-- Logs begin at Sat 2022-07-23 20:01:16 UTC, end at Sat 2022-07-23 22:43:41 UTC. -- Jul 23 20:56:11.291353 ncdv-master-1 systemd[1]: Starting Devstack devstack@keystone.service... Jul 23 20:56:11.300168 ncdv-master-1 devstack@keystone.service[91544]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 23 20:56:11.302940 ncdv-master-1 devstack@keystone.service[91544]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Jul 23 20:56:11 2022] *** Jul 23 20:56:11.303120 ncdv-master-1 devstack@keystone.service[91544]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 23 20:56:11.303270 ncdv-master-1 devstack@keystone.service[91544]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 23 20:56:11.303408 ncdv-master-1 devstack@keystone.service[91544]: nodename: ncdv-master-1 Jul 23 20:56:11.303537 ncdv-master-1 devstack@keystone.service[91544]: machine: x86_64 Jul 23 20:56:11.303669 ncdv-master-1 devstack@keystone.service[91544]: clock source: unix Jul 23 20:56:11.303794 ncdv-master-1 devstack@keystone.service[91544]: pcre jit disabled Jul 23 20:56:11.303918 ncdv-master-1 devstack@keystone.service[91544]: detected number of CPU cores: 4 Jul 23 20:56:11.304050 ncdv-master-1 devstack@keystone.service[91544]: current working directory: / Jul 23 20:56:11.304185 ncdv-master-1 devstack@keystone.service[91544]: detected binary path: /usr/bin/uwsgi-core Jul 23 20:56:11.304318 ncdv-master-1 devstack@keystone.service[91544]: your processes number limit is 47680 Jul 23 20:56:11.304318 ncdv-master-1 devstack@keystone.service[91544]: your memory page size is 4096 bytes Jul 23 20:56:11.304318 ncdv-master-1 devstack@keystone.service[91544]: detected max file descriptor number: 2048 Jul 23 20:56:11.304318 ncdv-master-1 devstack@keystone.service[91544]: lock engine: pthread robust mutexes Jul 23 20:56:11.304894 ncdv-master-1 devstack@keystone.service[91544]: thunder lock: enabled Jul 23 20:56:11.304894 ncdv-master-1 devstack@keystone.service[91544]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 23 20:56:11.304894 ncdv-master-1 devstack@keystone.service[91544]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 23 20:56:11.353068 ncdv-master-1 devstack@keystone.service[91544]: Python main interpreter initialized at 0x55ae195f69c0 Jul 23 20:56:11.353068 ncdv-master-1 devstack@keystone.service[91544]: python threads support enabled Jul 23 20:56:11.353068 ncdv-master-1 devstack@keystone.service[91544]: your server socket listen backlog is limited to 100 connections Jul 23 20:56:11.353068 ncdv-master-1 devstack@keystone.service[91544]: your mercy for graceful operations on workers is 90 seconds Jul 23 20:56:11.353444 ncdv-master-1 devstack@keystone.service[91544]: mapped 403077 bytes (393 KB) for 2 cores Jul 23 20:56:11.353523 ncdv-master-1 devstack@keystone.service[91544]: *** Operational MODE: preforking *** Jul 23 20:56:11.353784 ncdv-master-1 devstack@keystone.service[91544]: *** uWSGI is running in multiple interpreter mode *** Jul 23 20:56:11.353784 ncdv-master-1 devstack@keystone.service[91544]: spawned uWSGI master process (pid: 91544) Jul 23 20:56:11.354068 ncdv-master-1 systemd[1]: Started Devstack devstack@keystone.service. Jul 23 20:56:11.357909 ncdv-master-1 devstack@keystone.service[91544]: spawned uWSGI worker 1 (pid: 91547, cores: 1) Jul 23 20:56:11.357909 ncdv-master-1 devstack@keystone.service[91544]: spawned uWSGI worker 2 (pid: 91548, cores: 1) Jul 23 20:56:11.357909 ncdv-master-1 devstack@keystone.service[91544]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 23 20:56:17.045447 ncdv-master-1 devstack@keystone.service[91547]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 23 20:56:17.045447 ncdv-master-1 devstack@keystone.service[91547]: from cryptography.utils import int_from_bytes Jul 23 20:56:17.046338 ncdv-master-1 devstack@keystone.service[91547]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 23 20:56:17.046338 ncdv-master-1 devstack@keystone.service[91547]: from cryptography.utils import int_from_bytes Jul 23 20:56:17.046449 ncdv-master-1 devstack@keystone.service[91548]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 23 20:56:17.046449 ncdv-master-1 devstack@keystone.service[91548]: from cryptography.utils import int_from_bytes Jul 23 20:56:17.046893 ncdv-master-1 devstack@keystone.service[91548]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 23 20:56:17.046893 ncdv-master-1 devstack@keystone.service[91548]: from cryptography.utils import int_from_bytes Jul 23 20:56:17.094112 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 23 20:56:17.094304 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 23 20:56:17.094382 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] command line args: [] {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 23 20:56:17.094459 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 23 20:56:17.094670 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 23 20:56:17.094791 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 23 20:56:17.094865 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] command line args: [] {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 23 20:56:17.094934 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] ================================================================================ {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 23 20:56:17.095138 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] admin_token = **** {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:56:17.095284 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 23 20:56:17.095362 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] ================================================================================ {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 23 20:56:17.095435 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] config_dir = [] {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:56:17.095500 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:56:17.095626 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] admin_token = **** {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:56:17.095754 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] config_source = [] {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:56:17.095819 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] config_dir = [] {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:56:17.095896 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] debug = True {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:56:17.096014 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:56:17.096096 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:56:17.096296 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] config_source = [] {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:56:17.096414 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] debug = True {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:56:17.096519 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:56:17.096589 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:56:17.096679 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] insecure_debug = False {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:56:17.096805 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:56:17.096885 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:56:17.097085 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] insecure_debug = False {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:56:17.097192 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:56:17.097262 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:56:17.097326 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] list_limit = None {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:56:17.097457 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:56:17.097542 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] log_config_append = None {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:56:17.097639 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:56:17.097709 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] list_limit = None {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:56:17.097806 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] log_dir = None {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:56:17.097930 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] log_config_append = None {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:56:17.098045 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:56:17.098131 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] log_file = None {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:56:17.098239 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] log_dir = None {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:56:17.098313 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:56:17.098413 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] log_file = None {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:56:17.098527 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:56:17.098651 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:56:17.098887 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:56:17.099002 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:56:17.099147 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:56:17.099302 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:56:17.099384 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:56:17.099458 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:56:17.099544 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:56:17.099618 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:56:17.099696 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:56:17.099757 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:56:17.099950 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:56:17.100082 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:56:17.100168 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:56:17.100235 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:56:17.100363 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:56:17.100450 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:56:17.100569 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:56:17.100680 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:56:17.100810 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:56:17.100955 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:56:17.101046 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:56:17.101120 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:56:17.101271 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:56:17.101380 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] notification_format = cadf {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:56:17.101507 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] notification_format = cadf {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:56:17.101650 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:56:17.101754 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:56:17.102066 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.17/identity {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:56:17.102199 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] publish_errors = False {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:56:17.102299 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.17/identity {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:56:17.102433 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:56:17.102543 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] publish_errors = False {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:56:17.102643 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:56:17.102740 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:56:17.102868 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:56:17.102968 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:56:17.103064 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:56:17.103173 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:56:17.103318 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:56:17.103419 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:56:17.103517 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] standard_threads = False {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:56:17.103621 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:56:17.103827 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] strict_password_check = False {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:56:17.103928 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] standard_threads = False {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:56:17.104030 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:56:17.104265 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] strict_password_check = False {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:56:17.104344 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] use_eventlog = False {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:56:17.104559 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:56:17.104703 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] use_journal = False {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:56:17.104777 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] use_eventlog = False {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:56:17.104836 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] use_json = False {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:56:17.104903 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] use_journal = False {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:56:17.104968 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] use_stderr = False {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:56:17.105141 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] use_json = False {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:56:17.105215 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] use_syslog = False {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:56:17.105274 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] use_stderr = False {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:56:17.105337 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] watch_log_file = False {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:56:17.105402 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] use_syslog = False {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:56:17.105461 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.105525 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] watch_log_file = False {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 20:56:17.105585 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.105642 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.105697 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.105854 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.105958 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.106035 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.106097 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.106153 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.106280 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.106372 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.106547 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.106638 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.106753 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.106830 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.107009 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.107158 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.107237 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.107311 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.107493 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.107576 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.107709 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.107791 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.107963 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.108054 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.108172 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.108250 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.108426 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.108512 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.108671 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.108832 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.108896 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.108960 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.109119 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.109201 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.109384 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.109478 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.109614 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.109773 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.109902 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.109979 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.110098 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.110221 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.110336 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.110450 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.110594 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.110700 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.110845 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.110962 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.111060 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.111161 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.111258 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.111365 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.111467 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.111572 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.111702 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.111831 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.111945 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.112058 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.112183 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.112299 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.112411 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.112524 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.112752 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.112869 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.112996 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.113112 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.113209 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.113326 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.113440 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.113559 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.113685 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.113792 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.113935 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.114045 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.114156 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.114268 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.114466 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.114584 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.114697 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.114809 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.114924 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.115043 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.115166 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.115282 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.115394 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.115504 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.115607 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.115724 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.115848 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.115963 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.116077 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.116189 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.116302 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.116414 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.116523 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.116628 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.116739 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.116860 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.116974 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.117087 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.117209 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.117325 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.117444 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.117564 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.117679 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.117822 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.117967 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.118085 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.118199 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.118319 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.118441 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.118546 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.118669 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.118785 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.118899 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.119018 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.119134 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.119248 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.119375 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.119500 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.119617 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.119739 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.119855 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.119985 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.120102 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.120225 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.120342 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.120465 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.120581 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.120695 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.120808 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.120921 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.121047 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.121163 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.121284 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.121406 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.121522 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.121644 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.121768 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.121934 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.122052 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.122166 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.122281 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.122444 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.122562 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.122676 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.122790 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.122904 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.123018 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] cache.enabled = True {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.123140 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.123257 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.123355 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] cache.enabled = True {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.123467 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.123588 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.123703 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.123826 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.123942 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.123942 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.124157 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.124271 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.124385 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.124508 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.124624 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.124738 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.124852 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.124852 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.125074 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.125198 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.125314 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.125314 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.125528 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.125642 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.125756 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.125966 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.126087 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.126211 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.126334 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.126450 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.126566 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.126688 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.126813 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.126941 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.127042 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.127155 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.127276 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.127391 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.127505 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.127632 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.127749 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.127863 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.127986 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.128101 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.128311 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.128438 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.128564 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.128681 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.128795 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.128909 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.129023 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.129149 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.129274 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.129391 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.129505 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.129620 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.129734 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.129899 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] auth.external = None {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.130020 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.130140 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] auth.mapped = None {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.130255 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.130368 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.130497 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] auth.external = None {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.130615 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.130758 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] auth.mapped = None {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.130887 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] auth.password = None {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.131004 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.131127 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] auth.token = None {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.131244 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.131359 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.131482 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] auth.password = None {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.131600 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] catalog.caching = True {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.131717 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] auth.token = None {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.131832 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.131956 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.132081 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.132207 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] catalog.caching = True {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.132331 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.132448 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.132564 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.132680 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.132803 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.132929 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.133047 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] credential.caching = True {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.133163 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.133277 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] credential.driver = sql {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.133392 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.133508 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.133631 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] credential.caching = True {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.133755 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.133888 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] credential.driver = sql {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.134007 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.134122 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.134238 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.134368 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.134487 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.134602 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.134717 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.134833 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.134949 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.135073 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.135190 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.135305 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.135427 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.135544 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.135660 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.135784 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.135903 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.136010 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.136122 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.136238 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.136359 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.136484 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.136613 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.136731 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.136846 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] federation.caching = True {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.136972 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.137095 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.137220 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.137337 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] federation.driver = sql {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.137451 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] federation.caching = True {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.137566 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.137680 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.137795 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.137951 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] federation.driver = sql {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.138072 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.138188 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.138313 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.138430 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.138552 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.138686 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.138804 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.138919 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.139035 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.139151 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.139268 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.139392 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.139510 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.139625 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.139747 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] identity.caching = True {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.139864 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.139978 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.140178 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.140298 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.140414 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] identity.caching = True {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.140529 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.140644 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.140766 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.140884 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.140999 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] identity.driver = sql {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.141114 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.141230 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.141344 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.141472 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.141589 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] identity.driver = sql {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.141704 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.141820 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.141947 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.142062 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.142189 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.142189 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.142419 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.142535 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.142650 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.142765 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.142889 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.143007 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.143122 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.143122 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.143339 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.143454 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.143576 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.143694 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.143810 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.143925 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.144040 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.144155 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.144279 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.144398 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.144513 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.144513 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.144712 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.144809 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.144914 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.145019 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.145118 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.145214 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.145311 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.145408 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.145521 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.145641 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.145773 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.145943 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.146062 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.146206 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.146334 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.146517 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.146634 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.146759 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.146958 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.147079 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.147285 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.147408 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.147524 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.147624 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.147737 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.147851 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.147979 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.148098 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.148214 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.148313 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] ldap.password = **** {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.148408 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.148535 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.148662 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.148783 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.148902 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.149027 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.149148 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] ldap.password = **** {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.149246 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.149342 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.149424 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.149486 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.149545 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.149603 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.149669 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.149738 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.149806 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.149888 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.150014 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.150137 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.150236 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.150363 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.150482 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.150581 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.150695 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.150809 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.150923 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.150923 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.151151 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.151266 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] ldap.user = None {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.151381 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.151495 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.151611 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.151736 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.151854 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.151976 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.152093 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.152208 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.152331 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] ldap.user = None {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.152449 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.152564 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.153032 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.153154 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.153278 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.153404 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.153522 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.153636 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.153752 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.153932 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.154051 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.154182 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.154301 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.154419 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.154532 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.154646 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.154760 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.154929 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.155064 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.155214 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.155365 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.155482 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.155597 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.155722 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.155841 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.155956 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.156071 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.156185 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.156300 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.156424 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.156541 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.156657 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.156772 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.156888 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.157003 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.157003 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.157244 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.157367 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.157490 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.157606 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.157733 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.157881 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.158013 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.158143 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] policy.driver = sql {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.158262 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.158376 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.158488 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.158617 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.158735 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.158850 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.158948 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.159066 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] receipt.caching = True {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.159181 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.159304 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.159453 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] policy.driver = sql {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.159576 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.159692 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.159807 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.159922 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.160048 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.160170 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.160294 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.160411 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] receipt.caching = True {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.160527 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] resource.caching = True {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.160644 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.160864 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.161027 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.161187 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] resource.driver = sql {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.161319 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.161449 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.161528 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.161611 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.161687 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.161760 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.161832 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] resource.caching = True {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.161921 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] revoke.caching = True {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.161995 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.162080 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.162158 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] resource.driver = sql {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.162237 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.162312 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.162384 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] role.cache_time = None {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.162458 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.162613 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] role.caching = True {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.162691 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.162764 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] role.driver = sql {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.162837 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] revoke.caching = True {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.162908 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] role.list_limit = None {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.162980 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.163061 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.163137 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.163209 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.163282 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] role.cache_time = None {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.163353 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.163426 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] role.caching = True {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.163506 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.163581 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] role.driver = sql {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.163654 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.163726 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] role.list_limit = None {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.163797 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.163872 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.163954 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.164029 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.164102 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.164174 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.164246 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.164326 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.164401 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.164401 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.164531 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.164603 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.164676 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.164755 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.164831 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.164831 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.164961 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.165042 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.165116 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.165196 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.165264 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.165337 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.165409 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.165480 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.165551 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.165630 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.165705 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.165705 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.165836 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.165932 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.166006 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.166155 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.166245 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.166390 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.166459 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.166616 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.166684 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.166843 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.166924 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.167068 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.167147 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.167315 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.167395 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.167566 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.167648 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.167803 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.167882 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.168033 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.168120 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.168260 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.168339 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.168483 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] token.cache_time = None {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.168561 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.168721 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] token.caching = True {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.168809 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.168953 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.169033 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.169194 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] token.provider = fernet {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.169314 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.169436 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.169561 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.169687 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.169802 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.169969 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] token.cache_time = None {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.170086 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.170201 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] token.caching = True {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.170330 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.170448 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.170566 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.170681 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] token.provider = fernet {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.170796 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.170910 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.171037 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] trust.driver = sql {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.171155 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.171270 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.171270 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.171487 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.171487 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.171714 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.171832 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.171948 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.172063 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.172178 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.172178 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.172403 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] trust.driver = sql {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.172520 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.172637 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.172637 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.172854 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.172969 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.173092 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] database.connection = **** {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.173224 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.173354 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.173472 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.173588 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.173704 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.173826 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.173968 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.174097 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.174097 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.174322 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.174438 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.174553 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] database.connection = **** {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.174681 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.174808 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.174935 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.175053 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.175169 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.175285 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.175400 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.175514 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.175638 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.175757 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.175873 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.175987 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.176102 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.176217 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.176341 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.176459 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.176576 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.176691 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.176809 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.176925 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.177049 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.177168 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.177284 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.177400 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.177516 ncdv-master-1 devstack@keystone.service[91547]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=91547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 23 20:56:17.177633 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.177633 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.177917 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.178036 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.178186 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.178422 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 20:56:17.178593 ncdv-master-1 devstack@keystone.service[91548]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=91548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 23 20:56:17.208719 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=91547) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 23 20:56:17.208947 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=91547) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 23 20:56:17.209230 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=91547) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 23 20:56:17.209401 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=91548) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 23 20:56:17.209598 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=91548) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 23 20:56:17.209808 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=91548) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 23 20:56:17.217796 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=91547) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 23 20:56:17.218345 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=91548) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 23 20:56:17.246214 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=91547) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 23 20:56:17.246434 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=91547) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 23 20:56:17.246604 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=91548) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 23 20:56:17.246810 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=91548) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 23 20:56:17.299403 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=91547) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 23 20:56:17.299848 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=91548) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 23 20:56:17.349814 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=91547) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 23 20:56:17.350062 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=91547) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 23 20:56:17.350617 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=91548) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 23 20:56:17.350850 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=91548) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 23 20:56:17.416001 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91547) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 23 20:56:17.416213 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=91547) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 23 20:56:17.416355 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91548) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 23 20:56:17.416476 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=91547) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 23 20:56:17.416563 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=91548) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 23 20:56:17.416687 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=91547) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 23 20:56:17.416766 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=91548) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 23 20:56:17.416885 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=91547) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 23 20:56:17.416972 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=91548) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 23 20:56:17.417049 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=91547) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 23 20:56:17.417116 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=91548) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 23 20:56:17.417326 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=91548) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 23 20:56:17.440204 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91547) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 23 20:56:17.440402 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=91547) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 23 20:56:17.440487 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91548) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 23 20:56:17.440618 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=91547) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 23 20:56:17.440810 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=91548) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 23 20:56:17.440890 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=91547) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 23 20:56:17.440978 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=91548) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 23 20:56:17.441057 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=91547) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 23 20:56:17.441132 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=91548) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 23 20:56:17.441281 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=91547) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 23 20:56:17.441372 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=91548) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 23 20:56:17.441482 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=91547) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 23 20:56:17.441579 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=91548) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 23 20:56:17.441746 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=91548) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 23 20:56:17.454626 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=91547) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 23 20:56:17.455023 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=91548) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 23 20:56:17.467472 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91547) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 23 20:56:17.467655 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91548) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 23 20:56:17.467803 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=91547) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 23 20:56:17.467928 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=91548) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 23 20:56:17.468013 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=91547) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 23 20:56:17.468089 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=91548) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 23 20:56:17.468173 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=91547) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 23 20:56:17.468277 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=91547) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 23 20:56:17.468399 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=91548) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 23 20:56:17.468481 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=91548) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 23 20:56:17.468542 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=91547) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 23 20:56:17.468714 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=91547) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 23 20:56:17.468853 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=91548) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 23 20:56:17.468992 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=91548) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 23 20:56:17.485912 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=91547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.486184 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=91547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 23 20:56:17.486443 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=91547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.486597 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=91548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.486685 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=91547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 23 20:56:17.486762 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=91548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 23 20:56:17.486858 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=91547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.486946 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=91548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.487140 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=91547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.487279 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=91548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 23 20:56:17.487361 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=91547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.487425 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=91548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.487651 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=91547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.487741 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=91548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.487940 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=91548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.488192 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=91548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.498576 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=91547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.498843 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=91547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.499068 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=91547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.499193 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=91548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.499316 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=91547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.499514 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=91548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.499749 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=91548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.500028 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=91548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.507393 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=91547) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 23 20:56:17.508158 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=91548) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 23 20:56:17.510795 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=91547) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 23 20:56:17.511064 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=91547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.511341 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=91547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.511465 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=91548) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 23 20:56:17.511565 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=91547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.511718 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=91548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.511997 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=91547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.512124 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=91548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.512202 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=91547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.512280 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=91548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.512501 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=91547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.512629 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=91548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.512738 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=91547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.512915 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=91548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.513042 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=91547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.513148 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=91548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.513251 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=91547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.513441 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=91548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.513569 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=91547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.513689 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=91548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.514013 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=91548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.514283 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=91548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.540130 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=91547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.541144 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=91548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.541730 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=91547) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 23 20:56:17.542028 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=91547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.542804 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=91548) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 23 20:56:17.543081 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=91548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.547227 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=91547) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 23 20:56:17.547498 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=91547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.547772 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=91547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.548324 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=91548) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 23 20:56:17.548607 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=91548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.548885 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=91548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.555028 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=91547) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 23 20:56:17.555277 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=91547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.556258 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=91548) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 23 20:56:17.556535 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=91548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.559858 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=91547) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 23 20:56:17.560140 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=91547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.560405 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=91547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.560676 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=91547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.560938 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=91547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.561140 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=91548) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 23 20:56:17.561268 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=91547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.561460 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=91548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.561592 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=91547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.561685 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=91547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.561752 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=91548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.561994 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=91548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.562247 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=91548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.562542 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=91548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.562810 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=91548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.563061 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=91548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.580288 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=91547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.580560 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=91547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.581843 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=91548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.582144 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=91548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.585170 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=91547) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 23 20:56:17.586750 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=91548) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 23 20:56:17.588820 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=91547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.589105 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=91547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.590422 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=91548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.590712 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=91548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.594081 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=91547) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 23 20:56:17.595702 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=91548) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 23 20:56:17.597685 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=91547) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 23 20:56:17.599358 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=91548) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 23 20:56:17.601564 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=91547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.601801 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=91547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.602121 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=91547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.602400 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=91547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.602676 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=91547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.602954 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=91547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.603286 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=91548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.603581 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=91548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.603875 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=91548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.604151 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=91548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.604421 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=91548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.604699 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=91548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.621835 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=91547) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 23 20:56:17.622146 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=91547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.622501 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=91547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.622734 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=91547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.624056 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=91548) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 23 20:56:17.624338 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=91548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.624711 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=91548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.624971 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=91548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.630649 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=91547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.632345 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=91547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.632615 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=91547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.632998 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=91548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.634749 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=91548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.635026 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=91548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.635661 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=91547) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 23 20:56:17.635932 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=91547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.636213 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=91547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.636492 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=91547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.636782 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=91547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.638093 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=91548) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 23 20:56:17.638369 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=91548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.638665 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=91548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.638948 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=91548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.639225 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=91548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.650162 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=91547) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 23 20:56:17.650446 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=91547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.650719 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=91547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.650988 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=91547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.651258 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=91547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.651539 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=91547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.651788 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=91547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.653044 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=91548) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 23 20:56:17.653343 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=91548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.653619 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=91548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.653916 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=91548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.654193 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=91548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.654473 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=91548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.654742 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=91548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.670034 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=91547) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 23 20:56:17.672698 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=91548) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 23 20:56:17.673257 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=91547) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 23 20:56:17.676035 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=91548) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 23 20:56:17.676633 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=91547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.678239 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=91547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.679359 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=91548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.679857 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=91547) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 23 20:56:17.680134 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=91547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.680394 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=91547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.680958 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=91548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.682620 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=91548) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 23 20:56:17.682900 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=91548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.683180 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=91548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.687708 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=91547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.689304 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=91547) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 23 20:56:17.690577 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=91548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.692209 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=91548) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 23 20:56:17.692526 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=91547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.692805 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=91547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.693081 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=91547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.693357 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=91547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.695440 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=91548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.695727 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=91548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.695972 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=91548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.696282 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=91548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.703688 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=91547) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 23 20:56:17.703944 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=91547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.704246 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=91547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.706810 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=91548) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 23 20:56:17.707119 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=91548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.707472 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=91548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.712102 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=91547) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 23 20:56:17.712373 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=91547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.712656 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=91547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.712921 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=91547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.713179 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=91547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.713423 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=91547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.713691 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=91547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.713994 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=91547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.714255 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=91547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.714537 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=91547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.714804 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=91547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.715042 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=91547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.715298 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=91547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.715379 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=91548) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 23 20:56:17.715547 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=91547) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.715637 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=91548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.715883 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=91548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.716159 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=91548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.716431 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=91548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.716698 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=91548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.716972 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=91548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.717252 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=91548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.717520 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=91548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.717799 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=91548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.718103 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=91548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.718359 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=91548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.718626 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=91548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.718882 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=91548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 23 20:56:17.752883 ncdv-master-1 devstack@keystone.service[91547]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ae195f69c0 pid: 91547 (default app) Jul 23 20:56:17.756322 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922c421d-0c45-4af1-9afe-846a3ccb95a5 None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:17.756447 ncdv-master-1 devstack@keystone.service[91548]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ae195f69c0 pid: 91548 (default app) Jul 23 20:56:17.756599 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922c421d-0c45-4af1-9afe-846a3ccb95a5 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:17.756869 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922c421d-0c45-4af1-9afe-846a3ccb95a5 None None] PATH_INFO: `/v3` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:17.761112 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1/1] 10.222.0.17 () {50 vars in 791 bytes} [Sat Jul 23 20:56:17 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:56:25.930503 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be021be-e3b0-4553-856e-d961ee18a4a7 None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:25.931104 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be021be-e3b0-4553-856e-d961ee18a4a7 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:25.931104 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be021be-e3b0-4553-856e-d961ee18a4a7 None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:25.935411 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1/2] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:56:25 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:56:25.942143 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccf65d7-c1c7-4373-a167-cfde85dbc3f4 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:25.942667 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccf65d7-c1c7-4373-a167-cfde85dbc3f4 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:25.942822 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccf65d7-c1c7-4373-a167-cfde85dbc3f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:26.021893 ncdv-master-1 devstack@keystone.service[91547]: INFO dbcounter [None req-bccf65d7-c1c7-4373-a167-cfde85dbc3f4 None None] Registered counter for database keystone Jul 23 20:56:26.046151 ncdv-master-1 devstack@keystone.service[91547]: DEBUG oslo_db.sqlalchemy.engines [None req-bccf65d7-c1c7-4373-a167-cfde85dbc3f4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=91547) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 23 20:56:26.053769 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writer thread running {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 23 20:56:26.242856 ncdv-master-1 devstack@keystone.service[91547]: DEBUG passlib.handlers.bcrypt [None req-bccf65d7-c1c7-4373-a167-cfde85dbc3f4 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=91547) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 23 20:56:26.243197 ncdv-master-1 devstack@keystone.service[91547]: DEBUG passlib.handlers.bcrypt [None req-bccf65d7-c1c7-4373-a167-cfde85dbc3f4 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=91547) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 23 20:56:26.300862 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-bccf65d7-c1c7-4373-a167-cfde85dbc3f4 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:56:26.302564 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-bccf65d7-c1c7-4373-a167-cfde85dbc3f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:56:26.436342 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2/3] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:56:25 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 496 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 23 20:56:26.560888 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be021be-e3b0-4553-856e-d961ee18a4a7 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:56:26.639471 ncdv-master-1 devstack@keystone.service[91548]: INFO dbcounter [None req-5be021be-e3b0-4553-856e-d961ee18a4a7 None None] Registered counter for database keystone Jul 23 20:56:26.660471 ncdv-master-1 devstack@keystone.service[91548]: DEBUG oslo_db.sqlalchemy.engines [None req-5be021be-e3b0-4553-856e-d961ee18a4a7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=91548) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 23 20:56:26.667663 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writer thread running {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 23 20:56:26.787863 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be021be-e3b0-4553-856e-d961ee18a4a7 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:56:26.792636 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760b7925-c922-4f31-8f8d-cb90fa5a681d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:56:26.793318 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760b7925-c922-4f31-8f8d-cb90fa5a681d admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:26.793594 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760b7925-c922-4f31-8f8d-cb90fa5a681d admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:26.793895 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760b7925-c922-4f31-8f8d-cb90fa5a681d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:26.808630 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760b7925-c922-4f31-8f8d-cb90fa5a681d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:56:26.864096 ncdv-master-1 devstack@keystone.service[91548]: WARNING keystone.common.rbac_enforcer.enforcer [None req-760b7925-c922-4f31-8f8d-cb90fa5a681d admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 23 20:56:26.864427 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760b7925-c922-4f31-8f8d-cb90fa5a681d admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:56:26.875209 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2/4] 10.222.0.17 () {58 vars in 1324 bytes} [Sat Jul 23 20:56:26 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 23 20:56:26.881516 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccf65d7-c1c7-4373-a167-cfde85dbc3f4 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:56:26.896509 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccf65d7-c1c7-4373-a167-cfde85dbc3f4 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:56:26.900992 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32834cc-2113-4cb1-a77c-adb2150b52d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:56:26.902196 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32834cc-2113-4cb1-a77c-adb2150b52d2 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:26.902477 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32834cc-2113-4cb1-a77c-adb2150b52d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:26.902742 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32834cc-2113-4cb1-a77c-adb2150b52d2 admin admin] PATH_INFO: `/v3/projects/d6f3124c18f04946a431e587fc205bd4` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:26.905066 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32834cc-2113-4cb1-a77c-adb2150b52d2 admin admin] RBAC: Authorizing `identity:get_project(project_id=d6f3124c18f04946a431e587fc205bd4)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:56:26.957460 ncdv-master-1 devstack@keystone.service[91547]: WARNING keystone.common.rbac_enforcer.enforcer [None req-e32834cc-2113-4cb1-a77c-adb2150b52d2 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 23 20:56:26.958213 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32834cc-2113-4cb1-a77c-adb2150b52d2 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:56:26.962606 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3/5] 10.222.0.17 () {56 vars in 1207 bytes} [Sat Jul 23 20:56:26 2022] GET /identity/v3/projects/d6f3124c18f04946a431e587fc205bd4 => generated 344 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 20:56:29.204678 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d823048d-820f-41ee-91bc-3f22e0a23ac5 None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:29.205189 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d823048d-820f-41ee-91bc-3f22e0a23ac5 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:29.205189 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d823048d-820f-41ee-91bc-3f22e0a23ac5 None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:29.209283 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3/6] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:56:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:56:29.215175 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ae40b4-1dc0-44e3-beae-b6c349df04b9 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:29.215638 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ae40b4-1dc0-44e3-beae-b6c349df04b9 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:29.215730 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ae40b4-1dc0-44e3-beae-b6c349df04b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:29.235463 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-93ae40b4-1dc0-44e3-beae-b6c349df04b9 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:56:29.237013 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-93ae40b4-1dc0-44e3-beae-b6c349df04b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:56:29.247267 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4/7] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:56:29 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 23 20:56:29.271452 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d823048d-820f-41ee-91bc-3f22e0a23ac5 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:56:29.290117 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d823048d-820f-41ee-91bc-3f22e0a23ac5 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:56:29.295790 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85460f39-c3d4-4d5e-9442-88569482f8dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:56:29.296446 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85460f39-c3d4-4d5e-9442-88569482f8dc admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:29.296699 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85460f39-c3d4-4d5e-9442-88569482f8dc admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:29.297023 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85460f39-c3d4-4d5e-9442-88569482f8dc admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:29.305436 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85460f39-c3d4-4d5e-9442-88569482f8dc admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:56:29.307294 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85460f39-c3d4-4d5e-9442-88569482f8dc admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:56:29.316696 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4/8] 10.222.0.17 () {58 vars in 1324 bytes} [Sat Jul 23 20:56:29 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 23 20:56:29.322755 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ae40b4-1dc0-44e3-beae-b6c349df04b9 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:56:29.332624 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ae40b4-1dc0-44e3-beae-b6c349df04b9 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:56:29.338515 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cadce1-d4b5-406a-9029-f78df970bc06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:56:29.339404 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cadce1-d4b5-406a-9029-f78df970bc06 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:29.339683 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cadce1-d4b5-406a-9029-f78df970bc06 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:29.339932 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cadce1-d4b5-406a-9029-f78df970bc06 admin admin] PATH_INFO: `/v3/users/ef460ef8c739443881697a7ad53288a2` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:29.341519 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cadce1-d4b5-406a-9029-f78df970bc06 admin admin] RBAC: Authorizing `identity:get_user(user_id=ef460ef8c739443881697a7ad53288a2)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:56:29.343439 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cadce1-d4b5-406a-9029-f78df970bc06 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:56:29.345052 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 5/9] 10.222.0.17 () {56 vars in 1198 bytes} [Sat Jul 23 20:56:29 2022] GET /identity/v3/users/ef460ef8c739443881697a7ad53288a2 => generated 247 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:56:31.670765 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4f83b6-4346-4b4f-abe2-292fccc88553 None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:31.671311 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4f83b6-4346-4b4f-abe2-292fccc88553 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:31.671311 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4f83b6-4346-4b4f-abe2-292fccc88553 None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:31.672647 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 5/10] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:56:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:56:31.678403 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95106a82-0f80-48ac-8e04-073b0b960145 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:31.678859 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95106a82-0f80-48ac-8e04-073b0b960145 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:31.678961 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95106a82-0f80-48ac-8e04-073b0b960145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:31.681183 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27da0866-a95e-4714-acca-4c9dce241fd0 None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:31.681441 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27da0866-a95e-4714-acca-4c9dce241fd0 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:31.681713 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27da0866-a95e-4714-acca-4c9dce241fd0 None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:31.683081 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 6/11] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:56:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:56:31.688354 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4c63c1-86b3-48fc-a42f-6a215ffab0f0 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:31.688640 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4c63c1-86b3-48fc-a42f-6a215ffab0f0 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:31.688909 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4c63c1-86b3-48fc-a42f-6a215ffab0f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:31.696698 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-95106a82-0f80-48ac-8e04-073b0b960145 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:56:31.697946 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-95106a82-0f80-48ac-8e04-073b0b960145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:56:31.731677 ncdv-master-1 devstack@keystone.service[91548]: DEBUG passlib.handlers.bcrypt [None req-8e4c63c1-86b3-48fc-a42f-6a215ffab0f0 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=91548) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 23 20:56:31.732101 ncdv-master-1 devstack@keystone.service[91548]: DEBUG passlib.handlers.bcrypt [None req-8e4c63c1-86b3-48fc-a42f-6a215ffab0f0 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=91548) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 23 20:56:31.777693 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-8e4c63c1-86b3-48fc-a42f-6a215ffab0f0 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:56:31.779829 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-8e4c63c1-86b3-48fc-a42f-6a215ffab0f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:56:31.784354 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 6/12] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:56:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 23 20:56:31.809415 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95106a82-0f80-48ac-8e04-073b0b960145 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:56:31.835510 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:56:31.884178 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 7/13] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:56:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 23 20:56:31.908258 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4c63c1-86b3-48fc-a42f-6a215ffab0f0 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:56:31.918473 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95106a82-0f80-48ac-8e04-073b0b960145 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:56:31.959508 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22935167-b2b5-47c2-b730-b639efd61e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:56:31.960229 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22935167-b2b5-47c2-b730-b639efd61e6f None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:31.960505 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22935167-b2b5-47c2-b730-b639efd61e6f None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:31.960780 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22935167-b2b5-47c2-b730-b639efd61e6f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:32.019456 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4c63c1-86b3-48fc-a42f-6a215ffab0f0 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:56:32.022176 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:56:32.060268 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeb7776-014e-4a4f-93f2-ee6a765c000e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:56:32.061220 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeb7776-014e-4a4f-93f2-ee6a765c000e None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:32.061486 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeb7776-014e-4a4f-93f2-ee6a765c000e None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:32.061757 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeb7776-014e-4a4f-93f2-ee6a765c000e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:32.134381 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22935167-b2b5-47c2-b730-b639efd61e6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:56:32.145895 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfeb7776-014e-4a4f-93f2-ee6a765c000e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:56:32.147662 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfeb7776-014e-4a4f-93f2-ee6a765c000e None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:56:32.157463 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-22935167-b2b5-47c2-b730-b639efd61e6f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 23 20:56:32.157463 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:56:32.157463 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:56:32.157463 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:56:32.157463 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:56:32.157463 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:56:32.157463 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:56:32.157463 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:56:32.157463 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:56:32.157463 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:56:32.157463 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:56:32.157463 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:56:32.157463 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:56:32.157463 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:56:32.157463 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:56:32.157463 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:56:32.158632 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:56:32.158632 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:56:32.158632 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:56:32.158632 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:56:32.158632 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:56:32.158632 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:56:32.158632 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:56:32.158632 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:56:32.158632 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:56:32.158632 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:56:32.158632 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:56:32.158632 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application with Lock( Jul 23 20:56:32.158632 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:56:32.158632 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:56:32.158632 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:56:32.158632 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:56:32.159752 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:56:32.159752 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:56:32.159752 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:56:32.159752 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:56:32.159752 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:56:32.159752 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:56:32.159752 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:56:32.159752 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:56:32.159752 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:56:32.159752 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:56:32.159752 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 23 20:56:32.159752 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:56:32.160498 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 7/14] 10.222.0.17 () {56 vars in 1096 bytes} [Sat Jul 23 20:56:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 351 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:56:32.167032 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22935167-b2b5-47c2-b730-b639efd61e6f None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:56:32.265092 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:56:32.269724 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 8/15] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Jul 23 20:56:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 23 20:56:32.275479 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeb7776-014e-4a4f-93f2-ee6a765c000e None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:56:32.278792 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:56:32.286021 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22935167-b2b5-47c2-b730-b639efd61e6f None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:56:32.320926 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784cfa07-7d05-409f-8f1d-9ef39bfc362e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:56:32.321609 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784cfa07-7d05-409f-8f1d-9ef39bfc362e None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:32.321922 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784cfa07-7d05-409f-8f1d-9ef39bfc362e None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:32.322201 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784cfa07-7d05-409f-8f1d-9ef39bfc362e None admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:32.322970 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784cfa07-7d05-409f-8f1d-9ef39bfc362e None admin] RBAC: Adding query filter params (name=admin) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:56:32.323275 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784cfa07-7d05-409f-8f1d-9ef39bfc362e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:56:32.324691 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784cfa07-7d05-409f-8f1d-9ef39bfc362e None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:56:32.336931 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 8/16] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Jul 23 20:56:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:56:32.342820 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784cfa07-7d05-409f-8f1d-9ef39bfc362e None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:56:32.378940 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeb7776-014e-4a4f-93f2-ee6a765c000e None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:56:32.414035 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c43ad25-e4a6-4d1f-b8ce-0cb3d65a2402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:56:32.414845 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c43ad25-e4a6-4d1f-b8ce-0cb3d65a2402 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:32.415126 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c43ad25-e4a6-4d1f-b8ce-0cb3d65a2402 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:32.415400 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c43ad25-e4a6-4d1f-b8ce-0cb3d65a2402 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:32.434849 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c43ad25-e4a6-4d1f-b8ce-0cb3d65a2402 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:56:32.436336 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c43ad25-e4a6-4d1f-b8ce-0cb3d65a2402 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:56:32.447035 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784cfa07-7d05-409f-8f1d-9ef39bfc362e None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:56:32.457446 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-3c43ad25-e4a6-4d1f-b8ce-0cb3d65a2402 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:56:32.457446 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:56:32.457446 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:56:32.457446 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:56:32.457446 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:56:32.457446 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:56:32.457446 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:56:32.457446 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:56:32.457446 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:56:32.457446 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:56:32.457446 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:56:32.457446 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:56:32.457446 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 23 20:56:32.457446 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 23 20:56:32.457446 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 23 20:56:32.458322 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 23 20:56:32.458322 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:56:32.458322 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:56:32.458322 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:56:32.458322 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:56:32.458322 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:56:32.458322 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:56:32.458322 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:56:32.458322 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application with Lock( Jul 23 20:56:32.458322 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:56:32.458322 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:56:32.458322 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:56:32.458322 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:56:32.458322 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:56:32.458322 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:56:32.458322 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:56:32.458322 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:56:32.459323 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 23 20:56:32.459323 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 23 20:56:32.459323 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:56:32.459323 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 20:56:32.459323 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 9/17] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 23 20:56:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 23 20:56:32.464720 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c43ad25-e4a6-4d1f-b8ce-0cb3d65a2402 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:56:32.483524 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30657a8c-fb0a-4c48-b3cc-cdb74d0009c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:56:32.484426 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30657a8c-fb0a-4c48-b3cc-cdb74d0009c2 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:32.484703 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30657a8c-fb0a-4c48-b3cc-cdb74d0009c2 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:32.484975 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30657a8c-fb0a-4c48-b3cc-cdb74d0009c2 None admin] PATH_INFO: `/v3/users/ef460ef8c739443881697a7ad53288a2` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:32.486315 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30657a8c-fb0a-4c48-b3cc-cdb74d0009c2 None admin] RBAC: Authorizing `identity:get_user(user_id=ef460ef8c739443881697a7ad53288a2)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:56:32.487892 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30657a8c-fb0a-4c48-b3cc-cdb74d0009c2 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:56:32.489762 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 9/18] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Jul 23 20:56:32 2022] GET /identity/v3/users/ef460ef8c739443881697a7ad53288a2 => generated 247 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 20:56:32.495225 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30657a8c-fb0a-4c48-b3cc-cdb74d0009c2 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:56:32.509748 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:56:32.523510 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:56:32.603970 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30657a8c-fb0a-4c48-b3cc-cdb74d0009c2 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:56:32.644550 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bb1037-dbd7-4077-8040-6c6fb6035def None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:56:32.645368 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bb1037-dbd7-4077-8040-6c6fb6035def None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:32.645651 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bb1037-dbd7-4077-8040-6c6fb6035def None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:32.645942 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bb1037-dbd7-4077-8040-6c6fb6035def None admin] PATH_INFO: `/v3/domains/default` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:32.647182 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bb1037-dbd7-4077-8040-6c6fb6035def None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:56:32.648677 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bb1037-dbd7-4077-8040-6c6fb6035def None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:56:32.650373 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 10/19] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 23 20:56:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 20:56:32.656706 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bb1037-dbd7-4077-8040-6c6fb6035def None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:56:32.688902 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c43ad25-e4a6-4d1f-b8ce-0cb3d65a2402 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:56:32.731979 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5073ee2d-00ec-4bec-a3cd-aa33bfa463f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:56:32.733037 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5073ee2d-00ec-4bec-a3cd-aa33bfa463f4 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:32.733482 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5073ee2d-00ec-4bec-a3cd-aa33bfa463f4 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:32.733968 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5073ee2d-00ec-4bec-a3cd-aa33bfa463f4 None admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:32.735213 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5073ee2d-00ec-4bec-a3cd-aa33bfa463f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:56:32.735713 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5073ee2d-00ec-4bec-a3cd-aa33bfa463f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:56:32.738140 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5073ee2d-00ec-4bec-a3cd-aa33bfa463f4 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:56:32.764834 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:56:32.765423 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 10/20] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 23 20:56:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 20:56:32.788908 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bb1037-dbd7-4077-8040-6c6fb6035def None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:56:32.838714 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f40bdd-d0ed-4d28-8403-4cd137d07801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:56:32.839588 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f40bdd-d0ed-4d28-8403-4cd137d07801 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:32.839967 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f40bdd-d0ed-4d28-8403-4cd137d07801 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:32.840276 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f40bdd-d0ed-4d28-8403-4cd137d07801 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:32.841298 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f40bdd-d0ed-4d28-8403-4cd137d07801 None admin] RBAC: Adding query filter params (role.id=fec17bfdc65349a2b9c06a89131191df, scope.domain.id=default, user.id=ef460ef8c739443881697a7ad53288a2) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:56:32.841747 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f40bdd-d0ed-4d28-8403-4cd137d07801 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:56:32.843410 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f40bdd-d0ed-4d28-8403-4cd137d07801 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:56:32.852458 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 11/21] 10.222.0.17 () {56 vars in 1322 bytes} [Sat Jul 23 20:56:32 2022] GET /identity/v3/role_assignments?user.id=ef460ef8c739443881697a7ad53288a2&scope.domain.id=default&role.id=fec17bfdc65349a2b9c06a89131191df => generated 233 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 20:56:35.361496 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a29505-105f-4159-9a3d-ea92afeebe41 None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:35.362044 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a29505-105f-4159-9a3d-ea92afeebe41 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:35.362117 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a29505-105f-4159-9a3d-ea92afeebe41 None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:35.363528 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 11/22] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:56:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:56:35.369234 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0086fb-39d6-4969-8b61-97d11f864399 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:35.369706 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0086fb-39d6-4969-8b61-97d11f864399 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:35.369790 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0086fb-39d6-4969-8b61-97d11f864399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:35.394819 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-4f0086fb-39d6-4969-8b61-97d11f864399 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:56:35.396142 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-4f0086fb-39d6-4969-8b61-97d11f864399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:56:35.496971 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 12/23] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:56:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 23 20:56:35.539153 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a29505-105f-4159-9a3d-ea92afeebe41 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:56:35.550796 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32152c8-6554-44aa-a2ea-d752b849f178 None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:35.551088 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32152c8-6554-44aa-a2ea-d752b849f178 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:35.551362 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32152c8-6554-44aa-a2ea-d752b849f178 None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:35.552744 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 13/24] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:56:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:56:35.558664 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4430cb0-3d7c-4685-8b64-5eb896df8536 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:35.559270 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4430cb0-3d7c-4685-8b64-5eb896df8536 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:35.559551 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4430cb0-3d7c-4685-8b64-5eb896df8536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:35.590728 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-b4430cb0-3d7c-4685-8b64-5eb896df8536 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:56:35.591981 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-b4430cb0-3d7c-4685-8b64-5eb896df8536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:56:35.706010 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 14/25] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:56:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 23 20:56:35.747004 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4430cb0-3d7c-4685-8b64-5eb896df8536 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:56:35.750392 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:56:35.755379 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a29505-105f-4159-9a3d-ea92afeebe41 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:56:35.795395 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:56:35.852228 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9a2440-673b-4f6a-8347-c858e5051e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:56:35.853091 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9a2440-673b-4f6a-8347-c858e5051e75 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:35.853372 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9a2440-673b-4f6a-8347-c858e5051e75 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:35.853643 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9a2440-673b-4f6a-8347-c858e5051e75 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:35.879257 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9a2440-673b-4f6a-8347-c858e5051e75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:56:35.881162 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9a2440-673b-4f6a-8347-c858e5051e75 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:56:35.917054 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-fa9a2440-673b-4f6a-8347-c858e5051e75 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:56:35.917054 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:56:35.917054 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:56:35.917054 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:56:35.917054 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:56:35.917054 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:56:35.917054 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:56:35.917054 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:56:35.917054 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:56:35.917054 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:56:35.917054 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:56:35.917054 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:56:35.917054 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 23 20:56:35.917054 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 23 20:56:35.917054 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 23 20:56:35.918025 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 23 20:56:35.918025 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:56:35.918025 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:56:35.918025 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:56:35.918025 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:56:35.918025 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:56:35.918025 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:56:35.918025 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:56:35.918025 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application with Lock( Jul 23 20:56:35.918025 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:56:35.918025 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:56:35.918025 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:56:35.918025 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:56:35.918025 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:56:35.918025 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:56:35.918025 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:56:35.918025 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:56:35.918844 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 23 20:56:35.918844 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 23 20:56:35.918844 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:56:35.918844 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 20:56:35.926840 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 12/26] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 23 20:56:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 388 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:56:35.932299 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9a2440-673b-4f6a-8347-c858e5051e75 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:56:35.968161 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4430cb0-3d7c-4685-8b64-5eb896df8536 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:56:36.042306 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406e715b-bf31-4094-bde3-c5487709746f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:56:36.043658 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406e715b-bf31-4094-bde3-c5487709746f None admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:36.044157 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406e715b-bf31-4094-bde3-c5487709746f None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:36.045064 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406e715b-bf31-4094-bde3-c5487709746f None admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:36.046331 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406e715b-bf31-4094-bde3-c5487709746f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:56:36.048227 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406e715b-bf31-4094-bde3-c5487709746f None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:56:36.124501 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9a2440-673b-4f6a-8347-c858e5051e75 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:56:36.166471 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137329b4-2cb0-4ee6-b200-35e1b65c742e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:56:36.167488 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137329b4-2cb0-4ee6-b200-35e1b65c742e None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:36.167920 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137329b4-2cb0-4ee6-b200-35e1b65c742e None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:36.168329 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137329b4-2cb0-4ee6-b200-35e1b65c742e None admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:36.169210 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137329b4-2cb0-4ee6-b200-35e1b65c742e None admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:56:36.169657 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137329b4-2cb0-4ee6-b200-35e1b65c742e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:56:36.171227 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137329b4-2cb0-4ee6-b200-35e1b65c742e None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:56:36.192135 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 13/27] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 23 20:56:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:56:36.193694 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c000a6-a561-478a-9e60-c20ee166dee3 None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:36.194150 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c000a6-a561-478a-9e60-c20ee166dee3 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:36.194669 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c000a6-a561-478a-9e60-c20ee166dee3 None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:36.196043 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 14/28] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:56:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:56:36.197227 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec13d2e-9fc2-4af0-ad0f-5a40ee9f1385 None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:36.199628 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec13d2e-9fc2-4af0-ad0f-5a40ee9f1385 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:36.200057 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec13d2e-9fc2-4af0-ad0f-5a40ee9f1385 None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:36.201421 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 15/29] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:56:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:56:36.208754 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec13d2e-9fc2-4af0-ad0f-5a40ee9f1385 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:56:36.261581 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:56:36.268577 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 15/30] 10.222.0.17 () {60 vars in 1131 bytes} [Sat Jul 23 20:56:35 2022] POST /identity/v3/roles => generated 219 bytes in 522 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 20:56:36.270436 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430a8ef8-51f5-427e-af62-dc0b2282b98d None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:36.270873 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430a8ef8-51f5-427e-af62-dc0b2282b98d None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:36.271292 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430a8ef8-51f5-427e-af62-dc0b2282b98d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:36.310830 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-430a8ef8-51f5-427e-af62-dc0b2282b98d None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:56:36.313644 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-430a8ef8-51f5-427e-af62-dc0b2282b98d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:56:36.441374 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec13d2e-9fc2-4af0-ad0f-5a40ee9f1385 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:56:36.448801 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:56:36.465844 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 16/31] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:56:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 23 20:56:36.467073 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7542a1-df8d-47f5-9aee-f39e987d76c3 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:36.467366 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7542a1-df8d-47f5-9aee-f39e987d76c3 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:36.467646 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7542a1-df8d-47f5-9aee-f39e987d76c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:36.500168 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-ba7542a1-df8d-47f5-9aee-f39e987d76c3 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:56:36.501412 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-ba7542a1-df8d-47f5-9aee-f39e987d76c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:56:36.521198 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2612e4e3-0692-4f91-a614-0661310e7a50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:56:36.521889 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2612e4e3-0692-4f91-a614-0661310e7a50 None admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:36.522185 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2612e4e3-0692-4f91-a614-0661310e7a50 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:36.522514 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2612e4e3-0692-4f91-a614-0661310e7a50 None admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:36.523442 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2612e4e3-0692-4f91-a614-0661310e7a50 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:56:36.524925 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2612e4e3-0692-4f91-a614-0661310e7a50 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:56:36.617819 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 17/32] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:56:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 23 20:56:36.619092 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7542a1-df8d-47f5-9aee-f39e987d76c3 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:56:36.694206 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 16/33] 10.222.0.17 () {60 vars in 1141 bytes} [Sat Jul 23 20:56:36 2022] POST /identity/v3/projects => generated 301 bytes in 482 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 20:56:36.707306 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2612e4e3-0692-4f91-a614-0661310e7a50 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:56:36.765276 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7542a1-df8d-47f5-9aee-f39e987d76c3 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:56:36.797071 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:56:36.811783 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235cf715-e865-4059-bd43-9119d26edd34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:56:36.813082 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235cf715-e865-4059-bd43-9119d26edd34 None admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:36.813574 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235cf715-e865-4059-bd43-9119d26edd34 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:36.814078 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235cf715-e865-4059-bd43-9119d26edd34 None admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:36.815133 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235cf715-e865-4059-bd43-9119d26edd34 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:56:36.817100 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235cf715-e865-4059-bd43-9119d26edd34 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:56:36.841992 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 18/34] 10.222.0.17 () {60 vars in 1131 bytes} [Sat Jul 23 20:56:36 2022] POST /identity/v3/roles => generated 225 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 20:56:36.898004 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:56:36.928536 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2612e4e3-0692-4f91-a614-0661310e7a50 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:56:36.985017 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e317a5-08bd-4a51-9cd7-6ac267928403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:56:36.985916 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e317a5-08bd-4a51-9cd7-6ac267928403 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:36.986212 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e317a5-08bd-4a51-9cd7-6ac267928403 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:36.986493 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e317a5-08bd-4a51-9cd7-6ac267928403 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:37.006897 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e317a5-08bd-4a51-9cd7-6ac267928403 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:56:37.016342 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-38e317a5-08bd-4a51-9cd7-6ac267928403 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 23 20:56:37.016342 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:56:37.016342 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:56:37.016342 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:56:37.016342 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:56:37.016342 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:56:37.016342 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:56:37.016342 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:56:37.016342 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:56:37.016342 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:56:37.016342 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:56:37.016342 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:56:37.016342 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:56:37.016342 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:56:37.016342 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:56:37.016342 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:56:37.017229 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:56:37.017229 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:56:37.017229 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:56:37.017229 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:56:37.017229 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:56:37.017229 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:56:37.017229 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:56:37.017229 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:56:37.017229 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:56:37.017229 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:56:37.017229 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:56:37.017229 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application with Lock( Jul 23 20:56:37.017229 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:56:37.017229 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:56:37.017229 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:56:37.017229 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:56:37.018014 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:56:37.018014 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:56:37.018014 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:56:37.018014 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:56:37.018014 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:56:37.018014 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:56:37.018014 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:56:37.018014 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:56:37.018014 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:56:37.018014 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:56:37.018014 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 23 20:56:37.018014 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 20:56:37.018014 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 17/35] 10.222.0.17 () {56 vars in 1096 bytes} [Sat Jul 23 20:56:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 23 20:56:37.025897 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235cf715-e865-4059-bd43-9119d26edd34 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:56:37.144845 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f46b3a-c257-4ad1-9a8b-f2799c3408e2 None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:37.145145 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f46b3a-c257-4ad1-9a8b-f2799c3408e2 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:37.145321 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f46b3a-c257-4ad1-9a8b-f2799c3408e2 None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:37.146933 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 18/36] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:56:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 23 20:56:37.153720 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6326938d-2144-4e0f-9161-877c5bd172a1 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:37.154043 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6326938d-2144-4e0f-9161-877c5bd172a1 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:37.154320 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6326938d-2144-4e0f-9161-877c5bd172a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:37.180682 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-6326938d-2144-4e0f-9161-877c5bd172a1 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:56:37.182374 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-6326938d-2144-4e0f-9161-877c5bd172a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:56:37.199283 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235cf715-e865-4059-bd43-9119d26edd34 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:56:37.238610 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bdbf95-2a51-454a-9443-e23a70c4117f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:56:37.239308 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bdbf95-2a51-454a-9443-e23a70c4117f None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:37.239591 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bdbf95-2a51-454a-9443-e23a70c4117f None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:37.239870 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bdbf95-2a51-454a-9443-e23a70c4117f None admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:37.240638 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bdbf95-2a51-454a-9443-e23a70c4117f None admin] RBAC: Adding query filter params (name=admin) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:56:37.240947 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bdbf95-2a51-454a-9443-e23a70c4117f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:56:37.242418 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bdbf95-2a51-454a-9443-e23a70c4117f None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:56:37.251831 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 19/37] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Jul 23 20:56:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:56:37.253272 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90f2986-f17e-49e2-9a9c-c02d7db13de8 None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:37.253518 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90f2986-f17e-49e2-9a9c-c02d7db13de8 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:37.253852 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90f2986-f17e-49e2-9a9c-c02d7db13de8 None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:37.255172 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 20/38] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:56:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:56:37.258615 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90f2986-f17e-49e2-9a9c-c02d7db13de8 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:56:37.271299 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 19/39] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:56:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 23 20:56:37.272619 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f23ed0-e442-417e-b39a-0045e0656818 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:37.272941 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f23ed0-e442-417e-b39a-0045e0656818 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:37.273209 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f23ed0-e442-417e-b39a-0045e0656818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:37.290372 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-86f23ed0-e442-417e-b39a-0045e0656818 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:56:37.291587 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-86f23ed0-e442-417e-b39a-0045e0656818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:56:37.313039 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:56:37.357737 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:56:37.362835 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 20/40] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:56:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 23 20:56:37.364607 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f23ed0-e442-417e-b39a-0045e0656818 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:56:37.369731 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90f2986-f17e-49e2-9a9c-c02d7db13de8 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:56:37.407133 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcd31e4-8bf7-4b89-84e3-1db6fffd9aaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:56:37.408010 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcd31e4-8bf7-4b89-84e3-1db6fffd9aaa None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:37.408290 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcd31e4-8bf7-4b89-84e3-1db6fffd9aaa None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:37.408604 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcd31e4-8bf7-4b89-84e3-1db6fffd9aaa None admin] PATH_INFO: `/v3/users/ef460ef8c739443881697a7ad53288a2` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:37.409951 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcd31e4-8bf7-4b89-84e3-1db6fffd9aaa None admin] RBAC: Authorizing `identity:get_user(user_id=ef460ef8c739443881697a7ad53288a2)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:56:37.411447 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcd31e4-8bf7-4b89-84e3-1db6fffd9aaa None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:56:37.413119 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 21/41] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Jul 23 20:56:37 2022] GET /identity/v3/users/ef460ef8c739443881697a7ad53288a2 => generated 247 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 20:56:37.414001 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcd31e4-8bf7-4b89-84e3-1db6fffd9aaa None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:56:37.481382 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f23ed0-e442-417e-b39a-0045e0656818 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:56:37.514240 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcd31e4-8bf7-4b89-84e3-1db6fffd9aaa None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:56:37.516855 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd9fef2-ca07-4b2e-8dfc-26e898f64cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:56:37.517681 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd9fef2-ca07-4b2e-8dfc-26e898f64cbf None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:37.518001 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd9fef2-ca07-4b2e-8dfc-26e898f64cbf None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:37.518279 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd9fef2-ca07-4b2e-8dfc-26e898f64cbf None admin] PATH_INFO: `/v3/domains/default` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:37.519504 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd9fef2-ca07-4b2e-8dfc-26e898f64cbf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:56:37.521111 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd9fef2-ca07-4b2e-8dfc-26e898f64cbf None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:56:37.522800 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 21/42] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 23 20:56:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:56:37.524280 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd9fef2-ca07-4b2e-8dfc-26e898f64cbf None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:56:37.529129 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:56:37.550224 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dbe97b-9e9a-4264-8586-2cd20e4a376d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:56:37.550916 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dbe97b-9e9a-4264-8586-2cd20e4a376d None admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:37.551197 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dbe97b-9e9a-4264-8586-2cd20e4a376d None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:37.551456 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dbe97b-9e9a-4264-8586-2cd20e4a376d None admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:37.552211 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dbe97b-9e9a-4264-8586-2cd20e4a376d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:56:37.553630 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dbe97b-9e9a-4264-8586-2cd20e4a376d None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:56:37.567312 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 22/43] 10.222.0.17 () {60 vars in 1131 bytes} [Sat Jul 23 20:56:37 2022] POST /identity/v3/roles => generated 223 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 20:56:37.570790 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dbe97b-9e9a-4264-8586-2cd20e4a376d None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:56:37.613425 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:56:37.654283 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd9fef2-ca07-4b2e-8dfc-26e898f64cbf None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:56:37.692815 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dbe97b-9e9a-4264-8586-2cd20e4a376d None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:56:37.694831 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382e4ccd-c811-4b30-babc-15bec8a2b42f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:56:37.695677 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382e4ccd-c811-4b30-babc-15bec8a2b42f None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:37.695961 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382e4ccd-c811-4b30-babc-15bec8a2b42f None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:37.696230 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382e4ccd-c811-4b30-babc-15bec8a2b42f None admin] PATH_INFO: `/v3/domains/default` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:37.697515 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382e4ccd-c811-4b30-babc-15bec8a2b42f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:56:37.699079 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382e4ccd-c811-4b30-babc-15bec8a2b42f None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:56:37.700807 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 22/44] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 23 20:56:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:56:37.706992 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382e4ccd-c811-4b30-babc-15bec8a2b42f None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:56:37.735185 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ccd002-3108-4d25-8292-92d28f66528a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:56:37.735878 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ccd002-3108-4d25-8292-92d28f66528a None admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:37.736165 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ccd002-3108-4d25-8292-92d28f66528a None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:37.736444 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ccd002-3108-4d25-8292-92d28f66528a None admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:37.737364 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ccd002-3108-4d25-8292-92d28f66528a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:56:37.738994 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ccd002-3108-4d25-8292-92d28f66528a None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:56:37.773365 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 23/45] 10.222.0.17 () {60 vars in 1141 bytes} [Sat Jul 23 20:56:37 2022] POST /identity/v3/projects => generated 312 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 20:56:37.834620 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382e4ccd-c811-4b30-babc-15bec8a2b42f None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:56:37.874634 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d6acba-1d6e-4b95-96c3-66dbe67411a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:56:37.875547 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d6acba-1d6e-4b95-96c3-66dbe67411a3 None admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:37.875829 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d6acba-1d6e-4b95-96c3-66dbe67411a3 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:37.876108 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d6acba-1d6e-4b95-96c3-66dbe67411a3 None admin] PATH_INFO: `/v3/domains/default/users/ef460ef8c739443881697a7ad53288a2/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:37.878628 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d6acba-1d6e-4b95-96c3-66dbe67411a3 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=ef460ef8c739443881697a7ad53288a2, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:56:37.880125 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d6acba-1d6e-4b95-96c3-66dbe67411a3 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:56:37.886141 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:56:37.898884 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 23/46] 10.222.0.17 () {58 vars in 1361 bytes} [Sat Jul 23 20:56:37 2022] PUT /identity/v3/domains/default/users/ef460ef8c739443881697a7ad53288a2/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 20:56:40.073886 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b45ef5-177d-420b-9cf4-b8e0214149e5 None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:40.074447 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b45ef5-177d-420b-9cf4-b8e0214149e5 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:40.074447 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b45ef5-177d-420b-9cf4-b8e0214149e5 None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:40.075762 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 24/47] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:56:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:56:40.081791 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3ed31c-8675-4200-9198-8f5edc16cae0 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:40.082342 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3ed31c-8675-4200-9198-8f5edc16cae0 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:40.082342 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3ed31c-8675-4200-9198-8f5edc16cae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:40.101003 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-af3ed31c-8675-4200-9198-8f5edc16cae0 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:56:40.102269 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-af3ed31c-8675-4200-9198-8f5edc16cae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:56:40.158177 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b189b58-4ed4-4c1c-89cc-f9d1206b2a66 None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:40.158418 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b189b58-4ed4-4c1c-89cc-f9d1206b2a66 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:40.158789 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b189b58-4ed4-4c1c-89cc-f9d1206b2a66 None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:40.160247 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 25/48] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:56:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 23 20:56:40.165671 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8c9740-a792-400d-94b8-f7d5519f11ff None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:40.165993 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8c9740-a792-400d-94b8-f7d5519f11ff None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:40.166277 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8c9740-a792-400d-94b8-f7d5519f11ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:40.174719 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 24/49] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:56:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 23 20:56:40.183240 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-9a8c9740-a792-400d-94b8-f7d5519f11ff None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:56:40.184460 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-9a8c9740-a792-400d-94b8-f7d5519f11ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:56:40.199786 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3ed31c-8675-4200-9198-8f5edc16cae0 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:56:40.204950 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:56:40.259110 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 26/50] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:56:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 23 20:56:40.284152 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8c9740-a792-400d-94b8-f7d5519f11ff None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:56:40.307604 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3ed31c-8675-4200-9198-8f5edc16cae0 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:56:40.339685 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:56:40.353023 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5034a84-0bec-473c-98b4-6fbc7304f80e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:56:40.353851 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5034a84-0bec-473c-98b4-6fbc7304f80e None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:40.354161 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5034a84-0bec-473c-98b4-6fbc7304f80e None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:40.354432 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5034a84-0bec-473c-98b4-6fbc7304f80e None admin] PATH_INFO: `/v3/domains/default` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:40.355646 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5034a84-0bec-473c-98b4-6fbc7304f80e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:56:40.357238 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5034a84-0bec-473c-98b4-6fbc7304f80e None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:56:40.358986 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 25/51] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 23 20:56:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:56:40.364930 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5034a84-0bec-473c-98b4-6fbc7304f80e None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:56:40.395461 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8c9740-a792-400d-94b8-f7d5519f11ff None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:56:40.438968 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25423451-1ee8-434f-b292-15f04e0064aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:56:40.439890 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25423451-1ee8-434f-b292-15f04e0064aa None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:40.440191 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25423451-1ee8-434f-b292-15f04e0064aa None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:40.440455 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25423451-1ee8-434f-b292-15f04e0064aa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:40.452602 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25423451-1ee8-434f-b292-15f04e0064aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:56:40.460642 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-25423451-1ee8-434f-b292-15f04e0064aa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 23 20:56:40.460642 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:56:40.460642 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:56:40.460642 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:56:40.460642 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:56:40.460642 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:56:40.460642 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:56:40.460642 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:56:40.460642 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:56:40.460642 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:56:40.460642 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:56:40.460642 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:56:40.460642 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:56:40.460642 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:56:40.460642 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:56:40.460642 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:56:40.461516 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:56:40.461516 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:56:40.461516 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:56:40.461516 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:56:40.461516 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:56:40.461516 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:56:40.461516 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:56:40.461516 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:56:40.461516 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:56:40.461516 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:56:40.461516 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:56:40.461516 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application with Lock( Jul 23 20:56:40.461516 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:56:40.461516 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:56:40.461516 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:56:40.461516 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:56:40.462300 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:56:40.462300 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:56:40.462300 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:56:40.462300 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:56:40.462300 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:56:40.462300 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:56:40.462300 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:56:40.462300 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:56:40.462300 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:56:40.462300 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:56:40.462300 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 23 20:56:40.462300 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:56:40.462300 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 27/52] 10.222.0.17 () {56 vars in 1096 bytes} [Sat Jul 23 20:56:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 23 20:56:40.468365 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25423451-1ee8-434f-b292-15f04e0064aa None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:56:40.481720 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5034a84-0bec-473c-98b4-6fbc7304f80e None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:56:40.487533 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:56:40.518984 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe8888a-8935-4d5c-98b1-ef50627476da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:56:40.519686 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe8888a-8935-4d5c-98b1-ef50627476da None admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:40.519967 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe8888a-8935-4d5c-98b1-ef50627476da None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:40.520234 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe8888a-8935-4d5c-98b1-ef50627476da None admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:40.520932 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe8888a-8935-4d5c-98b1-ef50627476da None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:56:40.522444 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe8888a-8935-4d5c-98b1-ef50627476da None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:56:40.549638 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 26/53] 10.222.0.17 () {60 vars in 1140 bytes} [Sat Jul 23 20:56:40 2022] POST /identity/v3/projects => generated 298 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 20:56:40.574643 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25423451-1ee8-434f-b292-15f04e0064aa None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:56:40.613364 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29761ca-abe6-4540-903e-85e509aae759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:56:40.614009 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29761ca-abe6-4540-903e-85e509aae759 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:40.614286 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29761ca-abe6-4540-903e-85e509aae759 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:40.614545 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29761ca-abe6-4540-903e-85e509aae759 None admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:40.615333 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29761ca-abe6-4540-903e-85e509aae759 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:56:40.615638 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29761ca-abe6-4540-903e-85e509aae759 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:56:40.617101 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29761ca-abe6-4540-903e-85e509aae759 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:56:40.627329 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 28/54] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Jul 23 20:56:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 20:56:40.633520 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe8888a-8935-4d5c-98b1-ef50627476da None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:56:40.684652 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:56:40.750203 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe8888a-8935-4d5c-98b1-ef50627476da None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:56:40.790319 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba5e024-18bd-4a46-868b-1767002f213b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:56:40.791231 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba5e024-18bd-4a46-868b-1767002f213b None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:40.791508 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba5e024-18bd-4a46-868b-1767002f213b None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:40.791787 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba5e024-18bd-4a46-868b-1767002f213b None admin] PATH_INFO: `/v3/users/ef460ef8c739443881697a7ad53288a2` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:40.793032 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba5e024-18bd-4a46-868b-1767002f213b None admin] RBAC: Authorizing `identity:get_user(user_id=ef460ef8c739443881697a7ad53288a2)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:56:40.794816 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba5e024-18bd-4a46-868b-1767002f213b None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:56:40.796468 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 27/55] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Jul 23 20:56:40 2022] GET /identity/v3/users/ef460ef8c739443881697a7ad53288a2 => generated 247 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:56:40.802255 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29761ca-abe6-4540-903e-85e509aae759 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:56:40.886544 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:56:40.909392 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29761ca-abe6-4540-903e-85e509aae759 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:56:40.943506 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bf8cd1-1184-4550-8c80-c101fc6ac8bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:56:40.944330 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bf8cd1-1184-4550-8c80-c101fc6ac8bb None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:40.944611 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bf8cd1-1184-4550-8c80-c101fc6ac8bb None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:40.944889 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bf8cd1-1184-4550-8c80-c101fc6ac8bb None admin] PATH_INFO: `/v3/domains/default` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:40.946129 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bf8cd1-1184-4550-8c80-c101fc6ac8bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:56:40.947613 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bf8cd1-1184-4550-8c80-c101fc6ac8bb None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:56:40.949272 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 29/56] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 23 20:56:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:56:40.955224 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba5e024-18bd-4a46-868b-1767002f213b None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:56:41.058391 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba5e024-18bd-4a46-868b-1767002f213b None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:56:41.072762 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:56:41.093618 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20eec6d4-450a-4bec-be46-b1d2769a1095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:56:41.094313 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eec6d4-450a-4bec-be46-b1d2769a1095 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:41.094586 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eec6d4-450a-4bec-be46-b1d2769a1095 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:41.094857 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eec6d4-450a-4bec-be46-b1d2769a1095 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:41.095687 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20eec6d4-450a-4bec-be46-b1d2769a1095 None admin] RBAC: Adding query filter params (role.id=fec17bfdc65349a2b9c06a89131191df, scope.domain.id=default, user.id=ef460ef8c739443881697a7ad53288a2) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:56:41.095996 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20eec6d4-450a-4bec-be46-b1d2769a1095 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:56:41.097561 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20eec6d4-450a-4bec-be46-b1d2769a1095 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:56:41.106473 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 28/57] 10.222.0.17 () {56 vars in 1322 bytes} [Sat Jul 23 20:56:40 2022] GET /identity/v3/role_assignments?user.id=ef460ef8c739443881697a7ad53288a2&scope.domain.id=default&role.id=fec17bfdc65349a2b9c06a89131191df => generated 530 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:56:42.852260 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489b015d-671a-411b-ba05-f059e69f64e4 None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:42.852803 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489b015d-671a-411b-ba05-f059e69f64e4 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:42.852803 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489b015d-671a-411b-ba05-f059e69f64e4 None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:42.854207 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 30/58] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:56:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:56:42.860782 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb69806-eba9-4723-b4ba-155fb0153390 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:42.861313 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb69806-eba9-4723-b4ba-155fb0153390 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:42.861313 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb69806-eba9-4723-b4ba-155fb0153390 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:42.879919 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-abb69806-eba9-4723-b4ba-155fb0153390 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:56:42.881184 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-abb69806-eba9-4723-b4ba-155fb0153390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:56:42.958319 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 29/59] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:56:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 23 20:56:42.984535 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489b015d-671a-411b-ba05-f059e69f64e4 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:56:43.092282 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489b015d-671a-411b-ba05-f059e69f64e4 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:56:43.127159 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7483e0d7-4227-4283-83e9-8a7a68560282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:56:43.127989 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7483e0d7-4227-4283-83e9-8a7a68560282 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:43.128273 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7483e0d7-4227-4283-83e9-8a7a68560282 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:43.128549 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7483e0d7-4227-4283-83e9-8a7a68560282 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:43.129831 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7483e0d7-4227-4283-83e9-8a7a68560282 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:56:43.131385 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7483e0d7-4227-4283-83e9-8a7a68560282 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:56:43.133112 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 31/60] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 23 20:56:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:56:43.139677 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb69806-eba9-4723-b4ba-155fb0153390 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:56:43.250730 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb69806-eba9-4723-b4ba-155fb0153390 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:56:43.262054 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:56:43.288736 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61f8313-89b1-42c0-bd30-d3071399d869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:56:43.289416 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61f8313-89b1-42c0-bd30-d3071399d869 None admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:43.289694 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61f8313-89b1-42c0-bd30-d3071399d869 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:43.290001 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61f8313-89b1-42c0-bd30-d3071399d869 None admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:43.290711 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61f8313-89b1-42c0-bd30-d3071399d869 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:56:43.292170 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61f8313-89b1-42c0-bd30-d3071399d869 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:56:43.322389 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 30/61] 10.222.0.17 () {60 vars in 1132 bytes} [Sat Jul 23 20:56:43 2022] POST /identity/v3/users => generated 275 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 20:56:46.647575 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f2038a-3435-4eb3-ae09-b16973d14425 None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:46.647575 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f2038a-3435-4eb3-ae09-b16973d14425 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:46.647575 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f2038a-3435-4eb3-ae09-b16973d14425 None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:46.647575 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 32/62] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:56:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:56:46.654934 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170efbca-ff04-451d-969e-ce24f60b7c06 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:46.655789 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170efbca-ff04-451d-969e-ce24f60b7c06 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:46.656203 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170efbca-ff04-451d-969e-ce24f60b7c06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:46.680072 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-170efbca-ff04-451d-969e-ce24f60b7c06 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:56:46.681540 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-170efbca-ff04-451d-969e-ce24f60b7c06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:56:46.782737 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 31/63] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:56:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 23 20:56:46.831477 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f2038a-3435-4eb3-ae09-b16973d14425 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:56:46.854461 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:56:46.981626 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f2038a-3435-4eb3-ae09-b16973d14425 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:56:47.032922 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80341640-f32e-49aa-b052-a52114d399a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:56:47.033750 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80341640-f32e-49aa-b052-a52114d399a0 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:47.034081 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80341640-f32e-49aa-b052-a52114d399a0 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:47.034352 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80341640-f32e-49aa-b052-a52114d399a0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:47.054939 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80341640-f32e-49aa-b052-a52114d399a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:56:47.062905 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-80341640-f32e-49aa-b052-a52114d399a0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 23 20:56:47.062905 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:56:47.062905 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:56:47.062905 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:56:47.062905 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:56:47.062905 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:56:47.062905 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:56:47.062905 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:56:47.062905 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:56:47.062905 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:56:47.062905 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:56:47.062905 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:56:47.062905 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:56:47.062905 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:56:47.062905 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:56:47.062905 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:56:47.063801 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:56:47.063801 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:56:47.063801 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:56:47.063801 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:56:47.063801 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:56:47.063801 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:56:47.063801 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:56:47.063801 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:56:47.063801 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:56:47.063801 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:56:47.063801 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:56:47.063801 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application with Lock( Jul 23 20:56:47.063801 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:56:47.063801 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:56:47.063801 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:56:47.063801 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:56:47.064546 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:56:47.064546 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:56:47.064546 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:56:47.064546 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:56:47.064546 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:56:47.064546 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:56:47.064546 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:56:47.064546 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:56:47.064546 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:56:47.064546 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:56:47.064546 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 23 20:56:47.064546 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:56:47.064546 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 33/64] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Jul 23 20:56:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:56:47.070928 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aa25e1-94a1-4009-9e4b-27b8e59d75b1 None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:47.071217 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aa25e1-94a1-4009-9e4b-27b8e59d75b1 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:47.071500 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aa25e1-94a1-4009-9e4b-27b8e59d75b1 None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:47.072903 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 32/65] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:56:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:56:47.074402 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80341640-f32e-49aa-b052-a52114d399a0 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:56:47.078685 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3cd1fd-09c9-4204-9d3d-546e35582658 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:47.078970 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3cd1fd-09c9-4204-9d3d-546e35582658 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:47.079254 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3cd1fd-09c9-4204-9d3d-546e35582658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:47.098072 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-ee3cd1fd-09c9-4204-9d3d-546e35582658 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:56:47.099577 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-ee3cd1fd-09c9-4204-9d3d-546e35582658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:56:47.179358 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:56:47.206497 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80341640-f32e-49aa-b052-a52114d399a0 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:56:47.220795 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 33/66] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:56:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 23 20:56:47.267428 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3cd1fd-09c9-4204-9d3d-546e35582658 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:56:47.271794 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7f9e75-6735-4cfb-9562-f6d1791de0aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:56:47.272890 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7f9e75-6735-4cfb-9562-f6d1791de0aa None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:47.273390 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7f9e75-6735-4cfb-9562-f6d1791de0aa None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:47.273885 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7f9e75-6735-4cfb-9562-f6d1791de0aa None admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:47.274866 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7f9e75-6735-4cfb-9562-f6d1791de0aa None admin] RBAC: Adding query filter params (name=member) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:56:47.275444 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7f9e75-6735-4cfb-9562-f6d1791de0aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:56:47.277152 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7f9e75-6735-4cfb-9562-f6d1791de0aa None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:56:47.288390 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 34/67] 10.222.0.17 () {56 vars in 1101 bytes} [Sat Jul 23 20:56:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:56:47.290296 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac53aa2-ffbd-477f-b9c1-49ede56eb7d0 None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:47.290808 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac53aa2-ffbd-477f-b9c1-49ede56eb7d0 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:47.291276 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac53aa2-ffbd-477f-b9c1-49ede56eb7d0 None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:47.292749 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 35/68] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:56:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:56:47.297131 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac53aa2-ffbd-477f-b9c1-49ede56eb7d0 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:56:47.310101 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:56:47.423606 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3cd1fd-09c9-4204-9d3d-546e35582658 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:56:47.442196 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac53aa2-ffbd-477f-b9c1-49ede56eb7d0 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:56:47.469017 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4594af71-5fb6-4510-b500-f3df85426303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:56:47.470418 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4594af71-5fb6-4510-b500-f3df85426303 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:47.470845 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4594af71-5fb6-4510-b500-f3df85426303 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:47.471450 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4594af71-5fb6-4510-b500-f3df85426303 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:47.485471 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63e358d-3391-487a-8bb8-b7b8aee95e47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:56:47.485710 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4594af71-5fb6-4510-b500-f3df85426303 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:56:47.486503 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63e358d-3391-487a-8bb8-b7b8aee95e47 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:47.486681 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63e358d-3391-487a-8bb8-b7b8aee95e47 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:47.487059 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63e358d-3391-487a-8bb8-b7b8aee95e47 None admin] PATH_INFO: `/v3/users/35d61800281b469cb2d8e0546f4eacbd` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:47.491254 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:56:47.494198 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-4594af71-5fb6-4510-b500-f3df85426303 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 23 20:56:47.494198 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:56:47.494198 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:56:47.494198 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:56:47.494198 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:56:47.494198 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:56:47.494198 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:56:47.494198 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:56:47.494198 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:56:47.494198 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:56:47.494198 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:56:47.494198 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:56:47.494198 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:56:47.494198 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:56:47.494198 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:56:47.494198 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:56:47.495042 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:56:47.495042 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:56:47.495042 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:56:47.495042 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:56:47.495042 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:56:47.495042 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:56:47.495042 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:56:47.495042 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:56:47.495042 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:56:47.495042 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:56:47.495042 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:56:47.495042 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application with Lock( Jul 23 20:56:47.495042 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:56:47.495042 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:56:47.495042 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:56:47.495042 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:56:47.496220 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:56:47.496220 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:56:47.496220 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:56:47.496220 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:56:47.496220 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:56:47.496220 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:56:47.496220 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:56:47.496220 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:56:47.496220 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:56:47.496220 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:56:47.496220 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 23 20:56:47.496220 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 20:56:47.496220 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 34/69] 10.222.0.17 () {56 vars in 1114 bytes} [Sat Jul 23 20:56:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 23 20:56:47.501639 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa93794-90dc-46ba-bf83-72e1cc55a23e None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:47.501945 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa93794-90dc-46ba-bf83-72e1cc55a23e None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:47.502549 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa93794-90dc-46ba-bf83-72e1cc55a23e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:47.506161 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63e358d-3391-487a-8bb8-b7b8aee95e47 None admin] RBAC: Authorizing `identity:get_user(user_id=35d61800281b469cb2d8e0546f4eacbd)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:56:47.509222 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63e358d-3391-487a-8bb8-b7b8aee95e47 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:56:47.517943 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 36/70] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Jul 23 20:56:47 2022] GET /identity/v3/users/35d61800281b469cb2d8e0546f4eacbd => generated 275 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:56:47.517943 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a6ab20-eb90-4ea7-82fe-f7320e68b494 None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:47.517943 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a6ab20-eb90-4ea7-82fe-f7320e68b494 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:47.517943 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a6ab20-eb90-4ea7-82fe-f7320e68b494 None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:47.521823 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 37/71] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:56:47 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:56:47.521823 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a6ab20-eb90-4ea7-82fe-f7320e68b494 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:56:47.524446 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-4aa93794-90dc-46ba-bf83-72e1cc55a23e None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:56:47.524446 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-4aa93794-90dc-46ba-bf83-72e1cc55a23e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:56:47.608782 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 35/72] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:56:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 23 20:56:47.609652 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa93794-90dc-46ba-bf83-72e1cc55a23e None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:56:47.624788 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:56:47.640849 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a6ab20-eb90-4ea7-82fe-f7320e68b494 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:56:47.678159 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced5e673-7768-4c40-8b76-44e13763e36f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:56:47.678860 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced5e673-7768-4c40-8b76-44e13763e36f None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:47.679147 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced5e673-7768-4c40-8b76-44e13763e36f None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:47.679426 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced5e673-7768-4c40-8b76-44e13763e36f None admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:47.680213 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced5e673-7768-4c40-8b76-44e13763e36f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:56:47.680548 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced5e673-7768-4c40-8b76-44e13763e36f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:56:47.682004 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced5e673-7768-4c40-8b76-44e13763e36f None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:56:47.690682 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 38/73] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Jul 23 20:56:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:56:47.695585 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82173d95-a750-4929-9eda-760ca54aaff5 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:47.695884 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82173d95-a750-4929-9eda-760ca54aaff5 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:47.696165 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82173d95-a750-4929-9eda-760ca54aaff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:47.712929 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-82173d95-a750-4929-9eda-760ca54aaff5 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:56:47.713933 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa93794-90dc-46ba-bf83-72e1cc55a23e None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:56:47.714360 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-82173d95-a750-4929-9eda-760ca54aaff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:56:47.748175 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e9e0a1-52a9-4458-acc5-be149c051182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:56:47.748842 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e9e0a1-52a9-4458-acc5-be149c051182 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:47.749127 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e9e0a1-52a9-4458-acc5-be149c051182 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:47.749402 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e9e0a1-52a9-4458-acc5-be149c051182 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:47.767771 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:56:47.798200 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 39/74] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:56:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 23 20:56:47.798200 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca74f9a-46a8-40aa-b88d-aa3b18dfdb8d None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:47.798200 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca74f9a-46a8-40aa-b88d-aa3b18dfdb8d None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:47.798200 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca74f9a-46a8-40aa-b88d-aa3b18dfdb8d None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:47.798200 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 40/75] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:56:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:56:47.798200 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca74f9a-46a8-40aa-b88d-aa3b18dfdb8d None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:56:47.827495 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e9e0a1-52a9-4458-acc5-be149c051182 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:56:47.829243 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e9e0a1-52a9-4458-acc5-be149c051182 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:56:47.844699 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:56:47.897281 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca74f9a-46a8-40aa-b88d-aa3b18dfdb8d None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:56:47.932457 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c30ed8-5ed2-4b7e-a98b-5e6bda0eea16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:56:47.933274 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c30ed8-5ed2-4b7e-a98b-5e6bda0eea16 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:47.933556 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c30ed8-5ed2-4b7e-a98b-5e6bda0eea16 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:47.933824 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c30ed8-5ed2-4b7e-a98b-5e6bda0eea16 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:47.937126 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 36/76] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Jul 23 20:56:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 23 20:56:47.938057 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e9e0a1-52a9-4458-acc5-be149c051182 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:56:47.948949 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c30ed8-5ed2-4b7e-a98b-5e6bda0eea16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:56:47.956867 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-57c30ed8-5ed2-4b7e-a98b-5e6bda0eea16 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 23 20:56:47.956867 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:56:47.956867 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:56:47.956867 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:56:47.956867 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:56:47.956867 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:56:47.956867 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:56:47.956867 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:56:47.956867 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:56:47.956867 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:56:47.956867 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:56:47.956867 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:56:47.956867 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:56:47.956867 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:56:47.956867 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:56:47.956867 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:56:47.957709 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:56:47.957709 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:56:47.957709 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:56:47.957709 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:56:47.957709 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:56:47.957709 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:56:47.957709 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:56:47.957709 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:56:47.957709 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:56:47.957709 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:56:47.957709 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:56:47.957709 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application with Lock( Jul 23 20:56:47.957709 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:56:47.957709 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:56:47.957709 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:56:47.957709 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:56:47.958512 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:56:47.958512 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:56:47.958512 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:56:47.958512 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:56:47.958512 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:56:47.958512 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:56:47.958512 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:56:47.958512 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:56:47.958512 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:56:47.958512 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:56:47.958512 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 23 20:56:47.958512 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:56:47.958512 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 41/77] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Jul 23 20:56:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:56:47.959406 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f006212-0a49-4203-8547-467ad6f72332 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:47.959733 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f006212-0a49-4203-8547-467ad6f72332 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:47.959956 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f006212-0a49-4203-8547-467ad6f72332 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:47.977082 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-5f006212-0a49-4203-8547-467ad6f72332 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:56:47.978322 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-5f006212-0a49-4203-8547-467ad6f72332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:56:48.020320 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:56:48.043951 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e9e0a1-52a9-4458-acc5-be149c051182 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:56:48.047018 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 42/78] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:56:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 23 20:56:48.047883 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f006212-0a49-4203-8547-467ad6f72332 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:56:48.062833 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:56:48.086459 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2492fd5-83c0-4e71-86a5-0537df81d7b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:56:48.087441 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2492fd5-83c0-4e71-86a5-0537df81d7b3 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:48.087723 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2492fd5-83c0-4e71-86a5-0537df81d7b3 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:48.087995 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2492fd5-83c0-4e71-86a5-0537df81d7b3 None admin] PATH_INFO: `/v3/users/35d61800281b469cb2d8e0546f4eacbd` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:48.089328 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2492fd5-83c0-4e71-86a5-0537df81d7b3 None admin] RBAC: Authorizing `identity:get_user(user_id=35d61800281b469cb2d8e0546f4eacbd)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:56:48.090881 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2492fd5-83c0-4e71-86a5-0537df81d7b3 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:56:48.092579 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 37/79] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Jul 23 20:56:47 2022] GET /identity/v3/users/35d61800281b469cb2d8e0546f4eacbd => generated 275 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:56:48.093380 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2492fd5-83c0-4e71-86a5-0537df81d7b3 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:56:48.153426 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f006212-0a49-4203-8547-467ad6f72332 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:56:48.188249 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d78d676-ef1f-4026-852e-7e770c612d95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:56:48.189163 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d78d676-ef1f-4026-852e-7e770c612d95 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:48.189450 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d78d676-ef1f-4026-852e-7e770c612d95 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:48.189728 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d78d676-ef1f-4026-852e-7e770c612d95 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:48.193541 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2492fd5-83c0-4e71-86a5-0537df81d7b3 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:56:48.200779 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d78d676-ef1f-4026-852e-7e770c612d95 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:56:48.208840 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-6d78d676-ef1f-4026-852e-7e770c612d95 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 23 20:56:48.208840 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:56:48.208840 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:56:48.208840 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:56:48.208840 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:56:48.208840 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:56:48.208840 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:56:48.208840 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:56:48.208840 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:56:48.208840 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:56:48.208840 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:56:48.208840 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:56:48.208840 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:56:48.208840 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:56:48.208840 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:56:48.208840 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:56:48.209730 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:56:48.209730 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:56:48.209730 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:56:48.209730 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:56:48.209730 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:56:48.209730 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:56:48.209730 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:56:48.209730 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:56:48.209730 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:56:48.209730 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:56:48.209730 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:56:48.209730 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application with Lock( Jul 23 20:56:48.209730 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:56:48.209730 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:56:48.209730 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:56:48.209730 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:56:48.210539 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:56:48.210539 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:56:48.210539 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:56:48.210539 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:56:48.210539 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:56:48.210539 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:56:48.210539 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:56:48.210539 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:56:48.210539 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:56:48.210539 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:56:48.210539 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 23 20:56:48.210539 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:56:48.210539 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 43/80] 10.222.0.17 () {56 vars in 1096 bytes} [Sat Jul 23 20:56:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:56:48.214826 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d78d676-ef1f-4026-852e-7e770c612d95 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:56:48.228786 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932c99d3-7e35-404c-885a-8be4f2f93bf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:56:48.229746 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932c99d3-7e35-404c-885a-8be4f2f93bf0 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:48.230083 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932c99d3-7e35-404c-885a-8be4f2f93bf0 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:48.230356 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932c99d3-7e35-404c-885a-8be4f2f93bf0 None admin] PATH_INFO: `/v3/projects/74cb8c05a64040c48e6687c9bd9865d1` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:48.231670 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932c99d3-7e35-404c-885a-8be4f2f93bf0 None admin] RBAC: Authorizing `identity:get_project(project_id=74cb8c05a64040c48e6687c9bd9865d1)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:56:48.233126 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932c99d3-7e35-404c-885a-8be4f2f93bf0 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:56:48.234889 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 38/81] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Jul 23 20:56:48 2022] GET /identity/v3/projects/74cb8c05a64040c48e6687c9bd9865d1 => generated 298 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:56:48.235689 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932c99d3-7e35-404c-885a-8be4f2f93bf0 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:56:48.262861 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:56:48.290158 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:56:48.333815 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d78d676-ef1f-4026-852e-7e770c612d95 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:56:48.353072 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932c99d3-7e35-404c-885a-8be4f2f93bf0 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:56:48.375562 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5223d38-fb5d-45d9-ad2c-81a3b6abf3d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:56:48.375893 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5223d38-fb5d-45d9-ad2c-81a3b6abf3d7 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:48.376179 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5223d38-fb5d-45d9-ad2c-81a3b6abf3d7 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:48.376548 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5223d38-fb5d-45d9-ad2c-81a3b6abf3d7 None admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:48.377220 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5223d38-fb5d-45d9-ad2c-81a3b6abf3d7 None admin] RBAC: Adding query filter params (name=member) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:56:48.377525 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5223d38-fb5d-45d9-ad2c-81a3b6abf3d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:56:48.379018 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5223d38-fb5d-45d9-ad2c-81a3b6abf3d7 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:56:48.387555 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 44/82] 10.222.0.17 () {56 vars in 1101 bytes} [Sat Jul 23 20:56:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:56:48.388386 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5223d38-fb5d-45d9-ad2c-81a3b6abf3d7 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:56:48.389017 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fa1ed4-709c-412a-95d8-db781b2dd580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:56:48.390021 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fa1ed4-709c-412a-95d8-db781b2dd580 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:48.390212 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fa1ed4-709c-412a-95d8-db781b2dd580 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:48.391048 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fa1ed4-709c-412a-95d8-db781b2dd580 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:48.391701 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fa1ed4-709c-412a-95d8-db781b2dd580 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:56:48.393305 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fa1ed4-709c-412a-95d8-db781b2dd580 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:56:48.395199 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 39/83] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 23 20:56:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:56:48.396044 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fa1ed4-709c-412a-95d8-db781b2dd580 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:56:48.493150 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:56:48.497295 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5223d38-fb5d-45d9-ad2c-81a3b6abf3d7 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:56:48.501811 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fa1ed4-709c-412a-95d8-db781b2dd580 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:56:48.521736 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:56:48.536103 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab49ed9f-8677-4449-b5eb-9638d93d1c54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:56:48.536770 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab49ed9f-8677-4449-b5eb-9638d93d1c54 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:48.537055 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab49ed9f-8677-4449-b5eb-9638d93d1c54 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:48.537329 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab49ed9f-8677-4449-b5eb-9638d93d1c54 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:48.540489 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432ad04b-0757-463a-a7c8-3c3f23f99001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:56:48.541175 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432ad04b-0757-463a-a7c8-3c3f23f99001 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:48.541467 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432ad04b-0757-463a-a7c8-3c3f23f99001 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:48.541740 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432ad04b-0757-463a-a7c8-3c3f23f99001 None admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:48.542569 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432ad04b-0757-463a-a7c8-3c3f23f99001 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:56:48.542987 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432ad04b-0757-463a-a7c8-3c3f23f99001 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:56:48.544305 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432ad04b-0757-463a-a7c8-3c3f23f99001 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:56:48.556396 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 40/84] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Jul 23 20:56:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:56:48.557130 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432ad04b-0757-463a-a7c8-3c3f23f99001 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:56:48.608886 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab49ed9f-8677-4449-b5eb-9638d93d1c54 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:56:48.610378 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab49ed9f-8677-4449-b5eb-9638d93d1c54 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:56:48.659996 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432ad04b-0757-463a-a7c8-3c3f23f99001 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:56:48.694537 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb7b170-701a-49d4-940e-bbca9b6d87c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:56:48.695209 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb7b170-701a-49d4-940e-bbca9b6d87c6 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:48.695493 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb7b170-701a-49d4-940e-bbca9b6d87c6 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:48.695773 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb7b170-701a-49d4-940e-bbca9b6d87c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:48.696613 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb7b170-701a-49d4-940e-bbca9b6d87c6 None admin] RBAC: Adding query filter params (role.id=14824669685048b38361b1676f7f0f9f, scope.project.id=74cb8c05a64040c48e6687c9bd9865d1, user.id=35d61800281b469cb2d8e0546f4eacbd) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:56:48.696924 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb7b170-701a-49d4-940e-bbca9b6d87c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:56:48.698593 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb7b170-701a-49d4-940e-bbca9b6d87c6 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:56:48.704418 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 41/85] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Jul 23 20:56:48 2022] GET /identity/v3/role_assignments?user.id=35d61800281b469cb2d8e0546f4eacbd&scope.project.id=74cb8c05a64040c48e6687c9bd9865d1&role.id=14824669685048b38361b1676f7f0f9f => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:56:48.705249 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb7b170-701a-49d4-940e-bbca9b6d87c6 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:56:48.714498 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:56:48.721685 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 45/86] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Jul 23 20:56:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 23 20:56:48.722473 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab49ed9f-8677-4449-b5eb-9638d93d1c54 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:56:48.768413 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:56:48.847813 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb7b170-701a-49d4-940e-bbca9b6d87c6 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:56:48.851410 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab49ed9f-8677-4449-b5eb-9638d93d1c54 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:56:48.891663 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a888af-6532-44dc-bcdd-0a7aa16f40a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:56:48.893273 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a888af-6532-44dc-bcdd-0a7aa16f40a8 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:48.893571 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a888af-6532-44dc-bcdd-0a7aa16f40a8 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:48.893847 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a888af-6532-44dc-bcdd-0a7aa16f40a8 None admin] PATH_INFO: `/v3/users/35d61800281b469cb2d8e0546f4eacbd` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:48.895049 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96deabd-8b1f-4191-a414-9986844f4003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:56:48.895166 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a888af-6532-44dc-bcdd-0a7aa16f40a8 None admin] RBAC: Authorizing `identity:get_user(user_id=35d61800281b469cb2d8e0546f4eacbd)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:56:48.895925 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96deabd-8b1f-4191-a414-9986844f4003 None admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:48.896025 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96deabd-8b1f-4191-a414-9986844f4003 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:48.896279 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96deabd-8b1f-4191-a414-9986844f4003 None admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:48.896627 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a888af-6532-44dc-bcdd-0a7aa16f40a8 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:56:48.896995 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96deabd-8b1f-4191-a414-9986844f4003 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:56:48.898524 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 42/87] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Jul 23 20:56:48 2022] GET /identity/v3/users/35d61800281b469cb2d8e0546f4eacbd => generated 275 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:56:48.898625 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96deabd-8b1f-4191-a414-9986844f4003 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:56:48.899122 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a888af-6532-44dc-bcdd-0a7aa16f40a8 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:56:48.932212 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 46/88] 10.222.0.17 () {60 vars in 1132 bytes} [Sat Jul 23 20:56:48 2022] POST /identity/v3/users => generated 289 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 20:56:48.932978 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96deabd-8b1f-4191-a414-9986844f4003 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:56:49.019313 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:56:49.061749 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a888af-6532-44dc-bcdd-0a7aa16f40a8 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:56:49.083130 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:56:49.097575 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96deabd-8b1f-4191-a414-9986844f4003 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:56:49.115992 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efffc585-36b6-4d62-9ebc-bbd97684c2f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:56:49.118126 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efffc585-36b6-4d62-9ebc-bbd97684c2f2 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:49.118625 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efffc585-36b6-4d62-9ebc-bbd97684c2f2 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:49.119354 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efffc585-36b6-4d62-9ebc-bbd97684c2f2 None admin] PATH_INFO: `/v3/users/ef460ef8c739443881697a7ad53288a2` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:49.121179 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efffc585-36b6-4d62-9ebc-bbd97684c2f2 None admin] RBAC: Authorizing `identity:get_user(user_id=ef460ef8c739443881697a7ad53288a2)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:56:49.123454 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efffc585-36b6-4d62-9ebc-bbd97684c2f2 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:56:49.126224 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 43/89] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Jul 23 20:56:48 2022] GET /identity/v3/users/ef460ef8c739443881697a7ad53288a2 => generated 247 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:56:49.127339 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efffc585-36b6-4d62-9ebc-bbd97684c2f2 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:56:49.148769 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb615f44-4ab6-4237-b199-1236a4fea71b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:56:49.150527 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb615f44-4ab6-4237-b199-1236a4fea71b None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:49.151007 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb615f44-4ab6-4237-b199-1236a4fea71b None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:49.151468 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb615f44-4ab6-4237-b199-1236a4fea71b None admin] PATH_INFO: `/v3/projects/74cb8c05a64040c48e6687c9bd9865d1` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:49.153831 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb615f44-4ab6-4237-b199-1236a4fea71b None admin] RBAC: Authorizing `identity:get_project(project_id=74cb8c05a64040c48e6687c9bd9865d1)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:56:49.155892 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb615f44-4ab6-4237-b199-1236a4fea71b None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:56:49.164545 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 47/90] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Jul 23 20:56:48 2022] GET /identity/v3/projects/74cb8c05a64040c48e6687c9bd9865d1 => generated 298 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:56:49.164545 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb615f44-4ab6-4237-b199-1236a4fea71b None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:56:49.255150 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efffc585-36b6-4d62-9ebc-bbd97684c2f2 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:56:49.292466 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb615f44-4ab6-4237-b199-1236a4fea71b None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:56:49.300681 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949e57dd-e2f1-4af0-849b-f5572b232963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:56:49.301357 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949e57dd-e2f1-4af0-849b-f5572b232963 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:49.301639 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949e57dd-e2f1-4af0-849b-f5572b232963 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:49.301944 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949e57dd-e2f1-4af0-849b-f5572b232963 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:49.324691 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:56:49.347372 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d433c009-64e4-4dea-aebc-4d73d5e0efcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:56:49.348060 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d433c009-64e4-4dea-aebc-4d73d5e0efcc None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:49.348341 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d433c009-64e4-4dea-aebc-4d73d5e0efcc None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:49.348616 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d433c009-64e4-4dea-aebc-4d73d5e0efcc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:49.386685 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:56:49.401284 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949e57dd-e2f1-4af0-849b-f5572b232963 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:56:49.404064 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949e57dd-e2f1-4af0-849b-f5572b232963 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:56:49.450152 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d433c009-64e4-4dea-aebc-4d73d5e0efcc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:56:49.452299 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d433c009-64e4-4dea-aebc-4d73d5e0efcc None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:56:49.556905 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 44/91] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Jul 23 20:56:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 23 20:56:49.558301 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949e57dd-e2f1-4af0-849b-f5572b232963 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:56:49.585480 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 48/92] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Jul 23 20:56:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 23 20:56:49.590135 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d433c009-64e4-4dea-aebc-4d73d5e0efcc None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:56:49.618099 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:56:49.656667 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:56:49.682340 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949e57dd-e2f1-4af0-849b-f5572b232963 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:56:49.722675 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553a21ea-2069-483b-9941-17e256d973c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:56:49.723440 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553a21ea-2069-483b-9941-17e256d973c3 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:49.723784 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553a21ea-2069-483b-9941-17e256d973c3 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:49.724124 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553a21ea-2069-483b-9941-17e256d973c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:49.724967 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553a21ea-2069-483b-9941-17e256d973c3 None admin] RBAC: Adding query filter params (role.id=c5f46541d35e44b691baa7a1fa304c0f, scope.project.id=74cb8c05a64040c48e6687c9bd9865d1, user.id=35d61800281b469cb2d8e0546f4eacbd) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:56:49.725277 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553a21ea-2069-483b-9941-17e256d973c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:56:49.726305 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d433c009-64e4-4dea-aebc-4d73d5e0efcc None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:56:49.726816 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553a21ea-2069-483b-9941-17e256d973c3 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:56:49.734097 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 45/93] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Jul 23 20:56:49 2022] GET /identity/v3/role_assignments?user.id=35d61800281b469cb2d8e0546f4eacbd&scope.project.id=74cb8c05a64040c48e6687c9bd9865d1&role.id=c5f46541d35e44b691baa7a1fa304c0f => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:56:49.734955 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553a21ea-2069-483b-9941-17e256d973c3 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:56:49.774545 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fbb1af-f273-4ef7-93f9-0580d6fb174d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:56:49.775942 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fbb1af-f273-4ef7-93f9-0580d6fb174d None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:49.776374 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fbb1af-f273-4ef7-93f9-0580d6fb174d None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:49.776772 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fbb1af-f273-4ef7-93f9-0580d6fb174d None admin] PATH_INFO: `/v3/projects/c1cfbbe0d85c4ac9b70b594f37b2646c` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:49.778532 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fbb1af-f273-4ef7-93f9-0580d6fb174d None admin] RBAC: Authorizing `identity:get_project(project_id=c1cfbbe0d85c4ac9b70b594f37b2646c)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:56:49.781378 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fbb1af-f273-4ef7-93f9-0580d6fb174d None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:56:49.783265 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 49/94] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Jul 23 20:56:49 2022] GET /identity/v3/projects/c1cfbbe0d85c4ac9b70b594f37b2646c => generated 312 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:56:49.790860 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fbb1af-f273-4ef7-93f9-0580d6fb174d None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:56:49.865153 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553a21ea-2069-483b-9941-17e256d973c3 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:56:49.914371 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd9f179-b29a-4de2-9681-2a23b502d948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:56:49.915835 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd9f179-b29a-4de2-9681-2a23b502d948 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:49.916129 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd9f179-b29a-4de2-9681-2a23b502d948 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:49.916407 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd9f179-b29a-4de2-9681-2a23b502d948 None admin] PATH_INFO: `/v3/projects/74cb8c05a64040c48e6687c9bd9865d1` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:49.917985 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd9f179-b29a-4de2-9681-2a23b502d948 None admin] RBAC: Authorizing `identity:get_project(project_id=74cb8c05a64040c48e6687c9bd9865d1)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:56:49.919403 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:56:49.920763 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd9f179-b29a-4de2-9681-2a23b502d948 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:56:49.923922 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 46/95] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Jul 23 20:56:49 2022] GET /identity/v3/projects/74cb8c05a64040c48e6687c9bd9865d1 => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:56:49.930101 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd9f179-b29a-4de2-9681-2a23b502d948 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:56:49.934241 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fbb1af-f273-4ef7-93f9-0580d6fb174d None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:56:49.948584 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:56:49.974707 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e94a42-347f-4ec8-bb63-41bf1317fae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:56:49.975882 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e94a42-347f-4ec8-bb63-41bf1317fae5 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:49.976370 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e94a42-347f-4ec8-bb63-41bf1317fae5 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:49.976806 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e94a42-347f-4ec8-bb63-41bf1317fae5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:49.977894 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e94a42-347f-4ec8-bb63-41bf1317fae5 None admin] RBAC: Adding query filter params (role.id=14824669685048b38361b1676f7f0f9f, scope.project.id=c1cfbbe0d85c4ac9b70b594f37b2646c, user.id=35d61800281b469cb2d8e0546f4eacbd) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:56:49.978488 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e94a42-347f-4ec8-bb63-41bf1317fae5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:56:49.980229 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e94a42-347f-4ec8-bb63-41bf1317fae5 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:56:49.986763 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 50/96] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Jul 23 20:56:49 2022] GET /identity/v3/role_assignments?user.id=35d61800281b469cb2d8e0546f4eacbd&scope.project.id=c1cfbbe0d85c4ac9b70b594f37b2646c&role.id=14824669685048b38361b1676f7f0f9f => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 20:56:50.055923 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd9f179-b29a-4de2-9681-2a23b502d948 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:56:50.101543 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36736ef-e60b-4b75-a47e-1b85184372d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:56:50.102279 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36736ef-e60b-4b75-a47e-1b85184372d9 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:50.102566 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36736ef-e60b-4b75-a47e-1b85184372d9 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:50.102839 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36736ef-e60b-4b75-a47e-1b85184372d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:50.103723 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36736ef-e60b-4b75-a47e-1b85184372d9 None admin] RBAC: Adding query filter params (role.id=fec17bfdc65349a2b9c06a89131191df, scope.project.id=74cb8c05a64040c48e6687c9bd9865d1, user.id=ef460ef8c739443881697a7ad53288a2) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:56:50.104038 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36736ef-e60b-4b75-a47e-1b85184372d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:56:50.105619 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36736ef-e60b-4b75-a47e-1b85184372d9 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:56:50.112988 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 47/97] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Jul 23 20:56:49 2022] GET /identity/v3/role_assignments?user.id=ef460ef8c739443881697a7ad53288a2&scope.project.id=74cb8c05a64040c48e6687c9bd9865d1&role.id=fec17bfdc65349a2b9c06a89131191df => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:56:52.208656 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f4d74a-6000-4b1b-aeec-104ce8f7fcdf None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:52.209685 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f4d74a-6000-4b1b-aeec-104ce8f7fcdf None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:52.210194 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f4d74a-6000-4b1b-aeec-104ce8f7fcdf None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:52.211806 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 51/98] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:56:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:56:52.217524 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9950a6bf-88c2-49a2-b479-54ec28dafe1f None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:52.218478 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9950a6bf-88c2-49a2-b479-54ec28dafe1f None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:52.218957 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9950a6bf-88c2-49a2-b479-54ec28dafe1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:52.243311 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-9950a6bf-88c2-49a2-b479-54ec28dafe1f None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:56:52.244892 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-9950a6bf-88c2-49a2-b479-54ec28dafe1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:56:52.300208 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36280121-a295-4ab6-ab53-8fb4f757bc08 None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:52.301011 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36280121-a295-4ab6-ab53-8fb4f757bc08 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:52.301486 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36280121-a295-4ab6-ab53-8fb4f757bc08 None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:52.303139 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 52/99] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:56:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:56:52.308954 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47c1fc3-b8d5-428f-8257-5aaa43a44d05 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:52.309602 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47c1fc3-b8d5-428f-8257-5aaa43a44d05 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:52.310112 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47c1fc3-b8d5-428f-8257-5aaa43a44d05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:52.339440 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-d47c1fc3-b8d5-428f-8257-5aaa43a44d05 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:56:52.343907 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-d47c1fc3-b8d5-428f-8257-5aaa43a44d05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:56:52.380608 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 48/100] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:56:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 23 20:56:52.412834 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9950a6bf-88c2-49a2-b479-54ec28dafe1f None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:56:52.422051 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:56:52.501322 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 53/101] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:56:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 23 20:56:52.542058 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47c1fc3-b8d5-428f-8257-5aaa43a44d05 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:56:52.644093 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9950a6bf-88c2-49a2-b479-54ec28dafe1f None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:56:52.651743 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:56:52.679058 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47c1fc3-b8d5-428f-8257-5aaa43a44d05 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:56:52.722184 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9461420d-7a6a-4f6d-b5f9-68e907183ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:56:52.723406 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9461420d-7a6a-4f6d-b5f9-68e907183ae3 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:52.724007 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9461420d-7a6a-4f6d-b5f9-68e907183ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:52.724416 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9461420d-7a6a-4f6d-b5f9-68e907183ae3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:52.736264 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9461420d-7a6a-4f6d-b5f9-68e907183ae3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:56:52.745393 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-9461420d-7a6a-4f6d-b5f9-68e907183ae3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 23 20:56:52.745393 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:56:52.745393 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:56:52.745393 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:56:52.745393 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:56:52.745393 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:56:52.745393 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:56:52.745393 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:56:52.745393 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:56:52.745393 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:56:52.745393 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:56:52.745393 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:56:52.745393 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:56:52.745393 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:56:52.745393 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:56:52.745393 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:56:52.746310 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:56:52.746310 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:56:52.746310 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:56:52.746310 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:56:52.746310 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:56:52.746310 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:56:52.746310 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:56:52.746310 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:56:52.746310 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:56:52.746310 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:56:52.746310 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:56:52.746310 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application with Lock( Jul 23 20:56:52.746310 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:56:52.746310 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:56:52.746310 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:56:52.746310 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:56:52.747115 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:56:52.747115 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:56:52.747115 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:56:52.747115 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:56:52.747115 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:56:52.747115 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:56:52.747115 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:56:52.747115 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:56:52.747115 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:56:52.747115 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:56:52.747115 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 23 20:56:52.747115 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 20:56:52.749434 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 49/102] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Jul 23 20:56:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 23 20:56:52.751139 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189956e7-d1c9-49ef-8335-28add0a7604d None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:52.751692 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189956e7-d1c9-49ef-8335-28add0a7604d None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:52.752169 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189956e7-d1c9-49ef-8335-28add0a7604d None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:52.754458 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 50/103] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:56:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:56:52.755437 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189956e7-d1c9-49ef-8335-28add0a7604d None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:56:52.842740 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b856fec-250e-4fde-9f8a-c5368da83589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:56:52.843638 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b856fec-250e-4fde-9f8a-c5368da83589 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:52.843921 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b856fec-250e-4fde-9f8a-c5368da83589 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:52.844203 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b856fec-250e-4fde-9f8a-c5368da83589 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:52.846058 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:56:52.882203 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189956e7-d1c9-49ef-8335-28add0a7604d None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:56:52.898651 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b856fec-250e-4fde-9f8a-c5368da83589 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:56:52.907132 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-0b856fec-250e-4fde-9f8a-c5368da83589 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 23 20:56:52.907132 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:56:52.907132 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:56:52.907132 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:56:52.907132 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:56:52.907132 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:56:52.907132 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:56:52.907132 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:56:52.907132 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:56:52.907132 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:56:52.907132 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:56:52.907132 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:56:52.907132 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:56:52.907132 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:56:52.907132 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:56:52.907132 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:56:52.908314 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:56:52.908314 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:56:52.908314 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:56:52.908314 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:56:52.908314 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:56:52.908314 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:56:52.908314 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:56:52.908314 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:56:52.908314 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:56:52.908314 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:56:52.908314 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:56:52.908314 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application with Lock( Jul 23 20:56:52.908314 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:56:52.908314 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:56:52.908314 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:56:52.908314 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:56:52.909313 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:56:52.909313 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:56:52.909313 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:56:52.909313 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:56:52.909313 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:56:52.909313 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:56:52.909313 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:56:52.909313 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:56:52.909313 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:56:52.909313 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:56:52.909313 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 23 20:56:52.909313 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:56:52.909313 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 54/104] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Jul 23 20:56:52 2022] GET /identity/v3/roles/reader => generated 84 bytes in 368 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:56:52.910195 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c97ce0-264b-4715-a6ae-3e112d51cdea None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:52.922375 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c97ce0-264b-4715-a6ae-3e112d51cdea None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:52.922714 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c97ce0-264b-4715-a6ae-3e112d51cdea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:52.927066 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61261aa-12da-497f-8929-61681a7588d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:56:52.928138 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61261aa-12da-497f-8929-61681a7588d2 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:52.928593 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61261aa-12da-497f-8929-61681a7588d2 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:52.929122 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61261aa-12da-497f-8929-61681a7588d2 None admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:52.930142 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61261aa-12da-497f-8929-61681a7588d2 None admin] RBAC: Adding query filter params (name=member) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:56:52.930648 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61261aa-12da-497f-8929-61681a7588d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:56:52.932670 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61261aa-12da-497f-8929-61681a7588d2 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:56:52.943812 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 51/105] 10.222.0.17 () {56 vars in 1101 bytes} [Sat Jul 23 20:56:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:56:52.945207 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61261aa-12da-497f-8929-61681a7588d2 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:56:52.958951 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-92c97ce0-264b-4715-a6ae-3e112d51cdea None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:56:52.960182 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-92c97ce0-264b-4715-a6ae-3e112d51cdea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:56:53.058272 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61261aa-12da-497f-8929-61681a7588d2 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:56:53.090169 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:56:53.099156 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1a1f8e-6a7a-4ef0-b7d6-db21b0d6428e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:56:53.099838 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1a1f8e-6a7a-4ef0-b7d6-db21b0d6428e None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:53.100179 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1a1f8e-6a7a-4ef0-b7d6-db21b0d6428e None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:53.100455 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1a1f8e-6a7a-4ef0-b7d6-db21b0d6428e None admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:53.100928 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 55/106] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:56:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 23 20:56:53.106215 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1a1f8e-6a7a-4ef0-b7d6-db21b0d6428e None admin] RBAC: Adding query filter params (name=reader) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:56:53.106215 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1a1f8e-6a7a-4ef0-b7d6-db21b0d6428e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:56:53.106389 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c97ce0-264b-4715-a6ae-3e112d51cdea None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:56:53.106461 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1a1f8e-6a7a-4ef0-b7d6-db21b0d6428e None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:56:53.116973 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 52/107] 10.222.0.17 () {56 vars in 1101 bytes} [Sat Jul 23 20:56:52 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:56:53.118750 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c7657f-a282-44ce-ba32-7521ff41b26c None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:53.119246 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c7657f-a282-44ce-ba32-7521ff41b26c None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:53.119709 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c7657f-a282-44ce-ba32-7521ff41b26c None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:53.121540 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 53/108] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:56:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:56:53.123083 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8ef5a5-b2d9-46d9-9c19-c55f748869b9 None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:53.123567 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8ef5a5-b2d9-46d9-9c19-c55f748869b9 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:53.124058 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8ef5a5-b2d9-46d9-9c19-c55f748869b9 None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:53.125662 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 54/109] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:56:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:56:53.126591 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8ef5a5-b2d9-46d9-9c19-c55f748869b9 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:56:53.198611 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:56:53.227078 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c97ce0-264b-4715-a6ae-3e112d51cdea None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:56:53.249420 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8ef5a5-b2d9-46d9-9c19-c55f748869b9 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:56:53.265278 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06917696-a8be-4dd6-8a83-73dc65dbdf50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:56:53.266211 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06917696-a8be-4dd6-8a83-73dc65dbdf50 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:53.266693 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06917696-a8be-4dd6-8a83-73dc65dbdf50 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:53.267167 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06917696-a8be-4dd6-8a83-73dc65dbdf50 None admin] PATH_INFO: `/v3/users/35d61800281b469cb2d8e0546f4eacbd` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:53.268559 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06917696-a8be-4dd6-8a83-73dc65dbdf50 None admin] RBAC: Authorizing `identity:get_user(user_id=35d61800281b469cb2d8e0546f4eacbd)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:56:53.270357 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06917696-a8be-4dd6-8a83-73dc65dbdf50 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:56:53.272227 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 56/110] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Jul 23 20:56:53 2022] GET /identity/v3/users/35d61800281b469cb2d8e0546f4eacbd => generated 275 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:56:53.273578 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afb5464-a05d-4b1c-ba1f-b25b906f77f9 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:53.274060 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afb5464-a05d-4b1c-ba1f-b25b906f77f9 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:53.274342 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afb5464-a05d-4b1c-ba1f-b25b906f77f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:53.293102 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cccc348-b911-42d1-88cf-808c8dc89efc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:56:53.294083 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cccc348-b911-42d1-88cf-808c8dc89efc None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:53.294370 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cccc348-b911-42d1-88cf-808c8dc89efc None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:53.294478 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-7afb5464-a05d-4b1c-ba1f-b25b906f77f9 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:56:53.294648 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cccc348-b911-42d1-88cf-808c8dc89efc None admin] PATH_INFO: `/v3/users/ede4f4cab761430893de0011491bbf7f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:53.295685 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-7afb5464-a05d-4b1c-ba1f-b25b906f77f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:56:53.311962 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cccc348-b911-42d1-88cf-808c8dc89efc None admin] RBAC: Authorizing `identity:get_user(user_id=ede4f4cab761430893de0011491bbf7f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:56:53.313373 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cccc348-b911-42d1-88cf-808c8dc89efc None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:56:53.319649 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 55/111] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Jul 23 20:56:53 2022] GET /identity/v3/users/ede4f4cab761430893de0011491bbf7f => generated 289 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:56:53.319649 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6e0d01-e3f5-42d3-837c-af2481eefd03 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:53.319649 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6e0d01-e3f5-42d3-837c-af2481eefd03 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:53.319649 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6e0d01-e3f5-42d3-837c-af2481eefd03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:53.336642 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-4f6e0d01-e3f5-42d3-837c-af2481eefd03 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:56:53.337980 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-4f6e0d01-e3f5-42d3-837c-af2481eefd03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:56:53.381088 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 57/112] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:56:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 23 20:56:53.386145 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afb5464-a05d-4b1c-ba1f-b25b906f77f9 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:56:53.394413 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:56:53.427868 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 56/113] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:56:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 23 20:56:53.430841 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6e0d01-e3f5-42d3-837c-af2481eefd03 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:56:53.467798 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:56:53.505014 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afb5464-a05d-4b1c-ba1f-b25b906f77f9 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:56:53.542155 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a3d3a5-23a7-472f-9fab-2437bd16e221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:56:53.542982 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a3d3a5-23a7-472f-9fab-2437bd16e221 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:53.543273 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a3d3a5-23a7-472f-9fab-2437bd16e221 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:53.543549 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a3d3a5-23a7-472f-9fab-2437bd16e221 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:53.544727 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a3d3a5-23a7-472f-9fab-2437bd16e221 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:56:53.546246 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a3d3a5-23a7-472f-9fab-2437bd16e221 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:56:53.548094 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 58/114] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 23 20:56:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:56:53.548715 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a3d3a5-23a7-472f-9fab-2437bd16e221 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:56:53.555200 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6e0d01-e3f5-42d3-837c-af2481eefd03 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:56:53.595729 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b4d9b9-c14c-4742-b682-5647f5b6b175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:56:53.596901 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b4d9b9-c14c-4742-b682-5647f5b6b175 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:53.597449 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b4d9b9-c14c-4742-b682-5647f5b6b175 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:53.597955 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b4d9b9-c14c-4742-b682-5647f5b6b175 None admin] PATH_INFO: `/v3/projects/74cb8c05a64040c48e6687c9bd9865d1` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:53.599426 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b4d9b9-c14c-4742-b682-5647f5b6b175 None admin] RBAC: Authorizing `identity:get_project(project_id=74cb8c05a64040c48e6687c9bd9865d1)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:56:53.601123 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b4d9b9-c14c-4742-b682-5647f5b6b175 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:56:53.603074 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 57/115] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Jul 23 20:56:53 2022] GET /identity/v3/projects/74cb8c05a64040c48e6687c9bd9865d1 => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:56:53.604036 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b4d9b9-c14c-4742-b682-5647f5b6b175 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:56:53.660194 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:56:53.669951 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a3d3a5-23a7-472f-9fab-2437bd16e221 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:56:53.708801 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6897bace-c049-41d1-8764-066c1e671749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:56:53.709465 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6897bace-c049-41d1-8764-066c1e671749 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:53.709754 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6897bace-c049-41d1-8764-066c1e671749 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:53.710083 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6897bace-c049-41d1-8764-066c1e671749 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:53.714341 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b4d9b9-c14c-4742-b682-5647f5b6b175 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:56:53.720804 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:56:53.749009 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f27f5a-bc73-48ff-a94d-6f1e0c7a6ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:56:53.749839 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f27f5a-bc73-48ff-a94d-6f1e0c7a6ddc None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:53.750158 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f27f5a-bc73-48ff-a94d-6f1e0c7a6ddc None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:53.750435 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f27f5a-bc73-48ff-a94d-6f1e0c7a6ddc None admin] PATH_INFO: `/v3/roles/member` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:53.760854 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f27f5a-bc73-48ff-a94d-6f1e0c7a6ddc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:56:53.768861 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-c0f27f5a-bc73-48ff-a94d-6f1e0c7a6ddc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 23 20:56:53.768861 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:56:53.768861 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:56:53.768861 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:56:53.768861 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:56:53.768861 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:56:53.768861 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:56:53.768861 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:56:53.768861 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:56:53.768861 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:56:53.768861 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:56:53.768861 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:56:53.768861 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:56:53.768861 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:56:53.768861 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:56:53.768861 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:56:53.769764 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:56:53.769764 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:56:53.769764 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:56:53.769764 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:56:53.769764 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:56:53.769764 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:56:53.769764 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:56:53.769764 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:56:53.769764 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:56:53.769764 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:56:53.769764 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:56:53.769764 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application with Lock( Jul 23 20:56:53.769764 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:56:53.769764 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:56:53.769764 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:56:53.769764 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:56:53.770589 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:56:53.770589 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:56:53.770589 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:56:53.770589 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:56:53.770589 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:56:53.770589 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:56:53.770589 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:56:53.770589 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:56:53.770589 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:56:53.770589 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:56:53.770589 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 23 20:56:53.770589 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 20:56:53.770589 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 58/116] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Jul 23 20:56:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:56:53.771219 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f27f5a-bc73-48ff-a94d-6f1e0c7a6ddc None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:56:53.782979 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6897bace-c049-41d1-8764-066c1e671749 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:56:53.784480 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6897bace-c049-41d1-8764-066c1e671749 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:56:53.875498 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f27f5a-bc73-48ff-a94d-6f1e0c7a6ddc None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:56:53.882864 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:56:53.886501 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 59/117] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Jul 23 20:56:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 23 20:56:53.887375 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6897bace-c049-41d1-8764-066c1e671749 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:56:53.915641 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e2b8ef-24b6-45a1-8df5-93082bcea06a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:56:53.916475 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e2b8ef-24b6-45a1-8df5-93082bcea06a None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:53.916766 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e2b8ef-24b6-45a1-8df5-93082bcea06a None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:53.917064 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e2b8ef-24b6-45a1-8df5-93082bcea06a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:53.927272 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e2b8ef-24b6-45a1-8df5-93082bcea06a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:56:53.931024 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:56:53.935587 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-38e2b8ef-24b6-45a1-8df5-93082bcea06a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 23 20:56:53.935587 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:56:53.935587 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:56:53.935587 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:56:53.935587 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:56:53.935587 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:56:53.935587 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:56:53.935587 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:56:53.935587 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:56:53.935587 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:56:53.935587 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:56:53.935587 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:56:53.935587 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:56:53.935587 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:56:53.935587 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:56:53.935587 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:56:53.936464 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:56:53.936464 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:56:53.936464 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:56:53.936464 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:56:53.936464 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:56:53.936464 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:56:53.936464 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:56:53.936464 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:56:53.936464 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:56:53.936464 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:56:53.936464 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:56:53.936464 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application with Lock( Jul 23 20:56:53.936464 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:56:53.936464 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:56:53.936464 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:56:53.936464 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:56:53.937463 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:56:53.937463 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:56:53.937463 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:56:53.937463 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:56:53.937463 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:56:53.937463 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:56:53.937463 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:56:53.937463 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:56:53.937463 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:56:53.937463 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:56:53.937463 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 23 20:56:53.937463 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 20:56:53.937463 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 59/118] 10.222.0.17 () {56 vars in 1114 bytes} [Sat Jul 23 20:56:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:56:53.938301 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e2b8ef-24b6-45a1-8df5-93082bcea06a None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:56:53.990651 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6897bace-c049-41d1-8764-066c1e671749 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:56:54.026703 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5860f815-3dd2-4bcb-9dbb-abf622796058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:56:54.027387 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5860f815-3dd2-4bcb-9dbb-abf622796058 None admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:54.027675 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5860f815-3dd2-4bcb-9dbb-abf622796058 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:54.027947 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5860f815-3dd2-4bcb-9dbb-abf622796058 None admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:54.029035 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5860f815-3dd2-4bcb-9dbb-abf622796058 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:56:54.030992 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5860f815-3dd2-4bcb-9dbb-abf622796058 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:56:54.040965 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e2b8ef-24b6-45a1-8df5-93082bcea06a None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:56:54.057317 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 60/119] 10.222.0.17 () {60 vars in 1141 bytes} [Sat Jul 23 20:56:53 2022] POST /identity/v3/projects => generated 302 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 20:56:54.059780 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078d826d-d139-4e54-8bb0-49c9d077d2d9 None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:54.060232 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078d826d-d139-4e54-8bb0-49c9d077d2d9 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:54.060515 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078d826d-d139-4e54-8bb0-49c9d077d2d9 None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:54.062679 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 61/120] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:56:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:56:54.063379 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078d826d-d139-4e54-8bb0-49c9d077d2d9 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:56:54.081976 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f37d83-e4af-46e7-9977-b62570d5247e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:56:54.082921 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f37d83-e4af-46e7-9977-b62570d5247e None admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:54.083206 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f37d83-e4af-46e7-9977-b62570d5247e None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:54.083476 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f37d83-e4af-46e7-9977-b62570d5247e None admin] PATH_INFO: `/v3/projects/74cb8c05a64040c48e6687c9bd9865d1/users/35d61800281b469cb2d8e0546f4eacbd/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:54.085677 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f37d83-e4af-46e7-9977-b62570d5247e None admin] RBAC: Authorizing `identity:create_grant(project_id=74cb8c05a64040c48e6687c9bd9865d1, user_id=35d61800281b469cb2d8e0546f4eacbd, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:56:54.087223 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f37d83-e4af-46e7-9977-b62570d5247e None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:56:54.102303 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 60/121] 10.222.0.17 () {58 vars in 1439 bytes} [Sat Jul 23 20:56:53 2022] PUT /identity/v3/projects/74cb8c05a64040c48e6687c9bd9865d1/users/35d61800281b469cb2d8e0546f4eacbd/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 20:56:54.103048 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f37d83-e4af-46e7-9977-b62570d5247e None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:56:54.145897 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:56:54.194426 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:56:54.207780 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078d826d-d139-4e54-8bb0-49c9d077d2d9 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:56:54.249524 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8789e7ab-695d-49a6-9d3e-3e48d79d0031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:56:54.250526 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8789e7ab-695d-49a6-9d3e-3e48d79d0031 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:54.250818 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8789e7ab-695d-49a6-9d3e-3e48d79d0031 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:54.251202 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8789e7ab-695d-49a6-9d3e-3e48d79d0031 None admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:54.252144 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8789e7ab-695d-49a6-9d3e-3e48d79d0031 None admin] RBAC: Adding query filter params (name=member) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:56:54.252605 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8789e7ab-695d-49a6-9d3e-3e48d79d0031 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:56:54.254360 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8789e7ab-695d-49a6-9d3e-3e48d79d0031 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:56:54.273376 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 62/122] 10.222.0.17 () {56 vars in 1101 bytes} [Sat Jul 23 20:56:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:56:54.273376 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8789e7ab-695d-49a6-9d3e-3e48d79d0031 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:56:54.300865 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f37d83-e4af-46e7-9977-b62570d5247e None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:56:54.363989 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0179dece-2ff0-44dd-a6a6-74c85a504e19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:56:54.364895 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0179dece-2ff0-44dd-a6a6-74c85a504e19 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:54.367890 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0179dece-2ff0-44dd-a6a6-74c85a504e19 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:54.367890 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0179dece-2ff0-44dd-a6a6-74c85a504e19 None admin] PATH_INFO: `/v3/projects/74cb8c05a64040c48e6687c9bd9865d1` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:54.367890 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0179dece-2ff0-44dd-a6a6-74c85a504e19 None admin] RBAC: Authorizing `identity:get_project(project_id=74cb8c05a64040c48e6687c9bd9865d1)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:56:54.371444 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0179dece-2ff0-44dd-a6a6-74c85a504e19 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:56:54.372485 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 61/123] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Jul 23 20:56:54 2022] GET /identity/v3/projects/74cb8c05a64040c48e6687c9bd9865d1 => generated 298 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:56:54.374302 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91a4051-402e-41cf-b91a-3f008a74688e None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:54.374587 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91a4051-402e-41cf-b91a-3f008a74688e None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:54.375151 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91a4051-402e-41cf-b91a-3f008a74688e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:54.395003 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-b91a4051-402e-41cf-b91a-3f008a74688e None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:56:54.396270 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-b91a4051-402e-41cf-b91a-3f008a74688e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:56:54.396909 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8789e7ab-695d-49a6-9d3e-3e48d79d0031 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:56:54.436410 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f25f1e8-38a3-4e2a-8d43-97c00f02b097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:56:54.437337 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f25f1e8-38a3-4e2a-8d43-97c00f02b097 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:54.437624 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f25f1e8-38a3-4e2a-8d43-97c00f02b097 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:54.437932 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f25f1e8-38a3-4e2a-8d43-97c00f02b097 None admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:54.438715 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f25f1e8-38a3-4e2a-8d43-97c00f02b097 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:56:54.439061 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f25f1e8-38a3-4e2a-8d43-97c00f02b097 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:56:54.440537 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f25f1e8-38a3-4e2a-8d43-97c00f02b097 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:56:54.451916 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 63/124] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Jul 23 20:56:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:56:54.452602 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f25f1e8-38a3-4e2a-8d43-97c00f02b097 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:56:54.481666 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:56:54.490455 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 62/125] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:56:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 23 20:56:54.492169 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91a4051-402e-41cf-b91a-3f008a74688e None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:56:54.522301 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:56:54.596356 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f25f1e8-38a3-4e2a-8d43-97c00f02b097 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:56:54.607534 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91a4051-402e-41cf-b91a-3f008a74688e None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:56:54.632353 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1b85fe-ac34-43a3-ac73-02b6766ebeab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:56:54.633457 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1b85fe-ac34-43a3-ac73-02b6766ebeab None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:54.633630 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1b85fe-ac34-43a3-ac73-02b6766ebeab None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:54.633889 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1b85fe-ac34-43a3-ac73-02b6766ebeab None admin] PATH_INFO: `/v3/users/35d61800281b469cb2d8e0546f4eacbd` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:54.635452 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1b85fe-ac34-43a3-ac73-02b6766ebeab None admin] RBAC: Authorizing `identity:get_user(user_id=35d61800281b469cb2d8e0546f4eacbd)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:56:54.637545 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1b85fe-ac34-43a3-ac73-02b6766ebeab None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:56:54.640471 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 64/126] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Jul 23 20:56:54 2022] GET /identity/v3/users/35d61800281b469cb2d8e0546f4eacbd => generated 275 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:56:54.641756 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1b85fe-ac34-43a3-ac73-02b6766ebeab None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:56:54.655688 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757bd167-7515-4022-b8f8-a9b8d292f43e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:56:54.656278 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757bd167-7515-4022-b8f8-a9b8d292f43e None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:54.656617 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757bd167-7515-4022-b8f8-a9b8d292f43e None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:54.656894 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757bd167-7515-4022-b8f8-a9b8d292f43e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:54.657800 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757bd167-7515-4022-b8f8-a9b8d292f43e None admin] RBAC: Adding query filter params (role.id=5e81c9ea0319460391e21a2a77dd537a, scope.project.id=74cb8c05a64040c48e6687c9bd9865d1, user.id=ede4f4cab761430893de0011491bbf7f) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:56:54.658942 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757bd167-7515-4022-b8f8-a9b8d292f43e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:56:54.660581 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757bd167-7515-4022-b8f8-a9b8d292f43e None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:56:54.668723 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 63/127] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Jul 23 20:56:54 2022] GET /identity/v3/role_assignments?user.id=ede4f4cab761430893de0011491bbf7f&scope.project.id=74cb8c05a64040c48e6687c9bd9865d1&role.id=5e81c9ea0319460391e21a2a77dd537a => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:56:54.669916 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757bd167-7515-4022-b8f8-a9b8d292f43e None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:56:54.798517 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:56:54.822655 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757bd167-7515-4022-b8f8-a9b8d292f43e None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:56:54.866263 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:56:54.866459 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0366feb-30f6-4266-bdd2-2791b2b574b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:56:54.867447 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0366feb-30f6-4266-bdd2-2791b2b574b6 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:54.867559 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0366feb-30f6-4266-bdd2-2791b2b574b6 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:54.867793 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0366feb-30f6-4266-bdd2-2791b2b574b6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:54.891693 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0366feb-30f6-4266-bdd2-2791b2b574b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:56:54.900297 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-a0366feb-30f6-4266-bdd2-2791b2b574b6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 23 20:56:54.900297 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:56:54.900297 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:56:54.900297 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:56:54.900297 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:56:54.900297 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:56:54.900297 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:56:54.900297 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:56:54.900297 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:56:54.900297 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:56:54.900297 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:56:54.900297 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:56:54.900297 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:56:54.900297 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:56:54.900297 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:56:54.900297 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:56:54.901180 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:56:54.901180 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:56:54.901180 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:56:54.901180 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:56:54.901180 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:56:54.901180 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:56:54.901180 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:56:54.901180 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:56:54.901180 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:56:54.901180 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:56:54.901180 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:56:54.901180 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application with Lock( Jul 23 20:56:54.901180 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:56:54.901180 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:56:54.901180 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:56:54.901180 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:56:54.901973 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:56:54.901973 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:56:54.901973 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:56:54.901973 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:56:54.901973 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:56:54.901973 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:56:54.901973 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:56:54.901973 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:56:54.901973 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:56:54.901973 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:56:54.901973 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 23 20:56:54.901973 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 20:56:54.901973 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 64/128] 10.222.0.17 () {56 vars in 1096 bytes} [Sat Jul 23 20:56:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:56:54.902613 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0366feb-30f6-4266-bdd2-2791b2b574b6 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:56:54.909565 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1b85fe-ac34-43a3-ac73-02b6766ebeab None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:56:54.958954 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2012f593-fe92-4326-b6de-21c317242f82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:56:54.959902 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2012f593-fe92-4326-b6de-21c317242f82 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:54.960508 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2012f593-fe92-4326-b6de-21c317242f82 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:54.960612 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2012f593-fe92-4326-b6de-21c317242f82 None admin] PATH_INFO: `/v3/users/35d61800281b469cb2d8e0546f4eacbd` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:54.961787 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2012f593-fe92-4326-b6de-21c317242f82 None admin] RBAC: Authorizing `identity:get_user(user_id=35d61800281b469cb2d8e0546f4eacbd)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:56:54.963495 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2012f593-fe92-4326-b6de-21c317242f82 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:56:54.965219 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 65/129] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Jul 23 20:56:54 2022] GET /identity/v3/users/35d61800281b469cb2d8e0546f4eacbd => generated 275 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:56:54.966043 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2012f593-fe92-4326-b6de-21c317242f82 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:56:55.020966 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0366feb-30f6-4266-bdd2-2791b2b574b6 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:56:55.066775 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4fc7c7-ae56-4cad-8eee-e8af9f0d1b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:56:55.068161 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4fc7c7-ae56-4cad-8eee-e8af9f0d1b7f None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:55.068673 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4fc7c7-ae56-4cad-8eee-e8af9f0d1b7f None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:55.069254 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4fc7c7-ae56-4cad-8eee-e8af9f0d1b7f None admin] PATH_INFO: `/v3/projects/c1cfbbe0d85c4ac9b70b594f37b2646c` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:55.072879 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2012f593-fe92-4326-b6de-21c317242f82 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:56:55.073896 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4fc7c7-ae56-4cad-8eee-e8af9f0d1b7f None admin] RBAC: Authorizing `identity:get_project(project_id=c1cfbbe0d85c4ac9b70b594f37b2646c)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:56:55.075824 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4fc7c7-ae56-4cad-8eee-e8af9f0d1b7f None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:56:55.078201 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 65/130] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Jul 23 20:56:54 2022] GET /identity/v3/projects/c1cfbbe0d85c4ac9b70b594f37b2646c => generated 312 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:56:55.079240 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4fc7c7-ae56-4cad-8eee-e8af9f0d1b7f None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:56:55.099857 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:56:55.111354 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a89f453-c591-43d0-b6c5-4773dcae5739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:56:55.112055 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a89f453-c591-43d0-b6c5-4773dcae5739 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:55.112346 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a89f453-c591-43d0-b6c5-4773dcae5739 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:55.112626 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a89f453-c591-43d0-b6c5-4773dcae5739 None admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:55.113602 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a89f453-c591-43d0-b6c5-4773dcae5739 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:56:55.113995 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a89f453-c591-43d0-b6c5-4773dcae5739 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:56:55.116028 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a89f453-c591-43d0-b6c5-4773dcae5739 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:56:55.128024 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 66/131] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Jul 23 20:56:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:56:55.128945 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a89f453-c591-43d0-b6c5-4773dcae5739 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:56:55.149788 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:56:55.197397 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4fc7c7-ae56-4cad-8eee-e8af9f0d1b7f None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:56:55.252127 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0aa0c9-077e-4bfc-84f0-d98dc9d5e165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:56:55.254552 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0aa0c9-077e-4bfc-84f0-d98dc9d5e165 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:55.255873 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0aa0c9-077e-4bfc-84f0-d98dc9d5e165 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:55.257061 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0aa0c9-077e-4bfc-84f0-d98dc9d5e165 None admin] PATH_INFO: `/v3/projects/74cb8c05a64040c48e6687c9bd9865d1` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:55.258814 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0aa0c9-077e-4bfc-84f0-d98dc9d5e165 None admin] RBAC: Authorizing `identity:get_project(project_id=74cb8c05a64040c48e6687c9bd9865d1)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:56:55.261767 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0aa0c9-077e-4bfc-84f0-d98dc9d5e165 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:56:55.264523 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 66/132] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Jul 23 20:56:55 2022] GET /identity/v3/projects/74cb8c05a64040c48e6687c9bd9865d1 => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:56:55.266167 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0aa0c9-077e-4bfc-84f0-d98dc9d5e165 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:56:55.268716 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a89f453-c591-43d0-b6c5-4773dcae5739 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:56:55.329685 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53204422-3b68-4846-8df6-7a102d16ae4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:56:55.332266 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53204422-3b68-4846-8df6-7a102d16ae4d None admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:55.333492 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53204422-3b68-4846-8df6-7a102d16ae4d None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:55.334069 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53204422-3b68-4846-8df6-7a102d16ae4d None admin] PATH_INFO: `/v3/projects/c1cfbbe0d85c4ac9b70b594f37b2646c/users/35d61800281b469cb2d8e0546f4eacbd/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:55.337809 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53204422-3b68-4846-8df6-7a102d16ae4d None admin] RBAC: Authorizing `identity:create_grant(project_id=c1cfbbe0d85c4ac9b70b594f37b2646c, user_id=35d61800281b469cb2d8e0546f4eacbd, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:56:55.341052 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53204422-3b68-4846-8df6-7a102d16ae4d None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:56:55.370610 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 67/133] 10.222.0.17 () {58 vars in 1439 bytes} [Sat Jul 23 20:56:55 2022] PUT /identity/v3/projects/c1cfbbe0d85c4ac9b70b594f37b2646c/users/35d61800281b469cb2d8e0546f4eacbd/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 20:56:55.371852 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53204422-3b68-4846-8df6-7a102d16ae4d None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:56:55.419251 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:56:55.449540 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0aa0c9-077e-4bfc-84f0-d98dc9d5e165 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:56:55.519059 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec33c603-f9eb-4638-b253-77ca287958f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:56:55.520079 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec33c603-f9eb-4638-b253-77ca287958f2 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:55.520359 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec33c603-f9eb-4638-b253-77ca287958f2 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:55.520643 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec33c603-f9eb-4638-b253-77ca287958f2 None admin] PATH_INFO: `/v3/users/ef460ef8c739443881697a7ad53288a2` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:55.523131 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec33c603-f9eb-4638-b253-77ca287958f2 None admin] RBAC: Authorizing `identity:get_user(user_id=ef460ef8c739443881697a7ad53288a2)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:56:55.524623 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec33c603-f9eb-4638-b253-77ca287958f2 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:56:55.526712 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 67/134] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Jul 23 20:56:55 2022] GET /identity/v3/users/ef460ef8c739443881697a7ad53288a2 => generated 247 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:56:55.532712 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec33c603-f9eb-4638-b253-77ca287958f2 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:56:55.602243 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:56:55.664373 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53204422-3b68-4846-8df6-7a102d16ae4d None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:56:55.691876 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec33c603-f9eb-4638-b253-77ca287958f2 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:56:55.746191 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff27865-19e7-45ca-a601-97f5c488ca3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:56:55.748360 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff27865-19e7-45ca-a601-97f5c488ca3e None admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:55.748360 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff27865-19e7-45ca-a601-97f5c488ca3e None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:55.748360 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff27865-19e7-45ca-a601-97f5c488ca3e None admin] PATH_INFO: `/v3/projects/74cb8c05a64040c48e6687c9bd9865d1/users/35d61800281b469cb2d8e0546f4eacbd/roles/c5f46541d35e44b691baa7a1fa304c0f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:55.750854 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff27865-19e7-45ca-a601-97f5c488ca3e None admin] RBAC: Authorizing `identity:create_grant(project_id=74cb8c05a64040c48e6687c9bd9865d1, user_id=35d61800281b469cb2d8e0546f4eacbd, role_id=c5f46541d35e44b691baa7a1fa304c0f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:56:55.752992 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff27865-19e7-45ca-a601-97f5c488ca3e None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:56:55.762550 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18403a69-3271-4852-ba1a-25bbfdf9fc55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:56:55.763573 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18403a69-3271-4852-ba1a-25bbfdf9fc55 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:55.763858 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18403a69-3271-4852-ba1a-25bbfdf9fc55 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:55.764132 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18403a69-3271-4852-ba1a-25bbfdf9fc55 None admin] PATH_INFO: `/v3/projects/74cb8c05a64040c48e6687c9bd9865d1` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:55.770348 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18403a69-3271-4852-ba1a-25bbfdf9fc55 None admin] RBAC: Authorizing `identity:get_project(project_id=74cb8c05a64040c48e6687c9bd9865d1)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:56:55.771890 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18403a69-3271-4852-ba1a-25bbfdf9fc55 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:56:55.775657 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 68/135] 10.222.0.17 () {58 vars in 1439 bytes} [Sat Jul 23 20:56:55 2022] PUT /identity/v3/projects/74cb8c05a64040c48e6687c9bd9865d1/users/35d61800281b469cb2d8e0546f4eacbd/roles/c5f46541d35e44b691baa7a1fa304c0f => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 20:56:55.777852 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 68/136] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Jul 23 20:56:55 2022] GET /identity/v3/projects/74cb8c05a64040c48e6687c9bd9865d1 => generated 298 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:56:55.784575 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff27865-19e7-45ca-a601-97f5c488ca3e None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:56:55.917556 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff27865-19e7-45ca-a601-97f5c488ca3e None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:56:55.961290 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b35e8b1-7d83-4fa9-a17e-981117794ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:56:55.962250 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b35e8b1-7d83-4fa9-a17e-981117794ae9 None admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:55.962532 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b35e8b1-7d83-4fa9-a17e-981117794ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:55.962808 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b35e8b1-7d83-4fa9-a17e-981117794ae9 None admin] PATH_INFO: `/v3/projects/74cb8c05a64040c48e6687c9bd9865d1/users/ef460ef8c739443881697a7ad53288a2/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:55.967024 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b35e8b1-7d83-4fa9-a17e-981117794ae9 None admin] RBAC: Authorizing `identity:create_grant(project_id=74cb8c05a64040c48e6687c9bd9865d1, user_id=ef460ef8c739443881697a7ad53288a2, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:56:55.968516 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b35e8b1-7d83-4fa9-a17e-981117794ae9 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:56:55.971055 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:56:55.987130 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 69/137] 10.222.0.17 () {58 vars in 1439 bytes} [Sat Jul 23 20:56:55 2022] PUT /identity/v3/projects/74cb8c05a64040c48e6687c9bd9865d1/users/ef460ef8c739443881697a7ad53288a2/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 20:56:57.005712 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f68cee-880f-4cfa-821d-49eef396dc15 None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:57.006290 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f68cee-880f-4cfa-821d-49eef396dc15 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:57.006290 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f68cee-880f-4cfa-821d-49eef396dc15 None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:57.008114 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 69/138] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:56:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:56:57.014497 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aee163d-5315-4109-8c5d-e1644622e677 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:57.014951 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aee163d-5315-4109-8c5d-e1644622e677 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:57.015333 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aee163d-5315-4109-8c5d-e1644622e677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:57.047272 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-2aee163d-5315-4109-8c5d-e1644622e677 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:56:57.048573 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-2aee163d-5315-4109-8c5d-e1644622e677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:56:57.141783 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 70/139] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:56:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 23 20:56:57.175705 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f68cee-880f-4cfa-821d-49eef396dc15 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:56:57.203496 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:56:57.308622 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f68cee-880f-4cfa-821d-49eef396dc15 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:56:57.355052 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2ed6e1-120f-4856-b329-979ca52ed039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:56:57.355879 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2ed6e1-120f-4856-b329-979ca52ed039 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:57.356163 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2ed6e1-120f-4856-b329-979ca52ed039 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:57.356440 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2ed6e1-120f-4856-b329-979ca52ed039 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:57.371699 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2ed6e1-120f-4856-b329-979ca52ed039 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:56:57.379728 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-fe2ed6e1-120f-4856-b329-979ca52ed039 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 23 20:56:57.379728 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:56:57.379728 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:56:57.379728 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:56:57.379728 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:56:57.379728 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:56:57.379728 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:56:57.379728 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:56:57.379728 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:56:57.379728 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:56:57.379728 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:56:57.379728 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:56:57.379728 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:56:57.379728 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:56:57.379728 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:56:57.379728 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:56:57.380553 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:56:57.380553 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:56:57.380553 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:56:57.380553 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:56:57.380553 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:56:57.380553 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:56:57.380553 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:56:57.380553 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:56:57.380553 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:56:57.380553 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:56:57.380553 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:56:57.380553 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application with Lock( Jul 23 20:56:57.380553 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:56:57.380553 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:56:57.380553 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:56:57.380553 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:56:57.381315 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:56:57.381315 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:56:57.381315 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:56:57.381315 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:56:57.381315 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:56:57.381315 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:56:57.381315 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:56:57.381315 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:56:57.381315 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:56:57.381315 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:56:57.381315 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 23 20:56:57.381315 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 20:56:57.381315 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 70/140] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Jul 23 20:56:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:56:57.388671 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aee163d-5315-4109-8c5d-e1644622e677 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:56:57.405701 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2e5290-10a0-4c8d-b2d1-14d36a7555e6 None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:57.405911 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2e5290-10a0-4c8d-b2d1-14d36a7555e6 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:57.406206 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2e5290-10a0-4c8d-b2d1-14d36a7555e6 None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:57.407870 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 71/141] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:56:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 23 20:56:57.413221 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9779f2c-9e58-42df-b61d-b4844d6eca5b None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:57.413504 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9779f2c-9e58-42df-b61d-b4844d6eca5b None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:57.413788 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9779f2c-9e58-42df-b61d-b4844d6eca5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:57.446863 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-c9779f2c-9e58-42df-b61d-b4844d6eca5b None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:56:57.448074 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-c9779f2c-9e58-42df-b61d-b4844d6eca5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:56:57.575021 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aee163d-5315-4109-8c5d-e1644622e677 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:56:57.602681 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:56:57.615899 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6d3c5c-4ae6-4f88-9383-7b61417858a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:56:57.616965 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6d3c5c-4ae6-4f88-9383-7b61417858a3 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:57.618223 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6d3c5c-4ae6-4f88-9383-7b61417858a3 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:57.618521 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6d3c5c-4ae6-4f88-9383-7b61417858a3 None admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:57.619301 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6d3c5c-4ae6-4f88-9383-7b61417858a3 None admin] RBAC: Adding query filter params (name=member) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:56:57.619608 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6d3c5c-4ae6-4f88-9383-7b61417858a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:56:57.621014 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6d3c5c-4ae6-4f88-9383-7b61417858a3 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:56:57.627593 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 72/142] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:56:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 23 20:56:57.630623 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 71/143] 10.222.0.17 () {56 vars in 1101 bytes} [Sat Jul 23 20:56:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:56:57.635983 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9779f2c-9e58-42df-b61d-b4844d6eca5b None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:56:57.658325 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:56:57.659572 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6d3c5c-4ae6-4f88-9383-7b61417858a3 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:56:57.771998 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6d3c5c-4ae6-4f88-9383-7b61417858a3 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:56:57.826643 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702c04cf-f9de-4972-ae64-9f4c1725883d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:56:57.827767 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702c04cf-f9de-4972-ae64-9f4c1725883d None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:57.830265 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702c04cf-f9de-4972-ae64-9f4c1725883d None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:57.830696 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702c04cf-f9de-4972-ae64-9f4c1725883d None admin] PATH_INFO: `/v3/domains/default` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:57.833161 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702c04cf-f9de-4972-ae64-9f4c1725883d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:56:57.834821 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702c04cf-f9de-4972-ae64-9f4c1725883d None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:56:57.836917 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 72/144] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 23 20:56:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:56:57.848698 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702c04cf-f9de-4972-ae64-9f4c1725883d None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:56:57.870986 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9779f2c-9e58-42df-b61d-b4844d6eca5b None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:56:57.945100 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b6181f-f7e0-4897-93ad-5a4c77452458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:56:57.945949 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b6181f-f7e0-4897-93ad-5a4c77452458 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:57.946228 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b6181f-f7e0-4897-93ad-5a4c77452458 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:57.946497 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b6181f-f7e0-4897-93ad-5a4c77452458 None admin] PATH_INFO: `/v3/users/35d61800281b469cb2d8e0546f4eacbd` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:57.947721 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b6181f-f7e0-4897-93ad-5a4c77452458 None admin] RBAC: Authorizing `identity:get_user(user_id=35d61800281b469cb2d8e0546f4eacbd)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:56:57.949178 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b6181f-f7e0-4897-93ad-5a4c77452458 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:56:57.950862 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 73/145] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Jul 23 20:56:57 2022] GET /identity/v3/users/35d61800281b469cb2d8e0546f4eacbd => generated 275 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:56:57.956511 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b6181f-f7e0-4897-93ad-5a4c77452458 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:56:57.988993 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:56:58.126042 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:56:58.128701 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702c04cf-f9de-4972-ae64-9f4c1725883d None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:56:58.167361 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b6181f-f7e0-4897-93ad-5a4c77452458 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:56:58.220418 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abca083-cd85-4dd1-bbdc-6f6088bc8530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:56:58.221026 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abca083-cd85-4dd1-bbdc-6f6088bc8530 None admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:58.221323 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abca083-cd85-4dd1-bbdc-6f6088bc8530 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:58.221729 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abca083-cd85-4dd1-bbdc-6f6088bc8530 None admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:58.222884 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abca083-cd85-4dd1-bbdc-6f6088bc8530 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:56:58.224531 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abca083-cd85-4dd1-bbdc-6f6088bc8530 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:56:58.241197 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcb5db8-ce5c-4eb4-87c4-322b7cf14b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:56:58.243203 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcb5db8-ce5c-4eb4-87c4-322b7cf14b14 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:58.243733 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcb5db8-ce5c-4eb4-87c4-322b7cf14b14 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:58.244503 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcb5db8-ce5c-4eb4-87c4-322b7cf14b14 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:58.264980 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 73/146] 10.222.0.17 () {60 vars in 1132 bytes} [Sat Jul 23 20:56:57 2022] POST /identity/v3/users => generated 283 bytes in 417 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 20:56:58.375799 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcb5db8-ce5c-4eb4-87c4-322b7cf14b14 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:56:58.378666 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcb5db8-ce5c-4eb4-87c4-322b7cf14b14 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:56:58.468687 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b5927a-114b-408a-98ce-e46493aa4b4f None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:58.468880 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b5927a-114b-408a-98ce-e46493aa4b4f None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:58.469118 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b5927a-114b-408a-98ce-e46493aa4b4f None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:58.470993 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 74/147] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:56:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:56:58.476652 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0158f318-84c0-440c-bb4d-dcf89b4b506b None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:58.476935 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0158f318-84c0-440c-bb4d-dcf89b4b506b None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:58.477216 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0158f318-84c0-440c-bb4d-dcf89b4b506b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:58.507158 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-0158f318-84c0-440c-bb4d-dcf89b4b506b None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:56:58.509278 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-0158f318-84c0-440c-bb4d-dcf89b4b506b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:56:58.521975 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:56:58.577165 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 74/148] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Jul 23 20:56:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 621 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 23 20:56:58.582748 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcb5db8-ce5c-4eb4-87c4-322b7cf14b14 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:56:58.636431 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 75/149] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:56:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 23 20:56:58.638056 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e5ef6c-9aa3-4128-bda9-1e7e4b833689 None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:58.638343 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e5ef6c-9aa3-4128-bda9-1e7e4b833689 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:58.638618 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e5ef6c-9aa3-4128-bda9-1e7e4b833689 None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:58.640133 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 76/150] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:56:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:56:58.655877 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6332f2e2-8864-426f-822e-37f9ba29bbf1 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:58.656178 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6332f2e2-8864-426f-822e-37f9ba29bbf1 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:58.656419 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6332f2e2-8864-426f-822e-37f9ba29bbf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:58.681114 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-6332f2e2-8864-426f-822e-37f9ba29bbf1 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:56:58.682638 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-6332f2e2-8864-426f-822e-37f9ba29bbf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:56:58.744079 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:56:58.759737 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcb5db8-ce5c-4eb4-87c4-322b7cf14b14 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:56:58.788916 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 77/151] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:56:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 23 20:56:58.790311 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6332f2e2-8864-426f-822e-37f9ba29bbf1 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:56:58.811305 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a301cf12-8b3a-4610-a251-4fc781040efa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:56:58.812214 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a301cf12-8b3a-4610-a251-4fc781040efa None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:58.812545 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a301cf12-8b3a-4610-a251-4fc781040efa None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:58.812829 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a301cf12-8b3a-4610-a251-4fc781040efa None admin] PATH_INFO: `/v3/projects/74cb8c05a64040c48e6687c9bd9865d1` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:58.814972 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a301cf12-8b3a-4610-a251-4fc781040efa None admin] RBAC: Authorizing `identity:get_project(project_id=74cb8c05a64040c48e6687c9bd9865d1)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:56:58.816583 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a301cf12-8b3a-4610-a251-4fc781040efa None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:56:58.818618 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 75/152] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Jul 23 20:56:58 2022] GET /identity/v3/projects/74cb8c05a64040c48e6687c9bd9865d1 => generated 298 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 20:56:58.830739 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a301cf12-8b3a-4610-a251-4fc781040efa None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:56:58.892322 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:56:58.910308 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6332f2e2-8864-426f-822e-37f9ba29bbf1 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:56:58.953070 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd5359a-7e70-48ce-975c-52d07feec92f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:56:58.954200 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd5359a-7e70-48ce-975c-52d07feec92f None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:58.954624 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd5359a-7e70-48ce-975c-52d07feec92f None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:58.955137 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd5359a-7e70-48ce-975c-52d07feec92f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:58.966330 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a301cf12-8b3a-4610-a251-4fc781040efa None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:56:58.968720 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd5359a-7e70-48ce-975c-52d07feec92f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:56:58.977427 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-ecd5359a-7e70-48ce-975c-52d07feec92f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 23 20:56:58.977427 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:56:58.977427 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:56:58.977427 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:56:58.977427 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:56:58.977427 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:56:58.977427 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:56:58.977427 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:56:58.977427 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:56:58.977427 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:56:58.977427 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:56:58.977427 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:56:58.977427 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:56:58.977427 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:56:58.977427 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:56:58.977427 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:56:58.978351 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:56:58.978351 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:56:58.978351 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:56:58.978351 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:56:58.978351 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:56:58.978351 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:56:58.978351 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:56:58.978351 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:56:58.978351 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:56:58.978351 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:56:58.978351 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:56:58.978351 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application with Lock( Jul 23 20:56:58.978351 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:56:58.978351 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:56:58.978351 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:56:58.978351 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:56:58.979118 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:56:58.979118 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:56:58.979118 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:56:58.979118 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:56:58.979118 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:56:58.979118 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:56:58.979118 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:56:58.979118 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:56:58.979118 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:56:58.979118 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:56:58.979118 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 23 20:56:58.979118 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:56:58.981847 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 78/153] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Jul 23 20:56:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:56:58.983177 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd5359a-7e70-48ce-975c-52d07feec92f None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:56:59.005629 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7fde1c-e902-4bb6-a7f6-60c9f91bd79d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:56:59.006925 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7fde1c-e902-4bb6-a7f6-60c9f91bd79d None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:59.007204 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7fde1c-e902-4bb6-a7f6-60c9f91bd79d None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:59.007476 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7fde1c-e902-4bb6-a7f6-60c9f91bd79d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:59.008741 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7fde1c-e902-4bb6-a7f6-60c9f91bd79d None admin] RBAC: Adding query filter params (role.id=14824669685048b38361b1676f7f0f9f, scope.project.id=74cb8c05a64040c48e6687c9bd9865d1, user.id=35d61800281b469cb2d8e0546f4eacbd) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:56:59.009058 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7fde1c-e902-4bb6-a7f6-60c9f91bd79d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:56:59.010818 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7fde1c-e902-4bb6-a7f6-60c9f91bd79d None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:56:59.018801 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 76/154] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Jul 23 20:56:58 2022] GET /identity/v3/role_assignments?user.id=35d61800281b469cb2d8e0546f4eacbd&scope.project.id=74cb8c05a64040c48e6687c9bd9865d1&role.id=14824669685048b38361b1676f7f0f9f => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:56:59.020197 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7fde1c-e902-4bb6-a7f6-60c9f91bd79d None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:56:59.025354 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:56:59.125236 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd5359a-7e70-48ce-975c-52d07feec92f None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:56:59.166402 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd211b3a-7469-4dbc-b093-468ac7c5375d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:56:59.168162 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd211b3a-7469-4dbc-b093-468ac7c5375d None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:59.168162 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd211b3a-7469-4dbc-b093-468ac7c5375d None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:59.168162 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd211b3a-7469-4dbc-b093-468ac7c5375d None admin] PATH_INFO: `/v3/roles/member` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:59.184369 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd211b3a-7469-4dbc-b093-468ac7c5375d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:56:59.193916 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-bd211b3a-7469-4dbc-b093-468ac7c5375d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 23 20:56:59.193916 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:56:59.193916 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:56:59.193916 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:56:59.193916 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:56:59.193916 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:56:59.193916 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:56:59.193916 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:56:59.193916 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:56:59.193916 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:56:59.193916 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:56:59.193916 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:56:59.193916 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:56:59.193916 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:56:59.193916 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:56:59.193916 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:56:59.194857 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:56:59.194857 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:56:59.194857 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:56:59.194857 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:56:59.194857 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:56:59.194857 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:56:59.194857 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:56:59.194857 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:56:59.194857 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:56:59.194857 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:56:59.194857 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:56:59.194857 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application with Lock( Jul 23 20:56:59.194857 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:56:59.194857 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:56:59.194857 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:56:59.194857 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:56:59.195859 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:56:59.195859 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:56:59.195859 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:56:59.195859 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:56:59.195859 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:56:59.195859 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:56:59.195859 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:56:59.195859 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:56:59.195859 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:56:59.195859 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:56:59.195859 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 23 20:56:59.195859 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:56:59.195859 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 79/155] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Jul 23 20:56:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:56:59.201578 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd211b3a-7469-4dbc-b093-468ac7c5375d None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:56:59.256385 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7fde1c-e902-4bb6-a7f6-60c9f91bd79d None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:56:59.283906 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:56:59.312632 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:56:59.321449 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd211b3a-7469-4dbc-b093-468ac7c5375d None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:56:59.357492 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9956f1-3ae5-46d8-a73e-63d171a492aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:56:59.358231 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9956f1-3ae5-46d8-a73e-63d171a492aa None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:59.358607 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9956f1-3ae5-46d8-a73e-63d171a492aa None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:59.358888 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9956f1-3ae5-46d8-a73e-63d171a492aa None admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:59.359656 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9956f1-3ae5-46d8-a73e-63d171a492aa None admin] RBAC: Adding query filter params (name=reader) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:56:59.359845 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74ee266-a6bf-4833-befb-e8c246e5023e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:56:59.359961 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9956f1-3ae5-46d8-a73e-63d171a492aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:56:59.360467 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74ee266-a6bf-4833-befb-e8c246e5023e None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:59.360742 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74ee266-a6bf-4833-befb-e8c246e5023e None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:59.361009 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74ee266-a6bf-4833-befb-e8c246e5023e None admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:59.361343 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9956f1-3ae5-46d8-a73e-63d171a492aa None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:56:59.361764 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74ee266-a6bf-4833-befb-e8c246e5023e None admin] RBAC: Adding query filter params (name=member) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:56:59.362098 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74ee266-a6bf-4833-befb-e8c246e5023e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:56:59.363928 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74ee266-a6bf-4833-befb-e8c246e5023e None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:56:59.373434 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 80/156] 10.222.0.17 () {56 vars in 1101 bytes} [Sat Jul 23 20:56:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 20:56:59.379357 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74ee266-a6bf-4833-befb-e8c246e5023e None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:56:59.380050 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 77/157] 10.222.0.17 () {56 vars in 1101 bytes} [Sat Jul 23 20:56:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:56:59.386016 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9956f1-3ae5-46d8-a73e-63d171a492aa None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:56:59.488564 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74ee266-a6bf-4833-befb-e8c246e5023e None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:56:59.526478 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac2958b-d950-4a18-8de5-231e2e4f20da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:56:59.527299 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac2958b-d950-4a18-8de5-231e2e4f20da None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:59.527572 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac2958b-d950-4a18-8de5-231e2e4f20da None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:59.527951 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac2958b-d950-4a18-8de5-231e2e4f20da None admin] PATH_INFO: `/v3/users/35d61800281b469cb2d8e0546f4eacbd` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:59.529669 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac2958b-d950-4a18-8de5-231e2e4f20da None admin] RBAC: Authorizing `identity:get_user(user_id=35d61800281b469cb2d8e0546f4eacbd)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:56:59.531191 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac2958b-d950-4a18-8de5-231e2e4f20da None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:56:59.538018 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 81/158] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Jul 23 20:56:59 2022] GET /identity/v3/users/35d61800281b469cb2d8e0546f4eacbd => generated 275 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 20:56:59.539659 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91840c30-c6b2-495f-b2b9-c447a1e70905 None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:59.539948 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91840c30-c6b2-495f-b2b9-c447a1e70905 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:59.540219 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91840c30-c6b2-495f-b2b9-c447a1e70905 None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:59.541630 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 82/159] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:56:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:56:59.542953 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91840c30-c6b2-495f-b2b9-c447a1e70905 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:56:59.568454 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:56:59.576231 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9956f1-3ae5-46d8-a73e-63d171a492aa None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:56:59.627140 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b33b130-73ce-4f4f-a41f-2bab11557d33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:56:59.628036 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b33b130-73ce-4f4f-a41f-2bab11557d33 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:59.628314 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b33b130-73ce-4f4f-a41f-2bab11557d33 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:59.628655 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b33b130-73ce-4f4f-a41f-2bab11557d33 None admin] PATH_INFO: `/v3/users/ede4f4cab761430893de0011491bbf7f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:59.629926 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b33b130-73ce-4f4f-a41f-2bab11557d33 None admin] RBAC: Authorizing `identity:get_user(user_id=ede4f4cab761430893de0011491bbf7f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:56:59.631409 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b33b130-73ce-4f4f-a41f-2bab11557d33 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:56:59.633425 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 78/160] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Jul 23 20:56:59 2022] GET /identity/v3/users/ede4f4cab761430893de0011491bbf7f => generated 289 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:56:59.634773 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f9ab16-1ee7-4337-bb5c-564d00747931 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:59.635041 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f9ab16-1ee7-4337-bb5c-564d00747931 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:59.635315 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f9ab16-1ee7-4337-bb5c-564d00747931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:59.656499 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-d8f9ab16-1ee7-4337-bb5c-564d00747931 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:56:59.657702 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-d8f9ab16-1ee7-4337-bb5c-564d00747931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:56:59.673670 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91840c30-c6b2-495f-b2b9-c447a1e70905 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:56:59.700545 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:56:59.733769 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9659075b-c3f3-4f2a-81c9-e207e3402563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:56:59.734471 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9659075b-c3f3-4f2a-81c9-e207e3402563 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:56:59.734749 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9659075b-c3f3-4f2a-81c9-e207e3402563 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:56:59.735018 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9659075b-c3f3-4f2a-81c9-e207e3402563 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:56:59.763688 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 79/161] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:56:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 23 20:56:59.764574 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f9ab16-1ee7-4337-bb5c-564d00747931 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:56:59.872757 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9659075b-c3f3-4f2a-81c9-e207e3402563 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:56:59.874339 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9659075b-c3f3-4f2a-81c9-e207e3402563 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:56:59.896981 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:56:59.941383 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f9ab16-1ee7-4337-bb5c-564d00747931 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:56:59.990471 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 83/162] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Jul 23 20:56:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 23 20:56:59.990471 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9659075b-c3f3-4f2a-81c9-e207e3402563 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:00.009481 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbdb9c3-cb19-470e-b67e-ba5d7a0d8501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:00.010414 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbdb9c3-cb19-470e-b67e-ba5d7a0d8501 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:00.010682 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbdb9c3-cb19-470e-b67e-ba5d7a0d8501 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:00.010947 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbdb9c3-cb19-470e-b67e-ba5d7a0d8501 None admin] PATH_INFO: `/v3/projects/74cb8c05a64040c48e6687c9bd9865d1` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:00.012201 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbdb9c3-cb19-470e-b67e-ba5d7a0d8501 None admin] RBAC: Authorizing `identity:get_project(project_id=74cb8c05a64040c48e6687c9bd9865d1)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:00.013679 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbdb9c3-cb19-470e-b67e-ba5d7a0d8501 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:00.015469 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 80/163] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Jul 23 20:56:59 2022] GET /identity/v3/projects/74cb8c05a64040c48e6687c9bd9865d1 => generated 298 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:57:00.016776 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccbfa16-8f50-42a1-9e67-ba526a6c6a0a None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:00.017059 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccbfa16-8f50-42a1-9e67-ba526a6c6a0a None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:00.017329 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccbfa16-8f50-42a1-9e67-ba526a6c6a0a None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:00.018659 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 81/164] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:57:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:57:00.019488 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccbfa16-8f50-42a1-9e67-ba526a6c6a0a None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:00.092624 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:00.168786 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9659075b-c3f3-4f2a-81c9-e207e3402563 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:00.197281 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccbfa16-8f50-42a1-9e67-ba526a6c6a0a None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:00.223890 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:00.256319 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2564b86c-cb4f-42cd-a43c-88c86658ce64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:00.257164 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2564b86c-cb4f-42cd-a43c-88c86658ce64 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:00.257445 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2564b86c-cb4f-42cd-a43c-88c86658ce64 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:00.257710 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2564b86c-cb4f-42cd-a43c-88c86658ce64 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:00.281724 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460f6079-0e96-4f00-b628-877600d53ddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:00.282642 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460f6079-0e96-4f00-b628-877600d53ddd None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:00.282922 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460f6079-0e96-4f00-b628-877600d53ddd None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:00.283194 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460f6079-0e96-4f00-b628-877600d53ddd None admin] PATH_INFO: `/v3/projects/c1cfbbe0d85c4ac9b70b594f37b2646c` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:00.284912 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460f6079-0e96-4f00-b628-877600d53ddd None admin] RBAC: Authorizing `identity:get_project(project_id=c1cfbbe0d85c4ac9b70b594f37b2646c)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:00.286429 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460f6079-0e96-4f00-b628-877600d53ddd None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:00.288165 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 82/165] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Jul 23 20:57:00 2022] GET /identity/v3/projects/c1cfbbe0d85c4ac9b70b594f37b2646c => generated 312 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:57:00.289420 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eda8332-126c-4a68-ba7c-887c0a937b4b None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:00.289611 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eda8332-126c-4a68-ba7c-887c0a937b4b None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:00.289892 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eda8332-126c-4a68-ba7c-887c0a937b4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:00.291721 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2564b86c-cb4f-42cd-a43c-88c86658ce64 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:57:00.300167 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-2564b86c-cb4f-42cd-a43c-88c86658ce64 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 23 20:57:00.300167 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:57:00.300167 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:57:00.300167 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:57:00.300167 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:57:00.300167 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:57:00.300167 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:57:00.300167 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:57:00.300167 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:57:00.300167 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:57:00.300167 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:57:00.300167 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:57:00.300167 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:57:00.300167 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:57:00.300167 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:57:00.300167 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:57:00.301106 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:57:00.301106 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:57:00.301106 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:57:00.301106 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:57:00.301106 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:57:00.301106 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:57:00.301106 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:57:00.301106 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:57:00.301106 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:57:00.301106 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:57:00.301106 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:57:00.301106 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application with Lock( Jul 23 20:57:00.301106 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:57:00.301106 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:57:00.301106 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:57:00.301106 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:57:00.302841 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:57:00.302841 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:57:00.302841 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:57:00.302841 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:57:00.302841 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:57:00.302841 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:57:00.302841 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:57:00.302841 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:57:00.302841 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:57:00.302841 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:57:00.302841 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 23 20:57:00.302841 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:57:00.302841 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 84/166] 10.222.0.17 () {56 vars in 1114 bytes} [Sat Jul 23 20:56:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:57:00.302841 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2564b86c-cb4f-42cd-a43c-88c86658ce64 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:00.333673 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-3eda8332-126c-4a68-ba7c-887c0a937b4b None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:57:00.334913 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-3eda8332-126c-4a68-ba7c-887c0a937b4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:57:00.418020 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2564b86c-cb4f-42cd-a43c-88c86658ce64 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:00.464203 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 83/167] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:57:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 23 20:57:00.465218 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eda8332-126c-4a68-ba7c-887c0a937b4b None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:00.517845 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3d14ab-5da0-4a7e-a330-d5c5df91ef76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:00.518841 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3d14ab-5da0-4a7e-a330-d5c5df91ef76 None admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:00.519122 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3d14ab-5da0-4a7e-a330-d5c5df91ef76 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:00.519434 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3d14ab-5da0-4a7e-a330-d5c5df91ef76 None admin] PATH_INFO: `/v3/projects/74cb8c05a64040c48e6687c9bd9865d1/users/ede4f4cab761430893de0011491bbf7f/roles/5e81c9ea0319460391e21a2a77dd537a` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:00.519616 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:00.521474 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3d14ab-5da0-4a7e-a330-d5c5df91ef76 None admin] RBAC: Authorizing `identity:create_grant(project_id=74cb8c05a64040c48e6687c9bd9865d1, user_id=ede4f4cab761430893de0011491bbf7f, role_id=5e81c9ea0319460391e21a2a77dd537a)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:00.523016 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3d14ab-5da0-4a7e-a330-d5c5df91ef76 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:00.560352 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 85/168] 10.222.0.17 () {58 vars in 1439 bytes} [Sat Jul 23 20:57:00 2022] PUT /identity/v3/projects/74cb8c05a64040c48e6687c9bd9865d1/users/ede4f4cab761430893de0011491bbf7f/roles/5e81c9ea0319460391e21a2a77dd537a => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 20:57:00.561322 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3d14ab-5da0-4a7e-a330-d5c5df91ef76 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:00.596221 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eda8332-126c-4a68-ba7c-887c0a937b4b None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:00.637013 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4627f0dd-9106-43c8-96b3-795c5093fe0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:00.637781 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4627f0dd-9106-43c8-96b3-795c5093fe0e None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:00.638108 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4627f0dd-9106-43c8-96b3-795c5093fe0e None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:00.638438 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4627f0dd-9106-43c8-96b3-795c5093fe0e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:00.639317 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4627f0dd-9106-43c8-96b3-795c5093fe0e None admin] RBAC: Adding query filter params (role.id=14824669685048b38361b1676f7f0f9f, scope.project.id=c1cfbbe0d85c4ac9b70b594f37b2646c, user.id=35d61800281b469cb2d8e0546f4eacbd) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:57:00.639679 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4627f0dd-9106-43c8-96b3-795c5093fe0e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:00.641253 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4627f0dd-9106-43c8-96b3-795c5093fe0e None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:00.644939 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:00.649220 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 84/169] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Jul 23 20:57:00 2022] GET /identity/v3/role_assignments?user.id=35d61800281b469cb2d8e0546f4eacbd&scope.project.id=c1cfbbe0d85c4ac9b70b594f37b2646c&role.id=14824669685048b38361b1676f7f0f9f => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:57:00.650180 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4627f0dd-9106-43c8-96b3-795c5093fe0e None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:00.771965 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:00.775342 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4627f0dd-9106-43c8-96b3-795c5093fe0e None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:00.784998 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3d14ab-5da0-4a7e-a330-d5c5df91ef76 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:00.820344 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88655168-e679-4e41-8cf9-65ee176b578f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:00.820344 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88655168-e679-4e41-8cf9-65ee176b578f None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:00.820344 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88655168-e679-4e41-8cf9-65ee176b578f None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:00.820344 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88655168-e679-4e41-8cf9-65ee176b578f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:00.853909 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88655168-e679-4e41-8cf9-65ee176b578f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:57:00.861912 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-88655168-e679-4e41-8cf9-65ee176b578f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 23 20:57:00.861912 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:57:00.861912 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:57:00.861912 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:57:00.861912 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:57:00.861912 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:57:00.861912 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:57:00.861912 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:57:00.861912 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:57:00.861912 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:57:00.861912 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:57:00.861912 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:57:00.861912 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:57:00.861912 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:57:00.861912 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:57:00.861912 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:57:00.862950 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:57:00.862950 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:57:00.862950 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:57:00.862950 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:57:00.862950 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:57:00.862950 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:57:00.862950 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:57:00.862950 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:57:00.862950 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:57:00.862950 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:57:00.862950 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:57:00.862950 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application with Lock( Jul 23 20:57:00.862950 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:57:00.862950 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:57:00.862950 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:57:00.862950 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:57:00.863829 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:57:00.863829 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:57:00.863829 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:57:00.863829 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:57:00.863829 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:57:00.863829 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:57:00.863829 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:57:00.863829 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:57:00.863829 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:57:00.863829 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:57:00.863829 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 23 20:57:00.863829 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 20:57:00.872092 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bba878-9529-4ec4-a8a2-f6daed7911ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:00.872797 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bba878-9529-4ec4-a8a2-f6daed7911ef None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:00.873077 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bba878-9529-4ec4-a8a2-f6daed7911ef None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:00.873351 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bba878-9529-4ec4-a8a2-f6daed7911ef None admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:00.874173 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bba878-9529-4ec4-a8a2-f6daed7911ef None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:57:00.874582 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bba878-9529-4ec4-a8a2-f6daed7911ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:00.876095 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bba878-9529-4ec4-a8a2-f6daed7911ef None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:00.878953 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 85/170] 10.222.0.17 () {56 vars in 1096 bytes} [Sat Jul 23 20:57:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:57:00.885547 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88655168-e679-4e41-8cf9-65ee176b578f None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:00.898023 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 86/171] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Jul 23 20:57:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:57:00.908138 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bba878-9529-4ec4-a8a2-f6daed7911ef None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:01.055997 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88655168-e679-4e41-8cf9-65ee176b578f None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:01.103691 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bba878-9529-4ec4-a8a2-f6daed7911ef None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:01.105509 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:01.108454 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7125f0-e020-4101-82a8-3d2520738bfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:01.109418 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7125f0-e020-4101-82a8-3d2520738bfd None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:01.109893 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7125f0-e020-4101-82a8-3d2520738bfd None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:01.110341 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7125f0-e020-4101-82a8-3d2520738bfd None admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:01.111279 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7125f0-e020-4101-82a8-3d2520738bfd None admin] RBAC: Adding query filter params (name=admin) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:57:01.111779 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7125f0-e020-4101-82a8-3d2520738bfd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:01.114070 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7125f0-e020-4101-82a8-3d2520738bfd None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:01.126520 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 86/172] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Jul 23 20:57:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:57:01.134249 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7125f0-e020-4101-82a8-3d2520738bfd None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:01.154847 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb5e146-b29b-4f97-b0c2-78951b214891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:01.156236 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb5e146-b29b-4f97-b0c2-78951b214891 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:01.156746 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb5e146-b29b-4f97-b0c2-78951b214891 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:01.157209 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb5e146-b29b-4f97-b0c2-78951b214891 None admin] PATH_INFO: `/v3/users/35d61800281b469cb2d8e0546f4eacbd` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:01.158850 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb5e146-b29b-4f97-b0c2-78951b214891 None admin] RBAC: Authorizing `identity:get_user(user_id=35d61800281b469cb2d8e0546f4eacbd)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:01.160654 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb5e146-b29b-4f97-b0c2-78951b214891 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:01.163129 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 87/173] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Jul 23 20:57:00 2022] GET /identity/v3/users/35d61800281b469cb2d8e0546f4eacbd => generated 275 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:57:01.170573 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb5e146-b29b-4f97-b0c2-78951b214891 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:01.198264 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:01.361678 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7125f0-e020-4101-82a8-3d2520738bfd None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:01.378443 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb5e146-b29b-4f97-b0c2-78951b214891 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:01.415481 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33461cf7-2a92-4119-a3db-e02882f888a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:01.416529 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33461cf7-2a92-4119-a3db-e02882f888a5 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:01.417004 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33461cf7-2a92-4119-a3db-e02882f888a5 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:01.417468 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33461cf7-2a92-4119-a3db-e02882f888a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:01.422681 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7c08e1-b786-435c-9109-692859b58daa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:01.423617 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7c08e1-b786-435c-9109-692859b58daa None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:01.423905 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7c08e1-b786-435c-9109-692859b58daa None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:01.424182 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7c08e1-b786-435c-9109-692859b58daa None admin] PATH_INFO: `/v3/users/ef460ef8c739443881697a7ad53288a2` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:01.427701 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7c08e1-b786-435c-9109-692859b58daa None admin] RBAC: Authorizing `identity:get_user(user_id=ef460ef8c739443881697a7ad53288a2)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:01.427701 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7c08e1-b786-435c-9109-692859b58daa None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:01.429562 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 87/174] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Jul 23 20:57:01 2022] GET /identity/v3/users/ef460ef8c739443881697a7ad53288a2 => generated 247 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 20:57:01.436087 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7c08e1-b786-435c-9109-692859b58daa None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:01.464392 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:01.494509 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33461cf7-2a92-4119-a3db-e02882f888a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:01.496128 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33461cf7-2a92-4119-a3db-e02882f888a5 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:01.610228 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:01.630174 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7c08e1-b786-435c-9109-692859b58daa None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:01.650897 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 88/175] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Jul 23 20:57:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 23 20:57:01.659041 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33461cf7-2a92-4119-a3db-e02882f888a5 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:01.724121 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7da9be-fa69-46df-9c8f-2faf96d1c657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:01.726206 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7da9be-fa69-46df-9c8f-2faf96d1c657 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:01.726507 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7da9be-fa69-46df-9c8f-2faf96d1c657 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:01.726785 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7da9be-fa69-46df-9c8f-2faf96d1c657 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:01.827268 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7da9be-fa69-46df-9c8f-2faf96d1c657 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:01.829138 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7da9be-fa69-46df-9c8f-2faf96d1c657 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:01.845545 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:01.917195 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33461cf7-2a92-4119-a3db-e02882f888a5 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:01.934262 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:01.940390 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 88/176] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Jul 23 20:57:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 505 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 23 20:57:01.946265 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7da9be-fa69-46df-9c8f-2faf96d1c657 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:01.980329 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc51fe33-cf8a-4fc8-92c9-65e9c8c47356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:01.981225 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc51fe33-cf8a-4fc8-92c9-65e9c8c47356 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:01.981501 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc51fe33-cf8a-4fc8-92c9-65e9c8c47356 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:01.981768 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc51fe33-cf8a-4fc8-92c9-65e9c8c47356 None admin] PATH_INFO: `/v3/projects/74cb8c05a64040c48e6687c9bd9865d1` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:01.983034 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc51fe33-cf8a-4fc8-92c9-65e9c8c47356 None admin] RBAC: Authorizing `identity:get_project(project_id=74cb8c05a64040c48e6687c9bd9865d1)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:01.984512 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc51fe33-cf8a-4fc8-92c9-65e9c8c47356 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:01.994444 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 89/177] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Jul 23 20:57:01 2022] GET /identity/v3/projects/74cb8c05a64040c48e6687c9bd9865d1 => generated 298 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:57:02.000659 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc51fe33-cf8a-4fc8-92c9-65e9c8c47356 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:02.050001 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7da9be-fa69-46df-9c8f-2faf96d1c657 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:02.087104 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ba5199-2852-4525-910e-6cd00fa60358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:02.088007 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ba5199-2852-4525-910e-6cd00fa60358 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:02.088294 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ba5199-2852-4525-910e-6cd00fa60358 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:02.089041 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ba5199-2852-4525-910e-6cd00fa60358 None admin] PATH_INFO: `/v3/projects/74cb8c05a64040c48e6687c9bd9865d1` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:02.091789 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ba5199-2852-4525-910e-6cd00fa60358 None admin] RBAC: Authorizing `identity:get_project(project_id=74cb8c05a64040c48e6687c9bd9865d1)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:02.093276 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ba5199-2852-4525-910e-6cd00fa60358 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:02.095088 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 89/178] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Jul 23 20:57:01 2022] GET /identity/v3/projects/74cb8c05a64040c48e6687c9bd9865d1 => generated 298 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 20:57:02.120115 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ba5199-2852-4525-910e-6cd00fa60358 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:02.190800 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc51fe33-cf8a-4fc8-92c9-65e9c8c47356 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:02.242229 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:02.272802 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5e297e-c19a-449b-8f40-49186b560b22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:02.273492 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5e297e-c19a-449b-8f40-49186b560b22 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:02.273774 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5e297e-c19a-449b-8f40-49186b560b22 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:02.274071 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5e297e-c19a-449b-8f40-49186b560b22 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:02.274926 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5e297e-c19a-449b-8f40-49186b560b22 None admin] RBAC: Adding query filter params (role.id=c5f46541d35e44b691baa7a1fa304c0f, scope.project.id=74cb8c05a64040c48e6687c9bd9865d1, user.id=35d61800281b469cb2d8e0546f4eacbd) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:57:02.275235 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5e297e-c19a-449b-8f40-49186b560b22 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:02.279518 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5e297e-c19a-449b-8f40-49186b560b22 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:02.293944 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 90/179] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Jul 23 20:57:01 2022] GET /identity/v3/role_assignments?user.id=35d61800281b469cb2d8e0546f4eacbd&scope.project.id=74cb8c05a64040c48e6687c9bd9865d1&role.id=c5f46541d35e44b691baa7a1fa304c0f => generated 608 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 20:57:02.328280 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ba5199-2852-4525-910e-6cd00fa60358 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:02.404747 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96873f75-4078-4f50-a856-406b04624450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:02.405552 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96873f75-4078-4f50-a856-406b04624450 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:02.405714 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96873f75-4078-4f50-a856-406b04624450 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:02.406005 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96873f75-4078-4f50-a856-406b04624450 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:02.406857 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96873f75-4078-4f50-a856-406b04624450 None admin] RBAC: Adding query filter params (role.id=fec17bfdc65349a2b9c06a89131191df, scope.project.id=74cb8c05a64040c48e6687c9bd9865d1, user.id=ef460ef8c739443881697a7ad53288a2) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:57:02.407167 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96873f75-4078-4f50-a856-406b04624450 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:02.408664 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96873f75-4078-4f50-a856-406b04624450 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:02.419286 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 90/180] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Jul 23 20:57:02 2022] GET /identity/v3/role_assignments?user.id=ef460ef8c739443881697a7ad53288a2&scope.project.id=74cb8c05a64040c48e6687c9bd9865d1&role.id=fec17bfdc65349a2b9c06a89131191df => generated 608 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 20:57:02.617022 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc34f496-75c3-43c5-b284-afa38e09e3ae None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:02.617405 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc34f496-75c3-43c5-b284-afa38e09e3ae None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:02.617595 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc34f496-75c3-43c5-b284-afa38e09e3ae None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:02.619296 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 91/181] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:57:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:57:02.624712 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabd2858-43b2-4b1a-b174-cfec2464d4c1 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:02.625035 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabd2858-43b2-4b1a-b174-cfec2464d4c1 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:02.625278 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabd2858-43b2-4b1a-b174-cfec2464d4c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:02.654139 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-eabd2858-43b2-4b1a-b174-cfec2464d4c1 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:57:02.655384 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-eabd2858-43b2-4b1a-b174-cfec2464d4c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:57:02.754720 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 91/182] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:57:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 23 20:57:02.782084 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc34f496-75c3-43c5-b284-afa38e09e3ae None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:02.785523 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:02.912048 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc34f496-75c3-43c5-b284-afa38e09e3ae None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:02.955190 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99fd02f-6473-492e-8ea8-fa6935ffd0cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:02.956006 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99fd02f-6473-492e-8ea8-fa6935ffd0cb None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:02.956282 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99fd02f-6473-492e-8ea8-fa6935ffd0cb None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:02.956551 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99fd02f-6473-492e-8ea8-fa6935ffd0cb None admin] PATH_INFO: `/v3/domains/default` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:02.957852 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99fd02f-6473-492e-8ea8-fa6935ffd0cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:02.959374 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99fd02f-6473-492e-8ea8-fa6935ffd0cb None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:02.961183 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 92/183] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 23 20:57:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:57:02.967145 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabd2858-43b2-4b1a-b174-cfec2464d4c1 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:02.986112 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9acd4a-920c-43ed-8fa2-73b7ede26cc8 None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:02.986481 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9acd4a-920c-43ed-8fa2-73b7ede26cc8 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:02.986758 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9acd4a-920c-43ed-8fa2-73b7ede26cc8 None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:02.988332 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 93/184] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:57:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 23 20:57:02.995180 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81ba3f7-fafe-4634-939f-2aad2f285b60 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:02.995448 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81ba3f7-fafe-4634-939f-2aad2f285b60 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:02.995744 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81ba3f7-fafe-4634-939f-2aad2f285b60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:03.015348 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-f81ba3f7-fafe-4634-939f-2aad2f285b60 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:57:03.016558 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-f81ba3f7-fafe-4634-939f-2aad2f285b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:57:03.053695 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:03.114253 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:03.122059 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 94/185] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:57:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 23 20:57:03.129256 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabd2858-43b2-4b1a-b174-cfec2464d4c1 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:03.148010 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81ba3f7-fafe-4634-939f-2aad2f285b60 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:03.174072 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd62cca-996c-4741-970a-9f753b061760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:03.175390 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd62cca-996c-4741-970a-9f753b061760 None admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:03.175770 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd62cca-996c-4741-970a-9f753b061760 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:03.176142 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd62cca-996c-4741-970a-9f753b061760 None admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:03.176746 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd62cca-996c-4741-970a-9f753b061760 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:03.178232 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd62cca-996c-4741-970a-9f753b061760 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:03.200872 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 92/186] 10.222.0.17 () {60 vars in 1132 bytes} [Sat Jul 23 20:57:02 2022] POST /identity/v3/users => generated 297 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 20:57:03.202647 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf957178-d123-4146-9790-58e1a63f1774 None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:03.203129 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf957178-d123-4146-9790-58e1a63f1774 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:03.203595 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf957178-d123-4146-9790-58e1a63f1774 None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:03.205139 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 93/187] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:57:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:57:03.211542 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fdb740-b922-4218-a645-3aa337ceea97 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:03.212134 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fdb740-b922-4218-a645-3aa337ceea97 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:03.212608 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fdb740-b922-4218-a645-3aa337ceea97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:03.235007 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-43fdb740-b922-4218-a645-3aa337ceea97 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:57:03.236928 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-43fdb740-b922-4218-a645-3aa337ceea97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:57:03.291777 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81ba3f7-fafe-4634-939f-2aad2f285b60 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:03.333656 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 94/188] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:57:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 23 20:57:03.349022 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f7dafa-80ed-4bb2-81ab-0a0cb8751c72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:03.349900 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f7dafa-80ed-4bb2-81ab-0a0cb8751c72 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:03.350190 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f7dafa-80ed-4bb2-81ab-0a0cb8751c72 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:03.350470 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f7dafa-80ed-4bb2-81ab-0a0cb8751c72 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:03.358751 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fdb740-b922-4218-a645-3aa337ceea97 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:03.372475 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f7dafa-80ed-4bb2-81ab-0a0cb8751c72 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:57:03.384877 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-b8f7dafa-80ed-4bb2-81ab-0a0cb8751c72 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 23 20:57:03.384877 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:57:03.384877 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:57:03.384877 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:57:03.384877 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:57:03.384877 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:57:03.384877 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:57:03.384877 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:57:03.384877 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:57:03.384877 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:57:03.384877 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:57:03.384877 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:57:03.384877 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:57:03.384877 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:57:03.384877 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:57:03.384877 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:57:03.385884 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:57:03.385884 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:57:03.385884 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:57:03.385884 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:57:03.385884 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:57:03.385884 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:57:03.385884 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:57:03.385884 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:57:03.385884 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:57:03.385884 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:57:03.385884 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:57:03.385884 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application with Lock( Jul 23 20:57:03.385884 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:57:03.385884 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:57:03.385884 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:57:03.385884 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:57:03.388773 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:57:03.388773 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:57:03.388773 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:57:03.388773 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:57:03.388773 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:57:03.388773 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:57:03.388773 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:57:03.388773 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:57:03.388773 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:57:03.388773 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:57:03.388773 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 23 20:57:03.388773 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:57:03.388773 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 95/189] 10.222.0.17 () {56 vars in 1114 bytes} [Sat Jul 23 20:57:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 23 20:57:03.394648 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f7dafa-80ed-4bb2-81ab-0a0cb8751c72 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:03.418254 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:03.491854 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:03.496436 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fdb740-b922-4218-a645-3aa337ceea97 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:03.547772 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70609a50-5466-4251-be5b-fcf38ea64262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:03.548598 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70609a50-5466-4251-be5b-fcf38ea64262 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:03.548874 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70609a50-5466-4251-be5b-fcf38ea64262 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:03.549143 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70609a50-5466-4251-be5b-fcf38ea64262 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:03.552340 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f7dafa-80ed-4bb2-81ab-0a0cb8751c72 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:03.563377 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70609a50-5466-4251-be5b-fcf38ea64262 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:57:03.572293 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-70609a50-5466-4251-be5b-fcf38ea64262 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 23 20:57:03.572293 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:57:03.572293 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:57:03.572293 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:57:03.572293 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:57:03.572293 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:57:03.572293 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:57:03.572293 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:57:03.572293 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:57:03.572293 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:57:03.572293 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:57:03.572293 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:57:03.572293 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:57:03.572293 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:57:03.572293 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:57:03.572293 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:57:03.573212 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:57:03.573212 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:57:03.573212 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:57:03.573212 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:57:03.573212 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:57:03.573212 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:57:03.573212 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:57:03.573212 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:57:03.573212 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:57:03.573212 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:57:03.573212 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:57:03.573212 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application with Lock( Jul 23 20:57:03.573212 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:57:03.573212 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:57:03.573212 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:57:03.573212 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:57:03.574032 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:57:03.574032 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:57:03.574032 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:57:03.574032 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:57:03.574032 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:57:03.574032 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:57:03.574032 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:57:03.574032 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:57:03.574032 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:57:03.574032 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:57:03.574032 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 23 20:57:03.574032 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 20:57:03.576543 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 95/190] 10.222.0.17 () {56 vars in 1096 bytes} [Sat Jul 23 20:57:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 23 20:57:03.583272 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70609a50-5466-4251-be5b-fcf38ea64262 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:03.612046 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb638e8b-addd-4e3a-80c2-2707566e5dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:03.613493 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb638e8b-addd-4e3a-80c2-2707566e5dd6 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:03.614023 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb638e8b-addd-4e3a-80c2-2707566e5dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:03.614763 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb638e8b-addd-4e3a-80c2-2707566e5dd6 None admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:03.616192 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb638e8b-addd-4e3a-80c2-2707566e5dd6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:57:03.616960 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb638e8b-addd-4e3a-80c2-2707566e5dd6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:03.618912 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb638e8b-addd-4e3a-80c2-2707566e5dd6 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:03.631456 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 96/191] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Jul 23 20:57:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 20:57:03.637490 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb638e8b-addd-4e3a-80c2-2707566e5dd6 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:03.725239 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:03.730168 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70609a50-5466-4251-be5b-fcf38ea64262 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:03.766497 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753d2840-3944-4009-bc58-bbf967c937ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:03.767566 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753d2840-3944-4009-bc58-bbf967c937ce None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:03.768044 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753d2840-3944-4009-bc58-bbf967c937ce None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:03.768512 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753d2840-3944-4009-bc58-bbf967c937ce None admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:03.769539 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753d2840-3944-4009-bc58-bbf967c937ce None admin] RBAC: Adding query filter params (name=admin) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:57:03.770096 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753d2840-3944-4009-bc58-bbf967c937ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:03.771685 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753d2840-3944-4009-bc58-bbf967c937ce None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:03.782357 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 96/192] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Jul 23 20:57:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 20:57:03.788505 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753d2840-3944-4009-bc58-bbf967c937ce None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:03.864099 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb638e8b-addd-4e3a-80c2-2707566e5dd6 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:03.920970 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753d2840-3944-4009-bc58-bbf967c937ce None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:03.938884 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:03.959327 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f45fcb-163b-4c2a-8afe-196b3ddd5d42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:03.960626 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f45fcb-163b-4c2a-8afe-196b3ddd5d42 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:03.961170 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f45fcb-163b-4c2a-8afe-196b3ddd5d42 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:03.961669 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f45fcb-163b-4c2a-8afe-196b3ddd5d42 None admin] PATH_INFO: `/v3/users/c0ebfcb519154de5acc86824b2b13261` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:03.977391 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f45fcb-163b-4c2a-8afe-196b3ddd5d42 None admin] RBAC: Authorizing `identity:get_user(user_id=c0ebfcb519154de5acc86824b2b13261)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:03.979282 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f45fcb-163b-4c2a-8afe-196b3ddd5d42 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:03.981206 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 97/193] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Jul 23 20:57:03 2022] GET /identity/v3/users/c0ebfcb519154de5acc86824b2b13261 => generated 283 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 20:57:03.989959 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09526b8d-ab80-4454-9f59-5fdf653c03a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:03.989959 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09526b8d-ab80-4454-9f59-5fdf653c03a0 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:03.989959 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09526b8d-ab80-4454-9f59-5fdf653c03a0 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:03.989959 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09526b8d-ab80-4454-9f59-5fdf653c03a0 None admin] PATH_INFO: `/v3/users/c0ebfcb519154de5acc86824b2b13261` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:03.990404 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09526b8d-ab80-4454-9f59-5fdf653c03a0 None admin] RBAC: Authorizing `identity:get_user(user_id=c0ebfcb519154de5acc86824b2b13261)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:03.990905 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09526b8d-ab80-4454-9f59-5fdf653c03a0 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:03.993156 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 97/194] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Jul 23 20:57:03 2022] GET /identity/v3/users/c0ebfcb519154de5acc86824b2b13261 => generated 283 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 20:57:03.995021 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f45fcb-163b-4c2a-8afe-196b3ddd5d42 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:03.998395 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09526b8d-ab80-4454-9f59-5fdf653c03a0 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:04.034563 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:04.102691 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f45fcb-163b-4c2a-8afe-196b3ddd5d42 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:04.114276 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09526b8d-ab80-4454-9f59-5fdf653c03a0 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:04.138854 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2b79b0-508b-4b7f-8998-3f99fb6ac78d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:04.139584 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2b79b0-508b-4b7f-8998-3f99fb6ac78d None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:04.139894 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2b79b0-508b-4b7f-8998-3f99fb6ac78d None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:04.140136 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2b79b0-508b-4b7f-8998-3f99fb6ac78d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:04.150165 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb263794-f817-4fb0-8c61-7b1d0bdad97b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:04.151140 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb263794-f817-4fb0-8c61-7b1d0bdad97b None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:04.151613 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb263794-f817-4fb0-8c61-7b1d0bdad97b None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:04.152077 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb263794-f817-4fb0-8c61-7b1d0bdad97b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:04.212648 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:04.221888 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2b79b0-508b-4b7f-8998-3f99fb6ac78d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:04.223542 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2b79b0-508b-4b7f-8998-3f99fb6ac78d None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:04.224286 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb263794-f817-4fb0-8c61-7b1d0bdad97b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:04.226013 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb263794-f817-4fb0-8c61-7b1d0bdad97b None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:04.250680 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:04.339803 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 98/195] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Jul 23 20:57:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 23 20:57:04.341974 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a17248-a43b-4784-af91-66240de2f0db None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:04.342459 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a17248-a43b-4784-af91-66240de2f0db None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:04.342926 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a17248-a43b-4784-af91-66240de2f0db None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:04.348736 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 99/196] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:57:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:57:04.350376 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd30b3f5-836d-4110-aa1a-a3251b435d02 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:04.350880 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd30b3f5-836d-4110-aa1a-a3251b435d02 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:04.351346 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd30b3f5-836d-4110-aa1a-a3251b435d02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:04.369510 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-fd30b3f5-836d-4110-aa1a-a3251b435d02 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:57:04.371077 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-fd30b3f5-836d-4110-aa1a-a3251b435d02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:57:04.373937 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 98/197] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Jul 23 20:57:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 23 20:57:04.375883 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2b79b0-508b-4b7f-8998-3f99fb6ac78d None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:04.457886 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 100/198] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:57:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 23 20:57:04.457886 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd30b3f5-836d-4110-aa1a-a3251b435d02 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:04.479807 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:04.515970 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2b79b0-508b-4b7f-8998-3f99fb6ac78d None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:04.535186 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:04.565441 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9808ba5a-189f-404b-a99c-925723b86eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:04.566628 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9808ba5a-189f-404b-a99c-925723b86eb5 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:04.566898 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9808ba5a-189f-404b-a99c-925723b86eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:04.567166 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9808ba5a-189f-404b-a99c-925723b86eb5 None admin] PATH_INFO: `/v3/projects/84094ca55a574d84ba5fe544c9d90f50` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:04.568713 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9808ba5a-189f-404b-a99c-925723b86eb5 None admin] RBAC: Authorizing `identity:get_project(project_id=84094ca55a574d84ba5fe544c9d90f50)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:04.570235 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9808ba5a-189f-404b-a99c-925723b86eb5 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:04.571952 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 99/199] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Jul 23 20:57:04 2022] GET /identity/v3/projects/84094ca55a574d84ba5fe544c9d90f50 => generated 302 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:57:04.576951 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9808ba5a-189f-404b-a99c-925723b86eb5 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:04.586635 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd30b3f5-836d-4110-aa1a-a3251b435d02 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:04.630458 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763dd4bd-51f7-44ea-9327-35bc444f0785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:04.631287 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763dd4bd-51f7-44ea-9327-35bc444f0785 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:04.631561 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763dd4bd-51f7-44ea-9327-35bc444f0785 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:04.631830 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763dd4bd-51f7-44ea-9327-35bc444f0785 None admin] PATH_INFO: `/v3/projects/84094ca55a574d84ba5fe544c9d90f50` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:04.633107 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763dd4bd-51f7-44ea-9327-35bc444f0785 None admin] RBAC: Authorizing `identity:get_project(project_id=84094ca55a574d84ba5fe544c9d90f50)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:04.635277 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763dd4bd-51f7-44ea-9327-35bc444f0785 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:04.637165 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 101/200] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Jul 23 20:57:04 2022] GET /identity/v3/projects/84094ca55a574d84ba5fe544c9d90f50 => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:57:04.638333 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763dd4bd-51f7-44ea-9327-35bc444f0785 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:04.693919 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9808ba5a-189f-404b-a99c-925723b86eb5 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:04.740426 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c94aff-1727-4934-9c87-fb77053a6af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:04.741495 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c94aff-1727-4934-9c87-fb77053a6af2 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:04.741776 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c94aff-1727-4934-9c87-fb77053a6af2 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:04.742071 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c94aff-1727-4934-9c87-fb77053a6af2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:04.757374 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c94aff-1727-4934-9c87-fb77053a6af2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:57:04.765422 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:04.769184 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-61c94aff-1727-4934-9c87-fb77053a6af2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 23 20:57:04.769184 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:57:04.769184 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:57:04.769184 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:57:04.769184 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:57:04.769184 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:57:04.769184 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:57:04.769184 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:57:04.769184 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:57:04.769184 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:57:04.769184 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:57:04.769184 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:57:04.769184 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:57:04.769184 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:57:04.769184 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:57:04.769184 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:57:04.770240 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:57:04.770240 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:57:04.770240 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:57:04.770240 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:57:04.770240 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:57:04.770240 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:57:04.770240 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:57:04.770240 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:57:04.770240 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:57:04.770240 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:57:04.770240 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:57:04.770240 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application with Lock( Jul 23 20:57:04.770240 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:57:04.770240 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:57:04.770240 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:57:04.770240 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:57:04.771496 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:57:04.771496 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:57:04.771496 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:57:04.771496 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:57:04.771496 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:57:04.771496 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:57:04.771496 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:57:04.771496 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:57:04.771496 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:57:04.771496 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:57:04.771496 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 23 20:57:04.771496 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 20:57:04.771496 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 100/201] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Jul 23 20:57:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:57:04.772351 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c94aff-1727-4934-9c87-fb77053a6af2 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:04.791306 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763dd4bd-51f7-44ea-9327-35bc444f0785 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:04.842240 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:04.851970 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdf6682-9e7d-4cca-93e3-5b33b4321b3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:04.853115 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdf6682-9e7d-4cca-93e3-5b33b4321b3d None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:04.853564 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdf6682-9e7d-4cca-93e3-5b33b4321b3d None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:04.854002 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdf6682-9e7d-4cca-93e3-5b33b4321b3d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:04.855260 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdf6682-9e7d-4cca-93e3-5b33b4321b3d None admin] RBAC: Adding query filter params (role.id=c5f46541d35e44b691baa7a1fa304c0f, scope.project.id=84094ca55a574d84ba5fe544c9d90f50, user.id=c0ebfcb519154de5acc86824b2b13261) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:57:04.856124 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdf6682-9e7d-4cca-93e3-5b33b4321b3d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:04.858276 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdf6682-9e7d-4cca-93e3-5b33b4321b3d None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:04.866106 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 102/202] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Jul 23 20:57:04 2022] GET /identity/v3/role_assignments?user.id=c0ebfcb519154de5acc86824b2b13261&scope.project.id=84094ca55a574d84ba5fe544c9d90f50&role.id=c5f46541d35e44b691baa7a1fa304c0f => generated 259 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:57:04.867384 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdf6682-9e7d-4cca-93e3-5b33b4321b3d None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:04.911882 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c94aff-1727-4934-9c87-fb77053a6af2 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:04.958047 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1256ee17-868f-4aec-bdc7-ec65eff20abb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:04.959001 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1256ee17-868f-4aec-bdc7-ec65eff20abb None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:04.959426 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1256ee17-868f-4aec-bdc7-ec65eff20abb None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:04.959840 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1256ee17-868f-4aec-bdc7-ec65eff20abb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:04.960953 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1256ee17-868f-4aec-bdc7-ec65eff20abb None admin] RBAC: Adding query filter params (role.id=fec17bfdc65349a2b9c06a89131191df, scope.project.id=84094ca55a574d84ba5fe544c9d90f50, user.id=c0ebfcb519154de5acc86824b2b13261) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:57:04.961408 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1256ee17-868f-4aec-bdc7-ec65eff20abb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:04.963116 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1256ee17-868f-4aec-bdc7-ec65eff20abb None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:04.976805 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 101/203] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Jul 23 20:57:04 2022] GET /identity/v3/role_assignments?user.id=c0ebfcb519154de5acc86824b2b13261&scope.project.id=84094ca55a574d84ba5fe544c9d90f50&role.id=fec17bfdc65349a2b9c06a89131191df => generated 259 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:57:04.985768 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdf6682-9e7d-4cca-93e3-5b33b4321b3d None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:05.033362 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597d54f6-2424-4f3e-befb-32acf2ac0b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:05.034295 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597d54f6-2424-4f3e-befb-32acf2ac0b75 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:05.034677 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597d54f6-2424-4f3e-befb-32acf2ac0b75 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:05.035132 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597d54f6-2424-4f3e-befb-32acf2ac0b75 None admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:05.036034 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597d54f6-2424-4f3e-befb-32acf2ac0b75 None admin] RBAC: Adding query filter params (name=reader) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:57:05.036440 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597d54f6-2424-4f3e-befb-32acf2ac0b75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:05.038159 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597d54f6-2424-4f3e-befb-32acf2ac0b75 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:05.048449 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 103/204] 10.222.0.17 () {56 vars in 1101 bytes} [Sat Jul 23 20:57:04 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:57:05.054316 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1256ee17-868f-4aec-bdc7-ec65eff20abb None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:05.173878 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1256ee17-868f-4aec-bdc7-ec65eff20abb None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:05.196319 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:05.253729 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838aea27-0873-42a1-beb0-ae60c65e7bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:05.255342 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838aea27-0873-42a1-beb0-ae60c65e7bfa None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:05.255830 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838aea27-0873-42a1-beb0-ae60c65e7bfa None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:05.256333 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838aea27-0873-42a1-beb0-ae60c65e7bfa None admin] PATH_INFO: `/v3/users/ede4f4cab761430893de0011491bbf7f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:05.258593 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838aea27-0873-42a1-beb0-ae60c65e7bfa None admin] RBAC: Authorizing `identity:get_user(user_id=ede4f4cab761430893de0011491bbf7f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:05.261394 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838aea27-0873-42a1-beb0-ae60c65e7bfa None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:05.264554 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 102/205] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Jul 23 20:57:05 2022] GET /identity/v3/users/ede4f4cab761430893de0011491bbf7f => generated 289 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:57:05.270584 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597d54f6-2424-4f3e-befb-32acf2ac0b75 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:05.305596 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:05.429139 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597d54f6-2424-4f3e-befb-32acf2ac0b75 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:05.464697 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afed3b7-a0b2-4000-a6fa-90e77f2ebb5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:05.465358 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afed3b7-a0b2-4000-a6fa-90e77f2ebb5f None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:05.465634 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afed3b7-a0b2-4000-a6fa-90e77f2ebb5f None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:05.465929 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afed3b7-a0b2-4000-a6fa-90e77f2ebb5f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:05.541152 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afed3b7-a0b2-4000-a6fa-90e77f2ebb5f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:05.542673 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afed3b7-a0b2-4000-a6fa-90e77f2ebb5f None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:05.565138 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:05.677943 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 104/206] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Jul 23 20:57:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 23 20:57:05.688031 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838aea27-0873-42a1-beb0-ae60c65e7bfa None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:05.956754 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838aea27-0873-42a1-beb0-ae60c65e7bfa None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:06.036506 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fe7820-98a9-4312-a4c8-cf48d3b82d71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:06.038124 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fe7820-98a9-4312-a4c8-cf48d3b82d71 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:06.038625 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fe7820-98a9-4312-a4c8-cf48d3b82d71 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:06.039114 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fe7820-98a9-4312-a4c8-cf48d3b82d71 None admin] PATH_INFO: `/v3/projects/74cb8c05a64040c48e6687c9bd9865d1` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:06.041258 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fe7820-98a9-4312-a4c8-cf48d3b82d71 None admin] RBAC: Authorizing `identity:get_project(project_id=74cb8c05a64040c48e6687c9bd9865d1)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:06.044054 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fe7820-98a9-4312-a4c8-cf48d3b82d71 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:06.053148 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 103/207] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Jul 23 20:57:05 2022] GET /identity/v3/projects/74cb8c05a64040c48e6687c9bd9865d1 => generated 298 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:57:06.053732 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afed3b7-a0b2-4000-a6fa-90e77f2ebb5f None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:06.202033 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afed3b7-a0b2-4000-a6fa-90e77f2ebb5f None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:06.226542 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:06.247095 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de63d3e-36db-4cc7-86e9-51c5aff9a711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:06.247763 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de63d3e-36db-4cc7-86e9-51c5aff9a711 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:06.248040 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de63d3e-36db-4cc7-86e9-51c5aff9a711 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:06.248313 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de63d3e-36db-4cc7-86e9-51c5aff9a711 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:06.249156 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de63d3e-36db-4cc7-86e9-51c5aff9a711 None admin] RBAC: Adding query filter params (role.id=5e81c9ea0319460391e21a2a77dd537a, scope.project.id=74cb8c05a64040c48e6687c9bd9865d1, user.id=ede4f4cab761430893de0011491bbf7f) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:57:06.249459 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de63d3e-36db-4cc7-86e9-51c5aff9a711 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:06.250974 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de63d3e-36db-4cc7-86e9-51c5aff9a711 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:06.257893 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 105/208] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Jul 23 20:57:06 2022] GET /identity/v3/role_assignments?user.id=ede4f4cab761430893de0011491bbf7f&scope.project.id=74cb8c05a64040c48e6687c9bd9865d1&role.id=5e81c9ea0319460391e21a2a77dd537a => generated 608 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:57:06.327453 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bb1b74-d350-4853-86b1-cf56866636ec None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:06.328135 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bb1b74-d350-4853-86b1-cf56866636ec None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:06.328652 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bb1b74-d350-4853-86b1-cf56866636ec None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:06.330818 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 104/209] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:57:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:57:06.337740 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a65d8c-9611-429c-9a94-10f79520d41f None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:06.338455 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a65d8c-9611-429c-9a94-10f79520d41f None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:06.338933 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a65d8c-9611-429c-9a94-10f79520d41f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:06.365496 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-42a65d8c-9611-429c-9a94-10f79520d41f None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:57:06.367198 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-42a65d8c-9611-429c-9a94-10f79520d41f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:57:06.455302 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 106/210] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:57:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 23 20:57:06.494760 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bb1b74-d350-4853-86b1-cf56866636ec None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:06.507519 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8159ce-2246-4936-a2af-125ccbaf18bd None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:06.508518 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8159ce-2246-4936-a2af-125ccbaf18bd None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:06.509017 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8159ce-2246-4936-a2af-125ccbaf18bd None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:06.513489 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 107/211] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:57:06 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:57:06.522800 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1956a9b1-1f6f-40a3-a87a-7ec6e9bbefb5 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:06.523419 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1956a9b1-1f6f-40a3-a87a-7ec6e9bbefb5 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:06.523917 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1956a9b1-1f6f-40a3-a87a-7ec6e9bbefb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:06.547219 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-1956a9b1-1f6f-40a3-a87a-7ec6e9bbefb5 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:57:06.548827 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-1956a9b1-1f6f-40a3-a87a-7ec6e9bbefb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:57:06.573714 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:06.627871 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 108/212] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:57:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 23 20:57:06.649060 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bb1b74-d350-4853-86b1-cf56866636ec None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:06.661067 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1956a9b1-1f6f-40a3-a87a-7ec6e9bbefb5 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:06.690059 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221398eb-42b8-4a56-9589-91df136224c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:06.691639 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221398eb-42b8-4a56-9589-91df136224c7 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:06.692121 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221398eb-42b8-4a56-9589-91df136224c7 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:06.692665 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221398eb-42b8-4a56-9589-91df136224c7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:06.694625 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221398eb-42b8-4a56-9589-91df136224c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:06.696302 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221398eb-42b8-4a56-9589-91df136224c7 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:06.698632 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 105/213] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 23 20:57:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:57:06.710940 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221398eb-42b8-4a56-9589-91df136224c7 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:06.713336 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:06.789339 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1956a9b1-1f6f-40a3-a87a-7ec6e9bbefb5 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:06.840114 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221398eb-42b8-4a56-9589-91df136224c7 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:06.857573 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:06.861302 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7d3543-f82a-48ab-b5ca-0ee77adb129e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:06.862282 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7d3543-f82a-48ab-b5ca-0ee77adb129e None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:06.862503 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7d3543-f82a-48ab-b5ca-0ee77adb129e None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:06.862772 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7d3543-f82a-48ab-b5ca-0ee77adb129e None admin] PATH_INFO: `/v3/roles/member` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:06.880340 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7d3543-f82a-48ab-b5ca-0ee77adb129e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:57:06.881482 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd88b41-e77e-4c24-a24c-86ecdb741c0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:06.882206 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd88b41-e77e-4c24-a24c-86ecdb741c0b None admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:06.882489 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd88b41-e77e-4c24-a24c-86ecdb741c0b None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:06.882764 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd88b41-e77e-4c24-a24c-86ecdb741c0b None admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:06.883485 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd88b41-e77e-4c24-a24c-86ecdb741c0b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:06.885182 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd88b41-e77e-4c24-a24c-86ecdb741c0b None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:06.890295 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-4f7d3543-f82a-48ab-b5ca-0ee77adb129e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 23 20:57:06.890295 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:57:06.890295 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:57:06.890295 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:57:06.890295 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:57:06.890295 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:57:06.890295 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:57:06.890295 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:57:06.890295 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:57:06.890295 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:57:06.890295 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:57:06.890295 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:57:06.890295 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:57:06.890295 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:57:06.890295 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:57:06.890295 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:57:06.891186 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:57:06.891186 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:57:06.891186 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:57:06.891186 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:57:06.891186 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:57:06.891186 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:57:06.891186 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:57:06.891186 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:57:06.891186 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:57:06.891186 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:57:06.891186 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:57:06.891186 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application with Lock( Jul 23 20:57:06.891186 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:57:06.891186 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:57:06.891186 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:57:06.891186 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:57:06.891964 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:57:06.891964 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:57:06.891964 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:57:06.891964 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:57:06.891964 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:57:06.891964 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:57:06.891964 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:57:06.891964 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:57:06.891964 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:57:06.891964 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:57:06.891964 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 23 20:57:06.891964 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:57:06.900472 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 109/214] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Jul 23 20:57:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 23 20:57:06.902481 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7d3543-f82a-48ab-b5ca-0ee77adb129e None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:06.924264 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 106/215] 10.222.0.17 () {60 vars in 1132 bytes} [Sat Jul 23 20:57:06 2022] POST /identity/v3/users => generated 297 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 20:57:07.027676 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:07.032935 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7d3543-f82a-48ab-b5ca-0ee77adb129e None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:07.073445 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253b566e-05ad-4361-9b7c-e5ea95cfc88f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:07.074589 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253b566e-05ad-4361-9b7c-e5ea95cfc88f None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:07.075118 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253b566e-05ad-4361-9b7c-e5ea95cfc88f None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:07.075594 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253b566e-05ad-4361-9b7c-e5ea95cfc88f None admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:07.076616 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253b566e-05ad-4361-9b7c-e5ea95cfc88f None admin] RBAC: Adding query filter params (name=member) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:57:07.077142 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253b566e-05ad-4361-9b7c-e5ea95cfc88f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:07.078880 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253b566e-05ad-4361-9b7c-e5ea95cfc88f None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:07.089541 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 110/216] 10.222.0.17 () {56 vars in 1101 bytes} [Sat Jul 23 20:57:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:57:07.095812 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd88b41-e77e-4c24-a24c-86ecdb741c0b None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:07.210571 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd88b41-e77e-4c24-a24c-86ecdb741c0b None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:07.247481 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3f061f-09bf-410c-8eb3-3689993daf38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:07.248753 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3f061f-09bf-410c-8eb3-3689993daf38 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:07.249227 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3f061f-09bf-410c-8eb3-3689993daf38 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:07.249705 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3f061f-09bf-410c-8eb3-3689993daf38 None admin] PATH_INFO: `/v3/users/673978868e494152b871ca41585a336c` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:07.266261 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3f061f-09bf-410c-8eb3-3689993daf38 None admin] RBAC: Authorizing `identity:get_user(user_id=673978868e494152b871ca41585a336c)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:07.267758 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3f061f-09bf-410c-8eb3-3689993daf38 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:07.269761 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 107/217] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Jul 23 20:57:07 2022] GET /identity/v3/users/673978868e494152b871ca41585a336c => generated 297 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:57:07.275158 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253b566e-05ad-4361-9b7c-e5ea95cfc88f None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:07.400845 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253b566e-05ad-4361-9b7c-e5ea95cfc88f None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:07.449832 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2610721b-1bf1-44e6-90f3-2b632dd83bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:07.450637 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2610721b-1bf1-44e6-90f3-2b632dd83bae None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:07.450840 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2610721b-1bf1-44e6-90f3-2b632dd83bae None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:07.451115 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2610721b-1bf1-44e6-90f3-2b632dd83bae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:07.484662 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:07.538615 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2610721b-1bf1-44e6-90f3-2b632dd83bae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:07.540129 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2610721b-1bf1-44e6-90f3-2b632dd83bae None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:07.564036 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e980dc8-d470-48a0-bed7-bf72b725f00d None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:07.564378 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e980dc8-d470-48a0-bed7-bf72b725f00d None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:07.564585 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e980dc8-d470-48a0-bed7-bf72b725f00d None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:07.566326 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 108/218] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:57:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:57:07.571533 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f322daa-086e-42aa-be80-ad7041419cb1 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:07.572101 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f322daa-086e-42aa-be80-ad7041419cb1 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:07.572565 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f322daa-086e-42aa-be80-ad7041419cb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:07.604858 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-9f322daa-086e-42aa-be80-ad7041419cb1 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:57:07.606477 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-9f322daa-086e-42aa-be80-ad7041419cb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:57:07.658738 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 111/219] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Jul 23 20:57:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 23 20:57:07.663415 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:07.665727 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2610721b-1bf1-44e6-90f3-2b632dd83bae None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:07.754862 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 109/220] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:57:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 23 20:57:07.778601 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:07.809851 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f322daa-086e-42aa-be80-ad7041419cb1 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:07.854105 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2610721b-1bf1-44e6-90f3-2b632dd83bae None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:07.904412 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75945fab-8cce-4923-b8e4-f5a06b7a071c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:07.905317 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75945fab-8cce-4923-b8e4-f5a06b7a071c None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:07.905586 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75945fab-8cce-4923-b8e4-f5a06b7a071c None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:07.905877 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75945fab-8cce-4923-b8e4-f5a06b7a071c None admin] PATH_INFO: `/v3/projects/84094ca55a574d84ba5fe544c9d90f50` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:07.910814 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75945fab-8cce-4923-b8e4-f5a06b7a071c None admin] RBAC: Authorizing `identity:get_project(project_id=84094ca55a574d84ba5fe544c9d90f50)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:07.912245 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75945fab-8cce-4923-b8e4-f5a06b7a071c None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:07.914059 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 112/221] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Jul 23 20:57:07 2022] GET /identity/v3/projects/84094ca55a574d84ba5fe544c9d90f50 => generated 302 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:57:07.919931 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75945fab-8cce-4923-b8e4-f5a06b7a071c None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:07.981811 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f322daa-086e-42aa-be80-ad7041419cb1 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:08.040318 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10407b8a-42f8-4771-a737-e7a3fe5ac954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:08.041158 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10407b8a-42f8-4771-a737-e7a3fe5ac954 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:08.041917 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10407b8a-42f8-4771-a737-e7a3fe5ac954 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:08.042205 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10407b8a-42f8-4771-a737-e7a3fe5ac954 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:08.057050 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10407b8a-42f8-4771-a737-e7a3fe5ac954 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:57:08.062072 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75945fab-8cce-4923-b8e4-f5a06b7a071c None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:08.067940 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-10407b8a-42f8-4771-a737-e7a3fe5ac954 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 23 20:57:08.067940 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:57:08.067940 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:57:08.067940 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:57:08.067940 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:57:08.067940 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:57:08.067940 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:57:08.067940 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:57:08.067940 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:57:08.067940 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:57:08.067940 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:57:08.067940 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:57:08.067940 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:57:08.067940 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:57:08.067940 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:57:08.067940 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:57:08.068864 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:57:08.068864 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:57:08.068864 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:57:08.068864 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:57:08.068864 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:57:08.068864 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:57:08.068864 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:57:08.068864 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:57:08.068864 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:57:08.068864 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:57:08.068864 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:57:08.068864 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application with Lock( Jul 23 20:57:08.068864 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:57:08.068864 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:57:08.068864 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:57:08.068864 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:57:08.070106 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:57:08.070106 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:57:08.070106 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:57:08.070106 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:57:08.070106 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:57:08.070106 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:57:08.070106 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:57:08.070106 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:57:08.070106 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:57:08.070106 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:57:08.070106 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 23 20:57:08.070106 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 20:57:08.070106 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 110/222] 10.222.0.17 () {56 vars in 1114 bytes} [Sat Jul 23 20:57:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 23 20:57:08.074827 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f962e9f4-2668-4b74-9f5f-0af0ac89a2a6 None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:08.075369 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f962e9f4-2668-4b74-9f5f-0af0ac89a2a6 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:08.077731 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f962e9f4-2668-4b74-9f5f-0af0ac89a2a6 None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:08.079421 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 111/223] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:57:08 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:57:08.084408 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f962e9f4-2668-4b74-9f5f-0af0ac89a2a6 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:08.100696 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:08.108472 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:08.110346 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab78f80-8e52-4dee-82f4-cf4442a5178a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:08.111226 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab78f80-8e52-4dee-82f4-cf4442a5178a None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:08.111503 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab78f80-8e52-4dee-82f4-cf4442a5178a None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:08.111771 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab78f80-8e52-4dee-82f4-cf4442a5178a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:08.112626 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab78f80-8e52-4dee-82f4-cf4442a5178a None admin] RBAC: Adding query filter params (role.id=14824669685048b38361b1676f7f0f9f, scope.project.id=84094ca55a574d84ba5fe544c9d90f50, user.id=673978868e494152b871ca41585a336c) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:57:08.112932 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab78f80-8e52-4dee-82f4-cf4442a5178a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:08.114900 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab78f80-8e52-4dee-82f4-cf4442a5178a None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:08.122271 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 113/224] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Jul 23 20:57:07 2022] GET /identity/v3/role_assignments?user.id=673978868e494152b871ca41585a336c&scope.project.id=84094ca55a574d84ba5fe544c9d90f50&role.id=14824669685048b38361b1676f7f0f9f => generated 259 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 20:57:08.123763 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c97ffe-3190-424f-8b36-55479827730b None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:08.124023 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c97ffe-3190-424f-8b36-55479827730b None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:08.124296 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c97ffe-3190-424f-8b36-55479827730b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:08.158878 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-34c97ffe-3190-424f-8b36-55479827730b None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:57:08.160187 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-34c97ffe-3190-424f-8b36-55479827730b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:57:08.297601 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f962e9f4-2668-4b74-9f5f-0af0ac89a2a6 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:08.316968 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 114/225] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:57:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 23 20:57:08.342976 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d62e5b-c303-4085-afa5-fefd7a66f95b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:08.343707 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d62e5b-c303-4085-afa5-fefd7a66f95b None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:08.343987 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d62e5b-c303-4085-afa5-fefd7a66f95b None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:08.344303 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d62e5b-c303-4085-afa5-fefd7a66f95b None admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:08.345062 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d62e5b-c303-4085-afa5-fefd7a66f95b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:57:08.345362 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d62e5b-c303-4085-afa5-fefd7a66f95b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:08.346868 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d62e5b-c303-4085-afa5-fefd7a66f95b None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:08.356596 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 112/226] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Jul 23 20:57:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:57:08.362137 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c97ffe-3190-424f-8b36-55479827730b None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:08.373637 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d62e5b-c303-4085-afa5-fefd7a66f95b None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:08.483046 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d62e5b-c303-4085-afa5-fefd7a66f95b None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:08.486272 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:08.519072 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9f306c-535f-43af-958a-e4b528d11b6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:08.520121 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9f306c-535f-43af-958a-e4b528d11b6b None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:08.520411 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9f306c-535f-43af-958a-e4b528d11b6b None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:08.520687 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9f306c-535f-43af-958a-e4b528d11b6b None admin] PATH_INFO: `/v3/users/c0ebfcb519154de5acc86824b2b13261` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:08.521966 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9f306c-535f-43af-958a-e4b528d11b6b None admin] RBAC: Authorizing `identity:get_user(user_id=c0ebfcb519154de5acc86824b2b13261)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:08.523493 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9f306c-535f-43af-958a-e4b528d11b6b None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:08.525152 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 113/227] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Jul 23 20:57:08 2022] GET /identity/v3/users/c0ebfcb519154de5acc86824b2b13261 => generated 283 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 20:57:08.531195 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9f306c-535f-43af-958a-e4b528d11b6b None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:08.543427 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c97ffe-3190-424f-8b36-55479827730b None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:08.568551 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:08.590151 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447f37d3-ffbe-4973-88fd-5af970af33e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:08.591227 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447f37d3-ffbe-4973-88fd-5af970af33e6 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:08.591676 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447f37d3-ffbe-4973-88fd-5af970af33e6 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:08.592086 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447f37d3-ffbe-4973-88fd-5af970af33e6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:08.614777 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447f37d3-ffbe-4973-88fd-5af970af33e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:57:08.624854 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-447f37d3-ffbe-4973-88fd-5af970af33e6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 23 20:57:08.624854 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:57:08.624854 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:57:08.624854 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:57:08.624854 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:57:08.624854 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:57:08.624854 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:57:08.624854 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:57:08.624854 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:57:08.624854 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:57:08.624854 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:57:08.624854 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:57:08.624854 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:57:08.624854 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:57:08.624854 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:57:08.624854 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:57:08.626046 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:57:08.626046 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:57:08.626046 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:57:08.626046 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:57:08.626046 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:57:08.626046 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:57:08.626046 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:57:08.626046 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:57:08.626046 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:57:08.626046 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:57:08.626046 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:57:08.626046 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application with Lock( Jul 23 20:57:08.626046 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:57:08.626046 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:57:08.626046 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:57:08.626046 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:57:08.627059 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:57:08.627059 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:57:08.627059 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:57:08.627059 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:57:08.627059 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:57:08.627059 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:57:08.627059 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:57:08.627059 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:57:08.627059 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:57:08.627059 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:57:08.627059 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 23 20:57:08.627059 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:57:08.629254 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 115/228] 10.222.0.17 () {56 vars in 1096 bytes} [Sat Jul 23 20:57:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:57:08.634982 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447f37d3-ffbe-4973-88fd-5af970af33e6 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:08.714637 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9f306c-535f-43af-958a-e4b528d11b6b None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:08.764506 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495574dd-c3a3-4bd2-a993-f62cc5ca335d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:08.765394 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495574dd-c3a3-4bd2-a993-f62cc5ca335d None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:08.765924 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495574dd-c3a3-4bd2-a993-f62cc5ca335d None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:08.766213 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495574dd-c3a3-4bd2-a993-f62cc5ca335d None admin] PATH_INFO: `/v3/projects/84094ca55a574d84ba5fe544c9d90f50` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:08.767929 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495574dd-c3a3-4bd2-a993-f62cc5ca335d None admin] RBAC: Authorizing `identity:get_project(project_id=84094ca55a574d84ba5fe544c9d90f50)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:08.769804 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495574dd-c3a3-4bd2-a993-f62cc5ca335d None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:08.770885 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447f37d3-ffbe-4973-88fd-5af970af33e6 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:08.771705 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 114/229] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Jul 23 20:57:08 2022] GET /identity/v3/projects/84094ca55a574d84ba5fe544c9d90f50 => generated 302 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 20:57:08.777926 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495574dd-c3a3-4bd2-a993-f62cc5ca335d None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:08.801130 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:08.867838 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb597df-d0ab-44c2-8f40-a11729787fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:08.868434 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb597df-d0ab-44c2-8f40-a11729787fb0 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:08.868709 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb597df-d0ab-44c2-8f40-a11729787fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:08.868973 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb597df-d0ab-44c2-8f40-a11729787fb0 None admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:08.869725 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb597df-d0ab-44c2-8f40-a11729787fb0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:57:08.870088 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb597df-d0ab-44c2-8f40-a11729787fb0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:08.871498 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb597df-d0ab-44c2-8f40-a11729787fb0 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:08.889142 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 116/230] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Jul 23 20:57:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 20:57:08.895025 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb597df-d0ab-44c2-8f40-a11729787fb0 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:08.934292 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495574dd-c3a3-4bd2-a993-f62cc5ca335d None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:08.948959 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:09.007080 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb597df-d0ab-44c2-8f40-a11729787fb0 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:09.015136 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b494686-125e-4213-bd60-28b6ab4bc0b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:09.016333 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b494686-125e-4213-bd60-28b6ab4bc0b6 None admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:09.016812 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b494686-125e-4213-bd60-28b6ab4bc0b6 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:09.017275 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b494686-125e-4213-bd60-28b6ab4bc0b6 None admin] PATH_INFO: `/v3/projects/84094ca55a574d84ba5fe544c9d90f50/users/c0ebfcb519154de5acc86824b2b13261/roles/c5f46541d35e44b691baa7a1fa304c0f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:09.023160 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b494686-125e-4213-bd60-28b6ab4bc0b6 None admin] RBAC: Authorizing `identity:create_grant(project_id=84094ca55a574d84ba5fe544c9d90f50, user_id=c0ebfcb519154de5acc86824b2b13261, role_id=c5f46541d35e44b691baa7a1fa304c0f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:09.024876 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b494686-125e-4213-bd60-28b6ab4bc0b6 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:09.042839 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6246e9e0-42d5-4236-b0f5-3726b4f14dd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:09.043796 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6246e9e0-42d5-4236-b0f5-3726b4f14dd7 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:09.044061 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6246e9e0-42d5-4236-b0f5-3726b4f14dd7 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:09.044330 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6246e9e0-42d5-4236-b0f5-3726b4f14dd7 None admin] PATH_INFO: `/v3/users/c0ebfcb519154de5acc86824b2b13261` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:09.045579 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6246e9e0-42d5-4236-b0f5-3726b4f14dd7 None admin] RBAC: Authorizing `identity:get_user(user_id=c0ebfcb519154de5acc86824b2b13261)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:09.047296 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6246e9e0-42d5-4236-b0f5-3726b4f14dd7 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:09.049357 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 117/231] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Jul 23 20:57:08 2022] GET /identity/v3/users/c0ebfcb519154de5acc86824b2b13261 => generated 283 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:57:09.054809 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6246e9e0-42d5-4236-b0f5-3726b4f14dd7 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:09.055849 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 115/232] 10.222.0.17 () {58 vars in 1439 bytes} [Sat Jul 23 20:57:08 2022] PUT /identity/v3/projects/84094ca55a574d84ba5fe544c9d90f50/users/c0ebfcb519154de5acc86824b2b13261/roles/c5f46541d35e44b691baa7a1fa304c0f => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 20:57:09.185400 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6246e9e0-42d5-4236-b0f5-3726b4f14dd7 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:09.200549 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:09.229597 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f73d15-bd7a-4590-a3e6-88945a3ed260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:09.230600 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f73d15-bd7a-4590-a3e6-88945a3ed260 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:09.230881 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f73d15-bd7a-4590-a3e6-88945a3ed260 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:09.231155 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f73d15-bd7a-4590-a3e6-88945a3ed260 None admin] PATH_INFO: `/v3/projects/84094ca55a574d84ba5fe544c9d90f50` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:09.237839 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f73d15-bd7a-4590-a3e6-88945a3ed260 None admin] RBAC: Authorizing `identity:get_project(project_id=84094ca55a574d84ba5fe544c9d90f50)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:09.239507 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f73d15-bd7a-4590-a3e6-88945a3ed260 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:09.241795 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 118/233] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Jul 23 20:57:09 2022] GET /identity/v3/projects/84094ca55a574d84ba5fe544c9d90f50 => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 20:57:09.248179 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b494686-125e-4213-bd60-28b6ab4bc0b6 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:09.380659 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:09.408268 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b494686-125e-4213-bd60-28b6ab4bc0b6 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:09.450276 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccdea19-33c4-47a3-9d53-fc03659e472c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:09.451116 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccdea19-33c4-47a3-9d53-fc03659e472c None admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:09.451392 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccdea19-33c4-47a3-9d53-fc03659e472c None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:09.451665 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccdea19-33c4-47a3-9d53-fc03659e472c None admin] PATH_INFO: `/v3/projects/84094ca55a574d84ba5fe544c9d90f50/users/c0ebfcb519154de5acc86824b2b13261/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:09.453989 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccdea19-33c4-47a3-9d53-fc03659e472c None admin] RBAC: Authorizing `identity:create_grant(project_id=84094ca55a574d84ba5fe544c9d90f50, user_id=c0ebfcb519154de5acc86824b2b13261, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:09.455517 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccdea19-33c4-47a3-9d53-fc03659e472c None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:09.476924 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 116/234] 10.222.0.17 () {58 vars in 1439 bytes} [Sat Jul 23 20:57:09 2022] PUT /identity/v3/projects/84094ca55a574d84ba5fe544c9d90f50/users/c0ebfcb519154de5acc86824b2b13261/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 20:57:09.902702 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420edd32-5a8c-4838-84c7-5d12285834d2 None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:09.903591 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420edd32-5a8c-4838-84c7-5d12285834d2 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:09.903591 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420edd32-5a8c-4838-84c7-5d12285834d2 None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:09.905395 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 119/235] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:57:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:57:09.911456 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2697d7b1-c876-4904-8238-b3e569f1ec27 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:09.912018 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2697d7b1-c876-4904-8238-b3e569f1ec27 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:09.912018 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2697d7b1-c876-4904-8238-b3e569f1ec27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:09.936447 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-2697d7b1-c876-4904-8238-b3e569f1ec27 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:57:09.937896 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-2697d7b1-c876-4904-8238-b3e569f1ec27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:57:10.032294 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 117/236] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:57:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 23 20:57:10.083544 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420edd32-5a8c-4838-84c7-5d12285834d2 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:10.090384 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d31f5b-f775-41de-9f1f-b5a9656bdad7 None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:10.090668 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d31f5b-f775-41de-9f1f-b5a9656bdad7 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:10.090944 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d31f5b-f775-41de-9f1f-b5a9656bdad7 None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:10.092664 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 118/237] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:57:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 23 20:57:10.098281 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2612d798-1981-49dc-ac3e-ca5fb8f95eaf None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:10.098567 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2612d798-1981-49dc-ac3e-ca5fb8f95eaf None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:10.098823 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2612d798-1981-49dc-ac3e-ca5fb8f95eaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:10.117735 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-2612d798-1981-49dc-ac3e-ca5fb8f95eaf None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:57:10.119082 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-2612d798-1981-49dc-ac3e-ca5fb8f95eaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:57:10.230967 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:10.247584 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 119/238] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:57:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 23 20:57:10.261042 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420edd32-5a8c-4838-84c7-5d12285834d2 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:10.308343 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27a1db1-7807-442d-ad0f-6f2acf0bdb88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:10.309171 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27a1db1-7807-442d-ad0f-6f2acf0bdb88 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:10.309451 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27a1db1-7807-442d-ad0f-6f2acf0bdb88 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:10.309747 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27a1db1-7807-442d-ad0f-6f2acf0bdb88 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:10.315660 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2612d798-1981-49dc-ac3e-ca5fb8f95eaf None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:10.321613 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27a1db1-7807-442d-ad0f-6f2acf0bdb88 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:57:10.330922 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-c27a1db1-7807-442d-ad0f-6f2acf0bdb88 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 23 20:57:10.330922 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:57:10.330922 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:57:10.330922 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:57:10.330922 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:57:10.330922 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:57:10.330922 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:57:10.330922 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:57:10.330922 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:57:10.330922 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:57:10.330922 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:57:10.330922 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:57:10.330922 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:57:10.330922 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:57:10.330922 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:57:10.330922 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:57:10.332029 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:57:10.332029 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:57:10.332029 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:57:10.332029 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:57:10.332029 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:57:10.332029 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:57:10.332029 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:57:10.332029 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:57:10.332029 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:57:10.332029 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:57:10.332029 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:57:10.332029 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application with Lock( Jul 23 20:57:10.332029 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:57:10.332029 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:57:10.332029 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:57:10.332029 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:57:10.332785 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:57:10.332785 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:57:10.332785 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:57:10.332785 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:57:10.332785 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:57:10.332785 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:57:10.332785 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:57:10.332785 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:57:10.332785 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:57:10.332785 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:57:10.332785 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 23 20:57:10.332785 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:57:10.332785 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 120/239] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Jul 23 20:57:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:57:10.341959 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27a1db1-7807-442d-ad0f-6f2acf0bdb88 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:10.385633 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:10.449020 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27a1db1-7807-442d-ad0f-6f2acf0bdb88 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:10.485636 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46655d1-818b-4ff1-accf-4ff821e907de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:10.486373 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46655d1-818b-4ff1-accf-4ff821e907de None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:10.486654 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46655d1-818b-4ff1-accf-4ff821e907de None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:10.486926 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46655d1-818b-4ff1-accf-4ff821e907de None admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:10.487703 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46655d1-818b-4ff1-accf-4ff821e907de None admin] RBAC: Adding query filter params (name=reader) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:57:10.488068 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46655d1-818b-4ff1-accf-4ff821e907de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:10.489627 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46655d1-818b-4ff1-accf-4ff821e907de None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:10.504010 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 121/240] 10.222.0.17 () {56 vars in 1101 bytes} [Sat Jul 23 20:57:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:57:10.507436 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46655d1-818b-4ff1-accf-4ff821e907de None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:10.570826 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2612d798-1981-49dc-ac3e-ca5fb8f95eaf None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:10.640218 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46655d1-818b-4ff1-accf-4ff821e907de None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:10.642207 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:10.679593 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28792ee-aa3c-42f5-ab59-7d4ac4a1a98b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:10.680428 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28792ee-aa3c-42f5-ab59-7d4ac4a1a98b None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:10.680709 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28792ee-aa3c-42f5-ab59-7d4ac4a1a98b None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:10.680980 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28792ee-aa3c-42f5-ab59-7d4ac4a1a98b None admin] PATH_INFO: `/v3/domains/default` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:10.681481 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba474da3-ca81-4020-97ed-b71cda085359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:10.682424 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba474da3-ca81-4020-97ed-b71cda085359 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:10.682527 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28792ee-aa3c-42f5-ab59-7d4ac4a1a98b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:10.682712 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba474da3-ca81-4020-97ed-b71cda085359 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:10.683102 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba474da3-ca81-4020-97ed-b71cda085359 None admin] PATH_INFO: `/v3/users/53919da957884590a66f1ce3b3135542` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:10.683970 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28792ee-aa3c-42f5-ab59-7d4ac4a1a98b None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:10.694366 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 120/241] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 23 20:57:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 379 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 20:57:10.699320 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba474da3-ca81-4020-97ed-b71cda085359 None admin] RBAC: Authorizing `identity:get_user(user_id=53919da957884590a66f1ce3b3135542)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:10.700003 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28792ee-aa3c-42f5-ab59-7d4ac4a1a98b None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:10.700826 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba474da3-ca81-4020-97ed-b71cda085359 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:10.702884 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 122/242] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Jul 23 20:57:10 2022] GET /identity/v3/users/53919da957884590a66f1ce3b3135542 => generated 297 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 20:57:10.709526 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba474da3-ca81-4020-97ed-b71cda085359 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:10.830468 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba474da3-ca81-4020-97ed-b71cda085359 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:10.833158 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:10.881396 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce822314-aaf4-4a95-a66a-73b24d3b4927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:10.882876 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce822314-aaf4-4a95-a66a-73b24d3b4927 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:10.883462 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce822314-aaf4-4a95-a66a-73b24d3b4927 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:10.883978 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce822314-aaf4-4a95-a66a-73b24d3b4927 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:10.886271 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28792ee-aa3c-42f5-ab59-7d4ac4a1a98b None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:10.920144 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:10.929894 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d740c4bf-d794-401c-9c5c-98c7bc4bd7e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:10.930702 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d740c4bf-d794-401c-9c5c-98c7bc4bd7e9 None admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:10.931104 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d740c4bf-d794-401c-9c5c-98c7bc4bd7e9 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:10.931473 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d740c4bf-d794-401c-9c5c-98c7bc4bd7e9 None admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:10.932719 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d740c4bf-d794-401c-9c5c-98c7bc4bd7e9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:10.934417 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d740c4bf-d794-401c-9c5c-98c7bc4bd7e9 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:10.959845 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 121/243] 10.222.0.17 () {60 vars in 1132 bytes} [Sat Jul 23 20:57:10 2022] POST /identity/v3/users => generated 293 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 20:57:10.961728 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d01194-2786-4515-a445-ef88d04ca429 None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:10.962211 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d01194-2786-4515-a445-ef88d04ca429 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:10.962651 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d01194-2786-4515-a445-ef88d04ca429 None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:10.969425 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 122/244] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:57:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:57:10.971510 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e47dc1-d818-472e-bbc0-d2b913a14dfc None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:10.971928 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e47dc1-d818-472e-bbc0-d2b913a14dfc None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:10.972305 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e47dc1-d818-472e-bbc0-d2b913a14dfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:10.977457 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce822314-aaf4-4a95-a66a-73b24d3b4927 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:10.979239 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce822314-aaf4-4a95-a66a-73b24d3b4927 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:10.993053 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-51e47dc1-d818-472e-bbc0-d2b913a14dfc None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:57:10.994475 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-51e47dc1-d818-472e-bbc0-d2b913a14dfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:57:11.082369 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 123/245] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:57:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 23 20:57:11.107037 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 123/246] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Jul 23 20:57:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 23 20:57:11.108582 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e47dc1-d818-472e-bbc0-d2b913a14dfc None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:11.110075 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce822314-aaf4-4a95-a66a-73b24d3b4927 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:11.166418 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:11.177430 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:11.228930 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce822314-aaf4-4a95-a66a-73b24d3b4927 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:11.230616 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e47dc1-d818-472e-bbc0-d2b913a14dfc None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:11.272616 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b758aecd-f5ee-4518-9249-6b24c28fd34b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:11.273328 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb12dd1-0aa4-4bd5-a541-2d5e0d5ac5dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:11.273797 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b758aecd-f5ee-4518-9249-6b24c28fd34b None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:11.274264 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b758aecd-f5ee-4518-9249-6b24c28fd34b None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:11.274801 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b758aecd-f5ee-4518-9249-6b24c28fd34b None admin] PATH_INFO: `/v3/roles/member` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:11.275228 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb12dd1-0aa4-4bd5-a541-2d5e0d5ac5dc None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:11.275826 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb12dd1-0aa4-4bd5-a541-2d5e0d5ac5dc None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:11.276389 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb12dd1-0aa4-4bd5-a541-2d5e0d5ac5dc None admin] PATH_INFO: `/v3/projects/84094ca55a574d84ba5fe544c9d90f50` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:11.278028 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb12dd1-0aa4-4bd5-a541-2d5e0d5ac5dc None admin] RBAC: Authorizing `identity:get_project(project_id=84094ca55a574d84ba5fe544c9d90f50)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:11.280251 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb12dd1-0aa4-4bd5-a541-2d5e0d5ac5dc None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:11.287053 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 124/247] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Jul 23 20:57:11 2022] GET /identity/v3/projects/84094ca55a574d84ba5fe544c9d90f50 => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 20:57:11.295475 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb12dd1-0aa4-4bd5-a541-2d5e0d5ac5dc None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:11.300335 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b758aecd-f5ee-4518-9249-6b24c28fd34b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:57:11.308708 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-b758aecd-f5ee-4518-9249-6b24c28fd34b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 23 20:57:11.308708 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:57:11.308708 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:57:11.308708 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:57:11.308708 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:57:11.308708 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:57:11.308708 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:57:11.308708 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:57:11.308708 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:57:11.308708 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:57:11.308708 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:57:11.308708 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:57:11.308708 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:57:11.308708 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:57:11.308708 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:57:11.308708 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:57:11.309844 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:57:11.309844 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:57:11.309844 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:57:11.309844 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:57:11.309844 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:57:11.309844 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:57:11.309844 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:57:11.309844 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:57:11.309844 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:57:11.309844 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:57:11.309844 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:57:11.309844 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application with Lock( Jul 23 20:57:11.309844 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:57:11.309844 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:57:11.309844 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:57:11.309844 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:57:11.310836 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:57:11.310836 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:57:11.310836 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:57:11.310836 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:57:11.310836 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:57:11.310836 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:57:11.310836 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:57:11.310836 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:57:11.310836 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:57:11.310836 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:57:11.310836 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 23 20:57:11.310836 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 20:57:11.313558 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 124/248] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Jul 23 20:57:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:57:11.319514 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b758aecd-f5ee-4518-9249-6b24c28fd34b None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:11.431544 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb12dd1-0aa4-4bd5-a541-2d5e0d5ac5dc None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:11.441466 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b758aecd-f5ee-4518-9249-6b24c28fd34b None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:11.453921 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:11.463926 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:11.473319 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b90897-8868-4be4-a8fb-09d32e5025cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:11.474177 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b90897-8868-4be4-a8fb-09d32e5025cd None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:11.474565 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b90897-8868-4be4-a8fb-09d32e5025cd None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:11.474940 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b90897-8868-4be4-a8fb-09d32e5025cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:11.475986 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b90897-8868-4be4-a8fb-09d32e5025cd None admin] RBAC: Adding query filter params (role.id=5e81c9ea0319460391e21a2a77dd537a, scope.project.id=84094ca55a574d84ba5fe544c9d90f50, user.id=53919da957884590a66f1ce3b3135542) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:57:11.476442 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b90897-8868-4be4-a8fb-09d32e5025cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:11.478075 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b90897-8868-4be4-a8fb-09d32e5025cd None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:11.484222 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3695b0e4-7dd1-476e-ba88-8916f91fb7ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:11.484460 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 125/249] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Jul 23 20:57:11 2022] GET /identity/v3/role_assignments?user.id=53919da957884590a66f1ce3b3135542&scope.project.id=84094ca55a574d84ba5fe544c9d90f50&role.id=5e81c9ea0319460391e21a2a77dd537a => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:57:11.484945 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3695b0e4-7dd1-476e-ba88-8916f91fb7ce None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:11.485322 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3695b0e4-7dd1-476e-ba88-8916f91fb7ce None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:11.485604 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3695b0e4-7dd1-476e-ba88-8916f91fb7ce None admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:11.486402 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3695b0e4-7dd1-476e-ba88-8916f91fb7ce None admin] RBAC: Adding query filter params (name=member) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:57:11.486724 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3695b0e4-7dd1-476e-ba88-8916f91fb7ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:11.488368 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3695b0e4-7dd1-476e-ba88-8916f91fb7ce None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:11.499080 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 125/250] 10.222.0.17 () {56 vars in 1101 bytes} [Sat Jul 23 20:57:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:57:11.505202 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b90897-8868-4be4-a8fb-09d32e5025cd None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:11.639230 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b90897-8868-4be4-a8fb-09d32e5025cd None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:11.688500 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d997b5fe-5f31-4873-9f92-3e30feb75daf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:11.689340 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d997b5fe-5f31-4873-9f92-3e30feb75daf None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:11.689620 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d997b5fe-5f31-4873-9f92-3e30feb75daf None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:11.689951 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d997b5fe-5f31-4873-9f92-3e30feb75daf None admin] PATH_INFO: `/v3/users/673978868e494152b871ca41585a336c` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:11.691477 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d997b5fe-5f31-4873-9f92-3e30feb75daf None admin] RBAC: Authorizing `identity:get_user(user_id=673978868e494152b871ca41585a336c)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:11.692994 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d997b5fe-5f31-4873-9f92-3e30feb75daf None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:11.694812 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 126/251] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Jul 23 20:57:11 2022] GET /identity/v3/users/673978868e494152b871ca41585a336c => generated 297 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:57:11.700785 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3695b0e4-7dd1-476e-ba88-8916f91fb7ce None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:11.840203 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3695b0e4-7dd1-476e-ba88-8916f91fb7ce None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:11.881894 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648b9ae3-4788-48d2-9f8e-a083ea04a287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:11.883184 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648b9ae3-4788-48d2-9f8e-a083ea04a287 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:11.883694 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648b9ae3-4788-48d2-9f8e-a083ea04a287 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:11.884167 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648b9ae3-4788-48d2-9f8e-a083ea04a287 None admin] PATH_INFO: `/v3/projects/84094ca55a574d84ba5fe544c9d90f50` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:11.885594 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648b9ae3-4788-48d2-9f8e-a083ea04a287 None admin] RBAC: Authorizing `identity:get_project(project_id=84094ca55a574d84ba5fe544c9d90f50)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:11.887290 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648b9ae3-4788-48d2-9f8e-a083ea04a287 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:11.889238 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 126/252] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Jul 23 20:57:11 2022] GET /identity/v3/projects/84094ca55a574d84ba5fe544c9d90f50 => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:57:11.895162 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d997b5fe-5f31-4873-9f92-3e30feb75daf None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:11.987840 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:12.070475 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d997b5fe-5f31-4873-9f92-3e30feb75daf None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:12.113014 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08791245-8e7d-4d96-a40d-a427ab7ec01e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:12.114003 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08791245-8e7d-4d96-a40d-a427ab7ec01e None admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:12.114280 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08791245-8e7d-4d96-a40d-a427ab7ec01e None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:12.114550 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08791245-8e7d-4d96-a40d-a427ab7ec01e None admin] PATH_INFO: `/v3/projects/84094ca55a574d84ba5fe544c9d90f50/users/673978868e494152b871ca41585a336c/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:12.116607 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08791245-8e7d-4d96-a40d-a427ab7ec01e None admin] RBAC: Authorizing `identity:create_grant(project_id=84094ca55a574d84ba5fe544c9d90f50, user_id=673978868e494152b871ca41585a336c, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:12.118128 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08791245-8e7d-4d96-a40d-a427ab7ec01e None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:12.140572 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 127/253] 10.222.0.17 () {58 vars in 1439 bytes} [Sat Jul 23 20:57:11 2022] PUT /identity/v3/projects/84094ca55a574d84ba5fe544c9d90f50/users/673978868e494152b871ca41585a336c/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 20:57:12.387495 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705592cc-a9d5-466e-9b2d-c65cb0817709 None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:12.388596 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705592cc-a9d5-466e-9b2d-c65cb0817709 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:12.389114 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705592cc-a9d5-466e-9b2d-c65cb0817709 None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:12.391252 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 127/254] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:57:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:57:12.397944 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1051f74e-3993-44ce-a08a-dec4eedc9e9b None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:12.398549 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1051f74e-3993-44ce-a08a-dec4eedc9e9b None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:12.399055 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1051f74e-3993-44ce-a08a-dec4eedc9e9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:12.423005 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-1051f74e-3993-44ce-a08a-dec4eedc9e9b None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:57:12.424592 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-1051f74e-3993-44ce-a08a-dec4eedc9e9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:57:12.525058 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbc0f21-d8d1-44fe-bbe6-655680f6388c None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:12.525757 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbc0f21-d8d1-44fe-bbe6-655680f6388c None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:12.526309 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbc0f21-d8d1-44fe-bbe6-655680f6388c None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:12.528003 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 128/255] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:57:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:57:12.531122 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 128/256] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:57:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 23 20:57:12.535839 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bd7ec1-038d-4a51-b9bd-4115ba7cd51a None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:12.536432 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bd7ec1-038d-4a51-b9bd-4115ba7cd51a None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:12.536938 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bd7ec1-038d-4a51-b9bd-4115ba7cd51a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:12.559311 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-72bd7ec1-038d-4a51-b9bd-4115ba7cd51a None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:57:12.560933 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-72bd7ec1-038d-4a51-b9bd-4115ba7cd51a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:57:12.598555 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1051f74e-3993-44ce-a08a-dec4eedc9e9b None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:12.632330 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:12.663998 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:12.720277 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 129/257] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:57:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 23 20:57:12.723192 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1051f74e-3993-44ce-a08a-dec4eedc9e9b None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:12.757394 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bd7ec1-038d-4a51-b9bd-4115ba7cd51a None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:12.765923 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c35367-1aae-4418-a179-a63a6d9e6252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:12.767214 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c35367-1aae-4418-a179-a63a6d9e6252 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:12.767727 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c35367-1aae-4418-a179-a63a6d9e6252 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:12.768204 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c35367-1aae-4418-a179-a63a6d9e6252 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:12.790009 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c35367-1aae-4418-a179-a63a6d9e6252 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:57:12.803401 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-35c35367-1aae-4418-a179-a63a6d9e6252 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 23 20:57:12.803401 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:57:12.803401 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:57:12.803401 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:57:12.803401 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:57:12.803401 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:57:12.803401 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:57:12.803401 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:57:12.803401 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:57:12.803401 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:57:12.803401 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:57:12.803401 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:57:12.803401 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:57:12.803401 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:57:12.803401 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:57:12.803401 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:57:12.804328 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:57:12.804328 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:57:12.804328 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:57:12.804328 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:57:12.804328 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:57:12.804328 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:57:12.804328 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:57:12.804328 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:57:12.804328 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:57:12.804328 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:57:12.804328 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:57:12.804328 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application with Lock( Jul 23 20:57:12.804328 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:57:12.804328 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:57:12.804328 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:57:12.804328 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:57:12.805101 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:57:12.805101 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:57:12.805101 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:57:12.805101 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:57:12.805101 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:57:12.805101 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:57:12.805101 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:57:12.805101 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:57:12.805101 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:57:12.805101 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:57:12.805101 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 23 20:57:12.805101 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:57:12.808820 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 129/258] 10.222.0.17 () {56 vars in 1114 bytes} [Sat Jul 23 20:57:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 23 20:57:12.830290 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c35367-1aae-4418-a179-a63a6d9e6252 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:12.965220 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bd7ec1-038d-4a51-b9bd-4115ba7cd51a None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:13.025086 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323b2262-af2c-42ca-8ba2-487d24221696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:13.026231 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323b2262-af2c-42ca-8ba2-487d24221696 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:13.026648 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323b2262-af2c-42ca-8ba2-487d24221696 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:13.027040 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323b2262-af2c-42ca-8ba2-487d24221696 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:13.047581 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323b2262-af2c-42ca-8ba2-487d24221696 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:57:13.063992 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-323b2262-af2c-42ca-8ba2-487d24221696 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 23 20:57:13.063992 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:57:13.063992 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:57:13.063992 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:57:13.063992 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:57:13.063992 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:57:13.063992 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:57:13.063992 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:57:13.063992 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:57:13.063992 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:57:13.063992 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:57:13.063992 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:57:13.063992 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:57:13.063992 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:57:13.063992 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:57:13.063992 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:57:13.065084 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:57:13.065084 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:57:13.065084 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:57:13.065084 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:57:13.065084 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:57:13.065084 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:57:13.065084 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:57:13.065084 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:57:13.065084 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:57:13.065084 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:57:13.065084 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:57:13.065084 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application with Lock( Jul 23 20:57:13.065084 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:57:13.065084 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:57:13.065084 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:57:13.065084 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:57:13.066085 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:57:13.066085 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:57:13.066085 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:57:13.066085 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:57:13.066085 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:57:13.066085 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:57:13.066085 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:57:13.066085 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:57:13.066085 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:57:13.066085 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:57:13.066085 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 23 20:57:13.066085 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 20:57:13.068141 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 130/259] 10.222.0.17 () {56 vars in 1096 bytes} [Sat Jul 23 20:57:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:57:13.076821 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323b2262-af2c-42ca-8ba2-487d24221696 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:13.135740 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:13.164085 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c35367-1aae-4418-a179-a63a6d9e6252 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:13.191656 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:13.255643 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60974354-4a8e-4325-93ca-416bdc013de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:13.257760 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60974354-4a8e-4325-93ca-416bdc013de3 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:13.258648 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60974354-4a8e-4325-93ca-416bdc013de3 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:13.265890 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60974354-4a8e-4325-93ca-416bdc013de3 None admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:13.267499 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60974354-4a8e-4325-93ca-416bdc013de3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:57:13.269433 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60974354-4a8e-4325-93ca-416bdc013de3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:13.271345 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60974354-4a8e-4325-93ca-416bdc013de3 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:13.288223 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323b2262-af2c-42ca-8ba2-487d24221696 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:13.297014 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 130/260] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Jul 23 20:57:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 467 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 20:57:13.307139 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60974354-4a8e-4325-93ca-416bdc013de3 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:13.394025 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61d041d-de1f-4527-9f2d-3c6cae73e387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:13.395543 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61d041d-de1f-4527-9f2d-3c6cae73e387 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:13.396312 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61d041d-de1f-4527-9f2d-3c6cae73e387 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:13.397476 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61d041d-de1f-4527-9f2d-3c6cae73e387 None admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:13.398516 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61d041d-de1f-4527-9f2d-3c6cae73e387 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:57:13.399276 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61d041d-de1f-4527-9f2d-3c6cae73e387 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:13.401559 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61d041d-de1f-4527-9f2d-3c6cae73e387 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:13.433230 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 131/261] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Jul 23 20:57:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 20:57:13.439446 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61d041d-de1f-4527-9f2d-3c6cae73e387 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:13.580051 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60974354-4a8e-4325-93ca-416bdc013de3 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:13.639346 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02bba92-6233-4984-8048-726c2404283e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:13.640667 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02bba92-6233-4984-8048-726c2404283e None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:13.641157 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02bba92-6233-4984-8048-726c2404283e None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:13.641657 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02bba92-6233-4984-8048-726c2404283e None admin] PATH_INFO: `/v3/users/c0ebfcb519154de5acc86824b2b13261` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:13.643180 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02bba92-6233-4984-8048-726c2404283e None admin] RBAC: Authorizing `identity:get_user(user_id=c0ebfcb519154de5acc86824b2b13261)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:13.644979 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02bba92-6233-4984-8048-726c2404283e None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:13.646933 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 131/262] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Jul 23 20:57:13 2022] GET /identity/v3/users/c0ebfcb519154de5acc86824b2b13261 => generated 283 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:57:13.655606 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02bba92-6233-4984-8048-726c2404283e None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:13.668848 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:13.684467 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61d041d-de1f-4527-9f2d-3c6cae73e387 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:13.740006 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:13.771207 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9318522e-1546-4aeb-93a4-22fa06e7c04e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:13.772132 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9318522e-1546-4aeb-93a4-22fa06e7c04e None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:13.772413 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9318522e-1546-4aeb-93a4-22fa06e7c04e None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:13.772711 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9318522e-1546-4aeb-93a4-22fa06e7c04e None admin] PATH_INFO: `/v3/users/c0ebfcb519154de5acc86824b2b13261` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:13.779053 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9318522e-1546-4aeb-93a4-22fa06e7c04e None admin] RBAC: Authorizing `identity:get_user(user_id=c0ebfcb519154de5acc86824b2b13261)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:13.780536 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9318522e-1546-4aeb-93a4-22fa06e7c04e None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:13.783073 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 132/263] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Jul 23 20:57:13 2022] GET /identity/v3/users/c0ebfcb519154de5acc86824b2b13261 => generated 283 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:57:13.788252 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9318522e-1546-4aeb-93a4-22fa06e7c04e None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:13.814009 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02bba92-6233-4984-8048-726c2404283e None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:13.851634 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2611c134-48a9-4529-96d8-1101e772a956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:13.852682 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2611c134-48a9-4529-96d8-1101e772a956 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:13.853168 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2611c134-48a9-4529-96d8-1101e772a956 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:13.853645 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2611c134-48a9-4529-96d8-1101e772a956 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:13.932614 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2611c134-48a9-4529-96d8-1101e772a956 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:13.935059 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2611c134-48a9-4529-96d8-1101e772a956 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:13.986268 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:14.000174 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9318522e-1546-4aeb-93a4-22fa06e7c04e None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:14.053829 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 132/264] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Jul 23 20:57:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 23 20:57:14.059188 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2611c134-48a9-4529-96d8-1101e772a956 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:14.068662 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f15502-9837-447d-aecf-8fa75a951506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:14.069031 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f15502-9837-447d-aecf-8fa75a951506 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:14.069199 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f15502-9837-447d-aecf-8fa75a951506 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:14.069478 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f15502-9837-447d-aecf-8fa75a951506 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:14.139578 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:14.213894 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f15502-9837-447d-aecf-8fa75a951506 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:14.213894 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f15502-9837-447d-aecf-8fa75a951506 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:14.214635 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2611c134-48a9-4529-96d8-1101e772a956 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:14.277130 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a05806a-139f-4abd-ab86-82b6b7be9108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:14.278816 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a05806a-139f-4abd-ab86-82b6b7be9108 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:14.279329 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a05806a-139f-4abd-ab86-82b6b7be9108 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:14.279803 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a05806a-139f-4abd-ab86-82b6b7be9108 None admin] PATH_INFO: `/v3/projects/84094ca55a574d84ba5fe544c9d90f50` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:14.282841 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a05806a-139f-4abd-ab86-82b6b7be9108 None admin] RBAC: Authorizing `identity:get_project(project_id=84094ca55a574d84ba5fe544c9d90f50)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:14.284609 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a05806a-139f-4abd-ab86-82b6b7be9108 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:14.289436 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 133/265] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Jul 23 20:57:14 2022] GET /identity/v3/projects/84094ca55a574d84ba5fe544c9d90f50 => generated 302 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:57:14.292624 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a05806a-139f-4abd-ab86-82b6b7be9108 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:14.314261 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:14.456095 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 133/266] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Jul 23 20:57:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 668 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 23 20:57:14.463252 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f15502-9837-447d-aecf-8fa75a951506 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:14.463607 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a05806a-139f-4abd-ab86-82b6b7be9108 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:14.530620 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a70a23c-6807-4730-aec5-7e194e2ff35d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:14.531313 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a70a23c-6807-4730-aec5-7e194e2ff35d None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:14.531602 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a70a23c-6807-4730-aec5-7e194e2ff35d None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:14.531884 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a70a23c-6807-4730-aec5-7e194e2ff35d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:14.532736 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a70a23c-6807-4730-aec5-7e194e2ff35d None admin] RBAC: Adding query filter params (role.id=c5f46541d35e44b691baa7a1fa304c0f, scope.project.id=84094ca55a574d84ba5fe544c9d90f50, user.id=c0ebfcb519154de5acc86824b2b13261) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:57:14.533048 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a70a23c-6807-4730-aec5-7e194e2ff35d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:14.534573 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a70a23c-6807-4730-aec5-7e194e2ff35d None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:14.543138 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 134/267] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Jul 23 20:57:14 2022] GET /identity/v3/role_assignments?user.id=c0ebfcb519154de5acc86824b2b13261&scope.project.id=84094ca55a574d84ba5fe544c9d90f50&role.id=c5f46541d35e44b691baa7a1fa304c0f => generated 608 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 20:57:14.547787 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3286623-a2a2-4434-8e52-d552d2c27065 None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:14.548110 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3286623-a2a2-4434-8e52-d552d2c27065 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:14.548389 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3286623-a2a2-4434-8e52-d552d2c27065 None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:14.549811 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 135/268] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:57:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:57:14.571582 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723e02b3-1778-49b3-926e-844c50a6f026 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:14.571919 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723e02b3-1778-49b3-926e-844c50a6f026 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:14.572141 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723e02b3-1778-49b3-926e-844c50a6f026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:14.600910 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:14.610156 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-723e02b3-1778-49b3-926e-844c50a6f026 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:57:14.611727 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-723e02b3-1778-49b3-926e-844c50a6f026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:57:14.720371 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f15502-9837-447d-aecf-8fa75a951506 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:14.789568 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f76bda8-4d21-4802-b857-7d2271c0e84f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:14.790689 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f76bda8-4d21-4802-b857-7d2271c0e84f None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:14.791033 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f76bda8-4d21-4802-b857-7d2271c0e84f None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:14.791316 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f76bda8-4d21-4802-b857-7d2271c0e84f None admin] PATH_INFO: `/v3/projects/84094ca55a574d84ba5fe544c9d90f50` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:14.792590 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f76bda8-4d21-4802-b857-7d2271c0e84f None admin] RBAC: Authorizing `identity:get_project(project_id=84094ca55a574d84ba5fe544c9d90f50)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:14.794601 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f76bda8-4d21-4802-b857-7d2271c0e84f None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:14.796756 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 134/269] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Jul 23 20:57:14 2022] GET /identity/v3/projects/84094ca55a574d84ba5fe544c9d90f50 => generated 302 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 20:57:14.804760 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f76bda8-4d21-4802-b857-7d2271c0e84f None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:14.809012 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 136/270] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:57:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 23 20:57:14.851858 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723e02b3-1778-49b3-926e-844c50a6f026 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:14.855935 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:15.002311 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f76bda8-4d21-4802-b857-7d2271c0e84f None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:15.070457 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:15.082864 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9cb2e5-e618-4f37-9e3f-f5dc8bdb0cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:15.085365 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9cb2e5-e618-4f37-9e3f-f5dc8bdb0cf6 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:15.085884 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9cb2e5-e618-4f37-9e3f-f5dc8bdb0cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:15.086577 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9cb2e5-e618-4f37-9e3f-f5dc8bdb0cf6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:15.088356 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9cb2e5-e618-4f37-9e3f-f5dc8bdb0cf6 None admin] RBAC: Adding query filter params (role.id=fec17bfdc65349a2b9c06a89131191df, scope.project.id=84094ca55a574d84ba5fe544c9d90f50, user.id=c0ebfcb519154de5acc86824b2b13261) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:57:15.089087 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9cb2e5-e618-4f37-9e3f-f5dc8bdb0cf6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:15.091571 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9cb2e5-e618-4f37-9e3f-f5dc8bdb0cf6 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:15.105801 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 135/271] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Jul 23 20:57:14 2022] GET /identity/v3/role_assignments?user.id=c0ebfcb519154de5acc86824b2b13261&scope.project.id=84094ca55a574d84ba5fe544c9d90f50&role.id=fec17bfdc65349a2b9c06a89131191df => generated 608 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:57:15.121420 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723e02b3-1778-49b3-926e-844c50a6f026 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:15.173663 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792d2b66-2f94-4724-a621-18978da507f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:15.174914 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792d2b66-2f94-4724-a621-18978da507f1 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:15.175400 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792d2b66-2f94-4724-a621-18978da507f1 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:15.175952 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792d2b66-2f94-4724-a621-18978da507f1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:15.191782 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792d2b66-2f94-4724-a621-18978da507f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:57:15.200521 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-792d2b66-2f94-4724-a621-18978da507f1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 23 20:57:15.200521 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:57:15.200521 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:57:15.200521 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:57:15.200521 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:57:15.200521 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:57:15.200521 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:57:15.200521 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:57:15.200521 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:57:15.200521 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:57:15.200521 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:57:15.200521 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:57:15.200521 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:57:15.200521 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:57:15.200521 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:57:15.200521 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:57:15.201473 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:57:15.201473 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:57:15.201473 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:57:15.201473 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:57:15.201473 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:57:15.201473 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:57:15.201473 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:57:15.201473 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:57:15.201473 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:57:15.201473 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:57:15.201473 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:57:15.201473 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application with Lock( Jul 23 20:57:15.201473 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:57:15.201473 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:57:15.201473 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:57:15.201473 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:57:15.202322 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:57:15.202322 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:57:15.202322 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:57:15.202322 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:57:15.202322 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:57:15.202322 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:57:15.202322 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:57:15.202322 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:57:15.202322 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:57:15.202322 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:57:15.202322 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 23 20:57:15.202322 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:57:15.205406 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 137/272] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Jul 23 20:57:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 355 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:57:15.209806 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81504649-b5f7-48fd-848c-3cd9c0a72fff None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:15.210637 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81504649-b5f7-48fd-848c-3cd9c0a72fff None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:15.211160 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81504649-b5f7-48fd-848c-3cd9c0a72fff None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:15.211347 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792d2b66-2f94-4724-a621-18978da507f1 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:15.213228 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 136/273] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:57:15 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:57:15.229695 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aa94d3-4c59-4b5b-9d77-04e4e453cfb3 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:15.230490 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aa94d3-4c59-4b5b-9d77-04e4e453cfb3 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:15.230972 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aa94d3-4c59-4b5b-9d77-04e4e453cfb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:15.262080 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-92aa94d3-4c59-4b5b-9d77-04e4e453cfb3 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:57:15.263995 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-92aa94d3-4c59-4b5b-9d77-04e4e453cfb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:57:15.343794 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:15.354515 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 137/274] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:57:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 23 20:57:15.405291 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aa94d3-4c59-4b5b-9d77-04e4e453cfb3 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:15.425243 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792d2b66-2f94-4724-a621-18978da507f1 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:15.466648 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d4ff2a-20c1-4869-a93b-85df33fd0119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:15.467336 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d4ff2a-20c1-4869-a93b-85df33fd0119 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:15.467781 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d4ff2a-20c1-4869-a93b-85df33fd0119 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:15.468198 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d4ff2a-20c1-4869-a93b-85df33fd0119 None admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:15.469167 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d4ff2a-20c1-4869-a93b-85df33fd0119 None admin] RBAC: Adding query filter params (name=reader) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:57:15.469670 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d4ff2a-20c1-4869-a93b-85df33fd0119 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:15.471273 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d4ff2a-20c1-4869-a93b-85df33fd0119 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:15.481379 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 138/275] 10.222.0.17 () {56 vars in 1101 bytes} [Sat Jul 23 20:57:15 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 20:57:15.483133 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243245b3-508d-43ff-a4c6-250459475b62 None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:15.483646 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243245b3-508d-43ff-a4c6-250459475b62 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:15.483924 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243245b3-508d-43ff-a4c6-250459475b62 None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:15.485415 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 139/276] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:57:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:57:15.487693 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243245b3-508d-43ff-a4c6-250459475b62 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:15.524802 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aa94d3-4c59-4b5b-9d77-04e4e453cfb3 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:15.551414 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:15.565974 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87361459-308a-4abe-87dd-30f765428a27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:15.567060 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87361459-308a-4abe-87dd-30f765428a27 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:15.567340 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87361459-308a-4abe-87dd-30f765428a27 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:15.567609 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87361459-308a-4abe-87dd-30f765428a27 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:15.578504 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87361459-308a-4abe-87dd-30f765428a27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:57:15.586447 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-87361459-308a-4abe-87dd-30f765428a27 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 23 20:57:15.586447 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:57:15.586447 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:57:15.586447 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:57:15.586447 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:57:15.586447 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:57:15.586447 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:57:15.586447 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:57:15.586447 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:57:15.586447 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:57:15.586447 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:57:15.586447 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:57:15.586447 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:57:15.586447 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:57:15.586447 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:57:15.586447 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:57:15.587551 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:57:15.587551 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:57:15.587551 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:57:15.587551 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:57:15.587551 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:57:15.587551 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:57:15.587551 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:57:15.587551 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:57:15.587551 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:57:15.587551 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:57:15.587551 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:57:15.587551 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application with Lock( Jul 23 20:57:15.587551 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:57:15.587551 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:57:15.587551 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:57:15.587551 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:57:15.588436 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:57:15.588436 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:57:15.588436 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:57:15.588436 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:57:15.588436 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:57:15.588436 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:57:15.588436 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:57:15.588436 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:57:15.588436 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:57:15.588436 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:57:15.588436 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 23 20:57:15.588436 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 20:57:15.588436 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 138/277] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Jul 23 20:57:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 23 20:57:15.589073 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74bb5a4-9e30-42e8-906f-6473d4457f71 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:15.589137 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74bb5a4-9e30-42e8-906f-6473d4457f71 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:15.589594 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74bb5a4-9e30-42e8-906f-6473d4457f71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:15.605651 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243245b3-508d-43ff-a4c6-250459475b62 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:15.605836 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-f74bb5a4-9e30-42e8-906f-6473d4457f71 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:57:15.606986 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-f74bb5a4-9e30-42e8-906f-6473d4457f71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:57:15.629218 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:15.641301 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d671eca-016f-4262-84c5-8d729108518d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:15.642228 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d671eca-016f-4262-84c5-8d729108518d None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:15.642504 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d671eca-016f-4262-84c5-8d729108518d None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:15.642771 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d671eca-016f-4262-84c5-8d729108518d None admin] PATH_INFO: `/v3/users/53919da957884590a66f1ce3b3135542` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:15.643958 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d671eca-016f-4262-84c5-8d729108518d None admin] RBAC: Authorizing `identity:get_user(user_id=53919da957884590a66f1ce3b3135542)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:15.645479 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d671eca-016f-4262-84c5-8d729108518d None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:15.647166 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 140/278] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Jul 23 20:57:15 2022] GET /identity/v3/users/53919da957884590a66f1ce3b3135542 => generated 297 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:57:15.648359 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3e80ce-eadb-4af4-8853-71e854e540ee None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:15.648743 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3e80ce-eadb-4af4-8853-71e854e540ee None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:15.649023 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3e80ce-eadb-4af4-8853-71e854e540ee None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:15.650428 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 141/279] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:57:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:57:15.653807 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3e80ce-eadb-4af4-8853-71e854e540ee None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:15.679055 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 139/280] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:57:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 23 20:57:15.679895 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74bb5a4-9e30-42e8-906f-6473d4457f71 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:15.762833 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3e80ce-eadb-4af4-8853-71e854e540ee None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:15.783289 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74bb5a4-9e30-42e8-906f-6473d4457f71 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:15.797459 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:15.799361 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07f4c54-b979-49bf-a48f-dac751dcca26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:15.800093 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07f4c54-b979-49bf-a48f-dac751dcca26 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:15.800389 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07f4c54-b979-49bf-a48f-dac751dcca26 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:15.800717 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07f4c54-b979-49bf-a48f-dac751dcca26 None admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:15.801470 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07f4c54-b979-49bf-a48f-dac751dcca26 None admin] RBAC: Adding query filter params (name=member) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:57:15.801766 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07f4c54-b979-49bf-a48f-dac751dcca26 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:15.803200 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07f4c54-b979-49bf-a48f-dac751dcca26 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:15.812637 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 142/281] 10.222.0.17 () {56 vars in 1101 bytes} [Sat Jul 23 20:57:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:57:15.813732 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7bf048-4278-40f3-a1df-548e62c986ba None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:15.814128 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7bf048-4278-40f3-a1df-548e62c986ba None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:15.814403 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7bf048-4278-40f3-a1df-548e62c986ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:15.824778 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6ed607-fa68-4fdf-b2c6-86a205d8c8e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:15.825671 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6ed607-fa68-4fdf-b2c6-86a205d8c8e2 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:15.825980 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6ed607-fa68-4fdf-b2c6-86a205d8c8e2 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:15.826254 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6ed607-fa68-4fdf-b2c6-86a205d8c8e2 None admin] PATH_INFO: `/v3/projects/84094ca55a574d84ba5fe544c9d90f50` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:15.827445 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6ed607-fa68-4fdf-b2c6-86a205d8c8e2 None admin] RBAC: Authorizing `identity:get_project(project_id=84094ca55a574d84ba5fe544c9d90f50)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:15.828918 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6ed607-fa68-4fdf-b2c6-86a205d8c8e2 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:15.830718 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 140/282] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Jul 23 20:57:15 2022] GET /identity/v3/projects/84094ca55a574d84ba5fe544c9d90f50 => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:57:15.831565 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6ed607-fa68-4fdf-b2c6-86a205d8c8e2 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:15.833895 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-9a7bf048-4278-40f3-a1df-548e62c986ba None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:57:15.836132 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-9a7bf048-4278-40f3-a1df-548e62c986ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:57:15.891600 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:15.909275 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 143/283] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:57:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 23 20:57:15.910185 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7bf048-4278-40f3-a1df-548e62c986ba None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:15.939415 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6ed607-fa68-4fdf-b2c6-86a205d8c8e2 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:15.975470 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9a4e24-c1b9-4f44-a413-9c35dff472a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:15.976284 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9a4e24-c1b9-4f44-a413-9c35dff472a4 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:15.976586 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9a4e24-c1b9-4f44-a413-9c35dff472a4 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:15.976827 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9a4e24-c1b9-4f44-a413-9c35dff472a4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:15.978025 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9a4e24-c1b9-4f44-a413-9c35dff472a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:15.979472 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9a4e24-c1b9-4f44-a413-9c35dff472a4 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:15.981101 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 141/284] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 23 20:57:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:57:15.981832 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9a4e24-c1b9-4f44-a413-9c35dff472a4 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:16.023386 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7bf048-4278-40f3-a1df-548e62c986ba None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:16.032515 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:16.057413 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456b5807-58a5-4cb0-8e6b-d6069b3727b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:16.058232 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456b5807-58a5-4cb0-8e6b-d6069b3727b7 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:16.058508 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456b5807-58a5-4cb0-8e6b-d6069b3727b7 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:16.058775 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456b5807-58a5-4cb0-8e6b-d6069b3727b7 None admin] PATH_INFO: `/v3/users/208db508028341a9a44aacc2ca53c1e8` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:16.071942 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456b5807-58a5-4cb0-8e6b-d6069b3727b7 None admin] RBAC: Authorizing `identity:get_user(user_id=208db508028341a9a44aacc2ca53c1e8)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:16.073421 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456b5807-58a5-4cb0-8e6b-d6069b3727b7 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:16.076300 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 144/285] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Jul 23 20:57:15 2022] GET /identity/v3/users/208db508028341a9a44aacc2ca53c1e8 => generated 293 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:57:16.076300 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456b5807-58a5-4cb0-8e6b-d6069b3727b7 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:16.090972 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9a4e24-c1b9-4f44-a413-9c35dff472a4 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:16.119912 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:16.125395 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7963806b-3cab-4fbb-8695-5f83f00c9ef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:16.126358 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7963806b-3cab-4fbb-8695-5f83f00c9ef1 None admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:16.126630 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7963806b-3cab-4fbb-8695-5f83f00c9ef1 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:16.126902 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7963806b-3cab-4fbb-8695-5f83f00c9ef1 None admin] PATH_INFO: `/v3/projects/84094ca55a574d84ba5fe544c9d90f50/users/53919da957884590a66f1ce3b3135542/roles/5e81c9ea0319460391e21a2a77dd537a` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:16.128973 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7963806b-3cab-4fbb-8695-5f83f00c9ef1 None admin] RBAC: Authorizing `identity:create_grant(project_id=84094ca55a574d84ba5fe544c9d90f50, user_id=53919da957884590a66f1ce3b3135542, role_id=5e81c9ea0319460391e21a2a77dd537a)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:16.130499 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7963806b-3cab-4fbb-8695-5f83f00c9ef1 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:16.147544 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 142/286] 10.222.0.17 () {58 vars in 1439 bytes} [Sat Jul 23 20:57:15 2022] PUT /identity/v3/projects/84094ca55a574d84ba5fe544c9d90f50/users/53919da957884590a66f1ce3b3135542/roles/5e81c9ea0319460391e21a2a77dd537a => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 20:57:16.149159 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7963806b-3cab-4fbb-8695-5f83f00c9ef1 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:16.187558 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456b5807-58a5-4cb0-8e6b-d6069b3727b7 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:16.227982 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b3791c-305d-4d7d-a836-b0031bacc261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:16.228824 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b3791c-305d-4d7d-a836-b0031bacc261 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:16.229685 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b3791c-305d-4d7d-a836-b0031bacc261 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:16.229975 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b3791c-305d-4d7d-a836-b0031bacc261 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:16.242385 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b3791c-305d-4d7d-a836-b0031bacc261 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:57:16.250480 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-f3b3791c-305d-4d7d-a836-b0031bacc261 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 23 20:57:16.250480 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:57:16.250480 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:57:16.250480 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:57:16.250480 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:57:16.250480 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:57:16.250480 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:57:16.250480 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:57:16.250480 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:57:16.250480 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:57:16.250480 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:57:16.250480 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:57:16.250480 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:57:16.250480 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:57:16.250480 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:57:16.250480 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:57:16.251466 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:57:16.251466 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:57:16.251466 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:57:16.251466 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:57:16.251466 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:57:16.251466 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:57:16.251466 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:57:16.251466 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:57:16.251466 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:57:16.251466 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:57:16.251466 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:57:16.251466 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application with Lock( Jul 23 20:57:16.251466 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:57:16.251466 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:57:16.251466 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:57:16.251466 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:57:16.252265 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:57:16.252265 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:57:16.252265 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:57:16.252265 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:57:16.252265 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:57:16.252265 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:57:16.252265 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:57:16.252265 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:57:16.252265 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:57:16.252265 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:57:16.252265 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 23 20:57:16.252265 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:57:16.252265 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 145/287] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Jul 23 20:57:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:57:16.252929 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b3791c-305d-4d7d-a836-b0031bacc261 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:16.276666 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7963806b-3cab-4fbb-8695-5f83f00c9ef1 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:16.288456 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:16.323931 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceea67d-085c-4168-92a0-00aa42ab5ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:16.324518 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceea67d-085c-4168-92a0-00aa42ab5ed0 None admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:16.324797 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceea67d-085c-4168-92a0-00aa42ab5ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:16.325064 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceea67d-085c-4168-92a0-00aa42ab5ed0 None admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:16.325778 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aceea67d-085c-4168-92a0-00aa42ab5ed0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:16.327252 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aceea67d-085c-4168-92a0-00aa42ab5ed0 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:16.354526 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 143/288] 10.222.0.17 () {60 vars in 1132 bytes} [Sat Jul 23 20:57:16 2022] POST /identity/v3/users => generated 293 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 20:57:16.355458 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceea67d-085c-4168-92a0-00aa42ab5ed0 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:16.388318 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b3791c-305d-4d7d-a836-b0031bacc261 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:16.390383 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:16.431475 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cd2dba-15a4-4e5a-9887-34a339e16484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:16.432484 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cd2dba-15a4-4e5a-9887-34a339e16484 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:16.432484 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cd2dba-15a4-4e5a-9887-34a339e16484 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:16.432734 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cd2dba-15a4-4e5a-9887-34a339e16484 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:16.433543 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cd2dba-15a4-4e5a-9887-34a339e16484 None admin] RBAC: Adding query filter params (role.id=14824669685048b38361b1676f7f0f9f, user.id=208db508028341a9a44aacc2ca53c1e8, scope.system=all) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:57:16.433927 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cd2dba-15a4-4e5a-9887-34a339e16484 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:16.435493 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cd2dba-15a4-4e5a-9887-34a339e16484 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:16.441466 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 146/289] 10.222.0.17 () {56 vars in 1308 bytes} [Sat Jul 23 20:57:16 2022] GET /identity/v3/role_assignments?user.id=208db508028341a9a44aacc2ca53c1e8&scope.system=all&role.id=14824669685048b38361b1676f7f0f9f => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:57:16.489902 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceea67d-085c-4168-92a0-00aa42ab5ed0 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:16.532929 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50572d8-8dbf-4c16-b389-c6bda2e4de53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:16.534575 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50572d8-8dbf-4c16-b389-c6bda2e4de53 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:16.535116 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50572d8-8dbf-4c16-b389-c6bda2e4de53 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:16.535587 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50572d8-8dbf-4c16-b389-c6bda2e4de53 None admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:16.536592 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50572d8-8dbf-4c16-b389-c6bda2e4de53 None admin] RBAC: Adding query filter params (name=member) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:57:16.537145 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50572d8-8dbf-4c16-b389-c6bda2e4de53 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:16.538898 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50572d8-8dbf-4c16-b389-c6bda2e4de53 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:16.550467 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 144/290] 10.222.0.17 () {56 vars in 1101 bytes} [Sat Jul 23 20:57:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:57:16.556610 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cd2dba-15a4-4e5a-9887-34a339e16484 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:16.679523 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cd2dba-15a4-4e5a-9887-34a339e16484 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:16.717143 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5660236d-8885-4d2e-a982-a30ab4bc9615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:16.718085 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5660236d-8885-4d2e-a982-a30ab4bc9615 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:16.718367 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5660236d-8885-4d2e-a982-a30ab4bc9615 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:16.718695 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5660236d-8885-4d2e-a982-a30ab4bc9615 None admin] PATH_INFO: `/v3/users/673978868e494152b871ca41585a336c` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:16.719901 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5660236d-8885-4d2e-a982-a30ab4bc9615 None admin] RBAC: Authorizing `identity:get_user(user_id=673978868e494152b871ca41585a336c)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:16.721393 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5660236d-8885-4d2e-a982-a30ab4bc9615 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:16.723525 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 147/291] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Jul 23 20:57:16 2022] GET /identity/v3/users/673978868e494152b871ca41585a336c => generated 297 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 20:57:16.729407 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50572d8-8dbf-4c16-b389-c6bda2e4de53 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:16.765158 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:16.851921 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50572d8-8dbf-4c16-b389-c6bda2e4de53 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:16.888113 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98dd294-d90e-470a-b5d2-23c0d5881588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:16.888781 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98dd294-d90e-470a-b5d2-23c0d5881588 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:16.889092 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98dd294-d90e-470a-b5d2-23c0d5881588 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:16.889326 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98dd294-d90e-470a-b5d2-23c0d5881588 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:16.972198 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98dd294-d90e-470a-b5d2-23c0d5881588 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:16.974851 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98dd294-d90e-470a-b5d2-23c0d5881588 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:17.021505 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:17.146446 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 145/292] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Jul 23 20:57:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 23 20:57:17.153127 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5660236d-8885-4d2e-a982-a30ab4bc9615 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:17.207129 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:17.279175 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5660236d-8885-4d2e-a982-a30ab4bc9615 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:17.323528 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadcaec7-c2ac-4db6-918d-318bf727bbc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:17.324763 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadcaec7-c2ac-4db6-918d-318bf727bbc8 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:17.325211 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadcaec7-c2ac-4db6-918d-318bf727bbc8 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:17.325626 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadcaec7-c2ac-4db6-918d-318bf727bbc8 None admin] PATH_INFO: `/v3/projects/84094ca55a574d84ba5fe544c9d90f50` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:17.327044 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadcaec7-c2ac-4db6-918d-318bf727bbc8 None admin] RBAC: Authorizing `identity:get_project(project_id=84094ca55a574d84ba5fe544c9d90f50)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:17.328683 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadcaec7-c2ac-4db6-918d-318bf727bbc8 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:17.330633 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 148/293] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Jul 23 20:57:17 2022] GET /identity/v3/projects/84094ca55a574d84ba5fe544c9d90f50 => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:57:17.336709 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98dd294-d90e-470a-b5d2-23c0d5881588 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:17.502205 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98dd294-d90e-470a-b5d2-23c0d5881588 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:17.530356 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:17.540780 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaae6d8-6951-415b-9875-bf3a8627066e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:17.542240 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaae6d8-6951-415b-9875-bf3a8627066e None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:17.542661 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaae6d8-6951-415b-9875-bf3a8627066e None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:17.543074 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaae6d8-6951-415b-9875-bf3a8627066e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:17.544049 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaae6d8-6951-415b-9875-bf3a8627066e None admin] RBAC: Adding query filter params (role.id=14824669685048b38361b1676f7f0f9f, scope.project.id=84094ca55a574d84ba5fe544c9d90f50, user.id=673978868e494152b871ca41585a336c) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:57:17.544527 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaae6d8-6951-415b-9875-bf3a8627066e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:17.546147 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaae6d8-6951-415b-9875-bf3a8627066e None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:17.557363 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 146/294] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Jul 23 20:57:17 2022] GET /identity/v3/role_assignments?user.id=673978868e494152b871ca41585a336c&scope.project.id=84094ca55a574d84ba5fe544c9d90f50&role.id=14824669685048b38361b1676f7f0f9f => generated 608 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:57:18.665413 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723503d9-3985-48c7-a872-f4acbbac3e40 None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:18.665977 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723503d9-3985-48c7-a872-f4acbbac3e40 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:18.665977 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723503d9-3985-48c7-a872-f4acbbac3e40 None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:18.667391 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 149/295] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:57:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:57:18.673151 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5e0439-5f35-43d7-8e52-275488d2a2fa None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:18.674081 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5e0439-5f35-43d7-8e52-275488d2a2fa None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:18.674586 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5e0439-5f35-43d7-8e52-275488d2a2fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:18.692748 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-3f5e0439-5f35-43d7-8e52-275488d2a2fa None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:57:18.694316 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-3f5e0439-5f35-43d7-8e52-275488d2a2fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:57:18.770812 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 147/296] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:57:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 23 20:57:18.796880 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723503d9-3985-48c7-a872-f4acbbac3e40 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:18.910274 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723503d9-3985-48c7-a872-f4acbbac3e40 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:18.911802 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:18.946549 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cc5a8b-828b-4463-bb2d-37a8f0cb2702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:18.947279 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cc5a8b-828b-4463-bb2d-37a8f0cb2702 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:18.947556 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cc5a8b-828b-4463-bb2d-37a8f0cb2702 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:18.947826 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cc5a8b-828b-4463-bb2d-37a8f0cb2702 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:18.958542 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cc5a8b-828b-4463-bb2d-37a8f0cb2702 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:57:18.966326 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-84cc5a8b-828b-4463-bb2d-37a8f0cb2702 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 23 20:57:18.966326 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:57:18.966326 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:57:18.966326 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:57:18.966326 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:57:18.966326 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:57:18.966326 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:57:18.966326 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:57:18.966326 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:57:18.966326 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:57:18.966326 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:57:18.966326 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:57:18.966326 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:57:18.966326 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:57:18.966326 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:57:18.966326 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:57:18.967261 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:57:18.967261 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:57:18.967261 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:57:18.967261 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:57:18.967261 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:57:18.967261 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:57:18.967261 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:57:18.967261 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:57:18.967261 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:57:18.967261 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:57:18.967261 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:57:18.967261 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application with Lock( Jul 23 20:57:18.967261 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:57:18.967261 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:57:18.967261 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:57:18.967261 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:57:18.968048 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:57:18.968048 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:57:18.968048 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:57:18.968048 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:57:18.968048 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:57:18.968048 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:57:18.968048 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:57:18.968048 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:57:18.968048 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:57:18.968048 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:57:18.968048 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 23 20:57:18.968048 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:57:18.968048 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 150/297] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Jul 23 20:57:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:57:18.975629 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5e0439-5f35-43d7-8e52-275488d2a2fa None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:19.040845 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407cdc1b-6578-496b-bb3f-2cba60aaf54d None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:19.041176 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407cdc1b-6578-496b-bb3f-2cba60aaf54d None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:19.041387 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407cdc1b-6578-496b-bb3f-2cba60aaf54d None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:19.043367 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 151/298] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:57:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 23 20:57:19.049642 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459a8519-f544-4c08-93dc-9e639c11a46e None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:19.049954 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459a8519-f544-4c08-93dc-9e639c11a46e None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:19.050235 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459a8519-f544-4c08-93dc-9e639c11a46e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:19.071381 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-459a8519-f544-4c08-93dc-9e639c11a46e None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:57:19.072879 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-459a8519-f544-4c08-93dc-9e639c11a46e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:57:19.091529 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5e0439-5f35-43d7-8e52-275488d2a2fa None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:19.114800 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:19.138233 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84a5f33-f80d-419d-9ef3-b284b54bdb38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:19.138921 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84a5f33-f80d-419d-9ef3-b284b54bdb38 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:19.139200 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84a5f33-f80d-419d-9ef3-b284b54bdb38 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:19.139469 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84a5f33-f80d-419d-9ef3-b284b54bdb38 None admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:19.140236 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84a5f33-f80d-419d-9ef3-b284b54bdb38 None admin] RBAC: Adding query filter params (name=reader) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:57:19.140540 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84a5f33-f80d-419d-9ef3-b284b54bdb38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:19.141967 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84a5f33-f80d-419d-9ef3-b284b54bdb38 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:19.150919 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 148/299] 10.222.0.17 () {56 vars in 1101 bytes} [Sat Jul 23 20:57:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:57:19.157472 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84a5f33-f80d-419d-9ef3-b284b54bdb38 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:19.167704 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 152/300] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:57:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 23 20:57:19.189500 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1524a979-71af-4d77-978d-e53438b31fc0 None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:19.189849 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1524a979-71af-4d77-978d-e53438b31fc0 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:19.190088 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1524a979-71af-4d77-978d-e53438b31fc0 None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:19.191683 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 153/301] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:57:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:57:19.192380 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1524a979-71af-4d77-978d-e53438b31fc0 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:19.276976 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84a5f33-f80d-419d-9ef3-b284b54bdb38 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:19.294061 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:19.305183 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1524a979-71af-4d77-978d-e53438b31fc0 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:19.313679 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942816af-5c6e-4a39-a9bd-9cbbce14ccd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:19.314609 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942816af-5c6e-4a39-a9bd-9cbbce14ccd9 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:19.314887 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942816af-5c6e-4a39-a9bd-9cbbce14ccd9 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:19.315157 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942816af-5c6e-4a39-a9bd-9cbbce14ccd9 None admin] PATH_INFO: `/v3/users/53919da957884590a66f1ce3b3135542` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:19.316445 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942816af-5c6e-4a39-a9bd-9cbbce14ccd9 None admin] RBAC: Authorizing `identity:get_user(user_id=53919da957884590a66f1ce3b3135542)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:19.317928 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942816af-5c6e-4a39-a9bd-9cbbce14ccd9 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:19.319584 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 149/302] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Jul 23 20:57:19 2022] GET /identity/v3/users/53919da957884590a66f1ce3b3135542 => generated 297 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:57:19.324244 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70d2603-c11a-4354-b4ff-899efd966d25 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:19.324244 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70d2603-c11a-4354-b4ff-899efd966d25 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:19.324244 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70d2603-c11a-4354-b4ff-899efd966d25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:19.338857 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-e70d2603-c11a-4354-b4ff-899efd966d25 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:57:19.340036 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-e70d2603-c11a-4354-b4ff-899efd966d25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:57:19.346901 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29835c74-2d67-422e-b535-993b2a862a83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:19.347985 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29835c74-2d67-422e-b535-993b2a862a83 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:19.348408 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29835c74-2d67-422e-b535-993b2a862a83 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:19.348820 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29835c74-2d67-422e-b535-993b2a862a83 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:19.360277 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29835c74-2d67-422e-b535-993b2a862a83 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:57:19.368423 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-29835c74-2d67-422e-b535-993b2a862a83 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 23 20:57:19.368423 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:57:19.368423 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:57:19.368423 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:57:19.368423 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:57:19.368423 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:57:19.368423 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:57:19.368423 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:57:19.368423 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:57:19.368423 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:57:19.368423 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:57:19.368423 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:57:19.368423 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:57:19.368423 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:57:19.368423 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:57:19.368423 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:57:19.369495 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:57:19.369495 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:57:19.369495 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:57:19.369495 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:57:19.369495 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:57:19.369495 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:57:19.369495 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:57:19.369495 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:57:19.369495 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:57:19.369495 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:57:19.369495 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:57:19.369495 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application with Lock( Jul 23 20:57:19.369495 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:57:19.369495 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:57:19.369495 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:57:19.369495 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:57:19.370380 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:57:19.370380 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:57:19.370380 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:57:19.370380 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:57:19.370380 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:57:19.370380 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:57:19.370380 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:57:19.370380 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:57:19.370380 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:57:19.370380 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:57:19.370380 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 23 20:57:19.370380 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:57:19.371294 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 154/303] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Jul 23 20:57:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:57:19.372128 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29835c74-2d67-422e-b535-993b2a862a83 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:19.399055 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:19.421694 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 150/304] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:57:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 23 20:57:19.422800 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70d2603-c11a-4354-b4ff-899efd966d25 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:19.490622 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29835c74-2d67-422e-b535-993b2a862a83 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:19.526948 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3536d2a9-e231-44f7-aa85-9ed8b8b3caff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:19.527658 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3536d2a9-e231-44f7-aa85-9ed8b8b3caff None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:19.527761 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70d2603-c11a-4354-b4ff-899efd966d25 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:19.527892 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3536d2a9-e231-44f7-aa85-9ed8b8b3caff None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:19.528173 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3536d2a9-e231-44f7-aa85-9ed8b8b3caff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:19.549727 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:19.565130 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428d0686-05d5-4003-93fa-23494fa28755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:19.565817 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428d0686-05d5-4003-93fa-23494fa28755 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:19.566136 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428d0686-05d5-4003-93fa-23494fa28755 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:19.566405 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428d0686-05d5-4003-93fa-23494fa28755 None admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:19.567160 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428d0686-05d5-4003-93fa-23494fa28755 None admin] RBAC: Adding query filter params (name=member) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:57:19.567461 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428d0686-05d5-4003-93fa-23494fa28755 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:19.568844 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428d0686-05d5-4003-93fa-23494fa28755 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:19.577108 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 151/305] 10.222.0.17 () {56 vars in 1101 bytes} [Sat Jul 23 20:57:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:57:19.578456 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b057552-c82f-43a6-b71c-0f283f4be9cc None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:19.578741 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b057552-c82f-43a6-b71c-0f283f4be9cc None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:19.579018 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b057552-c82f-43a6-b71c-0f283f4be9cc None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:19.581936 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 152/306] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:57:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:57:19.581936 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b057552-c82f-43a6-b71c-0f283f4be9cc None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:19.600944 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3536d2a9-e231-44f7-aa85-9ed8b8b3caff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:19.602465 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3536d2a9-e231-44f7-aa85-9ed8b8b3caff None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:19.624799 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:19.693729 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b057552-c82f-43a6-b71c-0f283f4be9cc None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:19.715019 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 155/307] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Jul 23 20:57:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 23 20:57:19.715883 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3536d2a9-e231-44f7-aa85-9ed8b8b3caff None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:19.729925 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05867c6e-b82e-4847-8763-96c081564c22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:19.730743 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05867c6e-b82e-4847-8763-96c081564c22 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:19.731022 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05867c6e-b82e-4847-8763-96c081564c22 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:19.731287 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05867c6e-b82e-4847-8763-96c081564c22 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:19.742322 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05867c6e-b82e-4847-8763-96c081564c22 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:57:19.751055 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-05867c6e-b82e-4847-8763-96c081564c22 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 23 20:57:19.751055 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:57:19.751055 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:57:19.751055 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:57:19.751055 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:57:19.751055 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:57:19.751055 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:57:19.751055 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:57:19.751055 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:57:19.751055 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:57:19.751055 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:57:19.751055 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:57:19.751055 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:57:19.751055 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:57:19.751055 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:57:19.751055 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:57:19.751980 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:57:19.751980 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:57:19.751980 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:57:19.751980 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:57:19.751980 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:57:19.751980 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:57:19.751980 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:57:19.751980 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:57:19.751980 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:57:19.751980 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:57:19.751980 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:57:19.751980 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application with Lock( Jul 23 20:57:19.751980 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:57:19.751980 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:57:19.751980 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:57:19.751980 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:57:19.752756 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:57:19.752756 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:57:19.752756 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:57:19.752756 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:57:19.752756 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:57:19.752756 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:57:19.752756 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:57:19.752756 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:57:19.752756 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:57:19.752756 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:57:19.752756 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 23 20:57:19.752756 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 20:57:19.752756 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 153/308] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Jul 23 20:57:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:57:19.753927 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7805d7-bf85-4caa-835a-43b480993ea7 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:19.754038 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7805d7-bf85-4caa-835a-43b480993ea7 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:19.754326 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7805d7-bf85-4caa-835a-43b480993ea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:19.770937 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:19.771111 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-4d7805d7-bf85-4caa-835a-43b480993ea7 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:57:19.772751 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-4d7805d7-bf85-4caa-835a-43b480993ea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:57:19.822924 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3536d2a9-e231-44f7-aa85-9ed8b8b3caff None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:19.839233 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 154/309] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:57:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 23 20:57:19.839967 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7805d7-bf85-4caa-835a-43b480993ea7 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:19.864861 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f88677d-9d4a-4e16-8dd9-7a314a8728c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:19.865842 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f88677d-9d4a-4e16-8dd9-7a314a8728c2 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:19.866153 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f88677d-9d4a-4e16-8dd9-7a314a8728c2 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:19.866426 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f88677d-9d4a-4e16-8dd9-7a314a8728c2 None admin] PATH_INFO: `/v3/users/208db508028341a9a44aacc2ca53c1e8` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:19.867659 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f88677d-9d4a-4e16-8dd9-7a314a8728c2 None admin] RBAC: Authorizing `identity:get_user(user_id=208db508028341a9a44aacc2ca53c1e8)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:19.869119 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f88677d-9d4a-4e16-8dd9-7a314a8728c2 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:19.870802 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 156/310] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Jul 23 20:57:19 2022] GET /identity/v3/users/208db508028341a9a44aacc2ca53c1e8 => generated 293 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:57:19.871562 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f88677d-9d4a-4e16-8dd9-7a314a8728c2 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:19.876046 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:19.942324 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7805d7-bf85-4caa-835a-43b480993ea7 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:19.973977 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f88677d-9d4a-4e16-8dd9-7a314a8728c2 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:19.977614 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14d425b-00ae-41cc-9c13-a1e587b3e02c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:19.978533 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14d425b-00ae-41cc-9c13-a1e587b3e02c None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:19.978808 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14d425b-00ae-41cc-9c13-a1e587b3e02c None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:19.979073 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14d425b-00ae-41cc-9c13-a1e587b3e02c None admin] PATH_INFO: `/v3/projects/84094ca55a574d84ba5fe544c9d90f50` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:19.980329 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14d425b-00ae-41cc-9c13-a1e587b3e02c None admin] RBAC: Authorizing `identity:get_project(project_id=84094ca55a574d84ba5fe544c9d90f50)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:19.981772 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14d425b-00ae-41cc-9c13-a1e587b3e02c None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:19.983501 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 155/311] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Jul 23 20:57:19 2022] GET /identity/v3/projects/84094ca55a574d84ba5fe544c9d90f50 => generated 302 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:57:19.984256 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14d425b-00ae-41cc-9c13-a1e587b3e02c None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:19.996081 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:20.011240 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91df3b7e-50c9-4c2b-87e0-0e97b9130b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:20.011916 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91df3b7e-50c9-4c2b-87e0-0e97b9130b53 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:20.012192 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91df3b7e-50c9-4c2b-87e0-0e97b9130b53 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:20.012462 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91df3b7e-50c9-4c2b-87e0-0e97b9130b53 None admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:20.013207 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91df3b7e-50c9-4c2b-87e0-0e97b9130b53 None admin] RBAC: Adding query filter params (name=reader) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:57:20.013507 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91df3b7e-50c9-4c2b-87e0-0e97b9130b53 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:20.014953 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91df3b7e-50c9-4c2b-87e0-0e97b9130b53 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:20.023075 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 157/312] 10.222.0.17 () {56 vars in 1101 bytes} [Sat Jul 23 20:57:19 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:57:20.023836 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91df3b7e-50c9-4c2b-87e0-0e97b9130b53 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:20.089500 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:20.093148 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14d425b-00ae-41cc-9c13-a1e587b3e02c None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:20.123452 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91df3b7e-50c9-4c2b-87e0-0e97b9130b53 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:20.127961 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9485cd49-07c8-469b-94e2-9fbdb108b6c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:20.128831 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9485cd49-07c8-469b-94e2-9fbdb108b6c7 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:20.129723 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9485cd49-07c8-469b-94e2-9fbdb108b6c7 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:20.130033 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9485cd49-07c8-469b-94e2-9fbdb108b6c7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:20.131274 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9485cd49-07c8-469b-94e2-9fbdb108b6c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:20.132931 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9485cd49-07c8-469b-94e2-9fbdb108b6c7 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:20.134875 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 156/313] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 23 20:57:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:57:20.135644 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9485cd49-07c8-469b-94e2-9fbdb108b6c7 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:20.160680 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce21100-4226-42e5-af1c-f2575e99cb5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:20.161561 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce21100-4226-42e5-af1c-f2575e99cb5c None admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:20.161841 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce21100-4226-42e5-af1c-f2575e99cb5c None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:20.162140 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce21100-4226-42e5-af1c-f2575e99cb5c None admin] PATH_INFO: `/v3/system/users/208db508028341a9a44aacc2ca53c1e8/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:20.163644 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce21100-4226-42e5-af1c-f2575e99cb5c None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=208db508028341a9a44aacc2ca53c1e8, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:20.165054 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce21100-4226-42e5-af1c-f2575e99cb5c None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:20.174168 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 158/314] 10.222.0.17 () {58 vars in 1334 bytes} [Sat Jul 23 20:57:20 2022] PUT /identity/v3/system/users/208db508028341a9a44aacc2ca53c1e8/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 20:57:20.175130 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce21100-4226-42e5-af1c-f2575e99cb5c None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:20.228405 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:20.274176 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9485cd49-07c8-469b-94e2-9fbdb108b6c7 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:20.292881 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce21100-4226-42e5-af1c-f2575e99cb5c None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:20.311611 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef00154-6fb0-4dae-aa36-1dac039a11dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:20.312294 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef00154-6fb0-4dae-aa36-1dac039a11dc None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:20.312553 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef00154-6fb0-4dae-aa36-1dac039a11dc None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:20.312827 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef00154-6fb0-4dae-aa36-1dac039a11dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:20.313657 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef00154-6fb0-4dae-aa36-1dac039a11dc None admin] RBAC: Adding query filter params (role.id=5e81c9ea0319460391e21a2a77dd537a, scope.project.id=84094ca55a574d84ba5fe544c9d90f50, user.id=53919da957884590a66f1ce3b3135542) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:57:20.313992 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef00154-6fb0-4dae-aa36-1dac039a11dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:20.315468 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef00154-6fb0-4dae-aa36-1dac039a11dc None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:20.322345 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 157/315] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Jul 23 20:57:20 2022] GET /identity/v3/role_assignments?user.id=53919da957884590a66f1ce3b3135542&scope.project.id=84094ca55a574d84ba5fe544c9d90f50&role.id=5e81c9ea0319460391e21a2a77dd537a => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:57:20.323009 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef00154-6fb0-4dae-aa36-1dac039a11dc None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:20.329781 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e133ce-c215-482a-89e0-677fb684afa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:20.332312 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e133ce-c215-482a-89e0-677fb684afa4 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:20.332594 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e133ce-c215-482a-89e0-677fb684afa4 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:20.332869 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e133ce-c215-482a-89e0-677fb684afa4 None admin] PATH_INFO: `/v3/users/dd356dbc3e684ce087c51a392e5a89a8` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:20.353356 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e133ce-c215-482a-89e0-677fb684afa4 None admin] RBAC: Authorizing `identity:get_user(user_id=dd356dbc3e684ce087c51a392e5a89a8)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:20.355702 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e133ce-c215-482a-89e0-677fb684afa4 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:20.357971 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 159/316] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Jul 23 20:57:20 2022] GET /identity/v3/users/dd356dbc3e684ce087c51a392e5a89a8 => generated 293 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:57:20.364995 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e133ce-c215-482a-89e0-677fb684afa4 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:20.368975 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:20.465932 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef00154-6fb0-4dae-aa36-1dac039a11dc None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:20.502440 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e133ce-c215-482a-89e0-677fb684afa4 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:20.505474 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:20.508419 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26393e19-9356-40ba-95aa-d83dc6d539aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:20.509353 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26393e19-9356-40ba-95aa-d83dc6d539aa None admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:20.510023 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26393e19-9356-40ba-95aa-d83dc6d539aa None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:20.510479 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26393e19-9356-40ba-95aa-d83dc6d539aa None admin] PATH_INFO: `/v3/groups` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:20.512113 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26393e19-9356-40ba-95aa-d83dc6d539aa None admin] RBAC: Authorizing `identity:create_group()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:20.513964 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26393e19-9356-40ba-95aa-d83dc6d539aa None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:20.534287 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 158/317] 10.222.0.17 () {60 vars in 1134 bytes} [Sat Jul 23 20:57:20 2022] POST /identity/v3/groups => generated 229 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 20:57:20.552583 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f463dcda-8a1f-4710-a62b-2bece8ba5eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:20.553273 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f463dcda-8a1f-4710-a62b-2bece8ba5eca None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:20.553547 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f463dcda-8a1f-4710-a62b-2bece8ba5eca None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:20.553816 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f463dcda-8a1f-4710-a62b-2bece8ba5eca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:20.554696 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f463dcda-8a1f-4710-a62b-2bece8ba5eca None admin] RBAC: Adding query filter params (role.id=5e81c9ea0319460391e21a2a77dd537a, user.id=dd356dbc3e684ce087c51a392e5a89a8, scope.system=all) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:57:20.555025 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f463dcda-8a1f-4710-a62b-2bece8ba5eca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:20.556517 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f463dcda-8a1f-4710-a62b-2bece8ba5eca None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:20.563215 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 160/318] 10.222.0.17 () {56 vars in 1308 bytes} [Sat Jul 23 20:57:20 2022] GET /identity/v3/role_assignments?user.id=dd356dbc3e684ce087c51a392e5a89a8&scope.system=all&role.id=5e81c9ea0319460391e21a2a77dd537a => generated 226 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:57:22.495353 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62889bd-dfef-4f84-8482-e20456d87a37 None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:22.495971 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62889bd-dfef-4f84-8482-e20456d87a37 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:22.495971 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62889bd-dfef-4f84-8482-e20456d87a37 None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:22.497353 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 159/319] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:57:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:57:22.502960 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07161233-9568-4919-bde4-8af0eebaa345 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:22.503395 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07161233-9568-4919-bde4-8af0eebaa345 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:22.503543 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07161233-9568-4919-bde4-8af0eebaa345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:22.520628 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-07161233-9568-4919-bde4-8af0eebaa345 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:57:22.522263 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-07161233-9568-4919-bde4-8af0eebaa345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:57:22.589828 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 161/320] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:57:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 23 20:57:22.614152 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62889bd-dfef-4f84-8482-e20456d87a37 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:22.724035 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:22.735825 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62889bd-dfef-4f84-8482-e20456d87a37 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:22.769335 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4415f12f-56c9-48f9-87fd-e28cf6359cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:22.770184 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4415f12f-56c9-48f9-87fd-e28cf6359cbc None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:22.770463 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4415f12f-56c9-48f9-87fd-e28cf6359cbc None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:22.770731 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4415f12f-56c9-48f9-87fd-e28cf6359cbc None admin] PATH_INFO: `/v3/roles/member` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:22.781742 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4415f12f-56c9-48f9-87fd-e28cf6359cbc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:57:22.789688 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-4415f12f-56c9-48f9-87fd-e28cf6359cbc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 23 20:57:22.789688 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:57:22.789688 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:57:22.789688 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:57:22.789688 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:57:22.789688 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:57:22.789688 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:57:22.789688 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:57:22.789688 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:57:22.789688 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:57:22.789688 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:57:22.789688 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:57:22.789688 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:57:22.789688 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:57:22.789688 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:57:22.789688 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:57:22.790743 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:57:22.790743 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:57:22.790743 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:57:22.790743 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:57:22.790743 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:57:22.790743 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:57:22.790743 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:57:22.790743 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:57:22.790743 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:57:22.790743 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:57:22.790743 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:57:22.790743 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application with Lock( Jul 23 20:57:22.790743 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:57:22.790743 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:57:22.790743 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:57:22.790743 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:57:22.796739 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:57:22.796739 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:57:22.796739 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:57:22.796739 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:57:22.796739 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:57:22.796739 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:57:22.796739 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:57:22.796739 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:57:22.796739 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:57:22.796739 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:57:22.796739 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 23 20:57:22.796739 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 20:57:22.796739 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 160/321] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Jul 23 20:57:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:57:22.798473 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07161233-9568-4919-bde4-8af0eebaa345 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:22.819885 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065d4df5-5c31-405e-9a19-1416bdf5b946 None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:22.819885 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065d4df5-5c31-405e-9a19-1416bdf5b946 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:22.820133 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065d4df5-5c31-405e-9a19-1416bdf5b946 None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:22.821788 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 161/322] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:57:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:57:22.826937 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14a5588-e1f5-4d4f-9bce-e2c4a124961c None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:22.827206 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14a5588-e1f5-4d4f-9bce-e2c4a124961c None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:22.827477 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14a5588-e1f5-4d4f-9bce-e2c4a124961c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:22.844265 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-a14a5588-e1f5-4d4f-9bce-e2c4a124961c None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:57:22.845439 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-a14a5588-e1f5-4d4f-9bce-e2c4a124961c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:57:22.907756 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:22.911895 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07161233-9568-4919-bde4-8af0eebaa345 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:22.913088 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 162/323] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:57:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 23 20:57:22.914456 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba8d6e2-501b-444a-a22f-6984ed90494d None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:22.914732 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba8d6e2-501b-444a-a22f-6984ed90494d None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:22.914983 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba8d6e2-501b-444a-a22f-6984ed90494d None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:22.916240 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 163/324] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:57:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:57:22.921500 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf135de-be9d-438c-b43d-50626daa652d None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:22.921779 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf135de-be9d-438c-b43d-50626daa652d None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:22.922085 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf135de-be9d-438c-b43d-50626daa652d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:22.939963 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-bdf135de-be9d-438c-b43d-50626daa652d None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:57:22.941168 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-bdf135de-be9d-438c-b43d-50626daa652d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:57:22.950505 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3cbd13-316d-4c98-acbd-027278c0a228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:22.951186 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3cbd13-316d-4c98-acbd-027278c0a228 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:22.951466 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3cbd13-316d-4c98-acbd-027278c0a228 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:22.951736 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3cbd13-316d-4c98-acbd-027278c0a228 None admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:22.952489 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3cbd13-316d-4c98-acbd-027278c0a228 None admin] RBAC: Adding query filter params (name=member) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:57:22.952803 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3cbd13-316d-4c98-acbd-027278c0a228 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:22.954205 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3cbd13-316d-4c98-acbd-027278c0a228 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:22.962570 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 162/325] 10.222.0.17 () {56 vars in 1101 bytes} [Sat Jul 23 20:57:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:57:22.963456 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3cbd13-316d-4c98-acbd-027278c0a228 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:23.015544 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 164/326] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:57:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 23 20:57:23.016387 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf135de-be9d-438c-b43d-50626daa652d None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:23.031831 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:23.072793 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3cbd13-316d-4c98-acbd-027278c0a228 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:23.107596 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fba942-995f-4605-9b00-447a528b54e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:23.108408 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fba942-995f-4605-9b00-447a528b54e5 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:23.108685 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fba942-995f-4605-9b00-447a528b54e5 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:23.108955 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fba942-995f-4605-9b00-447a528b54e5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:23.119618 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fba942-995f-4605-9b00-447a528b54e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:57:23.121815 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf135de-be9d-438c-b43d-50626daa652d None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:23.127403 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-e3fba942-995f-4605-9b00-447a528b54e5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 23 20:57:23.127403 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:57:23.127403 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:57:23.127403 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:57:23.127403 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:57:23.127403 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:57:23.127403 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:57:23.127403 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:57:23.127403 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:57:23.127403 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:57:23.127403 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:57:23.127403 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:57:23.127403 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:57:23.127403 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:57:23.127403 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:57:23.127403 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:57:23.129301 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:57:23.129301 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:57:23.129301 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:57:23.129301 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:57:23.129301 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:57:23.129301 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:57:23.129301 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:57:23.129301 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:57:23.129301 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:57:23.129301 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:57:23.129301 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:57:23.129301 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application with Lock( Jul 23 20:57:23.129301 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:57:23.129301 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:57:23.129301 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:57:23.129301 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:57:23.131066 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:57:23.131066 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:57:23.131066 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:57:23.131066 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:57:23.131066 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:57:23.131066 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:57:23.131066 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:57:23.131066 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:57:23.131066 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:57:23.131066 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:57:23.131066 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 23 20:57:23.131066 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:57:23.131066 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 163/327] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Jul 23 20:57:22 2022] GET /identity/v3/roles/reader => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:57:23.131066 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fba942-995f-4605-9b00-447a528b54e5 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:23.153175 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:23.164371 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15813820-fcfb-4d67-b7b4-b7338218e053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:23.165244 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15813820-fcfb-4d67-b7b4-b7338218e053 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:23.165516 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15813820-fcfb-4d67-b7b4-b7338218e053 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:23.166127 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15813820-fcfb-4d67-b7b4-b7338218e053 None admin] PATH_INFO: `/v3/users/208db508028341a9a44aacc2ca53c1e8` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:23.167105 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15813820-fcfb-4d67-b7b4-b7338218e053 None admin] RBAC: Authorizing `identity:get_user(user_id=208db508028341a9a44aacc2ca53c1e8)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:23.168578 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15813820-fcfb-4d67-b7b4-b7338218e053 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:23.170281 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 165/328] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Jul 23 20:57:23 2022] GET /identity/v3/users/208db508028341a9a44aacc2ca53c1e8 => generated 293 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:57:23.171059 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15813820-fcfb-4d67-b7b4-b7338218e053 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:23.235864 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fba942-995f-4605-9b00-447a528b54e5 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:23.257267 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:23.276770 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce8b3e7-f878-426c-b2b7-ae5e023b858f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:23.277583 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce8b3e7-f878-426c-b2b7-ae5e023b858f None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:23.277827 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce8b3e7-f878-426c-b2b7-ae5e023b858f None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:23.278170 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce8b3e7-f878-426c-b2b7-ae5e023b858f None admin] PATH_INFO: `/v3/domains/default` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:23.279735 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce8b3e7-f878-426c-b2b7-ae5e023b858f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:23.281208 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce8b3e7-f878-426c-b2b7-ae5e023b858f None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:23.287704 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 164/329] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 23 20:57:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:57:23.287704 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce8b3e7-f878-426c-b2b7-ae5e023b858f None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:23.290035 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15813820-fcfb-4d67-b7b4-b7338218e053 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:23.328347 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee502a30-94d6-43dc-af2f-e51f40fd8a8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:23.329002 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee502a30-94d6-43dc-af2f-e51f40fd8a8f None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:23.329264 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee502a30-94d6-43dc-af2f-e51f40fd8a8f None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:23.329536 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee502a30-94d6-43dc-af2f-e51f40fd8a8f None admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:23.330384 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee502a30-94d6-43dc-af2f-e51f40fd8a8f None admin] RBAC: Adding query filter params (name=reader) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:57:23.330715 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee502a30-94d6-43dc-af2f-e51f40fd8a8f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:23.332141 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee502a30-94d6-43dc-af2f-e51f40fd8a8f None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:23.341943 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 166/330] 10.222.0.17 () {56 vars in 1101 bytes} [Sat Jul 23 20:57:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:57:23.342648 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee502a30-94d6-43dc-af2f-e51f40fd8a8f None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:23.399589 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:23.416196 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce8b3e7-f878-426c-b2b7-ae5e023b858f None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:23.455704 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f107ac-85f5-4ad3-93b8-7ab5f02ab7c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:23.456404 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f107ac-85f5-4ad3-93b8-7ab5f02ab7c5 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:23.456682 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f107ac-85f5-4ad3-93b8-7ab5f02ab7c5 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:23.456884 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee502a30-94d6-43dc-af2f-e51f40fd8a8f None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:23.456995 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f107ac-85f5-4ad3-93b8-7ab5f02ab7c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:23.457830 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f107ac-85f5-4ad3-93b8-7ab5f02ab7c5 None admin] RBAC: Adding query filter params (role.id=14824669685048b38361b1676f7f0f9f, user.id=208db508028341a9a44aacc2ca53c1e8, scope.system=all) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:57:23.458167 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f107ac-85f5-4ad3-93b8-7ab5f02ab7c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:23.459635 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f107ac-85f5-4ad3-93b8-7ab5f02ab7c5 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:23.473153 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 165/331] 10.222.0.17 () {56 vars in 1308 bytes} [Sat Jul 23 20:57:23 2022] GET /identity/v3/role_assignments?user.id=208db508028341a9a44aacc2ca53c1e8&scope.system=all&role.id=14824669685048b38361b1676f7f0f9f => generated 510 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:57:23.474398 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f107ac-85f5-4ad3-93b8-7ab5f02ab7c5 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:23.511082 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cae542-bcf2-4b65-a5b8-59530f5cf45d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:23.512241 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cae542-bcf2-4b65-a5b8-59530f5cf45d None admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:23.512615 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cae542-bcf2-4b65-a5b8-59530f5cf45d None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:23.512985 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cae542-bcf2-4b65-a5b8-59530f5cf45d None admin] PATH_INFO: `/v3/groups` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:23.514293 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cae542-bcf2-4b65-a5b8-59530f5cf45d None admin] RBAC: Authorizing `identity:create_group()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:23.515927 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cae542-bcf2-4b65-a5b8-59530f5cf45d None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:23.546618 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 167/332] 10.222.0.17 () {60 vars in 1134 bytes} [Sat Jul 23 20:57:23 2022] POST /identity/v3/groups => generated 226 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 20:57:23.600881 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f107ac-85f5-4ad3-93b8-7ab5f02ab7c5 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:23.648883 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5168c8b-7f46-42cc-961e-ef98b37308d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:23.649812 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5168c8b-7f46-42cc-961e-ef98b37308d8 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:23.650124 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5168c8b-7f46-42cc-961e-ef98b37308d8 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:23.650396 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5168c8b-7f46-42cc-961e-ef98b37308d8 None admin] PATH_INFO: `/v3/users/dd356dbc3e684ce087c51a392e5a89a8` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:23.651797 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5168c8b-7f46-42cc-961e-ef98b37308d8 None admin] RBAC: Authorizing `identity:get_user(user_id=dd356dbc3e684ce087c51a392e5a89a8)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:23.653673 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5168c8b-7f46-42cc-961e-ef98b37308d8 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:23.655778 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 166/333] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Jul 23 20:57:23 2022] GET /identity/v3/users/dd356dbc3e684ce087c51a392e5a89a8 => generated 293 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:57:23.661816 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cae542-bcf2-4b65-a5b8-59530f5cf45d None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:23.666229 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:23.783612 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cae542-bcf2-4b65-a5b8-59530f5cf45d None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:23.821980 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef5bc09-fb1f-4473-be27-8b94bf42d4cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:23.822766 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef5bc09-fb1f-4473-be27-8b94bf42d4cc None admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:23.823048 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef5bc09-fb1f-4473-be27-8b94bf42d4cc None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:23.823324 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef5bc09-fb1f-4473-be27-8b94bf42d4cc None admin] PATH_INFO: `/v3/system/users/dd356dbc3e684ce087c51a392e5a89a8/roles/5e81c9ea0319460391e21a2a77dd537a` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:23.826003 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef5bc09-fb1f-4473-be27-8b94bf42d4cc None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=dd356dbc3e684ce087c51a392e5a89a8, role_id=5e81c9ea0319460391e21a2a77dd537a)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:23.827487 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef5bc09-fb1f-4473-be27-8b94bf42d4cc None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:23.839241 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 168/334] 10.222.0.17 () {58 vars in 1334 bytes} [Sat Jul 23 20:57:23 2022] PUT /identity/v3/system/users/dd356dbc3e684ce087c51a392e5a89a8/roles/5e81c9ea0319460391e21a2a77dd537a => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 20:57:26.420449 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8599ee-f551-4122-bd8f-af020ea998a3 None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:26.421394 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8599ee-f551-4122-bd8f-af020ea998a3 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:26.421856 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8599ee-f551-4122-bd8f-af020ea998a3 None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:26.423761 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 167/335] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:57:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:57:26.429042 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13b0ba0-2be6-4163-9ec0-e4119579adb7 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:26.429519 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13b0ba0-2be6-4163-9ec0-e4119579adb7 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:26.429740 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13b0ba0-2be6-4163-9ec0-e4119579adb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:26.454985 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-f13b0ba0-2be6-4163-9ec0-e4119579adb7 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:57:26.456195 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-f13b0ba0-2be6-4163-9ec0-e4119579adb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:57:26.516069 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f360b930-b202-4c02-abef-d5a18b323991 None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:26.516404 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f360b930-b202-4c02-abef-d5a18b323991 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:26.516616 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f360b930-b202-4c02-abef-d5a18b323991 None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:26.518284 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 168/336] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:57:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:57:26.527662 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1ddda2-6a71-4b3b-a7dd-ce494c2fb0aa None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:26.527938 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1ddda2-6a71-4b3b-a7dd-ce494c2fb0aa None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:26.528746 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1ddda2-6a71-4b3b-a7dd-ce494c2fb0aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:26.532351 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:26.548487 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 169/337] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:57:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 23 20:57:26.551210 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a922ec23-91a2-4ea3-9595-49c4e5e5bef3 None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:26.551210 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a922ec23-91a2-4ea3-9595-49c4e5e5bef3 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:26.551210 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a922ec23-91a2-4ea3-9595-49c4e5e5bef3 None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:26.552560 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 170/338] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:57:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:57:26.563134 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6685eeeb-4cc6-4db9-9230-6c8ae05f1901 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:26.563486 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6685eeeb-4cc6-4db9-9230-6c8ae05f1901 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:26.563684 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6685eeeb-4cc6-4db9-9230-6c8ae05f1901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:26.565964 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-ba1ddda2-6a71-4b3b-a7dd-ce494c2fb0aa None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:57:26.567328 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-ba1ddda2-6a71-4b3b-a7dd-ce494c2fb0aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:57:26.583090 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:26.592318 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-6685eeeb-4cc6-4db9-9230-6c8ae05f1901 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:57:26.593443 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-6685eeeb-4cc6-4db9-9230-6c8ae05f1901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:57:26.669854 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 169/339] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:57:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 23 20:57:26.670669 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1ddda2-6a71-4b3b-a7dd-ce494c2fb0aa None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:26.727986 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 171/340] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:57:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 23 20:57:26.734927 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6685eeeb-4cc6-4db9-9230-6c8ae05f1901 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:26.824848 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1ddda2-6a71-4b3b-a7dd-ce494c2fb0aa None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:26.878559 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b98094-5757-47bc-9bfc-1f385c650fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:26.880870 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b98094-5757-47bc-9bfc-1f385c650fcf None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:26.881380 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b98094-5757-47bc-9bfc-1f385c650fcf None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:26.881836 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b98094-5757-47bc-9bfc-1f385c650fcf None admin] PATH_INFO: `/v3/roles/member` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:26.882219 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6685eeeb-4cc6-4db9-9230-6c8ae05f1901 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:26.906820 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b98094-5757-47bc-9bfc-1f385c650fcf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:57:26.919026 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:26.922485 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-d3b98094-5757-47bc-9bfc-1f385c650fcf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 23 20:57:26.922485 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:57:26.922485 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:57:26.922485 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:57:26.922485 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:57:26.922485 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:57:26.922485 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:57:26.922485 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:57:26.922485 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:57:26.922485 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:57:26.922485 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:57:26.922485 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:57:26.922485 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:57:26.922485 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:57:26.922485 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:57:26.922485 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:57:26.923356 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:57:26.923356 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:57:26.923356 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:57:26.923356 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:57:26.923356 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:57:26.923356 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:57:26.923356 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:57:26.923356 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:57:26.923356 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:57:26.923356 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:57:26.923356 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:57:26.923356 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application with Lock( Jul 23 20:57:26.923356 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:57:26.923356 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:57:26.923356 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:57:26.923356 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:57:26.924144 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:57:26.924144 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:57:26.924144 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:57:26.924144 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:57:26.924144 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:57:26.924144 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:57:26.924144 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:57:26.924144 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:57:26.924144 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:57:26.924144 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:57:26.924144 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 23 20:57:26.924144 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:57:26.924144 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 170/341] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Jul 23 20:57:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:57:26.925422 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ea1128-9986-4651-9765-27b7f0432c75 None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:26.925987 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ea1128-9986-4651-9765-27b7f0432c75 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:26.926385 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ea1128-9986-4651-9765-27b7f0432c75 None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:26.929563 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 171/342] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:57:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:57:26.930572 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ea1128-9986-4651-9765-27b7f0432c75 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:26.935990 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:26.945698 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d875e516-dcb8-461d-b7cc-e44067c6c905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:26.947226 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d875e516-dcb8-461d-b7cc-e44067c6c905 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:26.947584 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d875e516-dcb8-461d-b7cc-e44067c6c905 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:26.947930 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d875e516-dcb8-461d-b7cc-e44067c6c905 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:26.962790 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d875e516-dcb8-461d-b7cc-e44067c6c905 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:57:26.973774 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-d875e516-dcb8-461d-b7cc-e44067c6c905 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 23 20:57:26.973774 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:57:26.973774 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:57:26.973774 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:57:26.973774 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:57:26.973774 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:57:26.973774 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:57:26.973774 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:57:26.973774 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:57:26.973774 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:57:26.973774 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:57:26.973774 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:57:26.973774 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:57:26.973774 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:57:26.973774 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:57:26.973774 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:57:26.974855 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:57:26.974855 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:57:26.974855 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:57:26.974855 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:57:26.974855 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:57:26.974855 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:57:26.974855 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:57:26.974855 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:57:26.974855 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:57:26.974855 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:57:26.974855 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:57:26.974855 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application with Lock( Jul 23 20:57:26.974855 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:57:26.974855 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:57:26.974855 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:57:26.974855 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:57:26.975662 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:57:26.975662 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:57:26.975662 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:57:26.975662 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:57:26.975662 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:57:26.975662 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:57:26.975662 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:57:26.975662 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:57:26.975662 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:57:26.975662 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:57:26.975662 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 23 20:57:26.975662 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 20:57:26.977995 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 172/343] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Jul 23 20:57:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:57:26.978950 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d875e516-dcb8-461d-b7cc-e44067c6c905 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:27.085455 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ea1128-9986-4651-9765-27b7f0432c75 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:27.110176 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d875e516-dcb8-461d-b7cc-e44067c6c905 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:27.121803 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d17723-4b0c-44a4-ba66-fa7ecf511f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:27.122772 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d17723-4b0c-44a4-ba66-fa7ecf511f97 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:27.123059 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d17723-4b0c-44a4-ba66-fa7ecf511f97 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:27.123459 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d17723-4b0c-44a4-ba66-fa7ecf511f97 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:27.134970 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d17723-4b0c-44a4-ba66-fa7ecf511f97 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:57:27.144693 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-49d17723-4b0c-44a4-ba66-fa7ecf511f97 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 23 20:57:27.144693 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:57:27.144693 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:57:27.144693 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:57:27.144693 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:57:27.144693 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:57:27.144693 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:57:27.144693 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:57:27.144693 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:57:27.144693 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:57:27.144693 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:57:27.144693 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:57:27.144693 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:57:27.144693 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:57:27.144693 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:57:27.144693 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:57:27.145828 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:57:27.145828 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:57:27.145828 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:57:27.145828 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:57:27.145828 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:57:27.145828 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:57:27.145828 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:57:27.145828 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:57:27.145828 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:57:27.145828 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:57:27.145828 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:57:27.145828 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application with Lock( Jul 23 20:57:27.145828 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:57:27.145828 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:57:27.145828 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:57:27.145828 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:57:27.146944 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:57:27.146944 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:57:27.146944 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:57:27.146944 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:57:27.146944 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:57:27.146944 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:57:27.146944 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:57:27.146944 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:57:27.146944 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:57:27.146944 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:57:27.146944 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 23 20:57:27.146944 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:57:27.146944 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 172/344] 10.222.0.17 () {56 vars in 1114 bytes} [Sat Jul 23 20:57:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:57:27.147736 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327719d4-4ae9-48b1-8496-71e02b08651d None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:27.147891 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327719d4-4ae9-48b1-8496-71e02b08651d None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:27.148167 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327719d4-4ae9-48b1-8496-71e02b08651d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:27.154720 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3234495f-8600-4719-bf68-d513c2cc73e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:27.155688 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3234495f-8600-4719-bf68-d513c2cc73e4 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:27.156105 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3234495f-8600-4719-bf68-d513c2cc73e4 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:27.156538 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3234495f-8600-4719-bf68-d513c2cc73e4 None admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:27.157425 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3234495f-8600-4719-bf68-d513c2cc73e4 None admin] RBAC: Adding query filter params (name=member) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:57:27.157896 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3234495f-8600-4719-bf68-d513c2cc73e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:27.159422 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3234495f-8600-4719-bf68-d513c2cc73e4 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:27.168761 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 173/345] 10.222.0.17 () {56 vars in 1101 bytes} [Sat Jul 23 20:57:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:57:27.170794 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-327719d4-4ae9-48b1-8496-71e02b08651d None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:57:27.170896 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-327719d4-4ae9-48b1-8496-71e02b08651d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:57:27.171946 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3234495f-8600-4719-bf68-d513c2cc73e4 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:27.238473 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:27.242847 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:27.252770 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 173/346] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:57:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 23 20:57:27.253996 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327719d4-4ae9-48b1-8496-71e02b08651d None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:27.297044 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3234495f-8600-4719-bf68-d513c2cc73e4 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:27.332852 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c39dbc-5038-454a-ad32-467614840f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:27.333908 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c39dbc-5038-454a-ad32-467614840f3e None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:27.334360 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c39dbc-5038-454a-ad32-467614840f3e None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:27.334821 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c39dbc-5038-454a-ad32-467614840f3e None admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:27.335739 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c39dbc-5038-454a-ad32-467614840f3e None admin] RBAC: Adding query filter params (name=member) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:57:27.336220 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c39dbc-5038-454a-ad32-467614840f3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:27.337961 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c39dbc-5038-454a-ad32-467614840f3e None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:27.347146 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 174/347] 10.222.0.17 () {56 vars in 1101 bytes} [Sat Jul 23 20:57:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:57:27.348370 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c39dbc-5038-454a-ad32-467614840f3e None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:27.392574 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327719d4-4ae9-48b1-8496-71e02b08651d None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:27.432759 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f26721f-9b66-4ef6-afe2-431a67c46623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:27.433546 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f26721f-9b66-4ef6-afe2-431a67c46623 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:27.433825 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f26721f-9b66-4ef6-afe2-431a67c46623 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:27.434126 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f26721f-9b66-4ef6-afe2-431a67c46623 None admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:27.434892 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f26721f-9b66-4ef6-afe2-431a67c46623 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:57:27.435194 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f26721f-9b66-4ef6-afe2-431a67c46623 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:27.436982 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f26721f-9b66-4ef6-afe2-431a67c46623 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:27.447607 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 174/348] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Jul 23 20:57:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:57:27.448454 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f26721f-9b66-4ef6-afe2-431a67c46623 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:27.461683 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c39dbc-5038-454a-ad32-467614840f3e None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:27.486719 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:27.506177 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eb2b28-9c8a-493d-922a-b20058fa5ef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:27.507228 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eb2b28-9c8a-493d-922a-b20058fa5ef4 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:27.507720 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eb2b28-9c8a-493d-922a-b20058fa5ef4 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:27.508297 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eb2b28-9c8a-493d-922a-b20058fa5ef4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:27.520297 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:27.575214 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f26721f-9b66-4ef6-afe2-431a67c46623 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:27.614835 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41eb2b28-9c8a-493d-922a-b20058fa5ef4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:27.616651 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41eb2b28-9c8a-493d-922a-b20058fa5ef4 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:27.622304 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d777bb35-1af4-427f-a6fe-8cd042d0ccfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:27.623135 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d777bb35-1af4-427f-a6fe-8cd042d0ccfb None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:27.623419 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d777bb35-1af4-427f-a6fe-8cd042d0ccfb None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:27.623696 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d777bb35-1af4-427f-a6fe-8cd042d0ccfb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:27.637480 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d777bb35-1af4-427f-a6fe-8cd042d0ccfb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:57:27.647498 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-d777bb35-1af4-427f-a6fe-8cd042d0ccfb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 23 20:57:27.647498 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:57:27.647498 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:57:27.647498 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:57:27.647498 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:57:27.647498 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:57:27.647498 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:57:27.647498 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:57:27.647498 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:57:27.647498 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:57:27.647498 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:57:27.647498 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:57:27.647498 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:57:27.647498 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:57:27.647498 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:57:27.647498 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:57:27.648404 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:57:27.648404 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:57:27.648404 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:57:27.648404 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:57:27.648404 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:57:27.648404 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:57:27.648404 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:57:27.648404 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:57:27.648404 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:57:27.648404 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:57:27.648404 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:57:27.648404 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application with Lock( Jul 23 20:57:27.648404 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:57:27.648404 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:57:27.648404 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:57:27.648404 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:57:27.649600 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:57:27.649600 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:57:27.649600 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:57:27.649600 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:57:27.649600 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:57:27.649600 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:57:27.649600 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:57:27.649600 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:57:27.649600 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:57:27.649600 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:57:27.649600 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 23 20:57:27.649600 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:57:27.649600 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 175/349] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Jul 23 20:57:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:57:27.649600 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d777bb35-1af4-427f-a6fe-8cd042d0ccfb None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:27.731977 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 175/350] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Jul 23 20:57:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 23 20:57:27.733392 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eb2b28-9c8a-493d-922a-b20058fa5ef4 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:27.746143 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:27.766759 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d777bb35-1af4-427f-a6fe-8cd042d0ccfb None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:27.784215 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:27.805341 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce427d3-628d-4504-b2d5-0316443281bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:27.806054 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce427d3-628d-4504-b2d5-0316443281bf None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:27.806339 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce427d3-628d-4504-b2d5-0316443281bf None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:27.806620 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce427d3-628d-4504-b2d5-0316443281bf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:27.856458 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eb2b28-9c8a-493d-922a-b20058fa5ef4 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:27.885105 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce427d3-628d-4504-b2d5-0316443281bf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:27.886940 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce427d3-628d-4504-b2d5-0316443281bf None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:27.895361 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6eee48-239e-4c24-9b4b-0d08caf97351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:27.896444 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6eee48-239e-4c24-9b4b-0d08caf97351 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:27.896930 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6eee48-239e-4c24-9b4b-0d08caf97351 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:27.897420 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6eee48-239e-4c24-9b4b-0d08caf97351 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:27.983362 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6eee48-239e-4c24-9b4b-0d08caf97351 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:27.985255 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6eee48-239e-4c24-9b4b-0d08caf97351 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:27.998225 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:27.999552 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 176/351] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Jul 23 20:57:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 23 20:57:28.000601 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce427d3-628d-4504-b2d5-0316443281bf None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:28.024084 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:28.100960 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 176/352] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Jul 23 20:57:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 23 20:57:28.102298 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6eee48-239e-4c24-9b4b-0d08caf97351 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:28.113692 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce427d3-628d-4504-b2d5-0316443281bf None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:28.154118 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c58d80-55b5-462a-89b6-3a86b973cedb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:28.154961 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c58d80-55b5-462a-89b6-3a86b973cedb None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:28.155299 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c58d80-55b5-462a-89b6-3a86b973cedb None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:28.155629 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c58d80-55b5-462a-89b6-3a86b973cedb None admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:28.157290 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c58d80-55b5-462a-89b6-3a86b973cedb None admin] RBAC: Adding query filter params (name=reader) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:57:28.157290 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c58d80-55b5-462a-89b6-3a86b973cedb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:28.158904 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c58d80-55b5-462a-89b6-3a86b973cedb None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:28.169014 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 177/353] 10.222.0.17 () {56 vars in 1101 bytes} [Sat Jul 23 20:57:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:57:28.169698 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c58d80-55b5-462a-89b6-3a86b973cedb None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:28.215457 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6eee48-239e-4c24-9b4b-0d08caf97351 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:28.229413 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:28.269792 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05b38ef-e9c6-480a-bbbd-2bda370d6df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:28.270729 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05b38ef-e9c6-480a-bbbd-2bda370d6df5 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:28.271010 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05b38ef-e9c6-480a-bbbd-2bda370d6df5 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:28.271282 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05b38ef-e9c6-480a-bbbd-2bda370d6df5 None admin] PATH_INFO: `/v3/projects/74cb8c05a64040c48e6687c9bd9865d1` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:28.272501 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05b38ef-e9c6-480a-bbbd-2bda370d6df5 None admin] RBAC: Authorizing `identity:get_project(project_id=74cb8c05a64040c48e6687c9bd9865d1)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:28.274024 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05b38ef-e9c6-480a-bbbd-2bda370d6df5 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:28.274414 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:28.278069 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 177/354] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Jul 23 20:57:28 2022] GET /identity/v3/projects/74cb8c05a64040c48e6687c9bd9865d1 => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:57:28.278069 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05b38ef-e9c6-480a-bbbd-2bda370d6df5 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:28.312469 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c58d80-55b5-462a-89b6-3a86b973cedb None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:28.364431 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e077a75-5742-4e73-b644-20375a7d14ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:28.366881 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e077a75-5742-4e73-b644-20375a7d14ae None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:28.367738 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e077a75-5742-4e73-b644-20375a7d14ae None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:28.368065 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e077a75-5742-4e73-b644-20375a7d14ae None admin] PATH_INFO: `/v3/projects/84094ca55a574d84ba5fe544c9d90f50` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:28.369729 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e077a75-5742-4e73-b644-20375a7d14ae None admin] RBAC: Authorizing `identity:get_project(project_id=84094ca55a574d84ba5fe544c9d90f50)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:28.371354 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e077a75-5742-4e73-b644-20375a7d14ae None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:28.373780 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 178/355] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Jul 23 20:57:28 2022] GET /identity/v3/projects/84094ca55a574d84ba5fe544c9d90f50 => generated 302 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:57:28.374917 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f8f865-ffc3-4339-a569-db8131762994 None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:28.375209 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f8f865-ffc3-4339-a569-db8131762994 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:28.375486 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f8f865-ffc3-4339-a569-db8131762994 None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:28.376904 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 179/356] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:57:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:57:28.377458 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f8f865-ffc3-4339-a569-db8131762994 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:28.430846 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05b38ef-e9c6-480a-bbbd-2bda370d6df5 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:28.476600 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b9b98b-ce49-46f2-9a21-8e387fdc9224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:28.477364 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b9b98b-ce49-46f2-9a21-8e387fdc9224 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:28.477635 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b9b98b-ce49-46f2-9a21-8e387fdc9224 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:28.477943 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b9b98b-ce49-46f2-9a21-8e387fdc9224 None admin] PATH_INFO: `/v3/projects/74cb8c05a64040c48e6687c9bd9865d1` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:28.479155 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b9b98b-ce49-46f2-9a21-8e387fdc9224 None admin] RBAC: Authorizing `identity:get_project(project_id=74cb8c05a64040c48e6687c9bd9865d1)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:28.480602 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b9b98b-ce49-46f2-9a21-8e387fdc9224 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:28.482692 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 178/357] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Jul 23 20:57:28 2022] GET /identity/v3/projects/74cb8c05a64040c48e6687c9bd9865d1 => generated 298 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:57:28.483487 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b9b98b-ce49-46f2-9a21-8e387fdc9224 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:28.517182 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f8f865-ffc3-4339-a569-db8131762994 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:28.548850 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:28.560398 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a9ae7f-8ef3-4a0d-a463-049405233148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:28.561298 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a9ae7f-8ef3-4a0d-a463-049405233148 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:28.561579 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a9ae7f-8ef3-4a0d-a463-049405233148 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:28.561852 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a9ae7f-8ef3-4a0d-a463-049405233148 None admin] PATH_INFO: `/v3/users/dd356dbc3e684ce087c51a392e5a89a8` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:28.563098 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a9ae7f-8ef3-4a0d-a463-049405233148 None admin] RBAC: Authorizing `identity:get_user(user_id=dd356dbc3e684ce087c51a392e5a89a8)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:28.564573 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a9ae7f-8ef3-4a0d-a463-049405233148 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:28.566322 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 180/358] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Jul 23 20:57:28 2022] GET /identity/v3/users/dd356dbc3e684ce087c51a392e5a89a8 => generated 293 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:57:28.567099 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a9ae7f-8ef3-4a0d-a463-049405233148 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:28.587551 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:28.637190 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b9b98b-ce49-46f2-9a21-8e387fdc9224 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:28.681894 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6159e6f-99b0-4755-81eb-2de013d57545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:28.682982 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6159e6f-99b0-4755-81eb-2de013d57545 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:28.683232 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6159e6f-99b0-4755-81eb-2de013d57545 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:28.683503 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6159e6f-99b0-4755-81eb-2de013d57545 None admin] PATH_INFO: `/v3/groups/1409e85b12ca4c6c9e929ac06c5c39a3` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:28.692830 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6159e6f-99b0-4755-81eb-2de013d57545 None admin] RBAC: Authorizing `identity:get_group(group_id=1409e85b12ca4c6c9e929ac06c5c39a3)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:28.694363 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6159e6f-99b0-4755-81eb-2de013d57545 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:28.696138 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 179/359] 10.222.0.17 () {56 vars in 1180 bytes} [Sat Jul 23 20:57:28 2022] GET /identity/v3/groups/1409e85b12ca4c6c9e929ac06c5c39a3 => generated 226 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:57:28.697898 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb461e93-c61c-4255-b4c0-9fbb02476fff None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:28.701703 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb461e93-c61c-4255-b4c0-9fbb02476fff None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:28.701703 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb461e93-c61c-4255-b4c0-9fbb02476fff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:28.702124 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a9ae7f-8ef3-4a0d-a463-049405233148 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:28.719655 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-bb461e93-c61c-4255-b4c0-9fbb02476fff None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:57:28.720851 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-bb461e93-c61c-4255-b4c0-9fbb02476fff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:57:28.745030 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e2e467-9ed2-492f-bcec-65665e0b3834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:28.745955 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e2e467-9ed2-492f-bcec-65665e0b3834 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:28.746233 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e2e467-9ed2-492f-bcec-65665e0b3834 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:28.746501 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e2e467-9ed2-492f-bcec-65665e0b3834 None admin] PATH_INFO: `/v3/groups/1409e85b12ca4c6c9e929ac06c5c39a3` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:28.747783 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e2e467-9ed2-492f-bcec-65665e0b3834 None admin] RBAC: Authorizing `identity:get_group(group_id=1409e85b12ca4c6c9e929ac06c5c39a3)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:28.749168 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e2e467-9ed2-492f-bcec-65665e0b3834 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:28.752129 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 181/360] 10.222.0.17 () {56 vars in 1180 bytes} [Sat Jul 23 20:57:28 2022] GET /identity/v3/groups/1409e85b12ca4c6c9e929ac06c5c39a3 => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:57:28.753089 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4053aee9-1b0b-4490-9325-a8a26b855ae3 None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:28.753375 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4053aee9-1b0b-4490-9325-a8a26b855ae3 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:28.753712 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4053aee9-1b0b-4490-9325-a8a26b855ae3 None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:28.755168 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 182/361] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:57:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:57:28.755705 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4053aee9-1b0b-4490-9325-a8a26b855ae3 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:28.812539 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 180/362] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:57:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 23 20:57:28.812539 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb461e93-c61c-4255-b4c0-9fbb02476fff None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:28.860915 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:28.867443 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:28.891693 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4053aee9-1b0b-4490-9325-a8a26b855ae3 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:28.936286 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb461e93-c61c-4255-b4c0-9fbb02476fff None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:28.937463 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f553fbd3-9138-4b2e-a7c8-5c6f1f4d7bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:28.938380 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f553fbd3-9138-4b2e-a7c8-5c6f1f4d7bfa None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:28.938658 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f553fbd3-9138-4b2e-a7c8-5c6f1f4d7bfa None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:28.938996 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f553fbd3-9138-4b2e-a7c8-5c6f1f4d7bfa None admin] PATH_INFO: `/v3/groups/1409e85b12ca4c6c9e929ac06c5c39a3` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:28.940732 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f553fbd3-9138-4b2e-a7c8-5c6f1f4d7bfa None admin] RBAC: Authorizing `identity:get_group(group_id=1409e85b12ca4c6c9e929ac06c5c39a3)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:28.942341 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f553fbd3-9138-4b2e-a7c8-5c6f1f4d7bfa None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:28.944142 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 183/363] 10.222.0.17 () {56 vars in 1180 bytes} [Sat Jul 23 20:57:28 2022] GET /identity/v3/groups/1409e85b12ca4c6c9e929ac06c5c39a3 => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:57:28.944828 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f553fbd3-9138-4b2e-a7c8-5c6f1f4d7bfa None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:28.978884 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64196066-b70d-48b7-8db0-312e08dc5f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:28.979880 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64196066-b70d-48b7-8db0-312e08dc5f16 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:28.980306 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64196066-b70d-48b7-8db0-312e08dc5f16 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:28.980577 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64196066-b70d-48b7-8db0-312e08dc5f16 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:28.981418 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64196066-b70d-48b7-8db0-312e08dc5f16 None admin] RBAC: Adding query filter params (role.id=5e81c9ea0319460391e21a2a77dd537a, user.id=dd356dbc3e684ce087c51a392e5a89a8, scope.system=all) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:57:28.981729 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64196066-b70d-48b7-8db0-312e08dc5f16 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:28.983277 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64196066-b70d-48b7-8db0-312e08dc5f16 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:28.997109 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 181/364] 10.222.0.17 () {56 vars in 1308 bytes} [Sat Jul 23 20:57:28 2022] GET /identity/v3/role_assignments?user.id=dd356dbc3e684ce087c51a392e5a89a8&scope.system=all&role.id=5e81c9ea0319460391e21a2a77dd537a => generated 510 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:57:28.998424 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64196066-b70d-48b7-8db0-312e08dc5f16 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:29.081390 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f553fbd3-9138-4b2e-a7c8-5c6f1f4d7bfa None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:29.126400 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:29.128814 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e81a78-bc0e-45cf-9633-ab28f09ff136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:29.129560 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e81a78-bc0e-45cf-9633-ab28f09ff136 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:29.129837 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e81a78-bc0e-45cf-9633-ab28f09ff136 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:29.130126 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e81a78-bc0e-45cf-9633-ab28f09ff136 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:29.130697 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64196066-b70d-48b7-8db0-312e08dc5f16 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:29.130973 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e81a78-bc0e-45cf-9633-ab28f09ff136 None admin] RBAC: Adding query filter params (group.id=1409e85b12ca4c6c9e929ac06c5c39a3, role.id=14824669685048b38361b1676f7f0f9f, scope.project.id=74cb8c05a64040c48e6687c9bd9865d1) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:57:29.131355 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e81a78-bc0e-45cf-9633-ab28f09ff136 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:29.133009 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e81a78-bc0e-45cf-9633-ab28f09ff136 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:29.140467 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 184/365] 10.222.0.17 () {56 vars in 1376 bytes} [Sat Jul 23 20:57:28 2022] GET /identity/v3/role_assignments?group.id=1409e85b12ca4c6c9e929ac06c5c39a3&scope.project.id=74cb8c05a64040c48e6687c9bd9865d1&role.id=14824669685048b38361b1676f7f0f9f => generated 260 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:57:29.142401 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7261d8-3997-4d2b-8d11-5694ed70099f None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:29.142688 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7261d8-3997-4d2b-8d11-5694ed70099f None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:29.142960 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7261d8-3997-4d2b-8d11-5694ed70099f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:29.167322 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-bf7261d8-3997-4d2b-8d11-5694ed70099f None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:57:29.168867 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-bf7261d8-3997-4d2b-8d11-5694ed70099f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:57:29.179472 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a032cef2-c165-41f1-86e6-294920b9bb8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:29.180171 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a032cef2-c165-41f1-86e6-294920b9bb8f None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:29.180455 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a032cef2-c165-41f1-86e6-294920b9bb8f None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:29.180797 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a032cef2-c165-41f1-86e6-294920b9bb8f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:29.181687 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a032cef2-c165-41f1-86e6-294920b9bb8f None admin] RBAC: Adding query filter params (group.id=1409e85b12ca4c6c9e929ac06c5c39a3, role.id=14824669685048b38361b1676f7f0f9f, scope.project.id=84094ca55a574d84ba5fe544c9d90f50) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:57:29.183355 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a032cef2-c165-41f1-86e6-294920b9bb8f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:29.185081 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a032cef2-c165-41f1-86e6-294920b9bb8f None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:29.187023 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:29.192179 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 182/366] 10.222.0.17 () {56 vars in 1376 bytes} [Sat Jul 23 20:57:28 2022] GET /identity/v3/role_assignments?group.id=1409e85b12ca4c6c9e929ac06c5c39a3&scope.project.id=84094ca55a574d84ba5fe544c9d90f50&role.id=14824669685048b38361b1676f7f0f9f => generated 260 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:57:29.193086 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a032cef2-c165-41f1-86e6-294920b9bb8f None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:29.292125 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 185/367] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:57:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 23 20:57:29.293153 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7261d8-3997-4d2b-8d11-5694ed70099f None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:29.376627 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a032cef2-c165-41f1-86e6-294920b9bb8f None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:29.429127 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfb887b-5679-4d95-a7a6-bc713b506e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:29.430023 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfb887b-5679-4d95-a7a6-bc713b506e61 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:29.430301 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfb887b-5679-4d95-a7a6-bc713b506e61 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:29.430567 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfb887b-5679-4d95-a7a6-bc713b506e61 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:29.432005 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7261d8-3997-4d2b-8d11-5694ed70099f None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:29.444703 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfb887b-5679-4d95-a7a6-bc713b506e61 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:57:29.454442 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-bbfb887b-5679-4d95-a7a6-bc713b506e61 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 23 20:57:29.454442 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:57:29.454442 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:57:29.454442 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:57:29.454442 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:57:29.454442 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:57:29.454442 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:57:29.454442 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:57:29.454442 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:57:29.454442 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:57:29.454442 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:57:29.454442 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:57:29.454442 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:57:29.454442 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:57:29.454442 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:57:29.454442 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:57:29.455584 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:57:29.455584 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:57:29.455584 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:57:29.455584 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:57:29.455584 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:57:29.455584 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:57:29.455584 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:57:29.455584 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:57:29.455584 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:57:29.455584 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:57:29.455584 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:57:29.455584 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application with Lock( Jul 23 20:57:29.455584 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:57:29.455584 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:57:29.455584 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:57:29.455584 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:57:29.456493 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:57:29.456493 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:57:29.456493 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:57:29.456493 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:57:29.456493 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:57:29.456493 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:57:29.456493 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:57:29.456493 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:57:29.456493 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:57:29.456493 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:57:29.456493 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 23 20:57:29.456493 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 20:57:29.456493 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 183/368] 10.222.0.17 () {56 vars in 1114 bytes} [Sat Jul 23 20:57:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:57:29.457435 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfb887b-5679-4d95-a7a6-bc713b506e61 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:29.480249 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae707da-7716-406b-bda3-4ed4c1bb1610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:29.481206 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae707da-7716-406b-bda3-4ed4c1bb1610 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:29.481778 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae707da-7716-406b-bda3-4ed4c1bb1610 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:29.482210 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae707da-7716-406b-bda3-4ed4c1bb1610 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:29.483521 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae707da-7716-406b-bda3-4ed4c1bb1610 None admin] RBAC: Adding query filter params (group.id=1409e85b12ca4c6c9e929ac06c5c39a3, role.id=c5f46541d35e44b691baa7a1fa304c0f, scope.project.id=74cb8c05a64040c48e6687c9bd9865d1) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:57:29.483964 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae707da-7716-406b-bda3-4ed4c1bb1610 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:29.486079 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae707da-7716-406b-bda3-4ed4c1bb1610 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:29.493809 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 186/369] 10.222.0.17 () {56 vars in 1376 bytes} [Sat Jul 23 20:57:29 2022] GET /identity/v3/role_assignments?group.id=1409e85b12ca4c6c9e929ac06c5c39a3&scope.project.id=74cb8c05a64040c48e6687c9bd9865d1&role.id=c5f46541d35e44b691baa7a1fa304c0f => generated 260 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:57:29.494248 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:29.495439 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae707da-7716-406b-bda3-4ed4c1bb1610 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:29.514398 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:29.628494 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfb887b-5679-4d95-a7a6-bc713b506e61 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:29.670759 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483b3f5c-f0c9-4f05-ada2-67634e90c90c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:29.671593 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483b3f5c-f0c9-4f05-ada2-67634e90c90c None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:29.671866 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483b3f5c-f0c9-4f05-ada2-67634e90c90c None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:29.672029 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae707da-7716-406b-bda3-4ed4c1bb1610 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:29.672446 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483b3f5c-f0c9-4f05-ada2-67634e90c90c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:29.684187 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483b3f5c-f0c9-4f05-ada2-67634e90c90c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:57:29.694956 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-483b3f5c-f0c9-4f05-ada2-67634e90c90c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 23 20:57:29.694956 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:57:29.694956 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:57:29.694956 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:57:29.694956 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:57:29.694956 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:57:29.694956 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:57:29.694956 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:57:29.694956 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:57:29.694956 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:57:29.694956 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:57:29.694956 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:57:29.694956 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:57:29.694956 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:57:29.694956 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:57:29.694956 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:57:29.695899 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:57:29.695899 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:57:29.695899 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:57:29.695899 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:57:29.695899 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:57:29.695899 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:57:29.695899 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:57:29.695899 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:57:29.695899 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:57:29.695899 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:57:29.695899 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:57:29.695899 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application with Lock( Jul 23 20:57:29.695899 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:57:29.695899 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:57:29.695899 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:57:29.695899 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:57:29.696677 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:57:29.696677 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:57:29.696677 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:57:29.696677 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:57:29.696677 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:57:29.696677 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:57:29.696677 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:57:29.696677 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:57:29.696677 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:57:29.696677 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:57:29.696677 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 23 20:57:29.696677 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 20:57:29.696677 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 184/370] 10.222.0.17 () {56 vars in 1096 bytes} [Sat Jul 23 20:57:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:57:29.707417 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483b3f5c-f0c9-4f05-ada2-67634e90c90c None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:29.735268 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31a7be4-b659-4a16-aff4-b3ce705c13d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:29.736115 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31a7be4-b659-4a16-aff4-b3ce705c13d3 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:29.736393 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31a7be4-b659-4a16-aff4-b3ce705c13d3 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:29.736657 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31a7be4-b659-4a16-aff4-b3ce705c13d3 None admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:29.737547 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31a7be4-b659-4a16-aff4-b3ce705c13d3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:57:29.737849 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31a7be4-b659-4a16-aff4-b3ce705c13d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:29.739446 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31a7be4-b659-4a16-aff4-b3ce705c13d3 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:29.758149 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 187/371] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Jul 23 20:57:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:57:29.764834 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31a7be4-b659-4a16-aff4-b3ce705c13d3 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:29.801990 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:29.839031 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483b3f5c-f0c9-4f05-ada2-67634e90c90c None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:29.900262 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:29.909553 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f639dd-45bb-497e-b07c-36f9254f55fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:29.910317 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f639dd-45bb-497e-b07c-36f9254f55fc None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:29.910606 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f639dd-45bb-497e-b07c-36f9254f55fc None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:29.910918 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f639dd-45bb-497e-b07c-36f9254f55fc None admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:29.911672 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f639dd-45bb-497e-b07c-36f9254f55fc None admin] RBAC: Adding query filter params (name=admin) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:57:29.911979 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f639dd-45bb-497e-b07c-36f9254f55fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:29.913361 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f639dd-45bb-497e-b07c-36f9254f55fc None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:29.924431 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 185/372] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Jul 23 20:57:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 20:57:29.931095 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f639dd-45bb-497e-b07c-36f9254f55fc None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:29.944197 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31a7be4-b659-4a16-aff4-b3ce705c13d3 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:29.982383 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fe0de2-dd45-4839-8656-c6c4140c3378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:29.983346 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fe0de2-dd45-4839-8656-c6c4140c3378 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:29.983609 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fe0de2-dd45-4839-8656-c6c4140c3378 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:29.983901 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fe0de2-dd45-4839-8656-c6c4140c3378 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:30.072762 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fe0de2-dd45-4839-8656-c6c4140c3378 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:30.074544 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fe0de2-dd45-4839-8656-c6c4140c3378 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:30.108846 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f639dd-45bb-497e-b07c-36f9254f55fc None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:30.158658 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:30.195144 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13578476-0a4c-4c92-b7dd-de661b44fe10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:30.195818 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13578476-0a4c-4c92-b7dd-de661b44fe10 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:30.196099 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13578476-0a4c-4c92-b7dd-de661b44fe10 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:30.196535 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13578476-0a4c-4c92-b7dd-de661b44fe10 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:30.196638 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 188/373] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Jul 23 20:57:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 23 20:57:30.202660 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fe0de2-dd45-4839-8656-c6c4140c3378 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:30.228880 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:30.334763 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fe0de2-dd45-4839-8656-c6c4140c3378 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:30.378118 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651e8806-2132-4ee4-8a0b-c7a28a97b990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:30.379323 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651e8806-2132-4ee4-8a0b-c7a28a97b990 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:30.379598 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651e8806-2132-4ee4-8a0b-c7a28a97b990 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:30.379866 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651e8806-2132-4ee4-8a0b-c7a28a97b990 None admin] PATH_INFO: `/v3/projects/84094ca55a574d84ba5fe544c9d90f50` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:30.381069 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651e8806-2132-4ee4-8a0b-c7a28a97b990 None admin] RBAC: Authorizing `identity:get_project(project_id=84094ca55a574d84ba5fe544c9d90f50)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:30.382791 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651e8806-2132-4ee4-8a0b-c7a28a97b990 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:30.385526 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 189/374] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Jul 23 20:57:30 2022] GET /identity/v3/projects/84094ca55a574d84ba5fe544c9d90f50 => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 20:57:30.388009 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13578476-0a4c-4c92-b7dd-de661b44fe10 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:30.389585 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13578476-0a4c-4c92-b7dd-de661b44fe10 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:30.391107 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651e8806-2132-4ee4-8a0b-c7a28a97b990 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:30.473561 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:30.596957 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651e8806-2132-4ee4-8a0b-c7a28a97b990 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:30.603667 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 186/375] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Jul 23 20:57:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 673 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 23 20:57:30.610119 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13578476-0a4c-4c92-b7dd-de661b44fe10 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:30.667925 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:30.678025 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3d39d6-3f9c-4aaf-93f3-0fba29d7ec16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:30.678908 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3d39d6-3f9c-4aaf-93f3-0fba29d7ec16 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:30.679179 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3d39d6-3f9c-4aaf-93f3-0fba29d7ec16 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:30.679446 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3d39d6-3f9c-4aaf-93f3-0fba29d7ec16 None admin] PATH_INFO: `/v3/groups/1409e85b12ca4c6c9e929ac06c5c39a3` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:30.680649 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3d39d6-3f9c-4aaf-93f3-0fba29d7ec16 None admin] RBAC: Authorizing `identity:get_group(group_id=1409e85b12ca4c6c9e929ac06c5c39a3)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:30.686209 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3d39d6-3f9c-4aaf-93f3-0fba29d7ec16 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:30.688237 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 190/376] 10.222.0.17 () {56 vars in 1180 bytes} [Sat Jul 23 20:57:30 2022] GET /identity/v3/groups/1409e85b12ca4c6c9e929ac06c5c39a3 => generated 226 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 20:57:30.694039 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3d39d6-3f9c-4aaf-93f3-0fba29d7ec16 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:30.731592 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13578476-0a4c-4c92-b7dd-de661b44fe10 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:30.780640 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461f0ece-17dc-479b-ab49-541b1d943a48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:30.781554 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461f0ece-17dc-479b-ab49-541b1d943a48 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:30.781830 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461f0ece-17dc-479b-ab49-541b1d943a48 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:30.782119 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461f0ece-17dc-479b-ab49-541b1d943a48 None admin] PATH_INFO: `/v3/projects/d6f3124c18f04946a431e587fc205bd4` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:30.784054 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461f0ece-17dc-479b-ab49-541b1d943a48 None admin] RBAC: Authorizing `identity:get_project(project_id=d6f3124c18f04946a431e587fc205bd4)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:30.787802 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461f0ece-17dc-479b-ab49-541b1d943a48 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:30.794400 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 187/377] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Jul 23 20:57:30 2022] GET /identity/v3/projects/d6f3124c18f04946a431e587fc205bd4 => generated 344 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 20:57:30.823305 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461f0ece-17dc-479b-ab49-541b1d943a48 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:30.890946 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3d39d6-3f9c-4aaf-93f3-0fba29d7ec16 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:30.900880 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:30.935251 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af3b6d7-05e4-4c6a-aa74-901f037595e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:30.936033 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af3b6d7-05e4-4c6a-aa74-901f037595e1 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:30.936314 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af3b6d7-05e4-4c6a-aa74-901f037595e1 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:30.936589 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af3b6d7-05e4-4c6a-aa74-901f037595e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:30.937481 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af3b6d7-05e4-4c6a-aa74-901f037595e1 None admin] RBAC: Adding query filter params (group.id=1409e85b12ca4c6c9e929ac06c5c39a3, role.id=c5f46541d35e44b691baa7a1fa304c0f, scope.project.id=84094ca55a574d84ba5fe544c9d90f50) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:57:30.937795 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af3b6d7-05e4-4c6a-aa74-901f037595e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:30.943302 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af3b6d7-05e4-4c6a-aa74-901f037595e1 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:30.950223 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 191/378] 10.222.0.17 () {56 vars in 1376 bytes} [Sat Jul 23 20:57:30 2022] GET /identity/v3/role_assignments?group.id=1409e85b12ca4c6c9e929ac06c5c39a3&scope.project.id=84094ca55a574d84ba5fe544c9d90f50&role.id=c5f46541d35e44b691baa7a1fa304c0f => generated 260 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:57:30.978628 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461f0ece-17dc-479b-ab49-541b1d943a48 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:30.995605 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:31.023654 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f2789b-7987-4d13-b122-0a1b814b4a84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:31.024602 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f2789b-7987-4d13-b122-0a1b814b4a84 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:31.024882 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f2789b-7987-4d13-b122-0a1b814b4a84 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:31.025152 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f2789b-7987-4d13-b122-0a1b814b4a84 None admin] PATH_INFO: `/v3/groups/350e0fc337674c8a9f982c41700e04f8` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:31.031292 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f2789b-7987-4d13-b122-0a1b814b4a84 None admin] RBAC: Authorizing `identity:get_group(group_id=350e0fc337674c8a9f982c41700e04f8)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:31.032734 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f2789b-7987-4d13-b122-0a1b814b4a84 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:31.034893 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 188/379] 10.222.0.17 () {56 vars in 1180 bytes} [Sat Jul 23 20:57:30 2022] GET /identity/v3/groups/350e0fc337674c8a9f982c41700e04f8 => generated 229 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 20:57:31.040552 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af3b6d7-05e4-4c6a-aa74-901f037595e1 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:31.175754 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af3b6d7-05e4-4c6a-aa74-901f037595e1 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:31.215964 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0c6fba-59bb-4441-b0b9-99f63c7ac2d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:31.216708 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0c6fba-59bb-4441-b0b9-99f63c7ac2d0 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:31.216987 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0c6fba-59bb-4441-b0b9-99f63c7ac2d0 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:31.217259 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0c6fba-59bb-4441-b0b9-99f63c7ac2d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:31.218196 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0c6fba-59bb-4441-b0b9-99f63c7ac2d0 None admin] RBAC: Adding query filter params (group.id=350e0fc337674c8a9f982c41700e04f8, role.id=fec17bfdc65349a2b9c06a89131191df, scope.project.id=d6f3124c18f04946a431e587fc205bd4) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:57:31.218511 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0c6fba-59bb-4441-b0b9-99f63c7ac2d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:31.220031 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0c6fba-59bb-4441-b0b9-99f63c7ac2d0 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:31.226945 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 192/380] 10.222.0.17 () {56 vars in 1376 bytes} [Sat Jul 23 20:57:31 2022] GET /identity/v3/role_assignments?group.id=350e0fc337674c8a9f982c41700e04f8&scope.project.id=d6f3124c18f04946a431e587fc205bd4&role.id=fec17bfdc65349a2b9c06a89131191df => generated 260 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:57:32.021659 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ee5514-7f3c-4c47-b0e1-e2074443c76a None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:32.022241 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ee5514-7f3c-4c47-b0e1-e2074443c76a None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:32.022241 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ee5514-7f3c-4c47-b0e1-e2074443c76a None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:32.023818 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 189/381] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:57:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:57:32.030429 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132d3ace-f570-4e36-af0e-e9a98901196b None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:32.030884 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132d3ace-f570-4e36-af0e-e9a98901196b None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:32.030979 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132d3ace-f570-4e36-af0e-e9a98901196b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:32.052887 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-132d3ace-f570-4e36-af0e-e9a98901196b None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:57:32.054120 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-132d3ace-f570-4e36-af0e-e9a98901196b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:57:32.098303 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:32.146943 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 193/382] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:57:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 23 20:57:32.149958 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f9b400-cb84-4d72-a042-9a4325bf5b94 None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:32.150243 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f9b400-cb84-4d72-a042-9a4325bf5b94 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:32.150518 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f9b400-cb84-4d72-a042-9a4325bf5b94 None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:32.152106 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 190/383] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:57:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:57:32.171954 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f594d01-62e4-4c4d-91e0-8f5f5feed143 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:32.172255 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f594d01-62e4-4c4d-91e0-8f5f5feed143 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:32.172507 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f594d01-62e4-4c4d-91e0-8f5f5feed143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:32.182747 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f9b400-cb84-4d72-a042-9a4325bf5b94 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:32.194383 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-3f594d01-62e4-4c4d-91e0-8f5f5feed143 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:57:32.195844 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-3f594d01-62e4-4c4d-91e0-8f5f5feed143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:57:32.323217 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 194/384] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:57:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 23 20:57:32.347927 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f594d01-62e4-4c4d-91e0-8f5f5feed143 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:32.366682 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f9b400-cb84-4d72-a042-9a4325bf5b94 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:32.428665 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6513123-5ece-4257-9ed8-017ee3e7fee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:32.429914 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6513123-5ece-4257-9ed8-017ee3e7fee4 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:32.430553 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6513123-5ece-4257-9ed8-017ee3e7fee4 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:32.430923 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6513123-5ece-4257-9ed8-017ee3e7fee4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:32.457199 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6513123-5ece-4257-9ed8-017ee3e7fee4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:57:32.465224 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-b6513123-5ece-4257-9ed8-017ee3e7fee4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 23 20:57:32.465224 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:57:32.465224 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:57:32.465224 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:57:32.465224 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:57:32.465224 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:57:32.465224 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:57:32.465224 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:57:32.465224 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:57:32.465224 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:57:32.465224 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:57:32.465224 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:57:32.465224 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:57:32.465224 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:57:32.465224 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:57:32.465224 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:57:32.466148 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:57:32.466148 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:57:32.466148 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:57:32.466148 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:57:32.466148 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:57:32.466148 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:57:32.466148 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:57:32.466148 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:57:32.466148 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:57:32.466148 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:57:32.466148 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:57:32.466148 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application with Lock( Jul 23 20:57:32.466148 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:57:32.466148 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:57:32.466148 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:57:32.466148 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:57:32.466922 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:57:32.466922 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:57:32.466922 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:57:32.466922 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:57:32.466922 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:57:32.466922 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:57:32.466922 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:57:32.466922 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:57:32.466922 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:57:32.466922 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:57:32.466922 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 23 20:57:32.466922 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 20:57:32.466922 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 191/385] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Jul 23 20:57:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:57:32.474891 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6513123-5ece-4257-9ed8-017ee3e7fee4 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:32.522923 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f594d01-62e4-4c4d-91e0-8f5f5feed143 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:32.526237 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:32.534399 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:32.591634 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb4cf2d-56b4-4aca-893d-1a3e93f7f089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:32.592502 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb4cf2d-56b4-4aca-893d-1a3e93f7f089 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:32.592770 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb4cf2d-56b4-4aca-893d-1a3e93f7f089 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:32.593055 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb4cf2d-56b4-4aca-893d-1a3e93f7f089 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:32.611112 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6513123-5ece-4257-9ed8-017ee3e7fee4 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:32.615875 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb4cf2d-56b4-4aca-893d-1a3e93f7f089 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:57:32.632417 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-1bb4cf2d-56b4-4aca-893d-1a3e93f7f089 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 23 20:57:32.632417 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:57:32.632417 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:57:32.632417 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:57:32.632417 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:57:32.632417 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:57:32.632417 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:57:32.632417 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:57:32.632417 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:57:32.632417 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:57:32.632417 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:57:32.632417 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:57:32.632417 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:57:32.632417 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:57:32.632417 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:57:32.632417 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:57:32.633377 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:57:32.633377 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:57:32.633377 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:57:32.633377 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:57:32.633377 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:57:32.633377 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:57:32.633377 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:57:32.633377 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:57:32.633377 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:57:32.633377 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:57:32.633377 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:57:32.633377 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application with Lock( Jul 23 20:57:32.633377 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:57:32.633377 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:57:32.633377 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:57:32.633377 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:57:32.634191 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:57:32.634191 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:57:32.634191 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:57:32.634191 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:57:32.634191 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:57:32.634191 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:57:32.634191 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:57:32.634191 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:57:32.634191 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:57:32.634191 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:57:32.634191 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 23 20:57:32.634191 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:57:32.636362 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 195/386] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Jul 23 20:57:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 23 20:57:32.644293 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb4cf2d-56b4-4aca-893d-1a3e93f7f089 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:32.654089 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83b5261-5f81-4458-8736-f8fd63e78ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:32.654778 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83b5261-5f81-4458-8736-f8fd63e78ba2 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:32.655051 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83b5261-5f81-4458-8736-f8fd63e78ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:32.655320 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83b5261-5f81-4458-8736-f8fd63e78ba2 None admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:32.656064 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83b5261-5f81-4458-8736-f8fd63e78ba2 None admin] RBAC: Adding query filter params (name=member) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:57:32.656363 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83b5261-5f81-4458-8736-f8fd63e78ba2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:32.657764 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83b5261-5f81-4458-8736-f8fd63e78ba2 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:32.678705 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 192/387] 10.222.0.17 () {56 vars in 1101 bytes} [Sat Jul 23 20:57:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:57:32.688100 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83b5261-5f81-4458-8736-f8fd63e78ba2 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:32.849386 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb4cf2d-56b4-4aca-893d-1a3e93f7f089 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:32.852350 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:32.857237 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83b5261-5f81-4458-8736-f8fd63e78ba2 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:32.899534 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904100ab-b781-4e9c-8d9a-b3216f89dfbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:32.900475 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904100ab-b781-4e9c-8d9a-b3216f89dfbc None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:32.900901 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904100ab-b781-4e9c-8d9a-b3216f89dfbc None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:32.901351 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904100ab-b781-4e9c-8d9a-b3216f89dfbc None admin] PATH_INFO: `/v3/groups/1409e85b12ca4c6c9e929ac06c5c39a3` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:32.902690 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904100ab-b781-4e9c-8d9a-b3216f89dfbc None admin] RBAC: Authorizing `identity:get_group(group_id=1409e85b12ca4c6c9e929ac06c5c39a3)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:32.904688 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904100ab-b781-4e9c-8d9a-b3216f89dfbc None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:32.905054 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0768312d-1288-4249-ba40-e90e023f19a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:32.906145 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0768312d-1288-4249-ba40-e90e023f19a0 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:32.906672 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0768312d-1288-4249-ba40-e90e023f19a0 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:32.907221 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0768312d-1288-4249-ba40-e90e023f19a0 None admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:32.908526 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0768312d-1288-4249-ba40-e90e023f19a0 None admin] RBAC: Adding query filter params (name=member) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:57:32.909088 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0768312d-1288-4249-ba40-e90e023f19a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:32.911278 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0768312d-1288-4249-ba40-e90e023f19a0 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:32.912272 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 193/388] 10.222.0.17 () {56 vars in 1180 bytes} [Sat Jul 23 20:57:32 2022] GET /identity/v3/groups/1409e85b12ca4c6c9e929ac06c5c39a3 => generated 226 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:57:32.913856 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69176c6-d20b-422f-90cb-623b28f8991d None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:32.914269 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69176c6-d20b-422f-90cb-623b28f8991d None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:32.914640 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69176c6-d20b-422f-90cb-623b28f8991d None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:32.916426 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 194/389] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:57:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:57:32.917270 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69176c6-d20b-422f-90cb-623b28f8991d None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:32.926370 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 196/390] 10.222.0.17 () {56 vars in 1101 bytes} [Sat Jul 23 20:57:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:57:32.931731 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85894fd-5a46-4974-ae88-deada317b592 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:32.931731 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85894fd-5a46-4974-ae88-deada317b592 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:32.932046 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85894fd-5a46-4974-ae88-deada317b592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:32.954681 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-c85894fd-5a46-4974-ae88-deada317b592 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:57:32.955879 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-c85894fd-5a46-4974-ae88-deada317b592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:57:32.968015 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:33.046087 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 197/391] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:57:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 23 20:57:33.047071 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85894fd-5a46-4974-ae88-deada317b592 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:33.064894 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69176c6-d20b-422f-90cb-623b28f8991d None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:33.104528 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d86b60-101c-4d8b-855e-4844ec397170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:33.105962 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d86b60-101c-4d8b-855e-4844ec397170 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:33.106603 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d86b60-101c-4d8b-855e-4844ec397170 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:33.106891 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d86b60-101c-4d8b-855e-4844ec397170 None admin] PATH_INFO: `/v3/projects/74cb8c05a64040c48e6687c9bd9865d1` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:33.108283 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d86b60-101c-4d8b-855e-4844ec397170 None admin] RBAC: Authorizing `identity:get_project(project_id=74cb8c05a64040c48e6687c9bd9865d1)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:33.109904 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d86b60-101c-4d8b-855e-4844ec397170 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:33.111853 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 195/392] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Jul 23 20:57:32 2022] GET /identity/v3/projects/74cb8c05a64040c48e6687c9bd9865d1 => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:57:33.112782 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d86b60-101c-4d8b-855e-4844ec397170 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:33.156591 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:33.185740 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85894fd-5a46-4974-ae88-deada317b592 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:33.221458 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2140002-fdc4-4a90-9b5f-e21e81389b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:33.222502 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2140002-fdc4-4a90-9b5f-e21e81389b05 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:33.222867 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2140002-fdc4-4a90-9b5f-e21e81389b05 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:33.223136 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2140002-fdc4-4a90-9b5f-e21e81389b05 None admin] PATH_INFO: `/v3/groups/1409e85b12ca4c6c9e929ac06c5c39a3` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:33.224319 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2140002-fdc4-4a90-9b5f-e21e81389b05 None admin] RBAC: Authorizing `identity:get_group(group_id=1409e85b12ca4c6c9e929ac06c5c39a3)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:33.225886 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2140002-fdc4-4a90-9b5f-e21e81389b05 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:33.227625 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 198/393] 10.222.0.17 () {56 vars in 1180 bytes} [Sat Jul 23 20:57:33 2022] GET /identity/v3/groups/1409e85b12ca4c6c9e929ac06c5c39a3 => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:57:33.228363 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2140002-fdc4-4a90-9b5f-e21e81389b05 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:33.234350 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d86b60-101c-4d8b-855e-4844ec397170 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:33.244582 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:33.274746 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaca6e87-3b1d-4827-893f-0ca91e13b81f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:33.275892 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaca6e87-3b1d-4827-893f-0ca91e13b81f None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:33.276316 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaca6e87-3b1d-4827-893f-0ca91e13b81f None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:33.276782 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaca6e87-3b1d-4827-893f-0ca91e13b81f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:33.288849 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaca6e87-3b1d-4827-893f-0ca91e13b81f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:57:33.299774 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-aaca6e87-3b1d-4827-893f-0ca91e13b81f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 23 20:57:33.299774 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:57:33.299774 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:57:33.299774 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:57:33.299774 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:57:33.299774 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:57:33.299774 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:57:33.299774 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:57:33.299774 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:57:33.299774 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:57:33.299774 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:57:33.299774 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:57:33.299774 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:57:33.299774 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:57:33.299774 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:57:33.299774 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:57:33.300882 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:57:33.300882 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:57:33.300882 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:57:33.300882 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:57:33.300882 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:57:33.300882 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:57:33.300882 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:57:33.300882 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:57:33.300882 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:57:33.300882 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:57:33.300882 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:57:33.300882 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application with Lock( Jul 23 20:57:33.300882 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:57:33.300882 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:57:33.300882 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:57:33.300882 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:57:33.301735 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:57:33.301735 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:57:33.301735 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:57:33.301735 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:57:33.301735 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:57:33.301735 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:57:33.301735 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:57:33.301735 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:57:33.301735 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:57:33.301735 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:57:33.301735 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 23 20:57:33.301735 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 20:57:33.304130 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 196/394] 10.222.0.17 () {56 vars in 1114 bytes} [Sat Jul 23 20:57:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:57:33.305265 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaca6e87-3b1d-4827-893f-0ca91e13b81f None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:33.340195 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2140002-fdc4-4a90-9b5f-e21e81389b05 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:33.375690 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1ecafa-b35b-4bbe-8441-f7e807e23c9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:33.376587 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1ecafa-b35b-4bbe-8441-f7e807e23c9d None admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:33.376864 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1ecafa-b35b-4bbe-8441-f7e807e23c9d None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:33.377126 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1ecafa-b35b-4bbe-8441-f7e807e23c9d None admin] PATH_INFO: `/v3/projects/74cb8c05a64040c48e6687c9bd9865d1/groups/1409e85b12ca4c6c9e929ac06c5c39a3/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:33.379312 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1ecafa-b35b-4bbe-8441-f7e807e23c9d None admin] RBAC: Authorizing `identity:create_grant(project_id=74cb8c05a64040c48e6687c9bd9865d1, group_id=1409e85b12ca4c6c9e929ac06c5c39a3, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:33.380874 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1ecafa-b35b-4bbe-8441-f7e807e23c9d None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:33.406173 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 199/395] 10.222.0.17 () {58 vars in 1442 bytes} [Sat Jul 23 20:57:33 2022] PUT /identity/v3/projects/74cb8c05a64040c48e6687c9bd9865d1/groups/1409e85b12ca4c6c9e929ac06c5c39a3/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 20:57:33.407484 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1ecafa-b35b-4bbe-8441-f7e807e23c9d None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:33.411733 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:33.419812 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaca6e87-3b1d-4827-893f-0ca91e13b81f None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:33.467652 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d59512-3efe-4edb-836d-d55745187cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:33.471009 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d59512-3efe-4edb-836d-d55745187cfa None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:33.472885 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d59512-3efe-4edb-836d-d55745187cfa None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:33.473993 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d59512-3efe-4edb-836d-d55745187cfa None admin] PATH_INFO: `/v3/projects/84094ca55a574d84ba5fe544c9d90f50` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:33.478149 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d59512-3efe-4edb-836d-d55745187cfa None admin] RBAC: Authorizing `identity:get_project(project_id=84094ca55a574d84ba5fe544c9d90f50)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:33.479971 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d59512-3efe-4edb-836d-d55745187cfa None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:33.491787 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 197/396] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Jul 23 20:57:33 2022] GET /identity/v3/projects/84094ca55a574d84ba5fe544c9d90f50 => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:57:33.493145 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d59512-3efe-4edb-836d-d55745187cfa None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:33.583351 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:33.629728 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1ecafa-b35b-4bbe-8441-f7e807e23c9d None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:33.676819 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e956d5f1-c2c0-445b-bfc1-6e8d1ef4c7ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:33.677146 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d59512-3efe-4edb-836d-d55745187cfa None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:33.678068 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e956d5f1-c2c0-445b-bfc1-6e8d1ef4c7ec None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:33.678669 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e956d5f1-c2c0-445b-bfc1-6e8d1ef4c7ec None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:33.679175 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e956d5f1-c2c0-445b-bfc1-6e8d1ef4c7ec None admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:33.680184 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e956d5f1-c2c0-445b-bfc1-6e8d1ef4c7ec None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:57:33.680680 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e956d5f1-c2c0-445b-bfc1-6e8d1ef4c7ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:33.682406 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e956d5f1-c2c0-445b-bfc1-6e8d1ef4c7ec None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:33.692797 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 200/397] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Jul 23 20:57:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:57:33.694707 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0504363-f154-4adc-968d-d06e77c6b16b None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:33.695246 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0504363-f154-4adc-968d-d06e77c6b16b None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:33.695715 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0504363-f154-4adc-968d-d06e77c6b16b None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:33.697492 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 201/398] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:57:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:57:33.698502 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0504363-f154-4adc-968d-d06e77c6b16b None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:33.717439 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0669d5d-a1fd-401f-b234-3976b183373e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:33.718660 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0669d5d-a1fd-401f-b234-3976b183373e None admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:33.718945 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0669d5d-a1fd-401f-b234-3976b183373e None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:33.719204 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0669d5d-a1fd-401f-b234-3976b183373e None admin] PATH_INFO: `/v3/projects/84094ca55a574d84ba5fe544c9d90f50/groups/1409e85b12ca4c6c9e929ac06c5c39a3/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:33.721854 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0669d5d-a1fd-401f-b234-3976b183373e None admin] RBAC: Authorizing `identity:create_grant(project_id=84094ca55a574d84ba5fe544c9d90f50, group_id=1409e85b12ca4c6c9e929ac06c5c39a3, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:33.723371 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0669d5d-a1fd-401f-b234-3976b183373e None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:33.740616 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 198/399] 10.222.0.17 () {58 vars in 1442 bytes} [Sat Jul 23 20:57:33 2022] PUT /identity/v3/projects/84094ca55a574d84ba5fe544c9d90f50/groups/1409e85b12ca4c6c9e929ac06c5c39a3/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 20:57:33.743254 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5543f691-0ccf-4156-8672-bace1b917672 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:33.743588 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5543f691-0ccf-4156-8672-bace1b917672 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:33.743868 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5543f691-0ccf-4156-8672-bace1b917672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:33.766139 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-5543f691-0ccf-4156-8672-bace1b917672 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:57:33.767644 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-5543f691-0ccf-4156-8672-bace1b917672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:57:33.792621 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:33.852939 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0504363-f154-4adc-968d-d06e77c6b16b None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:33.911056 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a87422-3fdd-4ec5-b914-e8d54f5741c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:33.912435 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a87422-3fdd-4ec5-b914-e8d54f5741c8 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:33.912714 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a87422-3fdd-4ec5-b914-e8d54f5741c8 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:33.912987 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a87422-3fdd-4ec5-b914-e8d54f5741c8 None admin] PATH_INFO: `/v3/groups/1409e85b12ca4c6c9e929ac06c5c39a3` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:33.914300 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a87422-3fdd-4ec5-b914-e8d54f5741c8 None admin] RBAC: Authorizing `identity:get_group(group_id=1409e85b12ca4c6c9e929ac06c5c39a3)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:33.916166 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a87422-3fdd-4ec5-b914-e8d54f5741c8 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:33.917905 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 202/400] 10.222.0.17 () {56 vars in 1180 bytes} [Sat Jul 23 20:57:33 2022] GET /identity/v3/groups/1409e85b12ca4c6c9e929ac06c5c39a3 => generated 226 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:57:33.923732 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 199/401] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:57:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 23 20:57:33.923893 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a87422-3fdd-4ec5-b914-e8d54f5741c8 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:33.928486 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:33.959716 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5543f691-0ccf-4156-8672-bace1b917672 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:34.062763 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a87422-3fdd-4ec5-b914-e8d54f5741c8 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:34.086831 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5543f691-0ccf-4156-8672-bace1b917672 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:34.116682 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b81b500-f51f-4c36-91ed-c98d1f8658c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:34.117596 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b81b500-f51f-4c36-91ed-c98d1f8658c6 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:34.119377 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b81b500-f51f-4c36-91ed-c98d1f8658c6 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:34.119377 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b81b500-f51f-4c36-91ed-c98d1f8658c6 None admin] PATH_INFO: `/v3/projects/74cb8c05a64040c48e6687c9bd9865d1` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:34.119569 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b81b500-f51f-4c36-91ed-c98d1f8658c6 None admin] RBAC: Authorizing `identity:get_project(project_id=74cb8c05a64040c48e6687c9bd9865d1)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:34.121000 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b81b500-f51f-4c36-91ed-c98d1f8658c6 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:34.126965 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 203/402] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Jul 23 20:57:33 2022] GET /identity/v3/projects/74cb8c05a64040c48e6687c9bd9865d1 => generated 298 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:57:34.134241 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b81b500-f51f-4c36-91ed-c98d1f8658c6 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:34.149443 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df33677e-3c3e-4677-90b5-2a65d763865a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:34.150321 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df33677e-3c3e-4677-90b5-2a65d763865a None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:34.150603 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df33677e-3c3e-4677-90b5-2a65d763865a None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:34.150876 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df33677e-3c3e-4677-90b5-2a65d763865a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:34.170936 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df33677e-3c3e-4677-90b5-2a65d763865a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:57:34.179609 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-df33677e-3c3e-4677-90b5-2a65d763865a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 23 20:57:34.179609 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:57:34.179609 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:57:34.179609 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:57:34.179609 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:57:34.179609 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:57:34.179609 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:57:34.179609 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:57:34.179609 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:57:34.179609 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:57:34.179609 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:57:34.179609 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:57:34.179609 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:57:34.179609 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:57:34.179609 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:57:34.179609 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:57:34.181636 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:57:34.181636 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:57:34.181636 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:57:34.181636 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:57:34.181636 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:57:34.181636 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:57:34.181636 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:57:34.181636 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:57:34.181636 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:57:34.181636 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:57:34.181636 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:57:34.181636 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application with Lock( Jul 23 20:57:34.181636 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:57:34.181636 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:57:34.181636 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:57:34.181636 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:57:34.183557 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:57:34.183557 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:57:34.183557 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:57:34.183557 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:57:34.183557 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:57:34.183557 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:57:34.183557 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:57:34.183557 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:57:34.183557 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:57:34.183557 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:57:34.183557 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 23 20:57:34.183557 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 20:57:34.183557 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 200/403] 10.222.0.17 () {56 vars in 1114 bytes} [Sat Jul 23 20:57:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 23 20:57:34.194939 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df33677e-3c3e-4677-90b5-2a65d763865a None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:34.222789 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:34.272230 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:34.319964 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b81b500-f51f-4c36-91ed-c98d1f8658c6 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:34.356280 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df33677e-3c3e-4677-90b5-2a65d763865a None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:34.361662 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99c952e-149c-434d-8977-5545764ed518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:34.362664 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99c952e-149c-434d-8977-5545764ed518 None admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:34.363065 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99c952e-149c-434d-8977-5545764ed518 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:34.363401 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99c952e-149c-434d-8977-5545764ed518 None admin] PATH_INFO: `/v3/projects/74cb8c05a64040c48e6687c9bd9865d1/groups/1409e85b12ca4c6c9e929ac06c5c39a3/roles/c5f46541d35e44b691baa7a1fa304c0f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:34.366268 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99c952e-149c-434d-8977-5545764ed518 None admin] RBAC: Authorizing `identity:create_grant(project_id=74cb8c05a64040c48e6687c9bd9865d1, group_id=1409e85b12ca4c6c9e929ac06c5c39a3, role_id=c5f46541d35e44b691baa7a1fa304c0f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:34.368155 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99c952e-149c-434d-8977-5545764ed518 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:34.393923 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 204/404] 10.222.0.17 () {58 vars in 1442 bytes} [Sat Jul 23 20:57:34 2022] PUT /identity/v3/projects/74cb8c05a64040c48e6687c9bd9865d1/groups/1409e85b12ca4c6c9e929ac06c5c39a3/roles/c5f46541d35e44b691baa7a1fa304c0f => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 20:57:34.393923 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dc196e-fa8d-4a6b-9a77-cd160d89cf79 None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:34.393923 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dc196e-fa8d-4a6b-9a77-cd160d89cf79 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:34.393923 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dc196e-fa8d-4a6b-9a77-cd160d89cf79 None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:34.393923 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 205/405] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:57:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:57:34.403713 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b0500e-330d-49b1-bddc-26888077d338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:34.404510 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b0500e-330d-49b1-bddc-26888077d338 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:34.404794 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b0500e-330d-49b1-bddc-26888077d338 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:34.405071 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b0500e-330d-49b1-bddc-26888077d338 None admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:34.405830 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b0500e-330d-49b1-bddc-26888077d338 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:57:34.406277 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b0500e-330d-49b1-bddc-26888077d338 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:34.407700 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b0500e-330d-49b1-bddc-26888077d338 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:34.410814 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4da338-fa06-4d8a-811f-fd174abc284b None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:34.411190 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4da338-fa06-4d8a-811f-fd174abc284b None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:34.411571 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4da338-fa06-4d8a-811f-fd174abc284b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:34.440084 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 201/406] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Jul 23 20:57:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:57:34.442201 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-7f4da338-fa06-4d8a-811f-fd174abc284b None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:57:34.445706 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b0500e-330d-49b1-bddc-26888077d338 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:34.446398 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-7f4da338-fa06-4d8a-811f-fd174abc284b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:57:34.546752 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 206/407] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:57:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 23 20:57:34.590318 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4da338-fa06-4d8a-811f-fd174abc284b None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:34.607163 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:34.643059 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b0500e-330d-49b1-bddc-26888077d338 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:34.670196 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:34.688652 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fa1d74-33e7-4570-91d7-2b8456427532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:34.689992 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fa1d74-33e7-4570-91d7-2b8456427532 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:34.690554 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fa1d74-33e7-4570-91d7-2b8456427532 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:34.691111 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fa1d74-33e7-4570-91d7-2b8456427532 None admin] PATH_INFO: `/v3/groups/1409e85b12ca4c6c9e929ac06c5c39a3` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:34.692624 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fa1d74-33e7-4570-91d7-2b8456427532 None admin] RBAC: Authorizing `identity:get_group(group_id=1409e85b12ca4c6c9e929ac06c5c39a3)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:34.694310 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fa1d74-33e7-4570-91d7-2b8456427532 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:34.696400 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 202/408] 10.222.0.17 () {56 vars in 1180 bytes} [Sat Jul 23 20:57:34 2022] GET /identity/v3/groups/1409e85b12ca4c6c9e929ac06c5c39a3 => generated 226 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:57:34.702088 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fa1d74-33e7-4570-91d7-2b8456427532 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:34.717113 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4da338-fa06-4d8a-811f-fd174abc284b None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:34.769636 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df8cfb7-863a-4a10-bae8-c7809d7134db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:34.770536 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df8cfb7-863a-4a10-bae8-c7809d7134db None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:34.770811 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df8cfb7-863a-4a10-bae8-c7809d7134db None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:34.771080 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df8cfb7-863a-4a10-bae8-c7809d7134db None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:34.794084 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df8cfb7-863a-4a10-bae8-c7809d7134db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:57:34.809648 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-9df8cfb7-863a-4a10-bae8-c7809d7134db None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 23 20:57:34.809648 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:57:34.809648 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:57:34.809648 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:57:34.809648 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:57:34.809648 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:57:34.809648 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:57:34.809648 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:57:34.809648 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:57:34.809648 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:57:34.809648 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:57:34.809648 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:57:34.809648 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:57:34.809648 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:57:34.809648 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:57:34.809648 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:57:34.810668 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:57:34.810668 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:57:34.810668 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:57:34.810668 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:57:34.810668 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:57:34.810668 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:57:34.810668 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:57:34.810668 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:57:34.810668 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:57:34.810668 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:57:34.810668 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:57:34.810668 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application with Lock( Jul 23 20:57:34.810668 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:57:34.810668 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:57:34.810668 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:57:34.810668 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:57:34.811455 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:57:34.811455 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:57:34.811455 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:57:34.811455 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:57:34.811455 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:57:34.811455 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:57:34.811455 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:57:34.811455 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:57:34.811455 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:57:34.811455 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:57:34.811455 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 23 20:57:34.811455 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:57:34.822064 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 207/409] 10.222.0.17 () {56 vars in 1096 bytes} [Sat Jul 23 20:57:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 23 20:57:34.833988 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df8cfb7-863a-4a10-bae8-c7809d7134db None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:34.904235 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fa1d74-33e7-4570-91d7-2b8456427532 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:34.940102 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e53a55-aee8-4d1e-8e1c-7e7762b7d51d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:34.941265 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e53a55-aee8-4d1e-8e1c-7e7762b7d51d None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:34.941441 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e53a55-aee8-4d1e-8e1c-7e7762b7d51d None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:34.941709 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e53a55-aee8-4d1e-8e1c-7e7762b7d51d None admin] PATH_INFO: `/v3/projects/84094ca55a574d84ba5fe544c9d90f50` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:34.943039 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e53a55-aee8-4d1e-8e1c-7e7762b7d51d None admin] RBAC: Authorizing `identity:get_project(project_id=84094ca55a574d84ba5fe544c9d90f50)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:34.944661 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e53a55-aee8-4d1e-8e1c-7e7762b7d51d None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:34.946746 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 203/410] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Jul 23 20:57:34 2022] GET /identity/v3/projects/84094ca55a574d84ba5fe544c9d90f50 => generated 302 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:57:34.953002 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e53a55-aee8-4d1e-8e1c-7e7762b7d51d None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:34.991866 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df8cfb7-863a-4a10-bae8-c7809d7134db None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:35.019345 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:35.033102 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:35.059978 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9675a6b5-3964-4cdc-abcf-b765af7d5841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:35.060666 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9675a6b5-3964-4cdc-abcf-b765af7d5841 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:35.061024 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9675a6b5-3964-4cdc-abcf-b765af7d5841 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:35.061207 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9675a6b5-3964-4cdc-abcf-b765af7d5841 None admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:35.061997 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9675a6b5-3964-4cdc-abcf-b765af7d5841 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:57:35.062301 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9675a6b5-3964-4cdc-abcf-b765af7d5841 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:35.063904 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9675a6b5-3964-4cdc-abcf-b765af7d5841 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:35.067519 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e53a55-aee8-4d1e-8e1c-7e7762b7d51d None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:35.085906 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 208/411] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Jul 23 20:57:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 20:57:35.086609 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9675a6b5-3964-4cdc-abcf-b765af7d5841 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:35.140238 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b918b05c-ccb6-4af4-a23f-c176dc5cad79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:35.141149 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b918b05c-ccb6-4af4-a23f-c176dc5cad79 None admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:35.141430 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b918b05c-ccb6-4af4-a23f-c176dc5cad79 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:35.141705 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b918b05c-ccb6-4af4-a23f-c176dc5cad79 None admin] PATH_INFO: `/v3/projects/84094ca55a574d84ba5fe544c9d90f50/groups/1409e85b12ca4c6c9e929ac06c5c39a3/roles/c5f46541d35e44b691baa7a1fa304c0f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:35.147876 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b918b05c-ccb6-4af4-a23f-c176dc5cad79 None admin] RBAC: Authorizing `identity:create_grant(project_id=84094ca55a574d84ba5fe544c9d90f50, group_id=1409e85b12ca4c6c9e929ac06c5c39a3, role_id=c5f46541d35e44b691baa7a1fa304c0f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:35.149571 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b918b05c-ccb6-4af4-a23f-c176dc5cad79 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:35.168254 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 204/412] 10.222.0.17 () {58 vars in 1442 bytes} [Sat Jul 23 20:57:34 2022] PUT /identity/v3/projects/84094ca55a574d84ba5fe544c9d90f50/groups/1409e85b12ca4c6c9e929ac06c5c39a3/roles/c5f46541d35e44b691baa7a1fa304c0f => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 20:57:35.220255 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9675a6b5-3964-4cdc-abcf-b765af7d5841 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:35.265718 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dc2602-923e-4e7a-a3ff-e70ce8afd339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:35.266660 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dc2602-923e-4e7a-a3ff-e70ce8afd339 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:35.266935 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dc2602-923e-4e7a-a3ff-e70ce8afd339 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:35.267207 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dc2602-923e-4e7a-a3ff-e70ce8afd339 None admin] PATH_INFO: `/v3/groups/350e0fc337674c8a9f982c41700e04f8` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:35.270917 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dc2602-923e-4e7a-a3ff-e70ce8afd339 None admin] RBAC: Authorizing `identity:get_group(group_id=350e0fc337674c8a9f982c41700e04f8)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:35.272452 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dc2602-923e-4e7a-a3ff-e70ce8afd339 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:35.274657 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 209/413] 10.222.0.17 () {56 vars in 1180 bytes} [Sat Jul 23 20:57:35 2022] GET /identity/v3/groups/350e0fc337674c8a9f982c41700e04f8 => generated 229 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 20:57:35.281188 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b918b05c-ccb6-4af4-a23f-c176dc5cad79 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:35.396600 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:35.424897 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b918b05c-ccb6-4af4-a23f-c176dc5cad79 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:35.463210 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0b08c9-b437-479b-ac29-ea3404a1a825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:35.464206 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0b08c9-b437-479b-ac29-ea3404a1a825 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:35.464488 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0b08c9-b437-479b-ac29-ea3404a1a825 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:35.464768 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0b08c9-b437-479b-ac29-ea3404a1a825 None admin] PATH_INFO: `/v3/projects/d6f3124c18f04946a431e587fc205bd4` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:35.465999 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0b08c9-b437-479b-ac29-ea3404a1a825 None admin] RBAC: Authorizing `identity:get_project(project_id=d6f3124c18f04946a431e587fc205bd4)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:35.467465 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0b08c9-b437-479b-ac29-ea3404a1a825 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:35.469533 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 205/414] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Jul 23 20:57:35 2022] GET /identity/v3/projects/d6f3124c18f04946a431e587fc205bd4 => generated 344 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:57:35.475773 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dc2602-923e-4e7a-a3ff-e70ce8afd339 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:35.539144 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:35.599743 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dc2602-923e-4e7a-a3ff-e70ce8afd339 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:35.643566 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b89005-dac0-4c40-b7d3-9fa75a673e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:35.644530 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b89005-dac0-4c40-b7d3-9fa75a673e40 None admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:35.644817 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b89005-dac0-4c40-b7d3-9fa75a673e40 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:35.645089 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b89005-dac0-4c40-b7d3-9fa75a673e40 None admin] PATH_INFO: `/v3/projects/d6f3124c18f04946a431e587fc205bd4/groups/350e0fc337674c8a9f982c41700e04f8/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:35.647139 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b89005-dac0-4c40-b7d3-9fa75a673e40 None admin] RBAC: Authorizing `identity:create_grant(project_id=d6f3124c18f04946a431e587fc205bd4, group_id=350e0fc337674c8a9f982c41700e04f8, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:35.648612 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b89005-dac0-4c40-b7d3-9fa75a673e40 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:35.668746 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 210/415] 10.222.0.17 () {58 vars in 1442 bytes} [Sat Jul 23 20:57:35 2022] PUT /identity/v3/projects/d6f3124c18f04946a431e587fc205bd4/groups/350e0fc337674c8a9f982c41700e04f8/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 20:57:36.212191 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b098d3ac-66e5-4d6c-8e66-fdffe3c8caf8 None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:36.212695 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b098d3ac-66e5-4d6c-8e66-fdffe3c8caf8 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:36.212695 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b098d3ac-66e5-4d6c-8e66-fdffe3c8caf8 None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:36.214415 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 206/416] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:57:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:57:36.220202 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23766bca-be3d-44ad-a0a1-d5229fa65511 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:36.220684 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23766bca-be3d-44ad-a0a1-d5229fa65511 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:36.220756 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23766bca-be3d-44ad-a0a1-d5229fa65511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:36.238760 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-23766bca-be3d-44ad-a0a1-d5229fa65511 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:57:36.239990 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-23766bca-be3d-44ad-a0a1-d5229fa65511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:57:36.322417 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 211/417] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:57:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 23 20:57:36.348153 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b098d3ac-66e5-4d6c-8e66-fdffe3c8caf8 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:36.465944 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b098d3ac-66e5-4d6c-8e66-fdffe3c8caf8 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:36.501233 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbf67e8-4071-4a38-94a0-f7ca77317e7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:36.502086 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbf67e8-4071-4a38-94a0-f7ca77317e7c None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:36.502366 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbf67e8-4071-4a38-94a0-f7ca77317e7c None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:36.502639 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbf67e8-4071-4a38-94a0-f7ca77317e7c None admin] PATH_INFO: `/v3/roles/member` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:36.510260 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:36.514034 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbf67e8-4071-4a38-94a0-f7ca77317e7c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:57:36.522516 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-1bbf67e8-4071-4a38-94a0-f7ca77317e7c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 23 20:57:36.522516 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:57:36.522516 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:57:36.522516 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:57:36.522516 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:57:36.522516 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:57:36.522516 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:57:36.522516 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:57:36.522516 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:57:36.522516 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:57:36.522516 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:57:36.522516 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:57:36.522516 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:57:36.522516 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:57:36.522516 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:57:36.522516 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:57:36.523662 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:57:36.523662 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:57:36.523662 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:57:36.523662 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:57:36.523662 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:57:36.523662 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:57:36.523662 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:57:36.523662 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:57:36.523662 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:57:36.523662 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:57:36.523662 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:57:36.523662 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application with Lock( Jul 23 20:57:36.523662 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:57:36.523662 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:57:36.523662 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:57:36.523662 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:57:36.524532 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:57:36.524532 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:57:36.524532 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:57:36.524532 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:57:36.524532 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:57:36.524532 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:57:36.524532 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:57:36.524532 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:57:36.524532 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:57:36.524532 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:57:36.524532 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 23 20:57:36.524532 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 20:57:36.530045 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 207/418] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Jul 23 20:57:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:57:36.533895 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23766bca-be3d-44ad-a0a1-d5229fa65511 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:36.585169 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:36.661633 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23766bca-be3d-44ad-a0a1-d5229fa65511 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:36.706511 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9e0a91-28ee-467c-8907-8ac8b328df5a None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:36.706924 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9e0a91-28ee-467c-8907-8ac8b328df5a None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:36.707174 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9e0a91-28ee-467c-8907-8ac8b328df5a None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:36.708650 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b906ef68-0f47-4530-af01-d94b17600281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:36.709046 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 208/419] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:57:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 23 20:57:36.709890 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b906ef68-0f47-4530-af01-d94b17600281 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:36.710434 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b906ef68-0f47-4530-af01-d94b17600281 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:36.710902 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b906ef68-0f47-4530-af01-d94b17600281 None admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:36.711886 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b906ef68-0f47-4530-af01-d94b17600281 None admin] RBAC: Adding query filter params (name=member) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:57:36.712385 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b906ef68-0f47-4530-af01-d94b17600281 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:36.714336 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0fe430-ccc4-4bda-80fd-ca0af59026ea None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:36.714625 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0fe430-ccc4-4bda-80fd-ca0af59026ea None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:36.714903 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0fe430-ccc4-4bda-80fd-ca0af59026ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:36.720693 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b906ef68-0f47-4530-af01-d94b17600281 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:36.743635 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 212/420] 10.222.0.17 () {56 vars in 1101 bytes} [Sat Jul 23 20:57:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:57:36.744500 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-4f0fe430-ccc4-4bda-80fd-ca0af59026ea None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:57:36.745737 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-4f0fe430-ccc4-4bda-80fd-ca0af59026ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:57:36.750871 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b906ef68-0f47-4530-af01-d94b17600281 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:36.904916 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 209/421] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:57:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 23 20:57:36.909723 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b906ef68-0f47-4530-af01-d94b17600281 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:36.912628 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:36.943409 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0fe430-ccc4-4bda-80fd-ca0af59026ea None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:36.955573 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2237fbcc-4800-4ed4-b9f4-7a298a97a92c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:36.956775 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2237fbcc-4800-4ed4-b9f4-7a298a97a92c None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:36.957262 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2237fbcc-4800-4ed4-b9f4-7a298a97a92c None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:36.957762 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2237fbcc-4800-4ed4-b9f4-7a298a97a92c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:37.036284 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2237fbcc-4800-4ed4-b9f4-7a298a97a92c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:37.038181 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2237fbcc-4800-4ed4-b9f4-7a298a97a92c None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:37.112331 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0fe430-ccc4-4bda-80fd-ca0af59026ea None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:37.139991 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:37.149528 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dc4ee8-6b87-42da-8b19-92c3f7d960b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:37.150409 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dc4ee8-6b87-42da-8b19-92c3f7d960b5 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:37.150642 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dc4ee8-6b87-42da-8b19-92c3f7d960b5 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:37.156275 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dc4ee8-6b87-42da-8b19-92c3f7d960b5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:37.156685 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 213/422] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Jul 23 20:57:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 23 20:57:37.158955 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6672dc54-b8f0-460a-891b-1f7744bddd37 None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:37.159605 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6672dc54-b8f0-460a-891b-1f7744bddd37 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:37.160275 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6672dc54-b8f0-460a-891b-1f7744bddd37 None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:37.163433 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 214/423] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:57:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:57:37.164226 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dc4ee8-6b87-42da-8b19-92c3f7d960b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:57:37.165506 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6672dc54-b8f0-460a-891b-1f7744bddd37 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:37.169764 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:37.173057 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-30dc4ee8-6b87-42da-8b19-92c3f7d960b5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 23 20:57:37.173057 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:57:37.173057 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:57:37.173057 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:57:37.173057 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:57:37.173057 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:57:37.173057 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:57:37.173057 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:57:37.173057 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:57:37.173057 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:57:37.173057 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:57:37.173057 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:57:37.173057 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:57:37.173057 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:57:37.173057 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:57:37.173057 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:57:37.174049 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:57:37.174049 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:57:37.174049 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:57:37.174049 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:57:37.174049 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:57:37.174049 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:57:37.174049 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:57:37.174049 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:57:37.174049 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:57:37.174049 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:57:37.174049 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:57:37.174049 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application with Lock( Jul 23 20:57:37.174049 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:57:37.174049 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:57:37.174049 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:57:37.174049 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:57:37.175329 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:57:37.175329 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:57:37.175329 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:57:37.175329 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:57:37.175329 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:57:37.175329 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:57:37.175329 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:57:37.175329 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:57:37.175329 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:57:37.175329 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:57:37.175329 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 23 20:57:37.175329 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 20:57:37.175329 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 210/424] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Jul 23 20:57:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 23 20:57:37.176369 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5105c04e-fd2b-4132-bdf9-e0af817a754e None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:37.176529 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5105c04e-fd2b-4132-bdf9-e0af817a754e None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:37.176793 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5105c04e-fd2b-4132-bdf9-e0af817a754e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:37.194758 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-5105c04e-fd2b-4132-bdf9-e0af817a754e None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:57:37.195944 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-5105c04e-fd2b-4132-bdf9-e0af817a754e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:57:37.267778 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 211/425] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:57:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 23 20:57:37.268707 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5105c04e-fd2b-4132-bdf9-e0af817a754e None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:37.286180 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6672dc54-b8f0-460a-891b-1f7744bddd37 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:37.326756 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8e493d-5cc2-47fb-b63a-9600b494821e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:37.328001 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8e493d-5cc2-47fb-b63a-9600b494821e None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:37.328480 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8e493d-5cc2-47fb-b63a-9600b494821e None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:37.328950 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8e493d-5cc2-47fb-b63a-9600b494821e None admin] PATH_INFO: `/v3/projects/74cb8c05a64040c48e6687c9bd9865d1` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:37.330552 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8e493d-5cc2-47fb-b63a-9600b494821e None admin] RBAC: Authorizing `identity:get_project(project_id=74cb8c05a64040c48e6687c9bd9865d1)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:37.332995 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8e493d-5cc2-47fb-b63a-9600b494821e None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:37.340457 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 215/426] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Jul 23 20:57:37 2022] GET /identity/v3/projects/74cb8c05a64040c48e6687c9bd9865d1 => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:57:37.340457 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8e493d-5cc2-47fb-b63a-9600b494821e None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:37.419391 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:37.423339 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5105c04e-fd2b-4132-bdf9-e0af817a754e None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:37.450107 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:37.456073 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8e493d-5cc2-47fb-b63a-9600b494821e None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:37.470219 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1a056a-62ca-4221-b5f6-5b576830fc59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:37.471342 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1a056a-62ca-4221-b5f6-5b576830fc59 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:37.471787 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1a056a-62ca-4221-b5f6-5b576830fc59 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:37.472387 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1a056a-62ca-4221-b5f6-5b576830fc59 None admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:37.473582 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1a056a-62ca-4221-b5f6-5b576830fc59 None admin] RBAC: Adding query filter params (name=member) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:57:37.474106 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1a056a-62ca-4221-b5f6-5b576830fc59 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:37.475853 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1a056a-62ca-4221-b5f6-5b576830fc59 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:37.485961 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 212/427] 10.222.0.17 () {56 vars in 1101 bytes} [Sat Jul 23 20:57:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:57:37.491966 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1a056a-62ca-4221-b5f6-5b576830fc59 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:37.494389 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489b5b8c-9fd1-4579-ba1a-0a17addede85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:37.495287 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489b5b8c-9fd1-4579-ba1a-0a17addede85 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:37.495652 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489b5b8c-9fd1-4579-ba1a-0a17addede85 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:37.495982 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489b5b8c-9fd1-4579-ba1a-0a17addede85 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:37.507777 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489b5b8c-9fd1-4579-ba1a-0a17addede85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:57:37.516658 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-489b5b8c-9fd1-4579-ba1a-0a17addede85 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 23 20:57:37.516658 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:57:37.516658 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:57:37.516658 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:57:37.516658 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:57:37.516658 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:57:37.516658 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:57:37.516658 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:57:37.516658 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:57:37.516658 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:57:37.516658 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:57:37.516658 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:57:37.516658 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:57:37.516658 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:57:37.516658 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:57:37.516658 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:57:37.517626 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:57:37.517626 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:57:37.517626 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:57:37.517626 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:57:37.517626 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:57:37.517626 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:57:37.517626 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:57:37.517626 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:57:37.517626 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:57:37.517626 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:57:37.517626 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:57:37.517626 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application with Lock( Jul 23 20:57:37.517626 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:57:37.517626 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:57:37.517626 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:57:37.517626 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:57:37.518475 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:57:37.518475 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:57:37.518475 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:57:37.518475 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:57:37.518475 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:57:37.518475 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:57:37.518475 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:57:37.518475 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:57:37.518475 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:57:37.518475 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:57:37.518475 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 23 20:57:37.518475 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:57:37.518475 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 216/428] 10.222.0.17 () {56 vars in 1114 bytes} [Sat Jul 23 20:57:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:57:37.519239 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489b5b8c-9fd1-4579-ba1a-0a17addede85 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:37.613507 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1a056a-62ca-4221-b5f6-5b576830fc59 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:37.628918 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489b5b8c-9fd1-4579-ba1a-0a17addede85 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:37.653196 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1a593c-2ace-4a87-9623-6aaf0546fe38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:37.654813 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1a593c-2ace-4a87-9623-6aaf0546fe38 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:37.655336 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1a593c-2ace-4a87-9623-6aaf0546fe38 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:37.655870 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1a593c-2ace-4a87-9623-6aaf0546fe38 None admin] PATH_INFO: `/v3/groups/1409e85b12ca4c6c9e929ac06c5c39a3` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:37.657329 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1a593c-2ace-4a87-9623-6aaf0546fe38 None admin] RBAC: Authorizing `identity:get_group(group_id=1409e85b12ca4c6c9e929ac06c5c39a3)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:37.659226 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1a593c-2ace-4a87-9623-6aaf0546fe38 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:37.661539 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 213/429] 10.222.0.17 () {56 vars in 1180 bytes} [Sat Jul 23 20:57:37 2022] GET /identity/v3/groups/1409e85b12ca4c6c9e929ac06c5c39a3 => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:57:37.662167 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:37.664077 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1a593c-2ace-4a87-9623-6aaf0546fe38 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:37.668491 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c134626-b3cf-4e17-8e3b-b79e07283de9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:37.669211 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c134626-b3cf-4e17-8e3b-b79e07283de9 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:37.669551 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c134626-b3cf-4e17-8e3b-b79e07283de9 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:37.669951 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c134626-b3cf-4e17-8e3b-b79e07283de9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:37.721899 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:37.755766 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c134626-b3cf-4e17-8e3b-b79e07283de9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:37.760553 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c134626-b3cf-4e17-8e3b-b79e07283de9 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:37.792558 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1a593c-2ace-4a87-9623-6aaf0546fe38 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:37.832747 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bbcee9-eac8-4fec-a57c-6aaeb4f1c341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:37.833735 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bbcee9-eac8-4fec-a57c-6aaeb4f1c341 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:37.834250 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bbcee9-eac8-4fec-a57c-6aaeb4f1c341 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:37.834695 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bbcee9-eac8-4fec-a57c-6aaeb4f1c341 None admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:37.835610 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bbcee9-eac8-4fec-a57c-6aaeb4f1c341 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:57:37.836110 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bbcee9-eac8-4fec-a57c-6aaeb4f1c341 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:37.837795 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bbcee9-eac8-4fec-a57c-6aaeb4f1c341 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:37.847430 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 214/430] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Jul 23 20:57:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:57:37.848540 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bbcee9-eac8-4fec-a57c-6aaeb4f1c341 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:37.885767 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 217/431] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Jul 23 20:57:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 23 20:57:37.890851 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c134626-b3cf-4e17-8e3b-b79e07283de9 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:37.923483 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:37.970388 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bbcee9-eac8-4fec-a57c-6aaeb4f1c341 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:37.982897 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:37.998886 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c134626-b3cf-4e17-8e3b-b79e07283de9 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:38.010375 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7152b4d0-a77f-4793-9fed-5af69a126293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:38.011524 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7152b4d0-a77f-4793-9fed-5af69a126293 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:38.012001 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7152b4d0-a77f-4793-9fed-5af69a126293 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:38.012470 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7152b4d0-a77f-4793-9fed-5af69a126293 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:38.013614 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7152b4d0-a77f-4793-9fed-5af69a126293 None admin] RBAC: Adding query filter params (group.id=1409e85b12ca4c6c9e929ac06c5c39a3, role.id=14824669685048b38361b1676f7f0f9f, scope.project.id=74cb8c05a64040c48e6687c9bd9865d1) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:57:38.014208 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7152b4d0-a77f-4793-9fed-5af69a126293 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:38.015939 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7152b4d0-a77f-4793-9fed-5af69a126293 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:38.023420 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 215/432] 10.222.0.17 () {56 vars in 1376 bytes} [Sat Jul 23 20:57:37 2022] GET /identity/v3/role_assignments?group.id=1409e85b12ca4c6c9e929ac06c5c39a3&scope.project.id=74cb8c05a64040c48e6687c9bd9865d1&role.id=14824669685048b38361b1676f7f0f9f => generated 611 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:57:38.024687 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7152b4d0-a77f-4793-9fed-5af69a126293 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:38.047503 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740dc11d-180d-451d-b889-f1f7ec6d7b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:38.048296 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740dc11d-180d-451d-b889-f1f7ec6d7b47 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:38.048687 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740dc11d-180d-451d-b889-f1f7ec6d7b47 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:38.048965 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740dc11d-180d-451d-b889-f1f7ec6d7b47 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:38.140167 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740dc11d-180d-451d-b889-f1f7ec6d7b47 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:38.141619 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740dc11d-180d-451d-b889-f1f7ec6d7b47 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:38.181637 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:38.186344 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7152b4d0-a77f-4793-9fed-5af69a126293 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:38.233851 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ea3d1d-ecad-483a-a7f4-3ace73e7728e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:38.235177 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ea3d1d-ecad-483a-a7f4-3ace73e7728e None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:38.235664 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ea3d1d-ecad-483a-a7f4-3ace73e7728e None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:38.236157 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ea3d1d-ecad-483a-a7f4-3ace73e7728e None admin] PATH_INFO: `/v3/projects/84094ca55a574d84ba5fe544c9d90f50` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:38.237924 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ea3d1d-ecad-483a-a7f4-3ace73e7728e None admin] RBAC: Authorizing `identity:get_project(project_id=84094ca55a574d84ba5fe544c9d90f50)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:38.240457 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ea3d1d-ecad-483a-a7f4-3ace73e7728e None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:38.243096 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 216/433] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Jul 23 20:57:38 2022] GET /identity/v3/projects/84094ca55a574d84ba5fe544c9d90f50 => generated 302 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:57:38.246038 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2807d5-3fcf-4301-863f-1b36179f9f6d None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:38.247007 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2807d5-3fcf-4301-863f-1b36179f9f6d None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:38.247668 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2807d5-3fcf-4301-863f-1b36179f9f6d None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:38.254478 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 217/434] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:57:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:57:38.255198 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2807d5-3fcf-4301-863f-1b36179f9f6d None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:38.293278 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 218/435] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Jul 23 20:57:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 23 20:57:38.299946 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453bc97b-1b8e-438c-9636-1befbb09033f None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:38.299946 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453bc97b-1b8e-438c-9636-1befbb09033f None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:38.299946 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453bc97b-1b8e-438c-9636-1befbb09033f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:38.317816 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:38.322525 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-453bc97b-1b8e-438c-9636-1befbb09033f None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:57:38.323749 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-453bc97b-1b8e-438c-9636-1befbb09033f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:57:38.413394 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2807d5-3fcf-4301-863f-1b36179f9f6d None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:38.434409 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 219/436] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:57:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 23 20:57:38.435163 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453bc97b-1b8e-438c-9636-1befbb09033f None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:38.453472 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb2fdcc-f75d-476d-8045-d044b1809bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:38.454710 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb2fdcc-f75d-476d-8045-d044b1809bda None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:38.454988 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb2fdcc-f75d-476d-8045-d044b1809bda None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:38.455259 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb2fdcc-f75d-476d-8045-d044b1809bda None admin] PATH_INFO: `/v3/groups/1409e85b12ca4c6c9e929ac06c5c39a3` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:38.456851 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb2fdcc-f75d-476d-8045-d044b1809bda None admin] RBAC: Authorizing `identity:get_group(group_id=1409e85b12ca4c6c9e929ac06c5c39a3)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:38.459036 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb2fdcc-f75d-476d-8045-d044b1809bda None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:38.461533 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 218/437] 10.222.0.17 () {56 vars in 1180 bytes} [Sat Jul 23 20:57:38 2022] GET /identity/v3/groups/1409e85b12ca4c6c9e929ac06c5c39a3 => generated 226 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:57:38.468537 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb2fdcc-f75d-476d-8045-d044b1809bda None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:38.533781 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:38.597853 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453bc97b-1b8e-438c-9636-1befbb09033f None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:38.621620 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb2fdcc-f75d-476d-8045-d044b1809bda None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:38.635081 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:38.640692 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df7c874-7e8b-4d7f-94bd-1830e0038a34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:38.641589 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df7c874-7e8b-4d7f-94bd-1830e0038a34 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:38.641933 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df7c874-7e8b-4d7f-94bd-1830e0038a34 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:38.642167 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df7c874-7e8b-4d7f-94bd-1830e0038a34 None admin] PATH_INFO: `/v3/projects/74cb8c05a64040c48e6687c9bd9865d1` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:38.643409 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df7c874-7e8b-4d7f-94bd-1830e0038a34 None admin] RBAC: Authorizing `identity:get_project(project_id=74cb8c05a64040c48e6687c9bd9865d1)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:38.645041 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df7c874-7e8b-4d7f-94bd-1830e0038a34 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:38.646846 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 220/438] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Jul 23 20:57:38 2022] GET /identity/v3/projects/74cb8c05a64040c48e6687c9bd9865d1 => generated 298 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:57:38.647688 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df7c874-7e8b-4d7f-94bd-1830e0038a34 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:38.662284 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4149dd-e710-40ad-b681-9af4675ee79d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:38.663125 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4149dd-e710-40ad-b681-9af4675ee79d None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:38.663461 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4149dd-e710-40ad-b681-9af4675ee79d None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:38.663675 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4149dd-e710-40ad-b681-9af4675ee79d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:38.674610 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4149dd-e710-40ad-b681-9af4675ee79d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:57:38.682879 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-3f4149dd-e710-40ad-b681-9af4675ee79d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 23 20:57:38.682879 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:57:38.682879 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:57:38.682879 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:57:38.682879 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:57:38.682879 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:57:38.682879 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:57:38.682879 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:57:38.682879 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:57:38.682879 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:57:38.682879 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:57:38.682879 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:57:38.682879 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:57:38.682879 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:57:38.682879 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:57:38.682879 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:57:38.683880 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:57:38.683880 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:57:38.683880 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:57:38.683880 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:57:38.683880 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:57:38.683880 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:57:38.683880 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:57:38.683880 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:57:38.683880 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:57:38.683880 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:57:38.683880 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:57:38.683880 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application with Lock( Jul 23 20:57:38.683880 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:57:38.683880 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:57:38.683880 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:57:38.683880 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:57:38.684674 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:57:38.684674 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:57:38.684674 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:57:38.684674 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:57:38.684674 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:57:38.684674 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:57:38.684674 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:57:38.684674 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:57:38.684674 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:57:38.684674 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:57:38.684674 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 23 20:57:38.684674 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 20:57:38.684674 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 219/439] 10.222.0.17 () {56 vars in 1114 bytes} [Sat Jul 23 20:57:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 23 20:57:38.685499 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab4fef3-d284-45ff-a0bc-067ad72edfb0 None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:38.685651 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab4fef3-d284-45ff-a0bc-067ad72edfb0 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:38.686081 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab4fef3-d284-45ff-a0bc-067ad72edfb0 None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:38.687504 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 220/440] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:57:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:57:38.690695 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab4fef3-d284-45ff-a0bc-067ad72edfb0 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:38.750214 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df7c874-7e8b-4d7f-94bd-1830e0038a34 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:38.779789 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:38.786563 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3425ba5e-b685-4fde-83c8-35c2abfba13d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:38.787247 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3425ba5e-b685-4fde-83c8-35c2abfba13d None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:38.787523 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3425ba5e-b685-4fde-83c8-35c2abfba13d None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:38.787799 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3425ba5e-b685-4fde-83c8-35c2abfba13d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:38.788667 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3425ba5e-b685-4fde-83c8-35c2abfba13d None admin] RBAC: Adding query filter params (group.id=1409e85b12ca4c6c9e929ac06c5c39a3, role.id=14824669685048b38361b1676f7f0f9f, scope.project.id=84094ca55a574d84ba5fe544c9d90f50) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:57:38.789004 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3425ba5e-b685-4fde-83c8-35c2abfba13d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:38.790446 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3425ba5e-b685-4fde-83c8-35c2abfba13d None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:38.796685 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 221/441] 10.222.0.17 () {56 vars in 1376 bytes} [Sat Jul 23 20:57:38 2022] GET /identity/v3/role_assignments?group.id=1409e85b12ca4c6c9e929ac06c5c39a3&scope.project.id=84094ca55a574d84ba5fe544c9d90f50&role.id=14824669685048b38361b1676f7f0f9f => generated 611 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:57:38.797485 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab4fef3-d284-45ff-a0bc-067ad72edfb0 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:38.797615 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3425ba5e-b685-4fde-83c8-35c2abfba13d None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:38.836868 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80773ef-c8b1-423f-a90f-70bc2d5cb2ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:38.837901 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80773ef-c8b1-423f-a90f-70bc2d5cb2ef None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:38.838110 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80773ef-c8b1-423f-a90f-70bc2d5cb2ef None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:38.838350 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80773ef-c8b1-423f-a90f-70bc2d5cb2ef None admin] PATH_INFO: `/v3/groups/1409e85b12ca4c6c9e929ac06c5c39a3` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:38.839669 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80773ef-c8b1-423f-a90f-70bc2d5cb2ef None admin] RBAC: Authorizing `identity:get_group(group_id=1409e85b12ca4c6c9e929ac06c5c39a3)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:38.841200 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80773ef-c8b1-423f-a90f-70bc2d5cb2ef None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:38.848053 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 221/442] 10.222.0.17 () {56 vars in 1180 bytes} [Sat Jul 23 20:57:38 2022] GET /identity/v3/groups/1409e85b12ca4c6c9e929ac06c5c39a3 => generated 226 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:57:38.848053 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380b73ec-a186-4a85-b990-5bf68926b90b None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:38.848053 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380b73ec-a186-4a85-b990-5bf68926b90b None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:38.848053 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380b73ec-a186-4a85-b990-5bf68926b90b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:38.864220 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-380b73ec-a186-4a85-b990-5bf68926b90b None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:57:38.865485 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-380b73ec-a186-4a85-b990-5bf68926b90b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:57:38.898462 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:38.931514 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3425ba5e-b685-4fde-83c8-35c2abfba13d None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:38.945921 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 222/443] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:57:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 23 20:57:38.945921 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380b73ec-a186-4a85-b990-5bf68926b90b None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:38.978540 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024a6483-7fec-4ab1-ac7d-9045f28dbd45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:38.979562 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024a6483-7fec-4ab1-ac7d-9045f28dbd45 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:38.979913 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024a6483-7fec-4ab1-ac7d-9045f28dbd45 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:38.980189 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024a6483-7fec-4ab1-ac7d-9045f28dbd45 None admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:38.980949 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024a6483-7fec-4ab1-ac7d-9045f28dbd45 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:57:38.981255 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024a6483-7fec-4ab1-ac7d-9045f28dbd45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:38.982722 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024a6483-7fec-4ab1-ac7d-9045f28dbd45 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:38.996226 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 222/444] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Jul 23 20:57:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:57:38.997035 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024a6483-7fec-4ab1-ac7d-9045f28dbd45 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:39.066065 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:39.078401 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380b73ec-a186-4a85-b990-5bf68926b90b None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:39.112316 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024a6483-7fec-4ab1-ac7d-9045f28dbd45 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:39.113931 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d63fc3a-4b7e-4b2c-893b-373ac390c47f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:39.114607 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d63fc3a-4b7e-4b2c-893b-373ac390c47f None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:39.114887 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d63fc3a-4b7e-4b2c-893b-373ac390c47f None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:39.115157 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d63fc3a-4b7e-4b2c-893b-373ac390c47f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:39.115998 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d63fc3a-4b7e-4b2c-893b-373ac390c47f None admin] RBAC: Adding query filter params (group.id=1409e85b12ca4c6c9e929ac06c5c39a3, role.id=c5f46541d35e44b691baa7a1fa304c0f, scope.project.id=74cb8c05a64040c48e6687c9bd9865d1) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:57:39.116303 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d63fc3a-4b7e-4b2c-893b-373ac390c47f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:39.117772 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d63fc3a-4b7e-4b2c-893b-373ac390c47f None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:39.124230 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 223/445] 10.222.0.17 () {56 vars in 1376 bytes} [Sat Jul 23 20:57:38 2022] GET /identity/v3/role_assignments?group.id=1409e85b12ca4c6c9e929ac06c5c39a3&scope.project.id=74cb8c05a64040c48e6687c9bd9865d1&role.id=c5f46541d35e44b691baa7a1fa304c0f => generated 611 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:57:39.125104 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d63fc3a-4b7e-4b2c-893b-373ac390c47f None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:39.157402 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7559a804-bfb7-43ce-8ec0-e3c5b50b02ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:39.158590 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7559a804-bfb7-43ce-8ec0-e3c5b50b02ad None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:39.158873 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7559a804-bfb7-43ce-8ec0-e3c5b50b02ad None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:39.159166 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7559a804-bfb7-43ce-8ec0-e3c5b50b02ad None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:39.174276 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:39.177051 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7559a804-bfb7-43ce-8ec0-e3c5b50b02ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:57:39.185782 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-7559a804-bfb7-43ce-8ec0-e3c5b50b02ad None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 23 20:57:39.185782 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:57:39.185782 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:57:39.185782 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:57:39.185782 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:57:39.185782 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:57:39.185782 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:57:39.185782 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:57:39.185782 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:57:39.185782 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:57:39.185782 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:57:39.185782 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:57:39.185782 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:57:39.185782 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:57:39.185782 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:57:39.185782 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:57:39.186901 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:57:39.186901 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:57:39.186901 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:57:39.186901 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:57:39.186901 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:57:39.186901 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:57:39.186901 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:57:39.186901 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:57:39.186901 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:57:39.186901 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:57:39.186901 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:57:39.186901 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application with Lock( Jul 23 20:57:39.186901 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:57:39.186901 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:57:39.186901 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:57:39.186901 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:57:39.187908 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:57:39.187908 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:57:39.187908 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:57:39.187908 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:57:39.187908 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:57:39.187908 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:57:39.187908 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:57:39.187908 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:57:39.187908 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:57:39.187908 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:57:39.187908 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 23 20:57:39.187908 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:57:39.187908 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 223/446] 10.222.0.17 () {56 vars in 1096 bytes} [Sat Jul 23 20:57:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:57:39.193312 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7559a804-bfb7-43ce-8ec0-e3c5b50b02ad None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:39.270870 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d63fc3a-4b7e-4b2c-893b-373ac390c47f None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:39.311694 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7559a804-bfb7-43ce-8ec0-e3c5b50b02ad None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:39.315731 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c4ff2b-bb9a-4475-a3e3-b78d5cad69b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:39.316547 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c4ff2b-bb9a-4475-a3e3-b78d5cad69b3 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:39.317026 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c4ff2b-bb9a-4475-a3e3-b78d5cad69b3 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:39.317243 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c4ff2b-bb9a-4475-a3e3-b78d5cad69b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:39.336311 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:39.356039 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570eb20d-d17d-4281-9998-897a9c15aa0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:39.356834 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570eb20d-d17d-4281-9998-897a9c15aa0f None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:39.357112 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570eb20d-d17d-4281-9998-897a9c15aa0f None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:39.357385 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570eb20d-d17d-4281-9998-897a9c15aa0f None admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:39.358183 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570eb20d-d17d-4281-9998-897a9c15aa0f None admin] RBAC: Adding query filter params (name=admin) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:57:39.358483 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570eb20d-d17d-4281-9998-897a9c15aa0f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:39.359878 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570eb20d-d17d-4281-9998-897a9c15aa0f None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:39.370031 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 224/447] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Jul 23 20:57:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 20:57:39.375507 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570eb20d-d17d-4281-9998-897a9c15aa0f None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:39.405756 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c4ff2b-bb9a-4475-a3e3-b78d5cad69b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:39.408486 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c4ff2b-bb9a-4475-a3e3-b78d5cad69b3 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:39.445319 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:39.503939 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570eb20d-d17d-4281-9998-897a9c15aa0f None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:39.532716 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 224/448] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Jul 23 20:57:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 23 20:57:39.538986 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c4ff2b-bb9a-4475-a3e3-b78d5cad69b3 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:39.545469 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e2399c-f89f-4c05-b37d-8b093db654ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:39.546187 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e2399c-f89f-4c05-b37d-8b093db654ea None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:39.546522 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e2399c-f89f-4c05-b37d-8b093db654ea None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:39.546733 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e2399c-f89f-4c05-b37d-8b093db654ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:39.608628 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:39.643828 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e2399c-f89f-4c05-b37d-8b093db654ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:39.645410 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e2399c-f89f-4c05-b37d-8b093db654ea None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:39.671808 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c4ff2b-bb9a-4475-a3e3-b78d5cad69b3 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:39.706343 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:39.711700 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43be6dac-5a5d-4939-9650-699f3fad7cb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:39.712586 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43be6dac-5a5d-4939-9650-699f3fad7cb4 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:39.712857 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43be6dac-5a5d-4939-9650-699f3fad7cb4 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:39.713121 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43be6dac-5a5d-4939-9650-699f3fad7cb4 None admin] PATH_INFO: `/v3/projects/84094ca55a574d84ba5fe544c9d90f50` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:39.714353 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43be6dac-5a5d-4939-9650-699f3fad7cb4 None admin] RBAC: Authorizing `identity:get_project(project_id=84094ca55a574d84ba5fe544c9d90f50)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:39.715808 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43be6dac-5a5d-4939-9650-699f3fad7cb4 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:39.717531 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 225/449] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Jul 23 20:57:39 2022] GET /identity/v3/projects/84094ca55a574d84ba5fe544c9d90f50 => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 20:57:39.723150 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43be6dac-5a5d-4939-9650-699f3fad7cb4 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:39.755509 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 225/450] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Jul 23 20:57:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 23 20:57:39.761373 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e2399c-f89f-4c05-b37d-8b093db654ea None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:39.832532 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43be6dac-5a5d-4939-9650-699f3fad7cb4 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:39.844032 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:39.866596 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e2399c-f89f-4c05-b37d-8b093db654ea None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:39.867476 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7272edb8-1214-4f14-a812-13d0797ece9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:39.868352 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7272edb8-1214-4f14-a812-13d0797ece9e None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:39.868625 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7272edb8-1214-4f14-a812-13d0797ece9e None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:39.868993 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7272edb8-1214-4f14-a812-13d0797ece9e None admin] PATH_INFO: `/v3/groups/1409e85b12ca4c6c9e929ac06c5c39a3` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:39.870109 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7272edb8-1214-4f14-a812-13d0797ece9e None admin] RBAC: Authorizing `identity:get_group(group_id=1409e85b12ca4c6c9e929ac06c5c39a3)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:39.871564 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7272edb8-1214-4f14-a812-13d0797ece9e None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:39.873182 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 226/451] 10.222.0.17 () {56 vars in 1180 bytes} [Sat Jul 23 20:57:39 2022] GET /identity/v3/groups/1409e85b12ca4c6c9e929ac06c5c39a3 => generated 226 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 20:57:39.879209 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7272edb8-1214-4f14-a812-13d0797ece9e None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:39.904137 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7efa073-b189-4a1d-a1b0-20a5b73630cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:39.905010 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7efa073-b189-4a1d-a1b0-20a5b73630cc None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:39.905337 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7efa073-b189-4a1d-a1b0-20a5b73630cc None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:39.905613 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7efa073-b189-4a1d-a1b0-20a5b73630cc None admin] PATH_INFO: `/v3/projects/d6f3124c18f04946a431e587fc205bd4` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:39.906817 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7efa073-b189-4a1d-a1b0-20a5b73630cc None admin] RBAC: Authorizing `identity:get_project(project_id=d6f3124c18f04946a431e587fc205bd4)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:39.908283 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7efa073-b189-4a1d-a1b0-20a5b73630cc None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:39.910339 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 226/452] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Jul 23 20:57:39 2022] GET /identity/v3/projects/d6f3124c18f04946a431e587fc205bd4 => generated 344 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 20:57:39.916329 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7efa073-b189-4a1d-a1b0-20a5b73630cc None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:39.947973 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:39.984239 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7272edb8-1214-4f14-a812-13d0797ece9e None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:40.019645 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7efa073-b189-4a1d-a1b0-20a5b73630cc None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:40.024413 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ac0762-55fb-42e4-83aa-13d063bd65c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:40.025069 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ac0762-55fb-42e4-83aa-13d063bd65c7 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:40.025348 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ac0762-55fb-42e4-83aa-13d063bd65c7 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:40.025614 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ac0762-55fb-42e4-83aa-13d063bd65c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:40.026472 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ac0762-55fb-42e4-83aa-13d063bd65c7 None admin] RBAC: Adding query filter params (group.id=1409e85b12ca4c6c9e929ac06c5c39a3, role.id=c5f46541d35e44b691baa7a1fa304c0f, scope.project.id=84094ca55a574d84ba5fe544c9d90f50) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:57:40.026773 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ac0762-55fb-42e4-83aa-13d063bd65c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:40.028219 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ac0762-55fb-42e4-83aa-13d063bd65c7 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:40.034865 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 227/453] 10.222.0.17 () {56 vars in 1376 bytes} [Sat Jul 23 20:57:39 2022] GET /identity/v3/role_assignments?group.id=1409e85b12ca4c6c9e929ac06c5c39a3&scope.project.id=84094ca55a574d84ba5fe544c9d90f50&role.id=c5f46541d35e44b691baa7a1fa304c0f => generated 611 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 20:57:40.059367 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b72b27-2288-4cfa-821b-264b9cbafb34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:40.060232 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b72b27-2288-4cfa-821b-264b9cbafb34 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:40.060525 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b72b27-2288-4cfa-821b-264b9cbafb34 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:40.060796 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b72b27-2288-4cfa-821b-264b9cbafb34 None admin] PATH_INFO: `/v3/groups/350e0fc337674c8a9f982c41700e04f8` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:40.062159 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b72b27-2288-4cfa-821b-264b9cbafb34 None admin] RBAC: Authorizing `identity:get_group(group_id=350e0fc337674c8a9f982c41700e04f8)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:40.063655 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b72b27-2288-4cfa-821b-264b9cbafb34 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:40.065397 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 227/454] 10.222.0.17 () {56 vars in 1180 bytes} [Sat Jul 23 20:57:39 2022] GET /identity/v3/groups/350e0fc337674c8a9f982c41700e04f8 => generated 229 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 20:57:40.071960 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ac0762-55fb-42e4-83aa-13d063bd65c7 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:40.202646 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ac0762-55fb-42e4-83aa-13d063bd65c7 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:40.233791 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:40.239347 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95c2b09-d976-4ed4-8aeb-b470610f051c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:40.239940 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95c2b09-d976-4ed4-8aeb-b470610f051c None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:40.240216 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95c2b09-d976-4ed4-8aeb-b470610f051c None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:40.240485 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95c2b09-d976-4ed4-8aeb-b470610f051c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:40.241328 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95c2b09-d976-4ed4-8aeb-b470610f051c None admin] RBAC: Adding query filter params (group.id=350e0fc337674c8a9f982c41700e04f8, role.id=fec17bfdc65349a2b9c06a89131191df, scope.project.id=d6f3124c18f04946a431e587fc205bd4) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:57:40.241631 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95c2b09-d976-4ed4-8aeb-b470610f051c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:40.243128 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95c2b09-d976-4ed4-8aeb-b470610f051c None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:40.249964 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 228/455] 10.222.0.17 () {56 vars in 1376 bytes} [Sat Jul 23 20:57:40 2022] GET /identity/v3/role_assignments?group.id=350e0fc337674c8a9f982c41700e04f8&scope.project.id=d6f3124c18f04946a431e587fc205bd4&role.id=fec17bfdc65349a2b9c06a89131191df => generated 611 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:57:43.026219 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dc5d82-04b2-4974-a785-ca0f9350e8f1 None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:43.026781 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dc5d82-04b2-4974-a785-ca0f9350e8f1 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:43.026781 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dc5d82-04b2-4974-a785-ca0f9350e8f1 None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:43.028765 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 228/456] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:57:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:57:43.034189 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e7b26c-8244-4f49-bee3-5493e90e5295 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:43.035156 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e7b26c-8244-4f49-bee3-5493e90e5295 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:43.035652 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e7b26c-8244-4f49-bee3-5493e90e5295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:43.058869 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-a8e7b26c-8244-4f49-bee3-5493e90e5295 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:57:43.060445 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-a8e7b26c-8244-4f49-bee3-5493e90e5295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:57:43.152650 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 229/457] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:57:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 23 20:57:43.199478 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dc5d82-04b2-4974-a785-ca0f9350e8f1 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:43.226521 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:43.355498 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dc5d82-04b2-4974-a785-ca0f9350e8f1 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:43.409163 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6550011e-2c5b-43f2-9f23-a31292a28fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:43.410441 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6550011e-2c5b-43f2-9f23-a31292a28fa4 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:43.410946 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6550011e-2c5b-43f2-9f23-a31292a28fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:43.411443 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6550011e-2c5b-43f2-9f23-a31292a28fa4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:43.428238 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6550011e-2c5b-43f2-9f23-a31292a28fa4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:43.430095 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6550011e-2c5b-43f2-9f23-a31292a28fa4 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:43.452743 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-6550011e-2c5b-43f2-9f23-a31292a28fa4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:57:43.452743 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:57:43.452743 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:57:43.452743 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:57:43.452743 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:57:43.452743 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:57:43.452743 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:57:43.452743 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:57:43.452743 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:57:43.452743 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:57:43.452743 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:57:43.452743 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:57:43.452743 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 23 20:57:43.452743 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 23 20:57:43.452743 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 23 20:57:43.453677 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 23 20:57:43.453677 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:57:43.453677 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:57:43.453677 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:57:43.453677 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:57:43.453677 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:57:43.453677 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:57:43.453677 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:57:43.453677 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application with Lock( Jul 23 20:57:43.453677 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:57:43.453677 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:57:43.453677 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:57:43.453677 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:57:43.453677 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:57:43.453677 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:57:43.453677 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:57:43.453677 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:57:43.454543 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 23 20:57:43.454543 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 23 20:57:43.454543 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:57:43.454543 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:57:43.456530 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 229/458] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 23 20:57:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:57:43.463214 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e7b26c-8244-4f49-bee3-5493e90e5295 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:43.482586 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9f10c9-3d99-45f0-803f-267ba46ed85e None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:43.483227 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9f10c9-3d99-45f0-803f-267ba46ed85e None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:43.483742 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9f10c9-3d99-45f0-803f-267ba46ed85e None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:43.485654 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 230/459] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:57:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:57:43.491825 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445d972b-900b-4c9e-a07c-3263b2c5a4af None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:43.492102 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445d972b-900b-4c9e-a07c-3263b2c5a4af None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:43.492543 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445d972b-900b-4c9e-a07c-3263b2c5a4af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:43.524009 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-445d972b-900b-4c9e-a07c-3263b2c5a4af None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:57:43.525284 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-445d972b-900b-4c9e-a07c-3263b2c5a4af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:57:43.608899 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:43.622531 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 231/460] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:57:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 23 20:57:43.623268 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e7b26c-8244-4f49-bee3-5493e90e5295 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:43.624677 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28646a6f-8f9a-4ad9-a969-cdc5ef773d4e None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:43.625092 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28646a6f-8f9a-4ad9-a969-cdc5ef773d4e None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:43.625762 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28646a6f-8f9a-4ad9-a969-cdc5ef773d4e None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:43.632720 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 232/461] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:57:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:57:43.635940 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e007dda4-2efd-46a3-a08d-67d2a867cf94 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:43.636278 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e007dda4-2efd-46a3-a08d-67d2a867cf94 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:43.636559 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e007dda4-2efd-46a3-a08d-67d2a867cf94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:43.660324 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-e007dda4-2efd-46a3-a08d-67d2a867cf94 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:57:43.662031 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-e007dda4-2efd-46a3-a08d-67d2a867cf94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:57:43.663764 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:43.677886 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2994a6-244a-407e-a092-cb14768619f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:43.678602 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2994a6-244a-407e-a092-cb14768619f4 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:43.678929 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2994a6-244a-407e-a092-cb14768619f4 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:43.679209 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2994a6-244a-407e-a092-cb14768619f4 None admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:43.679949 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2994a6-244a-407e-a092-cb14768619f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:57:43.680853 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2994a6-244a-407e-a092-cb14768619f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:43.682796 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2994a6-244a-407e-a092-cb14768619f4 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:43.698037 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 230/462] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 23 20:57:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:57:43.698037 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2994a6-244a-407e-a092-cb14768619f4 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:43.744437 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 233/463] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:57:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 23 20:57:43.746056 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c776f6a-a3c9-4137-9d3f-23a547ec6e1e None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:43.746340 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c776f6a-a3c9-4137-9d3f-23a547ec6e1e None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:43.746607 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c776f6a-a3c9-4137-9d3f-23a547ec6e1e None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:43.749992 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 234/464] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:57:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:57:43.749992 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c776f6a-a3c9-4137-9d3f-23a547ec6e1e None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:43.830809 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2994a6-244a-407e-a092-cb14768619f4 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:43.867711 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2ec5d8-b23f-4292-b66b-9d8a778e68bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:43.868519 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2ec5d8-b23f-4292-b66b-9d8a778e68bc None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:43.868793 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2ec5d8-b23f-4292-b66b-9d8a778e68bc None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:43.869059 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2ec5d8-b23f-4292-b66b-9d8a778e68bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:43.878542 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c776f6a-a3c9-4137-9d3f-23a547ec6e1e None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:43.880227 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2ec5d8-b23f-4292-b66b-9d8a778e68bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:43.881750 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2ec5d8-b23f-4292-b66b-9d8a778e68bc None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:43.899938 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-bf2ec5d8-b23f-4292-b66b-9d8a778e68bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:57:43.899938 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:57:43.899938 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:57:43.899938 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:57:43.899938 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:57:43.899938 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:57:43.899938 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:57:43.899938 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:57:43.899938 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:57:43.899938 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:57:43.899938 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:57:43.899938 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:57:43.899938 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 23 20:57:43.899938 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 23 20:57:43.899938 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 23 20:57:43.900879 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 23 20:57:43.900879 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:57:43.900879 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:57:43.900879 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:57:43.900879 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:57:43.900879 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:57:43.900879 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:57:43.900879 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:57:43.900879 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application with Lock( Jul 23 20:57:43.900879 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:57:43.900879 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:57:43.900879 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:57:43.900879 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:57:43.900879 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:57:43.900879 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:57:43.900879 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:57:43.900879 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:57:43.901749 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 23 20:57:43.901749 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 23 20:57:43.901749 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:57:43.901749 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 20:57:43.901749 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 231/465] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 23 20:57:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:57:43.903584 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d11205-9721-4e71-95ec-c3484beb8e98 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:43.903934 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d11205-9721-4e71-95ec-c3484beb8e98 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:43.904272 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d11205-9721-4e71-95ec-c3484beb8e98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:43.912946 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:43.922656 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4624372-031e-4b3d-b606-7d866d0c8758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:43.923437 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4624372-031e-4b3d-b606-7d866d0c8758 None admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:43.923816 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4624372-031e-4b3d-b606-7d866d0c8758 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:43.924097 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4624372-031e-4b3d-b606-7d866d0c8758 None admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:43.924806 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4624372-031e-4b3d-b606-7d866d0c8758 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:43.926419 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4624372-031e-4b3d-b606-7d866d0c8758 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:43.926802 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-47d11205-9721-4e71-95ec-c3484beb8e98 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:57:43.927987 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-47d11205-9721-4e71-95ec-c3484beb8e98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:57:43.957949 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 235/466] 10.222.0.17 () {60 vars in 1132 bytes} [Sat Jul 23 20:57:43 2022] POST /identity/v3/users => generated 246 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 20:57:43.957949 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4624372-031e-4b3d-b606-7d866d0c8758 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:43.975852 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:44.028974 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 232/467] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:57:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 23 20:57:44.030222 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d11205-9721-4e71-95ec-c3484beb8e98 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:44.075896 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4624372-031e-4b3d-b606-7d866d0c8758 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:44.127776 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229946f6-9bf5-40bc-ae02-f9e172f12f82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:44.129075 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229946f6-9bf5-40bc-ae02-f9e172f12f82 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:44.129602 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229946f6-9bf5-40bc-ae02-f9e172f12f82 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:44.130140 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229946f6-9bf5-40bc-ae02-f9e172f12f82 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:44.146931 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229946f6-9bf5-40bc-ae02-f9e172f12f82 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:44.149988 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229946f6-9bf5-40bc-ae02-f9e172f12f82 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:44.168621 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d11205-9721-4e71-95ec-c3484beb8e98 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:44.178758 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-229946f6-9bf5-40bc-ae02-f9e172f12f82 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:57:44.178758 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:57:44.178758 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:57:44.178758 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:57:44.178758 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:57:44.178758 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:57:44.178758 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:57:44.178758 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:57:44.178758 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:57:44.178758 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:57:44.178758 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:57:44.178758 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:57:44.178758 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 23 20:57:44.178758 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 23 20:57:44.178758 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 23 20:57:44.179721 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 23 20:57:44.179721 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:57:44.179721 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:57:44.179721 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:57:44.179721 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:57:44.179721 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:57:44.179721 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:57:44.179721 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:57:44.179721 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application with Lock( Jul 23 20:57:44.179721 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:57:44.179721 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:57:44.179721 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:57:44.179721 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:57:44.179721 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:57:44.179721 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:57:44.179721 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:57:44.179721 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:57:44.180569 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 23 20:57:44.180569 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 23 20:57:44.180569 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:57:44.180569 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:57:44.180569 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 236/468] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 23 20:57:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:57:44.182736 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229946f6-9bf5-40bc-ae02-f9e172f12f82 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:44.228970 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9f56b2-e52b-460e-acd6-18e8a72139d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:44.229709 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:44.229989 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9f56b2-e52b-460e-acd6-18e8a72139d9 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:44.230273 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9f56b2-e52b-460e-acd6-18e8a72139d9 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:44.230547 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9f56b2-e52b-460e-acd6-18e8a72139d9 None admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:44.231293 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9f56b2-e52b-460e-acd6-18e8a72139d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:57:44.231594 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9f56b2-e52b-460e-acd6-18e8a72139d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:44.233151 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9f56b2-e52b-460e-acd6-18e8a72139d9 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:44.248057 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 233/469] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 23 20:57:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:57:44.248935 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9f56b2-e52b-460e-acd6-18e8a72139d9 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:44.290313 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:44.326789 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229946f6-9bf5-40bc-ae02-f9e172f12f82 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:44.365932 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac5b8a6-4a61-47c6-969c-7e0eb7611745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:44.366806 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac5b8a6-4a61-47c6-969c-7e0eb7611745 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:44.367085 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac5b8a6-4a61-47c6-969c-7e0eb7611745 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:44.367357 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac5b8a6-4a61-47c6-969c-7e0eb7611745 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:44.379752 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac5b8a6-4a61-47c6-969c-7e0eb7611745 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:44.381259 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac5b8a6-4a61-47c6-969c-7e0eb7611745 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:44.400254 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9f56b2-e52b-460e-acd6-18e8a72139d9 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:44.400621 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-cac5b8a6-4a61-47c6-969c-7e0eb7611745 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:57:44.400621 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:57:44.400621 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:57:44.400621 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:57:44.400621 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:57:44.400621 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:57:44.400621 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:57:44.400621 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:57:44.400621 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:57:44.400621 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:57:44.400621 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:57:44.400621 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:57:44.400621 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 23 20:57:44.400621 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 23 20:57:44.400621 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 23 20:57:44.401494 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 23 20:57:44.401494 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:57:44.401494 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:57:44.401494 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:57:44.401494 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:57:44.401494 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:57:44.401494 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:57:44.401494 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:57:44.401494 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application with Lock( Jul 23 20:57:44.401494 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:57:44.401494 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:57:44.401494 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:57:44.401494 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:57:44.401494 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:57:44.401494 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:57:44.401494 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:57:44.401494 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:57:44.402376 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 23 20:57:44.402376 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 23 20:57:44.402376 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:57:44.402376 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:57:44.402376 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 237/470] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 23 20:57:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:57:44.408868 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac5b8a6-4a61-47c6-969c-7e0eb7611745 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:44.458968 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9a412c-2e02-4942-87c9-35a926327bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:44.460039 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9a412c-2e02-4942-87c9-35a926327bc8 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:44.460775 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9a412c-2e02-4942-87c9-35a926327bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:44.461772 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9a412c-2e02-4942-87c9-35a926327bc8 None admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:44.463098 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9a412c-2e02-4942-87c9-35a926327bc8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:57:44.463610 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9a412c-2e02-4942-87c9-35a926327bc8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:44.465846 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9a412c-2e02-4942-87c9-35a926327bc8 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:44.484359 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 234/471] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 23 20:57:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:57:44.485609 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9a412c-2e02-4942-87c9-35a926327bc8 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:44.514534 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:44.537301 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac5b8a6-4a61-47c6-969c-7e0eb7611745 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:44.578114 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe148f7-c926-4b8e-8c90-260766da3b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:44.578894 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe148f7-c926-4b8e-8c90-260766da3b1c None admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:44.579101 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe148f7-c926-4b8e-8c90-260766da3b1c None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:44.579377 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe148f7-c926-4b8e-8c90-260766da3b1c None admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:44.580091 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe148f7-c926-4b8e-8c90-260766da3b1c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:44.581561 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe148f7-c926-4b8e-8c90-260766da3b1c None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:44.606893 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 238/472] 10.222.0.17 () {60 vars in 1132 bytes} [Sat Jul 23 20:57:44 2022] POST /identity/v3/users => generated 248 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 20:57:44.607814 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe148f7-c926-4b8e-8c90-260766da3b1c None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:44.622953 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:44.641636 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9a412c-2e02-4942-87c9-35a926327bc8 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:44.706689 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dfaa9b-df23-4341-b7d6-d687895a9edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:44.707885 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dfaa9b-df23-4341-b7d6-d687895a9edf None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:44.708696 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dfaa9b-df23-4341-b7d6-d687895a9edf None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:44.709248 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dfaa9b-df23-4341-b7d6-d687895a9edf None admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:44.710635 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dfaa9b-df23-4341-b7d6-d687895a9edf None admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:57:44.711190 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dfaa9b-df23-4341-b7d6-d687895a9edf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:44.713743 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dfaa9b-df23-4341-b7d6-d687895a9edf None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:44.736242 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 235/473] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 23 20:57:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:57:44.738734 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fda7c31-166a-48ba-a53e-2405580e2140 None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:44.739161 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fda7c31-166a-48ba-a53e-2405580e2140 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:44.739463 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fda7c31-166a-48ba-a53e-2405580e2140 None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:44.740841 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 236/474] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:57:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:57:44.746659 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fda7c31-166a-48ba-a53e-2405580e2140 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:44.751451 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe148f7-c926-4b8e-8c90-260766da3b1c None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:44.790471 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6226975a-d907-4875-82c9-f021d0e5bae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:44.791318 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6226975a-d907-4875-82c9-f021d0e5bae4 None admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:44.791604 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6226975a-d907-4875-82c9-f021d0e5bae4 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:44.791922 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6226975a-d907-4875-82c9-f021d0e5bae4 None admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:44.792664 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6226975a-d907-4875-82c9-f021d0e5bae4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:44.794453 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6226975a-d907-4875-82c9-f021d0e5bae4 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:44.824468 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:44.834547 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 239/475] 10.222.0.17 () {60 vars in 1132 bytes} [Sat Jul 23 20:57:44 2022] POST /identity/v3/users => generated 248 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 20:57:44.837915 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b121231e-5868-4508-a171-67da543ae5d5 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:44.838557 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b121231e-5868-4508-a171-67da543ae5d5 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:44.839106 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b121231e-5868-4508-a171-67da543ae5d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:44.872309 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-b121231e-5868-4508-a171-67da543ae5d5 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:57:44.873643 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-b121231e-5868-4508-a171-67da543ae5d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:57:44.891929 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fda7c31-166a-48ba-a53e-2405580e2140 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:44.940692 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a34bff7-a682-4ba1-aee8-cb9ac66670e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:44.941597 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a34bff7-a682-4ba1-aee8-cb9ac66670e1 None admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:44.942020 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a34bff7-a682-4ba1-aee8-cb9ac66670e1 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:44.942366 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a34bff7-a682-4ba1-aee8-cb9ac66670e1 None admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:44.943181 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a34bff7-a682-4ba1-aee8-cb9ac66670e1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:44.945897 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a34bff7-a682-4ba1-aee8-cb9ac66670e1 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:44.977995 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 237/476] 10.222.0.17 () {60 vars in 1132 bytes} [Sat Jul 23 20:57:44 2022] POST /identity/v3/users => generated 249 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 20:57:44.981116 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 240/477] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:57:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 23 20:57:45.008020 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a34bff7-a682-4ba1-aee8-cb9ac66670e1 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:45.019499 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:45.136769 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a34bff7-a682-4ba1-aee8-cb9ac66670e1 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:45.179784 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d22c14-c771-4bb8-9fe2-8dd246eb3d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:45.180580 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d22c14-c771-4bb8-9fe2-8dd246eb3d9a None admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:45.180819 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d22c14-c771-4bb8-9fe2-8dd246eb3d9a None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:45.181147 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d22c14-c771-4bb8-9fe2-8dd246eb3d9a None admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:45.182102 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d22c14-c771-4bb8-9fe2-8dd246eb3d9a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:45.183586 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d22c14-c771-4bb8-9fe2-8dd246eb3d9a None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:45.193192 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.sql.core [None req-c7d22c14-c771-4bb8-9fe2-8dd246eb3d9a None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 23 20:57:45.193192 ncdv-master-1 devstack@keystone.service[91548]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 23 20:57:45.193192 ncdv-master-1 devstack@keystone.service[91548]: [parameters: {'id': 'cdab8288fffb44c291ade69c686ed36b', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 23 20:57:45.193192 ncdv-master-1 devstack@keystone.service[91548]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=91548) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 23 20:57:45.210369 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-c7d22c14-c771-4bb8-9fe2-8dd246eb3d9a None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 23 20:57:45.210369 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:57:45.210369 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 23 20:57:45.210369 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 23 20:57:45.210369 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 23 20:57:45.210369 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 23 20:57:45.210369 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 23 20:57:45.210369 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application result = self._query(query) Jul 23 20:57:45.210369 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 23 20:57:45.210369 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application conn.query(q) Jul 23 20:57:45.210369 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 23 20:57:45.210369 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 23 20:57:45.210369 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 23 20:57:45.210369 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application result.read() Jul 23 20:57:45.210369 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 23 20:57:45.211339 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 23 20:57:45.211339 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 23 20:57:45.211339 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 23 20:57:45.211339 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 23 20:57:45.211339 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 23 20:57:45.211339 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 23 20:57:45.211339 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 23 20:57:45.211339 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 23 20:57:45.211339 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 20:57:45.211339 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 23 20:57:45.211339 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 20:57:45.211339 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:57:45.211339 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 23 20:57:45.211339 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 23 20:57:45.211339 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 23 20:57:45.211339 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return ref.to_dict() Jul 23 20:57:45.211339 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 23 20:57:45.211339 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application next(self.gen) Jul 23 20:57:45.212364 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 23 20:57:45.212364 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application yield resource Jul 23 20:57:45.212364 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 23 20:57:45.212364 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application next(self.gen) Jul 23 20:57:45.212364 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 23 20:57:45.212364 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application self.session.rollback() Jul 23 20:57:45.212364 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 23 20:57:45.212364 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application self.force_reraise() Jul 23 20:57:45.212364 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 23 20:57:45.212364 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise self.value Jul 23 20:57:45.212364 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 23 20:57:45.212364 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 23 20:57:45.212364 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 23 20:57:45.212364 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application session.commit() Jul 23 20:57:45.212364 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 23 20:57:45.212364 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 23 20:57:45.212364 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 23 20:57:45.213226 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application self._prepare_impl() Jul 23 20:57:45.213226 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 23 20:57:45.213226 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application self.session.flush() Jul 23 20:57:45.213226 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 23 20:57:45.213226 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application self._flush(objects) Jul 23 20:57:45.213226 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 23 20:57:45.213226 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 23 20:57:45.213226 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 23 20:57:45.213226 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application compat.raise_( Jul 23 20:57:45.213226 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 23 20:57:45.213226 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception Jul 23 20:57:45.213226 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 23 20:57:45.213226 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application flush_context.execute() Jul 23 20:57:45.213226 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 23 20:57:45.213226 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rec.execute(self) Jul 23 20:57:45.213226 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 23 20:57:45.213226 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 23 20:57:45.214111 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 23 20:57:45.214111 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 23 20:57:45.214111 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 23 20:57:45.214111 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 23 20:57:45.214111 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 23 20:57:45.214111 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 23 20:57:45.214111 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 23 20:57:45.214111 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 23 20:57:45.214111 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 23 20:57:45.214111 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 23 20:57:45.214111 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 23 20:57:45.214111 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 23 20:57:45.214111 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 23 20:57:45.214111 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 23 20:57:45.214111 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 23 20:57:45.214111 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception Jul 23 20:57:45.214894 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 23 20:57:45.214894 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 23 20:57:45.214894 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 23 20:57:45.214894 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 23 20:57:45.214894 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 23 20:57:45.214894 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application result = self._query(query) Jul 23 20:57:45.214894 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 23 20:57:45.214894 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application conn.query(q) Jul 23 20:57:45.214894 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 23 20:57:45.214894 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 23 20:57:45.214894 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 23 20:57:45.214894 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application result.read() Jul 23 20:57:45.214894 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 23 20:57:45.214894 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 23 20:57:45.214894 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 23 20:57:45.214894 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 23 20:57:45.215657 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 23 20:57:45.215657 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 23 20:57:45.215657 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 23 20:57:45.215657 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 23 20:57:45.215657 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 23 20:57:45.215657 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 23 20:57:45.215657 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [parameters: {'id': 'cdab8288fffb44c291ade69c686ed36b', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 23 20:57:45.215657 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 23 20:57:45.215657 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 20:57:45.215657 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 23 20:57:45.215657 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 20:57:45.215657 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:57:45.215657 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:57:45.215657 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:57:45.215657 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:57:45.215657 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:57:45.216511 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:57:45.216511 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:57:45.216511 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:57:45.216511 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:57:45.216511 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:57:45.216511 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:57:45.216511 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 23 20:57:45.216511 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 23 20:57:45.216511 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:57:45.216511 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:57:45.216511 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 23 20:57:45.216511 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 23 20:57:45.216511 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 23 20:57:45.216511 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 23 20:57:45.216511 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 23 20:57:45.216511 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 20:57:45.219557 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 238/478] 10.222.0.17 () {60 vars in 1131 bytes} [Sat Jul 23 20:57:45 2022] POST /identity/v3/roles => generated 144 bytes in 205 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:57:45.225157 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b121231e-5868-4508-a171-67da543ae5d5 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:45.361749 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b121231e-5868-4508-a171-67da543ae5d5 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:45.405065 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:45.414119 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca441483-5a15-46cf-aa4e-e6862ddc9474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:45.414960 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca441483-5a15-46cf-aa4e-e6862ddc9474 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:45.415229 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca441483-5a15-46cf-aa4e-e6862ddc9474 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:45.415499 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca441483-5a15-46cf-aa4e-e6862ddc9474 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:45.434370 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca441483-5a15-46cf-aa4e-e6862ddc9474 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:57:45.447369 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-ca441483-5a15-46cf-aa4e-e6862ddc9474 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 23 20:57:45.447369 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:57:45.447369 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:57:45.447369 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:57:45.447369 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:57:45.447369 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:57:45.447369 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:57:45.447369 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:57:45.447369 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:57:45.447369 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:57:45.447369 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:57:45.447369 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:57:45.447369 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:57:45.447369 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:57:45.447369 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:57:45.447369 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:57:45.448297 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:57:45.448297 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:57:45.448297 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:57:45.448297 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:57:45.448297 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:57:45.448297 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:57:45.448297 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:57:45.448297 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:57:45.448297 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:57:45.448297 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:57:45.448297 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:57:45.448297 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application with Lock( Jul 23 20:57:45.448297 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:57:45.448297 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:57:45.448297 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:57:45.448297 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:57:45.449096 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:57:45.449096 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:57:45.449096 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:57:45.449096 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:57:45.449096 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:57:45.449096 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:57:45.449096 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:57:45.449096 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:57:45.449096 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:57:45.449096 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:57:45.449096 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 23 20:57:45.449096 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:57:45.449096 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 241/479] 10.222.0.17 () {56 vars in 1114 bytes} [Sat Jul 23 20:57:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:57:45.459097 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d22c14-c771-4bb8-9fe2-8dd246eb3d9a None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:45.585928 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:45.641519 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d22c14-c771-4bb8-9fe2-8dd246eb3d9a None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:45.697141 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec58f89-0bf1-41ec-8546-de85cce1a9cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:45.697839 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec58f89-0bf1-41ec-8546-de85cce1a9cc None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:45.698310 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec58f89-0bf1-41ec-8546-de85cce1a9cc None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:45.698590 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec58f89-0bf1-41ec-8546-de85cce1a9cc None admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:45.699351 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec58f89-0bf1-41ec-8546-de85cce1a9cc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:57:45.699656 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec58f89-0bf1-41ec-8546-de85cce1a9cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:45.701045 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec58f89-0bf1-41ec-8546-de85cce1a9cc None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:45.714300 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 239/480] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Jul 23 20:57:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:57:46.813493 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61e57b6-9493-43a4-9473-e92b37d0fd75 None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:46.814073 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61e57b6-9493-43a4-9473-e92b37d0fd75 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:46.814073 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61e57b6-9493-43a4-9473-e92b37d0fd75 None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:46.815594 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 242/481] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:57:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:57:46.821468 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802cd15b-a9c0-40d0-b2ae-aae9a63f8952 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:46.822099 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802cd15b-a9c0-40d0-b2ae-aae9a63f8952 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:46.822099 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802cd15b-a9c0-40d0-b2ae-aae9a63f8952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:46.844334 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-802cd15b-a9c0-40d0-b2ae-aae9a63f8952 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:57:46.845514 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-802cd15b-a9c0-40d0-b2ae-aae9a63f8952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:57:46.943101 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 240/482] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:57:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 23 20:57:46.991401 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61e57b6-9493-43a4-9473-e92b37d0fd75 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:47.129345 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61e57b6-9493-43a4-9473-e92b37d0fd75 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:47.166225 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84acf8a7-5673-449b-83fc-cf814e4f2da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:47.167046 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84acf8a7-5673-449b-83fc-cf814e4f2da9 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:47.167326 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84acf8a7-5673-449b-83fc-cf814e4f2da9 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:47.167601 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84acf8a7-5673-449b-83fc-cf814e4f2da9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:47.179202 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84acf8a7-5673-449b-83fc-cf814e4f2da9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:57:47.187116 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-84acf8a7-5673-449b-83fc-cf814e4f2da9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 23 20:57:47.187116 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:57:47.187116 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:57:47.187116 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:57:47.187116 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:57:47.187116 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:57:47.187116 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:57:47.187116 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:57:47.187116 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:57:47.187116 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:57:47.187116 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:57:47.187116 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:57:47.187116 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:57:47.187116 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:57:47.187116 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:57:47.187116 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:57:47.188030 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:57:47.188030 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:57:47.188030 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:57:47.188030 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:57:47.188030 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:57:47.188030 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:57:47.188030 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:57:47.188030 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:57:47.188030 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:57:47.188030 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:57:47.188030 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:57:47.188030 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application with Lock( Jul 23 20:57:47.188030 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:57:47.188030 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:57:47.188030 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:57:47.188030 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:57:47.188810 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:57:47.188810 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:57:47.188810 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:57:47.188810 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:57:47.188810 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:57:47.188810 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:57:47.188810 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:57:47.188810 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:57:47.188810 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:57:47.188810 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:57:47.188810 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 23 20:57:47.188810 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:57:47.188810 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 243/483] 10.222.0.17 () {56 vars in 1102 bytes} [Sat Jul 23 20:57:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:57:47.194630 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802cd15b-a9c0-40d0-b2ae-aae9a63f8952 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:47.265373 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:47.322730 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802cd15b-a9c0-40d0-b2ae-aae9a63f8952 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:47.358095 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e352ade9-6b8e-49d8-93f5-e498deef1203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:47.358835 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e352ade9-6b8e-49d8-93f5-e498deef1203 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:47.359121 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e352ade9-6b8e-49d8-93f5-e498deef1203 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:47.359391 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e352ade9-6b8e-49d8-93f5-e498deef1203 None admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:47.360157 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e352ade9-6b8e-49d8-93f5-e498deef1203 None admin] RBAC: Adding query filter params (name=service) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:57:47.360458 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e352ade9-6b8e-49d8-93f5-e498deef1203 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:47.361889 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e352ade9-6b8e-49d8-93f5-e498deef1203 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:47.373049 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 241/484] 10.222.0.17 () {56 vars in 1103 bytes} [Sat Jul 23 20:57:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:57:47.378740 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84acf8a7-5673-449b-83fc-cf814e4f2da9 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:47.471141 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:47.551041 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84acf8a7-5673-449b-83fc-cf814e4f2da9 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:47.604596 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4928ae4e-e565-4c47-a4e0-cd9803679095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:47.605428 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4928ae4e-e565-4c47-a4e0-cd9803679095 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:47.605710 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4928ae4e-e565-4c47-a4e0-cd9803679095 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:47.606028 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4928ae4e-e565-4c47-a4e0-cd9803679095 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:47.624177 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4928ae4e-e565-4c47-a4e0-cd9803679095 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:47.625898 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4928ae4e-e565-4c47-a4e0-cd9803679095 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:47.649563 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-4928ae4e-e565-4c47-a4e0-cd9803679095 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:57:47.649563 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:57:47.649563 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:57:47.649563 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:57:47.649563 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:57:47.649563 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:57:47.649563 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:57:47.649563 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:57:47.649563 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:57:47.649563 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:57:47.649563 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:57:47.649563 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:57:47.649563 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 23 20:57:47.649563 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 23 20:57:47.649563 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 23 20:57:47.650578 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 23 20:57:47.650578 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:57:47.650578 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:57:47.650578 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:57:47.650578 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:57:47.650578 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:57:47.650578 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:57:47.650578 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:57:47.650578 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application with Lock( Jul 23 20:57:47.650578 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:57:47.650578 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:57:47.650578 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:57:47.650578 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:57:47.650578 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:57:47.650578 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:57:47.650578 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:57:47.650578 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:57:47.651429 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 23 20:57:47.651429 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 23 20:57:47.651429 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:57:47.651429 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:57:47.651429 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 244/485] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 23 20:57:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:57:47.659428 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e352ade9-6b8e-49d8-93f5-e498deef1203 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:47.793385 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e352ade9-6b8e-49d8-93f5-e498deef1203 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:47.809019 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ede9fb5-0a0c-459b-93b1-cc0dd1d34261 None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:47.809019 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ede9fb5-0a0c-459b-93b1-cc0dd1d34261 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:47.809019 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ede9fb5-0a0c-459b-93b1-cc0dd1d34261 None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:47.809903 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 245/486] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:57:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:57:47.824858 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27e80bb-dbed-44a9-8ddb-1bfe23f4c961 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:47.826196 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27e80bb-dbed-44a9-8ddb-1bfe23f4c961 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:47.828923 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27e80bb-dbed-44a9-8ddb-1bfe23f4c961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:47.831423 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:47.841576 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d7748e-397d-45fd-995a-33e031a2ea40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:47.842299 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d7748e-397d-45fd-995a-33e031a2ea40 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:47.842577 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d7748e-397d-45fd-995a-33e031a2ea40 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:47.842847 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d7748e-397d-45fd-995a-33e031a2ea40 None admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:47.843572 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d7748e-397d-45fd-995a-33e031a2ea40 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:57:47.844284 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d7748e-397d-45fd-995a-33e031a2ea40 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:47.845254 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d7748e-397d-45fd-995a-33e031a2ea40 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:47.850258 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-c27e80bb-dbed-44a9-8ddb-1bfe23f4c961 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:57:47.851552 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-c27e80bb-dbed-44a9-8ddb-1bfe23f4c961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:57:47.858352 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 242/487] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 23 20:57:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:57:47.859541 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8dd23b-73a8-47e9-ba19-f1af846bd893 None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:47.859827 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8dd23b-73a8-47e9-ba19-f1af846bd893 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:47.860097 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8dd23b-73a8-47e9-ba19-f1af846bd893 None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:47.861506 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 243/488] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:57:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:57:47.866374 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefd2d30-c136-4a26-9da2-4901dde83fa5 None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:47.866374 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefd2d30-c136-4a26-9da2-4901dde83fa5 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:47.866374 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefd2d30-c136-4a26-9da2-4901dde83fa5 None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:47.866374 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 244/489] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:57:47 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:57:47.868749 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70f74ae-33d4-4b0a-8753-5231cda65018 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:47.869044 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70f74ae-33d4-4b0a-8753-5231cda65018 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:47.869323 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70f74ae-33d4-4b0a-8753-5231cda65018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:47.886304 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-a70f74ae-33d4-4b0a-8753-5231cda65018 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:57:47.887515 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-a70f74ae-33d4-4b0a-8753-5231cda65018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:57:47.933739 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 246/490] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:57:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 23 20:57:47.935093 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63c0d15-72f2-44bf-b68d-cd9b492a135a None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:47.935376 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63c0d15-72f2-44bf-b68d-cd9b492a135a None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:47.935649 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63c0d15-72f2-44bf-b68d-cd9b492a135a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:47.957459 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-b63c0d15-72f2-44bf-b68d-cd9b492a135a None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:57:47.958707 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-b63c0d15-72f2-44bf-b68d-cd9b492a135a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:57:47.977896 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 245/491] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:57:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 23 20:57:47.977896 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70f74ae-33d4-4b0a-8753-5231cda65018 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:47.983228 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:48.029109 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 247/492] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:57:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 23 20:57:48.030199 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63c0d15-72f2-44bf-b68d-cd9b492a135a None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:48.092912 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70f74ae-33d4-4b0a-8753-5231cda65018 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:48.106946 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:48.133179 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f41e64-1a2c-4432-97ad-92d5525e1af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:48.134033 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f41e64-1a2c-4432-97ad-92d5525e1af2 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:48.134317 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f41e64-1a2c-4432-97ad-92d5525e1af2 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:48.134661 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f41e64-1a2c-4432-97ad-92d5525e1af2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:48.140702 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63c0d15-72f2-44bf-b68d-cd9b492a135a None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:48.141988 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f41e64-1a2c-4432-97ad-92d5525e1af2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:48.143498 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f41e64-1a2c-4432-97ad-92d5525e1af2 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:48.159931 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-f5f41e64-1a2c-4432-97ad-92d5525e1af2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 23 20:57:48.159931 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:57:48.159931 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:57:48.159931 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:57:48.159931 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:57:48.159931 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:57:48.159931 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:57:48.159931 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:57:48.159931 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:57:48.159931 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:57:48.159931 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:57:48.159931 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:57:48.159931 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 23 20:57:48.159931 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 23 20:57:48.159931 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 23 20:57:48.159931 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 23 20:57:48.160897 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:57:48.160897 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:57:48.160897 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 23 20:57:48.160897 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 23 20:57:48.160897 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 23 20:57:48.160897 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 23 20:57:48.160897 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:57:48.160897 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:57:48.160897 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:57:48.160897 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:57:48.160897 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:57:48.160897 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application with Lock( Jul 23 20:57:48.160897 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:57:48.160897 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:57:48.160897 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:57:48.160897 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:57:48.160897 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:57:48.160897 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:57:48.161789 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:57:48.161789 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:57:48.161789 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 23 20:57:48.161789 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 23 20:57:48.161789 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 23 20:57:48.161789 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 23 20:57:48.161789 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 23 20:57:48.161789 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 23 20:57:48.161789 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 23 20:57:48.161789 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 20:57:48.161789 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 246/493] 10.222.0.17 () {56 vars in 1093 bytes} [Sat Jul 23 20:57:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:57:48.162880 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f41e64-1a2c-4432-97ad-92d5525e1af2 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:48.181657 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c904ad5-a16b-4a45-8f0d-ab2d4022e091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:48.182857 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c904ad5-a16b-4a45-8f0d-ab2d4022e091 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:48.183276 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c904ad5-a16b-4a45-8f0d-ab2d4022e091 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:48.183675 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c904ad5-a16b-4a45-8f0d-ab2d4022e091 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:48.195981 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c904ad5-a16b-4a45-8f0d-ab2d4022e091 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:57:48.204148 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-2c904ad5-a16b-4a45-8f0d-ab2d4022e091 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 23 20:57:48.204148 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:57:48.204148 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:57:48.204148 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:57:48.204148 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:57:48.204148 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:57:48.204148 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:57:48.204148 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:57:48.204148 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:57:48.204148 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:57:48.204148 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:57:48.204148 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:57:48.204148 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:57:48.204148 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:57:48.204148 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:57:48.204148 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:57:48.205261 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:57:48.205261 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:57:48.205261 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:57:48.205261 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:57:48.205261 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:57:48.205261 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:57:48.205261 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:57:48.205261 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:57:48.205261 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:57:48.205261 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:57:48.205261 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:57:48.205261 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application with Lock( Jul 23 20:57:48.205261 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:57:48.205261 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:57:48.205261 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:57:48.205261 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:57:48.206296 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:57:48.206296 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:57:48.206296 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:57:48.206296 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:57:48.206296 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:57:48.206296 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:57:48.206296 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:57:48.206296 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:57:48.206296 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:57:48.206296 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:57:48.206296 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 23 20:57:48.206296 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:57:48.208788 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 248/494] 10.222.0.17 () {56 vars in 1102 bytes} [Sat Jul 23 20:57:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:57:48.210068 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c904ad5-a16b-4a45-8f0d-ab2d4022e091 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:48.253199 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:48.291408 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f41e64-1a2c-4432-97ad-92d5525e1af2 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:48.338253 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4902e1-a447-4ee9-9561-3146a0e3f869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:48.339074 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4902e1-a447-4ee9-9561-3146a0e3f869 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:48.339352 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4902e1-a447-4ee9-9561-3146a0e3f869 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:48.339629 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4902e1-a447-4ee9-9561-3146a0e3f869 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:48.353248 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4902e1-a447-4ee9-9561-3146a0e3f869 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:57:48.364930 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c904ad5-a16b-4a45-8f0d-ab2d4022e091 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:48.369352 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-dc4902e1-a447-4ee9-9561-3146a0e3f869 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 23 20:57:48.369352 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:57:48.369352 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:57:48.369352 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:57:48.369352 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:57:48.369352 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:57:48.369352 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:57:48.369352 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:57:48.369352 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:57:48.369352 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:57:48.369352 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:57:48.369352 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:57:48.369352 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:57:48.369352 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:57:48.369352 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:57:48.369352 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:57:48.370302 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:57:48.370302 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:57:48.370302 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:57:48.370302 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:57:48.370302 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:57:48.370302 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:57:48.370302 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:57:48.370302 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:57:48.370302 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:57:48.370302 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:57:48.370302 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:57:48.370302 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application with Lock( Jul 23 20:57:48.370302 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:57:48.370302 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:57:48.370302 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:57:48.370302 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:57:48.371100 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:57:48.371100 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:57:48.371100 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:57:48.371100 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:57:48.371100 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:57:48.371100 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:57:48.371100 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:57:48.371100 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:57:48.371100 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:57:48.371100 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:57:48.371100 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 23 20:57:48.371100 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 20:57:48.377750 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 247/495] 10.222.0.17 () {56 vars in 1102 bytes} [Sat Jul 23 20:57:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:57:48.377750 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4902e1-a447-4ee9-9561-3146a0e3f869 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:48.408345 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88b3aa7-27da-4718-8176-adafab717813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:48.409166 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88b3aa7-27da-4718-8176-adafab717813 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:48.409443 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88b3aa7-27da-4718-8176-adafab717813 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:48.409842 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88b3aa7-27da-4718-8176-adafab717813 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:48.421608 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88b3aa7-27da-4718-8176-adafab717813 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:57:48.430435 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:48.431330 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-a88b3aa7-27da-4718-8176-adafab717813 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 23 20:57:48.431330 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:57:48.431330 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:57:48.431330 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:57:48.431330 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:57:48.431330 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:57:48.431330 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:57:48.431330 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:57:48.431330 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:57:48.431330 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:57:48.431330 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:57:48.431330 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:57:48.431330 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:57:48.431330 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:57:48.431330 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:57:48.431330 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:57:48.432231 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:57:48.432231 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:57:48.432231 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:57:48.432231 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:57:48.432231 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:57:48.432231 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:57:48.432231 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:57:48.432231 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:57:48.432231 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:57:48.432231 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:57:48.432231 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:57:48.432231 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application with Lock( Jul 23 20:57:48.432231 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:57:48.432231 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:57:48.432231 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:57:48.432231 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:57:48.433901 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:57:48.433901 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:57:48.433901 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:57:48.433901 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:57:48.433901 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:57:48.433901 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:57:48.433901 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:57:48.433901 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:57:48.433901 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:57:48.433901 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:57:48.433901 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 23 20:57:48.433901 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:57:48.433901 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 249/496] 10.222.0.17 () {56 vars in 1102 bytes} [Sat Jul 23 20:57:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:57:48.433901 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88b3aa7-27da-4718-8176-adafab717813 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:48.545906 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4902e1-a447-4ee9-9561-3146a0e3f869 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:48.546706 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:48.579310 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88b3aa7-27da-4718-8176-adafab717813 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:48.582331 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c810dd01-7026-4ded-b1ef-53481617f459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:48.583020 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c810dd01-7026-4ded-b1ef-53481617f459 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:48.583297 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c810dd01-7026-4ded-b1ef-53481617f459 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:48.583563 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c810dd01-7026-4ded-b1ef-53481617f459 None admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:48.584405 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c810dd01-7026-4ded-b1ef-53481617f459 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:57:48.584708 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c810dd01-7026-4ded-b1ef-53481617f459 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:48.586228 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c810dd01-7026-4ded-b1ef-53481617f459 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:48.616600 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86926cbb-53f3-414e-8b57-b1791b0ebaee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:48.617191 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86926cbb-53f3-414e-8b57-b1791b0ebaee None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:48.617534 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86926cbb-53f3-414e-8b57-b1791b0ebaee None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:48.617735 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86926cbb-53f3-414e-8b57-b1791b0ebaee None admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:48.618521 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86926cbb-53f3-414e-8b57-b1791b0ebaee None admin] RBAC: Adding query filter params (name=service) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:57:48.618820 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86926cbb-53f3-414e-8b57-b1791b0ebaee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:48.620210 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86926cbb-53f3-414e-8b57-b1791b0ebaee None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:48.625632 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 248/497] 10.222.0.17 () {56 vars in 1133 bytes} [Sat Jul 23 20:57:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:57:48.626307 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c810dd01-7026-4ded-b1ef-53481617f459 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:48.638824 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 250/498] 10.222.0.17 () {56 vars in 1103 bytes} [Sat Jul 23 20:57:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:57:48.638824 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86926cbb-53f3-414e-8b57-b1791b0ebaee None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:48.741314 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:48.746829 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86926cbb-53f3-414e-8b57-b1791b0ebaee None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:48.752690 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c810dd01-7026-4ded-b1ef-53481617f459 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:48.790454 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8318fdea-f206-432f-88ac-3bc07b83c01a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:48.791081 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8318fdea-f206-432f-88ac-3bc07b83c01a None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:48.791393 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8318fdea-f206-432f-88ac-3bc07b83c01a None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:48.791613 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8318fdea-f206-432f-88ac-3bc07b83c01a None admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:48.792398 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8318fdea-f206-432f-88ac-3bc07b83c01a None admin] RBAC: Adding query filter params (name=service) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:57:48.792698 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8318fdea-f206-432f-88ac-3bc07b83c01a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:48.794190 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8318fdea-f206-432f-88ac-3bc07b83c01a None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:48.799487 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09de242f-415a-47f8-9065-a5daf274fb33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:48.800252 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09de242f-415a-47f8-9065-a5daf274fb33 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:48.800595 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09de242f-415a-47f8-9065-a5daf274fb33 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:48.800796 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09de242f-415a-47f8-9065-a5daf274fb33 None admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:48.801572 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09de242f-415a-47f8-9065-a5daf274fb33 None admin] RBAC: Adding query filter params (name=service) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:57:48.801897 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09de242f-415a-47f8-9065-a5daf274fb33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:48.803390 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09de242f-415a-47f8-9065-a5daf274fb33 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:48.804997 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 251/499] 10.222.0.17 () {56 vars in 1103 bytes} [Sat Jul 23 20:57:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:57:48.806092 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8318fdea-f206-432f-88ac-3bc07b83c01a None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:48.810752 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:48.832024 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 249/500] 10.222.0.17 () {56 vars in 1103 bytes} [Sat Jul 23 20:57:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:57:48.833628 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09de242f-415a-47f8-9065-a5daf274fb33 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:48.922173 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8318fdea-f206-432f-88ac-3bc07b83c01a None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:48.943757 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09de242f-415a-47f8-9065-a5daf274fb33 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:48.956565 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943aa101-0372-45d3-80ac-2825fd0a0580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:48.957269 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943aa101-0372-45d3-80ac-2825fd0a0580 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:48.957617 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943aa101-0372-45d3-80ac-2825fd0a0580 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:48.957928 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943aa101-0372-45d3-80ac-2825fd0a0580 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:48.979530 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c12de67-04fa-4d76-8426-e1f6dc5419d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:48.980374 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c12de67-04fa-4d76-8426-e1f6dc5419d5 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:48.980633 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c12de67-04fa-4d76-8426-e1f6dc5419d5 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:48.980897 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c12de67-04fa-4d76-8426-e1f6dc5419d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:48.991957 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c12de67-04fa-4d76-8426-e1f6dc5419d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:48.993437 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c12de67-04fa-4d76-8426-e1f6dc5419d5 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:49.013842 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-0c12de67-04fa-4d76-8426-e1f6dc5419d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:57:49.013842 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:57:49.013842 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:57:49.013842 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:57:49.013842 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:57:49.013842 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:57:49.013842 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:57:49.013842 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:57:49.013842 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:57:49.013842 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:57:49.013842 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:57:49.013842 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:57:49.013842 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 23 20:57:49.013842 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 23 20:57:49.013842 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 23 20:57:49.014940 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 23 20:57:49.014940 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:57:49.014940 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:57:49.014940 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:57:49.014940 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:57:49.014940 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:57:49.014940 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:57:49.014940 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:57:49.014940 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application with Lock( Jul 23 20:57:49.014940 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:57:49.014940 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:57:49.014940 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:57:49.014940 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:57:49.014940 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:57:49.014940 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:57:49.014940 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:57:49.014940 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:57:49.020919 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 23 20:57:49.020919 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 23 20:57:49.020919 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:57:49.020919 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 20:57:49.020919 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 250/501] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 23 20:57:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:57:49.020919 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c12de67-04fa-4d76-8426-e1f6dc5419d5 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:49.020919 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:49.047139 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943aa101-0372-45d3-80ac-2825fd0a0580 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:49.048605 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943aa101-0372-45d3-80ac-2825fd0a0580 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:49.051519 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:49.129620 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c12de67-04fa-4d76-8426-e1f6dc5419d5 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:49.152117 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 252/502] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Jul 23 20:57:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 23 20:57:49.153055 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943aa101-0372-45d3-80ac-2825fd0a0580 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:49.166029 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d5627d-f020-4509-9441-eca6491c4be5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:49.166850 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d5627d-f020-4509-9441-eca6491c4be5 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:49.167120 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d5627d-f020-4509-9441-eca6491c4be5 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:49.167383 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d5627d-f020-4509-9441-eca6491c4be5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:49.179663 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d5627d-f020-4509-9441-eca6491c4be5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:49.180421 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d5627d-f020-4509-9441-eca6491c4be5 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:49.201344 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-04d5627d-f020-4509-9441-eca6491c4be5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:57:49.201344 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:57:49.201344 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:57:49.201344 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:57:49.201344 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:57:49.201344 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:57:49.201344 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:57:49.201344 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:57:49.201344 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:57:49.201344 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:57:49.201344 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:57:49.201344 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:57:49.201344 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 23 20:57:49.201344 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 23 20:57:49.201344 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 23 20:57:49.202461 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 23 20:57:49.202461 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:57:49.202461 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:57:49.202461 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:57:49.202461 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:57:49.202461 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:57:49.202461 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:57:49.202461 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:57:49.202461 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application with Lock( Jul 23 20:57:49.202461 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:57:49.202461 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:57:49.202461 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:57:49.202461 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:57:49.202461 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:57:49.202461 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:57:49.202461 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:57:49.202461 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:57:49.203494 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 23 20:57:49.203494 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 23 20:57:49.203494 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:57:49.203494 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 20:57:49.207309 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 251/503] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 23 20:57:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:57:49.208573 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b83addc-89a5-4538-8311-638046405c1c None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:49.208857 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b83addc-89a5-4538-8311-638046405c1c None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:49.209129 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b83addc-89a5-4538-8311-638046405c1c None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:49.210457 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 252/504] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:57:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:57:49.213990 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b83addc-89a5-4538-8311-638046405c1c None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:49.267031 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943aa101-0372-45d3-80ac-2825fd0a0580 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:49.269851 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:49.277552 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:49.303737 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31607c0b-a071-4fdd-b427-2ff1cc48e3ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:49.304556 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31607c0b-a071-4fdd-b427-2ff1cc48e3ba None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:49.304836 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31607c0b-a071-4fdd-b427-2ff1cc48e3ba None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:49.305116 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31607c0b-a071-4fdd-b427-2ff1cc48e3ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:49.315647 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31607c0b-a071-4fdd-b427-2ff1cc48e3ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:49.317241 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31607c0b-a071-4fdd-b427-2ff1cc48e3ba None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:49.324783 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b83addc-89a5-4538-8311-638046405c1c None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:49.335257 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-31607c0b-a071-4fdd-b427-2ff1cc48e3ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:57:49.335257 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:57:49.335257 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:57:49.335257 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:57:49.335257 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:57:49.335257 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:57:49.335257 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:57:49.335257 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:57:49.335257 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:57:49.335257 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:57:49.335257 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:57:49.335257 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:57:49.335257 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 23 20:57:49.335257 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 23 20:57:49.335257 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 23 20:57:49.336332 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 23 20:57:49.336332 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:57:49.336332 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:57:49.336332 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:57:49.336332 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:57:49.336332 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:57:49.336332 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:57:49.336332 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:57:49.336332 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application with Lock( Jul 23 20:57:49.336332 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:57:49.336332 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:57:49.336332 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:57:49.336332 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:57:49.336332 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:57:49.336332 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:57:49.336332 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:57:49.336332 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:57:49.337318 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 23 20:57:49.337318 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 23 20:57:49.337318 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:57:49.337318 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:57:49.337318 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 253/505] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 23 20:57:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:57:49.337640 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31607c0b-a071-4fdd-b427-2ff1cc48e3ba None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:49.364979 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c29de0-05b5-45d1-8ef4-a4c34025f5c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:49.365705 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c29de0-05b5-45d1-8ef4-a4c34025f5c3 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:49.366028 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c29de0-05b5-45d1-8ef4-a4c34025f5c3 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:49.366336 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c29de0-05b5-45d1-8ef4-a4c34025f5c3 None admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:49.367067 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c29de0-05b5-45d1-8ef4-a4c34025f5c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:57:49.367367 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c29de0-05b5-45d1-8ef4-a4c34025f5c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:49.368797 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c29de0-05b5-45d1-8ef4-a4c34025f5c3 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:49.380658 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 253/506] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 23 20:57:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:57:49.381482 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c29de0-05b5-45d1-8ef4-a4c34025f5c3 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:49.444498 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31607c0b-a071-4fdd-b427-2ff1cc48e3ba None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:49.479234 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a616e4-5844-45e7-a9c6-e8bfca32195c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:49.480049 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a616e4-5844-45e7-a9c6-e8bfca32195c None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:49.480319 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a616e4-5844-45e7-a9c6-e8bfca32195c None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:49.480569 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a616e4-5844-45e7-a9c6-e8bfca32195c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:49.487085 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c29de0-05b5-45d1-8ef4-a4c34025f5c3 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:49.490885 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a616e4-5844-45e7-a9c6-e8bfca32195c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:49.492352 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a616e4-5844-45e7-a9c6-e8bfca32195c None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:49.503881 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:49.510590 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-c1a616e4-5844-45e7-a9c6-e8bfca32195c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:57:49.510590 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:57:49.510590 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:57:49.510590 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:57:49.510590 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:57:49.510590 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:57:49.510590 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:57:49.510590 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:57:49.510590 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:57:49.510590 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:57:49.510590 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:57:49.510590 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:57:49.510590 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 23 20:57:49.510590 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 23 20:57:49.510590 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 23 20:57:49.511447 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 23 20:57:49.511447 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:57:49.511447 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:57:49.511447 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:57:49.511447 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:57:49.511447 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:57:49.511447 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:57:49.511447 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:57:49.511447 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application with Lock( Jul 23 20:57:49.511447 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:57:49.511447 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:57:49.511447 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:57:49.511447 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:57:49.511447 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:57:49.511447 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:57:49.511447 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:57:49.511447 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:57:49.516998 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 23 20:57:49.516998 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 23 20:57:49.516998 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:57:49.516998 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:57:49.516998 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 254/507] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 23 20:57:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:57:49.516998 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e3d632-9e29-4163-817b-862c3c60d72c None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:49.516998 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e3d632-9e29-4163-817b-862c3c60d72c None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:49.516998 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e3d632-9e29-4163-817b-862c3c60d72c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:49.522897 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42587891-47e8-4717-8a18-0c598986f6a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:49.523562 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42587891-47e8-4717-8a18-0c598986f6a3 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:49.523840 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42587891-47e8-4717-8a18-0c598986f6a3 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:49.524110 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42587891-47e8-4717-8a18-0c598986f6a3 None admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:49.524828 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42587891-47e8-4717-8a18-0c598986f6a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:57:49.525121 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42587891-47e8-4717-8a18-0c598986f6a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:49.526556 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42587891-47e8-4717-8a18-0c598986f6a3 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:49.532884 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-45e3d632-9e29-4163-817b-862c3c60d72c None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:57:49.534134 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-45e3d632-9e29-4163-817b-862c3c60d72c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:57:49.536364 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:49.543353 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 254/508] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 23 20:57:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:57:49.544275 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42587891-47e8-4717-8a18-0c598986f6a3 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:49.606292 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 255/509] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:57:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 23 20:57:49.607165 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e3d632-9e29-4163-817b-862c3c60d72c None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:49.658184 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42587891-47e8-4717-8a18-0c598986f6a3 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:49.696327 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b715ad0-8436-48f0-964c-849369283ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:49.696907 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b715ad0-8436-48f0-964c-849369283ee9 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:49.697187 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b715ad0-8436-48f0-964c-849369283ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:49.697452 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b715ad0-8436-48f0-964c-849369283ee9 None admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:49.698201 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b715ad0-8436-48f0-964c-849369283ee9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:57:49.698498 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b715ad0-8436-48f0-964c-849369283ee9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:49.699885 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b715ad0-8436-48f0-964c-849369283ee9 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:49.705948 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e3d632-9e29-4163-817b-862c3c60d72c None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:49.712931 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 255/510] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 23 20:57:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:57:49.713767 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b715ad0-8436-48f0-964c-849369283ee9 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:49.744113 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e833263-04dd-4b89-a3f8-6dc46fc8ac72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:49.744931 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e833263-04dd-4b89-a3f8-6dc46fc8ac72 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:49.745211 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e833263-04dd-4b89-a3f8-6dc46fc8ac72 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:49.745483 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e833263-04dd-4b89-a3f8-6dc46fc8ac72 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:49.748743 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:49.752931 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e833263-04dd-4b89-a3f8-6dc46fc8ac72 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:49.754478 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e833263-04dd-4b89-a3f8-6dc46fc8ac72 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:49.756415 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:49.771788 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-0e833263-04dd-4b89-a3f8-6dc46fc8ac72 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 23 20:57:49.771788 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:57:49.771788 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:57:49.771788 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:57:49.771788 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:57:49.771788 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:57:49.771788 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:57:49.771788 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:57:49.771788 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:57:49.771788 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:57:49.771788 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:57:49.771788 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:57:49.771788 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 23 20:57:49.771788 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 23 20:57:49.771788 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 23 20:57:49.771788 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 23 20:57:49.772900 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:57:49.772900 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:57:49.772900 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 23 20:57:49.772900 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 23 20:57:49.772900 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 23 20:57:49.772900 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 23 20:57:49.772900 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:57:49.772900 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:57:49.772900 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:57:49.772900 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:57:49.772900 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:57:49.772900 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application with Lock( Jul 23 20:57:49.772900 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:57:49.772900 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:57:49.772900 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:57:49.772900 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:57:49.772900 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:57:49.772900 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:57:49.774112 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:57:49.774112 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:57:49.774112 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 23 20:57:49.774112 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 23 20:57:49.774112 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 23 20:57:49.774112 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 23 20:57:49.774112 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 23 20:57:49.774112 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 23 20:57:49.774112 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 23 20:57:49.774112 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:57:49.774112 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 256/511] 10.222.0.17 () {56 vars in 1102 bytes} [Sat Jul 23 20:57:49 2022] GET /identity/v3/users/neutron => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:57:49.774112 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e833263-04dd-4b89-a3f8-6dc46fc8ac72 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:49.818992 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b715ad0-8436-48f0-964c-849369283ee9 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:49.858026 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb139e8-1045-4f93-9484-060e438ef678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:49.858879 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb139e8-1045-4f93-9484-060e438ef678 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:49.859158 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb139e8-1045-4f93-9484-060e438ef678 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:49.859424 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb139e8-1045-4f93-9484-060e438ef678 None admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:49.860142 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb139e8-1045-4f93-9484-060e438ef678 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:57:49.860440 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb139e8-1045-4f93-9484-060e438ef678 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:49.861889 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb139e8-1045-4f93-9484-060e438ef678 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:49.874167 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 256/512] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 23 20:57:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:57:49.875276 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb139e8-1045-4f93-9484-060e438ef678 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:49.887910 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e833263-04dd-4b89-a3f8-6dc46fc8ac72 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:49.924257 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfe7960-5d35-45ee-a864-14d4f00426f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:49.925416 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfe7960-5d35-45ee-a864-14d4f00426f7 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:49.925793 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfe7960-5d35-45ee-a864-14d4f00426f7 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:49.926266 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfe7960-5d35-45ee-a864-14d4f00426f7 None admin] PATH_INFO: `/v3/users/glance` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:49.934289 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfe7960-5d35-45ee-a864-14d4f00426f7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:49.935775 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfe7960-5d35-45ee-a864-14d4f00426f7 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:49.950416 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-3bfe7960-5d35-45ee-a864-14d4f00426f7 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 23 20:57:49.950416 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:57:49.950416 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:57:49.950416 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:57:49.950416 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:57:49.950416 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:57:49.950416 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:57:49.950416 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:57:49.950416 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:57:49.950416 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:57:49.950416 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:57:49.950416 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:57:49.950416 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 23 20:57:49.950416 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 23 20:57:49.950416 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 23 20:57:49.950416 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 23 20:57:49.951339 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:57:49.951339 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:57:49.951339 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 23 20:57:49.951339 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 23 20:57:49.951339 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 23 20:57:49.951339 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 23 20:57:49.951339 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:57:49.951339 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:57:49.951339 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:57:49.951339 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:57:49.951339 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:57:49.951339 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application with Lock( Jul 23 20:57:49.951339 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:57:49.951339 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:57:49.951339 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:57:49.951339 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:57:49.951339 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:57:49.951339 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:57:49.952239 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:57:49.952239 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:57:49.952239 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 23 20:57:49.952239 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 23 20:57:49.952239 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 23 20:57:49.952239 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 23 20:57:49.952239 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 23 20:57:49.952239 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 23 20:57:49.952239 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 23 20:57:49.952239 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:57:49.952239 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 257/513] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Jul 23 20:57:49 2022] GET /identity/v3/users/glance => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:57:49.952780 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfe7960-5d35-45ee-a864-14d4f00426f7 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:49.974279 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:49.980481 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb139e8-1045-4f93-9484-060e438ef678 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:50.009320 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:50.015128 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a80cbe-39f4-4c80-811f-a95c550a7410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:50.015948 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a80cbe-39f4-4c80-811f-a95c550a7410 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:50.016225 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a80cbe-39f4-4c80-811f-a95c550a7410 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:50.016520 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a80cbe-39f4-4c80-811f-a95c550a7410 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:50.027421 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a80cbe-39f4-4c80-811f-a95c550a7410 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:50.029298 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a80cbe-39f4-4c80-811f-a95c550a7410 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:50.046353 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-54a80cbe-39f4-4c80-811f-a95c550a7410 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:57:50.046353 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:57:50.046353 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:57:50.046353 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:57:50.046353 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:57:50.046353 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:57:50.046353 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:57:50.046353 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:57:50.046353 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:57:50.046353 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:57:50.046353 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:57:50.046353 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:57:50.046353 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 23 20:57:50.046353 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 23 20:57:50.046353 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 23 20:57:50.047209 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 23 20:57:50.047209 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:57:50.047209 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:57:50.047209 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:57:50.047209 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:57:50.047209 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:57:50.047209 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:57:50.047209 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:57:50.047209 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application with Lock( Jul 23 20:57:50.047209 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:57:50.047209 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:57:50.047209 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:57:50.047209 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:57:50.047209 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:57:50.047209 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:57:50.047209 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:57:50.047209 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:57:50.048038 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 23 20:57:50.048038 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 23 20:57:50.048038 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:57:50.048038 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 20:57:50.048038 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 257/514] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 23 20:57:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:57:50.048736 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a80cbe-39f4-4c80-811f-a95c550a7410 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:50.056593 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfe7960-5d35-45ee-a864-14d4f00426f7 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:50.091515 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dfa9b8-0152-431f-ae29-729e8818f164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:50.092329 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dfa9b8-0152-431f-ae29-729e8818f164 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:50.092588 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dfa9b8-0152-431f-ae29-729e8818f164 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:50.092860 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dfa9b8-0152-431f-ae29-729e8818f164 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:50.100035 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dfa9b8-0152-431f-ae29-729e8818f164 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:50.101485 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dfa9b8-0152-431f-ae29-729e8818f164 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:50.116729 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-12dfa9b8-0152-431f-ae29-729e8818f164 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 23 20:57:50.116729 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:57:50.116729 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:57:50.116729 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:57:50.116729 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:57:50.116729 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:57:50.116729 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:57:50.116729 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:57:50.116729 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:57:50.116729 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:57:50.116729 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:57:50.116729 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:57:50.116729 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 23 20:57:50.116729 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 23 20:57:50.116729 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 23 20:57:50.116729 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 23 20:57:50.117690 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:57:50.117690 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:57:50.117690 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 23 20:57:50.117690 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 23 20:57:50.117690 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 23 20:57:50.117690 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 23 20:57:50.117690 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:57:50.117690 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:57:50.117690 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:57:50.117690 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:57:50.117690 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:57:50.117690 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application with Lock( Jul 23 20:57:50.117690 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:57:50.117690 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:57:50.117690 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:57:50.117690 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:57:50.117690 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:57:50.117690 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:57:50.118626 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:57:50.118626 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:57:50.118626 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 23 20:57:50.118626 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 23 20:57:50.118626 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 23 20:57:50.118626 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 23 20:57:50.118626 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 23 20:57:50.118626 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 23 20:57:50.118626 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 23 20:57:50.118626 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:57:50.122051 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 258/515] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Jul 23 20:57:49 2022] GET /identity/v3/users/cinder => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:57:50.123218 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dfa9b8-0152-431f-ae29-729e8818f164 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:50.151012 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a80cbe-39f4-4c80-811f-a95c550a7410 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:50.185846 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272bdb89-8b03-465c-8037-1eddad33d215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:50.186575 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272bdb89-8b03-465c-8037-1eddad33d215 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:50.186857 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272bdb89-8b03-465c-8037-1eddad33d215 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:50.187132 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272bdb89-8b03-465c-8037-1eddad33d215 None admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:50.187968 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272bdb89-8b03-465c-8037-1eddad33d215 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:57:50.188351 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272bdb89-8b03-465c-8037-1eddad33d215 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:50.189806 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272bdb89-8b03-465c-8037-1eddad33d215 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:50.207301 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 258/516] 10.222.0.17 () {56 vars in 1139 bytes} [Sat Jul 23 20:57:50 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:57:50.208170 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272bdb89-8b03-465c-8037-1eddad33d215 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:50.219657 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:50.225541 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dfa9b8-0152-431f-ae29-729e8818f164 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:50.244618 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:50.264169 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79aa3cda-4891-4ff2-9d47-e134edd0f9d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:50.264978 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aa3cda-4891-4ff2-9d47-e134edd0f9d3 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:50.265255 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aa3cda-4891-4ff2-9d47-e134edd0f9d3 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:50.265529 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aa3cda-4891-4ff2-9d47-e134edd0f9d3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:50.272558 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79aa3cda-4891-4ff2-9d47-e134edd0f9d3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:50.274059 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79aa3cda-4891-4ff2-9d47-e134edd0f9d3 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:50.288989 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-79aa3cda-4891-4ff2-9d47-e134edd0f9d3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 23 20:57:50.288989 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:57:50.288989 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:57:50.288989 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:57:50.288989 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:57:50.288989 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:57:50.288989 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:57:50.288989 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:57:50.288989 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:57:50.288989 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:57:50.288989 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:57:50.288989 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:57:50.288989 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 23 20:57:50.288989 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 23 20:57:50.288989 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 23 20:57:50.289853 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 23 20:57:50.289853 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:57:50.289853 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:57:50.289853 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:57:50.289853 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:57:50.289853 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:57:50.289853 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:57:50.289853 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:57:50.289853 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application with Lock( Jul 23 20:57:50.289853 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:57:50.289853 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:57:50.289853 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:57:50.289853 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:57:50.289853 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:57:50.289853 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:57:50.289853 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:57:50.289853 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:57:50.290731 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 23 20:57:50.290731 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 23 20:57:50.290731 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 23 20:57:50.290731 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 23 20:57:50.290731 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 23 20:57:50.290731 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 23 20:57:50.290731 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 23 20:57:50.290731 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:57:50.290731 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 259/517] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Jul 23 20:57:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:57:50.291188 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79aa3cda-4891-4ff2-9d47-e134edd0f9d3 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:50.318121 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272bdb89-8b03-465c-8037-1eddad33d215 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:50.352052 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129e361e-8da8-409c-b6e0-bda759cadf08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:50.352740 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129e361e-8da8-409c-b6e0-bda759cadf08 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:50.353022 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129e361e-8da8-409c-b6e0-bda759cadf08 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:50.353295 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129e361e-8da8-409c-b6e0-bda759cadf08 None admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:50.354164 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129e361e-8da8-409c-b6e0-bda759cadf08 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:57:50.354468 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129e361e-8da8-409c-b6e0-bda759cadf08 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:50.355988 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129e361e-8da8-409c-b6e0-bda759cadf08 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:50.374265 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 259/518] 10.222.0.17 () {56 vars in 1137 bytes} [Sat Jul 23 20:57:50 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:57:50.375086 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129e361e-8da8-409c-b6e0-bda759cadf08 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:50.397527 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79aa3cda-4891-4ff2-9d47-e134edd0f9d3 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:50.432776 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a0beff-f742-4b0f-835c-9e72463e5e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:50.433509 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a0beff-f742-4b0f-835c-9e72463e5e66 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:50.433880 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a0beff-f742-4b0f-835c-9e72463e5e66 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:50.434306 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a0beff-f742-4b0f-835c-9e72463e5e66 None admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:50.434969 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a0beff-f742-4b0f-835c-9e72463e5e66 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:57:50.435275 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a0beff-f742-4b0f-835c-9e72463e5e66 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:50.436660 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a0beff-f742-4b0f-835c-9e72463e5e66 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:50.437439 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:50.454766 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 260/519] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 23 20:57:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:57:50.455609 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a0beff-f742-4b0f-835c-9e72463e5e66 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:50.479888 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129e361e-8da8-409c-b6e0-bda759cadf08 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:50.496459 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:50.513774 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e49e34-2a22-4135-b69c-645b186082f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:50.514506 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e49e34-2a22-4135-b69c-645b186082f8 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:50.514780 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e49e34-2a22-4135-b69c-645b186082f8 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:50.515046 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e49e34-2a22-4135-b69c-645b186082f8 None admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:50.515880 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e49e34-2a22-4135-b69c-645b186082f8 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:57:50.516166 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e49e34-2a22-4135-b69c-645b186082f8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:50.517622 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e49e34-2a22-4135-b69c-645b186082f8 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:50.536101 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 260/520] 10.222.0.17 () {56 vars in 1137 bytes} [Sat Jul 23 20:57:50 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:57:50.536783 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e49e34-2a22-4135-b69c-645b186082f8 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:50.561607 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a0beff-f742-4b0f-835c-9e72463e5e66 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:50.596423 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3875c865-2eff-4878-974d-53a701592cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:50.597074 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3875c865-2eff-4878-974d-53a701592cfa None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:50.597387 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3875c865-2eff-4878-974d-53a701592cfa None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:50.597656 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3875c865-2eff-4878-974d-53a701592cfa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:50.641314 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e49e34-2a22-4135-b69c-645b186082f8 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:50.664394 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:50.667929 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3875c865-2eff-4878-974d-53a701592cfa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:50.669431 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3875c865-2eff-4878-974d-53a701592cfa None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:50.677238 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c73bbb-db64-4058-80d6-0d9e411d94d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:50.677935 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c73bbb-db64-4058-80d6-0d9e411d94d7 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:50.678213 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c73bbb-db64-4058-80d6-0d9e411d94d7 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:50.678476 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c73bbb-db64-4058-80d6-0d9e411d94d7 None admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:50.679254 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c73bbb-db64-4058-80d6-0d9e411d94d7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:57:50.679555 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c73bbb-db64-4058-80d6-0d9e411d94d7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:50.680973 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c73bbb-db64-4058-80d6-0d9e411d94d7 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:50.699435 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 261/521] 10.222.0.17 () {56 vars in 1148 bytes} [Sat Jul 23 20:57:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:57:50.700296 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c73bbb-db64-4058-80d6-0d9e411d94d7 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:50.710627 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:50.774679 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 261/522] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Jul 23 20:57:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 23 20:57:50.779964 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3875c865-2eff-4878-974d-53a701592cfa None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:50.812880 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c73bbb-db64-4058-80d6-0d9e411d94d7 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:50.847557 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99708c53-4262-4969-9fa5-6fa7ebb9ddda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:50.848115 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99708c53-4262-4969-9fa5-6fa7ebb9ddda None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:50.848396 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99708c53-4262-4969-9fa5-6fa7ebb9ddda None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:50.848667 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99708c53-4262-4969-9fa5-6fa7ebb9ddda None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:50.879257 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3875c865-2eff-4878-974d-53a701592cfa None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:50.897542 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:50.913156 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8b4c54-1e5e-42fa-a282-215994754486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:50.913834 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8b4c54-1e5e-42fa-a282-215994754486 None admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:50.914145 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8b4c54-1e5e-42fa-a282-215994754486 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:50.914416 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8b4c54-1e5e-42fa-a282-215994754486 None admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:50.915123 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8b4c54-1e5e-42fa-a282-215994754486 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:50.916587 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8b4c54-1e5e-42fa-a282-215994754486 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:50.917260 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99708c53-4262-4969-9fa5-6fa7ebb9ddda None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:50.918734 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99708c53-4262-4969-9fa5-6fa7ebb9ddda None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:50.925108 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:50.939139 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 262/523] 10.222.0.17 () {60 vars in 1132 bytes} [Sat Jul 23 20:57:50 2022] POST /identity/v3/users => generated 247 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 20:57:50.939965 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8b4c54-1e5e-42fa-a282-215994754486 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:51.043684 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 262/524] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Jul 23 20:57:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 23 20:57:51.043684 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99708c53-4262-4969-9fa5-6fa7ebb9ddda None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:51.067536 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8b4c54-1e5e-42fa-a282-215994754486 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:51.106014 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4238bcc-f047-4910-a623-e40430e08969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:51.106690 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4238bcc-f047-4910-a623-e40430e08969 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:51.106968 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4238bcc-f047-4910-a623-e40430e08969 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:51.107368 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4238bcc-f047-4910-a623-e40430e08969 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:51.138871 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:51.161653 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99708c53-4262-4969-9fa5-6fa7ebb9ddda None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:51.181047 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:51.190095 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4238bcc-f047-4910-a623-e40430e08969 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:51.191855 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4238bcc-f047-4910-a623-e40430e08969 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:51.202224 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7171658d-beeb-4ffe-aac2-bff0c273dbba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:51.202892 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7171658d-beeb-4ffe-aac2-bff0c273dbba None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:51.203188 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7171658d-beeb-4ffe-aac2-bff0c273dbba None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:51.203455 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7171658d-beeb-4ffe-aac2-bff0c273dbba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:51.204294 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7171658d-beeb-4ffe-aac2-bff0c273dbba None admin] RBAC: Adding query filter params (role.id=abf9f3b81f3647dbb70c44d0aedaa614, scope.project.id=4804ed61295f4d4a92d9b685dd9e9f3b, user.id=079f31ed2c844e67bd4e206f24b69d97) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:57:51.204602 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7171658d-beeb-4ffe-aac2-bff0c273dbba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:51.206151 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7171658d-beeb-4ffe-aac2-bff0c273dbba None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:51.212688 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 263/525] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Jul 23 20:57:51 2022] GET /identity/v3/role_assignments?user.id=079f31ed2c844e67bd4e206f24b69d97&scope.project.id=4804ed61295f4d4a92d9b685dd9e9f3b&role.id=abf9f3b81f3647dbb70c44d0aedaa614 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:57:51.213716 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7171658d-beeb-4ffe-aac2-bff0c273dbba None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:51.348208 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 263/526] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Jul 23 20:57:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 23 20:57:51.348208 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4238bcc-f047-4910-a623-e40430e08969 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:51.355197 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7171658d-beeb-4ffe-aac2-bff0c273dbba None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:51.395684 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436e650d-5553-4ec8-8313-f2fe3c22404d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:51.396902 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436e650d-5553-4ec8-8313-f2fe3c22404d None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:51.397392 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436e650d-5553-4ec8-8313-f2fe3c22404d None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:51.397951 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436e650d-5553-4ec8-8313-f2fe3c22404d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:51.411257 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436e650d-5553-4ec8-8313-f2fe3c22404d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:51.413068 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436e650d-5553-4ec8-8313-f2fe3c22404d None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:51.433133 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:51.434958 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-436e650d-5553-4ec8-8313-f2fe3c22404d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:57:51.434958 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:57:51.434958 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:57:51.434958 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:57:51.434958 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:57:51.434958 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:57:51.434958 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:57:51.434958 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:57:51.434958 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:57:51.434958 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:57:51.434958 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:57:51.434958 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:57:51.434958 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 23 20:57:51.434958 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 23 20:57:51.434958 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 23 20:57:51.435812 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 23 20:57:51.435812 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:57:51.435812 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:57:51.435812 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:57:51.435812 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:57:51.435812 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:57:51.435812 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:57:51.435812 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:57:51.435812 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application with Lock( Jul 23 20:57:51.435812 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:57:51.435812 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:57:51.435812 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:57:51.435812 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:57:51.435812 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:57:51.435812 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:57:51.435812 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:57:51.435812 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:57:51.436694 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 23 20:57:51.436694 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 23 20:57:51.436694 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:57:51.436694 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 20:57:51.443734 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 264/527] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 23 20:57:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:57:51.443734 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436e650d-5553-4ec8-8313-f2fe3c22404d None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:51.458786 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:51.466213 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4238bcc-f047-4910-a623-e40430e08969 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:51.505420 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a696ef-f24b-417a-9c98-e08616998fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:51.506740 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a696ef-f24b-417a-9c98-e08616998fc5 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:51.507143 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a696ef-f24b-417a-9c98-e08616998fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:51.507707 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a696ef-f24b-417a-9c98-e08616998fc5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:51.520403 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a696ef-f24b-417a-9c98-e08616998fc5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:51.522311 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a696ef-f24b-417a-9c98-e08616998fc5 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:51.553135 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-c2a696ef-f24b-417a-9c98-e08616998fc5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:57:51.553135 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:57:51.553135 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:57:51.553135 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:57:51.553135 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:57:51.553135 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:57:51.553135 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:57:51.553135 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:57:51.553135 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:57:51.553135 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:57:51.553135 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:57:51.553135 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:57:51.553135 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 23 20:57:51.553135 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 23 20:57:51.553135 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 23 20:57:51.554510 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 23 20:57:51.554510 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:57:51.554510 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:57:51.554510 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:57:51.554510 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:57:51.554510 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:57:51.554510 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:57:51.554510 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:57:51.554510 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application with Lock( Jul 23 20:57:51.554510 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:57:51.554510 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:57:51.554510 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:57:51.554510 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:57:51.554510 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:57:51.554510 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:57:51.554510 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:57:51.554510 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:57:51.555629 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 23 20:57:51.555629 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 23 20:57:51.555629 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:57:51.555629 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:57:51.558098 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 264/528] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 23 20:57:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:57:51.559179 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a696ef-f24b-417a-9c98-e08616998fc5 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:51.587449 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436e650d-5553-4ec8-8313-f2fe3c22404d None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:51.624510 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e849ee5a-67f4-4018-ae79-e7fdf8e82eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:51.625389 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e849ee5a-67f4-4018-ae79-e7fdf8e82eee None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:51.625765 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e849ee5a-67f4-4018-ae79-e7fdf8e82eee None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:51.626159 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e849ee5a-67f4-4018-ae79-e7fdf8e82eee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:51.637051 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e849ee5a-67f4-4018-ae79-e7fdf8e82eee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:51.638678 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e849ee5a-67f4-4018-ae79-e7fdf8e82eee None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:51.658585 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-e849ee5a-67f4-4018-ae79-e7fdf8e82eee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:57:51.658585 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:57:51.658585 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:57:51.658585 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:57:51.658585 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:57:51.658585 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:57:51.658585 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:57:51.658585 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:57:51.658585 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:57:51.658585 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:57:51.658585 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:57:51.658585 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:57:51.658585 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 23 20:57:51.658585 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 23 20:57:51.658585 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 23 20:57:51.659753 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 23 20:57:51.659753 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:57:51.659753 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:57:51.659753 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:57:51.659753 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:57:51.659753 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:57:51.659753 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:57:51.659753 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:57:51.659753 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application with Lock( Jul 23 20:57:51.659753 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:57:51.659753 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:57:51.659753 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:57:51.659753 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:57:51.659753 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:57:51.659753 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:57:51.659753 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:57:51.659753 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:57:51.660857 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 23 20:57:51.660857 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 23 20:57:51.660857 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:57:51.660857 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 20:57:51.666871 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 265/529] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 23 20:57:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:57:51.666871 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e849ee5a-67f4-4018-ae79-e7fdf8e82eee None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:51.704929 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a696ef-f24b-417a-9c98-e08616998fc5 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:51.720820 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:51.755125 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9aa09a-7be1-4963-85d5-a29da19e4f55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:51.756334 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9aa09a-7be1-4963-85d5-a29da19e4f55 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:51.757227 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9aa09a-7be1-4963-85d5-a29da19e4f55 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:51.757671 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9aa09a-7be1-4963-85d5-a29da19e4f55 None admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:51.758718 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9aa09a-7be1-4963-85d5-a29da19e4f55 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:57:51.759029 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9aa09a-7be1-4963-85d5-a29da19e4f55 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:51.760476 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9aa09a-7be1-4963-85d5-a29da19e4f55 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:51.778889 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 265/530] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 23 20:57:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:57:51.778889 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9aa09a-7be1-4963-85d5-a29da19e4f55 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:51.788794 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:51.791934 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e849ee5a-67f4-4018-ae79-e7fdf8e82eee None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:51.840976 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb1bc70-bae9-4b56-88a2-2441442ae1e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:51.841753 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb1bc70-bae9-4b56-88a2-2441442ae1e4 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:51.842132 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb1bc70-bae9-4b56-88a2-2441442ae1e4 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:51.842481 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb1bc70-bae9-4b56-88a2-2441442ae1e4 None admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:51.843541 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb1bc70-bae9-4b56-88a2-2441442ae1e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:57:51.843976 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb1bc70-bae9-4b56-88a2-2441442ae1e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:51.846258 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb1bc70-bae9-4b56-88a2-2441442ae1e4 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:51.865690 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 266/531] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 23 20:57:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:57:51.866742 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb1bc70-bae9-4b56-88a2-2441442ae1e4 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:51.903590 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9aa09a-7be1-4963-85d5-a29da19e4f55 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:51.951074 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2f68b7-2dac-4d8b-9111-838033fba4f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:51.952908 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2f68b7-2dac-4d8b-9111-838033fba4f8 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:51.953621 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2f68b7-2dac-4d8b-9111-838033fba4f8 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:51.954079 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2f68b7-2dac-4d8b-9111-838033fba4f8 None admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:51.954966 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2f68b7-2dac-4d8b-9111-838033fba4f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:57:51.955687 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2f68b7-2dac-4d8b-9111-838033fba4f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:51.958115 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2f68b7-2dac-4d8b-9111-838033fba4f8 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:51.979645 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb1bc70-bae9-4b56-88a2-2441442ae1e4 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:51.980190 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 266/532] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 23 20:57:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:57:51.980190 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2f68b7-2dac-4d8b-9111-838033fba4f8 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:51.991721 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:52.023429 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6279cad4-cfe3-4ff5-974e-eea37dbce5ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:52.024803 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6279cad4-cfe3-4ff5-974e-eea37dbce5ec None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:52.025642 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6279cad4-cfe3-4ff5-974e-eea37dbce5ec None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:52.026098 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6279cad4-cfe3-4ff5-974e-eea37dbce5ec None admin] PATH_INFO: `/v3/projects/service` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:52.035362 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6279cad4-cfe3-4ff5-974e-eea37dbce5ec None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:52.037612 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6279cad4-cfe3-4ff5-974e-eea37dbce5ec None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:52.057663 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-6279cad4-cfe3-4ff5-974e-eea37dbce5ec None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 23 20:57:52.057663 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:57:52.057663 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:57:52.057663 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:57:52.057663 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:57:52.057663 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:57:52.057663 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:57:52.057663 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:57:52.057663 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:57:52.057663 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:57:52.057663 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:57:52.057663 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:57:52.057663 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 23 20:57:52.057663 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 23 20:57:52.057663 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 23 20:57:52.059353 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 23 20:57:52.059353 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:57:52.059353 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:57:52.059353 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:57:52.059353 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:57:52.059353 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:57:52.059353 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:57:52.059353 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:57:52.059353 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application with Lock( Jul 23 20:57:52.059353 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:57:52.059353 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:57:52.059353 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:57:52.059353 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:57:52.059353 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:57:52.059353 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:57:52.059353 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:57:52.059353 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:57:52.066734 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 23 20:57:52.066734 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 23 20:57:52.066734 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 23 20:57:52.066734 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 23 20:57:52.066734 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 23 20:57:52.066734 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 23 20:57:52.066734 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 23 20:57:52.066734 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 20:57:52.066734 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 267/533] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Jul 23 20:57:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:57:52.066734 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6279cad4-cfe3-4ff5-974e-eea37dbce5ec None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:52.077242 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:52.114249 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2f68b7-2dac-4d8b-9111-838033fba4f8 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:52.151184 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ee1d7f-f2f2-4173-8176-8cd1f65c4855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:52.152094 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ee1d7f-f2f2-4173-8176-8cd1f65c4855 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:52.152375 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ee1d7f-f2f2-4173-8176-8cd1f65c4855 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:52.152650 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ee1d7f-f2f2-4173-8176-8cd1f65c4855 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:52.161553 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ee1d7f-f2f2-4173-8176-8cd1f65c4855 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:52.163103 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ee1d7f-f2f2-4173-8176-8cd1f65c4855 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:52.178489 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-e1ee1d7f-f2f2-4173-8176-8cd1f65c4855 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 23 20:57:52.178489 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:57:52.178489 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:57:52.178489 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:57:52.178489 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:57:52.178489 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:57:52.178489 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:57:52.178489 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:57:52.178489 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:57:52.178489 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:57:52.178489 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:57:52.178489 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:57:52.178489 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 23 20:57:52.178489 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 23 20:57:52.178489 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 23 20:57:52.179412 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 23 20:57:52.179412 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:57:52.179412 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:57:52.179412 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:57:52.179412 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:57:52.179412 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:57:52.179412 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:57:52.179412 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:57:52.179412 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application with Lock( Jul 23 20:57:52.179412 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:57:52.179412 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:57:52.179412 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:57:52.179412 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:57:52.179412 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:57:52.179412 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:57:52.179412 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:57:52.179412 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:57:52.180263 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 23 20:57:52.180263 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 23 20:57:52.180263 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 23 20:57:52.180263 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 23 20:57:52.180263 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 23 20:57:52.180263 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 23 20:57:52.180263 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 23 20:57:52.180263 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:57:52.180263 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 267/534] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Jul 23 20:57:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:57:52.180722 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ee1d7f-f2f2-4173-8176-8cd1f65c4855 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:52.189184 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6279cad4-cfe3-4ff5-974e-eea37dbce5ec None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:52.227718 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3281e4-e6df-40d1-9ff9-cb5a1e7378e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:52.228955 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3281e4-e6df-40d1-9ff9-cb5a1e7378e4 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:52.229438 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3281e4-e6df-40d1-9ff9-cb5a1e7378e4 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:52.229971 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3281e4-e6df-40d1-9ff9-cb5a1e7378e4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:52.237962 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3281e4-e6df-40d1-9ff9-cb5a1e7378e4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:52.239823 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3281e4-e6df-40d1-9ff9-cb5a1e7378e4 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:52.263171 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-3d3281e4-e6df-40d1-9ff9-cb5a1e7378e4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 23 20:57:52.263171 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:57:52.263171 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:57:52.263171 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:57:52.263171 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:57:52.263171 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:57:52.263171 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:57:52.263171 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:57:52.263171 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:57:52.263171 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:57:52.263171 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:57:52.263171 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:57:52.263171 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 23 20:57:52.263171 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 23 20:57:52.263171 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 23 20:57:52.264077 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 23 20:57:52.264077 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:57:52.264077 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:57:52.264077 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:57:52.264077 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:57:52.264077 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:57:52.264077 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:57:52.264077 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:57:52.264077 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application with Lock( Jul 23 20:57:52.264077 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:57:52.264077 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:57:52.264077 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:57:52.264077 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:57:52.264077 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:57:52.264077 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:57:52.264077 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:57:52.264077 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:57:52.264990 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 23 20:57:52.264990 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 23 20:57:52.264990 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 23 20:57:52.264990 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 23 20:57:52.264990 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 23 20:57:52.264990 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 23 20:57:52.264990 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 23 20:57:52.264990 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 20:57:52.272315 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 268/535] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Jul 23 20:57:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:57:52.273725 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3281e4-e6df-40d1-9ff9-cb5a1e7378e4 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:52.303309 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ee1d7f-f2f2-4173-8176-8cd1f65c4855 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:52.306941 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:52.330952 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:52.341628 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60d49fe-cd15-4ad1-9ab7-35039df2631b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:52.342396 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60d49fe-cd15-4ad1-9ab7-35039df2631b None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:52.342676 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60d49fe-cd15-4ad1-9ab7-35039df2631b None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:52.342945 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60d49fe-cd15-4ad1-9ab7-35039df2631b None admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:52.343798 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60d49fe-cd15-4ad1-9ab7-35039df2631b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:57:52.344095 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60d49fe-cd15-4ad1-9ab7-35039df2631b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:52.345654 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60d49fe-cd15-4ad1-9ab7-35039df2631b None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:52.369937 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 268/536] 10.222.0.17 () {56 vars in 1148 bytes} [Sat Jul 23 20:57:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:57:52.369937 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60d49fe-cd15-4ad1-9ab7-35039df2631b None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:52.392803 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3281e4-e6df-40d1-9ff9-cb5a1e7378e4 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:52.429412 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f75b16-7e20-4f7c-9d2d-a9170571726e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:52.430260 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f75b16-7e20-4f7c-9d2d-a9170571726e None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:52.430755 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f75b16-7e20-4f7c-9d2d-a9170571726e None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:52.431033 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f75b16-7e20-4f7c-9d2d-a9170571726e None admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:52.431935 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f75b16-7e20-4f7c-9d2d-a9170571726e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:57:52.432388 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f75b16-7e20-4f7c-9d2d-a9170571726e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:52.434256 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f75b16-7e20-4f7c-9d2d-a9170571726e None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:52.448276 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 269/537] 10.222.0.17 () {56 vars in 1148 bytes} [Sat Jul 23 20:57:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:57:52.449266 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f75b16-7e20-4f7c-9d2d-a9170571726e None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:52.483032 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60d49fe-cd15-4ad1-9ab7-35039df2631b None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:52.520144 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0832e7-acd6-4b1a-a497-3eb9ef76048f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:52.520853 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0832e7-acd6-4b1a-a497-3eb9ef76048f None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:52.521131 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0832e7-acd6-4b1a-a497-3eb9ef76048f None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:52.521451 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0832e7-acd6-4b1a-a497-3eb9ef76048f None admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:52.522274 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0832e7-acd6-4b1a-a497-3eb9ef76048f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:57:52.522579 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0832e7-acd6-4b1a-a497-3eb9ef76048f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:52.524189 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0832e7-acd6-4b1a-a497-3eb9ef76048f None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:52.537729 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 269/538] 10.222.0.17 () {56 vars in 1148 bytes} [Sat Jul 23 20:57:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:57:52.538685 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0832e7-acd6-4b1a-a497-3eb9ef76048f None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:52.552173 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:52.563725 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f75b16-7e20-4f7c-9d2d-a9170571726e None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:52.590354 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:52.601085 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7e42cf-3c6c-45b5-9da7-06ebdfa24e01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:52.602026 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e42cf-3c6c-45b5-9da7-06ebdfa24e01 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:52.602474 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e42cf-3c6c-45b5-9da7-06ebdfa24e01 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:52.602913 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e42cf-3c6c-45b5-9da7-06ebdfa24e01 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:52.603895 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7e42cf-3c6c-45b5-9da7-06ebdfa24e01 None admin] RBAC: Adding query filter params (role.id=abf9f3b81f3647dbb70c44d0aedaa614, scope.project.id=4804ed61295f4d4a92d9b685dd9e9f3b, user.id=c497326ee890462e8f48b4a56f81990c) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:57:52.604366 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7e42cf-3c6c-45b5-9da7-06ebdfa24e01 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:52.605984 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7e42cf-3c6c-45b5-9da7-06ebdfa24e01 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:52.618169 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 270/539] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Jul 23 20:57:52 2022] GET /identity/v3/role_assignments?user.id=c497326ee890462e8f48b4a56f81990c&scope.project.id=4804ed61295f4d4a92d9b685dd9e9f3b&role.id=abf9f3b81f3647dbb70c44d0aedaa614 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:57:52.619432 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7e42cf-3c6c-45b5-9da7-06ebdfa24e01 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:52.651438 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0832e7-acd6-4b1a-a497-3eb9ef76048f None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:52.690405 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70e273b-7d48-4bb1-8bed-b50ae97208b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:52.691031 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70e273b-7d48-4bb1-8bed-b50ae97208b8 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:52.691341 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70e273b-7d48-4bb1-8bed-b50ae97208b8 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:52.691619 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70e273b-7d48-4bb1-8bed-b50ae97208b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:52.692456 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70e273b-7d48-4bb1-8bed-b50ae97208b8 None admin] RBAC: Adding query filter params (role.id=abf9f3b81f3647dbb70c44d0aedaa614, scope.project.id=4804ed61295f4d4a92d9b685dd9e9f3b, user.id=f7f2db148c8e4d5d81431cae3576434b) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:57:52.697894 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70e273b-7d48-4bb1-8bed-b50ae97208b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:52.697894 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70e273b-7d48-4bb1-8bed-b50ae97208b8 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:52.701615 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 270/540] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Jul 23 20:57:52 2022] GET /identity/v3/role_assignments?user.id=f7f2db148c8e4d5d81431cae3576434b&scope.project.id=4804ed61295f4d4a92d9b685dd9e9f3b&role.id=abf9f3b81f3647dbb70c44d0aedaa614 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:57:52.796099 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7e42cf-3c6c-45b5-9da7-06ebdfa24e01 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:52.851505 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada0aa66-e71b-4eb3-a249-60ea64810180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:52.852206 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada0aa66-e71b-4eb3-a249-60ea64810180 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:52.852485 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada0aa66-e71b-4eb3-a249-60ea64810180 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:52.852755 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada0aa66-e71b-4eb3-a249-60ea64810180 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:52.853621 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada0aa66-e71b-4eb3-a249-60ea64810180 None admin] RBAC: Adding query filter params (role.id=abf9f3b81f3647dbb70c44d0aedaa614, scope.project.id=4804ed61295f4d4a92d9b685dd9e9f3b, user.id=ec5fd3a489c341b7964704d689037f05) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:57:52.854030 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada0aa66-e71b-4eb3-a249-60ea64810180 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:52.855541 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada0aa66-e71b-4eb3-a249-60ea64810180 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:52.867071 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 271/541] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Jul 23 20:57:52 2022] GET /identity/v3/role_assignments?user.id=ec5fd3a489c341b7964704d689037f05&scope.project.id=4804ed61295f4d4a92d9b685dd9e9f3b&role.id=abf9f3b81f3647dbb70c44d0aedaa614 => generated 259 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:57:53.352428 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0162e60-e35b-4348-936d-4fbf883740a4 None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:53.353008 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0162e60-e35b-4348-936d-4fbf883740a4 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:53.353008 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0162e60-e35b-4348-936d-4fbf883740a4 None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:53.354718 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 271/542] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:57:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:57:53.360282 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9102a8e-bd57-4d4d-b4cd-fb88565d546f None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:53.360737 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9102a8e-bd57-4d4d-b4cd-fb88565d546f None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:53.360812 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9102a8e-bd57-4d4d-b4cd-fb88565d546f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:53.381660 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-b9102a8e-bd57-4d4d-b4cd-fb88565d546f None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:57:53.383066 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-b9102a8e-bd57-4d4d-b4cd-fb88565d546f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:57:53.402405 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:53.466611 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 272/543] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:57:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 23 20:57:53.509254 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0162e60-e35b-4348-936d-4fbf883740a4 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:53.629049 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0162e60-e35b-4348-936d-4fbf883740a4 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:53.640182 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:53.654599 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bdf3a0-663d-4d87-9f45-0de6cf3567a8 None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:53.654917 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bdf3a0-663d-4d87-9f45-0de6cf3567a8 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:53.655198 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bdf3a0-663d-4d87-9f45-0de6cf3567a8 None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:53.656673 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 273/544] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:57:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 23 20:57:53.663732 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a41c417-1f5f-4470-884e-707d610accec None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:53.664012 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a41c417-1f5f-4470-884e-707d610accec None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:53.664289 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a41c417-1f5f-4470-884e-707d610accec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:53.689405 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-6a41c417-1f5f-4470-884e-707d610accec None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:57:53.691303 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-6a41c417-1f5f-4470-884e-707d610accec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:57:53.692660 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3390e6bd-c66b-4d52-82a9-391794833f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:53.693741 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3390e6bd-c66b-4d52-82a9-391794833f38 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:53.694213 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3390e6bd-c66b-4d52-82a9-391794833f38 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:53.694692 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3390e6bd-c66b-4d52-82a9-391794833f38 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:53.719049 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3390e6bd-c66b-4d52-82a9-391794833f38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:57:53.728120 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-3390e6bd-c66b-4d52-82a9-391794833f38 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 23 20:57:53.728120 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:57:53.728120 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:57:53.728120 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:57:53.728120 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:57:53.728120 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:57:53.728120 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:57:53.728120 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:57:53.728120 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:57:53.728120 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:57:53.728120 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:57:53.728120 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:57:53.728120 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:57:53.728120 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:57:53.728120 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:57:53.728120 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:57:53.729079 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:57:53.729079 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:57:53.729079 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:57:53.729079 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:57:53.729079 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:57:53.729079 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:57:53.729079 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:57:53.729079 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:57:53.729079 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:57:53.729079 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:57:53.729079 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:57:53.729079 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application with Lock( Jul 23 20:57:53.729079 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:57:53.729079 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:57:53.729079 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:57:53.729079 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:57:53.729945 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:57:53.729945 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:57:53.729945 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:57:53.729945 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:57:53.729945 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:57:53.729945 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:57:53.729945 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:57:53.729945 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:57:53.729945 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:57:53.729945 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:57:53.729945 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 23 20:57:53.729945 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:57:53.732594 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 272/545] 10.222.0.17 () {56 vars in 1102 bytes} [Sat Jul 23 20:57:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:57:53.738517 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3390e6bd-c66b-4d52-82a9-391794833f38 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:53.833779 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 274/546] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:57:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 23 20:57:53.858485 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a41c417-1f5f-4470-884e-707d610accec None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:53.943847 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3390e6bd-c66b-4d52-82a9-391794833f38 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:53.978960 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:53.990583 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5feaff3-e614-4897-903c-8db2c9ce5275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:53.991276 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5feaff3-e614-4897-903c-8db2c9ce5275 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:53.991551 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5feaff3-e614-4897-903c-8db2c9ce5275 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:53.991821 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5feaff3-e614-4897-903c-8db2c9ce5275 None admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:53.992571 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5feaff3-e614-4897-903c-8db2c9ce5275 None admin] RBAC: Adding query filter params (name=service) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:57:53.992865 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5feaff3-e614-4897-903c-8db2c9ce5275 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:53.994294 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5feaff3-e614-4897-903c-8db2c9ce5275 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:54.004446 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a41c417-1f5f-4470-884e-707d610accec None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:54.007242 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 273/547] 10.222.0.17 () {56 vars in 1103 bytes} [Sat Jul 23 20:57:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:57:54.012742 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5feaff3-e614-4897-903c-8db2c9ce5275 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:54.049568 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5faf6da-0442-4440-8dbf-6441a8096f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:54.051955 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5faf6da-0442-4440-8dbf-6441a8096f61 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:54.054064 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5faf6da-0442-4440-8dbf-6441a8096f61 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:54.054603 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5faf6da-0442-4440-8dbf-6441a8096f61 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:54.078614 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5faf6da-0442-4440-8dbf-6441a8096f61 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:57:54.091096 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:54.092444 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-e5faf6da-0442-4440-8dbf-6441a8096f61 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 23 20:57:54.092444 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:57:54.092444 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:57:54.092444 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:57:54.092444 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:57:54.092444 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:57:54.092444 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:57:54.092444 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:57:54.092444 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:57:54.092444 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:57:54.092444 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:57:54.092444 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:57:54.092444 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:57:54.092444 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:57:54.092444 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:57:54.092444 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:57:54.093411 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:57:54.093411 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:57:54.093411 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:57:54.093411 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:57:54.093411 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:57:54.093411 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:57:54.093411 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:57:54.093411 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:57:54.093411 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:57:54.093411 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:57:54.093411 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:57:54.093411 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application with Lock( Jul 23 20:57:54.093411 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:57:54.093411 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:57:54.093411 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:57:54.093411 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:57:54.094334 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:57:54.094334 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:57:54.094334 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:57:54.094334 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:57:54.094334 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:57:54.094334 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:57:54.094334 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:57:54.094334 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:57:54.094334 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:57:54.094334 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:57:54.094334 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 23 20:57:54.094334 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 20:57:54.101499 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 275/548] 10.222.0.17 () {56 vars in 1102 bytes} [Sat Jul 23 20:57:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:57:54.110423 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5faf6da-0442-4440-8dbf-6441a8096f61 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:54.199311 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5feaff3-e614-4897-903c-8db2c9ce5275 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:54.260676 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5870ed30-ee72-463f-bfdb-ad4626d22bbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:54.261526 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5870ed30-ee72-463f-bfdb-ad4626d22bbe None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:54.261801 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5870ed30-ee72-463f-bfdb-ad4626d22bbe None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:54.262096 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5870ed30-ee72-463f-bfdb-ad4626d22bbe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:54.289582 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5870ed30-ee72-463f-bfdb-ad4626d22bbe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:54.291268 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5870ed30-ee72-463f-bfdb-ad4626d22bbe None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:54.313826 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5faf6da-0442-4440-8dbf-6441a8096f61 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:54.324207 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-5870ed30-ee72-463f-bfdb-ad4626d22bbe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:57:54.324207 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:57:54.324207 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:57:54.324207 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:57:54.324207 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:57:54.324207 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:57:54.324207 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:57:54.324207 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:57:54.324207 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:57:54.324207 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:57:54.324207 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:57:54.324207 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:57:54.324207 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 23 20:57:54.324207 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 23 20:57:54.324207 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 23 20:57:54.325624 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 23 20:57:54.325624 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:57:54.325624 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:57:54.325624 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:57:54.325624 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:57:54.325624 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:57:54.325624 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:57:54.325624 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:57:54.325624 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application with Lock( Jul 23 20:57:54.325624 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:57:54.325624 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:57:54.325624 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:57:54.325624 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:57:54.325624 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:57:54.325624 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:57:54.325624 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:57:54.325624 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:57:54.326686 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 23 20:57:54.326686 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 23 20:57:54.326686 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:57:54.326686 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:57:54.326686 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 274/549] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 23 20:57:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:57:54.331445 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5870ed30-ee72-463f-bfdb-ad4626d22bbe None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:54.380037 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436b9ad1-2dcc-4ed2-9b99-3700da018228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:54.381515 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436b9ad1-2dcc-4ed2-9b99-3700da018228 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:54.382074 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436b9ad1-2dcc-4ed2-9b99-3700da018228 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:54.382740 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436b9ad1-2dcc-4ed2-9b99-3700da018228 None admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:54.383701 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436b9ad1-2dcc-4ed2-9b99-3700da018228 None admin] RBAC: Adding query filter params (name=service) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:57:54.384250 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436b9ad1-2dcc-4ed2-9b99-3700da018228 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:54.385946 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436b9ad1-2dcc-4ed2-9b99-3700da018228 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:54.398439 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:54.408726 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 276/550] 10.222.0.17 () {56 vars in 1103 bytes} [Sat Jul 23 20:57:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 20:57:54.412648 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436b9ad1-2dcc-4ed2-9b99-3700da018228 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:54.435403 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:54.456496 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5870ed30-ee72-463f-bfdb-ad4626d22bbe None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:54.526957 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436b9ad1-2dcc-4ed2-9b99-3700da018228 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:54.555733 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e8507d-41f1-4ba3-be19-4d82534a02b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:54.556862 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e8507d-41f1-4ba3-be19-4d82534a02b9 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:54.557346 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e8507d-41f1-4ba3-be19-4d82534a02b9 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:54.557873 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e8507d-41f1-4ba3-be19-4d82534a02b9 None admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:54.558806 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e8507d-41f1-4ba3-be19-4d82534a02b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:57:54.559334 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e8507d-41f1-4ba3-be19-4d82534a02b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:54.561104 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e8507d-41f1-4ba3-be19-4d82534a02b9 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:54.569912 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48dd454-36d2-44b3-a229-4357993d8b7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:54.569912 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48dd454-36d2-44b3-a229-4357993d8b7a None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:54.569912 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48dd454-36d2-44b3-a229-4357993d8b7a None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:54.569912 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48dd454-36d2-44b3-a229-4357993d8b7a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:54.581754 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 275/551] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 23 20:57:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:57:54.587105 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e8507d-41f1-4ba3-be19-4d82534a02b9 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:54.601582 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48dd454-36d2-44b3-a229-4357993d8b7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:54.603096 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48dd454-36d2-44b3-a229-4357993d8b7a None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:54.629046 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-f48dd454-36d2-44b3-a229-4357993d8b7a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:57:54.629046 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:57:54.629046 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:57:54.629046 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:57:54.629046 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:57:54.629046 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:57:54.629046 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:57:54.629046 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:57:54.629046 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:57:54.629046 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:57:54.629046 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:57:54.629046 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:57:54.629046 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 23 20:57:54.629046 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 23 20:57:54.629046 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 23 20:57:54.630070 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 23 20:57:54.630070 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:57:54.630070 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:57:54.630070 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:57:54.630070 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:57:54.630070 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:57:54.630070 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:57:54.630070 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:57:54.630070 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application with Lock( Jul 23 20:57:54.630070 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:57:54.630070 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:57:54.630070 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:57:54.630070 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:57:54.630070 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:57:54.630070 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:57:54.630070 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:57:54.630070 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:57:54.630938 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 23 20:57:54.630938 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 23 20:57:54.630938 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:57:54.630938 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 20:57:54.630938 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 277/552] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 23 20:57:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 23 20:57:54.636779 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48dd454-36d2-44b3-a229-4357993d8b7a None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:54.702818 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:54.748480 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48dd454-36d2-44b3-a229-4357993d8b7a None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:54.790386 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181f6ff7-528b-4680-8c5e-183f9497f17b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:54.790912 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181f6ff7-528b-4680-8c5e-183f9497f17b None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:54.793293 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181f6ff7-528b-4680-8c5e-183f9497f17b None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:54.793539 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181f6ff7-528b-4680-8c5e-183f9497f17b None admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:54.794312 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181f6ff7-528b-4680-8c5e-183f9497f17b None admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:57:54.794614 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181f6ff7-528b-4680-8c5e-183f9497f17b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:54.796011 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181f6ff7-528b-4680-8c5e-183f9497f17b None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:54.823096 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 278/553] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 23 20:57:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:57:54.828748 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181f6ff7-528b-4680-8c5e-183f9497f17b None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:54.853401 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e8507d-41f1-4ba3-be19-4d82534a02b9 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:54.940241 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6f12ed-a6a6-4c78-a300-a154ffbc77da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:54.941389 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6f12ed-a6a6-4c78-a300-a154ffbc77da None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:54.941389 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6f12ed-a6a6-4c78-a300-a154ffbc77da None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:54.941698 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6f12ed-a6a6-4c78-a300-a154ffbc77da None admin] PATH_INFO: `/v3/users/swift` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:54.950093 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181f6ff7-528b-4680-8c5e-183f9497f17b None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:54.958834 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6f12ed-a6a6-4c78-a300-a154ffbc77da None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:54.960802 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6f12ed-a6a6-4c78-a300-a154ffbc77da None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:54.977473 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-ea6f12ed-a6a6-4c78-a300-a154ffbc77da None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 23 20:57:54.977473 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:57:54.977473 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:57:54.977473 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:57:54.977473 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:57:54.977473 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:57:54.977473 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:57:54.977473 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:57:54.977473 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:57:54.977473 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:57:54.977473 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:57:54.977473 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:57:54.977473 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 23 20:57:54.977473 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 23 20:57:54.977473 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 23 20:57:54.977473 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 23 20:57:54.978591 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:57:54.978591 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:57:54.978591 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 23 20:57:54.978591 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 23 20:57:54.978591 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 23 20:57:54.978591 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 23 20:57:54.978591 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:57:54.978591 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:57:54.978591 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:57:54.978591 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:57:54.978591 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:57:54.978591 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application with Lock( Jul 23 20:57:54.978591 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:57:54.978591 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:57:54.978591 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:57:54.978591 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:57:54.978591 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:57:54.978591 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:57:54.979519 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:57:54.979519 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:57:54.979519 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 23 20:57:54.979519 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 23 20:57:54.979519 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 23 20:57:54.979519 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 23 20:57:54.979519 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 23 20:57:54.979519 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 23 20:57:54.979519 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 23 20:57:54.979519 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:57:54.979519 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 276/554] 10.222.0.17 () {56 vars in 1096 bytes} [Sat Jul 23 20:57:54 2022] GET /identity/v3/users/swift => generated 83 bytes in 392 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 23 20:57:54.980301 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:54.985839 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6f12ed-a6a6-4c78-a300-a154ffbc77da None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:54.994058 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:55.025945 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2982879-b2fd-462f-a450-fe73a6debf2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:55.027074 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2982879-b2fd-462f-a450-fe73a6debf2c None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:55.027501 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2982879-b2fd-462f-a450-fe73a6debf2c None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:55.027908 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2982879-b2fd-462f-a450-fe73a6debf2c None admin] PATH_INFO: `/v3/users/nova` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:55.040951 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2982879-b2fd-462f-a450-fe73a6debf2c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:55.044045 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2982879-b2fd-462f-a450-fe73a6debf2c None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:55.073664 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-b2982879-b2fd-462f-a450-fe73a6debf2c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 23 20:57:55.073664 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:57:55.073664 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:57:55.073664 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:57:55.073664 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:57:55.073664 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:57:55.073664 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:57:55.073664 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:57:55.073664 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:57:55.073664 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:57:55.073664 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:57:55.073664 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:57:55.073664 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 23 20:57:55.073664 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 23 20:57:55.073664 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 23 20:57:55.073664 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 23 20:57:55.074891 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:57:55.074891 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:57:55.074891 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 23 20:57:55.074891 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 23 20:57:55.074891 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 23 20:57:55.074891 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 23 20:57:55.074891 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:57:55.074891 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:57:55.074891 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:57:55.074891 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:57:55.074891 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:57:55.074891 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application with Lock( Jul 23 20:57:55.074891 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:57:55.074891 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:57:55.074891 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:57:55.074891 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:57:55.074891 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:57:55.074891 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:57:55.076598 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:57:55.076598 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:57:55.076598 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 23 20:57:55.076598 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 23 20:57:55.076598 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 23 20:57:55.076598 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 23 20:57:55.076598 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 23 20:57:55.076598 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 23 20:57:55.076598 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 23 20:57:55.076598 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 20:57:55.076598 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 279/555] 10.222.0.17 () {56 vars in 1093 bytes} [Sat Jul 23 20:57:54 2022] GET /identity/v3/users/nova => generated 82 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:57:55.086919 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2982879-b2fd-462f-a450-fe73a6debf2c None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:55.136649 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6f12ed-a6a6-4c78-a300-a154ffbc77da None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:55.185038 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c48cdb6-741b-4984-8e45-31385662671e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:55.185747 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c48cdb6-741b-4984-8e45-31385662671e None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:55.186054 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c48cdb6-741b-4984-8e45-31385662671e None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:55.186328 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c48cdb6-741b-4984-8e45-31385662671e None admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:55.187212 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c48cdb6-741b-4984-8e45-31385662671e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:57:55.187520 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c48cdb6-741b-4984-8e45-31385662671e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:55.189061 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c48cdb6-741b-4984-8e45-31385662671e None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:55.232011 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 277/556] 10.222.0.17 () {56 vars in 1135 bytes} [Sat Jul 23 20:57:54 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:57:55.237645 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c48cdb6-741b-4984-8e45-31385662671e None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:55.310196 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:55.357654 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c48cdb6-741b-4984-8e45-31385662671e None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:55.379735 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2982879-b2fd-462f-a450-fe73a6debf2c None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:55.393157 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875bb63b-939b-4291-a049-25996c2b9007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:55.393904 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875bb63b-939b-4291-a049-25996c2b9007 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:55.394395 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875bb63b-939b-4291-a049-25996c2b9007 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:55.394674 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875bb63b-939b-4291-a049-25996c2b9007 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:55.474201 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875bb63b-939b-4291-a049-25996c2b9007 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:55.475801 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84915379-ecf9-488d-a6d9-dc9db9f2a73d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:55.476432 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875bb63b-939b-4291-a049-25996c2b9007 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:55.477199 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84915379-ecf9-488d-a6d9-dc9db9f2a73d None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:55.477688 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84915379-ecf9-488d-a6d9-dc9db9f2a73d None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:55.478182 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84915379-ecf9-488d-a6d9-dc9db9f2a73d None admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:55.480383 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84915379-ecf9-488d-a6d9-dc9db9f2a73d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:57:55.480943 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84915379-ecf9-488d-a6d9-dc9db9f2a73d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:55.482630 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84915379-ecf9-488d-a6d9-dc9db9f2a73d None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:55.507467 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 280/557] 10.222.0.17 () {56 vars in 1133 bytes} [Sat Jul 23 20:57:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 421 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:57:55.514246 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6d774a-bfb6-4518-99bb-bf364d478ca5 None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:55.514564 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6d774a-bfb6-4518-99bb-bf364d478ca5 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:55.514564 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6d774a-bfb6-4518-99bb-bf364d478ca5 None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:55.516579 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 281/558] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:57:55 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:57:55.516991 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6d774a-bfb6-4518-99bb-bf364d478ca5 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:55.555973 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:55.570379 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:55.610277 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 278/559] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Jul 23 20:57:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 23 20:57:55.611751 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a393c9-5893-4863-8b03-c6c6863bf895 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:55.612098 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a393c9-5893-4863-8b03-c6c6863bf895 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:55.612432 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a393c9-5893-4863-8b03-c6c6863bf895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:55.629409 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-90a393c9-5893-4863-8b03-c6c6863bf895 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:57:55.630851 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-90a393c9-5893-4863-8b03-c6c6863bf895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:57:55.640975 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6d774a-bfb6-4518-99bb-bf364d478ca5 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:55.678445 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39955506-93c0-471f-a9e1-bc42e9e27abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:55.679262 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39955506-93c0-471f-a9e1-bc42e9e27abd None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:55.679902 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39955506-93c0-471f-a9e1-bc42e9e27abd None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:55.680173 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39955506-93c0-471f-a9e1-bc42e9e27abd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:55.691384 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39955506-93c0-471f-a9e1-bc42e9e27abd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:55.692824 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39955506-93c0-471f-a9e1-bc42e9e27abd None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:55.703927 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 279/560] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:57:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 23 20:57:55.706070 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242759ae-0ff7-43df-8bed-946c6c913923 None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:55.706070 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242759ae-0ff7-43df-8bed-946c6c913923 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:55.706070 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242759ae-0ff7-43df-8bed-946c6c913923 None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:55.710027 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 280/561] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:57:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:57:55.710027 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242759ae-0ff7-43df-8bed-946c6c913923 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:55.712174 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-39955506-93c0-471f-a9e1-bc42e9e27abd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:57:55.712174 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:57:55.712174 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:57:55.712174 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:57:55.712174 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:57:55.712174 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:57:55.712174 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:57:55.712174 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:57:55.712174 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:57:55.712174 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:57:55.712174 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:57:55.712174 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:57:55.712174 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 23 20:57:55.712174 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 23 20:57:55.712174 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 23 20:57:55.713294 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 23 20:57:55.713294 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:57:55.713294 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:57:55.713294 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:57:55.713294 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:57:55.713294 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:57:55.713294 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:57:55.713294 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:57:55.713294 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application with Lock( Jul 23 20:57:55.713294 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:57:55.713294 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:57:55.713294 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:57:55.713294 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:57:55.713294 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:57:55.713294 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:57:55.713294 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:57:55.713294 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:57:55.714337 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 23 20:57:55.714337 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 23 20:57:55.714337 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:57:55.714337 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 20:57:55.714337 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 282/562] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 23 20:57:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:57:55.715035 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fb53f3-8385-458e-a124-9c9a907458f4 None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:55.715232 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fb53f3-8385-458e-a124-9c9a907458f4 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:55.715505 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fb53f3-8385-458e-a124-9c9a907458f4 None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:55.720903 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 283/563] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:57:55 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:57:55.722197 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f63085-3854-4384-a621-50e90308e31b None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:55.722560 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f63085-3854-4384-a621-50e90308e31b None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:55.722833 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f63085-3854-4384-a621-50e90308e31b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:55.740526 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-f0f63085-3854-4384-a621-50e90308e31b None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:57:55.741762 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-f0f63085-3854-4384-a621-50e90308e31b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:57:55.808102 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 284/564] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:57:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 23 20:57:55.808954 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f63085-3854-4384-a621-50e90308e31b None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:55.811741 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:55.825534 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242759ae-0ff7-43df-8bed-946c6c913923 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:55.829052 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:55.864403 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9960bced-6725-4770-a0b7-8fadad3b1cff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:55.865295 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9960bced-6725-4770-a0b7-8fadad3b1cff None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:55.865570 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9960bced-6725-4770-a0b7-8fadad3b1cff None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:55.865833 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9960bced-6725-4770-a0b7-8fadad3b1cff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:55.878909 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9960bced-6725-4770-a0b7-8fadad3b1cff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:55.881125 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9960bced-6725-4770-a0b7-8fadad3b1cff None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:55.903647 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-9960bced-6725-4770-a0b7-8fadad3b1cff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:57:55.903647 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:57:55.903647 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:57:55.903647 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:57:55.903647 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:57:55.903647 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:57:55.903647 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:57:55.903647 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:57:55.903647 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:57:55.903647 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:57:55.903647 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:57:55.903647 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:57:55.903647 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 23 20:57:55.903647 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 23 20:57:55.903647 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 23 20:57:55.904597 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 23 20:57:55.904597 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:57:55.904597 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:57:55.904597 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:57:55.904597 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:57:55.904597 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:57:55.904597 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:57:55.904597 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:57:55.904597 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application with Lock( Jul 23 20:57:55.904597 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:57:55.904597 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:57:55.904597 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:57:55.904597 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:57:55.904597 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:57:55.904597 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:57:55.904597 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:57:55.904597 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:57:55.905474 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 23 20:57:55.905474 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 23 20:57:55.905474 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:57:55.905474 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:57:55.905474 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 281/565] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 23 20:57:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:57:55.906256 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3b25ea-69bd-4aa1-9cab-eeef96eeba47 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:55.906539 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3b25ea-69bd-4aa1-9cab-eeef96eeba47 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:55.906807 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3b25ea-69bd-4aa1-9cab-eeef96eeba47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:55.924834 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-ef3b25ea-69bd-4aa1-9cab-eeef96eeba47 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:57:55.925890 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f63085-3854-4384-a621-50e90308e31b None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:55.926091 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-ef3b25ea-69bd-4aa1-9cab-eeef96eeba47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:57:55.961549 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0d158d-0e2c-4bae-85ba-35b4babf9f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:55.962218 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0d158d-0e2c-4bae-85ba-35b4babf9f27 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:55.962492 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0d158d-0e2c-4bae-85ba-35b4babf9f27 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:55.962759 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0d158d-0e2c-4bae-85ba-35b4babf9f27 None admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:55.963658 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0d158d-0e2c-4bae-85ba-35b4babf9f27 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:57:55.963807 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0d158d-0e2c-4bae-85ba-35b4babf9f27 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:55.965171 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0d158d-0e2c-4bae-85ba-35b4babf9f27 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:55.976836 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 285/566] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 23 20:57:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:57:55.977651 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0d158d-0e2c-4bae-85ba-35b4babf9f27 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:55.999971 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 282/567] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:57:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 23 20:57:56.001076 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3b25ea-69bd-4aa1-9cab-eeef96eeba47 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:56.050341 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:56.080099 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:56.084801 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0d158d-0e2c-4bae-85ba-35b4babf9f27 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:56.105910 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3b25ea-69bd-4aa1-9cab-eeef96eeba47 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:56.120204 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b56b08-07f3-4a79-b430-72e5e822547a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:56.121147 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b56b08-07f3-4a79-b430-72e5e822547a None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:56.121429 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b56b08-07f3-4a79-b430-72e5e822547a None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:56.121710 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b56b08-07f3-4a79-b430-72e5e822547a None admin] PATH_INFO: `/v3/roles/service` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:56.133504 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b56b08-07f3-4a79-b430-72e5e822547a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:57:56.142240 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-81b56b08-07f3-4a79-b430-72e5e822547a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 23 20:57:56.142240 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:57:56.142240 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:57:56.142240 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:57:56.142240 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:57:56.142240 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:57:56.142240 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:57:56.142240 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:57:56.142240 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:57:56.142240 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:57:56.142240 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:57:56.142240 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:57:56.142240 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:57:56.142240 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:57:56.142240 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:57:56.142240 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:57:56.143454 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:57:56.143454 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:57:56.143454 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:57:56.143454 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:57:56.143454 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:57:56.143454 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:57:56.143454 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:57:56.143454 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:57:56.143454 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:57:56.143454 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:57:56.143454 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:57:56.143454 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application with Lock( Jul 23 20:57:56.143454 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:57:56.143454 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:57:56.143454 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:57:56.143454 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:57:56.144406 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:57:56.144406 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:57:56.144406 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:57:56.144406 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:57:56.144406 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:57:56.144406 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:57:56.144406 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:57:56.144406 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:57:56.144406 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:57:56.144406 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:57:56.144406 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 23 20:57:56.144406 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 20:57:56.145057 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e0d6c3-3fc4-4448-a328-13c7e97be2ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:56.145057 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e0d6c3-3fc4-4448-a328-13c7e97be2ed None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:56.145057 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e0d6c3-3fc4-4448-a328-13c7e97be2ed None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:56.145267 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 286/568] 10.222.0.17 () {56 vars in 1102 bytes} [Sat Jul 23 20:57:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:57:56.145342 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e0d6c3-3fc4-4448-a328-13c7e97be2ed None admin] PATH_INFO: `/v3/roles/service` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:56.145410 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b56b08-07f3-4a79-b430-72e5e822547a None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:56.160046 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e0d6c3-3fc4-4448-a328-13c7e97be2ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:57:56.167786 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-87e0d6c3-3fc4-4448-a328-13c7e97be2ed None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 23 20:57:56.167786 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:57:56.167786 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:57:56.167786 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:57:56.167786 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:57:56.167786 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:57:56.167786 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:57:56.167786 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:57:56.167786 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:57:56.167786 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:57:56.167786 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:57:56.167786 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:57:56.167786 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:57:56.167786 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:57:56.167786 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:57:56.167786 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:57:56.168867 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:57:56.168867 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:57:56.168867 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:57:56.168867 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:57:56.168867 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:57:56.168867 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:57:56.168867 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:57:56.168867 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:57:56.168867 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:57:56.168867 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:57:56.168867 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:57:56.168867 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application with Lock( Jul 23 20:57:56.168867 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:57:56.168867 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:57:56.168867 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:57:56.168867 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:57:56.169925 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:57:56.169925 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:57:56.169925 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:57:56.169925 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:57:56.169925 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:57:56.169925 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:57:56.169925 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:57:56.169925 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:57:56.169925 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:57:56.169925 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:57:56.169925 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 23 20:57:56.169925 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:57:56.169925 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 283/569] 10.222.0.17 () {56 vars in 1102 bytes} [Sat Jul 23 20:57:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:57:56.169925 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e0d6c3-3fc4-4448-a328-13c7e97be2ed None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:56.258063 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b56b08-07f3-4a79-b430-72e5e822547a None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:56.280004 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e0d6c3-3fc4-4448-a328-13c7e97be2ed None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:56.288942 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:56.294506 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaf212c-70e1-4086-8bd1-7e9a15f907c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:56.295181 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaf212c-70e1-4086-8bd1-7e9a15f907c3 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:56.295453 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaf212c-70e1-4086-8bd1-7e9a15f907c3 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:56.295719 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaf212c-70e1-4086-8bd1-7e9a15f907c3 None admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:56.296478 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaf212c-70e1-4086-8bd1-7e9a15f907c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:57:56.296744 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaf212c-70e1-4086-8bd1-7e9a15f907c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:56.298145 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaf212c-70e1-4086-8bd1-7e9a15f907c3 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:56.310344 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 287/570] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 23 20:57:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:57:56.311201 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaf212c-70e1-4086-8bd1-7e9a15f907c3 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:56.318492 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0a09bf-3e7e-4d9b-9a4b-5046b341a173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:56.319293 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0a09bf-3e7e-4d9b-9a4b-5046b341a173 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:56.319565 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0a09bf-3e7e-4d9b-9a4b-5046b341a173 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:56.319834 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0a09bf-3e7e-4d9b-9a4b-5046b341a173 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:56.322056 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:56.327977 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0a09bf-3e7e-4d9b-9a4b-5046b341a173 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:56.332654 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0a09bf-3e7e-4d9b-9a4b-5046b341a173 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:56.346727 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-ba0a09bf-3e7e-4d9b-9a4b-5046b341a173 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 23 20:57:56.346727 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:57:56.346727 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:57:56.346727 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:57:56.346727 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:57:56.346727 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:57:56.346727 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:57:56.346727 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:57:56.346727 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:57:56.346727 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:57:56.346727 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:57:56.346727 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:57:56.346727 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 23 20:57:56.346727 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 23 20:57:56.346727 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 23 20:57:56.347938 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 23 20:57:56.347938 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:57:56.347938 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:57:56.347938 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:57:56.347938 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:57:56.347938 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:57:56.347938 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:57:56.347938 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:57:56.347938 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application with Lock( Jul 23 20:57:56.347938 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:57:56.347938 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:57:56.347938 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:57:56.347938 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:57:56.347938 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:57:56.347938 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:57:56.347938 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:57:56.347938 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:57:56.354001 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 23 20:57:56.354001 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 23 20:57:56.354001 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 23 20:57:56.354001 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 23 20:57:56.354001 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 23 20:57:56.354001 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 23 20:57:56.354001 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 23 20:57:56.354001 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:57:56.354001 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 284/571] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Jul 23 20:57:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:57:56.354001 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0a09bf-3e7e-4d9b-9a4b-5046b341a173 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:56.420307 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaf212c-70e1-4086-8bd1-7e9a15f907c3 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:56.452250 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0a09bf-3e7e-4d9b-9a4b-5046b341a173 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:56.456659 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934549d5-dbf4-475e-8f72-5f22a89820da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:56.457477 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934549d5-dbf4-475e-8f72-5f22a89820da None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:56.457758 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934549d5-dbf4-475e-8f72-5f22a89820da None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:56.458065 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934549d5-dbf4-475e-8f72-5f22a89820da None admin] PATH_INFO: `/v3/roles/service` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:56.470777 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934549d5-dbf4-475e-8f72-5f22a89820da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:57:56.478715 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-934549d5-dbf4-475e-8f72-5f22a89820da None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 23 20:57:56.478715 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:57:56.478715 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:57:56.478715 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:57:56.478715 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:57:56.478715 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:57:56.478715 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:57:56.478715 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:57:56.478715 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:57:56.478715 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:57:56.478715 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:57:56.478715 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:57:56.478715 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:57:56.478715 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:57:56.478715 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:57:56.478715 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:57:56.480462 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:57:56.480462 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:57:56.480462 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:57:56.480462 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:57:56.480462 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:57:56.480462 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:57:56.480462 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:57:56.480462 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:57:56.480462 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:57:56.480462 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:57:56.480462 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:57:56.480462 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application with Lock( Jul 23 20:57:56.480462 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:57:56.480462 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:57:56.480462 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:57:56.480462 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:57:56.481509 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:57:56.481509 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:57:56.481509 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:57:56.481509 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:57:56.481509 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:57:56.481509 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:57:56.481509 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:57:56.481509 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:57:56.481509 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:57:56.481509 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:57:56.481509 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 23 20:57:56.481509 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 20:57:56.481509 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 288/572] 10.222.0.17 () {56 vars in 1102 bytes} [Sat Jul 23 20:57:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:57:56.481509 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934549d5-dbf4-475e-8f72-5f22a89820da None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:56.493783 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8b9185-4d42-46d6-b043-72cee03dc857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:56.494502 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8b9185-4d42-46d6-b043-72cee03dc857 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:56.494776 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8b9185-4d42-46d6-b043-72cee03dc857 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:56.495037 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8b9185-4d42-46d6-b043-72cee03dc857 None admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:56.495800 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8b9185-4d42-46d6-b043-72cee03dc857 None admin] RBAC: Adding query filter params (name=service) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:57:56.496116 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8b9185-4d42-46d6-b043-72cee03dc857 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:56.497474 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8b9185-4d42-46d6-b043-72cee03dc857 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:56.506192 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 285/573] 10.222.0.17 () {56 vars in 1103 bytes} [Sat Jul 23 20:57:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:57:56.507000 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8b9185-4d42-46d6-b043-72cee03dc857 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:56.542190 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:56.569559 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:56.592886 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934549d5-dbf4-475e-8f72-5f22a89820da None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:56.612975 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8b9185-4d42-46d6-b043-72cee03dc857 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:56.627065 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480272b2-f1a4-4c84-95a2-9a0dcdb6fb19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:56.627745 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480272b2-f1a4-4c84-95a2-9a0dcdb6fb19 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:56.628024 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480272b2-f1a4-4c84-95a2-9a0dcdb6fb19 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:56.628294 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480272b2-f1a4-4c84-95a2-9a0dcdb6fb19 None admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:56.629245 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480272b2-f1a4-4c84-95a2-9a0dcdb6fb19 None admin] RBAC: Adding query filter params (name=service) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:57:56.629545 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480272b2-f1a4-4c84-95a2-9a0dcdb6fb19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:56.631149 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480272b2-f1a4-4c84-95a2-9a0dcdb6fb19 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:56.640508 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 289/574] 10.222.0.17 () {56 vars in 1103 bytes} [Sat Jul 23 20:57:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:57:56.641376 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480272b2-f1a4-4c84-95a2-9a0dcdb6fb19 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:56.654058 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2e63bb-824d-4376-afbe-5acc0afebda3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:56.654878 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2e63bb-824d-4376-afbe-5acc0afebda3 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:56.655161 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2e63bb-824d-4376-afbe-5acc0afebda3 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:56.655452 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2e63bb-824d-4376-afbe-5acc0afebda3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:56.662662 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2e63bb-824d-4376-afbe-5acc0afebda3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:56.664186 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2e63bb-824d-4376-afbe-5acc0afebda3 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:56.679088 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-af2e63bb-824d-4376-afbe-5acc0afebda3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 23 20:57:56.679088 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:57:56.679088 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:57:56.679088 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:57:56.679088 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:57:56.679088 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:57:56.679088 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:57:56.679088 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:57:56.679088 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:57:56.679088 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:57:56.679088 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:57:56.679088 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:57:56.679088 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 23 20:57:56.679088 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 23 20:57:56.679088 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 23 20:57:56.680137 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 23 20:57:56.680137 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:57:56.680137 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:57:56.680137 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:57:56.680137 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:57:56.680137 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:57:56.680137 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:57:56.680137 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:57:56.680137 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application with Lock( Jul 23 20:57:56.680137 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:57:56.680137 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:57:56.680137 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:57:56.680137 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:57:56.680137 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:57:56.680137 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:57:56.680137 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:57:56.680137 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:57:56.681041 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 23 20:57:56.681041 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 23 20:57:56.681041 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 23 20:57:56.681041 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 23 20:57:56.681041 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 23 20:57:56.681041 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 23 20:57:56.681041 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 23 20:57:56.681041 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:57:56.681041 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 286/575] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Jul 23 20:57:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:57:56.681532 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2e63bb-824d-4376-afbe-5acc0afebda3 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:56.743601 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480272b2-f1a4-4c84-95a2-9a0dcdb6fb19 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:56.759121 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:56.781610 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386bff7b-896b-4b8b-9421-8e3e575a38fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:56.782308 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386bff7b-896b-4b8b-9421-8e3e575a38fb None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:56.782588 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386bff7b-896b-4b8b-9421-8e3e575a38fb None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:56.782850 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386bff7b-896b-4b8b-9421-8e3e575a38fb None admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:56.783626 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386bff7b-896b-4b8b-9421-8e3e575a38fb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:57:56.783927 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386bff7b-896b-4b8b-9421-8e3e575a38fb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:56.784027 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2e63bb-824d-4376-afbe-5acc0afebda3 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:56.785410 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386bff7b-896b-4b8b-9421-8e3e575a38fb None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:56.798490 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 290/576] 10.222.0.17 () {56 vars in 1148 bytes} [Sat Jul 23 20:57:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:57:56.799321 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386bff7b-896b-4b8b-9421-8e3e575a38fb None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:56.801111 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:56.821181 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3855f4c0-1f7f-4aa1-9c54-86b7166e8eab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:56.821846 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3855f4c0-1f7f-4aa1-9c54-86b7166e8eab None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:56.822156 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3855f4c0-1f7f-4aa1-9c54-86b7166e8eab None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:56.822428 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3855f4c0-1f7f-4aa1-9c54-86b7166e8eab None admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:56.823181 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3855f4c0-1f7f-4aa1-9c54-86b7166e8eab None admin] RBAC: Adding query filter params (name=service) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:57:56.823481 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3855f4c0-1f7f-4aa1-9c54-86b7166e8eab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:56.824859 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3855f4c0-1f7f-4aa1-9c54-86b7166e8eab None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:56.833486 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 287/577] 10.222.0.17 () {56 vars in 1103 bytes} [Sat Jul 23 20:57:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:57:56.834334 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3855f4c0-1f7f-4aa1-9c54-86b7166e8eab None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:56.913407 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386bff7b-896b-4b8b-9421-8e3e575a38fb None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:56.933911 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3855f4c0-1f7f-4aa1-9c54-86b7166e8eab None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:56.949343 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31a4634-8feb-4d8f-99da-2513054c44d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:56.950198 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31a4634-8feb-4d8f-99da-2513054c44d9 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:56.950491 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31a4634-8feb-4d8f-99da-2513054c44d9 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:56.950757 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31a4634-8feb-4d8f-99da-2513054c44d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:56.961104 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31a4634-8feb-4d8f-99da-2513054c44d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:56.962613 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31a4634-8feb-4d8f-99da-2513054c44d9 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:56.967181 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea558fb-a5ee-48a2-b338-8e595589cdac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:56.967988 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea558fb-a5ee-48a2-b338-8e595589cdac None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:56.968262 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea558fb-a5ee-48a2-b338-8e595589cdac None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:56.968534 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea558fb-a5ee-48a2-b338-8e595589cdac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:56.979127 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea558fb-a5ee-48a2-b338-8e595589cdac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:56.980583 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea558fb-a5ee-48a2-b338-8e595589cdac None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:56.980812 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-e31a4634-8feb-4d8f-99da-2513054c44d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:57:56.980812 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:57:56.980812 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:57:56.980812 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:57:56.980812 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:57:56.980812 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:57:56.980812 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:57:56.980812 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:57:56.980812 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:57:56.980812 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:57:56.980812 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:57:56.980812 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:57:56.980812 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 23 20:57:56.980812 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 23 20:57:56.980812 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 23 20:57:56.981675 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 23 20:57:56.981675 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:57:56.981675 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:57:56.981675 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:57:56.981675 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:57:56.981675 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:57:56.981675 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:57:56.981675 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:57:56.981675 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application with Lock( Jul 23 20:57:56.981675 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:57:56.981675 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:57:56.981675 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:57:56.981675 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:57:56.981675 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:57:56.981675 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:57:56.981675 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:57:56.981675 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:57:56.982606 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 23 20:57:56.982606 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 23 20:57:56.982606 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:57:56.982606 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 20:57:56.982606 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 291/578] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 23 20:57:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:57:56.982885 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31a4634-8feb-4d8f-99da-2513054c44d9 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:57.004216 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-3ea558fb-a5ee-48a2-b338-8e595589cdac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:57:57.004216 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:57:57.004216 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:57:57.004216 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:57:57.004216 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:57:57.004216 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:57:57.004216 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:57:57.004216 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:57:57.004216 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:57:57.004216 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:57:57.004216 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:57:57.004216 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:57:57.004216 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 23 20:57:57.004216 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 23 20:57:57.004216 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 23 20:57:57.005316 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 23 20:57:57.005316 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:57:57.005316 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:57:57.005316 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:57:57.005316 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:57:57.005316 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:57:57.005316 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:57:57.005316 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:57:57.005316 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application with Lock( Jul 23 20:57:57.005316 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:57:57.005316 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:57:57.005316 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:57:57.005316 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:57:57.005316 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:57:57.005316 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:57:57.005316 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:57:57.005316 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:57:57.006235 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 23 20:57:57.006235 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 23 20:57:57.006235 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:57:57.006235 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:57:57.006235 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 288/579] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 23 20:57:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:57:57.006235 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea558fb-a5ee-48a2-b338-8e595589cdac None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:57.012553 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:57.038045 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:57.087163 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31a4634-8feb-4d8f-99da-2513054c44d9 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:57.104882 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea558fb-a5ee-48a2-b338-8e595589cdac None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:57.122099 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3570eab8-60c9-4564-be48-1d8ed0eb8a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:57.122795 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3570eab8-60c9-4564-be48-1d8ed0eb8a26 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:57.123106 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3570eab8-60c9-4564-be48-1d8ed0eb8a26 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:57.123355 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3570eab8-60c9-4564-be48-1d8ed0eb8a26 None admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:57.124159 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3570eab8-60c9-4564-be48-1d8ed0eb8a26 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:57:57.124463 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3570eab8-60c9-4564-be48-1d8ed0eb8a26 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:57.126005 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3570eab8-60c9-4564-be48-1d8ed0eb8a26 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:57.139178 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 292/580] 10.222.0.17 () {56 vars in 1148 bytes} [Sat Jul 23 20:57:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:57:57.140022 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3570eab8-60c9-4564-be48-1d8ed0eb8a26 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:57.147705 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089e794d-d4f2-4728-baae-6154ac505551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:57.148623 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089e794d-d4f2-4728-baae-6154ac505551 None admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:57.148906 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089e794d-d4f2-4728-baae-6154ac505551 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:57.149211 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089e794d-d4f2-4728-baae-6154ac505551 None admin] PATH_INFO: `/v3/projects/4804ed61295f4d4a92d9b685dd9e9f3b/users/079f31ed2c844e67bd4e206f24b69d97/roles/abf9f3b81f3647dbb70c44d0aedaa614` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:57.165695 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089e794d-d4f2-4728-baae-6154ac505551 None admin] RBAC: Authorizing `identity:create_grant(project_id=4804ed61295f4d4a92d9b685dd9e9f3b, user_id=079f31ed2c844e67bd4e206f24b69d97, role_id=abf9f3b81f3647dbb70c44d0aedaa614)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:57.167119 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089e794d-d4f2-4728-baae-6154ac505551 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:57.181742 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 289/581] 10.222.0.17 () {58 vars in 1439 bytes} [Sat Jul 23 20:57:57 2022] PUT /identity/v3/projects/4804ed61295f4d4a92d9b685dd9e9f3b/users/079f31ed2c844e67bd4e206f24b69d97/roles/abf9f3b81f3647dbb70c44d0aedaa614 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 20:57:57.182680 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089e794d-d4f2-4728-baae-6154ac505551 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:57.256906 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:57.287576 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3570eab8-60c9-4564-be48-1d8ed0eb8a26 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:57.290386 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:57.322715 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089e794d-d4f2-4728-baae-6154ac505551 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:57.338613 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a9c269-fee1-4be3-8886-d1ce8a36f97e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:57.340094 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a9c269-fee1-4be3-8886-d1ce8a36f97e None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:57.340644 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a9c269-fee1-4be3-8886-d1ce8a36f97e None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:57.341080 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a9c269-fee1-4be3-8886-d1ce8a36f97e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:57.355519 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a9c269-fee1-4be3-8886-d1ce8a36f97e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:57.356996 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a9c269-fee1-4be3-8886-d1ce8a36f97e None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:57.377063 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3afcd81-7652-4af0-9781-ccbd0891f438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:57.378035 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3afcd81-7652-4af0-9781-ccbd0891f438 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:57.378527 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3afcd81-7652-4af0-9781-ccbd0891f438 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:57.378901 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3afcd81-7652-4af0-9781-ccbd0891f438 None admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:57.379749 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3afcd81-7652-4af0-9781-ccbd0891f438 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:57:57.380169 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3afcd81-7652-4af0-9781-ccbd0891f438 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:57.381705 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3afcd81-7652-4af0-9781-ccbd0891f438 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:57.385518 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-27a9c269-fee1-4be3-8886-d1ce8a36f97e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:57:57.385518 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:57:57.385518 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:57:57.385518 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:57:57.385518 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:57:57.385518 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:57:57.385518 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:57:57.385518 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:57:57.385518 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:57:57.385518 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:57:57.385518 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:57:57.385518 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:57:57.385518 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 23 20:57:57.385518 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 23 20:57:57.385518 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 23 20:57:57.386623 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 23 20:57:57.386623 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:57:57.386623 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:57:57.386623 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:57:57.386623 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:57:57.386623 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:57:57.386623 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:57:57.386623 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:57:57.386623 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application with Lock( Jul 23 20:57:57.386623 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:57:57.386623 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:57:57.386623 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:57:57.386623 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:57:57.386623 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:57:57.386623 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:57:57.386623 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:57:57.386623 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:57:57.387704 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 23 20:57:57.387704 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 23 20:57:57.387704 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:57:57.387704 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 20:57:57.387704 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 293/582] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 23 20:57:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:57:57.389724 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a9c269-fee1-4be3-8886-d1ce8a36f97e None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:57.398274 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 290/583] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 23 20:57:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:57:57.399273 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3afcd81-7652-4af0-9781-ccbd0891f438 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:57.498668 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a9c269-fee1-4be3-8886-d1ce8a36f97e None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:57.506071 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3afcd81-7652-4af0-9781-ccbd0891f438 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:57.536512 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da88d90-7584-4df4-932e-fc3e32f1cd67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:57.537477 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da88d90-7584-4df4-932e-fc3e32f1cd67 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:57.537921 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da88d90-7584-4df4-932e-fc3e32f1cd67 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:57.538352 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da88d90-7584-4df4-932e-fc3e32f1cd67 None admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:57.539206 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da88d90-7584-4df4-932e-fc3e32f1cd67 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:57:57.539800 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da88d90-7584-4df4-932e-fc3e32f1cd67 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:57.541313 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da88d90-7584-4df4-932e-fc3e32f1cd67 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:57.543067 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a971b1-89a3-4e60-b0b8-8f50d3d7668d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:57.543750 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a971b1-89a3-4e60-b0b8-8f50d3d7668d None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:57.544022 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a971b1-89a3-4e60-b0b8-8f50d3d7668d None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:57.544297 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a971b1-89a3-4e60-b0b8-8f50d3d7668d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:57.545130 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a971b1-89a3-4e60-b0b8-8f50d3d7668d None admin] RBAC: Adding query filter params (role.id=abf9f3b81f3647dbb70c44d0aedaa614, scope.project.id=4804ed61295f4d4a92d9b685dd9e9f3b, user.id=47f0a685b7da46afb81024848f079d2f) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:57:57.545442 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a971b1-89a3-4e60-b0b8-8f50d3d7668d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:57.546933 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a971b1-89a3-4e60-b0b8-8f50d3d7668d None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:57.550642 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:57.554750 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 291/584] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Jul 23 20:57:57 2022] GET /identity/v3/role_assignments?user.id=47f0a685b7da46afb81024848f079d2f&scope.project.id=4804ed61295f4d4a92d9b685dd9e9f3b&role.id=abf9f3b81f3647dbb70c44d0aedaa614 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:57:57.555467 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a971b1-89a3-4e60-b0b8-8f50d3d7668d None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:57.564349 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:57.567234 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 294/585] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 23 20:57:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:57:57.568638 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da88d90-7584-4df4-932e-fc3e32f1cd67 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:57.691882 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da88d90-7584-4df4-932e-fc3e32f1cd67 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:57.714587 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a971b1-89a3-4e60-b0b8-8f50d3d7668d None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:57.734195 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7896691b-fec0-433c-9ebf-edc702fbb080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:57.735090 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7896691b-fec0-433c-9ebf-edc702fbb080 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:57.735369 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7896691b-fec0-433c-9ebf-edc702fbb080 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:57.735677 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7896691b-fec0-433c-9ebf-edc702fbb080 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:57.744993 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7896691b-fec0-433c-9ebf-edc702fbb080 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:57.746504 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7896691b-fec0-433c-9ebf-edc702fbb080 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:57.767030 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-7896691b-fec0-433c-9ebf-edc702fbb080 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 23 20:57:57.767030 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:57:57.767030 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:57:57.767030 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:57:57.767030 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:57:57.767030 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:57:57.767030 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:57:57.767030 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:57:57.767030 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:57:57.767030 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:57:57.767030 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:57:57.767030 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:57:57.767030 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 23 20:57:57.767030 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 23 20:57:57.767030 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 23 20:57:57.767030 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 23 20:57:57.768080 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:57:57.768080 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:57:57.768080 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 23 20:57:57.768080 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 23 20:57:57.768080 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 23 20:57:57.768080 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 23 20:57:57.768080 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:57:57.768080 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:57:57.768080 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:57:57.768080 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:57:57.768080 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:57:57.768080 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application with Lock( Jul 23 20:57:57.768080 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:57:57.768080 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:57:57.768080 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:57:57.768080 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:57:57.768080 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:57:57.768080 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:57:57.769075 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:57:57.769075 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:57:57.769075 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 23 20:57:57.769075 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 23 20:57:57.769075 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 23 20:57:57.769075 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 23 20:57:57.769075 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 23 20:57:57.769075 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 23 20:57:57.769075 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 23 20:57:57.769075 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 20:57:57.769618 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba50d70e-64a6-4c19-bdb7-05f24d6c5229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:57.771082 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba50d70e-64a6-4c19-bdb7-05f24d6c5229 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:57.771629 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba50d70e-64a6-4c19-bdb7-05f24d6c5229 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:57.772123 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba50d70e-64a6-4c19-bdb7-05f24d6c5229 None admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:57.773073 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 295/586] 10.222.0.17 () {56 vars in 1102 bytes} [Sat Jul 23 20:57:57 2022] GET /identity/v3/users/neutron => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:57:57.773259 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba50d70e-64a6-4c19-bdb7-05f24d6c5229 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:57:57.773747 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba50d70e-64a6-4c19-bdb7-05f24d6c5229 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:57.773991 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7896691b-fec0-433c-9ebf-edc702fbb080 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:57.775592 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba50d70e-64a6-4c19-bdb7-05f24d6c5229 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:57.793658 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 292/587] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 23 20:57:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:57:57.794886 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba50d70e-64a6-4c19-bdb7-05f24d6c5229 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:57.865577 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:57.875864 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:57.918198 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7896691b-fec0-433c-9ebf-edc702fbb080 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:57.927031 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba50d70e-64a6-4c19-bdb7-05f24d6c5229 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:57.956667 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff6a582-bc57-49ad-8e70-46446200aa6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:57.957402 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff6a582-bc57-49ad-8e70-46446200aa6f None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:57.957730 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff6a582-bc57-49ad-8e70-46446200aa6f None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:57.958164 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff6a582-bc57-49ad-8e70-46446200aa6f None admin] PATH_INFO: `/v3/users/cinder` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:57.967044 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff6a582-bc57-49ad-8e70-46446200aa6f None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:57.968509 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff6a582-bc57-49ad-8e70-46446200aa6f None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:57.976754 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6969102-20b7-4a09-a056-3bd843506a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:57.977659 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6969102-20b7-4a09-a056-3bd843506a85 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:57.978138 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6969102-20b7-4a09-a056-3bd843506a85 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:57.978554 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6969102-20b7-4a09-a056-3bd843506a85 None admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:57.979536 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6969102-20b7-4a09-a056-3bd843506a85 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:57:57.979983 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6969102-20b7-4a09-a056-3bd843506a85 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:57.981555 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6969102-20b7-4a09-a056-3bd843506a85 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:57.983874 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-eff6a582-bc57-49ad-8e70-46446200aa6f None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 23 20:57:57.983874 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:57:57.983874 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:57:57.983874 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:57:57.983874 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:57:57.983874 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:57:57.983874 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:57:57.983874 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:57:57.983874 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:57:57.983874 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:57:57.983874 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:57:57.983874 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:57:57.983874 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 23 20:57:57.983874 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 23 20:57:57.983874 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 23 20:57:57.983874 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 23 20:57:57.985003 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:57:57.985003 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:57:57.985003 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 23 20:57:57.985003 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 23 20:57:57.985003 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 23 20:57:57.985003 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 23 20:57:57.985003 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:57:57.985003 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:57:57.985003 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:57:57.985003 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:57:57.985003 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:57:57.985003 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application with Lock( Jul 23 20:57:57.985003 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:57:57.985003 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:57:57.985003 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:57:57.985003 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:57:57.985003 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:57:57.985003 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:57:57.986292 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:57:57.986292 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:57:57.986292 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 23 20:57:57.986292 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 23 20:57:57.986292 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 23 20:57:57.986292 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 23 20:57:57.986292 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 23 20:57:57.986292 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 23 20:57:57.986292 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 23 20:57:57.986292 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 20:57:57.986292 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 296/588] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Jul 23 20:57:57 2022] GET /identity/v3/users/cinder => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:57:57.986292 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff6a582-bc57-49ad-8e70-46446200aa6f None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:58.008781 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 293/589] 10.222.0.17 () {56 vars in 1139 bytes} [Sat Jul 23 20:57:57 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:57:58.010621 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6969102-20b7-4a09-a056-3bd843506a85 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:58.116170 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff6a582-bc57-49ad-8e70-46446200aa6f None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:58.126242 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6969102-20b7-4a09-a056-3bd843506a85 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:58.142256 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:58.150754 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:58.160679 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e84bbd-9214-465b-a9b0-39fb36080727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:58.161497 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e84bbd-9214-465b-a9b0-39fb36080727 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:58.161883 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e84bbd-9214-465b-a9b0-39fb36080727 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:58.162170 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e84bbd-9214-465b-a9b0-39fb36080727 None admin] PATH_INFO: `/v3/users/glance` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:58.165970 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae96fcc0-8f97-40cd-a1fa-235a312f35f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:58.166820 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae96fcc0-8f97-40cd-a1fa-235a312f35f2 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:58.167270 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae96fcc0-8f97-40cd-a1fa-235a312f35f2 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:58.167673 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae96fcc0-8f97-40cd-a1fa-235a312f35f2 None admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:58.168645 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae96fcc0-8f97-40cd-a1fa-235a312f35f2 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:57:58.169086 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae96fcc0-8f97-40cd-a1fa-235a312f35f2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:58.170686 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae96fcc0-8f97-40cd-a1fa-235a312f35f2 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:58.171300 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e84bbd-9214-465b-a9b0-39fb36080727 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:58.172849 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e84bbd-9214-465b-a9b0-39fb36080727 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:58.188519 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-79e84bbd-9214-465b-a9b0-39fb36080727 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 23 20:57:58.188519 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:57:58.188519 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:57:58.188519 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:57:58.188519 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:57:58.188519 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:57:58.188519 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:57:58.188519 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:57:58.188519 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:57:58.188519 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:57:58.188519 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:57:58.188519 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:57:58.188519 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 23 20:57:58.188519 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 23 20:57:58.188519 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 23 20:57:58.188519 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 23 20:57:58.189701 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:57:58.189701 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:57:58.189701 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 23 20:57:58.189701 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 23 20:57:58.189701 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 23 20:57:58.189701 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 23 20:57:58.189701 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:57:58.189701 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:57:58.189701 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:57:58.189701 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:57:58.189701 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:57:58.189701 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application with Lock( Jul 23 20:57:58.189701 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:57:58.189701 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:57:58.189701 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:57:58.189701 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:57:58.189701 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:57:58.189701 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:57:58.190709 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:57:58.190709 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:57:58.190709 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 23 20:57:58.190709 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 23 20:57:58.190709 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 23 20:57:58.190709 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 23 20:57:58.190709 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 23 20:57:58.190709 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 23 20:57:58.190709 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 23 20:57:58.190709 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 20:57:58.196586 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 297/590] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Jul 23 20:57:57 2022] GET /identity/v3/users/glance => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:57:58.196586 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e84bbd-9214-465b-a9b0-39fb36080727 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:58.197084 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 294/591] 10.222.0.17 () {56 vars in 1137 bytes} [Sat Jul 23 20:57:58 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:57:58.198150 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae96fcc0-8f97-40cd-a1fa-235a312f35f2 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:58.302786 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae96fcc0-8f97-40cd-a1fa-235a312f35f2 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:58.303306 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e84bbd-9214-465b-a9b0-39fb36080727 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:58.341943 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ac5c13-c395-4cda-a247-93f3d03d8707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:58.342960 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ac5c13-c395-4cda-a247-93f3d03d8707 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:58.343375 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ac5c13-c395-4cda-a247-93f3d03d8707 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:58.343783 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ac5c13-c395-4cda-a247-93f3d03d8707 None admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:58.344974 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ac5c13-c395-4cda-a247-93f3d03d8707 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:57:58.345452 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ac5c13-c395-4cda-a247-93f3d03d8707 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:58.346610 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9668a37-43b9-4355-8941-f8e5021c6ba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:58.347758 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9668a37-43b9-4355-8941-f8e5021c6ba7 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:58.347758 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9668a37-43b9-4355-8941-f8e5021c6ba7 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:58.348072 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9668a37-43b9-4355-8941-f8e5021c6ba7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:58.348596 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ac5c13-c395-4cda-a247-93f3d03d8707 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:58.360593 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9668a37-43b9-4355-8941-f8e5021c6ba7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:58.362207 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9668a37-43b9-4355-8941-f8e5021c6ba7 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:58.375023 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 295/592] 10.222.0.17 () {56 vars in 1137 bytes} [Sat Jul 23 20:57:58 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:57:58.376137 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ac5c13-c395-4cda-a247-93f3d03d8707 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:58.386673 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-f9668a37-43b9-4355-8941-f8e5021c6ba7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:57:58.386673 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:57:58.386673 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:57:58.386673 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:57:58.386673 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:57:58.386673 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:57:58.386673 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:57:58.386673 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:57:58.386673 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:57:58.386673 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:57:58.386673 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:57:58.386673 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:57:58.386673 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 23 20:57:58.386673 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 23 20:57:58.386673 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 23 20:57:58.387671 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 23 20:57:58.387671 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:57:58.387671 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:57:58.387671 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:57:58.387671 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:57:58.387671 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:57:58.387671 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:57:58.387671 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:57:58.387671 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application with Lock( Jul 23 20:57:58.387671 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:57:58.387671 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:57:58.387671 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:57:58.387671 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:57:58.387671 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:57:58.387671 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:57:58.387671 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:57:58.387671 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:57:58.388524 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 23 20:57:58.388524 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 23 20:57:58.388524 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:57:58.388524 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 20:57:58.393291 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 298/593] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 23 20:57:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:57:58.393762 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9668a37-43b9-4355-8941-f8e5021c6ba7 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:58.426211 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:58.428438 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:58.489467 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ac5c13-c395-4cda-a247-93f3d03d8707 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:58.507647 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9668a37-43b9-4355-8941-f8e5021c6ba7 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:58.523845 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b145c3-6ca4-40db-a058-16ea99ec71ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:58.524651 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b145c3-6ca4-40db-a058-16ea99ec71ad None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:58.524925 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b145c3-6ca4-40db-a058-16ea99ec71ad None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:58.525189 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b145c3-6ca4-40db-a058-16ea99ec71ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:58.536212 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b145c3-6ca4-40db-a058-16ea99ec71ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:58.537979 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b145c3-6ca4-40db-a058-16ea99ec71ad None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:58.549246 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7958df-396d-4484-8cf4-4837eb9e6f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:58.550441 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7958df-396d-4484-8cf4-4837eb9e6f2c None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:58.550858 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7958df-396d-4484-8cf4-4837eb9e6f2c None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:58.551267 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7958df-396d-4484-8cf4-4837eb9e6f2c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:58.555618 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-92b145c3-6ca4-40db-a058-16ea99ec71ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:57:58.555618 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:57:58.555618 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:57:58.555618 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:57:58.555618 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:57:58.555618 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:57:58.555618 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:57:58.555618 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:57:58.555618 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:57:58.555618 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:57:58.555618 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:57:58.555618 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:57:58.555618 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 23 20:57:58.555618 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 23 20:57:58.555618 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 23 20:57:58.556695 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 23 20:57:58.556695 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:57:58.556695 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:57:58.556695 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:57:58.556695 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:57:58.556695 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:57:58.556695 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:57:58.556695 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:57:58.556695 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application with Lock( Jul 23 20:57:58.556695 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:57:58.556695 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:57:58.556695 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:57:58.556695 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:57:58.556695 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:57:58.556695 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:57:58.556695 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:57:58.556695 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:57:58.557762 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 23 20:57:58.557762 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 23 20:57:58.557762 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:57:58.557762 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:57:58.561619 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 296/594] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 23 20:57:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:57:58.562517 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b145c3-6ca4-40db-a058-16ea99ec71ad None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:58.565971 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7958df-396d-4484-8cf4-4837eb9e6f2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:58.567849 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7958df-396d-4484-8cf4-4837eb9e6f2c None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:58.587612 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-2f7958df-396d-4484-8cf4-4837eb9e6f2c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:57:58.587612 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:57:58.587612 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:57:58.587612 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:57:58.587612 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:57:58.587612 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:57:58.587612 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:57:58.587612 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:57:58.587612 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:57:58.587612 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:57:58.587612 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:57:58.587612 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:57:58.587612 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 23 20:57:58.587612 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 23 20:57:58.587612 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 23 20:57:58.588723 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 23 20:57:58.588723 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:57:58.588723 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:57:58.588723 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:57:58.588723 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:57:58.588723 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:57:58.588723 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:57:58.588723 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:57:58.588723 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application with Lock( Jul 23 20:57:58.588723 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:57:58.588723 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:57:58.588723 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:57:58.588723 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:57:58.588723 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:57:58.588723 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:57:58.588723 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:57:58.588723 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:57:58.589663 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 23 20:57:58.589663 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 23 20:57:58.589663 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:57:58.589663 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 20:57:58.596081 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 299/595] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 23 20:57:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:57:58.597453 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7958df-396d-4484-8cf4-4837eb9e6f2c None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:58.654906 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:58.665058 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b145c3-6ca4-40db-a058-16ea99ec71ad None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:58.689821 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:58.708493 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf770239-920c-4bb4-9f52-71774f59e3af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:58.709171 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf770239-920c-4bb4-9f52-71774f59e3af None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:58.709493 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf770239-920c-4bb4-9f52-71774f59e3af None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:58.709709 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf770239-920c-4bb4-9f52-71774f59e3af None admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:58.710466 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf770239-920c-4bb4-9f52-71774f59e3af None admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:57:58.710762 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf770239-920c-4bb4-9f52-71774f59e3af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:58.712141 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf770239-920c-4bb4-9f52-71774f59e3af None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:58.712401 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7958df-396d-4484-8cf4-4837eb9e6f2c None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:58.729010 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 297/596] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 23 20:57:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:57:58.729010 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf770239-920c-4bb4-9f52-71774f59e3af None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:58.757923 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d11a222-5139-4966-a6d5-c5a3d26eac96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:58.758641 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d11a222-5139-4966-a6d5-c5a3d26eac96 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:58.758950 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d11a222-5139-4966-a6d5-c5a3d26eac96 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:58.759227 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d11a222-5139-4966-a6d5-c5a3d26eac96 None admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:58.760016 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d11a222-5139-4966-a6d5-c5a3d26eac96 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:57:58.760316 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d11a222-5139-4966-a6d5-c5a3d26eac96 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:58.762423 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d11a222-5139-4966-a6d5-c5a3d26eac96 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:58.784883 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 300/597] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 23 20:57:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:57:58.786352 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d11a222-5139-4966-a6d5-c5a3d26eac96 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:58.870433 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf770239-920c-4bb4-9f52-71774f59e3af None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:58.909835 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f333a8-9e94-45ae-9986-c29c9ad842c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:58.910467 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f333a8-9e94-45ae-9986-c29c9ad842c3 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:58.910730 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f333a8-9e94-45ae-9986-c29c9ad842c3 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:58.911005 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f333a8-9e94-45ae-9986-c29c9ad842c3 None admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:58.911988 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f333a8-9e94-45ae-9986-c29c9ad842c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:57:58.912297 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f333a8-9e94-45ae-9986-c29c9ad842c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:58.914109 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f333a8-9e94-45ae-9986-c29c9ad842c3 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:58.930654 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 298/598] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 23 20:57:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:57:58.931531 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f333a8-9e94-45ae-9986-c29c9ad842c3 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:58.932519 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d11a222-5139-4966-a6d5-c5a3d26eac96 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:58.946857 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:58.982314 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa04630-8eec-4136-b8e7-f1aee346fda9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:58.984169 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa04630-8eec-4136-b8e7-f1aee346fda9 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:58.984694 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa04630-8eec-4136-b8e7-f1aee346fda9 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:58.985176 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa04630-8eec-4136-b8e7-f1aee346fda9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:58.996344 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa04630-8eec-4136-b8e7-f1aee346fda9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:58.998236 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa04630-8eec-4136-b8e7-f1aee346fda9 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:59.018743 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-7fa04630-8eec-4136-b8e7-f1aee346fda9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 23 20:57:59.018743 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:57:59.018743 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:57:59.018743 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:57:59.018743 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:57:59.018743 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:57:59.018743 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:57:59.018743 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:57:59.018743 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:57:59.018743 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:57:59.018743 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:57:59.018743 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:57:59.018743 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 23 20:57:59.018743 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 23 20:57:59.018743 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 23 20:57:59.020206 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 23 20:57:59.020206 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:57:59.020206 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:57:59.020206 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:57:59.020206 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:57:59.020206 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:57:59.020206 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:57:59.020206 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:57:59.020206 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application with Lock( Jul 23 20:57:59.020206 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:57:59.020206 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:57:59.020206 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:57:59.020206 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:57:59.020206 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:57:59.020206 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:57:59.020206 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:57:59.020206 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:57:59.021148 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 23 20:57:59.021148 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 23 20:57:59.021148 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 23 20:57:59.021148 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 23 20:57:59.021148 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 23 20:57:59.021148 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 23 20:57:59.021148 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 23 20:57:59.021148 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 20:57:59.028664 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 301/599] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Jul 23 20:57:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:57:59.028664 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa04630-8eec-4136-b8e7-f1aee346fda9 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:59.035699 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:59.066984 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f333a8-9e94-45ae-9986-c29c9ad842c3 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:59.103528 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9498cdf7-4c30-444d-945b-f8f9c46e2d33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:59.104726 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9498cdf7-4c30-444d-945b-f8f9c46e2d33 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:59.105243 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9498cdf7-4c30-444d-945b-f8f9c46e2d33 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:59.105748 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9498cdf7-4c30-444d-945b-f8f9c46e2d33 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:59.113811 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9498cdf7-4c30-444d-945b-f8f9c46e2d33 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:59.115635 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9498cdf7-4c30-444d-945b-f8f9c46e2d33 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:59.130619 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-9498cdf7-4c30-444d-945b-f8f9c46e2d33 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 23 20:57:59.130619 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:57:59.130619 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:57:59.130619 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:57:59.130619 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:57:59.130619 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:57:59.130619 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:57:59.130619 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:57:59.130619 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:57:59.130619 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:57:59.130619 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:57:59.130619 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:57:59.130619 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 23 20:57:59.130619 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 23 20:57:59.130619 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 23 20:57:59.131562 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 23 20:57:59.131562 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:57:59.131562 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:57:59.131562 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:57:59.131562 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:57:59.131562 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:57:59.131562 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:57:59.131562 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:57:59.131562 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application with Lock( Jul 23 20:57:59.131562 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:57:59.131562 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:57:59.131562 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:57:59.131562 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:57:59.131562 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:57:59.131562 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:57:59.131562 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:57:59.131562 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:57:59.132457 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 23 20:57:59.132457 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 23 20:57:59.132457 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 23 20:57:59.132457 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 23 20:57:59.132457 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 23 20:57:59.132457 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 23 20:57:59.132457 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 23 20:57:59.132457 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:57:59.136026 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 299/600] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Jul 23 20:57:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:57:59.137346 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9498cdf7-4c30-444d-945b-f8f9c46e2d33 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:59.149928 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa04630-8eec-4136-b8e7-f1aee346fda9 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:59.186259 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476aac06-388e-4fdd-b1f2-d7b6e877ce86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:59.187321 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476aac06-388e-4fdd-b1f2-d7b6e877ce86 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:59.187752 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476aac06-388e-4fdd-b1f2-d7b6e877ce86 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:59.188170 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476aac06-388e-4fdd-b1f2-d7b6e877ce86 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:59.195645 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476aac06-388e-4fdd-b1f2-d7b6e877ce86 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:59.197302 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476aac06-388e-4fdd-b1f2-d7b6e877ce86 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:59.211771 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-476aac06-388e-4fdd-b1f2-d7b6e877ce86 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 23 20:57:59.211771 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:57:59.211771 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:57:59.211771 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:57:59.211771 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:57:59.211771 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:57:59.211771 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:57:59.211771 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:57:59.211771 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:57:59.211771 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:57:59.211771 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:57:59.211771 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:57:59.211771 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 23 20:57:59.211771 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 23 20:57:59.211771 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 23 20:57:59.212762 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 23 20:57:59.212762 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:57:59.212762 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:57:59.212762 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:57:59.212762 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:57:59.212762 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:57:59.212762 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:57:59.212762 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:57:59.212762 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application with Lock( Jul 23 20:57:59.212762 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:57:59.212762 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:57:59.212762 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:57:59.212762 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:57:59.212762 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:57:59.212762 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:57:59.212762 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:57:59.212762 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:57:59.213791 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 23 20:57:59.213791 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 23 20:57:59.213791 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 23 20:57:59.213791 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 23 20:57:59.213791 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 23 20:57:59.213791 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 23 20:57:59.213791 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 23 20:57:59.213791 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 20:57:59.215642 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 302/601] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Jul 23 20:57:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:57:59.216111 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:59.216775 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476aac06-388e-4fdd-b1f2-d7b6e877ce86 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:59.253676 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9498cdf7-4c30-444d-945b-f8f9c46e2d33 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:59.283067 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:59.292457 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f92f7f-e6e8-464c-8789-1d46f16f6bbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:59.293587 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f92f7f-e6e8-464c-8789-1d46f16f6bbb None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:59.293734 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f92f7f-e6e8-464c-8789-1d46f16f6bbb None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:59.294140 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f92f7f-e6e8-464c-8789-1d46f16f6bbb None admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:59.295160 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f92f7f-e6e8-464c-8789-1d46f16f6bbb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:57:59.295579 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f92f7f-e6e8-464c-8789-1d46f16f6bbb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:59.297152 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f92f7f-e6e8-464c-8789-1d46f16f6bbb None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:59.320471 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 300/602] 10.222.0.17 () {56 vars in 1148 bytes} [Sat Jul 23 20:57:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:57:59.320471 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f92f7f-e6e8-464c-8789-1d46f16f6bbb None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:59.329886 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476aac06-388e-4fdd-b1f2-d7b6e877ce86 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:59.384963 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeb2b15-cdc6-4aa6-aac2-b86e5609579a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:59.389116 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeb2b15-cdc6-4aa6-aac2-b86e5609579a None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:59.389662 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeb2b15-cdc6-4aa6-aac2-b86e5609579a None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:59.390092 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeb2b15-cdc6-4aa6-aac2-b86e5609579a None admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:59.391052 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebeb2b15-cdc6-4aa6-aac2-b86e5609579a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:57:59.391498 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebeb2b15-cdc6-4aa6-aac2-b86e5609579a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:59.393112 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebeb2b15-cdc6-4aa6-aac2-b86e5609579a None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:59.413976 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 303/603] 10.222.0.17 () {56 vars in 1148 bytes} [Sat Jul 23 20:57:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:57:59.415646 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeb2b15-cdc6-4aa6-aac2-b86e5609579a None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:59.452108 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f92f7f-e6e8-464c-8789-1d46f16f6bbb None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:59.484762 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:59.494215 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e783cf-0eb1-4e30-9e6d-022158227f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:59.495159 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e783cf-0eb1-4e30-9e6d-022158227f6f None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:59.495548 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e783cf-0eb1-4e30-9e6d-022158227f6f None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:59.495927 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e783cf-0eb1-4e30-9e6d-022158227f6f None admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:59.496838 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e783cf-0eb1-4e30-9e6d-022158227f6f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:57:59.497252 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e783cf-0eb1-4e30-9e6d-022158227f6f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:59.498891 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e783cf-0eb1-4e30-9e6d-022158227f6f None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:59.512917 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 301/604] 10.222.0.17 () {56 vars in 1148 bytes} [Sat Jul 23 20:57:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:57:59.514059 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e783cf-0eb1-4e30-9e6d-022158227f6f None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:59.525250 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeb2b15-cdc6-4aa6-aac2-b86e5609579a None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:59.549657 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:59.562777 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be257038-28a7-474f-b73a-0853c6ba38dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:59.563738 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be257038-28a7-474f-b73a-0853c6ba38dc None admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:59.564013 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be257038-28a7-474f-b73a-0853c6ba38dc None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:59.564281 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be257038-28a7-474f-b73a-0853c6ba38dc None admin] PATH_INFO: `/v3/projects/4804ed61295f4d4a92d9b685dd9e9f3b/users/c497326ee890462e8f48b4a56f81990c/roles/abf9f3b81f3647dbb70c44d0aedaa614` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:59.581193 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be257038-28a7-474f-b73a-0853c6ba38dc None admin] RBAC: Authorizing `identity:create_grant(project_id=4804ed61295f4d4a92d9b685dd9e9f3b, user_id=c497326ee890462e8f48b4a56f81990c, role_id=abf9f3b81f3647dbb70c44d0aedaa614)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:59.583088 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be257038-28a7-474f-b73a-0853c6ba38dc None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:59.597487 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 304/605] 10.222.0.17 () {58 vars in 1439 bytes} [Sat Jul 23 20:57:59 2022] PUT /identity/v3/projects/4804ed61295f4d4a92d9b685dd9e9f3b/users/c497326ee890462e8f48b4a56f81990c/roles/abf9f3b81f3647dbb70c44d0aedaa614 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 20:57:59.608031 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7953d994-5fa2-4723-ba7e-26ad427e3599 None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:59.608743 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7953d994-5fa2-4723-ba7e-26ad427e3599 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:59.609222 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7953d994-5fa2-4723-ba7e-26ad427e3599 None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:59.612338 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 305/606] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:57:59 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:57:59.613693 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7953d994-5fa2-4723-ba7e-26ad427e3599 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:59.630908 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e783cf-0eb1-4e30-9e6d-022158227f6f None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:59.674221 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584b291d-c76a-48c3-85c1-e6f1b40b7666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:59.675217 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584b291d-c76a-48c3-85c1-e6f1b40b7666 None admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:59.675678 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584b291d-c76a-48c3-85c1-e6f1b40b7666 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:59.675959 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584b291d-c76a-48c3-85c1-e6f1b40b7666 None admin] PATH_INFO: `/v3/projects/4804ed61295f4d4a92d9b685dd9e9f3b/users/ec5fd3a489c341b7964704d689037f05/roles/abf9f3b81f3647dbb70c44d0aedaa614` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:59.695330 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584b291d-c76a-48c3-85c1-e6f1b40b7666 None admin] RBAC: Authorizing `identity:create_grant(project_id=4804ed61295f4d4a92d9b685dd9e9f3b, user_id=ec5fd3a489c341b7964704d689037f05, role_id=abf9f3b81f3647dbb70c44d0aedaa614)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:59.696954 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584b291d-c76a-48c3-85c1-e6f1b40b7666 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:59.730678 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 302/607] 10.222.0.17 () {58 vars in 1439 bytes} [Sat Jul 23 20:57:59 2022] PUT /identity/v3/projects/4804ed61295f4d4a92d9b685dd9e9f3b/users/ec5fd3a489c341b7964704d689037f05/roles/abf9f3b81f3647dbb70c44d0aedaa614 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 20:57:59.730678 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598f7bbf-851a-4fe6-ae28-ac3a656942a4 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:59.730678 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598f7bbf-851a-4fe6-ae28-ac3a656942a4 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:59.730678 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598f7bbf-851a-4fe6-ae28-ac3a656942a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:59.755991 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-598f7bbf-851a-4fe6-ae28-ac3a656942a4 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:57:59.758722 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-598f7bbf-851a-4fe6-ae28-ac3a656942a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:57:59.814699 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:57:59.818892 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7953d994-5fa2-4723-ba7e-26ad427e3599 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:57:59.870355 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 303/608] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:57:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 23 20:57:59.875443 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27db560-35fd-47e3-9a41-dc096f055e3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:57:59.876811 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27db560-35fd-47e3-9a41-dc096f055e3d None admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:59.877410 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27db560-35fd-47e3-9a41-dc096f055e3d None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:59.877915 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27db560-35fd-47e3-9a41-dc096f055e3d None admin] PATH_INFO: `/v3/projects/4804ed61295f4d4a92d9b685dd9e9f3b/users/f7f2db148c8e4d5d81431cae3576434b/roles/abf9f3b81f3647dbb70c44d0aedaa614` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:59.895413 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27db560-35fd-47e3-9a41-dc096f055e3d None admin] RBAC: Authorizing `identity:create_grant(project_id=4804ed61295f4d4a92d9b685dd9e9f3b, user_id=f7f2db148c8e4d5d81431cae3576434b, role_id=abf9f3b81f3647dbb70c44d0aedaa614)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:57:59.897360 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27db560-35fd-47e3-9a41-dc096f055e3d None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:57:59.904913 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598f7bbf-851a-4fe6-ae28-ac3a656942a4 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:57:59.926579 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 306/609] 10.222.0.17 () {58 vars in 1439 bytes} [Sat Jul 23 20:57:59 2022] PUT /identity/v3/projects/4804ed61295f4d4a92d9b685dd9e9f3b/users/f7f2db148c8e4d5d81431cae3576434b/roles/abf9f3b81f3647dbb70c44d0aedaa614 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 20:57:59.953305 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bade7d-babd-4109-96ef-f1c2ea7c6781 None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:59.953588 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bade7d-babd-4109-96ef-f1c2ea7c6781 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:59.954077 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bade7d-babd-4109-96ef-f1c2ea7c6781 None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:59.956543 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 307/610] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:57:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:57:59.967976 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279a84cc-9c37-4de3-9ffb-30d34a5f45a1 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:57:59.968251 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279a84cc-9c37-4de3-9ffb-30d34a5f45a1 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:57:59.968817 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279a84cc-9c37-4de3-9ffb-30d34a5f45a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:57:59.995245 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-279a84cc-9c37-4de3-9ffb-30d34a5f45a1 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:57:59.996507 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-279a84cc-9c37-4de3-9ffb-30d34a5f45a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:58:00.021076 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:00.037455 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598f7bbf-851a-4fe6-ae28-ac3a656942a4 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:00.079201 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d64cb1e-23e3-4e94-a279-446e4dc132dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:00.080462 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d64cb1e-23e3-4e94-a279-446e4dc132dd None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:00.080940 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d64cb1e-23e3-4e94-a279-446e4dc132dd None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:00.081434 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d64cb1e-23e3-4e94-a279-446e4dc132dd None admin] PATH_INFO: `/v3/roles/service` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:00.089569 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 308/611] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:57:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 23 20:58:00.095268 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d64cb1e-23e3-4e94-a279-446e4dc132dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:58:00.104168 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-3d64cb1e-23e3-4e94-a279-446e4dc132dd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 23 20:58:00.104168 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:58:00.104168 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:58:00.104168 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:58:00.104168 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:58:00.104168 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:58:00.104168 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:58:00.104168 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:58:00.104168 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:58:00.104168 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:58:00.104168 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:58:00.104168 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:58:00.104168 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:58:00.104168 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:58:00.104168 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:58:00.104168 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:58:00.105675 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:58:00.105675 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:58:00.105675 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:58:00.105675 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:58:00.105675 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:58:00.105675 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:58:00.105675 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:58:00.105675 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:58:00.105675 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:58:00.105675 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:58:00.105675 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:58:00.105675 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application with Lock( Jul 23 20:58:00.105675 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:58:00.105675 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:58:00.105675 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:58:00.105675 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:58:00.106883 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:58:00.106883 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:58:00.106883 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:58:00.106883 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:58:00.106883 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:58:00.106883 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:58:00.106883 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:58:00.106883 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:58:00.106883 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:58:00.106883 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:58:00.106883 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 23 20:58:00.106883 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:58:00.109501 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 304/612] 10.222.0.17 () {56 vars in 1102 bytes} [Sat Jul 23 20:57:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:58:00.115767 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279a84cc-9c37-4de3-9ffb-30d34a5f45a1 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:00.174993 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d64cb1e-23e3-4e94-a279-446e4dc132dd None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:00.223758 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:00.266099 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279a84cc-9c37-4de3-9ffb-30d34a5f45a1 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:00.311717 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba154cc-0eae-4718-90b5-cd377159df0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:00.312561 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba154cc-0eae-4718-90b5-cd377159df0f None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:00.312843 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba154cc-0eae-4718-90b5-cd377159df0f None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:00.313116 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba154cc-0eae-4718-90b5-cd377159df0f None admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:00.313960 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba154cc-0eae-4718-90b5-cd377159df0f None admin] RBAC: Adding query filter params (name=service) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:00.314268 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba154cc-0eae-4718-90b5-cd377159df0f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:00.315665 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba154cc-0eae-4718-90b5-cd377159df0f None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:00.320219 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d64cb1e-23e3-4e94-a279-446e4dc132dd None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:00.325541 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 309/613] 10.222.0.17 () {56 vars in 1103 bytes} [Sat Jul 23 20:58:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:58:00.333196 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba154cc-0eae-4718-90b5-cd377159df0f None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:00.360827 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:00.400051 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d68082-ad6e-4585-975b-fdeaf874ae8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:00.400891 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d68082-ad6e-4585-975b-fdeaf874ae8a None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:00.401172 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d68082-ad6e-4585-975b-fdeaf874ae8a None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:00.401441 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d68082-ad6e-4585-975b-fdeaf874ae8a None admin] PATH_INFO: `/v3/roles/service` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:00.429476 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d68082-ad6e-4585-975b-fdeaf874ae8a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:58:00.442200 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-29d68082-ad6e-4585-975b-fdeaf874ae8a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 23 20:58:00.442200 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:58:00.442200 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:58:00.442200 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:58:00.442200 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:58:00.442200 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:58:00.442200 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:58:00.442200 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:58:00.442200 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:58:00.442200 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:58:00.442200 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:58:00.442200 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:58:00.442200 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:58:00.442200 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:58:00.442200 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:58:00.442200 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:58:00.443229 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:58:00.443229 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:58:00.443229 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:58:00.443229 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:58:00.443229 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:58:00.443229 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:58:00.443229 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:58:00.443229 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:58:00.443229 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:58:00.443229 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:58:00.443229 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:58:00.443229 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application with Lock( Jul 23 20:58:00.443229 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:58:00.443229 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:58:00.443229 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:58:00.443229 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:58:00.444094 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:58:00.444094 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:58:00.444094 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:58:00.444094 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:58:00.444094 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:58:00.444094 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:58:00.444094 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:58:00.444094 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:58:00.444094 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:58:00.444094 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:58:00.444094 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 23 20:58:00.444094 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:58:00.444094 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 305/614] 10.222.0.17 () {56 vars in 1102 bytes} [Sat Jul 23 20:58:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:58:00.451770 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d68082-ad6e-4585-975b-fdeaf874ae8a None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:00.556698 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba154cc-0eae-4718-90b5-cd377159df0f None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:00.601458 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c98efa-3ed9-4baf-b4ae-042f32d134c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:00.603462 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c98efa-3ed9-4baf-b4ae-042f32d134c7 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:00.604635 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c98efa-3ed9-4baf-b4ae-042f32d134c7 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:00.604968 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c98efa-3ed9-4baf-b4ae-042f32d134c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:00.620149 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:00.634374 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c98efa-3ed9-4baf-b4ae-042f32d134c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:00.635976 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c98efa-3ed9-4baf-b4ae-042f32d134c7 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:00.640512 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d68082-ad6e-4585-975b-fdeaf874ae8a None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:00.668487 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-43c98efa-3ed9-4baf-b4ae-042f32d134c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:58:00.668487 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:58:00.668487 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:58:00.668487 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:58:00.668487 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:58:00.668487 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:58:00.668487 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:58:00.668487 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:58:00.668487 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:58:00.668487 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:58:00.668487 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:58:00.668487 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:58:00.668487 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 23 20:58:00.668487 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 23 20:58:00.668487 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 23 20:58:00.669465 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 23 20:58:00.669465 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:58:00.669465 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:58:00.669465 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:58:00.669465 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:58:00.669465 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:58:00.669465 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:58:00.669465 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:58:00.669465 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application with Lock( Jul 23 20:58:00.669465 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:58:00.669465 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:58:00.669465 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:58:00.669465 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:58:00.669465 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:58:00.669465 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:58:00.669465 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:58:00.669465 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:58:00.670395 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 23 20:58:00.670395 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 23 20:58:00.670395 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:58:00.670395 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 20:58:00.670395 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 310/615] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 23 20:58:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:58:00.678986 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c98efa-3ed9-4baf-b4ae-042f32d134c7 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:00.695160 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f39004-d8db-4ba7-893d-dc5745eb5316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:00.696093 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f39004-d8db-4ba7-893d-dc5745eb5316 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:00.696550 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f39004-d8db-4ba7-893d-dc5745eb5316 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:00.696970 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f39004-d8db-4ba7-893d-dc5745eb5316 None admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:00.697889 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f39004-d8db-4ba7-893d-dc5745eb5316 None admin] RBAC: Adding query filter params (name=service) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:00.698594 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f39004-d8db-4ba7-893d-dc5745eb5316 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:00.701051 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f39004-d8db-4ba7-893d-dc5745eb5316 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:00.724458 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 306/616] 10.222.0.17 () {56 vars in 1103 bytes} [Sat Jul 23 20:58:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:58:00.730051 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f39004-d8db-4ba7-893d-dc5745eb5316 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:00.756439 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:00.795833 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c98efa-3ed9-4baf-b4ae-042f32d134c7 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:00.862801 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05a7bcb-d271-47cd-a257-91020b31d622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:00.863541 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05a7bcb-d271-47cd-a257-91020b31d622 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:00.863816 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05a7bcb-d271-47cd-a257-91020b31d622 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:00.864086 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05a7bcb-d271-47cd-a257-91020b31d622 None admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:00.864807 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05a7bcb-d271-47cd-a257-91020b31d622 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:00.865105 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05a7bcb-d271-47cd-a257-91020b31d622 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:00.869632 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05a7bcb-d271-47cd-a257-91020b31d622 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:00.896922 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 311/617] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 23 20:58:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:58:00.904675 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05a7bcb-d271-47cd-a257-91020b31d622 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:00.951159 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f39004-d8db-4ba7-893d-dc5745eb5316 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:01.001156 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fe9dd3-d6d2-4295-a89b-f33e1ba24990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:01.002001 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fe9dd3-d6d2-4295-a89b-f33e1ba24990 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:01.002278 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fe9dd3-d6d2-4295-a89b-f33e1ba24990 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:01.002545 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fe9dd3-d6d2-4295-a89b-f33e1ba24990 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:01.013819 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fe9dd3-d6d2-4295-a89b-f33e1ba24990 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:01.015316 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fe9dd3-d6d2-4295-a89b-f33e1ba24990 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:01.033216 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-72fe9dd3-d6d2-4295-a89b-f33e1ba24990 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:58:01.033216 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:58:01.033216 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:58:01.033216 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:58:01.033216 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:58:01.033216 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:58:01.033216 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:58:01.033216 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:58:01.033216 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:58:01.033216 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:58:01.033216 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:58:01.033216 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:58:01.033216 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 23 20:58:01.033216 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 23 20:58:01.033216 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 23 20:58:01.034265 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 23 20:58:01.034265 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:58:01.034265 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:58:01.034265 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:58:01.034265 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:58:01.034265 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:58:01.034265 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:58:01.034265 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:58:01.034265 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application with Lock( Jul 23 20:58:01.034265 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:58:01.034265 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:58:01.034265 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:58:01.034265 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:58:01.034265 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:58:01.034265 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:58:01.034265 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:58:01.034265 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:58:01.035480 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 23 20:58:01.035480 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 23 20:58:01.035480 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:58:01.035480 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:58:01.035480 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 307/618] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 23 20:58:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:58:01.040261 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fe9dd3-d6d2-4295-a89b-f33e1ba24990 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:01.043978 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:01.103680 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05a7bcb-d271-47cd-a257-91020b31d622 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:01.143657 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fe9dd3-d6d2-4295-a89b-f33e1ba24990 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:01.158377 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:01.183657 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1bf0d3-4ef5-4cd6-b9b5-5492a7b1abee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:01.184497 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1bf0d3-4ef5-4cd6-b9b5-5492a7b1abee None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:01.184771 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1bf0d3-4ef5-4cd6-b9b5-5492a7b1abee None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:01.185046 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1bf0d3-4ef5-4cd6-b9b5-5492a7b1abee None admin] PATH_INFO: `/v3/users/nova` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:01.186178 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3991889e-3875-411a-be2c-56a65f224f5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:01.186853 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3991889e-3875-411a-be2c-56a65f224f5e None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:01.187130 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3991889e-3875-411a-be2c-56a65f224f5e None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:01.187403 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3991889e-3875-411a-be2c-56a65f224f5e None admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:01.188128 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3991889e-3875-411a-be2c-56a65f224f5e None admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:01.188425 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3991889e-3875-411a-be2c-56a65f224f5e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:01.189809 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3991889e-3875-411a-be2c-56a65f224f5e None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:01.197626 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1bf0d3-4ef5-4cd6-b9b5-5492a7b1abee None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:01.203925 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 308/619] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 23 20:58:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 20:58:01.208664 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1bf0d3-4ef5-4cd6-b9b5-5492a7b1abee None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:01.209631 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3991889e-3875-411a-be2c-56a65f224f5e None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:01.229616 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-1b1bf0d3-4ef5-4cd6-b9b5-5492a7b1abee None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 23 20:58:01.229616 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:58:01.229616 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:58:01.229616 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:58:01.229616 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:58:01.229616 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:58:01.229616 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:58:01.229616 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:58:01.229616 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:58:01.229616 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:58:01.229616 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:58:01.229616 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:58:01.229616 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 23 20:58:01.229616 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 23 20:58:01.229616 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 23 20:58:01.229616 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 23 20:58:01.230815 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:58:01.230815 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:58:01.230815 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 23 20:58:01.230815 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 23 20:58:01.230815 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 23 20:58:01.230815 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 23 20:58:01.230815 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:58:01.230815 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:58:01.230815 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:58:01.230815 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:58:01.230815 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:58:01.230815 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application with Lock( Jul 23 20:58:01.230815 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:58:01.230815 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:58:01.230815 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:58:01.230815 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:58:01.230815 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:58:01.230815 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:58:01.231815 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:58:01.231815 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:58:01.231815 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 23 20:58:01.231815 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 23 20:58:01.231815 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 23 20:58:01.231815 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 23 20:58:01.231815 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 23 20:58:01.231815 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 23 20:58:01.231815 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 23 20:58:01.231815 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 20:58:01.231815 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 312/620] 10.222.0.17 () {56 vars in 1093 bytes} [Sat Jul 23 20:58:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:58:01.242982 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1bf0d3-4ef5-4cd6-b9b5-5492a7b1abee None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:01.289567 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:01.329563 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3991889e-3875-411a-be2c-56a65f224f5e None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:01.365526 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996a3fec-6b86-4437-a4cc-5cef61e6b3a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:01.366651 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996a3fec-6b86-4437-a4cc-5cef61e6b3a9 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:01.367110 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996a3fec-6b86-4437-a4cc-5cef61e6b3a9 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:01.367518 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996a3fec-6b86-4437-a4cc-5cef61e6b3a9 None admin] PATH_INFO: `/v3/users/swift` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:01.375476 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996a3fec-6b86-4437-a4cc-5cef61e6b3a9 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:01.377138 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996a3fec-6b86-4437-a4cc-5cef61e6b3a9 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:01.414365 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-996a3fec-6b86-4437-a4cc-5cef61e6b3a9 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 23 20:58:01.414365 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:58:01.414365 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:58:01.414365 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:58:01.414365 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:58:01.414365 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:58:01.414365 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:58:01.414365 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:58:01.414365 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:58:01.414365 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:58:01.414365 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:58:01.414365 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:58:01.414365 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 23 20:58:01.414365 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 23 20:58:01.414365 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 23 20:58:01.414365 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 23 20:58:01.415423 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:58:01.415423 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:58:01.415423 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 23 20:58:01.415423 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 23 20:58:01.415423 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 23 20:58:01.415423 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 23 20:58:01.415423 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:58:01.415423 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:58:01.415423 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:58:01.415423 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:58:01.415423 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:58:01.415423 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application with Lock( Jul 23 20:58:01.415423 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:58:01.415423 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:58:01.415423 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:58:01.415423 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:58:01.415423 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:58:01.415423 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:58:01.416343 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:58:01.416343 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:58:01.416343 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 23 20:58:01.416343 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 23 20:58:01.416343 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 23 20:58:01.416343 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 23 20:58:01.416343 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 23 20:58:01.416343 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 23 20:58:01.416343 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 23 20:58:01.416343 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:58:01.421532 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 309/621] 10.222.0.17 () {56 vars in 1096 bytes} [Sat Jul 23 20:58:01 2022] GET /identity/v3/users/swift => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 23 20:58:01.428227 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996a3fec-6b86-4437-a4cc-5cef61e6b3a9 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:01.475828 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1bf0d3-4ef5-4cd6-b9b5-5492a7b1abee None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:01.549615 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996a3fec-6b86-4437-a4cc-5cef61e6b3a9 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:01.573262 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5a8504-9e40-4f40-a6a9-1a48fd357ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:01.574038 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5a8504-9e40-4f40-a6a9-1a48fd357ed7 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:01.574385 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5a8504-9e40-4f40-a6a9-1a48fd357ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:01.574597 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5a8504-9e40-4f40-a6a9-1a48fd357ed7 None admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:01.575440 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5a8504-9e40-4f40-a6a9-1a48fd357ed7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:01.575748 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5a8504-9e40-4f40-a6a9-1a48fd357ed7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:01.577187 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5a8504-9e40-4f40-a6a9-1a48fd357ed7 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:01.577570 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:01.590668 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03c1ad4-db43-46e8-8347-1d4318952b1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:01.591562 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03c1ad4-db43-46e8-8347-1d4318952b1b None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:01.592054 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03c1ad4-db43-46e8-8347-1d4318952b1b None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:01.592464 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03c1ad4-db43-46e8-8347-1d4318952b1b None admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:01.593481 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03c1ad4-db43-46e8-8347-1d4318952b1b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:01.593939 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03c1ad4-db43-46e8-8347-1d4318952b1b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:01.595562 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03c1ad4-db43-46e8-8347-1d4318952b1b None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:01.613511 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 313/622] 10.222.0.17 () {56 vars in 1133 bytes} [Sat Jul 23 20:58:01 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:58:01.622283 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 310/623] 10.222.0.17 () {56 vars in 1135 bytes} [Sat Jul 23 20:58:01 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:58:01.624871 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03c1ad4-db43-46e8-8347-1d4318952b1b None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:01.624994 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5a8504-9e40-4f40-a6a9-1a48fd357ed7 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:01.731433 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03c1ad4-db43-46e8-8347-1d4318952b1b None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:01.732014 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:01.768914 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c8a8e2-9975-4d77-af1e-2b208fa1d89d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:01.770095 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c8a8e2-9975-4d77-af1e-2b208fa1d89d None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:01.770534 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c8a8e2-9975-4d77-af1e-2b208fa1d89d None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:01.770941 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c8a8e2-9975-4d77-af1e-2b208fa1d89d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:01.782209 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c8a8e2-9975-4d77-af1e-2b208fa1d89d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:01.784126 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c8a8e2-9975-4d77-af1e-2b208fa1d89d None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:01.803711 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-95c8a8e2-9975-4d77-af1e-2b208fa1d89d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:58:01.803711 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:58:01.803711 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:58:01.803711 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:58:01.803711 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:58:01.803711 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:58:01.803711 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:58:01.803711 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:58:01.803711 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:58:01.803711 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:58:01.803711 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:58:01.803711 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:58:01.803711 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 23 20:58:01.803711 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 23 20:58:01.803711 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 23 20:58:01.804809 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 23 20:58:01.804809 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:58:01.804809 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:58:01.804809 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:58:01.804809 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:58:01.804809 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:58:01.804809 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:58:01.804809 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:58:01.804809 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application with Lock( Jul 23 20:58:01.804809 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:58:01.804809 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:58:01.804809 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:58:01.804809 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:58:01.804809 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:58:01.804809 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:58:01.804809 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:58:01.804809 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:58:01.805932 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 23 20:58:01.805932 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 23 20:58:01.805932 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:58:01.805932 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:58:01.807865 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 311/624] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 23 20:58:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:58:01.813921 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c8a8e2-9975-4d77-af1e-2b208fa1d89d None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:01.856717 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:01.867978 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5a8504-9e40-4f40-a6a9-1a48fd357ed7 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:01.948824 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8de4776-7ebf-465f-8ab9-5a429e5a265b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:01.949816 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8de4776-7ebf-465f-8ab9-5a429e5a265b None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:01.950323 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8de4776-7ebf-465f-8ab9-5a429e5a265b None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:01.951233 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8de4776-7ebf-465f-8ab9-5a429e5a265b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:01.978092 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c8a8e2-9975-4d77-af1e-2b208fa1d89d None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:02.047016 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faaf980-c9b9-4846-b2a3-d6176da77889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:02.048220 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faaf980-c9b9-4846-b2a3-d6176da77889 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:02.050126 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faaf980-c9b9-4846-b2a3-d6176da77889 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:02.050653 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faaf980-c9b9-4846-b2a3-d6176da77889 None admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:02.052556 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faaf980-c9b9-4846-b2a3-d6176da77889 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:02.053036 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faaf980-c9b9-4846-b2a3-d6176da77889 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:02.055395 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faaf980-c9b9-4846-b2a3-d6176da77889 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:02.077540 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 312/625] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 23 20:58:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 20:58:02.086552 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faaf980-c9b9-4846-b2a3-d6176da77889 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:02.105639 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8de4776-7ebf-465f-8ab9-5a429e5a265b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:02.111417 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8de4776-7ebf-465f-8ab9-5a429e5a265b None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:02.178330 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:02.225677 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 314/626] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Jul 23 20:58:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 601 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 23 20:58:02.230363 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:02.231772 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8de4776-7ebf-465f-8ab9-5a429e5a265b None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:02.246164 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faaf980-c9b9-4846-b2a3-d6176da77889 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:02.312454 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7897f217-8df5-45cd-bde3-b7483d48b91f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:02.313291 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7897f217-8df5-45cd-bde3-b7483d48b91f None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:02.313568 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7897f217-8df5-45cd-bde3-b7483d48b91f None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:02.313837 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7897f217-8df5-45cd-bde3-b7483d48b91f None admin] PATH_INFO: `/v3/projects/service` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:02.321568 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7897f217-8df5-45cd-bde3-b7483d48b91f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:02.323067 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7897f217-8df5-45cd-bde3-b7483d48b91f None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:02.341353 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8de4776-7ebf-465f-8ab9-5a429e5a265b None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:02.354345 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-7897f217-8df5-45cd-bde3-b7483d48b91f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 23 20:58:02.354345 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:58:02.354345 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:58:02.354345 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:58:02.354345 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:58:02.354345 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:58:02.354345 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:58:02.354345 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:58:02.354345 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:58:02.354345 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:58:02.354345 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:58:02.354345 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:58:02.354345 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 23 20:58:02.354345 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 23 20:58:02.354345 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 23 20:58:02.355383 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 23 20:58:02.355383 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:58:02.355383 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:58:02.355383 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:58:02.355383 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:58:02.355383 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:58:02.355383 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:58:02.355383 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:58:02.355383 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application with Lock( Jul 23 20:58:02.355383 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:58:02.355383 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:58:02.355383 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:58:02.355383 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:58:02.355383 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:58:02.355383 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:58:02.355383 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:58:02.355383 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:58:02.356267 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 23 20:58:02.356267 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 23 20:58:02.356267 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 23 20:58:02.356267 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 23 20:58:02.356267 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 23 20:58:02.356267 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 23 20:58:02.356267 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 23 20:58:02.356267 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:58:02.356267 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 313/627] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Jul 23 20:58:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:58:02.361838 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7897f217-8df5-45cd-bde3-b7483d48b91f None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:02.378673 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62527656-c0ca-4e03-87ef-116de783f111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:02.379498 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62527656-c0ca-4e03-87ef-116de783f111 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:02.379779 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62527656-c0ca-4e03-87ef-116de783f111 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:02.380054 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62527656-c0ca-4e03-87ef-116de783f111 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:02.391069 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62527656-c0ca-4e03-87ef-116de783f111 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:02.392542 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62527656-c0ca-4e03-87ef-116de783f111 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:02.398504 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:02.416653 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-62527656-c0ca-4e03-87ef-116de783f111 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:58:02.416653 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:58:02.416653 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:58:02.416653 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:58:02.416653 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:58:02.416653 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:58:02.416653 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:58:02.416653 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:58:02.416653 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:58:02.416653 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:58:02.416653 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:58:02.416653 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:58:02.416653 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 23 20:58:02.416653 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 23 20:58:02.416653 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 23 20:58:02.417725 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 23 20:58:02.417725 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:58:02.417725 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:58:02.417725 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:58:02.417725 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:58:02.417725 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:58:02.417725 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:58:02.417725 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:58:02.417725 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application with Lock( Jul 23 20:58:02.417725 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:58:02.417725 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:58:02.417725 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:58:02.417725 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:58:02.417725 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:58:02.417725 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:58:02.417725 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:58:02.417725 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:58:02.418695 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 23 20:58:02.418695 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 23 20:58:02.418695 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:58:02.418695 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 20:58:02.418695 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 315/628] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 23 20:58:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:58:02.428787 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b38f4e-0e70-467e-8db7-513419a258cb None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:02.429244 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b38f4e-0e70-467e-8db7-513419a258cb None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:02.429673 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b38f4e-0e70-467e-8db7-513419a258cb None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:02.435594 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 316/629] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:58:02 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:58:02.435594 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b38f4e-0e70-467e-8db7-513419a258cb None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:02.503211 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7897f217-8df5-45cd-bde3-b7483d48b91f None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:02.541531 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3046c430-28bf-4b8b-b726-dec2f508b462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:02.542810 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3046c430-28bf-4b8b-b726-dec2f508b462 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:02.543290 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3046c430-28bf-4b8b-b726-dec2f508b462 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:02.543790 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3046c430-28bf-4b8b-b726-dec2f508b462 None admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:02.544867 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3046c430-28bf-4b8b-b726-dec2f508b462 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:02.545512 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3046c430-28bf-4b8b-b726-dec2f508b462 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:02.547234 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3046c430-28bf-4b8b-b726-dec2f508b462 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:02.549011 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b38f4e-0e70-467e-8db7-513419a258cb None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:02.561195 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 314/630] 10.222.0.17 () {56 vars in 1148 bytes} [Sat Jul 23 20:58:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 20:58:02.562969 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9f444d-a474-4846-99e5-cf8b867a9181 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:02.563508 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9f444d-a474-4846-99e5-cf8b867a9181 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:02.564042 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9f444d-a474-4846-99e5-cf8b867a9181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:02.584427 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-9c9f444d-a474-4846-99e5-cf8b867a9181 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:58:02.586497 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-9c9f444d-a474-4846-99e5-cf8b867a9181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:58:02.588419 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073e5dd5-3304-43a6-8c19-7305b7a65fa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:02.589117 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073e5dd5-3304-43a6-8c19-7305b7a65fa3 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:02.589408 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073e5dd5-3304-43a6-8c19-7305b7a65fa3 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:02.589686 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073e5dd5-3304-43a6-8c19-7305b7a65fa3 None admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:02.590512 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073e5dd5-3304-43a6-8c19-7305b7a65fa3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:02.590816 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073e5dd5-3304-43a6-8c19-7305b7a65fa3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:02.592444 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073e5dd5-3304-43a6-8c19-7305b7a65fa3 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:02.601640 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:02.610538 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 317/631] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 23 20:58:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:58:02.611566 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073e5dd5-3304-43a6-8c19-7305b7a65fa3 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:02.675641 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 315/632] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:58:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 23 20:58:02.676931 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9f444d-a474-4846-99e5-cf8b867a9181 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:02.679362 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:02.729995 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073e5dd5-3304-43a6-8c19-7305b7a65fa3 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:02.766157 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f05eec3-349c-4d8f-9e4a-25d621e463db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:02.767055 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f05eec3-349c-4d8f-9e4a-25d621e463db None admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:02.767328 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f05eec3-349c-4d8f-9e4a-25d621e463db None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:02.767592 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f05eec3-349c-4d8f-9e4a-25d621e463db None admin] PATH_INFO: `/v3/projects/4804ed61295f4d4a92d9b685dd9e9f3b/users/47f0a685b7da46afb81024848f079d2f/roles/abf9f3b81f3647dbb70c44d0aedaa614` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:02.783159 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f05eec3-349c-4d8f-9e4a-25d621e463db None admin] RBAC: Authorizing `identity:create_grant(project_id=4804ed61295f4d4a92d9b685dd9e9f3b, user_id=47f0a685b7da46afb81024848f079d2f, role_id=abf9f3b81f3647dbb70c44d0aedaa614)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:02.784663 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f05eec3-349c-4d8f-9e4a-25d621e463db None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:02.799214 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9f444d-a474-4846-99e5-cf8b867a9181 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:02.800214 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 318/633] 10.222.0.17 () {58 vars in 1439 bytes} [Sat Jul 23 20:58:02 2022] PUT /identity/v3/projects/4804ed61295f4d4a92d9b685dd9e9f3b/users/47f0a685b7da46afb81024848f079d2f/roles/abf9f3b81f3647dbb70c44d0aedaa614 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 20:58:02.801965 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b4650b-c8a2-43d3-aa44-88b0b5c021fc None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:02.802262 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b4650b-c8a2-43d3-aa44-88b0b5c021fc None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:02.802538 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b4650b-c8a2-43d3-aa44-88b0b5c021fc None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:02.804291 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 319/634] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:58:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:58:02.804908 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b4650b-c8a2-43d3-aa44-88b0b5c021fc None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:02.850569 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ee88e4-622f-4a06-bb86-9549948829dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:02.851518 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ee88e4-622f-4a06-bb86-9549948829dc None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:02.851917 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ee88e4-622f-4a06-bb86-9549948829dc None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:02.852190 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ee88e4-622f-4a06-bb86-9549948829dc None admin] PATH_INFO: `/v3/projects/service` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:02.861032 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ee88e4-622f-4a06-bb86-9549948829dc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:02.862798 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ee88e4-622f-4a06-bb86-9549948829dc None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:02.879803 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-67ee88e4-622f-4a06-bb86-9549948829dc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 23 20:58:02.879803 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:58:02.879803 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:58:02.879803 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:58:02.879803 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:58:02.879803 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:58:02.879803 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:58:02.879803 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:58:02.879803 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:58:02.879803 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:58:02.879803 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:58:02.879803 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:58:02.879803 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 23 20:58:02.879803 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 23 20:58:02.879803 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 23 20:58:02.880796 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 23 20:58:02.880796 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:58:02.880796 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:58:02.880796 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:58:02.880796 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:58:02.880796 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:58:02.880796 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:58:02.880796 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:58:02.880796 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application with Lock( Jul 23 20:58:02.880796 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:58:02.880796 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:58:02.880796 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:58:02.880796 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:58:02.880796 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:58:02.880796 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:58:02.880796 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:58:02.880796 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:58:02.881675 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 23 20:58:02.881675 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 23 20:58:02.881675 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 23 20:58:02.881675 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 23 20:58:02.881675 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 23 20:58:02.881675 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 23 20:58:02.881675 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 23 20:58:02.881675 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:58:02.881675 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 316/635] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Jul 23 20:58:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:58:02.882797 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083a64b1-2e81-428b-9e80-b4012fc5cd6e None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:02.882876 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083a64b1-2e81-428b-9e80-b4012fc5cd6e None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:02.883159 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083a64b1-2e81-428b-9e80-b4012fc5cd6e None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:02.888818 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 317/636] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:58:02 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:58:02.890316 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b73b133-d0fb-4c6b-9a14-20613c5cf37c None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:02.890606 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b73b133-d0fb-4c6b-9a14-20613c5cf37c None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:02.890885 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b73b133-d0fb-4c6b-9a14-20613c5cf37c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:02.898107 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:02.910433 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-3b73b133-d0fb-4c6b-9a14-20613c5cf37c None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:58:02.911766 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-3b73b133-d0fb-4c6b-9a14-20613c5cf37c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:58:02.949056 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b4650b-c8a2-43d3-aa44-88b0b5c021fc None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:02.959132 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:02.990535 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf39181a-345d-4189-b069-9206a8e87f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:02.993297 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf39181a-345d-4189-b069-9206a8e87f18 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:02.993297 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf39181a-345d-4189-b069-9206a8e87f18 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:02.993297 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf39181a-345d-4189-b069-9206a8e87f18 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:02.998960 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 318/637] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:58:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 23 20:58:02.999666 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b73b133-d0fb-4c6b-9a14-20613c5cf37c None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:03.007460 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf39181a-345d-4189-b069-9206a8e87f18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:58:03.015516 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-cf39181a-345d-4189-b069-9206a8e87f18 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 23 20:58:03.015516 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:58:03.015516 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:58:03.015516 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:58:03.015516 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:58:03.015516 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:58:03.015516 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:58:03.015516 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:58:03.015516 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:58:03.015516 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:58:03.015516 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:58:03.015516 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:58:03.015516 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:58:03.015516 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:58:03.015516 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:58:03.015516 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:58:03.016730 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:58:03.016730 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:58:03.016730 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:58:03.016730 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:58:03.016730 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:58:03.016730 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:58:03.016730 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:58:03.016730 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:58:03.016730 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:58:03.016730 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:58:03.016730 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:58:03.016730 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application with Lock( Jul 23 20:58:03.016730 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:58:03.016730 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:58:03.016730 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:58:03.016730 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:58:03.017818 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:58:03.017818 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:58:03.017818 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:58:03.017818 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:58:03.017818 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:58:03.017818 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:58:03.017818 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:58:03.017818 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:58:03.017818 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:58:03.017818 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:58:03.017818 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 23 20:58:03.017818 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 20:58:03.017818 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 320/638] 10.222.0.17 () {56 vars in 1102 bytes} [Sat Jul 23 20:58:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:58:03.018917 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fea1fe-ae9b-44c3-a3b4-344762b32b88 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:03.018917 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fea1fe-ae9b-44c3-a3b4-344762b32b88 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:03.018917 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fea1fe-ae9b-44c3-a3b4-344762b32b88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:03.036804 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-a1fea1fe-ae9b-44c3-a3b4-344762b32b88 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:58:03.038136 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-a1fea1fe-ae9b-44c3-a3b4-344762b32b88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:58:03.110902 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b73b133-d0fb-4c6b-9a14-20613c5cf37c None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:03.115991 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 321/639] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:58:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 23 20:58:03.117072 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fea1fe-ae9b-44c3-a3b4-344762b32b88 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:03.174878 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9f82ec-21a3-4b8a-afc0-89d8ce9c8495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:03.176120 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9f82ec-21a3-4b8a-afc0-89d8ce9c8495 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:03.176682 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9f82ec-21a3-4b8a-afc0-89d8ce9c8495 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:03.177186 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9f82ec-21a3-4b8a-afc0-89d8ce9c8495 None admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:03.178585 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9f82ec-21a3-4b8a-afc0-89d8ce9c8495 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:03.179193 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9f82ec-21a3-4b8a-afc0-89d8ce9c8495 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:03.181774 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9f82ec-21a3-4b8a-afc0-89d8ce9c8495 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:03.184798 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:03.213909 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 319/640] 10.222.0.17 () {56 vars in 1148 bytes} [Sat Jul 23 20:58:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:58:03.213909 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9f82ec-21a3-4b8a-afc0-89d8ce9c8495 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:03.243648 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:03.258490 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fea1fe-ae9b-44c3-a3b4-344762b32b88 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:03.305037 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff7cf45-7520-40a7-b97c-ccebd8cfa611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:03.305629 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff7cf45-7520-40a7-b97c-ccebd8cfa611 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:03.305934 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff7cf45-7520-40a7-b97c-ccebd8cfa611 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:03.306214 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff7cf45-7520-40a7-b97c-ccebd8cfa611 None admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:03.306948 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff7cf45-7520-40a7-b97c-ccebd8cfa611 None admin] RBAC: Adding query filter params (name=service) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:03.308573 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff7cf45-7520-40a7-b97c-ccebd8cfa611 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:03.308692 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff7cf45-7520-40a7-b97c-ccebd8cfa611 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:03.319489 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 322/641] 10.222.0.17 () {56 vars in 1103 bytes} [Sat Jul 23 20:58:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:58:03.319489 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff7cf45-7520-40a7-b97c-ccebd8cfa611 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:03.352008 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9f82ec-21a3-4b8a-afc0-89d8ce9c8495 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:03.386380 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309df8a9-995d-4cdb-89f5-b32d4d0eff17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:03.387299 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309df8a9-995d-4cdb-89f5-b32d4d0eff17 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:03.387629 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309df8a9-995d-4cdb-89f5-b32d4d0eff17 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:03.387963 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309df8a9-995d-4cdb-89f5-b32d4d0eff17 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:03.402154 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309df8a9-995d-4cdb-89f5-b32d4d0eff17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:58:03.412374 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-309df8a9-995d-4cdb-89f5-b32d4d0eff17 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 23 20:58:03.412374 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:58:03.412374 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:58:03.412374 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:58:03.412374 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:58:03.412374 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:58:03.412374 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:58:03.412374 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:58:03.412374 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:58:03.412374 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:58:03.412374 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:58:03.412374 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:58:03.412374 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:58:03.412374 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:58:03.412374 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:58:03.412374 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:58:03.413516 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:58:03.413516 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:58:03.413516 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:58:03.413516 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:58:03.413516 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:58:03.413516 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:58:03.413516 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:58:03.413516 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:58:03.413516 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:58:03.413516 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:58:03.413516 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:58:03.413516 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application with Lock( Jul 23 20:58:03.413516 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:58:03.413516 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:58:03.413516 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:58:03.413516 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:58:03.414598 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:58:03.414598 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:58:03.414598 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:58:03.414598 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:58:03.414598 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:58:03.414598 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:58:03.414598 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:58:03.414598 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:58:03.414598 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:58:03.414598 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:58:03.414598 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 23 20:58:03.414598 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:58:03.419121 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 320/642] 10.222.0.17 () {56 vars in 1102 bytes} [Sat Jul 23 20:58:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:58:03.419907 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309df8a9-995d-4cdb-89f5-b32d4d0eff17 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:03.445529 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff7cf45-7520-40a7-b97c-ccebd8cfa611 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:03.477454 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:03.486169 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210f8b4e-b1d5-43ef-882d-2d486d71260b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:03.487204 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210f8b4e-b1d5-43ef-882d-2d486d71260b None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:03.487724 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210f8b4e-b1d5-43ef-882d-2d486d71260b None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:03.488244 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210f8b4e-b1d5-43ef-882d-2d486d71260b None admin] PATH_INFO: `/v3/roles/service` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:03.500232 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210f8b4e-b1d5-43ef-882d-2d486d71260b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:58:03.508948 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-210f8b4e-b1d5-43ef-882d-2d486d71260b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 23 20:58:03.508948 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:58:03.508948 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:58:03.508948 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:58:03.508948 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:58:03.508948 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:58:03.508948 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:58:03.508948 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:58:03.508948 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:58:03.508948 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:58:03.508948 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:58:03.508948 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:58:03.508948 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:58:03.508948 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:58:03.508948 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:58:03.508948 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:58:03.510032 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:58:03.510032 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:58:03.510032 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:58:03.510032 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:58:03.510032 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:58:03.510032 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:58:03.510032 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:58:03.510032 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:58:03.510032 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:58:03.510032 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:58:03.510032 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:58:03.510032 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application with Lock( Jul 23 20:58:03.510032 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:58:03.510032 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:58:03.510032 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:58:03.510032 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:58:03.511069 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:58:03.511069 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:58:03.511069 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:58:03.511069 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:58:03.511069 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:58:03.511069 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:58:03.511069 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:58:03.511069 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:58:03.511069 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:58:03.511069 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:58:03.511069 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 23 20:58:03.511069 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 20:58:03.517155 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 323/643] 10.222.0.17 () {56 vars in 1102 bytes} [Sat Jul 23 20:58:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:58:03.517155 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210f8b4e-b1d5-43ef-882d-2d486d71260b None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:03.528641 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309df8a9-995d-4cdb-89f5-b32d4d0eff17 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:03.534326 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:03.570297 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b963e23-37c0-4eb9-a958-1ab3b6c71958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:03.571051 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b963e23-37c0-4eb9-a958-1ab3b6c71958 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:03.571434 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b963e23-37c0-4eb9-a958-1ab3b6c71958 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:03.571791 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b963e23-37c0-4eb9-a958-1ab3b6c71958 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:03.572676 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b963e23-37c0-4eb9-a958-1ab3b6c71958 None admin] RBAC: Adding query filter params (role.id=abf9f3b81f3647dbb70c44d0aedaa614, scope.project.id=4804ed61295f4d4a92d9b685dd9e9f3b, user.id=079f31ed2c844e67bd4e206f24b69d97) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:03.572985 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b963e23-37c0-4eb9-a958-1ab3b6c71958 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:03.574504 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b963e23-37c0-4eb9-a958-1ab3b6c71958 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:03.581242 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 321/644] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Jul 23 20:58:03 2022] GET /identity/v3/role_assignments?user.id=079f31ed2c844e67bd4e206f24b69d97&scope.project.id=4804ed61295f4d4a92d9b685dd9e9f3b&role.id=abf9f3b81f3647dbb70c44d0aedaa614 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:58:03.582284 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b963e23-37c0-4eb9-a958-1ab3b6c71958 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:03.649171 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210f8b4e-b1d5-43ef-882d-2d486d71260b None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:03.696560 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5f399c-2c0f-451a-98d9-72c449cf137d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:03.697695 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5f399c-2c0f-451a-98d9-72c449cf137d None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:03.698184 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5f399c-2c0f-451a-98d9-72c449cf137d None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:03.698632 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5f399c-2c0f-451a-98d9-72c449cf137d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:03.711526 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5f399c-2c0f-451a-98d9-72c449cf137d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:03.713557 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5f399c-2c0f-451a-98d9-72c449cf137d None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:03.728063 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b963e23-37c0-4eb9-a958-1ab3b6c71958 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:03.733200 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-be5f399c-2c0f-451a-98d9-72c449cf137d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:58:03.733200 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:58:03.733200 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:58:03.733200 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:58:03.733200 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:58:03.733200 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:58:03.733200 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:58:03.733200 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:58:03.733200 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:58:03.733200 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:58:03.733200 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:58:03.733200 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:58:03.733200 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 23 20:58:03.733200 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 23 20:58:03.733200 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 23 20:58:03.734394 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 23 20:58:03.734394 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:58:03.734394 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:58:03.734394 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:58:03.734394 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:58:03.734394 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:58:03.734394 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:58:03.734394 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:58:03.734394 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application with Lock( Jul 23 20:58:03.734394 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:58:03.734394 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:58:03.734394 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:58:03.734394 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:58:03.734394 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:58:03.734394 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:58:03.734394 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:58:03.734394 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:58:03.735676 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 23 20:58:03.735676 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 23 20:58:03.735676 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:58:03.735676 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 20:58:03.742173 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 324/645] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 23 20:58:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:58:03.743530 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5f399c-2c0f-451a-98d9-72c449cf137d None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:03.748139 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:03.768818 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be2ebfc-905c-44dc-b79e-4e37a65378c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:03.769989 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be2ebfc-905c-44dc-b79e-4e37a65378c4 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:03.770412 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be2ebfc-905c-44dc-b79e-4e37a65378c4 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:03.770857 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be2ebfc-905c-44dc-b79e-4e37a65378c4 None admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:03.771760 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be2ebfc-905c-44dc-b79e-4e37a65378c4 None admin] RBAC: Adding query filter params (name=service) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:03.772205 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be2ebfc-905c-44dc-b79e-4e37a65378c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:03.773991 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be2ebfc-905c-44dc-b79e-4e37a65378c4 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:03.784580 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 322/646] 10.222.0.17 () {56 vars in 1103 bytes} [Sat Jul 23 20:58:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:58:03.785791 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be2ebfc-905c-44dc-b79e-4e37a65378c4 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:03.841247 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:03.882850 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5f399c-2c0f-451a-98d9-72c449cf137d None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:03.922811 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbdec40-a481-4469-8e56-9a1e77e88cba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:03.923460 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbdec40-a481-4469-8e56-9a1e77e88cba None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:03.923738 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbdec40-a481-4469-8e56-9a1e77e88cba None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:03.923833 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be2ebfc-905c-44dc-b79e-4e37a65378c4 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:03.924255 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbdec40-a481-4469-8e56-9a1e77e88cba None admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:03.924746 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbdec40-a481-4469-8e56-9a1e77e88cba None admin] RBAC: Adding query filter params (name=service) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:03.925045 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbdec40-a481-4469-8e56-9a1e77e88cba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:03.927633 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbdec40-a481-4469-8e56-9a1e77e88cba None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:03.936910 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 325/647] 10.222.0.17 () {56 vars in 1103 bytes} [Sat Jul 23 20:58:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:58:03.937097 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbdec40-a481-4469-8e56-9a1e77e88cba None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:03.973614 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fa12f1-0512-4aea-91de-af83b79438ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:03.974333 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fa12f1-0512-4aea-91de-af83b79438ff None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:03.974611 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fa12f1-0512-4aea-91de-af83b79438ff None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:03.974886 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fa12f1-0512-4aea-91de-af83b79438ff None admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:03.975768 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fa12f1-0512-4aea-91de-af83b79438ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:03.976427 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fa12f1-0512-4aea-91de-af83b79438ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:03.978239 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fa12f1-0512-4aea-91de-af83b79438ff None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:03.997990 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 323/648] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 23 20:58:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:58:04.000489 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fa12f1-0512-4aea-91de-af83b79438ff None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:04.057416 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:04.063139 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbdec40-a481-4469-8e56-9a1e77e88cba None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:04.095232 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:04.101601 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2bdb7a-2ed7-4608-aa52-5ffd441205af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:04.102825 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2bdb7a-2ed7-4608-aa52-5ffd441205af None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:04.103208 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2bdb7a-2ed7-4608-aa52-5ffd441205af None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:04.103578 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2bdb7a-2ed7-4608-aa52-5ffd441205af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:04.115611 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2bdb7a-2ed7-4608-aa52-5ffd441205af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:04.117350 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2bdb7a-2ed7-4608-aa52-5ffd441205af None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:04.135723 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fa12f1-0512-4aea-91de-af83b79438ff None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:04.135929 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-cc2bdb7a-2ed7-4608-aa52-5ffd441205af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:58:04.135929 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:58:04.135929 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:58:04.135929 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:58:04.135929 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:58:04.135929 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:58:04.135929 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:58:04.135929 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:58:04.135929 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:58:04.135929 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:58:04.135929 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:58:04.135929 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:58:04.135929 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 23 20:58:04.135929 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 23 20:58:04.135929 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 23 20:58:04.136927 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 23 20:58:04.136927 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:58:04.136927 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:58:04.136927 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:58:04.136927 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:58:04.136927 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:58:04.136927 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:58:04.136927 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:58:04.136927 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application with Lock( Jul 23 20:58:04.136927 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:58:04.136927 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:58:04.136927 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:58:04.136927 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:58:04.136927 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:58:04.136927 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:58:04.136927 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:58:04.136927 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:58:04.138041 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 23 20:58:04.138041 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 23 20:58:04.138041 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:58:04.138041 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 20:58:04.144165 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 326/649] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 23 20:58:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:58:04.145063 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2bdb7a-2ed7-4608-aa52-5ffd441205af None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:04.181771 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717e0c35-2dd3-4836-b7ab-8951c1d866a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:04.182819 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717e0c35-2dd3-4836-b7ab-8951c1d866a8 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:04.183196 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717e0c35-2dd3-4836-b7ab-8951c1d866a8 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:04.183767 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717e0c35-2dd3-4836-b7ab-8951c1d866a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:04.195259 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717e0c35-2dd3-4836-b7ab-8951c1d866a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:04.197052 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717e0c35-2dd3-4836-b7ab-8951c1d866a8 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:04.216335 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-717e0c35-2dd3-4836-b7ab-8951c1d866a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:58:04.216335 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:58:04.216335 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:58:04.216335 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:58:04.216335 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:58:04.216335 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:58:04.216335 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:58:04.216335 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:58:04.216335 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:58:04.216335 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:58:04.216335 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:58:04.216335 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:58:04.216335 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 23 20:58:04.216335 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 23 20:58:04.216335 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 23 20:58:04.217480 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 23 20:58:04.217480 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:58:04.217480 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:58:04.217480 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:58:04.217480 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:58:04.217480 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:58:04.217480 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:58:04.217480 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:58:04.217480 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application with Lock( Jul 23 20:58:04.217480 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:58:04.217480 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:58:04.217480 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:58:04.217480 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:58:04.217480 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:58:04.217480 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:58:04.217480 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:58:04.217480 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:58:04.218614 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 23 20:58:04.218614 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 23 20:58:04.218614 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:58:04.218614 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:58:04.220362 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 324/650] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 23 20:58:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:58:04.225904 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717e0c35-2dd3-4836-b7ab-8951c1d866a8 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:04.284909 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2bdb7a-2ed7-4608-aa52-5ffd441205af None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:04.331900 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd763413-b53e-4b56-ae00-076321354416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:04.333690 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd763413-b53e-4b56-ae00-076321354416 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:04.334139 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd763413-b53e-4b56-ae00-076321354416 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:04.334599 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd763413-b53e-4b56-ae00-076321354416 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:04.346155 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd763413-b53e-4b56-ae00-076321354416 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:04.346593 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:04.347663 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd763413-b53e-4b56-ae00-076321354416 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:04.359056 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717e0c35-2dd3-4836-b7ab-8951c1d866a8 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:04.363502 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-cd763413-b53e-4b56-ae00-076321354416 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 23 20:58:04.363502 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:58:04.363502 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:58:04.363502 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:58:04.363502 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:58:04.363502 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:58:04.363502 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:58:04.363502 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:58:04.363502 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:58:04.363502 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:58:04.363502 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:58:04.363502 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:58:04.363502 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 23 20:58:04.363502 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 23 20:58:04.363502 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 23 20:58:04.363502 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 23 20:58:04.364608 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:58:04.364608 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:58:04.364608 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 23 20:58:04.364608 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 23 20:58:04.364608 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 23 20:58:04.364608 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 23 20:58:04.364608 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:58:04.364608 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:58:04.364608 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:58:04.364608 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:58:04.364608 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:58:04.364608 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application with Lock( Jul 23 20:58:04.364608 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:58:04.364608 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:58:04.364608 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:58:04.364608 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:58:04.364608 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:58:04.364608 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:58:04.365555 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:58:04.365555 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:58:04.365555 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 23 20:58:04.365555 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 23 20:58:04.365555 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 23 20:58:04.365555 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 23 20:58:04.365555 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 23 20:58:04.365555 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 23 20:58:04.365555 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 23 20:58:04.365555 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 20:58:04.369422 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 327/651] 10.222.0.17 () {56 vars in 1102 bytes} [Sat Jul 23 20:58:04 2022] GET /identity/v3/users/neutron => generated 85 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:58:04.370759 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd763413-b53e-4b56-ae00-076321354416 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:04.409418 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1dad2b-0599-442f-9168-23d1a1b1ae72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:04.414011 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1dad2b-0599-442f-9168-23d1a1b1ae72 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:04.414458 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1dad2b-0599-442f-9168-23d1a1b1ae72 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:04.415327 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1dad2b-0599-442f-9168-23d1a1b1ae72 None admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:04.416208 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1dad2b-0599-442f-9168-23d1a1b1ae72 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:04.417122 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1dad2b-0599-442f-9168-23d1a1b1ae72 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:04.419402 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1dad2b-0599-442f-9168-23d1a1b1ae72 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:04.421000 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:04.438841 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 325/652] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 23 20:58:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:58:04.440035 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1dad2b-0599-442f-9168-23d1a1b1ae72 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:04.489613 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd763413-b53e-4b56-ae00-076321354416 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:04.536971 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bcebd4-e366-4e6a-9c17-033a3e53d331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:04.537658 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bcebd4-e366-4e6a-9c17-033a3e53d331 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:04.537978 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bcebd4-e366-4e6a-9c17-033a3e53d331 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:04.538268 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bcebd4-e366-4e6a-9c17-033a3e53d331 None admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:04.538994 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bcebd4-e366-4e6a-9c17-033a3e53d331 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:04.539291 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bcebd4-e366-4e6a-9c17-033a3e53d331 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:04.540673 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bcebd4-e366-4e6a-9c17-033a3e53d331 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:04.554718 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 328/653] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 23 20:58:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:58:04.555721 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bcebd4-e366-4e6a-9c17-033a3e53d331 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:04.570559 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1dad2b-0599-442f-9168-23d1a1b1ae72 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:04.611886 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4c9cd0-af6c-45e4-b670-c17e318bcd76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:04.612939 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4c9cd0-af6c-45e4-b670-c17e318bcd76 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:04.613356 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4c9cd0-af6c-45e4-b670-c17e318bcd76 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:04.613760 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4c9cd0-af6c-45e4-b670-c17e318bcd76 None admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:04.614786 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4c9cd0-af6c-45e4-b670-c17e318bcd76 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:04.615328 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4c9cd0-af6c-45e4-b670-c17e318bcd76 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:04.617023 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4c9cd0-af6c-45e4-b670-c17e318bcd76 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:04.639567 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 326/654] 10.222.0.17 () {56 vars in 1139 bytes} [Sat Jul 23 20:58:04 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:58:04.640646 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4c9cd0-af6c-45e4-b670-c17e318bcd76 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:04.654496 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:04.674876 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bcebd4-e366-4e6a-9c17-033a3e53d331 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:04.677582 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:04.714563 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014744be-13b0-4ea7-a670-cd041aa8cf5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:04.715384 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014744be-13b0-4ea7-a670-cd041aa8cf5a None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:04.715662 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014744be-13b0-4ea7-a670-cd041aa8cf5a None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:04.715931 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014744be-13b0-4ea7-a670-cd041aa8cf5a None admin] PATH_INFO: `/v3/users/glance` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:04.724512 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014744be-13b0-4ea7-a670-cd041aa8cf5a None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:04.726054 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014744be-13b0-4ea7-a670-cd041aa8cf5a None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:04.742297 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-014744be-13b0-4ea7-a670-cd041aa8cf5a None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 23 20:58:04.742297 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:58:04.742297 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:58:04.742297 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:58:04.742297 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:58:04.742297 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:58:04.742297 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:58:04.742297 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:58:04.742297 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:58:04.742297 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:58:04.742297 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:58:04.742297 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:58:04.742297 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 23 20:58:04.742297 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 23 20:58:04.742297 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 23 20:58:04.742297 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 23 20:58:04.743504 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:58:04.743504 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:58:04.743504 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 23 20:58:04.743504 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 23 20:58:04.743504 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 23 20:58:04.743504 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 23 20:58:04.743504 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:58:04.743504 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:58:04.743504 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:58:04.743504 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:58:04.743504 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:58:04.743504 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application with Lock( Jul 23 20:58:04.743504 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:58:04.743504 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:58:04.743504 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:58:04.743504 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:58:04.743504 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:58:04.743504 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:58:04.744458 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:58:04.744458 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:58:04.744458 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 23 20:58:04.744458 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 23 20:58:04.744458 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 23 20:58:04.744458 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 23 20:58:04.744458 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 23 20:58:04.744458 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 23 20:58:04.744458 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 23 20:58:04.744458 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 20:58:04.748641 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 329/655] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Jul 23 20:58:04 2022] GET /identity/v3/users/glance => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:58:04.749556 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014744be-13b0-4ea7-a670-cd041aa8cf5a None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:04.767695 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4c9cd0-af6c-45e4-b670-c17e318bcd76 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:04.805853 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d930cc-1829-4e45-8ca2-91cdce13e19d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:04.807029 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d930cc-1829-4e45-8ca2-91cdce13e19d None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:04.807474 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d930cc-1829-4e45-8ca2-91cdce13e19d None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:04.807883 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d930cc-1829-4e45-8ca2-91cdce13e19d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:04.825269 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d930cc-1829-4e45-8ca2-91cdce13e19d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:04.826994 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d930cc-1829-4e45-8ca2-91cdce13e19d None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:04.843251 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-b5d930cc-1829-4e45-8ca2-91cdce13e19d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 23 20:58:04.843251 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:58:04.843251 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:58:04.843251 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:58:04.843251 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:58:04.843251 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:58:04.843251 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:58:04.843251 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:58:04.843251 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:58:04.843251 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:58:04.843251 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:58:04.843251 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:58:04.843251 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 23 20:58:04.843251 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 23 20:58:04.843251 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 23 20:58:04.843251 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 23 20:58:04.844393 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:58:04.844393 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:58:04.844393 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 23 20:58:04.844393 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 23 20:58:04.844393 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 23 20:58:04.844393 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 23 20:58:04.844393 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:58:04.844393 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:58:04.844393 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:58:04.844393 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:58:04.844393 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:58:04.844393 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application with Lock( Jul 23 20:58:04.844393 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:58:04.844393 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:58:04.844393 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:58:04.844393 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:58:04.844393 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:58:04.844393 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:58:04.845402 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:58:04.845402 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:58:04.845402 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 23 20:58:04.845402 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 23 20:58:04.845402 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 23 20:58:04.845402 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 23 20:58:04.845402 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 23 20:58:04.845402 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 23 20:58:04.845402 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 23 20:58:04.845402 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:58:04.847758 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 327/656] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Jul 23 20:58:04 2022] GET /identity/v3/users/cinder => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:58:04.848883 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d930cc-1829-4e45-8ca2-91cdce13e19d None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:04.865888 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014744be-13b0-4ea7-a670-cd041aa8cf5a None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:04.905474 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6db5906-446a-4db6-9ba1-d5ab5f11f589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:04.906430 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6db5906-446a-4db6-9ba1-d5ab5f11f589 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:04.907230 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6db5906-446a-4db6-9ba1-d5ab5f11f589 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:04.907230 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6db5906-446a-4db6-9ba1-d5ab5f11f589 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:04.924698 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:04.944529 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:04.962342 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d930cc-1829-4e45-8ca2-91cdce13e19d None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:04.990690 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6db5906-446a-4db6-9ba1-d5ab5f11f589 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:04.992524 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6db5906-446a-4db6-9ba1-d5ab5f11f589 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:05.017332 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73df903c-789d-4d4b-bfbf-c6b6060c6a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:05.018349 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73df903c-789d-4d4b-bfbf-c6b6060c6a62 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:05.018772 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73df903c-789d-4d4b-bfbf-c6b6060c6a62 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:05.019266 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73df903c-789d-4d4b-bfbf-c6b6060c6a62 None admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:05.020975 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73df903c-789d-4d4b-bfbf-c6b6060c6a62 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:05.021446 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73df903c-789d-4d4b-bfbf-c6b6060c6a62 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:05.023813 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73df903c-789d-4d4b-bfbf-c6b6060c6a62 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:05.050148 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 328/657] 10.222.0.17 () {56 vars in 1137 bytes} [Sat Jul 23 20:58:04 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:58:05.051275 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73df903c-789d-4d4b-bfbf-c6b6060c6a62 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:05.130205 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 330/658] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Jul 23 20:58:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 23 20:58:05.131217 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6db5906-446a-4db6-9ba1-d5ab5f11f589 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:05.164387 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73df903c-789d-4d4b-bfbf-c6b6060c6a62 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:05.191021 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:05.198163 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:05.200218 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dec167-c954-47dc-88f5-9675d8fb5204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:05.200892 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dec167-c954-47dc-88f5-9675d8fb5204 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:05.201168 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dec167-c954-47dc-88f5-9675d8fb5204 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:05.201594 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dec167-c954-47dc-88f5-9675d8fb5204 None admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:05.202456 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dec167-c954-47dc-88f5-9675d8fb5204 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:05.202748 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dec167-c954-47dc-88f5-9675d8fb5204 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:05.204931 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dec167-c954-47dc-88f5-9675d8fb5204 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:05.223649 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 329/659] 10.222.0.17 () {56 vars in 1137 bytes} [Sat Jul 23 20:58:05 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:58:05.224322 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dec167-c954-47dc-88f5-9675d8fb5204 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:05.245641 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6db5906-446a-4db6-9ba1-d5ab5f11f589 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:05.287794 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0d3881-636d-4dfb-b7af-bf09f5ad805e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:05.288787 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0d3881-636d-4dfb-b7af-bf09f5ad805e None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:05.289069 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0d3881-636d-4dfb-b7af-bf09f5ad805e None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:05.289344 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0d3881-636d-4dfb-b7af-bf09f5ad805e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:05.340562 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dec167-c954-47dc-88f5-9675d8fb5204 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:05.361875 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0d3881-636d-4dfb-b7af-bf09f5ad805e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:05.363364 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0d3881-636d-4dfb-b7af-bf09f5ad805e None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:05.383096 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b423b391-b5d7-4a80-a624-78b570658f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:05.383776 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b423b391-b5d7-4a80-a624-78b570658f09 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:05.384053 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b423b391-b5d7-4a80-a624-78b570658f09 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:05.384320 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b423b391-b5d7-4a80-a624-78b570658f09 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:05.396522 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b423b391-b5d7-4a80-a624-78b570658f09 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:05.398070 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b423b391-b5d7-4a80-a624-78b570658f09 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:05.417708 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-b423b391-b5d7-4a80-a624-78b570658f09 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:58:05.417708 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:58:05.417708 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:58:05.417708 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:58:05.417708 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:58:05.417708 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:58:05.417708 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:58:05.417708 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:58:05.417708 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:58:05.417708 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:58:05.417708 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:58:05.417708 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:58:05.417708 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 23 20:58:05.417708 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 23 20:58:05.417708 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 23 20:58:05.418776 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 23 20:58:05.418776 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:58:05.418776 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:58:05.418776 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:58:05.418776 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:58:05.418776 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:58:05.418776 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:58:05.418776 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:58:05.418776 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application with Lock( Jul 23 20:58:05.418776 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:58:05.418776 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:58:05.418776 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:58:05.418776 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:58:05.418776 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:58:05.418776 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:58:05.418776 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:58:05.418776 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:58:05.419661 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 23 20:58:05.419661 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 23 20:58:05.419661 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:58:05.419661 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:58:05.423344 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 330/660] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 23 20:58:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:58:05.424559 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bbdb7d-5672-4b3f-8e1a-48714a4a9749 None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:05.424841 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bbdb7d-5672-4b3f-8e1a-48714a4a9749 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:05.425110 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bbdb7d-5672-4b3f-8e1a-48714a4a9749 None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:05.430005 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 331/661] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:58:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:58:05.430005 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bbdb7d-5672-4b3f-8e1a-48714a4a9749 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:05.443125 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:05.486592 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:05.494055 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 331/662] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Jul 23 20:58:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 23 20:58:05.495182 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0d3881-636d-4dfb-b7af-bf09f5ad805e None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:05.558792 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bbdb7d-5672-4b3f-8e1a-48714a4a9749 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:05.597772 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1af71ec-6c75-4cb4-83db-e93df07498ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:05.598652 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1af71ec-6c75-4cb4-83db-e93df07498ae None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:05.599003 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1af71ec-6c75-4cb4-83db-e93df07498ae None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:05.599271 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1af71ec-6c75-4cb4-83db-e93df07498ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:05.611611 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0d3881-636d-4dfb-b7af-bf09f5ad805e None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:05.655052 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fff160d-be3f-4f1a-ba2b-b70b814ab950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:05.656117 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fff160d-be3f-4f1a-ba2b-b70b814ab950 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:05.656619 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fff160d-be3f-4f1a-ba2b-b70b814ab950 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:05.657108 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fff160d-be3f-4f1a-ba2b-b70b814ab950 None admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:05.658474 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fff160d-be3f-4f1a-ba2b-b70b814ab950 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:05.659044 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fff160d-be3f-4f1a-ba2b-b70b814ab950 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:05.661570 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fff160d-be3f-4f1a-ba2b-b70b814ab950 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:05.683186 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 332/663] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 23 20:58:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:58:05.683186 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ba5808-b363-4ee9-a98e-2bb7c0e57823 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:05.683186 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ba5808-b363-4ee9-a98e-2bb7c0e57823 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:05.683186 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ba5808-b363-4ee9-a98e-2bb7c0e57823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:05.684374 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1af71ec-6c75-4cb4-83db-e93df07498ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:05.684374 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1af71ec-6c75-4cb4-83db-e93df07498ae None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:05.705950 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-58ba5808-b363-4ee9-a98e-2bb7c0e57823 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:58:05.707487 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-58ba5808-b363-4ee9-a98e-2bb7c0e57823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:58:05.727502 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:05.729527 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:05.797889 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 333/664] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:58:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 23 20:58:05.797889 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ba5808-b363-4ee9-a98e-2bb7c0e57823 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:05.807376 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 332/665] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Jul 23 20:58:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 23 20:58:05.808435 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1af71ec-6c75-4cb4-83db-e93df07498ae None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:05.933242 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ba5808-b363-4ee9-a98e-2bb7c0e57823 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:05.957358 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1af71ec-6c75-4cb4-83db-e93df07498ae None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:05.978537 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb914bc-46bf-432e-882d-f3b4ab9fe2f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:05.979573 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb914bc-46bf-432e-882d-f3b4ab9fe2f1 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:05.979975 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb914bc-46bf-432e-882d-f3b4ab9fe2f1 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:05.980387 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb914bc-46bf-432e-882d-f3b4ab9fe2f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:05.993607 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb914bc-46bf-432e-882d-f3b4ab9fe2f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:05.995547 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb914bc-46bf-432e-882d-f3b4ab9fe2f1 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:06.000811 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8816586-32d7-45a9-bc5f-9528260bef7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:06.001828 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8816586-32d7-45a9-bc5f-9528260bef7a None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:06.002248 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8816586-32d7-45a9-bc5f-9528260bef7a None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:06.002627 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8816586-32d7-45a9-bc5f-9528260bef7a None admin] PATH_INFO: `/v3/projects/service` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:06.012088 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8816586-32d7-45a9-bc5f-9528260bef7a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:06.013794 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8816586-32d7-45a9-bc5f-9528260bef7a None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:06.015289 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-bbb914bc-46bf-432e-882d-f3b4ab9fe2f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:58:06.015289 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:58:06.015289 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:58:06.015289 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:58:06.015289 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:58:06.015289 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:58:06.015289 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:58:06.015289 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:58:06.015289 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:58:06.015289 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:58:06.015289 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:58:06.015289 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:58:06.015289 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 23 20:58:06.015289 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 23 20:58:06.015289 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 23 20:58:06.016247 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 23 20:58:06.016247 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:58:06.016247 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:58:06.016247 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:58:06.016247 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:58:06.016247 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:58:06.016247 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:58:06.016247 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:58:06.016247 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application with Lock( Jul 23 20:58:06.016247 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:58:06.016247 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:58:06.016247 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:58:06.016247 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:58:06.016247 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:58:06.016247 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:58:06.016247 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:58:06.016247 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:58:06.017580 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 23 20:58:06.017580 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 23 20:58:06.017580 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:58:06.017580 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 20:58:06.018927 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:06.021468 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 334/666] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 23 20:58:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:58:06.022060 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb914bc-46bf-432e-882d-f3b4ab9fe2f1 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:06.032648 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:06.034776 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-d8816586-32d7-45a9-bc5f-9528260bef7a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 23 20:58:06.034776 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:58:06.034776 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:58:06.034776 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:58:06.034776 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:58:06.034776 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:58:06.034776 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:58:06.034776 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:58:06.034776 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:58:06.034776 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:58:06.034776 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:58:06.034776 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:58:06.034776 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 23 20:58:06.034776 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 23 20:58:06.034776 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 23 20:58:06.036042 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 23 20:58:06.036042 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:58:06.036042 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:58:06.036042 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:58:06.036042 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:58:06.036042 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:58:06.036042 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:58:06.036042 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:58:06.036042 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application with Lock( Jul 23 20:58:06.036042 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:58:06.036042 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:58:06.036042 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:58:06.036042 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:58:06.036042 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:58:06.036042 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:58:06.036042 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:58:06.036042 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:58:06.036938 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 23 20:58:06.036938 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 23 20:58:06.036938 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 23 20:58:06.036938 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 23 20:58:06.036938 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 23 20:58:06.036938 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 23 20:58:06.036938 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 23 20:58:06.036938 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:58:06.036938 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 333/667] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Jul 23 20:58:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:58:06.036938 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8816586-32d7-45a9-bc5f-9528260bef7a None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:06.155313 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb914bc-46bf-432e-882d-f3b4ab9fe2f1 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:06.167417 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8816586-32d7-45a9-bc5f-9528260bef7a None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:06.193905 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb96c7a-e9e7-48c6-bebc-3560db0b129d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:06.194764 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb96c7a-e9e7-48c6-bebc-3560db0b129d None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:06.195044 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb96c7a-e9e7-48c6-bebc-3560db0b129d None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:06.195316 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb96c7a-e9e7-48c6-bebc-3560db0b129d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:06.204353 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbda715-4246-4e61-8c76-d9cfc0432dc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:06.205374 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbda715-4246-4e61-8c76-d9cfc0432dc2 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:06.205654 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbda715-4246-4e61-8c76-d9cfc0432dc2 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:06.205949 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbda715-4246-4e61-8c76-d9cfc0432dc2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:06.206623 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb96c7a-e9e7-48c6-bebc-3560db0b129d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:06.208082 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb96c7a-e9e7-48c6-bebc-3560db0b129d None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:06.216723 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbda715-4246-4e61-8c76-d9cfc0432dc2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:58:06.224552 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-bfbda715-4246-4e61-8c76-d9cfc0432dc2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 23 20:58:06.224552 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:58:06.224552 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:58:06.224552 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:58:06.224552 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:58:06.224552 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:58:06.224552 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:58:06.224552 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:58:06.224552 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:58:06.224552 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:58:06.224552 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:58:06.224552 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:58:06.224552 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:58:06.224552 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:58:06.224552 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:58:06.224552 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:58:06.225649 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:58:06.225649 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:58:06.225649 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:58:06.225649 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:58:06.225649 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:58:06.225649 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:58:06.225649 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:58:06.225649 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:58:06.225649 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:58:06.225649 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:58:06.225649 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:58:06.225649 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application with Lock( Jul 23 20:58:06.225649 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:58:06.225649 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:58:06.225649 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:58:06.225649 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:58:06.226581 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:58:06.226581 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:58:06.226581 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:58:06.226581 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:58:06.226581 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:58:06.226581 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:58:06.226581 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:58:06.226581 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:58:06.226581 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:58:06.226581 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:58:06.226581 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 23 20:58:06.226581 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:58:06.226581 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 334/668] 10.222.0.17 () {56 vars in 1102 bytes} [Sat Jul 23 20:58:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:58:06.227364 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-ebb96c7a-e9e7-48c6-bebc-3560db0b129d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:58:06.227364 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:58:06.227364 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:58:06.227364 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:58:06.227364 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:58:06.227364 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:58:06.227364 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:58:06.227364 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:58:06.227364 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:58:06.227364 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:58:06.227364 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:58:06.227364 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:58:06.227364 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 23 20:58:06.227364 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 23 20:58:06.227364 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 23 20:58:06.228150 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 23 20:58:06.228150 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:58:06.228150 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:58:06.228150 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:58:06.228150 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:58:06.228150 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:58:06.228150 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:58:06.228150 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:58:06.228150 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application with Lock( Jul 23 20:58:06.228150 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:58:06.228150 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:58:06.228150 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:58:06.228150 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:58:06.228150 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:58:06.228150 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:58:06.228150 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:58:06.228150 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:58:06.229099 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 23 20:58:06.229099 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 23 20:58:06.229099 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:58:06.229099 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 20:58:06.229337 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbda715-4246-4e61-8c76-d9cfc0432dc2 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:06.230240 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 335/669] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 23 20:58:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:58:06.230855 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb96c7a-e9e7-48c6-bebc-3560db0b129d None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:06.297656 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:06.302434 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:06.344640 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbda715-4246-4e61-8c76-d9cfc0432dc2 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:06.351879 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb96c7a-e9e7-48c6-bebc-3560db0b129d None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:06.380674 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d401306-76f6-457c-bb2f-e421fe5aef06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:06.381336 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d401306-76f6-457c-bb2f-e421fe5aef06 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:06.381622 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d401306-76f6-457c-bb2f-e421fe5aef06 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:06.381900 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d401306-76f6-457c-bb2f-e421fe5aef06 None admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:06.382628 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d401306-76f6-457c-bb2f-e421fe5aef06 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:06.382924 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d401306-76f6-457c-bb2f-e421fe5aef06 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:06.384307 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d401306-76f6-457c-bb2f-e421fe5aef06 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:06.386866 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb3ed9f-d6a7-4ea3-b6b0-263dc9ccb5d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:06.387686 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb3ed9f-d6a7-4ea3-b6b0-263dc9ccb5d7 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:06.387963 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb3ed9f-d6a7-4ea3-b6b0-263dc9ccb5d7 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:06.388234 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb3ed9f-d6a7-4ea3-b6b0-263dc9ccb5d7 None admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:06.389030 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb3ed9f-d6a7-4ea3-b6b0-263dc9ccb5d7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:06.389373 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb3ed9f-d6a7-4ea3-b6b0-263dc9ccb5d7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:06.390847 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb3ed9f-d6a7-4ea3-b6b0-263dc9ccb5d7 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:06.402250 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 335/670] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 23 20:58:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:58:06.402250 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59884af3-dc08-443c-b693-f901b8d6f7d3 None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:06.402250 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59884af3-dc08-443c-b693-f901b8d6f7d3 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:06.402250 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59884af3-dc08-443c-b693-f901b8d6f7d3 None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:06.402250 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 336/671] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:58:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:58:06.402250 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59884af3-dc08-443c-b693-f901b8d6f7d3 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:06.408350 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 336/672] 10.222.0.17 () {56 vars in 1148 bytes} [Sat Jul 23 20:58:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:58:06.408350 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb3ed9f-d6a7-4ea3-b6b0-263dc9ccb5d7 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:06.514398 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59884af3-dc08-443c-b693-f901b8d6f7d3 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:06.520048 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb3ed9f-d6a7-4ea3-b6b0-263dc9ccb5d7 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:06.533098 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:06.538985 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:06.552209 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15089814-6041-4ae7-991c-36e7b8e20b68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:06.552829 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15089814-6041-4ae7-991c-36e7b8e20b68 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:06.553123 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15089814-6041-4ae7-991c-36e7b8e20b68 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:06.553381 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15089814-6041-4ae7-991c-36e7b8e20b68 None admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:06.554163 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15089814-6041-4ae7-991c-36e7b8e20b68 None admin] RBAC: Adding query filter params (name=service) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:06.554459 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15089814-6041-4ae7-991c-36e7b8e20b68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:06.555896 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15089814-6041-4ae7-991c-36e7b8e20b68 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:06.558079 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e780376-8253-4444-9152-9bfea889e6da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:06.558738 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e780376-8253-4444-9152-9bfea889e6da None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:06.559015 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e780376-8253-4444-9152-9bfea889e6da None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:06.559283 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e780376-8253-4444-9152-9bfea889e6da None admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:06.560001 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e780376-8253-4444-9152-9bfea889e6da None admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:06.560303 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e780376-8253-4444-9152-9bfea889e6da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:06.561706 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e780376-8253-4444-9152-9bfea889e6da None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:06.564644 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 337/673] 10.222.0.17 () {56 vars in 1103 bytes} [Sat Jul 23 20:58:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:58:06.565474 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15089814-6041-4ae7-991c-36e7b8e20b68 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:06.577128 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 337/674] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 23 20:58:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:58:06.579147 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2a41fa-a390-413a-8fdd-bfb75ada44d9 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:06.579500 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2a41fa-a390-413a-8fdd-bfb75ada44d9 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:06.579828 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2a41fa-a390-413a-8fdd-bfb75ada44d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:06.597482 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-ad2a41fa-a390-413a-8fdd-bfb75ada44d9 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:58:06.598724 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-ad2a41fa-a390-413a-8fdd-bfb75ada44d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:58:06.671185 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 338/675] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:58:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 23 20:58:06.672057 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2a41fa-a390-413a-8fdd-bfb75ada44d9 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:06.673756 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15089814-6041-4ae7-991c-36e7b8e20b68 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:06.721340 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b676f89-3b00-40f0-b5fa-df674f1dfc46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:06.722231 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b676f89-3b00-40f0-b5fa-df674f1dfc46 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:06.722548 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b676f89-3b00-40f0-b5fa-df674f1dfc46 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:06.722820 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b676f89-3b00-40f0-b5fa-df674f1dfc46 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:06.730003 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b676f89-3b00-40f0-b5fa-df674f1dfc46 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:06.731463 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b676f89-3b00-40f0-b5fa-df674f1dfc46 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:06.746226 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-2b676f89-3b00-40f0-b5fa-df674f1dfc46 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 23 20:58:06.746226 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:58:06.746226 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:58:06.746226 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:58:06.746226 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:58:06.746226 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:58:06.746226 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:58:06.746226 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:58:06.746226 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:58:06.746226 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:58:06.746226 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:58:06.746226 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:58:06.746226 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 23 20:58:06.746226 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 23 20:58:06.746226 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 23 20:58:06.747553 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 23 20:58:06.747553 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:58:06.747553 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:58:06.747553 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:58:06.747553 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:58:06.747553 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:58:06.747553 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:58:06.747553 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:58:06.747553 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application with Lock( Jul 23 20:58:06.747553 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:58:06.747553 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:58:06.747553 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:58:06.747553 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:58:06.747553 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:58:06.747553 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:58:06.747553 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:58:06.747553 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:58:06.748519 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 23 20:58:06.748519 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 23 20:58:06.748519 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 23 20:58:06.748519 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 23 20:58:06.748519 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 23 20:58:06.748519 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 23 20:58:06.748519 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 23 20:58:06.748519 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:58:06.748519 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 338/676] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Jul 23 20:58:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:58:06.748519 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b676f89-3b00-40f0-b5fa-df674f1dfc46 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:06.795080 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:06.803066 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2a41fa-a390-413a-8fdd-bfb75ada44d9 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:06.812993 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:06.842383 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e678739-e3f2-41b9-8b6e-2e7f494842b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:06.843049 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e678739-e3f2-41b9-8b6e-2e7f494842b4 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:06.843325 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e678739-e3f2-41b9-8b6e-2e7f494842b4 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:06.843616 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e678739-e3f2-41b9-8b6e-2e7f494842b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:06.844414 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e678739-e3f2-41b9-8b6e-2e7f494842b4 None admin] RBAC: Adding query filter params (role.id=abf9f3b81f3647dbb70c44d0aedaa614, scope.project.id=4804ed61295f4d4a92d9b685dd9e9f3b, user.id=c497326ee890462e8f48b4a56f81990c) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:06.844719 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e678739-e3f2-41b9-8b6e-2e7f494842b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:06.846210 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e678739-e3f2-41b9-8b6e-2e7f494842b4 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:06.852253 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 339/677] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Jul 23 20:58:06 2022] GET /identity/v3/role_assignments?user.id=c497326ee890462e8f48b4a56f81990c&scope.project.id=4804ed61295f4d4a92d9b685dd9e9f3b&role.id=abf9f3b81f3647dbb70c44d0aedaa614 => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:58:06.853040 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e678739-e3f2-41b9-8b6e-2e7f494842b4 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:06.868126 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b676f89-3b00-40f0-b5fa-df674f1dfc46 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:06.914343 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f986f88c-ee5e-4ec8-a4d6-c95a53472d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:06.915185 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f986f88c-ee5e-4ec8-a4d6-c95a53472d84 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:06.915469 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f986f88c-ee5e-4ec8-a4d6-c95a53472d84 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:06.915746 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f986f88c-ee5e-4ec8-a4d6-c95a53472d84 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:06.928556 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f986f88c-ee5e-4ec8-a4d6-c95a53472d84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:06.930095 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f986f88c-ee5e-4ec8-a4d6-c95a53472d84 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:06.951642 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-f986f88c-ee5e-4ec8-a4d6-c95a53472d84 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:58:06.951642 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:58:06.951642 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:58:06.951642 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:58:06.951642 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:58:06.951642 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:58:06.951642 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:58:06.951642 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:58:06.951642 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:58:06.951642 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:58:06.951642 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:58:06.951642 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:58:06.951642 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 23 20:58:06.951642 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 23 20:58:06.951642 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 23 20:58:06.953578 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 23 20:58:06.953578 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:58:06.953578 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:58:06.953578 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:58:06.953578 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:58:06.953578 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:58:06.953578 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:58:06.953578 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:58:06.953578 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application with Lock( Jul 23 20:58:06.953578 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:58:06.953578 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:58:06.953578 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:58:06.953578 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:58:06.953578 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:58:06.953578 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:58:06.953578 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:58:06.953578 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:58:06.955370 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 23 20:58:06.955370 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 23 20:58:06.955370 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:58:06.955370 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:58:06.955370 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 339/678] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 23 20:58:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:58:06.955370 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f986f88c-ee5e-4ec8-a4d6-c95a53472d84 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:07.005509 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e678739-e3f2-41b9-8b6e-2e7f494842b4 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:07.047554 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afb527c-4753-4e35-b189-950762f4cf2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:07.047554 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afb527c-4753-4e35-b189-950762f4cf2d None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:07.047554 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afb527c-4753-4e35-b189-950762f4cf2d None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:07.047903 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afb527c-4753-4e35-b189-950762f4cf2d None admin] PATH_INFO: `/v3/projects/service` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:07.055343 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afb527c-4753-4e35-b189-950762f4cf2d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:07.056809 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afb527c-4753-4e35-b189-950762f4cf2d None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:07.073275 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-0afb527c-4753-4e35-b189-950762f4cf2d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 23 20:58:07.073275 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:58:07.073275 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:58:07.073275 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:58:07.073275 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:58:07.073275 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:58:07.073275 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:58:07.073275 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:58:07.073275 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:58:07.073275 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:58:07.073275 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:58:07.073275 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:58:07.073275 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 23 20:58:07.073275 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 23 20:58:07.073275 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 23 20:58:07.074393 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 23 20:58:07.074393 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:58:07.074393 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:58:07.074393 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:58:07.074393 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:58:07.074393 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:58:07.074393 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:58:07.074393 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:58:07.074393 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application with Lock( Jul 23 20:58:07.074393 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:58:07.074393 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:58:07.074393 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:58:07.074393 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:58:07.074393 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:58:07.074393 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:58:07.074393 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:58:07.074393 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:58:07.075536 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 23 20:58:07.075536 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 23 20:58:07.075536 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 23 20:58:07.075536 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 23 20:58:07.075536 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 23 20:58:07.075536 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 23 20:58:07.075536 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 23 20:58:07.075536 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 20:58:07.075536 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 340/679] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Jul 23 20:58:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:58:07.076057 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afb527c-4753-4e35-b189-950762f4cf2d None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:07.111808 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:07.117938 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:07.123012 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f986f88c-ee5e-4ec8-a4d6-c95a53472d84 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:07.172132 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7232a9ee-49f1-4407-83cb-a0be2cc96fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:07.173072 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7232a9ee-49f1-4407-83cb-a0be2cc96fa2 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:07.173418 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7232a9ee-49f1-4407-83cb-a0be2cc96fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:07.173754 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7232a9ee-49f1-4407-83cb-a0be2cc96fa2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:07.187580 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7232a9ee-49f1-4407-83cb-a0be2cc96fa2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:58:07.195422 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-7232a9ee-49f1-4407-83cb-a0be2cc96fa2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 23 20:58:07.195422 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:58:07.195422 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:58:07.195422 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:58:07.195422 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:58:07.195422 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:58:07.195422 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:58:07.195422 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:58:07.195422 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:58:07.195422 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:58:07.195422 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:58:07.195422 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:58:07.195422 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:58:07.195422 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:58:07.195422 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:58:07.195422 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:58:07.196640 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:58:07.196640 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:58:07.196640 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:58:07.196640 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:58:07.196640 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:58:07.196640 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:58:07.196640 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:58:07.196640 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:58:07.196640 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:58:07.196640 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:58:07.196640 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:58:07.196640 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application with Lock( Jul 23 20:58:07.196640 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:58:07.196640 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:58:07.196640 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:58:07.196640 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:58:07.197691 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:58:07.197691 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:58:07.197691 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:58:07.197691 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:58:07.197691 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:58:07.197691 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:58:07.197691 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:58:07.197691 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:58:07.197691 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:58:07.197691 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:58:07.197691 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 23 20:58:07.197691 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:58:07.198756 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 340/680] 10.222.0.17 () {56 vars in 1096 bytes} [Sat Jul 23 20:58:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:58:07.199451 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7232a9ee-49f1-4407-83cb-a0be2cc96fa2 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:07.217335 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afb527c-4753-4e35-b189-950762f4cf2d None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:07.259983 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b5ec67-aac3-49ed-82fb-b4e6c6909898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:07.260694 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b5ec67-aac3-49ed-82fb-b4e6c6909898 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:07.261058 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b5ec67-aac3-49ed-82fb-b4e6c6909898 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:07.261219 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b5ec67-aac3-49ed-82fb-b4e6c6909898 None admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:07.262043 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b5ec67-aac3-49ed-82fb-b4e6c6909898 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:07.262515 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b5ec67-aac3-49ed-82fb-b4e6c6909898 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:07.263798 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b5ec67-aac3-49ed-82fb-b4e6c6909898 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:07.277823 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 341/681] 10.222.0.17 () {56 vars in 1148 bytes} [Sat Jul 23 20:58:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:58:07.284032 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b5ec67-aac3-49ed-82fb-b4e6c6909898 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:07.324031 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7232a9ee-49f1-4407-83cb-a0be2cc96fa2 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:07.367033 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c650c58-2366-4f13-b2b2-ef36a96e6c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:07.368262 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c650c58-2366-4f13-b2b2-ef36a96e6c77 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:07.368706 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c650c58-2366-4f13-b2b2-ef36a96e6c77 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:07.369129 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c650c58-2366-4f13-b2b2-ef36a96e6c77 None admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:07.370494 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c650c58-2366-4f13-b2b2-ef36a96e6c77 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:07.370989 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c650c58-2366-4f13-b2b2-ef36a96e6c77 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:07.373503 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c650c58-2366-4f13-b2b2-ef36a96e6c77 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:07.393530 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 341/682] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 23 20:58:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:58:07.394876 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c650c58-2366-4f13-b2b2-ef36a96e6c77 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:07.400398 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:07.414169 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b5ec67-aac3-49ed-82fb-b4e6c6909898 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:07.414408 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:07.461693 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b48fd6a-8547-40b0-a114-942fb3c047bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:07.462989 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b48fd6a-8547-40b0-a114-942fb3c047bc None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:07.463395 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b48fd6a-8547-40b0-a114-942fb3c047bc None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:07.463815 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b48fd6a-8547-40b0-a114-942fb3c047bc None admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:07.464942 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b48fd6a-8547-40b0-a114-942fb3c047bc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:07.465503 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b48fd6a-8547-40b0-a114-942fb3c047bc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:07.467029 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b48fd6a-8547-40b0-a114-942fb3c047bc None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:07.490729 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 342/683] 10.222.0.17 () {56 vars in 1148 bytes} [Sat Jul 23 20:58:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:58:07.490729 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b48fd6a-8547-40b0-a114-942fb3c047bc None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:07.504335 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c650c58-2366-4f13-b2b2-ef36a96e6c77 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:07.552883 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e657b834-c779-4d44-8c9e-277e13b1d94e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:07.553574 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e657b834-c779-4d44-8c9e-277e13b1d94e None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:07.553849 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e657b834-c779-4d44-8c9e-277e13b1d94e None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:07.554147 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e657b834-c779-4d44-8c9e-277e13b1d94e None admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:07.554905 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e657b834-c779-4d44-8c9e-277e13b1d94e None admin] RBAC: Adding query filter params (name=admin) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:07.555205 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e657b834-c779-4d44-8c9e-277e13b1d94e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:07.556600 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e657b834-c779-4d44-8c9e-277e13b1d94e None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:07.566329 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 342/684] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Jul 23 20:58:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:58:07.567003 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e657b834-c779-4d44-8c9e-277e13b1d94e None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:07.628887 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b48fd6a-8547-40b0-a114-942fb3c047bc None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:07.657145 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:07.678022 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6866724c-e7d2-48b3-bdba-05f3d902017a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:07.678857 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6866724c-e7d2-48b3-bdba-05f3d902017a None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:07.679115 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6866724c-e7d2-48b3-bdba-05f3d902017a None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:07.679587 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6866724c-e7d2-48b3-bdba-05f3d902017a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:07.681017 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6866724c-e7d2-48b3-bdba-05f3d902017a None admin] RBAC: Adding query filter params (role.id=abf9f3b81f3647dbb70c44d0aedaa614, scope.project.id=4804ed61295f4d4a92d9b685dd9e9f3b, user.id=f7f2db148c8e4d5d81431cae3576434b) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:07.681334 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6866724c-e7d2-48b3-bdba-05f3d902017a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:07.682792 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e657b834-c779-4d44-8c9e-277e13b1d94e None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:07.682950 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6866724c-e7d2-48b3-bdba-05f3d902017a None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:07.706138 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 343/685] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Jul 23 20:58:07 2022] GET /identity/v3/role_assignments?user.id=f7f2db148c8e4d5d81431cae3576434b&scope.project.id=4804ed61295f4d4a92d9b685dd9e9f3b&role.id=abf9f3b81f3647dbb70c44d0aedaa614 => generated 608 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:58:07.707203 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6866724c-e7d2-48b3-bdba-05f3d902017a None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:07.733369 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc926bc-43b2-4b10-a01f-9841fd3307b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:07.734259 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc926bc-43b2-4b10-a01f-9841fd3307b8 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:07.734536 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc926bc-43b2-4b10-a01f-9841fd3307b8 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:07.734802 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc926bc-43b2-4b10-a01f-9841fd3307b8 None admin] PATH_INFO: `/v3/users/swift` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:07.744979 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc926bc-43b2-4b10-a01f-9841fd3307b8 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:07.746542 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc926bc-43b2-4b10-a01f-9841fd3307b8 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:07.750325 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:07.769224 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-1cc926bc-43b2-4b10-a01f-9841fd3307b8 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 23 20:58:07.769224 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:58:07.769224 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:58:07.769224 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:58:07.769224 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:58:07.769224 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:58:07.769224 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:58:07.769224 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:58:07.769224 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:58:07.769224 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:58:07.769224 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:58:07.769224 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:58:07.769224 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 23 20:58:07.769224 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 23 20:58:07.769224 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 23 20:58:07.769224 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 23 20:58:07.770331 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:58:07.770331 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:58:07.770331 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 23 20:58:07.770331 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 23 20:58:07.770331 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 23 20:58:07.770331 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 23 20:58:07.770331 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:58:07.770331 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:58:07.770331 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:58:07.770331 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:58:07.770331 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:58:07.770331 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application with Lock( Jul 23 20:58:07.770331 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:58:07.770331 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:58:07.770331 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:58:07.770331 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:58:07.770331 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:58:07.770331 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:58:07.771266 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:58:07.771266 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:58:07.771266 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 23 20:58:07.771266 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 23 20:58:07.771266 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 23 20:58:07.771266 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 23 20:58:07.771266 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 23 20:58:07.771266 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 23 20:58:07.771266 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 23 20:58:07.771266 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:58:07.775730 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 343/686] 10.222.0.17 () {56 vars in 1096 bytes} [Sat Jul 23 20:58:07 2022] GET /identity/v3/users/swift => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:58:07.776770 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc926bc-43b2-4b10-a01f-9841fd3307b8 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:07.878195 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6866724c-e7d2-48b3-bdba-05f3d902017a None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:07.920996 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc926bc-43b2-4b10-a01f-9841fd3307b8 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:07.929173 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c82d232-8bb8-4114-9eb1-13d943a6b2ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:07.929851 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c82d232-8bb8-4114-9eb1-13d943a6b2ac None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:07.930153 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c82d232-8bb8-4114-9eb1-13d943a6b2ac None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:07.930425 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c82d232-8bb8-4114-9eb1-13d943a6b2ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:07.931261 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c82d232-8bb8-4114-9eb1-13d943a6b2ac None admin] RBAC: Adding query filter params (role.id=abf9f3b81f3647dbb70c44d0aedaa614, scope.project.id=4804ed61295f4d4a92d9b685dd9e9f3b, user.id=ec5fd3a489c341b7964704d689037f05) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:07.931609 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c82d232-8bb8-4114-9eb1-13d943a6b2ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:07.933011 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c82d232-8bb8-4114-9eb1-13d943a6b2ac None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:07.944546 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 344/687] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Jul 23 20:58:07 2022] GET /identity/v3/role_assignments?user.id=ec5fd3a489c341b7964704d689037f05&scope.project.id=4804ed61295f4d4a92d9b685dd9e9f3b&role.id=abf9f3b81f3647dbb70c44d0aedaa614 => generated 608 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:58:07.944546 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c82d232-8bb8-4114-9eb1-13d943a6b2ac None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:07.981826 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd4b872-5a16-4832-8042-f013fd81cd09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:07.983383 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd4b872-5a16-4832-8042-f013fd81cd09 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:07.983383 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd4b872-5a16-4832-8042-f013fd81cd09 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:07.983563 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd4b872-5a16-4832-8042-f013fd81cd09 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:07.994153 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:08.001234 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd4b872-5a16-4832-8042-f013fd81cd09 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:08.004375 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd4b872-5a16-4832-8042-f013fd81cd09 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:08.033738 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-edd4b872-5a16-4832-8042-f013fd81cd09 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:58:08.033738 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:58:08.033738 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:58:08.033738 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:58:08.033738 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:58:08.033738 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:58:08.033738 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:58:08.033738 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:58:08.033738 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:58:08.033738 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:58:08.033738 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:58:08.033738 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:58:08.033738 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 23 20:58:08.033738 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 23 20:58:08.033738 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 23 20:58:08.034949 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 23 20:58:08.034949 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:58:08.034949 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:58:08.034949 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:58:08.034949 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:58:08.034949 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:58:08.034949 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:58:08.034949 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:58:08.034949 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application with Lock( Jul 23 20:58:08.034949 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:58:08.034949 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:58:08.034949 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:58:08.034949 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:58:08.034949 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:58:08.034949 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:58:08.034949 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:58:08.034949 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:58:08.035849 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 23 20:58:08.035849 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 23 20:58:08.035849 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:58:08.035849 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:58:08.036386 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 344/688] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 23 20:58:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:58:08.042637 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd4b872-5a16-4832-8042-f013fd81cd09 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:08.094546 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:08.119967 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c82d232-8bb8-4114-9eb1-13d943a6b2ac None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:08.169264 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37034de-0a53-4659-92e9-0c4f41d1404d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:08.170829 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37034de-0a53-4659-92e9-0c4f41d1404d None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:08.170829 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37034de-0a53-4659-92e9-0c4f41d1404d None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:08.170829 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37034de-0a53-4659-92e9-0c4f41d1404d None admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:08.171518 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37034de-0a53-4659-92e9-0c4f41d1404d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:08.171634 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37034de-0a53-4659-92e9-0c4f41d1404d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:08.174203 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37034de-0a53-4659-92e9-0c4f41d1404d None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:08.199750 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 345/689] 10.222.0.17 () {56 vars in 1135 bytes} [Sat Jul 23 20:58:07 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:58:08.205498 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37034de-0a53-4659-92e9-0c4f41d1404d None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:08.211668 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd4b872-5a16-4832-8042-f013fd81cd09 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:08.265202 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7963a686-faa5-4eab-b215-7b37c68678f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:08.266225 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7963a686-faa5-4eab-b215-7b37c68678f6 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:08.266561 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7963a686-faa5-4eab-b215-7b37c68678f6 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:08.266795 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7963a686-faa5-4eab-b215-7b37c68678f6 None admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:08.267796 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7963a686-faa5-4eab-b215-7b37c68678f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:08.268104 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7963a686-faa5-4eab-b215-7b37c68678f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:08.269609 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7963a686-faa5-4eab-b215-7b37c68678f6 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:08.288442 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 345/690] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 23 20:58:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:58:08.293894 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7963a686-faa5-4eab-b215-7b37c68678f6 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:08.337201 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37034de-0a53-4659-92e9-0c4f41d1404d None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:08.344081 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:08.375774 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a7defc-d924-498f-9042-9154851eb5fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:08.376488 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a7defc-d924-498f-9042-9154851eb5fd None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:08.376773 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a7defc-d924-498f-9042-9154851eb5fd None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:08.377037 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a7defc-d924-498f-9042-9154851eb5fd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:08.386408 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:08.404543 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7963a686-faa5-4eab-b215-7b37c68678f6 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:08.440835 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477b6aa6-4325-4d84-908f-691a2f11dda7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:08.441703 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477b6aa6-4325-4d84-908f-691a2f11dda7 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:08.442010 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477b6aa6-4325-4d84-908f-691a2f11dda7 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:08.442279 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477b6aa6-4325-4d84-908f-691a2f11dda7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:08.450975 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477b6aa6-4325-4d84-908f-691a2f11dda7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:08.452445 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477b6aa6-4325-4d84-908f-691a2f11dda7 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:08.454621 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a7defc-d924-498f-9042-9154851eb5fd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:08.456075 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a7defc-d924-498f-9042-9154851eb5fd None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:08.469164 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-477b6aa6-4325-4d84-908f-691a2f11dda7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 23 20:58:08.469164 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:58:08.469164 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:58:08.469164 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:58:08.469164 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:58:08.469164 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:58:08.469164 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:58:08.469164 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:58:08.469164 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:58:08.469164 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:58:08.469164 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:58:08.469164 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:58:08.469164 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 23 20:58:08.469164 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 23 20:58:08.469164 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 23 20:58:08.469164 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 23 20:58:08.470215 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:58:08.470215 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:58:08.470215 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 23 20:58:08.470215 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 23 20:58:08.470215 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 23 20:58:08.470215 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 23 20:58:08.470215 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:58:08.470215 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:58:08.470215 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:58:08.470215 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:58:08.470215 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:58:08.470215 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application with Lock( Jul 23 20:58:08.470215 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:58:08.470215 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:58:08.470215 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:58:08.470215 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:58:08.470215 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:58:08.470215 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:58:08.471150 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:58:08.471150 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:58:08.471150 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 23 20:58:08.471150 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 23 20:58:08.471150 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 23 20:58:08.471150 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 23 20:58:08.471150 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 23 20:58:08.471150 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 23 20:58:08.471150 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 23 20:58:08.471150 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:58:08.471685 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 346/691] 10.222.0.17 () {56 vars in 1093 bytes} [Sat Jul 23 20:58:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 23 20:58:08.477833 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477b6aa6-4325-4d84-908f-691a2f11dda7 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:08.594175 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 346/692] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Jul 23 20:58:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 23 20:58:08.600983 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a7defc-d924-498f-9042-9154851eb5fd None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:08.626552 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477b6aa6-4325-4d84-908f-691a2f11dda7 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:08.641612 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:08.673896 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:08.684745 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6f3579-b139-4f4f-9571-49d81f04f970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:08.690404 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6f3579-b139-4f4f-9571-49d81f04f970 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:08.690727 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6f3579-b139-4f4f-9571-49d81f04f970 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:08.691113 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6f3579-b139-4f4f-9571-49d81f04f970 None admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:08.691946 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6f3579-b139-4f4f-9571-49d81f04f970 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:08.692256 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6f3579-b139-4f4f-9571-49d81f04f970 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:08.693732 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6f3579-b139-4f4f-9571-49d81f04f970 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:08.733829 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 347/693] 10.222.0.17 () {56 vars in 1133 bytes} [Sat Jul 23 20:58:08 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:58:08.746961 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6f3579-b139-4f4f-9571-49d81f04f970 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:08.752100 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a7defc-d924-498f-9042-9154851eb5fd None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:08.792148 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7fa700-22ad-497e-b4f6-a346094850b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:08.792964 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7fa700-22ad-497e-b4f6-a346094850b9 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:08.793237 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7fa700-22ad-497e-b4f6-a346094850b9 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:08.793497 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7fa700-22ad-497e-b4f6-a346094850b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:08.812694 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7fa700-22ad-497e-b4f6-a346094850b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:08.814255 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7fa700-22ad-497e-b4f6-a346094850b9 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:08.855239 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-5c7fa700-22ad-497e-b4f6-a346094850b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:58:08.855239 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:58:08.855239 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:58:08.855239 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:58:08.855239 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:58:08.855239 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:58:08.855239 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:58:08.855239 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:58:08.855239 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:58:08.855239 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:58:08.855239 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:58:08.855239 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:58:08.855239 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 23 20:58:08.855239 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 23 20:58:08.855239 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 23 20:58:08.856203 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 23 20:58:08.856203 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:58:08.856203 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:58:08.856203 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:58:08.856203 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:58:08.856203 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:58:08.856203 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:58:08.856203 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:58:08.856203 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application with Lock( Jul 23 20:58:08.856203 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:58:08.856203 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:58:08.856203 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:58:08.856203 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:58:08.856203 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:58:08.856203 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:58:08.856203 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:58:08.856203 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:58:08.857102 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 23 20:58:08.857102 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 23 20:58:08.857102 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:58:08.857102 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 20:58:08.861899 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 347/694] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 23 20:58:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 23 20:58:08.862233 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7fa700-22ad-497e-b4f6-a346094850b9 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:08.969235 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6f3579-b139-4f4f-9571-49d81f04f970 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:09.033801 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6a931a-c62c-45f4-8413-5e6ece0bdd9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:09.034482 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6a931a-c62c-45f4-8413-5e6ece0bdd9c None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:09.034822 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6a931a-c62c-45f4-8413-5e6ece0bdd9c None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:09.035093 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6a931a-c62c-45f4-8413-5e6ece0bdd9c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:09.036003 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:09.047991 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7fa700-22ad-497e-b4f6-a346094850b9 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:09.083792 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5aecda0-71b8-4e92-b34e-a3e534bf7c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:09.084939 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aecda0-71b8-4e92-b34e-a3e534bf7c57 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:09.085242 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aecda0-71b8-4e92-b34e-a3e534bf7c57 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:09.085515 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aecda0-71b8-4e92-b34e-a3e534bf7c57 None admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:09.086304 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5aecda0-71b8-4e92-b34e-a3e534bf7c57 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:09.086603 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5aecda0-71b8-4e92-b34e-a3e534bf7c57 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:09.087971 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5aecda0-71b8-4e92-b34e-a3e534bf7c57 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:09.105136 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 348/695] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 23 20:58:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:58:09.109403 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5aecda0-71b8-4e92-b34e-a3e534bf7c57 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:09.112256 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:09.195655 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6a931a-c62c-45f4-8413-5e6ece0bdd9c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:09.195655 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6a931a-c62c-45f4-8413-5e6ece0bdd9c None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:09.302637 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5aecda0-71b8-4e92-b34e-a3e534bf7c57 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:09.306400 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 348/696] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Jul 23 20:58:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 565 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 23 20:58:09.315855 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6a931a-c62c-45f4-8413-5e6ece0bdd9c None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:09.360753 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dd855e-205f-4f2e-b42c-1c2f021eb66f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:09.361690 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dd855e-205f-4f2e-b42c-1c2f021eb66f None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:09.362011 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dd855e-205f-4f2e-b42c-1c2f021eb66f None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:09.362286 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dd855e-205f-4f2e-b42c-1c2f021eb66f None admin] PATH_INFO: `/v3/projects/service` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:09.370283 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dd855e-205f-4f2e-b42c-1c2f021eb66f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:09.371948 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dd855e-205f-4f2e-b42c-1c2f021eb66f None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:09.384070 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:09.389579 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-88dd855e-205f-4f2e-b42c-1c2f021eb66f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 23 20:58:09.389579 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:58:09.389579 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:58:09.389579 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:58:09.389579 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:58:09.389579 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:58:09.389579 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:58:09.389579 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:58:09.389579 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:58:09.389579 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:58:09.389579 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:58:09.389579 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:58:09.389579 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 23 20:58:09.389579 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 23 20:58:09.389579 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 23 20:58:09.390671 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 23 20:58:09.390671 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:58:09.390671 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:58:09.390671 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:58:09.390671 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:58:09.390671 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:58:09.390671 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:58:09.390671 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:58:09.390671 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application with Lock( Jul 23 20:58:09.390671 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:58:09.390671 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:58:09.390671 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:58:09.390671 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:58:09.390671 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:58:09.390671 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:58:09.390671 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:58:09.390671 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:58:09.391543 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 23 20:58:09.391543 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 23 20:58:09.391543 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 23 20:58:09.391543 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 23 20:58:09.391543 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 23 20:58:09.391543 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 23 20:58:09.391543 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 23 20:58:09.391543 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 20:58:09.391543 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 349/697] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Jul 23 20:58:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:58:09.392364 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a6ecc3-2156-4e17-ac0d-2d90c30327d2 None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:09.392516 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a6ecc3-2156-4e17-ac0d-2d90c30327d2 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:09.392657 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a6ecc3-2156-4e17-ac0d-2d90c30327d2 None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:09.398499 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 350/698] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:58:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:58:09.399843 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0636e3fe-bafd-4491-8d89-e2e2bed5e8dc None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:09.400128 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0636e3fe-bafd-4491-8d89-e2e2bed5e8dc None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:09.400401 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0636e3fe-bafd-4491-8d89-e2e2bed5e8dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:09.418631 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-0636e3fe-bafd-4491-8d89-e2e2bed5e8dc None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:58:09.419841 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-0636e3fe-bafd-4491-8d89-e2e2bed5e8dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:58:09.429624 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:09.436046 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6a931a-c62c-45f4-8413-5e6ece0bdd9c None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:09.479563 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8643aa91-eb40-4f50-9f31-dc185b20f8e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:09.481183 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8643aa91-eb40-4f50-9f31-dc185b20f8e1 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:09.481912 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8643aa91-eb40-4f50-9f31-dc185b20f8e1 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:09.482389 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8643aa91-eb40-4f50-9f31-dc185b20f8e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:09.495673 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8643aa91-eb40-4f50-9f31-dc185b20f8e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:09.497616 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8643aa91-eb40-4f50-9f31-dc185b20f8e1 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:09.502169 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 351/699] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:58:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 23 20:58:09.503103 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0636e3fe-bafd-4491-8d89-e2e2bed5e8dc None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:09.519445 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-8643aa91-eb40-4f50-9f31-dc185b20f8e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:58:09.519445 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:58:09.519445 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:58:09.519445 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:58:09.519445 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:58:09.519445 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:58:09.519445 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:58:09.519445 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:58:09.519445 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:58:09.519445 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:58:09.519445 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:58:09.519445 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:58:09.519445 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 23 20:58:09.519445 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 23 20:58:09.519445 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 23 20:58:09.520522 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 23 20:58:09.520522 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:58:09.520522 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:58:09.520522 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:58:09.520522 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:58:09.520522 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:58:09.520522 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:58:09.520522 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:58:09.520522 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application with Lock( Jul 23 20:58:09.520522 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:58:09.520522 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:58:09.520522 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:58:09.520522 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:58:09.520522 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:58:09.520522 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:58:09.520522 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:58:09.520522 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:58:09.521402 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 23 20:58:09.521402 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 23 20:58:09.521402 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:58:09.521402 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:58:09.524364 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 349/700] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 23 20:58:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:58:09.530715 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8643aa91-eb40-4f50-9f31-dc185b20f8e1 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:09.635145 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0636e3fe-bafd-4491-8d89-e2e2bed5e8dc None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:09.644409 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8643aa91-eb40-4f50-9f31-dc185b20f8e1 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:09.663027 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:09.677332 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e53ed1-9b8b-444d-b1cb-8fa252d18451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:09.678340 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e53ed1-9b8b-444d-b1cb-8fa252d18451 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:09.678769 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e53ed1-9b8b-444d-b1cb-8fa252d18451 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:09.679293 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e53ed1-9b8b-444d-b1cb-8fa252d18451 None admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:09.680495 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e53ed1-9b8b-444d-b1cb-8fa252d18451 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:09.681015 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e53ed1-9b8b-444d-b1cb-8fa252d18451 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:09.682703 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59617b36-57c5-44be-bb24-f8e8d34ac6fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:09.683095 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e53ed1-9b8b-444d-b1cb-8fa252d18451 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:09.683513 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59617b36-57c5-44be-bb24-f8e8d34ac6fb None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:09.683855 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59617b36-57c5-44be-bb24-f8e8d34ac6fb None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:09.684187 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59617b36-57c5-44be-bb24-f8e8d34ac6fb None admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:09.685030 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59617b36-57c5-44be-bb24-f8e8d34ac6fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:09.685396 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59617b36-57c5-44be-bb24-f8e8d34ac6fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:09.687061 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59617b36-57c5-44be-bb24-f8e8d34ac6fb None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:09.694004 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:09.701815 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 350/701] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 23 20:58:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 20:58:09.703205 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59617b36-57c5-44be-bb24-f8e8d34ac6fb None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:09.706878 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 352/702] 10.222.0.17 () {56 vars in 1148 bytes} [Sat Jul 23 20:58:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:58:09.709963 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e53ed1-9b8b-444d-b1cb-8fa252d18451 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:09.854049 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59617b36-57c5-44be-bb24-f8e8d34ac6fb None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:09.874973 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e53ed1-9b8b-444d-b1cb-8fa252d18451 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:09.897374 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89930597-7b58-4481-bfc1-64c4871220ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:09.898347 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89930597-7b58-4481-bfc1-64c4871220ee None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:09.898634 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89930597-7b58-4481-bfc1-64c4871220ee None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:09.898950 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89930597-7b58-4481-bfc1-64c4871220ee None admin] PATH_INFO: `/v3/services/network` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:09.899614 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89930597-7b58-4481-bfc1-64c4871220ee None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:09.901322 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89930597-7b58-4481-bfc1-64c4871220ee None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:09.919268 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42fbb44-caf4-4665-bcf9-7cd7f6b7ada7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:09.919907 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-89930597-7b58-4481-bfc1-64c4871220ee None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 23 20:58:09.919907 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:58:09.919907 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 23 20:58:09.919907 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 23 20:58:09.919907 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 23 20:58:09.919907 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 23 20:58:09.919907 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 23 20:58:09.919907 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 23 20:58:09.919907 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 23 20:58:09.919907 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:58:09.919907 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 23 20:58:09.919907 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:58:09.919907 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:58:09.919907 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:58:09.919907 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:58:09.919907 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:58:09.919907 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:58:09.920869 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:58:09.920869 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:58:09.920869 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:58:09.920869 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:58:09.920869 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:58:09.920869 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:58:09.920869 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 23 20:58:09.920869 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 23 20:58:09.920869 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 23 20:58:09.920869 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 23 20:58:09.920869 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:58:09.920869 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:58:09.920869 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:58:09.920869 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:58:09.920869 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:58:09.920869 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:58:09.921948 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:58:09.921948 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application with Lock( Jul 23 20:58:09.921948 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:58:09.921948 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:58:09.921948 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:58:09.921948 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:58:09.921948 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:58:09.921948 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:58:09.921948 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:58:09.921948 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:58:09.921948 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 23 20:58:09.921948 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 23 20:58:09.921948 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 23 20:58:09.921948 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:58:09.921948 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 351/703] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Jul 23 20:58:09 2022] GET /identity/v3/services/network => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:58:09.923065 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89930597-7b58-4481-bfc1-64c4871220ee None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:09.923581 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42fbb44-caf4-4665-bcf9-7cd7f6b7ada7 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:09.923995 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42fbb44-caf4-4665-bcf9-7cd7f6b7ada7 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:09.924413 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42fbb44-caf4-4665-bcf9-7cd7f6b7ada7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:09.925816 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42fbb44-caf4-4665-bcf9-7cd7f6b7ada7 None admin] RBAC: Adding query filter params (role.id=abf9f3b81f3647dbb70c44d0aedaa614, scope.project.id=4804ed61295f4d4a92d9b685dd9e9f3b, user.id=47f0a685b7da46afb81024848f079d2f) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:09.926311 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42fbb44-caf4-4665-bcf9-7cd7f6b7ada7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:09.928850 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42fbb44-caf4-4665-bcf9-7cd7f6b7ada7 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:09.937546 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 353/704] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Jul 23 20:58:09 2022] GET /identity/v3/role_assignments?user.id=47f0a685b7da46afb81024848f079d2f&scope.project.id=4804ed61295f4d4a92d9b685dd9e9f3b&role.id=abf9f3b81f3647dbb70c44d0aedaa614 => generated 608 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:58:09.939047 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42fbb44-caf4-4665-bcf9-7cd7f6b7ada7 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:10.007782 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:10.090277 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:10.133081 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89930597-7b58-4481-bfc1-64c4871220ee None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:10.156528 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42fbb44-caf4-4665-bcf9-7cd7f6b7ada7 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:10.171081 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d79482-841a-4733-bde1-4b47454e4ddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:10.172275 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d79482-841a-4733-bde1-4b47454e4ddd None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:10.172749 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d79482-841a-4733-bde1-4b47454e4ddd None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:10.173300 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d79482-841a-4733-bde1-4b47454e4ddd None admin] PATH_INFO: `/v3/projects/service` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:10.181262 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d79482-841a-4733-bde1-4b47454e4ddd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:10.183272 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d79482-841a-4733-bde1-4b47454e4ddd None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:10.201584 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-d1d79482-841a-4733-bde1-4b47454e4ddd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 23 20:58:10.201584 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:58:10.201584 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:58:10.201584 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:58:10.201584 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:58:10.201584 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:58:10.201584 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:58:10.201584 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:58:10.201584 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:58:10.201584 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:58:10.201584 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:58:10.201584 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:58:10.201584 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 23 20:58:10.201584 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 23 20:58:10.201584 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 23 20:58:10.203449 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 23 20:58:10.203449 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:58:10.203449 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:58:10.203449 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:58:10.203449 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:58:10.203449 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:58:10.203449 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:58:10.203449 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:58:10.203449 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application with Lock( Jul 23 20:58:10.203449 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:58:10.203449 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:58:10.203449 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:58:10.203449 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:58:10.203449 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:58:10.203449 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:58:10.203449 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:58:10.203449 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:58:10.204374 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 23 20:58:10.204374 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 23 20:58:10.204374 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 23 20:58:10.204374 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 23 20:58:10.204374 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 23 20:58:10.204374 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 23 20:58:10.204374 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 23 20:58:10.204374 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:58:10.204374 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 352/705] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Jul 23 20:58:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:58:10.207704 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d79482-841a-4733-bde1-4b47454e4ddd None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:10.209924 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d6eb5b-8e89-4593-81c2-0dd5a306207f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:10.210771 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d6eb5b-8e89-4593-81c2-0dd5a306207f None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:10.210897 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d6eb5b-8e89-4593-81c2-0dd5a306207f None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:10.211151 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d6eb5b-8e89-4593-81c2-0dd5a306207f None admin] PATH_INFO: `/v3/services` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:10.211863 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d6eb5b-8e89-4593-81c2-0dd5a306207f None admin] RBAC: Adding query filter params (name=network) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:10.212160 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d6eb5b-8e89-4593-81c2-0dd5a306207f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:10.213544 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d6eb5b-8e89-4593-81c2-0dd5a306207f None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:10.218940 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 354/706] 10.222.0.17 () {56 vars in 1112 bytes} [Sat Jul 23 20:58:09 2022] GET /identity/v3/services?name=network => generated 124 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:58:10.225999 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d6eb5b-8e89-4593-81c2-0dd5a306207f None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:10.318916 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:10.323545 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d79482-841a-4733-bde1-4b47454e4ddd None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:10.340347 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d6eb5b-8e89-4593-81c2-0dd5a306207f None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:10.360368 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c8fce2-10e6-4663-aaf7-40faec4d6fdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:10.361475 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c8fce2-10e6-4663-aaf7-40faec4d6fdd None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:10.361988 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c8fce2-10e6-4663-aaf7-40faec4d6fdd None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:10.362454 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c8fce2-10e6-4663-aaf7-40faec4d6fdd None admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:10.363615 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c8fce2-10e6-4663-aaf7-40faec4d6fdd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:10.364240 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c8fce2-10e6-4663-aaf7-40faec4d6fdd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:10.366036 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c8fce2-10e6-4663-aaf7-40faec4d6fdd None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:10.367275 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:10.376340 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c24cc6f-ebef-44e7-b625-ebe46bcdd9cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:10.377020 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c24cc6f-ebef-44e7-b625-ebe46bcdd9cb None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:10.377297 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c24cc6f-ebef-44e7-b625-ebe46bcdd9cb None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:10.377611 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c24cc6f-ebef-44e7-b625-ebe46bcdd9cb None admin] PATH_INFO: `/v3/services` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:10.378388 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c24cc6f-ebef-44e7-b625-ebe46bcdd9cb None admin] RBAC: Adding query filter params (type=network) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:10.378690 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c24cc6f-ebef-44e7-b625-ebe46bcdd9cb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:10.380065 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c24cc6f-ebef-44e7-b625-ebe46bcdd9cb None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:10.383319 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 353/707] 10.222.0.17 () {56 vars in 1148 bytes} [Sat Jul 23 20:58:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:58:10.386377 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 355/708] 10.222.0.17 () {56 vars in 1112 bytes} [Sat Jul 23 20:58:10 2022] GET /identity/v3/services?type=network => generated 124 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:58:10.388792 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c8fce2-10e6-4663-aaf7-40faec4d6fdd None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:10.468312 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73f9304-837d-4baa-a702-c13b552067f6 None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:10.468974 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73f9304-837d-4baa-a702-c13b552067f6 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:10.469480 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73f9304-837d-4baa-a702-c13b552067f6 None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:10.472087 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 356/709] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:58:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:58:10.478710 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f57f04c-7c8e-4109-bdbf-7ef63d271ffd None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:10.479077 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f57f04c-7c8e-4109-bdbf-7ef63d271ffd None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:10.479420 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f57f04c-7c8e-4109-bdbf-7ef63d271ffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:10.504221 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-9f57f04c-7c8e-4109-bdbf-7ef63d271ffd None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:58:10.506185 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-9f57f04c-7c8e-4109-bdbf-7ef63d271ffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:58:10.519909 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c8fce2-10e6-4663-aaf7-40faec4d6fdd None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:10.565997 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9338e755-1581-4965-9059-66b83b04fb91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:10.567009 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9338e755-1581-4965-9059-66b83b04fb91 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:10.567477 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9338e755-1581-4965-9059-66b83b04fb91 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:10.567966 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9338e755-1581-4965-9059-66b83b04fb91 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:10.569015 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9338e755-1581-4965-9059-66b83b04fb91 None admin] RBAC: Adding query filter params (role.id=fec17bfdc65349a2b9c06a89131191df, scope.project.id=4804ed61295f4d4a92d9b685dd9e9f3b, user.id=079f31ed2c844e67bd4e206f24b69d97) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:10.569534 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9338e755-1581-4965-9059-66b83b04fb91 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:10.571355 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9338e755-1581-4965-9059-66b83b04fb91 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:10.579033 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 354/710] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Jul 23 20:58:10 2022] GET /identity/v3/role_assignments?user.id=079f31ed2c844e67bd4e206f24b69d97&scope.project.id=4804ed61295f4d4a92d9b685dd9e9f3b&role.id=fec17bfdc65349a2b9c06a89131191df => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:58:10.605927 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 357/711] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:58:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 23 20:58:10.632801 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9338e755-1581-4965-9059-66b83b04fb91 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:10.666651 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:10.771387 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9338e755-1581-4965-9059-66b83b04fb91 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:10.814880 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067a9b72-3dcb-41a8-b6c0-0feb8d6ebc56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:10.817158 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067a9b72-3dcb-41a8-b6c0-0feb8d6ebc56 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:10.817158 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067a9b72-3dcb-41a8-b6c0-0feb8d6ebc56 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:10.817457 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067a9b72-3dcb-41a8-b6c0-0feb8d6ebc56 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:10.839943 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067a9b72-3dcb-41a8-b6c0-0feb8d6ebc56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:10.841788 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067a9b72-3dcb-41a8-b6c0-0feb8d6ebc56 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:10.866058 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-067a9b72-3dcb-41a8-b6c0-0feb8d6ebc56 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:58:10.866058 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:58:10.866058 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:58:10.866058 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:58:10.866058 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:58:10.866058 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:58:10.866058 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:58:10.866058 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:58:10.866058 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:58:10.866058 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:58:10.866058 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:58:10.866058 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:58:10.866058 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 23 20:58:10.866058 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 23 20:58:10.866058 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 23 20:58:10.867085 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 23 20:58:10.867085 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:58:10.867085 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:58:10.867085 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:58:10.867085 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:58:10.867085 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:58:10.867085 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:58:10.867085 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:58:10.867085 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application with Lock( Jul 23 20:58:10.867085 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:58:10.867085 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:58:10.867085 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:58:10.867085 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:58:10.867085 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:58:10.867085 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:58:10.867085 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:58:10.867085 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:58:10.867954 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 23 20:58:10.867954 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 23 20:58:10.867954 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:58:10.867954 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:58:10.873958 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 355/712] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 23 20:58:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:58:10.876449 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f57f04c-7c8e-4109-bdbf-7ef63d271ffd None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:11.016795 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f57f04c-7c8e-4109-bdbf-7ef63d271ffd None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:11.052765 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:11.065514 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26aa601-fc40-4f1d-a162-22ae96b22519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:11.066255 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26aa601-fc40-4f1d-a162-22ae96b22519 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:11.066537 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26aa601-fc40-4f1d-a162-22ae96b22519 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:11.066811 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26aa601-fc40-4f1d-a162-22ae96b22519 None admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:11.067546 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26aa601-fc40-4f1d-a162-22ae96b22519 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:11.067849 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26aa601-fc40-4f1d-a162-22ae96b22519 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:11.069222 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26aa601-fc40-4f1d-a162-22ae96b22519 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:11.084956 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 358/713] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 23 20:58:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:58:11.090871 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067a9b72-3dcb-41a8-b6c0-0feb8d6ebc56 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:11.130027 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f20abb-cb47-43d9-a453-71ea4cd51c50 None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:11.130560 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f20abb-cb47-43d9-a453-71ea4cd51c50 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:11.130560 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f20abb-cb47-43d9-a453-71ea4cd51c50 None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:11.132105 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 359/714] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:58:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 23 20:58:11.143241 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b08ff7-f213-47a0-8dd8-c4805c29db9c None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:11.143517 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b08ff7-f213-47a0-8dd8-c4805c29db9c None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:11.143802 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b08ff7-f213-47a0-8dd8-c4805c29db9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:11.172633 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-f0b08ff7-f213-47a0-8dd8-c4805c29db9c None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:58:11.172633 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-f0b08ff7-f213-47a0-8dd8-c4805c29db9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:58:11.186256 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:11.216443 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067a9b72-3dcb-41a8-b6c0-0feb8d6ebc56 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:11.258263 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdbb585-8dd8-477c-9fe7-1467bcec15a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:11.258993 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdbb585-8dd8-477c-9fe7-1467bcec15a4 None admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:11.259271 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdbb585-8dd8-477c-9fe7-1467bcec15a4 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:11.259540 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdbb585-8dd8-477c-9fe7-1467bcec15a4 None admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:11.260276 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdbb585-8dd8-477c-9fe7-1467bcec15a4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:11.261727 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdbb585-8dd8-477c-9fe7-1467bcec15a4 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:11.298790 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 356/715] 10.222.0.17 () {60 vars in 1132 bytes} [Sat Jul 23 20:58:11 2022] POST /identity/v3/users => generated 254 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 20:58:11.315385 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 360/716] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:58:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 23 20:58:11.351133 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdbb585-8dd8-477c-9fe7-1467bcec15a4 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:11.512810 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdbb585-8dd8-477c-9fe7-1467bcec15a4 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:11.562650 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:11.569568 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca2aae7-d44f-434a-b3c2-e6ea72bb4807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:11.570410 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca2aae7-d44f-434a-b3c2-e6ea72bb4807 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:11.570690 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca2aae7-d44f-434a-b3c2-e6ea72bb4807 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:11.570961 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca2aae7-d44f-434a-b3c2-e6ea72bb4807 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:11.571676 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca2aae7-d44f-434a-b3c2-e6ea72bb4807 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:11.573312 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca2aae7-d44f-434a-b3c2-e6ea72bb4807 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:11.586759 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-eca2aae7-d44f-434a-b3c2-e6ea72bb4807 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 23 20:58:11.586759 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:58:11.586759 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 23 20:58:11.586759 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 23 20:58:11.586759 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 23 20:58:11.586759 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 23 20:58:11.586759 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 23 20:58:11.586759 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 23 20:58:11.586759 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 23 20:58:11.586759 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:58:11.586759 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 23 20:58:11.586759 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:58:11.586759 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:58:11.586759 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:58:11.586759 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:58:11.586759 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:58:11.587747 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:58:11.587747 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:58:11.587747 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:58:11.587747 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:58:11.587747 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:58:11.587747 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:58:11.587747 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:58:11.587747 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 23 20:58:11.587747 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 23 20:58:11.587747 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 23 20:58:11.587747 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 23 20:58:11.587747 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:58:11.587747 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:58:11.587747 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:58:11.587747 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:58:11.587747 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:58:11.588880 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:58:11.588880 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:58:11.588880 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application with Lock( Jul 23 20:58:11.588880 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:58:11.588880 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:58:11.588880 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:58:11.588880 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:58:11.588880 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:58:11.588880 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:58:11.588880 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:58:11.588880 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:58:11.588880 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 23 20:58:11.588880 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 23 20:58:11.588880 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 23 20:58:11.588880 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:58:11.588880 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 357/717] 10.222.0.17 () {56 vars in 1129 bytes} [Sat Jul 23 20:58:11 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:58:11.594324 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b08ff7-f213-47a0-8dd8-c4805c29db9c None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:11.850295 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b08ff7-f213-47a0-8dd8-c4805c29db9c None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:11.869784 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:11.895751 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6a81af-cac2-476e-afa2-96ce6f2082c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:11.896785 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6a81af-cac2-476e-afa2-96ce6f2082c6 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:11.897281 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6a81af-cac2-476e-afa2-96ce6f2082c6 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:11.897784 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6a81af-cac2-476e-afa2-96ce6f2082c6 None admin] PATH_INFO: `/v3/services` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:11.898720 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6a81af-cac2-476e-afa2-96ce6f2082c6 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:11.899214 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6a81af-cac2-476e-afa2-96ce6f2082c6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:11.900755 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6a81af-cac2-476e-afa2-96ce6f2082c6 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:11.913194 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 361/718] 10.222.0.17 () {56 vars in 1124 bytes} [Sat Jul 23 20:58:11 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:58:11.918365 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca2aae7-d44f-434a-b3c2-e6ea72bb4807 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:12.084222 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca2aae7-d44f-434a-b3c2-e6ea72bb4807 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:12.132898 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd604609-3d25-4324-a2e6-7a8bb7a064eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:12.133483 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd604609-3d25-4324-a2e6-7a8bb7a064eb None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:12.133757 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd604609-3d25-4324-a2e6-7a8bb7a064eb None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:12.134056 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd604609-3d25-4324-a2e6-7a8bb7a064eb None admin] PATH_INFO: `/v3/services` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:12.134762 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd604609-3d25-4324-a2e6-7a8bb7a064eb None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:12.135058 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd604609-3d25-4324-a2e6-7a8bb7a064eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:12.136442 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd604609-3d25-4324-a2e6-7a8bb7a064eb None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:12.142964 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 358/719] 10.222.0.17 () {56 vars in 1124 bytes} [Sat Jul 23 20:58:11 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:58:13.141628 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58837c41-297f-4bcf-a5cf-17231c5a9bc2 None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:13.142158 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58837c41-297f-4bcf-a5cf-17231c5a9bc2 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:13.142158 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58837c41-297f-4bcf-a5cf-17231c5a9bc2 None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:13.143485 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 362/720] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:58:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:58:13.149972 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f1a7da-a25a-46b1-b502-582120486a9a None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:13.150385 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f1a7da-a25a-46b1-b502-582120486a9a None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:13.150551 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f1a7da-a25a-46b1-b502-582120486a9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:13.174915 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-c4f1a7da-a25a-46b1-b502-582120486a9a None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:58:13.176220 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-c4f1a7da-a25a-46b1-b502-582120486a9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:58:13.185113 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0ebdf7-3c47-4a3e-956e-6a1e052f86c7 None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:13.185412 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0ebdf7-3c47-4a3e-956e-6a1e052f86c7 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:13.185666 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0ebdf7-3c47-4a3e-956e-6a1e052f86c7 None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:13.187682 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 363/721] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:58:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:58:13.193972 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931089d1-1d52-4b9c-856a-ec1cc4fd81f9 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:13.194268 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931089d1-1d52-4b9c-856a-ec1cc4fd81f9 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:13.194542 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931089d1-1d52-4b9c-856a-ec1cc4fd81f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:13.213837 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-931089d1-1d52-4b9c-856a-ec1cc4fd81f9 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:58:13.215310 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-931089d1-1d52-4b9c-856a-ec1cc4fd81f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:58:13.286216 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:13.299205 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 364/722] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:58:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 23 20:58:13.316439 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 359/723] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:58:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 23 20:58:13.345365 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931089d1-1d52-4b9c-856a-ec1cc4fd81f9 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:13.356917 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f1a7da-a25a-46b1-b502-582120486a9a None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:13.460982 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931089d1-1d52-4b9c-856a-ec1cc4fd81f9 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:13.469715 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:13.503246 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06da7349-a321-444d-896b-be47acb154a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:13.504139 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06da7349-a321-444d-896b-be47acb154a7 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:13.504418 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06da7349-a321-444d-896b-be47acb154a7 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:13.504683 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06da7349-a321-444d-896b-be47acb154a7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:13.518142 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06da7349-a321-444d-896b-be47acb154a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:58:13.528554 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-06da7349-a321-444d-896b-be47acb154a7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 23 20:58:13.528554 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:58:13.528554 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:58:13.528554 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:58:13.528554 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:58:13.528554 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:58:13.528554 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:58:13.528554 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:58:13.528554 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:58:13.528554 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:58:13.528554 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:58:13.528554 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:58:13.528554 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:58:13.528554 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:58:13.528554 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:58:13.528554 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:58:13.529487 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:58:13.529487 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:58:13.529487 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:58:13.529487 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:58:13.529487 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:58:13.529487 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:58:13.529487 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:58:13.529487 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:58:13.529487 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:58:13.529487 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:58:13.529487 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:58:13.529487 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application with Lock( Jul 23 20:58:13.529487 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:58:13.529487 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:58:13.529487 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:58:13.529487 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:58:13.530354 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:58:13.530354 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:58:13.530354 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:58:13.530354 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:58:13.530354 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:58:13.530354 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:58:13.530354 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:58:13.530354 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:58:13.530354 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:58:13.530354 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:58:13.530354 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 23 20:58:13.530354 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 20:58:13.531166 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 365/724] 10.222.0.17 () {56 vars in 1096 bytes} [Sat Jul 23 20:58:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:58:13.532039 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e842b0-59ea-4d1e-80fd-248cc7c56cc2 None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:13.532318 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e842b0-59ea-4d1e-80fd-248cc7c56cc2 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:13.532596 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e842b0-59ea-4d1e-80fd-248cc7c56cc2 None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:13.533421 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f1a7da-a25a-46b1-b502-582120486a9a None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:13.538011 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 366/725] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:58:13 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:58:13.542808 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e842b0-59ea-4d1e-80fd-248cc7c56cc2 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:13.582682 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d2da30-5624-49b6-bb87-1bb7e41ea8b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:13.583541 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d2da30-5624-49b6-bb87-1bb7e41ea8b6 None admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:13.583914 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d2da30-5624-49b6-bb87-1bb7e41ea8b6 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:13.584297 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d2da30-5624-49b6-bb87-1bb7e41ea8b6 None admin] PATH_INFO: `/v3/services` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:13.585318 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d2da30-5624-49b6-bb87-1bb7e41ea8b6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:13.587662 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d2da30-5624-49b6-bb87-1bb7e41ea8b6 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:13.609961 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 360/726] 10.222.0.17 () {60 vars in 1141 bytes} [Sat Jul 23 20:58:13 2022] POST /identity/v3/services => generated 240 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 20:58:13.611388 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d54d85-ad21-4434-9f92-e07db8fc47a7 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:13.611602 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d54d85-ad21-4434-9f92-e07db8fc47a7 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:13.611924 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d54d85-ad21-4434-9f92-e07db8fc47a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:13.647592 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-92d54d85-ad21-4434-9f92-e07db8fc47a7 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:58:13.648812 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-92d54d85-ad21-4434-9f92-e07db8fc47a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:58:13.738331 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e842b0-59ea-4d1e-80fd-248cc7c56cc2 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:13.751207 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:13.785896 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff15d30-bebe-4823-b8fe-a8ca704248b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:13.785896 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff15d30-bebe-4823-b8fe-a8ca704248b9 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:13.785896 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff15d30-bebe-4823-b8fe-a8ca704248b9 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:13.785896 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff15d30-bebe-4823-b8fe-a8ca704248b9 None admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:13.786349 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff15d30-bebe-4823-b8fe-a8ca704248b9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:13.786349 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff15d30-bebe-4823-b8fe-a8ca704248b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:13.786349 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff15d30-bebe-4823-b8fe-a8ca704248b9 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:13.797523 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 367/727] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Jul 23 20:58:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:58:13.803929 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff15d30-bebe-4823-b8fe-a8ca704248b9 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:13.809317 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 361/728] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:58:13 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 23 20:58:13.833361 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:13.851485 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d54d85-ad21-4434-9f92-e07db8fc47a7 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:13.930892 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff15d30-bebe-4823-b8fe-a8ca704248b9 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:13.980559 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a2c236-06dc-4725-9f8d-8ef3af571b8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:13.981387 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a2c236-06dc-4725-9f8d-8ef3af571b8b None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:13.981662 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a2c236-06dc-4725-9f8d-8ef3af571b8b None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:13.981953 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a2c236-06dc-4725-9f8d-8ef3af571b8b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:13.992166 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d54d85-ad21-4434-9f92-e07db8fc47a7 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:13.996268 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a2c236-06dc-4725-9f8d-8ef3af571b8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:13.997727 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a2c236-06dc-4725-9f8d-8ef3af571b8b None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:14.021476 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-56a2c236-06dc-4725-9f8d-8ef3af571b8b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:58:14.021476 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:58:14.021476 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:58:14.021476 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:58:14.021476 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:58:14.021476 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:58:14.021476 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:58:14.021476 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:58:14.021476 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:58:14.021476 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:58:14.021476 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:58:14.021476 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:58:14.021476 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 23 20:58:14.021476 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 23 20:58:14.021476 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 23 20:58:14.022459 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 23 20:58:14.022459 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:58:14.022459 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:58:14.022459 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:58:14.022459 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:58:14.022459 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:58:14.022459 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:58:14.022459 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:58:14.022459 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application with Lock( Jul 23 20:58:14.022459 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:58:14.022459 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:58:14.022459 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:58:14.022459 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:58:14.022459 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:58:14.022459 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:58:14.022459 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:58:14.022459 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:58:14.023316 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 23 20:58:14.023316 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 23 20:58:14.023316 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:58:14.023316 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 20:58:14.025830 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 368/729] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 23 20:58:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:58:14.032198 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a2c236-06dc-4725-9f8d-8ef3af571b8b None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:14.040655 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971180ba-c2f6-47f4-80b3-8ffbe567ebee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:14.041774 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971180ba-c2f6-47f4-80b3-8ffbe567ebee None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:14.042301 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971180ba-c2f6-47f4-80b3-8ffbe567ebee None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:14.042795 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971180ba-c2f6-47f4-80b3-8ffbe567ebee None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:14.055602 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971180ba-c2f6-47f4-80b3-8ffbe567ebee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:58:14.063824 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-971180ba-c2f6-47f4-80b3-8ffbe567ebee None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 23 20:58:14.063824 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:58:14.063824 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:58:14.063824 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:58:14.063824 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:58:14.063824 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:58:14.063824 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:58:14.063824 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:58:14.063824 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:58:14.063824 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:58:14.063824 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:58:14.063824 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:58:14.063824 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:58:14.063824 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:58:14.063824 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:58:14.063824 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:58:14.064758 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:58:14.064758 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:58:14.064758 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:58:14.064758 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:58:14.064758 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:58:14.064758 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:58:14.064758 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:58:14.064758 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:58:14.064758 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:58:14.064758 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:58:14.064758 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:58:14.064758 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application with Lock( Jul 23 20:58:14.064758 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:58:14.064758 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:58:14.064758 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:58:14.064758 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:58:14.065572 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:58:14.065572 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:58:14.065572 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:58:14.065572 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:58:14.065572 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:58:14.065572 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:58:14.065572 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:58:14.065572 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:58:14.065572 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:58:14.065572 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:58:14.065572 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 23 20:58:14.065572 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:58:14.068411 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 362/730] 10.222.0.17 () {56 vars in 1096 bytes} [Sat Jul 23 20:58:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:58:14.074382 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971180ba-c2f6-47f4-80b3-8ffbe567ebee None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:14.120556 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:14.125504 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:14.154040 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a2c236-06dc-4725-9f8d-8ef3af571b8b None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:14.187283 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971180ba-c2f6-47f4-80b3-8ffbe567ebee None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:14.194766 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a0cb06-1fee-4434-8cea-57f9f55b4889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:14.195445 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a0cb06-1fee-4434-8cea-57f9f55b4889 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:14.195720 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a0cb06-1fee-4434-8cea-57f9f55b4889 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:14.195990 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a0cb06-1fee-4434-8cea-57f9f55b4889 None admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:14.197159 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a0cb06-1fee-4434-8cea-57f9f55b4889 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:14.197463 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a0cb06-1fee-4434-8cea-57f9f55b4889 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:14.198866 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a0cb06-1fee-4434-8cea-57f9f55b4889 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:14.214190 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 369/731] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 23 20:58:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:58:14.215894 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e8a8f-2042-47a0-bf3c-a33980cfef60 None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:14.216372 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e8a8f-2042-47a0-bf3c-a33980cfef60 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:14.216836 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e8a8f-2042-47a0-bf3c-a33980cfef60 None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:14.219082 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 370/732] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:58:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:58:14.220111 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0e8a8f-2042-47a0-bf3c-a33980cfef60 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:14.235614 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79abe03b-4b21-47e6-b58d-3c209081462a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:14.236282 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79abe03b-4b21-47e6-b58d-3c209081462a None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:14.236571 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79abe03b-4b21-47e6-b58d-3c209081462a None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:14.237070 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79abe03b-4b21-47e6-b58d-3c209081462a None admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:14.237912 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79abe03b-4b21-47e6-b58d-3c209081462a None admin] RBAC: Adding query filter params (name=admin) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:14.238208 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79abe03b-4b21-47e6-b58d-3c209081462a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:14.240275 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79abe03b-4b21-47e6-b58d-3c209081462a None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:14.251421 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 363/733] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Jul 23 20:58:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:58:14.252910 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6a82a6-35da-4e5b-93fa-f941d0815f34 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:14.253196 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6a82a6-35da-4e5b-93fa-f941d0815f34 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:14.253854 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6a82a6-35da-4e5b-93fa-f941d0815f34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:14.279077 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-de6a82a6-35da-4e5b-93fa-f941d0815f34 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:58:14.279077 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-de6a82a6-35da-4e5b-93fa-f941d0815f34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:58:14.351003 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0e8a8f-2042-47a0-bf3c-a33980cfef60 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:14.357358 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 364/734] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:58:14 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 23 20:58:14.358547 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6a82a6-35da-4e5b-93fa-f941d0815f34 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:14.390805 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:14.393563 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b364e47-ebbd-4358-9aa2-31601c386b49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:14.394441 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b364e47-ebbd-4358-9aa2-31601c386b49 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:14.394718 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b364e47-ebbd-4358-9aa2-31601c386b49 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:14.394986 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b364e47-ebbd-4358-9aa2-31601c386b49 None admin] PATH_INFO: `/v3/users/nova` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:14.398107 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:14.404542 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b364e47-ebbd-4358-9aa2-31601c386b49 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:14.406499 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b364e47-ebbd-4358-9aa2-31601c386b49 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:14.426400 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-9b364e47-ebbd-4358-9aa2-31601c386b49 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 23 20:58:14.426400 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:58:14.426400 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:58:14.426400 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:58:14.426400 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:58:14.426400 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:58:14.426400 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:58:14.426400 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:58:14.426400 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:58:14.426400 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:58:14.426400 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:58:14.426400 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:58:14.426400 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 23 20:58:14.426400 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 23 20:58:14.426400 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 23 20:58:14.426400 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 23 20:58:14.427392 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:58:14.427392 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:58:14.427392 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 23 20:58:14.427392 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 23 20:58:14.427392 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 23 20:58:14.427392 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 23 20:58:14.427392 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:58:14.427392 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:58:14.427392 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:58:14.427392 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:58:14.427392 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:58:14.427392 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application with Lock( Jul 23 20:58:14.427392 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:58:14.427392 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:58:14.427392 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:58:14.427392 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:58:14.427392 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:58:14.427392 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:58:14.428799 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:58:14.428799 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:58:14.428799 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 23 20:58:14.428799 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 23 20:58:14.428799 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 23 20:58:14.428799 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 23 20:58:14.428799 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 23 20:58:14.428799 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 23 20:58:14.428799 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 23 20:58:14.428799 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 20:58:14.428799 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 371/735] 10.222.0.17 () {56 vars in 1093 bytes} [Sat Jul 23 20:58:14 2022] GET /identity/v3/users/nova => generated 82 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:58:14.428799 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b364e47-ebbd-4358-9aa2-31601c386b49 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:14.478538 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6a82a6-35da-4e5b-93fa-f941d0815f34 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:14.514892 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250d0b7c-6135-4ee0-a09c-c74d8003fbae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:14.515851 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250d0b7c-6135-4ee0-a09c-c74d8003fbae None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:14.516129 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250d0b7c-6135-4ee0-a09c-c74d8003fbae None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:14.516395 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250d0b7c-6135-4ee0-a09c-c74d8003fbae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:14.527262 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250d0b7c-6135-4ee0-a09c-c74d8003fbae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:14.529218 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250d0b7c-6135-4ee0-a09c-c74d8003fbae None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:14.548052 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-250d0b7c-6135-4ee0-a09c-c74d8003fbae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:58:14.548052 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:58:14.548052 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:58:14.548052 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:58:14.548052 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:58:14.548052 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:58:14.548052 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:58:14.548052 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:58:14.548052 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:58:14.548052 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:58:14.548052 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:58:14.548052 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:58:14.548052 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 23 20:58:14.548052 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 23 20:58:14.548052 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 23 20:58:14.548979 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 23 20:58:14.548979 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:58:14.548979 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:58:14.548979 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:58:14.548979 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:58:14.548979 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:58:14.548979 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:58:14.548979 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:58:14.548979 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application with Lock( Jul 23 20:58:14.548979 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:58:14.548979 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:58:14.548979 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:58:14.548979 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:58:14.548979 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:58:14.548979 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:58:14.548979 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:58:14.548979 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:58:14.550718 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 23 20:58:14.550718 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 23 20:58:14.550718 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:58:14.550718 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:58:14.553403 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b364e47-ebbd-4358-9aa2-31601c386b49 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:14.554150 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 365/736] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 23 20:58:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:58:14.555180 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250d0b7c-6135-4ee0-a09c-c74d8003fbae None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:14.598481 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5132a951-e7e1-4f1b-8c74-f73dd5a19bac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:14.600425 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5132a951-e7e1-4f1b-8c74-f73dd5a19bac None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:14.600710 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5132a951-e7e1-4f1b-8c74-f73dd5a19bac None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:14.601125 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5132a951-e7e1-4f1b-8c74-f73dd5a19bac None admin] PATH_INFO: `/v3/roles/service` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:14.615273 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5132a951-e7e1-4f1b-8c74-f73dd5a19bac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:58:14.625406 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-5132a951-e7e1-4f1b-8c74-f73dd5a19bac None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 23 20:58:14.625406 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:58:14.625406 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:58:14.625406 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:58:14.625406 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:58:14.625406 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:58:14.625406 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:58:14.625406 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:58:14.625406 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:58:14.625406 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:58:14.625406 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:58:14.625406 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:58:14.625406 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:58:14.625406 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:58:14.625406 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:58:14.625406 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:58:14.626596 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:58:14.626596 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:58:14.626596 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:58:14.626596 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:58:14.626596 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:58:14.626596 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:58:14.626596 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:58:14.626596 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:58:14.626596 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:58:14.626596 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:58:14.626596 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:58:14.626596 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application with Lock( Jul 23 20:58:14.626596 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:58:14.626596 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:58:14.626596 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:58:14.626596 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:58:14.627627 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:58:14.627627 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:58:14.627627 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:58:14.627627 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:58:14.627627 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:58:14.627627 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:58:14.627627 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:58:14.627627 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:58:14.627627 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:58:14.627627 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:58:14.627627 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 23 20:58:14.627627 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 20:58:14.627627 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 372/737] 10.222.0.17 () {56 vars in 1102 bytes} [Sat Jul 23 20:58:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:58:14.627627 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5132a951-e7e1-4f1b-8c74-f73dd5a19bac None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:14.650552 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:14.667012 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250d0b7c-6135-4ee0-a09c-c74d8003fbae None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:14.691775 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:14.714545 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbe17cb-14f4-44e2-8d62-e53d1a5cd99f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:14.715233 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbe17cb-14f4-44e2-8d62-e53d1a5cd99f None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:14.715507 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbe17cb-14f4-44e2-8d62-e53d1a5cd99f None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:14.715776 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbe17cb-14f4-44e2-8d62-e53d1a5cd99f None admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:14.716964 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbe17cb-14f4-44e2-8d62-e53d1a5cd99f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:14.717276 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbe17cb-14f4-44e2-8d62-e53d1a5cd99f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:14.719053 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbe17cb-14f4-44e2-8d62-e53d1a5cd99f None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:14.741171 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5132a951-e7e1-4f1b-8c74-f73dd5a19bac None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:14.746166 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 366/738] 10.222.0.17 () {56 vars in 1133 bytes} [Sat Jul 23 20:58:14 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:58:14.748076 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbe17cb-14f4-44e2-8d62-e53d1a5cd99f None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:14.783108 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beece43d-ba6d-4d0c-a1e7-7fd9f4880046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:14.783703 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beece43d-ba6d-4d0c-a1e7-7fd9f4880046 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:14.783981 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beece43d-ba6d-4d0c-a1e7-7fd9f4880046 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:14.790094 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beece43d-ba6d-4d0c-a1e7-7fd9f4880046 None admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:14.790927 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beece43d-ba6d-4d0c-a1e7-7fd9f4880046 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:14.791254 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beece43d-ba6d-4d0c-a1e7-7fd9f4880046 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:14.792653 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beece43d-ba6d-4d0c-a1e7-7fd9f4880046 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:14.808020 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 373/739] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 23 20:58:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:58:14.809246 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beece43d-ba6d-4d0c-a1e7-7fd9f4880046 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:14.884988 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbe17cb-14f4-44e2-8d62-e53d1a5cd99f None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:14.927891 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2ecab9-779c-4a4f-8727-82ea4ca119df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:14.929023 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2ecab9-779c-4a4f-8727-82ea4ca119df None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:14.929503 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2ecab9-779c-4a4f-8727-82ea4ca119df None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:14.930020 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2ecab9-779c-4a4f-8727-82ea4ca119df None admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:14.931666 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2ecab9-779c-4a4f-8727-82ea4ca119df None admin] RBAC: Adding query filter params (name=service) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:14.932183 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2ecab9-779c-4a4f-8727-82ea4ca119df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:14.934126 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2ecab9-779c-4a4f-8727-82ea4ca119df None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:14.947236 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beece43d-ba6d-4d0c-a1e7-7fd9f4880046 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:14.947595 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 367/740] 10.222.0.17 () {56 vars in 1103 bytes} [Sat Jul 23 20:58:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:58:14.948804 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2ecab9-779c-4a4f-8727-82ea4ca119df None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:14.954665 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:14.972366 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:14.993933 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a35d1d3-de6c-4f12-a950-8380a270db88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:14.994752 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a35d1d3-de6c-4f12-a950-8380a270db88 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:14.995023 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a35d1d3-de6c-4f12-a950-8380a270db88 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:14.995294 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a35d1d3-de6c-4f12-a950-8380a270db88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:15.006096 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a35d1d3-de6c-4f12-a950-8380a270db88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:15.007597 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a35d1d3-de6c-4f12-a950-8380a270db88 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:15.025457 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-6a35d1d3-de6c-4f12-a950-8380a270db88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:58:15.025457 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:58:15.025457 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:58:15.025457 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:58:15.025457 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:58:15.025457 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:58:15.025457 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:58:15.025457 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:58:15.025457 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:58:15.025457 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:58:15.025457 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:58:15.025457 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:58:15.025457 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 23 20:58:15.025457 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 23 20:58:15.025457 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 23 20:58:15.026618 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 23 20:58:15.026618 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:58:15.026618 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:58:15.026618 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:58:15.026618 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:58:15.026618 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:58:15.026618 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:58:15.026618 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:58:15.026618 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application with Lock( Jul 23 20:58:15.026618 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:58:15.026618 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:58:15.026618 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:58:15.026618 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:58:15.026618 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:58:15.026618 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:58:15.026618 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:58:15.026618 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:58:15.030819 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 23 20:58:15.030819 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 23 20:58:15.030819 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:58:15.030819 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 20:58:15.030819 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 374/741] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 23 20:58:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:58:15.030819 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a35d1d3-de6c-4f12-a950-8380a270db88 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:15.067377 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2ecab9-779c-4a4f-8727-82ea4ca119df None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:15.102142 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f02f8c-3941-4c5a-8f85-888680852ec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:15.102957 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f02f8c-3941-4c5a-8f85-888680852ec2 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:15.103227 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f02f8c-3941-4c5a-8f85-888680852ec2 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:15.103507 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f02f8c-3941-4c5a-8f85-888680852ec2 None admin] PATH_INFO: `/v3/users/swift` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:15.111316 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f02f8c-3941-4c5a-8f85-888680852ec2 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:15.112829 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f02f8c-3941-4c5a-8f85-888680852ec2 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:15.130367 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-41f02f8c-3941-4c5a-8f85-888680852ec2 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 23 20:58:15.130367 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:58:15.130367 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:58:15.130367 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:58:15.130367 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:58:15.130367 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:58:15.130367 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:58:15.130367 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:58:15.130367 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:58:15.130367 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:58:15.130367 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:58:15.130367 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:58:15.130367 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 23 20:58:15.130367 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 23 20:58:15.130367 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 23 20:58:15.130367 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 23 20:58:15.131425 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:58:15.131425 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:58:15.131425 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 23 20:58:15.131425 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 23 20:58:15.131425 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 23 20:58:15.131425 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 23 20:58:15.131425 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:58:15.131425 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:58:15.131425 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:58:15.131425 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:58:15.131425 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:58:15.131425 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application with Lock( Jul 23 20:58:15.131425 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:58:15.131425 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:58:15.131425 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:58:15.131425 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:58:15.131425 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:58:15.131425 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:58:15.132371 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:58:15.132371 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:58:15.132371 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 23 20:58:15.132371 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 23 20:58:15.132371 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 23 20:58:15.132371 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 23 20:58:15.132371 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 23 20:58:15.132371 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 23 20:58:15.132371 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 23 20:58:15.132371 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:58:15.132371 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 368/742] 10.222.0.17 () {56 vars in 1096 bytes} [Sat Jul 23 20:58:14 2022] GET /identity/v3/users/swift => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:58:15.133300 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b360454-fd12-4be1-9fc5-d104caac7b8c None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:15.133300 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b360454-fd12-4be1-9fc5-d104caac7b8c None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:15.133584 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b360454-fd12-4be1-9fc5-d104caac7b8c None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:15.135131 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 369/743] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:58:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:58:15.135757 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b360454-fd12-4be1-9fc5-d104caac7b8c None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:15.143611 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a35d1d3-de6c-4f12-a950-8380a270db88 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:15.187983 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7553f7d-4747-4443-b963-a1303ce8598a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:15.189189 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7553f7d-4747-4443-b963-a1303ce8598a None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:15.189609 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7553f7d-4747-4443-b963-a1303ce8598a None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:15.189899 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7553f7d-4747-4443-b963-a1303ce8598a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:15.201818 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7553f7d-4747-4443-b963-a1303ce8598a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:15.203313 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7553f7d-4747-4443-b963-a1303ce8598a None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:15.210725 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:15.224311 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-e7553f7d-4747-4443-b963-a1303ce8598a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:58:15.224311 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:58:15.224311 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:58:15.224311 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:58:15.224311 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:58:15.224311 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:58:15.224311 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:58:15.224311 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:58:15.224311 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:58:15.224311 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:58:15.224311 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:58:15.224311 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:58:15.224311 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 23 20:58:15.224311 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 23 20:58:15.224311 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 23 20:58:15.225266 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 23 20:58:15.225266 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:58:15.225266 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:58:15.225266 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:58:15.225266 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:58:15.225266 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:58:15.225266 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:58:15.225266 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:58:15.225266 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application with Lock( Jul 23 20:58:15.225266 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:58:15.225266 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:58:15.225266 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:58:15.225266 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:58:15.225266 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:58:15.225266 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:58:15.225266 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:58:15.225266 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:58:15.226260 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 23 20:58:15.226260 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 23 20:58:15.226260 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:58:15.226260 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 20:58:15.230398 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 375/744] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 23 20:58:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:58:15.231802 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca0721e-240b-41c9-8d77-faa645c1a7a6 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:15.232090 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca0721e-240b-41c9-8d77-faa645c1a7a6 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:15.232374 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca0721e-240b-41c9-8d77-faa645c1a7a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:15.250489 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-eca0721e-240b-41c9-8d77-faa645c1a7a6 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:58:15.251746 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-eca0721e-240b-41c9-8d77-faa645c1a7a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:58:15.255713 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b360454-fd12-4be1-9fc5-d104caac7b8c None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:15.268205 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:15.300012 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61ff6ac-8b02-4655-bcea-fadee0ccb296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:15.300737 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61ff6ac-8b02-4655-bcea-fadee0ccb296 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:15.301011 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61ff6ac-8b02-4655-bcea-fadee0ccb296 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:15.301277 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61ff6ac-8b02-4655-bcea-fadee0ccb296 None admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:15.302022 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61ff6ac-8b02-4655-bcea-fadee0ccb296 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:15.302320 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61ff6ac-8b02-4655-bcea-fadee0ccb296 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:15.303742 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61ff6ac-8b02-4655-bcea-fadee0ccb296 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:15.321089 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 370/745] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 23 20:58:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:58:15.321089 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61ff6ac-8b02-4655-bcea-fadee0ccb296 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:15.335649 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 376/746] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:58:15 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 23 20:58:15.346842 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca0721e-240b-41c9-8d77-faa645c1a7a6 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:15.422243 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61ff6ac-8b02-4655-bcea-fadee0ccb296 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:15.446849 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:15.456874 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca0721e-240b-41c9-8d77-faa645c1a7a6 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:15.458313 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33494ec9-34e2-4c78-b800-df9116e8a944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:15.459000 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33494ec9-34e2-4c78-b800-df9116e8a944 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:15.459280 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33494ec9-34e2-4c78-b800-df9116e8a944 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:15.459545 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33494ec9-34e2-4c78-b800-df9116e8a944 None admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:15.460378 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33494ec9-34e2-4c78-b800-df9116e8a944 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:15.460679 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33494ec9-34e2-4c78-b800-df9116e8a944 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:15.462138 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33494ec9-34e2-4c78-b800-df9116e8a944 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:15.484510 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 371/747] 10.222.0.17 () {56 vars in 1135 bytes} [Sat Jul 23 20:58:15 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:58:15.484510 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33494ec9-34e2-4c78-b800-df9116e8a944 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:15.494708 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba20c16-b9b5-4dc5-82e6-b064c75e5ea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:15.495715 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba20c16-b9b5-4dc5-82e6-b064c75e5ea9 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:15.496225 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba20c16-b9b5-4dc5-82e6-b064c75e5ea9 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:15.496739 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba20c16-b9b5-4dc5-82e6-b064c75e5ea9 None admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:15.497678 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba20c16-b9b5-4dc5-82e6-b064c75e5ea9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:15.498188 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba20c16-b9b5-4dc5-82e6-b064c75e5ea9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:15.499749 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba20c16-b9b5-4dc5-82e6-b064c75e5ea9 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:15.518409 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 377/748] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 23 20:58:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:58:15.518409 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba20c16-b9b5-4dc5-82e6-b064c75e5ea9 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:15.532070 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:15.626254 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33494ec9-34e2-4c78-b800-df9116e8a944 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:15.637970 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba20c16-b9b5-4dc5-82e6-b064c75e5ea9 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:15.666992 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a62cab-42d6-409f-a8e1-371af842ef9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:15.667818 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a62cab-42d6-409f-a8e1-371af842ef9e None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:15.668098 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a62cab-42d6-409f-a8e1-371af842ef9e None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:15.668379 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a62cab-42d6-409f-a8e1-371af842ef9e None admin] PATH_INFO: `/v3/projects/service` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:15.673371 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2447dd4-ad10-47c8-848e-4747c987d584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:15.674072 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2447dd4-ad10-47c8-848e-4747c987d584 None admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:15.674355 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2447dd4-ad10-47c8-848e-4747c987d584 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:15.674698 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2447dd4-ad10-47c8-848e-4747c987d584 None admin] PATH_INFO: `/v3/services` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:15.675398 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2447dd4-ad10-47c8-848e-4747c987d584 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:15.675689 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a62cab-42d6-409f-a8e1-371af842ef9e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:15.676763 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2447dd4-ad10-47c8-848e-4747c987d584 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:15.677134 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a62cab-42d6-409f-a8e1-371af842ef9e None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:15.701892 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-23a62cab-42d6-409f-a8e1-371af842ef9e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 23 20:58:15.701892 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:58:15.701892 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:58:15.701892 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:58:15.701892 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:58:15.701892 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:58:15.701892 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:58:15.701892 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:58:15.701892 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:58:15.701892 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:58:15.701892 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:58:15.701892 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:58:15.701892 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 23 20:58:15.701892 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 23 20:58:15.701892 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 23 20:58:15.703070 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 23 20:58:15.703070 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:58:15.703070 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:58:15.703070 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:58:15.703070 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:58:15.703070 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:58:15.703070 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:58:15.703070 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:58:15.703070 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application with Lock( Jul 23 20:58:15.703070 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:58:15.703070 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:58:15.703070 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:58:15.703070 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:58:15.703070 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:58:15.703070 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:58:15.703070 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:58:15.703070 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:58:15.704165 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 23 20:58:15.704165 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 23 20:58:15.704165 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 23 20:58:15.704165 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 23 20:58:15.704165 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 23 20:58:15.704165 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 23 20:58:15.704165 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 23 20:58:15.704165 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:58:15.704719 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 378/749] 10.222.0.17 () {60 vars in 1141 bytes} [Sat Jul 23 20:58:15 2022] POST /identity/v3/services => generated 251 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 20:58:15.704719 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2447dd4-ad10-47c8-848e-4747c987d584 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:15.704874 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 372/750] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Jul 23 20:58:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:58:15.704874 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a62cab-42d6-409f-a8e1-371af842ef9e None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:15.765264 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:15.828972 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:15.846416 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a62cab-42d6-409f-a8e1-371af842ef9e None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:15.880968 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2447dd4-ad10-47c8-848e-4747c987d584 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:15.905965 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc06c89-e28d-4297-a44b-1428f296442f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:15.906689 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc06c89-e28d-4297-a44b-1428f296442f None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:15.907113 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc06c89-e28d-4297-a44b-1428f296442f None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:15.907315 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc06c89-e28d-4297-a44b-1428f296442f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:15.917085 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc06c89-e28d-4297-a44b-1428f296442f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:15.918828 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc06c89-e28d-4297-a44b-1428f296442f None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:15.929299 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aaf9e7-6825-4d68-b1b4-e779363c6b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:15.930999 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aaf9e7-6825-4d68-b1b4-e779363c6b0a None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:15.930999 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aaf9e7-6825-4d68-b1b4-e779363c6b0a None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:15.931167 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aaf9e7-6825-4d68-b1b4-e779363c6b0a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:15.934734 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-fdc06c89-e28d-4297-a44b-1428f296442f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 23 20:58:15.934734 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:58:15.934734 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:58:15.934734 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:58:15.934734 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:58:15.934734 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:58:15.934734 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:58:15.934734 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:58:15.934734 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:58:15.934734 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:58:15.934734 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:58:15.934734 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:58:15.934734 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 23 20:58:15.934734 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 23 20:58:15.934734 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 23 20:58:15.934734 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 23 20:58:15.935641 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:58:15.935641 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:58:15.935641 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 23 20:58:15.935641 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 23 20:58:15.935641 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 23 20:58:15.935641 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 23 20:58:15.935641 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:58:15.935641 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:58:15.935641 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:58:15.935641 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:58:15.935641 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:58:15.935641 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application with Lock( Jul 23 20:58:15.935641 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:58:15.935641 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:58:15.935641 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:58:15.935641 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:58:15.935641 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:58:15.935641 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:58:15.936598 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:58:15.936598 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:58:15.936598 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 23 20:58:15.936598 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 23 20:58:15.936598 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 23 20:58:15.936598 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 23 20:58:15.936598 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 23 20:58:15.936598 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 23 20:58:15.936598 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 23 20:58:15.936598 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:58:15.936598 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 373/751] 10.222.0.17 () {56 vars in 1117 bytes} [Sat Jul 23 20:58:15 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:58:15.937192 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc06c89-e28d-4297-a44b-1428f296442f None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:16.035984 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3aaf9e7-6825-4d68-b1b4-e779363c6b0a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:16.038336 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3aaf9e7-6825-4d68-b1b4-e779363c6b0a None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:16.053297 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc06c89-e28d-4297-a44b-1428f296442f None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:16.055030 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:16.090517 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49437728-c87b-4543-afcf-9ddf8e2eccab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:16.091383 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49437728-c87b-4543-afcf-9ddf8e2eccab None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:16.091768 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49437728-c87b-4543-afcf-9ddf8e2eccab None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:16.092150 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49437728-c87b-4543-afcf-9ddf8e2eccab None admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:16.093081 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49437728-c87b-4543-afcf-9ddf8e2eccab None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:16.093505 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49437728-c87b-4543-afcf-9ddf8e2eccab None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:16.095259 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49437728-c87b-4543-afcf-9ddf8e2eccab None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:16.109835 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 374/752] 10.222.0.17 () {56 vars in 1148 bytes} [Sat Jul 23 20:58:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:58:16.110895 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49437728-c87b-4543-afcf-9ddf8e2eccab None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:16.113595 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:16.153468 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 379/753] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Jul 23 20:58:15 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 23 20:58:16.154550 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aaf9e7-6825-4d68-b1b4-e779363c6b0a None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:16.222815 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49437728-c87b-4543-afcf-9ddf8e2eccab None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:16.259571 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968280ea-2b88-4540-8751-cae8f11c2248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:16.260280 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968280ea-2b88-4540-8751-cae8f11c2248 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:16.260559 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968280ea-2b88-4540-8751-cae8f11c2248 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:16.260976 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968280ea-2b88-4540-8751-cae8f11c2248 None admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:16.262080 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968280ea-2b88-4540-8751-cae8f11c2248 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:16.262080 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968280ea-2b88-4540-8751-cae8f11c2248 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:16.263495 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968280ea-2b88-4540-8751-cae8f11c2248 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:16.265753 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aaf9e7-6825-4d68-b1b4-e779363c6b0a None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:16.284719 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 375/754] 10.222.0.17 () {56 vars in 1149 bytes} [Sat Jul 23 20:58:16 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:58:16.285911 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968280ea-2b88-4540-8751-cae8f11c2248 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:16.313670 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:16.314553 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6888d657-875d-4ecf-bec2-0e6e735d59ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:16.315480 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6888d657-875d-4ecf-bec2-0e6e735d59ee None admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:16.315776 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6888d657-875d-4ecf-bec2-0e6e735d59ee None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:16.316046 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6888d657-875d-4ecf-bec2-0e6e735d59ee None admin] PATH_INFO: `/v3/projects/4804ed61295f4d4a92d9b685dd9e9f3b/users/079f31ed2c844e67bd4e206f24b69d97/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:16.318374 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6888d657-875d-4ecf-bec2-0e6e735d59ee None admin] RBAC: Authorizing `identity:create_grant(project_id=4804ed61295f4d4a92d9b685dd9e9f3b, user_id=079f31ed2c844e67bd4e206f24b69d97, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:16.319835 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6888d657-875d-4ecf-bec2-0e6e735d59ee None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:16.341893 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 380/755] 10.222.0.17 () {58 vars in 1439 bytes} [Sat Jul 23 20:58:16 2022] PUT /identity/v3/projects/4804ed61295f4d4a92d9b685dd9e9f3b/users/079f31ed2c844e67bd4e206f24b69d97/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 20:58:16.341893 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182836b5-b760-4eab-91f9-25ab5da252d6 None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:16.341893 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182836b5-b760-4eab-91f9-25ab5da252d6 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:16.341893 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182836b5-b760-4eab-91f9-25ab5da252d6 None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:16.341893 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 381/756] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:58:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:58:16.341893 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182836b5-b760-4eab-91f9-25ab5da252d6 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:16.375026 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:16.422393 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968280ea-2b88-4540-8751-cae8f11c2248 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:16.475817 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d13e729-799b-455e-a741-d94c8c0f2eea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:16.476308 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182836b5-b760-4eab-91f9-25ab5da252d6 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:16.476868 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d13e729-799b-455e-a741-d94c8c0f2eea None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:16.477213 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d13e729-799b-455e-a741-d94c8c0f2eea None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:16.477573 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d13e729-799b-455e-a741-d94c8c0f2eea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:16.491805 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d13e729-799b-455e-a741-d94c8c0f2eea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:16.494360 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d13e729-799b-455e-a741-d94c8c0f2eea None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:16.515849 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef29079-afb5-437f-8a1f-fdc3498dda60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:16.516513 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef29079-afb5-437f-8a1f-fdc3498dda60 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:16.516792 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef29079-afb5-437f-8a1f-fdc3498dda60 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:16.517062 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef29079-afb5-437f-8a1f-fdc3498dda60 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:16.518433 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-3d13e729-799b-455e-a741-d94c8c0f2eea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:58:16.518433 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:58:16.518433 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:58:16.518433 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:58:16.518433 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:58:16.518433 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:58:16.518433 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:58:16.518433 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:58:16.518433 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:58:16.518433 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:58:16.518433 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:58:16.518433 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:58:16.518433 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 23 20:58:16.518433 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 23 20:58:16.518433 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 23 20:58:16.519334 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 23 20:58:16.519334 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:58:16.519334 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:58:16.519334 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:58:16.519334 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:58:16.519334 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:58:16.519334 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:58:16.519334 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:58:16.519334 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application with Lock( Jul 23 20:58:16.519334 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:58:16.519334 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:58:16.519334 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:58:16.519334 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:58:16.519334 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:58:16.519334 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:58:16.519334 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:58:16.519334 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:58:16.520211 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 23 20:58:16.520211 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 23 20:58:16.520211 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:58:16.520211 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:58:16.522030 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 376/757] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 23 20:58:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:58:16.523462 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7111b7c8-0d07-49ee-b01c-f6a77b98b878 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:16.523744 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7111b7c8-0d07-49ee-b01c-f6a77b98b878 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:16.524014 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7111b7c8-0d07-49ee-b01c-f6a77b98b878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:16.544854 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-7111b7c8-0d07-49ee-b01c-f6a77b98b878 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:58:16.546155 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-7111b7c8-0d07-49ee-b01c-f6a77b98b878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:58:16.619027 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef29079-afb5-437f-8a1f-fdc3498dda60 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:16.621601 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef29079-afb5-437f-8a1f-fdc3498dda60 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:16.631310 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 377/758] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:58:16 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 23 20:58:16.632330 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7111b7c8-0d07-49ee-b01c-f6a77b98b878 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:16.634887 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:16.664396 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:16.754312 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 382/759] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Jul 23 20:58:16 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 23 20:58:16.756115 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef29079-afb5-437f-8a1f-fdc3498dda60 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:16.781838 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7111b7c8-0d07-49ee-b01c-f6a77b98b878 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:16.831523 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f575fc0-af20-4881-acb8-ab7fbb937afd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:16.832202 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f575fc0-af20-4881-acb8-ab7fbb937afd None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:16.832474 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f575fc0-af20-4881-acb8-ab7fbb937afd None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:16.832738 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f575fc0-af20-4881-acb8-ab7fbb937afd None admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:16.833462 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f575fc0-af20-4881-acb8-ab7fbb937afd None admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:16.833764 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f575fc0-af20-4881-acb8-ab7fbb937afd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:16.835928 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f575fc0-af20-4881-acb8-ab7fbb937afd None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:16.852759 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 378/760] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 23 20:58:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:58:16.853726 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f575fc0-af20-4881-acb8-ab7fbb937afd None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:16.887791 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef29079-afb5-437f-8a1f-fdc3498dda60 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:16.929764 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:16.939186 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5118815e-69e6-4f3f-9aee-57a4c8ebe6d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:16.940951 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5118815e-69e6-4f3f-9aee-57a4c8ebe6d3 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:16.941234 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5118815e-69e6-4f3f-9aee-57a4c8ebe6d3 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:16.941508 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5118815e-69e6-4f3f-9aee-57a4c8ebe6d3 None admin] PATH_INFO: `/v3/services/network` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:16.942200 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5118815e-69e6-4f3f-9aee-57a4c8ebe6d3 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:16.943588 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5118815e-69e6-4f3f-9aee-57a4c8ebe6d3 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:16.950200 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:16.963663 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-5118815e-69e6-4f3f-9aee-57a4c8ebe6d3 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 23 20:58:16.963663 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:58:16.963663 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 23 20:58:16.963663 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 23 20:58:16.963663 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 23 20:58:16.963663 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 23 20:58:16.963663 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 23 20:58:16.963663 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 23 20:58:16.963663 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 23 20:58:16.963663 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 20:58:16.963663 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 23 20:58:16.963663 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 20:58:16.963663 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:58:16.963663 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:58:16.963663 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:58:16.963663 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:58:16.963663 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:58:16.965066 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:58:16.965066 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:58:16.965066 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:58:16.965066 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:58:16.965066 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:58:16.965066 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:58:16.965066 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 23 20:58:16.965066 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 23 20:58:16.965066 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 23 20:58:16.965066 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 23 20:58:16.965066 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:58:16.965066 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:58:16.965066 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:58:16.965066 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:58:16.965066 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:58:16.965066 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:58:16.966849 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:58:16.966849 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application with Lock( Jul 23 20:58:16.966849 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:58:16.966849 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:58:16.966849 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:58:16.966849 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:58:16.966849 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:58:16.966849 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:58:16.966849 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:58:16.966849 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:58:16.966849 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 23 20:58:16.966849 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 23 20:58:16.966849 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 23 20:58:16.966849 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 20:58:16.973711 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 383/761] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Jul 23 20:58:16 2022] GET /identity/v3/services/network => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:58:16.973711 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5118815e-69e6-4f3f-9aee-57a4c8ebe6d3 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:16.984762 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f575fc0-af20-4881-acb8-ab7fbb937afd None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:17.034093 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9857fb-867c-4b32-a18e-053571fd7ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:17.035857 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9857fb-867c-4b32-a18e-053571fd7ff6 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:17.036320 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9857fb-867c-4b32-a18e-053571fd7ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:17.036770 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9857fb-867c-4b32-a18e-053571fd7ff6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:17.052757 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9857fb-867c-4b32-a18e-053571fd7ff6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:17.055342 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9857fb-867c-4b32-a18e-053571fd7ff6 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:17.078125 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-9e9857fb-867c-4b32-a18e-053571fd7ff6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:58:17.078125 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:58:17.078125 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:58:17.078125 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:58:17.078125 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:58:17.078125 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:58:17.078125 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:58:17.078125 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:58:17.078125 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:58:17.078125 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:58:17.078125 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:58:17.078125 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:58:17.078125 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 23 20:58:17.078125 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 23 20:58:17.078125 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 23 20:58:17.079117 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 23 20:58:17.079117 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:58:17.079117 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:58:17.079117 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:58:17.079117 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:58:17.079117 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:58:17.079117 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:58:17.079117 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:58:17.079117 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application with Lock( Jul 23 20:58:17.079117 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:58:17.079117 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:58:17.079117 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:58:17.079117 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:58:17.079117 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:58:17.079117 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:58:17.079117 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:58:17.079117 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:58:17.080023 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 23 20:58:17.080023 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 23 20:58:17.080023 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:58:17.080023 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:58:17.082796 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 379/762] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 23 20:58:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:58:17.083778 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9857fb-867c-4b32-a18e-053571fd7ff6 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:17.099632 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5118815e-69e6-4f3f-9aee-57a4c8ebe6d3 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:17.138953 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7851ac64-6f3f-449b-8915-402d2290d2f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:17.139944 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7851ac64-6f3f-449b-8915-402d2290d2f7 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:17.140316 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7851ac64-6f3f-449b-8915-402d2290d2f7 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:17.140677 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7851ac64-6f3f-449b-8915-402d2290d2f7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:17.148789 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7851ac64-6f3f-449b-8915-402d2290d2f7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:17.150532 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7851ac64-6f3f-449b-8915-402d2290d2f7 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:17.168016 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-7851ac64-6f3f-449b-8915-402d2290d2f7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 23 20:58:17.168016 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:58:17.168016 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:58:17.168016 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:58:17.168016 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:58:17.168016 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:58:17.168016 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:58:17.168016 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:58:17.168016 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:58:17.168016 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:58:17.168016 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:58:17.168016 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:58:17.168016 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 23 20:58:17.168016 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 23 20:58:17.168016 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 23 20:58:17.169194 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 23 20:58:17.169194 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:58:17.169194 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:58:17.169194 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:58:17.169194 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:58:17.169194 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:58:17.169194 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:58:17.169194 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:58:17.169194 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application with Lock( Jul 23 20:58:17.169194 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:58:17.169194 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:58:17.169194 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:58:17.169194 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:58:17.169194 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:58:17.169194 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:58:17.169194 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:58:17.169194 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:58:17.170371 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 23 20:58:17.170371 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 23 20:58:17.170371 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 23 20:58:17.170371 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 23 20:58:17.170371 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 23 20:58:17.170371 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 23 20:58:17.170371 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 23 20:58:17.170371 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 20:58:17.176890 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 384/763] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Jul 23 20:58:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:58:17.178153 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7851ac64-6f3f-449b-8915-402d2290d2f7 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:17.239077 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:17.307786 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7851ac64-6f3f-449b-8915-402d2290d2f7 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:17.348672 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a449bdb1-4aa5-42c8-9396-7561d898b91c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:17.349643 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a449bdb1-4aa5-42c8-9396-7561d898b91c None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:17.350074 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a449bdb1-4aa5-42c8-9396-7561d898b91c None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:17.350513 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a449bdb1-4aa5-42c8-9396-7561d898b91c None admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:17.351776 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a449bdb1-4aa5-42c8-9396-7561d898b91c None admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:17.352080 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a449bdb1-4aa5-42c8-9396-7561d898b91c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:17.353438 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a449bdb1-4aa5-42c8-9396-7561d898b91c None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:17.354082 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9857fb-867c-4b32-a18e-053571fd7ff6 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:17.370097 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 385/764] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 23 20:58:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:58:17.371983 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a449bdb1-4aa5-42c8-9396-7561d898b91c None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:17.378020 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:17.407647 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507b9cd4-4165-4153-895b-ffc10640ed42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:17.408697 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507b9cd4-4165-4153-895b-ffc10640ed42 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:17.409768 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507b9cd4-4165-4153-895b-ffc10640ed42 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:17.410337 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507b9cd4-4165-4153-895b-ffc10640ed42 None admin] PATH_INFO: `/v3/services` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:17.411516 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507b9cd4-4165-4153-895b-ffc10640ed42 None admin] RBAC: Adding query filter params (name=network) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:17.412281 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507b9cd4-4165-4153-895b-ffc10640ed42 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:17.414583 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507b9cd4-4165-4153-895b-ffc10640ed42 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:17.426220 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 380/765] 10.222.0.17 () {56 vars in 1112 bytes} [Sat Jul 23 20:58:17 2022] GET /identity/v3/services?name=network => generated 124 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:58:17.426882 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507b9cd4-4165-4153-895b-ffc10640ed42 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:17.514140 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a449bdb1-4aa5-42c8-9396-7561d898b91c None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:17.526168 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:17.555482 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225c67b6-42e0-404c-8d30-5e1a69133d82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:17.556199 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225c67b6-42e0-404c-8d30-5e1a69133d82 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:17.556568 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225c67b6-42e0-404c-8d30-5e1a69133d82 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:17.556820 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225c67b6-42e0-404c-8d30-5e1a69133d82 None admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:17.557634 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225c67b6-42e0-404c-8d30-5e1a69133d82 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:17.558258 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225c67b6-42e0-404c-8d30-5e1a69133d82 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:17.559771 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225c67b6-42e0-404c-8d30-5e1a69133d82 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:17.568903 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507b9cd4-4165-4153-895b-ffc10640ed42 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:17.578924 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 386/766] 10.222.0.17 () {56 vars in 1148 bytes} [Sat Jul 23 20:58:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:58:17.580081 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225c67b6-42e0-404c-8d30-5e1a69133d82 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:17.616149 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ade04d-f6f2-4a74-910e-8e0bdbb89634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:17.617932 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ade04d-f6f2-4a74-910e-8e0bdbb89634 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:17.618684 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ade04d-f6f2-4a74-910e-8e0bdbb89634 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:17.619146 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ade04d-f6f2-4a74-910e-8e0bdbb89634 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:17.631513 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ade04d-f6f2-4a74-910e-8e0bdbb89634 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:17.634018 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ade04d-f6f2-4a74-910e-8e0bdbb89634 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:17.653990 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-d3ade04d-f6f2-4a74-910e-8e0bdbb89634 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 23 20:58:17.653990 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:58:17.653990 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:58:17.653990 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:58:17.653990 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:58:17.653990 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:58:17.653990 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:58:17.653990 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:58:17.653990 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:58:17.653990 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:58:17.653990 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:58:17.653990 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:58:17.653990 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 23 20:58:17.653990 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 23 20:58:17.653990 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 23 20:58:17.654971 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 23 20:58:17.654971 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:58:17.654971 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:58:17.654971 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:58:17.654971 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:58:17.654971 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:58:17.654971 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:58:17.654971 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:58:17.654971 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application with Lock( Jul 23 20:58:17.654971 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:58:17.654971 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:58:17.654971 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:58:17.654971 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:58:17.654971 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:58:17.654971 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:58:17.654971 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:58:17.654971 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:58:17.655885 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 23 20:58:17.655885 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 23 20:58:17.655885 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 23 20:58:17.655885 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 23 20:58:17.655885 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 23 20:58:17.655885 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 23 20:58:17.655885 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 23 20:58:17.655885 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:58:17.658730 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 381/767] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Jul 23 20:58:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:58:17.659772 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ade04d-f6f2-4a74-910e-8e0bdbb89634 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:17.704088 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225c67b6-42e0-404c-8d30-5e1a69133d82 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:17.710589 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:17.754436 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b01e6c4-37f7-45d4-8ee0-027b4a3f7367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:17.755524 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b01e6c4-37f7-45d4-8ee0-027b4a3f7367 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:17.756347 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b01e6c4-37f7-45d4-8ee0-027b4a3f7367 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:17.756771 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b01e6c4-37f7-45d4-8ee0-027b4a3f7367 None admin] PATH_INFO: `/v3/services` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:17.757880 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b01e6c4-37f7-45d4-8ee0-027b4a3f7367 None admin] RBAC: Adding query filter params (type=network) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:17.758330 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b01e6c4-37f7-45d4-8ee0-027b4a3f7367 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:17.760294 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b01e6c4-37f7-45d4-8ee0-027b4a3f7367 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:17.771809 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 387/768] 10.222.0.17 () {56 vars in 1112 bytes} [Sat Jul 23 20:58:17 2022] GET /identity/v3/services?type=network => generated 350 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:58:17.771809 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b01e6c4-37f7-45d4-8ee0-027b4a3f7367 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:17.783278 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ade04d-f6f2-4a74-910e-8e0bdbb89634 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:17.808667 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:17.840918 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1263d5-b9e2-4b71-a23d-014583409b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:17.842215 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1263d5-b9e2-4b71-a23d-014583409b47 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:17.842947 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1263d5-b9e2-4b71-a23d-014583409b47 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:17.843823 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1263d5-b9e2-4b71-a23d-014583409b47 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:17.845129 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1263d5-b9e2-4b71-a23d-014583409b47 None admin] RBAC: Adding query filter params (role.id=fec17bfdc65349a2b9c06a89131191df, scope.project.id=4804ed61295f4d4a92d9b685dd9e9f3b, user.id=47f0a685b7da46afb81024848f079d2f) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:17.845916 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1263d5-b9e2-4b71-a23d-014583409b47 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:17.848246 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1263d5-b9e2-4b71-a23d-014583409b47 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:17.856826 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 382/769] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Jul 23 20:58:17 2022] GET /identity/v3/role_assignments?user.id=47f0a685b7da46afb81024848f079d2f&scope.project.id=4804ed61295f4d4a92d9b685dd9e9f3b&role.id=fec17bfdc65349a2b9c06a89131191df => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:58:17.858052 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1263d5-b9e2-4b71-a23d-014583409b47 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:17.922789 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b01e6c4-37f7-45d4-8ee0-027b4a3f7367 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:17.987807 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1263d5-b9e2-4b71-a23d-014583409b47 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:17.990778 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:18.004076 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fde0150-b300-4f8a-9742-e10d61515c84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:18.004799 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fde0150-b300-4f8a-9742-e10d61515c84 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:18.005078 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fde0150-b300-4f8a-9742-e10d61515c84 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:18.005344 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fde0150-b300-4f8a-9742-e10d61515c84 None admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:18.006150 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fde0150-b300-4f8a-9742-e10d61515c84 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:18.006448 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fde0150-b300-4f8a-9742-e10d61515c84 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:18.007878 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fde0150-b300-4f8a-9742-e10d61515c84 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:18.037956 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 388/770] 10.222.0.17 () {56 vars in 1148 bytes} [Sat Jul 23 20:58:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:58:18.038713 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb4601b-1b33-477e-9b35-c86425d2773d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:18.039471 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb4601b-1b33-477e-9b35-c86425d2773d None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:18.039754 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb4601b-1b33-477e-9b35-c86425d2773d None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:18.040022 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb4601b-1b33-477e-9b35-c86425d2773d None admin] PATH_INFO: `/v3/endpoints` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:18.040821 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb4601b-1b33-477e-9b35-c86425d2773d None admin] RBAC: Adding query filter params (interface=public, service_id=332b277c42a142078dc845a137a0c8e1, region_id=RegionOne) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:18.041125 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb4601b-1b33-477e-9b35-c86425d2773d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:18.046147 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb4601b-1b33-477e-9b35-c86425d2773d None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:18.051293 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fde0150-b300-4f8a-9742-e10d61515c84 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:18.053839 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 383/771] 10.222.0.17 () {56 vars in 1251 bytes} [Sat Jul 23 20:58:17 2022] GET /identity/v3/endpoints?service_id=332b277c42a142078dc845a137a0c8e1&interface=public®ion_id=RegionOne => generated 194 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:58:18.061184 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb4601b-1b33-477e-9b35-c86425d2773d None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:18.157370 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:18.165974 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fde0150-b300-4f8a-9742-e10d61515c84 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:18.202294 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d21959-cf25-46a5-89eb-68f784c59eed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:18.203347 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d21959-cf25-46a5-89eb-68f784c59eed None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:18.203833 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d21959-cf25-46a5-89eb-68f784c59eed None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:18.204328 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d21959-cf25-46a5-89eb-68f784c59eed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:18.205399 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d21959-cf25-46a5-89eb-68f784c59eed None admin] RBAC: Adding query filter params (role.id=abf9f3b81f3647dbb70c44d0aedaa614, scope.project.id=4804ed61295f4d4a92d9b685dd9e9f3b, user.id=17b779a3e21a415bb42cde5d6863d9cf) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:18.205959 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d21959-cf25-46a5-89eb-68f784c59eed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:18.207677 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d21959-cf25-46a5-89eb-68f784c59eed None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:18.214384 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 389/772] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Jul 23 20:58:18 2022] GET /identity/v3/role_assignments?user.id=17b779a3e21a415bb42cde5d6863d9cf&scope.project.id=4804ed61295f4d4a92d9b685dd9e9f3b&role.id=abf9f3b81f3647dbb70c44d0aedaa614 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:58:18.215982 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321d99cf-edbe-408c-8ae6-18c8533749d1 None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:18.216497 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321d99cf-edbe-408c-8ae6-18c8533749d1 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:18.216973 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321d99cf-edbe-408c-8ae6-18c8533749d1 None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:18.218868 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 390/773] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:58:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:58:18.225328 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b17dc1-bcd8-442f-9af3-717af3c2533d None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:18.225646 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b17dc1-bcd8-442f-9af3-717af3c2533d None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:18.225895 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b17dc1-bcd8-442f-9af3-717af3c2533d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:18.235535 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb4601b-1b33-477e-9b35-c86425d2773d None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:18.275313 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-f9b17dc1-bcd8-442f-9af3-717af3c2533d None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:58:18.276598 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-f9b17dc1-bcd8-442f-9af3-717af3c2533d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:58:18.289086 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e569c0-4d9a-44dc-b509-71e865abc37d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:18.289781 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e569c0-4d9a-44dc-b509-71e865abc37d None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:18.290078 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e569c0-4d9a-44dc-b509-71e865abc37d None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:18.290341 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e569c0-4d9a-44dc-b509-71e865abc37d None admin] PATH_INFO: `/v3/services` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:18.291035 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e569c0-4d9a-44dc-b509-71e865abc37d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:18.292430 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e569c0-4d9a-44dc-b509-71e865abc37d None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:18.304632 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 384/774] 10.222.0.17 () {56 vars in 1087 bytes} [Sat Jul 23 20:58:18 2022] GET /identity/v3/services => generated 772 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 20:58:18.400789 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 391/775] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:58:18 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 23 20:58:18.442976 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e569c0-4d9a-44dc-b509-71e865abc37d None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:18.498130 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:18.590969 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e569c0-4d9a-44dc-b509-71e865abc37d None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:18.635929 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1591a3-7697-4046-87a5-56e6088b243f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:18.636942 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1591a3-7697-4046-87a5-56e6088b243f None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:18.637219 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1591a3-7697-4046-87a5-56e6088b243f None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:18.637485 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1591a3-7697-4046-87a5-56e6088b243f None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:18.638191 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1591a3-7697-4046-87a5-56e6088b243f None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:18.639627 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1591a3-7697-4046-87a5-56e6088b243f None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:18.656031 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-be1591a3-7697-4046-87a5-56e6088b243f None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 23 20:58:18.656031 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:58:18.656031 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 23 20:58:18.656031 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 23 20:58:18.656031 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 23 20:58:18.656031 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 23 20:58:18.656031 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 23 20:58:18.656031 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 23 20:58:18.656031 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 23 20:58:18.656031 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:58:18.656031 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 23 20:58:18.656031 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:58:18.656031 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:58:18.656031 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:58:18.656031 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:58:18.656031 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:58:18.656973 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:58:18.656973 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:58:18.656973 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:58:18.656973 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:58:18.656973 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:58:18.656973 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:58:18.656973 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:58:18.656973 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 23 20:58:18.656973 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 23 20:58:18.656973 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 23 20:58:18.656973 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 23 20:58:18.656973 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:58:18.656973 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:58:18.656973 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:58:18.656973 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:58:18.656973 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:58:18.657808 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:58:18.657808 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:58:18.657808 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application with Lock( Jul 23 20:58:18.657808 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:58:18.657808 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:58:18.657808 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:58:18.657808 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:58:18.657808 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:58:18.657808 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:58:18.657808 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:58:18.657808 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:58:18.657808 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 23 20:58:18.657808 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 23 20:58:18.657808 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 23 20:58:18.657808 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:58:18.657808 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 385/776] 10.222.0.17 () {56 vars in 1129 bytes} [Sat Jul 23 20:58:18 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:58:18.664573 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b17dc1-bcd8-442f-9af3-717af3c2533d None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:18.771302 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a2bb13-adc6-45fb-b68c-180e6ccd5baf None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:18.771638 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a2bb13-adc6-45fb-b68c-180e6ccd5baf None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:18.771831 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a2bb13-adc6-45fb-b68c-180e6ccd5baf None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:18.773186 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 386/777] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:58:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:58:18.778675 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f98ab26-cebd-4677-8f5f-035a0fdf7190 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:18.778956 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f98ab26-cebd-4677-8f5f-035a0fdf7190 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:18.779223 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f98ab26-cebd-4677-8f5f-035a0fdf7190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:18.805628 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-4f98ab26-cebd-4677-8f5f-035a0fdf7190 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:58:18.806859 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-4f98ab26-cebd-4677-8f5f-035a0fdf7190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:58:18.827424 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:18.850521 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b17dc1-bcd8-442f-9af3-717af3c2533d None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:18.902628 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2c813e-d532-4144-a0e4-59ff046162c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:18.904103 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2c813e-d532-4144-a0e4-59ff046162c0 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:18.904386 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2c813e-d532-4144-a0e4-59ff046162c0 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:18.904660 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2c813e-d532-4144-a0e4-59ff046162c0 None admin] PATH_INFO: `/v3/services` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:18.905413 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2c813e-d532-4144-a0e4-59ff046162c0 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:18.905711 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2c813e-d532-4144-a0e4-59ff046162c0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:18.907371 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2c813e-d532-4144-a0e4-59ff046162c0 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:18.912727 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 392/778] 10.222.0.17 () {56 vars in 1124 bytes} [Sat Jul 23 20:58:18 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:58:18.918095 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2c813e-d532-4144-a0e4-59ff046162c0 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:18.976437 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 387/779] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:58:18 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 23 20:58:19.024231 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f98ab26-cebd-4677-8f5f-035a0fdf7190 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:19.036257 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2c813e-d532-4144-a0e4-59ff046162c0 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:19.071793 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4e95b6-5e58-415d-b018-baab943a49d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:19.072562 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4e95b6-5e58-415d-b018-baab943a49d6 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:19.072842 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4e95b6-5e58-415d-b018-baab943a49d6 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:19.073108 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4e95b6-5e58-415d-b018-baab943a49d6 None admin] PATH_INFO: `/v3/services` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:19.073552 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:19.074832 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4e95b6-5e58-415d-b018-baab943a49d6 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:19.075137 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4e95b6-5e58-415d-b018-baab943a49d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:19.076887 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4e95b6-5e58-415d-b018-baab943a49d6 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:19.083416 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 393/780] 10.222.0.17 () {56 vars in 1124 bytes} [Sat Jul 23 20:58:18 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:58:19.088977 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4e95b6-5e58-415d-b018-baab943a49d6 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:19.130220 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:19.220223 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4e95b6-5e58-415d-b018-baab943a49d6 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:19.225325 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f98ab26-cebd-4677-8f5f-035a0fdf7190 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:19.259618 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ec4b7f-6214-41e7-b11d-7dc0b6faae8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:19.260308 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ec4b7f-6214-41e7-b11d-7dc0b6faae8e None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:19.260585 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ec4b7f-6214-41e7-b11d-7dc0b6faae8e None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:19.260849 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ec4b7f-6214-41e7-b11d-7dc0b6faae8e None admin] PATH_INFO: `/v3/endpoints` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:19.261648 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ec4b7f-6214-41e7-b11d-7dc0b6faae8e None admin] RBAC: Adding query filter params (interface=public, service_id=a7759754f6b54154856ee2bd9b03d4f0, region_id=RegionOne) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:19.261973 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ec4b7f-6214-41e7-b11d-7dc0b6faae8e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:19.263363 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ec4b7f-6214-41e7-b11d-7dc0b6faae8e None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:19.281495 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 394/781] 10.222.0.17 () {56 vars in 1251 bytes} [Sat Jul 23 20:58:19 2022] GET /identity/v3/endpoints?service_id=a7759754f6b54154856ee2bd9b03d4f0&interface=public®ion_id=RegionOne => generated 194 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 20:58:19.289009 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ec4b7f-6214-41e7-b11d-7dc0b6faae8e None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:19.305560 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0bab6b-83c1-40f4-917e-f40625c26ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:19.306460 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0bab6b-83c1-40f4-917e-f40625c26ab7 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:19.306740 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0bab6b-83c1-40f4-917e-f40625c26ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:19.307011 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0bab6b-83c1-40f4-917e-f40625c26ab7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:19.337462 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0bab6b-83c1-40f4-917e-f40625c26ab7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:58:19.346743 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-7b0bab6b-83c1-40f4-917e-f40625c26ab7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 23 20:58:19.346743 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:58:19.346743 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:58:19.346743 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:58:19.346743 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:58:19.346743 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:58:19.346743 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:58:19.346743 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:58:19.346743 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:58:19.346743 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:58:19.346743 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:58:19.346743 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:58:19.346743 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:58:19.346743 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:58:19.346743 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:58:19.346743 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:58:19.348163 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:58:19.348163 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:58:19.348163 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:58:19.348163 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:58:19.348163 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:58:19.348163 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:58:19.348163 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:58:19.348163 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:58:19.348163 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:58:19.348163 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:58:19.348163 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:58:19.348163 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application with Lock( Jul 23 20:58:19.348163 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:58:19.348163 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:58:19.348163 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:58:19.348163 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:58:19.349011 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:58:19.349011 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:58:19.349011 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:58:19.349011 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:58:19.349011 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:58:19.349011 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:58:19.349011 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:58:19.349011 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:58:19.349011 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:58:19.349011 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:58:19.349011 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 23 20:58:19.349011 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:58:19.351682 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 388/782] 10.222.0.17 () {56 vars in 1096 bytes} [Sat Jul 23 20:58:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:58:19.357517 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0bab6b-83c1-40f4-917e-f40625c26ab7 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:19.427541 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ec4b7f-6214-41e7-b11d-7dc0b6faae8e None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:19.438175 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:19.461398 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3402b894-38c1-4639-b7df-73de65b01d75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:19.462097 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3402b894-38c1-4639-b7df-73de65b01d75 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:19.462378 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3402b894-38c1-4639-b7df-73de65b01d75 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:19.462649 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3402b894-38c1-4639-b7df-73de65b01d75 None admin] PATH_INFO: `/v3/services` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:19.463325 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3402b894-38c1-4639-b7df-73de65b01d75 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:19.464787 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3402b894-38c1-4639-b7df-73de65b01d75 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:19.470493 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 395/783] 10.222.0.17 () {56 vars in 1087 bytes} [Sat Jul 23 20:58:19 2022] GET /identity/v3/services => generated 772 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:58:19.555262 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:19.580153 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0bab6b-83c1-40f4-917e-f40625c26ab7 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:19.631124 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053e9bd0-d37e-4fd3-ba9a-d840c310f6f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:19.631824 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053e9bd0-d37e-4fd3-ba9a-d840c310f6f8 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:19.632100 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053e9bd0-d37e-4fd3-ba9a-d840c310f6f8 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:19.632355 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053e9bd0-d37e-4fd3-ba9a-d840c310f6f8 None admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:19.633104 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053e9bd0-d37e-4fd3-ba9a-d840c310f6f8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:19.633400 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053e9bd0-d37e-4fd3-ba9a-d840c310f6f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:19.634810 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053e9bd0-d37e-4fd3-ba9a-d840c310f6f8 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:19.648290 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 389/784] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Jul 23 20:58:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 20:58:19.654469 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3402b894-38c1-4639-b7df-73de65b01d75 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:19.795632 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3402b894-38c1-4639-b7df-73de65b01d75 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:19.835488 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecca526e-7a45-461a-b3d1-04446476a674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:19.836560 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecca526e-7a45-461a-b3d1-04446476a674 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:19.836999 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecca526e-7a45-461a-b3d1-04446476a674 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:19.837410 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecca526e-7a45-461a-b3d1-04446476a674 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:19.849391 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecca526e-7a45-461a-b3d1-04446476a674 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:19.851093 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecca526e-7a45-461a-b3d1-04446476a674 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:19.854228 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:19.871121 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-ecca526e-7a45-461a-b3d1-04446476a674 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:58:19.871121 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:58:19.871121 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:58:19.871121 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:58:19.871121 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:58:19.871121 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:58:19.871121 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:58:19.871121 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:58:19.871121 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:58:19.871121 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:58:19.871121 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:58:19.871121 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:58:19.871121 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 23 20:58:19.871121 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 23 20:58:19.871121 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 23 20:58:19.872074 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 23 20:58:19.872074 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:58:19.872074 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:58:19.872074 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:58:19.872074 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:58:19.872074 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:58:19.872074 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:58:19.872074 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:58:19.872074 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application with Lock( Jul 23 20:58:19.872074 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:58:19.872074 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:58:19.872074 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:58:19.872074 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:58:19.872074 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:58:19.872074 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:58:19.872074 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:58:19.872074 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:58:19.872938 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 23 20:58:19.872938 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 23 20:58:19.872938 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:58:19.872938 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 20:58:19.872938 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 396/785] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 23 20:58:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:58:19.878182 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053e9bd0-d37e-4fd3-ba9a-d840c310f6f8 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:20.029020 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053e9bd0-d37e-4fd3-ba9a-d840c310f6f8 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:20.070557 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce379faa-64ff-42ea-a607-6fbe8cc6551a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:20.071576 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce379faa-64ff-42ea-a607-6fbe8cc6551a None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:20.072091 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce379faa-64ff-42ea-a607-6fbe8cc6551a None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:20.072566 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce379faa-64ff-42ea-a607-6fbe8cc6551a None admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:20.073517 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce379faa-64ff-42ea-a607-6fbe8cc6551a None admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:20.074037 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce379faa-64ff-42ea-a607-6fbe8cc6551a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:20.075777 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce379faa-64ff-42ea-a607-6fbe8cc6551a None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:20.095055 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 390/786] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 23 20:58:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:58:20.100824 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecca526e-7a45-461a-b3d1-04446476a674 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:20.249453 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecca526e-7a45-461a-b3d1-04446476a674 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:20.299944 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6492c9-26de-44e2-99e8-78f7e05b42b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:20.300815 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6492c9-26de-44e2-99e8-78f7e05b42b4 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:20.301091 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6492c9-26de-44e2-99e8-78f7e05b42b4 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:20.301361 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6492c9-26de-44e2-99e8-78f7e05b42b4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:20.315044 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6492c9-26de-44e2-99e8-78f7e05b42b4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:20.316586 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6492c9-26de-44e2-99e8-78f7e05b42b4 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:20.334502 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-bf6492c9-26de-44e2-99e8-78f7e05b42b4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 23 20:58:20.334502 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:58:20.334502 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:58:20.334502 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:58:20.334502 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:58:20.334502 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:58:20.334502 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:58:20.334502 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:58:20.334502 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:58:20.334502 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:58:20.334502 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:58:20.334502 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:58:20.334502 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 23 20:58:20.334502 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 23 20:58:20.334502 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 23 20:58:20.334502 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 23 20:58:20.335438 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:58:20.335438 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:58:20.335438 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 23 20:58:20.335438 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 23 20:58:20.335438 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 23 20:58:20.335438 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 23 20:58:20.335438 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:58:20.335438 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:58:20.335438 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:58:20.335438 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:58:20.335438 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:58:20.335438 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application with Lock( Jul 23 20:58:20.335438 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:58:20.335438 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:58:20.335438 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:58:20.335438 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:58:20.335438 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:58:20.335438 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:58:20.336360 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:58:20.336360 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:58:20.336360 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 23 20:58:20.336360 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 23 20:58:20.336360 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 23 20:58:20.336360 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 23 20:58:20.336360 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 23 20:58:20.336360 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 23 20:58:20.336360 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 23 20:58:20.336360 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 20:58:20.336360 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 397/787] 10.222.0.17 () {56 vars in 1093 bytes} [Sat Jul 23 20:58:20 2022] GET /identity/v3/users/nova => generated 82 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:58:20.341689 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce379faa-64ff-42ea-a607-6fbe8cc6551a None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:20.355969 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:20.493685 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce379faa-64ff-42ea-a607-6fbe8cc6551a None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:20.548472 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d53c57e-27fc-46c4-9e62-b050c87574ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:20.549164 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d53c57e-27fc-46c4-9e62-b050c87574ae None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:20.549441 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d53c57e-27fc-46c4-9e62-b050c87574ae None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:20.549712 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d53c57e-27fc-46c4-9e62-b050c87574ae None admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:20.550641 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d53c57e-27fc-46c4-9e62-b050c87574ae None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:20.550942 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d53c57e-27fc-46c4-9e62-b050c87574ae None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:20.552387 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d53c57e-27fc-46c4-9e62-b050c87574ae None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:20.577950 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 391/788] 10.222.0.17 () {56 vars in 1133 bytes} [Sat Jul 23 20:58:20 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:58:20.583649 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6492c9-26de-44e2-99e8-78f7e05b42b4 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:20.663071 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:20.685226 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7182c35-68e4-4b85-907a-c01f82fe9e47 None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:20.685548 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7182c35-68e4-4b85-907a-c01f82fe9e47 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:20.685782 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7182c35-68e4-4b85-907a-c01f82fe9e47 None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:20.687298 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 392/789] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:58:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 23 20:58:20.695277 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386f165f-1e97-4f62-b142-b57857b70f6f None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:20.695563 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386f165f-1e97-4f62-b142-b57857b70f6f None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:20.695846 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386f165f-1e97-4f62-b142-b57857b70f6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:20.716269 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6492c9-26de-44e2-99e8-78f7e05b42b4 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:20.738940 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-386f165f-1e97-4f62-b142-b57857b70f6f None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:58:20.740220 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-386f165f-1e97-4f62-b142-b57857b70f6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:58:20.767623 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b86a6b2-d605-4b39-a965-de1e7174aa9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:20.768296 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b86a6b2-d605-4b39-a965-de1e7174aa9e None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:20.768580 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b86a6b2-d605-4b39-a965-de1e7174aa9e None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:20.768855 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b86a6b2-d605-4b39-a965-de1e7174aa9e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:20.830260 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:20.847154 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 393/790] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:58:20 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 23 20:58:20.872445 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386f165f-1e97-4f62-b142-b57857b70f6f None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:20.904555 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b86a6b2-d605-4b39-a965-de1e7174aa9e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:20.906413 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b86a6b2-d605-4b39-a965-de1e7174aa9e None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:20.977272 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:21.041251 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 398/791] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Jul 23 20:58:20 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 23 20:58:21.042868 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cec01a-b19d-4e83-9d35-5eb3dd6e741b None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:21.043215 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cec01a-b19d-4e83-9d35-5eb3dd6e741b None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:21.043553 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cec01a-b19d-4e83-9d35-5eb3dd6e741b None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:21.045154 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 399/792] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:58:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:58:21.047159 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069d56ab-f795-4abe-b431-886e4b1163c5 None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:21.047573 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069d56ab-f795-4abe-b431-886e4b1163c5 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:21.047910 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069d56ab-f795-4abe-b431-886e4b1163c5 None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:21.049230 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 400/793] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:58:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:58:21.049797 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069d56ab-f795-4abe-b431-886e4b1163c5 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:21.058415 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386f165f-1e97-4f62-b142-b57857b70f6f None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:21.092120 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847d226a-ac89-44f7-a260-cb2ed2e04a0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:21.092921 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847d226a-ac89-44f7-a260-cb2ed2e04a0c None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:21.093194 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847d226a-ac89-44f7-a260-cb2ed2e04a0c None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:21.093740 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847d226a-ac89-44f7-a260-cb2ed2e04a0c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:21.104093 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847d226a-ac89-44f7-a260-cb2ed2e04a0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:58:21.111628 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-847d226a-ac89-44f7-a260-cb2ed2e04a0c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 23 20:58:21.111628 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:58:21.111628 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:58:21.111628 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:58:21.111628 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:58:21.111628 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:58:21.111628 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:58:21.111628 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:58:21.111628 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:58:21.111628 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:58:21.111628 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:58:21.111628 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:58:21.111628 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:58:21.111628 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:58:21.111628 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:58:21.111628 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:58:21.112553 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:58:21.112553 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:58:21.112553 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:58:21.112553 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:58:21.112553 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:58:21.112553 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:58:21.112553 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:58:21.112553 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:58:21.112553 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:58:21.112553 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:58:21.112553 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:58:21.112553 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application with Lock( Jul 23 20:58:21.112553 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:58:21.112553 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:58:21.112553 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:58:21.112553 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:58:21.113450 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:58:21.113450 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:58:21.113450 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:58:21.113450 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:58:21.113450 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:58:21.113450 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:58:21.113450 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:58:21.113450 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:58:21.113450 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:58:21.113450 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:58:21.113450 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 23 20:58:21.113450 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:58:21.113450 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 394/794] 10.222.0.17 () {56 vars in 1096 bytes} [Sat Jul 23 20:58:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:58:21.114668 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75e4ab8-21bb-4669-8410-ea401c158d68 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:21.114668 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75e4ab8-21bb-4669-8410-ea401c158d68 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:21.114668 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75e4ab8-21bb-4669-8410-ea401c158d68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:21.130655 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-f75e4ab8-21bb-4669-8410-ea401c158d68 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:58:21.131837 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-f75e4ab8-21bb-4669-8410-ea401c158d68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:58:21.161441 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069d56ab-f795-4abe-b431-886e4b1163c5 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:21.185337 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:21.202497 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f534aad2-e7b3-4572-962b-de22bfe61cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:21.203307 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f534aad2-e7b3-4572-962b-de22bfe61cdd None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:21.203584 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f534aad2-e7b3-4572-962b-de22bfe61cdd None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:21.203854 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f534aad2-e7b3-4572-962b-de22bfe61cdd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:21.209917 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 395/795] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:58:21 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 23 20:58:21.209917 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a5b55e-bdc9-4541-a25f-ace849460d73 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:21.209917 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a5b55e-bdc9-4541-a25f-ace849460d73 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:21.209917 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a5b55e-bdc9-4541-a25f-ace849460d73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:21.223669 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-18a5b55e-bdc9-4541-a25f-ace849460d73 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:58:21.224869 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-18a5b55e-bdc9-4541-a25f-ace849460d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:58:21.228593 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f534aad2-e7b3-4572-962b-de22bfe61cdd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:21.230322 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f534aad2-e7b3-4572-962b-de22bfe61cdd None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:21.250905 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-f534aad2-e7b3-4572-962b-de22bfe61cdd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:58:21.250905 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:58:21.250905 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:58:21.250905 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:58:21.250905 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:58:21.250905 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:58:21.250905 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:58:21.250905 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:58:21.250905 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:58:21.250905 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:58:21.250905 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:58:21.250905 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:58:21.250905 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 23 20:58:21.250905 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 23 20:58:21.250905 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 23 20:58:21.251849 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 23 20:58:21.251849 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:58:21.251849 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:58:21.251849 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:58:21.251849 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:58:21.251849 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:58:21.251849 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:58:21.251849 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:58:21.251849 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application with Lock( Jul 23 20:58:21.251849 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:58:21.251849 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:58:21.251849 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:58:21.251849 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:58:21.251849 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:58:21.251849 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:58:21.251849 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:58:21.251849 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:58:21.252743 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 23 20:58:21.252743 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 23 20:58:21.252743 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:58:21.252743 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 20:58:21.252743 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 401/796] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 23 20:58:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:58:21.253037 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f534aad2-e7b3-4572-962b-de22bfe61cdd None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:21.265336 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:21.302715 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 396/797] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:58:21 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 23 20:58:21.303769 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a5b55e-bdc9-4541-a25f-ace849460d73 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:21.379228 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f534aad2-e7b3-4572-962b-de22bfe61cdd None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:21.410989 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a5b55e-bdc9-4541-a25f-ace849460d73 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:21.419703 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c862864-3a6c-4313-a692-f3f3b71436a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:21.420384 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c862864-3a6c-4313-a692-f3f3b71436a6 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:21.420665 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c862864-3a6c-4313-a692-f3f3b71436a6 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:21.420935 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c862864-3a6c-4313-a692-f3f3b71436a6 None admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:21.421737 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c862864-3a6c-4313-a692-f3f3b71436a6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:21.422118 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c862864-3a6c-4313-a692-f3f3b71436a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:21.423533 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c862864-3a6c-4313-a692-f3f3b71436a6 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:21.426127 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:21.437185 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 402/798] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Jul 23 20:58:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:58:21.437185 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c862864-3a6c-4313-a692-f3f3b71436a6 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:21.454523 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54cbe91-4a58-4483-8488-ef5da400b61c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:21.455337 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54cbe91-4a58-4483-8488-ef5da400b61c None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:21.455616 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54cbe91-4a58-4483-8488-ef5da400b61c None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:21.455887 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54cbe91-4a58-4483-8488-ef5da400b61c None admin] PATH_INFO: `/v3/roles/service` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:21.466796 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54cbe91-4a58-4483-8488-ef5da400b61c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:58:21.474578 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-e54cbe91-4a58-4483-8488-ef5da400b61c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 23 20:58:21.474578 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:58:21.474578 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:58:21.474578 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:58:21.474578 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:58:21.474578 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:58:21.474578 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:58:21.474578 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:58:21.474578 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:58:21.474578 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:58:21.474578 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:58:21.474578 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:58:21.474578 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:58:21.474578 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:58:21.474578 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:58:21.474578 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:58:21.475504 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:58:21.475504 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:58:21.475504 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:58:21.475504 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:58:21.475504 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:58:21.475504 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:58:21.475504 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:58:21.475504 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:58:21.475504 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:58:21.475504 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:58:21.475504 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:58:21.475504 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application with Lock( Jul 23 20:58:21.475504 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:58:21.475504 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:58:21.475504 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:58:21.475504 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:58:21.476335 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:58:21.476335 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:58:21.476335 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:58:21.476335 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:58:21.476335 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:58:21.476335 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:58:21.476335 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:58:21.476335 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:58:21.476335 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:58:21.476335 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:58:21.476335 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 23 20:58:21.476335 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:58:21.476335 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 397/799] 10.222.0.17 () {56 vars in 1102 bytes} [Sat Jul 23 20:58:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:58:21.477009 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54cbe91-4a58-4483-8488-ef5da400b61c None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:21.509167 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:21.542252 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c862864-3a6c-4313-a692-f3f3b71436a6 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:21.576320 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3051fc-a372-4752-99ff-a4ffe6ee8ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:21.576988 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3051fc-a372-4752-99ff-a4ffe6ee8ee8 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:21.577265 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3051fc-a372-4752-99ff-a4ffe6ee8ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:21.577534 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3051fc-a372-4752-99ff-a4ffe6ee8ee8 None admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:21.578282 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3051fc-a372-4752-99ff-a4ffe6ee8ee8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:21.578581 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3051fc-a372-4752-99ff-a4ffe6ee8ee8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:21.579941 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3051fc-a372-4752-99ff-a4ffe6ee8ee8 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:21.585190 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54cbe91-4a58-4483-8488-ef5da400b61c None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:21.596401 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 403/800] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 23 20:58:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:58:21.596401 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3051fc-a372-4752-99ff-a4ffe6ee8ee8 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:21.631229 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23f03d4-b280-4e13-8c46-463847c2b5af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:21.632136 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23f03d4-b280-4e13-8c46-463847c2b5af None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:21.632485 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23f03d4-b280-4e13-8c46-463847c2b5af None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:21.632838 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23f03d4-b280-4e13-8c46-463847c2b5af None admin] PATH_INFO: `/v3/services/network` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:21.633554 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23f03d4-b280-4e13-8c46-463847c2b5af None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:21.635036 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23f03d4-b280-4e13-8c46-463847c2b5af None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:21.647715 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-b23f03d4-b280-4e13-8c46-463847c2b5af None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 23 20:58:21.647715 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:58:21.647715 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 23 20:58:21.647715 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 23 20:58:21.647715 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 23 20:58:21.647715 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 23 20:58:21.647715 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 23 20:58:21.647715 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 23 20:58:21.647715 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 23 20:58:21.647715 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:58:21.647715 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 23 20:58:21.647715 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:58:21.647715 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:58:21.647715 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:58:21.647715 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:58:21.647715 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:58:21.647715 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:58:21.648776 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:58:21.648776 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:58:21.648776 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:58:21.648776 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:58:21.648776 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:58:21.648776 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:58:21.648776 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 23 20:58:21.648776 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 23 20:58:21.648776 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 23 20:58:21.648776 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 23 20:58:21.648776 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:58:21.648776 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:58:21.648776 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:58:21.648776 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:58:21.648776 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:58:21.648776 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:58:21.649607 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:58:21.649607 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application with Lock( Jul 23 20:58:21.649607 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:58:21.649607 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:58:21.649607 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:58:21.649607 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:58:21.649607 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:58:21.649607 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:58:21.649607 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:58:21.649607 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:58:21.649607 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 23 20:58:21.649607 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 23 20:58:21.649607 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 23 20:58:21.649607 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:58:21.649607 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 398/801] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Jul 23 20:58:21 2022] GET /identity/v3/services/network => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:58:21.651466 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23f03d4-b280-4e13-8c46-463847c2b5af None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:21.692138 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:21.709895 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3051fc-a372-4752-99ff-a4ffe6ee8ee8 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:21.739197 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:21.746328 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3e4b82-f151-4106-84f4-e6c5002e88df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:21.747080 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3e4b82-f151-4106-84f4-e6c5002e88df None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:21.747356 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3e4b82-f151-4106-84f4-e6c5002e88df None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:21.748087 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3e4b82-f151-4106-84f4-e6c5002e88df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:21.759459 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3e4b82-f151-4106-84f4-e6c5002e88df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:21.760459 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23f03d4-b280-4e13-8c46-463847c2b5af None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:21.760852 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3e4b82-f151-4106-84f4-e6c5002e88df None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:21.781780 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-4d3e4b82-f151-4106-84f4-e6c5002e88df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:58:21.781780 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:58:21.781780 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:58:21.781780 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:58:21.781780 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:58:21.781780 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:58:21.781780 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:58:21.781780 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:58:21.781780 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:58:21.781780 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:58:21.781780 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:58:21.781780 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:58:21.781780 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 23 20:58:21.781780 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 23 20:58:21.781780 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 23 20:58:21.782988 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 23 20:58:21.782988 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:58:21.782988 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:58:21.782988 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:58:21.782988 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:58:21.782988 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:58:21.782988 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:58:21.782988 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:58:21.782988 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application with Lock( Jul 23 20:58:21.782988 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:58:21.782988 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:58:21.782988 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:58:21.782988 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:58:21.782988 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:58:21.782988 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:58:21.782988 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:58:21.782988 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:58:21.783863 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 23 20:58:21.783863 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 23 20:58:21.783863 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:58:21.783863 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 20:58:21.783863 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 404/802] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 23 20:58:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:58:21.783863 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3e4b82-f151-4106-84f4-e6c5002e88df None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:21.798351 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45641fef-02c5-47c0-a0d9-ac2a41730e0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:21.799035 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45641fef-02c5-47c0-a0d9-ac2a41730e0a None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:21.799307 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45641fef-02c5-47c0-a0d9-ac2a41730e0a None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:21.799574 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45641fef-02c5-47c0-a0d9-ac2a41730e0a None admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:21.800630 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45641fef-02c5-47c0-a0d9-ac2a41730e0a None admin] RBAC: Adding query filter params (name=service) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:21.800941 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45641fef-02c5-47c0-a0d9-ac2a41730e0a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:21.802332 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45641fef-02c5-47c0-a0d9-ac2a41730e0a None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:21.815803 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 399/803] 10.222.0.17 () {56 vars in 1103 bytes} [Sat Jul 23 20:58:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:58:21.816641 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45641fef-02c5-47c0-a0d9-ac2a41730e0a None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:21.900886 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3e4b82-f151-4106-84f4-e6c5002e88df None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:21.916439 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:21.919733 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45641fef-02c5-47c0-a0d9-ac2a41730e0a None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:21.941411 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae664c5e-b87a-4335-9fa4-68205c4b0d68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:21.942300 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae664c5e-b87a-4335-9fa4-68205c4b0d68 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:21.942576 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae664c5e-b87a-4335-9fa4-68205c4b0d68 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:21.942848 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae664c5e-b87a-4335-9fa4-68205c4b0d68 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:21.950386 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae664c5e-b87a-4335-9fa4-68205c4b0d68 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:21.951883 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae664c5e-b87a-4335-9fa4-68205c4b0d68 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:21.955016 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377c5074-cb2b-4acd-bf43-8615dd7eeae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:21.955645 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377c5074-cb2b-4acd-bf43-8615dd7eeae7 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:21.955924 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377c5074-cb2b-4acd-bf43-8615dd7eeae7 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:21.956195 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377c5074-cb2b-4acd-bf43-8615dd7eeae7 None admin] PATH_INFO: `/v3/services` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:21.956948 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377c5074-cb2b-4acd-bf43-8615dd7eeae7 None admin] RBAC: Adding query filter params (name=network) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:21.957248 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377c5074-cb2b-4acd-bf43-8615dd7eeae7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:21.958869 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377c5074-cb2b-4acd-bf43-8615dd7eeae7 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:21.968310 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 400/804] 10.222.0.17 () {56 vars in 1112 bytes} [Sat Jul 23 20:58:21 2022] GET /identity/v3/services?name=network => generated 124 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:58:21.968310 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377c5074-cb2b-4acd-bf43-8615dd7eeae7 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:21.968538 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-ae664c5e-b87a-4335-9fa4-68205c4b0d68 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 23 20:58:21.968538 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:58:21.968538 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:58:21.968538 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:58:21.968538 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:58:21.968538 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:58:21.968538 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:58:21.968538 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:58:21.968538 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:58:21.968538 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:58:21.968538 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:58:21.968538 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:58:21.968538 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 23 20:58:21.968538 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 23 20:58:21.968538 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 23 20:58:21.969349 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 23 20:58:21.969349 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:58:21.969349 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:58:21.969349 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:58:21.969349 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:58:21.969349 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:58:21.969349 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:58:21.969349 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:58:21.969349 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application with Lock( Jul 23 20:58:21.969349 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:58:21.969349 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:58:21.969349 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:58:21.969349 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:58:21.969349 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:58:21.969349 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:58:21.969349 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:58:21.969349 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:58:21.970790 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 23 20:58:21.970790 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 23 20:58:21.970790 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 23 20:58:21.970790 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 23 20:58:21.970790 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 23 20:58:21.970790 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 23 20:58:21.970790 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 23 20:58:21.970790 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 20:58:21.970790 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 405/805] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Jul 23 20:58:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:58:21.970790 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae664c5e-b87a-4335-9fa4-68205c4b0d68 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:22.016651 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:22.082184 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377c5074-cb2b-4acd-bf43-8615dd7eeae7 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:22.082577 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae664c5e-b87a-4335-9fa4-68205c4b0d68 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:22.116750 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76017801-0a75-411c-8fc3-cd3843f3578b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:22.117701 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76017801-0a75-411c-8fc3-cd3843f3578b None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:22.117833 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6a2bb1-9d61-4c95-9cc8-2388f53b96a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:22.118108 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76017801-0a75-411c-8fc3-cd3843f3578b None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:22.118287 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76017801-0a75-411c-8fc3-cd3843f3578b None admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:22.118666 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6a2bb1-9d61-4c95-9cc8-2388f53b96a2 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:22.118939 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6a2bb1-9d61-4c95-9cc8-2388f53b96a2 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:22.119033 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76017801-0a75-411c-8fc3-cd3843f3578b None admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:22.119208 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6a2bb1-9d61-4c95-9cc8-2388f53b96a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:22.119312 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76017801-0a75-411c-8fc3-cd3843f3578b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:22.120734 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76017801-0a75-411c-8fc3-cd3843f3578b None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:22.130339 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6a2bb1-9d61-4c95-9cc8-2388f53b96a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:22.131788 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6a2bb1-9d61-4c95-9cc8-2388f53b96a2 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:22.133059 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 401/806] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 23 20:58:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:58:22.138243 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76017801-0a75-411c-8fc3-cd3843f3578b None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:22.149755 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-8f6a2bb1-9d61-4c95-9cc8-2388f53b96a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:58:22.149755 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:58:22.149755 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:58:22.149755 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:58:22.149755 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:58:22.149755 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:58:22.149755 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:58:22.149755 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:58:22.149755 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:58:22.149755 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:58:22.149755 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:58:22.149755 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:58:22.149755 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 23 20:58:22.149755 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 23 20:58:22.149755 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 23 20:58:22.150841 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 23 20:58:22.150841 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:58:22.150841 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:58:22.150841 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:58:22.150841 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:58:22.150841 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:58:22.150841 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:58:22.150841 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:58:22.150841 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application with Lock( Jul 23 20:58:22.150841 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:58:22.150841 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:58:22.150841 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:58:22.150841 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:58:22.150841 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:58:22.150841 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:58:22.150841 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:58:22.150841 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:58:22.151719 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 23 20:58:22.151719 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 23 20:58:22.151719 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:58:22.151719 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 20:58:22.151719 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 406/807] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 23 20:58:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:58:22.152000 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6a2bb1-9d61-4c95-9cc8-2388f53b96a2 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:22.170685 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:22.257033 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76017801-0a75-411c-8fc3-cd3843f3578b None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:22.258045 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:22.265704 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6a2bb1-9d61-4c95-9cc8-2388f53b96a2 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:22.298887 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbebbcae-3398-4ae1-a46c-d415f78d9ea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:22.299477 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbebbcae-3398-4ae1-a46c-d415f78d9ea2 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:22.299752 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbebbcae-3398-4ae1-a46c-d415f78d9ea2 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:22.300019 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbebbcae-3398-4ae1-a46c-d415f78d9ea2 None admin] PATH_INFO: `/v3/services` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:22.301029 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbebbcae-3398-4ae1-a46c-d415f78d9ea2 None admin] RBAC: Adding query filter params (type=network) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:22.301324 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbebbcae-3398-4ae1-a46c-d415f78d9ea2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:22.302854 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbebbcae-3398-4ae1-a46c-d415f78d9ea2 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:22.305418 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d10b03f-c91e-4514-b760-fd3d00805cff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:22.306119 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d10b03f-c91e-4514-b760-fd3d00805cff None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:22.306400 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d10b03f-c91e-4514-b760-fd3d00805cff None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:22.306675 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d10b03f-c91e-4514-b760-fd3d00805cff None admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:22.307468 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d10b03f-c91e-4514-b760-fd3d00805cff None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:22.307770 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d10b03f-c91e-4514-b760-fd3d00805cff None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:22.309194 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d10b03f-c91e-4514-b760-fd3d00805cff None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:22.309620 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 402/808] 10.222.0.17 () {56 vars in 1112 bytes} [Sat Jul 23 20:58:22 2022] GET /identity/v3/services?type=network => generated 350 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:58:22.310659 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbebbcae-3398-4ae1-a46c-d415f78d9ea2 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:22.330685 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 407/809] 10.222.0.17 () {56 vars in 1148 bytes} [Sat Jul 23 20:58:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:58:22.330685 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d10b03f-c91e-4514-b760-fd3d00805cff None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:22.411931 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:22.424389 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbebbcae-3398-4ae1-a46c-d415f78d9ea2 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:22.439444 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d10b03f-c91e-4514-b760-fd3d00805cff None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:22.459500 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5625826e-7476-4f58-abc4-f381e5e1c709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:22.460318 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5625826e-7476-4f58-abc4-f381e5e1c709 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:22.460575 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5625826e-7476-4f58-abc4-f381e5e1c709 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:22.460841 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5625826e-7476-4f58-abc4-f381e5e1c709 None admin] PATH_INFO: `/v3/users/swift` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:22.467899 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5625826e-7476-4f58-abc4-f381e5e1c709 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:22.469342 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5625826e-7476-4f58-abc4-f381e5e1c709 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:22.473606 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5712ae0-9720-414e-a21a-392a0e7e84d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:22.474309 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5712ae0-9720-414e-a21a-392a0e7e84d3 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:22.474589 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5712ae0-9720-414e-a21a-392a0e7e84d3 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:22.474867 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5712ae0-9720-414e-a21a-392a0e7e84d3 None admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:22.475580 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5712ae0-9720-414e-a21a-392a0e7e84d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:22.475878 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5712ae0-9720-414e-a21a-392a0e7e84d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:22.477221 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5712ae0-9720-414e-a21a-392a0e7e84d3 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:22.483637 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-5625826e-7476-4f58-abc4-f381e5e1c709 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 23 20:58:22.483637 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:58:22.483637 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:58:22.483637 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:58:22.483637 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:58:22.483637 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:58:22.483637 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:58:22.483637 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:58:22.483637 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:58:22.483637 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:58:22.483637 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:58:22.483637 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:58:22.483637 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 23 20:58:22.483637 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 23 20:58:22.483637 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 23 20:58:22.483637 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 23 20:58:22.484774 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:58:22.484774 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:58:22.484774 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 23 20:58:22.484774 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 23 20:58:22.484774 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 23 20:58:22.484774 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 23 20:58:22.484774 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:58:22.484774 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:58:22.484774 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:58:22.484774 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:58:22.484774 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:58:22.484774 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application with Lock( Jul 23 20:58:22.484774 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:58:22.484774 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:58:22.484774 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:58:22.484774 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:58:22.484774 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:58:22.484774 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:58:22.485934 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:58:22.485934 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:58:22.485934 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 23 20:58:22.485934 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 23 20:58:22.485934 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 23 20:58:22.485934 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 23 20:58:22.485934 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 23 20:58:22.485934 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 23 20:58:22.485934 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 23 20:58:22.485934 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:58:22.485934 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 403/810] 10.222.0.17 () {56 vars in 1096 bytes} [Sat Jul 23 20:58:22 2022] GET /identity/v3/users/swift => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:58:22.485934 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5625826e-7476-4f58-abc4-f381e5e1c709 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:22.494037 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 408/811] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 23 20:58:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:58:22.494878 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5712ae0-9720-414e-a21a-392a0e7e84d3 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:22.512040 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:22.590489 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5625826e-7476-4f58-abc4-f381e5e1c709 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:22.595420 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5712ae0-9720-414e-a21a-392a0e7e84d3 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:22.629566 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1877b705-e26f-4bc5-9284-66e7846f5c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:22.630266 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1877b705-e26f-4bc5-9284-66e7846f5c3c None admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:22.630548 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1877b705-e26f-4bc5-9284-66e7846f5c3c None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:22.630821 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1877b705-e26f-4bc5-9284-66e7846f5c3c None admin] PATH_INFO: `/v3/endpoints` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:22.631555 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1877b705-e26f-4bc5-9284-66e7846f5c3c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:22.631846 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2201abb-4283-4191-85ab-c538c1393426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:22.632489 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2201abb-4283-4191-85ab-c538c1393426 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:22.632781 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2201abb-4283-4191-85ab-c538c1393426 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:22.632941 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1877b705-e26f-4bc5-9284-66e7846f5c3c None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:22.633038 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2201abb-4283-4191-85ab-c538c1393426 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:22.633833 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2201abb-4283-4191-85ab-c538c1393426 None admin] RBAC: Adding query filter params (role.id=fec17bfdc65349a2b9c06a89131191df, scope.project.id=4804ed61295f4d4a92d9b685dd9e9f3b, user.id=079f31ed2c844e67bd4e206f24b69d97) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:22.634167 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2201abb-4283-4191-85ab-c538c1393426 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:22.635590 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2201abb-4283-4191-85ab-c538c1393426 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:22.641992 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 409/812] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Jul 23 20:58:22 2022] GET /identity/v3/role_assignments?user.id=079f31ed2c844e67bd4e206f24b69d97&scope.project.id=4804ed61295f4d4a92d9b685dd9e9f3b&role.id=fec17bfdc65349a2b9c06a89131191df => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:58:22.643290 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece46f37-1580-4e5f-8a58-67535ab8661c None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:22.643571 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece46f37-1580-4e5f-8a58-67535ab8661c None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:22.643841 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece46f37-1580-4e5f-8a58-67535ab8661c None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:22.645191 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 410/813] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:58:22 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:58:22.645765 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece46f37-1580-4e5f-8a58-67535ab8661c None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:22.676532 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 404/814] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 23 20:58:22 2022] POST /identity/v3/endpoints => generated 327 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 20:58:22.676532 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1877b705-e26f-4bc5-9284-66e7846f5c3c None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:22.684617 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:22.768076 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:22.812113 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece46f37-1580-4e5f-8a58-67535ab8661c None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:22.829273 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1877b705-e26f-4bc5-9284-66e7846f5c3c None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:22.855400 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b24c51-4e7a-4658-ab76-2d89b8df92f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:22.856465 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b24c51-4e7a-4658-ab76-2d89b8df92f6 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:22.856955 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b24c51-4e7a-4658-ab76-2d89b8df92f6 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:22.857427 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b24c51-4e7a-4658-ab76-2d89b8df92f6 None admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:22.858539 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b24c51-4e7a-4658-ab76-2d89b8df92f6 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:22.859100 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b24c51-4e7a-4658-ab76-2d89b8df92f6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:22.860796 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b24c51-4e7a-4658-ab76-2d89b8df92f6 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:22.871889 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a2134b-d419-4b75-8ef4-a77ef2f26528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:22.873488 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a2134b-d419-4b75-8ef4-a77ef2f26528 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:22.873488 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a2134b-d419-4b75-8ef4-a77ef2f26528 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:22.873488 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a2134b-d419-4b75-8ef4-a77ef2f26528 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:22.882135 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a2134b-d419-4b75-8ef4-a77ef2f26528 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:22.883682 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a2134b-d419-4b75-8ef4-a77ef2f26528 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:22.884546 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 411/815] 10.222.0.17 () {56 vars in 1135 bytes} [Sat Jul 23 20:58:22 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:58:22.885920 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255f6f6a-4889-4cf6-b898-e642bb2cac92 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:22.886204 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255f6f6a-4889-4cf6-b898-e642bb2cac92 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:22.886457 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255f6f6a-4889-4cf6-b898-e642bb2cac92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:22.901754 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-64a2134b-d419-4b75-8ef4-a77ef2f26528 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 23 20:58:22.901754 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:58:22.901754 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:58:22.901754 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:58:22.901754 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:58:22.901754 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:58:22.901754 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:58:22.901754 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:58:22.901754 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:58:22.901754 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:58:22.901754 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:58:22.901754 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:58:22.901754 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 23 20:58:22.901754 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 23 20:58:22.901754 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 23 20:58:22.901754 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 23 20:58:22.902809 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:58:22.902809 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:58:22.902809 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 23 20:58:22.902809 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 23 20:58:22.902809 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 23 20:58:22.902809 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 23 20:58:22.902809 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:58:22.902809 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:58:22.902809 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:58:22.902809 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:58:22.902809 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:58:22.902809 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application with Lock( Jul 23 20:58:22.902809 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:58:22.902809 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:58:22.902809 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:58:22.902809 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:58:22.902809 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:58:22.902809 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:58:22.904113 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:58:22.904113 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:58:22.904113 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 23 20:58:22.904113 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 23 20:58:22.904113 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 23 20:58:22.904113 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 23 20:58:22.904113 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 23 20:58:22.904113 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 23 20:58:22.904113 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 23 20:58:22.904113 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:58:22.904113 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 405/816] 10.222.0.17 () {56 vars in 1117 bytes} [Sat Jul 23 20:58:22 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:58:22.905373 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a2134b-d419-4b75-8ef4-a77ef2f26528 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:22.906819 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-255f6f6a-4889-4cf6-b898-e642bb2cac92 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:58:22.907263 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-255f6f6a-4889-4cf6-b898-e642bb2cac92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:58:22.982245 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:23.002195 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 412/817] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:58:22 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 23 20:58:23.003390 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255f6f6a-4889-4cf6-b898-e642bb2cac92 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:23.025012 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a2134b-d419-4b75-8ef4-a77ef2f26528 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:23.061240 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0805107-b9ee-412c-a516-f278c9035c26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:23.062109 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0805107-b9ee-412c-a516-f278c9035c26 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:23.062383 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0805107-b9ee-412c-a516-f278c9035c26 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:23.062652 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0805107-b9ee-412c-a516-f278c9035c26 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:23.073613 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0805107-b9ee-412c-a516-f278c9035c26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:23.075080 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0805107-b9ee-412c-a516-f278c9035c26 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:23.077111 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:23.094133 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-b0805107-b9ee-412c-a516-f278c9035c26 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:58:23.094133 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:58:23.094133 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:58:23.094133 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:58:23.094133 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:58:23.094133 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:58:23.094133 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:58:23.094133 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:58:23.094133 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:58:23.094133 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:58:23.094133 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:58:23.094133 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:58:23.094133 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 23 20:58:23.094133 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 23 20:58:23.094133 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 23 20:58:23.095140 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 23 20:58:23.095140 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:58:23.095140 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:58:23.095140 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:58:23.095140 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:58:23.095140 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:58:23.095140 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:58:23.095140 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:58:23.095140 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application with Lock( Jul 23 20:58:23.095140 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:58:23.095140 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:58:23.095140 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:58:23.095140 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:58:23.095140 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:58:23.095140 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:58:23.095140 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:58:23.095140 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:58:23.096048 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 23 20:58:23.096048 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 23 20:58:23.096048 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:58:23.096048 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:58:23.098017 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 406/818] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 23 20:58:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:58:23.099683 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0805107-b9ee-412c-a516-f278c9035c26 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:23.122586 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255f6f6a-4889-4cf6-b898-e642bb2cac92 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:23.160463 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab585d50-f7f8-4447-88e0-e1dca019b57e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:23.161237 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab585d50-f7f8-4447-88e0-e1dca019b57e None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:23.161516 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab585d50-f7f8-4447-88e0-e1dca019b57e None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:23.161781 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab585d50-f7f8-4447-88e0-e1dca019b57e None admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:23.162642 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab585d50-f7f8-4447-88e0-e1dca019b57e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:23.162946 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab585d50-f7f8-4447-88e0-e1dca019b57e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:23.164369 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab585d50-f7f8-4447-88e0-e1dca019b57e None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:23.188815 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 413/819] 10.222.0.17 () {56 vars in 1149 bytes} [Sat Jul 23 20:58:23 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:58:23.188815 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab585d50-f7f8-4447-88e0-e1dca019b57e None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:23.206520 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0805107-b9ee-412c-a516-f278c9035c26 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:23.224253 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:23.245488 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cc5ddb-0dd7-4416-b8c8-e33d86796cac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:23.246384 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cc5ddb-0dd7-4416-b8c8-e33d86796cac None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:23.246715 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cc5ddb-0dd7-4416-b8c8-e33d86796cac None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:23.246901 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cc5ddb-0dd7-4416-b8c8-e33d86796cac None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:23.247557 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cc5ddb-0dd7-4416-b8c8-e33d86796cac None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:23.248935 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cc5ddb-0dd7-4416-b8c8-e33d86796cac None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:23.261637 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-42cc5ddb-0dd7-4416-b8c8-e33d86796cac None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 23 20:58:23.261637 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:58:23.261637 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 23 20:58:23.261637 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 23 20:58:23.261637 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 23 20:58:23.261637 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 23 20:58:23.261637 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 23 20:58:23.261637 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 23 20:58:23.261637 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 23 20:58:23.261637 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:58:23.261637 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 23 20:58:23.261637 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:58:23.261637 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:58:23.261637 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:58:23.261637 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:58:23.261637 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:58:23.262928 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:58:23.262928 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:58:23.262928 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:58:23.262928 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:58:23.262928 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:58:23.262928 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:58:23.262928 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:58:23.262928 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 23 20:58:23.262928 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 23 20:58:23.262928 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 23 20:58:23.262928 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 23 20:58:23.262928 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:58:23.262928 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:58:23.262928 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:58:23.262928 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:58:23.262928 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:58:23.263795 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:58:23.263795 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:58:23.263795 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application with Lock( Jul 23 20:58:23.263795 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:58:23.263795 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:58:23.263795 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:58:23.263795 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:58:23.263795 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:58:23.263795 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:58:23.263795 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:58:23.263795 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:58:23.263795 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 23 20:58:23.263795 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 23 20:58:23.263795 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 23 20:58:23.263795 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:58:23.263795 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 407/820] 10.222.0.17 () {56 vars in 1129 bytes} [Sat Jul 23 20:58:23 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:58:23.264644 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cc5ddb-0dd7-4416-b8c8-e33d86796cac None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:23.313976 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab585d50-f7f8-4447-88e0-e1dca019b57e None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:23.337124 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:23.353091 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca532252-050f-4ae4-8546-aeec444d32c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:23.353769 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca532252-050f-4ae4-8546-aeec444d32c1 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:23.354083 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca532252-050f-4ae4-8546-aeec444d32c1 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:23.354357 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca532252-050f-4ae4-8546-aeec444d32c1 None admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:23.355074 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca532252-050f-4ae4-8546-aeec444d32c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:23.355373 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca532252-050f-4ae4-8546-aeec444d32c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:23.356740 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca532252-050f-4ae4-8546-aeec444d32c1 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:23.367844 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 414/821] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 23 20:58:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:58:23.368643 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca532252-050f-4ae4-8546-aeec444d32c1 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:23.376352 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cc5ddb-0dd7-4416-b8c8-e33d86796cac None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:23.414819 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80e9a30-6cea-49d5-90e5-8c74d65b6b96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:23.415627 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80e9a30-6cea-49d5-90e5-8c74d65b6b96 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:23.415899 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80e9a30-6cea-49d5-90e5-8c74d65b6b96 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:23.416163 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80e9a30-6cea-49d5-90e5-8c74d65b6b96 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:23.427847 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80e9a30-6cea-49d5-90e5-8c74d65b6b96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:23.429286 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80e9a30-6cea-49d5-90e5-8c74d65b6b96 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:23.447251 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-c80e9a30-6cea-49d5-90e5-8c74d65b6b96 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:58:23.447251 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:58:23.447251 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:58:23.447251 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:58:23.447251 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:58:23.447251 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:58:23.447251 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:58:23.447251 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:58:23.447251 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:58:23.447251 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:58:23.447251 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:58:23.447251 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:58:23.447251 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 23 20:58:23.447251 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 23 20:58:23.447251 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 23 20:58:23.448371 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 23 20:58:23.448371 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:58:23.448371 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:58:23.448371 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:58:23.448371 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:58:23.448371 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:58:23.448371 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:58:23.448371 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:58:23.448371 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application with Lock( Jul 23 20:58:23.448371 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:58:23.448371 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:58:23.448371 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:58:23.448371 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:58:23.448371 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:58:23.448371 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:58:23.448371 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:58:23.448371 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:58:23.449467 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 23 20:58:23.449467 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 23 20:58:23.449467 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:58:23.449467 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:58:23.453189 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 408/822] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 23 20:58:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:58:23.454111 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80e9a30-6cea-49d5-90e5-8c74d65b6b96 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:23.484779 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:23.489086 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca532252-050f-4ae4-8546-aeec444d32c1 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:23.529251 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57627ec6-63bb-478d-bf99-c36e1889e25f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:23.529967 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57627ec6-63bb-478d-bf99-c36e1889e25f None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:23.530252 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57627ec6-63bb-478d-bf99-c36e1889e25f None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:23.530529 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57627ec6-63bb-478d-bf99-c36e1889e25f None admin] PATH_INFO: `/v3/services` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:23.531238 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57627ec6-63bb-478d-bf99-c36e1889e25f None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:23.531532 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57627ec6-63bb-478d-bf99-c36e1889e25f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:23.532915 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57627ec6-63bb-478d-bf99-c36e1889e25f None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:23.537850 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 415/823] 10.222.0.17 () {56 vars in 1124 bytes} [Sat Jul 23 20:58:23 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:58:23.543077 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57627ec6-63bb-478d-bf99-c36e1889e25f None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:23.562231 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80e9a30-6cea-49d5-90e5-8c74d65b6b96 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:23.590533 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:23.598039 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca54a3d-699d-4997-9466-07c9034c6c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:23.598842 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca54a3d-699d-4997-9466-07c9034c6c41 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:23.599571 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca54a3d-699d-4997-9466-07c9034c6c41 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:23.599571 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca54a3d-699d-4997-9466-07c9034c6c41 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:23.606828 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca54a3d-699d-4997-9466-07c9034c6c41 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:23.608261 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca54a3d-699d-4997-9466-07c9034c6c41 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:23.623016 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-5ca54a3d-699d-4997-9466-07c9034c6c41 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 23 20:58:23.623016 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:58:23.623016 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:58:23.623016 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:58:23.623016 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:58:23.623016 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:58:23.623016 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:58:23.623016 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:58:23.623016 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:58:23.623016 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:58:23.623016 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:58:23.623016 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:58:23.623016 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 23 20:58:23.623016 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 23 20:58:23.623016 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 23 20:58:23.623996 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 23 20:58:23.623996 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:58:23.623996 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:58:23.623996 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:58:23.623996 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:58:23.623996 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:58:23.623996 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:58:23.623996 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:58:23.623996 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application with Lock( Jul 23 20:58:23.623996 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:58:23.623996 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:58:23.623996 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:58:23.623996 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:58:23.623996 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:58:23.623996 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:58:23.623996 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:58:23.623996 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:58:23.624875 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 23 20:58:23.624875 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 23 20:58:23.624875 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 23 20:58:23.624875 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 23 20:58:23.624875 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 23 20:58:23.624875 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 23 20:58:23.624875 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 23 20:58:23.624875 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:58:23.624875 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 409/824] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Jul 23 20:58:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:58:23.625403 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca54a3d-699d-4997-9466-07c9034c6c41 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:23.667578 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57627ec6-63bb-478d-bf99-c36e1889e25f None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:23.712944 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171b4993-d18c-40e9-9f52-119c7abad394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:23.713637 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171b4993-d18c-40e9-9f52-119c7abad394 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:23.713942 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171b4993-d18c-40e9-9f52-119c7abad394 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:23.716840 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171b4993-d18c-40e9-9f52-119c7abad394 None admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:23.716840 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171b4993-d18c-40e9-9f52-119c7abad394 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:23.716840 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171b4993-d18c-40e9-9f52-119c7abad394 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:23.717780 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171b4993-d18c-40e9-9f52-119c7abad394 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:23.737335 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 416/825] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 23 20:58:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:58:23.738311 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171b4993-d18c-40e9-9f52-119c7abad394 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:23.751220 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:23.765163 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca54a3d-699d-4997-9466-07c9034c6c41 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:23.813503 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1442d12a-468d-47c5-ba4b-6d93a4f17a77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:23.815048 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1442d12a-468d-47c5-ba4b-6d93a4f17a77 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:23.816424 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1442d12a-468d-47c5-ba4b-6d93a4f17a77 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:23.816949 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1442d12a-468d-47c5-ba4b-6d93a4f17a77 None admin] PATH_INFO: `/v3/services` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:23.817912 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1442d12a-468d-47c5-ba4b-6d93a4f17a77 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:23.818417 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1442d12a-468d-47c5-ba4b-6d93a4f17a77 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:23.820053 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1442d12a-468d-47c5-ba4b-6d93a4f17a77 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:23.833343 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 410/826] 10.222.0.17 () {56 vars in 1124 bytes} [Sat Jul 23 20:58:23 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:58:23.834707 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1442d12a-468d-47c5-ba4b-6d93a4f17a77 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:23.857557 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171b4993-d18c-40e9-9f52-119c7abad394 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:23.860434 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:23.900625 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095cd9e3-83dd-48ca-9b1b-54f880e8a9dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:23.901530 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095cd9e3-83dd-48ca-9b1b-54f880e8a9dd None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:23.901957 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095cd9e3-83dd-48ca-9b1b-54f880e8a9dd None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:23.902356 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095cd9e3-83dd-48ca-9b1b-54f880e8a9dd None admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:23.903642 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095cd9e3-83dd-48ca-9b1b-54f880e8a9dd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:23.904072 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095cd9e3-83dd-48ca-9b1b-54f880e8a9dd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:23.905629 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095cd9e3-83dd-48ca-9b1b-54f880e8a9dd None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:23.924073 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 417/827] 10.222.0.17 () {56 vars in 1148 bytes} [Sat Jul 23 20:58:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:58:23.925062 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095cd9e3-83dd-48ca-9b1b-54f880e8a9dd None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:23.958848 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1442d12a-468d-47c5-ba4b-6d93a4f17a77 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:24.001844 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fbfed9-8b0d-4feb-ba61-3681fb16421d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:24.003936 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fbfed9-8b0d-4feb-ba61-3681fb16421d None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:24.004222 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fbfed9-8b0d-4feb-ba61-3681fb16421d None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:24.004489 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fbfed9-8b0d-4feb-ba61-3681fb16421d None admin] PATH_INFO: `/v3/projects/service` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:24.016288 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fbfed9-8b0d-4feb-ba61-3681fb16421d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:24.017693 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fbfed9-8b0d-4feb-ba61-3681fb16421d None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:24.036683 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-c9fbfed9-8b0d-4feb-ba61-3681fb16421d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 23 20:58:24.036683 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:58:24.036683 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:58:24.036683 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:58:24.036683 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:58:24.036683 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:58:24.036683 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:58:24.036683 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:58:24.036683 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:58:24.036683 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:58:24.036683 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:58:24.036683 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:58:24.036683 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 23 20:58:24.036683 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 23 20:58:24.036683 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 23 20:58:24.037640 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 23 20:58:24.037640 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:58:24.037640 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:58:24.037640 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:58:24.037640 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:58:24.037640 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:58:24.037640 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:58:24.037640 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:58:24.037640 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application with Lock( Jul 23 20:58:24.037640 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:58:24.037640 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:58:24.037640 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:58:24.037640 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:58:24.037640 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:58:24.037640 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:58:24.037640 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:58:24.037640 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:58:24.038636 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 23 20:58:24.038636 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 23 20:58:24.038636 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 23 20:58:24.038636 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 23 20:58:24.038636 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 23 20:58:24.038636 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 23 20:58:24.038636 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 23 20:58:24.038636 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:58:24.038636 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 411/828] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Jul 23 20:58:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:58:24.040083 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fbfed9-8b0d-4feb-ba61-3681fb16421d None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:24.067506 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:24.075609 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095cd9e3-83dd-48ca-9b1b-54f880e8a9dd None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:24.119580 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308a8e90-e455-4eb3-a7ed-50cc8962f89a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:24.120354 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308a8e90-e455-4eb3-a7ed-50cc8962f89a None admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:24.120742 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308a8e90-e455-4eb3-a7ed-50cc8962f89a None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:24.121019 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308a8e90-e455-4eb3-a7ed-50cc8962f89a None admin] PATH_INFO: `/v3/endpoints` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:24.121760 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308a8e90-e455-4eb3-a7ed-50cc8962f89a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:24.123159 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308a8e90-e455-4eb3-a7ed-50cc8962f89a None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:24.157900 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 418/829] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 23 20:58:23 2022] POST /identity/v3/endpoints => generated 346 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 20:58:24.157900 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308a8e90-e455-4eb3-a7ed-50cc8962f89a None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:24.175544 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:24.178700 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fbfed9-8b0d-4feb-ba61-3681fb16421d None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:24.229830 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee327e5-f930-4443-8344-661db2fd4dab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:24.230796 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee327e5-f930-4443-8344-661db2fd4dab None admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:24.231371 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee327e5-f930-4443-8344-661db2fd4dab None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:24.231654 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee327e5-f930-4443-8344-661db2fd4dab None admin] PATH_INFO: `/v3/projects/4804ed61295f4d4a92d9b685dd9e9f3b/users/47f0a685b7da46afb81024848f079d2f/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:24.235065 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee327e5-f930-4443-8344-661db2fd4dab None admin] RBAC: Authorizing `identity:create_grant(project_id=4804ed61295f4d4a92d9b685dd9e9f3b, user_id=47f0a685b7da46afb81024848f079d2f, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:24.236596 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee327e5-f930-4443-8344-661db2fd4dab None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:24.266002 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 412/830] 10.222.0.17 () {58 vars in 1439 bytes} [Sat Jul 23 20:58:24 2022] PUT /identity/v3/projects/4804ed61295f4d4a92d9b685dd9e9f3b/users/47f0a685b7da46afb81024848f079d2f/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 20:58:24.279243 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308a8e90-e455-4eb3-a7ed-50cc8962f89a None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:24.323952 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7841e30c-cec4-4ae2-9614-1abe498931b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:24.324856 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7841e30c-cec4-4ae2-9614-1abe498931b8 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:24.325189 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7841e30c-cec4-4ae2-9614-1abe498931b8 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:24.325574 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7841e30c-cec4-4ae2-9614-1abe498931b8 None admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:24.326438 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7841e30c-cec4-4ae2-9614-1abe498931b8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:24.326789 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7841e30c-cec4-4ae2-9614-1abe498931b8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:24.328369 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7841e30c-cec4-4ae2-9614-1abe498931b8 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:24.349529 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 419/831] 10.222.0.17 () {56 vars in 1148 bytes} [Sat Jul 23 20:58:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:58:24.353210 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee327e5-f930-4443-8344-661db2fd4dab None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:24.441473 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:24.485325 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee327e5-f930-4443-8344-661db2fd4dab None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:24.519967 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a27724-46e9-4e2d-8635-72b7d9b8d714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:24.520886 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a27724-46e9-4e2d-8635-72b7d9b8d714 None admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:24.521158 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a27724-46e9-4e2d-8635-72b7d9b8d714 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:24.521425 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a27724-46e9-4e2d-8635-72b7d9b8d714 None admin] PATH_INFO: `/v3/projects/4804ed61295f4d4a92d9b685dd9e9f3b/users/17b779a3e21a415bb42cde5d6863d9cf/roles/abf9f3b81f3647dbb70c44d0aedaa614` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:24.537411 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a27724-46e9-4e2d-8635-72b7d9b8d714 None admin] RBAC: Authorizing `identity:create_grant(project_id=4804ed61295f4d4a92d9b685dd9e9f3b, user_id=17b779a3e21a415bb42cde5d6863d9cf, role_id=abf9f3b81f3647dbb70c44d0aedaa614)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:24.538905 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a27724-46e9-4e2d-8635-72b7d9b8d714 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:24.555607 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 413/832] 10.222.0.17 () {58 vars in 1439 bytes} [Sat Jul 23 20:58:24 2022] PUT /identity/v3/projects/4804ed61295f4d4a92d9b685dd9e9f3b/users/17b779a3e21a415bb42cde5d6863d9cf/roles/abf9f3b81f3647dbb70c44d0aedaa614 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 20:58:25.038879 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8edff9-af59-4d52-91f5-f526dda9b5ae None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:25.039442 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8edff9-af59-4d52-91f5-f526dda9b5ae None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:25.039442 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8edff9-af59-4d52-91f5-f526dda9b5ae None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:25.041181 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 420/833] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:58:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:58:25.046817 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3cfc34-75fd-4541-87df-8d68133244fd None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:25.047347 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3cfc34-75fd-4541-87df-8d68133244fd None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:25.047347 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3cfc34-75fd-4541-87df-8d68133244fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:25.064563 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-8d3cfc34-75fd-4541-87df-8d68133244fd None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:58:25.065711 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-8d3cfc34-75fd-4541-87df-8d68133244fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:58:25.133687 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 414/834] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:58:25 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 23 20:58:25.157654 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8edff9-af59-4d52-91f5-f526dda9b5ae None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:25.241777 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:25.264008 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8edff9-af59-4d52-91f5-f526dda9b5ae None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:25.301094 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7466e497-1728-4958-9c44-d85bceb651c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:25.302362 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7466e497-1728-4958-9c44-d85bceb651c4 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:25.302858 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7466e497-1728-4958-9c44-d85bceb651c4 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:25.303325 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7466e497-1728-4958-9c44-d85bceb651c4 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:25.304210 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7466e497-1728-4958-9c44-d85bceb651c4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:25.305794 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7466e497-1728-4958-9c44-d85bceb651c4 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:25.318959 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-7466e497-1728-4958-9c44-d85bceb651c4 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 23 20:58:25.318959 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:58:25.318959 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 23 20:58:25.318959 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 23 20:58:25.318959 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 23 20:58:25.318959 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 23 20:58:25.318959 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 23 20:58:25.318959 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 23 20:58:25.318959 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 23 20:58:25.318959 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 20:58:25.318959 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 23 20:58:25.318959 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 20:58:25.318959 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:58:25.318959 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:58:25.318959 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:58:25.318959 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:58:25.319896 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:58:25.319896 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:58:25.319896 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:58:25.319896 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:58:25.319896 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:58:25.319896 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:58:25.319896 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:58:25.319896 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 23 20:58:25.319896 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 23 20:58:25.319896 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 23 20:58:25.319896 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 23 20:58:25.319896 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:58:25.319896 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:58:25.319896 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:58:25.319896 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:58:25.319896 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:58:25.320749 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:58:25.320749 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:58:25.320749 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application with Lock( Jul 23 20:58:25.320749 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:58:25.320749 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:58:25.320749 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:58:25.320749 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:58:25.320749 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:58:25.320749 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:58:25.320749 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:58:25.320749 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:58:25.320749 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 23 20:58:25.320749 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 23 20:58:25.320749 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 23 20:58:25.320749 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 20:58:25.323813 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 421/835] 10.222.0.17 () {56 vars in 1132 bytes} [Sat Jul 23 20:58:25 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:58:25.331563 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3cfc34-75fd-4541-87df-8d68133244fd None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:25.383649 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:25.434696 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3cfc34-75fd-4541-87df-8d68133244fd None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:25.469208 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704aa867-4848-437b-ba05-354076ecd211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:25.469905 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704aa867-4848-437b-ba05-354076ecd211 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:25.470238 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704aa867-4848-437b-ba05-354076ecd211 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:25.470509 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704aa867-4848-437b-ba05-354076ecd211 None admin] PATH_INFO: `/v3/services` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:25.471266 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704aa867-4848-437b-ba05-354076ecd211 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:25.471566 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704aa867-4848-437b-ba05-354076ecd211 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:25.473063 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704aa867-4848-437b-ba05-354076ecd211 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:25.478199 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 415/836] 10.222.0.17 () {56 vars in 1126 bytes} [Sat Jul 23 20:58:25 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:58:25.483915 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7466e497-1728-4958-9c44-d85bceb651c4 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:25.587194 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7466e497-1728-4958-9c44-d85bceb651c4 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:25.623971 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e907b3-8012-4627-8f02-ba8530f5d2ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:25.625144 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e907b3-8012-4627-8f02-ba8530f5d2ff None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:25.625715 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e907b3-8012-4627-8f02-ba8530f5d2ff None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:25.626226 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e907b3-8012-4627-8f02-ba8530f5d2ff None admin] PATH_INFO: `/v3/services` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:25.627301 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e907b3-8012-4627-8f02-ba8530f5d2ff None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:25.627856 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e907b3-8012-4627-8f02-ba8530f5d2ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:25.629608 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e907b3-8012-4627-8f02-ba8530f5d2ff None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:25.635503 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 422/837] 10.222.0.17 () {56 vars in 1126 bytes} [Sat Jul 23 20:58:25 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:58:26.527933 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462011b1-9609-4b4a-a009-be220aa7af63 None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:26.528891 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462011b1-9609-4b4a-a009-be220aa7af63 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:26.528891 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462011b1-9609-4b4a-a009-be220aa7af63 None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:26.530632 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 416/838] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:58:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:58:26.536590 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524be02e-a6c9-4e6b-a3dd-4afdfb1e593c None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:26.537122 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524be02e-a6c9-4e6b-a3dd-4afdfb1e593c None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:26.537122 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524be02e-a6c9-4e6b-a3dd-4afdfb1e593c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:26.555014 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-524be02e-a6c9-4e6b-a3dd-4afdfb1e593c None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:58:26.556210 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-524be02e-a6c9-4e6b-a3dd-4afdfb1e593c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:58:26.558261 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:26.626801 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 423/839] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:58:26 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 23 20:58:26.650565 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462011b1-9609-4b4a-a009-be220aa7af63 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:26.697304 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f53ad9-4616-4ca7-97c4-b0a4a0d8ba4e None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:26.698006 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f53ad9-4616-4ca7-97c4-b0a4a0d8ba4e None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:26.698769 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f53ad9-4616-4ca7-97c4-b0a4a0d8ba4e None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:26.700753 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 424/840] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:58:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 23 20:58:26.707374 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8478f676-7fa4-41ae-9524-681b5e6f3432 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:26.708025 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8478f676-7fa4-41ae-9524-681b5e6f3432 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:26.708539 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8478f676-7fa4-41ae-9524-681b5e6f3432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:26.726797 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-8478f676-7fa4-41ae-9524-681b5e6f3432 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:58:26.728441 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-8478f676-7fa4-41ae-9524-681b5e6f3432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:58:26.764835 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462011b1-9609-4b4a-a009-be220aa7af63 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:26.783476 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:26.803008 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb6d3aa-b57d-42dc-9c82-209f9209ea1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:26.803861 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb6d3aa-b57d-42dc-9c82-209f9209ea1a None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:26.804125 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb6d3aa-b57d-42dc-9c82-209f9209ea1a None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:26.804399 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb6d3aa-b57d-42dc-9c82-209f9209ea1a None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:26.805058 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb6d3aa-b57d-42dc-9c82-209f9209ea1a None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:26.806535 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb6d3aa-b57d-42dc-9c82-209f9209ea1a None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:26.813953 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 425/841] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:58:26 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 23 20:58:26.819927 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-4fb6d3aa-b57d-42dc-9c82-209f9209ea1a None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 23 20:58:26.819927 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:58:26.819927 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 23 20:58:26.819927 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 23 20:58:26.819927 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 23 20:58:26.819927 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 23 20:58:26.819927 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 23 20:58:26.819927 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 23 20:58:26.819927 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 23 20:58:26.819927 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:58:26.819927 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 23 20:58:26.819927 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:58:26.819927 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:58:26.819927 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:58:26.819927 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:58:26.819927 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:58:26.819927 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:58:26.820935 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:58:26.820935 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:58:26.820935 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:58:26.820935 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:58:26.820935 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:58:26.820935 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:58:26.820935 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 23 20:58:26.820935 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 23 20:58:26.820935 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 23 20:58:26.820935 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 23 20:58:26.820935 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:58:26.820935 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:58:26.820935 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:58:26.820935 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:58:26.820935 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:58:26.820935 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:58:26.821788 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:58:26.821788 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application with Lock( Jul 23 20:58:26.821788 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:58:26.821788 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:58:26.821788 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:58:26.821788 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:58:26.821788 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:58:26.821788 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:58:26.821788 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:58:26.821788 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:58:26.821788 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 23 20:58:26.821788 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 23 20:58:26.821788 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 23 20:58:26.821788 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:58:26.821788 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 417/842] 10.222.0.17 () {56 vars in 1114 bytes} [Sat Jul 23 20:58:26 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:58:26.831171 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8478f676-7fa4-41ae-9524-681b5e6f3432 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:26.838097 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb6d3aa-b57d-42dc-9c82-209f9209ea1a None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:26.904297 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:26.940620 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8478f676-7fa4-41ae-9524-681b5e6f3432 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:26.944821 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb6d3aa-b57d-42dc-9c82-209f9209ea1a None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:26.975909 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcbc1a0-0277-469b-a24e-ad6e0a1cc19b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:26.976585 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcbc1a0-0277-469b-a24e-ad6e0a1cc19b None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:26.976868 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcbc1a0-0277-469b-a24e-ad6e0a1cc19b None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:26.977143 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcbc1a0-0277-469b-a24e-ad6e0a1cc19b None admin] PATH_INFO: `/v3/services` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:26.977846 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcbc1a0-0277-469b-a24e-ad6e0a1cc19b None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:26.978177 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcbc1a0-0277-469b-a24e-ad6e0a1cc19b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:26.979232 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b394e7-ad0c-45f0-9a46-c9ec8a2691ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:26.979555 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcbc1a0-0277-469b-a24e-ad6e0a1cc19b None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:26.980030 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b394e7-ad0c-45f0-9a46-c9ec8a2691ca None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:26.980301 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b394e7-ad0c-45f0-9a46-c9ec8a2691ca None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:26.980562 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b394e7-ad0c-45f0-9a46-c9ec8a2691ca None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:26.984367 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 426/843] 10.222.0.17 () {56 vars in 1114 bytes} [Sat Jul 23 20:58:26 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 20:58:26.985432 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35775854-a5cf-4ef5-8592-4dc44d0cdf0a None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:26.985813 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35775854-a5cf-4ef5-8592-4dc44d0cdf0a None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:26.986023 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35775854-a5cf-4ef5-8592-4dc44d0cdf0a None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:26.991379 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 427/844] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:58:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:58:26.991379 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35775854-a5cf-4ef5-8592-4dc44d0cdf0a None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:26.998157 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b394e7-ad0c-45f0-9a46-c9ec8a2691ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:58:27.006020 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-82b394e7-ad0c-45f0-9a46-c9ec8a2691ca None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 23 20:58:27.006020 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:58:27.006020 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:58:27.006020 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:58:27.006020 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:58:27.006020 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:58:27.006020 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:58:27.006020 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:58:27.006020 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:58:27.006020 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:58:27.006020 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:58:27.006020 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:58:27.006020 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:58:27.006020 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:58:27.006020 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:58:27.006020 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:58:27.006972 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:58:27.006972 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:58:27.006972 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:58:27.006972 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:58:27.006972 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:58:27.006972 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:58:27.006972 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:58:27.006972 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:58:27.006972 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:58:27.006972 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:58:27.006972 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:58:27.006972 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application with Lock( Jul 23 20:58:27.006972 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:58:27.006972 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:58:27.006972 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:58:27.006972 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:58:27.007819 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:58:27.007819 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:58:27.007819 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:58:27.007819 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:58:27.007819 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:58:27.007819 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:58:27.007819 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:58:27.007819 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:58:27.007819 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:58:27.007819 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:58:27.007819 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 23 20:58:27.007819 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:58:27.007819 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 418/845] 10.222.0.17 () {56 vars in 1096 bytes} [Sat Jul 23 20:58:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 23 20:58:27.008532 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8900d992-a67f-4a3f-843b-34670fddc595 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:27.008934 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8900d992-a67f-4a3f-843b-34670fddc595 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:27.009035 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8900d992-a67f-4a3f-843b-34670fddc595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:27.025753 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-8900d992-a67f-4a3f-843b-34670fddc595 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:58:27.026942 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-8900d992-a67f-4a3f-843b-34670fddc595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:58:27.065368 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:27.100158 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 419/846] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:58:27 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 23 20:58:27.101286 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8900d992-a67f-4a3f-843b-34670fddc595 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:27.116963 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35775854-a5cf-4ef5-8592-4dc44d0cdf0a None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:27.149185 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:27.157694 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea7568d-c779-4a8d-8236-467b7995acd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:27.158517 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea7568d-c779-4a8d-8236-467b7995acd6 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:27.158796 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea7568d-c779-4a8d-8236-467b7995acd6 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:27.159068 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea7568d-c779-4a8d-8236-467b7995acd6 None admin] PATH_INFO: `/v3/services` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:27.159820 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea7568d-c779-4a8d-8236-467b7995acd6 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:27.160117 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea7568d-c779-4a8d-8236-467b7995acd6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:27.161514 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea7568d-c779-4a8d-8236-467b7995acd6 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:27.166394 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 428/847] 10.222.0.17 () {56 vars in 1114 bytes} [Sat Jul 23 20:58:26 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:58:27.167181 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea7568d-c779-4a8d-8236-467b7995acd6 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:27.230657 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8900d992-a67f-4a3f-843b-34670fddc595 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:27.270616 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47754054-2d4a-436d-9a86-afbc3b183f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:27.271415 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47754054-2d4a-436d-9a86-afbc3b183f7c None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:27.271765 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47754054-2d4a-436d-9a86-afbc3b183f7c None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:27.272105 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47754054-2d4a-436d-9a86-afbc3b183f7c None admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:27.272947 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47754054-2d4a-436d-9a86-afbc3b183f7c None admin] RBAC: Adding query filter params (name=admin) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:27.273322 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47754054-2d4a-436d-9a86-afbc3b183f7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:27.274838 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47754054-2d4a-436d-9a86-afbc3b183f7c None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:27.285279 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 420/848] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Jul 23 20:58:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:58:27.298984 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47754054-2d4a-436d-9a86-afbc3b183f7c None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:27.318502 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea7568d-c779-4a8d-8236-467b7995acd6 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:27.339738 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:27.372535 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137532ca-d9cc-4c74-acd8-7ef16edd99b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:27.373376 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137532ca-d9cc-4c74-acd8-7ef16edd99b2 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:27.373648 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137532ca-d9cc-4c74-acd8-7ef16edd99b2 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:27.373944 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137532ca-d9cc-4c74-acd8-7ef16edd99b2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:27.394867 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137532ca-d9cc-4c74-acd8-7ef16edd99b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:58:27.402195 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-137532ca-d9cc-4c74-acd8-7ef16edd99b2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 23 20:58:27.402195 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:58:27.402195 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:58:27.402195 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:58:27.402195 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:58:27.402195 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:58:27.402195 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:58:27.402195 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:58:27.402195 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:58:27.402195 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:58:27.402195 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:58:27.402195 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:58:27.402195 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:58:27.402195 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:58:27.402195 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:58:27.402195 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:58:27.403527 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:58:27.403527 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:58:27.403527 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:58:27.403527 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:58:27.403527 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:58:27.403527 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:58:27.403527 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:58:27.403527 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:58:27.403527 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:58:27.403527 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:58:27.403527 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:58:27.403527 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application with Lock( Jul 23 20:58:27.403527 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:58:27.403527 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:58:27.403527 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:58:27.403527 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:58:27.404347 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:58:27.404347 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:58:27.404347 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:58:27.404347 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:58:27.404347 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:58:27.404347 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:58:27.404347 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:58:27.404347 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:58:27.404347 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:58:27.404347 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:58:27.404347 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 23 20:58:27.404347 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 20:58:27.404347 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 429/849] 10.222.0.17 () {56 vars in 1102 bytes} [Sat Jul 23 20:58:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:58:27.409921 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137532ca-d9cc-4c74-acd8-7ef16edd99b2 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:27.432932 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47754054-2d4a-436d-9a86-afbc3b183f7c None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:27.472902 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f908bc-12a4-4179-9775-17a09599d8d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:27.473717 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f908bc-12a4-4179-9775-17a09599d8d7 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:27.474250 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f908bc-12a4-4179-9775-17a09599d8d7 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:27.474529 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f908bc-12a4-4179-9775-17a09599d8d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:27.483468 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:27.486384 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f908bc-12a4-4179-9775-17a09599d8d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:27.488233 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f908bc-12a4-4179-9775-17a09599d8d7 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:27.506144 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-c8f908bc-12a4-4179-9775-17a09599d8d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:58:27.506144 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:58:27.506144 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:58:27.506144 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:58:27.506144 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:58:27.506144 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:58:27.506144 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:58:27.506144 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:58:27.506144 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:58:27.506144 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:58:27.506144 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:58:27.506144 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:58:27.506144 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 23 20:58:27.506144 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 23 20:58:27.506144 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 23 20:58:27.507287 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 23 20:58:27.507287 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:58:27.507287 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:58:27.507287 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:58:27.507287 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:58:27.507287 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:58:27.507287 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:58:27.507287 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:58:27.507287 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application with Lock( Jul 23 20:58:27.507287 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:58:27.507287 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:58:27.507287 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:58:27.507287 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:58:27.507287 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:58:27.507287 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:58:27.507287 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:58:27.507287 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:58:27.508212 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 23 20:58:27.508212 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 23 20:58:27.508212 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:58:27.508212 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:58:27.508212 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 421/850] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 23 20:58:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:58:27.513264 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f908bc-12a4-4179-9775-17a09599d8d7 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:27.544051 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137532ca-d9cc-4c74-acd8-7ef16edd99b2 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:27.585418 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391e32a4-d0ad-43c0-94e9-e61f06f620bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:27.586589 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391e32a4-d0ad-43c0-94e9-e61f06f620bf None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:27.587267 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391e32a4-d0ad-43c0-94e9-e61f06f620bf None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:27.588121 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391e32a4-d0ad-43c0-94e9-e61f06f620bf None admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:27.589326 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391e32a4-d0ad-43c0-94e9-e61f06f620bf None admin] RBAC: Adding query filter params (name=service) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:27.590094 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391e32a4-d0ad-43c0-94e9-e61f06f620bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:27.592344 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391e32a4-d0ad-43c0-94e9-e61f06f620bf None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:27.609096 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 430/851] 10.222.0.17 () {56 vars in 1103 bytes} [Sat Jul 23 20:58:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 20:58:27.610725 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391e32a4-d0ad-43c0-94e9-e61f06f620bf None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:27.619526 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:27.638181 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f908bc-12a4-4179-9775-17a09599d8d7 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:27.677701 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d41e07-d87e-42f5-82a8-2739b085b01f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:27.678412 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d41e07-d87e-42f5-82a8-2739b085b01f None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:27.678690 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d41e07-d87e-42f5-82a8-2739b085b01f None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:27.678958 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d41e07-d87e-42f5-82a8-2739b085b01f None admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:27.679687 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d41e07-d87e-42f5-82a8-2739b085b01f None admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:27.679990 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d41e07-d87e-42f5-82a8-2739b085b01f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:27.681375 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d41e07-d87e-42f5-82a8-2739b085b01f None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:27.694417 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 422/852] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 23 20:58:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 20:58:27.699566 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d41e07-d87e-42f5-82a8-2739b085b01f None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:27.756540 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391e32a4-d0ad-43c0-94e9-e61f06f620bf None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:27.795856 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:27.802436 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82100e40-28c1-43d5-afb8-fcdffe072630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:27.803293 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82100e40-28c1-43d5-afb8-fcdffe072630 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:27.803574 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82100e40-28c1-43d5-afb8-fcdffe072630 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:27.803853 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82100e40-28c1-43d5-afb8-fcdffe072630 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:27.826307 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82100e40-28c1-43d5-afb8-fcdffe072630 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:27.827787 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82100e40-28c1-43d5-afb8-fcdffe072630 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:27.852469 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d41e07-d87e-42f5-82a8-2739b085b01f None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:27.857168 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-82100e40-28c1-43d5-afb8-fcdffe072630 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:58:27.857168 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:58:27.857168 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:58:27.857168 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:58:27.857168 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:58:27.857168 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:58:27.857168 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:58:27.857168 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:58:27.857168 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:58:27.857168 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:58:27.857168 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:58:27.857168 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:58:27.857168 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 23 20:58:27.857168 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 23 20:58:27.857168 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 23 20:58:27.858055 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 23 20:58:27.858055 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:58:27.858055 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:58:27.858055 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:58:27.858055 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:58:27.858055 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:58:27.858055 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:58:27.858055 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:58:27.858055 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application with Lock( Jul 23 20:58:27.858055 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:58:27.858055 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:58:27.858055 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:58:27.858055 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:58:27.858055 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:58:27.858055 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:58:27.858055 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:58:27.858055 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:58:27.858932 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 23 20:58:27.858932 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 23 20:58:27.858932 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:58:27.858932 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 20:58:27.867199 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 431/853] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 23 20:58:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 23 20:58:27.869126 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82100e40-28c1-43d5-afb8-fcdffe072630 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:27.896548 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b335d9b6-0f2f-4870-b842-809d2dd307ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:27.897367 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b335d9b6-0f2f-4870-b842-809d2dd307ed None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:27.897642 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b335d9b6-0f2f-4870-b842-809d2dd307ed None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:27.897951 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b335d9b6-0f2f-4870-b842-809d2dd307ed None admin] PATH_INFO: `/v3/users/swift` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:27.908079 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b335d9b6-0f2f-4870-b842-809d2dd307ed None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:27.910268 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b335d9b6-0f2f-4870-b842-809d2dd307ed None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:27.930231 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-b335d9b6-0f2f-4870-b842-809d2dd307ed None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 23 20:58:27.930231 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:58:27.930231 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:58:27.930231 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:58:27.930231 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:58:27.930231 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:58:27.930231 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:58:27.930231 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:58:27.930231 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:58:27.930231 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:58:27.930231 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:58:27.930231 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:58:27.930231 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 23 20:58:27.930231 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 23 20:58:27.930231 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 23 20:58:27.930231 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 23 20:58:27.931239 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:58:27.931239 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:58:27.931239 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 23 20:58:27.931239 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 23 20:58:27.931239 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 23 20:58:27.931239 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 23 20:58:27.931239 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:58:27.931239 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:58:27.931239 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:58:27.931239 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:58:27.931239 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:58:27.931239 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application with Lock( Jul 23 20:58:27.931239 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:58:27.931239 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:58:27.931239 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:58:27.931239 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:58:27.931239 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:58:27.931239 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:58:27.932169 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:58:27.932169 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:58:27.932169 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 23 20:58:27.932169 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 23 20:58:27.932169 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 23 20:58:27.932169 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 23 20:58:27.932169 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 23 20:58:27.932169 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 23 20:58:27.932169 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 23 20:58:27.932169 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:58:27.937297 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 423/854] 10.222.0.17 () {56 vars in 1096 bytes} [Sat Jul 23 20:58:27 2022] GET /identity/v3/users/swift => generated 83 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:58:27.938460 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b335d9b6-0f2f-4870-b842-809d2dd307ed None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:27.944573 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:28.000690 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82100e40-28c1-43d5-afb8-fcdffe072630 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:28.037523 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ca599a-c0a1-454b-bd05-a0b33bbcaadc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:28.038265 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ca599a-c0a1-454b-bd05-a0b33bbcaadc None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:28.038642 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ca599a-c0a1-454b-bd05-a0b33bbcaadc None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:28.038921 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ca599a-c0a1-454b-bd05-a0b33bbcaadc None admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:28.039648 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ca599a-c0a1-454b-bd05-a0b33bbcaadc None admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:28.039945 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ca599a-c0a1-454b-bd05-a0b33bbcaadc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:28.041313 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ca599a-c0a1-454b-bd05-a0b33bbcaadc None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:28.042045 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b335d9b6-0f2f-4870-b842-809d2dd307ed None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:28.058484 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 432/855] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 23 20:58:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:58:28.058484 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916d6667-ae4d-4489-a7f7-ed8b59e54a9a None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:28.058484 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916d6667-ae4d-4489-a7f7-ed8b59e54a9a None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:28.058484 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916d6667-ae4d-4489-a7f7-ed8b59e54a9a None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:28.058484 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 433/856] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:58:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:58:28.063004 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5373f1d-bce3-4aad-a6f7-c7599bf30434 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:28.063291 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5373f1d-bce3-4aad-a6f7-c7599bf30434 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:28.063678 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5373f1d-bce3-4aad-a6f7-c7599bf30434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:28.080418 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-b5373f1d-bce3-4aad-a6f7-c7599bf30434 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:58:28.081456 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7679fc5-c7fb-4ea2-ba32-8a9e18c503de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:28.081678 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-b5373f1d-bce3-4aad-a6f7-c7599bf30434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:58:28.082176 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7679fc5-c7fb-4ea2-ba32-8a9e18c503de None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:28.082452 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7679fc5-c7fb-4ea2-ba32-8a9e18c503de None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:28.082721 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7679fc5-c7fb-4ea2-ba32-8a9e18c503de None admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:28.083586 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7679fc5-c7fb-4ea2-ba32-8a9e18c503de None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:28.083845 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7679fc5-c7fb-4ea2-ba32-8a9e18c503de None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:28.085305 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7679fc5-c7fb-4ea2-ba32-8a9e18c503de None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:28.102619 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 424/857] 10.222.0.17 () {56 vars in 1135 bytes} [Sat Jul 23 20:58:27 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:58:28.103371 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7679fc5-c7fb-4ea2-ba32-8a9e18c503de None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:28.111828 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:28.166041 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 434/858] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:58:28 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 23 20:58:28.166041 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5373f1d-bce3-4aad-a6f7-c7599bf30434 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:28.182504 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:28.227973 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7679fc5-c7fb-4ea2-ba32-8a9e18c503de None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:28.265127 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a728be-1e4b-4133-9436-ca0125d75cf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:28.265991 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a728be-1e4b-4133-9436-ca0125d75cf8 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:28.266288 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a728be-1e4b-4133-9436-ca0125d75cf8 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:28.266548 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a728be-1e4b-4133-9436-ca0125d75cf8 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:28.274043 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a728be-1e4b-4133-9436-ca0125d75cf8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:28.275498 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a728be-1e4b-4133-9436-ca0125d75cf8 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:28.285607 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5373f1d-bce3-4aad-a6f7-c7599bf30434 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:28.290708 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-67a728be-1e4b-4133-9436-ca0125d75cf8 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 23 20:58:28.290708 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:58:28.290708 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:58:28.290708 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:58:28.290708 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:58:28.290708 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:58:28.290708 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:58:28.290708 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:58:28.290708 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:58:28.290708 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:58:28.290708 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:58:28.290708 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:58:28.290708 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 23 20:58:28.290708 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 23 20:58:28.290708 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 23 20:58:28.290708 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 23 20:58:28.291630 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:58:28.291630 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:58:28.291630 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 23 20:58:28.291630 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 23 20:58:28.291630 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 23 20:58:28.291630 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 23 20:58:28.291630 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:58:28.291630 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:58:28.291630 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:58:28.291630 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:58:28.291630 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:58:28.291630 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application with Lock( Jul 23 20:58:28.291630 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:58:28.291630 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:58:28.291630 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:58:28.291630 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:58:28.291630 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:58:28.291630 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:58:28.292574 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:58:28.292574 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:58:28.292574 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 23 20:58:28.292574 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 23 20:58:28.292574 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 23 20:58:28.292574 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 23 20:58:28.292574 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 23 20:58:28.292574 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 23 20:58:28.292574 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 23 20:58:28.292574 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:58:28.292574 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 425/859] 10.222.0.17 () {56 vars in 1117 bytes} [Sat Jul 23 20:58:28 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:58:28.293167 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a728be-1e4b-4133-9436-ca0125d75cf8 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:28.328093 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97b76ec-7d5b-47b0-8953-78d754f625c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:28.329101 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97b76ec-7d5b-47b0-8953-78d754f625c4 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:28.329596 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97b76ec-7d5b-47b0-8953-78d754f625c4 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:28.330079 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97b76ec-7d5b-47b0-8953-78d754f625c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:28.361033 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:28.409787 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97b76ec-7d5b-47b0-8953-78d754f625c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:28.411372 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97b76ec-7d5b-47b0-8953-78d754f625c4 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:28.411993 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a728be-1e4b-4133-9436-ca0125d75cf8 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:28.437141 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:28.449750 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac5c27c-210a-4983-8aae-3d88da523559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:28.450451 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac5c27c-210a-4983-8aae-3d88da523559 None admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:28.450726 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac5c27c-210a-4983-8aae-3d88da523559 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:28.451001 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac5c27c-210a-4983-8aae-3d88da523559 None admin] PATH_INFO: `/v3/services` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:28.451722 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac5c27c-210a-4983-8aae-3d88da523559 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:28.453160 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac5c27c-210a-4983-8aae-3d88da523559 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:28.469308 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 426/860] 10.222.0.17 () {60 vars in 1141 bytes} [Sat Jul 23 20:58:28 2022] POST /identity/v3/services => generated 269 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 20:58:28.470290 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac5c27c-210a-4983-8aae-3d88da523559 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:28.552431 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 435/861] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Jul 23 20:58:28 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 23 20:58:28.558960 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97b76ec-7d5b-47b0-8953-78d754f625c4 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:28.614603 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac5c27c-210a-4983-8aae-3d88da523559 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:28.623122 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:28.659321 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d38f87-f1e5-4131-ad3c-5e980d2a9a84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:28.660257 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d38f87-f1e5-4131-ad3c-5e980d2a9a84 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:28.660534 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d38f87-f1e5-4131-ad3c-5e980d2a9a84 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:28.660804 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d38f87-f1e5-4131-ad3c-5e980d2a9a84 None admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:28.661647 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d38f87-f1e5-4131-ad3c-5e980d2a9a84 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:28.662886 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d38f87-f1e5-4131-ad3c-5e980d2a9a84 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:28.663437 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d38f87-f1e5-4131-ad3c-5e980d2a9a84 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:28.673996 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97b76ec-7d5b-47b0-8953-78d754f625c4 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:28.682545 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 427/862] 10.222.0.17 () {56 vars in 1149 bytes} [Sat Jul 23 20:58:28 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:58:28.688939 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d38f87-f1e5-4131-ad3c-5e980d2a9a84 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:28.718397 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e190068d-4417-4a39-a9bb-24903ecb6c2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:28.719614 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e190068d-4417-4a39-a9bb-24903ecb6c2f None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:28.720123 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e190068d-4417-4a39-a9bb-24903ecb6c2f None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:28.720593 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e190068d-4417-4a39-a9bb-24903ecb6c2f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:28.732163 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e190068d-4417-4a39-a9bb-24903ecb6c2f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:28.734039 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e190068d-4417-4a39-a9bb-24903ecb6c2f None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:28.734420 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:28.762035 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-e190068d-4417-4a39-a9bb-24903ecb6c2f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:58:28.762035 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:58:28.762035 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:58:28.762035 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:58:28.762035 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:58:28.762035 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:58:28.762035 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:58:28.762035 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:58:28.762035 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:58:28.762035 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:58:28.762035 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:58:28.762035 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:58:28.762035 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 23 20:58:28.762035 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 23 20:58:28.762035 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 23 20:58:28.763100 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 23 20:58:28.763100 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:58:28.763100 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:58:28.763100 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:58:28.763100 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:58:28.763100 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:58:28.763100 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:58:28.763100 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:58:28.763100 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application with Lock( Jul 23 20:58:28.763100 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:58:28.763100 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:58:28.763100 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:58:28.763100 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:58:28.763100 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:58:28.763100 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:58:28.763100 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:58:28.763100 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:58:28.764003 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 23 20:58:28.764003 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 23 20:58:28.764003 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:58:28.764003 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 20:58:28.766292 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 436/863] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 23 20:58:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:58:28.775626 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e190068d-4417-4a39-a9bb-24903ecb6c2f None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:28.810472 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d38f87-f1e5-4131-ad3c-5e980d2a9a84 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:28.846074 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66671d60-4052-4b4d-b6e3-086ec7d72303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:28.846733 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66671d60-4052-4b4d-b6e3-086ec7d72303 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:28.847054 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66671d60-4052-4b4d-b6e3-086ec7d72303 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:28.847326 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66671d60-4052-4b4d-b6e3-086ec7d72303 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:28.901414 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e190068d-4417-4a39-a9bb-24903ecb6c2f None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:28.918647 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66671d60-4052-4b4d-b6e3-086ec7d72303 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:28.919240 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:28.920504 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66671d60-4052-4b4d-b6e3-086ec7d72303 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:28.946016 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddbac9f-c3e7-4c71-8dc8-c5b1afa6e97e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:28.947003 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddbac9f-c3e7-4c71-8dc8-c5b1afa6e97e None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:28.947285 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddbac9f-c3e7-4c71-8dc8-c5b1afa6e97e None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:28.947809 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddbac9f-c3e7-4c71-8dc8-c5b1afa6e97e None admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:28.948538 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddbac9f-c3e7-4c71-8dc8-c5b1afa6e97e None admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:28.948982 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddbac9f-c3e7-4c71-8dc8-c5b1afa6e97e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:28.950946 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddbac9f-c3e7-4c71-8dc8-c5b1afa6e97e None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:28.956706 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:28.965632 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 437/864] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 23 20:58:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:58:28.971297 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddbac9f-c3e7-4c71-8dc8-c5b1afa6e97e None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:29.051307 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 428/865] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Jul 23 20:58:28 2022] GET /identity/v3/auth/tokens => generated 1261 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 23 20:58:29.056500 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66671d60-4052-4b4d-b6e3-086ec7d72303 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:29.085247 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddbac9f-c3e7-4c71-8dc8-c5b1afa6e97e None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:29.127055 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94a1ae0-2e36-4a79-a137-8a9282993339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:29.128397 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94a1ae0-2e36-4a79-a137-8a9282993339 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:29.128680 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94a1ae0-2e36-4a79-a137-8a9282993339 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:29.128949 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94a1ae0-2e36-4a79-a137-8a9282993339 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:29.138391 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94a1ae0-2e36-4a79-a137-8a9282993339 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:29.140226 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94a1ae0-2e36-4a79-a137-8a9282993339 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:29.156501 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-b94a1ae0-2e36-4a79-a137-8a9282993339 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 23 20:58:29.156501 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:58:29.156501 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:58:29.156501 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:58:29.156501 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:58:29.156501 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:58:29.156501 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:58:29.156501 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:58:29.156501 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:58:29.156501 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:58:29.156501 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:58:29.156501 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:58:29.156501 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 23 20:58:29.156501 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 23 20:58:29.156501 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 23 20:58:29.157395 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 23 20:58:29.157395 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:58:29.157395 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:58:29.157395 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:58:29.157395 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:58:29.157395 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:58:29.157395 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:58:29.157395 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:58:29.157395 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application with Lock( Jul 23 20:58:29.157395 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:58:29.157395 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:58:29.157395 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:58:29.157395 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:58:29.157395 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:58:29.157395 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:58:29.157395 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:58:29.157395 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:58:29.158736 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 23 20:58:29.158736 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 23 20:58:29.158736 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 23 20:58:29.158736 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 23 20:58:29.158736 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 23 20:58:29.158736 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 23 20:58:29.158736 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 23 20:58:29.158736 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 20:58:29.165710 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66671d60-4052-4b4d-b6e3-086ec7d72303 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:29.166049 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 438/866] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Jul 23 20:58:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:58:29.167292 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94a1ae0-2e36-4a79-a137-8a9282993339 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:29.200642 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:29.206867 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcab48de-f98d-4653-9ada-9e4bf173ce00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:29.207715 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcab48de-f98d-4653-9ada-9e4bf173ce00 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:29.207996 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcab48de-f98d-4653-9ada-9e4bf173ce00 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:29.208269 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcab48de-f98d-4653-9ada-9e4bf173ce00 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:29.212561 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:29.225906 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcab48de-f98d-4653-9ada-9e4bf173ce00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:29.225906 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcab48de-f98d-4653-9ada-9e4bf173ce00 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:29.247786 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-dcab48de-f98d-4653-9ada-9e4bf173ce00 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:58:29.247786 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:58:29.247786 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:58:29.247786 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:58:29.247786 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:58:29.247786 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:58:29.247786 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:58:29.247786 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:58:29.247786 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:58:29.247786 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:58:29.247786 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:58:29.247786 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:58:29.247786 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 23 20:58:29.247786 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 23 20:58:29.247786 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 23 20:58:29.248759 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 23 20:58:29.248759 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:58:29.248759 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:58:29.248759 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:58:29.248759 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:58:29.248759 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:58:29.248759 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:58:29.248759 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:58:29.248759 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application with Lock( Jul 23 20:58:29.248759 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:58:29.248759 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:58:29.248759 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:58:29.248759 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:58:29.248759 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:58:29.248759 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:58:29.248759 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:58:29.248759 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:58:29.249666 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 23 20:58:29.249666 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 23 20:58:29.249666 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:58:29.249666 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:58:29.252140 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 429/867] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 23 20:58:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 23 20:58:29.258011 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcab48de-f98d-4653-9ada-9e4bf173ce00 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:29.293966 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94a1ae0-2e36-4a79-a137-8a9282993339 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:29.329955 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67143cd1-aecb-42f7-ad64-470cabd7555f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:29.330794 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67143cd1-aecb-42f7-ad64-470cabd7555f None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:29.330929 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67143cd1-aecb-42f7-ad64-470cabd7555f None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:29.331157 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67143cd1-aecb-42f7-ad64-470cabd7555f None admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:29.332168 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67143cd1-aecb-42f7-ad64-470cabd7555f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:29.332466 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67143cd1-aecb-42f7-ad64-470cabd7555f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:29.333944 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67143cd1-aecb-42f7-ad64-470cabd7555f None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:29.351451 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 439/868] 10.222.0.17 () {56 vars in 1148 bytes} [Sat Jul 23 20:58:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:58:29.352575 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67143cd1-aecb-42f7-ad64-470cabd7555f None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:29.391841 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcab48de-f98d-4653-9ada-9e4bf173ce00 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:29.429268 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0b3e85-6d4d-4ffd-b606-b0e2571a6901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:29.429852 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0b3e85-6d4d-4ffd-b606-b0e2571a6901 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:29.430179 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0b3e85-6d4d-4ffd-b606-b0e2571a6901 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:29.430446 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0b3e85-6d4d-4ffd-b606-b0e2571a6901 None admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:29.431218 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0b3e85-6d4d-4ffd-b606-b0e2571a6901 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:29.431516 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0b3e85-6d4d-4ffd-b606-b0e2571a6901 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:29.432885 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0b3e85-6d4d-4ffd-b606-b0e2571a6901 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:29.445997 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 430/869] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 23 20:58:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:58:29.454991 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0b3e85-6d4d-4ffd-b606-b0e2571a6901 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:29.479778 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:29.492349 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67143cd1-aecb-42f7-ad64-470cabd7555f None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:29.511025 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:29.537429 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e9d79e-ebca-4e42-bd71-e44937e3b2f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:29.538131 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e9d79e-ebca-4e42-bd71-e44937e3b2f9 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:29.538413 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e9d79e-ebca-4e42-bd71-e44937e3b2f9 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:29.538685 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e9d79e-ebca-4e42-bd71-e44937e3b2f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:29.539511 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e9d79e-ebca-4e42-bd71-e44937e3b2f9 None admin] RBAC: Adding query filter params (role.id=fec17bfdc65349a2b9c06a89131191df, scope.project.id=4804ed61295f4d4a92d9b685dd9e9f3b, user.id=47f0a685b7da46afb81024848f079d2f) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:29.539820 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e9d79e-ebca-4e42-bd71-e44937e3b2f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:29.541252 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e9d79e-ebca-4e42-bd71-e44937e3b2f9 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:29.547767 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 440/870] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Jul 23 20:58:29 2022] GET /identity/v3/role_assignments?user.id=47f0a685b7da46afb81024848f079d2f&scope.project.id=4804ed61295f4d4a92d9b685dd9e9f3b&role.id=fec17bfdc65349a2b9c06a89131191df => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 20:58:29.555537 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87a62ff-c941-4d3c-905f-a901fe70329e None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:29.556158 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87a62ff-c941-4d3c-905f-a901fe70329e None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:29.556158 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87a62ff-c941-4d3c-905f-a901fe70329e None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:29.558073 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 441/871] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:58:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:58:29.563397 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130b8185-3550-4624-b509-e9283434c8e4 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:29.563685 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130b8185-3550-4624-b509-e9283434c8e4 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:29.563960 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130b8185-3550-4624-b509-e9283434c8e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:29.568906 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0b3e85-6d4d-4ffd-b606-b0e2571a6901 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:29.586475 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-130b8185-3550-4624-b509-e9283434c8e4 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:58:29.588206 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-130b8185-3550-4624-b509-e9283434c8e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:58:29.608525 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b48e828-058b-4b46-83c3-c487031d4827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:29.609348 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b48e828-058b-4b46-83c3-c487031d4827 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:29.609628 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b48e828-058b-4b46-83c3-c487031d4827 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:29.609921 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b48e828-058b-4b46-83c3-c487031d4827 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:29.618066 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b48e828-058b-4b46-83c3-c487031d4827 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:29.619997 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b48e828-058b-4b46-83c3-c487031d4827 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:29.636277 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-2b48e828-058b-4b46-83c3-c487031d4827 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 23 20:58:29.636277 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:58:29.636277 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:58:29.636277 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:58:29.636277 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:58:29.636277 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:58:29.636277 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:58:29.636277 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:58:29.636277 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:58:29.636277 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:58:29.636277 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:58:29.636277 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:58:29.636277 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 23 20:58:29.636277 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 23 20:58:29.636277 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 23 20:58:29.637308 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 23 20:58:29.637308 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:58:29.637308 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:58:29.637308 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:58:29.637308 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:58:29.637308 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:58:29.637308 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:58:29.637308 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:58:29.637308 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application with Lock( Jul 23 20:58:29.637308 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:58:29.637308 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:58:29.637308 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:58:29.637308 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:58:29.637308 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:58:29.637308 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:58:29.637308 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:58:29.637308 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:58:29.638208 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 23 20:58:29.638208 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 23 20:58:29.638208 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 23 20:58:29.638208 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 23 20:58:29.638208 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 23 20:58:29.638208 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 23 20:58:29.638208 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 23 20:58:29.638208 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:58:29.642423 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 431/872] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Jul 23 20:58:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:58:29.644146 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b48e828-058b-4b46-83c3-c487031d4827 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:29.689678 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 442/873] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:58:29 2022] POST /identity/v3/auth/tokens => generated 1261 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 23 20:58:29.708134 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130b8185-3550-4624-b509-e9283434c8e4 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:29.780954 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b48e828-058b-4b46-83c3-c487031d4827 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:29.790721 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:29.828576 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b878a882-86b4-4ba2-ae7e-a5741b168877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:29.829246 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b878a882-86b4-4ba2-ae7e-a5741b168877 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:29.829532 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b878a882-86b4-4ba2-ae7e-a5741b168877 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:29.829818 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b878a882-86b4-4ba2-ae7e-a5741b168877 None admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:29.830015 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:29.830899 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b878a882-86b4-4ba2-ae7e-a5741b168877 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:29.830899 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b878a882-86b4-4ba2-ae7e-a5741b168877 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:29.832721 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b878a882-86b4-4ba2-ae7e-a5741b168877 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:29.850407 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 432/874] 10.222.0.17 () {56 vars in 1148 bytes} [Sat Jul 23 20:58:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 20:58:29.852899 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130b8185-3550-4624-b509-e9283434c8e4 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:29.856260 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b878a882-86b4-4ba2-ae7e-a5741b168877 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:29.896712 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d5dee7-addc-431b-a6cf-dc9f3bb06d29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:29.897386 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d5dee7-addc-431b-a6cf-dc9f3bb06d29 None admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:29.897658 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d5dee7-addc-431b-a6cf-dc9f3bb06d29 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:29.897961 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d5dee7-addc-431b-a6cf-dc9f3bb06d29 None admin] PATH_INFO: `/v3/services` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:29.898691 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d5dee7-addc-431b-a6cf-dc9f3bb06d29 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:29.900058 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d5dee7-addc-431b-a6cf-dc9f3bb06d29 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:29.922077 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 443/875] 10.222.0.17 () {60 vars in 1141 bytes} [Sat Jul 23 20:58:29 2022] POST /identity/v3/services => generated 251 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 20:58:29.972375 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b878a882-86b4-4ba2-ae7e-a5741b168877 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:30.016979 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278ba407-5f88-43bb-b87e-3c578936212a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:30.017998 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278ba407-5f88-43bb-b87e-3c578936212a None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:30.018492 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278ba407-5f88-43bb-b87e-3c578936212a None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:30.018991 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278ba407-5f88-43bb-b87e-3c578936212a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:30.020035 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278ba407-5f88-43bb-b87e-3c578936212a None admin] RBAC: Adding query filter params (role.id=abf9f3b81f3647dbb70c44d0aedaa614, scope.project.id=4804ed61295f4d4a92d9b685dd9e9f3b, user.id=17b779a3e21a415bb42cde5d6863d9cf) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:30.020552 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278ba407-5f88-43bb-b87e-3c578936212a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:30.022401 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278ba407-5f88-43bb-b87e-3c578936212a None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:30.030413 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 433/876] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Jul 23 20:58:29 2022] GET /identity/v3/role_assignments?user.id=17b779a3e21a415bb42cde5d6863d9cf&scope.project.id=4804ed61295f4d4a92d9b685dd9e9f3b&role.id=abf9f3b81f3647dbb70c44d0aedaa614 => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 20:58:30.869525 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc03cdaf-39ba-4f0e-8bf1-b66ce6bce166 None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:30.870082 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc03cdaf-39ba-4f0e-8bf1-b66ce6bce166 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:30.870082 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc03cdaf-39ba-4f0e-8bf1-b66ce6bce166 None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:30.871593 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 444/877] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:58:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:58:30.877543 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4942497-a728-4e81-9976-6a2eccb10669 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:30.878483 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4942497-a728-4e81-9976-6a2eccb10669 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:30.878960 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4942497-a728-4e81-9976-6a2eccb10669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:30.900427 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-f4942497-a728-4e81-9976-6a2eccb10669 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:58:30.902812 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-f4942497-a728-4e81-9976-6a2eccb10669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:58:30.927146 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:30.972192 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 434/878] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:58:30 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 23 20:58:30.996306 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc03cdaf-39ba-4f0e-8bf1-b66ce6bce166 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:31.097121 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc03cdaf-39ba-4f0e-8bf1-b66ce6bce166 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:31.134066 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e165160-3aa7-438e-a5df-34d3f0dc791f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:31.134899 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e165160-3aa7-438e-a5df-34d3f0dc791f None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:31.135173 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e165160-3aa7-438e-a5df-34d3f0dc791f None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:31.135439 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e165160-3aa7-438e-a5df-34d3f0dc791f None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:31.136089 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e165160-3aa7-438e-a5df-34d3f0dc791f None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:31.137453 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e165160-3aa7-438e-a5df-34d3f0dc791f None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:31.149897 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-1e165160-3aa7-438e-a5df-34d3f0dc791f None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 23 20:58:31.149897 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:58:31.149897 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 23 20:58:31.149897 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 23 20:58:31.149897 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 23 20:58:31.149897 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 23 20:58:31.149897 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 23 20:58:31.149897 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 23 20:58:31.149897 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 23 20:58:31.149897 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 20:58:31.149897 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 23 20:58:31.149897 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 20:58:31.149897 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:58:31.149897 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:58:31.149897 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:58:31.149897 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:58:31.150789 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:58:31.150789 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:58:31.150789 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:58:31.150789 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:58:31.150789 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:58:31.150789 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:58:31.150789 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:58:31.150789 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 23 20:58:31.150789 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 23 20:58:31.150789 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 23 20:58:31.150789 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 23 20:58:31.150789 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:58:31.150789 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:58:31.150789 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:58:31.150789 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:58:31.150789 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:58:31.152045 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:58:31.152045 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:58:31.152045 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application with Lock( Jul 23 20:58:31.152045 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:58:31.152045 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:58:31.152045 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:58:31.152045 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:58:31.152045 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:58:31.152045 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:58:31.152045 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:58:31.152045 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:58:31.152045 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 23 20:58:31.152045 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 23 20:58:31.152045 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 23 20:58:31.152045 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 20:58:31.152045 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 445/879] 10.222.0.17 () {56 vars in 1132 bytes} [Sat Jul 23 20:58:30 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:58:31.157691 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4942497-a728-4e81-9976-6a2eccb10669 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:31.269226 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4942497-a728-4e81-9976-6a2eccb10669 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:31.304705 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8691d1-f611-4efc-97fb-44d48803e791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:31.305389 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8691d1-f611-4efc-97fb-44d48803e791 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:31.305671 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8691d1-f611-4efc-97fb-44d48803e791 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:31.305965 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8691d1-f611-4efc-97fb-44d48803e791 None admin] PATH_INFO: `/v3/services` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:31.306683 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8691d1-f611-4efc-97fb-44d48803e791 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:31.306987 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8691d1-f611-4efc-97fb-44d48803e791 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:31.308368 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8691d1-f611-4efc-97fb-44d48803e791 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:31.313854 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 435/880] 10.222.0.17 () {56 vars in 1126 bytes} [Sat Jul 23 20:58:31 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:58:31.319694 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e165160-3aa7-438e-a5df-34d3f0dc791f None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:31.334097 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:31.435957 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e165160-3aa7-438e-a5df-34d3f0dc791f None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:31.473517 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6198c70-bd53-4be3-8afb-cf66ccca4361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:31.474230 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6198c70-bd53-4be3-8afb-cf66ccca4361 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:31.474510 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6198c70-bd53-4be3-8afb-cf66ccca4361 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:31.474788 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6198c70-bd53-4be3-8afb-cf66ccca4361 None admin] PATH_INFO: `/v3/services` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:31.475506 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6198c70-bd53-4be3-8afb-cf66ccca4361 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:31.475853 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6198c70-bd53-4be3-8afb-cf66ccca4361 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:31.477238 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6198c70-bd53-4be3-8afb-cf66ccca4361 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:31.482777 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 446/881] 10.222.0.17 () {56 vars in 1126 bytes} [Sat Jul 23 20:58:31 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:58:31.488768 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8691d1-f611-4efc-97fb-44d48803e791 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:31.513691 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:31.593524 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8691d1-f611-4efc-97fb-44d48803e791 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:31.629602 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82778bbe-6a9a-43e6-b1df-e26dd26c0554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:31.630304 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82778bbe-6a9a-43e6-b1df-e26dd26c0554 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:31.630588 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82778bbe-6a9a-43e6-b1df-e26dd26c0554 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:31.630871 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82778bbe-6a9a-43e6-b1df-e26dd26c0554 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:31.631671 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82778bbe-6a9a-43e6-b1df-e26dd26c0554 None admin] RBAC: Adding query filter params (interface=public, service_id=f9049d8c52c24a54b43634478bb922fa, region_id=RegionOne) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:31.631981 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82778bbe-6a9a-43e6-b1df-e26dd26c0554 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:31.633369 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82778bbe-6a9a-43e6-b1df-e26dd26c0554 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:31.639346 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 436/882] 10.222.0.17 () {56 vars in 1251 bytes} [Sat Jul 23 20:58:31 2022] GET /identity/v3/endpoints?service_id=f9049d8c52c24a54b43634478bb922fa&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:58:31.644655 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6198c70-bd53-4be3-8afb-cf66ccca4361 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:31.732381 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:31.758845 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6198c70-bd53-4be3-8afb-cf66ccca4361 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:31.794407 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bf1e20-cec3-492d-9272-c3bb5f8a07b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:31.795144 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bf1e20-cec3-492d-9272-c3bb5f8a07b4 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:31.795425 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bf1e20-cec3-492d-9272-c3bb5f8a07b4 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:31.795736 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bf1e20-cec3-492d-9272-c3bb5f8a07b4 None admin] PATH_INFO: `/v3/services` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:31.796430 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bf1e20-cec3-492d-9272-c3bb5f8a07b4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:31.797809 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bf1e20-cec3-492d-9272-c3bb5f8a07b4 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:31.804219 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 447/883] 10.222.0.17 () {56 vars in 1087 bytes} [Sat Jul 23 20:58:31 2022] GET /identity/v3/services => generated 1268 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 20:58:32.088898 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56379a97-8504-4c7a-b6b6-2270b4c59145 None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:32.089999 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56379a97-8504-4c7a-b6b6-2270b4c59145 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:32.090484 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56379a97-8504-4c7a-b6b6-2270b4c59145 None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:32.092556 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 437/884] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:58:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:58:32.098982 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5438d2-9400-45dd-aa70-84be639ab107 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:32.099984 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5438d2-9400-45dd-aa70-84be639ab107 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:32.100454 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5438d2-9400-45dd-aa70-84be639ab107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:32.118616 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-0d5438d2-9400-45dd-aa70-84be639ab107 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:58:32.120153 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-0d5438d2-9400-45dd-aa70-84be639ab107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:58:32.197973 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 448/885] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:58:32 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 23 20:58:32.214694 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56379a97-8504-4c7a-b6b6-2270b4c59145 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:32.240029 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d951dc8d-a390-43fc-a332-78378a7963d9 None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:32.240375 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d951dc8d-a390-43fc-a332-78378a7963d9 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:32.240589 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d951dc8d-a390-43fc-a332-78378a7963d9 None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:32.242011 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 449/886] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:58:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 23 20:58:32.247685 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10c7671-8471-4f24-8c9f-0fef9aa0846f None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:32.248200 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10c7671-8471-4f24-8c9f-0fef9aa0846f None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:32.248619 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10c7671-8471-4f24-8c9f-0fef9aa0846f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:32.267820 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-a10c7671-8471-4f24-8c9f-0fef9aa0846f None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:58:32.269802 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-a10c7671-8471-4f24-8c9f-0fef9aa0846f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:58:32.334925 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:32.343410 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:32.358205 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 450/887] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:58:32 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 23 20:58:32.360536 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56379a97-8504-4c7a-b6b6-2270b4c59145 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:32.376935 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10c7671-8471-4f24-8c9f-0fef9aa0846f None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:32.402785 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5199a3cc-d192-489f-a253-50216c330724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:32.403984 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5199a3cc-d192-489f-a253-50216c330724 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:32.404674 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5199a3cc-d192-489f-a253-50216c330724 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:32.404970 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5199a3cc-d192-489f-a253-50216c330724 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:32.405649 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5199a3cc-d192-489f-a253-50216c330724 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:32.407566 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5199a3cc-d192-489f-a253-50216c330724 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:32.423891 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-5199a3cc-d192-489f-a253-50216c330724 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 23 20:58:32.423891 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:58:32.423891 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 23 20:58:32.423891 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 23 20:58:32.423891 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 23 20:58:32.423891 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 23 20:58:32.423891 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 23 20:58:32.423891 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 23 20:58:32.423891 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 23 20:58:32.423891 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:58:32.423891 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 23 20:58:32.423891 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:58:32.423891 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:58:32.423891 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:58:32.423891 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:58:32.423891 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:58:32.423891 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:58:32.424988 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:58:32.424988 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:58:32.424988 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:58:32.424988 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:58:32.424988 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:58:32.424988 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:58:32.424988 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 23 20:58:32.424988 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 23 20:58:32.424988 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 23 20:58:32.424988 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 23 20:58:32.424988 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:58:32.424988 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:58:32.424988 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:58:32.424988 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:58:32.424988 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:58:32.424988 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:58:32.425935 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:58:32.425935 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application with Lock( Jul 23 20:58:32.425935 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:58:32.425935 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:58:32.425935 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:58:32.425935 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:58:32.425935 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:58:32.425935 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:58:32.425935 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:58:32.425935 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:58:32.425935 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 23 20:58:32.425935 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 23 20:58:32.425935 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 23 20:58:32.425935 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:58:32.425935 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 438/888] 10.222.0.17 () {56 vars in 1126 bytes} [Sat Jul 23 20:58:32 2022] GET /identity/v3/services/object-store => generated 93 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:58:32.435047 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5199a3cc-d192-489f-a253-50216c330724 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:32.495911 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10c7671-8471-4f24-8c9f-0fef9aa0846f None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:32.531924 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a98a674-5f93-49cd-a954-c3cafd5c94a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:32.532751 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a98a674-5f93-49cd-a954-c3cafd5c94a8 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:32.533033 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a98a674-5f93-49cd-a954-c3cafd5c94a8 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:32.533309 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a98a674-5f93-49cd-a954-c3cafd5c94a8 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:32.533997 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a98a674-5f93-49cd-a954-c3cafd5c94a8 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:32.535427 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a98a674-5f93-49cd-a954-c3cafd5c94a8 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:32.547880 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-5a98a674-5f93-49cd-a954-c3cafd5c94a8 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 23 20:58:32.547880 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:58:32.547880 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 23 20:58:32.547880 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 23 20:58:32.547880 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 23 20:58:32.547880 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 23 20:58:32.547880 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 23 20:58:32.547880 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 23 20:58:32.547880 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 23 20:58:32.547880 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 20:58:32.547880 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 23 20:58:32.547880 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 20:58:32.547880 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:58:32.547880 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:58:32.547880 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:58:32.547880 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:58:32.547880 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:58:32.549075 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:58:32.549075 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:58:32.549075 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:58:32.549075 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:58:32.549075 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:58:32.549075 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:58:32.549075 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 23 20:58:32.549075 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 23 20:58:32.549075 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 23 20:58:32.549075 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 23 20:58:32.549075 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:58:32.549075 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:58:32.549075 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:58:32.549075 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:58:32.549075 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:58:32.549075 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:58:32.555040 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:58:32.555040 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application with Lock( Jul 23 20:58:32.555040 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:58:32.555040 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:58:32.555040 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:58:32.555040 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:58:32.555040 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:58:32.555040 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:58:32.555040 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:58:32.555040 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:58:32.555040 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 23 20:58:32.555040 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 23 20:58:32.555040 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 23 20:58:32.555040 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 20:58:32.555040 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 451/889] 10.222.0.17 () {56 vars in 1114 bytes} [Sat Jul 23 20:58:32 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 23 20:58:32.555970 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc27581-bca4-4def-8de9-def7fd2b9024 None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:32.555970 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc27581-bca4-4def-8de9-def7fd2b9024 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:32.555970 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc27581-bca4-4def-8de9-def7fd2b9024 None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:32.555970 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 452/890] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:58:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:58:32.557244 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc27581-bca4-4def-8de9-def7fd2b9024 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:32.567075 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5199a3cc-d192-489f-a253-50216c330724 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:32.603971 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01eb632-c92e-42e2-a4ae-7d562ff9ab60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:32.604571 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01eb632-c92e-42e2-a4ae-7d562ff9ab60 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:32.604850 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01eb632-c92e-42e2-a4ae-7d562ff9ab60 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:32.605119 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01eb632-c92e-42e2-a4ae-7d562ff9ab60 None admin] PATH_INFO: `/v3/services` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:32.605833 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01eb632-c92e-42e2-a4ae-7d562ff9ab60 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:32.606168 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01eb632-c92e-42e2-a4ae-7d562ff9ab60 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:32.607642 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01eb632-c92e-42e2-a4ae-7d562ff9ab60 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:32.612562 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 439/891] 10.222.0.17 () {56 vars in 1122 bytes} [Sat Jul 23 20:58:32 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:58:32.613606 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb6498c-bc2f-4818-b787-f72036ae6cc5 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:32.613922 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb6498c-bc2f-4818-b787-f72036ae6cc5 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:32.614196 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb6498c-bc2f-4818-b787-f72036ae6cc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:32.628907 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:32.631980 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-1cb6498c-bc2f-4818-b787-f72036ae6cc5 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:58:32.633347 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-1cb6498c-bc2f-4818-b787-f72036ae6cc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:58:32.644036 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:32.673927 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc27581-bca4-4def-8de9-def7fd2b9024 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:32.706372 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 440/892] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:58:32 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 23 20:58:32.707666 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb6498c-bc2f-4818-b787-f72036ae6cc5 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:32.720900 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d454ac80-126f-4f67-a214-7f2ba41230c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:32.721594 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d454ac80-126f-4f67-a214-7f2ba41230c2 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:32.721933 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d454ac80-126f-4f67-a214-7f2ba41230c2 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:32.722213 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d454ac80-126f-4f67-a214-7f2ba41230c2 None admin] PATH_INFO: `/v3/services` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:32.723225 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d454ac80-126f-4f67-a214-7f2ba41230c2 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:32.723530 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d454ac80-126f-4f67-a214-7f2ba41230c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:32.725686 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d454ac80-126f-4f67-a214-7f2ba41230c2 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:32.732001 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 453/893] 10.222.0.17 () {56 vars in 1114 bytes} [Sat Jul 23 20:58:32 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:58:32.737406 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d454ac80-126f-4f67-a214-7f2ba41230c2 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:32.820505 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb6498c-bc2f-4818-b787-f72036ae6cc5 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:32.852876 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d454ac80-126f-4f67-a214-7f2ba41230c2 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:32.855284 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59016389-95ab-4f67-b3bf-95c2f899ce3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:32.855892 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59016389-95ab-4f67-b3bf-95c2f899ce3c None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:32.856177 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59016389-95ab-4f67-b3bf-95c2f899ce3c None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:32.856450 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59016389-95ab-4f67-b3bf-95c2f899ce3c None admin] PATH_INFO: `/v3/services` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:32.857156 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59016389-95ab-4f67-b3bf-95c2f899ce3c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:32.857457 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59016389-95ab-4f67-b3bf-95c2f899ce3c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:32.858882 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59016389-95ab-4f67-b3bf-95c2f899ce3c None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:32.869923 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 441/894] 10.222.0.17 () {56 vars in 1122 bytes} [Sat Jul 23 20:58:32 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:58:32.869923 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59016389-95ab-4f67-b3bf-95c2f899ce3c None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:32.876221 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:32.901431 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:32.914549 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15256e1-48fd-4e1a-a2ba-1fc4015b09e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:32.915402 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15256e1-48fd-4e1a-a2ba-1fc4015b09e3 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:32.915694 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15256e1-48fd-4e1a-a2ba-1fc4015b09e3 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:32.916034 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15256e1-48fd-4e1a-a2ba-1fc4015b09e3 None admin] PATH_INFO: `/v3/services` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:32.916999 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15256e1-48fd-4e1a-a2ba-1fc4015b09e3 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:32.917181 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15256e1-48fd-4e1a-a2ba-1fc4015b09e3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:32.918674 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15256e1-48fd-4e1a-a2ba-1fc4015b09e3 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:32.929960 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 454/895] 10.222.0.17 () {56 vars in 1114 bytes} [Sat Jul 23 20:58:32 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 20:58:32.931066 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15256e1-48fd-4e1a-a2ba-1fc4015b09e3 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:33.016504 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59016389-95ab-4f67-b3bf-95c2f899ce3c None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:33.051081 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15256e1-48fd-4e1a-a2ba-1fc4015b09e3 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:33.057267 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354b0c3d-66eb-4c70-9c1b-8fb2da6fbd99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:33.058239 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354b0c3d-66eb-4c70-9c1b-8fb2da6fbd99 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:33.058686 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354b0c3d-66eb-4c70-9c1b-8fb2da6fbd99 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:33.059028 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354b0c3d-66eb-4c70-9c1b-8fb2da6fbd99 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:33.072342 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354b0c3d-66eb-4c70-9c1b-8fb2da6fbd99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:58:33.080951 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-354b0c3d-66eb-4c70-9c1b-8fb2da6fbd99 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 23 20:58:33.080951 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:58:33.080951 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:58:33.080951 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:58:33.080951 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:58:33.080951 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:58:33.080951 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:58:33.080951 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:58:33.080951 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:58:33.080951 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:58:33.080951 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:58:33.080951 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:58:33.080951 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:58:33.080951 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:58:33.080951 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:58:33.080951 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:58:33.082230 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:58:33.082230 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:58:33.082230 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:58:33.082230 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:58:33.082230 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:58:33.082230 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:58:33.082230 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:58:33.082230 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:58:33.082230 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:58:33.082230 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:58:33.082230 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:58:33.082230 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application with Lock( Jul 23 20:58:33.082230 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:58:33.082230 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:58:33.082230 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:58:33.082230 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:58:33.083286 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:58:33.083286 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:58:33.083286 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:58:33.083286 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:58:33.083286 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:58:33.083286 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:58:33.083286 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:58:33.083286 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:58:33.083286 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:58:33.083286 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:58:33.083286 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 23 20:58:33.083286 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:58:33.089910 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 442/896] 10.222.0.17 () {56 vars in 1120 bytes} [Sat Jul 23 20:58:32 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:58:33.095167 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354b0c3d-66eb-4c70-9c1b-8fb2da6fbd99 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:33.098175 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c14f325-bf69-4914-b219-afaf321dd8e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:33.098958 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c14f325-bf69-4914-b219-afaf321dd8e9 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:33.099435 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c14f325-bf69-4914-b219-afaf321dd8e9 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:33.099950 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c14f325-bf69-4914-b219-afaf321dd8e9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:33.100580 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c14f325-bf69-4914-b219-afaf321dd8e9 None admin] RBAC: Adding query filter params (interface=public, service_id=5737fc8bfd064a4dbe76e0905c82e72c, region_id=RegionOne) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:33.100941 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c14f325-bf69-4914-b219-afaf321dd8e9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:33.102486 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c14f325-bf69-4914-b219-afaf321dd8e9 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:33.108877 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 455/897] 10.222.0.17 () {56 vars in 1251 bytes} [Sat Jul 23 20:58:32 2022] GET /identity/v3/endpoints?service_id=5737fc8bfd064a4dbe76e0905c82e72c&interface=public®ion_id=RegionOne => generated 194 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:58:33.115602 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c14f325-bf69-4914-b219-afaf321dd8e9 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:33.176530 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:33.191124 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:33.222892 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354b0c3d-66eb-4c70-9c1b-8fb2da6fbd99 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:33.252924 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c14f325-bf69-4914-b219-afaf321dd8e9 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:33.266769 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2c8de9-5c5b-4cb0-bd70-5bc45e2d5157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:33.267460 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2c8de9-5c5b-4cb0-bd70-5bc45e2d5157 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:33.267736 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2c8de9-5c5b-4cb0-bd70-5bc45e2d5157 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:33.267996 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2c8de9-5c5b-4cb0-bd70-5bc45e2d5157 None admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:33.268797 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2c8de9-5c5b-4cb0-bd70-5bc45e2d5157 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:33.269132 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2c8de9-5c5b-4cb0-bd70-5bc45e2d5157 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:33.270715 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2c8de9-5c5b-4cb0-bd70-5bc45e2d5157 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:33.287242 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 443/898] 10.222.0.17 () {56 vars in 1115 bytes} [Sat Jul 23 20:58:33 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 20:58:33.288411 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2c8de9-5c5b-4cb0-bd70-5bc45e2d5157 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:33.303343 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12df1a5-8551-49d1-86ee-b00bb1ae0c3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:33.304476 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12df1a5-8551-49d1-86ee-b00bb1ae0c3d None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:33.304950 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12df1a5-8551-49d1-86ee-b00bb1ae0c3d None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:33.305433 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12df1a5-8551-49d1-86ee-b00bb1ae0c3d None admin] PATH_INFO: `/v3/services` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:33.306458 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12df1a5-8551-49d1-86ee-b00bb1ae0c3d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:33.308056 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12df1a5-8551-49d1-86ee-b00bb1ae0c3d None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:33.314922 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 456/899] 10.222.0.17 () {56 vars in 1087 bytes} [Sat Jul 23 20:58:33 2022] GET /identity/v3/services => generated 1268 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 20:58:33.429060 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2c8de9-5c5b-4cb0-bd70-5bc45e2d5157 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:33.466593 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:33.473767 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02caa7a-56be-4b1d-bdad-3358cca26ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:33.474628 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02caa7a-56be-4b1d-bdad-3358cca26ad2 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:33.474896 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02caa7a-56be-4b1d-bdad-3358cca26ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:33.475172 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02caa7a-56be-4b1d-bdad-3358cca26ad2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:33.487716 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02caa7a-56be-4b1d-bdad-3358cca26ad2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:33.489210 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02caa7a-56be-4b1d-bdad-3358cca26ad2 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:33.508278 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-c02caa7a-56be-4b1d-bdad-3358cca26ad2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:58:33.508278 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:58:33.508278 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:58:33.508278 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:58:33.508278 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:58:33.508278 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:58:33.508278 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:58:33.508278 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:58:33.508278 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:58:33.508278 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:58:33.508278 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:58:33.508278 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:58:33.508278 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 23 20:58:33.508278 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 23 20:58:33.508278 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 23 20:58:33.509234 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 23 20:58:33.509234 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:58:33.509234 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:58:33.509234 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:58:33.509234 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:58:33.509234 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:58:33.509234 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:58:33.509234 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:58:33.509234 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application with Lock( Jul 23 20:58:33.509234 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:58:33.509234 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:58:33.509234 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:58:33.509234 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:58:33.509234 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:58:33.509234 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:58:33.509234 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:58:33.509234 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:58:33.510673 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 23 20:58:33.510673 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 23 20:58:33.510673 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:58:33.510673 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:58:33.514478 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 444/900] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 23 20:58:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:58:33.516306 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12df1a5-8551-49d1-86ee-b00bb1ae0c3d None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:33.624756 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12df1a5-8551-49d1-86ee-b00bb1ae0c3d None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:33.642770 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:33.662442 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440208fe-4d95-403d-a91c-01a1e4ac2ccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:33.663117 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440208fe-4d95-403d-a91c-01a1e4ac2ccc None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:33.663442 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440208fe-4d95-403d-a91c-01a1e4ac2ccc None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:33.663719 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440208fe-4d95-403d-a91c-01a1e4ac2ccc None admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:33.664438 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440208fe-4d95-403d-a91c-01a1e4ac2ccc None admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:33.664744 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440208fe-4d95-403d-a91c-01a1e4ac2ccc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:33.666138 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440208fe-4d95-403d-a91c-01a1e4ac2ccc None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:33.678928 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 457/901] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 23 20:58:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:58:33.684598 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02caa7a-56be-4b1d-bdad-3358cca26ad2 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:33.791894 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02caa7a-56be-4b1d-bdad-3358cca26ad2 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:33.829314 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9898291d-f4d8-4f4c-9d11-054abd5f4413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:33.830177 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9898291d-f4d8-4f4c-9d11-054abd5f4413 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:33.830457 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9898291d-f4d8-4f4c-9d11-054abd5f4413 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:33.830725 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9898291d-f4d8-4f4c-9d11-054abd5f4413 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:33.838992 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9898291d-f4d8-4f4c-9d11-054abd5f4413 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:33.840507 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9898291d-f4d8-4f4c-9d11-054abd5f4413 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:33.855471 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-9898291d-f4d8-4f4c-9d11-054abd5f4413 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 23 20:58:33.855471 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:58:33.855471 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:58:33.855471 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:58:33.855471 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:58:33.855471 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:58:33.855471 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:58:33.855471 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:58:33.855471 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:58:33.855471 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:58:33.855471 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:58:33.855471 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:58:33.855471 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 23 20:58:33.855471 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 23 20:58:33.855471 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 23 20:58:33.855471 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 23 20:58:33.856421 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:58:33.856421 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:58:33.856421 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 23 20:58:33.856421 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 23 20:58:33.856421 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 23 20:58:33.856421 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 23 20:58:33.856421 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:58:33.856421 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:58:33.856421 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:58:33.856421 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:58:33.856421 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:58:33.856421 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application with Lock( Jul 23 20:58:33.856421 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:58:33.856421 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:58:33.856421 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:58:33.856421 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:58:33.856421 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:58:33.856421 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:58:33.857766 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:58:33.857766 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:58:33.857766 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 23 20:58:33.857766 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 23 20:58:33.857766 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 23 20:58:33.857766 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 23 20:58:33.857766 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 23 20:58:33.857766 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 23 20:58:33.857766 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 23 20:58:33.857766 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:58:33.857766 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 445/902] 10.222.0.17 () {56 vars in 1117 bytes} [Sat Jul 23 20:58:33 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:58:33.862852 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440208fe-4d95-403d-a91c-01a1e4ac2ccc None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:33.968015 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440208fe-4d95-403d-a91c-01a1e4ac2ccc None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:34.003212 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd6ef65-6921-4dab-9c72-2b8fcde617a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:34.003921 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd6ef65-6921-4dab-9c72-2b8fcde617a8 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:34.004201 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd6ef65-6921-4dab-9c72-2b8fcde617a8 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:34.004474 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd6ef65-6921-4dab-9c72-2b8fcde617a8 None admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:34.005415 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd6ef65-6921-4dab-9c72-2b8fcde617a8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:34.005730 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd6ef65-6921-4dab-9c72-2b8fcde617a8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:34.007294 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd6ef65-6921-4dab-9c72-2b8fcde617a8 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:34.029050 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 458/903] 10.222.0.17 () {56 vars in 1149 bytes} [Sat Jul 23 20:58:33 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:58:34.034837 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9898291d-f4d8-4f4c-9d11-054abd5f4413 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:34.084525 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:34.144438 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9898291d-f4d8-4f4c-9d11-054abd5f4413 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:34.177967 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1162d0-8027-4317-8f53-bf3294dd5aba None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:34.178508 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1162d0-8027-4317-8f53-bf3294dd5aba None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:34.178508 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1162d0-8027-4317-8f53-bf3294dd5aba None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:34.180255 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 459/904] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:58:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:58:34.183153 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59750228-35b6-429e-a377-02cd210df8c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:34.184086 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59750228-35b6-429e-a377-02cd210df8c8 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:34.184514 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59750228-35b6-429e-a377-02cd210df8c8 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:34.184994 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59750228-35b6-429e-a377-02cd210df8c8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:34.185423 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7dcd33-144e-4201-b6cf-a96d1bfdd472 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:34.185708 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7dcd33-144e-4201-b6cf-a96d1bfdd472 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:34.186071 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7dcd33-144e-4201-b6cf-a96d1bfdd472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:34.202616 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-ab7dcd33-144e-4201-b6cf-a96d1bfdd472 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:58:34.203805 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-ab7dcd33-144e-4201-b6cf-a96d1bfdd472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:58:34.237205 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:34.266662 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59750228-35b6-429e-a377-02cd210df8c8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:34.268129 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59750228-35b6-429e-a377-02cd210df8c8 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:34.280474 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 460/905] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:58:34 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 23 20:58:34.305310 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7dcd33-144e-4201-b6cf-a96d1bfdd472 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:34.346343 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:34.391248 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 446/906] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Jul 23 20:58:34 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 23 20:58:34.397225 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59750228-35b6-429e-a377-02cd210df8c8 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:34.423703 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7dcd33-144e-4201-b6cf-a96d1bfdd472 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:34.460226 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d16632-ee37-43a8-b225-f532b1ff3758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:34.461455 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d16632-ee37-43a8-b225-f532b1ff3758 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:34.461981 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d16632-ee37-43a8-b225-f532b1ff3758 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:34.462453 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d16632-ee37-43a8-b225-f532b1ff3758 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:34.463301 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d16632-ee37-43a8-b225-f532b1ff3758 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:34.464865 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d16632-ee37-43a8-b225-f532b1ff3758 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:34.477643 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-54d16632-ee37-43a8-b225-f532b1ff3758 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 23 20:58:34.477643 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:58:34.477643 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 23 20:58:34.477643 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 23 20:58:34.477643 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 23 20:58:34.477643 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 23 20:58:34.477643 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 23 20:58:34.477643 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 23 20:58:34.477643 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 23 20:58:34.477643 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 20:58:34.477643 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 23 20:58:34.477643 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 20:58:34.477643 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:58:34.477643 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:58:34.477643 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:58:34.477643 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:58:34.478647 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:58:34.478647 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:58:34.478647 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:58:34.478647 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:58:34.478647 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:58:34.478647 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:58:34.478647 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:58:34.478647 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 23 20:58:34.478647 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 23 20:58:34.478647 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 23 20:58:34.478647 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 23 20:58:34.478647 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:58:34.478647 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:58:34.478647 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:58:34.478647 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:58:34.478647 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:58:34.479479 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:58:34.479479 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:58:34.479479 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application with Lock( Jul 23 20:58:34.479479 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:58:34.479479 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:58:34.479479 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:58:34.479479 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:58:34.479479 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:58:34.479479 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:58:34.479479 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:58:34.479479 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:58:34.479479 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 23 20:58:34.479479 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 23 20:58:34.479479 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 23 20:58:34.479479 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 20:58:34.482580 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 461/907] 10.222.0.17 () {56 vars in 1132 bytes} [Sat Jul 23 20:58:34 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 23 20:58:34.489732 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d16632-ee37-43a8-b225-f532b1ff3758 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:34.516475 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59750228-35b6-429e-a377-02cd210df8c8 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:34.528959 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:34.563333 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5256b846-1b79-4ae3-a552-1a218f5e7dc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:34.564789 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5256b846-1b79-4ae3-a552-1a218f5e7dc3 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:34.565419 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5256b846-1b79-4ae3-a552-1a218f5e7dc3 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:34.566040 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5256b846-1b79-4ae3-a552-1a218f5e7dc3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:34.585050 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5256b846-1b79-4ae3-a552-1a218f5e7dc3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:34.586865 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5256b846-1b79-4ae3-a552-1a218f5e7dc3 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:34.589449 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:34.612448 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-5256b846-1b79-4ae3-a552-1a218f5e7dc3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:58:34.612448 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:58:34.612448 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:58:34.612448 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:58:34.612448 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:58:34.612448 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:58:34.612448 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:58:34.612448 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:58:34.612448 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:58:34.612448 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:58:34.612448 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:58:34.612448 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:58:34.612448 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 23 20:58:34.612448 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 23 20:58:34.612448 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 23 20:58:34.613422 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 23 20:58:34.613422 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:58:34.613422 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:58:34.613422 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:58:34.613422 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:58:34.613422 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:58:34.613422 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:58:34.613422 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:58:34.613422 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application with Lock( Jul 23 20:58:34.613422 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:58:34.613422 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:58:34.613422 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:58:34.613422 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:58:34.613422 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:58:34.613422 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:58:34.613422 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:58:34.613422 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:58:34.614372 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 23 20:58:34.614372 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 23 20:58:34.614372 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:58:34.614372 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:58:34.614593 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d16632-ee37-43a8-b225-f532b1ff3758 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:34.623242 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 447/908] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 23 20:58:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:58:34.623692 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5256b846-1b79-4ae3-a552-1a218f5e7dc3 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:34.669030 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bb3341-e65c-4477-b1dd-2faafb509385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:34.669727 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bb3341-e65c-4477-b1dd-2faafb509385 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:34.670046 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bb3341-e65c-4477-b1dd-2faafb509385 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:34.670327 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bb3341-e65c-4477-b1dd-2faafb509385 None admin] PATH_INFO: `/v3/services` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:34.671048 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bb3341-e65c-4477-b1dd-2faafb509385 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:34.671356 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bb3341-e65c-4477-b1dd-2faafb509385 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:34.672741 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bb3341-e65c-4477-b1dd-2faafb509385 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:34.678759 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 462/909] 10.222.0.17 () {56 vars in 1126 bytes} [Sat Jul 23 20:58:34 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 20:58:34.686885 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bb3341-e65c-4477-b1dd-2faafb509385 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:34.765449 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5256b846-1b79-4ae3-a552-1a218f5e7dc3 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:34.803271 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b161b0-fef8-46fe-9207-6dad3e095035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:34.804008 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b161b0-fef8-46fe-9207-6dad3e095035 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:34.804173 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:34.804317 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b161b0-fef8-46fe-9207-6dad3e095035 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:34.804556 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b161b0-fef8-46fe-9207-6dad3e095035 None admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:34.805896 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b161b0-fef8-46fe-9207-6dad3e095035 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:34.806505 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b161b0-fef8-46fe-9207-6dad3e095035 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:34.808275 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b161b0-fef8-46fe-9207-6dad3e095035 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:34.815642 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bb3341-e65c-4477-b1dd-2faafb509385 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:34.831974 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 448/910] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 23 20:58:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 20:58:34.837720 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b161b0-fef8-46fe-9207-6dad3e095035 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:34.866780 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858d64f1-78a8-4f93-9e93-70347743420b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:34.867716 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858d64f1-78a8-4f93-9e93-70347743420b None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:34.868410 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858d64f1-78a8-4f93-9e93-70347743420b None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:34.868835 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858d64f1-78a8-4f93-9e93-70347743420b None admin] PATH_INFO: `/v3/services` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:34.869972 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858d64f1-78a8-4f93-9e93-70347743420b None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:34.870849 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858d64f1-78a8-4f93-9e93-70347743420b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:34.872882 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858d64f1-78a8-4f93-9e93-70347743420b None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:34.880041 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 463/911] 10.222.0.17 () {56 vars in 1126 bytes} [Sat Jul 23 20:58:34 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:58:34.885245 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858d64f1-78a8-4f93-9e93-70347743420b None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:34.907061 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:34.955926 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b161b0-fef8-46fe-9207-6dad3e095035 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:34.991419 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28724ea9-cb87-477e-9fa5-1ba3275d4a7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:34.992599 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28724ea9-cb87-477e-9fa5-1ba3275d4a7e None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:34.993107 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28724ea9-cb87-477e-9fa5-1ba3275d4a7e None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:34.993607 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28724ea9-cb87-477e-9fa5-1ba3275d4a7e None admin] PATH_INFO: `/v3/projects/service` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:34.995298 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858d64f1-78a8-4f93-9e93-70347743420b None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:35.001795 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28724ea9-cb87-477e-9fa5-1ba3275d4a7e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:35.003723 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28724ea9-cb87-477e-9fa5-1ba3275d4a7e None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:35.021678 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-28724ea9-cb87-477e-9fa5-1ba3275d4a7e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 23 20:58:35.021678 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:58:35.021678 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:58:35.021678 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:58:35.021678 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:58:35.021678 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:58:35.021678 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:58:35.021678 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:58:35.021678 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:58:35.021678 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:58:35.021678 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:58:35.021678 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:58:35.021678 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 23 20:58:35.021678 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 23 20:58:35.021678 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 23 20:58:35.022661 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 23 20:58:35.022661 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:58:35.022661 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:58:35.022661 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:58:35.022661 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:58:35.022661 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:58:35.022661 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:58:35.022661 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:58:35.022661 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application with Lock( Jul 23 20:58:35.022661 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:58:35.022661 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:58:35.022661 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:58:35.022661 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:58:35.022661 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:58:35.022661 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:58:35.022661 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:58:35.022661 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:58:35.023572 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 23 20:58:35.023572 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 23 20:58:35.023572 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 23 20:58:35.023572 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 23 20:58:35.023572 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 23 20:58:35.023572 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 23 20:58:35.023572 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 23 20:58:35.023572 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:58:35.026314 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 449/912] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Jul 23 20:58:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:58:35.035468 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28724ea9-cb87-477e-9fa5-1ba3275d4a7e None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:35.048138 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be55cc45-8175-4092-8b9c-7273448bb945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:35.048837 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be55cc45-8175-4092-8b9c-7273448bb945 None admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:35.049305 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be55cc45-8175-4092-8b9c-7273448bb945 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:35.049698 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be55cc45-8175-4092-8b9c-7273448bb945 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:35.050567 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be55cc45-8175-4092-8b9c-7273448bb945 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:35.052039 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be55cc45-8175-4092-8b9c-7273448bb945 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:35.082037 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 464/913] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 23 20:58:34 2022] POST /identity/v3/endpoints => generated 347 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 20:58:35.149712 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28724ea9-cb87-477e-9fa5-1ba3275d4a7e None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:35.171883 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:35.206736 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e67c9c-c372-4bca-b27b-7ec8b686d3dd None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:35.207302 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87771ea-5365-45b0-8679-c3180a52e25f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:35.207400 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e67c9c-c372-4bca-b27b-7ec8b686d3dd None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:35.207400 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e67c9c-c372-4bca-b27b-7ec8b686d3dd None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:35.207726 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87771ea-5365-45b0-8679-c3180a52e25f None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:35.207921 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87771ea-5365-45b0-8679-c3180a52e25f None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:35.208191 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87771ea-5365-45b0-8679-c3180a52e25f None admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:35.208979 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87771ea-5365-45b0-8679-c3180a52e25f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:35.209079 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 465/914] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:58:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 23 20:58:35.209283 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87771ea-5365-45b0-8679-c3180a52e25f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:35.210781 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87771ea-5365-45b0-8679-c3180a52e25f None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:35.215688 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e203a8a7-82a1-4ca1-8fb9-8312a6d4fd61 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:35.215968 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e203a8a7-82a1-4ca1-8fb9-8312a6d4fd61 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:35.216242 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e203a8a7-82a1-4ca1-8fb9-8312a6d4fd61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:35.224772 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 450/915] 10.222.0.17 () {56 vars in 1148 bytes} [Sat Jul 23 20:58:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:58:35.231379 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87771ea-5365-45b0-8679-c3180a52e25f None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:35.237903 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-e203a8a7-82a1-4ca1-8fb9-8312a6d4fd61 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:58:35.239169 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-e203a8a7-82a1-4ca1-8fb9-8312a6d4fd61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:58:35.253773 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:35.344516 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 466/916] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:58:35 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 23 20:58:35.363736 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87771ea-5365-45b0-8679-c3180a52e25f None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:35.368280 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e203a8a7-82a1-4ca1-8fb9-8312a6d4fd61 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:35.399460 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c3aff0-fee5-4440-985d-5838bccb79d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:35.400134 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c3aff0-fee5-4440-985d-5838bccb79d6 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:35.400411 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c3aff0-fee5-4440-985d-5838bccb79d6 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:35.400684 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c3aff0-fee5-4440-985d-5838bccb79d6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:35.401520 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c3aff0-fee5-4440-985d-5838bccb79d6 None admin] RBAC: Adding query filter params (role.id=3295256c44774d3ea100d28799b26fd9, scope.project.id=4804ed61295f4d4a92d9b685dd9e9f3b, user.id=17b779a3e21a415bb42cde5d6863d9cf) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:35.401828 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c3aff0-fee5-4440-985d-5838bccb79d6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:35.403741 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c3aff0-fee5-4440-985d-5838bccb79d6 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:35.410034 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 451/917] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Jul 23 20:58:35 2022] GET /identity/v3/role_assignments?user.id=17b779a3e21a415bb42cde5d6863d9cf&scope.project.id=4804ed61295f4d4a92d9b685dd9e9f3b&role.id=3295256c44774d3ea100d28799b26fd9 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:58:35.479305 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e203a8a7-82a1-4ca1-8fb9-8312a6d4fd61 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:35.517819 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47eadfe-268c-40d4-8def-5d7d46f5ac07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:35.518572 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47eadfe-268c-40d4-8def-5d7d46f5ac07 None admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:35.518918 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47eadfe-268c-40d4-8def-5d7d46f5ac07 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:35.519191 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47eadfe-268c-40d4-8def-5d7d46f5ac07 None admin] PATH_INFO: `/v3/services` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:35.519925 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47eadfe-268c-40d4-8def-5d7d46f5ac07 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:35.521326 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47eadfe-268c-40d4-8def-5d7d46f5ac07 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:35.539811 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 467/918] 10.222.0.17 () {60 vars in 1141 bytes} [Sat Jul 23 20:58:35 2022] POST /identity/v3/services => generated 241 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 20:58:35.830074 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63307555-bd21-45e8-9fe2-390ce9bad818 None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:35.830390 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63307555-bd21-45e8-9fe2-390ce9bad818 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:35.830636 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63307555-bd21-45e8-9fe2-390ce9bad818 None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:35.832407 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 452/919] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:58:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:58:35.838092 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1725f5-ebef-4f51-8451-9f28754723bf None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:35.838385 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1725f5-ebef-4f51-8451-9f28754723bf None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:35.838669 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1725f5-ebef-4f51-8451-9f28754723bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:35.844847 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:35.858238 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-be1725f5-ebef-4f51-8451-9f28754723bf None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:58:35.859829 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-be1725f5-ebef-4f51-8451-9f28754723bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:58:35.942700 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 468/920] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:58:35 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 23 20:58:35.967130 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63307555-bd21-45e8-9fe2-390ce9bad818 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:36.004601 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:36.075963 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63307555-bd21-45e8-9fe2-390ce9bad818 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:36.111459 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9f646e-cd20-4fef-ad8c-8ae04d9cdabe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:36.112271 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9f646e-cd20-4fef-ad8c-8ae04d9cdabe None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:36.112578 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9f646e-cd20-4fef-ad8c-8ae04d9cdabe None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:36.112846 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9f646e-cd20-4fef-ad8c-8ae04d9cdabe None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:36.113496 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9f646e-cd20-4fef-ad8c-8ae04d9cdabe None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:36.114894 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9f646e-cd20-4fef-ad8c-8ae04d9cdabe None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:36.126890 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-fc9f646e-cd20-4fef-ad8c-8ae04d9cdabe None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 23 20:58:36.126890 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:58:36.126890 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 23 20:58:36.126890 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 23 20:58:36.126890 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 23 20:58:36.126890 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 23 20:58:36.126890 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 23 20:58:36.126890 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 23 20:58:36.126890 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 23 20:58:36.126890 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:58:36.126890 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 23 20:58:36.126890 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:58:36.126890 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:58:36.126890 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:58:36.126890 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:58:36.126890 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:58:36.126890 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:58:36.127910 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:58:36.127910 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:58:36.127910 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:58:36.127910 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:58:36.127910 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:58:36.127910 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:58:36.127910 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 23 20:58:36.127910 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 23 20:58:36.127910 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 23 20:58:36.127910 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 23 20:58:36.127910 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:58:36.127910 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:58:36.127910 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:58:36.127910 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:58:36.127910 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:58:36.127910 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:58:36.128889 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:58:36.128889 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application with Lock( Jul 23 20:58:36.128889 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:58:36.128889 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:58:36.128889 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:58:36.128889 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:58:36.128889 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:58:36.128889 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:58:36.128889 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:58:36.128889 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:58:36.128889 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 23 20:58:36.128889 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 23 20:58:36.128889 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 23 20:58:36.128889 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:58:36.128889 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 453/921] 10.222.0.17 () {56 vars in 1114 bytes} [Sat Jul 23 20:58:35 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:58:36.134445 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1725f5-ebef-4f51-8451-9f28754723bf None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:36.244236 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1725f5-ebef-4f51-8451-9f28754723bf None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:36.274847 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:36.282058 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfcb400-27b3-4ea1-97b1-3919e91914b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:36.282743 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfcb400-27b3-4ea1-97b1-3919e91914b4 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:36.283023 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfcb400-27b3-4ea1-97b1-3919e91914b4 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:36.283297 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfcb400-27b3-4ea1-97b1-3919e91914b4 None admin] PATH_INFO: `/v3/services` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:36.284011 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfcb400-27b3-4ea1-97b1-3919e91914b4 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:36.284341 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfcb400-27b3-4ea1-97b1-3919e91914b4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:36.285733 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfcb400-27b3-4ea1-97b1-3919e91914b4 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:36.295628 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 469/922] 10.222.0.17 () {56 vars in 1114 bytes} [Sat Jul 23 20:58:36 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:58:36.297046 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9f646e-cd20-4fef-ad8c-8ae04d9cdabe None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:36.402542 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:36.407057 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9f646e-cd20-4fef-ad8c-8ae04d9cdabe None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:36.443772 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d288d5-f4c7-4738-bba8-56f263a0ceb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:36.444495 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d288d5-f4c7-4738-bba8-56f263a0ceb5 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:36.444770 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d288d5-f4c7-4738-bba8-56f263a0ceb5 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:36.445045 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d288d5-f4c7-4738-bba8-56f263a0ceb5 None admin] PATH_INFO: `/v3/services` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:36.445754 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d288d5-f4c7-4738-bba8-56f263a0ceb5 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:36.446080 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d288d5-f4c7-4738-bba8-56f263a0ceb5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:36.447458 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d288d5-f4c7-4738-bba8-56f263a0ceb5 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:36.452974 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 454/923] 10.222.0.17 () {56 vars in 1114 bytes} [Sat Jul 23 20:58:36 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:58:36.458982 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfcb400-27b3-4ea1-97b1-3919e91914b4 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:36.563359 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfcb400-27b3-4ea1-97b1-3919e91914b4 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:36.601193 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396d1c0b-8210-4feb-8b8b-c00269679aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:36.601885 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396d1c0b-8210-4feb-8b8b-c00269679aec None admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:36.602191 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396d1c0b-8210-4feb-8b8b-c00269679aec None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:36.602464 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396d1c0b-8210-4feb-8b8b-c00269679aec None admin] PATH_INFO: `/v3/endpoints` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:36.603211 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396d1c0b-8210-4feb-8b8b-c00269679aec None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:36.604578 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396d1c0b-8210-4feb-8b8b-c00269679aec None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:36.630138 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 470/924] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 23 20:58:36 2022] POST /identity/v3/endpoints => generated 346 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 20:58:37.526132 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e94a80-3ab5-49a9-903b-a7164045ce8d None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:37.526868 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e94a80-3ab5-49a9-903b-a7164045ce8d None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:37.526868 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e94a80-3ab5-49a9-903b-a7164045ce8d None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:37.528663 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 455/925] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:58:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:58:37.534838 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499ece6b-181e-4538-ba7f-041466690402 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:37.535507 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499ece6b-181e-4538-ba7f-041466690402 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:37.535507 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499ece6b-181e-4538-ba7f-041466690402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:37.554128 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-499ece6b-181e-4538-ba7f-041466690402 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:58:37.555365 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-499ece6b-181e-4538-ba7f-041466690402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:58:37.605818 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:37.634504 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 471/926] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:58:37 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 23 20:58:37.662735 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e94a80-3ab5-49a9-903b-a7164045ce8d None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:37.702112 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfad82d-ce4f-4d8f-81da-da2863ecf0ab None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:37.702435 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfad82d-ce4f-4d8f-81da-da2863ecf0ab None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:37.702640 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfad82d-ce4f-4d8f-81da-da2863ecf0ab None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:37.704253 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 472/927] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:58:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:58:37.709783 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca52095d-96df-4e6b-88d5-97063525bda7 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:37.710093 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca52095d-96df-4e6b-88d5-97063525bda7 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:37.710373 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca52095d-96df-4e6b-88d5-97063525bda7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:37.731092 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-ca52095d-96df-4e6b-88d5-97063525bda7 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:58:37.732347 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-ca52095d-96df-4e6b-88d5-97063525bda7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:58:37.793489 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e94a80-3ab5-49a9-903b-a7164045ce8d None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:37.807295 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 473/928] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:58:37 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 23 20:58:37.838141 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca52095d-96df-4e6b-88d5-97063525bda7 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:37.842167 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf34cc2-2e84-43df-bef8-27e183353acb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:37.843409 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf34cc2-2e84-43df-bef8-27e183353acb None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:37.843899 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf34cc2-2e84-43df-bef8-27e183353acb None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:37.844376 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf34cc2-2e84-43df-bef8-27e183353acb None admin] PATH_INFO: `/v3/services/compute` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:37.845343 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf34cc2-2e84-43df-bef8-27e183353acb None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:37.847164 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf34cc2-2e84-43df-bef8-27e183353acb None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:37.861429 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-4cf34cc2-2e84-43df-bef8-27e183353acb None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 23 20:58:37.861429 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:58:37.861429 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 23 20:58:37.861429 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 23 20:58:37.861429 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 23 20:58:37.861429 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 23 20:58:37.861429 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 23 20:58:37.861429 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 23 20:58:37.861429 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 23 20:58:37.861429 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:58:37.861429 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 23 20:58:37.861429 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:58:37.861429 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:58:37.861429 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:58:37.861429 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:58:37.861429 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:58:37.861429 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:58:37.862628 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:58:37.862628 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:58:37.862628 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:58:37.862628 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:58:37.862628 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:58:37.862628 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:58:37.862628 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 23 20:58:37.862628 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 23 20:58:37.862628 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 23 20:58:37.862628 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 23 20:58:37.862628 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:58:37.862628 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:58:37.862628 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:58:37.862628 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:58:37.862628 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:58:37.862628 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:58:37.863467 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:58:37.863467 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application with Lock( Jul 23 20:58:37.863467 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:58:37.863467 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:58:37.863467 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:58:37.863467 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:58:37.863467 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:58:37.863467 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:58:37.863467 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:58:37.863467 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:58:37.863467 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 23 20:58:37.863467 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 23 20:58:37.863467 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 23 20:58:37.863467 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:58:37.866142 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 456/929] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Jul 23 20:58:37 2022] GET /identity/v3/services/compute => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:58:37.872229 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf34cc2-2e84-43df-bef8-27e183353acb None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:37.906150 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:37.951755 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca52095d-96df-4e6b-88d5-97063525bda7 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:37.960848 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:37.984619 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf34cc2-2e84-43df-bef8-27e183353acb None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:37.989432 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de66c7b-2af8-4c70-80de-caf447aae36a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:37.990378 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de66c7b-2af8-4c70-80de-caf447aae36a None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:37.990659 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de66c7b-2af8-4c70-80de-caf447aae36a None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:37.990926 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de66c7b-2af8-4c70-80de-caf447aae36a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:38.002217 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de66c7b-2af8-4c70-80de-caf447aae36a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:58:38.010490 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-0de66c7b-2af8-4c70-80de-caf447aae36a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 23 20:58:38.010490 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:58:38.010490 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:58:38.010490 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:58:38.010490 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:58:38.010490 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:58:38.010490 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:58:38.010490 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:58:38.010490 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:58:38.010490 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:58:38.010490 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:58:38.010490 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:58:38.010490 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:58:38.010490 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:58:38.010490 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:58:38.010490 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:58:38.011394 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:58:38.011394 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:58:38.011394 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:58:38.011394 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:58:38.011394 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:58:38.011394 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:58:38.011394 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:58:38.011394 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:58:38.011394 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:58:38.011394 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:58:38.011394 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:58:38.011394 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application with Lock( Jul 23 20:58:38.011394 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:58:38.011394 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:58:38.011394 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:58:38.011394 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:58:38.012214 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:58:38.012214 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:58:38.012214 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:58:38.012214 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:58:38.012214 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:58:38.012214 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:58:38.012214 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:58:38.012214 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:58:38.012214 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:58:38.012214 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:58:38.012214 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 23 20:58:38.012214 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 20:58:38.012214 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 474/930] 10.222.0.17 () {56 vars in 1120 bytes} [Sat Jul 23 20:58:37 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:58:38.013646 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ea5126-77f5-46f6-baab-0df1b617ecdf None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:38.013646 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ea5126-77f5-46f6-baab-0df1b617ecdf None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:38.013959 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ea5126-77f5-46f6-baab-0df1b617ecdf None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:38.015350 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 475/931] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:58:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:58:38.020293 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ea5126-77f5-46f6-baab-0df1b617ecdf None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:38.025013 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a271e3c-294b-4268-8b46-dba27ebbe3ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:38.025739 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a271e3c-294b-4268-8b46-dba27ebbe3ad None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:38.026126 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a271e3c-294b-4268-8b46-dba27ebbe3ad None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:38.026393 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a271e3c-294b-4268-8b46-dba27ebbe3ad None admin] PATH_INFO: `/v3/services` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:38.027152 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a271e3c-294b-4268-8b46-dba27ebbe3ad None admin] RBAC: Adding query filter params (name=compute) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:38.027451 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a271e3c-294b-4268-8b46-dba27ebbe3ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:38.029241 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a271e3c-294b-4268-8b46-dba27ebbe3ad None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:38.036037 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 457/932] 10.222.0.17 () {56 vars in 1112 bytes} [Sat Jul 23 20:58:37 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 20:58:38.037226 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccefd91e-d5c1-4aa0-8cdc-d2ad9733ec2a None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:38.037504 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccefd91e-d5c1-4aa0-8cdc-d2ad9733ec2a None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:38.037773 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccefd91e-d5c1-4aa0-8cdc-d2ad9733ec2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:38.056136 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-ccefd91e-d5c1-4aa0-8cdc-d2ad9733ec2a None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:58:38.057223 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-ccefd91e-d5c1-4aa0-8cdc-d2ad9733ec2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:58:38.133277 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ea5126-77f5-46f6-baab-0df1b617ecdf None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:38.138701 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 458/933] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:58:38 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 23 20:58:38.139731 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccefd91e-d5c1-4aa0-8cdc-d2ad9733ec2a None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:38.172331 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:38.180220 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f20b90-5287-4762-97b1-8a26d19c07a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:38.180902 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f20b90-5287-4762-97b1-8a26d19c07a0 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:38.181181 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f20b90-5287-4762-97b1-8a26d19c07a0 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:38.181447 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f20b90-5287-4762-97b1-8a26d19c07a0 None admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:38.182229 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f20b90-5287-4762-97b1-8a26d19c07a0 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:38.182528 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f20b90-5287-4762-97b1-8a26d19c07a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:38.183911 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f20b90-5287-4762-97b1-8a26d19c07a0 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:38.192821 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 476/934] 10.222.0.17 () {56 vars in 1115 bytes} [Sat Jul 23 20:58:38 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:58:38.193550 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f20b90-5287-4762-97b1-8a26d19c07a0 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:38.224301 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:38.269152 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccefd91e-d5c1-4aa0-8cdc-d2ad9733ec2a None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:38.307668 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4733f417-dc73-4ba4-b013-307fc824b045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:38.308001 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f20b90-5287-4762-97b1-8a26d19c07a0 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:38.308894 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4733f417-dc73-4ba4-b013-307fc824b045 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:38.309400 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4733f417-dc73-4ba4-b013-307fc824b045 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:38.309741 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4733f417-dc73-4ba4-b013-307fc824b045 None admin] PATH_INFO: `/v3/services` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:38.311011 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4733f417-dc73-4ba4-b013-307fc824b045 None admin] RBAC: Adding query filter params (type=compute) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:38.311011 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4733f417-dc73-4ba4-b013-307fc824b045 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:38.312337 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4733f417-dc73-4ba4-b013-307fc824b045 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:38.321905 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 459/935] 10.222.0.17 () {56 vars in 1112 bytes} [Sat Jul 23 20:58:38 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:58:38.321905 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4733f417-dc73-4ba4-b013-307fc824b045 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:38.366990 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdbf747-5654-4c18-b17a-1f7e37e5d8a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:38.368544 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdbf747-5654-4c18-b17a-1f7e37e5d8a5 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:38.369115 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdbf747-5654-4c18-b17a-1f7e37e5d8a5 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:38.369649 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdbf747-5654-4c18-b17a-1f7e37e5d8a5 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:38.371213 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdbf747-5654-4c18-b17a-1f7e37e5d8a5 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:38.373348 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdbf747-5654-4c18-b17a-1f7e37e5d8a5 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:38.388772 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-dcdbf747-5654-4c18-b17a-1f7e37e5d8a5 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 23 20:58:38.388772 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:58:38.388772 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 23 20:58:38.388772 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 23 20:58:38.388772 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 23 20:58:38.388772 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 23 20:58:38.388772 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 23 20:58:38.388772 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 23 20:58:38.388772 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 23 20:58:38.388772 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 20:58:38.388772 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 23 20:58:38.388772 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 20:58:38.388772 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:58:38.388772 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:58:38.388772 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:58:38.388772 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:58:38.388772 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:58:38.390068 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:58:38.390068 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:58:38.390068 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:58:38.390068 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:58:38.390068 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:58:38.390068 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:58:38.390068 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 23 20:58:38.390068 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 23 20:58:38.390068 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 23 20:58:38.390068 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 23 20:58:38.390068 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:58:38.390068 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:58:38.390068 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:58:38.390068 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:58:38.390068 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:58:38.390068 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:58:38.391127 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:58:38.391127 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application with Lock( Jul 23 20:58:38.391127 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:58:38.391127 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:58:38.391127 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:58:38.391127 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:58:38.391127 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:58:38.391127 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:58:38.391127 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:58:38.391127 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:58:38.391127 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 23 20:58:38.391127 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 23 20:58:38.391127 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 23 20:58:38.391127 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 20:58:38.398023 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 477/936] 10.222.0.17 () {56 vars in 1126 bytes} [Sat Jul 23 20:58:38 2022] GET /identity/v3/services/object-store => generated 93 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:58:38.399449 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdbf747-5654-4c18-b17a-1f7e37e5d8a5 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:38.423648 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:38.445033 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4733f417-dc73-4ba4-b013-307fc824b045 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:38.487508 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bf62f2-cfea-4cb0-8a13-9cdaec4afe97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:38.488541 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bf62f2-cfea-4cb0-8a13-9cdaec4afe97 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:38.489023 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bf62f2-cfea-4cb0-8a13-9cdaec4afe97 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:38.489359 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bf62f2-cfea-4cb0-8a13-9cdaec4afe97 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:38.501809 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bf62f2-cfea-4cb0-8a13-9cdaec4afe97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:38.503546 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bf62f2-cfea-4cb0-8a13-9cdaec4afe97 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:38.525967 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-b6bf62f2-cfea-4cb0-8a13-9cdaec4afe97 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:58:38.525967 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:58:38.525967 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:58:38.525967 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:58:38.525967 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:58:38.525967 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:58:38.525967 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:58:38.525967 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:58:38.525967 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:58:38.525967 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:58:38.525967 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:58:38.525967 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:58:38.525967 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 23 20:58:38.525967 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 23 20:58:38.525967 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 23 20:58:38.527535 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 23 20:58:38.527535 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:58:38.527535 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:58:38.527535 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:58:38.527535 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:58:38.527535 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:58:38.527535 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:58:38.527535 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:58:38.527535 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application with Lock( Jul 23 20:58:38.527535 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:58:38.527535 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:58:38.527535 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:58:38.527535 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:58:38.527535 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:58:38.527535 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:58:38.527535 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:58:38.527535 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:58:38.528871 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 23 20:58:38.528871 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 23 20:58:38.528871 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:58:38.528871 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:58:38.528871 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 460/937] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 23 20:58:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:58:38.531989 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bf62f2-cfea-4cb0-8a13-9cdaec4afe97 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:38.532818 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:38.546797 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdbf747-5654-4c18-b17a-1f7e37e5d8a5 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:38.596476 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154c728e-6e2a-46fb-8bb6-4729f350062d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:38.597194 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154c728e-6e2a-46fb-8bb6-4729f350062d None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:38.597525 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154c728e-6e2a-46fb-8bb6-4729f350062d None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:38.597806 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154c728e-6e2a-46fb-8bb6-4729f350062d None admin] PATH_INFO: `/v3/services` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:38.598626 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154c728e-6e2a-46fb-8bb6-4729f350062d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:38.598931 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154c728e-6e2a-46fb-8bb6-4729f350062d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:38.601058 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154c728e-6e2a-46fb-8bb6-4729f350062d None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:38.612727 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 478/938] 10.222.0.17 () {56 vars in 1122 bytes} [Sat Jul 23 20:58:38 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:58:38.614514 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154c728e-6e2a-46fb-8bb6-4729f350062d None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:38.666837 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bf62f2-cfea-4cb0-8a13-9cdaec4afe97 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:38.711763 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfea6cc-711e-431f-92f0-a5d77f899540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:38.712827 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfea6cc-711e-431f-92f0-a5d77f899540 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:38.713110 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfea6cc-711e-431f-92f0-a5d77f899540 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:38.713385 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfea6cc-711e-431f-92f0-a5d77f899540 None admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:38.714150 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfea6cc-711e-431f-92f0-a5d77f899540 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:38.714456 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfea6cc-711e-431f-92f0-a5d77f899540 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:38.715843 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfea6cc-711e-431f-92f0-a5d77f899540 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:38.719220 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:38.734364 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154c728e-6e2a-46fb-8bb6-4729f350062d None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:38.734949 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 461/939] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 23 20:58:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:58:38.742959 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfea6cc-711e-431f-92f0-a5d77f899540 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:38.774561 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c638487-c6fb-45d3-a6b3-c66f902cb7c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:38.775706 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c638487-c6fb-45d3-a6b3-c66f902cb7c9 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:38.776244 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c638487-c6fb-45d3-a6b3-c66f902cb7c9 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:38.776722 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c638487-c6fb-45d3-a6b3-c66f902cb7c9 None admin] PATH_INFO: `/v3/services` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:38.778281 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c638487-c6fb-45d3-a6b3-c66f902cb7c9 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:38.778761 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c638487-c6fb-45d3-a6b3-c66f902cb7c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:38.780330 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c638487-c6fb-45d3-a6b3-c66f902cb7c9 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:38.789988 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 479/940] 10.222.0.17 () {56 vars in 1122 bytes} [Sat Jul 23 20:58:38 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:58:38.793114 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c638487-c6fb-45d3-a6b3-c66f902cb7c9 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:38.826076 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:38.884246 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfea6cc-711e-431f-92f0-a5d77f899540 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:38.915480 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c638487-c6fb-45d3-a6b3-c66f902cb7c9 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:38.930040 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4eab64b-5040-47f6-a36c-cebec208bcdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:38.931384 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eab64b-5040-47f6-a36c-cebec208bcdc None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:38.931734 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eab64b-5040-47f6-a36c-cebec208bcdc None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:38.932015 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eab64b-5040-47f6-a36c-cebec208bcdc None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:38.942908 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4eab64b-5040-47f6-a36c-cebec208bcdc None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:38.944737 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4eab64b-5040-47f6-a36c-cebec208bcdc None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:38.958826 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701bc0a9-70fd-4841-981f-ddc19094953a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:38.959506 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701bc0a9-70fd-4841-981f-ddc19094953a None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:38.959789 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701bc0a9-70fd-4841-981f-ddc19094953a None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:38.960068 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701bc0a9-70fd-4841-981f-ddc19094953a None admin] PATH_INFO: `/v3/endpoints` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:38.960868 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701bc0a9-70fd-4841-981f-ddc19094953a None admin] RBAC: Adding query filter params (interface=public, service_id=d59203be7dff4d118704acf72c80c4de, region_id=RegionOne) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:38.961180 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701bc0a9-70fd-4841-981f-ddc19094953a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:38.962599 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701bc0a9-70fd-4841-981f-ddc19094953a None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:38.966433 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-f4eab64b-5040-47f6-a36c-cebec208bcdc None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 23 20:58:38.966433 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:58:38.966433 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:58:38.966433 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:58:38.966433 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:58:38.966433 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:58:38.966433 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:58:38.966433 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:58:38.966433 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:58:38.966433 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:58:38.966433 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:58:38.966433 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:58:38.966433 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 23 20:58:38.966433 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 23 20:58:38.966433 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 23 20:58:38.966433 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 23 20:58:38.967351 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:58:38.967351 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:58:38.967351 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 23 20:58:38.967351 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 23 20:58:38.967351 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 23 20:58:38.967351 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 23 20:58:38.967351 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:58:38.967351 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:58:38.967351 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:58:38.967351 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:58:38.967351 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:58:38.967351 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application with Lock( Jul 23 20:58:38.967351 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:58:38.967351 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:58:38.967351 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:58:38.967351 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:58:38.967351 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:58:38.967351 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:58:38.968296 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:58:38.968296 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:58:38.968296 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 23 20:58:38.968296 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 23 20:58:38.968296 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 23 20:58:38.968296 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 23 20:58:38.968296 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 23 20:58:38.968296 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 23 20:58:38.968296 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 23 20:58:38.968296 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:58:38.975445 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 462/942] 10.222.0.17 () {56 vars in 1117 bytes} [Sat Jul 23 20:58:38 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:58:38.975606 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 480/942] 10.222.0.17 () {56 vars in 1251 bytes} [Sat Jul 23 20:58:38 2022] GET /identity/v3/endpoints?service_id=d59203be7dff4d118704acf72c80c4de&interface=public®ion_id=RegionOne => generated 194 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:58:38.977095 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701bc0a9-70fd-4841-981f-ddc19094953a None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:38.977564 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ee4e69-d06e-4c74-9e60-05cd330a19a3 None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:38.977849 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ee4e69-d06e-4c74-9e60-05cd330a19a3 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:38.978149 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ee4e69-d06e-4c74-9e60-05cd330a19a3 None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:38.979574 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 463/943] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:58:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:58:38.980131 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ee4e69-d06e-4c74-9e60-05cd330a19a3 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:39.046168 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:39.072878 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:39.089729 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701bc0a9-70fd-4841-981f-ddc19094953a None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:39.098605 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ee4e69-d06e-4c74-9e60-05cd330a19a3 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:39.125156 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2b7b79-85cf-40ca-a912-85de927780cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:39.125848 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2b7b79-85cf-40ca-a912-85de927780cc None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:39.126156 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2b7b79-85cf-40ca-a912-85de927780cc None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:39.126422 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2b7b79-85cf-40ca-a912-85de927780cc None admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:39.127247 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2b7b79-85cf-40ca-a912-85de927780cc None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:39.127554 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2b7b79-85cf-40ca-a912-85de927780cc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:39.129066 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2b7b79-85cf-40ca-a912-85de927780cc None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:39.136557 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97138802-b1b4-4e50-b161-4ebf2ed14313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:39.137410 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97138802-b1b4-4e50-b161-4ebf2ed14313 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:39.137852 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97138802-b1b4-4e50-b161-4ebf2ed14313 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:39.138146 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97138802-b1b4-4e50-b161-4ebf2ed14313 None admin] PATH_INFO: `/v3/services` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:39.138827 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97138802-b1b4-4e50-b161-4ebf2ed14313 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:39.140200 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97138802-b1b4-4e50-b161-4ebf2ed14313 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:39.152026 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 464/944] 10.222.0.17 () {56 vars in 1087 bytes} [Sat Jul 23 20:58:38 2022] GET /identity/v3/services => generated 1497 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 20:58:39.152026 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d4ac8f-cfdc-4b49-8943-bae954ca1c69 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:39.152026 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d4ac8f-cfdc-4b49-8943-bae954ca1c69 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:39.152026 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d4ac8f-cfdc-4b49-8943-bae954ca1c69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:39.152652 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 481/945] 10.222.0.17 () {56 vars in 1149 bytes} [Sat Jul 23 20:58:38 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:58:39.158047 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2b7b79-85cf-40ca-a912-85de927780cc None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:39.172922 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-45d4ac8f-cfdc-4b49-8943-bae954ca1c69 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:58:39.174303 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-45d4ac8f-cfdc-4b49-8943-bae954ca1c69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:58:39.267570 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 465/946] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:58:39 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 23 20:58:39.280418 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2b7b79-85cf-40ca-a912-85de927780cc None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:39.292611 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d4ac8f-cfdc-4b49-8943-bae954ca1c69 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:39.320476 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dc3dd1-fa0f-4263-91ba-2a902623f095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:39.321307 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dc3dd1-fa0f-4263-91ba-2a902623f095 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:39.321717 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dc3dd1-fa0f-4263-91ba-2a902623f095 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:39.322084 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dc3dd1-fa0f-4263-91ba-2a902623f095 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:39.334604 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dc3dd1-fa0f-4263-91ba-2a902623f095 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:39.336330 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dc3dd1-fa0f-4263-91ba-2a902623f095 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:39.338662 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:39.347753 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:39.359405 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-e4dc3dd1-fa0f-4263-91ba-2a902623f095 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:58:39.359405 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:58:39.359405 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:58:39.359405 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:58:39.359405 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:58:39.359405 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:58:39.359405 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:58:39.359405 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:58:39.359405 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:58:39.359405 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:58:39.359405 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:58:39.359405 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:58:39.359405 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 23 20:58:39.359405 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 23 20:58:39.359405 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 23 20:58:39.360686 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 23 20:58:39.360686 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:58:39.360686 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:58:39.360686 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:58:39.360686 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:58:39.360686 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:58:39.360686 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:58:39.360686 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:58:39.360686 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application with Lock( Jul 23 20:58:39.360686 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:58:39.360686 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:58:39.360686 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:58:39.360686 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:58:39.360686 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:58:39.360686 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:58:39.360686 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:58:39.360686 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:58:39.362521 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 23 20:58:39.362521 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 23 20:58:39.362521 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:58:39.362521 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 20:58:39.362521 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 482/947] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 23 20:58:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:58:39.367842 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dc3dd1-fa0f-4263-91ba-2a902623f095 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:39.417013 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d4ac8f-cfdc-4b49-8943-bae954ca1c69 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:39.462615 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083af2f2-efd9-4b73-a0b4-a63d3a78d3f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:39.463284 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083af2f2-efd9-4b73-a0b4-a63d3a78d3f5 None admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:39.463558 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083af2f2-efd9-4b73-a0b4-a63d3a78d3f5 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:39.463826 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083af2f2-efd9-4b73-a0b4-a63d3a78d3f5 None admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:39.464550 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083af2f2-efd9-4b73-a0b4-a63d3a78d3f5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:39.467587 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083af2f2-efd9-4b73-a0b4-a63d3a78d3f5 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:39.469233 ncdv-master-1 devstack@keystone.service[91547]: WARNING keystone.server.flask.common [None req-083af2f2-efd9-4b73-a0b4-a63d3a78d3f5 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 23 20:58:39.493965 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.sql.core [None req-083af2f2-efd9-4b73-a0b4-a63d3a78d3f5 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 23 20:58:39.493965 ncdv-master-1 devstack@keystone.service[91547]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 23 20:58:39.493965 ncdv-master-1 devstack@keystone.service[91547]: [parameters: {'id': 'e01d6512a6644fff9a1eb10dfbf59857', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 23 20:58:39.493965 ncdv-master-1 devstack@keystone.service[91547]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=91547) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 23 20:58:39.498615 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dc3dd1-fa0f-4263-91ba-2a902623f095 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:39.515551 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-083af2f2-efd9-4b73-a0b4-a63d3a78d3f5 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id e01d6512a6644fff9a1eb10dfbf59857.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id e01d6512a6644fff9a1eb10dfbf59857. Jul 23 20:58:39.515551 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:58:39.515551 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 23 20:58:39.515551 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 23 20:58:39.515551 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 23 20:58:39.515551 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 23 20:58:39.515551 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 23 20:58:39.515551 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application result = self._query(query) Jul 23 20:58:39.515551 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 23 20:58:39.515551 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application conn.query(q) Jul 23 20:58:39.515551 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 23 20:58:39.515551 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 23 20:58:39.515551 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 23 20:58:39.516428 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application result.read() Jul 23 20:58:39.516428 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 23 20:58:39.516428 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 23 20:58:39.516428 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 23 20:58:39.516428 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 23 20:58:39.516428 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 23 20:58:39.516428 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 23 20:58:39.516428 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 23 20:58:39.516428 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 23 20:58:39.516428 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 23 20:58:39.516428 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:58:39.516428 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 23 20:58:39.516428 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:58:39.516428 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:58:39.516428 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 23 20:58:39.516428 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 23 20:58:39.516428 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 23 20:58:39.516428 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 23 20:58:39.517382 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 23 20:58:39.517382 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application next(self.gen) Jul 23 20:58:39.517382 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 23 20:58:39.517382 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application yield resource Jul 23 20:58:39.517382 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 23 20:58:39.517382 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application next(self.gen) Jul 23 20:58:39.517382 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 23 20:58:39.517382 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application self.session.rollback() Jul 23 20:58:39.517382 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 23 20:58:39.517382 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application self.force_reraise() Jul 23 20:58:39.517382 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 23 20:58:39.517382 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise self.value Jul 23 20:58:39.517382 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 23 20:58:39.517382 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 23 20:58:39.517382 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 23 20:58:39.517382 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application session.commit() Jul 23 20:58:39.517382 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 23 20:58:39.518287 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 23 20:58:39.518287 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 23 20:58:39.518287 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application self._prepare_impl() Jul 23 20:58:39.518287 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 23 20:58:39.518287 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application self.session.flush() Jul 23 20:58:39.518287 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 23 20:58:39.518287 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application self._flush(objects) Jul 23 20:58:39.518287 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 23 20:58:39.518287 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 23 20:58:39.518287 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 23 20:58:39.518287 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application compat.raise_( Jul 23 20:58:39.518287 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 23 20:58:39.518287 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception Jul 23 20:58:39.518287 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 23 20:58:39.518287 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application flush_context.execute() Jul 23 20:58:39.518287 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 23 20:58:39.518287 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rec.execute(self) Jul 23 20:58:39.519255 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 23 20:58:39.519255 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 23 20:58:39.519255 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 23 20:58:39.519255 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 23 20:58:39.519255 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 23 20:58:39.519255 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 23 20:58:39.519255 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 23 20:58:39.519255 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 23 20:58:39.519255 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 23 20:58:39.519255 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 23 20:58:39.519255 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 23 20:58:39.519255 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 23 20:58:39.519255 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 23 20:58:39.519255 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 23 20:58:39.519255 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 23 20:58:39.520113 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 23 20:58:39.520113 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 23 20:58:39.520113 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception Jul 23 20:58:39.520113 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 23 20:58:39.520113 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 23 20:58:39.520113 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 23 20:58:39.520113 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 23 20:58:39.520113 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 23 20:58:39.520113 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application result = self._query(query) Jul 23 20:58:39.520113 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 23 20:58:39.520113 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application conn.query(q) Jul 23 20:58:39.520113 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 23 20:58:39.520113 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 23 20:58:39.520113 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 23 20:58:39.520113 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application result.read() Jul 23 20:58:39.520113 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 23 20:58:39.520113 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 23 20:58:39.520989 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 23 20:58:39.520989 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 23 20:58:39.520989 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 23 20:58:39.520989 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 23 20:58:39.520989 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 23 20:58:39.520989 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 23 20:58:39.520989 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 23 20:58:39.520989 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 23 20:58:39.520989 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [parameters: {'id': 'e01d6512a6644fff9a1eb10dfbf59857', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 23 20:58:39.520989 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 23 20:58:39.520989 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:58:39.520989 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 23 20:58:39.520989 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:58:39.520989 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:58:39.520989 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 23 20:58:39.521769 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 23 20:58:39.521769 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 23 20:58:39.521769 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 23 20:58:39.521769 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 23 20:58:39.521769 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:58:39.521769 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 23 20:58:39.521769 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:58:39.521769 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:58:39.521769 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:58:39.521769 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:58:39.521769 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:58:39.521769 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:58:39.521769 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:58:39.521769 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:58:39.521769 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:58:39.521769 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:58:39.521769 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:58:39.529750 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:58:39.529750 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 23 20:58:39.529750 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 23 20:58:39.529750 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:58:39.529750 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:58:39.529750 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 23 20:58:39.529750 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 23 20:58:39.529750 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id e01d6512a6644fff9a1eb10dfbf59857. Jul 23 20:58:39.529750 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:58:39.529750 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 466/948] 10.222.0.17 () {60 vars in 1140 bytes} [Sat Jul 23 20:58:39 2022] POST /identity/v3/projects => generated 262 bytes in 227 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:58:39.531114 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083af2f2-efd9-4b73-a0b4-a63d3a78d3f5 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:39.551894 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1050503-b16b-4468-95b8-f9dc3cbe43df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:39.553508 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1050503-b16b-4468-95b8-f9dc3cbe43df None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:39.554046 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1050503-b16b-4468-95b8-f9dc3cbe43df None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:39.554464 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1050503-b16b-4468-95b8-f9dc3cbe43df None admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:39.555873 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1050503-b16b-4468-95b8-f9dc3cbe43df None admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:39.556366 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1050503-b16b-4468-95b8-f9dc3cbe43df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:39.557965 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1050503-b16b-4468-95b8-f9dc3cbe43df None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:39.575861 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 483/949] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 23 20:58:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:58:39.581546 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1050503-b16b-4468-95b8-f9dc3cbe43df None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:39.644065 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083af2f2-efd9-4b73-a0b4-a63d3a78d3f5 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:39.652312 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:39.666783 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:39.687318 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de41896-fef5-4e55-8a36-c68e9b983311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:39.688230 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de41896-fef5-4e55-8a36-c68e9b983311 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:39.688654 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de41896-fef5-4e55-8a36-c68e9b983311 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:39.689017 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de41896-fef5-4e55-8a36-c68e9b983311 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:39.697798 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de41896-fef5-4e55-8a36-c68e9b983311 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:39.699745 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de41896-fef5-4e55-8a36-c68e9b983311 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:39.716141 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-9de41896-fef5-4e55-8a36-c68e9b983311 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 23 20:58:39.716141 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:58:39.716141 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:58:39.716141 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:58:39.716141 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:58:39.716141 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:58:39.716141 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:58:39.716141 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:58:39.716141 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:58:39.716141 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:58:39.716141 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:58:39.716141 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:58:39.716141 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 23 20:58:39.716141 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 23 20:58:39.716141 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 23 20:58:39.717325 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 23 20:58:39.717325 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:58:39.717325 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:58:39.717325 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:58:39.717325 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:58:39.717325 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:58:39.717325 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:58:39.717325 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:58:39.717325 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application with Lock( Jul 23 20:58:39.717325 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:58:39.717325 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:58:39.717325 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:58:39.717325 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:58:39.717325 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:58:39.717325 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:58:39.717325 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:58:39.717325 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:58:39.718721 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 23 20:58:39.718721 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 23 20:58:39.718721 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 23 20:58:39.718721 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 23 20:58:39.718721 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 23 20:58:39.718721 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 23 20:58:39.718721 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 23 20:58:39.718721 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:58:39.725055 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 467/950] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Jul 23 20:58:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:58:39.727509 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de41896-fef5-4e55-8a36-c68e9b983311 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:39.729402 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1050503-b16b-4468-95b8-f9dc3cbe43df None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:39.767871 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7775cb-f27f-42ac-abc9-b1a2ae8de6c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:39.768961 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7775cb-f27f-42ac-abc9-b1a2ae8de6c3 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:39.769336 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7775cb-f27f-42ac-abc9-b1a2ae8de6c3 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:39.769701 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7775cb-f27f-42ac-abc9-b1a2ae8de6c3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:39.777281 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7775cb-f27f-42ac-abc9-b1a2ae8de6c3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:39.779248 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7775cb-f27f-42ac-abc9-b1a2ae8de6c3 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:39.794445 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-8f7775cb-f27f-42ac-abc9-b1a2ae8de6c3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 23 20:58:39.794445 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:58:39.794445 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:58:39.794445 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:58:39.794445 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:58:39.794445 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:58:39.794445 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:58:39.794445 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:58:39.794445 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:58:39.794445 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:58:39.794445 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:58:39.794445 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:58:39.794445 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 23 20:58:39.794445 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 23 20:58:39.794445 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 23 20:58:39.795637 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 23 20:58:39.795637 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:58:39.795637 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:58:39.795637 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:58:39.795637 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:58:39.795637 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:58:39.795637 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:58:39.795637 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:58:39.795637 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application with Lock( Jul 23 20:58:39.795637 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:58:39.795637 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:58:39.795637 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:58:39.795637 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:58:39.795637 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:58:39.795637 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:58:39.795637 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:58:39.795637 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:58:39.796610 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 23 20:58:39.796610 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 23 20:58:39.796610 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 23 20:58:39.796610 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 23 20:58:39.796610 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 23 20:58:39.796610 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 23 20:58:39.796610 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 23 20:58:39.796610 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 20:58:39.797570 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 484/951] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Jul 23 20:58:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:58:39.807094 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7775cb-f27f-42ac-abc9-b1a2ae8de6c3 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:39.859102 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de41896-fef5-4e55-8a36-c68e9b983311 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:39.904966 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138bea2a-c017-49b4-b310-ed0db86371c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:39.905644 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138bea2a-c017-49b4-b310-ed0db86371c1 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:39.905962 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138bea2a-c017-49b4-b310-ed0db86371c1 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:39.906237 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138bea2a-c017-49b4-b310-ed0db86371c1 None admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:39.907429 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138bea2a-c017-49b4-b310-ed0db86371c1 None admin] RBAC: Adding query filter params (name=service) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:39.907738 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138bea2a-c017-49b4-b310-ed0db86371c1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:39.909601 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138bea2a-c017-49b4-b310-ed0db86371c1 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:39.932848 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7775cb-f27f-42ac-abc9-b1a2ae8de6c3 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:39.941974 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 468/952] 10.222.0.17 () {56 vars in 1112 bytes} [Sat Jul 23 20:58:39 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:58:39.957656 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:39.983056 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d924088b-2a67-410d-bc41-376957a69312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:39.983748 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d924088b-2a67-410d-bc41-376957a69312 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:39.984029 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d924088b-2a67-410d-bc41-376957a69312 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:39.984303 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d924088b-2a67-410d-bc41-376957a69312 None admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:39.985095 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d924088b-2a67-410d-bc41-376957a69312 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:39.985399 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d924088b-2a67-410d-bc41-376957a69312 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:39.986903 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d924088b-2a67-410d-bc41-376957a69312 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:40.004886 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 485/953] 10.222.0.17 () {56 vars in 1148 bytes} [Sat Jul 23 20:58:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:58:40.011394 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138bea2a-c017-49b4-b310-ed0db86371c1 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:40.043787 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:40.131231 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138bea2a-c017-49b4-b310-ed0db86371c1 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:40.166324 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a924cd12-71ac-4868-a27a-04bb8f240b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:40.167245 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a924cd12-71ac-4868-a27a-04bb8f240b02 None admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:40.167521 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a924cd12-71ac-4868-a27a-04bb8f240b02 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:40.167792 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a924cd12-71ac-4868-a27a-04bb8f240b02 None admin] PATH_INFO: `/v3/projects/4804ed61295f4d4a92d9b685dd9e9f3b/users/17b779a3e21a415bb42cde5d6863d9cf/roles/3295256c44774d3ea100d28799b26fd9` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:40.170491 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a924cd12-71ac-4868-a27a-04bb8f240b02 None admin] RBAC: Authorizing `identity:create_grant(project_id=4804ed61295f4d4a92d9b685dd9e9f3b, user_id=17b779a3e21a415bb42cde5d6863d9cf, role_id=3295256c44774d3ea100d28799b26fd9)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:40.171590 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a924cd12-71ac-4868-a27a-04bb8f240b02 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:40.187587 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 469/954] 10.222.0.17 () {58 vars in 1439 bytes} [Sat Jul 23 20:58:40 2022] PUT /identity/v3/projects/4804ed61295f4d4a92d9b685dd9e9f3b/users/17b779a3e21a415bb42cde5d6863d9cf/roles/3295256c44774d3ea100d28799b26fd9 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 20:58:40.708660 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3982647e-aff5-4fbb-b31b-f64fbbf8fc13 None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:40.709218 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3982647e-aff5-4fbb-b31b-f64fbbf8fc13 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:40.709218 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3982647e-aff5-4fbb-b31b-f64fbbf8fc13 None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:40.710874 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 486/955] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:58:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:58:40.716343 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06205523-40d8-422f-a207-168048321230 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:40.716774 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06205523-40d8-422f-a207-168048321230 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:40.716972 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06205523-40d8-422f-a207-168048321230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:40.734426 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-06205523-40d8-422f-a207-168048321230 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:58:40.735969 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-06205523-40d8-422f-a207-168048321230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:58:40.807012 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 470/956] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:58:40 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 23 20:58:40.830803 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3982647e-aff5-4fbb-b31b-f64fbbf8fc13 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:40.935818 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3982647e-aff5-4fbb-b31b-f64fbbf8fc13 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:40.973365 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6544d9-9e28-4df4-9cc7-5c139dafe0e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:40.974030 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6544d9-9e28-4df4-9cc7-5c139dafe0e9 None admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:40.974314 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6544d9-9e28-4df4-9cc7-5c139dafe0e9 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:40.974635 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6544d9-9e28-4df4-9cc7-5c139dafe0e9 None admin] PATH_INFO: `/v3/services` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:40.975367 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6544d9-9e28-4df4-9cc7-5c139dafe0e9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:40.976747 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6544d9-9e28-4df4-9cc7-5c139dafe0e9 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:40.993749 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 487/957] 10.222.0.17 () {60 vars in 1141 bytes} [Sat Jul 23 20:58:40 2022] POST /identity/v3/services => generated 242 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 20:58:41.525309 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b12a1f6-3da7-48e9-99e7-49ff09d04eed None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:41.525710 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b12a1f6-3da7-48e9-99e7-49ff09d04eed None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:41.525930 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b12a1f6-3da7-48e9-99e7-49ff09d04eed None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:41.527549 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 471/958] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:58:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:58:41.533286 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdf72a5-b03f-4f51-b03f-56da5b467363 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:41.533573 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdf72a5-b03f-4f51-b03f-56da5b467363 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:41.533848 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdf72a5-b03f-4f51-b03f-56da5b467363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:41.550767 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-1fdf72a5-b03f-4f51-b03f-56da5b467363 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:58:41.551955 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-1fdf72a5-b03f-4f51-b03f-56da5b467363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:58:41.578544 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:41.629280 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 488/959] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:58:41 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 23 20:58:41.653855 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b12a1f6-3da7-48e9-99e7-49ff09d04eed None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:41.672267 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:41.768925 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b12a1f6-3da7-48e9-99e7-49ff09d04eed None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:41.806956 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d600ee37-fc4a-48a4-8cc7-0548df6499e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:41.808014 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d600ee37-fc4a-48a4-8cc7-0548df6499e5 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:41.808432 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d600ee37-fc4a-48a4-8cc7-0548df6499e5 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:41.808845 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d600ee37-fc4a-48a4-8cc7-0548df6499e5 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:41.810140 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d600ee37-fc4a-48a4-8cc7-0548df6499e5 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:41.811758 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d600ee37-fc4a-48a4-8cc7-0548df6499e5 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:41.826942 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-d600ee37-fc4a-48a4-8cc7-0548df6499e5 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 23 20:58:41.826942 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:58:41.826942 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 23 20:58:41.826942 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 23 20:58:41.826942 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 23 20:58:41.826942 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 23 20:58:41.826942 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 23 20:58:41.826942 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 23 20:58:41.826942 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 23 20:58:41.826942 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:58:41.826942 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 23 20:58:41.826942 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:58:41.826942 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:58:41.826942 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:58:41.826942 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:58:41.826942 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:58:41.826942 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:58:41.828105 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:58:41.828105 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:58:41.828105 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:58:41.828105 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:58:41.828105 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:58:41.828105 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:58:41.828105 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 23 20:58:41.828105 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 23 20:58:41.828105 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 23 20:58:41.828105 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 23 20:58:41.828105 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:58:41.828105 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:58:41.828105 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:58:41.828105 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:58:41.828105 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:58:41.828105 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:58:41.828979 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:58:41.828979 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application with Lock( Jul 23 20:58:41.828979 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:58:41.828979 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:58:41.828979 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:58:41.828979 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:58:41.828979 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:58:41.828979 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:58:41.828979 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:58:41.828979 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:58:41.828979 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 23 20:58:41.828979 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 23 20:58:41.828979 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 23 20:58:41.828979 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:58:41.828979 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 472/960] 10.222.0.17 () {56 vars in 1126 bytes} [Sat Jul 23 20:58:41 2022] GET /identity/v3/services/object-store => generated 93 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:58:41.836645 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdf72a5-b03f-4f51-b03f-56da5b467363 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:41.939946 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdf72a5-b03f-4f51-b03f-56da5b467363 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:41.975063 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412a6cba-7428-45ae-a85e-9a2d29f15bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:41.975742 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412a6cba-7428-45ae-a85e-9a2d29f15bef None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:41.976021 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412a6cba-7428-45ae-a85e-9a2d29f15bef None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:41.976291 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412a6cba-7428-45ae-a85e-9a2d29f15bef None admin] PATH_INFO: `/v3/services` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:41.977004 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412a6cba-7428-45ae-a85e-9a2d29f15bef None admin] RBAC: Adding query filter params (name=object-store) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:41.977306 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412a6cba-7428-45ae-a85e-9a2d29f15bef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:41.978712 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412a6cba-7428-45ae-a85e-9a2d29f15bef None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:41.984029 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 489/961] 10.222.0.17 () {56 vars in 1122 bytes} [Sat Jul 23 20:58:41 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:58:41.989766 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d600ee37-fc4a-48a4-8cc7-0548df6499e5 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:42.098114 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:42.119589 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d600ee37-fc4a-48a4-8cc7-0548df6499e5 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:42.155228 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e070fd2-dd06-45a1-9616-f05e3c6413e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:42.155901 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e070fd2-dd06-45a1-9616-f05e3c6413e5 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:42.156174 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e070fd2-dd06-45a1-9616-f05e3c6413e5 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:42.156441 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e070fd2-dd06-45a1-9616-f05e3c6413e5 None admin] PATH_INFO: `/v3/services` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:42.157145 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e070fd2-dd06-45a1-9616-f05e3c6413e5 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:42.157443 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e070fd2-dd06-45a1-9616-f05e3c6413e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:42.161930 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e070fd2-dd06-45a1-9616-f05e3c6413e5 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:42.164555 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 473/962] 10.222.0.17 () {56 vars in 1122 bytes} [Sat Jul 23 20:58:41 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:58:42.170198 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412a6cba-7428-45ae-a85e-9a2d29f15bef None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:42.198457 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:42.281399 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412a6cba-7428-45ae-a85e-9a2d29f15bef None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:42.321068 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23e7b55-dd83-442e-bc89-5d99c5a4c969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:42.322166 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23e7b55-dd83-442e-bc89-5d99c5a4c969 None admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:42.322725 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23e7b55-dd83-442e-bc89-5d99c5a4c969 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:42.323199 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23e7b55-dd83-442e-bc89-5d99c5a4c969 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:42.324183 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23e7b55-dd83-442e-bc89-5d99c5a4c969 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:42.325842 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23e7b55-dd83-442e-bc89-5d99c5a4c969 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:42.349089 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 490/963] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 23 20:58:42 2022] POST /identity/v3/endpoints => generated 349 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 20:58:42.473066 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4620d648-c5cb-46d0-af21-28f70afce20f None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:42.473429 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4620d648-c5cb-46d0-af21-28f70afce20f None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:42.473614 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4620d648-c5cb-46d0-af21-28f70afce20f None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:42.475343 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 474/964] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:58:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:58:42.480953 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d581548-2fb5-423c-bbea-f52530afac20 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:42.481237 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d581548-2fb5-423c-bbea-f52530afac20 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:42.481520 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d581548-2fb5-423c-bbea-f52530afac20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:42.499620 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-7d581548-2fb5-423c-bbea-f52530afac20 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:58:42.500835 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-7d581548-2fb5-423c-bbea-f52530afac20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:58:42.586496 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 491/965] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:58:42 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 23 20:58:42.596616 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c8ffa5-274d-44d9-a7e1-f3dc65a443fe None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:42.596949 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c8ffa5-274d-44d9-a7e1-f3dc65a443fe None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:42.597223 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c8ffa5-274d-44d9-a7e1-f3dc65a443fe None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:42.598914 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 475/966] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:58:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 23 20:58:42.604200 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9747c2-2a2e-4b60-a4a8-ff7ad8ac49d0 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:42.604671 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9747c2-2a2e-4b60-a4a8-ff7ad8ac49d0 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:42.604946 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9747c2-2a2e-4b60-a4a8-ff7ad8ac49d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:42.612748 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c8ffa5-274d-44d9-a7e1-f3dc65a443fe None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:42.617888 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:42.624788 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-ec9747c2-2a2e-4b60-a4a8-ff7ad8ac49d0 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:58:42.626939 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-ec9747c2-2a2e-4b60-a4a8-ff7ad8ac49d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:58:42.704837 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 492/967] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:58:42 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 23 20:58:42.729435 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9747c2-2a2e-4b60-a4a8-ff7ad8ac49d0 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:42.762885 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c8ffa5-274d-44d9-a7e1-f3dc65a443fe None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:42.813452 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e1f917-c507-4728-9866-58096aec6cba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:42.814263 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e1f917-c507-4728-9866-58096aec6cba None admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:42.814449 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e1f917-c507-4728-9866-58096aec6cba None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:42.814719 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e1f917-c507-4728-9866-58096aec6cba None admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:42.815520 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e1f917-c507-4728-9866-58096aec6cba None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:42.817011 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e1f917-c507-4728-9866-58096aec6cba None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:42.835416 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.sql.core [None req-96e1f917-c507-4728-9866-58096aec6cba None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 23 20:58:42.835416 ncdv-master-1 devstack@keystone.service[91547]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 23 20:58:42.835416 ncdv-master-1 devstack@keystone.service[91547]: [parameters: {'user_id': '3e33113ce5d64e69b0a68d0dca4fc09e', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 23 20:58:42.835416 ncdv-master-1 devstack@keystone.service[91547]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=91547) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 23 20:58:42.847456 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-96e1f917-c507-4728-9866-58096aec6cba None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 23 20:58:42.847456 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:58:42.847456 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 23 20:58:42.847456 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 23 20:58:42.847456 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 23 20:58:42.847456 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 23 20:58:42.847456 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 23 20:58:42.847456 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application result = self._query(query) Jul 23 20:58:42.847456 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 23 20:58:42.847456 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application conn.query(q) Jul 23 20:58:42.847456 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 23 20:58:42.847456 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 23 20:58:42.847456 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 23 20:58:42.847456 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application result.read() Jul 23 20:58:42.847456 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 23 20:58:42.848880 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 23 20:58:42.848880 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 23 20:58:42.848880 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 23 20:58:42.848880 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 23 20:58:42.848880 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 23 20:58:42.848880 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 23 20:58:42.848880 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 23 20:58:42.848880 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 23 20:58:42.848880 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:58:42.848880 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 23 20:58:42.848880 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:58:42.848880 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:58:42.848880 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 23 20:58:42.848880 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 23 20:58:42.848880 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 23 20:58:42.848880 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 23 20:58:42.848880 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 23 20:58:42.848880 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application next(self.gen) Jul 23 20:58:42.850044 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 23 20:58:42.850044 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application yield resource Jul 23 20:58:42.850044 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 23 20:58:42.850044 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application next(self.gen) Jul 23 20:58:42.850044 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 23 20:58:42.850044 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application self.session.rollback() Jul 23 20:58:42.850044 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 23 20:58:42.850044 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application self.force_reraise() Jul 23 20:58:42.850044 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 23 20:58:42.850044 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise self.value Jul 23 20:58:42.850044 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 23 20:58:42.850044 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 23 20:58:42.850044 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 23 20:58:42.850044 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application session.commit() Jul 23 20:58:42.850044 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 23 20:58:42.850044 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 23 20:58:42.850044 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 23 20:58:42.851051 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application self._prepare_impl() Jul 23 20:58:42.851051 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 23 20:58:42.851051 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application self.session.flush() Jul 23 20:58:42.851051 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 23 20:58:42.851051 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application self._flush(objects) Jul 23 20:58:42.851051 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 23 20:58:42.851051 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 23 20:58:42.851051 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 23 20:58:42.851051 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application compat.raise_( Jul 23 20:58:42.851051 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 23 20:58:42.851051 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception Jul 23 20:58:42.851051 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 23 20:58:42.851051 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application flush_context.execute() Jul 23 20:58:42.851051 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 23 20:58:42.851051 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rec.execute(self) Jul 23 20:58:42.851051 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 23 20:58:42.851051 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 23 20:58:42.852544 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 23 20:58:42.852544 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 23 20:58:42.852544 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 23 20:58:42.852544 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 23 20:58:42.852544 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 23 20:58:42.852544 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 23 20:58:42.852544 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 23 20:58:42.852544 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 23 20:58:42.852544 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 23 20:58:42.852544 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 23 20:58:42.852544 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 23 20:58:42.852544 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 23 20:58:42.852544 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 23 20:58:42.852544 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 23 20:58:42.852544 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 23 20:58:42.852544 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception Jul 23 20:58:42.854695 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 23 20:58:42.854695 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 23 20:58:42.854695 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 23 20:58:42.854695 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 23 20:58:42.854695 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 23 20:58:42.854695 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application result = self._query(query) Jul 23 20:58:42.854695 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 23 20:58:42.854695 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application conn.query(q) Jul 23 20:58:42.854695 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 23 20:58:42.854695 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 23 20:58:42.854695 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 23 20:58:42.854695 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application result.read() Jul 23 20:58:42.854695 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 23 20:58:42.854695 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 23 20:58:42.854695 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 23 20:58:42.854695 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 23 20:58:42.858049 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 23 20:58:42.858049 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 23 20:58:42.858049 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 23 20:58:42.858049 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 23 20:58:42.858049 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 23 20:58:42.858049 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 23 20:58:42.858049 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [parameters: {'user_id': '3e33113ce5d64e69b0a68d0dca4fc09e', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 23 20:58:42.858049 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 23 20:58:42.858049 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:58:42.858049 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 23 20:58:42.858049 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:58:42.858049 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:58:42.858049 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:58:42.858049 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:58:42.858049 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:58:42.861206 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:58:42.861206 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:58:42.861206 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:58:42.861206 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:58:42.861206 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:58:42.861206 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:58:42.861206 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:58:42.861206 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 23 20:58:42.861206 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 23 20:58:42.861206 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:58:42.861206 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:58:42.861206 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 23 20:58:42.861206 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 23 20:58:42.861206 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 23 20:58:42.861206 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 23 20:58:42.861206 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 23 20:58:42.861206 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 23 20:58:42.864673 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 23 20:58:42.864673 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 23 20:58:42.864673 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 23 20:58:42.864673 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 23 20:58:42.864673 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 23 20:58:42.864673 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:58:42.864673 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 476/968] 10.222.0.17 () {60 vars in 1131 bytes} [Sat Jul 23 20:58:42 2022] POST /identity/v3/users => generated 160 bytes in 237 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 23 20:58:42.864673 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e1f917-c507-4728-9866-58096aec6cba None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:42.877999 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9747c2-2a2e-4b60-a4a8-ff7ad8ac49d0 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:42.879448 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:42.926721 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1887820-d9d9-43dd-af5f-10adc0de458b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:42.928327 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1887820-d9d9-43dd-af5f-10adc0de458b None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:42.929369 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1887820-d9d9-43dd-af5f-10adc0de458b None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:42.929814 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1887820-d9d9-43dd-af5f-10adc0de458b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:42.934039 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:42.947839 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1887820-d9d9-43dd-af5f-10adc0de458b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:58:42.959630 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-e1887820-d9d9-43dd-af5f-10adc0de458b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 23 20:58:42.959630 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:58:42.959630 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:58:42.959630 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:58:42.959630 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:58:42.959630 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:58:42.959630 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:58:42.959630 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:58:42.959630 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:58:42.959630 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:58:42.959630 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:58:42.959630 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:58:42.959630 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:58:42.959630 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:58:42.959630 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:58:42.959630 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:58:42.960845 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:58:42.960845 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:58:42.960845 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:58:42.960845 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:58:42.960845 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:58:42.960845 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:58:42.960845 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:58:42.960845 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:58:42.960845 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:58:42.960845 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:58:42.960845 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:58:42.960845 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application with Lock( Jul 23 20:58:42.960845 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:58:42.960845 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:58:42.960845 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:58:42.960845 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:58:42.961899 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:58:42.961899 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:58:42.961899 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:58:42.961899 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:58:42.961899 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:58:42.961899 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:58:42.961899 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:58:42.961899 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:58:42.961899 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:58:42.961899 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:58:42.961899 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 23 20:58:42.961899 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 20:58:42.966007 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 493/969] 10.222.0.17 () {56 vars in 1120 bytes} [Sat Jul 23 20:58:42 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 23 20:58:42.971138 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1887820-d9d9-43dd-af5f-10adc0de458b None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:42.992571 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e1f917-c507-4728-9866-58096aec6cba None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:43.032040 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dadafd8-a7aa-4e0d-bcad-6eadd3044555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:43.032926 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dadafd8-a7aa-4e0d-bcad-6eadd3044555 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:43.033266 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dadafd8-a7aa-4e0d-bcad-6eadd3044555 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:43.033595 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dadafd8-a7aa-4e0d-bcad-6eadd3044555 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:43.049078 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dadafd8-a7aa-4e0d-bcad-6eadd3044555 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:43.051049 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dadafd8-a7aa-4e0d-bcad-6eadd3044555 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:43.072874 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-1dadafd8-a7aa-4e0d-bcad-6eadd3044555 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 23 20:58:43.072874 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:58:43.072874 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:58:43.072874 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:58:43.072874 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:58:43.072874 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:58:43.072874 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:58:43.072874 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:58:43.072874 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:58:43.072874 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:58:43.072874 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:58:43.072874 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:58:43.072874 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 23 20:58:43.072874 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 23 20:58:43.072874 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 23 20:58:43.072874 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 23 20:58:43.074748 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:58:43.074748 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:58:43.074748 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 23 20:58:43.074748 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 23 20:58:43.074748 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 23 20:58:43.074748 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 23 20:58:43.074748 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:58:43.074748 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:58:43.074748 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:58:43.074748 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:58:43.074748 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:58:43.074748 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application with Lock( Jul 23 20:58:43.074748 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:58:43.074748 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:58:43.074748 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:58:43.074748 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:58:43.074748 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:58:43.074748 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:58:43.076404 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:58:43.076404 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:58:43.076404 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 23 20:58:43.076404 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 23 20:58:43.076404 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 23 20:58:43.076404 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 23 20:58:43.076404 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 23 20:58:43.076404 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 23 20:58:43.076404 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 23 20:58:43.076404 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:58:43.080742 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 477/970] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Jul 23 20:58:42 2022] GET /identity/v3/users/cinder => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 23 20:58:43.081957 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dadafd8-a7aa-4e0d-bcad-6eadd3044555 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:43.123462 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1887820-d9d9-43dd-af5f-10adc0de458b None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:43.173451 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:43.174701 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebc721f-cab9-4741-9627-d99f5b8e44ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:43.176734 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebc721f-cab9-4741-9627-d99f5b8e44ec None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:43.177717 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebc721f-cab9-4741-9627-d99f5b8e44ec None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:43.178378 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebc721f-cab9-4741-9627-d99f5b8e44ec None admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:43.179825 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebc721f-cab9-4741-9627-d99f5b8e44ec None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:43.180485 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebc721f-cab9-4741-9627-d99f5b8e44ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:43.185098 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebc721f-cab9-4741-9627-d99f5b8e44ec None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:43.200996 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 494/971] 10.222.0.17 () {56 vars in 1115 bytes} [Sat Jul 23 20:58:42 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:58:43.209688 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebc721f-cab9-4741-9627-d99f5b8e44ec None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:43.243775 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dadafd8-a7aa-4e0d-bcad-6eadd3044555 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:43.287041 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:43.305257 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ccea93-e51c-497b-a823-87e7b48b6dd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:43.306599 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ccea93-e51c-497b-a823-87e7b48b6dd4 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:43.307165 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ccea93-e51c-497b-a823-87e7b48b6dd4 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:43.307719 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ccea93-e51c-497b-a823-87e7b48b6dd4 None admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:43.309252 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ccea93-e51c-497b-a823-87e7b48b6dd4 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:43.309855 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ccea93-e51c-497b-a823-87e7b48b6dd4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:43.314401 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ccea93-e51c-497b-a823-87e7b48b6dd4 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:43.348793 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebc721f-cab9-4741-9627-d99f5b8e44ec None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:43.378308 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 478/972] 10.222.0.17 () {56 vars in 1101 bytes} [Sat Jul 23 20:58:43 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:58:43.405701 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db17cb4e-d744-4dd0-84a6-b4295b4deed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:43.406979 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db17cb4e-d744-4dd0-84a6-b4295b4deed1 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:43.407442 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db17cb4e-d744-4dd0-84a6-b4295b4deed1 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:43.407895 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db17cb4e-d744-4dd0-84a6-b4295b4deed1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:43.413706 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38dbd75-b0e8-4591-a36a-3e2cd23cebf8 None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:43.414001 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38dbd75-b0e8-4591-a36a-3e2cd23cebf8 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:43.414456 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38dbd75-b0e8-4591-a36a-3e2cd23cebf8 None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:43.415954 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 479/973] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:58:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:58:43.421719 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db17cb4e-d744-4dd0-84a6-b4295b4deed1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:43.422425 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259f88e0-bd58-4b84-8a9a-8a2bde32db87 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:43.422654 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259f88e0-bd58-4b84-8a9a-8a2bde32db87 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:43.422913 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259f88e0-bd58-4b84-8a9a-8a2bde32db87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:43.423209 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db17cb4e-d744-4dd0-84a6-b4295b4deed1 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:43.445220 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-db17cb4e-d744-4dd0-84a6-b4295b4deed1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:58:43.445220 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:58:43.445220 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:58:43.445220 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:58:43.445220 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:58:43.445220 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:58:43.445220 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:58:43.445220 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:58:43.445220 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:58:43.445220 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:58:43.445220 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:58:43.445220 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:58:43.445220 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 23 20:58:43.445220 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 23 20:58:43.445220 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 23 20:58:43.446697 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 23 20:58:43.446697 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:58:43.446697 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:58:43.446697 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:58:43.446697 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:58:43.446697 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:58:43.446697 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:58:43.446697 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:58:43.446697 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application with Lock( Jul 23 20:58:43.446697 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:58:43.446697 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:58:43.446697 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:58:43.446697 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:58:43.446697 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:58:43.446697 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:58:43.446697 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:58:43.446697 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:58:43.448485 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 23 20:58:43.448485 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 23 20:58:43.448485 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:58:43.448485 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 20:58:43.448485 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 495/974] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 23 20:58:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 23 20:58:43.453224 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db17cb4e-d744-4dd0-84a6-b4295b4deed1 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:43.461743 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-259f88e0-bd58-4b84-8a9a-8a2bde32db87 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:58:43.464512 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-259f88e0-bd58-4b84-8a9a-8a2bde32db87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:58:43.565466 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 480/975] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:58:43 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 23 20:58:43.589333 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259f88e0-bd58-4b84-8a9a-8a2bde32db87 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:43.607895 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db17cb4e-d744-4dd0-84a6-b4295b4deed1 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:43.620222 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:43.654427 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47bf956-b742-4fe6-b639-86be275f3c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:43.655042 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47bf956-b742-4fe6-b639-86be275f3c3a None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:43.655325 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47bf956-b742-4fe6-b639-86be275f3c3a None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:43.655599 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47bf956-b742-4fe6-b639-86be275f3c3a None admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:43.656739 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47bf956-b742-4fe6-b639-86be275f3c3a None admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:43.656739 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47bf956-b742-4fe6-b639-86be275f3c3a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:43.660044 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47bf956-b742-4fe6-b639-86be275f3c3a None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:43.675775 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 496/976] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 23 20:58:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 20:58:43.682901 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47bf956-b742-4fe6-b639-86be275f3c3a None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:43.688855 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:43.762617 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259f88e0-bd58-4b84-8a9a-8a2bde32db87 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:43.808133 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f845369-0ef2-49a2-a859-0ebc9cead92c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:43.809102 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f845369-0ef2-49a2-a859-0ebc9cead92c None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:43.809385 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f845369-0ef2-49a2-a859-0ebc9cead92c None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:43.809657 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f845369-0ef2-49a2-a859-0ebc9cead92c None admin] PATH_INFO: `/v3/services/compute` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:43.813279 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f845369-0ef2-49a2-a859-0ebc9cead92c None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:43.813279 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f845369-0ef2-49a2-a859-0ebc9cead92c None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:43.830233 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47bf956-b742-4fe6-b639-86be275f3c3a None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:43.830558 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-8f845369-0ef2-49a2-a859-0ebc9cead92c None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 23 20:58:43.830558 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:58:43.830558 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 23 20:58:43.830558 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 23 20:58:43.830558 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 23 20:58:43.830558 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 23 20:58:43.830558 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 23 20:58:43.830558 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 23 20:58:43.830558 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 23 20:58:43.830558 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:58:43.830558 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 23 20:58:43.830558 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:58:43.830558 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:58:43.830558 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:58:43.830558 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:58:43.830558 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:58:43.830558 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:58:43.831989 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:58:43.831989 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:58:43.831989 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:58:43.831989 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:58:43.831989 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:58:43.831989 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:58:43.831989 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 23 20:58:43.831989 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 23 20:58:43.831989 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 23 20:58:43.831989 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 23 20:58:43.831989 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:58:43.831989 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:58:43.831989 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:58:43.831989 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:58:43.831989 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:58:43.831989 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:58:43.832852 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:58:43.832852 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application with Lock( Jul 23 20:58:43.832852 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:58:43.832852 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:58:43.832852 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:58:43.832852 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:58:43.832852 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:58:43.832852 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:58:43.832852 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:58:43.832852 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:58:43.832852 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 23 20:58:43.832852 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 23 20:58:43.832852 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 23 20:58:43.832852 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:58:43.832852 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 481/977] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Jul 23 20:58:43 2022] GET /identity/v3/services/compute => generated 88 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 23 20:58:43.839850 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f845369-0ef2-49a2-a859-0ebc9cead92c None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:43.875706 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e8aa53-c3e5-4dd1-9a95-ba6d458d9370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:43.876530 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e8aa53-c3e5-4dd1-9a95-ba6d458d9370 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:43.876768 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e8aa53-c3e5-4dd1-9a95-ba6d458d9370 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:43.877070 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e8aa53-c3e5-4dd1-9a95-ba6d458d9370 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:43.887113 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e8aa53-c3e5-4dd1-9a95-ba6d458d9370 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:43.888895 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e8aa53-c3e5-4dd1-9a95-ba6d458d9370 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:43.906342 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-b7e8aa53-c3e5-4dd1-9a95-ba6d458d9370 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 23 20:58:43.906342 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:58:43.906342 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:58:43.906342 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:58:43.906342 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:58:43.906342 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:58:43.906342 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:58:43.906342 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:58:43.906342 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:58:43.906342 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:58:43.906342 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:58:43.906342 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:58:43.906342 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 23 20:58:43.906342 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 23 20:58:43.906342 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 23 20:58:43.906342 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 23 20:58:43.907597 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:58:43.907597 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:58:43.907597 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 23 20:58:43.907597 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 23 20:58:43.907597 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 23 20:58:43.907597 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 23 20:58:43.907597 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:58:43.907597 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:58:43.907597 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:58:43.907597 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:58:43.907597 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:58:43.907597 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application with Lock( Jul 23 20:58:43.907597 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:58:43.907597 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:58:43.907597 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:58:43.907597 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:58:43.907597 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:58:43.907597 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:58:43.908752 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:58:43.908752 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:58:43.908752 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 23 20:58:43.908752 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 23 20:58:43.908752 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 23 20:58:43.908752 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 23 20:58:43.908752 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 23 20:58:43.908752 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 23 20:58:43.908752 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 23 20:58:43.908752 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 20:58:43.913662 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 497/978] 10.222.0.17 () {56 vars in 1117 bytes} [Sat Jul 23 20:58:43 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 23 20:58:43.915000 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e8aa53-c3e5-4dd1-9a95-ba6d458d9370 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:43.951597 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:43.960884 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f845369-0ef2-49a2-a859-0ebc9cead92c None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:43.983917 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:44.005313 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02e8b9e-f7ec-4357-9814-97386205f4a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:44.006105 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02e8b9e-f7ec-4357-9814-97386205f4a3 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:44.006335 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02e8b9e-f7ec-4357-9814-97386205f4a3 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:44.006584 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02e8b9e-f7ec-4357-9814-97386205f4a3 None admin] PATH_INFO: `/v3/services` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:44.007307 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02e8b9e-f7ec-4357-9814-97386205f4a3 None admin] RBAC: Adding query filter params (name=compute) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:44.007614 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02e8b9e-f7ec-4357-9814-97386205f4a3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:44.008991 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02e8b9e-f7ec-4357-9814-97386205f4a3 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:44.015090 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 482/979] 10.222.0.17 () {56 vars in 1112 bytes} [Sat Jul 23 20:58:43 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 20:58:44.025383 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02e8b9e-f7ec-4357-9814-97386205f4a3 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:44.029006 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e8aa53-c3e5-4dd1-9a95-ba6d458d9370 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:44.072248 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098105a5-cd1b-4c1e-a2df-7fdea893e954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:44.073192 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098105a5-cd1b-4c1e-a2df-7fdea893e954 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:44.073694 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098105a5-cd1b-4c1e-a2df-7fdea893e954 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:44.073819 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098105a5-cd1b-4c1e-a2df-7fdea893e954 None admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:44.074614 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098105a5-cd1b-4c1e-a2df-7fdea893e954 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:44.074927 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098105a5-cd1b-4c1e-a2df-7fdea893e954 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:44.076430 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098105a5-cd1b-4c1e-a2df-7fdea893e954 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:44.096574 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 498/980] 10.222.0.17 () {56 vars in 1149 bytes} [Sat Jul 23 20:58:43 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 20:58:44.104328 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098105a5-cd1b-4c1e-a2df-7fdea893e954 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:44.158916 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02e8b9e-f7ec-4357-9814-97386205f4a3 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:44.197329 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daed998-64e6-4732-85f3-cc1118fb3725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:44.198202 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daed998-64e6-4732-85f3-cc1118fb3725 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:44.198583 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daed998-64e6-4732-85f3-cc1118fb3725 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:44.198846 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daed998-64e6-4732-85f3-cc1118fb3725 None admin] PATH_INFO: `/v3/services` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:44.199571 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daed998-64e6-4732-85f3-cc1118fb3725 None admin] RBAC: Adding query filter params (type=compute) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:44.199867 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daed998-64e6-4732-85f3-cc1118fb3725 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:44.201262 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daed998-64e6-4732-85f3-cc1118fb3725 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:44.209072 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:44.210522 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 483/981] 10.222.0.17 () {56 vars in 1112 bytes} [Sat Jul 23 20:58:44 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 20:58:44.214924 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daed998-64e6-4732-85f3-cc1118fb3725 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:44.233667 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098105a5-cd1b-4c1e-a2df-7fdea893e954 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:44.279612 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b5cda0-afc1-47c0-84a8-998ea15bc6b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:44.280315 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b5cda0-afc1-47c0-84a8-998ea15bc6b2 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:44.280603 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b5cda0-afc1-47c0-84a8-998ea15bc6b2 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:44.280928 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b5cda0-afc1-47c0-84a8-998ea15bc6b2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:44.282988 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:44.346391 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daed998-64e6-4732-85f3-cc1118fb3725 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:44.355335 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b5cda0-afc1-47c0-84a8-998ea15bc6b2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:44.357019 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b5cda0-afc1-47c0-84a8-998ea15bc6b2 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:44.386020 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de86f96-a54e-4df9-ac5e-6df25e2d9078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:44.386738 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de86f96-a54e-4df9-ac5e-6df25e2d9078 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:44.387021 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de86f96-a54e-4df9-ac5e-6df25e2d9078 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:44.387297 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de86f96-a54e-4df9-ac5e-6df25e2d9078 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:44.388091 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de86f96-a54e-4df9-ac5e-6df25e2d9078 None admin] RBAC: Adding query filter params (interface=public, service_id=32edaad6c99342629318dae069c1849a, region_id=RegionOne) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:44.388405 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de86f96-a54e-4df9-ac5e-6df25e2d9078 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:44.389790 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de86f96-a54e-4df9-ac5e-6df25e2d9078 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:44.396004 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 484/982] 10.222.0.17 () {56 vars in 1251 bytes} [Sat Jul 23 20:58:44 2022] GET /identity/v3/endpoints?service_id=32edaad6c99342629318dae069c1849a&interface=public®ion_id=RegionOne => generated 194 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 20:58:44.402094 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de86f96-a54e-4df9-ac5e-6df25e2d9078 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:44.460904 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:44.478034 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 499/983] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Jul 23 20:58:44 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 23 20:58:44.484108 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b5cda0-afc1-47c0-84a8-998ea15bc6b2 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:44.521739 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de86f96-a54e-4df9-ac5e-6df25e2d9078 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:44.534055 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:44.559880 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293b72db-343a-4489-b496-e9b3d6d3ed84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:44.560560 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293b72db-343a-4489-b496-e9b3d6d3ed84 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:44.560840 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293b72db-343a-4489-b496-e9b3d6d3ed84 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:44.561112 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293b72db-343a-4489-b496-e9b3d6d3ed84 None admin] PATH_INFO: `/v3/services` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:44.561795 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293b72db-343a-4489-b496-e9b3d6d3ed84 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:44.563247 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293b72db-343a-4489-b496-e9b3d6d3ed84 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:44.577905 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 485/984] 10.222.0.17 () {56 vars in 1087 bytes} [Sat Jul 23 20:58:44 2022] GET /identity/v3/services => generated 1727 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 20:58:44.611598 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b5cda0-afc1-47c0-84a8-998ea15bc6b2 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:44.655451 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917f9c7e-22ee-43c7-9885-e4f8764a0eed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:44.656259 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917f9c7e-22ee-43c7-9885-e4f8764a0eed None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:44.656535 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917f9c7e-22ee-43c7-9885-e4f8764a0eed None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:44.656807 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917f9c7e-22ee-43c7-9885-e4f8764a0eed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:44.675162 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917f9c7e-22ee-43c7-9885-e4f8764a0eed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:44.676785 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917f9c7e-22ee-43c7-9885-e4f8764a0eed None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:44.696902 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-917f9c7e-22ee-43c7-9885-e4f8764a0eed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:58:44.696902 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:58:44.696902 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:58:44.696902 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:58:44.696902 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:58:44.696902 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:58:44.696902 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:58:44.696902 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:58:44.696902 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:58:44.696902 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:58:44.696902 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:58:44.696902 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:58:44.696902 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 23 20:58:44.696902 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 23 20:58:44.696902 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 23 20:58:44.698016 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 23 20:58:44.698016 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:58:44.698016 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:58:44.698016 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:58:44.698016 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:58:44.698016 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:58:44.698016 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:58:44.698016 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:58:44.698016 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application with Lock( Jul 23 20:58:44.698016 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:58:44.698016 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:58:44.698016 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:58:44.698016 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:58:44.698016 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:58:44.698016 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:58:44.698016 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:58:44.698016 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:58:44.703995 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 23 20:58:44.703995 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 23 20:58:44.703995 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:58:44.703995 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 20:58:44.703995 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 500/985] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 23 20:58:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 23 20:58:44.705583 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293b72db-343a-4489-b496-e9b3d6d3ed84 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:44.838579 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293b72db-343a-4489-b496-e9b3d6d3ed84 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:44.873870 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3412768-fb3e-4d29-8e9e-72d9ea86b137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:44.874551 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3412768-fb3e-4d29-8e9e-72d9ea86b137 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:44.874831 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3412768-fb3e-4d29-8e9e-72d9ea86b137 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:44.875104 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3412768-fb3e-4d29-8e9e-72d9ea86b137 None admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:44.875828 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3412768-fb3e-4d29-8e9e-72d9ea86b137 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:44.876132 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3412768-fb3e-4d29-8e9e-72d9ea86b137 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:44.877568 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3412768-fb3e-4d29-8e9e-72d9ea86b137 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:44.895006 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 486/986] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 23 20:58:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:58:44.896275 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917f9c7e-22ee-43c7-9885-e4f8764a0eed None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:44.915788 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cbaedf-6a01-48a4-afe6-fd121ca6c619 None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:44.916030 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cbaedf-6a01-48a4-afe6-fd121ca6c619 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:44.916310 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cbaedf-6a01-48a4-afe6-fd121ca6c619 None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:44.917937 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 487/987] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:58:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 23 20:58:44.922875 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1d449e-a1b1-4359-a0d7-c387c2762954 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:44.923169 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1d449e-a1b1-4359-a0d7-c387c2762954 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:44.923414 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1d449e-a1b1-4359-a0d7-c387c2762954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:44.940646 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-5d1d449e-a1b1-4359-a0d7-c387c2762954 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:58:44.941838 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-5d1d449e-a1b1-4359-a0d7-c387c2762954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:58:44.946340 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:44.968565 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:45.010269 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 488/988] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:58:44 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 23 20:58:45.014403 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917f9c7e-22ee-43c7-9885-e4f8764a0eed None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:45.034604 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1d449e-a1b1-4359-a0d7-c387c2762954 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:45.052880 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d7f512-8ea0-4572-a9ad-76bc78154b70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:45.053717 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d7f512-8ea0-4572-a9ad-76bc78154b70 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:45.054032 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d7f512-8ea0-4572-a9ad-76bc78154b70 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:45.054303 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d7f512-8ea0-4572-a9ad-76bc78154b70 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:45.062476 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d7f512-8ea0-4572-a9ad-76bc78154b70 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:45.064129 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d7f512-8ea0-4572-a9ad-76bc78154b70 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:45.080003 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-74d7f512-8ea0-4572-a9ad-76bc78154b70 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 23 20:58:45.080003 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:58:45.080003 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:58:45.080003 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:58:45.080003 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:58:45.080003 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:58:45.080003 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:58:45.080003 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:58:45.080003 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:58:45.080003 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:58:45.080003 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:58:45.080003 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:58:45.080003 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 23 20:58:45.080003 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 23 20:58:45.080003 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 23 20:58:45.081010 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 23 20:58:45.081010 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:58:45.081010 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:58:45.081010 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:58:45.081010 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:58:45.081010 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:58:45.081010 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:58:45.081010 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:58:45.081010 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application with Lock( Jul 23 20:58:45.081010 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:58:45.081010 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:58:45.081010 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:58:45.081010 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:58:45.081010 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:58:45.081010 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:58:45.081010 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:58:45.081010 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:58:45.081996 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 23 20:58:45.081996 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 23 20:58:45.081996 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 23 20:58:45.081996 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 23 20:58:45.081996 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 23 20:58:45.081996 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 23 20:58:45.081996 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 23 20:58:45.081996 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 20:58:45.081996 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 501/989] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Jul 23 20:58:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 23 20:58:45.087250 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d7f512-8ea0-4572-a9ad-76bc78154b70 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:45.138663 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1d449e-a1b1-4359-a0d7-c387c2762954 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:45.176540 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e6511e-0911-44bc-8fa6-885cef4a820d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:45.177390 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e6511e-0911-44bc-8fa6-885cef4a820d None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:45.177671 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e6511e-0911-44bc-8fa6-885cef4a820d None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:45.177978 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e6511e-0911-44bc-8fa6-885cef4a820d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:45.178646 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e6511e-0911-44bc-8fa6-885cef4a820d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:45.180269 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e6511e-0911-44bc-8fa6-885cef4a820d None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:45.189360 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:45.192754 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d7f512-8ea0-4572-a9ad-76bc78154b70 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:45.194298 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-c3e6511e-0911-44bc-8fa6-885cef4a820d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 23 20:58:45.194298 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:58:45.194298 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 23 20:58:45.194298 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 23 20:58:45.194298 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 23 20:58:45.194298 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 23 20:58:45.194298 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 23 20:58:45.194298 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 23 20:58:45.194298 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 23 20:58:45.194298 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:58:45.194298 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 23 20:58:45.194298 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:58:45.194298 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:58:45.194298 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:58:45.194298 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:58:45.194298 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:58:45.194298 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:58:45.195537 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:58:45.195537 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:58:45.195537 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:58:45.195537 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:58:45.195537 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:58:45.195537 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:58:45.195537 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 23 20:58:45.195537 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 23 20:58:45.195537 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 23 20:58:45.195537 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 23 20:58:45.195537 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:58:45.195537 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:58:45.195537 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:58:45.195537 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:58:45.195537 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:58:45.195537 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:58:45.196438 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:58:45.196438 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application with Lock( Jul 23 20:58:45.196438 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:58:45.196438 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:58:45.196438 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:58:45.196438 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:58:45.196438 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:58:45.196438 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:58:45.196438 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:58:45.196438 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:58:45.196438 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 23 20:58:45.196438 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 23 20:58:45.196438 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 23 20:58:45.196438 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:58:45.196438 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 489/990] 10.222.0.17 () {56 vars in 1126 bytes} [Sat Jul 23 20:58:45 2022] GET /identity/v3/services/object-store => generated 93 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 23 20:58:45.201479 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e6511e-0911-44bc-8fa6-885cef4a820d None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:45.232283 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:45.240563 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559b5dff-d93f-406e-88c3-5c736a5c5b3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:45.241252 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559b5dff-d93f-406e-88c3-5c736a5c5b3d None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:45.241532 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559b5dff-d93f-406e-88c3-5c736a5c5b3d None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:45.241806 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559b5dff-d93f-406e-88c3-5c736a5c5b3d None admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:45.242627 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559b5dff-d93f-406e-88c3-5c736a5c5b3d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:45.242934 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559b5dff-d93f-406e-88c3-5c736a5c5b3d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:45.244382 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559b5dff-d93f-406e-88c3-5c736a5c5b3d None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:45.264249 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 502/991] 10.222.0.17 () {56 vars in 1148 bytes} [Sat Jul 23 20:58:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:58:45.265206 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559b5dff-d93f-406e-88c3-5c736a5c5b3d None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:45.311218 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e6511e-0911-44bc-8fa6-885cef4a820d None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:45.372626 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f327e9d-5561-406f-956e-8f56fcfac3b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:45.373335 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f327e9d-5561-406f-956e-8f56fcfac3b2 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:45.373619 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f327e9d-5561-406f-956e-8f56fcfac3b2 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:45.373887 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f327e9d-5561-406f-956e-8f56fcfac3b2 None admin] PATH_INFO: `/v3/services` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:45.374690 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f327e9d-5561-406f-956e-8f56fcfac3b2 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:45.374982 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f327e9d-5561-406f-956e-8f56fcfac3b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:45.376377 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f327e9d-5561-406f-956e-8f56fcfac3b2 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:45.382489 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 490/992] 10.222.0.17 () {56 vars in 1122 bytes} [Sat Jul 23 20:58:45 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:58:45.387740 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f327e9d-5561-406f-956e-8f56fcfac3b2 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:45.398590 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559b5dff-d93f-406e-88c3-5c736a5c5b3d None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:45.435432 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b36eb56-4e41-40ee-9fb4-d66ff439e63f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:45.436068 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b36eb56-4e41-40ee-9fb4-d66ff439e63f None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:45.436368 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b36eb56-4e41-40ee-9fb4-d66ff439e63f None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:45.436637 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b36eb56-4e41-40ee-9fb4-d66ff439e63f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:45.437649 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b36eb56-4e41-40ee-9fb4-d66ff439e63f None admin] RBAC: Adding query filter params (role.id=3295256c44774d3ea100d28799b26fd9, scope.project.id=4804ed61295f4d4a92d9b685dd9e9f3b, user.id=17b779a3e21a415bb42cde5d6863d9cf) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:45.438001 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b36eb56-4e41-40ee-9fb4-d66ff439e63f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:45.439591 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b36eb56-4e41-40ee-9fb4-d66ff439e63f None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:45.447145 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 503/993] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Jul 23 20:58:45 2022] GET /identity/v3/role_assignments?user.id=17b779a3e21a415bb42cde5d6863d9cf&scope.project.id=4804ed61295f4d4a92d9b685dd9e9f3b&role.id=3295256c44774d3ea100d28799b26fd9 => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:58:45.490578 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:45.501446 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f327e9d-5561-406f-956e-8f56fcfac3b2 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:45.553676 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deb2fc1-cb80-4aff-ae24-586202ff06ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:45.554387 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deb2fc1-cb80-4aff-ae24-586202ff06ac None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:45.554664 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deb2fc1-cb80-4aff-ae24-586202ff06ac None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:45.554932 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deb2fc1-cb80-4aff-ae24-586202ff06ac None admin] PATH_INFO: `/v3/services` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:45.555671 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3deb2fc1-cb80-4aff-ae24-586202ff06ac None admin] RBAC: Adding query filter params (type=object-store) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:45.555948 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3deb2fc1-cb80-4aff-ae24-586202ff06ac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:45.557351 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3deb2fc1-cb80-4aff-ae24-586202ff06ac None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:45.563342 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 491/994] 10.222.0.17 () {56 vars in 1122 bytes} [Sat Jul 23 20:58:45 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:58:45.569346 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b36eb56-4e41-40ee-9fb4-d66ff439e63f None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:45.597845 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:45.689382 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b36eb56-4e41-40ee-9fb4-d66ff439e63f None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:45.723274 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d7c2be-9dc0-40ee-ac0d-3cd12645020e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:45.723938 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d7c2be-9dc0-40ee-ac0d-3cd12645020e None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:45.724212 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d7c2be-9dc0-40ee-ac0d-3cd12645020e None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:45.724475 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d7c2be-9dc0-40ee-ac0d-3cd12645020e None admin] PATH_INFO: `/v3/endpoints` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:45.726584 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d7c2be-9dc0-40ee-ac0d-3cd12645020e None admin] RBAC: Adding query filter params (interface=admin, service_id=d59203be7dff4d118704acf72c80c4de, region_id=RegionOne) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:45.726584 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d7c2be-9dc0-40ee-ac0d-3cd12645020e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:45.726942 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d7c2be-9dc0-40ee-ac0d-3cd12645020e None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:45.732456 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 504/995] 10.222.0.17 () {56 vars in 1249 bytes} [Sat Jul 23 20:58:45 2022] GET /identity/v3/endpoints?service_id=d59203be7dff4d118704acf72c80c4de&interface=admin®ion_id=RegionOne => generated 193 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:58:45.738029 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deb2fc1-cb80-4aff-ae24-586202ff06ac None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:45.856263 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deb2fc1-cb80-4aff-ae24-586202ff06ac None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:45.897042 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466b85ef-0e93-47ed-affc-2f73fc21599b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:45.897723 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466b85ef-0e93-47ed-affc-2f73fc21599b None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:45.898034 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466b85ef-0e93-47ed-affc-2f73fc21599b None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:45.898304 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466b85ef-0e93-47ed-affc-2f73fc21599b None admin] PATH_INFO: `/v3/services` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:45.898988 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466b85ef-0e93-47ed-affc-2f73fc21599b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:45.900384 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466b85ef-0e93-47ed-affc-2f73fc21599b None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:45.913951 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 492/996] 10.222.0.17 () {56 vars in 1087 bytes} [Sat Jul 23 20:58:45 2022] GET /identity/v3/services => generated 1727 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 20:58:46.962968 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbe1de2-b11c-4c4a-8c20-818e26149cf0 None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:46.963693 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbe1de2-b11c-4c4a-8c20-818e26149cf0 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:46.963693 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbe1de2-b11c-4c4a-8c20-818e26149cf0 None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:46.965173 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 505/997] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:58:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 23 20:58:46.971153 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f280cbdc-17e1-45a7-8123-d828577c4ffc None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:46.971677 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f280cbdc-17e1-45a7-8123-d828577c4ffc None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:46.971789 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f280cbdc-17e1-45a7-8123-d828577c4ffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:46.992570 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-f280cbdc-17e1-45a7-8123-d828577c4ffc None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:58:46.993755 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-f280cbdc-17e1-45a7-8123-d828577c4ffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:58:47.010670 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:47.074145 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 493/998] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:58:46 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 23 20:58:47.094051 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbe1de2-b11c-4c4a-8c20-818e26149cf0 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:47.210283 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:47.228088 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbe1de2-b11c-4c4a-8c20-818e26149cf0 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:47.264435 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120ebcea-3486-4c19-b495-61ddd362a5ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:47.265274 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120ebcea-3486-4c19-b495-61ddd362a5ec None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:47.265525 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120ebcea-3486-4c19-b495-61ddd362a5ec None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:47.265805 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120ebcea-3486-4c19-b495-61ddd362a5ec None admin] PATH_INFO: `/v3/services/compute` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:47.266491 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120ebcea-3486-4c19-b495-61ddd362a5ec None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:47.267872 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120ebcea-3486-4c19-b495-61ddd362a5ec None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:47.280958 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-120ebcea-3486-4c19-b495-61ddd362a5ec None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 23 20:58:47.280958 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:58:47.280958 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 23 20:58:47.280958 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 23 20:58:47.280958 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 23 20:58:47.280958 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 23 20:58:47.280958 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 23 20:58:47.280958 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 23 20:58:47.280958 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 23 20:58:47.280958 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 20:58:47.280958 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 23 20:58:47.280958 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 20:58:47.280958 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:58:47.280958 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:58:47.280958 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:58:47.280958 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:58:47.280958 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:58:47.282140 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:58:47.282140 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:58:47.282140 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:58:47.282140 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:58:47.282140 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:58:47.282140 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:58:47.282140 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 23 20:58:47.282140 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 23 20:58:47.282140 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 23 20:58:47.282140 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 23 20:58:47.282140 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:58:47.282140 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:58:47.282140 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:58:47.282140 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:58:47.282140 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:58:47.282140 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:58:47.288451 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:58:47.288451 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application with Lock( Jul 23 20:58:47.288451 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:58:47.288451 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:58:47.288451 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:58:47.288451 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:58:47.288451 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:58:47.288451 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:58:47.288451 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:58:47.288451 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:58:47.288451 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 23 20:58:47.288451 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 23 20:58:47.288451 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 23 20:58:47.288451 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 20:58:47.288451 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 506/999] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Jul 23 20:58:47 2022] GET /identity/v3/services/compute => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:58:47.290868 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f280cbdc-17e1-45a7-8123-d828577c4ffc None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:47.412895 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f280cbdc-17e1-45a7-8123-d828577c4ffc None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:47.449645 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064f28dd-fff6-4629-84fc-c797aafcd543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:47.450354 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064f28dd-fff6-4629-84fc-c797aafcd543 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:47.450630 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064f28dd-fff6-4629-84fc-c797aafcd543 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:47.450901 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064f28dd-fff6-4629-84fc-c797aafcd543 None admin] PATH_INFO: `/v3/services` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:47.451611 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064f28dd-fff6-4629-84fc-c797aafcd543 None admin] RBAC: Adding query filter params (name=compute) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:47.451911 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064f28dd-fff6-4629-84fc-c797aafcd543 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:47.453319 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064f28dd-fff6-4629-84fc-c797aafcd543 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:47.458712 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 494/1000] 10.222.0.17 () {56 vars in 1112 bytes} [Sat Jul 23 20:58:47 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:58:47.464666 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120ebcea-3486-4c19-b495-61ddd362a5ec None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:47.581190 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120ebcea-3486-4c19-b495-61ddd362a5ec None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:47.616826 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de032cd-989b-4e27-84b6-9c0d87ef4293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:47.617508 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de032cd-989b-4e27-84b6-9c0d87ef4293 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:47.617783 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de032cd-989b-4e27-84b6-9c0d87ef4293 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:47.618093 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de032cd-989b-4e27-84b6-9c0d87ef4293 None admin] PATH_INFO: `/v3/services` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:47.618804 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de032cd-989b-4e27-84b6-9c0d87ef4293 None admin] RBAC: Adding query filter params (type=compute) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:47.619106 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de032cd-989b-4e27-84b6-9c0d87ef4293 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:47.620478 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de032cd-989b-4e27-84b6-9c0d87ef4293 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:47.625818 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 507/1001] 10.222.0.17 () {56 vars in 1112 bytes} [Sat Jul 23 20:58:47 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:58:47.641447 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064f28dd-fff6-4629-84fc-c797aafcd543 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:47.664647 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:47.759739 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064f28dd-fff6-4629-84fc-c797aafcd543 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:47.795726 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2951ce6-efce-4c1b-92e4-d6ab6f5a66c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:47.796809 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2951ce6-efce-4c1b-92e4-d6ab6f5a66c5 None admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:47.797283 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2951ce6-efce-4c1b-92e4-d6ab6f5a66c5 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:47.797806 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2951ce6-efce-4c1b-92e4-d6ab6f5a66c5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:47.798851 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2951ce6-efce-4c1b-92e4-d6ab6f5a66c5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:47.800782 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2951ce6-efce-4c1b-92e4-d6ab6f5a66c5 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:47.830115 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 495/1002] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 23 20:58:47 2022] POST /identity/v3/endpoints => generated 334 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 20:58:48.085466 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25095ee5-55fe-49e2-ad94-0b4967403c65 None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:48.086285 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25095ee5-55fe-49e2-ad94-0b4967403c65 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:48.086285 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25095ee5-55fe-49e2-ad94-0b4967403c65 None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:48.087685 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 508/1003] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:58:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:58:48.093102 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff96cb2-cf83-45f0-8dd9-0511002f16ff None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:48.093595 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff96cb2-cf83-45f0-8dd9-0511002f16ff None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:48.093678 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff96cb2-cf83-45f0-8dd9-0511002f16ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:48.111100 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-7ff96cb2-cf83-45f0-8dd9-0511002f16ff None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:58:48.112409 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-7ff96cb2-cf83-45f0-8dd9-0511002f16ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:58:48.194958 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:48.208659 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 496/1004] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:58:48 2022] POST /identity/v3/auth/tokens => generated 1716 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 23 20:58:48.235061 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25095ee5-55fe-49e2-ad94-0b4967403c65 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:48.267692 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:48.292626 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8565c8-50e5-411b-9a7a-39ab2696867d None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:48.292916 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8565c8-50e5-411b-9a7a-39ab2696867d None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:48.293170 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8565c8-50e5-411b-9a7a-39ab2696867d None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:48.294796 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 497/1005] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:58:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 23 20:58:48.300302 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2149a340-c339-4d0b-b902-16ba08ff05f9 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:48.300592 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2149a340-c339-4d0b-b902-16ba08ff05f9 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:48.300859 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2149a340-c339-4d0b-b902-16ba08ff05f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:48.319138 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-2149a340-c339-4d0b-b902-16ba08ff05f9 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:58:48.320344 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-2149a340-c339-4d0b-b902-16ba08ff05f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:58:48.376553 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25095ee5-55fe-49e2-ad94-0b4967403c65 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:48.401813 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 498/1006] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:58:48 2022] POST /identity/v3/auth/tokens => generated 1716 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 23 20:58:48.413649 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e94fcdd-bd7e-42e9-adbf-0d87e7c88aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:48.414487 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e94fcdd-bd7e-42e9-adbf-0d87e7c88aaf None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:48.414761 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e94fcdd-bd7e-42e9-adbf-0d87e7c88aaf None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:48.415028 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e94fcdd-bd7e-42e9-adbf-0d87e7c88aaf None admin] PATH_INFO: `/v3/services/image` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:48.415674 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e94fcdd-bd7e-42e9-adbf-0d87e7c88aaf None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:48.417037 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e94fcdd-bd7e-42e9-adbf-0d87e7c88aaf None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:48.426966 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2149a340-c339-4d0b-b902-16ba08ff05f9 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:48.429938 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-7e94fcdd-bd7e-42e9-adbf-0d87e7c88aaf None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 23 20:58:48.429938 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:58:48.429938 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 23 20:58:48.429938 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 23 20:58:48.429938 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 23 20:58:48.429938 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 23 20:58:48.429938 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 23 20:58:48.429938 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 23 20:58:48.429938 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 23 20:58:48.429938 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 20:58:48.429938 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 23 20:58:48.429938 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 20:58:48.429938 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:58:48.429938 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:58:48.429938 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:58:48.429938 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:58:48.429938 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:58:48.430932 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:58:48.430932 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:58:48.430932 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:58:48.430932 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:58:48.430932 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:58:48.430932 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:58:48.430932 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 23 20:58:48.430932 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 23 20:58:48.430932 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 23 20:58:48.430932 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 23 20:58:48.430932 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:58:48.430932 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:58:48.430932 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:58:48.430932 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:58:48.430932 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:58:48.430932 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:58:48.431785 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:58:48.431785 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application with Lock( Jul 23 20:58:48.431785 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:58:48.431785 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:58:48.431785 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:58:48.431785 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:58:48.431785 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:58:48.431785 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:58:48.431785 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:58:48.431785 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:58:48.431785 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 23 20:58:48.431785 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 23 20:58:48.431785 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 23 20:58:48.431785 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 20:58:48.436416 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 509/1007] 10.222.0.17 () {56 vars in 1105 bytes} [Sat Jul 23 20:58:48 2022] GET /identity/v3/services/image => generated 86 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:58:48.437473 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e94fcdd-bd7e-42e9-adbf-0d87e7c88aaf None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:48.526958 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:48.549415 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e94fcdd-bd7e-42e9-adbf-0d87e7c88aaf None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:48.550316 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2149a340-c339-4d0b-b902-16ba08ff05f9 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:48.580851 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:48.590783 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44acd122-716f-4716-9ac3-f2604b452a3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:48.591636 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44acd122-716f-4716-9ac3-f2604b452a3e None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:48.591913 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44acd122-716f-4716-9ac3-f2604b452a3e None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:48.592069 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c45c869-51f8-45a3-b291-65f3313aade9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:48.592167 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44acd122-716f-4716-9ac3-f2604b452a3e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:48.592604 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c45c869-51f8-45a3-b291-65f3313aade9 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:48.592828 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44acd122-716f-4716-9ac3-f2604b452a3e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:48.592929 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c45c869-51f8-45a3-b291-65f3313aade9 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:48.593113 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c45c869-51f8-45a3-b291-65f3313aade9 None admin] PATH_INFO: `/v3/services` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:48.593844 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c45c869-51f8-45a3-b291-65f3313aade9 None admin] RBAC: Adding query filter params (name=image) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:48.594174 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c45c869-51f8-45a3-b291-65f3313aade9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:48.594318 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44acd122-716f-4716-9ac3-f2604b452a3e None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:48.595526 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c45c869-51f8-45a3-b291-65f3313aade9 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:48.600848 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 510/1008] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 23 20:58:48 2022] GET /identity/v3/services?name=image => generated 122 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:58:48.606424 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-44acd122-716f-4716-9ac3-f2604b452a3e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 23 20:58:48.606424 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:58:48.606424 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 23 20:58:48.606424 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 23 20:58:48.606424 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 23 20:58:48.606424 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 23 20:58:48.606424 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 23 20:58:48.606424 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 23 20:58:48.606424 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 23 20:58:48.606424 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:58:48.606424 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 23 20:58:48.606424 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:58:48.606424 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:58:48.606424 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:58:48.606424 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:58:48.606424 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:58:48.606424 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:58:48.607400 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:58:48.607400 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:58:48.607400 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:58:48.607400 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:58:48.607400 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:58:48.607400 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:58:48.607400 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 23 20:58:48.607400 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 23 20:58:48.607400 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 23 20:58:48.607400 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 23 20:58:48.607400 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:58:48.607400 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:58:48.607400 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:58:48.607400 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:58:48.607400 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:58:48.607400 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:58:48.608704 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:58:48.608704 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application with Lock( Jul 23 20:58:48.608704 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:58:48.608704 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:58:48.608704 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:58:48.608704 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:58:48.608704 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:58:48.608704 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:58:48.608704 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:58:48.608704 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:58:48.608704 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 23 20:58:48.608704 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 23 20:58:48.608704 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 23 20:58:48.608704 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:58:48.609446 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c45c869-51f8-45a3-b291-65f3313aade9 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:48.609529 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 499/1009] 10.222.0.17 () {56 vars in 1126 bytes} [Sat Jul 23 20:58:48 2022] GET /identity/v3/services/object-store => generated 93 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 23 20:58:48.614009 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44acd122-716f-4716-9ac3-f2604b452a3e None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:48.717993 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c45c869-51f8-45a3-b291-65f3313aade9 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:48.722132 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44acd122-716f-4716-9ac3-f2604b452a3e None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:48.754811 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8293c3fb-15e8-40eb-bd0c-639225538474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:48.757950 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8293c3fb-15e8-40eb-bd0c-639225538474 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:48.757950 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8293c3fb-15e8-40eb-bd0c-639225538474 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:48.757950 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8293c3fb-15e8-40eb-bd0c-639225538474 None admin] PATH_INFO: `/v3/services` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:48.757950 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8293c3fb-15e8-40eb-bd0c-639225538474 None admin] RBAC: Adding query filter params (type=image) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:48.757950 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8293c3fb-15e8-40eb-bd0c-639225538474 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:48.758362 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8293c3fb-15e8-40eb-bd0c-639225538474 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:48.764471 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c151806a-5137-4a9a-aa25-5a917ed3a9d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:48.767991 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c151806a-5137-4a9a-aa25-5a917ed3a9d5 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:48.767991 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c151806a-5137-4a9a-aa25-5a917ed3a9d5 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:48.767991 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c151806a-5137-4a9a-aa25-5a917ed3a9d5 None admin] PATH_INFO: `/v3/services` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:48.767991 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c151806a-5137-4a9a-aa25-5a917ed3a9d5 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:48.767991 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c151806a-5137-4a9a-aa25-5a917ed3a9d5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:48.768363 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c151806a-5137-4a9a-aa25-5a917ed3a9d5 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:48.773710 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 511/1010] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 23 20:58:48 2022] GET /identity/v3/services?type=image => generated 122 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 20:58:48.778020 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 500/1011] 10.222.0.17 () {56 vars in 1122 bytes} [Sat Jul 23 20:58:48 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 20:58:48.780993 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8293c3fb-15e8-40eb-bd0c-639225538474 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:48.794274 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:48.903966 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8293c3fb-15e8-40eb-bd0c-639225538474 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:48.943085 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eda6f5b-1b16-45cd-ae07-364bc9486e7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:48.943770 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eda6f5b-1b16-45cd-ae07-364bc9486e7c None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:48.944041 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eda6f5b-1b16-45cd-ae07-364bc9486e7c None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:48.944325 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eda6f5b-1b16-45cd-ae07-364bc9486e7c None admin] PATH_INFO: `/v3/services` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:48.945015 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eda6f5b-1b16-45cd-ae07-364bc9486e7c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:48.945314 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eda6f5b-1b16-45cd-ae07-364bc9486e7c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:48.946726 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eda6f5b-1b16-45cd-ae07-364bc9486e7c None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:48.952572 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 512/1012] 10.222.0.17 () {56 vars in 1122 bytes} [Sat Jul 23 20:58:48 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 20:58:48.958549 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c151806a-5137-4a9a-aa25-5a917ed3a9d5 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:49.020065 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:49.066094 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c151806a-5137-4a9a-aa25-5a917ed3a9d5 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:49.100584 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d117ea-7b97-43da-b6d5-679919efd502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:49.101248 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d117ea-7b97-43da-b6d5-679919efd502 None admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:49.101515 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d117ea-7b97-43da-b6d5-679919efd502 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:49.101788 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d117ea-7b97-43da-b6d5-679919efd502 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:49.102567 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d117ea-7b97-43da-b6d5-679919efd502 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:49.103946 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d117ea-7b97-43da-b6d5-679919efd502 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:49.122345 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 501/1013] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 23 20:58:48 2022] POST /identity/v3/endpoints => generated 325 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 20:58:50.258480 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea10809-b68f-4cb6-8ba4-8d782a1bf12b None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:50.259513 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea10809-b68f-4cb6-8ba4-8d782a1bf12b None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:50.260239 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea10809-b68f-4cb6-8ba4-8d782a1bf12b None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:50.262388 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 513/1014] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:58:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:58:50.268385 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3423f089-aca8-4bef-8ab0-295ddbe767fd None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:50.268884 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3423f089-aca8-4bef-8ab0-295ddbe767fd None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:50.268960 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3423f089-aca8-4bef-8ab0-295ddbe767fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:50.286628 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-3423f089-aca8-4bef-8ab0-295ddbe767fd None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:58:50.287816 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-3423f089-aca8-4bef-8ab0-295ddbe767fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:58:50.367455 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 502/1015] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:58:50 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 23 20:58:50.403512 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea10809-b68f-4cb6-8ba4-8d782a1bf12b None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:50.484825 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:50.518149 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea10809-b68f-4cb6-8ba4-8d782a1bf12b None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:50.558711 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d076e74-847d-445c-a75b-e04aa0b1243a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:50.559963 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d076e74-847d-445c-a75b-e04aa0b1243a None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:50.560452 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d076e74-847d-445c-a75b-e04aa0b1243a None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:50.560928 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d076e74-847d-445c-a75b-e04aa0b1243a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:50.572333 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d076e74-847d-445c-a75b-e04aa0b1243a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:58:50.580845 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-7d076e74-847d-445c-a75b-e04aa0b1243a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 23 20:58:50.580845 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:58:50.580845 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:58:50.580845 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:58:50.580845 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:58:50.580845 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:58:50.580845 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:58:50.580845 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:58:50.580845 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:58:50.580845 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:58:50.580845 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:58:50.580845 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:58:50.580845 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:58:50.580845 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:58:50.580845 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:58:50.580845 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:58:50.581877 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:58:50.581877 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:58:50.581877 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:58:50.581877 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:58:50.581877 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:58:50.581877 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:58:50.581877 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:58:50.581877 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:58:50.581877 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:58:50.581877 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:58:50.581877 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:58:50.581877 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application with Lock( Jul 23 20:58:50.581877 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:58:50.581877 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:58:50.581877 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:58:50.581877 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:58:50.582761 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:58:50.582761 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:58:50.582761 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:58:50.582761 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:58:50.582761 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:58:50.582761 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:58:50.582761 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:58:50.582761 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:58:50.582761 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:58:50.582761 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:58:50.582761 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 23 20:58:50.582761 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 20:58:50.583420 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 514/1016] 10.222.0.17 () {56 vars in 1120 bytes} [Sat Jul 23 20:58:50 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 23 20:58:50.590267 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3423f089-aca8-4bef-8ab0-295ddbe767fd None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:50.635368 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:50.698651 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3423f089-aca8-4bef-8ab0-295ddbe767fd None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:50.734067 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ad4fbe-4417-4590-be14-578c04657bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:50.734748 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ad4fbe-4417-4590-be14-578c04657bee None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:50.735028 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ad4fbe-4417-4590-be14-578c04657bee None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:50.735296 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ad4fbe-4417-4590-be14-578c04657bee None admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:50.736045 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ad4fbe-4417-4590-be14-578c04657bee None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:50.736346 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ad4fbe-4417-4590-be14-578c04657bee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:50.737801 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ad4fbe-4417-4590-be14-578c04657bee None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:50.747878 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 503/1017] 10.222.0.17 () {56 vars in 1115 bytes} [Sat Jul 23 20:58:50 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:58:50.753488 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d076e74-847d-445c-a75b-e04aa0b1243a None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:50.871550 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d076e74-847d-445c-a75b-e04aa0b1243a None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:50.902214 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:50.908283 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d963168-84de-4704-8c23-cfd19d4dc688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:50.909191 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d963168-84de-4704-8c23-cfd19d4dc688 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:50.910033 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d963168-84de-4704-8c23-cfd19d4dc688 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:50.910291 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d963168-84de-4704-8c23-cfd19d4dc688 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:50.923258 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d963168-84de-4704-8c23-cfd19d4dc688 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:50.924741 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d963168-84de-4704-8c23-cfd19d4dc688 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:50.945167 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-3d963168-84de-4704-8c23-cfd19d4dc688 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:58:50.945167 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:58:50.945167 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:58:50.945167 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:58:50.945167 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:58:50.945167 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:58:50.945167 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:58:50.945167 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:58:50.945167 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:58:50.945167 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:58:50.945167 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:58:50.945167 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:58:50.945167 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 23 20:58:50.945167 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 23 20:58:50.945167 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 23 20:58:50.946202 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 23 20:58:50.946202 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:58:50.946202 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:58:50.946202 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:58:50.946202 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:58:50.946202 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:58:50.946202 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:58:50.946202 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:58:50.946202 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application with Lock( Jul 23 20:58:50.946202 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:58:50.946202 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:58:50.946202 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:58:50.946202 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:58:50.946202 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:58:50.946202 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:58:50.946202 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:58:50.946202 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:58:50.947088 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 23 20:58:50.947088 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 23 20:58:50.947088 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:58:50.947088 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 20:58:50.950205 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 515/1018] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 23 20:58:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:58:50.952266 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ad4fbe-4417-4590-be14-578c04657bee None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:51.063206 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ad4fbe-4417-4590-be14-578c04657bee None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:51.064873 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:51.074357 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fab36d5-0431-43f9-8477-97d1b7326cb6 None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:51.074670 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fab36d5-0431-43f9-8477-97d1b7326cb6 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:51.074883 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fab36d5-0431-43f9-8477-97d1b7326cb6 None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:51.076422 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 516/1019] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:58:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 23 20:58:51.081642 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e1bfb7-cdcf-4491-b03d-a34c8f87b788 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:51.081932 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e1bfb7-cdcf-4491-b03d-a34c8f87b788 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:51.082207 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e1bfb7-cdcf-4491-b03d-a34c8f87b788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:51.099077 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-81e1bfb7-cdcf-4491-b03d-a34c8f87b788 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:58:51.100249 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-81e1bfb7-cdcf-4491-b03d-a34c8f87b788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:58:51.101147 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bad89d5-2282-418a-bc42-0bac36c4f1b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:51.101819 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bad89d5-2282-418a-bc42-0bac36c4f1b0 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:51.102125 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bad89d5-2282-418a-bc42-0bac36c4f1b0 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:51.102396 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bad89d5-2282-418a-bc42-0bac36c4f1b0 None admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:51.103114 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bad89d5-2282-418a-bc42-0bac36c4f1b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:51.103417 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bad89d5-2282-418a-bc42-0bac36c4f1b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:51.104792 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bad89d5-2282-418a-bc42-0bac36c4f1b0 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:51.116966 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 504/1020] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 23 20:58:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:58:51.122539 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bad89d5-2282-418a-bc42-0bac36c4f1b0 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:51.171037 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 517/1021] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:58:51 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 23 20:58:51.195047 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e1bfb7-cdcf-4491-b03d-a34c8f87b788 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:51.237205 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bad89d5-2282-418a-bc42-0bac36c4f1b0 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:51.280623 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820e340d-43d0-4ff0-8b6d-8d7b08e3aef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:51.281463 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820e340d-43d0-4ff0-8b6d-8d7b08e3aef9 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:51.281741 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820e340d-43d0-4ff0-8b6d-8d7b08e3aef9 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:51.282052 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820e340d-43d0-4ff0-8b6d-8d7b08e3aef9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:51.290804 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820e340d-43d0-4ff0-8b6d-8d7b08e3aef9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:51.292295 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820e340d-43d0-4ff0-8b6d-8d7b08e3aef9 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:51.308303 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-820e340d-43d0-4ff0-8b6d-8d7b08e3aef9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 23 20:58:51.308303 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:58:51.308303 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:58:51.308303 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:58:51.308303 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:58:51.308303 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:58:51.308303 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:58:51.308303 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:58:51.308303 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:58:51.308303 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:58:51.308303 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:58:51.308303 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:58:51.308303 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 23 20:58:51.308303 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 23 20:58:51.308303 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 23 20:58:51.308303 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 23 20:58:51.309336 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:58:51.309336 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:58:51.309336 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 23 20:58:51.309336 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 23 20:58:51.309336 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 23 20:58:51.309336 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 23 20:58:51.309336 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:58:51.309336 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:58:51.309336 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:58:51.309336 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:58:51.309336 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:58:51.309336 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application with Lock( Jul 23 20:58:51.309336 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:58:51.309336 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:58:51.309336 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:58:51.309336 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:58:51.309336 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:58:51.309336 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:58:51.310472 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:58:51.310472 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:58:51.310472 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 23 20:58:51.310472 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 23 20:58:51.310472 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 23 20:58:51.310472 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 23 20:58:51.310472 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 23 20:58:51.310472 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 23 20:58:51.310472 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 23 20:58:51.310472 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:58:51.310472 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 505/1022] 10.222.0.17 () {56 vars in 1093 bytes} [Sat Jul 23 20:58:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 23 20:58:51.315415 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820e340d-43d0-4ff0-8b6d-8d7b08e3aef9 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:51.316010 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e1bfb7-cdcf-4491-b03d-a34c8f87b788 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:51.331402 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:51.341589 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:51.358481 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c6afb7-6192-48aa-a7e9-028b7b273910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:51.359158 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c6afb7-6192-48aa-a7e9-028b7b273910 None admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:51.359434 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c6afb7-6192-48aa-a7e9-028b7b273910 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:51.360046 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c6afb7-6192-48aa-a7e9-028b7b273910 None admin] PATH_INFO: `/v3/services` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:51.360774 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c6afb7-6192-48aa-a7e9-028b7b273910 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:51.362560 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c6afb7-6192-48aa-a7e9-028b7b273910 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:51.381938 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 518/1023] 10.222.0.17 () {60 vars in 1141 bytes} [Sat Jul 23 20:58:51 2022] POST /identity/v3/services => generated 242 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 20:58:51.436557 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820e340d-43d0-4ff0-8b6d-8d7b08e3aef9 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:51.441636 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80615aff-efc3-4e93-844d-c92dd94d8401 None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:51.441959 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80615aff-efc3-4e93-844d-c92dd94d8401 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:51.442245 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80615aff-efc3-4e93-844d-c92dd94d8401 None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:51.444020 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 519/1024] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:58:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 23 20:58:51.450466 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9243fd77-870e-4288-8d3c-fafdf08b231d None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:51.450759 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9243fd77-870e-4288-8d3c-fafdf08b231d None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:51.451485 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9243fd77-870e-4288-8d3c-fafdf08b231d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:51.474370 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-9243fd77-870e-4288-8d3c-fafdf08b231d None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:58:51.475611 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-9243fd77-870e-4288-8d3c-fafdf08b231d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:58:51.484805 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc093b3-f464-4f92-a45e-8748f47b8d06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:51.485500 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc093b3-f464-4f92-a45e-8748f47b8d06 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:51.485783 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc093b3-f464-4f92-a45e-8748f47b8d06 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:51.486091 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc093b3-f464-4f92-a45e-8748f47b8d06 None admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:51.486932 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc093b3-f464-4f92-a45e-8748f47b8d06 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:51.487276 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc093b3-f464-4f92-a45e-8748f47b8d06 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:51.488781 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc093b3-f464-4f92-a45e-8748f47b8d06 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:51.508953 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 506/1025] 10.222.0.17 () {56 vars in 1133 bytes} [Sat Jul 23 20:58:51 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 20:58:51.514861 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc093b3-f464-4f92-a45e-8748f47b8d06 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:51.559241 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 520/1026] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:58:51 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 23 20:58:51.584642 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9243fd77-870e-4288-8d3c-fafdf08b231d None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:51.596683 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:51.629906 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc093b3-f464-4f92-a45e-8748f47b8d06 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:51.661189 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8f5585-d2ad-4534-b887-56003365d04d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:51.661849 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8f5585-d2ad-4534-b887-56003365d04d None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:51.662567 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8f5585-d2ad-4534-b887-56003365d04d None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:51.662567 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8f5585-d2ad-4534-b887-56003365d04d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:51.697879 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9243fd77-870e-4288-8d3c-fafdf08b231d None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:51.702002 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:51.736082 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8f5585-d2ad-4534-b887-56003365d04d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:51.737978 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8f5585-d2ad-4534-b887-56003365d04d None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:51.740535 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2c3d7a-25bf-4109-943b-f2db377e0ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:51.741403 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2c3d7a-25bf-4109-943b-f2db377e0ed2 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:51.741687 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2c3d7a-25bf-4109-943b-f2db377e0ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:51.741992 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2c3d7a-25bf-4109-943b-f2db377e0ed2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:51.743195 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2c3d7a-25bf-4109-943b-f2db377e0ed2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:51.744644 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2c3d7a-25bf-4109-943b-f2db377e0ed2 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:51.746319 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 521/1027] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 23 20:58:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:58:51.752572 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2c3d7a-25bf-4109-943b-f2db377e0ed2 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:51.827790 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:51.852804 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 507/1028] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Jul 23 20:58:51 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 23 20:58:51.859048 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8f5585-d2ad-4534-b887-56003365d04d None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:51.871336 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2c3d7a-25bf-4109-943b-f2db377e0ed2 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:51.910673 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44cc192-4dab-4010-9efb-84a58df9dc9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:51.911350 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44cc192-4dab-4010-9efb-84a58df9dc9e None admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:51.911625 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44cc192-4dab-4010-9efb-84a58df9dc9e None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:51.911896 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44cc192-4dab-4010-9efb-84a58df9dc9e None admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:51.912608 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44cc192-4dab-4010-9efb-84a58df9dc9e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:51.914064 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44cc192-4dab-4010-9efb-84a58df9dc9e None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:51.943968 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 522/1029] 10.222.0.17 () {60 vars in 1141 bytes} [Sat Jul 23 20:58:51 2022] POST /identity/v3/projects => generated 311 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 20:58:51.982649 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8f5585-d2ad-4534-b887-56003365d04d None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:52.021636 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed4f15a-257f-4404-a743-913c1472d6bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:52.022511 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed4f15a-257f-4404-a743-913c1472d6bc None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:52.022859 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed4f15a-257f-4404-a743-913c1472d6bc None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:52.023115 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed4f15a-257f-4404-a743-913c1472d6bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:52.035463 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed4f15a-257f-4404-a743-913c1472d6bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:52.036956 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed4f15a-257f-4404-a743-913c1472d6bc None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:52.056425 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-8ed4f15a-257f-4404-a743-913c1472d6bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:58:52.056425 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:58:52.056425 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:58:52.056425 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:58:52.056425 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:58:52.056425 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:58:52.056425 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:58:52.056425 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:58:52.056425 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:58:52.056425 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:58:52.056425 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:58:52.056425 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:58:52.056425 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 23 20:58:52.056425 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 23 20:58:52.056425 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 23 20:58:52.057459 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 23 20:58:52.057459 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:58:52.057459 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:58:52.057459 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:58:52.057459 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:58:52.057459 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:58:52.057459 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:58:52.057459 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:58:52.057459 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application with Lock( Jul 23 20:58:52.057459 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:58:52.057459 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:58:52.057459 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:58:52.057459 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:58:52.057459 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:58:52.057459 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:58:52.057459 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:58:52.057459 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:58:52.058805 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 23 20:58:52.058805 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 23 20:58:52.058805 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:58:52.058805 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:58:52.062564 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 508/1030] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 23 20:58:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 23 20:58:52.063921 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44cc192-4dab-4010-9efb-84a58df9dc9e None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:52.095725 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:52.184096 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44cc192-4dab-4010-9efb-84a58df9dc9e None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:52.219673 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e608d889-da40-42b3-8c05-d7e5a89ad09b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:52.220355 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e608d889-da40-42b3-8c05-d7e5a89ad09b None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:52.220637 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e608d889-da40-42b3-8c05-d7e5a89ad09b None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:52.220906 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e608d889-da40-42b3-8c05-d7e5a89ad09b None admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:52.221673 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e608d889-da40-42b3-8c05-d7e5a89ad09b None admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:52.222015 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e608d889-da40-42b3-8c05-d7e5a89ad09b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:52.223395 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e608d889-da40-42b3-8c05-d7e5a89ad09b None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:52.235813 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 523/1031] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 23 20:58:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:58:52.241428 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed4f15a-257f-4404-a743-913c1472d6bc None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:52.276798 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:52.351430 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed4f15a-257f-4404-a743-913c1472d6bc None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:52.386180 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78d906c-dc74-4b12-a274-1d34c4bc52b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:52.386986 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78d906c-dc74-4b12-a274-1d34c4bc52b7 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:52.387263 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78d906c-dc74-4b12-a274-1d34c4bc52b7 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:52.387534 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78d906c-dc74-4b12-a274-1d34c4bc52b7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:52.394704 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78d906c-dc74-4b12-a274-1d34c4bc52b7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:52.396150 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78d906c-dc74-4b12-a274-1d34c4bc52b7 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:52.410393 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-a78d906c-dc74-4b12-a274-1d34c4bc52b7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 23 20:58:52.410393 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:58:52.410393 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:58:52.410393 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:58:52.410393 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:58:52.410393 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:58:52.410393 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:58:52.410393 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:58:52.410393 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:58:52.410393 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:58:52.410393 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:58:52.410393 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:58:52.410393 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 23 20:58:52.410393 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 23 20:58:52.410393 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 23 20:58:52.411284 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 23 20:58:52.411284 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:58:52.411284 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:58:52.411284 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:58:52.411284 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:58:52.411284 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:58:52.411284 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:58:52.411284 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:58:52.411284 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application with Lock( Jul 23 20:58:52.411284 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:58:52.411284 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:58:52.411284 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:58:52.411284 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:58:52.411284 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:58:52.411284 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:58:52.411284 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:58:52.411284 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:58:52.412168 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 23 20:58:52.412168 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 23 20:58:52.412168 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 23 20:58:52.412168 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 23 20:58:52.412168 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 23 20:58:52.412168 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 23 20:58:52.412168 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 23 20:58:52.412168 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:58:52.412168 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 509/1032] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Jul 23 20:58:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 23 20:58:52.418908 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e608d889-da40-42b3-8c05-d7e5a89ad09b None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:52.508769 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:52.525506 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e608d889-da40-42b3-8c05-d7e5a89ad09b None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:52.562724 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d7accc-fa54-43e6-931f-2f1061a3f21c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:52.563403 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d7accc-fa54-43e6-931f-2f1061a3f21c None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:52.563686 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d7accc-fa54-43e6-931f-2f1061a3f21c None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:52.563959 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d7accc-fa54-43e6-931f-2f1061a3f21c None admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:52.564747 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d7accc-fa54-43e6-931f-2f1061a3f21c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:52.565050 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d7accc-fa54-43e6-931f-2f1061a3f21c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:52.566667 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d7accc-fa54-43e6-931f-2f1061a3f21c None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:52.580383 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 524/1033] 10.222.0.17 () {56 vars in 1148 bytes} [Sat Jul 23 20:58:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:58:52.586758 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78d906c-dc74-4b12-a274-1d34c4bc52b7 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:52.681970 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:52.696032 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78d906c-dc74-4b12-a274-1d34c4bc52b7 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:52.731879 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b50fac-4f89-454a-a696-2cdd0e97e44a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:52.732547 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b50fac-4f89-454a-a696-2cdd0e97e44a None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:52.732822 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b50fac-4f89-454a-a696-2cdd0e97e44a None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:52.733094 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b50fac-4f89-454a-a696-2cdd0e97e44a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:52.733995 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b50fac-4f89-454a-a696-2cdd0e97e44a None admin] RBAC: Adding query filter params (role.id=3295256c44774d3ea100d28799b26fd9, scope.project.id=4804ed61295f4d4a92d9b685dd9e9f3b, user.id=079f31ed2c844e67bd4e206f24b69d97) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:52.734274 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b50fac-4f89-454a-a696-2cdd0e97e44a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:52.735727 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b50fac-4f89-454a-a696-2cdd0e97e44a None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:52.741549 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 510/1034] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Jul 23 20:58:52 2022] GET /identity/v3/role_assignments?user.id=079f31ed2c844e67bd4e206f24b69d97&scope.project.id=4804ed61295f4d4a92d9b685dd9e9f3b&role.id=3295256c44774d3ea100d28799b26fd9 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:58:53.689733 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be0f4be-7c6e-4ac9-b994-b2a9e04c09d5 None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:53.690456 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be0f4be-7c6e-4ac9-b994-b2a9e04c09d5 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:53.690456 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be0f4be-7c6e-4ac9-b994-b2a9e04c09d5 None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:53.693903 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 525/1035] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:58:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:58:53.697225 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac025889-2611-467d-9e0d-cde6e4f1728b None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:53.697659 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac025889-2611-467d-9e0d-cde6e4f1728b None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:53.697837 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac025889-2611-467d-9e0d-cde6e4f1728b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:53.715797 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-ac025889-2611-467d-9e0d-cde6e4f1728b None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:58:53.716988 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-ac025889-2611-467d-9e0d-cde6e4f1728b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:58:53.792401 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 511/1036] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:58:53 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 23 20:58:53.816948 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be0f4be-7c6e-4ac9-b994-b2a9e04c09d5 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:53.930416 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be0f4be-7c6e-4ac9-b994-b2a9e04c09d5 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:53.966118 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda8c663-debc-4404-b343-912c8416aea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:53.966864 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda8c663-debc-4404-b343-912c8416aea9 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:53.967147 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda8c663-debc-4404-b343-912c8416aea9 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:53.967419 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda8c663-debc-4404-b343-912c8416aea9 None admin] PATH_INFO: `/v3/services/image` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:53.968129 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda8c663-debc-4404-b343-912c8416aea9 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:53.969453 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda8c663-debc-4404-b343-912c8416aea9 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:53.981756 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-bda8c663-debc-4404-b343-912c8416aea9 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 23 20:58:53.981756 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:58:53.981756 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 23 20:58:53.981756 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 23 20:58:53.981756 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 23 20:58:53.981756 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 23 20:58:53.981756 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 23 20:58:53.981756 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 23 20:58:53.981756 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 23 20:58:53.981756 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 20:58:53.981756 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 23 20:58:53.981756 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 20:58:53.981756 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:58:53.981756 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:58:53.981756 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:58:53.981756 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:58:53.981756 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:58:53.982872 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:58:53.982872 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:58:53.982872 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:58:53.982872 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:58:53.982872 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:58:53.982872 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:58:53.982872 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 23 20:58:53.982872 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 23 20:58:53.982872 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 23 20:58:53.982872 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 23 20:58:53.982872 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:58:53.982872 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:58:53.982872 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:58:53.982872 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:58:53.982872 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:58:53.982872 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:58:53.983790 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:58:53.983790 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application with Lock( Jul 23 20:58:53.983790 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:58:53.983790 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:58:53.983790 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:58:53.983790 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:58:53.983790 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:58:53.983790 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:58:53.983790 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:58:53.983790 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:58:53.983790 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 23 20:58:53.983790 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 23 20:58:53.983790 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 23 20:58:53.983790 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 20:58:53.986279 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 526/1037] 10.222.0.17 () {56 vars in 1105 bytes} [Sat Jul 23 20:58:53 2022] GET /identity/v3/services/image => generated 86 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:58:53.989332 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac025889-2611-467d-9e0d-cde6e4f1728b None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:54.076951 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:54.101556 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac025889-2611-467d-9e0d-cde6e4f1728b None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:54.136817 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db326c88-ddaa-453f-9d0a-6de60d9475fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:54.137516 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db326c88-ddaa-453f-9d0a-6de60d9475fd None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:54.137796 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db326c88-ddaa-453f-9d0a-6de60d9475fd None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:54.138117 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db326c88-ddaa-453f-9d0a-6de60d9475fd None admin] PATH_INFO: `/v3/services` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:54.138826 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db326c88-ddaa-453f-9d0a-6de60d9475fd None admin] RBAC: Adding query filter params (name=image) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:54.139132 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db326c88-ddaa-453f-9d0a-6de60d9475fd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:54.140512 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db326c88-ddaa-453f-9d0a-6de60d9475fd None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:54.145782 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 512/1038] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 23 20:58:53 2022] GET /identity/v3/services?name=image => generated 122 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:58:54.151648 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda8c663-debc-4404-b343-912c8416aea9 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:54.163852 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:54.237650 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dacdb1-bddf-41f6-8541-bd8eb5f3ff38 None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:54.237873 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dacdb1-bddf-41f6-8541-bd8eb5f3ff38 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:54.238157 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dacdb1-bddf-41f6-8541-bd8eb5f3ff38 None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:54.239741 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 513/1039] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:58:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 23 20:58:54.244988 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83540816-2a1e-4cd2-ac6d-ca3b4d4b5b42 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:54.245253 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83540816-2a1e-4cd2-ac6d-ca3b4d4b5b42 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:54.245535 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83540816-2a1e-4cd2-ac6d-ca3b4d4b5b42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:54.260077 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda8c663-debc-4404-b343-912c8416aea9 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:54.262272 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-83540816-2a1e-4cd2-ac6d-ca3b4d4b5b42 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:58:54.263467 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-83540816-2a1e-4cd2-ac6d-ca3b4d4b5b42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:58:54.301420 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda6930c-7b80-46f4-b054-737c9ad529bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:54.302261 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda6930c-7b80-46f4-b054-737c9ad529bf None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:54.302533 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda6930c-7b80-46f4-b054-737c9ad529bf None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:54.302818 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda6930c-7b80-46f4-b054-737c9ad529bf None admin] PATH_INFO: `/v3/services` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:54.303532 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda6930c-7b80-46f4-b054-737c9ad529bf None admin] RBAC: Adding query filter params (type=image) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:54.303856 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda6930c-7b80-46f4-b054-737c9ad529bf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:54.305209 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda6930c-7b80-46f4-b054-737c9ad529bf None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:54.310372 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 527/1040] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 23 20:58:54 2022] GET /identity/v3/services?type=image => generated 350 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:58:54.316352 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda6930c-7b80-46f4-b054-737c9ad529bf None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:54.341503 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 514/1041] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:58:54 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 23 20:58:54.367854 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83540816-2a1e-4cd2-ac6d-ca3b4d4b5b42 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:54.403213 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:54.441050 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda6930c-7b80-46f4-b054-737c9ad529bf None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:54.454691 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:54.476731 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c08d0a9-2e1f-4536-9e29-d39054189206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:54.477753 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c08d0a9-2e1f-4536-9e29-d39054189206 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:54.478217 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c08d0a9-2e1f-4536-9e29-d39054189206 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:54.478492 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c08d0a9-2e1f-4536-9e29-d39054189206 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:54.479288 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c08d0a9-2e1f-4536-9e29-d39054189206 None admin] RBAC: Adding query filter params (interface=public, service_id=c32e137ff59946b48ef0387c62c4cea3, region_id=RegionOne) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:54.479599 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c08d0a9-2e1f-4536-9e29-d39054189206 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:54.479709 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83540816-2a1e-4cd2-ac6d-ca3b4d4b5b42 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:54.480987 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c08d0a9-2e1f-4536-9e29-d39054189206 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:54.486929 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 528/1042] 10.222.0.17 () {56 vars in 1251 bytes} [Sat Jul 23 20:58:54 2022] GET /identity/v3/endpoints?service_id=c32e137ff59946b48ef0387c62c4cea3&interface=public®ion_id=RegionOne => generated 194 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 20:58:54.492529 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c08d0a9-2e1f-4536-9e29-d39054189206 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:54.515717 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0d2dc8-b677-4f64-be0c-ec26de2799ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:54.516532 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0d2dc8-b677-4f64-be0c-ec26de2799ac None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:54.516810 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0d2dc8-b677-4f64-be0c-ec26de2799ac None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:54.517096 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0d2dc8-b677-4f64-be0c-ec26de2799ac None admin] PATH_INFO: `/v3/domains/default` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:54.518278 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0d2dc8-b677-4f64-be0c-ec26de2799ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:54.520020 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0d2dc8-b677-4f64-be0c-ec26de2799ac None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:54.526796 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 515/1043] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 23 20:58:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:58:54.527557 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0d2dc8-b677-4f64-be0c-ec26de2799ac None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:54.604132 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c08d0a9-2e1f-4536-9e29-d39054189206 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:54.641493 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0d2dc8-b677-4f64-be0c-ec26de2799ac None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:54.642590 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719f1861-8627-42f4-8e80-92eff166bd68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:54.643272 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719f1861-8627-42f4-8e80-92eff166bd68 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:54.643629 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719f1861-8627-42f4-8e80-92eff166bd68 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:54.643907 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719f1861-8627-42f4-8e80-92eff166bd68 None admin] PATH_INFO: `/v3/services` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:54.644589 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719f1861-8627-42f4-8e80-92eff166bd68 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:54.646045 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719f1861-8627-42f4-8e80-92eff166bd68 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:54.648706 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:54.662844 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 529/1044] 10.222.0.17 () {56 vars in 1087 bytes} [Sat Jul 23 20:58:54 2022] GET /identity/v3/services => generated 1957 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 20:58:54.688941 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61496d1a-e7fe-426b-8879-f858723c7e89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:54.689643 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61496d1a-e7fe-426b-8879-f858723c7e89 None admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:54.690027 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61496d1a-e7fe-426b-8879-f858723c7e89 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:54.690219 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61496d1a-e7fe-426b-8879-f858723c7e89 None admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:54.691056 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61496d1a-e7fe-426b-8879-f858723c7e89 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:54.692526 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61496d1a-e7fe-426b-8879-f858723c7e89 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:54.710764 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:54.717097 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 516/1045] 10.222.0.17 () {60 vars in 1132 bytes} [Sat Jul 23 20:58:54 2022] POST /identity/v3/users => generated 285 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 20:58:55.006684 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43893ecc-720e-4269-a904-b97bcc187502 None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:55.007233 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43893ecc-720e-4269-a904-b97bcc187502 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:55.007233 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43893ecc-720e-4269-a904-b97bcc187502 None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:55.008748 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 530/1046] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:58:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:58:55.013990 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac45cece-d88b-4be9-8b9c-dd2a68e65448 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:55.014274 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac45cece-d88b-4be9-8b9c-dd2a68e65448 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:55.014545 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac45cece-d88b-4be9-8b9c-dd2a68e65448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:55.032158 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-ac45cece-d88b-4be9-8b9c-dd2a68e65448 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:58:55.033340 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-ac45cece-d88b-4be9-8b9c-dd2a68e65448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:58:55.105361 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 517/1047] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:58:55 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 23 20:58:55.129127 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43893ecc-720e-4269-a904-b97bcc187502 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:55.236761 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43893ecc-720e-4269-a904-b97bcc187502 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:55.273562 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de4cbf6-674a-4d70-a0ad-df0ab86cabb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:55.274751 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de4cbf6-674a-4d70-a0ad-df0ab86cabb0 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:55.275208 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de4cbf6-674a-4d70-a0ad-df0ab86cabb0 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:55.275678 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de4cbf6-674a-4d70-a0ad-df0ab86cabb0 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:55.287472 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de4cbf6-674a-4d70-a0ad-df0ab86cabb0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:58:55.295815 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-0de4cbf6-674a-4d70-a0ad-df0ab86cabb0 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 23 20:58:55.295815 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:58:55.295815 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:58:55.295815 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:58:55.295815 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:58:55.295815 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:58:55.295815 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:58:55.295815 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:58:55.295815 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:58:55.295815 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:58:55.295815 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:58:55.295815 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:58:55.295815 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:58:55.295815 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:58:55.295815 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:58:55.295815 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:58:55.306196 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:58:55.306196 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:58:55.306196 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:58:55.306196 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:58:55.306196 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:58:55.306196 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:58:55.306196 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:58:55.306196 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:58:55.306196 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:58:55.306196 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:58:55.306196 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:58:55.306196 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application with Lock( Jul 23 20:58:55.306196 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:58:55.306196 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:58:55.306196 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:58:55.306196 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:58:55.307206 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:58:55.307206 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:58:55.307206 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:58:55.307206 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:58:55.307206 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:58:55.307206 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:58:55.307206 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:58:55.307206 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:58:55.307206 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:58:55.307206 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:58:55.307206 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 23 20:58:55.307206 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 20:58:55.307206 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 531/1048] 10.222.0.17 () {56 vars in 1120 bytes} [Sat Jul 23 20:58:55 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:58:55.309633 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac45cece-d88b-4be9-8b9c-dd2a68e65448 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:55.413358 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac45cece-d88b-4be9-8b9c-dd2a68e65448 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:55.442062 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:55.448915 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8312aada-2c64-47f2-b638-daf8c42b8d6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:55.449592 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8312aada-2c64-47f2-b638-daf8c42b8d6a None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:55.449882 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8312aada-2c64-47f2-b638-daf8c42b8d6a None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:55.450172 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8312aada-2c64-47f2-b638-daf8c42b8d6a None admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:55.450915 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8312aada-2c64-47f2-b638-daf8c42b8d6a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:55.451211 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8312aada-2c64-47f2-b638-daf8c42b8d6a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:55.452586 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8312aada-2c64-47f2-b638-daf8c42b8d6a None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:55.461305 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 518/1049] 10.222.0.17 () {56 vars in 1115 bytes} [Sat Jul 23 20:58:55 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:58:55.466976 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de4cbf6-674a-4d70-a0ad-df0ab86cabb0 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:55.530730 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:55.574827 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de4cbf6-674a-4d70-a0ad-df0ab86cabb0 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:55.610244 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b121819-ab84-497d-abb9-6abbf302e28a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:55.611059 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b121819-ab84-497d-abb9-6abbf302e28a None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:55.611336 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b121819-ab84-497d-abb9-6abbf302e28a None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:55.611592 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b121819-ab84-497d-abb9-6abbf302e28a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:55.622298 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b121819-ab84-497d-abb9-6abbf302e28a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:55.623752 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b121819-ab84-497d-abb9-6abbf302e28a None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:55.641002 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-9b121819-ab84-497d-abb9-6abbf302e28a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:58:55.641002 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:58:55.641002 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:58:55.641002 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:58:55.641002 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:58:55.641002 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:58:55.641002 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:58:55.641002 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:58:55.641002 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:58:55.641002 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:58:55.641002 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:58:55.641002 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:58:55.641002 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 23 20:58:55.641002 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 23 20:58:55.641002 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 23 20:58:55.642201 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 23 20:58:55.642201 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:58:55.642201 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:58:55.642201 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:58:55.642201 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:58:55.642201 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:58:55.642201 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:58:55.642201 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:58:55.642201 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application with Lock( Jul 23 20:58:55.642201 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:58:55.642201 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:58:55.642201 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:58:55.642201 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:58:55.642201 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:58:55.642201 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:58:55.642201 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:58:55.642201 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:58:55.643187 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 23 20:58:55.643187 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 23 20:58:55.643187 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:58:55.643187 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 20:58:55.643187 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 532/1050] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 23 20:58:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:58:55.649569 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8312aada-2c64-47f2-b638-daf8c42b8d6a None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:55.753667 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8312aada-2c64-47f2-b638-daf8c42b8d6a None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:55.790748 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed19727f-d42c-43cb-a5f2-3ea2a8a4c55d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:55.791783 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed19727f-d42c-43cb-a5f2-3ea2a8a4c55d None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:55.792267 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed19727f-d42c-43cb-a5f2-3ea2a8a4c55d None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:55.792743 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed19727f-d42c-43cb-a5f2-3ea2a8a4c55d None admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:55.793676 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed19727f-d42c-43cb-a5f2-3ea2a8a4c55d None admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:55.794230 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed19727f-d42c-43cb-a5f2-3ea2a8a4c55d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:55.795794 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed19727f-d42c-43cb-a5f2-3ea2a8a4c55d None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:55.815277 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 519/1051] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 23 20:58:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:58:55.816398 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b121819-ab84-497d-abb9-6abbf302e28a None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:55.930663 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b121819-ab84-497d-abb9-6abbf302e28a None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:55.945709 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:55.969378 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2a10c6-e4b2-48d5-8987-80b71b52aa51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:55.970228 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2a10c6-e4b2-48d5-8987-80b71b52aa51 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:55.970510 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2a10c6-e4b2-48d5-8987-80b71b52aa51 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:55.970790 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2a10c6-e4b2-48d5-8987-80b71b52aa51 None admin] PATH_INFO: `/v3/users/nova` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:55.979055 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2a10c6-e4b2-48d5-8987-80b71b52aa51 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:55.980510 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2a10c6-e4b2-48d5-8987-80b71b52aa51 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:55.994946 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-6f2a10c6-e4b2-48d5-8987-80b71b52aa51 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 23 20:58:55.994946 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:58:55.994946 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:58:55.994946 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:58:55.994946 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:58:55.994946 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:58:55.994946 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:58:55.994946 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:58:55.994946 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:58:55.994946 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:58:55.994946 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:58:55.994946 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:58:55.994946 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 23 20:58:55.994946 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 23 20:58:55.994946 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 23 20:58:55.994946 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 23 20:58:55.995907 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:58:55.995907 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:58:55.995907 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 23 20:58:55.995907 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 23 20:58:55.995907 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 23 20:58:55.995907 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 23 20:58:55.995907 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:58:55.995907 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:58:55.995907 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:58:55.995907 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:58:55.995907 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:58:55.995907 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application with Lock( Jul 23 20:58:55.995907 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:58:55.995907 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:58:55.995907 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:58:55.995907 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:58:55.995907 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:58:55.995907 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:58:55.996930 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:58:55.996930 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:58:55.996930 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 23 20:58:55.996930 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 23 20:58:55.996930 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 23 20:58:55.996930 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 23 20:58:55.996930 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 23 20:58:55.996930 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 23 20:58:55.996930 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 23 20:58:55.996930 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 20:58:55.996930 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 533/1052] 10.222.0.17 () {56 vars in 1093 bytes} [Sat Jul 23 20:58:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:58:56.003170 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed19727f-d42c-43cb-a5f2-3ea2a8a4c55d None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:56.058823 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:56.109008 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed19727f-d42c-43cb-a5f2-3ea2a8a4c55d None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:56.142979 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d565ea5d-0a69-434e-8124-c5f0c1737080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:56.143755 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d565ea5d-0a69-434e-8124-c5f0c1737080 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:56.144028 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d565ea5d-0a69-434e-8124-c5f0c1737080 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:56.144293 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d565ea5d-0a69-434e-8124-c5f0c1737080 None admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:56.145113 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d565ea5d-0a69-434e-8124-c5f0c1737080 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:56.145411 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d565ea5d-0a69-434e-8124-c5f0c1737080 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:56.146864 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d565ea5d-0a69-434e-8124-c5f0c1737080 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:56.164265 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 520/1053] 10.222.0.17 () {56 vars in 1133 bytes} [Sat Jul 23 20:58:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 20:58:56.170702 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2a10c6-e4b2-48d5-8987-80b71b52aa51 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:56.286011 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2a10c6-e4b2-48d5-8987-80b71b52aa51 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:56.325924 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f30df38-1a55-4def-8aa8-1db9a7bc50fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:56.326649 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f30df38-1a55-4def-8aa8-1db9a7bc50fe None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:56.326929 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f30df38-1a55-4def-8aa8-1db9a7bc50fe None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:56.327199 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f30df38-1a55-4def-8aa8-1db9a7bc50fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:56.338470 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f30df38-1a55-4def-8aa8-1db9a7bc50fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:56.339977 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f30df38-1a55-4def-8aa8-1db9a7bc50fe None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:56.357795 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-9f30df38-1a55-4def-8aa8-1db9a7bc50fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:58:56.357795 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:58:56.357795 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:58:56.357795 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:58:56.357795 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:58:56.357795 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:58:56.357795 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:58:56.357795 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:58:56.357795 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:58:56.357795 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:58:56.357795 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:58:56.357795 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:58:56.357795 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 23 20:58:56.357795 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 23 20:58:56.357795 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 23 20:58:56.358891 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 23 20:58:56.358891 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:58:56.358891 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:58:56.358891 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:58:56.358891 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:58:56.358891 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:58:56.358891 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:58:56.358891 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:58:56.358891 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application with Lock( Jul 23 20:58:56.358891 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:58:56.358891 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:58:56.358891 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:58:56.358891 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:58:56.358891 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:58:56.358891 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:58:56.358891 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:58:56.358891 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:58:56.359798 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 23 20:58:56.359798 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 23 20:58:56.359798 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:58:56.359798 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 20:58:56.359798 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 534/1054] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 23 20:58:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:58:56.367063 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d565ea5d-0a69-434e-8124-c5f0c1737080 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:56.474886 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d565ea5d-0a69-434e-8124-c5f0c1737080 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:56.485889 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:56.511539 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ec1ee2-4054-47b8-9b46-c8297fc90a6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:56.512219 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ec1ee2-4054-47b8-9b46-c8297fc90a6e None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:56.512496 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ec1ee2-4054-47b8-9b46-c8297fc90a6e None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:56.512770 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ec1ee2-4054-47b8-9b46-c8297fc90a6e None admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:56.513496 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ec1ee2-4054-47b8-9b46-c8297fc90a6e None admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:56.513799 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ec1ee2-4054-47b8-9b46-c8297fc90a6e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:56.515215 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ec1ee2-4054-47b8-9b46-c8297fc90a6e None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:56.527411 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 521/1055] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 23 20:58:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:58:56.533367 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f30df38-1a55-4def-8aa8-1db9a7bc50fe None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:56.563072 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:56.644590 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f30df38-1a55-4def-8aa8-1db9a7bc50fe None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:56.680304 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc79c9be-7420-4a86-8c72-fcd5a846c974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:56.681131 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc79c9be-7420-4a86-8c72-fcd5a846c974 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:56.681449 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc79c9be-7420-4a86-8c72-fcd5a846c974 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:56.681725 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc79c9be-7420-4a86-8c72-fcd5a846c974 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:56.688674 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc79c9be-7420-4a86-8c72-fcd5a846c974 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:56.690164 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc79c9be-7420-4a86-8c72-fcd5a846c974 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:56.705239 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-cc79c9be-7420-4a86-8c72-fcd5a846c974 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 23 20:58:56.705239 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:58:56.705239 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:58:56.705239 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:58:56.705239 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:58:56.705239 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:58:56.705239 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:58:56.705239 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:58:56.705239 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:58:56.705239 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:58:56.705239 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:58:56.705239 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:58:56.705239 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 23 20:58:56.705239 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 23 20:58:56.705239 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 23 20:58:56.706557 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 23 20:58:56.706557 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:58:56.706557 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:58:56.706557 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:58:56.706557 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:58:56.706557 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:58:56.706557 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:58:56.706557 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:58:56.706557 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application with Lock( Jul 23 20:58:56.706557 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:58:56.706557 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:58:56.706557 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:58:56.706557 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:58:56.706557 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:58:56.706557 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:58:56.706557 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:58:56.706557 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:58:56.707617 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 23 20:58:56.707617 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 23 20:58:56.707617 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 23 20:58:56.707617 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 23 20:58:56.707617 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 23 20:58:56.707617 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 23 20:58:56.707617 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 23 20:58:56.707617 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 20:58:56.707617 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 535/1056] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Jul 23 20:58:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:58:56.714574 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ec1ee2-4054-47b8-9b46-c8297fc90a6e None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:56.832571 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ec1ee2-4054-47b8-9b46-c8297fc90a6e None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:56.866335 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42464c6f-6de7-4524-bf6b-d814fb72bb30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:56.867002 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42464c6f-6de7-4524-bf6b-d814fb72bb30 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:56.867280 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42464c6f-6de7-4524-bf6b-d814fb72bb30 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:56.867541 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42464c6f-6de7-4524-bf6b-d814fb72bb30 None admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:56.868325 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42464c6f-6de7-4524-bf6b-d814fb72bb30 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:56.868618 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42464c6f-6de7-4524-bf6b-d814fb72bb30 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:56.870064 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42464c6f-6de7-4524-bf6b-d814fb72bb30 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:56.882650 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 522/1057] 10.222.0.17 () {56 vars in 1148 bytes} [Sat Jul 23 20:58:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:58:56.888594 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc79c9be-7420-4a86-8c72-fcd5a846c974 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:56.937310 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144405ab-38ab-4997-b97c-9df2cb6f7117 None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:56.937511 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144405ab-38ab-4997-b97c-9df2cb6f7117 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:56.937931 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144405ab-38ab-4997-b97c-9df2cb6f7117 None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:56.939723 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 523/1058] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:58:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:58:56.944800 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310e223c-55e0-4b34-9ff3-2970ebab3848 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:56.945077 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310e223c-55e0-4b34-9ff3-2970ebab3848 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:56.945350 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310e223c-55e0-4b34-9ff3-2970ebab3848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:56.961680 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-310e223c-55e0-4b34-9ff3-2970ebab3848 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:58:56.962884 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-310e223c-55e0-4b34-9ff3-2970ebab3848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:58:56.985194 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:56.990214 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:57.005516 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc79c9be-7420-4a86-8c72-fcd5a846c974 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:57.038977 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 524/1059] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:58:56 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 23 20:58:57.044375 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3bd865-3221-47a9-abd8-ee1455c5a6a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:57.045282 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3bd865-3221-47a9-abd8-ee1455c5a6a4 None admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:57.045556 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3bd865-3221-47a9-abd8-ee1455c5a6a4 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:57.045822 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3bd865-3221-47a9-abd8-ee1455c5a6a4 None admin] PATH_INFO: `/v3/projects/4804ed61295f4d4a92d9b685dd9e9f3b/users/079f31ed2c844e67bd4e206f24b69d97/roles/3295256c44774d3ea100d28799b26fd9` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:57.047982 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3bd865-3221-47a9-abd8-ee1455c5a6a4 None admin] RBAC: Authorizing `identity:create_grant(project_id=4804ed61295f4d4a92d9b685dd9e9f3b, user_id=079f31ed2c844e67bd4e206f24b69d97, role_id=3295256c44774d3ea100d28799b26fd9)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:57.049417 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3bd865-3221-47a9-abd8-ee1455c5a6a4 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:57.063987 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 536/1060] 10.222.0.17 () {58 vars in 1439 bytes} [Sat Jul 23 20:58:56 2022] PUT /identity/v3/projects/4804ed61295f4d4a92d9b685dd9e9f3b/users/079f31ed2c844e67bd4e206f24b69d97/roles/3295256c44774d3ea100d28799b26fd9 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 20:58:57.067340 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310e223c-55e0-4b34-9ff3-2970ebab3848 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:57.068695 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12fe88b-7571-4d22-a2a4-358131d4f539 None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:57.068988 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12fe88b-7571-4d22-a2a4-358131d4f539 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:57.069265 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12fe88b-7571-4d22-a2a4-358131d4f539 None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:57.070889 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 537/1061] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:58:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:58:57.076616 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9868e3-6c8b-451f-984e-b79a648e367f None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:57.076925 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9868e3-6c8b-451f-984e-b79a648e367f None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:57.077169 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9868e3-6c8b-451f-984e-b79a648e367f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:57.095141 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-5d9868e3-6c8b-451f-984e-b79a648e367f None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:58:57.096529 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-5d9868e3-6c8b-451f-984e-b79a648e367f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:58:57.176783 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 538/1062] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:58:57 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 23 20:58:57.189924 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310e223c-55e0-4b34-9ff3-2970ebab3848 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:57.202289 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9868e3-6c8b-451f-984e-b79a648e367f None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:57.227981 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c7476b-c08b-4550-805e-54c2e814bc6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:57.228822 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c7476b-c08b-4550-805e-54c2e814bc6d None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:57.229110 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c7476b-c08b-4550-805e-54c2e814bc6d None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:57.229426 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c7476b-c08b-4550-805e-54c2e814bc6d None admin] PATH_INFO: `/v3/services/image` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:57.230124 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c7476b-c08b-4550-805e-54c2e814bc6d None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:57.231545 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c7476b-c08b-4550-805e-54c2e814bc6d None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:57.244733 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-06c7476b-c08b-4550-805e-54c2e814bc6d None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 23 20:58:57.244733 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:58:57.244733 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 23 20:58:57.244733 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 23 20:58:57.244733 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 23 20:58:57.244733 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 23 20:58:57.244733 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 23 20:58:57.244733 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 23 20:58:57.244733 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 23 20:58:57.244733 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:58:57.244733 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 23 20:58:57.244733 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:58:57.244733 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:58:57.244733 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:58:57.244733 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:58:57.244733 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:58:57.244733 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:58:57.245805 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:58:57.245805 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:58:57.245805 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:58:57.245805 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:58:57.245805 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:58:57.245805 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:58:57.245805 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 23 20:58:57.245805 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 23 20:58:57.245805 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 23 20:58:57.245805 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 23 20:58:57.245805 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:58:57.245805 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:58:57.245805 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:58:57.245805 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:58:57.245805 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:58:57.245805 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:58:57.246711 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:58:57.246711 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application with Lock( Jul 23 20:58:57.246711 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:58:57.246711 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:58:57.246711 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:58:57.246711 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:58:57.246711 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:58:57.246711 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:58:57.246711 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:58:57.246711 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:58:57.246711 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 23 20:58:57.246711 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 23 20:58:57.246711 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 23 20:58:57.246711 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:58:57.249985 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 525/1063] 10.222.0.17 () {56 vars in 1105 bytes} [Sat Jul 23 20:58:57 2022] GET /identity/v3/services/image => generated 86 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 23 20:58:57.252359 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c7476b-c08b-4550-805e-54c2e814bc6d None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:57.280101 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:57.293163 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:57.326501 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9868e3-6c8b-451f-984e-b79a648e367f None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:57.363293 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979e9088-5cfc-4f81-b34c-cbbe71857b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:57.363684 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c7476b-c08b-4550-805e-54c2e814bc6d None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:57.364527 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979e9088-5cfc-4f81-b34c-cbbe71857b59 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:57.364980 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979e9088-5cfc-4f81-b34c-cbbe71857b59 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:57.365540 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979e9088-5cfc-4f81-b34c-cbbe71857b59 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:57.379966 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979e9088-5cfc-4f81-b34c-cbbe71857b59 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:58:57.398249 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-979e9088-5cfc-4f81-b34c-cbbe71857b59 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 23 20:58:57.398249 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:58:57.398249 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:58:57.398249 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:58:57.398249 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:58:57.398249 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:58:57.398249 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:58:57.398249 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:58:57.398249 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:58:57.398249 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:58:57.398249 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:58:57.398249 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:58:57.398249 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:58:57.398249 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:58:57.398249 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:58:57.398249 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:58:57.399403 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:58:57.399403 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:58:57.399403 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:58:57.399403 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:58:57.399403 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:58:57.399403 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:58:57.399403 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:58:57.399403 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:58:57.399403 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:58:57.399403 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:58:57.399403 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:58:57.399403 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application with Lock( Jul 23 20:58:57.399403 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:58:57.399403 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:58:57.399403 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:58:57.399403 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:58:57.400448 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:58:57.400448 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:58:57.400448 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:58:57.400448 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:58:57.400448 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:58:57.400448 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:58:57.400448 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:58:57.400448 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:58:57.400448 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:58:57.400448 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:58:57.400448 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 23 20:58:57.400448 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 20:58:57.401226 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0e24d2-88ec-4870-bc31-45ea46819c8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:57.401226 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0e24d2-88ec-4870-bc31-45ea46819c8c None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:57.401226 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0e24d2-88ec-4870-bc31-45ea46819c8c None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:57.401226 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0e24d2-88ec-4870-bc31-45ea46819c8c None admin] PATH_INFO: `/v3/services` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:57.401677 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0e24d2-88ec-4870-bc31-45ea46819c8c None admin] RBAC: Adding query filter params (name=image) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:57.402008 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0e24d2-88ec-4870-bc31-45ea46819c8c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:57.403721 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0e24d2-88ec-4870-bc31-45ea46819c8c None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:57.404031 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 539/1064] 10.222.0.17 () {56 vars in 1096 bytes} [Sat Jul 23 20:58:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:58:57.409466 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 526/1065] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 23 20:58:57 2022] GET /identity/v3/services?name=image => generated 122 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 20:58:57.410044 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979e9088-5cfc-4f81-b34c-cbbe71857b59 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:57.416197 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0e24d2-88ec-4870-bc31-45ea46819c8c None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:57.511440 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:57.520198 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979e9088-5cfc-4f81-b34c-cbbe71857b59 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:57.525945 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0e24d2-88ec-4870-bc31-45ea46819c8c None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:57.555827 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a2e646-e3d7-4fb6-a59b-6f927e6e1164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:57.556506 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a2e646-e3d7-4fb6-a59b-6f927e6e1164 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:57.556854 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a2e646-e3d7-4fb6-a59b-6f927e6e1164 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:57.557042 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a2e646-e3d7-4fb6-a59b-6f927e6e1164 None admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:57.557783 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a2e646-e3d7-4fb6-a59b-6f927e6e1164 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:57.558110 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a2e646-e3d7-4fb6-a59b-6f927e6e1164 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:57.559479 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a2e646-e3d7-4fb6-a59b-6f927e6e1164 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:57.561067 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:57.564439 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc07d045-7e23-434c-ab77-53ae9c501e0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:57.565154 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc07d045-7e23-434c-ab77-53ae9c501e0f None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:57.565466 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc07d045-7e23-434c-ab77-53ae9c501e0f None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:57.565746 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc07d045-7e23-434c-ab77-53ae9c501e0f None admin] PATH_INFO: `/v3/services` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:57.566484 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc07d045-7e23-434c-ab77-53ae9c501e0f None admin] RBAC: Adding query filter params (type=image) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:57.566789 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc07d045-7e23-434c-ab77-53ae9c501e0f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:57.568189 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc07d045-7e23-434c-ab77-53ae9c501e0f None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:57.570570 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 540/1066] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Jul 23 20:58:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:58:57.576274 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a2e646-e3d7-4fb6-a59b-6f927e6e1164 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:57.583564 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 527/1067] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 23 20:58:57 2022] GET /identity/v3/services?type=image => generated 350 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 20:58:57.584469 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc07d045-7e23-434c-ab77-53ae9c501e0f None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:57.685533 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a2e646-e3d7-4fb6-a59b-6f927e6e1164 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:57.694161 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc07d045-7e23-434c-ab77-53ae9c501e0f None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:57.720590 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b12001c-51ab-4a77-9e85-ded6ed6322f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:57.721551 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b12001c-51ab-4a77-9e85-ded6ed6322f0 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:57.721838 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b12001c-51ab-4a77-9e85-ded6ed6322f0 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:57.722143 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b12001c-51ab-4a77-9e85-ded6ed6322f0 None admin] PATH_INFO: `/v3/users/bd1d501f406f4bc4b52c1e73bbb41f74` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:57.732910 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def142a5-0ce8-4192-82ad-f9572f91b10d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:57.733685 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def142a5-0ce8-4192-82ad-f9572f91b10d None admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:57.734063 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def142a5-0ce8-4192-82ad-f9572f91b10d None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:57.734341 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def142a5-0ce8-4192-82ad-f9572f91b10d None admin] PATH_INFO: `/v3/endpoints` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:57.735080 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def142a5-0ce8-4192-82ad-f9572f91b10d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:57.736454 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def142a5-0ce8-4192-82ad-f9572f91b10d None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:57.740360 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b12001c-51ab-4a77-9e85-ded6ed6322f0 None admin] RBAC: Authorizing `identity:get_user(user_id=bd1d501f406f4bc4b52c1e73bbb41f74)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:57.741814 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b12001c-51ab-4a77-9e85-ded6ed6322f0 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:57.743608 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 541/1068] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Jul 23 20:58:57 2022] GET /identity/v3/users/bd1d501f406f4bc4b52c1e73bbb41f74 => generated 285 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 20:58:57.749298 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b12001c-51ab-4a77-9e85-ded6ed6322f0 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:57.760876 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 528/1069] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 23 20:58:57 2022] POST /identity/v3/endpoints => generated 327 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 20:58:57.829073 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:57.881494 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b12001c-51ab-4a77-9e85-ded6ed6322f0 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:57.927504 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e3a274-ad3a-48ac-bb67-e9703cfe6d8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:57.928178 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e3a274-ad3a-48ac-bb67-e9703cfe6d8d None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:57.928464 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e3a274-ad3a-48ac-bb67-e9703cfe6d8d None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:57.928735 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e3a274-ad3a-48ac-bb67-e9703cfe6d8d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:58.005582 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e3a274-ad3a-48ac-bb67-e9703cfe6d8d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:58.007102 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e3a274-ad3a-48ac-bb67-e9703cfe6d8d None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:58.075491 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:58.134742 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 542/1070] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Jul 23 20:58:57 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 23 20:58:58.136385 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def142a5-0ce8-4192-82ad-f9572f91b10d None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:58.148352 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:58.268859 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def142a5-0ce8-4192-82ad-f9572f91b10d None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:58.305974 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44307a68-e1a2-4fe2-a428-e6c49cb4b7d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:58.306862 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44307a68-e1a2-4fe2-a428-e6c49cb4b7d2 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:58.307138 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44307a68-e1a2-4fe2-a428-e6c49cb4b7d2 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:58.307407 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44307a68-e1a2-4fe2-a428-e6c49cb4b7d2 None admin] PATH_INFO: `/v3/projects/cf47095dfbdb4a5a9629d52ddc469806` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:58.308602 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44307a68-e1a2-4fe2-a428-e6c49cb4b7d2 None admin] RBAC: Authorizing `identity:get_project(project_id=cf47095dfbdb4a5a9629d52ddc469806)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:58.310107 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44307a68-e1a2-4fe2-a428-e6c49cb4b7d2 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:58.311993 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 529/1071] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Jul 23 20:58:58 2022] GET /identity/v3/projects/cf47095dfbdb4a5a9629d52ddc469806 => generated 311 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:58:58.318634 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e3a274-ad3a-48ac-bb67-e9703cfe6d8d None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:58.434118 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e3a274-ad3a-48ac-bb67-e9703cfe6d8d None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:58.474518 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e871c1c-01f1-4434-b3fb-c013b57610b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:58.475185 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e871c1c-01f1-4434-b3fb-c013b57610b8 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:58.475463 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e871c1c-01f1-4434-b3fb-c013b57610b8 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:58.475737 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e871c1c-01f1-4434-b3fb-c013b57610b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:58.476576 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e871c1c-01f1-4434-b3fb-c013b57610b8 None admin] RBAC: Adding query filter params (role.id=fec17bfdc65349a2b9c06a89131191df, scope.project.id=cf47095dfbdb4a5a9629d52ddc469806, user.id=bd1d501f406f4bc4b52c1e73bbb41f74) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:58.476886 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e871c1c-01f1-4434-b3fb-c013b57610b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:58.478383 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e871c1c-01f1-4434-b3fb-c013b57610b8 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:58.489960 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 543/1072] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Jul 23 20:58:58 2022] GET /identity/v3/role_assignments?user.id=bd1d501f406f4bc4b52c1e73bbb41f74&scope.project.id=cf47095dfbdb4a5a9629d52ddc469806&role.id=fec17bfdc65349a2b9c06a89131191df => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:58:59.313531 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d548084-3fef-4860-a01f-b9ce12c427d2 None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:59.314156 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d548084-3fef-4860-a01f-b9ce12c427d2 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:59.314156 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d548084-3fef-4860-a01f-b9ce12c427d2 None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:59.315755 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 530/1073] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:58:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:58:59.320955 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60d6f74-31b6-4640-86bf-7442246f6b5e None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:59.321406 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60d6f74-31b6-4640-86bf-7442246f6b5e None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:59.321486 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60d6f74-31b6-4640-86bf-7442246f6b5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:59.342693 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-c60d6f74-31b6-4640-86bf-7442246f6b5e None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:58:59.343888 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-c60d6f74-31b6-4640-86bf-7442246f6b5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:58:59.354208 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:59.416610 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 544/1074] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:58:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 23 20:58:59.441828 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d548084-3fef-4860-a01f-b9ce12c427d2 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:59.522862 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:59.548930 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d548084-3fef-4860-a01f-b9ce12c427d2 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:59.583708 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22317fc4-2e33-440c-83a8-c183fabed32a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:59.584524 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22317fc4-2e33-440c-83a8-c183fabed32a None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:59.584789 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22317fc4-2e33-440c-83a8-c183fabed32a None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:59.585055 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22317fc4-2e33-440c-83a8-c183fabed32a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:59.596818 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22317fc4-2e33-440c-83a8-c183fabed32a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:58:59.605702 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-22317fc4-2e33-440c-83a8-c183fabed32a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 23 20:58:59.605702 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:58:59.605702 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:58:59.605702 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:58:59.605702 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:58:59.605702 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:58:59.605702 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:58:59.605702 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:58:59.605702 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:58:59.605702 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:58:59.605702 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:58:59.605702 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:58:59.605702 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:58:59.605702 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:58:59.605702 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:58:59.605702 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:58:59.606957 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:58:59.606957 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:58:59.606957 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:58:59.606957 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:58:59.606957 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:58:59.606957 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:58:59.606957 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:58:59.606957 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:58:59.606957 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:58:59.606957 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:58:59.606957 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:58:59.606957 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application with Lock( Jul 23 20:58:59.606957 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:58:59.606957 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:58:59.606957 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:58:59.606957 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:58:59.613740 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:58:59.613740 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:58:59.613740 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:58:59.613740 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:58:59.613740 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:58:59.613740 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:58:59.613740 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:58:59.613740 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:58:59.613740 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:58:59.613740 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:58:59.613740 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 23 20:58:59.613740 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:58:59.613740 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 531/1075] 10.222.0.17 () {56 vars in 1120 bytes} [Sat Jul 23 20:58:59 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:58:59.614850 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60d6f74-31b6-4640-86bf-7442246f6b5e None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:59.721238 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60d6f74-31b6-4640-86bf-7442246f6b5e None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:59.758385 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fde79b-c726-41aa-b714-d0f7691e1516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:59.759030 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fde79b-c726-41aa-b714-d0f7691e1516 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:59.759354 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fde79b-c726-41aa-b714-d0f7691e1516 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:59.759630 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fde79b-c726-41aa-b714-d0f7691e1516 None admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:59.760371 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fde79b-c726-41aa-b714-d0f7691e1516 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:58:59.760670 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fde79b-c726-41aa-b714-d0f7691e1516 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:59.762079 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fde79b-c726-41aa-b714-d0f7691e1516 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:59.770812 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 545/1076] 10.222.0.17 () {56 vars in 1115 bytes} [Sat Jul 23 20:58:59 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:58:59.776557 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22317fc4-2e33-440c-83a8-c183fabed32a None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:59.892537 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22317fc4-2e33-440c-83a8-c183fabed32a None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:58:59.928840 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c1dc35-e88b-4194-9455-ab3830a1163c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:58:59.929651 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c1dc35-e88b-4194-9455-ab3830a1163c None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:58:59.929956 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c1dc35-e88b-4194-9455-ab3830a1163c None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:58:59.930230 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c1dc35-e88b-4194-9455-ab3830a1163c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:58:59.933059 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:58:59.941761 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c1dc35-e88b-4194-9455-ab3830a1163c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:58:59.943313 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c1dc35-e88b-4194-9455-ab3830a1163c None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:58:59.962079 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-50c1dc35-e88b-4194-9455-ab3830a1163c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:58:59.962079 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:58:59.962079 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:58:59.962079 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:58:59.962079 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:58:59.962079 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:58:59.962079 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:58:59.962079 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:58:59.962079 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:58:59.962079 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:58:59.962079 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:58:59.962079 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:58:59.962079 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 23 20:58:59.962079 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 23 20:58:59.962079 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 23 20:58:59.963007 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 23 20:58:59.963007 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:58:59.963007 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:58:59.963007 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:58:59.963007 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:58:59.963007 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:58:59.963007 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:58:59.963007 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:58:59.963007 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application with Lock( Jul 23 20:58:59.963007 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:58:59.963007 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:58:59.963007 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:58:59.963007 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:58:59.963007 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:58:59.963007 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:58:59.963007 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:58:59.963007 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:58:59.963961 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 23 20:58:59.963961 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 23 20:58:59.963961 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:58:59.963961 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:58:59.969533 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 532/1077] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 23 20:58:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:58:59.969702 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fde79b-c726-41aa-b714-d0f7691e1516 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:58:59.979417 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:59:00.033577 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0cf3e4-6147-4db2-82c5-3674f8e3635c None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:59:00.033832 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0cf3e4-6147-4db2-82c5-3674f8e3635c None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:59:00.034216 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0cf3e4-6147-4db2-82c5-3674f8e3635c None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:59:00.035727 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 533/1078] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:59:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 23 20:59:00.040624 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e225f682-0123-4f6a-9b66-3b262f55b908 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:59:00.040904 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e225f682-0123-4f6a-9b66-3b262f55b908 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:59:00.041178 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e225f682-0123-4f6a-9b66-3b262f55b908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:59:00.057735 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-e225f682-0123-4f6a-9b66-3b262f55b908 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:59:00.058940 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-e225f682-0123-4f6a-9b66-3b262f55b908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:59:00.086171 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fde79b-c726-41aa-b714-d0f7691e1516 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:59:00.125264 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e035c47-af83-4e71-a3e9-1c192305e8c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:59:00.125981 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e035c47-af83-4e71-a3e9-1c192305e8c7 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:59:00.126246 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e035c47-af83-4e71-a3e9-1c192305e8c7 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:59:00.126522 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e035c47-af83-4e71-a3e9-1c192305e8c7 None admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:59:00.127324 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e035c47-af83-4e71-a3e9-1c192305e8c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:59:00.127661 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e035c47-af83-4e71-a3e9-1c192305e8c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:59:00.129189 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e035c47-af83-4e71-a3e9-1c192305e8c7 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:59:00.136786 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 534/1079] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:59:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 23 20:59:00.147420 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 546/1080] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 23 20:58:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:59:00.151009 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e225f682-0123-4f6a-9b66-3b262f55b908 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:59:00.162469 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e035c47-af83-4e71-a3e9-1c192305e8c7 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:59:00.229765 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:59:00.264532 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e225f682-0123-4f6a-9b66-3b262f55b908 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:59:00.278995 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e035c47-af83-4e71-a3e9-1c192305e8c7 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:59:00.283735 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:59:00.301291 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dc4db0-f9c3-47c1-a92a-97bf47f8a5ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:59:00.302176 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dc4db0-f9c3-47c1-a92a-97bf47f8a5ac None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:59:00.302402 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dc4db0-f9c3-47c1-a92a-97bf47f8a5ac None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:59:00.302640 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dc4db0-f9c3-47c1-a92a-97bf47f8a5ac None admin] PATH_INFO: `/v3/users/nova` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:59:00.309966 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dc4db0-f9c3-47c1-a92a-97bf47f8a5ac None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:59:00.311470 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dc4db0-f9c3-47c1-a92a-97bf47f8a5ac None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:59:00.317333 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723d5fbe-3f4c-474f-9b66-a78b713f793a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:59:00.318029 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723d5fbe-3f4c-474f-9b66-a78b713f793a None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:59:00.318307 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723d5fbe-3f4c-474f-9b66-a78b713f793a None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:59:00.318572 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723d5fbe-3f4c-474f-9b66-a78b713f793a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:59:00.326102 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-f5dc4db0-f9c3-47c1-a92a-97bf47f8a5ac None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 23 20:59:00.326102 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:59:00.326102 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:59:00.326102 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:59:00.326102 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:59:00.326102 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:59:00.326102 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:59:00.326102 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:59:00.326102 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:59:00.326102 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:59:00.326102 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:59:00.326102 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:59:00.326102 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 23 20:59:00.326102 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 23 20:59:00.326102 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 23 20:59:00.326102 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 23 20:59:00.327380 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:59:00.327380 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:59:00.327380 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 23 20:59:00.327380 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 23 20:59:00.327380 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 23 20:59:00.327380 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 23 20:59:00.327380 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:59:00.327380 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:59:00.327380 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:59:00.327380 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:59:00.327380 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:59:00.327380 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application with Lock( Jul 23 20:59:00.327380 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:59:00.327380 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:59:00.327380 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:59:00.327380 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:59:00.327380 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:59:00.327380 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:59:00.328357 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:59:00.328357 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:59:00.328357 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 23 20:59:00.328357 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 23 20:59:00.328357 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 23 20:59:00.328357 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 23 20:59:00.328357 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 23 20:59:00.328357 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 23 20:59:00.328357 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 23 20:59:00.328357 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:59:00.332497 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 535/1081] 10.222.0.17 () {56 vars in 1093 bytes} [Sat Jul 23 20:59:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:59:00.333381 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dc4db0-f9c3-47c1-a92a-97bf47f8a5ac None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:59:00.400759 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723d5fbe-3f4c-474f-9b66-a78b713f793a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:59:00.402313 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723d5fbe-3f4c-474f-9b66-a78b713f793a None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:59:00.457989 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dc4db0-f9c3-47c1-a92a-97bf47f8a5ac None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:59:00.475999 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:59:00.495432 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62313863-4acb-49eb-bfc4-f8bf37c4642a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:59:00.496120 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62313863-4acb-49eb-bfc4-f8bf37c4642a None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:59:00.496465 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62313863-4acb-49eb-bfc4-f8bf37c4642a None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:59:00.496742 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62313863-4acb-49eb-bfc4-f8bf37c4642a None admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:59:00.497587 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62313863-4acb-49eb-bfc4-f8bf37c4642a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:59:00.497914 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62313863-4acb-49eb-bfc4-f8bf37c4642a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:59:00.499366 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62313863-4acb-49eb-bfc4-f8bf37c4642a None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:59:00.519540 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 536/1082] 10.222.0.17 () {56 vars in 1133 bytes} [Sat Jul 23 20:59:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 20:59:00.519932 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 547/1083] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Jul 23 20:59:00 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 23 20:59:00.520606 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62313863-4acb-49eb-bfc4-f8bf37c4642a None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:59:00.523966 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723d5fbe-3f4c-474f-9b66-a78b713f793a None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:59:00.558489 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:59:00.634526 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62313863-4acb-49eb-bfc4-f8bf37c4642a None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:59:00.635070 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723d5fbe-3f4c-474f-9b66-a78b713f793a None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:59:00.671879 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b8f043-3138-479f-b6fa-f128ed3cf232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:59:00.672450 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b8f043-3138-479f-b6fa-f128ed3cf232 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:59:00.672727 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b8f043-3138-479f-b6fa-f128ed3cf232 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:59:00.672905 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eac17f4-4991-45c7-8fdf-1c96fe707e47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:59:00.673015 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b8f043-3138-479f-b6fa-f128ed3cf232 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:59:00.673674 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eac17f4-4991-45c7-8fdf-1c96fe707e47 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:59:00.674087 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eac17f4-4991-45c7-8fdf-1c96fe707e47 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:59:00.674362 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eac17f4-4991-45c7-8fdf-1c96fe707e47 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:59:00.684874 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eac17f4-4991-45c7-8fdf-1c96fe707e47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:59:00.686363 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eac17f4-4991-45c7-8fdf-1c96fe707e47 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:59:00.703752 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-9eac17f4-4991-45c7-8fdf-1c96fe707e47 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:59:00.703752 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:59:00.703752 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:59:00.703752 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:59:00.703752 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:59:00.703752 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:59:00.703752 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:59:00.703752 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:59:00.703752 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:59:00.703752 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:59:00.703752 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:59:00.703752 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:59:00.703752 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 23 20:59:00.703752 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 23 20:59:00.703752 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 23 20:59:00.704693 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 23 20:59:00.704693 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:59:00.704693 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:59:00.704693 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:59:00.704693 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:59:00.704693 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:59:00.704693 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:59:00.704693 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:59:00.704693 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application with Lock( Jul 23 20:59:00.704693 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:59:00.704693 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:59:00.704693 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:59:00.704693 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:59:00.704693 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:59:00.704693 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:59:00.704693 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:59:00.704693 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:59:00.705580 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 23 20:59:00.705580 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 23 20:59:00.705580 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:59:00.705580 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:59:00.705580 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 537/1084] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 23 20:59:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:59:00.710847 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eac17f4-4991-45c7-8fdf-1c96fe707e47 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:59:00.711102 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:59:00.747867 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b8f043-3138-479f-b6fa-f128ed3cf232 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:59:00.749327 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b8f043-3138-479f-b6fa-f128ed3cf232 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:59:00.797538 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:59:00.809611 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eac17f4-4991-45c7-8fdf-1c96fe707e47 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:59:00.845664 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78df151e-a54d-48d8-aeb5-3a9ebcc7da75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:59:00.846253 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78df151e-a54d-48d8-aeb5-3a9ebcc7da75 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:59:00.846588 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78df151e-a54d-48d8-aeb5-3a9ebcc7da75 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:59:00.846886 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78df151e-a54d-48d8-aeb5-3a9ebcc7da75 None admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:59:00.847600 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78df151e-a54d-48d8-aeb5-3a9ebcc7da75 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:59:00.847900 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78df151e-a54d-48d8-aeb5-3a9ebcc7da75 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:59:00.849279 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78df151e-a54d-48d8-aeb5-3a9ebcc7da75 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:59:00.853266 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 548/1085] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Jul 23 20:59:00 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 23 20:59:00.854736 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd6da6b-f6c2-4020-b21d-ce54d394ce66 None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:59:00.855023 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd6da6b-f6c2-4020-b21d-ce54d394ce66 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:59:00.855305 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd6da6b-f6c2-4020-b21d-ce54d394ce66 None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:59:00.856564 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 549/1086] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:59:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:59:00.858833 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd6da6b-f6c2-4020-b21d-ce54d394ce66 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:59:00.870065 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 538/1087] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 23 20:59:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 20:59:00.870065 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33d51a2-f09e-4b71-99da-e14a20806cc3 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:59:00.870065 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33d51a2-f09e-4b71-99da-e14a20806cc3 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:59:00.870065 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33d51a2-f09e-4b71-99da-e14a20806cc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:59:00.887876 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-f33d51a2-f09e-4b71-99da-e14a20806cc3 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:59:00.889110 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-f33d51a2-f09e-4b71-99da-e14a20806cc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:59:00.941170 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:59:00.981887 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 539/1088] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:59:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 23 20:59:00.984192 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd6da6b-f6c2-4020-b21d-ce54d394ce66 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:59:00.996495 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33d51a2-f09e-4b71-99da-e14a20806cc3 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:59:01.024035 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a705da61-fc5a-457e-bab6-33c35443f049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:59:01.025046 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a705da61-fc5a-457e-bab6-33c35443f049 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:59:01.025326 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a705da61-fc5a-457e-bab6-33c35443f049 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:59:01.025595 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a705da61-fc5a-457e-bab6-33c35443f049 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:59:01.037319 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a705da61-fc5a-457e-bab6-33c35443f049 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:59:01.038853 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a705da61-fc5a-457e-bab6-33c35443f049 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:59:01.057418 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-a705da61-fc5a-457e-bab6-33c35443f049 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:59:01.057418 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:59:01.057418 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:59:01.057418 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:59:01.057418 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:59:01.057418 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:59:01.057418 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:59:01.057418 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:59:01.057418 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:59:01.057418 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:59:01.057418 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:59:01.057418 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:59:01.057418 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 23 20:59:01.057418 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 23 20:59:01.057418 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 23 20:59:01.058434 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 23 20:59:01.058434 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:59:01.058434 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:59:01.058434 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:59:01.058434 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:59:01.058434 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:59:01.058434 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:59:01.058434 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:59:01.058434 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application with Lock( Jul 23 20:59:01.058434 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:59:01.058434 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:59:01.058434 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:59:01.058434 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:59:01.058434 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:59:01.058434 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:59:01.058434 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:59:01.058434 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:59:01.060625 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 23 20:59:01.060625 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 23 20:59:01.060625 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 20:59:01.060625 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 20:59:01.060625 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 550/1089] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 23 20:59:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 23 20:59:01.065023 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a705da61-fc5a-457e-bab6-33c35443f049 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:59:01.090346 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:59:01.119051 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33d51a2-f09e-4b71-99da-e14a20806cc3 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:59:01.163155 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0bee1d-5ad9-4156-a900-f77d3fa66737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:59:01.163958 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0bee1d-5ad9-4156-a900-f77d3fa66737 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:59:01.164233 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0bee1d-5ad9-4156-a900-f77d3fa66737 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:59:01.164499 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0bee1d-5ad9-4156-a900-f77d3fa66737 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:59:01.176367 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0bee1d-5ad9-4156-a900-f77d3fa66737 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:59:01.184174 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-6a0bee1d-5ad9-4156-a900-f77d3fa66737 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 23 20:59:01.184174 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:59:01.184174 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:59:01.184174 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:59:01.184174 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:59:01.184174 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:59:01.184174 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:59:01.184174 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:59:01.184174 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:59:01.184174 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:59:01.184174 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:59:01.184174 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:59:01.184174 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:59:01.184174 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:59:01.184174 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:59:01.184174 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:59:01.185227 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:59:01.185227 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:59:01.185227 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:59:01.185227 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:59:01.185227 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:59:01.185227 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:59:01.185227 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:59:01.185227 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:59:01.185227 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:59:01.185227 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:59:01.185227 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:59:01.185227 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application with Lock( Jul 23 20:59:01.185227 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:59:01.185227 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:59:01.185227 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:59:01.185227 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:59:01.186120 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:59:01.186120 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:59:01.186120 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:59:01.186120 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:59:01.186120 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:59:01.186120 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:59:01.186120 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:59:01.186120 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:59:01.186120 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:59:01.186120 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:59:01.186120 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 23 20:59:01.186120 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:59:01.186120 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 540/1090] 10.222.0.17 () {56 vars in 1096 bytes} [Sat Jul 23 20:59:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:59:01.192017 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0bee1d-5ad9-4156-a900-f77d3fa66737 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:59:01.194208 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a705da61-fc5a-457e-bab6-33c35443f049 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:59:01.213449 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:59:01.233355 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae7518e-5d6c-4c22-8ff7-6e18ed218b1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:59:01.234057 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae7518e-5d6c-4c22-8ff7-6e18ed218b1d None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:59:01.234338 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae7518e-5d6c-4c22-8ff7-6e18ed218b1d None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:59:01.234609 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae7518e-5d6c-4c22-8ff7-6e18ed218b1d None admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:59:01.235333 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae7518e-5d6c-4c22-8ff7-6e18ed218b1d None admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:59:01.235632 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae7518e-5d6c-4c22-8ff7-6e18ed218b1d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:59:01.237040 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae7518e-5d6c-4c22-8ff7-6e18ed218b1d None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:59:01.253682 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 551/1091] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 23 20:59:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:59:01.259652 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae7518e-5d6c-4c22-8ff7-6e18ed218b1d None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:59:01.304999 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0bee1d-5ad9-4156-a900-f77d3fa66737 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:59:01.338556 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2ff970-6c09-46db-aecc-e7c8c192d917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:59:01.339266 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2ff970-6c09-46db-aecc-e7c8c192d917 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:59:01.339528 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2ff970-6c09-46db-aecc-e7c8c192d917 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:59:01.339829 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2ff970-6c09-46db-aecc-e7c8c192d917 None admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:59:01.340536 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2ff970-6c09-46db-aecc-e7c8c192d917 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:59:01.340834 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2ff970-6c09-46db-aecc-e7c8c192d917 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:59:01.342247 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2ff970-6c09-46db-aecc-e7c8c192d917 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:59:01.347744 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:59:01.352451 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 541/1092] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Jul 23 20:59:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:59:01.358360 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2ff970-6c09-46db-aecc-e7c8c192d917 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:59:01.375521 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae7518e-5d6c-4c22-8ff7-6e18ed218b1d None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:59:01.410685 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a377cc-f8c4-46e0-af62-4ae164d30300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:59:01.411728 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a377cc-f8c4-46e0-af62-4ae164d30300 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:59:01.411946 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a377cc-f8c4-46e0-af62-4ae164d30300 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:59:01.412535 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a377cc-f8c4-46e0-af62-4ae164d30300 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:59:01.422549 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a377cc-f8c4-46e0-af62-4ae164d30300 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:59:01.424020 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a377cc-f8c4-46e0-af62-4ae164d30300 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:59:01.443010 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-67a377cc-f8c4-46e0-af62-4ae164d30300 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 23 20:59:01.443010 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:59:01.443010 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:59:01.443010 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:59:01.443010 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:59:01.443010 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:59:01.443010 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:59:01.443010 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:59:01.443010 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:59:01.443010 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:59:01.443010 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:59:01.443010 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:59:01.443010 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 23 20:59:01.443010 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 23 20:59:01.443010 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 23 20:59:01.444692 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 23 20:59:01.444692 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:59:01.444692 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:59:01.444692 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:59:01.444692 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:59:01.444692 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:59:01.444692 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:59:01.444692 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:59:01.444692 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application with Lock( Jul 23 20:59:01.444692 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:59:01.444692 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:59:01.444692 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:59:01.444692 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:59:01.444692 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:59:01.444692 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:59:01.444692 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:59:01.444692 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:59:01.446266 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 23 20:59:01.446266 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 23 20:59:01.446266 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 23 20:59:01.446266 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 23 20:59:01.446266 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 23 20:59:01.446266 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 23 20:59:01.446266 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 23 20:59:01.446266 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 20:59:01.446266 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 552/1093] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Jul 23 20:59:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 23 20:59:01.452729 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a377cc-f8c4-46e0-af62-4ae164d30300 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:59:01.473161 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2ff970-6c09-46db-aecc-e7c8c192d917 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:59:01.505373 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:59:01.515970 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10124877-c253-40f6-a80a-d35094a1d12e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:59:01.516868 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10124877-c253-40f6-a80a-d35094a1d12e None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:59:01.517144 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10124877-c253-40f6-a80a-d35094a1d12e None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:59:01.517412 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10124877-c253-40f6-a80a-d35094a1d12e None admin] PATH_INFO: `/v3/users/bd1d501f406f4bc4b52c1e73bbb41f74` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:59:01.518696 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10124877-c253-40f6-a80a-d35094a1d12e None admin] RBAC: Authorizing `identity:get_user(user_id=bd1d501f406f4bc4b52c1e73bbb41f74)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:59:01.520146 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10124877-c253-40f6-a80a-d35094a1d12e None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:59:01.521800 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 542/1094] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Jul 23 20:59:01 2022] GET /identity/v3/users/bd1d501f406f4bc4b52c1e73bbb41f74 => generated 285 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:59:01.529181 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10124877-c253-40f6-a80a-d35094a1d12e None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:59:01.570221 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a377cc-f8c4-46e0-af62-4ae164d30300 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:59:01.599843 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:59:01.604721 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33fba3a-7a9c-4d69-98dd-0761e1491ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:59:01.605399 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33fba3a-7a9c-4d69-98dd-0761e1491ea0 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:59:01.605671 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33fba3a-7a9c-4d69-98dd-0761e1491ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:59:01.606042 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33fba3a-7a9c-4d69-98dd-0761e1491ea0 None admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:59:01.606760 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33fba3a-7a9c-4d69-98dd-0761e1491ea0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:59:01.607062 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33fba3a-7a9c-4d69-98dd-0761e1491ea0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:59:01.608497 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33fba3a-7a9c-4d69-98dd-0761e1491ea0 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:59:01.621668 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 553/1095] 10.222.0.17 () {56 vars in 1148 bytes} [Sat Jul 23 20:59:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:59:01.628292 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33fba3a-7a9c-4d69-98dd-0761e1491ea0 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:59:01.637113 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10124877-c253-40f6-a80a-d35094a1d12e None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:59:01.672515 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7418b07-c5a7-4e2c-9249-c1186bff2f52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:59:01.673402 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7418b07-c5a7-4e2c-9249-c1186bff2f52 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:59:01.673679 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7418b07-c5a7-4e2c-9249-c1186bff2f52 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:59:01.673980 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7418b07-c5a7-4e2c-9249-c1186bff2f52 None admin] PATH_INFO: `/v3/projects/cf47095dfbdb4a5a9629d52ddc469806` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:59:01.675284 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7418b07-c5a7-4e2c-9249-c1186bff2f52 None admin] RBAC: Authorizing `identity:get_project(project_id=cf47095dfbdb4a5a9629d52ddc469806)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:59:01.676724 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7418b07-c5a7-4e2c-9249-c1186bff2f52 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:59:01.678503 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 543/1096] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Jul 23 20:59:01 2022] GET /identity/v3/projects/cf47095dfbdb4a5a9629d52ddc469806 => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:59:01.685692 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7418b07-c5a7-4e2c-9249-c1186bff2f52 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:59:01.726424 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:59:01.730381 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33fba3a-7a9c-4d69-98dd-0761e1491ea0 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:59:01.768485 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e39c49e-172c-433f-b992-9cd9413576b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:59:01.769153 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e39c49e-172c-433f-b992-9cd9413576b2 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:59:01.769430 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e39c49e-172c-433f-b992-9cd9413576b2 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:59:01.769703 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e39c49e-172c-433f-b992-9cd9413576b2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:59:01.770576 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e39c49e-172c-433f-b992-9cd9413576b2 None admin] RBAC: Adding query filter params (role.id=3295256c44774d3ea100d28799b26fd9, scope.project.id=4804ed61295f4d4a92d9b685dd9e9f3b, user.id=079f31ed2c844e67bd4e206f24b69d97) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:59:01.770880 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e39c49e-172c-433f-b992-9cd9413576b2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:59:01.772368 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e39c49e-172c-433f-b992-9cd9413576b2 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:59:01.778839 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 554/1097] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Jul 23 20:59:01 2022] GET /identity/v3/role_assignments?user.id=079f31ed2c844e67bd4e206f24b69d97&scope.project.id=4804ed61295f4d4a92d9b685dd9e9f3b&role.id=3295256c44774d3ea100d28799b26fd9 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 20:59:01.797108 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7418b07-c5a7-4e2c-9249-c1186bff2f52 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:59:01.851228 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eecf3e-7865-4d15-a063-06aa25a11590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:59:01.852161 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eecf3e-7865-4d15-a063-06aa25a11590 None admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:59:01.852432 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eecf3e-7865-4d15-a063-06aa25a11590 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:59:01.852699 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eecf3e-7865-4d15-a063-06aa25a11590 None admin] PATH_INFO: `/v3/projects/cf47095dfbdb4a5a9629d52ddc469806/users/bd1d501f406f4bc4b52c1e73bbb41f74/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:59:01.854772 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7eecf3e-7865-4d15-a063-06aa25a11590 None admin] RBAC: Authorizing `identity:create_grant(project_id=cf47095dfbdb4a5a9629d52ddc469806, user_id=bd1d501f406f4bc4b52c1e73bbb41f74, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:59:01.856240 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7eecf3e-7865-4d15-a063-06aa25a11590 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:59:01.859874 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:59:01.873195 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 544/1098] 10.222.0.17 () {58 vars in 1439 bytes} [Sat Jul 23 20:59:01 2022] PUT /identity/v3/projects/cf47095dfbdb4a5a9629d52ddc469806/users/bd1d501f406f4bc4b52c1e73bbb41f74/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 20:59:04.143707 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc01470c-1645-407f-a221-ee2c1c825215 None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:59:04.144258 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc01470c-1645-407f-a221-ee2c1c825215 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:59:04.144258 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc01470c-1645-407f-a221-ee2c1c825215 None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:59:04.145572 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 555/1099] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:59:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:59:04.152334 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082157a1-628b-4d1e-914c-da7c5a345a5c None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:59:04.153505 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082157a1-628b-4d1e-914c-da7c5a345a5c None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:59:04.153666 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082157a1-628b-4d1e-914c-da7c5a345a5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:59:04.186679 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-082157a1-628b-4d1e-914c-da7c5a345a5c None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:59:04.188541 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-082157a1-628b-4d1e-914c-da7c5a345a5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:59:04.267768 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 545/1100] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:59:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 23 20:59:04.293765 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc01470c-1645-407f-a221-ee2c1c825215 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:59:04.411610 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc01470c-1645-407f-a221-ee2c1c825215 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:59:04.453797 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e229712-bc88-4061-8dfc-8cf52e609e53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:59:04.454890 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e229712-bc88-4061-8dfc-8cf52e609e53 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:59:04.455257 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e229712-bc88-4061-8dfc-8cf52e609e53 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:59:04.455734 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e229712-bc88-4061-8dfc-8cf52e609e53 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:59:04.472523 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e229712-bc88-4061-8dfc-8cf52e609e53 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:59:04.480691 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-7e229712-bc88-4061-8dfc-8cf52e609e53 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 23 20:59:04.480691 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:59:04.480691 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:59:04.480691 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:59:04.480691 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:59:04.480691 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:59:04.480691 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:59:04.480691 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:59:04.480691 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:59:04.480691 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:59:04.480691 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:59:04.480691 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:59:04.480691 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:59:04.480691 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:59:04.480691 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:59:04.480691 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:59:04.481781 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:59:04.481781 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:59:04.481781 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:59:04.481781 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:59:04.481781 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:59:04.481781 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:59:04.481781 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:59:04.481781 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:59:04.481781 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:59:04.481781 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:59:04.481781 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:59:04.481781 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application with Lock( Jul 23 20:59:04.481781 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:59:04.481781 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:59:04.481781 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:59:04.481781 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:59:04.482805 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:59:04.482805 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:59:04.482805 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:59:04.482805 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:59:04.482805 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:59:04.482805 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:59:04.482805 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:59:04.482805 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:59:04.482805 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:59:04.482805 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:59:04.482805 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 23 20:59:04.482805 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 20:59:04.482805 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 556/1101] 10.222.0.17 () {56 vars in 1096 bytes} [Sat Jul 23 20:59:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:59:04.488911 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082157a1-628b-4d1e-914c-da7c5a345a5c None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:59:04.606377 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082157a1-628b-4d1e-914c-da7c5a345a5c None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:59:04.633111 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:59:04.643720 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abef3bd6-f39e-4a4b-a8f6-d06c6ad09efc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:59:04.644397 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abef3bd6-f39e-4a4b-a8f6-d06c6ad09efc None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:59:04.644676 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abef3bd6-f39e-4a4b-a8f6-d06c6ad09efc None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:59:04.644951 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abef3bd6-f39e-4a4b-a8f6-d06c6ad09efc None admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:59:04.645701 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abef3bd6-f39e-4a4b-a8f6-d06c6ad09efc None admin] RBAC: Adding query filter params (name=admin) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:59:04.646038 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abef3bd6-f39e-4a4b-a8f6-d06c6ad09efc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:59:04.647432 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abef3bd6-f39e-4a4b-a8f6-d06c6ad09efc None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:59:04.657816 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 546/1102] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Jul 23 20:59:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:59:04.667944 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e229712-bc88-4061-8dfc-8cf52e609e53 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:59:04.702663 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:59:04.788657 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e229712-bc88-4061-8dfc-8cf52e609e53 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:59:04.825267 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d23905e-2a35-4f2d-9055-f11179b5145c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:59:04.826608 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d23905e-2a35-4f2d-9055-f11179b5145c None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:59:04.827003 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d23905e-2a35-4f2d-9055-f11179b5145c None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:59:04.827303 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d23905e-2a35-4f2d-9055-f11179b5145c None admin] PATH_INFO: `/v3/users/bd1d501f406f4bc4b52c1e73bbb41f74` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:59:04.829180 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d23905e-2a35-4f2d-9055-f11179b5145c None admin] RBAC: Authorizing `identity:get_user(user_id=bd1d501f406f4bc4b52c1e73bbb41f74)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:59:04.831416 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d23905e-2a35-4f2d-9055-f11179b5145c None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:59:04.833096 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 557/1103] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Jul 23 20:59:04 2022] GET /identity/v3/users/bd1d501f406f4bc4b52c1e73bbb41f74 => generated 285 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:59:04.839108 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abef3bd6-f39e-4a4b-a8f6-d06c6ad09efc None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:59:04.941449 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abef3bd6-f39e-4a4b-a8f6-d06c6ad09efc None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:59:04.976126 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1156499-3e22-4951-9d15-95092dccc429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:59:04.976768 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1156499-3e22-4951-9d15-95092dccc429 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:59:04.977041 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1156499-3e22-4951-9d15-95092dccc429 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:59:04.977312 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1156499-3e22-4951-9d15-95092dccc429 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:59:05.033247 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:59:05.047855 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1156499-3e22-4951-9d15-95092dccc429 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:59:05.049307 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1156499-3e22-4951-9d15-95092dccc429 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:59:05.155746 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 547/1104] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Jul 23 20:59:04 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 23 20:59:05.165513 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d23905e-2a35-4f2d-9055-f11179b5145c None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:59:05.276217 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:59:05.288925 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d23905e-2a35-4f2d-9055-f11179b5145c None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:59:05.326469 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7e8955-ad6a-4d4a-8c58-9b81297a4371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:59:05.327329 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7e8955-ad6a-4d4a-8c58-9b81297a4371 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:59:05.327603 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7e8955-ad6a-4d4a-8c58-9b81297a4371 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:59:05.327847 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7e8955-ad6a-4d4a-8c58-9b81297a4371 None admin] PATH_INFO: `/v3/projects/cf47095dfbdb4a5a9629d52ddc469806` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:59:05.329082 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7e8955-ad6a-4d4a-8c58-9b81297a4371 None admin] RBAC: Authorizing `identity:get_project(project_id=cf47095dfbdb4a5a9629d52ddc469806)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:59:05.330545 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7e8955-ad6a-4d4a-8c58-9b81297a4371 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:59:05.332253 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 558/1105] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Jul 23 20:59:05 2022] GET /identity/v3/projects/cf47095dfbdb4a5a9629d52ddc469806 => generated 311 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:59:05.338947 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1156499-3e22-4951-9d15-95092dccc429 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:59:05.436431 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:59:05.449947 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1156499-3e22-4951-9d15-95092dccc429 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:59:05.489029 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96811131-9c68-47da-ae42-81105bb765b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:59:05.489681 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96811131-9c68-47da-ae42-81105bb765b4 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:59:05.489983 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96811131-9c68-47da-ae42-81105bb765b4 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:59:05.490263 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96811131-9c68-47da-ae42-81105bb765b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:59:05.491095 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96811131-9c68-47da-ae42-81105bb765b4 None admin] RBAC: Adding query filter params (role.id=fec17bfdc65349a2b9c06a89131191df, scope.project.id=cf47095dfbdb4a5a9629d52ddc469806, user.id=bd1d501f406f4bc4b52c1e73bbb41f74) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:59:05.491403 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96811131-9c68-47da-ae42-81105bb765b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:59:05.492856 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96811131-9c68-47da-ae42-81105bb765b4 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:59:05.498977 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 548/1106] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Jul 23 20:59:05 2022] GET /identity/v3/role_assignments?user.id=bd1d501f406f4bc4b52c1e73bbb41f74&scope.project.id=cf47095dfbdb4a5a9629d52ddc469806&role.id=fec17bfdc65349a2b9c06a89131191df => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:59:07.764305 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5791a21-91e4-49b8-a036-3e3d0356e382 None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:59:07.765171 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5791a21-91e4-49b8-a036-3e3d0356e382 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:59:07.765171 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5791a21-91e4-49b8-a036-3e3d0356e382 None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:59:07.767381 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 559/1107] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:59:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:59:07.773071 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2abcc71-a6cd-4bb5-85c6-708c8a1f41d2 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:59:07.773498 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2abcc71-a6cd-4bb5-85c6-708c8a1f41d2 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:59:07.773587 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2abcc71-a6cd-4bb5-85c6-708c8a1f41d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:59:07.791402 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-d2abcc71-a6cd-4bb5-85c6-708c8a1f41d2 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:59:07.792582 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-d2abcc71-a6cd-4bb5-85c6-708c8a1f41d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:59:07.862497 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 549/1108] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:59:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 23 20:59:07.889117 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5791a21-91e4-49b8-a036-3e3d0356e382 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:59:08.003971 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5791a21-91e4-49b8-a036-3e3d0356e382 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:59:08.043840 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1e4771-f98b-4d2c-ba14-6cace57a3e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:59:08.044963 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1e4771-f98b-4d2c-ba14-6cace57a3e92 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:59:08.045392 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1e4771-f98b-4d2c-ba14-6cace57a3e92 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:59:08.045813 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1e4771-f98b-4d2c-ba14-6cace57a3e92 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:59:08.047829 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1e4771-f98b-4d2c-ba14-6cace57a3e92 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:59:08.050133 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1e4771-f98b-4d2c-ba14-6cace57a3e92 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:59:08.051736 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 560/1109] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 23 20:59:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:59:08.060441 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2abcc71-a6cd-4bb5-85c6-708c8a1f41d2 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:59:08.144312 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:59:08.165020 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2abcc71-a6cd-4bb5-85c6-708c8a1f41d2 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:59:08.200782 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3c4590-9b1e-4961-9601-c8885491bf45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:59:08.201458 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3c4590-9b1e-4961-9601-c8885491bf45 None admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:59:08.201752 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3c4590-9b1e-4961-9601-c8885491bf45 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:59:08.202033 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3c4590-9b1e-4961-9601-c8885491bf45 None admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:59:08.202740 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3c4590-9b1e-4961-9601-c8885491bf45 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:59:08.204178 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3c4590-9b1e-4961-9601-c8885491bf45 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:59:08.226432 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 550/1110] 10.222.0.17 () {60 vars in 1132 bytes} [Sat Jul 23 20:59:08 2022] POST /identity/v3/users => generated 286 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 20:59:10.490164 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9a82a8-f375-4bd4-af4e-88b30de52b13 None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:59:10.491036 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9a82a8-f375-4bd4-af4e-88b30de52b13 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:59:10.491036 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9a82a8-f375-4bd4-af4e-88b30de52b13 None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:59:10.493235 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 561/1111] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:59:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:59:10.498731 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622bd3fb-d2e7-44ab-aefb-afe65d3f6cae None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:59:10.499159 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622bd3fb-d2e7-44ab-aefb-afe65d3f6cae None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:59:10.499269 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622bd3fb-d2e7-44ab-aefb-afe65d3f6cae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:59:10.516809 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-622bd3fb-d2e7-44ab-aefb-afe65d3f6cae None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:59:10.518013 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-622bd3fb-d2e7-44ab-aefb-afe65d3f6cae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:59:10.588109 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 551/1112] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:59:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 23 20:59:10.613145 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9a82a8-f375-4bd4-af4e-88b30de52b13 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:59:10.644456 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:59:10.725089 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9a82a8-f375-4bd4-af4e-88b30de52b13 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:59:10.761126 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4225e1-1a09-4dc9-8a1f-69300a1a9f11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:59:10.762020 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4225e1-1a09-4dc9-8a1f-69300a1a9f11 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:59:10.762304 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4225e1-1a09-4dc9-8a1f-69300a1a9f11 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:59:10.762570 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4225e1-1a09-4dc9-8a1f-69300a1a9f11 None admin] PATH_INFO: `/v3/roles/c5f46541d35e44b691baa7a1fa304c0f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:59:10.764190 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4225e1-1a09-4dc9-8a1f-69300a1a9f11 None admin] RBAC: Authorizing `identity:get_role(role_id=c5f46541d35e44b691baa7a1fa304c0f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:59:10.765556 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4225e1-1a09-4dc9-8a1f-69300a1a9f11 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:59:10.766977 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 562/1113] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Jul 23 20:59:10 2022] GET /identity/v3/roles/c5f46541d35e44b691baa7a1fa304c0f => generated 223 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:59:10.776433 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622bd3fb-d2e7-44ab-aefb-afe65d3f6cae None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:59:10.858089 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:59:10.893501 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622bd3fb-d2e7-44ab-aefb-afe65d3f6cae None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:59:10.930387 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caa5ee7-988f-4fcb-90e2-bd35e2ee90ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:59:10.931270 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caa5ee7-988f-4fcb-90e2-bd35e2ee90ba None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:59:10.931552 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caa5ee7-988f-4fcb-90e2-bd35e2ee90ba None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:59:10.931821 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caa5ee7-988f-4fcb-90e2-bd35e2ee90ba None admin] PATH_INFO: `/v3/users/89255bcf5b494927b5c8418d55cc9e19` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:59:10.946145 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caa5ee7-988f-4fcb-90e2-bd35e2ee90ba None admin] RBAC: Authorizing `identity:get_user(user_id=89255bcf5b494927b5c8418d55cc9e19)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:59:10.947603 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caa5ee7-988f-4fcb-90e2-bd35e2ee90ba None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:59:10.949308 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 552/1114] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Jul 23 20:59:10 2022] GET /identity/v3/users/89255bcf5b494927b5c8418d55cc9e19 => generated 286 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:59:10.956177 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4225e1-1a09-4dc9-8a1f-69300a1a9f11 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:59:11.050850 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:59:11.057796 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4225e1-1a09-4dc9-8a1f-69300a1a9f11 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:59:11.092113 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bdf9be-ac9e-4c31-b385-70df6df39053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:59:11.092755 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bdf9be-ac9e-4c31-b385-70df6df39053 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:59:11.093028 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bdf9be-ac9e-4c31-b385-70df6df39053 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:59:11.093297 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bdf9be-ac9e-4c31-b385-70df6df39053 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:59:11.160864 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bdf9be-ac9e-4c31-b385-70df6df39053 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:59:11.162457 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bdf9be-ac9e-4c31-b385-70df6df39053 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:59:11.262529 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:59:11.271136 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 563/1115] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Jul 23 20:59:10 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 23 20:59:11.280764 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caa5ee7-988f-4fcb-90e2-bd35e2ee90ba None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:59:11.394140 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caa5ee7-988f-4fcb-90e2-bd35e2ee90ba None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:59:11.436638 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:59:11.449311 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fd622c-cd54-41b9-a571-388d4b7508d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:59:11.450242 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fd622c-cd54-41b9-a571-388d4b7508d2 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:59:11.450522 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fd622c-cd54-41b9-a571-388d4b7508d2 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:59:11.450789 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fd622c-cd54-41b9-a571-388d4b7508d2 None admin] PATH_INFO: `/v3/projects/cf47095dfbdb4a5a9629d52ddc469806` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:59:11.452020 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fd622c-cd54-41b9-a571-388d4b7508d2 None admin] RBAC: Authorizing `identity:get_project(project_id=cf47095dfbdb4a5a9629d52ddc469806)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:59:11.453478 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fd622c-cd54-41b9-a571-388d4b7508d2 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:59:11.455268 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 553/1116] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Jul 23 20:59:11 2022] GET /identity/v3/projects/cf47095dfbdb4a5a9629d52ddc469806 => generated 311 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:59:11.461837 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bdf9be-ac9e-4c31-b385-70df6df39053 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:59:11.576921 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bdf9be-ac9e-4c31-b385-70df6df39053 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:59:11.612584 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d64ee1-541f-4980-9307-2197925c51a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:59:11.613228 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d64ee1-541f-4980-9307-2197925c51a1 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:59:11.613501 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d64ee1-541f-4980-9307-2197925c51a1 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:59:11.613769 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d64ee1-541f-4980-9307-2197925c51a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:59:11.614716 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d64ee1-541f-4980-9307-2197925c51a1 None admin] RBAC: Adding query filter params (role.id=c5f46541d35e44b691baa7a1fa304c0f, scope.project.id=cf47095dfbdb4a5a9629d52ddc469806, user.id=89255bcf5b494927b5c8418d55cc9e19) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:59:11.615020 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d64ee1-541f-4980-9307-2197925c51a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:59:11.616438 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d64ee1-541f-4980-9307-2197925c51a1 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:59:11.622000 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 564/1117] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Jul 23 20:59:11 2022] GET /identity/v3/role_assignments?user.id=89255bcf5b494927b5c8418d55cc9e19&scope.project.id=cf47095dfbdb4a5a9629d52ddc469806&role.id=c5f46541d35e44b691baa7a1fa304c0f => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:59:13.820197 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09974d44-fb46-4486-8a96-f5faa0312f2e None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:59:13.820907 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09974d44-fb46-4486-8a96-f5faa0312f2e None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:59:13.821054 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09974d44-fb46-4486-8a96-f5faa0312f2e None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:59:13.823315 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 554/1118] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:59:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:59:13.832814 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c540637-90e9-460e-8153-42a4ff0f5d05 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:59:13.833605 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c540637-90e9-460e-8153-42a4ff0f5d05 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:59:13.833912 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c540637-90e9-460e-8153-42a4ff0f5d05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:59:13.862205 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-5c540637-90e9-460e-8153-42a4ff0f5d05 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:59:13.864080 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-5c540637-90e9-460e-8153-42a4ff0f5d05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:59:13.927078 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:59:13.941794 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 565/1119] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:59:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 23 20:59:13.969675 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09974d44-fb46-4486-8a96-f5faa0312f2e None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:59:14.086298 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09974d44-fb46-4486-8a96-f5faa0312f2e None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:59:14.124961 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef273e3-1bde-4ba8-bf27-41abe4ab72a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:59:14.125937 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef273e3-1bde-4ba8-bf27-41abe4ab72a4 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:59:14.126092 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef273e3-1bde-4ba8-bf27-41abe4ab72a4 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:59:14.126391 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef273e3-1bde-4ba8-bf27-41abe4ab72a4 None admin] PATH_INFO: `/v3/roles/c5f46541d35e44b691baa7a1fa304c0f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:59:14.128021 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef273e3-1bde-4ba8-bf27-41abe4ab72a4 None admin] RBAC: Authorizing `identity:get_role(role_id=c5f46541d35e44b691baa7a1fa304c0f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:59:14.129392 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef273e3-1bde-4ba8-bf27-41abe4ab72a4 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:59:14.130884 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 555/1120] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Jul 23 20:59:13 2022] GET /identity/v3/roles/c5f46541d35e44b691baa7a1fa304c0f => generated 223 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:59:14.137308 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c540637-90e9-460e-8153-42a4ff0f5d05 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:59:14.243690 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c540637-90e9-460e-8153-42a4ff0f5d05 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:59:14.281381 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd95877-776e-404c-99a1-0fe4bc32a188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:59:14.282300 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd95877-776e-404c-99a1-0fe4bc32a188 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:59:14.282576 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd95877-776e-404c-99a1-0fe4bc32a188 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:59:14.282845 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd95877-776e-404c-99a1-0fe4bc32a188 None admin] PATH_INFO: `/v3/users/89255bcf5b494927b5c8418d55cc9e19` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:59:14.284163 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd95877-776e-404c-99a1-0fe4bc32a188 None admin] RBAC: Authorizing `identity:get_user(user_id=89255bcf5b494927b5c8418d55cc9e19)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:59:14.285616 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd95877-776e-404c-99a1-0fe4bc32a188 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:59:14.287301 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 566/1121] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Jul 23 20:59:14 2022] GET /identity/v3/users/89255bcf5b494927b5c8418d55cc9e19 => generated 286 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:59:14.293411 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef273e3-1bde-4ba8-bf27-41abe4ab72a4 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:59:14.369645 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:59:14.409334 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef273e3-1bde-4ba8-bf27-41abe4ab72a4 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:59:14.442919 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f84a6b3-2a33-470c-b146-9dbf31ee31b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:59:14.443784 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f84a6b3-2a33-470c-b146-9dbf31ee31b5 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:59:14.444099 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f84a6b3-2a33-470c-b146-9dbf31ee31b5 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:59:14.444369 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f84a6b3-2a33-470c-b146-9dbf31ee31b5 None admin] PATH_INFO: `/v3/projects/cf47095dfbdb4a5a9629d52ddc469806` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:59:14.445662 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f84a6b3-2a33-470c-b146-9dbf31ee31b5 None admin] RBAC: Authorizing `identity:get_project(project_id=cf47095dfbdb4a5a9629d52ddc469806)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:59:14.447164 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f84a6b3-2a33-470c-b146-9dbf31ee31b5 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:59:14.448878 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 556/1122] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Jul 23 20:59:14 2022] GET /identity/v3/projects/cf47095dfbdb4a5a9629d52ddc469806 => generated 311 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:59:14.458532 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd95877-776e-404c-99a1-0fe4bc32a188 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:59:14.523406 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:59:14.569611 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd95877-776e-404c-99a1-0fe4bc32a188 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:59:14.604895 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f7e900-8728-40fc-a734-e9fd5b132a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:59:14.605790 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f7e900-8728-40fc-a734-e9fd5b132a19 None admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:59:14.606104 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f7e900-8728-40fc-a734-e9fd5b132a19 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:59:14.606377 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f7e900-8728-40fc-a734-e9fd5b132a19 None admin] PATH_INFO: `/v3/projects/cf47095dfbdb4a5a9629d52ddc469806/users/89255bcf5b494927b5c8418d55cc9e19/roles/c5f46541d35e44b691baa7a1fa304c0f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:59:14.609018 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f7e900-8728-40fc-a734-e9fd5b132a19 None admin] RBAC: Authorizing `identity:create_grant(project_id=cf47095dfbdb4a5a9629d52ddc469806, user_id=89255bcf5b494927b5c8418d55cc9e19, role_id=c5f46541d35e44b691baa7a1fa304c0f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:59:14.610490 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f7e900-8728-40fc-a734-e9fd5b132a19 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:59:14.626046 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 567/1123] 10.222.0.17 () {58 vars in 1439 bytes} [Sat Jul 23 20:59:14 2022] PUT /identity/v3/projects/cf47095dfbdb4a5a9629d52ddc469806/users/89255bcf5b494927b5c8418d55cc9e19/roles/c5f46541d35e44b691baa7a1fa304c0f => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 20:59:16.848924 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8c4021-f40a-444d-a76c-f5e2a50866d1 None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:59:16.849451 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8c4021-f40a-444d-a76c-f5e2a50866d1 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:59:16.849451 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8c4021-f40a-444d-a76c-f5e2a50866d1 None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:59:16.850901 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 557/1124] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:59:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:59:16.856368 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdc1698-1863-49f8-b962-9158a209bbe2 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:59:16.856813 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdc1698-1863-49f8-b962-9158a209bbe2 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:59:16.856906 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdc1698-1863-49f8-b962-9158a209bbe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:59:16.875150 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-9bdc1698-1863-49f8-b962-9158a209bbe2 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:59:16.876324 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-9bdc1698-1863-49f8-b962-9158a209bbe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:59:16.945587 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 568/1125] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:59:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 23 20:59:16.971679 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8c4021-f40a-444d-a76c-f5e2a50866d1 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:59:17.087954 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8c4021-f40a-444d-a76c-f5e2a50866d1 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:59:17.116925 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:59:17.124181 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5058d45b-9219-4f29-a12c-6226ef4d802e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:59:17.125041 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5058d45b-9219-4f29-a12c-6226ef4d802e None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:59:17.125318 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5058d45b-9219-4f29-a12c-6226ef4d802e None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:59:17.125588 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5058d45b-9219-4f29-a12c-6226ef4d802e None admin] PATH_INFO: `/v3/roles/c5f46541d35e44b691baa7a1fa304c0f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:59:17.127122 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5058d45b-9219-4f29-a12c-6226ef4d802e None admin] RBAC: Authorizing `identity:get_role(role_id=c5f46541d35e44b691baa7a1fa304c0f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:59:17.128498 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5058d45b-9219-4f29-a12c-6226ef4d802e None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:59:17.129886 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 558/1126] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Jul 23 20:59:16 2022] GET /identity/v3/roles/c5f46541d35e44b691baa7a1fa304c0f => generated 223 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:59:17.136727 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdc1698-1863-49f8-b962-9158a209bbe2 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:59:17.194872 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:59:17.266642 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdc1698-1863-49f8-b962-9158a209bbe2 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:59:17.308847 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf14994e-8912-4a78-9298-6d43f847350b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:59:17.309740 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf14994e-8912-4a78-9298-6d43f847350b None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:59:17.310051 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf14994e-8912-4a78-9298-6d43f847350b None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:59:17.310323 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf14994e-8912-4a78-9298-6d43f847350b None admin] PATH_INFO: `/v3/users/89255bcf5b494927b5c8418d55cc9e19` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:59:17.311663 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf14994e-8912-4a78-9298-6d43f847350b None admin] RBAC: Authorizing `identity:get_user(user_id=89255bcf5b494927b5c8418d55cc9e19)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:59:17.313118 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf14994e-8912-4a78-9298-6d43f847350b None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:59:17.314817 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 569/1127] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Jul 23 20:59:17 2022] GET /identity/v3/users/89255bcf5b494927b5c8418d55cc9e19 => generated 286 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:59:17.321318 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5058d45b-9219-4f29-a12c-6226ef4d802e None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:59:17.438962 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5058d45b-9219-4f29-a12c-6226ef4d802e None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:59:17.476220 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f23ec1-3112-4a09-b9f5-e34eb4cfb6f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:59:17.476856 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f23ec1-3112-4a09-b9f5-e34eb4cfb6f7 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:59:17.477130 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f23ec1-3112-4a09-b9f5-e34eb4cfb6f7 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:59:17.477396 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f23ec1-3112-4a09-b9f5-e34eb4cfb6f7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:59:17.542924 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:59:17.547509 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f23ec1-3112-4a09-b9f5-e34eb4cfb6f7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:59:17.550550 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f23ec1-3112-4a09-b9f5-e34eb4cfb6f7 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:59:17.656629 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 559/1128] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Jul 23 20:59:17 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 23 20:59:17.663180 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf14994e-8912-4a78-9298-6d43f847350b None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:59:17.781760 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf14994e-8912-4a78-9298-6d43f847350b None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:59:17.797589 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:59:17.821098 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94d8f88-6566-419a-9fb7-9e389210298c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:59:17.822021 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94d8f88-6566-419a-9fb7-9e389210298c None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:59:17.822300 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94d8f88-6566-419a-9fb7-9e389210298c None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:59:17.822557 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94d8f88-6566-419a-9fb7-9e389210298c None admin] PATH_INFO: `/v3/projects/cf47095dfbdb4a5a9629d52ddc469806` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:59:17.823856 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94d8f88-6566-419a-9fb7-9e389210298c None admin] RBAC: Authorizing `identity:get_project(project_id=cf47095dfbdb4a5a9629d52ddc469806)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:59:17.825286 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94d8f88-6566-419a-9fb7-9e389210298c None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:59:17.827020 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 570/1129] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Jul 23 20:59:17 2022] GET /identity/v3/projects/cf47095dfbdb4a5a9629d52ddc469806 => generated 311 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:59:17.834178 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f23ec1-3112-4a09-b9f5-e34eb4cfb6f7 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:59:17.942042 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:59:17.946827 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f23ec1-3112-4a09-b9f5-e34eb4cfb6f7 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:59:17.982780 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81df405-40d0-4c6d-adaf-a15a90069327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:59:17.983431 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81df405-40d0-4c6d-adaf-a15a90069327 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:59:17.983713 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81df405-40d0-4c6d-adaf-a15a90069327 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:59:17.983983 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81df405-40d0-4c6d-adaf-a15a90069327 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:59:17.984801 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81df405-40d0-4c6d-adaf-a15a90069327 None admin] RBAC: Adding query filter params (role.id=c5f46541d35e44b691baa7a1fa304c0f, scope.project.id=cf47095dfbdb4a5a9629d52ddc469806, user.id=89255bcf5b494927b5c8418d55cc9e19) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:59:17.985105 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81df405-40d0-4c6d-adaf-a15a90069327 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:59:17.986585 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81df405-40d0-4c6d-adaf-a15a90069327 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:59:17.992381 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 560/1130] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Jul 23 20:59:17 2022] GET /identity/v3/role_assignments?user.id=89255bcf5b494927b5c8418d55cc9e19&scope.project.id=cf47095dfbdb4a5a9629d52ddc469806&role.id=c5f46541d35e44b691baa7a1fa304c0f => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:59:20.255122 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe42525-4d80-499a-99c1-d6974cb6d12d None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:59:20.255684 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe42525-4d80-499a-99c1-d6974cb6d12d None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:59:20.255684 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe42525-4d80-499a-99c1-d6974cb6d12d None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:59:20.256973 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 571/1131] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:59:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:59:20.262742 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0ac5e9-ac17-4436-b181-df6a3c8f26a2 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:59:20.263564 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0ac5e9-ac17-4436-b181-df6a3c8f26a2 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:59:20.263739 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0ac5e9-ac17-4436-b181-df6a3c8f26a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:59:20.289644 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-8d0ac5e9-ac17-4436-b181-df6a3c8f26a2 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:59:20.290887 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-8d0ac5e9-ac17-4436-b181-df6a3c8f26a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:59:20.363415 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 561/1132] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:59:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 23 20:59:20.395190 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe42525-4d80-499a-99c1-d6974cb6d12d None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:59:20.513624 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe42525-4d80-499a-99c1-d6974cb6d12d None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:59:20.548822 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56d6067-f345-4ea1-9ddd-c6af3f8a9d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:59:20.549620 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56d6067-f345-4ea1-9ddd-c6af3f8a9d91 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:59:20.549977 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56d6067-f345-4ea1-9ddd-c6af3f8a9d91 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:59:20.550186 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56d6067-f345-4ea1-9ddd-c6af3f8a9d91 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:59:20.551469 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56d6067-f345-4ea1-9ddd-c6af3f8a9d91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:59:20.552939 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56d6067-f345-4ea1-9ddd-c6af3f8a9d91 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:59:20.554589 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 572/1133] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 23 20:59:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:59:20.563762 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0ac5e9-ac17-4436-b181-df6a3c8f26a2 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:59:20.662558 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:59:20.674506 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0ac5e9-ac17-4436-b181-df6a3c8f26a2 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:59:20.709935 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ac631c-97fe-4130-b20c-0bc21fce9f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:59:20.710586 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ac631c-97fe-4130-b20c-0bc21fce9f4f None admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:59:20.710861 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ac631c-97fe-4130-b20c-0bc21fce9f4f None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:59:20.711125 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ac631c-97fe-4130-b20c-0bc21fce9f4f None admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:59:20.711828 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ac631c-97fe-4130-b20c-0bc21fce9f4f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:59:20.713263 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ac631c-97fe-4130-b20c-0bc21fce9f4f None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:59:20.741272 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 562/1134] 10.222.0.17 () {60 vars in 1141 bytes} [Sat Jul 23 20:59:20 2022] POST /identity/v3/projects => generated 311 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 20:59:23.012476 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9ebf8a-b66f-4350-b936-7cbd7c002612 None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:59:23.013027 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9ebf8a-b66f-4350-b936-7cbd7c002612 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:59:23.013027 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9ebf8a-b66f-4350-b936-7cbd7c002612 None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:59:23.015159 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 573/1135] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:59:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:59:23.023115 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809cb5ca-3336-41ca-834d-f0c69b05f2f7 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:59:23.023569 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809cb5ca-3336-41ca-834d-f0c69b05f2f7 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:59:23.023658 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809cb5ca-3336-41ca-834d-f0c69b05f2f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:59:23.042544 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-809cb5ca-3336-41ca-834d-f0c69b05f2f7 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:59:23.043724 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-809cb5ca-3336-41ca-834d-f0c69b05f2f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:59:23.117357 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 563/1136] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:59:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 23 20:59:23.143513 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9ebf8a-b66f-4350-b936-7cbd7c002612 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:59:23.206437 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:59:23.258730 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9ebf8a-b66f-4350-b936-7cbd7c002612 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:59:23.297288 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134eff50-e7d2-4c17-8f75-f9c4e3e73532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:59:23.298111 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134eff50-e7d2-4c17-8f75-f9c4e3e73532 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:59:23.298391 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134eff50-e7d2-4c17-8f75-f9c4e3e73532 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:59:23.298660 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134eff50-e7d2-4c17-8f75-f9c4e3e73532 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:59:23.299896 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134eff50-e7d2-4c17-8f75-f9c4e3e73532 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:59:23.301340 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134eff50-e7d2-4c17-8f75-f9c4e3e73532 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:59:23.303021 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 574/1137] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 23 20:59:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:59:23.309001 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809cb5ca-3336-41ca-834d-f0c69b05f2f7 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:59:23.389191 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:59:23.423787 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809cb5ca-3336-41ca-834d-f0c69b05f2f7 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:59:23.465186 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c1a693-a66b-41e6-ac38-0b02d763551d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:59:23.465899 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c1a693-a66b-41e6-ac38-0b02d763551d None admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:59:23.466185 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c1a693-a66b-41e6-ac38-0b02d763551d None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:59:23.466451 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c1a693-a66b-41e6-ac38-0b02d763551d None admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:59:23.467176 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c1a693-a66b-41e6-ac38-0b02d763551d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:59:23.468621 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c1a693-a66b-41e6-ac38-0b02d763551d None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:59:23.496285 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 564/1138] 10.222.0.17 () {60 vars in 1132 bytes} [Sat Jul 23 20:59:23 2022] POST /identity/v3/users => generated 286 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 20:59:25.772314 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c72f3f-ff86-4ed8-b2ec-ecb075724a4c None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:59:25.772947 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c72f3f-ff86-4ed8-b2ec-ecb075724a4c None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:59:25.772947 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c72f3f-ff86-4ed8-b2ec-ecb075724a4c None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:59:25.774400 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 575/1139] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:59:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:59:25.780728 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fa9286-5326-4389-a297-3b46cbe5eee1 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:59:25.781198 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fa9286-5326-4389-a297-3b46cbe5eee1 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:59:25.781368 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fa9286-5326-4389-a297-3b46cbe5eee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:59:25.805349 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-29fa9286-5326-4389-a297-3b46cbe5eee1 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:59:25.806754 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-29fa9286-5326-4389-a297-3b46cbe5eee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:59:25.880341 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 565/1140] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:59:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 23 20:59:25.913261 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c72f3f-ff86-4ed8-b2ec-ecb075724a4c None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:59:26.036575 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c72f3f-ff86-4ed8-b2ec-ecb075724a4c None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:59:26.061130 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:59:26.081899 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84afbf4a-583c-4339-b641-152a97d8c176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:59:26.082728 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84afbf4a-583c-4339-b641-152a97d8c176 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:59:26.083057 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84afbf4a-583c-4339-b641-152a97d8c176 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:59:26.083351 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84afbf4a-583c-4339-b641-152a97d8c176 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:59:26.095355 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84afbf4a-583c-4339-b641-152a97d8c176 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:59:26.103244 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-84afbf4a-583c-4339-b641-152a97d8c176 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 23 20:59:26.103244 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:59:26.103244 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:59:26.103244 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:59:26.103244 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:59:26.103244 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:59:26.103244 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:59:26.103244 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:59:26.103244 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:59:26.103244 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:59:26.103244 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:59:26.103244 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:59:26.103244 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:59:26.103244 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:59:26.103244 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:59:26.103244 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:59:26.104522 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:59:26.104522 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:59:26.104522 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:59:26.104522 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:59:26.104522 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:59:26.104522 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:59:26.104522 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:59:26.104522 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:59:26.104522 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:59:26.104522 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:59:26.104522 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:59:26.104522 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application with Lock( Jul 23 20:59:26.104522 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:59:26.104522 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:59:26.104522 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:59:26.104522 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:59:26.105795 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:59:26.105795 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:59:26.105795 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:59:26.105795 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:59:26.105795 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:59:26.105795 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:59:26.105795 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:59:26.105795 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:59:26.105795 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:59:26.105795 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:59:26.105795 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 23 20:59:26.105795 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 20:59:26.105795 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 576/1141] 10.222.0.17 () {56 vars in 1096 bytes} [Sat Jul 23 20:59:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:59:26.111106 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fa9286-5326-4389-a297-3b46cbe5eee1 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:59:26.181419 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:59:26.223547 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fa9286-5326-4389-a297-3b46cbe5eee1 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:59:26.260365 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e303aed-b130-4c00-962e-39e7c7af67b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:59:26.261044 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e303aed-b130-4c00-962e-39e7c7af67b2 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:59:26.261318 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e303aed-b130-4c00-962e-39e7c7af67b2 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:59:26.261582 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e303aed-b130-4c00-962e-39e7c7af67b2 None admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:59:26.262369 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e303aed-b130-4c00-962e-39e7c7af67b2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:59:26.263290 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e303aed-b130-4c00-962e-39e7c7af67b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:59:26.264051 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e303aed-b130-4c00-962e-39e7c7af67b2 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:59:26.273216 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 566/1142] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Jul 23 20:59:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:59:26.279587 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84afbf4a-583c-4339-b641-152a97d8c176 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:59:26.391408 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84afbf4a-583c-4339-b641-152a97d8c176 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:59:26.425941 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a44c9b1-90eb-4d7e-a0f5-e955f16508c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:59:26.426856 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a44c9b1-90eb-4d7e-a0f5-e955f16508c8 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:59:26.427139 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a44c9b1-90eb-4d7e-a0f5-e955f16508c8 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:59:26.427400 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a44c9b1-90eb-4d7e-a0f5-e955f16508c8 None admin] PATH_INFO: `/v3/users/d296bfd7fe8b48bd84f4ae2438ded9c1` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:59:26.442349 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a44c9b1-90eb-4d7e-a0f5-e955f16508c8 None admin] RBAC: Authorizing `identity:get_user(user_id=d296bfd7fe8b48bd84f4ae2438ded9c1)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:59:26.444166 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a44c9b1-90eb-4d7e-a0f5-e955f16508c8 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:59:26.446229 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 577/1143] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Jul 23 20:59:26 2022] GET /identity/v3/users/d296bfd7fe8b48bd84f4ae2438ded9c1 => generated 286 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:59:26.452572 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e303aed-b130-4c00-962e-39e7c7af67b2 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:59:26.565023 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e303aed-b130-4c00-962e-39e7c7af67b2 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:59:26.597430 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:59:26.611637 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed81e72-f229-4bc2-b8fd-901d795e4c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:59:26.612292 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed81e72-f229-4bc2-b8fd-901d795e4c4f None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:59:26.612597 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed81e72-f229-4bc2-b8fd-901d795e4c4f None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:59:26.612868 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed81e72-f229-4bc2-b8fd-901d795e4c4f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:59:26.683418 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed81e72-f229-4bc2-b8fd-901d795e4c4f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:59:26.684842 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed81e72-f229-4bc2-b8fd-901d795e4c4f None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:59:26.789356 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 567/1144] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Jul 23 20:59:26 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 23 20:59:26.796950 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a44c9b1-90eb-4d7e-a0f5-e955f16508c8 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:59:26.836720 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:59:26.903512 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a44c9b1-90eb-4d7e-a0f5-e955f16508c8 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:59:26.937566 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5ea234-8726-4bf5-b7f7-c0f3b5fa5d77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:59:26.938339 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5ea234-8726-4bf5-b7f7-c0f3b5fa5d77 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:59:26.938620 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5ea234-8726-4bf5-b7f7-c0f3b5fa5d77 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:59:26.938893 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5ea234-8726-4bf5-b7f7-c0f3b5fa5d77 None admin] PATH_INFO: `/v3/projects/4a3c6db052334bcf9e8cef477b44865f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:59:26.940118 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5ea234-8726-4bf5-b7f7-c0f3b5fa5d77 None admin] RBAC: Authorizing `identity:get_project(project_id=4a3c6db052334bcf9e8cef477b44865f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:59:26.941566 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5ea234-8726-4bf5-b7f7-c0f3b5fa5d77 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:59:26.943430 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 578/1145] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Jul 23 20:59:26 2022] GET /identity/v3/projects/4a3c6db052334bcf9e8cef477b44865f => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:59:26.951740 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed81e72-f229-4bc2-b8fd-901d795e4c4f None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:59:26.976203 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:59:27.056290 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed81e72-f229-4bc2-b8fd-901d795e4c4f None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:59:27.095867 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f33dec-2288-46fa-9644-657df53bd137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:59:27.096542 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f33dec-2288-46fa-9644-657df53bd137 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:59:27.096859 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f33dec-2288-46fa-9644-657df53bd137 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:59:27.097131 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f33dec-2288-46fa-9644-657df53bd137 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:59:27.098006 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f33dec-2288-46fa-9644-657df53bd137 None admin] RBAC: Adding query filter params (role.id=fec17bfdc65349a2b9c06a89131191df, scope.project.id=4a3c6db052334bcf9e8cef477b44865f, user.id=d296bfd7fe8b48bd84f4ae2438ded9c1) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:59:27.098315 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f33dec-2288-46fa-9644-657df53bd137 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:59:27.099844 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f33dec-2288-46fa-9644-657df53bd137 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:59:27.106416 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 568/1146] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Jul 23 20:59:26 2022] GET /identity/v3/role_assignments?user.id=d296bfd7fe8b48bd84f4ae2438ded9c1&scope.project.id=4a3c6db052334bcf9e8cef477b44865f&role.id=fec17bfdc65349a2b9c06a89131191df => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:59:29.369655 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c874d8-18ba-4b2f-8adc-c2144450b443 None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:59:29.370494 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c874d8-18ba-4b2f-8adc-c2144450b443 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:59:29.370494 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c874d8-18ba-4b2f-8adc-c2144450b443 None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:59:29.372632 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 579/1147] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:59:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:59:29.378982 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf435718-bbe9-4c71-b5aa-d32b1af5dec4 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:59:29.379435 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf435718-bbe9-4c71-b5aa-d32b1af5dec4 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:59:29.379535 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf435718-bbe9-4c71-b5aa-d32b1af5dec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:59:29.403609 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-bf435718-bbe9-4c71-b5aa-d32b1af5dec4 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:59:29.404832 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-bf435718-bbe9-4c71-b5aa-d32b1af5dec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:59:29.476711 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 569/1148] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:59:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 23 20:59:29.509889 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c874d8-18ba-4b2f-8adc-c2144450b443 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:59:29.630616 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c874d8-18ba-4b2f-8adc-c2144450b443 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:59:29.633646 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:59:29.669138 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138df60e-c1e5-4e7c-b7dc-c2653a654130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:59:29.669961 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138df60e-c1e5-4e7c-b7dc-c2653a654130 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:59:29.670233 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138df60e-c1e5-4e7c-b7dc-c2653a654130 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:59:29.670503 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138df60e-c1e5-4e7c-b7dc-c2653a654130 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:59:29.681467 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138df60e-c1e5-4e7c-b7dc-c2653a654130 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:59:29.689027 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-138df60e-c1e5-4e7c-b7dc-c2653a654130 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 23 20:59:29.689027 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:59:29.689027 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:59:29.689027 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:59:29.689027 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:59:29.689027 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:59:29.689027 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:59:29.689027 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:59:29.689027 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:59:29.689027 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:59:29.689027 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:59:29.689027 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:59:29.689027 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:59:29.689027 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:59:29.689027 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:59:29.689027 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:59:29.690363 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:59:29.690363 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:59:29.690363 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:59:29.690363 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:59:29.690363 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:59:29.690363 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:59:29.690363 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:59:29.690363 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:59:29.690363 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:59:29.690363 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:59:29.690363 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:59:29.690363 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application with Lock( Jul 23 20:59:29.690363 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:59:29.690363 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:59:29.690363 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:59:29.690363 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:59:29.691807 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:59:29.691807 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:59:29.691807 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:59:29.691807 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:59:29.691807 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:59:29.691807 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:59:29.691807 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:59:29.691807 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:59:29.691807 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:59:29.691807 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:59:29.691807 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 23 20:59:29.691807 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 20:59:29.691807 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 580/1149] 10.222.0.17 () {56 vars in 1096 bytes} [Sat Jul 23 20:59:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:59:29.699682 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf435718-bbe9-4c71-b5aa-d32b1af5dec4 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:59:29.721626 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:59:29.819773 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf435718-bbe9-4c71-b5aa-d32b1af5dec4 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:59:29.855176 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf407af-cf6a-4e78-9a42-874600059897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:59:29.855842 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf407af-cf6a-4e78-9a42-874600059897 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:59:29.856117 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf407af-cf6a-4e78-9a42-874600059897 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:59:29.856391 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf407af-cf6a-4e78-9a42-874600059897 None admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:59:29.857126 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf407af-cf6a-4e78-9a42-874600059897 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:59:29.857422 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf407af-cf6a-4e78-9a42-874600059897 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:59:29.858844 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf407af-cf6a-4e78-9a42-874600059897 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:59:29.866817 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 570/1150] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Jul 23 20:59:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:59:29.873592 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138df60e-c1e5-4e7c-b7dc-c2653a654130 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:59:29.981758 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138df60e-c1e5-4e7c-b7dc-c2653a654130 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:59:30.016946 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c44b6c-2b6b-4c46-bba4-009f54ecd5dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:59:30.017820 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c44b6c-2b6b-4c46-bba4-009f54ecd5dc None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:59:30.018118 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c44b6c-2b6b-4c46-bba4-009f54ecd5dc None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:59:30.018383 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c44b6c-2b6b-4c46-bba4-009f54ecd5dc None admin] PATH_INFO: `/v3/users/d296bfd7fe8b48bd84f4ae2438ded9c1` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:59:30.019581 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c44b6c-2b6b-4c46-bba4-009f54ecd5dc None admin] RBAC: Authorizing `identity:get_user(user_id=d296bfd7fe8b48bd84f4ae2438ded9c1)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:59:30.021069 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c44b6c-2b6b-4c46-bba4-009f54ecd5dc None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:59:30.022752 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 581/1151] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Jul 23 20:59:29 2022] GET /identity/v3/users/d296bfd7fe8b48bd84f4ae2438ded9c1 => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:59:30.030976 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf407af-cf6a-4e78-9a42-874600059897 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:59:30.119071 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:59:30.143531 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf407af-cf6a-4e78-9a42-874600059897 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:59:30.179251 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5eeecf-284d-46f9-8ccf-3e6ac54f1b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:59:30.180110 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5eeecf-284d-46f9-8ccf-3e6ac54f1b21 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:59:30.180391 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5eeecf-284d-46f9-8ccf-3e6ac54f1b21 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:59:30.180656 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5eeecf-284d-46f9-8ccf-3e6ac54f1b21 None admin] PATH_INFO: `/v3/projects/4a3c6db052334bcf9e8cef477b44865f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:59:30.181920 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5eeecf-284d-46f9-8ccf-3e6ac54f1b21 None admin] RBAC: Authorizing `identity:get_project(project_id=4a3c6db052334bcf9e8cef477b44865f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:59:30.183365 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5eeecf-284d-46f9-8ccf-3e6ac54f1b21 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:59:30.185118 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 571/1152] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Jul 23 20:59:30 2022] GET /identity/v3/projects/4a3c6db052334bcf9e8cef477b44865f => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:59:30.192627 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c44b6c-2b6b-4c46-bba4-009f54ecd5dc None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:59:30.228444 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:59:30.301680 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c44b6c-2b6b-4c46-bba4-009f54ecd5dc None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:59:30.334774 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a07f9b8-d1cf-44f9-aa63-af31638a1cae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:59:30.335673 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a07f9b8-d1cf-44f9-aa63-af31638a1cae None admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:59:30.335948 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a07f9b8-d1cf-44f9-aa63-af31638a1cae None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:59:30.336216 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a07f9b8-d1cf-44f9-aa63-af31638a1cae None admin] PATH_INFO: `/v3/projects/4a3c6db052334bcf9e8cef477b44865f/users/d296bfd7fe8b48bd84f4ae2438ded9c1/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:59:30.338240 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a07f9b8-d1cf-44f9-aa63-af31638a1cae None admin] RBAC: Authorizing `identity:create_grant(project_id=4a3c6db052334bcf9e8cef477b44865f, user_id=d296bfd7fe8b48bd84f4ae2438ded9c1, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:59:30.339679 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a07f9b8-d1cf-44f9-aa63-af31638a1cae None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:59:30.354768 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 582/1153] 10.222.0.17 () {58 vars in 1439 bytes} [Sat Jul 23 20:59:30 2022] PUT /identity/v3/projects/4a3c6db052334bcf9e8cef477b44865f/users/d296bfd7fe8b48bd84f4ae2438ded9c1/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 20:59:32.585687 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3df415-43f2-49bf-b282-59433c60b70f None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:59:32.586286 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3df415-43f2-49bf-b282-59433c60b70f None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:59:32.586286 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3df415-43f2-49bf-b282-59433c60b70f None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:59:32.587640 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 572/1154] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:59:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:59:32.593039 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b115ab5-571c-487e-a437-51a52626a3e8 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:59:32.593468 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b115ab5-571c-487e-a437-51a52626a3e8 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:59:32.593556 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b115ab5-571c-487e-a437-51a52626a3e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:59:32.610945 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-5b115ab5-571c-487e-a437-51a52626a3e8 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:59:32.612134 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-5b115ab5-571c-487e-a437-51a52626a3e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:59:32.683941 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 583/1155] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:59:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 23 20:59:32.709392 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3df415-43f2-49bf-b282-59433c60b70f None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:59:32.821241 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3df415-43f2-49bf-b282-59433c60b70f None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:59:32.858630 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815c9409-7b0b-4664-94eb-a086dcea48eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:59:32.859348 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815c9409-7b0b-4664-94eb-a086dcea48eb None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:59:32.859629 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815c9409-7b0b-4664-94eb-a086dcea48eb None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:59:32.859900 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815c9409-7b0b-4664-94eb-a086dcea48eb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:59:32.871571 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815c9409-7b0b-4664-94eb-a086dcea48eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:59:32.879181 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-815c9409-7b0b-4664-94eb-a086dcea48eb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 23 20:59:32.879181 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:59:32.879181 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:59:32.879181 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:59:32.879181 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:59:32.879181 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:59:32.879181 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:59:32.879181 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:59:32.879181 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:59:32.879181 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:59:32.879181 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:59:32.879181 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:59:32.879181 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:59:32.879181 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:59:32.879181 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:59:32.879181 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:59:32.880344 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:59:32.880344 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:59:32.880344 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:59:32.880344 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:59:32.880344 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:59:32.880344 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:59:32.880344 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:59:32.880344 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:59:32.880344 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:59:32.880344 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:59:32.880344 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:59:32.880344 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application with Lock( Jul 23 20:59:32.880344 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:59:32.880344 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:59:32.880344 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:59:32.880344 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:59:32.881423 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:59:32.881423 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:59:32.881423 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:59:32.881423 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:59:32.881423 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:59:32.881423 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:59:32.881423 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:59:32.881423 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:59:32.881423 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:59:32.881423 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:59:32.881423 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 23 20:59:32.881423 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:59:32.881423 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 573/1156] 10.222.0.17 () {56 vars in 1096 bytes} [Sat Jul 23 20:59:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:59:32.886820 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b115ab5-571c-487e-a437-51a52626a3e8 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:59:32.911936 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:59:32.989008 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b115ab5-571c-487e-a437-51a52626a3e8 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:59:33.024735 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53ff376-b18f-4831-8214-25d400f3da14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:59:33.025395 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53ff376-b18f-4831-8214-25d400f3da14 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:59:33.025650 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53ff376-b18f-4831-8214-25d400f3da14 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:59:33.025983 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53ff376-b18f-4831-8214-25d400f3da14 None admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:59:33.026721 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53ff376-b18f-4831-8214-25d400f3da14 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:59:33.027376 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53ff376-b18f-4831-8214-25d400f3da14 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:59:33.028743 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53ff376-b18f-4831-8214-25d400f3da14 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:59:33.037579 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 584/1157] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Jul 23 20:59:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:59:33.044347 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815c9409-7b0b-4664-94eb-a086dcea48eb None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:59:33.057642 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:59:33.157523 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815c9409-7b0b-4664-94eb-a086dcea48eb None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:59:33.196631 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcb1356-0e19-4e6b-ab0b-16480ec350a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:59:33.197506 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcb1356-0e19-4e6b-ab0b-16480ec350a0 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:59:33.197779 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcb1356-0e19-4e6b-ab0b-16480ec350a0 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:59:33.198075 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcb1356-0e19-4e6b-ab0b-16480ec350a0 None admin] PATH_INFO: `/v3/users/d296bfd7fe8b48bd84f4ae2438ded9c1` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:59:33.199371 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcb1356-0e19-4e6b-ab0b-16480ec350a0 None admin] RBAC: Authorizing `identity:get_user(user_id=d296bfd7fe8b48bd84f4ae2438ded9c1)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:59:33.200811 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcb1356-0e19-4e6b-ab0b-16480ec350a0 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:59:33.202471 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 574/1158] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Jul 23 20:59:33 2022] GET /identity/v3/users/d296bfd7fe8b48bd84f4ae2438ded9c1 => generated 286 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:59:33.210782 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53ff376-b18f-4831-8214-25d400f3da14 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:59:33.310322 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:59:33.336233 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53ff376-b18f-4831-8214-25d400f3da14 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:59:33.375557 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43a6225-9dd2-44e4-9885-885a7c8cad3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:59:33.376219 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43a6225-9dd2-44e4-9885-885a7c8cad3d None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:59:33.376502 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43a6225-9dd2-44e4-9885-885a7c8cad3d None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:59:33.376781 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43a6225-9dd2-44e4-9885-885a7c8cad3d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:59:33.455177 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43a6225-9dd2-44e4-9885-885a7c8cad3d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:59:33.456370 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43a6225-9dd2-44e4-9885-885a7c8cad3d None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:59:33.545682 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:59:33.563237 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 585/1159] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Jul 23 20:59:33 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 23 20:59:33.570969 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcb1356-0e19-4e6b-ab0b-16480ec350a0 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:59:33.650160 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:59:33.676665 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcb1356-0e19-4e6b-ab0b-16480ec350a0 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:59:33.723356 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31cd35f-4002-45cc-b35a-9b20b33a0ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:59:33.724203 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31cd35f-4002-45cc-b35a-9b20b33a0ced None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:59:33.724482 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31cd35f-4002-45cc-b35a-9b20b33a0ced None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:59:33.724755 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31cd35f-4002-45cc-b35a-9b20b33a0ced None admin] PATH_INFO: `/v3/projects/4a3c6db052334bcf9e8cef477b44865f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:59:33.726071 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31cd35f-4002-45cc-b35a-9b20b33a0ced None admin] RBAC: Authorizing `identity:get_project(project_id=4a3c6db052334bcf9e8cef477b44865f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:59:33.727537 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31cd35f-4002-45cc-b35a-9b20b33a0ced None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:59:33.729276 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 575/1160] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Jul 23 20:59:33 2022] GET /identity/v3/projects/4a3c6db052334bcf9e8cef477b44865f => generated 311 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:59:33.736441 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43a6225-9dd2-44e4-9885-885a7c8cad3d None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:59:33.845961 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43a6225-9dd2-44e4-9885-885a7c8cad3d None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:59:33.886277 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa31738-3316-4083-ba77-bc55ad7931da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:59:33.886927 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa31738-3316-4083-ba77-bc55ad7931da None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:59:33.887203 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa31738-3316-4083-ba77-bc55ad7931da None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:59:33.887468 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa31738-3316-4083-ba77-bc55ad7931da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:59:33.888280 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa31738-3316-4083-ba77-bc55ad7931da None admin] RBAC: Adding query filter params (role.id=fec17bfdc65349a2b9c06a89131191df, scope.project.id=4a3c6db052334bcf9e8cef477b44865f, user.id=d296bfd7fe8b48bd84f4ae2438ded9c1) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:59:33.888608 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa31738-3316-4083-ba77-bc55ad7931da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:59:33.890025 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa31738-3316-4083-ba77-bc55ad7931da None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:59:33.895962 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 586/1161] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Jul 23 20:59:33 2022] GET /identity/v3/role_assignments?user.id=d296bfd7fe8b48bd84f4ae2438ded9c1&scope.project.id=4a3c6db052334bcf9e8cef477b44865f&role.id=fec17bfdc65349a2b9c06a89131191df => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:59:36.192184 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568abeea-8a24-40f9-a056-994baeb266a4 None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:59:36.192727 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568abeea-8a24-40f9-a056-994baeb266a4 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:59:36.195154 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568abeea-8a24-40f9-a056-994baeb266a4 None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:59:36.196563 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 576/1162] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:59:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:59:36.206206 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc643cf-ee98-429d-ad67-88ca1b429ce9 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:59:36.207047 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc643cf-ee98-429d-ad67-88ca1b429ce9 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:59:36.207047 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc643cf-ee98-429d-ad67-88ca1b429ce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:59:36.225546 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-4cc643cf-ee98-429d-ad67-88ca1b429ce9 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:59:36.226764 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-4cc643cf-ee98-429d-ad67-88ca1b429ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:59:36.275125 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:59:36.304701 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 587/1163] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:59:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 23 20:59:36.328360 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568abeea-8a24-40f9-a056-994baeb266a4 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:59:36.441551 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568abeea-8a24-40f9-a056-994baeb266a4 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:59:36.477336 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d55b93a-565a-4be7-9396-7badfe209e2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:59:36.478268 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d55b93a-565a-4be7-9396-7badfe209e2d None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:59:36.478547 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d55b93a-565a-4be7-9396-7badfe209e2d None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:59:36.478814 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d55b93a-565a-4be7-9396-7badfe209e2d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:59:36.492274 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:59:36.570613 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d55b93a-565a-4be7-9396-7badfe209e2d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:59:36.572105 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d55b93a-565a-4be7-9396-7badfe209e2d None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:59:36.679490 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 577/1164] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Jul 23 20:59:36 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 23 20:59:36.686112 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc643cf-ee98-429d-ad67-88ca1b429ce9 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:59:36.791540 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc643cf-ee98-429d-ad67-88ca1b429ce9 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:59:36.830019 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db69d83a-da09-4193-8519-0da966252b7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:59:36.830848 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db69d83a-da09-4193-8519-0da966252b7a None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:59:36.831111 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db69d83a-da09-4193-8519-0da966252b7a None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:59:36.831394 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db69d83a-da09-4193-8519-0da966252b7a None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:59:36.838561 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db69d83a-da09-4193-8519-0da966252b7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:59:36.840015 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db69d83a-da09-4193-8519-0da966252b7a None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:59:36.854286 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-db69d83a-da09-4193-8519-0da966252b7a None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 23 20:59:36.854286 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:59:36.854286 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 23 20:59:36.854286 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 23 20:59:36.854286 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 23 20:59:36.854286 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 23 20:59:36.854286 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 23 20:59:36.854286 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 23 20:59:36.854286 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 23 20:59:36.854286 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 20:59:36.854286 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 23 20:59:36.854286 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 20:59:36.854286 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:59:36.854286 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:59:36.854286 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:59:36.854286 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:59:36.854286 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:59:36.855460 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:59:36.855460 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:59:36.855460 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:59:36.855460 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:59:36.855460 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:59:36.855460 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:59:36.855460 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 23 20:59:36.855460 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 23 20:59:36.855460 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 23 20:59:36.855460 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 23 20:59:36.855460 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:59:36.855460 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:59:36.855460 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:59:36.855460 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:59:36.855460 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:59:36.855460 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:59:36.856664 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:59:36.856664 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application with Lock( Jul 23 20:59:36.856664 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:59:36.856664 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:59:36.856664 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:59:36.856664 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:59:36.856664 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:59:36.856664 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:59:36.856664 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:59:36.856664 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:59:36.856664 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 23 20:59:36.856664 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 23 20:59:36.856664 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 23 20:59:36.856664 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 20:59:36.856664 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 588/1165] 10.222.0.17 () {56 vars in 1117 bytes} [Sat Jul 23 20:59:36 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:59:36.861676 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d55b93a-565a-4be7-9396-7badfe209e2d None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:59:36.906372 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:59:36.966526 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d55b93a-565a-4be7-9396-7badfe209e2d None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:59:37.005090 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d2714e-b4ce-427d-a0cb-c9e8ae546026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:59:37.005758 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d2714e-b4ce-427d-a0cb-c9e8ae546026 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:59:37.006065 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d2714e-b4ce-427d-a0cb-c9e8ae546026 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:59:37.006341 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d2714e-b4ce-427d-a0cb-c9e8ae546026 None admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:59:37.007064 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d2714e-b4ce-427d-a0cb-c9e8ae546026 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:59:37.007363 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d2714e-b4ce-427d-a0cb-c9e8ae546026 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:59:37.008742 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d2714e-b4ce-427d-a0cb-c9e8ae546026 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:59:37.016369 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 578/1166] 10.222.0.17 () {56 vars in 1115 bytes} [Sat Jul 23 20:59:36 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:59:39.263580 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69e0dac-74a6-485e-b33d-14814aceec6a None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:59:39.264418 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69e0dac-74a6-485e-b33d-14814aceec6a None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:59:39.264418 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69e0dac-74a6-485e-b33d-14814aceec6a None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:59:39.266744 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 589/1167] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:59:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:59:39.274070 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4f1c83-aa22-413c-9ed9-01840c9c2f17 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:59:39.275293 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4f1c83-aa22-413c-9ed9-01840c9c2f17 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:59:39.275293 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4f1c83-aa22-413c-9ed9-01840c9c2f17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:59:39.293684 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-3b4f1c83-aa22-413c-9ed9-01840c9c2f17 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:59:39.294958 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-3b4f1c83-aa22-413c-9ed9-01840c9c2f17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:59:39.364180 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 579/1168] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:59:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 23 20:59:39.397938 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69e0dac-74a6-485e-b33d-14814aceec6a None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:59:39.457850 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:59:39.524368 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69e0dac-74a6-485e-b33d-14814aceec6a None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:59:39.559976 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5471313d-ad86-46b5-b8df-29b35ef1c9ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:59:39.560637 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5471313d-ad86-46b5-b8df-29b35ef1c9ef None admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:59:39.560911 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5471313d-ad86-46b5-b8df-29b35ef1c9ef None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:59:39.561179 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5471313d-ad86-46b5-b8df-29b35ef1c9ef None admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:59:39.561939 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5471313d-ad86-46b5-b8df-29b35ef1c9ef None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:59:39.563303 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5471313d-ad86-46b5-b8df-29b35ef1c9ef None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:59:39.581105 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 590/1169] 10.222.0.17 () {60 vars in 1138 bytes} [Sat Jul 23 20:59:39 2022] POST /identity/v3/domains => generated 267 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 20:59:41.857928 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffe6ab4-f101-4aa3-901b-d1f5172fbfe6 None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:59:41.858773 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffe6ab4-f101-4aa3-901b-d1f5172fbfe6 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:59:41.858950 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffe6ab4-f101-4aa3-901b-d1f5172fbfe6 None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:59:41.861078 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 580/1170] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:59:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:59:41.866529 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a672ce90-ca15-4704-b8be-60a855b9dcb2 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:59:41.866948 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a672ce90-ca15-4704-b8be-60a855b9dcb2 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:59:41.867064 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a672ce90-ca15-4704-b8be-60a855b9dcb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:59:41.886410 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-a672ce90-ca15-4704-b8be-60a855b9dcb2 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:59:41.887572 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-a672ce90-ca15-4704-b8be-60a855b9dcb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:59:41.962791 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 591/1171] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:59:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 23 20:59:41.988775 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffe6ab4-f101-4aa3-901b-d1f5172fbfe6 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:59:42.027634 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:59:42.098382 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffe6ab4-f101-4aa3-901b-d1f5172fbfe6 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:59:42.133123 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeb1595-c1db-44dd-b113-b71cb49edb22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:59:42.134018 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeb1595-c1db-44dd-b113-b71cb49edb22 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:59:42.134308 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeb1595-c1db-44dd-b113-b71cb49edb22 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:59:42.134528 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeb1595-c1db-44dd-b113-b71cb49edb22 None admin] PATH_INFO: `/v3/domains/52df05d62d8b43679f33cb8c74cf49a2` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:59:42.145769 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdeb1595-c1db-44dd-b113-b71cb49edb22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=52df05d62d8b43679f33cb8c74cf49a2)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:59:42.147257 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdeb1595-c1db-44dd-b113-b71cb49edb22 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:59:42.148901 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 581/1172] 10.222.0.17 () {56 vars in 1183 bytes} [Sat Jul 23 20:59:41 2022] GET /identity/v3/domains/52df05d62d8b43679f33cb8c74cf49a2 => generated 267 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:59:42.155519 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a672ce90-ca15-4704-b8be-60a855b9dcb2 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:59:42.187994 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:59:42.266908 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a672ce90-ca15-4704-b8be-60a855b9dcb2 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:59:42.316844 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c7eef3-e2d1-4234-a3e2-609fa3b5c55b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:59:42.317517 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c7eef3-e2d1-4234-a3e2-609fa3b5c55b None admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:59:42.317797 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c7eef3-e2d1-4234-a3e2-609fa3b5c55b None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:59:42.318102 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c7eef3-e2d1-4234-a3e2-609fa3b5c55b None admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:59:42.318811 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c7eef3-e2d1-4234-a3e2-609fa3b5c55b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:59:42.320251 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c7eef3-e2d1-4234-a3e2-609fa3b5c55b None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:59:42.349370 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 592/1173] 10.222.0.17 () {60 vars in 1141 bytes} [Sat Jul 23 20:59:42 2022] POST /identity/v3/projects => generated 361 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 20:59:44.656962 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c4dcd4-9c66-445b-b43f-e5aca1f67c2d None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:59:44.657604 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c4dcd4-9c66-445b-b43f-e5aca1f67c2d None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:59:44.657604 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c4dcd4-9c66-445b-b43f-e5aca1f67c2d None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:59:44.658928 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 582/1174] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:59:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:59:44.664674 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca4d1a0-14ae-474b-bdce-7a81dad51f21 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:59:44.665128 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca4d1a0-14ae-474b-bdce-7a81dad51f21 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:59:44.665221 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca4d1a0-14ae-474b-bdce-7a81dad51f21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:59:44.682879 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-cca4d1a0-14ae-474b-bdce-7a81dad51f21 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:59:44.684078 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-cca4d1a0-14ae-474b-bdce-7a81dad51f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:59:44.755596 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 593/1175] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:59:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 23 20:59:44.782476 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c4dcd4-9c66-445b-b43f-e5aca1f67c2d None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:59:44.884416 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:59:44.892105 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c4dcd4-9c66-445b-b43f-e5aca1f67c2d None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:59:44.929221 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017f0778-d956-44d6-aba0-4059560bb927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:59:44.930060 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017f0778-d956-44d6-aba0-4059560bb927 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:59:44.930338 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017f0778-d956-44d6-aba0-4059560bb927 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:59:44.930608 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017f0778-d956-44d6-aba0-4059560bb927 None admin] PATH_INFO: `/v3/domains/52df05d62d8b43679f33cb8c74cf49a2` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:59:44.931818 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017f0778-d956-44d6-aba0-4059560bb927 None admin] RBAC: Authorizing `identity:get_domain(domain_id=52df05d62d8b43679f33cb8c74cf49a2)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:59:44.933261 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017f0778-d956-44d6-aba0-4059560bb927 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:59:44.934929 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 583/1176] 10.222.0.17 () {56 vars in 1183 bytes} [Sat Jul 23 20:59:44 2022] GET /identity/v3/domains/52df05d62d8b43679f33cb8c74cf49a2 => generated 267 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:59:44.941135 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca4d1a0-14ae-474b-bdce-7a81dad51f21 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:59:44.955152 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:59:45.060728 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca4d1a0-14ae-474b-bdce-7a81dad51f21 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:59:45.099967 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c36f8c3-fdb4-4266-9ede-e9377043f45b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:59:45.100643 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c36f8c3-fdb4-4266-9ede-e9377043f45b None admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:59:45.100920 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c36f8c3-fdb4-4266-9ede-e9377043f45b None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:59:45.101183 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c36f8c3-fdb4-4266-9ede-e9377043f45b None admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:59:45.101922 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c36f8c3-fdb4-4266-9ede-e9377043f45b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:59:45.103339 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c36f8c3-fdb4-4266-9ede-e9377043f45b None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:59:45.124115 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 594/1177] 10.222.0.17 () {60 vars in 1132 bytes} [Sat Jul 23 20:59:44 2022] POST /identity/v3/users => generated 311 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 20:59:47.439015 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54da5001-9b2d-4756-9760-a8e032862122 None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:59:47.439570 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54da5001-9b2d-4756-9760-a8e032862122 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:59:47.439570 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54da5001-9b2d-4756-9760-a8e032862122 None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:59:47.440980 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 584/1178] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:59:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:59:47.447538 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef87afd3-aa95-4e69-8fd4-1ff3287959a8 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:59:47.448299 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef87afd3-aa95-4e69-8fd4-1ff3287959a8 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:59:47.448435 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef87afd3-aa95-4e69-8fd4-1ff3287959a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:59:47.468986 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-ef87afd3-aa95-4e69-8fd4-1ff3287959a8 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:59:47.470214 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-ef87afd3-aa95-4e69-8fd4-1ff3287959a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:59:47.534399 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:59:47.546135 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 595/1179] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:59:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 23 20:59:47.573678 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54da5001-9b2d-4756-9760-a8e032862122 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:59:47.696201 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54da5001-9b2d-4756-9760-a8e032862122 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:59:47.733193 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18e9a02-5163-45fc-9597-271e9ef7edfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:59:47.734018 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18e9a02-5163-45fc-9597-271e9ef7edfb None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:59:47.734293 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18e9a02-5163-45fc-9597-271e9ef7edfb None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:59:47.734561 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18e9a02-5163-45fc-9597-271e9ef7edfb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:59:47.746568 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18e9a02-5163-45fc-9597-271e9ef7edfb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:59:47.755557 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-e18e9a02-5163-45fc-9597-271e9ef7edfb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 23 20:59:47.755557 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:59:47.755557 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:59:47.755557 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:59:47.755557 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:59:47.755557 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:59:47.755557 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:59:47.755557 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:59:47.755557 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:59:47.755557 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:59:47.755557 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:59:47.755557 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:59:47.755557 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:59:47.755557 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:59:47.755557 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:59:47.755557 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:59:47.756724 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:59:47.756724 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:59:47.756724 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:59:47.756724 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:59:47.756724 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:59:47.756724 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:59:47.756724 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:59:47.756724 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:59:47.756724 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:59:47.756724 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:59:47.756724 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:59:47.756724 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application with Lock( Jul 23 20:59:47.756724 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:59:47.756724 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:59:47.756724 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:59:47.756724 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:59:47.757848 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:59:47.757848 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:59:47.757848 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:59:47.757848 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:59:47.757848 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:59:47.757848 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:59:47.757848 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:59:47.757848 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:59:47.757848 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:59:47.757848 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:59:47.757848 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 23 20:59:47.757848 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:59:47.757848 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 585/1180] 10.222.0.17 () {56 vars in 1096 bytes} [Sat Jul 23 20:59:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:59:47.767238 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef87afd3-aa95-4e69-8fd4-1ff3287959a8 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:59:47.872188 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef87afd3-aa95-4e69-8fd4-1ff3287959a8 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:59:47.911207 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b612da58-517b-4107-8899-f4670e024aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:59:47.911864 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b612da58-517b-4107-8899-f4670e024aad None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:59:47.912140 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b612da58-517b-4107-8899-f4670e024aad None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:59:47.912413 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b612da58-517b-4107-8899-f4670e024aad None admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:59:47.913140 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b612da58-517b-4107-8899-f4670e024aad None admin] RBAC: Adding query filter params (name=admin) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:59:47.913432 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b612da58-517b-4107-8899-f4670e024aad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:59:47.914835 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b612da58-517b-4107-8899-f4670e024aad None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:59:47.923687 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 596/1181] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Jul 23 20:59:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 20:59:47.930588 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18e9a02-5163-45fc-9597-271e9ef7edfb None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:59:47.970271 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:59:48.051778 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18e9a02-5163-45fc-9597-271e9ef7edfb None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:59:48.087630 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf13aa0-103c-4a2a-a577-2dcacafd966b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:59:48.088548 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf13aa0-103c-4a2a-a577-2dcacafd966b None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:59:48.088822 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf13aa0-103c-4a2a-a577-2dcacafd966b None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:59:48.089086 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf13aa0-103c-4a2a-a577-2dcacafd966b None admin] PATH_INFO: `/v3/users/aed5cb2e40d14d4bb604949e77d761d1` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:59:48.102806 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf13aa0-103c-4a2a-a577-2dcacafd966b None admin] RBAC: Authorizing `identity:get_user(user_id=aed5cb2e40d14d4bb604949e77d761d1)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:59:48.104276 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf13aa0-103c-4a2a-a577-2dcacafd966b None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:59:48.105996 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 586/1182] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Jul 23 20:59:47 2022] GET /identity/v3/users/aed5cb2e40d14d4bb604949e77d761d1 => generated 311 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:59:48.112191 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b612da58-517b-4107-8899-f4670e024aad None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:59:48.174860 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:59:48.218076 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b612da58-517b-4107-8899-f4670e024aad None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:59:48.255571 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7144e375-ef4f-4f48-a37a-4ea650a79131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:59:48.256294 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7144e375-ef4f-4f48-a37a-4ea650a79131 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:59:48.256584 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7144e375-ef4f-4f48-a37a-4ea650a79131 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:59:48.256838 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7144e375-ef4f-4f48-a37a-4ea650a79131 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:59:48.329064 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7144e375-ef4f-4f48-a37a-4ea650a79131 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:59:48.330539 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7144e375-ef4f-4f48-a37a-4ea650a79131 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:59:48.391636 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:59:48.436831 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 597/1183] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Jul 23 20:59:48 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 23 20:59:48.443682 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf13aa0-103c-4a2a-a577-2dcacafd966b None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:59:48.548797 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:59:48.567501 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf13aa0-103c-4a2a-a577-2dcacafd966b None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:59:48.611783 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fba2a6-106e-4dc1-96a2-d7730776fc94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:59:48.612653 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fba2a6-106e-4dc1-96a2-d7730776fc94 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:59:48.612928 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fba2a6-106e-4dc1-96a2-d7730776fc94 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:59:48.613238 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fba2a6-106e-4dc1-96a2-d7730776fc94 None admin] PATH_INFO: `/v3/projects/80fe9c78dcf6422ba8c56d0ffd294182` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:59:48.614457 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fba2a6-106e-4dc1-96a2-d7730776fc94 None admin] RBAC: Authorizing `identity:get_project(project_id=80fe9c78dcf6422ba8c56d0ffd294182)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:59:48.615901 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fba2a6-106e-4dc1-96a2-d7730776fc94 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:59:48.617609 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 587/1184] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Jul 23 20:59:48 2022] GET /identity/v3/projects/80fe9c78dcf6422ba8c56d0ffd294182 => generated 361 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 20:59:48.624095 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7144e375-ef4f-4f48-a37a-4ea650a79131 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:59:48.728956 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7144e375-ef4f-4f48-a37a-4ea650a79131 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:59:48.767044 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f41496-c764-45a1-8c9f-65fefd6f5efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:59:48.767702 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f41496-c764-45a1-8c9f-65fefd6f5efe None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:59:48.767982 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f41496-c764-45a1-8c9f-65fefd6f5efe None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:59:48.768257 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f41496-c764-45a1-8c9f-65fefd6f5efe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:59:48.769074 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f41496-c764-45a1-8c9f-65fefd6f5efe None admin] RBAC: Adding query filter params (role.id=fec17bfdc65349a2b9c06a89131191df, scope.project.id=80fe9c78dcf6422ba8c56d0ffd294182, user.id=aed5cb2e40d14d4bb604949e77d761d1) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:59:48.769383 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f41496-c764-45a1-8c9f-65fefd6f5efe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:59:48.770879 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f41496-c764-45a1-8c9f-65fefd6f5efe None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:59:48.777064 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 598/1185] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Jul 23 20:59:48 2022] GET /identity/v3/role_assignments?user.id=aed5cb2e40d14d4bb604949e77d761d1&scope.project.id=80fe9c78dcf6422ba8c56d0ffd294182&role.id=fec17bfdc65349a2b9c06a89131191df => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:59:50.972396 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b043e28-edfe-43d5-9938-90e77d1d451d None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:59:50.972955 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b043e28-edfe-43d5-9938-90e77d1d451d None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:59:50.972955 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b043e28-edfe-43d5-9938-90e77d1d451d None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:59:50.974395 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 588/1186] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:59:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:59:50.983206 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067bdd0d-7be2-47e6-9379-a8013c7cb9d1 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:59:50.983648 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067bdd0d-7be2-47e6-9379-a8013c7cb9d1 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:59:50.983769 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067bdd0d-7be2-47e6-9379-a8013c7cb9d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:59:51.009344 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-067bdd0d-7be2-47e6-9379-a8013c7cb9d1 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:59:51.010563 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-067bdd0d-7be2-47e6-9379-a8013c7cb9d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:59:51.028296 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:59:51.096216 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 599/1187] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:59:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 23 20:59:51.134080 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b043e28-edfe-43d5-9938-90e77d1d451d None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:59:51.256093 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b043e28-edfe-43d5-9938-90e77d1d451d None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:59:51.295760 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f651e6-2988-4627-8b9f-a2ec755558d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:59:51.296567 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f651e6-2988-4627-8b9f-a2ec755558d2 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:59:51.296856 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f651e6-2988-4627-8b9f-a2ec755558d2 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:59:51.297117 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f651e6-2988-4627-8b9f-a2ec755558d2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:59:51.308060 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f651e6-2988-4627-8b9f-a2ec755558d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:59:51.315645 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-94f651e6-2988-4627-8b9f-a2ec755558d2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 23 20:59:51.315645 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:59:51.315645 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:59:51.315645 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:59:51.315645 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:59:51.315645 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:59:51.315645 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:59:51.315645 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:59:51.315645 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:59:51.315645 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:59:51.315645 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:59:51.315645 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:59:51.315645 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:59:51.315645 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:59:51.315645 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:59:51.315645 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:59:51.316738 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:59:51.316738 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:59:51.316738 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:59:51.316738 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:59:51.316738 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:59:51.316738 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:59:51.316738 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:59:51.316738 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:59:51.316738 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:59:51.316738 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:59:51.316738 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:59:51.316738 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application with Lock( Jul 23 20:59:51.316738 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:59:51.316738 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:59:51.316738 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:59:51.316738 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:59:51.317780 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:59:51.317780 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:59:51.317780 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:59:51.317780 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:59:51.317780 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:59:51.317780 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:59:51.317780 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:59:51.317780 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:59:51.317780 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:59:51.317780 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:59:51.317780 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 23 20:59:51.317780 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 20:59:51.317780 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 589/1188] 10.222.0.17 () {56 vars in 1096 bytes} [Sat Jul 23 20:59:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:59:51.323317 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067bdd0d-7be2-47e6-9379-a8013c7cb9d1 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:59:51.430322 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067bdd0d-7be2-47e6-9379-a8013c7cb9d1 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:59:51.471401 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914aab4a-65bc-412d-a34d-ec5e67490f90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:59:51.472076 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914aab4a-65bc-412d-a34d-ec5e67490f90 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:59:51.472350 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914aab4a-65bc-412d-a34d-ec5e67490f90 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:59:51.472613 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914aab4a-65bc-412d-a34d-ec5e67490f90 None admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:59:51.473355 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914aab4a-65bc-412d-a34d-ec5e67490f90 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:59:51.473659 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914aab4a-65bc-412d-a34d-ec5e67490f90 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:59:51.475110 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914aab4a-65bc-412d-a34d-ec5e67490f90 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:59:51.484392 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 600/1189] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Jul 23 20:59:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:59:51.492403 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f651e6-2988-4627-8b9f-a2ec755558d2 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:59:51.506466 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:59:51.621775 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f651e6-2988-4627-8b9f-a2ec755558d2 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:59:51.671083 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9625dac5-51e4-4f9a-bb18-877e5857d967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:59:51.671980 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9625dac5-51e4-4f9a-bb18-877e5857d967 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:59:51.672259 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9625dac5-51e4-4f9a-bb18-877e5857d967 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:59:51.672529 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9625dac5-51e4-4f9a-bb18-877e5857d967 None admin] PATH_INFO: `/v3/users/aed5cb2e40d14d4bb604949e77d761d1` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:59:51.673810 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9625dac5-51e4-4f9a-bb18-877e5857d967 None admin] RBAC: Authorizing `identity:get_user(user_id=aed5cb2e40d14d4bb604949e77d761d1)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:59:51.675294 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9625dac5-51e4-4f9a-bb18-877e5857d967 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:59:51.676967 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 590/1190] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Jul 23 20:59:51 2022] GET /identity/v3/users/aed5cb2e40d14d4bb604949e77d761d1 => generated 311 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:59:51.684181 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914aab4a-65bc-412d-a34d-ec5e67490f90 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:59:51.702618 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:59:51.800134 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914aab4a-65bc-412d-a34d-ec5e67490f90 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:59:51.839385 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eb370a-ea06-41a9-b6ba-b2b38b859152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:59:51.840263 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eb370a-ea06-41a9-b6ba-b2b38b859152 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:59:51.840541 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eb370a-ea06-41a9-b6ba-b2b38b859152 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:59:51.840811 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eb370a-ea06-41a9-b6ba-b2b38b859152 None admin] PATH_INFO: `/v3/projects/80fe9c78dcf6422ba8c56d0ffd294182` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:59:51.842075 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47eb370a-ea06-41a9-b6ba-b2b38b859152 None admin] RBAC: Authorizing `identity:get_project(project_id=80fe9c78dcf6422ba8c56d0ffd294182)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:59:51.843530 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47eb370a-ea06-41a9-b6ba-b2b38b859152 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:59:51.845231 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 601/1191] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Jul 23 20:59:51 2022] GET /identity/v3/projects/80fe9c78dcf6422ba8c56d0ffd294182 => generated 361 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:59:51.853162 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9625dac5-51e4-4f9a-bb18-877e5857d967 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:59:51.939404 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:59:51.964166 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9625dac5-51e4-4f9a-bb18-877e5857d967 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:59:51.998054 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac091a5-5048-41a9-9962-ec19e9d8f619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:59:51.998942 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac091a5-5048-41a9-9962-ec19e9d8f619 None admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:59:51.999207 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac091a5-5048-41a9-9962-ec19e9d8f619 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:59:51.999530 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac091a5-5048-41a9-9962-ec19e9d8f619 None admin] PATH_INFO: `/v3/projects/80fe9c78dcf6422ba8c56d0ffd294182/users/aed5cb2e40d14d4bb604949e77d761d1/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:59:52.001698 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac091a5-5048-41a9-9962-ec19e9d8f619 None admin] RBAC: Authorizing `identity:create_grant(project_id=80fe9c78dcf6422ba8c56d0ffd294182, user_id=aed5cb2e40d14d4bb604949e77d761d1, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:59:52.003186 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac091a5-5048-41a9-9962-ec19e9d8f619 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:59:52.021776 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 591/1192] 10.222.0.17 () {58 vars in 1439 bytes} [Sat Jul 23 20:59:51 2022] PUT /identity/v3/projects/80fe9c78dcf6422ba8c56d0ffd294182/users/aed5cb2e40d14d4bb604949e77d761d1/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 20:59:54.263472 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd862f4e-e218-4455-a657-ca146b4bbaaa None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:59:54.264025 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd862f4e-e218-4455-a657-ca146b4bbaaa None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:59:54.264025 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd862f4e-e218-4455-a657-ca146b4bbaaa None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:59:54.265409 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 602/1193] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 20:59:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 20:59:54.272074 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659cffb3-e018-490c-8532-74420315060f None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:59:54.272670 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659cffb3-e018-490c-8532-74420315060f None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:59:54.272796 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659cffb3-e018-490c-8532-74420315060f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:59:54.300821 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-659cffb3-e018-490c-8532-74420315060f None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 20:59:54.302537 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-659cffb3-e018-490c-8532-74420315060f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 20:59:54.374397 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 592/1194] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 20:59:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 23 20:59:54.399921 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd862f4e-e218-4455-a657-ca146b4bbaaa None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:59:54.499901 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:59:54.523224 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd862f4e-e218-4455-a657-ca146b4bbaaa None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:59:54.567254 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e308388d-e11e-44d2-a4b4-7b638dc1688c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:59:54.568162 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e308388d-e11e-44d2-a4b4-7b638dc1688c None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:59:54.568439 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e308388d-e11e-44d2-a4b4-7b638dc1688c None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:59:54.568690 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e308388d-e11e-44d2-a4b4-7b638dc1688c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:59:54.580391 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e308388d-e11e-44d2-a4b4-7b638dc1688c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 20:59:54.588049 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-e308388d-e11e-44d2-a4b4-7b638dc1688c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 23 20:59:54.588049 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 20:59:54.588049 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 20:59:54.588049 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 20:59:54.588049 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 20:59:54.588049 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 20:59:54.588049 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 20:59:54.588049 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 20:59:54.588049 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 20:59:54.588049 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 20:59:54.588049 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 20:59:54.588049 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 20:59:54.588049 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 20:59:54.588049 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 20:59:54.588049 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 20:59:54.588049 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 20:59:54.589262 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 20:59:54.589262 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 20:59:54.589262 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 20:59:54.589262 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 20:59:54.589262 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 20:59:54.589262 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 20:59:54.589262 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 20:59:54.589262 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 20:59:54.589262 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 20:59:54.589262 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 20:59:54.589262 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 20:59:54.589262 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application with Lock( Jul 23 20:59:54.589262 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 20:59:54.589262 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._enter() Jul 23 20:59:54.589262 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 20:59:54.589262 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 20:59:54.590221 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 20:59:54.590221 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.creator() Jul 23 20:59:54.590221 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 20:59:54.590221 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application created_value = creator( Jul 23 20:59:54.590221 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 20:59:54.590221 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 20:59:54.590221 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 20:59:54.590221 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 20:59:54.590221 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 20:59:54.590221 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 20:59:54.590221 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 23 20:59:54.590221 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 20:59:54.590221 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 603/1195] 10.222.0.17 () {56 vars in 1096 bytes} [Sat Jul 23 20:59:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 20:59:54.595684 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659cffb3-e018-490c-8532-74420315060f None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:59:54.667126 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:59:54.702777 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659cffb3-e018-490c-8532-74420315060f None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:59:54.737851 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8ba39c-cdd9-4914-b00f-f49b90c3d346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:59:54.738547 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8ba39c-cdd9-4914-b00f-f49b90c3d346 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:59:54.738823 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8ba39c-cdd9-4914-b00f-f49b90c3d346 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:59:54.739094 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8ba39c-cdd9-4914-b00f-f49b90c3d346 None admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:59:54.739863 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8ba39c-cdd9-4914-b00f-f49b90c3d346 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:59:54.740161 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8ba39c-cdd9-4914-b00f-f49b90c3d346 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:59:54.741538 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8ba39c-cdd9-4914-b00f-f49b90c3d346 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:59:54.754191 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 593/1196] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Jul 23 20:59:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:59:54.760337 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e308388d-e11e-44d2-a4b4-7b638dc1688c None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:59:54.872204 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e308388d-e11e-44d2-a4b4-7b638dc1688c None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:59:54.908167 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d560e64-44b5-4c12-8ce8-caa4468c40c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:59:54.909042 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d560e64-44b5-4c12-8ce8-caa4468c40c9 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:59:54.909319 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d560e64-44b5-4c12-8ce8-caa4468c40c9 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:59:54.909586 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d560e64-44b5-4c12-8ce8-caa4468c40c9 None admin] PATH_INFO: `/v3/users/aed5cb2e40d14d4bb604949e77d761d1` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:59:54.910924 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d560e64-44b5-4c12-8ce8-caa4468c40c9 None admin] RBAC: Authorizing `identity:get_user(user_id=aed5cb2e40d14d4bb604949e77d761d1)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:59:54.912405 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d560e64-44b5-4c12-8ce8-caa4468c40c9 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:59:54.914065 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 604/1197] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Jul 23 20:59:54 2022] GET /identity/v3/users/aed5cb2e40d14d4bb604949e77d761d1 => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:59:54.920245 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8ba39c-cdd9-4914-b00f-f49b90c3d346 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:59:55.025422 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8ba39c-cdd9-4914-b00f-f49b90c3d346 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:59:55.055600 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:59:55.065662 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb440a3-a040-4235-9762-2466d99c2638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:59:55.066668 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb440a3-a040-4235-9762-2466d99c2638 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:59:55.067059 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb440a3-a040-4235-9762-2466d99c2638 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:59:55.067559 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb440a3-a040-4235-9762-2466d99c2638 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:59:55.146455 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb440a3-a040-4235-9762-2466d99c2638 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:59:55.147904 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb440a3-a040-4235-9762-2466d99c2638 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:59:55.249875 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 594/1198] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Jul 23 20:59:54 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 23 20:59:55.259362 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d560e64-44b5-4c12-8ce8-caa4468c40c9 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:59:55.277901 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:59:55.376187 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d560e64-44b5-4c12-8ce8-caa4468c40c9 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:59:55.411418 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7b3567-bbd0-4786-85ea-d216d5c521be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:59:55.412286 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7b3567-bbd0-4786-85ea-d216d5c521be None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:59:55.412557 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7b3567-bbd0-4786-85ea-d216d5c521be None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:59:55.412800 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7b3567-bbd0-4786-85ea-d216d5c521be None admin] PATH_INFO: `/v3/projects/80fe9c78dcf6422ba8c56d0ffd294182` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:59:55.414185 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7b3567-bbd0-4786-85ea-d216d5c521be None admin] RBAC: Authorizing `identity:get_project(project_id=80fe9c78dcf6422ba8c56d0ffd294182)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:59:55.415611 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7b3567-bbd0-4786-85ea-d216d5c521be None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:59:55.417315 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 605/1199] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Jul 23 20:59:55 2022] GET /identity/v3/projects/80fe9c78dcf6422ba8c56d0ffd294182 => generated 361 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 20:59:55.424480 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb440a3-a040-4235-9762-2466d99c2638 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 20:59:55.458930 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 20:59:55.535116 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb440a3-a040-4235-9762-2466d99c2638 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 20:59:55.572515 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb580399-8f5d-47a9-963e-2a718611a4be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 20:59:55.573171 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb580399-8f5d-47a9-963e-2a718611a4be None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 20:59:55.573447 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb580399-8f5d-47a9-963e-2a718611a4be None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 20:59:55.573712 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb580399-8f5d-47a9-963e-2a718611a4be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 20:59:55.574573 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb580399-8f5d-47a9-963e-2a718611a4be None admin] RBAC: Adding query filter params (role.id=fec17bfdc65349a2b9c06a89131191df, scope.project.id=80fe9c78dcf6422ba8c56d0ffd294182, user.id=aed5cb2e40d14d4bb604949e77d761d1) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 20:59:55.574882 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb580399-8f5d-47a9-963e-2a718611a4be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 20:59:55.576338 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb580399-8f5d-47a9-963e-2a718611a4be None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 20:59:55.582464 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 595/1200] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Jul 23 20:59:55 2022] GET /identity/v3/role_assignments?user.id=aed5cb2e40d14d4bb604949e77d761d1&scope.project.id=80fe9c78dcf6422ba8c56d0ffd294182&role.id=fec17bfdc65349a2b9c06a89131191df => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:00:05.406768 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=61 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:00:05.579447 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=53 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:00:57.729556 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542ab256-b086-4bce-9f01-d09d098770d0 None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:00:57.730519 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542ab256-b086-4bce-9f01-d09d098770d0 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:00:57.730519 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542ab256-b086-4bce-9f01-d09d098770d0 None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:00:57.733898 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 606/1201] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 21:00:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:00:57.738121 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d8a7cf-843a-4d7c-8bb1-6e159a601ad7 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:00:57.738619 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d8a7cf-843a-4d7c-8bb1-6e159a601ad7 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:00:57.738729 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d8a7cf-843a-4d7c-8bb1-6e159a601ad7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:00:57.756998 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-53d8a7cf-843a-4d7c-8bb1-6e159a601ad7 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:00:57.758607 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-53d8a7cf-843a-4d7c-8bb1-6e159a601ad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:00:57.841677 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 596/1202] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 21:00:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 23 21:00:57.870184 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542ab256-b086-4bce-9f01-d09d098770d0 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:00:58.018661 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542ab256-b086-4bce-9f01-d09d098770d0 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:00:58.072798 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b42e1bc-022a-42b0-b7e1-f329bfa7feaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:00:58.073641 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b42e1bc-022a-42b0-b7e1-f329bfa7feaf None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:00:58.073948 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b42e1bc-022a-42b0-b7e1-f329bfa7feaf None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:00:58.074235 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b42e1bc-022a-42b0-b7e1-f329bfa7feaf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:00:58.092282 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b42e1bc-022a-42b0-b7e1-f329bfa7feaf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:00:58.093911 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b42e1bc-022a-42b0-b7e1-f329bfa7feaf None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:00:58.118640 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-3b42e1bc-022a-42b0-b7e1-f329bfa7feaf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 21:00:58.118640 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 21:00:58.118640 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 21:00:58.118640 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 21:00:58.118640 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 21:00:58.118640 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 21:00:58.118640 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 21:00:58.118640 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 21:00:58.118640 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 21:00:58.118640 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 21:00:58.118640 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 21:00:58.118640 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 21:00:58.118640 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 23 21:00:58.118640 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 23 21:00:58.118640 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 23 21:00:58.120400 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 23 21:00:58.120400 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 21:00:58.120400 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 21:00:58.120400 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 21:00:58.120400 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 21:00:58.120400 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 21:00:58.120400 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 21:00:58.120400 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 21:00:58.120400 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application with Lock( Jul 23 21:00:58.120400 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 21:00:58.120400 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._enter() Jul 23 21:00:58.120400 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 21:00:58.120400 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 21:00:58.120400 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 21:00:58.120400 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.creator() Jul 23 21:00:58.120400 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 21:00:58.120400 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application created_value = creator( Jul 23 21:00:58.122180 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 23 21:00:58.122180 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 23 21:00:58.122180 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 21:00:58.122180 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 21:00:58.122180 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 607/1203] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 23 21:00:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 21:00:58.126475 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d8a7cf-843a-4d7c-8bb1-6e159a601ad7 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:00:58.302894 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d8a7cf-843a-4d7c-8bb1-6e159a601ad7 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:00:58.341215 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:00:58.351706 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7503914-ea65-4fa6-86ac-6a549e8d1c96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:00:58.352784 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7503914-ea65-4fa6-86ac-6a549e8d1c96 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:00:58.352981 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7503914-ea65-4fa6-86ac-6a549e8d1c96 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:00:58.353202 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7503914-ea65-4fa6-86ac-6a549e8d1c96 None admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:00:58.355948 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7503914-ea65-4fa6-86ac-6a549e8d1c96 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:00:58.355948 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7503914-ea65-4fa6-86ac-6a549e8d1c96 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:00:58.356267 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7503914-ea65-4fa6-86ac-6a549e8d1c96 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:00:58.373161 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 597/1204] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 23 21:00:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:00:58.380307 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b42e1bc-022a-42b0-b7e1-f329bfa7feaf None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:00:58.454026 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:00:58.512327 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b42e1bc-022a-42b0-b7e1-f329bfa7feaf None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:00:58.558230 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12266ef7-6350-4815-ab60-eace6439dc5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:00:58.559216 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12266ef7-6350-4815-ab60-eace6439dc5a None admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:00:58.559703 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12266ef7-6350-4815-ab60-eace6439dc5a None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:00:58.560204 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12266ef7-6350-4815-ab60-eace6439dc5a None admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:00:58.561268 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12266ef7-6350-4815-ab60-eace6439dc5a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:00:58.563395 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12266ef7-6350-4815-ab60-eace6439dc5a None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:00:58.590882 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 608/1205] 10.222.0.17 () {60 vars in 1132 bytes} [Sat Jul 23 21:00:58 2022] POST /identity/v3/users => generated 251 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:01:01.007853 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f67d048-ca57-4409-ac77-d79181222e5b None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:01:01.008530 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f67d048-ca57-4409-ac77-d79181222e5b None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:01:01.008530 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f67d048-ca57-4409-ac77-d79181222e5b None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:01:01.009760 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 598/1206] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 21:01:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:01:01.015367 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27791f91-2bd0-4484-bfd2-d35e6221dc10 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:01:01.015834 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27791f91-2bd0-4484-bfd2-d35e6221dc10 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:01:01.015966 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27791f91-2bd0-4484-bfd2-d35e6221dc10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:01:01.034230 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-27791f91-2bd0-4484-bfd2-d35e6221dc10 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:01:01.035453 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-27791f91-2bd0-4484-bfd2-d35e6221dc10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:01:01.109297 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 609/1207] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 21:01:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 23 21:01:01.134159 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f67d048-ca57-4409-ac77-d79181222e5b None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:01:01.282823 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f67d048-ca57-4409-ac77-d79181222e5b None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:01:01.335065 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57daee9a-0e8e-40a7-87f5-cf1483096763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:01:01.335929 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57daee9a-0e8e-40a7-87f5-cf1483096763 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:01:01.336213 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57daee9a-0e8e-40a7-87f5-cf1483096763 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:01:01.336479 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57daee9a-0e8e-40a7-87f5-cf1483096763 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:01:01.350679 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57daee9a-0e8e-40a7-87f5-cf1483096763 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 21:01:01.358821 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-57daee9a-0e8e-40a7-87f5-cf1483096763 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 23 21:01:01.358821 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 21:01:01.358821 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 21:01:01.358821 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 21:01:01.358821 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 21:01:01.358821 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 21:01:01.358821 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 21:01:01.358821 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 21:01:01.358821 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 21:01:01.358821 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 21:01:01.358821 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 21:01:01.358821 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 21:01:01.358821 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 21:01:01.358821 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 21:01:01.358821 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 21:01:01.358821 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 21:01:01.359974 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 21:01:01.359974 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 21:01:01.359974 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 21:01:01.359974 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 21:01:01.359974 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 21:01:01.359974 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 21:01:01.359974 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 21:01:01.359974 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 21:01:01.359974 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 21:01:01.359974 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 21:01:01.359974 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 21:01:01.359974 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application with Lock( Jul 23 21:01:01.359974 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 21:01:01.359974 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._enter() Jul 23 21:01:01.359974 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 21:01:01.359974 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 21:01:01.363016 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 21:01:01.363016 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.creator() Jul 23 21:01:01.363016 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 21:01:01.363016 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application created_value = creator( Jul 23 21:01:01.363016 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 21:01:01.363016 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 21:01:01.363016 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 21:01:01.363016 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 21:01:01.363016 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 21:01:01.363016 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 21:01:01.363016 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 23 21:01:01.363016 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 21:01:01.363016 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 599/1208] 10.222.0.17 () {56 vars in 1102 bytes} [Sat Jul 23 21:01:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 21:01:01.366724 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27791f91-2bd0-4484-bfd2-d35e6221dc10 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:01:01.413219 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:01:01.489553 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27791f91-2bd0-4484-bfd2-d35e6221dc10 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:01:01.531390 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c6b3e0-e792-4114-82b5-52b2ebc92e15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:01:01.532072 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c6b3e0-e792-4114-82b5-52b2ebc92e15 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:01:01.532357 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c6b3e0-e792-4114-82b5-52b2ebc92e15 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:01:01.532629 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c6b3e0-e792-4114-82b5-52b2ebc92e15 None admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:01:01.533373 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c6b3e0-e792-4114-82b5-52b2ebc92e15 None admin] RBAC: Adding query filter params (name=service) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:01:01.533669 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c6b3e0-e792-4114-82b5-52b2ebc92e15 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:01:01.535075 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c6b3e0-e792-4114-82b5-52b2ebc92e15 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:01:01.549054 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 610/1209] 10.222.0.17 () {56 vars in 1103 bytes} [Sat Jul 23 21:01:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:01:01.555160 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57daee9a-0e8e-40a7-87f5-cf1483096763 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:01:01.620966 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:01:01.675817 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57daee9a-0e8e-40a7-87f5-cf1483096763 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:01:01.716365 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898f70d6-940c-40e3-86bb-f268d51c3e19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:01:01.717197 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898f70d6-940c-40e3-86bb-f268d51c3e19 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:01:01.717463 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898f70d6-940c-40e3-86bb-f268d51c3e19 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:01:01.717835 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898f70d6-940c-40e3-86bb-f268d51c3e19 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:01:01.729334 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898f70d6-940c-40e3-86bb-f268d51c3e19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:01:01.730909 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898f70d6-940c-40e3-86bb-f268d51c3e19 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:01:01.753547 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-898f70d6-940c-40e3-86bb-f268d51c3e19 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 21:01:01.753547 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 21:01:01.753547 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 21:01:01.753547 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 21:01:01.753547 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 21:01:01.753547 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 21:01:01.753547 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 21:01:01.753547 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 21:01:01.753547 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 21:01:01.753547 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 21:01:01.753547 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 21:01:01.753547 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 21:01:01.753547 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 23 21:01:01.753547 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 23 21:01:01.753547 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 23 21:01:01.760720 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 23 21:01:01.760720 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 21:01:01.760720 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 21:01:01.760720 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 21:01:01.760720 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 21:01:01.760720 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 21:01:01.760720 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 21:01:01.760720 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 21:01:01.760720 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application with Lock( Jul 23 21:01:01.760720 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 21:01:01.760720 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._enter() Jul 23 21:01:01.760720 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 21:01:01.760720 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 21:01:01.760720 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 21:01:01.760720 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.creator() Jul 23 21:01:01.760720 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 21:01:01.760720 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application created_value = creator( Jul 23 21:01:01.761613 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 23 21:01:01.761613 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 23 21:01:01.761613 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 21:01:01.761613 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 21:01:01.761613 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 600/1210] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 23 21:01:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 23 21:01:01.763142 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c6b3e0-e792-4114-82b5-52b2ebc92e15 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:01:01.884503 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:01:01.888014 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c6b3e0-e792-4114-82b5-52b2ebc92e15 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:01:01.930661 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca4f18d-79bc-4c7b-b162-14c2d3618940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:01:01.931355 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca4f18d-79bc-4c7b-b162-14c2d3618940 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:01:01.931666 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca4f18d-79bc-4c7b-b162-14c2d3618940 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:01:01.931907 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca4f18d-79bc-4c7b-b162-14c2d3618940 None admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:01:01.933189 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca4f18d-79bc-4c7b-b162-14c2d3618940 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:01:01.933498 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca4f18d-79bc-4c7b-b162-14c2d3618940 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:01:01.934912 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca4f18d-79bc-4c7b-b162-14c2d3618940 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:01:01.947955 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 611/1211] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 23 21:01:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:01:01.953982 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898f70d6-940c-40e3-86bb-f268d51c3e19 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:01:02.064763 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898f70d6-940c-40e3-86bb-f268d51c3e19 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:01:02.066473 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:01:02.103317 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebe4d91-d2eb-44c2-b0ff-f0b2a5f1ed4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:01:02.105991 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebe4d91-d2eb-44c2-b0ff-f0b2a5f1ed4e None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:01:02.106315 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebe4d91-d2eb-44c2-b0ff-f0b2a5f1ed4e None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:01:02.106594 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebe4d91-d2eb-44c2-b0ff-f0b2a5f1ed4e None admin] PATH_INFO: `/v3/users/placement` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:01:02.114450 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebe4d91-d2eb-44c2-b0ff-f0b2a5f1ed4e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:01:02.115961 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebe4d91-d2eb-44c2-b0ff-f0b2a5f1ed4e None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:01:02.132457 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-7ebe4d91-d2eb-44c2-b0ff-f0b2a5f1ed4e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 23 21:01:02.132457 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 21:01:02.132457 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 21:01:02.132457 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 21:01:02.132457 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 21:01:02.132457 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 21:01:02.132457 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 21:01:02.132457 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 21:01:02.132457 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 21:01:02.132457 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 21:01:02.132457 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 21:01:02.132457 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 21:01:02.132457 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 23 21:01:02.132457 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 23 21:01:02.132457 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 23 21:01:02.132457 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 23 21:01:02.133533 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 21:01:02.133533 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 21:01:02.133533 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 23 21:01:02.133533 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 23 21:01:02.133533 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 23 21:01:02.133533 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 23 21:01:02.133533 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 21:01:02.133533 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 21:01:02.133533 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 21:01:02.133533 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 21:01:02.133533 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 21:01:02.133533 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application with Lock( Jul 23 21:01:02.133533 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 21:01:02.133533 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._enter() Jul 23 21:01:02.133533 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 21:01:02.133533 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 21:01:02.133533 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 21:01:02.133533 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.creator() Jul 23 21:01:02.134829 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 21:01:02.134829 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application created_value = creator( Jul 23 21:01:02.134829 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 23 21:01:02.134829 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 23 21:01:02.134829 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 23 21:01:02.134829 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 23 21:01:02.134829 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 23 21:01:02.134829 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 23 21:01:02.134829 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 23 21:01:02.134829 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 21:01:02.134829 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 601/1212] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 23 21:01:01 2022] GET /identity/v3/users/placement => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 21:01:02.140096 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca4f18d-79bc-4c7b-b162-14c2d3618940 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:01:02.254338 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca4f18d-79bc-4c7b-b162-14c2d3618940 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:01:02.294553 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b845e2-bc67-4125-9454-6cd5942f7d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:01:02.295535 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b845e2-bc67-4125-9454-6cd5942f7d91 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:01:02.295802 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b845e2-bc67-4125-9454-6cd5942f7d91 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:01:02.296069 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b845e2-bc67-4125-9454-6cd5942f7d91 None admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:01:02.296915 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b845e2-bc67-4125-9454-6cd5942f7d91 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:01:02.297215 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b845e2-bc67-4125-9454-6cd5942f7d91 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:01:02.298669 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b845e2-bc67-4125-9454-6cd5942f7d91 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:01:02.317296 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 612/1213] 10.222.0.17 () {56 vars in 1143 bytes} [Sat Jul 23 21:01:02 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:01:02.323648 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebe4d91-d2eb-44c2-b0ff-f0b2a5f1ed4e None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:01:02.459240 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebe4d91-d2eb-44c2-b0ff-f0b2a5f1ed4e None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:01:02.506987 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45af8864-ed03-4148-9296-d5947b6f2ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:01:02.507969 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45af8864-ed03-4148-9296-d5947b6f2ff0 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:01:02.507969 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45af8864-ed03-4148-9296-d5947b6f2ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:01:02.508210 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45af8864-ed03-4148-9296-d5947b6f2ff0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:01:02.544645 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:01:02.598230 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45af8864-ed03-4148-9296-d5947b6f2ff0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:01:02.599970 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45af8864-ed03-4148-9296-d5947b6f2ff0 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:01:02.725196 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 602/1214] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Jul 23 21:01:02 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 23 21:01:02.726614 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b845e2-bc67-4125-9454-6cd5942f7d91 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:01:02.750033 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:01:02.843507 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b845e2-bc67-4125-9454-6cd5942f7d91 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:01:02.883795 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7477d6-a09c-4d9a-bbc2-0cf4ef16adec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:01:02.884994 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7477d6-a09c-4d9a-bbc2-0cf4ef16adec None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:01:02.885480 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7477d6-a09c-4d9a-bbc2-0cf4ef16adec None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:01:02.885988 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7477d6-a09c-4d9a-bbc2-0cf4ef16adec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:01:02.901741 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7477d6-a09c-4d9a-bbc2-0cf4ef16adec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:01:02.903449 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7477d6-a09c-4d9a-bbc2-0cf4ef16adec None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:01:02.930292 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-4a7477d6-a09c-4d9a-bbc2-0cf4ef16adec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 21:01:02.930292 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 21:01:02.930292 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 21:01:02.930292 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 21:01:02.930292 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 21:01:02.930292 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 21:01:02.930292 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 21:01:02.930292 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 21:01:02.930292 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 21:01:02.930292 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 21:01:02.930292 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 21:01:02.930292 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 21:01:02.930292 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 23 21:01:02.930292 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 23 21:01:02.930292 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 23 21:01:02.931286 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 23 21:01:02.931286 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 21:01:02.931286 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 21:01:02.931286 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 21:01:02.931286 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 21:01:02.931286 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 21:01:02.931286 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 21:01:02.931286 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 21:01:02.931286 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application with Lock( Jul 23 21:01:02.931286 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 21:01:02.931286 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._enter() Jul 23 21:01:02.931286 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 21:01:02.931286 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 21:01:02.931286 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 21:01:02.931286 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.creator() Jul 23 21:01:02.931286 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 21:01:02.931286 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application created_value = creator( Jul 23 21:01:02.937355 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 23 21:01:02.937355 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 23 21:01:02.937355 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 21:01:02.937355 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 21:01:02.937355 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 613/1215] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 23 21:01:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 21:01:02.937988 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45af8864-ed03-4148-9296-d5947b6f2ff0 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:01:03.011971 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:01:03.057742 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45af8864-ed03-4148-9296-d5947b6f2ff0 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:01:03.106719 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdbfc13-a9df-4746-a235-8ba87c611a3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:01:03.108946 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdbfc13-a9df-4746-a235-8ba87c611a3d None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:01:03.109435 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdbfc13-a9df-4746-a235-8ba87c611a3d None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:01:03.111837 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdbfc13-a9df-4746-a235-8ba87c611a3d None admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:01:03.111837 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdbfc13-a9df-4746-a235-8ba87c611a3d None admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:01:03.111837 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdbfc13-a9df-4746-a235-8ba87c611a3d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:01:03.114494 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdbfc13-a9df-4746-a235-8ba87c611a3d None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:01:03.143246 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 603/1216] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 23 21:01:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:01:03.144538 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7477d6-a09c-4d9a-bbc2-0cf4ef16adec None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:01:03.254613 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:01:03.291369 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7477d6-a09c-4d9a-bbc2-0cf4ef16adec None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:01:03.331356 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef14202-ea62-4ac6-92cf-e743f172abb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:01:03.332226 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef14202-ea62-4ac6-92cf-e743f172abb6 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:01:03.332528 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef14202-ea62-4ac6-92cf-e743f172abb6 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:01:03.332781 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef14202-ea62-4ac6-92cf-e743f172abb6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:01:03.340925 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef14202-ea62-4ac6-92cf-e743f172abb6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:01:03.342553 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef14202-ea62-4ac6-92cf-e743f172abb6 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:01:03.358454 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-1ef14202-ea62-4ac6-92cf-e743f172abb6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 23 21:01:03.358454 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 21:01:03.358454 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 21:01:03.358454 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 21:01:03.358454 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 21:01:03.358454 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 21:01:03.358454 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 21:01:03.358454 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 21:01:03.358454 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 21:01:03.358454 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 21:01:03.358454 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 21:01:03.358454 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 21:01:03.358454 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 23 21:01:03.358454 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 23 21:01:03.358454 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 23 21:01:03.359551 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 23 21:01:03.359551 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 21:01:03.359551 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 21:01:03.359551 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 21:01:03.359551 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 21:01:03.359551 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 21:01:03.359551 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 21:01:03.359551 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 21:01:03.359551 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application with Lock( Jul 23 21:01:03.359551 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 21:01:03.359551 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._enter() Jul 23 21:01:03.359551 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 21:01:03.359551 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 21:01:03.359551 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 21:01:03.359551 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.creator() Jul 23 21:01:03.359551 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 21:01:03.359551 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application created_value = creator( Jul 23 21:01:03.360465 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 23 21:01:03.360465 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 23 21:01:03.360465 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 23 21:01:03.360465 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 23 21:01:03.360465 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 23 21:01:03.360465 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 23 21:01:03.360465 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 23 21:01:03.360465 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 21:01:03.365043 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 614/1217] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Jul 23 21:01:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 21:01:03.365919 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdbfc13-a9df-4746-a235-8ba87c611a3d None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:01:03.505137 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdbfc13-a9df-4746-a235-8ba87c611a3d None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:01:03.535543 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:01:03.550696 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0907e24-cd85-481d-a19d-2707b5931070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:01:03.551726 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0907e24-cd85-481d-a19d-2707b5931070 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:01:03.552220 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0907e24-cd85-481d-a19d-2707b5931070 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:01:03.552660 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0907e24-cd85-481d-a19d-2707b5931070 None admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:01:03.553623 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0907e24-cd85-481d-a19d-2707b5931070 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:01:03.554129 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0907e24-cd85-481d-a19d-2707b5931070 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:01:03.555825 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0907e24-cd85-481d-a19d-2707b5931070 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:01:03.569042 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 604/1218] 10.222.0.17 () {56 vars in 1148 bytes} [Sat Jul 23 21:01:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 21:01:03.575034 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef14202-ea62-4ac6-92cf-e743f172abb6 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:01:03.688837 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef14202-ea62-4ac6-92cf-e743f172abb6 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:01:03.722717 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:01:03.729970 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f144c3-720e-4d72-9886-747ef149f28f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:01:03.730651 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f144c3-720e-4d72-9886-747ef149f28f None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:01:03.730932 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f144c3-720e-4d72-9886-747ef149f28f None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:01:03.731202 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f144c3-720e-4d72-9886-747ef149f28f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:01:03.732076 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f144c3-720e-4d72-9886-747ef149f28f None admin] RBAC: Adding query filter params (role.id=abf9f3b81f3647dbb70c44d0aedaa614, scope.project.id=4804ed61295f4d4a92d9b685dd9e9f3b, user.id=abc719a3b3ac4461b82ca04ab6451d81) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:01:03.732385 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f144c3-720e-4d72-9886-747ef149f28f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:01:03.733848 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f144c3-720e-4d72-9886-747ef149f28f None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:01:03.741908 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 615/1219] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Jul 23 21:01:03 2022] GET /identity/v3/role_assignments?user.id=abc719a3b3ac4461b82ca04ab6451d81&scope.project.id=4804ed61295f4d4a92d9b685dd9e9f3b&role.id=abf9f3b81f3647dbb70c44d0aedaa614 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:01:06.184986 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8b6f4c-277f-472f-95e8-a5a28a42814b None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:01:06.185531 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8b6f4c-277f-472f-95e8-a5a28a42814b None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:01:06.185531 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8b6f4c-277f-472f-95e8-a5a28a42814b None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:01:06.187133 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 605/1220] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 21:01:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:01:06.193097 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec5caa6-cf53-4e8d-85bc-5be412c072f2 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:01:06.193709 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec5caa6-cf53-4e8d-85bc-5be412c072f2 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:01:06.193709 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec5caa6-cf53-4e8d-85bc-5be412c072f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:01:06.214669 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-7ec5caa6-cf53-4e8d-85bc-5be412c072f2 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:01:06.216083 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-7ec5caa6-cf53-4e8d-85bc-5be412c072f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:01:06.317916 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 616/1221] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 21:01:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 23 21:01:06.340494 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8b6f4c-277f-472f-95e8-a5a28a42814b None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:01:06.487178 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8b6f4c-277f-472f-95e8-a5a28a42814b None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:01:06.537722 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c6b293-c787-4315-a0dd-ed64ad98055c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:01:06.538809 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c6b293-c787-4315-a0dd-ed64ad98055c None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:01:06.539173 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c6b293-c787-4315-a0dd-ed64ad98055c None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:01:06.539438 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c6b293-c787-4315-a0dd-ed64ad98055c None admin] PATH_INFO: `/v3/roles/service` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:01:06.555511 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c6b293-c787-4315-a0dd-ed64ad98055c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 21:01:06.563979 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-f9c6b293-c787-4315-a0dd-ed64ad98055c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 23 21:01:06.563979 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 21:01:06.563979 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 21:01:06.563979 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 21:01:06.563979 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 21:01:06.563979 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 21:01:06.563979 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 21:01:06.563979 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 21:01:06.563979 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 21:01:06.563979 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 21:01:06.563979 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 21:01:06.563979 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 21:01:06.563979 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 21:01:06.563979 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 21:01:06.563979 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 21:01:06.563979 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 21:01:06.567359 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 21:01:06.567359 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 21:01:06.567359 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 21:01:06.567359 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 21:01:06.567359 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 21:01:06.567359 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 21:01:06.567359 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 21:01:06.567359 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 21:01:06.567359 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 21:01:06.567359 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 21:01:06.567359 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 21:01:06.567359 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application with Lock( Jul 23 21:01:06.567359 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 21:01:06.567359 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._enter() Jul 23 21:01:06.567359 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 21:01:06.567359 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 21:01:06.568462 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 21:01:06.568462 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.creator() Jul 23 21:01:06.568462 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 21:01:06.568462 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application created_value = creator( Jul 23 21:01:06.568462 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 21:01:06.568462 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 21:01:06.568462 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 21:01:06.568462 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 21:01:06.568462 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 21:01:06.568462 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 21:01:06.568462 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 23 21:01:06.568462 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 21:01:06.568462 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 606/1222] 10.222.0.17 () {56 vars in 1102 bytes} [Sat Jul 23 21:01:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 21:01:06.571641 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec5caa6-cf53-4e8d-85bc-5be412c072f2 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:01:06.690060 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec5caa6-cf53-4e8d-85bc-5be412c072f2 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:01:06.717517 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:01:06.739138 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5f031a-dda1-45ee-821a-cd7267b30a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:01:06.740026 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5f031a-dda1-45ee-821a-cd7267b30a6d None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:01:06.740419 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5f031a-dda1-45ee-821a-cd7267b30a6d None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:01:06.740726 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5f031a-dda1-45ee-821a-cd7267b30a6d None admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:01:06.741683 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5f031a-dda1-45ee-821a-cd7267b30a6d None admin] RBAC: Adding query filter params (name=service) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:01:06.742146 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5f031a-dda1-45ee-821a-cd7267b30a6d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:01:06.743994 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5f031a-dda1-45ee-821a-cd7267b30a6d None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:01:06.755421 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 617/1223] 10.222.0.17 () {56 vars in 1103 bytes} [Sat Jul 23 21:01:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 21:01:06.761410 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c6b293-c787-4315-a0dd-ed64ad98055c None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:01:06.820657 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:01:06.886830 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c6b293-c787-4315-a0dd-ed64ad98055c None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:01:06.925483 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e81427-239d-4b48-8f77-b1abf3415ad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:01:06.926532 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e81427-239d-4b48-8f77-b1abf3415ad4 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:01:06.926928 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e81427-239d-4b48-8f77-b1abf3415ad4 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:01:06.927284 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e81427-239d-4b48-8f77-b1abf3415ad4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:01:06.940708 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e81427-239d-4b48-8f77-b1abf3415ad4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:01:06.942746 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e81427-239d-4b48-8f77-b1abf3415ad4 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:01:06.962588 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-d1e81427-239d-4b48-8f77-b1abf3415ad4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 21:01:06.962588 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 21:01:06.962588 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 21:01:06.962588 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 21:01:06.962588 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 21:01:06.962588 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 21:01:06.962588 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 21:01:06.962588 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 21:01:06.962588 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 21:01:06.962588 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 21:01:06.962588 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 21:01:06.962588 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 21:01:06.962588 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 23 21:01:06.962588 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 23 21:01:06.962588 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 23 21:01:06.963761 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 23 21:01:06.963761 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 21:01:06.963761 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 21:01:06.963761 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 21:01:06.963761 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 21:01:06.963761 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 21:01:06.963761 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 21:01:06.963761 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 21:01:06.963761 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application with Lock( Jul 23 21:01:06.963761 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 21:01:06.963761 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._enter() Jul 23 21:01:06.963761 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 21:01:06.963761 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 21:01:06.963761 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 21:01:06.963761 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.creator() Jul 23 21:01:06.963761 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 21:01:06.963761 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application created_value = creator( Jul 23 21:01:06.970377 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 23 21:01:06.970377 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 23 21:01:06.970377 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 21:01:06.970377 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 21:01:06.970377 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 607/1224] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 23 21:01:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 21:01:06.970738 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5f031a-dda1-45ee-821a-cd7267b30a6d None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:01:07.082535 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5f031a-dda1-45ee-821a-cd7267b30a6d None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:01:07.125687 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd70228-8f65-4fd6-9c3d-c0743366e93a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:01:07.126416 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd70228-8f65-4fd6-9c3d-c0743366e93a None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:01:07.126693 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd70228-8f65-4fd6-9c3d-c0743366e93a None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:01:07.126960 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd70228-8f65-4fd6-9c3d-c0743366e93a None admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:01:07.127679 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd70228-8f65-4fd6-9c3d-c0743366e93a None admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:01:07.127976 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd70228-8f65-4fd6-9c3d-c0743366e93a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:01:07.129531 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd70228-8f65-4fd6-9c3d-c0743366e93a None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:01:07.151238 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 618/1225] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 23 21:01:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:01:07.161224 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e81427-239d-4b48-8f77-b1abf3415ad4 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:01:07.273718 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:01:07.281690 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e81427-239d-4b48-8f77-b1abf3415ad4 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:01:07.325132 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801c0e3f-6785-4337-91b7-6b87c47fd4b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:01:07.326315 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801c0e3f-6785-4337-91b7-6b87c47fd4b1 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:01:07.326658 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801c0e3f-6785-4337-91b7-6b87c47fd4b1 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:01:07.326956 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801c0e3f-6785-4337-91b7-6b87c47fd4b1 None admin] PATH_INFO: `/v3/users/placement` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:01:07.337494 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801c0e3f-6785-4337-91b7-6b87c47fd4b1 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:01:07.339504 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801c0e3f-6785-4337-91b7-6b87c47fd4b1 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:01:07.355812 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-801c0e3f-6785-4337-91b7-6b87c47fd4b1 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 23 21:01:07.355812 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 21:01:07.355812 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 21:01:07.355812 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 21:01:07.355812 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 21:01:07.355812 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 21:01:07.355812 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 21:01:07.355812 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 21:01:07.355812 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 21:01:07.355812 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 21:01:07.355812 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 21:01:07.355812 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 21:01:07.355812 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 23 21:01:07.355812 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 23 21:01:07.355812 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 23 21:01:07.355812 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 23 21:01:07.356883 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 21:01:07.356883 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 21:01:07.356883 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 23 21:01:07.356883 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 23 21:01:07.356883 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 23 21:01:07.356883 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 23 21:01:07.356883 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 21:01:07.356883 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 21:01:07.356883 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 21:01:07.356883 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 21:01:07.356883 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 21:01:07.356883 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application with Lock( Jul 23 21:01:07.356883 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 21:01:07.356883 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._enter() Jul 23 21:01:07.356883 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 21:01:07.356883 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 21:01:07.356883 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 21:01:07.356883 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.creator() Jul 23 21:01:07.357831 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 21:01:07.357831 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application created_value = creator( Jul 23 21:01:07.357831 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 23 21:01:07.357831 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 23 21:01:07.357831 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 23 21:01:07.357831 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 23 21:01:07.357831 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 23 21:01:07.357831 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 23 21:01:07.357831 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 23 21:01:07.357831 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 21:01:07.357831 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 608/1226] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 23 21:01:07 2022] GET /identity/v3/users/placement => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 21:01:07.364891 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd70228-8f65-4fd6-9c3d-c0743366e93a None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:01:07.434765 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:01:07.506375 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd70228-8f65-4fd6-9c3d-c0743366e93a None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:01:07.546171 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a45ce21-1229-47dc-ad50-c26fdac2ffa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:01:07.546982 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a45ce21-1229-47dc-ad50-c26fdac2ffa7 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:01:07.547276 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a45ce21-1229-47dc-ad50-c26fdac2ffa7 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:01:07.547551 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a45ce21-1229-47dc-ad50-c26fdac2ffa7 None admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:01:07.548538 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a45ce21-1229-47dc-ad50-c26fdac2ffa7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:01:07.548908 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a45ce21-1229-47dc-ad50-c26fdac2ffa7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:01:07.550509 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a45ce21-1229-47dc-ad50-c26fdac2ffa7 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:01:07.571305 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 619/1227] 10.222.0.17 () {56 vars in 1143 bytes} [Sat Jul 23 21:01:07 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 21:01:07.578167 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801c0e3f-6785-4337-91b7-6b87c47fd4b1 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:01:07.697994 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801c0e3f-6785-4337-91b7-6b87c47fd4b1 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:01:07.735335 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcf468d-0dbe-4576-97dd-b64c92203d8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:01:07.736179 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcf468d-0dbe-4576-97dd-b64c92203d8e None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:01:07.736451 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcf468d-0dbe-4576-97dd-b64c92203d8e None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:01:07.736712 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcf468d-0dbe-4576-97dd-b64c92203d8e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:01:07.749515 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcf468d-0dbe-4576-97dd-b64c92203d8e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:01:07.751037 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcf468d-0dbe-4576-97dd-b64c92203d8e None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:01:07.769311 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-8fcf468d-0dbe-4576-97dd-b64c92203d8e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 21:01:07.769311 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 21:01:07.769311 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 21:01:07.769311 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 21:01:07.769311 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 21:01:07.769311 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 21:01:07.769311 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 21:01:07.769311 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 21:01:07.769311 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 21:01:07.769311 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 21:01:07.769311 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 21:01:07.769311 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 21:01:07.769311 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 23 21:01:07.769311 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 23 21:01:07.769311 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 23 21:01:07.770524 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 23 21:01:07.770524 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 21:01:07.770524 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 21:01:07.770524 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 21:01:07.770524 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 21:01:07.770524 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 21:01:07.770524 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 21:01:07.770524 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 21:01:07.770524 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application with Lock( Jul 23 21:01:07.770524 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 21:01:07.770524 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._enter() Jul 23 21:01:07.770524 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 21:01:07.770524 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 21:01:07.770524 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 21:01:07.770524 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.creator() Jul 23 21:01:07.770524 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 21:01:07.770524 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application created_value = creator( Jul 23 21:01:07.771700 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 23 21:01:07.771700 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 23 21:01:07.771700 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 21:01:07.771700 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 21:01:07.771700 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 609/1228] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 23 21:01:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 21:01:07.778647 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a45ce21-1229-47dc-ad50-c26fdac2ffa7 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:01:07.901965 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a45ce21-1229-47dc-ad50-c26fdac2ffa7 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:01:07.904458 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:01:07.945560 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccfbe51-68a5-420b-aeb4-190426c3db30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:01:07.946346 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccfbe51-68a5-420b-aeb4-190426c3db30 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:01:07.946627 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccfbe51-68a5-420b-aeb4-190426c3db30 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:01:07.946903 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccfbe51-68a5-420b-aeb4-190426c3db30 None admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:01:07.947624 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccfbe51-68a5-420b-aeb4-190426c3db30 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:01:07.947920 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccfbe51-68a5-420b-aeb4-190426c3db30 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:01:07.949412 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccfbe51-68a5-420b-aeb4-190426c3db30 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:01:07.967634 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 620/1229] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 23 21:01:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:01:07.974297 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcf468d-0dbe-4576-97dd-b64c92203d8e None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:01:07.985198 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:01:08.093820 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcf468d-0dbe-4576-97dd-b64c92203d8e None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:01:08.129241 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33222a74-5f08-4dea-9d93-e9c67f54b933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:01:08.130128 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33222a74-5f08-4dea-9d93-e9c67f54b933 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:01:08.130408 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33222a74-5f08-4dea-9d93-e9c67f54b933 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:01:08.130686 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33222a74-5f08-4dea-9d93-e9c67f54b933 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:01:08.138099 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33222a74-5f08-4dea-9d93-e9c67f54b933 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:01:08.139618 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33222a74-5f08-4dea-9d93-e9c67f54b933 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:01:08.156768 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-33222a74-5f08-4dea-9d93-e9c67f54b933 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 23 21:01:08.156768 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 21:01:08.156768 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 21:01:08.156768 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 21:01:08.156768 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 21:01:08.156768 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 21:01:08.156768 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 21:01:08.156768 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 21:01:08.156768 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 21:01:08.156768 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 21:01:08.156768 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 21:01:08.156768 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 21:01:08.156768 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 23 21:01:08.156768 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 23 21:01:08.156768 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 23 21:01:08.157897 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 23 21:01:08.157897 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 21:01:08.157897 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 21:01:08.157897 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 21:01:08.157897 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 21:01:08.157897 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 21:01:08.157897 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 21:01:08.157897 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 21:01:08.157897 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application with Lock( Jul 23 21:01:08.157897 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 21:01:08.157897 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._enter() Jul 23 21:01:08.157897 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 21:01:08.157897 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 21:01:08.157897 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 21:01:08.157897 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.creator() Jul 23 21:01:08.157897 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 21:01:08.157897 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application created_value = creator( Jul 23 21:01:08.158987 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 23 21:01:08.158987 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 23 21:01:08.158987 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 23 21:01:08.158987 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 23 21:01:08.158987 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 23 21:01:08.158987 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 23 21:01:08.158987 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 23 21:01:08.158987 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 21:01:08.159516 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 610/1230] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Jul 23 21:01:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 23 21:01:08.165152 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccfbe51-68a5-420b-aeb4-190426c3db30 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:01:08.291488 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccfbe51-68a5-420b-aeb4-190426c3db30 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:01:08.328120 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a19cee1-5abe-4ba5-ba50-7b9bced91357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:01:08.328900 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a19cee1-5abe-4ba5-ba50-7b9bced91357 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:01:08.329343 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a19cee1-5abe-4ba5-ba50-7b9bced91357 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:01:08.329689 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a19cee1-5abe-4ba5-ba50-7b9bced91357 None admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:01:08.330636 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a19cee1-5abe-4ba5-ba50-7b9bced91357 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:01:08.331033 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a19cee1-5abe-4ba5-ba50-7b9bced91357 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:01:08.332816 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a19cee1-5abe-4ba5-ba50-7b9bced91357 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:01:08.350240 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 621/1231] 10.222.0.17 () {56 vars in 1148 bytes} [Sat Jul 23 21:01:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 21:01:08.356591 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33222a74-5f08-4dea-9d93-e9c67f54b933 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:01:08.439258 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:01:08.492132 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33222a74-5f08-4dea-9d93-e9c67f54b933 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:01:08.534866 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ffcdf0-085d-470a-9147-3aaed9c9804f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:01:08.535824 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ffcdf0-085d-470a-9147-3aaed9c9804f None admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:01:08.536169 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ffcdf0-085d-470a-9147-3aaed9c9804f None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:01:08.536537 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ffcdf0-085d-470a-9147-3aaed9c9804f None admin] PATH_INFO: `/v3/projects/4804ed61295f4d4a92d9b685dd9e9f3b/users/abc719a3b3ac4461b82ca04ab6451d81/roles/abf9f3b81f3647dbb70c44d0aedaa614` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:01:08.554256 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ffcdf0-085d-470a-9147-3aaed9c9804f None admin] RBAC: Authorizing `identity:create_grant(project_id=4804ed61295f4d4a92d9b685dd9e9f3b, user_id=abc719a3b3ac4461b82ca04ab6451d81, role_id=abf9f3b81f3647dbb70c44d0aedaa614)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:01:08.555871 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ffcdf0-085d-470a-9147-3aaed9c9804f None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:01:08.570765 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 611/1232] 10.222.0.17 () {58 vars in 1439 bytes} [Sat Jul 23 21:01:08 2022] PUT /identity/v3/projects/4804ed61295f4d4a92d9b685dd9e9f3b/users/abc719a3b3ac4461b82ca04ab6451d81/roles/abf9f3b81f3647dbb70c44d0aedaa614 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:01:10.988464 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64f5e1d-97db-4839-bf70-eddfdeb4ecc9 None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:01:10.989028 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64f5e1d-97db-4839-bf70-eddfdeb4ecc9 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:01:10.989145 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64f5e1d-97db-4839-bf70-eddfdeb4ecc9 None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:01:10.990477 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 622/1233] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 21:01:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:01:10.995798 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7247fd07-64c9-44f8-8dcc-d70aa29b9090 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:01:10.996260 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7247fd07-64c9-44f8-8dcc-d70aa29b9090 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:01:10.996365 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7247fd07-64c9-44f8-8dcc-d70aa29b9090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:01:11.014437 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-7247fd07-64c9-44f8-8dcc-d70aa29b9090 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:01:11.015667 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-7247fd07-64c9-44f8-8dcc-d70aa29b9090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:01:11.086940 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 612/1234] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 21:01:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 23 21:01:11.111887 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64f5e1d-97db-4839-bf70-eddfdeb4ecc9 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:01:11.140563 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:01:11.229565 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64f5e1d-97db-4839-bf70-eddfdeb4ecc9 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:01:11.270402 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9350ea-dc3a-4319-b862-ab9dc4ca9aa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:01:11.271227 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9350ea-dc3a-4319-b862-ab9dc4ca9aa1 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:01:11.271506 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9350ea-dc3a-4319-b862-ab9dc4ca9aa1 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:01:11.271792 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9350ea-dc3a-4319-b862-ab9dc4ca9aa1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:01:11.283452 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9350ea-dc3a-4319-b862-ab9dc4ca9aa1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 21:01:11.293285 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-0c9350ea-dc3a-4319-b862-ab9dc4ca9aa1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 23 21:01:11.293285 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 21:01:11.293285 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 21:01:11.293285 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 21:01:11.293285 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 21:01:11.293285 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 21:01:11.293285 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 21:01:11.293285 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 21:01:11.293285 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 21:01:11.293285 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 21:01:11.293285 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 21:01:11.293285 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 21:01:11.293285 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 21:01:11.293285 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 21:01:11.293285 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 21:01:11.293285 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 21:01:11.294519 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 21:01:11.294519 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 21:01:11.294519 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 21:01:11.294519 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 21:01:11.294519 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 21:01:11.294519 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 21:01:11.294519 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 21:01:11.294519 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 21:01:11.294519 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 21:01:11.294519 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 21:01:11.294519 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 21:01:11.294519 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application with Lock( Jul 23 21:01:11.294519 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 21:01:11.294519 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._enter() Jul 23 21:01:11.294519 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 21:01:11.294519 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 21:01:11.300481 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 21:01:11.300481 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.creator() Jul 23 21:01:11.300481 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 21:01:11.300481 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application created_value = creator( Jul 23 21:01:11.300481 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 21:01:11.300481 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 21:01:11.300481 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 21:01:11.300481 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 21:01:11.300481 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 21:01:11.300481 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 21:01:11.300481 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 23 21:01:11.300481 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 21:01:11.300481 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 623/1235] 10.222.0.17 () {56 vars in 1102 bytes} [Sat Jul 23 21:01:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 21:01:11.301176 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7247fd07-64c9-44f8-8dcc-d70aa29b9090 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:01:11.354656 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:01:11.418371 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7247fd07-64c9-44f8-8dcc-d70aa29b9090 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:01:11.462315 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bebd0be-a273-49f0-8e90-e9aa5463f59d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:01:11.463029 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bebd0be-a273-49f0-8e90-e9aa5463f59d None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:01:11.463288 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bebd0be-a273-49f0-8e90-e9aa5463f59d None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:01:11.463555 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bebd0be-a273-49f0-8e90-e9aa5463f59d None admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:01:11.464302 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bebd0be-a273-49f0-8e90-e9aa5463f59d None admin] RBAC: Adding query filter params (name=service) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:01:11.464599 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bebd0be-a273-49f0-8e90-e9aa5463f59d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:01:11.466022 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bebd0be-a273-49f0-8e90-e9aa5463f59d None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:01:11.475694 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 613/1236] 10.222.0.17 () {56 vars in 1103 bytes} [Sat Jul 23 21:01:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:01:11.481758 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9350ea-dc3a-4319-b862-ab9dc4ca9aa1 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:01:11.582092 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:01:11.599619 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9350ea-dc3a-4319-b862-ab9dc4ca9aa1 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:01:11.635613 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96dd67e-bce2-4372-b41b-0d53dfc6edd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:01:11.636352 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96dd67e-bce2-4372-b41b-0d53dfc6edd9 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:01:11.636626 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96dd67e-bce2-4372-b41b-0d53dfc6edd9 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:01:11.637031 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96dd67e-bce2-4372-b41b-0d53dfc6edd9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:01:11.648314 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96dd67e-bce2-4372-b41b-0d53dfc6edd9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:01:11.650194 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96dd67e-bce2-4372-b41b-0d53dfc6edd9 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:01:11.669736 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-d96dd67e-bce2-4372-b41b-0d53dfc6edd9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 21:01:11.669736 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 21:01:11.669736 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 21:01:11.669736 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 21:01:11.669736 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 21:01:11.669736 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 21:01:11.669736 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 21:01:11.669736 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 21:01:11.669736 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 21:01:11.669736 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 21:01:11.669736 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 21:01:11.669736 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 21:01:11.669736 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 23 21:01:11.669736 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 23 21:01:11.669736 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 23 21:01:11.670806 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 23 21:01:11.670806 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 21:01:11.670806 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 21:01:11.670806 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 21:01:11.670806 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 21:01:11.670806 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 21:01:11.670806 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 21:01:11.670806 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 21:01:11.670806 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application with Lock( Jul 23 21:01:11.670806 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 21:01:11.670806 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._enter() Jul 23 21:01:11.670806 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 21:01:11.670806 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 21:01:11.670806 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 21:01:11.670806 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.creator() Jul 23 21:01:11.670806 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 21:01:11.670806 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application created_value = creator( Jul 23 21:01:11.671710 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 23 21:01:11.671710 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 23 21:01:11.671710 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 21:01:11.671710 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 21:01:11.671710 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 624/1237] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 23 21:01:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 23 21:01:11.677514 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bebd0be-a273-49f0-8e90-e9aa5463f59d None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:01:11.780972 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bebd0be-a273-49f0-8e90-e9aa5463f59d None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:01:11.791130 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:01:11.825024 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e9a6e0-dc87-4ecc-b3a0-5f8160606cd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:01:11.825777 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e9a6e0-dc87-4ecc-b3a0-5f8160606cd5 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:01:11.826135 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e9a6e0-dc87-4ecc-b3a0-5f8160606cd5 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:01:11.826470 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e9a6e0-dc87-4ecc-b3a0-5f8160606cd5 None admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:01:11.827328 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e9a6e0-dc87-4ecc-b3a0-5f8160606cd5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:01:11.827714 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e9a6e0-dc87-4ecc-b3a0-5f8160606cd5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:01:11.829409 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e9a6e0-dc87-4ecc-b3a0-5f8160606cd5 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:01:11.848438 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 614/1238] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 23 21:01:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:01:11.849835 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96dd67e-bce2-4372-b41b-0d53dfc6edd9 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:01:11.966376 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96dd67e-bce2-4372-b41b-0d53dfc6edd9 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:01:12.003804 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bf2f75-ca35-4a76-aa89-8b9911b0c506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:01:12.004789 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bf2f75-ca35-4a76-aa89-8b9911b0c506 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:01:12.005067 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bf2f75-ca35-4a76-aa89-8b9911b0c506 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:01:12.005434 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bf2f75-ca35-4a76-aa89-8b9911b0c506 None admin] PATH_INFO: `/v3/users/placement` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:01:12.008798 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:01:12.015342 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bf2f75-ca35-4a76-aa89-8b9911b0c506 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:01:12.017141 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bf2f75-ca35-4a76-aa89-8b9911b0c506 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:01:12.033733 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-a9bf2f75-ca35-4a76-aa89-8b9911b0c506 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 23 21:01:12.033733 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 21:01:12.033733 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 21:01:12.033733 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 21:01:12.033733 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 21:01:12.033733 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 21:01:12.033733 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 21:01:12.033733 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 21:01:12.033733 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 21:01:12.033733 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 21:01:12.033733 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 21:01:12.033733 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 21:01:12.033733 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 23 21:01:12.033733 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 23 21:01:12.033733 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 23 21:01:12.033733 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 23 21:01:12.035155 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 21:01:12.035155 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 21:01:12.035155 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 23 21:01:12.035155 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 23 21:01:12.035155 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 23 21:01:12.035155 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 23 21:01:12.035155 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 21:01:12.035155 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 21:01:12.035155 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 21:01:12.035155 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 21:01:12.035155 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 21:01:12.035155 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application with Lock( Jul 23 21:01:12.035155 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 21:01:12.035155 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._enter() Jul 23 21:01:12.035155 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 21:01:12.035155 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 21:01:12.035155 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 21:01:12.035155 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.creator() Jul 23 21:01:12.036147 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 21:01:12.036147 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application created_value = creator( Jul 23 21:01:12.036147 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 23 21:01:12.036147 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 23 21:01:12.036147 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 23 21:01:12.036147 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 23 21:01:12.036147 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 23 21:01:12.036147 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 23 21:01:12.036147 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 23 21:01:12.036147 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 21:01:12.036147 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 625/1239] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 23 21:01:11 2022] GET /identity/v3/users/placement => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 21:01:12.041365 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e9a6e0-dc87-4ecc-b3a0-5f8160606cd5 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:01:12.153156 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e9a6e0-dc87-4ecc-b3a0-5f8160606cd5 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:01:12.193105 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a2533e-4fd0-460f-aa95-6f3367e82284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:01:12.193819 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a2533e-4fd0-460f-aa95-6f3367e82284 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:01:12.194217 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a2533e-4fd0-460f-aa95-6f3367e82284 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:01:12.194494 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a2533e-4fd0-460f-aa95-6f3367e82284 None admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:01:12.195349 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a2533e-4fd0-460f-aa95-6f3367e82284 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:01:12.195656 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a2533e-4fd0-460f-aa95-6f3367e82284 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:01:12.197115 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a2533e-4fd0-460f-aa95-6f3367e82284 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:01:12.218880 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 615/1240] 10.222.0.17 () {56 vars in 1143 bytes} [Sat Jul 23 21:01:12 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:01:12.225172 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bf2f75-ca35-4a76-aa89-8b9911b0c506 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:01:12.338224 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bf2f75-ca35-4a76-aa89-8b9911b0c506 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:01:12.376369 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ef4ec0-42e7-483e-955e-2cfe58c37db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:01:12.377028 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ef4ec0-42e7-483e-955e-2cfe58c37db9 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:01:12.377305 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ef4ec0-42e7-483e-955e-2cfe58c37db9 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:01:12.377575 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ef4ec0-42e7-483e-955e-2cfe58c37db9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:01:12.450891 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:01:12.459040 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ef4ec0-42e7-483e-955e-2cfe58c37db9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:01:12.460517 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ef4ec0-42e7-483e-955e-2cfe58c37db9 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:01:12.572841 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 626/1241] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Jul 23 21:01:12 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 23 21:01:12.579112 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a2533e-4fd0-460f-aa95-6f3367e82284 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:01:12.609623 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:01:12.688490 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a2533e-4fd0-460f-aa95-6f3367e82284 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:01:12.732821 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d03219-0432-450c-acf8-c2c346ccc572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:01:12.733632 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d03219-0432-450c-acf8-c2c346ccc572 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:01:12.733940 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d03219-0432-450c-acf8-c2c346ccc572 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:01:12.734202 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d03219-0432-450c-acf8-c2c346ccc572 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:01:12.745693 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d03219-0432-450c-acf8-c2c346ccc572 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:01:12.747199 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d03219-0432-450c-acf8-c2c346ccc572 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:01:12.766066 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-40d03219-0432-450c-acf8-c2c346ccc572 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 21:01:12.766066 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 21:01:12.766066 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 21:01:12.766066 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 21:01:12.766066 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 21:01:12.766066 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 21:01:12.766066 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 21:01:12.766066 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 21:01:12.766066 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 21:01:12.766066 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 21:01:12.766066 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 21:01:12.766066 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 21:01:12.766066 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 23 21:01:12.766066 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 23 21:01:12.766066 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 23 21:01:12.767541 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 23 21:01:12.767541 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 21:01:12.767541 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 21:01:12.767541 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 21:01:12.767541 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 21:01:12.767541 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 21:01:12.767541 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 21:01:12.767541 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 21:01:12.767541 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application with Lock( Jul 23 21:01:12.767541 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 21:01:12.767541 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._enter() Jul 23 21:01:12.767541 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 21:01:12.767541 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 21:01:12.767541 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 21:01:12.767541 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.creator() Jul 23 21:01:12.767541 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 21:01:12.767541 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application created_value = creator( Jul 23 21:01:12.768669 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 23 21:01:12.768669 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 23 21:01:12.768669 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 21:01:12.768669 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 21:01:12.768669 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 616/1242] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 23 21:01:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 21:01:12.773505 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ef4ec0-42e7-483e-955e-2cfe58c37db9 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:01:12.877961 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:01:12.885044 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ef4ec0-42e7-483e-955e-2cfe58c37db9 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:01:12.924226 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef6d32d-7271-44a0-8c57-324df8c55716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:01:12.924933 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef6d32d-7271-44a0-8c57-324df8c55716 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:01:12.925208 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef6d32d-7271-44a0-8c57-324df8c55716 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:01:12.925523 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef6d32d-7271-44a0-8c57-324df8c55716 None admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:01:12.926443 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef6d32d-7271-44a0-8c57-324df8c55716 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:01:12.926702 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef6d32d-7271-44a0-8c57-324df8c55716 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:01:12.928247 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef6d32d-7271-44a0-8c57-324df8c55716 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:01:12.941360 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 627/1243] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 23 21:01:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:01:12.947541 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d03219-0432-450c-acf8-c2c346ccc572 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:01:13.038256 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:01:13.064204 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d03219-0432-450c-acf8-c2c346ccc572 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:01:13.104879 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdb95dc-bd13-4f35-85dd-b9bd101b3dd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:01:13.105822 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdb95dc-bd13-4f35-85dd-b9bd101b3dd2 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:01:13.106115 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdb95dc-bd13-4f35-85dd-b9bd101b3dd2 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:01:13.106389 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdb95dc-bd13-4f35-85dd-b9bd101b3dd2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:01:13.114119 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdb95dc-bd13-4f35-85dd-b9bd101b3dd2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:01:13.115600 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdb95dc-bd13-4f35-85dd-b9bd101b3dd2 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:01:13.131108 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-cfdb95dc-bd13-4f35-85dd-b9bd101b3dd2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 23 21:01:13.131108 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 21:01:13.131108 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 21:01:13.131108 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 21:01:13.131108 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 21:01:13.131108 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 21:01:13.131108 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 21:01:13.131108 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 21:01:13.131108 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 21:01:13.131108 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 21:01:13.131108 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 21:01:13.131108 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 21:01:13.131108 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 23 21:01:13.131108 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 23 21:01:13.131108 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 23 21:01:13.132225 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 23 21:01:13.132225 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 21:01:13.132225 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 21:01:13.132225 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 21:01:13.132225 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 21:01:13.132225 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 21:01:13.132225 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 21:01:13.132225 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 21:01:13.132225 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application with Lock( Jul 23 21:01:13.132225 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 21:01:13.132225 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._enter() Jul 23 21:01:13.132225 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 21:01:13.132225 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 21:01:13.132225 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 21:01:13.132225 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.creator() Jul 23 21:01:13.132225 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 21:01:13.132225 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application created_value = creator( Jul 23 21:01:13.133424 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 23 21:01:13.133424 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 23 21:01:13.133424 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 23 21:01:13.133424 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 23 21:01:13.133424 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 23 21:01:13.133424 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 23 21:01:13.133424 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 23 21:01:13.133424 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 21:01:13.137310 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 617/1244] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Jul 23 21:01:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 21:01:13.138361 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef6d32d-7271-44a0-8c57-324df8c55716 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:01:13.255646 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef6d32d-7271-44a0-8c57-324df8c55716 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:01:13.295764 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de49a83a-142b-49c3-a99a-0e4cf7fd3f7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:01:13.296443 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de49a83a-142b-49c3-a99a-0e4cf7fd3f7d None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:01:13.296724 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de49a83a-142b-49c3-a99a-0e4cf7fd3f7d None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:01:13.296996 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de49a83a-142b-49c3-a99a-0e4cf7fd3f7d None admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:01:13.297785 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de49a83a-142b-49c3-a99a-0e4cf7fd3f7d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:01:13.298130 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de49a83a-142b-49c3-a99a-0e4cf7fd3f7d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:01:13.299598 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de49a83a-142b-49c3-a99a-0e4cf7fd3f7d None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:01:13.314667 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 628/1245] 10.222.0.17 () {56 vars in 1148 bytes} [Sat Jul 23 21:01:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:01:13.321638 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdb95dc-bd13-4f35-85dd-b9bd101b3dd2 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:01:13.434534 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdb95dc-bd13-4f35-85dd-b9bd101b3dd2 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:01:13.477652 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530493f8-bfce-4c96-a879-8739d1d94e79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:01:13.478396 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530493f8-bfce-4c96-a879-8739d1d94e79 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:01:13.478766 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530493f8-bfce-4c96-a879-8739d1d94e79 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:01:13.479059 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530493f8-bfce-4c96-a879-8739d1d94e79 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:01:13.480079 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530493f8-bfce-4c96-a879-8739d1d94e79 None admin] RBAC: Adding query filter params (role.id=abf9f3b81f3647dbb70c44d0aedaa614, scope.project.id=4804ed61295f4d4a92d9b685dd9e9f3b, user.id=abc719a3b3ac4461b82ca04ab6451d81) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:01:13.480415 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530493f8-bfce-4c96-a879-8739d1d94e79 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:01:13.482102 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530493f8-bfce-4c96-a879-8739d1d94e79 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:01:13.494029 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 618/1246] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Jul 23 21:01:13 2022] GET /identity/v3/role_assignments?user.id=abc719a3b3ac4461b82ca04ab6451d81&scope.project.id=4804ed61295f4d4a92d9b685dd9e9f3b&role.id=abf9f3b81f3647dbb70c44d0aedaa614 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:01:15.869180 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8a86e3-c672-4a30-a55e-b704c8739983 None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:01:15.869742 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8a86e3-c672-4a30-a55e-b704c8739983 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:01:15.870062 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8a86e3-c672-4a30-a55e-b704c8739983 None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:01:15.871750 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 629/1247] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 21:01:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:01:15.878380 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca49381-3933-46b1-85f0-b43dc8256357 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:01:15.879081 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca49381-3933-46b1-85f0-b43dc8256357 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:01:15.879081 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca49381-3933-46b1-85f0-b43dc8256357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:01:15.884380 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:01:15.898148 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-8ca49381-3933-46b1-85f0-b43dc8256357 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:01:15.899719 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-8ca49381-3933-46b1-85f0-b43dc8256357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:01:15.977066 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 619/1248] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 21:01:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 23 21:01:16.003729 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8a86e3-c672-4a30-a55e-b704c8739983 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:01:16.025926 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:01:16.117794 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8a86e3-c672-4a30-a55e-b704c8739983 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:01:16.156482 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f280bd2-8eda-4ae4-835c-b4bd129f9aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:01:16.159088 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f280bd2-8eda-4ae4-835c-b4bd129f9aee None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:01:16.159374 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f280bd2-8eda-4ae4-835c-b4bd129f9aee None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:01:16.159653 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f280bd2-8eda-4ae4-835c-b4bd129f9aee None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:01:16.171540 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f280bd2-8eda-4ae4-835c-b4bd129f9aee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 21:01:16.180091 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-0f280bd2-8eda-4ae4-835c-b4bd129f9aee None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 23 21:01:16.180091 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 21:01:16.180091 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 21:01:16.180091 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 21:01:16.180091 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 21:01:16.180091 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 21:01:16.180091 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 21:01:16.180091 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 21:01:16.180091 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 21:01:16.180091 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 21:01:16.180091 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 21:01:16.180091 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 21:01:16.180091 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 21:01:16.180091 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 21:01:16.180091 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 21:01:16.180091 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 21:01:16.181448 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 21:01:16.181448 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 21:01:16.181448 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 21:01:16.181448 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 21:01:16.181448 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 21:01:16.181448 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 21:01:16.181448 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 21:01:16.181448 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 21:01:16.181448 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 21:01:16.181448 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 21:01:16.181448 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 21:01:16.181448 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application with Lock( Jul 23 21:01:16.181448 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 21:01:16.181448 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._enter() Jul 23 21:01:16.181448 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 21:01:16.181448 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 21:01:16.182623 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 21:01:16.182623 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.creator() Jul 23 21:01:16.182623 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 21:01:16.182623 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application created_value = creator( Jul 23 21:01:16.182623 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 21:01:16.182623 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 21:01:16.182623 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 21:01:16.182623 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 21:01:16.182623 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 21:01:16.182623 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 21:01:16.182623 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 23 21:01:16.182623 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 21:01:16.182623 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 630/1249] 10.222.0.17 () {56 vars in 1096 bytes} [Sat Jul 23 21:01:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 21:01:16.187761 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca49381-3933-46b1-85f0-b43dc8256357 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:01:16.308058 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca49381-3933-46b1-85f0-b43dc8256357 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:01:16.341018 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:01:16.347487 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8236b256-43db-4ee8-941d-d43d73f63492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:01:16.348234 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8236b256-43db-4ee8-941d-d43d73f63492 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:01:16.348516 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8236b256-43db-4ee8-941d-d43d73f63492 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:01:16.348805 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8236b256-43db-4ee8-941d-d43d73f63492 None admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:01:16.349547 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8236b256-43db-4ee8-941d-d43d73f63492 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:01:16.349853 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8236b256-43db-4ee8-941d-d43d73f63492 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:01:16.351429 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8236b256-43db-4ee8-941d-d43d73f63492 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:01:16.362820 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 620/1250] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Jul 23 21:01:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 21:01:16.369030 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f280bd2-8eda-4ae4-835c-b4bd129f9aee None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:01:16.454781 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:01:16.482786 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f280bd2-8eda-4ae4-835c-b4bd129f9aee None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:01:16.521855 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc9d01b-aaec-4055-93a1-957a579805c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:01:16.522716 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc9d01b-aaec-4055-93a1-957a579805c8 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:01:16.522996 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc9d01b-aaec-4055-93a1-957a579805c8 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:01:16.523267 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc9d01b-aaec-4055-93a1-957a579805c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:01:16.535834 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc9d01b-aaec-4055-93a1-957a579805c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:01:16.537314 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc9d01b-aaec-4055-93a1-957a579805c8 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:01:16.556466 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-5cc9d01b-aaec-4055-93a1-957a579805c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 21:01:16.556466 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 21:01:16.556466 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 21:01:16.556466 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 21:01:16.556466 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 21:01:16.556466 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 21:01:16.556466 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 21:01:16.556466 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 21:01:16.556466 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 21:01:16.556466 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 21:01:16.556466 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 21:01:16.556466 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 21:01:16.556466 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 23 21:01:16.556466 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 23 21:01:16.556466 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 23 21:01:16.557588 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 23 21:01:16.557588 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 21:01:16.557588 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 21:01:16.557588 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 21:01:16.557588 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 21:01:16.557588 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 21:01:16.557588 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 21:01:16.557588 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 21:01:16.557588 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application with Lock( Jul 23 21:01:16.557588 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 21:01:16.557588 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._enter() Jul 23 21:01:16.557588 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 21:01:16.557588 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 21:01:16.557588 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 21:01:16.557588 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.creator() Jul 23 21:01:16.557588 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 21:01:16.557588 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application created_value = creator( Jul 23 21:01:16.558702 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 23 21:01:16.558702 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 23 21:01:16.558702 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 21:01:16.558702 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 21:01:16.558702 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 631/1251] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 23 21:01:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 21:01:16.563902 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8236b256-43db-4ee8-941d-d43d73f63492 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:01:16.673691 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8236b256-43db-4ee8-941d-d43d73f63492 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:01:16.716486 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf817712-174c-46c8-99f2-79c80b20f956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:01:16.717177 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf817712-174c-46c8-99f2-79c80b20f956 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:01:16.717448 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf817712-174c-46c8-99f2-79c80b20f956 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:01:16.717717 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf817712-174c-46c8-99f2-79c80b20f956 None admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:01:16.718485 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf817712-174c-46c8-99f2-79c80b20f956 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:01:16.718853 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf817712-174c-46c8-99f2-79c80b20f956 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:01:16.720178 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf817712-174c-46c8-99f2-79c80b20f956 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:01:16.733231 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 621/1252] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 23 21:01:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:01:16.739118 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc9d01b-aaec-4055-93a1-957a579805c8 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:01:16.882536 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc9d01b-aaec-4055-93a1-957a579805c8 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:01:16.916786 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:01:16.926447 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7403022-4653-4d28-b1e0-c2dc3984fd92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:01:16.927401 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7403022-4653-4d28-b1e0-c2dc3984fd92 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:01:16.927817 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7403022-4653-4d28-b1e0-c2dc3984fd92 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:01:16.928158 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7403022-4653-4d28-b1e0-c2dc3984fd92 None admin] PATH_INFO: `/v3/users/placement` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:01:16.937042 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7403022-4653-4d28-b1e0-c2dc3984fd92 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:01:16.938729 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7403022-4653-4d28-b1e0-c2dc3984fd92 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:01:16.954661 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-b7403022-4653-4d28-b1e0-c2dc3984fd92 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 23 21:01:16.954661 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 21:01:16.954661 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 21:01:16.954661 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 21:01:16.954661 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 21:01:16.954661 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 21:01:16.954661 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 21:01:16.954661 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 21:01:16.954661 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 21:01:16.954661 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 21:01:16.954661 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 21:01:16.954661 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 21:01:16.954661 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 23 21:01:16.954661 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 23 21:01:16.954661 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 23 21:01:16.954661 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 23 21:01:16.956101 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 21:01:16.956101 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 21:01:16.956101 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 23 21:01:16.956101 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 23 21:01:16.956101 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 23 21:01:16.956101 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 23 21:01:16.956101 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 21:01:16.956101 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 21:01:16.956101 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 21:01:16.956101 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 21:01:16.956101 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 21:01:16.956101 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application with Lock( Jul 23 21:01:16.956101 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 21:01:16.956101 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._enter() Jul 23 21:01:16.956101 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 21:01:16.956101 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 21:01:16.956101 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 21:01:16.956101 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.creator() Jul 23 21:01:16.957358 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 21:01:16.957358 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application created_value = creator( Jul 23 21:01:16.957358 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 23 21:01:16.957358 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 23 21:01:16.957358 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 23 21:01:16.957358 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 23 21:01:16.957358 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 23 21:01:16.957358 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 23 21:01:16.957358 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 23 21:01:16.957358 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 21:01:16.957358 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 632/1253] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 23 21:01:16 2022] GET /identity/v3/users/placement => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 23 21:01:16.962326 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf817712-174c-46c8-99f2-79c80b20f956 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:01:17.023214 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:01:17.083103 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf817712-174c-46c8-99f2-79c80b20f956 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:01:17.128534 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd215f77-4d67-47df-b1c6-93ea8869acb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:01:17.129231 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd215f77-4d67-47df-b1c6-93ea8869acb9 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:01:17.129535 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd215f77-4d67-47df-b1c6-93ea8869acb9 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:01:17.129803 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd215f77-4d67-47df-b1c6-93ea8869acb9 None admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:01:17.130675 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd215f77-4d67-47df-b1c6-93ea8869acb9 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:01:17.130972 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd215f77-4d67-47df-b1c6-93ea8869acb9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:01:17.132414 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd215f77-4d67-47df-b1c6-93ea8869acb9 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:01:17.153481 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 622/1254] 10.222.0.17 () {56 vars in 1143 bytes} [Sat Jul 23 21:01:16 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:01:17.159965 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7403022-4653-4d28-b1e0-c2dc3984fd92 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:01:17.279791 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7403022-4653-4d28-b1e0-c2dc3984fd92 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:01:17.317581 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f105e5-a54a-4174-a709-06d36b87161e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:01:17.318272 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f105e5-a54a-4174-a709-06d36b87161e None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:01:17.318545 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f105e5-a54a-4174-a709-06d36b87161e None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:01:17.318810 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f105e5-a54a-4174-a709-06d36b87161e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:01:17.383878 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:01:17.400279 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f105e5-a54a-4174-a709-06d36b87161e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:01:17.401743 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f105e5-a54a-4174-a709-06d36b87161e None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:01:17.537933 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 633/1255] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Jul 23 21:01:17 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 23 21:01:17.540896 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd215f77-4d67-47df-b1c6-93ea8869acb9 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:01:17.664383 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd215f77-4d67-47df-b1c6-93ea8869acb9 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:01:17.682066 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:01:17.707586 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56368c8e-c40c-4fe6-960c-2d2cc43140c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:01:17.708397 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56368c8e-c40c-4fe6-960c-2d2cc43140c3 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:01:17.708797 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56368c8e-c40c-4fe6-960c-2d2cc43140c3 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:01:17.709104 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56368c8e-c40c-4fe6-960c-2d2cc43140c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:01:17.720976 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56368c8e-c40c-4fe6-960c-2d2cc43140c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:01:17.722592 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56368c8e-c40c-4fe6-960c-2d2cc43140c3 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:01:17.742274 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-56368c8e-c40c-4fe6-960c-2d2cc43140c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 21:01:17.742274 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 21:01:17.742274 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 21:01:17.742274 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 21:01:17.742274 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 21:01:17.742274 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 21:01:17.742274 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 21:01:17.742274 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 21:01:17.742274 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 21:01:17.742274 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 21:01:17.742274 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 21:01:17.742274 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 21:01:17.742274 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 23 21:01:17.742274 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 23 21:01:17.742274 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 23 21:01:17.743460 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 23 21:01:17.743460 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 21:01:17.743460 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 21:01:17.743460 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 21:01:17.743460 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 21:01:17.743460 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 21:01:17.743460 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 21:01:17.743460 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 21:01:17.743460 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application with Lock( Jul 23 21:01:17.743460 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 21:01:17.743460 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._enter() Jul 23 21:01:17.743460 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 21:01:17.743460 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 21:01:17.743460 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 21:01:17.743460 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.creator() Jul 23 21:01:17.743460 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 21:01:17.743460 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application created_value = creator( Jul 23 21:01:17.744595 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 23 21:01:17.744595 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 23 21:01:17.744595 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 21:01:17.744595 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 21:01:17.744595 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 623/1256] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 23 21:01:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 21:01:17.751143 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f105e5-a54a-4174-a709-06d36b87161e None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:01:17.847455 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:01:17.862392 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f105e5-a54a-4174-a709-06d36b87161e None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:01:17.902314 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c96747-85bb-47fa-9f67-46bb9c57e54f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:01:17.903007 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c96747-85bb-47fa-9f67-46bb9c57e54f None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:01:17.903491 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c96747-85bb-47fa-9f67-46bb9c57e54f None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:01:17.903776 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c96747-85bb-47fa-9f67-46bb9c57e54f None admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:01:17.904556 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c96747-85bb-47fa-9f67-46bb9c57e54f None admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:01:17.904862 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c96747-85bb-47fa-9f67-46bb9c57e54f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:01:17.906486 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c96747-85bb-47fa-9f67-46bb9c57e54f None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:01:17.920530 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 634/1257] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 23 21:01:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:01:17.927105 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56368c8e-c40c-4fe6-960c-2d2cc43140c3 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:01:18.046025 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56368c8e-c40c-4fe6-960c-2d2cc43140c3 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:01:18.086135 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edc8d86-f88c-43d5-a9da-99d8447037e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:01:18.086135 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edc8d86-f88c-43d5-a9da-99d8447037e6 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:01:18.086135 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edc8d86-f88c-43d5-a9da-99d8447037e6 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:01:18.086135 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edc8d86-f88c-43d5-a9da-99d8447037e6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:01:18.093309 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edc8d86-f88c-43d5-a9da-99d8447037e6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:01:18.095079 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edc8d86-f88c-43d5-a9da-99d8447037e6 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:01:18.109821 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-9edc8d86-f88c-43d5-a9da-99d8447037e6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 23 21:01:18.109821 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 21:01:18.109821 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 21:01:18.109821 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 21:01:18.109821 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 21:01:18.109821 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 21:01:18.109821 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 21:01:18.109821 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 21:01:18.109821 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 21:01:18.109821 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 21:01:18.109821 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 21:01:18.109821 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 21:01:18.109821 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 23 21:01:18.109821 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 23 21:01:18.109821 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 23 21:01:18.111229 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 23 21:01:18.111229 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 21:01:18.111229 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 21:01:18.111229 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 21:01:18.111229 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 21:01:18.111229 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 21:01:18.111229 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 21:01:18.111229 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 21:01:18.111229 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application with Lock( Jul 23 21:01:18.111229 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 21:01:18.111229 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._enter() Jul 23 21:01:18.111229 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 21:01:18.111229 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 21:01:18.111229 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 21:01:18.111229 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.creator() Jul 23 21:01:18.111229 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 21:01:18.111229 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application created_value = creator( Jul 23 21:01:18.112306 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 23 21:01:18.112306 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 23 21:01:18.112306 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 23 21:01:18.112306 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 23 21:01:18.112306 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 23 21:01:18.112306 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 23 21:01:18.112306 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 23 21:01:18.112306 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 21:01:18.112306 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 624/1258] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Jul 23 21:01:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 21:01:18.117319 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c96747-85bb-47fa-9f67-46bb9c57e54f None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:01:18.236692 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c96747-85bb-47fa-9f67-46bb9c57e54f None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:01:18.281018 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f33ea1b-dd3c-4add-ba70-f4c4d279d0bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:01:18.281730 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f33ea1b-dd3c-4add-ba70-f4c4d279d0bc None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:01:18.282152 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f33ea1b-dd3c-4add-ba70-f4c4d279d0bc None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:01:18.282425 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f33ea1b-dd3c-4add-ba70-f4c4d279d0bc None admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:01:18.283214 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f33ea1b-dd3c-4add-ba70-f4c4d279d0bc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:01:18.283519 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f33ea1b-dd3c-4add-ba70-f4c4d279d0bc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:01:18.284981 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f33ea1b-dd3c-4add-ba70-f4c4d279d0bc None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:01:18.306752 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 635/1259] 10.222.0.17 () {56 vars in 1148 bytes} [Sat Jul 23 21:01:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:01:18.313026 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edc8d86-f88c-43d5-a9da-99d8447037e6 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:01:18.340561 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:01:18.437229 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edc8d86-f88c-43d5-a9da-99d8447037e6 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:01:18.480529 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e7836f-010a-47af-8d43-646372077ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:01:18.481675 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e7836f-010a-47af-8d43-646372077ce8 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:01:18.482083 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e7836f-010a-47af-8d43-646372077ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:01:18.482269 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e7836f-010a-47af-8d43-646372077ce8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:01:18.483204 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e7836f-010a-47af-8d43-646372077ce8 None admin] RBAC: Adding query filter params (role.id=fec17bfdc65349a2b9c06a89131191df, scope.project.id=4804ed61295f4d4a92d9b685dd9e9f3b, user.id=abc719a3b3ac4461b82ca04ab6451d81) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:01:18.483648 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e7836f-010a-47af-8d43-646372077ce8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:01:18.485183 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e7836f-010a-47af-8d43-646372077ce8 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:01:18.493809 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 625/1260] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Jul 23 21:01:18 2022] GET /identity/v3/role_assignments?user.id=abc719a3b3ac4461b82ca04ab6451d81&scope.project.id=4804ed61295f4d4a92d9b685dd9e9f3b&role.id=fec17bfdc65349a2b9c06a89131191df => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:01:20.779122 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ced5cf3-ff86-48c4-b545-0df88a1dfcbc None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:01:20.779695 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ced5cf3-ff86-48c4-b545-0df88a1dfcbc None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:01:20.779695 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ced5cf3-ff86-48c4-b545-0df88a1dfcbc None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:01:20.781017 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 636/1261] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 21:01:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:01:20.786593 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd60980-913c-4575-a5b7-f9cd7a01305a None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:01:20.787085 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd60980-913c-4575-a5b7-f9cd7a01305a None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:01:20.787085 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd60980-913c-4575-a5b7-f9cd7a01305a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:01:20.805270 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-bcd60980-913c-4575-a5b7-f9cd7a01305a None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:01:20.806598 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-bcd60980-913c-4575-a5b7-f9cd7a01305a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:01:20.879754 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 626/1262] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 21:01:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 23 21:01:20.903798 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ced5cf3-ff86-48c4-b545-0df88a1dfcbc None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:01:20.915159 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:01:21.009268 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ced5cf3-ff86-48c4-b545-0df88a1dfcbc None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:01:21.045136 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6edb384-bda3-4476-b6a6-c89b88679b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:01:21.045843 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6edb384-bda3-4476-b6a6-c89b88679b81 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:01:21.046147 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6edb384-bda3-4476-b6a6-c89b88679b81 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:01:21.046447 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6edb384-bda3-4476-b6a6-c89b88679b81 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:01:21.057129 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6edb384-bda3-4476-b6a6-c89b88679b81 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 21:01:21.064715 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-e6edb384-bda3-4476-b6a6-c89b88679b81 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 23 21:01:21.064715 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 21:01:21.064715 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 21:01:21.064715 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 21:01:21.064715 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 21:01:21.064715 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 21:01:21.064715 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 21:01:21.064715 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 21:01:21.064715 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 21:01:21.064715 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 21:01:21.064715 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 21:01:21.064715 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 21:01:21.064715 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 21:01:21.064715 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 21:01:21.064715 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 21:01:21.064715 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 21:01:21.065776 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 21:01:21.065776 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 21:01:21.065776 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 21:01:21.065776 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 21:01:21.065776 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 21:01:21.065776 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 21:01:21.065776 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 21:01:21.065776 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 21:01:21.065776 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 21:01:21.065776 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 21:01:21.065776 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 21:01:21.065776 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application with Lock( Jul 23 21:01:21.065776 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 21:01:21.065776 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._enter() Jul 23 21:01:21.065776 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 21:01:21.065776 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 21:01:21.066796 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 21:01:21.066796 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.creator() Jul 23 21:01:21.066796 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 21:01:21.066796 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application created_value = creator( Jul 23 21:01:21.066796 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 21:01:21.066796 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 21:01:21.066796 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 21:01:21.066796 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 21:01:21.066796 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 21:01:21.066796 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 21:01:21.066796 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 23 21:01:21.066796 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 21:01:21.070068 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 637/1263] 10.222.0.17 () {56 vars in 1096 bytes} [Sat Jul 23 21:01:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 21:01:21.072201 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd60980-913c-4575-a5b7-f9cd7a01305a None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:01:21.093327 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:01:21.178136 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd60980-913c-4575-a5b7-f9cd7a01305a None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:01:21.213037 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6b7ecb-9bff-46e9-81bb-0464167d8587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:01:21.213708 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6b7ecb-9bff-46e9-81bb-0464167d8587 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:01:21.214016 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6b7ecb-9bff-46e9-81bb-0464167d8587 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:01:21.214286 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6b7ecb-9bff-46e9-81bb-0464167d8587 None admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:01:21.215032 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6b7ecb-9bff-46e9-81bb-0464167d8587 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:01:21.215326 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6b7ecb-9bff-46e9-81bb-0464167d8587 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:01:21.216700 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6b7ecb-9bff-46e9-81bb-0464167d8587 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:01:21.224941 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 627/1264] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Jul 23 21:01:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:01:21.230983 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6edb384-bda3-4476-b6a6-c89b88679b81 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:01:21.301505 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:01:21.336873 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6edb384-bda3-4476-b6a6-c89b88679b81 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:01:21.373022 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a16e4c-b850-439a-a6f4-90cf9aa104d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:01:21.373841 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a16e4c-b850-439a-a6f4-90cf9aa104d2 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:01:21.374144 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a16e4c-b850-439a-a6f4-90cf9aa104d2 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:01:21.374855 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a16e4c-b850-439a-a6f4-90cf9aa104d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:01:21.386325 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a16e4c-b850-439a-a6f4-90cf9aa104d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:01:21.387799 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a16e4c-b850-439a-a6f4-90cf9aa104d2 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:01:21.405905 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-27a16e4c-b850-439a-a6f4-90cf9aa104d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 21:01:21.405905 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 21:01:21.405905 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 21:01:21.405905 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 21:01:21.405905 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 21:01:21.405905 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 21:01:21.405905 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 21:01:21.405905 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 21:01:21.405905 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 21:01:21.405905 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 21:01:21.405905 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 21:01:21.405905 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 21:01:21.405905 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 23 21:01:21.405905 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 23 21:01:21.405905 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 23 21:01:21.407021 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 23 21:01:21.407021 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 21:01:21.407021 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 21:01:21.407021 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 21:01:21.407021 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 21:01:21.407021 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 21:01:21.407021 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 21:01:21.407021 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 21:01:21.407021 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application with Lock( Jul 23 21:01:21.407021 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 21:01:21.407021 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._enter() Jul 23 21:01:21.407021 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 21:01:21.407021 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 21:01:21.407021 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 21:01:21.407021 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.creator() Jul 23 21:01:21.407021 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 21:01:21.407021 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application created_value = creator( Jul 23 21:01:21.408227 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 23 21:01:21.408227 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 23 21:01:21.408227 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 21:01:21.408227 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 21:01:21.408227 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 638/1265] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 23 21:01:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 21:01:21.413931 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6b7ecb-9bff-46e9-81bb-0464167d8587 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:01:21.510572 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:01:21.533506 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6b7ecb-9bff-46e9-81bb-0464167d8587 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:01:21.572825 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02c7e27-226f-4821-a48a-ca187afaa880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:01:21.573404 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02c7e27-226f-4821-a48a-ca187afaa880 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:01:21.573686 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02c7e27-226f-4821-a48a-ca187afaa880 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:01:21.573996 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02c7e27-226f-4821-a48a-ca187afaa880 None admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:01:21.574732 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02c7e27-226f-4821-a48a-ca187afaa880 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:01:21.575035 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02c7e27-226f-4821-a48a-ca187afaa880 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:01:21.576428 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02c7e27-226f-4821-a48a-ca187afaa880 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:01:21.588645 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 628/1266] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 23 21:01:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:01:21.595682 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a16e4c-b850-439a-a6f4-90cf9aa104d2 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:01:21.707401 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a16e4c-b850-439a-a6f4-90cf9aa104d2 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:01:21.727692 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:01:21.742776 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e8e08e-c29a-427f-b227-c6f90b2a66fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:01:21.743625 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e8e08e-c29a-427f-b227-c6f90b2a66fd None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:01:21.743903 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e8e08e-c29a-427f-b227-c6f90b2a66fd None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:01:21.744148 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e8e08e-c29a-427f-b227-c6f90b2a66fd None admin] PATH_INFO: `/v3/users/placement` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:01:21.751806 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e8e08e-c29a-427f-b227-c6f90b2a66fd None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:01:21.753258 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e8e08e-c29a-427f-b227-c6f90b2a66fd None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:01:21.767690 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-e7e8e08e-c29a-427f-b227-c6f90b2a66fd None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 23 21:01:21.767690 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 21:01:21.767690 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 21:01:21.767690 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 21:01:21.767690 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 21:01:21.767690 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 21:01:21.767690 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 21:01:21.767690 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 21:01:21.767690 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 21:01:21.767690 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 21:01:21.767690 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 21:01:21.767690 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 21:01:21.767690 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 23 21:01:21.767690 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 23 21:01:21.767690 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 23 21:01:21.767690 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 23 21:01:21.768746 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 21:01:21.768746 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 21:01:21.768746 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 23 21:01:21.768746 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 23 21:01:21.768746 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 23 21:01:21.768746 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 23 21:01:21.768746 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 21:01:21.768746 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 21:01:21.768746 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 21:01:21.768746 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 21:01:21.768746 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 21:01:21.768746 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application with Lock( Jul 23 21:01:21.768746 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 21:01:21.768746 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._enter() Jul 23 21:01:21.768746 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 21:01:21.768746 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 21:01:21.768746 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 21:01:21.768746 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.creator() Jul 23 21:01:21.769923 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 21:01:21.769923 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application created_value = creator( Jul 23 21:01:21.769923 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 23 21:01:21.769923 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 23 21:01:21.769923 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 23 21:01:21.769923 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 23 21:01:21.769923 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 23 21:01:21.769923 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 23 21:01:21.769923 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 23 21:01:21.769923 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 21:01:21.769923 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 639/1267] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 23 21:01:21 2022] GET /identity/v3/users/placement => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 21:01:21.776045 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02c7e27-226f-4821-a48a-ca187afaa880 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:01:21.880846 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02c7e27-226f-4821-a48a-ca187afaa880 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:01:21.916684 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22032b21-9d03-48e0-988f-3e9aaa297a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:01:21.917367 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22032b21-9d03-48e0-988f-3e9aaa297a79 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:01:21.917648 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22032b21-9d03-48e0-988f-3e9aaa297a79 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:01:21.917919 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22032b21-9d03-48e0-988f-3e9aaa297a79 None admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:01:21.918789 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22032b21-9d03-48e0-988f-3e9aaa297a79 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:01:21.919090 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22032b21-9d03-48e0-988f-3e9aaa297a79 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:01:21.920545 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22032b21-9d03-48e0-988f-3e9aaa297a79 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:01:21.930283 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:01:21.939848 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 629/1268] 10.222.0.17 () {56 vars in 1143 bytes} [Sat Jul 23 21:01:21 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:01:21.945963 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e8e08e-c29a-427f-b227-c6f90b2a66fd None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:01:22.062266 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e8e08e-c29a-427f-b227-c6f90b2a66fd None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:01:22.098450 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f160b4-0068-4a21-8ad7-0eff7a36d395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:01:22.099271 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f160b4-0068-4a21-8ad7-0eff7a36d395 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:01:22.099514 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f160b4-0068-4a21-8ad7-0eff7a36d395 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:01:22.099821 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f160b4-0068-4a21-8ad7-0eff7a36d395 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:01:22.111206 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f160b4-0068-4a21-8ad7-0eff7a36d395 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:01:22.112669 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f160b4-0068-4a21-8ad7-0eff7a36d395 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:01:22.130675 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-26f160b4-0068-4a21-8ad7-0eff7a36d395 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 21:01:22.130675 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 21:01:22.130675 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 21:01:22.130675 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 21:01:22.130675 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 21:01:22.130675 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 21:01:22.130675 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 21:01:22.130675 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 21:01:22.130675 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 21:01:22.130675 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 21:01:22.130675 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 21:01:22.130675 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 21:01:22.130675 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 23 21:01:22.130675 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 23 21:01:22.130675 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 23 21:01:22.132341 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 23 21:01:22.132341 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 21:01:22.132341 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 21:01:22.132341 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 21:01:22.132341 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 21:01:22.132341 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 21:01:22.132341 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 21:01:22.132341 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 21:01:22.132341 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application with Lock( Jul 23 21:01:22.132341 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 21:01:22.132341 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._enter() Jul 23 21:01:22.132341 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 21:01:22.132341 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 21:01:22.132341 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 21:01:22.132341 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.creator() Jul 23 21:01:22.132341 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 21:01:22.132341 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application created_value = creator( Jul 23 21:01:22.133773 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 23 21:01:22.133773 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 23 21:01:22.133773 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 21:01:22.133773 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 21:01:22.133773 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 640/1269] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 23 21:01:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 21:01:22.138013 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22032b21-9d03-48e0-988f-3e9aaa297a79 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:01:22.241755 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22032b21-9d03-48e0-988f-3e9aaa297a79 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:01:22.286626 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2caecba-5c07-402e-8ab8-e079a48bfff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:01:22.287318 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2caecba-5c07-402e-8ab8-e079a48bfff5 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:01:22.287590 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2caecba-5c07-402e-8ab8-e079a48bfff5 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:01:22.287856 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2caecba-5c07-402e-8ab8-e079a48bfff5 None admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:01:22.288590 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2caecba-5c07-402e-8ab8-e079a48bfff5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:01:22.288883 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2caecba-5c07-402e-8ab8-e079a48bfff5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:01:22.290355 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2caecba-5c07-402e-8ab8-e079a48bfff5 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:01:22.303367 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 630/1270] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 23 21:01:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:01:22.309610 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f160b4-0068-4a21-8ad7-0eff7a36d395 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:01:22.358855 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:01:22.444783 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f160b4-0068-4a21-8ad7-0eff7a36d395 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:01:22.485238 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e85e526-3b00-4a6e-9c5c-2ee1bb3a9efb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:01:22.486248 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e85e526-3b00-4a6e-9c5c-2ee1bb3a9efb None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:01:22.486537 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e85e526-3b00-4a6e-9c5c-2ee1bb3a9efb None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:01:22.486885 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e85e526-3b00-4a6e-9c5c-2ee1bb3a9efb None admin] PATH_INFO: `/v3/projects/service` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:01:22.497961 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e85e526-3b00-4a6e-9c5c-2ee1bb3a9efb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:01:22.501115 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e85e526-3b00-4a6e-9c5c-2ee1bb3a9efb None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:01:22.520406 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-1e85e526-3b00-4a6e-9c5c-2ee1bb3a9efb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 23 21:01:22.520406 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 21:01:22.520406 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 21:01:22.520406 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 21:01:22.520406 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 21:01:22.520406 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 21:01:22.520406 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 21:01:22.520406 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 21:01:22.520406 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 21:01:22.520406 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 21:01:22.520406 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 21:01:22.520406 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 21:01:22.520406 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 23 21:01:22.520406 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 23 21:01:22.520406 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 23 21:01:22.521541 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 23 21:01:22.521541 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 21:01:22.521541 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 21:01:22.521541 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 21:01:22.521541 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 21:01:22.521541 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 21:01:22.521541 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 21:01:22.521541 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 21:01:22.521541 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application with Lock( Jul 23 21:01:22.521541 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 21:01:22.521541 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._enter() Jul 23 21:01:22.521541 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 21:01:22.521541 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 21:01:22.521541 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 21:01:22.521541 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.creator() Jul 23 21:01:22.521541 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 21:01:22.521541 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application created_value = creator( Jul 23 21:01:22.522644 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 23 21:01:22.522644 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 23 21:01:22.522644 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 23 21:01:22.522644 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 23 21:01:22.522644 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 23 21:01:22.522644 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 23 21:01:22.522644 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 23 21:01:22.522644 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 21:01:22.523187 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 641/1271] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Jul 23 21:01:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 21:01:22.529370 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2caecba-5c07-402e-8ab8-e079a48bfff5 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:01:22.589650 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:01:22.647348 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2caecba-5c07-402e-8ab8-e079a48bfff5 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:01:22.682627 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63109de-1acd-4838-a404-21fca53e250e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:01:22.683292 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63109de-1acd-4838-a404-21fca53e250e None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:01:22.683571 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63109de-1acd-4838-a404-21fca53e250e None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:01:22.683838 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63109de-1acd-4838-a404-21fca53e250e None admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:01:22.684618 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63109de-1acd-4838-a404-21fca53e250e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:01:22.684925 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63109de-1acd-4838-a404-21fca53e250e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:01:22.686400 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63109de-1acd-4838-a404-21fca53e250e None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:01:22.699023 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 631/1272] 10.222.0.17 () {56 vars in 1148 bytes} [Sat Jul 23 21:01:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:01:22.706107 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e85e526-3b00-4a6e-9c5c-2ee1bb3a9efb None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:01:22.801890 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:01:22.812773 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e85e526-3b00-4a6e-9c5c-2ee1bb3a9efb None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:01:22.850853 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcfde0c-8ae9-4874-b8c9-11ae8671b941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:01:22.851749 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcfde0c-8ae9-4874-b8c9-11ae8671b941 None admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:01:22.852020 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcfde0c-8ae9-4874-b8c9-11ae8671b941 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:01:22.852281 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcfde0c-8ae9-4874-b8c9-11ae8671b941 None admin] PATH_INFO: `/v3/projects/4804ed61295f4d4a92d9b685dd9e9f3b/users/abc719a3b3ac4461b82ca04ab6451d81/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:01:22.854310 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcfde0c-8ae9-4874-b8c9-11ae8671b941 None admin] RBAC: Authorizing `identity:create_grant(project_id=4804ed61295f4d4a92d9b685dd9e9f3b, user_id=abc719a3b3ac4461b82ca04ab6451d81, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:01:22.855752 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcfde0c-8ae9-4874-b8c9-11ae8671b941 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:01:22.870316 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 642/1273] 10.222.0.17 () {58 vars in 1439 bytes} [Sat Jul 23 21:01:22 2022] PUT /identity/v3/projects/4804ed61295f4d4a92d9b685dd9e9f3b/users/abc719a3b3ac4461b82ca04ab6451d81/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:01:25.116866 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dc3984-dc67-44dc-ab32-381a6fb3e1f1 None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:01:25.117419 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dc3984-dc67-44dc-ab32-381a6fb3e1f1 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:01:25.117419 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dc3984-dc67-44dc-ab32-381a6fb3e1f1 None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:01:25.118838 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 632/1274] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 21:01:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:01:25.124564 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6634d0a0-8b66-451b-9826-4ce95bcaf84b None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:01:25.124978 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6634d0a0-8b66-451b-9826-4ce95bcaf84b None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:01:25.125086 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6634d0a0-8b66-451b-9826-4ce95bcaf84b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:01:25.143165 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-6634d0a0-8b66-451b-9826-4ce95bcaf84b None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:01:25.144362 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-6634d0a0-8b66-451b-9826-4ce95bcaf84b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:01:25.213588 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 643/1275] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 21:01:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 23 21:01:25.239313 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dc3984-dc67-44dc-ab32-381a6fb3e1f1 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:01:25.359818 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dc3984-dc67-44dc-ab32-381a6fb3e1f1 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:01:25.380079 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:01:25.398125 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e272b9-887e-4444-b812-871fc8eded50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:01:25.398940 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e272b9-887e-4444-b812-871fc8eded50 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:01:25.399595 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e272b9-887e-4444-b812-871fc8eded50 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:01:25.399857 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e272b9-887e-4444-b812-871fc8eded50 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:01:25.412227 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e272b9-887e-4444-b812-871fc8eded50 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 21:01:25.420204 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-21e272b9-887e-4444-b812-871fc8eded50 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 23 21:01:25.420204 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 21:01:25.420204 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 21:01:25.420204 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 21:01:25.420204 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 21:01:25.420204 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 21:01:25.420204 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 21:01:25.420204 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 21:01:25.420204 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 21:01:25.420204 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 21:01:25.420204 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 21:01:25.420204 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 21:01:25.420204 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 23 21:01:25.420204 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 23 21:01:25.420204 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 23 21:01:25.420204 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 23 21:01:25.421262 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 21:01:25.421262 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 21:01:25.421262 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 21:01:25.421262 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 21:01:25.421262 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 21:01:25.421262 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 21:01:25.421262 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 21:01:25.421262 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 21:01:25.421262 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 21:01:25.421262 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 21:01:25.421262 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 21:01:25.421262 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application with Lock( Jul 23 21:01:25.421262 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 21:01:25.421262 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._enter() Jul 23 21:01:25.421262 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 21:01:25.421262 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 21:01:25.422163 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 21:01:25.422163 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.creator() Jul 23 21:01:25.422163 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 21:01:25.422163 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application created_value = creator( Jul 23 21:01:25.422163 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 21:01:25.422163 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 21:01:25.422163 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 21:01:25.422163 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 21:01:25.422163 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 21:01:25.422163 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 21:01:25.422163 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 23 21:01:25.422163 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 21:01:25.422163 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 633/1276] 10.222.0.17 () {56 vars in 1096 bytes} [Sat Jul 23 21:01:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 21:01:25.427995 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6634d0a0-8b66-451b-9826-4ce95bcaf84b None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:01:25.527971 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:01:25.550084 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6634d0a0-8b66-451b-9826-4ce95bcaf84b None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:01:25.584494 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951e519c-7bf8-4b98-91b0-ad00e8b62939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:01:25.585169 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951e519c-7bf8-4b98-91b0-ad00e8b62939 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:01:25.585451 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951e519c-7bf8-4b98-91b0-ad00e8b62939 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:01:25.585721 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951e519c-7bf8-4b98-91b0-ad00e8b62939 None admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:01:25.586498 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951e519c-7bf8-4b98-91b0-ad00e8b62939 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:01:25.586799 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951e519c-7bf8-4b98-91b0-ad00e8b62939 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:01:25.588166 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951e519c-7bf8-4b98-91b0-ad00e8b62939 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:01:25.596260 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 644/1277] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Jul 23 21:01:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:01:25.602380 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e272b9-887e-4444-b812-871fc8eded50 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:01:25.727413 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e272b9-887e-4444-b812-871fc8eded50 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:01:25.762146 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb9e804-df7b-4305-8f8c-35894971cb37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:01:25.763141 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb9e804-df7b-4305-8f8c-35894971cb37 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:01:25.763555 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb9e804-df7b-4305-8f8c-35894971cb37 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:01:25.764028 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb9e804-df7b-4305-8f8c-35894971cb37 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:01:25.775412 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb9e804-df7b-4305-8f8c-35894971cb37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:01:25.776838 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb9e804-df7b-4305-8f8c-35894971cb37 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:01:25.793900 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-ccb9e804-df7b-4305-8f8c-35894971cb37 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 21:01:25.793900 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 21:01:25.793900 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 21:01:25.793900 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 21:01:25.793900 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 21:01:25.793900 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 21:01:25.793900 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 21:01:25.793900 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 21:01:25.793900 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 21:01:25.793900 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 21:01:25.793900 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 21:01:25.793900 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 21:01:25.793900 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 23 21:01:25.793900 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 23 21:01:25.793900 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 23 21:01:25.794996 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 23 21:01:25.794996 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 21:01:25.794996 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 21:01:25.794996 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 21:01:25.794996 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 21:01:25.794996 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 21:01:25.794996 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 21:01:25.794996 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 21:01:25.794996 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application with Lock( Jul 23 21:01:25.794996 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 21:01:25.794996 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._enter() Jul 23 21:01:25.794996 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 21:01:25.794996 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 21:01:25.794996 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 21:01:25.794996 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.creator() Jul 23 21:01:25.794996 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 21:01:25.794996 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application created_value = creator( Jul 23 21:01:25.796165 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 23 21:01:25.796165 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 23 21:01:25.796165 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 21:01:25.796165 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 21:01:25.796165 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 634/1278] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 23 21:01:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 21:01:25.801268 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951e519c-7bf8-4b98-91b0-ad00e8b62939 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:01:25.908411 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951e519c-7bf8-4b98-91b0-ad00e8b62939 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:01:25.944825 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165cdd9c-5549-480c-a1f6-463ed91296c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:01:25.945500 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165cdd9c-5549-480c-a1f6-463ed91296c6 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:01:25.945772 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165cdd9c-5549-480c-a1f6-463ed91296c6 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:01:25.946069 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165cdd9c-5549-480c-a1f6-463ed91296c6 None admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:01:25.946792 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165cdd9c-5549-480c-a1f6-463ed91296c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:01:25.947091 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165cdd9c-5549-480c-a1f6-463ed91296c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:01:25.948463 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165cdd9c-5549-480c-a1f6-463ed91296c6 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:01:25.960601 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 645/1279] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 23 21:01:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 21:01:25.966646 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb9e804-df7b-4305-8f8c-35894971cb37 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:01:26.000609 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:01:26.073483 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb9e804-df7b-4305-8f8c-35894971cb37 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:01:26.107660 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6bab2f-b22d-44d7-9937-4b09fee4f618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:01:26.108456 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6bab2f-b22d-44d7-9937-4b09fee4f618 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:01:26.108730 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6bab2f-b22d-44d7-9937-4b09fee4f618 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:01:26.108997 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6bab2f-b22d-44d7-9937-4b09fee4f618 None admin] PATH_INFO: `/v3/users/placement` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:01:26.116901 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6bab2f-b22d-44d7-9937-4b09fee4f618 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:01:26.118387 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6bab2f-b22d-44d7-9937-4b09fee4f618 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:01:26.132887 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-8e6bab2f-b22d-44d7-9937-4b09fee4f618 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 23 21:01:26.132887 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 21:01:26.132887 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 21:01:26.132887 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 21:01:26.132887 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 21:01:26.132887 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 21:01:26.132887 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 21:01:26.132887 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 21:01:26.132887 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 21:01:26.132887 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 21:01:26.132887 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 21:01:26.132887 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 21:01:26.132887 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 23 21:01:26.132887 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 23 21:01:26.132887 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 23 21:01:26.132887 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 23 21:01:26.134076 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 21:01:26.134076 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 21:01:26.134076 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 23 21:01:26.134076 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 23 21:01:26.134076 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 23 21:01:26.134076 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 23 21:01:26.134076 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 21:01:26.134076 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 21:01:26.134076 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 21:01:26.134076 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 21:01:26.134076 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 21:01:26.134076 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application with Lock( Jul 23 21:01:26.134076 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 21:01:26.134076 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._enter() Jul 23 21:01:26.134076 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 21:01:26.134076 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 21:01:26.134076 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 21:01:26.134076 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.creator() Jul 23 21:01:26.135286 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 21:01:26.135286 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application created_value = creator( Jul 23 21:01:26.135286 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 23 21:01:26.135286 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 23 21:01:26.135286 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 23 21:01:26.135286 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 23 21:01:26.135286 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 23 21:01:26.135286 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 23 21:01:26.135286 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 23 21:01:26.135286 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 21:01:26.135286 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 635/1280] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 23 21:01:25 2022] GET /identity/v3/users/placement => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 21:01:26.140572 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165cdd9c-5549-480c-a1f6-463ed91296c6 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:01:26.145002 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:01:26.247336 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165cdd9c-5549-480c-a1f6-463ed91296c6 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:01:26.287891 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bddd927-f15f-4749-81df-a593f0edf70c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:01:26.288581 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bddd927-f15f-4749-81df-a593f0edf70c None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:01:26.288854 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bddd927-f15f-4749-81df-a593f0edf70c None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:01:26.289120 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bddd927-f15f-4749-81df-a593f0edf70c None admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:01:26.289984 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bddd927-f15f-4749-81df-a593f0edf70c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:01:26.290287 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bddd927-f15f-4749-81df-a593f0edf70c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:01:26.291722 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bddd927-f15f-4749-81df-a593f0edf70c None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:01:26.309805 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 646/1281] 10.222.0.17 () {56 vars in 1143 bytes} [Sat Jul 23 21:01:26 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:01:26.315883 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6bab2f-b22d-44d7-9937-4b09fee4f618 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:01:26.413696 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:01:26.428987 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6bab2f-b22d-44d7-9937-4b09fee4f618 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:01:26.463058 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bd8c5f-6fbf-4232-aa59-90c5ada86458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:01:26.463726 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bd8c5f-6fbf-4232-aa59-90c5ada86458 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:01:26.464035 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bd8c5f-6fbf-4232-aa59-90c5ada86458 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:01:26.464312 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bd8c5f-6fbf-4232-aa59-90c5ada86458 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:01:26.542240 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bd8c5f-6fbf-4232-aa59-90c5ada86458 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:01:26.543606 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bd8c5f-6fbf-4232-aa59-90c5ada86458 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:01:26.639219 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:01:26.651286 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 636/1282] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Jul 23 21:01:26 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 23 21:01:26.657474 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bddd927-f15f-4749-81df-a593f0edf70c None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:01:26.720766 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:01:26.762232 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bddd927-f15f-4749-81df-a593f0edf70c None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:01:26.797789 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263e2785-fcd7-459c-abf1-780ef0c7c5e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:01:26.798549 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263e2785-fcd7-459c-abf1-780ef0c7c5e3 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:01:26.798823 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263e2785-fcd7-459c-abf1-780ef0c7c5e3 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:01:26.799091 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263e2785-fcd7-459c-abf1-780ef0c7c5e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:01:26.809686 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263e2785-fcd7-459c-abf1-780ef0c7c5e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:01:26.811083 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263e2785-fcd7-459c-abf1-780ef0c7c5e3 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:01:26.829609 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-263e2785-fcd7-459c-abf1-780ef0c7c5e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 21:01:26.829609 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 21:01:26.829609 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 21:01:26.829609 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 21:01:26.829609 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 21:01:26.829609 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 21:01:26.829609 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 21:01:26.829609 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 21:01:26.829609 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 21:01:26.829609 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 21:01:26.829609 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 21:01:26.829609 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 21:01:26.829609 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 23 21:01:26.829609 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 23 21:01:26.829609 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 23 21:01:26.830745 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 23 21:01:26.830745 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 21:01:26.830745 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 21:01:26.830745 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 21:01:26.830745 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 21:01:26.830745 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 21:01:26.830745 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 21:01:26.830745 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 21:01:26.830745 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application with Lock( Jul 23 21:01:26.830745 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 21:01:26.830745 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._enter() Jul 23 21:01:26.830745 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 21:01:26.830745 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 21:01:26.830745 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 21:01:26.830745 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.creator() Jul 23 21:01:26.830745 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 21:01:26.830745 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application created_value = creator( Jul 23 21:01:26.831762 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 23 21:01:26.831762 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 23 21:01:26.831762 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 23 21:01:26.831762 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 21:01:26.831762 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 647/1283] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 23 21:01:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 21:01:26.837108 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bd8c5f-6fbf-4232-aa59-90c5ada86458 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:01:26.938449 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bd8c5f-6fbf-4232-aa59-90c5ada86458 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:01:26.976806 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1220de-70b6-485a-872d-7178889f8dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:01:26.977486 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1220de-70b6-485a-872d-7178889f8dd6 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:01:26.977761 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1220de-70b6-485a-872d-7178889f8dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:01:26.978062 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1220de-70b6-485a-872d-7178889f8dd6 None admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:01:26.978809 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1220de-70b6-485a-872d-7178889f8dd6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:01:26.979110 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1220de-70b6-485a-872d-7178889f8dd6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:01:26.980507 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1220de-70b6-485a-872d-7178889f8dd6 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:01:26.992966 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 637/1284] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Jul 23 21:01:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:01:26.999034 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263e2785-fcd7-459c-abf1-780ef0c7c5e3 None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:01:27.099730 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263e2785-fcd7-459c-abf1-780ef0c7c5e3 None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:01:27.114104 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:01:27.137233 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc4abff-dd31-4882-8f9c-035e1a57b6ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:01:27.138081 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc4abff-dd31-4882-8f9c-035e1a57b6ff None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:01:27.138359 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc4abff-dd31-4882-8f9c-035e1a57b6ff None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:01:27.138631 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc4abff-dd31-4882-8f9c-035e1a57b6ff None admin] PATH_INFO: `/v3/projects/service` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:01:27.145989 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc4abff-dd31-4882-8f9c-035e1a57b6ff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:01:27.147432 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc4abff-dd31-4882-8f9c-035e1a57b6ff None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:01:27.161973 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-fdc4abff-dd31-4882-8f9c-035e1a57b6ff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 23 21:01:27.161973 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 21:01:27.161973 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 21:01:27.161973 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 21:01:27.161973 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 21:01:27.161973 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 21:01:27.161973 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 21:01:27.161973 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 21:01:27.161973 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 21:01:27.161973 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 21:01:27.161973 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 21:01:27.161973 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 21:01:27.161973 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 23 21:01:27.161973 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 23 21:01:27.161973 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 23 21:01:27.162980 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 23 21:01:27.162980 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 21:01:27.162980 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 21:01:27.162980 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 21:01:27.162980 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 21:01:27.162980 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 21:01:27.162980 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 21:01:27.162980 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 21:01:27.162980 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application with Lock( Jul 23 21:01:27.162980 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 21:01:27.162980 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._enter() Jul 23 21:01:27.162980 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 21:01:27.162980 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 21:01:27.162980 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 21:01:27.162980 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.creator() Jul 23 21:01:27.162980 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 21:01:27.162980 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application created_value = creator( Jul 23 21:01:27.163918 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 23 21:01:27.163918 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 23 21:01:27.163918 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 23 21:01:27.163918 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 23 21:01:27.163918 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 23 21:01:27.163918 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 23 21:01:27.163918 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 23 21:01:27.163918 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 21:01:27.163918 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 648/1285] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Jul 23 21:01:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 21:01:27.169440 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1220de-70b6-485a-872d-7178889f8dd6 None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:01:27.221928 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:01:27.281089 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1220de-70b6-485a-872d-7178889f8dd6 None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:01:27.319514 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81c053a-4c4e-4536-94d0-69f63cf73782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:01:27.320264 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81c053a-4c4e-4536-94d0-69f63cf73782 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:01:27.320518 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81c053a-4c4e-4536-94d0-69f63cf73782 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:01:27.320727 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81c053a-4c4e-4536-94d0-69f63cf73782 None admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:01:27.321517 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81c053a-4c4e-4536-94d0-69f63cf73782 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:01:27.321823 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81c053a-4c4e-4536-94d0-69f63cf73782 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:01:27.323308 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81c053a-4c4e-4536-94d0-69f63cf73782 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:01:27.337099 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 638/1286] 10.222.0.17 () {56 vars in 1148 bytes} [Sat Jul 23 21:01:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:01:27.344042 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc4abff-dd31-4882-8f9c-035e1a57b6ff None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:01:27.473468 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc4abff-dd31-4882-8f9c-035e1a57b6ff None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:01:27.527370 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e1201a-5536-4a2a-99ac-2d162bff6878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:01:27.528057 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e1201a-5536-4a2a-99ac-2d162bff6878 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:01:27.528333 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e1201a-5536-4a2a-99ac-2d162bff6878 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:01:27.528608 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e1201a-5536-4a2a-99ac-2d162bff6878 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:01:27.529428 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e1201a-5536-4a2a-99ac-2d162bff6878 None admin] RBAC: Adding query filter params (role.id=fec17bfdc65349a2b9c06a89131191df, scope.project.id=4804ed61295f4d4a92d9b685dd9e9f3b, user.id=abc719a3b3ac4461b82ca04ab6451d81) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:01:27.529758 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e1201a-5536-4a2a-99ac-2d162bff6878 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:01:27.531252 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e1201a-5536-4a2a-99ac-2d162bff6878 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:01:27.538345 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 649/1287] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Jul 23 21:01:27 2022] GET /identity/v3/role_assignments?user.id=abc719a3b3ac4461b82ca04ab6451d81&scope.project.id=4804ed61295f4d4a92d9b685dd9e9f3b&role.id=fec17bfdc65349a2b9c06a89131191df => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:01:29.907554 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e019e276-377f-4708-b72c-d97ebb0062d9 None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:01:29.908186 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e019e276-377f-4708-b72c-d97ebb0062d9 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:01:29.908186 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e019e276-377f-4708-b72c-d97ebb0062d9 None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:01:29.909478 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 639/1288] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 21:01:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:01:29.915142 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eda3b8-1cea-4991-ae82-839a59de14e3 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:01:29.915575 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eda3b8-1cea-4991-ae82-839a59de14e3 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:01:29.915701 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eda3b8-1cea-4991-ae82-839a59de14e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:01:29.938484 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-a5eda3b8-1cea-4991-ae82-839a59de14e3 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:01:29.939686 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-a5eda3b8-1cea-4991-ae82-839a59de14e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:01:29.984491 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:01:30.027610 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 650/1289] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 21:01:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 23 21:01:30.052474 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e019e276-377f-4708-b72c-d97ebb0062d9 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:01:30.178553 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e019e276-377f-4708-b72c-d97ebb0062d9 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:01:30.189660 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:01:30.213457 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e3baa6-6b4e-47bd-b8a8-59f05ae4bd2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:01:30.214376 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e3baa6-6b4e-47bd-b8a8-59f05ae4bd2f None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:01:30.214652 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e3baa6-6b4e-47bd-b8a8-59f05ae4bd2f None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:01:30.214893 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e3baa6-6b4e-47bd-b8a8-59f05ae4bd2f None admin] PATH_INFO: `/v3/services/placement` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:01:30.215567 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e3baa6-6b4e-47bd-b8a8-59f05ae4bd2f None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:01:30.216965 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e3baa6-6b4e-47bd-b8a8-59f05ae4bd2f None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:01:30.229242 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-a0e3baa6-6b4e-47bd-b8a8-59f05ae4bd2f None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 23 21:01:30.229242 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 21:01:30.229242 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 23 21:01:30.229242 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 23 21:01:30.229242 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 23 21:01:30.229242 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 23 21:01:30.229242 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 23 21:01:30.229242 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 23 21:01:30.229242 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 23 21:01:30.229242 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 21:01:30.229242 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 23 21:01:30.229242 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 21:01:30.229242 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 21:01:30.229242 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 21:01:30.229242 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 21:01:30.229242 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 21:01:30.229242 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 21:01:30.230504 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 21:01:30.230504 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 21:01:30.230504 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 21:01:30.230504 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 21:01:30.230504 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 21:01:30.230504 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 21:01:30.230504 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 23 21:01:30.230504 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 23 21:01:30.230504 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 23 21:01:30.230504 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 23 21:01:30.230504 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 21:01:30.230504 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 21:01:30.230504 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 21:01:30.230504 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 21:01:30.230504 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 21:01:30.230504 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 21:01:30.231904 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 21:01:30.231904 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application with Lock( Jul 23 21:01:30.231904 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 21:01:30.231904 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._enter() Jul 23 21:01:30.231904 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 21:01:30.231904 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 21:01:30.231904 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 21:01:30.231904 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.creator() Jul 23 21:01:30.231904 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 21:01:30.231904 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application created_value = creator( Jul 23 21:01:30.231904 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 23 21:01:30.231904 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 23 21:01:30.231904 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 23 21:01:30.231904 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 21:01:30.231904 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 640/1290] 10.222.0.17 () {56 vars in 1117 bytes} [Sat Jul 23 21:01:30 2022] GET /identity/v3/services/placement => generated 90 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 21:01:30.236737 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eda3b8-1cea-4991-ae82-839a59de14e3 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:01:30.341810 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eda3b8-1cea-4991-ae82-839a59de14e3 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:01:30.378999 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd0f0cf-a5bd-499f-b531-f42d41a2cecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:01:30.379672 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd0f0cf-a5bd-499f-b531-f42d41a2cecb None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:01:30.380158 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd0f0cf-a5bd-499f-b531-f42d41a2cecb None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:01:30.380311 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd0f0cf-a5bd-499f-b531-f42d41a2cecb None admin] PATH_INFO: `/v3/services` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:01:30.381027 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd0f0cf-a5bd-499f-b531-f42d41a2cecb None admin] RBAC: Adding query filter params (name=placement) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:01:30.381328 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd0f0cf-a5bd-499f-b531-f42d41a2cecb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:01:30.382726 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd0f0cf-a5bd-499f-b531-f42d41a2cecb None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:01:30.387939 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 651/1291] 10.222.0.17 () {56 vars in 1116 bytes} [Sat Jul 23 21:01:30 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:01:30.394478 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e3baa6-6b4e-47bd-b8a8-59f05ae4bd2f None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:01:30.525137 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e3baa6-6b4e-47bd-b8a8-59f05ae4bd2f None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:01:30.570368 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daaf9a7-61de-4270-b670-72e8299ae2e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:01:30.571052 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daaf9a7-61de-4270-b670-72e8299ae2e2 None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:01:30.571327 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daaf9a7-61de-4270-b670-72e8299ae2e2 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:01:30.571600 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daaf9a7-61de-4270-b670-72e8299ae2e2 None admin] PATH_INFO: `/v3/services` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:01:30.572319 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daaf9a7-61de-4270-b670-72e8299ae2e2 None admin] RBAC: Adding query filter params (type=placement) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:01:30.572616 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daaf9a7-61de-4270-b670-72e8299ae2e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:01:30.574035 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daaf9a7-61de-4270-b670-72e8299ae2e2 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:01:30.579242 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 641/1292] 10.222.0.17 () {56 vars in 1116 bytes} [Sat Jul 23 21:01:30 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:01:32.928335 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d660004-37c1-4def-a1b9-cf5792ff957c None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:01:32.928977 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d660004-37c1-4def-a1b9-cf5792ff957c None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:01:32.928977 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d660004-37c1-4def-a1b9-cf5792ff957c None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:01:32.930268 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 652/1293] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 21:01:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:01:32.936925 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f524084-4501-47cf-80db-d999500be466 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:01:32.937694 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f524084-4501-47cf-80db-d999500be466 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:01:32.937694 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f524084-4501-47cf-80db-d999500be466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:01:32.959219 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-1f524084-4501-47cf-80db-d999500be466 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:01:32.960446 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-1f524084-4501-47cf-80db-d999500be466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:01:32.993677 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:01:33.035343 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 642/1294] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 21:01:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 23 21:01:33.060120 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d660004-37c1-4def-a1b9-cf5792ff957c None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:01:33.095787 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:01:33.176721 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d660004-37c1-4def-a1b9-cf5792ff957c None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:01:33.217563 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6203d356-a461-4957-9ab8-850d2cfb064a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:01:33.218409 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6203d356-a461-4957-9ab8-850d2cfb064a None admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:01:33.218776 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6203d356-a461-4957-9ab8-850d2cfb064a None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:01:33.219147 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6203d356-a461-4957-9ab8-850d2cfb064a None admin] PATH_INFO: `/v3/services` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:01:33.220082 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6203d356-a461-4957-9ab8-850d2cfb064a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:01:33.221606 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6203d356-a461-4957-9ab8-850d2cfb064a None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:01:33.239356 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 653/1295] 10.222.0.17 () {60 vars in 1141 bytes} [Sat Jul 23 21:01:33 2022] POST /identity/v3/services => generated 246 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:01:35.656246 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72edb9d-633b-44a3-b582-16299a15a67d None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:01:35.656883 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72edb9d-633b-44a3-b582-16299a15a67d None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:01:35.656883 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72edb9d-633b-44a3-b582-16299a15a67d None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:01:35.658478 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 643/1296] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 21:01:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:01:35.665188 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcefdff-9165-48e6-b027-98a32f10af6b None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:01:35.665819 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcefdff-9165-48e6-b027-98a32f10af6b None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:01:35.665819 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcefdff-9165-48e6-b027-98a32f10af6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:01:35.684789 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-8fcefdff-9165-48e6-b027-98a32f10af6b None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:01:35.686035 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-8fcefdff-9165-48e6-b027-98a32f10af6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:01:35.777601 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 654/1297] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 21:01:35 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 23 21:01:35.804251 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72edb9d-633b-44a3-b582-16299a15a67d None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:01:35.933695 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72edb9d-633b-44a3-b582-16299a15a67d None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:01:35.973752 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff18eb1f-84b9-4c72-a0fd-8139da28006d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:01:35.974622 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff18eb1f-84b9-4c72-a0fd-8139da28006d None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:01:35.974900 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff18eb1f-84b9-4c72-a0fd-8139da28006d None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:01:35.975166 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff18eb1f-84b9-4c72-a0fd-8139da28006d None admin] PATH_INFO: `/v3/services/placement` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:01:35.975835 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff18eb1f-84b9-4c72-a0fd-8139da28006d None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:01:35.977257 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff18eb1f-84b9-4c72-a0fd-8139da28006d None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:01:35.990673 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-ff18eb1f-84b9-4c72-a0fd-8139da28006d None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 23 21:01:35.990673 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 21:01:35.990673 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 23 21:01:35.990673 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 23 21:01:35.990673 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 23 21:01:35.990673 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 23 21:01:35.990673 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 23 21:01:35.990673 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 23 21:01:35.990673 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 23 21:01:35.990673 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 21:01:35.990673 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 23 21:01:35.990673 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 21:01:35.990673 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 21:01:35.990673 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 21:01:35.990673 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 21:01:35.990673 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 21:01:35.990673 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 21:01:35.992711 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 21:01:35.992711 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 21:01:35.992711 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 21:01:35.992711 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 21:01:35.992711 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 21:01:35.992711 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 21:01:35.992711 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 23 21:01:35.992711 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 23 21:01:35.992711 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 23 21:01:35.992711 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 23 21:01:35.992711 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 21:01:35.992711 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 21:01:35.992711 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 21:01:35.992711 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 21:01:35.992711 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 21:01:35.992711 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 21:01:35.994021 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 21:01:35.994021 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application with Lock( Jul 23 21:01:35.994021 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 21:01:35.994021 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._enter() Jul 23 21:01:35.994021 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 21:01:35.994021 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 21:01:35.994021 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 21:01:35.994021 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.creator() Jul 23 21:01:35.994021 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 21:01:35.994021 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application created_value = creator( Jul 23 21:01:35.994021 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 23 21:01:35.994021 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 23 21:01:35.994021 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 23 21:01:35.994021 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 21:01:35.994021 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 644/1298] 10.222.0.17 () {56 vars in 1117 bytes} [Sat Jul 23 21:01:35 2022] GET /identity/v3/services/placement => generated 90 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 23 21:01:35.999106 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcefdff-9165-48e6-b027-98a32f10af6b None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:01:36.020926 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:01:36.122294 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcefdff-9165-48e6-b027-98a32f10af6b None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:01:36.163695 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4810f105-0d65-4664-a0eb-3a4897b30d1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:01:36.164377 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4810f105-0d65-4664-a0eb-3a4897b30d1f None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:01:36.164653 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4810f105-0d65-4664-a0eb-3a4897b30d1f None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:01:36.164908 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4810f105-0d65-4664-a0eb-3a4897b30d1f None admin] PATH_INFO: `/v3/services` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:01:36.165620 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4810f105-0d65-4664-a0eb-3a4897b30d1f None admin] RBAC: Adding query filter params (name=placement) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:01:36.165949 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4810f105-0d65-4664-a0eb-3a4897b30d1f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:01:36.167361 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4810f105-0d65-4664-a0eb-3a4897b30d1f None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:01:36.173608 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 655/1299] 10.222.0.17 () {56 vars in 1116 bytes} [Sat Jul 23 21:01:35 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:01:36.181142 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff18eb1f-84b9-4c72-a0fd-8139da28006d None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:01:36.219119 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:01:36.299881 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff18eb1f-84b9-4c72-a0fd-8139da28006d None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:01:36.338064 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d780198-27e3-444a-943e-3814a057473d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:01:36.338764 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d780198-27e3-444a-943e-3814a057473d None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:01:36.339042 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d780198-27e3-444a-943e-3814a057473d None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:01:36.339314 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d780198-27e3-444a-943e-3814a057473d None admin] PATH_INFO: `/v3/endpoints` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:01:36.340140 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d780198-27e3-444a-943e-3814a057473d None admin] RBAC: Adding query filter params (interface=public, service_id=a6d1384d9f7c4eb09d8445785bc110e4, region_id=RegionOne) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:01:36.340450 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d780198-27e3-444a-943e-3814a057473d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:01:36.341955 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d780198-27e3-444a-943e-3814a057473d None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:01:36.348154 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 645/1300] 10.222.0.17 () {56 vars in 1251 bytes} [Sat Jul 23 21:01:36 2022] GET /identity/v3/endpoints?service_id=a6d1384d9f7c4eb09d8445785bc110e4&interface=public®ion_id=RegionOne => generated 194 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:01:36.357240 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4810f105-0d65-4664-a0eb-3a4897b30d1f None admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:01:36.465080 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:01:36.490405 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4810f105-0d65-4664-a0eb-3a4897b30d1f None admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:01:36.533798 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af95e28-ee9c-4486-88f3-0d88ab541d09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:01:36.534542 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af95e28-ee9c-4486-88f3-0d88ab541d09 None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:01:36.534826 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af95e28-ee9c-4486-88f3-0d88ab541d09 None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:01:36.535097 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af95e28-ee9c-4486-88f3-0d88ab541d09 None admin] PATH_INFO: `/v3/services` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:01:36.535816 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af95e28-ee9c-4486-88f3-0d88ab541d09 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:01:36.537441 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af95e28-ee9c-4486-88f3-0d88ab541d09 None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:01:36.545544 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 656/1301] 10.222.0.17 () {56 vars in 1087 bytes} [Sat Jul 23 21:01:36 2022] GET /identity/v3/services => generated 2191 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 21:01:38.953963 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ffb37b-62d5-4c04-9671-fc8c1261e97b None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:01:38.954671 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ffb37b-62d5-4c04-9671-fc8c1261e97b None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:01:38.954671 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ffb37b-62d5-4c04-9671-fc8c1261e97b None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:01:38.955916 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 646/1302] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 21:01:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 23 21:01:38.961815 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0762df-812e-4d50-b74e-0e93a9aaa5f8 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:01:38.962395 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0762df-812e-4d50-b74e-0e93a9aaa5f8 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:01:38.962395 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0762df-812e-4d50-b74e-0e93a9aaa5f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:01:38.981595 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-4e0762df-812e-4d50-b74e-0e93a9aaa5f8 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:01:38.982900 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-4e0762df-812e-4d50-b74e-0e93a9aaa5f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:01:39.065188 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 657/1303] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 21:01:38 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 23 21:01:39.091348 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ffb37b-62d5-4c04-9671-fc8c1261e97b None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:01:39.211419 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:01:39.220256 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ffb37b-62d5-4c04-9671-fc8c1261e97b None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:01:39.259372 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d4d38b-33e7-41c4-82c6-045c4767266e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:01:39.260209 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d4d38b-33e7-41c4-82c6-045c4767266e None admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:01:39.260487 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d4d38b-33e7-41c4-82c6-045c4767266e None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:01:39.260758 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d4d38b-33e7-41c4-82c6-045c4767266e None admin] PATH_INFO: `/v3/services/placement` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:01:39.261483 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d4d38b-33e7-41c4-82c6-045c4767266e None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:01:39.262961 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d4d38b-33e7-41c4-82c6-045c4767266e None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:01:39.276568 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-43d4d38b-33e7-41c4-82c6-045c4767266e None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 23 21:01:39.276568 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 21:01:39.276568 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 23 21:01:39.276568 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 23 21:01:39.276568 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 23 21:01:39.276568 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 23 21:01:39.276568 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 23 21:01:39.276568 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 23 21:01:39.276568 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 23 21:01:39.276568 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 21:01:39.276568 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 23 21:01:39.276568 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 21:01:39.276568 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 21:01:39.276568 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 21:01:39.276568 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 21:01:39.276568 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 21:01:39.276568 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 21:01:39.278463 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 21:01:39.278463 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 21:01:39.278463 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 21:01:39.278463 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 21:01:39.278463 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 21:01:39.278463 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 21:01:39.278463 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 23 21:01:39.278463 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 23 21:01:39.278463 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 23 21:01:39.278463 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 23 21:01:39.278463 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 21:01:39.278463 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 21:01:39.278463 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 21:01:39.278463 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 21:01:39.278463 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 21:01:39.278463 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 21:01:39.279524 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 21:01:39.279524 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application with Lock( Jul 23 21:01:39.279524 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 21:01:39.279524 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._enter() Jul 23 21:01:39.279524 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 21:01:39.279524 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 21:01:39.279524 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 21:01:39.279524 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.creator() Jul 23 21:01:39.279524 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 21:01:39.279524 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application created_value = creator( Jul 23 21:01:39.279524 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 23 21:01:39.279524 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 23 21:01:39.279524 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 23 21:01:39.279524 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 21:01:39.279524 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 647/1304] 10.222.0.17 () {56 vars in 1117 bytes} [Sat Jul 23 21:01:39 2022] GET /identity/v3/services/placement => generated 90 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 21:01:39.288234 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0762df-812e-4d50-b74e-0e93a9aaa5f8 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:01:39.415519 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:01:39.444793 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0762df-812e-4d50-b74e-0e93a9aaa5f8 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:01:39.485042 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49476909-f11c-455b-8ab6-75200d94b9cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:01:39.486026 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49476909-f11c-455b-8ab6-75200d94b9cd None admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:01:39.486334 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49476909-f11c-455b-8ab6-75200d94b9cd None admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:01:39.486607 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49476909-f11c-455b-8ab6-75200d94b9cd None admin] PATH_INFO: `/v3/services` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:01:39.487345 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49476909-f11c-455b-8ab6-75200d94b9cd None admin] RBAC: Adding query filter params (name=placement) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:01:39.487660 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49476909-f11c-455b-8ab6-75200d94b9cd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:01:39.489072 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49476909-f11c-455b-8ab6-75200d94b9cd None admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:01:39.495995 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 658/1305] 10.222.0.17 () {56 vars in 1116 bytes} [Sat Jul 23 21:01:39 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:01:39.502930 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d4d38b-33e7-41c4-82c6-045c4767266e None admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:01:39.622370 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d4d38b-33e7-41c4-82c6-045c4767266e None admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:01:39.663482 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cd3b2a-3707-4438-a9bb-5ae0a1667396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:01:39.664166 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cd3b2a-3707-4438-a9bb-5ae0a1667396 None admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:01:39.664446 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cd3b2a-3707-4438-a9bb-5ae0a1667396 None admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:01:39.664721 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cd3b2a-3707-4438-a9bb-5ae0a1667396 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:01:39.665501 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cd3b2a-3707-4438-a9bb-5ae0a1667396 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:01:39.667066 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cd3b2a-3707-4438-a9bb-5ae0a1667396 None admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:01:39.691063 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 648/1306] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Jul 23 21:01:39 2022] POST /identity/v3/endpoints => generated 331 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:01:49.492204 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=30 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:01:49.686022 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:02:56.253970 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730a2c3f-314a-455a-a758-5303e72f5ff5 None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:02:56.255318 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730a2c3f-314a-455a-a758-5303e72f5ff5 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:02:56.256229 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730a2c3f-314a-455a-a758-5303e72f5ff5 None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:02:56.260534 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 659/1307] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 21:02:56 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:02:56.266252 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e96ae3-64a6-40df-ba67-18f8c99c1af5 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:02:56.266980 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e96ae3-64a6-40df-ba67-18f8c99c1af5 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:02:56.266980 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e96ae3-64a6-40df-ba67-18f8c99c1af5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:02:56.394271 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-c3e96ae3-64a6-40df-ba67-18f8c99c1af5 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:02:56.395696 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-c3e96ae3-64a6-40df-ba67-18f8c99c1af5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:02:56.545426 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 649/1308] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 21:02:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:02:56.597617 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9b1687-7cf9-4b44-8496-038cb8b009a5 None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:02:56.598181 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9b1687-7cf9-4b44-8496-038cb8b009a5 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:02:56.598493 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9b1687-7cf9-4b44-8496-038cb8b009a5 None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:02:56.599991 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 660/1309] 10.222.0.17 () {54 vars in 965 bytes} [Sat Jul 23 21:02:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:02:56.607247 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48af16e-8c2c-43a8-8254-bb7742a1af9f None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:02:56.607559 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48af16e-8c2c-43a8-8254-bb7742a1af9f None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:02:56.607834 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48af16e-8c2c-43a8-8254-bb7742a1af9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:02:56.720764 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-b48af16e-8c2c-43a8-8254-bb7742a1af9f None None] MFA Rules not processed for user `c497326ee890462e8f48b4a56f81990c`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:02:56.722074 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-b48af16e-8c2c-43a8-8254-bb7742a1af9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:02:56.748987 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:02:56.828313 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 650/1310] 10.222.0.17 () {58 vars in 1062 bytes} [Sat Jul 23 21:02:56 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:02:56.838185 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9b1687-7cf9-4b44-8496-038cb8b009a5 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:02:56.839973 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-bf9b1687-7cf9-4b44-8496-038cb8b009a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:02:56.978887 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9b1687-7cf9-4b44-8496-038cb8b009a5 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:02:57.074419 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0c842c-e9fb-4551-b554-d0f39d568de7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:02:57.075665 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0c842c-e9fb-4551-b554-d0f39d568de7 service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:02:57.076134 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0c842c-e9fb-4551-b554-d0f39d568de7 service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:02:57.076590 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0c842c-e9fb-4551-b554-d0f39d568de7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:02:57.078782 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-1a0c842c-e9fb-4551-b554-d0f39d568de7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:02:57.145426 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:02:57.206967 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0c842c-e9fb-4551-b554-d0f39d568de7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:02:57.209526 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0c842c-e9fb-4551-b554-d0f39d568de7 service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:02:57.230927 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 661/1311] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:02:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:02:59.875040 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d700e5aa-8722-4f53-925c-31495ccd93f7 None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:02:59.875614 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d700e5aa-8722-4f53-925c-31495ccd93f7 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:02:59.875948 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d700e5aa-8722-4f53-925c-31495ccd93f7 None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:02:59.877657 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 651/1312] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 21:02:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:02:59.883112 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f8c86a-4e75-45b3-b23b-05f143408f81 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:02:59.883556 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f8c86a-4e75-45b3-b23b-05f143408f81 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:02:59.883556 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f8c86a-4e75-45b3-b23b-05f143408f81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:02:59.968174 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-17f8c86a-4e75-45b3-b23b-05f143408f81 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:02:59.969419 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-17f8c86a-4e75-45b3-b23b-05f143408f81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:03:00.071284 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 662/1313] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 21:02:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:03:00.109888 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d700e5aa-8722-4f53-925c-31495ccd93f7 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:03:00.111475 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-d700e5aa-8722-4f53-925c-31495ccd93f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:03:00.220691 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d700e5aa-8722-4f53-925c-31495ccd93f7 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:03:00.303901 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:03:00.306714 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc29e48-ad1c-4d0e-9224-a334d185ef58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:03:00.307383 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc29e48-ad1c-4d0e-9224-a334d185ef58 service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:03:00.307864 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc29e48-ad1c-4d0e-9224-a334d185ef58 service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:03:00.308333 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc29e48-ad1c-4d0e-9224-a334d185ef58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:03:00.310314 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-1fc29e48-ad1c-4d0e-9224-a334d185ef58 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:03:00.425263 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc29e48-ad1c-4d0e-9224-a334d185ef58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:03:00.431193 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc29e48-ad1c-4d0e-9224-a334d185ef58 service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:03:00.446788 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 652/1314] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:03:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:03:03.030686 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e665bf51-870c-4050-bce7-1e18f29aea00 None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:03:03.031277 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e665bf51-870c-4050-bce7-1e18f29aea00 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:03:03.031277 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e665bf51-870c-4050-bce7-1e18f29aea00 None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:03:03.032626 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 663/1315] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 21:03:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:03:03.039223 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bb987d-2154-48f0-9c52-b05d399b838f None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:03:03.039724 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bb987d-2154-48f0-9c52-b05d399b838f None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:03:03.039832 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bb987d-2154-48f0-9c52-b05d399b838f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:03:03.119238 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-a0bb987d-2154-48f0-9c52-b05d399b838f None None] MFA Rules not processed for user `35d61800281b469cb2d8e0546f4eacbd`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:03:03.120372 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-a0bb987d-2154-48f0-9c52-b05d399b838f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:03:03.181890 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:03:03.231805 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 653/1316] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 21:03:03 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:03:03.275169 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e665bf51-870c-4050-bce7-1e18f29aea00 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:03:03.276749 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-e665bf51-870c-4050-bce7-1e18f29aea00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:03:03.286807 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:03:03.398568 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e665bf51-870c-4050-bce7-1e18f29aea00 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:03:03.480970 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36971411-0f53-4a7b-b3de-e27b2e9047ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:03:03.481630 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36971411-0f53-4a7b-b3de-e27b2e9047ad service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:03:03.481896 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36971411-0f53-4a7b-b3de-e27b2e9047ad service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:03:03.482200 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36971411-0f53-4a7b-b3de-e27b2e9047ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:03:03.483882 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-36971411-0f53-4a7b-b3de-e27b2e9047ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:03:03.549173 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:03:03.603233 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36971411-0f53-4a7b-b3de-e27b2e9047ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:03:03.604675 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36971411-0f53-4a7b-b3de-e27b2e9047ad service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:03:03.622818 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 664/1317] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:03:03 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:03:06.499450 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1756e14-6bec-4f56-9a52-22b331bd89c2 None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:03:06.500013 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1756e14-6bec-4f56-9a52-22b331bd89c2 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:03:06.500013 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1756e14-6bec-4f56-9a52-22b331bd89c2 None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:03:06.501299 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 654/1318] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 21:03:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:03:06.507660 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dce833-df7e-4da5-9137-9b4d823ecb6b None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:03:06.508101 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dce833-df7e-4da5-9137-9b4d823ecb6b None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:03:06.508192 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dce833-df7e-4da5-9137-9b4d823ecb6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:03:06.582705 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-90dce833-df7e-4da5-9137-9b4d823ecb6b None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:03:06.583957 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-90dce833-df7e-4da5-9137-9b4d823ecb6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:03:06.688391 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 665/1319] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 21:03:06 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:03:06.748876 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42649e52-e6c7-43d0-8bba-06d25f579b1a None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:03:06.749140 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42649e52-e6c7-43d0-8bba-06d25f579b1a None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:03:06.749410 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42649e52-e6c7-43d0-8bba-06d25f579b1a None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:03:06.750945 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 655/1320] 10.222.0.17 () {54 vars in 965 bytes} [Sat Jul 23 21:03:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:03:06.757513 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e823d7f6-ca65-439d-a0a9-572f96e1b19c None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:03:06.757794 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e823d7f6-ca65-439d-a0a9-572f96e1b19c None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:03:06.758081 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e823d7f6-ca65-439d-a0a9-572f96e1b19c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:03:06.781166 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:03:06.845836 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-e823d7f6-ca65-439d-a0a9-572f96e1b19c None None] MFA Rules not processed for user `c497326ee890462e8f48b4a56f81990c`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:03:06.847089 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-e823d7f6-ca65-439d-a0a9-572f96e1b19c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:03:06.932699 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 666/1321] 10.222.0.17 () {58 vars in 1062 bytes} [Sat Jul 23 21:03:06 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:03:06.943680 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42649e52-e6c7-43d0-8bba-06d25f579b1a None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:03:06.945214 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-42649e52-e6c7-43d0-8bba-06d25f579b1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:03:07.056326 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42649e52-e6c7-43d0-8bba-06d25f579b1a None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:03:07.134912 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71f2d45-d756-41bf-b51b-7c7c29999678 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:03:07.135575 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71f2d45-d756-41bf-b51b-7c7c29999678 service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:03:07.135860 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71f2d45-d756-41bf-b51b-7c7c29999678 service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:03:07.136137 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71f2d45-d756-41bf-b51b-7c7c29999678 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:03:07.137810 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-d71f2d45-d756-41bf-b51b-7c7c29999678 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:03:07.146380 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:03:07.264815 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71f2d45-d756-41bf-b51b-7c7c29999678 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:03:07.266558 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71f2d45-d756-41bf-b51b-7c7c29999678 service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:03:07.287808 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 656/1322] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:03:06 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:03:10.738927 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ccbaa1-147c-4960-8c03-3c7d88f2ad7e None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:03:10.739555 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ccbaa1-147c-4960-8c03-3c7d88f2ad7e None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:03:10.739555 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ccbaa1-147c-4960-8c03-3c7d88f2ad7e None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:03:10.740870 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 667/1323] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 21:03:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:03:10.746861 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb78a33a-0585-4f51-a971-cfa9e9e96c99 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:03:10.747549 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb78a33a-0585-4f51-a971-cfa9e9e96c99 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:03:10.747549 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb78a33a-0585-4f51-a971-cfa9e9e96c99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:03:10.821366 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-fb78a33a-0585-4f51-a971-cfa9e9e96c99 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:03:10.822837 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-fb78a33a-0585-4f51-a971-cfa9e9e96c99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:03:10.889775 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:03:10.936523 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 657/1324] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 21:03:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:03:10.975193 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ccbaa1-147c-4960-8c03-3c7d88f2ad7e None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:03:10.976797 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-c8ccbaa1-147c-4960-8c03-3c7d88f2ad7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:03:11.099451 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ccbaa1-147c-4960-8c03-3c7d88f2ad7e None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:03:11.114416 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:03:11.180664 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6be9bdb-18ab-44b0-9b02-c5775bdc39db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:03:11.181316 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6be9bdb-18ab-44b0-9b02-c5775bdc39db service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:03:11.181595 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6be9bdb-18ab-44b0-9b02-c5775bdc39db service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:03:11.181889 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6be9bdb-18ab-44b0-9b02-c5775bdc39db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:03:11.183525 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-c6be9bdb-18ab-44b0-9b02-c5775bdc39db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:03:11.303975 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6be9bdb-18ab-44b0-9b02-c5775bdc39db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:03:11.305439 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6be9bdb-18ab-44b0-9b02-c5775bdc39db service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:03:11.325374 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 668/1325] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:03:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:03:13.714191 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b8b40c-840d-4ada-b3d6-fe2082c1ec03 None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:03:13.714774 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b8b40c-840d-4ada-b3d6-fe2082c1ec03 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:03:13.714774 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b8b40c-840d-4ada-b3d6-fe2082c1ec03 None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:03:13.716112 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 658/1326] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 21:03:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:03:13.721718 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ca605f-d9dd-4bbb-806b-6f992782d58e None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:03:13.722265 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ca605f-d9dd-4bbb-806b-6f992782d58e None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:03:13.722345 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ca605f-d9dd-4bbb-806b-6f992782d58e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:03:13.771287 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:03:13.791823 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-b4ca605f-d9dd-4bbb-806b-6f992782d58e None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:03:13.793055 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-b4ca605f-d9dd-4bbb-806b-6f992782d58e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:03:13.898466 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 669/1327] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 21:03:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:03:13.936608 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b8b40c-840d-4ada-b3d6-fe2082c1ec03 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:03:13.938169 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-03b8b40c-840d-4ada-b3d6-fe2082c1ec03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:03:14.043219 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b8b40c-840d-4ada-b3d6-fe2082c1ec03 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:03:14.120736 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c74f77-240d-4302-951c-d0869276831a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:03:14.121388 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c74f77-240d-4302-951c-d0869276831a service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:03:14.121641 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c74f77-240d-4302-951c-d0869276831a service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:03:14.121957 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c74f77-240d-4302-951c-d0869276831a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:03:14.123568 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-e6c74f77-240d-4302-951c-d0869276831a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:03:14.140502 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:03:14.241723 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c74f77-240d-4302-951c-d0869276831a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:03:14.243199 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c74f77-240d-4302-951c-d0869276831a service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:03:14.261895 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 659/1328] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:03:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:03:16.619336 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248d48c9-0e46-4a14-aaab-cc6c8bf8d6db None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:03:16.619980 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248d48c9-0e46-4a14-aaab-cc6c8bf8d6db None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:03:16.619980 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248d48c9-0e46-4a14-aaab-cc6c8bf8d6db None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:03:16.621256 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 670/1329] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 21:03:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:03:16.626758 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080ee13e-e2d1-4565-ac88-8e36a2dbe92b None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:03:16.627217 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080ee13e-e2d1-4565-ac88-8e36a2dbe92b None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:03:16.627308 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080ee13e-e2d1-4565-ac88-8e36a2dbe92b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:03:16.698479 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-080ee13e-e2d1-4565-ac88-8e36a2dbe92b None None] MFA Rules not processed for user `35d61800281b469cb2d8e0546f4eacbd`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:03:16.699706 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-080ee13e-e2d1-4565-ac88-8e36a2dbe92b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:03:16.774135 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:03:16.806777 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 660/1330] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 21:03:16 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:03:16.845634 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248d48c9-0e46-4a14-aaab-cc6c8bf8d6db None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:03:16.847264 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-248d48c9-0e46-4a14-aaab-cc6c8bf8d6db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:03:16.962449 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248d48c9-0e46-4a14-aaab-cc6c8bf8d6db None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:03:16.984298 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:03:17.049449 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ed79ef-f8e1-4ce8-b58f-42a8cdcb4ede service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:03:17.050271 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ed79ef-f8e1-4ce8-b58f-42a8cdcb4ede service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:03:17.050619 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ed79ef-f8e1-4ce8-b58f-42a8cdcb4ede service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:03:17.050960 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ed79ef-f8e1-4ce8-b58f-42a8cdcb4ede service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:03:17.052996 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-54ed79ef-f8e1-4ce8-b58f-42a8cdcb4ede service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:03:17.179482 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ed79ef-f8e1-4ce8-b58f-42a8cdcb4ede service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:03:17.180932 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ed79ef-f8e1-4ce8-b58f-42a8cdcb4ede service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:03:17.201316 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 671/1331] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:03:16 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:03:19.754340 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a415e3ad-a7c3-47e1-97c1-66d6b634fec5 None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:03:19.754875 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a415e3ad-a7c3-47e1-97c1-66d6b634fec5 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:03:19.754875 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a415e3ad-a7c3-47e1-97c1-66d6b634fec5 None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:03:19.756318 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 661/1332] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 21:03:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:03:19.762210 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792a54f9-904d-4fd6-a38f-7ed4e413fb46 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:03:19.762736 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792a54f9-904d-4fd6-a38f-7ed4e413fb46 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:03:19.762736 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792a54f9-904d-4fd6-a38f-7ed4e413fb46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:03:19.834000 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:03:19.837356 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-792a54f9-904d-4fd6-a38f-7ed4e413fb46 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:03:19.839165 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-792a54f9-904d-4fd6-a38f-7ed4e413fb46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:03:19.940000 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 672/1333] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 21:03:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:03:19.979256 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a415e3ad-a7c3-47e1-97c1-66d6b634fec5 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:03:19.981060 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-a415e3ad-a7c3-47e1-97c1-66d6b634fec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:03:20.103145 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a415e3ad-a7c3-47e1-97c1-66d6b634fec5 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:03:20.185819 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee03787-a5b5-45a3-8375-65d1582cd6d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:03:20.186546 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee03787-a5b5-45a3-8375-65d1582cd6d4 service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:03:20.186826 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee03787-a5b5-45a3-8375-65d1582cd6d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:03:20.187096 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee03787-a5b5-45a3-8375-65d1582cd6d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:03:20.188817 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-fee03787-a5b5-45a3-8375-65d1582cd6d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:03:20.218644 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:03:20.337338 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee03787-a5b5-45a3-8375-65d1582cd6d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:03:20.338943 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee03787-a5b5-45a3-8375-65d1582cd6d4 service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:03:20.363515 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 662/1334] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:03:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 23 21:03:22.922910 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7eabb9-6518-4cb1-8d85-e6539ce5c304 None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:03:22.923746 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7eabb9-6518-4cb1-8d85-e6539ce5c304 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:03:22.923746 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7eabb9-6518-4cb1-8d85-e6539ce5c304 None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:03:22.925460 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 673/1335] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 21:03:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:03:22.931937 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf16554b-711b-4590-a019-07fe4a431712 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:03:22.932389 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf16554b-711b-4590-a019-07fe4a431712 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:03:22.932498 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf16554b-711b-4590-a019-07fe4a431712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:03:23.003236 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-cf16554b-711b-4590-a019-07fe4a431712 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:03:23.004442 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-cf16554b-711b-4590-a019-07fe4a431712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:03:23.082895 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:03:23.107492 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 663/1336] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 21:03:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:03:23.162394 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7eabb9-6518-4cb1-8d85-e6539ce5c304 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:03:23.164779 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-eb7eabb9-6518-4cb1-8d85-e6539ce5c304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:03:23.288603 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7eabb9-6518-4cb1-8d85-e6539ce5c304 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:03:23.318198 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:03:23.371760 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5446702d-4a9d-4990-b73d-8e482a79a841 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:03:23.372323 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5446702d-4a9d-4990-b73d-8e482a79a841 service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:03:23.372600 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5446702d-4a9d-4990-b73d-8e482a79a841 service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:03:23.372868 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5446702d-4a9d-4990-b73d-8e482a79a841 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:03:23.374549 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-5446702d-4a9d-4990-b73d-8e482a79a841 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:03:23.487800 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5446702d-4a9d-4990-b73d-8e482a79a841 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:03:23.489238 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5446702d-4a9d-4990-b73d-8e482a79a841 service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:03:23.508377 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 674/1337] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:03:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:03:26.141109 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cc701d-e30b-42bc-921c-612c53f21530 None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:03:26.142005 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cc701d-e30b-42bc-921c-612c53f21530 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:03:26.142005 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cc701d-e30b-42bc-921c-612c53f21530 None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:03:26.143400 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 664/1338] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 21:03:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:03:26.149667 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8715e587-6ed1-4a8b-b966-db54ad439277 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:03:26.150168 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8715e587-6ed1-4a8b-b966-db54ad439277 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:03:26.150262 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8715e587-6ed1-4a8b-b966-db54ad439277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:03:26.225844 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-8715e587-6ed1-4a8b-b966-db54ad439277 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:03:26.227793 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-8715e587-6ed1-4a8b-b966-db54ad439277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:03:26.238947 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:03:26.340629 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 675/1339] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 21:03:26 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:03:26.386701 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cc701d-e30b-42bc-921c-612c53f21530 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:03:26.388243 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-94cc701d-e30b-42bc-921c-612c53f21530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:03:26.526153 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cc701d-e30b-42bc-921c-612c53f21530 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:03:26.606979 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e035ea77-be78-4f64-a9b5-ffd7c4819927 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:03:26.607631 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e035ea77-be78-4f64-a9b5-ffd7c4819927 service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:03:26.607906 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e035ea77-be78-4f64-a9b5-ffd7c4819927 service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:03:26.608169 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e035ea77-be78-4f64-a9b5-ffd7c4819927 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:03:26.609799 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-e035ea77-be78-4f64-a9b5-ffd7c4819927 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:03:26.659058 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:03:26.745540 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e035ea77-be78-4f64-a9b5-ffd7c4819927 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:03:26.747044 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e035ea77-be78-4f64-a9b5-ffd7c4819927 service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:03:26.767950 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 665/1340] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:03:26 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:03:31.072628 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0269417b-df7d-4a87-93b5-145fda99a201 None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:03:31.073225 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0269417b-df7d-4a87-93b5-145fda99a201 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:03:31.073225 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0269417b-df7d-4a87-93b5-145fda99a201 None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:03:31.074509 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 676/1341] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 21:03:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:03:31.080333 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f72d73e-c99a-45ed-adcd-f527bd8c2884 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:03:31.080856 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f72d73e-c99a-45ed-adcd-f527bd8c2884 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:03:31.080979 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f72d73e-c99a-45ed-adcd-f527bd8c2884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:03:31.152522 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-7f72d73e-c99a-45ed-adcd-f527bd8c2884 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:03:31.153732 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-7f72d73e-c99a-45ed-adcd-f527bd8c2884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:03:31.245372 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:03:31.257683 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 666/1342] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 21:03:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:03:31.301559 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0269417b-df7d-4a87-93b5-145fda99a201 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:03:31.303148 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-0269417b-df7d-4a87-93b5-145fda99a201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:03:31.436087 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0269417b-df7d-4a87-93b5-145fda99a201 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:03:31.478713 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:03:31.530556 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e0e28d-ed68-4cdb-9cc1-7177f02fecb6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:03:31.531211 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e0e28d-ed68-4cdb-9cc1-7177f02fecb6 service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:03:31.531518 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e0e28d-ed68-4cdb-9cc1-7177f02fecb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:03:31.531782 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e0e28d-ed68-4cdb-9cc1-7177f02fecb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:03:31.533489 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-86e0e28d-ed68-4cdb-9cc1-7177f02fecb6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:03:31.672847 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e0e28d-ed68-4cdb-9cc1-7177f02fecb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:03:31.675010 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e0e28d-ed68-4cdb-9cc1-7177f02fecb6 service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:03:31.694791 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 677/1343] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:03:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:03:34.572766 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b50a5fa-8d6f-41fc-90c2-d718febfa8da None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:03:34.573522 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b50a5fa-8d6f-41fc-90c2-d718febfa8da None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:03:34.573522 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b50a5fa-8d6f-41fc-90c2-d718febfa8da None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:03:34.574729 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 667/1344] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 21:03:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 23 21:03:34.580587 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d1e7ab-d1c0-4770-950f-c61e751529a7 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:03:34.581324 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d1e7ab-d1c0-4770-950f-c61e751529a7 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:03:34.581324 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d1e7ab-d1c0-4770-950f-c61e751529a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:03:34.666492 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-d7d1e7ab-d1c0-4770-950f-c61e751529a7 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:03:34.667706 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-d7d1e7ab-d1c0-4770-950f-c61e751529a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:03:34.689769 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:03:34.792325 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 678/1345] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 21:03:34 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:03:34.835678 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b50a5fa-8d6f-41fc-90c2-d718febfa8da None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:03:34.837343 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-3b50a5fa-8d6f-41fc-90c2-d718febfa8da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:03:34.977918 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b50a5fa-8d6f-41fc-90c2-d718febfa8da None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:03:35.069006 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99594749-53f6-4cb9-8f3b-e4e88437b310 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:03:35.069692 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99594749-53f6-4cb9-8f3b-e4e88437b310 service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:03:35.070017 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99594749-53f6-4cb9-8f3b-e4e88437b310 service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:03:35.070287 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99594749-53f6-4cb9-8f3b-e4e88437b310 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:03:35.072177 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-99594749-53f6-4cb9-8f3b-e4e88437b310 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:03:35.123032 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:03:35.202979 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99594749-53f6-4cb9-8f3b-e4e88437b310 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:03:35.204529 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99594749-53f6-4cb9-8f3b-e4e88437b310 service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:03:35.226113 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 668/1346] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:03:34 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 23 21:03:39.828762 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51f0393-3783-4688-8fa4-710cc950019a None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:03:39.829326 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51f0393-3783-4688-8fa4-710cc950019a None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:03:39.829326 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51f0393-3783-4688-8fa4-710cc950019a None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:03:39.830921 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 679/1347] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 21:03:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:03:39.836783 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15f7ca2-cfe8-41a4-b4d7-915a5d97b30a None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:03:39.837257 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15f7ca2-cfe8-41a4-b4d7-915a5d97b30a None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:03:39.837520 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15f7ca2-cfe8-41a4-b4d7-915a5d97b30a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:03:39.907242 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-f15f7ca2-cfe8-41a4-b4d7-915a5d97b30a None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:03:39.908492 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-f15f7ca2-cfe8-41a4-b4d7-915a5d97b30a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:03:40.007746 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:03:40.014234 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 669/1348] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 21:03:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:03:40.054773 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51f0393-3783-4688-8fa4-710cc950019a None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:03:40.056532 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-e51f0393-3783-4688-8fa4-710cc950019a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:03:40.180295 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51f0393-3783-4688-8fa4-710cc950019a None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:03:40.237193 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:03:40.269028 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3863119-820d-4321-a4ce-e60fff5548a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:03:40.270081 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3863119-820d-4321-a4ce-e60fff5548a6 service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:03:40.270348 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3863119-820d-4321-a4ce-e60fff5548a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:03:40.270629 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3863119-820d-4321-a4ce-e60fff5548a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:03:40.272330 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-c3863119-820d-4321-a4ce-e60fff5548a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:03:40.419951 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3863119-820d-4321-a4ce-e60fff5548a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:03:40.422994 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3863119-820d-4321-a4ce-e60fff5548a6 service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:03:40.448022 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 680/1349] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:03:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 23 21:03:46.016268 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd090d10-6bec-438c-9dae-c312eb09411b None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:03:46.016820 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd090d10-6bec-438c-9dae-c312eb09411b None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:03:46.017040 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd090d10-6bec-438c-9dae-c312eb09411b None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:03:46.019480 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 670/1350] 10.222.0.17 () {54 vars in 921 bytes} [Sat Jul 23 21:03:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:03:46.024923 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c27234-490e-434a-91dd-dab9608c686d None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:03:46.025705 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c27234-490e-434a-91dd-dab9608c686d None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:03:46.026168 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c27234-490e-434a-91dd-dab9608c686d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:03:46.108188 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-56c27234-490e-434a-91dd-dab9608c686d None None] MFA Rules not processed for user `abc719a3b3ac4461b82ca04ab6451d81`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:03:46.109778 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-56c27234-490e-434a-91dd-dab9608c686d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:03:46.128872 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:03:46.222608 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 681/1351] 10.222.0.17 () {58 vars in 1018 bytes} [Sat Jul 23 21:03:46 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:03:50.665846 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dfacca-695b-4b5e-bf30-4517be04c2cf None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:03:50.665846 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dfacca-695b-4b5e-bf30-4517be04c2cf None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:03:50.665846 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dfacca-695b-4b5e-bf30-4517be04c2cf None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:03:50.667284 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 671/1352] 10.222.0.17 () {54 vars in 921 bytes} [Sat Jul 23 21:03:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:03:50.673266 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4efaa3b-cdaf-4e12-aec9-6b26ef6831b0 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:03:50.674136 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4efaa3b-cdaf-4e12-aec9-6b26ef6831b0 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:03:50.674136 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4efaa3b-cdaf-4e12-aec9-6b26ef6831b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:03:50.775374 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-e4efaa3b-cdaf-4e12-aec9-6b26ef6831b0 None None] MFA Rules not processed for user `abc719a3b3ac4461b82ca04ab6451d81`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:03:50.776630 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-e4efaa3b-cdaf-4e12-aec9-6b26ef6831b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:03:50.877897 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:03:50.924789 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 682/1353] 10.222.0.17 () {58 vars in 1018 bytes} [Sat Jul 23 21:03:50 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:03:52.327868 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dd63ea-5ced-4505-8fec-d7bfed1d4ccf None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:03:52.328550 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dd63ea-5ced-4505-8fec-d7bfed1d4ccf None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:03:52.329026 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dd63ea-5ced-4505-8fec-d7bfed1d4ccf None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:03:52.330637 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 672/1354] 10.222.0.17 () {54 vars in 921 bytes} [Sat Jul 23 21:03:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:03:52.336241 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f2a756-c90a-4179-a826-6cdf22653b38 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:03:52.336717 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f2a756-c90a-4179-a826-6cdf22653b38 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:03:52.336916 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f2a756-c90a-4179-a826-6cdf22653b38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:03:52.428935 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-f7f2a756-c90a-4179-a826-6cdf22653b38 None None] MFA Rules not processed for user `abc719a3b3ac4461b82ca04ab6451d81`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:03:52.430212 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-f7f2a756-c90a-4179-a826-6cdf22653b38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:03:52.543754 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 683/1355] 10.222.0.17 () {58 vars in 1018 bytes} [Sat Jul 23 21:03:52 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:03:56.663471 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e72a0b-d4bd-4330-8558-d905da3b3b74 None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:03:56.664372 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e72a0b-d4bd-4330-8558-d905da3b3b74 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:03:56.664917 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e72a0b-d4bd-4330-8558-d905da3b3b74 None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:03:56.670314 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 673/1356] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 21:03:56 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:03:56.672437 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40308461-da7c-4af8-98eb-159c13eb28ec None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:03:56.673079 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40308461-da7c-4af8-98eb-159c13eb28ec None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:03:56.673079 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40308461-da7c-4af8-98eb-159c13eb28ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:03:56.713736 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:03:56.751468 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-40308461-da7c-4af8-98eb-159c13eb28ec None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:03:56.752734 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-40308461-da7c-4af8-98eb-159c13eb28ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:03:56.877994 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 684/1357] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 21:03:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:03:56.931995 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4f7181-8ace-4943-84f7-4fcdc6051b55 None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:03:56.932303 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4f7181-8ace-4943-84f7-4fcdc6051b55 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:03:56.932626 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4f7181-8ace-4943-84f7-4fcdc6051b55 None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:03:56.934086 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 674/1358] 10.222.0.17 () {54 vars in 962 bytes} [Sat Jul 23 21:03:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:03:56.944967 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c648883d-2769-4c14-8203-90d7287d7a4b None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:03:56.945304 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c648883d-2769-4c14-8203-90d7287d7a4b None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:03:56.945834 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c648883d-2769-4c14-8203-90d7287d7a4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:03:57.036318 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-c648883d-2769-4c14-8203-90d7287d7a4b None None] MFA Rules not processed for user `079f31ed2c844e67bd4e206f24b69d97`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:03:57.037678 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-c648883d-2769-4c14-8203-90d7287d7a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:03:57.097442 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:03:57.182072 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 685/1359] 10.222.0.17 () {58 vars in 1059 bytes} [Sat Jul 23 21:03:56 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:03:57.186749 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4f7181-8ace-4943-84f7-4fcdc6051b55 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:03:57.188259 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-bb4f7181-8ace-4943-84f7-4fcdc6051b55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:03:57.350607 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4f7181-8ace-4943-84f7-4fcdc6051b55 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:03:57.434867 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:03:57.488928 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f562ca97-994c-4ea9-92ad-13472b6eb6df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:03:57.489600 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f562ca97-994c-4ea9-92ad-13472b6eb6df service nova] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:03:57.489904 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f562ca97-994c-4ea9-92ad-13472b6eb6df service nova] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:03:57.490171 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f562ca97-994c-4ea9-92ad-13472b6eb6df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:03:57.492876 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-f562ca97-994c-4ea9-92ad-13472b6eb6df service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:03:57.597419 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f562ca97-994c-4ea9-92ad-13472b6eb6df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:03:57.600229 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f562ca97-994c-4ea9-92ad-13472b6eb6df service nova] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:03:57.629708 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 675/1360] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:03:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:04:00.227254 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4d14b4-19dd-4770-b0d4-ab677020bd14 None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:04:00.228079 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4d14b4-19dd-4770-b0d4-ab677020bd14 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:04:00.228079 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4d14b4-19dd-4770-b0d4-ab677020bd14 None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:04:00.229543 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 686/1361] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 21:04:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:04:00.235117 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d22a68-c925-47ea-9f69-9cb498bb72cd None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:04:00.235610 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d22a68-c925-47ea-9f69-9cb498bb72cd None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:04:00.235828 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d22a68-c925-47ea-9f69-9cb498bb72cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:04:00.329216 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-d5d22a68-c925-47ea-9f69-9cb498bb72cd None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:04:00.331770 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-d5d22a68-c925-47ea-9f69-9cb498bb72cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:04:00.393298 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:04:00.475829 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 676/1362] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 21:04:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:04:00.538554 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4d14b4-19dd-4770-b0d4-ab677020bd14 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:04:00.550045 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-de4d14b4-19dd-4770-b0d4-ab677020bd14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:04:00.746362 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4d14b4-19dd-4770-b0d4-ab677020bd14 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:04:00.757818 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:04:00.903752 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ff8f70-6347-4a27-bc66-45f22c80f521 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:04:00.904541 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ff8f70-6347-4a27-bc66-45f22c80f521 service nova] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:04:00.904857 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ff8f70-6347-4a27-bc66-45f22c80f521 service nova] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:04:00.905112 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ff8f70-6347-4a27-bc66-45f22c80f521 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:04:00.907298 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-f2ff8f70-6347-4a27-bc66-45f22c80f521 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:04:01.035835 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ff8f70-6347-4a27-bc66-45f22c80f521 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:04:01.037654 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ff8f70-6347-4a27-bc66-45f22c80f521 service nova] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:04:01.064470 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 687/1363] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:04:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 528 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:04:03.726901 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0442c8-a6f8-42fd-8ada-ac518380c484 None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:04:03.727417 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0442c8-a6f8-42fd-8ada-ac518380c484 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:04:03.727417 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0442c8-a6f8-42fd-8ada-ac518380c484 None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:04:03.728973 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 677/1364] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 21:04:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:04:03.735343 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceaa730-2b2b-463a-bd62-b383cc91ecd7 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:04:03.736036 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceaa730-2b2b-463a-bd62-b383cc91ecd7 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:04:03.736036 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceaa730-2b2b-463a-bd62-b383cc91ecd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:04:03.754670 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:04:03.851629 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-4ceaa730-2b2b-463a-bd62-b383cc91ecd7 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:04:03.853126 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-4ceaa730-2b2b-463a-bd62-b383cc91ecd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:04:03.981297 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 688/1365] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 21:04:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:04:04.033607 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f267bc-94ec-49b3-a186-f5a535735b00 None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:04:04.034297 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f267bc-94ec-49b3-a186-f5a535735b00 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:04:04.034621 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f267bc-94ec-49b3-a186-f5a535735b00 None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:04:04.036293 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 678/1366] 10.222.0.17 () {54 vars in 962 bytes} [Sat Jul 23 21:04:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:04:04.042974 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dffd746-ed25-42ce-a444-04720bd7f4b8 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:04:04.043259 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dffd746-ed25-42ce-a444-04720bd7f4b8 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:04:04.043530 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dffd746-ed25-42ce-a444-04720bd7f4b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:04:04.135768 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-2dffd746-ed25-42ce-a444-04720bd7f4b8 None None] MFA Rules not processed for user `079f31ed2c844e67bd4e206f24b69d97`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:04:04.137649 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-2dffd746-ed25-42ce-a444-04720bd7f4b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:04:04.176740 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:04:04.322261 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f267bc-94ec-49b3-a186-f5a535735b00 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:04:04.330255 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-36f267bc-94ec-49b3-a186-f5a535735b00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:04:04.330485 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 689/1367] 10.222.0.17 () {58 vars in 1059 bytes} [Sat Jul 23 21:04:04 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:04:04.518979 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f267bc-94ec-49b3-a186-f5a535735b00 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:04:04.543058 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:04:04.668196 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5533f4b9-7b87-4ad5-8998-bd8ca6bf2bf1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:04:04.668890 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5533f4b9-7b87-4ad5-8998-bd8ca6bf2bf1 service nova] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:04:04.669169 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5533f4b9-7b87-4ad5-8998-bd8ca6bf2bf1 service nova] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:04:04.669524 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5533f4b9-7b87-4ad5-8998-bd8ca6bf2bf1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:04:04.671367 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-5533f4b9-7b87-4ad5-8998-bd8ca6bf2bf1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:04:04.813837 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5533f4b9-7b87-4ad5-8998-bd8ca6bf2bf1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:04:04.813837 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5533f4b9-7b87-4ad5-8998-bd8ca6bf2bf1 service nova] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:04:04.835512 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 679/1368] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:04:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 514 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:04:07.515653 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cfc6fa-8cc7-434b-938a-8c0ad27a5c57 None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:04:07.516545 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cfc6fa-8cc7-434b-938a-8c0ad27a5c57 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:04:07.516545 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cfc6fa-8cc7-434b-938a-8c0ad27a5c57 None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:04:07.517912 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 690/1369] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 21:04:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:04:07.524089 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fe8483-caed-411a-9c81-13fba749c56e None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:04:07.524676 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fe8483-caed-411a-9c81-13fba749c56e None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:04:07.524676 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fe8483-caed-411a-9c81-13fba749c56e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:04:07.561940 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:04:07.610914 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-65fe8483-caed-411a-9c81-13fba749c56e None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:04:07.612287 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-65fe8483-caed-411a-9c81-13fba749c56e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:04:07.741100 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 680/1370] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 21:04:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:04:07.795905 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cfc6fa-8cc7-434b-938a-8c0ad27a5c57 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:04:07.797511 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-f4cfc6fa-8cc7-434b-938a-8c0ad27a5c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:04:07.974212 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:04:07.981114 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cfc6fa-8cc7-434b-938a-8c0ad27a5c57 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:04:08.117284 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747a7c11-a9c3-46fa-8473-60b467b8b05c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:04:08.118025 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747a7c11-a9c3-46fa-8473-60b467b8b05c service nova] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:04:08.118307 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747a7c11-a9c3-46fa-8473-60b467b8b05c service nova] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:04:08.118581 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747a7c11-a9c3-46fa-8473-60b467b8b05c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:04:08.120274 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-747a7c11-a9c3-46fa-8473-60b467b8b05c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:04:08.223310 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747a7c11-a9c3-46fa-8473-60b467b8b05c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:04:08.225709 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747a7c11-a9c3-46fa-8473-60b467b8b05c service nova] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:04:08.243865 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:04:08.248262 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 691/1371] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:04:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:04:09.660059 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7103f66a-cb1d-4486-a9da-efc15ebd8b81 None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:04:09.660642 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7103f66a-cb1d-4486-a9da-efc15ebd8b81 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:04:09.660642 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7103f66a-cb1d-4486-a9da-efc15ebd8b81 None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:04:09.661926 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 681/1372] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 21:04:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:04:09.667807 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b99101a-6957-4b21-8ddb-f0d19affc6f7 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:04:09.668408 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b99101a-6957-4b21-8ddb-f0d19affc6f7 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:04:09.668408 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b99101a-6957-4b21-8ddb-f0d19affc6f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:04:09.774867 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-4b99101a-6957-4b21-8ddb-f0d19affc6f7 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:04:09.776176 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-4b99101a-6957-4b21-8ddb-f0d19affc6f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:04:09.908043 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 692/1373] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 21:04:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:04:10.208980 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23650ba8-8136-409c-aa5b-41633a426e7a None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:04:10.209227 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23650ba8-8136-409c-aa5b-41633a426e7a None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:04:10.209650 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23650ba8-8136-409c-aa5b-41633a426e7a None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:04:10.211463 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 682/1374] 10.222.0.17 () {54 vars in 964 bytes} [Sat Jul 23 21:04:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:04:10.217019 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cae69b7-d36b-4d22-8dfe-c94f9745cf78 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:04:10.217378 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cae69b7-d36b-4d22-8dfe-c94f9745cf78 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:04:10.217716 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cae69b7-d36b-4d22-8dfe-c94f9745cf78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:04:10.324986 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-8cae69b7-d36b-4d22-8dfe-c94f9745cf78 None None] MFA Rules not processed for user `ec5fd3a489c341b7964704d689037f05`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:04:10.326376 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-8cae69b7-d36b-4d22-8dfe-c94f9745cf78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:04:10.354169 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:04:10.426384 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 693/1375] 10.222.0.17 () {58 vars in 1061 bytes} [Sat Jul 23 21:04:10 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:04:10.434745 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23650ba8-8136-409c-aa5b-41633a426e7a None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:04:10.436304 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-23650ba8-8136-409c-aa5b-41633a426e7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:04:10.580892 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23650ba8-8136-409c-aa5b-41633a426e7a None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:04:10.585338 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:04:10.683358 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cf66d9-05da-40cd-b160-f39294576d1e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec5fd3a489c341b7964704d689037f05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:04:10.684043 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cf66d9-05da-40cd-b160-f39294576d1e service cinder] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:04:10.684411 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cf66d9-05da-40cd-b160-f39294576d1e service cinder] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:04:10.685443 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cf66d9-05da-40cd-b160-f39294576d1e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:04:10.686687 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-c8cf66d9-05da-40cd-b160-f39294576d1e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:04:10.829221 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cf66d9-05da-40cd-b160-f39294576d1e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:04:10.831735 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cf66d9-05da-40cd-b160-f39294576d1e service cinder] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:04:10.859063 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 683/1376] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:04:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:04:10.990426 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c357b553-877e-4e5f-9db4-8e23e1db0ab8 None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:04:10.991103 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c357b553-877e-4e5f-9db4-8e23e1db0ab8 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:04:10.991103 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c357b553-877e-4e5f-9db4-8e23e1db0ab8 None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:04:10.992878 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 694/1377] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 21:04:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:04:10.998987 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcd34bb-a500-45e8-8aa7-a28c232f3861 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:04:10.999326 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcd34bb-a500-45e8-8aa7-a28c232f3861 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:04:10.999639 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcd34bb-a500-45e8-8aa7-a28c232f3861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:04:11.054087 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:04:11.086004 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-5dcd34bb-a500-45e8-8aa7-a28c232f3861 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:04:11.087659 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-5dcd34bb-a500-45e8-8aa7-a28c232f3861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:04:11.461846 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 684/1378] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 21:04:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:04:11.493741 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c357b553-877e-4e5f-9db4-8e23e1db0ab8 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:04:11.493741 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-c357b553-877e-4e5f-9db4-8e23e1db0ab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:04:11.493741 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c357b553-877e-4e5f-9db4-8e23e1db0ab8 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:04:11.493741 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:04:11.639705 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc40d8f-f279-4dcd-bc38-d39f07fc9f6b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:04:11.640344 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc40d8f-f279-4dcd-bc38-d39f07fc9f6b service nova] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:04:11.640932 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc40d8f-f279-4dcd-bc38-d39f07fc9f6b service nova] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:04:11.641315 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc40d8f-f279-4dcd-bc38-d39f07fc9f6b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:04:11.644533 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-bfc40d8f-f279-4dcd-bc38-d39f07fc9f6b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:04:11.791240 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc40d8f-f279-4dcd-bc38-d39f07fc9f6b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:04:11.794147 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc40d8f-f279-4dcd-bc38-d39f07fc9f6b service nova] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:04:11.832036 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 695/1379] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:04:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 542 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 23 21:04:14.319246 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d6e150-8080-446d-8aa3-85770b33055b None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:04:14.320112 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d6e150-8080-446d-8aa3-85770b33055b None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:04:14.320112 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d6e150-8080-446d-8aa3-85770b33055b None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:04:14.321446 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 685/1380] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 21:04:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:04:14.327657 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7e9567-408d-4fb2-b0eb-8587ee672c11 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:04:14.328213 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7e9567-408d-4fb2-b0eb-8587ee672c11 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:04:14.328213 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7e9567-408d-4fb2-b0eb-8587ee672c11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:04:14.386423 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:04:14.421788 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-4d7e9567-408d-4fb2-b0eb-8587ee672c11 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:04:14.423507 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-4d7e9567-408d-4fb2-b0eb-8587ee672c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:04:14.536315 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 696/1381] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 21:04:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:04:14.584381 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d6e150-8080-446d-8aa3-85770b33055b None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:04:14.586187 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-c0d6e150-8080-446d-8aa3-85770b33055b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:04:14.727487 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:04:14.778326 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d6e150-8080-446d-8aa3-85770b33055b None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:04:14.944395 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85ef302-7d89-4606-ad19-0fdf4726faa7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:04:14.944902 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85ef302-7d89-4606-ad19-0fdf4726faa7 service nova] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:04:14.945178 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85ef302-7d89-4606-ad19-0fdf4726faa7 service nova] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:04:14.945443 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85ef302-7d89-4606-ad19-0fdf4726faa7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:04:14.947315 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-e85ef302-7d89-4606-ad19-0fdf4726faa7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:04:15.043165 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:04:15.066477 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85ef302-7d89-4606-ad19-0fdf4726faa7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:04:15.068522 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85ef302-7d89-4606-ad19-0fdf4726faa7 service nova] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:04:15.090828 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 686/1382] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:04:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 507 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:04:17.483612 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6422d53-40b5-446a-98d7-4b30ea43477b None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:04:17.484134 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6422d53-40b5-446a-98d7-4b30ea43477b None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:04:17.484134 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6422d53-40b5-446a-98d7-4b30ea43477b None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:04:17.485801 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 697/1383] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 21:04:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:04:17.492208 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e8adf8-f506-4c16-9dca-c1eee81ca260 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:04:17.492796 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e8adf8-f506-4c16-9dca-c1eee81ca260 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:04:17.492796 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e8adf8-f506-4c16-9dca-c1eee81ca260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:04:17.565412 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-32e8adf8-f506-4c16-9dca-c1eee81ca260 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:04:17.566742 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-32e8adf8-f506-4c16-9dca-c1eee81ca260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:04:17.672967 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 687/1384] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 21:04:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:04:17.715881 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6422d53-40b5-446a-98d7-4b30ea43477b None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:04:17.717487 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-c6422d53-40b5-446a-98d7-4b30ea43477b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:04:17.857049 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:04:17.903948 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6422d53-40b5-446a-98d7-4b30ea43477b None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:04:18.044403 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397576bd-c6a3-4fdb-b4aa-b55913020406 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:04:18.045061 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397576bd-c6a3-4fdb-b4aa-b55913020406 service nova] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:04:18.045337 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397576bd-c6a3-4fdb-b4aa-b55913020406 service nova] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:04:18.045603 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397576bd-c6a3-4fdb-b4aa-b55913020406 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:04:18.047609 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-397576bd-c6a3-4fdb-b4aa-b55913020406 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:04:18.132367 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:04:18.152104 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397576bd-c6a3-4fdb-b4aa-b55913020406 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:04:18.153697 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397576bd-c6a3-4fdb-b4aa-b55913020406 service nova] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:04:18.175960 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 698/1385] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:04:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:04:20.998189 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea91716-c919-4255-bb65-a73f945fe22b None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:04:20.998949 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea91716-c919-4255-bb65-a73f945fe22b None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:04:20.999248 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea91716-c919-4255-bb65-a73f945fe22b None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:04:21.000793 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 688/1386] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 21:04:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:04:21.007445 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dee352-2b9c-41bc-b779-d4ba1a2762c8 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:04:21.008155 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dee352-2b9c-41bc-b779-d4ba1a2762c8 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:04:21.008155 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dee352-2b9c-41bc-b779-d4ba1a2762c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:04:21.095368 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-c0dee352-2b9c-41bc-b779-d4ba1a2762c8 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:04:21.097454 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-c0dee352-2b9c-41bc-b779-d4ba1a2762c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:04:21.230852 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 699/1387] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 21:04:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:04:21.293130 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea91716-c919-4255-bb65-a73f945fe22b None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:04:21.295018 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-bea91716-c919-4255-bb65-a73f945fe22b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:04:21.375554 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:04:21.508974 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea91716-c919-4255-bb65-a73f945fe22b None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:04:21.680972 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d8c221-49aa-4aa6-8069-2569ccc143cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:04:21.682298 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d8c221-49aa-4aa6-8069-2569ccc143cf service nova] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:04:21.682694 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d8c221-49aa-4aa6-8069-2569ccc143cf service nova] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:04:21.683138 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d8c221-49aa-4aa6-8069-2569ccc143cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:04:21.686099 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-a6d8c221-49aa-4aa6-8069-2569ccc143cf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:04:21.707314 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:04:21.815355 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d8c221-49aa-4aa6-8069-2569ccc143cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:04:21.817509 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d8c221-49aa-4aa6-8069-2569ccc143cf service nova] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:04:21.843839 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 689/1388] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:04:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 551 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 23 21:04:24.920374 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52edbfc3-78b7-459a-aeae-688f6fd3e283 None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:04:24.921045 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52edbfc3-78b7-459a-aeae-688f6fd3e283 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:04:24.921045 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52edbfc3-78b7-459a-aeae-688f6fd3e283 None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:04:24.922416 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 700/1389] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 21:04:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:04:24.929266 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f0733c-b3d6-45a1-ac32-ca3c97ff8585 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:04:24.929823 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f0733c-b3d6-45a1-ac32-ca3c97ff8585 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:04:24.929823 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f0733c-b3d6-45a1-ac32-ca3c97ff8585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:04:25.008461 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-53f0733c-b3d6-45a1-ac32-ca3c97ff8585 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:04:25.009721 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-53f0733c-b3d6-45a1-ac32-ca3c97ff8585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:04:25.100513 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:04:25.112634 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 690/1390] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 21:04:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:04:25.160255 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52edbfc3-78b7-459a-aeae-688f6fd3e283 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:04:25.161787 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-52edbfc3-78b7-459a-aeae-688f6fd3e283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:04:25.222072 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:04:25.324273 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52edbfc3-78b7-459a-aeae-688f6fd3e283 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:04:25.471789 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6748a2b6-07cb-4913-a302-65f069c980cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:04:25.472419 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6748a2b6-07cb-4913-a302-65f069c980cd service nova] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:04:25.472701 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6748a2b6-07cb-4913-a302-65f069c980cd service nova] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:04:25.472978 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6748a2b6-07cb-4913-a302-65f069c980cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:04:25.475520 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-6748a2b6-07cb-4913-a302-65f069c980cd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:04:25.495716 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:04:25.609313 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6748a2b6-07cb-4913-a302-65f069c980cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:04:25.609313 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6748a2b6-07cb-4913-a302-65f069c980cd service nova] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:04:25.635642 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 701/1391] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:04:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:04:27.368901 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03188314-5e9b-4462-bca7-6a2a7d93da2b None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:04:27.369485 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03188314-5e9b-4462-bca7-6a2a7d93da2b None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:04:27.369485 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03188314-5e9b-4462-bca7-6a2a7d93da2b None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:04:27.371014 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 691/1392] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 21:04:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:04:27.376581 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ade13c-6aad-467b-a794-424fbca83286 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:04:27.377069 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ade13c-6aad-467b-a794-424fbca83286 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:04:27.377167 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ade13c-6aad-467b-a794-424fbca83286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:04:27.448665 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-63ade13c-6aad-467b-a794-424fbca83286 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:04:27.449894 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-63ade13c-6aad-467b-a794-424fbca83286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:04:27.545256 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:04:27.559089 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 702/1393] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 21:04:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:04:27.617118 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969c702f-c3bc-4b4f-abc8-829cc701f186 None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:04:27.617406 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969c702f-c3bc-4b4f-abc8-829cc701f186 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:04:27.617674 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969c702f-c3bc-4b4f-abc8-829cc701f186 None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:04:27.619189 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 692/1394] 10.222.0.17 () {54 vars in 966 bytes} [Sat Jul 23 21:04:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:04:27.624560 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530d67e6-04d7-4c91-b036-99e2a5c2a57f None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:04:27.624816 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530d67e6-04d7-4c91-b036-99e2a5c2a57f None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:04:27.625125 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530d67e6-04d7-4c91-b036-99e2a5c2a57f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:04:27.703473 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-530d67e6-04d7-4c91-b036-99e2a5c2a57f None None] MFA Rules not processed for user `f7f2db148c8e4d5d81431cae3576434b`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:04:27.704860 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-530d67e6-04d7-4c91-b036-99e2a5c2a57f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:04:27.792877 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 703/1395] 10.222.0.17 () {58 vars in 1063 bytes} [Sat Jul 23 21:04:27 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:04:27.800687 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969c702f-c3bc-4b4f-abc8-829cc701f186 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:04:27.802306 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-969c702f-c3bc-4b4f-abc8-829cc701f186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:04:27.956901 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969c702f-c3bc-4b4f-abc8-829cc701f186 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:04:28.071277 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de8304b-fb56-4671-87ff-32add988d4eb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7f2db148c8e4d5d81431cae3576434b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:04:28.071949 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de8304b-fb56-4671-87ff-32add988d4eb service glance] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:04:28.072414 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de8304b-fb56-4671-87ff-32add988d4eb service glance] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:04:28.072695 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de8304b-fb56-4671-87ff-32add988d4eb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:04:28.074560 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-9de8304b-fb56-4671-87ff-32add988d4eb service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:04:28.121170 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc38bae-f07a-4ba9-9833-1e53275348fc None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:04:28.121417 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc38bae-f07a-4ba9-9833-1e53275348fc None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:04:28.121706 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc38bae-f07a-4ba9-9833-1e53275348fc None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:04:28.123246 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 704/1396] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 21:04:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 23 21:04:28.129003 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4a1cf2-fa6e-48f9-a046-db8e06b36365 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:04:28.129426 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4a1cf2-fa6e-48f9-a046-db8e06b36365 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:04:28.129713 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4a1cf2-fa6e-48f9-a046-db8e06b36365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:04:28.130803 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:04:28.219440 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de8304b-fb56-4671-87ff-32add988d4eb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:04:28.220850 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de8304b-fb56-4671-87ff-32add988d4eb service glance] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:04:28.221295 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-2d4a1cf2-fa6e-48f9-a046-db8e06b36365 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:04:28.222566 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-2d4a1cf2-fa6e-48f9-a046-db8e06b36365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:04:28.240863 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 693/1397] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:04:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:04:28.264815 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:04:28.367654 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 705/1398] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 21:04:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:04:28.424903 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de8304b-fb56-4671-87ff-32add988d4eb service glance] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:04:28.426335 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-9de8304b-fb56-4671-87ff-32add988d4eb service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:04:28.547039 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de8304b-fb56-4671-87ff-32add988d4eb service glance] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:04:28.607053 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:04:28.685747 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a773a386-1b58-4e8c-bf42-95363322c99b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:04:28.686562 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a773a386-1b58-4e8c-bf42-95363322c99b service nova] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:04:28.686839 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a773a386-1b58-4e8c-bf42-95363322c99b service nova] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:04:28.687104 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a773a386-1b58-4e8c-bf42-95363322c99b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:04:28.688802 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-a773a386-1b58-4e8c-bf42-95363322c99b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:04:28.808027 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a773a386-1b58-4e8c-bf42-95363322c99b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:04:28.810441 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a773a386-1b58-4e8c-bf42-95363322c99b service nova] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:04:28.838699 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 694/1399] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:04:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:04:28.890575 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27719f2d-fb6d-4b5f-999a-d978aa3f4a49 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:04:28.891194 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27719f2d-fb6d-4b5f-999a-d978aa3f4a49 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:04:28.891194 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27719f2d-fb6d-4b5f-999a-d978aa3f4a49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:04:28.967680 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-27719f2d-fb6d-4b5f-999a-d978aa3f4a49 None None] MFA Rules not processed for user `17b779a3e21a415bb42cde5d6863d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:04:28.968986 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-27719f2d-fb6d-4b5f-999a-d978aa3f4a49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:04:29.079991 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 706/1400] 10.222.0.17 () {58 vars in 1009 bytes} [Sat Jul 23 21:04:28 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:04:29.135239 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f2d83d-7b13-40a2-9462-edc184d2b3b5 None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:04:29.135494 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f2d83d-7b13-40a2-9462-edc184d2b3b5 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:04:29.135852 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f2d83d-7b13-40a2-9462-edc184d2b3b5 None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:04:29.137290 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 695/1401] 10.222.0.17 () {54 vars in 943 bytes} [Sat Jul 23 21:04:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:04:29.145995 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a86fba-c0c4-4eda-b150-37888a8b307a None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:04:29.146293 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a86fba-c0c4-4eda-b150-37888a8b307a None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:04:29.146624 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a86fba-c0c4-4eda-b150-37888a8b307a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:04:29.177908 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:04:29.233718 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-e5a86fba-c0c4-4eda-b150-37888a8b307a None None] MFA Rules not processed for user `47f0a685b7da46afb81024848f079d2f`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:04:29.234992 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-e5a86fba-c0c4-4eda-b150-37888a8b307a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:04:29.362950 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 707/1402] 10.222.0.17 () {58 vars in 1040 bytes} [Sat Jul 23 21:04:29 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:04:29.372628 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f2d83d-7b13-40a2-9462-edc184d2b3b5 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:04:29.374764 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-18f2d83d-7b13-40a2-9462-edc184d2b3b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:04:29.456158 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:04:29.548210 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f2d83d-7b13-40a2-9462-edc184d2b3b5 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:04:29.658602 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0efc5c-895b-47c6-820d-980560e3e7be service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f0a685b7da46afb81024848f079d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:04:29.659177 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0efc5c-895b-47c6-820d-980560e3e7be service swift] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:04:29.659450 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0efc5c-895b-47c6-820d-980560e3e7be service swift] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:04:29.659717 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0efc5c-895b-47c6-820d-980560e3e7be service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:04:29.661422 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-aa0efc5c-895b-47c6-820d-980560e3e7be service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:04:29.709392 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:04:29.771035 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0efc5c-895b-47c6-820d-980560e3e7be service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:04:29.773652 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0efc5c-895b-47c6-820d-980560e3e7be service swift] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:04:29.785482 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 696/1403] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 23 21:04:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 23 21:04:31.274912 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477c4dc3-0f9f-436f-86f3-c405e9ee54d9 None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:04:31.275635 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477c4dc3-0f9f-436f-86f3-c405e9ee54d9 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:04:31.275635 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477c4dc3-0f9f-436f-86f3-c405e9ee54d9 None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:04:31.277151 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 708/1404] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 21:04:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:04:31.282889 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e4298d-212d-43ce-91b5-65c8cac453ca None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:04:31.283465 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e4298d-212d-43ce-91b5-65c8cac453ca None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:04:31.283465 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e4298d-212d-43ce-91b5-65c8cac453ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:04:31.373164 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-61e4298d-212d-43ce-91b5-65c8cac453ca None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:04:31.375281 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-61e4298d-212d-43ce-91b5-65c8cac453ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:04:31.493993 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 697/1405] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 21:04:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:04:31.546218 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477c4dc3-0f9f-436f-86f3-c405e9ee54d9 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:04:31.548039 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-477c4dc3-0f9f-436f-86f3-c405e9ee54d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:04:31.661029 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:04:31.742945 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477c4dc3-0f9f-436f-86f3-c405e9ee54d9 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:04:31.933844 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80c7113-3093-41a7-bd64-14ea7404072e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:04:31.934735 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80c7113-3093-41a7-bd64-14ea7404072e service nova] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:04:31.935192 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80c7113-3093-41a7-bd64-14ea7404072e service nova] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:04:31.935747 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80c7113-3093-41a7-bd64-14ea7404072e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:04:31.938004 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-d80c7113-3093-41a7-bd64-14ea7404072e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:04:32.015045 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:04:32.067468 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80c7113-3093-41a7-bd64-14ea7404072e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:04:32.069018 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80c7113-3093-41a7-bd64-14ea7404072e service nova] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:04:32.090063 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 709/1406] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:04:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 544 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:04:34.486779 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a54712-6f6a-4ab6-9d36-d862fa609c7a None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:04:34.487457 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a54712-6f6a-4ab6-9d36-d862fa609c7a None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:04:34.487457 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a54712-6f6a-4ab6-9d36-d862fa609c7a None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:04:34.490041 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 698/1407] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 21:04:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:04:34.496224 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1f8f6b-635c-4b0e-bd4f-797d7522611a None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:04:34.497047 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1f8f6b-635c-4b0e-bd4f-797d7522611a None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:04:34.497218 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1f8f6b-635c-4b0e-bd4f-797d7522611a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:04:34.610688 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-0f1f8f6b-635c-4b0e-bd4f-797d7522611a None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:04:34.612404 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-0f1f8f6b-635c-4b0e-bd4f-797d7522611a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:04:34.768413 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 710/1408] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 21:04:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:04:34.826206 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a54712-6f6a-4ab6-9d36-d862fa609c7a None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:04:34.827769 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-f1a54712-6f6a-4ab6-9d36-d862fa609c7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:04:34.874354 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:04:35.018729 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a54712-6f6a-4ab6-9d36-d862fa609c7a None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:04:35.162688 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:04:35.173428 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd3df0a-a98c-499f-ba3c-3166befeacfc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:04:35.174176 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd3df0a-a98c-499f-ba3c-3166befeacfc service nova] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:04:35.174461 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd3df0a-a98c-499f-ba3c-3166befeacfc service nova] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:04:35.174732 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd3df0a-a98c-499f-ba3c-3166befeacfc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:04:35.176455 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-8bd3df0a-a98c-499f-ba3c-3166befeacfc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:04:35.340186 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd3df0a-a98c-499f-ba3c-3166befeacfc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:04:35.341977 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd3df0a-a98c-499f-ba3c-3166befeacfc service nova] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:04:35.368823 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 699/1409] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:04:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 543 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:04:44.762401 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=90 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:04:45.364686 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=47 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:04:53.126247 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b200b76-7a1d-4707-b693-1f3f9b9d95c6 None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:04:53.126843 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b200b76-7a1d-4707-b693-1f3f9b9d95c6 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:04:53.126843 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b200b76-7a1d-4707-b693-1f3f9b9d95c6 None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:04:53.128058 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 711/1410] 10.222.0.17 () {54 vars in 918 bytes} [Sat Jul 23 21:04:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:04:53.133495 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5acc4e-20fc-4e41-97e1-54911097401f None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:04:53.133988 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5acc4e-20fc-4e41-97e1-54911097401f None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:04:53.134125 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5acc4e-20fc-4e41-97e1-54911097401f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:04:53.215088 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-bc5acc4e-20fc-4e41-97e1-54911097401f None None] MFA Rules not processed for user `abc719a3b3ac4461b82ca04ab6451d81`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:04:53.216349 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-bc5acc4e-20fc-4e41-97e1-54911097401f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:04:53.330902 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 700/1411] 10.222.0.17 () {58 vars in 1015 bytes} [Sat Jul 23 21:04:53 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:04:53.345763 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb4027b-e374-4f4e-8424-ccb1d4344b79 None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:04:53.346083 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb4027b-e374-4f4e-8424-ccb1d4344b79 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:04:53.346357 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb4027b-e374-4f4e-8424-ccb1d4344b79 None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:04:53.347707 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 712/1412] 10.222.0.17 () {54 vars in 918 bytes} [Sat Jul 23 21:04:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:04:53.352638 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad88a7d-a757-4f4b-a01d-fc41e71b3869 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:04:53.352923 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad88a7d-a757-4f4b-a01d-fc41e71b3869 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:04:53.353233 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad88a7d-a757-4f4b-a01d-fc41e71b3869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:04:53.428717 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:04:53.431694 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-6ad88a7d-a757-4f4b-a01d-fc41e71b3869 None None] MFA Rules not processed for user `079f31ed2c844e67bd4e206f24b69d97`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:04:53.432866 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-6ad88a7d-a757-4f4b-a01d-fc41e71b3869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:04:53.551747 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 701/1413] 10.222.0.17 () {58 vars in 1015 bytes} [Sat Jul 23 21:04:53 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:04:56.379327 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aea4e7d-9df0-40f8-9670-ddca2664af20 None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:04:56.379924 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aea4e7d-9df0-40f8-9670-ddca2664af20 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:04:56.379924 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aea4e7d-9df0-40f8-9670-ddca2664af20 None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:04:56.381271 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 713/1414] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jul 23 21:04:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:04:56.387021 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc866a3d-f259-4913-a1d3-f72632bc80c8 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:04:56.387506 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc866a3d-f259-4913-a1d3-f72632bc80c8 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:04:56.387611 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc866a3d-f259-4913-a1d3-f72632bc80c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:04:56.461167 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-cc866a3d-f259-4913-a1d3-f72632bc80c8 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:04:56.462427 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-cc866a3d-f259-4913-a1d3-f72632bc80c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:04:56.522376 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:04:56.568504 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 702/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jul 23 21:04:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:04:56.619262 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aea4e7d-9df0-40f8-9670-ddca2664af20 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:04:56.620948 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-9aea4e7d-9df0-40f8-9670-ddca2664af20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:04:56.777786 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aea4e7d-9df0-40f8-9670-ddca2664af20 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:04:56.857269 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:04:56.902225 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6639ec-7ffe-4524-a2b0-63ecdd32121f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:04:56.902871 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6639ec-7ffe-4524-a2b0-63ecdd32121f service nova] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:04:56.903168 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6639ec-7ffe-4524-a2b0-63ecdd32121f service nova] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:04:56.903433 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6639ec-7ffe-4524-a2b0-63ecdd32121f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:04:56.905103 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-fb6639ec-7ffe-4524-a2b0-63ecdd32121f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:04:57.010041 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6639ec-7ffe-4524-a2b0-63ecdd32121f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:04:57.011731 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6639ec-7ffe-4524-a2b0-63ecdd32121f service nova] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:04:57.031601 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 714/1416] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:04:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:04:58.004200 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffdef2e-9f8c-4843-97c3-d62a342a42c4 None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:04:58.004807 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffdef2e-9f8c-4843-97c3-d62a342a42c4 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:04:58.004807 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffdef2e-9f8c-4843-97c3-d62a342a42c4 None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:04:58.006260 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 703/1417] 127.0.0.1 () {54 vars in 901 bytes} [Sat Jul 23 21:04:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:04:58.012525 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33392a78-b8d6-47bb-b23f-9da4c82ede9c None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:04:58.013220 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33392a78-b8d6-47bb-b23f-9da4c82ede9c None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:04:58.013376 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33392a78-b8d6-47bb-b23f-9da4c82ede9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:04:58.098756 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-33392a78-b8d6-47bb-b23f-9da4c82ede9c None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:04:58.099855 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-33392a78-b8d6-47bb-b23f-9da4c82ede9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:04:58.127721 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:04:58.203637 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 715/1418] 127.0.0.1 () {58 vars in 998 bytes} [Sat Jul 23 21:04:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:04:58.458799 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffdef2e-9f8c-4843-97c3-d62a342a42c4 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:04:58.460225 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-7ffdef2e-9f8c-4843-97c3-d62a342a42c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:04:58.621432 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffdef2e-9f8c-4843-97c3-d62a342a42c4 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:04:58.666914 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:04:58.750494 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91b56ba-b9ea-4b4c-aa60-c930cf80b192 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:04:58.751048 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91b56ba-b9ea-4b4c-aa60-c930cf80b192 service nova] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:04:58.751317 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91b56ba-b9ea-4b4c-aa60-c930cf80b192 service nova] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:04:58.751622 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91b56ba-b9ea-4b4c-aa60-c930cf80b192 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:04:58.753294 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-c91b56ba-b9ea-4b4c-aa60-c930cf80b192 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:04:58.859575 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91b56ba-b9ea-4b4c-aa60-c930cf80b192 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:04:58.861217 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91b56ba-b9ea-4b4c-aa60-c930cf80b192 service nova] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:04:58.881468 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 704/1419] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:04:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:04:59.808474 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd30ebe-4801-402d-960b-6091a0cffa52 None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:04:59.809346 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd30ebe-4801-402d-960b-6091a0cffa52 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:04:59.809346 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd30ebe-4801-402d-960b-6091a0cffa52 None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:04:59.810466 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 716/1420] 127.0.0.1 () {54 vars in 901 bytes} [Sat Jul 23 21:04:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:04:59.817502 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14cd4f0-9be0-4e06-ba62-68e54d80cf57 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:04:59.820078 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14cd4f0-9be0-4e06-ba62-68e54d80cf57 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:04:59.820667 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14cd4f0-9be0-4e06-ba62-68e54d80cf57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:04:59.892445 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:04:59.920320 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-e14cd4f0-9be0-4e06-ba62-68e54d80cf57 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:04:59.921561 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-e14cd4f0-9be0-4e06-ba62-68e54d80cf57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:05:00.026628 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 705/1421] 127.0.0.1 () {58 vars in 998 bytes} [Sat Jul 23 21:04:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:05:00.189616 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd30ebe-4801-402d-960b-6091a0cffa52 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:05:00.192083 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-2cd30ebe-4801-402d-960b-6091a0cffa52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:05:00.375395 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd30ebe-4801-402d-960b-6091a0cffa52 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:05:00.389206 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:05:00.508282 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9adaa75-dec3-4b8c-ae1b-7c9c0f10fc5c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:05:00.508944 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9adaa75-dec3-4b8c-ae1b-7c9c0f10fc5c service nova] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:05:00.509220 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9adaa75-dec3-4b8c-ae1b-7c9c0f10fc5c service nova] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:05:00.509490 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9adaa75-dec3-4b8c-ae1b-7c9c0f10fc5c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:05:00.511172 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-d9adaa75-dec3-4b8c-ae1b-7c9c0f10fc5c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:05:00.613625 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9adaa75-dec3-4b8c-ae1b-7c9c0f10fc5c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:05:00.616281 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9adaa75-dec3-4b8c-ae1b-7c9c0f10fc5c service nova] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:05:00.638751 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 717/1422] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:05:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:05:01.525650 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b3be4e-efd2-4c83-a2dc-d829e3558272 None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:05:01.526821 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b3be4e-efd2-4c83-a2dc-d829e3558272 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:05:01.527191 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b3be4e-efd2-4c83-a2dc-d829e3558272 None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:05:01.529191 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 706/1423] 127.0.0.1 () {54 vars in 901 bytes} [Sat Jul 23 21:05:01 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:05:01.535287 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b2983f-46cf-411c-ae00-40c78695a6e0 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:05:01.535815 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b2983f-46cf-411c-ae00-40c78695a6e0 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:05:01.535815 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b2983f-46cf-411c-ae00-40c78695a6e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:05:01.554821 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:05:01.619415 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-b3b2983f-46cf-411c-ae00-40c78695a6e0 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:05:01.620648 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-b3b2983f-46cf-411c-ae00-40c78695a6e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:05:01.734654 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 718/1424] 127.0.0.1 () {58 vars in 998 bytes} [Sat Jul 23 21:05:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:05:01.891789 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b3be4e-efd2-4c83-a2dc-d829e3558272 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:05:01.894741 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-14b3be4e-efd2-4c83-a2dc-d829e3558272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:05:02.029624 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:05:02.071474 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b3be4e-efd2-4c83-a2dc-d829e3558272 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:05:02.209106 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9b0afb-1067-49a3-b316-910e9f899e8b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:05:02.209769 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9b0afb-1067-49a3-b316-910e9f899e8b service nova] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:05:02.210073 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9b0afb-1067-49a3-b316-910e9f899e8b service nova] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:05:02.210345 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9b0afb-1067-49a3-b316-910e9f899e8b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:05:02.212019 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-9b9b0afb-1067-49a3-b316-910e9f899e8b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:05:02.298888 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:05:02.322885 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9b0afb-1067-49a3-b316-910e9f899e8b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:05:02.325233 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9b0afb-1067-49a3-b316-910e9f899e8b service nova] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:05:02.350976 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 707/1425] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:05:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:05:03.246709 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fc9e71-135e-4fb9-83eb-eb15a17eee6e None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:05:03.247468 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fc9e71-135e-4fb9-83eb-eb15a17eee6e None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:05:03.247468 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fc9e71-135e-4fb9-83eb-eb15a17eee6e None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:05:03.249336 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 719/1426] 127.0.0.1 () {54 vars in 901 bytes} [Sat Jul 23 21:05:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:05:03.256904 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128a0faa-8515-40be-88e0-2c34f7171d13 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:05:03.257432 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128a0faa-8515-40be-88e0-2c34f7171d13 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:05:03.257524 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128a0faa-8515-40be-88e0-2c34f7171d13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:05:03.352105 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-128a0faa-8515-40be-88e0-2c34f7171d13 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:05:03.353341 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-128a0faa-8515-40be-88e0-2c34f7171d13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:05:03.481888 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 708/1427] 127.0.0.1 () {58 vars in 998 bytes} [Sat Jul 23 21:05:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:05:03.654876 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fc9e71-135e-4fb9-83eb-eb15a17eee6e None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:05:03.656552 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-f6fc9e71-135e-4fb9-83eb-eb15a17eee6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:05:03.759607 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:05:03.832451 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fc9e71-135e-4fb9-83eb-eb15a17eee6e None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:05:03.965909 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ae5475-919a-4cfd-8db1-ee1103b1de03 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:05:03.966466 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ae5475-919a-4cfd-8db1-ee1103b1de03 service nova] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:05:03.966744 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ae5475-919a-4cfd-8db1-ee1103b1de03 service nova] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:05:03.967002 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ae5475-919a-4cfd-8db1-ee1103b1de03 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:05:03.968702 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-f5ae5475-919a-4cfd-8db1-ee1103b1de03 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:05:04.043664 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:05:04.090448 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ae5475-919a-4cfd-8db1-ee1103b1de03 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:05:04.092079 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ae5475-919a-4cfd-8db1-ee1103b1de03 service nova] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:05:04.110941 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 720/1428] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:05:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:05:04.933677 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41e1119-a6eb-47a7-a381-92f40d27f5fd None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:05:04.934305 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41e1119-a6eb-47a7-a381-92f40d27f5fd None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:05:04.934305 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41e1119-a6eb-47a7-a381-92f40d27f5fd None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:05:04.935695 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 709/1429] 127.0.0.1 () {54 vars in 901 bytes} [Sat Jul 23 21:05:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:05:04.941221 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2577586c-d077-4336-b45a-0de69892c5af None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:05:04.941683 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2577586c-d077-4336-b45a-0de69892c5af None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:05:04.941797 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2577586c-d077-4336-b45a-0de69892c5af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:05:05.021139 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-2577586c-d077-4336-b45a-0de69892c5af None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:05:05.022389 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-2577586c-d077-4336-b45a-0de69892c5af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:05:05.129349 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 721/1430] 127.0.0.1 () {58 vars in 998 bytes} [Sat Jul 23 21:05:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:05:05.290549 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41e1119-a6eb-47a7-a381-92f40d27f5fd None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:05:05.292252 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-b41e1119-a6eb-47a7-a381-92f40d27f5fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:05:05.349033 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:05:05.456391 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41e1119-a6eb-47a7-a381-92f40d27f5fd None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:05:05.583530 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728db8ff-074b-42a6-8249-76644a3090ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:05:05.584397 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728db8ff-074b-42a6-8249-76644a3090ca service nova] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:05:05.584678 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728db8ff-074b-42a6-8249-76644a3090ca service nova] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:05:05.584950 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728db8ff-074b-42a6-8249-76644a3090ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:05:05.586710 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-728db8ff-074b-42a6-8249-76644a3090ca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:05:05.594184 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:05:05.680721 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728db8ff-074b-42a6-8249-76644a3090ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:05:05.682386 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728db8ff-074b-42a6-8249-76644a3090ca service nova] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:05:05.701044 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 710/1431] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:05:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:05:06.556425 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b285b9-85d2-43ef-80c1-306e5e4a1653 None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:05:06.556974 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b285b9-85d2-43ef-80c1-306e5e4a1653 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:05:06.556974 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b285b9-85d2-43ef-80c1-306e5e4a1653 None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:05:06.558380 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 722/1432] 127.0.0.1 () {54 vars in 901 bytes} [Sat Jul 23 21:05:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:05:06.564333 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5364777b-a517-4760-920d-a169982fc102 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:05:06.564878 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5364777b-a517-4760-920d-a169982fc102 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:05:06.564878 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5364777b-a517-4760-920d-a169982fc102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:05:06.643751 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-5364777b-a517-4760-920d-a169982fc102 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:05:06.644988 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-5364777b-a517-4760-920d-a169982fc102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:05:06.716488 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:05:06.746537 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 711/1433] 127.0.0.1 () {58 vars in 998 bytes} [Sat Jul 23 21:05:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:05:06.916246 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b285b9-85d2-43ef-80c1-306e5e4a1653 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:05:06.917819 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-76b285b9-85d2-43ef-80c1-306e5e4a1653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:05:06.937613 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:05:07.098079 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b285b9-85d2-43ef-80c1-306e5e4a1653 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:05:07.205048 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:05:07.234541 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38de6fdd-d04b-4c08-82ca-743a0a5cf644 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:05:07.235191 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38de6fdd-d04b-4c08-82ca-743a0a5cf644 service nova] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:05:07.235464 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38de6fdd-d04b-4c08-82ca-743a0a5cf644 service nova] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:05:07.235718 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38de6fdd-d04b-4c08-82ca-743a0a5cf644 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:05:07.237383 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-38de6fdd-d04b-4c08-82ca-743a0a5cf644 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:05:07.348355 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38de6fdd-d04b-4c08-82ca-743a0a5cf644 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:05:07.349856 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38de6fdd-d04b-4c08-82ca-743a0a5cf644 service nova] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:05:07.369944 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 723/1434] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:05:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:05:08.203454 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ea8d86-7026-45b0-9fff-872d8f44bdf0 None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:05:08.204316 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ea8d86-7026-45b0-9fff-872d8f44bdf0 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:05:08.204316 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ea8d86-7026-45b0-9fff-872d8f44bdf0 None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:05:08.206606 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 712/1435] 127.0.0.1 () {54 vars in 901 bytes} [Sat Jul 23 21:05:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:05:08.215170 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009a9e1e-a372-480d-824e-e4e0f0c2fa61 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:05:08.215885 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009a9e1e-a372-480d-824e-e4e0f0c2fa61 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:05:08.216088 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009a9e1e-a372-480d-824e-e4e0f0c2fa61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:05:08.299262 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-009a9e1e-a372-480d-824e-e4e0f0c2fa61 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:05:08.300507 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-009a9e1e-a372-480d-824e-e4e0f0c2fa61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:05:08.346843 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:05:08.416179 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 724/1436] 127.0.0.1 () {58 vars in 998 bytes} [Sat Jul 23 21:05:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:05:08.578965 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ea8d86-7026-45b0-9fff-872d8f44bdf0 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:05:08.580552 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-19ea8d86-7026-45b0-9fff-872d8f44bdf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:05:08.750979 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ea8d86-7026-45b0-9fff-872d8f44bdf0 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:05:08.821370 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:05:08.884420 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07903b80-fc7f-4c9b-9cd1-ef69849a2fdb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:05:08.884979 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07903b80-fc7f-4c9b-9cd1-ef69849a2fdb service nova] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:05:08.885277 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07903b80-fc7f-4c9b-9cd1-ef69849a2fdb service nova] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:05:08.885547 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07903b80-fc7f-4c9b-9cd1-ef69849a2fdb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:05:08.887250 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-07903b80-fc7f-4c9b-9cd1-ef69849a2fdb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:05:08.985748 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07903b80-fc7f-4c9b-9cd1-ef69849a2fdb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:05:08.987457 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07903b80-fc7f-4c9b-9cd1-ef69849a2fdb service nova] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:05:09.006849 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 713/1437] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:05:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:05:09.873419 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafb13ae-4504-4569-b938-19d683d923d8 None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:05:09.874057 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafb13ae-4504-4569-b938-19d683d923d8 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:05:09.874057 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafb13ae-4504-4569-b938-19d683d923d8 None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:05:09.875560 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 725/1438] 127.0.0.1 () {54 vars in 901 bytes} [Sat Jul 23 21:05:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:05:09.881838 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7810e135-3dab-4958-92e3-3beaaf961893 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:05:09.882412 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7810e135-3dab-4958-92e3-3beaaf961893 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:05:09.882412 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7810e135-3dab-4958-92e3-3beaaf961893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:05:09.965574 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-7810e135-3dab-4958-92e3-3beaaf961893 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:05:09.966809 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-7810e135-3dab-4958-92e3-3beaaf961893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:05:09.969186 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:05:10.073597 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 714/1439] 127.0.0.1 () {58 vars in 998 bytes} [Sat Jul 23 21:05:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:05:10.235681 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafb13ae-4504-4569-b938-19d683d923d8 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:05:10.237551 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-dafb13ae-4504-4569-b938-19d683d923d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:05:10.409204 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafb13ae-4504-4569-b938-19d683d923d8 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:05:10.439506 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:05:10.545800 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdba97d-18ec-42de-aaf1-2ff2fdaf9094 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:05:10.546562 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdba97d-18ec-42de-aaf1-2ff2fdaf9094 service nova] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:05:10.546869 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdba97d-18ec-42de-aaf1-2ff2fdaf9094 service nova] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:05:10.547234 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdba97d-18ec-42de-aaf1-2ff2fdaf9094 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:05:10.549720 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-afdba97d-18ec-42de-aaf1-2ff2fdaf9094 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:05:10.659103 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdba97d-18ec-42de-aaf1-2ff2fdaf9094 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:05:10.661375 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdba97d-18ec-42de-aaf1-2ff2fdaf9094 service nova] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:05:10.683173 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 726/1440] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:05:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 23 21:05:12.928183 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27a3441-33e5-4f39-805e-1c7fcfc684a7 None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:05:12.928859 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27a3441-33e5-4f39-805e-1c7fcfc684a7 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:05:12.928859 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27a3441-33e5-4f39-805e-1c7fcfc684a7 None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:05:12.930295 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 715/1441] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jul 23 21:05:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:05:12.936017 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f70ee1-a26e-4d6b-906c-906381d88553 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:05:12.936513 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f70ee1-a26e-4d6b-906c-906381d88553 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:05:12.936513 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f70ee1-a26e-4d6b-906c-906381d88553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:05:12.982384 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:05:13.017649 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-a6f70ee1-a26e-4d6b-906c-906381d88553 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:05:13.018997 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-a6f70ee1-a26e-4d6b-906c-906381d88553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:05:13.120289 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 727/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jul 23 21:05:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:05:13.167192 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27a3441-33e5-4f39-805e-1c7fcfc684a7 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:05:13.168748 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-f27a3441-33e5-4f39-805e-1c7fcfc684a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:05:13.280763 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27a3441-33e5-4f39-805e-1c7fcfc684a7 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:05:13.314658 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:05:13.367069 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84215632-113e-461e-90d7-6a3694d459b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:05:13.367732 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84215632-113e-461e-90d7-6a3694d459b5 service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:05:13.368016 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84215632-113e-461e-90d7-6a3694d459b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:05:13.368296 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84215632-113e-461e-90d7-6a3694d459b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:05:13.370024 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-84215632-113e-461e-90d7-6a3694d459b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:05:13.506045 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84215632-113e-461e-90d7-6a3694d459b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:05:13.507525 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84215632-113e-461e-90d7-6a3694d459b5 service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:05:13.529063 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 716/1443] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:05:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 23 21:05:15.987426 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdc88f2-61d7-49f1-852f-f6305391e13e None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:05:15.988050 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdc88f2-61d7-49f1-852f-f6305391e13e None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:05:15.988050 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdc88f2-61d7-49f1-852f-f6305391e13e None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:05:15.989856 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 728/1444] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jul 23 21:05:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:05:15.995624 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa19848-5a11-4c40-93a3-e24fa32ec2a4 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:05:15.996072 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa19848-5a11-4c40-93a3-e24fa32ec2a4 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:05:15.996175 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa19848-5a11-4c40-93a3-e24fa32ec2a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:05:16.062760 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-dfa19848-5a11-4c40-93a3-e24fa32ec2a4 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:05:16.063982 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-dfa19848-5a11-4c40-93a3-e24fa32ec2a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:05:16.077287 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:05:16.188019 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 717/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jul 23 21:05:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:05:16.236411 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdc88f2-61d7-49f1-852f-f6305391e13e None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:05:16.238604 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-bcdc88f2-61d7-49f1-852f-f6305391e13e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:05:16.360577 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdc88f2-61d7-49f1-852f-f6305391e13e None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:05:16.372939 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:05:16.441476 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6435bfc-0234-4fdc-8277-f26b32bba6fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:05:16.442210 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6435bfc-0234-4fdc-8277-f26b32bba6fd service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:05:16.442545 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6435bfc-0234-4fdc-8277-f26b32bba6fd service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:05:16.442815 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6435bfc-0234-4fdc-8277-f26b32bba6fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:05:16.444578 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-f6435bfc-0234-4fdc-8277-f26b32bba6fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:05:16.704497 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6435bfc-0234-4fdc-8277-f26b32bba6fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:05:16.706133 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6435bfc-0234-4fdc-8277-f26b32bba6fd service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:05:16.726429 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 729/1446] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:05:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:05:19.478377 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77583b89-8927-47d0-96d9-68f781cd6bc4 None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:05:19.479000 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77583b89-8927-47d0-96d9-68f781cd6bc4 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:05:19.479000 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77583b89-8927-47d0-96d9-68f781cd6bc4 None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:05:19.480310 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 718/1447] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jul 23 21:05:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:05:19.486307 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ef0f1f-2caf-4eed-8b0c-7065b2254a51 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:05:19.486863 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ef0f1f-2caf-4eed-8b0c-7065b2254a51 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:05:19.487011 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ef0f1f-2caf-4eed-8b0c-7065b2254a51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:05:19.552358 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:05:19.575258 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-c2ef0f1f-2caf-4eed-8b0c-7065b2254a51 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:05:19.576526 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-c2ef0f1f-2caf-4eed-8b0c-7065b2254a51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:05:19.700988 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 730/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jul 23 21:05:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:05:19.742631 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77583b89-8927-47d0-96d9-68f781cd6bc4 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:05:19.744188 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-77583b89-8927-47d0-96d9-68f781cd6bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:05:19.876093 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77583b89-8927-47d0-96d9-68f781cd6bc4 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:05:19.920224 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:05:19.966058 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c43ece-0627-42ef-8d47-bff400343d6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:05:19.966789 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c43ece-0627-42ef-8d47-bff400343d6b service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:05:19.967079 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c43ece-0627-42ef-8d47-bff400343d6b service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:05:19.967380 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c43ece-0627-42ef-8d47-bff400343d6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:05:19.969409 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-58c43ece-0627-42ef-8d47-bff400343d6b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:05:20.094440 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c43ece-0627-42ef-8d47-bff400343d6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:05:20.095911 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c43ece-0627-42ef-8d47-bff400343d6b service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:05:20.116054 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 719/1449] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:05:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:05:22.570895 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389407ab-e375-43b8-a8f6-f50e363f0ef6 None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:05:22.571497 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389407ab-e375-43b8-a8f6-f50e363f0ef6 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:05:22.571497 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389407ab-e375-43b8-a8f6-f50e363f0ef6 None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:05:22.572712 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 731/1450] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jul 23 21:05:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:05:22.578860 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953d795b-c1d3-47d8-a921-9236b80c0384 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:05:22.579443 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953d795b-c1d3-47d8-a921-9236b80c0384 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:05:22.579443 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953d795b-c1d3-47d8-a921-9236b80c0384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:05:22.649280 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-953d795b-c1d3-47d8-a921-9236b80c0384 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:05:22.650538 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-953d795b-c1d3-47d8-a921-9236b80c0384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:05:22.677413 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:05:22.767308 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 720/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jul 23 21:05:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:05:22.813556 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389407ab-e375-43b8-a8f6-f50e363f0ef6 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:05:22.815187 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-389407ab-e375-43b8-a8f6-f50e363f0ef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:05:22.937345 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389407ab-e375-43b8-a8f6-f50e363f0ef6 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:05:22.966385 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:05:23.045678 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206f4af3-282b-4153-a1d5-de29cb293cc4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:05:23.046373 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206f4af3-282b-4153-a1d5-de29cb293cc4 service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:05:23.046652 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206f4af3-282b-4153-a1d5-de29cb293cc4 service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:05:23.046918 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206f4af3-282b-4153-a1d5-de29cb293cc4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:05:23.048647 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-206f4af3-282b-4153-a1d5-de29cb293cc4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:05:23.167154 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206f4af3-282b-4153-a1d5-de29cb293cc4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:05:23.168495 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206f4af3-282b-4153-a1d5-de29cb293cc4 service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:05:23.189632 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 732/1452] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:05:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:05:25.638846 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19093eaa-c068-480a-a6fa-ef8fa25ed669 None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:05:25.639471 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19093eaa-c068-480a-a6fa-ef8fa25ed669 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:05:25.639471 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19093eaa-c068-480a-a6fa-ef8fa25ed669 None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:05:25.641214 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 721/1453] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jul 23 21:05:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:05:25.646980 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37fdb71-a6b4-442b-8827-34e1e4819a54 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:05:25.647466 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37fdb71-a6b4-442b-8827-34e1e4819a54 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:05:25.647579 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37fdb71-a6b4-442b-8827-34e1e4819a54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:05:25.712496 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:05:25.715289 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-e37fdb71-a6b4-442b-8827-34e1e4819a54 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:05:25.717126 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-e37fdb71-a6b4-442b-8827-34e1e4819a54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:05:25.844646 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 733/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jul 23 21:05:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:05:25.886829 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19093eaa-c068-480a-a6fa-ef8fa25ed669 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:05:25.888878 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-19093eaa-c068-480a-a6fa-ef8fa25ed669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:05:26.021174 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19093eaa-c068-480a-a6fa-ef8fa25ed669 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:05:26.075531 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:05:26.101999 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dc4839-241c-4e34-8d8d-3e1b7d816b9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:05:26.102659 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dc4839-241c-4e34-8d8d-3e1b7d816b9c service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:05:26.102971 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dc4839-241c-4e34-8d8d-3e1b7d816b9c service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:05:26.103246 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dc4839-241c-4e34-8d8d-3e1b7d816b9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:05:26.104906 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-99dc4839-241c-4e34-8d8d-3e1b7d816b9c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:05:26.234314 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dc4839-241c-4e34-8d8d-3e1b7d816b9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:05:26.235843 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dc4839-241c-4e34-8d8d-3e1b7d816b9c service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:05:26.257553 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 722/1455] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:05:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:05:28.780924 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06425f65-0399-4fff-95e7-3c4b7d46b17b None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:05:28.781479 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06425f65-0399-4fff-95e7-3c4b7d46b17b None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:05:28.781479 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06425f65-0399-4fff-95e7-3c4b7d46b17b None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:05:28.783464 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 734/1456] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jul 23 21:05:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:05:28.790261 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8740d77a-b2cb-4d52-a0a2-5feb09f2b03c None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:05:28.791001 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8740d77a-b2cb-4d52-a0a2-5feb09f2b03c None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:05:28.791001 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8740d77a-b2cb-4d52-a0a2-5feb09f2b03c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:05:28.867981 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-8740d77a-b2cb-4d52-a0a2-5feb09f2b03c None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:05:28.869219 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-8740d77a-b2cb-4d52-a0a2-5feb09f2b03c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:05:28.900620 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:05:28.969962 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 723/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jul 23 21:05:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:05:29.026050 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06425f65-0399-4fff-95e7-3c4b7d46b17b None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:05:29.027992 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-06425f65-0399-4fff-95e7-3c4b7d46b17b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:05:29.136899 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06425f65-0399-4fff-95e7-3c4b7d46b17b None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:05:29.173827 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:05:29.221241 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79982eea-b2e7-47ac-996f-78aac6928ebf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:05:29.221979 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79982eea-b2e7-47ac-996f-78aac6928ebf service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:05:29.222258 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79982eea-b2e7-47ac-996f-78aac6928ebf service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:05:29.222527 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79982eea-b2e7-47ac-996f-78aac6928ebf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:05:29.224318 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-79982eea-b2e7-47ac-996f-78aac6928ebf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:05:29.345373 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79982eea-b2e7-47ac-996f-78aac6928ebf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:05:29.346929 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79982eea-b2e7-47ac-996f-78aac6928ebf service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:05:29.369225 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 735/1458] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:05:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:05:31.686325 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb61c700-3f32-4672-9e90-5a500ab4f96c None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:05:31.686929 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb61c700-3f32-4672-9e90-5a500ab4f96c None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:05:31.686929 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb61c700-3f32-4672-9e90-5a500ab4f96c None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:05:31.688244 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 724/1459] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jul 23 21:05:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:05:31.693720 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32792139-ab72-4d75-87d7-c1c3cc162b76 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:05:31.694171 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32792139-ab72-4d75-87d7-c1c3cc162b76 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:05:31.694320 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32792139-ab72-4d75-87d7-c1c3cc162b76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:05:31.766238 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-32792139-ab72-4d75-87d7-c1c3cc162b76 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:05:31.767465 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-32792139-ab72-4d75-87d7-c1c3cc162b76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:05:31.777420 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:05:31.882088 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 736/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jul 23 21:05:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:05:31.928497 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb61c700-3f32-4672-9e90-5a500ab4f96c None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:05:31.930963 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-fb61c700-3f32-4672-9e90-5a500ab4f96c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:05:32.049887 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb61c700-3f32-4672-9e90-5a500ab4f96c None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:05:32.108231 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:05:32.135291 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3b521b-2aa1-48a3-8aa6-9df25f937e9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:05:32.135960 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3b521b-2aa1-48a3-8aa6-9df25f937e9f service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:05:32.136245 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3b521b-2aa1-48a3-8aa6-9df25f937e9f service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:05:32.136521 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3b521b-2aa1-48a3-8aa6-9df25f937e9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:05:32.138230 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-8d3b521b-2aa1-48a3-8aa6-9df25f937e9f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:05:32.275749 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3b521b-2aa1-48a3-8aa6-9df25f937e9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:05:32.277277 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3b521b-2aa1-48a3-8aa6-9df25f937e9f service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:05:32.297589 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 725/1461] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:05:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:05:34.620352 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a719c25b-0a01-429d-8c49-0d50fa8e495e None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:05:34.620907 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a719c25b-0a01-429d-8c49-0d50fa8e495e None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:05:34.620907 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a719c25b-0a01-429d-8c49-0d50fa8e495e None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:05:34.622692 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 737/1462] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jul 23 21:05:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:05:34.629709 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5824383d-5ce3-4212-b81e-5a7de11e3948 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:05:34.630554 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5824383d-5ce3-4212-b81e-5a7de11e3948 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:05:34.630554 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5824383d-5ce3-4212-b81e-5a7de11e3948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:05:34.710442 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-5824383d-5ce3-4212-b81e-5a7de11e3948 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:05:34.711667 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-5824383d-5ce3-4212-b81e-5a7de11e3948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:05:34.757271 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:05:34.824177 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 726/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jul 23 21:05:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:05:34.874219 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a719c25b-0a01-429d-8c49-0d50fa8e495e None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:05:34.875769 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-a719c25b-0a01-429d-8c49-0d50fa8e495e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:05:34.999386 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a719c25b-0a01-429d-8c49-0d50fa8e495e None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:05:35.038181 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:05:35.075368 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f190b7-3fea-4f39-8be6-92c3ce1fed54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:05:35.076028 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f190b7-3fea-4f39-8be6-92c3ce1fed54 service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:05:35.076305 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f190b7-3fea-4f39-8be6-92c3ce1fed54 service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:05:35.076582 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f190b7-3fea-4f39-8be6-92c3ce1fed54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:05:35.078275 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-48f190b7-3fea-4f39-8be6-92c3ce1fed54 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:05:35.194035 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f190b7-3fea-4f39-8be6-92c3ce1fed54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:05:35.195410 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f190b7-3fea-4f39-8be6-92c3ce1fed54 service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:05:35.214771 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 738/1464] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:05:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:05:37.555624 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381d43c8-11bc-430e-a4a3-885b6deb0c24 None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:05:37.556541 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381d43c8-11bc-430e-a4a3-885b6deb0c24 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:05:37.556541 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381d43c8-11bc-430e-a4a3-885b6deb0c24 None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:05:37.557816 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 727/1465] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jul 23 21:05:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:05:37.565355 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9846e52b-540a-46a1-876c-1808d1e18699 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:05:37.565808 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9846e52b-540a-46a1-876c-1808d1e18699 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:05:37.566399 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9846e52b-540a-46a1-876c-1808d1e18699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:05:37.639072 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-9846e52b-540a-46a1-876c-1808d1e18699 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:05:37.640636 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-9846e52b-540a-46a1-876c-1808d1e18699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:05:37.661418 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:05:37.755587 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 739/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jul 23 21:05:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:05:37.803122 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381d43c8-11bc-430e-a4a3-885b6deb0c24 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:05:37.804713 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-381d43c8-11bc-430e-a4a3-885b6deb0c24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:05:37.919271 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381d43c8-11bc-430e-a4a3-885b6deb0c24 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:05:37.998818 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:05:38.008230 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd01a6d6-8ad5-4f24-8591-4b35b4e7c825 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:05:38.009022 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd01a6d6-8ad5-4f24-8591-4b35b4e7c825 service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:05:38.009261 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd01a6d6-8ad5-4f24-8591-4b35b4e7c825 service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:05:38.009633 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd01a6d6-8ad5-4f24-8591-4b35b4e7c825 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:05:38.012176 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-cd01a6d6-8ad5-4f24-8591-4b35b4e7c825 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:05:38.143210 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd01a6d6-8ad5-4f24-8591-4b35b4e7c825 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:05:38.144663 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd01a6d6-8ad5-4f24-8591-4b35b4e7c825 service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:05:38.168643 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 728/1467] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:05:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:05:40.610366 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc4b051-9bff-411f-b0e7-dec41e334fc4 None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:05:40.611011 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc4b051-9bff-411f-b0e7-dec41e334fc4 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:05:40.611011 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc4b051-9bff-411f-b0e7-dec41e334fc4 None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:05:40.612626 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 740/1468] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jul 23 21:05:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:05:40.619200 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcacdb1-6c35-43f3-9b2f-6a3eac0b78fb None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:05:40.619688 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcacdb1-6c35-43f3-9b2f-6a3eac0b78fb None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:05:40.619798 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcacdb1-6c35-43f3-9b2f-6a3eac0b78fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:05:40.688849 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-8bcacdb1-6c35-43f3-9b2f-6a3eac0b78fb None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:05:40.690105 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-8bcacdb1-6c35-43f3-9b2f-6a3eac0b78fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:05:40.741434 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:05:40.801450 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 729/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jul 23 21:05:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:05:40.844045 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc4b051-9bff-411f-b0e7-dec41e334fc4 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:05:40.845603 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-6cc4b051-9bff-411f-b0e7-dec41e334fc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:05:40.954805 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc4b051-9bff-411f-b0e7-dec41e334fc4 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:05:41.004921 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:05:41.031577 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b07e79-3ddc-4c2b-a323-f1627dff1971 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:05:41.032229 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b07e79-3ddc-4c2b-a323-f1627dff1971 service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:05:41.032502 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b07e79-3ddc-4c2b-a323-f1627dff1971 service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:05:41.032766 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b07e79-3ddc-4c2b-a323-f1627dff1971 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:05:41.034423 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-71b07e79-3ddc-4c2b-a323-f1627dff1971 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:05:41.151284 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b07e79-3ddc-4c2b-a323-f1627dff1971 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:05:41.152743 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b07e79-3ddc-4c2b-a323-f1627dff1971 service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:05:41.170987 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 741/1470] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:05:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:05:50.799017 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=22 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:05:51.168807 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=66 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:06:05.119065 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edaeef6-b558-469d-b1f2-193078af1ee7 None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:06:05.119685 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edaeef6-b558-469d-b1f2-193078af1ee7 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:06:05.119685 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edaeef6-b558-469d-b1f2-193078af1ee7 None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:06:05.120903 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 730/1471] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 21:06:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:06:05.127684 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928ff351-c4ef-4888-b5b0-79bfb7e73de3 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:06:05.128472 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928ff351-c4ef-4888-b5b0-79bfb7e73de3 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:06:05.128633 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928ff351-c4ef-4888-b5b0-79bfb7e73de3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:06:05.204219 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-928ff351-c4ef-4888-b5b0-79bfb7e73de3 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:06:05.205517 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-928ff351-c4ef-4888-b5b0-79bfb7e73de3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:06:05.314683 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 742/1472] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 21:06:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:06:05.373070 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe9249f-5e25-42f6-aa9e-958c16737465 None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:06:05.373241 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe9249f-5e25-42f6-aa9e-958c16737465 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:06:05.373551 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe9249f-5e25-42f6-aa9e-958c16737465 None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:06:05.374978 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 731/1473] 10.222.0.17 () {54 vars in 966 bytes} [Sat Jul 23 21:06:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:06:05.380039 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3101e89-3a57-4000-b457-0b1400b5d334 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:06:05.380325 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3101e89-3a57-4000-b457-0b1400b5d334 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:06:05.380599 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3101e89-3a57-4000-b457-0b1400b5d334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:06:05.470858 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-f3101e89-3a57-4000-b457-0b1400b5d334 None None] MFA Rules not processed for user `f7f2db148c8e4d5d81431cae3576434b`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:06:05.472117 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-f3101e89-3a57-4000-b457-0b1400b5d334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:06:05.494282 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:06:05.555636 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 743/1474] 10.222.0.17 () {58 vars in 1063 bytes} [Sat Jul 23 21:06:05 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:06:05.563739 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe9249f-5e25-42f6-aa9e-958c16737465 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:06:05.565335 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-ebe9249f-5e25-42f6-aa9e-958c16737465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:06:05.676222 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe9249f-5e25-42f6-aa9e-958c16737465 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:06:05.755026 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78df95e4-b377-4e6b-919f-11ee66697893 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7f2db148c8e4d5d81431cae3576434b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:06:05.755689 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78df95e4-b377-4e6b-919f-11ee66697893 service glance] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:06:05.755970 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78df95e4-b377-4e6b-919f-11ee66697893 service glance] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:06:05.756247 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78df95e4-b377-4e6b-919f-11ee66697893 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:06:05.757900 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-78df95e4-b377-4e6b-919f-11ee66697893 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:06:05.818338 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:06:05.878725 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78df95e4-b377-4e6b-919f-11ee66697893 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:06:05.880182 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78df95e4-b377-4e6b-919f-11ee66697893 service glance] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:06:05.901026 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 732/1475] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:06:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:06:08.331170 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eec7738-7f51-4bcb-95a0-0d807a78262b None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:06:08.331786 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eec7738-7f51-4bcb-95a0-0d807a78262b None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:06:08.331786 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eec7738-7f51-4bcb-95a0-0d807a78262b None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:06:08.333117 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 744/1476] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 21:06:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:06:08.339029 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bd1bc7-b5d9-43ca-89fe-dcef70784bec None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:06:08.339478 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bd1bc7-b5d9-43ca-89fe-dcef70784bec None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:06:08.339725 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bd1bc7-b5d9-43ca-89fe-dcef70784bec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:06:08.415251 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-c1bd1bc7-b5d9-43ca-89fe-dcef70784bec None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:06:08.416514 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-c1bd1bc7-b5d9-43ca-89fe-dcef70784bec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:06:08.525586 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 733/1477] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 21:06:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:06:08.551685 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eec7738-7f51-4bcb-95a0-0d807a78262b None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:06:08.553232 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-9eec7738-7f51-4bcb-95a0-0d807a78262b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:06:08.699133 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eec7738-7f51-4bcb-95a0-0d807a78262b None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:06:08.751402 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:06:08.808118 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e052c609-7ddd-4a64-8e1e-341f09de10b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:06:08.808793 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e052c609-7ddd-4a64-8e1e-341f09de10b9 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:06:08.809065 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e052c609-7ddd-4a64-8e1e-341f09de10b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:06:08.809293 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e052c609-7ddd-4a64-8e1e-341f09de10b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:06:08.810193 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e052c609-7ddd-4a64-8e1e-341f09de10b9 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:06:08.812073 ncdv-master-1 devstack@keystone.service[91548]: WARNING py.warnings [None req-e052c609-7ddd-4a64-8e1e-341f09de10b9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:06:08.812073 ncdv-master-1 devstack@keystone.service[91548]: warnings.warn(msg) Jul 23 21:06:08.812073 ncdv-master-1 devstack@keystone.service[91548]: Jul 23 21:06:08.813225 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e052c609-7ddd-4a64-8e1e-341f09de10b9 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:06:08.835295 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 745/1478] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Jul 23 21:06:08 2022] GET /identity/v3/projects => generated 2553 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 21:06:11.186367 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a5ee81-31c0-4ed5-bbce-172cddfc6fc5 None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:06:11.187075 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a5ee81-31c0-4ed5-bbce-172cddfc6fc5 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:06:11.187075 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a5ee81-31c0-4ed5-bbce-172cddfc6fc5 None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:06:11.188275 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 734/1479] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 21:06:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:06:11.195148 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62a3886-d55a-4995-a246-ebf9f96def26 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:06:11.195643 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62a3886-d55a-4995-a246-ebf9f96def26 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:06:11.195749 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62a3886-d55a-4995-a246-ebf9f96def26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:06:11.268077 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-f62a3886-d55a-4995-a246-ebf9f96def26 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:06:11.269414 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-f62a3886-d55a-4995-a246-ebf9f96def26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:06:11.378884 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 746/1480] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 21:06:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:06:11.429555 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a5ee81-31c0-4ed5-bbce-172cddfc6fc5 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:06:11.431543 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-a3a5ee81-31c0-4ed5-bbce-172cddfc6fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:06:11.445024 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:06:11.599593 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a5ee81-31c0-4ed5-bbce-172cddfc6fc5 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:06:11.684666 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:06:11.720363 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f333bbd-ca18-4e72-9a11-47a57968a877 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:06:11.720939 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f333bbd-ca18-4e72-9a11-47a57968a877 service nova] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:06:11.721208 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f333bbd-ca18-4e72-9a11-47a57968a877 service nova] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:06:11.721473 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f333bbd-ca18-4e72-9a11-47a57968a877 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:06:11.723155 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-8f333bbd-ca18-4e72-9a11-47a57968a877 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:06:11.821823 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f333bbd-ca18-4e72-9a11-47a57968a877 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:06:11.823602 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f333bbd-ca18-4e72-9a11-47a57968a877 service nova] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:06:11.842145 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 735/1481] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:06:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:06:14.308387 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8634346f-7b7e-4157-bd8e-b11519325cfe None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:06:14.309034 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8634346f-7b7e-4157-bd8e-b11519325cfe None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:06:14.309034 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8634346f-7b7e-4157-bd8e-b11519325cfe None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:06:14.310323 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 747/1482] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 21:06:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:06:14.318158 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352f7980-5d32-487e-9d5e-b812ac213cce None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:06:14.318631 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352f7980-5d32-487e-9d5e-b812ac213cce None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:06:14.318740 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352f7980-5d32-487e-9d5e-b812ac213cce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:06:14.390619 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-352f7980-5d32-487e-9d5e-b812ac213cce None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:06:14.391830 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-352f7980-5d32-487e-9d5e-b812ac213cce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:06:14.448202 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:06:14.501734 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 736/1483] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 21:06:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:06:14.540967 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8634346f-7b7e-4157-bd8e-b11519325cfe None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:06:14.542585 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-8634346f-7b7e-4157-bd8e-b11519325cfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:06:14.565942 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:06:14.673501 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8634346f-7b7e-4157-bd8e-b11519325cfe None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:06:14.752479 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783c9587-ec77-4dd2-b4ad-fb874eed4268 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:06:14.753167 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783c9587-ec77-4dd2-b4ad-fb874eed4268 service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:06:14.753458 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783c9587-ec77-4dd2-b4ad-fb874eed4268 service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:06:14.753719 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783c9587-ec77-4dd2-b4ad-fb874eed4268 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:06:14.755398 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-783c9587-ec77-4dd2-b4ad-fb874eed4268 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:06:14.839723 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:06:14.879924 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783c9587-ec77-4dd2-b4ad-fb874eed4268 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:06:14.881371 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783c9587-ec77-4dd2-b4ad-fb874eed4268 service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:06:14.901163 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 748/1484] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:06:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:06:17.266680 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a055144-5d13-4dbb-9352-c5b91e5ed8b8 None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:06:17.267311 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a055144-5d13-4dbb-9352-c5b91e5ed8b8 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:06:17.267311 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a055144-5d13-4dbb-9352-c5b91e5ed8b8 None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:06:17.268899 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 737/1485] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 21:06:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:06:17.275096 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1f1b5b-33d0-486b-a18e-81c36dcc3697 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:06:17.275586 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1f1b5b-33d0-486b-a18e-81c36dcc3697 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:06:17.275679 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1f1b5b-33d0-486b-a18e-81c36dcc3697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:06:17.349224 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-1a1f1b5b-33d0-486b-a18e-81c36dcc3697 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:06:17.350506 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-1a1f1b5b-33d0-486b-a18e-81c36dcc3697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:06:17.470731 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 749/1486] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 21:06:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:06:17.511676 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a055144-5d13-4dbb-9352-c5b91e5ed8b8 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:06:17.513740 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-2a055144-5d13-4dbb-9352-c5b91e5ed8b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:06:17.627525 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a055144-5d13-4dbb-9352-c5b91e5ed8b8 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:06:17.715973 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:06:17.718422 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdc4b5d-a763-4df2-b014-d7eb0eb1ad62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:06:17.719196 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdc4b5d-a763-4df2-b014-d7eb0eb1ad62 service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:06:17.719866 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdc4b5d-a763-4df2-b014-d7eb0eb1ad62 service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:06:17.720159 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdc4b5d-a763-4df2-b014-d7eb0eb1ad62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:06:17.722117 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-8cdc4b5d-a763-4df2-b014-d7eb0eb1ad62 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:06:17.858309 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdc4b5d-a763-4df2-b014-d7eb0eb1ad62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:06:17.859783 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdc4b5d-a763-4df2-b014-d7eb0eb1ad62 service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:06:17.879821 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 738/1487] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:06:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:06:20.321035 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46dd214-61ff-4367-98e3-147145e88d08 None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:06:20.321617 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46dd214-61ff-4367-98e3-147145e88d08 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:06:20.321617 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46dd214-61ff-4367-98e3-147145e88d08 None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:06:20.322973 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 750/1488] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 21:06:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:06:20.328678 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb90a80-9af5-4947-869a-0b8b71040426 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:06:20.329225 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb90a80-9af5-4947-869a-0b8b71040426 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:06:20.329225 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb90a80-9af5-4947-869a-0b8b71040426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:06:20.409274 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-7cb90a80-9af5-4947-869a-0b8b71040426 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:06:20.410556 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-7cb90a80-9af5-4947-869a-0b8b71040426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:06:20.470150 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:06:20.517710 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 739/1489] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 21:06:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:06:20.561568 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46dd214-61ff-4367-98e3-147145e88d08 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:06:20.563202 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-f46dd214-61ff-4367-98e3-147145e88d08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:06:20.601667 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:06:20.682003 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46dd214-61ff-4367-98e3-147145e88d08 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:06:20.762810 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530edab9-c3f2-46c9-a115-83fdd303f79a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:06:20.763484 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530edab9-c3f2-46c9-a115-83fdd303f79a service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:06:20.763762 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530edab9-c3f2-46c9-a115-83fdd303f79a service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:06:20.764025 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530edab9-c3f2-46c9-a115-83fdd303f79a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:06:20.765742 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-530edab9-c3f2-46c9-a115-83fdd303f79a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:06:20.862711 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:06:20.894279 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530edab9-c3f2-46c9-a115-83fdd303f79a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:06:20.895958 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530edab9-c3f2-46c9-a115-83fdd303f79a service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:06:20.916042 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 751/1490] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:06:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:06:23.438103 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1348e295-4080-4db9-9f30-94f5c22ede6e None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:06:23.438673 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1348e295-4080-4db9-9f30-94f5c22ede6e None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:06:23.438673 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1348e295-4080-4db9-9f30-94f5c22ede6e None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:06:23.440115 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 740/1491] 10.222.0.17 () {54 vars in 926 bytes} [Sat Jul 23 21:06:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:06:23.446021 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d47302b-1dc9-494b-b579-cc6791e6687c None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:06:23.446528 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d47302b-1dc9-494b-b579-cc6791e6687c None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:06:23.446659 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d47302b-1dc9-494b-b579-cc6791e6687c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:06:23.540438 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-0d47302b-1dc9-494b-b579-cc6791e6687c None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:06:23.541955 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-0d47302b-1dc9-494b-b579-cc6791e6687c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:06:23.656448 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 752/1492] 10.222.0.17 () {58 vars in 1023 bytes} [Sat Jul 23 21:06:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:06:23.708594 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1348e295-4080-4db9-9f30-94f5c22ede6e None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:06:23.710147 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-1348e295-4080-4db9-9f30-94f5c22ede6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:06:23.827128 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1348e295-4080-4db9-9f30-94f5c22ede6e None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:06:23.931912 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7a2eb2-1e61-4f76-8726-b7f04ab884d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:06:23.933668 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7a2eb2-1e61-4f76-8726-b7f04ab884d0 service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:06:23.934423 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7a2eb2-1e61-4f76-8726-b7f04ab884d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:06:23.934962 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7a2eb2-1e61-4f76-8726-b7f04ab884d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:06:23.941080 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-6e7a2eb2-1e61-4f76-8726-b7f04ab884d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:06:23.969306 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:06:24.116126 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7a2eb2-1e61-4f76-8726-b7f04ab884d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:06:24.117517 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7a2eb2-1e61-4f76-8726-b7f04ab884d0 service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:06:24.139890 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 741/1493] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:06:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 23 21:06:33.654588 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=82 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:06:34.137216 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=50 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:07:54.819125 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f34c2e-b29e-4903-bf9e-4cd1c8f0f19c None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:07:54.819629 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f34c2e-b29e-4903-bf9e-4cd1c8f0f19c None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:07:54.819739 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f34c2e-b29e-4903-bf9e-4cd1c8f0f19c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:07:54.905770 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-11f34c2e-b29e-4903-bf9e-4cd1c8f0f19c None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:07:54.907028 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-11f34c2e-b29e-4903-bf9e-4cd1c8f0f19c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:07:55.014036 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 753/1494] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:07:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:07:55.022705 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966c91e7-ea62-40e1-9fb7-696a97c1f9a6 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:07:55.023230 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966c91e7-ea62-40e1-9fb7-696a97c1f9a6 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:07:55.023230 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966c91e7-ea62-40e1-9fb7-696a97c1f9a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:07:55.102678 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-966c91e7-ea62-40e1-9fb7-696a97c1f9a6 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:07:55.103790 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-966c91e7-ea62-40e1-9fb7-696a97c1f9a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:07:55.208622 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 742/1495] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:07:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:07:55.213622 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f34c2e-b29e-4903-bf9e-4cd1c8f0f19c None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:07:55.215065 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-11f34c2e-b29e-4903-bf9e-4cd1c8f0f19c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:07:55.226794 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f34c2e-b29e-4903-bf9e-4cd1c8f0f19c None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:07:55.297674 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:07:55.333597 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234f5d51-fb9c-4b64-a1eb-475cf750a718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:07:55.334298 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234f5d51-fb9c-4b64-a1eb-475cf750a718 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:07:55.334574 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234f5d51-fb9c-4b64-a1eb-475cf750a718 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:07:55.334844 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234f5d51-fb9c-4b64-a1eb-475cf750a718 admin admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:07:55.335568 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234f5d51-fb9c-4b64-a1eb-475cf750a718 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:07:55.335866 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234f5d51-fb9c-4b64-a1eb-475cf750a718 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:07:55.336871 ncdv-master-1 devstack@keystone.service[91548]: WARNING py.warnings [None req-234f5d51-fb9c-4b64-a1eb-475cf750a718 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:07:55.336871 ncdv-master-1 devstack@keystone.service[91548]: warnings.warn(msg) Jul 23 21:07:55.336871 ncdv-master-1 devstack@keystone.service[91548]: Jul 23 21:07:55.337767 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234f5d51-fb9c-4b64-a1eb-475cf750a718 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:07:55.349222 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 754/1496] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:07:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:07:55.357878 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966c91e7-ea62-40e1-9fb7-696a97c1f9a6 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:07:55.367570 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966c91e7-ea62-40e1-9fb7-696a97c1f9a6 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:07:55.432953 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:07:55.469341 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461e0d27-3b65-476b-958d-1137e6a18670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:07:55.470049 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461e0d27-3b65-476b-958d-1137e6a18670 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:07:55.470330 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461e0d27-3b65-476b-958d-1137e6a18670 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:07:55.470597 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461e0d27-3b65-476b-958d-1137e6a18670 admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:07:55.471279 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461e0d27-3b65-476b-958d-1137e6a18670 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:07:55.473091 ncdv-master-1 devstack@keystone.service[91547]: WARNING py.warnings [None req-461e0d27-3b65-476b-958d-1137e6a18670 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:07:55.473091 ncdv-master-1 devstack@keystone.service[91547]: warnings.warn(msg) Jul 23 21:07:55.473091 ncdv-master-1 devstack@keystone.service[91547]: Jul 23 21:07:55.474331 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461e0d27-3b65-476b-958d-1137e6a18670 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:07:55.662684 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 743/1497] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:07:55 2022] POST /identity/v3/projects => generated 379 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:07:55.667053 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234f5d51-fb9c-4b64-a1eb-475cf750a718 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:07:55.668585 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-234f5d51-fb9c-4b64-a1eb-475cf750a718 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:07:55.702838 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234f5d51-fb9c-4b64-a1eb-475cf750a718 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:07:55.802700 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93781f0-1da4-408d-9293-541abd653caa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:07:55.803371 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93781f0-1da4-408d-9293-541abd653caa admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:07:55.803647 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93781f0-1da4-408d-9293-541abd653caa admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:07:55.803912 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93781f0-1da4-408d-9293-541abd653caa admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:07:55.804619 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93781f0-1da4-408d-9293-541abd653caa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:07:55.805618 ncdv-master-1 devstack@keystone.service[91548]: WARNING py.warnings [None req-c93781f0-1da4-408d-9293-541abd653caa admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:07:55.805618 ncdv-master-1 devstack@keystone.service[91548]: warnings.warn(msg) Jul 23 21:07:55.805618 ncdv-master-1 devstack@keystone.service[91548]: Jul 23 21:07:55.806868 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93781f0-1da4-408d-9293-541abd653caa admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:07:55.850927 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 755/1498] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:07:55 2022] POST /identity/v3/users => generated 290 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:07:55.855152 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461e0d27-3b65-476b-958d-1137e6a18670 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:07:55.856815 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-461e0d27-3b65-476b-958d-1137e6a18670 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:07:55.925622 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461e0d27-3b65-476b-958d-1137e6a18670 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:07:56.011006 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:07:56.023503 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e99f02-a87f-4e4b-beb8-9276c6919af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:07:56.024207 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e99f02-a87f-4e4b-beb8-9276c6919af6 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:07:56.024483 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e99f02-a87f-4e4b-beb8-9276c6919af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:07:56.024756 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e99f02-a87f-4e4b-beb8-9276c6919af6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:07:56.025494 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e99f02-a87f-4e4b-beb8-9276c6919af6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:07:56.026561 ncdv-master-1 devstack@keystone.service[91547]: WARNING py.warnings [None req-95e99f02-a87f-4e4b-beb8-9276c6919af6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:07:56.026561 ncdv-master-1 devstack@keystone.service[91547]: warnings.warn(msg) Jul 23 21:07:56.026561 ncdv-master-1 devstack@keystone.service[91547]: Jul 23 21:07:56.027464 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e99f02-a87f-4e4b-beb8-9276c6919af6 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:07:56.039919 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 744/1499] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:07:55 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:07:56.044421 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93781f0-1da4-408d-9293-541abd653caa admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:07:56.046051 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-c93781f0-1da4-408d-9293-541abd653caa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:07:56.057795 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93781f0-1da4-408d-9293-541abd653caa admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:07:56.083831 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:07:56.160264 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2708af5-6881-4e54-a270-90de821244ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:07:56.160940 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2708af5-6881-4e54-a270-90de821244ca admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:07:56.161214 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2708af5-6881-4e54-a270-90de821244ca admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:07:56.161484 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2708af5-6881-4e54-a270-90de821244ca admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:07:56.162245 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2708af5-6881-4e54-a270-90de821244ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:07:56.163262 ncdv-master-1 devstack@keystone.service[91548]: WARNING py.warnings [None req-f2708af5-6881-4e54-a270-90de821244ca admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:07:56.163262 ncdv-master-1 devstack@keystone.service[91548]: warnings.warn(msg) Jul 23 21:07:56.163262 ncdv-master-1 devstack@keystone.service[91548]: Jul 23 21:07:56.164141 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2708af5-6881-4e54-a270-90de821244ca admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:07:56.176743 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 756/1500] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:07:56 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:07:56.181152 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e99f02-a87f-4e4b-beb8-9276c6919af6 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:07:56.182738 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-95e99f02-a87f-4e4b-beb8-9276c6919af6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:07:56.222290 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e99f02-a87f-4e4b-beb8-9276c6919af6 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:07:56.330978 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df30f3c-4b21-4bca-beb0-78efd51db108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:07:56.331885 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df30f3c-4b21-4bca-beb0-78efd51db108 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:07:56.332157 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df30f3c-4b21-4bca-beb0-78efd51db108 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:07:56.332424 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df30f3c-4b21-4bca-beb0-78efd51db108 admin admin] PATH_INFO: `/v3/projects/af0b3b60c94e47aebae5430d3918eddf/users/bbbc1696a9f74ca28985e7ffc6ee3c43/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:07:56.357664 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df30f3c-4b21-4bca-beb0-78efd51db108 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af0b3b60c94e47aebae5430d3918eddf, user_id=bbbc1696a9f74ca28985e7ffc6ee3c43, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:07:56.358766 ncdv-master-1 devstack@keystone.service[91547]: WARNING py.warnings [None req-9df30f3c-4b21-4bca-beb0-78efd51db108 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:07:56.358766 ncdv-master-1 devstack@keystone.service[91547]: warnings.warn(msg) Jul 23 21:07:56.358766 ncdv-master-1 devstack@keystone.service[91547]: Jul 23 21:07:56.360670 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df30f3c-4b21-4bca-beb0-78efd51db108 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:07:56.389207 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 745/1501] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:07:56 2022] PUT /identity/v3/projects/af0b3b60c94e47aebae5430d3918eddf/users/bbbc1696a9f74ca28985e7ffc6ee3c43/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:07:56.401682 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44122218-d3f1-4bc3-861e-764b9016e718 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:07:56.401991 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44122218-d3f1-4bc3-861e-764b9016e718 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:07:56.402288 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44122218-d3f1-4bc3-861e-764b9016e718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:07:56.462174 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-44122218-d3f1-4bc3-861e-764b9016e718 None None] MFA Rules not processed for user `bbbc1696a9f74ca28985e7ffc6ee3c43`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:07:56.463310 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-44122218-d3f1-4bc3-861e-764b9016e718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:07:56.545319 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 757/1502] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:07:56 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:07:56.559185 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fff40d6-73e2-4b3c-a610-ca950d54643c None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:07:56.559471 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fff40d6-73e2-4b3c-a610-ca950d54643c None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:07:56.559745 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fff40d6-73e2-4b3c-a610-ca950d54643c None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:07:56.561270 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 746/1503] 10.222.0.17 () {54 vars in 964 bytes} [Sat Jul 23 21:07:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:07:56.566373 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dad95af-c38b-4e38-95ef-12de32903bc8 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:07:56.566660 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dad95af-c38b-4e38-95ef-12de32903bc8 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:07:56.566934 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dad95af-c38b-4e38-95ef-12de32903bc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:07:56.598715 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:07:56.646829 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-3dad95af-c38b-4e38-95ef-12de32903bc8 None None] MFA Rules not processed for user `ec5fd3a489c341b7964704d689037f05`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:07:56.648061 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-3dad95af-c38b-4e38-95ef-12de32903bc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:07:56.724315 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 758/1504] 10.222.0.17 () {58 vars in 1061 bytes} [Sat Jul 23 21:07:56 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:07:56.735186 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fff40d6-73e2-4b3c-a610-ca950d54643c None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:07:56.737714 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-0fff40d6-73e2-4b3c-a610-ca950d54643c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:07:56.798700 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:07:56.859441 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fff40d6-73e2-4b3c-a610-ca950d54643c None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:07:56.863744 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18bf90f-7c65-4a69-819b-ea9d5b707d68 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec5fd3a489c341b7964704d689037f05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:07:56.864440 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18bf90f-7c65-4a69-819b-ea9d5b707d68 service cinder] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:07:56.864722 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18bf90f-7c65-4a69-819b-ea9d5b707d68 service cinder] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:07:56.864994 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18bf90f-7c65-4a69-819b-ea9d5b707d68 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:07:56.867092 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-d18bf90f-7c65-4a69-819b-ea9d5b707d68 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:07:56.964050 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18bf90f-7c65-4a69-819b-ea9d5b707d68 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:07:56.965492 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18bf90f-7c65-4a69-819b-ea9d5b707d68 service cinder] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:07:56.984395 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 747/1505] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:07:56 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:07:57.029232 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2738155-2f71-4212-a9e5-f30d2445f406 None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:07:57.029678 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2738155-2f71-4212-a9e5-f30d2445f406 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:07:57.030367 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2738155-2f71-4212-a9e5-f30d2445f406 None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:07:57.031714 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 759/1506] 10.222.0.17 () {52 vars in 829 bytes} [Sat Jul 23 21:07:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:07:57.035715 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18bf90f-7c65-4a69-819b-ea9d5b707d68 service cinder] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:07:57.037390 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-d18bf90f-7c65-4a69-819b-ea9d5b707d68 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:07:57.112606 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:07:57.145673 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18bf90f-7c65-4a69-819b-ea9d5b707d68 service cinder] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:07:57.151308 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3adcd28-284f-41f7-a0eb-5832d982e36f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:07:57.152609 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3adcd28-284f-41f7-a0eb-5832d982e36f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:07:57.152999 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3adcd28-284f-41f7-a0eb-5832d982e36f admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:07:57.153437 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3adcd28-284f-41f7-a0eb-5832d982e36f admin admin] PATH_INFO: `/v3/users/bbbc1696a9f74ca28985e7ffc6ee3c43` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:07:57.155438 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3adcd28-284f-41f7-a0eb-5832d982e36f admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbbc1696a9f74ca28985e7ffc6ee3c43)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:07:57.156466 ncdv-master-1 devstack@keystone.service[91547]: WARNING py.warnings [None req-d3adcd28-284f-41f7-a0eb-5832d982e36f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:07:57.156466 ncdv-master-1 devstack@keystone.service[91547]: warnings.warn(msg) Jul 23 21:07:57.156466 ncdv-master-1 devstack@keystone.service[91547]: Jul 23 21:07:57.157701 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3adcd28-284f-41f7-a0eb-5832d982e36f admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:07:57.231649 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-d3adcd28-284f-41f7-a0eb-5832d982e36f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbbc1696a9f74ca28985e7ffc6ee3c43'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:07:57.244746 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-d3adcd28-284f-41f7-a0eb-5832d982e36f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbbc1696a9f74ca28985e7ffc6ee3c43'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:07:57.245526 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-d3adcd28-284f-41f7-a0eb-5832d982e36f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbbc1696a9f74ca28985e7ffc6ee3c43'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:07:57.257801 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-d3adcd28-284f-41f7-a0eb-5832d982e36f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbbc1696a9f74ca28985e7ffc6ee3c43'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:07:57.277848 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-d3adcd28-284f-41f7-a0eb-5832d982e36f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbbc1696a9f74ca28985e7ffc6ee3c43'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:07:57.284167 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 748/1507] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:07:57 2022] DELETE /identity/v3/users/bbbc1696a9f74ca28985e7ffc6ee3c43 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:07:57.288952 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4534b8d-ffa1-41c4-8ddf-183cd15bec5b None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:07:57.289240 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4534b8d-ffa1-41c4-8ddf-183cd15bec5b None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:07:57.289545 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4534b8d-ffa1-41c4-8ddf-183cd15bec5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:07:57.319295 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-e4534b8d-ffa1-41c4-8ddf-183cd15bec5b None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:07:57.320509 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-e4534b8d-ffa1-41c4-8ddf-183cd15bec5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:07:57.389553 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 760/1508] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:07:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:07:57.400282 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3adcd28-284f-41f7-a0eb-5832d982e36f admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:07:57.401973 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-d3adcd28-284f-41f7-a0eb-5832d982e36f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:07:57.492897 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3adcd28-284f-41f7-a0eb-5832d982e36f admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:07:57.498516 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999ddc30-d875-478d-ad3c-fb9516b4b9ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:07:57.499397 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999ddc30-d875-478d-ad3c-fb9516b4b9ce service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:07:57.499757 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999ddc30-d875-478d-ad3c-fb9516b4b9ce service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:07:57.500030 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999ddc30-d875-478d-ad3c-fb9516b4b9ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:07:57.514044 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999ddc30-d875-478d-ad3c-fb9516b4b9ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:07:57.515820 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999ddc30-d875-478d-ad3c-fb9516b4b9ce service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:07:57.527928 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 749/1509] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:07:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:07:57.915949 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4534b8d-ffa1-41c4-8ddf-183cd15bec5b None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:07:57.917416 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-e4534b8d-ffa1-41c4-8ddf-183cd15bec5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:07:57.929929 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4534b8d-ffa1-41c4-8ddf-183cd15bec5b None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:07:57.935192 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54341d6d-25e4-46b8-9f15-f1245151573f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:07:57.936242 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54341d6d-25e4-46b8-9f15-f1245151573f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:07:57.936525 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54341d6d-25e4-46b8-9f15-f1245151573f admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:07:57.936799 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54341d6d-25e4-46b8-9f15-f1245151573f admin admin] PATH_INFO: `/v3/projects/af0b3b60c94e47aebae5430d3918eddf` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:07:57.938045 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54341d6d-25e4-46b8-9f15-f1245151573f admin admin] RBAC: Authorizing `identity:delete_project(project_id=af0b3b60c94e47aebae5430d3918eddf)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:07:57.939051 ncdv-master-1 devstack@keystone.service[91548]: WARNING py.warnings [None req-54341d6d-25e4-46b8-9f15-f1245151573f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:07:57.939051 ncdv-master-1 devstack@keystone.service[91548]: warnings.warn(msg) Jul 23 21:07:57.939051 ncdv-master-1 devstack@keystone.service[91548]: Jul 23 21:07:57.940606 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54341d6d-25e4-46b8-9f15-f1245151573f admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:07:58.007525 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:07:58.011993 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-54341d6d-25e4-46b8-9f15-f1245151573f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af0b3b60c94e47aebae5430d3918eddf', 'request_id': 'req-54341d6d-25e4-46b8-9f15-f1245151573f'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:07:58.022360 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-54341d6d-25e4-46b8-9f15-f1245151573f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af0b3b60c94e47aebae5430d3918eddf', 'request_id': 'req-54341d6d-25e4-46b8-9f15-f1245151573f'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:07:58.028452 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-54341d6d-25e4-46b8-9f15-f1245151573f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af0b3b60c94e47aebae5430d3918eddf', 'request_id': 'req-54341d6d-25e4-46b8-9f15-f1245151573f'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:07:58.046745 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-54341d6d-25e4-46b8-9f15-f1245151573f admin admin] The token cache is being invalidate because project af0b3b60c94e47aebae5430d3918eddf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:07:58.047375 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-54341d6d-25e4-46b8-9f15-f1245151573f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:07:58.047895 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-54341d6d-25e4-46b8-9f15-f1245151573f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:07:58.049664 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 761/1510] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:07:57 2022] DELETE /identity/v3/projects/af0b3b60c94e47aebae5430d3918eddf => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:08:07.522302 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=72,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:08:08.043745 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:DELETE=4,keystone:SELECT=7,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:11:03.004237 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342febc0-fbf3-4dc0-ac5c-fbd14e267ca8 None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:11:03.004891 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342febc0-fbf3-4dc0-ac5c-fbd14e267ca8 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:11:03.004891 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342febc0-fbf3-4dc0-ac5c-fbd14e267ca8 None None] PATH_INFO: `/v3` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:11:03.006520 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 750/1511] 10.222.0.42 () {54 vars in 925 bytes} [Sat Jul 23 21:11:03 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:11:03.042615 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56e87a8-9477-4358-abfb-ed88560e1a21 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:11:03.043166 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56e87a8-9477-4358-abfb-ed88560e1a21 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:11:03.043166 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56e87a8-9477-4358-abfb-ed88560e1a21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:11:03.119007 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-a56e87a8-9477-4358-abfb-ed88560e1a21 None None] MFA Rules not processed for user `abc719a3b3ac4461b82ca04ab6451d81`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:11:03.120136 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-a56e87a8-9477-4358-abfb-ed88560e1a21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:11:03.203087 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 762/1512] 10.222.0.42 () {58 vars in 1015 bytes} [Sat Jul 23 21:11:03 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:11:07.236862 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d288b2b-6640-46b3-99c1-6b6cd84443eb None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:11:07.237434 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d288b2b-6640-46b3-99c1-6b6cd84443eb None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:11:07.237434 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d288b2b-6640-46b3-99c1-6b6cd84443eb None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:11:07.238725 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 751/1513] 10.222.0.17 () {54 vars in 961 bytes} [Sat Jul 23 21:11:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:11:07.245026 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca67ba9-6026-40aa-9eeb-0fd1d064e7b3 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:11:07.245816 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca67ba9-6026-40aa-9eeb-0fd1d064e7b3 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:11:07.245816 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca67ba9-6026-40aa-9eeb-0fd1d064e7b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:11:07.269540 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-bca67ba9-6026-40aa-9eeb-0fd1d064e7b3 None None] MFA Rules not processed for user `abc719a3b3ac4461b82ca04ab6451d81`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:11:07.270878 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-bca67ba9-6026-40aa-9eeb-0fd1d064e7b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:11:07.281168 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 763/1514] 10.222.0.17 () {58 vars in 1058 bytes} [Sat Jul 23 21:11:07 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:11:07.291449 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d288b2b-6640-46b3-99c1-6b6cd84443eb None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:11:07.312353 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d288b2b-6640-46b3-99c1-6b6cd84443eb None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:11:07.317834 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6d6d93-e235-4983-8ee0-22ee1300713e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc719a3b3ac4461b82ca04ab6451d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:11:07.318520 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6d6d93-e235-4983-8ee0-22ee1300713e service placement] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:11:07.318793 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6d6d93-e235-4983-8ee0-22ee1300713e service placement] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:11:07.319065 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6d6d93-e235-4983-8ee0-22ee1300713e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:11:07.328144 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6d6d93-e235-4983-8ee0-22ee1300713e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:11:07.329760 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6d6d93-e235-4983-8ee0-22ee1300713e service placement] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:11:07.339611 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 752/1515] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:11:07 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:11:14.191790 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160a9289-b50b-489d-bd67-1aed6349e5aa None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:11:14.192367 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160a9289-b50b-489d-bd67-1aed6349e5aa None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:11:14.192367 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160a9289-b50b-489d-bd67-1aed6349e5aa None None] PATH_INFO: `/v3` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:11:14.193606 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 764/1516] 10.222.0.39 () {54 vars in 925 bytes} [Sat Jul 23 21:11:14 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:11:14.200327 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278a2f61-4e94-4662-a1c2-1ac09d1f1fc7 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:11:14.200808 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278a2f61-4e94-4662-a1c2-1ac09d1f1fc7 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:11:14.200924 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278a2f61-4e94-4662-a1c2-1ac09d1f1fc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:11:14.222653 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-278a2f61-4e94-4662-a1c2-1ac09d1f1fc7 None None] MFA Rules not processed for user `abc719a3b3ac4461b82ca04ab6451d81`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:11:14.223885 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-278a2f61-4e94-4662-a1c2-1ac09d1f1fc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:11:14.234682 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 753/1517] 10.222.0.39 () {58 vars in 1015 bytes} [Sat Jul 23 21:11:14 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:11:17.263962 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=55 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:11:23.121268 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160a9289-b50b-489d-bd67-1aed6349e5aa None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:11:23.139472 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160a9289-b50b-489d-bd67-1aed6349e5aa None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:11:23.145470 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ae8e43-3e1c-42b0-8517-c05529fdf48e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc719a3b3ac4461b82ca04ab6451d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:11:23.146153 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ae8e43-3e1c-42b0-8517-c05529fdf48e service placement] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:11:23.146713 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ae8e43-3e1c-42b0-8517-c05529fdf48e service placement] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:11:23.146990 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ae8e43-3e1c-42b0-8517-c05529fdf48e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:11:23.155798 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ae8e43-3e1c-42b0-8517-c05529fdf48e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:11:23.157399 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ae8e43-3e1c-42b0-8517-c05529fdf48e service placement] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:11:23.167430 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 765/1518] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:11:23 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:11:24.215002 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=9 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:11:33.163627 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=6 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:11:44.737708 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd3e6cd-f6ca-457d-b79d-ecb7b0139be2 None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:11:44.738326 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd3e6cd-f6ca-457d-b79d-ecb7b0139be2 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:11:44.738326 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd3e6cd-f6ca-457d-b79d-ecb7b0139be2 None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:11:44.739673 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 754/1519] 127.0.0.1 () {54 vars in 901 bytes} [Sat Jul 23 21:11:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:11:44.745306 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ff1ea0-4358-49a4-95c4-da2031a720c0 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:11:44.745822 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ff1ea0-4358-49a4-95c4-da2031a720c0 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:11:44.745822 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ff1ea0-4358-49a4-95c4-da2031a720c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:11:44.784559 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-43ff1ea0-4358-49a4-95c4-da2031a720c0 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:11:44.785665 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-43ff1ea0-4358-49a4-95c4-da2031a720c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:11:44.850427 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 766/1520] 127.0.0.1 () {58 vars in 998 bytes} [Sat Jul 23 21:11:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:11:45.018847 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd3e6cd-f6ca-457d-b79d-ecb7b0139be2 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:11:45.021165 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-3cd3e6cd-f6ca-457d-b79d-ecb7b0139be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:11:45.149972 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd3e6cd-f6ca-457d-b79d-ecb7b0139be2 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:11:45.156963 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804465ed-2dd9-4fc9-8d89-45a518b1b2ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:11:45.157623 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804465ed-2dd9-4fc9-8d89-45a518b1b2ce service nova] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:11:45.157913 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804465ed-2dd9-4fc9-8d89-45a518b1b2ce service nova] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:11:45.158201 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804465ed-2dd9-4fc9-8d89-45a518b1b2ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:11:45.166519 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804465ed-2dd9-4fc9-8d89-45a518b1b2ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:11:45.168106 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804465ed-2dd9-4fc9-8d89-45a518b1b2ce service nova] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:11:45.178489 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 755/1521] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:11:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:11:46.033583 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b96665-2edf-4bc9-95c2-14ea23cf802a None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:11:46.034221 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b96665-2edf-4bc9-95c2-14ea23cf802a None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:11:46.034221 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b96665-2edf-4bc9-95c2-14ea23cf802a None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:11:46.035577 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 767/1522] 127.0.0.1 () {54 vars in 901 bytes} [Sat Jul 23 21:11:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:11:46.040704 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7259fa52-f703-4647-8062-9b123b5191fc None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:11:46.041167 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7259fa52-f703-4647-8062-9b123b5191fc None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:11:46.041281 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7259fa52-f703-4647-8062-9b123b5191fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:11:46.060143 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-7259fa52-f703-4647-8062-9b123b5191fc None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:11:46.061338 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-7259fa52-f703-4647-8062-9b123b5191fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:11:46.073497 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 756/1523] 127.0.0.1 () {58 vars in 998 bytes} [Sat Jul 23 21:11:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:11:46.244850 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b96665-2edf-4bc9-95c2-14ea23cf802a None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:11:46.264107 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b96665-2edf-4bc9-95c2-14ea23cf802a None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:11:46.270068 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a7ba6d-6e5d-4c08-8869-e453fce8fd53 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:11:46.270724 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a7ba6d-6e5d-4c08-8869-e453fce8fd53 service nova] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:11:46.270996 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a7ba6d-6e5d-4c08-8869-e453fce8fd53 service nova] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:11:46.271270 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a7ba6d-6e5d-4c08-8869-e453fce8fd53 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:11:46.280168 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a7ba6d-6e5d-4c08-8869-e453fce8fd53 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:11:46.281763 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a7ba6d-6e5d-4c08-8869-e453fce8fd53 service nova] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:11:46.291409 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 768/1524] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:11:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 23 21:11:50.260435 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2051a3f4-2134-49f5-baf7-acb1dc9a2a9c None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:11:50.261041 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2051a3f4-2134-49f5-baf7-acb1dc9a2a9c None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:11:50.261041 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2051a3f4-2134-49f5-baf7-acb1dc9a2a9c None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:11:50.262545 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 757/1525] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jul 23 21:11:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:11:50.268555 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc88dec-1ba1-40d0-9f08-aa50b9298d38 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:11:50.269374 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc88dec-1ba1-40d0-9f08-aa50b9298d38 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:11:50.269374 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc88dec-1ba1-40d0-9f08-aa50b9298d38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:11:50.290927 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-4cc88dec-1ba1-40d0-9f08-aa50b9298d38 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:11:50.292319 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-4cc88dec-1ba1-40d0-9f08-aa50b9298d38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:11:50.301920 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 769/1526] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jul 23 21:11:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:11:50.341163 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2051a3f4-2134-49f5-baf7-acb1dc9a2a9c None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:11:50.343155 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-2051a3f4-2134-49f5-baf7-acb1dc9a2a9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:11:50.416130 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2051a3f4-2134-49f5-baf7-acb1dc9a2a9c None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:11:50.420196 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8db6b7-bb12-4cfa-9a6e-d395c5de7abb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:11:50.420858 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8db6b7-bb12-4cfa-9a6e-d395c5de7abb service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:11:50.421137 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8db6b7-bb12-4cfa-9a6e-d395c5de7abb service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:11:50.421408 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8db6b7-bb12-4cfa-9a6e-d395c5de7abb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:11:50.431738 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8db6b7-bb12-4cfa-9a6e-d395c5de7abb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:11:50.433208 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8db6b7-bb12-4cfa-9a6e-d395c5de7abb service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:11:50.443437 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 758/1527] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:11:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:11:52.729370 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6076344e-9110-429b-9519-2549097e1ba3 None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:11:52.730084 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6076344e-9110-429b-9519-2549097e1ba3 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:11:52.730084 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6076344e-9110-429b-9519-2549097e1ba3 None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:11:52.731306 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 770/1528] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jul 23 21:11:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:11:52.737009 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d604bb-2b12-4cdf-9324-db7b8efa293b None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:11:52.737464 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d604bb-2b12-4cdf-9324-db7b8efa293b None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:11:52.737705 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d604bb-2b12-4cdf-9324-db7b8efa293b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:11:52.758357 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-59d604bb-2b12-4cdf-9324-db7b8efa293b None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:11:52.759587 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-59d604bb-2b12-4cdf-9324-db7b8efa293b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:11:52.767830 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 759/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jul 23 21:11:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:11:52.814325 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6076344e-9110-429b-9519-2549097e1ba3 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:11:52.829758 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6076344e-9110-429b-9519-2549097e1ba3 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:11:52.833958 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb119393-3294-4712-80d5-0916e757a008 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:11:52.834597 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb119393-3294-4712-80d5-0916e757a008 service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:11:52.834876 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb119393-3294-4712-80d5-0916e757a008 service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:11:52.835149 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb119393-3294-4712-80d5-0916e757a008 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:11:52.846669 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb119393-3294-4712-80d5-0916e757a008 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:11:52.848311 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb119393-3294-4712-80d5-0916e757a008 service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:11:52.858772 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 771/1530] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:11:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:12:02.751869 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=78 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:12:02.853912 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=49 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:12:44.902960 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689f3099-c905-4298-b2aa-c9ebe879d101 None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:12:44.903552 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689f3099-c905-4298-b2aa-c9ebe879d101 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:12:44.903552 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689f3099-c905-4298-b2aa-c9ebe879d101 None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:12:44.905127 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 760/1531] 10.222.0.17 () {54 vars in 921 bytes} [Sat Jul 23 21:12:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:12:44.910041 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf070f35-b4a1-4119-9593-de6c9ae6cbac None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:12:44.910495 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf070f35-b4a1-4119-9593-de6c9ae6cbac None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:12:44.910594 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf070f35-b4a1-4119-9593-de6c9ae6cbac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:12:44.930047 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-bf070f35-b4a1-4119-9593-de6c9ae6cbac None None] MFA Rules not processed for user `abc719a3b3ac4461b82ca04ab6451d81`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:12:44.931259 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-bf070f35-b4a1-4119-9593-de6c9ae6cbac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:12:44.941705 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 772/1532] 10.222.0.17 () {58 vars in 1018 bytes} [Sat Jul 23 21:12:44 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:12:54.924061 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=3 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:13:23.421765 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dfc00d-66f3-441e-9bb8-7c130073c16c None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:23.422418 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dfc00d-66f3-441e-9bb8-7c130073c16c None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:23.422418 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dfc00d-66f3-441e-9bb8-7c130073c16c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:23.448806 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-b7dfc00d-66f3-441e-9bb8-7c130073c16c None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:13:23.450258 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-b7dfc00d-66f3-441e-9bb8-7c130073c16c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:23.461880 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 761/1533] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:13:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:13:23.468479 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6044e8e-837e-4dd3-b31e-524f724d0394 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:23.469463 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6044e8e-837e-4dd3-b31e-524f724d0394 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:23.469987 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6044e8e-837e-4dd3-b31e-524f724d0394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:23.500839 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6536ad1-957a-4b09-8064-8c8909db7488 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:23.501168 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6536ad1-957a-4b09-8064-8c8909db7488 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:23.501493 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6536ad1-957a-4b09-8064-8c8909db7488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:23.507786 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-b6044e8e-837e-4dd3-b31e-524f724d0394 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:13:23.509425 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-b6044e8e-837e-4dd3-b31e-524f724d0394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:23.523621 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 773/1534] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:13:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:13:23.532717 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-e6536ad1-957a-4b09-8064-8c8909db7488 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:13:23.534008 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-e6536ad1-957a-4b09-8064-8c8909db7488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:23.534636 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a166ab-861e-43c3-8414-eb9c90eea6e4 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:23.535318 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a166ab-861e-43c3-8414-eb9c90eea6e4 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:23.535799 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a166ab-861e-43c3-8414-eb9c90eea6e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:23.552676 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 762/1535] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:13:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:13:23.567862 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-08a166ab-861e-43c3-8414-eb9c90eea6e4 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:13:23.573889 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6536ad1-957a-4b09-8064-8c8909db7488 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:23.575999 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-08a166ab-861e-43c3-8414-eb9c90eea6e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:23.589596 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 774/1536] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:13:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:13:23.593673 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6536ad1-957a-4b09-8064-8c8909db7488 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:23.595743 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a166ab-861e-43c3-8414-eb9c90eea6e4 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:23.613901 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a545b56-c5e6-4bd7-8f45-faa5f1d38476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:23.613901 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a545b56-c5e6-4bd7-8f45-faa5f1d38476 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:23.613901 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a545b56-c5e6-4bd7-8f45-faa5f1d38476 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:23.613901 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a545b56-c5e6-4bd7-8f45-faa5f1d38476 admin admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:23.614330 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a545b56-c5e6-4bd7-8f45-faa5f1d38476 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:13:23.614330 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a545b56-c5e6-4bd7-8f45-faa5f1d38476 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:23.614330 ncdv-master-1 devstack@keystone.service[91547]: WARNING py.warnings [None req-6a545b56-c5e6-4bd7-8f45-faa5f1d38476 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:13:23.614330 ncdv-master-1 devstack@keystone.service[91547]: warnings.warn(msg) Jul 23 21:13:23.614330 ncdv-master-1 devstack@keystone.service[91547]: Jul 23 21:13:23.614330 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a545b56-c5e6-4bd7-8f45-faa5f1d38476 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:23.619313 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a166ab-861e-43c3-8414-eb9c90eea6e4 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:23.625386 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6acf01a-bda6-42c4-8927-c63c71aa6995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:23.627023 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6acf01a-bda6-42c4-8927-c63c71aa6995 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:23.628005 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6acf01a-bda6-42c4-8927-c63c71aa6995 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:23.628512 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6acf01a-bda6-42c4-8927-c63c71aa6995 admin admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:23.629527 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6acf01a-bda6-42c4-8927-c63c71aa6995 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:13:23.630105 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6acf01a-bda6-42c4-8927-c63c71aa6995 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:23.632006 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6acf01a-bda6-42c4-8927-c63c71aa6995 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:23.648474 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 763/1537] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:13:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:13:23.661630 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 775/1538] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:13:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:13:23.665424 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a545b56-c5e6-4bd7-8f45-faa5f1d38476 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:23.670369 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6acf01a-bda6-42c4-8927-c63c71aa6995 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:23.685835 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6acf01a-bda6-42c4-8927-c63c71aa6995 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:23.686056 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a545b56-c5e6-4bd7-8f45-faa5f1d38476 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:23.693442 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96565e85-926d-4a72-a735-277f5ea47389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:23.694657 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96565e85-926d-4a72-a735-277f5ea47389 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:23.695224 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96565e85-926d-4a72-a735-277f5ea47389 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:23.695754 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96565e85-926d-4a72-a735-277f5ea47389 admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:23.696683 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96565e85-926d-4a72-a735-277f5ea47389 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:23.697984 ncdv-master-1 devstack@keystone.service[91548]: WARNING py.warnings [None req-96565e85-926d-4a72-a735-277f5ea47389 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:13:23.697984 ncdv-master-1 devstack@keystone.service[91548]: warnings.warn(msg) Jul 23 21:13:23.697984 ncdv-master-1 devstack@keystone.service[91548]: Jul 23 21:13:23.701263 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96565e85-926d-4a72-a735-277f5ea47389 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:23.705679 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e670e5a5-4886-4aa2-8667-5f098a4347e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:23.705679 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e670e5a5-4886-4aa2-8667-5f098a4347e4 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:23.705679 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e670e5a5-4886-4aa2-8667-5f098a4347e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:23.705679 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e670e5a5-4886-4aa2-8667-5f098a4347e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:23.706132 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e670e5a5-4886-4aa2-8667-5f098a4347e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:23.707338 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e670e5a5-4886-4aa2-8667-5f098a4347e4 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:23.786849 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 776/1539] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:13:23 2022] POST /identity/v3/projects => generated 375 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:13:23.789200 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96565e85-926d-4a72-a735-277f5ea47389 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:23.804444 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 764/1540] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:13:23 2022] POST /identity/v3/projects => generated 387 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:13:23.827465 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e670e5a5-4886-4aa2-8667-5f098a4347e4 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:23.920150 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96565e85-926d-4a72-a735-277f5ea47389 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:23.984349 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e670e5a5-4886-4aa2-8667-5f098a4347e4 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:23.998655 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32027e25-8945-401e-9610-cb1f15fee2af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:24.000233 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32027e25-8945-401e-9610-cb1f15fee2af admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:24.000613 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32027e25-8945-401e-9610-cb1f15fee2af admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:24.000964 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32027e25-8945-401e-9610-cb1f15fee2af admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:24.001669 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32027e25-8945-401e-9610-cb1f15fee2af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:24.002962 ncdv-master-1 devstack@keystone.service[91547]: WARNING py.warnings [None req-32027e25-8945-401e-9610-cb1f15fee2af admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:13:24.002962 ncdv-master-1 devstack@keystone.service[91547]: warnings.warn(msg) Jul 23 21:13:24.002962 ncdv-master-1 devstack@keystone.service[91547]: Jul 23 21:13:24.004182 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32027e25-8945-401e-9610-cb1f15fee2af admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:24.032875 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5c89a1-a25b-4455-9baa-2c53f8233be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:24.034482 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5c89a1-a25b-4455-9baa-2c53f8233be2 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:24.034759 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5c89a1-a25b-4455-9baa-2c53f8233be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:24.035028 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5c89a1-a25b-4455-9baa-2c53f8233be2 admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:24.035724 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5c89a1-a25b-4455-9baa-2c53f8233be2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:24.037776 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5c89a1-a25b-4455-9baa-2c53f8233be2 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:24.043910 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 765/1541] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:13:23 2022] POST /identity/v3/users => generated 294 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:13:24.059467 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32027e25-8945-401e-9610-cb1f15fee2af admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:24.080327 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32027e25-8945-401e-9610-cb1f15fee2af admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:24.085006 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 777/1542] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:13:23 2022] POST /identity/v3/users => generated 288 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:13:24.088767 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0323ae4e-67ac-4568-b429-63cc08718815 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:24.089155 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0323ae4e-67ac-4568-b429-63cc08718815 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:24.089416 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0323ae4e-67ac-4568-b429-63cc08718815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:24.092354 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fe7d3d-e3dd-4f75-a35c-9de911759206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:24.093049 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fe7d3d-e3dd-4f75-a35c-9de911759206 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:24.093761 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fe7d3d-e3dd-4f75-a35c-9de911759206 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:24.094067 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fe7d3d-e3dd-4f75-a35c-9de911759206 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:24.094853 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fe7d3d-e3dd-4f75-a35c-9de911759206 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:24.096602 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fe7d3d-e3dd-4f75-a35c-9de911759206 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:24.116407 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-0323ae4e-67ac-4568-b429-63cc08718815 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:13:24.117632 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-0323ae4e-67ac-4568-b429-63cc08718815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:24.119887 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 766/1543] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:13:24 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:13:24.120746 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fe7d3d-e3dd-4f75-a35c-9de911759206 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:24.133790 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 778/1544] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:13:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:13:24.137201 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67807a3a-af5d-4fa2-ac03-db6f74f81c2d None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:24.137485 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67807a3a-af5d-4fa2-ac03-db6f74f81c2d None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:24.137785 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67807a3a-af5d-4fa2-ac03-db6f74f81c2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:24.142508 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fe7d3d-e3dd-4f75-a35c-9de911759206 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:24.151727 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d084126-19bd-4116-8064-6f71ea4ed83d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:24.152718 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d084126-19bd-4116-8064-6f71ea4ed83d admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:24.153228 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d084126-19bd-4116-8064-6f71ea4ed83d admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:24.153701 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d084126-19bd-4116-8064-6f71ea4ed83d admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:24.154670 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d084126-19bd-4116-8064-6f71ea4ed83d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:24.156689 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d084126-19bd-4116-8064-6f71ea4ed83d admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:24.163842 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-67807a3a-af5d-4fa2-ac03-db6f74f81c2d None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:13:24.165072 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-67807a3a-af5d-4fa2-ac03-db6f74f81c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:24.169819 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 767/1545] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:13:24 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:13:24.171033 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d084126-19bd-4116-8064-6f71ea4ed83d admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:24.176112 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 779/1546] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:13:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:13:24.177562 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14af58a0-a054-4464-87a8-174ed39cc920 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:24.177840 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14af58a0-a054-4464-87a8-174ed39cc920 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:24.178149 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14af58a0-a054-4464-87a8-174ed39cc920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:24.183460 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d084126-19bd-4116-8064-6f71ea4ed83d admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:24.191637 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf842815-c911-496a-a82b-803daaa319cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:24.192326 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf842815-c911-496a-a82b-803daaa319cf admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:24.192615 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf842815-c911-496a-a82b-803daaa319cf admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:24.192891 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf842815-c911-496a-a82b-803daaa319cf admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:24.193613 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf842815-c911-496a-a82b-803daaa319cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:24.195309 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf842815-c911-496a-a82b-803daaa319cf admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:24.209032 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 768/1547] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:13:24 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:13:24.209620 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-14af58a0-a054-4464-87a8-174ed39cc920 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:13:24.210505 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aff3f33-3ecd-4d4c-9f10-af1ca299c774 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:24.210799 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aff3f33-3ecd-4d4c-9f10-af1ca299c774 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:24.211074 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aff3f33-3ecd-4d4c-9f10-af1ca299c774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:24.211781 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-14af58a0-a054-4464-87a8-174ed39cc920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:24.221601 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 780/1548] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:13:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:13:24.222747 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629c647b-ca5d-4e95-83e8-49ccc83b0c67 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:24.223033 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629c647b-ca5d-4e95-83e8-49ccc83b0c67 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:24.223306 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629c647b-ca5d-4e95-83e8-49ccc83b0c67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:24.231444 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-7aff3f33-3ecd-4d4c-9f10-af1ca299c774 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:13:24.232659 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-7aff3f33-3ecd-4d4c-9f10-af1ca299c774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:24.245074 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 769/1549] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:13:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:13:24.246377 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b5c23b-a11f-45ab-9f8b-fef48f4627be None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:24.246596 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-629c647b-ca5d-4e95-83e8-49ccc83b0c67 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:13:24.246702 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b5c23b-a11f-45ab-9f8b-fef48f4627be None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:24.246914 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b5c23b-a11f-45ab-9f8b-fef48f4627be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:24.248095 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-629c647b-ca5d-4e95-83e8-49ccc83b0c67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:24.257671 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 781/1550] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:13:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:13:24.258576 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629c647b-ca5d-4e95-83e8-49ccc83b0c67 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:24.269414 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629c647b-ca5d-4e95-83e8-49ccc83b0c67 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:24.270883 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-42b5c23b-a11f-45ab-9f8b-fef48f4627be None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:13:24.272527 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-42b5c23b-a11f-45ab-9f8b-fef48f4627be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:24.274282 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2460baac-60b7-41ee-9987-76afb9f5ca85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:24.274987 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2460baac-60b7-41ee-9987-76afb9f5ca85 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:24.275266 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2460baac-60b7-41ee-9987-76afb9f5ca85 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:24.276157 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2460baac-60b7-41ee-9987-76afb9f5ca85 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:24.276261 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2460baac-60b7-41ee-9987-76afb9f5ca85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:24.277957 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2460baac-60b7-41ee-9987-76afb9f5ca85 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:24.282052 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 770/1551] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:13:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:13:24.283138 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe42d24-dce4-4110-b8f5-bdde8d22a786 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:24.283423 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe42d24-dce4-4110-b8f5-bdde8d22a786 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:24.283695 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe42d24-dce4-4110-b8f5-bdde8d22a786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:24.292548 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 782/1552] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:13:24 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:13:24.293664 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2460baac-60b7-41ee-9987-76afb9f5ca85 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:24.300084 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:13:24.306435 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2460baac-60b7-41ee-9987-76afb9f5ca85 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:24.307923 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-bfe42d24-dce4-4110-b8f5-bdde8d22a786 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:13:24.309275 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-bfe42d24-dce4-4110-b8f5-bdde8d22a786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:24.312689 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430d39e8-341b-4fbb-90e6-4ee1babf4be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:24.314147 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430d39e8-341b-4fbb-90e6-4ee1babf4be4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:24.314355 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430d39e8-341b-4fbb-90e6-4ee1babf4be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:24.314820 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430d39e8-341b-4fbb-90e6-4ee1babf4be4 admin admin] PATH_INFO: `/v3/projects/07101aee06ca4bb6885f87cfec3257db/users/199522d29cb746379cb6f75d4b108cb9/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:24.318504 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 771/1553] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:13:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:13:24.319587 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2132fdbd-f63c-475e-a146-595401536752 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:24.319866 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2132fdbd-f63c-475e-a146-595401536752 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:24.320136 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2132fdbd-f63c-475e-a146-595401536752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:24.331750 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430d39e8-341b-4fbb-90e6-4ee1babf4be4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07101aee06ca4bb6885f87cfec3257db, user_id=199522d29cb746379cb6f75d4b108cb9, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:24.332789 ncdv-master-1 devstack@keystone.service[91548]: WARNING py.warnings [None req-430d39e8-341b-4fbb-90e6-4ee1babf4be4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:13:24.332789 ncdv-master-1 devstack@keystone.service[91548]: warnings.warn(msg) Jul 23 21:13:24.332789 ncdv-master-1 devstack@keystone.service[91548]: Jul 23 21:13:24.334835 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430d39e8-341b-4fbb-90e6-4ee1babf4be4 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:24.340333 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-2132fdbd-f63c-475e-a146-595401536752 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:13:24.341700 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-2132fdbd-f63c-475e-a146-595401536752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:24.349739 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 783/1554] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:13:24 2022] PUT /identity/v3/projects/07101aee06ca4bb6885f87cfec3257db/users/199522d29cb746379cb6f75d4b108cb9/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:13:24.351226 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3a8ebd-1220-43f6-820e-2f504befc01f None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:24.351727 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3a8ebd-1220-43f6-820e-2f504befc01f None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:24.352130 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3a8ebd-1220-43f6-820e-2f504befc01f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:24.375483 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-0f3a8ebd-1220-43f6-820e-2f504befc01f None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:13:24.376755 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-0f3a8ebd-1220-43f6-820e-2f504befc01f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:24.386629 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:13:24.414299 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 772/1555] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:13:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:13:24.415678 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2125ef3c-9624-44a5-a40d-d0b3371b6145 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:24.415964 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2125ef3c-9624-44a5-a40d-d0b3371b6145 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:24.416233 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2125ef3c-9624-44a5-a40d-d0b3371b6145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:24.434178 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-2125ef3c-9624-44a5-a40d-d0b3371b6145 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:13:24.435389 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-2125ef3c-9624-44a5-a40d-d0b3371b6145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:24.444707 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 773/1556] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:13:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:13:24.448319 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 784/1557] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:13:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:13:24.448319 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3a8ebd-1220-43f6-820e-2f504befc01f None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:24.448479 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662fc134-f2bc-4acf-be1f-15f7edf0b35f None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:24.448479 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662fc134-f2bc-4acf-be1f-15f7edf0b35f None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:24.448479 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662fc134-f2bc-4acf-be1f-15f7edf0b35f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:24.460925 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3a8ebd-1220-43f6-820e-2f504befc01f None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:24.465654 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-662fc134-f2bc-4acf-be1f-15f7edf0b35f None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:13:24.465809 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f657bfae-cf60-4126-b6c2-33b967785eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:24.466427 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f657bfae-cf60-4126-b6c2-33b967785eb7 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:24.466702 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f657bfae-cf60-4126-b6c2-33b967785eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:24.466827 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-662fc134-f2bc-4acf-be1f-15f7edf0b35f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:24.466948 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f657bfae-cf60-4126-b6c2-33b967785eb7 admin admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:24.467782 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f657bfae-cf60-4126-b6c2-33b967785eb7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:13:24.468017 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f657bfae-cf60-4126-b6c2-33b967785eb7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:24.469662 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f657bfae-cf60-4126-b6c2-33b967785eb7 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:24.475521 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 774/1558] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:13:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:13:24.476218 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662fc134-f2bc-4acf-be1f-15f7edf0b35f None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:24.484799 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 785/1559] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:13:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:13:24.485542 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f657bfae-cf60-4126-b6c2-33b967785eb7 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:24.493947 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662fc134-f2bc-4acf-be1f-15f7edf0b35f None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:24.497388 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f657bfae-cf60-4126-b6c2-33b967785eb7 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:24.498578 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d27e0ac-fd34-4326-929d-72661255f4d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:24.499477 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d27e0ac-fd34-4326-929d-72661255f4d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:24.500105 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d27e0ac-fd34-4326-929d-72661255f4d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:24.500514 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d27e0ac-fd34-4326-929d-72661255f4d3 admin admin] PATH_INFO: `/v3/projects/ced1e252b82841b1ad54368c13349bda/users/77d32aad338c47eab5087ac911dcd5ea/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:24.502655 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c998a23-c602-4505-906b-b499e4ca3b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:24.503303 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c998a23-c602-4505-906b-b499e4ca3b00 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:24.503578 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c998a23-c602-4505-906b-b499e4ca3b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:24.503851 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c998a23-c602-4505-906b-b499e4ca3b00 admin admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:24.504671 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c998a23-c602-4505-906b-b499e4ca3b00 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:13:24.504971 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c998a23-c602-4505-906b-b499e4ca3b00 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:24.506576 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c998a23-c602-4505-906b-b499e4ca3b00 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:24.515548 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d27e0ac-fd34-4326-929d-72661255f4d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ced1e252b82841b1ad54368c13349bda, user_id=77d32aad338c47eab5087ac911dcd5ea, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:24.518316 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d27e0ac-fd34-4326-929d-72661255f4d3 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:24.519155 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 786/1560] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:13:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:13:24.520406 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a9b461-ab3e-49e2-9d4d-e3a4b77f68a9 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:24.520687 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a9b461-ab3e-49e2-9d4d-e3a4b77f68a9 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:24.520959 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a9b461-ab3e-49e2-9d4d-e3a4b77f68a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:24.549890 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 775/1561] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:13:24 2022] PUT /identity/v3/projects/ced1e252b82841b1ad54368c13349bda/users/77d32aad338c47eab5087ac911dcd5ea/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:13:24.549890 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91baa14d-461a-44d2-9a39-a2a2b59e4a25 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:24.549890 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91baa14d-461a-44d2-9a39-a2a2b59e4a25 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:24.549890 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91baa14d-461a-44d2-9a39-a2a2b59e4a25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:24.559801 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-d8a9b461-ab3e-49e2-9d4d-e3a4b77f68a9 None None] MFA Rules not processed for user `199522d29cb746379cb6f75d4b108cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:13:24.560011 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-91baa14d-461a-44d2-9a39-a2a2b59e4a25 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:13:24.561102 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-d8a9b461-ab3e-49e2-9d4d-e3a4b77f68a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:24.561231 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-91baa14d-461a-44d2-9a39-a2a2b59e4a25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:24.619184 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 776/1562] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:13:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:13:24.620043 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91baa14d-461a-44d2-9a39-a2a2b59e4a25 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:24.628749 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 787/1563] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:13:24 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:13:24.629661 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a9b461-ab3e-49e2-9d4d-e3a4b77f68a9 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:24.633404 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91baa14d-461a-44d2-9a39-a2a2b59e4a25 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:24.637972 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed29d549-d3bc-44ce-924e-bcd8bc390870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:24.638635 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed29d549-d3bc-44ce-924e-bcd8bc390870 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:24.638974 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed29d549-d3bc-44ce-924e-bcd8bc390870 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:24.639184 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed29d549-d3bc-44ce-924e-bcd8bc390870 admin admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:24.639913 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a9b461-ab3e-49e2-9d4d-e3a4b77f68a9 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:24.640008 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed29d549-d3bc-44ce-924e-bcd8bc390870 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:13:24.640221 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed29d549-d3bc-44ce-924e-bcd8bc390870 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:24.641891 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed29d549-d3bc-44ce-924e-bcd8bc390870 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:24.645550 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248495a7-45a2-4e7f-a97c-78dd0fcd5645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:24.646283 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248495a7-45a2-4e7f-a97c-78dd0fcd5645 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:24.646589 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248495a7-45a2-4e7f-a97c-78dd0fcd5645 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:24.646884 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248495a7-45a2-4e7f-a97c-78dd0fcd5645 admin admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:24.647617 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248495a7-45a2-4e7f-a97c-78dd0fcd5645 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:13:24.647919 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248495a7-45a2-4e7f-a97c-78dd0fcd5645 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:24.649551 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248495a7-45a2-4e7f-a97c-78dd0fcd5645 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:24.654284 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 777/1564] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:13:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:13:24.655338 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed29d549-d3bc-44ce-924e-bcd8bc390870 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:24.665557 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed29d549-d3bc-44ce-924e-bcd8bc390870 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:24.668901 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 788/1565] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:13:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:13:24.670371 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbd0ba3-4a53-4c66-ac8c-803e1c1f0c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:24.670955 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248495a7-45a2-4e7f-a97c-78dd0fcd5645 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:24.671085 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbd0ba3-4a53-4c66-ac8c-803e1c1f0c1e admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:24.671291 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbd0ba3-4a53-4c66-ac8c-803e1c1f0c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:24.671570 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbd0ba3-4a53-4c66-ac8c-803e1c1f0c1e admin admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:24.672289 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbd0ba3-4a53-4c66-ac8c-803e1c1f0c1e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:13:24.672619 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbd0ba3-4a53-4c66-ac8c-803e1c1f0c1e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:24.674265 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbd0ba3-4a53-4c66-ac8c-803e1c1f0c1e admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:24.681073 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248495a7-45a2-4e7f-a97c-78dd0fcd5645 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:24.685718 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a393f7d0-9135-4041-a072-3322d7485335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:24.686401 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a393f7d0-9135-4041-a072-3322d7485335 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:24.686677 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a393f7d0-9135-4041-a072-3322d7485335 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:24.686947 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a393f7d0-9135-4041-a072-3322d7485335 admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:24.687509 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 778/1566] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:13:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:13:24.687632 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a393f7d0-9135-4041-a072-3322d7485335 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:24.688494 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbd0ba3-4a53-4c66-ac8c-803e1c1f0c1e admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:24.689580 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a393f7d0-9135-4041-a072-3322d7485335 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:24.699158 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbd0ba3-4a53-4c66-ac8c-803e1c1f0c1e admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:24.706437 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd509d7-c55f-4a5d-94c4-6a7aebcbe07d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:24.707233 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd509d7-c55f-4a5d-94c4-6a7aebcbe07d admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:24.707592 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd509d7-c55f-4a5d-94c4-6a7aebcbe07d admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:24.707925 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd509d7-c55f-4a5d-94c4-6a7aebcbe07d admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:24.708830 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd509d7-c55f-4a5d-94c4-6a7aebcbe07d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:24.711070 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd509d7-c55f-4a5d-94c4-6a7aebcbe07d admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:24.718814 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 789/1567] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:13:24 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:13:24.723857 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b612e7-bb46-477a-aaf5-a0116020915a None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:24.724149 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b612e7-bb46-477a-aaf5-a0116020915a None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:24.724447 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b612e7-bb46-477a-aaf5-a0116020915a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:24.737514 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:13:24.740332 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 779/1568] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:13:24 2022] POST /identity/v3/projects => generated 399 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:13:24.741262 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd509d7-c55f-4a5d-94c4-6a7aebcbe07d admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:24.755110 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-31b612e7-bb46-477a-aaf5-a0116020915a None None] MFA Rules not processed for user `77d32aad338c47eab5087ac911dcd5ea`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:13:24.756501 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-31b612e7-bb46-477a-aaf5-a0116020915a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:24.805069 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:13:24.812035 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd509d7-c55f-4a5d-94c4-6a7aebcbe07d admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:24.817830 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5283df-f5f2-464f-acc3-878aa72a0a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:24.818545 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5283df-f5f2-464f-acc3-878aa72a0a97 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:24.818828 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5283df-f5f2-464f-acc3-878aa72a0a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:24.819106 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5283df-f5f2-464f-acc3-878aa72a0a97 admin admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:24.819995 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5283df-f5f2-464f-acc3-878aa72a0a97 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:13:24.820307 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5283df-f5f2-464f-acc3-878aa72a0a97 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:24.821966 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5283df-f5f2-464f-acc3-878aa72a0a97 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:24.830260 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 790/1569] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:13:24 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:13:24.833986 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b612e7-bb46-477a-aaf5-a0116020915a None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:24.842163 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 780/1570] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:13:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:13:24.842163 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5283df-f5f2-464f-acc3-878aa72a0a97 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:24.842508 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b612e7-bb46-477a-aaf5-a0116020915a None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:24.847011 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5283df-f5f2-464f-acc3-878aa72a0a97 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:24.847157 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129c5598-f6b9-4179-911a-4f01a02ce3e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:24.847737 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129c5598-f6b9-4179-911a-4f01a02ce3e7 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:24.848012 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129c5598-f6b9-4179-911a-4f01a02ce3e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:24.848280 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129c5598-f6b9-4179-911a-4f01a02ce3e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:24.848996 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129c5598-f6b9-4179-911a-4f01a02ce3e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:24.850943 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129c5598-f6b9-4179-911a-4f01a02ce3e7 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:24.852243 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5177df26-8ae3-4cc6-a6ea-98b165f0ea20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:24.852899 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5177df26-8ae3-4cc6-a6ea-98b165f0ea20 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:24.853182 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5177df26-8ae3-4cc6-a6ea-98b165f0ea20 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:24.853459 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5177df26-8ae3-4cc6-a6ea-98b165f0ea20 admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:24.854179 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5177df26-8ae3-4cc6-a6ea-98b165f0ea20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:24.856076 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5177df26-8ae3-4cc6-a6ea-98b165f0ea20 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:24.879942 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 791/1571] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:13:24 2022] POST /identity/v3/projects => generated 387 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:13:24.880768 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129c5598-f6b9-4179-911a-4f01a02ce3e7 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:24.883696 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 781/1572] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:13:24 2022] POST /identity/v3/projects => generated 381 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:13:24.884564 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5177df26-8ae3-4cc6-a6ea-98b165f0ea20 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:24.944300 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129c5598-f6b9-4179-911a-4f01a02ce3e7 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:24.947276 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5177df26-8ae3-4cc6-a6ea-98b165f0ea20 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:24.949179 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9f6641-748b-467b-babe-e1c53ed6db71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:24.949832 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9f6641-748b-467b-babe-e1c53ed6db71 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:24.950141 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9f6641-748b-467b-babe-e1c53ed6db71 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:24.950411 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9f6641-748b-467b-babe-e1c53ed6db71 admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:24.951098 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9f6641-748b-467b-babe-e1c53ed6db71 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:24.951963 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849002e6-87ff-4bf9-8f03-1141bfa197ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:24.952626 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849002e6-87ff-4bf9-8f03-1141bfa197ef admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:24.952904 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849002e6-87ff-4bf9-8f03-1141bfa197ef admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:24.953000 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9f6641-748b-467b-babe-e1c53ed6db71 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:24.953176 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849002e6-87ff-4bf9-8f03-1141bfa197ef admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:24.954009 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849002e6-87ff-4bf9-8f03-1141bfa197ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:24.955921 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849002e6-87ff-4bf9-8f03-1141bfa197ef admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:24.983713 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 792/1573] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:13:24 2022] POST /identity/v3/projects => generated 393 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:13:24.984595 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 782/1574] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:13:24 2022] POST /identity/v3/projects => generated 403 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:13:24.984716 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9f6641-748b-467b-babe-e1c53ed6db71 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:24.985395 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849002e6-87ff-4bf9-8f03-1141bfa197ef admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:25.049684 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9f6641-748b-467b-babe-e1c53ed6db71 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:25.054516 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b2ec22-a7ff-4f79-9434-1916239acd78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:25.055204 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b2ec22-a7ff-4f79-9434-1916239acd78 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:25.055483 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b2ec22-a7ff-4f79-9434-1916239acd78 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:25.055758 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b2ec22-a7ff-4f79-9434-1916239acd78 admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:25.056436 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849002e6-87ff-4bf9-8f03-1141bfa197ef admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:25.056539 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b2ec22-a7ff-4f79-9434-1916239acd78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:25.058423 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b2ec22-a7ff-4f79-9434-1916239acd78 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:25.060988 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74eb42f-272f-4018-98c2-e5e54d7182cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:25.061769 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74eb42f-272f-4018-98c2-e5e54d7182cb admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:25.062148 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74eb42f-272f-4018-98c2-e5e54d7182cb admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:25.062421 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74eb42f-272f-4018-98c2-e5e54d7182cb admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:25.063124 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74eb42f-272f-4018-98c2-e5e54d7182cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:25.065052 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74eb42f-272f-4018-98c2-e5e54d7182cb admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:25.065193 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:13:25.081132 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 793/1575] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:13:24 2022] POST /identity/v3/users => generated 292 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:13:25.082115 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b2ec22-a7ff-4f79-9434-1916239acd78 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:25.085966 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 783/1576] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:13:24 2022] POST /identity/v3/users => generated 300 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:13:25.087182 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74eb42f-272f-4018-98c2-e5e54d7182cb admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:25.091929 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b2ec22-a7ff-4f79-9434-1916239acd78 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:25.097048 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd1c992-8c36-4a2a-8919-605b1a64f3b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:25.097711 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd1c992-8c36-4a2a-8919-605b1a64f3b6 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:25.098024 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd1c992-8c36-4a2a-8919-605b1a64f3b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:25.098193 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74eb42f-272f-4018-98c2-e5e54d7182cb admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:25.098292 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd1c992-8c36-4a2a-8919-605b1a64f3b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:25.098963 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd1c992-8c36-4a2a-8919-605b1a64f3b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:25.100865 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd1c992-8c36-4a2a-8919-605b1a64f3b6 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:25.103630 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb9c4a2-3620-4ba7-aea9-ec38345cb46d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:25.104314 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb9c4a2-3620-4ba7-aea9-ec38345cb46d admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:25.104576 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb9c4a2-3620-4ba7-aea9-ec38345cb46d admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:25.104846 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb9c4a2-3620-4ba7-aea9-ec38345cb46d admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:25.105521 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb9c4a2-3620-4ba7-aea9-ec38345cb46d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:25.107475 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb9c4a2-3620-4ba7-aea9-ec38345cb46d admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:25.129236 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 794/1577] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:13:25 2022] POST /identity/v3/projects => generated 375 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:13:25.130213 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd1c992-8c36-4a2a-8919-605b1a64f3b6 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:25.141131 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 784/1578] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:13:25 2022] POST /identity/v3/projects => generated 393 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:13:25.141131 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb9c4a2-3620-4ba7-aea9-ec38345cb46d admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:25.160049 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:13:25.196974 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd1c992-8c36-4a2a-8919-605b1a64f3b6 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:25.201305 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb9c4a2-3620-4ba7-aea9-ec38345cb46d admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:25.201637 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2444429f-0e5d-4fc2-baf9-8b6435dcdafa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:25.202351 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2444429f-0e5d-4fc2-baf9-8b6435dcdafa admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:25.202646 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2444429f-0e5d-4fc2-baf9-8b6435dcdafa admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:25.202923 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2444429f-0e5d-4fc2-baf9-8b6435dcdafa admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:25.203584 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2444429f-0e5d-4fc2-baf9-8b6435dcdafa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:25.205551 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2444429f-0e5d-4fc2-baf9-8b6435dcdafa admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:25.205679 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4ec762-ed9c-4502-83c1-d55408b63be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:25.206326 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4ec762-ed9c-4502-83c1-d55408b63be6 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:25.206598 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4ec762-ed9c-4502-83c1-d55408b63be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:25.206867 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4ec762-ed9c-4502-83c1-d55408b63be6 admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:25.207545 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4ec762-ed9c-4502-83c1-d55408b63be6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:25.209459 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4ec762-ed9c-4502-83c1-d55408b63be6 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:25.227563 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 795/1579] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:13:25 2022] POST /identity/v3/users => generated 300 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:13:25.227563 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2444429f-0e5d-4fc2-baf9-8b6435dcdafa admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:25.232275 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 785/1580] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:13:25 2022] POST /identity/v3/users => generated 291 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:13:25.232275 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4ec762-ed9c-4502-83c1-d55408b63be6 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:25.241383 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2444429f-0e5d-4fc2-baf9-8b6435dcdafa admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:25.243329 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4ec762-ed9c-4502-83c1-d55408b63be6 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:25.246530 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba18d6c-68d8-4c26-861a-72f74fcbdea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:25.247215 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba18d6c-68d8-4c26-861a-72f74fcbdea1 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:25.247491 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba18d6c-68d8-4c26-861a-72f74fcbdea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:25.247903 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba18d6c-68d8-4c26-861a-72f74fcbdea1 admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:25.248277 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81fd354-d099-4e97-88fe-fc908ed3fcbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:25.248461 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba18d6c-68d8-4c26-861a-72f74fcbdea1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:25.248947 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81fd354-d099-4e97-88fe-fc908ed3fcbc admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:25.249227 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81fd354-d099-4e97-88fe-fc908ed3fcbc admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:25.249503 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81fd354-d099-4e97-88fe-fc908ed3fcbc admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:25.250604 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81fd354-d099-4e97-88fe-fc908ed3fcbc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:25.250857 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba18d6c-68d8-4c26-861a-72f74fcbdea1 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:25.252631 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81fd354-d099-4e97-88fe-fc908ed3fcbc admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:25.276168 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 796/1581] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:13:25 2022] POST /identity/v3/users => generated 297 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:13:25.276168 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba18d6c-68d8-4c26-861a-72f74fcbdea1 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:25.277159 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 786/1582] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:13:25 2022] POST /identity/v3/users => generated 302 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:13:25.277822 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81fd354-d099-4e97-88fe-fc908ed3fcbc admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:25.283485 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba18d6c-68d8-4c26-861a-72f74fcbdea1 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:25.287593 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81fd354-d099-4e97-88fe-fc908ed3fcbc admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:25.288156 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1635b1ec-6996-419d-bb4e-b706f7737013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:25.288818 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1635b1ec-6996-419d-bb4e-b706f7737013 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:25.289095 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1635b1ec-6996-419d-bb4e-b706f7737013 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:25.289437 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1635b1ec-6996-419d-bb4e-b706f7737013 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:25.290109 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1635b1ec-6996-419d-bb4e-b706f7737013 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:25.291764 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1635b1ec-6996-419d-bb4e-b706f7737013 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:25.292269 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab92c3f4-483c-4d5a-9c79-581eb4217b06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:25.292922 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab92c3f4-483c-4d5a-9c79-581eb4217b06 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:25.293199 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab92c3f4-483c-4d5a-9c79-581eb4217b06 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:25.293472 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab92c3f4-483c-4d5a-9c79-581eb4217b06 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:25.294217 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab92c3f4-483c-4d5a-9c79-581eb4217b06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:25.295829 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab92c3f4-483c-4d5a-9c79-581eb4217b06 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:25.302568 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 797/1583] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:13:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:13:25.303259 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1635b1ec-6996-419d-bb4e-b706f7737013 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:25.308888 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 787/1584] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:13:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:13:25.310769 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab92c3f4-483c-4d5a-9c79-581eb4217b06 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:25.312972 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1635b1ec-6996-419d-bb4e-b706f7737013 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:25.317548 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be4e3ce-2556-4d94-abad-06c3a11dec42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:25.318229 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be4e3ce-2556-4d94-abad-06c3a11dec42 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:25.318511 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be4e3ce-2556-4d94-abad-06c3a11dec42 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:25.318831 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be4e3ce-2556-4d94-abad-06c3a11dec42 admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:25.319555 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be4e3ce-2556-4d94-abad-06c3a11dec42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:25.321401 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab92c3f4-483c-4d5a-9c79-581eb4217b06 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:25.321607 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be4e3ce-2556-4d94-abad-06c3a11dec42 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:25.326282 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05342caf-9708-4141-a4d0-5eb44a79f9b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:25.326958 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05342caf-9708-4141-a4d0-5eb44a79f9b9 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:25.327240 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05342caf-9708-4141-a4d0-5eb44a79f9b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:25.327536 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05342caf-9708-4141-a4d0-5eb44a79f9b9 admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:25.328217 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05342caf-9708-4141-a4d0-5eb44a79f9b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:25.330177 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05342caf-9708-4141-a4d0-5eb44a79f9b9 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:25.342471 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 798/1585] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:13:25 2022] POST /identity/v3/users => generated 294 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:13:25.343287 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be4e3ce-2556-4d94-abad-06c3a11dec42 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:25.353518 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be4e3ce-2556-4d94-abad-06c3a11dec42 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:25.354281 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 788/1586] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:13:25 2022] POST /identity/v3/users => generated 297 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:13:25.355352 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05342caf-9708-4141-a4d0-5eb44a79f9b9 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:25.361190 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcc50cd-b3ba-473d-9172-c675c27764f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:25.361887 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcc50cd-b3ba-473d-9172-c675c27764f2 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:25.362167 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcc50cd-b3ba-473d-9172-c675c27764f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:25.362436 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcc50cd-b3ba-473d-9172-c675c27764f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:25.363155 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcc50cd-b3ba-473d-9172-c675c27764f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:25.364737 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcc50cd-b3ba-473d-9172-c675c27764f2 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:25.365414 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05342caf-9708-4141-a4d0-5eb44a79f9b9 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:25.371172 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15b42aa-a13c-4564-b48f-1992f81a135a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:25.371826 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15b42aa-a13c-4564-b48f-1992f81a135a admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:25.372105 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15b42aa-a13c-4564-b48f-1992f81a135a admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:25.372373 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15b42aa-a13c-4564-b48f-1992f81a135a admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:25.373085 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15b42aa-a13c-4564-b48f-1992f81a135a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:25.374734 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15b42aa-a13c-4564-b48f-1992f81a135a admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:25.375749 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 799/1587] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:13:25 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:13:25.376447 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcc50cd-b3ba-473d-9172-c675c27764f2 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:25.385784 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcc50cd-b3ba-473d-9172-c675c27764f2 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:25.385949 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 789/1588] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:13:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:13:25.386759 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15b42aa-a13c-4564-b48f-1992f81a135a admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:25.390498 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4a068d-9c8b-454d-bae8-b61658e756a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:25.391154 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4a068d-9c8b-454d-bae8-b61658e756a6 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:25.391477 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4a068d-9c8b-454d-bae8-b61658e756a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:25.391748 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4a068d-9c8b-454d-bae8-b61658e756a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:25.392456 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4a068d-9c8b-454d-bae8-b61658e756a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:25.394070 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4a068d-9c8b-454d-bae8-b61658e756a6 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:25.396510 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15b42aa-a13c-4564-b48f-1992f81a135a admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:25.401449 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8229bda-a6a4-4d43-9d9e-e513b99c1a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:25.402122 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8229bda-a6a4-4d43-9d9e-e513b99c1a7c admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:25.402399 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8229bda-a6a4-4d43-9d9e-e513b99c1a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:25.402673 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8229bda-a6a4-4d43-9d9e-e513b99c1a7c admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:25.403379 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8229bda-a6a4-4d43-9d9e-e513b99c1a7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:25.404960 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8229bda-a6a4-4d43-9d9e-e513b99c1a7c admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:25.405569 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 800/1589] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:13:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:13:25.406689 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4a068d-9c8b-454d-bae8-b61658e756a6 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:25.416956 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4a068d-9c8b-454d-bae8-b61658e756a6 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:25.421407 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 790/1590] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:13:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:13:25.421407 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8229bda-a6a4-4d43-9d9e-e513b99c1a7c admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:25.425439 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e908d162-9f32-475c-8dc1-7e19400b5c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:25.426150 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e908d162-9f32-475c-8dc1-7e19400b5c21 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:25.426432 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e908d162-9f32-475c-8dc1-7e19400b5c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:25.426707 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e908d162-9f32-475c-8dc1-7e19400b5c21 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:25.427427 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e908d162-9f32-475c-8dc1-7e19400b5c21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:25.429029 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e908d162-9f32-475c-8dc1-7e19400b5c21 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:25.429260 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8229bda-a6a4-4d43-9d9e-e513b99c1a7c admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:25.433781 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13224937-e2ad-4b77-a73b-c0233ba4372d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:25.434477 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13224937-e2ad-4b77-a73b-c0233ba4372d admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:25.435075 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13224937-e2ad-4b77-a73b-c0233ba4372d admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:25.435075 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13224937-e2ad-4b77-a73b-c0233ba4372d admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:25.435707 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13224937-e2ad-4b77-a73b-c0233ba4372d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:25.437287 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13224937-e2ad-4b77-a73b-c0233ba4372d admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:25.439568 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 801/1591] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:13:25 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:13:25.440326 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e908d162-9f32-475c-8dc1-7e19400b5c21 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:25.449953 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e908d162-9f32-475c-8dc1-7e19400b5c21 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:25.451943 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 791/1592] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:13:25 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:13:25.455883 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef998de-3a25-4a64-a619-2be3cf3c0f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:25.456115 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13224937-e2ad-4b77-a73b-c0233ba4372d admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:25.456624 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef998de-3a25-4a64-a619-2be3cf3c0f9b admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:25.457009 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef998de-3a25-4a64-a619-2be3cf3c0f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:25.457347 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef998de-3a25-4a64-a619-2be3cf3c0f9b admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:25.458151 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef998de-3a25-4a64-a619-2be3cf3c0f9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:25.459725 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef998de-3a25-4a64-a619-2be3cf3c0f9b admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:25.466265 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13224937-e2ad-4b77-a73b-c0233ba4372d admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:25.473408 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 802/1593] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:13:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:13:25.473408 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef998de-3a25-4a64-a619-2be3cf3c0f9b admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:25.473988 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bed4c1-e077-41e5-99bd-50f271df6d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:25.473988 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bed4c1-e077-41e5-99bd-50f271df6d41 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:25.473988 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bed4c1-e077-41e5-99bd-50f271df6d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:25.473988 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bed4c1-e077-41e5-99bd-50f271df6d41 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:25.474304 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bed4c1-e077-41e5-99bd-50f271df6d41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:25.474935 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bed4c1-e077-41e5-99bd-50f271df6d41 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:25.481007 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef998de-3a25-4a64-a619-2be3cf3c0f9b admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:25.485621 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 792/1594] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:13:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:13:25.485788 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d34517-aab7-4d6d-b1e9-142c6a020581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:25.486315 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bed4c1-e077-41e5-99bd-50f271df6d41 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:25.486768 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d34517-aab7-4d6d-b1e9-142c6a020581 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:25.487055 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d34517-aab7-4d6d-b1e9-142c6a020581 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:25.487328 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d34517-aab7-4d6d-b1e9-142c6a020581 admin admin] PATH_INFO: `/v3/projects/806cd8102111418d997221825848ad86/users/3959c498fb4f4454a42b7e6a7a7afb60/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:25.498069 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bed4c1-e077-41e5-99bd-50f271df6d41 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:25.503216 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d34517-aab7-4d6d-b1e9-142c6a020581 admin admin] RBAC: Authorizing `identity:create_grant(project_id=806cd8102111418d997221825848ad86, user_id=3959c498fb4f4454a42b7e6a7a7afb60, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:25.503506 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c11537-5cf7-41e8-8667-fd145681277e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:25.504161 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c11537-5cf7-41e8-8667-fd145681277e admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:25.504447 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c11537-5cf7-41e8-8667-fd145681277e admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:25.504710 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c11537-5cf7-41e8-8667-fd145681277e admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:25.505429 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c11537-5cf7-41e8-8667-fd145681277e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:25.506119 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d34517-aab7-4d6d-b1e9-142c6a020581 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:25.507045 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c11537-5cf7-41e8-8667-fd145681277e admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:25.517711 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 793/1595] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:13:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:13:25.519669 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 803/1596] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:13:25 2022] PUT /identity/v3/projects/806cd8102111418d997221825848ad86/users/3959c498fb4f4454a42b7e6a7a7afb60/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:13:25.522256 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c11537-5cf7-41e8-8667-fd145681277e admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:25.523636 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d34517-aab7-4d6d-b1e9-142c6a020581 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:25.528921 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:INSERT=14,keystone:SELECT=86 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:13:25.534176 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c11537-5cf7-41e8-8667-fd145681277e admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:25.590287 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d34517-aab7-4d6d-b1e9-142c6a020581 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:25.593471 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0563747a-45d9-4aff-af3b-4202084ffb0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:25.594202 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0563747a-45d9-4aff-af3b-4202084ffb0a admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:25.594515 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0563747a-45d9-4aff-af3b-4202084ffb0a admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:25.594786 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0563747a-45d9-4aff-af3b-4202084ffb0a admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:25.595512 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0563747a-45d9-4aff-af3b-4202084ffb0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:25.595617 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db9c9a2-ecfd-4858-8f39-c2d91d1695e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:25.596453 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db9c9a2-ecfd-4858-8f39-c2d91d1695e8 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:25.596827 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db9c9a2-ecfd-4858-8f39-c2d91d1695e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:25.597113 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0563747a-45d9-4aff-af3b-4202084ffb0a admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:25.597307 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db9c9a2-ecfd-4858-8f39-c2d91d1695e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:25.598157 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db9c9a2-ecfd-4858-8f39-c2d91d1695e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:25.599835 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db9c9a2-ecfd-4858-8f39-c2d91d1695e8 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:25.607306 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 794/1597] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:13:25 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:13:25.608110 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0563747a-45d9-4aff-af3b-4202084ffb0a admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:25.613353 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 804/1598] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:13:25 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:13:25.613353 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db9c9a2-ecfd-4858-8f39-c2d91d1695e8 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:25.614414 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:13:25.621937 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0563747a-45d9-4aff-af3b-4202084ffb0a admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:25.623493 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db9c9a2-ecfd-4858-8f39-c2d91d1695e8 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:25.628449 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fe0349-1dad-4b49-a176-d3022ff35c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:25.628886 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c6b69a-6533-4de7-a5d9-d28dc1a544eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:25.629390 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fe0349-1dad-4b49-a176-d3022ff35c16 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:25.629814 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fe0349-1dad-4b49-a176-d3022ff35c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:25.630053 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fe0349-1dad-4b49-a176-d3022ff35c16 admin admin] PATH_INFO: `/v3/projects/681566c31052436b9d2ce072e733f052/users/0e1fdaed25764b15a6f74a925ee81499/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:25.630177 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c6b69a-6533-4de7-a5d9-d28dc1a544eb admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:25.630458 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c6b69a-6533-4de7-a5d9-d28dc1a544eb admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:25.630850 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c6b69a-6533-4de7-a5d9-d28dc1a544eb admin admin] PATH_INFO: `/v3/projects/2366e681931c49118c1120350487bde5/users/95896f2064e34e5d82e9531e68aab170/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:25.647294 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fe0349-1dad-4b49-a176-d3022ff35c16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=681566c31052436b9d2ce072e733f052, user_id=0e1fdaed25764b15a6f74a925ee81499, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:25.648336 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c6b69a-6533-4de7-a5d9-d28dc1a544eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=2366e681931c49118c1120350487bde5, user_id=95896f2064e34e5d82e9531e68aab170, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:25.651282 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c6b69a-6533-4de7-a5d9-d28dc1a544eb admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:25.651672 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fe0349-1dad-4b49-a176-d3022ff35c16 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:25.665412 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 795/1599] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:13:25 2022] PUT /identity/v3/projects/2366e681931c49118c1120350487bde5/users/95896f2064e34e5d82e9531e68aab170/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:13:25.666459 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c6b69a-6533-4de7-a5d9-d28dc1a544eb admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:25.666745 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 805/1600] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:13:25 2022] PUT /identity/v3/projects/681566c31052436b9d2ce072e733f052/users/0e1fdaed25764b15a6f74a925ee81499/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:13:25.667563 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fe0349-1dad-4b49-a176-d3022ff35c16 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:25.730468 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fe0349-1dad-4b49-a176-d3022ff35c16 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:25.731352 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c6b69a-6533-4de7-a5d9-d28dc1a544eb admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:25.735207 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe510854-e615-4a97-966c-a0c076014c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:25.735885 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe510854-e615-4a97-966c-a0c076014c4a admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:25.736124 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f19b38-62a4-4a67-8a65-efb45648ad36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:25.736895 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe510854-e615-4a97-966c-a0c076014c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:25.736895 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe510854-e615-4a97-966c-a0c076014c4a admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:25.737082 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f19b38-62a4-4a67-8a65-efb45648ad36 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:25.737164 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe510854-e615-4a97-966c-a0c076014c4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:25.737294 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f19b38-62a4-4a67-8a65-efb45648ad36 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:25.737569 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f19b38-62a4-4a67-8a65-efb45648ad36 admin admin] PATH_INFO: `/v3/projects/8f68d489e9f245e98eb543d2d31e4f49/users/521d520fcbac4fbeae611ce8d7a0e74d/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:25.738801 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe510854-e615-4a97-966c-a0c076014c4a admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:25.749143 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 806/1601] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:13:25 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:13:25.750347 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe510854-e615-4a97-966c-a0c076014c4a admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:25.754159 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f19b38-62a4-4a67-8a65-efb45648ad36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f68d489e9f245e98eb543d2d31e4f49, user_id=521d520fcbac4fbeae611ce8d7a0e74d, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:25.756839 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f19b38-62a4-4a67-8a65-efb45648ad36 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:25.763085 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe510854-e615-4a97-966c-a0c076014c4a admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:25.768927 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ab3b1b-49c4-409e-ad5d-a8fadfb7538b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:25.769833 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ab3b1b-49c4-409e-ad5d-a8fadfb7538b admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:25.770144 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ab3b1b-49c4-409e-ad5d-a8fadfb7538b admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:25.770436 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ab3b1b-49c4-409e-ad5d-a8fadfb7538b admin admin] PATH_INFO: `/v3/projects/929fe29a08e04fd4b35cfa46882ffc92/users/ef5c4d542e1c4ceaba976d907a9fac04/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:25.772799 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 796/1602] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:13:25 2022] PUT /identity/v3/projects/8f68d489e9f245e98eb543d2d31e4f49/users/521d520fcbac4fbeae611ce8d7a0e74d/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:13:25.774767 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f19b38-62a4-4a67-8a65-efb45648ad36 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:25.788082 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ab3b1b-49c4-409e-ad5d-a8fadfb7538b admin admin] RBAC: Authorizing `identity:create_grant(project_id=929fe29a08e04fd4b35cfa46882ffc92, user_id=ef5c4d542e1c4ceaba976d907a9fac04, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:25.790857 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ab3b1b-49c4-409e-ad5d-a8fadfb7538b admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:25.816886 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 807/1603] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:13:25 2022] PUT /identity/v3/projects/929fe29a08e04fd4b35cfa46882ffc92/users/ef5c4d542e1c4ceaba976d907a9fac04/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:13:25.816886 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ab3b1b-49c4-409e-ad5d-a8fadfb7538b admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:25.855331 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f19b38-62a4-4a67-8a65-efb45648ad36 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:25.856291 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:13:25.871691 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ab3b1b-49c4-409e-ad5d-a8fadfb7538b admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:25.877044 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383d07fb-3f8b-4cde-8896-4f3f1cf60e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:25.877985 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383d07fb-3f8b-4cde-8896-4f3f1cf60e9c admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:25.878265 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383d07fb-3f8b-4cde-8896-4f3f1cf60e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:25.878537 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383d07fb-3f8b-4cde-8896-4f3f1cf60e9c admin admin] PATH_INFO: `/v3/projects/261deb211d6b45c39bbee3188d2ac559/users/b62c516b2d50424c80d7ac4549900639/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:25.893025 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383d07fb-3f8b-4cde-8896-4f3f1cf60e9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=261deb211d6b45c39bbee3188d2ac559, user_id=b62c516b2d50424c80d7ac4549900639, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:25.895798 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383d07fb-3f8b-4cde-8896-4f3f1cf60e9c admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:25.910061 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 808/1604] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:13:25 2022] PUT /identity/v3/projects/261deb211d6b45c39bbee3188d2ac559/users/b62c516b2d50424c80d7ac4549900639/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:13:25.910898 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383d07fb-3f8b-4cde-8896-4f3f1cf60e9c admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:25.913570 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82691d5-91ce-410b-a59f-3e85c30696b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:25.914295 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82691d5-91ce-410b-a59f-3e85c30696b4 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:25.914579 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82691d5-91ce-410b-a59f-3e85c30696b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:25.914861 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82691d5-91ce-410b-a59f-3e85c30696b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:25.915592 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82691d5-91ce-410b-a59f-3e85c30696b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:25.917232 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82691d5-91ce-410b-a59f-3e85c30696b4 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:25.928918 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 797/1605] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:13:25 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:13:25.930456 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2899ee-1675-48f7-b87c-c61235fe03c0 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:25.930770 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2899ee-1675-48f7-b87c-c61235fe03c0 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:25.931074 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2899ee-1675-48f7-b87c-c61235fe03c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:25.943135 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:13:25.958638 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-2c2899ee-1675-48f7-b87c-c61235fe03c0 None None] MFA Rules not processed for user `95896f2064e34e5d82e9531e68aab170`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:13:25.959852 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-2c2899ee-1675-48f7-b87c-c61235fe03c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:25.974193 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383d07fb-3f8b-4cde-8896-4f3f1cf60e9c admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:25.978911 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a22a239-4909-4f5e-997c-5b7df102204b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:25.979819 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a22a239-4909-4f5e-997c-5b7df102204b admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:25.980101 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a22a239-4909-4f5e-997c-5b7df102204b admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:25.980376 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a22a239-4909-4f5e-997c-5b7df102204b admin admin] PATH_INFO: `/v3/projects/c62a56af2f634cf49e7556c47b3215a6/users/5edd58f5094b474aa98cf79cbcbebd5b/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:25.994996 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a22a239-4909-4f5e-997c-5b7df102204b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c62a56af2f634cf49e7556c47b3215a6, user_id=5edd58f5094b474aa98cf79cbcbebd5b, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:25.997692 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a22a239-4909-4f5e-997c-5b7df102204b admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:26.012880 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 809/1606] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:13:25 2022] PUT /identity/v3/projects/c62a56af2f634cf49e7556c47b3215a6/users/5edd58f5094b474aa98cf79cbcbebd5b/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:13:26.014655 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cc2c2f-a763-44f5-a5be-b010f0bf2ef3 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:26.015070 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cc2c2f-a763-44f5-a5be-b010f0bf2ef3 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:26.015484 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cc2c2f-a763-44f5-a5be-b010f0bf2ef3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:26.038894 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 798/1607] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:13:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:13:26.039826 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2899ee-1675-48f7-b87c-c61235fe03c0 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:26.045715 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-63cc2c2f-a763-44f5-a5be-b010f0bf2ef3 None None] MFA Rules not processed for user `0e1fdaed25764b15a6f74a925ee81499`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:13:26.046943 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-63cc2c2f-a763-44f5-a5be-b010f0bf2ef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:26.053182 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2899ee-1675-48f7-b87c-c61235fe03c0 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:26.115822 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f423e61c-ad57-4076-97d4-18e771f4b5ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:26.116982 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f423e61c-ad57-4076-97d4-18e771f4b5ea admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:26.117260 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f423e61c-ad57-4076-97d4-18e771f4b5ea admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:26.117676 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f423e61c-ad57-4076-97d4-18e771f4b5ea admin admin] PATH_INFO: `/v3/projects/96a9cb5407034489a78b193ad1f092da/users/368262045c5746be82a4ec322a7f2265/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:26.121170 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 810/1608] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:13:26 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:13:26.122112 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cc2c2f-a763-44f5-a5be-b010f0bf2ef3 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:26.133999 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cc2c2f-a763-44f5-a5be-b010f0bf2ef3 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:26.134194 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f423e61c-ad57-4076-97d4-18e771f4b5ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=96a9cb5407034489a78b193ad1f092da, user_id=368262045c5746be82a4ec322a7f2265, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:26.136923 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f423e61c-ad57-4076-97d4-18e771f4b5ea admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:26.138534 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe1ffe4-e5e4-4452-961a-38a165649df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:26.139199 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe1ffe4-e5e4-4452-961a-38a165649df1 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:26.139473 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe1ffe4-e5e4-4452-961a-38a165649df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:26.139743 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe1ffe4-e5e4-4452-961a-38a165649df1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:26.140459 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe1ffe4-e5e4-4452-961a-38a165649df1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:26.142397 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe1ffe4-e5e4-4452-961a-38a165649df1 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:26.151583 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 799/1609] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:13:26 2022] PUT /identity/v3/projects/96a9cb5407034489a78b193ad1f092da/users/368262045c5746be82a4ec322a7f2265/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:13:26.163439 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 811/1610] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:13:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:13:26.163554 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88309559-3ce0-4de9-b3be-77e1a53e3846 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:26.163554 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88309559-3ce0-4de9-b3be-77e1a53e3846 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:26.163554 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88309559-3ce0-4de9-b3be-77e1a53e3846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:26.163768 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6748c602-e5aa-4967-bb25-d5b9b7d194f5 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:26.163768 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6748c602-e5aa-4967-bb25-d5b9b7d194f5 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:26.163768 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6748c602-e5aa-4967-bb25-d5b9b7d194f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:26.182451 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-88309559-3ce0-4de9-b3be-77e1a53e3846 None None] MFA Rules not processed for user `ef5c4d542e1c4ceaba976d907a9fac04`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:13:26.183679 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-88309559-3ce0-4de9-b3be-77e1a53e3846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:26.184677 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-6748c602-e5aa-4967-bb25-d5b9b7d194f5 None None] MFA Rules not processed for user `b62c516b2d50424c80d7ac4549900639`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:13:26.185929 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-6748c602-e5aa-4967-bb25-d5b9b7d194f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:26.204964 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:13:26.251339 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 800/1611] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:13:26 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:13:26.255206 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88309559-3ce0-4de9-b3be-77e1a53e3846 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:26.256835 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 812/1612] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:13:26 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:13:26.258168 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f5f42c-d474-4f7f-a078-e41cfea061fe None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:26.258458 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f5f42c-d474-4f7f-a078-e41cfea061fe None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:26.258732 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f5f42c-d474-4f7f-a078-e41cfea061fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:26.264296 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:13:26.285474 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-24f5f42c-d474-4f7f-a078-e41cfea061fe None None] MFA Rules not processed for user `5edd58f5094b474aa98cf79cbcbebd5b`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:13:26.286805 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-24f5f42c-d474-4f7f-a078-e41cfea061fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:26.320068 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88309559-3ce0-4de9-b3be-77e1a53e3846 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:26.324681 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd22b8e-dccb-466a-b190-a5a888743787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:26.325585 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd22b8e-dccb-466a-b190-a5a888743787 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:26.325880 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd22b8e-dccb-466a-b190-a5a888743787 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:26.326158 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd22b8e-dccb-466a-b190-a5a888743787 admin admin] PATH_INFO: `/v3/projects/806cd8102111418d997221825848ad86/users/3959c498fb4f4454a42b7e6a7a7afb60/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:26.328106 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd22b8e-dccb-466a-b190-a5a888743787 admin admin] RBAC: Authorizing `identity:create_grant(project_id=806cd8102111418d997221825848ad86, user_id=3959c498fb4f4454a42b7e6a7a7afb60, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:26.330931 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd22b8e-dccb-466a-b190-a5a888743787 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:26.341473 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 801/1613] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:13:26 2022] PUT /identity/v3/projects/806cd8102111418d997221825848ad86/users/3959c498fb4f4454a42b7e6a7a7afb60/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:13:26.349366 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd22b8e-dccb-466a-b190-a5a888743787 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:26.361849 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 813/1614] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:13:26 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:13:26.362755 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f5f42c-d474-4f7f-a078-e41cfea061fe None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:26.373433 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f5f42c-d474-4f7f-a078-e41cfea061fe None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:26.409747 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd22b8e-dccb-466a-b190-a5a888743787 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:26.414661 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7d7b6e-f6e0-4cd3-ab45-c291f7ff9832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:26.415541 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7d7b6e-f6e0-4cd3-ab45-c291f7ff9832 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:26.415819 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7d7b6e-f6e0-4cd3-ab45-c291f7ff9832 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:26.416088 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7d7b6e-f6e0-4cd3-ab45-c291f7ff9832 admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:26.416778 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7d7b6e-f6e0-4cd3-ab45-c291f7ff9832 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:26.418731 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7d7b6e-f6e0-4cd3-ab45-c291f7ff9832 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:26.430068 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa44921-1337-44a8-95c7-9375463efbd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:26.430734 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa44921-1337-44a8-95c7-9375463efbd2 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:26.431109 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa44921-1337-44a8-95c7-9375463efbd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:26.431386 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa44921-1337-44a8-95c7-9375463efbd2 admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:26.432063 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa44921-1337-44a8-95c7-9375463efbd2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:26.433982 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa44921-1337-44a8-95c7-9375463efbd2 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:26.454944 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 802/1615] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:13:26 2022] POST /identity/v3/projects => generated 383 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:13:26.456866 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fda5480-e70f-4784-bb75-a2417336c809 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:26.457301 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fda5480-e70f-4784-bb75-a2417336c809 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:26.457949 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fda5480-e70f-4784-bb75-a2417336c809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:26.467677 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 814/1616] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:13:26 2022] POST /identity/v3/projects => generated 399 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:13:26.468415 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa44921-1337-44a8-95c7-9375463efbd2 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:26.487582 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-0fda5480-e70f-4784-bb75-a2417336c809 None None] MFA Rules not processed for user `368262045c5746be82a4ec322a7f2265`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:13:26.488803 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-0fda5480-e70f-4784-bb75-a2417336c809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:26.508153 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:13:26.533724 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa44921-1337-44a8-95c7-9375463efbd2 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:26.539421 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9db5bcf-7c21-4df9-9ed9-ec064271f49a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:26.540389 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9db5bcf-7c21-4df9-9ed9-ec064271f49a admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:26.540670 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9db5bcf-7c21-4df9-9ed9-ec064271f49a admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:26.540942 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9db5bcf-7c21-4df9-9ed9-ec064271f49a admin admin] PATH_INFO: `/v3/projects/8f68d489e9f245e98eb543d2d31e4f49/users/521d520fcbac4fbeae611ce8d7a0e74d/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:26.542991 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9db5bcf-7c21-4df9-9ed9-ec064271f49a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f68d489e9f245e98eb543d2d31e4f49, user_id=521d520fcbac4fbeae611ce8d7a0e74d, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:26.545636 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9db5bcf-7c21-4df9-9ed9-ec064271f49a admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:26.556434 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 803/1617] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:13:26 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:13:26.556949 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 815/1618] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:13:26 2022] PUT /identity/v3/projects/8f68d489e9f245e98eb543d2d31e4f49/users/521d520fcbac4fbeae611ce8d7a0e74d/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:13:26.557567 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9db5bcf-7c21-4df9-9ed9-ec064271f49a admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:26.558012 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fda5480-e70f-4784-bb75-a2417336c809 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:26.575438 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fda5480-e70f-4784-bb75-a2417336c809 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:26.590801 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:13:26.624055 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9db5bcf-7c21-4df9-9ed9-ec064271f49a admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:26.629247 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d91a8c7-bd83-408f-a218-fbbc30a14b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:26.630045 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d91a8c7-bd83-408f-a218-fbbc30a14b6e admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:26.630320 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d91a8c7-bd83-408f-a218-fbbc30a14b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:26.630589 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d91a8c7-bd83-408f-a218-fbbc30a14b6e admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:26.631275 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d91a8c7-bd83-408f-a218-fbbc30a14b6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:26.633178 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d91a8c7-bd83-408f-a218-fbbc30a14b6e admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:26.638499 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef494ea5-6d09-426a-935d-c7ec023bbde3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:26.639147 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef494ea5-6d09-426a-935d-c7ec023bbde3 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:26.639421 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef494ea5-6d09-426a-935d-c7ec023bbde3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:26.639693 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef494ea5-6d09-426a-935d-c7ec023bbde3 admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:26.640381 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef494ea5-6d09-426a-935d-c7ec023bbde3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:26.642416 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef494ea5-6d09-426a-935d-c7ec023bbde3 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:26.659870 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 816/1619] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:13:26 2022] POST /identity/v3/projects => generated 403 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:13:26.661560 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc72ded-9756-406b-baa8-5031d7739018 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:26.661847 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc72ded-9756-406b-baa8-5031d7739018 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:26.662140 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc72ded-9756-406b-baa8-5031d7739018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:26.669977 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 804/1620] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:13:26 2022] POST /identity/v3/projects => generated 383 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:13:26.670845 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef494ea5-6d09-426a-935d-c7ec023bbde3 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:26.690278 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-5bc72ded-9756-406b-baa8-5031d7739018 None None] MFA Rules not processed for user `3959c498fb4f4454a42b7e6a7a7afb60`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:13:26.691872 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-5bc72ded-9756-406b-baa8-5031d7739018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:26.734021 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef494ea5-6d09-426a-935d-c7ec023bbde3 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:26.740843 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f440228-2a36-4599-a85d-d800afa53f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:26.741514 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f440228-2a36-4599-a85d-d800afa53f2f admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:26.741792 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f440228-2a36-4599-a85d-d800afa53f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:26.742122 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f440228-2a36-4599-a85d-d800afa53f2f admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:26.742814 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f440228-2a36-4599-a85d-d800afa53f2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:26.747260 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f440228-2a36-4599-a85d-d800afa53f2f admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:26.770558 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 817/1621] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:13:26 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:13:26.771614 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc72ded-9756-406b-baa8-5031d7739018 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:26.783847 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 805/1622] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:13:26 2022] POST /identity/v3/projects => generated 393 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:13:26.783847 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f440228-2a36-4599-a85d-d800afa53f2f admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:26.784111 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc72ded-9756-406b-baa8-5031d7739018 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:26.821567 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:13:26.841926 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2359ec44-dfea-4d9f-8e59-afda1f3e501c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:26.842619 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2359ec44-dfea-4d9f-8e59-afda1f3e501c admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:26.842902 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2359ec44-dfea-4d9f-8e59-afda1f3e501c admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:26.843177 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2359ec44-dfea-4d9f-8e59-afda1f3e501c admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:26.843869 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2359ec44-dfea-4d9f-8e59-afda1f3e501c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:26.845944 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2359ec44-dfea-4d9f-8e59-afda1f3e501c admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:26.859681 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f440228-2a36-4599-a85d-d800afa53f2f admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:26.864442 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6709cdb3-3662-4216-b6aa-61e3886cb694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:26.865121 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6709cdb3-3662-4216-b6aa-61e3886cb694 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:26.865395 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6709cdb3-3662-4216-b6aa-61e3886cb694 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:26.865662 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6709cdb3-3662-4216-b6aa-61e3886cb694 admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:26.866377 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6709cdb3-3662-4216-b6aa-61e3886cb694 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:26.870132 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 818/1623] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:13:26 2022] POST /identity/v3/users => generated 298 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:13:26.870132 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2359ec44-dfea-4d9f-8e59-afda1f3e501c admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:26.870347 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6709cdb3-3662-4216-b6aa-61e3886cb694 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:26.878372 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2359ec44-dfea-4d9f-8e59-afda1f3e501c admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:26.883224 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485a8595-2ff7-4691-ba8a-9ea2066fc1cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:26.883931 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485a8595-2ff7-4691-ba8a-9ea2066fc1cd admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:26.884212 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485a8595-2ff7-4691-ba8a-9ea2066fc1cd admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:26.884511 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485a8595-2ff7-4691-ba8a-9ea2066fc1cd admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:26.885192 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485a8595-2ff7-4691-ba8a-9ea2066fc1cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:26.887225 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485a8595-2ff7-4691-ba8a-9ea2066fc1cd admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:26.890712 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 806/1624] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:13:26 2022] POST /identity/v3/users => generated 306 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:13:26.892045 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5931b8d-3928-45d2-92da-cc708797924a None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:26.892326 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5931b8d-3928-45d2-92da-cc708797924a None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:26.892595 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5931b8d-3928-45d2-92da-cc708797924a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:26.918187 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 819/1625] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:13:26 2022] POST /identity/v3/projects => generated 393 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:13:26.921548 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-a5931b8d-3928-45d2-92da-cc708797924a None None] MFA Rules not processed for user `521d520fcbac4fbeae611ce8d7a0e74d`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:13:26.921548 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-a5931b8d-3928-45d2-92da-cc708797924a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:26.922668 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485a8595-2ff7-4691-ba8a-9ea2066fc1cd admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:26.925541 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:13:26.986123 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485a8595-2ff7-4691-ba8a-9ea2066fc1cd admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:26.990474 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 807/1626] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:13:26 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:13:26.991308 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5931b8d-3928-45d2-92da-cc708797924a None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:26.994133 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaa1768-9505-473e-a597-99d23b784289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:26.995154 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaa1768-9505-473e-a597-99d23b784289 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:26.995334 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaa1768-9505-473e-a597-99d23b784289 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:26.995710 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaa1768-9505-473e-a597-99d23b784289 admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:26.996500 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaa1768-9505-473e-a597-99d23b784289 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:26.998722 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaa1768-9505-473e-a597-99d23b784289 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:27.002508 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5931b8d-3928-45d2-92da-cc708797924a None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:27.007561 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5e7542-5745-425b-84a5-c221386dffc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:27.007812 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5e7542-5745-425b-84a5-c221386dffc9 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:27.008350 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5e7542-5745-425b-84a5-c221386dffc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:27.008517 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5e7542-5745-425b-84a5-c221386dffc9 admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:27.009232 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5e7542-5745-425b-84a5-c221386dffc9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:27.011236 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5e7542-5745-425b-84a5-c221386dffc9 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:27.025925 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 820/1627] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:13:26 2022] POST /identity/v3/users => generated 308 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:13:27.025925 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7334567-94d0-49de-8a12-2d89ea2b83d9 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:27.025925 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7334567-94d0-49de-8a12-2d89ea2b83d9 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:27.026320 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7334567-94d0-49de-8a12-2d89ea2b83d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:27.037284 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 808/1628] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:13:26 2022] POST /identity/v3/users => generated 298 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:13:27.038380 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5e7542-5745-425b-84a5-c221386dffc9 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:27.044637 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-b7334567-94d0-49de-8a12-2d89ea2b83d9 None None] MFA Rules not processed for user `199522d29cb746379cb6f75d4b108cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:13:27.045825 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-b7334567-94d0-49de-8a12-2d89ea2b83d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:27.048601 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5e7542-5745-425b-84a5-c221386dffc9 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:27.053139 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabddd24-8910-4a2b-9d53-3bd9c150a4b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:27.053803 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabddd24-8910-4a2b-9d53-3bd9c150a4b6 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:27.054118 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabddd24-8910-4a2b-9d53-3bd9c150a4b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:27.054388 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabddd24-8910-4a2b-9d53-3bd9c150a4b6 admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:27.055064 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabddd24-8910-4a2b-9d53-3bd9c150a4b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:27.057018 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabddd24-8910-4a2b-9d53-3bd9c150a4b6 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:27.082948 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 809/1629] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:13:27 2022] POST /identity/v3/users => generated 303 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:13:27.083824 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabddd24-8910-4a2b-9d53-3bd9c150a4b6 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:27.094765 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabddd24-8910-4a2b-9d53-3bd9c150a4b6 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:27.100883 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623de507-52cb-4aa3-ac6f-d7f5ff2ecf96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:27.101579 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623de507-52cb-4aa3-ac6f-d7f5ff2ecf96 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:27.101886 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623de507-52cb-4aa3-ac6f-d7f5ff2ecf96 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:27.102169 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623de507-52cb-4aa3-ac6f-d7f5ff2ecf96 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:27.102916 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623de507-52cb-4aa3-ac6f-d7f5ff2ecf96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:27.104548 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623de507-52cb-4aa3-ac6f-d7f5ff2ecf96 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:27.112737 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 821/1630] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:13:27 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:13:27.113698 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7334567-94d0-49de-8a12-2d89ea2b83d9 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:27.116552 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 810/1631] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:13:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:13:27.117619 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623de507-52cb-4aa3-ac6f-d7f5ff2ecf96 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:27.127770 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7334567-94d0-49de-8a12-2d89ea2b83d9 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:27.128528 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623de507-52cb-4aa3-ac6f-d7f5ff2ecf96 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:27.133119 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6785e3b-a4d9-448e-9c47-c61f43454a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:27.133906 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6785e3b-a4d9-448e-9c47-c61f43454a9e admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:27.134893 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be582d72-a4ce-4416-8d0b-e67e67bbed88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:27.135676 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be582d72-a4ce-4416-8d0b-e67e67bbed88 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:27.136228 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be582d72-a4ce-4416-8d0b-e67e67bbed88 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:27.136332 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be582d72-a4ce-4416-8d0b-e67e67bbed88 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:27.136608 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6785e3b-a4d9-448e-9c47-c61f43454a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:27.137090 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6785e3b-a4d9-448e-9c47-c61f43454a9e admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:27.137528 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be582d72-a4ce-4416-8d0b-e67e67bbed88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:27.139406 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be582d72-a4ce-4416-8d0b-e67e67bbed88 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:27.139910 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6785e3b-a4d9-448e-9c47-c61f43454a9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:27.144140 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6785e3b-a4d9-448e-9c47-c61f43454a9e admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:27.157297 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 822/1632] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:13:27 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:13:27.157297 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd49d5b9-2616-4d5d-9d99-a8778a227931 None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:27.157297 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd49d5b9-2616-4d5d-9d99-a8778a227931 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:27.157297 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd49d5b9-2616-4d5d-9d99-a8778a227931 None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:27.161965 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 823/1633] 10.222.0.17 () {54 vars in 962 bytes} [Sat Jul 23 21:13:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:13:27.162952 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd49d5b9-2616-4d5d-9d99-a8778a227931 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:27.167064 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 811/1634] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:13:27 2022] POST /identity/v3/users => generated 303 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:13:27.168113 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6785e3b-a4d9-448e-9c47-c61f43454a9e admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:27.176361 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd49d5b9-2616-4d5d-9d99-a8778a227931 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:27.178230 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6785e3b-a4d9-448e-9c47-c61f43454a9e admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:27.181028 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9140b50f-409b-44fd-abe1-734f05fedf8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:27.181687 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9140b50f-409b-44fd-abe1-734f05fedf8e admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:27.181996 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9140b50f-409b-44fd-abe1-734f05fedf8e admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:27.182270 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9140b50f-409b-44fd-abe1-734f05fedf8e admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:27.182843 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200aaedb-e76e-4395-90ad-97295c600159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:27.182990 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9140b50f-409b-44fd-abe1-734f05fedf8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:27.183493 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200aaedb-e76e-4395-90ad-97295c600159 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:27.183876 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200aaedb-e76e-4395-90ad-97295c600159 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:27.184173 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200aaedb-e76e-4395-90ad-97295c600159 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:27.184591 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9140b50f-409b-44fd-abe1-734f05fedf8e admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:27.184889 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200aaedb-e76e-4395-90ad-97295c600159 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:27.186504 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200aaedb-e76e-4395-90ad-97295c600159 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:27.195168 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 824/1635] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:13:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:13:27.195985 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9140b50f-409b-44fd-abe1-734f05fedf8e admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:27.199915 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 812/1636] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:13:27 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:13:27.199915 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200aaedb-e76e-4395-90ad-97295c600159 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:27.206170 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9140b50f-409b-44fd-abe1-734f05fedf8e admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:27.208429 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200aaedb-e76e-4395-90ad-97295c600159 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:27.210761 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be52ddf-37d2-45dc-a8c7-3336014beca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:27.211423 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be52ddf-37d2-45dc-a8c7-3336014beca1 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:27.211702 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be52ddf-37d2-45dc-a8c7-3336014beca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:27.211978 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be52ddf-37d2-45dc-a8c7-3336014beca1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:27.212694 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be52ddf-37d2-45dc-a8c7-3336014beca1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:27.212937 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855ff8d2-4168-41ad-a2eb-2bac6401d47d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:27.213805 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855ff8d2-4168-41ad-a2eb-2bac6401d47d admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:27.214119 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855ff8d2-4168-41ad-a2eb-2bac6401d47d admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:27.214323 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be52ddf-37d2-45dc-a8c7-3336014beca1 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:27.214415 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855ff8d2-4168-41ad-a2eb-2bac6401d47d admin admin] PATH_INFO: `/v3/projects/e9da90b237c34e5dad70af3cd2742be5/users/ff29128277cb4b6eaf78a8a62dd2b725/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:27.228786 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 825/1637] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:13:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:13:27.228786 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a955d88-84b3-452d-a01b-a7404030ee1a None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:27.228786 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a955d88-84b3-452d-a01b-a7404030ee1a None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:27.228786 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a955d88-84b3-452d-a01b-a7404030ee1a None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:27.229384 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 826/1638] 10.222.0.17 () {54 vars in 962 bytes} [Sat Jul 23 21:13:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:13:27.229629 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a955d88-84b3-452d-a01b-a7404030ee1a None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:27.234750 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855ff8d2-4168-41ad-a2eb-2bac6401d47d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9da90b237c34e5dad70af3cd2742be5, user_id=ff29128277cb4b6eaf78a8a62dd2b725, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:27.237697 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855ff8d2-4168-41ad-a2eb-2bac6401d47d admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:27.243876 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a955d88-84b3-452d-a01b-a7404030ee1a None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:27.249231 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba270df4-bdec-475f-8eb6-bd234248e835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:27.250551 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba270df4-bdec-475f-8eb6-bd234248e835 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:27.250876 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba270df4-bdec-475f-8eb6-bd234248e835 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:27.251136 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba270df4-bdec-475f-8eb6-bd234248e835 admin admin] PATH_INFO: `/v3/projects/91b039b789a9402796ffb5eee541b3d3/users/37598ed1e36d4e81936d5ad3cf35612b/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:27.254271 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 813/1639] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:13:27 2022] PUT /identity/v3/projects/e9da90b237c34e5dad70af3cd2742be5/users/ff29128277cb4b6eaf78a8a62dd2b725/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:13:27.255616 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:13:27.255759 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a461de-ea92-4b3c-9a37-8825c6834489 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:27.256045 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a461de-ea92-4b3c-9a37-8825c6834489 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:27.256315 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a461de-ea92-4b3c-9a37-8825c6834489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:27.271995 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba270df4-bdec-475f-8eb6-bd234248e835 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91b039b789a9402796ffb5eee541b3d3, user_id=37598ed1e36d4e81936d5ad3cf35612b, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:27.275719 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba270df4-bdec-475f-8eb6-bd234248e835 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:27.290089 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 827/1640] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:13:27 2022] PUT /identity/v3/projects/91b039b789a9402796ffb5eee541b3d3/users/37598ed1e36d4e81936d5ad3cf35612b/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:13:27.290994 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba270df4-bdec-475f-8eb6-bd234248e835 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:27.295408 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-26a461de-ea92-4b3c-9a37-8825c6834489 None None] MFA Rules not processed for user `079f31ed2c844e67bd4e206f24b69d97`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:13:27.296619 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-26a461de-ea92-4b3c-9a37-8825c6834489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:27.342623 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:13:27.356045 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba270df4-bdec-475f-8eb6-bd234248e835 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:27.360702 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe16dd22-c839-493a-87c3-28eab57b23df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:27.361382 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe16dd22-c839-493a-87c3-28eab57b23df admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:27.361661 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe16dd22-c839-493a-87c3-28eab57b23df admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:27.361971 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe16dd22-c839-493a-87c3-28eab57b23df admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:27.362695 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe16dd22-c839-493a-87c3-28eab57b23df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:27.364300 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe16dd22-c839-493a-87c3-28eab57b23df admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:27.365903 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 814/1641] 10.222.0.17 () {58 vars in 1059 bytes} [Sat Jul 23 21:13:27 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:13:27.367279 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a461de-ea92-4b3c-9a37-8825c6834489 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:27.376317 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 828/1642] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:13:27 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:13:27.377309 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe16dd22-c839-493a-87c3-28eab57b23df admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:27.379677 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a461de-ea92-4b3c-9a37-8825c6834489 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:27.384464 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237d716c-e154-4f29-af3c-feae836ee2e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:27.385376 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237d716c-e154-4f29-af3c-feae836ee2e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:27.385758 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237d716c-e154-4f29-af3c-feae836ee2e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:27.386094 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237d716c-e154-4f29-af3c-feae836ee2e5 admin admin] PATH_INFO: `/v3/projects/c39959ed6b824c75a46b058008ce3bd6/users/cdd2a325dc5a4e0fa1d3b679afb5d863/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:27.389174 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe16dd22-c839-493a-87c3-28eab57b23df admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:27.394156 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e0c794-b290-44b7-a753-f910ba6cfc9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:27.395081 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e0c794-b290-44b7-a753-f910ba6cfc9e admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:27.395769 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e0c794-b290-44b7-a753-f910ba6cfc9e admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:27.395769 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e0c794-b290-44b7-a753-f910ba6cfc9e admin admin] PATH_INFO: `/v3/projects/55b250efc0d94d91a943680a3b56d71e/users/74a49bad80d14c8eb6b5c19903a1b3aa/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:27.402161 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237d716c-e154-4f29-af3c-feae836ee2e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c39959ed6b824c75a46b058008ce3bd6, user_id=cdd2a325dc5a4e0fa1d3b679afb5d863, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:27.404882 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237d716c-e154-4f29-af3c-feae836ee2e5 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:27.412232 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e0c794-b290-44b7-a753-f910ba6cfc9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=55b250efc0d94d91a943680a3b56d71e, user_id=74a49bad80d14c8eb6b5c19903a1b3aa, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:27.415233 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e0c794-b290-44b7-a753-f910ba6cfc9e admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:27.422189 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 815/1643] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:13:27 2022] PUT /identity/v3/projects/c39959ed6b824c75a46b058008ce3bd6/users/cdd2a325dc5a4e0fa1d3b679afb5d863/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:13:27.423182 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237d716c-e154-4f29-af3c-feae836ee2e5 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:27.429805 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 829/1644] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:13:27 2022] PUT /identity/v3/projects/55b250efc0d94d91a943680a3b56d71e/users/74a49bad80d14c8eb6b5c19903a1b3aa/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:13:27.431325 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594f098a-5c72-474d-a110-53f77599913f None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:27.431677 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594f098a-5c72-474d-a110-53f77599913f None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:27.431958 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594f098a-5c72-474d-a110-53f77599913f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:27.449123 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-594f098a-5c72-474d-a110-53f77599913f None None] MFA Rules not processed for user `079f31ed2c844e67bd4e206f24b69d97`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:13:27.450405 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-594f098a-5c72-474d-a110-53f77599913f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:27.488467 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237d716c-e154-4f29-af3c-feae836ee2e5 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:27.519534 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 830/1645] 10.222.0.17 () {58 vars in 1059 bytes} [Sat Jul 23 21:13:27 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:13:27.520523 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594f098a-5c72-474d-a110-53f77599913f None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:27.547349 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d7dfe4-cb2d-4341-aad0-a01b0790d4b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:27.548357 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d7dfe4-cb2d-4341-aad0-a01b0790d4b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:27.548660 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d7dfe4-cb2d-4341-aad0-a01b0790d4b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:27.548926 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d7dfe4-cb2d-4341-aad0-a01b0790d4b5 admin admin] PATH_INFO: `/v3/projects/769afe32bc5d48dd9e24186168aaa3e1/users/2f243774c8494e10b8b1690f2da39b82/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:27.563483 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d7dfe4-cb2d-4341-aad0-a01b0790d4b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=769afe32bc5d48dd9e24186168aaa3e1, user_id=2f243774c8494e10b8b1690f2da39b82, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:27.566390 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d7dfe4-cb2d-4341-aad0-a01b0790d4b5 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:27.572116 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:13:27.581024 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 816/1646] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:13:27 2022] PUT /identity/v3/projects/769afe32bc5d48dd9e24186168aaa3e1/users/2f243774c8494e10b8b1690f2da39b82/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:13:27.581842 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d7dfe4-cb2d-4341-aad0-a01b0790d4b5 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:27.589091 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594f098a-5c72-474d-a110-53f77599913f None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:27.634645 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:13:27.650210 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d7dfe4-cb2d-4341-aad0-a01b0790d4b5 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:27.655861 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad6df3e-4a36-4485-b451-baeff97f8660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:27.656551 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad6df3e-4a36-4485-b451-baeff97f8660 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:27.656851 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad6df3e-4a36-4485-b451-baeff97f8660 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:27.657243 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad6df3e-4a36-4485-b451-baeff97f8660 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:27.658027 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad6df3e-4a36-4485-b451-baeff97f8660 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:27.659529 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8fc98b-57bf-4e01-8b87-00dd07423c53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:27.659657 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad6df3e-4a36-4485-b451-baeff97f8660 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:27.660210 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8fc98b-57bf-4e01-8b87-00dd07423c53 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:27.660489 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8fc98b-57bf-4e01-8b87-00dd07423c53 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:27.660763 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8fc98b-57bf-4e01-8b87-00dd07423c53 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:27.661491 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8fc98b-57bf-4e01-8b87-00dd07423c53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:27.663327 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8fc98b-57bf-4e01-8b87-00dd07423c53 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:27.670177 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 817/1647] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:13:27 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:13:27.671198 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad6df3e-4a36-4485-b451-baeff97f8660 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:27.673972 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 831/1648] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:13:27 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:13:27.674828 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8fc98b-57bf-4e01-8b87-00dd07423c53 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:27.687155 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8fc98b-57bf-4e01-8b87-00dd07423c53 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:27.692220 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb40c202-a7e9-47ab-9985-e8bed55d2c8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:27.693124 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb40c202-a7e9-47ab-9985-e8bed55d2c8b admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:27.693404 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb40c202-a7e9-47ab-9985-e8bed55d2c8b admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:27.693673 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb40c202-a7e9-47ab-9985-e8bed55d2c8b admin admin] PATH_INFO: `/v3/projects/ded4be9c03a54ecdbd517999f984ddf5/users/24a24a4a7bd844039d18a56fe9d1cf1e/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:27.709374 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb40c202-a7e9-47ab-9985-e8bed55d2c8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ded4be9c03a54ecdbd517999f984ddf5, user_id=24a24a4a7bd844039d18a56fe9d1cf1e, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:27.712443 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb40c202-a7e9-47ab-9985-e8bed55d2c8b admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:27.727721 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 832/1649] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:13:27 2022] PUT /identity/v3/projects/ded4be9c03a54ecdbd517999f984ddf5/users/24a24a4a7bd844039d18a56fe9d1cf1e/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:13:27.728660 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb40c202-a7e9-47ab-9985-e8bed55d2c8b admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:27.747004 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad6df3e-4a36-4485-b451-baeff97f8660 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:27.790871 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb40c202-a7e9-47ab-9985-e8bed55d2c8b admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:27.795679 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e50c3a6-ac78-4939-b749-6a661cbe2849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:27.796354 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e50c3a6-ac78-4939-b749-6a661cbe2849 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:27.796637 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e50c3a6-ac78-4939-b749-6a661cbe2849 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:27.796906 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e50c3a6-ac78-4939-b749-6a661cbe2849 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:27.797741 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e50c3a6-ac78-4939-b749-6a661cbe2849 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:27.799483 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e50c3a6-ac78-4939-b749-6a661cbe2849 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:27.812598 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 833/1650] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:13:27 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:13:27.812806 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc75423f-5ee8-4e7f-a82d-71d18f37a4f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:27.812923 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e50c3a6-ac78-4939-b749-6a661cbe2849 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:27.813005 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc75423f-5ee8-4e7f-a82d-71d18f37a4f7 service nova] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:27.813005 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc75423f-5ee8-4e7f-a82d-71d18f37a4f7 service nova] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:27.813005 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc75423f-5ee8-4e7f-a82d-71d18f37a4f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:27.827052 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e50c3a6-ac78-4939-b749-6a661cbe2849 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:27.832055 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408f81a1-7c1d-460a-aae9-28abd9a054ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:27.832842 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408f81a1-7c1d-460a-aae9-28abd9a054ad admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:27.833757 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408f81a1-7c1d-460a-aae9-28abd9a054ad admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:27.833757 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408f81a1-7c1d-460a-aae9-28abd9a054ad admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:27.834362 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408f81a1-7c1d-460a-aae9-28abd9a054ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:27.836023 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408f81a1-7c1d-460a-aae9-28abd9a054ad admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:27.846496 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 834/1651] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:13:27 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:13:27.850511 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408f81a1-7c1d-460a-aae9-28abd9a054ad admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:27.862855 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408f81a1-7c1d-460a-aae9-28abd9a054ad admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:27.870120 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be58ed9-a6b8-4974-a0e7-e56192575194 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:27.871008 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be58ed9-a6b8-4974-a0e7-e56192575194 service nova] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:27.871386 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be58ed9-a6b8-4974-a0e7-e56192575194 service nova] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:27.871787 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be58ed9-a6b8-4974-a0e7-e56192575194 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:27.873461 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc75423f-5ee8-4e7f-a82d-71d18f37a4f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:27.875723 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc75423f-5ee8-4e7f-a82d-71d18f37a4f7 service nova] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:27.889234 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 818/1652] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:13:27 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:13:27.890083 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc75423f-5ee8-4e7f-a82d-71d18f37a4f7 service nova] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:27.902407 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc75423f-5ee8-4e7f-a82d-71d18f37a4f7 service nova] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:27.918545 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17799a4d-267d-4c3f-b985-710abf2c12b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:27.922440 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17799a4d-267d-4c3f-b985-710abf2c12b7 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:27.922896 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17799a4d-267d-4c3f-b985-710abf2c12b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:27.923265 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17799a4d-267d-4c3f-b985-710abf2c12b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:27.924127 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17799a4d-267d-4c3f-b985-710abf2c12b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:27.925827 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17799a4d-267d-4c3f-b985-710abf2c12b7 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:27.937236 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:13:27.940748 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 819/1653] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:13:27 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:13:27.940748 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17799a4d-267d-4c3f-b985-710abf2c12b7 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:27.947370 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:13:27.949889 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17799a4d-267d-4c3f-b985-710abf2c12b7 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:27.952245 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be58ed9-a6b8-4974-a0e7-e56192575194 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:27.954462 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be58ed9-a6b8-4974-a0e7-e56192575194 service nova] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:27.956036 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f413b31a-2df4-4c2f-8adf-cc92a4d6c856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:27.957020 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f413b31a-2df4-4c2f-8adf-cc92a4d6c856 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:27.957359 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f413b31a-2df4-4c2f-8adf-cc92a4d6c856 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:27.957816 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f413b31a-2df4-4c2f-8adf-cc92a4d6c856 admin admin] PATH_INFO: `/v3/projects/91b039b789a9402796ffb5eee541b3d3/users/37598ed1e36d4e81936d5ad3cf35612b/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:27.962458 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f413b31a-2df4-4c2f-8adf-cc92a4d6c856 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91b039b789a9402796ffb5eee541b3d3, user_id=37598ed1e36d4e81936d5ad3cf35612b, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:27.965396 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f413b31a-2df4-4c2f-8adf-cc92a4d6c856 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:27.965507 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 835/1654] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:13:27 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:13:27.967099 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be58ed9-a6b8-4974-a0e7-e56192575194 service nova] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:27.976225 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 820/1655] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:13:27 2022] PUT /identity/v3/projects/91b039b789a9402796ffb5eee541b3d3/users/37598ed1e36d4e81936d5ad3cf35612b/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:13:27.978138 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f413b31a-2df4-4c2f-8adf-cc92a4d6c856 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:27.989525 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be58ed9-a6b8-4974-a0e7-e56192575194 service nova] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:28.093889 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f413b31a-2df4-4c2f-8adf-cc92a4d6c856 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:28.094820 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25122286-e6fa-4f17-9136-375b29238211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:28.095880 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25122286-e6fa-4f17-9136-375b29238211 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:28.096200 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25122286-e6fa-4f17-9136-375b29238211 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:28.096570 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25122286-e6fa-4f17-9136-375b29238211 admin admin] PATH_INFO: `/v3/projects/e9da90b237c34e5dad70af3cd2742be5/users/ff29128277cb4b6eaf78a8a62dd2b725/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:28.099545 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25122286-e6fa-4f17-9136-375b29238211 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9da90b237c34e5dad70af3cd2742be5, user_id=ff29128277cb4b6eaf78a8a62dd2b725, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:28.102376 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25122286-e6fa-4f17-9136-375b29238211 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:28.109840 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a883e6-b4ff-4aa1-96e8-5cafc4030efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:28.110877 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a883e6-b4ff-4aa1-96e8-5cafc4030efd admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:28.111255 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a883e6-b4ff-4aa1-96e8-5cafc4030efd admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:28.111622 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a883e6-b4ff-4aa1-96e8-5cafc4030efd admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:28.112459 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a883e6-b4ff-4aa1-96e8-5cafc4030efd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:28.114189 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a883e6-b4ff-4aa1-96e8-5cafc4030efd admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:28.129333 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 836/1656] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:13:27 2022] PUT /identity/v3/projects/e9da90b237c34e5dad70af3cd2742be5/users/ff29128277cb4b6eaf78a8a62dd2b725/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:13:28.130131 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25122286-e6fa-4f17-9136-375b29238211 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:28.133872 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 821/1657] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:13:27 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:13:28.134811 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a883e6-b4ff-4aa1-96e8-5cafc4030efd admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:28.155257 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a883e6-b4ff-4aa1-96e8-5cafc4030efd admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:28.256201 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b0f141-985e-4cb7-87b8-3de395305b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:28.257282 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b0f141-985e-4cb7-87b8-3de395305b14 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:28.257664 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b0f141-985e-4cb7-87b8-3de395305b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:28.258060 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b0f141-985e-4cb7-87b8-3de395305b14 admin admin] PATH_INFO: `/v3/projects/55b250efc0d94d91a943680a3b56d71e/users/74a49bad80d14c8eb6b5c19903a1b3aa/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:28.260530 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b0f141-985e-4cb7-87b8-3de395305b14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55b250efc0d94d91a943680a3b56d71e, user_id=74a49bad80d14c8eb6b5c19903a1b3aa, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:28.264916 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b0f141-985e-4cb7-87b8-3de395305b14 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:28.266508 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25122286-e6fa-4f17-9136-375b29238211 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:28.278286 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6833905-afa0-4ee2-98ec-8016dece53d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:28.279329 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6833905-afa0-4ee2-98ec-8016dece53d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:28.279613 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6833905-afa0-4ee2-98ec-8016dece53d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:28.279888 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6833905-afa0-4ee2-98ec-8016dece53d6 admin admin] PATH_INFO: `/v3/projects/c39959ed6b824c75a46b058008ce3bd6/users/cdd2a325dc5a4e0fa1d3b679afb5d863/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:28.282457 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6833905-afa0-4ee2-98ec-8016dece53d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c39959ed6b824c75a46b058008ce3bd6, user_id=cdd2a325dc5a4e0fa1d3b679afb5d863, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:28.290797 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6833905-afa0-4ee2-98ec-8016dece53d6 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:28.296162 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 822/1658] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:13:28 2022] PUT /identity/v3/projects/55b250efc0d94d91a943680a3b56d71e/users/74a49bad80d14c8eb6b5c19903a1b3aa/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:13:28.297605 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b0f141-985e-4cb7-87b8-3de395305b14 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:28.316709 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 837/1659] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:13:28 2022] PUT /identity/v3/projects/c39959ed6b824c75a46b058008ce3bd6/users/cdd2a325dc5a4e0fa1d3b679afb5d863/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:13:28.318366 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7879b5-fb5a-4cbc-ae8f-d51a4a7b4b31 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:28.318656 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7879b5-fb5a-4cbc-ae8f-d51a4a7b4b31 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:28.318942 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7879b5-fb5a-4cbc-ae8f-d51a4a7b4b31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:28.351153 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-df7879b5-fb5a-4cbc-ae8f-d51a4a7b4b31 None None] MFA Rules not processed for user `37598ed1e36d4e81936d5ad3cf35612b`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:13:28.352083 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-df7879b5-fb5a-4cbc-ae8f-d51a4a7b4b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:28.367805 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b0f141-985e-4cb7-87b8-3de395305b14 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:28.396805 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:13:28.429002 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 838/1660] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:13:28 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:13:28.429346 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b038bc96-8921-441c-9228-00334c18738c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:28.429891 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7879b5-fb5a-4cbc-ae8f-d51a4a7b4b31 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:28.430356 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b038bc96-8921-441c-9228-00334c18738c admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:28.430551 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b038bc96-8921-441c-9228-00334c18738c admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:28.430818 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b038bc96-8921-441c-9228-00334c18738c admin admin] PATH_INFO: `/v3/projects/769afe32bc5d48dd9e24186168aaa3e1/users/2f243774c8494e10b8b1690f2da39b82/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:28.432980 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b038bc96-8921-441c-9228-00334c18738c admin admin] RBAC: Authorizing `identity:create_grant(project_id=769afe32bc5d48dd9e24186168aaa3e1, user_id=2f243774c8494e10b8b1690f2da39b82, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:28.435697 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b038bc96-8921-441c-9228-00334c18738c admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:28.436707 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:13:28.441780 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7879b5-fb5a-4cbc-ae8f-d51a4a7b4b31 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:28.447635 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 823/1661] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:13:28 2022] PUT /identity/v3/projects/769afe32bc5d48dd9e24186168aaa3e1/users/2f243774c8494e10b8b1690f2da39b82/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:13:28.451835 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8980979d-4aed-4c58-b328-aa46112a7f32 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:28.454477 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8980979d-4aed-4c58-b328-aa46112a7f32 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:28.455166 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8980979d-4aed-4c58-b328-aa46112a7f32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:28.487587 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-8980979d-4aed-4c58-b328-aa46112a7f32 None None] MFA Rules not processed for user `ff29128277cb4b6eaf78a8a62dd2b725`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:13:28.488912 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-8980979d-4aed-4c58-b328-aa46112a7f32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:28.510070 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6bc559-cc22-4572-a396-24b83c236b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:28.511033 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6bc559-cc22-4572-a396-24b83c236b8d admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:28.511283 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6bc559-cc22-4572-a396-24b83c236b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:28.511554 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6bc559-cc22-4572-a396-24b83c236b8d admin admin] PATH_INFO: `/v3/projects/ded4be9c03a54ecdbd517999f984ddf5/users/24a24a4a7bd844039d18a56fe9d1cf1e/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:28.513523 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6bc559-cc22-4572-a396-24b83c236b8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ded4be9c03a54ecdbd517999f984ddf5, user_id=24a24a4a7bd844039d18a56fe9d1cf1e, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:28.516233 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6bc559-cc22-4572-a396-24b83c236b8d admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:28.526776 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 839/1662] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:13:28 2022] PUT /identity/v3/projects/ded4be9c03a54ecdbd517999f984ddf5/users/24a24a4a7bd844039d18a56fe9d1cf1e/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:13:28.527587 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6bc559-cc22-4572-a396-24b83c236b8d admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:28.561254 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 824/1663] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:13:28 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:13:28.562468 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ac6ae5-3191-4a30-bc9f-e0340553e15e None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:28.562754 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ac6ae5-3191-4a30-bc9f-e0340553e15e None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:28.563027 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ac6ae5-3191-4a30-bc9f-e0340553e15e None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:28.565018 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 825/1664] 10.222.0.17 () {54 vars in 912 bytes} [Sat Jul 23 21:13:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:13:28.565756 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939c2054-4f34-444f-aecc-966cd2993bc5 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:28.566063 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939c2054-4f34-444f-aecc-966cd2993bc5 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:28.566338 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939c2054-4f34-444f-aecc-966cd2993bc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:28.592613 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-939c2054-4f34-444f-aecc-966cd2993bc5 None None] MFA Rules not processed for user `74a49bad80d14c8eb6b5c19903a1b3aa`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:13:28.593771 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-939c2054-4f34-444f-aecc-966cd2993bc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:28.611471 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6bc559-cc22-4572-a396-24b83c236b8d admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:28.616944 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020730e2-2c3f-4fe5-8af7-df300e9773fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:28.617604 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020730e2-2c3f-4fe5-8af7-df300e9773fe service nova] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:28.617908 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020730e2-2c3f-4fe5-8af7-df300e9773fe service nova] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:28.618180 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020730e2-2c3f-4fe5-8af7-df300e9773fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:28.662876 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 826/1665] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:13:28 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:13:28.664198 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c1f99a-6cd0-456a-b118-04edb2964a1a None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:28.664459 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c1f99a-6cd0-456a-b118-04edb2964a1a None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:28.664734 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c1f99a-6cd0-456a-b118-04edb2964a1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:28.676436 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020730e2-2c3f-4fe5-8af7-df300e9773fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:28.678299 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020730e2-2c3f-4fe5-8af7-df300e9773fe service nova] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:28.688635 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 840/1666] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:13:28 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:13:28.689735 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a979b3ee-480f-4ec1-ba28-59aa4ec83cd3 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:28.690056 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a979b3ee-480f-4ec1-ba28-59aa4ec83cd3 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:28.690349 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a979b3ee-480f-4ec1-ba28-59aa4ec83cd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:28.694145 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-59c1f99a-6cd0-456a-b118-04edb2964a1a None None] MFA Rules not processed for user `cdd2a325dc5a4e0fa1d3b679afb5d863`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:13:28.695552 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-59c1f99a-6cd0-456a-b118-04edb2964a1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:28.716644 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:13:28.719940 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-a979b3ee-480f-4ec1-ba28-59aa4ec83cd3 None None] MFA Rules not processed for user `2f243774c8494e10b8b1690f2da39b82`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:13:28.721559 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-a979b3ee-480f-4ec1-ba28-59aa4ec83cd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:28.753548 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:13:28.775884 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 827/1667] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:13:28 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:13:28.779208 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66f37b5-a3bc-49b4-ad28-5911ab930d05 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:28.779746 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66f37b5-a3bc-49b4-ad28-5911ab930d05 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:28.779746 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66f37b5-a3bc-49b4-ad28-5911ab930d05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:28.809778 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-c66f37b5-a3bc-49b4-ad28-5911ab930d05 None None] MFA Rules not processed for user `24a24a4a7bd844039d18a56fe9d1cf1e`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:13:28.811056 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-c66f37b5-a3bc-49b4-ad28-5911ab930d05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:28.811630 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 841/1668] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:13:28 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:13:28.813058 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ea5ca8-858c-4e70-962a-b946209030ff None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:28.813527 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ea5ca8-858c-4e70-962a-b946209030ff None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:28.813798 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ea5ca8-858c-4e70-962a-b946209030ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:28.837973 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-44ea5ca8-858c-4e70-962a-b946209030ff None None] MFA Rules not processed for user `079f31ed2c844e67bd4e206f24b69d97`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:13:28.839185 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-44ea5ca8-858c-4e70-962a-b946209030ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:28.848764 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 842/1669] 10.222.0.17 () {58 vars in 1009 bytes} [Sat Jul 23 21:13:28 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:13:28.849625 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ea5ca8-858c-4e70-962a-b946209030ff None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:28.862861 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ea5ca8-858c-4e70-962a-b946209030ff None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:28.868422 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0f2085-e705-4f8f-8716-9692c7455896 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:28.869107 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0f2085-e705-4f8f-8716-9692c7455896 service nova] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:28.869390 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0f2085-e705-4f8f-8716-9692c7455896 service nova] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:28.869659 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0f2085-e705-4f8f-8716-9692c7455896 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:28.890741 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 828/1670] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:13:28 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:13:28.892434 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66f37b5-a3bc-49b4-ad28-5911ab930d05 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:28.929637 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0f2085-e705-4f8f-8716-9692c7455896 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:28.931271 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0f2085-e705-4f8f-8716-9692c7455896 service nova] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:28.941570 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 843/1671] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:13:28 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:13:28.942298 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0f2085-e705-4f8f-8716-9692c7455896 service nova] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:28.943604 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-3e0f2085-e705-4f8f-8716-9692c7455896 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:28.954124 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66f37b5-a3bc-49b4-ad28-5911ab930d05 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:28.959442 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bacace6-6e0a-4232-9561-39a6f3633886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:28.960305 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bacace6-6e0a-4232-9561-39a6f3633886 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:28.960630 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bacace6-6e0a-4232-9561-39a6f3633886 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:28.961010 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bacace6-6e0a-4232-9561-39a6f3633886 admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:28.961747 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bacace6-6e0a-4232-9561-39a6f3633886 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:28.963791 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bacace6-6e0a-4232-9561-39a6f3633886 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:28.996857 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 829/1672] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:13:28 2022] POST /identity/v3/projects => generated 395 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:13:29.001519 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bacace6-6e0a-4232-9561-39a6f3633886 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:29.035064 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:13:29.035548 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0f2085-e705-4f8f-8716-9692c7455896 service nova] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:29.067408 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bacace6-6e0a-4232-9561-39a6f3633886 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:29.072011 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16a1a4a-2ce9-4dfb-8bac-1447edf9f52d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:29.072686 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16a1a4a-2ce9-4dfb-8bac-1447edf9f52d admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:29.072956 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16a1a4a-2ce9-4dfb-8bac-1447edf9f52d admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:29.073226 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16a1a4a-2ce9-4dfb-8bac-1447edf9f52d admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:29.073945 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16a1a4a-2ce9-4dfb-8bac-1447edf9f52d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:29.075881 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16a1a4a-2ce9-4dfb-8bac-1447edf9f52d admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:29.076592 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:13:29.084770 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8aca32-ea72-4d9d-88b7-8d34db940f40 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7f2db148c8e4d5d81431cae3576434b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:29.085435 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8aca32-ea72-4d9d-88b7-8d34db940f40 service glance] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:29.085736 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8aca32-ea72-4d9d-88b7-8d34db940f40 service glance] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:29.086169 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8aca32-ea72-4d9d-88b7-8d34db940f40 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:29.100362 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 830/1673] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:13:29 2022] POST /identity/v3/users => generated 298 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:13:29.100362 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16a1a4a-2ce9-4dfb-8bac-1447edf9f52d admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:29.161230 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8aca32-ea72-4d9d-88b7-8d34db940f40 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:29.162996 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8aca32-ea72-4d9d-88b7-8d34db940f40 service glance] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:29.173663 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 844/1674] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:13:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:13:29.174532 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8aca32-ea72-4d9d-88b7-8d34db940f40 service glance] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:29.177989 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16a1a4a-2ce9-4dfb-8bac-1447edf9f52d admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:29.184142 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8aca32-ea72-4d9d-88b7-8d34db940f40 service glance] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:29.184770 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932fdca4-b56c-4dc4-be62-16e704b69df4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:29.185474 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932fdca4-b56c-4dc4-be62-16e704b69df4 service nova] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:29.185754 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932fdca4-b56c-4dc4-be62-16e704b69df4 service nova] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:29.186063 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932fdca4-b56c-4dc4-be62-16e704b69df4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:29.188782 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c99983d-dfec-448d-9965-1084bd89a2b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:29.189439 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c99983d-dfec-448d-9965-1084bd89a2b8 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:29.189765 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c99983d-dfec-448d-9965-1084bd89a2b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:29.190072 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c99983d-dfec-448d-9965-1084bd89a2b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:29.190793 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c99983d-dfec-448d-9965-1084bd89a2b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:29.192433 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c99983d-dfec-448d-9965-1084bd89a2b8 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:29.211076 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 845/1675] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:13:29 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:13:29.211997 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c99983d-dfec-448d-9965-1084bd89a2b8 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:29.226621 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c99983d-dfec-448d-9965-1084bd89a2b8 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:29.233705 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e178eb71-962a-455e-9d5a-085e0793f6bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:29.234447 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e178eb71-962a-455e-9d5a-085e0793f6bf admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:29.234735 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e178eb71-962a-455e-9d5a-085e0793f6bf admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:29.235029 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e178eb71-962a-455e-9d5a-085e0793f6bf admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:29.235748 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e178eb71-962a-455e-9d5a-085e0793f6bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:29.237534 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e178eb71-962a-455e-9d5a-085e0793f6bf admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:29.252501 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 846/1676] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:13:29 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:13:29.256674 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e178eb71-962a-455e-9d5a-085e0793f6bf admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:29.262729 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932fdca4-b56c-4dc4-be62-16e704b69df4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:29.264329 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932fdca4-b56c-4dc4-be62-16e704b69df4 service nova] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:29.267823 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e178eb71-962a-455e-9d5a-085e0793f6bf admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:29.273503 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c1b0d2-a20f-4de9-9eb3-f4e3fcf39a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:29.274445 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c1b0d2-a20f-4de9-9eb3-f4e3fcf39a31 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:29.274711 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c1b0d2-a20f-4de9-9eb3-f4e3fcf39a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:29.274831 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 831/1677] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:13:29 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:13:29.275080 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c1b0d2-a20f-4de9-9eb3-f4e3fcf39a31 admin admin] PATH_INFO: `/v3/projects/aefbf9ae46e34052b41a581194a5ebfb/users/1a276712950c4e8187552af2c6bfd221/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:29.291857 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c1b0d2-a20f-4de9-9eb3-f4e3fcf39a31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aefbf9ae46e34052b41a581194a5ebfb, user_id=1a276712950c4e8187552af2c6bfd221, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:29.294694 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c1b0d2-a20f-4de9-9eb3-f4e3fcf39a31 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:29.321588 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 847/1678] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:13:29 2022] PUT /identity/v3/projects/aefbf9ae46e34052b41a581194a5ebfb/users/1a276712950c4e8187552af2c6bfd221/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:13:29.323440 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe08afb-bd3f-49a6-abe3-95259b3efe11 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:29.323757 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe08afb-bd3f-49a6-abe3-95259b3efe11 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:29.324025 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe08afb-bd3f-49a6-abe3-95259b3efe11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:29.344015 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c1b0d2-a20f-4de9-9eb3-f4e3fcf39a31 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:29.363188 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-5fe08afb-bd3f-49a6-abe3-95259b3efe11 None None] MFA Rules not processed for user `1a276712950c4e8187552af2c6bfd221`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:13:29.364621 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-5fe08afb-bd3f-49a6-abe3-95259b3efe11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:29.409110 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:13:29.433938 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c1b0d2-a20f-4de9-9eb3-f4e3fcf39a31 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:29.443668 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 832/1679] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:13:29 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:13:29.443852 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd3b895-6423-4e5b-a607-bb72bf3be547 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:29.443852 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd3b895-6423-4e5b-a607-bb72bf3be547 service nova] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:29.443852 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd3b895-6423-4e5b-a607-bb72bf3be547 service nova] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:29.443852 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd3b895-6423-4e5b-a607-bb72bf3be547 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:29.486188 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:13:29.514362 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd3b895-6423-4e5b-a607-bb72bf3be547 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:29.515973 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd3b895-6423-4e5b-a607-bb72bf3be547 service nova] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:29.526364 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 848/1680] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:13:29 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 23 21:13:29.632574 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe08afb-bd3f-49a6-abe3-95259b3efe11 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:29.645142 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe08afb-bd3f-49a6-abe3-95259b3efe11 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:29.650628 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d3dad8-a5c4-4068-adc4-062081e9797c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:29.651405 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d3dad8-a5c4-4068-adc4-062081e9797c service nova] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:29.651738 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d3dad8-a5c4-4068-adc4-062081e9797c service nova] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:29.652013 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d3dad8-a5c4-4068-adc4-062081e9797c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:29.725821 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d3dad8-a5c4-4068-adc4-062081e9797c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:29.727463 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d3dad8-a5c4-4068-adc4-062081e9797c service nova] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:29.738093 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 833/1681] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:13:29 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:13:29.774607 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd3b895-6423-4e5b-a607-bb72bf3be547 service nova] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:29.786515 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd3b895-6423-4e5b-a607-bb72bf3be547 service nova] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:29.792615 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66483e7-f8f0-4ed6-bf75-f0fbe12a70b5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:29.793396 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66483e7-f8f0-4ed6-bf75-f0fbe12a70b5 service nova] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:29.793556 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66483e7-f8f0-4ed6-bf75-f0fbe12a70b5 service nova] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:29.793830 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66483e7-f8f0-4ed6-bf75-f0fbe12a70b5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:29.859197 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d3dad8-a5c4-4068-adc4-062081e9797c service nova] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:29.870859 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d3dad8-a5c4-4068-adc4-062081e9797c service nova] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:29.876899 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1e4f59-8039-4bea-a0da-384958437cae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:29.877550 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1e4f59-8039-4bea-a0da-384958437cae service nova] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:29.877884 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1e4f59-8039-4bea-a0da-384958437cae service nova] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:29.878151 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1e4f59-8039-4bea-a0da-384958437cae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:29.878537 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66483e7-f8f0-4ed6-bf75-f0fbe12a70b5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:29.880131 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66483e7-f8f0-4ed6-bf75-f0fbe12a70b5 service nova] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:29.890071 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 849/1682] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:13:29 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:13:29.890725 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66483e7-f8f0-4ed6-bf75-f0fbe12a70b5 service nova] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:29.955896 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1e4f59-8039-4bea-a0da-384958437cae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:29.956455 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1e4f59-8039-4bea-a0da-384958437cae service nova] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:29.961660 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66483e7-f8f0-4ed6-bf75-f0fbe12a70b5 service nova] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:29.966576 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 834/1683] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:13:29 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:13:29.967010 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc45eb1-13c5-409c-9a66-76c74536a1dd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc719a3b3ac4461b82ca04ab6451d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:29.967764 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc45eb1-13c5-409c-9a66-76c74536a1dd service placement] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:29.968147 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc45eb1-13c5-409c-9a66-76c74536a1dd service placement] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:29.968518 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc45eb1-13c5-409c-9a66-76c74536a1dd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:29.970707 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-bdc45eb1-13c5-409c-9a66-76c74536a1dd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:29.978760 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1e4f59-8039-4bea-a0da-384958437cae service nova] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:29.990887 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc45eb1-13c5-409c-9a66-76c74536a1dd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:29.992655 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc45eb1-13c5-409c-9a66-76c74536a1dd service placement] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:29.994467 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1e4f59-8039-4bea-a0da-384958437cae service nova] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:30.002277 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437aa7e4-4ffd-4cec-ab36-f052dd7a9434 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:30.003460 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437aa7e4-4ffd-4cec-ab36-f052dd7a9434 service nova] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:30.003806 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 850/1684] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:13:29 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:13:30.004086 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437aa7e4-4ffd-4cec-ab36-f052dd7a9434 service nova] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:30.004364 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437aa7e4-4ffd-4cec-ab36-f052dd7a9434 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:30.072075 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437aa7e4-4ffd-4cec-ab36-f052dd7a9434 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:30.073926 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437aa7e4-4ffd-4cec-ab36-f052dd7a9434 service nova] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:30.089082 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 835/1685] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:13:29 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 23 21:13:30.231614 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add78f27-b45e-4a3d-b827-36e16bb1da0b None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:30.231946 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add78f27-b45e-4a3d-b827-36e16bb1da0b None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:30.232232 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add78f27-b45e-4a3d-b827-36e16bb1da0b None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:30.233645 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 851/1686] 10.222.0.17 () {54 vars in 912 bytes} [Sat Jul 23 21:13:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:13:30.239673 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a49b212-661e-46ec-8b51-78fad16926f7 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:30.239969 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a49b212-661e-46ec-8b51-78fad16926f7 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:30.240451 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a49b212-661e-46ec-8b51-78fad16926f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:30.259477 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:13:30.266436 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-2a49b212-661e-46ec-8b51-78fad16926f7 None None] MFA Rules not processed for user `abc719a3b3ac4461b82ca04ab6451d81`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:13:30.267661 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-2a49b212-661e-46ec-8b51-78fad16926f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:30.277044 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 836/1687] 10.222.0.17 () {58 vars in 1009 bytes} [Sat Jul 23 21:13:30 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:13:30.297494 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5552b224-4828-413b-ad9b-062a0c33db6d None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:30.298599 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5552b224-4828-413b-ad9b-062a0c33db6d None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:30.299350 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5552b224-4828-413b-ad9b-062a0c33db6d None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:30.301467 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 852/1688] 10.222.0.17 () {54 vars in 912 bytes} [Sat Jul 23 21:13:30 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:13:30.307642 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a49b212-661e-46ec-8b51-78fad16926f7 None None] Authenticating service token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 23 21:13:30.309102 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5552b224-4828-413b-ad9b-062a0c33db6d None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:30.323643 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5552b224-4828-413b-ad9b-062a0c33db6d None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:30.329016 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1990b8f8-fd18-4878-88a3-b716a7813d14 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc719a3b3ac4461b82ca04ab6451d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:30.329401 ncdv-master-1 devstack@keystone.service[91547]: WARNING keystone.server.flask.request_processing.middleware.auth_context [None req-2a49b212-661e-46ec-8b51-78fad16926f7 None None] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Jul 23 21:13:30.329671 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1990b8f8-fd18-4878-88a3-b716a7813d14 service placement] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:30.329824 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a49b212-661e-46ec-8b51-78fad16926f7 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:30.330213 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1990b8f8-fd18-4878-88a3-b716a7813d14 service placement] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:30.330486 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1990b8f8-fd18-4878-88a3-b716a7813d14 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:30.340184 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1990b8f8-fd18-4878-88a3-b716a7813d14 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:30.341772 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1990b8f8-fd18-4878-88a3-b716a7813d14 service placement] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:30.342655 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a49b212-661e-46ec-8b51-78fad16926f7 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:30.348784 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c4e7a6-02f4-4568-928d-424851f415aa tempest-FlavorsAccessNegativeTestJSON-992011010 tempest-FlavorsAccessNegativeTestJSON-992011010-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f243774c8494e10b8b1690f2da39b82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '769afe32bc5d48dd9e24186168aaa3e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:30.349742 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c4e7a6-02f4-4568-928d-424851f415aa tempest-FlavorsAccessNegativeTestJSON-992011010 tempest-FlavorsAccessNegativeTestJSON-992011010-project-admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:30.350124 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c4e7a6-02f4-4568-928d-424851f415aa tempest-FlavorsAccessNegativeTestJSON-992011010 tempest-FlavorsAccessNegativeTestJSON-992011010-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:30.350460 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c4e7a6-02f4-4568-928d-424851f415aa tempest-FlavorsAccessNegativeTestJSON-992011010 tempest-FlavorsAccessNegativeTestJSON-992011010-project-admin] PATH_INFO: `/v3/projects/c62a56af2f634cf49e7556c47b3215a6` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:30.351715 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c4e7a6-02f4-4568-928d-424851f415aa tempest-FlavorsAccessNegativeTestJSON-992011010 tempest-FlavorsAccessNegativeTestJSON-992011010-project-admin] RBAC: Authorizing `identity:get_project(project_id=c62a56af2f634cf49e7556c47b3215a6)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:30.352955 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 853/1689] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:13:30 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 23 21:13:30.353972 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c4e7a6-02f4-4568-928d-424851f415aa tempest-FlavorsAccessNegativeTestJSON-992011010 tempest-FlavorsAccessNegativeTestJSON-992011010-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:30.358063 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 837/1690] 10.222.0.17 () {58 vars in 1443 bytes} [Sat Jul 23 21:13:30 2022] GET /identity/v3/projects/c62a56af2f634cf49e7556c47b3215a6 => generated 393 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:13:30.532048 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411c96f6-b087-4735-b224-82c552bb63ef None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:30.532822 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411c96f6-b087-4735-b224-82c552bb63ef None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:30.533272 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411c96f6-b087-4735-b224-82c552bb63ef None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:30.536579 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 854/1691] 10.222.0.17 () {54 vars in 912 bytes} [Sat Jul 23 21:13:30 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:13:30.542945 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c4e7a6-02f4-4568-928d-424851f415aa tempest-FlavorsAccessNegativeTestJSON-992011010 tempest-FlavorsAccessNegativeTestJSON-992011010-project-admin] Authenticating service token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 23 21:13:30.560360 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c4e7a6-02f4-4568-928d-424851f415aa tempest-FlavorsAccessNegativeTestJSON-992011010 tempest-FlavorsAccessNegativeTestJSON-992011010-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:30.575867 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c4e7a6-02f4-4568-928d-424851f415aa tempest-FlavorsAccessNegativeTestJSON-992011010 tempest-FlavorsAccessNegativeTestJSON-992011010-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:30.581517 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33512ac-51e9-4f98-86ce-2984340472cf tempest-FlavorsAccessNegativeTestJSON-992011010 tempest-FlavorsAccessNegativeTestJSON-992011010-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f243774c8494e10b8b1690f2da39b82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '769afe32bc5d48dd9e24186168aaa3e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:30.582541 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33512ac-51e9-4f98-86ce-2984340472cf tempest-FlavorsAccessNegativeTestJSON-992011010 tempest-FlavorsAccessNegativeTestJSON-992011010-project-admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:30.582831 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33512ac-51e9-4f98-86ce-2984340472cf tempest-FlavorsAccessNegativeTestJSON-992011010 tempest-FlavorsAccessNegativeTestJSON-992011010-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:30.583110 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33512ac-51e9-4f98-86ce-2984340472cf tempest-FlavorsAccessNegativeTestJSON-992011010 tempest-FlavorsAccessNegativeTestJSON-992011010-project-admin] PATH_INFO: `/v3/projects/c62a56af2f634cf49e7556c47b3215a6` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:30.584395 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33512ac-51e9-4f98-86ce-2984340472cf tempest-FlavorsAccessNegativeTestJSON-992011010 tempest-FlavorsAccessNegativeTestJSON-992011010-project-admin] RBAC: Authorizing `identity:get_project(project_id=c62a56af2f634cf49e7556c47b3215a6)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:30.586768 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33512ac-51e9-4f98-86ce-2984340472cf tempest-FlavorsAccessNegativeTestJSON-992011010 tempest-FlavorsAccessNegativeTestJSON-992011010-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:30.589903 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 838/1692] 10.222.0.17 () {58 vars in 1443 bytes} [Sat Jul 23 21:13:30 2022] GET /identity/v3/projects/c62a56af2f634cf49e7556c47b3215a6 => generated 393 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:13:30.667289 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411c96f6-b087-4735-b224-82c552bb63ef None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:30.687626 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33512ac-51e9-4f98-86ce-2984340472cf tempest-FlavorsAccessNegativeTestJSON-992011010 tempest-FlavorsAccessNegativeTestJSON-992011010-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:30.750717 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:13:30.776595 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33512ac-51e9-4f98-86ce-2984340472cf tempest-FlavorsAccessNegativeTestJSON-992011010 tempest-FlavorsAccessNegativeTestJSON-992011010-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:30.779858 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fd54fb-7561-40e1-88ec-7fe5ac692f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:30.780827 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fd54fb-7561-40e1-88ec-7fe5ac692f74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:30.781165 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fd54fb-7561-40e1-88ec-7fe5ac692f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:30.781527 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fd54fb-7561-40e1-88ec-7fe5ac692f74 admin admin] PATH_INFO: `/v3/users/77d32aad338c47eab5087ac911dcd5ea` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:30.783093 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fd54fb-7561-40e1-88ec-7fe5ac692f74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=77d32aad338c47eab5087ac911dcd5ea)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:30.785259 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fd54fb-7561-40e1-88ec-7fe5ac692f74 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:30.789388 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411c96f6-b087-4735-b224-82c552bb63ef None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:30.797032 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa31a87-44b3-4ed8-8459-e63968d4251f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:30.798243 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa31a87-44b3-4ed8-8459-e63968d4251f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:30.798661 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa31a87-44b3-4ed8-8459-e63968d4251f admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:30.799065 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa31a87-44b3-4ed8-8459-e63968d4251f admin admin] PATH_INFO: `/v3/users/368262045c5746be82a4ec322a7f2265` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:30.800985 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa31a87-44b3-4ed8-8459-e63968d4251f admin admin] RBAC: Authorizing `identity:delete_user(user_id=368262045c5746be82a4ec322a7f2265)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:30.802447 ncdv-master-1 devstack@keystone.service[91548]: WARNING py.warnings [None req-5fa31a87-44b3-4ed8-8459-e63968d4251f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:13:30.802447 ncdv-master-1 devstack@keystone.service[91548]: warnings.warn(msg) Jul 23 21:13:30.802447 ncdv-master-1 devstack@keystone.service[91548]: Jul 23 21:13:30.805258 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa31a87-44b3-4ed8-8459-e63968d4251f admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:30.874235 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-18fd54fb-7561-40e1-88ec-7fe5ac692f74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77d32aad338c47eab5087ac911dcd5ea'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:30.892612 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-18fd54fb-7561-40e1-88ec-7fe5ac692f74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77d32aad338c47eab5087ac911dcd5ea'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:30.893503 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-18fd54fb-7561-40e1-88ec-7fe5ac692f74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77d32aad338c47eab5087ac911dcd5ea'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:30.896705 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-5fa31a87-44b3-4ed8-8459-e63968d4251f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '368262045c5746be82a4ec322a7f2265'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:30.897512 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-5fa31a87-44b3-4ed8-8459-e63968d4251f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '368262045c5746be82a4ec322a7f2265'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:30.906933 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-18fd54fb-7561-40e1-88ec-7fe5ac692f74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77d32aad338c47eab5087ac911dcd5ea'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:30.910805 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-5fa31a87-44b3-4ed8-8459-e63968d4251f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '368262045c5746be82a4ec322a7f2265'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:30.924769 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-5fa31a87-44b3-4ed8-8459-e63968d4251f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '368262045c5746be82a4ec322a7f2265'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:30.928235 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-18fd54fb-7561-40e1-88ec-7fe5ac692f74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77d32aad338c47eab5087ac911dcd5ea'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:30.938643 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 839/1693] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:13:30 2022] DELETE /identity/v3/users/77d32aad338c47eab5087ac911dcd5ea => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:13:30.938643 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8064fe88-6f05-472a-84fc-ba2fc2a43183 None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:30.938643 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8064fe88-6f05-472a-84fc-ba2fc2a43183 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:30.938643 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8064fe88-6f05-472a-84fc-ba2fc2a43183 None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:30.940846 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 840/1694] 10.222.0.17 () {54 vars in 912 bytes} [Sat Jul 23 21:13:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:13:30.942345 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69110d6-5a3a-4743-9b38-37d098de4ed6 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:30.942619 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69110d6-5a3a-4743-9b38-37d098de4ed6 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:30.942946 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69110d6-5a3a-4743-9b38-37d098de4ed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:30.960577 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-5fa31a87-44b3-4ed8-8459-e63968d4251f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '368262045c5746be82a4ec322a7f2265'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:30.966940 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-b69110d6-5a3a-4743-9b38-37d098de4ed6 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:13:30.968176 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-b69110d6-5a3a-4743-9b38-37d098de4ed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:30.968579 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 855/1695] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:13:30 2022] DELETE /identity/v3/users/368262045c5746be82a4ec322a7f2265 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:13:30.970143 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa31a87-44b3-4ed8-8459-e63968d4251f admin admin] Authenticating service token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 23 21:13:30.971841 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-5fa31a87-44b3-4ed8-8459-e63968d4251f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:31.074141 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 841/1696] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:13:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:13:31.075611 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3363692-0237-4d63-91a3-a81451699abc None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:31.075894 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3363692-0237-4d63-91a3-a81451699abc None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:31.076165 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3363692-0237-4d63-91a3-a81451699abc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:31.084239 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:13:31.085725 ncdv-master-1 devstack@keystone.service[91548]: WARNING keystone.server.flask.request_processing.middleware.auth_context [None req-5fa31a87-44b3-4ed8-8459-e63968d4251f admin admin] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Jul 23 21:13:31.086276 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa31a87-44b3-4ed8-8459-e63968d4251f admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:31.087987 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-5fa31a87-44b3-4ed8-8459-e63968d4251f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:31.107320 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-c3363692-0237-4d63-91a3-a81451699abc None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:13:31.109469 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-c3363692-0237-4d63-91a3-a81451699abc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:31.132293 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 842/1697] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:13:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:13:31.132293 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3363692-0237-4d63-91a3-a81451699abc None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:31.132581 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-c3363692-0237-4d63-91a3-a81451699abc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:31.175429 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:13:31.190330 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa31a87-44b3-4ed8-8459-e63968d4251f admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:31.201483 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520fd909-6701-4664-869b-987a3169c9b8 tempest-FlavorsAccessNegativeTestJSON-992011010 tempest-FlavorsAccessNegativeTestJSON-992011010-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f243774c8494e10b8b1690f2da39b82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '769afe32bc5d48dd9e24186168aaa3e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:31.202068 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520fd909-6701-4664-869b-987a3169c9b8 tempest-FlavorsAccessNegativeTestJSON-992011010 tempest-FlavorsAccessNegativeTestJSON-992011010-project-admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:31.203807 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520fd909-6701-4664-869b-987a3169c9b8 tempest-FlavorsAccessNegativeTestJSON-992011010 tempest-FlavorsAccessNegativeTestJSON-992011010-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:31.203981 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520fd909-6701-4664-869b-987a3169c9b8 tempest-FlavorsAccessNegativeTestJSON-992011010 tempest-FlavorsAccessNegativeTestJSON-992011010-project-admin] PATH_INFO: `/v3/projects/c62a56af2f634cf49e7556c47b3215a6` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:31.205162 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520fd909-6701-4664-869b-987a3169c9b8 tempest-FlavorsAccessNegativeTestJSON-992011010 tempest-FlavorsAccessNegativeTestJSON-992011010-project-admin] RBAC: Authorizing `identity:get_project(project_id=c62a56af2f634cf49e7556c47b3215a6)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:31.211516 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520fd909-6701-4664-869b-987a3169c9b8 tempest-FlavorsAccessNegativeTestJSON-992011010 tempest-FlavorsAccessNegativeTestJSON-992011010-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:31.213796 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 856/1698] 10.222.0.17 () {58 vars in 1443 bytes} [Sat Jul 23 21:13:30 2022] GET /identity/v3/projects/c62a56af2f634cf49e7556c47b3215a6 => generated 393 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:13:31.219033 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520fd909-6701-4664-869b-987a3169c9b8 tempest-FlavorsAccessNegativeTestJSON-992011010 tempest-FlavorsAccessNegativeTestJSON-992011010-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:31.230431 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3363692-0237-4d63-91a3-a81451699abc None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:31.234221 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520fd909-6701-4664-869b-987a3169c9b8 tempest-FlavorsAccessNegativeTestJSON-992011010 tempest-FlavorsAccessNegativeTestJSON-992011010-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:31.238917 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d27682-4440-4019-bc58-20eab6c43170 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:31.239618 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d27682-4440-4019-bc58-20eab6c43170 service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:31.239995 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d27682-4440-4019-bc58-20eab6c43170 service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:31.240364 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d27682-4440-4019-bc58-20eab6c43170 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:31.251407 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710a4673-8193-408b-89a1-195608d796c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:31.252092 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710a4673-8193-408b-89a1-195608d796c0 service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:31.252363 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710a4673-8193-408b-89a1-195608d796c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:31.252644 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710a4673-8193-408b-89a1-195608d796c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:31.262690 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710a4673-8193-408b-89a1-195608d796c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:31.263679 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d27682-4440-4019-bc58-20eab6c43170 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:31.264151 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710a4673-8193-408b-89a1-195608d796c0 service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:31.265762 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d27682-4440-4019-bc58-20eab6c43170 service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:31.277889 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 857/1699] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:13:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:13:31.280146 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 843/1700] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:13:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:13:31.322155 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d27682-4440-4019-bc58-20eab6c43170 service neutron] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:31.339207 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d27682-4440-4019-bc58-20eab6c43170 service neutron] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:31.351028 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49341ccf-4901-4377-8209-0c68e6517a9b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:31.352151 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49341ccf-4901-4377-8209-0c68e6517a9b service nova] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:31.352653 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49341ccf-4901-4377-8209-0c68e6517a9b service nova] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:31.353094 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49341ccf-4901-4377-8209-0c68e6517a9b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:31.356839 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-49341ccf-4901-4377-8209-0c68e6517a9b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:31.357462 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97de56c2-d503-4c56-8979-d00e6493e5d7 None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:31.357718 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97de56c2-d503-4c56-8979-d00e6493e5d7 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:31.358055 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97de56c2-d503-4c56-8979-d00e6493e5d7 None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:31.361104 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 844/1701] 10.222.0.17 () {54 vars in 912 bytes} [Sat Jul 23 21:13:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:13:31.367007 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e189a098-9a6f-41e2-a9f0-752b5bd0011c None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:31.367304 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e189a098-9a6f-41e2-a9f0-752b5bd0011c None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:31.367568 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e189a098-9a6f-41e2-a9f0-752b5bd0011c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:31.390542 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-e189a098-9a6f-41e2-a9f0-752b5bd0011c None None] MFA Rules not processed for user `079f31ed2c844e67bd4e206f24b69d97`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:13:31.392144 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-e189a098-9a6f-41e2-a9f0-752b5bd0011c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:31.403066 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 845/1702] 10.222.0.17 () {58 vars in 1009 bytes} [Sat Jul 23 21:13:31 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:13:31.417584 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e189a098-9a6f-41e2-a9f0-752b5bd0011c None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:31.419764 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-e189a098-9a6f-41e2-a9f0-752b5bd0011c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:31.433915 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e189a098-9a6f-41e2-a9f0-752b5bd0011c None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:31.439513 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e046f1-236e-444f-b47f-abb3dc02b671 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:31.440393 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e046f1-236e-444f-b47f-abb3dc02b671 service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:31.440850 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e046f1-236e-444f-b47f-abb3dc02b671 service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:31.441278 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e046f1-236e-444f-b47f-abb3dc02b671 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:31.449589 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49341ccf-4901-4377-8209-0c68e6517a9b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:31.451280 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49341ccf-4901-4377-8209-0c68e6517a9b service nova] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:31.460219 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e046f1-236e-444f-b47f-abb3dc02b671 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:31.462163 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e046f1-236e-444f-b47f-abb3dc02b671 service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:31.465792 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 858/1703] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:13:31 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:13:31.478248 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 846/1704] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:13:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 23 21:13:31.742357 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49341ccf-4901-4377-8209-0c68e6517a9b service nova] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:31.744261 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-49341ccf-4901-4377-8209-0c68e6517a9b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:31.766220 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49341ccf-4901-4377-8209-0c68e6517a9b service nova] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:31.780312 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06ec15b-4c1f-433a-90d8-7bd2319a4904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:31.781460 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06ec15b-4c1f-433a-90d8-7bd2319a4904 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:31.782185 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06ec15b-4c1f-433a-90d8-7bd2319a4904 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:31.782598 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06ec15b-4c1f-433a-90d8-7bd2319a4904 admin admin] PATH_INFO: `/v3/users/b62c516b2d50424c80d7ac4549900639` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:31.784005 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06ec15b-4c1f-433a-90d8-7bd2319a4904 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b62c516b2d50424c80d7ac4549900639)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:31.786150 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06ec15b-4c1f-433a-90d8-7bd2319a4904 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:31.838123 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e046f1-236e-444f-b47f-abb3dc02b671 service neutron] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:31.839785 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-c8e046f1-236e-444f-b47f-abb3dc02b671 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:31.902258 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e046f1-236e-444f-b47f-abb3dc02b671 service neutron] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:31.902258 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f3a9ab-44fc-4677-b4f3-3c5e35950841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:31.902258 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f3a9ab-44fc-4677-b4f3-3c5e35950841 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:31.913022 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f3a9ab-44fc-4677-b4f3-3c5e35950841 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:31.913022 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f3a9ab-44fc-4677-b4f3-3c5e35950841 admin admin] PATH_INFO: `/v3/projects/96a9cb5407034489a78b193ad1f092da` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:31.913022 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f3a9ab-44fc-4677-b4f3-3c5e35950841 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96a9cb5407034489a78b193ad1f092da)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:31.913022 ncdv-master-1 devstack@keystone.service[91547]: WARNING py.warnings [None req-08f3a9ab-44fc-4677-b4f3-3c5e35950841 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:13:31.913022 ncdv-master-1 devstack@keystone.service[91547]: warnings.warn(msg) Jul 23 21:13:31.913022 ncdv-master-1 devstack@keystone.service[91547]: Jul 23 21:13:31.915344 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f3a9ab-44fc-4677-b4f3-3c5e35950841 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:31.939592 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-d06ec15b-4c1f-433a-90d8-7bd2319a4904 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b62c516b2d50424c80d7ac4549900639'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:31.940546 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-d06ec15b-4c1f-433a-90d8-7bd2319a4904 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b62c516b2d50424c80d7ac4549900639'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:31.951471 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-d06ec15b-4c1f-433a-90d8-7bd2319a4904 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b62c516b2d50424c80d7ac4549900639'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:31.976040 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-d06ec15b-4c1f-433a-90d8-7bd2319a4904 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b62c516b2d50424c80d7ac4549900639'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:32.035214 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-d06ec15b-4c1f-433a-90d8-7bd2319a4904 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b62c516b2d50424c80d7ac4549900639'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:32.090336 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-08f3a9ab-44fc-4677-b4f3-3c5e35950841 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96a9cb5407034489a78b193ad1f092da', 'request_id': 'req-08f3a9ab-44fc-4677-b4f3-3c5e35950841'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:32.114174 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 859/1705] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:13:31 2022] DELETE /identity/v3/users/b62c516b2d50424c80d7ac4549900639 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:13:32.116772 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-08f3a9ab-44fc-4677-b4f3-3c5e35950841 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96a9cb5407034489a78b193ad1f092da', 'request_id': 'req-08f3a9ab-44fc-4677-b4f3-3c5e35950841'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:32.121102 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06ec15b-4c1f-433a-90d8-7bd2319a4904 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:32.122759 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-d06ec15b-4c1f-433a-90d8-7bd2319a4904 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:32.125768 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-08f3a9ab-44fc-4677-b4f3-3c5e35950841 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96a9cb5407034489a78b193ad1f092da', 'request_id': 'req-08f3a9ab-44fc-4677-b4f3-3c5e35950841'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:32.151733 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-08f3a9ab-44fc-4677-b4f3-3c5e35950841 admin admin] The token cache is being invalidate because project 96a9cb5407034489a78b193ad1f092da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:13:32.152200 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-08f3a9ab-44fc-4677-b4f3-3c5e35950841 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:32.152983 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-08f3a9ab-44fc-4677-b4f3-3c5e35950841 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:32.158313 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 847/1706] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:13:31 2022] DELETE /identity/v3/projects/96a9cb5407034489a78b193ad1f092da => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:13:32.160527 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09965514-e1bf-4aed-b8d0-b1119f7e4c76 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:32.161070 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09965514-e1bf-4aed-b8d0-b1119f7e4c76 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:32.161947 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09965514-e1bf-4aed-b8d0-b1119f7e4c76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:32.201107 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-09965514-e1bf-4aed-b8d0-b1119f7e4c76 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:13:32.207718 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-09965514-e1bf-4aed-b8d0-b1119f7e4c76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:32.343816 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:13:32.351692 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06ec15b-4c1f-433a-90d8-7bd2319a4904 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:32.357572 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a208dc-307b-4e00-9159-ef72df20f369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:32.358531 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a208dc-307b-4e00-9159-ef72df20f369 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:32.358810 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a208dc-307b-4e00-9159-ef72df20f369 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:32.359081 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a208dc-307b-4e00-9159-ef72df20f369 admin admin] PATH_INFO: `/v3/projects/ced1e252b82841b1ad54368c13349bda` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:32.360614 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a208dc-307b-4e00-9159-ef72df20f369 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ced1e252b82841b1ad54368c13349bda)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:32.363167 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a208dc-307b-4e00-9159-ef72df20f369 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:32.381476 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 848/1707] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:13:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:13:32.382389 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09965514-e1bf-4aed-b8d0-b1119f7e4c76 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:32.383767 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-09965514-e1bf-4aed-b8d0-b1119f7e4c76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:32.390924 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:13:32.397350 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09965514-e1bf-4aed-b8d0-b1119f7e4c76 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:32.403868 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa59b2d-610a-4c06-a494-3c4239491d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:32.405286 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa59b2d-610a-4c06-a494-3c4239491d3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:32.405743 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa59b2d-610a-4c06-a494-3c4239491d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:32.406086 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa59b2d-610a-4c06-a494-3c4239491d3f admin admin] PATH_INFO: `/v3/users/24a24a4a7bd844039d18a56fe9d1cf1e` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:32.408457 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa59b2d-610a-4c06-a494-3c4239491d3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=24a24a4a7bd844039d18a56fe9d1cf1e)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:32.411011 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa59b2d-610a-4c06-a494-3c4239491d3f admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:32.414802 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-f4a208dc-307b-4e00-9159-ef72df20f369 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ced1e252b82841b1ad54368c13349bda', 'request_id': 'req-f4a208dc-307b-4e00-9159-ef72df20f369'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:32.425143 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-f4a208dc-307b-4e00-9159-ef72df20f369 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ced1e252b82841b1ad54368c13349bda', 'request_id': 'req-f4a208dc-307b-4e00-9159-ef72df20f369'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:32.433804 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-f4a208dc-307b-4e00-9159-ef72df20f369 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ced1e252b82841b1ad54368c13349bda', 'request_id': 'req-f4a208dc-307b-4e00-9159-ef72df20f369'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:32.449406 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-f4a208dc-307b-4e00-9159-ef72df20f369 admin admin] The token cache is being invalidate because project ced1e252b82841b1ad54368c13349bda was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:13:32.451052 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-f4a208dc-307b-4e00-9159-ef72df20f369 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:32.452495 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-f4a208dc-307b-4e00-9159-ef72df20f369 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:32.454666 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 860/1708] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:13:32 2022] DELETE /identity/v3/projects/ced1e252b82841b1ad54368c13349bda => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:13:32.455526 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a208dc-307b-4e00-9159-ef72df20f369 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:32.457021 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-f4a208dc-307b-4e00-9159-ef72df20f369 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:32.471855 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-faa59b2d-610a-4c06-a494-3c4239491d3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24a24a4a7bd844039d18a56fe9d1cf1e'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:32.481653 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-faa59b2d-610a-4c06-a494-3c4239491d3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24a24a4a7bd844039d18a56fe9d1cf1e'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:32.482531 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-faa59b2d-610a-4c06-a494-3c4239491d3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24a24a4a7bd844039d18a56fe9d1cf1e'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:32.494263 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-faa59b2d-610a-4c06-a494-3c4239491d3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24a24a4a7bd844039d18a56fe9d1cf1e'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:32.519725 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-faa59b2d-610a-4c06-a494-3c4239491d3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24a24a4a7bd844039d18a56fe9d1cf1e'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:32.528173 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 849/1709] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:13:32 2022] DELETE /identity/v3/users/24a24a4a7bd844039d18a56fe9d1cf1e => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:13:32.532928 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d110330c-ec94-43d9-9a54-353340a0bd4e None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:32.532928 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d110330c-ec94-43d9-9a54-353340a0bd4e None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:32.533283 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d110330c-ec94-43d9-9a54-353340a0bd4e None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:32.539031 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 850/1710] 10.222.0.17 () {54 vars in 912 bytes} [Sat Jul 23 21:13:32 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:13:32.539930 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d110330c-ec94-43d9-9a54-353340a0bd4e None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:32.542541 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-d110330c-ec94-43d9-9a54-353340a0bd4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:32.561749 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a208dc-307b-4e00-9159-ef72df20f369 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:32.624084 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d110330c-ec94-43d9-9a54-353340a0bd4e None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:32.629759 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f381b4-13d2-4eb5-a02e-b9fc9ac0767f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:32.630495 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f381b4-13d2-4eb5-a02e-b9fc9ac0767f service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:32.630858 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f381b4-13d2-4eb5-a02e-b9fc9ac0767f service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:32.631137 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f381b4-13d2-4eb5-a02e-b9fc9ac0767f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:32.634589 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-f5f381b4-13d2-4eb5-a02e-b9fc9ac0767f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:32.703983 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee4ed52-3be8-4080-93ce-15896d6c5371 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:32.705594 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee4ed52-3be8-4080-93ce-15896d6c5371 service nova] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:32.705900 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee4ed52-3be8-4080-93ce-15896d6c5371 service nova] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:32.706992 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee4ed52-3be8-4080-93ce-15896d6c5371 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:32.712040 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-1ee4ed52-3be8-4080-93ce-15896d6c5371 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:32.726223 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f381b4-13d2-4eb5-a02e-b9fc9ac0767f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:32.727753 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f381b4-13d2-4eb5-a02e-b9fc9ac0767f service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:32.740129 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:13:32.740465 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 851/1711] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:13:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:13:32.741450 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f381b4-13d2-4eb5-a02e-b9fc9ac0767f service neutron] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:32.743051 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-f5f381b4-13d2-4eb5-a02e-b9fc9ac0767f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:32.758003 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f381b4-13d2-4eb5-a02e-b9fc9ac0767f service neutron] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:32.765511 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56b5ccd-3f96-4ca3-ae81-a1a4b17b3177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:32.765705 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56b5ccd-3f96-4ca3-ae81-a1a4b17b3177 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:32.765992 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56b5ccd-3f96-4ca3-ae81-a1a4b17b3177 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:32.766212 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56b5ccd-3f96-4ca3-ae81-a1a4b17b3177 admin admin] PATH_INFO: `/v3/users/521d520fcbac4fbeae611ce8d7a0e74d` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:32.768217 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56b5ccd-3f96-4ca3-ae81-a1a4b17b3177 admin admin] RBAC: Authorizing `identity:delete_user(user_id=521d520fcbac4fbeae611ce8d7a0e74d)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:32.770986 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56b5ccd-3f96-4ca3-ae81-a1a4b17b3177 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:32.798997 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:13:32.831339 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee4ed52-3be8-4080-93ce-15896d6c5371 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:32.834426 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee4ed52-3be8-4080-93ce-15896d6c5371 service nova] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:32.844861 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-a56b5ccd-3f96-4ca3-ae81-a1a4b17b3177 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '521d520fcbac4fbeae611ce8d7a0e74d'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:32.847674 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 861/1712] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:13:32 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:13:32.849489 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a530671-5f2c-4700-a014-cf4af73fa1b2 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:32.849833 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a530671-5f2c-4700-a014-cf4af73fa1b2 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:32.850279 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a530671-5f2c-4700-a014-cf4af73fa1b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:32.882594 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-a56b5ccd-3f96-4ca3-ae81-a1a4b17b3177 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '521d520fcbac4fbeae611ce8d7a0e74d'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:32.884372 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-a56b5ccd-3f96-4ca3-ae81-a1a4b17b3177 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '521d520fcbac4fbeae611ce8d7a0e74d'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:32.897614 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-a56b5ccd-3f96-4ca3-ae81-a1a4b17b3177 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '521d520fcbac4fbeae611ce8d7a0e74d'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:32.932656 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-1a530671-5f2c-4700-a014-cf4af73fa1b2 None None] MFA Rules not processed for user `17b779a3e21a415bb42cde5d6863d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:13:32.934830 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-1a530671-5f2c-4700-a014-cf4af73fa1b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:32.946281 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-a56b5ccd-3f96-4ca3-ae81-a1a4b17b3177 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '521d520fcbac4fbeae611ce8d7a0e74d'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:32.968690 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 852/1713] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:13:32 2022] DELETE /identity/v3/users/521d520fcbac4fbeae611ce8d7a0e74d => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:13:32.973305 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4db43d1-05c2-470e-b387-9ca401aef72f None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:32.975060 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4db43d1-05c2-470e-b387-9ca401aef72f None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:32.975710 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4db43d1-05c2-470e-b387-9ca401aef72f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:33.024694 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-f4db43d1-05c2-470e-b387-9ca401aef72f None None] MFA Rules not processed for user `abc719a3b3ac4461b82ca04ab6451d81`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:13:33.027549 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-f4db43d1-05c2-470e-b387-9ca401aef72f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:33.030955 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 862/1714] 10.222.0.17 () {58 vars in 1009 bytes} [Sat Jul 23 21:13:32 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:13:33.130890 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 853/1715] 10.222.0.17 () {58 vars in 1009 bytes} [Sat Jul 23 21:13:32 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:13:33.169374 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718e5642-ea75-451e-b0e8-703f785b9fe3 None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:33.169741 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718e5642-ea75-451e-b0e8-703f785b9fe3 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:33.169980 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718e5642-ea75-451e-b0e8-703f785b9fe3 None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:33.171852 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 863/1716] 10.222.0.17 () {54 vars in 961 bytes} [Sat Jul 23 21:13:33 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:13:33.179749 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3715c14c-26bd-441a-a243-d95eccf28c8d None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:33.180039 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3715c14c-26bd-441a-a243-d95eccf28c8d None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:33.180273 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3715c14c-26bd-441a-a243-d95eccf28c8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:33.207171 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718e5642-ea75-451e-b0e8-703f785b9fe3 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:33.209201 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-718e5642-ea75-451e-b0e8-703f785b9fe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:33.211827 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-3715c14c-26bd-441a-a243-d95eccf28c8d None None] MFA Rules not processed for user `abc719a3b3ac4461b82ca04ab6451d81`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:13:33.213310 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-3715c14c-26bd-441a-a243-d95eccf28c8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:33.226023 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 854/1717] 10.222.0.17 () {58 vars in 1058 bytes} [Sat Jul 23 21:13:33 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:13:33.241091 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3715c14c-26bd-441a-a243-d95eccf28c8d None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:33.264905 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3715c14c-26bd-441a-a243-d95eccf28c8d None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:33.275246 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa454e7-6233-4b3c-bf82-d8f0eaae5199 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc719a3b3ac4461b82ca04ab6451d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:33.276018 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa454e7-6233-4b3c-bf82-d8f0eaae5199 service placement] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:33.279150 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa454e7-6233-4b3c-bf82-d8f0eaae5199 service placement] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:33.279150 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa454e7-6233-4b3c-bf82-d8f0eaae5199 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:33.312305 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa454e7-6233-4b3c-bf82-d8f0eaae5199 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:33.314231 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa454e7-6233-4b3c-bf82-d8f0eaae5199 service placement] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:33.342394 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 855/1718] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:13:33 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:13:33.346468 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa454e7-6233-4b3c-bf82-d8f0eaae5199 service placement] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:33.346702 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-caa454e7-6233-4b3c-bf82-d8f0eaae5199 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:33.415978 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718e5642-ea75-451e-b0e8-703f785b9fe3 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:33.422292 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df383fc-ef22-436a-a5b9-165899380a6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:33.422963 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df383fc-ef22-436a-a5b9-165899380a6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:33.429146 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df383fc-ef22-436a-a5b9-165899380a6d admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:33.429528 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df383fc-ef22-436a-a5b9-165899380a6d admin admin] PATH_INFO: `/v3/projects/ded4be9c03a54ecdbd517999f984ddf5` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:33.431927 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df383fc-ef22-436a-a5b9-165899380a6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ded4be9c03a54ecdbd517999f984ddf5)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:33.434779 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df383fc-ef22-436a-a5b9-165899380a6d admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:33.523690 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:13:33.532432 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:13:33.550724 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-2df383fc-ef22-436a-a5b9-165899380a6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ded4be9c03a54ecdbd517999f984ddf5', 'request_id': 'req-2df383fc-ef22-436a-a5b9-165899380a6d'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:33.565059 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-2df383fc-ef22-436a-a5b9-165899380a6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ded4be9c03a54ecdbd517999f984ddf5', 'request_id': 'req-2df383fc-ef22-436a-a5b9-165899380a6d'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:33.578699 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-2df383fc-ef22-436a-a5b9-165899380a6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ded4be9c03a54ecdbd517999f984ddf5', 'request_id': 'req-2df383fc-ef22-436a-a5b9-165899380a6d'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:33.581974 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa454e7-6233-4b3c-bf82-d8f0eaae5199 service placement] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:33.602425 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-2df383fc-ef22-436a-a5b9-165899380a6d admin admin] The token cache is being invalidate because project ded4be9c03a54ecdbd517999f984ddf5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:13:33.602858 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-2df383fc-ef22-436a-a5b9-165899380a6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:33.605697 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-2df383fc-ef22-436a-a5b9-165899380a6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:33.613045 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 864/1719] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:13:33 2022] DELETE /identity/v3/projects/ded4be9c03a54ecdbd517999f984ddf5 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:13:33.613045 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df383fc-ef22-436a-a5b9-165899380a6d admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:33.616260 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-2df383fc-ef22-436a-a5b9-165899380a6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:33.744622 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df383fc-ef22-436a-a5b9-165899380a6d admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:33.755428 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ba775a-2b02-4030-af73-0544288d2aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:33.756350 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ba775a-2b02-4030-af73-0544288d2aa5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:33.756613 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ba775a-2b02-4030-af73-0544288d2aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:33.756878 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ba775a-2b02-4030-af73-0544288d2aa5 admin admin] PATH_INFO: `/v3/projects/261deb211d6b45c39bbee3188d2ac559` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:33.758540 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ba775a-2b02-4030-af73-0544288d2aa5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=261deb211d6b45c39bbee3188d2ac559)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:33.760489 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ba775a-2b02-4030-af73-0544288d2aa5 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:33.771462 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560cc61c-fad9-44e3-9e63-a3524a236f18 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f0a685b7da46afb81024848f079d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:33.772142 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560cc61c-fad9-44e3-9e63-a3524a236f18 service swift] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:33.772420 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560cc61c-fad9-44e3-9e63-a3524a236f18 service swift] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:33.772814 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560cc61c-fad9-44e3-9e63-a3524a236f18 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:33.774773 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-560cc61c-fad9-44e3-9e63-a3524a236f18 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:33.888278 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560cc61c-fad9-44e3-9e63-a3524a236f18 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:33.895609 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560cc61c-fad9-44e3-9e63-a3524a236f18 service swift] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:33.896969 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-f7ba775a-2b02-4030-af73-0544288d2aa5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '261deb211d6b45c39bbee3188d2ac559', 'request_id': 'req-f7ba775a-2b02-4030-af73-0544288d2aa5'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:33.912004 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-f7ba775a-2b02-4030-af73-0544288d2aa5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '261deb211d6b45c39bbee3188d2ac559', 'request_id': 'req-f7ba775a-2b02-4030-af73-0544288d2aa5'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:33.912800 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 856/1720] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 23 21:13:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 570 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 23 21:13:33.915285 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deee2d50-838c-4724-8a8c-d32b66ef950f None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:33.915747 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deee2d50-838c-4724-8a8c-d32b66ef950f None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:33.916143 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deee2d50-838c-4724-8a8c-d32b66ef950f None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:33.918810 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 857/1721] 10.222.0.17 () {54 vars in 912 bytes} [Sat Jul 23 21:13:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:13:33.919324 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-f7ba775a-2b02-4030-af73-0544288d2aa5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '261deb211d6b45c39bbee3188d2ac559', 'request_id': 'req-f7ba775a-2b02-4030-af73-0544288d2aa5'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:33.920082 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f7e6c9-a4c6-4fa9-8b7e-3d7cff0a850d None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:33.920489 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f7e6c9-a4c6-4fa9-8b7e-3d7cff0a850d None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:33.920863 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f7e6c9-a4c6-4fa9-8b7e-3d7cff0a850d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:33.963355 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-d1f7e6c9-a4c6-4fa9-8b7e-3d7cff0a850d None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:13:33.965323 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-d1f7e6c9-a4c6-4fa9-8b7e-3d7cff0a850d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:33.969838 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-f7ba775a-2b02-4030-af73-0544288d2aa5 admin admin] The token cache is being invalidate because project 261deb211d6b45c39bbee3188d2ac559 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:13:33.970170 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-f7ba775a-2b02-4030-af73-0544288d2aa5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:33.972629 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-f7ba775a-2b02-4030-af73-0544288d2aa5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:33.983281 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 865/1722] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:13:33 2022] DELETE /identity/v3/projects/261deb211d6b45c39bbee3188d2ac559 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:13:33.983281 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ba775a-2b02-4030-af73-0544288d2aa5 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:33.986188 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-f7ba775a-2b02-4030-af73-0544288d2aa5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:34.156747 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 858/1723] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:13:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:13:34.163560 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f7e6c9-a4c6-4fa9-8b7e-3d7cff0a850d None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:34.163560 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-d1f7e6c9-a4c6-4fa9-8b7e-3d7cff0a850d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:34.168803 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:13:34.187471 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f7e6c9-a4c6-4fa9-8b7e-3d7cff0a850d None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:34.203863 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ba775a-2b02-4030-af73-0544288d2aa5 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:34.211050 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971e3fd0-8d3b-48a4-9db6-79bd19b160dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:34.212184 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971e3fd0-8d3b-48a4-9db6-79bd19b160dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:34.212509 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971e3fd0-8d3b-48a4-9db6-79bd19b160dd admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:34.212857 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971e3fd0-8d3b-48a4-9db6-79bd19b160dd admin admin] PATH_INFO: `/v3/projects/8f68d489e9f245e98eb543d2d31e4f49` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:34.215920 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971e3fd0-8d3b-48a4-9db6-79bd19b160dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f68d489e9f245e98eb543d2d31e4f49)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:34.218212 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971e3fd0-8d3b-48a4-9db6-79bd19b160dd admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:34.221353 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadf6f58-b548-4585-8a34-e4bc34710370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:34.222652 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadf6f58-b548-4585-8a34-e4bc34710370 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:34.223231 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadf6f58-b548-4585-8a34-e4bc34710370 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:34.223747 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadf6f58-b548-4585-8a34-e4bc34710370 admin admin] PATH_INFO: `/v3/users/ef5c4d542e1c4ceaba976d907a9fac04` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:34.225658 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadf6f58-b548-4585-8a34-e4bc34710370 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef5c4d542e1c4ceaba976d907a9fac04)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:34.228270 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadf6f58-b548-4585-8a34-e4bc34710370 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:34.323474 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:13:34.339022 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-fadf6f58-b548-4585-8a34-e4bc34710370 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef5c4d542e1c4ceaba976d907a9fac04'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:34.339746 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-fadf6f58-b548-4585-8a34-e4bc34710370 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef5c4d542e1c4ceaba976d907a9fac04'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:34.355283 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-fadf6f58-b548-4585-8a34-e4bc34710370 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef5c4d542e1c4ceaba976d907a9fac04'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:34.374495 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-fadf6f58-b548-4585-8a34-e4bc34710370 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef5c4d542e1c4ceaba976d907a9fac04'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:34.390139 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-971e3fd0-8d3b-48a4-9db6-79bd19b160dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f68d489e9f245e98eb543d2d31e4f49', 'request_id': 'req-971e3fd0-8d3b-48a4-9db6-79bd19b160dd'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:34.402119 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-971e3fd0-8d3b-48a4-9db6-79bd19b160dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f68d489e9f245e98eb543d2d31e4f49', 'request_id': 'req-971e3fd0-8d3b-48a4-9db6-79bd19b160dd'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:34.415451 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-fadf6f58-b548-4585-8a34-e4bc34710370 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef5c4d542e1c4ceaba976d907a9fac04'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:34.427779 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-971e3fd0-8d3b-48a4-9db6-79bd19b160dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f68d489e9f245e98eb543d2d31e4f49', 'request_id': 'req-971e3fd0-8d3b-48a4-9db6-79bd19b160dd'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:34.436990 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 866/1724] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:13:33 2022] DELETE /identity/v3/users/ef5c4d542e1c4ceaba976d907a9fac04 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:13:34.436990 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadf6f58-b548-4585-8a34-e4bc34710370 admin admin] Authenticating service token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 23 21:13:34.440854 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-fadf6f58-b548-4585-8a34-e4bc34710370 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:34.466217 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-971e3fd0-8d3b-48a4-9db6-79bd19b160dd admin admin] The token cache is being invalidate because project 8f68d489e9f245e98eb543d2d31e4f49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:13:34.466664 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-971e3fd0-8d3b-48a4-9db6-79bd19b160dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:34.467726 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-971e3fd0-8d3b-48a4-9db6-79bd19b160dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:34.475930 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 859/1725] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:13:34 2022] DELETE /identity/v3/projects/8f68d489e9f245e98eb543d2d31e4f49 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:13:34.477654 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bd6783-47c3-4fcc-9a3a-2597bf6e9e11 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:34.477969 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bd6783-47c3-4fcc-9a3a-2597bf6e9e11 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:34.478364 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bd6783-47c3-4fcc-9a3a-2597bf6e9e11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:34.537296 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-f9bd6783-47c3-4fcc-9a3a-2597bf6e9e11 None None] MFA Rules not processed for user `c497326ee890462e8f48b4a56f81990c`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:13:34.538848 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-f9bd6783-47c3-4fcc-9a3a-2597bf6e9e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:34.607404 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadf6f58-b548-4585-8a34-e4bc34710370 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:34.610090 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 860/1726] 10.222.0.42 () {58 vars in 1015 bytes} [Sat Jul 23 21:13:34 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:13:34.611804 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-fadf6f58-b548-4585-8a34-e4bc34710370 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:34.614633 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bd6783-47c3-4fcc-9a3a-2597bf6e9e11 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:34.619691 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-f9bd6783-47c3-4fcc-9a3a-2597bf6e9e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:34.731000 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bd6783-47c3-4fcc-9a3a-2597bf6e9e11 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:34.739209 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840f035a-ba60-48a7-a347-7585733f5196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:34.741259 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840f035a-ba60-48a7-a347-7585733f5196 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:34.742035 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840f035a-ba60-48a7-a347-7585733f5196 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:34.742644 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840f035a-ba60-48a7-a347-7585733f5196 admin admin] PATH_INFO: `/v3/users/cdd2a325dc5a4e0fa1d3b679afb5d863` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:34.743860 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadf6f58-b548-4585-8a34-e4bc34710370 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:34.744485 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840f035a-ba60-48a7-a347-7585733f5196 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cdd2a325dc5a4e0fa1d3b679afb5d863)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:34.747491 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840f035a-ba60-48a7-a347-7585733f5196 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:34.766105 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0deb6b-1a90-409c-9c31-5db99dd49e29 tempest-FlavorsAccessNegativeTestJSON-992011010 tempest-FlavorsAccessNegativeTestJSON-992011010-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f243774c8494e10b8b1690f2da39b82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '769afe32bc5d48dd9e24186168aaa3e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:34.768415 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0deb6b-1a90-409c-9c31-5db99dd49e29 tempest-FlavorsAccessNegativeTestJSON-992011010 tempest-FlavorsAccessNegativeTestJSON-992011010-project-admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:34.768679 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0deb6b-1a90-409c-9c31-5db99dd49e29 tempest-FlavorsAccessNegativeTestJSON-992011010 tempest-FlavorsAccessNegativeTestJSON-992011010-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:34.768929 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0deb6b-1a90-409c-9c31-5db99dd49e29 tempest-FlavorsAccessNegativeTestJSON-992011010 tempest-FlavorsAccessNegativeTestJSON-992011010-project-admin] PATH_INFO: `/v3/projects/c62a56af2f634cf49e7556c47b3215a6` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:34.770751 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0deb6b-1a90-409c-9c31-5db99dd49e29 tempest-FlavorsAccessNegativeTestJSON-992011010 tempest-FlavorsAccessNegativeTestJSON-992011010-project-admin] RBAC: Authorizing `identity:get_project(project_id=c62a56af2f634cf49e7556c47b3215a6)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:34.772949 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0deb6b-1a90-409c-9c31-5db99dd49e29 tempest-FlavorsAccessNegativeTestJSON-992011010 tempest-FlavorsAccessNegativeTestJSON-992011010-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:34.775087 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 867/1727] 10.222.0.17 () {58 vars in 1443 bytes} [Sat Jul 23 21:13:34 2022] GET /identity/v3/projects/c62a56af2f634cf49e7556c47b3215a6 => generated 393 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:13:34.776412 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1962ccf-912e-4634-93fd-a17d4640077b None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:34.776692 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1962ccf-912e-4634-93fd-a17d4640077b None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:34.776963 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1962ccf-912e-4634-93fd-a17d4640077b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:34.800588 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-d1962ccf-912e-4634-93fd-a17d4640077b None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:13:34.802053 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-d1962ccf-912e-4634-93fd-a17d4640077b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:34.816543 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 868/1728] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:13:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:13:34.818023 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a4ad61-b3ba-42f6-9c3b-f32afc9f4add None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:34.822752 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a4ad61-b3ba-42f6-9c3b-f32afc9f4add None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:34.824242 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a4ad61-b3ba-42f6-9c3b-f32afc9f4add None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:34.838118 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-840f035a-ba60-48a7-a347-7585733f5196 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cdd2a325dc5a4e0fa1d3b679afb5d863'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:34.850441 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:13:34.864330 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-840f035a-ba60-48a7-a347-7585733f5196 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cdd2a325dc5a4e0fa1d3b679afb5d863'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:34.865199 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-840f035a-ba60-48a7-a347-7585733f5196 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cdd2a325dc5a4e0fa1d3b679afb5d863'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:34.868463 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:13:34.881962 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-840f035a-ba60-48a7-a347-7585733f5196 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cdd2a325dc5a4e0fa1d3b679afb5d863'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:34.884435 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-91a4ad61-b3ba-42f6-9c3b-f32afc9f4add None None] MFA Rules not processed for user `95896f2064e34e5d82e9531e68aab170`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:13:34.893952 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-91a4ad61-b3ba-42f6-9c3b-f32afc9f4add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:34.904882 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-840f035a-ba60-48a7-a347-7585733f5196 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cdd2a325dc5a4e0fa1d3b679afb5d863'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:34.917285 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 861/1729] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:13:34 2022] DELETE /identity/v3/users/cdd2a325dc5a4e0fa1d3b679afb5d863 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:13:34.917285 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fcbbdf-9346-42e1-b9b1-5a3228080c50 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:34.917285 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fcbbdf-9346-42e1-b9b1-5a3228080c50 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:34.917285 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fcbbdf-9346-42e1-b9b1-5a3228080c50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:34.987823 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-17fcbbdf-9346-42e1-b9b1-5a3228080c50 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:13:34.989461 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-17fcbbdf-9346-42e1-b9b1-5a3228080c50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:35.044317 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 869/1730] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:13:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:13:35.046929 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57757ee0-5f8c-46df-b573-b76feb58820c None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:35.046929 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57757ee0-5f8c-46df-b573-b76feb58820c None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:35.046929 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57757ee0-5f8c-46df-b573-b76feb58820c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:35.069360 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 862/1731] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:13:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:13:35.070467 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fcbbdf-9346-42e1-b9b1-5a3228080c50 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:35.072463 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-17fcbbdf-9346-42e1-b9b1-5a3228080c50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:35.088744 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fcbbdf-9346-42e1-b9b1-5a3228080c50 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:35.092175 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-57757ee0-5f8c-46df-b573-b76feb58820c None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:13:35.093738 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-57757ee0-5f8c-46df-b573-b76feb58820c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:35.094840 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623c8bbc-0fc0-4992-80ad-8d1f579d3228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:35.097171 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623c8bbc-0fc0-4992-80ad-8d1f579d3228 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:35.097459 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623c8bbc-0fc0-4992-80ad-8d1f579d3228 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:35.097730 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623c8bbc-0fc0-4992-80ad-8d1f579d3228 admin admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:35.102319 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623c8bbc-0fc0-4992-80ad-8d1f579d3228 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:13:35.102505 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623c8bbc-0fc0-4992-80ad-8d1f579d3228 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:35.104089 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623c8bbc-0fc0-4992-80ad-8d1f579d3228 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:35.117506 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 870/1732] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:13:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:13:35.117506 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57757ee0-5f8c-46df-b573-b76feb58820c None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:35.119022 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 863/1733] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:13:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:13:35.122695 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-57757ee0-5f8c-46df-b573-b76feb58820c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:35.124548 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9411498c-ab20-4182-ad5c-57a948fd02bd None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:35.124838 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9411498c-ab20-4182-ad5c-57a948fd02bd None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:35.125485 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9411498c-ab20-4182-ad5c-57a948fd02bd None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:35.127601 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 864/1734] 10.222.0.17 () {54 vars in 912 bytes} [Sat Jul 23 21:13:35 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:13:35.128355 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9411498c-ab20-4182-ad5c-57a948fd02bd None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:35.130362 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-9411498c-ab20-4182-ad5c-57a948fd02bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:35.210749 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57757ee0-5f8c-46df-b573-b76feb58820c None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:35.215638 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a387be78-c909-4633-a3e8-453c47cbbd47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:35.216431 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a387be78-c909-4633-a3e8-453c47cbbd47 service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:35.216778 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a387be78-c909-4633-a3e8-453c47cbbd47 service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:35.217113 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a387be78-c909-4633-a3e8-453c47cbbd47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:35.219800 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-a387be78-c909-4633-a3e8-453c47cbbd47 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:35.249189 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a387be78-c909-4633-a3e8-453c47cbbd47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:35.252515 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a387be78-c909-4633-a3e8-453c47cbbd47 service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:35.260491 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9411498c-ab20-4182-ad5c-57a948fd02bd None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:35.262651 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 871/1735] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:13:35 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:13:35.263616 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a387be78-c909-4633-a3e8-453c47cbbd47 service neutron] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:35.269566 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0755f3b-065f-4620-bc3c-f6f0cea1a96a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:35.270398 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0755f3b-065f-4620-bc3c-f6f0cea1a96a service nova] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:35.270641 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0755f3b-065f-4620-bc3c-f6f0cea1a96a service nova] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:35.270972 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0755f3b-065f-4620-bc3c-f6f0cea1a96a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:35.274101 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-a0755f3b-065f-4620-bc3c-f6f0cea1a96a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:35.277009 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a387be78-c909-4633-a3e8-453c47cbbd47 service neutron] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:35.294600 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d41b05-c8fb-4501-bff9-f28c71d0146b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:35.295897 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d41b05-c8fb-4501-bff9-f28c71d0146b service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:35.296761 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d41b05-c8fb-4501-bff9-f28c71d0146b service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:35.297211 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d41b05-c8fb-4501-bff9-f28c71d0146b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:35.320925 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d41b05-c8fb-4501-bff9-f28c71d0146b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:35.324089 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d41b05-c8fb-4501-bff9-f28c71d0146b service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:35.344787 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 872/1736] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:13:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:13:35.347823 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6cac4f-ddb0-4787-b9c8-18f38481a5e7 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:35.348117 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6cac4f-ddb0-4787-b9c8-18f38481a5e7 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:35.348609 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6cac4f-ddb0-4787-b9c8-18f38481a5e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:35.382480 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-3f6cac4f-ddb0-4787-b9c8-18f38481a5e7 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:13:35.383821 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-3f6cac4f-ddb0-4787-b9c8-18f38481a5e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:35.398032 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 873/1737] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:13:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:13:35.398032 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6cac4f-ddb0-4787-b9c8-18f38481a5e7 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:35.401607 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0755f3b-065f-4620-bc3c-f6f0cea1a96a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:35.404778 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0755f3b-065f-4620-bc3c-f6f0cea1a96a service nova] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:35.414575 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:DELETE=3,keystone:SELECT=97 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:13:35.424751 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 865/1738] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:13:35 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:13:35.426352 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0755f3b-065f-4620-bc3c-f6f0cea1a96a service nova] Authenticating service token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 23 21:13:35.427891 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6cac4f-ddb0-4787-b9c8-18f38481a5e7 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:35.428819 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-a0755f3b-065f-4620-bc3c-f6f0cea1a96a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:35.446343 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906af742-024a-476f-bd03-abdfd1cede25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:35.451348 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906af742-024a-476f-bd03-abdfd1cede25 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:35.451626 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906af742-024a-476f-bd03-abdfd1cede25 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:35.457881 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906af742-024a-476f-bd03-abdfd1cede25 admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:35.458800 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906af742-024a-476f-bd03-abdfd1cede25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:35.460755 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906af742-024a-476f-bd03-abdfd1cede25 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:35.468636 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0755f3b-065f-4620-bc3c-f6f0cea1a96a service nova] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:35.474447 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-a0755f3b-065f-4620-bc3c-f6f0cea1a96a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:35.534587 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 874/1739] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:13:35 2022] POST /identity/v3/projects => generated 383 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:13:35.551469 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906af742-024a-476f-bd03-abdfd1cede25 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:35.667523 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0755f3b-065f-4620-bc3c-f6f0cea1a96a service nova] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:35.775818 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906af742-024a-476f-bd03-abdfd1cede25 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:35.786712 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307b569a-a2c7-486e-9637-28e6fa9a9cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:35.788808 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307b569a-a2c7-486e-9637-28e6fa9a9cdf admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:35.789647 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307b569a-a2c7-486e-9637-28e6fa9a9cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:35.790395 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307b569a-a2c7-486e-9637-28e6fa9a9cdf admin admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:35.796842 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307b569a-a2c7-486e-9637-28e6fa9a9cdf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:13:35.797242 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307b569a-a2c7-486e-9637-28e6fa9a9cdf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:35.799273 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307b569a-a2c7-486e-9637-28e6fa9a9cdf admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:35.803638 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:13:35.818547 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fc5d95-bec1-484e-96a7-80c37e74352f tempest-FlavorsAccessNegativeTestJSON-992011010 tempest-FlavorsAccessNegativeTestJSON-992011010-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f243774c8494e10b8b1690f2da39b82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '769afe32bc5d48dd9e24186168aaa3e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:35.819464 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fc5d95-bec1-484e-96a7-80c37e74352f tempest-FlavorsAccessNegativeTestJSON-992011010 tempest-FlavorsAccessNegativeTestJSON-992011010-project-admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:35.819744 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fc5d95-bec1-484e-96a7-80c37e74352f tempest-FlavorsAccessNegativeTestJSON-992011010 tempest-FlavorsAccessNegativeTestJSON-992011010-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:35.820016 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fc5d95-bec1-484e-96a7-80c37e74352f tempest-FlavorsAccessNegativeTestJSON-992011010 tempest-FlavorsAccessNegativeTestJSON-992011010-project-admin] PATH_INFO: `/v3/projects/c62a56af2f634cf49e7556c47b3215a6` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:35.822063 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fc5d95-bec1-484e-96a7-80c37e74352f tempest-FlavorsAccessNegativeTestJSON-992011010 tempest-FlavorsAccessNegativeTestJSON-992011010-project-admin] RBAC: Authorizing `identity:get_project(project_id=c62a56af2f634cf49e7556c47b3215a6)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:35.824062 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 875/1740] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:13:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:13:35.825163 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307b569a-a2c7-486e-9637-28e6fa9a9cdf admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:35.838567 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fc5d95-bec1-484e-96a7-80c37e74352f tempest-FlavorsAccessNegativeTestJSON-992011010 tempest-FlavorsAccessNegativeTestJSON-992011010-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:35.840559 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307b569a-a2c7-486e-9637-28e6fa9a9cdf admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:35.840857 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 866/1741] 10.222.0.17 () {58 vars in 1443 bytes} [Sat Jul 23 21:13:35 2022] GET /identity/v3/projects/c62a56af2f634cf49e7556c47b3215a6 => generated 393 bytes in 415 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:13:35.842410 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fc5d95-bec1-484e-96a7-80c37e74352f tempest-FlavorsAccessNegativeTestJSON-992011010 tempest-FlavorsAccessNegativeTestJSON-992011010-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:35.846255 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-31fc5d95-bec1-484e-96a7-80c37e74352f tempest-FlavorsAccessNegativeTestJSON-992011010 tempest-FlavorsAccessNegativeTestJSON-992011010-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:35.847626 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342638ff-b8e5-4c08-8b35-e102380fd42c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:35.848523 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342638ff-b8e5-4c08-8b35-e102380fd42c admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:35.850068 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342638ff-b8e5-4c08-8b35-e102380fd42c admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:35.850331 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342638ff-b8e5-4c08-8b35-e102380fd42c admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:35.851274 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342638ff-b8e5-4c08-8b35-e102380fd42c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:35.854639 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342638ff-b8e5-4c08-8b35-e102380fd42c admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:35.891440 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fc5d95-bec1-484e-96a7-80c37e74352f tempest-FlavorsAccessNegativeTestJSON-992011010 tempest-FlavorsAccessNegativeTestJSON-992011010-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:35.898811 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727710a0-8006-4b96-8846-e08ab171af00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:35.900470 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727710a0-8006-4b96-8846-e08ab171af00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:35.900661 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 876/1742] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:13:35 2022] POST /identity/v3/users => generated 292 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:13:35.900882 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727710a0-8006-4b96-8846-e08ab171af00 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:35.901160 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727710a0-8006-4b96-8846-e08ab171af00 admin admin] PATH_INFO: `/v3/projects/c39959ed6b824c75a46b058008ce3bd6` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:35.903104 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342638ff-b8e5-4c08-8b35-e102380fd42c admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:35.906339 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727710a0-8006-4b96-8846-e08ab171af00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c39959ed6b824c75a46b058008ce3bd6)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:35.909393 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727710a0-8006-4b96-8846-e08ab171af00 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:35.931283 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342638ff-b8e5-4c08-8b35-e102380fd42c admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:35.953518 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49e8657-fdbc-4bb1-9d56-bc5f4765ae01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:35.954404 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49e8657-fdbc-4bb1-9d56-bc5f4765ae01 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:35.954665 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49e8657-fdbc-4bb1-9d56-bc5f4765ae01 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:35.955073 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49e8657-fdbc-4bb1-9d56-bc5f4765ae01 admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:35.956260 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49e8657-fdbc-4bb1-9d56-bc5f4765ae01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:35.960358 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49e8657-fdbc-4bb1-9d56-bc5f4765ae01 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:35.983786 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-727710a0-8006-4b96-8846-e08ab171af00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c39959ed6b824c75a46b058008ce3bd6', 'request_id': 'req-727710a0-8006-4b96-8846-e08ab171af00'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:35.995893 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-727710a0-8006-4b96-8846-e08ab171af00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c39959ed6b824c75a46b058008ce3bd6', 'request_id': 'req-727710a0-8006-4b96-8846-e08ab171af00'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:36.005791 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-727710a0-8006-4b96-8846-e08ab171af00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c39959ed6b824c75a46b058008ce3bd6', 'request_id': 'req-727710a0-8006-4b96-8846-e08ab171af00'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:36.023043 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-727710a0-8006-4b96-8846-e08ab171af00 admin admin] The token cache is being invalidate because project c39959ed6b824c75a46b058008ce3bd6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:13:36.023635 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-727710a0-8006-4b96-8846-e08ab171af00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:36.024408 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-727710a0-8006-4b96-8846-e08ab171af00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:36.028582 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 867/1743] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:13:35 2022] DELETE /identity/v3/projects/c39959ed6b824c75a46b058008ce3bd6 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:13:36.031552 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727710a0-8006-4b96-8846-e08ab171af00 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:36.043806 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 877/1744] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:13:35 2022] POST /identity/v3/projects => generated 373 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:13:36.045360 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb0d6be-d15a-48f8-ba6c-b362d6a81f6b None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:36.045640 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb0d6be-d15a-48f8-ba6c-b362d6a81f6b None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:36.045930 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb0d6be-d15a-48f8-ba6c-b362d6a81f6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:36.048922 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-727710a0-8006-4b96-8846-e08ab171af00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:36.081048 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-6eb0d6be-d15a-48f8-ba6c-b362d6a81f6b None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:13:36.082625 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-6eb0d6be-d15a-48f8-ba6c-b362d6a81f6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:36.160700 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:13:36.265759 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 878/1745] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:13:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:13:36.266578 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb0d6be-d15a-48f8-ba6c-b362d6a81f6b None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:36.276907 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-6eb0d6be-d15a-48f8-ba6c-b362d6a81f6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:36.293004 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727710a0-8006-4b96-8846-e08ab171af00 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:36.299203 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb0d6be-d15a-48f8-ba6c-b362d6a81f6b None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:36.303003 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a76505-a787-4817-a756-9dda27b77596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:36.303706 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a76505-a787-4817-a756-9dda27b77596 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:36.303986 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a76505-a787-4817-a756-9dda27b77596 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:36.304256 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a76505-a787-4817-a756-9dda27b77596 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:36.304994 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a76505-a787-4817-a756-9dda27b77596 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:36.308596 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a76505-a787-4817-a756-9dda27b77596 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:36.312451 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3153ba9-509b-4b4a-9f38-efee1f516f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:36.313171 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3153ba9-509b-4b4a-9f38-efee1f516f69 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:36.313471 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3153ba9-509b-4b4a-9f38-efee1f516f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:36.313739 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3153ba9-509b-4b4a-9f38-efee1f516f69 admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:36.314488 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3153ba9-509b-4b4a-9f38-efee1f516f69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:36.316444 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3153ba9-509b-4b4a-9f38-efee1f516f69 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:36.336134 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 868/1746] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:13:36 2022] GET /identity/v3/roles => generated 1420 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:13:36.337796 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848f3c8d-086a-434a-a32e-fb504a04961b None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:36.338110 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848f3c8d-086a-434a-a32e-fb504a04961b None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:36.338382 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848f3c8d-086a-434a-a32e-fb504a04961b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:36.364577 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 879/1747] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:13:36 2022] POST /identity/v3/users => generated 287 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:13:36.367504 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3153ba9-509b-4b4a-9f38-efee1f516f69 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:36.382493 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-848f3c8d-086a-434a-a32e-fb504a04961b None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:13:36.385180 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-848f3c8d-086a-434a-a32e-fb504a04961b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:36.388449 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3153ba9-509b-4b4a-9f38-efee1f516f69 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:36.398942 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61438ff3-7960-4a0f-8c6f-8060769ab78e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:36.399772 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61438ff3-7960-4a0f-8c6f-8060769ab78e admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:36.400484 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61438ff3-7960-4a0f-8c6f-8060769ab78e admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:36.401577 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61438ff3-7960-4a0f-8c6f-8060769ab78e admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:36.402630 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61438ff3-7960-4a0f-8c6f-8060769ab78e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:36.407822 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61438ff3-7960-4a0f-8c6f-8060769ab78e admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:36.408157 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 869/1748] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:13:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:13:36.408157 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848f3c8d-086a-434a-a32e-fb504a04961b None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:36.427146 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848f3c8d-086a-434a-a32e-fb504a04961b None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:36.433627 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 880/1749] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:13:36 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:13:36.435137 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61438ff3-7960-4a0f-8c6f-8060769ab78e admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:36.445225 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ade3cfc-8317-4d3b-96b7-a89a22454851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:36.446094 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ade3cfc-8317-4d3b-96b7-a89a22454851 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:36.446466 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ade3cfc-8317-4d3b-96b7-a89a22454851 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:36.446971 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ade3cfc-8317-4d3b-96b7-a89a22454851 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:36.447894 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ade3cfc-8317-4d3b-96b7-a89a22454851 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:36.449657 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ade3cfc-8317-4d3b-96b7-a89a22454851 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:36.458144 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61438ff3-7960-4a0f-8c6f-8060769ab78e admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:36.472344 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a53052-8a9a-4245-b262-df02f88d1a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:36.473188 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a53052-8a9a-4245-b262-df02f88d1a31 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:36.473568 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a53052-8a9a-4245-b262-df02f88d1a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:36.473963 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a53052-8a9a-4245-b262-df02f88d1a31 admin admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:36.474816 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a53052-8a9a-4245-b262-df02f88d1a31 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:13:36.475194 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a53052-8a9a-4245-b262-df02f88d1a31 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:36.475649 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 870/1750] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:13:36 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:13:36.478304 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a53052-8a9a-4245-b262-df02f88d1a31 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:36.478739 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ade3cfc-8317-4d3b-96b7-a89a22454851 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:36.499354 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ade3cfc-8317-4d3b-96b7-a89a22454851 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:36.508022 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 881/1751] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:13:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:13:36.508022 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a53052-8a9a-4245-b262-df02f88d1a31 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:36.519620 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb52e960-2696-499a-8bb8-c58bf4243157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:36.520961 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb52e960-2696-499a-8bb8-c58bf4243157 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:36.520961 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb52e960-2696-499a-8bb8-c58bf4243157 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:36.521434 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb52e960-2696-499a-8bb8-c58bf4243157 admin admin] PATH_INFO: `/v3/projects/28f9d89c76024813b64fece7237df9cc/users/473e7990d0a64022853d3a21780b8977/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:36.548836 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a53052-8a9a-4245-b262-df02f88d1a31 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:36.550453 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb52e960-2696-499a-8bb8-c58bf4243157 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28f9d89c76024813b64fece7237df9cc, user_id=473e7990d0a64022853d3a21780b8977, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:36.553407 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb52e960-2696-499a-8bb8-c58bf4243157 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:36.557116 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d82f8e-70ea-4355-afc1-85b05eac6907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:36.558994 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d82f8e-70ea-4355-afc1-85b05eac6907 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:36.561256 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d82f8e-70ea-4355-afc1-85b05eac6907 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:36.561619 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d82f8e-70ea-4355-afc1-85b05eac6907 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:36.564759 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d82f8e-70ea-4355-afc1-85b05eac6907 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:36.567748 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d82f8e-70ea-4355-afc1-85b05eac6907 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:36.598022 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 882/1753] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:13:36 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:13:36.598022 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d82f8e-70ea-4355-afc1-85b05eac6907 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:36.604852 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 871/1753] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:13:36 2022] PUT /identity/v3/projects/28f9d89c76024813b64fece7237df9cc/users/473e7990d0a64022853d3a21780b8977/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:13:36.606224 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb52e960-2696-499a-8bb8-c58bf4243157 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:36.619791 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d82f8e-70ea-4355-afc1-85b05eac6907 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:36.747273 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb52e960-2696-499a-8bb8-c58bf4243157 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:36.759269 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e87b16-746d-4e89-8041-723ec095f1b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:36.760618 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e87b16-746d-4e89-8041-723ec095f1b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:36.760983 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e87b16-746d-4e89-8041-723ec095f1b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:36.761440 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e87b16-746d-4e89-8041-723ec095f1b4 admin admin] PATH_INFO: `/v3/projects/d2b1c3e999e447d2b7b591cf6b7639a6/users/ee8af4b5701d43cf912997b74b432821/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:36.768586 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a4b775-c05d-44e3-96da-c28dde4c15cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:36.769489 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a4b775-c05d-44e3-96da-c28dde4c15cb admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:36.769778 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a4b775-c05d-44e3-96da-c28dde4c15cb admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:36.770092 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a4b775-c05d-44e3-96da-c28dde4c15cb admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:36.771219 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a4b775-c05d-44e3-96da-c28dde4c15cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:36.773764 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a4b775-c05d-44e3-96da-c28dde4c15cb admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:36.780679 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e87b16-746d-4e89-8041-723ec095f1b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2b1c3e999e447d2b7b591cf6b7639a6, user_id=ee8af4b5701d43cf912997b74b432821, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:36.784509 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e87b16-746d-4e89-8041-723ec095f1b4 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:36.800264 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:13:36.811962 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 872/1754] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:13:36 2022] PUT /identity/v3/projects/d2b1c3e999e447d2b7b591cf6b7639a6/users/ee8af4b5701d43cf912997b74b432821/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:13:36.822410 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747b2ce1-b4da-4abe-a08d-e7aa120aff02 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:36.822410 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747b2ce1-b4da-4abe-a08d-e7aa120aff02 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:36.822410 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747b2ce1-b4da-4abe-a08d-e7aa120aff02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:36.856515 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 883/1755] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:13:36 2022] POST /identity/v3/projects => generated 411 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:13:36.857571 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a4b775-c05d-44e3-96da-c28dde4c15cb admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:36.863560 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-f6a4b775-c05d-44e3-96da-c28dde4c15cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:36.888133 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-747b2ce1-b4da-4abe-a08d-e7aa120aff02 None None] MFA Rules not processed for user `473e7990d0a64022853d3a21780b8977`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:13:36.889966 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-747b2ce1-b4da-4abe-a08d-e7aa120aff02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:37.020609 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:13:37.037138 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 873/1756] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:13:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:13:37.040663 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19add128-e1d2-4329-966c-4b800f048420 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:37.042600 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19add128-e1d2-4329-966c-4b800f048420 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:37.042981 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19add128-e1d2-4329-966c-4b800f048420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:37.053407 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a4b775-c05d-44e3-96da-c28dde4c15cb admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:37.063469 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6410adbd-dfc8-4b7e-a73b-de8866b87084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:37.064673 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6410adbd-dfc8-4b7e-a73b-de8866b87084 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:37.064673 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6410adbd-dfc8-4b7e-a73b-de8866b87084 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:37.064926 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6410adbd-dfc8-4b7e-a73b-de8866b87084 admin admin] PATH_INFO: `/v3/projects/929fe29a08e04fd4b35cfa46882ffc92` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:37.066168 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6410adbd-dfc8-4b7e-a73b-de8866b87084 admin admin] RBAC: Authorizing `identity:delete_project(project_id=929fe29a08e04fd4b35cfa46882ffc92)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:37.079869 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6410adbd-dfc8-4b7e-a73b-de8866b87084 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:37.114950 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-19add128-e1d2-4329-966c-4b800f048420 None None] MFA Rules not processed for user `ee8af4b5701d43cf912997b74b432821`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:13:37.116213 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-19add128-e1d2-4329-966c-4b800f048420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:37.187094 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-6410adbd-dfc8-4b7e-a73b-de8866b87084 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '929fe29a08e04fd4b35cfa46882ffc92', 'request_id': 'req-6410adbd-dfc8-4b7e-a73b-de8866b87084'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:37.208621 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-6410adbd-dfc8-4b7e-a73b-de8866b87084 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '929fe29a08e04fd4b35cfa46882ffc92', 'request_id': 'req-6410adbd-dfc8-4b7e-a73b-de8866b87084'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:37.215834 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-6410adbd-dfc8-4b7e-a73b-de8866b87084 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '929fe29a08e04fd4b35cfa46882ffc92', 'request_id': 'req-6410adbd-dfc8-4b7e-a73b-de8866b87084'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:37.239184 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-6410adbd-dfc8-4b7e-a73b-de8866b87084 admin admin] The token cache is being invalidate because project 929fe29a08e04fd4b35cfa46882ffc92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:13:37.239720 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-6410adbd-dfc8-4b7e-a73b-de8866b87084 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:37.240928 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-6410adbd-dfc8-4b7e-a73b-de8866b87084 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:37.243735 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 884/1757] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:13:36 2022] DELETE /identity/v3/projects/929fe29a08e04fd4b35cfa46882ffc92 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:13:37.244610 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6410adbd-dfc8-4b7e-a73b-de8866b87084 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:37.253718 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-6410adbd-dfc8-4b7e-a73b-de8866b87084 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:37.311134 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 874/1758] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:13:37 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:13:37.317956 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddffcee-05dc-4627-9b79-8a11b3aaf38e None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:37.318304 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddffcee-05dc-4627-9b79-8a11b3aaf38e None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:37.318581 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddffcee-05dc-4627-9b79-8a11b3aaf38e None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:37.320405 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 875/1759] 10.222.0.17 () {54 vars in 912 bytes} [Sat Jul 23 21:13:37 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:13:37.321195 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddffcee-05dc-4627-9b79-8a11b3aaf38e None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:37.324799 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-4ddffcee-05dc-4627-9b79-8a11b3aaf38e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:37.421788 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6410adbd-dfc8-4b7e-a73b-de8866b87084 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:37.437498 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec80f52-d680-443e-b71b-1c9ce72f4aa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:37.439247 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec80f52-d680-443e-b71b-1c9ce72f4aa6 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:37.439625 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec80f52-d680-443e-b71b-1c9ce72f4aa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:37.440010 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec80f52-d680-443e-b71b-1c9ce72f4aa6 admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:37.440830 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec80f52-d680-443e-b71b-1c9ce72f4aa6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:37.445062 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec80f52-d680-443e-b71b-1c9ce72f4aa6 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:37.460601 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddffcee-05dc-4627-9b79-8a11b3aaf38e None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:37.475263 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4081f0-f922-4100-8ec8-e69fdeaa4e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:37.477794 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4081f0-f922-4100-8ec8-e69fdeaa4e0b admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:37.479347 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4081f0-f922-4100-8ec8-e69fdeaa4e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:37.479628 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4081f0-f922-4100-8ec8-e69fdeaa4e0b admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:37.483358 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4081f0-f922-4100-8ec8-e69fdeaa4e0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:37.485384 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4081f0-f922-4100-8ec8-e69fdeaa4e0b admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:37.499504 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 885/1760] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:13:37 2022] POST /identity/v3/users => generated 306 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:13:37.499504 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec80f52-d680-443e-b71b-1c9ce72f4aa6 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:37.516614 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-eec80f52-d680-443e-b71b-1c9ce72f4aa6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:37.555478 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec80f52-d680-443e-b71b-1c9ce72f4aa6 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:37.574451 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c997470a-8d0e-4ff3-8044-d6835aa43d2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:37.577565 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 876/1761] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:13:37 2022] POST /identity/v3/projects => generated 381 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:13:37.579086 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4081f0-f922-4100-8ec8-e69fdeaa4e0b admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:37.579233 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c997470a-8d0e-4ff3-8044-d6835aa43d2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:37.579630 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c997470a-8d0e-4ff3-8044-d6835aa43d2f admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:37.581260 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c997470a-8d0e-4ff3-8044-d6835aa43d2f admin admin] PATH_INFO: `/v3/users/74a49bad80d14c8eb6b5c19903a1b3aa` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:37.587119 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-cc4081f0-f922-4100-8ec8-e69fdeaa4e0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:37.590121 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c997470a-8d0e-4ff3-8044-d6835aa43d2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=74a49bad80d14c8eb6b5c19903a1b3aa)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:37.592462 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c997470a-8d0e-4ff3-8044-d6835aa43d2f admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:37.605978 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:13:37.723813 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c997470a-8d0e-4ff3-8044-d6835aa43d2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74a49bad80d14c8eb6b5c19903a1b3aa'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:37.727007 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c997470a-8d0e-4ff3-8044-d6835aa43d2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74a49bad80d14c8eb6b5c19903a1b3aa'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:37.731732 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4081f0-f922-4100-8ec8-e69fdeaa4e0b admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:37.746521 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c997470a-8d0e-4ff3-8044-d6835aa43d2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74a49bad80d14c8eb6b5c19903a1b3aa'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:37.746698 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12a1536-750a-4801-af4e-ec282de76e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:37.747496 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12a1536-750a-4801-af4e-ec282de76e4f admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:37.747867 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12a1536-750a-4801-af4e-ec282de76e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:37.748111 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12a1536-750a-4801-af4e-ec282de76e4f admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:37.748737 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12a1536-750a-4801-af4e-ec282de76e4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:37.753553 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12a1536-750a-4801-af4e-ec282de76e4f admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:37.776579 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c997470a-8d0e-4ff3-8044-d6835aa43d2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74a49bad80d14c8eb6b5c19903a1b3aa'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:37.806795 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c997470a-8d0e-4ff3-8044-d6835aa43d2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74a49bad80d14c8eb6b5c19903a1b3aa'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:37.810549 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:13:37.833067 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 877/1762] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:13:37 2022] POST /identity/v3/projects => generated 371 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:13:37.833958 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12a1536-750a-4801-af4e-ec282de76e4f admin admin] Authenticating service token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 23 21:13:37.835789 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-a12a1536-750a-4801-af4e-ec282de76e4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:37.844289 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 886/1763] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:13:37 2022] DELETE /identity/v3/users/74a49bad80d14c8eb6b5c19903a1b3aa => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:13:37.846229 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c997470a-8d0e-4ff3-8044-d6835aa43d2f admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:37.853587 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-c997470a-8d0e-4ff3-8044-d6835aa43d2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:38.001518 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c997470a-8d0e-4ff3-8044-d6835aa43d2f admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:38.008986 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1e813e-59fd-43e3-8c12-799d401b355b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:38.011515 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1e813e-59fd-43e3-8c12-799d401b355b admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:38.012924 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1e813e-59fd-43e3-8c12-799d401b355b admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:38.013704 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1e813e-59fd-43e3-8c12-799d401b355b admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:38.016504 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1e813e-59fd-43e3-8c12-799d401b355b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:38.018950 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1e813e-59fd-43e3-8c12-799d401b355b admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:38.052486 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 887/1764] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:13:37 2022] GET /identity/v3/roles => generated 1420 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:13:38.053755 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1e813e-59fd-43e3-8c12-799d401b355b admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:38.059328 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-6e1e813e-59fd-43e3-8c12-799d401b355b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:38.069539 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12a1536-750a-4801-af4e-ec282de76e4f admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:38.074994 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-a12a1536-750a-4801-af4e-ec282de76e4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:38.077762 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1e813e-59fd-43e3-8c12-799d401b355b admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:38.087364 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573862f8-664d-47a8-ad06-1fa493b6b47f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:38.088046 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573862f8-664d-47a8-ad06-1fa493b6b47f admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:38.090111 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573862f8-664d-47a8-ad06-1fa493b6b47f admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:38.090111 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573862f8-664d-47a8-ad06-1fa493b6b47f admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:38.090111 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573862f8-664d-47a8-ad06-1fa493b6b47f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:38.096089 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573862f8-664d-47a8-ad06-1fa493b6b47f admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:38.152614 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 888/1765] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:13:38 2022] POST /identity/v3/users => generated 297 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:13:38.153815 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573862f8-664d-47a8-ad06-1fa493b6b47f admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:38.167340 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-573862f8-664d-47a8-ad06-1fa493b6b47f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:38.181516 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573862f8-664d-47a8-ad06-1fa493b6b47f admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:38.187721 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65bcea7-b9a8-4f7c-a00e-d78ec5514dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:38.189136 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65bcea7-b9a8-4f7c-a00e-d78ec5514dae admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:38.189136 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65bcea7-b9a8-4f7c-a00e-d78ec5514dae admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:38.189329 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65bcea7-b9a8-4f7c-a00e-d78ec5514dae admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:38.189974 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65bcea7-b9a8-4f7c-a00e-d78ec5514dae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:38.192101 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65bcea7-b9a8-4f7c-a00e-d78ec5514dae admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:38.226581 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 889/1766] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:13:38 2022] POST /identity/v3/users => generated 292 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:13:38.226581 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68c2501-04a3-47a2-8e7c-6a7c370fbc46 None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:38.227270 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68c2501-04a3-47a2-8e7c-6a7c370fbc46 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:38.227372 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68c2501-04a3-47a2-8e7c-6a7c370fbc46 None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:38.231738 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 890/1767] 10.222.0.17 () {54 vars in 921 bytes} [Sat Jul 23 21:13:38 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:13:38.234104 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68c2501-04a3-47a2-8e7c-6a7c370fbc46 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:38.246599 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12a1536-750a-4801-af4e-ec282de76e4f admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:38.276778 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68c2501-04a3-47a2-8e7c-6a7c370fbc46 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:38.286877 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9471eb89-6e30-4173-a30c-20a9aa7873cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:38.290445 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9471eb89-6e30-4173-a30c-20a9aa7873cb admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:38.290735 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9471eb89-6e30-4173-a30c-20a9aa7873cb admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:38.291011 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9471eb89-6e30-4173-a30c-20a9aa7873cb admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:38.293053 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9471eb89-6e30-4173-a30c-20a9aa7873cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:38.299983 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9471eb89-6e30-4173-a30c-20a9aa7873cb admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:38.329438 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 891/1768] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:13:38 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:13:38.330397 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9471eb89-6e30-4173-a30c-20a9aa7873cb admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:38.356408 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9471eb89-6e30-4173-a30c-20a9aa7873cb admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:38.401594 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54efb0bd-bca3-4664-ac9d-4a0a10c30de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:38.402362 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54efb0bd-bca3-4664-ac9d-4a0a10c30de7 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:38.402686 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54efb0bd-bca3-4664-ac9d-4a0a10c30de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:38.403003 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54efb0bd-bca3-4664-ac9d-4a0a10c30de7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:38.403694 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54efb0bd-bca3-4664-ac9d-4a0a10c30de7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:38.407903 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54efb0bd-bca3-4664-ac9d-4a0a10c30de7 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:38.430249 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 892/1769] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:13:38 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:13:38.438355 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54efb0bd-bca3-4664-ac9d-4a0a10c30de7 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:38.451882 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a965d9-728a-4cfe-85ae-08d7b246cd4f tempest-FlavorsAccessNegativeTestJSON-992011010 tempest-FlavorsAccessNegativeTestJSON-992011010-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f243774c8494e10b8b1690f2da39b82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '769afe32bc5d48dd9e24186168aaa3e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:38.459601 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a965d9-728a-4cfe-85ae-08d7b246cd4f tempest-FlavorsAccessNegativeTestJSON-992011010 tempest-FlavorsAccessNegativeTestJSON-992011010-project-admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:38.459988 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a965d9-728a-4cfe-85ae-08d7b246cd4f tempest-FlavorsAccessNegativeTestJSON-992011010 tempest-FlavorsAccessNegativeTestJSON-992011010-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:38.460296 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a965d9-728a-4cfe-85ae-08d7b246cd4f tempest-FlavorsAccessNegativeTestJSON-992011010 tempest-FlavorsAccessNegativeTestJSON-992011010-project-admin] PATH_INFO: `/v3/projects/aefbf9ae46e34052b41a581194a5ebfb` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:38.462450 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a965d9-728a-4cfe-85ae-08d7b246cd4f tempest-FlavorsAccessNegativeTestJSON-992011010 tempest-FlavorsAccessNegativeTestJSON-992011010-project-admin] RBAC: Authorizing `identity:get_project(project_id=aefbf9ae46e34052b41a581194a5ebfb)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:38.467787 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a965d9-728a-4cfe-85ae-08d7b246cd4f tempest-FlavorsAccessNegativeTestJSON-992011010 tempest-FlavorsAccessNegativeTestJSON-992011010-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:38.474829 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 878/1770] 10.222.0.17 () {58 vars in 1443 bytes} [Sat Jul 23 21:13:37 2022] GET /identity/v3/projects/aefbf9ae46e34052b41a581194a5ebfb => generated 395 bytes in 639 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:13:38.476820 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54efb0bd-bca3-4664-ac9d-4a0a10c30de7 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:38.477169 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512c53e3-a63e-4ec4-b579-bf668c61b87e None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:38.477456 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512c53e3-a63e-4ec4-b579-bf668c61b87e None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:38.481625 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512c53e3-a63e-4ec4-b579-bf668c61b87e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:38.502855 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11039ac-c664-41d3-93f4-ad05e2defd72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:38.503746 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11039ac-c664-41d3-93f4-ad05e2defd72 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:38.504176 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11039ac-c664-41d3-93f4-ad05e2defd72 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:38.504832 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11039ac-c664-41d3-93f4-ad05e2defd72 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:38.505573 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11039ac-c664-41d3-93f4-ad05e2defd72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:38.511038 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11039ac-c664-41d3-93f4-ad05e2defd72 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:38.532952 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-512c53e3-a63e-4ec4-b579-bf668c61b87e None None] MFA Rules not processed for user `079f31ed2c844e67bd4e206f24b69d97`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:13:38.534229 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-512c53e3-a63e-4ec4-b579-bf668c61b87e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:38.537825 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 893/1771] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:13:38 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:13:38.538854 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11039ac-c664-41d3-93f4-ad05e2defd72 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:38.581780 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11039ac-c664-41d3-93f4-ad05e2defd72 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:38.601290 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f57822-b4fa-4452-90de-aaca65c6e91e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:38.604706 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f57822-b4fa-4452-90de-aaca65c6e91e admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:38.606288 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f57822-b4fa-4452-90de-aaca65c6e91e admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:38.606833 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f57822-b4fa-4452-90de-aaca65c6e91e admin admin] PATH_INFO: `/v3/projects/915bc70310864741842ac671ead5fd4a/users/f6cda6d061484b8aba7fc3ace8a49533/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:38.617914 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=83,keystone:DELETE=10,keystone:INSERT=7 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:13:38.658695 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f57822-b4fa-4452-90de-aaca65c6e91e admin admin] RBAC: Authorizing `identity:create_grant(project_id=915bc70310864741842ac671ead5fd4a, user_id=f6cda6d061484b8aba7fc3ace8a49533, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:38.662490 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f57822-b4fa-4452-90de-aaca65c6e91e admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:38.671422 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:13:38.728173 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 894/1772] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:13:38 2022] PUT /identity/v3/projects/915bc70310864741842ac671ead5fd4a/users/f6cda6d061484b8aba7fc3ace8a49533/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:13:38.730616 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f57822-b4fa-4452-90de-aaca65c6e91e admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:38.774043 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 879/1773] 10.222.0.17 () {58 vars in 1018 bytes} [Sat Jul 23 21:13:38 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:13:38.775890 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512c53e3-a63e-4ec4-b579-bf668c61b87e None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:38.804253 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512c53e3-a63e-4ec4-b579-bf668c61b87e None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:38.845608 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f57822-b4fa-4452-90de-aaca65c6e91e admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:38.851938 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae836e9-e4dc-42a9-afee-bdafd9eb989c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:38.852870 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae836e9-e4dc-42a9-afee-bdafd9eb989c admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:38.853143 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae836e9-e4dc-42a9-afee-bdafd9eb989c admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:38.853413 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae836e9-e4dc-42a9-afee-bdafd9eb989c admin admin] PATH_INFO: `/v3/projects/b124e69204e9439f8e6c9bbfa167a4e5/users/12a3cf4db2204c69b75a1640b17ee36e/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:38.874162 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae836e9-e4dc-42a9-afee-bdafd9eb989c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b124e69204e9439f8e6c9bbfa167a4e5, user_id=12a3cf4db2204c69b75a1640b17ee36e, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:38.878686 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae836e9-e4dc-42a9-afee-bdafd9eb989c admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:38.884495 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0fb70a-5a97-4ef2-9547-4e64d81f0524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:38.886003 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0fb70a-5a97-4ef2-9547-4e64d81f0524 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:38.886466 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0fb70a-5a97-4ef2-9547-4e64d81f0524 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:38.886771 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0fb70a-5a97-4ef2-9547-4e64d81f0524 admin admin] PATH_INFO: `/v3/projects/527c04714bed423da08a3a662ae06f92/users/6118db3609df4bc2aa46d956e985fd05/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:38.907307 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0fb70a-5a97-4ef2-9547-4e64d81f0524 admin admin] RBAC: Authorizing `identity:create_grant(project_id=527c04714bed423da08a3a662ae06f92, user_id=6118db3609df4bc2aa46d956e985fd05, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:38.909973 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0fb70a-5a97-4ef2-9547-4e64d81f0524 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:38.913371 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 895/1774] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:13:38 2022] PUT /identity/v3/projects/b124e69204e9439f8e6c9bbfa167a4e5/users/12a3cf4db2204c69b75a1640b17ee36e/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:13:38.914321 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae836e9-e4dc-42a9-afee-bdafd9eb989c admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:38.916090 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-aae836e9-e4dc-42a9-afee-bdafd9eb989c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:38.929228 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 880/1775] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:13:38 2022] PUT /identity/v3/projects/527c04714bed423da08a3a662ae06f92/users/6118db3609df4bc2aa46d956e985fd05/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:13:38.930207 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0fb70a-5a97-4ef2-9547-4e64d81f0524 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:38.932528 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-4a0fb70a-5a97-4ef2-9547-4e64d81f0524 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:39.008452 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae836e9-e4dc-42a9-afee-bdafd9eb989c admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:39.035380 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0fb70a-5a97-4ef2-9547-4e64d81f0524 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:39.040821 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369e06b3-4e2a-4f39-8e32-bcbcef31bf18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:39.041712 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369e06b3-4e2a-4f39-8e32-bcbcef31bf18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:39.042024 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369e06b3-4e2a-4f39-8e32-bcbcef31bf18 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:39.042297 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369e06b3-4e2a-4f39-8e32-bcbcef31bf18 admin admin] PATH_INFO: `/v3/projects/55b250efc0d94d91a943680a3b56d71e` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:39.043595 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369e06b3-4e2a-4f39-8e32-bcbcef31bf18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=55b250efc0d94d91a943680a3b56d71e)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:39.045535 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369e06b3-4e2a-4f39-8e32-bcbcef31bf18 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:39.106315 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-369e06b3-4e2a-4f39-8e32-bcbcef31bf18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55b250efc0d94d91a943680a3b56d71e', 'request_id': 'req-369e06b3-4e2a-4f39-8e32-bcbcef31bf18'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:39.107073 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009b2c56-fb32-41a7-b6c3-bcb85d17f713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:39.107796 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009b2c56-fb32-41a7-b6c3-bcb85d17f713 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:39.107956 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009b2c56-fb32-41a7-b6c3-bcb85d17f713 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:39.108266 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009b2c56-fb32-41a7-b6c3-bcb85d17f713 admin admin] PATH_INFO: `/v3/users/5edd58f5094b474aa98cf79cbcbebd5b` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:39.109686 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009b2c56-fb32-41a7-b6c3-bcb85d17f713 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5edd58f5094b474aa98cf79cbcbebd5b)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:39.111688 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009b2c56-fb32-41a7-b6c3-bcb85d17f713 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:39.118216 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-369e06b3-4e2a-4f39-8e32-bcbcef31bf18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55b250efc0d94d91a943680a3b56d71e', 'request_id': 'req-369e06b3-4e2a-4f39-8e32-bcbcef31bf18'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:39.119534 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:13:39.131671 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-369e06b3-4e2a-4f39-8e32-bcbcef31bf18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55b250efc0d94d91a943680a3b56d71e', 'request_id': 'req-369e06b3-4e2a-4f39-8e32-bcbcef31bf18'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:39.140563 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:13:39.146965 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-369e06b3-4e2a-4f39-8e32-bcbcef31bf18 admin admin] The token cache is being invalidate because project 55b250efc0d94d91a943680a3b56d71e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:13:39.147480 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-369e06b3-4e2a-4f39-8e32-bcbcef31bf18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:39.148307 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-369e06b3-4e2a-4f39-8e32-bcbcef31bf18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:39.150783 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 881/1776] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:13:38 2022] DELETE /identity/v3/projects/55b250efc0d94d91a943680a3b56d71e => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:13:39.152212 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ebd11e-8029-4362-9ca3-eb8a0825cf8f None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:39.153781 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ebd11e-8029-4362-9ca3-eb8a0825cf8f None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:39.154255 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ebd11e-8029-4362-9ca3-eb8a0825cf8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:39.191541 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-009b2c56-fb32-41a7-b6c3-bcb85d17f713 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5edd58f5094b474aa98cf79cbcbebd5b'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:39.191727 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-d8ebd11e-8029-4362-9ca3-eb8a0825cf8f None None] MFA Rules not processed for user `f6cda6d061484b8aba7fc3ace8a49533`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:13:39.192661 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-009b2c56-fb32-41a7-b6c3-bcb85d17f713 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5edd58f5094b474aa98cf79cbcbebd5b'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:39.193219 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-d8ebd11e-8029-4362-9ca3-eb8a0825cf8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:39.214542 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-009b2c56-fb32-41a7-b6c3-bcb85d17f713 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5edd58f5094b474aa98cf79cbcbebd5b'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:39.226568 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-009b2c56-fb32-41a7-b6c3-bcb85d17f713 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5edd58f5094b474aa98cf79cbcbebd5b'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:39.242867 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-009b2c56-fb32-41a7-b6c3-bcb85d17f713 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5edd58f5094b474aa98cf79cbcbebd5b'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:39.261073 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 896/1777] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:13:38 2022] DELETE /identity/v3/users/5edd58f5094b474aa98cf79cbcbebd5b => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:13:39.264731 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009b2c56-fb32-41a7-b6c3-bcb85d17f713 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:39.266179 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-009b2c56-fb32-41a7-b6c3-bcb85d17f713 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:39.311416 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 882/1778] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:13:39 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:13:39.312677 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ebd11e-8029-4362-9ca3-eb8a0825cf8f None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:39.314293 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-d8ebd11e-8029-4362-9ca3-eb8a0825cf8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:39.373042 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009b2c56-fb32-41a7-b6c3-bcb85d17f713 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:39.381169 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7d9131-e9bf-4d11-a02f-163d9f61de18 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:39.381851 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7d9131-e9bf-4d11-a02f-163d9f61de18 service nova] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:39.382180 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7d9131-e9bf-4d11-a02f-163d9f61de18 service nova] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:39.382455 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7d9131-e9bf-4d11-a02f-163d9f61de18 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:39.384247 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-8b7d9131-e9bf-4d11-a02f-163d9f61de18 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:39.401632 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7d9131-e9bf-4d11-a02f-163d9f61de18 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:39.403399 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7d9131-e9bf-4d11-a02f-163d9f61de18 service nova] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:39.420291 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 897/1779] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:13:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:13:39.421510 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7d9131-e9bf-4d11-a02f-163d9f61de18 service nova] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:39.422948 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-8b7d9131-e9bf-4d11-a02f-163d9f61de18 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:39.487724 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ebd11e-8029-4362-9ca3-eb8a0825cf8f None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:39.538247 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7d9131-e9bf-4d11-a02f-163d9f61de18 service nova] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:39.563788 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab6efed-7b18-473b-b09c-de5714761e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:39.564639 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab6efed-7b18-473b-b09c-de5714761e89 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:39.564928 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab6efed-7b18-473b-b09c-de5714761e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:39.565206 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab6efed-7b18-473b-b09c-de5714761e89 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:39.566056 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab6efed-7b18-473b-b09c-de5714761e89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:39.574802 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab6efed-7b18-473b-b09c-de5714761e89 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:39.596737 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 898/1780] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:13:39 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:13:39.597902 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e000567-2d42-43c4-bd29-2726f4d8b85f None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:39.598256 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e000567-2d42-43c4-bd29-2726f4d8b85f None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:39.598505 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e000567-2d42-43c4-bd29-2726f4d8b85f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:39.627877 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-9e000567-2d42-43c4-bd29-2726f4d8b85f None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:13:39.629344 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-9e000567-2d42-43c4-bd29-2726f4d8b85f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:39.646794 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09f5557-55cd-4704-98fb-771f7ad8c5fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:39.647507 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 899/1781] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:13:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:13:39.649190 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa39439-6a35-4e10-838e-ffb9010d0ca2 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:39.649626 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa39439-6a35-4e10-838e-ffb9010d0ca2 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:39.650069 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa39439-6a35-4e10-838e-ffb9010d0ca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:39.652379 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09f5557-55cd-4704-98fb-771f7ad8c5fa admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:39.652670 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09f5557-55cd-4704-98fb-771f7ad8c5fa admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:39.652975 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09f5557-55cd-4704-98fb-771f7ad8c5fa admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:39.653781 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09f5557-55cd-4704-98fb-771f7ad8c5fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:39.660186 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09f5557-55cd-4704-98fb-771f7ad8c5fa admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:39.690455 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 883/1782] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:13:39 2022] GET /identity/v3/roles => generated 1420 bytes in 378 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:13:39.691221 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09f5557-55cd-4704-98fb-771f7ad8c5fa admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:39.692585 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-4aa39439-6a35-4e10-838e-ffb9010d0ca2 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:13:39.695009 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-4aa39439-6a35-4e10-838e-ffb9010d0ca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:39.705942 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-a09f5557-55cd-4704-98fb-771f7ad8c5fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:39.717695 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 900/1783] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:13:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:13:39.724374 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa39439-6a35-4e10-838e-ffb9010d0ca2 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:39.730734 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:13:39.737284 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09f5557-55cd-4704-98fb-771f7ad8c5fa admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:39.742628 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa39439-6a35-4e10-838e-ffb9010d0ca2 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:39.751188 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1db6d8-f8de-4cad-9ac3-4cd2f428e53c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:39.751881 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1db6d8-f8de-4cad-9ac3-4cd2f428e53c admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:39.752150 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1db6d8-f8de-4cad-9ac3-4cd2f428e53c admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:39.752398 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2d346f-3ba0-43c4-85e9-fa8dae76ee65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:39.752565 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1db6d8-f8de-4cad-9ac3-4cd2f428e53c admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:39.753106 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1db6d8-f8de-4cad-9ac3-4cd2f428e53c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:39.753333 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2d346f-3ba0-43c4-85e9-fa8dae76ee65 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:39.753610 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2d346f-3ba0-43c4-85e9-fa8dae76ee65 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:39.753902 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2d346f-3ba0-43c4-85e9-fa8dae76ee65 admin admin] PATH_INFO: `/v3/projects/527c04714bed423da08a3a662ae06f92/users/6118db3609df4bc2aa46d956e985fd05/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:39.756056 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2d346f-3ba0-43c4-85e9-fa8dae76ee65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=527c04714bed423da08a3a662ae06f92, user_id=6118db3609df4bc2aa46d956e985fd05, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:39.759011 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2d346f-3ba0-43c4-85e9-fa8dae76ee65 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:39.759995 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1db6d8-f8de-4cad-9ac3-4cd2f428e53c admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:39.779704 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:DELETE=2,keystone:SELECT=97,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:13:39.782511 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 901/1784] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:13:39 2022] PUT /identity/v3/projects/527c04714bed423da08a3a662ae06f92/users/6118db3609df4bc2aa46d956e985fd05/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:13:39.784472 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e79f957-f59d-4d3d-81d8-40a2bb55c859 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:39.784910 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e79f957-f59d-4d3d-81d8-40a2bb55c859 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:39.785271 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e79f957-f59d-4d3d-81d8-40a2bb55c859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:39.814527 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 884/1785] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:13:39 2022] POST /identity/v3/projects => generated 411 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:13:39.814527 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1db6d8-f8de-4cad-9ac3-4cd2f428e53c admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:39.845044 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-2e79f957-f59d-4d3d-81d8-40a2bb55c859 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:13:39.848045 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-2e79f957-f59d-4d3d-81d8-40a2bb55c859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:39.961195 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1db6d8-f8de-4cad-9ac3-4cd2f428e53c admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:39.966649 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9da1805-f2d7-48fc-8c9c-8a5c7fc95699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:39.967579 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9da1805-f2d7-48fc-8c9c-8a5c7fc95699 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:39.967852 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9da1805-f2d7-48fc-8c9c-8a5c7fc95699 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:39.968118 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9da1805-f2d7-48fc-8c9c-8a5c7fc95699 admin admin] PATH_INFO: `/v3/projects/b124e69204e9439f8e6c9bbfa167a4e5/users/12a3cf4db2204c69b75a1640b17ee36e/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:39.975569 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 902/1786] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:13:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:13:39.975569 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e79f957-f59d-4d3d-81d8-40a2bb55c859 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:39.975919 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9da1805-f2d7-48fc-8c9c-8a5c7fc95699 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b124e69204e9439f8e6c9bbfa167a4e5, user_id=12a3cf4db2204c69b75a1640b17ee36e, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:39.979454 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9da1805-f2d7-48fc-8c9c-8a5c7fc95699 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:39.983018 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-2e79f957-f59d-4d3d-81d8-40a2bb55c859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:40.017942 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 885/1787] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:13:39 2022] PUT /identity/v3/projects/b124e69204e9439f8e6c9bbfa167a4e5/users/12a3cf4db2204c69b75a1640b17ee36e/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:13:40.025908 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11380b36-817a-4a22-ac8b-1084560cf1c2 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:40.025908 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11380b36-817a-4a22-ac8b-1084560cf1c2 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:40.025908 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11380b36-817a-4a22-ac8b-1084560cf1c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:40.061018 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-11380b36-817a-4a22-ac8b-1084560cf1c2 None None] MFA Rules not processed for user `6118db3609df4bc2aa46d956e985fd05`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:13:40.062385 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-11380b36-817a-4a22-ac8b-1084560cf1c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:40.070735 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e79f957-f59d-4d3d-81d8-40a2bb55c859 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:40.130102 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ddd83a-fe54-493a-8cd4-211a6c8b6106 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:40.130768 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ddd83a-fe54-493a-8cd4-211a6c8b6106 service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:40.131044 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ddd83a-fe54-493a-8cd4-211a6c8b6106 service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:40.131314 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ddd83a-fe54-493a-8cd4-211a6c8b6106 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:40.153902 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 886/1788] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:13:40 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:13:40.153902 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11380b36-817a-4a22-ac8b-1084560cf1c2 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:40.203568 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:13:40.206682 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ddd83a-fe54-493a-8cd4-211a6c8b6106 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:40.208314 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ddd83a-fe54-493a-8cd4-211a6c8b6106 service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:40.219705 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 903/1789] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:13:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:13:40.228152 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ddd83a-fe54-493a-8cd4-211a6c8b6106 service neutron] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:40.236574 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11380b36-817a-4a22-ac8b-1084560cf1c2 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:40.242322 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5539c10-26c7-4278-897a-4d1d64810fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:40.243015 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5539c10-26c7-4278-897a-4d1d64810fff admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:40.243306 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5539c10-26c7-4278-897a-4d1d64810fff admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:40.243600 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5539c10-26c7-4278-897a-4d1d64810fff admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:40.245158 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5539c10-26c7-4278-897a-4d1d64810fff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:40.247174 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5539c10-26c7-4278-897a-4d1d64810fff admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:40.257258 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ddd83a-fe54-493a-8cd4-211a6c8b6106 service neutron] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:40.274085 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792dcae6-8e95-4e27-83c2-c6be03ad10e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:40.274790 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792dcae6-8e95-4e27-83c2-c6be03ad10e0 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:40.275074 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792dcae6-8e95-4e27-83c2-c6be03ad10e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:40.275336 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792dcae6-8e95-4e27-83c2-c6be03ad10e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:40.276069 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792dcae6-8e95-4e27-83c2-c6be03ad10e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:13:40.276365 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792dcae6-8e95-4e27-83c2-c6be03ad10e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:40.278044 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792dcae6-8e95-4e27-83c2-c6be03ad10e0 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:40.300044 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 887/1790] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:13:40 2022] POST /identity/v3/users => generated 312 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:13:40.302691 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33514d23-7c64-4682-90cc-beb9b18a8487 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:40.303202 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33514d23-7c64-4682-90cc-beb9b18a8487 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:40.303952 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33514d23-7c64-4682-90cc-beb9b18a8487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:40.317613 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:13:40.329901 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 904/1791] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:13:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:13:40.333299 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792dcae6-8e95-4e27-83c2-c6be03ad10e0 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:40.335935 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-792dcae6-8e95-4e27-83c2-c6be03ad10e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:40.349999 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-33514d23-7c64-4682-90cc-beb9b18a8487 None None] MFA Rules not processed for user `12a3cf4db2204c69b75a1640b17ee36e`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:13:40.351954 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-33514d23-7c64-4682-90cc-beb9b18a8487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:40.444495 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792dcae6-8e95-4e27-83c2-c6be03ad10e0 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:40.450341 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016e0fe1-0cb3-4c5f-867b-1133626b2493 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:40.451198 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016e0fe1-0cb3-4c5f-867b-1133626b2493 service nova] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:40.451481 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016e0fe1-0cb3-4c5f-867b-1133626b2493 service nova] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:40.451752 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016e0fe1-0cb3-4c5f-867b-1133626b2493 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:40.464961 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 888/1792] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:13:40 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:13:40.466090 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33514d23-7c64-4682-90cc-beb9b18a8487 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:40.476095 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016e0fe1-0cb3-4c5f-867b-1133626b2493 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:40.477635 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016e0fe1-0cb3-4c5f-867b-1133626b2493 service nova] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:40.496040 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 905/1793] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:13:40 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:13:40.499171 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016e0fe1-0cb3-4c5f-867b-1133626b2493 service nova] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:40.502174 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33514d23-7c64-4682-90cc-beb9b18a8487 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:40.512199 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016e0fe1-0cb3-4c5f-867b-1133626b2493 service nova] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:40.514367 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a15c44-128a-4a23-b91e-13ca202740e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:40.515170 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a15c44-128a-4a23-b91e-13ca202740e9 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:40.518820 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a15c44-128a-4a23-b91e-13ca202740e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:40.519012 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eed6e5-ffcc-4fc4-aeba-4a2269d3bd6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:40.519261 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a15c44-128a-4a23-b91e-13ca202740e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:40.519945 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eed6e5-ffcc-4fc4-aeba-4a2269d3bd6b admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:40.520154 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a15c44-128a-4a23-b91e-13ca202740e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:40.521144 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eed6e5-ffcc-4fc4-aeba-4a2269d3bd6b admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:40.521447 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eed6e5-ffcc-4fc4-aeba-4a2269d3bd6b admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:40.522294 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a15c44-128a-4a23-b91e-13ca202740e9 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:40.529012 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72eed6e5-ffcc-4fc4-aeba-4a2269d3bd6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:40.531638 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72eed6e5-ffcc-4fc4-aeba-4a2269d3bd6b admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:40.559328 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 889/1794] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:13:40 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:13:40.560651 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a15c44-128a-4a23-b91e-13ca202740e9 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:40.596905 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 906/1795] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:13:40 2022] POST /identity/v3/projects => generated 381 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:13:40.603147 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a15c44-128a-4a23-b91e-13ca202740e9 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:40.603548 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eed6e5-ffcc-4fc4-aeba-4a2269d3bd6b admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:40.717772 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eed6e5-ffcc-4fc4-aeba-4a2269d3bd6b admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:40.722907 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8163522f-81da-4d17-84a9-709383c6fadf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:40.723921 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8163522f-81da-4d17-84a9-709383c6fadf admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:40.724445 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8163522f-81da-4d17-84a9-709383c6fadf admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:40.724575 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8163522f-81da-4d17-84a9-709383c6fadf admin admin] PATH_INFO: `/v3/projects/32b46be372824ec49b0ef96868e02437/users/f35d04ec736e4ebe99685b340f399b96/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:40.746555 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b5ceff-d541-42fc-99a2-13147233c3fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:40.747326 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b5ceff-d541-42fc-99a2-13147233c3fa service nova] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:40.747771 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b5ceff-d541-42fc-99a2-13147233c3fa service nova] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:40.748052 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b5ceff-d541-42fc-99a2-13147233c3fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:40.754788 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8163522f-81da-4d17-84a9-709383c6fadf admin admin] RBAC: Authorizing `identity:create_grant(project_id=32b46be372824ec49b0ef96868e02437, user_id=f35d04ec736e4ebe99685b340f399b96, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:40.759237 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8163522f-81da-4d17-84a9-709383c6fadf admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:40.784325 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 907/1796] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:13:40 2022] PUT /identity/v3/projects/32b46be372824ec49b0ef96868e02437/users/f35d04ec736e4ebe99685b340f399b96/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:13:40.785340 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8163522f-81da-4d17-84a9-709383c6fadf admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:40.838649 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b5ceff-d541-42fc-99a2-13147233c3fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:40.840726 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b5ceff-d541-42fc-99a2-13147233c3fa service nova] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:40.845358 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:13:40.864973 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 890/1797] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:13:40 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:13:40.866208 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b5ceff-d541-42fc-99a2-13147233c3fa service nova] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:40.868464 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-90b5ceff-d541-42fc-99a2-13147233c3fa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:40.912957 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8163522f-81da-4d17-84a9-709383c6fadf admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:40.917789 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b5ceff-d541-42fc-99a2-13147233c3fa service nova] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:40.923179 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a9caaf-e9e1-4afe-8412-97b6e2100113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:40.923324 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52b084b-c721-4bd1-a9eb-a28b43e0ab36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:40.924034 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a9caaf-e9e1-4afe-8412-97b6e2100113 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:40.924673 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a9caaf-e9e1-4afe-8412-97b6e2100113 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:40.924923 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52b084b-c721-4bd1-a9eb-a28b43e0ab36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:40.925034 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a9caaf-e9e1-4afe-8412-97b6e2100113 admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:40.925221 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52b084b-c721-4bd1-a9eb-a28b43e0ab36 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:40.925502 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52b084b-c721-4bd1-a9eb-a28b43e0ab36 admin admin] PATH_INFO: `/v3/projects/c62a56af2f634cf49e7556c47b3215a6` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:40.925668 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a9caaf-e9e1-4afe-8412-97b6e2100113 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:40.927203 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52b084b-c721-4bd1-a9eb-a28b43e0ab36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c62a56af2f634cf49e7556c47b3215a6)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:40.928149 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a9caaf-e9e1-4afe-8412-97b6e2100113 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:40.929460 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52b084b-c721-4bd1-a9eb-a28b43e0ab36 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:40.937311 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:13:40.976901 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 908/1798] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:13:40 2022] POST /identity/v3/users => generated 291 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:13:40.985301 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a9caaf-e9e1-4afe-8412-97b6e2100113 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:41.004489 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a9caaf-e9e1-4afe-8412-97b6e2100113 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:41.009240 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ce70a4-908d-4fea-989a-b2d5fb6c0311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:41.009976 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ce70a4-908d-4fea-989a-b2d5fb6c0311 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:41.010276 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ce70a4-908d-4fea-989a-b2d5fb6c0311 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:41.010676 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ce70a4-908d-4fea-989a-b2d5fb6c0311 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:41.011246 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ce70a4-908d-4fea-989a-b2d5fb6c0311 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:41.012842 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ce70a4-908d-4fea-989a-b2d5fb6c0311 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:41.027691 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-f52b084b-c721-4bd1-a9eb-a28b43e0ab36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c62a56af2f634cf49e7556c47b3215a6', 'request_id': 'req-f52b084b-c721-4bd1-a9eb-a28b43e0ab36'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:41.036376 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 909/1799] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:13:40 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:13:41.037751 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ce70a4-908d-4fea-989a-b2d5fb6c0311 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:41.049993 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ce70a4-908d-4fea-989a-b2d5fb6c0311 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:41.054328 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-f52b084b-c721-4bd1-a9eb-a28b43e0ab36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c62a56af2f634cf49e7556c47b3215a6', 'request_id': 'req-f52b084b-c721-4bd1-a9eb-a28b43e0ab36'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:41.075981 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-f52b084b-c721-4bd1-a9eb-a28b43e0ab36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c62a56af2f634cf49e7556c47b3215a6', 'request_id': 'req-f52b084b-c721-4bd1-a9eb-a28b43e0ab36'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:41.107915 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-f52b084b-c721-4bd1-a9eb-a28b43e0ab36 admin admin] The token cache is being invalidate because project c62a56af2f634cf49e7556c47b3215a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:13:41.108836 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-f52b084b-c721-4bd1-a9eb-a28b43e0ab36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:41.109577 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-f52b084b-c721-4bd1-a9eb-a28b43e0ab36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:41.114310 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 891/1800] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:13:40 2022] DELETE /identity/v3/projects/c62a56af2f634cf49e7556c47b3215a6 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:13:41.116184 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52b084b-c721-4bd1-a9eb-a28b43e0ab36 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:41.117485 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-f52b084b-c721-4bd1-a9eb-a28b43e0ab36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:41.138614 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a820e39-ddd9-43cd-9f83-3e07f8f93842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:41.139318 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a820e39-ddd9-43cd-9f83-3e07f8f93842 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:41.139602 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a820e39-ddd9-43cd-9f83-3e07f8f93842 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:41.139919 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a820e39-ddd9-43cd-9f83-3e07f8f93842 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:41.140594 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a820e39-ddd9-43cd-9f83-3e07f8f93842 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:41.142452 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a820e39-ddd9-43cd-9f83-3e07f8f93842 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:41.166392 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 910/1801] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:13:41 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:13:41.167302 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a820e39-ddd9-43cd-9f83-3e07f8f93842 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:41.174527 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-2a820e39-ddd9-43cd-9f83-3e07f8f93842 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:41.212705 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52b084b-c721-4bd1-a9eb-a28b43e0ab36 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:41.218675 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a820e39-ddd9-43cd-9f83-3e07f8f93842 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:41.229339 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c23186-e8e1-4dfa-9fcb-e2f56a867ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:41.229813 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26d072a-76e4-4efe-885c-c3afa1267dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:41.230224 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c23186-e8e1-4dfa-9fcb-e2f56a867ccb admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:41.230506 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c23186-e8e1-4dfa-9fcb-e2f56a867ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:41.230780 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c23186-e8e1-4dfa-9fcb-e2f56a867ccb admin admin] PATH_INFO: `/v3/projects/32b46be372824ec49b0ef96868e02437/users/f35d04ec736e4ebe99685b340f399b96/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:41.231532 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26d072a-76e4-4efe-885c-c3afa1267dc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:41.231890 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26d072a-76e4-4efe-885c-c3afa1267dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:41.232169 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26d072a-76e4-4efe-885c-c3afa1267dc9 admin admin] PATH_INFO: `/v3/users/473e7990d0a64022853d3a21780b8977` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:41.235113 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26d072a-76e4-4efe-885c-c3afa1267dc9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=473e7990d0a64022853d3a21780b8977)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:41.236451 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c23186-e8e1-4dfa-9fcb-e2f56a867ccb admin admin] RBAC: Authorizing `identity:create_grant(project_id=32b46be372824ec49b0ef96868e02437, user_id=f35d04ec736e4ebe99685b340f399b96, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:41.238051 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26d072a-76e4-4efe-885c-c3afa1267dc9 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:41.239224 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c23186-e8e1-4dfa-9fcb-e2f56a867ccb admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:41.265950 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 911/1802] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:13:41 2022] PUT /identity/v3/projects/32b46be372824ec49b0ef96868e02437/users/f35d04ec736e4ebe99685b340f399b96/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:13:41.275712 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c23186-e8e1-4dfa-9fcb-e2f56a867ccb admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:41.283328 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-60c23186-e8e1-4dfa-9fcb-e2f56a867ccb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:41.362068 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-a26d072a-76e4-4efe-885c-c3afa1267dc9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '473e7990d0a64022853d3a21780b8977'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:41.373291 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-a26d072a-76e4-4efe-885c-c3afa1267dc9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '473e7990d0a64022853d3a21780b8977'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:41.374397 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-a26d072a-76e4-4efe-885c-c3afa1267dc9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '473e7990d0a64022853d3a21780b8977'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:41.382032 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c23186-e8e1-4dfa-9fcb-e2f56a867ccb admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:41.385981 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-a26d072a-76e4-4efe-885c-c3afa1267dc9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '473e7990d0a64022853d3a21780b8977'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:41.387525 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaba0801-469e-4b31-a05a-b9d3d4a834de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:41.388563 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaba0801-469e-4b31-a05a-b9d3d4a834de admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:41.388791 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaba0801-469e-4b31-a05a-b9d3d4a834de admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:41.389063 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaba0801-469e-4b31-a05a-b9d3d4a834de admin admin] PATH_INFO: `/v3/users/2f243774c8494e10b8b1690f2da39b82` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:41.390548 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaba0801-469e-4b31-a05a-b9d3d4a834de admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f243774c8494e10b8b1690f2da39b82)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:41.393906 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaba0801-469e-4b31-a05a-b9d3d4a834de admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:41.403674 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-a26d072a-76e4-4efe-885c-c3afa1267dc9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '473e7990d0a64022853d3a21780b8977'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:41.412427 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 892/1803] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:13:41 2022] DELETE /identity/v3/users/473e7990d0a64022853d3a21780b8977 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:13:41.414590 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26d072a-76e4-4efe-885c-c3afa1267dc9 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:41.416412 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-a26d072a-76e4-4efe-885c-c3afa1267dc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:41.434763 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:13:41.442086 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:13:41.460401 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-aaba0801-469e-4b31-a05a-b9d3d4a834de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f243774c8494e10b8b1690f2da39b82'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:41.461316 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-aaba0801-469e-4b31-a05a-b9d3d4a834de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f243774c8494e10b8b1690f2da39b82'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:41.470482 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-aaba0801-469e-4b31-a05a-b9d3d4a834de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f243774c8494e10b8b1690f2da39b82'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:41.480113 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-aaba0801-469e-4b31-a05a-b9d3d4a834de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f243774c8494e10b8b1690f2da39b82'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:41.496334 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-aaba0801-469e-4b31-a05a-b9d3d4a834de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f243774c8494e10b8b1690f2da39b82'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:41.508331 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 912/1804] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:13:41 2022] DELETE /identity/v3/users/2f243774c8494e10b8b1690f2da39b82 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:13:41.508705 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26d072a-76e4-4efe-885c-c3afa1267dc9 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:41.510166 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5339a1ff-de8d-4333-aa59-198b3d207435 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:41.510580 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5339a1ff-de8d-4333-aa59-198b3d207435 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:41.510857 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5339a1ff-de8d-4333-aa59-198b3d207435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:41.565294 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-5339a1ff-de8d-4333-aa59-198b3d207435 None None] MFA Rules not processed for user `f35d04ec736e4ebe99685b340f399b96`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:13:41.570533 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-5339a1ff-de8d-4333-aa59-198b3d207435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:41.596186 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee1c636-39f8-4820-8991-25e57ddf9262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:41.596186 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee1c636-39f8-4820-8991-25e57ddf9262 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:41.596186 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee1c636-39f8-4820-8991-25e57ddf9262 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:41.596186 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee1c636-39f8-4820-8991-25e57ddf9262 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:41.596628 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee1c636-39f8-4820-8991-25e57ddf9262 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:41.597211 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee1c636-39f8-4820-8991-25e57ddf9262 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:41.620412 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 893/1805] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:13:41 2022] GET /identity/v3/roles => generated 1420 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:13:41.621750 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9053fb-547b-43ae-8215-2b17e8f30143 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:41.622054 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9053fb-547b-43ae-8215-2b17e8f30143 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:41.622574 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9053fb-547b-43ae-8215-2b17e8f30143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:41.647159 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-ea9053fb-547b-43ae-8215-2b17e8f30143 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:13:41.647159 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-ea9053fb-547b-43ae-8215-2b17e8f30143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:41.658240 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 894/1806] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:13:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:13:41.661053 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9053fb-547b-43ae-8215-2b17e8f30143 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:41.665188 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-ea9053fb-547b-43ae-8215-2b17e8f30143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:41.685702 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9053fb-547b-43ae-8215-2b17e8f30143 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:41.700231 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5962f4c1-adc1-45d0-a937-af595c1444c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:41.701688 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5962f4c1-adc1-45d0-a937-af595c1444c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:41.703760 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5962f4c1-adc1-45d0-a937-af595c1444c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:41.704102 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5962f4c1-adc1-45d0-a937-af595c1444c3 admin admin] PATH_INFO: `/v3/projects/f37329418a5e4ba68962530ffba591d0/users/a2c3785784f04de7aeb30d0623dd791d/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:41.705054 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 913/1807] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:13:41 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:13:41.706178 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5339a1ff-de8d-4333-aa59-198b3d207435 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:41.709154 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-5339a1ff-de8d-4333-aa59-198b3d207435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:41.748428 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5962f4c1-adc1-45d0-a937-af595c1444c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f37329418a5e4ba68962530ffba591d0, user_id=a2c3785784f04de7aeb30d0623dd791d, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:41.754210 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5962f4c1-adc1-45d0-a937-af595c1444c3 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:41.788507 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 895/1808] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:13:41 2022] PUT /identity/v3/projects/f37329418a5e4ba68962530ffba591d0/users/a2c3785784f04de7aeb30d0623dd791d/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:13:41.788507 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5962f4c1-adc1-45d0-a937-af595c1444c3 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:41.788507 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-5962f4c1-adc1-45d0-a937-af595c1444c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:41.832930 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5339a1ff-de8d-4333-aa59-198b3d207435 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:41.914177 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5962f4c1-adc1-45d0-a937-af595c1444c3 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:41.918124 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f93b1f-c78f-4310-b03e-3a711864a6e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:41.918812 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f93b1f-c78f-4310-b03e-3a711864a6e9 service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:41.919102 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f93b1f-c78f-4310-b03e-3a711864a6e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:41.919383 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f93b1f-c78f-4310-b03e-3a711864a6e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:41.920284 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedcdc85-e702-4e01-ba0e-cd01e35fed17 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:41.921143 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedcdc85-e702-4e01-ba0e-cd01e35fed17 service nova] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:41.921574 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedcdc85-e702-4e01-ba0e-cd01e35fed17 service nova] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:41.921961 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedcdc85-e702-4e01-ba0e-cd01e35fed17 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:41.924489 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:13:41.953899 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:13:42.031353 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedcdc85-e702-4e01-ba0e-cd01e35fed17 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:42.033296 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedcdc85-e702-4e01-ba0e-cd01e35fed17 service nova] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:42.049637 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f93b1f-c78f-4310-b03e-3a711864a6e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:42.051162 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 896/1809] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:13:41 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:13:42.051701 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f93b1f-c78f-4310-b03e-3a711864a6e9 service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:42.052497 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7828eee-a89a-498d-86a5-af0afd70bbd1 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:42.052780 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7828eee-a89a-498d-86a5-af0afd70bbd1 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:42.053053 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7828eee-a89a-498d-86a5-af0afd70bbd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:42.068046 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 914/1810] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:13:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:13:42.069346 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f93b1f-c78f-4310-b03e-3a711864a6e9 service neutron] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:42.071310 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-b6f93b1f-c78f-4310-b03e-3a711864a6e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:42.086551 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-b7828eee-a89a-498d-86a5-af0afd70bbd1 None None] MFA Rules not processed for user `a2c3785784f04de7aeb30d0623dd791d`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:13:42.088068 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-b7828eee-a89a-498d-86a5-af0afd70bbd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:42.092495 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f93b1f-c78f-4310-b03e-3a711864a6e9 service neutron] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:42.104423 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c592fb03-4233-4f92-b1c5-219b6e2974b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:42.105329 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c592fb03-4233-4f92-b1c5-219b6e2974b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:42.105610 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c592fb03-4233-4f92-b1c5-219b6e2974b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:42.105924 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c592fb03-4233-4f92-b1c5-219b6e2974b2 admin admin] PATH_INFO: `/v3/projects/769afe32bc5d48dd9e24186168aaa3e1` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:42.107494 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c592fb03-4233-4f92-b1c5-219b6e2974b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=769afe32bc5d48dd9e24186168aaa3e1)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:42.109215 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c592fb03-4233-4f92-b1c5-219b6e2974b2 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:42.193404 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c592fb03-4233-4f92-b1c5-219b6e2974b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '769afe32bc5d48dd9e24186168aaa3e1', 'request_id': 'req-c592fb03-4233-4f92-b1c5-219b6e2974b2'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:42.206292 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c592fb03-4233-4f92-b1c5-219b6e2974b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '769afe32bc5d48dd9e24186168aaa3e1', 'request_id': 'req-c592fb03-4233-4f92-b1c5-219b6e2974b2'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:42.218559 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 897/1811] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:13:42 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:13:42.221514 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7828eee-a89a-498d-86a5-af0afd70bbd1 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:42.234682 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c592fb03-4233-4f92-b1c5-219b6e2974b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '769afe32bc5d48dd9e24186168aaa3e1', 'request_id': 'req-c592fb03-4233-4f92-b1c5-219b6e2974b2'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:42.267019 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c592fb03-4233-4f92-b1c5-219b6e2974b2 admin admin] The token cache is being invalidate because project 769afe32bc5d48dd9e24186168aaa3e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:13:42.267195 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c592fb03-4233-4f92-b1c5-219b6e2974b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:42.268868 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c592fb03-4233-4f92-b1c5-219b6e2974b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:42.277359 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 915/1812] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:13:42 2022] DELETE /identity/v3/projects/769afe32bc5d48dd9e24186168aaa3e1 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:13:42.277983 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7828eee-a89a-498d-86a5-af0afd70bbd1 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:42.278860 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c592fb03-4233-4f92-b1c5-219b6e2974b2 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:42.280506 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-c592fb03-4233-4f92-b1c5-219b6e2974b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:42.426814 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44121807-8e45-4fa1-a123-42394b86c66b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:42.427583 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44121807-8e45-4fa1-a123-42394b86c66b service nova] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:42.427926 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44121807-8e45-4fa1-a123-42394b86c66b service nova] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:42.428297 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44121807-8e45-4fa1-a123-42394b86c66b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:42.431212 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c592fb03-4233-4f92-b1c5-219b6e2974b2 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:42.431622 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-44121807-8e45-4fa1-a123-42394b86c66b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:42.436771 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5b9260-566d-4d60-b57c-b50155824ff2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:42.437560 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5b9260-566d-4d60-b57c-b50155824ff2 service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:42.438040 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5b9260-566d-4d60-b57c-b50155824ff2 service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:42.438503 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5b9260-566d-4d60-b57c-b50155824ff2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:42.441107 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-2f5b9260-566d-4d60-b57c-b50155824ff2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:42.517550 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:13:42.541841 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:13:42.546559 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44121807-8e45-4fa1-a123-42394b86c66b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:42.548911 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44121807-8e45-4fa1-a123-42394b86c66b service nova] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:42.567759 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 898/1813] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:13:42 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:13:42.568961 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44121807-8e45-4fa1-a123-42394b86c66b service nova] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:42.571238 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-44121807-8e45-4fa1-a123-42394b86c66b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:42.586135 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5b9260-566d-4d60-b57c-b50155824ff2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:42.588791 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5b9260-566d-4d60-b57c-b50155824ff2 service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:42.626132 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 916/1814] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:13:42 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:13:42.642430 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5b9260-566d-4d60-b57c-b50155824ff2 service neutron] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:42.648035 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-2f5b9260-566d-4d60-b57c-b50155824ff2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:42.698641 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44121807-8e45-4fa1-a123-42394b86c66b service nova] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:42.705331 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23f7b31-2a98-4e25-82d8-24d1c137f2b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:42.719153 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23f7b31-2a98-4e25-82d8-24d1c137f2b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:42.719444 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23f7b31-2a98-4e25-82d8-24d1c137f2b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:42.719872 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23f7b31-2a98-4e25-82d8-24d1c137f2b6 admin admin] PATH_INFO: `/v3/users/1a276712950c4e8187552af2c6bfd221` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:42.722034 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23f7b31-2a98-4e25-82d8-24d1c137f2b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a276712950c4e8187552af2c6bfd221)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:42.723966 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23f7b31-2a98-4e25-82d8-24d1c137f2b6 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:42.747026 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5b9260-566d-4d60-b57c-b50155824ff2 service neutron] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:42.760773 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e910ec60-c12e-4118-9a61-7d72d166fc90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:42.761721 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e910ec60-c12e-4118-9a61-7d72d166fc90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:42.762171 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e910ec60-c12e-4118-9a61-7d72d166fc90 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:42.762313 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e910ec60-c12e-4118-9a61-7d72d166fc90 admin admin] PATH_INFO: `/v3/users/f6cda6d061484b8aba7fc3ace8a49533` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:42.763638 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e910ec60-c12e-4118-9a61-7d72d166fc90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6cda6d061484b8aba7fc3ace8a49533)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:42.765612 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e910ec60-c12e-4118-9a61-7d72d166fc90 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:42.845039 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-f23f7b31-2a98-4e25-82d8-24d1c137f2b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a276712950c4e8187552af2c6bfd221'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:42.859917 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-f23f7b31-2a98-4e25-82d8-24d1c137f2b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a276712950c4e8187552af2c6bfd221'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:42.859917 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-f23f7b31-2a98-4e25-82d8-24d1c137f2b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a276712950c4e8187552af2c6bfd221'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:42.881776 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-f23f7b31-2a98-4e25-82d8-24d1c137f2b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a276712950c4e8187552af2c6bfd221'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:42.898542 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-e910ec60-c12e-4118-9a61-7d72d166fc90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6cda6d061484b8aba7fc3ace8a49533'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:42.899012 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-f23f7b31-2a98-4e25-82d8-24d1c137f2b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a276712950c4e8187552af2c6bfd221'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:42.899925 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-e910ec60-c12e-4118-9a61-7d72d166fc90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6cda6d061484b8aba7fc3ace8a49533'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:42.926818 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 899/1815] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:13:42 2022] DELETE /identity/v3/users/1a276712950c4e8187552af2c6bfd221 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:13:42.926818 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23f7b31-2a98-4e25-82d8-24d1c137f2b6 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:42.926818 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-f23f7b31-2a98-4e25-82d8-24d1c137f2b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:42.947027 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-e910ec60-c12e-4118-9a61-7d72d166fc90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6cda6d061484b8aba7fc3ace8a49533'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:42.967990 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-e910ec60-c12e-4118-9a61-7d72d166fc90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6cda6d061484b8aba7fc3ace8a49533'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:43.000630 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-e910ec60-c12e-4118-9a61-7d72d166fc90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6cda6d061484b8aba7fc3ace8a49533'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:43.005984 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23f7b31-2a98-4e25-82d8-24d1c137f2b6 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:43.011782 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f399f48-b1a8-45ed-9471-08d95803d89a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:43.012675 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f399f48-b1a8-45ed-9471-08d95803d89a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:43.012969 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f399f48-b1a8-45ed-9471-08d95803d89a admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:43.013222 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f399f48-b1a8-45ed-9471-08d95803d89a admin admin] PATH_INFO: `/v3/projects/28f9d89c76024813b64fece7237df9cc` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:43.017193 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 917/1816] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:13:42 2022] DELETE /identity/v3/users/f6cda6d061484b8aba7fc3ace8a49533 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:13:43.017354 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f399f48-b1a8-45ed-9471-08d95803d89a admin admin] RBAC: Authorizing `identity:delete_project(project_id=28f9d89c76024813b64fece7237df9cc)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:43.017507 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e910ec60-c12e-4118-9a61-7d72d166fc90 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:43.017507 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-e910ec60-c12e-4118-9a61-7d72d166fc90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:43.017702 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f399f48-b1a8-45ed-9471-08d95803d89a admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:43.027995 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:13:43.104058 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-3f399f48-b1a8-45ed-9471-08d95803d89a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28f9d89c76024813b64fece7237df9cc', 'request_id': 'req-3f399f48-b1a8-45ed-9471-08d95803d89a'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:43.114468 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-3f399f48-b1a8-45ed-9471-08d95803d89a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28f9d89c76024813b64fece7237df9cc', 'request_id': 'req-3f399f48-b1a8-45ed-9471-08d95803d89a'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:43.122955 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-3f399f48-b1a8-45ed-9471-08d95803d89a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28f9d89c76024813b64fece7237df9cc', 'request_id': 'req-3f399f48-b1a8-45ed-9471-08d95803d89a'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:43.140921 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:13:43.141687 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-3f399f48-b1a8-45ed-9471-08d95803d89a admin admin] The token cache is being invalidate because project 28f9d89c76024813b64fece7237df9cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:13:43.142139 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-3f399f48-b1a8-45ed-9471-08d95803d89a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:43.142958 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-3f399f48-b1a8-45ed-9471-08d95803d89a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:43.146288 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 900/1817] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:13:42 2022] DELETE /identity/v3/projects/28f9d89c76024813b64fece7237df9cc => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:13:43.147038 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e910ec60-c12e-4118-9a61-7d72d166fc90 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:43.147774 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ec13e1-5d2e-4889-afec-79486c9c6837 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:43.148113 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ec13e1-5d2e-4889-afec-79486c9c6837 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:43.148440 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ec13e1-5d2e-4889-afec-79486c9c6837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:43.184866 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-01ec13e1-5d2e-4889-afec-79486c9c6837 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:13:43.186739 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-01ec13e1-5d2e-4889-afec-79486c9c6837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:43.240154 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4556fbc6-e835-472d-a37c-d458dad888da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:43.241070 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4556fbc6-e835-472d-a37c-d458dad888da admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:43.241529 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4556fbc6-e835-472d-a37c-d458dad888da admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:43.241844 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4556fbc6-e835-472d-a37c-d458dad888da admin admin] PATH_INFO: `/v3/users/a2c3785784f04de7aeb30d0623dd791d` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:43.243595 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4556fbc6-e835-472d-a37c-d458dad888da admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2c3785784f04de7aeb30d0623dd791d)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:43.245077 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4556fbc6-e835-472d-a37c-d458dad888da admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:43.272919 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 901/1818] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:13:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:13:43.274853 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ec13e1-5d2e-4889-afec-79486c9c6837 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:43.276927 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-01ec13e1-5d2e-4889-afec-79486c9c6837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:43.301051 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ec13e1-5d2e-4889-afec-79486c9c6837 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:43.311659 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec9faad-dd9c-43e5-94e6-12b1483b4af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:43.314191 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec9faad-dd9c-43e5-94e6-12b1483b4af8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:43.314734 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec9faad-dd9c-43e5-94e6-12b1483b4af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:43.315219 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec9faad-dd9c-43e5-94e6-12b1483b4af8 admin admin] PATH_INFO: `/v3/users/12a3cf4db2204c69b75a1640b17ee36e` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:43.317043 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec9faad-dd9c-43e5-94e6-12b1483b4af8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12a3cf4db2204c69b75a1640b17ee36e)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:43.319772 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec9faad-dd9c-43e5-94e6-12b1483b4af8 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:43.353939 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-4556fbc6-e835-472d-a37c-d458dad888da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2c3785784f04de7aeb30d0623dd791d'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:43.355159 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-4556fbc6-e835-472d-a37c-d458dad888da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2c3785784f04de7aeb30d0623dd791d'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:43.377178 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-4556fbc6-e835-472d-a37c-d458dad888da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2c3785784f04de7aeb30d0623dd791d'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:43.392436 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-4556fbc6-e835-472d-a37c-d458dad888da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2c3785784f04de7aeb30d0623dd791d'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:43.405598 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-8ec9faad-dd9c-43e5-94e6-12b1483b4af8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12a3cf4db2204c69b75a1640b17ee36e'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:43.414245 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-8ec9faad-dd9c-43e5-94e6-12b1483b4af8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12a3cf4db2204c69b75a1640b17ee36e'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:43.415149 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-8ec9faad-dd9c-43e5-94e6-12b1483b4af8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12a3cf4db2204c69b75a1640b17ee36e'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:43.415545 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-4556fbc6-e835-472d-a37c-d458dad888da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2c3785784f04de7aeb30d0623dd791d'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:43.422901 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 918/1819] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:13:43 2022] DELETE /identity/v3/users/a2c3785784f04de7aeb30d0623dd791d => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:13:43.424078 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4556fbc6-e835-472d-a37c-d458dad888da admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:43.427260 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-4556fbc6-e835-472d-a37c-d458dad888da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:43.428323 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-8ec9faad-dd9c-43e5-94e6-12b1483b4af8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12a3cf4db2204c69b75a1640b17ee36e'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:43.444162 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-8ec9faad-dd9c-43e5-94e6-12b1483b4af8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12a3cf4db2204c69b75a1640b17ee36e'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:43.453028 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 902/1820] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:13:43 2022] DELETE /identity/v3/users/12a3cf4db2204c69b75a1640b17ee36e => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:13:43.453853 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec9faad-dd9c-43e5-94e6-12b1483b4af8 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:43.455349 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-8ec9faad-dd9c-43e5-94e6-12b1483b4af8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:43.466870 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:13:43.509083 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4556fbc6-e835-472d-a37c-d458dad888da admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:43.564152 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec9faad-dd9c-43e5-94e6-12b1483b4af8 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:43.565139 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:13:43.573128 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e6f161-a474-4a7f-9721-4e7b7b3859fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:43.574110 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e6f161-a474-4a7f-9721-4e7b7b3859fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:43.574536 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e6f161-a474-4a7f-9721-4e7b7b3859fe admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:43.574814 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e6f161-a474-4a7f-9721-4e7b7b3859fe admin admin] PATH_INFO: `/v3/projects/aefbf9ae46e34052b41a581194a5ebfb` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:43.576163 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e6f161-a474-4a7f-9721-4e7b7b3859fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=aefbf9ae46e34052b41a581194a5ebfb)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:43.578788 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e6f161-a474-4a7f-9721-4e7b7b3859fe admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:43.583259 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a73f14-2186-4b6b-8415-fe1ed651ec26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:43.584080 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a73f14-2186-4b6b-8415-fe1ed651ec26 service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:43.584289 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a73f14-2186-4b6b-8415-fe1ed651ec26 service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:43.584560 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a73f14-2186-4b6b-8415-fe1ed651ec26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:43.586408 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-62a73f14-2186-4b6b-8415-fe1ed651ec26 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:43.605730 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a73f14-2186-4b6b-8415-fe1ed651ec26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:43.608109 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a73f14-2186-4b6b-8415-fe1ed651ec26 service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:43.623959 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 919/1821] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:13:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:13:43.626229 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d15d60-52eb-4403-83b8-4f75831a6df1 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:43.626525 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d15d60-52eb-4403-83b8-4f75831a6df1 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:43.626860 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d15d60-52eb-4403-83b8-4f75831a6df1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:43.649103 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-68d15d60-52eb-4403-83b8-4f75831a6df1 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:13:43.651658 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-68d15d60-52eb-4403-83b8-4f75831a6df1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:43.663744 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-14e6f161-a474-4a7f-9721-4e7b7b3859fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aefbf9ae46e34052b41a581194a5ebfb', 'request_id': 'req-14e6f161-a474-4a7f-9721-4e7b7b3859fe'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:43.675547 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-14e6f161-a474-4a7f-9721-4e7b7b3859fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aefbf9ae46e34052b41a581194a5ebfb', 'request_id': 'req-14e6f161-a474-4a7f-9721-4e7b7b3859fe'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:43.687781 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-14e6f161-a474-4a7f-9721-4e7b7b3859fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aefbf9ae46e34052b41a581194a5ebfb', 'request_id': 'req-14e6f161-a474-4a7f-9721-4e7b7b3859fe'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:43.704727 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-14e6f161-a474-4a7f-9721-4e7b7b3859fe admin admin] The token cache is being invalidate because project aefbf9ae46e34052b41a581194a5ebfb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:13:43.705224 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-14e6f161-a474-4a7f-9721-4e7b7b3859fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:43.706065 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-14e6f161-a474-4a7f-9721-4e7b7b3859fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:43.712952 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 903/1822] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:13:43 2022] DELETE /identity/v3/projects/aefbf9ae46e34052b41a581194a5ebfb => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:13:43.714864 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015483f6-953d-4352-81b5-64771557e763 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:43.715200 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015483f6-953d-4352-81b5-64771557e763 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:43.715482 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015483f6-953d-4352-81b5-64771557e763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:43.753517 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 920/1823] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:13:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:13:43.758727 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-015483f6-953d-4352-81b5-64771557e763 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:13:43.760730 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-015483f6-953d-4352-81b5-64771557e763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:43.767649 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d15d60-52eb-4403-83b8-4f75831a6df1 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:43.769093 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-68d15d60-52eb-4403-83b8-4f75831a6df1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:43.773749 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 904/1824] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:13:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:13:43.781491 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261e2e5e-9638-4150-b643-b7d6f466b7ff None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:43.781802 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261e2e5e-9638-4150-b643-b7d6f466b7ff None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:43.782196 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261e2e5e-9638-4150-b643-b7d6f466b7ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:43.855024 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-261e2e5e-9638-4150-b643-b7d6f466b7ff None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:13:43.856610 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-261e2e5e-9638-4150-b643-b7d6f466b7ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:43.870579 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 905/1825] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:13:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:13:43.875002 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261e2e5e-9638-4150-b643-b7d6f466b7ff None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:43.886071 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261e2e5e-9638-4150-b643-b7d6f466b7ff None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:43.887733 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d15d60-52eb-4403-83b8-4f75831a6df1 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:43.891215 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9c7d9b-ea90-4791-8336-c49998c059ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:43.891628 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a649dacd-ae0a-4aa4-aa1e-aafa423166a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:43.892175 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9c7d9b-ea90-4791-8336-c49998c059ef admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:43.892297 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a649dacd-ae0a-4aa4-aa1e-aafa423166a4 service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:43.892566 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a649dacd-ae0a-4aa4-aa1e-aafa423166a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:43.892878 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a649dacd-ae0a-4aa4-aa1e-aafa423166a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:43.893041 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9c7d9b-ea90-4791-8336-c49998c059ef admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:43.893410 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9c7d9b-ea90-4791-8336-c49998c059ef admin admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:43.894274 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9c7d9b-ea90-4791-8336-c49998c059ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:13:43.894644 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9c7d9b-ea90-4791-8336-c49998c059ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:43.896338 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9c7d9b-ea90-4791-8336-c49998c059ef admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:43.904982 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a649dacd-ae0a-4aa4-aa1e-aafa423166a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:43.907608 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a649dacd-ae0a-4aa4-aa1e-aafa423166a4 service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:43.915833 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 906/1826] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:13:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:13:43.916999 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9c7d9b-ea90-4791-8336-c49998c059ef admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:43.926424 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 921/1827] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:13:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 23 21:13:43.930759 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9c7d9b-ea90-4791-8336-c49998c059ef admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:43.936488 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7098b4-65ba-4c90-a49f-928a9c0a0152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:43.937264 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7098b4-65ba-4c90-a49f-928a9c0a0152 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:43.937581 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7098b4-65ba-4c90-a49f-928a9c0a0152 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:43.937909 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7098b4-65ba-4c90-a49f-928a9c0a0152 admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:43.938699 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7098b4-65ba-4c90-a49f-928a9c0a0152 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:43.940723 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7098b4-65ba-4c90-a49f-928a9c0a0152 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:43.980319 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 907/1828] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:13:43 2022] POST /identity/v3/projects => generated 387 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:13:43.985225 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a649dacd-ae0a-4aa4-aa1e-aafa423166a4 service neutron] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:43.999160 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7098b4-65ba-4c90-a49f-928a9c0a0152 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:43.999880 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a649dacd-ae0a-4aa4-aa1e-aafa423166a4 service neutron] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:44.003458 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-5f7098b4-65ba-4c90-a49f-928a9c0a0152 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:44.064215 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:13:44.074963 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15f55e1-1814-4a58-bb0a-425104540091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:44.076221 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15f55e1-1814-4a58-bb0a-425104540091 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:44.076696 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15f55e1-1814-4a58-bb0a-425104540091 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:44.077037 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15f55e1-1814-4a58-bb0a-425104540091 admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:44.078652 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15f55e1-1814-4a58-bb0a-425104540091 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:44.081004 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15f55e1-1814-4a58-bb0a-425104540091 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:44.081843 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7098b4-65ba-4c90-a49f-928a9c0a0152 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:44.087653 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9deced-f293-4ccc-aa72-7d5d10175664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:44.088590 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9deced-f293-4ccc-aa72-7d5d10175664 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:44.088868 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9deced-f293-4ccc-aa72-7d5d10175664 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:44.089136 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9deced-f293-4ccc-aa72-7d5d10175664 admin admin] PATH_INFO: `/v3/projects/915bc70310864741842ac671ead5fd4a` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:44.090482 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9deced-f293-4ccc-aa72-7d5d10175664 admin admin] RBAC: Authorizing `identity:delete_project(project_id=915bc70310864741842ac671ead5fd4a)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:44.092600 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9deced-f293-4ccc-aa72-7d5d10175664 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:44.110857 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 922/1829] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:13:43 2022] POST /identity/v3/users => generated 294 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:13:44.114875 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15f55e1-1814-4a58-bb0a-425104540091 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:44.131060 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15f55e1-1814-4a58-bb0a-425104540091 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:44.138392 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da6d966-7ba7-4358-89a8-33c28c978604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:44.139633 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da6d966-7ba7-4358-89a8-33c28c978604 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:44.140065 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da6d966-7ba7-4358-89a8-33c28c978604 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:44.140463 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da6d966-7ba7-4358-89a8-33c28c978604 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:44.141203 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da6d966-7ba7-4358-89a8-33c28c978604 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:44.143212 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da6d966-7ba7-4358-89a8-33c28c978604 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:44.155972 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 923/1830] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:13:44 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:13:44.159883 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da6d966-7ba7-4358-89a8-33c28c978604 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:44.161815 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-8da6d966-7ba7-4358-89a8-33c28c978604 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:44.163016 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-8e9deced-f293-4ccc-aa72-7d5d10175664 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '915bc70310864741842ac671ead5fd4a', 'request_id': 'req-8e9deced-f293-4ccc-aa72-7d5d10175664'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:44.171219 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:13:44.174233 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-8e9deced-f293-4ccc-aa72-7d5d10175664 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '915bc70310864741842ac671ead5fd4a', 'request_id': 'req-8e9deced-f293-4ccc-aa72-7d5d10175664'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:44.176478 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da6d966-7ba7-4358-89a8-33c28c978604 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:44.183898 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-8e9deced-f293-4ccc-aa72-7d5d10175664 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '915bc70310864741842ac671ead5fd4a', 'request_id': 'req-8e9deced-f293-4ccc-aa72-7d5d10175664'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:44.203748 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-8e9deced-f293-4ccc-aa72-7d5d10175664 admin admin] The token cache is being invalidate because project 915bc70310864741842ac671ead5fd4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:13:44.204221 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-8e9deced-f293-4ccc-aa72-7d5d10175664 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:44.204964 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-8e9deced-f293-4ccc-aa72-7d5d10175664 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:44.207603 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 908/1831] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:13:43 2022] DELETE /identity/v3/projects/915bc70310864741842ac671ead5fd4a => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:13:44.209065 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9deced-f293-4ccc-aa72-7d5d10175664 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:44.211290 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-8e9deced-f293-4ccc-aa72-7d5d10175664 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:44.248522 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc1a04b-9dd1-4ed6-92f4-967011ba5284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:44.249426 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc1a04b-9dd1-4ed6-92f4-967011ba5284 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:44.249705 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc1a04b-9dd1-4ed6-92f4-967011ba5284 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:44.250011 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc1a04b-9dd1-4ed6-92f4-967011ba5284 admin admin] PATH_INFO: `/v3/projects/b124e69204e9439f8e6c9bbfa167a4e5` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:44.251741 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc1a04b-9dd1-4ed6-92f4-967011ba5284 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b124e69204e9439f8e6c9bbfa167a4e5)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:44.254453 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc1a04b-9dd1-4ed6-92f4-967011ba5284 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:44.303314 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9deced-f293-4ccc-aa72-7d5d10175664 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:44.315941 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-ebc1a04b-9dd1-4ed6-92f4-967011ba5284 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b124e69204e9439f8e6c9bbfa167a4e5', 'request_id': 'req-ebc1a04b-9dd1-4ed6-92f4-967011ba5284'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:44.350724 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-ebc1a04b-9dd1-4ed6-92f4-967011ba5284 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b124e69204e9439f8e6c9bbfa167a4e5', 'request_id': 'req-ebc1a04b-9dd1-4ed6-92f4-967011ba5284'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:44.362232 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-ebc1a04b-9dd1-4ed6-92f4-967011ba5284 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b124e69204e9439f8e6c9bbfa167a4e5', 'request_id': 'req-ebc1a04b-9dd1-4ed6-92f4-967011ba5284'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:44.385459 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-ebc1a04b-9dd1-4ed6-92f4-967011ba5284 admin admin] The token cache is being invalidate because project b124e69204e9439f8e6c9bbfa167a4e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:13:44.385754 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-ebc1a04b-9dd1-4ed6-92f4-967011ba5284 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:44.386742 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-ebc1a04b-9dd1-4ed6-92f4-967011ba5284 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:44.387277 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7398b20-3f60-43a6-acc8-1d62ca7420a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:44.387985 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7398b20-3f60-43a6-acc8-1d62ca7420a3 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:44.388267 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7398b20-3f60-43a6-acc8-1d62ca7420a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:44.388548 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7398b20-3f60-43a6-acc8-1d62ca7420a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:44.389310 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7398b20-3f60-43a6-acc8-1d62ca7420a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:44.391160 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7398b20-3f60-43a6-acc8-1d62ca7420a3 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:44.392907 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 924/1832] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:13:44 2022] DELETE /identity/v3/projects/b124e69204e9439f8e6c9bbfa167a4e5 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:13:44.393987 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc1a04b-9dd1-4ed6-92f4-967011ba5284 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:44.395902 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-ebc1a04b-9dd1-4ed6-92f4-967011ba5284 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:44.406890 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 909/1833] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:13:44 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:13:44.408553 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec26348-c0fc-4e10-9f65-2e0f89c65f4d None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:44.408898 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec26348-c0fc-4e10-9f65-2e0f89c65f4d None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:44.409121 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec26348-c0fc-4e10-9f65-2e0f89c65f4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:44.413537 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc1a04b-9dd1-4ed6-92f4-967011ba5284 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:44.418821 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79f272d-a62b-4e33-9a33-dc6b68fe13b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:44.419723 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79f272d-a62b-4e33-9a33-dc6b68fe13b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:44.420064 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79f272d-a62b-4e33-9a33-dc6b68fe13b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:44.420333 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79f272d-a62b-4e33-9a33-dc6b68fe13b1 admin admin] PATH_INFO: `/v3/users/f35d04ec736e4ebe99685b340f399b96` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:44.421574 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79f272d-a62b-4e33-9a33-dc6b68fe13b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f35d04ec736e4ebe99685b340f399b96)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:44.431656 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-eec26348-c0fc-4e10-9f65-2e0f89c65f4d None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:13:44.433043 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-eec26348-c0fc-4e10-9f65-2e0f89c65f4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:44.434232 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79f272d-a62b-4e33-9a33-dc6b68fe13b1 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:44.442782 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 910/1834] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:13:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:13:44.443441 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec26348-c0fc-4e10-9f65-2e0f89c65f4d None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:44.444812 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-eec26348-c0fc-4e10-9f65-2e0f89c65f4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:44.458243 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec26348-c0fc-4e10-9f65-2e0f89c65f4d None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:44.463784 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce85ce7-2e11-43b3-b594-c68ad58922ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:44.464726 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce85ce7-2e11-43b3-b594-c68ad58922ce admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:44.465006 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce85ce7-2e11-43b3-b594-c68ad58922ce admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:44.465275 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce85ce7-2e11-43b3-b594-c68ad58922ce admin admin] PATH_INFO: `/v3/projects/dab4a036ceb84c84b34a5aea5b2d9b97/users/97a116b9e9404477860d091fc51c988f/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:44.478607 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:13:44.482792 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce85ce7-2e11-43b3-b594-c68ad58922ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=dab4a036ceb84c84b34a5aea5b2d9b97, user_id=97a116b9e9404477860d091fc51c988f, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:44.486438 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce85ce7-2e11-43b3-b594-c68ad58922ce admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:44.499726 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-e79f272d-a62b-4e33-9a33-dc6b68fe13b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f35d04ec736e4ebe99685b340f399b96'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:44.500793 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-e79f272d-a62b-4e33-9a33-dc6b68fe13b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f35d04ec736e4ebe99685b340f399b96'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:44.504477 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 911/1835] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:13:44 2022] PUT /identity/v3/projects/dab4a036ceb84c84b34a5aea5b2d9b97/users/97a116b9e9404477860d091fc51c988f/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:13:44.505883 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5518feb-1250-4fde-93bf-9d46b0a9589d None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:44.507084 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5518feb-1250-4fde-93bf-9d46b0a9589d None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:44.507369 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5518feb-1250-4fde-93bf-9d46b0a9589d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:44.511464 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-e79f272d-a62b-4e33-9a33-dc6b68fe13b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f35d04ec736e4ebe99685b340f399b96'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:44.523132 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-e79f272d-a62b-4e33-9a33-dc6b68fe13b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f35d04ec736e4ebe99685b340f399b96'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:44.528777 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-e5518feb-1250-4fde-93bf-9d46b0a9589d None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:13:44.530090 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-e5518feb-1250-4fde-93bf-9d46b0a9589d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:44.537521 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-e79f272d-a62b-4e33-9a33-dc6b68fe13b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f35d04ec736e4ebe99685b340f399b96'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:44.545936 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 925/1836] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:13:44 2022] DELETE /identity/v3/users/f35d04ec736e4ebe99685b340f399b96 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:13:44.546989 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79f272d-a62b-4e33-9a33-dc6b68fe13b1 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:44.548747 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-e79f272d-a62b-4e33-9a33-dc6b68fe13b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:44.564569 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:13:44.621206 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 912/1837] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:13:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:13:44.623074 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c2c49a-2717-4ea5-8807-1104968e6c26 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:44.623514 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c2c49a-2717-4ea5-8807-1104968e6c26 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:44.623861 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c2c49a-2717-4ea5-8807-1104968e6c26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:44.652485 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79f272d-a62b-4e33-9a33-dc6b68fe13b1 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:44.658006 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c737e7a7-43da-4088-bb14-250d9f097cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:44.659194 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c737e7a7-43da-4088-bb14-250d9f097cd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:44.659623 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c737e7a7-43da-4088-bb14-250d9f097cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:44.660051 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c737e7a7-43da-4088-bb14-250d9f097cd7 admin admin] PATH_INFO: `/v3/projects/f37329418a5e4ba68962530ffba591d0` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:44.661626 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c737e7a7-43da-4088-bb14-250d9f097cd7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f37329418a5e4ba68962530ffba591d0)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:44.664426 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c737e7a7-43da-4088-bb14-250d9f097cd7 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:44.665213 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-28c2c49a-2717-4ea5-8807-1104968e6c26 None None] MFA Rules not processed for user `97a116b9e9404477860d091fc51c988f`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:13:44.667638 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-28c2c49a-2717-4ea5-8807-1104968e6c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:44.727065 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c737e7a7-43da-4088-bb14-250d9f097cd7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f37329418a5e4ba68962530ffba591d0', 'request_id': 'req-c737e7a7-43da-4088-bb14-250d9f097cd7'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:44.746082 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c737e7a7-43da-4088-bb14-250d9f097cd7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f37329418a5e4ba68962530ffba591d0', 'request_id': 'req-c737e7a7-43da-4088-bb14-250d9f097cd7'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:44.753718 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c737e7a7-43da-4088-bb14-250d9f097cd7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f37329418a5e4ba68962530ffba591d0', 'request_id': 'req-c737e7a7-43da-4088-bb14-250d9f097cd7'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:44.765373 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c737e7a7-43da-4088-bb14-250d9f097cd7 admin admin] The token cache is being invalidate because project f37329418a5e4ba68962530ffba591d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:13:44.765718 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c737e7a7-43da-4088-bb14-250d9f097cd7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:44.766391 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c737e7a7-43da-4088-bb14-250d9f097cd7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:44.768353 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 926/1838] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:13:44 2022] DELETE /identity/v3/projects/f37329418a5e4ba68962530ffba591d0 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:13:44.769262 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c737e7a7-43da-4088-bb14-250d9f097cd7 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:44.770657 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-c737e7a7-43da-4088-bb14-250d9f097cd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:44.779935 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 913/1839] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:13:44 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:13:44.783732 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb68352-8221-47f0-8965-98f8b2d2943a None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:44.783732 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb68352-8221-47f0-8965-98f8b2d2943a None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:44.783732 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb68352-8221-47f0-8965-98f8b2d2943a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:44.802847 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-7bb68352-8221-47f0-8965-98f8b2d2943a None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:13:44.804201 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-7bb68352-8221-47f0-8965-98f8b2d2943a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:44.855631 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c737e7a7-43da-4088-bb14-250d9f097cd7 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:44.861080 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25f51db-bdc8-4270-b455-9c1c791a1da9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:44.861854 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25f51db-bdc8-4270-b455-9c1c791a1da9 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:44.862071 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25f51db-bdc8-4270-b455-9c1c791a1da9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:44.862435 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25f51db-bdc8-4270-b455-9c1c791a1da9 admin admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:44.863217 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25f51db-bdc8-4270-b455-9c1c791a1da9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:13:44.863411 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25f51db-bdc8-4270-b455-9c1c791a1da9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:44.865121 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25f51db-bdc8-4270-b455-9c1c791a1da9 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:44.878394 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 927/1840] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:13:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:13:44.879204 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25f51db-bdc8-4270-b455-9c1c791a1da9 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:44.881799 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-b25f51db-bdc8-4270-b455-9c1c791a1da9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:44.896376 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25f51db-bdc8-4270-b455-9c1c791a1da9 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:44.901519 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f161a20-72eb-48c5-901b-5639c0eae5a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:44.902225 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f161a20-72eb-48c5-901b-5639c0eae5a9 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:44.902508 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f161a20-72eb-48c5-901b-5639c0eae5a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:44.902775 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f161a20-72eb-48c5-901b-5639c0eae5a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:44.903469 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f161a20-72eb-48c5-901b-5639c0eae5a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:44.909997 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f161a20-72eb-48c5-901b-5639c0eae5a9 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:44.910836 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 914/1841] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:13:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:13:44.911785 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb68352-8221-47f0-8965-98f8b2d2943a None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:44.925931 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb68352-8221-47f0-8965-98f8b2d2943a None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:44.934750 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981d2db4-8069-48a3-aeb0-340521bd6883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:44.935522 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981d2db4-8069-48a3-aeb0-340521bd6883 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:44.935808 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981d2db4-8069-48a3-aeb0-340521bd6883 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:44.936099 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981d2db4-8069-48a3-aeb0-340521bd6883 admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:44.936867 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981d2db4-8069-48a3-aeb0-340521bd6883 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:44.939227 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981d2db4-8069-48a3-aeb0-340521bd6883 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:44.947946 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 928/1842] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:13:44 2022] POST /identity/v3/projects => generated 387 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:13:44.947946 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ff1d16-f030-43b9-a5a6-226186495e20 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:44.947946 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ff1d16-f030-43b9-a5a6-226186495e20 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:44.947946 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ff1d16-f030-43b9-a5a6-226186495e20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:44.965693 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:13:44.969802 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-24ff1d16-f030-43b9-a5a6-226186495e20 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:13:44.971461 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-24ff1d16-f030-43b9-a5a6-226186495e20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:44.976517 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:13:44.979154 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 915/1843] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:13:44 2022] POST /identity/v3/projects => generated 409 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:13:44.980310 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981d2db4-8069-48a3-aeb0-340521bd6883 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:45.050425 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981d2db4-8069-48a3-aeb0-340521bd6883 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:45.052391 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 929/1844] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:13:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:13:45.053222 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ff1d16-f030-43b9-a5a6-226186495e20 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:45.055772 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668720be-cfa5-4e45-8feb-21bae002b5a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:45.056574 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668720be-cfa5-4e45-8feb-21bae002b5a2 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:45.056855 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668720be-cfa5-4e45-8feb-21bae002b5a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:45.057130 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668720be-cfa5-4e45-8feb-21bae002b5a2 admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:45.057819 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668720be-cfa5-4e45-8feb-21bae002b5a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:45.060665 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668720be-cfa5-4e45-8feb-21bae002b5a2 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:45.063094 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ff1d16-f030-43b9-a5a6-226186495e20 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:45.068188 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af725108-4793-4f57-851c-0bc9bac1dee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:45.068862 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af725108-4793-4f57-851c-0bc9bac1dee3 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:45.069146 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af725108-4793-4f57-851c-0bc9bac1dee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:45.069423 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af725108-4793-4f57-851c-0bc9bac1dee3 admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:45.070166 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af725108-4793-4f57-851c-0bc9bac1dee3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:45.072290 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af725108-4793-4f57-851c-0bc9bac1dee3 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:45.081022 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 916/1845] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:13:44 2022] POST /identity/v3/users => generated 300 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:13:45.082421 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668720be-cfa5-4e45-8feb-21bae002b5a2 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:45.085125 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-668720be-cfa5-4e45-8feb-21bae002b5a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:45.093955 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 930/1846] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:13:45 2022] POST /identity/v3/users => generated 305 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:13:45.098635 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af725108-4793-4f57-851c-0bc9bac1dee3 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:45.102106 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668720be-cfa5-4e45-8feb-21bae002b5a2 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:45.105591 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af725108-4793-4f57-851c-0bc9bac1dee3 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:45.107276 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682d3e7f-284e-43f4-a8ad-0d7ea38d0e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:45.108204 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682d3e7f-284e-43f4-a8ad-0d7ea38d0e1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:45.108644 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682d3e7f-284e-43f4-a8ad-0d7ea38d0e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:45.108933 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682d3e7f-284e-43f4-a8ad-0d7ea38d0e1d admin admin] PATH_INFO: `/v3/projects/32b46be372824ec49b0ef96868e02437` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:45.110259 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682d3e7f-284e-43f4-a8ad-0d7ea38d0e1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=32b46be372824ec49b0ef96868e02437)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:45.110433 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5791cb-b82c-4490-a1e5-9bb09a663893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:45.111065 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5791cb-b82c-4490-a1e5-9bb09a663893 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:45.111345 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5791cb-b82c-4490-a1e5-9bb09a663893 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:45.111619 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5791cb-b82c-4490-a1e5-9bb09a663893 admin admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:45.112341 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5791cb-b82c-4490-a1e5-9bb09a663893 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:13:45.112438 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682d3e7f-284e-43f4-a8ad-0d7ea38d0e1d admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:45.112643 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5791cb-b82c-4490-a1e5-9bb09a663893 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:45.114258 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5791cb-b82c-4490-a1e5-9bb09a663893 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:45.127354 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 931/1847] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:13:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:13:45.128170 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5791cb-b82c-4490-a1e5-9bb09a663893 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:45.138029 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5791cb-b82c-4490-a1e5-9bb09a663893 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:45.143350 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52ed9d2-16ab-411d-b95e-050b7e3bfdba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:45.144075 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52ed9d2-16ab-411d-b95e-050b7e3bfdba admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:45.144349 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52ed9d2-16ab-411d-b95e-050b7e3bfdba admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:45.144690 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52ed9d2-16ab-411d-b95e-050b7e3bfdba admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:45.145442 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52ed9d2-16ab-411d-b95e-050b7e3bfdba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:45.147061 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52ed9d2-16ab-411d-b95e-050b7e3bfdba admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:45.157176 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 932/1848] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:13:45 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:13:45.158003 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52ed9d2-16ab-411d-b95e-050b7e3bfdba admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:45.162710 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-682d3e7f-284e-43f4-a8ad-0d7ea38d0e1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32b46be372824ec49b0ef96868e02437', 'request_id': 'req-682d3e7f-284e-43f4-a8ad-0d7ea38d0e1d'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:45.168703 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52ed9d2-16ab-411d-b95e-050b7e3bfdba admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:45.170965 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-682d3e7f-284e-43f4-a8ad-0d7ea38d0e1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32b46be372824ec49b0ef96868e02437', 'request_id': 'req-682d3e7f-284e-43f4-a8ad-0d7ea38d0e1d'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:45.177699 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-682d3e7f-284e-43f4-a8ad-0d7ea38d0e1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32b46be372824ec49b0ef96868e02437', 'request_id': 'req-682d3e7f-284e-43f4-a8ad-0d7ea38d0e1d'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:45.191515 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-682d3e7f-284e-43f4-a8ad-0d7ea38d0e1d admin admin] The token cache is being invalidate because project 32b46be372824ec49b0ef96868e02437 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:13:45.191797 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-682d3e7f-284e-43f4-a8ad-0d7ea38d0e1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:45.192596 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-682d3e7f-284e-43f4-a8ad-0d7ea38d0e1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:45.194271 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 917/1849] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:13:45 2022] DELETE /identity/v3/projects/32b46be372824ec49b0ef96868e02437 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:13:45.195037 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682d3e7f-284e-43f4-a8ad-0d7ea38d0e1d admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:45.196427 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-682d3e7f-284e-43f4-a8ad-0d7ea38d0e1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:45.233714 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb31faf-bd65-4732-9943-77b634d21a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:45.234854 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb31faf-bd65-4732-9943-77b634d21a4d admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:45.235135 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb31faf-bd65-4732-9943-77b634d21a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:45.235504 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb31faf-bd65-4732-9943-77b634d21a4d admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:45.236271 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb31faf-bd65-4732-9943-77b634d21a4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:45.237892 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb31faf-bd65-4732-9943-77b634d21a4d admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:45.248463 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 933/1850] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:13:45 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:13:45.249327 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb31faf-bd65-4732-9943-77b634d21a4d admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:45.255325 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-2bb31faf-bd65-4732-9943-77b634d21a4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:45.266998 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682d3e7f-284e-43f4-a8ad-0d7ea38d0e1d admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:45.270822 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb31faf-bd65-4732-9943-77b634d21a4d admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:45.271655 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ce5857-dabe-49f1-bf9c-00797c9b776e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:45.272334 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ce5857-dabe-49f1-bf9c-00797c9b776e admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:45.272617 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ce5857-dabe-49f1-bf9c-00797c9b776e admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:45.272891 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ce5857-dabe-49f1-bf9c-00797c9b776e admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:45.273618 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ce5857-dabe-49f1-bf9c-00797c9b776e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:45.275584 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ce5857-dabe-49f1-bf9c-00797c9b776e admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:45.277320 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e200792b-e66b-4bf1-814d-cb19fd0ca325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:45.278774 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e200792b-e66b-4bf1-814d-cb19fd0ca325 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:45.279060 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e200792b-e66b-4bf1-814d-cb19fd0ca325 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:45.279333 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e200792b-e66b-4bf1-814d-cb19fd0ca325 admin admin] PATH_INFO: `/v3/projects/8686e58d67f744ad9a7f6440bae8dce3/users/de046398833b4fd5a560e521a19f9598/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:45.295359 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:13:45.299151 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e200792b-e66b-4bf1-814d-cb19fd0ca325 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8686e58d67f744ad9a7f6440bae8dce3, user_id=de046398833b4fd5a560e521a19f9598, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:45.302119 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e200792b-e66b-4bf1-814d-cb19fd0ca325 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:45.304777 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 918/1851] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:13:45 2022] POST /identity/v3/projects => generated 371 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:13:45.306211 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc31ad64-3aeb-42ef-ab0e-7d06cb3abbfc None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:45.306466 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc31ad64-3aeb-42ef-ab0e-7d06cb3abbfc None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:45.306745 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc31ad64-3aeb-42ef-ab0e-7d06cb3abbfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:45.318907 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 934/1852] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:13:45 2022] PUT /identity/v3/projects/8686e58d67f744ad9a7f6440bae8dce3/users/de046398833b4fd5a560e521a19f9598/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:13:45.319523 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e200792b-e66b-4bf1-814d-cb19fd0ca325 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:45.321202 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-e200792b-e66b-4bf1-814d-cb19fd0ca325 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:45.327509 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-bc31ad64-3aeb-42ef-ab0e-7d06cb3abbfc None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:13:45.328691 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-bc31ad64-3aeb-42ef-ab0e-7d06cb3abbfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:45.364450 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:13:45.386833 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e200792b-e66b-4bf1-814d-cb19fd0ca325 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:45.389849 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 919/1853] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:13:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:13:45.390698 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc31ad64-3aeb-42ef-ab0e-7d06cb3abbfc None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:45.399086 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cae327-09b4-4a88-85b1-2178f00f5b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:45.399779 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cae327-09b4-4a88-85b1-2178f00f5b8d admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:45.400054 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cae327-09b4-4a88-85b1-2178f00f5b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:45.400320 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cae327-09b4-4a88-85b1-2178f00f5b8d admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:45.400428 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc31ad64-3aeb-42ef-ab0e-7d06cb3abbfc None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:45.401151 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cae327-09b4-4a88-85b1-2178f00f5b8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:45.402800 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cae327-09b4-4a88-85b1-2178f00f5b8d admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:45.405316 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240221e2-d2c0-4c46-a1db-3234068095b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:45.406028 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240221e2-d2c0-4c46-a1db-3234068095b3 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:45.406295 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240221e2-d2c0-4c46-a1db-3234068095b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:45.406572 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240221e2-d2c0-4c46-a1db-3234068095b3 admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:45.407314 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240221e2-d2c0-4c46-a1db-3234068095b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:45.409219 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240221e2-d2c0-4c46-a1db-3234068095b3 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:45.416512 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 935/1854] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:13:45 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:13:45.416512 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cae327-09b4-4a88-85b1-2178f00f5b8d admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:45.426827 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cae327-09b4-4a88-85b1-2178f00f5b8d admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:45.431316 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45763e77-e506-4f58-b18a-f483aeb5e54f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:45.431587 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 920/1855] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:13:45 2022] POST /identity/v3/users => generated 286 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:13:45.431976 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45763e77-e506-4f58-b18a-f483aeb5e54f admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:45.432258 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45763e77-e506-4f58-b18a-f483aeb5e54f admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:45.432535 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45763e77-e506-4f58-b18a-f483aeb5e54f admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:45.433025 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d30ff76-0843-48e8-bbc7-bc404784c9cd None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:45.433250 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45763e77-e506-4f58-b18a-f483aeb5e54f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:45.433333 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d30ff76-0843-48e8-bbc7-bc404784c9cd None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:45.433577 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d30ff76-0843-48e8-bbc7-bc404784c9cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:45.434874 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45763e77-e506-4f58-b18a-f483aeb5e54f admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:45.448504 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 936/1856] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:13:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:13:45.448504 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45763e77-e506-4f58-b18a-f483aeb5e54f admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:45.455011 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-7d30ff76-0843-48e8-bbc7-bc404784c9cd None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:13:45.455700 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45763e77-e506-4f58-b18a-f483aeb5e54f admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:45.456234 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-7d30ff76-0843-48e8-bbc7-bc404784c9cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:45.460234 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a21ab8-ed78-4683-a44d-42c12d09370c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:45.461140 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a21ab8-ed78-4683-a44d-42c12d09370c admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:45.461402 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a21ab8-ed78-4683-a44d-42c12d09370c admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:45.461677 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a21ab8-ed78-4683-a44d-42c12d09370c admin admin] PATH_INFO: `/v3/projects/7b7aebda5e1e49308c404624091e8511/users/221b02f2034d4ba88a36645ae61f0735/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:45.465445 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 921/1857] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:13:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:13:45.465695 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d30ff76-0843-48e8-bbc7-bc404784c9cd None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:45.475416 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d30ff76-0843-48e8-bbc7-bc404784c9cd None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:45.477410 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a21ab8-ed78-4683-a44d-42c12d09370c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b7aebda5e1e49308c404624091e8511, user_id=221b02f2034d4ba88a36645ae61f0735, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:45.480508 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8ee107-022d-4f67-9f68-ff1553a2a0a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:45.480659 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a21ab8-ed78-4683-a44d-42c12d09370c admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:45.481173 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8ee107-022d-4f67-9f68-ff1553a2a0a3 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:45.481454 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8ee107-022d-4f67-9f68-ff1553a2a0a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:45.481748 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8ee107-022d-4f67-9f68-ff1553a2a0a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:45.482498 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8ee107-022d-4f67-9f68-ff1553a2a0a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:45.484118 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8ee107-022d-4f67-9f68-ff1553a2a0a3 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:45.495007 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 937/1858] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:13:45 2022] PUT /identity/v3/projects/7b7aebda5e1e49308c404624091e8511/users/221b02f2034d4ba88a36645ae61f0735/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:13:45.495184 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 922/1859] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:13:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:13:45.496075 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8ee107-022d-4f67-9f68-ff1553a2a0a3 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:45.496208 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a21ab8-ed78-4683-a44d-42c12d09370c admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:45.508705 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8ee107-022d-4f67-9f68-ff1553a2a0a3 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:45.561041 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a21ab8-ed78-4683-a44d-42c12d09370c admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:45.565993 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b8fe52-38cd-48ec-a03f-dee930fd98d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:45.566673 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b8fe52-38cd-48ec-a03f-dee930fd98d9 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:45.566957 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b8fe52-38cd-48ec-a03f-dee930fd98d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:45.567231 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b8fe52-38cd-48ec-a03f-dee930fd98d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:45.568037 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b8fe52-38cd-48ec-a03f-dee930fd98d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:13:45.568329 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b8fe52-38cd-48ec-a03f-dee930fd98d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:45.569965 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b8fe52-38cd-48ec-a03f-dee930fd98d9 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:45.571030 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae960400-1cd5-4087-a4bb-5f789f03d460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:45.571947 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae960400-1cd5-4087-a4bb-5f789f03d460 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:45.572231 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae960400-1cd5-4087-a4bb-5f789f03d460 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:45.572698 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae960400-1cd5-4087-a4bb-5f789f03d460 admin admin] PATH_INFO: `/v3/projects/8686e58d67f744ad9a7f6440bae8dce3/users/de046398833b4fd5a560e521a19f9598/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:45.576359 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae960400-1cd5-4087-a4bb-5f789f03d460 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8686e58d67f744ad9a7f6440bae8dce3, user_id=de046398833b4fd5a560e521a19f9598, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:45.581989 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae960400-1cd5-4087-a4bb-5f789f03d460 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:45.582872 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 938/1860] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:13:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:13:45.584246 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aee2217-778e-421c-a066-f53663055f40 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:45.584535 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aee2217-778e-421c-a066-f53663055f40 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:45.584809 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aee2217-778e-421c-a066-f53663055f40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:45.595669 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 923/1861] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:13:45 2022] PUT /identity/v3/projects/8686e58d67f744ad9a7f6440bae8dce3/users/de046398833b4fd5a560e521a19f9598/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:13:45.596699 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae960400-1cd5-4087-a4bb-5f789f03d460 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:45.637678 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-9aee2217-778e-421c-a066-f53663055f40 None None] MFA Rules not processed for user `221b02f2034d4ba88a36645ae61f0735`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:13:45.637968 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-9aee2217-778e-421c-a066-f53663055f40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:45.719281 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 939/1862] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:13:45 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:13:45.720216 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aee2217-778e-421c-a066-f53663055f40 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:45.728339 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:13:45.734205 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aee2217-778e-421c-a066-f53663055f40 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:45.736034 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae960400-1cd5-4087-a4bb-5f789f03d460 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:45.743378 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50da5199-e92f-473f-8e91-bc6e08915121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:45.744099 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50da5199-e92f-473f-8e91-bc6e08915121 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:45.744386 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50da5199-e92f-473f-8e91-bc6e08915121 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:45.744656 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50da5199-e92f-473f-8e91-bc6e08915121 admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:45.745367 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50da5199-e92f-473f-8e91-bc6e08915121 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:45.747508 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50da5199-e92f-473f-8e91-bc6e08915121 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:45.748454 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941cb20a-7785-46d8-8ec3-b5b9a86d4b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:45.749149 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941cb20a-7785-46d8-8ec3-b5b9a86d4b51 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:45.749425 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941cb20a-7785-46d8-8ec3-b5b9a86d4b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:45.749692 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941cb20a-7785-46d8-8ec3-b5b9a86d4b51 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:45.750810 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941cb20a-7785-46d8-8ec3-b5b9a86d4b51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:45.752475 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941cb20a-7785-46d8-8ec3-b5b9a86d4b51 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:45.764093 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 924/1863] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:13:45 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:13:45.768659 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c6e9cc-983d-409e-bf7d-eb0c974017cb None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:45.768976 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c6e9cc-983d-409e-bf7d-eb0c974017cb None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:45.769251 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c6e9cc-983d-409e-bf7d-eb0c974017cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:45.793628 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 940/1864] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:13:45 2022] POST /identity/v3/projects => generated 369 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:13:45.794887 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50da5199-e92f-473f-8e91-bc6e08915121 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:45.800789 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:13:45.834307 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-05c6e9cc-983d-409e-bf7d-eb0c974017cb None None] MFA Rules not processed for user `de046398833b4fd5a560e521a19f9598`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:13:45.835557 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-05c6e9cc-983d-409e-bf7d-eb0c974017cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:45.879598 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50da5199-e92f-473f-8e91-bc6e08915121 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:45.887558 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82453ee9-5570-42e2-964e-1468d9e52393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:45.888367 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82453ee9-5570-42e2-964e-1468d9e52393 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:45.888641 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82453ee9-5570-42e2-964e-1468d9e52393 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:45.888923 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82453ee9-5570-42e2-964e-1468d9e52393 admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:45.889724 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82453ee9-5570-42e2-964e-1468d9e52393 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:45.892870 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82453ee9-5570-42e2-964e-1468d9e52393 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:45.932650 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 941/1865] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:13:45 2022] POST /identity/v3/projects => generated 407 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:13:45.933352 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82453ee9-5570-42e2-964e-1468d9e52393 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:45.955797 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 925/1866] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:13:45 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:13:45.956964 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c6e9cc-983d-409e-bf7d-eb0c974017cb None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:45.968814 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c6e9cc-983d-409e-bf7d-eb0c974017cb None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:46.015336 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82453ee9-5570-42e2-964e-1468d9e52393 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:46.026432 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d087a9d0-ac24-46c0-9eab-ff0c14128217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:46.027665 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d087a9d0-ac24-46c0-9eab-ff0c14128217 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:46.028079 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d087a9d0-ac24-46c0-9eab-ff0c14128217 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:46.028604 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d087a9d0-ac24-46c0-9eab-ff0c14128217 admin admin] PATH_INFO: `/v3/projects/4414c384045242c88443bfb6abc0b976/users/8704cae40ac34b2e9547fe5874dcdebb/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:46.038339 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469d29ca-e2f0-48d4-8090-14e6441d8252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:46.039138 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469d29ca-e2f0-48d4-8090-14e6441d8252 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:46.039412 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469d29ca-e2f0-48d4-8090-14e6441d8252 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:46.039700 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469d29ca-e2f0-48d4-8090-14e6441d8252 admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:46.040382 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469d29ca-e2f0-48d4-8090-14e6441d8252 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:46.042355 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469d29ca-e2f0-48d4-8090-14e6441d8252 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:46.054409 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d087a9d0-ac24-46c0-9eab-ff0c14128217 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4414c384045242c88443bfb6abc0b976, user_id=8704cae40ac34b2e9547fe5874dcdebb, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:46.058201 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d087a9d0-ac24-46c0-9eab-ff0c14128217 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:46.074637 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 926/1867] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:13:45 2022] POST /identity/v3/users => generated 285 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:13:46.075556 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469d29ca-e2f0-48d4-8090-14e6441d8252 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:46.080545 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 942/1868] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:13:45 2022] PUT /identity/v3/projects/4414c384045242c88443bfb6abc0b976/users/8704cae40ac34b2e9547fe5874dcdebb/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:13:46.081544 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d087a9d0-ac24-46c0-9eab-ff0c14128217 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:46.083347 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-d087a9d0-ac24-46c0-9eab-ff0c14128217 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:46.089854 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469d29ca-e2f0-48d4-8090-14e6441d8252 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:46.171028 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee61864-487a-48aa-aca5-db70b0cdc80e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:46.171753 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee61864-487a-48aa-aca5-db70b0cdc80e admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:46.172027 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee61864-487a-48aa-aca5-db70b0cdc80e admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:46.172302 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee61864-487a-48aa-aca5-db70b0cdc80e admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:46.173107 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee61864-487a-48aa-aca5-db70b0cdc80e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:46.175341 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee61864-487a-48aa-aca5-db70b0cdc80e admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:46.193797 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:13:46.207608 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 927/1869] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:13:46 2022] POST /identity/v3/users => generated 310 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:13:46.208332 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d087a9d0-ac24-46c0-9eab-ff0c14128217 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:46.209302 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee61864-487a-48aa-aca5-db70b0cdc80e admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:46.216689 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12189875-1155-43be-885a-3d52de2ddde8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:46.217985 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12189875-1155-43be-885a-3d52de2ddde8 service nova] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:46.218283 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12189875-1155-43be-885a-3d52de2ddde8 service nova] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:46.218561 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12189875-1155-43be-885a-3d52de2ddde8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:46.224289 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee61864-487a-48aa-aca5-db70b0cdc80e admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:46.226539 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:13:46.238577 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2215a72f-2943-437c-9d14-160a496d911a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:46.239285 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2215a72f-2943-437c-9d14-160a496d911a admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:46.239567 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2215a72f-2943-437c-9d14-160a496d911a admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:46.239849 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2215a72f-2943-437c-9d14-160a496d911a admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:46.241310 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2215a72f-2943-437c-9d14-160a496d911a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:46.244660 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2215a72f-2943-437c-9d14-160a496d911a admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:46.277553 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 928/1870] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:13:46 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:13:46.279092 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbfd5c2-fcdb-4c40-a592-d3faac469545 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:46.279405 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbfd5c2-fcdb-4c40-a592-d3faac469545 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:46.279673 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbfd5c2-fcdb-4c40-a592-d3faac469545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:46.307237 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12189875-1155-43be-885a-3d52de2ddde8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:46.309034 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12189875-1155-43be-885a-3d52de2ddde8 service nova] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:46.319817 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 943/1871] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:13:46 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:13:46.320790 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12189875-1155-43be-885a-3d52de2ddde8 service nova] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:46.323035 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-abbfd5c2-fcdb-4c40-a592-d3faac469545 None None] MFA Rules not processed for user `8704cae40ac34b2e9547fe5874dcdebb`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:13:46.324251 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-abbfd5c2-fcdb-4c40-a592-d3faac469545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:46.333117 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12189875-1155-43be-885a-3d52de2ddde8 service nova] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:46.338677 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3bb8b6-f2a7-46da-a04c-0f4db304dfbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:46.339483 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3bb8b6-f2a7-46da-a04c-0f4db304dfbe admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:46.339857 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3bb8b6-f2a7-46da-a04c-0f4db304dfbe admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:46.340237 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3bb8b6-f2a7-46da-a04c-0f4db304dfbe admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:46.341272 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3bb8b6-f2a7-46da-a04c-0f4db304dfbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:46.342811 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3bb8b6-f2a7-46da-a04c-0f4db304dfbe admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:46.354849 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 944/1872] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:13:46 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:13:46.356195 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3bb8b6-f2a7-46da-a04c-0f4db304dfbe admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:46.367589 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3bb8b6-f2a7-46da-a04c-0f4db304dfbe admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:46.379697 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ad6eb5-3e66-4b6f-8e00-6a3908da7513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:46.380542 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ad6eb5-3e66-4b6f-8e00-6a3908da7513 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:46.380719 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ad6eb5-3e66-4b6f-8e00-6a3908da7513 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:46.380924 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ad6eb5-3e66-4b6f-8e00-6a3908da7513 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:46.382346 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ad6eb5-3e66-4b6f-8e00-6a3908da7513 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:46.385965 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ad6eb5-3e66-4b6f-8e00-6a3908da7513 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:46.409625 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 945/1873] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:13:46 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:13:46.411743 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ad6eb5-3e66-4b6f-8e00-6a3908da7513 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:46.418829 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 929/1874] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:13:46 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:13:46.420264 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbfd5c2-fcdb-4c40-a592-d3faac469545 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:46.432058 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ad6eb5-3e66-4b6f-8e00-6a3908da7513 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:46.434703 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbfd5c2-fcdb-4c40-a592-d3faac469545 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:46.439828 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c06ed89-4859-4613-947f-e23ff04e1025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:46.440890 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c06ed89-4859-4613-947f-e23ff04e1025 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:46.441177 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c06ed89-4859-4613-947f-e23ff04e1025 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:46.441452 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c06ed89-4859-4613-947f-e23ff04e1025 admin admin] PATH_INFO: `/v3/projects/74db98fae0c044b19ae2bc4f74bcd38d/users/caaadf823a394935b08d631d2f256b38/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:46.447252 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64ca588-ab38-4893-92d2-db5685cc51eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:46.448466 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64ca588-ab38-4893-92d2-db5685cc51eb admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:46.448950 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64ca588-ab38-4893-92d2-db5685cc51eb admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:46.449454 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64ca588-ab38-4893-92d2-db5685cc51eb admin admin] PATH_INFO: `/v3/projects/6610a2359aa64f89befcf72e4f3f6a54/users/f2672c5db79b4a48a505c3df536594dd/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:46.466394 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c06ed89-4859-4613-947f-e23ff04e1025 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74db98fae0c044b19ae2bc4f74bcd38d, user_id=caaadf823a394935b08d631d2f256b38, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:46.468307 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64ca588-ab38-4893-92d2-db5685cc51eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=6610a2359aa64f89befcf72e4f3f6a54, user_id=f2672c5db79b4a48a505c3df536594dd, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:46.469495 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c06ed89-4859-4613-947f-e23ff04e1025 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:46.471741 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64ca588-ab38-4893-92d2-db5685cc51eb admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:46.489407 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 946/1875] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:13:46 2022] PUT /identity/v3/projects/74db98fae0c044b19ae2bc4f74bcd38d/users/caaadf823a394935b08d631d2f256b38/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:13:46.491955 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c06ed89-4859-4613-947f-e23ff04e1025 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:46.493006 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 930/1876] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:13:46 2022] PUT /identity/v3/projects/6610a2359aa64f89befcf72e4f3f6a54/users/f2672c5db79b4a48a505c3df536594dd/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:13:46.495098 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64ca588-ab38-4893-92d2-db5685cc51eb admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:46.587575 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c06ed89-4859-4613-947f-e23ff04e1025 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:46.590883 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64ca588-ab38-4893-92d2-db5685cc51eb admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:46.600261 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17006fef-7b8f-4962-88d8-0f859cde8f9d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:46.601808 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17006fef-7b8f-4962-88d8-0f859cde8f9d service nova] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:46.602410 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17006fef-7b8f-4962-88d8-0f859cde8f9d service nova] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:46.602835 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17006fef-7b8f-4962-88d8-0f859cde8f9d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:46.606139 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-17006fef-7b8f-4962-88d8-0f859cde8f9d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:46.672611 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88c92ea-a42a-4dc3-8d7c-7f4139718fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:46.673990 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88c92ea-a42a-4dc3-8d7c-7f4139718fec admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:46.675104 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88c92ea-a42a-4dc3-8d7c-7f4139718fec admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:46.675370 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88c92ea-a42a-4dc3-8d7c-7f4139718fec admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:46.676181 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88c92ea-a42a-4dc3-8d7c-7f4139718fec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:46.678452 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88c92ea-a42a-4dc3-8d7c-7f4139718fec admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:46.690981 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:13:46.693577 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:13:46.721508 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17006fef-7b8f-4962-88d8-0f859cde8f9d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:46.725070 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17006fef-7b8f-4962-88d8-0f859cde8f9d service nova] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:46.744816 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 931/1877] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:13:46 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:13:46.745773 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17006fef-7b8f-4962-88d8-0f859cde8f9d service nova] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:46.752989 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 947/1878] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:13:46 2022] POST /identity/v3/projects => generated 369 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:13:46.754883 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4c3b9d-3d54-4644-8afb-7c34b789511d None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:46.755282 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4c3b9d-3d54-4644-8afb-7c34b789511d None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:46.755656 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4c3b9d-3d54-4644-8afb-7c34b789511d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:46.760606 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17006fef-7b8f-4962-88d8-0f859cde8f9d service nova] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:46.800341 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-0c4c3b9d-3d54-4644-8afb-7c34b789511d None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:13:46.801922 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-0c4c3b9d-3d54-4644-8afb-7c34b789511d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:46.860587 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73378511-0c82-4a4f-8e3d-0acd7f20ec61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:46.861505 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73378511-0c82-4a4f-8e3d-0acd7f20ec61 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:46.862086 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73378511-0c82-4a4f-8e3d-0acd7f20ec61 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:46.862457 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73378511-0c82-4a4f-8e3d-0acd7f20ec61 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:46.863317 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73378511-0c82-4a4f-8e3d-0acd7f20ec61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:46.865467 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73378511-0c82-4a4f-8e3d-0acd7f20ec61 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:46.903895 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 948/1879] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:13:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:13:46.904959 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4c3b9d-3d54-4644-8afb-7c34b789511d None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:46.906708 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 932/1880] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:13:46 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:13:46.910964 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73378511-0c82-4a4f-8e3d-0acd7f20ec61 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:46.928778 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73378511-0c82-4a4f-8e3d-0acd7f20ec61 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:46.935199 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4c3b9d-3d54-4644-8afb-7c34b789511d None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:46.940040 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e048a9-2b28-4d06-a0b9-3970dcbb3578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:46.941218 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e048a9-2b28-4d06-a0b9-3970dcbb3578 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:46.941613 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e048a9-2b28-4d06-a0b9-3970dcbb3578 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:46.942083 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e048a9-2b28-4d06-a0b9-3970dcbb3578 admin admin] PATH_INFO: `/v3/projects/74db98fae0c044b19ae2bc4f74bcd38d/users/caaadf823a394935b08d631d2f256b38/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:46.943383 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de7ec2b-dd58-44c5-b73b-c617f59c130b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:46.944338 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e048a9-2b28-4d06-a0b9-3970dcbb3578 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74db98fae0c044b19ae2bc4f74bcd38d, user_id=caaadf823a394935b08d631d2f256b38, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:46.944520 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de7ec2b-dd58-44c5-b73b-c617f59c130b admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:46.945129 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de7ec2b-dd58-44c5-b73b-c617f59c130b admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:46.945547 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de7ec2b-dd58-44c5-b73b-c617f59c130b admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:46.946423 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de7ec2b-dd58-44c5-b73b-c617f59c130b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:46.948221 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e048a9-2b28-4d06-a0b9-3970dcbb3578 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:46.949344 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de7ec2b-dd58-44c5-b73b-c617f59c130b admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:46.960638 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 933/1881] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:13:46 2022] PUT /identity/v3/projects/74db98fae0c044b19ae2bc4f74bcd38d/users/caaadf823a394935b08d631d2f256b38/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:13:46.966151 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e048a9-2b28-4d06-a0b9-3970dcbb3578 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:46.967281 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-75e048a9-2b28-4d06-a0b9-3970dcbb3578 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:46.999147 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 949/1882] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:13:46 2022] POST /identity/v3/users => generated 291 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:13:47.001236 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c21de5-635f-45fa-a39e-fb0a0a8c6fac None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:47.001548 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c21de5-635f-45fa-a39e-fb0a0a8c6fac None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:47.001827 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c21de5-635f-45fa-a39e-fb0a0a8c6fac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:47.050791 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-19c21de5-635f-45fa-a39e-fb0a0a8c6fac None None] MFA Rules not processed for user `caaadf823a394935b08d631d2f256b38`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:13:47.054095 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-19c21de5-635f-45fa-a39e-fb0a0a8c6fac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:47.058674 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e048a9-2b28-4d06-a0b9-3970dcbb3578 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:47.072563 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1dde64-d8e5-49e3-a839-49ffcd09f72a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:47.074514 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1dde64-d8e5-49e3-a839-49ffcd09f72a service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:47.074801 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1dde64-d8e5-49e3-a839-49ffcd09f72a service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:47.075082 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1dde64-d8e5-49e3-a839-49ffcd09f72a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:47.154952 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 950/1883] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:13:46 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:13:47.156021 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c21de5-635f-45fa-a39e-fb0a0a8c6fac None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:47.169250 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1dde64-d8e5-49e3-a839-49ffcd09f72a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:47.170811 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1dde64-d8e5-49e3-a839-49ffcd09f72a service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:47.194614 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 934/1884] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:13:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:13:47.195493 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1dde64-d8e5-49e3-a839-49ffcd09f72a service neutron] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:47.197636 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-fc1dde64-d8e5-49e3-a839-49ffcd09f72a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:47.237942 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:13:47.242473 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:13:47.249912 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c21de5-635f-45fa-a39e-fb0a0a8c6fac None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:47.259028 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc641244-093a-427d-93a2-f0d52bd374f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:47.259874 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc641244-093a-427d-93a2-f0d52bd374f5 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:47.260253 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc641244-093a-427d-93a2-f0d52bd374f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:47.260623 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc641244-093a-427d-93a2-f0d52bd374f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:47.262218 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc641244-093a-427d-93a2-f0d52bd374f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:47.264425 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc641244-093a-427d-93a2-f0d52bd374f5 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:47.280970 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 951/1885] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:13:47 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:13:47.286031 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc641244-093a-427d-93a2-f0d52bd374f5 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:47.299409 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc641244-093a-427d-93a2-f0d52bd374f5 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:47.307536 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7630877d-5904-49cf-8de4-d3cced4eb869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:47.308840 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7630877d-5904-49cf-8de4-d3cced4eb869 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:47.309317 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7630877d-5904-49cf-8de4-d3cced4eb869 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:47.309738 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7630877d-5904-49cf-8de4-d3cced4eb869 admin admin] PATH_INFO: `/v3/projects/1dded48a02c542db93950a1593eeaaf1/users/cf46071658894cf5b4da6bc3e2c6ec09/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:47.329324 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1dde64-d8e5-49e3-a839-49ffcd09f72a service neutron] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:47.340403 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7630877d-5904-49cf-8de4-d3cced4eb869 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1dded48a02c542db93950a1593eeaaf1, user_id=cf46071658894cf5b4da6bc3e2c6ec09, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:47.343446 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7630877d-5904-49cf-8de4-d3cced4eb869 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:47.350283 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b6eeda-2986-444a-8ecf-c6428ccd1d93 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:47.350968 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b6eeda-2986-444a-8ecf-c6428ccd1d93 service nova] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:47.351243 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b6eeda-2986-444a-8ecf-c6428ccd1d93 service nova] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:47.351565 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b6eeda-2986-444a-8ecf-c6428ccd1d93 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:47.367019 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b6eeda-2986-444a-8ecf-c6428ccd1d93 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:47.369551 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b6eeda-2986-444a-8ecf-c6428ccd1d93 service nova] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:47.371910 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 952/1886] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:13:47 2022] PUT /identity/v3/projects/1dded48a02c542db93950a1593eeaaf1/users/cf46071658894cf5b4da6bc3e2c6ec09/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:13:47.372654 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7630877d-5904-49cf-8de4-d3cced4eb869 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:47.404081 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 935/1887] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:13:47 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:13:47.404806 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b6eeda-2986-444a-8ecf-c6428ccd1d93 service nova] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:47.435936 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b6eeda-2986-444a-8ecf-c6428ccd1d93 service nova] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:47.511538 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7630877d-5904-49cf-8de4-d3cced4eb869 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:47.519491 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946f1fbc-c6a3-4d7c-9e24-3a142110b478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:47.520510 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946f1fbc-c6a3-4d7c-9e24-3a142110b478 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:47.520856 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946f1fbc-c6a3-4d7c-9e24-3a142110b478 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:47.521196 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946f1fbc-c6a3-4d7c-9e24-3a142110b478 admin admin] PATH_INFO: `/v3/users/97a116b9e9404477860d091fc51c988f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:47.522628 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946f1fbc-c6a3-4d7c-9e24-3a142110b478 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97a116b9e9404477860d091fc51c988f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:47.525426 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946f1fbc-c6a3-4d7c-9e24-3a142110b478 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:47.525688 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfd4547-b86b-44ca-9093-3b8facd0122d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:47.526765 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfd4547-b86b-44ca-9093-3b8facd0122d admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:47.527055 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfd4547-b86b-44ca-9093-3b8facd0122d admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:47.527476 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfd4547-b86b-44ca-9093-3b8facd0122d admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:47.528494 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfd4547-b86b-44ca-9093-3b8facd0122d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:47.530877 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfd4547-b86b-44ca-9093-3b8facd0122d admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:47.551854 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 936/1888] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:13:47 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:13:47.556482 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfd4547-b86b-44ca-9093-3b8facd0122d admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:47.605499 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-946f1fbc-c6a3-4d7c-9e24-3a142110b478 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97a116b9e9404477860d091fc51c988f'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:47.606307 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-946f1fbc-c6a3-4d7c-9e24-3a142110b478 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97a116b9e9404477860d091fc51c988f'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:47.618461 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-946f1fbc-c6a3-4d7c-9e24-3a142110b478 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97a116b9e9404477860d091fc51c988f'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:47.636334 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-946f1fbc-c6a3-4d7c-9e24-3a142110b478 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97a116b9e9404477860d091fc51c988f'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:47.667564 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-946f1fbc-c6a3-4d7c-9e24-3a142110b478 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97a116b9e9404477860d091fc51c988f'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:47.675447 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 953/1889] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:13:47 2022] DELETE /identity/v3/users/97a116b9e9404477860d091fc51c988f => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:13:47.679707 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946f1fbc-c6a3-4d7c-9e24-3a142110b478 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:47.682149 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-946f1fbc-c6a3-4d7c-9e24-3a142110b478 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:47.699824 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfd4547-b86b-44ca-9093-3b8facd0122d admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:47.764717 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:13:47.771638 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:13:47.798638 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946f1fbc-c6a3-4d7c-9e24-3a142110b478 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:47.803843 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da9a25c-392a-4ec3-926c-98a7a0224b80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:47.804446 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da9a25c-392a-4ec3-926c-98a7a0224b80 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:47.804718 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da9a25c-392a-4ec3-926c-98a7a0224b80 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:47.804990 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da9a25c-392a-4ec3-926c-98a7a0224b80 admin admin] PATH_INFO: `/v3/projects/1dded48a02c542db93950a1593eeaaf1/users/cf46071658894cf5b4da6bc3e2c6ec09/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:47.807542 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da9a25c-392a-4ec3-926c-98a7a0224b80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1dded48a02c542db93950a1593eeaaf1, user_id=cf46071658894cf5b4da6bc3e2c6ec09, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:47.810788 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da9a25c-392a-4ec3-926c-98a7a0224b80 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:47.825495 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dffc770-f0e9-4fa5-a35a-30e16a368c75 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:47.827218 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dffc770-f0e9-4fa5-a35a-30e16a368c75 service nova] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:47.827507 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dffc770-f0e9-4fa5-a35a-30e16a368c75 service nova] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:47.827816 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dffc770-f0e9-4fa5-a35a-30e16a368c75 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:47.829533 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 954/1890] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:13:47 2022] PUT /identity/v3/projects/1dded48a02c542db93950a1593eeaaf1/users/cf46071658894cf5b4da6bc3e2c6ec09/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:13:47.830078 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-8dffc770-f0e9-4fa5-a35a-30e16a368c75 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:47.831337 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fdb6f9-d1ae-49cc-9315-f82953f5fc66 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:47.831771 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fdb6f9-d1ae-49cc-9315-f82953f5fc66 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:47.832311 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fdb6f9-d1ae-49cc-9315-f82953f5fc66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:47.856147 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-18fdb6f9-d1ae-49cc-9315-f82953f5fc66 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:13:47.857899 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-18fdb6f9-d1ae-49cc-9315-f82953f5fc66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:47.904992 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dffc770-f0e9-4fa5-a35a-30e16a368c75 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:47.906717 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dffc770-f0e9-4fa5-a35a-30e16a368c75 service nova] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:47.919796 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 937/1891] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:13:47 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:13:47.921202 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ece1ebe-1086-4870-999d-0f375565624f None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:47.921482 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ece1ebe-1086-4870-999d-0f375565624f None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:47.921754 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ece1ebe-1086-4870-999d-0f375565624f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:47.924538 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 955/1892] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:13:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:13:47.937707 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fdb6f9-d1ae-49cc-9315-f82953f5fc66 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:47.939740 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-18fdb6f9-d1ae-49cc-9315-f82953f5fc66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:47.964774 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-5ece1ebe-1086-4870-999d-0f375565624f None None] MFA Rules not processed for user `cf46071658894cf5b4da6bc3e2c6ec09`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:13:47.966253 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-5ece1ebe-1086-4870-999d-0f375565624f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:48.020362 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fdb6f9-d1ae-49cc-9315-f82953f5fc66 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:48.024703 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77602c37-e241-4661-98a9-e45bcf0b178b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:48.025478 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77602c37-e241-4661-98a9-e45bcf0b178b service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:48.025655 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77602c37-e241-4661-98a9-e45bcf0b178b service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:48.025948 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77602c37-e241-4661-98a9-e45bcf0b178b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:48.041451 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77602c37-e241-4661-98a9-e45bcf0b178b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:48.042917 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77602c37-e241-4661-98a9-e45bcf0b178b service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:48.066593 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 956/1893] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:13:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 23 21:13:48.092238 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 938/1894] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:13:47 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:13:48.101754 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77602c37-e241-4661-98a9-e45bcf0b178b service neutron] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:48.102653 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-77602c37-e241-4661-98a9-e45bcf0b178b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:48.106646 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ece1ebe-1086-4870-999d-0f375565624f None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:48.112045 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-5ece1ebe-1086-4870-999d-0f375565624f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:48.139463 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ece1ebe-1086-4870-999d-0f375565624f None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:48.146820 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56a5282-e095-4700-b767-9c0a21093664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:48.148969 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56a5282-e095-4700-b767-9c0a21093664 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:48.149320 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56a5282-e095-4700-b767-9c0a21093664 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:48.149637 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56a5282-e095-4700-b767-9c0a21093664 admin admin] PATH_INFO: `/v3/users/221b02f2034d4ba88a36645ae61f0735` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:48.151653 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56a5282-e095-4700-b767-9c0a21093664 admin admin] RBAC: Authorizing `identity:delete_user(user_id=221b02f2034d4ba88a36645ae61f0735)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:48.153905 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56a5282-e095-4700-b767-9c0a21093664 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:48.205913 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77602c37-e241-4661-98a9-e45bcf0b178b service neutron] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:48.219062 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1908d11-96be-417f-9092-9412f572d366 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:48.222193 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1908d11-96be-417f-9092-9412f572d366 service nova] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:48.226438 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1908d11-96be-417f-9092-9412f572d366 service nova] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:48.226438 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1908d11-96be-417f-9092-9412f572d366 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:48.263390 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1908d11-96be-417f-9092-9412f572d366 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:48.269075 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1908d11-96be-417f-9092-9412f572d366 service nova] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:48.295678 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 957/1895] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:13:48 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:13:48.342538 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-f56a5282-e095-4700-b767-9c0a21093664 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '221b02f2034d4ba88a36645ae61f0735'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:48.366332 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-f56a5282-e095-4700-b767-9c0a21093664 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '221b02f2034d4ba88a36645ae61f0735'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:48.368458 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-f56a5282-e095-4700-b767-9c0a21093664 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '221b02f2034d4ba88a36645ae61f0735'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:48.371705 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:13:48.396276 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-f56a5282-e095-4700-b767-9c0a21093664 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '221b02f2034d4ba88a36645ae61f0735'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:48.434955 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-f56a5282-e095-4700-b767-9c0a21093664 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '221b02f2034d4ba88a36645ae61f0735'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:48.451180 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1908d11-96be-417f-9092-9412f572d366 service nova] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:48.467648 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1908d11-96be-417f-9092-9412f572d366 service nova] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:48.474889 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 939/1896] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:13:48 2022] DELETE /identity/v3/users/221b02f2034d4ba88a36645ae61f0735 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:13:48.480279 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db433d7-526c-4945-9584-ef9bb542f14d None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:48.480647 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db433d7-526c-4945-9584-ef9bb542f14d None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:48.480998 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db433d7-526c-4945-9584-ef9bb542f14d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:48.487818 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:13:48.526197 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-9db433d7-526c-4945-9584-ef9bb542f14d None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:13:48.527560 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-9db433d7-526c-4945-9584-ef9bb542f14d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:48.618431 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f890686-727d-4091-b9db-b631e4c42834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:48.619639 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f890686-727d-4091-b9db-b631e4c42834 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:48.620981 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f890686-727d-4091-b9db-b631e4c42834 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:48.621352 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f890686-727d-4091-b9db-b631e4c42834 admin admin] PATH_INFO: `/v3/users/8704cae40ac34b2e9547fe5874dcdebb` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:48.624631 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f890686-727d-4091-b9db-b631e4c42834 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8704cae40ac34b2e9547fe5874dcdebb)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:48.627152 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f890686-727d-4091-b9db-b631e4c42834 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:48.670389 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 940/1897] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:13:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:13:48.675003 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db433d7-526c-4945-9584-ef9bb542f14d None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:48.676626 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-9db433d7-526c-4945-9584-ef9bb542f14d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:48.687566 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-2f890686-727d-4091-b9db-b631e4c42834 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8704cae40ac34b2e9547fe5874dcdebb'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:48.688159 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-2f890686-727d-4091-b9db-b631e4c42834 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8704cae40ac34b2e9547fe5874dcdebb'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:48.691404 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db433d7-526c-4945-9584-ef9bb542f14d None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:48.696168 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de85320-9017-4d86-9f22-6b1a02ba1e5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:48.697049 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de85320-9017-4d86-9f22-6b1a02ba1e5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:48.697330 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de85320-9017-4d86-9f22-6b1a02ba1e5d admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:48.697605 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de85320-9017-4d86-9f22-6b1a02ba1e5d admin admin] PATH_INFO: `/v3/projects/dab4a036ceb84c84b34a5aea5b2d9b97` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:48.698768 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-2f890686-727d-4091-b9db-b631e4c42834 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8704cae40ac34b2e9547fe5874dcdebb'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:48.699645 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de85320-9017-4d86-9f22-6b1a02ba1e5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=dab4a036ceb84c84b34a5aea5b2d9b97)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:48.701833 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de85320-9017-4d86-9f22-6b1a02ba1e5d admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:48.717533 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-2f890686-727d-4091-b9db-b631e4c42834 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8704cae40ac34b2e9547fe5874dcdebb'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:48.738030 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-2f890686-727d-4091-b9db-b631e4c42834 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8704cae40ac34b2e9547fe5874dcdebb'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:48.749293 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 958/1898] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:13:48 2022] DELETE /identity/v3/users/8704cae40ac34b2e9547fe5874dcdebb => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:13:48.751963 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f890686-727d-4091-b9db-b631e4c42834 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:48.753563 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-2f890686-727d-4091-b9db-b631e4c42834 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:48.772762 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-4de85320-9017-4d86-9f22-6b1a02ba1e5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dab4a036ceb84c84b34a5aea5b2d9b97', 'request_id': 'req-4de85320-9017-4d86-9f22-6b1a02ba1e5d'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:48.784292 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-4de85320-9017-4d86-9f22-6b1a02ba1e5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dab4a036ceb84c84b34a5aea5b2d9b97', 'request_id': 'req-4de85320-9017-4d86-9f22-6b1a02ba1e5d'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:48.792109 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-4de85320-9017-4d86-9f22-6b1a02ba1e5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dab4a036ceb84c84b34a5aea5b2d9b97', 'request_id': 'req-4de85320-9017-4d86-9f22-6b1a02ba1e5d'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:48.806033 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-4de85320-9017-4d86-9f22-6b1a02ba1e5d admin admin] The token cache is being invalidate because project dab4a036ceb84c84b34a5aea5b2d9b97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:13:48.806467 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-4de85320-9017-4d86-9f22-6b1a02ba1e5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:48.807257 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-4de85320-9017-4d86-9f22-6b1a02ba1e5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:48.809122 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 941/1899] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:13:48 2022] DELETE /identity/v3/projects/dab4a036ceb84c84b34a5aea5b2d9b97 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:13:48.810603 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c58ebad-fbd7-485c-8ad9-a2d5e1665cb9 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:48.810997 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c58ebad-fbd7-485c-8ad9-a2d5e1665cb9 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:48.811369 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c58ebad-fbd7-485c-8ad9-a2d5e1665cb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:48.834684 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-8c58ebad-fbd7-485c-8ad9-a2d5e1665cb9 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:13:48.835904 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-8c58ebad-fbd7-485c-8ad9-a2d5e1665cb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:48.836956 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f890686-727d-4091-b9db-b631e4c42834 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:48.895842 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:13:48.898115 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:13:48.903546 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fe881b-ded5-4120-a0d3-de744359db75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:48.904445 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fe881b-ded5-4120-a0d3-de744359db75 service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:48.904838 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fe881b-ded5-4120-a0d3-de744359db75 service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:48.905211 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fe881b-ded5-4120-a0d3-de744359db75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:48.909531 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-c9fe881b-ded5-4120-a0d3-de744359db75 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:48.914051 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 942/1900] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:13:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:13:48.915201 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c58ebad-fbd7-485c-8ad9-a2d5e1665cb9 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:48.916955 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-8c58ebad-fbd7-485c-8ad9-a2d5e1665cb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:48.928811 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fe881b-ded5-4120-a0d3-de744359db75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:48.930396 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fe881b-ded5-4120-a0d3-de744359db75 service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:48.932967 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c58ebad-fbd7-485c-8ad9-a2d5e1665cb9 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:48.938265 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dccbd4f-d530-4366-8392-ad7a2689e1d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:48.939307 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dccbd4f-d530-4366-8392-ad7a2689e1d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:48.939688 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dccbd4f-d530-4366-8392-ad7a2689e1d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:48.940189 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dccbd4f-d530-4366-8392-ad7a2689e1d2 admin admin] PATH_INFO: `/v3/users/de046398833b4fd5a560e521a19f9598` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:48.942230 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dccbd4f-d530-4366-8392-ad7a2689e1d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de046398833b4fd5a560e521a19f9598)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:48.944381 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dccbd4f-d530-4366-8392-ad7a2689e1d2 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:48.950067 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 959/1901] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:13:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:13:48.951761 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fe881b-ded5-4120-a0d3-de744359db75 service neutron] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:48.953801 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-c9fe881b-ded5-4120-a0d3-de744359db75 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:48.969295 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fe881b-ded5-4120-a0d3-de744359db75 service neutron] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:48.975542 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0953bce4-1e62-405f-b01c-d8a1052c537b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:48.977732 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0953bce4-1e62-405f-b01c-d8a1052c537b service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:48.978850 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0953bce4-1e62-405f-b01c-d8a1052c537b service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:48.979518 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0953bce4-1e62-405f-b01c-d8a1052c537b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:49.009524 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0953bce4-1e62-405f-b01c-d8a1052c537b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:49.016028 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0953bce4-1e62-405f-b01c-d8a1052c537b service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:49.021589 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-7dccbd4f-d530-4366-8392-ad7a2689e1d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de046398833b4fd5a560e521a19f9598'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:49.036099 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-7dccbd4f-d530-4366-8392-ad7a2689e1d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de046398833b4fd5a560e521a19f9598'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:49.037203 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-7dccbd4f-d530-4366-8392-ad7a2689e1d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de046398833b4fd5a560e521a19f9598'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:49.039197 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 960/1902] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:13:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:13:49.054011 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-7dccbd4f-d530-4366-8392-ad7a2689e1d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de046398833b4fd5a560e521a19f9598'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:49.070559 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-7dccbd4f-d530-4366-8392-ad7a2689e1d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de046398833b4fd5a560e521a19f9598'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:49.083020 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 943/1903] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:13:48 2022] DELETE /identity/v3/users/de046398833b4fd5a560e521a19f9598 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:13:49.777469 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0953bce4-1e62-405f-b01c-d8a1052c537b service neutron] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:49.782704 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-0953bce4-1e62-405f-b01c-d8a1052c537b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:49.808937 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dccbd4f-d530-4366-8392-ad7a2689e1d2 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:49.810245 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0953bce4-1e62-405f-b01c-d8a1052c537b service neutron] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:49.811369 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-7dccbd4f-d530-4366-8392-ad7a2689e1d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:49.905773 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dccbd4f-d530-4366-8392-ad7a2689e1d2 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:49.912089 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a148ebb1-6f50-44fd-844c-dd69251b29dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:49.913578 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a148ebb1-6f50-44fd-844c-dd69251b29dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:49.913818 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a148ebb1-6f50-44fd-844c-dd69251b29dd admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:49.914128 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a148ebb1-6f50-44fd-844c-dd69251b29dd admin admin] PATH_INFO: `/v3/projects/8686e58d67f744ad9a7f6440bae8dce3` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:49.915600 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a148ebb1-6f50-44fd-844c-dd69251b29dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=8686e58d67f744ad9a7f6440bae8dce3)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:49.917668 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a148ebb1-6f50-44fd-844c-dd69251b29dd admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:49.955383 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693c08fe-c8df-4454-ba47-370b8f826ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:49.957154 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693c08fe-c8df-4454-ba47-370b8f826ee2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:49.957727 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693c08fe-c8df-4454-ba47-370b8f826ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:49.957887 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693c08fe-c8df-4454-ba47-370b8f826ee2 admin admin] PATH_INFO: `/v3/projects/7b7aebda5e1e49308c404624091e8511` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:49.960266 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693c08fe-c8df-4454-ba47-370b8f826ee2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b7aebda5e1e49308c404624091e8511)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:49.964188 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693c08fe-c8df-4454-ba47-370b8f826ee2 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:49.987719 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-a148ebb1-6f50-44fd-844c-dd69251b29dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8686e58d67f744ad9a7f6440bae8dce3', 'request_id': 'req-a148ebb1-6f50-44fd-844c-dd69251b29dd'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:50.003700 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-a148ebb1-6f50-44fd-844c-dd69251b29dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8686e58d67f744ad9a7f6440bae8dce3', 'request_id': 'req-a148ebb1-6f50-44fd-844c-dd69251b29dd'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:50.015226 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-a148ebb1-6f50-44fd-844c-dd69251b29dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8686e58d67f744ad9a7f6440bae8dce3', 'request_id': 'req-a148ebb1-6f50-44fd-844c-dd69251b29dd'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:50.043781 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-693c08fe-c8df-4454-ba47-370b8f826ee2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b7aebda5e1e49308c404624091e8511', 'request_id': 'req-693c08fe-c8df-4454-ba47-370b8f826ee2'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:50.044806 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-a148ebb1-6f50-44fd-844c-dd69251b29dd admin admin] The token cache is being invalidate because project 8686e58d67f744ad9a7f6440bae8dce3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:13:50.045799 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-a148ebb1-6f50-44fd-844c-dd69251b29dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:50.046786 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-a148ebb1-6f50-44fd-844c-dd69251b29dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:50.050266 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 944/1904] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:13:49 2022] DELETE /identity/v3/projects/8686e58d67f744ad9a7f6440bae8dce3 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:13:50.055994 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600d7316-da70-4d91-940f-add9d7365f61 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:50.056622 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600d7316-da70-4d91-940f-add9d7365f61 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:50.057081 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600d7316-da70-4d91-940f-add9d7365f61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:50.063007 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-693c08fe-c8df-4454-ba47-370b8f826ee2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b7aebda5e1e49308c404624091e8511', 'request_id': 'req-693c08fe-c8df-4454-ba47-370b8f826ee2'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:50.067032 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:13:50.075906 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-693c08fe-c8df-4454-ba47-370b8f826ee2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b7aebda5e1e49308c404624091e8511', 'request_id': 'req-693c08fe-c8df-4454-ba47-370b8f826ee2'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:50.095377 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-600d7316-da70-4d91-940f-add9d7365f61 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:13:50.098520 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-600d7316-da70-4d91-940f-add9d7365f61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:50.104950 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-693c08fe-c8df-4454-ba47-370b8f826ee2 admin admin] The token cache is being invalidate because project 7b7aebda5e1e49308c404624091e8511 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:13:50.105964 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-693c08fe-c8df-4454-ba47-370b8f826ee2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:50.107529 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-693c08fe-c8df-4454-ba47-370b8f826ee2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:50.117834 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 961/1905] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:13:49 2022] DELETE /identity/v3/projects/7b7aebda5e1e49308c404624091e8511 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:13:50.119294 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693c08fe-c8df-4454-ba47-370b8f826ee2 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:50.120756 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-693c08fe-c8df-4454-ba47-370b8f826ee2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:50.197816 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 945/1906] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:13:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:13:50.200714 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7274339d-4aad-479a-bd58-e35895134800 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:50.201179 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7274339d-4aad-479a-bd58-e35895134800 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:50.201610 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7274339d-4aad-479a-bd58-e35895134800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:50.226749 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693c08fe-c8df-4454-ba47-370b8f826ee2 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:50.235743 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-7274339d-4aad-479a-bd58-e35895134800 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:13:50.236611 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce8d7a4-647a-47d0-ac94-22ac276d1d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:50.238306 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-7274339d-4aad-479a-bd58-e35895134800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:50.238854 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce8d7a4-647a-47d0-ac94-22ac276d1d6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:50.239300 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce8d7a4-647a-47d0-ac94-22ac276d1d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:50.239750 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce8d7a4-647a-47d0-ac94-22ac276d1d6a admin admin] PATH_INFO: `/v3/users/caaadf823a394935b08d631d2f256b38` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:50.243780 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce8d7a4-647a-47d0-ac94-22ac276d1d6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=caaadf823a394935b08d631d2f256b38)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:50.249629 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce8d7a4-647a-47d0-ac94-22ac276d1d6a admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:50.263654 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 946/1907] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:13:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:13:50.264614 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:13:50.265630 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7274339d-4aad-479a-bd58-e35895134800 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:50.293109 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7274339d-4aad-479a-bd58-e35895134800 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:50.304469 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885576b7-f1a1-4ade-9971-df1a894875eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:50.317517 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885576b7-f1a1-4ade-9971-df1a894875eb admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:50.318563 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885576b7-f1a1-4ade-9971-df1a894875eb admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:50.319155 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885576b7-f1a1-4ade-9971-df1a894875eb admin admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:50.321028 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885576b7-f1a1-4ade-9971-df1a894875eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:13:50.321189 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885576b7-f1a1-4ade-9971-df1a894875eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:50.324327 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885576b7-f1a1-4ade-9971-df1a894875eb admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:50.358628 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 947/1908] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:13:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:13:50.369341 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885576b7-f1a1-4ade-9971-df1a894875eb admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:50.401832 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-8ce8d7a4-647a-47d0-ac94-22ac276d1d6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'caaadf823a394935b08d631d2f256b38'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:50.403019 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-8ce8d7a4-647a-47d0-ac94-22ac276d1d6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'caaadf823a394935b08d631d2f256b38'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:50.411412 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885576b7-f1a1-4ade-9971-df1a894875eb admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:50.414755 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-8ce8d7a4-647a-47d0-ac94-22ac276d1d6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'caaadf823a394935b08d631d2f256b38'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:50.419256 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59af622e-5243-4fcb-bb6e-40bb051cc53b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:50.420646 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59af622e-5243-4fcb-bb6e-40bb051cc53b admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:50.421233 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59af622e-5243-4fcb-bb6e-40bb051cc53b admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:50.421755 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59af622e-5243-4fcb-bb6e-40bb051cc53b admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:50.425962 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59af622e-5243-4fcb-bb6e-40bb051cc53b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:50.426853 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59af622e-5243-4fcb-bb6e-40bb051cc53b admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:50.433925 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-8ce8d7a4-647a-47d0-ac94-22ac276d1d6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'caaadf823a394935b08d631d2f256b38'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:50.464942 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-8ce8d7a4-647a-47d0-ac94-22ac276d1d6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'caaadf823a394935b08d631d2f256b38'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:50.472972 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 962/1909] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:13:50 2022] DELETE /identity/v3/users/caaadf823a394935b08d631d2f256b38 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:13:50.473967 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 948/1910] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:13:50 2022] POST /identity/v3/projects => generated 381 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:13:50.478309 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce8d7a4-647a-47d0-ac94-22ac276d1d6a admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:50.479985 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-8ce8d7a4-647a-47d0-ac94-22ac276d1d6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:50.500695 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59af622e-5243-4fcb-bb6e-40bb051cc53b admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:50.503711 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-59af622e-5243-4fcb-bb6e-40bb051cc53b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:50.642132 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce8d7a4-647a-47d0-ac94-22ac276d1d6a admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:50.705700 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59af622e-5243-4fcb-bb6e-40bb051cc53b admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:50.712679 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad7aa02-de6a-4f0a-985e-a811d674ed8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:50.713667 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad7aa02-de6a-4f0a-985e-a811d674ed8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:50.713972 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad7aa02-de6a-4f0a-985e-a811d674ed8a admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:50.714445 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad7aa02-de6a-4f0a-985e-a811d674ed8a admin admin] PATH_INFO: `/v3/projects/4414c384045242c88443bfb6abc0b976` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:50.717971 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad7aa02-de6a-4f0a-985e-a811d674ed8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4414c384045242c88443bfb6abc0b976)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:50.718201 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad7aa02-de6a-4f0a-985e-a811d674ed8a admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:50.777303 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58fb317-0654-4ad5-9407-b678a72c43af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:50.778330 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58fb317-0654-4ad5-9407-b678a72c43af admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:50.778997 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58fb317-0654-4ad5-9407-b678a72c43af admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:50.778997 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58fb317-0654-4ad5-9407-b678a72c43af admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:50.780012 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58fb317-0654-4ad5-9407-b678a72c43af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:50.782508 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58fb317-0654-4ad5-9407-b678a72c43af admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:50.830527 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 963/1911] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:13:50 2022] POST /identity/v3/users => generated 291 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:13:50.836228 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58fb317-0654-4ad5-9407-b678a72c43af admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:50.843485 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-cad7aa02-de6a-4f0a-985e-a811d674ed8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4414c384045242c88443bfb6abc0b976', 'request_id': 'req-cad7aa02-de6a-4f0a-985e-a811d674ed8a'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:50.855397 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-cad7aa02-de6a-4f0a-985e-a811d674ed8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4414c384045242c88443bfb6abc0b976', 'request_id': 'req-cad7aa02-de6a-4f0a-985e-a811d674ed8a'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:50.861724 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58fb317-0654-4ad5-9407-b678a72c43af admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:50.871371 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:13:50.873352 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-cad7aa02-de6a-4f0a-985e-a811d674ed8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4414c384045242c88443bfb6abc0b976', 'request_id': 'req-cad7aa02-de6a-4f0a-985e-a811d674ed8a'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:50.899345 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:13:50.901991 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-cad7aa02-de6a-4f0a-985e-a811d674ed8a admin admin] The token cache is being invalidate because project 4414c384045242c88443bfb6abc0b976 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:13:50.902391 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-cad7aa02-de6a-4f0a-985e-a811d674ed8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:50.906889 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-cad7aa02-de6a-4f0a-985e-a811d674ed8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:50.909171 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 949/1912] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:13:50 2022] DELETE /identity/v3/projects/4414c384045242c88443bfb6abc0b976 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:13:50.913451 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad7aa02-de6a-4f0a-985e-a811d674ed8a admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:50.915987 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-cad7aa02-de6a-4f0a-985e-a811d674ed8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:50.958259 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d00620-6dc0-4aa4-9483-6a9d00272975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:50.959053 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d00620-6dc0-4aa4-9483-6a9d00272975 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:50.959640 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d00620-6dc0-4aa4-9483-6a9d00272975 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:50.960071 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d00620-6dc0-4aa4-9483-6a9d00272975 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:50.961118 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d00620-6dc0-4aa4-9483-6a9d00272975 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:50.963144 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d00620-6dc0-4aa4-9483-6a9d00272975 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:50.975102 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 964/1913] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:13:50 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:13:50.979461 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d00620-6dc0-4aa4-9483-6a9d00272975 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:50.981273 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-47d00620-6dc0-4aa4-9483-6a9d00272975 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:50.997097 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d00620-6dc0-4aa4-9483-6a9d00272975 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:51.004001 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3f5060-3d9a-41c4-90e5-592d87ce2950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:51.005153 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3f5060-3d9a-41c4-90e5-592d87ce2950 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:51.005516 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3f5060-3d9a-41c4-90e5-592d87ce2950 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:51.005877 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3f5060-3d9a-41c4-90e5-592d87ce2950 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:51.006819 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3f5060-3d9a-41c4-90e5-592d87ce2950 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:51.009225 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3f5060-3d9a-41c4-90e5-592d87ce2950 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:51.038198 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 965/1914] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:13:50 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:13:51.038345 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad7aa02-de6a-4f0a-985e-a811d674ed8a admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:51.039394 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3f5060-3d9a-41c4-90e5-592d87ce2950 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:51.045303 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257a5bab-f396-4473-a6eb-3e121ab729df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:51.046414 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257a5bab-f396-4473-a6eb-3e121ab729df admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:51.046704 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257a5bab-f396-4473-a6eb-3e121ab729df admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:51.046980 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257a5bab-f396-4473-a6eb-3e121ab729df admin admin] PATH_INFO: `/v3/users/cf46071658894cf5b4da6bc3e2c6ec09` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:51.048641 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257a5bab-f396-4473-a6eb-3e121ab729df admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf46071658894cf5b4da6bc3e2c6ec09)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:51.050427 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257a5bab-f396-4473-a6eb-3e121ab729df admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:51.053761 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3f5060-3d9a-41c4-90e5-592d87ce2950 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:51.061684 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ac58fa-8526-4fd8-8f67-a61aafd9e8f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:51.062872 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ac58fa-8526-4fd8-8f67-a61aafd9e8f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:51.063351 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ac58fa-8526-4fd8-8f67-a61aafd9e8f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:51.064732 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ac58fa-8526-4fd8-8f67-a61aafd9e8f1 admin admin] PATH_INFO: `/v3/projects/995b3350672d45e6bf4a3669edff1ff2/users/99674846731e4900981ffeb4ef98db20/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:51.104570 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ac58fa-8526-4fd8-8f67-a61aafd9e8f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=995b3350672d45e6bf4a3669edff1ff2, user_id=99674846731e4900981ffeb4ef98db20, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:51.108856 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ac58fa-8526-4fd8-8f67-a61aafd9e8f1 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:51.119536 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-257a5bab-f396-4473-a6eb-3e121ab729df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf46071658894cf5b4da6bc3e2c6ec09'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:51.128830 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-257a5bab-f396-4473-a6eb-3e121ab729df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf46071658894cf5b4da6bc3e2c6ec09'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:51.129828 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-257a5bab-f396-4473-a6eb-3e121ab729df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf46071658894cf5b4da6bc3e2c6ec09'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:51.134513 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 966/1915] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:13:51 2022] PUT /identity/v3/projects/995b3350672d45e6bf4a3669edff1ff2/users/99674846731e4900981ffeb4ef98db20/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:13:51.134740 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ac58fa-8526-4fd8-8f67-a61aafd9e8f1 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:51.137349 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-e6ac58fa-8526-4fd8-8f67-a61aafd9e8f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:51.151324 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-257a5bab-f396-4473-a6eb-3e121ab729df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf46071658894cf5b4da6bc3e2c6ec09'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:51.179135 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-257a5bab-f396-4473-a6eb-3e121ab729df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf46071658894cf5b4da6bc3e2c6ec09'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:51.194616 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 950/1916] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:13:50 2022] DELETE /identity/v3/users/cf46071658894cf5b4da6bc3e2c6ec09 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:13:51.206351 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9d4e02-b391-493c-b795-63fa92e067c9 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:51.206744 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9d4e02-b391-493c-b795-63fa92e067c9 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:51.206992 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9d4e02-b391-493c-b795-63fa92e067c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:51.254252 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ac58fa-8526-4fd8-8f67-a61aafd9e8f1 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:51.266726 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-cf9d4e02-b391-493c-b795-63fa92e067c9 None None] MFA Rules not processed for user `99674846731e4900981ffeb4ef98db20`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:13:51.268495 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-cf9d4e02-b391-493c-b795-63fa92e067c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:51.372556 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:13:51.380980 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043d5df9-f97e-4f0b-8bb9-23dbd712968e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:51.381556 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043d5df9-f97e-4f0b-8bb9-23dbd712968e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:51.381846 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043d5df9-f97e-4f0b-8bb9-23dbd712968e admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:51.382151 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043d5df9-f97e-4f0b-8bb9-23dbd712968e admin admin] PATH_INFO: `/v3/projects/74db98fae0c044b19ae2bc4f74bcd38d` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:51.383478 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043d5df9-f97e-4f0b-8bb9-23dbd712968e admin admin] RBAC: Authorizing `identity:delete_project(project_id=74db98fae0c044b19ae2bc4f74bcd38d)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:51.383900 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 951/1917] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:13:51 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:13:51.385347 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043d5df9-f97e-4f0b-8bb9-23dbd712968e admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:51.395228 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9d4e02-b391-493c-b795-63fa92e067c9 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:51.399179 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-cf9d4e02-b391-493c-b795-63fa92e067c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:51.431102 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9d4e02-b391-493c-b795-63fa92e067c9 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:51.447034 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c05d7c-ff7f-451b-a0c4-a80cd997a7bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:51.447842 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c05d7c-ff7f-451b-a0c4-a80cd997a7bf admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:51.448024 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c05d7c-ff7f-451b-a0c4-a80cd997a7bf admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:51.448640 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c05d7c-ff7f-451b-a0c4-a80cd997a7bf admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:51.449091 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c05d7c-ff7f-451b-a0c4-a80cd997a7bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:51.451167 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c05d7c-ff7f-451b-a0c4-a80cd997a7bf admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:51.453958 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:13:51.473094 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-043d5df9-f97e-4f0b-8bb9-23dbd712968e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74db98fae0c044b19ae2bc4f74bcd38d', 'request_id': 'req-043d5df9-f97e-4f0b-8bb9-23dbd712968e'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:51.504505 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-043d5df9-f97e-4f0b-8bb9-23dbd712968e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74db98fae0c044b19ae2bc4f74bcd38d', 'request_id': 'req-043d5df9-f97e-4f0b-8bb9-23dbd712968e'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:51.507903 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 952/1918] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:13:51 2022] POST /identity/v3/projects => generated 381 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:13:51.508685 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c05d7c-ff7f-451b-a0c4-a80cd997a7bf admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:51.515165 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-043d5df9-f97e-4f0b-8bb9-23dbd712968e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74db98fae0c044b19ae2bc4f74bcd38d', 'request_id': 'req-043d5df9-f97e-4f0b-8bb9-23dbd712968e'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:51.532124 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-043d5df9-f97e-4f0b-8bb9-23dbd712968e admin admin] The token cache is being invalidate because project 74db98fae0c044b19ae2bc4f74bcd38d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:13:51.533384 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-043d5df9-f97e-4f0b-8bb9-23dbd712968e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:51.534495 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-043d5df9-f97e-4f0b-8bb9-23dbd712968e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:51.536362 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 967/1919] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:13:51 2022] DELETE /identity/v3/projects/74db98fae0c044b19ae2bc4f74bcd38d => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:13:51.544530 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964f3f27-a02b-4b85-8a22-e88282ed4c93 None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:51.544751 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964f3f27-a02b-4b85-8a22-e88282ed4c93 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:51.545048 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964f3f27-a02b-4b85-8a22-e88282ed4c93 None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:51.546968 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 968/1920] 10.222.0.17 () {54 vars in 921 bytes} [Sat Jul 23 21:13:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:13:51.548530 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1327e4-71bb-46ee-8161-5cba0008783b None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:51.548886 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1327e4-71bb-46ee-8161-5cba0008783b None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:51.549166 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1327e4-71bb-46ee-8161-5cba0008783b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:51.588744 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-1b1327e4-71bb-46ee-8161-5cba0008783b None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:13:51.592067 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-1b1327e4-71bb-46ee-8161-5cba0008783b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:51.615334 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 969/1921] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:13:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:13:51.616941 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1117ca1-05a6-4b68-8a5a-fcd2ece3cea8 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:51.617239 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1117ca1-05a6-4b68-8a5a-fcd2ece3cea8 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:51.617517 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1117ca1-05a6-4b68-8a5a-fcd2ece3cea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:51.630945 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c05d7c-ff7f-451b-a0c4-a80cd997a7bf admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:51.648083 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-d1117ca1-05a6-4b68-8a5a-fcd2ece3cea8 None None] MFA Rules not processed for user `079f31ed2c844e67bd4e206f24b69d97`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:13:51.649598 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-d1117ca1-05a6-4b68-8a5a-fcd2ece3cea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:51.650473 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424b142f-93ae-4ad4-b3a7-eff8901e34dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:51.651176 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424b142f-93ae-4ad4-b3a7-eff8901e34dd admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:51.651450 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424b142f-93ae-4ad4-b3a7-eff8901e34dd admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:51.651720 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424b142f-93ae-4ad4-b3a7-eff8901e34dd admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:51.653952 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424b142f-93ae-4ad4-b3a7-eff8901e34dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:51.656269 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424b142f-93ae-4ad4-b3a7-eff8901e34dd admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:51.710599 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 953/1922] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:13:51 2022] POST /identity/v3/users => generated 297 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:13:51.720981 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0365a06-a1bf-41d0-9948-cb1598dca250 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:51.721294 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0365a06-a1bf-41d0-9948-cb1598dca250 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:51.721537 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0365a06-a1bf-41d0-9948-cb1598dca250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:51.767256 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-c0365a06-a1bf-41d0-9948-cb1598dca250 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:13:51.768956 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-c0365a06-a1bf-41d0-9948-cb1598dca250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:51.779328 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 954/1923] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:13:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:13:51.780191 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0365a06-a1bf-41d0-9948-cb1598dca250 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:51.784465 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-c0365a06-a1bf-41d0-9948-cb1598dca250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:51.799674 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0365a06-a1bf-41d0-9948-cb1598dca250 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:51.802557 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 970/1924] 10.222.0.17 () {58 vars in 1018 bytes} [Sat Jul 23 21:13:51 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:13:51.803427 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1117ca1-05a6-4b68-8a5a-fcd2ece3cea8 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:51.806242 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ff4820-625d-45be-90dc-5985971bc751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:51.807518 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ff4820-625d-45be-90dc-5985971bc751 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:51.808246 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ff4820-625d-45be-90dc-5985971bc751 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:51.809037 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-d1117ca1-05a6-4b68-8a5a-fcd2ece3cea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:51.827303 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ff4820-625d-45be-90dc-5985971bc751 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:51.827457 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1117ca1-05a6-4b68-8a5a-fcd2ece3cea8 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:51.829021 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ff4820-625d-45be-90dc-5985971bc751 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:51.833034 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ff4820-625d-45be-90dc-5985971bc751 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:51.834374 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7698331a-8705-4cc7-82b6-ecee8e67e636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:51.835468 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7698331a-8705-4cc7-82b6-ecee8e67e636 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:51.835757 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7698331a-8705-4cc7-82b6-ecee8e67e636 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:51.836030 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7698331a-8705-4cc7-82b6-ecee8e67e636 admin admin] PATH_INFO: `/v3/projects/1dded48a02c542db93950a1593eeaaf1` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:51.837854 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7698331a-8705-4cc7-82b6-ecee8e67e636 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1dded48a02c542db93950a1593eeaaf1)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:51.840641 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7698331a-8705-4cc7-82b6-ecee8e67e636 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:51.850831 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 955/1925] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:13:51 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:13:51.853011 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ff4820-625d-45be-90dc-5985971bc751 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:51.867030 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ff4820-625d-45be-90dc-5985971bc751 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:51.873271 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3267863e-a69f-419e-b0b4-6344274447d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:51.874066 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3267863e-a69f-419e-b0b4-6344274447d4 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:51.874352 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3267863e-a69f-419e-b0b4-6344274447d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:51.874673 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3267863e-a69f-419e-b0b4-6344274447d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:51.875823 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3267863e-a69f-419e-b0b4-6344274447d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:13:51.876388 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3267863e-a69f-419e-b0b4-6344274447d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:51.877934 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3267863e-a69f-419e-b0b4-6344274447d4 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:51.908082 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 956/1926] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:13:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:13:51.908082 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3267863e-a69f-419e-b0b4-6344274447d4 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:51.911222 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-3267863e-a69f-419e-b0b4-6344274447d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:51.932766 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-7698331a-8705-4cc7-82b6-ecee8e67e636 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1dded48a02c542db93950a1593eeaaf1', 'request_id': 'req-7698331a-8705-4cc7-82b6-ecee8e67e636'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:51.933448 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3267863e-a69f-419e-b0b4-6344274447d4 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:51.945129 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-7698331a-8705-4cc7-82b6-ecee8e67e636 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1dded48a02c542db93950a1593eeaaf1', 'request_id': 'req-7698331a-8705-4cc7-82b6-ecee8e67e636'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:51.958251 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-7698331a-8705-4cc7-82b6-ecee8e67e636 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1dded48a02c542db93950a1593eeaaf1', 'request_id': 'req-7698331a-8705-4cc7-82b6-ecee8e67e636'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:51.985007 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-7698331a-8705-4cc7-82b6-ecee8e67e636 admin admin] The token cache is being invalidate because project 1dded48a02c542db93950a1593eeaaf1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:13:51.986533 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-7698331a-8705-4cc7-82b6-ecee8e67e636 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:51.987242 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-7698331a-8705-4cc7-82b6-ecee8e67e636 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:51.990114 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 971/1927] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:13:51 2022] DELETE /identity/v3/projects/1dded48a02c542db93950a1593eeaaf1 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:13:51.990938 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7698331a-8705-4cc7-82b6-ecee8e67e636 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:51.994370 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-7698331a-8705-4cc7-82b6-ecee8e67e636 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:52.026736 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473ba0fc-8bbf-496d-a093-4a867de79720 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:52.027672 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473ba0fc-8bbf-496d-a093-4a867de79720 service nova] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:52.028027 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473ba0fc-8bbf-496d-a093-4a867de79720 service nova] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:52.028387 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473ba0fc-8bbf-496d-a093-4a867de79720 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:52.030710 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-473ba0fc-8bbf-496d-a093-4a867de79720 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:52.046342 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473ba0fc-8bbf-496d-a093-4a867de79720 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:52.046873 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:13:52.049352 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473ba0fc-8bbf-496d-a093-4a867de79720 service nova] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:52.066697 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 957/1928] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:13:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:13:52.068951 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473ba0fc-8bbf-496d-a093-4a867de79720 service nova] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:52.071015 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-473ba0fc-8bbf-496d-a093-4a867de79720 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:52.099113 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7698331a-8705-4cc7-82b6-ecee8e67e636 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:52.109670 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:13:52.118883 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcb0da3-2700-4453-88c9-a687c228b839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:52.120112 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcb0da3-2700-4453-88c9-a687c228b839 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:52.120399 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcb0da3-2700-4453-88c9-a687c228b839 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:52.120680 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcb0da3-2700-4453-88c9-a687c228b839 admin admin] PATH_INFO: `/v3/projects/d051059b88ef495282ee67aefa1ad57f/users/d2680adfe5534be284c24994505fe250/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:52.146185 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcb0da3-2700-4453-88c9-a687c228b839 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d051059b88ef495282ee67aefa1ad57f, user_id=d2680adfe5534be284c24994505fe250, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:52.149773 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcb0da3-2700-4453-88c9-a687c228b839 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:52.181671 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 972/1929] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:13:51 2022] PUT /identity/v3/projects/d051059b88ef495282ee67aefa1ad57f/users/d2680adfe5534be284c24994505fe250/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:13:52.184324 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77525664-e4a2-4901-9472-a878a808ed70 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:52.184745 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77525664-e4a2-4901-9472-a878a808ed70 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:52.184910 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77525664-e4a2-4901-9472-a878a808ed70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:52.218557 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473ba0fc-8bbf-496d-a093-4a867de79720 service nova] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:52.231113 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-77525664-e4a2-4901-9472-a878a808ed70 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:13:52.237098 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-77525664-e4a2-4901-9472-a878a808ed70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:52.358837 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67defc9e-4bfb-4ac9-a577-de24ce23efcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:52.359924 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67defc9e-4bfb-4ac9-a577-de24ce23efcb admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:52.360293 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67defc9e-4bfb-4ac9-a577-de24ce23efcb admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:52.360618 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67defc9e-4bfb-4ac9-a577-de24ce23efcb admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:52.362476 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67defc9e-4bfb-4ac9-a577-de24ce23efcb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:52.365571 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67defc9e-4bfb-4ac9-a577-de24ce23efcb admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:52.373152 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 973/1930] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:13:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:13:52.374217 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77525664-e4a2-4901-9472-a878a808ed70 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:52.401113 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77525664-e4a2-4901-9472-a878a808ed70 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:52.411949 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42276f04-d7f1-47d7-a4ea-87a6bbabe8a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:52.413335 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42276f04-d7f1-47d7-a4ea-87a6bbabe8a1 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:52.413679 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42276f04-d7f1-47d7-a4ea-87a6bbabe8a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:52.414081 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42276f04-d7f1-47d7-a4ea-87a6bbabe8a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:52.414899 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42276f04-d7f1-47d7-a4ea-87a6bbabe8a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:52.416284 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 958/1931] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:13:52 2022] POST /identity/v3/projects => generated 393 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:13:52.418106 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7a7499-a44f-4a25-a0bc-c0ab98439f4e None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:52.418438 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7a7499-a44f-4a25-a0bc-c0ab98439f4e None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:52.418758 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7a7499-a44f-4a25-a0bc-c0ab98439f4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:52.420132 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42276f04-d7f1-47d7-a4ea-87a6bbabe8a1 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:52.438649 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 974/1932] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:13:52 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:13:52.438649 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42276f04-d7f1-47d7-a4ea-87a6bbabe8a1 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:52.448242 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-7a7a7499-a44f-4a25-a0bc-c0ab98439f4e None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:13:52.448824 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42276f04-d7f1-47d7-a4ea-87a6bbabe8a1 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:52.449616 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-7a7a7499-a44f-4a25-a0bc-c0ab98439f4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:52.543570 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e8306e-5c4c-4135-9c20-ab5fab8ec693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:52.544613 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e8306e-5c4c-4135-9c20-ab5fab8ec693 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:52.545078 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e8306e-5c4c-4135-9c20-ab5fab8ec693 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:52.545563 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e8306e-5c4c-4135-9c20-ab5fab8ec693 admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:52.546477 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e8306e-5c4c-4135-9c20-ab5fab8ec693 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:52.548711 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e8306e-5c4c-4135-9c20-ab5fab8ec693 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:52.556562 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 959/1933] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:13:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:13:52.557833 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7a7499-a44f-4a25-a0bc-c0ab98439f4e None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:52.574147 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7a7499-a44f-4a25-a0bc-c0ab98439f4e None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:52.580528 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 975/1934] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:13:52 2022] POST /identity/v3/users => generated 297 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:13:52.581065 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b4fbd3-db93-4f5e-8e22-de0fe2ff04e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:52.582261 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b4fbd3-db93-4f5e-8e22-de0fe2ff04e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:52.582601 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b4fbd3-db93-4f5e-8e22-de0fe2ff04e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:52.582938 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b4fbd3-db93-4f5e-8e22-de0fe2ff04e8 admin admin] PATH_INFO: `/v3/projects/d051059b88ef495282ee67aefa1ad57f/users/d2680adfe5534be284c24994505fe250/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:52.583142 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e8306e-5c4c-4135-9c20-ab5fab8ec693 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:52.585603 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b4fbd3-db93-4f5e-8e22-de0fe2ff04e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d051059b88ef495282ee67aefa1ad57f, user_id=d2680adfe5534be284c24994505fe250, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:52.594426 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b4fbd3-db93-4f5e-8e22-de0fe2ff04e8 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:52.595171 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e8306e-5c4c-4135-9c20-ab5fab8ec693 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:52.608164 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1685072-5ac0-4103-bdf2-e972a434a9c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:52.608917 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1685072-5ac0-4103-bdf2-e972a434a9c4 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:52.609417 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1685072-5ac0-4103-bdf2-e972a434a9c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:52.609703 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1685072-5ac0-4103-bdf2-e972a434a9c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:52.609975 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 960/1935] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:13:52 2022] PUT /identity/v3/projects/d051059b88ef495282ee67aefa1ad57f/users/d2680adfe5534be284c24994505fe250/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:13:52.610911 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1685072-5ac0-4103-bdf2-e972a434a9c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:13:52.611111 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b4fbd3-db93-4f5e-8e22-de0fe2ff04e8 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:52.611340 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1685072-5ac0-4103-bdf2-e972a434a9c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:52.613255 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1685072-5ac0-4103-bdf2-e972a434a9c4 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:52.653448 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 976/1936] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:13:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:13:52.653448 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0a7ee2-755f-434b-ad68-167fee4a40f9 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:52.653448 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0a7ee2-755f-434b-ad68-167fee4a40f9 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:52.653448 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0a7ee2-755f-434b-ad68-167fee4a40f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:52.691856 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:13:52.693120 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-6b0a7ee2-755f-434b-ad68-167fee4a40f9 None None] MFA Rules not processed for user `d2680adfe5534be284c24994505fe250`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:13:52.694624 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-6b0a7ee2-755f-434b-ad68-167fee4a40f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:52.701809 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:13:52.727585 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b4fbd3-db93-4f5e-8e22-de0fe2ff04e8 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:52.743426 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf463cd3-801a-47ac-9ce3-1c17719528ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:52.744296 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf463cd3-801a-47ac-9ce3-1c17719528ed admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:52.744575 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf463cd3-801a-47ac-9ce3-1c17719528ed admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:52.744845 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf463cd3-801a-47ac-9ce3-1c17719528ed admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:52.746155 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf463cd3-801a-47ac-9ce3-1c17719528ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:52.748475 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf463cd3-801a-47ac-9ce3-1c17719528ed admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:52.765670 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 961/1937] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:13:52 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:13:52.765670 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf463cd3-801a-47ac-9ce3-1c17719528ed admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:52.776477 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf463cd3-801a-47ac-9ce3-1c17719528ed admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:52.781765 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed43bce-769e-4377-ad2c-00307277869a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:52.782538 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed43bce-769e-4377-ad2c-00307277869a admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:52.782814 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed43bce-769e-4377-ad2c-00307277869a admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:52.783078 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed43bce-769e-4377-ad2c-00307277869a admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:52.783776 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed43bce-769e-4377-ad2c-00307277869a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:52.785729 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed43bce-769e-4377-ad2c-00307277869a admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:52.819942 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 977/1938] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:13:52 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:13:52.820684 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0a7ee2-755f-434b-ad68-167fee4a40f9 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:52.845474 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 962/1939] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:13:52 2022] POST /identity/v3/projects => generated 383 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:13:52.847031 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0a7ee2-755f-434b-ad68-167fee4a40f9 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:52.847929 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed43bce-769e-4377-ad2c-00307277869a admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:52.850156 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-2ed43bce-769e-4377-ad2c-00307277869a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:52.951656 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e42a9d-6735-495e-8229-8dbe968d63fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:52.952357 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e42a9d-6735-495e-8229-8dbe968d63fd admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:52.952638 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e42a9d-6735-495e-8229-8dbe968d63fd admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:52.952914 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e42a9d-6735-495e-8229-8dbe968d63fd admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:52.953650 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e42a9d-6735-495e-8229-8dbe968d63fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:52.955600 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e42a9d-6735-495e-8229-8dbe968d63fd admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:52.968344 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 978/1940] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:13:52 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:13:52.969663 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e42a9d-6735-495e-8229-8dbe968d63fd admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:52.983297 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e42a9d-6735-495e-8229-8dbe968d63fd admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:52.988909 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361efe7d-bb90-41a2-bdcd-fbf97b0accc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:52.989528 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361efe7d-bb90-41a2-bdcd-fbf97b0accc4 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:52.989803 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361efe7d-bb90-41a2-bdcd-fbf97b0accc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:52.990225 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361efe7d-bb90-41a2-bdcd-fbf97b0accc4 admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:52.991142 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361efe7d-bb90-41a2-bdcd-fbf97b0accc4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:52.993280 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361efe7d-bb90-41a2-bdcd-fbf97b0accc4 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:52.996145 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed43bce-769e-4377-ad2c-00307277869a admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:53.010725 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b40e22-85b1-423a-8ffa-ffc76241e0e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:53.011869 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b40e22-85b1-423a-8ffa-ffc76241e0e6 service nova] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:53.013767 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b40e22-85b1-423a-8ffa-ffc76241e0e6 service nova] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:53.014891 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b40e22-85b1-423a-8ffa-ffc76241e0e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:53.026902 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 979/1941] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:13:52 2022] POST /identity/v3/users => generated 292 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:13:53.028163 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361efe7d-bb90-41a2-bdcd-fbf97b0accc4 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:53.048684 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361efe7d-bb90-41a2-bdcd-fbf97b0accc4 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:53.060743 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570fc7df-3641-4146-850e-32eaa5413ab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:53.063308 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570fc7df-3641-4146-850e-32eaa5413ab0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:53.063669 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570fc7df-3641-4146-850e-32eaa5413ab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:53.063945 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570fc7df-3641-4146-850e-32eaa5413ab0 admin admin] PATH_INFO: `/v3/projects/6cb727a3d6fd44c98106fec9068492af/users/ad8fc53dadf24e19979a9fbf4f192f20/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:53.102425 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570fc7df-3641-4146-850e-32eaa5413ab0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cb727a3d6fd44c98106fec9068492af, user_id=ad8fc53dadf24e19979a9fbf4f192f20, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:53.105527 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570fc7df-3641-4146-850e-32eaa5413ab0 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:53.145679 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 980/1942] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:13:53 2022] PUT /identity/v3/projects/6cb727a3d6fd44c98106fec9068492af/users/ad8fc53dadf24e19979a9fbf4f192f20/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:13:53.146669 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570fc7df-3641-4146-850e-32eaa5413ab0 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:53.172856 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b40e22-85b1-423a-8ffa-ffc76241e0e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:53.174550 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b40e22-85b1-423a-8ffa-ffc76241e0e6 service nova] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:53.201034 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 963/1943] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:13:52 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:13:53.202772 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f050fc-5065-44f3-b0b6-f1caf42b1efa None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:53.203171 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f050fc-5065-44f3-b0b6-f1caf42b1efa None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:53.203522 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f050fc-5065-44f3-b0b6-f1caf42b1efa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:53.243953 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-66f050fc-5065-44f3-b0b6-f1caf42b1efa None None] MFA Rules not processed for user `ad8fc53dadf24e19979a9fbf4f192f20`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:13:53.245307 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-66f050fc-5065-44f3-b0b6-f1caf42b1efa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:53.309190 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:13:53.315219 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570fc7df-3641-4146-850e-32eaa5413ab0 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:53.318903 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:13:53.333477 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc70d4db-4e9c-43f7-a605-3d42de163a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:53.335630 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc70d4db-4e9c-43f7-a605-3d42de163a24 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:53.336155 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc70d4db-4e9c-43f7-a605-3d42de163a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:53.336633 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc70d4db-4e9c-43f7-a605-3d42de163a24 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:53.337882 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc70d4db-4e9c-43f7-a605-3d42de163a24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:53.342478 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc70d4db-4e9c-43f7-a605-3d42de163a24 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:53.370124 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 981/1944] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:13:53 2022] GET /identity/v3/roles => generated 1420 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:13:53.373781 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc70d4db-4e9c-43f7-a605-3d42de163a24 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:53.389321 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc70d4db-4e9c-43f7-a605-3d42de163a24 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:53.389535 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 964/1945] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:13:53 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:13:53.390515 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f050fc-5065-44f3-b0b6-f1caf42b1efa None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:53.396078 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92672d5-e02b-4e12-90cf-647221131911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:53.397904 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92672d5-e02b-4e12-90cf-647221131911 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:53.398421 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92672d5-e02b-4e12-90cf-647221131911 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:53.399927 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92672d5-e02b-4e12-90cf-647221131911 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:53.402844 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92672d5-e02b-4e12-90cf-647221131911 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:53.412659 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92672d5-e02b-4e12-90cf-647221131911 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:53.417072 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f050fc-5065-44f3-b0b6-f1caf42b1efa None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:53.423997 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13663a4f-8d35-43eb-9562-9e5f538abea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:53.424846 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13663a4f-8d35-43eb-9562-9e5f538abea7 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:53.425141 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13663a4f-8d35-43eb-9562-9e5f538abea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:53.425419 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13663a4f-8d35-43eb-9562-9e5f538abea7 admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:53.426169 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13663a4f-8d35-43eb-9562-9e5f538abea7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:53.428729 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13663a4f-8d35-43eb-9562-9e5f538abea7 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:53.441757 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 982/1946] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:13:53 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:13:53.442821 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92672d5-e02b-4e12-90cf-647221131911 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:53.463307 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 965/1947] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:13:53 2022] POST /identity/v3/projects => generated 393 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:13:53.467271 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13663a4f-8d35-43eb-9562-9e5f538abea7 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:53.471417 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92672d5-e02b-4e12-90cf-647221131911 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:53.549348 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975766a1-f9c2-4f9f-9186-3a456954ab18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:53.551061 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975766a1-f9c2-4f9f-9186-3a456954ab18 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:53.551444 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975766a1-f9c2-4f9f-9186-3a456954ab18 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:53.552010 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975766a1-f9c2-4f9f-9186-3a456954ab18 admin admin] PATH_INFO: `/v3/projects/ba16f1a6764344a1b32d2b3bc85fdfe2/users/c02f293f8cb04a2197ceb22728e717cb/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:53.574391 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975766a1-f9c2-4f9f-9186-3a456954ab18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba16f1a6764344a1b32d2b3bc85fdfe2, user_id=c02f293f8cb04a2197ceb22728e717cb, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:53.578006 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975766a1-f9c2-4f9f-9186-3a456954ab18 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:53.614732 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 983/1948] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:13:53 2022] PUT /identity/v3/projects/ba16f1a6764344a1b32d2b3bc85fdfe2/users/c02f293f8cb04a2197ceb22728e717cb/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:13:53.628158 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76b1910-20e8-4e21-a833-93a69746db67 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:53.628498 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76b1910-20e8-4e21-a833-93a69746db67 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:53.628780 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76b1910-20e8-4e21-a833-93a69746db67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:53.634180 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13663a4f-8d35-43eb-9562-9e5f538abea7 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:53.688328 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-f76b1910-20e8-4e21-a833-93a69746db67 None None] MFA Rules not processed for user `c02f293f8cb04a2197ceb22728e717cb`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:13:53.689840 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-f76b1910-20e8-4e21-a833-93a69746db67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:53.728248 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734777d9-ccd5-4916-aead-57302c792c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:53.728861 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734777d9-ccd5-4916-aead-57302c792c2d admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:53.729808 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734777d9-ccd5-4916-aead-57302c792c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:53.730688 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734777d9-ccd5-4916-aead-57302c792c2d admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:53.732011 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734777d9-ccd5-4916-aead-57302c792c2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:53.734629 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734777d9-ccd5-4916-aead-57302c792c2d admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:53.774446 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 966/1949] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:13:53 2022] POST /identity/v3/users => generated 303 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:13:53.775448 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734777d9-ccd5-4916-aead-57302c792c2d admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:53.788292 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734777d9-ccd5-4916-aead-57302c792c2d admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:53.795912 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b40e693-edbc-48c8-97c1-63c88a80b974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:53.796605 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b40e693-edbc-48c8-97c1-63c88a80b974 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:53.796884 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b40e693-edbc-48c8-97c1-63c88a80b974 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:53.797156 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b40e693-edbc-48c8-97c1-63c88a80b974 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:53.798007 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b40e693-edbc-48c8-97c1-63c88a80b974 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:53.832988 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b40e693-edbc-48c8-97c1-63c88a80b974 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:53.841122 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 984/1950] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:13:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:13:53.845340 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76b1910-20e8-4e21-a833-93a69746db67 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:53.865838 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 967/1951] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:13:53 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:13:53.868848 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b40e693-edbc-48c8-97c1-63c88a80b974 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:53.870935 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76b1910-20e8-4e21-a833-93a69746db67 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:53.883155 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083cb20a-6b57-447f-ba9e-7ce531a1f4e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:53.885319 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083cb20a-6b57-447f-ba9e-7ce531a1f4e8 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:53.885598 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083cb20a-6b57-447f-ba9e-7ce531a1f4e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:53.886141 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083cb20a-6b57-447f-ba9e-7ce531a1f4e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:53.888515 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083cb20a-6b57-447f-ba9e-7ce531a1f4e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:53.890476 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083cb20a-6b57-447f-ba9e-7ce531a1f4e8 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:53.893426 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b40e693-edbc-48c8-97c1-63c88a80b974 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:53.902741 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9173e6-8440-43d0-9374-64a2bbf09df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:53.904291 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9173e6-8440-43d0-9374-64a2bbf09df6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:53.904611 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9173e6-8440-43d0-9374-64a2bbf09df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:53.904874 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9173e6-8440-43d0-9374-64a2bbf09df6 admin admin] PATH_INFO: `/v3/projects/0d1572d4b1494426b6e511a38fdd6c20/users/9958f76e32b64a9ab61f62e439a3b32a/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:53.942494 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9173e6-8440-43d0-9374-64a2bbf09df6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d1572d4b1494426b6e511a38fdd6c20, user_id=9958f76e32b64a9ab61f62e439a3b32a, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:53.948789 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9173e6-8440-43d0-9374-64a2bbf09df6 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:53.950815 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 985/1952] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:13:53 2022] POST /identity/v3/projects => generated 383 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:13:53.955328 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083cb20a-6b57-447f-ba9e-7ce531a1f4e8 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:53.982040 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 968/1953] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:13:53 2022] PUT /identity/v3/projects/0d1572d4b1494426b6e511a38fdd6c20/users/9958f76e32b64a9ab61f62e439a3b32a/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:13:53.984166 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9173e6-8440-43d0-9374-64a2bbf09df6 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:54.020921 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:13:54.042981 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:13:54.090217 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083cb20a-6b57-447f-ba9e-7ce531a1f4e8 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:54.094326 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9173e6-8440-43d0-9374-64a2bbf09df6 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:54.095703 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa11d4c0-c902-4f54-973c-f90b3b3af11a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:54.096483 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa11d4c0-c902-4f54-973c-f90b3b3af11a admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:54.096724 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa11d4c0-c902-4f54-973c-f90b3b3af11a admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:54.096995 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa11d4c0-c902-4f54-973c-f90b3b3af11a admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:54.097962 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa11d4c0-c902-4f54-973c-f90b3b3af11a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:54.100043 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa11d4c0-c902-4f54-973c-f90b3b3af11a admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:54.107361 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9736992-2ffa-495d-a92a-681d5b0acfdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:54.108205 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9736992-2ffa-495d-a92a-681d5b0acfdb admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:54.108498 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9736992-2ffa-495d-a92a-681d5b0acfdb admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:54.108816 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9736992-2ffa-495d-a92a-681d5b0acfdb admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:54.112434 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9736992-2ffa-495d-a92a-681d5b0acfdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:54.114134 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9736992-2ffa-495d-a92a-681d5b0acfdb admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:54.130143 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 969/1954] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:13:53 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:13:54.130143 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9736992-2ffa-495d-a92a-681d5b0acfdb admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:54.134258 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 986/1955] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:13:53 2022] POST /identity/v3/users => generated 298 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:13:54.135588 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa11d4c0-c902-4f54-973c-f90b3b3af11a admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:54.148365 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9736992-2ffa-495d-a92a-681d5b0acfdb admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:54.153342 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa11d4c0-c902-4f54-973c-f90b3b3af11a admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:54.155103 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674ae41c-78c4-4e48-9d94-2c85efc5bf9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:54.156442 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674ae41c-78c4-4e48-9d94-2c85efc5bf9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:54.156809 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674ae41c-78c4-4e48-9d94-2c85efc5bf9e admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:54.157303 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674ae41c-78c4-4e48-9d94-2c85efc5bf9e admin admin] PATH_INFO: `/v3/users/99674846731e4900981ffeb4ef98db20` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:54.159087 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674ae41c-78c4-4e48-9d94-2c85efc5bf9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=99674846731e4900981ffeb4ef98db20)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:54.160728 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fabe1b4-7a91-4208-bdde-2035c6530bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:54.161268 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674ae41c-78c4-4e48-9d94-2c85efc5bf9e admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:54.162016 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fabe1b4-7a91-4208-bdde-2035c6530bbd admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:54.162520 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fabe1b4-7a91-4208-bdde-2035c6530bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:54.162873 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fabe1b4-7a91-4208-bdde-2035c6530bbd admin admin] PATH_INFO: `/v3/projects/0d1572d4b1494426b6e511a38fdd6c20/users/9958f76e32b64a9ab61f62e439a3b32a/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:54.167316 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fabe1b4-7a91-4208-bdde-2035c6530bbd admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d1572d4b1494426b6e511a38fdd6c20, user_id=9958f76e32b64a9ab61f62e439a3b32a, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:54.173196 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fabe1b4-7a91-4208-bdde-2035c6530bbd admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:54.195581 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 987/1956] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:13:54 2022] PUT /identity/v3/projects/0d1572d4b1494426b6e511a38fdd6c20/users/9958f76e32b64a9ab61f62e439a3b32a/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:13:54.196697 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fabe1b4-7a91-4208-bdde-2035c6530bbd admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:54.252715 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-674ae41c-78c4-4e48-9d94-2c85efc5bf9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99674846731e4900981ffeb4ef98db20'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:54.262212 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-674ae41c-78c4-4e48-9d94-2c85efc5bf9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99674846731e4900981ffeb4ef98db20'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:54.263224 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-674ae41c-78c4-4e48-9d94-2c85efc5bf9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99674846731e4900981ffeb4ef98db20'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:54.276444 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-674ae41c-78c4-4e48-9d94-2c85efc5bf9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99674846731e4900981ffeb4ef98db20'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:54.288107 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fabe1b4-7a91-4208-bdde-2035c6530bbd admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:54.294474 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-674ae41c-78c4-4e48-9d94-2c85efc5bf9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99674846731e4900981ffeb4ef98db20'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:54.295155 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0807dacc-22f0-4c5e-9054-59bb731323b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:54.296446 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0807dacc-22f0-4c5e-9054-59bb731323b0 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:54.296790 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0807dacc-22f0-4c5e-9054-59bb731323b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:54.297358 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0807dacc-22f0-4c5e-9054-59bb731323b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:54.298728 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0807dacc-22f0-4c5e-9054-59bb731323b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:54.300544 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0807dacc-22f0-4c5e-9054-59bb731323b0 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:54.304300 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 970/1957] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:13:54 2022] DELETE /identity/v3/users/99674846731e4900981ffeb4ef98db20 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:13:54.306371 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822aae9d-b526-496b-aff8-f620fcf74849 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:54.306771 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822aae9d-b526-496b-aff8-f620fcf74849 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:54.307752 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822aae9d-b526-496b-aff8-f620fcf74849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:54.315628 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 988/1958] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:13:54 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:13:54.317349 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f182ffe7-cef9-4b1c-ae93-2da464bfb89c None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:54.318235 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f182ffe7-cef9-4b1c-ae93-2da464bfb89c None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:54.318722 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f182ffe7-cef9-4b1c-ae93-2da464bfb89c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:54.346434 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-f182ffe7-cef9-4b1c-ae93-2da464bfb89c None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:13:54.347921 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-f182ffe7-cef9-4b1c-ae93-2da464bfb89c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:54.349650 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-822aae9d-b526-496b-aff8-f620fcf74849 None None] MFA Rules not processed for user `9958f76e32b64a9ab61f62e439a3b32a`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:13:54.351287 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-822aae9d-b526-496b-aff8-f620fcf74849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:54.486251 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 989/1959] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:13:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:13:54.487365 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f182ffe7-cef9-4b1c-ae93-2da464bfb89c None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:54.489147 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-f182ffe7-cef9-4b1c-ae93-2da464bfb89c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:54.508034 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f182ffe7-cef9-4b1c-ae93-2da464bfb89c None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:54.514485 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0a284f-e825-43ac-9644-f6ac141aaafe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:54.516544 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0a284f-e825-43ac-9644-f6ac141aaafe admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:54.517095 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0a284f-e825-43ac-9644-f6ac141aaafe admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:54.517761 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0a284f-e825-43ac-9644-f6ac141aaafe admin admin] PATH_INFO: `/v3/projects/b9f7ef99f3f84b94985953c9fdcfad55/users/9dc73638091a4299843b9a8c03be6c28/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:54.542402 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 971/1960] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:13:54 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:13:54.543659 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822aae9d-b526-496b-aff8-f620fcf74849 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:54.549771 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0a284f-e825-43ac-9644-f6ac141aaafe admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9f7ef99f3f84b94985953c9fdcfad55, user_id=9dc73638091a4299843b9a8c03be6c28, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:54.552891 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0a284f-e825-43ac-9644-f6ac141aaafe admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:54.555827 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-822aae9d-b526-496b-aff8-f620fcf74849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:54.575879 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 990/1961] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:13:54 2022] PUT /identity/v3/projects/b9f7ef99f3f84b94985953c9fdcfad55/users/9dc73638091a4299843b9a8c03be6c28/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:13:54.577620 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0a284f-e825-43ac-9644-f6ac141aaafe admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:54.579929 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-ee0a284f-e825-43ac-9644-f6ac141aaafe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:54.580866 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:13:54.640864 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:13:54.665716 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822aae9d-b526-496b-aff8-f620fcf74849 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:54.730105 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0a284f-e825-43ac-9644-f6ac141aaafe admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:54.748842 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eed27f5-9ef8-48c3-a32e-6017acca975b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:54.751646 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eed27f5-9ef8-48c3-a32e-6017acca975b service nova] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:54.754088 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eed27f5-9ef8-48c3-a32e-6017acca975b service nova] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:54.754785 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eed27f5-9ef8-48c3-a32e-6017acca975b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:54.769533 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6866abd8-2a69-40d8-a381-5c9a4d8236e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:54.770835 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6866abd8-2a69-40d8-a381-5c9a4d8236e0 service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:54.771453 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6866abd8-2a69-40d8-a381-5c9a4d8236e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:54.772154 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6866abd8-2a69-40d8-a381-5c9a4d8236e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:54.897025 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6866abd8-2a69-40d8-a381-5c9a4d8236e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:54.898563 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6866abd8-2a69-40d8-a381-5c9a4d8236e0 service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:54.901107 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eed27f5-9ef8-48c3-a32e-6017acca975b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:54.903007 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eed27f5-9ef8-48c3-a32e-6017acca975b service nova] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:54.918942 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 991/1962] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:13:54 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:13:54.920100 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eed27f5-9ef8-48c3-a32e-6017acca975b service nova] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:54.927192 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 972/1963] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:13:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:13:54.934074 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eed27f5-9ef8-48c3-a32e-6017acca975b service nova] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:54.941349 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a682eb45-f065-46ed-9306-2cc2b4c71c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:54.942809 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a682eb45-f065-46ed-9306-2cc2b4c71c44 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:54.943274 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a682eb45-f065-46ed-9306-2cc2b4c71c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:54.943753 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a682eb45-f065-46ed-9306-2cc2b4c71c44 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:54.944695 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a682eb45-f065-46ed-9306-2cc2b4c71c44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:54.946634 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a682eb45-f065-46ed-9306-2cc2b4c71c44 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:54.961284 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 992/1964] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:13:54 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:13:54.967841 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6866abd8-2a69-40d8-a381-5c9a4d8236e0 service neutron] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:54.979520 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6866abd8-2a69-40d8-a381-5c9a4d8236e0 service neutron] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:54.986840 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fda5baa-1624-40d5-b899-a0912f9cac4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:54.988253 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fda5baa-1624-40d5-b899-a0912f9cac4e admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:54.988759 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fda5baa-1624-40d5-b899-a0912f9cac4e admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:54.989250 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fda5baa-1624-40d5-b899-a0912f9cac4e admin admin] PATH_INFO: `/v3/projects/b9f7ef99f3f84b94985953c9fdcfad55/users/9dc73638091a4299843b9a8c03be6c28/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:54.992570 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fda5baa-1624-40d5-b899-a0912f9cac4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9f7ef99f3f84b94985953c9fdcfad55, user_id=9dc73638091a4299843b9a8c03be6c28, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:54.996995 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fda5baa-1624-40d5-b899-a0912f9cac4e admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:55.012791 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 973/1965] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:13:54 2022] PUT /identity/v3/projects/b9f7ef99f3f84b94985953c9fdcfad55/users/9dc73638091a4299843b9a8c03be6c28/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:13:55.023877 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e86baa-9572-4208-b3d4-1edcfdd249da None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:55.024284 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e86baa-9572-4208-b3d4-1edcfdd249da None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:55.024658 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e86baa-9572-4208-b3d4-1edcfdd249da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:55.065889 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-36e86baa-9572-4208-b3d4-1edcfdd249da None None] MFA Rules not processed for user `9dc73638091a4299843b9a8c03be6c28`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:13:55.071477 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-36e86baa-9572-4208-b3d4-1edcfdd249da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:55.079382 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fda5baa-1624-40d5-b899-a0912f9cac4e admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:55.086823 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-4fda5baa-1624-40d5-b899-a0912f9cac4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:55.230482 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fda5baa-1624-40d5-b899-a0912f9cac4e admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:55.238363 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a473eb7d-c48d-43b3-8ec9-cd35a034a56b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:55.238363 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a473eb7d-c48d-43b3-8ec9-cd35a034a56b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:55.238363 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a473eb7d-c48d-43b3-8ec9-cd35a034a56b admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:55.238363 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a473eb7d-c48d-43b3-8ec9-cd35a034a56b admin admin] PATH_INFO: `/v3/users/ad8fc53dadf24e19979a9fbf4f192f20` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:55.241024 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 993/1966] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:13:55 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:13:55.246209 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a473eb7d-c48d-43b3-8ec9-cd35a034a56b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad8fc53dadf24e19979a9fbf4f192f20)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:55.248297 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a473eb7d-c48d-43b3-8ec9-cd35a034a56b admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:55.254405 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:13:55.255535 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e86baa-9572-4208-b3d4-1edcfdd249da None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:55.337481 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:13:55.360595 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-a473eb7d-c48d-43b3-8ec9-cd35a034a56b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad8fc53dadf24e19979a9fbf4f192f20'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:55.370783 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-a473eb7d-c48d-43b3-8ec9-cd35a034a56b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad8fc53dadf24e19979a9fbf4f192f20'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:55.371565 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-a473eb7d-c48d-43b3-8ec9-cd35a034a56b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad8fc53dadf24e19979a9fbf4f192f20'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:55.383542 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-a473eb7d-c48d-43b3-8ec9-cd35a034a56b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad8fc53dadf24e19979a9fbf4f192f20'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:55.406070 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-a473eb7d-c48d-43b3-8ec9-cd35a034a56b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad8fc53dadf24e19979a9fbf4f192f20'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:55.415776 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 974/1967] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:13:55 2022] DELETE /identity/v3/users/ad8fc53dadf24e19979a9fbf4f192f20 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:13:55.417249 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0116ccfa-960c-436f-bfc0-28b8d7e3a6ef None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:55.417616 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0116ccfa-960c-436f-bfc0-28b8d7e3a6ef None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:55.417934 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0116ccfa-960c-436f-bfc0-28b8d7e3a6ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:55.431434 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e86baa-9572-4208-b3d4-1edcfdd249da None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:55.438158 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-0116ccfa-960c-436f-bfc0-28b8d7e3a6ef None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:13:55.441122 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-0116ccfa-960c-436f-bfc0-28b8d7e3a6ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:55.609117 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 975/1968] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:13:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:13:55.609296 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcca348e-4d28-4da7-8bc5-bec9e5bef6c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:55.609429 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0116ccfa-960c-436f-bfc0-28b8d7e3a6ef None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:55.609548 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcca348e-4d28-4da7-8bc5-bec9e5bef6c6 service nova] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:55.609548 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcca348e-4d28-4da7-8bc5-bec9e5bef6c6 service nova] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:55.609548 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcca348e-4d28-4da7-8bc5-bec9e5bef6c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:55.615081 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-bcca348e-4d28-4da7-8bc5-bec9e5bef6c6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:55.620346 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-0116ccfa-960c-436f-bfc0-28b8d7e3a6ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:55.671787 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0116ccfa-960c-436f-bfc0-28b8d7e3a6ef None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:55.677041 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706a028b-8429-49ad-86b0-2e3e54931799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:55.678044 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706a028b-8429-49ad-86b0-2e3e54931799 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:55.678275 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706a028b-8429-49ad-86b0-2e3e54931799 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:55.678603 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706a028b-8429-49ad-86b0-2e3e54931799 admin admin] PATH_INFO: `/v3/projects/995b3350672d45e6bf4a3669edff1ff2` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:55.681337 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706a028b-8429-49ad-86b0-2e3e54931799 admin admin] RBAC: Authorizing `identity:delete_project(project_id=995b3350672d45e6bf4a3669edff1ff2)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:55.685661 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706a028b-8429-49ad-86b0-2e3e54931799 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:55.786109 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcca348e-4d28-4da7-8bc5-bec9e5bef6c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:55.788436 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcca348e-4d28-4da7-8bc5-bec9e5bef6c6 service nova] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:55.804558 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-706a028b-8429-49ad-86b0-2e3e54931799 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '995b3350672d45e6bf4a3669edff1ff2', 'request_id': 'req-706a028b-8429-49ad-86b0-2e3e54931799'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:55.834043 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-706a028b-8429-49ad-86b0-2e3e54931799 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '995b3350672d45e6bf4a3669edff1ff2', 'request_id': 'req-706a028b-8429-49ad-86b0-2e3e54931799'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:55.839793 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 994/1969] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:13:55 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 585 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:13:55.842003 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-706a028b-8429-49ad-86b0-2e3e54931799 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '995b3350672d45e6bf4a3669edff1ff2', 'request_id': 'req-706a028b-8429-49ad-86b0-2e3e54931799'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:55.842933 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcca348e-4d28-4da7-8bc5-bec9e5bef6c6 service nova] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:55.852361 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-bcca348e-4d28-4da7-8bc5-bec9e5bef6c6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:55.870445 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-706a028b-8429-49ad-86b0-2e3e54931799 admin admin] The token cache is being invalidate because project 995b3350672d45e6bf4a3669edff1ff2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:13:55.870861 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-706a028b-8429-49ad-86b0-2e3e54931799 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:55.871736 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-706a028b-8429-49ad-86b0-2e3e54931799 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:55.881507 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 976/1970] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:13:55 2022] DELETE /identity/v3/projects/995b3350672d45e6bf4a3669edff1ff2 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:13:55.882596 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706a028b-8429-49ad-86b0-2e3e54931799 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:55.885530 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-706a028b-8429-49ad-86b0-2e3e54931799 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:55.901838 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:13:55.957336 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcca348e-4d28-4da7-8bc5-bec9e5bef6c6 service nova] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:55.987401 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:13:55.993900 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706a028b-8429-49ad-86b0-2e3e54931799 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:56.000647 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c28a43-34a9-4096-ab6a-51d40a493b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:56.001905 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c28a43-34a9-4096-ab6a-51d40a493b6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:56.002327 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c28a43-34a9-4096-ab6a-51d40a493b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:56.002752 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c28a43-34a9-4096-ab6a-51d40a493b6b admin admin] PATH_INFO: `/v3/users/c02f293f8cb04a2197ceb22728e717cb` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:56.004407 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c28a43-34a9-4096-ab6a-51d40a493b6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c02f293f8cb04a2197ceb22728e717cb)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:56.006734 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c28a43-34a9-4096-ab6a-51d40a493b6b admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:56.025772 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd5c9a7-868f-48ef-b706-84fa4ac675ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:56.027173 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd5c9a7-868f-48ef-b706-84fa4ac675ff service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:56.027617 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd5c9a7-868f-48ef-b706-84fa4ac675ff service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:56.028035 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd5c9a7-868f-48ef-b706-84fa4ac675ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:56.031601 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-4bd5c9a7-868f-48ef-b706-84fa4ac675ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:56.058042 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd5c9a7-868f-48ef-b706-84fa4ac675ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:56.062609 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd5c9a7-868f-48ef-b706-84fa4ac675ff service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:56.074036 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 995/1971] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:13:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:13:56.075191 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd5c9a7-868f-48ef-b706-84fa4ac675ff service neutron] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:56.076748 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-4bd5c9a7-868f-48ef-b706-84fa4ac675ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:56.082820 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-87c28a43-34a9-4096-ab6a-51d40a493b6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c02f293f8cb04a2197ceb22728e717cb'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:56.090191 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd5c9a7-868f-48ef-b706-84fa4ac675ff service neutron] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:56.092677 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-87c28a43-34a9-4096-ab6a-51d40a493b6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c02f293f8cb04a2197ceb22728e717cb'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:56.093982 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-87c28a43-34a9-4096-ab6a-51d40a493b6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c02f293f8cb04a2197ceb22728e717cb'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:56.096101 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b3ae01-72f4-42e2-a00f-a60d33aacf65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:56.097214 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b3ae01-72f4-42e2-a00f-a60d33aacf65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:56.097590 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b3ae01-72f4-42e2-a00f-a60d33aacf65 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:56.097994 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b3ae01-72f4-42e2-a00f-a60d33aacf65 admin admin] PATH_INFO: `/v3/users/d2680adfe5534be284c24994505fe250` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:56.105249 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b3ae01-72f4-42e2-a00f-a60d33aacf65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2680adfe5534be284c24994505fe250)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:56.107562 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b3ae01-72f4-42e2-a00f-a60d33aacf65 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:56.117579 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-87c28a43-34a9-4096-ab6a-51d40a493b6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c02f293f8cb04a2197ceb22728e717cb'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:56.131944 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-87c28a43-34a9-4096-ab6a-51d40a493b6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c02f293f8cb04a2197ceb22728e717cb'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:56.140409 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 977/1972] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:13:55 2022] DELETE /identity/v3/users/c02f293f8cb04a2197ceb22728e717cb => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:13:56.142188 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a471f07b-b277-4010-a6d1-835559dfd675 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:56.142630 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a471f07b-b277-4010-a6d1-835559dfd675 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:56.143149 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a471f07b-b277-4010-a6d1-835559dfd675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:56.178381 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-69b3ae01-72f4-42e2-a00f-a60d33aacf65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2680adfe5534be284c24994505fe250'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:56.179502 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-69b3ae01-72f4-42e2-a00f-a60d33aacf65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2680adfe5534be284c24994505fe250'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:56.185200 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-a471f07b-b277-4010-a6d1-835559dfd675 None None] MFA Rules not processed for user `f2672c5db79b4a48a505c3df536594dd`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:13:56.186619 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-a471f07b-b277-4010-a6d1-835559dfd675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:56.189249 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-69b3ae01-72f4-42e2-a00f-a60d33aacf65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2680adfe5534be284c24994505fe250'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:56.205186 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-69b3ae01-72f4-42e2-a00f-a60d33aacf65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2680adfe5534be284c24994505fe250'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:56.221526 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-69b3ae01-72f4-42e2-a00f-a60d33aacf65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2680adfe5534be284c24994505fe250'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:56.232235 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 996/1973] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:13:56 2022] DELETE /identity/v3/users/d2680adfe5534be284c24994505fe250 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:13:56.233963 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fa1460-387b-4997-a43f-f9bffe0a2ff9 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:56.244777 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fa1460-387b-4997-a43f-f9bffe0a2ff9 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:56.249379 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fa1460-387b-4997-a43f-f9bffe0a2ff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:56.285770 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-b1fa1460-387b-4997-a43f-f9bffe0a2ff9 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:13:56.286825 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 978/1974] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:13:56 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:13:56.289479 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-b1fa1460-387b-4997-a43f-f9bffe0a2ff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:56.291558 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a471f07b-b277-4010-a6d1-835559dfd675 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:56.294889 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-a471f07b-b277-4010-a6d1-835559dfd675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:56.319260 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:13:56.403749 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a471f07b-b277-4010-a6d1-835559dfd675 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:56.420692 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 997/1975] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:13:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:13:56.434169 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fa1460-387b-4997-a43f-f9bffe0a2ff9 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:56.435950 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-b1fa1460-387b-4997-a43f-f9bffe0a2ff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:56.495196 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:13:56.519552 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9242958-800d-42b8-8ddb-e1e7f6e49ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:56.520314 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9242958-800d-42b8-8ddb-e1e7f6e49ba9 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:56.520513 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9242958-800d-42b8-8ddb-e1e7f6e49ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:56.520882 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9242958-800d-42b8-8ddb-e1e7f6e49ba9 admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:56.521483 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9242958-800d-42b8-8ddb-e1e7f6e49ba9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:56.524099 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9242958-800d-42b8-8ddb-e1e7f6e49ba9 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:56.531458 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fa1460-387b-4997-a43f-f9bffe0a2ff9 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:56.535958 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72c62be-600d-4d74-a929-2922d3dcc840 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:56.536354 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72c62be-600d-4d74-a929-2922d3dcc840 service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:56.536634 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72c62be-600d-4d74-a929-2922d3dcc840 service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:56.536907 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72c62be-600d-4d74-a929-2922d3dcc840 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:56.547601 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72c62be-600d-4d74-a929-2922d3dcc840 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:56.549166 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72c62be-600d-4d74-a929-2922d3dcc840 service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:56.563308 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 979/1976] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:13:56 2022] POST /identity/v3/projects => generated 371 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:13:56.564525 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9242958-800d-42b8-8ddb-e1e7f6e49ba9 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:56.564639 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 998/1977] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:13:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 23 21:13:56.566020 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72c62be-600d-4d74-a929-2922d3dcc840 service neutron] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:56.567203 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-b9242958-800d-42b8-8ddb-e1e7f6e49ba9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:56.577395 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72c62be-600d-4d74-a929-2922d3dcc840 service neutron] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:56.711261 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4903c2-0c6c-4b82-a9c0-70d9a4df26b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:56.711961 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4903c2-0c6c-4b82-a9c0-70d9a4df26b1 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:56.712242 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4903c2-0c6c-4b82-a9c0-70d9a4df26b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:56.712515 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4903c2-0c6c-4b82-a9c0-70d9a4df26b1 admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:56.713211 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4903c2-0c6c-4b82-a9c0-70d9a4df26b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:56.715210 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4903c2-0c6c-4b82-a9c0-70d9a4df26b1 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:56.715711 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9242958-800d-42b8-8ddb-e1e7f6e49ba9 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:56.721235 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d8eb9c-1dd0-44d1-b3ed-f98ccb1b152f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:56.722446 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d8eb9c-1dd0-44d1-b3ed-f98ccb1b152f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:56.722731 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d8eb9c-1dd0-44d1-b3ed-f98ccb1b152f admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:56.723009 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d8eb9c-1dd0-44d1-b3ed-f98ccb1b152f admin admin] PATH_INFO: `/v3/projects/6cb727a3d6fd44c98106fec9068492af` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:56.724231 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d8eb9c-1dd0-44d1-b3ed-f98ccb1b152f admin admin] RBAC: Authorizing `identity:delete_project(project_id=6cb727a3d6fd44c98106fec9068492af)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:56.727280 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d8eb9c-1dd0-44d1-b3ed-f98ccb1b152f admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:56.742770 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 999/1978] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:13:56 2022] POST /identity/v3/users => generated 292 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:13:56.743812 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4903c2-0c6c-4b82-a9c0-70d9a4df26b1 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:56.753111 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-0d4903c2-0c6c-4b82-a9c0-70d9a4df26b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:56.770078 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4903c2-0c6c-4b82-a9c0-70d9a4df26b1 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:56.777111 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d4718e-a789-4ddc-8294-1369cf4df8ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:56.778509 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d4718e-a789-4ddc-8294-1369cf4df8ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:56.779233 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d4718e-a789-4ddc-8294-1369cf4df8ff admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:56.779697 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d4718e-a789-4ddc-8294-1369cf4df8ff admin admin] PATH_INFO: `/v3/projects/d051059b88ef495282ee67aefa1ad57f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:56.781941 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d4718e-a789-4ddc-8294-1369cf4df8ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=d051059b88ef495282ee67aefa1ad57f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:56.784317 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d4718e-a789-4ddc-8294-1369cf4df8ff admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:56.826357 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-55d8eb9c-1dd0-44d1-b3ed-f98ccb1b152f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6cb727a3d6fd44c98106fec9068492af', 'request_id': 'req-55d8eb9c-1dd0-44d1-b3ed-f98ccb1b152f'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:56.829741 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:13:56.841685 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-55d8eb9c-1dd0-44d1-b3ed-f98ccb1b152f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6cb727a3d6fd44c98106fec9068492af', 'request_id': 'req-55d8eb9c-1dd0-44d1-b3ed-f98ccb1b152f'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:56.856639 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-55d8eb9c-1dd0-44d1-b3ed-f98ccb1b152f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6cb727a3d6fd44c98106fec9068492af', 'request_id': 'req-55d8eb9c-1dd0-44d1-b3ed-f98ccb1b152f'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:56.876600 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-62d4718e-a789-4ddc-8294-1369cf4df8ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd051059b88ef495282ee67aefa1ad57f', 'request_id': 'req-62d4718e-a789-4ddc-8294-1369cf4df8ff'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:56.878751 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-55d8eb9c-1dd0-44d1-b3ed-f98ccb1b152f admin admin] The token cache is being invalidate because project 6cb727a3d6fd44c98106fec9068492af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:13:56.879188 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-55d8eb9c-1dd0-44d1-b3ed-f98ccb1b152f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:56.882054 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-55d8eb9c-1dd0-44d1-b3ed-f98ccb1b152f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:56.886705 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 980/1979] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:13:56 2022] DELETE /identity/v3/projects/6cb727a3d6fd44c98106fec9068492af => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:13:56.890685 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-62d4718e-a789-4ddc-8294-1369cf4df8ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd051059b88ef495282ee67aefa1ad57f', 'request_id': 'req-62d4718e-a789-4ddc-8294-1369cf4df8ff'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:56.892870 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d8eb9c-1dd0-44d1-b3ed-f98ccb1b152f admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:56.895866 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-55d8eb9c-1dd0-44d1-b3ed-f98ccb1b152f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:56.901203 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-62d4718e-a789-4ddc-8294-1369cf4df8ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd051059b88ef495282ee67aefa1ad57f', 'request_id': 'req-62d4718e-a789-4ddc-8294-1369cf4df8ff'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:56.916135 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-62d4718e-a789-4ddc-8294-1369cf4df8ff admin admin] The token cache is being invalidate because project d051059b88ef495282ee67aefa1ad57f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:13:56.916633 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-62d4718e-a789-4ddc-8294-1369cf4df8ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:56.917649 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-62d4718e-a789-4ddc-8294-1369cf4df8ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:56.923133 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1000/1980] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:13:56 2022] DELETE /identity/v3/projects/d051059b88ef495282ee67aefa1ad57f => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:13:56.924415 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d4718e-a789-4ddc-8294-1369cf4df8ff admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:56.926540 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-62d4718e-a789-4ddc-8294-1369cf4df8ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:57.017079 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d8eb9c-1dd0-44d1-b3ed-f98ccb1b152f admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:57.030578 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:13:57.054053 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d4718e-a789-4ddc-8294-1369cf4df8ff admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:57.065698 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37ffab5-0168-49cf-a8cc-831834f5ff2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:57.066975 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37ffab5-0168-49cf-a8cc-831834f5ff2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:57.067400 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37ffab5-0168-49cf-a8cc-831834f5ff2b admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:57.069203 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37ffab5-0168-49cf-a8cc-831834f5ff2b admin admin] PATH_INFO: `/v3/users/9958f76e32b64a9ab61f62e439a3b32a` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:57.071408 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37ffab5-0168-49cf-a8cc-831834f5ff2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=9958f76e32b64a9ab61f62e439a3b32a)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:57.073581 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37ffab5-0168-49cf-a8cc-831834f5ff2b admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:57.122564 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d549ae-e3f2-4fe5-9e38-c69bd20c84c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:57.125012 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d549ae-e3f2-4fe5-9e38-c69bd20c84c3 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:57.126472 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d549ae-e3f2-4fe5-9e38-c69bd20c84c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:57.131191 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d549ae-e3f2-4fe5-9e38-c69bd20c84c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:57.133940 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d549ae-e3f2-4fe5-9e38-c69bd20c84c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:57.135577 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d549ae-e3f2-4fe5-9e38-c69bd20c84c3 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:57.148249 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 981/1981] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:13:56 2022] GET /identity/v3/roles => generated 1420 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:13:57.150108 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4bd1bb-555e-40ce-9919-4d671f0fcbbd None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:57.150108 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4bd1bb-555e-40ce-9919-4d671f0fcbbd None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:57.150366 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4bd1bb-555e-40ce-9919-4d671f0fcbbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:57.180053 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-6c4bd1bb-555e-40ce-9919-4d671f0fcbbd None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:13:57.181453 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-6c4bd1bb-555e-40ce-9919-4d671f0fcbbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:57.189129 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c37ffab5-0168-49cf-a8cc-831834f5ff2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9958f76e32b64a9ab61f62e439a3b32a'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:57.190284 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c37ffab5-0168-49cf-a8cc-831834f5ff2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9958f76e32b64a9ab61f62e439a3b32a'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:57.201917 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 982/1982] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:13:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:13:57.201917 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4bd1bb-555e-40ce-9919-4d671f0fcbbd None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:57.205629 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c37ffab5-0168-49cf-a8cc-831834f5ff2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9958f76e32b64a9ab61f62e439a3b32a'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:57.206926 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-6c4bd1bb-555e-40ce-9919-4d671f0fcbbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:57.215836 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c37ffab5-0168-49cf-a8cc-831834f5ff2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9958f76e32b64a9ab61f62e439a3b32a'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:57.234921 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c37ffab5-0168-49cf-a8cc-831834f5ff2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9958f76e32b64a9ab61f62e439a3b32a'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:57.261113 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1001/1983] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:13:56 2022] DELETE /identity/v3/users/9958f76e32b64a9ab61f62e439a3b32a => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:13:57.261113 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37ffab5-0168-49cf-a8cc-831834f5ff2b admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:57.265597 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-c37ffab5-0168-49cf-a8cc-831834f5ff2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:57.314186 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4bd1bb-555e-40ce-9919-4d671f0fcbbd None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:57.327941 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:INSERT=1,keystone:DELETE=3,keystone:SELECT=96 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:13:57.374351 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37ffab5-0168-49cf-a8cc-831834f5ff2b admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:57.381093 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61dad72-b839-4f90-92a4-bf9e22f00296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:57.382089 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61dad72-b839-4f90-92a4-bf9e22f00296 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:57.382366 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61dad72-b839-4f90-92a4-bf9e22f00296 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:57.382635 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61dad72-b839-4f90-92a4-bf9e22f00296 admin admin] PATH_INFO: `/v3/projects/9193a8f9e7b741179a36e86ffa1b2b24/users/a47a7cc74c1041c68d49ab37ef3e2643/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:57.418737 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61dad72-b839-4f90-92a4-bf9e22f00296 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9193a8f9e7b741179a36e86ffa1b2b24, user_id=a47a7cc74c1041c68d49ab37ef3e2643, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:57.425118 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61dad72-b839-4f90-92a4-bf9e22f00296 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:57.445982 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439b1fe8-e9f2-4913-846c-182219c42381 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:57.446769 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439b1fe8-e9f2-4913-846c-182219c42381 service nova] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:57.447051 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439b1fe8-e9f2-4913-846c-182219c42381 service nova] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:57.447359 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439b1fe8-e9f2-4913-846c-182219c42381 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:57.450214 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1002/1984] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:13:57 2022] PUT /identity/v3/projects/9193a8f9e7b741179a36e86ffa1b2b24/users/a47a7cc74c1041c68d49ab37ef3e2643/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:13:57.451659 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61dad72-b839-4f90-92a4-bf9e22f00296 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:57.454847 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-439b1fe8-e9f2-4913-846c-182219c42381 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:57.456830 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-c61dad72-b839-4f90-92a4-bf9e22f00296 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:57.526133 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:13:57.553122 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61dad72-b839-4f90-92a4-bf9e22f00296 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:57.553122 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ee141d-2f17-4dce-a2e3-3117a91919bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:57.553122 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ee141d-2f17-4dce-a2e3-3117a91919bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:57.553122 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ee141d-2f17-4dce-a2e3-3117a91919bd admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:57.553542 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ee141d-2f17-4dce-a2e3-3117a91919bd admin admin] PATH_INFO: `/v3/projects/ba16f1a6764344a1b32d2b3bc85fdfe2` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:57.554308 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ee141d-2f17-4dce-a2e3-3117a91919bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba16f1a6764344a1b32d2b3bc85fdfe2)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:57.558036 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ee141d-2f17-4dce-a2e3-3117a91919bd admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:57.560013 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439b1fe8-e9f2-4913-846c-182219c42381 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:57.562960 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439b1fe8-e9f2-4913-846c-182219c42381 service nova] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:57.590691 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 983/1985] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:13:57 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:13:57.596049 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50af8225-b16c-4b00-add9-f08ab2411ebe None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:57.596996 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50af8225-b16c-4b00-add9-f08ab2411ebe None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:57.598019 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50af8225-b16c-4b00-add9-f08ab2411ebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:57.648232 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-50af8225-b16c-4b00-add9-f08ab2411ebe None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:13:57.654407 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-50af8225-b16c-4b00-add9-f08ab2411ebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:57.664252 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c3ee141d-2f17-4dce-a2e3-3117a91919bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba16f1a6764344a1b32d2b3bc85fdfe2', 'request_id': 'req-c3ee141d-2f17-4dce-a2e3-3117a91919bd'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:57.678940 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c3ee141d-2f17-4dce-a2e3-3117a91919bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba16f1a6764344a1b32d2b3bc85fdfe2', 'request_id': 'req-c3ee141d-2f17-4dce-a2e3-3117a91919bd'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:57.692423 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c3ee141d-2f17-4dce-a2e3-3117a91919bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba16f1a6764344a1b32d2b3bc85fdfe2', 'request_id': 'req-c3ee141d-2f17-4dce-a2e3-3117a91919bd'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:57.722650 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c3ee141d-2f17-4dce-a2e3-3117a91919bd admin admin] The token cache is being invalidate because project ba16f1a6764344a1b32d2b3bc85fdfe2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:13:57.723053 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c3ee141d-2f17-4dce-a2e3-3117a91919bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:57.725647 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c3ee141d-2f17-4dce-a2e3-3117a91919bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:57.731576 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1003/1986] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:13:57 2022] DELETE /identity/v3/projects/ba16f1a6764344a1b32d2b3bc85fdfe2 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:13:57.732561 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ee141d-2f17-4dce-a2e3-3117a91919bd admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:57.739794 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-c3ee141d-2f17-4dce-a2e3-3117a91919bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:57.787370 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 984/1987] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:13:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:13:57.791700 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50af8225-b16c-4b00-add9-f08ab2411ebe None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:57.793540 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-50af8225-b16c-4b00-add9-f08ab2411ebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:57.809733 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50af8225-b16c-4b00-add9-f08ab2411ebe None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:57.826727 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f772ea-7cbf-47fc-a341-7e54a2d38627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:57.827872 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f772ea-7cbf-47fc-a341-7e54a2d38627 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:57.828233 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f772ea-7cbf-47fc-a341-7e54a2d38627 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:57.828624 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f772ea-7cbf-47fc-a341-7e54a2d38627 admin admin] PATH_INFO: `/v3/projects/0d1572d4b1494426b6e511a38fdd6c20` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:57.835942 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f772ea-7cbf-47fc-a341-7e54a2d38627 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d1572d4b1494426b6e511a38fdd6c20)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:57.838707 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f772ea-7cbf-47fc-a341-7e54a2d38627 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:57.859136 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ee141d-2f17-4dce-a2e3-3117a91919bd admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:57.866755 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32eb0b21-54c2-485e-812d-128d9fdd2568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:57.868009 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eb0b21-54c2-485e-812d-128d9fdd2568 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:57.868461 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eb0b21-54c2-485e-812d-128d9fdd2568 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:57.868899 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eb0b21-54c2-485e-812d-128d9fdd2568 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:57.870502 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32eb0b21-54c2-485e-812d-128d9fdd2568 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:57.872686 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32eb0b21-54c2-485e-812d-128d9fdd2568 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:57.895558 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1004/1988] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:13:57 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:13:57.898052 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32eb0b21-54c2-485e-812d-128d9fdd2568 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:57.902524 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-32eb0b21-54c2-485e-812d-128d9fdd2568 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:57.904550 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:13:57.913578 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-33f772ea-7cbf-47fc-a341-7e54a2d38627 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d1572d4b1494426b6e511a38fdd6c20', 'request_id': 'req-33f772ea-7cbf-47fc-a341-7e54a2d38627'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:57.925272 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-33f772ea-7cbf-47fc-a341-7e54a2d38627 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d1572d4b1494426b6e511a38fdd6c20', 'request_id': 'req-33f772ea-7cbf-47fc-a341-7e54a2d38627'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:57.925585 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32eb0b21-54c2-485e-812d-128d9fdd2568 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:57.935014 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-33f772ea-7cbf-47fc-a341-7e54a2d38627 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d1572d4b1494426b6e511a38fdd6c20', 'request_id': 'req-33f772ea-7cbf-47fc-a341-7e54a2d38627'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:57.950090 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-33f772ea-7cbf-47fc-a341-7e54a2d38627 admin admin] The token cache is being invalidate because project 0d1572d4b1494426b6e511a38fdd6c20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:13:57.950607 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-33f772ea-7cbf-47fc-a341-7e54a2d38627 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:57.951408 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-33f772ea-7cbf-47fc-a341-7e54a2d38627 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:57.953211 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 985/1989] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:13:57 2022] DELETE /identity/v3/projects/0d1572d4b1494426b6e511a38fdd6c20 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:13:57.954498 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f772ea-7cbf-47fc-a341-7e54a2d38627 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:57.955938 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-33f772ea-7cbf-47fc-a341-7e54a2d38627 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:57.992612 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79224f60-11b2-433d-9e51-6ed645431959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:57.993744 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79224f60-11b2-433d-9e51-6ed645431959 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:57.993744 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79224f60-11b2-433d-9e51-6ed645431959 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:57.993984 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79224f60-11b2-433d-9e51-6ed645431959 admin admin] PATH_INFO: `/v3/users/9dc73638091a4299843b9a8c03be6c28` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:57.995448 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79224f60-11b2-433d-9e51-6ed645431959 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9dc73638091a4299843b9a8c03be6c28)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:57.997404 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79224f60-11b2-433d-9e51-6ed645431959 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:58.031795 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:13:58.051291 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f772ea-7cbf-47fc-a341-7e54a2d38627 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:58.057717 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e2ab0e-e7e5-4ae8-a44e-f600b25882eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:58.058604 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e2ab0e-e7e5-4ae8-a44e-f600b25882eb admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:58.059531 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e2ab0e-e7e5-4ae8-a44e-f600b25882eb admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:58.059883 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e2ab0e-e7e5-4ae8-a44e-f600b25882eb admin admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:58.060845 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e2ab0e-e7e5-4ae8-a44e-f600b25882eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:13:58.061367 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e2ab0e-e7e5-4ae8-a44e-f600b25882eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:58.063368 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e2ab0e-e7e5-4ae8-a44e-f600b25882eb admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:58.069490 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-79224f60-11b2-433d-9e51-6ed645431959 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9dc73638091a4299843b9a8c03be6c28'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:58.070297 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-79224f60-11b2-433d-9e51-6ed645431959 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9dc73638091a4299843b9a8c03be6c28'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:58.082086 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 986/1990] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:13:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:13:58.082086 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e2ab0e-e7e5-4ae8-a44e-f600b25882eb admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:58.086254 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-79224f60-11b2-433d-9e51-6ed645431959 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9dc73638091a4299843b9a8c03be6c28'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:58.087554 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-f9e2ab0e-e7e5-4ae8-a44e-f600b25882eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:58.105129 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-79224f60-11b2-433d-9e51-6ed645431959 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9dc73638091a4299843b9a8c03be6c28'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:58.105317 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e2ab0e-e7e5-4ae8-a44e-f600b25882eb admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:58.110155 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69272b12-da08-489d-a5e1-bb39718b11c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:58.111395 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69272b12-da08-489d-a5e1-bb39718b11c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:58.111625 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69272b12-da08-489d-a5e1-bb39718b11c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:58.111921 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69272b12-da08-489d-a5e1-bb39718b11c6 admin admin] PATH_INFO: `/v3/projects/9193a8f9e7b741179a36e86ffa1b2b24/users/a47a7cc74c1041c68d49ab37ef3e2643/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:58.114283 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69272b12-da08-489d-a5e1-bb39718b11c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9193a8f9e7b741179a36e86ffa1b2b24, user_id=a47a7cc74c1041c68d49ab37ef3e2643, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:58.117108 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69272b12-da08-489d-a5e1-bb39718b11c6 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:58.119345 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-79224f60-11b2-433d-9e51-6ed645431959 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9dc73638091a4299843b9a8c03be6c28'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:58.132384 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1005/1991] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:13:57 2022] DELETE /identity/v3/users/9dc73638091a4299843b9a8c03be6c28 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:13:58.132384 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5089cbae-0c76-4c9e-a1d4-ebb4acb17eba None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:58.132384 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5089cbae-0c76-4c9e-a1d4-ebb4acb17eba None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:58.132384 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5089cbae-0c76-4c9e-a1d4-ebb4acb17eba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:58.136648 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 987/1992] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:13:58 2022] PUT /identity/v3/projects/9193a8f9e7b741179a36e86ffa1b2b24/users/a47a7cc74c1041c68d49ab37ef3e2643/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:13:58.141363 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69272b12-da08-489d-a5e1-bb39718b11c6 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:58.145383 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-69272b12-da08-489d-a5e1-bb39718b11c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:58.168607 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-5089cbae-0c76-4c9e-a1d4-ebb4acb17eba None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:13:58.169855 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-5089cbae-0c76-4c9e-a1d4-ebb4acb17eba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:58.275393 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69272b12-da08-489d-a5e1-bb39718b11c6 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:58.288958 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcee27af-0961-45fb-a2d5-19968693821b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:58.289801 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1006/1993] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:13:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:13:58.294767 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcee27af-0961-45fb-a2d5-19968693821b admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:58.295185 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcee27af-0961-45fb-a2d5-19968693821b admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:58.295514 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcee27af-0961-45fb-a2d5-19968693821b admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:58.296816 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcee27af-0961-45fb-a2d5-19968693821b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:58.301955 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411a872f-16f8-4090-a9b3-ae5c2c991485 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:58.302333 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411a872f-16f8-4090-a9b3-ae5c2c991485 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:58.304086 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411a872f-16f8-4090-a9b3-ae5c2c991485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:58.304716 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcee27af-0961-45fb-a2d5-19968693821b admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:58.328668 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-411a872f-16f8-4090-a9b3-ae5c2c991485 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:13:58.330139 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-411a872f-16f8-4090-a9b3-ae5c2c991485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:58.348645 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1007/1994] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:13:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:13:58.350246 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 988/1995] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:13:58 2022] POST /identity/v3/projects => generated 391 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:13:58.355017 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411a872f-16f8-4090-a9b3-ae5c2c991485 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:58.356823 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcee27af-0961-45fb-a2d5-19968693821b admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:58.384451 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411a872f-16f8-4090-a9b3-ae5c2c991485 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:58.436386 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:13:58.474697 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5777179-fdff-4b7e-b7c9-d7fa00ff65db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:58.475408 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5777179-fdff-4b7e-b7c9-d7fa00ff65db admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:58.475693 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5777179-fdff-4b7e-b7c9-d7fa00ff65db admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:58.476086 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5777179-fdff-4b7e-b7c9-d7fa00ff65db admin admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:58.477059 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5777179-fdff-4b7e-b7c9-d7fa00ff65db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:13:58.477435 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5777179-fdff-4b7e-b7c9-d7fa00ff65db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:58.479682 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5777179-fdff-4b7e-b7c9-d7fa00ff65db admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:58.505460 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1008/1996] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:13:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 21:13:58.510035 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5777179-fdff-4b7e-b7c9-d7fa00ff65db admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:58.520768 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcee27af-0961-45fb-a2d5-19968693821b admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:58.525226 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5777179-fdff-4b7e-b7c9-d7fa00ff65db admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:58.531670 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c9b534-d25c-4db4-bbe3-836bfa891e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:58.531885 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb36794-406d-43b4-8b43-19428ba9eeb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:58.532334 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c9b534-d25c-4db4-bbe3-836bfa891e12 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:58.532624 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c9b534-d25c-4db4-bbe3-836bfa891e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:58.532970 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb36794-406d-43b4-8b43-19428ba9eeb3 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:58.533073 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c9b534-d25c-4db4-bbe3-836bfa891e12 admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:58.533421 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb36794-406d-43b4-8b43-19428ba9eeb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:58.533724 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c9b534-d25c-4db4-bbe3-836bfa891e12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:58.533826 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb36794-406d-43b4-8b43-19428ba9eeb3 admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:58.534674 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb36794-406d-43b4-8b43-19428ba9eeb3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:58.535892 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c9b534-d25c-4db4-bbe3-836bfa891e12 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:58.536778 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb36794-406d-43b4-8b43-19428ba9eeb3 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:58.572406 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1009/1997] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:13:58 2022] POST /identity/v3/projects => generated 375 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:13:58.576722 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb36794-406d-43b4-8b43-19428ba9eeb3 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:58.585757 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 989/1998] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:13:58 2022] POST /identity/v3/users => generated 296 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:13:58.587198 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c9b534-d25c-4db4-bbe3-836bfa891e12 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:58.587651 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:13:58.622060 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c9b534-d25c-4db4-bbe3-836bfa891e12 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:58.657651 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb36794-406d-43b4-8b43-19428ba9eeb3 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:58.663777 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718f82a4-aa84-4f9e-8574-6a4beefd6501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:58.664630 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718f82a4-aa84-4f9e-8574-6a4beefd6501 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:58.665067 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718f82a4-aa84-4f9e-8574-6a4beefd6501 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:58.665348 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718f82a4-aa84-4f9e-8574-6a4beefd6501 admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:58.666685 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718f82a4-aa84-4f9e-8574-6a4beefd6501 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:58.669240 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718f82a4-aa84-4f9e-8574-6a4beefd6501 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:58.723667 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1010/1999] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:13:58 2022] POST /identity/v3/users => generated 288 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:13:58.727590 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718f82a4-aa84-4f9e-8574-6a4beefd6501 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:58.760765 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ebd2e6-d366-4cd8-a3ef-65c070d51555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:58.761828 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718f82a4-aa84-4f9e-8574-6a4beefd6501 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:58.761991 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ebd2e6-d366-4cd8-a3ef-65c070d51555 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:58.763020 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ebd2e6-d366-4cd8-a3ef-65c070d51555 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:58.770290 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ebd2e6-d366-4cd8-a3ef-65c070d51555 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:58.770452 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3044d9a6-86bc-49e7-bfa9-fdc8be6ade5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:58.771116 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ebd2e6-d366-4cd8-a3ef-65c070d51555 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:58.771228 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3044d9a6-86bc-49e7-bfa9-fdc8be6ade5e admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:58.771394 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3044d9a6-86bc-49e7-bfa9-fdc8be6ade5e admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:58.771701 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3044d9a6-86bc-49e7-bfa9-fdc8be6ade5e admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:58.772435 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3044d9a6-86bc-49e7-bfa9-fdc8be6ade5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:58.772775 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ebd2e6-d366-4cd8-a3ef-65c070d51555 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:58.774138 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3044d9a6-86bc-49e7-bfa9-fdc8be6ade5e admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:58.791638 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1011/2000] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:13:58 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:13:58.792616 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3044d9a6-86bc-49e7-bfa9-fdc8be6ade5e admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:58.794808 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-3044d9a6-86bc-49e7-bfa9-fdc8be6ade5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:58.805850 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 990/2001] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:13:58 2022] GET /identity/v3/roles => generated 1420 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:13:58.807369 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ebd2e6-d366-4cd8-a3ef-65c070d51555 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:58.829532 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3044d9a6-86bc-49e7-bfa9-fdc8be6ade5e admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:58.836250 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ebd2e6-d366-4cd8-a3ef-65c070d51555 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:58.842151 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb6c6ff-821a-4b92-921b-bc333cdeccd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:58.842870 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70cbfd4-efe1-4a51-98b0-02dd2058b29c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:58.843030 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb6c6ff-821a-4b92-921b-bc333cdeccd2 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:58.843159 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb6c6ff-821a-4b92-921b-bc333cdeccd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:58.843434 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb6c6ff-821a-4b92-921b-bc333cdeccd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:58.844168 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb6c6ff-821a-4b92-921b-bc333cdeccd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:58.844513 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70cbfd4-efe1-4a51-98b0-02dd2058b29c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:58.845519 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70cbfd4-efe1-4a51-98b0-02dd2058b29c admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:58.845897 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb6c6ff-821a-4b92-921b-bc333cdeccd2 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:58.846106 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70cbfd4-efe1-4a51-98b0-02dd2058b29c admin admin] PATH_INFO: `/v3/projects/b9f7ef99f3f84b94985953c9fdcfad55` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:58.847865 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70cbfd4-efe1-4a51-98b0-02dd2058b29c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9f7ef99f3f84b94985953c9fdcfad55)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:58.850135 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70cbfd4-efe1-4a51-98b0-02dd2058b29c admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:58.873258 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 991/2002] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:13:58 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:13:58.874328 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb6c6ff-821a-4b92-921b-bc333cdeccd2 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:58.887833 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb6c6ff-821a-4b92-921b-bc333cdeccd2 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:58.895949 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253e6f0f-ee07-4dd9-967c-af3fb7e2532b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:58.896701 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253e6f0f-ee07-4dd9-967c-af3fb7e2532b admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:58.897084 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253e6f0f-ee07-4dd9-967c-af3fb7e2532b admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:58.897367 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253e6f0f-ee07-4dd9-967c-af3fb7e2532b admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:58.908996 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253e6f0f-ee07-4dd9-967c-af3fb7e2532b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:58.910770 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253e6f0f-ee07-4dd9-967c-af3fb7e2532b admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:58.931084 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 992/2003] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:13:58 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:13:58.931084 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253e6f0f-ee07-4dd9-967c-af3fb7e2532b admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:58.952457 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253e6f0f-ee07-4dd9-967c-af3fb7e2532b admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:58.956774 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c70cbfd4-efe1-4a51-98b0-02dd2058b29c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9f7ef99f3f84b94985953c9fdcfad55', 'request_id': 'req-c70cbfd4-efe1-4a51-98b0-02dd2058b29c'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:58.970871 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c70cbfd4-efe1-4a51-98b0-02dd2058b29c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9f7ef99f3f84b94985953c9fdcfad55', 'request_id': 'req-c70cbfd4-efe1-4a51-98b0-02dd2058b29c'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:58.982100 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c70cbfd4-efe1-4a51-98b0-02dd2058b29c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9f7ef99f3f84b94985953c9fdcfad55', 'request_id': 'req-c70cbfd4-efe1-4a51-98b0-02dd2058b29c'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:59.003195 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c70cbfd4-efe1-4a51-98b0-02dd2058b29c admin admin] The token cache is being invalidate because project b9f7ef99f3f84b94985953c9fdcfad55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:13:59.003788 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c70cbfd4-efe1-4a51-98b0-02dd2058b29c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:59.004848 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c70cbfd4-efe1-4a51-98b0-02dd2058b29c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:13:59.013988 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1012/2004] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:13:58 2022] DELETE /identity/v3/projects/b9f7ef99f3f84b94985953c9fdcfad55 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:13:59.013988 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70cbfd4-efe1-4a51-98b0-02dd2058b29c admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:59.015437 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-c70cbfd4-efe1-4a51-98b0-02dd2058b29c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:59.041620 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b576804-3301-4779-8107-d1517755c3ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:59.042503 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b576804-3301-4779-8107-d1517755c3ae admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:59.042880 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b576804-3301-4779-8107-d1517755c3ae admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:59.043157 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b576804-3301-4779-8107-d1517755c3ae admin admin] PATH_INFO: `/v3/projects/5935212e8b6a40768ee3fc90807b0cb1/users/0133d9533fbd4be5b46dc308dbe3a7d9/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:59.063885 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b576804-3301-4779-8107-d1517755c3ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=5935212e8b6a40768ee3fc90807b0cb1, user_id=0133d9533fbd4be5b46dc308dbe3a7d9, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:59.068358 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b576804-3301-4779-8107-d1517755c3ae admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:59.103965 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70cbfd4-efe1-4a51-98b0-02dd2058b29c admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:59.115632 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:13:59.132336 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 993/2005] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:13:58 2022] PUT /identity/v3/projects/5935212e8b6a40768ee3fc90807b0cb1/users/0133d9533fbd4be5b46dc308dbe3a7d9/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:13:59.144947 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1570554-1459-4181-8a07-c9bc12134b60 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:59.147548 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1570554-1459-4181-8a07-c9bc12134b60 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:59.151453 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1570554-1459-4181-8a07-c9bc12134b60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:59.194530 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-e1570554-1459-4181-8a07-c9bc12134b60 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:13:59.194771 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fe516d-1b2c-481c-aeae-ca342cbb3cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:59.195637 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fe516d-1b2c-481c-aeae-ca342cbb3cd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:59.195917 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fe516d-1b2c-481c-aeae-ca342cbb3cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:59.196270 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fe516d-1b2c-481c-aeae-ca342cbb3cd1 admin admin] PATH_INFO: `/v3/projects/e6aeead482c4469c87a75947dd10de66/users/7d86f24a21cc4e8bb931d3a65c76ace8/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:59.197635 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-e1570554-1459-4181-8a07-c9bc12134b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:59.219040 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fe516d-1b2c-481c-aeae-ca342cbb3cd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6aeead482c4469c87a75947dd10de66, user_id=7d86f24a21cc4e8bb931d3a65c76ace8, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:59.222119 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fe516d-1b2c-481c-aeae-ca342cbb3cd1 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:59.229389 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 994/2006] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:13:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:13:59.231917 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782f2ca3-9507-45a2-84bd-d7db5da00db9 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:59.232468 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782f2ca3-9507-45a2-84bd-d7db5da00db9 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:59.233072 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782f2ca3-9507-45a2-84bd-d7db5da00db9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:59.259880 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1013/2007] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:13:59 2022] PUT /identity/v3/projects/e6aeead482c4469c87a75947dd10de66/users/7d86f24a21cc4e8bb931d3a65c76ace8/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:13:59.259880 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d498abd-3b62-4bc8-a4ba-a045f906a02d None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:59.259880 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d498abd-3b62-4bc8-a4ba-a045f906a02d None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:59.259880 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d498abd-3b62-4bc8-a4ba-a045f906a02d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:59.302420 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-4d498abd-3b62-4bc8-a4ba-a045f906a02d None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:13:59.306135 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-4d498abd-3b62-4bc8-a4ba-a045f906a02d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:59.312514 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-782f2ca3-9507-45a2-84bd-d7db5da00db9 None None] MFA Rules not processed for user `0133d9533fbd4be5b46dc308dbe3a7d9`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:13:59.315446 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-782f2ca3-9507-45a2-84bd-d7db5da00db9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:59.323432 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:13:59.447655 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1014/2008] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:13:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:13:59.449389 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5d25e7-1998-4e7b-ae00-789aec859bae None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:59.449790 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5d25e7-1998-4e7b-ae00-789aec859bae None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:59.450148 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5d25e7-1998-4e7b-ae00-789aec859bae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:59.467784 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 995/2009] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:13:59 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:13:59.469886 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782f2ca3-9507-45a2-84bd-d7db5da00db9 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:59.489373 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-cd5d25e7-1998-4e7b-ae00-789aec859bae None None] MFA Rules not processed for user `7d86f24a21cc4e8bb931d3a65c76ace8`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:13:59.490327 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782f2ca3-9507-45a2-84bd-d7db5da00db9 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:59.490892 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-cd5d25e7-1998-4e7b-ae00-789aec859bae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:59.496830 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c32a12c-9f8d-4dd2-a7a3-b918b371c1b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:59.497621 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c32a12c-9f8d-4dd2-a7a3-b918b371c1b3 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:59.498037 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c32a12c-9f8d-4dd2-a7a3-b918b371c1b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:59.498413 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c32a12c-9f8d-4dd2-a7a3-b918b371c1b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:59.499344 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c32a12c-9f8d-4dd2-a7a3-b918b371c1b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:13:59.499714 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c32a12c-9f8d-4dd2-a7a3-b918b371c1b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:59.502349 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c32a12c-9f8d-4dd2-a7a3-b918b371c1b3 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:59.516668 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 996/2010] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:13:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:13:59.521425 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c32a12c-9f8d-4dd2-a7a3-b918b371c1b3 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:59.523542 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-2c32a12c-9f8d-4dd2-a7a3-b918b371c1b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:13:59.539285 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c32a12c-9f8d-4dd2-a7a3-b918b371c1b3 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:59.547427 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18e2c58-35db-4e30-a4fd-a18257bcc46b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:59.548503 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18e2c58-35db-4e30-a4fd-a18257bcc46b admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:59.548921 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18e2c58-35db-4e30-a4fd-a18257bcc46b admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:59.549282 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18e2c58-35db-4e30-a4fd-a18257bcc46b admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:59.550221 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18e2c58-35db-4e30-a4fd-a18257bcc46b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:59.552950 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18e2c58-35db-4e30-a4fd-a18257bcc46b admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:59.620442 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 997/2011] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:13:59 2022] POST /identity/v3/projects => generated 371 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:13:59.621687 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18e2c58-35db-4e30-a4fd-a18257bcc46b admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:59.627058 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1015/2012] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:13:59 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:13:59.629982 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5d25e7-1998-4e7b-ae00-789aec859bae None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:59.658114 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5d25e7-1998-4e7b-ae00-789aec859bae None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:59.700121 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:13:59.745027 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18e2c58-35db-4e30-a4fd-a18257bcc46b admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:59.747057 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42216129-a31d-4a74-b4c9-8f9102ca0260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:59.747754 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42216129-a31d-4a74-b4c9-8f9102ca0260 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:59.748198 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42216129-a31d-4a74-b4c9-8f9102ca0260 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:59.748486 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42216129-a31d-4a74-b4c9-8f9102ca0260 admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:59.750731 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42216129-a31d-4a74-b4c9-8f9102ca0260 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:59.753230 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3ab324-85a0-4784-9b3e-eee34197ff5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:59.753383 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42216129-a31d-4a74-b4c9-8f9102ca0260 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:59.755319 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3ab324-85a0-4784-9b3e-eee34197ff5f admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:59.755832 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3ab324-85a0-4784-9b3e-eee34197ff5f admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:59.756555 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3ab324-85a0-4784-9b3e-eee34197ff5f admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:59.757632 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3ab324-85a0-4784-9b3e-eee34197ff5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:59.760285 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3ab324-85a0-4784-9b3e-eee34197ff5f admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:59.798139 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1016/2013] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:13:59 2022] POST /identity/v3/users => generated 292 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:13:59.799289 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42216129-a31d-4a74-b4c9-8f9102ca0260 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:59.835159 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 998/2014] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:13:59 2022] POST /identity/v3/projects => generated 373 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:13:59.835159 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3ab324-85a0-4784-9b3e-eee34197ff5f admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:13:59.840233 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42216129-a31d-4a74-b4c9-8f9102ca0260 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:13:59.945235 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1b61fa-4536-4649-a1a8-935c826e9de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:13:59.946040 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1b61fa-4536-4649-a1a8-935c826e9de7 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:13:59.946389 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1b61fa-4536-4649-a1a8-935c826e9de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:13:59.946731 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1b61fa-4536-4649-a1a8-935c826e9de7 admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:13:59.947621 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1b61fa-4536-4649-a1a8-935c826e9de7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:13:59.950106 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1b61fa-4536-4649-a1a8-935c826e9de7 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:13:59.964332 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:13:59.974130 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3ab324-85a0-4784-9b3e-eee34197ff5f admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:00.002871 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782c6305-f806-43ac-92c9-ed0d041f6e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:00.007657 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782c6305-f806-43ac-92c9-ed0d041f6e09 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:00.008174 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782c6305-f806-43ac-92c9-ed0d041f6e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:00.008464 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782c6305-f806-43ac-92c9-ed0d041f6e09 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:00.010849 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782c6305-f806-43ac-92c9-ed0d041f6e09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:00.015722 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782c6305-f806-43ac-92c9-ed0d041f6e09 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:00.019411 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1017/2015] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:13:59 2022] POST /identity/v3/projects => generated 391 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:14:00.022510 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1b61fa-4536-4649-a1a8-935c826e9de7 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:00.049163 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 999/2016] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:13:59 2022] GET /identity/v3/roles => generated 1420 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:14:00.049163 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782c6305-f806-43ac-92c9-ed0d041f6e09 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:00.077806 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782c6305-f806-43ac-92c9-ed0d041f6e09 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:00.172335 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1b61fa-4536-4649-a1a8-935c826e9de7 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:00.183426 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faf7c60-6b59-42d5-a343-de0c84f00d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:00.184245 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faf7c60-6b59-42d5-a343-de0c84f00d37 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:00.184858 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faf7c60-6b59-42d5-a343-de0c84f00d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:00.185152 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faf7c60-6b59-42d5-a343-de0c84f00d37 admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:00.185879 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faf7c60-6b59-42d5-a343-de0c84f00d37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:00.187849 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faf7c60-6b59-42d5-a343-de0c84f00d37 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:00.208553 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9db4cb-6953-4c3f-ae3b-c848a981a69a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:00.209264 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9db4cb-6953-4c3f-ae3b-c848a981a69a admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:00.209547 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9db4cb-6953-4c3f-ae3b-c848a981a69a admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:00.209824 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9db4cb-6953-4c3f-ae3b-c848a981a69a admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:00.210577 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9db4cb-6953-4c3f-ae3b-c848a981a69a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:00.212603 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9db4cb-6953-4c3f-ae3b-c848a981a69a admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:00.233563 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1018/2017] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:14:00 2022] POST /identity/v3/users => generated 287 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:14:00.234500 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faf7c60-6b59-42d5-a343-de0c84f00d37 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:00.271053 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1000/2018] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:14:00 2022] POST /identity/v3/users => generated 302 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:14:00.271802 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9db4cb-6953-4c3f-ae3b-c848a981a69a admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:00.272544 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faf7c60-6b59-42d5-a343-de0c84f00d37 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:00.290170 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3ae1fa-4f8c-4d07-b4eb-b9d5d361dc24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:00.291076 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3ae1fa-4f8c-4d07-b4eb-b9d5d361dc24 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:00.291387 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3ae1fa-4f8c-4d07-b4eb-b9d5d361dc24 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:00.291665 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3ae1fa-4f8c-4d07-b4eb-b9d5d361dc24 admin admin] PATH_INFO: `/v3/projects/06abafd34fdd4fea90decc7bec9dc63f/users/f740c6611de74dadae72b604cc5c2b33/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:00.312359 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9db4cb-6953-4c3f-ae3b-c848a981a69a admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:00.335148 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c25292-d050-475e-91e3-9efbee2decf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:00.336013 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c25292-d050-475e-91e3-9efbee2decf9 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:00.336300 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c25292-d050-475e-91e3-9efbee2decf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:00.336578 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c25292-d050-475e-91e3-9efbee2decf9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:00.337323 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c25292-d050-475e-91e3-9efbee2decf9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:00.341719 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c25292-d050-475e-91e3-9efbee2decf9 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:00.346540 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3ae1fa-4f8c-4d07-b4eb-b9d5d361dc24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06abafd34fdd4fea90decc7bec9dc63f, user_id=f740c6611de74dadae72b604cc5c2b33, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:00.353747 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3ae1fa-4f8c-4d07-b4eb-b9d5d361dc24 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:00.367639 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1001/2019] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:14:00 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:14:00.367639 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c25292-d050-475e-91e3-9efbee2decf9 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:00.382187 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1019/2020] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:14:00 2022] PUT /identity/v3/projects/06abafd34fdd4fea90decc7bec9dc63f/users/f740c6611de74dadae72b604cc5c2b33/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:14:00.384603 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3ae1fa-4f8c-4d07-b4eb-b9d5d361dc24 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:00.399575 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c25292-d050-475e-91e3-9efbee2decf9 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:00.409378 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:00.573389 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3ae1fa-4f8c-4d07-b4eb-b9d5d361dc24 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:00.580796 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64f7c71-6de4-4a56-af77-0af337de8e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:00.582725 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64f7c71-6de4-4a56-af77-0af337de8e35 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:00.583289 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64f7c71-6de4-4a56-af77-0af337de8e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:00.583825 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64f7c71-6de4-4a56-af77-0af337de8e35 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:00.584716 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64f7c71-6de4-4a56-af77-0af337de8e35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:00.587144 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64f7c71-6de4-4a56-af77-0af337de8e35 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:00.588025 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcb0a79-672e-4805-8c48-c70d446a59a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:00.598546 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcb0a79-672e-4805-8c48-c70d446a59a2 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:00.598783 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcb0a79-672e-4805-8c48-c70d446a59a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:00.599360 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcb0a79-672e-4805-8c48-c70d446a59a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:00.600476 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcb0a79-672e-4805-8c48-c70d446a59a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:00.604857 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcb0a79-672e-4805-8c48-c70d446a59a2 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:00.622051 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1020/2021] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:14:00 2022] GET /identity/v3/roles => generated 1420 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:14:00.622051 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64f7c71-6de4-4a56-af77-0af337de8e35 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:00.636904 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64f7c71-6de4-4a56-af77-0af337de8e35 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:00.642762 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10f0ecc-b038-4a9e-91f4-7a7f9e2a521e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:00.646870 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1002/2022] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:14:00 2022] GET /identity/v3/roles => generated 1420 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:14:00.646870 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcb0a79-672e-4805-8c48-c70d446a59a2 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:00.648278 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10f0ecc-b038-4a9e-91f4-7a7f9e2a521e admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:00.648891 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10f0ecc-b038-4a9e-91f4-7a7f9e2a521e admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:00.649364 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10f0ecc-b038-4a9e-91f4-7a7f9e2a521e admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:00.650314 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10f0ecc-b038-4a9e-91f4-7a7f9e2a521e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:00.652793 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10f0ecc-b038-4a9e-91f4-7a7f9e2a521e admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:00.664582 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcb0a79-672e-4805-8c48-c70d446a59a2 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:00.669352 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1021/2023] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:14:00 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:14:00.670693 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10f0ecc-b038-4a9e-91f4-7a7f9e2a521e admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:00.672232 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822b0cca-11db-4899-9908-8b57222e7201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:00.673698 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822b0cca-11db-4899-9908-8b57222e7201 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:00.674124 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822b0cca-11db-4899-9908-8b57222e7201 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:00.674458 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822b0cca-11db-4899-9908-8b57222e7201 admin admin] PATH_INFO: `/v3/projects/e761e48e603741e68de2a7f1faac1f2d/users/297aedc9c9804bf9877911af2892fcea/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:00.689682 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10f0ecc-b038-4a9e-91f4-7a7f9e2a521e admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:00.703646 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a702fcd-e05e-43e0-baef-bd1167845660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:00.705106 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a702fcd-e05e-43e0-baef-bd1167845660 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:00.705385 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a702fcd-e05e-43e0-baef-bd1167845660 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:00.706439 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a702fcd-e05e-43e0-baef-bd1167845660 admin admin] PATH_INFO: `/v3/projects/e78f7d35826d4ae388c2b1725e259e3e/users/af0f28125e7b459fbb4a4c46afe5b987/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:00.709824 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822b0cca-11db-4899-9908-8b57222e7201 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e761e48e603741e68de2a7f1faac1f2d, user_id=297aedc9c9804bf9877911af2892fcea, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:00.718908 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822b0cca-11db-4899-9908-8b57222e7201 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:00.752957 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1003/2024] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:14:00 2022] PUT /identity/v3/projects/e761e48e603741e68de2a7f1faac1f2d/users/297aedc9c9804bf9877911af2892fcea/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:14:00.753326 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a702fcd-e05e-43e0-baef-bd1167845660 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e78f7d35826d4ae388c2b1725e259e3e, user_id=af0f28125e7b459fbb4a4c46afe5b987, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:00.755902 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822b0cca-11db-4899-9908-8b57222e7201 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:00.759730 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a702fcd-e05e-43e0-baef-bd1167845660 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:00.788395 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1022/2025] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:14:00 2022] PUT /identity/v3/projects/e78f7d35826d4ae388c2b1725e259e3e/users/af0f28125e7b459fbb4a4c46afe5b987/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:14:00.790020 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd599ee8-016f-4c1a-b2bf-fb21fac8710d None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:00.790478 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd599ee8-016f-4c1a-b2bf-fb21fac8710d None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:00.790898 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd599ee8-016f-4c1a-b2bf-fb21fac8710d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:00.846191 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:00.853199 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-bd599ee8-016f-4c1a-b2bf-fb21fac8710d None None] MFA Rules not processed for user `297aedc9c9804bf9877911af2892fcea`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:14:00.855257 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-bd599ee8-016f-4c1a-b2bf-fb21fac8710d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:00.871317 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822b0cca-11db-4899-9908-8b57222e7201 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:00.943470 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1023/2026] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:14:00 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:14:00.944757 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd599ee8-016f-4c1a-b2bf-fb21fac8710d None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:00.963247 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6416f42d-0b37-4715-8f68-a9de50b7a512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:00.965373 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6416f42d-0b37-4715-8f68-a9de50b7a512 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:00.965817 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6416f42d-0b37-4715-8f68-a9de50b7a512 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:00.966814 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6416f42d-0b37-4715-8f68-a9de50b7a512 admin admin] PATH_INFO: `/v3/projects/06abafd34fdd4fea90decc7bec9dc63f/users/f740c6611de74dadae72b604cc5c2b33/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:00.969417 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6416f42d-0b37-4715-8f68-a9de50b7a512 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06abafd34fdd4fea90decc7bec9dc63f, user_id=f740c6611de74dadae72b604cc5c2b33, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:00.973032 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6416f42d-0b37-4715-8f68-a9de50b7a512 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:00.986915 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1004/2027] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:14:00 2022] PUT /identity/v3/projects/06abafd34fdd4fea90decc7bec9dc63f/users/f740c6611de74dadae72b604cc5c2b33/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:14:00.988036 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6416f42d-0b37-4715-8f68-a9de50b7a512 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:01.032041 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:01.037397 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd599ee8-016f-4c1a-b2bf-fb21fac8710d None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:01.098565 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6416f42d-0b37-4715-8f68-a9de50b7a512 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:01.107808 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9108efb-b2fc-493c-8d98-4fb957e5a899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:01.110736 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9108efb-b2fc-493c-8d98-4fb957e5a899 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:01.111253 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9108efb-b2fc-493c-8d98-4fb957e5a899 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:01.112098 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9108efb-b2fc-493c-8d98-4fb957e5a899 admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:01.114356 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9108efb-b2fc-493c-8d98-4fb957e5a899 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:01.116889 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9108efb-b2fc-493c-8d98-4fb957e5a899 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:01.121043 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d59ea3-a463-42e4-98fe-5ae98d594e9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:01.121589 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d59ea3-a463-42e4-98fe-5ae98d594e9a admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:01.121977 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d59ea3-a463-42e4-98fe-5ae98d594e9a admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:01.122364 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d59ea3-a463-42e4-98fe-5ae98d594e9a admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:01.123269 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d59ea3-a463-42e4-98fe-5ae98d594e9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:01.126061 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d59ea3-a463-42e4-98fe-5ae98d594e9a admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:01.140459 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1024/2028] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:14:00 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:14:01.142726 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f34ef2-1339-4280-ab6c-dac9477ae7f1 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:01.143274 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f34ef2-1339-4280-ab6c-dac9477ae7f1 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:01.143482 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f34ef2-1339-4280-ab6c-dac9477ae7f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:01.160663 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1005/2029] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:14:00 2022] POST /identity/v3/projects => generated 377 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:14:01.162276 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9108efb-b2fc-493c-8d98-4fb957e5a899 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:01.195071 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-39f34ef2-1339-4280-ab6c-dac9477ae7f1 None None] MFA Rules not processed for user `f740c6611de74dadae72b604cc5c2b33`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:14:01.197355 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-39f34ef2-1339-4280-ab6c-dac9477ae7f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:01.271605 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9108efb-b2fc-493c-8d98-4fb957e5a899 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:01.278188 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ad2fb9-623f-474c-aee8-e53c79f19892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:01.280181 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ad2fb9-623f-474c-aee8-e53c79f19892 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:01.280645 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ad2fb9-623f-474c-aee8-e53c79f19892 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:01.281374 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ad2fb9-623f-474c-aee8-e53c79f19892 admin admin] PATH_INFO: `/v3/projects/e78f7d35826d4ae388c2b1725e259e3e/users/af0f28125e7b459fbb4a4c46afe5b987/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:01.284050 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ad2fb9-623f-474c-aee8-e53c79f19892 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e78f7d35826d4ae388c2b1725e259e3e, user_id=af0f28125e7b459fbb4a4c46afe5b987, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:01.290327 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ad2fb9-623f-474c-aee8-e53c79f19892 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:01.309427 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1006/2030] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:14:01 2022] PUT /identity/v3/projects/e78f7d35826d4ae388c2b1725e259e3e/users/af0f28125e7b459fbb4a4c46afe5b987/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:14:01.310915 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ad2fb9-623f-474c-aee8-e53c79f19892 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:01.316396 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:01.355341 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1025/2031] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:14:01 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:14:01.358310 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110a1aa6-dbee-487b-8292-72ebd4b2830d None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:01.358599 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110a1aa6-dbee-487b-8292-72ebd4b2830d None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:01.358874 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110a1aa6-dbee-487b-8292-72ebd4b2830d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:01.400836 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ad2fb9-623f-474c-aee8-e53c79f19892 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:01.401274 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-110a1aa6-dbee-487b-8292-72ebd4b2830d None None] MFA Rules not processed for user `af0f28125e7b459fbb4a4c46afe5b987`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:14:01.402627 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-110a1aa6-dbee-487b-8292-72ebd4b2830d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:01.427578 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b89cbd-9b89-4afc-8c12-2b11b7c24943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:01.429148 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b89cbd-9b89-4afc-8c12-2b11b7c24943 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:01.429640 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b89cbd-9b89-4afc-8c12-2b11b7c24943 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:01.430116 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b89cbd-9b89-4afc-8c12-2b11b7c24943 admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:01.440361 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b89cbd-9b89-4afc-8c12-2b11b7c24943 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:01.447446 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b89cbd-9b89-4afc-8c12-2b11b7c24943 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:01.484479 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1007/2032] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:14:01 2022] POST /identity/v3/users => generated 295 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:14:01.486932 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f460ccb2-2c30-4b78-a273-ff7cd700b3e1 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:01.487858 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f460ccb2-2c30-4b78-a273-ff7cd700b3e1 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:01.488406 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f460ccb2-2c30-4b78-a273-ff7cd700b3e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:01.515424 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-f460ccb2-2c30-4b78-a273-ff7cd700b3e1 None None] MFA Rules not processed for user `0133d9533fbd4be5b46dc308dbe3a7d9`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:14:01.522745 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-f460ccb2-2c30-4b78-a273-ff7cd700b3e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:01.595826 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1008/2033] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:14:01 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:14:01.597035 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f460ccb2-2c30-4b78-a273-ff7cd700b3e1 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:01.603433 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1026/2034] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:14:01 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:14:01.608636 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110a1aa6-dbee-487b-8292-72ebd4b2830d None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:01.609741 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-110a1aa6-dbee-487b-8292-72ebd4b2830d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:01.625087 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f460ccb2-2c30-4b78-a273-ff7cd700b3e1 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:01.628681 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:01.634292 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f8aa8c-5b40-43ea-aaff-2212aa296954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:01.635265 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f8aa8c-5b40-43ea-aaff-2212aa296954 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:01.635762 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f8aa8c-5b40-43ea-aaff-2212aa296954 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:01.636190 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f8aa8c-5b40-43ea-aaff-2212aa296954 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:01.639203 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f8aa8c-5b40-43ea-aaff-2212aa296954 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:01.643013 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f8aa8c-5b40-43ea-aaff-2212aa296954 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:01.658332 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1009/2035] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:14:01 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:14:01.659825 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f8aa8c-5b40-43ea-aaff-2212aa296954 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:01.662318 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-99f8aa8c-5b40-43ea-aaff-2212aa296954 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:01.720472 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110a1aa6-dbee-487b-8292-72ebd4b2830d None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:01.726993 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11a1f59-f50b-494e-b16a-9116c2420c6c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:01.728094 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11a1f59-f50b-494e-b16a-9116c2420c6c service nova] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:01.728529 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11a1f59-f50b-494e-b16a-9116c2420c6c service nova] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:01.728971 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11a1f59-f50b-494e-b16a-9116c2420c6c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:01.741329 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11a1f59-f50b-494e-b16a-9116c2420c6c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:01.743997 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11a1f59-f50b-494e-b16a-9116c2420c6c service nova] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:01.766699 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1027/2036] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:14:01 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:14:01.768681 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11a1f59-f50b-494e-b16a-9116c2420c6c service nova] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:01.799330 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f8aa8c-5b40-43ea-aaff-2212aa296954 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:01.803428 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11a1f59-f50b-494e-b16a-9116c2420c6c service nova] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:01.820975 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c9077e-d8a0-48e5-afb4-a12e0d964761 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:01.821536 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c9077e-d8a0-48e5-afb4-a12e0d964761 service nova] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:01.826324 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c9077e-d8a0-48e5-afb4-a12e0d964761 service nova] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:01.826611 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c9077e-d8a0-48e5-afb4-a12e0d964761 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:01.862093 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b59097-40e8-47df-8b23-bee46dc847e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:01.865560 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b59097-40e8-47df-8b23-bee46dc847e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:01.867128 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b59097-40e8-47df-8b23-bee46dc847e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:01.867614 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b59097-40e8-47df-8b23-bee46dc847e5 admin admin] PATH_INFO: `/v3/projects/db0e0608b1c3423f9c536bab6130117e/users/5f23552e8fd646a7b74bc86031412e19/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:01.876850 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c9077e-d8a0-48e5-afb4-a12e0d964761 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:01.885803 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c9077e-d8a0-48e5-afb4-a12e0d964761 service nova] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:01.904567 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b59097-40e8-47df-8b23-bee46dc847e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db0e0608b1c3423f9c536bab6130117e, user_id=5f23552e8fd646a7b74bc86031412e19, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:01.919125 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b59097-40e8-47df-8b23-bee46dc847e5 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:01.943458 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1010/2037] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:14:01 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:14:01.944671 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1028/2038] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:14:01 2022] PUT /identity/v3/projects/db0e0608b1c3423f9c536bab6130117e/users/5f23552e8fd646a7b74bc86031412e19/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:14:01.948118 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c9077e-d8a0-48e5-afb4-a12e0d964761 service nova] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:01.960975 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c9077e-d8a0-48e5-afb4-a12e0d964761 service nova] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:01.970245 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:02.078975 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c03e49-a6fb-4d33-893f-d400a22ce7ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:02.079897 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c03e49-a6fb-4d33-893f-d400a22ce7ef admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:02.080465 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c03e49-a6fb-4d33-893f-d400a22ce7ef admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:02.080694 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c03e49-a6fb-4d33-893f-d400a22ce7ef admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:02.081451 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c03e49-a6fb-4d33-893f-d400a22ce7ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:02.086139 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c03e49-a6fb-4d33-893f-d400a22ce7ef admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:02.116900 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1011/2039] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:14:01 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:14:02.121780 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b59097-40e8-47df-8b23-bee46dc847e5 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:02.138892 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b59097-40e8-47df-8b23-bee46dc847e5 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:02.150616 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011df5f6-bc34-432d-9484-a44678ca1897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:02.153160 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011df5f6-bc34-432d-9484-a44678ca1897 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:02.154164 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011df5f6-bc34-432d-9484-a44678ca1897 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:02.154515 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011df5f6-bc34-432d-9484-a44678ca1897 admin admin] PATH_INFO: `/v3/projects/db0e0608b1c3423f9c536bab6130117e/users/5f23552e8fd646a7b74bc86031412e19/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:02.159277 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011df5f6-bc34-432d-9484-a44678ca1897 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db0e0608b1c3423f9c536bab6130117e, user_id=5f23552e8fd646a7b74bc86031412e19, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:02.172086 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011df5f6-bc34-432d-9484-a44678ca1897 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:02.206540 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1029/2040] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:14:02 2022] PUT /identity/v3/projects/db0e0608b1c3423f9c536bab6130117e/users/5f23552e8fd646a7b74bc86031412e19/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:14:02.220390 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcae3048-9747-4ca6-a274-b2b8e8260bb7 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:02.220732 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcae3048-9747-4ca6-a274-b2b8e8260bb7 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:02.222138 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcae3048-9747-4ca6-a274-b2b8e8260bb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:02.290840 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-bcae3048-9747-4ca6-a274-b2b8e8260bb7 None None] MFA Rules not processed for user `5f23552e8fd646a7b74bc86031412e19`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:14:02.293419 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-bcae3048-9747-4ca6-a274-b2b8e8260bb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:02.427297 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1012/2041] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:14:02 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:14:02.811953 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ba60c7-5efe-461f-a883-ef6065939036 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:02.812448 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ba60c7-5efe-461f-a883-ef6065939036 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:02.812539 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ba60c7-5efe-461f-a883-ef6065939036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:02.839778 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-23ba60c7-5efe-461f-a883-ef6065939036 None None] MFA Rules not processed for user `199522d29cb746379cb6f75d4b108cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:14:02.841334 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-23ba60c7-5efe-461f-a883-ef6065939036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:02.972357 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1030/2042] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:14:02 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:14:03.033165 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcae3048-9747-4ca6-a274-b2b8e8260bb7 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:03.267351 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcae3048-9747-4ca6-a274-b2b8e8260bb7 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:03.287273 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03609ea-4c86-4577-a77b-ef93d38ccfec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:03.288243 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03609ea-4c86-4577-a77b-ef93d38ccfec service nova] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:03.288772 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03609ea-4c86-4577-a77b-ef93d38ccfec service nova] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:03.289281 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03609ea-4c86-4577-a77b-ef93d38ccfec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:03.309907 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03609ea-4c86-4577-a77b-ef93d38ccfec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:03.311734 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03609ea-4c86-4577-a77b-ef93d38ccfec service nova] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:03.344430 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1013/2043] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:14:03 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:14:03.594584 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ba60c7-5efe-461f-a883-ef6065939036 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:03.778379 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ba60c7-5efe-461f-a883-ef6065939036 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:03.787596 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8426d5-0f5b-4c71-b411-63c171cf0ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:03.788836 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8426d5-0f5b-4c71-b411-63c171cf0ccd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:03.789354 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8426d5-0f5b-4c71-b411-63c171cf0ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:03.789899 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8426d5-0f5b-4c71-b411-63c171cf0ccd admin admin] PATH_INFO: `/v3/users/7d86f24a21cc4e8bb931d3a65c76ace8` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:03.791648 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8426d5-0f5b-4c71-b411-63c171cf0ccd admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d86f24a21cc4e8bb931d3a65c76ace8)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:03.798661 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8426d5-0f5b-4c71-b411-63c171cf0ccd admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:03.807113 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:03.980165 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-7f8426d5-0f5b-4c71-b411-63c171cf0ccd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d86f24a21cc4e8bb931d3a65c76ace8'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:03.981551 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-7f8426d5-0f5b-4c71-b411-63c171cf0ccd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d86f24a21cc4e8bb931d3a65c76ace8'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:04.001471 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-7f8426d5-0f5b-4c71-b411-63c171cf0ccd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d86f24a21cc4e8bb931d3a65c76ace8'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:04.023219 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-7f8426d5-0f5b-4c71-b411-63c171cf0ccd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d86f24a21cc4e8bb931d3a65c76ace8'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:04.045779 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-7f8426d5-0f5b-4c71-b411-63c171cf0ccd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d86f24a21cc4e8bb931d3a65c76ace8'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:04.059577 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1031/2044] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:14:03 2022] DELETE /identity/v3/users/7d86f24a21cc4e8bb931d3a65c76ace8 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:14:04.060652 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a7971e-7dc8-49d5-988d-e285f2f53947 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:04.060943 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a7971e-7dc8-49d5-988d-e285f2f53947 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:04.061222 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a7971e-7dc8-49d5-988d-e285f2f53947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:04.112749 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-29a7971e-7dc8-49d5-988d-e285f2f53947 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:14:04.118387 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-29a7971e-7dc8-49d5-988d-e285f2f53947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:04.176515 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:04.330740 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1014/2045] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:14:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:14:04.342304 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8426d5-0f5b-4c71-b411-63c171cf0ccd admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:04.343971 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-7f8426d5-0f5b-4c71-b411-63c171cf0ccd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:04.522341 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8426d5-0f5b-4c71-b411-63c171cf0ccd admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:04.527352 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f67dcd2-bd19-4e9d-b379-326b6e76a455 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:04.528062 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f67dcd2-bd19-4e9d-b379-326b6e76a455 service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:04.528346 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f67dcd2-bd19-4e9d-b379-326b6e76a455 service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:04.528618 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f67dcd2-bd19-4e9d-b379-326b6e76a455 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:04.558296 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f67dcd2-bd19-4e9d-b379-326b6e76a455 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:04.569430 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f67dcd2-bd19-4e9d-b379-326b6e76a455 service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:04.589594 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1032/2046] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:14:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:14:05.719740 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a7971e-7dc8-49d5-988d-e285f2f53947 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:05.721992 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-29a7971e-7dc8-49d5-988d-e285f2f53947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:05.741620 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a7971e-7dc8-49d5-988d-e285f2f53947 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:05.756725 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b1184f-4986-4504-a6ce-fd08796e4f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:05.757738 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b1184f-4986-4504-a6ce-fd08796e4f5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:05.758120 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b1184f-4986-4504-a6ce-fd08796e4f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:05.758455 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b1184f-4986-4504-a6ce-fd08796e4f5c admin admin] PATH_INFO: `/v3/projects/e6aeead482c4469c87a75947dd10de66` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:05.761251 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b1184f-4986-4504-a6ce-fd08796e4f5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6aeead482c4469c87a75947dd10de66)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:05.765492 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b1184f-4986-4504-a6ce-fd08796e4f5c admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:05.884300 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-f5b1184f-4986-4504-a6ce-fd08796e4f5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6aeead482c4469c87a75947dd10de66', 'request_id': 'req-f5b1184f-4986-4504-a6ce-fd08796e4f5c'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:05.919506 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-f5b1184f-4986-4504-a6ce-fd08796e4f5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6aeead482c4469c87a75947dd10de66', 'request_id': 'req-f5b1184f-4986-4504-a6ce-fd08796e4f5c'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:05.929005 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f67dcd2-bd19-4e9d-b379-326b6e76a455 service neutron] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:05.936336 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-3f67dcd2-bd19-4e9d-b379-326b6e76a455 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:05.954647 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-f5b1184f-4986-4504-a6ce-fd08796e4f5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6aeead482c4469c87a75947dd10de66', 'request_id': 'req-f5b1184f-4986-4504-a6ce-fd08796e4f5c'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:05.975262 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-f5b1184f-4986-4504-a6ce-fd08796e4f5c admin admin] The token cache is being invalidate because project e6aeead482c4469c87a75947dd10de66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:14:05.989283 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-f5b1184f-4986-4504-a6ce-fd08796e4f5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:05.992804 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-f5b1184f-4986-4504-a6ce-fd08796e4f5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:06.005791 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1015/2047] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:14:05 2022] DELETE /identity/v3/projects/e6aeead482c4469c87a75947dd10de66 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:14:06.009217 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b1184f-4986-4504-a6ce-fd08796e4f5c admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:06.013080 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-f5b1184f-4986-4504-a6ce-fd08796e4f5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:06.107819 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f67dcd2-bd19-4e9d-b379-326b6e76a455 service neutron] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:06.176743 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:06.192056 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b1184f-4986-4504-a6ce-fd08796e4f5c admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:06.208716 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020d9684-b24f-4a00-8439-d8abb03c4b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:06.210288 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020d9684-b24f-4a00-8439-d8abb03c4b4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:06.211336 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020d9684-b24f-4a00-8439-d8abb03c4b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:06.211608 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020d9684-b24f-4a00-8439-d8abb03c4b4c admin admin] PATH_INFO: `/v3/users/af0f28125e7b459fbb4a4c46afe5b987` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:06.217304 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020d9684-b24f-4a00-8439-d8abb03c4b4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=af0f28125e7b459fbb4a4c46afe5b987)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:06.217496 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020d9684-b24f-4a00-8439-d8abb03c4b4c admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:06.308820 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f810ac7-2dfc-4966-abde-cb8f3081d7f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:06.309559 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f810ac7-2dfc-4966-abde-cb8f3081d7f6 service nova] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:06.309876 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f810ac7-2dfc-4966-abde-cb8f3081d7f6 service nova] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:06.310159 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f810ac7-2dfc-4966-abde-cb8f3081d7f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:06.314984 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-1f810ac7-2dfc-4966-abde-cb8f3081d7f6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:06.361553 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:06.369096 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-020d9684-b24f-4a00-8439-d8abb03c4b4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af0f28125e7b459fbb4a4c46afe5b987'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:06.403879 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-020d9684-b24f-4a00-8439-d8abb03c4b4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af0f28125e7b459fbb4a4c46afe5b987'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:06.404524 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-020d9684-b24f-4a00-8439-d8abb03c4b4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af0f28125e7b459fbb4a4c46afe5b987'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:06.433191 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-020d9684-b24f-4a00-8439-d8abb03c4b4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af0f28125e7b459fbb4a4c46afe5b987'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:06.461032 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-020d9684-b24f-4a00-8439-d8abb03c4b4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af0f28125e7b459fbb4a4c46afe5b987'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:06.472251 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1016/2048] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:14:06 2022] DELETE /identity/v3/users/af0f28125e7b459fbb4a4c46afe5b987 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:14:06.490905 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f810ac7-2dfc-4966-abde-cb8f3081d7f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:06.492544 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f810ac7-2dfc-4966-abde-cb8f3081d7f6 service nova] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:06.545577 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1033/2049] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:14:05 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 617 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:14:08.128997 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336d087d-50b3-4828-a35c-ef16f79a1657 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:08.129562 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336d087d-50b3-4828-a35c-ef16f79a1657 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:08.129562 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336d087d-50b3-4828-a35c-ef16f79a1657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:08.158922 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f810ac7-2dfc-4966-abde-cb8f3081d7f6 service nova] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:08.180873 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f810ac7-2dfc-4966-abde-cb8f3081d7f6 service nova] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:08.223027 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-336d087d-50b3-4828-a35c-ef16f79a1657 None None] MFA Rules not processed for user `a47a7cc74c1041c68d49ab37ef3e2643`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:14:08.225397 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-336d087d-50b3-4828-a35c-ef16f79a1657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:08.384251 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1017/2050] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:14:08 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:14:08.386958 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37344403-5979-47ab-9763-4d345c4a4e65 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:08.389376 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37344403-5979-47ab-9763-4d345c4a4e65 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:08.389662 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37344403-5979-47ab-9763-4d345c4a4e65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:08.391205 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e921d85-6ef3-48df-b7e5-7deee0d19ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:08.392196 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e921d85-6ef3-48df-b7e5-7deee0d19ca7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:08.392477 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e921d85-6ef3-48df-b7e5-7deee0d19ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:08.392748 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e921d85-6ef3-48df-b7e5-7deee0d19ca7 admin admin] PATH_INFO: `/v3/projects/e78f7d35826d4ae388c2b1725e259e3e` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:08.393995 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e921d85-6ef3-48df-b7e5-7deee0d19ca7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e78f7d35826d4ae388c2b1725e259e3e)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:08.397150 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e921d85-6ef3-48df-b7e5-7deee0d19ca7 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:08.434095 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-37344403-5979-47ab-9763-4d345c4a4e65 None None] MFA Rules not processed for user `f2672c5db79b4a48a505c3df536594dd`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:14:08.452073 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-37344403-5979-47ab-9763-4d345c4a4e65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:08.544255 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-7e921d85-6ef3-48df-b7e5-7deee0d19ca7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e78f7d35826d4ae388c2b1725e259e3e', 'request_id': 'req-7e921d85-6ef3-48df-b7e5-7deee0d19ca7'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:08.574996 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-7e921d85-6ef3-48df-b7e5-7deee0d19ca7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e78f7d35826d4ae388c2b1725e259e3e', 'request_id': 'req-7e921d85-6ef3-48df-b7e5-7deee0d19ca7'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:08.593620 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:08.600616 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-7e921d85-6ef3-48df-b7e5-7deee0d19ca7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e78f7d35826d4ae388c2b1725e259e3e', 'request_id': 'req-7e921d85-6ef3-48df-b7e5-7deee0d19ca7'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:08.632162 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-7e921d85-6ef3-48df-b7e5-7deee0d19ca7 admin admin] The token cache is being invalidate because project e78f7d35826d4ae388c2b1725e259e3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:14:08.638930 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-7e921d85-6ef3-48df-b7e5-7deee0d19ca7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:08.645918 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-7e921d85-6ef3-48df-b7e5-7deee0d19ca7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:08.648706 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1018/2051] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:14:08 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:14:08.651866 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1034/2052] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:14:08 2022] DELETE /identity/v3/projects/e78f7d35826d4ae388c2b1725e259e3e => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:14:08.660296 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1893eb29-44ad-481c-bfdd-fdc4f676e022 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:08.660680 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1893eb29-44ad-481c-bfdd-fdc4f676e022 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:08.660966 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1893eb29-44ad-481c-bfdd-fdc4f676e022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:08.733283 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-1893eb29-44ad-481c-bfdd-fdc4f676e022 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:14:08.746890 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-1893eb29-44ad-481c-bfdd-fdc4f676e022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:08.899089 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:08.967447 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1019/2053] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:14:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:14:08.968767 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7018f8d3-5a57-456c-9d98-02c9af32ed1b None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:08.969160 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7018f8d3-5a57-456c-9d98-02c9af32ed1b None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:08.969555 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7018f8d3-5a57-456c-9d98-02c9af32ed1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:08.981127 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1893eb29-44ad-481c-bfdd-fdc4f676e022 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:08.984603 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-1893eb29-44ad-481c-bfdd-fdc4f676e022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:09.011017 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-7018f8d3-5a57-456c-9d98-02c9af32ed1b None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:14:09.013095 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-7018f8d3-5a57-456c-9d98-02c9af32ed1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:09.043569 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1035/2054] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:14:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:14:09.043569 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7018f8d3-5a57-456c-9d98-02c9af32ed1b None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:09.059932 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7018f8d3-5a57-456c-9d98-02c9af32ed1b None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:09.071237 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c29c9a-1a48-43e9-93ac-afea9707244b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:09.072024 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c29c9a-1a48-43e9-93ac-afea9707244b admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:09.072362 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c29c9a-1a48-43e9-93ac-afea9707244b admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:09.072708 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c29c9a-1a48-43e9-93ac-afea9707244b admin admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:09.073531 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c29c9a-1a48-43e9-93ac-afea9707244b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:14:09.073923 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c29c9a-1a48-43e9-93ac-afea9707244b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:09.075864 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c29c9a-1a48-43e9-93ac-afea9707244b admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:09.124768 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1036/2055] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:14:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:14:09.129439 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c29c9a-1a48-43e9-93ac-afea9707244b admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:09.161650 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c29c9a-1a48-43e9-93ac-afea9707244b admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:09.175066 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8428b1-a44e-46ff-b231-68ed76f7ee86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:09.176769 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8428b1-a44e-46ff-b231-68ed76f7ee86 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:09.177313 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8428b1-a44e-46ff-b231-68ed76f7ee86 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:09.177826 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8428b1-a44e-46ff-b231-68ed76f7ee86 admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:09.178826 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8428b1-a44e-46ff-b231-68ed76f7ee86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:09.183341 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8428b1-a44e-46ff-b231-68ed76f7ee86 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:09.210545 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1893eb29-44ad-481c-bfdd-fdc4f676e022 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:09.231198 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c866e3ec-dd5e-49d2-83f7-c3699b965514 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:09.231883 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c866e3ec-dd5e-49d2-83f7-c3699b965514 service nova] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:09.236663 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c866e3ec-dd5e-49d2-83f7-c3699b965514 service nova] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:09.236663 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c866e3ec-dd5e-49d2-83f7-c3699b965514 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:09.239476 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-c866e3ec-dd5e-49d2-83f7-c3699b965514 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:09.246022 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1037/2056] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:14:09 2022] POST /identity/v3/projects => generated 397 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:14:09.251520 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8428b1-a44e-46ff-b231-68ed76f7ee86 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:09.402996 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c866e3ec-dd5e-49d2-83f7-c3699b965514 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:09.406397 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c866e3ec-dd5e-49d2-83f7-c3699b965514 service nova] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:09.426633 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8428b1-a44e-46ff-b231-68ed76f7ee86 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:09.440393 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1020/2057] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:14:08 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 23 21:14:09.442215 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e61577-fd19-4ba0-ae35-4d74c842c5c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:09.443254 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e61577-fd19-4ba0-ae35-4d74c842c5c9 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:09.443753 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e61577-fd19-4ba0-ae35-4d74c842c5c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:09.444230 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e61577-fd19-4ba0-ae35-4d74c842c5c9 admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:09.445141 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e61577-fd19-4ba0-ae35-4d74c842c5c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:09.448137 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e61577-fd19-4ba0-ae35-4d74c842c5c9 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:09.530528 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1038/2058] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:14:09 2022] POST /identity/v3/users => generated 299 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:14:09.535344 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c866e3ec-dd5e-49d2-83f7-c3699b965514 service nova] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:09.548325 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c866e3ec-dd5e-49d2-83f7-c3699b965514 service nova] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:09.561044 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a14948-51ae-421e-80ab-66988e420b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:09.563125 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a14948-51ae-421e-80ab-66988e420b39 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:09.563510 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a14948-51ae-421e-80ab-66988e420b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:09.565297 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a14948-51ae-421e-80ab-66988e420b39 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:09.566491 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a14948-51ae-421e-80ab-66988e420b39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:09.571213 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a14948-51ae-421e-80ab-66988e420b39 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:09.594661 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1021/2059] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:14:09 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:14:09.598529 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e61577-fd19-4ba0-ae35-4d74c842c5c9 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:09.611285 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e61577-fd19-4ba0-ae35-4d74c842c5c9 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:09.617692 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b8adf8-de54-4416-acda-ea3054f544ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:09.618912 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b8adf8-de54-4416-acda-ea3054f544ce admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:09.619678 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b8adf8-de54-4416-acda-ea3054f544ce admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:09.620256 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b8adf8-de54-4416-acda-ea3054f544ce admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:09.621265 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b8adf8-de54-4416-acda-ea3054f544ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:09.623172 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b8adf8-de54-4416-acda-ea3054f544ce admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:09.655716 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1039/2060] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:14:09 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:14:09.660566 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a14948-51ae-421e-80ab-66988e420b39 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:09.675227 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a14948-51ae-421e-80ab-66988e420b39 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:09.680479 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe12b0a9-0314-4270-b9e4-258db06a18ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:09.684026 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe12b0a9-0314-4270-b9e4-258db06a18ad admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:09.684301 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe12b0a9-0314-4270-b9e4-258db06a18ad admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:09.684578 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe12b0a9-0314-4270-b9e4-258db06a18ad admin admin] PATH_INFO: `/v3/projects/30dcc0dd92cc4ece9f1810ba760a8b1c/users/f92b0abcebcf4ef49dd02002a0f477ab/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:09.711520 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe12b0a9-0314-4270-b9e4-258db06a18ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=30dcc0dd92cc4ece9f1810ba760a8b1c, user_id=f92b0abcebcf4ef49dd02002a0f477ab, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:09.714756 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe12b0a9-0314-4270-b9e4-258db06a18ad admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:09.738726 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b8adf8-de54-4416-acda-ea3054f544ce admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:09.741164 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-a5b8adf8-de54-4416-acda-ea3054f544ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:09.746784 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1022/2061] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:14:09 2022] PUT /identity/v3/projects/30dcc0dd92cc4ece9f1810ba760a8b1c/users/f92b0abcebcf4ef49dd02002a0f477ab/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:14:09.760226 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c58169-d070-460c-8dc6-3d93a7b11abe None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:09.760520 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c58169-d070-460c-8dc6-3d93a7b11abe None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:09.760848 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c58169-d070-460c-8dc6-3d93a7b11abe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:09.767441 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b8adf8-de54-4416-acda-ea3054f544ce admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:09.835778 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-65c58169-d070-460c-8dc6-3d93a7b11abe None None] MFA Rules not processed for user `f92b0abcebcf4ef49dd02002a0f477ab`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:14:09.837716 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-65c58169-d070-460c-8dc6-3d93a7b11abe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:09.915416 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f064f68e-6d32-4a47-9f4f-f18f15f16f0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:09.916731 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f064f68e-6d32-4a47-9f4f-f18f15f16f0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:09.917193 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f064f68e-6d32-4a47-9f4f-f18f15f16f0f admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:09.924666 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f064f68e-6d32-4a47-9f4f-f18f15f16f0f admin admin] PATH_INFO: `/v3/users/297aedc9c9804bf9877911af2892fcea` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:09.924666 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f064f68e-6d32-4a47-9f4f-f18f15f16f0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=297aedc9c9804bf9877911af2892fcea)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:09.930470 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f064f68e-6d32-4a47-9f4f-f18f15f16f0f admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:09.938095 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:10.007191 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:10.007746 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1023/2062] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:14:09 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:14:10.012968 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c58169-d070-460c-8dc6-3d93a7b11abe None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:10.028298 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c58169-d070-460c-8dc6-3d93a7b11abe None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:10.036480 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c66ec27-f4ca-4b5c-a32f-2fa5b14eab67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:10.037328 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c66ec27-f4ca-4b5c-a32f-2fa5b14eab67 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:10.037773 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c66ec27-f4ca-4b5c-a32f-2fa5b14eab67 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:10.038191 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c66ec27-f4ca-4b5c-a32f-2fa5b14eab67 admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:10.039288 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c66ec27-f4ca-4b5c-a32f-2fa5b14eab67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:10.042882 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c66ec27-f4ca-4b5c-a32f-2fa5b14eab67 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:10.048233 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-f064f68e-6d32-4a47-9f4f-f18f15f16f0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '297aedc9c9804bf9877911af2892fcea'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:10.049301 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-f064f68e-6d32-4a47-9f4f-f18f15f16f0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '297aedc9c9804bf9877911af2892fcea'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:10.059604 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-f064f68e-6d32-4a47-9f4f-f18f15f16f0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '297aedc9c9804bf9877911af2892fcea'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:10.083779 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-f064f68e-6d32-4a47-9f4f-f18f15f16f0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '297aedc9c9804bf9877911af2892fcea'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:10.111605 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1024/2063] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:14:10 2022] POST /identity/v3/projects => generated 399 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:14:10.114118 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c66ec27-f4ca-4b5c-a32f-2fa5b14eab67 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:10.124973 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-f064f68e-6d32-4a47-9f4f-f18f15f16f0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '297aedc9c9804bf9877911af2892fcea'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:10.160033 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1040/2064] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:14:09 2022] DELETE /identity/v3/users/297aedc9c9804bf9877911af2892fcea => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:14:10.167144 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b296ac1f-d2ed-4a8e-8a1b-6bcdb1074590 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:10.167699 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b296ac1f-d2ed-4a8e-8a1b-6bcdb1074590 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:10.169048 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b296ac1f-d2ed-4a8e-8a1b-6bcdb1074590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:10.214340 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-b296ac1f-d2ed-4a8e-8a1b-6bcdb1074590 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:14:10.215651 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-b296ac1f-d2ed-4a8e-8a1b-6bcdb1074590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:10.277307 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c66ec27-f4ca-4b5c-a32f-2fa5b14eab67 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:10.351160 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1041/2065] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:14:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:14:10.396436 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f12044-38f0-469c-aed3-ad73f515f773 None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:10.397630 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f12044-38f0-469c-aed3-ad73f515f773 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:10.397929 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f12044-38f0-469c-aed3-ad73f515f773 None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:10.399512 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1042/2066] 10.222.0.17 () {54 vars in 912 bytes} [Sat Jul 23 21:14:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 23 21:14:10.406145 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8734f80b-35b1-4c76-a855-121b928375a0 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:10.406336 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8734f80b-35b1-4c76-a855-121b928375a0 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:10.406867 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8734f80b-35b1-4c76-a855-121b928375a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:10.437465 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e65c93-8dea-4ee6-922b-bd02828bb912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:10.439424 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e65c93-8dea-4ee6-922b-bd02828bb912 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:10.439858 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e65c93-8dea-4ee6-922b-bd02828bb912 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:10.440273 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e65c93-8dea-4ee6-922b-bd02828bb912 admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:10.440385 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-8734f80b-35b1-4c76-a855-121b928375a0 None None] MFA Rules not processed for user `c497326ee890462e8f48b4a56f81990c`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:14:10.441220 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e65c93-8dea-4ee6-922b-bd02828bb912 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:10.443410 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-8734f80b-35b1-4c76-a855-121b928375a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:10.448018 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e65c93-8dea-4ee6-922b-bd02828bb912 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:10.503059 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1025/2067] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:14:10 2022] POST /identity/v3/users => generated 306 bytes in 390 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:14:10.504100 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e65c93-8dea-4ee6-922b-bd02828bb912 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:10.516919 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-d8e65c93-8dea-4ee6-922b-bd02828bb912 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:10.619037 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1043/2068] 10.222.0.17 () {58 vars in 1009 bytes} [Sat Jul 23 21:14:10 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:14:10.620491 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8734f80b-35b1-4c76-a855-121b928375a0 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:10.622881 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-8734f80b-35b1-4c76-a855-121b928375a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:10.641910 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e65c93-8dea-4ee6-922b-bd02828bb912 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:10.647389 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023f9597-a249-4fe2-8bcb-2d9977a0f5ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:10.648130 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023f9597-a249-4fe2-8bcb-2d9977a0f5ab service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:10.648507 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023f9597-a249-4fe2-8bcb-2d9977a0f5ab service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:10.649892 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023f9597-a249-4fe2-8bcb-2d9977a0f5ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:10.662630 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023f9597-a249-4fe2-8bcb-2d9977a0f5ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:10.664630 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8734f80b-35b1-4c76-a855-121b928375a0 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:10.664770 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023f9597-a249-4fe2-8bcb-2d9977a0f5ab service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:10.672060 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:10.677907 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49286de-8b2b-4dd1-ae80-499dc1db128b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:10.678957 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49286de-8b2b-4dd1-ae80-499dc1db128b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:10.679216 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49286de-8b2b-4dd1-ae80-499dc1db128b admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:10.679489 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49286de-8b2b-4dd1-ae80-499dc1db128b admin admin] PATH_INFO: `/v3/users/ee8af4b5701d43cf912997b74b432821` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:10.680896 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49286de-8b2b-4dd1-ae80-499dc1db128b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee8af4b5701d43cf912997b74b432821)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:10.682147 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1026/2069] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:14:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:14:10.683205 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023f9597-a249-4fe2-8bcb-2d9977a0f5ab service neutron] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:10.683315 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49286de-8b2b-4dd1-ae80-499dc1db128b admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:10.687026 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-023f9597-a249-4fe2-8bcb-2d9977a0f5ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:10.706136 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023f9597-a249-4fe2-8bcb-2d9977a0f5ab service neutron] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:10.719926 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74bd55e-8df4-4e9b-9b37-4d41288e0a06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:10.720626 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74bd55e-8df4-4e9b-9b37-4d41288e0a06 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:10.720903 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74bd55e-8df4-4e9b-9b37-4d41288e0a06 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:10.721173 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74bd55e-8df4-4e9b-9b37-4d41288e0a06 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:10.729285 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74bd55e-8df4-4e9b-9b37-4d41288e0a06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:10.729285 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74bd55e-8df4-4e9b-9b37-4d41288e0a06 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:10.744693 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1027/2070] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:14:10 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:14:10.745719 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74bd55e-8df4-4e9b-9b37-4d41288e0a06 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:10.776696 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74bd55e-8df4-4e9b-9b37-4d41288e0a06 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:10.782295 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379550ba-383e-493e-9d6d-1b9a7c24ed96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:10.784025 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379550ba-383e-493e-9d6d-1b9a7c24ed96 service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:10.784371 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379550ba-383e-493e-9d6d-1b9a7c24ed96 service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:10.784912 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379550ba-383e-493e-9d6d-1b9a7c24ed96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:10.787010 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-f49286de-8b2b-4dd1-ae80-499dc1db128b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee8af4b5701d43cf912997b74b432821'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:10.788002 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-f49286de-8b2b-4dd1-ae80-499dc1db128b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee8af4b5701d43cf912997b74b432821'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:10.799798 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379550ba-383e-493e-9d6d-1b9a7c24ed96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:10.801261 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379550ba-383e-493e-9d6d-1b9a7c24ed96 service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:10.811543 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1028/2071] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:14:10 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:14:10.814167 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379550ba-383e-493e-9d6d-1b9a7c24ed96 service neutron] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:10.827486 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-f49286de-8b2b-4dd1-ae80-499dc1db128b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee8af4b5701d43cf912997b74b432821'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:10.832467 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:10.846879 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379550ba-383e-493e-9d6d-1b9a7c24ed96 service neutron] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:10.849465 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-f49286de-8b2b-4dd1-ae80-499dc1db128b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee8af4b5701d43cf912997b74b432821'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:10.860135 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226aa4fd-2d35-4c18-84d5-228ee65001c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:10.861898 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226aa4fd-2d35-4c18-84d5-228ee65001c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:10.862698 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226aa4fd-2d35-4c18-84d5-228ee65001c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:10.862698 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226aa4fd-2d35-4c18-84d5-228ee65001c2 admin admin] PATH_INFO: `/v3/projects/638e3886481548668ccddebb3eabfa12/users/c03fe65aa9364b8a94f79f887387d260/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:10.882273 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-f49286de-8b2b-4dd1-ae80-499dc1db128b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee8af4b5701d43cf912997b74b432821'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:10.890653 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1044/2072] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:14:10 2022] DELETE /identity/v3/users/ee8af4b5701d43cf912997b74b432821 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:14:10.895240 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f48cc4-2cf9-47d8-9f2f-452730f49022 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:10.898195 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f48cc4-2cf9-47d8-9f2f-452730f49022 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:10.898572 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f48cc4-2cf9-47d8-9f2f-452730f49022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:10.901293 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226aa4fd-2d35-4c18-84d5-228ee65001c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=638e3886481548668ccddebb3eabfa12, user_id=c03fe65aa9364b8a94f79f887387d260, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:10.904210 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226aa4fd-2d35-4c18-84d5-228ee65001c2 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:10.924255 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1029/2073] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:14:10 2022] PUT /identity/v3/projects/638e3886481548668ccddebb3eabfa12/users/c03fe65aa9364b8a94f79f887387d260/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:14:10.927835 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226aa4fd-2d35-4c18-84d5-228ee65001c2 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:10.935248 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-226aa4fd-2d35-4c18-84d5-228ee65001c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:10.945995 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-82f48cc4-2cf9-47d8-9f2f-452730f49022 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:14:10.947418 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-82f48cc4-2cf9-47d8-9f2f-452730f49022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:11.056455 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1045/2074] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:14:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:14:11.067075 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f48cc4-2cf9-47d8-9f2f-452730f49022 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:11.072592 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-82f48cc4-2cf9-47d8-9f2f-452730f49022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:11.134172 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226aa4fd-2d35-4c18-84d5-228ee65001c2 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:11.142978 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a59da8-bbf0-4d30-87be-4881c328a0df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:11.144516 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a59da8-bbf0-4d30-87be-4881c328a0df admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:11.144904 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a59da8-bbf0-4d30-87be-4881c328a0df admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:11.148676 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a59da8-bbf0-4d30-87be-4881c328a0df admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:11.149746 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a59da8-bbf0-4d30-87be-4881c328a0df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:11.152074 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a59da8-bbf0-4d30-87be-4881c328a0df admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:11.176958 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1030/2075] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:14:10 2022] GET /identity/v3/roles => generated 1420 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:14:11.182212 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a23377-6b92-46c3-a953-0fce59444d6c None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:11.182978 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a23377-6b92-46c3-a953-0fce59444d6c None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:11.183454 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a23377-6b92-46c3-a953-0fce59444d6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:11.231650 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-18a23377-6b92-46c3-a953-0fce59444d6c None None] MFA Rules not processed for user `c497326ee890462e8f48b4a56f81990c`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:14:11.232803 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f48cc4-2cf9-47d8-9f2f-452730f49022 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:11.233303 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-18a23377-6b92-46c3-a953-0fce59444d6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:11.240082 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92432dc9-e07a-443a-b3db-276097073e88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:11.241245 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92432dc9-e07a-443a-b3db-276097073e88 service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:11.242465 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92432dc9-e07a-443a-b3db-276097073e88 service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:11.242987 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92432dc9-e07a-443a-b3db-276097073e88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:11.246253 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1031/2076] 10.222.0.39 () {58 vars in 1015 bytes} [Sat Jul 23 21:14:11 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:14:11.247102 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a23377-6b92-46c3-a953-0fce59444d6c None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:11.260266 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a23377-6b92-46c3-a953-0fce59444d6c None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:11.262611 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92432dc9-e07a-443a-b3db-276097073e88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:11.265480 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92432dc9-e07a-443a-b3db-276097073e88 service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:11.267188 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc5c403-f9d5-4ca3-a8ec-f39f4d730447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:11.268231 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc5c403-f9d5-4ca3-a8ec-f39f4d730447 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:11.268517 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc5c403-f9d5-4ca3-a8ec-f39f4d730447 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:11.268791 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc5c403-f9d5-4ca3-a8ec-f39f4d730447 admin admin] PATH_INFO: `/v3/projects/638e3886481548668ccddebb3eabfa12/users/c03fe65aa9364b8a94f79f887387d260/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:11.270895 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc5c403-f9d5-4ca3-a8ec-f39f4d730447 admin admin] RBAC: Authorizing `identity:create_grant(project_id=638e3886481548668ccddebb3eabfa12, user_id=c03fe65aa9364b8a94f79f887387d260, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:11.273579 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc5c403-f9d5-4ca3-a8ec-f39f4d730447 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:11.281747 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1046/2077] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:14:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:14:11.287503 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1032/2078] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:14:11 2022] PUT /identity/v3/projects/638e3886481548668ccddebb3eabfa12/users/c03fe65aa9364b8a94f79f887387d260/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:14:11.298728 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745990ec-4fa0-4216-918e-0dc76e29d1eb None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:11.299483 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745990ec-4fa0-4216-918e-0dc76e29d1eb None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:11.300312 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745990ec-4fa0-4216-918e-0dc76e29d1eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:11.313736 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc5c403-f9d5-4ca3-a8ec-f39f4d730447 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:11.354454 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-745990ec-4fa0-4216-918e-0dc76e29d1eb None None] MFA Rules not processed for user `c03fe65aa9364b8a94f79f887387d260`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:14:11.356012 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-745990ec-4fa0-4216-918e-0dc76e29d1eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:11.463063 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc5c403-f9d5-4ca3-a8ec-f39f4d730447 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:11.474053 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9f814d-38b8-4960-b4e0-550d87e0a9f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:11.474742 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9f814d-38b8-4960-b4e0-550d87e0a9f8 service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:11.475022 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9f814d-38b8-4960-b4e0-550d87e0a9f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:11.475295 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9f814d-38b8-4960-b4e0-550d87e0a9f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:11.492083 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:11.506225 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9f814d-38b8-4960-b4e0-550d87e0a9f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:11.507842 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9f814d-38b8-4960-b4e0-550d87e0a9f8 service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:11.518440 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1047/2079] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:14:11 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:14:11.537044 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1033/2080] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:14:11 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 23 21:14:11.634842 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745990ec-4fa0-4216-918e-0dc76e29d1eb None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:11.636630 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-745990ec-4fa0-4216-918e-0dc76e29d1eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:11.744372 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745990ec-4fa0-4216-918e-0dc76e29d1eb None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:11.751765 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412ccd51-cc62-4c47-852f-e0fd19f51d80 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:11.752455 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412ccd51-cc62-4c47-852f-e0fd19f51d80 service nova] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:11.752772 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412ccd51-cc62-4c47-852f-e0fd19f51d80 service nova] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:11.753120 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412ccd51-cc62-4c47-852f-e0fd19f51d80 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:11.759353 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-412ccd51-cc62-4c47-852f-e0fd19f51d80 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:11.962733 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412ccd51-cc62-4c47-852f-e0fd19f51d80 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:11.968264 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412ccd51-cc62-4c47-852f-e0fd19f51d80 service nova] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:12.038232 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1048/2081] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:14:11 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:14:12.331839 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9f814d-38b8-4960-b4e0-550d87e0a9f8 service neutron] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:12.334189 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-ed9f814d-38b8-4960-b4e0-550d87e0a9f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:12.366963 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412ccd51-cc62-4c47-852f-e0fd19f51d80 service nova] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:12.368862 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-412ccd51-cc62-4c47-852f-e0fd19f51d80 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:12.402344 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:12.464399 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9f814d-38b8-4960-b4e0-550d87e0a9f8 service neutron] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:12.474564 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc8345f-d0e6-427a-bba4-d67208917587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:12.476399 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc8345f-d0e6-427a-bba4-d67208917587 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:12.476644 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc8345f-d0e6-427a-bba4-d67208917587 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:12.476919 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc8345f-d0e6-427a-bba4-d67208917587 admin admin] PATH_INFO: `/v3/projects/d2b1c3e999e447d2b7b591cf6b7639a6` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:12.478327 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc8345f-d0e6-427a-bba4-d67208917587 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2b1c3e999e447d2b7b591cf6b7639a6)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:12.480282 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc8345f-d0e6-427a-bba4-d67208917587 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:12.507207 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412ccd51-cc62-4c47-852f-e0fd19f51d80 service nova] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:12.519403 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16e292b-60d9-499d-b5b6-988f431d6ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:12.520150 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16e292b-60d9-499d-b5b6-988f431d6ee3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:12.520335 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16e292b-60d9-499d-b5b6-988f431d6ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:12.520608 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16e292b-60d9-499d-b5b6-988f431d6ee3 admin admin] PATH_INFO: `/v3/projects/e761e48e603741e68de2a7f1faac1f2d` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:12.523727 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16e292b-60d9-499d-b5b6-988f431d6ee3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e761e48e603741e68de2a7f1faac1f2d)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:12.525749 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16e292b-60d9-499d-b5b6-988f431d6ee3 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:12.624740 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-9fc8345f-d0e6-427a-bba4-d67208917587 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2b1c3e999e447d2b7b591cf6b7639a6', 'request_id': 'req-9fc8345f-d0e6-427a-bba4-d67208917587'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:12.644114 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-9fc8345f-d0e6-427a-bba4-d67208917587 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2b1c3e999e447d2b7b591cf6b7639a6', 'request_id': 'req-9fc8345f-d0e6-427a-bba4-d67208917587'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:12.663031 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-9fc8345f-d0e6-427a-bba4-d67208917587 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2b1c3e999e447d2b7b591cf6b7639a6', 'request_id': 'req-9fc8345f-d0e6-427a-bba4-d67208917587'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:12.663822 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:12.711063 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-9fc8345f-d0e6-427a-bba4-d67208917587 admin admin] The token cache is being invalidate because project d2b1c3e999e447d2b7b591cf6b7639a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:14:12.712588 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-9fc8345f-d0e6-427a-bba4-d67208917587 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:12.714849 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-9fc8345f-d0e6-427a-bba4-d67208917587 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:12.719881 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1034/2082] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:14:12 2022] DELETE /identity/v3/projects/d2b1c3e999e447d2b7b591cf6b7639a6 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:14:12.720941 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc8345f-d0e6-427a-bba4-d67208917587 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:12.722788 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-9fc8345f-d0e6-427a-bba4-d67208917587 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:12.738671 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-d16e292b-60d9-499d-b5b6-988f431d6ee3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e761e48e603741e68de2a7f1faac1f2d', 'request_id': 'req-d16e292b-60d9-499d-b5b6-988f431d6ee3'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:12.759182 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-d16e292b-60d9-499d-b5b6-988f431d6ee3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e761e48e603741e68de2a7f1faac1f2d', 'request_id': 'req-d16e292b-60d9-499d-b5b6-988f431d6ee3'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:12.765635 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-d16e292b-60d9-499d-b5b6-988f431d6ee3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e761e48e603741e68de2a7f1faac1f2d', 'request_id': 'req-d16e292b-60d9-499d-b5b6-988f431d6ee3'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:12.822079 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-d16e292b-60d9-499d-b5b6-988f431d6ee3 admin admin] The token cache is being invalidate because project e761e48e603741e68de2a7f1faac1f2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:14:12.822247 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-d16e292b-60d9-499d-b5b6-988f431d6ee3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:12.822985 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-d16e292b-60d9-499d-b5b6-988f431d6ee3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:12.827838 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1049/2083] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:14:12 2022] DELETE /identity/v3/projects/e761e48e603741e68de2a7f1faac1f2d => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:14:12.832841 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16e292b-60d9-499d-b5b6-988f431d6ee3 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:12.837190 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-d16e292b-60d9-499d-b5b6-988f431d6ee3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:12.916664 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc8345f-d0e6-427a-bba4-d67208917587 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:12.995554 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16e292b-60d9-499d-b5b6-988f431d6ee3 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:13.009051 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf98df7-36cf-418e-a3e5-81149a5cd6b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:13.010003 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf98df7-36cf-418e-a3e5-81149a5cd6b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:13.010289 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf98df7-36cf-418e-a3e5-81149a5cd6b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:13.010568 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf98df7-36cf-418e-a3e5-81149a5cd6b5 admin admin] PATH_INFO: `/v3/users/6118db3609df4bc2aa46d956e985fd05` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:13.012586 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf98df7-36cf-418e-a3e5-81149a5cd6b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6118db3609df4bc2aa46d956e985fd05)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:13.014656 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf98df7-36cf-418e-a3e5-81149a5cd6b5 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:13.076536 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c6f31e-c0c3-4f1f-b48a-c2ce17ea9dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:13.080533 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c6f31e-c0c3-4f1f-b48a-c2ce17ea9dec admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:13.081462 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c6f31e-c0c3-4f1f-b48a-c2ce17ea9dec admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:13.081773 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c6f31e-c0c3-4f1f-b48a-c2ce17ea9dec admin admin] PATH_INFO: `/v3/users/0e1fdaed25764b15a6f74a925ee81499` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:13.087140 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c6f31e-c0c3-4f1f-b48a-c2ce17ea9dec admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e1fdaed25764b15a6f74a925ee81499)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:13.096198 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c6f31e-c0c3-4f1f-b48a-c2ce17ea9dec admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:13.132924 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:13.139929 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-aaf98df7-36cf-418e-a3e5-81149a5cd6b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6118db3609df4bc2aa46d956e985fd05'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:13.141577 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-aaf98df7-36cf-418e-a3e5-81149a5cd6b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6118db3609df4bc2aa46d956e985fd05'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:13.160333 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-aaf98df7-36cf-418e-a3e5-81149a5cd6b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6118db3609df4bc2aa46d956e985fd05'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:13.175908 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-aaf98df7-36cf-418e-a3e5-81149a5cd6b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6118db3609df4bc2aa46d956e985fd05'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:13.227064 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-aaf98df7-36cf-418e-a3e5-81149a5cd6b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6118db3609df4bc2aa46d956e985fd05'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:13.239062 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-21c6f31e-c0c3-4f1f-b48a-c2ce17ea9dec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e1fdaed25764b15a6f74a925ee81499'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:13.252084 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1050/2084] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:14:12 2022] DELETE /identity/v3/users/6118db3609df4bc2aa46d956e985fd05 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:14:13.257345 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf98df7-36cf-418e-a3e5-81149a5cd6b5 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:13.261732 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-21c6f31e-c0c3-4f1f-b48a-c2ce17ea9dec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e1fdaed25764b15a6f74a925ee81499'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:13.263239 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-21c6f31e-c0c3-4f1f-b48a-c2ce17ea9dec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e1fdaed25764b15a6f74a925ee81499'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:13.269009 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-aaf98df7-36cf-418e-a3e5-81149a5cd6b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:13.284908 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-21c6f31e-c0c3-4f1f-b48a-c2ce17ea9dec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e1fdaed25764b15a6f74a925ee81499'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:13.323585 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-21c6f31e-c0c3-4f1f-b48a-c2ce17ea9dec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e1fdaed25764b15a6f74a925ee81499'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:13.344797 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1035/2085] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:14:12 2022] DELETE /identity/v3/users/0e1fdaed25764b15a6f74a925ee81499 => generated 0 bytes in 624 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:14:13.346798 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c6f31e-c0c3-4f1f-b48a-c2ce17ea9dec admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:13.348903 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-21c6f31e-c0c3-4f1f-b48a-c2ce17ea9dec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:13.459317 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:13.483566 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c6f31e-c0c3-4f1f-b48a-c2ce17ea9dec admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:13.498391 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b34555-b510-4f25-961a-e2e30f25ce47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:13.499650 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b34555-b510-4f25-961a-e2e30f25ce47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:13.500159 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b34555-b510-4f25-961a-e2e30f25ce47 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:13.501153 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b34555-b510-4f25-961a-e2e30f25ce47 admin admin] PATH_INFO: `/v3/users/5f23552e8fd646a7b74bc86031412e19` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:13.502853 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b34555-b510-4f25-961a-e2e30f25ce47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f23552e8fd646a7b74bc86031412e19)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:13.505621 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b34555-b510-4f25-961a-e2e30f25ce47 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:13.555516 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf98df7-36cf-418e-a3e5-81149a5cd6b5 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:13.596537 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-24b34555-b510-4f25-961a-e2e30f25ce47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f23552e8fd646a7b74bc86031412e19'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:13.614255 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-24b34555-b510-4f25-961a-e2e30f25ce47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f23552e8fd646a7b74bc86031412e19'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:13.619438 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-24b34555-b510-4f25-961a-e2e30f25ce47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f23552e8fd646a7b74bc86031412e19'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:13.645126 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-24b34555-b510-4f25-961a-e2e30f25ce47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f23552e8fd646a7b74bc86031412e19'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:13.670535 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-24b34555-b510-4f25-961a-e2e30f25ce47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f23552e8fd646a7b74bc86031412e19'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:13.687587 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1036/2086] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:14:13 2022] DELETE /identity/v3/users/5f23552e8fd646a7b74bc86031412e19 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:14:13.697787 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e23d942-b4e0-4eeb-9803-2775baf65beb None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:13.701165 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e23d942-b4e0-4eeb-9803-2775baf65beb None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:13.701583 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e23d942-b4e0-4eeb-9803-2775baf65beb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:13.724067 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cc6149-9c59-4d3e-97cd-3c93775a164c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:13.724764 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cc6149-9c59-4d3e-97cd-3c93775a164c service nova] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:13.725042 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cc6149-9c59-4d3e-97cd-3c93775a164c service nova] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:13.725313 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cc6149-9c59-4d3e-97cd-3c93775a164c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:13.725603 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:DELETE=20,keystone:SELECT=78,keystone:INSERT=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:13.729576 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-16cc6149-9c59-4d3e-97cd-3c93775a164c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:13.737921 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-2e23d942-b4e0-4eeb-9803-2775baf65beb None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:14:13.742977 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-2e23d942-b4e0-4eeb-9803-2775baf65beb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:13.868380 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cc6149-9c59-4d3e-97cd-3c93775a164c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:13.871172 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cc6149-9c59-4d3e-97cd-3c93775a164c service nova] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:13.886365 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1037/2087] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:14:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:14:13.908943 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1051/2088] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:14:13 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 656 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:14:13.942803 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e23d942-b4e0-4eeb-9803-2775baf65beb None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:13.944605 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-2e23d942-b4e0-4eeb-9803-2775baf65beb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:14.090428 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e23d942-b4e0-4eeb-9803-2775baf65beb None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:14.094580 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ead25b-d697-47b8-8cdc-77e70b25b869 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:14.095340 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ead25b-d697-47b8-8cdc-77e70b25b869 service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:14.095625 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ead25b-d697-47b8-8cdc-77e70b25b869 service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:14.095893 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ead25b-d697-47b8-8cdc-77e70b25b869 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:14.121507 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ead25b-d697-47b8-8cdc-77e70b25b869 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:14.124165 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ead25b-d697-47b8-8cdc-77e70b25b869 service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:14.138594 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1038/2089] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:14:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:14:14.406618 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a402fd6-97df-4b3b-9131-d9bf69b9958c None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:14.407577 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a402fd6-97df-4b3b-9131-d9bf69b9958c None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:14.407977 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a402fd6-97df-4b3b-9131-d9bf69b9958c None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:14.410411 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1052/2090] 10.222.0.17 () {54 vars in 921 bytes} [Sat Jul 23 21:14:14 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:14:14.422090 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a6e439-66e6-41dd-b03a-ca2492c0053e None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:14.422661 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a6e439-66e6-41dd-b03a-ca2492c0053e None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:14.422661 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a6e439-66e6-41dd-b03a-ca2492c0053e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:14.459348 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-16a6e439-66e6-41dd-b03a-ca2492c0053e None None] MFA Rules not processed for user `079f31ed2c844e67bd4e206f24b69d97`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:14:14.460614 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-16a6e439-66e6-41dd-b03a-ca2492c0053e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:14.617837 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1039/2091] 10.222.0.17 () {58 vars in 1018 bytes} [Sat Jul 23 21:14:14 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:14:14.651754 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a402fd6-97df-4b3b-9131-d9bf69b9958c None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:14.655088 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-1a402fd6-97df-4b3b-9131-d9bf69b9958c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:14.691656 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a402fd6-97df-4b3b-9131-d9bf69b9958c None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:14.708628 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e810db7d-b7a0-4624-afd5-28ccb6a72368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:14.709629 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e810db7d-b7a0-4624-afd5-28ccb6a72368 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:14.710043 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e810db7d-b7a0-4624-afd5-28ccb6a72368 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:14.710418 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e810db7d-b7a0-4624-afd5-28ccb6a72368 admin admin] PATH_INFO: `/v3/projects/527c04714bed423da08a3a662ae06f92` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:14.715748 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e810db7d-b7a0-4624-afd5-28ccb6a72368 admin admin] RBAC: Authorizing `identity:delete_project(project_id=527c04714bed423da08a3a662ae06f92)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:14.715748 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e810db7d-b7a0-4624-afd5-28ccb6a72368 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:14.851931 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-e810db7d-b7a0-4624-afd5-28ccb6a72368 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '527c04714bed423da08a3a662ae06f92', 'request_id': 'req-e810db7d-b7a0-4624-afd5-28ccb6a72368'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:14.856173 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a6e439-66e6-41dd-b03a-ca2492c0053e None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:14.859131 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-16a6e439-66e6-41dd-b03a-ca2492c0053e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:14.876161 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-e810db7d-b7a0-4624-afd5-28ccb6a72368 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '527c04714bed423da08a3a662ae06f92', 'request_id': 'req-e810db7d-b7a0-4624-afd5-28ccb6a72368'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:14.888347 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-e810db7d-b7a0-4624-afd5-28ccb6a72368 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '527c04714bed423da08a3a662ae06f92', 'request_id': 'req-e810db7d-b7a0-4624-afd5-28ccb6a72368'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:14.894452 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a6e439-66e6-41dd-b03a-ca2492c0053e None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:14.899922 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:14.914751 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-e810db7d-b7a0-4624-afd5-28ccb6a72368 admin admin] The token cache is being invalidate because project 527c04714bed423da08a3a662ae06f92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:14:14.915005 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-e810db7d-b7a0-4624-afd5-28ccb6a72368 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:14.917609 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-e810db7d-b7a0-4624-afd5-28ccb6a72368 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:14.919839 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1053/2092] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:14:14 2022] DELETE /identity/v3/projects/527c04714bed423da08a3a662ae06f92 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:14:14.925208 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6780623-5e14-431f-bef0-333a9bd89e0c None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:14.925208 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6780623-5e14-431f-bef0-333a9bd89e0c None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:14.925512 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6780623-5e14-431f-bef0-333a9bd89e0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:14.984731 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:14.989560 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-a6780623-5e14-431f-bef0-333a9bd89e0c None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:14:14.990772 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-a6780623-5e14-431f-bef0-333a9bd89e0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:15.024769 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8ecb6d-509e-47ba-9da8-be0aa29510c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:15.025448 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8ecb6d-509e-47ba-9da8-be0aa29510c6 service nova] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:15.025724 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8ecb6d-509e-47ba-9da8-be0aa29510c6 service nova] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:15.026053 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8ecb6d-509e-47ba-9da8-be0aa29510c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:15.028257 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-ca8ecb6d-509e-47ba-9da8-be0aa29510c6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:15.041542 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8ecb6d-509e-47ba-9da8-be0aa29510c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:15.043255 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8ecb6d-509e-47ba-9da8-be0aa29510c6 service nova] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:15.082806 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1040/2093] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:14:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 23 21:14:15.151186 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1054/2094] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:14:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:14:15.160256 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2064fd72-c5f9-4f21-baa5-d57c4434431d None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:15.160633 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2064fd72-c5f9-4f21-baa5-d57c4434431d None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:15.160909 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2064fd72-c5f9-4f21-baa5-d57c4434431d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:15.193614 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-2064fd72-c5f9-4f21-baa5-d57c4434431d None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:14:15.194385 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-2064fd72-c5f9-4f21-baa5-d57c4434431d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:15.207081 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1041/2095] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:14:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:14:15.211587 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6780623-5e14-431f-bef0-333a9bd89e0c None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:15.232376 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6780623-5e14-431f-bef0-333a9bd89e0c None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:15.243215 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea0b015-1334-4ae1-9e71-48ad7d6e44b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:15.247586 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea0b015-1334-4ae1-9e71-48ad7d6e44b8 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:15.249731 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea0b015-1334-4ae1-9e71-48ad7d6e44b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:15.249731 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea0b015-1334-4ae1-9e71-48ad7d6e44b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:15.249731 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea0b015-1334-4ae1-9e71-48ad7d6e44b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:14:15.250307 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea0b015-1334-4ae1-9e71-48ad7d6e44b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:15.252084 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea0b015-1334-4ae1-9e71-48ad7d6e44b8 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:15.282734 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1055/2096] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:14:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:14:15.286867 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2064fd72-c5f9-4f21-baa5-d57c4434431d None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:15.301384 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2064fd72-c5f9-4f21-baa5-d57c4434431d None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:15.315649 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173ac5e5-508d-47c6-abcb-f9d0eac199a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:15.315649 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173ac5e5-508d-47c6-abcb-f9d0eac199a9 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:15.315649 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173ac5e5-508d-47c6-abcb-f9d0eac199a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:15.315649 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173ac5e5-508d-47c6-abcb-f9d0eac199a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:15.316447 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173ac5e5-508d-47c6-abcb-f9d0eac199a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:15.324068 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173ac5e5-508d-47c6-abcb-f9d0eac199a9 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:15.348301 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea0b015-1334-4ae1-9e71-48ad7d6e44b8 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:15.351064 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-bea0b015-1334-4ae1-9e71-48ad7d6e44b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:15.390279 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea0b015-1334-4ae1-9e71-48ad7d6e44b8 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:15.392233 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1042/2097] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:14:15 2022] POST /identity/v3/projects => generated 397 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:14:15.392233 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173ac5e5-508d-47c6-abcb-f9d0eac199a9 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:15.479405 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173ac5e5-508d-47c6-abcb-f9d0eac199a9 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:15.485728 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfccc3d-9105-4b0b-a182-1cc25efd0c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:15.486469 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfccc3d-9105-4b0b-a182-1cc25efd0c7e admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:15.486746 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfccc3d-9105-4b0b-a182-1cc25efd0c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:15.487016 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfccc3d-9105-4b0b-a182-1cc25efd0c7e admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:15.487709 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfccc3d-9105-4b0b-a182-1cc25efd0c7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:15.489838 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfccc3d-9105-4b0b-a182-1cc25efd0c7e admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:15.526254 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1043/2098] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:14:15 2022] POST /identity/v3/users => generated 299 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:14:15.530198 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfccc3d-9105-4b0b-a182-1cc25efd0c7e admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:15.532878 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b747e3-b558-4b40-9fc4-ee458eca5d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:15.533441 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b747e3-b558-4b40-9fc4-ee458eca5d6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:15.533712 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b747e3-b558-4b40-9fc4-ee458eca5d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:15.534010 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b747e3-b558-4b40-9fc4-ee458eca5d6c admin admin] PATH_INFO: `/v3/users/f92b0abcebcf4ef49dd02002a0f477ab` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:15.536523 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b747e3-b558-4b40-9fc4-ee458eca5d6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f92b0abcebcf4ef49dd02002a0f477ab)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:15.536751 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-4bfccc3d-9105-4b0b-a182-1cc25efd0c7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:15.539187 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b747e3-b558-4b40-9fc4-ee458eca5d6c admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:15.552584 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfccc3d-9105-4b0b-a182-1cc25efd0c7e admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:15.559967 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72256036-5868-4455-874a-4ab09b64de12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:15.561614 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72256036-5868-4455-874a-4ab09b64de12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:15.562427 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72256036-5868-4455-874a-4ab09b64de12 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:15.563286 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72256036-5868-4455-874a-4ab09b64de12 admin admin] PATH_INFO: `/v3/users/95896f2064e34e5d82e9531e68aab170` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:15.565348 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72256036-5868-4455-874a-4ab09b64de12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=95896f2064e34e5d82e9531e68aab170)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:15.568802 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72256036-5868-4455-874a-4ab09b64de12 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:15.618640 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-f8b747e3-b558-4b40-9fc4-ee458eca5d6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f92b0abcebcf4ef49dd02002a0f477ab'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:15.619630 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-f8b747e3-b558-4b40-9fc4-ee458eca5d6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f92b0abcebcf4ef49dd02002a0f477ab'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:15.629444 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-f8b747e3-b558-4b40-9fc4-ee458eca5d6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f92b0abcebcf4ef49dd02002a0f477ab'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:15.642863 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-f8b747e3-b558-4b40-9fc4-ee458eca5d6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f92b0abcebcf4ef49dd02002a0f477ab'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:15.663714 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-f8b747e3-b558-4b40-9fc4-ee458eca5d6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f92b0abcebcf4ef49dd02002a0f477ab'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:15.676133 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1056/2099] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:14:15 2022] DELETE /identity/v3/users/f92b0abcebcf4ef49dd02002a0f477ab => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:14:15.677187 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b747e3-b558-4b40-9fc4-ee458eca5d6c admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:15.679633 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-f8b747e3-b558-4b40-9fc4-ee458eca5d6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:15.687287 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:15.728148 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-72256036-5868-4455-874a-4ab09b64de12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95896f2064e34e5d82e9531e68aab170'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:15.767292 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-72256036-5868-4455-874a-4ab09b64de12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95896f2064e34e5d82e9531e68aab170'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:15.773246 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-72256036-5868-4455-874a-4ab09b64de12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95896f2064e34e5d82e9531e68aab170'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:15.800606 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-72256036-5868-4455-874a-4ab09b64de12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95896f2064e34e5d82e9531e68aab170'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:15.817762 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-72256036-5868-4455-874a-4ab09b64de12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95896f2064e34e5d82e9531e68aab170'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:15.822379 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:15.823265 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b747e3-b558-4b40-9fc4-ee458eca5d6c admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:15.831705 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1044/2100] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:14:15 2022] DELETE /identity/v3/users/95896f2064e34e5d82e9531e68aab170 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:14:15.836451 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72256036-5868-4455-874a-4ab09b64de12 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:15.839243 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257c2abb-e860-4ffa-a8db-eaad3bee8ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:15.839956 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257c2abb-e860-4ffa-a8db-eaad3bee8ec5 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:15.840240 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257c2abb-e860-4ffa-a8db-eaad3bee8ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:15.840539 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257c2abb-e860-4ffa-a8db-eaad3bee8ec5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:15.841308 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257c2abb-e860-4ffa-a8db-eaad3bee8ec5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:15.842112 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-72256036-5868-4455-874a-4ab09b64de12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:15.858789 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257c2abb-e860-4ffa-a8db-eaad3bee8ec5 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:15.883041 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1057/2101] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:14:15 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:14:15.883041 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88719881-f8d8-4fe6-9b4a-dfcce577963e None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:15.883540 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88719881-f8d8-4fe6-9b4a-dfcce577963e None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:15.883848 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88719881-f8d8-4fe6-9b4a-dfcce577963e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:15.927230 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-88719881-f8d8-4fe6-9b4a-dfcce577963e None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:14:15.928373 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-88719881-f8d8-4fe6-9b4a-dfcce577963e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:16.001755 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72256036-5868-4455-874a-4ab09b64de12 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:16.011476 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd775691-81c2-4dd2-8f4e-b34f219c15b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:16.012542 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd775691-81c2-4dd2-8f4e-b34f219c15b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:16.012816 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd775691-81c2-4dd2-8f4e-b34f219c15b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:16.013089 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd775691-81c2-4dd2-8f4e-b34f219c15b1 admin admin] PATH_INFO: `/v3/projects/db0e0608b1c3423f9c536bab6130117e` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:16.017321 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd775691-81c2-4dd2-8f4e-b34f219c15b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db0e0608b1c3423f9c536bab6130117e)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:16.022913 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd775691-81c2-4dd2-8f4e-b34f219c15b1 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:16.042980 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1058/2102] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:14:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:14:16.044699 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878c6ad4-cc0a-4ce0-820d-c3236b0f02ac None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:16.044970 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878c6ad4-cc0a-4ce0-820d-c3236b0f02ac None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:16.045397 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878c6ad4-cc0a-4ce0-820d-c3236b0f02ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:16.069973 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-878c6ad4-cc0a-4ce0-820d-c3236b0f02ac None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:14:16.072152 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-878c6ad4-cc0a-4ce0-820d-c3236b0f02ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:16.087706 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1059/2103] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:14:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:14:16.089131 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878c6ad4-cc0a-4ce0-820d-c3236b0f02ac None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:16.090436 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-878c6ad4-cc0a-4ce0-820d-c3236b0f02ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:16.104700 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878c6ad4-cc0a-4ce0-820d-c3236b0f02ac None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:16.111347 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f888e3df-dc30-480e-afde-06a129ee5a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:16.112589 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f888e3df-dc30-480e-afde-06a129ee5a86 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:16.113089 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f888e3df-dc30-480e-afde-06a129ee5a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:16.114898 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f888e3df-dc30-480e-afde-06a129ee5a86 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:16.115968 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f888e3df-dc30-480e-afde-06a129ee5a86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:16.118017 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f888e3df-dc30-480e-afde-06a129ee5a86 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:16.128710 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-dd775691-81c2-4dd2-8f4e-b34f219c15b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db0e0608b1c3423f9c536bab6130117e', 'request_id': 'req-dd775691-81c2-4dd2-8f4e-b34f219c15b1'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:16.132339 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1060/2104] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:14:16 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:14:16.133356 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f888e3df-dc30-480e-afde-06a129ee5a86 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:16.136032 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-f888e3df-dc30-480e-afde-06a129ee5a86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:16.143117 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-dd775691-81c2-4dd2-8f4e-b34f219c15b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db0e0608b1c3423f9c536bab6130117e', 'request_id': 'req-dd775691-81c2-4dd2-8f4e-b34f219c15b1'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:16.152433 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f888e3df-dc30-480e-afde-06a129ee5a86 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:16.153425 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-dd775691-81c2-4dd2-8f4e-b34f219c15b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db0e0608b1c3423f9c536bab6130117e', 'request_id': 'req-dd775691-81c2-4dd2-8f4e-b34f219c15b1'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:16.168386 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-dd775691-81c2-4dd2-8f4e-b34f219c15b1 admin admin] The token cache is being invalidate because project db0e0608b1c3423f9c536bab6130117e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:14:16.169125 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-dd775691-81c2-4dd2-8f4e-b34f219c15b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:16.170035 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-dd775691-81c2-4dd2-8f4e-b34f219c15b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:16.175140 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1045/2105] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:14:15 2022] DELETE /identity/v3/projects/db0e0608b1c3423f9c536bab6130117e => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:14:16.176068 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd775691-81c2-4dd2-8f4e-b34f219c15b1 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:16.177534 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-dd775691-81c2-4dd2-8f4e-b34f219c15b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:16.273242 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd775691-81c2-4dd2-8f4e-b34f219c15b1 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:16.277221 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a47ab7-4a0b-4f77-9852-be6c0aace713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:16.278031 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ab693c-f1cb-4300-859a-f0ef6eb6d4ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:16.278217 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a47ab7-4a0b-4f77-9852-be6c0aace713 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:16.278635 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a47ab7-4a0b-4f77-9852-be6c0aace713 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:16.278913 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a47ab7-4a0b-4f77-9852-be6c0aace713 admin admin] PATH_INFO: `/v3/projects/681566c31052436b9d2ce072e733f052` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:16.279767 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ab693c-f1cb-4300-859a-f0ef6eb6d4ae service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:16.280121 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a47ab7-4a0b-4f77-9852-be6c0aace713 admin admin] RBAC: Authorizing `identity:delete_project(project_id=681566c31052436b9d2ce072e733f052)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:16.280377 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ab693c-f1cb-4300-859a-f0ef6eb6d4ae service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:16.280808 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ab693c-f1cb-4300-859a-f0ef6eb6d4ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:16.282568 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a47ab7-4a0b-4f77-9852-be6c0aace713 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:16.285565 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-a2ab693c-f1cb-4300-859a-f0ef6eb6d4ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:16.305325 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ab693c-f1cb-4300-859a-f0ef6eb6d4ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:16.307235 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ab693c-f1cb-4300-859a-f0ef6eb6d4ae service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:16.325398 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1046/2106] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:14:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:14:16.327031 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ab693c-f1cb-4300-859a-f0ef6eb6d4ae service neutron] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:16.328158 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:16.341075 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ab693c-f1cb-4300-859a-f0ef6eb6d4ae service neutron] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:16.357043 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-33a47ab7-4a0b-4f77-9852-be6c0aace713 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '681566c31052436b9d2ce072e733f052', 'request_id': 'req-33a47ab7-4a0b-4f77-9852-be6c0aace713'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:16.376499 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-33a47ab7-4a0b-4f77-9852-be6c0aace713 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '681566c31052436b9d2ce072e733f052', 'request_id': 'req-33a47ab7-4a0b-4f77-9852-be6c0aace713'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:16.384115 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:16.390670 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-33a47ab7-4a0b-4f77-9852-be6c0aace713 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '681566c31052436b9d2ce072e733f052', 'request_id': 'req-33a47ab7-4a0b-4f77-9852-be6c0aace713'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:16.409619 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-33a47ab7-4a0b-4f77-9852-be6c0aace713 admin admin] The token cache is being invalidate because project 681566c31052436b9d2ce072e733f052 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:14:16.409936 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-33a47ab7-4a0b-4f77-9852-be6c0aace713 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:16.410677 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-33a47ab7-4a0b-4f77-9852-be6c0aace713 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:16.415419 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1061/2107] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:14:16 2022] DELETE /identity/v3/projects/681566c31052436b9d2ce072e733f052 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:14:16.416383 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a47ab7-4a0b-4f77-9852-be6c0aace713 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:16.417811 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-33a47ab7-4a0b-4f77-9852-be6c0aace713 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:16.423233 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef23902b-2117-492a-8d96-38d5b676b671 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:16.424055 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef23902b-2117-492a-8d96-38d5b676b671 service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:16.424344 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef23902b-2117-492a-8d96-38d5b676b671 service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:16.425688 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef23902b-2117-492a-8d96-38d5b676b671 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:16.428407 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-ef23902b-2117-492a-8d96-38d5b676b671 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:16.497887 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a47ab7-4a0b-4f77-9852-be6c0aace713 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:16.504242 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8425a0a0-ba44-4900-8d83-27d9e8904fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:16.505306 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8425a0a0-ba44-4900-8d83-27d9e8904fb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:16.506243 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8425a0a0-ba44-4900-8d83-27d9e8904fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:16.506761 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8425a0a0-ba44-4900-8d83-27d9e8904fb8 admin admin] PATH_INFO: `/v3/projects/b347973dfb204484bdb87ab0094dbe22/users/3a56b82cf3954f279dd21e17a42462b3/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:16.515587 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef23902b-2117-492a-8d96-38d5b676b671 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:16.518144 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef23902b-2117-492a-8d96-38d5b676b671 service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:16.540101 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1047/2108] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:14:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:14:16.541728 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c6d8a4-eee2-45a7-8bf3-396e6ca17038 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:16.542068 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c6d8a4-eee2-45a7-8bf3-396e6ca17038 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:16.542351 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c6d8a4-eee2-45a7-8bf3-396e6ca17038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:16.568442 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8425a0a0-ba44-4900-8d83-27d9e8904fb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b347973dfb204484bdb87ab0094dbe22, user_id=3a56b82cf3954f279dd21e17a42462b3, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:16.577459 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8425a0a0-ba44-4900-8d83-27d9e8904fb8 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:16.593067 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-04c6d8a4-eee2-45a7-8bf3-396e6ca17038 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:14:16.595641 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-04c6d8a4-eee2-45a7-8bf3-396e6ca17038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:16.605736 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1062/2109] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:14:16 2022] PUT /identity/v3/projects/b347973dfb204484bdb87ab0094dbe22/users/3a56b82cf3954f279dd21e17a42462b3/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:14:16.607292 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8425a0a0-ba44-4900-8d83-27d9e8904fb8 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:16.611584 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-8425a0a0-ba44-4900-8d83-27d9e8904fb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:16.738477 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1048/2110] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:14:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:14:16.741854 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893a40d2-360f-4cd7-9374-969ed9e9491d None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:16.742422 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893a40d2-360f-4cd7-9374-969ed9e9491d None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:16.743079 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893a40d2-360f-4cd7-9374-969ed9e9491d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:16.758176 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8425a0a0-ba44-4900-8d83-27d9e8904fb8 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:16.777639 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66963d01-4050-4944-90b3-f448307b6b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:16.779133 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66963d01-4050-4944-90b3-f448307b6b95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:16.780521 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66963d01-4050-4944-90b3-f448307b6b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:16.780521 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66963d01-4050-4944-90b3-f448307b6b95 admin admin] PATH_INFO: `/v3/users/37598ed1e36d4e81936d5ad3cf35612b` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:16.788392 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66963d01-4050-4944-90b3-f448307b6b95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37598ed1e36d4e81936d5ad3cf35612b)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:16.796143 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66963d01-4050-4944-90b3-f448307b6b95 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:16.799412 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-893a40d2-360f-4cd7-9374-969ed9e9491d None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:14:16.802084 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-893a40d2-360f-4cd7-9374-969ed9e9491d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:16.832185 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1049/2111] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:14:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:14:16.835106 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99571659-3003-40b9-a93d-11a1b612773a None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:16.835945 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99571659-3003-40b9-a93d-11a1b612773a None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:16.836461 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99571659-3003-40b9-a93d-11a1b612773a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:16.863167 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-99571659-3003-40b9-a93d-11a1b612773a None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:14:16.864726 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-99571659-3003-40b9-a93d-11a1b612773a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:16.901700 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1050/2112] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:14:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:14:16.903021 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99571659-3003-40b9-a93d-11a1b612773a None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:16.904658 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-99571659-3003-40b9-a93d-11a1b612773a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:16.924877 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99571659-3003-40b9-a93d-11a1b612773a None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:16.936555 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948bd7aa-6df8-484c-85f2-a43811aaabb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:16.937166 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948bd7aa-6df8-484c-85f2-a43811aaabb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:16.937454 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948bd7aa-6df8-484c-85f2-a43811aaabb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:16.939772 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948bd7aa-6df8-484c-85f2-a43811aaabb4 admin admin] PATH_INFO: `/v3/projects/30dcc0dd92cc4ece9f1810ba760a8b1c` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:16.939772 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948bd7aa-6df8-484c-85f2-a43811aaabb4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=30dcc0dd92cc4ece9f1810ba760a8b1c)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:16.941788 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948bd7aa-6df8-484c-85f2-a43811aaabb4 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:16.946539 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:16.972930 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-66963d01-4050-4944-90b3-f448307b6b95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37598ed1e36d4e81936d5ad3cf35612b'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:16.975772 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-66963d01-4050-4944-90b3-f448307b6b95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37598ed1e36d4e81936d5ad3cf35612b'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:16.989039 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-66963d01-4050-4944-90b3-f448307b6b95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37598ed1e36d4e81936d5ad3cf35612b'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:17.004509 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-66963d01-4050-4944-90b3-f448307b6b95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37598ed1e36d4e81936d5ad3cf35612b'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:17.022961 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-948bd7aa-6df8-484c-85f2-a43811aaabb4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30dcc0dd92cc4ece9f1810ba760a8b1c', 'request_id': 'req-948bd7aa-6df8-484c-85f2-a43811aaabb4'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:17.035731 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-66963d01-4050-4944-90b3-f448307b6b95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37598ed1e36d4e81936d5ad3cf35612b'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:17.036003 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-948bd7aa-6df8-484c-85f2-a43811aaabb4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30dcc0dd92cc4ece9f1810ba760a8b1c', 'request_id': 'req-948bd7aa-6df8-484c-85f2-a43811aaabb4'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:17.043998 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-948bd7aa-6df8-484c-85f2-a43811aaabb4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30dcc0dd92cc4ece9f1810ba760a8b1c', 'request_id': 'req-948bd7aa-6df8-484c-85f2-a43811aaabb4'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:17.044310 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1063/2113] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:14:16 2022] DELETE /identity/v3/users/37598ed1e36d4e81936d5ad3cf35612b => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:14:17.045451 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66963d01-4050-4944-90b3-f448307b6b95 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:17.048166 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-66963d01-4050-4944-90b3-f448307b6b95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:17.049185 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:17.062456 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-948bd7aa-6df8-484c-85f2-a43811aaabb4 admin admin] The token cache is being invalidate because project 30dcc0dd92cc4ece9f1810ba760a8b1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:14:17.062953 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-948bd7aa-6df8-484c-85f2-a43811aaabb4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:17.064369 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-948bd7aa-6df8-484c-85f2-a43811aaabb4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:17.066805 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1051/2114] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:14:16 2022] DELETE /identity/v3/projects/30dcc0dd92cc4ece9f1810ba760a8b1c => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:14:17.067908 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948bd7aa-6df8-484c-85f2-a43811aaabb4 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:17.069784 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-948bd7aa-6df8-484c-85f2-a43811aaabb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:17.132242 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66963d01-4050-4944-90b3-f448307b6b95 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:17.138858 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07de185d-3c5b-413d-9b6d-a3214c44723c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:17.139650 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07de185d-3c5b-413d-9b6d-a3214c44723c service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:17.140109 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07de185d-3c5b-413d-9b6d-a3214c44723c service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:17.140438 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07de185d-3c5b-413d-9b6d-a3214c44723c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:17.143189 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-07de185d-3c5b-413d-9b6d-a3214c44723c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:17.178524 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948bd7aa-6df8-484c-85f2-a43811aaabb4 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:17.278244 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07de185d-3c5b-413d-9b6d-a3214c44723c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:17.280934 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07de185d-3c5b-413d-9b6d-a3214c44723c service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:17.301506 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1064/2115] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:14:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:14:17.305391 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07de185d-3c5b-413d-9b6d-a3214c44723c service neutron] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:17.309663 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-07de185d-3c5b-413d-9b6d-a3214c44723c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:17.319290 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339c84bb-9643-4512-ae4b-2c628d6d27b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:17.319290 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339c84bb-9643-4512-ae4b-2c628d6d27b3 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:17.319290 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339c84bb-9643-4512-ae4b-2c628d6d27b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:17.319290 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339c84bb-9643-4512-ae4b-2c628d6d27b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:17.319912 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339c84bb-9643-4512-ae4b-2c628d6d27b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:14:17.338920 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07de185d-3c5b-413d-9b6d-a3214c44723c service neutron] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:17.342075 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339c84bb-9643-4512-ae4b-2c628d6d27b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:17.343827 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339c84bb-9643-4512-ae4b-2c628d6d27b3 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:17.356017 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e7d9b6-7879-411c-89c4-a228e393c5a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:17.356938 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e7d9b6-7879-411c-89c4-a228e393c5a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:17.357477 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e7d9b6-7879-411c-89c4-a228e393c5a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:17.357762 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e7d9b6-7879-411c-89c4-a228e393c5a8 admin admin] PATH_INFO: `/v3/projects/2366e681931c49118c1120350487bde5` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:17.361360 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e7d9b6-7879-411c-89c4-a228e393c5a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2366e681931c49118c1120350487bde5)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:17.363334 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e7d9b6-7879-411c-89c4-a228e393c5a8 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:17.365251 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1052/2116] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:14:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:14:17.366392 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339c84bb-9643-4512-ae4b-2c628d6d27b3 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:17.372360 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-339c84bb-9643-4512-ae4b-2c628d6d27b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:17.404768 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339c84bb-9643-4512-ae4b-2c628d6d27b3 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:17.419331 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3adb6d4-2378-4040-bcf9-fa6f9a740d0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:17.420238 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3adb6d4-2378-4040-bcf9-fa6f9a740d0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:17.420516 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3adb6d4-2378-4040-bcf9-fa6f9a740d0c admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:17.420787 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3adb6d4-2378-4040-bcf9-fa6f9a740d0c admin admin] PATH_INFO: `/v3/users/c03fe65aa9364b8a94f79f887387d260` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:17.422080 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3adb6d4-2378-4040-bcf9-fa6f9a740d0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c03fe65aa9364b8a94f79f887387d260)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:17.424321 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3adb6d4-2378-4040-bcf9-fa6f9a740d0c admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:17.465312 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-94e7d9b6-7879-411c-89c4-a228e393c5a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2366e681931c49118c1120350487bde5', 'request_id': 'req-94e7d9b6-7879-411c-89c4-a228e393c5a8'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:17.475725 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-94e7d9b6-7879-411c-89c4-a228e393c5a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2366e681931c49118c1120350487bde5', 'request_id': 'req-94e7d9b6-7879-411c-89c4-a228e393c5a8'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:17.490198 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:17.493848 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-94e7d9b6-7879-411c-89c4-a228e393c5a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2366e681931c49118c1120350487bde5', 'request_id': 'req-94e7d9b6-7879-411c-89c4-a228e393c5a8'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:17.526718 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-94e7d9b6-7879-411c-89c4-a228e393c5a8 admin admin] The token cache is being invalidate because project 2366e681931c49118c1120350487bde5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:14:17.527018 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-94e7d9b6-7879-411c-89c4-a228e393c5a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:17.527954 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-94e7d9b6-7879-411c-89c4-a228e393c5a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:17.528064 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-a3adb6d4-2378-4040-bcf9-fa6f9a740d0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c03fe65aa9364b8a94f79f887387d260'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:17.530244 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1065/2117] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:14:17 2022] DELETE /identity/v3/projects/2366e681931c49118c1120350487bde5 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:14:17.533673 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e7d9b6-7879-411c-89c4-a228e393c5a8 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:17.533882 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-94e7d9b6-7879-411c-89c4-a228e393c5a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:17.538504 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-a3adb6d4-2378-4040-bcf9-fa6f9a740d0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c03fe65aa9364b8a94f79f887387d260'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:17.539525 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-a3adb6d4-2378-4040-bcf9-fa6f9a740d0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c03fe65aa9364b8a94f79f887387d260'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:17.555241 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-a3adb6d4-2378-4040-bcf9-fa6f9a740d0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c03fe65aa9364b8a94f79f887387d260'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:17.581693 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-a3adb6d4-2378-4040-bcf9-fa6f9a740d0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c03fe65aa9364b8a94f79f887387d260'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:17.596778 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1053/2118] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:14:17 2022] DELETE /identity/v3/users/c03fe65aa9364b8a94f79f887387d260 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:14:17.602148 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3adb6d4-2378-4040-bcf9-fa6f9a740d0c admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:17.604230 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-a3adb6d4-2378-4040-bcf9-fa6f9a740d0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:17.635734 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:17.664867 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e7d9b6-7879-411c-89c4-a228e393c5a8 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:17.743157 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3adb6d4-2378-4040-bcf9-fa6f9a740d0c admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:17.751858 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad076435-89e4-4fde-89eb-60f6a196a602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:17.752763 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad076435-89e4-4fde-89eb-60f6a196a602 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:17.753043 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad076435-89e4-4fde-89eb-60f6a196a602 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:17.753315 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad076435-89e4-4fde-89eb-60f6a196a602 admin admin] PATH_INFO: `/v3/users/ff29128277cb4b6eaf78a8a62dd2b725` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:17.754696 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad076435-89e4-4fde-89eb-60f6a196a602 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff29128277cb4b6eaf78a8a62dd2b725)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:17.756683 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad076435-89e4-4fde-89eb-60f6a196a602 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:17.789379 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c46857-69f5-4cd0-90cb-2b74559fedbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:17.790502 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c46857-69f5-4cd0-90cb-2b74559fedbd admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:17.790847 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c46857-69f5-4cd0-90cb-2b74559fedbd admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:17.791420 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c46857-69f5-4cd0-90cb-2b74559fedbd admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:17.792533 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c46857-69f5-4cd0-90cb-2b74559fedbd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:17.796515 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c46857-69f5-4cd0-90cb-2b74559fedbd admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:17.865670 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1066/2119] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:14:17 2022] POST /identity/v3/projects => generated 379 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:14:17.871228 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c46857-69f5-4cd0-90cb-2b74559fedbd admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:17.873814 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-d1c46857-69f5-4cd0-90cb-2b74559fedbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:17.877075 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-ad076435-89e4-4fde-89eb-60f6a196a602 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff29128277cb4b6eaf78a8a62dd2b725'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:17.885157 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-ad076435-89e4-4fde-89eb-60f6a196a602 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff29128277cb4b6eaf78a8a62dd2b725'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:17.886010 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-ad076435-89e4-4fde-89eb-60f6a196a602 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff29128277cb4b6eaf78a8a62dd2b725'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:17.903494 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-ad076435-89e4-4fde-89eb-60f6a196a602 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff29128277cb4b6eaf78a8a62dd2b725'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:17.950498 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-ad076435-89e4-4fde-89eb-60f6a196a602 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff29128277cb4b6eaf78a8a62dd2b725'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:17.982885 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1054/2120] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:14:17 2022] DELETE /identity/v3/users/ff29128277cb4b6eaf78a8a62dd2b725 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:14:18.009042 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c46857-69f5-4cd0-90cb-2b74559fedbd admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:18.060392 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:18.112686 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9ab44e-aa43-4375-b857-21842a08902d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:18.113526 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9ab44e-aa43-4375-b857-21842a08902d admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:18.113816 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9ab44e-aa43-4375-b857-21842a08902d admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:18.114160 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9ab44e-aa43-4375-b857-21842a08902d admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:18.114860 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9ab44e-aa43-4375-b857-21842a08902d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:18.117098 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9ab44e-aa43-4375-b857-21842a08902d admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:18.147415 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1067/2121] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:14:17 2022] POST /identity/v3/users => generated 290 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:14:18.149714 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad076435-89e4-4fde-89eb-60f6a196a602 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:18.151790 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-ad076435-89e4-4fde-89eb-60f6a196a602 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:18.157400 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9ab44e-aa43-4375-b857-21842a08902d admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:18.163209 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-0b9ab44e-aa43-4375-b857-21842a08902d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:18.168585 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad076435-89e4-4fde-89eb-60f6a196a602 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:18.175146 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b2587f-9de3-49e2-97a1-882b99bcc2a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:18.175545 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9ab44e-aa43-4375-b857-21842a08902d admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:18.177750 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b2587f-9de3-49e2-97a1-882b99bcc2a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:18.182839 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b2587f-9de3-49e2-97a1-882b99bcc2a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:18.184227 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b2587f-9de3-49e2-97a1-882b99bcc2a8 admin admin] PATH_INFO: `/v3/projects/91b039b789a9402796ffb5eee541b3d3` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:18.184342 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fc181c-df42-426a-8d1f-88d8c71aa3a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:18.184452 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fc181c-df42-426a-8d1f-88d8c71aa3a3 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:18.184817 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fc181c-df42-426a-8d1f-88d8c71aa3a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:18.185164 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fc181c-df42-426a-8d1f-88d8c71aa3a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:18.186058 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fc181c-df42-426a-8d1f-88d8c71aa3a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:18.187504 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b2587f-9de3-49e2-97a1-882b99bcc2a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91b039b789a9402796ffb5eee541b3d3)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:18.187806 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fc181c-df42-426a-8d1f-88d8c71aa3a3 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:18.194366 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b2587f-9de3-49e2-97a1-882b99bcc2a8 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:18.204776 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1068/2122] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:14:18 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:14:18.206109 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fc181c-df42-426a-8d1f-88d8c71aa3a3 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:18.219662 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fc181c-df42-426a-8d1f-88d8c71aa3a3 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:18.234046 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681a1875-a061-46e3-9b15-b79315f7f456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:18.235149 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681a1875-a061-46e3-9b15-b79315f7f456 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:18.235825 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681a1875-a061-46e3-9b15-b79315f7f456 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:18.236282 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681a1875-a061-46e3-9b15-b79315f7f456 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:18.240031 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681a1875-a061-46e3-9b15-b79315f7f456 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:18.242333 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681a1875-a061-46e3-9b15-b79315f7f456 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:18.273225 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1069/2123] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:14:18 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:14:18.274440 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681a1875-a061-46e3-9b15-b79315f7f456 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:18.286660 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-70b2587f-9de3-49e2-97a1-882b99bcc2a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91b039b789a9402796ffb5eee541b3d3', 'request_id': 'req-70b2587f-9de3-49e2-97a1-882b99bcc2a8'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:18.287571 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681a1875-a061-46e3-9b15-b79315f7f456 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:18.298385 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-70b2587f-9de3-49e2-97a1-882b99bcc2a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91b039b789a9402796ffb5eee541b3d3', 'request_id': 'req-70b2587f-9de3-49e2-97a1-882b99bcc2a8'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:18.308590 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-70b2587f-9de3-49e2-97a1-882b99bcc2a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91b039b789a9402796ffb5eee541b3d3', 'request_id': 'req-70b2587f-9de3-49e2-97a1-882b99bcc2a8'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:18.324743 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-70b2587f-9de3-49e2-97a1-882b99bcc2a8 admin admin] The token cache is being invalidate because project 91b039b789a9402796ffb5eee541b3d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:14:18.325178 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-70b2587f-9de3-49e2-97a1-882b99bcc2a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:18.325966 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-70b2587f-9de3-49e2-97a1-882b99bcc2a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:18.331178 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1055/2124] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:14:18 2022] DELETE /identity/v3/projects/91b039b789a9402796ffb5eee541b3d3 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:14:18.333914 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fa9b86-88b1-400e-8487-d15179226272 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:18.334207 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fa9b86-88b1-400e-8487-d15179226272 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:18.334483 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fa9b86-88b1-400e-8487-d15179226272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:18.369605 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-e3fa9b86-88b1-400e-8487-d15179226272 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:14:18.371126 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-e3fa9b86-88b1-400e-8487-d15179226272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:18.371858 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7686ce8-ee3b-4ef1-af9e-c3b7690faadf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:18.372939 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7686ce8-ee3b-4ef1-af9e-c3b7690faadf admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:18.373253 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7686ce8-ee3b-4ef1-af9e-c3b7690faadf admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:18.373619 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7686ce8-ee3b-4ef1-af9e-c3b7690faadf admin admin] PATH_INFO: `/v3/projects/9b6f57645a0e416cb21768225f71801e/users/6a56ee63e15440859f681d1a0bc0ca0f/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:18.387990 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1056/2125] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:14:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:14:18.397231 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7686ce8-ee3b-4ef1-af9e-c3b7690faadf admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b6f57645a0e416cb21768225f71801e, user_id=6a56ee63e15440859f681d1a0bc0ca0f, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:18.397437 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fc86c2-b127-417f-8b06-5108cda72ceb None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:18.397553 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fc86c2-b127-417f-8b06-5108cda72ceb None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:18.398032 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fc86c2-b127-417f-8b06-5108cda72ceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:18.400999 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7686ce8-ee3b-4ef1-af9e-c3b7690faadf admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:18.404689 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:18.419883 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-a0fc86c2-b127-417f-8b06-5108cda72ceb None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:14:18.421534 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-a0fc86c2-b127-417f-8b06-5108cda72ceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:18.429061 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1070/2126] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:14:18 2022] PUT /identity/v3/projects/9b6f57645a0e416cb21768225f71801e/users/6a56ee63e15440859f681d1a0bc0ca0f/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:14:18.441371 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334fcb98-97f9-43d0-93c1-652635e54909 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:18.441371 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334fcb98-97f9-43d0-93c1-652635e54909 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:18.441749 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334fcb98-97f9-43d0-93c1-652635e54909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:18.506156 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-334fcb98-97f9-43d0-93c1-652635e54909 None None] MFA Rules not processed for user `6a56ee63e15440859f681d1a0bc0ca0f`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:14:18.506558 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1057/2127] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:14:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:14:18.508138 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-334fcb98-97f9-43d0-93c1-652635e54909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:18.510678 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fc86c2-b127-417f-8b06-5108cda72ceb None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:18.522143 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fc86c2-b127-417f-8b06-5108cda72ceb None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:18.528309 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7020da-0f72-4b81-bf26-f39b8f942c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:18.529162 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7020da-0f72-4b81-bf26-f39b8f942c77 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:18.529568 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7020da-0f72-4b81-bf26-f39b8f942c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:18.530174 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7020da-0f72-4b81-bf26-f39b8f942c77 admin admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:18.531203 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7020da-0f72-4b81-bf26-f39b8f942c77 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:14:18.531604 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7020da-0f72-4b81-bf26-f39b8f942c77 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:18.533741 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7020da-0f72-4b81-bf26-f39b8f942c77 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:18.549554 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1058/2128] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:14:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:14:18.554888 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7020da-0f72-4b81-bf26-f39b8f942c77 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:18.566746 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7020da-0f72-4b81-bf26-f39b8f942c77 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:18.572925 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a29abc-c458-43d9-aaaf-7783f805f9fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:18.573666 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a29abc-c458-43d9-aaaf-7783f805f9fc admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:18.574588 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a29abc-c458-43d9-aaaf-7783f805f9fc admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:18.574883 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a29abc-c458-43d9-aaaf-7783f805f9fc admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:18.575682 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a29abc-c458-43d9-aaaf-7783f805f9fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:18.577791 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a29abc-c458-43d9-aaaf-7783f805f9fc admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:18.606440 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1071/2129] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:14:18 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:14:18.611060 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334fcb98-97f9-43d0-93c1-652635e54909 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:18.612738 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-334fcb98-97f9-43d0-93c1-652635e54909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:18.619210 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1059/2130] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:14:18 2022] POST /identity/v3/projects => generated 375 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:14:18.620230 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a29abc-c458-43d9-aaaf-7783f805f9fc admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:18.628608 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334fcb98-97f9-43d0-93c1-652635e54909 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:18.635700 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:18.730428 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5e4bd9-3d68-4474-81dc-c53f422688a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:18.731411 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5e4bd9-3d68-4474-81dc-c53f422688a0 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:18.731660 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5e4bd9-3d68-4474-81dc-c53f422688a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:18.731830 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5e4bd9-3d68-4474-81dc-c53f422688a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:18.734089 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a29abc-c458-43d9-aaaf-7783f805f9fc admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:18.734805 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5e4bd9-3d68-4474-81dc-c53f422688a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:18.737109 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5e4bd9-3d68-4474-81dc-c53f422688a0 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:18.745911 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf4274e-36a4-4a3c-aa26-cbad183ab30e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:18.746603 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf4274e-36a4-4a3c-aa26-cbad183ab30e admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:18.746872 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf4274e-36a4-4a3c-aa26-cbad183ab30e admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:18.747145 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf4274e-36a4-4a3c-aa26-cbad183ab30e admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:18.751557 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf4274e-36a4-4a3c-aa26-cbad183ab30e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:18.755587 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf4274e-36a4-4a3c-aa26-cbad183ab30e admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:18.787559 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1060/2131] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:14:18 2022] POST /identity/v3/users => generated 288 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:14:18.788567 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1072/2132] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:14:18 2022] POST /identity/v3/projects => generated 377 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:14:18.792641 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5e4bd9-3d68-4474-81dc-c53f422688a0 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:18.793820 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf4274e-36a4-4a3c-aa26-cbad183ab30e admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:18.814088 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf4274e-36a4-4a3c-aa26-cbad183ab30e admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:18.916833 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:18.950663 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5e4bd9-3d68-4474-81dc-c53f422688a0 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:18.951943 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4cdf5c-07f5-47f4-9eb9-052ed678d20f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:18.952846 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4cdf5c-07f5-47f4-9eb9-052ed678d20f admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:18.953411 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4cdf5c-07f5-47f4-9eb9-052ed678d20f admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:18.953850 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4cdf5c-07f5-47f4-9eb9-052ed678d20f admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:18.955791 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4cdf5c-07f5-47f4-9eb9-052ed678d20f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:18.961304 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4cdf5c-07f5-47f4-9eb9-052ed678d20f admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:18.963658 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51269545-f172-45e0-a692-4b521ba03948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:18.964870 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51269545-f172-45e0-a692-4b521ba03948 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:18.966144 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51269545-f172-45e0-a692-4b521ba03948 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:18.968934 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51269545-f172-45e0-a692-4b521ba03948 admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:18.969786 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51269545-f172-45e0-a692-4b521ba03948 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:18.976808 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51269545-f172-45e0-a692-4b521ba03948 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:18.996753 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1061/2133] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:14:18 2022] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:14:19.007032 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4cdf5c-07f5-47f4-9eb9-052ed678d20f admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:19.012329 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-6a4cdf5c-07f5-47f4-9eb9-052ed678d20f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:19.029172 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1073/2134] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:14:18 2022] POST /identity/v3/users => generated 295 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:14:19.030464 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51269545-f172-45e0-a692-4b521ba03948 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:19.038260 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4cdf5c-07f5-47f4-9eb9-052ed678d20f admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:19.045496 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a22fe62-18f9-44b3-b7c8-fa9be5b27f53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:19.046427 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a22fe62-18f9-44b3-b7c8-fa9be5b27f53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:19.046708 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a22fe62-18f9-44b3-b7c8-fa9be5b27f53 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:19.046977 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a22fe62-18f9-44b3-b7c8-fa9be5b27f53 admin admin] PATH_INFO: `/v3/projects/638e3886481548668ccddebb3eabfa12` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:19.048324 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a22fe62-18f9-44b3-b7c8-fa9be5b27f53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=638e3886481548668ccddebb3eabfa12)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:19.050146 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51269545-f172-45e0-a692-4b521ba03948 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:19.050335 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a22fe62-18f9-44b3-b7c8-fa9be5b27f53 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:19.065934 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac5450b-6049-4914-b48b-b03c28e23c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:19.067938 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac5450b-6049-4914-b48b-b03c28e23c10 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:19.068505 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac5450b-6049-4914-b48b-b03c28e23c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:19.068784 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac5450b-6049-4914-b48b-b03c28e23c10 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:19.069558 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac5450b-6049-4914-b48b-b03c28e23c10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:19.071255 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac5450b-6049-4914-b48b-b03c28e23c10 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:19.091420 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1074/2135] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:14:19 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:14:19.092628 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac5450b-6049-4914-b48b-b03c28e23c10 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:19.108087 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac5450b-6049-4914-b48b-b03c28e23c10 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:19.116105 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-6a22fe62-18f9-44b3-b7c8-fa9be5b27f53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '638e3886481548668ccddebb3eabfa12', 'request_id': 'req-6a22fe62-18f9-44b3-b7c8-fa9be5b27f53'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:19.128690 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-6a22fe62-18f9-44b3-b7c8-fa9be5b27f53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '638e3886481548668ccddebb3eabfa12', 'request_id': 'req-6a22fe62-18f9-44b3-b7c8-fa9be5b27f53'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:19.140298 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-6a22fe62-18f9-44b3-b7c8-fa9be5b27f53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '638e3886481548668ccddebb3eabfa12', 'request_id': 'req-6a22fe62-18f9-44b3-b7c8-fa9be5b27f53'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:19.185175 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-6a22fe62-18f9-44b3-b7c8-fa9be5b27f53 admin admin] The token cache is being invalidate because project 638e3886481548668ccddebb3eabfa12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:14:19.185562 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-6a22fe62-18f9-44b3-b7c8-fa9be5b27f53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:19.186488 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-6a22fe62-18f9-44b3-b7c8-fa9be5b27f53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:19.188233 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1062/2136] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:14:19 2022] DELETE /identity/v3/projects/638e3886481548668ccddebb3eabfa12 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:14:19.189072 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a22fe62-18f9-44b3-b7c8-fa9be5b27f53 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:19.193898 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-6a22fe62-18f9-44b3-b7c8-fa9be5b27f53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:19.217460 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f859978-1353-4a69-99ce-6e93f2bb3a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:19.220878 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f859978-1353-4a69-99ce-6e93f2bb3a97 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:19.221423 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f859978-1353-4a69-99ce-6e93f2bb3a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:19.221926 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f859978-1353-4a69-99ce-6e93f2bb3a97 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:19.222927 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f859978-1353-4a69-99ce-6e93f2bb3a97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:19.224838 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f859978-1353-4a69-99ce-6e93f2bb3a97 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:19.236628 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1075/2137] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:14:19 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:14:19.238084 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f859978-1353-4a69-99ce-6e93f2bb3a97 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:19.240417 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-8f859978-1353-4a69-99ce-6e93f2bb3a97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:19.254245 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f859978-1353-4a69-99ce-6e93f2bb3a97 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:19.259970 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc45d5a-882c-4c34-a1aa-bea885b56635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:19.261446 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc45d5a-882c-4c34-a1aa-bea885b56635 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:19.261977 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc45d5a-882c-4c34-a1aa-bea885b56635 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:19.262474 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc45d5a-882c-4c34-a1aa-bea885b56635 admin admin] PATH_INFO: `/v3/projects/e9da90b237c34e5dad70af3cd2742be5` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:19.263973 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc45d5a-882c-4c34-a1aa-bea885b56635 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9da90b237c34e5dad70af3cd2742be5)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:19.266235 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc45d5a-882c-4c34-a1aa-bea885b56635 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:19.270039 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:19.338511 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a22fe62-18f9-44b3-b7c8-fa9be5b27f53 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:19.359395 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-5dc45d5a-882c-4c34-a1aa-bea885b56635 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9da90b237c34e5dad70af3cd2742be5', 'request_id': 'req-5dc45d5a-882c-4c34-a1aa-bea885b56635'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:19.378017 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-5dc45d5a-882c-4c34-a1aa-bea885b56635 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9da90b237c34e5dad70af3cd2742be5', 'request_id': 'req-5dc45d5a-882c-4c34-a1aa-bea885b56635'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:19.398175 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-5dc45d5a-882c-4c34-a1aa-bea885b56635 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9da90b237c34e5dad70af3cd2742be5', 'request_id': 'req-5dc45d5a-882c-4c34-a1aa-bea885b56635'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:19.435393 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-5dc45d5a-882c-4c34-a1aa-bea885b56635 admin admin] The token cache is being invalidate because project e9da90b237c34e5dad70af3cd2742be5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:14:19.435825 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-5dc45d5a-882c-4c34-a1aa-bea885b56635 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:19.436585 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-5dc45d5a-882c-4c34-a1aa-bea885b56635 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:19.439344 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1076/2138] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:14:19 2022] DELETE /identity/v3/projects/e9da90b237c34e5dad70af3cd2742be5 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:14:19.440869 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf38b1a1-9016-4223-92ec-6c0a5ad6908b None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:19.441835 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf38b1a1-9016-4223-92ec-6c0a5ad6908b None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:19.442862 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf38b1a1-9016-4223-92ec-6c0a5ad6908b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:19.454808 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3924373-df1d-4c71-8f3a-89a747dac684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:19.464256 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3924373-df1d-4c71-8f3a-89a747dac684 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:19.465294 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3924373-df1d-4c71-8f3a-89a747dac684 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:19.465784 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3924373-df1d-4c71-8f3a-89a747dac684 admin admin] PATH_INFO: `/v3/projects/dcf0875fb49640ebaa610b675e3b0e24/users/08deef2f7b1c4532970eb1ccac222ba9/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:19.468042 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-cf38b1a1-9016-4223-92ec-6c0a5ad6908b None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:14:19.469575 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-cf38b1a1-9016-4223-92ec-6c0a5ad6908b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:19.486172 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3924373-df1d-4c71-8f3a-89a747dac684 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcf0875fb49640ebaa610b675e3b0e24, user_id=08deef2f7b1c4532970eb1ccac222ba9, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:19.488075 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1077/2139] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:14:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:14:19.490927 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3924373-df1d-4c71-8f3a-89a747dac684 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:19.496862 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf38b1a1-9016-4223-92ec-6c0a5ad6908b None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:19.500169 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-cf38b1a1-9016-4223-92ec-6c0a5ad6908b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:19.516987 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf38b1a1-9016-4223-92ec-6c0a5ad6908b None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:19.517558 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1063/2140] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:14:19 2022] PUT /identity/v3/projects/dcf0875fb49640ebaa610b675e3b0e24/users/08deef2f7b1c4532970eb1ccac222ba9/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:14:19.519603 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8bea09-62b3-43b6-a024-e502c429eb2b None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:19.520262 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8bea09-62b3-43b6-a024-e502c429eb2b None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:19.520883 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8bea09-62b3-43b6-a024-e502c429eb2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:19.538472 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:19.545318 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-5e8bea09-62b3-43b6-a024-e502c429eb2b None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:14:19.548637 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-5e8bea09-62b3-43b6-a024-e502c429eb2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:19.653128 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1064/2141] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:14:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:14:19.653128 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff009ee-8edb-473b-99e5-5a34b4e1c460 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:19.653128 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff009ee-8edb-473b-99e5-5a34b4e1c460 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:19.653128 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff009ee-8edb-473b-99e5-5a34b4e1c460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:19.670979 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5912ed-5795-4198-ad80-1d7dfe4ee8e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:19.672414 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5912ed-5795-4198-ad80-1d7dfe4ee8e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:19.673447 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-2ff009ee-8edb-473b-99e5-5a34b4e1c460 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:14:19.673855 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5912ed-5795-4198-ad80-1d7dfe4ee8e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:19.674748 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5912ed-5795-4198-ad80-1d7dfe4ee8e7 admin admin] PATH_INFO: `/v3/projects/a17bb53762284d0d940025faca3184b1/users/e5312516da104aab913accf1cab84e13/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:19.675504 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-2ff009ee-8edb-473b-99e5-5a34b4e1c460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:19.687058 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1065/2142] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:14:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:14:19.688660 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828baa88-50c5-4487-b4dd-d6ea2cf4da7e None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:19.689077 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828baa88-50c5-4487-b4dd-d6ea2cf4da7e None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:19.689487 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828baa88-50c5-4487-b4dd-d6ea2cf4da7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:19.696891 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5912ed-5795-4198-ad80-1d7dfe4ee8e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a17bb53762284d0d940025faca3184b1, user_id=e5312516da104aab913accf1cab84e13, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:19.700559 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5912ed-5795-4198-ad80-1d7dfe4ee8e7 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:19.721001 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1078/2143] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:14:19 2022] PUT /identity/v3/projects/a17bb53762284d0d940025faca3184b1/users/e5312516da104aab913accf1cab84e13/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:14:19.723459 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bf6d35-384a-477c-81b6-9293bf9f5445 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:19.723923 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bf6d35-384a-477c-81b6-9293bf9f5445 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:19.724394 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bf6d35-384a-477c-81b6-9293bf9f5445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:19.724649 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-828baa88-50c5-4487-b4dd-d6ea2cf4da7e None None] MFA Rules not processed for user `08deef2f7b1c4532970eb1ccac222ba9`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:14:19.726071 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-828baa88-50c5-4487-b4dd-d6ea2cf4da7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:19.752957 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-32bf6d35-384a-477c-81b6-9293bf9f5445 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:14:19.754461 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-32bf6d35-384a-477c-81b6-9293bf9f5445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:19.811007 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1066/2144] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:14:19 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:14:19.813970 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828baa88-50c5-4487-b4dd-d6ea2cf4da7e None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:19.839236 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1079/2145] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:14:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:14:19.843571 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bf6d35-384a-477c-81b6-9293bf9f5445 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:19.855627 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bf6d35-384a-477c-81b6-9293bf9f5445 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:19.863211 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f38dfd-9bfb-4e29-b13d-4d27a620d4b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:19.863886 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f38dfd-9bfb-4e29-b13d-4d27a620d4b3 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:19.864167 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f38dfd-9bfb-4e29-b13d-4d27a620d4b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:19.864425 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f38dfd-9bfb-4e29-b13d-4d27a620d4b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:19.865146 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f38dfd-9bfb-4e29-b13d-4d27a620d4b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:19.866783 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f38dfd-9bfb-4e29-b13d-4d27a620d4b3 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:19.869257 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:19.886648 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1080/2146] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:14:19 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:14:19.887898 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f38dfd-9bfb-4e29-b13d-4d27a620d4b3 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:19.890705 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-60f38dfd-9bfb-4e29-b13d-4d27a620d4b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:19.907906 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f38dfd-9bfb-4e29-b13d-4d27a620d4b3 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:19.914489 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828baa88-50c5-4487-b4dd-d6ea2cf4da7e None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:19.915073 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758140cc-c3b6-4ae3-ac38-95ea3a8d4f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:19.915752 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758140cc-c3b6-4ae3-ac38-95ea3a8d4f6d admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:19.916077 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758140cc-c3b6-4ae3-ac38-95ea3a8d4f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:19.916353 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758140cc-c3b6-4ae3-ac38-95ea3a8d4f6d admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:19.917048 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758140cc-c3b6-4ae3-ac38-95ea3a8d4f6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:19.919054 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758140cc-c3b6-4ae3-ac38-95ea3a8d4f6d admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:19.920512 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72947a2-f03c-4a32-a5ed-7504349507aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:19.921421 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72947a2-f03c-4a32-a5ed-7504349507aa admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:19.921708 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72947a2-f03c-4a32-a5ed-7504349507aa admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:19.922150 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72947a2-f03c-4a32-a5ed-7504349507aa admin admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:19.923597 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72947a2-f03c-4a32-a5ed-7504349507aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:14:19.923908 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72947a2-f03c-4a32-a5ed-7504349507aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:19.926069 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72947a2-f03c-4a32-a5ed-7504349507aa admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:19.941661 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1067/2147] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:14:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:14:19.943003 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72947a2-f03c-4a32-a5ed-7504349507aa admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:19.961274 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1081/2148] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:14:19 2022] POST /identity/v3/projects => generated 375 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:14:19.962164 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758140cc-c3b6-4ae3-ac38-95ea3a8d4f6d admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:19.967241 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72947a2-f03c-4a32-a5ed-7504349507aa admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:19.997330 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:20.055606 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758140cc-c3b6-4ae3-ac38-95ea3a8d4f6d admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:20.059931 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3c2a7f-3a28-4e48-9db8-cd92a47cfa67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:20.060741 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3c2a7f-3a28-4e48-9db8-cd92a47cfa67 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:20.061083 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3c2a7f-3a28-4e48-9db8-cd92a47cfa67 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:20.061291 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3c2a7f-3a28-4e48-9db8-cd92a47cfa67 admin admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:20.061772 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ac3e03-297d-48b6-b640-78be776132a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:20.062108 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3c2a7f-3a28-4e48-9db8-cd92a47cfa67 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:14:20.062480 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3c2a7f-3a28-4e48-9db8-cd92a47cfa67 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:20.063439 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ac3e03-297d-48b6-b640-78be776132a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:20.063889 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ac3e03-297d-48b6-b640-78be776132a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:20.064281 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ac3e03-297d-48b6-b640-78be776132a2 admin admin] PATH_INFO: `/v3/projects/a17bb53762284d0d940025faca3184b1/users/e5312516da104aab913accf1cab84e13/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:20.064606 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3c2a7f-3a28-4e48-9db8-cd92a47cfa67 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:20.068789 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ac3e03-297d-48b6-b640-78be776132a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a17bb53762284d0d940025faca3184b1, user_id=e5312516da104aab913accf1cab84e13, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:20.072246 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ac3e03-297d-48b6-b640-78be776132a2 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:20.083299 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1068/2149] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:14:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:14:20.083299 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3c2a7f-3a28-4e48-9db8-cd92a47cfa67 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:20.092037 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1082/2150] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:14:19 2022] PUT /identity/v3/projects/a17bb53762284d0d940025faca3184b1/users/e5312516da104aab913accf1cab84e13/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:14:20.093369 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ac3e03-297d-48b6-b640-78be776132a2 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:20.095023 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3c2a7f-3a28-4e48-9db8-cd92a47cfa67 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:20.175045 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab30aa1-1a01-4ff8-890f-a00ef76848f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:20.175847 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab30aa1-1a01-4ff8-890f-a00ef76848f1 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:20.176190 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab30aa1-1a01-4ff8-890f-a00ef76848f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:20.176525 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab30aa1-1a01-4ff8-890f-a00ef76848f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:20.177594 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab30aa1-1a01-4ff8-890f-a00ef76848f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:20.180124 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab30aa1-1a01-4ff8-890f-a00ef76848f1 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:20.188586 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ac3e03-297d-48b6-b640-78be776132a2 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:20.195009 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aa1451-8f78-4719-8f4c-fceb4fd9b356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:20.195754 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aa1451-8f78-4719-8f4c-fceb4fd9b356 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:20.196035 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aa1451-8f78-4719-8f4c-fceb4fd9b356 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:20.196335 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aa1451-8f78-4719-8f4c-fceb4fd9b356 admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:20.197033 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aa1451-8f78-4719-8f4c-fceb4fd9b356 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:20.200061 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aa1451-8f78-4719-8f4c-fceb4fd9b356 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:20.223156 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1069/2151] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:14:20 2022] POST /identity/v3/projects => generated 375 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:14:20.224167 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab30aa1-1a01-4ff8-890f-a00ef76848f1 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:20.238375 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1083/2152] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:14:20 2022] POST /identity/v3/users => generated 294 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:14:20.238375 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9acb731-ffab-4342-b053-e4eae0cebb95 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:20.238576 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9acb731-ffab-4342-b053-e4eae0cebb95 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:20.238818 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9acb731-ffab-4342-b053-e4eae0cebb95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:20.283881 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-c9acb731-ffab-4342-b053-e4eae0cebb95 None None] MFA Rules not processed for user `e5312516da104aab913accf1cab84e13`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:14:20.285213 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-c9acb731-ffab-4342-b053-e4eae0cebb95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:20.343387 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:20.382176 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1084/2153] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:14:20 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:14:20.382176 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9acb731-ffab-4342-b053-e4eae0cebb95 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:20.391660 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9acb731-ffab-4342-b053-e4eae0cebb95 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:20.398464 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7610d11e-d808-43fe-b77b-93fd3370cc1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:20.399278 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7610d11e-d808-43fe-b77b-93fd3370cc1d admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:20.399632 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7610d11e-d808-43fe-b77b-93fd3370cc1d admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:20.399979 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7610d11e-d808-43fe-b77b-93fd3370cc1d admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:20.400984 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7610d11e-d808-43fe-b77b-93fd3370cc1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:20.403353 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7610d11e-d808-43fe-b77b-93fd3370cc1d admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:20.406893 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab30aa1-1a01-4ff8-890f-a00ef76848f1 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:20.423031 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99829ee5-1221-4331-bab2-15d46342e949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:20.424487 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99829ee5-1221-4331-bab2-15d46342e949 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:20.425102 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99829ee5-1221-4331-bab2-15d46342e949 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:20.425686 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99829ee5-1221-4331-bab2-15d46342e949 admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:20.427041 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99829ee5-1221-4331-bab2-15d46342e949 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:20.429098 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99829ee5-1221-4331-bab2-15d46342e949 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:20.441676 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1085/2154] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:14:20 2022] POST /identity/v3/users => generated 288 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:14:20.442916 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7610d11e-d808-43fe-b77b-93fd3370cc1d admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:20.462064 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7610d11e-d808-43fe-b77b-93fd3370cc1d admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:20.468150 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945cb338-6181-421e-95c0-f1a7073867b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:20.469160 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945cb338-6181-421e-95c0-f1a7073867b5 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:20.469641 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945cb338-6181-421e-95c0-f1a7073867b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:20.470069 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945cb338-6181-421e-95c0-f1a7073867b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:20.470926 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945cb338-6181-421e-95c0-f1a7073867b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:20.472777 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945cb338-6181-421e-95c0-f1a7073867b5 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:20.504786 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1070/2155] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:14:20 2022] POST /identity/v3/projects => generated 403 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:14:20.505179 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1086/2156] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:14:20 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:14:20.505791 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99829ee5-1221-4331-bab2-15d46342e949 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:20.506606 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945cb338-6181-421e-95c0-f1a7073867b5 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:20.520286 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945cb338-6181-421e-95c0-f1a7073867b5 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:20.546116 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:20.613833 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99829ee5-1221-4331-bab2-15d46342e949 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:20.618408 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d67d701-8268-4af4-b552-ed4b182aec2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:20.618408 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d67d701-8268-4af4-b552-ed4b182aec2e admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:20.619439 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d67d701-8268-4af4-b552-ed4b182aec2e admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:20.620031 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d67d701-8268-4af4-b552-ed4b182aec2e admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:20.620749 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d67d701-8268-4af4-b552-ed4b182aec2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:20.623591 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d67d701-8268-4af4-b552-ed4b182aec2e admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:20.629455 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ae0b4f-050d-4489-b820-4992be930f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:20.630361 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ae0b4f-050d-4489-b820-4992be930f8a admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:20.631056 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ae0b4f-050d-4489-b820-4992be930f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:20.631897 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ae0b4f-050d-4489-b820-4992be930f8a admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:20.641165 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ae0b4f-050d-4489-b820-4992be930f8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:20.645252 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ae0b4f-050d-4489-b820-4992be930f8a admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:20.663063 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1087/2157] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:14:20 2022] POST /identity/v3/users => generated 302 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:14:20.669121 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1071/2158] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:14:20 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:14:20.669204 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d67d701-8268-4af4-b552-ed4b182aec2e admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:20.669277 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ae0b4f-050d-4489-b820-4992be930f8a admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:20.671110 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-31ae0b4f-050d-4489-b820-4992be930f8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:20.688175 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d67d701-8268-4af4-b552-ed4b182aec2e admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:20.701593 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d763a1-0b29-4f09-80a1-8cbf0a329c68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:20.703162 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d763a1-0b29-4f09-80a1-8cbf0a329c68 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:20.703668 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d763a1-0b29-4f09-80a1-8cbf0a329c68 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:20.704164 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d763a1-0b29-4f09-80a1-8cbf0a329c68 admin admin] PATH_INFO: `/v3/projects/809fa86aaf464746af85d31cd14a7f3b/users/c0da36d3851649bca0425150125c946d/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:20.734695 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d763a1-0b29-4f09-80a1-8cbf0a329c68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=809fa86aaf464746af85d31cd14a7f3b, user_id=c0da36d3851649bca0425150125c946d, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:20.741748 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d763a1-0b29-4f09-80a1-8cbf0a329c68 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:20.763639 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1088/2159] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:14:20 2022] PUT /identity/v3/projects/809fa86aaf464746af85d31cd14a7f3b/users/c0da36d3851649bca0425150125c946d/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:14:20.767666 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d763a1-0b29-4f09-80a1-8cbf0a329c68 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:20.804428 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ae0b4f-050d-4489-b820-4992be930f8a admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:20.895723 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d763a1-0b29-4f09-80a1-8cbf0a329c68 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:20.918951 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bed6916-4349-451f-aeb5-f15644cc45fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:20.920533 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bed6916-4349-451f-aeb5-f15644cc45fc admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:20.921019 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bed6916-4349-451f-aeb5-f15644cc45fc admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:20.921734 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bed6916-4349-451f-aeb5-f15644cc45fc admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:20.922711 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bed6916-4349-451f-aeb5-f15644cc45fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:20.925875 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bed6916-4349-451f-aeb5-f15644cc45fc admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:20.970160 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1089/2160] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:14:20 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:14:20.972989 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bed6916-4349-451f-aeb5-f15644cc45fc admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:20.991847 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc502749-0d4a-44d9-b3b7-25cea10066e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:20.999615 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc502749-0d4a-44d9-b3b7-25cea10066e9 service nova] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:21.000027 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc502749-0d4a-44d9-b3b7-25cea10066e9 service nova] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:21.000305 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc502749-0d4a-44d9-b3b7-25cea10066e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:21.003396 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bed6916-4349-451f-aeb5-f15644cc45fc admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:21.019916 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14f8372-0765-4ac0-8e64-f8fabf5e9447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:21.021051 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14f8372-0765-4ac0-8e64-f8fabf5e9447 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:21.021537 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14f8372-0765-4ac0-8e64-f8fabf5e9447 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:21.022051 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14f8372-0765-4ac0-8e64-f8fabf5e9447 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:21.023186 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14f8372-0765-4ac0-8e64-f8fabf5e9447 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:21.025160 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14f8372-0765-4ac0-8e64-f8fabf5e9447 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:21.052004 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1090/2161] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:14:20 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:14:21.053464 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14f8372-0765-4ac0-8e64-f8fabf5e9447 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:21.086062 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14f8372-0765-4ac0-8e64-f8fabf5e9447 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:21.097764 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228f9060-8e5d-409a-80e4-9004c69a5c91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:21.099145 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228f9060-8e5d-409a-80e4-9004c69a5c91 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:21.099515 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228f9060-8e5d-409a-80e4-9004c69a5c91 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:21.099855 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228f9060-8e5d-409a-80e4-9004c69a5c91 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:21.100933 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228f9060-8e5d-409a-80e4-9004c69a5c91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:21.102733 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228f9060-8e5d-409a-80e4-9004c69a5c91 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:21.104502 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:21.134795 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:21.137834 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc502749-0d4a-44d9-b3b7-25cea10066e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:21.140936 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc502749-0d4a-44d9-b3b7-25cea10066e9 service nova] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:21.152197 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1091/2162] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:14:21 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:14:21.153440 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228f9060-8e5d-409a-80e4-9004c69a5c91 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:21.168729 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1072/2163] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:14:20 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 502 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:14:21.170256 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc502749-0d4a-44d9-b3b7-25cea10066e9 service nova] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:21.171087 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228f9060-8e5d-409a-80e4-9004c69a5c91 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:21.181123 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75d53c6-2092-4feb-b72d-87bcafb0df7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:21.181842 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75d53c6-2092-4feb-b72d-87bcafb0df7f admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:21.182194 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75d53c6-2092-4feb-b72d-87bcafb0df7f admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:21.182956 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75d53c6-2092-4feb-b72d-87bcafb0df7f admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:21.183292 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75d53c6-2092-4feb-b72d-87bcafb0df7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:21.185115 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75d53c6-2092-4feb-b72d-87bcafb0df7f admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:21.202146 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc502749-0d4a-44d9-b3b7-25cea10066e9 service nova] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:21.202375 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1092/2164] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:14:21 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:14:21.202375 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75d53c6-2092-4feb-b72d-87bcafb0df7f admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:21.204281 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a97a0be-7231-473b-ab88-137ba157c658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:21.206131 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a97a0be-7231-473b-ab88-137ba157c658 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:21.206468 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a97a0be-7231-473b-ab88-137ba157c658 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:21.207712 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a97a0be-7231-473b-ab88-137ba157c658 admin admin] PATH_INFO: `/v3/projects/66610bd60abc459dae24d25231d10cfe/users/bfe8a5d8eb3f486f8a40fe1940c8b8aa/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:21.223491 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75d53c6-2092-4feb-b72d-87bcafb0df7f admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:21.229319 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bb2a09-1f14-4025-82fc-1764bf9673f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:21.230415 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bb2a09-1f14-4025-82fc-1764bf9673f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:21.230772 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bb2a09-1f14-4025-82fc-1764bf9673f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:21.231092 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a97a0be-7231-473b-ab88-137ba157c658 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66610bd60abc459dae24d25231d10cfe, user_id=bfe8a5d8eb3f486f8a40fe1940c8b8aa, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:21.231201 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bb2a09-1f14-4025-82fc-1764bf9673f4 admin admin] PATH_INFO: `/v3/projects/809fa86aaf464746af85d31cd14a7f3b/users/c0da36d3851649bca0425150125c946d/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:21.234456 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a97a0be-7231-473b-ab88-137ba157c658 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:21.235022 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bb2a09-1f14-4025-82fc-1764bf9673f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=809fa86aaf464746af85d31cd14a7f3b, user_id=c0da36d3851649bca0425150125c946d, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:21.238318 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bb2a09-1f14-4025-82fc-1764bf9673f4 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:21.255430 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1093/2165] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:14:21 2022] PUT /identity/v3/projects/809fa86aaf464746af85d31cd14a7f3b/users/c0da36d3851649bca0425150125c946d/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:14:21.256602 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bb2a09-1f14-4025-82fc-1764bf9673f4 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:21.263649 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1073/2166] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:14:21 2022] PUT /identity/v3/projects/66610bd60abc459dae24d25231d10cfe/users/bfe8a5d8eb3f486f8a40fe1940c8b8aa/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:14:21.268910 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92de2e8-e9fa-49e4-90f9-37b16da94d0a None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:21.269212 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92de2e8-e9fa-49e4-90f9-37b16da94d0a None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:21.269494 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92de2e8-e9fa-49e4-90f9-37b16da94d0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:21.317115 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-a92de2e8-e9fa-49e4-90f9-37b16da94d0a None None] MFA Rules not processed for user `c0da36d3851649bca0425150125c946d`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:14:21.317749 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-a92de2e8-e9fa-49e4-90f9-37b16da94d0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:21.396340 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bb2a09-1f14-4025-82fc-1764bf9673f4 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:21.448186 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1074/2167] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:14:21 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:14:21.451625 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f00711-9017-40c7-b6a2-16c48eb7c891 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:21.451911 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f00711-9017-40c7-b6a2-16c48eb7c891 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:21.452182 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f00711-9017-40c7-b6a2-16c48eb7c891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:21.506552 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a88e66-2cac-4f43-9790-f6d854e11978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:21.507715 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a88e66-2cac-4f43-9790-f6d854e11978 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:21.507998 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a88e66-2cac-4f43-9790-f6d854e11978 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:21.508373 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a88e66-2cac-4f43-9790-f6d854e11978 admin admin] PATH_INFO: `/v3/projects/d3c17bd813264fb9891076799e33acca/users/39f1a14a59b7401d88f18ec35c91e30a/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:21.512884 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-32f00711-9017-40c7-b6a2-16c48eb7c891 None None] MFA Rules not processed for user `bfe8a5d8eb3f486f8a40fe1940c8b8aa`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:14:21.514595 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-32f00711-9017-40c7-b6a2-16c48eb7c891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:21.532797 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a88e66-2cac-4f43-9790-f6d854e11978 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3c17bd813264fb9891076799e33acca, user_id=39f1a14a59b7401d88f18ec35c91e30a, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:21.535655 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a88e66-2cac-4f43-9790-f6d854e11978 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:21.553163 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1094/2168] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:14:21 2022] PUT /identity/v3/projects/d3c17bd813264fb9891076799e33acca/users/39f1a14a59b7401d88f18ec35c91e30a/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:14:21.554852 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee74960b-66a2-426e-9629-75d49fc9d00b None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:21.555154 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee74960b-66a2-426e-9629-75d49fc9d00b None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:21.556003 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee74960b-66a2-426e-9629-75d49fc9d00b None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:21.558317 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1095/2169] 10.222.0.17 () {54 vars in 912 bytes} [Sat Jul 23 21:14:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:14:21.559074 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee74960b-66a2-426e-9629-75d49fc9d00b None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:21.626143 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1075/2170] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:14:21 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:14:21.627619 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c34367-e74b-4ca3-990d-d65c3f18651b None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:21.627908 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c34367-e74b-4ca3-990d-d65c3f18651b None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:21.628185 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c34367-e74b-4ca3-990d-d65c3f18651b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:21.649425 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-02c34367-e74b-4ca3-990d-d65c3f18651b None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:14:21.650860 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-02c34367-e74b-4ca3-990d-d65c3f18651b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:21.661600 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:21.679725 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee74960b-66a2-426e-9629-75d49fc9d00b None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:21.688468 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea71773e-8831-4016-8f0b-4cbb68ffb65c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:21.689430 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea71773e-8831-4016-8f0b-4cbb68ffb65c service nova] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:21.689856 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea71773e-8831-4016-8f0b-4cbb68ffb65c service nova] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:21.690279 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea71773e-8831-4016-8f0b-4cbb68ffb65c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:21.713357 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:21.740173 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1076/2171] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:14:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:14:21.740173 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c34367-e74b-4ca3-990d-d65c3f18651b None None] Authenticating service token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 23 21:14:21.740173 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-02c34367-e74b-4ca3-990d-d65c3f18651b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:21.765645 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c34367-e74b-4ca3-990d-d65c3f18651b None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:21.768002 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea71773e-8831-4016-8f0b-4cbb68ffb65c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:21.769655 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea71773e-8831-4016-8f0b-4cbb68ffb65c service nova] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:21.782815 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1096/2172] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:14:21 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:14:21.784326 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea71773e-8831-4016-8f0b-4cbb68ffb65c service nova] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:21.816670 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea71773e-8831-4016-8f0b-4cbb68ffb65c service nova] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:21.825169 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e69a56a-5d7d-4dbb-a386-4126cb449f4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:21.826002 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e69a56a-5d7d-4dbb-a386-4126cb449f4c admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:21.826490 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e69a56a-5d7d-4dbb-a386-4126cb449f4c admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:21.826919 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e69a56a-5d7d-4dbb-a386-4126cb449f4c admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:21.828609 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e69a56a-5d7d-4dbb-a386-4126cb449f4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:21.831568 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e69a56a-5d7d-4dbb-a386-4126cb449f4c admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:21.889180 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1097/2173] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:14:21 2022] POST /identity/v3/projects => generated 375 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:14:21.890900 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e69a56a-5d7d-4dbb-a386-4126cb449f4c admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:21.893053 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-8e69a56a-5d7d-4dbb-a386-4126cb449f4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:21.898744 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c34367-e74b-4ca3-990d-d65c3f18651b None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:22.005700 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e69a56a-5d7d-4dbb-a386-4126cb449f4c admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:22.016902 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d352423-2672-4feb-876a-e9166d1c046a tempest-FlavorsAccessTestJSON-898147174 tempest-FlavorsAccessTestJSON-898147174-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5312516da104aab913accf1cab84e13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a17bb53762284d0d940025faca3184b1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:22.017856 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d352423-2672-4feb-876a-e9166d1c046a tempest-FlavorsAccessTestJSON-898147174 tempest-FlavorsAccessTestJSON-898147174-project-admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:22.018219 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d352423-2672-4feb-876a-e9166d1c046a tempest-FlavorsAccessTestJSON-898147174 tempest-FlavorsAccessTestJSON-898147174-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:22.018436 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d352423-2672-4feb-876a-e9166d1c046a tempest-FlavorsAccessTestJSON-898147174 tempest-FlavorsAccessTestJSON-898147174-project-admin] PATH_INFO: `/v3/projects/9b6f57645a0e416cb21768225f71801e` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:22.021512 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d352423-2672-4feb-876a-e9166d1c046a tempest-FlavorsAccessTestJSON-898147174 tempest-FlavorsAccessTestJSON-898147174-project-admin] RBAC: Authorizing `identity:get_project(project_id=9b6f57645a0e416cb21768225f71801e)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:22.026787 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8db997f-ee44-4c5a-b9af-7b3f54f482fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:22.027899 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8db997f-ee44-4c5a-b9af-7b3f54f482fd service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:22.028647 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8db997f-ee44-4c5a-b9af-7b3f54f482fd service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:22.029208 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8db997f-ee44-4c5a-b9af-7b3f54f482fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:22.029907 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d352423-2672-4feb-876a-e9166d1c046a tempest-FlavorsAccessTestJSON-898147174 tempest-FlavorsAccessTestJSON-898147174-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:22.032390 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1077/2174] 10.222.0.17 () {58 vars in 1443 bytes} [Sat Jul 23 21:14:21 2022] GET /identity/v3/projects/9b6f57645a0e416cb21768225f71801e => generated 379 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:14:22.033258 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d352423-2672-4feb-876a-e9166d1c046a tempest-FlavorsAccessTestJSON-898147174 tempest-FlavorsAccessTestJSON-898147174-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:22.157012 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8db997f-ee44-4c5a-b9af-7b3f54f482fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:22.158682 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8db997f-ee44-4c5a-b9af-7b3f54f482fd service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:22.177360 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1098/2175] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:14:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:14:22.178577 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8db997f-ee44-4c5a-b9af-7b3f54f482fd service neutron] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:22.191801 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d352423-2672-4feb-876a-e9166d1c046a tempest-FlavorsAccessTestJSON-898147174 tempest-FlavorsAccessTestJSON-898147174-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:22.212478 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:22.221198 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965f80c6-c655-4c9c-87ff-9cbe7a1264f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:22.222096 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965f80c6-c655-4c9c-87ff-9cbe7a1264f6 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:22.222410 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965f80c6-c655-4c9c-87ff-9cbe7a1264f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:22.222725 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965f80c6-c655-4c9c-87ff-9cbe7a1264f6 admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:22.223392 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965f80c6-c655-4c9c-87ff-9cbe7a1264f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:22.225658 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965f80c6-c655-4c9c-87ff-9cbe7a1264f6 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:22.281695 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1078/2176] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:14:22 2022] POST /identity/v3/users => generated 294 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:14:22.283005 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965f80c6-c655-4c9c-87ff-9cbe7a1264f6 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:22.295368 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965f80c6-c655-4c9c-87ff-9cbe7a1264f6 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:22.299683 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8db997f-ee44-4c5a-b9af-7b3f54f482fd service neutron] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:22.301191 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1194fce5-cb04-4ddd-a244-189a035d3579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:22.302603 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1194fce5-cb04-4ddd-a244-189a035d3579 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:22.302603 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1194fce5-cb04-4ddd-a244-189a035d3579 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:22.303263 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1194fce5-cb04-4ddd-a244-189a035d3579 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:22.304573 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1194fce5-cb04-4ddd-a244-189a035d3579 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:22.306776 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1194fce5-cb04-4ddd-a244-189a035d3579 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:22.309389 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960c7055-b5c2-48a5-a1c6-b993f9c836bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:22.313046 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960c7055-b5c2-48a5-a1c6-b993f9c836bb service nova] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:22.313046 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960c7055-b5c2-48a5-a1c6-b993f9c836bb service nova] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:22.313046 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960c7055-b5c2-48a5-a1c6-b993f9c836bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:22.319866 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1079/2177] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:14:22 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:14:22.324491 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1194fce5-cb04-4ddd-a244-189a035d3579 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:22.336649 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1194fce5-cb04-4ddd-a244-189a035d3579 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:22.343395 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6acf6e-63e5-4795-ae05-f60d390e361f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:22.344639 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6acf6e-63e5-4795-ae05-f60d390e361f admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:22.345555 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6acf6e-63e5-4795-ae05-f60d390e361f admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:22.346171 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6acf6e-63e5-4795-ae05-f60d390e361f admin admin] PATH_INFO: `/v3/projects/d102bd5fa72d44b6aa7ae900d4e81afc/users/2081723f952440d88c54f2881db4b603/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:22.360623 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:22.370283 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6acf6e-63e5-4795-ae05-f60d390e361f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d102bd5fa72d44b6aa7ae900d4e81afc, user_id=2081723f952440d88c54f2881db4b603, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:22.374417 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6acf6e-63e5-4795-ae05-f60d390e361f admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:22.396101 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1080/2178] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:14:22 2022] PUT /identity/v3/projects/d102bd5fa72d44b6aa7ae900d4e81afc/users/2081723f952440d88c54f2881db4b603/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:14:22.400353 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6acf6e-63e5-4795-ae05-f60d390e361f admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:22.436243 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960c7055-b5c2-48a5-a1c6-b993f9c836bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:22.438610 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960c7055-b5c2-48a5-a1c6-b993f9c836bb service nova] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:22.472975 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1099/2179] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:14:22 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:14:22.509354 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960c7055-b5c2-48a5-a1c6-b993f9c836bb service nova] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:22.520582 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6acf6e-63e5-4795-ae05-f60d390e361f admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:22.527622 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960c7055-b5c2-48a5-a1c6-b993f9c836bb service nova] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:22.535628 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d6e6bb-03bc-4a5f-afd9-4e7b51fc76f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:22.536489 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d6e6bb-03bc-4a5f-afd9-4e7b51fc76f4 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:22.536775 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d6e6bb-03bc-4a5f-afd9-4e7b51fc76f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:22.537044 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d6e6bb-03bc-4a5f-afd9-4e7b51fc76f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:22.537799 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d6e6bb-03bc-4a5f-afd9-4e7b51fc76f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:22.539605 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d6e6bb-03bc-4a5f-afd9-4e7b51fc76f4 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:22.566967 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1081/2180] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:14:22 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 21:14:22.567916 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d6e6bb-03bc-4a5f-afd9-4e7b51fc76f4 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:22.589425 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d6e6bb-03bc-4a5f-afd9-4e7b51fc76f4 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:22.603322 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c82152-c668-43da-baa3-3af990df1629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:22.604270 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c82152-c668-43da-baa3-3af990df1629 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:22.604565 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c82152-c668-43da-baa3-3af990df1629 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:22.604845 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c82152-c668-43da-baa3-3af990df1629 admin admin] PATH_INFO: `/v3/projects/d102bd5fa72d44b6aa7ae900d4e81afc/users/2081723f952440d88c54f2881db4b603/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:22.610081 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c82152-c668-43da-baa3-3af990df1629 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d102bd5fa72d44b6aa7ae900d4e81afc, user_id=2081723f952440d88c54f2881db4b603, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:22.613311 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c82152-c668-43da-baa3-3af990df1629 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:22.650587 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1082/2181] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:14:22 2022] PUT /identity/v3/projects/d102bd5fa72d44b6aa7ae900d4e81afc/users/2081723f952440d88c54f2881db4b603/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:14:22.661606 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9038d9-550a-4c61-bd5a-ac2a998525dc None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:22.661606 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9038d9-550a-4c61-bd5a-ac2a998525dc None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:22.663424 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9038d9-550a-4c61-bd5a-ac2a998525dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:22.715584 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-ef9038d9-550a-4c61-bd5a-ac2a998525dc None None] MFA Rules not processed for user `2081723f952440d88c54f2881db4b603`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:14:22.716954 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-ef9038d9-550a-4c61-bd5a-ac2a998525dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:22.741966 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618908fe-c021-4645-b89a-c3106abe3754 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:22.742735 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618908fe-c021-4645-b89a-c3106abe3754 service nova] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:22.743075 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618908fe-c021-4645-b89a-c3106abe3754 service nova] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:22.743493 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618908fe-c021-4645-b89a-c3106abe3754 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:22.745972 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-618908fe-c021-4645-b89a-c3106abe3754 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:22.838642 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:22.845357 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618908fe-c021-4645-b89a-c3106abe3754 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:22.848384 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618908fe-c021-4645-b89a-c3106abe3754 service nova] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:22.881090 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1100/2182] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:14:22 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 23 21:14:22.889422 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1083/2183] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:14:22 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:14:22.898322 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618908fe-c021-4645-b89a-c3106abe3754 service nova] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:23.076651 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618908fe-c021-4645-b89a-c3106abe3754 service nova] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:23.098419 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b03e81-2101-4f3e-ba0d-b31b777a9724 tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081723f952440d88c54f2881db4b603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd102bd5fa72d44b6aa7ae900d4e81afc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:23.099209 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b03e81-2101-4f3e-ba0d-b31b777a9724 tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:23.099500 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b03e81-2101-4f3e-ba0d-b31b777a9724 tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:23.100425 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b03e81-2101-4f3e-ba0d-b31b777a9724 tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:23.113115 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b03e81-2101-4f3e-ba0d-b31b777a9724 tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:14:23.114513 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b03e81-2101-4f3e-ba0d-b31b777a9724 tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:23.118724 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b03e81-2101-4f3e-ba0d-b31b777a9724 tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:23.159452 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1101/2184] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:14:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:14:23.165226 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9038d9-550a-4c61-bd5a-ac2a998525dc None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:23.181574 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9038d9-550a-4c61-bd5a-ac2a998525dc None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:23.193983 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fa001a-9373-46ae-9f1d-5bdbf1d5994c tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081723f952440d88c54f2881db4b603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd102bd5fa72d44b6aa7ae900d4e81afc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:23.197946 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fa001a-9373-46ae-9f1d-5bdbf1d5994c tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:23.198258 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fa001a-9373-46ae-9f1d-5bdbf1d5994c tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:23.200851 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fa001a-9373-46ae-9f1d-5bdbf1d5994c tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:23.201624 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fa001a-9373-46ae-9f1d-5bdbf1d5994c tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:23.208611 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fa001a-9373-46ae-9f1d-5bdbf1d5994c tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:23.294804 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1084/2185] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:14:23 2022] POST /identity/v3/projects => generated 369 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:14:23.305220 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b03e81-2101-4f3e-ba0d-b31b777a9724 tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:23.313666 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8e970b-1d94-4a05-929e-3785bea14718 None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:23.314034 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8e970b-1d94-4a05-929e-3785bea14718 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:23.314314 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8e970b-1d94-4a05-929e-3785bea14718 None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:23.324386 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1085/2186] 10.222.0.17 () {54 vars in 912 bytes} [Sat Jul 23 21:14:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:14:23.330336 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b03e81-2101-4f3e-ba0d-b31b777a9724 tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:23.332624 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8e970b-1d94-4a05-929e-3785bea14718 None None] Authenticating service token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 23 21:14:23.400873 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:23.468474 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8e970b-1d94-4a05-929e-3785bea14718 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:23.488753 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934b6124-7005-4d28-bf2c-c9865e08889d tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081723f952440d88c54f2881db4b603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd102bd5fa72d44b6aa7ae900d4e81afc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:23.494879 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934b6124-7005-4d28-bf2c-c9865e08889d tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:23.495402 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934b6124-7005-4d28-bf2c-c9865e08889d tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:23.497448 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934b6124-7005-4d28-bf2c-c9865e08889d tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:23.498768 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934b6124-7005-4d28-bf2c-c9865e08889d tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:14:23.499288 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934b6124-7005-4d28-bf2c-c9865e08889d tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:23.504064 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934b6124-7005-4d28-bf2c-c9865e08889d tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:23.532910 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1102/2187] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:14:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:14:23.557161 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934b6124-7005-4d28-bf2c-c9865e08889d tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:23.574764 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934b6124-7005-4d28-bf2c-c9865e08889d tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:23.590378 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a17ea17-d370-4d88-a555-5664383f5fa2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:23.593119 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a17ea17-d370-4d88-a555-5664383f5fa2 service nova] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:23.594571 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a17ea17-d370-4d88-a555-5664383f5fa2 service nova] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:23.595192 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a17ea17-d370-4d88-a555-5664383f5fa2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:23.616179 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a17ea17-d370-4d88-a555-5664383f5fa2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:23.618798 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a17ea17-d370-4d88-a555-5664383f5fa2 service nova] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:23.628178 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8e970b-1d94-4a05-929e-3785bea14718 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:23.644938 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019c24ce-28fb-434f-bd71-40bc7746a9e4 tempest-FlavorsAccessTestJSON-898147174 tempest-FlavorsAccessTestJSON-898147174-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5312516da104aab913accf1cab84e13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a17bb53762284d0d940025faca3184b1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:23.645851 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019c24ce-28fb-434f-bd71-40bc7746a9e4 tempest-FlavorsAccessTestJSON-898147174 tempest-FlavorsAccessTestJSON-898147174-project-admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:23.646159 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019c24ce-28fb-434f-bd71-40bc7746a9e4 tempest-FlavorsAccessTestJSON-898147174 tempest-FlavorsAccessTestJSON-898147174-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:23.646272 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1103/2188] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:14:23 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 23 21:14:23.646428 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019c24ce-28fb-434f-bd71-40bc7746a9e4 tempest-FlavorsAccessTestJSON-898147174 tempest-FlavorsAccessTestJSON-898147174-project-admin] PATH_INFO: `/v3/projects/9b6f57645a0e416cb21768225f71801e` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:23.647393 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a17ea17-d370-4d88-a555-5664383f5fa2 service nova] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:23.648145 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019c24ce-28fb-434f-bd71-40bc7746a9e4 tempest-FlavorsAccessTestJSON-898147174 tempest-FlavorsAccessTestJSON-898147174-project-admin] RBAC: Authorizing `identity:get_project(project_id=9b6f57645a0e416cb21768225f71801e)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:23.650443 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019c24ce-28fb-434f-bd71-40bc7746a9e4 tempest-FlavorsAccessTestJSON-898147174 tempest-FlavorsAccessTestJSON-898147174-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:23.662114 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1086/2189] 10.222.0.17 () {58 vars in 1443 bytes} [Sat Jul 23 21:14:23 2022] GET /identity/v3/projects/9b6f57645a0e416cb21768225f71801e => generated 379 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 21:14:23.668199 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e1ecd8-1b53-4f8f-be0a-91443638e21e None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:23.668707 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e1ecd8-1b53-4f8f-be0a-91443638e21e None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:23.669292 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e1ecd8-1b53-4f8f-be0a-91443638e21e None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:23.678059 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1087/2190] 10.222.0.17 () {54 vars in 912 bytes} [Sat Jul 23 21:14:23 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:14:23.681231 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e1ecd8-1b53-4f8f-be0a-91443638e21e None None] Authenticating service token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 23 21:14:23.716004 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e1ecd8-1b53-4f8f-be0a-91443638e21e None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:23.736041 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e1ecd8-1b53-4f8f-be0a-91443638e21e None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:23.743217 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247d79b8-357b-47d0-a737-f4c202f6324d tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081723f952440d88c54f2881db4b603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd102bd5fa72d44b6aa7ae900d4e81afc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:23.744452 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247d79b8-357b-47d0-a737-f4c202f6324d tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:23.744984 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247d79b8-357b-47d0-a737-f4c202f6324d tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:23.745202 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247d79b8-357b-47d0-a737-f4c202f6324d tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] PATH_INFO: `/v3/projects/5c1062cf2e7d44a7b2ca6cd79cba041e` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:23.749286 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247d79b8-357b-47d0-a737-f4c202f6324d tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] RBAC: Authorizing `identity:get_project(project_id=5c1062cf2e7d44a7b2ca6cd79cba041e)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:23.753330 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247d79b8-357b-47d0-a737-f4c202f6324d tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:23.782300 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1088/2191] 10.222.0.17 () {58 vars in 1443 bytes} [Sat Jul 23 21:14:23 2022] GET /identity/v3/projects/5c1062cf2e7d44a7b2ca6cd79cba041e => generated 369 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 21:14:23.804919 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a17ea17-d370-4d88-a555-5664383f5fa2 service nova] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:23.819583 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fdf4bf-214c-4df7-a3e9-60186e03179a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:23.820836 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fdf4bf-214c-4df7-a3e9-60186e03179a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:23.821196 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fdf4bf-214c-4df7-a3e9-60186e03179a admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:23.821665 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fdf4bf-214c-4df7-a3e9-60186e03179a admin admin] PATH_INFO: `/v3/users/08deef2f7b1c4532970eb1ccac222ba9` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:23.823862 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fdf4bf-214c-4df7-a3e9-60186e03179a admin admin] RBAC: Authorizing `identity:delete_user(user_id=08deef2f7b1c4532970eb1ccac222ba9)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:23.830540 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fdf4bf-214c-4df7-a3e9-60186e03179a admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:23.857285 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e212d4-4709-4f14-b987-6937848e33be None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:23.857928 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e212d4-4709-4f14-b987-6937848e33be None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:23.858321 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e212d4-4709-4f14-b987-6937848e33be None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:23.861516 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1089/2192] 10.222.0.17 () {54 vars in 912 bytes} [Sat Jul 23 21:14:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 23 21:14:23.867261 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e212d4-4709-4f14-b987-6937848e33be None None] Authenticating service token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 23 21:14:23.893834 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:23.906832 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e212d4-4709-4f14-b987-6937848e33be None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:23.943744 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e212d4-4709-4f14-b987-6937848e33be None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:23.963713 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52be3bf-cc46-4aeb-af81-06f729b8c4f5 tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081723f952440d88c54f2881db4b603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd102bd5fa72d44b6aa7ae900d4e81afc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:23.965653 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52be3bf-cc46-4aeb-af81-06f729b8c4f5 tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:23.966169 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52be3bf-cc46-4aeb-af81-06f729b8c4f5 tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:23.967335 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52be3bf-cc46-4aeb-af81-06f729b8c4f5 tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] PATH_INFO: `/v3/projects/5c1062cf2e7d44a7b2ca6cd79cba041e` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:23.970467 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52be3bf-cc46-4aeb-af81-06f729b8c4f5 tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] RBAC: Authorizing `identity:get_project(project_id=5c1062cf2e7d44a7b2ca6cd79cba041e)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:23.980906 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52be3bf-cc46-4aeb-af81-06f729b8c4f5 tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:23.984229 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1090/2193] 10.222.0.17 () {58 vars in 1443 bytes} [Sat Jul 23 21:14:23 2022] GET /identity/v3/projects/5c1062cf2e7d44a7b2ca6cd79cba041e => generated 369 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 21:14:23.996282 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-b2fdf4bf-214c-4df7-a3e9-60186e03179a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08deef2f7b1c4532970eb1ccac222ba9'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:23.997194 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-b2fdf4bf-214c-4df7-a3e9-60186e03179a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08deef2f7b1c4532970eb1ccac222ba9'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:24.021675 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-b2fdf4bf-214c-4df7-a3e9-60186e03179a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08deef2f7b1c4532970eb1ccac222ba9'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:24.042018 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-b2fdf4bf-214c-4df7-a3e9-60186e03179a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08deef2f7b1c4532970eb1ccac222ba9'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:24.075193 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-b2fdf4bf-214c-4df7-a3e9-60186e03179a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08deef2f7b1c4532970eb1ccac222ba9'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:24.089471 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1104/2194] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:14:23 2022] DELETE /identity/v3/users/08deef2f7b1c4532970eb1ccac222ba9 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:14:24.094255 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792d36f5-a27a-4b68-8113-cb2e3767c614 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:24.095587 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792d36f5-a27a-4b68-8113-cb2e3767c614 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:24.096008 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792d36f5-a27a-4b68-8113-cb2e3767c614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:24.129002 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-792d36f5-a27a-4b68-8113-cb2e3767c614 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:14:24.130514 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-792d36f5-a27a-4b68-8113-cb2e3767c614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:24.274775 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1091/2195] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:14:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:14:24.284160 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fdf4bf-214c-4df7-a3e9-60186e03179a admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:24.285847 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-b2fdf4bf-214c-4df7-a3e9-60186e03179a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:24.335005 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9a77e1-9db1-42a0-9a4e-3fe8ff504e9e None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:24.335467 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9a77e1-9db1-42a0-9a4e-3fe8ff504e9e None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:24.335881 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9a77e1-9db1-42a0-9a4e-3fe8ff504e9e None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:24.337715 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1092/2196] 10.222.0.17 () {54 vars in 912 bytes} [Sat Jul 23 21:14:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 23 21:14:24.357909 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9a77e1-9db1-42a0-9a4e-3fe8ff504e9e None None] Authenticating service token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 23 21:14:24.360301 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-2b9a77e1-9db1-42a0-9a4e-3fe8ff504e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:24.462800 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fdf4bf-214c-4df7-a3e9-60186e03179a admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:24.475034 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c7b08e-ef02-4e9c-b0dd-057d77cf11ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:24.475456 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c7b08e-ef02-4e9c-b0dd-057d77cf11ff service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:24.475682 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c7b08e-ef02-4e9c-b0dd-057d77cf11ff service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:24.475996 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c7b08e-ef02-4e9c-b0dd-057d77cf11ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:24.481831 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:24.491005 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c7b08e-ef02-4e9c-b0dd-057d77cf11ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:24.493240 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c7b08e-ef02-4e9c-b0dd-057d77cf11ff service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:24.507663 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1105/2197] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:14:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:14:24.519778 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9a77e1-9db1-42a0-9a4e-3fe8ff504e9e None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:24.521164 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-2b9a77e1-9db1-42a0-9a4e-3fe8ff504e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:24.655451 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9a77e1-9db1-42a0-9a4e-3fe8ff504e9e None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:24.662510 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f640de-3f64-43fa-8e66-9b0d9152c11c tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081723f952440d88c54f2881db4b603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd102bd5fa72d44b6aa7ae900d4e81afc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:24.664281 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f640de-3f64-43fa-8e66-9b0d9152c11c tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:24.665066 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f640de-3f64-43fa-8e66-9b0d9152c11c tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:24.665960 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f640de-3f64-43fa-8e66-9b0d9152c11c tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] PATH_INFO: `/v3/projects/5c1062cf2e7d44a7b2ca6cd79cba041e` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:24.667883 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f640de-3f64-43fa-8e66-9b0d9152c11c tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] RBAC: Authorizing `identity:get_project(project_id=5c1062cf2e7d44a7b2ca6cd79cba041e)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:24.670044 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f640de-3f64-43fa-8e66-9b0d9152c11c tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:24.671834 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1093/2198] 10.222.0.17 () {58 vars in 1443 bytes} [Sat Jul 23 21:14:24 2022] GET /identity/v3/projects/5c1062cf2e7d44a7b2ca6cd79cba041e => generated 369 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 21:14:24.700512 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c7b08e-ef02-4e9c-b0dd-057d77cf11ff service neutron] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:24.724086 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c7b08e-ef02-4e9c-b0dd-057d77cf11ff service neutron] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:24.740820 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bfee40-b5a3-4507-8a05-80134a450a5a tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081723f952440d88c54f2881db4b603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd102bd5fa72d44b6aa7ae900d4e81afc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:24.742086 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bfee40-b5a3-4507-8a05-80134a450a5a tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:24.742428 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bfee40-b5a3-4507-8a05-80134a450a5a tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:24.742579 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bfee40-b5a3-4507-8a05-80134a450a5a tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] PATH_INFO: `/v3/projects/5c1062cf2e7d44a7b2ca6cd79cba041e` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:24.744368 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bfee40-b5a3-4507-8a05-80134a450a5a tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] RBAC: Authorizing `identity:delete_project(project_id=5c1062cf2e7d44a7b2ca6cd79cba041e)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:24.750061 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bfee40-b5a3-4507-8a05-80134a450a5a tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:24.895511 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c9bfee40-b5a3-4507-8a05-80134a450a5a tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c1062cf2e7d44a7b2ca6cd79cba041e', 'request_id': 'req-c9bfee40-b5a3-4507-8a05-80134a450a5a'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:24.914865 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c9bfee40-b5a3-4507-8a05-80134a450a5a tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c1062cf2e7d44a7b2ca6cd79cba041e', 'request_id': 'req-c9bfee40-b5a3-4507-8a05-80134a450a5a'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:24.922536 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c9bfee40-b5a3-4507-8a05-80134a450a5a tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c1062cf2e7d44a7b2ca6cd79cba041e', 'request_id': 'req-c9bfee40-b5a3-4507-8a05-80134a450a5a'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:24.955103 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f640de-3f64-43fa-8e66-9b0d9152c11c tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:24.957466 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-d4f640de-3f64-43fa-8e66-9b0d9152c11c tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:24.958621 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c9bfee40-b5a3-4507-8a05-80134a450a5a tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] The token cache is being invalidate because project 5c1062cf2e7d44a7b2ca6cd79cba041e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:14:24.958917 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c9bfee40-b5a3-4507-8a05-80134a450a5a tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:24.959698 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c9bfee40-b5a3-4507-8a05-80134a450a5a tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:24.966840 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1106/2199] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:14:24 2022] DELETE /identity/v3/projects/5c1062cf2e7d44a7b2ca6cd79cba041e => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:14:24.996450 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6031d316-dcf1-4a11-9626-6cb10e619995 None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:24.996824 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6031d316-dcf1-4a11-9626-6cb10e619995 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:24.997077 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6031d316-dcf1-4a11-9626-6cb10e619995 None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:24.998519 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1107/2200] 10.222.0.17 () {54 vars in 912 bytes} [Sat Jul 23 21:14:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 23 21:14:25.004321 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6031d316-dcf1-4a11-9626-6cb10e619995 None None] Authenticating service token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 23 21:14:25.006995 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-6031d316-dcf1-4a11-9626-6cb10e619995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:25.015864 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f640de-3f64-43fa-8e66-9b0d9152c11c tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:25.050100 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:25.176992 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f07623f-cc62-480e-8d5c-0eccbccf491c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:25.177933 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f07623f-cc62-480e-8d5c-0eccbccf491c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:25.178214 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f07623f-cc62-480e-8d5c-0eccbccf491c admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:25.178483 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f07623f-cc62-480e-8d5c-0eccbccf491c admin admin] PATH_INFO: `/v3/users/6a56ee63e15440859f681d1a0bc0ca0f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:25.181223 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f07623f-cc62-480e-8d5c-0eccbccf491c admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a56ee63e15440859f681d1a0bc0ca0f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:25.186963 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f07623f-cc62-480e-8d5c-0eccbccf491c admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:25.204316 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6031d316-dcf1-4a11-9626-6cb10e619995 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:25.212097 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-6031d316-dcf1-4a11-9626-6cb10e619995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:25.298873 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-8f07623f-cc62-480e-8d5c-0eccbccf491c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a56ee63e15440859f681d1a0bc0ca0f'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:25.310899 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-8f07623f-cc62-480e-8d5c-0eccbccf491c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a56ee63e15440859f681d1a0bc0ca0f'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:25.312532 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-8f07623f-cc62-480e-8d5c-0eccbccf491c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a56ee63e15440859f681d1a0bc0ca0f'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:25.328880 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-8f07623f-cc62-480e-8d5c-0eccbccf491c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a56ee63e15440859f681d1a0bc0ca0f'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:25.366472 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6031d316-dcf1-4a11-9626-6cb10e619995 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:25.367360 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-8f07623f-cc62-480e-8d5c-0eccbccf491c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a56ee63e15440859f681d1a0bc0ca0f'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:25.380738 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427e1697-5c48-434f-aadd-e7e8a3f0e27d tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081723f952440d88c54f2881db4b603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd102bd5fa72d44b6aa7ae900d4e81afc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:25.381930 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427e1697-5c48-434f-aadd-e7e8a3f0e27d tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:25.382329 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427e1697-5c48-434f-aadd-e7e8a3f0e27d tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:25.386548 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427e1697-5c48-434f-aadd-e7e8a3f0e27d tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] PATH_INFO: `/v3/projects/66610bd60abc459dae24d25231d10cfe` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:25.387448 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1094/2201] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:14:24 2022] DELETE /identity/v3/users/6a56ee63e15440859f681d1a0bc0ca0f => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:14:25.388619 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f07623f-cc62-480e-8d5c-0eccbccf491c admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:25.391302 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427e1697-5c48-434f-aadd-e7e8a3f0e27d tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] RBAC: Authorizing `identity:get_project(project_id=66610bd60abc459dae24d25231d10cfe)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:25.394160 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-8f07623f-cc62-480e-8d5c-0eccbccf491c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:25.398319 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427e1697-5c48-434f-aadd-e7e8a3f0e27d tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:25.402854 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1108/2202] 10.222.0.17 () {58 vars in 1443 bytes} [Sat Jul 23 21:14:25 2022] GET /identity/v3/projects/66610bd60abc459dae24d25231d10cfe => generated 375 bytes in 399 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 21:14:25.405032 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d27514f-bfb7-49bb-be20-c30ddfa4f376 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:25.405323 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d27514f-bfb7-49bb-be20-c30ddfa4f376 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:25.405595 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d27514f-bfb7-49bb-be20-c30ddfa4f376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:25.438520 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:25.443085 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-7d27514f-bfb7-49bb-be20-c30ddfa4f376 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:14:25.453888 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-7d27514f-bfb7-49bb-be20-c30ddfa4f376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:25.593314 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f07623f-cc62-480e-8d5c-0eccbccf491c admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:25.605502 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26190ce8-d899-40cc-a3bb-dfaa6938cd09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:25.606872 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26190ce8-d899-40cc-a3bb-dfaa6938cd09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:25.607299 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26190ce8-d899-40cc-a3bb-dfaa6938cd09 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:25.607657 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1109/2203] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:14:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:14:25.607914 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26190ce8-d899-40cc-a3bb-dfaa6938cd09 admin admin] PATH_INFO: `/v3/projects/dcf0875fb49640ebaa610b675e3b0e24` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:25.609092 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d27514f-bfb7-49bb-be20-c30ddfa4f376 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:25.611750 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-7d27514f-bfb7-49bb-be20-c30ddfa4f376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:25.613131 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26190ce8-d899-40cc-a3bb-dfaa6938cd09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dcf0875fb49640ebaa610b675e3b0e24)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:25.622839 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26190ce8-d899-40cc-a3bb-dfaa6938cd09 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:25.739249 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-26190ce8-d899-40cc-a3bb-dfaa6938cd09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dcf0875fb49640ebaa610b675e3b0e24', 'request_id': 'req-26190ce8-d899-40cc-a3bb-dfaa6938cd09'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:25.741750 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:25.752450 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-26190ce8-d899-40cc-a3bb-dfaa6938cd09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dcf0875fb49640ebaa610b675e3b0e24', 'request_id': 'req-26190ce8-d899-40cc-a3bb-dfaa6938cd09'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:25.759743 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-26190ce8-d899-40cc-a3bb-dfaa6938cd09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dcf0875fb49640ebaa610b675e3b0e24', 'request_id': 'req-26190ce8-d899-40cc-a3bb-dfaa6938cd09'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:25.778330 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d27514f-bfb7-49bb-be20-c30ddfa4f376 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:25.784665 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-26190ce8-d899-40cc-a3bb-dfaa6938cd09 admin admin] The token cache is being invalidate because project dcf0875fb49640ebaa610b675e3b0e24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:14:25.785029 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-26190ce8-d899-40cc-a3bb-dfaa6938cd09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:25.786699 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-26190ce8-d899-40cc-a3bb-dfaa6938cd09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:25.792444 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1095/2204] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:14:25 2022] DELETE /identity/v3/projects/dcf0875fb49640ebaa610b675e3b0e24 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:14:25.793376 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26190ce8-d899-40cc-a3bb-dfaa6938cd09 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:25.796864 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-26190ce8-d899-40cc-a3bb-dfaa6938cd09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:25.895690 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a4af31-8600-4c3e-81f9-de3b347abb2c tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081723f952440d88c54f2881db4b603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd102bd5fa72d44b6aa7ae900d4e81afc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:25.896551 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a4af31-8600-4c3e-81f9-de3b347abb2c tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:25.896976 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a4af31-8600-4c3e-81f9-de3b347abb2c tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:25.897494 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a4af31-8600-4c3e-81f9-de3b347abb2c tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:25.898431 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a4af31-8600-4c3e-81f9-de3b347abb2c tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:14:25.898839 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a4af31-8600-4c3e-81f9-de3b347abb2c tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:25.909647 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a4af31-8600-4c3e-81f9-de3b347abb2c tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:25.914871 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26190ce8-d899-40cc-a3bb-dfaa6938cd09 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:25.919670 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663b0149-c42e-48b3-bac3-687b5f1941e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:25.921539 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663b0149-c42e-48b3-bac3-687b5f1941e9 service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:25.921823 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663b0149-c42e-48b3-bac3-687b5f1941e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:25.922140 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663b0149-c42e-48b3-bac3-687b5f1941e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:25.925483 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-663b0149-c42e-48b3-bac3-687b5f1941e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:25.930400 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1110/2205] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:14:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:14:25.931501 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a4af31-8600-4c3e-81f9-de3b347abb2c tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:25.937788 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-69a4af31-8600-4c3e-81f9-de3b347abb2c tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:26.006656 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:26.039340 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a4af31-8600-4c3e-81f9-de3b347abb2c tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:26.040546 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663b0149-c42e-48b3-bac3-687b5f1941e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:26.042157 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663b0149-c42e-48b3-bac3-687b5f1941e9 service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:26.046412 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5065539-a6a4-4957-b70e-6c491d3e1ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:26.047494 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5065539-a6a4-4957-b70e-6c491d3e1ce6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:26.048022 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5065539-a6a4-4957-b70e-6c491d3e1ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:26.048502 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5065539-a6a4-4957-b70e-6c491d3e1ce6 admin admin] PATH_INFO: `/v3/users/c0da36d3851649bca0425150125c946d` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:26.050013 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5065539-a6a4-4957-b70e-6c491d3e1ce6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0da36d3851649bca0425150125c946d)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:26.052512 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5065539-a6a4-4957-b70e-6c491d3e1ce6 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:26.058486 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1096/2206] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:14:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:14:26.059358 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663b0149-c42e-48b3-bac3-687b5f1941e9 service neutron] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:26.060807 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-663b0149-c42e-48b3-bac3-687b5f1941e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:26.079457 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663b0149-c42e-48b3-bac3-687b5f1941e9 service neutron] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:26.087574 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf3dcf2-e6ee-4925-9133-0556b3d26def tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081723f952440d88c54f2881db4b603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd102bd5fa72d44b6aa7ae900d4e81afc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:26.088589 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf3dcf2-e6ee-4925-9133-0556b3d26def tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:26.088879 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf3dcf2-e6ee-4925-9133-0556b3d26def tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:26.089198 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf3dcf2-e6ee-4925-9133-0556b3d26def tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:26.090104 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf3dcf2-e6ee-4925-9133-0556b3d26def tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:26.095572 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf3dcf2-e6ee-4925-9133-0556b3d26def tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:26.171619 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1097/2207] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:14:26 2022] POST /identity/v3/projects => generated 371 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:14:26.172664 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf3dcf2-e6ee-4925-9133-0556b3d26def tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:26.218094 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-b5065539-a6a4-4957-b70e-6c491d3e1ce6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0da36d3851649bca0425150125c946d'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:26.220209 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-b5065539-a6a4-4957-b70e-6c491d3e1ce6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0da36d3851649bca0425150125c946d'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:26.244457 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-b5065539-a6a4-4957-b70e-6c491d3e1ce6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0da36d3851649bca0425150125c946d'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:26.267476 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-b5065539-a6a4-4957-b70e-6c491d3e1ce6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0da36d3851649bca0425150125c946d'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:26.285253 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf3dcf2-e6ee-4925-9133-0556b3d26def tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:26.291223 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-b5065539-a6a4-4957-b70e-6c491d3e1ce6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0da36d3851649bca0425150125c946d'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:26.291762 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1441da-28e5-46f9-86e1-a6dfef197f5f tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081723f952440d88c54f2881db4b603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd102bd5fa72d44b6aa7ae900d4e81afc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:26.292573 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1441da-28e5-46f9-86e1-a6dfef197f5f tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:26.292954 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1441da-28e5-46f9-86e1-a6dfef197f5f tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:26.293266 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1441da-28e5-46f9-86e1-a6dfef197f5f tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:26.294422 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1441da-28e5-46f9-86e1-a6dfef197f5f tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:14:26.295075 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1441da-28e5-46f9-86e1-a6dfef197f5f tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:26.296854 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1441da-28e5-46f9-86e1-a6dfef197f5f tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:26.314847 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1098/2208] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:14:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:14:26.322023 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1111/2209] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:14:25 2022] DELETE /identity/v3/users/c0da36d3851649bca0425150125c946d => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:14:26.473904 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b4dc9d-7c6b-4e41-9964-5cf0869bc024 None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:26.473904 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b4dc9d-7c6b-4e41-9964-5cf0869bc024 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:26.473904 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b4dc9d-7c6b-4e41-9964-5cf0869bc024 None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:26.474524 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1099/2210] 10.222.0.17 () {54 vars in 912 bytes} [Sat Jul 23 21:14:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:14:26.484124 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5065539-a6a4-4957-b70e-6c491d3e1ce6 admin admin] Authenticating service token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 23 21:14:26.485157 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-b5065539-a6a4-4957-b70e-6c491d3e1ce6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:26.512096 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:26.702775 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5065539-a6a4-4957-b70e-6c491d3e1ce6 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:26.703846 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-b5065539-a6a4-4957-b70e-6c491d3e1ce6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:26.839105 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5065539-a6a4-4957-b70e-6c491d3e1ce6 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:26.845969 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c3ca2c-1c5a-4b86-8b6e-c6d82309b2aa tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081723f952440d88c54f2881db4b603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd102bd5fa72d44b6aa7ae900d4e81afc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:26.847225 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c3ca2c-1c5a-4b86-8b6e-c6d82309b2aa tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:26.847902 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c3ca2c-1c5a-4b86-8b6e-c6d82309b2aa tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:26.848907 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c3ca2c-1c5a-4b86-8b6e-c6d82309b2aa tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] PATH_INFO: `/v3/projects/3ad0d4062a894b9aab861106cff69b34` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:26.850552 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c3ca2c-1c5a-4b86-8b6e-c6d82309b2aa tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] RBAC: Authorizing `identity:get_project(project_id=3ad0d4062a894b9aab861106cff69b34)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:26.853755 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c3ca2c-1c5a-4b86-8b6e-c6d82309b2aa tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:26.856221 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1112/2211] 10.222.0.17 () {58 vars in 1443 bytes} [Sat Jul 23 21:14:26 2022] GET /identity/v3/projects/3ad0d4062a894b9aab861106cff69b34 => generated 371 bytes in 374 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:14:26.983399 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd49335a-e1f1-4c3c-9a06-b725bbb8aa6f None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:26.983935 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd49335a-e1f1-4c3c-9a06-b725bbb8aa6f None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:26.984049 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd49335a-e1f1-4c3c-9a06-b725bbb8aa6f None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:26.985692 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1100/2212] 10.222.0.17 () {54 vars in 912 bytes} [Sat Jul 23 21:14:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:14:26.993700 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c3ca2c-1c5a-4b86-8b6e-c6d82309b2aa tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] Authenticating service token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 23 21:14:27.013916 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c3ca2c-1c5a-4b86-8b6e-c6d82309b2aa tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:27.027472 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c3ca2c-1c5a-4b86-8b6e-c6d82309b2aa tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:27.033595 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798e49f6-45cf-422e-bb29-57eed85f6367 tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081723f952440d88c54f2881db4b603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd102bd5fa72d44b6aa7ae900d4e81afc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:27.034333 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798e49f6-45cf-422e-bb29-57eed85f6367 tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:27.034680 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798e49f6-45cf-422e-bb29-57eed85f6367 tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:27.035199 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798e49f6-45cf-422e-bb29-57eed85f6367 tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] PATH_INFO: `/v3/projects/3ad0d4062a894b9aab861106cff69b34` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:27.036753 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798e49f6-45cf-422e-bb29-57eed85f6367 tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] RBAC: Authorizing `identity:get_project(project_id=3ad0d4062a894b9aab861106cff69b34)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:27.039092 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798e49f6-45cf-422e-bb29-57eed85f6367 tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:27.041153 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1113/2213] 10.222.0.17 () {58 vars in 1443 bytes} [Sat Jul 23 21:14:26 2022] GET /identity/v3/projects/3ad0d4062a894b9aab861106cff69b34 => generated 371 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:14:27.089787 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd49335a-e1f1-4c3c-9a06-b725bbb8aa6f None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:27.102855 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd49335a-e1f1-4c3c-9a06-b725bbb8aa6f None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:27.107938 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6bcacb-9e34-45cb-9584-1bf9912c6efd tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081723f952440d88c54f2881db4b603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd102bd5fa72d44b6aa7ae900d4e81afc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:27.108647 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6bcacb-9e34-45cb-9584-1bf9912c6efd tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:27.108930 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6bcacb-9e34-45cb-9584-1bf9912c6efd tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:27.109205 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6bcacb-9e34-45cb-9584-1bf9912c6efd tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:27.110082 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6bcacb-9e34-45cb-9584-1bf9912c6efd tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:14:27.110397 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6bcacb-9e34-45cb-9584-1bf9912c6efd tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:27.112154 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6bcacb-9e34-45cb-9584-1bf9912c6efd tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:27.126619 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1101/2214] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:14:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:14:27.130830 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798e49f6-45cf-422e-bb29-57eed85f6367 tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:27.142961 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798e49f6-45cf-422e-bb29-57eed85f6367 tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:27.147750 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa0ec21-a950-4669-a18a-430885e8de9e tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081723f952440d88c54f2881db4b603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd102bd5fa72d44b6aa7ae900d4e81afc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:27.148505 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa0ec21-a950-4669-a18a-430885e8de9e tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:27.148898 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa0ec21-a950-4669-a18a-430885e8de9e tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:27.149242 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa0ec21-a950-4669-a18a-430885e8de9e tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:27.150063 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa0ec21-a950-4669-a18a-430885e8de9e tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:27.152085 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa0ec21-a950-4669-a18a-430885e8de9e tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:27.177185 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1114/2215] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:14:27 2022] POST /identity/v3/users => generated 381 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:14:27.182781 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6bcacb-9e34-45cb-9584-1bf9912c6efd tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:27.195646 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6bcacb-9e34-45cb-9584-1bf9912c6efd tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:27.200626 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d812d0-6862-46a5-861c-d221adbe19c5 tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081723f952440d88c54f2881db4b603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd102bd5fa72d44b6aa7ae900d4e81afc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:27.202035 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d812d0-6862-46a5-861c-d221adbe19c5 tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:27.202385 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d812d0-6862-46a5-861c-d221adbe19c5 tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:27.202821 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d812d0-6862-46a5-861c-d221adbe19c5 tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:27.203578 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d812d0-6862-46a5-861c-d221adbe19c5 tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:14:27.203887 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d812d0-6862-46a5-861c-d221adbe19c5 tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:27.205775 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d812d0-6862-46a5-861c-d221adbe19c5 tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:27.217536 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa0ec21-a950-4669-a18a-430885e8de9e tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:27.219531 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-7aa0ec21-a950-4669-a18a-430885e8de9e tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:27.226039 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1102/2216] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:14:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:14:27.246744 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e92523d-4354-471c-b3f9-942e8cc22c16 None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:27.247141 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e92523d-4354-471c-b3f9-942e8cc22c16 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:27.247405 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e92523d-4354-471c-b3f9-942e8cc22c16 None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:27.249027 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1103/2217] 10.222.0.17 () {54 vars in 912 bytes} [Sat Jul 23 21:14:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 23 21:14:27.256138 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e92523d-4354-471c-b3f9-942e8cc22c16 None None] Authenticating service token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 23 21:14:27.272579 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e92523d-4354-471c-b3f9-942e8cc22c16 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:27.288669 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e92523d-4354-471c-b3f9-942e8cc22c16 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:27.295184 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede17f3f-676a-4a32-9be7-9acec64343a8 tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081723f952440d88c54f2881db4b603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd102bd5fa72d44b6aa7ae900d4e81afc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:27.296457 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede17f3f-676a-4a32-9be7-9acec64343a8 tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:27.296865 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede17f3f-676a-4a32-9be7-9acec64343a8 tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:27.297254 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede17f3f-676a-4a32-9be7-9acec64343a8 tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] PATH_INFO: `/v3/projects/3ad0d4062a894b9aab861106cff69b34` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:27.298856 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede17f3f-676a-4a32-9be7-9acec64343a8 tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] RBAC: Authorizing `identity:get_project(project_id=3ad0d4062a894b9aab861106cff69b34)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:27.301658 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede17f3f-676a-4a32-9be7-9acec64343a8 tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:27.304247 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1104/2218] 10.222.0.17 () {58 vars in 1443 bytes} [Sat Jul 23 21:14:27 2022] GET /identity/v3/projects/3ad0d4062a894b9aab861106cff69b34 => generated 371 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 21:14:27.316889 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa0ec21-a950-4669-a18a-430885e8de9e tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:27.323086 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a30783-aa98-4449-b979-a114f8540439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:27.324358 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a30783-aa98-4449-b979-a114f8540439 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:27.324711 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a30783-aa98-4449-b979-a114f8540439 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:27.325057 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a30783-aa98-4449-b979-a114f8540439 admin admin] PATH_INFO: `/v3/projects/9b6f57645a0e416cb21768225f71801e` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:27.326650 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a30783-aa98-4449-b979-a114f8540439 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b6f57645a0e416cb21768225f71801e)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:27.328638 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a30783-aa98-4449-b979-a114f8540439 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:27.385078 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:27.419971 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-52a30783-aa98-4449-b979-a114f8540439 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b6f57645a0e416cb21768225f71801e', 'request_id': 'req-52a30783-aa98-4449-b979-a114f8540439'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:27.435554 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-52a30783-aa98-4449-b979-a114f8540439 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b6f57645a0e416cb21768225f71801e', 'request_id': 'req-52a30783-aa98-4449-b979-a114f8540439'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:27.455793 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-52a30783-aa98-4449-b979-a114f8540439 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b6f57645a0e416cb21768225f71801e', 'request_id': 'req-52a30783-aa98-4449-b979-a114f8540439'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:27.471081 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-52a30783-aa98-4449-b979-a114f8540439 admin admin] The token cache is being invalidate because project 9b6f57645a0e416cb21768225f71801e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:14:27.471441 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-52a30783-aa98-4449-b979-a114f8540439 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:27.472185 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-52a30783-aa98-4449-b979-a114f8540439 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:27.474215 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1115/2219] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:14:27 2022] DELETE /identity/v3/projects/9b6f57645a0e416cb21768225f71801e => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:14:27.479476 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede17f3f-676a-4a32-9be7-9acec64343a8 tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:27.481210 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-ede17f3f-676a-4a32-9be7-9acec64343a8 tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:27.503665 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede17f3f-676a-4a32-9be7-9acec64343a8 tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:27.568917 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae5d758-4785-4176-8eb5-6b5b02e71f5d None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:27.569370 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae5d758-4785-4176-8eb5-6b5b02e71f5d None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:27.569643 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae5d758-4785-4176-8eb5-6b5b02e71f5d None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:27.571337 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1116/2220] 10.222.0.17 () {54 vars in 912 bytes} [Sat Jul 23 21:14:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:14:27.578994 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae5d758-4785-4176-8eb5-6b5b02e71f5d None None] Authenticating service token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 23 21:14:27.581637 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-fae5d758-4785-4176-8eb5-6b5b02e71f5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:27.637551 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d2abe1-0dbe-4d84-9b3b-8966ff65f4db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:27.638833 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d2abe1-0dbe-4d84-9b3b-8966ff65f4db admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:27.639296 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d2abe1-0dbe-4d84-9b3b-8966ff65f4db admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:27.643513 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d2abe1-0dbe-4d84-9b3b-8966ff65f4db admin admin] PATH_INFO: `/v3/users/e5312516da104aab913accf1cab84e13` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:27.648496 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d2abe1-0dbe-4d84-9b3b-8966ff65f4db admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5312516da104aab913accf1cab84e13)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:27.650383 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d2abe1-0dbe-4d84-9b3b-8966ff65f4db admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:27.694017 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae5d758-4785-4176-8eb5-6b5b02e71f5d None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:27.695632 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-fae5d758-4785-4176-8eb5-6b5b02e71f5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:27.716952 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:27.750114 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-b7d2abe1-0dbe-4d84-9b3b-8966ff65f4db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5312516da104aab913accf1cab84e13'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:27.768539 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-b7d2abe1-0dbe-4d84-9b3b-8966ff65f4db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5312516da104aab913accf1cab84e13'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:27.772116 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-b7d2abe1-0dbe-4d84-9b3b-8966ff65f4db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5312516da104aab913accf1cab84e13'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:27.786149 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-b7d2abe1-0dbe-4d84-9b3b-8966ff65f4db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5312516da104aab913accf1cab84e13'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:27.810729 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae5d758-4785-4176-8eb5-6b5b02e71f5d None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:27.816801 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48709c20-83dc-4001-a045-31ac3d8f07cf tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081723f952440d88c54f2881db4b603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd102bd5fa72d44b6aa7ae900d4e81afc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:27.817879 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48709c20-83dc-4001-a045-31ac3d8f07cf tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:27.818413 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48709c20-83dc-4001-a045-31ac3d8f07cf tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:27.818756 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48709c20-83dc-4001-a045-31ac3d8f07cf tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] PATH_INFO: `/v3/projects/3ad0d4062a894b9aab861106cff69b34` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:27.820147 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48709c20-83dc-4001-a045-31ac3d8f07cf tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] RBAC: Authorizing `identity:get_project(project_id=3ad0d4062a894b9aab861106cff69b34)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:27.822443 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48709c20-83dc-4001-a045-31ac3d8f07cf tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:27.830109 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1117/2221] 10.222.0.17 () {58 vars in 1443 bytes} [Sat Jul 23 21:14:27 2022] GET /identity/v3/projects/3ad0d4062a894b9aab861106cff69b34 => generated 371 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:14:27.831424 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-b7d2abe1-0dbe-4d84-9b3b-8966ff65f4db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5312516da104aab913accf1cab84e13'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:27.841830 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1105/2222] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:14:27 2022] DELETE /identity/v3/users/e5312516da104aab913accf1cab84e13 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:14:27.865392 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d2abe1-0dbe-4d84-9b3b-8966ff65f4db admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:27.866860 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48709c20-83dc-4001-a045-31ac3d8f07cf tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:27.869477 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-b7d2abe1-0dbe-4d84-9b3b-8966ff65f4db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:27.872878 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-48709c20-83dc-4001-a045-31ac3d8f07cf tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:27.934938 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48709c20-83dc-4001-a045-31ac3d8f07cf tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:28.035397 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:28.055351 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8007214-f46b-490a-a3ae-a05732a2da65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:28.056567 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8007214-f46b-490a-a3ae-a05732a2da65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:28.057180 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8007214-f46b-490a-a3ae-a05732a2da65 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:28.057700 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8007214-f46b-490a-a3ae-a05732a2da65 admin admin] PATH_INFO: `/v3/projects/809fa86aaf464746af85d31cd14a7f3b` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:28.060971 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8007214-f46b-490a-a3ae-a05732a2da65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=809fa86aaf464746af85d31cd14a7f3b)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:28.066970 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8007214-f46b-490a-a3ae-a05732a2da65 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:28.087544 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d2abe1-0dbe-4d84-9b3b-8966ff65f4db admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:28.101559 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29f3bce-b6a3-465e-9b6f-80c60482869d tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081723f952440d88c54f2881db4b603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd102bd5fa72d44b6aa7ae900d4e81afc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:28.102635 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29f3bce-b6a3-465e-9b6f-80c60482869d tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:28.102877 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29f3bce-b6a3-465e-9b6f-80c60482869d tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:28.103146 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29f3bce-b6a3-465e-9b6f-80c60482869d tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] PATH_INFO: `/v3/users/a0d6c632326e4ca08bab885ed7ec0e78` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:28.137719 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29f3bce-b6a3-465e-9b6f-80c60482869d tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] RBAC: Authorizing `identity:delete_user(user_id=a0d6c632326e4ca08bab885ed7ec0e78)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:28.143410 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29f3bce-b6a3-465e-9b6f-80c60482869d tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:28.188065 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-a8007214-f46b-490a-a3ae-a05732a2da65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '809fa86aaf464746af85d31cd14a7f3b', 'request_id': 'req-a8007214-f46b-490a-a3ae-a05732a2da65'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:28.212472 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-a8007214-f46b-490a-a3ae-a05732a2da65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '809fa86aaf464746af85d31cd14a7f3b', 'request_id': 'req-a8007214-f46b-490a-a3ae-a05732a2da65'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:28.246731 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-a8007214-f46b-490a-a3ae-a05732a2da65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '809fa86aaf464746af85d31cd14a7f3b', 'request_id': 'req-a8007214-f46b-490a-a3ae-a05732a2da65'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:28.272017 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-a29f3bce-b6a3-465e-9b6f-80c60482869d tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0d6c632326e4ca08bab885ed7ec0e78'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:28.285072 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-a29f3bce-b6a3-465e-9b6f-80c60482869d tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0d6c632326e4ca08bab885ed7ec0e78'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:28.287448 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-a8007214-f46b-490a-a3ae-a05732a2da65 admin admin] The token cache is being invalidate because project 809fa86aaf464746af85d31cd14a7f3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:14:28.287904 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-a8007214-f46b-490a-a3ae-a05732a2da65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:28.288037 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-a29f3bce-b6a3-465e-9b6f-80c60482869d tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0d6c632326e4ca08bab885ed7ec0e78'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:28.289431 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-a8007214-f46b-490a-a3ae-a05732a2da65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:28.291991 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1118/2223] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:14:27 2022] DELETE /identity/v3/projects/809fa86aaf464746af85d31cd14a7f3b => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:14:28.293065 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8007214-f46b-490a-a3ae-a05732a2da65 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:28.297560 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-a8007214-f46b-490a-a3ae-a05732a2da65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:28.312611 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-a29f3bce-b6a3-465e-9b6f-80c60482869d tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0d6c632326e4ca08bab885ed7ec0e78'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:28.355222 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-a29f3bce-b6a3-465e-9b6f-80c60482869d tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0d6c632326e4ca08bab885ed7ec0e78'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:28.410004 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1106/2224] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:14:27 2022] DELETE /identity/v3/users/a0d6c632326e4ca08bab885ed7ec0e78 => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:14:28.414918 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5183e88f-7a53-4d87-b800-03e6ffc5589e None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:28.415216 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5183e88f-7a53-4d87-b800-03e6ffc5589e None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:28.415499 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5183e88f-7a53-4d87-b800-03e6ffc5589e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:28.454881 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-5183e88f-7a53-4d87-b800-03e6ffc5589e None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:14:28.457342 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-5183e88f-7a53-4d87-b800-03e6ffc5589e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:28.493726 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:28.586205 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8007214-f46b-490a-a3ae-a05732a2da65 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:28.626099 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1107/2225] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:14:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:14:28.626099 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5183e88f-7a53-4d87-b800-03e6ffc5589e None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:28.632386 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-5183e88f-7a53-4d87-b800-03e6ffc5589e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:28.786240 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efc0ef9-e42f-41b7-9418-ba3e9d7e5a2a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:28.786919 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efc0ef9-e42f-41b7-9418-ba3e9d7e5a2a service nova] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:28.787220 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efc0ef9-e42f-41b7-9418-ba3e9d7e5a2a service nova] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:28.787514 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efc0ef9-e42f-41b7-9418-ba3e9d7e5a2a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:28.789403 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-9efc0ef9-e42f-41b7-9418-ba3e9d7e5a2a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:28.791615 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5183e88f-7a53-4d87-b800-03e6ffc5589e None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:28.802391 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb97b7e4-4ad5-4b8c-957d-c91f5e9216bb tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081723f952440d88c54f2881db4b603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd102bd5fa72d44b6aa7ae900d4e81afc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:28.805288 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:28.805571 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb97b7e4-4ad5-4b8c-957d-c91f5e9216bb tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:28.806082 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb97b7e4-4ad5-4b8c-957d-c91f5e9216bb tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:28.806915 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb97b7e4-4ad5-4b8c-957d-c91f5e9216bb tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] PATH_INFO: `/v3/projects/3ad0d4062a894b9aab861106cff69b34` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:28.808430 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb97b7e4-4ad5-4b8c-957d-c91f5e9216bb tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] RBAC: Authorizing `identity:delete_project(project_id=3ad0d4062a894b9aab861106cff69b34)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:28.813712 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb97b7e4-4ad5-4b8c-957d-c91f5e9216bb tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:28.942686 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-bb97b7e4-4ad5-4b8c-957d-c91f5e9216bb tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ad0d4062a894b9aab861106cff69b34', 'request_id': 'req-bb97b7e4-4ad5-4b8c-957d-c91f5e9216bb'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:28.959652 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-bb97b7e4-4ad5-4b8c-957d-c91f5e9216bb tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ad0d4062a894b9aab861106cff69b34', 'request_id': 'req-bb97b7e4-4ad5-4b8c-957d-c91f5e9216bb'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:28.985836 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-bb97b7e4-4ad5-4b8c-957d-c91f5e9216bb tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ad0d4062a894b9aab861106cff69b34', 'request_id': 'req-bb97b7e4-4ad5-4b8c-957d-c91f5e9216bb'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:29.003315 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efc0ef9-e42f-41b7-9418-ba3e9d7e5a2a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:29.007020 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efc0ef9-e42f-41b7-9418-ba3e9d7e5a2a service nova] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:29.010654 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-bb97b7e4-4ad5-4b8c-957d-c91f5e9216bb tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] The token cache is being invalidate because project 3ad0d4062a894b9aab861106cff69b34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:14:29.010957 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-bb97b7e4-4ad5-4b8c-957d-c91f5e9216bb tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:29.014372 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-bb97b7e4-4ad5-4b8c-957d-c91f5e9216bb tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:29.017181 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1108/2226] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:14:28 2022] DELETE /identity/v3/projects/3ad0d4062a894b9aab861106cff69b34 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:14:29.018365 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb97b7e4-4ad5-4b8c-957d-c91f5e9216bb tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:29.024460 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-bb97b7e4-4ad5-4b8c-957d-c91f5e9216bb tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:29.040388 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1119/2227] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:14:28 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 747 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:14:29.042177 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e0450e-6b20-4868-9220-5b0e3204e38b None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:29.042560 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e0450e-6b20-4868-9220-5b0e3204e38b None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:29.043010 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e0450e-6b20-4868-9220-5b0e3204e38b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:29.071104 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-66e0450e-6b20-4868-9220-5b0e3204e38b None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:14:29.072449 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-66e0450e-6b20-4868-9220-5b0e3204e38b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:29.109771 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:29.148050 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb97b7e4-4ad5-4b8c-957d-c91f5e9216bb tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:29.154093 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449898ec-2bd7-4950-8b9b-f40fafe25d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:29.155759 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449898ec-2bd7-4950-8b9b-f40fafe25d41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:29.156030 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449898ec-2bd7-4950-8b9b-f40fafe25d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:29.156299 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449898ec-2bd7-4950-8b9b-f40fafe25d41 admin admin] PATH_INFO: `/v3/projects/a17bb53762284d0d940025faca3184b1` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:29.157843 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449898ec-2bd7-4950-8b9b-f40fafe25d41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a17bb53762284d0d940025faca3184b1)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:29.160888 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449898ec-2bd7-4950-8b9b-f40fafe25d41 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:29.191846 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1120/2228] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:14:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:14:29.192853 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e0450e-6b20-4868-9220-5b0e3204e38b None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:29.198546 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-66e0450e-6b20-4868-9220-5b0e3204e38b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:29.222342 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e0450e-6b20-4868-9220-5b0e3204e38b None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:29.252981 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d654106-36a3-4031-a02c-adcb80b55198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:29.254449 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d654106-36a3-4031-a02c-adcb80b55198 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:29.255836 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d654106-36a3-4031-a02c-adcb80b55198 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:29.256119 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d654106-36a3-4031-a02c-adcb80b55198 admin admin] PATH_INFO: `/v3/users/199522d29cb746379cb6f75d4b108cb9` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:29.260343 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d654106-36a3-4031-a02c-adcb80b55198 admin admin] RBAC: Authorizing `identity:delete_user(user_id=199522d29cb746379cb6f75d4b108cb9)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:29.263276 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-449898ec-2bd7-4950-8b9b-f40fafe25d41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a17bb53762284d0d940025faca3184b1', 'request_id': 'req-449898ec-2bd7-4950-8b9b-f40fafe25d41'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:29.265290 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d654106-36a3-4031-a02c-adcb80b55198 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:29.289809 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-449898ec-2bd7-4950-8b9b-f40fafe25d41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a17bb53762284d0d940025faca3184b1', 'request_id': 'req-449898ec-2bd7-4950-8b9b-f40fafe25d41'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:29.303183 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-449898ec-2bd7-4950-8b9b-f40fafe25d41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a17bb53762284d0d940025faca3184b1', 'request_id': 'req-449898ec-2bd7-4950-8b9b-f40fafe25d41'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:29.328702 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-449898ec-2bd7-4950-8b9b-f40fafe25d41 admin admin] The token cache is being invalidate because project a17bb53762284d0d940025faca3184b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:14:29.329038 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-449898ec-2bd7-4950-8b9b-f40fafe25d41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:29.331312 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-449898ec-2bd7-4950-8b9b-f40fafe25d41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:29.334043 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1109/2229] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:14:29 2022] DELETE /identity/v3/projects/a17bb53762284d0d940025faca3184b1 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:14:29.342535 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c114dcb-6ec8-4095-ba03-f553e6f0ed00 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:29.344110 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c114dcb-6ec8-4095-ba03-f553e6f0ed00 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:29.344675 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c114dcb-6ec8-4095-ba03-f553e6f0ed00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:29.374350 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-2d654106-36a3-4031-a02c-adcb80b55198 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '199522d29cb746379cb6f75d4b108cb9'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:29.374995 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-2d654106-36a3-4031-a02c-adcb80b55198 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '199522d29cb746379cb6f75d4b108cb9'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:29.385332 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-2d654106-36a3-4031-a02c-adcb80b55198 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '199522d29cb746379cb6f75d4b108cb9'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:29.405232 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-2d654106-36a3-4031-a02c-adcb80b55198 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '199522d29cb746379cb6f75d4b108cb9'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:29.413530 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-9c114dcb-6ec8-4095-ba03-f553e6f0ed00 None None] MFA Rules not processed for user `3a56b82cf3954f279dd21e17a42462b3`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:14:29.415231 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-9c114dcb-6ec8-4095-ba03-f553e6f0ed00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:29.428095 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-2d654106-36a3-4031-a02c-adcb80b55198 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '199522d29cb746379cb6f75d4b108cb9'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:29.439851 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1121/2230] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:14:29 2022] DELETE /identity/v3/users/199522d29cb746379cb6f75d4b108cb9 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:14:29.441406 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fa7dc7-05f7-4b33-9d7e-5d3b88f96a14 None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:29.441789 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fa7dc7-05f7-4b33-9d7e-5d3b88f96a14 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:29.442083 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fa7dc7-05f7-4b33-9d7e-5d3b88f96a14 None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:29.444477 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1122/2231] 10.222.0.17 () {54 vars in 912 bytes} [Sat Jul 23 21:14:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:14:29.448596 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fa7dc7-05f7-4b33-9d7e-5d3b88f96a14 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:29.450567 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-29fa7dc7-05f7-4b33-9d7e-5d3b88f96a14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:29.536210 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:29.592362 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1110/2232] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:14:29 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:14:29.593903 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1c2d85-41e1-44f0-b7b0-0324127faeb3 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:29.594199 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1c2d85-41e1-44f0-b7b0-0324127faeb3 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:29.594595 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1c2d85-41e1-44f0-b7b0-0324127faeb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:29.645559 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-bb1c2d85-41e1-44f0-b7b0-0324127faeb3 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:14:29.646895 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-bb1c2d85-41e1-44f0-b7b0-0324127faeb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:29.656415 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fa7dc7-05f7-4b33-9d7e-5d3b88f96a14 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:29.665745 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1111/2233] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:14:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:14:29.671975 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291aa643-afb5-4556-a3ec-8b8c78db49a9 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:29.672400 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291aa643-afb5-4556-a3ec-8b8c78db49a9 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:29.673753 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291aa643-afb5-4556-a3ec-8b8c78db49a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:29.676729 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d76c3b-69e7-42a9-b266-98ae1e782b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:29.677432 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d76c3b-69e7-42a9-b266-98ae1e782b04 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:29.678104 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d76c3b-69e7-42a9-b266-98ae1e782b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:29.678104 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d76c3b-69e7-42a9-b266-98ae1e782b04 admin admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:29.678749 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d76c3b-69e7-42a9-b266-98ae1e782b04 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:14:29.679050 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d76c3b-69e7-42a9-b266-98ae1e782b04 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:29.680669 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d76c3b-69e7-42a9-b266-98ae1e782b04 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:29.707448 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1123/2234] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:14:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:14:29.708774 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d76c3b-69e7-42a9-b266-98ae1e782b04 admin admin] Authenticating service token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 23 21:14:29.715013 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-291aa643-afb5-4556-a3ec-8b8c78db49a9 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:14:29.716104 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-291aa643-afb5-4556-a3ec-8b8c78db49a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:29.720160 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-54d76c3b-69e7-42a9-b266-98ae1e782b04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:29.730445 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1112/2235] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:14:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:14:29.731535 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291aa643-afb5-4556-a3ec-8b8c78db49a9 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:29.733562 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-291aa643-afb5-4556-a3ec-8b8c78db49a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:29.756402 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291aa643-afb5-4556-a3ec-8b8c78db49a9 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:29.768532 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eea26f8-f249-44a4-9665-d249c4edc64a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:29.769222 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eea26f8-f249-44a4-9665-d249c4edc64a admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:29.770886 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eea26f8-f249-44a4-9665-d249c4edc64a admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:29.771170 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eea26f8-f249-44a4-9665-d249c4edc64a admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:29.772895 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eea26f8-f249-44a4-9665-d249c4edc64a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:29.776477 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eea26f8-f249-44a4-9665-d249c4edc64a admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:29.851422 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1113/2236] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:14:29 2022] POST /identity/v3/projects => generated 395 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:14:29.851422 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7e648e-6bfe-46f1-81ff-5027795b3652 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:29.851689 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7e648e-6bfe-46f1-81ff-5027795b3652 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:29.851762 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7e648e-6bfe-46f1-81ff-5027795b3652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:29.874959 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-6b7e648e-6bfe-46f1-81ff-5027795b3652 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:14:29.878553 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-6b7e648e-6bfe-46f1-81ff-5027795b3652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:29.904481 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d76c3b-69e7-42a9-b266-98ae1e782b04 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:29.907527 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-54d76c3b-69e7-42a9-b266-98ae1e782b04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:29.914140 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:29.966722 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1114/2237] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:14:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:14:29.968212 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7e648e-6bfe-46f1-81ff-5027795b3652 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:29.982984 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7e648e-6bfe-46f1-81ff-5027795b3652 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:29.987796 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d76c3b-69e7-42a9-b266-98ae1e782b04 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:29.999969 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc3756c-f167-4091-8fc1-ef28cee70b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:30.002160 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc3756c-f167-4091-8fc1-ef28cee70b76 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:30.002709 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc3756c-f167-4091-8fc1-ef28cee70b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:30.003175 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc3756c-f167-4091-8fc1-ef28cee70b76 admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:30.004072 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc3756c-f167-4091-8fc1-ef28cee70b76 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:30.007257 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc3756c-f167-4091-8fc1-ef28cee70b76 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:30.043919 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1115/2238] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:14:29 2022] POST /identity/v3/projects => generated 391 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:14:30.045631 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc3756c-f167-4091-8fc1-ef28cee70b76 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:30.053323 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-8dc3756c-f167-4091-8fc1-ef28cee70b76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:30.067517 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9306c891-c807-4bfe-a0db-7bb785c0d4be tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081723f952440d88c54f2881db4b603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd102bd5fa72d44b6aa7ae900d4e81afc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:30.069052 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9306c891-c807-4bfe-a0db-7bb785c0d4be tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:30.069052 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9306c891-c807-4bfe-a0db-7bb785c0d4be tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:30.069052 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9306c891-c807-4bfe-a0db-7bb785c0d4be tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] PATH_INFO: `/v3/projects/66610bd60abc459dae24d25231d10cfe` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:30.071319 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9306c891-c807-4bfe-a0db-7bb785c0d4be tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] RBAC: Authorizing `identity:get_project(project_id=66610bd60abc459dae24d25231d10cfe)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:30.074857 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9306c891-c807-4bfe-a0db-7bb785c0d4be tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:30.077074 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1124/2239] 10.222.0.17 () {58 vars in 1443 bytes} [Sat Jul 23 21:14:29 2022] GET /identity/v3/projects/66610bd60abc459dae24d25231d10cfe => generated 375 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:14:30.078556 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9306c891-c807-4bfe-a0db-7bb785c0d4be tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:30.085675 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:30.094140 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9306c891-c807-4bfe-a0db-7bb785c0d4be tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:30.140972 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc3756c-f167-4091-8fc1-ef28cee70b76 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:30.145450 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd26c65-de48-4d77-97fd-afda2cc7d60e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:30.146115 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd26c65-de48-4d77-97fd-afda2cc7d60e service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:30.146391 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd26c65-de48-4d77-97fd-afda2cc7d60e service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:30.146656 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd26c65-de48-4d77-97fd-afda2cc7d60e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:30.199098 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6dc8f1-9e2a-4e47-8b61-5710e6508f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:30.200175 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6dc8f1-9e2a-4e47-8b61-5710e6508f76 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:30.200459 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6dc8f1-9e2a-4e47-8b61-5710e6508f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:30.200729 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6dc8f1-9e2a-4e47-8b61-5710e6508f76 admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:30.201425 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6dc8f1-9e2a-4e47-8b61-5710e6508f76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:30.203583 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6dc8f1-9e2a-4e47-8b61-5710e6508f76 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:30.254072 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1125/2240] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:14:30 2022] POST /identity/v3/users => generated 304 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:14:30.259249 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd3f061-7c98-4a9e-ad12-7425de6cc26a None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:30.259519 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd3f061-7c98-4a9e-ad12-7425de6cc26a None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:30.259796 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd3f061-7c98-4a9e-ad12-7425de6cc26a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:30.278686 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd26c65-de48-4d77-97fd-afda2cc7d60e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:30.280322 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd26c65-de48-4d77-97fd-afda2cc7d60e service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:30.307613 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-0fd3f061-7c98-4a9e-ad12-7425de6cc26a None None] MFA Rules not processed for user `c497326ee890462e8f48b4a56f81990c`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:14:30.309009 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-0fd3f061-7c98-4a9e-ad12-7425de6cc26a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:30.314210 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1116/2241] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:14:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:14:30.315134 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd26c65-de48-4d77-97fd-afda2cc7d60e service neutron] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:30.326014 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1126/2242] 10.222.0.17 () {58 vars in 1009 bytes} [Sat Jul 23 21:14:30 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:14:30.326786 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd3f061-7c98-4a9e-ad12-7425de6cc26a None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:30.343055 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd26c65-de48-4d77-97fd-afda2cc7d60e service neutron] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:30.353841 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd3f061-7c98-4a9e-ad12-7425de6cc26a None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:30.365163 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcce701-32c6-4e67-b835-7f0d51bd51fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:30.366806 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcce701-32c6-4e67-b835-7f0d51bd51fb admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:30.367429 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcce701-32c6-4e67-b835-7f0d51bd51fb admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:30.368265 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcce701-32c6-4e67-b835-7f0d51bd51fb admin admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:30.370700 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcce701-32c6-4e67-b835-7f0d51bd51fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:14:30.370972 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99df42db-f8d2-45e7-856e-91f9ebe01f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:30.371640 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcce701-32c6-4e67-b835-7f0d51bd51fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:30.371755 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99df42db-f8d2-45e7-856e-91f9ebe01f65 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:30.371935 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99df42db-f8d2-45e7-856e-91f9ebe01f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:30.372201 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99df42db-f8d2-45e7-856e-91f9ebe01f65 admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:30.372896 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99df42db-f8d2-45e7-856e-91f9ebe01f65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:30.374481 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcce701-32c6-4e67-b835-7f0d51bd51fb admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:30.374926 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99df42db-f8d2-45e7-856e-91f9ebe01f65 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:30.397543 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1117/2243] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:14:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:14:30.399482 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcce701-32c6-4e67-b835-7f0d51bd51fb admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:30.424727 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1127/2244] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:14:30 2022] POST /identity/v3/users => generated 296 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:14:30.425741 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99df42db-f8d2-45e7-856e-91f9ebe01f65 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:30.452641 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99df42db-f8d2-45e7-856e-91f9ebe01f65 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:30.466744 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b933eeb-9c07-4311-a84e-e10dc0f238d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:30.467448 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b933eeb-9c07-4311-a84e-e10dc0f238d2 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:30.467728 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b933eeb-9c07-4311-a84e-e10dc0f238d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:30.468000 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b933eeb-9c07-4311-a84e-e10dc0f238d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:30.471361 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b933eeb-9c07-4311-a84e-e10dc0f238d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:30.476601 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b933eeb-9c07-4311-a84e-e10dc0f238d2 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:30.480587 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:30.509588 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1128/2245] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:14:30 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:14:30.512656 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b933eeb-9c07-4311-a84e-e10dc0f238d2 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:30.522340 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcce701-32c6-4e67-b835-7f0d51bd51fb admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:30.530813 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3195397a-e28b-43c8-bcce-e8afad351096 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:30.531670 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3195397a-e28b-43c8-bcce-e8afad351096 service nova] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:30.532821 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3195397a-e28b-43c8-bcce-e8afad351096 service nova] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:30.532821 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3195397a-e28b-43c8-bcce-e8afad351096 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:30.535639 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-3195397a-e28b-43c8-bcce-e8afad351096 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:30.536512 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b933eeb-9c07-4311-a84e-e10dc0f238d2 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:30.552493 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5bbc62-6216-46fd-984f-76ac97bbc3c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:30.552493 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5bbc62-6216-46fd-984f-76ac97bbc3c1 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:30.552493 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5bbc62-6216-46fd-984f-76ac97bbc3c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:30.553054 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5bbc62-6216-46fd-984f-76ac97bbc3c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:30.553797 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5bbc62-6216-46fd-984f-76ac97bbc3c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:30.555907 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5bbc62-6216-46fd-984f-76ac97bbc3c1 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:30.623450 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3195397a-e28b-43c8-bcce-e8afad351096 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:30.626182 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3195397a-e28b-43c8-bcce-e8afad351096 service nova] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:30.630583 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1129/2246] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:14:30 2022] POST /identity/v3/projects => generated 387 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:14:30.631041 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5bbc62-6216-46fd-984f-76ac97bbc3c1 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:30.638375 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1118/2247] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:14:30 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:14:30.639554 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3195397a-e28b-43c8-bcce-e8afad351096 service nova] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:30.652207 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3195397a-e28b-43c8-bcce-e8afad351096 service nova] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:30.787237 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5bbc62-6216-46fd-984f-76ac97bbc3c1 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:30.794687 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab7b029-2e5f-4f34-bf3c-156996555c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:30.796849 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab7b029-2e5f-4f34-bf3c-156996555c57 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:30.797142 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab7b029-2e5f-4f34-bf3c-156996555c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:30.797411 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab7b029-2e5f-4f34-bf3c-156996555c57 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:30.798745 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3785989f-0cae-4905-a9d9-a0c3965030f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:30.799662 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3785989f-0cae-4905-a9d9-a0c3965030f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:30.799926 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3785989f-0cae-4905-a9d9-a0c3965030f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:30.800192 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3785989f-0cae-4905-a9d9-a0c3965030f6 admin admin] PATH_INFO: `/v3/projects/286a1457f4d14672a7edec877b939620/users/7efc45807d654f008f6dce01fd5f808d/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:30.801531 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab7b029-2e5f-4f34-bf3c-156996555c57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:30.805576 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab7b029-2e5f-4f34-bf3c-156996555c57 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:30.847343 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1130/2248] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:14:30 2022] GET /identity/v3/roles => generated 1420 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:14:30.847343 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab7b029-2e5f-4f34-bf3c-156996555c57 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:30.849810 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3785989f-0cae-4905-a9d9-a0c3965030f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=286a1457f4d14672a7edec877b939620, user_id=7efc45807d654f008f6dce01fd5f808d, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:30.856240 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3785989f-0cae-4905-a9d9-a0c3965030f6 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:30.873436 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab7b029-2e5f-4f34-bf3c-156996555c57 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:30.877147 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1119/2249] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:14:30 2022] PUT /identity/v3/projects/286a1457f4d14672a7edec877b939620/users/7efc45807d654f008f6dce01fd5f808d/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:14:30.878975 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3785989f-0cae-4905-a9d9-a0c3965030f6 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:30.947890 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3785989f-0cae-4905-a9d9-a0c3965030f6 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:30.953808 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49028f14-a9d4-45e8-bf0d-92ec5bd9eb94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:30.954005 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:30.955489 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49028f14-a9d4-45e8-bf0d-92ec5bd9eb94 service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:30.955919 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49028f14-a9d4-45e8-bf0d-92ec5bd9eb94 service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:30.956311 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49028f14-a9d4-45e8-bf0d-92ec5bd9eb94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:30.968162 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49028f14-a9d4-45e8-bf0d-92ec5bd9eb94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:30.969727 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49028f14-a9d4-45e8-bf0d-92ec5bd9eb94 service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:30.991841 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1120/2250] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:14:30 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:14:30.992727 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49028f14-a9d4-45e8-bf0d-92ec5bd9eb94 service neutron] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:31.001405 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:31.017378 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9321e50e-1aac-4906-974a-60ee0dc583ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:31.017536 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9321e50e-1aac-4906-974a-60ee0dc583ee admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:31.017846 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9321e50e-1aac-4906-974a-60ee0dc583ee admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:31.018045 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9321e50e-1aac-4906-974a-60ee0dc583ee admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:31.018754 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9321e50e-1aac-4906-974a-60ee0dc583ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:31.027173 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9321e50e-1aac-4906-974a-60ee0dc583ee admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:31.087105 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1131/2251] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:14:30 2022] POST /identity/v3/users => generated 294 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:14:31.087919 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9321e50e-1aac-4906-974a-60ee0dc583ee admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:31.112507 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9321e50e-1aac-4906-974a-60ee0dc583ee admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:31.129996 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49804816-55a3-4c2e-bddd-4760b1ce17d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:31.130713 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49804816-55a3-4c2e-bddd-4760b1ce17d6 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:31.131025 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49804816-55a3-4c2e-bddd-4760b1ce17d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:31.131298 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49804816-55a3-4c2e-bddd-4760b1ce17d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:31.132039 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49804816-55a3-4c2e-bddd-4760b1ce17d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:31.133797 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49804816-55a3-4c2e-bddd-4760b1ce17d6 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:31.173067 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49028f14-a9d4-45e8-bf0d-92ec5bd9eb94 service neutron] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:31.177318 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1132/2252] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:14:31 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:14:31.178831 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1ab2ae-8301-4936-b897-63844bafe1b0 None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:31.179121 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1ab2ae-8301-4936-b897-63844bafe1b0 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:31.179397 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1ab2ae-8301-4936-b897-63844bafe1b0 None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:31.180702 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1133/2253] 10.222.0.17 () {54 vars in 912 bytes} [Sat Jul 23 21:14:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:14:31.181466 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1ab2ae-8301-4936-b897-63844bafe1b0 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:31.194228 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3698b0-07d0-4002-b526-9bc1a29f7ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:31.195076 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3698b0-07d0-4002-b526-9bc1a29f7ff0 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:31.195541 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3698b0-07d0-4002-b526-9bc1a29f7ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:31.195696 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3698b0-07d0-4002-b526-9bc1a29f7ff0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:31.196502 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3698b0-07d0-4002-b526-9bc1a29f7ff0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:31.198210 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3698b0-07d0-4002-b526-9bc1a29f7ff0 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:31.213993 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1ab2ae-8301-4936-b897-63844bafe1b0 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:31.219034 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1121/2254] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:14:30 2022] GET /identity/v3/roles => generated 1420 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:14:31.222051 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a5dfb5-83f8-461d-873b-13a33f6260de None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:31.222348 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a5dfb5-83f8-461d-873b-13a33f6260de None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:31.222630 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a5dfb5-83f8-461d-873b-13a33f6260de None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:31.228068 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1122/2255] 10.222.0.17 () {54 vars in 912 bytes} [Sat Jul 23 21:14:31 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:14:31.228941 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a5dfb5-83f8-461d-873b-13a33f6260de None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:31.232400 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f4b4c2-a1be-453e-9817-e21bafb60734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:31.233111 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f4b4c2-a1be-453e-9817-e21bafb60734 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:31.234043 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f4b4c2-a1be-453e-9817-e21bafb60734 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:31.234326 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f4b4c2-a1be-453e-9817-e21bafb60734 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:31.235075 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f4b4c2-a1be-453e-9817-e21bafb60734 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:31.236754 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f4b4c2-a1be-453e-9817-e21bafb60734 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:31.269081 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1134/2256] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:14:31 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:14:31.271722 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a5dfb5-83f8-461d-873b-13a33f6260de None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:31.275850 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f4b4c2-a1be-453e-9817-e21bafb60734 admin admin] Authenticating service token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 23 21:14:31.280763 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c5eb72-bb9c-42fe-9f93-0e77d6cb8f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:31.285093 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c5eb72-bb9c-42fe-9f93-0e77d6cb8f9e admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:31.287325 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c5eb72-bb9c-42fe-9f93-0e77d6cb8f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:31.287801 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c5eb72-bb9c-42fe-9f93-0e77d6cb8f9e admin admin] PATH_INFO: `/v3/projects/286a1457f4d14672a7edec877b939620/users/7efc45807d654f008f6dce01fd5f808d/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:31.293424 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c5eb72-bb9c-42fe-9f93-0e77d6cb8f9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=286a1457f4d14672a7edec877b939620, user_id=7efc45807d654f008f6dce01fd5f808d, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:31.298565 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c5eb72-bb9c-42fe-9f93-0e77d6cb8f9e admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:31.341905 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1123/2257] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:14:31 2022] PUT /identity/v3/projects/286a1457f4d14672a7edec877b939620/users/7efc45807d654f008f6dce01fd5f808d/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:14:31.344071 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c5eb72-bb9c-42fe-9f93-0e77d6cb8f9e admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:31.443903 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f4b4c2-a1be-453e-9817-e21bafb60734 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:31.514114 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c5eb72-bb9c-42fe-9f93-0e77d6cb8f9e admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:31.527448 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc2346c-a2e6-4a8f-b241-989c7b87712d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:31.528859 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc2346c-a2e6-4a8f-b241-989c7b87712d admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:31.529140 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc2346c-a2e6-4a8f-b241-989c7b87712d admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:31.529433 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc2346c-a2e6-4a8f-b241-989c7b87712d admin admin] PATH_INFO: `/v3/projects/b6a338068a454a54950f91de657e4055/users/da5808807f604f758c74ef13693487fe/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:31.529983 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f4b4c2-a1be-453e-9817-e21bafb60734 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:31.569501 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc2346c-a2e6-4a8f-b241-989c7b87712d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6a338068a454a54950f91de657e4055, user_id=da5808807f604f758c74ef13693487fe, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:31.576976 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc2346c-a2e6-4a8f-b241-989c7b87712d admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:31.595951 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:31.611725 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1124/2258] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:14:31 2022] PUT /identity/v3/projects/b6a338068a454a54950f91de657e4055/users/da5808807f604f758c74ef13693487fe/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:14:31.624507 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbfb7e7-cfa9-47bd-b720-da62e07d8e4e None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:31.625033 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbfb7e7-cfa9-47bd-b720-da62e07d8e4e None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:31.625189 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbfb7e7-cfa9-47bd-b720-da62e07d8e4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:31.636582 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f70e9d9-a089-4c4e-b9c5-5fb786c8df9d tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081723f952440d88c54f2881db4b603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd102bd5fa72d44b6aa7ae900d4e81afc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:31.638119 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f70e9d9-a089-4c4e-b9c5-5fb786c8df9d tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:31.638119 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f70e9d9-a089-4c4e-b9c5-5fb786c8df9d tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:31.638376 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f70e9d9-a089-4c4e-b9c5-5fb786c8df9d tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] PATH_INFO: `/v3/projects/66610bd60abc459dae24d25231d10cfe` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:31.640377 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f70e9d9-a089-4c4e-b9c5-5fb786c8df9d tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] RBAC: Authorizing `identity:get_project(project_id=66610bd60abc459dae24d25231d10cfe)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:31.645591 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f70e9d9-a089-4c4e-b9c5-5fb786c8df9d tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:31.647948 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-3bbfb7e7-cfa9-47bd-b720-da62e07d8e4e None None] MFA Rules not processed for user `abc719a3b3ac4461b82ca04ab6451d81`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:14:31.649227 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-3bbfb7e7-cfa9-47bd-b720-da62e07d8e4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:31.652787 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1135/2259] 10.222.0.17 () {58 vars in 1443 bytes} [Sat Jul 23 21:14:31 2022] GET /identity/v3/projects/66610bd60abc459dae24d25231d10cfe => generated 375 bytes in 383 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:14:31.653833 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f70e9d9-a089-4c4e-b9c5-5fb786c8df9d tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:31.679468 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f70e9d9-a089-4c4e-b9c5-5fb786c8df9d tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:31.745415 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1125/2260] 10.222.0.17 () {58 vars in 1009 bytes} [Sat Jul 23 21:14:31 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:14:31.762110 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbfb7e7-cfa9-47bd-b720-da62e07d8e4e None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:31.767266 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-3bbfb7e7-cfa9-47bd-b720-da62e07d8e4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:31.784335 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:31.841133 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2337bd96-4f45-472e-824f-bece96fd52d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:31.841980 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2337bd96-4f45-472e-824f-bece96fd52d4 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:31.842278 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2337bd96-4f45-472e-824f-bece96fd52d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:31.842551 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2337bd96-4f45-472e-824f-bece96fd52d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:31.843414 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2337bd96-4f45-472e-824f-bece96fd52d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:31.845258 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2337bd96-4f45-472e-824f-bece96fd52d4 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:31.882146 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1136/2261] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:14:31 2022] GET /identity/v3/roles => generated 1420 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:14:31.884260 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b8a365-312b-4bee-a334-d2c1e7c8b96e None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:31.884611 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b8a365-312b-4bee-a334-d2c1e7c8b96e None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:31.884903 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b8a365-312b-4bee-a334-d2c1e7c8b96e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:31.935012 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbfb7e7-cfa9-47bd-b720-da62e07d8e4e None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:31.943191 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-60b8a365-312b-4bee-a334-d2c1e7c8b96e None None] MFA Rules not processed for user `da5808807f604f758c74ef13693487fe`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:14:31.944022 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87916db7-ceb4-4c2a-b746-26da852e77a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:31.944558 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-60b8a365-312b-4bee-a334-d2c1e7c8b96e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:31.945213 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87916db7-ceb4-4c2a-b746-26da852e77a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:31.945495 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87916db7-ceb4-4c2a-b746-26da852e77a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:31.945766 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87916db7-ceb4-4c2a-b746-26da852e77a7 admin admin] PATH_INFO: `/v3/projects/07101aee06ca4bb6885f87cfec3257db` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:31.950795 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87916db7-ceb4-4c2a-b746-26da852e77a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07101aee06ca4bb6885f87cfec3257db)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:31.956486 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87916db7-ceb4-4c2a-b746-26da852e77a7 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:32.047191 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1137/2262] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:14:31 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:14:32.048950 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b8a365-312b-4bee-a334-d2c1e7c8b96e None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:32.052762 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-60b8a365-312b-4bee-a334-d2c1e7c8b96e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:32.104772 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b8a365-312b-4bee-a334-d2c1e7c8b96e None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:32.118818 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-87916db7-ceb4-4c2a-b746-26da852e77a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07101aee06ca4bb6885f87cfec3257db', 'request_id': 'req-87916db7-ceb4-4c2a-b746-26da852e77a7'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:32.137584 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-87916db7-ceb4-4c2a-b746-26da852e77a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07101aee06ca4bb6885f87cfec3257db', 'request_id': 'req-87916db7-ceb4-4c2a-b746-26da852e77a7'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:32.151361 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-87916db7-ceb4-4c2a-b746-26da852e77a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07101aee06ca4bb6885f87cfec3257db', 'request_id': 'req-87916db7-ceb4-4c2a-b746-26da852e77a7'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:32.178164 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-87916db7-ceb4-4c2a-b746-26da852e77a7 admin admin] The token cache is being invalidate because project 07101aee06ca4bb6885f87cfec3257db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:14:32.179596 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-87916db7-ceb4-4c2a-b746-26da852e77a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:32.181961 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-87916db7-ceb4-4c2a-b746-26da852e77a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:32.189602 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1126/2263] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:14:31 2022] DELETE /identity/v3/projects/07101aee06ca4bb6885f87cfec3257db => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:14:32.190742 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87916db7-ceb4-4c2a-b746-26da852e77a7 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:32.193761 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-87916db7-ceb4-4c2a-b746-26da852e77a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:32.271714 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c2c3c1-6c14-4876-b9a8-47f943427576 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc719a3b3ac4461b82ca04ab6451d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:32.272660 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c2c3c1-6c14-4876-b9a8-47f943427576 service placement] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:32.273266 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c2c3c1-6c14-4876-b9a8-47f943427576 service placement] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:32.273601 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c2c3c1-6c14-4876-b9a8-47f943427576 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:32.277611 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-33c2c3c1-6c14-4876-b9a8-47f943427576 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:32.306017 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c2c3c1-6c14-4876-b9a8-47f943427576 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:32.308504 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c2c3c1-6c14-4876-b9a8-47f943427576 service placement] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:32.325390 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:32.342285 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1138/2264] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:14:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:14:32.342285 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c2c3c1-6c14-4876-b9a8-47f943427576 service placement] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:32.345838 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-33c2c3c1-6c14-4876-b9a8-47f943427576 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:32.368802 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87916db7-ceb4-4c2a-b746-26da852e77a7 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:32.374185 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c2c3c1-6c14-4876-b9a8-47f943427576 service placement] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:32.380214 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2523f8ea-8fc7-423d-80a4-44c45d63d101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:32.380974 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2523f8ea-8fc7-423d-80a4-44c45d63d101 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:32.381323 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2523f8ea-8fc7-423d-80a4-44c45d63d101 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:32.382360 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2523f8ea-8fc7-423d-80a4-44c45d63d101 admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:32.383668 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba679d4b-e166-47a6-bb84-324bb91e6ef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:32.384457 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2523f8ea-8fc7-423d-80a4-44c45d63d101 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:32.384636 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba679d4b-e166-47a6-bb84-324bb91e6ef4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:32.384919 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba679d4b-e166-47a6-bb84-324bb91e6ef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:32.385400 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba679d4b-e166-47a6-bb84-324bb91e6ef4 admin admin] PATH_INFO: `/v3/projects/fa284ec485b94303a8c7e3387e31dc63/users/925c3413d59f4b0bbb329317ea1f8a65/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:32.388255 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2523f8ea-8fc7-423d-80a4-44c45d63d101 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:32.408240 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba679d4b-e166-47a6-bb84-324bb91e6ef4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa284ec485b94303a8c7e3387e31dc63, user_id=925c3413d59f4b0bbb329317ea1f8a65, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:32.411963 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba679d4b-e166-47a6-bb84-324bb91e6ef4 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:32.427605 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1139/2265] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:14:32 2022] POST /identity/v3/projects => generated 391 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:14:32.428886 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2523f8ea-8fc7-423d-80a4-44c45d63d101 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:32.431490 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-2523f8ea-8fc7-423d-80a4-44c45d63d101 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:32.460597 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1127/2266] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:14:32 2022] PUT /identity/v3/projects/fa284ec485b94303a8c7e3387e31dc63/users/925c3413d59f4b0bbb329317ea1f8a65/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:14:32.461932 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba679d4b-e166-47a6-bb84-324bb91e6ef4 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:32.517735 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:32.563640 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2523f8ea-8fc7-423d-80a4-44c45d63d101 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:32.572438 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b48e1c-727e-42ac-a267-4eb16095deef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:32.573925 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b48e1c-727e-42ac-a267-4eb16095deef admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:32.574496 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b48e1c-727e-42ac-a267-4eb16095deef admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:32.575196 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b48e1c-727e-42ac-a267-4eb16095deef admin admin] PATH_INFO: `/v3/users/3959c498fb4f4454a42b7e6a7a7afb60` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:32.577004 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b48e1c-727e-42ac-a267-4eb16095deef admin admin] RBAC: Authorizing `identity:delete_user(user_id=3959c498fb4f4454a42b7e6a7a7afb60)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:32.580195 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b48e1c-727e-42ac-a267-4eb16095deef admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:32.603786 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba679d4b-e166-47a6-bb84-324bb91e6ef4 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:32.610328 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6676792c-c40b-4473-ae65-312d4d24a61d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:32.611315 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6676792c-c40b-4473-ae65-312d4d24a61d admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:32.611908 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6676792c-c40b-4473-ae65-312d4d24a61d admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:32.612302 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6676792c-c40b-4473-ae65-312d4d24a61d admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:32.613179 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6676792c-c40b-4473-ae65-312d4d24a61d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:32.616588 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6676792c-c40b-4473-ae65-312d4d24a61d admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:32.667479 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1128/2267] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:14:32 2022] POST /identity/v3/users => generated 302 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:14:32.668295 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-a8b48e1c-727e-42ac-a267-4eb16095deef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3959c498fb4f4454a42b7e6a7a7afb60'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:32.669373 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e907d6c-f349-4c3f-982e-9ca6d621da9f None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:32.669796 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e907d6c-f349-4c3f-982e-9ca6d621da9f None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:32.670312 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-a8b48e1c-727e-42ac-a267-4eb16095deef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3959c498fb4f4454a42b7e6a7a7afb60'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:32.670645 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e907d6c-f349-4c3f-982e-9ca6d621da9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:32.683285 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-a8b48e1c-727e-42ac-a267-4eb16095deef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3959c498fb4f4454a42b7e6a7a7afb60'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:32.701396 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-a8b48e1c-727e-42ac-a267-4eb16095deef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3959c498fb4f4454a42b7e6a7a7afb60'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:32.716919 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-0e907d6c-f349-4c3f-982e-9ca6d621da9f None None] MFA Rules not processed for user `925c3413d59f4b0bbb329317ea1f8a65`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:14:32.719598 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-0e907d6c-f349-4c3f-982e-9ca6d621da9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:32.724030 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-a8b48e1c-727e-42ac-a267-4eb16095deef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3959c498fb4f4454a42b7e6a7a7afb60'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:32.736469 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1140/2268] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:14:32 2022] DELETE /identity/v3/users/3959c498fb4f4454a42b7e6a7a7afb60 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:14:32.736469 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b48e1c-727e-42ac-a267-4eb16095deef admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:32.739873 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-a8b48e1c-727e-42ac-a267-4eb16095deef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:32.862128 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1129/2269] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:14:32 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:14:32.864515 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2b56d8-7375-4bda-8267-58658b7b5807 None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:32.865646 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2b56d8-7375-4bda-8267-58658b7b5807 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:32.868221 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2b56d8-7375-4bda-8267-58658b7b5807 None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:32.879015 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1130/2270] 10.222.0.17 () {54 vars in 912 bytes} [Sat Jul 23 21:14:32 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:14:32.880723 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8f80c9-a4c0-484e-a772-c96321acd73d None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:32.881365 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8f80c9-a4c0-484e-a772-c96321acd73d None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:32.882311 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8f80c9-a4c0-484e-a772-c96321acd73d None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:32.884218 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1131/2271] 10.222.0.17 () {54 vars in 921 bytes} [Sat Jul 23 21:14:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:14:32.885383 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8f80c9-a4c0-484e-a772-c96321acd73d None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:32.887613 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-0e8f80c9-a4c0-484e-a772-c96321acd73d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:32.928733 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:32.942683 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b48e1c-727e-42ac-a267-4eb16095deef admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:32.953644 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64155708-61e0-46e6-95f5-eb927791d788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:32.954984 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64155708-61e0-46e6-95f5-eb927791d788 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:32.956458 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64155708-61e0-46e6-95f5-eb927791d788 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:32.957012 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64155708-61e0-46e6-95f5-eb927791d788 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:32.960031 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64155708-61e0-46e6-95f5-eb927791d788 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:32.963692 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64155708-61e0-46e6-95f5-eb927791d788 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:33.016791 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1141/2272] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:14:32 2022] GET /identity/v3/roles => generated 1420 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:14:33.020501 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64155708-61e0-46e6-95f5-eb927791d788 admin admin] Authenticating service token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 23 21:14:33.027752 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-64155708-61e0-46e6-95f5-eb927791d788 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:33.107283 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8f80c9-a4c0-484e-a772-c96321acd73d None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:33.115694 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2503623f-5222-40ce-a576-c1d1a453d377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:33.121646 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2503623f-5222-40ce-a576-c1d1a453d377 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:33.122151 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2503623f-5222-40ce-a576-c1d1a453d377 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:33.123398 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2503623f-5222-40ce-a576-c1d1a453d377 admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:33.124598 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2503623f-5222-40ce-a576-c1d1a453d377 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:33.127546 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2503623f-5222-40ce-a576-c1d1a453d377 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:33.217611 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1132/2273] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:14:32 2022] POST /identity/v3/projects => generated 387 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:14:33.219041 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c90608-fdab-4bc2-a5f8-fe1aa9b5a3b5 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:33.219333 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c90608-fdab-4bc2-a5f8-fe1aa9b5a3b5 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:33.219613 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c90608-fdab-4bc2-a5f8-fe1aa9b5a3b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:33.242904 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64155708-61e0-46e6-95f5-eb927791d788 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:33.252693 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-64155708-61e0-46e6-95f5-eb927791d788 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:33.260498 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-52c90608-fdab-4bc2-a5f8-fe1aa9b5a3b5 None None] MFA Rules not processed for user `c497326ee890462e8f48b4a56f81990c`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:14:33.262061 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-52c90608-fdab-4bc2-a5f8-fe1aa9b5a3b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:33.324877 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:33.441393 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1133/2274] 10.222.0.17 () {58 vars in 1018 bytes} [Sat Jul 23 21:14:33 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:14:33.442502 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c90608-fdab-4bc2-a5f8-fe1aa9b5a3b5 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:33.500423 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64155708-61e0-46e6-95f5-eb927791d788 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:33.626396 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c90608-fdab-4bc2-a5f8-fe1aa9b5a3b5 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:33.644501 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d7cc67-89f5-4b74-a5b1-72b7f4a741bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:33.645440 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d7cc67-89f5-4b74-a5b1-72b7f4a741bf admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:33.645897 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d7cc67-89f5-4b74-a5b1-72b7f4a741bf admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:33.646535 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d7cc67-89f5-4b74-a5b1-72b7f4a741bf admin admin] PATH_INFO: `/v3/projects/2e7a45a3f74d4fa5adc7f980e023e268/users/571926481b2e4356b96ad7a334c59aea/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:33.697536 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d7cc67-89f5-4b74-a5b1-72b7f4a741bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e7a45a3f74d4fa5adc7f980e023e268, user_id=571926481b2e4356b96ad7a334c59aea, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:33.705499 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d7cc67-89f5-4b74-a5b1-72b7f4a741bf admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:33.713971 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b6089b-427e-42d8-89b4-e29fee7933ff tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2081723f952440d88c54f2881db4b603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd102bd5fa72d44b6aa7ae900d4e81afc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:33.714983 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b6089b-427e-42d8-89b4-e29fee7933ff tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:33.715263 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b6089b-427e-42d8-89b4-e29fee7933ff tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:33.715533 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b6089b-427e-42d8-89b4-e29fee7933ff tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] PATH_INFO: `/v3/projects/66610bd60abc459dae24d25231d10cfe` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:33.716797 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b6089b-427e-42d8-89b4-e29fee7933ff tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] RBAC: Authorizing `identity:get_project(project_id=66610bd60abc459dae24d25231d10cfe)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:33.721670 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b6089b-427e-42d8-89b4-e29fee7933ff tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:33.731923 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1134/2275] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:14:33 2022] PUT /identity/v3/projects/2e7a45a3f74d4fa5adc7f980e023e268/users/571926481b2e4356b96ad7a334c59aea/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:14:33.732783 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d7cc67-89f5-4b74-a5b1-72b7f4a741bf admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:33.737473 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1142/2276] 10.222.0.17 () {58 vars in 1443 bytes} [Sat Jul 23 21:14:33 2022] GET /identity/v3/projects/66610bd60abc459dae24d25231d10cfe => generated 375 bytes in 715 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:14:33.738514 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b6089b-427e-42d8-89b4-e29fee7933ff tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:33.751902 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-f9b6089b-427e-42d8-89b4-e29fee7933ff tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:33.792269 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b6089b-427e-42d8-89b4-e29fee7933ff tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:33.896331 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d7cc67-89f5-4b74-a5b1-72b7f4a741bf admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:33.911157 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3810dd4d-b8cb-40fc-8def-1a830aef969d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:33.912838 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3810dd4d-b8cb-40fc-8def-1a830aef969d admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:33.913383 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3810dd4d-b8cb-40fc-8def-1a830aef969d admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:33.914046 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3810dd4d-b8cb-40fc-8def-1a830aef969d admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:33.918691 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:33.926261 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3810dd4d-b8cb-40fc-8def-1a830aef969d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:33.933942 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3810dd4d-b8cb-40fc-8def-1a830aef969d admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:33.974173 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09bc922-c573-472e-a592-354e18956881 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:33.974374 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1135/2277] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:14:33 2022] POST /identity/v3/users => generated 300 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:14:33.974474 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09bc922-c573-472e-a592-354e18956881 service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:33.974474 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09bc922-c573-472e-a592-354e18956881 service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:33.974474 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09bc922-c573-472e-a592-354e18956881 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:33.975286 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3810dd4d-b8cb-40fc-8def-1a830aef969d admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:34.000595 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09bc922-c573-472e-a592-354e18956881 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:34.003515 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09bc922-c573-472e-a592-354e18956881 service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:34.012639 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3810dd4d-b8cb-40fc-8def-1a830aef969d admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:34.025344 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1143/2278] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:14:33 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:14:34.026989 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09bc922-c573-472e-a592-354e18956881 service neutron] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:34.034471 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd58971-c7df-44a4-bcaf-4479e5452fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:34.035751 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd58971-c7df-44a4-bcaf-4479e5452fbf admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:34.036043 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd58971-c7df-44a4-bcaf-4479e5452fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:34.036321 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd58971-c7df-44a4-bcaf-4479e5452fbf admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:34.043354 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd58971-c7df-44a4-bcaf-4479e5452fbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:34.052459 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd58971-c7df-44a4-bcaf-4479e5452fbf admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:34.061669 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09bc922-c573-472e-a592-354e18956881 service neutron] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:34.069368 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395fae05-75e4-4407-bb5c-0474c2fe1933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:34.069727 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1136/2279] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:14:33 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:14:34.070843 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395fae05-75e4-4407-bb5c-0474c2fe1933 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:34.071603 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395fae05-75e4-4407-bb5c-0474c2fe1933 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:34.072073 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395fae05-75e4-4407-bb5c-0474c2fe1933 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:34.073304 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395fae05-75e4-4407-bb5c-0474c2fe1933 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:34.075384 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395fae05-75e4-4407-bb5c-0474c2fe1933 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:34.078083 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd58971-c7df-44a4-bcaf-4479e5452fbf admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:34.106101 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1144/2280] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:14:34 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:14:34.107720 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395fae05-75e4-4407-bb5c-0474c2fe1933 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:34.130271 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd58971-c7df-44a4-bcaf-4479e5452fbf admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:34.137615 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395fae05-75e4-4407-bb5c-0474c2fe1933 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:34.144415 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea88de2-0ebc-4ba8-a8b2-d602a1b360e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:34.145702 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea88de2-0ebc-4ba8-a8b2-d602a1b360e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:34.146146 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea88de2-0ebc-4ba8-a8b2-d602a1b360e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:34.146561 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea88de2-0ebc-4ba8-a8b2-d602a1b360e6 admin admin] PATH_INFO: `/v3/projects/2e7a45a3f74d4fa5adc7f980e023e268/users/571926481b2e4356b96ad7a334c59aea/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:34.154107 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ff2a49-17a6-4627-a606-1a82d661580c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:34.155390 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ff2a49-17a6-4627-a606-1a82d661580c admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:34.155896 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ff2a49-17a6-4627-a606-1a82d661580c admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:34.158944 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ff2a49-17a6-4627-a606-1a82d661580c admin admin] PATH_INFO: `/v3/projects/e031fe2a65f54f1da9d17aff9c2d7b08/users/9cc2753d5f8c4a3481d35781da5b97c5/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:34.172086 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea88de2-0ebc-4ba8-a8b2-d602a1b360e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e7a45a3f74d4fa5adc7f980e023e268, user_id=571926481b2e4356b96ad7a334c59aea, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:34.192352 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea88de2-0ebc-4ba8-a8b2-d602a1b360e6 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:34.229397 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1137/2281] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:14:34 2022] PUT /identity/v3/projects/2e7a45a3f74d4fa5adc7f980e023e268/users/571926481b2e4356b96ad7a334c59aea/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:14:34.242041 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ead56d-dc32-4257-a81a-b7ba8bd6f8ae None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:34.242428 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ead56d-dc32-4257-a81a-b7ba8bd6f8ae None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:34.242723 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ead56d-dc32-4257-a81a-b7ba8bd6f8ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:34.249818 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ff2a49-17a6-4627-a606-1a82d661580c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e031fe2a65f54f1da9d17aff9c2d7b08, user_id=9cc2753d5f8c4a3481d35781da5b97c5, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:34.259811 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ff2a49-17a6-4627-a606-1a82d661580c admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:34.290463 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1145/2282] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:14:34 2022] PUT /identity/v3/projects/e031fe2a65f54f1da9d17aff9c2d7b08/users/9cc2753d5f8c4a3481d35781da5b97c5/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:14:34.292006 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ff2a49-17a6-4627-a606-1a82d661580c admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:34.302653 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-c8ead56d-dc32-4257-a81a-b7ba8bd6f8ae None None] MFA Rules not processed for user `571926481b2e4356b96ad7a334c59aea`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:14:34.306509 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-c8ead56d-dc32-4257-a81a-b7ba8bd6f8ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:34.330296 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:34.459230 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ff2a49-17a6-4627-a606-1a82d661580c admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:34.469616 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6d91a2-29a7-4348-875c-0bfe469465c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:34.470471 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6d91a2-29a7-4348-875c-0bfe469465c7 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:34.470768 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6d91a2-29a7-4348-875c-0bfe469465c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:34.471014 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6d91a2-29a7-4348-875c-0bfe469465c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:34.471785 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6d91a2-29a7-4348-875c-0bfe469465c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:34.473410 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6d91a2-29a7-4348-875c-0bfe469465c7 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:34.498034 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1138/2283] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:14:34 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:14:34.503864 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1146/2284] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:14:34 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:14:34.507892 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ead56d-dc32-4257-a81a-b7ba8bd6f8ae None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:34.521352 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ead56d-dc32-4257-a81a-b7ba8bd6f8ae None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:34.527755 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7100ed-1cf4-46b0-ab3a-281a91a3705c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:34.528757 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7100ed-1cf4-46b0-ab3a-281a91a3705c admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:34.529093 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7100ed-1cf4-46b0-ab3a-281a91a3705c admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:34.529432 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7100ed-1cf4-46b0-ab3a-281a91a3705c admin admin] PATH_INFO: `/v3/projects/e031fe2a65f54f1da9d17aff9c2d7b08/users/9cc2753d5f8c4a3481d35781da5b97c5/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:34.532920 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7100ed-1cf4-46b0-ab3a-281a91a3705c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e031fe2a65f54f1da9d17aff9c2d7b08, user_id=9cc2753d5f8c4a3481d35781da5b97c5, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:34.536412 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7100ed-1cf4-46b0-ab3a-281a91a3705c admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:34.552897 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1139/2285] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:14:34 2022] PUT /identity/v3/projects/e031fe2a65f54f1da9d17aff9c2d7b08/users/9cc2753d5f8c4a3481d35781da5b97c5/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:14:34.564571 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608ad912-c428-45f2-9f24-c8d05009727e None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:34.564994 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608ad912-c428-45f2-9f24-c8d05009727e None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:34.565366 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608ad912-c428-45f2-9f24-c8d05009727e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:34.583094 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7100ed-1cf4-46b0-ab3a-281a91a3705c admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:34.591661 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-5c7100ed-1cf4-46b0-ab3a-281a91a3705c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:34.659043 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-608ad912-c428-45f2-9f24-c8d05009727e None None] MFA Rules not processed for user `9cc2753d5f8c4a3481d35781da5b97c5`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:14:34.661412 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-608ad912-c428-45f2-9f24-c8d05009727e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:34.803148 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7100ed-1cf4-46b0-ab3a-281a91a3705c admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:34.829730 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d2a8d0-8019-4a7f-93e2-fe5fd1c79a74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:34.830775 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d2a8d0-8019-4a7f-93e2-fe5fd1c79a74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:34.830999 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d2a8d0-8019-4a7f-93e2-fe5fd1c79a74 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:34.831273 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d2a8d0-8019-4a7f-93e2-fe5fd1c79a74 admin admin] PATH_INFO: `/v3/users/bfe8a5d8eb3f486f8a40fe1940c8b8aa` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:34.832581 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d2a8d0-8019-4a7f-93e2-fe5fd1c79a74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bfe8a5d8eb3f486f8a40fe1940c8b8aa)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:34.839033 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d2a8d0-8019-4a7f-93e2-fe5fd1c79a74 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:34.876620 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1147/2286] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:14:34 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:14:34.878487 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608ad912-c428-45f2-9f24-c8d05009727e None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:34.910849 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608ad912-c428-45f2-9f24-c8d05009727e None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:34.923897 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e2529c-9951-4f51-b116-0b5920f241db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:34.925132 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e2529c-9951-4f51-b116-0b5920f241db admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:34.925540 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e2529c-9951-4f51-b116-0b5920f241db admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:34.926124 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e2529c-9951-4f51-b116-0b5920f241db admin admin] PATH_INFO: `/v3/users/da5808807f604f758c74ef13693487fe` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:34.930033 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e2529c-9951-4f51-b116-0b5920f241db admin admin] RBAC: Authorizing `identity:delete_user(user_id=da5808807f604f758c74ef13693487fe)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:34.932780 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e2529c-9951-4f51-b116-0b5920f241db admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:34.976933 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-49d2a8d0-8019-4a7f-93e2-fe5fd1c79a74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bfe8a5d8eb3f486f8a40fe1940c8b8aa'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:34.984311 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:34.990867 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-49d2a8d0-8019-4a7f-93e2-fe5fd1c79a74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bfe8a5d8eb3f486f8a40fe1940c8b8aa'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:34.992038 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-49d2a8d0-8019-4a7f-93e2-fe5fd1c79a74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bfe8a5d8eb3f486f8a40fe1940c8b8aa'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:35.007712 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-49d2a8d0-8019-4a7f-93e2-fe5fd1c79a74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bfe8a5d8eb3f486f8a40fe1940c8b8aa'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:35.031084 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-49d2a8d0-8019-4a7f-93e2-fe5fd1c79a74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bfe8a5d8eb3f486f8a40fe1940c8b8aa'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:35.040749 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1140/2287] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:14:34 2022] DELETE /identity/v3/users/bfe8a5d8eb3f486f8a40fe1940c8b8aa => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:14:35.042695 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9747cf-92ca-41a8-bf60-f9101523a1ab None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:35.042986 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9747cf-92ca-41a8-bf60-f9101523a1ab None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:35.043950 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9747cf-92ca-41a8-bf60-f9101523a1ab None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:35.045714 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1141/2288] 10.222.0.17 () {54 vars in 921 bytes} [Sat Jul 23 21:14:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:14:35.047026 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0449c46-ae45-4505-a497-ef4d7a24d1cd None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:35.047358 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0449c46-ae45-4505-a497-ef4d7a24d1cd None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:35.047640 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0449c46-ae45-4505-a497-ef4d7a24d1cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:35.057767 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-16e2529c-9951-4f51-b116-0b5920f241db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da5808807f604f758c74ef13693487fe'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:35.059607 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-16e2529c-9951-4f51-b116-0b5920f241db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da5808807f604f758c74ef13693487fe'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:35.074336 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-e0449c46-ae45-4505-a497-ef4d7a24d1cd None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:14:35.076870 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-e0449c46-ae45-4505-a497-ef4d7a24d1cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:35.080056 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-16e2529c-9951-4f51-b116-0b5920f241db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da5808807f604f758c74ef13693487fe'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:35.086214 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:35.096452 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-16e2529c-9951-4f51-b116-0b5920f241db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da5808807f604f758c74ef13693487fe'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:35.139634 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-16e2529c-9951-4f51-b116-0b5920f241db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da5808807f604f758c74ef13693487fe'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:35.153444 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1148/2289] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:14:34 2022] DELETE /identity/v3/users/da5808807f604f758c74ef13693487fe => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:14:35.153444 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c222165-853b-4f23-b41b-429dea2118cf None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:35.153444 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c222165-853b-4f23-b41b-429dea2118cf None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:35.157899 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c222165-853b-4f23-b41b-429dea2118cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:35.163501 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1142/2290] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:14:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:14:35.164315 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0449c46-ae45-4505-a497-ef4d7a24d1cd None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:35.165756 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-e0449c46-ae45-4505-a497-ef4d7a24d1cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:35.179081 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0449c46-ae45-4505-a497-ef4d7a24d1cd None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:35.237020 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-6c222165-853b-4f23-b41b-429dea2118cf None None] MFA Rules not processed for user `abc719a3b3ac4461b82ca04ab6451d81`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:14:35.244139 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-6c222165-853b-4f23-b41b-429dea2118cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:35.256044 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae739311-de35-484d-b6bc-846e5b074806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:35.256971 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae739311-de35-484d-b6bc-846e5b074806 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:35.257248 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae739311-de35-484d-b6bc-846e5b074806 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:35.257521 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae739311-de35-484d-b6bc-846e5b074806 admin admin] PATH_INFO: `/v3/projects/806cd8102111418d997221825848ad86` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:35.264743 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae739311-de35-484d-b6bc-846e5b074806 admin admin] RBAC: Authorizing `identity:delete_project(project_id=806cd8102111418d997221825848ad86)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:35.276271 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae739311-de35-484d-b6bc-846e5b074806 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:35.402034 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-ae739311-de35-484d-b6bc-846e5b074806 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '806cd8102111418d997221825848ad86', 'request_id': 'req-ae739311-de35-484d-b6bc-846e5b074806'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:35.421124 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-ae739311-de35-484d-b6bc-846e5b074806 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '806cd8102111418d997221825848ad86', 'request_id': 'req-ae739311-de35-484d-b6bc-846e5b074806'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:35.431724 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1149/2291] 10.222.0.17 () {58 vars in 1018 bytes} [Sat Jul 23 21:14:35 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:14:35.436693 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00922d38-4ca9-4751-b040-e501ac0f5364 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:35.437004 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00922d38-4ca9-4751-b040-e501ac0f5364 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:35.437233 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00922d38-4ca9-4751-b040-e501ac0f5364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:35.447752 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-ae739311-de35-484d-b6bc-846e5b074806 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '806cd8102111418d997221825848ad86', 'request_id': 'req-ae739311-de35-484d-b6bc-846e5b074806'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:35.458913 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-00922d38-4ca9-4751-b040-e501ac0f5364 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:14:35.460152 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-00922d38-4ca9-4751-b040-e501ac0f5364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:35.473317 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-ae739311-de35-484d-b6bc-846e5b074806 admin admin] The token cache is being invalidate because project 806cd8102111418d997221825848ad86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:14:35.473833 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-ae739311-de35-484d-b6bc-846e5b074806 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:35.474554 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-ae739311-de35-484d-b6bc-846e5b074806 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:35.479053 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1143/2292] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:14:35 2022] DELETE /identity/v3/projects/806cd8102111418d997221825848ad86 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:14:35.480083 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae739311-de35-484d-b6bc-846e5b074806 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:35.483497 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-ae739311-de35-484d-b6bc-846e5b074806 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:35.542562 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1150/2293] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:14:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:14:35.543562 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00922d38-4ca9-4751-b040-e501ac0f5364 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:35.546963 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-00922d38-4ca9-4751-b040-e501ac0f5364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:35.601043 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:35.606751 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:35.642352 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00922d38-4ca9-4751-b040-e501ac0f5364 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:35.647816 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc00695-62e0-46aa-8e57-a18b838e79e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:35.648088 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc00695-62e0-46aa-8e57-a18b838e79e6 service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:35.648469 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc00695-62e0-46aa-8e57-a18b838e79e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:35.648754 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc00695-62e0-46aa-8e57-a18b838e79e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:35.651377 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-4bc00695-62e0-46aa-8e57-a18b838e79e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:35.664431 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae739311-de35-484d-b6bc-846e5b074806 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:35.671826 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc00695-62e0-46aa-8e57-a18b838e79e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:35.673369 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc00695-62e0-46aa-8e57-a18b838e79e6 service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:35.674575 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4925361-3226-47f8-963c-9e6ad677377f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:35.675517 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4925361-3226-47f8-963c-9e6ad677377f service nova] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:35.676883 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4925361-3226-47f8-963c-9e6ad677377f service nova] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:35.677377 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4925361-3226-47f8-963c-9e6ad677377f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:35.681565 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-f4925361-3226-47f8-963c-9e6ad677377f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:35.691964 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1151/2294] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:14:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:14:35.693499 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d4ce2e-ff55-447d-a654-3097e0ff55b1 None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:35.697053 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d4ce2e-ff55-447d-a654-3097e0ff55b1 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:35.697339 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d4ce2e-ff55-447d-a654-3097e0ff55b1 None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:35.699745 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1152/2295] 10.222.0.17 () {54 vars in 921 bytes} [Sat Jul 23 21:14:35 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:14:35.701113 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d69a05-bfbb-4f08-89d7-4a5198916c27 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:35.701411 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d69a05-bfbb-4f08-89d7-4a5198916c27 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:35.701685 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d69a05-bfbb-4f08-89d7-4a5198916c27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:35.742661 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-f1d69a05-bfbb-4f08-89d7-4a5198916c27 None None] MFA Rules not processed for user `39f1a14a59b7401d88f18ec35c91e30a`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:14:35.744373 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-f1d69a05-bfbb-4f08-89d7-4a5198916c27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:35.788699 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4925361-3226-47f8-963c-9e6ad677377f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:35.792582 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4925361-3226-47f8-963c-9e6ad677377f service nova] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:35.808723 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1144/2296] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:14:35 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:14:35.817693 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4925361-3226-47f8-963c-9e6ad677377f service nova] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:35.825606 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-f4925361-3226-47f8-963c-9e6ad677377f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:35.924786 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1153/2297] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:14:35 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:14:35.927009 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b268eec5-f1fa-4e99-a64c-85671a2e4f20 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:35.927402 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b268eec5-f1fa-4e99-a64c-85671a2e4f20 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:35.928171 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b268eec5-f1fa-4e99-a64c-85671a2e4f20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:35.975057 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-b268eec5-f1fa-4e99-a64c-85671a2e4f20 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:14:35.976620 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-b268eec5-f1fa-4e99-a64c-85671a2e4f20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:35.977614 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4925361-3226-47f8-963c-9e6ad677377f service nova] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:35.992785 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179d00f4-7ac9-4412-9fd5-8afe86e201e6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc719a3b3ac4461b82ca04ab6451d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:35.993167 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179d00f4-7ac9-4412-9fd5-8afe86e201e6 service placement] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:35.993497 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179d00f4-7ac9-4412-9fd5-8afe86e201e6 service placement] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:35.993814 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179d00f4-7ac9-4412-9fd5-8afe86e201e6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:35.999727 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-179d00f4-7ac9-4412-9fd5-8afe86e201e6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:36.013901 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1154/2298] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:14:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:14:36.017597 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b268eec5-f1fa-4e99-a64c-85671a2e4f20 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:36.026748 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179d00f4-7ac9-4412-9fd5-8afe86e201e6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:36.028468 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179d00f4-7ac9-4412-9fd5-8afe86e201e6 service placement] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:36.040902 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b268eec5-f1fa-4e99-a64c-85671a2e4f20 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:36.046199 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5c3a52-2b12-48cf-a49a-645798607bf7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:36.048462 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5c3a52-2b12-48cf-a49a-645798607bf7 service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:36.051307 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5c3a52-2b12-48cf-a49a-645798607bf7 service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:36.051863 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5c3a52-2b12-48cf-a49a-645798607bf7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:36.055569 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1145/2299] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:14:35 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:14:36.057064 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9acfec3-a6ca-4b1f-9f4a-e9864ad6ad79 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:36.057354 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9acfec3-a6ca-4b1f-9f4a-e9864ad6ad79 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:36.057635 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9acfec3-a6ca-4b1f-9f4a-e9864ad6ad79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:36.067856 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5c3a52-2b12-48cf-a49a-645798607bf7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:36.070770 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5c3a52-2b12-48cf-a49a-645798607bf7 service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:36.094888 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-f9acfec3-a6ca-4b1f-9f4a-e9864ad6ad79 None None] MFA Rules not processed for user `abc719a3b3ac4461b82ca04ab6451d81`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:14:36.096395 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-f9acfec3-a6ca-4b1f-9f4a-e9864ad6ad79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:36.115238 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1146/2300] 10.222.0.17 () {58 vars in 1018 bytes} [Sat Jul 23 21:14:36 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:14:36.117107 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9acfec3-a6ca-4b1f-9f4a-e9864ad6ad79 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:36.135277 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9acfec3-a6ca-4b1f-9f4a-e9864ad6ad79 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:36.149618 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1155/2301] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:14:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:14:36.151720 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d2a44d-5b81-4c4f-8eea-09bc5e4ad369 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:36.152789 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5c3a52-2b12-48cf-a49a-645798607bf7 service neutron] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:36.154254 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d2a44d-5b81-4c4f-8eea-09bc5e4ad369 service nova] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:36.154542 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d2a44d-5b81-4c4f-8eea-09bc5e4ad369 service nova] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:36.154816 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d2a44d-5b81-4c4f-8eea-09bc5e4ad369 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:36.158824 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-98d2a44d-5b81-4c4f-8eea-09bc5e4ad369 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:36.189245 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-fd5c3a52-2b12-48cf-a49a-645798607bf7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:36.245068 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5c3a52-2b12-48cf-a49a-645798607bf7 service neutron] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:36.257980 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feb9cec-86ff-4662-a123-98a20f7f4727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:36.260723 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feb9cec-86ff-4662-a123-98a20f7f4727 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:36.261173 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feb9cec-86ff-4662-a123-98a20f7f4727 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:36.262236 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feb9cec-86ff-4662-a123-98a20f7f4727 admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:36.263403 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4feb9cec-86ff-4662-a123-98a20f7f4727 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:36.276477 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4feb9cec-86ff-4662-a123-98a20f7f4727 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:36.313260 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:36.320689 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d2a44d-5b81-4c4f-8eea-09bc5e4ad369 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:36.325067 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d2a44d-5b81-4c4f-8eea-09bc5e4ad369 service nova] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:36.345505 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1156/2302] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:14:36 2022] POST /identity/v3/projects => generated 403 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:14:36.347164 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1147/2303] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:14:36 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:14:36.348796 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d2a44d-5b81-4c4f-8eea-09bc5e4ad369 service nova] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:36.350982 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d14ad8-d360-4c27-8b25-83e74f27c263 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:36.351994 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d14ad8-d360-4c27-8b25-83e74f27c263 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:36.354231 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d14ad8-d360-4c27-8b25-83e74f27c263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:36.381081 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d2a44d-5b81-4c4f-8eea-09bc5e4ad369 service nova] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:36.428883 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-25d14ad8-d360-4c27-8b25-83e74f27c263 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:14:36.430821 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-25d14ad8-d360-4c27-8b25-83e74f27c263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:36.610711 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0784059e-cc55-4397-9933-99083231b81a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc719a3b3ac4461b82ca04ab6451d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:36.611451 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0784059e-cc55-4397-9933-99083231b81a service placement] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:36.611736 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0784059e-cc55-4397-9933-99083231b81a service placement] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:36.612579 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0784059e-cc55-4397-9933-99083231b81a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:36.646375 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0784059e-cc55-4397-9933-99083231b81a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:36.654265 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0784059e-cc55-4397-9933-99083231b81a service placement] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:36.664473 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1157/2304] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:14:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:14:36.671276 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d14ad8-d360-4c27-8b25-83e74f27c263 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:36.681363 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-25d14ad8-d360-4c27-8b25-83e74f27c263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:36.687655 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1148/2305] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:14:36 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:14:36.688599 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0784059e-cc55-4397-9933-99083231b81a service placement] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:36.739118 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0784059e-cc55-4397-9933-99083231b81a service placement] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:36.757109 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de266826-1d27-4a1d-9839-e7cc0a57ed10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:36.757817 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de266826-1d27-4a1d-9839-e7cc0a57ed10 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:36.758120 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de266826-1d27-4a1d-9839-e7cc0a57ed10 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:36.763128 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de266826-1d27-4a1d-9839-e7cc0a57ed10 admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:36.763993 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de266826-1d27-4a1d-9839-e7cc0a57ed10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:36.765741 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d14ad8-d360-4c27-8b25-83e74f27c263 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:36.773517 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de266826-1d27-4a1d-9839-e7cc0a57ed10 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:36.794809 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024b2daa-03c7-48b4-9f20-9309f1002b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:36.796003 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024b2daa-03c7-48b4-9f20-9309f1002b70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:36.796497 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024b2daa-03c7-48b4-9f20-9309f1002b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:36.796968 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024b2daa-03c7-48b4-9f20-9309f1002b70 admin admin] PATH_INFO: `/v3/projects/66610bd60abc459dae24d25231d10cfe` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:36.798534 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024b2daa-03c7-48b4-9f20-9309f1002b70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=66610bd60abc459dae24d25231d10cfe)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:36.800893 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024b2daa-03c7-48b4-9f20-9309f1002b70 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:36.853480 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1149/2306] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:14:36 2022] POST /identity/v3/users => generated 308 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:14:36.854450 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de266826-1d27-4a1d-9839-e7cc0a57ed10 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:36.872293 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:36.888557 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de266826-1d27-4a1d-9839-e7cc0a57ed10 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:36.908108 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b311f0-c2ee-4a46-98f3-8e921c628c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:36.912961 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b311f0-c2ee-4a46-98f3-8e921c628c2a admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:36.913286 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b311f0-c2ee-4a46-98f3-8e921c628c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:36.913575 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b311f0-c2ee-4a46-98f3-8e921c628c2a admin admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:36.914403 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b311f0-c2ee-4a46-98f3-8e921c628c2a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:14:36.914731 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b311f0-c2ee-4a46-98f3-8e921c628c2a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:36.925491 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b311f0-c2ee-4a46-98f3-8e921c628c2a admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:36.961102 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1150/2307] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:14:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:14:36.962187 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b311f0-c2ee-4a46-98f3-8e921c628c2a admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:36.968224 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-024b2daa-03c7-48b4-9f20-9309f1002b70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66610bd60abc459dae24d25231d10cfe', 'request_id': 'req-024b2daa-03c7-48b4-9f20-9309f1002b70'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:36.983628 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b311f0-c2ee-4a46-98f3-8e921c628c2a admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:37.007578 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-024b2daa-03c7-48b4-9f20-9309f1002b70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66610bd60abc459dae24d25231d10cfe', 'request_id': 'req-024b2daa-03c7-48b4-9f20-9309f1002b70'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:37.020729 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-024b2daa-03c7-48b4-9f20-9309f1002b70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66610bd60abc459dae24d25231d10cfe', 'request_id': 'req-024b2daa-03c7-48b4-9f20-9309f1002b70'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:37.054032 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-024b2daa-03c7-48b4-9f20-9309f1002b70 admin admin] The token cache is being invalidate because project 66610bd60abc459dae24d25231d10cfe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:14:37.054414 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-024b2daa-03c7-48b4-9f20-9309f1002b70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:37.055320 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-024b2daa-03c7-48b4-9f20-9309f1002b70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:37.062821 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1158/2308] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:14:36 2022] DELETE /identity/v3/projects/66610bd60abc459dae24d25231d10cfe => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:14:37.063846 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024b2daa-03c7-48b4-9f20-9309f1002b70 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:37.065837 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-024b2daa-03c7-48b4-9f20-9309f1002b70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:37.141122 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc5a2d0-e030-4ac5-a13f-159e7d6cdbb3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc719a3b3ac4461b82ca04ab6451d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:37.141518 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc5a2d0-e030-4ac5-a13f-159e7d6cdbb3 service placement] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:37.141795 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc5a2d0-e030-4ac5-a13f-159e7d6cdbb3 service placement] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:37.142152 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc5a2d0-e030-4ac5-a13f-159e7d6cdbb3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:37.144177 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-4fc5a2d0-e030-4ac5-a13f-159e7d6cdbb3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:37.164648 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc5a2d0-e030-4ac5-a13f-159e7d6cdbb3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:37.166466 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc5a2d0-e030-4ac5-a13f-159e7d6cdbb3 service placement] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:37.180452 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1151/2309] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:14:36 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:14:37.187009 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc5a2d0-e030-4ac5-a13f-159e7d6cdbb3 service placement] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:37.192131 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-4fc5a2d0-e030-4ac5-a13f-159e7d6cdbb3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:37.218149 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024b2daa-03c7-48b4-9f20-9309f1002b70 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:37.226019 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad1016a-e330-46ca-a612-cc5dc6be2d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:37.226865 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad1016a-e330-46ca-a612-cc5dc6be2d2a admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:37.227152 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad1016a-e330-46ca-a612-cc5dc6be2d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:37.227426 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad1016a-e330-46ca-a612-cc5dc6be2d2a admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:37.228263 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad1016a-e330-46ca-a612-cc5dc6be2d2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:37.229555 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc5a2d0-e030-4ac5-a13f-159e7d6cdbb3 service placement] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:37.229998 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad1016a-e330-46ca-a612-cc5dc6be2d2a admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:37.244937 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4ef986-0f5f-4d2d-b91e-a14e80586827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:37.246528 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4ef986-0f5f-4d2d-b91e-a14e80586827 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:37.246804 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4ef986-0f5f-4d2d-b91e-a14e80586827 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:37.247078 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4ef986-0f5f-4d2d-b91e-a14e80586827 admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:37.247871 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4ef986-0f5f-4d2d-b91e-a14e80586827 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:37.249145 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1159/2310] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:14:37 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:14:37.250254 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad1016a-e330-46ca-a612-cc5dc6be2d2a admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:37.252848 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-7ad1016a-e330-46ca-a612-cc5dc6be2d2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:37.258928 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4ef986-0f5f-4d2d-b91e-a14e80586827 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:37.268765 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad1016a-e330-46ca-a612-cc5dc6be2d2a admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:37.275028 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f6162a-f3cb-44de-9a7f-e637b6db2d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:37.277354 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f6162a-f3cb-44de-9a7f-e637b6db2d9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:37.277354 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f6162a-f3cb-44de-9a7f-e637b6db2d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:37.277354 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f6162a-f3cb-44de-9a7f-e637b6db2d9a admin admin] PATH_INFO: `/v3/users/2081723f952440d88c54f2881db4b603` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:37.278501 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f6162a-f3cb-44de-9a7f-e637b6db2d9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2081723f952440d88c54f2881db4b603)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:37.281215 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f6162a-f3cb-44de-9a7f-e637b6db2d9a admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:37.360574 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1152/2311] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:14:37 2022] POST /identity/v3/projects => generated 385 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:14:37.364468 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ade4b6-1492-4b29-8e0e-92bf79dd3eae None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:37.364468 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ade4b6-1492-4b29-8e0e-92bf79dd3eae None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:37.367704 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ade4b6-1492-4b29-8e0e-92bf79dd3eae None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:37.377723 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1153/2312] 10.222.0.17 () {54 vars in 921 bytes} [Sat Jul 23 21:14:37 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:14:37.377723 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ade4b6-1492-4b29-8e0e-92bf79dd3eae None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:37.438745 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-61f6162a-f3cb-44de-9a7f-e637b6db2d9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2081723f952440d88c54f2881db4b603'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:37.439739 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-61f6162a-f3cb-44de-9a7f-e637b6db2d9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2081723f952440d88c54f2881db4b603'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:37.449230 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-61f6162a-f3cb-44de-9a7f-e637b6db2d9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2081723f952440d88c54f2881db4b603'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:37.464319 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-61f6162a-f3cb-44de-9a7f-e637b6db2d9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2081723f952440d88c54f2881db4b603'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:37.470960 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:37.497484 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-61f6162a-f3cb-44de-9a7f-e637b6db2d9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2081723f952440d88c54f2881db4b603'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:37.511072 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1160/2313] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:14:37 2022] DELETE /identity/v3/users/2081723f952440d88c54f2881db4b603 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:14:37.512249 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f6162a-f3cb-44de-9a7f-e637b6db2d9a admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:37.514135 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-61f6162a-f3cb-44de-9a7f-e637b6db2d9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:37.537358 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:37.559171 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ade4b6-1492-4b29-8e0e-92bf79dd3eae None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:37.659668 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f6162a-f3cb-44de-9a7f-e637b6db2d9a admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:37.687120 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ea1ad3-b255-4a39-8811-beb064c4a090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:37.688763 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ea1ad3-b255-4a39-8811-beb064c4a090 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:37.689298 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ea1ad3-b255-4a39-8811-beb064c4a090 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:37.689982 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ea1ad3-b255-4a39-8811-beb064c4a090 admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:37.691702 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ea1ad3-b255-4a39-8811-beb064c4a090 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:37.699800 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ea1ad3-b255-4a39-8811-beb064c4a090 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:37.727017 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3936a8-a61a-45be-8c6f-2fa24662dc2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:37.728013 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3936a8-a61a-45be-8c6f-2fa24662dc2a admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:37.728296 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3936a8-a61a-45be-8c6f-2fa24662dc2a admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:37.728575 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3936a8-a61a-45be-8c6f-2fa24662dc2a admin admin] PATH_INFO: `/v3/projects/1c37426b28e642aea8604c40c0b6afcf/users/c3c98764e4124ec8a07db8d3d3cce19a/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:37.743668 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1161/2314] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:14:37 2022] POST /identity/v3/users => generated 293 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:14:37.745906 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3482730a-ec68-48a5-801f-309321e6d10b None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:37.746521 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3482730a-ec68-48a5-801f-309321e6d10b None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:37.747260 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3482730a-ec68-48a5-801f-309321e6d10b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:37.768678 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3936a8-a61a-45be-8c6f-2fa24662dc2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c37426b28e642aea8604c40c0b6afcf, user_id=c3c98764e4124ec8a07db8d3d3cce19a, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:37.771455 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3936a8-a61a-45be-8c6f-2fa24662dc2a admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:37.799266 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-3482730a-ec68-48a5-801f-309321e6d10b None None] MFA Rules not processed for user `079f31ed2c844e67bd4e206f24b69d97`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:14:37.801435 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-3482730a-ec68-48a5-801f-309321e6d10b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:37.820272 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1154/2315] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:14:37 2022] PUT /identity/v3/projects/1c37426b28e642aea8604c40c0b6afcf/users/c3c98764e4124ec8a07db8d3d3cce19a/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:14:37.826711 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3936a8-a61a-45be-8c6f-2fa24662dc2a admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:37.829079 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-6e3936a8-a61a-45be-8c6f-2fa24662dc2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:37.910798 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3936a8-a61a-45be-8c6f-2fa24662dc2a admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:37.929453 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d968c4-676a-458f-a25a-354e826583ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:37.930419 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d968c4-676a-458f-a25a-354e826583ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:37.930699 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d968c4-676a-458f-a25a-354e826583ee admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:37.930974 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d968c4-676a-458f-a25a-354e826583ee admin admin] PATH_INFO: `/v3/users/925c3413d59f4b0bbb329317ea1f8a65` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:37.932257 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d968c4-676a-458f-a25a-354e826583ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=925c3413d59f4b0bbb329317ea1f8a65)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:37.942924 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d968c4-676a-458f-a25a-354e826583ee admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:37.997697 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1162/2316] 10.222.0.17 () {58 vars in 1018 bytes} [Sat Jul 23 21:14:37 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:14:37.999596 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3482730a-ec68-48a5-801f-309321e6d10b None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:38.016288 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-3482730a-ec68-48a5-801f-309321e6d10b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:38.039743 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3482730a-ec68-48a5-801f-309321e6d10b None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:38.046922 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff37b243-3dfe-4a06-8549-03f46f2dcb2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:38.048043 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff37b243-3dfe-4a06-8549-03f46f2dcb2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:38.048527 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff37b243-3dfe-4a06-8549-03f46f2dcb2a admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:38.048864 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff37b243-3dfe-4a06-8549-03f46f2dcb2a admin admin] PATH_INFO: `/v3/projects/b6a338068a454a54950f91de657e4055` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:38.050357 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff37b243-3dfe-4a06-8549-03f46f2dcb2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6a338068a454a54950f91de657e4055)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:38.052478 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff37b243-3dfe-4a06-8549-03f46f2dcb2a admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:38.053134 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-68d968c4-676a-458f-a25a-354e826583ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '925c3413d59f4b0bbb329317ea1f8a65'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:38.067474 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:38.077734 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-68d968c4-676a-458f-a25a-354e826583ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '925c3413d59f4b0bbb329317ea1f8a65'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:38.078402 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-68d968c4-676a-458f-a25a-354e826583ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '925c3413d59f4b0bbb329317ea1f8a65'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:38.097201 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-68d968c4-676a-458f-a25a-354e826583ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '925c3413d59f4b0bbb329317ea1f8a65'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:38.139155 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-68d968c4-676a-458f-a25a-354e826583ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '925c3413d59f4b0bbb329317ea1f8a65'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:38.160596 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1155/2317] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:14:37 2022] DELETE /identity/v3/users/925c3413d59f4b0bbb329317ea1f8a65 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:14:38.162045 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c3018f-247b-41ba-bb8d-0b2a7f349eb8 None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:38.162357 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c3018f-247b-41ba-bb8d-0b2a7f349eb8 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:38.162637 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c3018f-247b-41ba-bb8d-0b2a7f349eb8 None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:38.164254 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1156/2318] 10.222.0.17 () {54 vars in 921 bytes} [Sat Jul 23 21:14:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:14:38.164866 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c3018f-247b-41ba-bb8d-0b2a7f349eb8 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:38.168780 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-f3c3018f-247b-41ba-bb8d-0b2a7f349eb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:38.170780 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-ff37b243-3dfe-4a06-8549-03f46f2dcb2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6a338068a454a54950f91de657e4055', 'request_id': 'req-ff37b243-3dfe-4a06-8549-03f46f2dcb2a'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:38.183868 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-ff37b243-3dfe-4a06-8549-03f46f2dcb2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6a338068a454a54950f91de657e4055', 'request_id': 'req-ff37b243-3dfe-4a06-8549-03f46f2dcb2a'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:38.200010 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-ff37b243-3dfe-4a06-8549-03f46f2dcb2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6a338068a454a54950f91de657e4055', 'request_id': 'req-ff37b243-3dfe-4a06-8549-03f46f2dcb2a'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:38.258687 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-ff37b243-3dfe-4a06-8549-03f46f2dcb2a admin admin] The token cache is being invalidate because project b6a338068a454a54950f91de657e4055 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:14:38.258981 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-ff37b243-3dfe-4a06-8549-03f46f2dcb2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:38.262500 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-ff37b243-3dfe-4a06-8549-03f46f2dcb2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:38.268918 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1163/2319] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:14:37 2022] DELETE /identity/v3/projects/b6a338068a454a54950f91de657e4055 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:14:38.269747 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff37b243-3dfe-4a06-8549-03f46f2dcb2a admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:38.272218 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-ff37b243-3dfe-4a06-8549-03f46f2dcb2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:38.336093 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:38.386735 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c3018f-247b-41ba-bb8d-0b2a7f349eb8 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:38.392634 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2851e7-5da9-47ec-9174-1f0d62b294a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:38.393333 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2851e7-5da9-47ec-9174-1f0d62b294a0 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:38.393615 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2851e7-5da9-47ec-9174-1f0d62b294a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:38.393924 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2851e7-5da9-47ec-9174-1f0d62b294a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:38.394955 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2851e7-5da9-47ec-9174-1f0d62b294a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:38.396794 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2851e7-5da9-47ec-9174-1f0d62b294a0 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:38.415023 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1157/2320] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:14:38 2022] GET /identity/v3/roles => generated 1420 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:14:38.415023 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2851e7-5da9-47ec-9174-1f0d62b294a0 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:38.422075 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-cf2851e7-5da9-47ec-9174-1f0d62b294a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:38.438513 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff37b243-3dfe-4a06-8549-03f46f2dcb2a admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:38.444615 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f623367-fad4-49ec-aedc-66061a01fc76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:38.445728 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f623367-fad4-49ec-aedc-66061a01fc76 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:38.446051 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f623367-fad4-49ec-aedc-66061a01fc76 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:38.446331 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f623367-fad4-49ec-aedc-66061a01fc76 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:38.447080 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f623367-fad4-49ec-aedc-66061a01fc76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:38.448730 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f623367-fad4-49ec-aedc-66061a01fc76 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:38.462571 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1164/2321] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:14:38 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:14:38.464345 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17c8cc8-4b63-4212-afd9-cc8650aaefdf None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:38.464709 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17c8cc8-4b63-4212-afd9-cc8650aaefdf None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:38.465059 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17c8cc8-4b63-4212-afd9-cc8650aaefdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:38.483490 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-e17c8cc8-4b63-4212-afd9-cc8650aaefdf None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:14:38.484828 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-e17c8cc8-4b63-4212-afd9-cc8650aaefdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:38.493551 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1165/2322] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:14:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:14:38.495009 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c11eddc-2a16-424f-8c10-203958fa6516 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:38.495341 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c11eddc-2a16-424f-8c10-203958fa6516 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:38.495690 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c11eddc-2a16-424f-8c10-203958fa6516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:38.503094 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2851e7-5da9-47ec-9174-1f0d62b294a0 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:38.508248 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8aabdb2-907c-48b7-b9ae-512cd291ed5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:38.509185 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aabdb2-907c-48b7-b9ae-512cd291ed5e service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:38.509635 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aabdb2-907c-48b7-b9ae-512cd291ed5e service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:38.510233 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aabdb2-907c-48b7-b9ae-512cd291ed5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:38.513656 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-f8aabdb2-907c-48b7-b9ae-512cd291ed5e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:38.525240 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-1c11eddc-2a16-424f-8c10-203958fa6516 None None] MFA Rules not processed for user `079f31ed2c844e67bd4e206f24b69d97`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:14:38.526789 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-1c11eddc-2a16-424f-8c10-203958fa6516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:38.633636 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8aabdb2-907c-48b7-b9ae-512cd291ed5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:38.636496 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1166/2323] 10.222.0.17 () {58 vars in 1018 bytes} [Sat Jul 23 21:14:38 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:14:38.637727 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c11eddc-2a16-424f-8c10-203958fa6516 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:38.639276 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-1c11eddc-2a16-424f-8c10-203958fa6516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:38.653845 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8aabdb2-907c-48b7-b9ae-512cd291ed5e service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:38.655614 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c11eddc-2a16-424f-8c10-203958fa6516 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:38.663837 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b70d78-831f-460a-8120-b4bcff3f3ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:38.664741 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b70d78-831f-460a-8120-b4bcff3f3ce4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:38.665027 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b70d78-831f-460a-8120-b4bcff3f3ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:38.665312 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b70d78-831f-460a-8120-b4bcff3f3ce4 admin admin] PATH_INFO: `/v3/projects/d102bd5fa72d44b6aa7ae900d4e81afc` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:38.666548 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b70d78-831f-460a-8120-b4bcff3f3ce4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d102bd5fa72d44b6aa7ae900d4e81afc)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:38.668482 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b70d78-831f-460a-8120-b4bcff3f3ce4 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:38.687118 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1158/2324] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:14:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:14:38.688461 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8aabdb2-907c-48b7-b9ae-512cd291ed5e service neutron] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:38.691198 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-f8aabdb2-907c-48b7-b9ae-512cd291ed5e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:38.713583 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8aabdb2-907c-48b7-b9ae-512cd291ed5e service neutron] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:38.736471 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:38.756282 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-76b70d78-831f-460a-8120-b4bcff3f3ce4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd102bd5fa72d44b6aa7ae900d4e81afc', 'request_id': 'req-76b70d78-831f-460a-8120-b4bcff3f3ce4'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:38.767936 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-76b70d78-831f-460a-8120-b4bcff3f3ce4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd102bd5fa72d44b6aa7ae900d4e81afc', 'request_id': 'req-76b70d78-831f-460a-8120-b4bcff3f3ce4'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:38.776573 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-76b70d78-831f-460a-8120-b4bcff3f3ce4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd102bd5fa72d44b6aa7ae900d4e81afc', 'request_id': 'req-76b70d78-831f-460a-8120-b4bcff3f3ce4'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:38.793701 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-76b70d78-831f-460a-8120-b4bcff3f3ce4 admin admin] The token cache is being invalidate because project d102bd5fa72d44b6aa7ae900d4e81afc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:14:38.794094 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-76b70d78-831f-460a-8120-b4bcff3f3ce4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:38.795175 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-76b70d78-831f-460a-8120-b4bcff3f3ce4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:38.797896 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1167/2325] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:14:38 2022] DELETE /identity/v3/projects/d102bd5fa72d44b6aa7ae900d4e81afc => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:14:38.798993 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b70d78-831f-460a-8120-b4bcff3f3ce4 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:38.800374 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-76b70d78-831f-460a-8120-b4bcff3f3ce4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:38.858016 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:38.888491 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac6b0bb-a82f-4f42-a893-eb700825e38f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:38.889413 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac6b0bb-a82f-4f42-a893-eb700825e38f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:38.889697 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac6b0bb-a82f-4f42-a893-eb700825e38f admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:38.889997 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac6b0bb-a82f-4f42-a893-eb700825e38f admin admin] PATH_INFO: `/v3/users/571926481b2e4356b96ad7a334c59aea` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:38.896797 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac6b0bb-a82f-4f42-a893-eb700825e38f admin admin] RBAC: Authorizing `identity:delete_user(user_id=571926481b2e4356b96ad7a334c59aea)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:38.898832 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac6b0bb-a82f-4f42-a893-eb700825e38f admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:38.915740 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b70d78-831f-460a-8120-b4bcff3f3ce4 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:38.923490 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea94b7e-d2cd-4792-b1fb-3542a9bb0bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:38.924203 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea94b7e-d2cd-4792-b1fb-3542a9bb0bdc admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:38.924673 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea94b7e-d2cd-4792-b1fb-3542a9bb0bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:38.924959 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea94b7e-d2cd-4792-b1fb-3542a9bb0bdc admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:38.925781 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea94b7e-d2cd-4792-b1fb-3542a9bb0bdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:38.927491 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea94b7e-d2cd-4792-b1fb-3542a9bb0bdc admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:38.943237 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1168/2326] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:14:38 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:14:38.944577 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea94b7e-d2cd-4792-b1fb-3542a9bb0bdc admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:38.946507 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-7ea94b7e-d2cd-4792-b1fb-3542a9bb0bdc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:38.963129 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea94b7e-d2cd-4792-b1fb-3542a9bb0bdc admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:38.968699 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d99166a-430e-46bb-9958-bf931b50cdee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:38.969764 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d99166a-430e-46bb-9958-bf931b50cdee admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:38.970102 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d99166a-430e-46bb-9958-bf931b50cdee admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:38.970552 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d99166a-430e-46bb-9958-bf931b50cdee admin admin] PATH_INFO: `/v3/projects/1c37426b28e642aea8604c40c0b6afcf/users/c3c98764e4124ec8a07db8d3d3cce19a/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:38.972759 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d99166a-430e-46bb-9958-bf931b50cdee admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c37426b28e642aea8604c40c0b6afcf, user_id=c3c98764e4124ec8a07db8d3d3cce19a, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:38.976161 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d99166a-430e-46bb-9958-bf931b50cdee admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:38.995505 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1169/2327] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:14:38 2022] PUT /identity/v3/projects/1c37426b28e642aea8604c40c0b6afcf/users/c3c98764e4124ec8a07db8d3d3cce19a/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:14:38.995505 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d99166a-430e-46bb-9958-bf931b50cdee admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:38.995505 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-3d99166a-430e-46bb-9958-bf931b50cdee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:39.047427 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-eac6b0bb-a82f-4f42-a893-eb700825e38f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '571926481b2e4356b96ad7a334c59aea'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:39.066568 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-eac6b0bb-a82f-4f42-a893-eb700825e38f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '571926481b2e4356b96ad7a334c59aea'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:39.067348 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-eac6b0bb-a82f-4f42-a893-eb700825e38f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '571926481b2e4356b96ad7a334c59aea'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:39.091587 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-eac6b0bb-a82f-4f42-a893-eb700825e38f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '571926481b2e4356b96ad7a334c59aea'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:39.104812 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d99166a-430e-46bb-9958-bf931b50cdee admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:39.115647 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab34329-199a-4c00-8b26-479cc9e3c291 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:39.116361 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab34329-199a-4c00-8b26-479cc9e3c291 service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:39.116648 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab34329-199a-4c00-8b26-479cc9e3c291 service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:39.116920 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab34329-199a-4c00-8b26-479cc9e3c291 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:39.123296 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-eac6b0bb-a82f-4f42-a893-eb700825e38f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '571926481b2e4356b96ad7a334c59aea'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:39.124117 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-8ab34329-199a-4c00-8b26-479cc9e3c291 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:39.135164 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1159/2328] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:14:38 2022] DELETE /identity/v3/users/571926481b2e4356b96ad7a334c59aea => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:14:39.136179 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac6b0bb-a82f-4f42-a893-eb700825e38f admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:39.143079 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-eac6b0bb-a82f-4f42-a893-eb700825e38f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:39.285467 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab34329-199a-4c00-8b26-479cc9e3c291 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:39.287281 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab34329-199a-4c00-8b26-479cc9e3c291 service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:39.292743 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac6b0bb-a82f-4f42-a893-eb700825e38f admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:39.307967 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a519a41-f6cf-4af9-a2c7-b2f4c73816a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:39.309477 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a519a41-f6cf-4af9-a2c7-b2f4c73816a8 service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:39.310021 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a519a41-f6cf-4af9-a2c7-b2f4c73816a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:39.310837 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a519a41-f6cf-4af9-a2c7-b2f4c73816a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:39.320969 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1170/2329] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:14:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:14:39.322548 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-0a519a41-f6cf-4af9-a2c7-b2f4c73816a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:39.324172 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b58121-7d1d-4b55-af72-22705b6a8368 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:39.324465 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b58121-7d1d-4b55-af72-22705b6a8368 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:39.324736 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b58121-7d1d-4b55-af72-22705b6a8368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:39.389326 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-63b58121-7d1d-4b55-af72-22705b6a8368 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:14:39.394430 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-63b58121-7d1d-4b55-af72-22705b6a8368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:39.500313 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:39.525753 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:39.551791 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1171/2330] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:14:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:14:39.553682 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b58121-7d1d-4b55-af72-22705b6a8368 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:39.560037 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-63b58121-7d1d-4b55-af72-22705b6a8368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:39.597913 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b58121-7d1d-4b55-af72-22705b6a8368 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:39.621764 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b83cbc0-d35e-4df4-9088-89df978893db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:39.624359 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b83cbc0-d35e-4df4-9088-89df978893db admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:39.624920 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b83cbc0-d35e-4df4-9088-89df978893db admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:39.625439 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b83cbc0-d35e-4df4-9088-89df978893db admin admin] PATH_INFO: `/v3/projects/3e3af81d641e413aa3961a777e60a135/users/d06df3ff09be42ae9b7f09221357f683/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:39.636889 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a519a41-f6cf-4af9-a2c7-b2f4c73816a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:39.643389 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a519a41-f6cf-4af9-a2c7-b2f4c73816a8 service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:39.673714 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b83cbc0-d35e-4df4-9088-89df978893db admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e3af81d641e413aa3961a777e60a135, user_id=d06df3ff09be42ae9b7f09221357f683, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:39.677923 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b83cbc0-d35e-4df4-9088-89df978893db admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:39.690932 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1160/2331] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:14:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 555 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:14:39.693401 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da95be8-6aa0-44eb-a0ba-24422583b14a None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:39.694881 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da95be8-6aa0-44eb-a0ba-24422583b14a None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:39.695181 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da95be8-6aa0-44eb-a0ba-24422583b14a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:39.709878 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1172/2332] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:14:39 2022] PUT /identity/v3/projects/3e3af81d641e413aa3961a777e60a135/users/d06df3ff09be42ae9b7f09221357f683/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:14:39.721183 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f6323a-b5f4-42f2-84fa-2e653196a5d2 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:39.721732 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f6323a-b5f4-42f2-84fa-2e653196a5d2 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:39.722199 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f6323a-b5f4-42f2-84fa-2e653196a5d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:39.739831 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-7da95be8-6aa0-44eb-a0ba-24422583b14a None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:14:39.741323 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-7da95be8-6aa0-44eb-a0ba-24422583b14a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:39.788174 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-17f6323a-b5f4-42f2-84fa-2e653196a5d2 None None] MFA Rules not processed for user `d06df3ff09be42ae9b7f09221357f683`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:14:39.790892 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-17f6323a-b5f4-42f2-84fa-2e653196a5d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:39.911082 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1161/2333] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:14:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:14:39.918218 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da95be8-6aa0-44eb-a0ba-24422583b14a None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:39.937351 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da95be8-6aa0-44eb-a0ba-24422583b14a None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:39.950562 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1846d6c-2e59-4a21-b271-27df54043e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:39.953334 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1846d6c-2e59-4a21-b271-27df54043e97 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:39.954702 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1846d6c-2e59-4a21-b271-27df54043e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:39.955507 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1846d6c-2e59-4a21-b271-27df54043e97 admin admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:39.958273 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1846d6c-2e59-4a21-b271-27df54043e97 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:14:39.959124 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1846d6c-2e59-4a21-b271-27df54043e97 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:39.964071 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1846d6c-2e59-4a21-b271-27df54043e97 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:40.005807 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1162/2334] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:14:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 21:14:40.010235 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3b1394-ba86-44c5-b2da-16fb3dbec84a None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:40.010539 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3b1394-ba86-44c5-b2da-16fb3dbec84a None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:40.011806 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3b1394-ba86-44c5-b2da-16fb3dbec84a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:40.014621 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1173/2335] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:14:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:14:40.016091 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f6323a-b5f4-42f2-84fa-2e653196a5d2 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:40.029599 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f6323a-b5f4-42f2-84fa-2e653196a5d2 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:40.035421 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c4872c-1666-4555-a579-78b9bd21a2f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:40.036967 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c4872c-1666-4555-a579-78b9bd21a2f0 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:40.037325 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c4872c-1666-4555-a579-78b9bd21a2f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:40.037719 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c4872c-1666-4555-a579-78b9bd21a2f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:40.038596 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c4872c-1666-4555-a579-78b9bd21a2f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:40.040954 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c4872c-1666-4555-a579-78b9bd21a2f0 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:40.058553 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-ac3b1394-ba86-44c5-b2da-16fb3dbec84a None None] MFA Rules not processed for user `c497326ee890462e8f48b4a56f81990c`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:14:40.059919 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-ac3b1394-ba86-44c5-b2da-16fb3dbec84a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:40.101334 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1174/2336] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:14:40 2022] POST /identity/v3/projects => generated 407 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:14:40.101713 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c4872c-1666-4555-a579-78b9bd21a2f0 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:40.210348 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1163/2337] 10.222.0.17 () {58 vars in 1018 bytes} [Sat Jul 23 21:14:40 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:14:40.212031 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3b1394-ba86-44c5-b2da-16fb3dbec84a None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:40.228235 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3b1394-ba86-44c5-b2da-16fb3dbec84a None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:40.298196 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c4872c-1666-4555-a579-78b9bd21a2f0 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:40.312107 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f473920-7a90-4b91-8cb3-1afc6c66a7de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:40.314964 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f473920-7a90-4b91-8cb3-1afc6c66a7de admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:40.315249 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f473920-7a90-4b91-8cb3-1afc6c66a7de admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:40.315521 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f473920-7a90-4b91-8cb3-1afc6c66a7de admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:40.318630 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f473920-7a90-4b91-8cb3-1afc6c66a7de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:40.319584 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbed08f-b95b-498c-8c1c-e472f6c67929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:40.323620 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbed08f-b95b-498c-8c1c-e472f6c67929 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:40.324048 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f473920-7a90-4b91-8cb3-1afc6c66a7de admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:40.324272 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbed08f-b95b-498c-8c1c-e472f6c67929 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:40.324695 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbed08f-b95b-498c-8c1c-e472f6c67929 admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:40.326907 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbed08f-b95b-498c-8c1c-e472f6c67929 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:40.334393 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbed08f-b95b-498c-8c1c-e472f6c67929 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:40.382939 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:40.390167 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1175/2338] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:14:40 2022] POST /identity/v3/projects => generated 385 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:14:40.391345 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f473920-7a90-4b91-8cb3-1afc6c66a7de admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:40.433818 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1164/2339] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:14:40 2022] POST /identity/v3/users => generated 304 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:14:40.434802 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbed08f-b95b-498c-8c1c-e472f6c67929 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:40.467829 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:40.469731 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbed08f-b95b-498c-8c1c-e472f6c67929 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:40.531826 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f473920-7a90-4b91-8cb3-1afc6c66a7de admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:40.540705 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50644f74-b307-498b-ac62-42b220c11eb1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:40.541801 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50644f74-b307-498b-ac62-42b220c11eb1 service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:40.542371 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50644f74-b307-498b-ac62-42b220c11eb1 service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:40.542900 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50644f74-b307-498b-ac62-42b220c11eb1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:40.557267 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50644f74-b307-498b-ac62-42b220c11eb1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:40.559124 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50644f74-b307-498b-ac62-42b220c11eb1 service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:40.597936 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1176/2340] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:14:40 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:14:40.599210 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50644f74-b307-498b-ac62-42b220c11eb1 service neutron] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:40.635753 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d9bed2-61d4-4edd-8a08-330f94e39a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:40.637014 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d9bed2-61d4-4edd-8a08-330f94e39a7e admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:40.638043 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d9bed2-61d4-4edd-8a08-330f94e39a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:40.640034 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d9bed2-61d4-4edd-8a08-330f94e39a7e admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:40.640819 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d9bed2-61d4-4edd-8a08-330f94e39a7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:40.644272 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d9bed2-61d4-4edd-8a08-330f94e39a7e admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:40.689966 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1165/2341] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:14:40 2022] POST /identity/v3/users => generated 299 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:14:40.692838 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d9bed2-61d4-4edd-8a08-330f94e39a7e admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:40.719160 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d9bed2-61d4-4edd-8a08-330f94e39a7e admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:40.726193 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8fc66f-a701-4571-bc3e-9fe7abfa4a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:40.727431 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8fc66f-a701-4571-bc3e-9fe7abfa4a4a admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:40.727860 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8fc66f-a701-4571-bc3e-9fe7abfa4a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:40.728406 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8fc66f-a701-4571-bc3e-9fe7abfa4a4a admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:40.729315 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8fc66f-a701-4571-bc3e-9fe7abfa4a4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:40.731499 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8fc66f-a701-4571-bc3e-9fe7abfa4a4a admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:40.756945 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1166/2342] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:14:40 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:14:40.761228 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8fc66f-a701-4571-bc3e-9fe7abfa4a4a admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:40.763679 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50644f74-b307-498b-ac62-42b220c11eb1 service neutron] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:40.771391 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8744262-abb2-473c-a773-ffe2b266f42e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:40.773535 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8744262-abb2-473c-a773-ffe2b266f42e admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:40.774023 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8744262-abb2-473c-a773-ffe2b266f42e admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:40.774396 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8744262-abb2-473c-a773-ffe2b266f42e admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:40.776104 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8744262-abb2-473c-a773-ffe2b266f42e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:40.779782 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8744262-abb2-473c-a773-ffe2b266f42e admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:40.783438 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8fc66f-a701-4571-bc3e-9fe7abfa4a4a admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:40.790933 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48201b65-b280-4c94-8ddc-90986ed41cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:40.801893 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1177/2343] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:14:40 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:14:40.801893 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8744262-abb2-473c-a773-ffe2b266f42e admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:40.805247 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-f8744262-abb2-473c-a773-ffe2b266f42e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:40.807474 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48201b65-b280-4c94-8ddc-90986ed41cfd admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:40.810345 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48201b65-b280-4c94-8ddc-90986ed41cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:40.812620 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48201b65-b280-4c94-8ddc-90986ed41cfd admin admin] PATH_INFO: `/v3/projects/a1c7e25a7a2448428a44fa16244dc362/users/4185a7e552ca46f1babea25c6fce74bd/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:40.842611 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48201b65-b280-4c94-8ddc-90986ed41cfd admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1c7e25a7a2448428a44fa16244dc362, user_id=4185a7e552ca46f1babea25c6fce74bd, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:40.845999 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8744262-abb2-473c-a773-ffe2b266f42e admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:40.846726 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48201b65-b280-4c94-8ddc-90986ed41cfd admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:40.856389 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbe9ee2-7d11-4891-b407-ef5a830a7af7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:40.857163 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbe9ee2-7d11-4891-b407-ef5a830a7af7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:40.857749 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbe9ee2-7d11-4891-b407-ef5a830a7af7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:40.857892 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbe9ee2-7d11-4891-b407-ef5a830a7af7 admin admin] PATH_INFO: `/v3/projects/2e7a45a3f74d4fa5adc7f980e023e268` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:40.861295 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbe9ee2-7d11-4891-b407-ef5a830a7af7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e7a45a3f74d4fa5adc7f980e023e268)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:40.864377 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbe9ee2-7d11-4891-b407-ef5a830a7af7 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:40.868519 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1167/2344] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:14:40 2022] PUT /identity/v3/projects/a1c7e25a7a2448428a44fa16244dc362/users/4185a7e552ca46f1babea25c6fce74bd/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:14:40.869712 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48201b65-b280-4c94-8ddc-90986ed41cfd admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:41.002526 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48201b65-b280-4c94-8ddc-90986ed41cfd admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:41.024874 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-4dbe9ee2-7d11-4891-b407-ef5a830a7af7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e7a45a3f74d4fa5adc7f980e023e268', 'request_id': 'req-4dbe9ee2-7d11-4891-b407-ef5a830a7af7'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:41.051137 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-4dbe9ee2-7d11-4891-b407-ef5a830a7af7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e7a45a3f74d4fa5adc7f980e023e268', 'request_id': 'req-4dbe9ee2-7d11-4891-b407-ef5a830a7af7'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:41.061298 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-4dbe9ee2-7d11-4891-b407-ef5a830a7af7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e7a45a3f74d4fa5adc7f980e023e268', 'request_id': 'req-4dbe9ee2-7d11-4891-b407-ef5a830a7af7'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:41.095353 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-4dbe9ee2-7d11-4891-b407-ef5a830a7af7 admin admin] The token cache is being invalidate because project 2e7a45a3f74d4fa5adc7f980e023e268 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:14:41.095707 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-4dbe9ee2-7d11-4891-b407-ef5a830a7af7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:41.102362 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-4dbe9ee2-7d11-4891-b407-ef5a830a7af7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:41.112344 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:41.115191 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1178/2345] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:14:40 2022] DELETE /identity/v3/projects/2e7a45a3f74d4fa5adc7f980e023e268 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:14:41.115437 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbe9ee2-7d11-4891-b407-ef5a830a7af7 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:41.118578 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-4dbe9ee2-7d11-4891-b407-ef5a830a7af7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:41.122543 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f641fe-a7e1-4e47-b88c-3c0a55ee9163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:41.130395 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f641fe-a7e1-4e47-b88c-3c0a55ee9163 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:41.130672 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f641fe-a7e1-4e47-b88c-3c0a55ee9163 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:41.130950 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f641fe-a7e1-4e47-b88c-3c0a55ee9163 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:41.132124 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f641fe-a7e1-4e47-b88c-3c0a55ee9163 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:41.134293 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f641fe-a7e1-4e47-b88c-3c0a55ee9163 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:41.150693 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1168/2346] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:14:40 2022] GET /identity/v3/roles => generated 1420 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:14:41.151676 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f641fe-a7e1-4e47-b88c-3c0a55ee9163 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:41.153735 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-21f641fe-a7e1-4e47-b88c-3c0a55ee9163 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:41.167056 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbe9ee2-7d11-4891-b407-ef5a830a7af7 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:41.170200 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f641fe-a7e1-4e47-b88c-3c0a55ee9163 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:41.176191 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488ca23e-6e6b-4906-bc8b-42b088220309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:41.177305 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488ca23e-6e6b-4906-bc8b-42b088220309 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:41.177585 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488ca23e-6e6b-4906-bc8b-42b088220309 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:41.184705 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488ca23e-6e6b-4906-bc8b-42b088220309 admin admin] PATH_INFO: `/v3/projects/fa284ec485b94303a8c7e3387e31dc63` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:41.186365 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488ca23e-6e6b-4906-bc8b-42b088220309 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa284ec485b94303a8c7e3387e31dc63)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:41.189458 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488ca23e-6e6b-4906-bc8b-42b088220309 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:41.194792 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6e3e54-8b2a-43fb-919f-b2115fde1860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:41.196934 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6e3e54-8b2a-43fb-919f-b2115fde1860 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:41.198040 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6e3e54-8b2a-43fb-919f-b2115fde1860 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:41.199274 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6e3e54-8b2a-43fb-919f-b2115fde1860 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:41.200578 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6e3e54-8b2a-43fb-919f-b2115fde1860 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:41.203373 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6e3e54-8b2a-43fb-919f-b2115fde1860 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:41.236298 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1179/2347] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:14:41 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:14:41.238634 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4335a7-dae0-4569-94c0-26f2956abc66 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:41.240716 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4335a7-dae0-4569-94c0-26f2956abc66 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:41.241480 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4335a7-dae0-4569-94c0-26f2956abc66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:41.292628 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-4b4335a7-dae0-4569-94c0-26f2956abc66 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:14:41.294288 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-4b4335a7-dae0-4569-94c0-26f2956abc66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:41.295482 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-488ca23e-6e6b-4906-bc8b-42b088220309 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa284ec485b94303a8c7e3387e31dc63', 'request_id': 'req-488ca23e-6e6b-4906-bc8b-42b088220309'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:41.312811 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-488ca23e-6e6b-4906-bc8b-42b088220309 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa284ec485b94303a8c7e3387e31dc63', 'request_id': 'req-488ca23e-6e6b-4906-bc8b-42b088220309'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:41.319699 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-488ca23e-6e6b-4906-bc8b-42b088220309 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa284ec485b94303a8c7e3387e31dc63', 'request_id': 'req-488ca23e-6e6b-4906-bc8b-42b088220309'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:41.348398 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-488ca23e-6e6b-4906-bc8b-42b088220309 admin admin] The token cache is being invalidate because project fa284ec485b94303a8c7e3387e31dc63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:14:41.348758 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-488ca23e-6e6b-4906-bc8b-42b088220309 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:41.349355 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-488ca23e-6e6b-4906-bc8b-42b088220309 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:41.351269 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1169/2348] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:14:41 2022] DELETE /identity/v3/projects/fa284ec485b94303a8c7e3387e31dc63 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:14:41.354793 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488ca23e-6e6b-4906-bc8b-42b088220309 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:41.363021 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-488ca23e-6e6b-4906-bc8b-42b088220309 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:41.382811 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:41.478059 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1180/2349] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:14:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:14:41.479513 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4335a7-dae0-4569-94c0-26f2956abc66 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:41.481910 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-4b4335a7-dae0-4569-94c0-26f2956abc66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:41.497819 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4335a7-dae0-4569-94c0-26f2956abc66 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:41.505318 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509c7a7e-2d17-455c-bdaf-077be18c487c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:41.521026 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509c7a7e-2d17-455c-bdaf-077be18c487c admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:41.521316 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509c7a7e-2d17-455c-bdaf-077be18c487c admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:41.522332 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509c7a7e-2d17-455c-bdaf-077be18c487c admin admin] PATH_INFO: `/v3/projects/a1c7e25a7a2448428a44fa16244dc362/users/4185a7e552ca46f1babea25c6fce74bd/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:41.527154 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509c7a7e-2d17-455c-bdaf-077be18c487c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1c7e25a7a2448428a44fa16244dc362, user_id=4185a7e552ca46f1babea25c6fce74bd, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:41.529671 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509c7a7e-2d17-455c-bdaf-077be18c487c admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:41.558063 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488ca23e-6e6b-4906-bc8b-42b088220309 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:41.564553 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1181/2350] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:14:41 2022] PUT /identity/v3/projects/a1c7e25a7a2448428a44fa16244dc362/users/4185a7e552ca46f1babea25c6fce74bd/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:14:41.566876 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509c7a7e-2d17-455c-bdaf-077be18c487c admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:41.569973 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-509c7a7e-2d17-455c-bdaf-077be18c487c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:41.701496 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d6c11b-cb25-42b7-a8c4-c2592603d3c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:41.702545 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d6c11b-cb25-42b7-a8c4-c2592603d3c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:41.702827 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d6c11b-cb25-42b7-a8c4-c2592603d3c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:41.703096 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d6c11b-cb25-42b7-a8c4-c2592603d3c2 admin admin] PATH_INFO: `/v3/projects/da863c9f73e24dff833292927f4b9655/users/452bc7a6c73644cb97098702f6ebb5e4/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:41.717311 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509c7a7e-2d17-455c-bdaf-077be18c487c admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:41.726673 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aec39a3-ac04-4020-b311-b28b08fcbed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:41.727591 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aec39a3-ac04-4020-b311-b28b08fcbed2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:41.727869 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aec39a3-ac04-4020-b311-b28b08fcbed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:41.728145 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aec39a3-ac04-4020-b311-b28b08fcbed2 admin admin] PATH_INFO: `/v3/users/9cc2753d5f8c4a3481d35781da5b97c5` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:41.729649 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aec39a3-ac04-4020-b311-b28b08fcbed2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9cc2753d5f8c4a3481d35781da5b97c5)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:41.731888 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aec39a3-ac04-4020-b311-b28b08fcbed2 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:41.739871 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d6c11b-cb25-42b7-a8c4-c2592603d3c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da863c9f73e24dff833292927f4b9655, user_id=452bc7a6c73644cb97098702f6ebb5e4, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:41.742728 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d6c11b-cb25-42b7-a8c4-c2592603d3c2 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:41.777760 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1170/2351] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:14:41 2022] PUT /identity/v3/projects/da863c9f73e24dff833292927f4b9655/users/452bc7a6c73644cb97098702f6ebb5e4/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:14:41.779142 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea220703-d998-4f29-b96f-a247fc8c1bd1 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:41.779426 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea220703-d998-4f29-b96f-a247fc8c1bd1 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:41.779699 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea220703-d998-4f29-b96f-a247fc8c1bd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:41.805828 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:41.818758 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-ea220703-d998-4f29-b96f-a247fc8c1bd1 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:14:41.820354 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-ea220703-d998-4f29-b96f-a247fc8c1bd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:41.896334 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-4aec39a3-ac04-4020-b311-b28b08fcbed2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9cc2753d5f8c4a3481d35781da5b97c5'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:41.898240 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-4aec39a3-ac04-4020-b311-b28b08fcbed2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9cc2753d5f8c4a3481d35781da5b97c5'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:41.927426 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-4aec39a3-ac04-4020-b311-b28b08fcbed2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9cc2753d5f8c4a3481d35781da5b97c5'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:41.950479 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-4aec39a3-ac04-4020-b311-b28b08fcbed2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9cc2753d5f8c4a3481d35781da5b97c5'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:41.983977 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-4aec39a3-ac04-4020-b311-b28b08fcbed2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9cc2753d5f8c4a3481d35781da5b97c5'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:42.003037 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1182/2352] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:14:41 2022] DELETE /identity/v3/users/9cc2753d5f8c4a3481d35781da5b97c5 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:14:42.006774 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7255eb01-3b1a-46e9-bb9e-bcead74994a2 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:42.008368 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7255eb01-3b1a-46e9-bb9e-bcead74994a2 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:42.009523 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7255eb01-3b1a-46e9-bb9e-bcead74994a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:42.033124 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1171/2353] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:14:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:14:42.036652 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14aba80-3fbc-482a-8b2e-47fdb4dc0804 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:42.037299 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14aba80-3fbc-482a-8b2e-47fdb4dc0804 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:42.038967 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14aba80-3fbc-482a-8b2e-47fdb4dc0804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:42.084659 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-7255eb01-3b1a-46e9-bb9e-bcead74994a2 None None] MFA Rules not processed for user `4185a7e552ca46f1babea25c6fce74bd`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:14:42.092684 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-7255eb01-3b1a-46e9-bb9e-bcead74994a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:42.115232 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-f14aba80-3fbc-482a-8b2e-47fdb4dc0804 None None] MFA Rules not processed for user `452bc7a6c73644cb97098702f6ebb5e4`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:14:42.117557 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-f14aba80-3fbc-482a-8b2e-47fdb4dc0804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:42.171302 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:42.281901 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1183/2354] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:14:42 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:14:42.283707 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7255eb01-3b1a-46e9-bb9e-bcead74994a2 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:42.309228 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1172/2355] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:14:42 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:14:42.312997 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14aba80-3fbc-482a-8b2e-47fdb4dc0804 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:42.316648 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-f14aba80-3fbc-482a-8b2e-47fdb4dc0804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:42.548732 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14aba80-3fbc-482a-8b2e-47fdb4dc0804 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:42.565282 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcb6515-9217-4cb4-9cdd-3089b7ca03e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:42.566465 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcb6515-9217-4cb4-9cdd-3089b7ca03e6 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:42.566809 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcb6515-9217-4cb4-9cdd-3089b7ca03e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:42.567867 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcb6515-9217-4cb4-9cdd-3089b7ca03e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:42.569499 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcb6515-9217-4cb4-9cdd-3089b7ca03e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:42.573319 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcb6515-9217-4cb4-9cdd-3089b7ca03e6 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:42.589436 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7255eb01-3b1a-46e9-bb9e-bcead74994a2 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:42.598935 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7d8124-bc1b-457c-b6f5-25488bbc30ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:42.600012 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7d8124-bc1b-457c-b6f5-25488bbc30ee admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:42.600296 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7d8124-bc1b-457c-b6f5-25488bbc30ee admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:42.600518 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7d8124-bc1b-457c-b6f5-25488bbc30ee admin admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:42.601260 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7d8124-bc1b-457c-b6f5-25488bbc30ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:14:42.601585 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7d8124-bc1b-457c-b6f5-25488bbc30ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:42.606371 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7d8124-bc1b-457c-b6f5-25488bbc30ee admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:42.633257 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1184/2356] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:14:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:14:42.635264 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7d8124-bc1b-457c-b6f5-25488bbc30ee admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:42.641197 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-5d7d8124-bc1b-457c-b6f5-25488bbc30ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:42.643865 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1173/2357] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:14:42 2022] POST /identity/v3/projects => generated 409 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:14:42.644987 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcb6515-9217-4cb4-9cdd-3089b7ca03e6 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:42.725304 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:42.848998 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcb6515-9217-4cb4-9cdd-3089b7ca03e6 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:42.877346 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71abfe61-d6a1-47bc-9ac9-d974d6c2e394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:42.878283 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71abfe61-d6a1-47bc-9ac9-d974d6c2e394 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:42.878701 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71abfe61-d6a1-47bc-9ac9-d974d6c2e394 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:42.879112 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71abfe61-d6a1-47bc-9ac9-d974d6c2e394 admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:42.879955 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71abfe61-d6a1-47bc-9ac9-d974d6c2e394 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:42.885582 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71abfe61-d6a1-47bc-9ac9-d974d6c2e394 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:42.893065 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7d8124-bc1b-457c-b6f5-25488bbc30ee admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:42.960673 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1174/2358] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:14:42 2022] POST /identity/v3/projects => generated 377 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:14:42.964561 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71abfe61-d6a1-47bc-9ac9-d974d6c2e394 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:43.059456 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:43.088530 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dc70c2-ddcb-43e9-ae35-9628550f1ddf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:43.089452 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dc70c2-ddcb-43e9-ae35-9628550f1ddf service nova] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:43.089723 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dc70c2-ddcb-43e9-ae35-9628550f1ddf service nova] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:43.090037 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dc70c2-ddcb-43e9-ae35-9628550f1ddf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:43.149789 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71abfe61-d6a1-47bc-9ac9-d974d6c2e394 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:43.167059 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bf53d4-772d-449e-acc3-3e8f4e714f61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:43.167895 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bf53d4-772d-449e-acc3-3e8f4e714f61 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:43.168815 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bf53d4-772d-449e-acc3-3e8f4e714f61 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:43.169109 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bf53d4-772d-449e-acc3-3e8f4e714f61 admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:43.169813 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bf53d4-772d-449e-acc3-3e8f4e714f61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:43.171939 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bf53d4-772d-449e-acc3-3e8f4e714f61 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:43.237912 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1175/2359] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:14:42 2022] POST /identity/v3/users => generated 311 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:14:43.239246 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bf53d4-772d-449e-acc3-3e8f4e714f61 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:43.246945 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dc70c2-ddcb-43e9-ae35-9628550f1ddf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:43.251940 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dc70c2-ddcb-43e9-ae35-9628550f1ddf service nova] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:43.259854 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bf53d4-772d-449e-acc3-3e8f4e714f61 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:43.267356 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3adbc4c-4bb3-4b03-a958-fd9dd399943d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:43.268740 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3adbc4c-4bb3-4b03-a958-fd9dd399943d admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:43.274941 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1185/2360] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:14:42 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 641 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:14:43.276360 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dc70c2-ddcb-43e9-ae35-9628550f1ddf service nova] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:43.295403 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3adbc4c-4bb3-4b03-a958-fd9dd399943d admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:43.297392 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3adbc4c-4bb3-4b03-a958-fd9dd399943d admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:43.298803 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3adbc4c-4bb3-4b03-a958-fd9dd399943d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:43.309646 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3adbc4c-4bb3-4b03-a958-fd9dd399943d admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:43.315980 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dc70c2-ddcb-43e9-ae35-9628550f1ddf service nova] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:43.326775 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8465b6a3-9e2c-4474-8e03-e8e1bd5c36df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:43.328064 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8465b6a3-9e2c-4474-8e03-e8e1bd5c36df admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:43.328557 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8465b6a3-9e2c-4474-8e03-e8e1bd5c36df admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:43.329429 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8465b6a3-9e2c-4474-8e03-e8e1bd5c36df admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:43.332494 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8465b6a3-9e2c-4474-8e03-e8e1bd5c36df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:43.340325 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8465b6a3-9e2c-4474-8e03-e8e1bd5c36df admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:43.374225 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1186/2361] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:14:43 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:14:43.375480 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8465b6a3-9e2c-4474-8e03-e8e1bd5c36df admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:43.396826 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1176/2362] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:14:43 2022] POST /identity/v3/users => generated 289 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:14:43.400396 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3adbc4c-4bb3-4b03-a958-fd9dd399943d admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:43.423860 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3adbc4c-4bb3-4b03-a958-fd9dd399943d admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:43.428783 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8465b6a3-9e2c-4474-8e03-e8e1bd5c36df admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:43.441338 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159f224a-a8fb-419a-88a2-c57f24a74c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:43.442310 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159f224a-a8fb-419a-88a2-c57f24a74c9a admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:43.442592 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159f224a-a8fb-419a-88a2-c57f24a74c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:43.442860 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159f224a-a8fb-419a-88a2-c57f24a74c9a admin admin] PATH_INFO: `/v3/projects/8f31da93b863429d996bebbb56e6aa8e/users/4f4f9b0492154bdba7b9dbb90bf5064d/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:43.444505 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d611de5-6504-46f9-a7d6-61cfa99fdb2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:43.445207 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d611de5-6504-46f9-a7d6-61cfa99fdb2e admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:43.445489 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d611de5-6504-46f9-a7d6-61cfa99fdb2e admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:43.445781 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d611de5-6504-46f9-a7d6-61cfa99fdb2e admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:43.446533 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d611de5-6504-46f9-a7d6-61cfa99fdb2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:43.448494 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d611de5-6504-46f9-a7d6-61cfa99fdb2e admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:43.472065 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1177/2363] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:14:43 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:14:43.477764 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d611de5-6504-46f9-a7d6-61cfa99fdb2e admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:43.491286 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159f224a-a8fb-419a-88a2-c57f24a74c9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f31da93b863429d996bebbb56e6aa8e, user_id=4f4f9b0492154bdba7b9dbb90bf5064d, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:43.502325 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159f224a-a8fb-419a-88a2-c57f24a74c9a admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:43.511933 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d611de5-6504-46f9-a7d6-61cfa99fdb2e admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:43.525999 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da39da3-abdb-4b8f-bdb0-26725f1c857d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:43.526819 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da39da3-abdb-4b8f-bdb0-26725f1c857d admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:43.527012 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da39da3-abdb-4b8f-bdb0-26725f1c857d admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:43.527296 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da39da3-abdb-4b8f-bdb0-26725f1c857d admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:43.530877 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da39da3-abdb-4b8f-bdb0-26725f1c857d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:43.532067 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1187/2364] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:14:43 2022] PUT /identity/v3/projects/8f31da93b863429d996bebbb56e6aa8e/users/4f4f9b0492154bdba7b9dbb90bf5064d/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:14:43.535908 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da39da3-abdb-4b8f-bdb0-26725f1c857d admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:43.538948 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159f224a-a8fb-419a-88a2-c57f24a74c9a admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:43.598209 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1178/2365] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:14:43 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:14:43.613331 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da39da3-abdb-4b8f-bdb0-26725f1c857d admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:43.646638 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da39da3-abdb-4b8f-bdb0-26725f1c857d admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:43.719548 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159f224a-a8fb-419a-88a2-c57f24a74c9a admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:43.751619 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d971c89a-8220-4385-b593-12d5d8f473fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:43.752324 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d971c89a-8220-4385-b593-12d5d8f473fc admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:43.752601 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d971c89a-8220-4385-b593-12d5d8f473fc admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:43.752866 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d971c89a-8220-4385-b593-12d5d8f473fc admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:43.753597 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d971c89a-8220-4385-b593-12d5d8f473fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:43.755261 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d971c89a-8220-4385-b593-12d5d8f473fc admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:43.794460 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:43.808877 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1188/2366] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:14:43 2022] GET /identity/v3/roles => generated 1420 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:14:43.811413 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d971c89a-8220-4385-b593-12d5d8f473fc admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:43.828213 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500f00bd-fb28-45a0-9605-7814da45d032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:43.829260 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500f00bd-fb28-45a0-9605-7814da45d032 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:43.829790 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500f00bd-fb28-45a0-9605-7814da45d032 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:43.832064 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500f00bd-fb28-45a0-9605-7814da45d032 admin admin] PATH_INFO: `/v3/projects/3dd9680491d143aba028c462f52beaa0/users/c838be8a91804574aa90e8d90df8600c/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:43.846857 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d971c89a-8220-4385-b593-12d5d8f473fc admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:43.862514 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4423ea-c229-4217-8c14-5825a896ab8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:43.863558 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4423ea-c229-4217-8c14-5825a896ab8d admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:43.863965 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4423ea-c229-4217-8c14-5825a896ab8d admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:43.868244 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4423ea-c229-4217-8c14-5825a896ab8d admin admin] PATH_INFO: `/v3/projects/8f31da93b863429d996bebbb56e6aa8e/users/4f4f9b0492154bdba7b9dbb90bf5064d/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:43.872811 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4423ea-c229-4217-8c14-5825a896ab8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f31da93b863429d996bebbb56e6aa8e, user_id=4f4f9b0492154bdba7b9dbb90bf5064d, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:43.881157 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4423ea-c229-4217-8c14-5825a896ab8d admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:43.891345 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500f00bd-fb28-45a0-9605-7814da45d032 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3dd9680491d143aba028c462f52beaa0, user_id=c838be8a91804574aa90e8d90df8600c, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:43.902025 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500f00bd-fb28-45a0-9605-7814da45d032 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:43.923607 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1189/2367] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:14:43 2022] PUT /identity/v3/projects/8f31da93b863429d996bebbb56e6aa8e/users/4f4f9b0492154bdba7b9dbb90bf5064d/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:14:43.933117 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19269032-f9bf-4815-bc72-0883b7f1e12f None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:43.933729 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19269032-f9bf-4815-bc72-0883b7f1e12f None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:43.934142 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19269032-f9bf-4815-bc72-0883b7f1e12f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:43.938592 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1179/2368] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:14:43 2022] PUT /identity/v3/projects/3dd9680491d143aba028c462f52beaa0/users/c838be8a91804574aa90e8d90df8600c/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:14:43.940359 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d070b61e-8649-4b18-a96f-b97585862407 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:43.940654 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d070b61e-8649-4b18-a96f-b97585862407 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:43.940952 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d070b61e-8649-4b18-a96f-b97585862407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:44.007444 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-d070b61e-8649-4b18-a96f-b97585862407 None None] MFA Rules not processed for user `c838be8a91804574aa90e8d90df8600c`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:14:44.009647 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-19269032-f9bf-4815-bc72-0883b7f1e12f None None] MFA Rules not processed for user `4f4f9b0492154bdba7b9dbb90bf5064d`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:14:44.013626 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-d070b61e-8649-4b18-a96f-b97585862407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:44.014752 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-19269032-f9bf-4815-bc72-0883b7f1e12f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:44.111640 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:44.196697 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1190/2369] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:14:43 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:14:44.197700 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19269032-f9bf-4815-bc72-0883b7f1e12f None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:44.199268 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-19269032-f9bf-4815-bc72-0883b7f1e12f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:44.249559 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1180/2370] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:14:43 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:14:44.251301 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d070b61e-8649-4b18-a96f-b97585862407 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:44.255984 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-d070b61e-8649-4b18-a96f-b97585862407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:44.322818 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19269032-f9bf-4815-bc72-0883b7f1e12f None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:44.327880 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca8630c-39e3-447c-a948-ce312734089c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:44.329057 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca8630c-39e3-447c-a948-ce312734089c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:44.329340 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca8630c-39e3-447c-a948-ce312734089c admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:44.329671 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca8630c-39e3-447c-a948-ce312734089c admin admin] PATH_INFO: `/v3/projects/e031fe2a65f54f1da9d17aff9c2d7b08` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:44.331773 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca8630c-39e3-447c-a948-ce312734089c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e031fe2a65f54f1da9d17aff9c2d7b08)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:44.333715 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca8630c-39e3-447c-a948-ce312734089c admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:44.409762 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-3ca8630c-39e3-447c-a948-ce312734089c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e031fe2a65f54f1da9d17aff9c2d7b08', 'request_id': 'req-3ca8630c-39e3-447c-a948-ce312734089c'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:44.424100 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-3ca8630c-39e3-447c-a948-ce312734089c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e031fe2a65f54f1da9d17aff9c2d7b08', 'request_id': 'req-3ca8630c-39e3-447c-a948-ce312734089c'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:44.425157 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d070b61e-8649-4b18-a96f-b97585862407 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:44.436351 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-3ca8630c-39e3-447c-a948-ce312734089c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e031fe2a65f54f1da9d17aff9c2d7b08', 'request_id': 'req-3ca8630c-39e3-447c-a948-ce312734089c'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:44.451793 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-3ca8630c-39e3-447c-a948-ce312734089c admin admin] The token cache is being invalidate because project e031fe2a65f54f1da9d17aff9c2d7b08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:14:44.452075 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-3ca8630c-39e3-447c-a948-ce312734089c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:44.452966 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-3ca8630c-39e3-447c-a948-ce312734089c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:44.459608 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1191/2371] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:14:44 2022] DELETE /identity/v3/projects/e031fe2a65f54f1da9d17aff9c2d7b08 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:14:44.460590 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca8630c-39e3-447c-a948-ce312734089c admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:44.462809 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-3ca8630c-39e3-447c-a948-ce312734089c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:44.556837 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c268b5fb-7342-496e-88c8-262477eb8418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:44.558107 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c268b5fb-7342-496e-88c8-262477eb8418 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:44.558285 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c268b5fb-7342-496e-88c8-262477eb8418 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:44.558622 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c268b5fb-7342-496e-88c8-262477eb8418 admin admin] PATH_INFO: `/v3/users/d06df3ff09be42ae9b7f09221357f683` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:44.562788 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c268b5fb-7342-496e-88c8-262477eb8418 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d06df3ff09be42ae9b7f09221357f683)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:44.565365 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c268b5fb-7342-496e-88c8-262477eb8418 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:44.607627 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:44.614790 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca8630c-39e3-447c-a948-ce312734089c admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:44.620568 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:44.627836 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cceac6-f08e-4bc3-8a23-559b76dcbda3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:44.628843 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cceac6-f08e-4bc3-8a23-559b76dcbda3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:44.629085 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cceac6-f08e-4bc3-8a23-559b76dcbda3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:44.629357 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cceac6-f08e-4bc3-8a23-559b76dcbda3 admin admin] PATH_INFO: `/v3/users/452bc7a6c73644cb97098702f6ebb5e4` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:44.635833 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cceac6-f08e-4bc3-8a23-559b76dcbda3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=452bc7a6c73644cb97098702f6ebb5e4)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:44.643787 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cceac6-f08e-4bc3-8a23-559b76dcbda3 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:44.677897 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-c268b5fb-7342-496e-88c8-262477eb8418 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd06df3ff09be42ae9b7f09221357f683'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:44.693765 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-c268b5fb-7342-496e-88c8-262477eb8418 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd06df3ff09be42ae9b7f09221357f683'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:44.695274 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-c268b5fb-7342-496e-88c8-262477eb8418 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd06df3ff09be42ae9b7f09221357f683'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:44.709245 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-c268b5fb-7342-496e-88c8-262477eb8418 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd06df3ff09be42ae9b7f09221357f683'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:44.750219 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-c268b5fb-7342-496e-88c8-262477eb8418 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd06df3ff09be42ae9b7f09221357f683'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:44.769244 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1181/2372] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:14:44 2022] DELETE /identity/v3/users/d06df3ff09be42ae9b7f09221357f683 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:14:44.772217 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c268b5fb-7342-496e-88c8-262477eb8418 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:44.783296 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-c268b5fb-7342-496e-88c8-262477eb8418 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:44.790614 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-08cceac6-f08e-4bc3-8a23-559b76dcbda3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '452bc7a6c73644cb97098702f6ebb5e4'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:44.791603 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-08cceac6-f08e-4bc3-8a23-559b76dcbda3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '452bc7a6c73644cb97098702f6ebb5e4'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:44.809132 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-08cceac6-f08e-4bc3-8a23-559b76dcbda3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '452bc7a6c73644cb97098702f6ebb5e4'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:44.832301 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-08cceac6-f08e-4bc3-8a23-559b76dcbda3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '452bc7a6c73644cb97098702f6ebb5e4'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:44.853495 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-08cceac6-f08e-4bc3-8a23-559b76dcbda3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '452bc7a6c73644cb97098702f6ebb5e4'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:44.869941 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1192/2373] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:14:44 2022] DELETE /identity/v3/users/452bc7a6c73644cb97098702f6ebb5e4 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:14:44.871783 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe99a168-4602-4339-bcfd-f2a6b9685f7a None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:44.872082 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe99a168-4602-4339-bcfd-f2a6b9685f7a None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:44.872365 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe99a168-4602-4339-bcfd-f2a6b9685f7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:44.939239 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-fe99a168-4602-4339-bcfd-f2a6b9685f7a None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:14:44.942842 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-fe99a168-4602-4339-bcfd-f2a6b9685f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:44.955408 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c268b5fb-7342-496e-88c8-262477eb8418 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:45.048000 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1193/2374] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:14:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:14:45.049939 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b6d688-15a1-443d-8b58-1797f8d65001 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:45.050229 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b6d688-15a1-443d-8b58-1797f8d65001 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:45.050500 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b6d688-15a1-443d-8b58-1797f8d65001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:45.079251 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-d7b6d688-15a1-443d-8b58-1797f8d65001 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:14:45.080596 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-d7b6d688-15a1-443d-8b58-1797f8d65001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:45.087579 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1326ba-0b8c-4560-98b8-a3a9cc1246a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:45.088256 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1326ba-0b8c-4560-98b8-a3a9cc1246a7 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:45.088547 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1326ba-0b8c-4560-98b8-a3a9cc1246a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:45.091798 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1326ba-0b8c-4560-98b8-a3a9cc1246a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:45.091951 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1194/2375] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:14:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:14:45.092058 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1326ba-0b8c-4560-98b8-a3a9cc1246a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:45.092153 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e036335-f4b7-4922-aa35-732a8ac0d7ef None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:45.092153 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e036335-f4b7-4922-aa35-732a8ac0d7ef None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:45.092330 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1326ba-0b8c-4560-98b8-a3a9cc1246a7 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:45.092422 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e036335-f4b7-4922-aa35-732a8ac0d7ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:45.113732 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-9e036335-f4b7-4922-aa35-732a8ac0d7ef None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:14:45.115012 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-9e036335-f4b7-4922-aa35-732a8ac0d7ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:45.130712 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1195/2376] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:14:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:14:45.132669 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c540ff32-7845-40ed-ba70-743259e6f702 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:45.133401 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c540ff32-7845-40ed-ba70-743259e6f702 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:45.141494 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c540ff32-7845-40ed-ba70-743259e6f702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:45.152360 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1182/2377] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:14:44 2022] POST /identity/v3/projects => generated 375 bytes in 382 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:14:45.153428 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1326ba-0b8c-4560-98b8-a3a9cc1246a7 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:45.161573 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-9b1326ba-0b8c-4560-98b8-a3a9cc1246a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:45.168481 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-c540ff32-7845-40ed-ba70-743259e6f702 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:14:45.170317 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-c540ff32-7845-40ed-ba70-743259e6f702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:45.211594 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:DELETE=8,keystone:SELECT=90,keystone:INSERT=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:45.265552 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1326ba-0b8c-4560-98b8-a3a9cc1246a7 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:45.271012 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4c1371-223b-4609-a00d-4789d410c6f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:45.272122 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4c1371-223b-4609-a00d-4789d410c6f9 service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:45.272411 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4c1371-223b-4609-a00d-4789d410c6f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:45.272681 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4c1371-223b-4609-a00d-4789d410c6f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:45.282001 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1196/2378] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:14:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:14:45.283649 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488f54a5-b301-4ed9-b0a0-9a34648bfc04 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:45.284032 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488f54a5-b301-4ed9-b0a0-9a34648bfc04 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:45.284401 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488f54a5-b301-4ed9-b0a0-9a34648bfc04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:45.284506 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4c1371-223b-4609-a00d-4789d410c6f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:45.285948 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4c1371-223b-4609-a00d-4789d410c6f9 service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:45.293211 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:45.301371 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1183/2379] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:14:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:14:45.302343 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4c1371-223b-4609-a00d-4789d410c6f9 service neutron] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:45.315722 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4c1371-223b-4609-a00d-4789d410c6f9 service neutron] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:45.321971 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e52833-fb09-4058-806a-d0f6db4dc309 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:45.322709 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e52833-fb09-4058-806a-d0f6db4dc309 service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:45.322989 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e52833-fb09-4058-806a-d0f6db4dc309 service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:45.323262 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e52833-fb09-4058-806a-d0f6db4dc309 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:45.337593 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e52833-fb09-4058-806a-d0f6db4dc309 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:45.339119 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e52833-fb09-4058-806a-d0f6db4dc309 service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:45.344719 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-488f54a5-b301-4ed9-b0a0-9a34648bfc04 None None] MFA Rules not processed for user `7efc45807d654f008f6dce01fd5f808d`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:14:45.347779 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-488f54a5-b301-4ed9-b0a0-9a34648bfc04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:45.353482 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1184/2380] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:14:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:14:45.354505 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e52833-fb09-4058-806a-d0f6db4dc309 service neutron] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:45.356833 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-a0e52833-fb09-4058-806a-d0f6db4dc309 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:45.377798 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e52833-fb09-4058-806a-d0f6db4dc309 service neutron] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:45.388150 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f03f0c-731d-42ad-b8ab-c6237b3c4bf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:45.389068 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f03f0c-731d-42ad-b8ab-c6237b3c4bf4 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:45.389361 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f03f0c-731d-42ad-b8ab-c6237b3c4bf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:45.389639 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f03f0c-731d-42ad-b8ab-c6237b3c4bf4 admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:45.390834 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f03f0c-731d-42ad-b8ab-c6237b3c4bf4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:45.394598 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f03f0c-731d-42ad-b8ab-c6237b3c4bf4 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:45.443684 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1185/2381] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:14:45 2022] POST /identity/v3/users => generated 294 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:14:45.444991 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f03f0c-731d-42ad-b8ab-c6237b3c4bf4 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:45.460822 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f03f0c-731d-42ad-b8ab-c6237b3c4bf4 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:45.472839 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fbe6e8-a25f-49d7-9d70-efcfc418ed6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:45.474511 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fbe6e8-a25f-49d7-9d70-efcfc418ed6e admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:45.475666 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fbe6e8-a25f-49d7-9d70-efcfc418ed6e admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:45.476468 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fbe6e8-a25f-49d7-9d70-efcfc418ed6e admin admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:45.483469 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fbe6e8-a25f-49d7-9d70-efcfc418ed6e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:14:45.484252 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fbe6e8-a25f-49d7-9d70-efcfc418ed6e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:45.493233 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1197/2382] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:14:45 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:14:45.499486 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fbe6e8-a25f-49d7-9d70-efcfc418ed6e admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:45.506343 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488f54a5-b301-4ed9-b0a0-9a34648bfc04 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:45.530966 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488f54a5-b301-4ed9-b0a0-9a34648bfc04 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:45.538355 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1186/2383] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:14:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:14:45.540066 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd0c084-8096-4db3-80e4-c1c9ddca7fe5 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:45.540358 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd0c084-8096-4db3-80e4-c1c9ddca7fe5 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:45.540689 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd0c084-8096-4db3-80e4-c1c9ddca7fe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:45.548764 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a6f3c1-8944-4244-bb5b-498c7c025e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:45.549591 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a6f3c1-8944-4244-bb5b-498c7c025e09 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:45.549916 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a6f3c1-8944-4244-bb5b-498c7c025e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:45.550309 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a6f3c1-8944-4244-bb5b-498c7c025e09 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:45.551050 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a6f3c1-8944-4244-bb5b-498c7c025e09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:45.552833 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a6f3c1-8944-4244-bb5b-498c7c025e09 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:45.568207 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1198/2384] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:14:45 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:14:45.569025 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-4cd0c084-8096-4db3-80e4-c1c9ddca7fe5 None None] MFA Rules not processed for user `3a56b82cf3954f279dd21e17a42462b3`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:14:45.569340 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a6f3c1-8944-4244-bb5b-498c7c025e09 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:45.570809 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-4cd0c084-8096-4db3-80e4-c1c9ddca7fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:45.597769 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a6f3c1-8944-4244-bb5b-498c7c025e09 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:45.612454 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d921f3a5-f91f-4437-8f95-1d3fdbd3177d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:45.613150 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d921f3a5-f91f-4437-8f95-1d3fdbd3177d admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:45.615259 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d921f3a5-f91f-4437-8f95-1d3fdbd3177d admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:45.615546 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d921f3a5-f91f-4437-8f95-1d3fdbd3177d admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:45.617530 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d921f3a5-f91f-4437-8f95-1d3fdbd3177d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:45.623891 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d921f3a5-f91f-4437-8f95-1d3fdbd3177d admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:45.680540 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1187/2385] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:14:45 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:14:45.681509 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd0c084-8096-4db3-80e4-c1c9ddca7fe5 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:45.694340 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1199/2386] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:14:45 2022] POST /identity/v3/projects => generated 385 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:14:45.695234 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d921f3a5-f91f-4437-8f95-1d3fdbd3177d admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:45.697957 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-d921f3a5-f91f-4437-8f95-1d3fdbd3177d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:45.704905 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd0c084-8096-4db3-80e4-c1c9ddca7fe5 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:45.850751 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d921f3a5-f91f-4437-8f95-1d3fdbd3177d admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:45.857600 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0776bd16-9182-45ca-82e7-6a14c7902aa9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:45.858448 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0776bd16-9182-45ca-82e7-6a14c7902aa9 service nova] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:45.858828 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0776bd16-9182-45ca-82e7-6a14c7902aa9 service nova] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:45.859199 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0776bd16-9182-45ca-82e7-6a14c7902aa9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:45.861498 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-0776bd16-9182-45ca-82e7-6a14c7902aa9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:45.942364 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b05a624-317c-47a1-a85c-ec592f8a7daa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:45.945581 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b05a624-317c-47a1-a85c-ec592f8a7daa admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:45.950267 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b05a624-317c-47a1-a85c-ec592f8a7daa admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:45.950533 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b05a624-317c-47a1-a85c-ec592f8a7daa admin admin] PATH_INFO: `/v3/projects/d0df7d6bde584592a1b92d00065cb6a9/users/20ff4b538d574a53a05b261388b614b6/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:45.963365 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:45.983350 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0776bd16-9182-45ca-82e7-6a14c7902aa9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:45.985704 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0776bd16-9182-45ca-82e7-6a14c7902aa9 service nova] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:46.002919 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b05a624-317c-47a1-a85c-ec592f8a7daa admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0df7d6bde584592a1b92d00065cb6a9, user_id=20ff4b538d574a53a05b261388b614b6, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:46.016834 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1200/2387] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:14:45 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:14:46.026322 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b05a624-317c-47a1-a85c-ec592f8a7daa admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:46.041011 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0776bd16-9182-45ca-82e7-6a14c7902aa9 service nova] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:46.082528 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1188/2388] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:14:45 2022] PUT /identity/v3/projects/d0df7d6bde584592a1b92d00065cb6a9/users/20ff4b538d574a53a05b261388b614b6/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:14:46.089469 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b05a624-317c-47a1-a85c-ec592f8a7daa admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:46.111754 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0776bd16-9182-45ca-82e7-6a14c7902aa9 service nova] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:46.137922 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:46.259430 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b05a624-317c-47a1-a85c-ec592f8a7daa admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:46.261034 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867e2ac5-f7df-4992-8b30-48372331eda6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:46.264584 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867e2ac5-f7df-4992-8b30-48372331eda6 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:46.265025 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867e2ac5-f7df-4992-8b30-48372331eda6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:46.265412 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867e2ac5-f7df-4992-8b30-48372331eda6 admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:46.266312 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867e2ac5-f7df-4992-8b30-48372331eda6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:46.266871 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4fa52d-ec6b-44a8-8d08-642e4a7f98ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:46.268010 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4fa52d-ec6b-44a8-8d08-642e4a7f98ef admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:46.268639 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4fa52d-ec6b-44a8-8d08-642e4a7f98ef admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:46.269075 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4fa52d-ec6b-44a8-8d08-642e4a7f98ef admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:46.269909 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867e2ac5-f7df-4992-8b30-48372331eda6 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:46.270204 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4fa52d-ec6b-44a8-8d08-642e4a7f98ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:46.272029 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4fa52d-ec6b-44a8-8d08-642e4a7f98ef admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:46.285626 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1189/2389] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:14:46 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 21:14:46.307387 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4fa52d-ec6b-44a8-8d08-642e4a7f98ef admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:46.323651 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1201/2390] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:14:46 2022] POST /identity/v3/users => generated 293 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:14:46.326926 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4fa52d-ec6b-44a8-8d08-642e4a7f98ef admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:46.328359 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867e2ac5-f7df-4992-8b30-48372331eda6 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:46.335783 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f280766a-fec2-40d2-8530-91d25c38799c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:46.337077 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f280766a-fec2-40d2-8530-91d25c38799c admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:46.337783 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f280766a-fec2-40d2-8530-91d25c38799c admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:46.339177 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f280766a-fec2-40d2-8530-91d25c38799c admin admin] PATH_INFO: `/v3/projects/d0df7d6bde584592a1b92d00065cb6a9/users/20ff4b538d574a53a05b261388b614b6/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:46.343841 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f280766a-fec2-40d2-8530-91d25c38799c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0df7d6bde584592a1b92d00065cb6a9, user_id=20ff4b538d574a53a05b261388b614b6, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:46.348447 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f280766a-fec2-40d2-8530-91d25c38799c admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:46.353101 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867e2ac5-f7df-4992-8b30-48372331eda6 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:46.366666 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0c8992-cf43-4774-b9b4-3604ed73ee80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:46.367459 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1190/2391] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:14:46 2022] PUT /identity/v3/projects/d0df7d6bde584592a1b92d00065cb6a9/users/20ff4b538d574a53a05b261388b614b6/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:14:46.378263 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0c8992-cf43-4774-b9b4-3604ed73ee80 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:46.378710 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0c8992-cf43-4774-b9b4-3604ed73ee80 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:46.378999 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0c8992-cf43-4774-b9b4-3604ed73ee80 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:46.379798 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0c8992-cf43-4774-b9b4-3604ed73ee80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:46.381265 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da380f0-8251-4c86-aaae-f6ec42c09be2 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:46.381490 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0c8992-cf43-4774-b9b4-3604ed73ee80 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:46.382011 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da380f0-8251-4c86-aaae-f6ec42c09be2 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:46.382805 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da380f0-8251-4c86-aaae-f6ec42c09be2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:46.411974 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1202/2392] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:14:46 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:14:46.413319 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0c8992-cf43-4774-b9b4-3604ed73ee80 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:46.426694 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0c8992-cf43-4774-b9b4-3604ed73ee80 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:46.449642 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-2da380f0-8251-4c86-aaae-f6ec42c09be2 None None] MFA Rules not processed for user `20ff4b538d574a53a05b261388b614b6`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:14:46.453638 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-2da380f0-8251-4c86-aaae-f6ec42c09be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:46.507251 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92ed43a-0ab1-47d8-8c07-16b01211792d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:46.508104 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92ed43a-0ab1-47d8-8c07-16b01211792d admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:46.508479 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92ed43a-0ab1-47d8-8c07-16b01211792d admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:46.508849 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92ed43a-0ab1-47d8-8c07-16b01211792d admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:46.510275 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92ed43a-0ab1-47d8-8c07-16b01211792d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:46.511989 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92ed43a-0ab1-47d8-8c07-16b01211792d admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:46.541918 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1203/2393] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:14:46 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:14:46.543212 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92ed43a-0ab1-47d8-8c07-16b01211792d admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:46.563404 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92ed43a-0ab1-47d8-8c07-16b01211792d admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:46.572461 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8082d1e2-0ca6-4e09-87a7-4db6d2557fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:46.574249 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8082d1e2-0ca6-4e09-87a7-4db6d2557fce admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:46.574536 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8082d1e2-0ca6-4e09-87a7-4db6d2557fce admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:46.574817 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8082d1e2-0ca6-4e09-87a7-4db6d2557fce admin admin] PATH_INFO: `/v3/projects/457d184c579a4016a0eec16eb9f23195/users/8a872dad882e4694aba20eaa8c06df53/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:46.592345 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1191/2394] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:14:46 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:14:46.611215 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8082d1e2-0ca6-4e09-87a7-4db6d2557fce admin admin] RBAC: Authorizing `identity:create_grant(project_id=457d184c579a4016a0eec16eb9f23195, user_id=8a872dad882e4694aba20eaa8c06df53, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:46.614176 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8082d1e2-0ca6-4e09-87a7-4db6d2557fce admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:46.637102 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1204/2395] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:14:46 2022] PUT /identity/v3/projects/457d184c579a4016a0eec16eb9f23195/users/8a872dad882e4694aba20eaa8c06df53/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:14:46.646628 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7610ce2a-f9f5-4ed1-9373-354505c4e491 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:46.647064 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7610ce2a-f9f5-4ed1-9373-354505c4e491 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:46.647407 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7610ce2a-f9f5-4ed1-9373-354505c4e491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:46.680772 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-7610ce2a-f9f5-4ed1-9373-354505c4e491 None None] MFA Rules not processed for user `8a872dad882e4694aba20eaa8c06df53`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:14:46.682267 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-7610ce2a-f9f5-4ed1-9373-354505c4e491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:46.696666 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8082d1e2-0ca6-4e09-87a7-4db6d2557fce admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:46.700319 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-8082d1e2-0ca6-4e09-87a7-4db6d2557fce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:46.844137 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:46.860582 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1192/2396] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:14:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:14:46.861996 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7610ce2a-f9f5-4ed1-9373-354505c4e491 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:46.864288 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-7610ce2a-f9f5-4ed1-9373-354505c4e491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:46.885786 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:46.907205 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8082d1e2-0ca6-4e09-87a7-4db6d2557fce admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:46.923197 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f905e5-d795-4444-86cd-ccddbf7e8bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:46.923470 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f905e5-d795-4444-86cd-ccddbf7e8bc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:46.923587 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f905e5-d795-4444-86cd-ccddbf7e8bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:46.924319 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f905e5-d795-4444-86cd-ccddbf7e8bc5 admin admin] PATH_INFO: `/v3/projects/da863c9f73e24dff833292927f4b9655` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:46.926451 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f905e5-d795-4444-86cd-ccddbf7e8bc5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da863c9f73e24dff833292927f4b9655)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:46.929531 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f905e5-d795-4444-86cd-ccddbf7e8bc5 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:47.023085 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-63f905e5-d795-4444-86cd-ccddbf7e8bc5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da863c9f73e24dff833292927f4b9655', 'request_id': 'req-63f905e5-d795-4444-86cd-ccddbf7e8bc5'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:47.042639 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-63f905e5-d795-4444-86cd-ccddbf7e8bc5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da863c9f73e24dff833292927f4b9655', 'request_id': 'req-63f905e5-d795-4444-86cd-ccddbf7e8bc5'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:47.055865 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-63f905e5-d795-4444-86cd-ccddbf7e8bc5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da863c9f73e24dff833292927f4b9655', 'request_id': 'req-63f905e5-d795-4444-86cd-ccddbf7e8bc5'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:47.071386 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-63f905e5-d795-4444-86cd-ccddbf7e8bc5 admin admin] The token cache is being invalidate because project da863c9f73e24dff833292927f4b9655 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:14:47.072083 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-63f905e5-d795-4444-86cd-ccddbf7e8bc5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:47.072844 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-63f905e5-d795-4444-86cd-ccddbf7e8bc5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:47.075316 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1205/2397] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:14:46 2022] DELETE /identity/v3/projects/da863c9f73e24dff833292927f4b9655 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:14:47.076204 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f905e5-d795-4444-86cd-ccddbf7e8bc5 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:47.078516 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-63f905e5-d795-4444-86cd-ccddbf7e8bc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:47.091476 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7610ce2a-f9f5-4ed1-9373-354505c4e491 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:47.203729 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8998163-e691-4bbc-80ad-eb42b3eb13c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:47.204986 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8998163-e691-4bbc-80ad-eb42b3eb13c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:47.205411 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8998163-e691-4bbc-80ad-eb42b3eb13c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:47.205839 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8998163-e691-4bbc-80ad-eb42b3eb13c0 admin admin] PATH_INFO: `/v3/projects/3e3af81d641e413aa3961a777e60a135` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:47.207249 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8998163-e691-4bbc-80ad-eb42b3eb13c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e3af81d641e413aa3961a777e60a135)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:47.209544 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8998163-e691-4bbc-80ad-eb42b3eb13c0 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:47.241480 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f905e5-d795-4444-86cd-ccddbf7e8bc5 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:47.257762 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66debbe-dc46-4311-a693-5985cb22598a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:47.259115 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66debbe-dc46-4311-a693-5985cb22598a admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:47.260459 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66debbe-dc46-4311-a693-5985cb22598a admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:47.260459 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66debbe-dc46-4311-a693-5985cb22598a admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:47.260740 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66debbe-dc46-4311-a693-5985cb22598a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:47.265453 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66debbe-dc46-4311-a693-5985cb22598a admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:47.319740 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1206/2398] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:14:47 2022] POST /identity/v3/projects => generated 387 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:14:47.321129 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66debbe-dc46-4311-a693-5985cb22598a admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:47.324829 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-b8998163-e691-4bbc-80ad-eb42b3eb13c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e3af81d641e413aa3961a777e60a135', 'request_id': 'req-b8998163-e691-4bbc-80ad-eb42b3eb13c0'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:47.327352 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-a66debbe-dc46-4311-a693-5985cb22598a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:47.340873 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-b8998163-e691-4bbc-80ad-eb42b3eb13c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e3af81d641e413aa3961a777e60a135', 'request_id': 'req-b8998163-e691-4bbc-80ad-eb42b3eb13c0'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:47.350731 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-b8998163-e691-4bbc-80ad-eb42b3eb13c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e3af81d641e413aa3961a777e60a135', 'request_id': 'req-b8998163-e691-4bbc-80ad-eb42b3eb13c0'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:47.372318 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-b8998163-e691-4bbc-80ad-eb42b3eb13c0 admin admin] The token cache is being invalidate because project 3e3af81d641e413aa3961a777e60a135 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:14:47.372672 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-b8998163-e691-4bbc-80ad-eb42b3eb13c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:47.373681 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-b8998163-e691-4bbc-80ad-eb42b3eb13c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:47.377224 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1193/2399] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:14:46 2022] DELETE /identity/v3/projects/3e3af81d641e413aa3961a777e60a135 => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:14:47.378695 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8998163-e691-4bbc-80ad-eb42b3eb13c0 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:47.381077 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-b8998163-e691-4bbc-80ad-eb42b3eb13c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:47.452430 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66debbe-dc46-4311-a693-5985cb22598a admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:47.459194 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60fec78-6374-42d9-bb0b-61d40eb8e631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:47.460447 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60fec78-6374-42d9-bb0b-61d40eb8e631 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:47.460983 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60fec78-6374-42d9-bb0b-61d40eb8e631 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:47.461287 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60fec78-6374-42d9-bb0b-61d40eb8e631 admin admin] PATH_INFO: `/v3/users/4f4f9b0492154bdba7b9dbb90bf5064d` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:47.463672 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60fec78-6374-42d9-bb0b-61d40eb8e631 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f4f9b0492154bdba7b9dbb90bf5064d)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:47.466561 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60fec78-6374-42d9-bb0b-61d40eb8e631 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:47.468658 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:47.515911 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:47.581658 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8998163-e691-4bbc-80ad-eb42b3eb13c0 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:47.595635 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-b60fec78-6374-42d9-bb0b-61d40eb8e631 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f4f9b0492154bdba7b9dbb90bf5064d'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:47.596365 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-b60fec78-6374-42d9-bb0b-61d40eb8e631 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f4f9b0492154bdba7b9dbb90bf5064d'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:47.621747 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-b60fec78-6374-42d9-bb0b-61d40eb8e631 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f4f9b0492154bdba7b9dbb90bf5064d'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:47.645010 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-b60fec78-6374-42d9-bb0b-61d40eb8e631 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f4f9b0492154bdba7b9dbb90bf5064d'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:47.680304 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-b60fec78-6374-42d9-bb0b-61d40eb8e631 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f4f9b0492154bdba7b9dbb90bf5064d'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:47.700344 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1207/2400] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:14:47 2022] DELETE /identity/v3/users/4f4f9b0492154bdba7b9dbb90bf5064d => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:14:47.703594 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60fec78-6374-42d9-bb0b-61d40eb8e631 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:47.706748 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-b60fec78-6374-42d9-bb0b-61d40eb8e631 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:47.806604 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2978d82d-e4aa-4c3e-afd7-4950b6cf92f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:47.807507 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2978d82d-e4aa-4c3e-afd7-4950b6cf92f6 service nova] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:47.807939 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2978d82d-e4aa-4c3e-afd7-4950b6cf92f6 service nova] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:47.816928 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2978d82d-e4aa-4c3e-afd7-4950b6cf92f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:47.827348 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-2978d82d-e4aa-4c3e-afd7-4950b6cf92f6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:47.940212 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60fec78-6374-42d9-bb0b-61d40eb8e631 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:47.950437 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfccd93f-d972-402d-8e4f-f4f5e19490fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:47.951007 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfccd93f-d972-402d-8e4f-f4f5e19490fa admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:47.951286 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfccd93f-d972-402d-8e4f-f4f5e19490fa admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:47.951559 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfccd93f-d972-402d-8e4f-f4f5e19490fa admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:47.952260 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfccd93f-d972-402d-8e4f-f4f5e19490fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:47.956412 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfccd93f-d972-402d-8e4f-f4f5e19490fa admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:48.015083 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1208/2401] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:14:47 2022] POST /identity/v3/users => generated 300 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:14:48.016890 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfccd93f-d972-402d-8e4f-f4f5e19490fa admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:48.021475 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-dfccd93f-d972-402d-8e4f-f4f5e19490fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:48.071176 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfccd93f-d972-402d-8e4f-f4f5e19490fa admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:48.089016 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2978d82d-e4aa-4c3e-afd7-4950b6cf92f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:48.091166 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2978d82d-e4aa-4c3e-afd7-4950b6cf92f6 service nova] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:48.102589 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d6ee13-ee10-45be-98b3-67c2864c1d61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:48.104319 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1194/2402] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:14:47 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 726 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:14:48.105415 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2978d82d-e4aa-4c3e-afd7-4950b6cf92f6 service nova] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:48.117526 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d6ee13-ee10-45be-98b3-67c2864c1d61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:48.121507 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2978d82d-e4aa-4c3e-afd7-4950b6cf92f6 service nova] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:48.126661 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d6ee13-ee10-45be-98b3-67c2864c1d61 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:48.129523 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de97d055-5183-43a7-bf1f-3660be23719e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:48.130841 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de97d055-5183-43a7-bf1f-3660be23719e admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:48.131167 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de97d055-5183-43a7-bf1f-3660be23719e admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:48.131523 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de97d055-5183-43a7-bf1f-3660be23719e admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:48.132829 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de97d055-5183-43a7-bf1f-3660be23719e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:48.133852 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d6ee13-ee10-45be-98b3-67c2864c1d61 admin admin] PATH_INFO: `/v3/users/4185a7e552ca46f1babea25c6fce74bd` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:48.135473 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de97d055-5183-43a7-bf1f-3660be23719e admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:48.146945 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d6ee13-ee10-45be-98b3-67c2864c1d61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4185a7e552ca46f1babea25c6fce74bd)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:48.149492 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d6ee13-ee10-45be-98b3-67c2864c1d61 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:48.175373 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1195/2403] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:14:48 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:14:48.176381 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de97d055-5183-43a7-bf1f-3660be23719e admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:48.204289 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de97d055-5183-43a7-bf1f-3660be23719e admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:48.218264 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802de956-ec74-4b76-8988-99cba1b79f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:48.220448 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802de956-ec74-4b76-8988-99cba1b79f24 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:48.220733 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802de956-ec74-4b76-8988-99cba1b79f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:48.223217 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802de956-ec74-4b76-8988-99cba1b79f24 admin admin] PATH_INFO: `/v3/projects/a1e5e46ae97b4f79832de640e753f8c8/users/a65178068e4e487bb27e2f152ba9b081/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:48.302346 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802de956-ec74-4b76-8988-99cba1b79f24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1e5e46ae97b4f79832de640e753f8c8, user_id=a65178068e4e487bb27e2f152ba9b081, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:48.305448 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802de956-ec74-4b76-8988-99cba1b79f24 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:48.340539 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-11d6ee13-ee10-45be-98b3-67c2864c1d61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4185a7e552ca46f1babea25c6fce74bd'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:48.342602 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-11d6ee13-ee10-45be-98b3-67c2864c1d61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4185a7e552ca46f1babea25c6fce74bd'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:48.361455 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1196/2404] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:14:48 2022] PUT /identity/v3/projects/a1e5e46ae97b4f79832de640e753f8c8/users/a65178068e4e487bb27e2f152ba9b081/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:14:48.363514 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802de956-ec74-4b76-8988-99cba1b79f24 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:48.368491 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-11d6ee13-ee10-45be-98b3-67c2864c1d61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4185a7e552ca46f1babea25c6fce74bd'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:48.393357 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-11d6ee13-ee10-45be-98b3-67c2864c1d61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4185a7e552ca46f1babea25c6fce74bd'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:48.394926 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=77,keystone:DELETE=18,keystone:INSERT=5 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:48.441539 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-11d6ee13-ee10-45be-98b3-67c2864c1d61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4185a7e552ca46f1babea25c6fce74bd'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:48.465988 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1209/2405] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:14:48 2022] DELETE /identity/v3/users/4185a7e552ca46f1babea25c6fce74bd => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:14:48.503475 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:48.532520 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802de956-ec74-4b76-8988-99cba1b79f24 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:48.667634 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e36bc3b-f857-4a6e-8568-6b9b11e36887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:48.669662 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e36bc3b-f857-4a6e-8568-6b9b11e36887 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:48.670057 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e36bc3b-f857-4a6e-8568-6b9b11e36887 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:48.671011 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e36bc3b-f857-4a6e-8568-6b9b11e36887 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:48.673160 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e36bc3b-f857-4a6e-8568-6b9b11e36887 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:48.677179 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e36bc3b-f857-4a6e-8568-6b9b11e36887 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:48.706567 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1197/2406] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:14:48 2022] GET /identity/v3/roles => generated 1420 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:14:48.707952 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d6ee13-ee10-45be-98b3-67c2864c1d61 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:48.709470 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-11d6ee13-ee10-45be-98b3-67c2864c1d61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:48.732607 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d6ee13-ee10-45be-98b3-67c2864c1d61 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:48.745904 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b88dcb-1e70-449c-9529-bcbceb605118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:48.748445 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b88dcb-1e70-449c-9529-bcbceb605118 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:48.748445 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b88dcb-1e70-449c-9529-bcbceb605118 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:48.748669 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b88dcb-1e70-449c-9529-bcbceb605118 admin admin] PATH_INFO: `/v3/projects/a1e5e46ae97b4f79832de640e753f8c8/users/a65178068e4e487bb27e2f152ba9b081/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:48.756204 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b88dcb-1e70-449c-9529-bcbceb605118 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1e5e46ae97b4f79832de640e753f8c8, user_id=a65178068e4e487bb27e2f152ba9b081, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:48.764932 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b88dcb-1e70-449c-9529-bcbceb605118 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:48.802994 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1210/2407] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:14:48 2022] PUT /identity/v3/projects/a1e5e46ae97b4f79832de640e753f8c8/users/a65178068e4e487bb27e2f152ba9b081/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:14:48.907110 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da8f56d-8070-4cde-b592-869229ae2cdd None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:48.910020 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da8f56d-8070-4cde-b592-869229ae2cdd None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:48.910469 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da8f56d-8070-4cde-b592-869229ae2cdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:49.000033 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-3da8f56d-8070-4cde-b592-869229ae2cdd None None] MFA Rules not processed for user `a65178068e4e487bb27e2f152ba9b081`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:14:49.006323 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-3da8f56d-8070-4cde-b592-869229ae2cdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:49.266394 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1198/2408] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:14:48 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 360 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:14:49.279138 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cd2fca-c9f4-4edd-aebf-62bfe62652ae None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:49.279584 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cd2fca-c9f4-4edd-aebf-62bfe62652ae None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:49.279990 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cd2fca-c9f4-4edd-aebf-62bfe62652ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:49.341442 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-d1cd2fca-c9f4-4edd-aebf-62bfe62652ae None None] MFA Rules not processed for user `8a872dad882e4694aba20eaa8c06df53`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:14:49.344828 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-d1cd2fca-c9f4-4edd-aebf-62bfe62652ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:49.506245 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1211/2409] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:14:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:14:49.518198 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da8f56d-8070-4cde-b592-869229ae2cdd None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:49.520070 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-3da8f56d-8070-4cde-b592-869229ae2cdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:49.701696 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cd2fca-c9f4-4edd-aebf-62bfe62652ae None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:49.703292 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-d1cd2fca-c9f4-4edd-aebf-62bfe62652ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:49.731523 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da8f56d-8070-4cde-b592-869229ae2cdd None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:49.743711 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6b0724-7c63-454a-876e-4a229a6e67e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:49.749752 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6b0724-7c63-454a-876e-4a229a6e67e7 service nova] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:49.752835 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6b0724-7c63-454a-876e-4a229a6e67e7 service nova] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:49.753376 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6b0724-7c63-454a-876e-4a229a6e67e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:49.757443 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-eb6b0724-7c63-454a-876e-4a229a6e67e7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:49.792866 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6b0724-7c63-454a-876e-4a229a6e67e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:49.795529 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6b0724-7c63-454a-876e-4a229a6e67e7 service nova] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:49.818381 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:49.838442 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1199/2410] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:14:49 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:14:49.839465 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6b0724-7c63-454a-876e-4a229a6e67e7 service nova] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:49.863639 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-eb6b0724-7c63-454a-876e-4a229a6e67e7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:49.952919 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cd2fca-c9f4-4edd-aebf-62bfe62652ae None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:49.964649 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418e3f6f-c26f-43bb-aa13-f8edea5839a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:49.967038 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418e3f6f-c26f-43bb-aa13-f8edea5839a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:49.968958 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418e3f6f-c26f-43bb-aa13-f8edea5839a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:49.969471 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418e3f6f-c26f-43bb-aa13-f8edea5839a3 admin admin] PATH_INFO: `/v3/users/c838be8a91804574aa90e8d90df8600c` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:49.972548 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418e3f6f-c26f-43bb-aa13-f8edea5839a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c838be8a91804574aa90e8d90df8600c)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:49.978432 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418e3f6f-c26f-43bb-aa13-f8edea5839a3 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:50.045808 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6b0724-7c63-454a-876e-4a229a6e67e7 service nova] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:50.060193 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d84180-78b6-479e-a2b6-a5acfde21158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:50.061968 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d84180-78b6-479e-a2b6-a5acfde21158 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:50.062349 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d84180-78b6-479e-a2b6-a5acfde21158 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:50.064361 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d84180-78b6-479e-a2b6-a5acfde21158 admin admin] PATH_INFO: `/v3/projects/8f31da93b863429d996bebbb56e6aa8e` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:50.065950 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d84180-78b6-479e-a2b6-a5acfde21158 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f31da93b863429d996bebbb56e6aa8e)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:50.069506 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d84180-78b6-479e-a2b6-a5acfde21158 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:50.087853 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-418e3f6f-c26f-43bb-aa13-f8edea5839a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c838be8a91804574aa90e8d90df8600c'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:50.088643 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-418e3f6f-c26f-43bb-aa13-f8edea5839a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c838be8a91804574aa90e8d90df8600c'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:50.108066 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-418e3f6f-c26f-43bb-aa13-f8edea5839a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c838be8a91804574aa90e8d90df8600c'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:50.123425 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-418e3f6f-c26f-43bb-aa13-f8edea5839a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c838be8a91804574aa90e8d90df8600c'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:50.138246 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:50.152538 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-418e3f6f-c26f-43bb-aa13-f8edea5839a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c838be8a91804574aa90e8d90df8600c'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:50.163408 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1212/2411] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:14:49 2022] DELETE /identity/v3/users/c838be8a91804574aa90e8d90df8600c => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:14:50.171381 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1346ba-3688-4362-aeda-2a2e0ae64766 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:50.172318 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1346ba-3688-4362-aeda-2a2e0ae64766 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:50.173036 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1346ba-3688-4362-aeda-2a2e0ae64766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:50.197606 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-95d84180-78b6-479e-a2b6-a5acfde21158 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f31da93b863429d996bebbb56e6aa8e', 'request_id': 'req-95d84180-78b6-479e-a2b6-a5acfde21158'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:50.199490 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-ca1346ba-3688-4362-aeda-2a2e0ae64766 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:14:50.200805 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-ca1346ba-3688-4362-aeda-2a2e0ae64766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:50.224639 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-95d84180-78b6-479e-a2b6-a5acfde21158 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f31da93b863429d996bebbb56e6aa8e', 'request_id': 'req-95d84180-78b6-479e-a2b6-a5acfde21158'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:50.249035 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-95d84180-78b6-479e-a2b6-a5acfde21158 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f31da93b863429d996bebbb56e6aa8e', 'request_id': 'req-95d84180-78b6-479e-a2b6-a5acfde21158'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:50.272272 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-95d84180-78b6-479e-a2b6-a5acfde21158 admin admin] The token cache is being invalidate because project 8f31da93b863429d996bebbb56e6aa8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:14:50.272951 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-95d84180-78b6-479e-a2b6-a5acfde21158 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:50.276200 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-95d84180-78b6-479e-a2b6-a5acfde21158 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:50.279539 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1200/2412] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:14:49 2022] DELETE /identity/v3/projects/8f31da93b863429d996bebbb56e6aa8e => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:14:50.285938 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec1c8ac-36cc-4654-9998-2af6b2199583 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:50.287044 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec1c8ac-36cc-4654-9998-2af6b2199583 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:50.288979 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec1c8ac-36cc-4654-9998-2af6b2199583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:50.327120 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1213/2413] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:14:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:14:50.330048 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-aec1c8ac-36cc-4654-9998-2af6b2199583 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:14:50.331314 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-aec1c8ac-36cc-4654-9998-2af6b2199583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:50.348539 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1201/2414] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:14:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:14:50.353036 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5b6e6e-39d2-4823-a4bb-9eb17fc76723 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:50.353915 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5b6e6e-39d2-4823-a4bb-9eb17fc76723 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:50.354485 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5b6e6e-39d2-4823-a4bb-9eb17fc76723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:50.364953 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec1c8ac-36cc-4654-9998-2af6b2199583 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:50.367405 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-aec1c8ac-36cc-4654-9998-2af6b2199583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:50.398860 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-7e5b6e6e-39d2-4823-a4bb-9eb17fc76723 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:14:50.400507 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-7e5b6e6e-39d2-4823-a4bb-9eb17fc76723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:50.423722 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1214/2415] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:14:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:14:50.423722 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5b6e6e-39d2-4823-a4bb-9eb17fc76723 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:50.424922 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-7e5b6e6e-39d2-4823-a4bb-9eb17fc76723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:50.454041 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5b6e6e-39d2-4823-a4bb-9eb17fc76723 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:50.467895 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5b1a8f-aa06-4a88-b3e6-0fa14654735c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:50.468874 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5b1a8f-aa06-4a88-b3e6-0fa14654735c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:50.472100 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5b1a8f-aa06-4a88-b3e6-0fa14654735c admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:50.472400 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5b1a8f-aa06-4a88-b3e6-0fa14654735c admin admin] PATH_INFO: `/v3/projects/a1c7e25a7a2448428a44fa16244dc362` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:50.474792 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5b1a8f-aa06-4a88-b3e6-0fa14654735c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1c7e25a7a2448428a44fa16244dc362)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:50.478916 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5b1a8f-aa06-4a88-b3e6-0fa14654735c admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:50.520138 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec1c8ac-36cc-4654-9998-2af6b2199583 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:50.527125 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f027aa06-9374-4b38-a4b4-58259ff2b479 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:50.527815 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f027aa06-9374-4b38-a4b4-58259ff2b479 service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:50.528101 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f027aa06-9374-4b38-a4b4-58259ff2b479 service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:50.528381 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f027aa06-9374-4b38-a4b4-58259ff2b479 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:50.596715 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f027aa06-9374-4b38-a4b4-58259ff2b479 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:50.599008 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f027aa06-9374-4b38-a4b4-58259ff2b479 service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:50.613827 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-2e5b1a8f-aa06-4a88-b3e6-0fa14654735c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1c7e25a7a2448428a44fa16244dc362', 'request_id': 'req-2e5b1a8f-aa06-4a88-b3e6-0fa14654735c'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:50.633350 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-2e5b1a8f-aa06-4a88-b3e6-0fa14654735c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1c7e25a7a2448428a44fa16244dc362', 'request_id': 'req-2e5b1a8f-aa06-4a88-b3e6-0fa14654735c'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:50.638522 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1202/2416] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:14:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:14:50.640689 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f027aa06-9374-4b38-a4b4-58259ff2b479 service neutron] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:50.655514 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-2e5b1a8f-aa06-4a88-b3e6-0fa14654735c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1c7e25a7a2448428a44fa16244dc362', 'request_id': 'req-2e5b1a8f-aa06-4a88-b3e6-0fa14654735c'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:50.666888 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f027aa06-9374-4b38-a4b4-58259ff2b479 service neutron] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:50.674888 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-2e5b1a8f-aa06-4a88-b3e6-0fa14654735c admin admin] The token cache is being invalidate because project a1c7e25a7a2448428a44fa16244dc362 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:14:50.675230 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-2e5b1a8f-aa06-4a88-b3e6-0fa14654735c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:50.675906 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-2e5b1a8f-aa06-4a88-b3e6-0fa14654735c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:50.680899 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1215/2417] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:14:50 2022] DELETE /identity/v3/projects/a1c7e25a7a2448428a44fa16244dc362 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:14:50.684052 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1fc19c-151f-4600-8b22-69fd4d3e8db6 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:50.684052 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1fc19c-151f-4600-8b22-69fd4d3e8db6 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:50.684248 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1fc19c-151f-4600-8b22-69fd4d3e8db6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:50.714039 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-2c1fc19c-151f-4600-8b22-69fd4d3e8db6 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:14:50.715454 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-2c1fc19c-151f-4600-8b22-69fd4d3e8db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:50.743335 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:50.831678 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1216/2418] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:14:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:14:50.839492 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975d26a9-a657-4094-b2f1-cab9adabe91e None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:50.839808 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975d26a9-a657-4094-b2f1-cab9adabe91e None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:50.840049 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975d26a9-a657-4094-b2f1-cab9adabe91e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:50.840737 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e731ae9-5a9b-4a04-9d8c-72d1f0e46551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:50.841449 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e731ae9-5a9b-4a04-9d8c-72d1f0e46551 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:50.841731 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e731ae9-5a9b-4a04-9d8c-72d1f0e46551 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:50.842036 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e731ae9-5a9b-4a04-9d8c-72d1f0e46551 admin admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:50.842912 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e731ae9-5a9b-4a04-9d8c-72d1f0e46551 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:14:50.843078 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e731ae9-5a9b-4a04-9d8c-72d1f0e46551 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:50.844734 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e731ae9-5a9b-4a04-9d8c-72d1f0e46551 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:50.890770 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-975d26a9-a657-4094-b2f1-cab9adabe91e None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:14:50.891416 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1203/2419] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:14:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:14:50.897174 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e731ae9-5a9b-4a04-9d8c-72d1f0e46551 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:50.901401 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-975d26a9-a657-4094-b2f1-cab9adabe91e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:50.901611 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-1e731ae9-5a9b-4a04-9d8c-72d1f0e46551 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:50.923285 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e731ae9-5a9b-4a04-9d8c-72d1f0e46551 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:50.926418 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1217/2420] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:14:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:14:50.930150 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6ff109-35b6-45e0-a5a2-e26a8ca080d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:50.931372 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975d26a9-a657-4094-b2f1-cab9adabe91e None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:50.933216 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6ff109-35b6-45e0-a5a2-e26a8ca080d6 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:50.933883 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6ff109-35b6-45e0-a5a2-e26a8ca080d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:50.934349 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6ff109-35b6-45e0-a5a2-e26a8ca080d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:50.938041 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6ff109-35b6-45e0-a5a2-e26a8ca080d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:50.938645 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:50.942622 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6ff109-35b6-45e0-a5a2-e26a8ca080d6 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:50.951362 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975d26a9-a657-4094-b2f1-cab9adabe91e None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:50.968561 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77728935-699f-40a0-96d4-bd90fd71ab61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:50.975420 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77728935-699f-40a0-96d4-bd90fd71ab61 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:50.975751 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77728935-699f-40a0-96d4-bd90fd71ab61 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:50.976095 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77728935-699f-40a0-96d4-bd90fd71ab61 admin admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:50.976953 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77728935-699f-40a0-96d4-bd90fd71ab61 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:14:50.979148 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77728935-699f-40a0-96d4-bd90fd71ab61 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:50.987632 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77728935-699f-40a0-96d4-bd90fd71ab61 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:51.012025 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1204/2421] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:14:50 2022] POST /identity/v3/projects => generated 371 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:14:51.016122 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6ff109-35b6-45e0-a5a2-e26a8ca080d6 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:51.041818 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1218/2422] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:14:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:14:51.044692 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77728935-699f-40a0-96d4-bd90fd71ab61 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:51.077714 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77728935-699f-40a0-96d4-bd90fd71ab61 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:51.179808 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6ff109-35b6-45e0-a5a2-e26a8ca080d6 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:51.192623 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c00ac31-b01d-4b08-911f-d37ef862127d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:51.193652 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c00ac31-b01d-4b08-911f-d37ef862127d admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:51.194163 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c00ac31-b01d-4b08-911f-d37ef862127d admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:51.194594 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c00ac31-b01d-4b08-911f-d37ef862127d admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:51.195437 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c00ac31-b01d-4b08-911f-d37ef862127d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:51.197651 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c00ac31-b01d-4b08-911f-d37ef862127d admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:51.205052 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3527b7b4-1af8-4ff8-8fbf-0e427bdb35dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:51.205745 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3527b7b4-1af8-4ff8-8fbf-0e427bdb35dc admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:51.206164 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3527b7b4-1af8-4ff8-8fbf-0e427bdb35dc admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:51.206538 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3527b7b4-1af8-4ff8-8fbf-0e427bdb35dc admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:51.207241 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3527b7b4-1af8-4ff8-8fbf-0e427bdb35dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:51.209258 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3527b7b4-1af8-4ff8-8fbf-0e427bdb35dc admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:51.239040 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1205/2423] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:14:51 2022] POST /identity/v3/users => generated 286 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:14:51.243269 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c00ac31-b01d-4b08-911f-d37ef862127d admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:51.262191 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1219/2424] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:14:51 2022] POST /identity/v3/projects => generated 393 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:14:51.267019 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3527b7b4-1af8-4ff8-8fbf-0e427bdb35dc admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:51.269357 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c00ac31-b01d-4b08-911f-d37ef862127d admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:51.409538 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3527b7b4-1af8-4ff8-8fbf-0e427bdb35dc admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:51.414863 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0532a4-e0af-4fc6-897a-ccd5855ab0a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:51.415195 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6f1623-dd9c-41d0-9c99-8c588a5d9131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:51.415767 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0532a4-e0af-4fc6-897a-ccd5855ab0a3 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:51.415865 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0532a4-e0af-4fc6-897a-ccd5855ab0a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:51.416094 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0532a4-e0af-4fc6-897a-ccd5855ab0a3 admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:51.416391 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6f1623-dd9c-41d0-9c99-8c588a5d9131 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:51.416792 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0532a4-e0af-4fc6-897a-ccd5855ab0a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:51.416904 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6f1623-dd9c-41d0-9c99-8c588a5d9131 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:51.417231 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6f1623-dd9c-41d0-9c99-8c588a5d9131 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:51.418129 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6f1623-dd9c-41d0-9c99-8c588a5d9131 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:51.420006 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6f1623-dd9c-41d0-9c99-8c588a5d9131 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:51.435460 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1206/2425] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:14:51 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 21:14:51.437065 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0532a4-e0af-4fc6-897a-ccd5855ab0a3 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:51.452096 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6f1623-dd9c-41d0-9c99-8c588a5d9131 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:51.466157 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6f1623-dd9c-41d0-9c99-8c588a5d9131 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:51.481394 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71e08bf-a158-4078-bb71-54d73784a1a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:51.482299 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71e08bf-a158-4078-bb71-54d73784a1a0 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:51.482780 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71e08bf-a158-4078-bb71-54d73784a1a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:51.484136 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71e08bf-a158-4078-bb71-54d73784a1a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:51.487276 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71e08bf-a158-4078-bb71-54d73784a1a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:51.489244 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71e08bf-a158-4078-bb71-54d73784a1a0 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:51.494805 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1220/2426] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:14:51 2022] POST /identity/v3/users => generated 297 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:14:51.497987 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0532a4-e0af-4fc6-897a-ccd5855ab0a3 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:51.523295 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1207/2427] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:14:51 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:14:51.527651 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71e08bf-a158-4078-bb71-54d73784a1a0 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:51.531138 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0532a4-e0af-4fc6-897a-ccd5855ab0a3 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:51.542980 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71e08bf-a158-4078-bb71-54d73784a1a0 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:51.548435 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8175d3-ffa6-456a-a716-917d6168321a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:51.549132 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8175d3-ffa6-456a-a716-917d6168321a admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:51.549410 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8175d3-ffa6-456a-a716-917d6168321a admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:51.549684 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8175d3-ffa6-456a-a716-917d6168321a admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:51.551537 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8175d3-ffa6-456a-a716-917d6168321a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:51.553905 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8175d3-ffa6-456a-a716-917d6168321a admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:51.556165 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650f4696-129a-4691-955d-5f50d978f40c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:51.557182 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650f4696-129a-4691-955d-5f50d978f40c admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:51.557879 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650f4696-129a-4691-955d-5f50d978f40c admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:51.557879 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650f4696-129a-4691-955d-5f50d978f40c admin admin] PATH_INFO: `/v3/projects/c50fb0aa12e34b4eac4be580c4e33c77/users/0ae5f16c80d54ac7a712e9ab2d242ba2/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:51.591166 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1221/2428] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:14:51 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:14:51.595013 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8175d3-ffa6-456a-a716-917d6168321a admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:51.599520 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:51.612515 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650f4696-129a-4691-955d-5f50d978f40c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c50fb0aa12e34b4eac4be580c4e33c77, user_id=0ae5f16c80d54ac7a712e9ab2d242ba2, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:51.615700 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650f4696-129a-4691-955d-5f50d978f40c admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:51.621423 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8175d3-ffa6-456a-a716-917d6168321a admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:51.636204 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fd91c0-1579-4eac-a8fc-b707f10475bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:51.638910 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fd91c0-1579-4eac-a8fc-b707f10475bd admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:51.639555 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fd91c0-1579-4eac-a8fc-b707f10475bd admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:51.639555 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fd91c0-1579-4eac-a8fc-b707f10475bd admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:51.643540 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fd91c0-1579-4eac-a8fc-b707f10475bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:51.647498 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fd91c0-1579-4eac-a8fc-b707f10475bd admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:51.660403 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1208/2429] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:14:51 2022] PUT /identity/v3/projects/c50fb0aa12e34b4eac4be580c4e33c77/users/0ae5f16c80d54ac7a712e9ab2d242ba2/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:14:51.719083 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650f4696-129a-4691-955d-5f50d978f40c admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:51.720137 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1222/2430] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:14:51 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:14:51.762268 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea02bbc-222a-40bd-a6de-6221cb1b3f9c None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:51.762928 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea02bbc-222a-40bd-a6de-6221cb1b3f9c None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:51.763422 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea02bbc-222a-40bd-a6de-6221cb1b3f9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:51.896685 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-dea02bbc-222a-40bd-a6de-6221cb1b3f9c None None] MFA Rules not processed for user `0ae5f16c80d54ac7a712e9ab2d242ba2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:14:51.902064 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-dea02bbc-222a-40bd-a6de-6221cb1b3f9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:51.937790 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650f4696-129a-4691-955d-5f50d978f40c admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:51.954459 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2708a15d-4514-4b1f-9206-70dca2404af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:51.955787 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2708a15d-4514-4b1f-9206-70dca2404af2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:51.956334 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2708a15d-4514-4b1f-9206-70dca2404af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:51.956800 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2708a15d-4514-4b1f-9206-70dca2404af2 admin admin] PATH_INFO: `/v3/projects/fcf6363b1e154ff59ee30143aee3d4f1/users/90d3840d84f34ae5ba5d95b4c96847ba/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:52.020828 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2708a15d-4514-4b1f-9206-70dca2404af2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcf6363b1e154ff59ee30143aee3d4f1, user_id=90d3840d84f34ae5ba5d95b4c96847ba, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:52.038630 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2708a15d-4514-4b1f-9206-70dca2404af2 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:52.047185 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:52.106785 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1209/2431] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:14:51 2022] PUT /identity/v3/projects/fcf6363b1e154ff59ee30143aee3d4f1/users/90d3840d84f34ae5ba5d95b4c96847ba/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:14:52.113473 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fda404-2523-4691-a886-2eefb7cf44d6 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:52.113771 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fda404-2523-4691-a886-2eefb7cf44d6 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:52.114205 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fda404-2523-4691-a886-2eefb7cf44d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:52.171272 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1223/2432] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:14:51 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 410 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:14:52.233540 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-36fda404-2523-4691-a886-2eefb7cf44d6 None None] MFA Rules not processed for user `90d3840d84f34ae5ba5d95b4c96847ba`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:14:52.235609 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-36fda404-2523-4691-a886-2eefb7cf44d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:52.389387 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1210/2433] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:14:52 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:14:52.390715 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea02bbc-222a-40bd-a6de-6221cb1b3f9c None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:52.405767 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea02bbc-222a-40bd-a6de-6221cb1b3f9c None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:52.472001 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fda404-2523-4691-a886-2eefb7cf44d6 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:52.474110 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-36fda404-2523-4691-a886-2eefb7cf44d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:52.538752 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b33a43f-1064-47d9-b1cb-c1eedfdf3fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:52.540101 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b33a43f-1064-47d9-b1cb-c1eedfdf3fd3 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:52.540527 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b33a43f-1064-47d9-b1cb-c1eedfdf3fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:52.541548 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b33a43f-1064-47d9-b1cb-c1eedfdf3fd3 admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:52.542445 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b33a43f-1064-47d9-b1cb-c1eedfdf3fd3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:52.552030 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b33a43f-1064-47d9-b1cb-c1eedfdf3fd3 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:52.604480 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1224/2434] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:14:52 2022] POST /identity/v3/projects => generated 393 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:14:52.614748 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b33a43f-1064-47d9-b1cb-c1eedfdf3fd3 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:52.639406 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:52.697890 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fda404-2523-4691-a886-2eefb7cf44d6 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:52.788019 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b33a43f-1064-47d9-b1cb-c1eedfdf3fd3 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:52.826625 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540dae20-032c-4277-b23d-6b4d78f534b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:52.830420 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540dae20-032c-4277-b23d-6b4d78f534b2 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:52.830776 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540dae20-032c-4277-b23d-6b4d78f534b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:52.832486 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540dae20-032c-4277-b23d-6b4d78f534b2 admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:52.836196 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540dae20-032c-4277-b23d-6b4d78f534b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:52.843421 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540dae20-032c-4277-b23d-6b4d78f534b2 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:52.877928 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f84526-98cc-4fb6-85d8-b47c3dd1c8e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:52.889382 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f84526-98cc-4fb6-85d8-b47c3dd1c8e8 service nova] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:52.889695 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f84526-98cc-4fb6-85d8-b47c3dd1c8e8 service nova] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:52.890504 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f84526-98cc-4fb6-85d8-b47c3dd1c8e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:52.896434 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1225/2435] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:14:52 2022] POST /identity/v3/users => generated 303 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:14:52.898291 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540dae20-032c-4277-b23d-6b4d78f534b2 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:52.930351 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540dae20-032c-4277-b23d-6b4d78f534b2 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:52.937014 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46c6755-8eb6-429b-b59c-54efe23db424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:52.938076 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46c6755-8eb6-429b-b59c-54efe23db424 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:52.945066 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46c6755-8eb6-429b-b59c-54efe23db424 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:52.945742 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46c6755-8eb6-429b-b59c-54efe23db424 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:52.946550 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46c6755-8eb6-429b-b59c-54efe23db424 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:52.948270 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46c6755-8eb6-429b-b59c-54efe23db424 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:52.996290 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1226/2436] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:14:52 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:14:52.998859 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46c6755-8eb6-429b-b59c-54efe23db424 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:53.025449 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46c6755-8eb6-429b-b59c-54efe23db424 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:53.025932 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f84526-98cc-4fb6-85d8-b47c3dd1c8e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:53.029189 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f84526-98cc-4fb6-85d8-b47c3dd1c8e8 service nova] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:53.040965 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa8a2fb-4d59-40fc-adc2-fb32d3044209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:53.043912 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa8a2fb-4d59-40fc-adc2-fb32d3044209 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:53.044206 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa8a2fb-4d59-40fc-adc2-fb32d3044209 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:53.045978 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa8a2fb-4d59-40fc-adc2-fb32d3044209 admin admin] PATH_INFO: `/v3/projects/6856f62a06d847fbace1c289da5e104c/users/542d3eb2cfe149329fac67ac1cdc036e/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:53.056969 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1211/2437] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:14:52 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 585 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 23 21:14:53.107512 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa8a2fb-4d59-40fc-adc2-fb32d3044209 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6856f62a06d847fbace1c289da5e104c, user_id=542d3eb2cfe149329fac67ac1cdc036e, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:53.120028 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa8a2fb-4d59-40fc-adc2-fb32d3044209 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:53.148506 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1227/2438] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:14:52 2022] PUT /identity/v3/projects/6856f62a06d847fbace1c289da5e104c/users/542d3eb2cfe149329fac67ac1cdc036e/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:14:53.152405 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f84526-98cc-4fb6-85d8-b47c3dd1c8e8 service nova] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:53.167048 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f84526-98cc-4fb6-85d8-b47c3dd1c8e8 service nova] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:53.320599 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d032504c-dee2-4930-abae-e46588eb4b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:53.326864 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d032504c-dee2-4930-abae-e46588eb4b53 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:53.327521 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d032504c-dee2-4930-abae-e46588eb4b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:53.327969 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d032504c-dee2-4930-abae-e46588eb4b53 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:53.328923 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d032504c-dee2-4930-abae-e46588eb4b53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:53.332291 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d032504c-dee2-4930-abae-e46588eb4b53 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:53.344919 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1212/2439] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:14:53 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:14:53.349056 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa8a2fb-4d59-40fc-adc2-fb32d3044209 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:53.362123 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa8a2fb-4d59-40fc-adc2-fb32d3044209 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:53.398340 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8299702-a07d-403b-aa18-9672c2b73943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:53.399278 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8299702-a07d-403b-aa18-9672c2b73943 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:53.399560 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8299702-a07d-403b-aa18-9672c2b73943 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:53.404390 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8299702-a07d-403b-aa18-9672c2b73943 admin admin] PATH_INFO: `/v3/projects/6856f62a06d847fbace1c289da5e104c/users/542d3eb2cfe149329fac67ac1cdc036e/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:53.408223 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8299702-a07d-403b-aa18-9672c2b73943 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6856f62a06d847fbace1c289da5e104c, user_id=542d3eb2cfe149329fac67ac1cdc036e, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:53.432778 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8299702-a07d-403b-aa18-9672c2b73943 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:53.461691 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:53.480291 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1228/2440] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:14:53 2022] PUT /identity/v3/projects/6856f62a06d847fbace1c289da5e104c/users/542d3eb2cfe149329fac67ac1cdc036e/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:14:53.492686 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876982c7-d4ee-4c74-aa31-2fe54e3d2eb2 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:53.493295 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876982c7-d4ee-4c74-aa31-2fe54e3d2eb2 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:53.498241 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876982c7-d4ee-4c74-aa31-2fe54e3d2eb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:53.551404 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8299702-a07d-403b-aa18-9672c2b73943 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:53.553410 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-e8299702-a07d-403b-aa18-9672c2b73943 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:53.577374 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-876982c7-d4ee-4c74-aa31-2fe54e3d2eb2 None None] MFA Rules not processed for user `542d3eb2cfe149329fac67ac1cdc036e`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:14:53.582373 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-876982c7-d4ee-4c74-aa31-2fe54e3d2eb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:53.647887 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:53.770598 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8299702-a07d-403b-aa18-9672c2b73943 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:53.798943 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ffd6b7-a4c6-4650-bdbc-57ee4bbca4fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:53.799955 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ffd6b7-a4c6-4650-bdbc-57ee4bbca4fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:53.800299 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ffd6b7-a4c6-4650-bdbc-57ee4bbca4fb admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:53.800637 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ffd6b7-a4c6-4650-bdbc-57ee4bbca4fb admin admin] PATH_INFO: `/v3/projects/3dd9680491d143aba028c462f52beaa0` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:53.806471 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ffd6b7-a4c6-4650-bdbc-57ee4bbca4fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=3dd9680491d143aba028c462f52beaa0)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:53.814127 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1213/2441] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:14:53 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:14:53.825586 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ffd6b7-a4c6-4650-bdbc-57ee4bbca4fb admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:53.828847 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb065b2c-b810-4e2a-97af-f9683bd48b36 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:53.829317 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb065b2c-b810-4e2a-97af-f9683bd48b36 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:53.829833 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb065b2c-b810-4e2a-97af-f9683bd48b36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:53.881176 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-bb065b2c-b810-4e2a-97af-f9683bd48b36 None None] MFA Rules not processed for user `90d3840d84f34ae5ba5d95b4c96847ba`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:14:53.884351 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-bb065b2c-b810-4e2a-97af-f9683bd48b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:53.977225 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-20ffd6b7-a4c6-4650-bdbc-57ee4bbca4fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3dd9680491d143aba028c462f52beaa0', 'request_id': 'req-20ffd6b7-a4c6-4650-bdbc-57ee4bbca4fb'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:53.999455 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-20ffd6b7-a4c6-4650-bdbc-57ee4bbca4fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3dd9680491d143aba028c462f52beaa0', 'request_id': 'req-20ffd6b7-a4c6-4650-bdbc-57ee4bbca4fb'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:54.006464 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1214/2442] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:14:53 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:14:54.040246 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-20ffd6b7-a4c6-4650-bdbc-57ee4bbca4fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3dd9680491d143aba028c462f52beaa0', 'request_id': 'req-20ffd6b7-a4c6-4650-bdbc-57ee4bbca4fb'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:54.070980 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-20ffd6b7-a4c6-4650-bdbc-57ee4bbca4fb admin admin] The token cache is being invalidate because project 3dd9680491d143aba028c462f52beaa0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:14:54.071270 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-20ffd6b7-a4c6-4650-bdbc-57ee4bbca4fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:54.086655 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-20ffd6b7-a4c6-4650-bdbc-57ee4bbca4fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:54.094283 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1229/2443] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:14:53 2022] DELETE /identity/v3/projects/3dd9680491d143aba028c462f52beaa0 => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:14:54.095051 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb065b2c-b810-4e2a-97af-f9683bd48b36 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:54.117697 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb065b2c-b810-4e2a-97af-f9683bd48b36 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:54.118911 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ffd6b7-a4c6-4650-bdbc-57ee4bbca4fb admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:54.120431 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-20ffd6b7-a4c6-4650-bdbc-57ee4bbca4fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:54.265673 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c029b20-ed8a-41ae-816c-7d2f534be849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:54.266747 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c029b20-ed8a-41ae-816c-7d2f534be849 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:54.266969 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c029b20-ed8a-41ae-816c-7d2f534be849 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:54.267808 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c029b20-ed8a-41ae-816c-7d2f534be849 admin admin] PATH_INFO: `/v3/users/20ff4b538d574a53a05b261388b614b6` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:54.269350 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c029b20-ed8a-41ae-816c-7d2f534be849 admin admin] RBAC: Authorizing `identity:delete_user(user_id=20ff4b538d574a53a05b261388b614b6)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:54.271352 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c029b20-ed8a-41ae-816c-7d2f534be849 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:54.373425 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-6c029b20-ed8a-41ae-816c-7d2f534be849 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20ff4b538d574a53a05b261388b614b6'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:54.381679 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ffd6b7-a4c6-4650-bdbc-57ee4bbca4fb admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:54.393047 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-6c029b20-ed8a-41ae-816c-7d2f534be849 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20ff4b538d574a53a05b261388b614b6'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:54.394077 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-6c029b20-ed8a-41ae-816c-7d2f534be849 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20ff4b538d574a53a05b261388b614b6'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:54.397820 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62220f18-5e55-4789-8b02-e2af1251498b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:54.400190 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62220f18-5e55-4789-8b02-e2af1251498b service nova] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:54.400686 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62220f18-5e55-4789-8b02-e2af1251498b service nova] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:54.401136 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62220f18-5e55-4789-8b02-e2af1251498b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:54.410474 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-62220f18-5e55-4789-8b02-e2af1251498b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:54.413916 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-6c029b20-ed8a-41ae-816c-7d2f534be849 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20ff4b538d574a53a05b261388b614b6'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:54.416850 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:54.448809 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-6c029b20-ed8a-41ae-816c-7d2f534be849 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20ff4b538d574a53a05b261388b614b6'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:54.470210 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1215/2444] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:14:54 2022] DELETE /identity/v3/users/20ff4b538d574a53a05b261388b614b6 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:14:54.484504 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:54.490764 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30e4aa4-5788-46e3-a35d-36e4e8e9efdd None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:54.491039 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30e4aa4-5788-46e3-a35d-36e4e8e9efdd None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:54.491374 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30e4aa4-5788-46e3-a35d-36e4e8e9efdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:54.576286 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-a30e4aa4-5788-46e3-a35d-36e4e8e9efdd None None] MFA Rules not processed for user `c3c98764e4124ec8a07db8d3d3cce19a`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:14:54.576975 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-a30e4aa4-5788-46e3-a35d-36e4e8e9efdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:54.598997 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62220f18-5e55-4789-8b02-e2af1251498b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:54.600157 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62220f18-5e55-4789-8b02-e2af1251498b service nova] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:54.632425 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1230/2445] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:14:54 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 514 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 23 21:14:54.749829 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1216/2446] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:14:54 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:14:55.594109 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62220f18-5e55-4789-8b02-e2af1251498b service nova] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:55.596691 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-62220f18-5e55-4789-8b02-e2af1251498b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:55.623384 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62220f18-5e55-4789-8b02-e2af1251498b service nova] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:55.688011 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30e4aa4-5788-46e3-a35d-36e4e8e9efdd None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:55.690401 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-a30e4aa4-5788-46e3-a35d-36e4e8e9efdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:55.795293 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce217c8c-74c9-444a-86d0-c59c20da58fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:55.796194 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce217c8c-74c9-444a-86d0-c59c20da58fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:55.796475 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce217c8c-74c9-444a-86d0-c59c20da58fc admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:55.796747 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce217c8c-74c9-444a-86d0-c59c20da58fc admin admin] PATH_INFO: `/v3/projects/d0df7d6bde584592a1b92d00065cb6a9` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:55.805023 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce217c8c-74c9-444a-86d0-c59c20da58fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0df7d6bde584592a1b92d00065cb6a9)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:55.806953 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce217c8c-74c9-444a-86d0-c59c20da58fc admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:55.892087 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30e4aa4-5788-46e3-a35d-36e4e8e9efdd None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:55.898552 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa148300-b1b2-4f51-a6cc-a1e7d0787a71 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:55.899219 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa148300-b1b2-4f51-a6cc-a1e7d0787a71 service nova] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:55.899499 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa148300-b1b2-4f51-a6cc-a1e7d0787a71 service nova] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:55.899774 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa148300-b1b2-4f51-a6cc-a1e7d0787a71 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:55.902870 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-aa148300-b1b2-4f51-a6cc-a1e7d0787a71 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:55.975853 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-ce217c8c-74c9-444a-86d0-c59c20da58fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0df7d6bde584592a1b92d00065cb6a9', 'request_id': 'req-ce217c8c-74c9-444a-86d0-c59c20da58fc'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:56.007589 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-ce217c8c-74c9-444a-86d0-c59c20da58fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0df7d6bde584592a1b92d00065cb6a9', 'request_id': 'req-ce217c8c-74c9-444a-86d0-c59c20da58fc'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:56.018530 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-ce217c8c-74c9-444a-86d0-c59c20da58fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0df7d6bde584592a1b92d00065cb6a9', 'request_id': 'req-ce217c8c-74c9-444a-86d0-c59c20da58fc'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:56.049135 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-ce217c8c-74c9-444a-86d0-c59c20da58fc admin admin] The token cache is being invalidate because project d0df7d6bde584592a1b92d00065cb6a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:14:56.049434 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-ce217c8c-74c9-444a-86d0-c59c20da58fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:56.052495 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-ce217c8c-74c9-444a-86d0-c59c20da58fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:56.058568 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1231/2447] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:14:55 2022] DELETE /identity/v3/projects/d0df7d6bde584592a1b92d00065cb6a9 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:14:56.063776 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96973e57-f8d8-405f-a735-a284eeae24bc None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:56.063776 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96973e57-f8d8-405f-a735-a284eeae24bc None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:56.063776 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96973e57-f8d8-405f-a735-a284eeae24bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:56.064400 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa148300-b1b2-4f51-a6cc-a1e7d0787a71 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:56.066468 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa148300-b1b2-4f51-a6cc-a1e7d0787a71 service nova] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:56.105406 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1217/2448] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:14:55 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:14:56.123163 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-96973e57-f8d8-405f-a735-a284eeae24bc None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:14:56.124452 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-96973e57-f8d8-405f-a735-a284eeae24bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:56.241566 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:56.262378 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1232/2449] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:14:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:14:56.270195 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d81445a-aea8-4792-a824-16025b8feda8 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:56.270565 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d81445a-aea8-4792-a824-16025b8feda8 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:56.270758 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d81445a-aea8-4792-a824-16025b8feda8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:56.283618 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:56.335485 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-0d81445a-aea8-4792-a824-16025b8feda8 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:14:56.336836 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-0d81445a-aea8-4792-a824-16025b8feda8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:56.368430 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1218/2450] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:14:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:14:56.373407 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96973e57-f8d8-405f-a735-a284eeae24bc None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:56.387501 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96973e57-f8d8-405f-a735-a284eeae24bc None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:56.393517 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14920d2-bebf-4141-93d0-a4a8f5c847c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:56.412783 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14920d2-bebf-4141-93d0-a4a8f5c847c2 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:56.413114 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14920d2-bebf-4141-93d0-a4a8f5c847c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:56.413575 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14920d2-bebf-4141-93d0-a4a8f5c847c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:56.414420 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14920d2-bebf-4141-93d0-a4a8f5c847c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:14:56.414732 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14920d2-bebf-4141-93d0-a4a8f5c847c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:56.425522 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14920d2-bebf-4141-93d0-a4a8f5c847c2 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:56.448940 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d81445a-aea8-4792-a824-16025b8feda8 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:56.458013 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1233/2451] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:14:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:14:56.462292 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d81445a-aea8-4792-a824-16025b8feda8 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:56.469951 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3bfd17-6051-44b5-bba3-2b1aca76d5ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:56.471061 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3bfd17-6051-44b5-bba3-2b1aca76d5ed admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:56.471548 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3bfd17-6051-44b5-bba3-2b1aca76d5ed admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:56.473401 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3bfd17-6051-44b5-bba3-2b1aca76d5ed admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:56.474598 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3bfd17-6051-44b5-bba3-2b1aca76d5ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:56.476748 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3bfd17-6051-44b5-bba3-2b1aca76d5ed admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:56.545137 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1219/2452] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:14:56 2022] POST /identity/v3/projects => generated 387 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:14:56.557681 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14920d2-bebf-4141-93d0-a4a8f5c847c2 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:56.558770 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3bfd17-6051-44b5-bba3-2b1aca76d5ed admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:56.560550 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-a14920d2-bebf-4141-93d0-a4a8f5c847c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:56.761799 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3bfd17-6051-44b5-bba3-2b1aca76d5ed admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:56.777391 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14920d2-bebf-4141-93d0-a4a8f5c847c2 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:56.779327 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da57db9-17e1-4d3f-847e-260fa6280d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:56.780200 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da57db9-17e1-4d3f-847e-260fa6280d45 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:56.780663 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da57db9-17e1-4d3f-847e-260fa6280d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:56.781148 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da57db9-17e1-4d3f-847e-260fa6280d45 admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:56.782049 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da57db9-17e1-4d3f-847e-260fa6280d45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:56.784328 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da57db9-17e1-4d3f-847e-260fa6280d45 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:56.845849 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1220/2453] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:14:56 2022] POST /identity/v3/users => generated 294 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:14:56.850017 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da57db9-17e1-4d3f-847e-260fa6280d45 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:56.876633 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da57db9-17e1-4d3f-847e-260fa6280d45 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:56.888932 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2155c7ea-de9d-44b6-ba3a-3628cb3ccd05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:56.889632 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2155c7ea-de9d-44b6-ba3a-3628cb3ccd05 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:56.890061 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2155c7ea-de9d-44b6-ba3a-3628cb3ccd05 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:56.890250 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2155c7ea-de9d-44b6-ba3a-3628cb3ccd05 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:56.890942 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2155c7ea-de9d-44b6-ba3a-3628cb3ccd05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:56.892639 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2155c7ea-de9d-44b6-ba3a-3628cb3ccd05 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:56.917461 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1221/2454] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:14:56 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:14:56.920408 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbc8b72-76d0-4421-b7d4-55d2c32e9bca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:56.921292 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2155c7ea-de9d-44b6-ba3a-3628cb3ccd05 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:56.921427 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbc8b72-76d0-4421-b7d4-55d2c32e9bca service nova] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:56.921850 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbc8b72-76d0-4421-b7d4-55d2c32e9bca service nova] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:56.922223 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbc8b72-76d0-4421-b7d4-55d2c32e9bca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:56.924295 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-4dbc8b72-76d0-4421-b7d4-55d2c32e9bca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:56.949375 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2155c7ea-de9d-44b6-ba3a-3628cb3ccd05 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:56.961161 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5616ddd-87df-4aac-85af-0b5429e32589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:56.961890 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5616ddd-87df-4aac-85af-0b5429e32589 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:56.962179 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5616ddd-87df-4aac-85af-0b5429e32589 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:56.962452 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5616ddd-87df-4aac-85af-0b5429e32589 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:56.963194 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5616ddd-87df-4aac-85af-0b5429e32589 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:56.964818 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5616ddd-87df-4aac-85af-0b5429e32589 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:56.990846 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1222/2455] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:14:56 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 21:14:56.995073 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5616ddd-87df-4aac-85af-0b5429e32589 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:57.017471 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5616ddd-87df-4aac-85af-0b5429e32589 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:57.032609 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84ffad9-458d-4446-bd34-7e79468f2ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:57.033468 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84ffad9-458d-4446-bd34-7e79468f2ede admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:57.033741 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84ffad9-458d-4446-bd34-7e79468f2ede admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:57.034037 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84ffad9-458d-4446-bd34-7e79468f2ede admin admin] PATH_INFO: `/v3/projects/dbc1f7886ea6460b8750a60994045795/users/99c9bef5fb814b9a8a0342c20cb316eb/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:57.068128 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84ffad9-458d-4446-bd34-7e79468f2ede admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbc1f7886ea6460b8750a60994045795, user_id=99c9bef5fb814b9a8a0342c20cb316eb, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:57.071139 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84ffad9-458d-4446-bd34-7e79468f2ede admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:57.086930 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbc8b72-76d0-4421-b7d4-55d2c32e9bca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:57.093205 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbc8b72-76d0-4421-b7d4-55d2c32e9bca service nova] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:57.095995 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1223/2456] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:14:56 2022] PUT /identity/v3/projects/dbc1f7886ea6460b8750a60994045795/users/99c9bef5fb814b9a8a0342c20cb316eb/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:14:57.107595 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a389e373-d2b3-42ba-af98-3313a3dce43c None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:57.107879 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a389e373-d2b3-42ba-af98-3313a3dce43c None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:57.108148 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a389e373-d2b3-42ba-af98-3313a3dce43c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:57.142197 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1234/2457] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:14:56 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 588 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:14:57.168600 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-a389e373-d2b3-42ba-af98-3313a3dce43c None None] MFA Rules not processed for user `99c9bef5fb814b9a8a0342c20cb316eb`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:14:57.169934 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-a389e373-d2b3-42ba-af98-3313a3dce43c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:57.304253 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1224/2458] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:14:57 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:14:57.309413 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbc8b72-76d0-4421-b7d4-55d2c32e9bca service nova] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:57.321441 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbc8b72-76d0-4421-b7d4-55d2c32e9bca service nova] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:57.336283 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:57.402223 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839bdea9-d271-49e9-bbbd-95e364ab5fc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:57.402997 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839bdea9-d271-49e9-bbbd-95e364ab5fc4 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:57.403282 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839bdea9-d271-49e9-bbbd-95e364ab5fc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:57.403556 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839bdea9-d271-49e9-bbbd-95e364ab5fc4 admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:57.404285 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839bdea9-d271-49e9-bbbd-95e364ab5fc4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:57.406379 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839bdea9-d271-49e9-bbbd-95e364ab5fc4 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:57.447785 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a389e373-d2b3-42ba-af98-3313a3dce43c None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:57.449615 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1235/2459] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:14:57 2022] POST /identity/v3/projects => generated 387 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:14:57.460291 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a389e373-d2b3-42ba-af98-3313a3dce43c None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:57.467182 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:57.546690 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e78492-9347-4330-9579-eaa3104f8a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:57.548151 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e78492-9347-4330-9579-eaa3104f8a0d admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:57.548607 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e78492-9347-4330-9579-eaa3104f8a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:57.549685 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e78492-9347-4330-9579-eaa3104f8a0d admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:57.550775 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e78492-9347-4330-9579-eaa3104f8a0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:57.553710 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e78492-9347-4330-9579-eaa3104f8a0d admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:57.598412 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839bdea9-d271-49e9-bbbd-95e364ab5fc4 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:57.606948 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1225/2460] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:14:57 2022] POST /identity/v3/users => generated 300 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:14:57.611306 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839bdea9-d271-49e9-bbbd-95e364ab5fc4 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:57.642779 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fa0da4-b655-4201-b705-9e4a6c83b6b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:57.646855 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fa0da4-b655-4201-b705-9e4a6c83b6b4 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:57.647362 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fa0da4-b655-4201-b705-9e4a6c83b6b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:57.650321 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fa0da4-b655-4201-b705-9e4a6c83b6b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:57.651427 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fa0da4-b655-4201-b705-9e4a6c83b6b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:57.655579 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fa0da4-b655-4201-b705-9e4a6c83b6b4 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:57.681197 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e78492-9347-4330-9579-eaa3104f8a0d admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:57.696859 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1236/2461] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:14:57 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:14:57.699891 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e78492-9347-4330-9579-eaa3104f8a0d admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:57.706239 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e898a3f5-d6c1-41df-ae03-33b204072616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:57.707166 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e898a3f5-d6c1-41df-ae03-33b204072616 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:57.707448 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e898a3f5-d6c1-41df-ae03-33b204072616 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:57.709012 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e898a3f5-d6c1-41df-ae03-33b204072616 admin admin] PATH_INFO: `/v3/projects/df5b2f484bad45b48dc70043477724d0/users/9b094df90d174e2682f369c81f276a9e/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:57.730712 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e898a3f5-d6c1-41df-ae03-33b204072616 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df5b2f484bad45b48dc70043477724d0, user_id=9b094df90d174e2682f369c81f276a9e, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:57.734010 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e898a3f5-d6c1-41df-ae03-33b204072616 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:57.759267 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fa0da4-b655-4201-b705-9e4a6c83b6b4 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:57.759729 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1226/2462] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:14:57 2022] PUT /identity/v3/projects/df5b2f484bad45b48dc70043477724d0/users/9b094df90d174e2682f369c81f276a9e/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:14:57.776023 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fa0da4-b655-4201-b705-9e4a6c83b6b4 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:57.910172 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f182273-eaf3-4b2e-93f3-96e934e218b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:57.911378 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f182273-eaf3-4b2e-93f3-96e934e218b4 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:57.911729 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f182273-eaf3-4b2e-93f3-96e934e218b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:57.912071 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f182273-eaf3-4b2e-93f3-96e934e218b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:57.912909 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f182273-eaf3-4b2e-93f3-96e934e218b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:57.917528 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f182273-eaf3-4b2e-93f3-96e934e218b4 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:57.941279 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e898a3f5-d6c1-41df-ae03-33b204072616 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:57.951494 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1237/2463] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:14:57 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:14:57.957754 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e898a3f5-d6c1-41df-ae03-33b204072616 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:57.972973 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb290045-f3c9-4cdb-8bfb-2425490e1497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:57.974216 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb290045-f3c9-4cdb-8bfb-2425490e1497 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:57.975098 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb290045-f3c9-4cdb-8bfb-2425490e1497 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:57.975482 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb290045-f3c9-4cdb-8bfb-2425490e1497 admin admin] PATH_INFO: `/v3/projects/df5b2f484bad45b48dc70043477724d0/users/9b094df90d174e2682f369c81f276a9e/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:57.978013 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb290045-f3c9-4cdb-8bfb-2425490e1497 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df5b2f484bad45b48dc70043477724d0, user_id=9b094df90d174e2682f369c81f276a9e, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:57.982383 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb290045-f3c9-4cdb-8bfb-2425490e1497 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:58.021769 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1227/2464] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:14:57 2022] PUT /identity/v3/projects/df5b2f484bad45b48dc70043477724d0/users/9b094df90d174e2682f369c81f276a9e/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:14:58.023992 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1e0b3a-e864-4655-b217-f73a3ab39bcd None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:58.025071 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1e0b3a-e864-4655-b217-f73a3ab39bcd None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:58.025071 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1e0b3a-e864-4655-b217-f73a3ab39bcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:58.076651 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-cb1e0b3a-e864-4655-b217-f73a3ab39bcd None None] MFA Rules not processed for user `9b094df90d174e2682f369c81f276a9e`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:14:58.078047 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-cb1e0b3a-e864-4655-b217-f73a3ab39bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:58.210501 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1238/2465] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:14:58 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:14:58.250902 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb290045-f3c9-4cdb-8bfb-2425490e1497 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:58.252535 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-eb290045-f3c9-4cdb-8bfb-2425490e1497 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:58.361631 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb290045-f3c9-4cdb-8bfb-2425490e1497 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:58.370084 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6975b0-62e8-4791-a40f-200af4c443eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:58.370535 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6975b0-62e8-4791-a40f-200af4c443eb service nova] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:58.370917 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6975b0-62e8-4791-a40f-200af4c443eb service nova] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:58.371295 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6975b0-62e8-4791-a40f-200af4c443eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:58.381807 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6975b0-62e8-4791-a40f-200af4c443eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:58.383640 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6975b0-62e8-4791-a40f-200af4c443eb service nova] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:58.395521 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1228/2466] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:14:58 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:14:59.359468 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1e0b3a-e864-4655-b217-f73a3ab39bcd None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:59.361020 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-cb1e0b3a-e864-4655-b217-f73a3ab39bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:59.389821 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:59.430668 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6975b0-62e8-4791-a40f-200af4c443eb service nova] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:14:59.508869 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:59.560113 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6975b0-62e8-4791-a40f-200af4c443eb service nova] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:59.578225 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35adfda1-5d4b-4232-aec3-1e2d4b3d2ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:59.582076 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35adfda1-5d4b-4232-aec3-1e2d4b3d2ece admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:59.582932 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35adfda1-5d4b-4232-aec3-1e2d4b3d2ece admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:59.583681 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35adfda1-5d4b-4232-aec3-1e2d4b3d2ece admin admin] PATH_INFO: `/v3/users/99c9bef5fb814b9a8a0342c20cb316eb` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:59.587944 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35adfda1-5d4b-4232-aec3-1e2d4b3d2ece admin admin] RBAC: Authorizing `identity:delete_user(user_id=99c9bef5fb814b9a8a0342c20cb316eb)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:59.588872 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1e0b3a-e864-4655-b217-f73a3ab39bcd None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:14:59.595003 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35adfda1-5d4b-4232-aec3-1e2d4b3d2ece admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:59.603710 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd0c17c-aea8-4d6f-8e90-e3ae6a3dab9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:14:59.604846 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd0c17c-aea8-4d6f-8e90-e3ae6a3dab9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:59.606125 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd0c17c-aea8-4d6f-8e90-e3ae6a3dab9d admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:59.610166 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd0c17c-aea8-4d6f-8e90-e3ae6a3dab9d admin admin] PATH_INFO: `/v3/users/0ae5f16c80d54ac7a712e9ab2d242ba2` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:59.611762 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd0c17c-aea8-4d6f-8e90-e3ae6a3dab9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ae5f16c80d54ac7a712e9ab2d242ba2)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:14:59.624679 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd0c17c-aea8-4d6f-8e90-e3ae6a3dab9d admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:14:59.720636 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-35adfda1-5d4b-4232-aec3-1e2d4b3d2ece admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99c9bef5fb814b9a8a0342c20cb316eb'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:59.721093 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-dcd0c17c-aea8-4d6f-8e90-e3ae6a3dab9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ae5f16c80d54ac7a712e9ab2d242ba2'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:59.721987 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-dcd0c17c-aea8-4d6f-8e90-e3ae6a3dab9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ae5f16c80d54ac7a712e9ab2d242ba2'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:59.741473 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-35adfda1-5d4b-4232-aec3-1e2d4b3d2ece admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99c9bef5fb814b9a8a0342c20cb316eb'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:59.744407 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-35adfda1-5d4b-4232-aec3-1e2d4b3d2ece admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99c9bef5fb814b9a8a0342c20cb316eb'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:59.744770 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-dcd0c17c-aea8-4d6f-8e90-e3ae6a3dab9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ae5f16c80d54ac7a712e9ab2d242ba2'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:59.765888 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-dcd0c17c-aea8-4d6f-8e90-e3ae6a3dab9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ae5f16c80d54ac7a712e9ab2d242ba2'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:59.773757 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-35adfda1-5d4b-4232-aec3-1e2d4b3d2ece admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99c9bef5fb814b9a8a0342c20cb316eb'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:59.788092 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-dcd0c17c-aea8-4d6f-8e90-e3ae6a3dab9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ae5f16c80d54ac7a712e9ab2d242ba2'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:59.798113 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1239/2467] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:14:59 2022] DELETE /identity/v3/users/0ae5f16c80d54ac7a712e9ab2d242ba2 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:14:59.802374 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-35adfda1-5d4b-4232-aec3-1e2d4b3d2ece admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99c9bef5fb814b9a8a0342c20cb316eb'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:14:59.802885 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6178977c-c1c7-45b0-8845-624080bac173 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:59.803241 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6178977c-c1c7-45b0-8845-624080bac173 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:59.803630 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6178977c-c1c7-45b0-8845-624080bac173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:59.855014 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1229/2468] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:14:59 2022] DELETE /identity/v3/users/99c9bef5fb814b9a8a0342c20cb316eb => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:14:59.855014 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0916c8e-8434-4e50-bf29-f90c8a24a7fd None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:14:59.855014 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0916c8e-8434-4e50-bf29-f90c8a24a7fd None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:14:59.855014 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0916c8e-8434-4e50-bf29-f90c8a24a7fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:14:59.889718 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-6178977c-c1c7-45b0-8845-624080bac173 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:14:59.893798 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-6178977c-c1c7-45b0-8845-624080bac173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:14:59.895286 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-a0916c8e-8434-4e50-bf29-f90c8a24a7fd None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:14:59.896481 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-a0916c8e-8434-4e50-bf29-f90c8a24a7fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:15:00.033901 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1230/2469] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:14:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:15:00.066112 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0916c8e-8434-4e50-bf29-f90c8a24a7fd None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:15:00.067593 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-a0916c8e-8434-4e50-bf29-f90c8a24a7fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:15:00.173761 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1240/2470] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:14:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 370 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:15:00.177343 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0916c8e-8434-4e50-bf29-f90c8a24a7fd None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:15:00.182518 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37f3d9c-6ee3-4fad-8a12-272acd4f2b92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:15:00.183317 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37f3d9c-6ee3-4fad-8a12-272acd4f2b92 service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:15:00.183597 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37f3d9c-6ee3-4fad-8a12-272acd4f2b92 service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:15:00.183864 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37f3d9c-6ee3-4fad-8a12-272acd4f2b92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:15:00.192633 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6178977c-c1c7-45b0-8845-624080bac173 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:15:00.200770 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-6178977c-c1c7-45b0-8845-624080bac173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:15:00.218119 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37f3d9c-6ee3-4fad-8a12-272acd4f2b92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:15:00.220798 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37f3d9c-6ee3-4fad-8a12-272acd4f2b92 service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:15:00.228103 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6178977c-c1c7-45b0-8845-624080bac173 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:15:00.237700 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1231/2471] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:15:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 23 21:15:00.242271 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660ad07d-5318-482f-840c-a4ce0c1e87ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:15:00.244298 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660ad07d-5318-482f-840c-a4ce0c1e87ce service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:15:00.244800 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660ad07d-5318-482f-840c-a4ce0c1e87ce service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:15:00.245891 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660ad07d-5318-482f-840c-a4ce0c1e87ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:15:00.258572 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660ad07d-5318-482f-840c-a4ce0c1e87ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:15:00.260150 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660ad07d-5318-482f-840c-a4ce0c1e87ce service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:15:00.276241 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1241/2472] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:15:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:15:01.424684 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828192fe-ef98-40c1-804d-794a41799e7b None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:15:01.425286 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828192fe-ef98-40c1-804d-794a41799e7b None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:15:01.425286 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828192fe-ef98-40c1-804d-794a41799e7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:15:01.441748 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660ad07d-5318-482f-840c-a4ce0c1e87ce service neutron] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:15:01.444648 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-660ad07d-5318-482f-840c-a4ce0c1e87ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:15:01.513698 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660ad07d-5318-482f-840c-a4ce0c1e87ce service neutron] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:15:01.523650 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-828192fe-ef98-40c1-804d-794a41799e7b None None] MFA Rules not processed for user `f2672c5db79b4a48a505c3df536594dd`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:15:01.525324 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-828192fe-ef98-40c1-804d-794a41799e7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:15:01.533889 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6c8ffb-1ee3-4895-b131-92428cfe1142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:15:01.534808 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6c8ffb-1ee3-4895-b131-92428cfe1142 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:15:01.535089 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6c8ffb-1ee3-4895-b131-92428cfe1142 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:15:01.535362 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6c8ffb-1ee3-4895-b131-92428cfe1142 admin admin] PATH_INFO: `/v3/projects/c50fb0aa12e34b4eac4be580c4e33c77` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:15:01.536720 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6c8ffb-1ee3-4895-b131-92428cfe1142 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c50fb0aa12e34b4eac4be580c4e33c77)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:15:01.538684 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6c8ffb-1ee3-4895-b131-92428cfe1142 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:15:01.544315 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:15:01.582119 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:15:01.682174 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1232/2473] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:15:01 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:15:01.683575 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828192fe-ef98-40c1-804d-794a41799e7b None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:15:01.685323 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-828192fe-ef98-40c1-804d-794a41799e7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:15:01.703044 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828192fe-ef98-40c1-804d-794a41799e7b None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:15:01.707078 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-cb6c8ffb-1ee3-4895-b131-92428cfe1142 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c50fb0aa12e34b4eac4be580c4e33c77', 'request_id': 'req-cb6c8ffb-1ee3-4895-b131-92428cfe1142'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:15:01.726774 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-cb6c8ffb-1ee3-4895-b131-92428cfe1142 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c50fb0aa12e34b4eac4be580c4e33c77', 'request_id': 'req-cb6c8ffb-1ee3-4895-b131-92428cfe1142'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:15:01.737397 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-cb6c8ffb-1ee3-4895-b131-92428cfe1142 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c50fb0aa12e34b4eac4be580c4e33c77', 'request_id': 'req-cb6c8ffb-1ee3-4895-b131-92428cfe1142'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:15:01.755850 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-cb6c8ffb-1ee3-4895-b131-92428cfe1142 admin admin] The token cache is being invalidate because project c50fb0aa12e34b4eac4be580c4e33c77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:15:01.756338 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-cb6c8ffb-1ee3-4895-b131-92428cfe1142 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:15:01.757091 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-cb6c8ffb-1ee3-4895-b131-92428cfe1142 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:15:01.759606 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1242/2474] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:15:01 2022] DELETE /identity/v3/projects/c50fb0aa12e34b4eac4be580c4e33c77 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:15:01.765303 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab91c55-889e-4a84-b111-e74010eae397 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:15:01.765682 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab91c55-889e-4a84-b111-e74010eae397 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:15:01.766591 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab91c55-889e-4a84-b111-e74010eae397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:15:01.784913 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96fec06-64f4-4900-9edc-bb5b85fbdd8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:15:01.785895 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96fec06-64f4-4900-9edc-bb5b85fbdd8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:15:01.786366 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96fec06-64f4-4900-9edc-bb5b85fbdd8e admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:15:01.786465 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96fec06-64f4-4900-9edc-bb5b85fbdd8e admin admin] PATH_INFO: `/v3/projects/dbc1f7886ea6460b8750a60994045795` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:15:01.788095 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96fec06-64f4-4900-9edc-bb5b85fbdd8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=dbc1f7886ea6460b8750a60994045795)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:15:01.790108 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96fec06-64f4-4900-9edc-bb5b85fbdd8e admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:15:01.797095 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-8ab91c55-889e-4a84-b111-e74010eae397 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:15:01.800049 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-8ab91c55-889e-4a84-b111-e74010eae397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:15:01.813913 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1243/2475] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:15:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:15:01.823059 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499b40b5-e701-444e-ac5d-f1a373f06a14 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:15:01.826164 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499b40b5-e701-444e-ac5d-f1a373f06a14 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:15:01.827015 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499b40b5-e701-444e-ac5d-f1a373f06a14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:15:01.856308 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-499b40b5-e701-444e-ac5d-f1a373f06a14 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:15:01.858835 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-499b40b5-e701-444e-ac5d-f1a373f06a14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:15:01.874694 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-e96fec06-64f4-4900-9edc-bb5b85fbdd8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dbc1f7886ea6460b8750a60994045795', 'request_id': 'req-e96fec06-64f4-4900-9edc-bb5b85fbdd8e'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:15:01.885675 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-e96fec06-64f4-4900-9edc-bb5b85fbdd8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dbc1f7886ea6460b8750a60994045795', 'request_id': 'req-e96fec06-64f4-4900-9edc-bb5b85fbdd8e'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:15:01.895514 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-e96fec06-64f4-4900-9edc-bb5b85fbdd8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dbc1f7886ea6460b8750a60994045795', 'request_id': 'req-e96fec06-64f4-4900-9edc-bb5b85fbdd8e'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:15:01.930109 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-e96fec06-64f4-4900-9edc-bb5b85fbdd8e admin admin] The token cache is being invalidate because project dbc1f7886ea6460b8750a60994045795 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:15:01.930109 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-e96fec06-64f4-4900-9edc-bb5b85fbdd8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:15:01.931260 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-e96fec06-64f4-4900-9edc-bb5b85fbdd8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:15:01.933574 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1233/2476] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:15:01 2022] DELETE /identity/v3/projects/dbc1f7886ea6460b8750a60994045795 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:15:01.934747 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfe276e-4b7b-4489-b3b8-3b97353a00a8 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:15:01.935095 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfe276e-4b7b-4489-b3b8-3b97353a00a8 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:15:01.935433 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfe276e-4b7b-4489-b3b8-3b97353a00a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:15:01.964670 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-8cfe276e-4b7b-4489-b3b8-3b97353a00a8 None None] MFA Rules not processed for user `39f1a14a59b7401d88f18ec35c91e30a`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:15:01.966026 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-8cfe276e-4b7b-4489-b3b8-3b97353a00a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:15:01.991644 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1244/2477] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:15:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:15:01.992707 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499b40b5-e701-444e-ac5d-f1a373f06a14 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:15:01.994072 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-499b40b5-e701-444e-ac5d-f1a373f06a14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:15:02.012982 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499b40b5-e701-444e-ac5d-f1a373f06a14 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:15:02.019646 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f563e3f-b418-4a65-afdd-ef3aadc68f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:15:02.020451 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f563e3f-b418-4a65-afdd-ef3aadc68f3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:15:02.020893 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f563e3f-b418-4a65-afdd-ef3aadc68f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:15:02.022378 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f563e3f-b418-4a65-afdd-ef3aadc68f3e admin admin] PATH_INFO: `/v3/users/9b094df90d174e2682f369c81f276a9e` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:15:02.024625 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f563e3f-b418-4a65-afdd-ef3aadc68f3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b094df90d174e2682f369c81f276a9e)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:15:02.026597 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:15:02.026924 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f563e3f-b418-4a65-afdd-ef3aadc68f3e admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:15:02.053271 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1234/2478] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:15:01 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:15:02.055017 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfe276e-4b7b-4489-b3b8-3b97353a00a8 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:15:02.077568 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfe276e-4b7b-4489-b3b8-3b97353a00a8 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:15:02.088476 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3ff63d-01a1-4960-8c0b-034c489ec112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:15:02.091599 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3ff63d-01a1-4960-8c0b-034c489ec112 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:15:02.091842 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3ff63d-01a1-4960-8c0b-034c489ec112 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:15:02.092104 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3ff63d-01a1-4960-8c0b-034c489ec112 admin admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:15:02.095143 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3ff63d-01a1-4960-8c0b-034c489ec112 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:15:02.095143 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3ff63d-01a1-4960-8c0b-034c489ec112 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:15:02.098109 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3ff63d-01a1-4960-8c0b-034c489ec112 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:15:02.109936 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-3f563e3f-b418-4a65-afdd-ef3aadc68f3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b094df90d174e2682f369c81f276a9e'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:15:02.111369 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-3f563e3f-b418-4a65-afdd-ef3aadc68f3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b094df90d174e2682f369c81f276a9e'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:15:02.118645 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1235/2479] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:15:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:15:02.120301 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3ff63d-01a1-4960-8c0b-034c489ec112 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:15:02.125115 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-3f563e3f-b418-4a65-afdd-ef3aadc68f3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b094df90d174e2682f369c81f276a9e'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:15:02.137197 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-3f563e3f-b418-4a65-afdd-ef3aadc68f3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b094df90d174e2682f369c81f276a9e'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:15:02.141636 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3ff63d-01a1-4960-8c0b-034c489ec112 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:15:02.158774 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30426f6c-0262-42ba-b578-45e13923fc22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:15:02.159452 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30426f6c-0262-42ba-b578-45e13923fc22 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:15:02.159728 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30426f6c-0262-42ba-b578-45e13923fc22 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:15:02.159995 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30426f6c-0262-42ba-b578-45e13923fc22 admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:15:02.160712 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30426f6c-0262-42ba-b578-45e13923fc22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:15:02.162615 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30426f6c-0262-42ba-b578-45e13923fc22 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:15:02.172722 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-3f563e3f-b418-4a65-afdd-ef3aadc68f3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b094df90d174e2682f369c81f276a9e'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:15:02.180768 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1245/2480] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:15:01 2022] DELETE /identity/v3/users/9b094df90d174e2682f369c81f276a9e => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:15:02.230574 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1236/2481] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:15:02 2022] POST /identity/v3/projects => generated 373 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:15:02.233899 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f563e3f-b418-4a65-afdd-ef3aadc68f3e admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:15:02.235779 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-3f563e3f-b418-4a65-afdd-ef3aadc68f3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:15:02.246053 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:15:02.322154 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f563e3f-b418-4a65-afdd-ef3aadc68f3e admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:15:02.419181 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1b41b2-efc7-482b-b3bf-585ced9e3195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:15:02.420529 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1b41b2-efc7-482b-b3bf-585ced9e3195 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:15:02.420965 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1b41b2-efc7-482b-b3bf-585ced9e3195 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:15:02.421384 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1b41b2-efc7-482b-b3bf-585ced9e3195 admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:15:02.422388 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1b41b2-efc7-482b-b3bf-585ced9e3195 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:15:02.424769 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1b41b2-efc7-482b-b3bf-585ced9e3195 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:15:02.454067 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1246/2482] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:15:02 2022] POST /identity/v3/users => generated 287 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:15:02.457271 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30426f6c-0262-42ba-b578-45e13923fc22 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:15:02.469692 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30426f6c-0262-42ba-b578-45e13923fc22 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:15:02.478255 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a275b2-ad50-4769-8e96-12ae50241db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:15:02.479004 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a275b2-ad50-4769-8e96-12ae50241db0 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:15:02.479373 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a275b2-ad50-4769-8e96-12ae50241db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:15:02.479709 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a275b2-ad50-4769-8e96-12ae50241db0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:15:02.480659 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a275b2-ad50-4769-8e96-12ae50241db0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:15:02.482551 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a275b2-ad50-4769-8e96-12ae50241db0 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:15:02.496469 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1237/2483] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:15:02 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:15:02.498355 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1b41b2-efc7-482b-b3bf-585ced9e3195 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:15:02.511879 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1b41b2-efc7-482b-b3bf-585ced9e3195 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:15:02.515645 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6769f5-55de-486c-b72d-67f4daa82ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:15:02.516327 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6769f5-55de-486c-b72d-67f4daa82ca6 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:15:02.516604 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6769f5-55de-486c-b72d-67f4daa82ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:15:02.516869 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6769f5-55de-486c-b72d-67f4daa82ca6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:15:02.517805 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6769f5-55de-486c-b72d-67f4daa82ca6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:15:02.519445 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6769f5-55de-486c-b72d-67f4daa82ca6 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:15:02.531190 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1247/2484] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:15:02 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 21:15:02.535323 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a275b2-ad50-4769-8e96-12ae50241db0 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:15:02.548595 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a275b2-ad50-4769-8e96-12ae50241db0 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:15:02.554079 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5de77e-b1b2-43a4-89c0-bf1c34970eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:15:02.554866 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5de77e-b1b2-43a4-89c0-bf1c34970eee admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:15:02.555164 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5de77e-b1b2-43a4-89c0-bf1c34970eee admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:15:02.555536 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5de77e-b1b2-43a4-89c0-bf1c34970eee admin admin] PATH_INFO: `/v3/projects/21523d7e146e4e84a1a85222141c6e7b/users/89b3fe601e1a476ea1abb1870769eb60/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:15:02.578441 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5de77e-b1b2-43a4-89c0-bf1c34970eee admin admin] RBAC: Authorizing `identity:create_grant(project_id=21523d7e146e4e84a1a85222141c6e7b, user_id=89b3fe601e1a476ea1abb1870769eb60, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:15:02.581567 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5de77e-b1b2-43a4-89c0-bf1c34970eee admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:15:02.600146 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1238/2485] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:15:02 2022] PUT /identity/v3/projects/21523d7e146e4e84a1a85222141c6e7b/users/89b3fe601e1a476ea1abb1870769eb60/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:15:02.607450 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa84cf5-0495-433a-a23d-79564add93d3 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:15:02.609210 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa84cf5-0495-433a-a23d-79564add93d3 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:15:02.610454 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa84cf5-0495-433a-a23d-79564add93d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:15:02.639231 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-9aa84cf5-0495-433a-a23d-79564add93d3 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:15:02.641727 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-9aa84cf5-0495-433a-a23d-79564add93d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:15:02.709788 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1248/2486] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:15:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:15:02.732237 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5de77e-b1b2-43a4-89c0-bf1c34970eee admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:15:02.734049 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-9d5de77e-b1b2-43a4-89c0-bf1c34970eee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:15:02.811468 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5de77e-b1b2-43a4-89c0-bf1c34970eee admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:15:02.816470 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e807fe-7681-4b44-bb91-e85f8baef8a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:15:02.818764 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e807fe-7681-4b44-bb91-e85f8baef8a7 service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:15:02.818764 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e807fe-7681-4b44-bb91-e85f8baef8a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:15:02.818764 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e807fe-7681-4b44-bb91-e85f8baef8a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:15:02.831368 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e807fe-7681-4b44-bb91-e85f8baef8a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:15:02.833390 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e807fe-7681-4b44-bb91-e85f8baef8a7 service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:15:02.849166 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1239/2487] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:15:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 23 21:15:02.933787 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa84cf5-0495-433a-a23d-79564add93d3 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:15:02.935896 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-9aa84cf5-0495-433a-a23d-79564add93d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:15:02.993104 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa84cf5-0495-433a-a23d-79564add93d3 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:15:03.000008 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de125b58-ed0b-4312-8101-8a1f46773caa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:15:03.001742 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de125b58-ed0b-4312-8101-8a1f46773caa admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:15:03.002861 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de125b58-ed0b-4312-8101-8a1f46773caa admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:15:03.003143 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de125b58-ed0b-4312-8101-8a1f46773caa admin admin] PATH_INFO: `/v3/projects/df5b2f484bad45b48dc70043477724d0` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:15:03.004499 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de125b58-ed0b-4312-8101-8a1f46773caa admin admin] RBAC: Authorizing `identity:delete_project(project_id=df5b2f484bad45b48dc70043477724d0)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:15:03.006737 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de125b58-ed0b-4312-8101-8a1f46773caa admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:15:03.081072 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:15:03.103880 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-de125b58-ed0b-4312-8101-8a1f46773caa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df5b2f484bad45b48dc70043477724d0', 'request_id': 'req-de125b58-ed0b-4312-8101-8a1f46773caa'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:15:03.115278 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-de125b58-ed0b-4312-8101-8a1f46773caa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df5b2f484bad45b48dc70043477724d0', 'request_id': 'req-de125b58-ed0b-4312-8101-8a1f46773caa'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:15:03.122059 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-de125b58-ed0b-4312-8101-8a1f46773caa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df5b2f484bad45b48dc70043477724d0', 'request_id': 'req-de125b58-ed0b-4312-8101-8a1f46773caa'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:15:03.138920 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-de125b58-ed0b-4312-8101-8a1f46773caa admin admin] The token cache is being invalidate because project df5b2f484bad45b48dc70043477724d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:15:03.139400 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-de125b58-ed0b-4312-8101-8a1f46773caa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:15:03.140640 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-de125b58-ed0b-4312-8101-8a1f46773caa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:15:03.142539 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1249/2488] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:15:02 2022] DELETE /identity/v3/projects/df5b2f484bad45b48dc70043477724d0 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:15:03.147628 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1d324b-e350-40f2-b489-8d964f09ed13 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:15:03.148206 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1d324b-e350-40f2-b489-8d964f09ed13 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:15:03.149988 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1d324b-e350-40f2-b489-8d964f09ed13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:15:03.194326 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-0f1d324b-e350-40f2-b489-8d964f09ed13 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:15:03.195896 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-0f1d324b-e350-40f2-b489-8d964f09ed13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:15:03.330146 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1240/2489] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:15:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:15:03.332462 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa7e4c0-315d-45f6-abdc-2c1b03976f7d None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:15:03.332723 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa7e4c0-315d-45f6-abdc-2c1b03976f7d None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:15:03.332998 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa7e4c0-315d-45f6-abdc-2c1b03976f7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:15:03.386708 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-3fa7e4c0-315d-45f6-abdc-2c1b03976f7d None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:15:03.388106 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-3fa7e4c0-315d-45f6-abdc-2c1b03976f7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:15:03.401712 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1250/2490] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:15:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:15:03.403079 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1d324b-e350-40f2-b489-8d964f09ed13 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:15:03.418394 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1d324b-e350-40f2-b489-8d964f09ed13 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:15:03.424417 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b05cb7a-b90b-4754-9c0a-8f85bbc81b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:15:03.425120 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b05cb7a-b90b-4754-9c0a-8f85bbc81b7c admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:15:03.425395 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b05cb7a-b90b-4754-9c0a-8f85bbc81b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:15:03.425664 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b05cb7a-b90b-4754-9c0a-8f85bbc81b7c admin admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:15:03.426753 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b05cb7a-b90b-4754-9c0a-8f85bbc81b7c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:15:03.427101 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b05cb7a-b90b-4754-9c0a-8f85bbc81b7c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:15:03.428682 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b05cb7a-b90b-4754-9c0a-8f85bbc81b7c admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:15:03.446543 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1241/2491] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:15:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:15:03.447838 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa7e4c0-315d-45f6-abdc-2c1b03976f7d None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:15:03.459604 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa7e4c0-315d-45f6-abdc-2c1b03976f7d None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:15:03.464660 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6b2c35-673a-490c-876d-61ee97e4d3d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:15:03.465312 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6b2c35-673a-490c-876d-61ee97e4d3d7 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:15:03.465588 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6b2c35-673a-490c-876d-61ee97e4d3d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:15:03.465893 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6b2c35-673a-490c-876d-61ee97e4d3d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:15:03.466573 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6b2c35-673a-490c-876d-61ee97e4d3d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:15:03.468463 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6b2c35-673a-490c-876d-61ee97e4d3d7 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:15:03.505037 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1251/2492] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:15:03 2022] POST /identity/v3/projects => generated 379 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:15:03.509240 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b05cb7a-b90b-4754-9c0a-8f85bbc81b7c admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:15:03.522656 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b05cb7a-b90b-4754-9c0a-8f85bbc81b7c admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:15:03.530801 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:15:03.627555 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914c8c64-74ae-4821-80c3-c2d62a3efa03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:15:03.628736 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914c8c64-74ae-4821-80c3-c2d62a3efa03 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:15:03.629376 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914c8c64-74ae-4821-80c3-c2d62a3efa03 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:15:03.629835 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914c8c64-74ae-4821-80c3-c2d62a3efa03 admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:15:03.631331 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914c8c64-74ae-4821-80c3-c2d62a3efa03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:15:03.634013 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914c8c64-74ae-4821-80c3-c2d62a3efa03 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:15:03.660454 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1242/2493] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:15:03 2022] POST /identity/v3/users => generated 290 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:15:03.664457 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6b2c35-673a-490c-876d-61ee97e4d3d7 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:15:03.680697 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6b2c35-673a-490c-876d-61ee97e4d3d7 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:15:03.691923 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0409e008-4207-4158-9ace-5f19efa3ec62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:15:03.692901 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0409e008-4207-4158-9ace-5f19efa3ec62 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:15:03.693179 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0409e008-4207-4158-9ace-5f19efa3ec62 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:15:03.693489 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0409e008-4207-4158-9ace-5f19efa3ec62 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:15:03.694469 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0409e008-4207-4158-9ace-5f19efa3ec62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:15:03.696676 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0409e008-4207-4158-9ace-5f19efa3ec62 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:15:03.713331 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1252/2494] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:15:03 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:15:03.714120 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914c8c64-74ae-4821-80c3-c2d62a3efa03 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:15:03.733071 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914c8c64-74ae-4821-80c3-c2d62a3efa03 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:15:03.740483 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b99d09d-b728-4266-a2d5-a1aaa5a9adc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:15:03.742240 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b99d09d-b728-4266-a2d5-a1aaa5a9adc7 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:15:03.742837 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b99d09d-b728-4266-a2d5-a1aaa5a9adc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:15:03.742938 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b99d09d-b728-4266-a2d5-a1aaa5a9adc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:15:03.743657 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b99d09d-b728-4266-a2d5-a1aaa5a9adc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:15:03.746233 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b99d09d-b728-4266-a2d5-a1aaa5a9adc7 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:15:03.765096 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1243/2495] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:15:03 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:15:03.767096 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0409e008-4207-4158-9ace-5f19efa3ec62 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:15:03.783891 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0409e008-4207-4158-9ace-5f19efa3ec62 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:15:03.790583 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0c103e-e7f6-48b4-bd19-637f6de999e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:15:03.791578 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0c103e-e7f6-48b4-bd19-637f6de999e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:15:03.791869 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0c103e-e7f6-48b4-bd19-637f6de999e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:15:03.792127 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0c103e-e7f6-48b4-bd19-637f6de999e1 admin admin] PATH_INFO: `/v3/projects/f5e7d37a0e3b4b32ae99c3bc15a831e6/users/ebf92af08fa94215b4eafcacea6c63f6/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:15:03.811828 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0c103e-e7f6-48b4-bd19-637f6de999e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5e7d37a0e3b4b32ae99c3bc15a831e6, user_id=ebf92af08fa94215b4eafcacea6c63f6, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:15:03.814994 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0c103e-e7f6-48b4-bd19-637f6de999e1 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:15:03.835250 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1253/2496] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:15:03 2022] PUT /identity/v3/projects/f5e7d37a0e3b4b32ae99c3bc15a831e6/users/ebf92af08fa94215b4eafcacea6c63f6/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:15:03.845877 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c59604-6b32-4993-aab4-f8cae9f1ac0f None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:15:03.846097 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c59604-6b32-4993-aab4-f8cae9f1ac0f None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:15:03.846361 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c59604-6b32-4993-aab4-f8cae9f1ac0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:15:03.909818 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-f1c59604-6b32-4993-aab4-f8cae9f1ac0f None None] MFA Rules not processed for user `ebf92af08fa94215b4eafcacea6c63f6`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:15:03.911311 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-f1c59604-6b32-4993-aab4-f8cae9f1ac0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:15:04.038012 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1244/2497] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:15:03 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:15:04.038332 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0c103e-e7f6-48b4-bd19-637f6de999e1 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:15:04.176006 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0c103e-e7f6-48b4-bd19-637f6de999e1 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:15:04.181688 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77e5256-5c96-4250-9e5a-0fafadf28424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:15:04.182845 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77e5256-5c96-4250-9e5a-0fafadf28424 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:15:04.183960 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77e5256-5c96-4250-9e5a-0fafadf28424 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:15:04.184262 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77e5256-5c96-4250-9e5a-0fafadf28424 admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:15:04.184981 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77e5256-5c96-4250-9e5a-0fafadf28424 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:15:04.187995 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77e5256-5c96-4250-9e5a-0fafadf28424 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:15:04.257406 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1254/2498] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:15:04 2022] POST /identity/v3/projects => generated 383 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:15:04.258031 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c59604-6b32-4993-aab4-f8cae9f1ac0f None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:15:04.274993 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c59604-6b32-4993-aab4-f8cae9f1ac0f None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:15:04.356176 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a751ec-db10-415c-b692-623d3f0481a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:15:04.356898 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a751ec-db10-415c-b692-623d3f0481a1 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:15:04.357168 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a751ec-db10-415c-b692-623d3f0481a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:15:04.357442 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a751ec-db10-415c-b692-623d3f0481a1 admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:15:04.358202 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a751ec-db10-415c-b692-623d3f0481a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:15:04.360334 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a751ec-db10-415c-b692-623d3f0481a1 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:15:04.397079 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1245/2499] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:15:04 2022] POST /identity/v3/users => generated 298 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:15:04.401243 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77e5256-5c96-4250-9e5a-0fafadf28424 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:15:04.421901 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77e5256-5c96-4250-9e5a-0fafadf28424 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:15:04.427744 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42948cc2-ea0e-404f-b854-4cd04423df7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:15:04.428505 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42948cc2-ea0e-404f-b854-4cd04423df7e admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:15:04.429519 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42948cc2-ea0e-404f-b854-4cd04423df7e admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:15:04.430811 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42948cc2-ea0e-404f-b854-4cd04423df7e admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:15:04.431925 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42948cc2-ea0e-404f-b854-4cd04423df7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:15:04.446674 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42948cc2-ea0e-404f-b854-4cd04423df7e admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:15:04.498347 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1255/2500] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:15:04 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:15:04.502027 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a751ec-db10-415c-b692-623d3f0481a1 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:15:04.518448 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a751ec-db10-415c-b692-623d3f0481a1 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:15:04.529380 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e28b18-4780-4505-8a6a-1793a2401a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:15:04.530336 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e28b18-4780-4505-8a6a-1793a2401a97 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:15:04.530621 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e28b18-4780-4505-8a6a-1793a2401a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:15:04.530893 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e28b18-4780-4505-8a6a-1793a2401a97 admin admin] PATH_INFO: `/v3/projects/881735f360a54c159c565d09f8ddf98a/users/b840b07183424a7f9ed49511a83b2958/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:15:04.538084 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:15:04.558970 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e28b18-4780-4505-8a6a-1793a2401a97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=881735f360a54c159c565d09f8ddf98a, user_id=b840b07183424a7f9ed49511a83b2958, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:15:04.562621 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e28b18-4780-4505-8a6a-1793a2401a97 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:15:04.604237 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1246/2501] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:15:04 2022] PUT /identity/v3/projects/881735f360a54c159c565d09f8ddf98a/users/b840b07183424a7f9ed49511a83b2958/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:15:04.614242 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42948cc2-ea0e-404f-b854-4cd04423df7e admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:15:04.627289 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42948cc2-ea0e-404f-b854-4cd04423df7e admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:15:04.692813 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:15:04.741810 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0199328-6b94-41a8-adcc-7448bedc3906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:15:04.742790 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0199328-6b94-41a8-adcc-7448bedc3906 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:15:04.743254 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0199328-6b94-41a8-adcc-7448bedc3906 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:15:04.743912 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0199328-6b94-41a8-adcc-7448bedc3906 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:15:04.745479 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0199328-6b94-41a8-adcc-7448bedc3906 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:15:04.747656 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0199328-6b94-41a8-adcc-7448bedc3906 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:15:04.763256 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1256/2502] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:15:04 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:15:04.767178 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e28b18-4780-4505-8a6a-1793a2401a97 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:15:04.792353 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e28b18-4780-4505-8a6a-1793a2401a97 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:15:04.809820 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a78e40b-5d09-4546-8ea7-a40ce01716a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:15:04.811099 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a78e40b-5d09-4546-8ea7-a40ce01716a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:15:04.811581 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a78e40b-5d09-4546-8ea7-a40ce01716a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:15:04.812050 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a78e40b-5d09-4546-8ea7-a40ce01716a3 admin admin] PATH_INFO: `/v3/projects/881735f360a54c159c565d09f8ddf98a/users/b840b07183424a7f9ed49511a83b2958/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:15:04.817707 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a78e40b-5d09-4546-8ea7-a40ce01716a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=881735f360a54c159c565d09f8ddf98a, user_id=b840b07183424a7f9ed49511a83b2958, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:15:04.822919 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a78e40b-5d09-4546-8ea7-a40ce01716a3 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:15:04.851856 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1247/2503] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:15:04 2022] PUT /identity/v3/projects/881735f360a54c159c565d09f8ddf98a/users/b840b07183424a7f9ed49511a83b2958/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:15:04.865884 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5159f65-b82f-4baf-b0e0-3a18fcf55285 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:15:04.866409 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5159f65-b82f-4baf-b0e0-3a18fcf55285 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:15:04.866904 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5159f65-b82f-4baf-b0e0-3a18fcf55285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:15:04.916873 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-d5159f65-b82f-4baf-b0e0-3a18fcf55285 None None] MFA Rules not processed for user `b840b07183424a7f9ed49511a83b2958`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:15:04.918728 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-d5159f65-b82f-4baf-b0e0-3a18fcf55285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:15:05.035689 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1257/2504] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:15:04 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:15:05.045657 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faa893c-f31f-4b31-9c9c-ea92696ebb60 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:15:05.046143 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faa893c-f31f-4b31-9c9c-ea92696ebb60 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:15:05.046425 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faa893c-f31f-4b31-9c9c-ea92696ebb60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:15:05.069636 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-6faa893c-f31f-4b31-9c9c-ea92696ebb60 None None] MFA Rules not processed for user `ebf92af08fa94215b4eafcacea6c63f6`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:15:05.071406 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-6faa893c-f31f-4b31-9c9c-ea92696ebb60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:15:05.244338 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1248/2505] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:15:05 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:15:05.259124 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5159f65-b82f-4baf-b0e0-3a18fcf55285 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:15:05.261237 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-d5159f65-b82f-4baf-b0e0-3a18fcf55285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:15:05.453776 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5159f65-b82f-4baf-b0e0-3a18fcf55285 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:15:05.460724 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4c4fa6-d748-4bde-a80f-8aff1895d7b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:15:05.461675 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4c4fa6-d748-4bde-a80f-8aff1895d7b6 service nova] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:15:05.461992 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4c4fa6-d748-4bde-a80f-8aff1895d7b6 service nova] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:15:05.462270 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4c4fa6-d748-4bde-a80f-8aff1895d7b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:15:05.474570 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4c4fa6-d748-4bde-a80f-8aff1895d7b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:15:05.477973 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4c4fa6-d748-4bde-a80f-8aff1895d7b6 service nova] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:15:05.491322 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1258/2506] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:15:05 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:15:07.836181 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faa893c-f31f-4b31-9c9c-ea92696ebb60 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:15:07.854738 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faa893c-f31f-4b31-9c9c-ea92696ebb60 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:15:07.865297 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86c5975-5d08-41ae-84f4-24c3fe13039b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:15:07.866369 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86c5975-5d08-41ae-84f4-24c3fe13039b service nova] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:15:07.866884 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86c5975-5d08-41ae-84f4-24c3fe13039b service nova] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:15:07.867448 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86c5975-5d08-41ae-84f4-24c3fe13039b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:15:07.870474 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-f86c5975-5d08-41ae-84f4-24c3fe13039b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:15:07.981086 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86c5975-5d08-41ae-84f4-24c3fe13039b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:15:07.983025 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86c5975-5d08-41ae-84f4-24c3fe13039b service nova] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:15:08.030989 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1249/2507] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:15:07 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:15:11.218979 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0524a3c-1578-4a26-86c8-62fc1d7fdaa7 None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:15:11.219799 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0524a3c-1578-4a26-86c8-62fc1d7fdaa7 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:15:11.220078 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0524a3c-1578-4a26-86c8-62fc1d7fdaa7 None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:15:11.221883 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1259/2508] 10.222.0.17 () {54 vars in 921 bytes} [Sat Jul 23 21:15:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:15:11.227662 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bcd602-1941-460d-bfa3-5c1458d0c596 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:15:11.228527 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bcd602-1941-460d-bfa3-5c1458d0c596 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:15:11.228969 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bcd602-1941-460d-bfa3-5c1458d0c596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:15:11.263957 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-51bcd602-1941-460d-bfa3-5c1458d0c596 None None] MFA Rules not processed for user `abc719a3b3ac4461b82ca04ab6451d81`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:15:11.265226 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-51bcd602-1941-460d-bfa3-5c1458d0c596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:15:11.416709 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1250/2509] 10.222.0.17 () {58 vars in 1018 bytes} [Sat Jul 23 21:15:11 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:15:11.446171 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0524a3c-1578-4a26-86c8-62fc1d7fdaa7 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:15:11.448394 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-e0524a3c-1578-4a26-86c8-62fc1d7fdaa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:15:11.470178 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0524a3c-1578-4a26-86c8-62fc1d7fdaa7 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:15:11.478592 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2ab92b-d9d9-41f9-a3fd-fc9bacc82dbd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc719a3b3ac4461b82ca04ab6451d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:15:11.479989 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2ab92b-d9d9-41f9-a3fd-fc9bacc82dbd service placement] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:15:11.480349 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2ab92b-d9d9-41f9-a3fd-fc9bacc82dbd service placement] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:15:11.480796 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2ab92b-d9d9-41f9-a3fd-fc9bacc82dbd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:15:11.493277 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2ab92b-d9d9-41f9-a3fd-fc9bacc82dbd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:15:11.495722 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2ab92b-d9d9-41f9-a3fd-fc9bacc82dbd service placement] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:15:11.514460 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1260/2510] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:15:11 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:15:12.484801 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61442675-7e58-4722-83d8-575aaf877c50 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:15:12.485369 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61442675-7e58-4722-83d8-575aaf877c50 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:15:12.485570 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61442675-7e58-4722-83d8-575aaf877c50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:15:12.496454 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:15:12.528026 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-61442675-7e58-4722-83d8-575aaf877c50 None None] MFA Rules not processed for user `079f31ed2c844e67bd4e206f24b69d97`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:15:12.529709 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-61442675-7e58-4722-83d8-575aaf877c50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:15:12.552935 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1251/2511] 10.222.0.17 () {58 vars in 1018 bytes} [Sat Jul 23 21:15:12 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:15:12.627572 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2ab92b-d9d9-41f9-a3fd-fc9bacc82dbd service placement] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:15:12.633669 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-4b2ab92b-d9d9-41f9-a3fd-fc9bacc82dbd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:15:12.670215 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:15:12.717630 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2ab92b-d9d9-41f9-a3fd-fc9bacc82dbd service placement] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:15:12.722622 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12273ae1-a57b-4da1-bdd1-855a5f96a65b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:15:12.723631 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12273ae1-a57b-4da1-bdd1-855a5f96a65b service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:15:12.724123 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12273ae1-a57b-4da1-bdd1-855a5f96a65b service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:15:12.724594 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12273ae1-a57b-4da1-bdd1-855a5f96a65b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:15:12.737490 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12273ae1-a57b-4da1-bdd1-855a5f96a65b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:15:12.739447 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12273ae1-a57b-4da1-bdd1-855a5f96a65b service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:15:12.756406 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1261/2512] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:15:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:15:14.714861 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61442675-7e58-4722-83d8-575aaf877c50 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:15:14.730191 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61442675-7e58-4722-83d8-575aaf877c50 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:15:14.741288 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7402cd6c-acc4-4454-9f68-bc23820ade86 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:15:14.742552 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7402cd6c-acc4-4454-9f68-bc23820ade86 service nova] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:15:14.743017 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7402cd6c-acc4-4454-9f68-bc23820ade86 service nova] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:15:14.743653 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7402cd6c-acc4-4454-9f68-bc23820ade86 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:15:14.746687 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-7402cd6c-acc4-4454-9f68-bc23820ade86 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:15:14.854984 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7402cd6c-acc4-4454-9f68-bc23820ade86 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:15:14.857050 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7402cd6c-acc4-4454-9f68-bc23820ade86 service nova] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:15:14.873626 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1252/2513] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:15:14 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:15:15.360859 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9aa0c4-b6c7-4cb0-89d3-140c09258dfe None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:15:15.361470 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9aa0c4-b6c7-4cb0-89d3-140c09258dfe None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:15:15.361605 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9aa0c4-b6c7-4cb0-89d3-140c09258dfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:15:15.394888 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-ec9aa0c4-b6c7-4cb0-89d3-140c09258dfe None None] MFA Rules not processed for user `8a872dad882e4694aba20eaa8c06df53`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:15:15.413808 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-ec9aa0c4-b6c7-4cb0-89d3-140c09258dfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:15:15.551984 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1262/2514] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:15:15 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:15:16.828879 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bc104a-2af3-4a82-a801-f56b23f744e2 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:15:16.829457 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bc104a-2af3-4a82-a801-f56b23f744e2 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:15:16.829457 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bc104a-2af3-4a82-a801-f56b23f744e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:15:16.860691 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-a2bc104a-2af3-4a82-a801-f56b23f744e2 None None] MFA Rules not processed for user `89b3fe601e1a476ea1abb1870769eb60`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:15:16.862289 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-a2bc104a-2af3-4a82-a801-f56b23f744e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:15:16.946376 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1253/2515] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:15:16 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:15:17.013717 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9aa0c4-b6c7-4cb0-89d3-140c09258dfe None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:15:17.015955 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-ec9aa0c4-b6c7-4cb0-89d3-140c09258dfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:15:17.039648 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9aa0c4-b6c7-4cb0-89d3-140c09258dfe None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:15:17.045933 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c87f25-e9bc-4be4-9b07-29c6ab00d41c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:15:17.046922 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c87f25-e9bc-4be4-9b07-29c6ab00d41c service nova] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:15:17.047359 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c87f25-e9bc-4be4-9b07-29c6ab00d41c service nova] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:15:17.047779 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c87f25-e9bc-4be4-9b07-29c6ab00d41c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:15:17.057147 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c87f25-e9bc-4be4-9b07-29c6ab00d41c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:15:17.059158 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c87f25-e9bc-4be4-9b07-29c6ab00d41c service nova] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:15:17.083037 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1263/2516] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:15:17 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:15:21.731113 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a44213-aeb8-4e38-84d1-bdd9d5de0f75 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:15:21.731596 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a44213-aeb8-4e38-84d1-bdd9d5de0f75 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:15:21.731792 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a44213-aeb8-4e38-84d1-bdd9d5de0f75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:15:21.780658 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-47a44213-aeb8-4e38-84d1-bdd9d5de0f75 None None] MFA Rules not processed for user `0133d9533fbd4be5b46dc308dbe3a7d9`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:15:21.785310 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-47a44213-aeb8-4e38-84d1-bdd9d5de0f75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:15:21.932046 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1254/2517] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:15:21 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:15:26.369090 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c87f25-e9bc-4be4-9b07-29c6ab00d41c service nova] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:15:26.370634 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-b1c87f25-e9bc-4be4-9b07-29c6ab00d41c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:15:26.485809 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c87f25-e9bc-4be4-9b07-29c6ab00d41c service nova] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:15:26.492537 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe568e8-941d-48b3-a96d-23e0c1c77eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:15:26.493898 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe568e8-941d-48b3-a96d-23e0c1c77eb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:15:26.494351 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe568e8-941d-48b3-a96d-23e0c1c77eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:15:26.494918 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe568e8-941d-48b3-a96d-23e0c1c77eb8 admin admin] PATH_INFO: `/v3/users/90d3840d84f34ae5ba5d95b4c96847ba` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:15:26.497004 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe568e8-941d-48b3-a96d-23e0c1c77eb8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=90d3840d84f34ae5ba5d95b4c96847ba)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:15:26.499411 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe568e8-941d-48b3-a96d-23e0c1c77eb8 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:15:26.533634 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a44213-aeb8-4e38-84d1-bdd9d5de0f75 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:15:26.560664 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a44213-aeb8-4e38-84d1-bdd9d5de0f75 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:15:26.589987 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183abb36-0879-4485-9eb9-a3ce5d6fab01 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:15:26.592110 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183abb36-0879-4485-9eb9-a3ce5d6fab01 service nova] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:15:26.592644 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183abb36-0879-4485-9eb9-a3ce5d6fab01 service nova] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:15:26.593432 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183abb36-0879-4485-9eb9-a3ce5d6fab01 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:15:26.621238 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183abb36-0879-4485-9eb9-a3ce5d6fab01 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:15:26.631705 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183abb36-0879-4485-9eb9-a3ce5d6fab01 service nova] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:15:26.644572 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-abe568e8-941d-48b3-a96d-23e0c1c77eb8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90d3840d84f34ae5ba5d95b4c96847ba'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:15:26.646307 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-abe568e8-941d-48b3-a96d-23e0c1c77eb8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90d3840d84f34ae5ba5d95b4c96847ba'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:15:26.662258 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:15:26.664520 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1255/2518] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:15:26 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:15:26.666672 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-abe568e8-941d-48b3-a96d-23e0c1c77eb8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90d3840d84f34ae5ba5d95b4c96847ba'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:15:26.690097 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-abe568e8-941d-48b3-a96d-23e0c1c77eb8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90d3840d84f34ae5ba5d95b4c96847ba'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:15:26.716132 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-abe568e8-941d-48b3-a96d-23e0c1c77eb8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90d3840d84f34ae5ba5d95b4c96847ba'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:15:26.727219 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1264/2519] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:15:26 2022] DELETE /identity/v3/users/90d3840d84f34ae5ba5d95b4c96847ba => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:15:26.732157 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bfc51c-85e7-4c01-9a3f-100bdd9db197 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:15:26.732619 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bfc51c-85e7-4c01-9a3f-100bdd9db197 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:15:26.733170 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bfc51c-85e7-4c01-9a3f-100bdd9db197 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:15:26.757191 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-64bfc51c-85e7-4c01-9a3f-100bdd9db197 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:15:26.759098 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-64bfc51c-85e7-4c01-9a3f-100bdd9db197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:15:26.786888 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:15:26.857724 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1256/2520] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:15:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:15:26.872423 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe568e8-941d-48b3-a96d-23e0c1c77eb8 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:15:26.877610 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-abe568e8-941d-48b3-a96d-23e0c1c77eb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:15:26.963073 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe568e8-941d-48b3-a96d-23e0c1c77eb8 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:15:26.973942 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfd5468-9ce6-4f76-a0b9-b4f29b7f8b3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:15:26.974745 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfd5468-9ce6-4f76-a0b9-b4f29b7f8b3c service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:15:26.975235 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfd5468-9ce6-4f76-a0b9-b4f29b7f8b3c service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:15:26.975695 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfd5468-9ce6-4f76-a0b9-b4f29b7f8b3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:15:26.988279 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfd5468-9ce6-4f76-a0b9-b4f29b7f8b3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:15:26.990181 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfd5468-9ce6-4f76-a0b9-b4f29b7f8b3c service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:15:27.003881 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1265/2521] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:15:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:15:27.409299 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bfc51c-85e7-4c01-9a3f-100bdd9db197 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:15:27.410840 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-64bfc51c-85e7-4c01-9a3f-100bdd9db197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:15:27.434807 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bfc51c-85e7-4c01-9a3f-100bdd9db197 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:15:27.446618 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c2b8cf-be75-450b-9d78-50e9f9a78a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:15:27.447734 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c2b8cf-be75-450b-9d78-50e9f9a78a7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:15:27.448235 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c2b8cf-be75-450b-9d78-50e9f9a78a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:15:27.448555 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c2b8cf-be75-450b-9d78-50e9f9a78a7c admin admin] PATH_INFO: `/v3/projects/fcf6363b1e154ff59ee30143aee3d4f1` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:15:27.451301 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c2b8cf-be75-450b-9d78-50e9f9a78a7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=fcf6363b1e154ff59ee30143aee3d4f1)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:15:27.454841 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c2b8cf-be75-450b-9d78-50e9f9a78a7c admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:15:27.536780 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-d7c2b8cf-be75-450b-9d78-50e9f9a78a7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fcf6363b1e154ff59ee30143aee3d4f1', 'request_id': 'req-d7c2b8cf-be75-450b-9d78-50e9f9a78a7c'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:15:27.542906 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-d7c2b8cf-be75-450b-9d78-50e9f9a78a7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fcf6363b1e154ff59ee30143aee3d4f1', 'request_id': 'req-d7c2b8cf-be75-450b-9d78-50e9f9a78a7c'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:15:27.555068 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-d7c2b8cf-be75-450b-9d78-50e9f9a78a7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fcf6363b1e154ff59ee30143aee3d4f1', 'request_id': 'req-d7c2b8cf-be75-450b-9d78-50e9f9a78a7c'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:15:27.570144 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-d7c2b8cf-be75-450b-9d78-50e9f9a78a7c admin admin] The token cache is being invalidate because project fcf6363b1e154ff59ee30143aee3d4f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:15:27.571154 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-d7c2b8cf-be75-450b-9d78-50e9f9a78a7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:15:27.572219 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-d7c2b8cf-be75-450b-9d78-50e9f9a78a7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:15:27.580199 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1257/2522] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:15:27 2022] DELETE /identity/v3/projects/fcf6363b1e154ff59ee30143aee3d4f1 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:15:27.582302 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfd5468-9ce6-4f76-a0b9-b4f29b7f8b3c service neutron] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:15:27.598496 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfd5468-9ce6-4f76-a0b9-b4f29b7f8b3c service neutron] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:15:27.694927 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c29072-4611-43f2-8d60-1c029401b761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:15:27.696199 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c29072-4611-43f2-8d60-1c029401b761 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:15:27.696714 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c29072-4611-43f2-8d60-1c029401b761 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:15:27.697187 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c29072-4611-43f2-8d60-1c029401b761 admin admin] PATH_INFO: `/v3/users/542d3eb2cfe149329fac67ac1cdc036e` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:15:27.698668 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c29072-4611-43f2-8d60-1c029401b761 admin admin] RBAC: Authorizing `identity:delete_user(user_id=542d3eb2cfe149329fac67ac1cdc036e)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:15:27.701205 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c29072-4611-43f2-8d60-1c029401b761 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:15:27.782730 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-14c29072-4611-43f2-8d60-1c029401b761 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '542d3eb2cfe149329fac67ac1cdc036e'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:15:27.784047 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-14c29072-4611-43f2-8d60-1c029401b761 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '542d3eb2cfe149329fac67ac1cdc036e'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:15:27.794873 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-14c29072-4611-43f2-8d60-1c029401b761 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '542d3eb2cfe149329fac67ac1cdc036e'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:15:27.830796 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-14c29072-4611-43f2-8d60-1c029401b761 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '542d3eb2cfe149329fac67ac1cdc036e'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:15:27.850971 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:15:27.853894 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-14c29072-4611-43f2-8d60-1c029401b761 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '542d3eb2cfe149329fac67ac1cdc036e'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:15:27.867141 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1266/2523] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:15:27 2022] DELETE /identity/v3/users/542d3eb2cfe149329fac67ac1cdc036e => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:15:28.122144 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f3cc84-6aac-4cd4-abc8-218b866d6da8 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:15:28.122432 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f3cc84-6aac-4cd4-abc8-218b866d6da8 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:15:28.122895 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f3cc84-6aac-4cd4-abc8-218b866d6da8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:15:28.149104 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-91f3cc84-6aac-4cd4-abc8-218b866d6da8 None None] MFA Rules not processed for user `ebf92af08fa94215b4eafcacea6c63f6`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:15:28.152648 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-91f3cc84-6aac-4cd4-abc8-218b866d6da8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:15:28.229576 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1258/2524] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:15:28 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:15:29.439985 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c29072-4611-43f2-8d60-1c029401b761 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:15:29.441548 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-14c29072-4611-43f2-8d60-1c029401b761 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:15:29.609892 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c29072-4611-43f2-8d60-1c029401b761 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:15:29.619038 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b2d05b-70f1-4208-ae45-ac6967db19cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:15:29.620005 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b2d05b-70f1-4208-ae45-ac6967db19cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:15:29.620289 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b2d05b-70f1-4208-ae45-ac6967db19cd admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:15:29.620734 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b2d05b-70f1-4208-ae45-ac6967db19cd admin admin] PATH_INFO: `/v3/projects/6856f62a06d847fbace1c289da5e104c` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:15:29.622365 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b2d05b-70f1-4208-ae45-ac6967db19cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=6856f62a06d847fbace1c289da5e104c)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:15:29.624440 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b2d05b-70f1-4208-ae45-ac6967db19cd admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:15:29.726020 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-d5b2d05b-70f1-4208-ae45-ac6967db19cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6856f62a06d847fbace1c289da5e104c', 'request_id': 'req-d5b2d05b-70f1-4208-ae45-ac6967db19cd'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:15:29.739133 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-d5b2d05b-70f1-4208-ae45-ac6967db19cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6856f62a06d847fbace1c289da5e104c', 'request_id': 'req-d5b2d05b-70f1-4208-ae45-ac6967db19cd'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:15:29.750309 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-d5b2d05b-70f1-4208-ae45-ac6967db19cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6856f62a06d847fbace1c289da5e104c', 'request_id': 'req-d5b2d05b-70f1-4208-ae45-ac6967db19cd'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:15:29.771534 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-d5b2d05b-70f1-4208-ae45-ac6967db19cd admin admin] The token cache is being invalidate because project 6856f62a06d847fbace1c289da5e104c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:15:29.771881 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-d5b2d05b-70f1-4208-ae45-ac6967db19cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:15:29.772557 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-d5b2d05b-70f1-4208-ae45-ac6967db19cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:15:29.776893 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1267/2525] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:15:29 2022] DELETE /identity/v3/projects/6856f62a06d847fbace1c289da5e104c => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:15:29.781926 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b0dfa9-27ec-48ff-96e0-9515c53d3f2b None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:15:29.783607 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b0dfa9-27ec-48ff-96e0-9515c53d3f2b None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:15:29.783901 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b0dfa9-27ec-48ff-96e0-9515c53d3f2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:15:29.813890 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-76b0dfa9-27ec-48ff-96e0-9515c53d3f2b None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:15:29.820558 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-76b0dfa9-27ec-48ff-96e0-9515c53d3f2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:15:29.929357 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:15:29.972476 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1259/2526] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:15:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:15:29.981311 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489df805-596f-4814-9f26-65d9991f0ab3 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:15:29.981624 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489df805-596f-4814-9f26-65d9991f0ab3 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:15:29.981932 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489df805-596f-4814-9f26-65d9991f0ab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:15:30.008138 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-489df805-596f-4814-9f26-65d9991f0ab3 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:15:30.010710 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-489df805-596f-4814-9f26-65d9991f0ab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:15:30.036097 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1268/2527] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:15:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:15:30.037534 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b0dfa9-27ec-48ff-96e0-9515c53d3f2b None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:15:30.048424 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b0dfa9-27ec-48ff-96e0-9515c53d3f2b None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:15:30.065949 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab1496c-4ddb-4c2d-974c-4e3f016a5119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:15:30.066815 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab1496c-4ddb-4c2d-974c-4e3f016a5119 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:15:30.067244 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab1496c-4ddb-4c2d-974c-4e3f016a5119 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:15:30.067522 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab1496c-4ddb-4c2d-974c-4e3f016a5119 admin admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:15:30.068261 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab1496c-4ddb-4c2d-974c-4e3f016a5119 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:15:30.068566 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab1496c-4ddb-4c2d-974c-4e3f016a5119 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:15:30.070259 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab1496c-4ddb-4c2d-974c-4e3f016a5119 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:15:30.104350 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1260/2528] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:15:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:15:30.110580 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489df805-596f-4814-9f26-65d9991f0ab3 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:15:30.124088 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489df805-596f-4814-9f26-65d9991f0ab3 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:15:30.131076 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b0159b-ea94-44a2-9e7b-976b43f355a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:15:30.131969 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b0159b-ea94-44a2-9e7b-976b43f355a1 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:15:30.133225 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b0159b-ea94-44a2-9e7b-976b43f355a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:15:30.133728 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b0159b-ea94-44a2-9e7b-976b43f355a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:15:30.134884 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b0159b-ea94-44a2-9e7b-976b43f355a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:15:30.138068 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b0159b-ea94-44a2-9e7b-976b43f355a1 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:15:30.196540 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1269/2529] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:15:30 2022] POST /identity/v3/projects => generated 389 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:15:30.198358 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab1496c-4ddb-4c2d-974c-4e3f016a5119 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:15:30.216279 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab1496c-4ddb-4c2d-974c-4e3f016a5119 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:15:30.302786 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07208b58-b329-4266-b7e7-7a3b20ddaa3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:15:30.303650 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07208b58-b329-4266-b7e7-7a3b20ddaa3a admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:15:30.303934 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07208b58-b329-4266-b7e7-7a3b20ddaa3a admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:15:30.304294 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07208b58-b329-4266-b7e7-7a3b20ddaa3a admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:15:30.305049 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07208b58-b329-4266-b7e7-7a3b20ddaa3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:15:30.307434 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07208b58-b329-4266-b7e7-7a3b20ddaa3a admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:15:30.364077 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1261/2530] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:15:30 2022] POST /identity/v3/users => generated 295 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:15:30.368329 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b0159b-ea94-44a2-9e7b-976b43f355a1 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:15:30.390583 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b0159b-ea94-44a2-9e7b-976b43f355a1 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:15:30.409577 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355dc4da-1973-472d-97d3-f92ea1a1842e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:15:30.411819 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355dc4da-1973-472d-97d3-f92ea1a1842e admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:15:30.412589 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355dc4da-1973-472d-97d3-f92ea1a1842e admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:15:30.413316 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355dc4da-1973-472d-97d3-f92ea1a1842e admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:15:30.414645 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355dc4da-1973-472d-97d3-f92ea1a1842e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:15:30.416584 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355dc4da-1973-472d-97d3-f92ea1a1842e admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:15:30.434747 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1270/2531] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:15:30 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:15:30.438490 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07208b58-b329-4266-b7e7-7a3b20ddaa3a admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:15:30.458909 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07208b58-b329-4266-b7e7-7a3b20ddaa3a admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:15:30.522628 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c86e53-45f8-42ee-a439-173981756b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:15:30.523350 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c86e53-45f8-42ee-a439-173981756b7b admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:15:30.526398 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c86e53-45f8-42ee-a439-173981756b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:15:30.526682 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c86e53-45f8-42ee-a439-173981756b7b admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:15:30.527451 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c86e53-45f8-42ee-a439-173981756b7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:15:30.531585 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c86e53-45f8-42ee-a439-173981756b7b admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:15:30.573503 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1262/2532] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:15:30 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:15:30.579561 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355dc4da-1973-472d-97d3-f92ea1a1842e admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:15:30.619989 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355dc4da-1973-472d-97d3-f92ea1a1842e admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:15:30.641930 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df56e1b-1209-49d2-8f69-cc9bddce2674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:15:30.643235 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df56e1b-1209-49d2-8f69-cc9bddce2674 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:15:30.645576 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df56e1b-1209-49d2-8f69-cc9bddce2674 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:15:30.646772 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df56e1b-1209-49d2-8f69-cc9bddce2674 admin admin] PATH_INFO: `/v3/projects/db444807b51d4f20a3c99848a8c373eb/users/a943802454a547b694910d4110180f9c/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:15:30.708575 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df56e1b-1209-49d2-8f69-cc9bddce2674 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db444807b51d4f20a3c99848a8c373eb, user_id=a943802454a547b694910d4110180f9c, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:15:30.714749 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df56e1b-1209-49d2-8f69-cc9bddce2674 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:15:30.738436 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1271/2533] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:15:30 2022] PUT /identity/v3/projects/db444807b51d4f20a3c99848a8c373eb/users/a943802454a547b694910d4110180f9c/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:15:30.743466 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886c5252-8c89-4a21-9e1f-663aab29da72 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:15:30.743760 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886c5252-8c89-4a21-9e1f-663aab29da72 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:15:30.744026 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886c5252-8c89-4a21-9e1f-663aab29da72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:15:30.778013 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-886c5252-8c89-4a21-9e1f-663aab29da72 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:15:30.779180 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-886c5252-8c89-4a21-9e1f-663aab29da72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:15:30.939476 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1263/2534] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:15:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:15:30.975811 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df56e1b-1209-49d2-8f69-cc9bddce2674 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:15:30.979342 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-4df56e1b-1209-49d2-8f69-cc9bddce2674 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:15:31.052695 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:15:31.159714 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df56e1b-1209-49d2-8f69-cc9bddce2674 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:15:31.172045 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda179cf-9906-4e45-90ce-fa0c9998a71f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:15:31.172829 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda179cf-9906-4e45-90ce-fa0c9998a71f service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:15:31.174721 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda179cf-9906-4e45-90ce-fa0c9998a71f service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:15:31.175004 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda179cf-9906-4e45-90ce-fa0c9998a71f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:15:31.203522 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda179cf-9906-4e45-90ce-fa0c9998a71f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:15:31.207949 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda179cf-9906-4e45-90ce-fa0c9998a71f service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:15:31.225202 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1272/2535] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:15:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:15:32.807298 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5c0a51-0409-4968-aa05-6af25a834c6b None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:15:32.808196 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5c0a51-0409-4968-aa05-6af25a834c6b None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:15:32.808644 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5c0a51-0409-4968-aa05-6af25a834c6b None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:15:32.811458 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1264/2536] 10.222.0.17 () {54 vars in 921 bytes} [Sat Jul 23 21:15:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:15:32.817473 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dc7bd3-b431-4310-9b92-8a75f1a692f0 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:15:32.818604 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dc7bd3-b431-4310-9b92-8a75f1a692f0 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:15:32.819048 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dc7bd3-b431-4310-9b92-8a75f1a692f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:15:32.856369 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-98dc7bd3-b431-4310-9b92-8a75f1a692f0 None None] MFA Rules not processed for user `abc719a3b3ac4461b82ca04ab6451d81`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:15:32.857677 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-98dc7bd3-b431-4310-9b92-8a75f1a692f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:15:33.023982 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1273/2537] 10.222.0.17 () {58 vars in 1018 bytes} [Sat Jul 23 21:15:32 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:15:33.065527 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5c0a51-0409-4968-aa05-6af25a834c6b None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:15:33.067473 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-6c5c0a51-0409-4968-aa05-6af25a834c6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:15:33.088615 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5c0a51-0409-4968-aa05-6af25a834c6b None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:15:33.107691 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee594684-df2e-4c54-a8ed-5bbbc9258819 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc719a3b3ac4461b82ca04ab6451d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:15:33.108984 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee594684-df2e-4c54-a8ed-5bbbc9258819 service placement] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:15:33.110036 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee594684-df2e-4c54-a8ed-5bbbc9258819 service placement] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:15:33.111227 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee594684-df2e-4c54-a8ed-5bbbc9258819 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:15:33.122716 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee594684-df2e-4c54-a8ed-5bbbc9258819 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:15:33.124489 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee594684-df2e-4c54-a8ed-5bbbc9258819 service placement] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:15:33.146231 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5823e4-87fe-4f2a-b901-075244c79412 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:15:33.146794 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5823e4-87fe-4f2a-b901-075244c79412 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:15:33.147263 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5823e4-87fe-4f2a-b901-075244c79412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:15:33.171735 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1265/2538] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:15:33 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:15:33.192067 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-af5823e4-87fe-4f2a-b901-075244c79412 None None] MFA Rules not processed for user `3a56b82cf3954f279dd21e17a42462b3`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:15:33.194405 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-af5823e4-87fe-4f2a-b901-075244c79412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:15:33.315947 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1274/2539] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:15:33 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:15:37.091242 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca3d599-fb54-43a2-95e8-7162eee1c2a1 None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:15:37.091827 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca3d599-fb54-43a2-95e8-7162eee1c2a1 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:15:37.091827 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca3d599-fb54-43a2-95e8-7162eee1c2a1 None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:15:37.093245 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1266/2540] 10.222.0.17 () {54 vars in 921 bytes} [Sat Jul 23 21:15:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:15:37.720961 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0bb377-83ee-4144-b9af-0e0fdf43a6bb None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:15:37.722004 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0bb377-83ee-4144-b9af-0e0fdf43a6bb None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:15:37.722413 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0bb377-83ee-4144-b9af-0e0fdf43a6bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:15:37.766091 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-6e0bb377-83ee-4144-b9af-0e0fdf43a6bb None None] MFA Rules not processed for user `abc719a3b3ac4461b82ca04ab6451d81`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:15:37.767860 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-6e0bb377-83ee-4144-b9af-0e0fdf43a6bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:15:37.779568 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1275/2541] 10.222.0.17 () {58 vars in 1018 bytes} [Sat Jul 23 21:15:37 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:15:37.826117 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca3d599-fb54-43a2-95e8-7162eee1c2a1 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:15:37.828582 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-6ca3d599-fb54-43a2-95e8-7162eee1c2a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:15:37.859889 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0bb377-83ee-4144-b9af-0e0fdf43a6bb None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:15:37.862919 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-6e0bb377-83ee-4144-b9af-0e0fdf43a6bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:15:37.863500 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca3d599-fb54-43a2-95e8-7162eee1c2a1 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:15:37.874555 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a961254-a23b-4d90-9822-5af3d0f9f83f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc719a3b3ac4461b82ca04ab6451d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:15:37.875528 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a961254-a23b-4d90-9822-5af3d0f9f83f service placement] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:15:37.876025 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a961254-a23b-4d90-9822-5af3d0f9f83f service placement] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:15:37.876882 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a961254-a23b-4d90-9822-5af3d0f9f83f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:15:37.908082 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a961254-a23b-4d90-9822-5af3d0f9f83f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:15:37.910011 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a961254-a23b-4d90-9822-5af3d0f9f83f service placement] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:15:37.936459 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1267/2542] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:15:37 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:15:37.948705 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0bb377-83ee-4144-b9af-0e0fdf43a6bb None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:15:37.963654 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664720f0-1b4b-4567-a6c2-badb73084b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:15:37.964672 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664720f0-1b4b-4567-a6c2-badb73084b1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:15:37.965114 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664720f0-1b4b-4567-a6c2-badb73084b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:15:37.965392 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664720f0-1b4b-4567-a6c2-badb73084b1f admin admin] PATH_INFO: `/v3/users/89b3fe601e1a476ea1abb1870769eb60` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:15:37.971387 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664720f0-1b4b-4567-a6c2-badb73084b1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=89b3fe601e1a476ea1abb1870769eb60)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:15:37.973536 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664720f0-1b4b-4567-a6c2-badb73084b1f admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:15:38.111158 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-664720f0-1b4b-4567-a6c2-badb73084b1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89b3fe601e1a476ea1abb1870769eb60'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:15:38.112284 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-664720f0-1b4b-4567-a6c2-badb73084b1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89b3fe601e1a476ea1abb1870769eb60'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:15:38.118491 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:15:38.123040 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-664720f0-1b4b-4567-a6c2-badb73084b1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89b3fe601e1a476ea1abb1870769eb60'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:15:38.138175 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-664720f0-1b4b-4567-a6c2-badb73084b1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89b3fe601e1a476ea1abb1870769eb60'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:15:38.170140 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-664720f0-1b4b-4567-a6c2-badb73084b1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89b3fe601e1a476ea1abb1870769eb60'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:15:38.180989 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1276/2543] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:15:37 2022] DELETE /identity/v3/users/89b3fe601e1a476ea1abb1870769eb60 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:15:38.997340 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a961254-a23b-4d90-9822-5af3d0f9f83f service placement] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:15:39.013523 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a961254-a23b-4d90-9822-5af3d0f9f83f service placement] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:15:39.068312 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:15:39.125019 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdd6513-d534-4400-9cb4-ef7b9087b2ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:15:39.130189 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdd6513-d534-4400-9cb4-ef7b9087b2ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:15:39.131593 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdd6513-d534-4400-9cb4-ef7b9087b2ee admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:15:39.132146 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdd6513-d534-4400-9cb4-ef7b9087b2ee admin admin] PATH_INFO: `/v3/projects/21523d7e146e4e84a1a85222141c6e7b` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:15:39.139981 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdd6513-d534-4400-9cb4-ef7b9087b2ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=21523d7e146e4e84a1a85222141c6e7b)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:15:39.142605 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdd6513-d534-4400-9cb4-ef7b9087b2ee admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:15:39.296587 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-9bdd6513-d534-4400-9cb4-ef7b9087b2ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21523d7e146e4e84a1a85222141c6e7b', 'request_id': 'req-9bdd6513-d534-4400-9cb4-ef7b9087b2ee'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:15:39.312200 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-9bdd6513-d534-4400-9cb4-ef7b9087b2ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21523d7e146e4e84a1a85222141c6e7b', 'request_id': 'req-9bdd6513-d534-4400-9cb4-ef7b9087b2ee'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:15:39.320904 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-9bdd6513-d534-4400-9cb4-ef7b9087b2ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21523d7e146e4e84a1a85222141c6e7b', 'request_id': 'req-9bdd6513-d534-4400-9cb4-ef7b9087b2ee'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:15:39.335581 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-9bdd6513-d534-4400-9cb4-ef7b9087b2ee admin admin] The token cache is being invalidate because project 21523d7e146e4e84a1a85222141c6e7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:15:39.336174 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-9bdd6513-d534-4400-9cb4-ef7b9087b2ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:15:39.337099 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-9bdd6513-d534-4400-9cb4-ef7b9087b2ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:15:39.339488 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1268/2544] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:15:38 2022] DELETE /identity/v3/projects/21523d7e146e4e84a1a85222141c6e7b => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:15:39.344385 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9faaee-5155-4ce5-99e3-bab55d8691d7 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:15:39.344912 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9faaee-5155-4ce5-99e3-bab55d8691d7 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:15:39.345190 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9faaee-5155-4ce5-99e3-bab55d8691d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:15:39.381541 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-0e9faaee-5155-4ce5-99e3-bab55d8691d7 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:15:39.383136 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-0e9faaee-5155-4ce5-99e3-bab55d8691d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:15:39.500482 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1277/2545] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:15:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:15:39.508062 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b13107-4e8f-4edf-ba2a-e9b2c519730f None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:15:39.508351 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b13107-4e8f-4edf-ba2a-e9b2c519730f None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:15:39.508658 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b13107-4e8f-4edf-ba2a-e9b2c519730f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:15:39.541966 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-12b13107-4e8f-4edf-ba2a-e9b2c519730f None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:15:39.543402 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-12b13107-4e8f-4edf-ba2a-e9b2c519730f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:15:39.553856 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1269/2546] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:15:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:15:39.558620 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9faaee-5155-4ce5-99e3-bab55d8691d7 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:15:39.587272 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9faaee-5155-4ce5-99e3-bab55d8691d7 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:15:39.594214 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27ab645-b824-425e-b55c-93e9a60cf9a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:15:39.595330 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27ab645-b824-425e-b55c-93e9a60cf9a6 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:15:39.595867 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27ab645-b824-425e-b55c-93e9a60cf9a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:15:39.596147 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27ab645-b824-425e-b55c-93e9a60cf9a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:15:39.596888 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27ab645-b824-425e-b55c-93e9a60cf9a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:15:39.597187 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27ab645-b824-425e-b55c-93e9a60cf9a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:15:39.600245 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27ab645-b824-425e-b55c-93e9a60cf9a6 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:15:39.629752 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1278/2547] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:15:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:15:39.634812 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b13107-4e8f-4edf-ba2a-e9b2c519730f None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:15:39.660501 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b13107-4e8f-4edf-ba2a-e9b2c519730f None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:15:39.666088 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae154fc3-e6b5-4eb7-9065-367d1cc1d1a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:15:39.667020 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae154fc3-e6b5-4eb7-9065-367d1cc1d1a3 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:15:39.667443 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae154fc3-e6b5-4eb7-9065-367d1cc1d1a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:15:39.667885 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae154fc3-e6b5-4eb7-9065-367d1cc1d1a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:15:39.668986 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae154fc3-e6b5-4eb7-9065-367d1cc1d1a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:15:39.671424 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae154fc3-e6b5-4eb7-9065-367d1cc1d1a3 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:15:39.715959 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1270/2548] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:15:39 2022] POST /identity/v3/projects => generated 365 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:15:39.716974 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27ab645-b824-425e-b55c-93e9a60cf9a6 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:15:39.742589 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27ab645-b824-425e-b55c-93e9a60cf9a6 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:15:39.826130 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f71dd8-6f74-4b9c-ac5d-e6e2ca07c15b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:15:39.827267 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f71dd8-6f74-4b9c-ac5d-e6e2ca07c15b admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:15:39.827690 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f71dd8-6f74-4b9c-ac5d-e6e2ca07c15b admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:15:39.827970 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f71dd8-6f74-4b9c-ac5d-e6e2ca07c15b admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:15:39.828679 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f71dd8-6f74-4b9c-ac5d-e6e2ca07c15b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:15:39.830937 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f71dd8-6f74-4b9c-ac5d-e6e2ca07c15b admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:15:39.858780 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1279/2549] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:15:39 2022] POST /identity/v3/users => generated 283 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:15:39.860002 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae154fc3-e6b5-4eb7-9065-367d1cc1d1a3 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:15:39.873750 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae154fc3-e6b5-4eb7-9065-367d1cc1d1a3 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:15:39.882282 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81c944c-cf69-4eec-bcb0-d975cd315994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:15:39.883948 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81c944c-cf69-4eec-bcb0-d975cd315994 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:15:39.884249 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81c944c-cf69-4eec-bcb0-d975cd315994 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:15:39.884530 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81c944c-cf69-4eec-bcb0-d975cd315994 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:15:39.885287 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81c944c-cf69-4eec-bcb0-d975cd315994 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:15:39.887786 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81c944c-cf69-4eec-bcb0-d975cd315994 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:15:39.912149 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1271/2550] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:15:39 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:15:39.913188 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f71dd8-6f74-4b9c-ac5d-e6e2ca07c15b admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:15:39.929106 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f71dd8-6f74-4b9c-ac5d-e6e2ca07c15b admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:15:39.936189 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc9ce23-a558-471a-9611-dee8e4def334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:15:39.936633 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc9ce23-a558-471a-9611-dee8e4def334 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:15:39.937237 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc9ce23-a558-471a-9611-dee8e4def334 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:15:39.937510 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc9ce23-a558-471a-9611-dee8e4def334 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:15:39.938519 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc9ce23-a558-471a-9611-dee8e4def334 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:15:39.940361 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc9ce23-a558-471a-9611-dee8e4def334 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:15:39.964624 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1280/2551] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:15:39 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:15:39.965846 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81c944c-cf69-4eec-bcb0-d975cd315994 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:15:39.982497 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81c944c-cf69-4eec-bcb0-d975cd315994 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:15:39.996867 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f17fac6-b844-4a23-85e5-b074f1a22317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:15:39.998015 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f17fac6-b844-4a23-85e5-b074f1a22317 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:15:39.998591 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f17fac6-b844-4a23-85e5-b074f1a22317 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:15:39.998591 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f17fac6-b844-4a23-85e5-b074f1a22317 admin admin] PATH_INFO: `/v3/projects/580ed681cbf44d10936259b17f60f1b2/users/bb4f9dda4c2a411cb0394bf86e9ae223/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:15:40.025884 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f17fac6-b844-4a23-85e5-b074f1a22317 admin admin] RBAC: Authorizing `identity:create_grant(project_id=580ed681cbf44d10936259b17f60f1b2, user_id=bb4f9dda4c2a411cb0394bf86e9ae223, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:15:40.028977 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f17fac6-b844-4a23-85e5-b074f1a22317 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:15:40.060170 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1272/2552] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:15:39 2022] PUT /identity/v3/projects/580ed681cbf44d10936259b17f60f1b2/users/bb4f9dda4c2a411cb0394bf86e9ae223/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:15:40.062286 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a63b047-ca31-4d06-b38f-5d96a1c99ad4 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:15:40.062582 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a63b047-ca31-4d06-b38f-5d96a1c99ad4 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:15:40.062862 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a63b047-ca31-4d06-b38f-5d96a1c99ad4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:15:40.087353 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-4a63b047-ca31-4d06-b38f-5d96a1c99ad4 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:15:40.088575 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-4a63b047-ca31-4d06-b38f-5d96a1c99ad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:15:40.165517 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:15:40.215681 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1281/2553] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:15:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:15:40.226001 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f17fac6-b844-4a23-85e5-b074f1a22317 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:15:40.227904 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-8f17fac6-b844-4a23-85e5-b074f1a22317 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:15:40.295904 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:15:40.301185 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f17fac6-b844-4a23-85e5-b074f1a22317 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:15:40.308777 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af04177-c946-43c7-b4de-ce867d37793d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:15:40.309457 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af04177-c946-43c7-b4de-ce867d37793d service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:15:40.309737 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af04177-c946-43c7-b4de-ce867d37793d service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:15:40.310168 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af04177-c946-43c7-b4de-ce867d37793d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:15:40.321932 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af04177-c946-43c7-b4de-ce867d37793d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:15:40.323405 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af04177-c946-43c7-b4de-ce867d37793d service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:15:40.341000 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1273/2554] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:15:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:15:45.153171 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1a1990-4bd3-472d-82d3-fcd4adc3b0cb None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:15:45.153657 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1a1990-4bd3-472d-82d3-fcd4adc3b0cb None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:15:45.153746 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1a1990-4bd3-472d-82d3-fcd4adc3b0cb None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:15:45.155523 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1282/2555] 10.222.0.17 () {54 vars in 921 bytes} [Sat Jul 23 21:15:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:15:45.163750 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8c487f-b751-42c0-a340-a9893c1ca6fd None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:15:45.164318 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8c487f-b751-42c0-a340-a9893c1ca6fd None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:15:45.164318 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8c487f-b751-42c0-a340-a9893c1ca6fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:15:45.198484 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-1f8c487f-b751-42c0-a340-a9893c1ca6fd None None] MFA Rules not processed for user `abc719a3b3ac4461b82ca04ab6451d81`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:15:45.200262 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-1f8c487f-b751-42c0-a340-a9893c1ca6fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:15:45.340365 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1274/2556] 10.222.0.17 () {58 vars in 1018 bytes} [Sat Jul 23 21:15:45 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:15:45.363013 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1a1990-4bd3-472d-82d3-fcd4adc3b0cb None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:15:45.365517 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-7c1a1990-4bd3-472d-82d3-fcd4adc3b0cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:15:45.390940 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1a1990-4bd3-472d-82d3-fcd4adc3b0cb None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:15:45.398796 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deba361f-d78b-4b8c-b4a2-3cfc6c9cbe7c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc719a3b3ac4461b82ca04ab6451d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:15:45.399969 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deba361f-d78b-4b8c-b4a2-3cfc6c9cbe7c service placement] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:15:45.400398 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deba361f-d78b-4b8c-b4a2-3cfc6c9cbe7c service placement] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:15:45.400821 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deba361f-d78b-4b8c-b4a2-3cfc6c9cbe7c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:15:45.411592 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deba361f-d78b-4b8c-b4a2-3cfc6c9cbe7c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:15:45.413513 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deba361f-d78b-4b8c-b4a2-3cfc6c9cbe7c service placement] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:15:45.439674 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1283/2557] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:15:45 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:15:45.727603 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d3d148-3cad-44f1-909d-c8f4f1618199 None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:15:45.728458 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d3d148-3cad-44f1-909d-c8f4f1618199 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:15:45.728812 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d3d148-3cad-44f1-909d-c8f4f1618199 None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:15:45.731351 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1275/2558] 10.222.0.17 () {54 vars in 921 bytes} [Sat Jul 23 21:15:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:15:45.738382 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a9da85-f501-4e47-a265-e8c9341f6f28 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:15:45.738826 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a9da85-f501-4e47-a265-e8c9341f6f28 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:15:45.739468 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a9da85-f501-4e47-a265-e8c9341f6f28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:15:45.767583 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-71a9da85-f501-4e47-a265-e8c9341f6f28 None None] MFA Rules not processed for user `079f31ed2c844e67bd4e206f24b69d97`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:15:45.769101 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-71a9da85-f501-4e47-a265-e8c9341f6f28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:15:46.020131 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1284/2559] 10.222.0.17 () {58 vars in 1018 bytes} [Sat Jul 23 21:15:45 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:15:46.040210 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d3d148-3cad-44f1-909d-c8f4f1618199 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:15:46.042213 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-50d3d148-3cad-44f1-909d-c8f4f1618199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:15:46.064760 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d3d148-3cad-44f1-909d-c8f4f1618199 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:15:46.076906 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6a8beb-3c82-413f-9d48-bd328e957262 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:15:46.077967 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6a8beb-3c82-413f-9d48-bd328e957262 service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:15:46.078431 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6a8beb-3c82-413f-9d48-bd328e957262 service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:15:46.079012 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6a8beb-3c82-413f-9d48-bd328e957262 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:15:46.093403 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6a8beb-3c82-413f-9d48-bd328e957262 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:15:46.095126 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6a8beb-3c82-413f-9d48-bd328e957262 service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:15:46.110064 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1276/2560] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:15:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 23 21:15:49.025197 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b85370-6fad-4a94-86fb-80fd43e6cf85 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:15:49.025788 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b85370-6fad-4a94-86fb-80fd43e6cf85 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:15:49.025908 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b85370-6fad-4a94-86fb-80fd43e6cf85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:15:49.080313 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-78b85370-6fad-4a94-86fb-80fd43e6cf85 None None] MFA Rules not processed for user `a943802454a547b694910d4110180f9c`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:15:49.081593 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-78b85370-6fad-4a94-86fb-80fd43e6cf85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:15:49.335724 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1285/2561] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:15:49 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:15:49.464505 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6a8beb-3c82-413f-9d48-bd328e957262 service neutron] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:15:49.466622 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-eb6a8beb-3c82-413f-9d48-bd328e957262 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:15:49.487772 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6a8beb-3c82-413f-9d48-bd328e957262 service neutron] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:15:49.498426 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bab3dbe-a2a9-4563-975a-f0716d48de1f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:15:49.499251 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bab3dbe-a2a9-4563-975a-f0716d48de1f service nova] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:15:49.499634 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bab3dbe-a2a9-4563-975a-f0716d48de1f service nova] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:15:49.500004 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bab3dbe-a2a9-4563-975a-f0716d48de1f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:15:49.514858 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bab3dbe-a2a9-4563-975a-f0716d48de1f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:15:49.517028 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bab3dbe-a2a9-4563-975a-f0716d48de1f service nova] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:15:49.531139 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1277/2562] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:15:49 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:15:53.336034 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c372fc8-7554-4006-9740-4f869020db12 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:15:53.336666 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c372fc8-7554-4006-9740-4f869020db12 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:15:53.336666 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c372fc8-7554-4006-9740-4f869020db12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:15:53.419027 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-5c372fc8-7554-4006-9740-4f869020db12 None None] MFA Rules not processed for user `bb4f9dda4c2a411cb0394bf86e9ae223`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:15:53.423648 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-5c372fc8-7554-4006-9740-4f869020db12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:15:53.528847 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:15:53.634648 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1286/2563] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:15:53 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:15:53.636545 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59957691-3723-4d95-a222-1c8ea5c686ab None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:15:53.638210 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59957691-3723-4d95-a222-1c8ea5c686ab None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:15:53.638698 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59957691-3723-4d95-a222-1c8ea5c686ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:15:53.676070 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-59957691-3723-4d95-a222-1c8ea5c686ab None None] MFA Rules not processed for user `bb4f9dda4c2a411cb0394bf86e9ae223`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:15:53.677827 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-59957691-3723-4d95-a222-1c8ea5c686ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:15:53.716085 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1278/2564] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:15:53 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:15:53.942240 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c372fc8-7554-4006-9740-4f869020db12 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:15:53.944180 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-5c372fc8-7554-4006-9740-4f869020db12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:15:53.983737 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c372fc8-7554-4006-9740-4f869020db12 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:15:53.998919 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeb3e53-6b42-4544-af67-c6c1cf93776e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:15:53.999598 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeb3e53-6b42-4544-af67-c6c1cf93776e service nova] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:15:53.999872 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeb3e53-6b42-4544-af67-c6c1cf93776e service nova] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:15:54.000148 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeb3e53-6b42-4544-af67-c6c1cf93776e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:15:54.024154 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efeb3e53-6b42-4544-af67-c6c1cf93776e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:15:54.026028 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efeb3e53-6b42-4544-af67-c6c1cf93776e service nova] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:15:54.047460 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1287/2565] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:15:53 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 23 21:15:54.830798 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59957691-3723-4d95-a222-1c8ea5c686ab None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:15:54.832384 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-59957691-3723-4d95-a222-1c8ea5c686ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:15:54.866853 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59957691-3723-4d95-a222-1c8ea5c686ab None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:15:54.895408 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eef8c4-60c7-49eb-b739-803f5f9ec957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:15:54.897235 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eef8c4-60c7-49eb-b739-803f5f9ec957 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:15:54.897779 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eef8c4-60c7-49eb-b739-803f5f9ec957 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:15:54.898508 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eef8c4-60c7-49eb-b739-803f5f9ec957 admin admin] PATH_INFO: `/v3/users/8a872dad882e4694aba20eaa8c06df53` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:15:54.904649 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00eef8c4-60c7-49eb-b739-803f5f9ec957 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a872dad882e4694aba20eaa8c06df53)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:15:54.907306 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00eef8c4-60c7-49eb-b739-803f5f9ec957 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:15:55.046491 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-00eef8c4-60c7-49eb-b739-803f5f9ec957 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a872dad882e4694aba20eaa8c06df53'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:15:55.085625 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-00eef8c4-60c7-49eb-b739-803f5f9ec957 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a872dad882e4694aba20eaa8c06df53'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:15:55.086111 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-00eef8c4-60c7-49eb-b739-803f5f9ec957 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a872dad882e4694aba20eaa8c06df53'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:15:55.115095 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-00eef8c4-60c7-49eb-b739-803f5f9ec957 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a872dad882e4694aba20eaa8c06df53'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:15:55.150412 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-00eef8c4-60c7-49eb-b739-803f5f9ec957 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a872dad882e4694aba20eaa8c06df53'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:15:55.172016 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c06156-6105-4224-8dd0-83f01bdc7d5e None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:15:55.173030 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c06156-6105-4224-8dd0-83f01bdc7d5e None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:15:55.173535 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c06156-6105-4224-8dd0-83f01bdc7d5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:15:55.175486 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1279/2566] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:15:54 2022] DELETE /identity/v3/users/8a872dad882e4694aba20eaa8c06df53 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:15:55.218008 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-75c06156-6105-4224-8dd0-83f01bdc7d5e None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:15:55.221462 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-75c06156-6105-4224-8dd0-83f01bdc7d5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:15:55.401311 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1288/2567] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:15:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:15:55.426526 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eef8c4-60c7-49eb-b739-803f5f9ec957 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:15:55.431800 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-00eef8c4-60c7-49eb-b739-803f5f9ec957 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:15:55.533762 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:15:55.629559 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eef8c4-60c7-49eb-b739-803f5f9ec957 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:15:55.650631 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ca2c0e-c6ce-43a9-9ee1-2b0081545072 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:15:55.651494 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ca2c0e-c6ce-43a9-9ee1-2b0081545072 service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:15:55.651884 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ca2c0e-c6ce-43a9-9ee1-2b0081545072 service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:15:55.654282 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ca2c0e-c6ce-43a9-9ee1-2b0081545072 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:15:55.686289 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ca2c0e-c6ce-43a9-9ee1-2b0081545072 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:15:55.688128 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ca2c0e-c6ce-43a9-9ee1-2b0081545072 service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:15:55.710894 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1280/2568] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:15:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:15:56.311060 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c06156-6105-4224-8dd0-83f01bdc7d5e None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:15:56.313214 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-75c06156-6105-4224-8dd0-83f01bdc7d5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:15:56.333332 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c06156-6105-4224-8dd0-83f01bdc7d5e None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:15:56.346086 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ef0d53-90bf-4b0f-ae88-784ffc5f880e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:15:56.348945 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ef0d53-90bf-4b0f-ae88-784ffc5f880e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:15:56.350175 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ef0d53-90bf-4b0f-ae88-784ffc5f880e admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:15:56.351325 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ef0d53-90bf-4b0f-ae88-784ffc5f880e admin admin] PATH_INFO: `/v3/projects/457d184c579a4016a0eec16eb9f23195` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:15:56.355048 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ef0d53-90bf-4b0f-ae88-784ffc5f880e admin admin] RBAC: Authorizing `identity:delete_project(project_id=457d184c579a4016a0eec16eb9f23195)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:15:56.359965 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ef0d53-90bf-4b0f-ae88-784ffc5f880e admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:15:56.555381 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-34ef0d53-90bf-4b0f-ae88-784ffc5f880e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '457d184c579a4016a0eec16eb9f23195', 'request_id': 'req-34ef0d53-90bf-4b0f-ae88-784ffc5f880e'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:15:56.596279 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-34ef0d53-90bf-4b0f-ae88-784ffc5f880e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '457d184c579a4016a0eec16eb9f23195', 'request_id': 'req-34ef0d53-90bf-4b0f-ae88-784ffc5f880e'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:15:56.621930 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-34ef0d53-90bf-4b0f-ae88-784ffc5f880e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '457d184c579a4016a0eec16eb9f23195', 'request_id': 'req-34ef0d53-90bf-4b0f-ae88-784ffc5f880e'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:15:56.668345 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-34ef0d53-90bf-4b0f-ae88-784ffc5f880e admin admin] The token cache is being invalidate because project 457d184c579a4016a0eec16eb9f23195 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:15:56.668670 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-34ef0d53-90bf-4b0f-ae88-784ffc5f880e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:15:56.672132 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-34ef0d53-90bf-4b0f-ae88-784ffc5f880e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:15:56.680424 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1289/2569] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:15:56 2022] DELETE /identity/v3/projects/457d184c579a4016a0eec16eb9f23195 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:15:56.684368 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ca2c0e-c6ce-43a9-9ee1-2b0081545072 service neutron] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:15:56.699606 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ca2c0e-c6ce-43a9-9ee1-2b0081545072 service neutron] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:15:56.900456 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66b76ee-be38-4558-bfba-cc3273ece41f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:15:56.901994 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66b76ee-be38-4558-bfba-cc3273ece41f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:15:56.902605 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66b76ee-be38-4558-bfba-cc3273ece41f admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:15:56.903149 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66b76ee-be38-4558-bfba-cc3273ece41f admin admin] PATH_INFO: `/v3/users/a65178068e4e487bb27e2f152ba9b081` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:15:56.905759 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66b76ee-be38-4558-bfba-cc3273ece41f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a65178068e4e487bb27e2f152ba9b081)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:15:56.912617 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66b76ee-be38-4558-bfba-cc3273ece41f admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:15:57.041252 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-f66b76ee-be38-4558-bfba-cc3273ece41f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a65178068e4e487bb27e2f152ba9b081'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:15:57.065620 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-f66b76ee-be38-4558-bfba-cc3273ece41f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a65178068e4e487bb27e2f152ba9b081'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:15:57.066778 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-f66b76ee-be38-4558-bfba-cc3273ece41f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a65178068e4e487bb27e2f152ba9b081'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:15:57.084274 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-f66b76ee-be38-4558-bfba-cc3273ece41f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a65178068e4e487bb27e2f152ba9b081'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:15:57.123548 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-f66b76ee-be38-4558-bfba-cc3273ece41f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a65178068e4e487bb27e2f152ba9b081'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:15:57.145046 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1281/2570] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:15:56 2022] DELETE /identity/v3/users/a65178068e4e487bb27e2f152ba9b081 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:15:57.878538 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ef0d53-90bf-4b0f-ae88-784ffc5f880e admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:15:57.880378 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-34ef0d53-90bf-4b0f-ae88-784ffc5f880e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:15:57.900133 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ef0d53-90bf-4b0f-ae88-784ffc5f880e admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:15:58.022068 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:15:58.080384 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a04d3c-ee03-46ca-8e36-9acf81817a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:15:58.081443 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a04d3c-ee03-46ca-8e36-9acf81817a53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:15:58.081731 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a04d3c-ee03-46ca-8e36-9acf81817a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:15:58.082047 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a04d3c-ee03-46ca-8e36-9acf81817a53 admin admin] PATH_INFO: `/v3/projects/a1e5e46ae97b4f79832de640e753f8c8` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:15:58.083980 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a04d3c-ee03-46ca-8e36-9acf81817a53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1e5e46ae97b4f79832de640e753f8c8)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:15:58.089927 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a04d3c-ee03-46ca-8e36-9acf81817a53 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:15:58.206630 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-82a04d3c-ee03-46ca-8e36-9acf81817a53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1e5e46ae97b4f79832de640e753f8c8', 'request_id': 'req-82a04d3c-ee03-46ca-8e36-9acf81817a53'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:15:58.236527 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-82a04d3c-ee03-46ca-8e36-9acf81817a53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1e5e46ae97b4f79832de640e753f8c8', 'request_id': 'req-82a04d3c-ee03-46ca-8e36-9acf81817a53'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:15:58.244995 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-82a04d3c-ee03-46ca-8e36-9acf81817a53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1e5e46ae97b4f79832de640e753f8c8', 'request_id': 'req-82a04d3c-ee03-46ca-8e36-9acf81817a53'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:15:58.305260 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-82a04d3c-ee03-46ca-8e36-9acf81817a53 admin admin] The token cache is being invalidate because project a1e5e46ae97b4f79832de640e753f8c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:15:58.305260 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-82a04d3c-ee03-46ca-8e36-9acf81817a53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:15:58.312305 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-82a04d3c-ee03-46ca-8e36-9acf81817a53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:15:58.315797 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1290/2571] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:15:57 2022] DELETE /identity/v3/projects/a1e5e46ae97b4f79832de640e753f8c8 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:15:58.320905 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011986aa-6bb2-4f31-adae-8747b3128d81 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:15:58.325523 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011986aa-6bb2-4f31-adae-8747b3128d81 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:15:58.326054 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011986aa-6bb2-4f31-adae-8747b3128d81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:15:58.346296 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff5e72d-5aff-46d8-89d7-c8d1cab5cac7 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:15:58.346792 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff5e72d-5aff-46d8-89d7-c8d1cab5cac7 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:15:58.348016 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff5e72d-5aff-46d8-89d7-c8d1cab5cac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:15:58.410318 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-8ff5e72d-5aff-46d8-89d7-c8d1cab5cac7 None None] MFA Rules not processed for user `ebf92af08fa94215b4eafcacea6c63f6`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:15:58.414928 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-8ff5e72d-5aff-46d8-89d7-c8d1cab5cac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:15:58.420407 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-011986aa-6bb2-4f31-adae-8747b3128d81 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:15:58.421773 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-011986aa-6bb2-4f31-adae-8747b3128d81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:15:58.566803 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:15:58.605755 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1282/2572] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:15:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:15:58.613261 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a85e03-39b1-46b6-95be-adab46bb9789 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:15:58.613612 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a85e03-39b1-46b6-95be-adab46bb9789 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:15:58.614089 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a85e03-39b1-46b6-95be-adab46bb9789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:15:58.641271 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1291/2573] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:15:58 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:15:58.663077 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-33a85e03-39b1-46b6-95be-adab46bb9789 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:15:58.666405 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-33a85e03-39b1-46b6-95be-adab46bb9789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:15:58.699230 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1283/2574] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:15:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:15:58.703299 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff5e72d-5aff-46d8-89d7-c8d1cab5cac7 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:15:58.721232 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff5e72d-5aff-46d8-89d7-c8d1cab5cac7 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:15:58.755493 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d6c6ce-babc-423d-82d1-1c40514941cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:15:58.755859 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d6c6ce-babc-423d-82d1-1c40514941cb admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:15:58.756144 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d6c6ce-babc-423d-82d1-1c40514941cb admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:15:58.756995 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d6c6ce-babc-423d-82d1-1c40514941cb admin admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:15:58.758092 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d6c6ce-babc-423d-82d1-1c40514941cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:15:58.758423 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d6c6ce-babc-423d-82d1-1c40514941cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:15:58.760695 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d6c6ce-babc-423d-82d1-1c40514941cb admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:15:58.781533 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1292/2575] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:15:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:15:58.784911 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a85e03-39b1-46b6-95be-adab46bb9789 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:15:58.797009 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a85e03-39b1-46b6-95be-adab46bb9789 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:15:58.804594 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befd303e-b2a4-41c6-96d6-8d464f2b24ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:15:58.806476 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befd303e-b2a4-41c6-96d6-8d464f2b24ef admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:15:58.807003 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befd303e-b2a4-41c6-96d6-8d464f2b24ef admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:15:58.807526 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befd303e-b2a4-41c6-96d6-8d464f2b24ef admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:15:58.808425 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befd303e-b2a4-41c6-96d6-8d464f2b24ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:15:58.812212 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befd303e-b2a4-41c6-96d6-8d464f2b24ef admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:15:58.872111 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78afba6e-cc13-4114-aed1-a418b47d4687 None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:15:58.872399 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78afba6e-cc13-4114-aed1-a418b47d4687 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:15:58.872674 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78afba6e-cc13-4114-aed1-a418b47d4687 None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:15:58.874322 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1293/2576] 10.222.0.17 () {54 vars in 921 bytes} [Sat Jul 23 21:15:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 23 21:15:58.892318 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09028c4-1380-406e-9455-a65bf566ec6f None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:15:58.892984 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09028c4-1380-406e-9455-a65bf566ec6f None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:15:58.892984 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09028c4-1380-406e-9455-a65bf566ec6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:15:58.936768 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1284/2577] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:15:58 2022] POST /identity/v3/projects => generated 383 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:15:58.937996 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befd303e-b2a4-41c6-96d6-8d464f2b24ef admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:15:58.957994 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-f09028c4-1380-406e-9455-a65bf566ec6f None None] MFA Rules not processed for user `abc719a3b3ac4461b82ca04ab6451d81`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:15:58.959342 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-f09028c4-1380-406e-9455-a65bf566ec6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:15:59.082645 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befd303e-b2a4-41c6-96d6-8d464f2b24ef admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:15:59.090809 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e5bea4-f9a8-4a61-ba4f-8214b1ecf2ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:15:59.091899 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e5bea4-f9a8-4a61-ba4f-8214b1ecf2ff admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:15:59.092923 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e5bea4-f9a8-4a61-ba4f-8214b1ecf2ff admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:15:59.093355 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e5bea4-f9a8-4a61-ba4f-8214b1ecf2ff admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:15:59.094439 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e5bea4-f9a8-4a61-ba4f-8214b1ecf2ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:15:59.096701 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e5bea4-f9a8-4a61-ba4f-8214b1ecf2ff admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:15:59.130333 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1294/2578] 10.222.0.17 () {58 vars in 1018 bytes} [Sat Jul 23 21:15:58 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:15:59.131411 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09028c4-1380-406e-9455-a65bf566ec6f None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:15:59.134907 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-f09028c4-1380-406e-9455-a65bf566ec6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:15:59.136811 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1285/2579] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:15:58 2022] POST /identity/v3/users => generated 292 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:15:59.138206 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e5bea4-f9a8-4a61-ba4f-8214b1ecf2ff admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:15:59.147143 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:15:59.151472 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e5bea4-f9a8-4a61-ba4f-8214b1ecf2ff admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:15:59.157372 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09028c4-1380-406e-9455-a65bf566ec6f None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:15:59.167448 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bc9831-8731-44d0-9d92-3255e5382c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:15:59.169650 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bc9831-8731-44d0-9d92-3255e5382c3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:15:59.170700 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bc9831-8731-44d0-9d92-3255e5382c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:15:59.171221 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bc9831-8731-44d0-9d92-3255e5382c3b admin admin] PATH_INFO: `/v3/users/a943802454a547b694910d4110180f9c` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:15:59.173278 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc903912-aa29-49ec-9135-cae7d500362f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:15:59.174937 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc903912-aa29-49ec-9135-cae7d500362f admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:15:59.175542 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc903912-aa29-49ec-9135-cae7d500362f admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:15:59.176203 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc903912-aa29-49ec-9135-cae7d500362f admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:15:59.177554 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc903912-aa29-49ec-9135-cae7d500362f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:15:59.180268 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bc9831-8731-44d0-9d92-3255e5382c3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a943802454a547b694910d4110180f9c)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:15:59.181494 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc903912-aa29-49ec-9135-cae7d500362f admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:15:59.182967 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bc9831-8731-44d0-9d92-3255e5382c3b admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:15:59.198959 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1286/2580] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:15:59 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:15:59.200402 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc903912-aa29-49ec-9135-cae7d500362f admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:15:59.213413 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc903912-aa29-49ec-9135-cae7d500362f admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:15:59.219945 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078cb81a-9b49-4758-b54b-629c15cc6793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:15:59.221012 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078cb81a-9b49-4758-b54b-629c15cc6793 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:15:59.221366 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078cb81a-9b49-4758-b54b-629c15cc6793 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:15:59.221933 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078cb81a-9b49-4758-b54b-629c15cc6793 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:15:59.222745 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078cb81a-9b49-4758-b54b-629c15cc6793 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:15:59.224505 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078cb81a-9b49-4758-b54b-629c15cc6793 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:15:59.244376 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1287/2581] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:15:59 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:15:59.245391 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078cb81a-9b49-4758-b54b-629c15cc6793 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:15:59.258477 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078cb81a-9b49-4758-b54b-629c15cc6793 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:15:59.263784 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53d0294-e268-43af-ba07-95eb90bc1a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:15:59.265149 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53d0294-e268-43af-ba07-95eb90bc1a08 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:15:59.265428 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53d0294-e268-43af-ba07-95eb90bc1a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:15:59.265727 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53d0294-e268-43af-ba07-95eb90bc1a08 admin admin] PATH_INFO: `/v3/projects/eef12e9221c04a6cbee380b903a30363/users/a62c9c8b061b4d29b61696314907c572/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:15:59.276351 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-03bc9831-8731-44d0-9d92-3255e5382c3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a943802454a547b694910d4110180f9c'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:15:59.277656 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-03bc9831-8731-44d0-9d92-3255e5382c3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a943802454a547b694910d4110180f9c'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:15:59.289800 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-03bc9831-8731-44d0-9d92-3255e5382c3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a943802454a547b694910d4110180f9c'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:15:59.298940 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53d0294-e268-43af-ba07-95eb90bc1a08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eef12e9221c04a6cbee380b903a30363, user_id=a62c9c8b061b4d29b61696314907c572, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:15:59.301241 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-03bc9831-8731-44d0-9d92-3255e5382c3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a943802454a547b694910d4110180f9c'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:15:59.302403 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53d0294-e268-43af-ba07-95eb90bc1a08 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:15:59.323862 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-03bc9831-8731-44d0-9d92-3255e5382c3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a943802454a547b694910d4110180f9c'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:15:59.325949 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1288/2582] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:15:59 2022] PUT /identity/v3/projects/eef12e9221c04a6cbee380b903a30363/users/a62c9c8b061b4d29b61696314907c572/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:15:59.327521 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53d0294-e268-43af-ba07-95eb90bc1a08 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:15:59.331662 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-d53d0294-e268-43af-ba07-95eb90bc1a08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:15:59.349002 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1295/2583] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:15:59 2022] DELETE /identity/v3/users/a943802454a547b694910d4110180f9c => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:15:59.353020 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056c3f41-5aaf-4205-ad8a-1f51800e45ba None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:15:59.353315 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056c3f41-5aaf-4205-ad8a-1f51800e45ba None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:15:59.353594 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056c3f41-5aaf-4205-ad8a-1f51800e45ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:15:59.392015 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-056c3f41-5aaf-4205-ad8a-1f51800e45ba None None] MFA Rules not processed for user `a62c9c8b061b4d29b61696314907c572`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:15:59.393543 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-056c3f41-5aaf-4205-ad8a-1f51800e45ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:15:59.436229 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53d0294-e268-43af-ba07-95eb90bc1a08 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:15:59.441452 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:15:59.496989 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1296/2584] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:15:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:15:59.502016 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056c3f41-5aaf-4205-ad8a-1f51800e45ba None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:15:59.504097 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-056c3f41-5aaf-4205-ad8a-1f51800e45ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:15:59.575734 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e761af-a509-4d79-8677-d97867da173c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc719a3b3ac4461b82ca04ab6451d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:15:59.576743 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e761af-a509-4d79-8677-d97867da173c service placement] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:15:59.581221 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e761af-a509-4d79-8677-d97867da173c service placement] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:15:59.581706 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e761af-a509-4d79-8677-d97867da173c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:15:59.584177 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-f2e761af-a509-4d79-8677-d97867da173c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:15:59.601823 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e761af-a509-4d79-8677-d97867da173c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:15:59.603994 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e761af-a509-4d79-8677-d97867da173c service placement] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:15:59.618923 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1289/2585] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:15:59 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:15:59.698726 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056c3f41-5aaf-4205-ad8a-1f51800e45ba None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:15:59.707317 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2841f1-493a-407f-a908-351a03354dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:15:59.707972 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2841f1-493a-407f-a908-351a03354dd3 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:15:59.708259 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2841f1-493a-407f-a908-351a03354dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:15:59.708889 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2841f1-493a-407f-a908-351a03354dd3 admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:15:59.709611 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2841f1-493a-407f-a908-351a03354dd3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:15:59.712738 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2841f1-493a-407f-a908-351a03354dd3 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:15:59.725981 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:15:59.775164 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1297/2586] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:15:59 2022] POST /identity/v3/projects => generated 383 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:15:59.777750 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e761af-a509-4d79-8677-d97867da173c service placement] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:15:59.791007 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e761af-a509-4d79-8677-d97867da173c service placement] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:15:59.906396 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2841f1-493a-407f-a908-351a03354dd3 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:15:59.908401 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-5c2841f1-493a-407f-a908-351a03354dd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:15:59.910404 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1268bd-7c56-413a-89dc-992b523a0e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:15:59.911403 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1268bd-7c56-413a-89dc-992b523a0e59 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:15:59.911792 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1268bd-7c56-413a-89dc-992b523a0e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:15:59.912161 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1268bd-7c56-413a-89dc-992b523a0e59 admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:15:59.913667 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1268bd-7c56-413a-89dc-992b523a0e59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:15:59.915745 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1268bd-7c56-413a-89dc-992b523a0e59 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:15:59.936785 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2841f1-493a-407f-a908-351a03354dd3 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:15:59.968353 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199c81b6-243f-489b-b871-0a9395058a09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:15:59.969967 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199c81b6-243f-489b-b871-0a9395058a09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:15:59.970401 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199c81b6-243f-489b-b871-0a9395058a09 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:15:59.970909 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199c81b6-243f-489b-b871-0a9395058a09 admin admin] PATH_INFO: `/v3/projects/db444807b51d4f20a3c99848a8c373eb` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:15:59.974435 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1290/2587] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:15:59 2022] POST /identity/v3/users => generated 298 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:15:59.976270 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1268bd-7c56-413a-89dc-992b523a0e59 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:15:59.979563 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199c81b6-243f-489b-b871-0a9395058a09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db444807b51d4f20a3c99848a8c373eb)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:15:59.981350 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199c81b6-243f-489b-b871-0a9395058a09 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:15:59.991855 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1268bd-7c56-413a-89dc-992b523a0e59 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:16:00.011479 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fc77d7-75e0-4538-bf6f-1f72483b7c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:16:00.012180 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fc77d7-75e0-4538-bf6f-1f72483b7c5b admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:16:00.012504 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fc77d7-75e0-4538-bf6f-1f72483b7c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:16:00.012781 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fc77d7-75e0-4538-bf6f-1f72483b7c5b admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:16:00.014045 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fc77d7-75e0-4538-bf6f-1f72483b7c5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:16:00.016486 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fc77d7-75e0-4538-bf6f-1f72483b7c5b admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:16:00.032619 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1291/2588] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:15:59 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:16:00.036829 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fc77d7-75e0-4538-bf6f-1f72483b7c5b admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:16:00.047995 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fc77d7-75e0-4538-bf6f-1f72483b7c5b admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:16:00.054264 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4d09c7-5e85-4dcc-a457-0e9371149b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:16:00.055307 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4d09c7-5e85-4dcc-a457-0e9371149b5c admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:16:00.055656 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4d09c7-5e85-4dcc-a457-0e9371149b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:16:00.055997 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4d09c7-5e85-4dcc-a457-0e9371149b5c admin admin] PATH_INFO: `/v3/projects/8494aaf50dbe4b3aa205d84bc0f2da18/users/d748e6296dad47a8a72e096c93761fa4/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:16:00.090112 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-199c81b6-243f-489b-b871-0a9395058a09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db444807b51d4f20a3c99848a8c373eb', 'request_id': 'req-199c81b6-243f-489b-b871-0a9395058a09'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:16:00.092350 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4d09c7-5e85-4dcc-a457-0e9371149b5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8494aaf50dbe4b3aa205d84bc0f2da18, user_id=d748e6296dad47a8a72e096c93761fa4, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:16:00.100171 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4d09c7-5e85-4dcc-a457-0e9371149b5c admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:16:00.104384 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-199c81b6-243f-489b-b871-0a9395058a09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db444807b51d4f20a3c99848a8c373eb', 'request_id': 'req-199c81b6-243f-489b-b871-0a9395058a09'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:16:00.115350 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-199c81b6-243f-489b-b871-0a9395058a09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db444807b51d4f20a3c99848a8c373eb', 'request_id': 'req-199c81b6-243f-489b-b871-0a9395058a09'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:16:00.129755 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1292/2589] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:16:00 2022] PUT /identity/v3/projects/8494aaf50dbe4b3aa205d84bc0f2da18/users/d748e6296dad47a8a72e096c93761fa4/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:16:00.133781 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-199c81b6-243f-489b-b871-0a9395058a09 admin admin] The token cache is being invalidate because project db444807b51d4f20a3c99848a8c373eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:16:00.134020 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4d09c7-5e85-4dcc-a457-0e9371149b5c admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:16:00.134712 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-199c81b6-243f-489b-b871-0a9395058a09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:16:00.135211 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-199c81b6-243f-489b-b871-0a9395058a09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:16:00.137151 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1298/2590] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:15:59 2022] DELETE /identity/v3/projects/db444807b51d4f20a3c99848a8c373eb => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:16:00.144530 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dab092-d976-4a07-ac65-4d6c81ed43ee None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:16:00.145663 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dab092-d976-4a07-ac65-4d6c81ed43ee None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:16:00.145996 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dab092-d976-4a07-ac65-4d6c81ed43ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:16:00.180962 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-a9dab092-d976-4a07-ac65-4d6c81ed43ee None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:16:00.183531 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-a9dab092-d976-4a07-ac65-4d6c81ed43ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:16:00.245549 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:16:00.276316 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4d09c7-5e85-4dcc-a457-0e9371149b5c admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:16:00.286900 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d288e338-d914-47b3-aedd-09db780c52f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:16:00.287591 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d288e338-d914-47b3-aedd-09db780c52f4 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:16:00.287873 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d288e338-d914-47b3-aedd-09db780c52f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:16:00.288151 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d288e338-d914-47b3-aedd-09db780c52f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:16:00.288890 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d288e338-d914-47b3-aedd-09db780c52f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:16:00.293398 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d288e338-d914-47b3-aedd-09db780c52f4 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:16:00.319807 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1293/2591] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:16:00 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 21:16:00.323556 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d288e338-d914-47b3-aedd-09db780c52f4 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:16:00.324798 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1299/2592] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:16:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:16:00.325887 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-d288e338-d914-47b3-aedd-09db780c52f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:16:00.331153 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4b2ce0-09a9-4daf-b691-fe43cd157667 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:16:00.332098 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4b2ce0-09a9-4daf-b691-fe43cd157667 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:16:00.332098 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4b2ce0-09a9-4daf-b691-fe43cd157667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:16:00.356443 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d288e338-d914-47b3-aedd-09db780c52f4 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:16:00.371030 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-be4b2ce0-09a9-4daf-b691-fe43cd157667 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:16:00.372270 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-be4b2ce0-09a9-4daf-b691-fe43cd157667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:16:00.373699 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488fecc5-6116-4d23-adb3-14f7d092bb34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:16:00.374651 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488fecc5-6116-4d23-adb3-14f7d092bb34 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:16:00.374930 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488fecc5-6116-4d23-adb3-14f7d092bb34 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:16:00.375208 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488fecc5-6116-4d23-adb3-14f7d092bb34 admin admin] PATH_INFO: `/v3/projects/8494aaf50dbe4b3aa205d84bc0f2da18/users/d748e6296dad47a8a72e096c93761fa4/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:16:00.379426 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488fecc5-6116-4d23-adb3-14f7d092bb34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8494aaf50dbe4b3aa205d84bc0f2da18, user_id=d748e6296dad47a8a72e096c93761fa4, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:16:00.382568 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488fecc5-6116-4d23-adb3-14f7d092bb34 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:16:00.395188 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1300/2593] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:16:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:16:00.399435 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4b2ce0-09a9-4daf-b691-fe43cd157667 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:16:00.412303 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1294/2594] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:16:00 2022] PUT /identity/v3/projects/8494aaf50dbe4b3aa205d84bc0f2da18/users/d748e6296dad47a8a72e096c93761fa4/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:16:00.423789 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299f585c-6c30-455d-9485-be1e967afe40 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:16:00.425041 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299f585c-6c30-455d-9485-be1e967afe40 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:16:00.425328 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299f585c-6c30-455d-9485-be1e967afe40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:16:00.458205 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4b2ce0-09a9-4daf-b691-fe43cd157667 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:16:00.470707 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-299f585c-6c30-455d-9485-be1e967afe40 None None] MFA Rules not processed for user `d748e6296dad47a8a72e096c93761fa4`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:16:00.472140 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-299f585c-6c30-455d-9485-be1e967afe40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:16:00.602205 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4ce3d6-f4ee-47e7-8d6e-386d93fc61d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:16:00.603147 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4ce3d6-f4ee-47e7-8d6e-386d93fc61d5 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:16:00.604241 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4ce3d6-f4ee-47e7-8d6e-386d93fc61d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:16:00.605637 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4ce3d6-f4ee-47e7-8d6e-386d93fc61d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:16:00.607640 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4ce3d6-f4ee-47e7-8d6e-386d93fc61d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:16:00.608413 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4ce3d6-f4ee-47e7-8d6e-386d93fc61d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:16:00.612899 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4ce3d6-f4ee-47e7-8d6e-386d93fc61d5 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:16:00.623825 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1295/2595] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:16:00 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:16:00.635853 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:16:00.642404 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1301/2596] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:16:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 21:16:00.647722 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299f585c-6c30-455d-9485-be1e967afe40 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:16:00.663513 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299f585c-6c30-455d-9485-be1e967afe40 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:16:00.668858 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43718d3e-d95a-405a-8ccf-32af5a9f2a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:16:00.669889 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43718d3e-d95a-405a-8ccf-32af5a9f2a3f admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:16:00.670368 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43718d3e-d95a-405a-8ccf-32af5a9f2a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:16:00.670659 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43718d3e-d95a-405a-8ccf-32af5a9f2a3f admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:16:00.671377 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43718d3e-d95a-405a-8ccf-32af5a9f2a3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:16:00.673687 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43718d3e-d95a-405a-8ccf-32af5a9f2a3f admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:16:00.727619 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1296/2597] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:16:00 2022] POST /identity/v3/projects => generated 387 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:16:00.729773 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4ce3d6-f4ee-47e7-8d6e-386d93fc61d5 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:16:00.745933 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4ce3d6-f4ee-47e7-8d6e-386d93fc61d5 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:16:00.772054 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43718d3e-d95a-405a-8ccf-32af5a9f2a3f admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:16:00.775366 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-43718d3e-d95a-405a-8ccf-32af5a9f2a3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:16:00.892006 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7848c9f-7666-477a-b407-adb2d88a2db8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:16:00.895221 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7848c9f-7666-477a-b407-adb2d88a2db8 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:16:00.895599 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7848c9f-7666-477a-b407-adb2d88a2db8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:16:00.896651 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7848c9f-7666-477a-b407-adb2d88a2db8 admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:16:00.900309 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7848c9f-7666-477a-b407-adb2d88a2db8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:16:00.906236 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7848c9f-7666-477a-b407-adb2d88a2db8 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:16:00.929488 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43718d3e-d95a-405a-8ccf-32af5a9f2a3f admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:16:00.936985 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec64eeb4-5cc7-48d8-b4ee-a6cb650e46f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:16:00.938102 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec64eeb4-5cc7-48d8-b4ee-a6cb650e46f0 service nova] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:16:00.939080 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec64eeb4-5cc7-48d8-b4ee-a6cb650e46f0 service nova] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:16:00.939456 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec64eeb4-5cc7-48d8-b4ee-a6cb650e46f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:16:00.970415 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1302/2598] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:16:00 2022] POST /identity/v3/users => generated 294 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:16:00.971796 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7848c9f-7666-477a-b407-adb2d88a2db8 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:16:00.987739 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7848c9f-7666-477a-b407-adb2d88a2db8 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:16:00.994675 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bec584-8e13-4151-9004-459577ca66a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:16:00.995700 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bec584-8e13-4151-9004-459577ca66a3 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:16:00.995983 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bec584-8e13-4151-9004-459577ca66a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:16:00.996310 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bec584-8e13-4151-9004-459577ca66a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:16:00.997050 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bec584-8e13-4151-9004-459577ca66a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:16:00.998709 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bec584-8e13-4151-9004-459577ca66a3 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:16:01.006948 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:16:01.013215 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1303/2599] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:16:00 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 21:16:01.018464 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bec584-8e13-4151-9004-459577ca66a3 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:16:01.041689 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bec584-8e13-4151-9004-459577ca66a3 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:16:01.050053 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873fb6b1-401c-43e5-abcf-181ff0691518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:16:01.051451 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873fb6b1-401c-43e5-abcf-181ff0691518 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:16:01.051885 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873fb6b1-401c-43e5-abcf-181ff0691518 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:16:01.052320 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873fb6b1-401c-43e5-abcf-181ff0691518 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:16:01.053272 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873fb6b1-401c-43e5-abcf-181ff0691518 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:16:01.055562 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873fb6b1-401c-43e5-abcf-181ff0691518 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:16:01.062081 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec64eeb4-5cc7-48d8-b4ee-a6cb650e46f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:16:01.064146 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec64eeb4-5cc7-48d8-b4ee-a6cb650e46f0 service nova] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:16:01.080288 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1304/2600] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:16:01 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:16:01.080498 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1297/2601] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:16:00 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 23 21:16:01.081476 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873fb6b1-401c-43e5-abcf-181ff0691518 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:16:01.097750 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873fb6b1-401c-43e5-abcf-181ff0691518 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:16:01.101840 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25de75fb-515f-424c-bfcd-f1746ce623c7 None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:16:01.102293 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25de75fb-515f-424c-bfcd-f1746ce623c7 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:16:01.102929 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25de75fb-515f-424c-bfcd-f1746ce623c7 None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:16:01.105163 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fd871e-98cb-4631-b2b3-51ebf31c5d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:16:01.107193 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fd871e-98cb-4631-b2b3-51ebf31c5d38 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:16:01.108064 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fd871e-98cb-4631-b2b3-51ebf31c5d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:16:01.108194 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fd871e-98cb-4631-b2b3-51ebf31c5d38 admin admin] PATH_INFO: `/v3/projects/e6dde0bc5a6444eaa396aec0c7c9b9c6/users/c0990a2281f948b8a68be6c7e8599d8e/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:16:01.109213 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1298/2602] 10.222.0.17 () {54 vars in 912 bytes} [Sat Jul 23 21:16:01 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:16:01.116981 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25de75fb-515f-424c-bfcd-f1746ce623c7 None None] Authenticating service token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 23 21:16:01.132919 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fd871e-98cb-4631-b2b3-51ebf31c5d38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6dde0bc5a6444eaa396aec0c7c9b9c6, user_id=c0990a2281f948b8a68be6c7e8599d8e, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:16:01.135301 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25de75fb-515f-424c-bfcd-f1746ce623c7 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:16:01.135901 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fd871e-98cb-4631-b2b3-51ebf31c5d38 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:16:01.149631 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25de75fb-515f-424c-bfcd-f1746ce623c7 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:16:01.161032 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1305/2603] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:16:01 2022] PUT /identity/v3/projects/e6dde0bc5a6444eaa396aec0c7c9b9c6/users/c0990a2281f948b8a68be6c7e8599d8e/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:16:01.163071 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d619d6-6343-4740-a898-eb98905bb06f None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:16:01.163375 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d619d6-6343-4740-a898-eb98905bb06f None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:16:01.163690 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d619d6-6343-4740-a898-eb98905bb06f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:16:01.191271 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-36d619d6-6343-4740-a898-eb98905bb06f None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:16:01.192917 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-36d619d6-6343-4740-a898-eb98905bb06f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:16:01.235087 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c236e81-6d8e-4bc6-a85a-a5a57755f339 tempest-QuotasAdminNegativeTest-1459539385 tempest-QuotasAdminNegativeTest-1459539385-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd748e6296dad47a8a72e096c93761fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8494aaf50dbe4b3aa205d84bc0f2da18', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:16:01.236212 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c236e81-6d8e-4bc6-a85a-a5a57755f339 tempest-QuotasAdminNegativeTest-1459539385 tempest-QuotasAdminNegativeTest-1459539385-project-admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:16:01.236559 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c236e81-6d8e-4bc6-a85a-a5a57755f339 tempest-QuotasAdminNegativeTest-1459539385 tempest-QuotasAdminNegativeTest-1459539385-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:16:01.237044 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c236e81-6d8e-4bc6-a85a-a5a57755f339 tempest-QuotasAdminNegativeTest-1459539385 tempest-QuotasAdminNegativeTest-1459539385-project-admin] PATH_INFO: `/v3/projects/eef12e9221c04a6cbee380b903a30363` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:16:01.238698 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c236e81-6d8e-4bc6-a85a-a5a57755f339 tempest-QuotasAdminNegativeTest-1459539385 tempest-QuotasAdminNegativeTest-1459539385-project-admin] RBAC: Authorizing `identity:get_project(project_id=eef12e9221c04a6cbee380b903a30363)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:16:01.241101 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c236e81-6d8e-4bc6-a85a-a5a57755f339 tempest-QuotasAdminNegativeTest-1459539385 tempest-QuotasAdminNegativeTest-1459539385-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:16:01.255822 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1299/2604] 10.222.0.17 () {58 vars in 1443 bytes} [Sat Jul 23 21:16:01 2022] GET /identity/v3/projects/eef12e9221c04a6cbee380b903a30363 => generated 383 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:16:01.293819 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1306/2605] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:16:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:16:01.302272 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c236e81-6d8e-4bc6-a85a-a5a57755f339 tempest-QuotasAdminNegativeTest-1459539385 tempest-QuotasAdminNegativeTest-1459539385-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:16:01.304697 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-8c236e81-6d8e-4bc6-a85a-a5a57755f339 tempest-QuotasAdminNegativeTest-1459539385 tempest-QuotasAdminNegativeTest-1459539385-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:16:01.423253 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c236e81-6d8e-4bc6-a85a-a5a57755f339 tempest-QuotasAdminNegativeTest-1459539385 tempest-QuotasAdminNegativeTest-1459539385-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:16:01.428188 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8de3b60-c58f-41ad-b24b-ca475541b9fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:16:01.429090 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8de3b60-c58f-41ad-b24b-ca475541b9fb service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:16:01.429587 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8de3b60-c58f-41ad-b24b-ca475541b9fb service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:16:01.430172 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8de3b60-c58f-41ad-b24b-ca475541b9fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:16:01.449187 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8de3b60-c58f-41ad-b24b-ca475541b9fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:16:01.453160 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8de3b60-c58f-41ad-b24b-ca475541b9fb service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:16:01.469025 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1300/2606] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:16:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:16:01.559848 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f314e09-b6bc-4196-b770-947ea3d78d50 None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:16:01.560437 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f314e09-b6bc-4196-b770-947ea3d78d50 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:16:01.560895 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f314e09-b6bc-4196-b770-947ea3d78d50 None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:16:01.563096 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1307/2607] 10.222.0.17 () {54 vars in 912 bytes} [Sat Jul 23 21:16:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:16:01.569834 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8de3b60-c58f-41ad-b24b-ca475541b9fb service neutron] Authenticating service token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 23 21:16:01.572600 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-b8de3b60-c58f-41ad-b24b-ca475541b9fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:16:01.718404 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8de3b60-c58f-41ad-b24b-ca475541b9fb service neutron] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:16:01.725729 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:16:01.731726 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8de3b60-c58f-41ad-b24b-ca475541b9fb service neutron] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:16:01.738216 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2950dc-d2d9-4926-9eaf-ca967bcdb5dc tempest-QuotasAdminNegativeTest-1459539385 tempest-QuotasAdminNegativeTest-1459539385-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd748e6296dad47a8a72e096c93761fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8494aaf50dbe4b3aa205d84bc0f2da18', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:16:01.739461 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2950dc-d2d9-4926-9eaf-ca967bcdb5dc tempest-QuotasAdminNegativeTest-1459539385 tempest-QuotasAdminNegativeTest-1459539385-project-admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:16:01.739951 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2950dc-d2d9-4926-9eaf-ca967bcdb5dc tempest-QuotasAdminNegativeTest-1459539385 tempest-QuotasAdminNegativeTest-1459539385-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:16:01.740406 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2950dc-d2d9-4926-9eaf-ca967bcdb5dc tempest-QuotasAdminNegativeTest-1459539385 tempest-QuotasAdminNegativeTest-1459539385-project-admin] PATH_INFO: `/v3/projects/eef12e9221c04a6cbee380b903a30363` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:16:01.741848 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2950dc-d2d9-4926-9eaf-ca967bcdb5dc tempest-QuotasAdminNegativeTest-1459539385 tempest-QuotasAdminNegativeTest-1459539385-project-admin] RBAC: Authorizing `identity:get_project(project_id=eef12e9221c04a6cbee380b903a30363)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:16:01.744775 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2950dc-d2d9-4926-9eaf-ca967bcdb5dc tempest-QuotasAdminNegativeTest-1459539385 tempest-QuotasAdminNegativeTest-1459539385-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:16:01.747562 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1301/2608] 10.222.0.17 () {58 vars in 1443 bytes} [Sat Jul 23 21:16:01 2022] GET /identity/v3/projects/eef12e9221c04a6cbee380b903a30363 => generated 383 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:16:01.895934 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bebd251-bf6e-4348-b32e-f13a53133d61 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:16:01.896212 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bebd251-bf6e-4348-b32e-f13a53133d61 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:16:01.897095 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bebd251-bf6e-4348-b32e-f13a53133d61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:16:01.939074 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-3bebd251-bf6e-4348-b32e-f13a53133d61 None None] MFA Rules not processed for user `a62c9c8b061b4d29b61696314907c572`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:16:01.941897 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-3bebd251-bf6e-4348-b32e-f13a53133d61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:16:02.028651 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:16:02.058841 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1308/2609] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:16:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:16:02.070638 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2950dc-d2d9-4926-9eaf-ca967bcdb5dc tempest-QuotasAdminNegativeTest-1459539385 tempest-QuotasAdminNegativeTest-1459539385-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:16:02.078170 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af2f6c0-904e-4bfd-acc6-bc8ea46ff1a7 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:16:02.081899 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af2f6c0-904e-4bfd-acc6-bc8ea46ff1a7 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:16:02.082803 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af2f6c0-904e-4bfd-acc6-bc8ea46ff1a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:16:02.086515 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2950dc-d2d9-4926-9eaf-ca967bcdb5dc tempest-QuotasAdminNegativeTest-1459539385 tempest-QuotasAdminNegativeTest-1459539385-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:16:02.097496 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96b85c7-a1b2-4f3e-9109-2838818bbb3a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:16:02.098380 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96b85c7-a1b2-4f3e-9109-2838818bbb3a service nova] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:16:02.098655 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96b85c7-a1b2-4f3e-9109-2838818bbb3a service nova] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:16:02.098928 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96b85c7-a1b2-4f3e-9109-2838818bbb3a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:16:02.100858 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-e96b85c7-a1b2-4f3e-9109-2838818bbb3a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:16:02.116782 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96b85c7-a1b2-4f3e-9109-2838818bbb3a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:16:02.117366 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-4af2f6c0-904e-4bfd-acc6-bc8ea46ff1a7 None None] MFA Rules not processed for user `f2672c5db79b4a48a505c3df536594dd`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:16:02.121030 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96b85c7-a1b2-4f3e-9109-2838818bbb3a service nova] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:16:02.133752 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-4af2f6c0-904e-4bfd-acc6-bc8ea46ff1a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:16:02.137282 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1302/2610] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:16:02 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:16:02.326073 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1309/2611] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:16:02 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:16:04.320461 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f32016-c8c5-4360-a32a-6cfe8277bcfc None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:16:04.321010 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f32016-c8c5-4360-a32a-6cfe8277bcfc None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:16:04.321010 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f32016-c8c5-4360-a32a-6cfe8277bcfc None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:16:04.322435 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1303/2612] 10.222.0.17 () {54 vars in 912 bytes} [Sat Jul 23 21:16:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:16:04.328500 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af2f6c0-904e-4bfd-acc6-bc8ea46ff1a7 None None] Authenticating service token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 23 21:16:04.345612 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af2f6c0-904e-4bfd-acc6-bc8ea46ff1a7 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:16:04.355543 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af2f6c0-904e-4bfd-acc6-bc8ea46ff1a7 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:16:04.360632 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bc2031-51a5-48fb-ad3a-f89db08fd45e tempest-QuotasAdminNegativeTest-1459539385 tempest-QuotasAdminNegativeTest-1459539385-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd748e6296dad47a8a72e096c93761fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8494aaf50dbe4b3aa205d84bc0f2da18', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:16:04.361549 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bc2031-51a5-48fb-ad3a-f89db08fd45e tempest-QuotasAdminNegativeTest-1459539385 tempest-QuotasAdminNegativeTest-1459539385-project-admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:16:04.361834 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bc2031-51a5-48fb-ad3a-f89db08fd45e tempest-QuotasAdminNegativeTest-1459539385 tempest-QuotasAdminNegativeTest-1459539385-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:16:04.362141 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bc2031-51a5-48fb-ad3a-f89db08fd45e tempest-QuotasAdminNegativeTest-1459539385 tempest-QuotasAdminNegativeTest-1459539385-project-admin] PATH_INFO: `/v3/projects/eef12e9221c04a6cbee380b903a30363` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:16:04.364415 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bc2031-51a5-48fb-ad3a-f89db08fd45e tempest-QuotasAdminNegativeTest-1459539385 tempest-QuotasAdminNegativeTest-1459539385-project-admin] RBAC: Authorizing `identity:get_project(project_id=eef12e9221c04a6cbee380b903a30363)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:16:04.367053 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bc2031-51a5-48fb-ad3a-f89db08fd45e tempest-QuotasAdminNegativeTest-1459539385 tempest-QuotasAdminNegativeTest-1459539385-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:16:04.369253 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1310/2613] 10.222.0.17 () {58 vars in 1443 bytes} [Sat Jul 23 21:16:04 2022] GET /identity/v3/projects/eef12e9221c04a6cbee380b903a30363 => generated 383 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:16:04.655555 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6e712b-1bac-4b3b-9791-09c5cc332362 None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:16:04.657265 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6e712b-1bac-4b3b-9791-09c5cc332362 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:16:04.657265 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6e712b-1bac-4b3b-9791-09c5cc332362 None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:16:04.659212 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1304/2614] 10.222.0.17 () {54 vars in 912 bytes} [Sat Jul 23 21:16:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:16:04.670698 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bc2031-51a5-48fb-ad3a-f89db08fd45e tempest-QuotasAdminNegativeTest-1459539385 tempest-QuotasAdminNegativeTest-1459539385-project-admin] Authenticating service token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 23 21:16:04.695691 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bc2031-51a5-48fb-ad3a-f89db08fd45e tempest-QuotasAdminNegativeTest-1459539385 tempest-QuotasAdminNegativeTest-1459539385-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:16:04.716011 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bc2031-51a5-48fb-ad3a-f89db08fd45e tempest-QuotasAdminNegativeTest-1459539385 tempest-QuotasAdminNegativeTest-1459539385-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:16:04.732384 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbd11f4-bf15-4dde-8da9-5eb4731d5a25 tempest-QuotasAdminNegativeTest-1459539385 tempest-QuotasAdminNegativeTest-1459539385-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd748e6296dad47a8a72e096c93761fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8494aaf50dbe4b3aa205d84bc0f2da18', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:16:04.733303 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbd11f4-bf15-4dde-8da9-5eb4731d5a25 tempest-QuotasAdminNegativeTest-1459539385 tempest-QuotasAdminNegativeTest-1459539385-project-admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:16:04.733672 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbd11f4-bf15-4dde-8da9-5eb4731d5a25 tempest-QuotasAdminNegativeTest-1459539385 tempest-QuotasAdminNegativeTest-1459539385-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:16:04.733978 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbd11f4-bf15-4dde-8da9-5eb4731d5a25 tempest-QuotasAdminNegativeTest-1459539385 tempest-QuotasAdminNegativeTest-1459539385-project-admin] PATH_INFO: `/v3/projects/eef12e9221c04a6cbee380b903a30363` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:16:04.735749 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbd11f4-bf15-4dde-8da9-5eb4731d5a25 tempest-QuotasAdminNegativeTest-1459539385 tempest-QuotasAdminNegativeTest-1459539385-project-admin] RBAC: Authorizing `identity:get_project(project_id=eef12e9221c04a6cbee380b903a30363)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:16:04.738629 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbd11f4-bf15-4dde-8da9-5eb4731d5a25 tempest-QuotasAdminNegativeTest-1459539385 tempest-QuotasAdminNegativeTest-1459539385-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:16:04.743980 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1311/2615] 10.222.0.17 () {58 vars in 1443 bytes} [Sat Jul 23 21:16:04 2022] GET /identity/v3/projects/eef12e9221c04a6cbee380b903a30363 => generated 383 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:16:04.820893 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc79e963-6017-4664-91ff-7e752bbe8ead None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:16:04.821180 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc79e963-6017-4664-91ff-7e752bbe8ead None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:16:04.821456 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc79e963-6017-4664-91ff-7e752bbe8ead None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:16:04.824507 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1305/2616] 10.222.0.17 () {54 vars in 921 bytes} [Sat Jul 23 21:16:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:16:04.836497 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3309b9-c993-4828-af76-03ae54b9f9db None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:16:04.836769 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3309b9-c993-4828-af76-03ae54b9f9db None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:16:04.837047 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3309b9-c993-4828-af76-03ae54b9f9db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:16:04.881593 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-fb3309b9-c993-4828-af76-03ae54b9f9db None None] MFA Rules not processed for user `abc719a3b3ac4461b82ca04ab6451d81`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:16:04.883121 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-fb3309b9-c993-4828-af76-03ae54b9f9db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:16:04.998893 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1312/2617] 10.222.0.17 () {58 vars in 1018 bytes} [Sat Jul 23 21:16:04 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:16:05.034160 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc79e963-6017-4664-91ff-7e752bbe8ead None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:16:05.036314 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-bc79e963-6017-4664-91ff-7e752bbe8ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:16:05.071387 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc79e963-6017-4664-91ff-7e752bbe8ead None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:16:05.087441 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106f9c0f-f0f0-4af5-b46b-5f0411f6f321 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc719a3b3ac4461b82ca04ab6451d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:16:05.088231 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106f9c0f-f0f0-4af5-b46b-5f0411f6f321 service placement] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:16:05.088378 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106f9c0f-f0f0-4af5-b46b-5f0411f6f321 service placement] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:16:05.088656 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106f9c0f-f0f0-4af5-b46b-5f0411f6f321 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:16:05.104032 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106f9c0f-f0f0-4af5-b46b-5f0411f6f321 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:16:05.105989 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106f9c0f-f0f0-4af5-b46b-5f0411f6f321 service placement] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:16:05.134403 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1306/2618] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:16:05 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:16:05.358625 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b8c6ea-57e6-4832-b2ba-5045443153a2 None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:16:05.359117 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b8c6ea-57e6-4832-b2ba-5045443153a2 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:16:05.359218 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b8c6ea-57e6-4832-b2ba-5045443153a2 None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:16:05.360605 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1313/2619] 10.222.0.17 () {54 vars in 912 bytes} [Sat Jul 23 21:16:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:16:05.368913 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106f9c0f-f0f0-4af5-b46b-5f0411f6f321 service placement] Authenticating service token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 23 21:16:05.387236 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106f9c0f-f0f0-4af5-b46b-5f0411f6f321 service placement] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:16:05.412144 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106f9c0f-f0f0-4af5-b46b-5f0411f6f321 service placement] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:16:05.428837 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba8c485-7438-4ec2-a595-930a6f585d78 tempest-QuotasAdminNegativeTest-1459539385 tempest-QuotasAdminNegativeTest-1459539385-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd748e6296dad47a8a72e096c93761fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8494aaf50dbe4b3aa205d84bc0f2da18', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:16:05.429732 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba8c485-7438-4ec2-a595-930a6f585d78 tempest-QuotasAdminNegativeTest-1459539385 tempest-QuotasAdminNegativeTest-1459539385-project-admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:16:05.430044 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba8c485-7438-4ec2-a595-930a6f585d78 tempest-QuotasAdminNegativeTest-1459539385 tempest-QuotasAdminNegativeTest-1459539385-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:16:05.430507 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba8c485-7438-4ec2-a595-930a6f585d78 tempest-QuotasAdminNegativeTest-1459539385 tempest-QuotasAdminNegativeTest-1459539385-project-admin] PATH_INFO: `/v3/projects/eef12e9221c04a6cbee380b903a30363` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:16:05.432480 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba8c485-7438-4ec2-a595-930a6f585d78 tempest-QuotasAdminNegativeTest-1459539385 tempest-QuotasAdminNegativeTest-1459539385-project-admin] RBAC: Authorizing `identity:get_project(project_id=eef12e9221c04a6cbee380b903a30363)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:16:05.435631 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba8c485-7438-4ec2-a595-930a6f585d78 tempest-QuotasAdminNegativeTest-1459539385 tempest-QuotasAdminNegativeTest-1459539385-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:16:05.437631 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1307/2620] 10.222.0.17 () {58 vars in 1443 bytes} [Sat Jul 23 21:16:05 2022] GET /identity/v3/projects/eef12e9221c04a6cbee380b903a30363 => generated 383 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:16:05.547486 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5f5c7a-5848-4d33-a7f1-857e02681920 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:16:05.547908 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5f5c7a-5848-4d33-a7f1-857e02681920 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:16:05.548046 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5f5c7a-5848-4d33-a7f1-857e02681920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:16:05.587870 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-aa5f5c7a-5848-4d33-a7f1-857e02681920 None None] MFA Rules not processed for user `a62c9c8b061b4d29b61696314907c572`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:16:05.589992 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-aa5f5c7a-5848-4d33-a7f1-857e02681920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:16:05.603795 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1314/2621] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:16:05 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:16:08.714392 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfce2469-cffa-4110-bebe-f98feb06cbaf None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:16:08.715371 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfce2469-cffa-4110-bebe-f98feb06cbaf None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:16:08.715915 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfce2469-cffa-4110-bebe-f98feb06cbaf None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:16:08.717520 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1308/2622] 10.222.0.17 () {54 vars in 912 bytes} [Sat Jul 23 21:16:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:16:08.723786 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5f5c7a-5848-4d33-a7f1-857e02681920 None None] Authenticating service token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 23 21:16:08.739845 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5f5c7a-5848-4d33-a7f1-857e02681920 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:16:08.750337 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5f5c7a-5848-4d33-a7f1-857e02681920 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:16:08.761824 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14f787f-f1ad-4537-9857-0c8fcf0af0b7 tempest-QuotasAdminNegativeTest-1459539385 tempest-QuotasAdminNegativeTest-1459539385-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd748e6296dad47a8a72e096c93761fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8494aaf50dbe4b3aa205d84bc0f2da18', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:16:08.763532 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14f787f-f1ad-4537-9857-0c8fcf0af0b7 tempest-QuotasAdminNegativeTest-1459539385 tempest-QuotasAdminNegativeTest-1459539385-project-admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:16:08.763890 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14f787f-f1ad-4537-9857-0c8fcf0af0b7 tempest-QuotasAdminNegativeTest-1459539385 tempest-QuotasAdminNegativeTest-1459539385-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:16:08.764341 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14f787f-f1ad-4537-9857-0c8fcf0af0b7 tempest-QuotasAdminNegativeTest-1459539385 tempest-QuotasAdminNegativeTest-1459539385-project-admin] PATH_INFO: `/v3/projects/eef12e9221c04a6cbee380b903a30363` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:16:08.765692 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14f787f-f1ad-4537-9857-0c8fcf0af0b7 tempest-QuotasAdminNegativeTest-1459539385 tempest-QuotasAdminNegativeTest-1459539385-project-admin] RBAC: Authorizing `identity:get_project(project_id=eef12e9221c04a6cbee380b903a30363)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:16:08.770320 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14f787f-f1ad-4537-9857-0c8fcf0af0b7 tempest-QuotasAdminNegativeTest-1459539385 tempest-QuotasAdminNegativeTest-1459539385-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:16:08.772729 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1315/2623] 10.222.0.17 () {58 vars in 1443 bytes} [Sat Jul 23 21:16:08 2022] GET /identity/v3/projects/eef12e9221c04a6cbee380b903a30363 => generated 383 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:16:08.877800 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7467aeb4-fbd9-4e08-ade7-47fe8d1a8031 None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:16:08.878121 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7467aeb4-fbd9-4e08-ade7-47fe8d1a8031 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:16:08.878427 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7467aeb4-fbd9-4e08-ade7-47fe8d1a8031 None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:16:08.879786 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1309/2624] 10.222.0.17 () {54 vars in 912 bytes} [Sat Jul 23 21:16:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:16:08.884917 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14f787f-f1ad-4537-9857-0c8fcf0af0b7 tempest-QuotasAdminNegativeTest-1459539385 tempest-QuotasAdminNegativeTest-1459539385-project-admin] Authenticating service token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 23 21:16:08.899968 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14f787f-f1ad-4537-9857-0c8fcf0af0b7 tempest-QuotasAdminNegativeTest-1459539385 tempest-QuotasAdminNegativeTest-1459539385-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:16:08.910217 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14f787f-f1ad-4537-9857-0c8fcf0af0b7 tempest-QuotasAdminNegativeTest-1459539385 tempest-QuotasAdminNegativeTest-1459539385-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:16:08.915579 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5d0026-77e7-4d32-aef1-07dc1541bf14 tempest-QuotasAdminNegativeTest-1459539385 tempest-QuotasAdminNegativeTest-1459539385-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd748e6296dad47a8a72e096c93761fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8494aaf50dbe4b3aa205d84bc0f2da18', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:16:08.916477 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5d0026-77e7-4d32-aef1-07dc1541bf14 tempest-QuotasAdminNegativeTest-1459539385 tempest-QuotasAdminNegativeTest-1459539385-project-admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:16:08.916760 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5d0026-77e7-4d32-aef1-07dc1541bf14 tempest-QuotasAdminNegativeTest-1459539385 tempest-QuotasAdminNegativeTest-1459539385-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:16:08.917034 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5d0026-77e7-4d32-aef1-07dc1541bf14 tempest-QuotasAdminNegativeTest-1459539385 tempest-QuotasAdminNegativeTest-1459539385-project-admin] PATH_INFO: `/v3/projects/eef12e9221c04a6cbee380b903a30363` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:16:08.918301 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5d0026-77e7-4d32-aef1-07dc1541bf14 tempest-QuotasAdminNegativeTest-1459539385 tempest-QuotasAdminNegativeTest-1459539385-project-admin] RBAC: Authorizing `identity:get_project(project_id=eef12e9221c04a6cbee380b903a30363)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:16:08.920400 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5d0026-77e7-4d32-aef1-07dc1541bf14 tempest-QuotasAdminNegativeTest-1459539385 tempest-QuotasAdminNegativeTest-1459539385-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:16:08.922549 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1316/2625] 10.222.0.17 () {58 vars in 1443 bytes} [Sat Jul 23 21:16:08 2022] GET /identity/v3/projects/eef12e9221c04a6cbee380b903a30363 => generated 383 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 21:16:08.961417 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23a1fcd-49f3-4d57-8b27-e5729d5b5a71 None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:16:08.962338 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23a1fcd-49f3-4d57-8b27-e5729d5b5a71 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:16:08.962803 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23a1fcd-49f3-4d57-8b27-e5729d5b5a71 None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:16:08.965233 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1310/2626] 10.222.0.17 () {54 vars in 912 bytes} [Sat Jul 23 21:16:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:16:08.971883 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5d0026-77e7-4d32-aef1-07dc1541bf14 tempest-QuotasAdminNegativeTest-1459539385 tempest-QuotasAdminNegativeTest-1459539385-project-admin] Authenticating service token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 23 21:16:08.988302 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5d0026-77e7-4d32-aef1-07dc1541bf14 tempest-QuotasAdminNegativeTest-1459539385 tempest-QuotasAdminNegativeTest-1459539385-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:16:08.999040 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5d0026-77e7-4d32-aef1-07dc1541bf14 tempest-QuotasAdminNegativeTest-1459539385 tempest-QuotasAdminNegativeTest-1459539385-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:16:09.006036 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50600c8-5aa3-4c4a-9ebe-d1a6caad8e6b tempest-QuotasAdminNegativeTest-1459539385 tempest-QuotasAdminNegativeTest-1459539385-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd748e6296dad47a8a72e096c93761fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8494aaf50dbe4b3aa205d84bc0f2da18', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:16:09.006906 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50600c8-5aa3-4c4a-9ebe-d1a6caad8e6b tempest-QuotasAdminNegativeTest-1459539385 tempest-QuotasAdminNegativeTest-1459539385-project-admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:16:09.007192 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50600c8-5aa3-4c4a-9ebe-d1a6caad8e6b tempest-QuotasAdminNegativeTest-1459539385 tempest-QuotasAdminNegativeTest-1459539385-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:16:09.007464 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50600c8-5aa3-4c4a-9ebe-d1a6caad8e6b tempest-QuotasAdminNegativeTest-1459539385 tempest-QuotasAdminNegativeTest-1459539385-project-admin] PATH_INFO: `/v3/projects/eef12e9221c04a6cbee380b903a30363` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:16:09.008668 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50600c8-5aa3-4c4a-9ebe-d1a6caad8e6b tempest-QuotasAdminNegativeTest-1459539385 tempest-QuotasAdminNegativeTest-1459539385-project-admin] RBAC: Authorizing `identity:get_project(project_id=eef12e9221c04a6cbee380b903a30363)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:16:09.010785 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50600c8-5aa3-4c4a-9ebe-d1a6caad8e6b tempest-QuotasAdminNegativeTest-1459539385 tempest-QuotasAdminNegativeTest-1459539385-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:16:09.012543 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1317/2627] 10.222.0.17 () {58 vars in 1443 bytes} [Sat Jul 23 21:16:08 2022] GET /identity/v3/projects/eef12e9221c04a6cbee380b903a30363 => generated 383 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:16:09.094323 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa14d14-3f75-4274-a840-9f6c736055ac None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:16:09.094611 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa14d14-3f75-4274-a840-9f6c736055ac None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:16:09.094889 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa14d14-3f75-4274-a840-9f6c736055ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:16:09.114190 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-caa14d14-3f75-4274-a840-9f6c736055ac None None] MFA Rules not processed for user `a62c9c8b061b4d29b61696314907c572`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:16:09.115433 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-caa14d14-3f75-4274-a840-9f6c736055ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:16:09.123689 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1311/2628] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:16:09 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:16:10.458650 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50600c8-5aa3-4c4a-9ebe-d1a6caad8e6b tempest-QuotasAdminNegativeTest-1459539385 tempest-QuotasAdminNegativeTest-1459539385-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:16:10.461659 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-e50600c8-5aa3-4c4a-9ebe-d1a6caad8e6b tempest-QuotasAdminNegativeTest-1459539385 tempest-QuotasAdminNegativeTest-1459539385-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:16:10.486546 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50600c8-5aa3-4c4a-9ebe-d1a6caad8e6b tempest-QuotasAdminNegativeTest-1459539385 tempest-QuotasAdminNegativeTest-1459539385-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:16:10.499815 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc99ab0-475a-49b3-bbe9-4b109946405c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc719a3b3ac4461b82ca04ab6451d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:16:10.500850 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc99ab0-475a-49b3-bbe9-4b109946405c service placement] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:16:10.501132 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc99ab0-475a-49b3-bbe9-4b109946405c service placement] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:16:10.501983 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc99ab0-475a-49b3-bbe9-4b109946405c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:16:10.504753 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-dbc99ab0-475a-49b3-bbe9-4b109946405c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:16:10.544630 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc99ab0-475a-49b3-bbe9-4b109946405c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:16:10.546397 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc99ab0-475a-49b3-bbe9-4b109946405c service placement] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:16:10.568801 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1318/2629] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:16:10 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 23 21:16:10.783527 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797f774e-8ca2-4133-a4de-e47724da9302 None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:16:10.784114 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797f774e-8ca2-4133-a4de-e47724da9302 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:16:10.784114 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797f774e-8ca2-4133-a4de-e47724da9302 None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:16:10.785441 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1312/2630] 10.222.0.17 () {54 vars in 912 bytes} [Sat Jul 23 21:16:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:16:10.793481 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc99ab0-475a-49b3-bbe9-4b109946405c service placement] Authenticating service token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 23 21:16:10.850798 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc99ab0-475a-49b3-bbe9-4b109946405c service placement] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:16:10.866259 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc99ab0-475a-49b3-bbe9-4b109946405c service placement] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:16:10.875566 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcfa54e-dae6-4b4f-a1d3-f9720b6a639c tempest-QuotasAdminNegativeTest-1459539385 tempest-QuotasAdminNegativeTest-1459539385-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd748e6296dad47a8a72e096c93761fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8494aaf50dbe4b3aa205d84bc0f2da18', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:16:10.879723 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcfa54e-dae6-4b4f-a1d3-f9720b6a639c tempest-QuotasAdminNegativeTest-1459539385 tempest-QuotasAdminNegativeTest-1459539385-project-admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:16:10.880404 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcfa54e-dae6-4b4f-a1d3-f9720b6a639c tempest-QuotasAdminNegativeTest-1459539385 tempest-QuotasAdminNegativeTest-1459539385-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:16:10.880887 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcfa54e-dae6-4b4f-a1d3-f9720b6a639c tempest-QuotasAdminNegativeTest-1459539385 tempest-QuotasAdminNegativeTest-1459539385-project-admin] PATH_INFO: `/v3/projects/eef12e9221c04a6cbee380b903a30363` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:16:10.882763 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcfa54e-dae6-4b4f-a1d3-f9720b6a639c tempest-QuotasAdminNegativeTest-1459539385 tempest-QuotasAdminNegativeTest-1459539385-project-admin] RBAC: Authorizing `identity:get_project(project_id=eef12e9221c04a6cbee380b903a30363)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:16:10.885463 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcfa54e-dae6-4b4f-a1d3-f9720b6a639c tempest-QuotasAdminNegativeTest-1459539385 tempest-QuotasAdminNegativeTest-1459539385-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:16:10.889658 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1319/2631] 10.222.0.17 () {58 vars in 1443 bytes} [Sat Jul 23 21:16:10 2022] GET /identity/v3/projects/eef12e9221c04a6cbee380b903a30363 => generated 383 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:16:11.237417 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee88eac-16c3-4260-b545-5326b35d8073 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:16:11.237973 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee88eac-16c3-4260-b545-5326b35d8073 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:16:11.238502 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee88eac-16c3-4260-b545-5326b35d8073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:16:11.280731 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-2ee88eac-16c3-4260-b545-5326b35d8073 None None] MFA Rules not processed for user `39f1a14a59b7401d88f18ec35c91e30a`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:16:11.283255 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-2ee88eac-16c3-4260-b545-5326b35d8073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:16:11.288526 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcfa54e-dae6-4b4f-a1d3-f9720b6a639c tempest-QuotasAdminNegativeTest-1459539385 tempest-QuotasAdminNegativeTest-1459539385-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:16:11.313716 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcfa54e-dae6-4b4f-a1d3-f9720b6a639c tempest-QuotasAdminNegativeTest-1459539385 tempest-QuotasAdminNegativeTest-1459539385-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:16:11.330811 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e42688d-0d9d-4480-be9f-0583bb5a6566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:16:11.333183 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e42688d-0d9d-4480-be9f-0583bb5a6566 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:16:11.335280 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e42688d-0d9d-4480-be9f-0583bb5a6566 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:16:11.335822 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e42688d-0d9d-4480-be9f-0583bb5a6566 admin admin] PATH_INFO: `/v3/users/a62c9c8b061b4d29b61696314907c572` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:16:11.339723 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e42688d-0d9d-4480-be9f-0583bb5a6566 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a62c9c8b061b4d29b61696314907c572)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:16:11.350184 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e42688d-0d9d-4480-be9f-0583bb5a6566 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:16:11.409508 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:16:11.490800 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-8e42688d-0d9d-4480-be9f-0583bb5a6566 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a62c9c8b061b4d29b61696314907c572'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:16:11.492518 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1313/2632] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:16:11 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:16:11.494037 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-8e42688d-0d9d-4480-be9f-0583bb5a6566 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a62c9c8b061b4d29b61696314907c572'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:16:11.507841 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-8e42688d-0d9d-4480-be9f-0583bb5a6566 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a62c9c8b061b4d29b61696314907c572'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:16:11.519882 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-8e42688d-0d9d-4480-be9f-0583bb5a6566 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a62c9c8b061b4d29b61696314907c572'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:16:11.570831 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-8e42688d-0d9d-4480-be9f-0583bb5a6566 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a62c9c8b061b4d29b61696314907c572'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:16:11.588765 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1320/2633] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:16:11 2022] DELETE /identity/v3/users/a62c9c8b061b4d29b61696314907c572 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:16:11.595075 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cabbdbc-084e-4bc9-a697-93158412acea None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:16:11.595844 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cabbdbc-084e-4bc9-a697-93158412acea None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:16:11.596282 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cabbdbc-084e-4bc9-a697-93158412acea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:16:11.625774 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-8cabbdbc-084e-4bc9-a697-93158412acea None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:16:11.627860 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-8cabbdbc-084e-4bc9-a697-93158412acea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:16:11.822562 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1314/2634] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:16:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:16:11.870733 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e42688d-0d9d-4480-be9f-0583bb5a6566 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:16:11.873010 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-8e42688d-0d9d-4480-be9f-0583bb5a6566 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:16:12.030166 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e42688d-0d9d-4480-be9f-0583bb5a6566 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:16:12.040069 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae0a867-ed13-4c0b-9230-2bb194db461a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:16:12.040757 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae0a867-ed13-4c0b-9230-2bb194db461a service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:16:12.041221 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae0a867-ed13-4c0b-9230-2bb194db461a service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:16:12.041678 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae0a867-ed13-4c0b-9230-2bb194db461a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:16:12.065436 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae0a867-ed13-4c0b-9230-2bb194db461a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:16:12.068449 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae0a867-ed13-4c0b-9230-2bb194db461a service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:16:12.085916 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1321/2635] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:16:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:16:13.551409 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cabbdbc-084e-4bc9-a697-93158412acea None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:16:13.553100 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-8cabbdbc-084e-4bc9-a697-93158412acea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:16:13.578257 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cabbdbc-084e-4bc9-a697-93158412acea None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:16:13.592308 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd61d070-31ab-41d6-9fec-8c8ac14eaa8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:16:13.593512 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd61d070-31ab-41d6-9fec-8c8ac14eaa8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:16:13.593981 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd61d070-31ab-41d6-9fec-8c8ac14eaa8b admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:16:13.594434 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd61d070-31ab-41d6-9fec-8c8ac14eaa8b admin admin] PATH_INFO: `/v3/projects/eef12e9221c04a6cbee380b903a30363` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:16:13.596467 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd61d070-31ab-41d6-9fec-8c8ac14eaa8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=eef12e9221c04a6cbee380b903a30363)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:16:13.598881 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd61d070-31ab-41d6-9fec-8c8ac14eaa8b admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:16:13.692635 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-bd61d070-31ab-41d6-9fec-8c8ac14eaa8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eef12e9221c04a6cbee380b903a30363', 'request_id': 'req-bd61d070-31ab-41d6-9fec-8c8ac14eaa8b'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:16:13.710698 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-bd61d070-31ab-41d6-9fec-8c8ac14eaa8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eef12e9221c04a6cbee380b903a30363', 'request_id': 'req-bd61d070-31ab-41d6-9fec-8c8ac14eaa8b'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:16:13.714387 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:16:13.722143 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-bd61d070-31ab-41d6-9fec-8c8ac14eaa8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eef12e9221c04a6cbee380b903a30363', 'request_id': 'req-bd61d070-31ab-41d6-9fec-8c8ac14eaa8b'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:16:13.739184 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-bd61d070-31ab-41d6-9fec-8c8ac14eaa8b admin admin] The token cache is being invalidate because project eef12e9221c04a6cbee380b903a30363 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:16:13.740042 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-bd61d070-31ab-41d6-9fec-8c8ac14eaa8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:16:13.741150 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-bd61d070-31ab-41d6-9fec-8c8ac14eaa8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:16:13.743451 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1315/2636] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:16:13 2022] DELETE /identity/v3/projects/eef12e9221c04a6cbee380b903a30363 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:16:13.748348 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae0a867-ed13-4c0b-9230-2bb194db461a service neutron] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:16:13.766231 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae0a867-ed13-4c0b-9230-2bb194db461a service neutron] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:16:13.897383 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6615af29-4c68-4a77-a6a0-0aca8e0923c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:16:13.898579 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6615af29-4c68-4a77-a6a0-0aca8e0923c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:16:13.899014 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6615af29-4c68-4a77-a6a0-0aca8e0923c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:16:13.899656 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6615af29-4c68-4a77-a6a0-0aca8e0923c1 admin admin] PATH_INFO: `/v3/users/d748e6296dad47a8a72e096c93761fa4` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:16:13.901132 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6615af29-4c68-4a77-a6a0-0aca8e0923c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d748e6296dad47a8a72e096c93761fa4)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:16:13.905073 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6615af29-4c68-4a77-a6a0-0aca8e0923c1 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:16:13.991322 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:16:14.017480 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-6615af29-4c68-4a77-a6a0-0aca8e0923c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd748e6296dad47a8a72e096c93761fa4'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:16:14.019251 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-6615af29-4c68-4a77-a6a0-0aca8e0923c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd748e6296dad47a8a72e096c93761fa4'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:16:14.041942 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-6615af29-4c68-4a77-a6a0-0aca8e0923c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd748e6296dad47a8a72e096c93761fa4'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:16:14.062968 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-6615af29-4c68-4a77-a6a0-0aca8e0923c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd748e6296dad47a8a72e096c93761fa4'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:16:14.099745 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-6615af29-4c68-4a77-a6a0-0aca8e0923c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd748e6296dad47a8a72e096c93761fa4'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:16:14.119062 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1322/2637] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:16:13 2022] DELETE /identity/v3/users/d748e6296dad47a8a72e096c93761fa4 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:16:16.030443 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd61d070-31ab-41d6-9fec-8c8ac14eaa8b admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:16:16.032806 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-bd61d070-31ab-41d6-9fec-8c8ac14eaa8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:16:16.053257 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd61d070-31ab-41d6-9fec-8c8ac14eaa8b admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:16:16.132585 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cdeb5f-d708-44f1-be1e-c63cc946152f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:16:16.133801 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cdeb5f-d708-44f1-be1e-c63cc946152f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:16:16.134424 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cdeb5f-d708-44f1-be1e-c63cc946152f admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:16:16.135010 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cdeb5f-d708-44f1-be1e-c63cc946152f admin admin] PATH_INFO: `/v3/projects/8494aaf50dbe4b3aa205d84bc0f2da18` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:16:16.137149 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cdeb5f-d708-44f1-be1e-c63cc946152f admin admin] RBAC: Authorizing `identity:delete_project(project_id=8494aaf50dbe4b3aa205d84bc0f2da18)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:16:16.140225 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cdeb5f-d708-44f1-be1e-c63cc946152f admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:16:16.219357 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-e5cdeb5f-d708-44f1-be1e-c63cc946152f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8494aaf50dbe4b3aa205d84bc0f2da18', 'request_id': 'req-e5cdeb5f-d708-44f1-be1e-c63cc946152f'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:16:16.232990 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-e5cdeb5f-d708-44f1-be1e-c63cc946152f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8494aaf50dbe4b3aa205d84bc0f2da18', 'request_id': 'req-e5cdeb5f-d708-44f1-be1e-c63cc946152f'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:16:16.248098 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-e5cdeb5f-d708-44f1-be1e-c63cc946152f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8494aaf50dbe4b3aa205d84bc0f2da18', 'request_id': 'req-e5cdeb5f-d708-44f1-be1e-c63cc946152f'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:16:16.266031 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-e5cdeb5f-d708-44f1-be1e-c63cc946152f admin admin] The token cache is being invalidate because project 8494aaf50dbe4b3aa205d84bc0f2da18 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:16:16.266567 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-e5cdeb5f-d708-44f1-be1e-c63cc946152f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:16:16.268611 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-e5cdeb5f-d708-44f1-be1e-c63cc946152f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:16:16.272517 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1316/2638] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:16:16 2022] DELETE /identity/v3/projects/8494aaf50dbe4b3aa205d84bc0f2da18 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:16:16.278023 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cb9f66-df64-4489-89f9-31c3629d95aa None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:16:16.278886 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cb9f66-df64-4489-89f9-31c3629d95aa None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:16:16.279315 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cb9f66-df64-4489-89f9-31c3629d95aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:16:16.324039 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-09cb9f66-df64-4489-89f9-31c3629d95aa None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:16:16.326466 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-09cb9f66-df64-4489-89f9-31c3629d95aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:16:16.410487 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1323/2639] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:16:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:16:16.418804 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9836079-481f-45fe-8159-9644bc5e8567 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:16:16.419110 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9836079-481f-45fe-8159-9644bc5e8567 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:16:16.419429 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9836079-481f-45fe-8159-9644bc5e8567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:16:16.455317 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-d9836079-481f-45fe-8159-9644bc5e8567 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:16:16.456596 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-d9836079-481f-45fe-8159-9644bc5e8567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:16:16.474004 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1317/2640] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:16:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:16:16.478768 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cb9f66-df64-4489-89f9-31c3629d95aa None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:16:16.492423 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cb9f66-df64-4489-89f9-31c3629d95aa None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:16:16.512049 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f3fd3c-4692-4480-b240-ebe487bc40fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:16:16.513025 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f3fd3c-4692-4480-b240-ebe487bc40fc admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:16:16.513682 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f3fd3c-4692-4480-b240-ebe487bc40fc admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:16:16.513914 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f3fd3c-4692-4480-b240-ebe487bc40fc admin admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:16:16.514536 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f3fd3c-4692-4480-b240-ebe487bc40fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:16:16.514839 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f3fd3c-4692-4480-b240-ebe487bc40fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:16:16.516616 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f3fd3c-4692-4480-b240-ebe487bc40fc admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:16:16.565068 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1324/2641] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:16:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:16:16.570331 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9836079-481f-45fe-8159-9644bc5e8567 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:16:16.599967 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9836079-481f-45fe-8159-9644bc5e8567 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:16:16.619673 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2b3dd2-59bf-42c6-9c01-87d8fade1d12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:16:16.623099 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2b3dd2-59bf-42c6-9c01-87d8fade1d12 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:16:16.624832 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2b3dd2-59bf-42c6-9c01-87d8fade1d12 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:16:16.625264 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2b3dd2-59bf-42c6-9c01-87d8fade1d12 admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:16:16.629247 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2b3dd2-59bf-42c6-9c01-87d8fade1d12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:16:16.635250 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2b3dd2-59bf-42c6-9c01-87d8fade1d12 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:16:16.693661 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f3fd3c-4692-4480-b240-ebe487bc40fc admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:16:16.695774 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1318/2642] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:16:16 2022] POST /identity/v3/projects => generated 393 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:16:16.714532 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f3fd3c-4692-4480-b240-ebe487bc40fc admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:16:16.887926 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b805d11-8274-44a9-89e3-6919547be6bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:16:16.888898 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b805d11-8274-44a9-89e3-6919547be6bf admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:16:16.889330 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b805d11-8274-44a9-89e3-6919547be6bf admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:16:16.889782 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b805d11-8274-44a9-89e3-6919547be6bf admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:16:16.891231 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b805d11-8274-44a9-89e3-6919547be6bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:16:16.895917 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b805d11-8274-44a9-89e3-6919547be6bf admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:16:16.948349 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1325/2643] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:16:16 2022] POST /identity/v3/users => generated 297 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:16:16.954756 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2b3dd2-59bf-42c6-9c01-87d8fade1d12 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:16:16.969323 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2b3dd2-59bf-42c6-9c01-87d8fade1d12 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:16:17.002756 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b55658a-167d-4923-9447-85204bbfb5f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:16:17.003715 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b55658a-167d-4923-9447-85204bbfb5f3 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:16:17.007908 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b55658a-167d-4923-9447-85204bbfb5f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:16:17.008330 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b55658a-167d-4923-9447-85204bbfb5f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:16:17.012102 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b55658a-167d-4923-9447-85204bbfb5f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:16:17.019728 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b55658a-167d-4923-9447-85204bbfb5f3 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:16:17.071703 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1319/2644] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:16:16 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:16:17.072993 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b805d11-8274-44a9-89e3-6919547be6bf admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:16:17.096662 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b805d11-8274-44a9-89e3-6919547be6bf admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:16:17.124565 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095ecc5b-f27e-4f74-9b51-585f2dd52316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:16:17.125295 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095ecc5b-f27e-4f74-9b51-585f2dd52316 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:16:17.125615 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095ecc5b-f27e-4f74-9b51-585f2dd52316 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:16:17.125834 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095ecc5b-f27e-4f74-9b51-585f2dd52316 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:16:17.128590 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095ecc5b-f27e-4f74-9b51-585f2dd52316 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:16:17.130289 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095ecc5b-f27e-4f74-9b51-585f2dd52316 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:16:17.152439 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b55658a-167d-4923-9447-85204bbfb5f3 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:16:17.163413 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1326/2645] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:16:17 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 21:16:17.165528 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b55658a-167d-4923-9447-85204bbfb5f3 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:16:17.174593 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c121be9-b055-492f-8e68-71dd84cfe86a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:16:17.175690 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c121be9-b055-492f-8e68-71dd84cfe86a admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:16:17.176172 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c121be9-b055-492f-8e68-71dd84cfe86a admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:16:17.177239 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c121be9-b055-492f-8e68-71dd84cfe86a admin admin] PATH_INFO: `/v3/projects/d33c120f6af043118dc2a6a38f1b3fef/users/c55591dee28340968946a4199aea40db/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:16:17.199961 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c121be9-b055-492f-8e68-71dd84cfe86a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d33c120f6af043118dc2a6a38f1b3fef, user_id=c55591dee28340968946a4199aea40db, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:16:17.203162 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c121be9-b055-492f-8e68-71dd84cfe86a admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:16:17.233996 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1320/2646] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:16:17 2022] PUT /identity/v3/projects/d33c120f6af043118dc2a6a38f1b3fef/users/c55591dee28340968946a4199aea40db/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:16:17.234753 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350b7de9-2ab2-4b9c-91db-d5a3c4f6df7e None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:16:17.235053 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350b7de9-2ab2-4b9c-91db-d5a3c4f6df7e None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:16:17.235339 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350b7de9-2ab2-4b9c-91db-d5a3c4f6df7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:16:17.276100 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-350b7de9-2ab2-4b9c-91db-d5a3c4f6df7e None None] MFA Rules not processed for user `c55591dee28340968946a4199aea40db`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:16:17.277746 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-350b7de9-2ab2-4b9c-91db-d5a3c4f6df7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:16:17.286625 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:16:17.369803 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1327/2647] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:16:17 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:16:17.374288 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c121be9-b055-492f-8e68-71dd84cfe86a admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:16:17.393724 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=89,keystone:DELETE=8,keystone:INSERT=3 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:16:17.461587 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c121be9-b055-492f-8e68-71dd84cfe86a admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:16:17.470008 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eac3fe1-c2bf-46f5-af98-a50034f6d4d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:16:17.475927 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eac3fe1-c2bf-46f5-af98-a50034f6d4d8 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:16:17.476511 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eac3fe1-c2bf-46f5-af98-a50034f6d4d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:16:17.477072 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eac3fe1-c2bf-46f5-af98-a50034f6d4d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:16:17.478672 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eac3fe1-c2bf-46f5-af98-a50034f6d4d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:16:17.481716 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eac3fe1-c2bf-46f5-af98-a50034f6d4d8 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:16:17.524012 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1321/2648] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:16:17 2022] POST /identity/v3/projects => generated 393 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:16:17.524591 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350b7de9-2ab2-4b9c-91db-d5a3c4f6df7e None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:16:17.549054 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350b7de9-2ab2-4b9c-91db-d5a3c4f6df7e None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:16:17.698717 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d967d99-2724-4ec1-bf57-3bc748764d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:16:17.699520 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d967d99-2724-4ec1-bf57-3bc748764d71 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:16:17.700059 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d967d99-2724-4ec1-bf57-3bc748764d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:16:17.700548 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d967d99-2724-4ec1-bf57-3bc748764d71 admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:16:17.701583 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d967d99-2724-4ec1-bf57-3bc748764d71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:16:17.704708 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d967d99-2724-4ec1-bf57-3bc748764d71 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:16:17.740508 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1328/2649] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:16:17 2022] POST /identity/v3/users => generated 303 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:16:17.741440 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eac3fe1-c2bf-46f5-af98-a50034f6d4d8 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:16:17.755856 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eac3fe1-c2bf-46f5-af98-a50034f6d4d8 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:16:17.762575 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a429014d-0675-4eab-9334-de93a7e48826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:16:17.764426 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a429014d-0675-4eab-9334-de93a7e48826 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:16:17.766181 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a429014d-0675-4eab-9334-de93a7e48826 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:16:17.766689 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a429014d-0675-4eab-9334-de93a7e48826 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:16:17.767711 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a429014d-0675-4eab-9334-de93a7e48826 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:16:17.769680 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a429014d-0675-4eab-9334-de93a7e48826 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:16:17.771527 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7b5bb6-5895-4569-89c5-87eb7d37c7e5 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:16:17.771972 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7b5bb6-5895-4569-89c5-87eb7d37c7e5 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:16:17.772791 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7b5bb6-5895-4569-89c5-87eb7d37c7e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:16:17.786190 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1322/2650] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:16:17 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 21:16:17.790729 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a429014d-0675-4eab-9334-de93a7e48826 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:16:17.804628 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a429014d-0675-4eab-9334-de93a7e48826 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:16:17.818731 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1ca7a3-8579-4024-aae7-ed9547dba15d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:16:17.820143 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1ca7a3-8579-4024-aae7-ed9547dba15d admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:16:17.820993 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1ca7a3-8579-4024-aae7-ed9547dba15d admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:16:17.821492 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1ca7a3-8579-4024-aae7-ed9547dba15d admin admin] PATH_INFO: `/v3/projects/4ec95705e75e4e0e9dff3b94102a0eaf/users/74db7bd93e554a9c8a4f333ef6fef1ff/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:16:17.873815 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1ca7a3-8579-4024-aae7-ed9547dba15d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ec95705e75e4e0e9dff3b94102a0eaf, user_id=74db7bd93e554a9c8a4f333ef6fef1ff, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:16:17.878300 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1ca7a3-8579-4024-aae7-ed9547dba15d admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:16:17.915893 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-ad7b5bb6-5895-4569-89c5-87eb7d37c7e5 None None] MFA Rules not processed for user `c0990a2281f948b8a68be6c7e8599d8e`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:16:17.917147 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-ad7b5bb6-5895-4569-89c5-87eb7d37c7e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:16:17.919201 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1323/2651] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:16:17 2022] PUT /identity/v3/projects/4ec95705e75e4e0e9dff3b94102a0eaf/users/74db7bd93e554a9c8a4f333ef6fef1ff/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:16:17.924692 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1ca7a3-8579-4024-aae7-ed9547dba15d admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:16:18.143952 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1329/2652] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:16:17 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 374 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:16:18.167620 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1ca7a3-8579-4024-aae7-ed9547dba15d admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:16:18.174896 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fe4ad6-7d69-4c87-a7b9-fa6399bf61fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:16:18.185045 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fe4ad6-7d69-4c87-a7b9-fa6399bf61fd admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:16:18.185289 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fe4ad6-7d69-4c87-a7b9-fa6399bf61fd admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:16:18.185569 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fe4ad6-7d69-4c87-a7b9-fa6399bf61fd admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:16:18.186392 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fe4ad6-7d69-4c87-a7b9-fa6399bf61fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:16:18.188045 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fe4ad6-7d69-4c87-a7b9-fa6399bf61fd admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:16:18.235575 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1324/2653] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:16:17 2022] GET /identity/v3/roles => generated 1420 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:16:18.236120 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7b5bb6-5895-4569-89c5-87eb7d37c7e5 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:16:18.262477 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7b5bb6-5895-4569-89c5-87eb7d37c7e5 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:16:18.281771 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2545dac1-6f2a-4f30-b524-43844ba67d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:16:18.282734 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2545dac1-6f2a-4f30-b524-43844ba67d1d admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:16:18.283265 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2545dac1-6f2a-4f30-b524-43844ba67d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:16:18.283708 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2545dac1-6f2a-4f30-b524-43844ba67d1d admin admin] PATH_INFO: `/v3/projects/4ec95705e75e4e0e9dff3b94102a0eaf/users/74db7bd93e554a9c8a4f333ef6fef1ff/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:16:18.288430 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2545dac1-6f2a-4f30-b524-43844ba67d1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ec95705e75e4e0e9dff3b94102a0eaf, user_id=74db7bd93e554a9c8a4f333ef6fef1ff, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:16:18.291213 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2545dac1-6f2a-4f30-b524-43844ba67d1d admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:16:18.344985 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1330/2654] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:16:18 2022] PUT /identity/v3/projects/4ec95705e75e4e0e9dff3b94102a0eaf/users/74db7bd93e554a9c8a4f333ef6fef1ff/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:16:18.356107 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca254342-1640-4c93-984d-5d84ca4fc7fd None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:16:18.356395 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca254342-1640-4c93-984d-5d84ca4fc7fd None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:16:18.356672 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca254342-1640-4c93-984d-5d84ca4fc7fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:16:18.421599 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-ca254342-1640-4c93-984d-5d84ca4fc7fd None None] MFA Rules not processed for user `74db7bd93e554a9c8a4f333ef6fef1ff`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:16:18.423149 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-ca254342-1640-4c93-984d-5d84ca4fc7fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:16:18.597639 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:16:18.735716 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1325/2655] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:16:18 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 381 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:16:18.843984 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2545dac1-6f2a-4f30-b524-43844ba67d1d admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:16:18.847300 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-2545dac1-6f2a-4f30-b524-43844ba67d1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:16:18.866469 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:16:18.950087 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2545dac1-6f2a-4f30-b524-43844ba67d1d admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:16:18.957795 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969ab95f-8371-4a73-b765-7161bb4a1f14 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:16:18.959404 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969ab95f-8371-4a73-b765-7161bb4a1f14 service nova] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:16:18.959936 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969ab95f-8371-4a73-b765-7161bb4a1f14 service nova] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:16:18.960391 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969ab95f-8371-4a73-b765-7161bb4a1f14 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:16:19.058144 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969ab95f-8371-4a73-b765-7161bb4a1f14 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:16:19.060028 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969ab95f-8371-4a73-b765-7161bb4a1f14 service nova] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:16:19.090038 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1331/2656] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:16:18 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:16:19.862259 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca254342-1640-4c93-984d-5d84ca4fc7fd None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:16:19.866202 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-ca254342-1640-4c93-984d-5d84ca4fc7fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:16:19.888262 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca254342-1640-4c93-984d-5d84ca4fc7fd None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:16:19.916370 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff3f5aa-0a08-43a2-9ae3-b703b1badbea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:16:19.917243 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff3f5aa-0a08-43a2-9ae3-b703b1badbea service nova] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:16:19.917725 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff3f5aa-0a08-43a2-9ae3-b703b1badbea service nova] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:16:19.917947 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff3f5aa-0a08-43a2-9ae3-b703b1badbea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:16:19.940574 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff3f5aa-0a08-43a2-9ae3-b703b1badbea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:16:19.944014 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff3f5aa-0a08-43a2-9ae3-b703b1badbea service nova] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:16:19.977007 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1326/2657] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:16:19 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 23 21:16:23.317203 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969ab95f-8371-4a73-b765-7161bb4a1f14 service nova] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:16:23.319007 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-969ab95f-8371-4a73-b765-7161bb4a1f14 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:16:23.444438 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969ab95f-8371-4a73-b765-7161bb4a1f14 service nova] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:16:23.462697 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0421a222-0d03-4244-bedb-16c10e99e8f2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc719a3b3ac4461b82ca04ab6451d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:16:23.464456 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0421a222-0d03-4244-bedb-16c10e99e8f2 service placement] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:16:23.465047 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0421a222-0d03-4244-bedb-16c10e99e8f2 service placement] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:16:23.466087 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0421a222-0d03-4244-bedb-16c10e99e8f2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:16:23.472937 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-0421a222-0d03-4244-bedb-16c10e99e8f2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:16:23.507813 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0421a222-0d03-4244-bedb-16c10e99e8f2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:16:23.510589 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0421a222-0d03-4244-bedb-16c10e99e8f2 service placement] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:16:23.533713 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1332/2658] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:16:23 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:16:23.579824 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b233bf6-ad47-4c17-987f-a31419cf394b None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:16:23.580931 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b233bf6-ad47-4c17-987f-a31419cf394b None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:16:23.581385 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b233bf6-ad47-4c17-987f-a31419cf394b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:16:23.605463 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-9b233bf6-ad47-4c17-987f-a31419cf394b None None] MFA Rules not processed for user `17b779a3e21a415bb42cde5d6863d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:16:23.607715 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-9b233bf6-ad47-4c17-987f-a31419cf394b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:16:23.691187 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1327/2659] 10.222.0.17 () {58 vars in 1009 bytes} [Sat Jul 23 21:16:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:16:23.740437 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0421a222-0d03-4244-bedb-16c10e99e8f2 service placement] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:16:23.742833 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-0421a222-0d03-4244-bedb-16c10e99e8f2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:16:23.855140 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:16:23.919559 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0421a222-0d03-4244-bedb-16c10e99e8f2 service placement] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:16:23.936858 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf9dbfe-69da-4f14-9f27-1ceaa6d4963c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f0a685b7da46afb81024848f079d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:16:23.936858 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf9dbfe-69da-4f14-9f27-1ceaa6d4963c service swift] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:16:23.937142 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf9dbfe-69da-4f14-9f27-1ceaa6d4963c service swift] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:16:23.937442 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf9dbfe-69da-4f14-9f27-1ceaa6d4963c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:16:23.964338 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf9dbfe-69da-4f14-9f27-1ceaa6d4963c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:16:23.971714 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf9dbfe-69da-4f14-9f27-1ceaa6d4963c service swift] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:16:24.009049 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1333/2660] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 23 21:16:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 23 21:16:25.866171 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b233bf6-ad47-4c17-987f-a31419cf394b None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:16:25.895746 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b233bf6-ad47-4c17-987f-a31419cf394b None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:16:25.902777 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c21354d-8830-4c69-923c-dc43a8422e6c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:16:25.903839 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c21354d-8830-4c69-923c-dc43a8422e6c service nova] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:16:25.904817 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c21354d-8830-4c69-923c-dc43a8422e6c service nova] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:16:25.905326 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c21354d-8830-4c69-923c-dc43a8422e6c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:16:26.006044 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c21354d-8830-4c69-923c-dc43a8422e6c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:16:26.007932 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c21354d-8830-4c69-923c-dc43a8422e6c service nova] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:16:26.028808 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1328/2661] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:16:25 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:16:26.059214 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf9dbfe-69da-4f14-9f27-1ceaa6d4963c service swift] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:16:26.202948 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf9dbfe-69da-4f14-9f27-1ceaa6d4963c service swift] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:16:26.208287 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b872fb3a-0d74-4229-89af-101ed0ec4c5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:16:26.209210 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b872fb3a-0d74-4229-89af-101ed0ec4c5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:16:26.209484 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b872fb3a-0d74-4229-89af-101ed0ec4c5a admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:16:26.209754 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b872fb3a-0d74-4229-89af-101ed0ec4c5a admin admin] PATH_INFO: `/v3/users/c55591dee28340968946a4199aea40db` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:16:26.211044 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b872fb3a-0d74-4229-89af-101ed0ec4c5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c55591dee28340968946a4199aea40db)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:16:26.215316 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b872fb3a-0d74-4229-89af-101ed0ec4c5a admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:16:26.305468 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-b872fb3a-0d74-4229-89af-101ed0ec4c5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c55591dee28340968946a4199aea40db'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:16:26.306554 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-b872fb3a-0d74-4229-89af-101ed0ec4c5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c55591dee28340968946a4199aea40db'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:16:26.315267 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-b872fb3a-0d74-4229-89af-101ed0ec4c5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c55591dee28340968946a4199aea40db'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:16:26.327908 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-b872fb3a-0d74-4229-89af-101ed0ec4c5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c55591dee28340968946a4199aea40db'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:16:26.343919 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-b872fb3a-0d74-4229-89af-101ed0ec4c5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c55591dee28340968946a4199aea40db'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:16:26.350702 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1334/2662] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:16:26 2022] DELETE /identity/v3/users/c55591dee28340968946a4199aea40db => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:16:26.355406 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b34abd9-787c-4773-ba90-356355767d4d None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:16:26.355701 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b34abd9-787c-4773-ba90-356355767d4d None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:16:26.355981 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b34abd9-787c-4773-ba90-356355767d4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:16:26.382277 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-1b34abd9-787c-4773-ba90-356355767d4d None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:16:26.384235 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-1b34abd9-787c-4773-ba90-356355767d4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:16:26.524848 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1329/2663] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:16:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:16:26.555047 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b872fb3a-0d74-4229-89af-101ed0ec4c5a admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:16:26.557039 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-b872fb3a-0d74-4229-89af-101ed0ec4c5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:16:26.683298 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:16:26.696010 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b872fb3a-0d74-4229-89af-101ed0ec4c5a admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:16:26.703884 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6728c583-2f3b-4f5b-9adb-57759086d13b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:16:26.706532 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6728c583-2f3b-4f5b-9adb-57759086d13b service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:16:26.707084 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6728c583-2f3b-4f5b-9adb-57759086d13b service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:16:26.707435 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6728c583-2f3b-4f5b-9adb-57759086d13b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:16:26.733769 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6728c583-2f3b-4f5b-9adb-57759086d13b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:16:26.736345 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6728c583-2f3b-4f5b-9adb-57759086d13b service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:16:26.778246 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1335/2664] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:16:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:16:27.283975 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf56c43d-19bc-4a2e-ad3c-64e50e7595af None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:16:27.284935 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf56c43d-19bc-4a2e-ad3c-64e50e7595af None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:16:27.285363 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf56c43d-19bc-4a2e-ad3c-64e50e7595af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:16:27.310415 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-cf56c43d-19bc-4a2e-ad3c-64e50e7595af None None] MFA Rules not processed for user `ebf92af08fa94215b4eafcacea6c63f6`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:16:27.311937 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-cf56c43d-19bc-4a2e-ad3c-64e50e7595af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:16:27.326420 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:16:27.416007 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1330/2665] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:16:27 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:16:28.342405 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6728c583-2f3b-4f5b-9adb-57759086d13b service neutron] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:16:28.344352 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-6728c583-2f3b-4f5b-9adb-57759086d13b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:16:28.374079 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6728c583-2f3b-4f5b-9adb-57759086d13b service neutron] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:16:28.388837 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2bc3ee-5398-412a-8527-7c5d34621a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:16:28.390438 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2bc3ee-5398-412a-8527-7c5d34621a72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:16:28.390991 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2bc3ee-5398-412a-8527-7c5d34621a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:16:28.391532 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2bc3ee-5398-412a-8527-7c5d34621a72 admin admin] PATH_INFO: `/v3/projects/d33c120f6af043118dc2a6a38f1b3fef` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:16:28.393615 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2bc3ee-5398-412a-8527-7c5d34621a72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d33c120f6af043118dc2a6a38f1b3fef)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:16:28.397067 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2bc3ee-5398-412a-8527-7c5d34621a72 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:16:28.531785 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-ce2bc3ee-5398-412a-8527-7c5d34621a72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd33c120f6af043118dc2a6a38f1b3fef', 'request_id': 'req-ce2bc3ee-5398-412a-8527-7c5d34621a72'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:16:28.551527 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-ce2bc3ee-5398-412a-8527-7c5d34621a72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd33c120f6af043118dc2a6a38f1b3fef', 'request_id': 'req-ce2bc3ee-5398-412a-8527-7c5d34621a72'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:16:28.558196 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-ce2bc3ee-5398-412a-8527-7c5d34621a72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd33c120f6af043118dc2a6a38f1b3fef', 'request_id': 'req-ce2bc3ee-5398-412a-8527-7c5d34621a72'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:16:28.573543 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-ce2bc3ee-5398-412a-8527-7c5d34621a72 admin admin] The token cache is being invalidate because project d33c120f6af043118dc2a6a38f1b3fef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:16:28.573831 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-ce2bc3ee-5398-412a-8527-7c5d34621a72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:16:28.574567 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-ce2bc3ee-5398-412a-8527-7c5d34621a72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:16:28.579068 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1336/2666] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:16:28 2022] DELETE /identity/v3/projects/d33c120f6af043118dc2a6a38f1b3fef => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:16:28.582360 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf56c43d-19bc-4a2e-ad3c-64e50e7595af None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:16:28.601987 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf56c43d-19bc-4a2e-ad3c-64e50e7595af None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:16:28.683827 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a38a68-df10-4dac-ad0b-14d88c25e51a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:16:28.685274 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a38a68-df10-4dac-ad0b-14d88c25e51a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:16:28.685705 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a38a68-df10-4dac-ad0b-14d88c25e51a admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:16:28.686199 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a38a68-df10-4dac-ad0b-14d88c25e51a admin admin] PATH_INFO: `/v3/users/74db7bd93e554a9c8a4f333ef6fef1ff` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:16:28.687693 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a38a68-df10-4dac-ad0b-14d88c25e51a admin admin] RBAC: Authorizing `identity:delete_user(user_id=74db7bd93e554a9c8a4f333ef6fef1ff)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:16:28.690187 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a38a68-df10-4dac-ad0b-14d88c25e51a admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:16:28.959036 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-a9a38a68-df10-4dac-ad0b-14d88c25e51a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74db7bd93e554a9c8a4f333ef6fef1ff'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:16:28.985709 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-a9a38a68-df10-4dac-ad0b-14d88c25e51a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74db7bd93e554a9c8a4f333ef6fef1ff'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:16:28.989380 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-a9a38a68-df10-4dac-ad0b-14d88c25e51a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74db7bd93e554a9c8a4f333ef6fef1ff'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:16:29.008725 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-a9a38a68-df10-4dac-ad0b-14d88c25e51a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74db7bd93e554a9c8a4f333ef6fef1ff'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:16:29.074303 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-a9a38a68-df10-4dac-ad0b-14d88c25e51a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74db7bd93e554a9c8a4f333ef6fef1ff'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:16:29.086233 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1331/2667] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:16:28 2022] DELETE /identity/v3/users/74db7bd93e554a9c8a4f333ef6fef1ff => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:16:30.151518 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2bc3ee-5398-412a-8527-7c5d34621a72 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:16:30.156201 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-ce2bc3ee-5398-412a-8527-7c5d34621a72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:16:30.228510 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2bc3ee-5398-412a-8527-7c5d34621a72 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:16:30.441536 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaa454f-42ce-4ce0-ac52-d3c2bf530d0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:16:30.442731 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaa454f-42ce-4ce0-ac52-d3c2bf530d0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:16:30.443340 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaa454f-42ce-4ce0-ac52-d3c2bf530d0c admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:16:30.446039 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaa454f-42ce-4ce0-ac52-d3c2bf530d0c admin admin] PATH_INFO: `/v3/projects/4ec95705e75e4e0e9dff3b94102a0eaf` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:16:30.448031 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaa454f-42ce-4ce0-ac52-d3c2bf530d0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ec95705e75e4e0e9dff3b94102a0eaf)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:16:30.452298 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaa454f-42ce-4ce0-ac52-d3c2bf530d0c admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:16:30.631589 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-aaaa454f-42ce-4ce0-ac52-d3c2bf530d0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ec95705e75e4e0e9dff3b94102a0eaf', 'request_id': 'req-aaaa454f-42ce-4ce0-ac52-d3c2bf530d0c'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:16:30.653339 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-aaaa454f-42ce-4ce0-ac52-d3c2bf530d0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ec95705e75e4e0e9dff3b94102a0eaf', 'request_id': 'req-aaaa454f-42ce-4ce0-ac52-d3c2bf530d0c'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:16:30.674986 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-aaaa454f-42ce-4ce0-ac52-d3c2bf530d0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ec95705e75e4e0e9dff3b94102a0eaf', 'request_id': 'req-aaaa454f-42ce-4ce0-ac52-d3c2bf530d0c'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:16:30.718249 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-aaaa454f-42ce-4ce0-ac52-d3c2bf530d0c admin admin] The token cache is being invalidate because project 4ec95705e75e4e0e9dff3b94102a0eaf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:16:30.719609 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-aaaa454f-42ce-4ce0-ac52-d3c2bf530d0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:16:30.724366 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-aaaa454f-42ce-4ce0-ac52-d3c2bf530d0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:16:30.729005 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1337/2668] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:16:30 2022] DELETE /identity/v3/projects/4ec95705e75e4e0e9dff3b94102a0eaf => generated 0 bytes in 579 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:16:30.734621 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5a9c10-b075-4285-b715-e711d6e4cc32 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:16:30.735213 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5a9c10-b075-4285-b715-e711d6e4cc32 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:16:30.735213 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5a9c10-b075-4285-b715-e711d6e4cc32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:16:30.802106 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-fe5a9c10-b075-4285-b715-e711d6e4cc32 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:16:30.804218 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-fe5a9c10-b075-4285-b715-e711d6e4cc32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:16:30.897335 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:16:30.955717 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1332/2669] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:16:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:16:30.963646 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79b8428-7ba0-496c-af94-1bbdec5424e5 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:16:30.963937 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79b8428-7ba0-496c-af94-1bbdec5424e5 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:16:30.964223 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79b8428-7ba0-496c-af94-1bbdec5424e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:16:30.979083 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:16:31.016727 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-b79b8428-7ba0-496c-af94-1bbdec5424e5 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:16:31.020905 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-b79b8428-7ba0-496c-af94-1bbdec5424e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:16:31.049713 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1338/2670] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:16:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:16:31.053350 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5a9c10-b075-4285-b715-e711d6e4cc32 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:16:31.070592 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5a9c10-b075-4285-b715-e711d6e4cc32 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:16:31.090839 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2d0421-b4c0-48cb-bf4c-d7d7d2ee80db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:16:31.091936 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2d0421-b4c0-48cb-bf4c-d7d7d2ee80db admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:16:31.092830 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2d0421-b4c0-48cb-bf4c-d7d7d2ee80db admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:16:31.093817 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2d0421-b4c0-48cb-bf4c-d7d7d2ee80db admin admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:16:31.099751 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2d0421-b4c0-48cb-bf4c-d7d7d2ee80db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:16:31.100669 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2d0421-b4c0-48cb-bf4c-d7d7d2ee80db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:16:31.107082 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2d0421-b4c0-48cb-bf4c-d7d7d2ee80db admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:16:31.141762 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1333/2671] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:16:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:16:31.148048 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79b8428-7ba0-496c-af94-1bbdec5424e5 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:16:31.164098 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79b8428-7ba0-496c-af94-1bbdec5424e5 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:16:31.176694 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7500ecf-ec5b-47c4-92e1-e2e07e1f5313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:16:31.179178 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7500ecf-ec5b-47c4-92e1-e2e07e1f5313 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:16:31.179654 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7500ecf-ec5b-47c4-92e1-e2e07e1f5313 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:16:31.180106 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7500ecf-ec5b-47c4-92e1-e2e07e1f5313 admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:16:31.182411 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7500ecf-ec5b-47c4-92e1-e2e07e1f5313 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:16:31.186316 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7500ecf-ec5b-47c4-92e1-e2e07e1f5313 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:16:31.274566 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2d0421-b4c0-48cb-bf4c-d7d7d2ee80db admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:16:31.275704 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1339/2672] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:16:31 2022] POST /identity/v3/projects => generated 391 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:16:31.287540 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2d0421-b4c0-48cb-bf4c-d7d7d2ee80db admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:16:31.493025 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f355710a-bc14-4433-8b8e-805be54594ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:16:31.493751 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f355710a-bc14-4433-8b8e-805be54594ce admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:16:31.495388 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f355710a-bc14-4433-8b8e-805be54594ce admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:16:31.495669 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f355710a-bc14-4433-8b8e-805be54594ce admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:16:31.496382 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f355710a-bc14-4433-8b8e-805be54594ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:16:31.503846 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f355710a-bc14-4433-8b8e-805be54594ce admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:16:31.556994 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1334/2673] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:16:31 2022] POST /identity/v3/users => generated 296 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:16:31.560982 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7500ecf-ec5b-47c4-92e1-e2e07e1f5313 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:16:31.580901 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7500ecf-ec5b-47c4-92e1-e2e07e1f5313 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:16:31.600385 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654c5735-50ab-4ad5-be39-9d44fc08ff18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:16:31.603653 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654c5735-50ab-4ad5-be39-9d44fc08ff18 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:16:31.603944 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654c5735-50ab-4ad5-be39-9d44fc08ff18 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:16:31.604226 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654c5735-50ab-4ad5-be39-9d44fc08ff18 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:16:31.615020 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654c5735-50ab-4ad5-be39-9d44fc08ff18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:16:31.617212 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654c5735-50ab-4ad5-be39-9d44fc08ff18 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:16:31.644465 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1340/2674] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:16:31 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:16:31.648922 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f355710a-bc14-4433-8b8e-805be54594ce admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:16:31.663706 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f355710a-bc14-4433-8b8e-805be54594ce admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:16:31.680014 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b9d19d-6b96-4b1f-8de9-3ec5f785126e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:16:31.682691 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b9d19d-6b96-4b1f-8de9-3ec5f785126e admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:16:31.683025 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b9d19d-6b96-4b1f-8de9-3ec5f785126e admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:16:31.683357 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b9d19d-6b96-4b1f-8de9-3ec5f785126e admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:16:31.684277 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b9d19d-6b96-4b1f-8de9-3ec5f785126e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:16:31.686349 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b9d19d-6b96-4b1f-8de9-3ec5f785126e admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:16:31.701715 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1335/2675] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:16:31 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:16:31.707332 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654c5735-50ab-4ad5-be39-9d44fc08ff18 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:16:31.728020 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654c5735-50ab-4ad5-be39-9d44fc08ff18 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:16:31.738401 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768ae168-0709-4714-b564-73a3196b4b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:16:31.739898 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768ae168-0709-4714-b564-73a3196b4b73 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:16:31.740456 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768ae168-0709-4714-b564-73a3196b4b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:16:31.741064 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768ae168-0709-4714-b564-73a3196b4b73 admin admin] PATH_INFO: `/v3/projects/4a19b7b423a940b6881c60f7e5a32e04/users/cd0bef731892464d80e1c433b43e3afe/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:16:31.776112 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768ae168-0709-4714-b564-73a3196b4b73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a19b7b423a940b6881c60f7e5a32e04, user_id=cd0bef731892464d80e1c433b43e3afe, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:16:31.781430 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768ae168-0709-4714-b564-73a3196b4b73 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:16:31.815355 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1341/2676] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:16:31 2022] PUT /identity/v3/projects/4a19b7b423a940b6881c60f7e5a32e04/users/cd0bef731892464d80e1c433b43e3afe/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:16:31.828123 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031ba393-1733-4ac2-a86e-9a19fd906164 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:16:31.828708 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031ba393-1733-4ac2-a86e-9a19fd906164 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:16:31.828708 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031ba393-1733-4ac2-a86e-9a19fd906164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:16:31.892682 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-031ba393-1733-4ac2-a86e-9a19fd906164 None None] MFA Rules not processed for user `cd0bef731892464d80e1c433b43e3afe`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:16:31.894458 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-031ba393-1733-4ac2-a86e-9a19fd906164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:16:32.047924 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1336/2677] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:16:31 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:16:32.053184 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768ae168-0709-4714-b564-73a3196b4b73 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:16:32.190741 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768ae168-0709-4714-b564-73a3196b4b73 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:16:32.208321 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9d1c85-23a3-4001-9351-33d412c0691a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:16:32.209302 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9d1c85-23a3-4001-9351-33d412c0691a admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:16:32.209760 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9d1c85-23a3-4001-9351-33d412c0691a admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:16:32.210332 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9d1c85-23a3-4001-9351-33d412c0691a admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:16:32.212440 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9d1c85-23a3-4001-9351-33d412c0691a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:16:32.214648 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9d1c85-23a3-4001-9351-33d412c0691a admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:16:32.271799 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1342/2678] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:16:32 2022] POST /identity/v3/projects => generated 391 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:16:32.275658 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031ba393-1733-4ac2-a86e-9a19fd906164 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:16:32.299125 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031ba393-1733-4ac2-a86e-9a19fd906164 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:16:32.348271 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:16:32.399387 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50744121-5b61-43c4-a98e-0f0253945a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:16:32.400290 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50744121-5b61-43c4-a98e-0f0253945a93 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:16:32.400717 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50744121-5b61-43c4-a98e-0f0253945a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:16:32.401155 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50744121-5b61-43c4-a98e-0f0253945a93 admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:16:32.402211 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50744121-5b61-43c4-a98e-0f0253945a93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:16:32.405273 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50744121-5b61-43c4-a98e-0f0253945a93 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:16:32.452068 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1337/2679] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:16:32 2022] POST /identity/v3/users => generated 302 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:16:32.453853 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9d1c85-23a3-4001-9351-33d412c0691a admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:16:32.476651 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9d1c85-23a3-4001-9351-33d412c0691a admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:16:32.496534 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1899ab47-d36f-4621-af41-ea3b9b4d15bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:16:32.497260 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1899ab47-d36f-4621-af41-ea3b9b4d15bd admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:16:32.497556 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1899ab47-d36f-4621-af41-ea3b9b4d15bd admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:16:32.497798 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1899ab47-d36f-4621-af41-ea3b9b4d15bd admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:16:32.498566 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1899ab47-d36f-4621-af41-ea3b9b4d15bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:16:32.504506 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1899ab47-d36f-4621-af41-ea3b9b4d15bd admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:16:32.539333 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1343/2680] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:16:32 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:16:32.541280 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50744121-5b61-43c4-a98e-0f0253945a93 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:16:32.556550 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50744121-5b61-43c4-a98e-0f0253945a93 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:16:32.566812 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39560332-c44f-4251-9dc1-9f8fbc472545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:16:32.567907 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39560332-c44f-4251-9dc1-9f8fbc472545 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:16:32.568367 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39560332-c44f-4251-9dc1-9f8fbc472545 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:16:32.569292 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39560332-c44f-4251-9dc1-9f8fbc472545 admin admin] PATH_INFO: `/v3/projects/43617ab0d12046bdb548f383035fb37e/users/2fb354f50ad34c13919aebcbe8abb3aa/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:16:32.602807 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39560332-c44f-4251-9dc1-9f8fbc472545 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43617ab0d12046bdb548f383035fb37e, user_id=2fb354f50ad34c13919aebcbe8abb3aa, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:16:32.606590 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39560332-c44f-4251-9dc1-9f8fbc472545 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:16:32.654986 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1338/2681] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:16:32 2022] PUT /identity/v3/projects/43617ab0d12046bdb548f383035fb37e/users/2fb354f50ad34c13919aebcbe8abb3aa/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:16:32.669059 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1899ab47-d36f-4621-af41-ea3b9b4d15bd admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:16:32.690855 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1899ab47-d36f-4621-af41-ea3b9b4d15bd admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:16:32.853530 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de27ec8-5a75-41fd-b3de-8b69fff6e391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:16:32.854329 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de27ec8-5a75-41fd-b3de-8b69fff6e391 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:16:32.854611 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de27ec8-5a75-41fd-b3de-8b69fff6e391 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:16:32.854885 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de27ec8-5a75-41fd-b3de-8b69fff6e391 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:16:32.855638 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de27ec8-5a75-41fd-b3de-8b69fff6e391 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:16:32.857640 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de27ec8-5a75-41fd-b3de-8b69fff6e391 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:16:32.879368 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1344/2682] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:16:32 2022] GET /identity/v3/roles => generated 1420 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:16:32.880710 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39560332-c44f-4251-9dc1-9f8fbc472545 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:16:32.894030 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39560332-c44f-4251-9dc1-9f8fbc472545 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:16:32.899953 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc35490-0ec9-4026-9f59-181e592fd622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:16:32.901174 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc35490-0ec9-4026-9f59-181e592fd622 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:16:32.901561 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc35490-0ec9-4026-9f59-181e592fd622 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:16:32.901977 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc35490-0ec9-4026-9f59-181e592fd622 admin admin] PATH_INFO: `/v3/projects/43617ab0d12046bdb548f383035fb37e/users/2fb354f50ad34c13919aebcbe8abb3aa/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:16:32.904302 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc35490-0ec9-4026-9f59-181e592fd622 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43617ab0d12046bdb548f383035fb37e, user_id=2fb354f50ad34c13919aebcbe8abb3aa, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:16:32.910050 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc35490-0ec9-4026-9f59-181e592fd622 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:16:32.933355 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1339/2683] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:16:32 2022] PUT /identity/v3/projects/43617ab0d12046bdb548f383035fb37e/users/2fb354f50ad34c13919aebcbe8abb3aa/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:16:32.935215 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf52bd1d-2100-467c-aac0-5d9291945494 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:16:32.935672 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf52bd1d-2100-467c-aac0-5d9291945494 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:16:32.935972 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf52bd1d-2100-467c-aac0-5d9291945494 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:16:32.971225 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:16:32.987545 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-bf52bd1d-2100-467c-aac0-5d9291945494 None None] MFA Rules not processed for user `2fb354f50ad34c13919aebcbe8abb3aa`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:16:32.991690 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-bf52bd1d-2100-467c-aac0-5d9291945494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:16:33.134909 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab074f1-51da-4ad6-9bfd-0660a908f942 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:16:33.136469 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab074f1-51da-4ad6-9bfd-0660a908f942 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:16:33.136469 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab074f1-51da-4ad6-9bfd-0660a908f942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:16:33.171073 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-5ab074f1-51da-4ad6-9bfd-0660a908f942 None None] MFA Rules not processed for user `3a56b82cf3954f279dd21e17a42462b3`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:16:33.172447 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-5ab074f1-51da-4ad6-9bfd-0660a908f942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:16:33.227433 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1345/2684] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:16:32 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:16:33.249071 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf52bd1d-2100-467c-aac0-5d9291945494 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:16:33.251163 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-bf52bd1d-2100-467c-aac0-5d9291945494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:16:33.320845 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1340/2685] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:16:33 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:16:33.477688 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf52bd1d-2100-467c-aac0-5d9291945494 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:16:33.497131 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a625d3-8531-493d-bbbb-d338ee71468b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:16:33.497534 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a625d3-8531-493d-bbbb-d338ee71468b service nova] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:16:33.498380 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a625d3-8531-493d-bbbb-d338ee71468b service nova] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:16:33.498380 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a625d3-8531-493d-bbbb-d338ee71468b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:16:33.513133 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a625d3-8531-493d-bbbb-d338ee71468b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:16:33.515675 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a625d3-8531-493d-bbbb-d338ee71468b service nova] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:16:33.536023 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1346/2686] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:16:33 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:16:35.703684 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab074f1-51da-4ad6-9bfd-0660a908f942 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:16:35.734636 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab074f1-51da-4ad6-9bfd-0660a908f942 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:16:35.750833 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410bbc6a-80d1-4e0d-9037-69f49e6d3cfd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:16:35.752942 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410bbc6a-80d1-4e0d-9037-69f49e6d3cfd service nova] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:16:35.754630 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410bbc6a-80d1-4e0d-9037-69f49e6d3cfd service nova] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:16:35.755127 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410bbc6a-80d1-4e0d-9037-69f49e6d3cfd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:16:35.911396 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410bbc6a-80d1-4e0d-9037-69f49e6d3cfd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:16:35.911396 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410bbc6a-80d1-4e0d-9037-69f49e6d3cfd service nova] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:16:35.961635 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1341/2687] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:16:35 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:16:35.980222 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a625d3-8531-493d-bbbb-d338ee71468b service nova] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:16:36.147334 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a625d3-8531-493d-bbbb-d338ee71468b service nova] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:16:36.168645 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09194e52-c126-4d32-af6a-8b3d65918f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:16:36.171257 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09194e52-c126-4d32-af6a-8b3d65918f1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:16:36.172863 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09194e52-c126-4d32-af6a-8b3d65918f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:16:36.175353 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09194e52-c126-4d32-af6a-8b3d65918f1a admin admin] PATH_INFO: `/v3/users/cd0bef731892464d80e1c433b43e3afe` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:16:36.177808 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09194e52-c126-4d32-af6a-8b3d65918f1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd0bef731892464d80e1c433b43e3afe)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:16:36.184175 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09194e52-c126-4d32-af6a-8b3d65918f1a admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:16:36.245550 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:16:36.259875 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1876914d-8595-4f3a-8913-0488dc497c71 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:16:36.260197 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1876914d-8595-4f3a-8913-0488dc497c71 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:16:36.260719 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1876914d-8595-4f3a-8913-0488dc497c71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:16:36.301650 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-1876914d-8595-4f3a-8913-0488dc497c71 None None] MFA Rules not processed for user `0133d9533fbd4be5b46dc308dbe3a7d9`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:16:36.308730 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-1876914d-8595-4f3a-8913-0488dc497c71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:16:36.327574 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-09194e52-c126-4d32-af6a-8b3d65918f1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd0bef731892464d80e1c433b43e3afe'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:16:36.329667 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-09194e52-c126-4d32-af6a-8b3d65918f1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd0bef731892464d80e1c433b43e3afe'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:16:36.350160 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-09194e52-c126-4d32-af6a-8b3d65918f1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd0bef731892464d80e1c433b43e3afe'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:16:36.366327 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-09194e52-c126-4d32-af6a-8b3d65918f1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd0bef731892464d80e1c433b43e3afe'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:16:36.388239 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:16:36.404521 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-09194e52-c126-4d32-af6a-8b3d65918f1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd0bef731892464d80e1c433b43e3afe'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:16:36.412602 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1347/2688] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:16:35 2022] DELETE /identity/v3/users/cd0bef731892464d80e1c433b43e3afe => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:16:36.417060 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0737a452-6030-4f61-ab0b-d6450495a2e9 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:16:36.417368 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0737a452-6030-4f61-ab0b-d6450495a2e9 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:16:36.417637 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0737a452-6030-4f61-ab0b-d6450495a2e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:16:36.455683 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-0737a452-6030-4f61-ab0b-d6450495a2e9 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:16:36.457066 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1342/2689] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:16:36 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:16:36.461498 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-0737a452-6030-4f61-ab0b-d6450495a2e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:16:36.561427 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1348/2690] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:16:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:16:36.584176 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1876914d-8595-4f3a-8913-0488dc497c71 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:16:36.587558 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-1876914d-8595-4f3a-8913-0488dc497c71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:16:36.763068 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1876914d-8595-4f3a-8913-0488dc497c71 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:16:36.875628 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0d4a5f-b389-49c4-837a-6864d7e62276 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:16:36.887964 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0d4a5f-b389-49c4-837a-6864d7e62276 service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:16:36.888752 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0d4a5f-b389-49c4-837a-6864d7e62276 service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:16:36.889261 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0d4a5f-b389-49c4-837a-6864d7e62276 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:16:36.934139 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0d4a5f-b389-49c4-837a-6864d7e62276 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:16:36.935925 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0d4a5f-b389-49c4-837a-6864d7e62276 service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:16:36.957753 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1343/2691] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:16:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:16:37.673884 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0737a452-6030-4f61-ab0b-d6450495a2e9 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:16:37.676033 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-0737a452-6030-4f61-ab0b-d6450495a2e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:16:37.692384 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0737a452-6030-4f61-ab0b-d6450495a2e9 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:16:37.697963 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4680fb41-99c5-428f-ab61-886b8366397a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:16:37.699778 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4680fb41-99c5-428f-ab61-886b8366397a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:16:37.700428 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4680fb41-99c5-428f-ab61-886b8366397a admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:16:37.700902 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4680fb41-99c5-428f-ab61-886b8366397a admin admin] PATH_INFO: `/v3/projects/4a19b7b423a940b6881c60f7e5a32e04` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:16:37.703935 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4680fb41-99c5-428f-ab61-886b8366397a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a19b7b423a940b6881c60f7e5a32e04)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:16:37.710246 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4680fb41-99c5-428f-ab61-886b8366397a admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:16:37.849394 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-4680fb41-99c5-428f-ab61-886b8366397a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a19b7b423a940b6881c60f7e5a32e04', 'request_id': 'req-4680fb41-99c5-428f-ab61-886b8366397a'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:16:37.869816 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-4680fb41-99c5-428f-ab61-886b8366397a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a19b7b423a940b6881c60f7e5a32e04', 'request_id': 'req-4680fb41-99c5-428f-ab61-886b8366397a'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:16:37.890860 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-4680fb41-99c5-428f-ab61-886b8366397a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a19b7b423a940b6881c60f7e5a32e04', 'request_id': 'req-4680fb41-99c5-428f-ab61-886b8366397a'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:16:37.917424 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-4680fb41-99c5-428f-ab61-886b8366397a admin admin] The token cache is being invalidate because project 4a19b7b423a940b6881c60f7e5a32e04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:16:37.917712 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-4680fb41-99c5-428f-ab61-886b8366397a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:16:37.921071 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-4680fb41-99c5-428f-ab61-886b8366397a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:16:37.922974 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1349/2692] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:16:37 2022] DELETE /identity/v3/projects/4a19b7b423a940b6881c60f7e5a32e04 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:16:37.927540 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0d4a5f-b389-49c4-837a-6864d7e62276 service neutron] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:16:37.945328 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0d4a5f-b389-49c4-837a-6864d7e62276 service neutron] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:16:38.095521 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc55bc1-f79e-431e-a3f4-28419f325689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:16:38.096481 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc55bc1-f79e-431e-a3f4-28419f325689 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:16:38.097098 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc55bc1-f79e-431e-a3f4-28419f325689 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:16:38.097098 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc55bc1-f79e-431e-a3f4-28419f325689 admin admin] PATH_INFO: `/v3/users/2fb354f50ad34c13919aebcbe8abb3aa` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:16:38.101045 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc55bc1-f79e-431e-a3f4-28419f325689 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2fb354f50ad34c13919aebcbe8abb3aa)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:16:38.103194 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc55bc1-f79e-431e-a3f4-28419f325689 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:16:38.191824 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:16:38.218555 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-bdc55bc1-f79e-431e-a3f4-28419f325689 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2fb354f50ad34c13919aebcbe8abb3aa'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:16:38.230146 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-bdc55bc1-f79e-431e-a3f4-28419f325689 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2fb354f50ad34c13919aebcbe8abb3aa'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:16:38.232056 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-bdc55bc1-f79e-431e-a3f4-28419f325689 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2fb354f50ad34c13919aebcbe8abb3aa'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:16:38.249877 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-bdc55bc1-f79e-431e-a3f4-28419f325689 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2fb354f50ad34c13919aebcbe8abb3aa'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:16:38.265129 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-bdc55bc1-f79e-431e-a3f4-28419f325689 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2fb354f50ad34c13919aebcbe8abb3aa'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:16:38.291935 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1344/2693] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:16:37 2022] DELETE /identity/v3/users/2fb354f50ad34c13919aebcbe8abb3aa => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:16:38.851055 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4680fb41-99c5-428f-ab61-886b8366397a admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:16:38.859494 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-4680fb41-99c5-428f-ab61-886b8366397a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:16:38.878711 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4680fb41-99c5-428f-ab61-886b8366397a admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:16:38.943799 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:16:39.035519 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca35fa8c-cd44-47e9-8ba8-887ad279b090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:16:39.036425 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca35fa8c-cd44-47e9-8ba8-887ad279b090 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:16:39.036708 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca35fa8c-cd44-47e9-8ba8-887ad279b090 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:16:39.036975 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca35fa8c-cd44-47e9-8ba8-887ad279b090 admin admin] PATH_INFO: `/v3/projects/43617ab0d12046bdb548f383035fb37e` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:16:39.058293 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca35fa8c-cd44-47e9-8ba8-887ad279b090 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43617ab0d12046bdb548f383035fb37e)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:16:39.062647 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca35fa8c-cd44-47e9-8ba8-887ad279b090 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:16:39.210962 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-ca35fa8c-cd44-47e9-8ba8-887ad279b090 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43617ab0d12046bdb548f383035fb37e', 'request_id': 'req-ca35fa8c-cd44-47e9-8ba8-887ad279b090'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:16:39.226451 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-ca35fa8c-cd44-47e9-8ba8-887ad279b090 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43617ab0d12046bdb548f383035fb37e', 'request_id': 'req-ca35fa8c-cd44-47e9-8ba8-887ad279b090'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:16:39.236478 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-ca35fa8c-cd44-47e9-8ba8-887ad279b090 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43617ab0d12046bdb548f383035fb37e', 'request_id': 'req-ca35fa8c-cd44-47e9-8ba8-887ad279b090'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:16:39.254924 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-ca35fa8c-cd44-47e9-8ba8-887ad279b090 admin admin] The token cache is being invalidate because project 43617ab0d12046bdb548f383035fb37e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:16:39.255257 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-ca35fa8c-cd44-47e9-8ba8-887ad279b090 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:16:39.255884 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-ca35fa8c-cd44-47e9-8ba8-887ad279b090 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:16:39.257813 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1350/2694] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:16:38 2022] DELETE /identity/v3/projects/43617ab0d12046bdb548f383035fb37e => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:16:39.264627 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ee0e0f-3794-4b89-8278-8a036b1671f9 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:16:39.265164 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ee0e0f-3794-4b89-8278-8a036b1671f9 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:16:39.265164 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ee0e0f-3794-4b89-8278-8a036b1671f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:16:39.299743 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-65ee0e0f-3794-4b89-8278-8a036b1671f9 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:16:39.300989 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-65ee0e0f-3794-4b89-8278-8a036b1671f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:16:39.448884 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1345/2695] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:16:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:16:39.451563 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3d10e7-be2e-46d0-90b4-ae46d039530d None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:16:39.451854 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3d10e7-be2e-46d0-90b4-ae46d039530d None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:16:39.452129 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3d10e7-be2e-46d0-90b4-ae46d039530d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:16:39.487984 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-2f3d10e7-be2e-46d0-90b4-ae46d039530d None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:16:39.489996 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-2f3d10e7-be2e-46d0-90b4-ae46d039530d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:16:39.517192 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1351/2696] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:16:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:16:39.518431 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ee0e0f-3794-4b89-8278-8a036b1671f9 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:16:39.528868 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ee0e0f-3794-4b89-8278-8a036b1671f9 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:16:39.542140 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030786f4-6e39-41f1-a8c7-0793a6bca180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:16:39.542898 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030786f4-6e39-41f1-a8c7-0793a6bca180 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:16:39.543206 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030786f4-6e39-41f1-a8c7-0793a6bca180 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:16:39.543522 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030786f4-6e39-41f1-a8c7-0793a6bca180 admin admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:16:39.544429 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030786f4-6e39-41f1-a8c7-0793a6bca180 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:16:39.544706 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030786f4-6e39-41f1-a8c7-0793a6bca180 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:16:39.546524 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030786f4-6e39-41f1-a8c7-0793a6bca180 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:16:39.561988 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1346/2697] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:16:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:16:39.566377 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3d10e7-be2e-46d0-90b4-ae46d039530d None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:16:39.584053 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3d10e7-be2e-46d0-90b4-ae46d039530d None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:16:39.595017 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e542f57-528b-4637-ae05-69ce6634ad30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:16:39.599918 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e542f57-528b-4637-ae05-69ce6634ad30 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:16:39.601442 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e542f57-528b-4637-ae05-69ce6634ad30 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:16:39.601738 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e542f57-528b-4637-ae05-69ce6634ad30 admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:16:39.603803 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e542f57-528b-4637-ae05-69ce6634ad30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:16:39.607343 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e542f57-528b-4637-ae05-69ce6634ad30 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:16:39.671527 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1352/2698] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:16:39 2022] POST /identity/v3/projects => generated 383 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:16:39.677456 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030786f4-6e39-41f1-a8c7-0793a6bca180 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:16:39.691422 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030786f4-6e39-41f1-a8c7-0793a6bca180 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:16:39.774814 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f761e6a5-7bd8-44aa-b684-32f509a625e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:16:39.775870 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f761e6a5-7bd8-44aa-b684-32f509a625e1 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:16:39.776356 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f761e6a5-7bd8-44aa-b684-32f509a625e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:16:39.776835 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f761e6a5-7bd8-44aa-b684-32f509a625e1 admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:16:39.780804 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f761e6a5-7bd8-44aa-b684-32f509a625e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:16:39.782151 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f761e6a5-7bd8-44aa-b684-32f509a625e1 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:16:39.861225 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1347/2699] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:16:39 2022] POST /identity/v3/users => generated 292 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:16:39.865731 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e542f57-528b-4637-ae05-69ce6634ad30 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:16:39.899957 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e542f57-528b-4637-ae05-69ce6634ad30 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:16:39.920795 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dc6a09-79c7-41cb-965b-0a736feafbec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:16:39.922109 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dc6a09-79c7-41cb-965b-0a736feafbec admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:16:39.923297 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dc6a09-79c7-41cb-965b-0a736feafbec admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:16:39.923994 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dc6a09-79c7-41cb-965b-0a736feafbec admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:16:39.925179 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dc6a09-79c7-41cb-965b-0a736feafbec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:16:39.927081 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dc6a09-79c7-41cb-965b-0a736feafbec admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:16:39.963671 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1353/2700] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:16:39 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:16:39.964327 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f761e6a5-7bd8-44aa-b684-32f509a625e1 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:16:39.983595 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f761e6a5-7bd8-44aa-b684-32f509a625e1 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:16:39.997954 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080a9e24-4b16-4b9b-9894-2bfc96dfc487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:16:39.999532 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080a9e24-4b16-4b9b-9894-2bfc96dfc487 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:16:40.006787 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080a9e24-4b16-4b9b-9894-2bfc96dfc487 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:16:40.011033 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080a9e24-4b16-4b9b-9894-2bfc96dfc487 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:16:40.012381 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080a9e24-4b16-4b9b-9894-2bfc96dfc487 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:16:40.014279 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080a9e24-4b16-4b9b-9894-2bfc96dfc487 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:16:40.053228 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1348/2701] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:16:39 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:16:40.054568 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dc6a09-79c7-41cb-965b-0a736feafbec admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:16:40.089368 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dc6a09-79c7-41cb-965b-0a736feafbec admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:16:40.125985 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e1a0a3-9e01-44c4-b294-c8c5a8bfdbe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:16:40.130208 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e1a0a3-9e01-44c4-b294-c8c5a8bfdbe4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:16:40.131479 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e1a0a3-9e01-44c4-b294-c8c5a8bfdbe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:16:40.134022 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e1a0a3-9e01-44c4-b294-c8c5a8bfdbe4 admin admin] PATH_INFO: `/v3/projects/3811ea868f5649e8a235539a5bf46706/users/fe3ad614d9d24300adb274cc95120fd3/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:16:40.175556 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e1a0a3-9e01-44c4-b294-c8c5a8bfdbe4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3811ea868f5649e8a235539a5bf46706, user_id=fe3ad614d9d24300adb274cc95120fd3, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:16:40.180476 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e1a0a3-9e01-44c4-b294-c8c5a8bfdbe4 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:16:40.218590 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1354/2702] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:16:40 2022] PUT /identity/v3/projects/3811ea868f5649e8a235539a5bf46706/users/fe3ad614d9d24300adb274cc95120fd3/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:16:40.225265 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cf8b6e-c3bc-42e2-af8a-59059a1385ac None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:16:40.225802 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cf8b6e-c3bc-42e2-af8a-59059a1385ac None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:16:40.226339 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cf8b6e-c3bc-42e2-af8a-59059a1385ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:16:40.262317 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-09cf8b6e-c3bc-42e2-af8a-59059a1385ac None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:16:40.265894 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-09cf8b6e-c3bc-42e2-af8a-59059a1385ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:16:40.304507 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:16:40.396835 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1349/2703] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:16:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:16:40.426293 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e1a0a3-9e01-44c4-b294-c8c5a8bfdbe4 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:16:40.428172 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-40e1a0a3-9e01-44c4-b294-c8c5a8bfdbe4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:16:40.537232 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e1a0a3-9e01-44c4-b294-c8c5a8bfdbe4 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:16:40.541957 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03b7e6a-b432-4704-bc1a-30aef62c16ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:16:40.542651 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03b7e6a-b432-4704-bc1a-30aef62c16ef service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:16:40.542940 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03b7e6a-b432-4704-bc1a-30aef62c16ef service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:16:40.543202 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03b7e6a-b432-4704-bc1a-30aef62c16ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:16:40.551277 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:16:40.556165 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03b7e6a-b432-4704-bc1a-30aef62c16ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:16:40.558571 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03b7e6a-b432-4704-bc1a-30aef62c16ef service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:16:40.572223 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1355/2704] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:16:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:16:45.059289 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1c6d2b-dbf1-4d92-bfcc-bb17caf8021c None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:16:45.059867 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1c6d2b-dbf1-4d92-bfcc-bb17caf8021c None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:16:45.060178 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1c6d2b-dbf1-4d92-bfcc-bb17caf8021c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:16:45.090690 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-df1c6d2b-dbf1-4d92-bfcc-bb17caf8021c None None] MFA Rules not processed for user `17b779a3e21a415bb42cde5d6863d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:16:45.093204 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-df1c6d2b-dbf1-4d92-bfcc-bb17caf8021c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:16:45.176328 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1350/2705] 10.222.0.17 () {58 vars in 967 bytes} [Sat Jul 23 21:16:45 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:16:45.191778 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03b7e6a-b432-4704-bc1a-30aef62c16ef service neutron] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:16:45.193347 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-f03b7e6a-b432-4704-bc1a-30aef62c16ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:16:45.298785 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03b7e6a-b432-4704-bc1a-30aef62c16ef service neutron] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:16:45.311257 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f4d7b9-7173-429e-84a4-05110b9c1131 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f0a685b7da46afb81024848f079d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:16:45.312498 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f4d7b9-7173-429e-84a4-05110b9c1131 service swift] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:16:45.313055 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f4d7b9-7173-429e-84a4-05110b9c1131 service swift] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:16:45.313536 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f4d7b9-7173-429e-84a4-05110b9c1131 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:16:45.326737 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f4d7b9-7173-429e-84a4-05110b9c1131 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:16:45.330011 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f4d7b9-7173-429e-84a4-05110b9c1131 service swift] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:16:45.358379 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1356/2706] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 23 21:16:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 23 21:16:46.364052 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73828988-19b2-4df9-b9f6-60b0f7504282 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:16:46.364658 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73828988-19b2-4df9-b9f6-60b0f7504282 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:16:46.364658 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73828988-19b2-4df9-b9f6-60b0f7504282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:16:46.384149 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-73828988-19b2-4df9-b9f6-60b0f7504282 None None] MFA Rules not processed for user `bb4f9dda4c2a411cb0394bf86e9ae223`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:16:46.385466 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-73828988-19b2-4df9-b9f6-60b0f7504282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:16:46.446861 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1351/2707] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:16:46 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:16:48.304674 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175dbdb8-f83c-43c1-aad4-073418c2dbbd None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:16:48.304674 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175dbdb8-f83c-43c1-aad4-073418c2dbbd None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:16:48.304674 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175dbdb8-f83c-43c1-aad4-073418c2dbbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:16:48.337332 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-175dbdb8-f83c-43c1-aad4-073418c2dbbd None None] MFA Rules not processed for user `ebf92af08fa94215b4eafcacea6c63f6`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:16:48.339430 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-175dbdb8-f83c-43c1-aad4-073418c2dbbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:16:48.440327 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1357/2708] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:16:48 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:16:52.055071 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882431a2-4ed0-417a-9484-5d2645d21461 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:16:52.055989 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882431a2-4ed0-417a-9484-5d2645d21461 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:16:52.056455 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882431a2-4ed0-417a-9484-5d2645d21461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:16:52.099989 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-882431a2-4ed0-417a-9484-5d2645d21461 None None] MFA Rules not processed for user `fe3ad614d9d24300adb274cc95120fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:16:52.101528 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-882431a2-4ed0-417a-9484-5d2645d21461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:16:52.177488 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:16:52.186925 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175dbdb8-f83c-43c1-aad4-073418c2dbbd None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:16:52.194406 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1352/2709] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:16:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:16:52.199424 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175dbdb8-f83c-43c1-aad4-073418c2dbbd None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:16:52.205117 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bf0c84-270f-4fbd-8f58-d2af7589fc58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:16:52.206288 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bf0c84-270f-4fbd-8f58-d2af7589fc58 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:16:52.207150 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bf0c84-270f-4fbd-8f58-d2af7589fc58 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:16:52.207559 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bf0c84-270f-4fbd-8f58-d2af7589fc58 admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:16:52.208397 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bf0c84-270f-4fbd-8f58-d2af7589fc58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:16:52.211221 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bf0c84-270f-4fbd-8f58-d2af7589fc58 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:16:52.266139 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1358/2710] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:16:52 2022] POST /identity/v3/projects => generated 383 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:16:52.266469 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882431a2-4ed0-417a-9484-5d2645d21461 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:16:52.283887 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882431a2-4ed0-417a-9484-5d2645d21461 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:16:52.382050 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da83ac50-aafb-4c6d-a643-94ad8c14ba66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:16:52.383054 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da83ac50-aafb-4c6d-a643-94ad8c14ba66 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:16:52.383480 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da83ac50-aafb-4c6d-a643-94ad8c14ba66 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:16:52.383959 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da83ac50-aafb-4c6d-a643-94ad8c14ba66 admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:16:52.384932 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da83ac50-aafb-4c6d-a643-94ad8c14ba66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:16:52.387613 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da83ac50-aafb-4c6d-a643-94ad8c14ba66 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:16:52.434614 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1353/2711] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:16:52 2022] POST /identity/v3/users => generated 298 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:16:52.437651 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bf0c84-270f-4fbd-8f58-d2af7589fc58 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:16:52.449984 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bf0c84-270f-4fbd-8f58-d2af7589fc58 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:16:52.455804 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c530a623-4081-47d2-91f9-85c516ba9465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:16:52.456623 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c530a623-4081-47d2-91f9-85c516ba9465 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:16:52.456938 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c530a623-4081-47d2-91f9-85c516ba9465 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:16:52.457270 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c530a623-4081-47d2-91f9-85c516ba9465 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:16:52.458349 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c530a623-4081-47d2-91f9-85c516ba9465 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:16:52.460008 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c530a623-4081-47d2-91f9-85c516ba9465 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:16:52.473721 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1359/2712] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:16:52 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:16:52.478554 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da83ac50-aafb-4c6d-a643-94ad8c14ba66 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:16:52.511222 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da83ac50-aafb-4c6d-a643-94ad8c14ba66 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:16:52.532129 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532a657b-8012-42ab-8060-332be595c542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:16:52.533190 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532a657b-8012-42ab-8060-332be595c542 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:16:52.533536 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532a657b-8012-42ab-8060-332be595c542 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:16:52.534129 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532a657b-8012-42ab-8060-332be595c542 admin admin] PATH_INFO: `/v3/projects/435823eb5eb144c0aa89671b1c12bb36/users/88e8ff3eff3b44a79f7e37f6adc361cd/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:16:52.587924 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532a657b-8012-42ab-8060-332be595c542 admin admin] RBAC: Authorizing `identity:create_grant(project_id=435823eb5eb144c0aa89671b1c12bb36, user_id=88e8ff3eff3b44a79f7e37f6adc361cd, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:16:52.595663 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532a657b-8012-42ab-8060-332be595c542 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:16:52.645517 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1354/2713] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:16:52 2022] PUT /identity/v3/projects/435823eb5eb144c0aa89671b1c12bb36/users/88e8ff3eff3b44a79f7e37f6adc361cd/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:16:52.650685 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c530a623-4081-47d2-91f9-85c516ba9465 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:16:52.666332 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c530a623-4081-47d2-91f9-85c516ba9465 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:16:52.753937 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:16:52.827075 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d820ca-62e1-4c90-9cdf-455f9189feb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:16:52.828162 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d820ca-62e1-4c90-9cdf-455f9189feb5 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:16:52.828666 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d820ca-62e1-4c90-9cdf-455f9189feb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:16:52.829192 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d820ca-62e1-4c90-9cdf-455f9189feb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:16:52.830309 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d820ca-62e1-4c90-9cdf-455f9189feb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:16:52.832160 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d820ca-62e1-4c90-9cdf-455f9189feb5 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:16:52.861914 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1360/2714] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:16:52 2022] GET /identity/v3/roles => generated 1420 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:16:52.865229 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532a657b-8012-42ab-8060-332be595c542 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:16:52.879715 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532a657b-8012-42ab-8060-332be595c542 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:16:52.902949 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e1ccd0-32cf-4931-bf43-ca7818a0377d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:16:52.904239 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e1ccd0-32cf-4931-bf43-ca7818a0377d admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:16:52.904589 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e1ccd0-32cf-4931-bf43-ca7818a0377d admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:16:52.904929 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e1ccd0-32cf-4931-bf43-ca7818a0377d admin admin] PATH_INFO: `/v3/projects/435823eb5eb144c0aa89671b1c12bb36/users/88e8ff3eff3b44a79f7e37f6adc361cd/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:16:52.918672 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e1ccd0-32cf-4931-bf43-ca7818a0377d admin admin] RBAC: Authorizing `identity:create_grant(project_id=435823eb5eb144c0aa89671b1c12bb36, user_id=88e8ff3eff3b44a79f7e37f6adc361cd, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:16:52.928360 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e1ccd0-32cf-4931-bf43-ca7818a0377d admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:16:52.955725 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1355/2715] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:16:52 2022] PUT /identity/v3/projects/435823eb5eb144c0aa89671b1c12bb36/users/88e8ff3eff3b44a79f7e37f6adc361cd/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:16:57.586881 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d820ca-62e1-4c90-9cdf-455f9189feb5 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:16:57.590403 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-98d820ca-62e1-4c90-9cdf-455f9189feb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:16:57.627506 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d820ca-62e1-4c90-9cdf-455f9189feb5 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:16:57.883065 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d55ea4-c489-4d54-aa7c-9ba682cc43ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:16:57.884253 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d55ea4-c489-4d54-aa7c-9ba682cc43ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:16:57.884687 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d55ea4-c489-4d54-aa7c-9ba682cc43ea admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:16:57.885102 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d55ea4-c489-4d54-aa7c-9ba682cc43ea admin admin] PATH_INFO: `/v3/users/c0990a2281f948b8a68be6c7e8599d8e` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:16:57.887133 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d55ea4-c489-4d54-aa7c-9ba682cc43ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0990a2281f948b8a68be6c7e8599d8e)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:16:57.889290 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d55ea4-c489-4d54-aa7c-9ba682cc43ea admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:16:57.943595 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-18d55ea4-c489-4d54-aa7c-9ba682cc43ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0990a2281f948b8a68be6c7e8599d8e'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:16:57.944268 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-18d55ea4-c489-4d54-aa7c-9ba682cc43ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0990a2281f948b8a68be6c7e8599d8e'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:16:57.953115 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-18d55ea4-c489-4d54-aa7c-9ba682cc43ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0990a2281f948b8a68be6c7e8599d8e'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:16:57.965850 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-18d55ea4-c489-4d54-aa7c-9ba682cc43ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0990a2281f948b8a68be6c7e8599d8e'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:16:57.982169 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-18d55ea4-c489-4d54-aa7c-9ba682cc43ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0990a2281f948b8a68be6c7e8599d8e'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:16:57.990017 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1361/2716] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:16:57 2022] DELETE /identity/v3/users/c0990a2281f948b8a68be6c7e8599d8e => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:16:58.288770 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e1ccd0-32cf-4931-bf43-ca7818a0377d admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:16:58.290640 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-d5e1ccd0-32cf-4931-bf43-ca7818a0377d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:16:58.330322 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e1ccd0-32cf-4931-bf43-ca7818a0377d admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:16:58.489708 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a879720a-062d-4d61-b819-317a4e45d1a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:16:58.490667 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a879720a-062d-4d61-b819-317a4e45d1a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:16:58.490946 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a879720a-062d-4d61-b819-317a4e45d1a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:16:58.491224 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a879720a-062d-4d61-b819-317a4e45d1a7 admin admin] PATH_INFO: `/v3/projects/e6dde0bc5a6444eaa396aec0c7c9b9c6` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:16:58.496647 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a879720a-062d-4d61-b819-317a4e45d1a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6dde0bc5a6444eaa396aec0c7c9b9c6)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:16:58.498583 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a879720a-062d-4d61-b819-317a4e45d1a7 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:16:58.595410 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-a879720a-062d-4d61-b819-317a4e45d1a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6dde0bc5a6444eaa396aec0c7c9b9c6', 'request_id': 'req-a879720a-062d-4d61-b819-317a4e45d1a7'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:16:58.600465 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=89,keystone:INSERT=6,keystone:DELETE=5 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:16:58.607910 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-a879720a-062d-4d61-b819-317a4e45d1a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6dde0bc5a6444eaa396aec0c7c9b9c6', 'request_id': 'req-a879720a-062d-4d61-b819-317a4e45d1a7'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:16:58.619136 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-a879720a-062d-4d61-b819-317a4e45d1a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6dde0bc5a6444eaa396aec0c7c9b9c6', 'request_id': 'req-a879720a-062d-4d61-b819-317a4e45d1a7'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:16:58.642808 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-a879720a-062d-4d61-b819-317a4e45d1a7 admin admin] The token cache is being invalidate because project e6dde0bc5a6444eaa396aec0c7c9b9c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:16:58.642808 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-a879720a-062d-4d61-b819-317a4e45d1a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:16:58.642808 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-a879720a-062d-4d61-b819-317a4e45d1a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:16:58.643838 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1356/2717] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:16:58 2022] DELETE /identity/v3/projects/e6dde0bc5a6444eaa396aec0c7c9b9c6 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:16:58.645217 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b06a20-5d94-4709-b4c9-dbf27c240c84 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:16:58.645695 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b06a20-5d94-4709-b4c9-dbf27c240c84 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:16:58.645777 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b06a20-5d94-4709-b4c9-dbf27c240c84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:16:58.666785 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-87b06a20-5d94-4709-b4c9-dbf27c240c84 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:16:58.668707 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-87b06a20-5d94-4709-b4c9-dbf27c240c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:16:58.756872 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a5901b-5983-4a0a-9112-af653979a2da None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:16:58.757410 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a5901b-5983-4a0a-9112-af653979a2da None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:16:58.758137 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a5901b-5983-4a0a-9112-af653979a2da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:16:58.758404 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1362/2718] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:16:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:16:58.783326 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-37a5901b-5983-4a0a-9112-af653979a2da None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:16:58.785551 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-37a5901b-5983-4a0a-9112-af653979a2da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:16:58.794367 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1357/2719] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:16:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:16:58.799268 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b06a20-5d94-4709-b4c9-dbf27c240c84 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:16:58.825561 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b06a20-5d94-4709-b4c9-dbf27c240c84 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:16:58.842917 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ac785c-7a86-4ff1-980a-75bc102db157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:16:58.843616 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ac785c-7a86-4ff1-980a-75bc102db157 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:16:58.844074 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ac785c-7a86-4ff1-980a-75bc102db157 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:16:58.844344 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ac785c-7a86-4ff1-980a-75bc102db157 admin admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:16:58.845088 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ac785c-7a86-4ff1-980a-75bc102db157 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:16:58.845434 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ac785c-7a86-4ff1-980a-75bc102db157 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:16:58.847059 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ac785c-7a86-4ff1-980a-75bc102db157 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:16:58.859077 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:16:58.868045 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1363/2720] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:16:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:16:58.872311 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a5901b-5983-4a0a-9112-af653979a2da None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:16:58.897520 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a5901b-5983-4a0a-9112-af653979a2da None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:16:58.903018 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8ecfc0-9180-4946-9754-06ab53a89580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:16:58.903881 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8ecfc0-9180-4946-9754-06ab53a89580 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:16:58.904283 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8ecfc0-9180-4946-9754-06ab53a89580 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:16:58.904693 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8ecfc0-9180-4946-9754-06ab53a89580 admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:16:58.905955 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8ecfc0-9180-4946-9754-06ab53a89580 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:16:58.908085 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8ecfc0-9180-4946-9754-06ab53a89580 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:16:58.945937 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1358/2721] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:16:58 2022] POST /identity/v3/projects => generated 403 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:16:58.947113 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ac785c-7a86-4ff1-980a-75bc102db157 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:16:58.957827 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ac785c-7a86-4ff1-980a-75bc102db157 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:16:59.047034 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8f243e-7fef-4c25-bf73-a9e9c285a503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:16:59.047889 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8f243e-7fef-4c25-bf73-a9e9c285a503 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:16:59.048348 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8f243e-7fef-4c25-bf73-a9e9c285a503 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:16:59.048720 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8f243e-7fef-4c25-bf73-a9e9c285a503 admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:16:59.049468 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8f243e-7fef-4c25-bf73-a9e9c285a503 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:16:59.051697 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8f243e-7fef-4c25-bf73-a9e9c285a503 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:16:59.086020 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1364/2722] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:16:58 2022] POST /identity/v3/users => generated 302 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:16:59.086183 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8ecfc0-9180-4946-9754-06ab53a89580 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:16:59.097894 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8ecfc0-9180-4946-9754-06ab53a89580 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:16:59.102808 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fec068-bce3-40f4-9908-9d3e880190db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:16:59.103499 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fec068-bce3-40f4-9908-9d3e880190db admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:16:59.103774 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fec068-bce3-40f4-9908-9d3e880190db admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:16:59.104042 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fec068-bce3-40f4-9908-9d3e880190db admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:16:59.104773 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fec068-bce3-40f4-9908-9d3e880190db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:16:59.106479 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fec068-bce3-40f4-9908-9d3e880190db admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:16:59.119722 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1359/2723] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:16:59 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 21:16:59.123559 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8f243e-7fef-4c25-bf73-a9e9c285a503 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:16:59.136087 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8f243e-7fef-4c25-bf73-a9e9c285a503 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:16:59.142158 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2abc2f-720e-444e-9aa5-e331ff5007f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:16:59.143807 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2abc2f-720e-444e-9aa5-e331ff5007f5 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:16:59.144301 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2abc2f-720e-444e-9aa5-e331ff5007f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:16:59.144801 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2abc2f-720e-444e-9aa5-e331ff5007f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:16:59.145787 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2abc2f-720e-444e-9aa5-e331ff5007f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:16:59.147949 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2abc2f-720e-444e-9aa5-e331ff5007f5 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:16:59.161716 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1365/2724] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:16:59 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:16:59.166471 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fec068-bce3-40f4-9908-9d3e880190db admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:16:59.182295 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fec068-bce3-40f4-9908-9d3e880190db admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:16:59.191707 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afacfe4d-a3a1-48b8-be04-acfff69dddaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:16:59.193020 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afacfe4d-a3a1-48b8-be04-acfff69dddaf admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:16:59.193534 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afacfe4d-a3a1-48b8-be04-acfff69dddaf admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:16:59.193996 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afacfe4d-a3a1-48b8-be04-acfff69dddaf admin admin] PATH_INFO: `/v3/projects/a9048665723042548bb40405a19e3efd/users/55c76bc3f4d24532a4a8e9fd5aa7ec10/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:16:59.223694 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afacfe4d-a3a1-48b8-be04-acfff69dddaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9048665723042548bb40405a19e3efd, user_id=55c76bc3f4d24532a4a8e9fd5aa7ec10, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:16:59.226887 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afacfe4d-a3a1-48b8-be04-acfff69dddaf admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:16:59.246438 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1360/2725] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:16:59 2022] PUT /identity/v3/projects/a9048665723042548bb40405a19e3efd/users/55c76bc3f4d24532a4a8e9fd5aa7ec10/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:16:59.252120 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec74017-787c-4b9f-bb26-48f32da073ae None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:16:59.253129 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec74017-787c-4b9f-bb26-48f32da073ae None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:16:59.253129 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec74017-787c-4b9f-bb26-48f32da073ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:16:59.280091 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-2ec74017-787c-4b9f-bb26-48f32da073ae None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:16:59.281314 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-2ec74017-787c-4b9f-bb26-48f32da073ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:16:59.364326 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1366/2726] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:16:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:16:59.405522 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afacfe4d-a3a1-48b8-be04-acfff69dddaf admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:16:59.408532 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-afacfe4d-a3a1-48b8-be04-acfff69dddaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:16:59.539577 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afacfe4d-a3a1-48b8-be04-acfff69dddaf admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:16:59.550201 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4b4959-3cb7-4e0e-99c4-05cc61d00842 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:16:59.551908 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4b4959-3cb7-4e0e-99c4-05cc61d00842 service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:16:59.553145 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4b4959-3cb7-4e0e-99c4-05cc61d00842 service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:16:59.554200 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4b4959-3cb7-4e0e-99c4-05cc61d00842 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:16:59.581374 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4b4959-3cb7-4e0e-99c4-05cc61d00842 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:16:59.582921 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4b4959-3cb7-4e0e-99c4-05cc61d00842 service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:16:59.606552 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1361/2727] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:16:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:17:03.106058 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d949c38-7000-42ee-b1ed-5544da395da7 None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:17:03.106575 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d949c38-7000-42ee-b1ed-5544da395da7 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:17:03.106575 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d949c38-7000-42ee-b1ed-5544da395da7 None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:17:03.109560 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1367/2728] 10.222.0.17 () {54 vars in 921 bytes} [Sat Jul 23 21:17:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:17:03.115407 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db267fd-aa37-4393-a04a-a51d5eab7a15 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:17:03.115972 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db267fd-aa37-4393-a04a-a51d5eab7a15 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:17:03.115972 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db267fd-aa37-4393-a04a-a51d5eab7a15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:17:03.139127 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-6db267fd-aa37-4393-a04a-a51d5eab7a15 None None] MFA Rules not processed for user `abc719a3b3ac4461b82ca04ab6451d81`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:17:03.140978 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-6db267fd-aa37-4393-a04a-a51d5eab7a15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:17:03.236479 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1362/2729] 10.222.0.17 () {58 vars in 1018 bytes} [Sat Jul 23 21:17:03 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:17:03.269329 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d949c38-7000-42ee-b1ed-5544da395da7 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:17:03.271317 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-1d949c38-7000-42ee-b1ed-5544da395da7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:17:03.289937 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d949c38-7000-42ee-b1ed-5544da395da7 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:17:03.307273 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8500ef8-8b07-4d11-a29f-59b78652319e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc719a3b3ac4461b82ca04ab6451d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:17:03.307955 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8500ef8-8b07-4d11-a29f-59b78652319e service placement] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:17:03.308233 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8500ef8-8b07-4d11-a29f-59b78652319e service placement] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:17:03.308501 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8500ef8-8b07-4d11-a29f-59b78652319e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:17:03.318987 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8500ef8-8b07-4d11-a29f-59b78652319e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:17:03.320947 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8500ef8-8b07-4d11-a29f-59b78652319e service placement] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:17:03.343171 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1368/2730] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:17:03 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:17:06.848123 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfd0dc6-92ad-46a0-b57c-c1c4c0506bb6 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:17:06.850752 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfd0dc6-92ad-46a0-b57c-c1c4c0506bb6 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:17:06.851254 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfd0dc6-92ad-46a0-b57c-c1c4c0506bb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:17:06.919048 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-dbfd0dc6-92ad-46a0-b57c-c1c4c0506bb6 None None] MFA Rules not processed for user `88e8ff3eff3b44a79f7e37f6adc361cd`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:17:06.920359 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-dbfd0dc6-92ad-46a0-b57c-c1c4c0506bb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:17:06.928887 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:17:07.075056 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1363/2731] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:17:06 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:17:07.078936 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8500ef8-8b07-4d11-a29f-59b78652319e service placement] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:17:07.081508 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-e8500ef8-8b07-4d11-a29f-59b78652319e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:17:07.220420 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8500ef8-8b07-4d11-a29f-59b78652319e service placement] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:17:07.229976 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a75ad1f-5590-4b3b-976b-f8ca63df15f3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7f2db148c8e4d5d81431cae3576434b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:17:07.231231 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a75ad1f-5590-4b3b-976b-f8ca63df15f3 service glance] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:17:07.231695 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a75ad1f-5590-4b3b-976b-f8ca63df15f3 service glance] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:17:07.232166 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a75ad1f-5590-4b3b-976b-f8ca63df15f3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:17:07.253931 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a75ad1f-5590-4b3b-976b-f8ca63df15f3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:17:07.257385 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a75ad1f-5590-4b3b-976b-f8ca63df15f3 service glance] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:17:07.279315 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1369/2732] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:17:07 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:17:09.878526 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f77398-b609-46fd-9d1a-9d2002fb37c2 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:17:09.879089 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f77398-b609-46fd-9d1a-9d2002fb37c2 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:17:09.879195 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f77398-b609-46fd-9d1a-9d2002fb37c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:17:09.927561 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-b8f77398-b609-46fd-9d1a-9d2002fb37c2 None None] MFA Rules not processed for user `ebf92af08fa94215b4eafcacea6c63f6`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:17:09.929495 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-b8f77398-b609-46fd-9d1a-9d2002fb37c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:17:10.237888 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1364/2733] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:17:09 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 362 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:17:12.239403 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4947553-3173-46e5-9982-1849283e59bd None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:17:12.239968 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4947553-3173-46e5-9982-1849283e59bd None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:17:12.239968 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4947553-3173-46e5-9982-1849283e59bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:17:12.267410 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:17:12.332725 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-b4947553-3173-46e5-9982-1849283e59bd None None] MFA Rules not processed for user `55c76bc3f4d24532a4a8e9fd5aa7ec10`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:17:12.334004 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-b4947553-3173-46e5-9982-1849283e59bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:17:12.502424 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1370/2734] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:17:12 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:17:12.935900 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f77398-b609-46fd-9d1a-9d2002fb37c2 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:17:12.939212 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-b8f77398-b609-46fd-9d1a-9d2002fb37c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:17:13.205068 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f77398-b609-46fd-9d1a-9d2002fb37c2 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:17:13.212745 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524289b3-bc66-4664-9bc0-774c1131cfa0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:17:13.213708 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524289b3-bc66-4664-9bc0-774c1131cfa0 service nova] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:17:13.214172 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524289b3-bc66-4664-9bc0-774c1131cfa0 service nova] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:17:13.214829 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524289b3-bc66-4664-9bc0-774c1131cfa0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:17:13.246863 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524289b3-bc66-4664-9bc0-774c1131cfa0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:17:13.248820 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524289b3-bc66-4664-9bc0-774c1131cfa0 service nova] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:17:13.272011 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1365/2735] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:17:12 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:17:21.037325 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b359df47-0b54-482e-aadd-1570cbfd35d9 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:17:21.038343 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b359df47-0b54-482e-aadd-1570cbfd35d9 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:17:21.038935 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b359df47-0b54-482e-aadd-1570cbfd35d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:17:21.060552 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-b359df47-0b54-482e-aadd-1570cbfd35d9 None None] MFA Rules not processed for user `17b779a3e21a415bb42cde5d6863d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:17:21.061840 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-b359df47-0b54-482e-aadd-1570cbfd35d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:17:21.147317 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde7f962-c6d8-446b-8c3f-c45ff2c5523e None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:17:21.148388 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde7f962-c6d8-446b-8c3f-c45ff2c5523e None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:17:21.148881 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde7f962-c6d8-446b-8c3f-c45ff2c5523e None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:17:21.151444 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1366/2736] 10.222.0.17 () {54 vars in 921 bytes} [Sat Jul 23 21:17:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:17:21.151578 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1371/2737] 10.222.0.17 () {58 vars in 1009 bytes} [Sat Jul 23 21:17:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:17:21.158520 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2545b914-0aea-40cc-8a97-8090ff1b9bd9 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:17:21.158805 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2545b914-0aea-40cc-8a97-8090ff1b9bd9 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:17:21.159542 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2545b914-0aea-40cc-8a97-8090ff1b9bd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:17:21.165037 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde7f962-c6d8-446b-8c3f-c45ff2c5523e None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:17:21.167138 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-dde7f962-c6d8-446b-8c3f-c45ff2c5523e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:17:21.192506 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-2545b914-0aea-40cc-8a97-8090ff1b9bd9 None None] MFA Rules not processed for user `abc719a3b3ac4461b82ca04ab6451d81`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:17:21.193898 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-2545b914-0aea-40cc-8a97-8090ff1b9bd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:17:21.209129 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1372/2738] 10.222.0.17 () {58 vars in 1018 bytes} [Sat Jul 23 21:17:21 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:17:21.211247 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2545b914-0aea-40cc-8a97-8090ff1b9bd9 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:17:21.222185 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:17:21.228476 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2545b914-0aea-40cc-8a97-8090ff1b9bd9 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:17:21.237742 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8dc417-d10c-4d4a-a827-462ec9ea9e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:17:21.239351 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8dc417-d10c-4d4a-a827-462ec9ea9e86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:17:21.239639 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8dc417-d10c-4d4a-a827-462ec9ea9e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:17:21.239920 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8dc417-d10c-4d4a-a827-462ec9ea9e86 admin admin] PATH_INFO: `/v3/users/55c76bc3f4d24532a4a8e9fd5aa7ec10` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:17:21.246698 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8dc417-d10c-4d4a-a827-462ec9ea9e86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55c76bc3f4d24532a4a8e9fd5aa7ec10)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:17:21.248886 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8dc417-d10c-4d4a-a827-462ec9ea9e86 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:17:21.276210 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde7f962-c6d8-446b-8c3f-c45ff2c5523e None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:17:21.281988 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd061b15-dd56-439a-ac0f-67473e0d75d9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f0a685b7da46afb81024848f079d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:17:21.282792 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd061b15-dd56-439a-ac0f-67473e0d75d9 service swift] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:17:21.283103 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd061b15-dd56-439a-ac0f-67473e0d75d9 service swift] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:17:21.283393 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd061b15-dd56-439a-ac0f-67473e0d75d9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:17:21.294123 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd061b15-dd56-439a-ac0f-67473e0d75d9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:17:21.295798 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd061b15-dd56-439a-ac0f-67473e0d75d9 service swift] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:17:21.300946 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-8f8dc417-d10c-4d4a-a827-462ec9ea9e86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55c76bc3f4d24532a4a8e9fd5aa7ec10'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:17:21.301611 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-8f8dc417-d10c-4d4a-a827-462ec9ea9e86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55c76bc3f4d24532a4a8e9fd5aa7ec10'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:17:21.306500 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1367/2739] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 23 21:17:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 23 21:17:21.308868 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-8f8dc417-d10c-4d4a-a827-462ec9ea9e86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55c76bc3f4d24532a4a8e9fd5aa7ec10'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:17:21.313835 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd061b15-dd56-439a-ac0f-67473e0d75d9 service swift] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:17:21.315462 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-dd061b15-dd56-439a-ac0f-67473e0d75d9 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:17:21.317626 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-8f8dc417-d10c-4d4a-a827-462ec9ea9e86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55c76bc3f4d24532a4a8e9fd5aa7ec10'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:17:21.330843 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-8f8dc417-d10c-4d4a-a827-462ec9ea9e86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55c76bc3f4d24532a4a8e9fd5aa7ec10'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:17:21.331436 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd061b15-dd56-439a-ac0f-67473e0d75d9 service swift] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:17:21.337655 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c28ce7b-ccdd-4646-8c8a-a13cdf4f6771 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc719a3b3ac4461b82ca04ab6451d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:17:21.338316 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1373/2740] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:17:21 2022] DELETE /identity/v3/users/55c76bc3f4d24532a4a8e9fd5aa7ec10 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:17:21.341376 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c28ce7b-ccdd-4646-8c8a-a13cdf4f6771 service placement] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:17:21.341376 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c28ce7b-ccdd-4646-8c8a-a13cdf4f6771 service placement] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:17:21.341376 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c28ce7b-ccdd-4646-8c8a-a13cdf4f6771 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:17:21.341376 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-0c28ce7b-ccdd-4646-8c8a-a13cdf4f6771 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:17:21.353184 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c28ce7b-ccdd-4646-8c8a-a13cdf4f6771 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:17:21.355170 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c28ce7b-ccdd-4646-8c8a-a13cdf4f6771 service placement] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:17:21.369378 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1368/2741] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:17:21 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:17:21.867162 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8dc417-d10c-4d4a-a827-462ec9ea9e86 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:17:21.871178 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-8f8dc417-d10c-4d4a-a827-462ec9ea9e86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:17:21.885943 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:17:22.022682 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8dc417-d10c-4d4a-a827-462ec9ea9e86 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:17:22.032770 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a280fc8f-f939-4c2a-a45c-054e07fe98c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:17:22.034179 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a280fc8f-f939-4c2a-a45c-054e07fe98c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:17:22.034508 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a280fc8f-f939-4c2a-a45c-054e07fe98c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:17:22.034862 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a280fc8f-f939-4c2a-a45c-054e07fe98c0 admin admin] PATH_INFO: `/v3/projects/a9048665723042548bb40405a19e3efd` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:17:22.037138 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a280fc8f-f939-4c2a-a45c-054e07fe98c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9048665723042548bb40405a19e3efd)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:17:22.039530 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a280fc8f-f939-4c2a-a45c-054e07fe98c0 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:17:22.103376 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-a280fc8f-f939-4c2a-a45c-054e07fe98c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9048665723042548bb40405a19e3efd', 'request_id': 'req-a280fc8f-f939-4c2a-a45c-054e07fe98c0'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:17:22.114718 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-a280fc8f-f939-4c2a-a45c-054e07fe98c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9048665723042548bb40405a19e3efd', 'request_id': 'req-a280fc8f-f939-4c2a-a45c-054e07fe98c0'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:17:22.121974 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-a280fc8f-f939-4c2a-a45c-054e07fe98c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9048665723042548bb40405a19e3efd', 'request_id': 'req-a280fc8f-f939-4c2a-a45c-054e07fe98c0'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:17:22.136655 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-a280fc8f-f939-4c2a-a45c-054e07fe98c0 admin admin] The token cache is being invalidate because project a9048665723042548bb40405a19e3efd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:17:22.137168 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-a280fc8f-f939-4c2a-a45c-054e07fe98c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:17:22.137849 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-a280fc8f-f939-4c2a-a45c-054e07fe98c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:17:22.143027 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1374/2742] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:17:21 2022] DELETE /identity/v3/projects/a9048665723042548bb40405a19e3efd => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:17:22.145208 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47511fd2-3ca6-404d-b2e7-7824b9640930 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:17:22.145495 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47511fd2-3ca6-404d-b2e7-7824b9640930 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:17:22.145771 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47511fd2-3ca6-404d-b2e7-7824b9640930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:17:22.172288 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-47511fd2-3ca6-404d-b2e7-7824b9640930 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:17:22.174433 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-47511fd2-3ca6-404d-b2e7-7824b9640930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:17:22.263579 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1369/2743] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:17:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:17:22.271431 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c341464-e403-482c-a376-cdfec2b410d7 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:17:22.271709 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c341464-e403-482c-a376-cdfec2b410d7 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:17:22.271986 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c341464-e403-482c-a376-cdfec2b410d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:17:22.298580 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-8c341464-e403-482c-a376-cdfec2b410d7 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:17:22.300349 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-8c341464-e403-482c-a376-cdfec2b410d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:17:22.317121 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47511fd2-3ca6-404d-b2e7-7824b9640930 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:17:22.325369 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1375/2744] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:17:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:17:22.334820 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47511fd2-3ca6-404d-b2e7-7824b9640930 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:17:22.343139 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b73ceb0-455f-4e3b-bd4e-be411a7d714b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:17:22.343841 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b73ceb0-455f-4e3b-bd4e-be411a7d714b admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:17:22.344118 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b73ceb0-455f-4e3b-bd4e-be411a7d714b admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:17:22.344387 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b73ceb0-455f-4e3b-bd4e-be411a7d714b admin admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:17:22.345199 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b73ceb0-455f-4e3b-bd4e-be411a7d714b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:17:22.346670 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b73ceb0-455f-4e3b-bd4e-be411a7d714b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:17:22.347878 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b73ceb0-455f-4e3b-bd4e-be411a7d714b admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:17:22.366347 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1370/2745] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:17:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:17:22.370708 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c341464-e403-482c-a376-cdfec2b410d7 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:17:22.388978 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c341464-e403-482c-a376-cdfec2b410d7 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:17:22.401500 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0fd115-30c5-4d5e-b8a5-bbc21a0f00a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:17:22.403675 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0fd115-30c5-4d5e-b8a5-bbc21a0f00a0 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:17:22.404004 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0fd115-30c5-4d5e-b8a5-bbc21a0f00a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:17:22.404239 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0fd115-30c5-4d5e-b8a5-bbc21a0f00a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:17:22.405034 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0fd115-30c5-4d5e-b8a5-bbc21a0f00a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:17:22.411303 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0fd115-30c5-4d5e-b8a5-bbc21a0f00a0 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:17:22.485708 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1376/2746] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:17:22 2022] POST /identity/v3/projects => generated 381 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:17:22.486341 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b73ceb0-455f-4e3b-bd4e-be411a7d714b admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:17:22.498722 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b73ceb0-455f-4e3b-bd4e-be411a7d714b admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:17:22.582921 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8dd205-d404-4fbb-91c3-7cd3883713d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:17:22.583913 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8dd205-d404-4fbb-91c3-7cd3883713d8 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:17:22.584321 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8dd205-d404-4fbb-91c3-7cd3883713d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:17:22.584602 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8dd205-d404-4fbb-91c3-7cd3883713d8 admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:17:22.585567 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8dd205-d404-4fbb-91c3-7cd3883713d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:17:22.589222 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8dd205-d404-4fbb-91c3-7cd3883713d8 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:17:22.654245 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0fd115-30c5-4d5e-b8a5-bbc21a0f00a0 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:17:22.662666 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1371/2747] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:17:22 2022] POST /identity/v3/users => generated 291 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:17:22.668908 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0fd115-30c5-4d5e-b8a5-bbc21a0f00a0 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:17:22.677498 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58d508b-f739-49f9-9e0d-80d97db9f64c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:17:22.678217 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58d508b-f739-49f9-9e0d-80d97db9f64c admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:17:22.678349 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58d508b-f739-49f9-9e0d-80d97db9f64c admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:17:22.678918 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58d508b-f739-49f9-9e0d-80d97db9f64c admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:17:22.687799 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58d508b-f739-49f9-9e0d-80d97db9f64c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:17:22.692953 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58d508b-f739-49f9-9e0d-80d97db9f64c admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:17:22.722917 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8dd205-d404-4fbb-91c3-7cd3883713d8 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:17:22.735109 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1377/2748] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:17:22 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:17:22.737375 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8dd205-d404-4fbb-91c3-7cd3883713d8 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:17:22.742765 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dff5aa8-fea3-4eea-883f-f6d4c82a3852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:17:22.743511 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dff5aa8-fea3-4eea-883f-f6d4c82a3852 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:17:22.743805 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dff5aa8-fea3-4eea-883f-f6d4c82a3852 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:17:22.744075 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dff5aa8-fea3-4eea-883f-f6d4c82a3852 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:17:22.757728 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dff5aa8-fea3-4eea-883f-f6d4c82a3852 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:17:22.761112 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dff5aa8-fea3-4eea-883f-f6d4c82a3852 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:17:22.789434 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58d508b-f739-49f9-9e0d-80d97db9f64c admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:17:22.812707 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1372/2749] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:17:22 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:17:22.822600 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58d508b-f739-49f9-9e0d-80d97db9f64c admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:17:22.829802 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e1a159-1125-462b-8333-f653c1a9f99f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:17:22.830764 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e1a159-1125-462b-8333-f653c1a9f99f admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:17:22.831043 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e1a159-1125-462b-8333-f653c1a9f99f admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:17:22.833631 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e1a159-1125-462b-8333-f653c1a9f99f admin admin] PATH_INFO: `/v3/projects/454092f7aaf44ed3a3cdfba882e217b3/users/d18a11b26ded436ab197043a4b90b276/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:17:22.891030 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e1a159-1125-462b-8333-f653c1a9f99f admin admin] RBAC: Authorizing `identity:create_grant(project_id=454092f7aaf44ed3a3cdfba882e217b3, user_id=d18a11b26ded436ab197043a4b90b276, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:17:22.893716 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e1a159-1125-462b-8333-f653c1a9f99f admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:17:22.925927 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1378/2750] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:17:22 2022] PUT /identity/v3/projects/454092f7aaf44ed3a3cdfba882e217b3/users/d18a11b26ded436ab197043a4b90b276/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:17:22.931381 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89dd1b1-31c7-472c-a810-8e322b54e234 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:17:22.931681 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89dd1b1-31c7-472c-a810-8e322b54e234 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:17:22.931970 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89dd1b1-31c7-472c-a810-8e322b54e234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:17:22.963106 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-e89dd1b1-31c7-472c-a810-8e322b54e234 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:17:22.964998 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-e89dd1b1-31c7-472c-a810-8e322b54e234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:17:22.997297 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:17:23.143123 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1373/2751] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:17:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:17:23.155998 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e1a159-1125-462b-8333-f653c1a9f99f admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:17:23.157884 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-10e1a159-1125-462b-8333-f653c1a9f99f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:17:23.220903 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:17:23.266926 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e1a159-1125-462b-8333-f653c1a9f99f admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:17:23.283621 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c4777c-a08b-4058-b25f-5bf2a81f2705 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:17:23.284295 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c4777c-a08b-4058-b25f-5bf2a81f2705 service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:17:23.284575 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c4777c-a08b-4058-b25f-5bf2a81f2705 service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:17:23.292568 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c4777c-a08b-4058-b25f-5bf2a81f2705 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:17:23.310369 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c4777c-a08b-4058-b25f-5bf2a81f2705 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:17:23.312929 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c4777c-a08b-4058-b25f-5bf2a81f2705 service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:17:23.342124 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1379/2752] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:17:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:17:33.124127 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=20 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:17:33.326358 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=11 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:17:33.702245 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a527ae-c246-4afb-9263-9fe5be39840d None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:17:33.702634 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a527ae-c246-4afb-9263-9fe5be39840d None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:17:33.702912 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a527ae-c246-4afb-9263-9fe5be39840d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:17:33.777321 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-40a527ae-c246-4afb-9263-9fe5be39840d None None] MFA Rules not processed for user `d18a11b26ded436ab197043a4b90b276`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:17:33.783275 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-40a527ae-c246-4afb-9263-9fe5be39840d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:17:34.083573 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1374/2753] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:17:33 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 383 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:17:34.088690 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccddfebe-bc15-4b14-b5f3-4d450b009de5 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:17:34.088690 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccddfebe-bc15-4b14-b5f3-4d450b009de5 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:17:34.088690 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccddfebe-bc15-4b14-b5f3-4d450b009de5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:17:34.146458 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-ccddfebe-bc15-4b14-b5f3-4d450b009de5 None None] MFA Rules not processed for user `d18a11b26ded436ab197043a4b90b276`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:17:34.150256 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-ccddfebe-bc15-4b14-b5f3-4d450b009de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:17:34.184901 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1380/2754] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:17:34 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:17:34.475690 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a527ae-c246-4afb-9263-9fe5be39840d None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:17:34.477639 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-40a527ae-c246-4afb-9263-9fe5be39840d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:17:34.809772 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a527ae-c246-4afb-9263-9fe5be39840d None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:17:34.819578 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02726a6-c703-436b-aa87-1b8d545b953d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:17:34.820369 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02726a6-c703-436b-aa87-1b8d545b953d service nova] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:17:34.820723 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02726a6-c703-436b-aa87-1b8d545b953d service nova] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:17:34.821066 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02726a6-c703-436b-aa87-1b8d545b953d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:17:34.838545 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02726a6-c703-436b-aa87-1b8d545b953d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:17:34.840289 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02726a6-c703-436b-aa87-1b8d545b953d service nova] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:17:34.870382 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1375/2755] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:17:34 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:17:43.380966 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccddfebe-bc15-4b14-b5f3-4d450b009de5 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:17:43.400422 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccddfebe-bc15-4b14-b5f3-4d450b009de5 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:17:43.408252 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793670cc-5cb7-4ab5-a02a-20e41e1eca2b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:17:43.409128 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793670cc-5cb7-4ab5-a02a-20e41e1eca2b service nova] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:17:43.409654 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793670cc-5cb7-4ab5-a02a-20e41e1eca2b service nova] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:17:43.410110 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793670cc-5cb7-4ab5-a02a-20e41e1eca2b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:17:43.418289 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-793670cc-5cb7-4ab5-a02a-20e41e1eca2b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:17:43.510606 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793670cc-5cb7-4ab5-a02a-20e41e1eca2b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:17:43.512562 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793670cc-5cb7-4ab5-a02a-20e41e1eca2b service nova] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:17:43.524500 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1381/2756] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:17:43 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:17:44.859473 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=66 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:17:45.524232 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc88cb22-0e07-4597-97df-94b0ffa6bffa None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:17:45.524532 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc88cb22-0e07-4597-97df-94b0ffa6bffa None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:17:45.525577 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc88cb22-0e07-4597-97df-94b0ffa6bffa None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:17:45.527277 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1376/2757] 10.222.0.17 () {54 vars in 921 bytes} [Sat Jul 23 21:17:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:17:45.533236 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e461664-b3b7-416b-b521-3040832ec239 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:17:45.533749 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e461664-b3b7-416b-b521-3040832ec239 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:17:45.534238 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e461664-b3b7-416b-b521-3040832ec239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:17:45.556630 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-1e461664-b3b7-416b-b521-3040832ec239 None None] MFA Rules not processed for user `abc719a3b3ac4461b82ca04ab6451d81`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:17:45.557978 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-1e461664-b3b7-416b-b521-3040832ec239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:17:45.662734 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1382/2758] 10.222.0.17 () {58 vars in 1018 bytes} [Sat Jul 23 21:17:45 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:17:45.687090 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc88cb22-0e07-4597-97df-94b0ffa6bffa None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:17:45.689132 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-dc88cb22-0e07-4597-97df-94b0ffa6bffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:17:45.709659 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc88cb22-0e07-4597-97df-94b0ffa6bffa None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:17:45.715132 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3851e184-63b1-4d7e-ae5b-4fef89289e7c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc719a3b3ac4461b82ca04ab6451d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:17:45.716020 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3851e184-63b1-4d7e-ae5b-4fef89289e7c service placement] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:17:45.716301 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3851e184-63b1-4d7e-ae5b-4fef89289e7c service placement] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:17:45.716745 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3851e184-63b1-4d7e-ae5b-4fef89289e7c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:17:45.726755 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3851e184-63b1-4d7e-ae5b-4fef89289e7c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:17:45.728594 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3851e184-63b1-4d7e-ae5b-4fef89289e7c service placement] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:17:45.740665 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1377/2759] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:17:45 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:17:48.766873 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf80d41-4298-4124-a049-509b7ade2459 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:17:48.767446 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf80d41-4298-4124-a049-509b7ade2459 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:17:48.767552 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf80d41-4298-4124-a049-509b7ade2459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:17:48.803551 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-0bf80d41-4298-4124-a049-509b7ade2459 None None] MFA Rules not processed for user `fe3ad614d9d24300adb274cc95120fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:17:48.804870 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-0bf80d41-4298-4124-a049-509b7ade2459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:17:48.833543 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1383/2760] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:17:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:17:49.548659 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afce724c-43d1-4e0b-8e2d-2aca0d922073 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:17:49.549776 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afce724c-43d1-4e0b-8e2d-2aca0d922073 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:17:49.550280 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afce724c-43d1-4e0b-8e2d-2aca0d922073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:17:49.587240 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-afce724c-43d1-4e0b-8e2d-2aca0d922073 None None] MFA Rules not processed for user `17b779a3e21a415bb42cde5d6863d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:17:49.588779 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-afce724c-43d1-4e0b-8e2d-2aca0d922073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:17:49.702438 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1378/2761] 10.222.0.17 () {58 vars in 1009 bytes} [Sat Jul 23 21:17:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:17:49.722227 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf80d41-4298-4124-a049-509b7ade2459 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:17:49.723786 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-0bf80d41-4298-4124-a049-509b7ade2459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:17:49.860620 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf80d41-4298-4124-a049-509b7ade2459 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:17:49.869038 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380686e5-acc1-4e50-916e-6a2a7ba1b323 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f0a685b7da46afb81024848f079d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:17:49.870095 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380686e5-acc1-4e50-916e-6a2a7ba1b323 service swift] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:17:49.870551 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380686e5-acc1-4e50-916e-6a2a7ba1b323 service swift] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:17:49.870977 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380686e5-acc1-4e50-916e-6a2a7ba1b323 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:17:49.881697 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380686e5-acc1-4e50-916e-6a2a7ba1b323 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:17:49.883709 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380686e5-acc1-4e50-916e-6a2a7ba1b323 service swift] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:17:49.909107 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1384/2762] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 23 21:17:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 23 21:17:52.717394 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e257974d-2cc4-4188-92e0-24f2b2c2333e None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:17:52.718018 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e257974d-2cc4-4188-92e0-24f2b2c2333e None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:17:52.718018 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e257974d-2cc4-4188-92e0-24f2b2c2333e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:17:52.755321 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-e257974d-2cc4-4188-92e0-24f2b2c2333e None None] MFA Rules not processed for user `17b779a3e21a415bb42cde5d6863d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:17:52.756804 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-e257974d-2cc4-4188-92e0-24f2b2c2333e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:17:52.776471 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1379/2763] 10.222.0.17 () {58 vars in 1009 bytes} [Sat Jul 23 21:17:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:17:52.799543 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380686e5-acc1-4e50-916e-6a2a7ba1b323 service swift] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:17:52.834643 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380686e5-acc1-4e50-916e-6a2a7ba1b323 service swift] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:17:52.854683 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec00574f-fe35-457b-8070-74d051e51e50 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f0a685b7da46afb81024848f079d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:17:52.856967 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec00574f-fe35-457b-8070-74d051e51e50 service swift] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:17:52.857652 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec00574f-fe35-457b-8070-74d051e51e50 service swift] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:17:52.858119 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec00574f-fe35-457b-8070-74d051e51e50 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:17:52.872680 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec00574f-fe35-457b-8070-74d051e51e50 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:17:52.875283 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec00574f-fe35-457b-8070-74d051e51e50 service swift] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:17:52.880279 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:17:52.892562 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1385/2764] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 23 21:17:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 23 21:17:53.970266 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e257974d-2cc4-4188-92e0-24f2b2c2333e None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:17:53.973628 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-e257974d-2cc4-4188-92e0-24f2b2c2333e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:17:54.011541 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e257974d-2cc4-4188-92e0-24f2b2c2333e None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:17:54.034999 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18feab57-5c32-42e8-a403-b68b48591953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:17:54.037297 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18feab57-5c32-42e8-a403-b68b48591953 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:17:54.039512 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18feab57-5c32-42e8-a403-b68b48591953 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:17:54.040101 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18feab57-5c32-42e8-a403-b68b48591953 admin admin] PATH_INFO: `/v3/users/39f1a14a59b7401d88f18ec35c91e30a` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:17:54.045182 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18feab57-5c32-42e8-a403-b68b48591953 admin admin] RBAC: Authorizing `identity:delete_user(user_id=39f1a14a59b7401d88f18ec35c91e30a)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:17:54.054243 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18feab57-5c32-42e8-a403-b68b48591953 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:17:54.196387 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-18feab57-5c32-42e8-a403-b68b48591953 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39f1a14a59b7401d88f18ec35c91e30a'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:17:54.226365 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-18feab57-5c32-42e8-a403-b68b48591953 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39f1a14a59b7401d88f18ec35c91e30a'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:17:54.227614 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-18feab57-5c32-42e8-a403-b68b48591953 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39f1a14a59b7401d88f18ec35c91e30a'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:17:54.249971 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-18feab57-5c32-42e8-a403-b68b48591953 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39f1a14a59b7401d88f18ec35c91e30a'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:17:54.302231 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-18feab57-5c32-42e8-a403-b68b48591953 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39f1a14a59b7401d88f18ec35c91e30a'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:17:54.325671 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1380/2765] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:17:53 2022] DELETE /identity/v3/users/39f1a14a59b7401d88f18ec35c91e30a => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:17:54.845214 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec00574f-fe35-457b-8070-74d051e51e50 service swift] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:17:54.863071 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec00574f-fe35-457b-8070-74d051e51e50 service swift] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:17:55.006108 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9e509a-8444-42dd-a2d3-fdf2734212e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:17:55.007619 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9e509a-8444-42dd-a2d3-fdf2734212e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:17:55.008361 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9e509a-8444-42dd-a2d3-fdf2734212e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:17:55.008928 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9e509a-8444-42dd-a2d3-fdf2734212e3 admin admin] PATH_INFO: `/v3/projects/d3c17bd813264fb9891076799e33acca` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:17:55.013886 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9e509a-8444-42dd-a2d3-fdf2734212e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3c17bd813264fb9891076799e33acca)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:17:55.016085 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9e509a-8444-42dd-a2d3-fdf2734212e3 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:17:55.121940 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-5a9e509a-8444-42dd-a2d3-fdf2734212e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3c17bd813264fb9891076799e33acca', 'request_id': 'req-5a9e509a-8444-42dd-a2d3-fdf2734212e3'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:17:55.143141 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-5a9e509a-8444-42dd-a2d3-fdf2734212e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3c17bd813264fb9891076799e33acca', 'request_id': 'req-5a9e509a-8444-42dd-a2d3-fdf2734212e3'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:17:55.152836 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-5a9e509a-8444-42dd-a2d3-fdf2734212e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3c17bd813264fb9891076799e33acca', 'request_id': 'req-5a9e509a-8444-42dd-a2d3-fdf2734212e3'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:17:55.165520 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-5a9e509a-8444-42dd-a2d3-fdf2734212e3 admin admin] The token cache is being invalidate because project d3c17bd813264fb9891076799e33acca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:17:55.166098 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-5a9e509a-8444-42dd-a2d3-fdf2734212e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:17:55.166991 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-5a9e509a-8444-42dd-a2d3-fdf2734212e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:17:55.169224 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1386/2766] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:17:54 2022] DELETE /identity/v3/projects/d3c17bd813264fb9891076799e33acca => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:17:55.173655 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18feab57-5c32-42e8-a403-b68b48591953 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:17:55.176961 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-18feab57-5c32-42e8-a403-b68b48591953 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:17:55.209008 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18feab57-5c32-42e8-a403-b68b48591953 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:17:55.332823 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:17:55.355763 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f65faef-54f2-4e67-bcb3-3c2fa20993f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:17:55.365106 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f65faef-54f2-4e67-bcb3-3c2fa20993f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:17:55.365488 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f65faef-54f2-4e67-bcb3-3c2fa20993f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:17:55.365834 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f65faef-54f2-4e67-bcb3-3c2fa20993f9 admin admin] PATH_INFO: `/v3/users/c3c98764e4124ec8a07db8d3d3cce19a` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:17:55.367345 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f65faef-54f2-4e67-bcb3-3c2fa20993f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3c98764e4124ec8a07db8d3d3cce19a)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:17:55.369408 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f65faef-54f2-4e67-bcb3-3c2fa20993f9 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:17:55.468222 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-4f65faef-54f2-4e67-bcb3-3c2fa20993f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3c98764e4124ec8a07db8d3d3cce19a'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:17:55.487551 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-4f65faef-54f2-4e67-bcb3-3c2fa20993f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3c98764e4124ec8a07db8d3d3cce19a'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:17:55.488383 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-4f65faef-54f2-4e67-bcb3-3c2fa20993f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3c98764e4124ec8a07db8d3d3cce19a'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:17:55.502217 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-4f65faef-54f2-4e67-bcb3-3c2fa20993f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3c98764e4124ec8a07db8d3d3cce19a'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:17:55.540733 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-4f65faef-54f2-4e67-bcb3-3c2fa20993f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3c98764e4124ec8a07db8d3d3cce19a'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:17:55.557227 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1381/2767] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:17:55 2022] DELETE /identity/v3/users/c3c98764e4124ec8a07db8d3d3cce19a => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:17:56.076553 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9e509a-8444-42dd-a2d3-fdf2734212e3 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:17:56.078801 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-5a9e509a-8444-42dd-a2d3-fdf2734212e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:17:56.119086 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9e509a-8444-42dd-a2d3-fdf2734212e3 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:17:56.331318 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4876db6c-c176-4f1b-a339-b63189fae92b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:17:56.333239 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4876db6c-c176-4f1b-a339-b63189fae92b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:17:56.333576 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4876db6c-c176-4f1b-a339-b63189fae92b admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:17:56.333879 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4876db6c-c176-4f1b-a339-b63189fae92b admin admin] PATH_INFO: `/v3/projects/1c37426b28e642aea8604c40c0b6afcf` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:17:56.338204 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4876db6c-c176-4f1b-a339-b63189fae92b admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c37426b28e642aea8604c40c0b6afcf)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:17:56.339496 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4876db6c-c176-4f1b-a339-b63189fae92b admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:17:56.408262 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:17:56.446220 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-4876db6c-c176-4f1b-a339-b63189fae92b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c37426b28e642aea8604c40c0b6afcf', 'request_id': 'req-4876db6c-c176-4f1b-a339-b63189fae92b'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:17:56.478657 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-4876db6c-c176-4f1b-a339-b63189fae92b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c37426b28e642aea8604c40c0b6afcf', 'request_id': 'req-4876db6c-c176-4f1b-a339-b63189fae92b'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:17:56.505247 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-4876db6c-c176-4f1b-a339-b63189fae92b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c37426b28e642aea8604c40c0b6afcf', 'request_id': 'req-4876db6c-c176-4f1b-a339-b63189fae92b'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:17:56.529775 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-4876db6c-c176-4f1b-a339-b63189fae92b admin admin] The token cache is being invalidate because project 1c37426b28e642aea8604c40c0b6afcf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:17:56.530189 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-4876db6c-c176-4f1b-a339-b63189fae92b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:17:56.534757 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-4876db6c-c176-4f1b-a339-b63189fae92b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:17:56.556821 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0116612-68bf-4593-abc5-58d61f374da5 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:17:56.557949 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0116612-68bf-4593-abc5-58d61f374da5 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:17:56.558698 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0116612-68bf-4593-abc5-58d61f374da5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:17:56.559146 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1387/2768] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:17:56 2022] DELETE /identity/v3/projects/1c37426b28e642aea8604c40c0b6afcf => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:17:56.591137 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-c0116612-68bf-4593-abc5-58d61f374da5 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:17:56.600081 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-c0116612-68bf-4593-abc5-58d61f374da5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:17:56.703968 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1382/2769] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:17:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:17:56.722703 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0835a024-6520-43d2-989c-b2adff91d7de None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:17:56.724180 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0835a024-6520-43d2-989c-b2adff91d7de None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:17:56.724968 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0835a024-6520-43d2-989c-b2adff91d7de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:17:56.803799 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-0835a024-6520-43d2-989c-b2adff91d7de None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:17:56.805587 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-0835a024-6520-43d2-989c-b2adff91d7de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:17:56.842099 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1388/2770] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:17:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:17:56.843513 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0116612-68bf-4593-abc5-58d61f374da5 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:17:56.870055 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0116612-68bf-4593-abc5-58d61f374da5 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:17:56.880833 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b030a21d-8128-4861-ac6d-af32ffbc7078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:17:56.882049 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b030a21d-8128-4861-ac6d-af32ffbc7078 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:17:56.882613 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b030a21d-8128-4861-ac6d-af32ffbc7078 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:17:56.883542 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b030a21d-8128-4861-ac6d-af32ffbc7078 admin admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:17:56.885722 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b030a21d-8128-4861-ac6d-af32ffbc7078 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:17:56.887914 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b030a21d-8128-4861-ac6d-af32ffbc7078 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:17:56.891120 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b030a21d-8128-4861-ac6d-af32ffbc7078 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:17:56.939443 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1383/2771] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:17:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:17:56.945395 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0835a024-6520-43d2-989c-b2adff91d7de None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:17:57.005551 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0835a024-6520-43d2-989c-b2adff91d7de None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:17:57.017568 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982cdb73-59ce-4035-b1ee-59bd5b5a56bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:17:57.018684 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982cdb73-59ce-4035-b1ee-59bd5b5a56bc admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:17:57.019183 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982cdb73-59ce-4035-b1ee-59bd5b5a56bc admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:17:57.019702 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982cdb73-59ce-4035-b1ee-59bd5b5a56bc admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:17:57.020637 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982cdb73-59ce-4035-b1ee-59bd5b5a56bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:17:57.033991 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982cdb73-59ce-4035-b1ee-59bd5b5a56bc admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:17:57.093403 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1389/2772] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:17:56 2022] POST /identity/v3/projects => generated 403 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:17:57.097802 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b030a21d-8128-4861-ac6d-af32ffbc7078 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:17:57.177056 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b030a21d-8128-4861-ac6d-af32ffbc7078 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:17:57.231209 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:17:57.303030 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5e62aa-7094-409e-892c-db220ffec4a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:17:57.305192 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5e62aa-7094-409e-892c-db220ffec4a1 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:17:57.305751 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5e62aa-7094-409e-892c-db220ffec4a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:17:57.306811 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5e62aa-7094-409e-892c-db220ffec4a1 admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:17:57.307941 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5e62aa-7094-409e-892c-db220ffec4a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:17:57.314490 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5e62aa-7094-409e-892c-db220ffec4a1 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:17:57.364330 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1384/2773] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:17:57 2022] POST /identity/v3/users => generated 302 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:17:57.368917 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982cdb73-59ce-4035-b1ee-59bd5b5a56bc admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:17:57.414623 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982cdb73-59ce-4035-b1ee-59bd5b5a56bc admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:17:57.420291 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da8bad7-1012-42b6-936a-267961ef4200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:17:57.421091 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da8bad7-1012-42b6-936a-267961ef4200 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:17:57.421484 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da8bad7-1012-42b6-936a-267961ef4200 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:17:57.421875 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da8bad7-1012-42b6-936a-267961ef4200 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:17:57.423834 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da8bad7-1012-42b6-936a-267961ef4200 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:17:57.426586 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da8bad7-1012-42b6-936a-267961ef4200 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:17:57.448090 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1390/2774] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:17:57 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:17:57.450702 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5e62aa-7094-409e-892c-db220ffec4a1 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:17:57.470141 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5e62aa-7094-409e-892c-db220ffec4a1 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:17:57.480861 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88dc49b-efb6-44b8-9b78-fc9f6f78e6d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:17:57.481915 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88dc49b-efb6-44b8-9b78-fc9f6f78e6d3 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:17:57.482299 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88dc49b-efb6-44b8-9b78-fc9f6f78e6d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:17:57.482671 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88dc49b-efb6-44b8-9b78-fc9f6f78e6d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:17:57.484012 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88dc49b-efb6-44b8-9b78-fc9f6f78e6d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:17:57.486529 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88dc49b-efb6-44b8-9b78-fc9f6f78e6d3 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:17:57.509253 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1385/2775] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:17:57 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:17:57.513503 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da8bad7-1012-42b6-936a-267961ef4200 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:17:57.531780 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da8bad7-1012-42b6-936a-267961ef4200 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:17:57.563296 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0be4de0-4e95-466f-ad89-eff5c90d39e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:17:57.564344 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0be4de0-4e95-466f-ad89-eff5c90d39e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:17:57.564620 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0be4de0-4e95-466f-ad89-eff5c90d39e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:17:57.564888 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0be4de0-4e95-466f-ad89-eff5c90d39e0 admin admin] PATH_INFO: `/v3/projects/900d0effd2b34f91996a850b1d1b3aef/users/19256ba5522c45b08105e1a3ba27df43/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:17:57.618387 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0be4de0-4e95-466f-ad89-eff5c90d39e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=900d0effd2b34f91996a850b1d1b3aef, user_id=19256ba5522c45b08105e1a3ba27df43, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:17:57.624112 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0be4de0-4e95-466f-ad89-eff5c90d39e0 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:17:57.668390 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0279e703-242e-46c1-8441-84b57c1fae1d None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:17:57.668961 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0279e703-242e-46c1-8441-84b57c1fae1d None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:17:57.668961 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0279e703-242e-46c1-8441-84b57c1fae1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:17:57.671140 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1391/2776] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:17:57 2022] PUT /identity/v3/projects/900d0effd2b34f91996a850b1d1b3aef/users/19256ba5522c45b08105e1a3ba27df43/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:17:57.731544 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-0279e703-242e-46c1-8441-84b57c1fae1d None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:17:57.733136 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-0279e703-242e-46c1-8441-84b57c1fae1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:17:57.891718 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0be4de0-4e95-466f-ad89-eff5c90d39e0 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:17:57.894331 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-f0be4de0-4e95-466f-ad89-eff5c90d39e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:17:57.899115 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1386/2777] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:17:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:17:58.038240 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:17:58.123132 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0be4de0-4e95-466f-ad89-eff5c90d39e0 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:17:58.128911 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5eeb7e-547e-484b-b592-d2ca98dc7f39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:17:58.130007 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5eeb7e-547e-484b-b592-d2ca98dc7f39 service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:17:58.130153 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5eeb7e-547e-484b-b592-d2ca98dc7f39 service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:17:58.130513 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5eeb7e-547e-484b-b592-d2ca98dc7f39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:17:58.157611 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5eeb7e-547e-484b-b592-d2ca98dc7f39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:17:58.166816 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5eeb7e-547e-484b-b592-d2ca98dc7f39 service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:17:58.192435 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1392/2778] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:17:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 23 21:18:00.156123 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b566e8e1-28f9-425f-97e7-2239fd041d8b None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:18:00.156613 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b566e8e1-28f9-425f-97e7-2239fd041d8b None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:18:00.156613 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b566e8e1-28f9-425f-97e7-2239fd041d8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:18:00.189398 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-b566e8e1-28f9-425f-97e7-2239fd041d8b None None] MFA Rules not processed for user `f2672c5db79b4a48a505c3df536594dd`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:18:00.195287 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-b566e8e1-28f9-425f-97e7-2239fd041d8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:18:00.325058 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1387/2779] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:18:00 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:18:08.177116 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=14 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:18:08.237175 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0833bc-8ab5-4dd2-9a43-d06f34e52dc3 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:18:08.237634 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0833bc-8ab5-4dd2-9a43-d06f34e52dc3 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:18:08.238406 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0833bc-8ab5-4dd2-9a43-d06f34e52dc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:18:08.370110 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-8d0833bc-8ab5-4dd2-9a43-d06f34e52dc3 None None] MFA Rules not processed for user `19256ba5522c45b08105e1a3ba27df43`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:18:08.374733 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-8d0833bc-8ab5-4dd2-9a43-d06f34e52dc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:18:08.628811 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1393/2780] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:18:08 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 390 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:18:08.630054 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b566e8e1-28f9-425f-97e7-2239fd041d8b None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:18:08.649993 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d2b8fa-cbec-4abe-abdb-efb0698d966e None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:18:08.650288 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d2b8fa-cbec-4abe-abdb-efb0698d966e None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:18:08.650568 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d2b8fa-cbec-4abe-abdb-efb0698d966e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:18:08.657794 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b566e8e1-28f9-425f-97e7-2239fd041d8b None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:18:08.665153 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544605c8-1820-4b86-8a6c-50b9417ff193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:18:08.665978 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544605c8-1820-4b86-8a6c-50b9417ff193 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:18:08.666323 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544605c8-1820-4b86-8a6c-50b9417ff193 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:18:08.666664 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544605c8-1820-4b86-8a6c-50b9417ff193 admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:18:08.667441 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544605c8-1820-4b86-8a6c-50b9417ff193 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:18:08.693948 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-c7d2b8fa-cbec-4abe-abdb-efb0698d966e None None] MFA Rules not processed for user `0133d9533fbd4be5b46dc308dbe3a7d9`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:18:08.695286 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-c7d2b8fa-cbec-4abe-abdb-efb0698d966e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:18:08.697999 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544605c8-1820-4b86-8a6c-50b9417ff193 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:18:08.790324 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1388/2781] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:18:08 2022] POST /identity/v3/projects => generated 405 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:18:08.792723 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a93917-883f-4fd9-b82b-0a9f7cfc2a93 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:18:08.793202 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a93917-883f-4fd9-b82b-0a9f7cfc2a93 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:18:08.794875 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a93917-883f-4fd9-b82b-0a9f7cfc2a93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:18:08.821628 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-a8a93917-883f-4fd9-b82b-0a9f7cfc2a93 None None] MFA Rules not processed for user `17b779a3e21a415bb42cde5d6863d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:18:08.823142 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-a8a93917-883f-4fd9-b82b-0a9f7cfc2a93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:18:08.845186 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:18:08.906590 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1389/2782] 10.222.0.17 () {58 vars in 967 bytes} [Sat Jul 23 21:18:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:18:08.909342 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a93917-883f-4fd9-b82b-0a9f7cfc2a93 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:18:08.931389 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1394/2783] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:18:08 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:18:08.976020 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d2b8fa-cbec-4abe-abdb-efb0698d966e None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:18:08.978212 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-c7d2b8fa-cbec-4abe-abdb-efb0698d966e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:18:09.030863 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a93917-883f-4fd9-b82b-0a9f7cfc2a93 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:18:09.036353 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6d1a0d-89b7-4dbd-9e0d-9e03a91e27c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:18:09.037241 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6d1a0d-89b7-4dbd-9e0d-9e03a91e27c1 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:18:09.037526 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6d1a0d-89b7-4dbd-9e0d-9e03a91e27c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:18:09.039735 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6d1a0d-89b7-4dbd-9e0d-9e03a91e27c1 admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:18:09.039735 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6d1a0d-89b7-4dbd-9e0d-9e03a91e27c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:18:09.041695 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6d1a0d-89b7-4dbd-9e0d-9e03a91e27c1 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:18:09.097313 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1390/2784] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:18:08 2022] POST /identity/v3/users => generated 309 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:18:09.101431 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6d1a0d-89b7-4dbd-9e0d-9e03a91e27c1 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:18:09.120904 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6d1a0d-89b7-4dbd-9e0d-9e03a91e27c1 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:18:09.134237 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0134266-b5d8-4c58-9051-a62cf6d5fe04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:18:09.134935 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0134266-b5d8-4c58-9051-a62cf6d5fe04 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:18:09.135212 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0134266-b5d8-4c58-9051-a62cf6d5fe04 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:18:09.135489 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0134266-b5d8-4c58-9051-a62cf6d5fe04 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:18:09.137283 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0134266-b5d8-4c58-9051-a62cf6d5fe04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:18:09.138144 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0134266-b5d8-4c58-9051-a62cf6d5fe04 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:18:09.167460 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1391/2785] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:18:09 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 21:18:09.171682 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0134266-b5d8-4c58-9051-a62cf6d5fe04 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:18:09.189056 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0134266-b5d8-4c58-9051-a62cf6d5fe04 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:18:09.207047 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882c5106-78a0-45d1-812f-85d6a8a35d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:18:09.208002 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882c5106-78a0-45d1-812f-85d6a8a35d9b admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:18:09.208284 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882c5106-78a0-45d1-812f-85d6a8a35d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:18:09.208840 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882c5106-78a0-45d1-812f-85d6a8a35d9b admin admin] PATH_INFO: `/v3/projects/8b5400a74faf4b2bb54c28555a62b11e/users/0d971eabc83648d28300e14eb7df72c9/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:18:09.243005 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882c5106-78a0-45d1-812f-85d6a8a35d9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b5400a74faf4b2bb54c28555a62b11e, user_id=0d971eabc83648d28300e14eb7df72c9, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:18:09.245764 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882c5106-78a0-45d1-812f-85d6a8a35d9b admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:18:09.275991 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1392/2786] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:18:09 2022] PUT /identity/v3/projects/8b5400a74faf4b2bb54c28555a62b11e/users/0d971eabc83648d28300e14eb7df72c9/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:18:09.285085 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882c5106-78a0-45d1-812f-85d6a8a35d9b admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:18:09.303166 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d2b8fa-cbec-4abe-abdb-efb0698d966e None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:18:09.511760 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:18:09.512585 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882c5106-78a0-45d1-812f-85d6a8a35d9b admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:18:09.549253 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7aefe5-9d61-460e-a5ef-4d7a404e9832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:18:09.554297 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7aefe5-9d61-460e-a5ef-4d7a404e9832 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:18:09.554577 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7aefe5-9d61-460e-a5ef-4d7a404e9832 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:18:09.560554 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7aefe5-9d61-460e-a5ef-4d7a404e9832 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:18:09.561705 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7aefe5-9d61-460e-a5ef-4d7a404e9832 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:18:09.574562 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7aefe5-9d61-460e-a5ef-4d7a404e9832 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:18:09.612266 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae186c3-33d5-433f-824f-ca1216f15c8f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f0a685b7da46afb81024848f079d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:18:09.612794 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae186c3-33d5-433f-824f-ca1216f15c8f service swift] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:18:09.613249 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae186c3-33d5-433f-824f-ca1216f15c8f service swift] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:18:09.613568 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae186c3-33d5-433f-824f-ca1216f15c8f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:18:09.653302 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1393/2787] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:18:09 2022] GET /identity/v3/roles => generated 1420 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:18:09.654582 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7aefe5-9d61-460e-a5ef-4d7a404e9832 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:18:09.703360 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7aefe5-9d61-460e-a5ef-4d7a404e9832 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:18:09.720863 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfa5c1b-cd8c-4bc9-ad16-82b2fbdb095c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:18:09.721796 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfa5c1b-cd8c-4bc9-ad16-82b2fbdb095c admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:18:09.724034 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfa5c1b-cd8c-4bc9-ad16-82b2fbdb095c admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:18:09.724189 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfa5c1b-cd8c-4bc9-ad16-82b2fbdb095c admin admin] PATH_INFO: `/v3/projects/8b5400a74faf4b2bb54c28555a62b11e/users/0d971eabc83648d28300e14eb7df72c9/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:18:09.730856 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfa5c1b-cd8c-4bc9-ad16-82b2fbdb095c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b5400a74faf4b2bb54c28555a62b11e, user_id=0d971eabc83648d28300e14eb7df72c9, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:18:09.739702 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfa5c1b-cd8c-4bc9-ad16-82b2fbdb095c admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:18:09.780706 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1394/2788] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:18:09 2022] PUT /identity/v3/projects/8b5400a74faf4b2bb54c28555a62b11e/users/0d971eabc83648d28300e14eb7df72c9/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:18:09.807090 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae186c3-33d5-433f-824f-ca1216f15c8f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:18:09.830002 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae186c3-33d5-433f-824f-ca1216f15c8f service swift] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:18:09.833288 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1395/2789] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 23 21:18:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 858 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 23 21:18:12.805890 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a5af0a-3dca-4bfb-ac74-378d6fb36cbd None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:18:12.806857 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a5af0a-3dca-4bfb-ac74-378d6fb36cbd None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:18:12.807894 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a5af0a-3dca-4bfb-ac74-378d6fb36cbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:18:12.838251 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:18:12.903755 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-70a5af0a-3dca-4bfb-ac74-378d6fb36cbd None None] MFA Rules not processed for user `bb4f9dda4c2a411cb0394bf86e9ae223`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:18:12.905085 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-70a5af0a-3dca-4bfb-ac74-378d6fb36cbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:18:13.089110 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1395/2790] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:18:12 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:18:19.822326 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=37 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:18:23.072277 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=24 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:18:24.453642 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae186c3-33d5-433f-824f-ca1216f15c8f service swift] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:18:24.455921 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-8ae186c3-33d5-433f-824f-ca1216f15c8f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:18:24.479791 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae186c3-33d5-433f-824f-ca1216f15c8f service swift] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:18:24.747641 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9c108c-3925-4015-b59a-e516f2a76dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:18:24.751385 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9c108c-3925-4015-b59a-e516f2a76dda admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:18:24.751669 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9c108c-3925-4015-b59a-e516f2a76dda admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:18:24.751942 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9c108c-3925-4015-b59a-e516f2a76dda admin admin] PATH_INFO: `/v3/users/ebf92af08fa94215b4eafcacea6c63f6` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:18:24.760451 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9c108c-3925-4015-b59a-e516f2a76dda admin admin] RBAC: Authorizing `identity:delete_user(user_id=ebf92af08fa94215b4eafcacea6c63f6)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:18:24.768457 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9c108c-3925-4015-b59a-e516f2a76dda admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:18:24.926336 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-cd9c108c-3925-4015-b59a-e516f2a76dda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ebf92af08fa94215b4eafcacea6c63f6'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:18:24.929142 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-cd9c108c-3925-4015-b59a-e516f2a76dda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ebf92af08fa94215b4eafcacea6c63f6'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:18:24.959519 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-cd9c108c-3925-4015-b59a-e516f2a76dda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ebf92af08fa94215b4eafcacea6c63f6'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:18:24.992242 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-cd9c108c-3925-4015-b59a-e516f2a76dda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ebf92af08fa94215b4eafcacea6c63f6'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:18:25.038190 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-cd9c108c-3925-4015-b59a-e516f2a76dda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ebf92af08fa94215b4eafcacea6c63f6'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:18:25.061409 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1396/2791] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:18:24 2022] DELETE /identity/v3/users/ebf92af08fa94215b4eafcacea6c63f6 => generated 0 bytes in 605 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:18:25.063226 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddea58b5-c39e-4e0c-b855-21f916c2a627 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:18:25.063736 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddea58b5-c39e-4e0c-b855-21f916c2a627 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:18:25.063842 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddea58b5-c39e-4e0c-b855-21f916c2a627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:18:25.099727 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-ddea58b5-c39e-4e0c-b855-21f916c2a627 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:18:25.101522 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-ddea58b5-c39e-4e0c-b855-21f916c2a627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:18:25.237963 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1396/2792] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:18:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:18:25.357533 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9c108c-3925-4015-b59a-e516f2a76dda admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:18:25.358747 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-cd9c108c-3925-4015-b59a-e516f2a76dda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:18:25.484936 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9c108c-3925-4015-b59a-e516f2a76dda admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:18:25.489847 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b407b2b-3614-4419-9d2f-a1bd2a1f6a38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:18:25.490477 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b407b2b-3614-4419-9d2f-a1bd2a1f6a38 service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:18:25.490943 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b407b2b-3614-4419-9d2f-a1bd2a1f6a38 service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:18:25.491387 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b407b2b-3614-4419-9d2f-a1bd2a1f6a38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:18:25.520694 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b407b2b-3614-4419-9d2f-a1bd2a1f6a38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:18:25.522204 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b407b2b-3614-4419-9d2f-a1bd2a1f6a38 service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:18:25.536286 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1397/2793] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:18:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:18:26.281793 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddea58b5-c39e-4e0c-b855-21f916c2a627 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:18:26.284670 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-ddea58b5-c39e-4e0c-b855-21f916c2a627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:18:26.301000 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddea58b5-c39e-4e0c-b855-21f916c2a627 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:18:26.312003 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290af1ca-ac95-41a0-a0c1-b91661a9d560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:18:26.314074 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290af1ca-ac95-41a0-a0c1-b91661a9d560 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:18:26.314683 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290af1ca-ac95-41a0-a0c1-b91661a9d560 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:18:26.315302 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290af1ca-ac95-41a0-a0c1-b91661a9d560 admin admin] PATH_INFO: `/v3/projects/f5e7d37a0e3b4b32ae99c3bc15a831e6` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:18:26.317101 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290af1ca-ac95-41a0-a0c1-b91661a9d560 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5e7d37a0e3b4b32ae99c3bc15a831e6)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:18:26.323382 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290af1ca-ac95-41a0-a0c1-b91661a9d560 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:18:26.458932 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-290af1ca-ac95-41a0-a0c1-b91661a9d560 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5e7d37a0e3b4b32ae99c3bc15a831e6', 'request_id': 'req-290af1ca-ac95-41a0-a0c1-b91661a9d560'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:18:26.492620 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-290af1ca-ac95-41a0-a0c1-b91661a9d560 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5e7d37a0e3b4b32ae99c3bc15a831e6', 'request_id': 'req-290af1ca-ac95-41a0-a0c1-b91661a9d560'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:18:26.523189 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-290af1ca-ac95-41a0-a0c1-b91661a9d560 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5e7d37a0e3b4b32ae99c3bc15a831e6', 'request_id': 'req-290af1ca-ac95-41a0-a0c1-b91661a9d560'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:18:26.556827 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-290af1ca-ac95-41a0-a0c1-b91661a9d560 admin admin] The token cache is being invalidate because project f5e7d37a0e3b4b32ae99c3bc15a831e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:18:26.557346 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-290af1ca-ac95-41a0-a0c1-b91661a9d560 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:18:26.558510 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-290af1ca-ac95-41a0-a0c1-b91661a9d560 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:18:26.560796 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1397/2794] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:18:26 2022] DELETE /identity/v3/projects/f5e7d37a0e3b4b32ae99c3bc15a831e6 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:18:26.567638 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b407b2b-3614-4419-9d2f-a1bd2a1f6a38 service neutron] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:18:26.583486 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b407b2b-3614-4419-9d2f-a1bd2a1f6a38 service neutron] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:18:26.618590 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:18:26.693738 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d05db48-8f45-4c5a-bb02-f9b2250a6d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:18:26.694757 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d05db48-8f45-4c5a-bb02-f9b2250a6d52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:18:26.695093 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d05db48-8f45-4c5a-bb02-f9b2250a6d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:18:26.695428 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d05db48-8f45-4c5a-bb02-f9b2250a6d52 admin admin] PATH_INFO: `/v3/users/b840b07183424a7f9ed49511a83b2958` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:18:26.697080 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d05db48-8f45-4c5a-bb02-f9b2250a6d52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b840b07183424a7f9ed49511a83b2958)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:18:26.699428 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d05db48-8f45-4c5a-bb02-f9b2250a6d52 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:18:26.793790 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-0d05db48-8f45-4c5a-bb02-f9b2250a6d52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b840b07183424a7f9ed49511a83b2958'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:18:26.794722 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-0d05db48-8f45-4c5a-bb02-f9b2250a6d52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b840b07183424a7f9ed49511a83b2958'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:18:26.804305 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-0d05db48-8f45-4c5a-bb02-f9b2250a6d52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b840b07183424a7f9ed49511a83b2958'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:18:26.831595 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-0d05db48-8f45-4c5a-bb02-f9b2250a6d52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b840b07183424a7f9ed49511a83b2958'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:18:26.862904 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-0d05db48-8f45-4c5a-bb02-f9b2250a6d52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b840b07183424a7f9ed49511a83b2958'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:18:26.877716 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1398/2795] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:18:26 2022] DELETE /identity/v3/users/b840b07183424a7f9ed49511a83b2958 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:18:27.270483 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290af1ca-ac95-41a0-a0c1-b91661a9d560 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:18:27.272392 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-290af1ca-ac95-41a0-a0c1-b91661a9d560 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:18:27.290296 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290af1ca-ac95-41a0-a0c1-b91661a9d560 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:18:27.439788 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6d796f-d628-4e7e-a67c-50ef79946d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:18:27.440700 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6d796f-d628-4e7e-a67c-50ef79946d04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:18:27.440987 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6d796f-d628-4e7e-a67c-50ef79946d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:18:27.441248 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6d796f-d628-4e7e-a67c-50ef79946d04 admin admin] PATH_INFO: `/v3/projects/881735f360a54c159c565d09f8ddf98a` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:18:27.444682 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6d796f-d628-4e7e-a67c-50ef79946d04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=881735f360a54c159c565d09f8ddf98a)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:18:27.451137 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6d796f-d628-4e7e-a67c-50ef79946d04 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:18:27.550778 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:18:27.588769 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-df6d796f-d628-4e7e-a67c-50ef79946d04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '881735f360a54c159c565d09f8ddf98a', 'request_id': 'req-df6d796f-d628-4e7e-a67c-50ef79946d04'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:18:27.600986 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-df6d796f-d628-4e7e-a67c-50ef79946d04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '881735f360a54c159c565d09f8ddf98a', 'request_id': 'req-df6d796f-d628-4e7e-a67c-50ef79946d04'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:18:27.612730 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-df6d796f-d628-4e7e-a67c-50ef79946d04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '881735f360a54c159c565d09f8ddf98a', 'request_id': 'req-df6d796f-d628-4e7e-a67c-50ef79946d04'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:18:27.643221 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-df6d796f-d628-4e7e-a67c-50ef79946d04 admin admin] The token cache is being invalidate because project 881735f360a54c159c565d09f8ddf98a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:18:27.644126 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-df6d796f-d628-4e7e-a67c-50ef79946d04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:18:27.645069 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-df6d796f-d628-4e7e-a67c-50ef79946d04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:18:27.647384 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1398/2796] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:18:27 2022] DELETE /identity/v3/projects/881735f360a54c159c565d09f8ddf98a => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:18:27.652167 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb47356-7a26-49c2-a4f0-ea0384643f5b None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:18:27.652663 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb47356-7a26-49c2-a4f0-ea0384643f5b None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:18:27.652745 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb47356-7a26-49c2-a4f0-ea0384643f5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:18:27.685843 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-ceb47356-7a26-49c2-a4f0-ea0384643f5b None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:18:27.687780 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-ceb47356-7a26-49c2-a4f0-ea0384643f5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:18:27.788130 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1399/2797] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:18:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:18:27.797232 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2240c434-c147-484a-9084-3c65354aa07c None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:18:27.797674 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2240c434-c147-484a-9084-3c65354aa07c None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:18:27.798250 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2240c434-c147-484a-9084-3c65354aa07c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:18:27.836575 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-2240c434-c147-484a-9084-3c65354aa07c None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:18:27.839601 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-2240c434-c147-484a-9084-3c65354aa07c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:18:27.853234 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1399/2798] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:18:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:18:27.857288 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb47356-7a26-49c2-a4f0-ea0384643f5b None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:18:27.874688 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb47356-7a26-49c2-a4f0-ea0384643f5b None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:18:27.882530 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dbf8f5-0759-4cf8-ae41-c6a8856f711c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:18:27.883440 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dbf8f5-0759-4cf8-ae41-c6a8856f711c admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:18:27.883895 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dbf8f5-0759-4cf8-ae41-c6a8856f711c admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:18:27.884350 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dbf8f5-0759-4cf8-ae41-c6a8856f711c admin admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:18:27.885301 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dbf8f5-0759-4cf8-ae41-c6a8856f711c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:18:27.885842 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dbf8f5-0759-4cf8-ae41-c6a8856f711c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:18:27.888165 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dbf8f5-0759-4cf8-ae41-c6a8856f711c admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:18:27.908296 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1400/2799] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:18:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:18:27.912101 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2240c434-c147-484a-9084-3c65354aa07c None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:18:27.935501 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2240c434-c147-484a-9084-3c65354aa07c None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:18:27.951887 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1622398c-8273-4650-bf2d-59e4fb307f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:18:27.952797 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1622398c-8273-4650-bf2d-59e4fb307f05 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:18:27.953081 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1622398c-8273-4650-bf2d-59e4fb307f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:18:27.953352 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1622398c-8273-4650-bf2d-59e4fb307f05 admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:18:27.954279 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1622398c-8273-4650-bf2d-59e4fb307f05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:18:27.956277 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1622398c-8273-4650-bf2d-59e4fb307f05 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:18:28.023461 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1400/2800] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:18:27 2022] POST /identity/v3/projects => generated 385 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:18:28.031777 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dbf8f5-0759-4cf8-ae41-c6a8856f711c admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:18:28.045470 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dbf8f5-0759-4cf8-ae41-c6a8856f711c admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:18:28.105567 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:18:28.192773 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f158f163-3f73-4a92-b908-5acb7a4a84bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:18:28.193483 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f158f163-3f73-4a92-b908-5acb7a4a84bf admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:18:28.194020 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f158f163-3f73-4a92-b908-5acb7a4a84bf admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:18:28.194308 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f158f163-3f73-4a92-b908-5acb7a4a84bf admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:18:28.195029 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f158f163-3f73-4a92-b908-5acb7a4a84bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:18:28.197552 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f158f163-3f73-4a92-b908-5acb7a4a84bf admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:18:28.245988 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1401/2801] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:18:28 2022] POST /identity/v3/users => generated 293 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:18:28.247251 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1622398c-8273-4650-bf2d-59e4fb307f05 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:18:28.276197 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1622398c-8273-4650-bf2d-59e4fb307f05 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:18:28.301365 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10a4ba8-5a30-4229-97ec-8fee00512f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:18:28.302118 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10a4ba8-5a30-4229-97ec-8fee00512f6d admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:18:28.302401 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10a4ba8-5a30-4229-97ec-8fee00512f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:18:28.302679 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10a4ba8-5a30-4229-97ec-8fee00512f6d admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:18:28.303430 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10a4ba8-5a30-4229-97ec-8fee00512f6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:18:28.305170 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10a4ba8-5a30-4229-97ec-8fee00512f6d admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:18:28.346338 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1401/2802] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:18:28 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:18:28.350414 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f158f163-3f73-4a92-b908-5acb7a4a84bf admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:18:28.362966 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f158f163-3f73-4a92-b908-5acb7a4a84bf admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:18:28.381667 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2aa666e-93df-4bf3-aa40-9eb8e9c37a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:18:28.382929 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aa666e-93df-4bf3-aa40-9eb8e9c37a98 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:18:28.383292 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aa666e-93df-4bf3-aa40-9eb8e9c37a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:18:28.383660 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aa666e-93df-4bf3-aa40-9eb8e9c37a98 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:18:28.384543 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2aa666e-93df-4bf3-aa40-9eb8e9c37a98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:18:28.386285 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2aa666e-93df-4bf3-aa40-9eb8e9c37a98 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:18:28.409004 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1402/2803] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:18:28 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:18:28.411277 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10a4ba8-5a30-4229-97ec-8fee00512f6d admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:18:28.438410 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10a4ba8-5a30-4229-97ec-8fee00512f6d admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:18:28.465827 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2a74de-a57a-49c6-9ac0-c05357d7d8b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:18:28.468640 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2a74de-a57a-49c6-9ac0-c05357d7d8b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:18:28.470933 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2a74de-a57a-49c6-9ac0-c05357d7d8b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:18:28.472226 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2a74de-a57a-49c6-9ac0-c05357d7d8b3 admin admin] PATH_INFO: `/v3/projects/f220ba2f42db435a818f3e462aea35a2/users/145e518288ce4d70a12a3f2cc6a91810/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:18:28.478744 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33540ae-b341-467a-9bc6-55e1383b1d90 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:18:28.479040 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33540ae-b341-467a-9bc6-55e1383b1d90 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:18:28.479287 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33540ae-b341-467a-9bc6-55e1383b1d90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:18:28.526814 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-a33540ae-b341-467a-9bc6-55e1383b1d90 None None] MFA Rules not processed for user `3a56b82cf3954f279dd21e17a42462b3`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:18:28.528053 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-a33540ae-b341-467a-9bc6-55e1383b1d90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:18:28.528737 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2a74de-a57a-49c6-9ac0-c05357d7d8b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f220ba2f42db435a818f3e462aea35a2, user_id=145e518288ce4d70a12a3f2cc6a91810, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:18:28.533771 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2a74de-a57a-49c6-9ac0-c05357d7d8b3 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:18:28.592229 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1402/2804] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:18:28 2022] PUT /identity/v3/projects/f220ba2f42db435a818f3e462aea35a2/users/145e518288ce4d70a12a3f2cc6a91810/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:18:28.595170 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c34703e-c9de-41e7-b697-4f1eb9f22d95 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:18:28.596210 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c34703e-c9de-41e7-b697-4f1eb9f22d95 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:18:28.596499 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c34703e-c9de-41e7-b697-4f1eb9f22d95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:18:28.643484 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1403/2805] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:18:28 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:18:28.683381 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-5c34703e-c9de-41e7-b697-4f1eb9f22d95 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:18:28.696959 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-5c34703e-c9de-41e7-b697-4f1eb9f22d95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:18:28.936840 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1403/2806] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:18:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:18:28.982361 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33540ae-b341-467a-9bc6-55e1383b1d90 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:18:28.983986 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-a33540ae-b341-467a-9bc6-55e1383b1d90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:18:29.160736 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33540ae-b341-467a-9bc6-55e1383b1d90 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:18:29.257737 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bd4462-0cc8-4da8-a1a9-55a783d53c9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:18:29.258434 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bd4462-0cc8-4da8-a1a9-55a783d53c9a service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:18:29.258710 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bd4462-0cc8-4da8-a1a9-55a783d53c9a service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:18:29.258981 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bd4462-0cc8-4da8-a1a9-55a783d53c9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:18:29.283281 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bd4462-0cc8-4da8-a1a9-55a783d53c9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:18:29.284800 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bd4462-0cc8-4da8-a1a9-55a783d53c9a service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:18:29.307370 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1404/2807] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:18:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:18:30.074034 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c34703e-c9de-41e7-b697-4f1eb9f22d95 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:18:30.087402 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c34703e-c9de-41e7-b697-4f1eb9f22d95 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:18:30.097746 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbaad8b-fa0a-45eb-91d7-13af2531e190 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:18:30.099635 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbaad8b-fa0a-45eb-91d7-13af2531e190 service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:18:30.099917 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbaad8b-fa0a-45eb-91d7-13af2531e190 service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:18:30.100194 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbaad8b-fa0a-45eb-91d7-13af2531e190 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:18:30.105630 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-acbaad8b-fa0a-45eb-91d7-13af2531e190 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:18:30.264020 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:18:30.286589 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bd4462-0cc8-4da8-a1a9-55a783d53c9a service neutron] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:18:30.289779 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-05bd4462-0cc8-4da8-a1a9-55a783d53c9a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:18:30.314937 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bd4462-0cc8-4da8-a1a9-55a783d53c9a service neutron] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:18:30.329954 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b5a92a-1079-4a9f-a87d-522d4d37a62e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:18:30.331484 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b5a92a-1079-4a9f-a87d-522d4d37a62e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:18:30.331969 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b5a92a-1079-4a9f-a87d-522d4d37a62e admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:18:30.332574 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b5a92a-1079-4a9f-a87d-522d4d37a62e admin admin] PATH_INFO: `/v3/users/d18a11b26ded436ab197043a4b90b276` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:18:30.334997 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b5a92a-1079-4a9f-a87d-522d4d37a62e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d18a11b26ded436ab197043a4b90b276)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:18:30.345933 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b5a92a-1079-4a9f-a87d-522d4d37a62e admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:18:30.347353 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbaad8b-fa0a-45eb-91d7-13af2531e190 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:18:30.362823 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:18:30.372268 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbaad8b-fa0a-45eb-91d7-13af2531e190 service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:18:30.432451 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1404/2808] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:18:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:18:30.468543 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-51b5a92a-1079-4a9f-a87d-522d4d37a62e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd18a11b26ded436ab197043a4b90b276'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:18:30.469948 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-51b5a92a-1079-4a9f-a87d-522d4d37a62e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd18a11b26ded436ab197043a4b90b276'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:18:30.490535 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-51b5a92a-1079-4a9f-a87d-522d4d37a62e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd18a11b26ded436ab197043a4b90b276'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:18:30.511899 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-51b5a92a-1079-4a9f-a87d-522d4d37a62e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd18a11b26ded436ab197043a4b90b276'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:18:30.539126 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-51b5a92a-1079-4a9f-a87d-522d4d37a62e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd18a11b26ded436ab197043a4b90b276'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:18:30.549232 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1405/2809] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:18:30 2022] DELETE /identity/v3/users/d18a11b26ded436ab197043a4b90b276 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:18:30.860183 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbaad8b-fa0a-45eb-91d7-13af2531e190 service neutron] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:18:30.871404 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-acbaad8b-fa0a-45eb-91d7-13af2531e190 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:18:30.927620 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbaad8b-fa0a-45eb-91d7-13af2531e190 service neutron] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:18:31.093647 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d63d26c-a46e-4aa3-997e-95035410526b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:18:31.094153 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d63d26c-a46e-4aa3-997e-95035410526b service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:18:31.094277 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d63d26c-a46e-4aa3-997e-95035410526b service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:18:31.094812 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d63d26c-a46e-4aa3-997e-95035410526b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:18:31.100161 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-3d63d26c-a46e-4aa3-997e-95035410526b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:18:31.249129 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d63d26c-a46e-4aa3-997e-95035410526b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:18:31.257959 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d63d26c-a46e-4aa3-997e-95035410526b service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:18:31.265085 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b5a92a-1079-4a9f-a87d-522d4d37a62e admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:18:31.266758 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-51b5a92a-1079-4a9f-a87d-522d4d37a62e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:18:31.276679 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1405/2810] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:18:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:18:31.372137 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b5a92a-1079-4a9f-a87d-522d4d37a62e admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:18:31.382425 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ede162-11b5-48f0-8e4a-a78aca8fc922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:18:31.382425 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ede162-11b5-48f0-8e4a-a78aca8fc922 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:18:31.382425 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ede162-11b5-48f0-8e4a-a78aca8fc922 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:18:31.382425 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ede162-11b5-48f0-8e4a-a78aca8fc922 admin admin] PATH_INFO: `/v3/projects/454092f7aaf44ed3a3cdfba882e217b3` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:18:31.383899 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ede162-11b5-48f0-8e4a-a78aca8fc922 admin admin] RBAC: Authorizing `identity:delete_project(project_id=454092f7aaf44ed3a3cdfba882e217b3)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:18:31.386637 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ede162-11b5-48f0-8e4a-a78aca8fc922 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:18:31.499489 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-18ede162-11b5-48f0-8e4a-a78aca8fc922 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '454092f7aaf44ed3a3cdfba882e217b3', 'request_id': 'req-18ede162-11b5-48f0-8e4a-a78aca8fc922'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:18:31.523372 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-18ede162-11b5-48f0-8e4a-a78aca8fc922 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '454092f7aaf44ed3a3cdfba882e217b3', 'request_id': 'req-18ede162-11b5-48f0-8e4a-a78aca8fc922'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:18:31.533482 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-18ede162-11b5-48f0-8e4a-a78aca8fc922 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '454092f7aaf44ed3a3cdfba882e217b3', 'request_id': 'req-18ede162-11b5-48f0-8e4a-a78aca8fc922'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:18:31.551219 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-18ede162-11b5-48f0-8e4a-a78aca8fc922 admin admin] The token cache is being invalidate because project 454092f7aaf44ed3a3cdfba882e217b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:18:31.551219 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-18ede162-11b5-48f0-8e4a-a78aca8fc922 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:18:31.551219 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-18ede162-11b5-48f0-8e4a-a78aca8fc922 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:18:31.559360 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1406/2811] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:18:31 2022] DELETE /identity/v3/projects/454092f7aaf44ed3a3cdfba882e217b3 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:18:31.561389 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc810903-4268-448b-885f-f814ba97fdfa None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:18:31.561887 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc810903-4268-448b-885f-f814ba97fdfa None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:18:31.562191 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc810903-4268-448b-885f-f814ba97fdfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:18:31.582153 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-bc810903-4268-448b-885f-f814ba97fdfa None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:18:31.591955 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-bc810903-4268-448b-885f-f814ba97fdfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:18:31.673908 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1406/2812] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:18:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:18:31.680437 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f293488-7414-4caf-a0f8-68a1bb412358 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:18:31.680910 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f293488-7414-4caf-a0f8-68a1bb412358 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:18:31.681327 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f293488-7414-4caf-a0f8-68a1bb412358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:18:31.708539 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-9f293488-7414-4caf-a0f8-68a1bb412358 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:18:31.710083 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-9f293488-7414-4caf-a0f8-68a1bb412358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:18:31.721777 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1407/2813] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:18:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:18:31.726630 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc810903-4268-448b-885f-f814ba97fdfa None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:18:31.740849 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc810903-4268-448b-885f-f814ba97fdfa None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:18:31.746449 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763012d0-a352-48f6-9652-02c6a31e5857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:18:31.747302 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763012d0-a352-48f6-9652-02c6a31e5857 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:18:31.747484 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763012d0-a352-48f6-9652-02c6a31e5857 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:18:31.747979 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763012d0-a352-48f6-9652-02c6a31e5857 admin admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:18:31.748790 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763012d0-a352-48f6-9652-02c6a31e5857 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:18:31.749151 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763012d0-a352-48f6-9652-02c6a31e5857 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:18:31.751405 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763012d0-a352-48f6-9652-02c6a31e5857 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:18:31.769600 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1407/2814] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:18:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:18:31.774393 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f293488-7414-4caf-a0f8-68a1bb412358 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:18:31.794104 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f293488-7414-4caf-a0f8-68a1bb412358 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:18:31.802277 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e15d2a-5886-40e7-bbb2-f890edb10313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:18:31.803229 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e15d2a-5886-40e7-bbb2-f890edb10313 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:18:31.803667 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e15d2a-5886-40e7-bbb2-f890edb10313 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:18:31.806676 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e15d2a-5886-40e7-bbb2-f890edb10313 admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:18:31.807649 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e15d2a-5886-40e7-bbb2-f890edb10313 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:18:31.809757 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e15d2a-5886-40e7-bbb2-f890edb10313 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:18:31.828010 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:18:31.880124 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1408/2815] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:18:31 2022] POST /identity/v3/projects => generated 373 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:18:31.884158 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763012d0-a352-48f6-9652-02c6a31e5857 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:18:31.891429 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:18:31.897690 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763012d0-a352-48f6-9652-02c6a31e5857 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:18:31.983718 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47accf0a-5a59-43a0-b803-6e5a6416efb7 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:18:31.983991 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47accf0a-5a59-43a0-b803-6e5a6416efb7 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:18:31.984275 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47accf0a-5a59-43a0-b803-6e5a6416efb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:18:32.055233 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bde258-8e3e-4250-96eb-287c7cfef2a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:18:32.056424 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-47accf0a-5a59-43a0-b803-6e5a6416efb7 None None] MFA Rules not processed for user `0d971eabc83648d28300e14eb7df72c9`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:18:32.057488 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bde258-8e3e-4250-96eb-287c7cfef2a4 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:18:32.057678 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-47accf0a-5a59-43a0-b803-6e5a6416efb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:18:32.060788 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bde258-8e3e-4250-96eb-287c7cfef2a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:18:32.061353 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bde258-8e3e-4250-96eb-287c7cfef2a4 admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:18:32.062497 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bde258-8e3e-4250-96eb-287c7cfef2a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:18:32.067494 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bde258-8e3e-4250-96eb-287c7cfef2a4 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:18:32.123593 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1408/2816] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:18:31 2022] POST /identity/v3/users => generated 287 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:18:32.126353 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bde258-8e3e-4250-96eb-287c7cfef2a4 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:18:32.147266 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bde258-8e3e-4250-96eb-287c7cfef2a4 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:18:32.166580 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b0a113-5c4b-461f-bd45-ba659132daa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:18:32.167497 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b0a113-5c4b-461f-bd45-ba659132daa7 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:18:32.167893 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b0a113-5c4b-461f-bd45-ba659132daa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:18:32.168322 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b0a113-5c4b-461f-bd45-ba659132daa7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:18:32.170978 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b0a113-5c4b-461f-bd45-ba659132daa7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:18:32.174082 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b0a113-5c4b-461f-bd45-ba659132daa7 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:18:32.198061 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1409/2817] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:18:32 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:18:32.199590 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b0a113-5c4b-461f-bd45-ba659132daa7 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:18:32.224085 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1409/2818] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:18:31 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:18:32.240542 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b0a113-5c4b-461f-bd45-ba659132daa7 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:18:32.253166 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2aa0b8-782c-41eb-b4ed-261d1d233332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:18:32.254532 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2aa0b8-782c-41eb-b4ed-261d1d233332 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:18:32.256759 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2aa0b8-782c-41eb-b4ed-261d1d233332 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:18:32.257203 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2aa0b8-782c-41eb-b4ed-261d1d233332 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:18:32.261359 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2aa0b8-782c-41eb-b4ed-261d1d233332 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:18:32.264435 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2aa0b8-782c-41eb-b4ed-261d1d233332 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:18:32.292086 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1410/2819] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:18:32 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:18:32.296472 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47accf0a-5a59-43a0-b803-6e5a6416efb7 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:18:32.310728 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47accf0a-5a59-43a0-b803-6e5a6416efb7 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:18:32.324956 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce3cd16-ec0b-4b99-b0b7-670642398bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:18:32.325964 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce3cd16-ec0b-4b99-b0b7-670642398bd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:18:32.326199 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce3cd16-ec0b-4b99-b0b7-670642398bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:18:32.326476 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce3cd16-ec0b-4b99-b0b7-670642398bd7 admin admin] PATH_INFO: `/v3/projects/ad09cbaf0f384f6fb0cea9879b83f32e/users/3d71a807adbd4c1082be1437f1b0ace6/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:18:32.347509 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce3cd16-ec0b-4b99-b0b7-670642398bd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad09cbaf0f384f6fb0cea9879b83f32e, user_id=3d71a807adbd4c1082be1437f1b0ace6, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:18:32.350490 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce3cd16-ec0b-4b99-b0b7-670642398bd7 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:18:32.371052 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1410/2820] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:18:32 2022] PUT /identity/v3/projects/ad09cbaf0f384f6fb0cea9879b83f32e/users/3d71a807adbd4c1082be1437f1b0ace6/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:18:32.472425 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5fddac-b05f-4cba-95ef-a98849a85dd9 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:18:32.472802 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5fddac-b05f-4cba-95ef-a98849a85dd9 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:18:32.473176 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5fddac-b05f-4cba-95ef-a98849a85dd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:18:32.528654 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-cd5fddac-b05f-4cba-95ef-a98849a85dd9 None None] MFA Rules not processed for user `3d71a807adbd4c1082be1437f1b0ace6`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:18:32.530201 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-cd5fddac-b05f-4cba-95ef-a98849a85dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:18:32.674224 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1411/2821] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:18:32 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:18:32.691777 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce3cd16-ec0b-4b99-b0b7-670642398bd7 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:18:32.695801 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-fce3cd16-ec0b-4b99-b0b7-670642398bd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:18:32.834887 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce3cd16-ec0b-4b99-b0b7-670642398bd7 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:18:32.846315 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5375dca5-9bda-467a-8689-ba4256fa1b57 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:18:32.847541 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5375dca5-9bda-467a-8689-ba4256fa1b57 service nova] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:18:32.848031 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5375dca5-9bda-467a-8689-ba4256fa1b57 service nova] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:18:32.848506 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5375dca5-9bda-467a-8689-ba4256fa1b57 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:18:32.858567 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5375dca5-9bda-467a-8689-ba4256fa1b57 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:18:32.860806 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5375dca5-9bda-467a-8689-ba4256fa1b57 service nova] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:18:32.876930 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1411/2822] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:18:32 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:18:34.941678 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5fddac-b05f-4cba-95ef-a98849a85dd9 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:18:35.132972 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5fddac-b05f-4cba-95ef-a98849a85dd9 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:18:35.141221 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606a3558-6672-46bb-a1e6-acd8d96dbaed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:18:35.143060 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606a3558-6672-46bb-a1e6-acd8d96dbaed admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:18:35.143359 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606a3558-6672-46bb-a1e6-acd8d96dbaed admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:18:35.143665 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606a3558-6672-46bb-a1e6-acd8d96dbaed admin admin] PATH_INFO: `/v3/users/3d71a807adbd4c1082be1437f1b0ace6` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:18:35.146505 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606a3558-6672-46bb-a1e6-acd8d96dbaed admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d71a807adbd4c1082be1437f1b0ace6)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:18:35.148953 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606a3558-6672-46bb-a1e6-acd8d96dbaed admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:18:35.156761 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:18:35.288686 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-606a3558-6672-46bb-a1e6-acd8d96dbaed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d71a807adbd4c1082be1437f1b0ace6'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:18:35.315528 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-606a3558-6672-46bb-a1e6-acd8d96dbaed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d71a807adbd4c1082be1437f1b0ace6'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:18:35.317231 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-606a3558-6672-46bb-a1e6-acd8d96dbaed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d71a807adbd4c1082be1437f1b0ace6'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:18:35.335559 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-606a3558-6672-46bb-a1e6-acd8d96dbaed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d71a807adbd4c1082be1437f1b0ace6'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:18:35.367276 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-606a3558-6672-46bb-a1e6-acd8d96dbaed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d71a807adbd4c1082be1437f1b0ace6'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:18:35.387268 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1412/2823] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:18:34 2022] DELETE /identity/v3/users/3d71a807adbd4c1082be1437f1b0ace6 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:18:35.389448 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a022bcbd-898e-41b9-b7a2-14e34e59b6aa None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:18:35.389983 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a022bcbd-898e-41b9-b7a2-14e34e59b6aa None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:18:35.390084 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a022bcbd-898e-41b9-b7a2-14e34e59b6aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:18:35.445903 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-a022bcbd-898e-41b9-b7a2-14e34e59b6aa None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:18:35.452713 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-a022bcbd-898e-41b9-b7a2-14e34e59b6aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:18:35.549295 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:18:35.591310 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1412/2824] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:18:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:18:35.601369 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606a3558-6672-46bb-a1e6-acd8d96dbaed admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:18:35.603115 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-606a3558-6672-46bb-a1e6-acd8d96dbaed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:18:35.843217 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606a3558-6672-46bb-a1e6-acd8d96dbaed admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:18:35.854848 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c6181b-5e8a-47cf-b70b-1e7f15734f99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:18:35.855743 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c6181b-5e8a-47cf-b70b-1e7f15734f99 service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:18:35.856176 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c6181b-5e8a-47cf-b70b-1e7f15734f99 service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:18:35.856455 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c6181b-5e8a-47cf-b70b-1e7f15734f99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:18:35.873186 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c6181b-5e8a-47cf-b70b-1e7f15734f99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:18:35.874705 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c6181b-5e8a-47cf-b70b-1e7f15734f99 service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:18:35.890289 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1413/2825] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:18:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:18:36.041991 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a022bcbd-898e-41b9-b7a2-14e34e59b6aa None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:18:36.059843 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a022bcbd-898e-41b9-b7a2-14e34e59b6aa None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:18:36.066875 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9c7321-69d3-4963-a05e-eaf845b8a1af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:18:36.068779 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9c7321-69d3-4963-a05e-eaf845b8a1af service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:18:36.069296 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9c7321-69d3-4963-a05e-eaf845b8a1af service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:18:36.070097 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9c7321-69d3-4963-a05e-eaf845b8a1af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:18:36.072592 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-4c9c7321-69d3-4963-a05e-eaf845b8a1af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:18:36.086291 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9c7321-69d3-4963-a05e-eaf845b8a1af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:18:36.088339 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9c7321-69d3-4963-a05e-eaf845b8a1af service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:18:36.100580 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1413/2826] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:18:36 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:18:36.632828 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c6181b-5e8a-47cf-b70b-1e7f15734f99 service neutron] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:18:36.634253 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-12c6181b-5e8a-47cf-b70b-1e7f15734f99 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:18:36.659363 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c6181b-5e8a-47cf-b70b-1e7f15734f99 service neutron] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:18:36.693491 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5722972-ef7c-451a-8db3-9b1be5d09243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:18:36.694520 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5722972-ef7c-451a-8db3-9b1be5d09243 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:18:36.696188 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5722972-ef7c-451a-8db3-9b1be5d09243 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:18:36.697323 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5722972-ef7c-451a-8db3-9b1be5d09243 admin admin] PATH_INFO: `/v3/projects/ad09cbaf0f384f6fb0cea9879b83f32e` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:18:36.704199 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5722972-ef7c-451a-8db3-9b1be5d09243 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad09cbaf0f384f6fb0cea9879b83f32e)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:18:36.712710 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5722972-ef7c-451a-8db3-9b1be5d09243 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:18:36.837128 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-c5722972-ef7c-451a-8db3-9b1be5d09243 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad09cbaf0f384f6fb0cea9879b83f32e', 'request_id': 'req-c5722972-ef7c-451a-8db3-9b1be5d09243'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:18:36.861378 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-c5722972-ef7c-451a-8db3-9b1be5d09243 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad09cbaf0f384f6fb0cea9879b83f32e', 'request_id': 'req-c5722972-ef7c-451a-8db3-9b1be5d09243'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:18:36.868865 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-c5722972-ef7c-451a-8db3-9b1be5d09243 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad09cbaf0f384f6fb0cea9879b83f32e', 'request_id': 'req-c5722972-ef7c-451a-8db3-9b1be5d09243'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:18:36.901551 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-c5722972-ef7c-451a-8db3-9b1be5d09243 admin admin] The token cache is being invalidate because project ad09cbaf0f384f6fb0cea9879b83f32e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:18:36.902238 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-c5722972-ef7c-451a-8db3-9b1be5d09243 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:18:36.903115 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-c5722972-ef7c-451a-8db3-9b1be5d09243 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:18:36.905201 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1414/2827] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:18:36 2022] DELETE /identity/v3/projects/ad09cbaf0f384f6fb0cea9879b83f32e => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:18:36.910407 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06d814a-355e-4aab-8e4a-c2f4298b4162 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:18:36.911365 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06d814a-355e-4aab-8e4a-c2f4298b4162 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:18:36.911851 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06d814a-355e-4aab-8e4a-c2f4298b4162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:18:36.935029 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-c06d814a-355e-4aab-8e4a-c2f4298b4162 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:18:36.937035 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-c06d814a-355e-4aab-8e4a-c2f4298b4162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:18:37.024266 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1414/2828] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:18:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:18:37.033114 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81199402-b294-445a-bd91-6171617bce14 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:18:37.033626 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81199402-b294-445a-bd91-6171617bce14 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:18:37.033713 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81199402-b294-445a-bd91-6171617bce14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:18:37.055021 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:18:37.071823 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-81199402-b294-445a-bd91-6171617bce14 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:18:37.078036 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-81199402-b294-445a-bd91-6171617bce14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:18:37.091054 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1415/2829] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:18:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:18:37.095412 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06d814a-355e-4aab-8e4a-c2f4298b4162 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:18:37.111220 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06d814a-355e-4aab-8e4a-c2f4298b4162 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:18:37.118364 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7742d476-1b53-4333-be27-bb451366afeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:18:37.119051 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7742d476-1b53-4333-be27-bb451366afeb admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:18:37.119239 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7742d476-1b53-4333-be27-bb451366afeb admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:18:37.119512 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7742d476-1b53-4333-be27-bb451366afeb admin admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:18:37.120337 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7742d476-1b53-4333-be27-bb451366afeb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:18:37.120997 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7742d476-1b53-4333-be27-bb451366afeb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:18:37.123625 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7742d476-1b53-4333-be27-bb451366afeb admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:18:37.142494 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1415/2830] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:18:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 21:18:37.146631 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81199402-b294-445a-bd91-6171617bce14 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:18:37.162660 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81199402-b294-445a-bd91-6171617bce14 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:18:37.168360 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfcb91f-9a98-4929-a47d-6ab33f238378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:18:37.168845 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfcb91f-9a98-4929-a47d-6ab33f238378 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:18:37.169202 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfcb91f-9a98-4929-a47d-6ab33f238378 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:18:37.169542 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfcb91f-9a98-4929-a47d-6ab33f238378 admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:18:37.170702 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfcb91f-9a98-4929-a47d-6ab33f238378 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:18:37.173967 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfcb91f-9a98-4929-a47d-6ab33f238378 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:18:37.235641 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1416/2831] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:18:37 2022] POST /identity/v3/projects => generated 389 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:18:37.237087 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7742d476-1b53-4333-be27-bb451366afeb admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:18:37.249400 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7742d476-1b53-4333-be27-bb451366afeb admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:18:37.335098 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebae66ae-e192-42fc-bd33-0bf3df59bb0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:18:37.336120 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebae66ae-e192-42fc-bd33-0bf3df59bb0b admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:18:37.336410 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebae66ae-e192-42fc-bd33-0bf3df59bb0b admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:18:37.336771 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebae66ae-e192-42fc-bd33-0bf3df59bb0b admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:18:37.337499 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebae66ae-e192-42fc-bd33-0bf3df59bb0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:18:37.339497 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebae66ae-e192-42fc-bd33-0bf3df59bb0b admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:18:37.384834 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1416/2832] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:18:37 2022] POST /identity/v3/users => generated 295 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:18:37.386126 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfcb91f-9a98-4929-a47d-6ab33f238378 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:18:37.398958 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfcb91f-9a98-4929-a47d-6ab33f238378 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:18:37.414973 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abd5c01-984b-4695-a070-36a4ac195a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:18:37.415904 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abd5c01-984b-4695-a070-36a4ac195a4f admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:18:37.416532 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abd5c01-984b-4695-a070-36a4ac195a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:18:37.416800 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abd5c01-984b-4695-a070-36a4ac195a4f admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:18:37.417922 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abd5c01-984b-4695-a070-36a4ac195a4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:18:37.419639 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abd5c01-984b-4695-a070-36a4ac195a4f admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:18:37.448684 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1417/2833] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:18:37 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:18:37.449948 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebae66ae-e192-42fc-bd33-0bf3df59bb0b admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:18:37.463256 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebae66ae-e192-42fc-bd33-0bf3df59bb0b admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:18:37.477732 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65d9cb3-b717-4848-8def-20a9ead98bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:18:37.478780 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65d9cb3-b717-4848-8def-20a9ead98bcf admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:18:37.479063 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65d9cb3-b717-4848-8def-20a9ead98bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:18:37.479334 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65d9cb3-b717-4848-8def-20a9ead98bcf admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:18:37.480072 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65d9cb3-b717-4848-8def-20a9ead98bcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:18:37.481710 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65d9cb3-b717-4848-8def-20a9ead98bcf admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:18:37.523491 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1417/2834] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:18:37 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 21:18:37.524727 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abd5c01-984b-4695-a070-36a4ac195a4f admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:18:37.543685 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abd5c01-984b-4695-a070-36a4ac195a4f admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:18:37.553286 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d84f4d3-f4cf-4781-8195-0f6df46dcc82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:18:37.554424 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d84f4d3-f4cf-4781-8195-0f6df46dcc82 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:18:37.554711 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d84f4d3-f4cf-4781-8195-0f6df46dcc82 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:18:37.555020 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d84f4d3-f4cf-4781-8195-0f6df46dcc82 admin admin] PATH_INFO: `/v3/projects/31c41ae7265a4a629521b546a7231319/users/7578019c30174bc888279bf5009c0f4b/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:18:37.590358 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d84f4d3-f4cf-4781-8195-0f6df46dcc82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31c41ae7265a4a629521b546a7231319, user_id=7578019c30174bc888279bf5009c0f4b, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:18:37.593092 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d84f4d3-f4cf-4781-8195-0f6df46dcc82 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:18:37.641928 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1418/2835] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:18:37 2022] PUT /identity/v3/projects/31c41ae7265a4a629521b546a7231319/users/7578019c30174bc888279bf5009c0f4b/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:18:37.647319 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d06f63a-a6d0-479c-94e8-6dead1d27af3 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:18:37.647655 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d06f63a-a6d0-479c-94e8-6dead1d27af3 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:18:37.647994 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d06f63a-a6d0-479c-94e8-6dead1d27af3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:18:37.696643 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-7d06f63a-a6d0-479c-94e8-6dead1d27af3 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:18:37.698541 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-7d06f63a-a6d0-479c-94e8-6dead1d27af3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:18:37.751795 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:18:37.858436 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1418/2836] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:18:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:18:37.869197 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d84f4d3-f4cf-4781-8195-0f6df46dcc82 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:18:37.871434 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-9d84f4d3-f4cf-4781-8195-0f6df46dcc82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:18:38.086436 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d84f4d3-f4cf-4781-8195-0f6df46dcc82 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:18:38.100800 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0adeb1a-0a92-4a99-b197-24204195bd9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:18:38.104643 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0adeb1a-0a92-4a99-b197-24204195bd9d service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:18:38.104909 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0adeb1a-0a92-4a99-b197-24204195bd9d service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:18:38.107436 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0adeb1a-0a92-4a99-b197-24204195bd9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:18:38.137646 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0adeb1a-0a92-4a99-b197-24204195bd9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:18:38.140465 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0adeb1a-0a92-4a99-b197-24204195bd9d service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:18:38.173933 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1419/2837] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:18:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:18:38.947967 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea27316-0767-40d7-b617-0cbe4dfd93a0 None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:18:38.948517 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea27316-0767-40d7-b617-0cbe4dfd93a0 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:18:38.948982 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea27316-0767-40d7-b617-0cbe4dfd93a0 None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:18:38.950620 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1419/2838] 10.222.0.17 () {54 vars in 921 bytes} [Sat Jul 23 21:18:38 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 23 21:18:38.956623 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d60d5af-0295-464b-9afb-4345e1e71115 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:18:38.957143 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d60d5af-0295-464b-9afb-4345e1e71115 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:18:38.957242 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d60d5af-0295-464b-9afb-4345e1e71115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:18:39.007577 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-8d60d5af-0295-464b-9afb-4345e1e71115 None None] MFA Rules not processed for user `abc719a3b3ac4461b82ca04ab6451d81`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:18:39.008927 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-8d60d5af-0295-464b-9afb-4345e1e71115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:18:39.212630 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1420/2839] 10.222.0.17 () {58 vars in 1018 bytes} [Sat Jul 23 21:18:38 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:18:39.263303 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea27316-0767-40d7-b617-0cbe4dfd93a0 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:18:39.267217 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-6ea27316-0767-40d7-b617-0cbe4dfd93a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:18:39.302311 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea27316-0767-40d7-b617-0cbe4dfd93a0 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:18:39.342137 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b513f436-c805-4d4b-9dfc-1fcf1b4576c5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc719a3b3ac4461b82ca04ab6451d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:18:39.342908 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b513f436-c805-4d4b-9dfc-1fcf1b4576c5 service placement] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:18:39.343190 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b513f436-c805-4d4b-9dfc-1fcf1b4576c5 service placement] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:18:39.344615 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b513f436-c805-4d4b-9dfc-1fcf1b4576c5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:18:39.377134 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b513f436-c805-4d4b-9dfc-1fcf1b4576c5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:18:39.378778 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b513f436-c805-4d4b-9dfc-1fcf1b4576c5 service placement] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:18:39.400688 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1420/2840] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:18:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:18:40.279420 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d60d5af-0295-464b-9afb-4345e1e71115 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:18:40.303033 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d60d5af-0295-464b-9afb-4345e1e71115 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:18:40.313792 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58623d1-3cbc-4cd7-b7f9-b8af2a8a5d8f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc719a3b3ac4461b82ca04ab6451d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:18:40.315311 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58623d1-3cbc-4cd7-b7f9-b8af2a8a5d8f service placement] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:18:40.315846 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58623d1-3cbc-4cd7-b7f9-b8af2a8a5d8f service placement] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:18:40.316347 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58623d1-3cbc-4cd7-b7f9-b8af2a8a5d8f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:18:40.318834 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-c58623d1-3cbc-4cd7-b7f9-b8af2a8a5d8f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:18:40.355654 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58623d1-3cbc-4cd7-b7f9-b8af2a8a5d8f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:18:40.358427 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58623d1-3cbc-4cd7-b7f9-b8af2a8a5d8f service placement] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:18:40.399504 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1421/2841] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:18:40 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:18:44.414972 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb66e00-d334-45ea-b08f-2d74526e80e0 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:18:44.420423 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb66e00-d334-45ea-b08f-2d74526e80e0 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:18:44.422312 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb66e00-d334-45ea-b08f-2d74526e80e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:18:44.474352 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-3eb66e00-d334-45ea-b08f-2d74526e80e0 None None] MFA Rules not processed for user `145e518288ce4d70a12a3f2cc6a91810`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:18:44.475720 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-3eb66e00-d334-45ea-b08f-2d74526e80e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:18:44.648140 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1421/2842] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:18:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:18:44.649978 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58623d1-3cbc-4cd7-b7f9-b8af2a8a5d8f service placement] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:18:44.652279 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-c58623d1-3cbc-4cd7-b7f9-b8af2a8a5d8f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:18:44.700275 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58623d1-3cbc-4cd7-b7f9-b8af2a8a5d8f service placement] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:18:44.717381 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e115f97-af1e-432e-8b17-7cec174ebb9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:18:44.725223 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e115f97-af1e-432e-8b17-7cec174ebb9d admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:18:44.725223 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e115f97-af1e-432e-8b17-7cec174ebb9d admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:18:44.725223 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e115f97-af1e-432e-8b17-7cec174ebb9d admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:18:44.726058 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e115f97-af1e-432e-8b17-7cec174ebb9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:18:44.738381 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e115f97-af1e-432e-8b17-7cec174ebb9d admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:18:44.818654 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1422/2843] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:18:44 2022] POST /identity/v3/projects => generated 385 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:18:44.822625 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb66e00-d334-45ea-b08f-2d74526e80e0 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:18:44.836369 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb66e00-d334-45ea-b08f-2d74526e80e0 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:18:45.030032 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f53f9a-0078-41a6-b3da-0744ed9d65ba None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:18:45.030340 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f53f9a-0078-41a6-b3da-0744ed9d65ba None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:18:45.030626 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f53f9a-0078-41a6-b3da-0744ed9d65ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:18:45.085451 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:18:45.096739 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-d6f53f9a-0078-41a6-b3da-0744ed9d65ba None None] MFA Rules not processed for user `17b779a3e21a415bb42cde5d6863d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:18:45.098699 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-d6f53f9a-0078-41a6-b3da-0744ed9d65ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:18:45.112217 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b00ef06-cecb-46ee-aab6-d237e216a8c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:18:45.113118 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b00ef06-cecb-46ee-aab6-d237e216a8c4 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:18:45.113402 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b00ef06-cecb-46ee-aab6-d237e216a8c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:18:45.115252 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b00ef06-cecb-46ee-aab6-d237e216a8c4 admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:18:45.116493 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b00ef06-cecb-46ee-aab6-d237e216a8c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:18:45.120836 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b00ef06-cecb-46ee-aab6-d237e216a8c4 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:18:45.183617 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1422/2844] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:18:44 2022] POST /identity/v3/users => generated 299 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:18:45.185494 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b00ef06-cecb-46ee-aab6-d237e216a8c4 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:18:45.227864 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b00ef06-cecb-46ee-aab6-d237e216a8c4 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:18:45.264513 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f414ec-474f-4d82-8ffb-61107efd3665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:18:45.265243 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f414ec-474f-4d82-8ffb-61107efd3665 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:18:45.265527 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f414ec-474f-4d82-8ffb-61107efd3665 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:18:45.265800 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f414ec-474f-4d82-8ffb-61107efd3665 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:18:45.272092 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f414ec-474f-4d82-8ffb-61107efd3665 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:18:45.275244 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f414ec-474f-4d82-8ffb-61107efd3665 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:18:45.282860 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1423/2845] 10.222.0.17 () {58 vars in 1009 bytes} [Sat Jul 23 21:18:45 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:18:45.299442 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f53f9a-0078-41a6-b3da-0744ed9d65ba None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:18:45.301508 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-d6f53f9a-0078-41a6-b3da-0744ed9d65ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:18:45.317111 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1423/2846] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:18:45 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:18:45.318896 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f414ec-474f-4d82-8ffb-61107efd3665 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:18:45.345709 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f414ec-474f-4d82-8ffb-61107efd3665 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:18:45.350948 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ad0928-f1cd-41b4-9e85-654fd5dcb30f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:18:45.351862 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ad0928-f1cd-41b4-9e85-654fd5dcb30f admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:18:45.352144 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ad0928-f1cd-41b4-9e85-654fd5dcb30f admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:18:45.352423 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ad0928-f1cd-41b4-9e85-654fd5dcb30f admin admin] PATH_INFO: `/v3/projects/2a1692e025cd466cb532b1caa78fa196/users/460eb04964224ed0a414d2fde153a26a/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:18:45.371362 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ad0928-f1cd-41b4-9e85-654fd5dcb30f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a1692e025cd466cb532b1caa78fa196, user_id=460eb04964224ed0a414d2fde153a26a, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:18:45.374117 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ad0928-f1cd-41b4-9e85-654fd5dcb30f admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:18:45.378373 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:18:45.410053 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1424/2847] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:18:45 2022] PUT /identity/v3/projects/2a1692e025cd466cb532b1caa78fa196/users/460eb04964224ed0a414d2fde153a26a/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:18:45.439319 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ad0928-f1cd-41b4-9e85-654fd5dcb30f admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:18:45.530434 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f53f9a-0078-41a6-b3da-0744ed9d65ba None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:18:45.619841 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ad0928-f1cd-41b4-9e85-654fd5dcb30f admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:18:45.633750 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcebb5a-966e-4155-8c34-e27a0554fa70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:18:45.634487 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcebb5a-966e-4155-8c34-e27a0554fa70 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:18:45.634771 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcebb5a-966e-4155-8c34-e27a0554fa70 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:18:45.635047 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcebb5a-966e-4155-8c34-e27a0554fa70 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:18:45.635787 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcebb5a-966e-4155-8c34-e27a0554fa70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:18:45.637429 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcebb5a-966e-4155-8c34-e27a0554fa70 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:18:45.679621 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1425/2848] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:18:45 2022] GET /identity/v3/roles => generated 1420 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:18:45.687372 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcebb5a-966e-4155-8c34-e27a0554fa70 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:18:45.700271 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85eefaf-593c-4787-ad48-08809be40486 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f0a685b7da46afb81024848f079d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:18:45.701681 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85eefaf-593c-4787-ad48-08809be40486 service swift] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:18:45.702302 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85eefaf-593c-4787-ad48-08809be40486 service swift] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:18:45.703587 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85eefaf-593c-4787-ad48-08809be40486 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:18:45.722552 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcebb5a-966e-4155-8c34-e27a0554fa70 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:18:45.739625 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2932048-e8e1-4f10-809b-4535be48bfae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:18:45.743374 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2932048-e8e1-4f10-809b-4535be48bfae admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:18:45.743669 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2932048-e8e1-4f10-809b-4535be48bfae admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:18:45.743954 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2932048-e8e1-4f10-809b-4535be48bfae admin admin] PATH_INFO: `/v3/projects/2a1692e025cd466cb532b1caa78fa196/users/460eb04964224ed0a414d2fde153a26a/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:18:45.751596 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2932048-e8e1-4f10-809b-4535be48bfae admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a1692e025cd466cb532b1caa78fa196, user_id=460eb04964224ed0a414d2fde153a26a, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:18:45.780361 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2932048-e8e1-4f10-809b-4535be48bfae admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:18:45.807054 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1426/2849] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:18:45 2022] PUT /identity/v3/projects/2a1692e025cd466cb532b1caa78fa196/users/460eb04964224ed0a414d2fde153a26a/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:18:45.891413 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:18:45.900054 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85eefaf-593c-4787-ad48-08809be40486 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:18:45.902362 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85eefaf-593c-4787-ad48-08809be40486 service swift] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:18:45.944227 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1424/2850] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 23 21:18:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 645 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 23 21:18:51.752289 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a26885e-fa9b-40b5-bd14-9367cc94babd None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:18:51.754358 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a26885e-fa9b-40b5-bd14-9367cc94babd None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:18:51.754825 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a26885e-fa9b-40b5-bd14-9367cc94babd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:18:51.834423 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-1a26885e-fa9b-40b5-bd14-9367cc94babd None None] MFA Rules not processed for user `7578019c30174bc888279bf5009c0f4b`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:18:51.835670 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-1a26885e-fa9b-40b5-bd14-9367cc94babd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:18:52.145976 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1427/2851] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:18:51 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 395 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:18:52.152867 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85eefaf-593c-4787-ad48-08809be40486 service swift] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:18:52.189522 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85eefaf-593c-4787-ad48-08809be40486 service swift] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:18:52.265904 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a42008-4a8e-4c26-9c87-cc87ecb3218b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:18:52.266945 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a42008-4a8e-4c26-9c87-cc87ecb3218b admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:18:52.267414 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a42008-4a8e-4c26-9c87-cc87ecb3218b admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:18:52.267869 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a42008-4a8e-4c26-9c87-cc87ecb3218b admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:18:52.268771 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a42008-4a8e-4c26-9c87-cc87ecb3218b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:18:52.271030 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a42008-4a8e-4c26-9c87-cc87ecb3218b admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:18:52.323112 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a26885e-fa9b-40b5-bd14-9367cc94babd None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:18:52.333194 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1425/2852] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:18:52 2022] POST /identity/v3/projects => generated 387 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:18:52.340887 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a26885e-fa9b-40b5-bd14-9367cc94babd None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:18:52.436377 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eacb8d-b286-4ebb-9157-bda8299b4922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:18:52.436377 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eacb8d-b286-4ebb-9157-bda8299b4922 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:18:52.436377 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eacb8d-b286-4ebb-9157-bda8299b4922 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:18:52.436849 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eacb8d-b286-4ebb-9157-bda8299b4922 admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:18:52.438727 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4eacb8d-b286-4ebb-9157-bda8299b4922 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:18:52.439846 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4eacb8d-b286-4ebb-9157-bda8299b4922 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:18:52.500977 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:18:52.510046 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1428/2853] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:18:52 2022] POST /identity/v3/users => generated 300 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:18:52.520723 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a42008-4a8e-4c26-9c87-cc87ecb3218b admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:18:52.546742 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a42008-4a8e-4c26-9c87-cc87ecb3218b admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:18:52.554559 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbfd015-a5ec-421c-ae50-66110f069bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:18:52.555640 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbfd015-a5ec-421c-ae50-66110f069bcd admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:18:52.556420 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbfd015-a5ec-421c-ae50-66110f069bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:18:52.556951 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbfd015-a5ec-421c-ae50-66110f069bcd admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:18:52.557997 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbfd015-a5ec-421c-ae50-66110f069bcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:18:52.560080 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbfd015-a5ec-421c-ae50-66110f069bcd admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:18:52.605586 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1426/2854] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:18:52 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:18:52.609820 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eacb8d-b286-4ebb-9157-bda8299b4922 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:18:52.648171 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eacb8d-b286-4ebb-9157-bda8299b4922 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:18:52.656553 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02665da-53e8-4943-b84b-5e84c4c853cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:18:52.658184 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02665da-53e8-4943-b84b-5e84c4c853cc admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:18:52.658717 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02665da-53e8-4943-b84b-5e84c4c853cc admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:18:52.659321 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02665da-53e8-4943-b84b-5e84c4c853cc admin admin] PATH_INFO: `/v3/projects/dfd64c2641fa4a50aa8a20b28499c9bd/users/3f189667b4fb48b28d450ebfb44a961b/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:18:52.684880 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02665da-53e8-4943-b84b-5e84c4c853cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfd64c2641fa4a50aa8a20b28499c9bd, user_id=3f189667b4fb48b28d450ebfb44a961b, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:18:52.688947 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02665da-53e8-4943-b84b-5e84c4c853cc admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:18:52.728915 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1429/2855] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:18:52 2022] PUT /identity/v3/projects/dfd64c2641fa4a50aa8a20b28499c9bd/users/3f189667b4fb48b28d450ebfb44a961b/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:18:52.732698 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbfd015-a5ec-421c-ae50-66110f069bcd admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:18:52.757975 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbfd015-a5ec-421c-ae50-66110f069bcd admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:18:52.877927 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d98a3d1-ead7-404c-895d-52642c9a6055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:18:52.878873 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d98a3d1-ead7-404c-895d-52642c9a6055 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:18:52.879158 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d98a3d1-ead7-404c-895d-52642c9a6055 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:18:52.879465 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d98a3d1-ead7-404c-895d-52642c9a6055 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:18:52.882777 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d98a3d1-ead7-404c-895d-52642c9a6055 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:18:52.888082 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d98a3d1-ead7-404c-895d-52642c9a6055 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:18:52.913111 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1427/2856] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:18:52 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:18:52.918069 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02665da-53e8-4943-b84b-5e84c4c853cc admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:18:52.941492 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02665da-53e8-4943-b84b-5e84c4c853cc admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:18:52.952444 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57f469d-e08b-48b0-a65d-13aa3ed17b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:18:52.957880 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57f469d-e08b-48b0-a65d-13aa3ed17b8e admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:18:52.958405 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57f469d-e08b-48b0-a65d-13aa3ed17b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:18:52.959393 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57f469d-e08b-48b0-a65d-13aa3ed17b8e admin admin] PATH_INFO: `/v3/projects/dfd64c2641fa4a50aa8a20b28499c9bd/users/3f189667b4fb48b28d450ebfb44a961b/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:18:52.966561 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57f469d-e08b-48b0-a65d-13aa3ed17b8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfd64c2641fa4a50aa8a20b28499c9bd, user_id=3f189667b4fb48b28d450ebfb44a961b, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:18:52.973636 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57f469d-e08b-48b0-a65d-13aa3ed17b8e admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:18:53.013315 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1430/2857] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:18:52 2022] PUT /identity/v3/projects/dfd64c2641fa4a50aa8a20b28499c9bd/users/3f189667b4fb48b28d450ebfb44a961b/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:18:57.588727 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d98a3d1-ead7-404c-895d-52642c9a6055 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:18:57.591640 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-2d98a3d1-ead7-404c-895d-52642c9a6055 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:18:57.631077 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d98a3d1-ead7-404c-895d-52642c9a6055 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:18:57.876702 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f17b9f1-749f-4417-a644-723a09abcfd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:18:57.883877 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f17b9f1-749f-4417-a644-723a09abcfd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:18:57.885032 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f17b9f1-749f-4417-a644-723a09abcfd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:18:57.885567 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f17b9f1-749f-4417-a644-723a09abcfd6 admin admin] PATH_INFO: `/v3/users/19256ba5522c45b08105e1a3ba27df43` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:18:57.892076 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f17b9f1-749f-4417-a644-723a09abcfd6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19256ba5522c45b08105e1a3ba27df43)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:18:57.898699 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f17b9f1-749f-4417-a644-723a09abcfd6 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:18:57.907880 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:18:58.057560 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-1f17b9f1-749f-4417-a644-723a09abcfd6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19256ba5522c45b08105e1a3ba27df43'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:18:58.072052 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-1f17b9f1-749f-4417-a644-723a09abcfd6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19256ba5522c45b08105e1a3ba27df43'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:18:58.073030 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-1f17b9f1-749f-4417-a644-723a09abcfd6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19256ba5522c45b08105e1a3ba27df43'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:18:58.089002 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-1f17b9f1-749f-4417-a644-723a09abcfd6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19256ba5522c45b08105e1a3ba27df43'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:18:58.114785 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-1f17b9f1-749f-4417-a644-723a09abcfd6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19256ba5522c45b08105e1a3ba27df43'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:18:58.122057 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1428/2858] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:18:57 2022] DELETE /identity/v3/users/19256ba5522c45b08105e1a3ba27df43 => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:18:58.558719 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57f469d-e08b-48b0-a65d-13aa3ed17b8e admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:18:58.560525 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-d57f469d-e08b-48b0-a65d-13aa3ed17b8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:18:58.595198 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57f469d-e08b-48b0-a65d-13aa3ed17b8e admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:18:58.756301 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b89282-cff0-48d1-bb89-40082ee85989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:18:58.757494 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b89282-cff0-48d1-bb89-40082ee85989 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:18:58.758052 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b89282-cff0-48d1-bb89-40082ee85989 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:18:58.758524 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b89282-cff0-48d1-bb89-40082ee85989 admin admin] PATH_INFO: `/v3/projects/900d0effd2b34f91996a850b1d1b3aef` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:18:58.760779 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b89282-cff0-48d1-bb89-40082ee85989 admin admin] RBAC: Authorizing `identity:delete_project(project_id=900d0effd2b34f91996a850b1d1b3aef)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:18:58.766767 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b89282-cff0-48d1-bb89-40082ee85989 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:18:58.923764 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-08b89282-cff0-48d1-bb89-40082ee85989 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '900d0effd2b34f91996a850b1d1b3aef', 'request_id': 'req-08b89282-cff0-48d1-bb89-40082ee85989'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:18:58.959721 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-08b89282-cff0-48d1-bb89-40082ee85989 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '900d0effd2b34f91996a850b1d1b3aef', 'request_id': 'req-08b89282-cff0-48d1-bb89-40082ee85989'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:18:58.979858 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-08b89282-cff0-48d1-bb89-40082ee85989 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '900d0effd2b34f91996a850b1d1b3aef', 'request_id': 'req-08b89282-cff0-48d1-bb89-40082ee85989'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:18:59.011013 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-08b89282-cff0-48d1-bb89-40082ee85989 admin admin] The token cache is being invalidate because project 900d0effd2b34f91996a850b1d1b3aef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:18:59.011145 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-08b89282-cff0-48d1-bb89-40082ee85989 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:18:59.016133 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-08b89282-cff0-48d1-bb89-40082ee85989 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:18:59.019251 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1431/2859] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:18:58 2022] DELETE /identity/v3/projects/900d0effd2b34f91996a850b1d1b3aef => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:18:59.023629 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f17b9f1-749f-4417-a644-723a09abcfd6 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:18:59.035457 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f17b9f1-749f-4417-a644-723a09abcfd6 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:18:59.328831 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3212fe-c76a-4e6b-a61d-349225edc551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:18:59.330452 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3212fe-c76a-4e6b-a61d-349225edc551 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:18:59.330733 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3212fe-c76a-4e6b-a61d-349225edc551 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:18:59.340310 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3212fe-c76a-4e6b-a61d-349225edc551 admin admin] PATH_INFO: `/v3/users/0d971eabc83648d28300e14eb7df72c9` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:18:59.343030 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3212fe-c76a-4e6b-a61d-349225edc551 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d971eabc83648d28300e14eb7df72c9)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:18:59.348773 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3212fe-c76a-4e6b-a61d-349225edc551 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:18:59.522277 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-9c3212fe-c76a-4e6b-a61d-349225edc551 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d971eabc83648d28300e14eb7df72c9'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:18:59.552070 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-9c3212fe-c76a-4e6b-a61d-349225edc551 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d971eabc83648d28300e14eb7df72c9'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:18:59.556004 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-9c3212fe-c76a-4e6b-a61d-349225edc551 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d971eabc83648d28300e14eb7df72c9'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:18:59.578922 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-9c3212fe-c76a-4e6b-a61d-349225edc551 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d971eabc83648d28300e14eb7df72c9'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:18:59.609697 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-9c3212fe-c76a-4e6b-a61d-349225edc551 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d971eabc83648d28300e14eb7df72c9'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:18:59.634977 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1429/2860] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:18:59 2022] DELETE /identity/v3/users/0d971eabc83648d28300e14eb7df72c9 => generated 0 bytes in 610 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:19:00.670650 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b89282-cff0-48d1-bb89-40082ee85989 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:19:00.672237 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-08b89282-cff0-48d1-bb89-40082ee85989 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:19:00.693391 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b89282-cff0-48d1-bb89-40082ee85989 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:19:00.813116 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:19:00.843858 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63b3d51-0a7f-4f56-bb1d-bb060c58a931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:19:00.845834 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63b3d51-0a7f-4f56-bb1d-bb060c58a931 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:00.846927 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63b3d51-0a7f-4f56-bb1d-bb060c58a931 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:00.847299 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63b3d51-0a7f-4f56-bb1d-bb060c58a931 admin admin] PATH_INFO: `/v3/projects/8b5400a74faf4b2bb54c28555a62b11e` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:00.848579 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63b3d51-0a7f-4f56-bb1d-bb060c58a931 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b5400a74faf4b2bb54c28555a62b11e)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:19:00.850765 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63b3d51-0a7f-4f56-bb1d-bb060c58a931 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:19:00.912568 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3212fe-c76a-4e6b-a61d-349225edc551 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:19:00.915592 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-9c3212fe-c76a-4e6b-a61d-349225edc551 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:19:00.925791 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:19:00.961493 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-d63b3d51-0a7f-4f56-bb1d-bb060c58a931 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b5400a74faf4b2bb54c28555a62b11e', 'request_id': 'req-d63b3d51-0a7f-4f56-bb1d-bb060c58a931'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:19:00.978177 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-d63b3d51-0a7f-4f56-bb1d-bb060c58a931 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b5400a74faf4b2bb54c28555a62b11e', 'request_id': 'req-d63b3d51-0a7f-4f56-bb1d-bb060c58a931'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:19:00.986318 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-d63b3d51-0a7f-4f56-bb1d-bb060c58a931 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b5400a74faf4b2bb54c28555a62b11e', 'request_id': 'req-d63b3d51-0a7f-4f56-bb1d-bb060c58a931'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:19:01.012929 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-d63b3d51-0a7f-4f56-bb1d-bb060c58a931 admin admin] The token cache is being invalidate because project 8b5400a74faf4b2bb54c28555a62b11e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:19:01.018700 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-d63b3d51-0a7f-4f56-bb1d-bb060c58a931 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:19:01.019908 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-d63b3d51-0a7f-4f56-bb1d-bb060c58a931 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:19:01.025317 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1432/2861] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:19:00 2022] DELETE /identity/v3/projects/8b5400a74faf4b2bb54c28555a62b11e => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:19:01.027228 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a6c68e-eec6-4c52-9152-aa8885d04107 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:01.027811 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a6c68e-eec6-4c52-9152-aa8885d04107 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:01.028293 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a6c68e-eec6-4c52-9152-aa8885d04107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:01.056940 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-13a6c68e-eec6-4c52-9152-aa8885d04107 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:19:01.062044 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-13a6c68e-eec6-4c52-9152-aa8885d04107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:19:01.086287 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3212fe-c76a-4e6b-a61d-349225edc551 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:19:01.189403 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c48c2b-d83d-44ba-b88e-aa5e27f62c71 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:19:01.191172 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c48c2b-d83d-44ba-b88e-aa5e27f62c71 service nova] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:01.191586 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c48c2b-d83d-44ba-b88e-aa5e27f62c71 service nova] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:01.192019 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c48c2b-d83d-44ba-b88e-aa5e27f62c71 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:01.194561 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-74c48c2b-d83d-44ba-b88e-aa5e27f62c71 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:19:01.229696 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1433/2862] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:19:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:19:01.243829 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ef3cd8-39dd-4db2-a8a0-63e9e01246e5 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:01.244268 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ef3cd8-39dd-4db2-a8a0-63e9e01246e5 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:01.244678 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ef3cd8-39dd-4db2-a8a0-63e9e01246e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:01.295018 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-30ef3cd8-39dd-4db2-a8a0-63e9e01246e5 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:19:01.296445 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-30ef3cd8-39dd-4db2-a8a0-63e9e01246e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:19:01.319131 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1434/2863] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:19:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:19:01.324923 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ef3cd8-39dd-4db2-a8a0-63e9e01246e5 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:19:01.348281 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ef3cd8-39dd-4db2-a8a0-63e9e01246e5 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:19:01.349372 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c48c2b-d83d-44ba-b88e-aa5e27f62c71 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:19:01.354899 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c48c2b-d83d-44ba-b88e-aa5e27f62c71 service nova] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:19:01.372890 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed4c5c2-01c8-4bf7-b89f-ed6a9143f71a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:19:01.374352 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed4c5c2-01c8-4bf7-b89f-ed6a9143f71a admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:01.375261 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed4c5c2-01c8-4bf7-b89f-ed6a9143f71a admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:01.379875 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed4c5c2-01c8-4bf7-b89f-ed6a9143f71a admin admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:01.379875 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed4c5c2-01c8-4bf7-b89f-ed6a9143f71a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:19:01.379875 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed4c5c2-01c8-4bf7-b89f-ed6a9143f71a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:19:01.384660 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed4c5c2-01c8-4bf7-b89f-ed6a9143f71a admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:19:01.399151 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1430/2864] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:19:00 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:19:01.420665 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1435/2865] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:19:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:19:01.420908 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c48c2b-d83d-44ba-b88e-aa5e27f62c71 service nova] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:19:01.450021 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c48c2b-d83d-44ba-b88e-aa5e27f62c71 service nova] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:19:01.483524 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0970070-05a1-47f6-be82-ab2cea9b0f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:19:01.504818 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0970070-05a1-47f6-be82-ab2cea9b0f9c admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:01.505153 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0970070-05a1-47f6-be82-ab2cea9b0f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:01.505396 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0970070-05a1-47f6-be82-ab2cea9b0f9c admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:01.506151 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0970070-05a1-47f6-be82-ab2cea9b0f9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:19:01.520941 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0970070-05a1-47f6-be82-ab2cea9b0f9c admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:19:01.578919 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1431/2866] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:19:01 2022] POST /identity/v3/projects => generated 359 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:19:01.580387 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed4c5c2-01c8-4bf7-b89f-ed6a9143f71a admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:19:01.599083 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed4c5c2-01c8-4bf7-b89f-ed6a9143f71a admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:19:01.727709 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb1066b-d587-44fb-a856-2cf01db331ed None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:01.728911 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb1066b-d587-44fb-a856-2cf01db331ed None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:01.729197 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb1066b-d587-44fb-a856-2cf01db331ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:01.810859 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-7cb1066b-d587-44fb-a856-2cf01db331ed None None] MFA Rules not processed for user `460eb04964224ed0a414d2fde153a26a`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:19:01.811952 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-7cb1066b-d587-44fb-a856-2cf01db331ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:19:01.821830 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:19:01.845766 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35db7a96-28a0-4059-bf53-9601e95fb671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:19:01.846693 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35db7a96-28a0-4059-bf53-9601e95fb671 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:01.846970 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35db7a96-28a0-4059-bf53-9601e95fb671 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:01.849119 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35db7a96-28a0-4059-bf53-9601e95fb671 admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:01.850419 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35db7a96-28a0-4059-bf53-9601e95fb671 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:19:01.856921 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35db7a96-28a0-4059-bf53-9601e95fb671 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:19:01.881766 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:19:01.915807 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1436/2867] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:19:01 2022] POST /identity/v3/users => generated 280 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:19:01.919584 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35db7a96-28a0-4059-bf53-9601e95fb671 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:19:01.940752 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35db7a96-28a0-4059-bf53-9601e95fb671 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:19:01.952685 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceabc2e-b5ee-49b5-9da8-cf7f992402c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:19:01.955921 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceabc2e-b5ee-49b5-9da8-cf7f992402c8 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:01.956336 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceabc2e-b5ee-49b5-9da8-cf7f992402c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:01.956698 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceabc2e-b5ee-49b5-9da8-cf7f992402c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:01.957703 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cceabc2e-b5ee-49b5-9da8-cf7f992402c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:19:01.962642 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cceabc2e-b5ee-49b5-9da8-cf7f992402c8 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:19:01.974303 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1432/2868] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:19:01 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:19:01.988535 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1437/2869] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:19:01 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 21:19:01.992294 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb1066b-d587-44fb-a856-2cf01db331ed None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:19:02.006833 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb1066b-d587-44fb-a856-2cf01db331ed None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:19:02.013479 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907f6a0f-5d42-4399-af56-5911cb2592a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:19:02.014482 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907f6a0f-5d42-4399-af56-5911cb2592a0 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:02.014951 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907f6a0f-5d42-4399-af56-5911cb2592a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:02.015383 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907f6a0f-5d42-4399-af56-5911cb2592a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:02.016344 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907f6a0f-5d42-4399-af56-5911cb2592a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:19:02.019619 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907f6a0f-5d42-4399-af56-5911cb2592a0 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:19:02.036124 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1433/2870] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:19:01 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:19:02.040971 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceabc2e-b5ee-49b5-9da8-cf7f992402c8 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:19:02.062252 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceabc2e-b5ee-49b5-9da8-cf7f992402c8 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:19:02.099872 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907f6a0f-5d42-4399-af56-5911cb2592a0 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:19:02.102528 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-907f6a0f-5d42-4399-af56-5911cb2592a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:19:02.112694 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b235590a-30af-4ce9-889b-18940855ded3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:19:02.113703 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b235590a-30af-4ce9-889b-18940855ded3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:02.114042 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b235590a-30af-4ce9-889b-18940855ded3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:02.119881 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b235590a-30af-4ce9-889b-18940855ded3 admin admin] PATH_INFO: `/v3/projects/65afd800770347c5a254918a8c390826/users/b489c55d46cf4396b0d68e81abb8b8ac/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:02.148527 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b235590a-30af-4ce9-889b-18940855ded3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65afd800770347c5a254918a8c390826, user_id=b489c55d46cf4396b0d68e81abb8b8ac, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:19:02.152938 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b235590a-30af-4ce9-889b-18940855ded3 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:19:02.199221 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1438/2871] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:19:02 2022] PUT /identity/v3/projects/65afd800770347c5a254918a8c390826/users/b489c55d46cf4396b0d68e81abb8b8ac/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:19:02.213079 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82990594-77f2-4719-b0d0-3a7975db7fb7 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:02.213298 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82990594-77f2-4719-b0d0-3a7975db7fb7 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:02.216980 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82990594-77f2-4719-b0d0-3a7975db7fb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:02.299127 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-82990594-77f2-4719-b0d0-3a7975db7fb7 None None] MFA Rules not processed for user `b489c55d46cf4396b0d68e81abb8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:19:02.300643 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-82990594-77f2-4719-b0d0-3a7975db7fb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:19:02.409377 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907f6a0f-5d42-4399-af56-5911cb2592a0 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:19:02.597204 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1439/2872] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:19:02 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 386 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:19:02.601184 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82990594-77f2-4719-b0d0-3a7975db7fb7 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:19:02.660361 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f30a9d-63f9-4b3d-b3fd-ad500ce271ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:19:02.661122 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f30a9d-63f9-4b3d-b3fd-ad500ce271ab service nova] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:02.661326 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f30a9d-63f9-4b3d-b3fd-ad500ce271ab service nova] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:02.661591 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f30a9d-63f9-4b3d-b3fd-ad500ce271ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:02.667427 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-18f30a9d-63f9-4b3d-b3fd-ad500ce271ab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:19:02.736398 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:19:02.825026 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f30a9d-63f9-4b3d-b3fd-ad500ce271ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:19:02.827646 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f30a9d-63f9-4b3d-b3fd-ad500ce271ab service nova] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:19:02.854319 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82990594-77f2-4719-b0d0-3a7975db7fb7 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:19:02.859799 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1434/2873] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:19:02 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 760 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:19:02.868507 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4052c62-3477-4e8c-ab81-f947bf7d2ba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:19:02.869269 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4052c62-3477-4e8c-ab81-f947bf7d2ba0 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:02.869550 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4052c62-3477-4e8c-ab81-f947bf7d2ba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:02.869827 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4052c62-3477-4e8c-ab81-f947bf7d2ba0 admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:02.870548 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4052c62-3477-4e8c-ab81-f947bf7d2ba0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:19:02.872902 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4052c62-3477-4e8c-ab81-f947bf7d2ba0 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:19:02.951774 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1440/2874] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:19:02 2022] POST /identity/v3/projects => generated 359 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:19:02.952950 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f30a9d-63f9-4b3d-b3fd-ad500ce271ab service nova] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:19:02.970894 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f30a9d-63f9-4b3d-b3fd-ad500ce271ab service nova] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:19:03.051224 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41997685-cd78-42c7-81eb-df09409e3a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:19:03.052166 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41997685-cd78-42c7-81eb-df09409e3a35 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:03.052557 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41997685-cd78-42c7-81eb-df09409e3a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:03.052947 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41997685-cd78-42c7-81eb-df09409e3a35 admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:03.053712 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41997685-cd78-42c7-81eb-df09409e3a35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:19:03.056596 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41997685-cd78-42c7-81eb-df09409e3a35 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:19:03.092614 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1435/2875] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:19:02 2022] POST /identity/v3/users => generated 286 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:19:03.096866 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4052c62-3477-4e8c-ab81-f947bf7d2ba0 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:19:03.131782 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4052c62-3477-4e8c-ab81-f947bf7d2ba0 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:19:03.151953 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870d60e3-3e40-4f5e-b993-37b5525a033a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:19:03.155713 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870d60e3-3e40-4f5e-b993-37b5525a033a admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:03.156235 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870d60e3-3e40-4f5e-b993-37b5525a033a admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:03.158334 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870d60e3-3e40-4f5e-b993-37b5525a033a admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:03.167229 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870d60e3-3e40-4f5e-b993-37b5525a033a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:19:03.170967 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870d60e3-3e40-4f5e-b993-37b5525a033a admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:19:03.214297 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1441/2876] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:19:03 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:19:03.215535 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41997685-cd78-42c7-81eb-df09409e3a35 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:19:03.232991 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41997685-cd78-42c7-81eb-df09409e3a35 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:19:03.245524 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d3338d-c52a-4ffa-91e8-45554d5a5ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:19:03.246935 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d3338d-c52a-4ffa-91e8-45554d5a5ec5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:03.246935 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d3338d-c52a-4ffa-91e8-45554d5a5ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:03.247118 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d3338d-c52a-4ffa-91e8-45554d5a5ec5 admin admin] PATH_INFO: `/v3/projects/d09928d042434257bafeabd2cb182cd0/users/5f312a14cdc649a09c692e785092a862/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:03.304031 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d3338d-c52a-4ffa-91e8-45554d5a5ec5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d09928d042434257bafeabd2cb182cd0, user_id=5f312a14cdc649a09c692e785092a862, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:19:03.308707 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d3338d-c52a-4ffa-91e8-45554d5a5ec5 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:19:03.346786 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1436/2877] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:19:03 2022] PUT /identity/v3/projects/d09928d042434257bafeabd2cb182cd0/users/5f312a14cdc649a09c692e785092a862/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:19:03.352005 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870d60e3-3e40-4f5e-b993-37b5525a033a admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:19:03.380200 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870d60e3-3e40-4f5e-b993-37b5525a033a admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:19:03.432789 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:19:03.527484 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e223786c-84f7-4f05-91a6-5f99a0cc4a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:19:03.528153 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e223786c-84f7-4f05-91a6-5f99a0cc4a0d admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:03.528434 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e223786c-84f7-4f05-91a6-5f99a0cc4a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:03.528707 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e223786c-84f7-4f05-91a6-5f99a0cc4a0d admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:03.530485 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e223786c-84f7-4f05-91a6-5f99a0cc4a0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:19:03.533032 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e223786c-84f7-4f05-91a6-5f99a0cc4a0d admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:19:03.591333 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1442/2878] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:19:03 2022] GET /identity/v3/roles => generated 1420 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:19:03.596876 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d3338d-c52a-4ffa-91e8-45554d5a5ec5 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:19:03.619808 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d3338d-c52a-4ffa-91e8-45554d5a5ec5 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:19:03.650865 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844f7755-642f-4c17-8381-613fbbdd3c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:19:03.652133 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844f7755-642f-4c17-8381-613fbbdd3c05 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:03.653760 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844f7755-642f-4c17-8381-613fbbdd3c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:03.655604 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844f7755-642f-4c17-8381-613fbbdd3c05 admin admin] PATH_INFO: `/v3/projects/d09928d042434257bafeabd2cb182cd0/users/5f312a14cdc649a09c692e785092a862/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:03.678198 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844f7755-642f-4c17-8381-613fbbdd3c05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d09928d042434257bafeabd2cb182cd0, user_id=5f312a14cdc649a09c692e785092a862, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:19:03.692791 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844f7755-642f-4c17-8381-613fbbdd3c05 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:19:03.745370 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1437/2879] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:19:03 2022] PUT /identity/v3/projects/d09928d042434257bafeabd2cb182cd0/users/5f312a14cdc649a09c692e785092a862/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:19:03.753850 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c45109-c945-4fed-a617-dd626b53c1be None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:03.754160 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c45109-c945-4fed-a617-dd626b53c1be None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:03.754499 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c45109-c945-4fed-a617-dd626b53c1be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:03.886430 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-d7c45109-c945-4fed-a617-dd626b53c1be None None] MFA Rules not processed for user `5f312a14cdc649a09c692e785092a862`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:19:03.890993 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-d7c45109-c945-4fed-a617-dd626b53c1be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:19:04.175733 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1443/2880] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:19:03 2022] POST /identity/v3/auth/tokens => generated 3293 bytes in 424 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:19:04.656723 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844f7755-642f-4c17-8381-613fbbdd3c05 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:19:04.879632 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844f7755-642f-4c17-8381-613fbbdd3c05 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:19:04.895669 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543c100d-290a-4290-a7de-772cbb663a82 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:19:04.896373 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543c100d-290a-4290-a7de-772cbb663a82 service nova] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:04.896673 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543c100d-290a-4290-a7de-772cbb663a82 service nova] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:04.896938 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543c100d-290a-4290-a7de-772cbb663a82 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:04.924801 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543c100d-290a-4290-a7de-772cbb663a82 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:19:04.926488 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543c100d-290a-4290-a7de-772cbb663a82 service nova] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:19:04.995517 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1438/2881] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:19:04 2022] GET /identity/v3/auth/tokens => generated 3293 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:19:07.345394 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c45109-c945-4fed-a617-dd626b53c1be None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:19:07.583750 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c45109-c945-4fed-a617-dd626b53c1be None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:19:07.606594 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba0062f-989f-416d-a88d-34d93f859b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:19:07.609467 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba0062f-989f-416d-a88d-34d93f859b67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:07.609752 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba0062f-989f-416d-a88d-34d93f859b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:07.610125 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba0062f-989f-416d-a88d-34d93f859b67 admin admin] PATH_INFO: `/v3/users/b489c55d46cf4396b0d68e81abb8b8ac` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:07.615465 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba0062f-989f-416d-a88d-34d93f859b67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b489c55d46cf4396b0d68e81abb8b8ac)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:19:07.619524 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba0062f-989f-416d-a88d-34d93f859b67 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:19:07.745307 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:19:07.749528 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-aba0062f-989f-416d-a88d-34d93f859b67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b489c55d46cf4396b0d68e81abb8b8ac'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:19:07.751058 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-aba0062f-989f-416d-a88d-34d93f859b67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b489c55d46cf4396b0d68e81abb8b8ac'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:19:07.792131 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-aba0062f-989f-416d-a88d-34d93f859b67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b489c55d46cf4396b0d68e81abb8b8ac'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:19:07.845161 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-aba0062f-989f-416d-a88d-34d93f859b67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b489c55d46cf4396b0d68e81abb8b8ac'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:19:07.876678 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-aba0062f-989f-416d-a88d-34d93f859b67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b489c55d46cf4396b0d68e81abb8b8ac'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:19:07.896984 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1444/2882] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:19:07 2022] DELETE /identity/v3/users/b489c55d46cf4396b0d68e81abb8b8ac => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:19:07.901924 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0084080d-5f33-4582-a40b-c0e626fff33a None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:07.903369 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0084080d-5f33-4582-a40b-c0e626fff33a None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:07.904004 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0084080d-5f33-4582-a40b-c0e626fff33a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:07.919704 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:19:07.980141 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-0084080d-5f33-4582-a40b-c0e626fff33a None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:19:07.985700 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-0084080d-5f33-4582-a40b-c0e626fff33a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:19:08.181303 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1439/2883] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:19:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:19:08.752083 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba0062f-989f-416d-a88d-34d93f859b67 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:19:08.754212 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-aba0062f-989f-416d-a88d-34d93f859b67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:19:08.766547 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0084080d-5f33-4582-a40b-c0e626fff33a None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:19:08.768506 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-0084080d-5f33-4582-a40b-c0e626fff33a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:19:09.047756 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba0062f-989f-416d-a88d-34d93f859b67 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:19:09.051837 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcf2e05-ca44-47cd-b142-c401964dc294 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:19:09.055219 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcf2e05-ca44-47cd-b142-c401964dc294 service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:09.055711 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcf2e05-ca44-47cd-b142-c401964dc294 service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:09.056145 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcf2e05-ca44-47cd-b142-c401964dc294 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:09.060222 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-2bcf2e05-ca44-47cd-b142-c401964dc294 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:19:09.108663 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0084080d-5f33-4582-a40b-c0e626fff33a None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:19:09.162764 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192d0db3-c889-4ccd-8dea-d5489dc67c7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:19:09.171892 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192d0db3-c889-4ccd-8dea-d5489dc67c7c service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:09.172532 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192d0db3-c889-4ccd-8dea-d5489dc67c7c service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:09.172817 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192d0db3-c889-4ccd-8dea-d5489dc67c7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:09.182333 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-192d0db3-c889-4ccd-8dea-d5489dc67c7c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:19:09.239372 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcf2e05-ca44-47cd-b142-c401964dc294 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:19:09.240858 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcf2e05-ca44-47cd-b142-c401964dc294 service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:19:09.254260 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192d0db3-c889-4ccd-8dea-d5489dc67c7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:19:09.255328 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192d0db3-c889-4ccd-8dea-d5489dc67c7c service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:19:09.281817 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1445/2884] 10.222.0.17 () {60 vars in 1396 bytes} [Sat Jul 23 21:19:08 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3236 bytes in 530 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:19:09.282432 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcf2e05-ca44-47cd-b142-c401964dc294 service neutron] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:19:09.293283 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-2bcf2e05-ca44-47cd-b142-c401964dc294 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:19:09.306244 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1440/2885] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:19:08 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 540 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 23 21:19:09.328138 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcf2e05-ca44-47cd-b142-c401964dc294 service neutron] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:19:09.342071 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9256c0a-ca79-4bc1-a4fd-7445dffc5daf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:19:09.346964 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9256c0a-ca79-4bc1-a4fd-7445dffc5daf service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:09.347259 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9256c0a-ca79-4bc1-a4fd-7445dffc5daf service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:09.347547 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9256c0a-ca79-4bc1-a4fd-7445dffc5daf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:09.432190 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9256c0a-ca79-4bc1-a4fd-7445dffc5daf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:19:09.445023 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9256c0a-ca79-4bc1-a4fd-7445dffc5daf service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:19:09.512566 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1446/2886] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:19:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:19:09.891773 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192d0db3-c889-4ccd-8dea-d5489dc67c7c service neutron] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:19:09.893227 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-192d0db3-c889-4ccd-8dea-d5489dc67c7c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:19:10.245411 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192d0db3-c889-4ccd-8dea-d5489dc67c7c service neutron] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:19:10.280022 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c074c3-3a53-4ffe-8434-ccca6e06f5d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:19:10.280711 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c074c3-3a53-4ffe-8434-ccca6e06f5d8 service nova] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:10.284984 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c074c3-3a53-4ffe-8434-ccca6e06f5d8 service nova] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:10.287118 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c074c3-3a53-4ffe-8434-ccca6e06f5d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:10.302829 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-91c074c3-3a53-4ffe-8434-ccca6e06f5d8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:19:10.348770 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c074c3-3a53-4ffe-8434-ccca6e06f5d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:19:10.353508 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c074c3-3a53-4ffe-8434-ccca6e06f5d8 service nova] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:19:10.380258 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1441/2887] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:19:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:19:11.254640 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9256c0a-ca79-4bc1-a4fd-7445dffc5daf service neutron] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:19:11.256683 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-e9256c0a-ca79-4bc1-a4fd-7445dffc5daf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:19:11.296806 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9256c0a-ca79-4bc1-a4fd-7445dffc5daf service neutron] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:19:11.319927 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc13076-96f4-4bb9-bea6-78b529816c71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:19:11.321642 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc13076-96f4-4bb9-bea6-78b529816c71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:11.322284 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc13076-96f4-4bb9-bea6-78b529816c71 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:11.323687 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc13076-96f4-4bb9-bea6-78b529816c71 admin admin] PATH_INFO: `/v3/projects/65afd800770347c5a254918a8c390826` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:11.326745 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc13076-96f4-4bb9-bea6-78b529816c71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=65afd800770347c5a254918a8c390826)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:19:11.326934 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c074c3-3a53-4ffe-8434-ccca6e06f5d8 service nova] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:19:11.338179 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc13076-96f4-4bb9-bea6-78b529816c71 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:19:11.338598 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c074c3-3a53-4ffe-8434-ccca6e06f5d8 service nova] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:19:11.353831 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a265300-72b4-492a-9816-d52b9d742908 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:19:11.357679 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a265300-72b4-492a-9816-d52b9d742908 service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:11.360540 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a265300-72b4-492a-9816-d52b9d742908 service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:11.362210 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a265300-72b4-492a-9816-d52b9d742908 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:11.369555 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-7a265300-72b4-492a-9816-d52b9d742908 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:19:11.435020 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a265300-72b4-492a-9816-d52b9d742908 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:19:11.438575 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a265300-72b4-492a-9816-d52b9d742908 service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:19:11.479345 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-bdc13076-96f4-4bb9-bea6-78b529816c71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65afd800770347c5a254918a8c390826', 'request_id': 'req-bdc13076-96f4-4bb9-bea6-78b529816c71'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:19:11.495870 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-bdc13076-96f4-4bb9-bea6-78b529816c71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65afd800770347c5a254918a8c390826', 'request_id': 'req-bdc13076-96f4-4bb9-bea6-78b529816c71'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:19:11.497576 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:19:11.521033 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1442/2888] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:19:11 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:19:11.522039 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-bdc13076-96f4-4bb9-bea6-78b529816c71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65afd800770347c5a254918a8c390826', 'request_id': 'req-bdc13076-96f4-4bb9-bea6-78b529816c71'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:19:11.531560 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c848eb1-32ea-4daf-bb57-694beb366464 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:11.533191 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c848eb1-32ea-4daf-bb57-694beb366464 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:11.538895 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c848eb1-32ea-4daf-bb57-694beb366464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:11.554335 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-bdc13076-96f4-4bb9-bea6-78b529816c71 admin admin] The token cache is being invalidate because project 65afd800770347c5a254918a8c390826 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:19:11.554631 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-bdc13076-96f4-4bb9-bea6-78b529816c71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:19:11.555358 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-bdc13076-96f4-4bb9-bea6-78b529816c71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:19:11.557269 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1447/2889] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:19:11 2022] DELETE /identity/v3/projects/65afd800770347c5a254918a8c390826 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:19:11.561445 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc13076-96f4-4bb9-bea6-78b529816c71 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:19:11.563228 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-bdc13076-96f4-4bb9-bea6-78b529816c71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:19:11.661566 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-3c848eb1-32ea-4daf-bb57-694beb366464 None None] MFA Rules not processed for user `145e518288ce4d70a12a3f2cc6a91810`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:19:11.662854 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-3c848eb1-32ea-4daf-bb57-694beb366464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:19:11.726110 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:19:11.853443 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc13076-96f4-4bb9-bea6-78b529816c71 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:19:11.870456 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18185ba4-cc06-4d8a-87cd-82c8ce19f4ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:19:11.871647 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18185ba4-cc06-4d8a-87cd-82c8ce19f4ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:11.871927 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18185ba4-cc06-4d8a-87cd-82c8ce19f4ac admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:11.872338 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18185ba4-cc06-4d8a-87cd-82c8ce19f4ac admin admin] PATH_INFO: `/v3/users/5f312a14cdc649a09c692e785092a862` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:11.877083 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18185ba4-cc06-4d8a-87cd-82c8ce19f4ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f312a14cdc649a09c692e785092a862)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:19:11.885136 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18185ba4-cc06-4d8a-87cd-82c8ce19f4ac admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:19:11.923758 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1443/2890] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:19:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 400 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:19:12.039015 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-18185ba4-cc06-4d8a-87cd-82c8ce19f4ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f312a14cdc649a09c692e785092a862'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:19:12.040740 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-18185ba4-cc06-4d8a-87cd-82c8ce19f4ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f312a14cdc649a09c692e785092a862'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:19:12.074714 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-18185ba4-cc06-4d8a-87cd-82c8ce19f4ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f312a14cdc649a09c692e785092a862'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:19:12.098971 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-18185ba4-cc06-4d8a-87cd-82c8ce19f4ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f312a14cdc649a09c692e785092a862'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:19:12.149084 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-18185ba4-cc06-4d8a-87cd-82c8ce19f4ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f312a14cdc649a09c692e785092a862'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:19:12.171690 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1448/2891] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:19:11 2022] DELETE /identity/v3/users/5f312a14cdc649a09c692e785092a862 => generated 0 bytes in 611 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:19:15.282818 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c848eb1-32ea-4daf-bb57-694beb366464 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:19:15.323272 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c848eb1-32ea-4daf-bb57-694beb366464 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:19:15.582915 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c0faae-437c-4664-943a-c09803f9f19b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:19:15.584105 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c0faae-437c-4664-943a-c09803f9f19b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:15.587236 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c0faae-437c-4664-943a-c09803f9f19b admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:15.587604 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c0faae-437c-4664-943a-c09803f9f19b admin admin] PATH_INFO: `/v3/projects/d09928d042434257bafeabd2cb182cd0` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:15.589270 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c0faae-437c-4664-943a-c09803f9f19b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d09928d042434257bafeabd2cb182cd0)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:19:15.591463 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c0faae-437c-4664-943a-c09803f9f19b admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:19:15.764868 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-15c0faae-437c-4664-943a-c09803f9f19b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd09928d042434257bafeabd2cb182cd0', 'request_id': 'req-15c0faae-437c-4664-943a-c09803f9f19b'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:19:15.796389 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-15c0faae-437c-4664-943a-c09803f9f19b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd09928d042434257bafeabd2cb182cd0', 'request_id': 'req-15c0faae-437c-4664-943a-c09803f9f19b'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:19:15.807475 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-15c0faae-437c-4664-943a-c09803f9f19b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd09928d042434257bafeabd2cb182cd0', 'request_id': 'req-15c0faae-437c-4664-943a-c09803f9f19b'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:19:15.876247 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-15c0faae-437c-4664-943a-c09803f9f19b admin admin] The token cache is being invalidate because project d09928d042434257bafeabd2cb182cd0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:19:15.877644 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-15c0faae-437c-4664-943a-c09803f9f19b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:19:15.880150 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-15c0faae-437c-4664-943a-c09803f9f19b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:19:15.889096 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1444/2892] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:19:15 2022] DELETE /identity/v3/projects/d09928d042434257bafeabd2cb182cd0 => generated 0 bytes in 605 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:19:15.892544 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3daeae-3e3d-4e5d-9a4c-9d3a45bf006d None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:15.893067 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3daeae-3e3d-4e5d-9a4c-9d3a45bf006d None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:15.894901 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3daeae-3e3d-4e5d-9a4c-9d3a45bf006d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:15.941415 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-db3daeae-3e3d-4e5d-9a4c-9d3a45bf006d None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:19:15.945178 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-db3daeae-3e3d-4e5d-9a4c-9d3a45bf006d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:19:16.136414 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1449/2893] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:19:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:19:16.140324 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92815f60-4b49-4a96-b845-a96bf1e42b02 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:16.140614 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92815f60-4b49-4a96-b845-a96bf1e42b02 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:16.140890 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92815f60-4b49-4a96-b845-a96bf1e42b02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:16.204335 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-92815f60-4b49-4a96-b845-a96bf1e42b02 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:19:16.214556 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-92815f60-4b49-4a96-b845-a96bf1e42b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:19:16.238583 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3daeae-3e3d-4e5d-9a4c-9d3a45bf006d None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:19:16.245110 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:19:16.246275 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1445/2894] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:19:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:19:16.254717 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3daeae-3e3d-4e5d-9a4c-9d3a45bf006d None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:19:16.269211 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df490bb-a7cf-4794-af7a-b8bf1e144f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:19:16.270193 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df490bb-a7cf-4794-af7a-b8bf1e144f59 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:16.270504 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df490bb-a7cf-4794-af7a-b8bf1e144f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:16.270823 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df490bb-a7cf-4794-af7a-b8bf1e144f59 admin admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:16.279905 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df490bb-a7cf-4794-af7a-b8bf1e144f59 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:19:16.282734 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df490bb-a7cf-4794-af7a-b8bf1e144f59 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:19:16.284511 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df490bb-a7cf-4794-af7a-b8bf1e144f59 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:19:16.317708 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92815f60-4b49-4a96-b845-a96bf1e42b02 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:19:16.334665 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92815f60-4b49-4a96-b845-a96bf1e42b02 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:19:16.335738 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1450/2895] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:19:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:19:16.349348 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd042e48-e863-4080-a4b0-247ac5a865bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:19:16.350079 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd042e48-e863-4080-a4b0-247ac5a865bb admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:16.350364 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd042e48-e863-4080-a4b0-247ac5a865bb admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:16.350634 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd042e48-e863-4080-a4b0-247ac5a865bb admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:16.351509 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd042e48-e863-4080-a4b0-247ac5a865bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:19:16.357980 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd042e48-e863-4080-a4b0-247ac5a865bb admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:19:16.441330 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1446/2896] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:19:16 2022] POST /identity/v3/projects => generated 375 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:19:16.445642 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df490bb-a7cf-4794-af7a-b8bf1e144f59 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:19:16.458316 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df490bb-a7cf-4794-af7a-b8bf1e144f59 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:19:16.580082 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e361a052-cec0-4a49-b5bf-fc8d2da0233e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:19:16.581150 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e361a052-cec0-4a49-b5bf-fc8d2da0233e admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:16.581653 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e361a052-cec0-4a49-b5bf-fc8d2da0233e admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:16.582158 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e361a052-cec0-4a49-b5bf-fc8d2da0233e admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:16.583045 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e361a052-cec0-4a49-b5bf-fc8d2da0233e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:19:16.586356 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e361a052-cec0-4a49-b5bf-fc8d2da0233e admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:19:16.619726 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1451/2897] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:19:16 2022] POST /identity/v3/users => generated 288 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:19:16.623692 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd042e48-e863-4080-a4b0-247ac5a865bb admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:19:16.642029 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd042e48-e863-4080-a4b0-247ac5a865bb admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:19:16.657794 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f99401-d96a-4978-b618-7c5c7df8e0dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:19:16.658851 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f99401-d96a-4978-b618-7c5c7df8e0dd admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:16.659199 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f99401-d96a-4978-b618-7c5c7df8e0dd admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:16.659543 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f99401-d96a-4978-b618-7c5c7df8e0dd admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:16.660386 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f99401-d96a-4978-b618-7c5c7df8e0dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:19:16.662176 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f99401-d96a-4978-b618-7c5c7df8e0dd admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:19:16.683132 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1447/2898] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:19:16 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:19:16.685831 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e361a052-cec0-4a49-b5bf-fc8d2da0233e admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:19:16.698428 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e361a052-cec0-4a49-b5bf-fc8d2da0233e admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:19:16.707653 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea50e1fe-0b9f-4f86-8720-abeb16a1eaf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:19:16.708503 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea50e1fe-0b9f-4f86-8720-abeb16a1eaf4 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:16.708780 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea50e1fe-0b9f-4f86-8720-abeb16a1eaf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:16.709337 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea50e1fe-0b9f-4f86-8720-abeb16a1eaf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:16.710203 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea50e1fe-0b9f-4f86-8720-abeb16a1eaf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:19:16.713642 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea50e1fe-0b9f-4f86-8720-abeb16a1eaf4 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:19:16.741948 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1452/2899] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:19:16 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:19:16.742182 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f99401-d96a-4978-b618-7c5c7df8e0dd admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:19:16.760616 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f99401-d96a-4978-b618-7c5c7df8e0dd admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:19:16.766205 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54276a15-eb9c-401a-9357-df71066c2bf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:19:16.767143 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54276a15-eb9c-401a-9357-df71066c2bf4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:16.767411 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54276a15-eb9c-401a-9357-df71066c2bf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:16.767685 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54276a15-eb9c-401a-9357-df71066c2bf4 admin admin] PATH_INFO: `/v3/projects/6531d5431fe44004b8d1bbd4426812df/users/99cf481e91b2467b84dd5d72190a16f6/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:16.785896 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:19:16.791655 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54276a15-eb9c-401a-9357-df71066c2bf4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6531d5431fe44004b8d1bbd4426812df, user_id=99cf481e91b2467b84dd5d72190a16f6, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:19:16.795421 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54276a15-eb9c-401a-9357-df71066c2bf4 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:19:16.821678 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1448/2900] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:19:16 2022] PUT /identity/v3/projects/6531d5431fe44004b8d1bbd4426812df/users/99cf481e91b2467b84dd5d72190a16f6/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:19:16.833428 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a48603-fc9c-4fff-88ed-7a56d98a7b24 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:16.833828 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a48603-fc9c-4fff-88ed-7a56d98a7b24 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:16.834349 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a48603-fc9c-4fff-88ed-7a56d98a7b24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:16.877695 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-e1a48603-fc9c-4fff-88ed-7a56d98a7b24 None None] MFA Rules not processed for user `99cf481e91b2467b84dd5d72190a16f6`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:19:16.887174 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-e1a48603-fc9c-4fff-88ed-7a56d98a7b24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:19:17.192902 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1453/2901] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:19:16 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 360 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:19:17.197229 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54276a15-eb9c-401a-9357-df71066c2bf4 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:19:17.327454 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54276a15-eb9c-401a-9357-df71066c2bf4 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:19:17.340752 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a173cd-7d4f-451b-bf4e-61355750ea65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:19:17.341291 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a173cd-7d4f-451b-bf4e-61355750ea65 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:17.343500 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a173cd-7d4f-451b-bf4e-61355750ea65 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:17.343811 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a173cd-7d4f-451b-bf4e-61355750ea65 admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:17.345133 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a173cd-7d4f-451b-bf4e-61355750ea65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:19:17.350668 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a173cd-7d4f-451b-bf4e-61355750ea65 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:19:17.430475 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a48603-fc9c-4fff-88ed-7a56d98a7b24 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:19:17.433368 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1449/2902] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:19:17 2022] POST /identity/v3/projects => generated 373 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:19:17.453573 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a48603-fc9c-4fff-88ed-7a56d98a7b24 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:19:17.658759 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f288705d-f69b-4f5d-9a25-e870eaf370da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:19:17.659834 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f288705d-f69b-4f5d-9a25-e870eaf370da admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:17.660170 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f288705d-f69b-4f5d-9a25-e870eaf370da admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:17.660510 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f288705d-f69b-4f5d-9a25-e870eaf370da admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:17.662279 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f288705d-f69b-4f5d-9a25-e870eaf370da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:19:17.669627 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f288705d-f69b-4f5d-9a25-e870eaf370da admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:19:17.696199 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:19:17.729160 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1454/2903] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:19:17 2022] POST /identity/v3/users => generated 293 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:19:17.731397 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a173cd-7d4f-451b-bf4e-61355750ea65 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:19:17.748876 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a173cd-7d4f-451b-bf4e-61355750ea65 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:19:17.764958 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2471a8b8-8974-4047-a15d-f26041847be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:19:17.768639 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2471a8b8-8974-4047-a15d-f26041847be3 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:17.771386 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2471a8b8-8974-4047-a15d-f26041847be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:17.773503 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2471a8b8-8974-4047-a15d-f26041847be3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:17.775890 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2471a8b8-8974-4047-a15d-f26041847be3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:19:17.779873 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2471a8b8-8974-4047-a15d-f26041847be3 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:19:17.832580 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f288705d-f69b-4f5d-9a25-e870eaf370da admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:19:17.840050 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1450/2904] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:19:17 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:19:17.847770 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f288705d-f69b-4f5d-9a25-e870eaf370da admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:19:17.859383 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23f1c50-8850-4072-957c-9d192893c6a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:19:17.860404 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23f1c50-8850-4072-957c-9d192893c6a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:17.860617 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23f1c50-8850-4072-957c-9d192893c6a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:17.860891 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23f1c50-8850-4072-957c-9d192893c6a9 admin admin] PATH_INFO: `/v3/projects/a675488306844962a893dc4138e22aac/users/babc4383e7a94261a0a222a6baba77fc/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:17.886744 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23f1c50-8850-4072-957c-9d192893c6a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a675488306844962a893dc4138e22aac, user_id=babc4383e7a94261a0a222a6baba77fc, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:19:17.889952 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23f1c50-8850-4072-957c-9d192893c6a9 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:19:17.911938 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1455/2905] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:19:17 2022] PUT /identity/v3/projects/a675488306844962a893dc4138e22aac/users/babc4383e7a94261a0a222a6baba77fc/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:19:17.915722 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2471a8b8-8974-4047-a15d-f26041847be3 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:19:17.934359 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2471a8b8-8974-4047-a15d-f26041847be3 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:19:18.102267 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eed447c-16c7-4fa7-8ba2-fd3f401704e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:19:18.102969 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eed447c-16c7-4fa7-8ba2-fd3f401704e1 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:18.103250 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eed447c-16c7-4fa7-8ba2-fd3f401704e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:18.103577 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eed447c-16c7-4fa7-8ba2-fd3f401704e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:18.104319 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eed447c-16c7-4fa7-8ba2-fd3f401704e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:19:18.106205 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eed447c-16c7-4fa7-8ba2-fd3f401704e1 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:19:18.122044 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1451/2906] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:19:17 2022] GET /identity/v3/roles => generated 1420 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:19:18.123592 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23f1c50-8850-4072-957c-9d192893c6a9 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:19:18.135208 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23f1c50-8850-4072-957c-9d192893c6a9 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:19:18.159712 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9204e222-98d9-4493-985b-ca051796014d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:19:18.163243 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9204e222-98d9-4493-985b-ca051796014d admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:18.163681 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9204e222-98d9-4493-985b-ca051796014d admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:18.164139 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9204e222-98d9-4493-985b-ca051796014d admin admin] PATH_INFO: `/v3/projects/a675488306844962a893dc4138e22aac/users/babc4383e7a94261a0a222a6baba77fc/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:18.169398 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9204e222-98d9-4493-985b-ca051796014d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a675488306844962a893dc4138e22aac, user_id=babc4383e7a94261a0a222a6baba77fc, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:19:18.184907 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9204e222-98d9-4493-985b-ca051796014d admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:19:18.219453 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1456/2907] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:19:18 2022] PUT /identity/v3/projects/a675488306844962a893dc4138e22aac/users/babc4383e7a94261a0a222a6baba77fc/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:19:18.230470 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f63cd35-babc-4b7e-9e2a-88913783d258 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:18.230758 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f63cd35-babc-4b7e-9e2a-88913783d258 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:18.231041 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f63cd35-babc-4b7e-9e2a-88913783d258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:18.280571 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-3f63cd35-babc-4b7e-9e2a-88913783d258 None None] MFA Rules not processed for user `babc4383e7a94261a0a222a6baba77fc`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:19:18.283871 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-3f63cd35-babc-4b7e-9e2a-88913783d258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:19:18.361264 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:19:18.409950 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1452/2908] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:19:18 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:19:18.411793 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9204e222-98d9-4493-985b-ca051796014d admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:19:18.424097 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9204e222-98d9-4493-985b-ca051796014d admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:19:18.429152 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fb398e-9d0f-4c29-8f9b-ef10c5f9dabb tempest-QuotasAdminTestV236-576095878 tempest-QuotasAdminTestV236-576095878-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'babc4383e7a94261a0a222a6baba77fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a675488306844962a893dc4138e22aac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:19:18.429983 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fb398e-9d0f-4c29-8f9b-ef10c5f9dabb tempest-QuotasAdminTestV236-576095878 tempest-QuotasAdminTestV236-576095878-project-admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:18.430405 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fb398e-9d0f-4c29-8f9b-ef10c5f9dabb tempest-QuotasAdminTestV236-576095878 tempest-QuotasAdminTestV236-576095878-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:18.430783 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fb398e-9d0f-4c29-8f9b-ef10c5f9dabb tempest-QuotasAdminTestV236-576095878 tempest-QuotasAdminTestV236-576095878-project-admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:18.431642 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fb398e-9d0f-4c29-8f9b-ef10c5f9dabb tempest-QuotasAdminTestV236-576095878 tempest-QuotasAdminTestV236-576095878-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:19:18.432193 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fb398e-9d0f-4c29-8f9b-ef10c5f9dabb tempest-QuotasAdminTestV236-576095878 tempest-QuotasAdminTestV236-576095878-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:19:18.434275 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fb398e-9d0f-4c29-8f9b-ef10c5f9dabb tempest-QuotasAdminTestV236-576095878 tempest-QuotasAdminTestV236-576095878-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:19:18.454732 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f63cd35-babc-4b7e-9e2a-88913783d258 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:19:18.461386 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1457/2909] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:19:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:19:18.467260 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f63cd35-babc-4b7e-9e2a-88913783d258 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:19:18.473586 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2579118f-d90f-418e-a8ba-81424f63854f tempest-QuotasAdminTestV236-576095878 tempest-QuotasAdminTestV236-576095878-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'babc4383e7a94261a0a222a6baba77fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a675488306844962a893dc4138e22aac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:19:18.474524 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2579118f-d90f-418e-a8ba-81424f63854f tempest-QuotasAdminTestV236-576095878 tempest-QuotasAdminTestV236-576095878-project-admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:18.474993 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2579118f-d90f-418e-a8ba-81424f63854f tempest-QuotasAdminTestV236-576095878 tempest-QuotasAdminTestV236-576095878-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:18.475326 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2579118f-d90f-418e-a8ba-81424f63854f tempest-QuotasAdminTestV236-576095878 tempest-QuotasAdminTestV236-576095878-project-admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:18.476191 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2579118f-d90f-418e-a8ba-81424f63854f tempest-QuotasAdminTestV236-576095878 tempest-QuotasAdminTestV236-576095878-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:19:18.478137 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2579118f-d90f-418e-a8ba-81424f63854f tempest-QuotasAdminTestV236-576095878 tempest-QuotasAdminTestV236-576095878-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:19:18.509703 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1453/2910] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:19:18 2022] POST /identity/v3/projects => generated 371 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:19:18.515005 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fb398e-9d0f-4c29-8f9b-ef10c5f9dabb tempest-QuotasAdminTestV236-576095878 tempest-QuotasAdminTestV236-576095878-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:19:18.532710 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fb398e-9d0f-4c29-8f9b-ef10c5f9dabb tempest-QuotasAdminTestV236-576095878 tempest-QuotasAdminTestV236-576095878-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:19:18.651143 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaf5c84-4e32-4d0c-9d81-15f41e6791fc tempest-QuotasAdminTestV236-576095878 tempest-QuotasAdminTestV236-576095878-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'babc4383e7a94261a0a222a6baba77fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a675488306844962a893dc4138e22aac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:19:18.662648 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaf5c84-4e32-4d0c-9d81-15f41e6791fc tempest-QuotasAdminTestV236-576095878 tempest-QuotasAdminTestV236-576095878-project-admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:18.662950 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaf5c84-4e32-4d0c-9d81-15f41e6791fc tempest-QuotasAdminTestV236-576095878 tempest-QuotasAdminTestV236-576095878-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:18.663281 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaf5c84-4e32-4d0c-9d81-15f41e6791fc tempest-QuotasAdminTestV236-576095878 tempest-QuotasAdminTestV236-576095878-project-admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:18.664178 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaf5c84-4e32-4d0c-9d81-15f41e6791fc tempest-QuotasAdminTestV236-576095878 tempest-QuotasAdminTestV236-576095878-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:19:18.664491 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaf5c84-4e32-4d0c-9d81-15f41e6791fc tempest-QuotasAdminTestV236-576095878 tempest-QuotasAdminTestV236-576095878-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:19:18.666835 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaf5c84-4e32-4d0c-9d81-15f41e6791fc tempest-QuotasAdminTestV236-576095878 tempest-QuotasAdminTestV236-576095878-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:19:18.689940 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1458/2911] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:19:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:19:19.141434 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2579118f-d90f-418e-a8ba-81424f63854f tempest-QuotasAdminTestV236-576095878 tempest-QuotasAdminTestV236-576095878-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:19:19.143380 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-2579118f-d90f-418e-a8ba-81424f63854f tempest-QuotasAdminTestV236-576095878 tempest-QuotasAdminTestV236-576095878-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:19:19.286668 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8f1f87-b299-4948-88ac-7cb7b5089103 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:19.287160 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8f1f87-b299-4948-88ac-7cb7b5089103 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:19.287280 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8f1f87-b299-4948-88ac-7cb7b5089103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:19.323926 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-4e8f1f87-b299-4948-88ac-7cb7b5089103 None None] MFA Rules not processed for user `3f189667b4fb48b28d450ebfb44a961b`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:19:19.326036 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-4e8f1f87-b299-4948-88ac-7cb7b5089103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:19:19.370804 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2579118f-d90f-418e-a8ba-81424f63854f tempest-QuotasAdminTestV236-576095878 tempest-QuotasAdminTestV236-576095878-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:19:19.388531 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0178748-e6ac-4392-9b16-5969aad66c41 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:19:19.389356 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0178748-e6ac-4392-9b16-5969aad66c41 service nova] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:19.389679 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0178748-e6ac-4392-9b16-5969aad66c41 service nova] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:19.390014 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0178748-e6ac-4392-9b16-5969aad66c41 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:19.407935 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0178748-e6ac-4392-9b16-5969aad66c41 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:19:19.409916 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0178748-e6ac-4392-9b16-5969aad66c41 service nova] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:19:19.424814 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1459/2912] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:19:19 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:19:19.426951 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1454/2913] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:19:19 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 23 21:19:19.431538 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8f1f87-b299-4948-88ac-7cb7b5089103 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:19:19.436055 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-4e8f1f87-b299-4948-88ac-7cb7b5089103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:19:19.442621 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f6e910-b7c3-48f3-93e8-61f670d5fbba None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:19.443207 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f6e910-b7c3-48f3-93e8-61f670d5fbba None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:19.443804 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f6e910-b7c3-48f3-93e8-61f670d5fbba None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:19.446185 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1455/2914] 10.222.0.17 () {54 vars in 912 bytes} [Sat Jul 23 21:19:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:19:19.467826 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f6e910-b7c3-48f3-93e8-61f670d5fbba None None] Authenticating service token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 23 21:19:19.482090 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:19:19.503901 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f6e910-b7c3-48f3-93e8-61f670d5fbba None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:19:19.522324 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f6e910-b7c3-48f3-93e8-61f670d5fbba None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:19:19.528675 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd012cb-9d7e-45f5-8742-109f4ca58e0d tempest-QuotasAdminTestV236-576095878 tempest-QuotasAdminTestV236-576095878-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'babc4383e7a94261a0a222a6baba77fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a675488306844962a893dc4138e22aac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:19:19.530723 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd012cb-9d7e-45f5-8742-109f4ca58e0d tempest-QuotasAdminTestV236-576095878 tempest-QuotasAdminTestV236-576095878-project-admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:19.531297 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd012cb-9d7e-45f5-8742-109f4ca58e0d tempest-QuotasAdminTestV236-576095878 tempest-QuotasAdminTestV236-576095878-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:19.531734 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd012cb-9d7e-45f5-8742-109f4ca58e0d tempest-QuotasAdminTestV236-576095878 tempest-QuotasAdminTestV236-576095878-project-admin] PATH_INFO: `/v3/projects/ae9b2a25ba5f4a479a072b0be6f190c9` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:19.533065 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd012cb-9d7e-45f5-8742-109f4ca58e0d tempest-QuotasAdminTestV236-576095878 tempest-QuotasAdminTestV236-576095878-project-admin] RBAC: Authorizing `identity:get_project(project_id=ae9b2a25ba5f4a479a072b0be6f190c9)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:19:19.535289 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd012cb-9d7e-45f5-8742-109f4ca58e0d tempest-QuotasAdminTestV236-576095878 tempest-QuotasAdminTestV236-576095878-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:19:19.548330 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8f1f87-b299-4948-88ac-7cb7b5089103 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:19:19.552068 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1456/2915] 10.222.0.17 () {58 vars in 1443 bytes} [Sat Jul 23 21:19:19 2022] GET /identity/v3/projects/ae9b2a25ba5f4a479a072b0be6f190c9 => generated 371 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:19:19.553181 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905572c5-e300-4d17-8760-322fceb5adee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec5fd3a489c341b7964704d689037f05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:19:19.554184 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905572c5-e300-4d17-8760-322fceb5adee service cinder] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:19.554184 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905572c5-e300-4d17-8760-322fceb5adee service cinder] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:19.554460 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905572c5-e300-4d17-8760-322fceb5adee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:19.556264 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-905572c5-e300-4d17-8760-322fceb5adee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:19:19.634277 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905572c5-e300-4d17-8760-322fceb5adee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:19:19.635580 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905572c5-e300-4d17-8760-322fceb5adee service cinder] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:19:19.646897 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1460/2916] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:19:19 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:19:20.194511 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd012cb-9d7e-45f5-8742-109f4ca58e0d tempest-QuotasAdminTestV236-576095878 tempest-QuotasAdminTestV236-576095878-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:19:20.196481 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-bcd012cb-9d7e-45f5-8742-109f4ca58e0d tempest-QuotasAdminTestV236-576095878 tempest-QuotasAdminTestV236-576095878-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:19:20.240517 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd012cb-9d7e-45f5-8742-109f4ca58e0d tempest-QuotasAdminTestV236-576095878 tempest-QuotasAdminTestV236-576095878-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:19:20.254962 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d1cfbb-07c3-4872-ab0a-f2fd6e8021ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:19:20.257147 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d1cfbb-07c3-4872-ab0a-f2fd6e8021ae service nova] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:20.258256 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d1cfbb-07c3-4872-ab0a-f2fd6e8021ae service nova] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:20.258403 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d1cfbb-07c3-4872-ab0a-f2fd6e8021ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:20.263597 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-31d1cfbb-07c3-4872-ab0a-f2fd6e8021ae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:19:20.296113 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d1cfbb-07c3-4872-ab0a-f2fd6e8021ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:19:20.297828 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d1cfbb-07c3-4872-ab0a-f2fd6e8021ae service nova] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:19:20.323366 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1457/2917] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:19:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:19:20.512662 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4372128-d4b3-419a-8757-905a92c33c90 None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:20.513813 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4372128-d4b3-419a-8757-905a92c33c90 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:20.514349 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4372128-d4b3-419a-8757-905a92c33c90 None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:20.516354 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1461/2918] 10.222.0.17 () {54 vars in 912 bytes} [Sat Jul 23 21:19:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:19:20.527480 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d1cfbb-07c3-4872-ab0a-f2fd6e8021ae service nova] Authenticating service token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 23 21:19:20.570492 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d1cfbb-07c3-4872-ab0a-f2fd6e8021ae service nova] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:19:20.604013 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d1cfbb-07c3-4872-ab0a-f2fd6e8021ae service nova] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:19:20.630161 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05098de7-5111-425b-b8e4-ed5a77d1f979 tempest-QuotasAdminTestV236-576095878 tempest-QuotasAdminTestV236-576095878-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'babc4383e7a94261a0a222a6baba77fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a675488306844962a893dc4138e22aac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:19:20.631512 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05098de7-5111-425b-b8e4-ed5a77d1f979 tempest-QuotasAdminTestV236-576095878 tempest-QuotasAdminTestV236-576095878-project-admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:20.632625 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05098de7-5111-425b-b8e4-ed5a77d1f979 tempest-QuotasAdminTestV236-576095878 tempest-QuotasAdminTestV236-576095878-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:20.635665 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05098de7-5111-425b-b8e4-ed5a77d1f979 tempest-QuotasAdminTestV236-576095878 tempest-QuotasAdminTestV236-576095878-project-admin] PATH_INFO: `/v3/projects/ae9b2a25ba5f4a479a072b0be6f190c9` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:20.640817 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05098de7-5111-425b-b8e4-ed5a77d1f979 tempest-QuotasAdminTestV236-576095878 tempest-QuotasAdminTestV236-576095878-project-admin] RBAC: Authorizing `identity:get_project(project_id=ae9b2a25ba5f4a479a072b0be6f190c9)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:19:20.650191 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05098de7-5111-425b-b8e4-ed5a77d1f979 tempest-QuotasAdminTestV236-576095878 tempest-QuotasAdminTestV236-576095878-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:19:20.654841 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1458/2919] 10.222.0.17 () {58 vars in 1443 bytes} [Sat Jul 23 21:19:20 2022] GET /identity/v3/projects/ae9b2a25ba5f4a479a072b0be6f190c9 => generated 371 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:19:20.753451 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4372128-d4b3-419a-8757-905a92c33c90 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:19:20.761856 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05098de7-5111-425b-b8e4-ed5a77d1f979 tempest-QuotasAdminTestV236-576095878 tempest-QuotasAdminTestV236-576095878-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:19:20.776859 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05098de7-5111-425b-b8e4-ed5a77d1f979 tempest-QuotasAdminTestV236-576095878 tempest-QuotasAdminTestV236-576095878-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:19:20.793532 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4372128-d4b3-419a-8757-905a92c33c90 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:19:20.796042 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76794f7-5a70-456e-8a31-05996fc688a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:19:20.797282 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76794f7-5a70-456e-8a31-05996fc688a4 service nova] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:20.797747 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76794f7-5a70-456e-8a31-05996fc688a4 service nova] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:20.798173 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76794f7-5a70-456e-8a31-05996fc688a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:20.801581 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-e76794f7-5a70-456e-8a31-05996fc688a4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:19:20.816371 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d6a1b2-a40e-4009-b484-d3a57759ef97 tempest-QuotasAdminTestV236-576095878 tempest-QuotasAdminTestV236-576095878-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'babc4383e7a94261a0a222a6baba77fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a675488306844962a893dc4138e22aac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:19:20.819627 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d6a1b2-a40e-4009-b484-d3a57759ef97 tempest-QuotasAdminTestV236-576095878 tempest-QuotasAdminTestV236-576095878-project-admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:20.819917 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d6a1b2-a40e-4009-b484-d3a57759ef97 tempest-QuotasAdminTestV236-576095878 tempest-QuotasAdminTestV236-576095878-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:20.820190 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d6a1b2-a40e-4009-b484-d3a57759ef97 tempest-QuotasAdminTestV236-576095878 tempest-QuotasAdminTestV236-576095878-project-admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:20.820950 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d6a1b2-a40e-4009-b484-d3a57759ef97 tempest-QuotasAdminTestV236-576095878 tempest-QuotasAdminTestV236-576095878-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:19:20.821257 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d6a1b2-a40e-4009-b484-d3a57759ef97 tempest-QuotasAdminTestV236-576095878 tempest-QuotasAdminTestV236-576095878-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:19:20.822924 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d6a1b2-a40e-4009-b484-d3a57759ef97 tempest-QuotasAdminTestV236-576095878 tempest-QuotasAdminTestV236-576095878-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:19:20.845336 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76794f7-5a70-456e-8a31-05996fc688a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:19:20.849898 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76794f7-5a70-456e-8a31-05996fc688a4 service nova] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:19:20.863506 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1462/2920] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:19:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:19:20.865052 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d6a1b2-a40e-4009-b484-d3a57759ef97 tempest-QuotasAdminTestV236-576095878 tempest-QuotasAdminTestV236-576095878-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:19:20.892990 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d6a1b2-a40e-4009-b484-d3a57759ef97 tempest-QuotasAdminTestV236-576095878 tempest-QuotasAdminTestV236-576095878-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:19:20.906615 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e08beee-01b9-4f47-89b0-e9c8ceb2c1df tempest-QuotasAdminTestV236-576095878 tempest-QuotasAdminTestV236-576095878-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'babc4383e7a94261a0a222a6baba77fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a675488306844962a893dc4138e22aac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:19:20.907868 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1459/2921] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:19:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 23 21:19:20.908697 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e08beee-01b9-4f47-89b0-e9c8ceb2c1df tempest-QuotasAdminTestV236-576095878 tempest-QuotasAdminTestV236-576095878-project-admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:20.908985 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e08beee-01b9-4f47-89b0-e9c8ceb2c1df tempest-QuotasAdminTestV236-576095878 tempest-QuotasAdminTestV236-576095878-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:20.909263 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e08beee-01b9-4f47-89b0-e9c8ceb2c1df tempest-QuotasAdminTestV236-576095878 tempest-QuotasAdminTestV236-576095878-project-admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:20.911152 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e08beee-01b9-4f47-89b0-e9c8ceb2c1df tempest-QuotasAdminTestV236-576095878 tempest-QuotasAdminTestV236-576095878-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:19:20.917141 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e08beee-01b9-4f47-89b0-e9c8ceb2c1df tempest-QuotasAdminTestV236-576095878 tempest-QuotasAdminTestV236-576095878-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:19:20.971726 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1463/2922] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:19:20 2022] POST /identity/v3/users => generated 381 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:19:20.983077 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76794f7-5a70-456e-8a31-05996fc688a4 service nova] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:19:21.014237 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76794f7-5a70-456e-8a31-05996fc688a4 service nova] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:19:21.036613 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc11dcee-8be8-46b0-9873-a4931d0f1991 tempest-QuotasAdminTestV236-576095878 tempest-QuotasAdminTestV236-576095878-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'babc4383e7a94261a0a222a6baba77fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a675488306844962a893dc4138e22aac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:19:21.040385 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc11dcee-8be8-46b0-9873-a4931d0f1991 tempest-QuotasAdminTestV236-576095878 tempest-QuotasAdminTestV236-576095878-project-admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:21.041886 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc11dcee-8be8-46b0-9873-a4931d0f1991 tempest-QuotasAdminTestV236-576095878 tempest-QuotasAdminTestV236-576095878-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:21.043623 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc11dcee-8be8-46b0-9873-a4931d0f1991 tempest-QuotasAdminTestV236-576095878 tempest-QuotasAdminTestV236-576095878-project-admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:21.048224 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc11dcee-8be8-46b0-9873-a4931d0f1991 tempest-QuotasAdminTestV236-576095878 tempest-QuotasAdminTestV236-576095878-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:19:21.050935 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc11dcee-8be8-46b0-9873-a4931d0f1991 tempest-QuotasAdminTestV236-576095878 tempest-QuotasAdminTestV236-576095878-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:19:21.061471 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc11dcee-8be8-46b0-9873-a4931d0f1991 tempest-QuotasAdminTestV236-576095878 tempest-QuotasAdminTestV236-576095878-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:19:21.128953 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1460/2923] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:19:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:19:21.913330 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51e296c-dd2e-4e33-a3de-caeb9a64e320 None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:21.914432 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51e296c-dd2e-4e33-a3de-caeb9a64e320 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:21.914981 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51e296c-dd2e-4e33-a3de-caeb9a64e320 None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:21.916774 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1464/2924] 10.222.0.17 () {54 vars in 912 bytes} [Sat Jul 23 21:19:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:19:21.922499 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc11dcee-8be8-46b0-9873-a4931d0f1991 tempest-QuotasAdminTestV236-576095878 tempest-QuotasAdminTestV236-576095878-project-admin] Authenticating service token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 23 21:19:21.945257 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc11dcee-8be8-46b0-9873-a4931d0f1991 tempest-QuotasAdminTestV236-576095878 tempest-QuotasAdminTestV236-576095878-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:19:22.051628 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc11dcee-8be8-46b0-9873-a4931d0f1991 tempest-QuotasAdminTestV236-576095878 tempest-QuotasAdminTestV236-576095878-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:19:22.098399 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9b9dec-ab1b-4add-b836-bd75e6a46a87 tempest-QuotasAdminTestV236-576095878 tempest-QuotasAdminTestV236-576095878-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'babc4383e7a94261a0a222a6baba77fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a675488306844962a893dc4138e22aac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:19:22.103367 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9b9dec-ab1b-4add-b836-bd75e6a46a87 tempest-QuotasAdminTestV236-576095878 tempest-QuotasAdminTestV236-576095878-project-admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:22.105457 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9b9dec-ab1b-4add-b836-bd75e6a46a87 tempest-QuotasAdminTestV236-576095878 tempest-QuotasAdminTestV236-576095878-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:22.108297 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9b9dec-ab1b-4add-b836-bd75e6a46a87 tempest-QuotasAdminTestV236-576095878 tempest-QuotasAdminTestV236-576095878-project-admin] PATH_INFO: `/v3/projects/ae9b2a25ba5f4a479a072b0be6f190c9` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:22.113701 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9b9dec-ab1b-4add-b836-bd75e6a46a87 tempest-QuotasAdminTestV236-576095878 tempest-QuotasAdminTestV236-576095878-project-admin] RBAC: Authorizing `identity:get_project(project_id=ae9b2a25ba5f4a479a072b0be6f190c9)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:19:22.134346 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9b9dec-ab1b-4add-b836-bd75e6a46a87 tempest-QuotasAdminTestV236-576095878 tempest-QuotasAdminTestV236-576095878-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:19:22.148843 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1461/2925] 10.222.0.17 () {58 vars in 1443 bytes} [Sat Jul 23 21:19:21 2022] GET /identity/v3/projects/ae9b2a25ba5f4a479a072b0be6f190c9 => generated 371 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:19:22.340798 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403a90ef-7aab-4652-83a0-a922a6e3c1d6 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:22.344771 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403a90ef-7aab-4652-83a0-a922a6e3c1d6 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:22.346562 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403a90ef-7aab-4652-83a0-a922a6e3c1d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:22.393358 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-403a90ef-7aab-4652-83a0-a922a6e3c1d6 None None] MFA Rules not processed for user `17b779a3e21a415bb42cde5d6863d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:19:22.396130 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-403a90ef-7aab-4652-83a0-a922a6e3c1d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:19:22.545855 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1465/2926] 10.222.0.17 () {58 vars in 967 bytes} [Sat Jul 23 21:19:22 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:19:22.546441 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9b9dec-ab1b-4add-b836-bd75e6a46a87 tempest-QuotasAdminTestV236-576095878 tempest-QuotasAdminTestV236-576095878-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:19:22.550917 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-bd9b9dec-ab1b-4add-b836-bd75e6a46a87 tempest-QuotasAdminTestV236-576095878 tempest-QuotasAdminTestV236-576095878-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:19:22.672392 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:19:22.710324 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9b9dec-ab1b-4add-b836-bd75e6a46a87 tempest-QuotasAdminTestV236-576095878 tempest-QuotasAdminTestV236-576095878-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:19:22.717210 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8713a0-1930-4f8e-8ba6-3dcfe2d0f50e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f0a685b7da46afb81024848f079d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:19:22.718806 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8713a0-1930-4f8e-8ba6-3dcfe2d0f50e service swift] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:22.719217 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8713a0-1930-4f8e-8ba6-3dcfe2d0f50e service swift] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:22.719751 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8713a0-1930-4f8e-8ba6-3dcfe2d0f50e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:22.737092 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8713a0-1930-4f8e-8ba6-3dcfe2d0f50e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:19:22.742151 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8713a0-1930-4f8e-8ba6-3dcfe2d0f50e service swift] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:19:22.761490 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1462/2927] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 23 21:19:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 23 21:19:23.315392 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1c465a-509d-4c86-afc4-88837a38cebc None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:23.315876 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1c465a-509d-4c86-afc4-88837a38cebc None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:23.315876 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1c465a-509d-4c86-afc4-88837a38cebc None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:23.317326 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1466/2928] 10.222.0.17 () {54 vars in 912 bytes} [Sat Jul 23 21:19:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:19:23.325514 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8713a0-1930-4f8e-8ba6-3dcfe2d0f50e service swift] Authenticating service token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 23 21:19:23.355494 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8713a0-1930-4f8e-8ba6-3dcfe2d0f50e service swift] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:19:23.380929 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8713a0-1930-4f8e-8ba6-3dcfe2d0f50e service swift] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:19:23.394746 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e6f415-ad58-4d63-90fd-fb4d2bc6ee77 tempest-QuotasAdminTestV236-576095878 tempest-QuotasAdminTestV236-576095878-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'babc4383e7a94261a0a222a6baba77fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a675488306844962a893dc4138e22aac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:19:23.395652 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e6f415-ad58-4d63-90fd-fb4d2bc6ee77 tempest-QuotasAdminTestV236-576095878 tempest-QuotasAdminTestV236-576095878-project-admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:23.395932 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e6f415-ad58-4d63-90fd-fb4d2bc6ee77 tempest-QuotasAdminTestV236-576095878 tempest-QuotasAdminTestV236-576095878-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:23.396204 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e6f415-ad58-4d63-90fd-fb4d2bc6ee77 tempest-QuotasAdminTestV236-576095878 tempest-QuotasAdminTestV236-576095878-project-admin] PATH_INFO: `/v3/projects/ae9b2a25ba5f4a479a072b0be6f190c9` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:23.397567 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e6f415-ad58-4d63-90fd-fb4d2bc6ee77 tempest-QuotasAdminTestV236-576095878 tempest-QuotasAdminTestV236-576095878-project-admin] RBAC: Authorizing `identity:get_project(project_id=ae9b2a25ba5f4a479a072b0be6f190c9)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:19:23.403114 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e6f415-ad58-4d63-90fd-fb4d2bc6ee77 tempest-QuotasAdminTestV236-576095878 tempest-QuotasAdminTestV236-576095878-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:19:23.409896 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1463/2929] 10.222.0.17 () {58 vars in 1443 bytes} [Sat Jul 23 21:19:23 2022] GET /identity/v3/projects/ae9b2a25ba5f4a479a072b0be6f190c9 => generated 371 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:19:23.458290 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1c465a-509d-4c86-afc4-88837a38cebc None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:19:23.483345 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1c465a-509d-4c86-afc4-88837a38cebc None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:19:23.491747 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860890b9-00e1-4e48-8c37-b2a37e28d3d7 tempest-QuotasAdminTestV236-576095878 tempest-QuotasAdminTestV236-576095878-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'babc4383e7a94261a0a222a6baba77fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a675488306844962a893dc4138e22aac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:19:23.492930 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860890b9-00e1-4e48-8c37-b2a37e28d3d7 tempest-QuotasAdminTestV236-576095878 tempest-QuotasAdminTestV236-576095878-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:23.493366 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860890b9-00e1-4e48-8c37-b2a37e28d3d7 tempest-QuotasAdminTestV236-576095878 tempest-QuotasAdminTestV236-576095878-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:23.493843 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860890b9-00e1-4e48-8c37-b2a37e28d3d7 tempest-QuotasAdminTestV236-576095878 tempest-QuotasAdminTestV236-576095878-project-admin] PATH_INFO: `/v3/users/5e591c901f354665bc63703be5f2677c` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:23.549632 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860890b9-00e1-4e48-8c37-b2a37e28d3d7 tempest-QuotasAdminTestV236-576095878 tempest-QuotasAdminTestV236-576095878-project-admin] RBAC: Authorizing `identity:delete_user(user_id=5e591c901f354665bc63703be5f2677c)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:19:23.551682 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860890b9-00e1-4e48-8c37-b2a37e28d3d7 tempest-QuotasAdminTestV236-576095878 tempest-QuotasAdminTestV236-576095878-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:19:23.575109 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:19:23.648435 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-860890b9-00e1-4e48-8c37-b2a37e28d3d7 tempest-QuotasAdminTestV236-576095878 tempest-QuotasAdminTestV236-576095878-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e591c901f354665bc63703be5f2677c'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:19:23.649183 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-860890b9-00e1-4e48-8c37-b2a37e28d3d7 tempest-QuotasAdminTestV236-576095878 tempest-QuotasAdminTestV236-576095878-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e591c901f354665bc63703be5f2677c'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:19:23.667979 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-860890b9-00e1-4e48-8c37-b2a37e28d3d7 tempest-QuotasAdminTestV236-576095878 tempest-QuotasAdminTestV236-576095878-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e591c901f354665bc63703be5f2677c'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:19:23.688819 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-860890b9-00e1-4e48-8c37-b2a37e28d3d7 tempest-QuotasAdminTestV236-576095878 tempest-QuotasAdminTestV236-576095878-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e591c901f354665bc63703be5f2677c'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:19:23.710127 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-860890b9-00e1-4e48-8c37-b2a37e28d3d7 tempest-QuotasAdminTestV236-576095878 tempest-QuotasAdminTestV236-576095878-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e591c901f354665bc63703be5f2677c'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:19:23.717811 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1467/2930] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:19:23 2022] DELETE /identity/v3/users/5e591c901f354665bc63703be5f2677c => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:19:23.722176 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e6f415-ad58-4d63-90fd-fb4d2bc6ee77 tempest-QuotasAdminTestV236-576095878 tempest-QuotasAdminTestV236-576095878-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:19:23.724434 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-02e6f415-ad58-4d63-90fd-fb4d2bc6ee77 tempest-QuotasAdminTestV236-576095878 tempest-QuotasAdminTestV236-576095878-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:19:23.747798 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e6f415-ad58-4d63-90fd-fb4d2bc6ee77 tempest-QuotasAdminTestV236-576095878 tempest-QuotasAdminTestV236-576095878-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:19:24.147612 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6a284e-81b6-4c39-9de3-1bb7b193f324 tempest-QuotasAdminTestV236-576095878 tempest-QuotasAdminTestV236-576095878-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'babc4383e7a94261a0a222a6baba77fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a675488306844962a893dc4138e22aac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:19:24.148963 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6a284e-81b6-4c39-9de3-1bb7b193f324 tempest-QuotasAdminTestV236-576095878 tempest-QuotasAdminTestV236-576095878-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:24.149397 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6a284e-81b6-4c39-9de3-1bb7b193f324 tempest-QuotasAdminTestV236-576095878 tempest-QuotasAdminTestV236-576095878-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:24.149830 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6a284e-81b6-4c39-9de3-1bb7b193f324 tempest-QuotasAdminTestV236-576095878 tempest-QuotasAdminTestV236-576095878-project-admin] PATH_INFO: `/v3/projects/ae9b2a25ba5f4a479a072b0be6f190c9` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:24.151324 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6a284e-81b6-4c39-9de3-1bb7b193f324 tempest-QuotasAdminTestV236-576095878 tempest-QuotasAdminTestV236-576095878-project-admin] RBAC: Authorizing `identity:delete_project(project_id=ae9b2a25ba5f4a479a072b0be6f190c9)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:19:24.154075 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6a284e-81b6-4c39-9de3-1bb7b193f324 tempest-QuotasAdminTestV236-576095878 tempest-QuotasAdminTestV236-576095878-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:19:24.219771 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-4f6a284e-81b6-4c39-9de3-1bb7b193f324 tempest-QuotasAdminTestV236-576095878 tempest-QuotasAdminTestV236-576095878-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae9b2a25ba5f4a479a072b0be6f190c9', 'request_id': 'req-4f6a284e-81b6-4c39-9de3-1bb7b193f324'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:19:24.238532 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-4f6a284e-81b6-4c39-9de3-1bb7b193f324 tempest-QuotasAdminTestV236-576095878 tempest-QuotasAdminTestV236-576095878-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae9b2a25ba5f4a479a072b0be6f190c9', 'request_id': 'req-4f6a284e-81b6-4c39-9de3-1bb7b193f324'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:19:24.248303 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-4f6a284e-81b6-4c39-9de3-1bb7b193f324 tempest-QuotasAdminTestV236-576095878 tempest-QuotasAdminTestV236-576095878-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae9b2a25ba5f4a479a072b0be6f190c9', 'request_id': 'req-4f6a284e-81b6-4c39-9de3-1bb7b193f324'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:19:24.265534 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-4f6a284e-81b6-4c39-9de3-1bb7b193f324 tempest-QuotasAdminTestV236-576095878 tempest-QuotasAdminTestV236-576095878-project-admin] The token cache is being invalidate because project ae9b2a25ba5f4a479a072b0be6f190c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:19:24.266188 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-4f6a284e-81b6-4c39-9de3-1bb7b193f324 tempest-QuotasAdminTestV236-576095878 tempest-QuotasAdminTestV236-576095878-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:19:24.268024 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-4f6a284e-81b6-4c39-9de3-1bb7b193f324 tempest-QuotasAdminTestV236-576095878 tempest-QuotasAdminTestV236-576095878-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:19:24.274412 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1464/2931] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:19:23 2022] DELETE /identity/v3/projects/ae9b2a25ba5f4a479a072b0be6f190c9 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:19:24.282631 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860890b9-00e1-4e48-8c37-b2a37e28d3d7 tempest-QuotasAdminTestV236-576095878 tempest-QuotasAdminTestV236-576095878-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:19:24.284335 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-860890b9-00e1-4e48-8c37-b2a37e28d3d7 tempest-QuotasAdminTestV236-576095878 tempest-QuotasAdminTestV236-576095878-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:19:24.339182 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be19b795-c79a-4efa-8e24-6de6adddf06c None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:24.339668 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be19b795-c79a-4efa-8e24-6de6adddf06c None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:24.339904 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be19b795-c79a-4efa-8e24-6de6adddf06c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:24.400840 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-be19b795-c79a-4efa-8e24-6de6adddf06c None None] MFA Rules not processed for user `bb4f9dda4c2a411cb0394bf86e9ae223`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:19:24.403073 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-be19b795-c79a-4efa-8e24-6de6adddf06c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:19:24.560538 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860890b9-00e1-4e48-8c37-b2a37e28d3d7 tempest-QuotasAdminTestV236-576095878 tempest-QuotasAdminTestV236-576095878-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:19:24.573017 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:19:24.608639 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1465/2932] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:19:24 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:19:24.802504 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459be042-1785-4ef5-8824-6feb1ee3b138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:19:24.803413 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459be042-1785-4ef5-8824-6feb1ee3b138 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:24.806160 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459be042-1785-4ef5-8824-6feb1ee3b138 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:24.806692 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459be042-1785-4ef5-8824-6feb1ee3b138 admin admin] PATH_INFO: `/v3/users/99cf481e91b2467b84dd5d72190a16f6` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:24.808775 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459be042-1785-4ef5-8824-6feb1ee3b138 admin admin] RBAC: Authorizing `identity:delete_user(user_id=99cf481e91b2467b84dd5d72190a16f6)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:19:24.816926 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459be042-1785-4ef5-8824-6feb1ee3b138 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:19:24.883135 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:19:24.897361 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-459be042-1785-4ef5-8824-6feb1ee3b138 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99cf481e91b2467b84dd5d72190a16f6'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:19:24.899219 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-459be042-1785-4ef5-8824-6feb1ee3b138 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99cf481e91b2467b84dd5d72190a16f6'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:19:24.916247 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-459be042-1785-4ef5-8824-6feb1ee3b138 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99cf481e91b2467b84dd5d72190a16f6'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:19:24.934177 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-459be042-1785-4ef5-8824-6feb1ee3b138 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99cf481e91b2467b84dd5d72190a16f6'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:19:24.969070 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-459be042-1785-4ef5-8824-6feb1ee3b138 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99cf481e91b2467b84dd5d72190a16f6'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:19:24.996225 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1468/2933] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:19:24 2022] DELETE /identity/v3/users/99cf481e91b2467b84dd5d72190a16f6 => generated 0 bytes in 713 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:19:24.998650 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8847604c-2bb2-4ff2-96ca-2505bda45c31 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:24.999278 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8847604c-2bb2-4ff2-96ca-2505bda45c31 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:24.999700 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8847604c-2bb2-4ff2-96ca-2505bda45c31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:25.056401 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-8847604c-2bb2-4ff2-96ca-2505bda45c31 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:19:25.059583 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-8847604c-2bb2-4ff2-96ca-2505bda45c31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:19:25.202182 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1466/2934] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:19:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:19:25.218127 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459be042-1785-4ef5-8824-6feb1ee3b138 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:19:25.219794 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-459be042-1785-4ef5-8824-6feb1ee3b138 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:19:25.329537 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8847604c-2bb2-4ff2-96ca-2505bda45c31 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:19:25.331174 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-8847604c-2bb2-4ff2-96ca-2505bda45c31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:19:25.394602 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459be042-1785-4ef5-8824-6feb1ee3b138 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:19:25.410035 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66da7134-c2e1-4bff-b473-0a7a2505cfe6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:19:25.410720 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66da7134-c2e1-4bff-b473-0a7a2505cfe6 service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:25.411073 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66da7134-c2e1-4bff-b473-0a7a2505cfe6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:25.411341 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66da7134-c2e1-4bff-b473-0a7a2505cfe6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:25.433457 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66da7134-c2e1-4bff-b473-0a7a2505cfe6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:19:25.434948 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66da7134-c2e1-4bff-b473-0a7a2505cfe6 service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:19:25.471152 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1469/2935] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:19:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:19:25.479666 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8847604c-2bb2-4ff2-96ca-2505bda45c31 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:19:25.494232 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48abb563-1ccc-41de-adef-8c80c0616ba5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:19:25.494833 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48abb563-1ccc-41de-adef-8c80c0616ba5 service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:25.495113 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48abb563-1ccc-41de-adef-8c80c0616ba5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:25.495385 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48abb563-1ccc-41de-adef-8c80c0616ba5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:25.497275 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-48abb563-1ccc-41de-adef-8c80c0616ba5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:19:25.517489 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48abb563-1ccc-41de-adef-8c80c0616ba5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:19:25.519005 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48abb563-1ccc-41de-adef-8c80c0616ba5 service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:19:25.541021 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1467/2936] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:19:25 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:19:26.872502 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66da7134-c2e1-4bff-b473-0a7a2505cfe6 service neutron] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:19:26.873991 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-66da7134-c2e1-4bff-b473-0a7a2505cfe6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:19:26.901412 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66da7134-c2e1-4bff-b473-0a7a2505cfe6 service neutron] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:19:26.914226 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce41aec-3d21-4f6f-810a-40a067d56ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:19:26.915744 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce41aec-3d21-4f6f-810a-40a067d56ec5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:26.917756 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce41aec-3d21-4f6f-810a-40a067d56ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:26.918552 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce41aec-3d21-4f6f-810a-40a067d56ec5 admin admin] PATH_INFO: `/v3/projects/6531d5431fe44004b8d1bbd4426812df` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:26.923439 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce41aec-3d21-4f6f-810a-40a067d56ec5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6531d5431fe44004b8d1bbd4426812df)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:19:26.941571 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce41aec-3d21-4f6f-810a-40a067d56ec5 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:19:27.096146 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-6ce41aec-3d21-4f6f-810a-40a067d56ec5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6531d5431fe44004b8d1bbd4426812df', 'request_id': 'req-6ce41aec-3d21-4f6f-810a-40a067d56ec5'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:19:27.108559 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-6ce41aec-3d21-4f6f-810a-40a067d56ec5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6531d5431fe44004b8d1bbd4426812df', 'request_id': 'req-6ce41aec-3d21-4f6f-810a-40a067d56ec5'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:19:27.116641 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-6ce41aec-3d21-4f6f-810a-40a067d56ec5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6531d5431fe44004b8d1bbd4426812df', 'request_id': 'req-6ce41aec-3d21-4f6f-810a-40a067d56ec5'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:19:27.134135 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-6ce41aec-3d21-4f6f-810a-40a067d56ec5 admin admin] The token cache is being invalidate because project 6531d5431fe44004b8d1bbd4426812df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:19:27.134610 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-6ce41aec-3d21-4f6f-810a-40a067d56ec5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:19:27.135372 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-6ce41aec-3d21-4f6f-810a-40a067d56ec5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:19:27.138374 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1470/2937] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:19:26 2022] DELETE /identity/v3/projects/6531d5431fe44004b8d1bbd4426812df => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:19:27.142258 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48abb563-1ccc-41de-adef-8c80c0616ba5 service neutron] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:19:27.160658 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48abb563-1ccc-41de-adef-8c80c0616ba5 service neutron] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:19:27.287787 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8843c2f9-8521-418d-b090-05c4e0f6379f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:19:27.288887 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8843c2f9-8521-418d-b090-05c4e0f6379f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:27.289227 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8843c2f9-8521-418d-b090-05c4e0f6379f admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:27.289897 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8843c2f9-8521-418d-b090-05c4e0f6379f admin admin] PATH_INFO: `/v3/users/babc4383e7a94261a0a222a6baba77fc` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:27.291720 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8843c2f9-8521-418d-b090-05c4e0f6379f admin admin] RBAC: Authorizing `identity:delete_user(user_id=babc4383e7a94261a0a222a6baba77fc)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:19:27.294062 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8843c2f9-8521-418d-b090-05c4e0f6379f admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:19:27.301362 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b66b89-c822-4e68-b246-0168479a773a None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:27.302134 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b66b89-c822-4e68-b246-0168479a773a None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:27.302735 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b66b89-c822-4e68-b246-0168479a773a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:27.354722 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-81b66b89-c822-4e68-b246-0168479a773a None None] MFA Rules not processed for user `17b779a3e21a415bb42cde5d6863d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:19:27.356562 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-81b66b89-c822-4e68-b246-0168479a773a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:19:27.362128 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:19:27.369888 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-8843c2f9-8521-418d-b090-05c4e0f6379f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'babc4383e7a94261a0a222a6baba77fc'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:19:27.382736 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-8843c2f9-8521-418d-b090-05c4e0f6379f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'babc4383e7a94261a0a222a6baba77fc'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:19:27.383901 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-8843c2f9-8521-418d-b090-05c4e0f6379f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'babc4383e7a94261a0a222a6baba77fc'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:19:27.405687 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-8843c2f9-8521-418d-b090-05c4e0f6379f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'babc4383e7a94261a0a222a6baba77fc'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:19:27.422648 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:19:27.434230 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-8843c2f9-8521-418d-b090-05c4e0f6379f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'babc4383e7a94261a0a222a6baba77fc'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:19:27.468128 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1471/2938] 10.222.0.17 () {58 vars in 967 bytes} [Sat Jul 23 21:19:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:19:27.470305 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b66b89-c822-4e68-b246-0168479a773a None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:19:27.470606 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1468/2939] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:19:27 2022] DELETE /identity/v3/users/babc4383e7a94261a0a222a6baba77fc => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:19:27.479234 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-81b66b89-c822-4e68-b246-0168479a773a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:19:27.605895 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b66b89-c822-4e68-b246-0168479a773a None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:19:27.714376 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31969e8a-81fa-41a3-a42b-9cf35c69b925 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f0a685b7da46afb81024848f079d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:19:27.715047 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31969e8a-81fa-41a3-a42b-9cf35c69b925 service swift] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:27.715325 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31969e8a-81fa-41a3-a42b-9cf35c69b925 service swift] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:27.715597 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31969e8a-81fa-41a3-a42b-9cf35c69b925 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:27.795638 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31969e8a-81fa-41a3-a42b-9cf35c69b925 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:19:27.797507 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31969e8a-81fa-41a3-a42b-9cf35c69b925 service swift] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:19:27.808125 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1472/2940] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 23 21:19:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 23 21:19:29.057755 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8843c2f9-8521-418d-b090-05c4e0f6379f admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:19:29.060923 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-8843c2f9-8521-418d-b090-05c4e0f6379f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:19:29.313833 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8843c2f9-8521-418d-b090-05c4e0f6379f admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:19:29.322795 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb5b5f3-348b-43e5-97dd-8de8480509cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:19:29.325203 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb5b5f3-348b-43e5-97dd-8de8480509cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:29.325938 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb5b5f3-348b-43e5-97dd-8de8480509cd admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:29.326377 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb5b5f3-348b-43e5-97dd-8de8480509cd admin admin] PATH_INFO: `/v3/projects/a675488306844962a893dc4138e22aac` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:29.328115 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb5b5f3-348b-43e5-97dd-8de8480509cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=a675488306844962a893dc4138e22aac)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:19:29.330841 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb5b5f3-348b-43e5-97dd-8de8480509cd admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:19:29.404120 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-0fb5b5f3-348b-43e5-97dd-8de8480509cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a675488306844962a893dc4138e22aac', 'request_id': 'req-0fb5b5f3-348b-43e5-97dd-8de8480509cd'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:19:29.427008 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-0fb5b5f3-348b-43e5-97dd-8de8480509cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a675488306844962a893dc4138e22aac', 'request_id': 'req-0fb5b5f3-348b-43e5-97dd-8de8480509cd'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:19:29.435513 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-0fb5b5f3-348b-43e5-97dd-8de8480509cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a675488306844962a893dc4138e22aac', 'request_id': 'req-0fb5b5f3-348b-43e5-97dd-8de8480509cd'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:19:29.456711 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-0fb5b5f3-348b-43e5-97dd-8de8480509cd admin admin] The token cache is being invalidate because project a675488306844962a893dc4138e22aac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:19:29.457577 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-0fb5b5f3-348b-43e5-97dd-8de8480509cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:19:29.458776 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-0fb5b5f3-348b-43e5-97dd-8de8480509cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:19:29.462694 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1469/2941] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:19:29 2022] DELETE /identity/v3/projects/a675488306844962a893dc4138e22aac => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:19:29.471017 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67551c6-6b47-41db-b738-e4207978ad69 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:29.471017 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67551c6-6b47-41db-b738-e4207978ad69 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:29.471017 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67551c6-6b47-41db-b738-e4207978ad69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:29.539887 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-c67551c6-6b47-41db-b738-e4207978ad69 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:19:29.546265 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-c67551c6-6b47-41db-b738-e4207978ad69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:19:29.610944 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:19:29.672741 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1473/2942] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:19:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:19:29.680865 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2a7982-bc7e-4603-8c2b-b77f30ba952f None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:29.681131 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2a7982-bc7e-4603-8c2b-b77f30ba952f None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:29.681244 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2a7982-bc7e-4603-8c2b-b77f30ba952f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:29.718565 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-fd2a7982-bc7e-4603-8c2b-b77f30ba952f None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:19:29.720319 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-fd2a7982-bc7e-4603-8c2b-b77f30ba952f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:19:29.740776 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1470/2943] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:19:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:19:29.741895 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67551c6-6b47-41db-b738-e4207978ad69 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:19:29.757832 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67551c6-6b47-41db-b738-e4207978ad69 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:19:29.763689 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93185a8e-cf9a-4ae1-bc26-9027f21bc548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:19:29.764386 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93185a8e-cf9a-4ae1-bc26-9027f21bc548 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:29.764667 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93185a8e-cf9a-4ae1-bc26-9027f21bc548 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:29.764941 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93185a8e-cf9a-4ae1-bc26-9027f21bc548 admin admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:29.768833 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93185a8e-cf9a-4ae1-bc26-9027f21bc548 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:19:29.769179 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93185a8e-cf9a-4ae1-bc26-9027f21bc548 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:19:29.770914 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93185a8e-cf9a-4ae1-bc26-9027f21bc548 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:19:29.799363 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1474/2944] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:19:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 21:19:29.803497 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2a7982-bc7e-4603-8c2b-b77f30ba952f None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:19:29.832029 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2a7982-bc7e-4603-8c2b-b77f30ba952f None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:19:29.837671 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ec125d-41ef-4995-9fa3-a3f4edbc50d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:19:29.838389 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ec125d-41ef-4995-9fa3-a3f4edbc50d2 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:29.838664 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ec125d-41ef-4995-9fa3-a3f4edbc50d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:29.838933 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ec125d-41ef-4995-9fa3-a3f4edbc50d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:29.839643 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ec125d-41ef-4995-9fa3-a3f4edbc50d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:19:29.841550 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ec125d-41ef-4995-9fa3-a3f4edbc50d2 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:19:29.919963 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1471/2945] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:19:29 2022] POST /identity/v3/projects => generated 375 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:19:29.924248 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93185a8e-cf9a-4ae1-bc26-9027f21bc548 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:19:29.940215 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93185a8e-cf9a-4ae1-bc26-9027f21bc548 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:19:30.088294 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f254cd-f805-4cbd-bea4-d860a42ca9be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:19:30.088987 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f254cd-f805-4cbd-bea4-d860a42ca9be admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:30.089485 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f254cd-f805-4cbd-bea4-d860a42ca9be admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:30.090120 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f254cd-f805-4cbd-bea4-d860a42ca9be admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:30.090511 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f254cd-f805-4cbd-bea4-d860a42ca9be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:19:30.092780 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f254cd-f805-4cbd-bea4-d860a42ca9be admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:19:30.124578 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1475/2946] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:19:29 2022] POST /identity/v3/users => generated 288 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:19:30.128707 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ec125d-41ef-4995-9fa3-a3f4edbc50d2 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:19:30.145921 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ec125d-41ef-4995-9fa3-a3f4edbc50d2 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:19:30.154509 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67422568-f061-4312-8659-5da4823ef263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:19:30.155590 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67422568-f061-4312-8659-5da4823ef263 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:30.156422 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67422568-f061-4312-8659-5da4823ef263 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:30.157131 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67422568-f061-4312-8659-5da4823ef263 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:30.158484 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67422568-f061-4312-8659-5da4823ef263 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:19:30.160294 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67422568-f061-4312-8659-5da4823ef263 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:19:30.177435 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1472/2947] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:19:30 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:19:30.180809 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f254cd-f805-4cbd-bea4-d860a42ca9be admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:19:30.194469 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f254cd-f805-4cbd-bea4-d860a42ca9be admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:19:30.203888 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564ecb54-7184-452c-b21f-09adbfa2a075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:19:30.205200 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564ecb54-7184-452c-b21f-09adbfa2a075 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:30.205494 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564ecb54-7184-452c-b21f-09adbfa2a075 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:30.205776 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564ecb54-7184-452c-b21f-09adbfa2a075 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:30.207229 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564ecb54-7184-452c-b21f-09adbfa2a075 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:19:30.209145 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564ecb54-7184-452c-b21f-09adbfa2a075 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:19:30.225949 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1476/2948] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:19:30 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:19:30.229518 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67422568-f061-4312-8659-5da4823ef263 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:19:30.245923 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67422568-f061-4312-8659-5da4823ef263 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:19:30.261306 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824cdb49-00bf-4c11-9a2e-236c8b5e4290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:19:30.262382 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824cdb49-00bf-4c11-9a2e-236c8b5e4290 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:30.262698 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824cdb49-00bf-4c11-9a2e-236c8b5e4290 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:30.262929 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824cdb49-00bf-4c11-9a2e-236c8b5e4290 admin admin] PATH_INFO: `/v3/projects/45e12cf4efbe4a53a50519da849ca401/users/3df07b06af4947df8d8b93c0bd7cef14/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:30.287260 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:19:30.293673 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824cdb49-00bf-4c11-9a2e-236c8b5e4290 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45e12cf4efbe4a53a50519da849ca401, user_id=3df07b06af4947df8d8b93c0bd7cef14, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:19:30.298665 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824cdb49-00bf-4c11-9a2e-236c8b5e4290 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:19:30.322593 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1473/2949] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:19:30 2022] PUT /identity/v3/projects/45e12cf4efbe4a53a50519da849ca401/users/3df07b06af4947df8d8b93c0bd7cef14/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:19:30.336606 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209f1dd7-228d-4270-a4ec-e3eb88d182c8 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:30.336892 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209f1dd7-228d-4270-a4ec-e3eb88d182c8 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:30.337171 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209f1dd7-228d-4270-a4ec-e3eb88d182c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:30.405278 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-209f1dd7-228d-4270-a4ec-e3eb88d182c8 None None] MFA Rules not processed for user `3df07b06af4947df8d8b93c0bd7cef14`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:19:30.407942 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-209f1dd7-228d-4270-a4ec-e3eb88d182c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:19:30.494746 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1477/2950] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:19:30 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:19:30.499436 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824cdb49-00bf-4c11-9a2e-236c8b5e4290 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:19:30.613207 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824cdb49-00bf-4c11-9a2e-236c8b5e4290 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:19:30.620489 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d44d7b-380a-413a-bd58-b43201abf373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:19:30.621190 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d44d7b-380a-413a-bd58-b43201abf373 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:30.621465 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d44d7b-380a-413a-bd58-b43201abf373 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:30.621735 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d44d7b-380a-413a-bd58-b43201abf373 admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:30.622869 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d44d7b-380a-413a-bd58-b43201abf373 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:19:30.627369 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d44d7b-380a-413a-bd58-b43201abf373 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:19:30.677484 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209f1dd7-228d-4270-a4ec-e3eb88d182c8 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:19:30.690181 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1474/2951] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:19:30 2022] POST /identity/v3/projects => generated 371 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:19:30.694427 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209f1dd7-228d-4270-a4ec-e3eb88d182c8 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:19:30.725596 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:19:30.830180 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5a93b9-de0d-4820-97e6-6e9eefcf5468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:19:30.831826 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5a93b9-de0d-4820-97e6-6e9eefcf5468 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:30.832277 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5a93b9-de0d-4820-97e6-6e9eefcf5468 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:30.834213 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5a93b9-de0d-4820-97e6-6e9eefcf5468 admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:30.835747 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5a93b9-de0d-4820-97e6-6e9eefcf5468 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:19:30.837367 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5a93b9-de0d-4820-97e6-6e9eefcf5468 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:19:30.894616 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1478/2952] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:19:30 2022] POST /identity/v3/users => generated 292 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:19:30.899564 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d44d7b-380a-413a-bd58-b43201abf373 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:19:30.916398 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d44d7b-380a-413a-bd58-b43201abf373 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:19:30.924921 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c185128-3207-4335-b048-23e457beab75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:19:30.925763 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c185128-3207-4335-b048-23e457beab75 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:30.926070 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c185128-3207-4335-b048-23e457beab75 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:30.926340 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c185128-3207-4335-b048-23e457beab75 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:30.927070 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c185128-3207-4335-b048-23e457beab75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:19:30.930491 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c185128-3207-4335-b048-23e457beab75 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:19:30.947560 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1475/2953] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:19:30 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:19:30.952008 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5a93b9-de0d-4820-97e6-6e9eefcf5468 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:19:30.968258 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5a93b9-de0d-4820-97e6-6e9eefcf5468 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:19:30.975334 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f03772-abf1-4b4d-a772-88bd40c5cf44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:19:30.976267 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f03772-abf1-4b4d-a772-88bd40c5cf44 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:30.976542 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f03772-abf1-4b4d-a772-88bd40c5cf44 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:30.977489 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f03772-abf1-4b4d-a772-88bd40c5cf44 admin admin] PATH_INFO: `/v3/projects/58275fa1edba4f24bfbe78d0cf79bd3c/users/6bc8e4b4f284423eadb98c7ca7a834d2/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:31.000457 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f03772-abf1-4b4d-a772-88bd40c5cf44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58275fa1edba4f24bfbe78d0cf79bd3c, user_id=6bc8e4b4f284423eadb98c7ca7a834d2, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:19:31.007675 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f03772-abf1-4b4d-a772-88bd40c5cf44 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:19:31.036838 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c185128-3207-4335-b048-23e457beab75 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:19:31.038544 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1479/2954] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:19:30 2022] PUT /identity/v3/projects/58275fa1edba4f24bfbe78d0cf79bd3c/users/6bc8e4b4f284423eadb98c7ca7a834d2/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:19:31.051688 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c185128-3207-4335-b048-23e457beab75 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:19:31.147320 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df03836-55cb-4e7b-a622-5edf17f8da1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:19:31.149010 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df03836-55cb-4e7b-a622-5edf17f8da1c admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:31.154241 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df03836-55cb-4e7b-a622-5edf17f8da1c admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:31.154648 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df03836-55cb-4e7b-a622-5edf17f8da1c admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:31.155544 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df03836-55cb-4e7b-a622-5edf17f8da1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:19:31.160257 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df03836-55cb-4e7b-a622-5edf17f8da1c admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:19:31.190794 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f03772-abf1-4b4d-a772-88bd40c5cf44 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:19:31.193587 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1476/2955] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:19:31 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:19:31.210218 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f03772-abf1-4b4d-a772-88bd40c5cf44 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:19:31.216135 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f70bb1-bfb4-4c29-9f1b-9a5fdcb4229f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:19:31.218160 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f70bb1-bfb4-4c29-9f1b-9a5fdcb4229f admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:31.219641 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f70bb1-bfb4-4c29-9f1b-9a5fdcb4229f admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:31.220848 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f70bb1-bfb4-4c29-9f1b-9a5fdcb4229f admin admin] PATH_INFO: `/v3/projects/58275fa1edba4f24bfbe78d0cf79bd3c/users/6bc8e4b4f284423eadb98c7ca7a834d2/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:31.224599 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f70bb1-bfb4-4c29-9f1b-9a5fdcb4229f admin admin] RBAC: Authorizing `identity:create_grant(project_id=58275fa1edba4f24bfbe78d0cf79bd3c, user_id=6bc8e4b4f284423eadb98c7ca7a834d2, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:19:31.230669 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f70bb1-bfb4-4c29-9f1b-9a5fdcb4229f admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:19:31.251500 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1480/2956] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:19:31 2022] PUT /identity/v3/projects/58275fa1edba4f24bfbe78d0cf79bd3c/users/6bc8e4b4f284423eadb98c7ca7a834d2/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:19:31.262793 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25110fd6-2fba-4abe-9834-b2c2d39c0d35 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:31.262793 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25110fd6-2fba-4abe-9834-b2c2d39c0d35 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:31.263085 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25110fd6-2fba-4abe-9834-b2c2d39c0d35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:31.292978 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-25110fd6-2fba-4abe-9834-b2c2d39c0d35 None None] MFA Rules not processed for user `6bc8e4b4f284423eadb98c7ca7a834d2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:19:31.294827 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-25110fd6-2fba-4abe-9834-b2c2d39c0d35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:19:31.403509 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:19:31.458405 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1477/2957] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:19:31 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:19:31.466257 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f70bb1-bfb4-4c29-9f1b-9a5fdcb4229f admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:19:31.483930 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f70bb1-bfb4-4c29-9f1b-9a5fdcb4229f admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:19:31.497207 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296e8583-f01c-47cb-8dfe-caf8c6467766 tempest-QuotasAdminTestV257-54075716 tempest-QuotasAdminTestV257-54075716-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bc8e4b4f284423eadb98c7ca7a834d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58275fa1edba4f24bfbe78d0cf79bd3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:19:31.500696 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296e8583-f01c-47cb-8dfe-caf8c6467766 tempest-QuotasAdminTestV257-54075716 tempest-QuotasAdminTestV257-54075716-project-admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:31.501156 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296e8583-f01c-47cb-8dfe-caf8c6467766 tempest-QuotasAdminTestV257-54075716 tempest-QuotasAdminTestV257-54075716-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:31.501732 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296e8583-f01c-47cb-8dfe-caf8c6467766 tempest-QuotasAdminTestV257-54075716 tempest-QuotasAdminTestV257-54075716-project-admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:31.514624 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296e8583-f01c-47cb-8dfe-caf8c6467766 tempest-QuotasAdminTestV257-54075716 tempest-QuotasAdminTestV257-54075716-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:19:31.517041 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296e8583-f01c-47cb-8dfe-caf8c6467766 tempest-QuotasAdminTestV257-54075716 tempest-QuotasAdminTestV257-54075716-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:19:31.520676 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296e8583-f01c-47cb-8dfe-caf8c6467766 tempest-QuotasAdminTestV257-54075716 tempest-QuotasAdminTestV257-54075716-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:19:31.549751 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1481/2958] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:19:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:19:31.555017 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25110fd6-2fba-4abe-9834-b2c2d39c0d35 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:19:31.569075 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25110fd6-2fba-4abe-9834-b2c2d39c0d35 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:19:31.585469 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84f319d-82cb-4da8-8b82-8687460da5cc tempest-QuotasAdminTestV257-54075716 tempest-QuotasAdminTestV257-54075716-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bc8e4b4f284423eadb98c7ca7a834d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58275fa1edba4f24bfbe78d0cf79bd3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:19:31.588691 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84f319d-82cb-4da8-8b82-8687460da5cc tempest-QuotasAdminTestV257-54075716 tempest-QuotasAdminTestV257-54075716-project-admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:31.591391 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84f319d-82cb-4da8-8b82-8687460da5cc tempest-QuotasAdminTestV257-54075716 tempest-QuotasAdminTestV257-54075716-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:31.592393 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84f319d-82cb-4da8-8b82-8687460da5cc tempest-QuotasAdminTestV257-54075716 tempest-QuotasAdminTestV257-54075716-project-admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:31.594617 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84f319d-82cb-4da8-8b82-8687460da5cc tempest-QuotasAdminTestV257-54075716 tempest-QuotasAdminTestV257-54075716-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:19:31.601094 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84f319d-82cb-4da8-8b82-8687460da5cc tempest-QuotasAdminTestV257-54075716 tempest-QuotasAdminTestV257-54075716-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:19:31.663974 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1478/2959] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:19:31 2022] POST /identity/v3/projects => generated 371 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:19:31.669252 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296e8583-f01c-47cb-8dfe-caf8c6467766 tempest-QuotasAdminTestV257-54075716 tempest-QuotasAdminTestV257-54075716-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:19:31.684040 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296e8583-f01c-47cb-8dfe-caf8c6467766 tempest-QuotasAdminTestV257-54075716 tempest-QuotasAdminTestV257-54075716-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:19:31.831573 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9844f2a7-73cb-4a14-8f8d-2a2ab524c73c tempest-QuotasAdminTestV257-54075716 tempest-QuotasAdminTestV257-54075716-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bc8e4b4f284423eadb98c7ca7a834d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58275fa1edba4f24bfbe78d0cf79bd3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:19:31.832433 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9844f2a7-73cb-4a14-8f8d-2a2ab524c73c tempest-QuotasAdminTestV257-54075716 tempest-QuotasAdminTestV257-54075716-project-admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:31.832786 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9844f2a7-73cb-4a14-8f8d-2a2ab524c73c tempest-QuotasAdminTestV257-54075716 tempest-QuotasAdminTestV257-54075716-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:31.833156 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9844f2a7-73cb-4a14-8f8d-2a2ab524c73c tempest-QuotasAdminTestV257-54075716 tempest-QuotasAdminTestV257-54075716-project-admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:31.834006 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9844f2a7-73cb-4a14-8f8d-2a2ab524c73c tempest-QuotasAdminTestV257-54075716 tempest-QuotasAdminTestV257-54075716-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:19:31.834553 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9844f2a7-73cb-4a14-8f8d-2a2ab524c73c tempest-QuotasAdminTestV257-54075716 tempest-QuotasAdminTestV257-54075716-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:19:31.839394 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9844f2a7-73cb-4a14-8f8d-2a2ab524c73c tempest-QuotasAdminTestV257-54075716 tempest-QuotasAdminTestV257-54075716-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:19:31.873665 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1482/2960] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:19:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:19:32.327167 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84f319d-82cb-4da8-8b82-8687460da5cc tempest-QuotasAdminTestV257-54075716 tempest-QuotasAdminTestV257-54075716-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:19:32.330144 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-b84f319d-82cb-4da8-8b82-8687460da5cc tempest-QuotasAdminTestV257-54075716 tempest-QuotasAdminTestV257-54075716-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:19:32.481944 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84f319d-82cb-4da8-8b82-8687460da5cc tempest-QuotasAdminTestV257-54075716 tempest-QuotasAdminTestV257-54075716-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:19:32.490698 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72fef6a-a375-4a0e-a50e-7f48c921597e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:19:32.491432 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72fef6a-a375-4a0e-a50e-7f48c921597e service nova] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:32.491716 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72fef6a-a375-4a0e-a50e-7f48c921597e service nova] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:32.491986 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72fef6a-a375-4a0e-a50e-7f48c921597e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:32.502919 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72fef6a-a375-4a0e-a50e-7f48c921597e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:19:32.505005 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72fef6a-a375-4a0e-a50e-7f48c921597e service nova] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:19:32.537947 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1479/2961] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:19:32 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:19:32.548208 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7ab293-75dd-47f7-8c73-8afdaf4fcf70 None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:32.549436 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7ab293-75dd-47f7-8c73-8afdaf4fcf70 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:32.550090 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7ab293-75dd-47f7-8c73-8afdaf4fcf70 None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:32.553003 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1483/2962] 10.222.0.17 () {54 vars in 912 bytes} [Sat Jul 23 21:19:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:19:32.577676 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72fef6a-a375-4a0e-a50e-7f48c921597e service nova] Authenticating service token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 23 21:19:32.592279 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72fef6a-a375-4a0e-a50e-7f48c921597e service nova] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:19:32.603567 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72fef6a-a375-4a0e-a50e-7f48c921597e service nova] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:19:32.614147 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b4a39d-a1bc-46f6-9967-32f82db9074f tempest-QuotasAdminTestV257-54075716 tempest-QuotasAdminTestV257-54075716-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bc8e4b4f284423eadb98c7ca7a834d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58275fa1edba4f24bfbe78d0cf79bd3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:19:32.615050 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b4a39d-a1bc-46f6-9967-32f82db9074f tempest-QuotasAdminTestV257-54075716 tempest-QuotasAdminTestV257-54075716-project-admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:32.615334 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b4a39d-a1bc-46f6-9967-32f82db9074f tempest-QuotasAdminTestV257-54075716 tempest-QuotasAdminTestV257-54075716-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:32.615609 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b4a39d-a1bc-46f6-9967-32f82db9074f tempest-QuotasAdminTestV257-54075716 tempest-QuotasAdminTestV257-54075716-project-admin] PATH_INFO: `/v3/projects/49ce2303160e4094b185f091dbec959e` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:32.616846 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b4a39d-a1bc-46f6-9967-32f82db9074f tempest-QuotasAdminTestV257-54075716 tempest-QuotasAdminTestV257-54075716-project-admin] RBAC: Authorizing `identity:get_project(project_id=49ce2303160e4094b185f091dbec959e)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:19:32.619338 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b4a39d-a1bc-46f6-9967-32f82db9074f tempest-QuotasAdminTestV257-54075716 tempest-QuotasAdminTestV257-54075716-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:19:32.633296 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1480/2963] 10.222.0.17 () {58 vars in 1443 bytes} [Sat Jul 23 21:19:32 2022] GET /identity/v3/projects/49ce2303160e4094b185f091dbec959e => generated 371 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:19:33.124505 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4d571e-60a8-4092-8b10-4f6325d465af None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:33.125621 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4d571e-60a8-4092-8b10-4f6325d465af None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:33.126217 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4d571e-60a8-4092-8b10-4f6325d465af None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:33.128388 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1484/2964] 10.222.0.17 () {54 vars in 912 bytes} [Sat Jul 23 21:19:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:19:33.134305 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b4a39d-a1bc-46f6-9967-32f82db9074f tempest-QuotasAdminTestV257-54075716 tempest-QuotasAdminTestV257-54075716-project-admin] Authenticating service token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 23 21:19:33.136731 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-b3b4a39d-a1bc-46f6-9967-32f82db9074f tempest-QuotasAdminTestV257-54075716 tempest-QuotasAdminTestV257-54075716-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:19:33.164950 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b4a39d-a1bc-46f6-9967-32f82db9074f tempest-QuotasAdminTestV257-54075716 tempest-QuotasAdminTestV257-54075716-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:19:33.190689 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b4a39d-a1bc-46f6-9967-32f82db9074f tempest-QuotasAdminTestV257-54075716 tempest-QuotasAdminTestV257-54075716-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:19:33.204081 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c673ecf-13c0-4a23-82e0-2f852aa811ae tempest-QuotasAdminTestV257-54075716 tempest-QuotasAdminTestV257-54075716-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bc8e4b4f284423eadb98c7ca7a834d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58275fa1edba4f24bfbe78d0cf79bd3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:19:33.204981 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c673ecf-13c0-4a23-82e0-2f852aa811ae tempest-QuotasAdminTestV257-54075716 tempest-QuotasAdminTestV257-54075716-project-admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:33.205258 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c673ecf-13c0-4a23-82e0-2f852aa811ae tempest-QuotasAdminTestV257-54075716 tempest-QuotasAdminTestV257-54075716-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:33.205534 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c673ecf-13c0-4a23-82e0-2f852aa811ae tempest-QuotasAdminTestV257-54075716 tempest-QuotasAdminTestV257-54075716-project-admin] PATH_INFO: `/v3/projects/49ce2303160e4094b185f091dbec959e` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:33.208839 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c673ecf-13c0-4a23-82e0-2f852aa811ae tempest-QuotasAdminTestV257-54075716 tempest-QuotasAdminTestV257-54075716-project-admin] RBAC: Authorizing `identity:get_project(project_id=49ce2303160e4094b185f091dbec959e)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:19:33.211159 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c673ecf-13c0-4a23-82e0-2f852aa811ae tempest-QuotasAdminTestV257-54075716 tempest-QuotasAdminTestV257-54075716-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:19:33.215499 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1481/2965] 10.222.0.17 () {58 vars in 1443 bytes} [Sat Jul 23 21:19:33 2022] GET /identity/v3/projects/49ce2303160e4094b185f091dbec959e => generated 371 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:19:33.333747 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4d571e-60a8-4092-8b10-4f6325d465af None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:19:33.368660 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4d571e-60a8-4092-8b10-4f6325d465af None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:19:33.382025 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fac654d-1f5b-4c57-adfd-3d60efba3bd4 tempest-QuotasAdminTestV257-54075716 tempest-QuotasAdminTestV257-54075716-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bc8e4b4f284423eadb98c7ca7a834d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58275fa1edba4f24bfbe78d0cf79bd3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:19:33.382830 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fac654d-1f5b-4c57-adfd-3d60efba3bd4 tempest-QuotasAdminTestV257-54075716 tempest-QuotasAdminTestV257-54075716-project-admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:33.383223 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fac654d-1f5b-4c57-adfd-3d60efba3bd4 tempest-QuotasAdminTestV257-54075716 tempest-QuotasAdminTestV257-54075716-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:33.383581 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fac654d-1f5b-4c57-adfd-3d60efba3bd4 tempest-QuotasAdminTestV257-54075716 tempest-QuotasAdminTestV257-54075716-project-admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:33.384576 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fac654d-1f5b-4c57-adfd-3d60efba3bd4 tempest-QuotasAdminTestV257-54075716 tempest-QuotasAdminTestV257-54075716-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:19:33.387550 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fac654d-1f5b-4c57-adfd-3d60efba3bd4 tempest-QuotasAdminTestV257-54075716 tempest-QuotasAdminTestV257-54075716-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:19:33.389686 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fac654d-1f5b-4c57-adfd-3d60efba3bd4 tempest-QuotasAdminTestV257-54075716 tempest-QuotasAdminTestV257-54075716-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:19:33.423643 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1485/2966] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:19:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:19:33.425468 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c673ecf-13c0-4a23-82e0-2f852aa811ae tempest-QuotasAdminTestV257-54075716 tempest-QuotasAdminTestV257-54075716-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:19:33.439995 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c673ecf-13c0-4a23-82e0-2f852aa811ae tempest-QuotasAdminTestV257-54075716 tempest-QuotasAdminTestV257-54075716-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:19:33.454339 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d98dd36-0c0b-45b2-a4a7-eef7f2988016 tempest-QuotasAdminTestV257-54075716 tempest-QuotasAdminTestV257-54075716-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bc8e4b4f284423eadb98c7ca7a834d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58275fa1edba4f24bfbe78d0cf79bd3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:19:33.455191 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d98dd36-0c0b-45b2-a4a7-eef7f2988016 tempest-QuotasAdminTestV257-54075716 tempest-QuotasAdminTestV257-54075716-project-admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:33.455593 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d98dd36-0c0b-45b2-a4a7-eef7f2988016 tempest-QuotasAdminTestV257-54075716 tempest-QuotasAdminTestV257-54075716-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:33.455994 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d98dd36-0c0b-45b2-a4a7-eef7f2988016 tempest-QuotasAdminTestV257-54075716 tempest-QuotasAdminTestV257-54075716-project-admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:33.466189 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d98dd36-0c0b-45b2-a4a7-eef7f2988016 tempest-QuotasAdminTestV257-54075716 tempest-QuotasAdminTestV257-54075716-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:19:33.471050 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d98dd36-0c0b-45b2-a4a7-eef7f2988016 tempest-QuotasAdminTestV257-54075716 tempest-QuotasAdminTestV257-54075716-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:19:33.515515 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1482/2967] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:19:33 2022] POST /identity/v3/users => generated 381 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:19:33.520033 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fac654d-1f5b-4c57-adfd-3d60efba3bd4 tempest-QuotasAdminTestV257-54075716 tempest-QuotasAdminTestV257-54075716-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:19:33.534142 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fac654d-1f5b-4c57-adfd-3d60efba3bd4 tempest-QuotasAdminTestV257-54075716 tempest-QuotasAdminTestV257-54075716-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:19:33.547067 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9edacd5-d149-474c-9307-8a339dae49fc tempest-QuotasAdminTestV257-54075716 tempest-QuotasAdminTestV257-54075716-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bc8e4b4f284423eadb98c7ca7a834d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58275fa1edba4f24bfbe78d0cf79bd3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:19:33.548007 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9edacd5-d149-474c-9307-8a339dae49fc tempest-QuotasAdminTestV257-54075716 tempest-QuotasAdminTestV257-54075716-project-admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:33.548449 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9edacd5-d149-474c-9307-8a339dae49fc tempest-QuotasAdminTestV257-54075716 tempest-QuotasAdminTestV257-54075716-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:33.549331 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9edacd5-d149-474c-9307-8a339dae49fc tempest-QuotasAdminTestV257-54075716 tempest-QuotasAdminTestV257-54075716-project-admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:33.550271 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9edacd5-d149-474c-9307-8a339dae49fc tempest-QuotasAdminTestV257-54075716 tempest-QuotasAdminTestV257-54075716-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:19:33.550746 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9edacd5-d149-474c-9307-8a339dae49fc tempest-QuotasAdminTestV257-54075716 tempest-QuotasAdminTestV257-54075716-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:19:33.552711 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9edacd5-d149-474c-9307-8a339dae49fc tempest-QuotasAdminTestV257-54075716 tempest-QuotasAdminTestV257-54075716-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:19:33.586198 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1486/2968] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:19:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:19:34.335030 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5872104c-92e9-4e8c-8186-f4b89caa0d80 None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:34.335585 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5872104c-92e9-4e8c-8186-f4b89caa0d80 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:34.336069 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5872104c-92e9-4e8c-8186-f4b89caa0d80 None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:34.338843 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1483/2969] 10.222.0.17 () {54 vars in 912 bytes} [Sat Jul 23 21:19:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:19:34.360363 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9edacd5-d149-474c-9307-8a339dae49fc tempest-QuotasAdminTestV257-54075716 tempest-QuotasAdminTestV257-54075716-project-admin] Authenticating service token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 23 21:19:34.397098 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9edacd5-d149-474c-9307-8a339dae49fc tempest-QuotasAdminTestV257-54075716 tempest-QuotasAdminTestV257-54075716-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:19:34.418729 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9edacd5-d149-474c-9307-8a339dae49fc tempest-QuotasAdminTestV257-54075716 tempest-QuotasAdminTestV257-54075716-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:19:34.431043 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b5f0db-d7d5-4288-b867-1d0ba4a76301 tempest-QuotasAdminTestV257-54075716 tempest-QuotasAdminTestV257-54075716-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bc8e4b4f284423eadb98c7ca7a834d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58275fa1edba4f24bfbe78d0cf79bd3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:19:34.432306 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b5f0db-d7d5-4288-b867-1d0ba4a76301 tempest-QuotasAdminTestV257-54075716 tempest-QuotasAdminTestV257-54075716-project-admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:34.433094 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b5f0db-d7d5-4288-b867-1d0ba4a76301 tempest-QuotasAdminTestV257-54075716 tempest-QuotasAdminTestV257-54075716-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:34.433502 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b5f0db-d7d5-4288-b867-1d0ba4a76301 tempest-QuotasAdminTestV257-54075716 tempest-QuotasAdminTestV257-54075716-project-admin] PATH_INFO: `/v3/projects/49ce2303160e4094b185f091dbec959e` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:34.435555 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b5f0db-d7d5-4288-b867-1d0ba4a76301 tempest-QuotasAdminTestV257-54075716 tempest-QuotasAdminTestV257-54075716-project-admin] RBAC: Authorizing `identity:get_project(project_id=49ce2303160e4094b185f091dbec959e)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:19:34.437739 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b5f0db-d7d5-4288-b867-1d0ba4a76301 tempest-QuotasAdminTestV257-54075716 tempest-QuotasAdminTestV257-54075716-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:19:34.439571 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1487/2970] 10.222.0.17 () {58 vars in 1443 bytes} [Sat Jul 23 21:19:34 2022] GET /identity/v3/projects/49ce2303160e4094b185f091dbec959e => generated 371 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:19:34.746512 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cba8a4-23b3-4b87-98a4-74a91755068a None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:34.747083 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cba8a4-23b3-4b87-98a4-74a91755068a None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:34.747083 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cba8a4-23b3-4b87-98a4-74a91755068a None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:34.748426 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1484/2971] 10.222.0.17 () {54 vars in 921 bytes} [Sat Jul 23 21:19:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:19:34.768776 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae21b1d9-fd3c-42a0-ab1a-a6ab769ea75f None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:34.769316 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae21b1d9-fd3c-42a0-ab1a-a6ab769ea75f None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:34.769316 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae21b1d9-fd3c-42a0-ab1a-a6ab769ea75f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:34.805464 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-ae21b1d9-fd3c-42a0-ab1a-a6ab769ea75f None None] MFA Rules not processed for user `abc719a3b3ac4461b82ca04ab6451d81`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:19:34.818696 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-ae21b1d9-fd3c-42a0-ab1a-a6ab769ea75f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:19:34.824725 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cba8a4-23b3-4b87-98a4-74a91755068a None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:19:34.855790 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cba8a4-23b3-4b87-98a4-74a91755068a None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:19:34.864477 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:19:34.865315 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e5aa67-d644-4a8d-9d83-a5e0b89c974d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:19:34.866170 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e5aa67-d644-4a8d-9d83-a5e0b89c974d service nova] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:34.866455 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e5aa67-d644-4a8d-9d83-a5e0b89c974d service nova] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:34.866730 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e5aa67-d644-4a8d-9d83-a5e0b89c974d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:34.870695 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-e4e5aa67-d644-4a8d-9d83-a5e0b89c974d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:19:34.988699 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1488/2972] 10.222.0.17 () {58 vars in 1018 bytes} [Sat Jul 23 21:19:34 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:19:35.016946 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae21b1d9-fd3c-42a0-ab1a-a6ab769ea75f None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:19:35.018413 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-ae21b1d9-fd3c-42a0-ab1a-a6ab769ea75f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:19:35.041511 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae21b1d9-fd3c-42a0-ab1a-a6ab769ea75f None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:19:35.058181 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e5aa67-d644-4a8d-9d83-a5e0b89c974d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:19:35.058744 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5140d6cd-3a45-42f8-a227-8bdd92d0eb28 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc719a3b3ac4461b82ca04ab6451d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:19:35.059418 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5140d6cd-3a45-42f8-a227-8bdd92d0eb28 service placement] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:35.059881 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5140d6cd-3a45-42f8-a227-8bdd92d0eb28 service placement] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:35.060308 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5140d6cd-3a45-42f8-a227-8bdd92d0eb28 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:35.076689 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5140d6cd-3a45-42f8-a227-8bdd92d0eb28 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:19:35.078579 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5140d6cd-3a45-42f8-a227-8bdd92d0eb28 service placement] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:19:35.085223 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e5aa67-d644-4a8d-9d83-a5e0b89c974d service nova] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:19:35.100970 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1489/2973] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:19:35 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 23 21:19:35.128101 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1485/2974] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:19:34 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 23 21:19:35.865776 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5140d6cd-3a45-42f8-a227-8bdd92d0eb28 service placement] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:19:35.868442 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-5140d6cd-3a45-42f8-a227-8bdd92d0eb28 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:19:35.951353 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5140d6cd-3a45-42f8-a227-8bdd92d0eb28 service placement] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:19:35.956407 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c99d88-ce1b-4b7b-9ee2-36cc33b53ad3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:19:35.957154 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c99d88-ce1b-4b7b-9ee2-36cc33b53ad3 service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:35.957509 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c99d88-ce1b-4b7b-9ee2-36cc33b53ad3 service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:35.957849 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c99d88-ce1b-4b7b-9ee2-36cc33b53ad3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:35.963657 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-18c99d88-ce1b-4b7b-9ee2-36cc33b53ad3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:19:35.988027 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c99d88-ce1b-4b7b-9ee2-36cc33b53ad3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:19:35.988027 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c99d88-ce1b-4b7b-9ee2-36cc33b53ad3 service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:19:35.999336 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e5aa67-d644-4a8d-9d83-a5e0b89c974d service nova] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:19:36.005562 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1490/2975] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:19:35 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:19:36.012809 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e5aa67-d644-4a8d-9d83-a5e0b89c974d service nova] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:19:36.020694 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b6a0bc-cac4-436b-8a3f-f3d89123a760 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:19:36.021574 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b6a0bc-cac4-436b-8a3f-f3d89123a760 service nova] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:36.022099 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b6a0bc-cac4-436b-8a3f-f3d89123a760 service nova] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:36.022573 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b6a0bc-cac4-436b-8a3f-f3d89123a760 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:36.024696 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-a1b6a0bc-cac4-436b-8a3f-f3d89123a760 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:19:36.033977 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:19:36.118417 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b6a0bc-cac4-436b-8a3f-f3d89123a760 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:19:36.120434 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b6a0bc-cac4-436b-8a3f-f3d89123a760 service nova] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:19:36.146725 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1486/2976] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:19:35 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:19:37.076781 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1d2402-8ad9-4ca2-8ce6-217c7e9d2108 None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:37.077616 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1d2402-8ad9-4ca2-8ce6-217c7e9d2108 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:37.078267 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1d2402-8ad9-4ca2-8ce6-217c7e9d2108 None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:37.079854 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1491/2977] 10.222.0.17 () {54 vars in 912 bytes} [Sat Jul 23 21:19:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:19:37.088229 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b6a0bc-cac4-436b-8a3f-f3d89123a760 service nova] Authenticating service token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 23 21:19:37.108661 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b6a0bc-cac4-436b-8a3f-f3d89123a760 service nova] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:19:37.132444 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b6a0bc-cac4-436b-8a3f-f3d89123a760 service nova] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:19:37.138123 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b171a20f-cbf6-4e5b-baad-97601639b438 tempest-QuotasAdminTestV257-54075716 tempest-QuotasAdminTestV257-54075716-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bc8e4b4f284423eadb98c7ca7a834d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58275fa1edba4f24bfbe78d0cf79bd3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:19:37.139242 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b171a20f-cbf6-4e5b-baad-97601639b438 tempest-QuotasAdminTestV257-54075716 tempest-QuotasAdminTestV257-54075716-project-admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:37.139732 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b171a20f-cbf6-4e5b-baad-97601639b438 tempest-QuotasAdminTestV257-54075716 tempest-QuotasAdminTestV257-54075716-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:37.140344 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b171a20f-cbf6-4e5b-baad-97601639b438 tempest-QuotasAdminTestV257-54075716 tempest-QuotasAdminTestV257-54075716-project-admin] PATH_INFO: `/v3/projects/49ce2303160e4094b185f091dbec959e` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:37.141808 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b171a20f-cbf6-4e5b-baad-97601639b438 tempest-QuotasAdminTestV257-54075716 tempest-QuotasAdminTestV257-54075716-project-admin] RBAC: Authorizing `identity:get_project(project_id=49ce2303160e4094b185f091dbec959e)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:19:37.143972 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b171a20f-cbf6-4e5b-baad-97601639b438 tempest-QuotasAdminTestV257-54075716 tempest-QuotasAdminTestV257-54075716-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:19:37.146139 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1487/2978] 10.222.0.17 () {58 vars in 1443 bytes} [Sat Jul 23 21:19:37 2022] GET /identity/v3/projects/49ce2303160e4094b185f091dbec959e => generated 371 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:19:37.178845 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1d2402-8ad9-4ca2-8ce6-217c7e9d2108 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:19:37.195211 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1d2402-8ad9-4ca2-8ce6-217c7e9d2108 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:19:37.201767 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262051bd-2208-4ceb-abcd-d735151cba8d tempest-QuotasAdminTestV257-54075716 tempest-QuotasAdminTestV257-54075716-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bc8e4b4f284423eadb98c7ca7a834d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58275fa1edba4f24bfbe78d0cf79bd3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:19:37.203494 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262051bd-2208-4ceb-abcd-d735151cba8d tempest-QuotasAdminTestV257-54075716 tempest-QuotasAdminTestV257-54075716-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:37.203881 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262051bd-2208-4ceb-abcd-d735151cba8d tempest-QuotasAdminTestV257-54075716 tempest-QuotasAdminTestV257-54075716-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:37.204401 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262051bd-2208-4ceb-abcd-d735151cba8d tempest-QuotasAdminTestV257-54075716 tempest-QuotasAdminTestV257-54075716-project-admin] PATH_INFO: `/v3/users/b33b55782e5a4c36b9c9d20d87d9c135` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:37.226558 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262051bd-2208-4ceb-abcd-d735151cba8d tempest-QuotasAdminTestV257-54075716 tempest-QuotasAdminTestV257-54075716-project-admin] RBAC: Authorizing `identity:delete_user(user_id=b33b55782e5a4c36b9c9d20d87d9c135)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:19:37.228802 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262051bd-2208-4ceb-abcd-d735151cba8d tempest-QuotasAdminTestV257-54075716 tempest-QuotasAdminTestV257-54075716-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:19:37.342219 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-262051bd-2208-4ceb-abcd-d735151cba8d tempest-QuotasAdminTestV257-54075716 tempest-QuotasAdminTestV257-54075716-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b33b55782e5a4c36b9c9d20d87d9c135'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:19:37.344912 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-262051bd-2208-4ceb-abcd-d735151cba8d tempest-QuotasAdminTestV257-54075716 tempest-QuotasAdminTestV257-54075716-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b33b55782e5a4c36b9c9d20d87d9c135'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:19:37.362714 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-262051bd-2208-4ceb-abcd-d735151cba8d tempest-QuotasAdminTestV257-54075716 tempest-QuotasAdminTestV257-54075716-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b33b55782e5a4c36b9c9d20d87d9c135'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:19:37.385823 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-262051bd-2208-4ceb-abcd-d735151cba8d tempest-QuotasAdminTestV257-54075716 tempest-QuotasAdminTestV257-54075716-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b33b55782e5a4c36b9c9d20d87d9c135'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:19:37.402756 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-262051bd-2208-4ceb-abcd-d735151cba8d tempest-QuotasAdminTestV257-54075716 tempest-QuotasAdminTestV257-54075716-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b33b55782e5a4c36b9c9d20d87d9c135'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:19:37.411386 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1492/2979] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:19:37 2022] DELETE /identity/v3/users/b33b55782e5a4c36b9c9d20d87d9c135 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:19:37.415852 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b171a20f-cbf6-4e5b-baad-97601639b438 tempest-QuotasAdminTestV257-54075716 tempest-QuotasAdminTestV257-54075716-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:19:37.417893 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-b171a20f-cbf6-4e5b-baad-97601639b438 tempest-QuotasAdminTestV257-54075716 tempest-QuotasAdminTestV257-54075716-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:19:37.434422 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b171a20f-cbf6-4e5b-baad-97601639b438 tempest-QuotasAdminTestV257-54075716 tempest-QuotasAdminTestV257-54075716-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:19:37.522194 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae0c2f6-0199-425b-bf9c-0b4f3210e389 tempest-QuotasAdminTestV257-54075716 tempest-QuotasAdminTestV257-54075716-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bc8e4b4f284423eadb98c7ca7a834d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58275fa1edba4f24bfbe78d0cf79bd3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:19:37.523469 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae0c2f6-0199-425b-bf9c-0b4f3210e389 tempest-QuotasAdminTestV257-54075716 tempest-QuotasAdminTestV257-54075716-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:37.523971 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae0c2f6-0199-425b-bf9c-0b4f3210e389 tempest-QuotasAdminTestV257-54075716 tempest-QuotasAdminTestV257-54075716-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:37.524366 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae0c2f6-0199-425b-bf9c-0b4f3210e389 tempest-QuotasAdminTestV257-54075716 tempest-QuotasAdminTestV257-54075716-project-admin] PATH_INFO: `/v3/projects/49ce2303160e4094b185f091dbec959e` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:37.525705 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae0c2f6-0199-425b-bf9c-0b4f3210e389 tempest-QuotasAdminTestV257-54075716 tempest-QuotasAdminTestV257-54075716-project-admin] RBAC: Authorizing `identity:delete_project(project_id=49ce2303160e4094b185f091dbec959e)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:19:37.527834 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae0c2f6-0199-425b-bf9c-0b4f3210e389 tempest-QuotasAdminTestV257-54075716 tempest-QuotasAdminTestV257-54075716-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:19:37.605689 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-cae0c2f6-0199-425b-bf9c-0b4f3210e389 tempest-QuotasAdminTestV257-54075716 tempest-QuotasAdminTestV257-54075716-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49ce2303160e4094b185f091dbec959e', 'request_id': 'req-cae0c2f6-0199-425b-bf9c-0b4f3210e389'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:19:37.629376 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-cae0c2f6-0199-425b-bf9c-0b4f3210e389 tempest-QuotasAdminTestV257-54075716 tempest-QuotasAdminTestV257-54075716-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49ce2303160e4094b185f091dbec959e', 'request_id': 'req-cae0c2f6-0199-425b-bf9c-0b4f3210e389'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:19:37.648361 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-cae0c2f6-0199-425b-bf9c-0b4f3210e389 tempest-QuotasAdminTestV257-54075716 tempest-QuotasAdminTestV257-54075716-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49ce2303160e4094b185f091dbec959e', 'request_id': 'req-cae0c2f6-0199-425b-bf9c-0b4f3210e389'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:19:37.674518 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-cae0c2f6-0199-425b-bf9c-0b4f3210e389 tempest-QuotasAdminTestV257-54075716 tempest-QuotasAdminTestV257-54075716-project-admin] The token cache is being invalidate because project 49ce2303160e4094b185f091dbec959e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:19:37.675101 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-cae0c2f6-0199-425b-bf9c-0b4f3210e389 tempest-QuotasAdminTestV257-54075716 tempest-QuotasAdminTestV257-54075716-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:19:37.676044 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-cae0c2f6-0199-425b-bf9c-0b4f3210e389 tempest-QuotasAdminTestV257-54075716 tempest-QuotasAdminTestV257-54075716-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:19:37.679997 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1488/2980] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:19:37 2022] DELETE /identity/v3/projects/49ce2303160e4094b185f091dbec959e => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:19:37.685048 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262051bd-2208-4ceb-abcd-d735151cba8d tempest-QuotasAdminTestV257-54075716 tempest-QuotasAdminTestV257-54075716-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:19:37.686744 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-262051bd-2208-4ceb-abcd-d735151cba8d tempest-QuotasAdminTestV257-54075716 tempest-QuotasAdminTestV257-54075716-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:19:37.710005 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:19:37.793487 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262051bd-2208-4ceb-abcd-d735151cba8d tempest-QuotasAdminTestV257-54075716 tempest-QuotasAdminTestV257-54075716-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:19:37.893936 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffa947f-2f17-4249-a714-ebd81296b63b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:19:37.895880 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffa947f-2f17-4249-a714-ebd81296b63b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:37.896371 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffa947f-2f17-4249-a714-ebd81296b63b admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:37.897037 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffa947f-2f17-4249-a714-ebd81296b63b admin admin] PATH_INFO: `/v3/users/3df07b06af4947df8d8b93c0bd7cef14` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:37.900165 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffa947f-2f17-4249-a714-ebd81296b63b admin admin] RBAC: Authorizing `identity:delete_user(user_id=3df07b06af4947df8d8b93c0bd7cef14)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:19:37.903721 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffa947f-2f17-4249-a714-ebd81296b63b admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:19:37.964114 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-6ffa947f-2f17-4249-a714-ebd81296b63b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3df07b06af4947df8d8b93c0bd7cef14'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:19:37.966861 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-6ffa947f-2f17-4249-a714-ebd81296b63b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3df07b06af4947df8d8b93c0bd7cef14'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:19:37.976660 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-6ffa947f-2f17-4249-a714-ebd81296b63b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3df07b06af4947df8d8b93c0bd7cef14'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:19:37.987296 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-6ffa947f-2f17-4249-a714-ebd81296b63b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3df07b06af4947df8d8b93c0bd7cef14'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:19:38.004765 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-6ffa947f-2f17-4249-a714-ebd81296b63b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3df07b06af4947df8d8b93c0bd7cef14'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:19:38.013455 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1493/2981] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:19:37 2022] DELETE /identity/v3/users/3df07b06af4947df8d8b93c0bd7cef14 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:19:38.018182 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f02fc7-5067-46a2-a8bc-ad68ac24d0ab None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:38.019533 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f02fc7-5067-46a2-a8bc-ad68ac24d0ab None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:38.019916 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f02fc7-5067-46a2-a8bc-ad68ac24d0ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:38.051162 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-13f02fc7-5067-46a2-a8bc-ad68ac24d0ab None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:19:38.058583 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-13f02fc7-5067-46a2-a8bc-ad68ac24d0ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:19:38.091106 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:19:38.173213 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1489/2982] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:19:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:19:38.278703 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffa947f-2f17-4249-a714-ebd81296b63b admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:19:38.280698 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-6ffa947f-2f17-4249-a714-ebd81296b63b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:19:38.365031 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:19:38.417251 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffa947f-2f17-4249-a714-ebd81296b63b admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:19:38.421534 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed8beb3-927a-4edb-929b-fada38afb8d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:19:38.422787 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed8beb3-927a-4edb-929b-fada38afb8d9 service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:38.423074 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed8beb3-927a-4edb-929b-fada38afb8d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:38.423469 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed8beb3-927a-4edb-929b-fada38afb8d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:38.435735 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed8beb3-927a-4edb-929b-fada38afb8d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:19:38.437999 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed8beb3-927a-4edb-929b-fada38afb8d9 service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:19:38.453632 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1494/2983] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:19:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:19:38.914446 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bbb6a1-5bda-4528-ab8c-7fefc934490f None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:38.914744 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bbb6a1-5bda-4528-ab8c-7fefc934490f None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:38.915151 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bbb6a1-5bda-4528-ab8c-7fefc934490f None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:38.916979 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1490/2984] 10.222.0.17 () {54 vars in 921 bytes} [Sat Jul 23 21:19:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:19:38.922391 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a89e5dc-3a33-4ba2-9a04-8bb6e2bd717a None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:38.923285 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a89e5dc-3a33-4ba2-9a04-8bb6e2bd717a None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:38.924567 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a89e5dc-3a33-4ba2-9a04-8bb6e2bd717a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:38.954294 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-2a89e5dc-3a33-4ba2-9a04-8bb6e2bd717a None None] MFA Rules not processed for user `abc719a3b3ac4461b82ca04ab6451d81`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:19:38.955638 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-2a89e5dc-3a33-4ba2-9a04-8bb6e2bd717a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:19:39.045665 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1495/2985] 10.222.0.17 () {58 vars in 1018 bytes} [Sat Jul 23 21:19:38 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:19:39.064646 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bbb6a1-5bda-4528-ab8c-7fefc934490f None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:19:39.066600 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-e3bbb6a1-5bda-4528-ab8c-7fefc934490f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:19:39.087366 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bbb6a1-5bda-4528-ab8c-7fefc934490f None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:19:39.095592 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb459f15-7668-46b1-bfe7-157747cc9f20 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc719a3b3ac4461b82ca04ab6451d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:19:39.097657 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb459f15-7668-46b1-bfe7-157747cc9f20 service placement] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:39.098392 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb459f15-7668-46b1-bfe7-157747cc9f20 service placement] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:39.098817 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb459f15-7668-46b1-bfe7-157747cc9f20 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:39.116116 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb459f15-7668-46b1-bfe7-157747cc9f20 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:19:39.118237 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb459f15-7668-46b1-bfe7-157747cc9f20 service placement] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:19:39.138397 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1491/2986] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:19:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:19:39.607089 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a89e5dc-3a33-4ba2-9a04-8bb6e2bd717a None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:19:39.624816 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a89e5dc-3a33-4ba2-9a04-8bb6e2bd717a None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:19:39.639438 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af0fa90-7840-4119-a906-0943bf0debd9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc719a3b3ac4461b82ca04ab6451d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:19:39.640721 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af0fa90-7840-4119-a906-0943bf0debd9 service placement] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:39.643227 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af0fa90-7840-4119-a906-0943bf0debd9 service placement] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:39.643864 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af0fa90-7840-4119-a906-0943bf0debd9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:39.649359 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-8af0fa90-7840-4119-a906-0943bf0debd9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:19:39.681900 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af0fa90-7840-4119-a906-0943bf0debd9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:19:39.689311 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af0fa90-7840-4119-a906-0943bf0debd9 service placement] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:19:39.724057 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1496/2987] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:19:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 23 21:19:40.295342 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb459f15-7668-46b1-bfe7-157747cc9f20 service placement] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:19:40.299503 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-bb459f15-7668-46b1-bfe7-157747cc9f20 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:19:40.327721 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb459f15-7668-46b1-bfe7-157747cc9f20 service placement] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:19:40.340720 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c54ced-d590-49db-afdf-684d79e64604 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:19:40.342434 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c54ced-d590-49db-afdf-684d79e64604 service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:40.342944 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c54ced-d590-49db-afdf-684d79e64604 service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:40.344673 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c54ced-d590-49db-afdf-684d79e64604 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:40.353478 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-14c54ced-d590-49db-afdf-684d79e64604 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:19:40.561006 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c54ced-d590-49db-afdf-684d79e64604 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:19:40.562825 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c54ced-d590-49db-afdf-684d79e64604 service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:19:40.595866 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1492/2988] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:19:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:19:40.656208 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af0fa90-7840-4119-a906-0943bf0debd9 service placement] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:19:40.673822 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af0fa90-7840-4119-a906-0943bf0debd9 service placement] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:19:40.679275 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4049b50c-1b81-4cbe-8c8e-554c5c8bedc8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:19:40.680502 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4049b50c-1b81-4cbe-8c8e-554c5c8bedc8 service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:40.681001 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4049b50c-1b81-4cbe-8c8e-554c5c8bedc8 service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:40.681565 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4049b50c-1b81-4cbe-8c8e-554c5c8bedc8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:40.686119 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-4049b50c-1b81-4cbe-8c8e-554c5c8bedc8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:19:40.698798 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4049b50c-1b81-4cbe-8c8e-554c5c8bedc8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:19:40.703015 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4049b50c-1b81-4cbe-8c8e-554c5c8bedc8 service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:19:40.727663 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1497/2989] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:19:40 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:19:41.368965 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c54ced-d590-49db-afdf-684d79e64604 service neutron] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:19:41.370760 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-14c54ced-d590-49db-afdf-684d79e64604 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:19:41.400400 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c54ced-d590-49db-afdf-684d79e64604 service neutron] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:19:41.417223 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70671db9-d44f-47ee-b04a-824c7d4997ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:19:41.418415 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70671db9-d44f-47ee-b04a-824c7d4997ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:41.418892 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70671db9-d44f-47ee-b04a-824c7d4997ac admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:41.419356 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70671db9-d44f-47ee-b04a-824c7d4997ac admin admin] PATH_INFO: `/v3/projects/45e12cf4efbe4a53a50519da849ca401` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:41.421770 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70671db9-d44f-47ee-b04a-824c7d4997ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=45e12cf4efbe4a53a50519da849ca401)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:19:41.425051 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70671db9-d44f-47ee-b04a-824c7d4997ac admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:19:41.509751 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-70671db9-d44f-47ee-b04a-824c7d4997ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45e12cf4efbe4a53a50519da849ca401', 'request_id': 'req-70671db9-d44f-47ee-b04a-824c7d4997ac'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:19:41.521697 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-70671db9-d44f-47ee-b04a-824c7d4997ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45e12cf4efbe4a53a50519da849ca401', 'request_id': 'req-70671db9-d44f-47ee-b04a-824c7d4997ac'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:19:41.541283 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-70671db9-d44f-47ee-b04a-824c7d4997ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45e12cf4efbe4a53a50519da849ca401', 'request_id': 'req-70671db9-d44f-47ee-b04a-824c7d4997ac'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:19:41.583141 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-70671db9-d44f-47ee-b04a-824c7d4997ac admin admin] The token cache is being invalidate because project 45e12cf4efbe4a53a50519da849ca401 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:19:41.583983 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-70671db9-d44f-47ee-b04a-824c7d4997ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:19:41.587091 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-70671db9-d44f-47ee-b04a-824c7d4997ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:19:41.590398 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1493/2990] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:19:41 2022] DELETE /identity/v3/projects/45e12cf4efbe4a53a50519da849ca401 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:19:41.594552 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4049b50c-1b81-4cbe-8c8e-554c5c8bedc8 service neutron] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:19:41.620790 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4049b50c-1b81-4cbe-8c8e-554c5c8bedc8 service neutron] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:19:41.753592 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bd5f4f-5fa7-46bc-b03d-1451ce355663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:19:41.755793 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bd5f4f-5fa7-46bc-b03d-1451ce355663 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:41.756259 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bd5f4f-5fa7-46bc-b03d-1451ce355663 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:41.757375 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bd5f4f-5fa7-46bc-b03d-1451ce355663 admin admin] PATH_INFO: `/v3/users/6bc8e4b4f284423eadb98c7ca7a834d2` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:41.758836 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bd5f4f-5fa7-46bc-b03d-1451ce355663 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6bc8e4b4f284423eadb98c7ca7a834d2)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:19:41.761153 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bd5f4f-5fa7-46bc-b03d-1451ce355663 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:19:41.845275 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-e5bd5f4f-5fa7-46bc-b03d-1451ce355663 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6bc8e4b4f284423eadb98c7ca7a834d2'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:19:41.846074 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-e5bd5f4f-5fa7-46bc-b03d-1451ce355663 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6bc8e4b4f284423eadb98c7ca7a834d2'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:19:41.849829 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:19:41.859257 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-e5bd5f4f-5fa7-46bc-b03d-1451ce355663 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6bc8e4b4f284423eadb98c7ca7a834d2'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:19:41.872700 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-e5bd5f4f-5fa7-46bc-b03d-1451ce355663 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6bc8e4b4f284423eadb98c7ca7a834d2'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:19:41.887744 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-e5bd5f4f-5fa7-46bc-b03d-1451ce355663 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6bc8e4b4f284423eadb98c7ca7a834d2'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:19:41.898236 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1498/2991] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:19:41 2022] DELETE /identity/v3/users/6bc8e4b4f284423eadb98c7ca7a834d2 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:19:43.154334 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70671db9-d44f-47ee-b04a-824c7d4997ac admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:19:43.155959 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-70671db9-d44f-47ee-b04a-824c7d4997ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:19:43.180617 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70671db9-d44f-47ee-b04a-824c7d4997ac admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:19:43.200566 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:19:43.379061 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff5a135-6da6-4d1a-8348-78d8a73a9458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:19:43.379061 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff5a135-6da6-4d1a-8348-78d8a73a9458 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:43.379061 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff5a135-6da6-4d1a-8348-78d8a73a9458 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:43.379061 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff5a135-6da6-4d1a-8348-78d8a73a9458 admin admin] PATH_INFO: `/v3/projects/58275fa1edba4f24bfbe78d0cf79bd3c` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:43.388955 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff5a135-6da6-4d1a-8348-78d8a73a9458 admin admin] RBAC: Authorizing `identity:delete_project(project_id=58275fa1edba4f24bfbe78d0cf79bd3c)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:19:43.392379 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff5a135-6da6-4d1a-8348-78d8a73a9458 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:19:43.507344 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-cff5a135-6da6-4d1a-8348-78d8a73a9458 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58275fa1edba4f24bfbe78d0cf79bd3c', 'request_id': 'req-cff5a135-6da6-4d1a-8348-78d8a73a9458'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:19:43.526796 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-cff5a135-6da6-4d1a-8348-78d8a73a9458 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58275fa1edba4f24bfbe78d0cf79bd3c', 'request_id': 'req-cff5a135-6da6-4d1a-8348-78d8a73a9458'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:19:43.534285 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-cff5a135-6da6-4d1a-8348-78d8a73a9458 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58275fa1edba4f24bfbe78d0cf79bd3c', 'request_id': 'req-cff5a135-6da6-4d1a-8348-78d8a73a9458'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:19:43.559446 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-cff5a135-6da6-4d1a-8348-78d8a73a9458 admin admin] The token cache is being invalidate because project 58275fa1edba4f24bfbe78d0cf79bd3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:19:43.559446 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-cff5a135-6da6-4d1a-8348-78d8a73a9458 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:19:43.560657 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-cff5a135-6da6-4d1a-8348-78d8a73a9458 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:19:43.568166 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1494/2992] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:19:43 2022] DELETE /identity/v3/projects/58275fa1edba4f24bfbe78d0cf79bd3c => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:19:43.574732 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ffef7a-f957-43d1-ac11-af649c3fd038 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:43.575694 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ffef7a-f957-43d1-ac11-af649c3fd038 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:43.576152 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ffef7a-f957-43d1-ac11-af649c3fd038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:43.632533 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-70ffef7a-f957-43d1-ac11-af649c3fd038 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:19:43.634197 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-70ffef7a-f957-43d1-ac11-af649c3fd038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:19:43.769439 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1499/2993] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:19:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:19:43.778508 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cec9068-e4f7-4b8f-b7e1-1b7a6ceca48d None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:43.779091 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cec9068-e4f7-4b8f-b7e1-1b7a6ceca48d None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:43.779571 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cec9068-e4f7-4b8f-b7e1-1b7a6ceca48d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:43.809575 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-2cec9068-e4f7-4b8f-b7e1-1b7a6ceca48d None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:19:43.811210 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-2cec9068-e4f7-4b8f-b7e1-1b7a6ceca48d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:19:43.824500 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1495/2994] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:19:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:19:43.825905 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ffef7a-f957-43d1-ac11-af649c3fd038 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:19:43.838024 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ffef7a-f957-43d1-ac11-af649c3fd038 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:19:43.845049 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bebf573-e307-4443-94f4-4828c6b29daa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:19:43.845788 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bebf573-e307-4443-94f4-4828c6b29daa admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:43.846225 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bebf573-e307-4443-94f4-4828c6b29daa admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:43.846730 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bebf573-e307-4443-94f4-4828c6b29daa admin admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:43.848774 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bebf573-e307-4443-94f4-4828c6b29daa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:19:43.849219 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bebf573-e307-4443-94f4-4828c6b29daa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:19:43.853051 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bebf573-e307-4443-94f4-4828c6b29daa admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:19:43.870885 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1500/2995] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:19:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 21:19:43.875606 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cec9068-e4f7-4b8f-b7e1-1b7a6ceca48d None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:19:43.894106 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cec9068-e4f7-4b8f-b7e1-1b7a6ceca48d None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:19:43.904990 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8fb83f-e71e-471b-8177-1ac1ee8e8b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:19:43.905798 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8fb83f-e71e-471b-8177-1ac1ee8e8b61 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:43.906565 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8fb83f-e71e-471b-8177-1ac1ee8e8b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:43.906565 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8fb83f-e71e-471b-8177-1ac1ee8e8b61 admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:43.907310 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8fb83f-e71e-471b-8177-1ac1ee8e8b61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:19:43.911096 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8fb83f-e71e-471b-8177-1ac1ee8e8b61 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:19:43.938663 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2ccede-dca6-4903-9775-e16e520c35dc None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:43.941831 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2ccede-dca6-4903-9775-e16e520c35dc None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:43.942189 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2ccede-dca6-4903-9775-e16e520c35dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:43.972408 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-0e2ccede-dca6-4903-9775-e16e520c35dc None None] MFA Rules not processed for user `7578019c30174bc888279bf5009c0f4b`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:19:43.974420 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-0e2ccede-dca6-4903-9775-e16e520c35dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:19:44.006578 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1496/2996] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:19:43 2022] POST /identity/v3/projects => generated 373 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:19:44.008657 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8fb83f-e71e-471b-8177-1ac1ee8e8b61 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:19:44.123571 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1501/2997] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:19:43 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:19:44.136878 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739b4a7e-568b-4c60-9a45-62a857bda62f None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:44.137312 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739b4a7e-568b-4c60-9a45-62a857bda62f None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:44.137605 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739b4a7e-568b-4c60-9a45-62a857bda62f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:44.174910 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-739b4a7e-568b-4c60-9a45-62a857bda62f None None] MFA Rules not processed for user `7578019c30174bc888279bf5009c0f4b`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:19:44.179485 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-739b4a7e-568b-4c60-9a45-62a857bda62f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:19:44.182254 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8fb83f-e71e-471b-8177-1ac1ee8e8b61 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:19:44.195687 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18190ce-d785-4955-b780-b79fc9e86e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:19:44.199250 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18190ce-d785-4955-b780-b79fc9e86e31 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:44.199616 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18190ce-d785-4955-b780-b79fc9e86e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:44.199966 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18190ce-d785-4955-b780-b79fc9e86e31 admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:44.200693 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18190ce-d785-4955-b780-b79fc9e86e31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:19:44.203404 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18190ce-d785-4955-b780-b79fc9e86e31 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:19:44.232414 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1497/2998] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:19:44 2022] POST /identity/v3/users => generated 287 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:19:44.237442 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18190ce-d785-4955-b780-b79fc9e86e31 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:19:44.250447 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18190ce-d785-4955-b780-b79fc9e86e31 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:19:44.256895 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef32818-b16a-4c61-b8d9-0d99fd206fc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:19:44.258025 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef32818-b16a-4c61-b8d9-0d99fd206fc7 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:44.258450 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef32818-b16a-4c61-b8d9-0d99fd206fc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:44.258751 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef32818-b16a-4c61-b8d9-0d99fd206fc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:44.259907 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef32818-b16a-4c61-b8d9-0d99fd206fc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:19:44.261783 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef32818-b16a-4c61-b8d9-0d99fd206fc7 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:19:44.304754 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:19:44.318473 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1502/2999] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:19:44 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:19:44.331873 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1498/3000] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:19:44 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:19:44.336239 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739b4a7e-568b-4c60-9a45-62a857bda62f None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:19:44.347764 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:19:44.354581 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739b4a7e-568b-4c60-9a45-62a857bda62f None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:19:44.369632 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52f5d70-be19-4753-82fc-aed870f74502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:19:44.370411 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52f5d70-be19-4753-82fc-aed870f74502 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:44.370746 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52f5d70-be19-4753-82fc-aed870f74502 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:44.371033 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52f5d70-be19-4753-82fc-aed870f74502 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:44.371784 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52f5d70-be19-4753-82fc-aed870f74502 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:19:44.373709 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52f5d70-be19-4753-82fc-aed870f74502 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:19:44.395347 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1503/3001] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:19:44 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 21:19:44.400495 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef32818-b16a-4c61-b8d9-0d99fd206fc7 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:19:44.422320 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef32818-b16a-4c61-b8d9-0d99fd206fc7 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:19:44.444504 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304f7c07-f642-4627-800f-453dd63c555e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:19:44.446151 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304f7c07-f642-4627-800f-453dd63c555e admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:44.446652 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304f7c07-f642-4627-800f-453dd63c555e admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:44.447267 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304f7c07-f642-4627-800f-453dd63c555e admin admin] PATH_INFO: `/v3/projects/c7af16c62b144aa0972331a69e3638c3/users/3ef41817e4f5478bb7afdcb59ed634cd/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:44.480532 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304f7c07-f642-4627-800f-453dd63c555e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7af16c62b144aa0972331a69e3638c3, user_id=3ef41817e4f5478bb7afdcb59ed634cd, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:19:44.483999 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304f7c07-f642-4627-800f-453dd63c555e admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:19:44.535322 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1499/3002] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:19:44 2022] PUT /identity/v3/projects/c7af16c62b144aa0972331a69e3638c3/users/3ef41817e4f5478bb7afdcb59ed634cd/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:19:44.617736 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe3b2a8-b53d-447d-be4b-51e45684b045 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:44.620569 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe3b2a8-b53d-447d-be4b-51e45684b045 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:44.621053 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe3b2a8-b53d-447d-be4b-51e45684b045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:44.696629 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-9fe3b2a8-b53d-447d-be4b-51e45684b045 None None] MFA Rules not processed for user `3ef41817e4f5478bb7afdcb59ed634cd`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:19:44.698368 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-9fe3b2a8-b53d-447d-be4b-51e45684b045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:19:44.917299 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304f7c07-f642-4627-800f-453dd63c555e admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:19:44.917995 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1504/3003] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:19:44 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:19:45.072008 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304f7c07-f642-4627-800f-453dd63c555e admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:19:45.092944 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607fb4e8-8920-4cbb-ab67-6a2f58897179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:19:45.093680 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607fb4e8-8920-4cbb-ab67-6a2f58897179 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:45.094024 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607fb4e8-8920-4cbb-ab67-6a2f58897179 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:45.094277 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607fb4e8-8920-4cbb-ab67-6a2f58897179 admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:45.095409 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607fb4e8-8920-4cbb-ab67-6a2f58897179 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:19:45.097599 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607fb4e8-8920-4cbb-ab67-6a2f58897179 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:19:45.207165 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe3b2a8-b53d-447d-be4b-51e45684b045 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:19:45.216542 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1500/3004] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:19:44 2022] POST /identity/v3/projects => generated 373 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:19:45.223307 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe3b2a8-b53d-447d-be4b-51e45684b045 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:19:45.389208 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073d362d-6a00-4228-85a1-7abb8505c266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:19:45.391198 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073d362d-6a00-4228-85a1-7abb8505c266 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:45.393783 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073d362d-6a00-4228-85a1-7abb8505c266 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:45.394309 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073d362d-6a00-4228-85a1-7abb8505c266 admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:45.395167 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073d362d-6a00-4228-85a1-7abb8505c266 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:19:45.402521 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073d362d-6a00-4228-85a1-7abb8505c266 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:19:45.485660 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607fb4e8-8920-4cbb-ab67-6a2f58897179 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:19:45.496348 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1505/3005] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:19:45 2022] POST /identity/v3/users => generated 293 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:19:45.509163 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607fb4e8-8920-4cbb-ab67-6a2f58897179 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:19:45.528224 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6bcb41-b5d3-4c13-893f-e0b892342cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:19:45.531747 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6bcb41-b5d3-4c13-893f-e0b892342cf9 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:45.532230 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6bcb41-b5d3-4c13-893f-e0b892342cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:45.533214 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6bcb41-b5d3-4c13-893f-e0b892342cf9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:45.536606 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6bcb41-b5d3-4c13-893f-e0b892342cf9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:19:45.541255 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6bcb41-b5d3-4c13-893f-e0b892342cf9 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:19:45.576178 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1501/3006] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:19:45 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:19:45.581935 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073d362d-6a00-4228-85a1-7abb8505c266 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:19:45.596250 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073d362d-6a00-4228-85a1-7abb8505c266 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:19:45.601214 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fb41b7-f68e-4ce6-9193-c6326e37e312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:19:45.602160 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fb41b7-f68e-4ce6-9193-c6326e37e312 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:45.602667 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fb41b7-f68e-4ce6-9193-c6326e37e312 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:45.603318 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fb41b7-f68e-4ce6-9193-c6326e37e312 admin admin] PATH_INFO: `/v3/projects/27b46a6297f44be6908d72b8b7dac7c5/users/acdb5e01ae4140c4b52f2494a63b68b8/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:45.628538 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fb41b7-f68e-4ce6-9193-c6326e37e312 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27b46a6297f44be6908d72b8b7dac7c5, user_id=acdb5e01ae4140c4b52f2494a63b68b8, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:19:45.635590 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fb41b7-f68e-4ce6-9193-c6326e37e312 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:19:45.663045 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1506/3007] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:19:45 2022] PUT /identity/v3/projects/27b46a6297f44be6908d72b8b7dac7c5/users/acdb5e01ae4140c4b52f2494a63b68b8/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:19:45.667081 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6bcb41-b5d3-4c13-893f-e0b892342cf9 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:19:45.683036 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6bcb41-b5d3-4c13-893f-e0b892342cf9 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:19:45.830634 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511eb76d-7837-4706-9b31-7ec2c009e2c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:19:45.831870 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511eb76d-7837-4706-9b31-7ec2c009e2c6 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:45.832618 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511eb76d-7837-4706-9b31-7ec2c009e2c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:45.833951 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511eb76d-7837-4706-9b31-7ec2c009e2c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:45.835320 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511eb76d-7837-4706-9b31-7ec2c009e2c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:19:45.838789 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511eb76d-7837-4706-9b31-7ec2c009e2c6 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:19:45.858658 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1502/3008] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:19:45 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:19:45.859858 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fb41b7-f68e-4ce6-9193-c6326e37e312 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:19:45.876395 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fb41b7-f68e-4ce6-9193-c6326e37e312 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:19:45.891415 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f46b45a-96b5-4af4-b84a-3945a89fc651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:19:45.892494 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f46b45a-96b5-4af4-b84a-3945a89fc651 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:45.892837 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f46b45a-96b5-4af4-b84a-3945a89fc651 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:45.893341 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f46b45a-96b5-4af4-b84a-3945a89fc651 admin admin] PATH_INFO: `/v3/projects/27b46a6297f44be6908d72b8b7dac7c5/users/acdb5e01ae4140c4b52f2494a63b68b8/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:45.898015 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f46b45a-96b5-4af4-b84a-3945a89fc651 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27b46a6297f44be6908d72b8b7dac7c5, user_id=acdb5e01ae4140c4b52f2494a63b68b8, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:19:45.901597 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f46b45a-96b5-4af4-b84a-3945a89fc651 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:19:45.917213 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1507/3009] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:19:45 2022] PUT /identity/v3/projects/27b46a6297f44be6908d72b8b7dac7c5/users/acdb5e01ae4140c4b52f2494a63b68b8/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:19:45.928425 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d2ed7f-40b8-4568-8069-a533bc8d8316 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:45.928637 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d2ed7f-40b8-4568-8069-a533bc8d8316 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:45.929012 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d2ed7f-40b8-4568-8069-a533bc8d8316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:45.966451 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-a6d2ed7f-40b8-4568-8069-a533bc8d8316 None None] MFA Rules not processed for user `acdb5e01ae4140c4b52f2494a63b68b8`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:19:45.981899 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-a6d2ed7f-40b8-4568-8069-a533bc8d8316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:19:46.031774 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:19:46.092643 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1503/3010] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:19:45 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:19:46.100278 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e5a7e9-0419-4fb7-af53-f20d03b56ae3 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:46.100799 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e5a7e9-0419-4fb7-af53-f20d03b56ae3 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:46.101091 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e5a7e9-0419-4fb7-af53-f20d03b56ae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:46.157761 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-89e5a7e9-0419-4fb7-af53-f20d03b56ae3 None None] MFA Rules not processed for user `3ef41817e4f5478bb7afdcb59ed634cd`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:19:46.159070 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-89e5a7e9-0419-4fb7-af53-f20d03b56ae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:19:46.210021 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:19:46.253306 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1508/3011] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:19:46 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:19:46.602812 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d2ed7f-40b8-4568-8069-a533bc8d8316 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:19:46.604263 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-a6d2ed7f-40b8-4568-8069-a533bc8d8316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:19:46.700474 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d2ed7f-40b8-4568-8069-a533bc8d8316 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:19:46.706798 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c638700-442c-46ac-9d25-8d7a89921ee7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:19:46.707974 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c638700-442c-46ac-9d25-8d7a89921ee7 service nova] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:46.708723 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c638700-442c-46ac-9d25-8d7a89921ee7 service nova] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:46.709223 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c638700-442c-46ac-9d25-8d7a89921ee7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:46.720362 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c638700-442c-46ac-9d25-8d7a89921ee7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:19:46.722341 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c638700-442c-46ac-9d25-8d7a89921ee7 service nova] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:19:46.735175 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1504/3012] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:19:46 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:19:47.728139 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e5a7e9-0419-4fb7-af53-f20d03b56ae3 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:19:47.745824 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e5a7e9-0419-4fb7-af53-f20d03b56ae3 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:19:47.754862 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90a2058-0da7-47a4-ac99-c79970974544 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:19:47.755982 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90a2058-0da7-47a4-ac99-c79970974544 service nova] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:47.756471 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90a2058-0da7-47a4-ac99-c79970974544 service nova] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:47.756945 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90a2058-0da7-47a4-ac99-c79970974544 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:47.759057 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-f90a2058-0da7-47a4-ac99-c79970974544 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:19:47.839705 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90a2058-0da7-47a4-ac99-c79970974544 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:19:47.841696 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90a2058-0da7-47a4-ac99-c79970974544 service nova] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:19:47.864043 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1509/3013] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:19:47 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:19:48.924742 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c638700-442c-46ac-9d25-8d7a89921ee7 service nova] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:19:48.926785 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-0c638700-442c-46ac-9d25-8d7a89921ee7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:19:49.050616 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c638700-442c-46ac-9d25-8d7a89921ee7 service nova] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:19:49.058528 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b21af37-d3f0-4263-b91d-06ba964aad11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:19:49.059528 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b21af37-d3f0-4263-b91d-06ba964aad11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:49.059868 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b21af37-d3f0-4263-b91d-06ba964aad11 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:49.060212 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b21af37-d3f0-4263-b91d-06ba964aad11 admin admin] PATH_INFO: `/v3/users/fe3ad614d9d24300adb274cc95120fd3` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:49.061546 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b21af37-d3f0-4263-b91d-06ba964aad11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe3ad614d9d24300adb274cc95120fd3)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:19:49.063954 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b21af37-d3f0-4263-b91d-06ba964aad11 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:19:49.139274 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-8b21af37-d3f0-4263-b91d-06ba964aad11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe3ad614d9d24300adb274cc95120fd3'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:19:49.151077 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-8b21af37-d3f0-4263-b91d-06ba964aad11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe3ad614d9d24300adb274cc95120fd3'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:19:49.151875 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-8b21af37-d3f0-4263-b91d-06ba964aad11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe3ad614d9d24300adb274cc95120fd3'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:19:49.154280 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:19:49.178431 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-8b21af37-d3f0-4263-b91d-06ba964aad11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe3ad614d9d24300adb274cc95120fd3'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:19:49.192410 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-8b21af37-d3f0-4263-b91d-06ba964aad11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe3ad614d9d24300adb274cc95120fd3'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:19:49.200116 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1505/3014] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:19:48 2022] DELETE /identity/v3/users/fe3ad614d9d24300adb274cc95120fd3 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:19:49.743854 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90a2058-0da7-47a4-ac99-c79970974544 service nova] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:19:49.775641 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90a2058-0da7-47a4-ac99-c79970974544 service nova] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:19:49.869731 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba91c66-22c6-438f-82dc-d3a710c75ab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:19:49.870974 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba91c66-22c6-438f-82dc-d3a710c75ab3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:49.871383 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba91c66-22c6-438f-82dc-d3a710c75ab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:49.871720 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba91c66-22c6-438f-82dc-d3a710c75ab3 admin admin] PATH_INFO: `/v3/projects/3811ea868f5649e8a235539a5bf46706` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:49.873491 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba91c66-22c6-438f-82dc-d3a710c75ab3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3811ea868f5649e8a235539a5bf46706)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:19:49.876010 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba91c66-22c6-438f-82dc-d3a710c75ab3 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:19:49.954771 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-7ba91c66-22c6-438f-82dc-d3a710c75ab3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3811ea868f5649e8a235539a5bf46706', 'request_id': 'req-7ba91c66-22c6-438f-82dc-d3a710c75ab3'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:19:49.966995 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-7ba91c66-22c6-438f-82dc-d3a710c75ab3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3811ea868f5649e8a235539a5bf46706', 'request_id': 'req-7ba91c66-22c6-438f-82dc-d3a710c75ab3'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:19:49.978186 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-7ba91c66-22c6-438f-82dc-d3a710c75ab3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3811ea868f5649e8a235539a5bf46706', 'request_id': 'req-7ba91c66-22c6-438f-82dc-d3a710c75ab3'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:19:50.008913 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-7ba91c66-22c6-438f-82dc-d3a710c75ab3 admin admin] The token cache is being invalidate because project 3811ea868f5649e8a235539a5bf46706 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:19:50.009431 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-7ba91c66-22c6-438f-82dc-d3a710c75ab3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:19:50.011384 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-7ba91c66-22c6-438f-82dc-d3a710c75ab3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:19:50.014636 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1510/3015] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:19:49 2022] DELETE /identity/v3/projects/3811ea868f5649e8a235539a5bf46706 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:19:50.018480 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b21af37-d3f0-4263-b91d-06ba964aad11 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:19:50.021217 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-8b21af37-d3f0-4263-b91d-06ba964aad11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:19:50.053759 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b21af37-d3f0-4263-b91d-06ba964aad11 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:19:50.184522 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b93d6a-8cc0-4411-88d5-8e557142fcbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:19:50.185707 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b93d6a-8cc0-4411-88d5-8e557142fcbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:50.186454 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b93d6a-8cc0-4411-88d5-8e557142fcbd admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:50.187027 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b93d6a-8cc0-4411-88d5-8e557142fcbd admin admin] PATH_INFO: `/v3/users/88e8ff3eff3b44a79f7e37f6adc361cd` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:50.189742 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b93d6a-8cc0-4411-88d5-8e557142fcbd admin admin] RBAC: Authorizing `identity:delete_user(user_id=88e8ff3eff3b44a79f7e37f6adc361cd)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:19:50.193098 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b93d6a-8cc0-4411-88d5-8e557142fcbd admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:19:50.303384 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-f6b93d6a-8cc0-4411-88d5-8e557142fcbd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88e8ff3eff3b44a79f7e37f6adc361cd'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:19:50.329376 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-f6b93d6a-8cc0-4411-88d5-8e557142fcbd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88e8ff3eff3b44a79f7e37f6adc361cd'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:19:50.331296 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-f6b93d6a-8cc0-4411-88d5-8e557142fcbd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88e8ff3eff3b44a79f7e37f6adc361cd'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:19:50.349098 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-f6b93d6a-8cc0-4411-88d5-8e557142fcbd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88e8ff3eff3b44a79f7e37f6adc361cd'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:19:50.368827 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-f6b93d6a-8cc0-4411-88d5-8e557142fcbd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88e8ff3eff3b44a79f7e37f6adc361cd'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:19:50.380089 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1506/3016] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:19:50 2022] DELETE /identity/v3/users/88e8ff3eff3b44a79f7e37f6adc361cd => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:19:50.870846 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba91c66-22c6-438f-82dc-d3a710c75ab3 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:19:50.872432 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-7ba91c66-22c6-438f-82dc-d3a710c75ab3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:19:50.906518 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba91c66-22c6-438f-82dc-d3a710c75ab3 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:19:50.921122 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:19:51.080583 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d57bf1-e894-46fa-8c75-b563d74e694a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:19:51.082609 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d57bf1-e894-46fa-8c75-b563d74e694a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:51.083087 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d57bf1-e894-46fa-8c75-b563d74e694a admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:51.086098 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d57bf1-e894-46fa-8c75-b563d74e694a admin admin] PATH_INFO: `/v3/projects/435823eb5eb144c0aa89671b1c12bb36` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:51.087851 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d57bf1-e894-46fa-8c75-b563d74e694a admin admin] RBAC: Authorizing `identity:delete_project(project_id=435823eb5eb144c0aa89671b1c12bb36)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:19:51.092787 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d57bf1-e894-46fa-8c75-b563d74e694a admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:19:51.207177 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-71d57bf1-e894-46fa-8c75-b563d74e694a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '435823eb5eb144c0aa89671b1c12bb36', 'request_id': 'req-71d57bf1-e894-46fa-8c75-b563d74e694a'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:19:51.233486 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-71d57bf1-e894-46fa-8c75-b563d74e694a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '435823eb5eb144c0aa89671b1c12bb36', 'request_id': 'req-71d57bf1-e894-46fa-8c75-b563d74e694a'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:19:51.243958 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-71d57bf1-e894-46fa-8c75-b563d74e694a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '435823eb5eb144c0aa89671b1c12bb36', 'request_id': 'req-71d57bf1-e894-46fa-8c75-b563d74e694a'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:19:51.264173 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-71d57bf1-e894-46fa-8c75-b563d74e694a admin admin] The token cache is being invalidate because project 435823eb5eb144c0aa89671b1c12bb36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:19:51.264413 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-71d57bf1-e894-46fa-8c75-b563d74e694a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:19:51.265082 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-71d57bf1-e894-46fa-8c75-b563d74e694a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:19:51.272517 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1511/3017] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:19:50 2022] DELETE /identity/v3/projects/435823eb5eb144c0aa89671b1c12bb36 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:19:51.273992 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6538f050-85ca-4167-b501-7c5f6608199c None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:51.274463 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6538f050-85ca-4167-b501-7c5f6608199c None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:51.274632 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6538f050-85ca-4167-b501-7c5f6608199c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:51.294689 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-6538f050-85ca-4167-b501-7c5f6608199c None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:19:51.296324 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-6538f050-85ca-4167-b501-7c5f6608199c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:19:51.362057 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:19:51.388450 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1507/3018] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:19:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:19:51.397414 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd28889-0eab-4b19-83fb-16cb24970829 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:51.398251 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd28889-0eab-4b19-83fb-16cb24970829 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:51.398588 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd28889-0eab-4b19-83fb-16cb24970829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:51.450955 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-6dd28889-0eab-4b19-83fb-16cb24970829 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:19:51.452219 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-6dd28889-0eab-4b19-83fb-16cb24970829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:19:51.466108 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1512/3019] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:19:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:19:51.470818 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6538f050-85ca-4167-b501-7c5f6608199c None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:19:51.483020 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6538f050-85ca-4167-b501-7c5f6608199c None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:19:51.490264 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de7306f-cdde-4e2f-999e-95f2e37d915f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:19:51.491468 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de7306f-cdde-4e2f-999e-95f2e37d915f admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:51.492051 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de7306f-cdde-4e2f-999e-95f2e37d915f admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:51.492575 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de7306f-cdde-4e2f-999e-95f2e37d915f admin admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:51.493769 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de7306f-cdde-4e2f-999e-95f2e37d915f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:19:51.494295 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de7306f-cdde-4e2f-999e-95f2e37d915f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:19:51.496810 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de7306f-cdde-4e2f-999e-95f2e37d915f admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:19:51.518695 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1508/3020] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:19:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:19:51.523284 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd28889-0eab-4b19-83fb-16cb24970829 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:19:51.537340 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd28889-0eab-4b19-83fb-16cb24970829 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:19:51.548077 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3537ca90-aa36-4eec-8851-3b369ff3c5e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:19:51.548845 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3537ca90-aa36-4eec-8851-3b369ff3c5e1 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:51.549189 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3537ca90-aa36-4eec-8851-3b369ff3c5e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:51.549674 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3537ca90-aa36-4eec-8851-3b369ff3c5e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:51.550460 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3537ca90-aa36-4eec-8851-3b369ff3c5e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:19:51.556355 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3537ca90-aa36-4eec-8851-3b369ff3c5e1 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:19:51.610358 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1513/3021] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:19:51 2022] POST /identity/v3/projects => generated 395 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:19:51.611544 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de7306f-cdde-4e2f-999e-95f2e37d915f admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:19:51.628523 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de7306f-cdde-4e2f-999e-95f2e37d915f admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:19:51.741578 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478420c8-1455-48fb-9aa5-95345c21b2ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:19:51.742637 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478420c8-1455-48fb-9aa5-95345c21b2ed admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:51.743228 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478420c8-1455-48fb-9aa5-95345c21b2ed admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:51.743660 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478420c8-1455-48fb-9aa5-95345c21b2ed admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:51.744517 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478420c8-1455-48fb-9aa5-95345c21b2ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:19:51.747401 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478420c8-1455-48fb-9aa5-95345c21b2ed admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:19:51.777453 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1509/3022] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:19:51 2022] POST /identity/v3/users => generated 298 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:19:51.782442 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3537ca90-aa36-4eec-8851-3b369ff3c5e1 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:19:51.795539 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3537ca90-aa36-4eec-8851-3b369ff3c5e1 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:19:51.804636 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4bb46a-3f2b-42eb-8a58-27f08e99ff1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:19:51.805359 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4bb46a-3f2b-42eb-8a58-27f08e99ff1d admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:51.805647 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4bb46a-3f2b-42eb-8a58-27f08e99ff1d admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:51.807125 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4bb46a-3f2b-42eb-8a58-27f08e99ff1d admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:51.809986 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4bb46a-3f2b-42eb-8a58-27f08e99ff1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:19:51.826561 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4bb46a-3f2b-42eb-8a58-27f08e99ff1d admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:19:51.857950 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1514/3023] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:19:51 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:19:51.861679 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478420c8-1455-48fb-9aa5-95345c21b2ed admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:19:51.877985 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478420c8-1455-48fb-9aa5-95345c21b2ed admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:19:51.884012 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c943b061-36f3-4054-8cd2-b77e16994f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:19:51.884914 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c943b061-36f3-4054-8cd2-b77e16994f4e admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:51.885355 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c943b061-36f3-4054-8cd2-b77e16994f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:51.885817 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c943b061-36f3-4054-8cd2-b77e16994f4e admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:51.887483 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c943b061-36f3-4054-8cd2-b77e16994f4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:19:51.889605 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c943b061-36f3-4054-8cd2-b77e16994f4e admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:19:51.907484 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1510/3024] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:19:51 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:19:51.911604 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4bb46a-3f2b-42eb-8a58-27f08e99ff1d admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:19:51.931196 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4bb46a-3f2b-42eb-8a58-27f08e99ff1d admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:19:51.939632 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c21a2e-73b3-45b0-b63a-534cc2d556d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:19:51.942425 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c21a2e-73b3-45b0-b63a-534cc2d556d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:51.942877 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c21a2e-73b3-45b0-b63a-534cc2d556d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:51.943421 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c21a2e-73b3-45b0-b63a-534cc2d556d3 admin admin] PATH_INFO: `/v3/projects/e165633a87b04bd9bc3f6e575f53fb12/users/194f98e3c86b48e9952fe02d3648beb0/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:51.986815 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c21a2e-73b3-45b0-b63a-534cc2d556d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e165633a87b04bd9bc3f6e575f53fb12, user_id=194f98e3c86b48e9952fe02d3648beb0, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:19:51.990521 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c21a2e-73b3-45b0-b63a-534cc2d556d3 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:19:52.017665 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1515/3025] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:19:51 2022] PUT /identity/v3/projects/e165633a87b04bd9bc3f6e575f53fb12/users/194f98e3c86b48e9952fe02d3648beb0/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:19:52.019376 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fef6436-b1f0-45d5-889c-61f459fcbdca None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:52.019665 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fef6436-b1f0-45d5-889c-61f459fcbdca None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:52.020017 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fef6436-b1f0-45d5-889c-61f459fcbdca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:52.056298 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-8fef6436-b1f0-45d5-889c-61f459fcbdca None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:19:52.057596 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-8fef6436-b1f0-45d5-889c-61f459fcbdca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:19:52.177163 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1511/3026] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:19:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:19:52.197835 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c21a2e-73b3-45b0-b63a-534cc2d556d3 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:19:52.201757 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-95c21a2e-73b3-45b0-b63a-534cc2d556d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:19:52.320172 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:19:52.352555 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c21a2e-73b3-45b0-b63a-534cc2d556d3 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:19:52.359412 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6302bd8-197f-4dd0-9e33-e2517548d89d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:19:52.360424 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6302bd8-197f-4dd0-9e33-e2517548d89d service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:19:52.361113 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6302bd8-197f-4dd0-9e33-e2517548d89d service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:19:52.361545 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6302bd8-197f-4dd0-9e33-e2517548d89d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:19:52.375862 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6302bd8-197f-4dd0-9e33-e2517548d89d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:19:52.378330 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6302bd8-197f-4dd0-9e33-e2517548d89d service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:19:52.417322 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1516/3027] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:19:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:20:02.163281 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=70,keystone:INSERT=3 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:20:02.384235 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9edc9b0-9726-45d1-bf92-9e328c1a0295 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:20:02.384525 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9edc9b0-9726-45d1-bf92-9e328c1a0295 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:20:02.385479 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9edc9b0-9726-45d1-bf92-9e328c1a0295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:20:02.392524 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=10 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:20:02.430889 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-f9edc9b0-9726-45d1-bf92-9e328c1a0295 None None] MFA Rules not processed for user `194f98e3c86b48e9952fe02d3648beb0`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:20:02.432506 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-f9edc9b0-9726-45d1-bf92-9e328c1a0295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:20:02.606453 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1512/3028] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:20:02 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:20:02.617918 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a130a807-2737-4bc5-8cfd-6cbdb58d0a92 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:20:02.618207 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a130a807-2737-4bc5-8cfd-6cbdb58d0a92 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:20:02.618483 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a130a807-2737-4bc5-8cfd-6cbdb58d0a92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:20:02.650164 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-a130a807-2737-4bc5-8cfd-6cbdb58d0a92 None None] MFA Rules not processed for user `194f98e3c86b48e9952fe02d3648beb0`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:20:02.651576 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-a130a807-2737-4bc5-8cfd-6cbdb58d0a92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:20:02.664270 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1517/3029] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:20:02 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:20:02.757555 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9edc9b0-9726-45d1-bf92-9e328c1a0295 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:20:02.759315 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-f9edc9b0-9726-45d1-bf92-9e328c1a0295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:20:02.969186 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9edc9b0-9726-45d1-bf92-9e328c1a0295 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:20:02.997003 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b288179-536e-4ffe-85e8-3bba650663e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:20:02.998198 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b288179-536e-4ffe-85e8-3bba650663e6 service nova] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:20:03.000020 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b288179-536e-4ffe-85e8-3bba650663e6 service nova] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:20:03.002270 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b288179-536e-4ffe-85e8-3bba650663e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:20:03.021545 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b288179-536e-4ffe-85e8-3bba650663e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:20:03.023877 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b288179-536e-4ffe-85e8-3bba650663e6 service nova] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:20:03.042213 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1513/3030] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:20:02 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:20:06.957352 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a130a807-2737-4bc5-8cfd-6cbdb58d0a92 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:20:06.959779 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-a130a807-2737-4bc5-8cfd-6cbdb58d0a92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:20:06.986051 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a130a807-2737-4bc5-8cfd-6cbdb58d0a92 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:20:07.007479 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e11f3f-245b-4067-a59d-5a0304ccb1f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:20:07.008398 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e11f3f-245b-4067-a59d-5a0304ccb1f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:20:07.008674 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e11f3f-245b-4067-a59d-5a0304ccb1f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:20:07.009086 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e11f3f-245b-4067-a59d-5a0304ccb1f4 admin admin] PATH_INFO: `/v3/users/0133d9533fbd4be5b46dc308dbe3a7d9` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:20:07.011686 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e11f3f-245b-4067-a59d-5a0304ccb1f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0133d9533fbd4be5b46dc308dbe3a7d9)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:20:07.022585 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e11f3f-245b-4067-a59d-5a0304ccb1f4 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:20:07.161100 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-36e11f3f-245b-4067-a59d-5a0304ccb1f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0133d9533fbd4be5b46dc308dbe3a7d9'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:20:07.162143 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-36e11f3f-245b-4067-a59d-5a0304ccb1f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0133d9533fbd4be5b46dc308dbe3a7d9'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:20:07.191530 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-36e11f3f-245b-4067-a59d-5a0304ccb1f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0133d9533fbd4be5b46dc308dbe3a7d9'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:20:07.215045 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-36e11f3f-245b-4067-a59d-5a0304ccb1f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0133d9533fbd4be5b46dc308dbe3a7d9'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:20:07.256622 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-36e11f3f-245b-4067-a59d-5a0304ccb1f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0133d9533fbd4be5b46dc308dbe3a7d9'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:20:07.273591 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1518/3031] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:20:06 2022] DELETE /identity/v3/users/0133d9533fbd4be5b46dc308dbe3a7d9 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:20:07.278410 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2766b1a-2a04-4895-b4b2-a201cd0fae53 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:20:07.278979 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2766b1a-2a04-4895-b4b2-a201cd0fae53 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:20:07.279181 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2766b1a-2a04-4895-b4b2-a201cd0fae53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:20:07.302410 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-f2766b1a-2a04-4895-b4b2-a201cd0fae53 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:20:07.306600 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-f2766b1a-2a04-4895-b4b2-a201cd0fae53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:20:07.439246 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1514/3032] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:20:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:20:07.462255 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e11f3f-245b-4067-a59d-5a0304ccb1f4 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:20:07.464397 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-36e11f3f-245b-4067-a59d-5a0304ccb1f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:20:07.580389 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e11f3f-245b-4067-a59d-5a0304ccb1f4 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:20:07.586072 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525307b7-8dad-4f51-9c5b-72775a0b8795 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:20:07.586748 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525307b7-8dad-4f51-9c5b-72775a0b8795 service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:20:07.587143 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525307b7-8dad-4f51-9c5b-72775a0b8795 service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:20:07.587505 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525307b7-8dad-4f51-9c5b-72775a0b8795 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:20:07.607715 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525307b7-8dad-4f51-9c5b-72775a0b8795 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:20:07.609557 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525307b7-8dad-4f51-9c5b-72775a0b8795 service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:20:07.622842 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1519/3033] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:20:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:20:08.699265 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2766b1a-2a04-4895-b4b2-a201cd0fae53 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:20:08.702403 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-f2766b1a-2a04-4895-b4b2-a201cd0fae53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:20:08.744374 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2766b1a-2a04-4895-b4b2-a201cd0fae53 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:20:08.776677 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f271d5a-2e5e-4d64-98fd-8a2dce7b54ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:20:08.779161 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f271d5a-2e5e-4d64-98fd-8a2dce7b54ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:20:08.779635 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f271d5a-2e5e-4d64-98fd-8a2dce7b54ad admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:20:08.780137 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f271d5a-2e5e-4d64-98fd-8a2dce7b54ad admin admin] PATH_INFO: `/v3/projects/5935212e8b6a40768ee3fc90807b0cb1` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:20:08.786431 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f271d5a-2e5e-4d64-98fd-8a2dce7b54ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=5935212e8b6a40768ee3fc90807b0cb1)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:20:08.790137 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f271d5a-2e5e-4d64-98fd-8a2dce7b54ad admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:20:08.805158 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:20:08.884640 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-8f271d5a-2e5e-4d64-98fd-8a2dce7b54ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5935212e8b6a40768ee3fc90807b0cb1', 'request_id': 'req-8f271d5a-2e5e-4d64-98fd-8a2dce7b54ad'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:20:08.896308 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-8f271d5a-2e5e-4d64-98fd-8a2dce7b54ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5935212e8b6a40768ee3fc90807b0cb1', 'request_id': 'req-8f271d5a-2e5e-4d64-98fd-8a2dce7b54ad'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:20:08.912740 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-8f271d5a-2e5e-4d64-98fd-8a2dce7b54ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5935212e8b6a40768ee3fc90807b0cb1', 'request_id': 'req-8f271d5a-2e5e-4d64-98fd-8a2dce7b54ad'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:20:08.934359 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-8f271d5a-2e5e-4d64-98fd-8a2dce7b54ad admin admin] The token cache is being invalidate because project 5935212e8b6a40768ee3fc90807b0cb1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:20:08.934892 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-8f271d5a-2e5e-4d64-98fd-8a2dce7b54ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:20:08.935934 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-8f271d5a-2e5e-4d64-98fd-8a2dce7b54ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:20:08.938427 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1515/3034] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:20:08 2022] DELETE /identity/v3/projects/5935212e8b6a40768ee3fc90807b0cb1 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:20:08.942273 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525307b7-8dad-4f51-9c5b-72775a0b8795 service neutron] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:20:08.957347 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525307b7-8dad-4f51-9c5b-72775a0b8795 service neutron] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:20:09.042502 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d949788-77b4-496a-a0b2-50b18b290866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:20:09.044168 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d949788-77b4-496a-a0b2-50b18b290866 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:20:09.044676 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d949788-77b4-496a-a0b2-50b18b290866 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:20:09.045194 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d949788-77b4-496a-a0b2-50b18b290866 admin admin] PATH_INFO: `/v3/users/f740c6611de74dadae72b604cc5c2b33` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:20:09.047186 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d949788-77b4-496a-a0b2-50b18b290866 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f740c6611de74dadae72b604cc5c2b33)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:20:09.050125 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d949788-77b4-496a-a0b2-50b18b290866 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:20:09.065263 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:20:09.145323 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-9d949788-77b4-496a-a0b2-50b18b290866 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f740c6611de74dadae72b604cc5c2b33'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:20:09.146501 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-9d949788-77b4-496a-a0b2-50b18b290866 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f740c6611de74dadae72b604cc5c2b33'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:20:09.174492 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-9d949788-77b4-496a-a0b2-50b18b290866 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f740c6611de74dadae72b604cc5c2b33'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:20:09.208410 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-9d949788-77b4-496a-a0b2-50b18b290866 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f740c6611de74dadae72b604cc5c2b33'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:20:09.267945 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-9d949788-77b4-496a-a0b2-50b18b290866 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f740c6611de74dadae72b604cc5c2b33'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:20:09.277995 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1520/3035] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:20:08 2022] DELETE /identity/v3/users/f740c6611de74dadae72b604cc5c2b33 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:20:10.780557 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f271d5a-2e5e-4d64-98fd-8a2dce7b54ad admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:20:10.782913 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-8f271d5a-2e5e-4d64-98fd-8a2dce7b54ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:20:10.806185 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f271d5a-2e5e-4d64-98fd-8a2dce7b54ad admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:20:11.020074 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aed641c-cee9-41b1-9000-60c459d49a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:20:11.020992 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aed641c-cee9-41b1-9000-60c459d49a33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:20:11.024096 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aed641c-cee9-41b1-9000-60c459d49a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:20:11.024421 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aed641c-cee9-41b1-9000-60c459d49a33 admin admin] PATH_INFO: `/v3/projects/06abafd34fdd4fea90decc7bec9dc63f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:20:11.027590 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aed641c-cee9-41b1-9000-60c459d49a33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=06abafd34fdd4fea90decc7bec9dc63f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:20:11.029707 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aed641c-cee9-41b1-9000-60c459d49a33 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:20:11.164912 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-4aed641c-cee9-41b1-9000-60c459d49a33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06abafd34fdd4fea90decc7bec9dc63f', 'request_id': 'req-4aed641c-cee9-41b1-9000-60c459d49a33'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:20:11.178373 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-4aed641c-cee9-41b1-9000-60c459d49a33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06abafd34fdd4fea90decc7bec9dc63f', 'request_id': 'req-4aed641c-cee9-41b1-9000-60c459d49a33'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:20:11.191206 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-4aed641c-cee9-41b1-9000-60c459d49a33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06abafd34fdd4fea90decc7bec9dc63f', 'request_id': 'req-4aed641c-cee9-41b1-9000-60c459d49a33'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:20:11.220108 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-4aed641c-cee9-41b1-9000-60c459d49a33 admin admin] The token cache is being invalidate because project 06abafd34fdd4fea90decc7bec9dc63f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:20:11.220395 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-4aed641c-cee9-41b1-9000-60c459d49a33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:20:11.221515 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-4aed641c-cee9-41b1-9000-60c459d49a33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:20:11.224177 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1516/3036] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:20:10 2022] DELETE /identity/v3/projects/06abafd34fdd4fea90decc7bec9dc63f => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:20:11.235203 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e956154c-3956-46a6-a56b-8e6ac13c8cab None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:20:11.235720 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e956154c-3956-46a6-a56b-8e6ac13c8cab None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:20:11.235950 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e956154c-3956-46a6-a56b-8e6ac13c8cab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:20:11.279392 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-e956154c-3956-46a6-a56b-8e6ac13c8cab None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:20:11.281061 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-e956154c-3956-46a6-a56b-8e6ac13c8cab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:20:11.403825 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1521/3037] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:20:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:20:11.411264 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf321868-ca72-4c19-ade8-48fd2b07e4d8 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:20:11.411594 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf321868-ca72-4c19-ade8-48fd2b07e4d8 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:20:11.411924 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf321868-ca72-4c19-ade8-48fd2b07e4d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:20:11.453033 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-cf321868-ca72-4c19-ade8-48fd2b07e4d8 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:20:11.461801 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-cf321868-ca72-4c19-ade8-48fd2b07e4d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:20:11.486896 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1517/3038] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:20:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:20:11.491336 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e956154c-3956-46a6-a56b-8e6ac13c8cab None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:20:11.519419 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e956154c-3956-46a6-a56b-8e6ac13c8cab None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:20:11.537954 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ff661e-2f84-4277-a08e-9ef048123dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:20:11.539511 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ff661e-2f84-4277-a08e-9ef048123dcb admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:20:11.539793 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ff661e-2f84-4277-a08e-9ef048123dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:20:11.540057 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ff661e-2f84-4277-a08e-9ef048123dcb admin admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:20:11.542648 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ff661e-2f84-4277-a08e-9ef048123dcb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:20:11.546197 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ff661e-2f84-4277-a08e-9ef048123dcb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:20:11.550131 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ff661e-2f84-4277-a08e-9ef048123dcb admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:20:11.581083 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1522/3039] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:20:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:20:11.585729 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf321868-ca72-4c19-ade8-48fd2b07e4d8 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:20:11.601293 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf321868-ca72-4c19-ade8-48fd2b07e4d8 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:20:11.608081 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb0440e-3ba1-420d-ac61-fc9eaa86acbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:20:11.615050 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb0440e-3ba1-420d-ac61-fc9eaa86acbb admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:20:11.618876 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb0440e-3ba1-420d-ac61-fc9eaa86acbb admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:20:11.619280 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb0440e-3ba1-420d-ac61-fc9eaa86acbb admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:20:11.620234 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb0440e-3ba1-420d-ac61-fc9eaa86acbb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:20:11.625488 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb0440e-3ba1-420d-ac61-fc9eaa86acbb admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:20:11.669796 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:20:11.687742 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1518/3040] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:20:11 2022] POST /identity/v3/projects => generated 385 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:20:11.692388 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ff661e-2f84-4277-a08e-9ef048123dcb admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:20:11.707183 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ff661e-2f84-4277-a08e-9ef048123dcb admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:20:11.846184 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42fab2d-e1ce-40e1-b886-7f9a2373278f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:20:11.848943 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42fab2d-e1ce-40e1-b886-7f9a2373278f admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:20:11.849344 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42fab2d-e1ce-40e1-b886-7f9a2373278f admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:20:11.849827 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42fab2d-e1ce-40e1-b886-7f9a2373278f admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:20:11.852922 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42fab2d-e1ce-40e1-b886-7f9a2373278f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:20:11.856067 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42fab2d-e1ce-40e1-b886-7f9a2373278f admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:20:11.887955 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1523/3041] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:20:11 2022] POST /identity/v3/users => generated 293 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:20:11.892139 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb0440e-3ba1-420d-ac61-fc9eaa86acbb admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:20:11.920104 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb0440e-3ba1-420d-ac61-fc9eaa86acbb admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:20:11.936131 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70436e0c-a42b-485c-b646-4d1b4a784a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:20:11.937551 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70436e0c-a42b-485c-b646-4d1b4a784a1c admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:20:11.938103 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70436e0c-a42b-485c-b646-4d1b4a784a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:20:11.938627 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70436e0c-a42b-485c-b646-4d1b4a784a1c admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:20:11.939581 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70436e0c-a42b-485c-b646-4d1b4a784a1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:20:11.942258 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70436e0c-a42b-485c-b646-4d1b4a784a1c admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:20:11.960520 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1519/3042] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:20:11 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:20:11.963754 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42fab2d-e1ce-40e1-b886-7f9a2373278f admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:20:11.973094 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:20:11.978425 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42fab2d-e1ce-40e1-b886-7f9a2373278f admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:20:11.990819 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73fa58d-b761-45e0-92c2-b5b44ef8976b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:20:11.991767 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73fa58d-b761-45e0-92c2-b5b44ef8976b admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:20:11.993144 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73fa58d-b761-45e0-92c2-b5b44ef8976b admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:20:11.993826 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73fa58d-b761-45e0-92c2-b5b44ef8976b admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:20:11.995679 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73fa58d-b761-45e0-92c2-b5b44ef8976b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:20:11.998650 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73fa58d-b761-45e0-92c2-b5b44ef8976b admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:20:12.014860 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1524/3043] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:20:11 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:20:12.018891 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70436e0c-a42b-485c-b646-4d1b4a784a1c admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:20:12.030598 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70436e0c-a42b-485c-b646-4d1b4a784a1c admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:20:12.038805 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3849c6dc-8f37-411e-b507-941860188152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:20:12.040561 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3849c6dc-8f37-411e-b507-941860188152 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:20:12.041137 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3849c6dc-8f37-411e-b507-941860188152 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:20:12.041565 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3849c6dc-8f37-411e-b507-941860188152 admin admin] PATH_INFO: `/v3/projects/f678a1128a214499b6f90e772808b269/users/2de91176ec6c4759bc55c0868aab1382/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:20:12.063758 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3849c6dc-8f37-411e-b507-941860188152 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f678a1128a214499b6f90e772808b269, user_id=2de91176ec6c4759bc55c0868aab1382, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:20:12.067426 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3849c6dc-8f37-411e-b507-941860188152 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:20:12.123164 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1520/3044] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:20:12 2022] PUT /identity/v3/projects/f678a1128a214499b6f90e772808b269/users/2de91176ec6c4759bc55c0868aab1382/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:20:12.134606 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd6d9af-c654-4467-980b-df6ca378786b None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:20:12.135111 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd6d9af-c654-4467-980b-df6ca378786b None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:20:12.135431 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd6d9af-c654-4467-980b-df6ca378786b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:20:12.224308 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-fcd6d9af-c654-4467-980b-df6ca378786b None None] MFA Rules not processed for user `2de91176ec6c4759bc55c0868aab1382`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:20:12.228937 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-fcd6d9af-c654-4467-980b-df6ca378786b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:20:12.424150 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1525/3045] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:20:12 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:20:12.427830 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3849c6dc-8f37-411e-b507-941860188152 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:20:12.629270 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3849c6dc-8f37-411e-b507-941860188152 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:20:12.651666 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee858258-8b6f-4d49-aad9-7e4e195eca00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:20:12.655965 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee858258-8b6f-4d49-aad9-7e4e195eca00 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:20:12.658712 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee858258-8b6f-4d49-aad9-7e4e195eca00 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:20:12.660494 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee858258-8b6f-4d49-aad9-7e4e195eca00 admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:20:12.663841 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee858258-8b6f-4d49-aad9-7e4e195eca00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:20:12.670752 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee858258-8b6f-4d49-aad9-7e4e195eca00 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:20:12.788770 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd6d9af-c654-4467-980b-df6ca378786b None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:20:12.798608 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1521/3046] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:20:12 2022] POST /identity/v3/projects => generated 383 bytes in 374 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:20:12.827293 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd6d9af-c654-4467-980b-df6ca378786b None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:20:13.001238 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c619baf-87fa-48ad-a207-29a3314162bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:20:13.002322 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c619baf-87fa-48ad-a207-29a3314162bf admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:20:13.002831 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c619baf-87fa-48ad-a207-29a3314162bf admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:20:13.003343 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c619baf-87fa-48ad-a207-29a3314162bf admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:20:13.004262 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c619baf-87fa-48ad-a207-29a3314162bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:20:13.011900 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c619baf-87fa-48ad-a207-29a3314162bf admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:20:13.069356 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1526/3047] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:20:12 2022] POST /identity/v3/users => generated 298 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:20:13.073452 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee858258-8b6f-4d49-aad9-7e4e195eca00 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:20:13.087114 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee858258-8b6f-4d49-aad9-7e4e195eca00 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:20:13.096752 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1113fac-f194-4b89-8c7e-42ae10ec4048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:20:13.097447 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1113fac-f194-4b89-8c7e-42ae10ec4048 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:20:13.097923 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1113fac-f194-4b89-8c7e-42ae10ec4048 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:20:13.098370 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1113fac-f194-4b89-8c7e-42ae10ec4048 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:20:13.099416 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1113fac-f194-4b89-8c7e-42ae10ec4048 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:20:13.101179 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1113fac-f194-4b89-8c7e-42ae10ec4048 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:20:13.118272 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1522/3048] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:20:13 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:20:13.122930 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c619baf-87fa-48ad-a207-29a3314162bf admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:20:13.147042 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c619baf-87fa-48ad-a207-29a3314162bf admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:20:13.153373 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d585d19c-ec23-4715-93bc-97d86bd05b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:20:13.154660 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d585d19c-ec23-4715-93bc-97d86bd05b04 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:20:13.155262 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d585d19c-ec23-4715-93bc-97d86bd05b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:20:13.155970 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d585d19c-ec23-4715-93bc-97d86bd05b04 admin admin] PATH_INFO: `/v3/projects/8eaec6c75c1d4557b660cf9a2dc9df5e/users/1dabbfcd6d3b469ab21c8f8cc2aab7d9/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:20:13.179205 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d585d19c-ec23-4715-93bc-97d86bd05b04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8eaec6c75c1d4557b660cf9a2dc9df5e, user_id=1dabbfcd6d3b469ab21c8f8cc2aab7d9, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:20:13.183705 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d585d19c-ec23-4715-93bc-97d86bd05b04 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:20:13.216850 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1527/3049] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:20:13 2022] PUT /identity/v3/projects/8eaec6c75c1d4557b660cf9a2dc9df5e/users/1dabbfcd6d3b469ab21c8f8cc2aab7d9/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:20:13.221398 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1113fac-f194-4b89-8c7e-42ae10ec4048 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:20:13.237493 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1113fac-f194-4b89-8c7e-42ae10ec4048 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:20:13.378227 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499b9d08-dc00-4ea1-9e0c-9ed6ef493c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:20:13.379396 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499b9d08-dc00-4ea1-9e0c-9ed6ef493c65 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:20:13.380279 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499b9d08-dc00-4ea1-9e0c-9ed6ef493c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:20:13.380766 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499b9d08-dc00-4ea1-9e0c-9ed6ef493c65 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:20:13.381728 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499b9d08-dc00-4ea1-9e0c-9ed6ef493c65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:20:13.404479 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499b9d08-dc00-4ea1-9e0c-9ed6ef493c65 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:20:13.454099 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1523/3050] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:20:13 2022] GET /identity/v3/roles => generated 1420 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:20:13.458575 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d585d19c-ec23-4715-93bc-97d86bd05b04 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:20:13.473229 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d585d19c-ec23-4715-93bc-97d86bd05b04 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:20:13.483152 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34d69c9-46ba-4ffb-a199-dcfaa725c92b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:20:13.484136 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34d69c9-46ba-4ffb-a199-dcfaa725c92b admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:20:13.484416 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34d69c9-46ba-4ffb-a199-dcfaa725c92b admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:20:13.484748 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34d69c9-46ba-4ffb-a199-dcfaa725c92b admin admin] PATH_INFO: `/v3/projects/8eaec6c75c1d4557b660cf9a2dc9df5e/users/1dabbfcd6d3b469ab21c8f8cc2aab7d9/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:20:13.486935 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34d69c9-46ba-4ffb-a199-dcfaa725c92b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8eaec6c75c1d4557b660cf9a2dc9df5e, user_id=1dabbfcd6d3b469ab21c8f8cc2aab7d9, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:20:13.491263 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34d69c9-46ba-4ffb-a199-dcfaa725c92b admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:20:13.538849 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1528/3051] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:20:13 2022] PUT /identity/v3/projects/8eaec6c75c1d4557b660cf9a2dc9df5e/users/1dabbfcd6d3b469ab21c8f8cc2aab7d9/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:20:13.609558 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623b30bc-22a5-4819-9008-0a610dc060ee None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:20:13.610006 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623b30bc-22a5-4819-9008-0a610dc060ee None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:20:13.610383 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623b30bc-22a5-4819-9008-0a610dc060ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:20:13.672341 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-623b30bc-22a5-4819-9008-0a610dc060ee None None] MFA Rules not processed for user `1dabbfcd6d3b469ab21c8f8cc2aab7d9`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:20:13.675274 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-623b30bc-22a5-4819-9008-0a610dc060ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:20:13.763639 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:20:13.850643 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34d69c9-46ba-4ffb-a199-dcfaa725c92b admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:20:13.853252 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-b34d69c9-46ba-4ffb-a199-dcfaa725c92b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:20:13.903827 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1524/3052] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:20:13 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:20:13.910721 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:20:13.974985 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623b30bc-22a5-4819-9008-0a610dc060ee None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:20:13.976501 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-623b30bc-22a5-4819-9008-0a610dc060ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:20:13.985153 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34d69c9-46ba-4ffb-a199-dcfaa725c92b admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:20:13.998285 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1093fc5-1e67-4c89-91c3-0e42308b470d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:20:13.999208 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1093fc5-1e67-4c89-91c3-0e42308b470d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:20:13.999941 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1093fc5-1e67-4c89-91c3-0e42308b470d admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:20:14.000218 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1093fc5-1e67-4c89-91c3-0e42308b470d admin admin] PATH_INFO: `/v3/users/bb4f9dda4c2a411cb0394bf86e9ae223` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:20:14.003765 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1093fc5-1e67-4c89-91c3-0e42308b470d admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb4f9dda4c2a411cb0394bf86e9ae223)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:20:14.010641 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1093fc5-1e67-4c89-91c3-0e42308b470d admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:20:14.118673 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-e1093fc5-1e67-4c89-91c3-0e42308b470d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb4f9dda4c2a411cb0394bf86e9ae223'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:20:14.119594 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-e1093fc5-1e67-4c89-91c3-0e42308b470d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb4f9dda4c2a411cb0394bf86e9ae223'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:20:14.139806 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-e1093fc5-1e67-4c89-91c3-0e42308b470d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb4f9dda4c2a411cb0394bf86e9ae223'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:20:14.179467 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623b30bc-22a5-4819-9008-0a610dc060ee None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:20:14.183146 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-e1093fc5-1e67-4c89-91c3-0e42308b470d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb4f9dda4c2a411cb0394bf86e9ae223'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:20:14.207222 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9ae350-c40c-4b8b-a4b4-81b59218bae1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:20:14.208957 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9ae350-c40c-4b8b-a4b4-81b59218bae1 service nova] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:20:14.214582 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9ae350-c40c-4b8b-a4b4-81b59218bae1 service nova] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:20:14.217592 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9ae350-c40c-4b8b-a4b4-81b59218bae1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:20:14.220573 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-e1093fc5-1e67-4c89-91c3-0e42308b470d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb4f9dda4c2a411cb0394bf86e9ae223'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:20:14.230332 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1529/3053] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:20:13 2022] DELETE /identity/v3/users/bb4f9dda4c2a411cb0394bf86e9ae223 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:20:14.245499 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9ae350-c40c-4b8b-a4b4-81b59218bae1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:20:14.247215 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9ae350-c40c-4b8b-a4b4-81b59218bae1 service nova] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:20:14.277706 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1525/3054] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:20:13 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:20:14.647655 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1093fc5-1e67-4c89-91c3-0e42308b470d admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:20:14.651123 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-e1093fc5-1e67-4c89-91c3-0e42308b470d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:20:14.791538 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9ae350-c40c-4b8b-a4b4-81b59218bae1 service nova] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:20:14.795823 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1093fc5-1e67-4c89-91c3-0e42308b470d admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:20:14.801689 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0385dfd-fd2d-408f-b7af-1527f0565434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:20:14.802775 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0385dfd-fd2d-408f-b7af-1527f0565434 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:20:14.803096 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0385dfd-fd2d-408f-b7af-1527f0565434 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:20:14.803506 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0385dfd-fd2d-408f-b7af-1527f0565434 admin admin] PATH_INFO: `/v3/users/2de91176ec6c4759bc55c0868aab1382` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:20:14.805314 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0385dfd-fd2d-408f-b7af-1527f0565434 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2de91176ec6c4759bc55c0868aab1382)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:20:14.807609 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0385dfd-fd2d-408f-b7af-1527f0565434 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:20:14.825185 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9ae350-c40c-4b8b-a4b4-81b59218bae1 service nova] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:20:14.831328 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ad2656-6c13-4085-a875-ec12a400eaae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:20:14.832469 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ad2656-6c13-4085-a875-ec12a400eaae admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:20:14.833059 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ad2656-6c13-4085-a875-ec12a400eaae admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:20:14.833495 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ad2656-6c13-4085-a875-ec12a400eaae admin admin] PATH_INFO: `/v3/projects/580ed681cbf44d10936259b17f60f1b2` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:20:14.835665 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ad2656-6c13-4085-a875-ec12a400eaae admin admin] RBAC: Authorizing `identity:delete_project(project_id=580ed681cbf44d10936259b17f60f1b2)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:20:14.842623 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ad2656-6c13-4085-a875-ec12a400eaae admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:20:14.889439 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c0385dfd-fd2d-408f-b7af-1527f0565434 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2de91176ec6c4759bc55c0868aab1382'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:20:14.890407 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c0385dfd-fd2d-408f-b7af-1527f0565434 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2de91176ec6c4759bc55c0868aab1382'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:20:14.902446 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c0385dfd-fd2d-408f-b7af-1527f0565434 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2de91176ec6c4759bc55c0868aab1382'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:20:14.905217 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:20:14.918708 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c0385dfd-fd2d-408f-b7af-1527f0565434 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2de91176ec6c4759bc55c0868aab1382'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:20:14.942037 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-d2ad2656-6c13-4085-a875-ec12a400eaae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '580ed681cbf44d10936259b17f60f1b2', 'request_id': 'req-d2ad2656-6c13-4085-a875-ec12a400eaae'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:20:14.946073 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c0385dfd-fd2d-408f-b7af-1527f0565434 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2de91176ec6c4759bc55c0868aab1382'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:20:14.962647 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-d2ad2656-6c13-4085-a875-ec12a400eaae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '580ed681cbf44d10936259b17f60f1b2', 'request_id': 'req-d2ad2656-6c13-4085-a875-ec12a400eaae'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:20:14.970711 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-d2ad2656-6c13-4085-a875-ec12a400eaae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '580ed681cbf44d10936259b17f60f1b2', 'request_id': 'req-d2ad2656-6c13-4085-a875-ec12a400eaae'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:20:14.978682 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1530/3055] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:20:14 2022] DELETE /identity/v3/users/2de91176ec6c4759bc55c0868aab1382 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:20:14.984366 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341147cf-d009-4a18-a040-f0b91e60a57f None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:20:14.985100 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341147cf-d009-4a18-a040-f0b91e60a57f None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:20:14.985603 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341147cf-d009-4a18-a040-f0b91e60a57f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:20:14.994625 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-d2ad2656-6c13-4085-a875-ec12a400eaae admin admin] The token cache is being invalidate because project 580ed681cbf44d10936259b17f60f1b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:20:14.995026 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-d2ad2656-6c13-4085-a875-ec12a400eaae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:20:14.995801 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-d2ad2656-6c13-4085-a875-ec12a400eaae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:20:14.997903 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1526/3056] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:20:14 2022] DELETE /identity/v3/projects/580ed681cbf44d10936259b17f60f1b2 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:20:15.003209 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d8be92-4659-40d2-b520-caecbf7233d2 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:20:15.003578 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d8be92-4659-40d2-b520-caecbf7233d2 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:20:15.007319 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d8be92-4659-40d2-b520-caecbf7233d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:20:15.039867 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-341147cf-d009-4a18-a040-f0b91e60a57f None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:20:15.047100 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-341147cf-d009-4a18-a040-f0b91e60a57f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:20:15.059318 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-19d8be92-4659-40d2-b520-caecbf7233d2 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:20:15.060738 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-19d8be92-4659-40d2-b520-caecbf7233d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:20:15.094650 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:20:15.172549 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1527/3057] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:20:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:20:15.174761 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9768298f-b339-4247-813c-1f5a3e6fd66a None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:20:15.175245 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9768298f-b339-4247-813c-1f5a3e6fd66a None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:20:15.175668 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9768298f-b339-4247-813c-1f5a3e6fd66a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:20:15.198469 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-9768298f-b339-4247-813c-1f5a3e6fd66a None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:20:15.200467 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-9768298f-b339-4247-813c-1f5a3e6fd66a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:20:15.209125 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1531/3058] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:20:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:20:15.218037 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1528/3059] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:20:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:20:15.218835 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341147cf-d009-4a18-a040-f0b91e60a57f None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:20:15.230262 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341147cf-d009-4a18-a040-f0b91e60a57f None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:20:15.235791 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8140680-99a0-4be1-acdc-ac3e11527d8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:20:15.236724 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8140680-99a0-4be1-acdc-ac3e11527d8d admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:20:15.237191 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8140680-99a0-4be1-acdc-ac3e11527d8d admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:20:15.238008 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8140680-99a0-4be1-acdc-ac3e11527d8d admin admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:20:15.238929 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8140680-99a0-4be1-acdc-ac3e11527d8d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:20:15.239578 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8140680-99a0-4be1-acdc-ac3e11527d8d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:20:15.241500 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8140680-99a0-4be1-acdc-ac3e11527d8d admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:20:15.252033 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9768298f-b339-4247-813c-1f5a3e6fd66a None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:20:15.253459 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-9768298f-b339-4247-813c-1f5a3e6fd66a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:20:15.275579 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1532/3060] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:20:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:20:15.277508 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8140680-99a0-4be1-acdc-ac3e11527d8d admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:20:15.290257 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8140680-99a0-4be1-acdc-ac3e11527d8d admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:20:15.298616 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a53eb7c-f469-48b6-bb1b-bb480db3de97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:20:15.300567 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a53eb7c-f469-48b6-bb1b-bb480db3de97 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:20:15.301367 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a53eb7c-f469-48b6-bb1b-bb480db3de97 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:20:15.303978 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a53eb7c-f469-48b6-bb1b-bb480db3de97 admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:20:15.305061 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a53eb7c-f469-48b6-bb1b-bb480db3de97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:20:15.307653 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a53eb7c-f469-48b6-bb1b-bb480db3de97 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:20:15.349688 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9768298f-b339-4247-813c-1f5a3e6fd66a None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:20:15.354110 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3258e43e-fa96-4ec9-ad6d-775f5683e4f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:20:15.355026 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3258e43e-fa96-4ec9-ad6d-775f5683e4f8 service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:20:15.355317 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3258e43e-fa96-4ec9-ad6d-775f5683e4f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:20:15.355584 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3258e43e-fa96-4ec9-ad6d-775f5683e4f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:20:15.368740 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3258e43e-fa96-4ec9-ad6d-775f5683e4f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:20:15.371262 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3258e43e-fa96-4ec9-ad6d-775f5683e4f8 service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:20:15.371945 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1533/3061] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:20:15 2022] POST /identity/v3/projects => generated 385 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:20:15.373239 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a53eb7c-f469-48b6-bb1b-bb480db3de97 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:20:15.384684 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1529/3062] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:20:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 23 21:20:15.498033 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a53eb7c-f469-48b6-bb1b-bb480db3de97 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:20:15.508726 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8aa8e6-0e43-44e0-acab-832e7a6be2de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:20:15.510070 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8aa8e6-0e43-44e0-acab-832e7a6be2de admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:20:15.510923 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8aa8e6-0e43-44e0-acab-832e7a6be2de admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:20:15.510923 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8aa8e6-0e43-44e0-acab-832e7a6be2de admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:20:15.511603 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8aa8e6-0e43-44e0-acab-832e7a6be2de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:20:15.514571 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8aa8e6-0e43-44e0-acab-832e7a6be2de admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:20:15.555516 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1534/3063] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:20:15 2022] POST /identity/v3/users => generated 293 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:20:15.555848 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3258e43e-fa96-4ec9-ad6d-775f5683e4f8 service neutron] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:20:15.567048 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3258e43e-fa96-4ec9-ad6d-775f5683e4f8 service neutron] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:20:15.572101 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192d3da3-090c-4b69-9a73-88b910231eed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:20:15.573077 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192d3da3-090c-4b69-9a73-88b910231eed admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:20:15.573205 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192d3da3-090c-4b69-9a73-88b910231eed admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:20:15.573754 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192d3da3-090c-4b69-9a73-88b910231eed admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:20:15.584064 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192d3da3-090c-4b69-9a73-88b910231eed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:20:15.585875 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192d3da3-090c-4b69-9a73-88b910231eed admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:20:15.599042 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1530/3064] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:20:15 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 21:20:15.603256 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8aa8e6-0e43-44e0-acab-832e7a6be2de admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:20:15.613811 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8aa8e6-0e43-44e0-acab-832e7a6be2de admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:20:15.619264 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71cf292-a091-4916-8b9b-534624eeeceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:20:15.620150 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71cf292-a091-4916-8b9b-534624eeeceb admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:20:15.621937 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71cf292-a091-4916-8b9b-534624eeeceb admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:20:15.621937 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71cf292-a091-4916-8b9b-534624eeeceb admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:20:15.621937 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71cf292-a091-4916-8b9b-534624eeeceb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:20:15.623292 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71cf292-a091-4916-8b9b-534624eeeceb admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:20:15.635322 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1535/3065] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:20:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:20:15.640875 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192d3da3-090c-4b69-9a73-88b910231eed admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:20:15.654165 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192d3da3-090c-4b69-9a73-88b910231eed admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:20:15.660327 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d4ee0b-01a9-43ed-bfe1-a2ba510ceb22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:20:15.661360 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d4ee0b-01a9-43ed-bfe1-a2ba510ceb22 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:20:15.661681 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d4ee0b-01a9-43ed-bfe1-a2ba510ceb22 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:20:15.662431 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d4ee0b-01a9-43ed-bfe1-a2ba510ceb22 admin admin] PATH_INFO: `/v3/projects/629d02efac724fa29fcfff53e370b69b/users/f80673ab800441b4bd1f5858e1df7b3c/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:20:15.689095 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d4ee0b-01a9-43ed-bfe1-a2ba510ceb22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=629d02efac724fa29fcfff53e370b69b, user_id=f80673ab800441b4bd1f5858e1df7b3c, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:20:15.694520 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d4ee0b-01a9-43ed-bfe1-a2ba510ceb22 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:20:15.723534 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1531/3066] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:20:15 2022] PUT /identity/v3/projects/629d02efac724fa29fcfff53e370b69b/users/f80673ab800441b4bd1f5858e1df7b3c/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:20:15.734889 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a912172-090c-476e-a7ab-1ba6fbfa32e1 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:20:15.734889 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a912172-090c-476e-a7ab-1ba6fbfa32e1 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:20:15.735598 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a912172-090c-476e-a7ab-1ba6fbfa32e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:20:15.788857 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-3a912172-090c-476e-a7ab-1ba6fbfa32e1 None None] MFA Rules not processed for user `f80673ab800441b4bd1f5858e1df7b3c`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:20:15.790343 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-3a912172-090c-476e-a7ab-1ba6fbfa32e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:20:15.797983 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:INSERT=5,keystone:DELETE=3,keystone:SELECT=92 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:20:15.895119 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1536/3067] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:20:15 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:20:15.908983 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d4ee0b-01a9-43ed-bfe1-a2ba510ceb22 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:20:15.911882 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-e3d4ee0b-01a9-43ed-bfe1-a2ba510ceb22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:20:15.950959 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a912172-090c-476e-a7ab-1ba6fbfa32e1 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:20:15.955931 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-3a912172-090c-476e-a7ab-1ba6fbfa32e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:20:16.013004 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d4ee0b-01a9-43ed-bfe1-a2ba510ceb22 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:20:16.017426 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbed614-91bc-4ad1-98d8-709263d3c67a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7f2db148c8e4d5d81431cae3576434b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:20:16.018238 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbed614-91bc-4ad1-98d8-709263d3c67a service glance] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:20:16.018587 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbed614-91bc-4ad1-98d8-709263d3c67a service glance] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:20:16.018918 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbed614-91bc-4ad1-98d8-709263d3c67a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:20:16.038475 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbed614-91bc-4ad1-98d8-709263d3c67a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:20:16.040183 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbed614-91bc-4ad1-98d8-709263d3c67a service glance] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:20:16.052824 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1532/3068] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:20:15 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:20:16.072444 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a912172-090c-476e-a7ab-1ba6fbfa32e1 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:20:16.077691 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd89086-8b6c-4647-bf2c-e2b84d3e013a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:20:16.079499 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd89086-8b6c-4647-bf2c-e2b84d3e013a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:20:16.079499 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd89086-8b6c-4647-bf2c-e2b84d3e013a admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:20:16.079499 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd89086-8b6c-4647-bf2c-e2b84d3e013a admin admin] PATH_INFO: `/v3/projects/f678a1128a214499b6f90e772808b269` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:20:16.080653 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd89086-8b6c-4647-bf2c-e2b84d3e013a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f678a1128a214499b6f90e772808b269)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:20:16.082635 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd89086-8b6c-4647-bf2c-e2b84d3e013a admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:20:16.186085 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-fdd89086-8b6c-4647-bf2c-e2b84d3e013a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f678a1128a214499b6f90e772808b269', 'request_id': 'req-fdd89086-8b6c-4647-bf2c-e2b84d3e013a'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:20:16.203288 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-fdd89086-8b6c-4647-bf2c-e2b84d3e013a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f678a1128a214499b6f90e772808b269', 'request_id': 'req-fdd89086-8b6c-4647-bf2c-e2b84d3e013a'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:20:16.215186 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-fdd89086-8b6c-4647-bf2c-e2b84d3e013a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f678a1128a214499b6f90e772808b269', 'request_id': 'req-fdd89086-8b6c-4647-bf2c-e2b84d3e013a'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:20:16.230137 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-fdd89086-8b6c-4647-bf2c-e2b84d3e013a admin admin] The token cache is being invalidate because project f678a1128a214499b6f90e772808b269 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:20:16.233465 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-fdd89086-8b6c-4647-bf2c-e2b84d3e013a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:20:16.233465 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-fdd89086-8b6c-4647-bf2c-e2b84d3e013a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:20:16.233465 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1537/3069] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:20:15 2022] DELETE /identity/v3/projects/f678a1128a214499b6f90e772808b269 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:20:16.237047 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbed614-91bc-4ad1-98d8-709263d3c67a service glance] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:20:16.256820 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbed614-91bc-4ad1-98d8-709263d3c67a service glance] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:20:16.320475 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:20:16.389084 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b22f4e-0181-463b-b906-f41402945ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:20:16.390485 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b22f4e-0181-463b-b906-f41402945ea1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:20:16.391093 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b22f4e-0181-463b-b906-f41402945ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:20:16.391525 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b22f4e-0181-463b-b906-f41402945ea1 admin admin] PATH_INFO: `/v3/users/1dabbfcd6d3b469ab21c8f8cc2aab7d9` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:20:16.397199 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b22f4e-0181-463b-b906-f41402945ea1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1dabbfcd6d3b469ab21c8f8cc2aab7d9)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:20:16.399939 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b22f4e-0181-463b-b906-f41402945ea1 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:20:16.494204 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-a9b22f4e-0181-463b-b906-f41402945ea1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1dabbfcd6d3b469ab21c8f8cc2aab7d9'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:20:16.504046 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-a9b22f4e-0181-463b-b906-f41402945ea1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1dabbfcd6d3b469ab21c8f8cc2aab7d9'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:20:16.505180 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-a9b22f4e-0181-463b-b906-f41402945ea1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1dabbfcd6d3b469ab21c8f8cc2aab7d9'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:20:16.533952 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-a9b22f4e-0181-463b-b906-f41402945ea1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1dabbfcd6d3b469ab21c8f8cc2aab7d9'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:20:16.552407 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-a9b22f4e-0181-463b-b906-f41402945ea1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1dabbfcd6d3b469ab21c8f8cc2aab7d9'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:20:16.566060 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1533/3070] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:20:16 2022] DELETE /identity/v3/users/1dabbfcd6d3b469ab21c8f8cc2aab7d9 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:20:17.008346 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd89086-8b6c-4647-bf2c-e2b84d3e013a admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:20:17.009977 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-fdd89086-8b6c-4647-bf2c-e2b84d3e013a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:20:17.024913 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd89086-8b6c-4647-bf2c-e2b84d3e013a admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:20:17.068266 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:20:17.123967 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8068b573-6551-41cf-bf34-3f1f7c80147a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:20:17.125366 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8068b573-6551-41cf-bf34-3f1f7c80147a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:20:17.125705 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8068b573-6551-41cf-bf34-3f1f7c80147a admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:20:17.126066 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8068b573-6551-41cf-bf34-3f1f7c80147a admin admin] PATH_INFO: `/v3/projects/8eaec6c75c1d4557b660cf9a2dc9df5e` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:20:17.127305 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8068b573-6551-41cf-bf34-3f1f7c80147a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8eaec6c75c1d4557b660cf9a2dc9df5e)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:20:17.129328 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8068b573-6551-41cf-bf34-3f1f7c80147a admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:20:17.190355 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-8068b573-6551-41cf-bf34-3f1f7c80147a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8eaec6c75c1d4557b660cf9a2dc9df5e', 'request_id': 'req-8068b573-6551-41cf-bf34-3f1f7c80147a'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:20:17.200082 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-8068b573-6551-41cf-bf34-3f1f7c80147a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8eaec6c75c1d4557b660cf9a2dc9df5e', 'request_id': 'req-8068b573-6551-41cf-bf34-3f1f7c80147a'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:20:17.201691 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06f6c38-2eae-4270-835e-c2502b96fb0e None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:20:17.202107 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06f6c38-2eae-4270-835e-c2502b96fb0e None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:20:17.202526 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06f6c38-2eae-4270-835e-c2502b96fb0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:20:17.207677 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-8068b573-6551-41cf-bf34-3f1f7c80147a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8eaec6c75c1d4557b660cf9a2dc9df5e', 'request_id': 'req-8068b573-6551-41cf-bf34-3f1f7c80147a'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:20:17.224309 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-d06f6c38-2eae-4270-835e-c2502b96fb0e None None] MFA Rules not processed for user `17b779a3e21a415bb42cde5d6863d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:20:17.225516 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-d06f6c38-2eae-4270-835e-c2502b96fb0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:20:17.226682 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-8068b573-6551-41cf-bf34-3f1f7c80147a admin admin] The token cache is being invalidate because project 8eaec6c75c1d4557b660cf9a2dc9df5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:20:17.227255 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-8068b573-6551-41cf-bf34-3f1f7c80147a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:20:17.228992 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-8068b573-6551-41cf-bf34-3f1f7c80147a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:20:17.232529 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1538/3071] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:20:17 2022] DELETE /identity/v3/projects/8eaec6c75c1d4557b660cf9a2dc9df5e => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:20:17.237648 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e6be63-353d-45ca-8c8c-2b0b96bb422e None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:20:17.237979 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e6be63-353d-45ca-8c8c-2b0b96bb422e None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:20:17.238249 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e6be63-353d-45ca-8c8c-2b0b96bb422e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:20:17.272993 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-b8e6be63-353d-45ca-8c8c-2b0b96bb422e None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:20:17.272993 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-b8e6be63-353d-45ca-8c8c-2b0b96bb422e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:20:17.297799 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1534/3072] 10.222.0.17 () {58 vars in 1009 bytes} [Sat Jul 23 21:20:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:20:17.324223 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06f6c38-2eae-4270-835e-c2502b96fb0e None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:20:17.326079 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-d06f6c38-2eae-4270-835e-c2502b96fb0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:20:17.348321 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1539/3073] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:20:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:20:17.359556 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dc728b-d554-4ce4-a345-6d59c0db381b None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:20:17.359914 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dc728b-d554-4ce4-a345-6d59c0db381b None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:20:17.360202 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dc728b-d554-4ce4-a345-6d59c0db381b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:20:17.387033 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-23dc728b-d554-4ce4-a345-6d59c0db381b None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:20:17.388480 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-23dc728b-d554-4ce4-a345-6d59c0db381b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:20:17.395465 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:20:17.404654 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1540/3074] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:20:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:20:17.405652 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dc728b-d554-4ce4-a345-6d59c0db381b None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:20:17.416105 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dc728b-d554-4ce4-a345-6d59c0db381b None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:20:17.418997 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06f6c38-2eae-4270-835e-c2502b96fb0e None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:20:17.421209 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b678ce-31b4-4b95-936e-7c0ca94ec143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:20:17.422093 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b678ce-31b4-4b95-936e-7c0ca94ec143 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:20:17.422439 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b678ce-31b4-4b95-936e-7c0ca94ec143 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:20:17.422779 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b678ce-31b4-4b95-936e-7c0ca94ec143 admin admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:20:17.423587 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b678ce-31b4-4b95-936e-7c0ca94ec143 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:20:17.423979 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b678ce-31b4-4b95-936e-7c0ca94ec143 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:20:17.425418 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b46221-485c-4e49-817e-c5d62b342093 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f0a685b7da46afb81024848f079d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:20:17.425720 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b678ce-31b4-4b95-936e-7c0ca94ec143 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:20:17.426205 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b46221-485c-4e49-817e-c5d62b342093 service swift] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:20:17.426487 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b46221-485c-4e49-817e-c5d62b342093 service swift] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:20:17.426763 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b46221-485c-4e49-817e-c5d62b342093 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:20:17.438656 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b46221-485c-4e49-817e-c5d62b342093 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:20:17.440487 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b46221-485c-4e49-817e-c5d62b342093 service swift] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:20:17.443462 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1541/3075] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:20:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:20:17.444427 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b678ce-31b4-4b95-936e-7c0ca94ec143 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:20:17.454532 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1535/3076] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 23 21:20:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 23 21:20:17.456675 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b678ce-31b4-4b95-936e-7c0ca94ec143 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:20:17.462177 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bb370a-e771-4264-92d8-6b93adc2caac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:20:17.462848 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bb370a-e771-4264-92d8-6b93adc2caac admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:20:17.463127 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bb370a-e771-4264-92d8-6b93adc2caac admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:20:17.463393 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bb370a-e771-4264-92d8-6b93adc2caac admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:20:17.464073 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bb370a-e771-4264-92d8-6b93adc2caac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:20:17.465982 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bb370a-e771-4264-92d8-6b93adc2caac admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:20:17.500706 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1542/3077] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:20:17 2022] POST /identity/v3/projects => generated 401 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:20:17.504897 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b46221-485c-4e49-817e-c5d62b342093 service swift] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:20:17.515674 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b46221-485c-4e49-817e-c5d62b342093 service swift] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:20:17.594152 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c1d24a-81d8-4ddf-9226-bdea910218e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:20:17.595373 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c1d24a-81d8-4ddf-9226-bdea910218e4 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:20:17.595662 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c1d24a-81d8-4ddf-9226-bdea910218e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:20:17.595935 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c1d24a-81d8-4ddf-9226-bdea910218e4 admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:20:17.596814 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c1d24a-81d8-4ddf-9226-bdea910218e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:20:17.598787 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c1d24a-81d8-4ddf-9226-bdea910218e4 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:20:17.639342 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bb370a-e771-4264-92d8-6b93adc2caac admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:20:17.647572 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1536/3078] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:20:17 2022] POST /identity/v3/users => generated 301 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:20:17.652757 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bb370a-e771-4264-92d8-6b93adc2caac admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:20:17.661944 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afe9b0a-54e4-4967-91f9-19361c57267f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:20:17.662796 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afe9b0a-54e4-4967-91f9-19361c57267f admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:20:17.663115 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afe9b0a-54e4-4967-91f9-19361c57267f admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:20:17.663669 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afe9b0a-54e4-4967-91f9-19361c57267f admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:20:17.664658 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afe9b0a-54e4-4967-91f9-19361c57267f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:20:17.667899 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afe9b0a-54e4-4967-91f9-19361c57267f admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:20:17.695682 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1543/3079] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:20:17 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 21:20:17.700316 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c1d24a-81d8-4ddf-9226-bdea910218e4 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:20:17.718767 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c1d24a-81d8-4ddf-9226-bdea910218e4 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:20:17.729185 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf439dd2-1edc-4acb-8638-feb5bd50b0a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:20:17.730161 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf439dd2-1edc-4acb-8638-feb5bd50b0a6 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:20:17.730546 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf439dd2-1edc-4acb-8638-feb5bd50b0a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:20:17.731027 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf439dd2-1edc-4acb-8638-feb5bd50b0a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:20:17.732661 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf439dd2-1edc-4acb-8638-feb5bd50b0a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:20:17.735509 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf439dd2-1edc-4acb-8638-feb5bd50b0a6 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:20:17.750878 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1537/3080] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:20:17 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:20:17.752324 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afe9b0a-54e4-4967-91f9-19361c57267f admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:20:17.769090 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afe9b0a-54e4-4967-91f9-19361c57267f admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:20:17.775581 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2875aaee-1e90-42ad-8143-afd08145616f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:20:17.776873 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2875aaee-1e90-42ad-8143-afd08145616f admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:20:17.777482 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2875aaee-1e90-42ad-8143-afd08145616f admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:20:17.778070 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2875aaee-1e90-42ad-8143-afd08145616f admin admin] PATH_INFO: `/v3/projects/cee093d7d580481bb8223f03b75f1def/users/3c997f5228bc4d529d6766a8c3dbeb90/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:20:17.797288 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:20:17.802763 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2875aaee-1e90-42ad-8143-afd08145616f admin admin] RBAC: Authorizing `identity:create_grant(project_id=cee093d7d580481bb8223f03b75f1def, user_id=3c997f5228bc4d529d6766a8c3dbeb90, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:20:17.807725 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2875aaee-1e90-42ad-8143-afd08145616f admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:20:17.853943 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1544/3081] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:20:17 2022] PUT /identity/v3/projects/cee093d7d580481bb8223f03b75f1def/users/3c997f5228bc4d529d6766a8c3dbeb90/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:20:17.865804 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bc9957-9f13-4406-8c3a-035a55718776 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:20:17.868651 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bc9957-9f13-4406-8c3a-035a55718776 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:20:17.868992 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bc9957-9f13-4406-8c3a-035a55718776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:20:17.928394 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-81bc9957-9f13-4406-8c3a-035a55718776 None None] MFA Rules not processed for user `3c997f5228bc4d529d6766a8c3dbeb90`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:20:17.932959 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-81bc9957-9f13-4406-8c3a-035a55718776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:20:18.089926 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1538/3082] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:20:17 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:20:18.092059 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2875aaee-1e90-42ad-8143-afd08145616f admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:20:18.185149 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2875aaee-1e90-42ad-8143-afd08145616f admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:20:18.191340 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d5fc30-2328-43df-a70c-140e95cb863a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:20:18.192441 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d5fc30-2328-43df-a70c-140e95cb863a admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:20:18.192959 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d5fc30-2328-43df-a70c-140e95cb863a admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:20:18.194004 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d5fc30-2328-43df-a70c-140e95cb863a admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:20:18.194957 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d5fc30-2328-43df-a70c-140e95cb863a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:20:18.197896 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d5fc30-2328-43df-a70c-140e95cb863a admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:20:18.240682 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1545/3083] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:20:18 2022] POST /identity/v3/projects => generated 399 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:20:18.242087 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bc9957-9f13-4406-8c3a-035a55718776 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:20:18.260059 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bc9957-9f13-4406-8c3a-035a55718776 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:20:18.345239 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:20:18.357011 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df73efeb-1187-45fd-bfbe-e4b2cb3971fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:20:18.357704 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df73efeb-1187-45fd-bfbe-e4b2cb3971fa admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:20:18.358031 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df73efeb-1187-45fd-bfbe-e4b2cb3971fa admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:20:18.358309 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df73efeb-1187-45fd-bfbe-e4b2cb3971fa admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:20:18.359073 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df73efeb-1187-45fd-bfbe-e4b2cb3971fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:20:18.361118 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df73efeb-1187-45fd-bfbe-e4b2cb3971fa admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:20:18.389630 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1539/3084] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:20:18 2022] POST /identity/v3/users => generated 306 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:20:18.390928 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d5fc30-2328-43df-a70c-140e95cb863a admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:20:18.408399 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d5fc30-2328-43df-a70c-140e95cb863a admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:20:18.413240 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecc6cdc-8b58-4666-8473-11b50e32a7fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:20:18.413953 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecc6cdc-8b58-4666-8473-11b50e32a7fc admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:20:18.414236 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecc6cdc-8b58-4666-8473-11b50e32a7fc admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:20:18.414516 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecc6cdc-8b58-4666-8473-11b50e32a7fc admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:20:18.415250 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecc6cdc-8b58-4666-8473-11b50e32a7fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:20:18.416870 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecc6cdc-8b58-4666-8473-11b50e32a7fc admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:20:18.429778 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1546/3085] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:20:18 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:20:18.434135 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df73efeb-1187-45fd-bfbe-e4b2cb3971fa admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:20:18.444637 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df73efeb-1187-45fd-bfbe-e4b2cb3971fa admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:20:18.467049 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948dc5a2-db68-4022-8f8c-3ee3e914b20d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:20:18.468312 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948dc5a2-db68-4022-8f8c-3ee3e914b20d admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:20:18.468684 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948dc5a2-db68-4022-8f8c-3ee3e914b20d admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:20:18.469319 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948dc5a2-db68-4022-8f8c-3ee3e914b20d admin admin] PATH_INFO: `/v3/projects/2fecaef03de24c6785543197f3b9d940/users/179195d5363d4328adea95efb3ab6ce8/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:20:18.492442 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948dc5a2-db68-4022-8f8c-3ee3e914b20d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fecaef03de24c6785543197f3b9d940, user_id=179195d5363d4328adea95efb3ab6ce8, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:20:18.497850 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948dc5a2-db68-4022-8f8c-3ee3e914b20d admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:20:18.529646 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1540/3086] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:20:18 2022] PUT /identity/v3/projects/2fecaef03de24c6785543197f3b9d940/users/179195d5363d4328adea95efb3ab6ce8/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:20:18.534047 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecc6cdc-8b58-4666-8473-11b50e32a7fc admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:20:18.548612 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecc6cdc-8b58-4666-8473-11b50e32a7fc admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:20:18.639731 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df92145-9f57-46cb-8632-133a52527e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:20:18.640913 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df92145-9f57-46cb-8632-133a52527e83 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:20:18.641309 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df92145-9f57-46cb-8632-133a52527e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:20:18.641704 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df92145-9f57-46cb-8632-133a52527e83 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:20:18.642729 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df92145-9f57-46cb-8632-133a52527e83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:20:18.646569 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df92145-9f57-46cb-8632-133a52527e83 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:20:18.666479 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1547/3087] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:20:18 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:20:18.670808 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948dc5a2-db68-4022-8f8c-3ee3e914b20d admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:20:18.685978 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948dc5a2-db68-4022-8f8c-3ee3e914b20d admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:20:18.699760 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad8656e-4ebe-437b-9278-70bfdca35dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:20:18.700912 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad8656e-4ebe-437b-9278-70bfdca35dff admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:20:18.701641 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad8656e-4ebe-437b-9278-70bfdca35dff admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:20:18.702039 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad8656e-4ebe-437b-9278-70bfdca35dff admin admin] PATH_INFO: `/v3/projects/2fecaef03de24c6785543197f3b9d940/users/179195d5363d4328adea95efb3ab6ce8/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:20:18.704572 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad8656e-4ebe-437b-9278-70bfdca35dff admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fecaef03de24c6785543197f3b9d940, user_id=179195d5363d4328adea95efb3ab6ce8, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:20:18.707416 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad8656e-4ebe-437b-9278-70bfdca35dff admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:20:18.731691 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1541/3088] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:20:18 2022] PUT /identity/v3/projects/2fecaef03de24c6785543197f3b9d940/users/179195d5363d4328adea95efb3ab6ce8/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:20:18.743017 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f107ff8-f453-4551-b128-d9b19b1f6f3c None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:20:18.743539 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f107ff8-f453-4551-b128-d9b19b1f6f3c None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:20:18.746404 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f107ff8-f453-4551-b128-d9b19b1f6f3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:20:18.808796 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-9f107ff8-f453-4551-b128-d9b19b1f6f3c None None] MFA Rules not processed for user `179195d5363d4328adea95efb3ab6ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:20:18.815804 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-9f107ff8-f453-4551-b128-d9b19b1f6f3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:20:18.910085 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5990360-98fa-479e-b4dc-968e02b1204b None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:20:18.910494 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5990360-98fa-479e-b4dc-968e02b1204b None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:20:18.910905 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5990360-98fa-479e-b4dc-968e02b1204b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:20:18.948855 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-e5990360-98fa-479e-b4dc-968e02b1204b None None] MFA Rules not processed for user `17b779a3e21a415bb42cde5d6863d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:20:18.950585 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-e5990360-98fa-479e-b4dc-968e02b1204b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:20:18.961452 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:20:19.051466 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1542/3090] 10.222.0.17 () {58 vars in 1009 bytes} [Sat Jul 23 21:20:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:20:19.052973 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1548/3090] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:20:18 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:20:19.053795 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f107ff8-f453-4551-b128-d9b19b1f6f3c None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:20:19.065052 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-9f107ff8-f453-4551-b128-d9b19b1f6f3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:20:19.070839 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5990360-98fa-479e-b4dc-968e02b1204b None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:20:19.252584 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5990360-98fa-479e-b4dc-968e02b1204b None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:20:19.258472 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8543c1ad-81be-45ef-9b58-9d54e32fc20a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f0a685b7da46afb81024848f079d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:20:19.259144 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8543c1ad-81be-45ef-9b58-9d54e32fc20a service swift] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:20:19.259423 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8543c1ad-81be-45ef-9b58-9d54e32fc20a service swift] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:20:19.259693 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8543c1ad-81be-45ef-9b58-9d54e32fc20a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:20:19.294798 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8543c1ad-81be-45ef-9b58-9d54e32fc20a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:20:19.296560 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8543c1ad-81be-45ef-9b58-9d54e32fc20a service swift] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:20:19.308799 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f107ff8-f453-4551-b128-d9b19b1f6f3c None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:20:19.311361 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1543/3091] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 23 21:20:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 23 21:20:19.314844 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee266630-b5e4-49b4-885d-02fe1f89ccf9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:20:19.315561 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee266630-b5e4-49b4-885d-02fe1f89ccf9 service nova] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:20:19.315797 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee266630-b5e4-49b4-885d-02fe1f89ccf9 service nova] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:20:19.316075 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee266630-b5e4-49b4-885d-02fe1f89ccf9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:20:19.334719 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee266630-b5e4-49b4-885d-02fe1f89ccf9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:20:19.337084 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee266630-b5e4-49b4-885d-02fe1f89ccf9 service nova] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:20:19.350631 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1549/3092] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:20:19 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:20:21.073100 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77db15fe-561c-4f5d-bc45-d58922afe853 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:20:21.073704 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77db15fe-561c-4f5d-bc45-d58922afe853 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:20:21.073704 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77db15fe-561c-4f5d-bc45-d58922afe853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:20:21.109596 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-77db15fe-561c-4f5d-bc45-d58922afe853 None None] MFA Rules not processed for user `17b779a3e21a415bb42cde5d6863d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:20:21.114613 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-77db15fe-561c-4f5d-bc45-d58922afe853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:20:21.146830 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1544/3093] 10.222.0.17 () {58 vars in 1009 bytes} [Sat Jul 23 21:20:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:20:21.160863 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee266630-b5e4-49b4-885d-02fe1f89ccf9 service nova] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:20:21.176779 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee266630-b5e4-49b4-885d-02fe1f89ccf9 service nova] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:20:21.190862 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36b28f5-f218-4109-bbe9-02a2a33d799e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f0a685b7da46afb81024848f079d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:20:21.191741 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36b28f5-f218-4109-bbe9-02a2a33d799e service swift] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:20:21.192206 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36b28f5-f218-4109-bbe9-02a2a33d799e service swift] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:20:21.192835 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36b28f5-f218-4109-bbe9-02a2a33d799e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:20:21.203595 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36b28f5-f218-4109-bbe9-02a2a33d799e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:20:21.205237 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36b28f5-f218-4109-bbe9-02a2a33d799e service swift] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:20:21.216368 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1550/3094] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 23 21:20:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 23 21:20:21.645478 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77db15fe-561c-4f5d-bc45-d58922afe853 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:20:21.647634 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-77db15fe-561c-4f5d-bc45-d58922afe853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:20:21.668400 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77db15fe-561c-4f5d-bc45-d58922afe853 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:20:21.675781 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dddece-8869-416b-9f51-364dd0e726d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:20:21.676552 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dddece-8869-416b-9f51-364dd0e726d4 service nova] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:20:21.676834 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dddece-8869-416b-9f51-364dd0e726d4 service nova] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:20:21.677394 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dddece-8869-416b-9f51-364dd0e726d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:20:21.728844 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:20:21.766879 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dddece-8869-416b-9f51-364dd0e726d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:20:21.770430 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dddece-8869-416b-9f51-364dd0e726d4 service nova] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:20:21.781218 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1545/3095] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:20:21 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:20:21.811765 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36b28f5-f218-4109-bbe9-02a2a33d799e service swift] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:20:21.957715 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36b28f5-f218-4109-bbe9-02a2a33d799e service swift] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:20:21.963856 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92f2f83-d633-4250-ad22-361dcda12089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:20:21.964826 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92f2f83-d633-4250-ad22-361dcda12089 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:20:21.965442 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92f2f83-d633-4250-ad22-361dcda12089 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:20:21.965605 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92f2f83-d633-4250-ad22-361dcda12089 admin admin] PATH_INFO: `/v3/users/3c997f5228bc4d529d6766a8c3dbeb90` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:20:21.966912 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92f2f83-d633-4250-ad22-361dcda12089 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c997f5228bc4d529d6766a8c3dbeb90)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:20:21.969727 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92f2f83-d633-4250-ad22-361dcda12089 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:20:22.024507 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebacd49-ff95-4ab3-b4f6-a3360208549f None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:20:22.025239 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebacd49-ff95-4ab3-b4f6-a3360208549f None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:20:22.026221 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebacd49-ff95-4ab3-b4f6-a3360208549f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:20:22.061043 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-a92f2f83-d633-4250-ad22-361dcda12089 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c997f5228bc4d529d6766a8c3dbeb90'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:20:22.062010 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-a92f2f83-d633-4250-ad22-361dcda12089 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c997f5228bc4d529d6766a8c3dbeb90'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:20:22.070757 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-a92f2f83-d633-4250-ad22-361dcda12089 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c997f5228bc4d529d6766a8c3dbeb90'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:20:22.077261 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:20:22.082353 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-5ebacd49-ff95-4ab3-b4f6-a3360208549f None None] MFA Rules not processed for user `f80673ab800441b4bd1f5858e1df7b3c`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:20:22.085612 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-5ebacd49-ff95-4ab3-b4f6-a3360208549f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:20:22.086404 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-a92f2f83-d633-4250-ad22-361dcda12089 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c997f5228bc4d529d6766a8c3dbeb90'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:20:22.119169 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-a92f2f83-d633-4250-ad22-361dcda12089 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c997f5228bc4d529d6766a8c3dbeb90'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:20:22.147493 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1551/3096] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:20:21 2022] DELETE /identity/v3/users/3c997f5228bc4d529d6766a8c3dbeb90 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:20:22.149598 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3984e4-5238-411a-84cb-ea77ef5bcb0d None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:20:22.149959 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3984e4-5238-411a-84cb-ea77ef5bcb0d None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:20:22.150248 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3984e4-5238-411a-84cb-ea77ef5bcb0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:20:22.198607 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-5b3984e4-5238-411a-84cb-ea77ef5bcb0d None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:20:22.200820 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-5b3984e4-5238-411a-84cb-ea77ef5bcb0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:20:22.207853 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1546/3097] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:20:22 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:20:22.348759 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1552/3098] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:20:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:20:22.392669 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebacd49-ff95-4ab3-b4f6-a3360208549f None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:20:22.395131 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-5ebacd49-ff95-4ab3-b4f6-a3360208549f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:20:22.527445 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebacd49-ff95-4ab3-b4f6-a3360208549f None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:20:22.635404 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051bd973-4d10-48e9-8034-5b429a2b30bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:20:22.636178 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051bd973-4d10-48e9-8034-5b429a2b30bf service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:20:22.636560 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051bd973-4d10-48e9-8034-5b429a2b30bf service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:20:22.636954 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051bd973-4d10-48e9-8034-5b429a2b30bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:20:22.663101 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051bd973-4d10-48e9-8034-5b429a2b30bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:20:22.666660 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051bd973-4d10-48e9-8034-5b429a2b30bf service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:20:22.692589 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1547/3099] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:20:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:20:22.914196 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06868cf-0abb-4d4d-9ddd-73a0bd12d59a None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:20:22.914485 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06868cf-0abb-4d4d-9ddd-73a0bd12d59a None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:20:22.914764 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06868cf-0abb-4d4d-9ddd-73a0bd12d59a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:20:22.945704 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-c06868cf-0abb-4d4d-9ddd-73a0bd12d59a None None] MFA Rules not processed for user `f80673ab800441b4bd1f5858e1df7b3c`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:20:22.947574 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-c06868cf-0abb-4d4d-9ddd-73a0bd12d59a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:20:23.021552 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1553/3100] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:20:22 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:20:24.140234 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051bd973-4d10-48e9-8034-5b429a2b30bf service neutron] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:20:24.142286 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-051bd973-4d10-48e9-8034-5b429a2b30bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:20:24.168143 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051bd973-4d10-48e9-8034-5b429a2b30bf service neutron] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:20:24.183019 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261452a6-f693-45f9-b784-08d80dd9f8d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:20:24.185798 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261452a6-f693-45f9-b784-08d80dd9f8d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:20:24.187156 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261452a6-f693-45f9-b784-08d80dd9f8d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:20:24.187797 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261452a6-f693-45f9-b784-08d80dd9f8d9 admin admin] PATH_INFO: `/v3/projects/cee093d7d580481bb8223f03b75f1def` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:20:24.195580 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261452a6-f693-45f9-b784-08d80dd9f8d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cee093d7d580481bb8223f03b75f1def)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:20:24.203085 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261452a6-f693-45f9-b784-08d80dd9f8d9 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:20:24.275640 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:20:24.303112 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-261452a6-f693-45f9-b784-08d80dd9f8d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cee093d7d580481bb8223f03b75f1def', 'request_id': 'req-261452a6-f693-45f9-b784-08d80dd9f8d9'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:20:24.326623 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-261452a6-f693-45f9-b784-08d80dd9f8d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cee093d7d580481bb8223f03b75f1def', 'request_id': 'req-261452a6-f693-45f9-b784-08d80dd9f8d9'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:20:24.338221 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-261452a6-f693-45f9-b784-08d80dd9f8d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cee093d7d580481bb8223f03b75f1def', 'request_id': 'req-261452a6-f693-45f9-b784-08d80dd9f8d9'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:20:24.366657 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-261452a6-f693-45f9-b784-08d80dd9f8d9 admin admin] The token cache is being invalidate because project cee093d7d580481bb8223f03b75f1def was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:20:24.367252 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-261452a6-f693-45f9-b784-08d80dd9f8d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:20:24.368156 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-261452a6-f693-45f9-b784-08d80dd9f8d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:20:24.372028 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1548/3101] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:20:24 2022] DELETE /identity/v3/projects/cee093d7d580481bb8223f03b75f1def => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:20:24.376589 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06868cf-0abb-4d4d-9ddd-73a0bd12d59a None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:20:24.398309 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06868cf-0abb-4d4d-9ddd-73a0bd12d59a None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:20:24.513888 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3d7fb7-94cc-4db3-8800-cea8a8fcb424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:20:24.514828 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3d7fb7-94cc-4db3-8800-cea8a8fcb424 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:20:24.515156 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3d7fb7-94cc-4db3-8800-cea8a8fcb424 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:20:24.515468 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3d7fb7-94cc-4db3-8800-cea8a8fcb424 admin admin] PATH_INFO: `/v3/users/179195d5363d4328adea95efb3ab6ce8` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:20:24.516727 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3d7fb7-94cc-4db3-8800-cea8a8fcb424 admin admin] RBAC: Authorizing `identity:delete_user(user_id=179195d5363d4328adea95efb3ab6ce8)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:20:24.518692 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3d7fb7-94cc-4db3-8800-cea8a8fcb424 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:20:24.575706 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:20:24.610238 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-4f3d7fb7-94cc-4db3-8800-cea8a8fcb424 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '179195d5363d4328adea95efb3ab6ce8'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:20:24.612703 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-4f3d7fb7-94cc-4db3-8800-cea8a8fcb424 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '179195d5363d4328adea95efb3ab6ce8'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:20:24.627272 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c092259-20e8-4ce8-8c58-e1e770cb06e8 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:20:24.627272 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c092259-20e8-4ce8-8c58-e1e770cb06e8 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:20:24.627526 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c092259-20e8-4ce8-8c58-e1e770cb06e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:20:24.633589 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-4f3d7fb7-94cc-4db3-8800-cea8a8fcb424 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '179195d5363d4328adea95efb3ab6ce8'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:20:24.649559 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-4f3d7fb7-94cc-4db3-8800-cea8a8fcb424 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '179195d5363d4328adea95efb3ab6ce8'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:20:24.670204 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-4f3d7fb7-94cc-4db3-8800-cea8a8fcb424 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '179195d5363d4328adea95efb3ab6ce8'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:20:24.680421 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1554/3102] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:20:24 2022] DELETE /identity/v3/users/179195d5363d4328adea95efb3ab6ce8 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:20:24.683645 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-2c092259-20e8-4ce8-8c58-e1e770cb06e8 None None] MFA Rules not processed for user `194f98e3c86b48e9952fe02d3648beb0`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:20:24.685082 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-2c092259-20e8-4ce8-8c58-e1e770cb06e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:20:24.884192 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1549/3103] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:20:24 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:20:25.527455 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3d7fb7-94cc-4db3-8800-cea8a8fcb424 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:20:25.529001 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-4f3d7fb7-94cc-4db3-8800-cea8a8fcb424 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:20:25.745037 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3d7fb7-94cc-4db3-8800-cea8a8fcb424 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:20:25.757108 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ef4e90-5ecd-47bd-9050-bdc78ccd41f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:20:25.758148 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ef4e90-5ecd-47bd-9050-bdc78ccd41f3 service nova] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:20:25.758531 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ef4e90-5ecd-47bd-9050-bdc78ccd41f3 service nova] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:20:25.758923 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ef4e90-5ecd-47bd-9050-bdc78ccd41f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:20:25.762475 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-b7ef4e90-5ecd-47bd-9050-bdc78ccd41f3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:20:25.851941 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ef4e90-5ecd-47bd-9050-bdc78ccd41f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:20:25.856961 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ef4e90-5ecd-47bd-9050-bdc78ccd41f3 service nova] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:20:25.874517 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1555/3104] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:20:25 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:20:25.925788 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c092259-20e8-4ce8-8c58-e1e770cb06e8 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:20:25.929405 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-2c092259-20e8-4ce8-8c58-e1e770cb06e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:20:26.043628 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c092259-20e8-4ce8-8c58-e1e770cb06e8 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:20:26.048474 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d46c35-3aa9-4e2b-a02b-339af760b5a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:20:26.049470 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d46c35-3aa9-4e2b-a02b-339af760b5a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:20:26.049783 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d46c35-3aa9-4e2b-a02b-339af760b5a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:20:26.050104 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d46c35-3aa9-4e2b-a02b-339af760b5a6 admin admin] PATH_INFO: `/v3/projects/2fecaef03de24c6785543197f3b9d940` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:20:26.051363 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d46c35-3aa9-4e2b-a02b-339af760b5a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2fecaef03de24c6785543197f3b9d940)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:20:26.053425 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d46c35-3aa9-4e2b-a02b-339af760b5a6 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:20:26.141799 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-60d46c35-3aa9-4e2b-a02b-339af760b5a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2fecaef03de24c6785543197f3b9d940', 'request_id': 'req-60d46c35-3aa9-4e2b-a02b-339af760b5a6'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:20:26.163403 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-60d46c35-3aa9-4e2b-a02b-339af760b5a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2fecaef03de24c6785543197f3b9d940', 'request_id': 'req-60d46c35-3aa9-4e2b-a02b-339af760b5a6'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:20:26.185221 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-60d46c35-3aa9-4e2b-a02b-339af760b5a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2fecaef03de24c6785543197f3b9d940', 'request_id': 'req-60d46c35-3aa9-4e2b-a02b-339af760b5a6'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:20:26.188230 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:20:26.199466 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-60d46c35-3aa9-4e2b-a02b-339af760b5a6 admin admin] The token cache is being invalidate because project 2fecaef03de24c6785543197f3b9d940 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:20:26.200828 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-60d46c35-3aa9-4e2b-a02b-339af760b5a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:20:26.202167 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-60d46c35-3aa9-4e2b-a02b-339af760b5a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:20:26.205306 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1550/3105] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:20:25 2022] DELETE /identity/v3/projects/2fecaef03de24c6785543197f3b9d940 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:20:26.211474 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff8bafb-a065-4d35-8f66-9ab13f03404c None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:20:26.211474 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff8bafb-a065-4d35-8f66-9ab13f03404c None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:20:26.211474 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff8bafb-a065-4d35-8f66-9ab13f03404c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:20:26.261771 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-4ff8bafb-a065-4d35-8f66-9ab13f03404c None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:20:26.265895 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-4ff8bafb-a065-4d35-8f66-9ab13f03404c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:20:26.353384 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:20:26.456689 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1556/3106] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:20:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:20:26.466544 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a873658a-bfe1-4fac-8647-be025609d9e1 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:20:26.467063 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a873658a-bfe1-4fac-8647-be025609d9e1 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:20:26.467830 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a873658a-bfe1-4fac-8647-be025609d9e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:20:26.493955 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-a873658a-bfe1-4fac-8647-be025609d9e1 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:20:26.495161 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-a873658a-bfe1-4fac-8647-be025609d9e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:20:26.509083 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1551/3107] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:20:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:20:26.511004 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff8bafb-a065-4d35-8f66-9ab13f03404c None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:20:26.526173 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff8bafb-a065-4d35-8f66-9ab13f03404c None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:20:26.532291 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fccbbd-12d4-4a33-85e2-bd30a299c7be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:20:26.532972 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fccbbd-12d4-4a33-85e2-bd30a299c7be admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:20:26.533520 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fccbbd-12d4-4a33-85e2-bd30a299c7be admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:20:26.534171 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fccbbd-12d4-4a33-85e2-bd30a299c7be admin admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:20:26.535108 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fccbbd-12d4-4a33-85e2-bd30a299c7be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:20:26.535625 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fccbbd-12d4-4a33-85e2-bd30a299c7be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:20:26.537514 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fccbbd-12d4-4a33-85e2-bd30a299c7be admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:20:26.563116 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1557/3108] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:20:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:20:26.567414 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a873658a-bfe1-4fac-8647-be025609d9e1 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:20:26.583620 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a873658a-bfe1-4fac-8647-be025609d9e1 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:20:26.593304 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc86326-e92c-4117-af3a-d3e7ccceaf21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:20:26.594077 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc86326-e92c-4117-af3a-d3e7ccceaf21 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:20:26.595594 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc86326-e92c-4117-af3a-d3e7ccceaf21 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:20:26.595952 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc86326-e92c-4117-af3a-d3e7ccceaf21 admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:20:26.596807 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc86326-e92c-4117-af3a-d3e7ccceaf21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:20:26.607216 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc86326-e92c-4117-af3a-d3e7ccceaf21 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:20:26.661178 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1552/3109] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:20:26 2022] POST /identity/v3/projects => generated 397 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:20:26.667545 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fccbbd-12d4-4a33-85e2-bd30a299c7be admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:20:26.679916 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fccbbd-12d4-4a33-85e2-bd30a299c7be admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:20:26.783359 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93122cb0-06e6-48bc-87b4-f74e8ae7bb75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:20:26.784061 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93122cb0-06e6-48bc-87b4-f74e8ae7bb75 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:20:26.785728 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93122cb0-06e6-48bc-87b4-f74e8ae7bb75 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:20:26.786065 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93122cb0-06e6-48bc-87b4-f74e8ae7bb75 admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:20:26.789067 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93122cb0-06e6-48bc-87b4-f74e8ae7bb75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:20:26.792265 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93122cb0-06e6-48bc-87b4-f74e8ae7bb75 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:20:26.841770 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1558/3110] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:20:26 2022] POST /identity/v3/users => generated 299 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:20:26.843248 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc86326-e92c-4117-af3a-d3e7ccceaf21 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:20:26.855095 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc86326-e92c-4117-af3a-d3e7ccceaf21 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:20:26.872228 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8529394f-b72e-4ebd-b83e-f9209b16ea18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:20:26.873118 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8529394f-b72e-4ebd-b83e-f9209b16ea18 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:20:26.873400 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8529394f-b72e-4ebd-b83e-f9209b16ea18 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:20:26.873668 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8529394f-b72e-4ebd-b83e-f9209b16ea18 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:20:26.874914 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8529394f-b72e-4ebd-b83e-f9209b16ea18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:20:26.882808 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8529394f-b72e-4ebd-b83e-f9209b16ea18 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:20:26.920871 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1553/3111] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:20:26 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:20:26.925259 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93122cb0-06e6-48bc-87b4-f74e8ae7bb75 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:20:26.944677 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93122cb0-06e6-48bc-87b4-f74e8ae7bb75 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:20:26.960279 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40147a6-5160-492f-9db9-54b954578993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:20:26.961109 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40147a6-5160-492f-9db9-54b954578993 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:20:26.961390 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40147a6-5160-492f-9db9-54b954578993 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:20:26.961754 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40147a6-5160-492f-9db9-54b954578993 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:20:26.963197 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40147a6-5160-492f-9db9-54b954578993 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:20:26.964936 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40147a6-5160-492f-9db9-54b954578993 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:20:26.982631 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1559/3112] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:20:26 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:20:26.983270 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8529394f-b72e-4ebd-b83e-f9209b16ea18 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:20:27.005446 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8529394f-b72e-4ebd-b83e-f9209b16ea18 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:20:27.014687 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50e8d6e-ed49-499e-b0b4-927784725672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:20:27.015649 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50e8d6e-ed49-499e-b0b4-927784725672 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:20:27.015975 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50e8d6e-ed49-499e-b0b4-927784725672 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:20:27.016244 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50e8d6e-ed49-499e-b0b4-927784725672 admin admin] PATH_INFO: `/v3/projects/bb233ab978c84af6a87b215076bf69dc/users/5343731b8a9b466ebe93def3e4c50771/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:20:27.037729 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50e8d6e-ed49-499e-b0b4-927784725672 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb233ab978c84af6a87b215076bf69dc, user_id=5343731b8a9b466ebe93def3e4c50771, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:20:27.041007 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50e8d6e-ed49-499e-b0b4-927784725672 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:20:27.086879 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1554/3113] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:20:26 2022] PUT /identity/v3/projects/bb233ab978c84af6a87b215076bf69dc/users/5343731b8a9b466ebe93def3e4c50771/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:20:27.100122 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e333b4-a382-4c8c-adcb-2d8406d0d614 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:20:27.100414 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e333b4-a382-4c8c-adcb-2d8406d0d614 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:20:27.100722 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e333b4-a382-4c8c-adcb-2d8406d0d614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:20:27.196807 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-66e333b4-a382-4c8c-adcb-2d8406d0d614 None None] MFA Rules not processed for user `5343731b8a9b466ebe93def3e4c50771`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:20:27.198132 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-66e333b4-a382-4c8c-adcb-2d8406d0d614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:20:27.358531 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1560/3114] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:20:27 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:20:27.946352 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50e8d6e-ed49-499e-b0b4-927784725672 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:20:27.948195 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-b50e8d6e-ed49-499e-b0b4-927784725672 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:20:28.058070 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50e8d6e-ed49-499e-b0b4-927784725672 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:20:28.067320 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f71717d-8cf9-47c2-84ce-2f933992044e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:20:28.068073 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f71717d-8cf9-47c2-84ce-2f933992044e service nova] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:20:28.068353 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f71717d-8cf9-47c2-84ce-2f933992044e service nova] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:20:28.068622 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f71717d-8cf9-47c2-84ce-2f933992044e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:20:28.080559 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f71717d-8cf9-47c2-84ce-2f933992044e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:20:28.083300 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f71717d-8cf9-47c2-84ce-2f933992044e service nova] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:20:28.104108 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1555/3115] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:20:27 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:20:28.161262 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e333b4-a382-4c8c-adcb-2d8406d0d614 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:20:28.175569 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e333b4-a382-4c8c-adcb-2d8406d0d614 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:20:28.182453 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c73278-1e87-4bd6-b4bf-65daa7525630 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:20:28.183241 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c73278-1e87-4bd6-b4bf-65daa7525630 service nova] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:20:28.183548 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c73278-1e87-4bd6-b4bf-65daa7525630 service nova] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:20:28.183825 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c73278-1e87-4bd6-b4bf-65daa7525630 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:20:28.186378 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-f8c73278-1e87-4bd6-b4bf-65daa7525630 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:20:28.223562 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:20:28.269693 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c73278-1e87-4bd6-b4bf-65daa7525630 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:20:28.272004 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c73278-1e87-4bd6-b4bf-65daa7525630 service nova] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:20:28.292272 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1561/3116] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:20:28 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:20:28.855334 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f71717d-8cf9-47c2-84ce-2f933992044e service nova] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:20:28.958388 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f71717d-8cf9-47c2-84ce-2f933992044e service nova] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:20:28.965295 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde44bbf-604f-4e81-bc4d-921cafbbc63a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:20:28.967103 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde44bbf-604f-4e81-bc4d-921cafbbc63a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:20:28.967447 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde44bbf-604f-4e81-bc4d-921cafbbc63a admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:20:28.967722 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde44bbf-604f-4e81-bc4d-921cafbbc63a admin admin] PATH_INFO: `/v3/users/5343731b8a9b466ebe93def3e4c50771` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:20:28.973512 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde44bbf-604f-4e81-bc4d-921cafbbc63a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5343731b8a9b466ebe93def3e4c50771)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:20:28.975944 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde44bbf-604f-4e81-bc4d-921cafbbc63a admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:20:29.002930 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:20:29.051177 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-dde44bbf-604f-4e81-bc4d-921cafbbc63a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5343731b8a9b466ebe93def3e4c50771'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:20:29.060968 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-dde44bbf-604f-4e81-bc4d-921cafbbc63a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5343731b8a9b466ebe93def3e4c50771'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:20:29.062677 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-dde44bbf-604f-4e81-bc4d-921cafbbc63a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5343731b8a9b466ebe93def3e4c50771'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:20:29.074092 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-dde44bbf-604f-4e81-bc4d-921cafbbc63a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5343731b8a9b466ebe93def3e4c50771'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:20:29.100879 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-dde44bbf-604f-4e81-bc4d-921cafbbc63a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5343731b8a9b466ebe93def3e4c50771'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:20:29.126661 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1556/3117] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:20:28 2022] DELETE /identity/v3/users/5343731b8a9b466ebe93def3e4c50771 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:20:29.135837 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be27770-ba8d-4dc7-80c9-16c4cebc7bd8 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:20:29.136508 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be27770-ba8d-4dc7-80c9-16c4cebc7bd8 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:20:29.138891 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be27770-ba8d-4dc7-80c9-16c4cebc7bd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:20:29.177513 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-5be27770-ba8d-4dc7-80c9-16c4cebc7bd8 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:20:29.178949 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-5be27770-ba8d-4dc7-80c9-16c4cebc7bd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:20:29.299169 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1562/3118] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:20:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:20:29.320865 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde44bbf-604f-4e81-bc4d-921cafbbc63a admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:20:29.323633 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-dde44bbf-604f-4e81-bc4d-921cafbbc63a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:20:29.412977 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde44bbf-604f-4e81-bc4d-921cafbbc63a admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:20:29.416874 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca86ef38-d69f-42d2-9816-47022e20b850 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:20:29.418442 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca86ef38-d69f-42d2-9816-47022e20b850 service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:20:29.418726 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca86ef38-d69f-42d2-9816-47022e20b850 service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:20:29.420291 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca86ef38-d69f-42d2-9816-47022e20b850 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:20:29.435596 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca86ef38-d69f-42d2-9816-47022e20b850 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:20:29.437337 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca86ef38-d69f-42d2-9816-47022e20b850 service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:20:29.502535 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1557/3119] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:20:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:20:29.571285 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4940d9f-f217-4644-8e4e-cf1d1722f72a None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:20:29.571828 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4940d9f-f217-4644-8e4e-cf1d1722f72a None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:20:29.572092 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4940d9f-f217-4644-8e4e-cf1d1722f72a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:20:29.611230 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-f4940d9f-f217-4644-8e4e-cf1d1722f72a None None] MFA Rules not processed for user `145e518288ce4d70a12a3f2cc6a91810`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:20:29.615865 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-f4940d9f-f217-4644-8e4e-cf1d1722f72a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:20:29.781620 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1563/3120] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:20:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:20:30.730678 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca86ef38-d69f-42d2-9816-47022e20b850 service neutron] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:20:30.745559 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca86ef38-d69f-42d2-9816-47022e20b850 service neutron] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:20:30.755272 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916b74ec-5ed0-4d4d-b2ee-c1c9163d1f3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:20:30.763325 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916b74ec-5ed0-4d4d-b2ee-c1c9163d1f3a service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:20:30.763662 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916b74ec-5ed0-4d4d-b2ee-c1c9163d1f3a service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:20:30.763939 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916b74ec-5ed0-4d4d-b2ee-c1c9163d1f3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:20:30.779074 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-916b74ec-5ed0-4d4d-b2ee-c1c9163d1f3a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:20:30.794096 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916b74ec-5ed0-4d4d-b2ee-c1c9163d1f3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:20:30.795550 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916b74ec-5ed0-4d4d-b2ee-c1c9163d1f3a service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:20:30.816228 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1558/3121] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:20:30 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:20:30.928452 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4940d9f-f217-4644-8e4e-cf1d1722f72a None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:20:30.930074 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-f4940d9f-f217-4644-8e4e-cf1d1722f72a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:20:30.944729 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4940d9f-f217-4644-8e4e-cf1d1722f72a None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:20:30.952775 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860683d2-b7eb-4a1a-83ae-8cfe77572b26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:20:30.954160 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860683d2-b7eb-4a1a-83ae-8cfe77572b26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:20:30.955422 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860683d2-b7eb-4a1a-83ae-8cfe77572b26 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:20:30.955712 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860683d2-b7eb-4a1a-83ae-8cfe77572b26 admin admin] PATH_INFO: `/v3/projects/bb233ab978c84af6a87b215076bf69dc` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:20:30.957302 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860683d2-b7eb-4a1a-83ae-8cfe77572b26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb233ab978c84af6a87b215076bf69dc)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:20:30.959309 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860683d2-b7eb-4a1a-83ae-8cfe77572b26 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:20:31.057716 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-860683d2-b7eb-4a1a-83ae-8cfe77572b26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb233ab978c84af6a87b215076bf69dc', 'request_id': 'req-860683d2-b7eb-4a1a-83ae-8cfe77572b26'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:20:31.071707 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-860683d2-b7eb-4a1a-83ae-8cfe77572b26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb233ab978c84af6a87b215076bf69dc', 'request_id': 'req-860683d2-b7eb-4a1a-83ae-8cfe77572b26'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:20:31.080480 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-860683d2-b7eb-4a1a-83ae-8cfe77572b26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb233ab978c84af6a87b215076bf69dc', 'request_id': 'req-860683d2-b7eb-4a1a-83ae-8cfe77572b26'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:20:31.085149 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:20:31.104429 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-860683d2-b7eb-4a1a-83ae-8cfe77572b26 admin admin] The token cache is being invalidate because project bb233ab978c84af6a87b215076bf69dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:20:31.105386 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-860683d2-b7eb-4a1a-83ae-8cfe77572b26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:20:31.106703 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-860683d2-b7eb-4a1a-83ae-8cfe77572b26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:20:31.109382 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1564/3122] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:20:30 2022] DELETE /identity/v3/projects/bb233ab978c84af6a87b215076bf69dc => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:20:31.114253 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d07b02-5813-4b51-8839-305d9e464328 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:20:31.114749 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d07b02-5813-4b51-8839-305d9e464328 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:20:31.115224 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d07b02-5813-4b51-8839-305d9e464328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:20:31.138424 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-27d07b02-5813-4b51-8839-305d9e464328 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:20:31.139997 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-27d07b02-5813-4b51-8839-305d9e464328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:20:31.270431 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9932e7b-0958-42c5-8166-ec73c6af1ea7 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:20:31.271152 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9932e7b-0958-42c5-8166-ec73c6af1ea7 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:20:31.272085 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9932e7b-0958-42c5-8166-ec73c6af1ea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:20:31.275144 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1559/3123] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:20:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:20:31.323631 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-e9932e7b-0958-42c5-8166-ec73c6af1ea7 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:20:31.326029 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-e9932e7b-0958-42c5-8166-ec73c6af1ea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:20:31.342359 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1565/3124] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:20:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:20:31.347139 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d07b02-5813-4b51-8839-305d9e464328 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:20:31.360345 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d07b02-5813-4b51-8839-305d9e464328 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:20:31.391293 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcf9c2b-181f-488b-b1a9-dbfcf81c99fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:20:31.392004 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcf9c2b-181f-488b-b1a9-dbfcf81c99fb admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:20:31.392358 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcf9c2b-181f-488b-b1a9-dbfcf81c99fb admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:20:31.392567 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcf9c2b-181f-488b-b1a9-dbfcf81c99fb admin admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:20:31.393279 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcf9c2b-181f-488b-b1a9-dbfcf81c99fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:20:31.393580 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcf9c2b-181f-488b-b1a9-dbfcf81c99fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:20:31.395697 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcf9c2b-181f-488b-b1a9-dbfcf81c99fb admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:20:31.425996 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1560/3125] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:20:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:20:31.430054 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9932e7b-0958-42c5-8166-ec73c6af1ea7 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:20:31.443426 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9932e7b-0958-42c5-8166-ec73c6af1ea7 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:20:31.460613 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce523a1f-152b-486b-b010-253830e01e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:20:31.461508 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce523a1f-152b-486b-b010-253830e01e25 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:20:31.461899 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce523a1f-152b-486b-b010-253830e01e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:20:31.462189 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce523a1f-152b-486b-b010-253830e01e25 admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:20:31.462932 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce523a1f-152b-486b-b010-253830e01e25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:20:31.465569 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce523a1f-152b-486b-b010-253830e01e25 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:20:31.510767 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1566/3126] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:20:31 2022] POST /identity/v3/projects => generated 373 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:20:31.515234 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcf9c2b-181f-488b-b1a9-dbfcf81c99fb admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:20:31.544807 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcf9c2b-181f-488b-b1a9-dbfcf81c99fb admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:20:31.571287 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:20:31.674507 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c86cbd5-eeb7-4213-b84c-57ce87ab7fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:20:31.675179 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c86cbd5-eeb7-4213-b84c-57ce87ab7fd4 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:20:31.675460 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c86cbd5-eeb7-4213-b84c-57ce87ab7fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:20:31.675742 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c86cbd5-eeb7-4213-b84c-57ce87ab7fd4 admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:20:31.676445 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c86cbd5-eeb7-4213-b84c-57ce87ab7fd4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:20:31.678568 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c86cbd5-eeb7-4213-b84c-57ce87ab7fd4 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:20:31.709896 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1561/3127] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:20:31 2022] POST /identity/v3/users => generated 287 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:20:31.714157 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce523a1f-152b-486b-b010-253830e01e25 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:20:31.728009 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce523a1f-152b-486b-b010-253830e01e25 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:20:31.741480 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39655a3f-fa9c-473a-b3cc-70aa23617149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:20:31.741480 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39655a3f-fa9c-473a-b3cc-70aa23617149 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:20:31.741480 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39655a3f-fa9c-473a-b3cc-70aa23617149 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:20:31.742942 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39655a3f-fa9c-473a-b3cc-70aa23617149 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:20:31.743702 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39655a3f-fa9c-473a-b3cc-70aa23617149 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:20:31.745466 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39655a3f-fa9c-473a-b3cc-70aa23617149 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:20:31.762011 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1567/3128] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:20:31 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 21:20:31.765639 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c86cbd5-eeb7-4213-b84c-57ce87ab7fd4 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:20:31.780200 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c86cbd5-eeb7-4213-b84c-57ce87ab7fd4 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:20:31.786776 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868db092-d305-4245-a9d1-493fe28f2312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:20:31.787890 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868db092-d305-4245-a9d1-493fe28f2312 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:20:31.788409 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868db092-d305-4245-a9d1-493fe28f2312 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:20:31.790265 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868db092-d305-4245-a9d1-493fe28f2312 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:20:31.791212 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868db092-d305-4245-a9d1-493fe28f2312 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:20:31.793494 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868db092-d305-4245-a9d1-493fe28f2312 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:20:31.808249 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1562/3129] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:20:31 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 21:20:31.817915 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39655a3f-fa9c-473a-b3cc-70aa23617149 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:20:31.848740 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39655a3f-fa9c-473a-b3cc-70aa23617149 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:20:31.854985 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5a9c1a-ec2c-4005-bc49-18bc10668a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:20:31.856216 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5a9c1a-ec2c-4005-bc49-18bc10668a08 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:20:31.856500 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5a9c1a-ec2c-4005-bc49-18bc10668a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:20:31.856772 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5a9c1a-ec2c-4005-bc49-18bc10668a08 admin admin] PATH_INFO: `/v3/projects/17582b242546441dbb9976f7dc09366c/users/041c034e5da54285833be29dc81e9f9e/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:20:31.879649 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5a9c1a-ec2c-4005-bc49-18bc10668a08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17582b242546441dbb9976f7dc09366c, user_id=041c034e5da54285833be29dc81e9f9e, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:20:31.882550 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5a9c1a-ec2c-4005-bc49-18bc10668a08 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:20:31.928061 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1568/3130] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:20:31 2022] PUT /identity/v3/projects/17582b242546441dbb9976f7dc09366c/users/041c034e5da54285833be29dc81e9f9e/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:20:31.943171 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f48ca6c-aca6-48fd-bb42-c08bc7edd653 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:20:31.943463 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f48ca6c-aca6-48fd-bb42-c08bc7edd653 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:20:31.943759 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f48ca6c-aca6-48fd-bb42-c08bc7edd653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:20:32.028907 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-2f48ca6c-aca6-48fd-bb42-c08bc7edd653 None None] MFA Rules not processed for user `041c034e5da54285833be29dc81e9f9e`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:20:32.030523 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-2f48ca6c-aca6-48fd-bb42-c08bc7edd653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:20:32.221379 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1563/3131] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:20:31 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:20:32.974013 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5a9c1a-ec2c-4005-bc49-18bc10668a08 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:20:32.979023 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-0c5a9c1a-ec2c-4005-bc49-18bc10668a08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:20:33.176779 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5a9c1a-ec2c-4005-bc49-18bc10668a08 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:20:33.184742 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea057d1d-7f4d-4e73-883e-675d4e913fe2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:20:33.185684 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea057d1d-7f4d-4e73-883e-675d4e913fe2 service nova] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:20:33.187235 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea057d1d-7f4d-4e73-883e-675d4e913fe2 service nova] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:20:33.187771 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea057d1d-7f4d-4e73-883e-675d4e913fe2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:20:33.204064 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea057d1d-7f4d-4e73-883e-675d4e913fe2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:20:33.206582 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea057d1d-7f4d-4e73-883e-675d4e913fe2 service nova] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:20:33.218691 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1569/3132] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:20:32 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:20:34.262396 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f48ca6c-aca6-48fd-bb42-c08bc7edd653 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:20:34.267049 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-2f48ca6c-aca6-48fd-bb42-c08bc7edd653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:20:34.421603 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f48ca6c-aca6-48fd-bb42-c08bc7edd653 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:20:34.425433 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8336c740-7097-4231-978a-cbf45bf661aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:20:34.426192 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8336c740-7097-4231-978a-cbf45bf661aa service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:20:34.426461 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8336c740-7097-4231-978a-cbf45bf661aa service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:20:34.426918 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8336c740-7097-4231-978a-cbf45bf661aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:20:34.429540 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-8336c740-7097-4231-978a-cbf45bf661aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:20:34.482490 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:20:34.523001 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8336c740-7097-4231-978a-cbf45bf661aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:20:34.526040 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8336c740-7097-4231-978a-cbf45bf661aa service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:20:34.550175 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1564/3133] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:20:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:20:36.330299 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea057d1d-7f4d-4e73-883e-675d4e913fe2 service nova] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:20:36.350865 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea057d1d-7f4d-4e73-883e-675d4e913fe2 service nova] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:20:36.386570 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee001b2b-7cda-42cf-bd34-9033ccf761b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:20:36.386570 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee001b2b-7cda-42cf-bd34-9033ccf761b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:20:36.386570 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee001b2b-7cda-42cf-bd34-9033ccf761b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:20:36.386570 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee001b2b-7cda-42cf-bd34-9033ccf761b1 admin admin] PATH_INFO: `/v3/users/041c034e5da54285833be29dc81e9f9e` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:20:36.391443 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee001b2b-7cda-42cf-bd34-9033ccf761b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=041c034e5da54285833be29dc81e9f9e)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:20:36.395995 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee001b2b-7cda-42cf-bd34-9033ccf761b1 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:20:36.506721 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8336c740-7097-4231-978a-cbf45bf661aa service neutron] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:20:36.521224 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8336c740-7097-4231-978a-cbf45bf661aa service neutron] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:20:36.524186 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-ee001b2b-7cda-42cf-bd34-9033ccf761b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '041c034e5da54285833be29dc81e9f9e'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:20:36.526618 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-ee001b2b-7cda-42cf-bd34-9033ccf761b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '041c034e5da54285833be29dc81e9f9e'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:20:36.534526 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97286ba1-d344-41c8-9c65-9e37dc00ca5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:20:36.536779 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97286ba1-d344-41c8-9c65-9e37dc00ca5b service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:20:36.538002 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97286ba1-d344-41c8-9c65-9e37dc00ca5b service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:20:36.540676 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97286ba1-d344-41c8-9c65-9e37dc00ca5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:20:36.545007 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-97286ba1-d344-41c8-9c65-9e37dc00ca5b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:20:36.546879 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-ee001b2b-7cda-42cf-bd34-9033ccf761b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '041c034e5da54285833be29dc81e9f9e'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:20:36.570546 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97286ba1-d344-41c8-9c65-9e37dc00ca5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:20:36.572647 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97286ba1-d344-41c8-9c65-9e37dc00ca5b service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:20:36.574153 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-ee001b2b-7cda-42cf-bd34-9033ccf761b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '041c034e5da54285833be29dc81e9f9e'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:20:36.581443 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:20:36.594238 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1565/3134] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:20:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:20:36.599519 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-ee001b2b-7cda-42cf-bd34-9033ccf761b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '041c034e5da54285833be29dc81e9f9e'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:20:36.611114 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1570/3135] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:20:36 2022] DELETE /identity/v3/users/041c034e5da54285833be29dc81e9f9e => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:20:36.617635 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43aee2d-3ecc-4371-b307-be017be16c1c None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:20:36.618346 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43aee2d-3ecc-4371-b307-be017be16c1c None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:20:36.618726 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43aee2d-3ecc-4371-b307-be017be16c1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:20:36.645709 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-e43aee2d-3ecc-4371-b307-be017be16c1c None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:20:36.647617 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-e43aee2d-3ecc-4371-b307-be017be16c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:20:36.799758 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1566/3136] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:20:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:20:36.854456 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee001b2b-7cda-42cf-bd34-9033ccf761b1 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:20:36.856320 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-ee001b2b-7cda-42cf-bd34-9033ccf761b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:20:36.939606 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee001b2b-7cda-42cf-bd34-9033ccf761b1 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:20:36.945955 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a73b842-ae67-40cf-bdb2-68c1100c0ce0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:20:36.946894 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a73b842-ae67-40cf-bdb2-68c1100c0ce0 service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:20:36.947540 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a73b842-ae67-40cf-bdb2-68c1100c0ce0 service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:20:36.948122 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a73b842-ae67-40cf-bdb2-68c1100c0ce0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:20:36.961623 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a73b842-ae67-40cf-bdb2-68c1100c0ce0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:20:36.964265 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a73b842-ae67-40cf-bdb2-68c1100c0ce0 service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:20:36.978880 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1571/3137] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:20:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:20:38.285398 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43aee2d-3ecc-4371-b307-be017be16c1c None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:20:38.288184 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-e43aee2d-3ecc-4371-b307-be017be16c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:20:38.309639 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43aee2d-3ecc-4371-b307-be017be16c1c None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:20:38.316003 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810c4f08-3420-4c01-89d0-88646c6dfebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:20:38.318205 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810c4f08-3420-4c01-89d0-88646c6dfebd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:20:38.319225 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810c4f08-3420-4c01-89d0-88646c6dfebd admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:20:38.319825 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810c4f08-3420-4c01-89d0-88646c6dfebd admin admin] PATH_INFO: `/v3/projects/17582b242546441dbb9976f7dc09366c` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:20:38.321684 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810c4f08-3420-4c01-89d0-88646c6dfebd admin admin] RBAC: Authorizing `identity:delete_project(project_id=17582b242546441dbb9976f7dc09366c)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:20:38.324030 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810c4f08-3420-4c01-89d0-88646c6dfebd admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:20:38.452836 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-810c4f08-3420-4c01-89d0-88646c6dfebd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17582b242546441dbb9976f7dc09366c', 'request_id': 'req-810c4f08-3420-4c01-89d0-88646c6dfebd'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:20:38.479812 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-810c4f08-3420-4c01-89d0-88646c6dfebd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17582b242546441dbb9976f7dc09366c', 'request_id': 'req-810c4f08-3420-4c01-89d0-88646c6dfebd'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:20:38.492515 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-810c4f08-3420-4c01-89d0-88646c6dfebd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17582b242546441dbb9976f7dc09366c', 'request_id': 'req-810c4f08-3420-4c01-89d0-88646c6dfebd'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:20:38.522784 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-810c4f08-3420-4c01-89d0-88646c6dfebd admin admin] The token cache is being invalidate because project 17582b242546441dbb9976f7dc09366c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:20:38.523453 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-810c4f08-3420-4c01-89d0-88646c6dfebd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:20:38.526678 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-810c4f08-3420-4c01-89d0-88646c6dfebd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:20:38.535666 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0f3751-e845-4985-abd7-086ad06d7cbb None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:20:38.536130 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0f3751-e845-4985-abd7-086ad06d7cbb None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:20:38.536417 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1567/3138] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:20:38 2022] DELETE /identity/v3/projects/17582b242546441dbb9976f7dc09366c => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:20:38.547414 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0f3751-e845-4985-abd7-086ad06d7cbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:20:38.576711 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-ea0f3751-e845-4985-abd7-086ad06d7cbb None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:20:38.578834 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-ea0f3751-e845-4985-abd7-086ad06d7cbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:20:38.675784 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1572/3139] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:20:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:20:38.677584 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85736d44-5b13-43ba-8146-bcd1c5510055 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:20:38.677889 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85736d44-5b13-43ba-8146-bcd1c5510055 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:20:38.678174 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85736d44-5b13-43ba-8146-bcd1c5510055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:20:38.700169 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-85736d44-5b13-43ba-8146-bcd1c5510055 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:20:38.701177 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-85736d44-5b13-43ba-8146-bcd1c5510055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:20:38.711621 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1568/3140] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:20:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:20:38.714853 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0f3751-e845-4985-abd7-086ad06d7cbb None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:20:38.730909 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0f3751-e845-4985-abd7-086ad06d7cbb None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:20:38.737734 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e224b571-3269-42ab-83e4-9f5c7df0e406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:20:38.738470 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e224b571-3269-42ab-83e4-9f5c7df0e406 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:20:38.738749 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e224b571-3269-42ab-83e4-9f5c7df0e406 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:20:38.739020 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e224b571-3269-42ab-83e4-9f5c7df0e406 admin admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:20:38.740369 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e224b571-3269-42ab-83e4-9f5c7df0e406 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:20:38.740684 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e224b571-3269-42ab-83e4-9f5c7df0e406 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:20:38.742331 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e224b571-3269-42ab-83e4-9f5c7df0e406 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:20:38.769391 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1573/3141] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:20:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:20:38.774411 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85736d44-5b13-43ba-8146-bcd1c5510055 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:20:38.798586 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85736d44-5b13-43ba-8146-bcd1c5510055 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:20:38.804958 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298e1fee-0bd8-4058-8698-5c0bfba71c73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:20:38.806042 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298e1fee-0bd8-4058-8698-5c0bfba71c73 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:20:38.806541 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298e1fee-0bd8-4058-8698-5c0bfba71c73 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:20:38.807002 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298e1fee-0bd8-4058-8698-5c0bfba71c73 admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:20:38.808502 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298e1fee-0bd8-4058-8698-5c0bfba71c73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:20:38.811657 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298e1fee-0bd8-4058-8698-5c0bfba71c73 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:20:38.875152 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1569/3142] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:20:38 2022] POST /identity/v3/projects => generated 403 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:20:38.879365 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e224b571-3269-42ab-83e4-9f5c7df0e406 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:20:38.910447 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e224b571-3269-42ab-83e4-9f5c7df0e406 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:20:39.045649 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1435be5-ff3a-46f0-bd5a-93b1203a35f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:20:39.046772 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1435be5-ff3a-46f0-bd5a-93b1203a35f0 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:20:39.047126 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1435be5-ff3a-46f0-bd5a-93b1203a35f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:20:39.047402 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1435be5-ff3a-46f0-bd5a-93b1203a35f0 admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:20:39.048244 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1435be5-ff3a-46f0-bd5a-93b1203a35f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:20:39.051527 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1435be5-ff3a-46f0-bd5a-93b1203a35f0 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:20:39.085110 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1574/3143] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:20:38 2022] POST /identity/v3/users => generated 302 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:20:39.085376 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298e1fee-0bd8-4058-8698-5c0bfba71c73 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:20:39.096809 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298e1fee-0bd8-4058-8698-5c0bfba71c73 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:20:39.102832 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3580f2f6-7051-47b0-80c8-080985591670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:20:39.103647 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3580f2f6-7051-47b0-80c8-080985591670 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:20:39.104015 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3580f2f6-7051-47b0-80c8-080985591670 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:20:39.104399 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3580f2f6-7051-47b0-80c8-080985591670 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:20:39.105608 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3580f2f6-7051-47b0-80c8-080985591670 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:20:39.107381 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3580f2f6-7051-47b0-80c8-080985591670 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:20:39.127817 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1435be5-ff3a-46f0-bd5a-93b1203a35f0 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:20:39.140642 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1570/3144] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:20:39 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:20:39.143756 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1435be5-ff3a-46f0-bd5a-93b1203a35f0 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:20:39.150461 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368be5d9-49d2-4d5d-9aeb-88f9e8a15092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:20:39.151424 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368be5d9-49d2-4d5d-9aeb-88f9e8a15092 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:20:39.152525 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368be5d9-49d2-4d5d-9aeb-88f9e8a15092 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:20:39.153020 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368be5d9-49d2-4d5d-9aeb-88f9e8a15092 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:20:39.154157 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368be5d9-49d2-4d5d-9aeb-88f9e8a15092 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:20:39.156822 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368be5d9-49d2-4d5d-9aeb-88f9e8a15092 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:20:39.160308 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:20:39.190517 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1575/3145] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:20:39 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:20:39.196276 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3580f2f6-7051-47b0-80c8-080985591670 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:20:39.203788 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:20:39.237906 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3580f2f6-7051-47b0-80c8-080985591670 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:20:39.250526 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b0fda4-8030-406f-832f-f913c42c3223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:20:39.251448 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b0fda4-8030-406f-832f-f913c42c3223 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:20:39.251726 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b0fda4-8030-406f-832f-f913c42c3223 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:20:39.251993 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b0fda4-8030-406f-832f-f913c42c3223 admin admin] PATH_INFO: `/v3/projects/24d534ba297c4d709c5ccf36c9394842/users/a271336fe39f4bcb94d326ddfb7b4365/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:20:39.288569 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b0fda4-8030-406f-832f-f913c42c3223 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24d534ba297c4d709c5ccf36c9394842, user_id=a271336fe39f4bcb94d326ddfb7b4365, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:20:39.298140 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b0fda4-8030-406f-832f-f913c42c3223 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:20:39.324619 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1571/3146] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:20:39 2022] PUT /identity/v3/projects/24d534ba297c4d709c5ccf36c9394842/users/a271336fe39f4bcb94d326ddfb7b4365/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:20:39.333015 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e81484-de59-45e2-9bbb-5d4fa045b58b None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:20:39.333379 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e81484-de59-45e2-9bbb-5d4fa045b58b None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:20:39.333795 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e81484-de59-45e2-9bbb-5d4fa045b58b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:20:39.362951 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-f5e81484-de59-45e2-9bbb-5d4fa045b58b None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:20:39.364658 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-f5e81484-de59-45e2-9bbb-5d4fa045b58b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:20:39.498699 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1576/3147] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:20:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:20:39.522420 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b0fda4-8030-406f-832f-f913c42c3223 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:20:39.524411 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-14b0fda4-8030-406f-832f-f913c42c3223 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:20:39.630599 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b0fda4-8030-406f-832f-f913c42c3223 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:20:39.639441 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fc2895-d0d3-469e-8d3f-68c90c54e956 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:20:39.640189 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fc2895-d0d3-469e-8d3f-68c90c54e956 service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:20:39.640502 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fc2895-d0d3-469e-8d3f-68c90c54e956 service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:20:39.647048 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fc2895-d0d3-469e-8d3f-68c90c54e956 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:20:39.664574 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fc2895-d0d3-469e-8d3f-68c90c54e956 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:20:39.666372 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fc2895-d0d3-469e-8d3f-68c90c54e956 service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:20:39.679882 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1572/3148] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:20:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:20:44.488784 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e81484-de59-45e2-9bbb-5d4fa045b58b None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:20:44.490827 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-f5e81484-de59-45e2-9bbb-5d4fa045b58b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:20:44.661498 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e81484-de59-45e2-9bbb-5d4fa045b58b None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:20:44.679391 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb845e2-d340-43b6-ad01-d7fb27d2b63d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc719a3b3ac4461b82ca04ab6451d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:20:44.681070 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb845e2-d340-43b6-ad01-d7fb27d2b63d service placement] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:20:44.681900 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb845e2-d340-43b6-ad01-d7fb27d2b63d service placement] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:20:44.681900 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb845e2-d340-43b6-ad01-d7fb27d2b63d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:20:44.683869 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-8bb845e2-d340-43b6-ad01-d7fb27d2b63d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:20:44.705182 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb845e2-d340-43b6-ad01-d7fb27d2b63d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:20:44.707773 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb845e2-d340-43b6-ad01-d7fb27d2b63d service placement] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:20:44.719313 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1577/3149] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:20:44 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:20:49.674533 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=35,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:20:52.936460 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71590ba2-f9fb-42dd-9e1f-4fc30218003b None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:20:52.939284 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71590ba2-f9fb-42dd-9e1f-4fc30218003b None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:20:52.940162 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71590ba2-f9fb-42dd-9e1f-4fc30218003b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:20:53.064115 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-71590ba2-f9fb-42dd-9e1f-4fc30218003b None None] MFA Rules not processed for user `a271336fe39f4bcb94d326ddfb7b4365`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:20:53.066454 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-71590ba2-f9fb-42dd-9e1f-4fc30218003b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:20:53.249777 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1573/3150] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:20:52 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:20:54.270945 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb845e2-d340-43b6-ad01-d7fb27d2b63d service placement] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:20:54.272677 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-8bb845e2-d340-43b6-ad01-d7fb27d2b63d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:20:54.474002 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb845e2-d340-43b6-ad01-d7fb27d2b63d service placement] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:20:54.483471 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a6042e-b1a4-4f9b-8e4c-0da149c56f50 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:20:54.484157 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a6042e-b1a4-4f9b-8e4c-0da149c56f50 service nova] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:20:54.485638 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a6042e-b1a4-4f9b-8e4c-0da149c56f50 service nova] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:20:54.485943 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a6042e-b1a4-4f9b-8e4c-0da149c56f50 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:20:54.499526 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a6042e-b1a4-4f9b-8e4c-0da149c56f50 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:20:54.501705 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a6042e-b1a4-4f9b-8e4c-0da149c56f50 service nova] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:20:54.514575 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1578/3151] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:20:54 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 23 21:20:54.688725 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6933d38-5370-41ed-a874-a244e9756928 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:20:54.689265 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6933d38-5370-41ed-a874-a244e9756928 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:20:54.689265 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6933d38-5370-41ed-a874-a244e9756928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:20:54.728283 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-e6933d38-5370-41ed-a874-a244e9756928 None None] MFA Rules not processed for user `17b779a3e21a415bb42cde5d6863d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:20:54.729580 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-e6933d38-5370-41ed-a874-a244e9756928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:20:54.892552 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1574/3152] 10.222.0.17 () {58 vars in 1009 bytes} [Sat Jul 23 21:20:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:20:54.906191 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a6042e-b1a4-4f9b-8e4c-0da149c56f50 service nova] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:20:54.907488 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-04a6042e-b1a4-4f9b-8e4c-0da149c56f50 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:20:54.932989 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:20:55.082601 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a6042e-b1a4-4f9b-8e4c-0da149c56f50 service nova] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:20:55.094055 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c5d3d6-9098-4b8e-b31d-d2ed35f4d226 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f0a685b7da46afb81024848f079d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:20:55.094826 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c5d3d6-9098-4b8e-b31d-d2ed35f4d226 service swift] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:20:55.095109 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c5d3d6-9098-4b8e-b31d-d2ed35f4d226 service swift] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:20:55.096079 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c5d3d6-9098-4b8e-b31d-d2ed35f4d226 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:20:55.142691 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c5d3d6-9098-4b8e-b31d-d2ed35f4d226 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:20:55.144402 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c5d3d6-9098-4b8e-b31d-d2ed35f4d226 service swift] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:20:55.174592 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1579/3153] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 23 21:20:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 23 21:20:59.014913 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6933d38-5370-41ed-a874-a244e9756928 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:20:59.016620 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-e6933d38-5370-41ed-a874-a244e9756928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:20:59.057413 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6933d38-5370-41ed-a874-a244e9756928 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:20:59.078299 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4252d6-3353-49d6-9f7d-2bc6cae99602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:20:59.085310 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4252d6-3353-49d6-9f7d-2bc6cae99602 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:20:59.092988 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4252d6-3353-49d6-9f7d-2bc6cae99602 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:20:59.093265 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4252d6-3353-49d6-9f7d-2bc6cae99602 admin admin] PATH_INFO: `/v3/users/3a56b82cf3954f279dd21e17a42462b3` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:20:59.101066 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4252d6-3353-49d6-9f7d-2bc6cae99602 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a56b82cf3954f279dd21e17a42462b3)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:20:59.110261 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4252d6-3353-49d6-9f7d-2bc6cae99602 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:20:59.293938 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-9f4252d6-3353-49d6-9f7d-2bc6cae99602 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a56b82cf3954f279dd21e17a42462b3'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:20:59.308449 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-9f4252d6-3353-49d6-9f7d-2bc6cae99602 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a56b82cf3954f279dd21e17a42462b3'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:20:59.312294 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-9f4252d6-3353-49d6-9f7d-2bc6cae99602 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a56b82cf3954f279dd21e17a42462b3'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:20:59.333047 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-9f4252d6-3353-49d6-9f7d-2bc6cae99602 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a56b82cf3954f279dd21e17a42462b3'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:20:59.377268 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-9f4252d6-3353-49d6-9f7d-2bc6cae99602 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a56b82cf3954f279dd21e17a42462b3'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:20:59.423096 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1575/3154] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:20:59 2022] DELETE /identity/v3/users/3a56b82cf3954f279dd21e17a42462b3 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:21:00.394380 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c5d3d6-9098-4b8e-b31d-d2ed35f4d226 service swift] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:21:00.433030 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c5d3d6-9098-4b8e-b31d-d2ed35f4d226 service swift] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:21:00.543337 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182fa9b8-23a4-46ff-8e3b-c42675b9b533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:21:00.544432 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182fa9b8-23a4-46ff-8e3b-c42675b9b533 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:21:00.544880 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182fa9b8-23a4-46ff-8e3b-c42675b9b533 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:21:00.546098 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182fa9b8-23a4-46ff-8e3b-c42675b9b533 admin admin] PATH_INFO: `/v3/projects/b347973dfb204484bdb87ab0094dbe22` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:21:00.548427 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182fa9b8-23a4-46ff-8e3b-c42675b9b533 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b347973dfb204484bdb87ab0094dbe22)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:21:00.569128 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182fa9b8-23a4-46ff-8e3b-c42675b9b533 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:21:00.719866 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-182fa9b8-23a4-46ff-8e3b-c42675b9b533 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b347973dfb204484bdb87ab0094dbe22', 'request_id': 'req-182fa9b8-23a4-46ff-8e3b-c42675b9b533'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:21:00.743903 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-182fa9b8-23a4-46ff-8e3b-c42675b9b533 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b347973dfb204484bdb87ab0094dbe22', 'request_id': 'req-182fa9b8-23a4-46ff-8e3b-c42675b9b533'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:21:00.753304 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-182fa9b8-23a4-46ff-8e3b-c42675b9b533 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b347973dfb204484bdb87ab0094dbe22', 'request_id': 'req-182fa9b8-23a4-46ff-8e3b-c42675b9b533'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:21:00.791496 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-182fa9b8-23a4-46ff-8e3b-c42675b9b533 admin admin] The token cache is being invalidate because project b347973dfb204484bdb87ab0094dbe22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:21:00.791796 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-182fa9b8-23a4-46ff-8e3b-c42675b9b533 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:21:00.796740 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-182fa9b8-23a4-46ff-8e3b-c42675b9b533 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:21:00.796740 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1580/3155] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:21:00 2022] DELETE /identity/v3/projects/b347973dfb204484bdb87ab0094dbe22 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:21:00.801543 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4252d6-3353-49d6-9f7d-2bc6cae99602 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:21:00.803769 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-9f4252d6-3353-49d6-9f7d-2bc6cae99602 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:21:00.829715 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4252d6-3353-49d6-9f7d-2bc6cae99602 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:21:00.844789 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:21:00.941852 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7407d5-395a-44cd-9a90-a64237683cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:21:00.942093 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7407d5-395a-44cd-9a90-a64237683cd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:21:00.942567 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7407d5-395a-44cd-9a90-a64237683cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:21:00.943776 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7407d5-395a-44cd-9a90-a64237683cd7 admin admin] PATH_INFO: `/v3/users/7efc45807d654f008f6dce01fd5f808d` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:21:00.948489 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7407d5-395a-44cd-9a90-a64237683cd7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7efc45807d654f008f6dce01fd5f808d)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:21:00.952823 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7407d5-395a-44cd-9a90-a64237683cd7 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:21:00.991489 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182fa9b8-23a4-46ff-8e3b-c42675b9b533 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:21:00.993169 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-182fa9b8-23a4-46ff-8e3b-c42675b9b533 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:21:01.020958 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182fa9b8-23a4-46ff-8e3b-c42675b9b533 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:21:01.039467 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1311605b-cdf7-403a-9a22-6ac1ab7e696b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:21:01.040751 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1311605b-cdf7-403a-9a22-6ac1ab7e696b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:21:01.043649 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1311605b-cdf7-403a-9a22-6ac1ab7e696b admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:21:01.046789 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1311605b-cdf7-403a-9a22-6ac1ab7e696b admin admin] PATH_INFO: `/v3/users/f2672c5db79b4a48a505c3df536594dd` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:21:01.049715 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1311605b-cdf7-403a-9a22-6ac1ab7e696b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2672c5db79b4a48a505c3df536594dd)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:21:01.053308 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1311605b-cdf7-403a-9a22-6ac1ab7e696b admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:21:01.055901 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-4a7407d5-395a-44cd-9a90-a64237683cd7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7efc45807d654f008f6dce01fd5f808d'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:21:01.069855 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-4a7407d5-395a-44cd-9a90-a64237683cd7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7efc45807d654f008f6dce01fd5f808d'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:21:01.070728 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-4a7407d5-395a-44cd-9a90-a64237683cd7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7efc45807d654f008f6dce01fd5f808d'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:21:01.094332 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-4a7407d5-395a-44cd-9a90-a64237683cd7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7efc45807d654f008f6dce01fd5f808d'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:21:01.122857 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:21:01.126831 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-4a7407d5-395a-44cd-9a90-a64237683cd7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7efc45807d654f008f6dce01fd5f808d'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:21:01.139696 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1576/3156] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:21:00 2022] DELETE /identity/v3/users/7efc45807d654f008f6dce01fd5f808d => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:21:01.179235 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-1311605b-cdf7-403a-9a22-6ac1ab7e696b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2672c5db79b4a48a505c3df536594dd'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:21:01.180901 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-1311605b-cdf7-403a-9a22-6ac1ab7e696b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2672c5db79b4a48a505c3df536594dd'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:21:01.194555 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-1311605b-cdf7-403a-9a22-6ac1ab7e696b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2672c5db79b4a48a505c3df536594dd'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:21:01.210377 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-1311605b-cdf7-403a-9a22-6ac1ab7e696b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2672c5db79b4a48a505c3df536594dd'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:21:01.238175 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-1311605b-cdf7-403a-9a22-6ac1ab7e696b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2672c5db79b4a48a505c3df536594dd'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:21:01.254456 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1581/3157] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:21:00 2022] DELETE /identity/v3/users/f2672c5db79b4a48a505c3df536594dd => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:21:02.207032 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7407d5-395a-44cd-9a90-a64237683cd7 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:21:02.208704 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-4a7407d5-395a-44cd-9a90-a64237683cd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:21:02.236678 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1311605b-cdf7-403a-9a22-6ac1ab7e696b admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:21:02.238859 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-1311605b-cdf7-403a-9a22-6ac1ab7e696b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:21:02.340520 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7407d5-395a-44cd-9a90-a64237683cd7 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:21:02.403802 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1311605b-cdf7-403a-9a22-6ac1ab7e696b admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:21:02.424596 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2435626-5b5e-4e4f-a57b-ec2e04f0759b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:21:02.427258 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2435626-5b5e-4e4f-a57b-ec2e04f0759b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:21:02.427537 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2435626-5b5e-4e4f-a57b-ec2e04f0759b admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:21:02.427820 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2435626-5b5e-4e4f-a57b-ec2e04f0759b admin admin] PATH_INFO: `/v3/projects/6610a2359aa64f89befcf72e4f3f6a54` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:21:02.429463 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2435626-5b5e-4e4f-a57b-ec2e04f0759b admin admin] RBAC: Authorizing `identity:delete_project(project_id=6610a2359aa64f89befcf72e4f3f6a54)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:21:02.431426 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2435626-5b5e-4e4f-a57b-ec2e04f0759b admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:21:02.472637 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:21:02.547468 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7af005-ca85-4ee2-98db-721166957934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:21:02.547761 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c2435626-5b5e-4e4f-a57b-ec2e04f0759b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6610a2359aa64f89befcf72e4f3f6a54', 'request_id': 'req-c2435626-5b5e-4e4f-a57b-ec2e04f0759b'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:21:02.548420 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7af005-ca85-4ee2-98db-721166957934 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:21:02.548700 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7af005-ca85-4ee2-98db-721166957934 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:21:02.548967 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7af005-ca85-4ee2-98db-721166957934 admin admin] PATH_INFO: `/v3/projects/286a1457f4d14672a7edec877b939620` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:21:02.550721 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7af005-ca85-4ee2-98db-721166957934 admin admin] RBAC: Authorizing `identity:delete_project(project_id=286a1457f4d14672a7edec877b939620)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:21:02.555083 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7af005-ca85-4ee2-98db-721166957934 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:21:02.565981 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c2435626-5b5e-4e4f-a57b-ec2e04f0759b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6610a2359aa64f89befcf72e4f3f6a54', 'request_id': 'req-c2435626-5b5e-4e4f-a57b-ec2e04f0759b'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:21:02.576622 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c2435626-5b5e-4e4f-a57b-ec2e04f0759b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6610a2359aa64f89befcf72e4f3f6a54', 'request_id': 'req-c2435626-5b5e-4e4f-a57b-ec2e04f0759b'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:21:02.602563 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c2435626-5b5e-4e4f-a57b-ec2e04f0759b admin admin] The token cache is being invalidate because project 6610a2359aa64f89befcf72e4f3f6a54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:21:02.602823 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c2435626-5b5e-4e4f-a57b-ec2e04f0759b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:21:02.607020 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c2435626-5b5e-4e4f-a57b-ec2e04f0759b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:21:02.609792 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1582/3158] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:21:02 2022] DELETE /identity/v3/projects/6610a2359aa64f89befcf72e4f3f6a54 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:21:02.614071 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2435626-5b5e-4e4f-a57b-ec2e04f0759b admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:21:02.615754 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-c2435626-5b5e-4e4f-a57b-ec2e04f0759b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:21:02.671820 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:21:02.695154 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-2a7af005-ca85-4ee2-98db-721166957934 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '286a1457f4d14672a7edec877b939620', 'request_id': 'req-2a7af005-ca85-4ee2-98db-721166957934'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:21:02.713299 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-2a7af005-ca85-4ee2-98db-721166957934 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '286a1457f4d14672a7edec877b939620', 'request_id': 'req-2a7af005-ca85-4ee2-98db-721166957934'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:21:02.717365 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2435626-5b5e-4e4f-a57b-ec2e04f0759b admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:21:02.723931 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-2a7af005-ca85-4ee2-98db-721166957934 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '286a1457f4d14672a7edec877b939620', 'request_id': 'req-2a7af005-ca85-4ee2-98db-721166957934'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:21:02.752010 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-2a7af005-ca85-4ee2-98db-721166957934 admin admin] The token cache is being invalidate because project 286a1457f4d14672a7edec877b939620 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:21:02.752895 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-2a7af005-ca85-4ee2-98db-721166957934 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:21:02.756537 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-2a7af005-ca85-4ee2-98db-721166957934 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:21:02.760425 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1577/3159] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:21:02 2022] DELETE /identity/v3/projects/286a1457f4d14672a7edec877b939620 => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:21:02.765652 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ebe8c1-e959-4897-a6f2-84f51928638f None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:21:02.766225 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ebe8c1-e959-4897-a6f2-84f51928638f None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:21:02.766742 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ebe8c1-e959-4897-a6f2-84f51928638f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:21:02.807694 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-63ebe8c1-e959-4897-a6f2-84f51928638f None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:21:02.809595 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-63ebe8c1-e959-4897-a6f2-84f51928638f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:21:02.841364 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1260602-a5f2-46a1-a1c2-c36241dd8601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:21:02.842480 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1260602-a5f2-46a1-a1c2-c36241dd8601 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:21:02.842766 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1260602-a5f2-46a1-a1c2-c36241dd8601 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:21:02.843039 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1260602-a5f2-46a1-a1c2-c36241dd8601 admin admin] PATH_INFO: `/v3/users/a47a7cc74c1041c68d49ab37ef3e2643` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:21:02.844315 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1260602-a5f2-46a1-a1c2-c36241dd8601 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a47a7cc74c1041c68d49ab37ef3e2643)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:21:02.846789 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1260602-a5f2-46a1-a1c2-c36241dd8601 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:21:02.928834 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-f1260602-a5f2-46a1-a1c2-c36241dd8601 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a47a7cc74c1041c68d49ab37ef3e2643'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:21:02.932498 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-f1260602-a5f2-46a1-a1c2-c36241dd8601 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a47a7cc74c1041c68d49ab37ef3e2643'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:21:02.963881 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-f1260602-a5f2-46a1-a1c2-c36241dd8601 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a47a7cc74c1041c68d49ab37ef3e2643'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:21:02.988980 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-f1260602-a5f2-46a1-a1c2-c36241dd8601 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a47a7cc74c1041c68d49ab37ef3e2643'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:21:03.002123 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1578/3160] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:21:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:21:03.004072 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606ab523-c79b-4dd8-b212-df7a86d4d4ec None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:21:03.004355 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606ab523-c79b-4dd8-b212-df7a86d4d4ec None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:21:03.004627 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606ab523-c79b-4dd8-b212-df7a86d4d4ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:21:03.031530 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-f1260602-a5f2-46a1-a1c2-c36241dd8601 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a47a7cc74c1041c68d49ab37ef3e2643'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:21:03.042522 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1583/3161] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:21:02 2022] DELETE /identity/v3/users/a47a7cc74c1041c68d49ab37ef3e2643 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:21:03.065946 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-606ab523-c79b-4dd8-b212-df7a86d4d4ec None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:21:03.068364 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-606ab523-c79b-4dd8-b212-df7a86d4d4ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:21:03.237990 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1579/3162] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:21:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:21:03.241937 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1260602-a5f2-46a1-a1c2-c36241dd8601 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:21:03.260327 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1260602-a5f2-46a1-a1c2-c36241dd8601 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:21:03.298615 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23da27bd-7426-4a64-a0c4-6ebb7addfa77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:21:03.300467 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23da27bd-7426-4a64-a0c4-6ebb7addfa77 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:21:03.300763 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23da27bd-7426-4a64-a0c4-6ebb7addfa77 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:21:03.301041 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23da27bd-7426-4a64-a0c4-6ebb7addfa77 admin admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:21:03.301804 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23da27bd-7426-4a64-a0c4-6ebb7addfa77 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:21:03.304065 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23da27bd-7426-4a64-a0c4-6ebb7addfa77 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:21:03.310784 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23da27bd-7426-4a64-a0c4-6ebb7addfa77 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:21:03.358224 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1584/3163] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:21:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:21:03.363400 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606ab523-c79b-4dd8-b212-df7a86d4d4ec None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:21:03.373395 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:21:03.389673 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606ab523-c79b-4dd8-b212-df7a86d4d4ec None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:21:03.399077 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c004b5-cb5e-44b7-853a-2c9d10ae3d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:21:03.399768 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c004b5-cb5e-44b7-853a-2c9d10ae3d9c admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:21:03.400055 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c004b5-cb5e-44b7-853a-2c9d10ae3d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:21:03.400338 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c004b5-cb5e-44b7-853a-2c9d10ae3d9c admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:21:03.401443 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c004b5-cb5e-44b7-853a-2c9d10ae3d9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:21:03.403060 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c004b5-cb5e-44b7-853a-2c9d10ae3d9c admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:21:03.440539 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1580/3164] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:21:03 2022] POST /identity/v3/projects => generated 375 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:21:03.447444 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23da27bd-7426-4a64-a0c4-6ebb7addfa77 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:21:03.460050 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23da27bd-7426-4a64-a0c4-6ebb7addfa77 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:21:03.522152 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:21:03.548340 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c004b5-cb5e-44b7-853a-2c9d10ae3d9c admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:21:03.551528 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-40c004b5-cb5e-44b7-853a-2c9d10ae3d9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:21:03.553784 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b2281e-e992-4104-bf8a-88c73f8b6474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:21:03.555557 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b2281e-e992-4104-bf8a-88c73f8b6474 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:21:03.557309 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b2281e-e992-4104-bf8a-88c73f8b6474 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:21:03.557309 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b2281e-e992-4104-bf8a-88c73f8b6474 admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:21:03.557309 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b2281e-e992-4104-bf8a-88c73f8b6474 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:21:03.560350 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b2281e-e992-4104-bf8a-88c73f8b6474 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:21:03.575830 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c004b5-cb5e-44b7-853a-2c9d10ae3d9c admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:21:03.591126 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe75f82-dc4c-40a9-9ada-1d43099404e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:21:03.593037 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1585/3165] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:21:03 2022] POST /identity/v3/users => generated 288 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:21:03.594880 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe75f82-dc4c-40a9-9ada-1d43099404e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:21:03.595177 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe75f82-dc4c-40a9-9ada-1d43099404e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:21:03.595445 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe75f82-dc4c-40a9-9ada-1d43099404e9 admin admin] PATH_INFO: `/v3/projects/9193a8f9e7b741179a36e86ffa1b2b24` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:21:03.598668 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b2281e-e992-4104-bf8a-88c73f8b6474 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:21:03.598815 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe75f82-dc4c-40a9-9ada-1d43099404e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9193a8f9e7b741179a36e86ffa1b2b24)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:21:03.612108 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe75f82-dc4c-40a9-9ada-1d43099404e9 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:21:03.628873 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b2281e-e992-4104-bf8a-88c73f8b6474 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:21:03.651249 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5638fd-648f-4607-80f2-ba792e090ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:21:03.652429 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5638fd-648f-4607-80f2-ba792e090ed6 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:21:03.653393 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5638fd-648f-4607-80f2-ba792e090ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:21:03.654170 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5638fd-648f-4607-80f2-ba792e090ed6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:21:03.655326 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5638fd-648f-4607-80f2-ba792e090ed6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:21:03.658594 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5638fd-648f-4607-80f2-ba792e090ed6 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:21:03.697509 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1586/3166] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:21:03 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:21:03.700476 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5638fd-648f-4607-80f2-ba792e090ed6 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:21:03.720329 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5638fd-648f-4607-80f2-ba792e090ed6 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:21:03.739186 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-dfe75f82-dc4c-40a9-9ada-1d43099404e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9193a8f9e7b741179a36e86ffa1b2b24', 'request_id': 'req-dfe75f82-dc4c-40a9-9ada-1d43099404e9'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:21:03.755084 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-dfe75f82-dc4c-40a9-9ada-1d43099404e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9193a8f9e7b741179a36e86ffa1b2b24', 'request_id': 'req-dfe75f82-dc4c-40a9-9ada-1d43099404e9'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:21:03.772145 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-dfe75f82-dc4c-40a9-9ada-1d43099404e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9193a8f9e7b741179a36e86ffa1b2b24', 'request_id': 'req-dfe75f82-dc4c-40a9-9ada-1d43099404e9'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:21:03.816155 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-dfe75f82-dc4c-40a9-9ada-1d43099404e9 admin admin] The token cache is being invalidate because project 9193a8f9e7b741179a36e86ffa1b2b24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:21:03.816445 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-dfe75f82-dc4c-40a9-9ada-1d43099404e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:21:03.817120 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-dfe75f82-dc4c-40a9-9ada-1d43099404e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:21:03.823268 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1581/3167] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:21:03 2022] DELETE /identity/v3/projects/9193a8f9e7b741179a36e86ffa1b2b24 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:21:03.825003 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39241f4-aa31-423d-a8c4-1aa28277349f None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:21:03.825344 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39241f4-aa31-423d-a8c4-1aa28277349f None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:21:03.825892 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39241f4-aa31-423d-a8c4-1aa28277349f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:21:03.892906 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-e39241f4-aa31-423d-a8c4-1aa28277349f None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:21:03.894202 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-e39241f4-aa31-423d-a8c4-1aa28277349f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:21:03.905495 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1bd1fe-1dc7-4eae-a359-d9b3746f3d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:21:03.908080 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1bd1fe-1dc7-4eae-a359-d9b3746f3d1b admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:21:03.908702 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1bd1fe-1dc7-4eae-a359-d9b3746f3d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:21:03.910867 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1bd1fe-1dc7-4eae-a359-d9b3746f3d1b admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:21:03.916457 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1bd1fe-1dc7-4eae-a359-d9b3746f3d1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:21:03.918481 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1bd1fe-1dc7-4eae-a359-d9b3746f3d1b admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:21:03.921459 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1582/3168] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:21:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:21:03.923012 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370d35d7-0878-4227-a69d-17075f66e6e6 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:21:03.923337 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370d35d7-0878-4227-a69d-17075f66e6e6 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:21:03.923555 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370d35d7-0878-4227-a69d-17075f66e6e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:21:03.938071 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1587/3169] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:21:03 2022] GET /identity/v3/roles => generated 1420 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:21:03.944044 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1bd1fe-1dc7-4eae-a359-d9b3746f3d1b admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:21:03.947099 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-af1bd1fe-1dc7-4eae-a359-d9b3746f3d1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:21:03.962286 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-370d35d7-0878-4227-a69d-17075f66e6e6 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:21:03.965499 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-370d35d7-0878-4227-a69d-17075f66e6e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:21:03.965675 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1bd1fe-1dc7-4eae-a359-d9b3746f3d1b admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:21:03.973766 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9356ca4a-9273-46d3-a295-79b55e9000e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:21:03.975408 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9356ca4a-9273-46d3-a295-79b55e9000e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:21:03.975922 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9356ca4a-9273-46d3-a295-79b55e9000e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:21:03.976702 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9356ca4a-9273-46d3-a295-79b55e9000e9 admin admin] PATH_INFO: `/v3/projects/35c1943188684b45b636541caf587247/users/ebf93a4b80cb4e19a36473986950fc75/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:21:03.990917 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1583/3170] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:21:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:21:03.992680 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370d35d7-0878-4227-a69d-17075f66e6e6 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:21:04.010585 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9356ca4a-9273-46d3-a295-79b55e9000e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35c1943188684b45b636541caf587247, user_id=ebf93a4b80cb4e19a36473986950fc75, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:21:04.013620 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370d35d7-0878-4227-a69d-17075f66e6e6 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:21:04.019227 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9356ca4a-9273-46d3-a295-79b55e9000e9 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:21:04.020122 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be649c8e-8d52-4dbc-bba0-0ae7cf926c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:21:04.020817 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be649c8e-8d52-4dbc-bba0-0ae7cf926c20 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:21:04.021090 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be649c8e-8d52-4dbc-bba0-0ae7cf926c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:21:04.021966 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be649c8e-8d52-4dbc-bba0-0ae7cf926c20 admin admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:21:04.022932 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be649c8e-8d52-4dbc-bba0-0ae7cf926c20 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:21:04.023739 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be649c8e-8d52-4dbc-bba0-0ae7cf926c20 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:21:04.025936 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be649c8e-8d52-4dbc-bba0-0ae7cf926c20 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:21:04.050011 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1584/3171] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:21:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:21:04.053840 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1588/3172] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:21:03 2022] PUT /identity/v3/projects/35c1943188684b45b636541caf587247/users/ebf93a4b80cb4e19a36473986950fc75/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:21:04.054580 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be649c8e-8d52-4dbc-bba0-0ae7cf926c20 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:21:04.065806 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4b3d72-a203-46d6-957f-5038a6ac943a None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:21:04.066485 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4b3d72-a203-46d6-957f-5038a6ac943a None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:21:04.067055 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4b3d72-a203-46d6-957f-5038a6ac943a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:21:04.078803 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be649c8e-8d52-4dbc-bba0-0ae7cf926c20 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:21:04.127301 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-af4b3d72-a203-46d6-957f-5038a6ac943a None None] MFA Rules not processed for user `ebf93a4b80cb4e19a36473986950fc75`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:21:04.128747 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-af4b3d72-a203-46d6-957f-5038a6ac943a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:21:04.252131 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea2040e-3798-4810-8c66-975edbbc84a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:21:04.255213 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea2040e-3798-4810-8c66-975edbbc84a6 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:21:04.257191 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea2040e-3798-4810-8c66-975edbbc84a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:21:04.257912 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea2040e-3798-4810-8c66-975edbbc84a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:21:04.258802 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea2040e-3798-4810-8c66-975edbbc84a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:21:04.264636 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea2040e-3798-4810-8c66-975edbbc84a6 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:21:04.292296 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1589/3173] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:21:04 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:21:04.301567 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4b3d72-a203-46d6-957f-5038a6ac943a None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:21:04.383557 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4b3d72-a203-46d6-957f-5038a6ac943a None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:21:04.395744 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1585/3174] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:21:04 2022] POST /identity/v3/projects => generated 389 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:21:04.400707 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea2040e-3798-4810-8c66-975edbbc84a6 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:21:04.401667 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcda2ad5-a756-40a2-8288-63f857282c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:21:04.404484 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcda2ad5-a756-40a2-8288-63f857282c1c admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:21:04.405426 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcda2ad5-a756-40a2-8288-63f857282c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:21:04.406871 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcda2ad5-a756-40a2-8288-63f857282c1c admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:21:04.408405 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcda2ad5-a756-40a2-8288-63f857282c1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:21:04.420079 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcda2ad5-a756-40a2-8288-63f857282c1c admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:21:04.465330 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:21:04.537594 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1590/3175] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:21:04 2022] POST /identity/v3/projects => generated 377 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:21:04.540021 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcda2ad5-a756-40a2-8288-63f857282c1c admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:21:04.565452 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea2040e-3798-4810-8c66-975edbbc84a6 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:21:04.566322 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:21:04.736989 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a0bc34-93e8-44cc-8ba8-3aea6c795908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:21:04.737915 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a0bc34-93e8-44cc-8ba8-3aea6c795908 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:21:04.738182 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a0bc34-93e8-44cc-8ba8-3aea6c795908 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:21:04.738452 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a0bc34-93e8-44cc-8ba8-3aea6c795908 admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:21:04.739145 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a0bc34-93e8-44cc-8ba8-3aea6c795908 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:21:04.741326 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a0bc34-93e8-44cc-8ba8-3aea6c795908 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:21:04.752945 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcda2ad5-a756-40a2-8288-63f857282c1c admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:21:04.766280 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beafe8b5-0ea9-416f-a482-44b602ce6a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:21:04.767212 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beafe8b5-0ea9-416f-a482-44b602ce6a5d admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:21:04.767677 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beafe8b5-0ea9-416f-a482-44b602ce6a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:21:04.772980 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beafe8b5-0ea9-416f-a482-44b602ce6a5d admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:21:04.773933 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beafe8b5-0ea9-416f-a482-44b602ce6a5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:21:04.778033 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beafe8b5-0ea9-416f-a482-44b602ce6a5d admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:21:04.789378 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1586/3176] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:21:04 2022] POST /identity/v3/users => generated 295 bytes in 389 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:21:04.790405 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a0bc34-93e8-44cc-8ba8-3aea6c795908 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:21:04.828182 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1591/3177] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:21:04 2022] POST /identity/v3/users => generated 295 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:21:04.834886 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beafe8b5-0ea9-416f-a482-44b602ce6a5d admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:21:04.850502 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beafe8b5-0ea9-416f-a482-44b602ce6a5d admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:21:04.856085 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8955bf-e07f-4acb-9c3b-b5b33c543d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:21:04.857543 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8955bf-e07f-4acb-9c3b-b5b33c543d40 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:21:04.858244 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8955bf-e07f-4acb-9c3b-b5b33c543d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:21:04.858829 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8955bf-e07f-4acb-9c3b-b5b33c543d40 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:21:04.859907 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8955bf-e07f-4acb-9c3b-b5b33c543d40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:21:04.862341 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8955bf-e07f-4acb-9c3b-b5b33c543d40 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:21:04.871510 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a0bc34-93e8-44cc-8ba8-3aea6c795908 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:21:04.878005 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1592/3178] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:21:04 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:21:04.882648 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8955bf-e07f-4acb-9c3b-b5b33c543d40 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:21:04.902130 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49625e55-6216-42f0-9ce7-9e5a01c6d75a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:21:04.902926 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49625e55-6216-42f0-9ce7-9e5a01c6d75a admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:21:04.905584 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8955bf-e07f-4acb-9c3b-b5b33c543d40 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:21:04.910341 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49625e55-6216-42f0-9ce7-9e5a01c6d75a admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:21:04.910647 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49625e55-6216-42f0-9ce7-9e5a01c6d75a admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:21:04.912776 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec50a15-2d0b-473a-b1ff-3018f098c87b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:21:04.914351 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec50a15-2d0b-473a-b1ff-3018f098c87b admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:21:04.914504 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49625e55-6216-42f0-9ce7-9e5a01c6d75a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:21:04.915189 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec50a15-2d0b-473a-b1ff-3018f098c87b admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:21:04.915799 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec50a15-2d0b-473a-b1ff-3018f098c87b admin admin] PATH_INFO: `/v3/projects/f76f4ad9750349ef83781bf6ea23416f/users/6cfbfb39775e4b16b4c62322c0d88375/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:21:04.944547 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49625e55-6216-42f0-9ce7-9e5a01c6d75a admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:21:04.997497 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1587/3179] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:21:04 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:21:04.998948 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49625e55-6216-42f0-9ce7-9e5a01c6d75a admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:21:04.999899 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec50a15-2d0b-473a-b1ff-3018f098c87b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f76f4ad9750349ef83781bf6ea23416f, user_id=6cfbfb39775e4b16b4c62322c0d88375, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:21:05.008815 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec50a15-2d0b-473a-b1ff-3018f098c87b admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:21:05.039294 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1593/3180] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:21:04 2022] PUT /identity/v3/projects/f76f4ad9750349ef83781bf6ea23416f/users/6cfbfb39775e4b16b4c62322c0d88375/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:21:05.044051 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec50a15-2d0b-473a-b1ff-3018f098c87b admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:21:05.045460 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49625e55-6216-42f0-9ce7-9e5a01c6d75a admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:21:05.227761 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec50a15-2d0b-473a-b1ff-3018f098c87b admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:21:05.242632 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ab3b82-a125-4f60-b02c-fd051d82803b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:21:05.243644 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ab3b82-a125-4f60-b02c-fd051d82803b admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:21:05.246597 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ab3b82-a125-4f60-b02c-fd051d82803b admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:21:05.248206 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ab3b82-a125-4f60-b02c-fd051d82803b admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:21:05.250732 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ab3b82-a125-4f60-b02c-fd051d82803b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:21:05.258118 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ab3b82-a125-4f60-b02c-fd051d82803b admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:21:05.263323 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e9484a-75de-4f0e-b4a9-ff906ea9832a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:21:05.266053 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e9484a-75de-4f0e-b4a9-ff906ea9832a admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:21:05.267410 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e9484a-75de-4f0e-b4a9-ff906ea9832a admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:21:05.267711 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e9484a-75de-4f0e-b4a9-ff906ea9832a admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:21:05.269781 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e9484a-75de-4f0e-b4a9-ff906ea9832a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:21:05.276328 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e9484a-75de-4f0e-b4a9-ff906ea9832a admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:21:05.293450 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1594/3181] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:21:05 2022] GET /identity/v3/roles => generated 1420 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:21:05.294863 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ab3b82-a125-4f60-b02c-fd051d82803b admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:21:05.305709 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1588/3182] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:21:04 2022] GET /identity/v3/roles => generated 1420 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:21:05.307633 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e9484a-75de-4f0e-b4a9-ff906ea9832a admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:21:05.311484 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ab3b82-a125-4f60-b02c-fd051d82803b admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:21:05.320329 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381cae36-c4bb-4de8-af82-dc66b3f9f33f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:21:05.322770 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381cae36-c4bb-4de8-af82-dc66b3f9f33f admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:21:05.322924 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381cae36-c4bb-4de8-af82-dc66b3f9f33f admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:21:05.323202 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381cae36-c4bb-4de8-af82-dc66b3f9f33f admin admin] PATH_INFO: `/v3/projects/f76f4ad9750349ef83781bf6ea23416f/users/6cfbfb39775e4b16b4c62322c0d88375/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:21:05.325385 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381cae36-c4bb-4de8-af82-dc66b3f9f33f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f76f4ad9750349ef83781bf6ea23416f, user_id=6cfbfb39775e4b16b4c62322c0d88375, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:21:05.330090 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381cae36-c4bb-4de8-af82-dc66b3f9f33f admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:21:05.348535 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e9484a-75de-4f0e-b4a9-ff906ea9832a admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:21:05.359828 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1595/3183] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:21:05 2022] PUT /identity/v3/projects/f76f4ad9750349ef83781bf6ea23416f/users/6cfbfb39775e4b16b4c62322c0d88375/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:21:05.364540 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd103e30-5815-4e40-94b7-df437ac99fdd None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:21:05.365762 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd103e30-5815-4e40-94b7-df437ac99fdd None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:21:05.366234 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd103e30-5815-4e40-94b7-df437ac99fdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:21:05.444879 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-dd103e30-5815-4e40-94b7-df437ac99fdd None None] MFA Rules not processed for user `6cfbfb39775e4b16b4c62322c0d88375`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:21:05.446421 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-dd103e30-5815-4e40-94b7-df437ac99fdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:21:05.468696 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:21:05.530373 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c133b64e-67f2-402d-a64a-3bffcc876542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:21:05.531496 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c133b64e-67f2-402d-a64a-3bffcc876542 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:21:05.531783 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c133b64e-67f2-402d-a64a-3bffcc876542 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:21:05.532061 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c133b64e-67f2-402d-a64a-3bffcc876542 admin admin] PATH_INFO: `/v3/projects/b10edc89289a48ae92aa73f120f3bc9e/users/7b525303553f4523aa71b27431961362/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:21:05.572854 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:21:05.573122 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c133b64e-67f2-402d-a64a-3bffcc876542 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b10edc89289a48ae92aa73f120f3bc9e, user_id=7b525303553f4523aa71b27431961362, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:21:05.579961 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c133b64e-67f2-402d-a64a-3bffcc876542 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:21:05.614752 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1589/3184] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:21:05 2022] PUT /identity/v3/projects/b10edc89289a48ae92aa73f120f3bc9e/users/7b525303553f4523aa71b27431961362/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:21:05.628354 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab95b290-da04-4d7a-9e01-ff282acb8e92 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:21:05.628709 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab95b290-da04-4d7a-9e01-ff282acb8e92 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:21:05.629096 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab95b290-da04-4d7a-9e01-ff282acb8e92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:21:05.661889 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-ab95b290-da04-4d7a-9e01-ff282acb8e92 None None] MFA Rules not processed for user `7b525303553f4523aa71b27431961362`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:21:05.663395 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-ab95b290-da04-4d7a-9e01-ff282acb8e92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:21:05.682468 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1596/3185] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:21:05 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:21:05.693623 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65019bb-4c36-4d3a-bafd-c529735084a4 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:21:05.693944 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65019bb-4c36-4d3a-bafd-c529735084a4 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:21:05.694220 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65019bb-4c36-4d3a-bafd-c529735084a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:21:05.720232 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-e65019bb-4c36-4d3a-bafd-c529735084a4 None None] MFA Rules not processed for user `ebf93a4b80cb4e19a36473986950fc75`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:21:05.721528 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-e65019bb-4c36-4d3a-bafd-c529735084a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:21:05.847654 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1597/3186] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:21:05 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:21:05.852394 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1590/3187] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:21:05 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:21:05.856850 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65019bb-4c36-4d3a-bafd-c529735084a4 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:21:06.050378 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65019bb-4c36-4d3a-bafd-c529735084a4 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:21:06.056968 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1937b0c-bbb0-4f7b-88df-ffc3ed1bd836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:21:06.058415 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1937b0c-bbb0-4f7b-88df-ffc3ed1bd836 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:21:06.058415 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1937b0c-bbb0-4f7b-88df-ffc3ed1bd836 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:21:06.058415 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1937b0c-bbb0-4f7b-88df-ffc3ed1bd836 admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:21:06.066041 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1937b0c-bbb0-4f7b-88df-ffc3ed1bd836 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:21:06.069154 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1937b0c-bbb0-4f7b-88df-ffc3ed1bd836 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:21:06.121146 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1598/3188] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:21:05 2022] POST /identity/v3/projects => generated 391 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:21:06.125517 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab95b290-da04-4d7a-9e01-ff282acb8e92 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:21:06.145784 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab95b290-da04-4d7a-9e01-ff282acb8e92 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:21:06.233873 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e314fd-6752-43d2-97b9-c50c4f4cc49f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:21:06.235832 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e314fd-6752-43d2-97b9-c50c4f4cc49f admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:21:06.236534 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e314fd-6752-43d2-97b9-c50c4f4cc49f admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:21:06.236918 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e314fd-6752-43d2-97b9-c50c4f4cc49f admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:21:06.237641 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e314fd-6752-43d2-97b9-c50c4f4cc49f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:21:06.243213 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e314fd-6752-43d2-97b9-c50c4f4cc49f admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:21:06.289818 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1591/3189] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:21:06 2022] POST /identity/v3/users => generated 302 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:21:06.294190 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1937b0c-bbb0-4f7b-88df-ffc3ed1bd836 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:21:06.312452 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1937b0c-bbb0-4f7b-88df-ffc3ed1bd836 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:21:06.332861 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992be7d8-e4f1-4e57-990d-e48ffdce3ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:21:06.333687 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992be7d8-e4f1-4e57-990d-e48ffdce3ec5 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:21:06.334190 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992be7d8-e4f1-4e57-990d-e48ffdce3ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:21:06.334493 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992be7d8-e4f1-4e57-990d-e48ffdce3ec5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:21:06.335352 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992be7d8-e4f1-4e57-990d-e48ffdce3ec5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:21:06.337113 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992be7d8-e4f1-4e57-990d-e48ffdce3ec5 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:21:06.363099 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1599/3190] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:21:06 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:21:06.364998 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e314fd-6752-43d2-97b9-c50c4f4cc49f admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:21:06.380381 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e314fd-6752-43d2-97b9-c50c4f4cc49f admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:21:06.394247 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add1a341-0430-437e-8166-34e97d9ba9fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:21:06.395176 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add1a341-0430-437e-8166-34e97d9ba9fb admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:21:06.395458 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add1a341-0430-437e-8166-34e97d9ba9fb admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:21:06.395731 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add1a341-0430-437e-8166-34e97d9ba9fb admin admin] PATH_INFO: `/v3/projects/4aff1bb7b45e426496feca769939bcd5/users/929f77a947534e72bdb6f2d7773cdb9e/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:21:06.429738 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add1a341-0430-437e-8166-34e97d9ba9fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=4aff1bb7b45e426496feca769939bcd5, user_id=929f77a947534e72bdb6f2d7773cdb9e, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:21:06.432862 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add1a341-0430-437e-8166-34e97d9ba9fb admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:21:06.458771 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1592/3191] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:21:06 2022] PUT /identity/v3/projects/4aff1bb7b45e426496feca769939bcd5/users/929f77a947534e72bdb6f2d7773cdb9e/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:21:06.467608 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992be7d8-e4f1-4e57-990d-e48ffdce3ec5 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:21:06.484479 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992be7d8-e4f1-4e57-990d-e48ffdce3ec5 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:21:06.550167 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add1a341-0430-437e-8166-34e97d9ba9fb admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:21:06.552132 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-add1a341-0430-437e-8166-34e97d9ba9fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:21:06.594313 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:21:06.615634 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:21:06.663511 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f19df0-bb87-44fa-9c61-a17810ae8c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:21:06.664377 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f19df0-bb87-44fa-9c61-a17810ae8c14 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:21:06.664894 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f19df0-bb87-44fa-9c61-a17810ae8c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:21:06.665467 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f19df0-bb87-44fa-9c61-a17810ae8c14 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:21:06.665972 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f19df0-bb87-44fa-9c61-a17810ae8c14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:21:06.667620 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f19df0-bb87-44fa-9c61-a17810ae8c14 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:21:06.709098 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1600/3192] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:21:06 2022] GET /identity/v3/roles => generated 1420 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:21:06.713765 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f19df0-bb87-44fa-9c61-a17810ae8c14 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:21:06.740372 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add1a341-0430-437e-8166-34e97d9ba9fb admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:21:06.742565 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f19df0-bb87-44fa-9c61-a17810ae8c14 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:21:06.751090 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdf4f58-3bf0-446b-9fc5-0b5662548712 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:21:06.752260 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdf4f58-3bf0-446b-9fc5-0b5662548712 service nova] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:21:06.754473 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a97fc64-f564-4972-a21c-34318f24aa8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:21:06.754899 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdf4f58-3bf0-446b-9fc5-0b5662548712 service nova] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:21:06.755436 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdf4f58-3bf0-446b-9fc5-0b5662548712 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:21:06.765177 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a97fc64-f564-4972-a21c-34318f24aa8d admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:21:06.766157 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a97fc64-f564-4972-a21c-34318f24aa8d admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:21:06.767875 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a97fc64-f564-4972-a21c-34318f24aa8d admin admin] PATH_INFO: `/v3/projects/4aff1bb7b45e426496feca769939bcd5/users/929f77a947534e72bdb6f2d7773cdb9e/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:21:06.776291 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a97fc64-f564-4972-a21c-34318f24aa8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4aff1bb7b45e426496feca769939bcd5, user_id=929f77a947534e72bdb6f2d7773cdb9e, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:21:06.784216 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a97fc64-f564-4972-a21c-34318f24aa8d admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:21:06.808954 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1601/3193] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:21:06 2022] PUT /identity/v3/projects/4aff1bb7b45e426496feca769939bcd5/users/929f77a947534e72bdb6f2d7773cdb9e/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:21:06.840156 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e6414a-7340-467e-8001-76997fa26980 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:21:06.840907 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e6414a-7340-467e-8001-76997fa26980 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:21:06.841405 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e6414a-7340-467e-8001-76997fa26980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:21:06.910001 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-21e6414a-7340-467e-8001-76997fa26980 None None] MFA Rules not processed for user `929f77a947534e72bdb6f2d7773cdb9e`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:21:06.913300 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-21e6414a-7340-467e-8001-76997fa26980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:21:06.928276 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdf4f58-3bf0-446b-9fc5-0b5662548712 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:21:06.930002 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdf4f58-3bf0-446b-9fc5-0b5662548712 service nova] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:21:06.954255 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1593/3194] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:21:06 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:21:07.075791 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1602/3195] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:21:06 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:21:08.163315 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8638edd1-c53b-46d6-9394-1375cc8280a2 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:21:08.163808 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8638edd1-c53b-46d6-9394-1375cc8280a2 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:21:08.164131 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8638edd1-c53b-46d6-9394-1375cc8280a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:21:08.193285 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-8638edd1-c53b-46d6-9394-1375cc8280a2 None None] MFA Rules not processed for user `ebf93a4b80cb4e19a36473986950fc75`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:21:08.194782 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-8638edd1-c53b-46d6-9394-1375cc8280a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:21:08.311348 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1594/3196] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:21:08 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:21:08.513251 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e6414a-7340-467e-8001-76997fa26980 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:21:08.752232 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e6414a-7340-467e-8001-76997fa26980 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:21:08.770749 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bf1ffe-4004-4c1a-9d28-7d8c2c41e8dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:21:08.776366 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bf1ffe-4004-4c1a-9d28-7d8c2c41e8dd service nova] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:21:08.776579 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bf1ffe-4004-4c1a-9d28-7d8c2c41e8dd service nova] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:21:08.776901 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bf1ffe-4004-4c1a-9d28-7d8c2c41e8dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:21:08.956954 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:21:08.980582 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bf1ffe-4004-4c1a-9d28-7d8c2c41e8dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:21:08.982456 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bf1ffe-4004-4c1a-9d28-7d8c2c41e8dd service nova] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:21:09.024189 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1603/3197] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:21:08 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 511 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:21:09.875843 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8638edd1-c53b-46d6-9394-1375cc8280a2 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:21:09.877387 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-8638edd1-c53b-46d6-9394-1375cc8280a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:21:10.081636 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:21:10.089071 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8638edd1-c53b-46d6-9394-1375cc8280a2 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:21:10.094504 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5797b51-4184-4afd-849a-2dce959edf8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:21:10.100025 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5797b51-4184-4afd-849a-2dce959edf8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:21:10.100025 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5797b51-4184-4afd-849a-2dce959edf8e admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:21:10.100025 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5797b51-4184-4afd-849a-2dce959edf8e admin admin] PATH_INFO: `/v3/users/3ef41817e4f5478bb7afdcb59ed634cd` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:21:10.101171 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5797b51-4184-4afd-849a-2dce959edf8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ef41817e4f5478bb7afdcb59ed634cd)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:21:10.104296 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5797b51-4184-4afd-849a-2dce959edf8e admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:21:10.240837 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-f5797b51-4184-4afd-849a-2dce959edf8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ef41817e4f5478bb7afdcb59ed634cd'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:21:10.251208 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-f5797b51-4184-4afd-849a-2dce959edf8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ef41817e4f5478bb7afdcb59ed634cd'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:21:10.252064 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-f5797b51-4184-4afd-849a-2dce959edf8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ef41817e4f5478bb7afdcb59ed634cd'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:21:10.267615 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-f5797b51-4184-4afd-849a-2dce959edf8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ef41817e4f5478bb7afdcb59ed634cd'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:21:10.291623 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-f5797b51-4184-4afd-849a-2dce959edf8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ef41817e4f5478bb7afdcb59ed634cd'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:21:10.315640 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bf1ffe-4004-4c1a-9d28-7d8c2c41e8dd service nova] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:21:10.317462 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1595/3198] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:21:09 2022] DELETE /identity/v3/users/3ef41817e4f5478bb7afdcb59ed634cd => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:21:10.318289 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-c4bf1ffe-4004-4c1a-9d28-7d8c2c41e8dd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:21:10.322832 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816c61ed-e9bb-4bf4-9815-bae277e49493 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:21:10.323793 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816c61ed-e9bb-4bf4-9815-bae277e49493 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:21:10.324555 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816c61ed-e9bb-4bf4-9815-bae277e49493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:21:10.394682 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-816c61ed-e9bb-4bf4-9815-bae277e49493 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:21:10.406032 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-816c61ed-e9bb-4bf4-9815-bae277e49493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:21:10.617502 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1596/3199] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:21:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:21:10.644057 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bf1ffe-4004-4c1a-9d28-7d8c2c41e8dd service nova] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:21:10.793568 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816c61ed-e9bb-4bf4-9815-bae277e49493 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:21:10.795820 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-816c61ed-e9bb-4bf4-9815-bae277e49493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:21:10.844241 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80abc36-41dc-43ab-88c2-be92bd1162dd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc719a3b3ac4461b82ca04ab6451d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:21:10.848679 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80abc36-41dc-43ab-88c2-be92bd1162dd service placement] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:21:10.849076 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80abc36-41dc-43ab-88c2-be92bd1162dd service placement] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:21:10.851098 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80abc36-41dc-43ab-88c2-be92bd1162dd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:21:10.858282 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-e80abc36-41dc-43ab-88c2-be92bd1162dd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:21:10.901761 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80abc36-41dc-43ab-88c2-be92bd1162dd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:21:10.910913 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80abc36-41dc-43ab-88c2-be92bd1162dd service placement] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:21:10.945597 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1604/3200] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:21:10 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 630 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:21:11.001451 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816c61ed-e9bb-4bf4-9815-bae277e49493 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:21:11.015936 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2816241f-96df-4bd9-8932-8146a0b35c93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:21:11.018934 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2816241f-96df-4bd9-8932-8146a0b35c93 service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:21:11.019340 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2816241f-96df-4bd9-8932-8146a0b35c93 service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:21:11.019741 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2816241f-96df-4bd9-8932-8146a0b35c93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:21:11.051542 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2816241f-96df-4bd9-8932-8146a0b35c93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:21:11.053440 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2816241f-96df-4bd9-8932-8146a0b35c93 service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:21:11.077975 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1597/3201] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:21:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:21:12.596751 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80abc36-41dc-43ab-88c2-be92bd1162dd service placement] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:21:12.598883 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-e80abc36-41dc-43ab-88c2-be92bd1162dd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:21:12.642612 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80abc36-41dc-43ab-88c2-be92bd1162dd service placement] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:21:12.661672 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f702cb-003e-4bf0-a186-3ec89905e2d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:21:12.665339 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f702cb-003e-4bf0-a186-3ec89905e2d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:21:12.667973 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f702cb-003e-4bf0-a186-3ec89905e2d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:21:12.668575 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f702cb-003e-4bf0-a186-3ec89905e2d6 admin admin] PATH_INFO: `/v3/projects/c7af16c62b144aa0972331a69e3638c3` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:21:12.672966 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f702cb-003e-4bf0-a186-3ec89905e2d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7af16c62b144aa0972331a69e3638c3)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:21:12.681596 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f702cb-003e-4bf0-a186-3ec89905e2d6 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:21:12.843279 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-d4f702cb-003e-4bf0-a186-3ec89905e2d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7af16c62b144aa0972331a69e3638c3', 'request_id': 'req-d4f702cb-003e-4bf0-a186-3ec89905e2d6'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:21:12.857256 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-d4f702cb-003e-4bf0-a186-3ec89905e2d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7af16c62b144aa0972331a69e3638c3', 'request_id': 'req-d4f702cb-003e-4bf0-a186-3ec89905e2d6'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:21:12.860864 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:21:12.869875 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-d4f702cb-003e-4bf0-a186-3ec89905e2d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7af16c62b144aa0972331a69e3638c3', 'request_id': 'req-d4f702cb-003e-4bf0-a186-3ec89905e2d6'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:21:12.892510 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-d4f702cb-003e-4bf0-a186-3ec89905e2d6 admin admin] The token cache is being invalidate because project c7af16c62b144aa0972331a69e3638c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:21:12.893521 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-d4f702cb-003e-4bf0-a186-3ec89905e2d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:21:12.894627 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-d4f702cb-003e-4bf0-a186-3ec89905e2d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:21:12.907420 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1605/3202] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:21:12 2022] DELETE /identity/v3/projects/c7af16c62b144aa0972331a69e3638c3 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:21:12.908687 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2816241f-96df-4bd9-8932-8146a0b35c93 service neutron] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:21:12.932942 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2816241f-96df-4bd9-8932-8146a0b35c93 service neutron] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:21:12.978523 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:21:13.097370 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2379e68f-ac7d-4848-ad08-0059e0aaf41e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:21:13.098358 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2379e68f-ac7d-4848-ad08-0059e0aaf41e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:21:13.098793 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2379e68f-ac7d-4848-ad08-0059e0aaf41e admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:21:13.099070 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2379e68f-ac7d-4848-ad08-0059e0aaf41e admin admin] PATH_INFO: `/v3/users/acdb5e01ae4140c4b52f2494a63b68b8` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:21:13.100778 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2379e68f-ac7d-4848-ad08-0059e0aaf41e admin admin] RBAC: Authorizing `identity:delete_user(user_id=acdb5e01ae4140c4b52f2494a63b68b8)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:21:13.106421 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2379e68f-ac7d-4848-ad08-0059e0aaf41e admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:21:13.238043 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-2379e68f-ac7d-4848-ad08-0059e0aaf41e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'acdb5e01ae4140c4b52f2494a63b68b8'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:21:13.254919 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-2379e68f-ac7d-4848-ad08-0059e0aaf41e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'acdb5e01ae4140c4b52f2494a63b68b8'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:21:13.255687 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-2379e68f-ac7d-4848-ad08-0059e0aaf41e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'acdb5e01ae4140c4b52f2494a63b68b8'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:21:13.282160 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-2379e68f-ac7d-4848-ad08-0059e0aaf41e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'acdb5e01ae4140c4b52f2494a63b68b8'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:21:13.302809 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-2379e68f-ac7d-4848-ad08-0059e0aaf41e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'acdb5e01ae4140c4b52f2494a63b68b8'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:21:13.336020 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1598/3203] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:21:12 2022] DELETE /identity/v3/users/acdb5e01ae4140c4b52f2494a63b68b8 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:21:13.453444 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f702cb-003e-4bf0-a186-3ec89905e2d6 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:21:13.455999 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-d4f702cb-003e-4bf0-a186-3ec89905e2d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:21:13.657755 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f702cb-003e-4bf0-a186-3ec89905e2d6 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:21:13.820567 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03146b0-2d15-4efd-a791-5b64801b925f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:21:13.821247 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03146b0-2d15-4efd-a791-5b64801b925f service nova] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:21:13.821524 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03146b0-2d15-4efd-a791-5b64801b925f service nova] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:21:13.821794 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03146b0-2d15-4efd-a791-5b64801b925f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:21:13.826978 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-b03146b0-2d15-4efd-a791-5b64801b925f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:21:14.018966 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03146b0-2d15-4efd-a791-5b64801b925f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:21:14.020949 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03146b0-2d15-4efd-a791-5b64801b925f service nova] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:21:14.042972 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1606/3204] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:21:13 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 590 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:21:14.964251 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2379e68f-ac7d-4848-ad08-0059e0aaf41e admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:21:14.965749 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-2379e68f-ac7d-4848-ad08-0059e0aaf41e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:21:15.116417 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2379e68f-ac7d-4848-ad08-0059e0aaf41e admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:21:15.121758 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be1fadf-fd19-4144-865e-83f373f4cf12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:21:15.122805 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be1fadf-fd19-4144-865e-83f373f4cf12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:21:15.123864 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be1fadf-fd19-4144-865e-83f373f4cf12 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:21:15.124740 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be1fadf-fd19-4144-865e-83f373f4cf12 admin admin] PATH_INFO: `/v3/projects/27b46a6297f44be6908d72b8b7dac7c5` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:21:15.126211 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be1fadf-fd19-4144-865e-83f373f4cf12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=27b46a6297f44be6908d72b8b7dac7c5)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:21:15.129320 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be1fadf-fd19-4144-865e-83f373f4cf12 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:21:15.221523 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:21:15.235615 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-4be1fadf-fd19-4144-865e-83f373f4cf12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27b46a6297f44be6908d72b8b7dac7c5', 'request_id': 'req-4be1fadf-fd19-4144-865e-83f373f4cf12'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:21:15.262774 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-4be1fadf-fd19-4144-865e-83f373f4cf12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27b46a6297f44be6908d72b8b7dac7c5', 'request_id': 'req-4be1fadf-fd19-4144-865e-83f373f4cf12'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:21:15.283420 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-4be1fadf-fd19-4144-865e-83f373f4cf12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27b46a6297f44be6908d72b8b7dac7c5', 'request_id': 'req-4be1fadf-fd19-4144-865e-83f373f4cf12'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:21:15.305485 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-4be1fadf-fd19-4144-865e-83f373f4cf12 admin admin] The token cache is being invalidate because project 27b46a6297f44be6908d72b8b7dac7c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:21:15.307542 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-4be1fadf-fd19-4144-865e-83f373f4cf12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:21:15.308504 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-4be1fadf-fd19-4144-865e-83f373f4cf12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:21:15.311805 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1599/3205] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:21:14 2022] DELETE /identity/v3/projects/27b46a6297f44be6908d72b8b7dac7c5 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:21:15.317077 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5716a53-0937-4d44-b754-d6c0898397e8 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:21:15.317605 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5716a53-0937-4d44-b754-d6c0898397e8 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:21:15.317724 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5716a53-0937-4d44-b754-d6c0898397e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:21:15.347606 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-a5716a53-0937-4d44-b754-d6c0898397e8 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:21:15.349473 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-a5716a53-0937-4d44-b754-d6c0898397e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:21:15.380761 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:21:15.458880 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1607/3206] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:21:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:21:15.460995 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7575d6f-7328-4d7d-b121-7e6bee88cdd3 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:21:15.462141 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7575d6f-7328-4d7d-b121-7e6bee88cdd3 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:21:15.467496 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7575d6f-7328-4d7d-b121-7e6bee88cdd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:21:15.527204 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-e7575d6f-7328-4d7d-b121-7e6bee88cdd3 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:21:15.531093 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-e7575d6f-7328-4d7d-b121-7e6bee88cdd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:21:15.545522 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1600/3207] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:21:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:21:15.549359 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5716a53-0937-4d44-b754-d6c0898397e8 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:21:15.574796 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5716a53-0937-4d44-b754-d6c0898397e8 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:21:15.589473 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bf5a5c-38c0-4b15-bf37-da60af113a26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:21:15.590480 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bf5a5c-38c0-4b15-bf37-da60af113a26 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:21:15.591359 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bf5a5c-38c0-4b15-bf37-da60af113a26 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:21:15.591857 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bf5a5c-38c0-4b15-bf37-da60af113a26 admin admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:21:15.592941 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bf5a5c-38c0-4b15-bf37-da60af113a26 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:21:15.593468 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bf5a5c-38c0-4b15-bf37-da60af113a26 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:21:15.596378 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bf5a5c-38c0-4b15-bf37-da60af113a26 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:21:15.618653 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1608/3208] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:21:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:21:15.620529 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7575d6f-7328-4d7d-b121-7e6bee88cdd3 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:21:15.637312 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7575d6f-7328-4d7d-b121-7e6bee88cdd3 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:21:15.652224 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0129d16d-f69e-4088-8cf3-253bde4b3193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:21:15.652224 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0129d16d-f69e-4088-8cf3-253bde4b3193 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:21:15.652224 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0129d16d-f69e-4088-8cf3-253bde4b3193 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:21:15.652224 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0129d16d-f69e-4088-8cf3-253bde4b3193 admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:21:15.652785 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0129d16d-f69e-4088-8cf3-253bde4b3193 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:21:15.660736 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0129d16d-f69e-4088-8cf3-253bde4b3193 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:21:15.716388 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1601/3209] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:21:15 2022] POST /identity/v3/projects => generated 411 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:21:15.723559 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bf5a5c-38c0-4b15-bf37-da60af113a26 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:21:15.743271 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bf5a5c-38c0-4b15-bf37-da60af113a26 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:21:15.870269 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bac907-610b-4ea4-bdac-9e6d7654f9c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:21:15.871916 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bac907-610b-4ea4-bdac-9e6d7654f9c4 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:21:15.873059 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bac907-610b-4ea4-bdac-9e6d7654f9c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:21:15.874004 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bac907-610b-4ea4-bdac-9e6d7654f9c4 admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:21:15.874932 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bac907-610b-4ea4-bdac-9e6d7654f9c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:21:15.877623 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bac907-610b-4ea4-bdac-9e6d7654f9c4 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:21:15.926243 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1609/3210] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:21:15 2022] POST /identity/v3/users => generated 306 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:21:15.930169 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0129d16d-f69e-4088-8cf3-253bde4b3193 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:21:15.950551 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0129d16d-f69e-4088-8cf3-253bde4b3193 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:21:15.959053 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c62e488-51de-4d64-9ba9-75c6fccd12fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:21:15.960262 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c62e488-51de-4d64-9ba9-75c6fccd12fa admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:21:15.960759 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c62e488-51de-4d64-9ba9-75c6fccd12fa admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:21:15.961398 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c62e488-51de-4d64-9ba9-75c6fccd12fa admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:21:15.963953 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c62e488-51de-4d64-9ba9-75c6fccd12fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:21:15.967029 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c62e488-51de-4d64-9ba9-75c6fccd12fa admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:21:15.984631 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1602/3211] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:21:15 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 21:21:15.992726 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bac907-610b-4ea4-bdac-9e6d7654f9c4 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:21:16.004565 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bac907-610b-4ea4-bdac-9e6d7654f9c4 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:21:16.016747 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7662619d-eaa8-4a55-be71-e38b9c4b0da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:21:16.018634 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7662619d-eaa8-4a55-be71-e38b9c4b0da5 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:21:16.018978 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7662619d-eaa8-4a55-be71-e38b9c4b0da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:21:16.019257 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7662619d-eaa8-4a55-be71-e38b9c4b0da5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:21:16.020274 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7662619d-eaa8-4a55-be71-e38b9c4b0da5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:21:16.023228 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7662619d-eaa8-4a55-be71-e38b9c4b0da5 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:21:16.038736 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1610/3212] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:21:15 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:21:16.043754 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c62e488-51de-4d64-9ba9-75c6fccd12fa admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:21:16.064952 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c62e488-51de-4d64-9ba9-75c6fccd12fa admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:21:16.080500 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5124c656-429f-4e10-87e2-9997cd2a9c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:21:16.081389 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5124c656-429f-4e10-87e2-9997cd2a9c45 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:21:16.081665 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5124c656-429f-4e10-87e2-9997cd2a9c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:21:16.082971 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5124c656-429f-4e10-87e2-9997cd2a9c45 admin admin] PATH_INFO: `/v3/projects/3d87ea887fea457fb07731d47de68333/users/672d90d732a0419ca669e0055359dcfd/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:21:16.121279 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5124c656-429f-4e10-87e2-9997cd2a9c45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d87ea887fea457fb07731d47de68333, user_id=672d90d732a0419ca669e0055359dcfd, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:21:16.124490 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5124c656-429f-4e10-87e2-9997cd2a9c45 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:21:16.161353 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1603/3213] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:21:16 2022] PUT /identity/v3/projects/3d87ea887fea457fb07731d47de68333/users/672d90d732a0419ca669e0055359dcfd/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:21:16.165156 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70de0ddc-7b1a-4241-88d3-fca233c1d319 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:21:16.168153 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70de0ddc-7b1a-4241-88d3-fca233c1d319 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:21:16.168741 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70de0ddc-7b1a-4241-88d3-fca233c1d319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:21:16.239133 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-70de0ddc-7b1a-4241-88d3-fca233c1d319 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:21:16.241180 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-70de0ddc-7b1a-4241-88d3-fca233c1d319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:21:16.427741 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1611/3214] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:21:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:21:16.529193 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5124c656-429f-4e10-87e2-9997cd2a9c45 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:21:16.533615 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-5124c656-429f-4e10-87e2-9997cd2a9c45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:21:16.675953 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5124c656-429f-4e10-87e2-9997cd2a9c45 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:21:16.681420 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180750cf-1cdc-4e9a-8fc5-225e17d24935 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:21:16.682126 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180750cf-1cdc-4e9a-8fc5-225e17d24935 service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:21:16.682421 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180750cf-1cdc-4e9a-8fc5-225e17d24935 service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:21:16.682683 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180750cf-1cdc-4e9a-8fc5-225e17d24935 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:21:16.706836 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180750cf-1cdc-4e9a-8fc5-225e17d24935 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:21:16.708312 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180750cf-1cdc-4e9a-8fc5-225e17d24935 service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:21:16.735189 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1604/3215] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:21:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:21:24.132319 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70de0ddc-7b1a-4241-88d3-fca233c1d319 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:21:24.133798 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-70de0ddc-7b1a-4241-88d3-fca233c1d319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:21:24.226508 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:21:24.330764 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70de0ddc-7b1a-4241-88d3-fca233c1d319 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:21:24.385526 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9615b0e-695a-4dd3-8989-37a9ad34e5fc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc719a3b3ac4461b82ca04ab6451d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:21:24.387171 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9615b0e-695a-4dd3-8989-37a9ad34e5fc service placement] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:21:24.388315 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9615b0e-695a-4dd3-8989-37a9ad34e5fc service placement] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:21:24.389646 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9615b0e-695a-4dd3-8989-37a9ad34e5fc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:21:24.394182 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-d9615b0e-695a-4dd3-8989-37a9ad34e5fc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:21:24.423945 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9615b0e-695a-4dd3-8989-37a9ad34e5fc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:21:24.426494 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9615b0e-695a-4dd3-8989-37a9ad34e5fc service placement] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:21:24.446235 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1612/3216] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:21:24 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:21:26.722029 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=62,keystone:DELETE=4,keystone:INSERT=3 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:21:28.526729 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78dcc25-fc05-4113-af86-319e21a2e6dc None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:21:28.527757 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78dcc25-fc05-4113-af86-319e21a2e6dc None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:21:28.528179 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78dcc25-fc05-4113-af86-319e21a2e6dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:21:28.559003 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-f78dcc25-fc05-4113-af86-319e21a2e6dc None None] MFA Rules not processed for user `672d90d732a0419ca669e0055359dcfd`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:21:28.560446 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-f78dcc25-fc05-4113-af86-319e21a2e6dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:21:28.657463 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1605/3217] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:21:28 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:21:28.668721 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1e4a1d-e230-4494-abe8-113329a0c748 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:21:28.669631 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1e4a1d-e230-4494-abe8-113329a0c748 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:21:28.670205 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1e4a1d-e230-4494-abe8-113329a0c748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:21:28.696169 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-1d1e4a1d-e230-4494-abe8-113329a0c748 None None] MFA Rules not processed for user `672d90d732a0419ca669e0055359dcfd`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:21:28.697625 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-1d1e4a1d-e230-4494-abe8-113329a0c748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:21:28.717751 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1613/3218] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:21:28 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:21:28.785636 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78dcc25-fc05-4113-af86-319e21a2e6dc None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:21:28.788191 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-f78dcc25-fc05-4113-af86-319e21a2e6dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:21:28.931312 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78dcc25-fc05-4113-af86-319e21a2e6dc None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:21:28.940453 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a086201-02e7-4d9c-b6e6-707a34f50660 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:21:28.941139 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a086201-02e7-4d9c-b6e6-707a34f50660 service nova] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:21:28.941421 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a086201-02e7-4d9c-b6e6-707a34f50660 service nova] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:21:28.941765 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a086201-02e7-4d9c-b6e6-707a34f50660 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:21:28.959909 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a086201-02e7-4d9c-b6e6-707a34f50660 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:21:28.962557 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a086201-02e7-4d9c-b6e6-707a34f50660 service nova] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:21:28.975289 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1606/3219] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:21:28 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:21:29.503506 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1e4a1d-e230-4494-abe8-113329a0c748 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:21:29.504934 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-1d1e4a1d-e230-4494-abe8-113329a0c748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:21:29.552309 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1e4a1d-e230-4494-abe8-113329a0c748 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:21:29.575065 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c8bee1-3284-4d9a-b343-6a3a849c3b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:21:29.580322 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c8bee1-3284-4d9a-b343-6a3a849c3b54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:21:29.580608 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c8bee1-3284-4d9a-b343-6a3a849c3b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:21:29.581232 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c8bee1-3284-4d9a-b343-6a3a849c3b54 admin admin] PATH_INFO: `/v3/users/7b525303553f4523aa71b27431961362` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:21:29.584325 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c8bee1-3284-4d9a-b343-6a3a849c3b54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b525303553f4523aa71b27431961362)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:21:29.586730 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c8bee1-3284-4d9a-b343-6a3a849c3b54 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:21:29.754429 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-61c8bee1-3284-4d9a-b343-6a3a849c3b54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b525303553f4523aa71b27431961362'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:21:29.755440 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-61c8bee1-3284-4d9a-b343-6a3a849c3b54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b525303553f4523aa71b27431961362'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:21:29.777955 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-61c8bee1-3284-4d9a-b343-6a3a849c3b54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b525303553f4523aa71b27431961362'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:21:29.807657 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-61c8bee1-3284-4d9a-b343-6a3a849c3b54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b525303553f4523aa71b27431961362'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:21:29.853953 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-61c8bee1-3284-4d9a-b343-6a3a849c3b54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b525303553f4523aa71b27431961362'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:21:29.863255 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1614/3220] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:21:29 2022] DELETE /identity/v3/users/7b525303553f4523aa71b27431961362 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:21:29.867878 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb780671-794a-4dbe-835b-c4979fed5904 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:21:29.868398 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb780671-794a-4dbe-835b-c4979fed5904 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:21:29.868398 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb780671-794a-4dbe-835b-c4979fed5904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:21:29.905661 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-fb780671-794a-4dbe-835b-c4979fed5904 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:21:29.906981 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-fb780671-794a-4dbe-835b-c4979fed5904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:21:30.056781 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1607/3221] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:21:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:21:30.129999 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c8bee1-3284-4d9a-b343-6a3a849c3b54 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:21:30.132861 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-61c8bee1-3284-4d9a-b343-6a3a849c3b54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:21:30.282896 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c8bee1-3284-4d9a-b343-6a3a849c3b54 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:21:30.297036 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6b358b-e45f-43b9-b194-baa750c07afe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:21:30.297818 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6b358b-e45f-43b9-b194-baa750c07afe service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:21:30.298127 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6b358b-e45f-43b9-b194-baa750c07afe service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:21:30.298443 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6b358b-e45f-43b9-b194-baa750c07afe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:21:30.317113 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6b358b-e45f-43b9-b194-baa750c07afe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:21:30.318299 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6b358b-e45f-43b9-b194-baa750c07afe service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:21:30.331076 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1615/3222] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:21:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:21:30.995777 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb780671-794a-4dbe-835b-c4979fed5904 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:21:30.998594 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-fb780671-794a-4dbe-835b-c4979fed5904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:21:31.017905 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb780671-794a-4dbe-835b-c4979fed5904 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:21:31.025347 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf8b75a-e10d-4406-a63d-fce1926e8273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:21:31.028443 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf8b75a-e10d-4406-a63d-fce1926e8273 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:21:31.028732 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf8b75a-e10d-4406-a63d-fce1926e8273 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:21:31.029013 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf8b75a-e10d-4406-a63d-fce1926e8273 admin admin] PATH_INFO: `/v3/projects/b10edc89289a48ae92aa73f120f3bc9e` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:21:31.032039 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf8b75a-e10d-4406-a63d-fce1926e8273 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b10edc89289a48ae92aa73f120f3bc9e)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:21:31.037703 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf8b75a-e10d-4406-a63d-fce1926e8273 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:21:31.128013 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:21:31.245074 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-2bf8b75a-e10d-4406-a63d-fce1926e8273 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b10edc89289a48ae92aa73f120f3bc9e', 'request_id': 'req-2bf8b75a-e10d-4406-a63d-fce1926e8273'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:21:31.267165 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-2bf8b75a-e10d-4406-a63d-fce1926e8273 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b10edc89289a48ae92aa73f120f3bc9e', 'request_id': 'req-2bf8b75a-e10d-4406-a63d-fce1926e8273'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:21:31.275171 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-2bf8b75a-e10d-4406-a63d-fce1926e8273 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b10edc89289a48ae92aa73f120f3bc9e', 'request_id': 'req-2bf8b75a-e10d-4406-a63d-fce1926e8273'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:21:31.307411 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-2bf8b75a-e10d-4406-a63d-fce1926e8273 admin admin] The token cache is being invalidate because project b10edc89289a48ae92aa73f120f3bc9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:21:31.309182 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-2bf8b75a-e10d-4406-a63d-fce1926e8273 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:21:31.310942 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-2bf8b75a-e10d-4406-a63d-fce1926e8273 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:21:31.315593 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1608/3223] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:21:30 2022] DELETE /identity/v3/projects/b10edc89289a48ae92aa73f120f3bc9e => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:21:31.319548 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6b358b-e45f-43b9-b194-baa750c07afe service neutron] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:21:31.358665 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6b358b-e45f-43b9-b194-baa750c07afe service neutron] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:21:31.439569 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:21:31.540950 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96564245-5e12-4ed5-a80a-d4818f6dc78d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:21:31.542132 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96564245-5e12-4ed5-a80a-d4818f6dc78d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:21:31.542491 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96564245-5e12-4ed5-a80a-d4818f6dc78d admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:21:31.542830 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96564245-5e12-4ed5-a80a-d4818f6dc78d admin admin] PATH_INFO: `/v3/users/929f77a947534e72bdb6f2d7773cdb9e` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:21:31.547095 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96564245-5e12-4ed5-a80a-d4818f6dc78d admin admin] RBAC: Authorizing `identity:delete_user(user_id=929f77a947534e72bdb6f2d7773cdb9e)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:21:31.571717 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96564245-5e12-4ed5-a80a-d4818f6dc78d admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:21:31.735214 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-96564245-5e12-4ed5-a80a-d4818f6dc78d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '929f77a947534e72bdb6f2d7773cdb9e'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:21:31.737161 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-96564245-5e12-4ed5-a80a-d4818f6dc78d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '929f77a947534e72bdb6f2d7773cdb9e'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:21:31.760979 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-96564245-5e12-4ed5-a80a-d4818f6dc78d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '929f77a947534e72bdb6f2d7773cdb9e'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:21:31.790895 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-96564245-5e12-4ed5-a80a-d4818f6dc78d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '929f77a947534e72bdb6f2d7773cdb9e'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:21:31.834536 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-96564245-5e12-4ed5-a80a-d4818f6dc78d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '929f77a947534e72bdb6f2d7773cdb9e'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:21:31.855799 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1616/3224] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:21:31 2022] DELETE /identity/v3/users/929f77a947534e72bdb6f2d7773cdb9e => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:21:32.677116 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3cd92b-33c3-4d93-90fe-35cb2e5a3e21 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:21:32.677705 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3cd92b-33c3-4d93-90fe-35cb2e5a3e21 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:21:32.677705 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3cd92b-33c3-4d93-90fe-35cb2e5a3e21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:21:32.758207 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-9f3cd92b-33c3-4d93-90fe-35cb2e5a3e21 None None] MFA Rules not processed for user `17b779a3e21a415bb42cde5d6863d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:21:32.763541 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-9f3cd92b-33c3-4d93-90fe-35cb2e5a3e21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:21:32.897350 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1609/3225] 10.222.0.17 () {58 vars in 1009 bytes} [Sat Jul 23 21:21:32 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:21:32.915711 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96564245-5e12-4ed5-a80a-d4818f6dc78d admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:21:32.916535 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-96564245-5e12-4ed5-a80a-d4818f6dc78d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:21:32.985081 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3cd92b-33c3-4d93-90fe-35cb2e5a3e21 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:21:32.987764 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-9f3cd92b-33c3-4d93-90fe-35cb2e5a3e21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:21:33.107220 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96564245-5e12-4ed5-a80a-d4818f6dc78d admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:21:33.119224 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63663c0-87df-43fb-8961-605b906383ce service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f0a685b7da46afb81024848f079d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:21:33.121582 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63663c0-87df-43fb-8961-605b906383ce service swift] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:21:33.126859 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63663c0-87df-43fb-8961-605b906383ce service swift] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:21:33.127186 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63663c0-87df-43fb-8961-605b906383ce service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:21:33.145495 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3cd92b-33c3-4d93-90fe-35cb2e5a3e21 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:21:33.148217 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63663c0-87df-43fb-8961-605b906383ce service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:21:33.149836 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63663c0-87df-43fb-8961-605b906383ce service swift] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:21:33.164524 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306c50da-77db-41f8-9c56-4ff77fde65ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:21:33.165632 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306c50da-77db-41f8-9c56-4ff77fde65ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:21:33.166638 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306c50da-77db-41f8-9c56-4ff77fde65ee admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:21:33.166926 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306c50da-77db-41f8-9c56-4ff77fde65ee admin admin] PATH_INFO: `/v3/projects/4aff1bb7b45e426496feca769939bcd5` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:21:33.171094 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306c50da-77db-41f8-9c56-4ff77fde65ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=4aff1bb7b45e426496feca769939bcd5)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:21:33.176365 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306c50da-77db-41f8-9c56-4ff77fde65ee admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:21:33.190469 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1617/3226] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 23 21:21:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 23 21:21:33.443586 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:21:33.488721 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-306c50da-77db-41f8-9c56-4ff77fde65ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4aff1bb7b45e426496feca769939bcd5', 'request_id': 'req-306c50da-77db-41f8-9c56-4ff77fde65ee'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:21:33.523413 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-306c50da-77db-41f8-9c56-4ff77fde65ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4aff1bb7b45e426496feca769939bcd5', 'request_id': 'req-306c50da-77db-41f8-9c56-4ff77fde65ee'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:21:33.542410 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-306c50da-77db-41f8-9c56-4ff77fde65ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4aff1bb7b45e426496feca769939bcd5', 'request_id': 'req-306c50da-77db-41f8-9c56-4ff77fde65ee'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:21:33.608964 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-306c50da-77db-41f8-9c56-4ff77fde65ee admin admin] The token cache is being invalidate because project 4aff1bb7b45e426496feca769939bcd5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:21:33.609259 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-306c50da-77db-41f8-9c56-4ff77fde65ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:21:33.614599 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-306c50da-77db-41f8-9c56-4ff77fde65ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:21:33.626303 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1610/3227] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:21:32 2022] DELETE /identity/v3/projects/4aff1bb7b45e426496feca769939bcd5 => generated 0 bytes in 642 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:21:33.632953 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d657e4c1-a7f9-41ae-8f9c-22d5c10aef0e None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:21:33.635309 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d657e4c1-a7f9-41ae-8f9c-22d5c10aef0e None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:21:33.635838 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d657e4c1-a7f9-41ae-8f9c-22d5c10aef0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:21:33.740413 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-d657e4c1-a7f9-41ae-8f9c-22d5c10aef0e None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:21:33.744666 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-d657e4c1-a7f9-41ae-8f9c-22d5c10aef0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:21:33.872175 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:21:33.997711 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1618/3228] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:21:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 367 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:21:34.006568 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5ede77-aa22-4f7d-82ec-8d5151f5ece2 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:21:34.007808 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5ede77-aa22-4f7d-82ec-8d5151f5ece2 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:21:34.008250 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5ede77-aa22-4f7d-82ec-8d5151f5ece2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:21:34.050031 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-eb5ede77-aa22-4f7d-82ec-8d5151f5ece2 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:21:34.051567 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-eb5ede77-aa22-4f7d-82ec-8d5151f5ece2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:21:34.062431 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1611/3229] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:21:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:21:34.066838 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d657e4c1-a7f9-41ae-8f9c-22d5c10aef0e None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:21:34.085804 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d657e4c1-a7f9-41ae-8f9c-22d5c10aef0e None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:21:34.103070 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a7844e-3f5b-47d4-a886-a86992be0608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:21:34.104218 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a7844e-3f5b-47d4-a886-a86992be0608 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:21:34.104733 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a7844e-3f5b-47d4-a886-a86992be0608 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:21:34.105235 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a7844e-3f5b-47d4-a886-a86992be0608 admin admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:21:34.106299 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a7844e-3f5b-47d4-a886-a86992be0608 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:21:34.107986 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a7844e-3f5b-47d4-a886-a86992be0608 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:21:34.110891 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a7844e-3f5b-47d4-a886-a86992be0608 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:21:34.157626 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1619/3230] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:21:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:21:34.164041 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5ede77-aa22-4f7d-82ec-8d5151f5ece2 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:21:34.191545 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5ede77-aa22-4f7d-82ec-8d5151f5ece2 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:21:34.210967 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70236bef-0f3c-4592-a934-9022ec07246b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:21:34.211638 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70236bef-0f3c-4592-a934-9022ec07246b admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:21:34.212050 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70236bef-0f3c-4592-a934-9022ec07246b admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:21:34.212536 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70236bef-0f3c-4592-a934-9022ec07246b admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:21:34.214637 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70236bef-0f3c-4592-a934-9022ec07246b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:21:34.256984 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70236bef-0f3c-4592-a934-9022ec07246b admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:21:34.381474 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1612/3231] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:21:34 2022] POST /identity/v3/projects => generated 391 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:21:34.385598 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a7844e-3f5b-47d4-a886-a86992be0608 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:21:34.404705 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a7844e-3f5b-47d4-a886-a86992be0608 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:21:34.641401 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3fa3ee-63d5-423f-9f90-c85f1dc172bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:21:34.641745 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3fa3ee-63d5-423f-9f90-c85f1dc172bf admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:21:34.642142 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3fa3ee-63d5-423f-9f90-c85f1dc172bf admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:21:34.642706 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3fa3ee-63d5-423f-9f90-c85f1dc172bf admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:21:34.643972 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3fa3ee-63d5-423f-9f90-c85f1dc172bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:21:34.646221 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3fa3ee-63d5-423f-9f90-c85f1dc172bf admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:21:34.686612 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1620/3232] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:21:34 2022] POST /identity/v3/users => generated 296 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:21:34.690951 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70236bef-0f3c-4592-a934-9022ec07246b admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:21:34.708994 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70236bef-0f3c-4592-a934-9022ec07246b admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:21:34.719700 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3a3639-ec4f-4439-b671-033321b32719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:21:34.721745 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3a3639-ec4f-4439-b671-033321b32719 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:21:34.722383 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3a3639-ec4f-4439-b671-033321b32719 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:21:34.722872 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3a3639-ec4f-4439-b671-033321b32719 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:21:34.723900 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3a3639-ec4f-4439-b671-033321b32719 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:21:34.726071 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3a3639-ec4f-4439-b671-033321b32719 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:21:34.751869 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1613/3233] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:21:34 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 21:21:34.756067 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3fa3ee-63d5-423f-9f90-c85f1dc172bf admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:21:34.774258 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3fa3ee-63d5-423f-9f90-c85f1dc172bf admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:21:34.804647 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc204edc-7e48-434f-977a-d514f3444017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:21:34.811425 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc204edc-7e48-434f-977a-d514f3444017 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:21:34.813486 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc204edc-7e48-434f-977a-d514f3444017 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:21:34.813486 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc204edc-7e48-434f-977a-d514f3444017 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:21:34.818089 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc204edc-7e48-434f-977a-d514f3444017 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:21:34.825531 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc204edc-7e48-434f-977a-d514f3444017 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:21:34.857917 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1621/3234] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:21:34 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 21:21:34.862463 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3a3639-ec4f-4439-b671-033321b32719 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:21:34.880403 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3a3639-ec4f-4439-b671-033321b32719 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:21:34.895208 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed24e27-8b0d-4a31-bebc-4a1ad5463ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:21:34.896787 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed24e27-8b0d-4a31-bebc-4a1ad5463ef5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:21:34.897307 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed24e27-8b0d-4a31-bebc-4a1ad5463ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:21:34.897931 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed24e27-8b0d-4a31-bebc-4a1ad5463ef5 admin admin] PATH_INFO: `/v3/projects/7e0f76ca9b734142a90c27f3d3de3a85/users/c7acc7eae5f946aaac9f0c8ead2c8d58/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:21:34.973830 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed24e27-8b0d-4a31-bebc-4a1ad5463ef5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e0f76ca9b734142a90c27f3d3de3a85, user_id=c7acc7eae5f946aaac9f0c8ead2c8d58, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:21:34.985852 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed24e27-8b0d-4a31-bebc-4a1ad5463ef5 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:21:35.017916 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1614/3235] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:21:34 2022] PUT /identity/v3/projects/7e0f76ca9b734142a90c27f3d3de3a85/users/c7acc7eae5f946aaac9f0c8ead2c8d58/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:21:35.030255 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c295a2-06e4-4738-b1f7-433ae4c69357 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:21:35.030720 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c295a2-06e4-4738-b1f7-433ae4c69357 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:21:35.031480 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c295a2-06e4-4738-b1f7-433ae4c69357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:21:35.122307 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-97c295a2-06e4-4738-b1f7-433ae4c69357 None None] MFA Rules not processed for user `c7acc7eae5f946aaac9f0c8ead2c8d58`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:21:35.124303 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-97c295a2-06e4-4738-b1f7-433ae4c69357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:21:35.243753 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf4e075-3c5a-45fa-a406-cedd8db65ecc None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:21:35.244300 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf4e075-3c5a-45fa-a406-cedd8db65ecc None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:21:35.244649 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf4e075-3c5a-45fa-a406-cedd8db65ecc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:21:35.297324 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-3cf4e075-3c5a-45fa-a406-cedd8db65ecc None None] MFA Rules not processed for user `ebf93a4b80cb4e19a36473986950fc75`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:21:35.307980 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-3cf4e075-3c5a-45fa-a406-cedd8db65ecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:21:35.383125 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1622/3236] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:21:35 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 352 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:21:35.384840 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c295a2-06e4-4738-b1f7-433ae4c69357 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:21:35.480616 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:21:35.492283 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1615/3237] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:21:35 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:21:35.664334 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c295a2-06e4-4738-b1f7-433ae4c69357 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:21:35.695066 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeea998-b736-4899-8f71-c953630a6bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:21:35.695940 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeea998-b736-4899-8f71-c953630a6bca admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:21:35.696319 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeea998-b736-4899-8f71-c953630a6bca admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:21:35.696918 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeea998-b736-4899-8f71-c953630a6bca admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:21:35.697748 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeea998-b736-4899-8f71-c953630a6bca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:21:35.703260 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeea998-b736-4899-8f71-c953630a6bca admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:21:35.827058 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1623/3238] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:21:35 2022] POST /identity/v3/projects => generated 393 bytes in 442 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:21:35.831584 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf4e075-3c5a-45fa-a406-cedd8db65ecc None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:21:35.851262 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf4e075-3c5a-45fa-a406-cedd8db65ecc None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:21:36.135939 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f92d27-431c-4b98-bfea-67c0a38fd734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:21:36.138222 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f92d27-431c-4b98-bfea-67c0a38fd734 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:21:36.140115 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f92d27-431c-4b98-bfea-67c0a38fd734 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:21:36.141330 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f92d27-431c-4b98-bfea-67c0a38fd734 admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:21:36.145424 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f92d27-431c-4b98-bfea-67c0a38fd734 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:21:36.149401 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f92d27-431c-4b98-bfea-67c0a38fd734 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:21:36.232638 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=90,keystone:DELETE=4,keystone:INSERT=6 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:21:36.271270 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1616/3239] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:21:35 2022] POST /identity/v3/users => generated 303 bytes in 441 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:21:36.272550 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeea998-b736-4899-8f71-c953630a6bca admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:21:36.300570 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeea998-b736-4899-8f71-c953630a6bca admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:21:36.310727 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac64e909-29db-45ae-ad65-6e1f3bb2d3e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:21:36.312282 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac64e909-29db-45ae-ad65-6e1f3bb2d3e7 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:21:36.313027 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac64e909-29db-45ae-ad65-6e1f3bb2d3e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:21:36.313756 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac64e909-29db-45ae-ad65-6e1f3bb2d3e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:21:36.315595 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac64e909-29db-45ae-ad65-6e1f3bb2d3e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:21:36.318941 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac64e909-29db-45ae-ad65-6e1f3bb2d3e7 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:21:36.337315 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1624/3240] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:21:36 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:21:36.341975 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f92d27-431c-4b98-bfea-67c0a38fd734 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:21:36.366785 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f92d27-431c-4b98-bfea-67c0a38fd734 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:21:36.373681 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d480a75-78f5-452b-9f1c-87d51a838072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:21:36.376813 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d480a75-78f5-452b-9f1c-87d51a838072 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:21:36.377804 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d480a75-78f5-452b-9f1c-87d51a838072 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:21:36.378342 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d480a75-78f5-452b-9f1c-87d51a838072 admin admin] PATH_INFO: `/v3/projects/a7a5537ccc0f49c397e9f6bc723a9b7b/users/745c84c03045459f948326f8e11b1c72/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:21:36.409225 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d480a75-78f5-452b-9f1c-87d51a838072 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7a5537ccc0f49c397e9f6bc723a9b7b, user_id=745c84c03045459f948326f8e11b1c72, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:21:36.417389 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d480a75-78f5-452b-9f1c-87d51a838072 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:21:36.456543 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1617/3241] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:21:36 2022] PUT /identity/v3/projects/a7a5537ccc0f49c397e9f6bc723a9b7b/users/745c84c03045459f948326f8e11b1c72/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:21:36.464464 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac64e909-29db-45ae-ad65-6e1f3bb2d3e7 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:21:36.488209 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac64e909-29db-45ae-ad65-6e1f3bb2d3e7 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:21:36.725982 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5205bf-6a65-43b1-969c-893ac9efc16e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:21:36.741800 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5205bf-6a65-43b1-969c-893ac9efc16e admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:21:36.742499 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5205bf-6a65-43b1-969c-893ac9efc16e admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:21:36.742804 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5205bf-6a65-43b1-969c-893ac9efc16e admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:21:36.743677 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5205bf-6a65-43b1-969c-893ac9efc16e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:21:36.745419 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5205bf-6a65-43b1-969c-893ac9efc16e admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:21:36.771757 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d480a75-78f5-452b-9f1c-87d51a838072 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:21:36.777879 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1625/3242] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:21:36 2022] GET /identity/v3/roles => generated 1420 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:21:36.807678 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d480a75-78f5-452b-9f1c-87d51a838072 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:21:36.820992 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1149a0c1-038d-4060-b8bb-5ace77fd7844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:21:36.829645 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1149a0c1-038d-4060-b8bb-5ace77fd7844 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:21:36.834193 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1149a0c1-038d-4060-b8bb-5ace77fd7844 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:21:36.834826 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1149a0c1-038d-4060-b8bb-5ace77fd7844 admin admin] PATH_INFO: `/v3/projects/a7a5537ccc0f49c397e9f6bc723a9b7b/users/745c84c03045459f948326f8e11b1c72/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:21:36.846070 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1149a0c1-038d-4060-b8bb-5ace77fd7844 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7a5537ccc0f49c397e9f6bc723a9b7b, user_id=745c84c03045459f948326f8e11b1c72, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:21:36.854786 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1149a0c1-038d-4060-b8bb-5ace77fd7844 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:21:36.898756 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1618/3243] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:21:36 2022] PUT /identity/v3/projects/a7a5537ccc0f49c397e9f6bc723a9b7b/users/745c84c03045459f948326f8e11b1c72/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:21:36.901836 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5c87ef-91e7-4fdd-a51c-3642a59de69b None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:21:36.902830 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5c87ef-91e7-4fdd-a51c-3642a59de69b None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:21:36.903205 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5c87ef-91e7-4fdd-a51c-3642a59de69b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:21:36.952779 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-0d5c87ef-91e7-4fdd-a51c-3642a59de69b None None] MFA Rules not processed for user `745c84c03045459f948326f8e11b1c72`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:21:36.954331 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-0d5c87ef-91e7-4fdd-a51c-3642a59de69b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:21:37.090920 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1626/3244] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:21:36 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:21:37.104778 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3b8254-e5d7-4cff-8c4f-badcaac2c25d None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:21:37.104778 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3b8254-e5d7-4cff-8c4f-badcaac2c25d None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:21:37.104778 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3b8254-e5d7-4cff-8c4f-badcaac2c25d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:21:37.139121 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-7e3b8254-e5d7-4cff-8c4f-badcaac2c25d None None] MFA Rules not processed for user `c7acc7eae5f946aaac9f0c8ead2c8d58`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:21:37.140551 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-7e3b8254-e5d7-4cff-8c4f-badcaac2c25d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:21:37.298137 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1619/3245] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:21:37 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:21:37.306613 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5c87ef-91e7-4fdd-a51c-3642a59de69b None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:21:37.311832 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-0d5c87ef-91e7-4fdd-a51c-3642a59de69b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:21:37.401079 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:21:37.610446 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5c87ef-91e7-4fdd-a51c-3642a59de69b None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:21:37.628454 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc772021-805f-4691-a12a-2231b6979ba4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:21:37.629594 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc772021-805f-4691-a12a-2231b6979ba4 service nova] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:21:37.630066 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc772021-805f-4691-a12a-2231b6979ba4 service nova] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:21:37.630390 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc772021-805f-4691-a12a-2231b6979ba4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:21:37.644202 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc772021-805f-4691-a12a-2231b6979ba4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:21:37.646265 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc772021-805f-4691-a12a-2231b6979ba4 service nova] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:21:37.686992 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1627/3246] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:21:37 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:21:38.527197 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3b8254-e5d7-4cff-8c4f-badcaac2c25d None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:21:38.530134 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-7e3b8254-e5d7-4cff-8c4f-badcaac2c25d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:21:38.649378 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3b8254-e5d7-4cff-8c4f-badcaac2c25d None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:21:38.656679 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4ecd05-0d8d-44d9-b2f9-0747242e32ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:21:38.658043 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4ecd05-0d8d-44d9-b2f9-0747242e32ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:21:38.658653 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4ecd05-0d8d-44d9-b2f9-0747242e32ca admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:21:38.659218 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4ecd05-0d8d-44d9-b2f9-0747242e32ca admin admin] PATH_INFO: `/v3/users/145e518288ce4d70a12a3f2cc6a91810` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:21:38.660898 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4ecd05-0d8d-44d9-b2f9-0747242e32ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=145e518288ce4d70a12a3f2cc6a91810)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:21:38.663985 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4ecd05-0d8d-44d9-b2f9-0747242e32ca admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:21:38.858672 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-aa4ecd05-0d8d-44d9-b2f9-0747242e32ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '145e518288ce4d70a12a3f2cc6a91810'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:21:38.878542 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-aa4ecd05-0d8d-44d9-b2f9-0747242e32ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '145e518288ce4d70a12a3f2cc6a91810'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:21:38.879311 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-aa4ecd05-0d8d-44d9-b2f9-0747242e32ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '145e518288ce4d70a12a3f2cc6a91810'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:21:38.902619 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-aa4ecd05-0d8d-44d9-b2f9-0747242e32ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '145e518288ce4d70a12a3f2cc6a91810'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:21:38.907751 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:21:38.953385 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-aa4ecd05-0d8d-44d9-b2f9-0747242e32ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '145e518288ce4d70a12a3f2cc6a91810'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:21:38.976108 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1620/3247] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:21:38 2022] DELETE /identity/v3/users/145e518288ce4d70a12a3f2cc6a91810 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:21:39.183816 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc772021-805f-4691-a12a-2231b6979ba4 service nova] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:21:39.185997 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-cc772021-805f-4691-a12a-2231b6979ba4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:21:39.254609 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc772021-805f-4691-a12a-2231b6979ba4 service nova] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:21:39.468003 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2823b2-cae3-48fe-9eae-eadf7b0b0564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:21:39.486197 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2823b2-cae3-48fe-9eae-eadf7b0b0564 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:21:39.486497 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2823b2-cae3-48fe-9eae-eadf7b0b0564 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:21:39.488577 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2823b2-cae3-48fe-9eae-eadf7b0b0564 admin admin] PATH_INFO: `/v3/users/a271336fe39f4bcb94d326ddfb7b4365` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:21:39.493178 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2823b2-cae3-48fe-9eae-eadf7b0b0564 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a271336fe39f4bcb94d326ddfb7b4365)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:21:39.495069 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2823b2-cae3-48fe-9eae-eadf7b0b0564 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:21:39.687189 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4ecd05-0d8d-44d9-b2f9-0747242e32ca admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:21:39.689083 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-aa4ecd05-0d8d-44d9-b2f9-0747242e32ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:21:39.705945 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-8f2823b2-cae3-48fe-9eae-eadf7b0b0564 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a271336fe39f4bcb94d326ddfb7b4365'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:21:39.709542 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-8f2823b2-cae3-48fe-9eae-eadf7b0b0564 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a271336fe39f4bcb94d326ddfb7b4365'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:21:39.722890 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4ecd05-0d8d-44d9-b2f9-0747242e32ca admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:21:39.741749 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-8f2823b2-cae3-48fe-9eae-eadf7b0b0564 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a271336fe39f4bcb94d326ddfb7b4365'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:21:39.756177 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46181c77-2e05-4104-8991-156e9629087a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:21:39.760430 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46181c77-2e05-4104-8991-156e9629087a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:21:39.762307 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46181c77-2e05-4104-8991-156e9629087a admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:21:39.764286 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46181c77-2e05-4104-8991-156e9629087a admin admin] PATH_INFO: `/v3/projects/f220ba2f42db435a818f3e462aea35a2` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:21:39.765738 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-8f2823b2-cae3-48fe-9eae-eadf7b0b0564 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a271336fe39f4bcb94d326ddfb7b4365'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:21:39.769382 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46181c77-2e05-4104-8991-156e9629087a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f220ba2f42db435a818f3e462aea35a2)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:21:39.777843 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46181c77-2e05-4104-8991-156e9629087a admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:21:39.821150 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-8f2823b2-cae3-48fe-9eae-eadf7b0b0564 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a271336fe39f4bcb94d326ddfb7b4365'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:21:39.839217 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1628/3248] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:21:39 2022] DELETE /identity/v3/users/a271336fe39f4bcb94d326ddfb7b4365 => generated 0 bytes in 656 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:21:39.931916 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-46181c77-2e05-4104-8991-156e9629087a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f220ba2f42db435a818f3e462aea35a2', 'request_id': 'req-46181c77-2e05-4104-8991-156e9629087a'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:21:39.955716 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-46181c77-2e05-4104-8991-156e9629087a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f220ba2f42db435a818f3e462aea35a2', 'request_id': 'req-46181c77-2e05-4104-8991-156e9629087a'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:21:39.971946 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-46181c77-2e05-4104-8991-156e9629087a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f220ba2f42db435a818f3e462aea35a2', 'request_id': 'req-46181c77-2e05-4104-8991-156e9629087a'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:21:40.001140 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-46181c77-2e05-4104-8991-156e9629087a admin admin] The token cache is being invalidate because project f220ba2f42db435a818f3e462aea35a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:21:40.002040 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-46181c77-2e05-4104-8991-156e9629087a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:21:40.005267 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-46181c77-2e05-4104-8991-156e9629087a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:21:40.007617 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1621/3249] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:21:39 2022] DELETE /identity/v3/projects/f220ba2f42db435a818f3e462aea35a2 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:21:40.011605 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2823b2-cae3-48fe-9eae-eadf7b0b0564 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:21:40.014910 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-8f2823b2-cae3-48fe-9eae-eadf7b0b0564 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:21:40.086402 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:21:40.182399 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2823b2-cae3-48fe-9eae-eadf7b0b0564 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:21:40.290412 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46181c77-2e05-4104-8991-156e9629087a admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:21:40.292529 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-46181c77-2e05-4104-8991-156e9629087a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:21:40.374099 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f57a4d-c404-4f53-8e9c-796b4677e723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:21:40.378867 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f57a4d-c404-4f53-8e9c-796b4677e723 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:21:40.379821 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f57a4d-c404-4f53-8e9c-796b4677e723 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:21:40.380421 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f57a4d-c404-4f53-8e9c-796b4677e723 admin admin] PATH_INFO: `/v3/users/460eb04964224ed0a414d2fde153a26a` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:21:40.383111 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f57a4d-c404-4f53-8e9c-796b4677e723 admin admin] RBAC: Authorizing `identity:delete_user(user_id=460eb04964224ed0a414d2fde153a26a)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:21:40.387662 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f57a4d-c404-4f53-8e9c-796b4677e723 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:21:40.458660 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46181c77-2e05-4104-8991-156e9629087a admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:21:40.466802 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-60f57a4d-c404-4f53-8e9c-796b4677e723 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '460eb04964224ed0a414d2fde153a26a'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:21:40.467819 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-60f57a4d-c404-4f53-8e9c-796b4677e723 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '460eb04964224ed0a414d2fde153a26a'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:21:40.468176 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f201b43-3b4f-436d-8984-25a809b6b134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:21:40.469791 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f201b43-3b4f-436d-8984-25a809b6b134 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:21:40.470110 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f201b43-3b4f-436d-8984-25a809b6b134 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:21:40.470453 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f201b43-3b4f-436d-8984-25a809b6b134 admin admin] PATH_INFO: `/v3/projects/24d534ba297c4d709c5ccf36c9394842` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:21:40.472644 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f201b43-3b4f-436d-8984-25a809b6b134 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24d534ba297c4d709c5ccf36c9394842)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:21:40.475968 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f201b43-3b4f-436d-8984-25a809b6b134 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:21:40.480910 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-60f57a4d-c404-4f53-8e9c-796b4677e723 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '460eb04964224ed0a414d2fde153a26a'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:21:40.492238 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-60f57a4d-c404-4f53-8e9c-796b4677e723 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '460eb04964224ed0a414d2fde153a26a'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:21:40.513647 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-60f57a4d-c404-4f53-8e9c-796b4677e723 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '460eb04964224ed0a414d2fde153a26a'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:21:40.528791 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1629/3250] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:21:40 2022] DELETE /identity/v3/users/460eb04964224ed0a414d2fde153a26a => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:21:40.623494 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-9f201b43-3b4f-436d-8984-25a809b6b134 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24d534ba297c4d709c5ccf36c9394842', 'request_id': 'req-9f201b43-3b4f-436d-8984-25a809b6b134'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:21:40.641609 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-9f201b43-3b4f-436d-8984-25a809b6b134 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24d534ba297c4d709c5ccf36c9394842', 'request_id': 'req-9f201b43-3b4f-436d-8984-25a809b6b134'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:21:40.658203 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-9f201b43-3b4f-436d-8984-25a809b6b134 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24d534ba297c4d709c5ccf36c9394842', 'request_id': 'req-9f201b43-3b4f-436d-8984-25a809b6b134'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:21:40.661840 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:21:40.684658 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-9f201b43-3b4f-436d-8984-25a809b6b134 admin admin] The token cache is being invalidate because project 24d534ba297c4d709c5ccf36c9394842 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:21:40.686138 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-9f201b43-3b4f-436d-8984-25a809b6b134 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:21:40.705926 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-9f201b43-3b4f-436d-8984-25a809b6b134 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:21:40.711367 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1622/3251] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:21:40 2022] DELETE /identity/v3/projects/24d534ba297c4d709c5ccf36c9394842 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:21:40.717954 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb4f543-c8ec-407d-8acc-462e917fa331 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:21:40.718248 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb4f543-c8ec-407d-8acc-462e917fa331 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:21:40.718569 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb4f543-c8ec-407d-8acc-462e917fa331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:21:40.758740 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-bbb4f543-c8ec-407d-8acc-462e917fa331 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:21:40.764081 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-bbb4f543-c8ec-407d-8acc-462e917fa331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:21:40.908451 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:21:40.940893 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1630/3252] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:21:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:21:40.948934 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce84a228-d27d-4e42-8fd7-3cca6c9b0fd2 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:21:40.949201 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce84a228-d27d-4e42-8fd7-3cca6c9b0fd2 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:21:40.949458 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce84a228-d27d-4e42-8fd7-3cca6c9b0fd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:21:40.996356 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-ce84a228-d27d-4e42-8fd7-3cca6c9b0fd2 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:21:40.997637 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-ce84a228-d27d-4e42-8fd7-3cca6c9b0fd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:21:41.020800 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1623/3253] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:21:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:21:41.022572 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb4f543-c8ec-407d-8acc-462e917fa331 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:21:41.039685 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb4f543-c8ec-407d-8acc-462e917fa331 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:21:41.050367 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2fbdc3-8916-4024-9257-51ee6d0ba489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:21:41.051195 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2fbdc3-8916-4024-9257-51ee6d0ba489 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:21:41.051515 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2fbdc3-8916-4024-9257-51ee6d0ba489 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:21:41.051802 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2fbdc3-8916-4024-9257-51ee6d0ba489 admin admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:21:41.052578 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2fbdc3-8916-4024-9257-51ee6d0ba489 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:21:41.052877 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2fbdc3-8916-4024-9257-51ee6d0ba489 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:21:41.057277 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2fbdc3-8916-4024-9257-51ee6d0ba489 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:21:41.091517 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1631/3254] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:21:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:21:41.093821 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce84a228-d27d-4e42-8fd7-3cca6c9b0fd2 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:21:41.106578 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce84a228-d27d-4e42-8fd7-3cca6c9b0fd2 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:21:41.114049 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded805c2-e38c-4a6a-9dff-4ded7045ace2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:21:41.114773 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded805c2-e38c-4a6a-9dff-4ded7045ace2 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:21:41.115286 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded805c2-e38c-4a6a-9dff-4ded7045ace2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:21:41.117048 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded805c2-e38c-4a6a-9dff-4ded7045ace2 admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:21:41.118000 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded805c2-e38c-4a6a-9dff-4ded7045ace2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:21:41.120326 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded805c2-e38c-4a6a-9dff-4ded7045ace2 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:21:41.157963 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1624/3255] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:21:41 2022] POST /identity/v3/projects => generated 377 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:21:41.162498 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2fbdc3-8916-4024-9257-51ee6d0ba489 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:21:41.174894 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2fbdc3-8916-4024-9257-51ee6d0ba489 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:21:41.260570 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63cda77-13bb-47f8-b724-1455b7dda658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:21:41.261596 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63cda77-13bb-47f8-b724-1455b7dda658 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:21:41.261906 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63cda77-13bb-47f8-b724-1455b7dda658 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:21:41.262202 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63cda77-13bb-47f8-b724-1455b7dda658 admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:21:41.263045 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63cda77-13bb-47f8-b724-1455b7dda658 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:21:41.270110 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63cda77-13bb-47f8-b724-1455b7dda658 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:21:41.304287 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1632/3256] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:21:41 2022] POST /identity/v3/users => generated 289 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:21:41.305818 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded805c2-e38c-4a6a-9dff-4ded7045ace2 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:21:41.320759 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded805c2-e38c-4a6a-9dff-4ded7045ace2 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:21:41.336801 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20afe8b-e166-498d-aa51-3f050688727d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:21:41.336801 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20afe8b-e166-498d-aa51-3f050688727d admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:21:41.336801 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20afe8b-e166-498d-aa51-3f050688727d admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:21:41.336801 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20afe8b-e166-498d-aa51-3f050688727d admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:21:41.339518 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20afe8b-e166-498d-aa51-3f050688727d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:21:41.339518 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20afe8b-e166-498d-aa51-3f050688727d admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:21:41.365855 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63cda77-13bb-47f8-b724-1455b7dda658 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:21:41.366530 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1625/3257] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:21:41 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:21:41.385278 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63cda77-13bb-47f8-b724-1455b7dda658 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:21:41.397447 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a5a073-ba40-44d7-8a8b-981c14daea90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:21:41.398186 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a5a073-ba40-44d7-8a8b-981c14daea90 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:21:41.398468 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a5a073-ba40-44d7-8a8b-981c14daea90 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:21:41.398742 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a5a073-ba40-44d7-8a8b-981c14daea90 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:21:41.399485 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a5a073-ba40-44d7-8a8b-981c14daea90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:21:41.401665 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a5a073-ba40-44d7-8a8b-981c14daea90 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:21:41.423905 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1633/3258] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:21:41 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:21:41.428473 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20afe8b-e166-498d-aa51-3f050688727d admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:21:41.450390 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20afe8b-e166-498d-aa51-3f050688727d admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:21:41.455994 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12dd7f4-1e0c-401f-8a11-2c9bde2f6f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:21:41.457391 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12dd7f4-1e0c-401f-8a11-2c9bde2f6f2c admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:21:41.458359 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12dd7f4-1e0c-401f-8a11-2c9bde2f6f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:21:41.459136 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12dd7f4-1e0c-401f-8a11-2c9bde2f6f2c admin admin] PATH_INFO: `/v3/projects/01cd9b8837554b8daf506ca062ec916b/users/efc72b47672e46659b1a5ebdfd99224c/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:21:41.481803 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12dd7f4-1e0c-401f-8a11-2c9bde2f6f2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=01cd9b8837554b8daf506ca062ec916b, user_id=efc72b47672e46659b1a5ebdfd99224c, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:21:41.486640 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12dd7f4-1e0c-401f-8a11-2c9bde2f6f2c admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:21:41.511698 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1626/3259] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:21:41 2022] PUT /identity/v3/projects/01cd9b8837554b8daf506ca062ec916b/users/efc72b47672e46659b1a5ebdfd99224c/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:21:41.516909 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265aa17d-6918-46da-a661-2bcf60f527c8 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:21:41.517258 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265aa17d-6918-46da-a661-2bcf60f527c8 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:21:41.517475 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265aa17d-6918-46da-a661-2bcf60f527c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:21:41.537399 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-265aa17d-6918-46da-a661-2bcf60f527c8 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:21:41.538742 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-265aa17d-6918-46da-a661-2bcf60f527c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:21:41.648530 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1634/3260] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:21:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:21:41.663414 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12dd7f4-1e0c-401f-8a11-2c9bde2f6f2c admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:21:41.665685 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-f12dd7f4-1e0c-401f-8a11-2c9bde2f6f2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:21:41.758634 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12dd7f4-1e0c-401f-8a11-2c9bde2f6f2c admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:21:41.764913 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dcfa08-dc0a-4ac9-98ea-b7d045e6a5a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:21:41.765634 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dcfa08-dc0a-4ac9-98ea-b7d045e6a5a3 service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:21:41.766257 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dcfa08-dc0a-4ac9-98ea-b7d045e6a5a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:21:41.767000 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dcfa08-dc0a-4ac9-98ea-b7d045e6a5a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:21:41.779159 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dcfa08-dc0a-4ac9-98ea-b7d045e6a5a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:21:41.781126 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dcfa08-dc0a-4ac9-98ea-b7d045e6a5a3 service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:21:41.794726 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1627/3261] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:21:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:21:42.209141 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265aa17d-6918-46da-a661-2bcf60f527c8 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:21:42.211026 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-265aa17d-6918-46da-a661-2bcf60f527c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:21:42.229228 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265aa17d-6918-46da-a661-2bcf60f527c8 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:21:42.244674 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f6ca64-b68c-4532-9a8d-2a5759176460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:21:42.251010 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f6ca64-b68c-4532-9a8d-2a5759176460 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:21:42.251301 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f6ca64-b68c-4532-9a8d-2a5759176460 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:21:42.251584 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f6ca64-b68c-4532-9a8d-2a5759176460 admin admin] PATH_INFO: `/v3/projects/2a1692e025cd466cb532b1caa78fa196` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:21:42.253518 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f6ca64-b68c-4532-9a8d-2a5759176460 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a1692e025cd466cb532b1caa78fa196)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:21:42.255656 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f6ca64-b68c-4532-9a8d-2a5759176460 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:21:42.365913 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-37f6ca64-b68c-4532-9a8d-2a5759176460 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a1692e025cd466cb532b1caa78fa196', 'request_id': 'req-37f6ca64-b68c-4532-9a8d-2a5759176460'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:21:42.374934 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:21:42.391559 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-37f6ca64-b68c-4532-9a8d-2a5759176460 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a1692e025cd466cb532b1caa78fa196', 'request_id': 'req-37f6ca64-b68c-4532-9a8d-2a5759176460'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:21:42.409215 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-37f6ca64-b68c-4532-9a8d-2a5759176460 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a1692e025cd466cb532b1caa78fa196', 'request_id': 'req-37f6ca64-b68c-4532-9a8d-2a5759176460'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:21:42.426104 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-37f6ca64-b68c-4532-9a8d-2a5759176460 admin admin] The token cache is being invalidate because project 2a1692e025cd466cb532b1caa78fa196 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:21:42.426365 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-37f6ca64-b68c-4532-9a8d-2a5759176460 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:21:42.427042 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-37f6ca64-b68c-4532-9a8d-2a5759176460 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:21:42.434000 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1635/3262] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:21:42 2022] DELETE /identity/v3/projects/2a1692e025cd466cb532b1caa78fa196 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:21:42.435312 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd0d03f-5d0e-4cf3-a733-34a39f23f9f3 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:21:42.435790 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd0d03f-5d0e-4cf3-a733-34a39f23f9f3 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:21:42.436199 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd0d03f-5d0e-4cf3-a733-34a39f23f9f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:21:42.489125 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-6fd0d03f-5d0e-4cf3-a733-34a39f23f9f3 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:21:42.490758 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-6fd0d03f-5d0e-4cf3-a733-34a39f23f9f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:21:42.642073 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1628/3263] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:21:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:21:42.653023 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51840cff-c81f-4e6b-8732-a2db38809af7 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:21:42.656474 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51840cff-c81f-4e6b-8732-a2db38809af7 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:21:42.656474 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51840cff-c81f-4e6b-8732-a2db38809af7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:21:42.684937 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-51840cff-c81f-4e6b-8732-a2db38809af7 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:21:42.687162 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-51840cff-c81f-4e6b-8732-a2db38809af7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:21:42.703321 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd0d03f-5d0e-4cf3-a733-34a39f23f9f3 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:21:42.709915 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1636/3264] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:21:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:21:42.714542 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd0d03f-5d0e-4cf3-a733-34a39f23f9f3 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:21:42.722159 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9c390f-af88-4f81-b594-92740ebfb455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:21:42.724082 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9c390f-af88-4f81-b594-92740ebfb455 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:21:42.725219 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9c390f-af88-4f81-b594-92740ebfb455 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:21:42.725742 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9c390f-af88-4f81-b594-92740ebfb455 admin admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:21:42.726803 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9c390f-af88-4f81-b594-92740ebfb455 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:21:42.727803 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9c390f-af88-4f81-b594-92740ebfb455 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:21:42.730399 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9c390f-af88-4f81-b594-92740ebfb455 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:21:42.757111 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51840cff-c81f-4e6b-8732-a2db38809af7 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:21:42.768393 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1629/3265] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:21:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:21:42.771628 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51840cff-c81f-4e6b-8732-a2db38809af7 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:21:42.781929 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8844d88b-f50a-4574-b82b-9590d4108336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:21:42.783260 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8844d88b-f50a-4574-b82b-9590d4108336 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:21:42.783779 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8844d88b-f50a-4574-b82b-9590d4108336 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:21:42.784796 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8844d88b-f50a-4574-b82b-9590d4108336 admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:21:42.785716 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8844d88b-f50a-4574-b82b-9590d4108336 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:21:42.789278 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8844d88b-f50a-4574-b82b-9590d4108336 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:21:42.848716 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1637/3266] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:21:42 2022] POST /identity/v3/projects => generated 379 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:21:42.853792 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9c390f-af88-4f81-b594-92740ebfb455 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:21:42.871300 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9c390f-af88-4f81-b594-92740ebfb455 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:21:42.901651 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:21:42.948722 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f46d54f-553b-434b-bb71-ba7b83073d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:21:42.949487 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f46d54f-553b-434b-bb71-ba7b83073d3d admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:21:42.949842 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f46d54f-553b-434b-bb71-ba7b83073d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:21:42.950432 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f46d54f-553b-434b-bb71-ba7b83073d3d admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:21:42.951453 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f46d54f-553b-434b-bb71-ba7b83073d3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:21:42.953692 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f46d54f-553b-434b-bb71-ba7b83073d3d admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:21:43.019482 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8844d88b-f50a-4574-b82b-9590d4108336 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:21:43.020759 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1630/3267] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:21:42 2022] POST /identity/v3/users => generated 290 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:21:43.034304 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8844d88b-f50a-4574-b82b-9590d4108336 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:21:43.046980 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a813d4-a7fb-4f4f-b028-4880568d0125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:21:43.048985 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a813d4-a7fb-4f4f-b028-4880568d0125 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:21:43.049309 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a813d4-a7fb-4f4f-b028-4880568d0125 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:21:43.049480 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a813d4-a7fb-4f4f-b028-4880568d0125 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:21:43.051989 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a813d4-a7fb-4f4f-b028-4880568d0125 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:21:43.054037 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a813d4-a7fb-4f4f-b028-4880568d0125 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:21:43.116184 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1638/3268] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:21:43 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:21:43.126061 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f46d54f-553b-434b-bb71-ba7b83073d3d admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:21:43.145414 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f46d54f-553b-434b-bb71-ba7b83073d3d admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:21:43.160003 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3cb86f-d2c8-4a06-80cf-f2a05032317f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:21:43.161006 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3cb86f-d2c8-4a06-80cf-f2a05032317f admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:21:43.161447 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3cb86f-d2c8-4a06-80cf-f2a05032317f admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:21:43.161967 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3cb86f-d2c8-4a06-80cf-f2a05032317f admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:21:43.163437 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3cb86f-d2c8-4a06-80cf-f2a05032317f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:21:43.165384 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3cb86f-d2c8-4a06-80cf-f2a05032317f admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:21:43.198826 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a813d4-a7fb-4f4f-b028-4880568d0125 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:21:43.201905 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1631/3269] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:21:43 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:21:43.219349 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a813d4-a7fb-4f4f-b028-4880568d0125 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:21:43.229775 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d36006-1d9f-4a91-830e-51697a659022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:21:43.231173 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d36006-1d9f-4a91-830e-51697a659022 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:21:43.231626 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d36006-1d9f-4a91-830e-51697a659022 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:21:43.232155 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d36006-1d9f-4a91-830e-51697a659022 admin admin] PATH_INFO: `/v3/projects/fa88d37bfb314835bd592d638db11360/users/22f9f9332aad483281c34422d83ba2fc/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:21:43.321042 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d36006-1d9f-4a91-830e-51697a659022 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa88d37bfb314835bd592d638db11360, user_id=22f9f9332aad483281c34422d83ba2fc, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:21:43.333016 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d36006-1d9f-4a91-830e-51697a659022 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:21:43.377284 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1639/3270] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:21:43 2022] PUT /identity/v3/projects/fa88d37bfb314835bd592d638db11360/users/22f9f9332aad483281c34422d83ba2fc/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:21:43.388665 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5731d3-4485-477b-b846-2c4cad01f288 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:21:43.389032 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5731d3-4485-477b-b846-2c4cad01f288 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:21:43.389290 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5731d3-4485-477b-b846-2c4cad01f288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:21:43.444401 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-da5731d3-4485-477b-b846-2c4cad01f288 None None] MFA Rules not processed for user `22f9f9332aad483281c34422d83ba2fc`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:21:43.446195 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-da5731d3-4485-477b-b846-2c4cad01f288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:21:43.611080 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1632/3271] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:21:43 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:21:43.624306 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d36006-1d9f-4a91-830e-51697a659022 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:21:43.628423 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-e7d36006-1d9f-4a91-830e-51697a659022 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:21:43.850289 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d36006-1d9f-4a91-830e-51697a659022 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:21:43.863041 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945a2689-2ffd-46c7-b815-ac3a5ffd5be8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7f2db148c8e4d5d81431cae3576434b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:21:43.863885 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945a2689-2ffd-46c7-b815-ac3a5ffd5be8 service glance] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:21:43.864925 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945a2689-2ffd-46c7-b815-ac3a5ffd5be8 service glance] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:21:43.865305 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945a2689-2ffd-46c7-b815-ac3a5ffd5be8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:21:43.887339 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945a2689-2ffd-46c7-b815-ac3a5ffd5be8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:21:43.889603 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945a2689-2ffd-46c7-b815-ac3a5ffd5be8 service glance] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:21:43.919305 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1640/3272] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:21:43 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:21:44.292066 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b671ffb4-4fa2-44d0-b60c-491d26d92bc0 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:21:44.292066 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b671ffb4-4fa2-44d0-b60c-491d26d92bc0 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:21:44.292066 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b671ffb4-4fa2-44d0-b60c-491d26d92bc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:21:44.322495 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-b671ffb4-4fa2-44d0-b60c-491d26d92bc0 None None] MFA Rules not processed for user `17b779a3e21a415bb42cde5d6863d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:21:44.323747 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-b671ffb4-4fa2-44d0-b60c-491d26d92bc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:21:44.472468 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1633/3273] 10.222.0.17 () {58 vars in 1009 bytes} [Sat Jul 23 21:21:44 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:21:44.491104 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945a2689-2ffd-46c7-b815-ac3a5ffd5be8 service glance] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:21:44.493190 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-945a2689-2ffd-46c7-b815-ac3a5ffd5be8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:21:44.686561 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945a2689-2ffd-46c7-b815-ac3a5ffd5be8 service glance] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:21:44.693550 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b67f63-4d1f-406f-b2cd-7c1cd7add05a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f0a685b7da46afb81024848f079d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:21:44.694783 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b67f63-4d1f-406f-b2cd-7c1cd7add05a service swift] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:21:44.694783 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b67f63-4d1f-406f-b2cd-7c1cd7add05a service swift] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:21:44.695056 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b67f63-4d1f-406f-b2cd-7c1cd7add05a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:21:44.709506 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b67f63-4d1f-406f-b2cd-7c1cd7add05a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:21:44.715711 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b67f63-4d1f-406f-b2cd-7c1cd7add05a service swift] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:21:44.731484 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1641/3274] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 23 21:21:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 23 21:21:48.822810 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b671ffb4-4fa2-44d0-b60c-491d26d92bc0 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:21:48.824281 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-b671ffb4-4fa2-44d0-b60c-491d26d92bc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:21:48.898096 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:21:48.943357 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b67f63-4d1f-406f-b2cd-7c1cd7add05a service swift] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:21:48.945075 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-97b67f63-4d1f-406f-b2cd-7c1cd7add05a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:21:48.946766 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b671ffb4-4fa2-44d0-b60c-491d26d92bc0 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:21:48.954533 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b45b83e-efce-45eb-ab35-c7d4cb631806 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc719a3b3ac4461b82ca04ab6451d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:21:48.955472 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b45b83e-efce-45eb-ab35-c7d4cb631806 service placement] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:21:48.956271 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b45b83e-efce-45eb-ab35-c7d4cb631806 service placement] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:21:48.956773 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b45b83e-efce-45eb-ab35-c7d4cb631806 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:21:48.958994 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-5b45b83e-efce-45eb-ab35-c7d4cb631806 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:21:48.972978 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:21:48.985636 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b45b83e-efce-45eb-ab35-c7d4cb631806 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:21:48.988368 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b45b83e-efce-45eb-ab35-c7d4cb631806 service placement] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:21:49.012376 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1634/3275] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:21:48 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:21:49.115752 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b67f63-4d1f-406f-b2cd-7c1cd7add05a service swift] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:21:49.129372 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d055561-6cca-49b2-b78a-c7fbf3522b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:21:49.130983 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d055561-6cca-49b2-b78a-c7fbf3522b96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:21:49.131727 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d055561-6cca-49b2-b78a-c7fbf3522b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:21:49.131727 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d055561-6cca-49b2-b78a-c7fbf3522b96 admin admin] PATH_INFO: `/v3/users/194f98e3c86b48e9952fe02d3648beb0` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:21:49.133189 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d055561-6cca-49b2-b78a-c7fbf3522b96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=194f98e3c86b48e9952fe02d3648beb0)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:21:49.136824 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d055561-6cca-49b2-b78a-c7fbf3522b96 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:21:49.361708 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-5d055561-6cca-49b2-b78a-c7fbf3522b96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '194f98e3c86b48e9952fe02d3648beb0'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:21:49.363404 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-5d055561-6cca-49b2-b78a-c7fbf3522b96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '194f98e3c86b48e9952fe02d3648beb0'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:21:49.389509 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-5d055561-6cca-49b2-b78a-c7fbf3522b96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '194f98e3c86b48e9952fe02d3648beb0'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:21:49.505455 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-5d055561-6cca-49b2-b78a-c7fbf3522b96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '194f98e3c86b48e9952fe02d3648beb0'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:21:49.536347 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-5d055561-6cca-49b2-b78a-c7fbf3522b96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '194f98e3c86b48e9952fe02d3648beb0'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:21:49.549746 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1642/3276] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:21:48 2022] DELETE /identity/v3/users/194f98e3c86b48e9952fe02d3648beb0 => generated 0 bytes in 603 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:21:50.212044 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b45b83e-efce-45eb-ab35-c7d4cb631806 service placement] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:21:50.228648 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b45b83e-efce-45eb-ab35-c7d4cb631806 service placement] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:21:50.413116 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8db3c1-618f-4a80-9cbe-5a3c020a03bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:21:50.414293 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8db3c1-618f-4a80-9cbe-5a3c020a03bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:21:50.414703 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8db3c1-618f-4a80-9cbe-5a3c020a03bd admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:21:50.415103 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8db3c1-618f-4a80-9cbe-5a3c020a03bd admin admin] PATH_INFO: `/v3/projects/e165633a87b04bd9bc3f6e575f53fb12` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:21:50.417379 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8db3c1-618f-4a80-9cbe-5a3c020a03bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=e165633a87b04bd9bc3f6e575f53fb12)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:21:50.420688 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8db3c1-618f-4a80-9cbe-5a3c020a03bd admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:21:50.528080 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-4e8db3c1-618f-4a80-9cbe-5a3c020a03bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e165633a87b04bd9bc3f6e575f53fb12', 'request_id': 'req-4e8db3c1-618f-4a80-9cbe-5a3c020a03bd'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:21:50.548298 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-4e8db3c1-618f-4a80-9cbe-5a3c020a03bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e165633a87b04bd9bc3f6e575f53fb12', 'request_id': 'req-4e8db3c1-618f-4a80-9cbe-5a3c020a03bd'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:21:50.565569 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-4e8db3c1-618f-4a80-9cbe-5a3c020a03bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e165633a87b04bd9bc3f6e575f53fb12', 'request_id': 'req-4e8db3c1-618f-4a80-9cbe-5a3c020a03bd'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:21:50.582411 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-4e8db3c1-618f-4a80-9cbe-5a3c020a03bd admin admin] The token cache is being invalidate because project e165633a87b04bd9bc3f6e575f53fb12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:21:50.582783 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-4e8db3c1-618f-4a80-9cbe-5a3c020a03bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:21:50.583380 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-4e8db3c1-618f-4a80-9cbe-5a3c020a03bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:21:50.592554 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1635/3277] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:21:50 2022] DELETE /identity/v3/projects/e165633a87b04bd9bc3f6e575f53fb12 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:21:50.594524 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daa7d56-88ac-49a5-8b7b-b8cd3068039c None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:21:50.595357 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daa7d56-88ac-49a5-8b7b-b8cd3068039c None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:21:50.595759 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daa7d56-88ac-49a5-8b7b-b8cd3068039c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:21:50.656862 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-1daa7d56-88ac-49a5-8b7b-b8cd3068039c None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:21:50.660335 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-1daa7d56-88ac-49a5-8b7b-b8cd3068039c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:21:50.759685 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1643/3278] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:21:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:21:50.768134 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61704a11-b670-448d-b7ba-7dd5c60d79ad None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:21:50.768457 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61704a11-b670-448d-b7ba-7dd5c60d79ad None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:21:50.768830 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61704a11-b670-448d-b7ba-7dd5c60d79ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:21:50.807925 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-61704a11-b670-448d-b7ba-7dd5c60d79ad None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:21:50.809256 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-61704a11-b670-448d-b7ba-7dd5c60d79ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:21:50.833567 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1636/3279] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:21:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:21:50.834853 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daa7d56-88ac-49a5-8b7b-b8cd3068039c None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:21:50.849068 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daa7d56-88ac-49a5-8b7b-b8cd3068039c None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:21:50.890961 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29c3031-adeb-49db-915d-b1a96b66ec67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:21:50.891660 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29c3031-adeb-49db-915d-b1a96b66ec67 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:21:50.891940 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29c3031-adeb-49db-915d-b1a96b66ec67 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:21:50.892363 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29c3031-adeb-49db-915d-b1a96b66ec67 admin admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:21:50.893241 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29c3031-adeb-49db-915d-b1a96b66ec67 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:21:50.893680 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29c3031-adeb-49db-915d-b1a96b66ec67 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:21:50.897609 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29c3031-adeb-49db-915d-b1a96b66ec67 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:21:50.922221 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1644/3280] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:21:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:21:50.926666 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61704a11-b670-448d-b7ba-7dd5c60d79ad None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:21:50.937094 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61704a11-b670-448d-b7ba-7dd5c60d79ad None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:21:50.957966 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fe4ab0-7f68-4542-b64d-9e4b54ccdc24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:21:50.958580 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fe4ab0-7f68-4542-b64d-9e4b54ccdc24 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:21:50.959037 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fe4ab0-7f68-4542-b64d-9e4b54ccdc24 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:21:50.959437 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fe4ab0-7f68-4542-b64d-9e4b54ccdc24 admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:21:50.960437 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fe4ab0-7f68-4542-b64d-9e4b54ccdc24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:21:50.962538 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fe4ab0-7f68-4542-b64d-9e4b54ccdc24 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:21:51.049510 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1637/3281] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:21:50 2022] POST /identity/v3/projects => generated 379 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:21:51.056144 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29c3031-adeb-49db-915d-b1a96b66ec67 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:21:51.061745 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:21:51.077216 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29c3031-adeb-49db-915d-b1a96b66ec67 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:21:51.240535 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc5aaea-7d4d-4274-9649-47b6528ead76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:21:51.241511 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc5aaea-7d4d-4274-9649-47b6528ead76 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:21:51.241946 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc5aaea-7d4d-4274-9649-47b6528ead76 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:21:51.242347 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc5aaea-7d4d-4274-9649-47b6528ead76 admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:21:51.243201 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc5aaea-7d4d-4274-9649-47b6528ead76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:21:51.245265 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc5aaea-7d4d-4274-9649-47b6528ead76 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:21:51.294838 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1645/3282] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:21:51 2022] POST /identity/v3/users => generated 290 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:21:51.299834 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fe4ab0-7f68-4542-b64d-9e4b54ccdc24 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:21:51.310987 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fe4ab0-7f68-4542-b64d-9e4b54ccdc24 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:21:51.328259 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d582fa04-b71e-4c43-8b50-2a7885cba078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:21:51.329840 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d582fa04-b71e-4c43-8b50-2a7885cba078 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:21:51.330240 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d582fa04-b71e-4c43-8b50-2a7885cba078 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:21:51.330701 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d582fa04-b71e-4c43-8b50-2a7885cba078 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:21:51.331622 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d582fa04-b71e-4c43-8b50-2a7885cba078 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:21:51.333413 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d582fa04-b71e-4c43-8b50-2a7885cba078 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:21:51.370498 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1638/3283] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:21:51 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:21:51.375074 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc5aaea-7d4d-4274-9649-47b6528ead76 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:21:51.390208 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc5aaea-7d4d-4274-9649-47b6528ead76 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:21:51.407988 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364b5bb2-cc15-4ad1-8386-35b0139f9bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:21:51.408915 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364b5bb2-cc15-4ad1-8386-35b0139f9bda admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:21:51.409354 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364b5bb2-cc15-4ad1-8386-35b0139f9bda admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:21:51.409753 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364b5bb2-cc15-4ad1-8386-35b0139f9bda admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:21:51.410648 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364b5bb2-cc15-4ad1-8386-35b0139f9bda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:21:51.412454 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364b5bb2-cc15-4ad1-8386-35b0139f9bda admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:21:51.444394 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d582fa04-b71e-4c43-8b50-2a7885cba078 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:21:51.451809 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1646/3284] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:21:51 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:21:51.456505 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d582fa04-b71e-4c43-8b50-2a7885cba078 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:21:51.473218 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0483a584-89e3-4583-800e-dd1f73d564c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:21:51.474460 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0483a584-89e3-4583-800e-dd1f73d564c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:21:51.475751 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0483a584-89e3-4583-800e-dd1f73d564c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:21:51.478772 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0483a584-89e3-4583-800e-dd1f73d564c1 admin admin] PATH_INFO: `/v3/projects/e3f61ae886a045ea8945fbce95462a4f/users/926cc49701df4b78b253bfaf4ebc0916/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:21:51.510774 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:21:51.519267 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0483a584-89e3-4583-800e-dd1f73d564c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3f61ae886a045ea8945fbce95462a4f, user_id=926cc49701df4b78b253bfaf4ebc0916, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:21:51.524849 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0483a584-89e3-4583-800e-dd1f73d564c1 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:21:51.585708 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1639/3285] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:21:51 2022] PUT /identity/v3/projects/e3f61ae886a045ea8945fbce95462a4f/users/926cc49701df4b78b253bfaf4ebc0916/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:21:51.596067 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0425fc11-685a-40f0-9f0d-fb1449308516 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:21:51.596988 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0425fc11-685a-40f0-9f0d-fb1449308516 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:21:51.597448 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0425fc11-685a-40f0-9f0d-fb1449308516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:21:51.648958 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-0425fc11-685a-40f0-9f0d-fb1449308516 None None] MFA Rules not processed for user `926cc49701df4b78b253bfaf4ebc0916`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:21:51.650979 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-0425fc11-685a-40f0-9f0d-fb1449308516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:21:51.795692 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1647/3286] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:21:51 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:21:52.189842 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0483a584-89e3-4583-800e-dd1f73d564c1 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:21:52.200116 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-0483a584-89e3-4583-800e-dd1f73d564c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:21:52.510327 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0483a584-89e3-4583-800e-dd1f73d564c1 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:21:52.527316 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ba9670-b205-455c-9092-fc105e30b767 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:21:52.528009 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ba9670-b205-455c-9092-fc105e30b767 service nova] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:21:52.528312 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ba9670-b205-455c-9092-fc105e30b767 service nova] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:21:52.528579 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ba9670-b205-455c-9092-fc105e30b767 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:21:52.545335 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ba9670-b205-455c-9092-fc105e30b767 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:21:52.551896 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ba9670-b205-455c-9092-fc105e30b767 service nova] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:21:52.577038 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1640/3287] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:21:52 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:21:52.678711 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0425fc11-685a-40f0-9f0d-fb1449308516 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:21:52.774429 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0425fc11-685a-40f0-9f0d-fb1449308516 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:21:52.783876 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66032d8a-e6af-4437-9943-e5d8bdd501b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:21:52.785461 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66032d8a-e6af-4437-9943-e5d8bdd501b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:21:52.785908 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66032d8a-e6af-4437-9943-e5d8bdd501b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:21:52.786189 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66032d8a-e6af-4437-9943-e5d8bdd501b9 admin admin] PATH_INFO: `/v3/users/926cc49701df4b78b253bfaf4ebc0916` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:21:52.787508 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66032d8a-e6af-4437-9943-e5d8bdd501b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=926cc49701df4b78b253bfaf4ebc0916)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:21:52.790948 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66032d8a-e6af-4437-9943-e5d8bdd501b9 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:21:52.832064 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:21:52.949214 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-66032d8a-e6af-4437-9943-e5d8bdd501b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '926cc49701df4b78b253bfaf4ebc0916'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:21:52.965826 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-66032d8a-e6af-4437-9943-e5d8bdd501b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '926cc49701df4b78b253bfaf4ebc0916'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:21:53.000658 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-66032d8a-e6af-4437-9943-e5d8bdd501b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '926cc49701df4b78b253bfaf4ebc0916'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:21:53.026516 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-66032d8a-e6af-4437-9943-e5d8bdd501b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '926cc49701df4b78b253bfaf4ebc0916'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:21:53.059220 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-66032d8a-e6af-4437-9943-e5d8bdd501b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '926cc49701df4b78b253bfaf4ebc0916'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:21:53.073635 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1648/3288] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:21:52 2022] DELETE /identity/v3/users/926cc49701df4b78b253bfaf4ebc0916 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:21:53.078504 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d3e835-413d-4d10-87f8-2612f8b81af2 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:21:53.079165 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d3e835-413d-4d10-87f8-2612f8b81af2 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:21:53.079581 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d3e835-413d-4d10-87f8-2612f8b81af2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:21:53.104455 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-45d3e835-413d-4d10-87f8-2612f8b81af2 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:21:53.106296 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-45d3e835-413d-4d10-87f8-2612f8b81af2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:21:53.283606 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1641/3289] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:21:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:21:53.296279 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66032d8a-e6af-4437-9943-e5d8bdd501b9 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:21:53.298119 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-66032d8a-e6af-4437-9943-e5d8bdd501b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:21:53.499773 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66032d8a-e6af-4437-9943-e5d8bdd501b9 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:21:53.507086 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44a27f4-0cd7-48f6-ab31-edca09171b17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:21:53.507086 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44a27f4-0cd7-48f6-ab31-edca09171b17 service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:21:53.507086 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44a27f4-0cd7-48f6-ab31-edca09171b17 service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:21:53.521208 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44a27f4-0cd7-48f6-ab31-edca09171b17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:21:53.570704 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44a27f4-0cd7-48f6-ab31-edca09171b17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:21:53.572176 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44a27f4-0cd7-48f6-ab31-edca09171b17 service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:21:53.599437 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1649/3290] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:21:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:21:53.994399 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e12578-0b03-46a5-9583-95c794d93d3e None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:21:53.994914 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e12578-0b03-46a5-9583-95c794d93d3e None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:21:53.995193 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e12578-0b03-46a5-9583-95c794d93d3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:21:54.042544 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-25e12578-0b03-46a5-9583-95c794d93d3e None None] MFA Rules not processed for user `efc72b47672e46659b1a5ebdfd99224c`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:21:54.044006 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-25e12578-0b03-46a5-9583-95c794d93d3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:21:54.169079 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:21:54.234580 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1642/3291] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:21:53 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:21:54.895566 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44a27f4-0cd7-48f6-ab31-edca09171b17 service neutron] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:21:54.898555 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-e44a27f4-0cd7-48f6-ab31-edca09171b17 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:21:55.098908 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44a27f4-0cd7-48f6-ab31-edca09171b17 service neutron] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:21:55.128351 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e69a39-d198-40be-a3db-e87ee2d384c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:21:55.129055 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e69a39-d198-40be-a3db-e87ee2d384c3 service nova] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:21:55.129336 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e69a39-d198-40be-a3db-e87ee2d384c3 service nova] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:21:55.129610 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e69a39-d198-40be-a3db-e87ee2d384c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:21:55.151432 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e69a39-d198-40be-a3db-e87ee2d384c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:21:55.153179 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e69a39-d198-40be-a3db-e87ee2d384c3 service nova] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:21:55.177786 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1650/3292] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:21:54 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:21:55.392596 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e12578-0b03-46a5-9583-95c794d93d3e None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:21:55.394651 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-25e12578-0b03-46a5-9583-95c794d93d3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:21:55.420932 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e12578-0b03-46a5-9583-95c794d93d3e None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:21:55.430216 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501f187e-11a9-4df2-bad4-340195433c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:21:55.431486 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501f187e-11a9-4df2-bad4-340195433c16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:21:55.432734 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501f187e-11a9-4df2-bad4-340195433c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:21:55.434231 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501f187e-11a9-4df2-bad4-340195433c16 admin admin] PATH_INFO: `/v3/projects/e3f61ae886a045ea8945fbce95462a4f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:21:55.437995 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501f187e-11a9-4df2-bad4-340195433c16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3f61ae886a045ea8945fbce95462a4f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:21:55.440464 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501f187e-11a9-4df2-bad4-340195433c16 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:21:55.551049 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-501f187e-11a9-4df2-bad4-340195433c16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3f61ae886a045ea8945fbce95462a4f', 'request_id': 'req-501f187e-11a9-4df2-bad4-340195433c16'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:21:55.577280 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-501f187e-11a9-4df2-bad4-340195433c16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3f61ae886a045ea8945fbce95462a4f', 'request_id': 'req-501f187e-11a9-4df2-bad4-340195433c16'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:21:55.597372 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-501f187e-11a9-4df2-bad4-340195433c16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3f61ae886a045ea8945fbce95462a4f', 'request_id': 'req-501f187e-11a9-4df2-bad4-340195433c16'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:21:55.619548 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-501f187e-11a9-4df2-bad4-340195433c16 admin admin] The token cache is being invalidate because project e3f61ae886a045ea8945fbce95462a4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:21:55.620005 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-501f187e-11a9-4df2-bad4-340195433c16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:21:55.620852 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-501f187e-11a9-4df2-bad4-340195433c16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:21:55.629514 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1643/3293] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:21:55 2022] DELETE /identity/v3/projects/e3f61ae886a045ea8945fbce95462a4f => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:21:55.630672 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb206690-0f1c-4a56-88c5-2bc46915575d None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:21:55.631012 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb206690-0f1c-4a56-88c5-2bc46915575d None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:21:55.631331 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb206690-0f1c-4a56-88c5-2bc46915575d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:21:55.691263 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-bb206690-0f1c-4a56-88c5-2bc46915575d None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:21:55.692031 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-bb206690-0f1c-4a56-88c5-2bc46915575d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:21:55.734736 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:21:55.855861 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1651/3294] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:21:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:21:55.864263 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02716827-f03d-4cd0-b30b-930ca6b90b8c None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:21:55.864582 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02716827-f03d-4cd0-b30b-930ca6b90b8c None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:21:55.864814 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02716827-f03d-4cd0-b30b-930ca6b90b8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:21:55.904921 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-02716827-f03d-4cd0-b30b-930ca6b90b8c None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:21:55.907870 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-02716827-f03d-4cd0-b30b-930ca6b90b8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:21:55.941518 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1644/3295] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:21:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:21:55.942967 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb206690-0f1c-4a56-88c5-2bc46915575d None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:21:55.963209 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb206690-0f1c-4a56-88c5-2bc46915575d None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:21:55.976687 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdea205d-862d-4d2b-91b0-64cd07a4e4ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:21:55.978138 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdea205d-862d-4d2b-91b0-64cd07a4e4ce admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:21:55.978138 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdea205d-862d-4d2b-91b0-64cd07a4e4ce admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:21:55.978800 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdea205d-862d-4d2b-91b0-64cd07a4e4ce admin admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:21:55.990401 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdea205d-862d-4d2b-91b0-64cd07a4e4ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:21:55.990914 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdea205d-862d-4d2b-91b0-64cd07a4e4ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:21:55.993685 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdea205d-862d-4d2b-91b0-64cd07a4e4ce admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:21:56.035739 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1652/3296] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:21:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:21:56.037078 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02716827-f03d-4cd0-b30b-930ca6b90b8c None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:21:56.056544 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02716827-f03d-4cd0-b30b-930ca6b90b8c None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:21:56.062992 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5135b626-9636-4f40-8cc6-83c7b93b2a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:21:56.064013 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5135b626-9636-4f40-8cc6-83c7b93b2a7f admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:21:56.066535 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5135b626-9636-4f40-8cc6-83c7b93b2a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:21:56.066747 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5135b626-9636-4f40-8cc6-83c7b93b2a7f admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:21:56.067765 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5135b626-9636-4f40-8cc6-83c7b93b2a7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:21:56.071147 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5135b626-9636-4f40-8cc6-83c7b93b2a7f admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:21:56.153769 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1645/3297] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:21:56 2022] POST /identity/v3/projects => generated 385 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:21:56.158544 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdea205d-862d-4d2b-91b0-64cd07a4e4ce admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:21:56.181300 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdea205d-862d-4d2b-91b0-64cd07a4e4ce admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:21:56.382792 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4871f3fb-393e-4155-bd10-b5293ae2022b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:21:56.384215 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4871f3fb-393e-4155-bd10-b5293ae2022b admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:21:56.384499 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4871f3fb-393e-4155-bd10-b5293ae2022b admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:21:56.384776 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4871f3fb-393e-4155-bd10-b5293ae2022b admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:21:56.385974 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4871f3fb-393e-4155-bd10-b5293ae2022b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:21:56.389002 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4871f3fb-393e-4155-bd10-b5293ae2022b admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:21:56.448957 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1653/3298] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:21:56 2022] POST /identity/v3/users => generated 293 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:21:56.453075 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5135b626-9636-4f40-8cc6-83c7b93b2a7f admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:21:56.465514 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5135b626-9636-4f40-8cc6-83c7b93b2a7f admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:21:56.483889 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83fdbca-828b-43bc-bd5b-433c44ecd1a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:21:56.485256 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83fdbca-828b-43bc-bd5b-433c44ecd1a3 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:21:56.485676 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83fdbca-828b-43bc-bd5b-433c44ecd1a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:21:56.486227 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83fdbca-828b-43bc-bd5b-433c44ecd1a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:21:56.487111 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83fdbca-828b-43bc-bd5b-433c44ecd1a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:21:56.490562 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83fdbca-828b-43bc-bd5b-433c44ecd1a3 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:21:56.545028 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1646/3299] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:21:56 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:21:56.546370 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4871f3fb-393e-4155-bd10-b5293ae2022b admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:21:56.566542 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4871f3fb-393e-4155-bd10-b5293ae2022b admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:21:56.580194 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0d36a6-d2e4-4ba7-97d2-7da8a5bdddd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:21:56.582417 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0d36a6-d2e4-4ba7-97d2-7da8a5bdddd5 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:21:56.582717 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0d36a6-d2e4-4ba7-97d2-7da8a5bdddd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:21:56.583000 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0d36a6-d2e4-4ba7-97d2-7da8a5bdddd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:21:56.583754 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0d36a6-d2e4-4ba7-97d2-7da8a5bdddd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:21:56.587551 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0d36a6-d2e4-4ba7-97d2-7da8a5bdddd5 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:21:56.638241 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83fdbca-828b-43bc-bd5b-433c44ecd1a3 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:21:56.652813 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83fdbca-828b-43bc-bd5b-433c44ecd1a3 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:21:56.654969 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1654/3300] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:21:56 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:21:56.670816 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd27361-0f41-4c5d-9858-7c7adf26d74a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:21:56.672197 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd27361-0f41-4c5d-9858-7c7adf26d74a admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:21:56.672475 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd27361-0f41-4c5d-9858-7c7adf26d74a admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:21:56.672749 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd27361-0f41-4c5d-9858-7c7adf26d74a admin admin] PATH_INFO: `/v3/projects/ab066f574cfe4405bf9ed948b81c8f24/users/ba49c745133b44f99ee9a7e4aa86dd54/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:21:56.735698 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd27361-0f41-4c5d-9858-7c7adf26d74a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab066f574cfe4405bf9ed948b81c8f24, user_id=ba49c745133b44f99ee9a7e4aa86dd54, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:21:56.750955 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd27361-0f41-4c5d-9858-7c7adf26d74a admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:21:56.804031 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1647/3301] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:21:56 2022] PUT /identity/v3/projects/ab066f574cfe4405bf9ed948b81c8f24/users/ba49c745133b44f99ee9a7e4aa86dd54/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:21:56.809116 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c273bc2-6918-4fee-85ad-7f9a0dae73e1 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:21:56.809398 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c273bc2-6918-4fee-85ad-7f9a0dae73e1 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:21:56.809683 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c273bc2-6918-4fee-85ad-7f9a0dae73e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:21:56.893416 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-1c273bc2-6918-4fee-85ad-7f9a0dae73e1 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:21:56.900852 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-1c273bc2-6918-4fee-85ad-7f9a0dae73e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:21:57.101311 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1655/3302] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:21:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:21:57.115435 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd27361-0f41-4c5d-9858-7c7adf26d74a admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:21:57.118990 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-edd27361-0f41-4c5d-9858-7c7adf26d74a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:21:57.382511 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd27361-0f41-4c5d-9858-7c7adf26d74a admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:21:57.396612 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1217b72c-0722-4547-9f54-794595e83d86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:21:57.397926 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1217b72c-0722-4547-9f54-794595e83d86 service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:21:57.398425 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1217b72c-0722-4547-9f54-794595e83d86 service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:21:57.398844 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1217b72c-0722-4547-9f54-794595e83d86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:21:57.436430 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1217b72c-0722-4547-9f54-794595e83d86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:21:57.454762 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1217b72c-0722-4547-9f54-794595e83d86 service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:21:57.498447 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1648/3303] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:21:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:21:59.001223 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a76d5e-00ce-43d5-afc0-7f5ebfbf7d0a None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:21:59.001701 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a76d5e-00ce-43d5-afc0-7f5ebfbf7d0a None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:21:59.001791 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a76d5e-00ce-43d5-afc0-7f5ebfbf7d0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:21:59.039347 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-78a76d5e-00ce-43d5-afc0-7f5ebfbf7d0a None None] MFA Rules not processed for user `efc72b47672e46659b1a5ebdfd99224c`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:21:59.040622 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-78a76d5e-00ce-43d5-afc0-7f5ebfbf7d0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:21:59.113463 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:21:59.215752 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1656/3304] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:21:58 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:22:01.159089 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a2436a-f11b-4b2a-90c8-0e171232e0f7 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:22:01.159648 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a2436a-f11b-4b2a-90c8-0e171232e0f7 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:22:01.160025 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a2436a-f11b-4b2a-90c8-0e171232e0f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:22:01.167471 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:22:01.196997 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-d4a2436a-f11b-4b2a-90c8-0e171232e0f7 None None] MFA Rules not processed for user `17b779a3e21a415bb42cde5d6863d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:22:01.198856 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-d4a2436a-f11b-4b2a-90c8-0e171232e0f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:22:01.367847 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1649/3305] 10.222.0.17 () {58 vars in 967 bytes} [Sat Jul 23 21:22:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:22:01.397693 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a76d5e-00ce-43d5-afc0-7f5ebfbf7d0a None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:22:01.399259 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-78a76d5e-00ce-43d5-afc0-7f5ebfbf7d0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:22:01.519011 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a76d5e-00ce-43d5-afc0-7f5ebfbf7d0a None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:22:01.526022 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4219a2-6d75-4360-b361-71de3147af49 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f0a685b7da46afb81024848f079d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:22:01.527277 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4219a2-6d75-4360-b361-71de3147af49 service swift] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:22:01.527654 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4219a2-6d75-4360-b361-71de3147af49 service swift] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:22:01.528019 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4219a2-6d75-4360-b361-71de3147af49 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:22:01.542267 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4219a2-6d75-4360-b361-71de3147af49 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:22:01.546395 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4219a2-6d75-4360-b361-71de3147af49 service swift] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:22:01.561766 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1657/3306] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 23 21:22:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 23 21:22:01.762043 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a2436a-f11b-4b2a-90c8-0e171232e0f7 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:22:01.763557 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-d4a2436a-f11b-4b2a-90c8-0e171232e0f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:22:01.792489 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a2436a-f11b-4b2a-90c8-0e171232e0f7 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:22:01.802868 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e49687f-0f6f-4785-b758-58b0f08b8ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:22:01.805236 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e49687f-0f6f-4785-b758-58b0f08b8ca4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:22:01.805561 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e49687f-0f6f-4785-b758-58b0f08b8ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:22:01.805795 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e49687f-0f6f-4785-b758-58b0f08b8ca4 admin admin] PATH_INFO: `/v3/users/22f9f9332aad483281c34422d83ba2fc` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:22:01.810867 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e49687f-0f6f-4785-b758-58b0f08b8ca4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=22f9f9332aad483281c34422d83ba2fc)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:22:01.814645 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e49687f-0f6f-4785-b758-58b0f08b8ca4 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:22:01.951977 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-3e49687f-0f6f-4785-b758-58b0f08b8ca4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22f9f9332aad483281c34422d83ba2fc'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:22:01.961232 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-3e49687f-0f6f-4785-b758-58b0f08b8ca4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22f9f9332aad483281c34422d83ba2fc'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:22:01.962344 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-3e49687f-0f6f-4785-b758-58b0f08b8ca4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22f9f9332aad483281c34422d83ba2fc'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:22:01.984167 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-3e49687f-0f6f-4785-b758-58b0f08b8ca4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22f9f9332aad483281c34422d83ba2fc'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:22:02.014053 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-3e49687f-0f6f-4785-b758-58b0f08b8ca4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22f9f9332aad483281c34422d83ba2fc'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:22:02.025355 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1650/3307] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:22:01 2022] DELETE /identity/v3/users/22f9f9332aad483281c34422d83ba2fc => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:22:02.031146 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cea541-3a30-4695-ae17-711522395248 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:22:02.034215 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cea541-3a30-4695-ae17-711522395248 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:22:02.034925 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cea541-3a30-4695-ae17-711522395248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:22:02.067681 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-10cea541-3a30-4695-ae17-711522395248 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:22:02.069265 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-10cea541-3a30-4695-ae17-711522395248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:22:02.179667 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1658/3308] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:22:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:22:02.201423 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e49687f-0f6f-4785-b758-58b0f08b8ca4 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:22:02.203273 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-3e49687f-0f6f-4785-b758-58b0f08b8ca4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:22:02.312774 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e49687f-0f6f-4785-b758-58b0f08b8ca4 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:22:02.317680 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73cfb81-f4d2-4b1a-a782-9d0091a57eba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:22:02.318691 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73cfb81-f4d2-4b1a-a782-9d0091a57eba service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:22:02.319177 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73cfb81-f4d2-4b1a-a782-9d0091a57eba service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:22:02.319733 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73cfb81-f4d2-4b1a-a782-9d0091a57eba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:22:02.332557 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73cfb81-f4d2-4b1a-a782-9d0091a57eba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:22:02.334517 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73cfb81-f4d2-4b1a-a782-9d0091a57eba service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:22:02.349239 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1651/3309] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:22:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:22:02.867446 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cea541-3a30-4695-ae17-711522395248 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:22:02.869741 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-10cea541-3a30-4695-ae17-711522395248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:22:02.883812 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cea541-3a30-4695-ae17-711522395248 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:22:02.892692 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efa6371-baa1-4587-a113-a7dcfd3dbb12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:22:02.893753 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efa6371-baa1-4587-a113-a7dcfd3dbb12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:22:02.894200 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efa6371-baa1-4587-a113-a7dcfd3dbb12 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:22:02.894610 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efa6371-baa1-4587-a113-a7dcfd3dbb12 admin admin] PATH_INFO: `/v3/projects/fa88d37bfb314835bd592d638db11360` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:22:02.906750 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efa6371-baa1-4587-a113-a7dcfd3dbb12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa88d37bfb314835bd592d638db11360)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:22:02.911142 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efa6371-baa1-4587-a113-a7dcfd3dbb12 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:22:03.000720 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-7efa6371-baa1-4587-a113-a7dcfd3dbb12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa88d37bfb314835bd592d638db11360', 'request_id': 'req-7efa6371-baa1-4587-a113-a7dcfd3dbb12'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:22:03.007467 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:22:03.015057 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-7efa6371-baa1-4587-a113-a7dcfd3dbb12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa88d37bfb314835bd592d638db11360', 'request_id': 'req-7efa6371-baa1-4587-a113-a7dcfd3dbb12'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:22:03.031960 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-7efa6371-baa1-4587-a113-a7dcfd3dbb12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa88d37bfb314835bd592d638db11360', 'request_id': 'req-7efa6371-baa1-4587-a113-a7dcfd3dbb12'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:22:03.065815 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-7efa6371-baa1-4587-a113-a7dcfd3dbb12 admin admin] The token cache is being invalidate because project fa88d37bfb314835bd592d638db11360 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:22:03.066445 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-7efa6371-baa1-4587-a113-a7dcfd3dbb12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:22:03.067978 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-7efa6371-baa1-4587-a113-a7dcfd3dbb12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:22:03.070391 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1659/3310] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:22:02 2022] DELETE /identity/v3/projects/fa88d37bfb314835bd592d638db11360 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:22:03.076260 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6e8e1c-d6cd-40c3-9328-c7d64db4d26e None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:22:03.076548 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6e8e1c-d6cd-40c3-9328-c7d64db4d26e None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:22:03.076828 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6e8e1c-d6cd-40c3-9328-c7d64db4d26e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:22:03.105418 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-4d6e8e1c-d6cd-40c3-9328-c7d64db4d26e None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:22:03.107272 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-4d6e8e1c-d6cd-40c3-9328-c7d64db4d26e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:22:03.135392 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:22:03.282515 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1652/3311] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:22:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:22:03.283166 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3bad57-fdb3-4110-afe3-f6247d4ee1f5 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:22:03.283468 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3bad57-fdb3-4110-afe3-f6247d4ee1f5 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:22:03.283746 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3bad57-fdb3-4110-afe3-f6247d4ee1f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:22:03.330206 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-3d3bad57-fdb3-4110-afe3-f6247d4ee1f5 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:22:03.333001 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-3d3bad57-fdb3-4110-afe3-f6247d4ee1f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:22:03.354524 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1660/3312] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:22:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:22:03.359003 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6e8e1c-d6cd-40c3-9328-c7d64db4d26e None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:22:03.376816 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6e8e1c-d6cd-40c3-9328-c7d64db4d26e None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:22:03.384220 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27e58f0-a937-45c9-9bd8-92d3dc63a940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:22:03.385144 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27e58f0-a937-45c9-9bd8-92d3dc63a940 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:22:03.385804 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27e58f0-a937-45c9-9bd8-92d3dc63a940 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:22:03.386328 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27e58f0-a937-45c9-9bd8-92d3dc63a940 admin admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:22:03.388497 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27e58f0-a937-45c9-9bd8-92d3dc63a940 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:22:03.388962 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27e58f0-a937-45c9-9bd8-92d3dc63a940 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:22:03.391022 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27e58f0-a937-45c9-9bd8-92d3dc63a940 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:22:03.414619 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3bad57-fdb3-4110-afe3-f6247d4ee1f5 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:22:03.417750 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1653/3313] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:22:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:22:03.426712 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3bad57-fdb3-4110-afe3-f6247d4ee1f5 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:22:03.432654 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def8fd3d-25dc-429d-b5e5-bc0761fc2144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:22:03.434052 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def8fd3d-25dc-429d-b5e5-bc0761fc2144 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:22:03.434392 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def8fd3d-25dc-429d-b5e5-bc0761fc2144 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:22:03.434663 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def8fd3d-25dc-429d-b5e5-bc0761fc2144 admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:22:03.435627 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def8fd3d-25dc-429d-b5e5-bc0761fc2144 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:22:03.439103 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def8fd3d-25dc-429d-b5e5-bc0761fc2144 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:22:03.486623 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1661/3314] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:22:03 2022] POST /identity/v3/projects => generated 393 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:22:03.492858 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27e58f0-a937-45c9-9bd8-92d3dc63a940 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:22:03.507903 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27e58f0-a937-45c9-9bd8-92d3dc63a940 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:22:03.593286 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bb56a1-4ed9-41b6-bf47-f4d14b44dd22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:22:03.598913 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bb56a1-4ed9-41b6-bf47-f4d14b44dd22 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:22:03.600172 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bb56a1-4ed9-41b6-bf47-f4d14b44dd22 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:22:03.600511 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bb56a1-4ed9-41b6-bf47-f4d14b44dd22 admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:22:03.601230 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bb56a1-4ed9-41b6-bf47-f4d14b44dd22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:22:03.603631 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bb56a1-4ed9-41b6-bf47-f4d14b44dd22 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:22:03.650400 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1654/3315] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:22:03 2022] POST /identity/v3/users => generated 297 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:22:03.650722 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def8fd3d-25dc-429d-b5e5-bc0761fc2144 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:22:03.665815 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def8fd3d-25dc-429d-b5e5-bc0761fc2144 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:22:03.690230 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedb2aff-f148-4315-9ba4-9040641ecf66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:22:03.691020 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedb2aff-f148-4315-9ba4-9040641ecf66 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:22:03.691352 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedb2aff-f148-4315-9ba4-9040641ecf66 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:22:03.691712 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedb2aff-f148-4315-9ba4-9040641ecf66 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:22:03.692730 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedb2aff-f148-4315-9ba4-9040641ecf66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:22:03.694182 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedb2aff-f148-4315-9ba4-9040641ecf66 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:22:03.711400 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1662/3316] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:22:03 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 21:22:03.715199 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bb56a1-4ed9-41b6-bf47-f4d14b44dd22 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:22:03.728696 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bb56a1-4ed9-41b6-bf47-f4d14b44dd22 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:22:03.734977 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cf3c6a-e428-41ad-8692-b206c52c100e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:22:03.736162 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cf3c6a-e428-41ad-8692-b206c52c100e admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:22:03.737456 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cf3c6a-e428-41ad-8692-b206c52c100e admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:22:03.737976 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cf3c6a-e428-41ad-8692-b206c52c100e admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:22:03.738936 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cf3c6a-e428-41ad-8692-b206c52c100e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:22:03.740780 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cf3c6a-e428-41ad-8692-b206c52c100e admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:22:03.753924 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1655/3317] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:22:03 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:22:03.757769 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedb2aff-f148-4315-9ba4-9040641ecf66 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:22:03.768952 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedb2aff-f148-4315-9ba4-9040641ecf66 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:22:03.775286 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e0a36c-125c-4366-943e-cfc807a1ea95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:22:03.777003 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e0a36c-125c-4366-943e-cfc807a1ea95 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:22:03.777208 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e0a36c-125c-4366-943e-cfc807a1ea95 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:22:03.777451 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e0a36c-125c-4366-943e-cfc807a1ea95 admin admin] PATH_INFO: `/v3/projects/1a6595adf7174855bf5dc685b2f3236d/users/26d47a6490ce4b078919f59d93d47188/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:22:03.797067 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e0a36c-125c-4366-943e-cfc807a1ea95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a6595adf7174855bf5dc685b2f3236d, user_id=26d47a6490ce4b078919f59d93d47188, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:22:03.802068 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e0a36c-125c-4366-943e-cfc807a1ea95 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:22:03.835183 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1663/3318] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:22:03 2022] PUT /identity/v3/projects/1a6595adf7174855bf5dc685b2f3236d/users/26d47a6490ce4b078919f59d93d47188/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:22:03.837094 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b020443-a832-4a4d-9d48-80a382e54526 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:22:03.837473 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b020443-a832-4a4d-9d48-80a382e54526 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:22:03.838012 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b020443-a832-4a4d-9d48-80a382e54526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:22:03.908717 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-8b020443-a832-4a4d-9d48-80a382e54526 None None] MFA Rules not processed for user `26d47a6490ce4b078919f59d93d47188`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:22:03.911335 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-8b020443-a832-4a4d-9d48-80a382e54526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:22:04.024247 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1656/3319] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:22:03 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:22:04.037092 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e0a36c-125c-4366-943e-cfc807a1ea95 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:22:04.039625 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-b9e0a36c-125c-4366-943e-cfc807a1ea95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:22:04.154150 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e0a36c-125c-4366-943e-cfc807a1ea95 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:22:04.163148 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f5dc34-534e-47c0-ab95-25057245eaf3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:22:04.163752 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f5dc34-534e-47c0-ab95-25057245eaf3 service nova] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:22:04.164106 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f5dc34-534e-47c0-ab95-25057245eaf3 service nova] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:22:04.164490 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f5dc34-534e-47c0-ab95-25057245eaf3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:22:04.177925 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f5dc34-534e-47c0-ab95-25057245eaf3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:22:04.177925 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f5dc34-534e-47c0-ab95-25057245eaf3 service nova] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:22:04.189253 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1664/3320] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:22:04 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:22:05.955875 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b020443-a832-4a4d-9d48-80a382e54526 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:22:05.993796 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b020443-a832-4a4d-9d48-80a382e54526 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:22:06.000915 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fc216f-2d71-42da-8189-cfe3813d2b44 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:22:06.001683 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fc216f-2d71-42da-8189-cfe3813d2b44 service nova] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:22:06.002033 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fc216f-2d71-42da-8189-cfe3813d2b44 service nova] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:22:06.002306 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fc216f-2d71-42da-8189-cfe3813d2b44 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:22:06.004409 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-92fc216f-2d71-42da-8189-cfe3813d2b44 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:22:06.042344 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:22:06.157238 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fc216f-2d71-42da-8189-cfe3813d2b44 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:22:06.159560 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fc216f-2d71-42da-8189-cfe3813d2b44 service nova] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:22:06.190743 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1657/3321] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:22:05 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:22:06.320146 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5115662e-cbb1-4619-a277-1bf47cf34a6e None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:22:06.320704 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5115662e-cbb1-4619-a277-1bf47cf34a6e None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:22:06.320920 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5115662e-cbb1-4619-a277-1bf47cf34a6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:22:06.353428 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-5115662e-cbb1-4619-a277-1bf47cf34a6e None None] MFA Rules not processed for user `c7acc7eae5f946aaac9f0c8ead2c8d58`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:22:06.354992 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-5115662e-cbb1-4619-a277-1bf47cf34a6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:22:06.500817 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1665/3322] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:22:06 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:22:08.247900 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fc216f-2d71-42da-8189-cfe3813d2b44 service nova] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:22:08.326362 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c4f900-8738-448a-adfa-c18b69394d69 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:22:08.327750 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c4f900-8738-448a-adfa-c18b69394d69 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:22:08.328176 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c4f900-8738-448a-adfa-c18b69394d69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:22:08.369500 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-08c4f900-8738-448a-adfa-c18b69394d69 None None] MFA Rules not processed for user `17b779a3e21a415bb42cde5d6863d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:22:08.371791 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-08c4f900-8738-448a-adfa-c18b69394d69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:22:08.378834 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:22:08.488530 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1666/3323] 10.222.0.17 () {58 vars in 1009 bytes} [Sat Jul 23 21:22:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:22:08.500332 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c4f900-8738-448a-adfa-c18b69394d69 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:22:08.502546 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-08c4f900-8738-448a-adfa-c18b69394d69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:22:08.510651 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fc216f-2d71-42da-8189-cfe3813d2b44 service nova] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:22:08.531698 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8029dcae-21f0-42fb-9e96-bbc00a2f30a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:22:08.533054 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8029dcae-21f0-42fb-9e96-bbc00a2f30a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:22:08.533474 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8029dcae-21f0-42fb-9e96-bbc00a2f30a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:22:08.534093 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8029dcae-21f0-42fb-9e96-bbc00a2f30a5 admin admin] PATH_INFO: `/v3/users/26d47a6490ce4b078919f59d93d47188` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:22:08.535717 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8029dcae-21f0-42fb-9e96-bbc00a2f30a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26d47a6490ce4b078919f59d93d47188)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:22:08.538253 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8029dcae-21f0-42fb-9e96-bbc00a2f30a5 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:22:08.647083 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-8029dcae-21f0-42fb-9e96-bbc00a2f30a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26d47a6490ce4b078919f59d93d47188'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:22:08.668035 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-8029dcae-21f0-42fb-9e96-bbc00a2f30a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26d47a6490ce4b078919f59d93d47188'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:22:08.670607 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-8029dcae-21f0-42fb-9e96-bbc00a2f30a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26d47a6490ce4b078919f59d93d47188'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:22:08.671673 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c4f900-8738-448a-adfa-c18b69394d69 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:22:08.687070 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a437b5b-8fde-498e-af02-7bf73519d146 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f0a685b7da46afb81024848f079d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:22:08.690519 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a437b5b-8fde-498e-af02-7bf73519d146 service swift] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:22:08.690650 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a437b5b-8fde-498e-af02-7bf73519d146 service swift] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:22:08.690859 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a437b5b-8fde-498e-af02-7bf73519d146 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:22:08.693886 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-8029dcae-21f0-42fb-9e96-bbc00a2f30a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26d47a6490ce4b078919f59d93d47188'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:22:08.714227 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a437b5b-8fde-498e-af02-7bf73519d146 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:22:08.718337 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a437b5b-8fde-498e-af02-7bf73519d146 service swift] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:22:08.726580 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-8029dcae-21f0-42fb-9e96-bbc00a2f30a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26d47a6490ce4b078919f59d93d47188'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:22:08.734197 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1667/3324] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 23 21:22:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 23 21:22:08.750937 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1658/3325] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:22:08 2022] DELETE /identity/v3/users/26d47a6490ce4b078919f59d93d47188 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:22:08.760419 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f951dfc1-643d-4f70-bc4b-94045c01e03b None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:22:08.761477 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f951dfc1-643d-4f70-bc4b-94045c01e03b None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:22:08.762418 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f951dfc1-643d-4f70-bc4b-94045c01e03b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:22:08.835951 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-f951dfc1-643d-4f70-bc4b-94045c01e03b None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:22:08.838021 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-f951dfc1-643d-4f70-bc4b-94045c01e03b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:22:08.953397 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1668/3326] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:22:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:22:08.983252 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8029dcae-21f0-42fb-9e96-bbc00a2f30a5 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:22:08.985815 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-8029dcae-21f0-42fb-9e96-bbc00a2f30a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:22:09.099611 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:22:09.169737 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8029dcae-21f0-42fb-9e96-bbc00a2f30a5 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:22:09.174252 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93facb41-31b3-4b92-a772-b574f03d6208 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:22:09.174923 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93facb41-31b3-4b92-a772-b574f03d6208 service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:22:09.175212 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93facb41-31b3-4b92-a772-b574f03d6208 service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:22:09.175486 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93facb41-31b3-4b92-a772-b574f03d6208 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:22:09.190929 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93facb41-31b3-4b92-a772-b574f03d6208 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:22:09.193367 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93facb41-31b3-4b92-a772-b574f03d6208 service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:22:09.205897 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1659/3327] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:22:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:22:09.663561 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f951dfc1-643d-4f70-bc4b-94045c01e03b None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:22:09.666145 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-f951dfc1-643d-4f70-bc4b-94045c01e03b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:22:09.859537 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:22:09.960717 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f951dfc1-643d-4f70-bc4b-94045c01e03b None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:22:09.968979 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2d3bfe-3a47-4dc6-9892-202a040366ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:22:09.970211 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2d3bfe-3a47-4dc6-9892-202a040366ce service nova] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:22:09.970600 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2d3bfe-3a47-4dc6-9892-202a040366ce service nova] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:22:09.971059 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2d3bfe-3a47-4dc6-9892-202a040366ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:22:09.975617 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-5e2d3bfe-3a47-4dc6-9892-202a040366ce service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:22:10.133098 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2d3bfe-3a47-4dc6-9892-202a040366ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:22:10.144271 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2d3bfe-3a47-4dc6-9892-202a040366ce service nova] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:22:10.225635 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1669/3328] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:22:09 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 565 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:22:10.301511 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93facb41-31b3-4b92-a772-b574f03d6208 service neutron] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:22:10.303891 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-93facb41-31b3-4b92-a772-b574f03d6208 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:22:10.345332 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93facb41-31b3-4b92-a772-b574f03d6208 service neutron] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:22:10.373088 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255e2cff-9a4e-4e0f-a400-7e09561d5a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:22:10.380245 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255e2cff-9a4e-4e0f-a400-7e09561d5a1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:22:10.384695 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255e2cff-9a4e-4e0f-a400-7e09561d5a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:22:10.385091 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255e2cff-9a4e-4e0f-a400-7e09561d5a1d admin admin] PATH_INFO: `/v3/projects/1a6595adf7174855bf5dc685b2f3236d` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:22:10.388913 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255e2cff-9a4e-4e0f-a400-7e09561d5a1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a6595adf7174855bf5dc685b2f3236d)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:22:10.391840 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255e2cff-9a4e-4e0f-a400-7e09561d5a1d admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:22:10.511183 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-255e2cff-9a4e-4e0f-a400-7e09561d5a1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a6595adf7174855bf5dc685b2f3236d', 'request_id': 'req-255e2cff-9a4e-4e0f-a400-7e09561d5a1d'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:22:10.537425 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-255e2cff-9a4e-4e0f-a400-7e09561d5a1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a6595adf7174855bf5dc685b2f3236d', 'request_id': 'req-255e2cff-9a4e-4e0f-a400-7e09561d5a1d'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:22:10.544462 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-255e2cff-9a4e-4e0f-a400-7e09561d5a1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a6595adf7174855bf5dc685b2f3236d', 'request_id': 'req-255e2cff-9a4e-4e0f-a400-7e09561d5a1d'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:22:10.571252 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-255e2cff-9a4e-4e0f-a400-7e09561d5a1d admin admin] The token cache is being invalidate because project 1a6595adf7174855bf5dc685b2f3236d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:22:10.571548 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-255e2cff-9a4e-4e0f-a400-7e09561d5a1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:22:10.572261 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-255e2cff-9a4e-4e0f-a400-7e09561d5a1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:22:10.574192 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1660/3329] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:22:10 2022] DELETE /identity/v3/projects/1a6595adf7174855bf5dc685b2f3236d => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:22:10.579611 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988b112a-5240-4dc6-93c5-afe7bdf2ad2a None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:22:10.579870 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988b112a-5240-4dc6-93c5-afe7bdf2ad2a None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:22:10.580096 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988b112a-5240-4dc6-93c5-afe7bdf2ad2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:22:10.653429 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-988b112a-5240-4dc6-93c5-afe7bdf2ad2a None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:22:10.654957 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-988b112a-5240-4dc6-93c5-afe7bdf2ad2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:22:10.750949 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1670/3330] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:22:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:22:10.752047 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa475868-79fb-4de9-8bf7-2a2c78eb74d6 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:22:10.752351 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa475868-79fb-4de9-8bf7-2a2c78eb74d6 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:22:10.752638 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa475868-79fb-4de9-8bf7-2a2c78eb74d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:22:10.788144 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-fa475868-79fb-4de9-8bf7-2a2c78eb74d6 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:22:10.790971 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-fa475868-79fb-4de9-8bf7-2a2c78eb74d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:22:10.833432 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1661/3331] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:22:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:22:10.841378 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988b112a-5240-4dc6-93c5-afe7bdf2ad2a None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:22:10.853448 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988b112a-5240-4dc6-93c5-afe7bdf2ad2a None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:22:10.861148 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbb5da3-7188-442a-958d-762ab5a3acc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:22:10.861956 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbb5da3-7188-442a-958d-762ab5a3acc0 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:22:10.862316 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbb5da3-7188-442a-958d-762ab5a3acc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:22:10.862594 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbb5da3-7188-442a-958d-762ab5a3acc0 admin admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:22:10.863391 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbb5da3-7188-442a-958d-762ab5a3acc0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:22:10.863703 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbb5da3-7188-442a-958d-762ab5a3acc0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:22:10.865647 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbb5da3-7188-442a-958d-762ab5a3acc0 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:22:10.888165 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1671/3332] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:22:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:22:10.889611 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa475868-79fb-4de9-8bf7-2a2c78eb74d6 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:22:10.906291 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa475868-79fb-4de9-8bf7-2a2c78eb74d6 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:22:10.924284 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485abbd6-277b-4941-a8f8-20de5a462971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:22:10.925361 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485abbd6-277b-4941-a8f8-20de5a462971 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:22:10.925604 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485abbd6-277b-4941-a8f8-20de5a462971 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:22:10.928337 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485abbd6-277b-4941-a8f8-20de5a462971 admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:22:10.929291 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485abbd6-277b-4941-a8f8-20de5a462971 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:22:10.933140 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485abbd6-277b-4941-a8f8-20de5a462971 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:22:11.000013 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1662/3333] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:22:10 2022] POST /identity/v3/projects => generated 373 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:22:11.006686 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbb5da3-7188-442a-958d-762ab5a3acc0 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:22:11.034705 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbb5da3-7188-442a-958d-762ab5a3acc0 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:22:11.233968 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb9916d-1af6-45d6-a44f-058425f6c969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:22:11.234829 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb9916d-1af6-45d6-a44f-058425f6c969 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:22:11.235198 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb9916d-1af6-45d6-a44f-058425f6c969 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:22:11.236104 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb9916d-1af6-45d6-a44f-058425f6c969 admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:22:11.239670 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb9916d-1af6-45d6-a44f-058425f6c969 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:22:11.242640 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb9916d-1af6-45d6-a44f-058425f6c969 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:22:11.266675 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:22:11.291601 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1672/3334] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:22:11 2022] POST /identity/v3/users => generated 287 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:22:11.296091 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485abbd6-277b-4941-a8f8-20de5a462971 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:22:11.310390 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485abbd6-277b-4941-a8f8-20de5a462971 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:22:11.317779 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9624d95-2965-4901-85aa-19de274fdc93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:22:11.318800 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9624d95-2965-4901-85aa-19de274fdc93 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:22:11.319276 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9624d95-2965-4901-85aa-19de274fdc93 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:22:11.319837 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9624d95-2965-4901-85aa-19de274fdc93 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:22:11.320742 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9624d95-2965-4901-85aa-19de274fdc93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:22:11.322820 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9624d95-2965-4901-85aa-19de274fdc93 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:22:11.346596 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1663/3335] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:22:11 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:22:11.347720 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb9916d-1af6-45d6-a44f-058425f6c969 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:22:11.360266 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb9916d-1af6-45d6-a44f-058425f6c969 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:22:11.366599 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b8a648-c147-4a1c-973e-7bb5bcf0c892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:22:11.367836 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b8a648-c147-4a1c-973e-7bb5bcf0c892 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:22:11.368521 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b8a648-c147-4a1c-973e-7bb5bcf0c892 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:22:11.368977 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b8a648-c147-4a1c-973e-7bb5bcf0c892 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:22:11.370020 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b8a648-c147-4a1c-973e-7bb5bcf0c892 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:22:11.375573 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b8a648-c147-4a1c-973e-7bb5bcf0c892 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:22:11.395234 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1673/3336] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:22:11 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 21:22:11.396683 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9624d95-2965-4901-85aa-19de274fdc93 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:22:11.412535 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9624d95-2965-4901-85aa-19de274fdc93 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:22:11.418886 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0500df9a-0416-4167-af6a-d35480950e1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:22:11.420201 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0500df9a-0416-4167-af6a-d35480950e1a admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:22:11.421207 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0500df9a-0416-4167-af6a-d35480950e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:22:11.421644 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0500df9a-0416-4167-af6a-d35480950e1a admin admin] PATH_INFO: `/v3/projects/578c33fc88b84bc9818faa0a1d834f8b/users/a1281358a2f644d19e46961d5ea8170c/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:22:11.445024 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0500df9a-0416-4167-af6a-d35480950e1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=578c33fc88b84bc9818faa0a1d834f8b, user_id=a1281358a2f644d19e46961d5ea8170c, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:22:11.448655 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0500df9a-0416-4167-af6a-d35480950e1a admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:22:11.500853 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d0c55b-e580-4925-9a32-095392243d53 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:22:11.500853 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d0c55b-e580-4925-9a32-095392243d53 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:22:11.500853 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d0c55b-e580-4925-9a32-095392243d53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:22:11.502189 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1664/3337] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:22:11 2022] PUT /identity/v3/projects/578c33fc88b84bc9818faa0a1d834f8b/users/a1281358a2f644d19e46961d5ea8170c/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:22:11.561228 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-49d0c55b-e580-4925-9a32-095392243d53 None None] MFA Rules not processed for user `a1281358a2f644d19e46961d5ea8170c`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:22:11.562780 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-49d0c55b-e580-4925-9a32-095392243d53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:22:11.724929 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1674/3338] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:22:11 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:22:12.289148 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0500df9a-0416-4167-af6a-d35480950e1a admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:22:12.291683 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-0500df9a-0416-4167-af6a-d35480950e1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:22:12.374957 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b3f0ae-cd66-436f-bedf-b80711ad7820 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:22:12.375776 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b3f0ae-cd66-436f-bedf-b80711ad7820 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:22:12.375776 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b3f0ae-cd66-436f-bedf-b80711ad7820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:22:12.466816 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-41b3f0ae-cd66-436f-bedf-b80711ad7820 None None] MFA Rules not processed for user `ba49c745133b44f99ee9a7e4aa86dd54`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:22:12.469179 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:22:12.473061 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-41b3f0ae-cd66-436f-bedf-b80711ad7820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:22:12.525368 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0500df9a-0416-4167-af6a-d35480950e1a admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:22:12.542045 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c71504a-dbd7-4c00-8e42-f2f26ef1b83d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:22:12.542813 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c71504a-dbd7-4c00-8e42-f2f26ef1b83d service nova] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:22:12.543092 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c71504a-dbd7-4c00-8e42-f2f26ef1b83d service nova] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:22:12.543363 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c71504a-dbd7-4c00-8e42-f2f26ef1b83d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:22:12.569046 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c71504a-dbd7-4c00-8e42-f2f26ef1b83d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:22:12.571080 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c71504a-dbd7-4c00-8e42-f2f26ef1b83d service nova] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:22:12.601305 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1665/3339] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:22:12 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:22:12.645637 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1675/3340] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:22:12 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:22:12.847462 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c71504a-dbd7-4c00-8e42-f2f26ef1b83d service nova] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:22:12.848755 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-3c71504a-dbd7-4c00-8e42-f2f26ef1b83d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:22:12.871574 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c71504a-dbd7-4c00-8e42-f2f26ef1b83d service nova] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:22:12.890080 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b9beff-00d9-4eb8-95fd-8d513535a98d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:22:12.890937 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b9beff-00d9-4eb8-95fd-8d513535a98d service nova] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:22:12.891222 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b9beff-00d9-4eb8-95fd-8d513535a98d service nova] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:22:12.891575 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b9beff-00d9-4eb8-95fd-8d513535a98d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:22:12.910251 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b9beff-00d9-4eb8-95fd-8d513535a98d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:22:12.911924 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b9beff-00d9-4eb8-95fd-8d513535a98d service nova] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:22:12.931604 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1666/3341] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:22:12 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:22:15.013531 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b3f0ae-cd66-436f-bedf-b80711ad7820 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:22:15.263889 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b3f0ae-cd66-436f-bedf-b80711ad7820 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:22:15.298195 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6722aff-73b6-45bf-b676-dc5d456abdb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:22:15.299120 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6722aff-73b6-45bf-b676-dc5d456abdb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:22:15.299473 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6722aff-73b6-45bf-b676-dc5d456abdb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:22:15.299750 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6722aff-73b6-45bf-b676-dc5d456abdb9 admin admin] PATH_INFO: `/v3/users/a1281358a2f644d19e46961d5ea8170c` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:22:15.304497 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6722aff-73b6-45bf-b676-dc5d456abdb9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1281358a2f644d19e46961d5ea8170c)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:22:15.314720 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6722aff-73b6-45bf-b676-dc5d456abdb9 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:22:15.335399 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:22:15.459143 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-e6722aff-73b6-45bf-b676-dc5d456abdb9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1281358a2f644d19e46961d5ea8170c'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:22:15.459972 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-e6722aff-73b6-45bf-b676-dc5d456abdb9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1281358a2f644d19e46961d5ea8170c'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:22:15.478372 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-e6722aff-73b6-45bf-b676-dc5d456abdb9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1281358a2f644d19e46961d5ea8170c'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:22:15.499642 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-e6722aff-73b6-45bf-b676-dc5d456abdb9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1281358a2f644d19e46961d5ea8170c'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:22:15.526428 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-e6722aff-73b6-45bf-b676-dc5d456abdb9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1281358a2f644d19e46961d5ea8170c'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:22:15.542682 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1676/3342] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:22:15 2022] DELETE /identity/v3/users/a1281358a2f644d19e46961d5ea8170c => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:22:15.550128 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f049fe-1693-4cc9-a412-a1ae1d03f1d7 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:22:15.550656 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f049fe-1693-4cc9-a412-a1ae1d03f1d7 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:22:15.550656 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f049fe-1693-4cc9-a412-a1ae1d03f1d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:22:15.596303 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-27f049fe-1693-4cc9-a412-a1ae1d03f1d7 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:22:15.610173 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-27f049fe-1693-4cc9-a412-a1ae1d03f1d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:22:15.796286 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1667/3343] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:22:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:22:15.832088 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6722aff-73b6-45bf-b676-dc5d456abdb9 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:22:15.834241 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-e6722aff-73b6-45bf-b676-dc5d456abdb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:22:16.056493 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6722aff-73b6-45bf-b676-dc5d456abdb9 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:22:16.077382 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736cb32e-dd62-4ff3-89ed-f0e53e33ed0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:22:16.078526 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736cb32e-dd62-4ff3-89ed-f0e53e33ed0c service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:22:16.078996 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736cb32e-dd62-4ff3-89ed-f0e53e33ed0c service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:22:16.079495 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736cb32e-dd62-4ff3-89ed-f0e53e33ed0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:22:16.097039 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736cb32e-dd62-4ff3-89ed-f0e53e33ed0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:22:16.099058 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736cb32e-dd62-4ff3-89ed-f0e53e33ed0c service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:22:16.131471 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1677/3344] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:22:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:22:16.595065 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049bfa44-bccd-446b-aea2-9fd7b9bd76b7 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:22:16.595641 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049bfa44-bccd-446b-aea2-9fd7b9bd76b7 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:22:16.595641 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049bfa44-bccd-446b-aea2-9fd7b9bd76b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:22:16.649002 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-049bfa44-bccd-446b-aea2-9fd7b9bd76b7 None None] MFA Rules not processed for user `ba49c745133b44f99ee9a7e4aa86dd54`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:22:16.653096 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-049bfa44-bccd-446b-aea2-9fd7b9bd76b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:22:16.860680 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1668/3345] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:22:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:22:17.081940 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736cb32e-dd62-4ff3-89ed-f0e53e33ed0c service neutron] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:22:17.086453 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-736cb32e-dd62-4ff3-89ed-f0e53e33ed0c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:22:17.129705 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736cb32e-dd62-4ff3-89ed-f0e53e33ed0c service neutron] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:22:17.154422 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffef88f-585d-447a-898e-dcfdd7185f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:22:17.158764 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffef88f-585d-447a-898e-dcfdd7185f2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:22:17.161838 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffef88f-585d-447a-898e-dcfdd7185f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:22:17.166269 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffef88f-585d-447a-898e-dcfdd7185f2c admin admin] PATH_INFO: `/v3/projects/578c33fc88b84bc9818faa0a1d834f8b` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:22:17.174230 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffef88f-585d-447a-898e-dcfdd7185f2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=578c33fc88b84bc9818faa0a1d834f8b)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:22:17.180377 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffef88f-585d-447a-898e-dcfdd7185f2c admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:22:17.323447 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-bffef88f-585d-447a-898e-dcfdd7185f2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '578c33fc88b84bc9818faa0a1d834f8b', 'request_id': 'req-bffef88f-585d-447a-898e-dcfdd7185f2c'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:22:17.347074 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-bffef88f-585d-447a-898e-dcfdd7185f2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '578c33fc88b84bc9818faa0a1d834f8b', 'request_id': 'req-bffef88f-585d-447a-898e-dcfdd7185f2c'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:22:17.357664 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-bffef88f-585d-447a-898e-dcfdd7185f2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '578c33fc88b84bc9818faa0a1d834f8b', 'request_id': 'req-bffef88f-585d-447a-898e-dcfdd7185f2c'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:22:17.386014 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-bffef88f-585d-447a-898e-dcfdd7185f2c admin admin] The token cache is being invalidate because project 578c33fc88b84bc9818faa0a1d834f8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:22:17.386318 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-bffef88f-585d-447a-898e-dcfdd7185f2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:22:17.388911 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-bffef88f-585d-447a-898e-dcfdd7185f2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:22:17.393611 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1678/3346] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:22:17 2022] DELETE /identity/v3/projects/578c33fc88b84bc9818faa0a1d834f8b => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:22:17.398872 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856121b6-7a38-4ee0-b617-709baa84f1bb None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:22:17.399187 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856121b6-7a38-4ee0-b617-709baa84f1bb None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:22:17.399519 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856121b6-7a38-4ee0-b617-709baa84f1bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:22:17.441837 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-856121b6-7a38-4ee0-b617-709baa84f1bb None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:22:17.443509 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-856121b6-7a38-4ee0-b617-709baa84f1bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:22:17.615921 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1669/3347] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:22:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:22:17.627661 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0f4f6b-7bdf-43c5-a268-1e4bc39d8e44 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:22:17.628084 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0f4f6b-7bdf-43c5-a268-1e4bc39d8e44 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:22:17.628401 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0f4f6b-7bdf-43c5-a268-1e4bc39d8e44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:22:17.721119 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:22:17.748903 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-4a0f4f6b-7bdf-43c5-a268-1e4bc39d8e44 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:22:17.751845 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-4a0f4f6b-7bdf-43c5-a268-1e4bc39d8e44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:22:17.795147 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1679/3348] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:22:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:22:17.799889 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856121b6-7a38-4ee0-b617-709baa84f1bb None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:22:17.811209 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856121b6-7a38-4ee0-b617-709baa84f1bb None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:22:17.844854 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee8d2e9-b960-4b65-9cf4-521916a1e3cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:22:17.848551 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee8d2e9-b960-4b65-9cf4-521916a1e3cb admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:22:17.852235 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee8d2e9-b960-4b65-9cf4-521916a1e3cb admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:22:17.853428 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee8d2e9-b960-4b65-9cf4-521916a1e3cb admin admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:22:17.854486 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee8d2e9-b960-4b65-9cf4-521916a1e3cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:22:17.857484 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee8d2e9-b960-4b65-9cf4-521916a1e3cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:22:17.862122 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee8d2e9-b960-4b65-9cf4-521916a1e3cb admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:22:17.892869 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:22:17.907988 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1670/3349] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:22:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 21:22:17.912889 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0f4f6b-7bdf-43c5-a268-1e4bc39d8e44 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:22:17.935819 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0f4f6b-7bdf-43c5-a268-1e4bc39d8e44 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:22:17.959084 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e28bdb-ba72-4fe2-a7dd-d29c5f0e2cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:22:17.964549 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e28bdb-ba72-4fe2-a7dd-d29c5f0e2cc9 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:22:17.967607 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e28bdb-ba72-4fe2-a7dd-d29c5f0e2cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:22:17.968876 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e28bdb-ba72-4fe2-a7dd-d29c5f0e2cc9 admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:22:17.971471 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e28bdb-ba72-4fe2-a7dd-d29c5f0e2cc9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:22:17.973610 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e28bdb-ba72-4fe2-a7dd-d29c5f0e2cc9 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:22:18.061824 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1680/3350] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:22:17 2022] POST /identity/v3/projects => generated 395 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:22:18.065804 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee8d2e9-b960-4b65-9cf4-521916a1e3cb admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:22:18.078155 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee8d2e9-b960-4b65-9cf4-521916a1e3cb admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:22:18.205089 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9969ced-c60d-47cc-ad43-766df22c5957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:22:18.206227 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9969ced-c60d-47cc-ad43-766df22c5957 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:22:18.206703 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9969ced-c60d-47cc-ad43-766df22c5957 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:22:18.207130 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9969ced-c60d-47cc-ad43-766df22c5957 admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:22:18.208006 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9969ced-c60d-47cc-ad43-766df22c5957 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:22:18.210332 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9969ced-c60d-47cc-ad43-766df22c5957 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:22:18.250691 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1671/3351] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:22:18 2022] POST /identity/v3/users => generated 298 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:22:18.256094 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e28bdb-ba72-4fe2-a7dd-d29c5f0e2cc9 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:22:18.279415 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e28bdb-ba72-4fe2-a7dd-d29c5f0e2cc9 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:22:18.287700 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75629f0c-c5e8-4902-a70b-6373d180f4da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:22:18.288713 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75629f0c-c5e8-4902-a70b-6373d180f4da admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:22:18.289183 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75629f0c-c5e8-4902-a70b-6373d180f4da admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:22:18.290092 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75629f0c-c5e8-4902-a70b-6373d180f4da admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:22:18.292294 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75629f0c-c5e8-4902-a70b-6373d180f4da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:22:18.299039 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75629f0c-c5e8-4902-a70b-6373d180f4da admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:22:18.332381 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1681/3352] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:22:18 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:22:18.336599 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9969ced-c60d-47cc-ad43-766df22c5957 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:22:18.360561 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9969ced-c60d-47cc-ad43-766df22c5957 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:22:18.369997 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc36aff-5b35-40d1-80cc-df4c99edd5bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:22:18.371945 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc36aff-5b35-40d1-80cc-df4c99edd5bd admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:22:18.372910 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc36aff-5b35-40d1-80cc-df4c99edd5bd admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:22:18.374215 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc36aff-5b35-40d1-80cc-df4c99edd5bd admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:22:18.375211 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc36aff-5b35-40d1-80cc-df4c99edd5bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:22:18.383693 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc36aff-5b35-40d1-80cc-df4c99edd5bd admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:22:18.413654 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1672/3353] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:22:18 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:22:18.418362 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75629f0c-c5e8-4902-a70b-6373d180f4da admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:22:18.435439 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75629f0c-c5e8-4902-a70b-6373d180f4da admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:22:18.448292 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58634988-9a1b-40a2-b301-c56a886f7c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:22:18.449384 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58634988-9a1b-40a2-b301-c56a886f7c4c admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:22:18.451538 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58634988-9a1b-40a2-b301-c56a886f7c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:22:18.452062 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58634988-9a1b-40a2-b301-c56a886f7c4c admin admin] PATH_INFO: `/v3/projects/3539382b7fc04ee3b0df6e1758251e5d/users/de804903007b4d67a89209614c63e985/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:22:18.489723 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58634988-9a1b-40a2-b301-c56a886f7c4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3539382b7fc04ee3b0df6e1758251e5d, user_id=de804903007b4d67a89209614c63e985, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:22:18.492655 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58634988-9a1b-40a2-b301-c56a886f7c4c admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:22:18.527814 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1682/3354] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:22:18 2022] PUT /identity/v3/projects/3539382b7fc04ee3b0df6e1758251e5d/users/de804903007b4d67a89209614c63e985/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:22:18.542460 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abccca98-4b9d-48ac-b0b0-1a1c6f80cf5e None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:22:18.543270 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abccca98-4b9d-48ac-b0b0-1a1c6f80cf5e None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:22:18.544099 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abccca98-4b9d-48ac-b0b0-1a1c6f80cf5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:22:18.588034 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-abccca98-4b9d-48ac-b0b0-1a1c6f80cf5e None None] MFA Rules not processed for user `de804903007b4d67a89209614c63e985`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:22:18.589495 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-abccca98-4b9d-48ac-b0b0-1a1c6f80cf5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:22:18.734652 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1673/3355] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:22:18 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:22:19.305222 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58634988-9a1b-40a2-b301-c56a886f7c4c admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:22:19.307267 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-58634988-9a1b-40a2-b301-c56a886f7c4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:22:19.580118 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58634988-9a1b-40a2-b301-c56a886f7c4c admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:22:19.588368 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a308f961-40ec-4cfa-ac52-65dad7633cb1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:22:19.589486 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a308f961-40ec-4cfa-ac52-65dad7633cb1 service nova] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:22:19.590191 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a308f961-40ec-4cfa-ac52-65dad7633cb1 service nova] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:22:19.591203 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a308f961-40ec-4cfa-ac52-65dad7633cb1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:22:19.606108 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a308f961-40ec-4cfa-ac52-65dad7633cb1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:22:19.611918 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a308f961-40ec-4cfa-ac52-65dad7633cb1 service nova] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:22:19.644353 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1683/3356] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:22:19 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:22:19.755557 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d491fe78-b050-4236-acdb-ffc19b792ffd None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:22:19.756106 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d491fe78-b050-4236-acdb-ffc19b792ffd None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:22:19.756224 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d491fe78-b050-4236-acdb-ffc19b792ffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:22:19.803778 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-d491fe78-b050-4236-acdb-ffc19b792ffd None None] MFA Rules not processed for user `de804903007b4d67a89209614c63e985`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:22:19.805270 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-d491fe78-b050-4236-acdb-ffc19b792ffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:22:19.832545 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1674/3357] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:22:19 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:22:21.492173 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a308f961-40ec-4cfa-ac52-65dad7633cb1 service nova] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:22:21.641957 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a308f961-40ec-4cfa-ac52-65dad7633cb1 service nova] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:22:21.649471 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1246d883-7a61-4945-a1da-f16c2cec1c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:22:21.650741 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1246d883-7a61-4945-a1da-f16c2cec1c8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:22:21.651236 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1246d883-7a61-4945-a1da-f16c2cec1c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:22:21.651708 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1246d883-7a61-4945-a1da-f16c2cec1c8a admin admin] PATH_INFO: `/v3/users/de804903007b4d67a89209614c63e985` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:22:21.653370 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1246d883-7a61-4945-a1da-f16c2cec1c8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=de804903007b4d67a89209614c63e985)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:22:21.655655 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1246d883-7a61-4945-a1da-f16c2cec1c8a admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:22:21.706424 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:22:21.726612 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-1246d883-7a61-4945-a1da-f16c2cec1c8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de804903007b4d67a89209614c63e985'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:22:21.727417 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-1246d883-7a61-4945-a1da-f16c2cec1c8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de804903007b4d67a89209614c63e985'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:22:21.751213 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-1246d883-7a61-4945-a1da-f16c2cec1c8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de804903007b4d67a89209614c63e985'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:22:21.779981 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-1246d883-7a61-4945-a1da-f16c2cec1c8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de804903007b4d67a89209614c63e985'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:22:21.803227 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-1246d883-7a61-4945-a1da-f16c2cec1c8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de804903007b4d67a89209614c63e985'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:22:21.824123 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1684/3358] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:22:21 2022] DELETE /identity/v3/users/de804903007b4d67a89209614c63e985 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:22:21.826295 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17625447-012e-4e29-b5a0-913ec9c869b2 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:22:21.826752 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17625447-012e-4e29-b5a0-913ec9c869b2 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:22:21.827000 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17625447-012e-4e29-b5a0-913ec9c869b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:22:21.867292 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-17625447-012e-4e29-b5a0-913ec9c869b2 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:22:21.869019 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-17625447-012e-4e29-b5a0-913ec9c869b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:22:22.027410 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:22:22.043013 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1675/3359] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:22:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:22:22.064208 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1246d883-7a61-4945-a1da-f16c2cec1c8a admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:22:22.067091 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-1246d883-7a61-4945-a1da-f16c2cec1c8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:22:22.190710 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1246d883-7a61-4945-a1da-f16c2cec1c8a admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:22:22.201062 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f363f2-3ec3-406c-897b-be74b787ab8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:22:22.202900 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f363f2-3ec3-406c-897b-be74b787ab8a service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:22:22.203398 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f363f2-3ec3-406c-897b-be74b787ab8a service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:22:22.203875 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f363f2-3ec3-406c-897b-be74b787ab8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:22:22.225974 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f363f2-3ec3-406c-897b-be74b787ab8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:22:22.231067 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f363f2-3ec3-406c-897b-be74b787ab8a service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:22:22.283828 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1685/3360] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:22:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:22:24.220811 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17625447-012e-4e29-b5a0-913ec9c869b2 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:22:24.225197 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-17625447-012e-4e29-b5a0-913ec9c869b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:22:24.246809 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17625447-012e-4e29-b5a0-913ec9c869b2 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:22:24.255429 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7be94e-cca0-430e-b441-4aa839c523a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:22:24.257540 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7be94e-cca0-430e-b441-4aa839c523a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:22:24.259344 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7be94e-cca0-430e-b441-4aa839c523a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:22:24.260635 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7be94e-cca0-430e-b441-4aa839c523a2 admin admin] PATH_INFO: `/v3/projects/3539382b7fc04ee3b0df6e1758251e5d` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:22:24.262980 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7be94e-cca0-430e-b441-4aa839c523a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3539382b7fc04ee3b0df6e1758251e5d)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:22:24.273544 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7be94e-cca0-430e-b441-4aa839c523a2 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:22:24.395671 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-5f7be94e-cca0-430e-b441-4aa839c523a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3539382b7fc04ee3b0df6e1758251e5d', 'request_id': 'req-5f7be94e-cca0-430e-b441-4aa839c523a2'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:22:24.410047 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-5f7be94e-cca0-430e-b441-4aa839c523a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3539382b7fc04ee3b0df6e1758251e5d', 'request_id': 'req-5f7be94e-cca0-430e-b441-4aa839c523a2'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:22:24.419365 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-5f7be94e-cca0-430e-b441-4aa839c523a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3539382b7fc04ee3b0df6e1758251e5d', 'request_id': 'req-5f7be94e-cca0-430e-b441-4aa839c523a2'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:22:24.478767 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-5f7be94e-cca0-430e-b441-4aa839c523a2 admin admin] The token cache is being invalidate because project 3539382b7fc04ee3b0df6e1758251e5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:22:24.479297 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-5f7be94e-cca0-430e-b441-4aa839c523a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:22:24.481171 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-5f7be94e-cca0-430e-b441-4aa839c523a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:22:24.484281 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1676/3361] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:22:24 2022] DELETE /identity/v3/projects/3539382b7fc04ee3b0df6e1758251e5d => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:22:24.488731 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d7c8c0-d2e4-4e2d-a98d-47fe2cbbdfda None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:22:24.489221 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d7c8c0-d2e4-4e2d-a98d-47fe2cbbdfda None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:22:24.489317 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d7c8c0-d2e4-4e2d-a98d-47fe2cbbdfda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:22:24.527340 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-04d7c8c0-d2e4-4e2d-a98d-47fe2cbbdfda None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:22:24.527340 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-04d7c8c0-d2e4-4e2d-a98d-47fe2cbbdfda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:22:24.638279 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1686/3362] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:22:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:22:24.646076 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682d48b6-b36a-4b00-90b4-a8d630d120be None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:22:24.646522 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682d48b6-b36a-4b00-90b4-a8d630d120be None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:22:24.647539 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682d48b6-b36a-4b00-90b4-a8d630d120be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:22:24.675469 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-682d48b6-b36a-4b00-90b4-a8d630d120be None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:22:24.676910 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-682d48b6-b36a-4b00-90b4-a8d630d120be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:22:24.700343 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1677/3363] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:22:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:22:24.704550 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d7c8c0-d2e4-4e2d-a98d-47fe2cbbdfda None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:22:24.726348 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d7c8c0-d2e4-4e2d-a98d-47fe2cbbdfda None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:22:24.741482 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765e417b-a85e-4245-a6ad-b61d7fc193ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:22:24.742830 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765e417b-a85e-4245-a6ad-b61d7fc193ec admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:22:24.742830 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765e417b-a85e-4245-a6ad-b61d7fc193ec admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:22:24.744512 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765e417b-a85e-4245-a6ad-b61d7fc193ec admin admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:22:24.749099 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765e417b-a85e-4245-a6ad-b61d7fc193ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:22:24.749744 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765e417b-a85e-4245-a6ad-b61d7fc193ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:22:24.751575 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765e417b-a85e-4245-a6ad-b61d7fc193ec admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:22:24.781128 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1687/3364] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:22:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:22:24.786054 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682d48b6-b36a-4b00-90b4-a8d630d120be None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:22:24.814635 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682d48b6-b36a-4b00-90b4-a8d630d120be None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:22:24.843914 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672484e7-6294-4dae-a3cb-4c2e30923d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:22:24.848871 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672484e7-6294-4dae-a3cb-4c2e30923d34 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:22:24.849164 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672484e7-6294-4dae-a3cb-4c2e30923d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:22:24.849437 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672484e7-6294-4dae-a3cb-4c2e30923d34 admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:22:24.850328 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672484e7-6294-4dae-a3cb-4c2e30923d34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:22:24.852444 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672484e7-6294-4dae-a3cb-4c2e30923d34 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:22:24.923242 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1678/3365] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:22:24 2022] POST /identity/v3/projects => generated 379 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:22:24.928439 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765e417b-a85e-4245-a6ad-b61d7fc193ec admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:22:24.945222 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765e417b-a85e-4245-a6ad-b61d7fc193ec admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:22:24.996743 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:22:25.061321 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c97951-2af7-419b-b084-0c0065771493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:22:25.065142 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c97951-2af7-419b-b084-0c0065771493 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:22:25.065625 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c97951-2af7-419b-b084-0c0065771493 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:22:25.066040 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c97951-2af7-419b-b084-0c0065771493 admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:22:25.066946 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c97951-2af7-419b-b084-0c0065771493 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:22:25.072656 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c97951-2af7-419b-b084-0c0065771493 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:22:25.146325 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1688/3366] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:22:24 2022] POST /identity/v3/users => generated 290 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:22:25.147805 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672484e7-6294-4dae-a3cb-4c2e30923d34 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:22:25.164485 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672484e7-6294-4dae-a3cb-4c2e30923d34 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:22:25.174962 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b91bfc-2f5c-4c09-94c4-eb3b0b85b94b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:22:25.175716 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b91bfc-2f5c-4c09-94c4-eb3b0b85b94b admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:22:25.176001 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b91bfc-2f5c-4c09-94c4-eb3b0b85b94b admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:22:25.176280 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b91bfc-2f5c-4c09-94c4-eb3b0b85b94b admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:22:25.177778 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b91bfc-2f5c-4c09-94c4-eb3b0b85b94b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:22:25.181414 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b91bfc-2f5c-4c09-94c4-eb3b0b85b94b admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:22:25.197890 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1679/3367] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:22:25 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:22:25.201196 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c97951-2af7-419b-b084-0c0065771493 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:22:25.216372 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c97951-2af7-419b-b084-0c0065771493 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:22:25.228931 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20acd4e8-4ee8-4c91-97a5-f694172dd20d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:22:25.230111 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20acd4e8-4ee8-4c91-97a5-f694172dd20d admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:22:25.230475 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20acd4e8-4ee8-4c91-97a5-f694172dd20d admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:22:25.231007 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20acd4e8-4ee8-4c91-97a5-f694172dd20d admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:22:25.234443 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20acd4e8-4ee8-4c91-97a5-f694172dd20d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:22:25.236433 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20acd4e8-4ee8-4c91-97a5-f694172dd20d admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:22:25.265682 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b91bfc-2f5c-4c09-94c4-eb3b0b85b94b admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:22:25.273395 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1689/3368] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:22:25 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:22:25.282310 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b91bfc-2f5c-4c09-94c4-eb3b0b85b94b admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:22:25.287995 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6472bc63-f6cb-47e2-a3e0-b8078e73a884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:22:25.289393 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6472bc63-f6cb-47e2-a3e0-b8078e73a884 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:22:25.290228 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6472bc63-f6cb-47e2-a3e0-b8078e73a884 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:22:25.290667 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6472bc63-f6cb-47e2-a3e0-b8078e73a884 admin admin] PATH_INFO: `/v3/projects/55cfd65431cf4b878ab1c0e25a0ac629/users/63ca7a39a8174a4b97767245e80b2bf7/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:22:25.315372 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6472bc63-f6cb-47e2-a3e0-b8078e73a884 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55cfd65431cf4b878ab1c0e25a0ac629, user_id=63ca7a39a8174a4b97767245e80b2bf7, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:22:25.318933 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6472bc63-f6cb-47e2-a3e0-b8078e73a884 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:22:25.349466 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc56ae5-4ec0-4576-bf90-a1ada1ab9527 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:22:25.350297 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc56ae5-4ec0-4576-bf90-a1ada1ab9527 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:22:25.350754 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc56ae5-4ec0-4576-bf90-a1ada1ab9527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:22:25.350898 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1680/3369] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:22:25 2022] PUT /identity/v3/projects/55cfd65431cf4b878ab1c0e25a0ac629/users/63ca7a39a8174a4b97767245e80b2bf7/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:22:25.422836 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-6bc56ae5-4ec0-4576-bf90-a1ada1ab9527 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:22:25.427121 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-6bc56ae5-4ec0-4576-bf90-a1ada1ab9527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:22:25.560887 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1690/3370] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:22:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:22:25.593483 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6472bc63-f6cb-47e2-a3e0-b8078e73a884 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:22:25.598289 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-6472bc63-f6cb-47e2-a3e0-b8078e73a884 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:22:25.816058 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6472bc63-f6cb-47e2-a3e0-b8078e73a884 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:22:25.821625 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b258b685-ad14-42ac-a49d-8bd6ecbd1312 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:22:25.822813 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b258b685-ad14-42ac-a49d-8bd6ecbd1312 service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:22:25.823450 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b258b685-ad14-42ac-a49d-8bd6ecbd1312 service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:22:25.825037 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b258b685-ad14-42ac-a49d-8bd6ecbd1312 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:22:25.862165 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b258b685-ad14-42ac-a49d-8bd6ecbd1312 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:22:25.864271 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b258b685-ad14-42ac-a49d-8bd6ecbd1312 service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:22:25.912399 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1681/3371] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:22:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:22:34.559038 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f970c5ef-443a-44a5-8301-f31338409c1c None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:22:34.560546 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f970c5ef-443a-44a5-8301-f31338409c1c None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:22:34.561706 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f970c5ef-443a-44a5-8301-f31338409c1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:22:34.595079 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-f970c5ef-443a-44a5-8301-f31338409c1c None None] MFA Rules not processed for user `17b779a3e21a415bb42cde5d6863d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:22:34.597682 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-f970c5ef-443a-44a5-8301-f31338409c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:22:34.760177 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1691/3372] 10.222.0.17 () {58 vars in 967 bytes} [Sat Jul 23 21:22:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:22:34.776662 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b258b685-ad14-42ac-a49d-8bd6ecbd1312 service neutron] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:22:34.779548 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-b258b685-ad14-42ac-a49d-8bd6ecbd1312 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:22:34.859636 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:22:34.992733 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b258b685-ad14-42ac-a49d-8bd6ecbd1312 service neutron] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:22:35.001606 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6535a865-1d1f-4380-aa9c-0e5cce651aa6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f0a685b7da46afb81024848f079d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:22:35.007128 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6535a865-1d1f-4380-aa9c-0e5cce651aa6 service swift] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:22:35.008716 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6535a865-1d1f-4380-aa9c-0e5cce651aa6 service swift] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:22:35.009422 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6535a865-1d1f-4380-aa9c-0e5cce651aa6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:22:35.030551 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6535a865-1d1f-4380-aa9c-0e5cce651aa6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:22:35.032414 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6535a865-1d1f-4380-aa9c-0e5cce651aa6 service swift] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:22:35.045132 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1682/3373] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 23 21:22:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 23 21:22:35.175835 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c474106e-61d9-4b4c-bd28-110d2e29f1c8 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:22:35.176211 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c474106e-61d9-4b4c-bd28-110d2e29f1c8 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:22:35.176504 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c474106e-61d9-4b4c-bd28-110d2e29f1c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:22:35.224541 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-c474106e-61d9-4b4c-bd28-110d2e29f1c8 None None] MFA Rules not processed for user `63ca7a39a8174a4b97767245e80b2bf7`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:22:35.226237 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-c474106e-61d9-4b4c-bd28-110d2e29f1c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:22:35.314650 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:22:35.343596 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1692/3374] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:22:35 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:22:35.594259 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6535a865-1d1f-4380-aa9c-0e5cce651aa6 service swift] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:22:35.594259 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-6535a865-1d1f-4380-aa9c-0e5cce651aa6 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:22:35.726263 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6535a865-1d1f-4380-aa9c-0e5cce651aa6 service swift] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:22:35.734167 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173d9803-3d52-40cc-b5da-1b84fc31e39f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:22:35.734956 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173d9803-3d52-40cc-b5da-1b84fc31e39f service nova] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:22:35.735332 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173d9803-3d52-40cc-b5da-1b84fc31e39f service nova] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:22:35.735698 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173d9803-3d52-40cc-b5da-1b84fc31e39f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:22:35.744290 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767d5566-0218-4d0d-965c-286273cf4e31 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:22:35.744835 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767d5566-0218-4d0d-965c-286273cf4e31 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:22:35.744972 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767d5566-0218-4d0d-965c-286273cf4e31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:22:35.751140 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173d9803-3d52-40cc-b5da-1b84fc31e39f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:22:35.753085 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173d9803-3d52-40cc-b5da-1b84fc31e39f service nova] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:22:35.765437 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1683/3375] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:22:35 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:22:35.790802 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-767d5566-0218-4d0d-965c-286273cf4e31 None None] MFA Rules not processed for user `17b779a3e21a415bb42cde5d6863d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:22:35.796301 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-767d5566-0218-4d0d-965c-286273cf4e31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:22:35.834859 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1693/3376] 10.222.0.17 () {58 vars in 967 bytes} [Sat Jul 23 21:22:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:22:35.853016 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173d9803-3d52-40cc-b5da-1b84fc31e39f service nova] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:22:35.874651 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173d9803-3d52-40cc-b5da-1b84fc31e39f service nova] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:22:35.899123 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5120720d-3425-4ba0-9d4c-5dd972e38104 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f0a685b7da46afb81024848f079d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:22:35.900295 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5120720d-3425-4ba0-9d4c-5dd972e38104 service swift] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:22:35.900736 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5120720d-3425-4ba0-9d4c-5dd972e38104 service swift] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:22:35.901089 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5120720d-3425-4ba0-9d4c-5dd972e38104 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:22:35.919598 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5120720d-3425-4ba0-9d4c-5dd972e38104 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:22:35.921500 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5120720d-3425-4ba0-9d4c-5dd972e38104 service swift] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:22:35.959035 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1684/3377] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 23 21:22:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 23 21:22:36.680019 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0bfb2f-3b60-438d-b017-a6caf84b2a9a None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:22:36.680618 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0bfb2f-3b60-438d-b017-a6caf84b2a9a None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:22:36.681158 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0bfb2f-3b60-438d-b017-a6caf84b2a9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:22:36.717695 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-7e0bfb2f-3b60-438d-b017-a6caf84b2a9a None None] MFA Rules not processed for user `17b779a3e21a415bb42cde5d6863d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:22:36.719246 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-7e0bfb2f-3b60-438d-b017-a6caf84b2a9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:22:36.730382 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1694/3378] 10.222.0.17 () {58 vars in 967 bytes} [Sat Jul 23 21:22:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:22:36.746452 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5120720d-3425-4ba0-9d4c-5dd972e38104 service swift] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:22:36.766272 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5120720d-3425-4ba0-9d4c-5dd972e38104 service swift] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:22:36.781602 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e542a161-adf1-4dde-9dbb-475a4361a4f1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f0a685b7da46afb81024848f079d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:22:36.782372 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e542a161-adf1-4dde-9dbb-475a4361a4f1 service swift] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:22:36.782654 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e542a161-adf1-4dde-9dbb-475a4361a4f1 service swift] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:22:36.783105 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e542a161-adf1-4dde-9dbb-475a4361a4f1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:22:36.804256 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e542a161-adf1-4dde-9dbb-475a4361a4f1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:22:36.806519 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e542a161-adf1-4dde-9dbb-475a4361a4f1 service swift] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:22:36.832826 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1685/3379] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 23 21:22:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 23 21:22:36.939558 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0803bc9a-39d8-432f-90b8-59c1d780f55e None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:22:36.940011 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0803bc9a-39d8-432f-90b8-59c1d780f55e None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:22:36.940118 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0803bc9a-39d8-432f-90b8-59c1d780f55e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:22:36.980698 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-0803bc9a-39d8-432f-90b8-59c1d780f55e None None] MFA Rules not processed for user `63ca7a39a8174a4b97767245e80b2bf7`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:22:36.982231 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-0803bc9a-39d8-432f-90b8-59c1d780f55e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:22:37.002273 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1695/3380] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:22:36 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:22:37.947053 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e542a161-adf1-4dde-9dbb-475a4361a4f1 service swift] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:22:37.948535 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-e542a161-adf1-4dde-9dbb-475a4361a4f1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:22:37.986006 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e542a161-adf1-4dde-9dbb-475a4361a4f1 service swift] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:22:37.995406 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4805dc-97c7-45a6-921f-95a709dddfe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:22:37.997173 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4805dc-97c7-45a6-921f-95a709dddfe4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:22:37.997688 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4805dc-97c7-45a6-921f-95a709dddfe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:22:37.999406 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4805dc-97c7-45a6-921f-95a709dddfe4 admin admin] PATH_INFO: `/v3/users/672d90d732a0419ca669e0055359dcfd` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:22:38.001225 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4805dc-97c7-45a6-921f-95a709dddfe4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=672d90d732a0419ca669e0055359dcfd)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:22:38.003721 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4805dc-97c7-45a6-921f-95a709dddfe4 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:22:38.109795 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-7a4805dc-97c7-45a6-921f-95a709dddfe4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '672d90d732a0419ca669e0055359dcfd'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:22:38.133810 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-7a4805dc-97c7-45a6-921f-95a709dddfe4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '672d90d732a0419ca669e0055359dcfd'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:22:38.137278 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-7a4805dc-97c7-45a6-921f-95a709dddfe4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '672d90d732a0419ca669e0055359dcfd'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:22:38.157990 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-7a4805dc-97c7-45a6-921f-95a709dddfe4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '672d90d732a0419ca669e0055359dcfd'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:22:38.163577 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:22:38.185183 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-7a4805dc-97c7-45a6-921f-95a709dddfe4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '672d90d732a0419ca669e0055359dcfd'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:22:38.195015 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1686/3381] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:22:37 2022] DELETE /identity/v3/users/672d90d732a0419ca669e0055359dcfd => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:22:38.548521 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0803bc9a-39d8-432f-90b8-59c1d780f55e None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:22:38.576672 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0803bc9a-39d8-432f-90b8-59c1d780f55e None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:22:38.697707 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dc4820-41b0-4ddc-9e50-d9176d49c803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:22:38.699218 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dc4820-41b0-4ddc-9e50-d9176d49c803 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:22:38.700235 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dc4820-41b0-4ddc-9e50-d9176d49c803 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:22:38.700679 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dc4820-41b0-4ddc-9e50-d9176d49c803 admin admin] PATH_INFO: `/v3/projects/3d87ea887fea457fb07731d47de68333` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:22:38.702614 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dc4820-41b0-4ddc-9e50-d9176d49c803 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d87ea887fea457fb07731d47de68333)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:22:38.704983 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dc4820-41b0-4ddc-9e50-d9176d49c803 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:22:38.773713 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-71dc4820-41b0-4ddc-9e50-d9176d49c803 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d87ea887fea457fb07731d47de68333', 'request_id': 'req-71dc4820-41b0-4ddc-9e50-d9176d49c803'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:22:38.783956 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-71dc4820-41b0-4ddc-9e50-d9176d49c803 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d87ea887fea457fb07731d47de68333', 'request_id': 'req-71dc4820-41b0-4ddc-9e50-d9176d49c803'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:22:38.793152 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-71dc4820-41b0-4ddc-9e50-d9176d49c803 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d87ea887fea457fb07731d47de68333', 'request_id': 'req-71dc4820-41b0-4ddc-9e50-d9176d49c803'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:22:38.821894 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-71dc4820-41b0-4ddc-9e50-d9176d49c803 admin admin] The token cache is being invalidate because project 3d87ea887fea457fb07731d47de68333 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:22:38.822192 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-71dc4820-41b0-4ddc-9e50-d9176d49c803 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:22:38.826008 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-71dc4820-41b0-4ddc-9e50-d9176d49c803 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:22:38.827752 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1696/3382] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:22:38 2022] DELETE /identity/v3/projects/3d87ea887fea457fb07731d47de68333 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:22:38.833249 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84fa405-d5c1-4058-8e29-fff66c664c85 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:22:38.833708 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84fa405-d5c1-4058-8e29-fff66c664c85 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:22:38.834305 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84fa405-d5c1-4058-8e29-fff66c664c85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:22:38.872279 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-f84fa405-d5c1-4058-8e29-fff66c664c85 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:22:38.874994 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-f84fa405-d5c1-4058-8e29-fff66c664c85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:22:38.956608 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1687/3383] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:22:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:22:38.965312 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7270be-fbed-4a9c-91d8-af6c131eca0f None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:22:38.966768 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7270be-fbed-4a9c-91d8-af6c131eca0f None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:22:38.967154 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7270be-fbed-4a9c-91d8-af6c131eca0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:22:38.987947 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-fb7270be-fbed-4a9c-91d8-af6c131eca0f None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:22:38.989336 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-fb7270be-fbed-4a9c-91d8-af6c131eca0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:22:39.000579 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1697/3384] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:22:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:22:39.004779 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84fa405-d5c1-4058-8e29-fff66c664c85 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:22:39.015720 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84fa405-d5c1-4058-8e29-fff66c664c85 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:22:39.020218 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98270da4-2260-4c42-8ae0-0626c0556094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:22:39.020893 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98270da4-2260-4c42-8ae0-0626c0556094 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:22:39.021169 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98270da4-2260-4c42-8ae0-0626c0556094 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:22:39.021439 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98270da4-2260-4c42-8ae0-0626c0556094 admin admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:22:39.022197 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98270da4-2260-4c42-8ae0-0626c0556094 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:22:39.022497 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98270da4-2260-4c42-8ae0-0626c0556094 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:22:39.024097 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98270da4-2260-4c42-8ae0-0626c0556094 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:22:39.036357 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1688/3385] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:22:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 21:22:39.040899 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7270be-fbed-4a9c-91d8-af6c131eca0f None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:22:39.051097 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7270be-fbed-4a9c-91d8-af6c131eca0f None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:22:39.056340 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd09366-904c-4c71-803d-4d724f114d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:22:39.057041 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd09366-904c-4c71-803d-4d724f114d8e admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:22:39.057807 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd09366-904c-4c71-803d-4d724f114d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:22:39.057807 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd09366-904c-4c71-803d-4d724f114d8e admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:22:39.058291 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd09366-904c-4c71-803d-4d724f114d8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:22:39.067436 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd09366-904c-4c71-803d-4d724f114d8e admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:22:39.100014 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1698/3386] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:22:39 2022] POST /identity/v3/projects => generated 383 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:22:39.104222 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98270da4-2260-4c42-8ae0-0626c0556094 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:22:39.115553 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98270da4-2260-4c42-8ae0-0626c0556094 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:22:39.195803 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9289cec-c397-48fb-aa10-c501364ace91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:22:39.196273 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9289cec-c397-48fb-aa10-c501364ace91 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:22:39.196641 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9289cec-c397-48fb-aa10-c501364ace91 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:22:39.196991 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9289cec-c397-48fb-aa10-c501364ace91 admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:22:39.197906 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9289cec-c397-48fb-aa10-c501364ace91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:22:39.200191 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9289cec-c397-48fb-aa10-c501364ace91 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:22:39.236484 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1689/3387] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:22:39 2022] POST /identity/v3/users => generated 292 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:22:39.237725 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd09366-904c-4c71-803d-4d724f114d8e admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:22:39.253012 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd09366-904c-4c71-803d-4d724f114d8e admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:22:39.261660 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be1304d-2241-4411-9efa-ace64e19cf64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:22:39.262554 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be1304d-2241-4411-9efa-ace64e19cf64 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:22:39.262907 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be1304d-2241-4411-9efa-ace64e19cf64 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:22:39.263321 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be1304d-2241-4411-9efa-ace64e19cf64 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:22:39.265512 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be1304d-2241-4411-9efa-ace64e19cf64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:22:39.267276 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be1304d-2241-4411-9efa-ace64e19cf64 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:22:39.287324 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9289cec-c397-48fb-aa10-c501364ace91 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:22:39.295435 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1699/3388] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:22:39 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 21:22:39.300537 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9289cec-c397-48fb-aa10-c501364ace91 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:22:39.320547 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5852c9f-1bd7-4cf9-9c7d-8359a156815f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:22:39.320547 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5852c9f-1bd7-4cf9-9c7d-8359a156815f admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:22:39.320547 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5852c9f-1bd7-4cf9-9c7d-8359a156815f admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:22:39.320547 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5852c9f-1bd7-4cf9-9c7d-8359a156815f admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:22:39.321656 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5852c9f-1bd7-4cf9-9c7d-8359a156815f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:22:39.321656 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5852c9f-1bd7-4cf9-9c7d-8359a156815f admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:22:39.329549 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1690/3389] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:22:39 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:22:39.333946 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be1304d-2241-4411-9efa-ace64e19cf64 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:22:39.345142 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be1304d-2241-4411-9efa-ace64e19cf64 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:22:39.350308 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794005d8-2f86-4e7d-b443-9cad43127cb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:22:39.351317 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794005d8-2f86-4e7d-b443-9cad43127cb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:22:39.351657 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794005d8-2f86-4e7d-b443-9cad43127cb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:22:39.351998 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794005d8-2f86-4e7d-b443-9cad43127cb0 admin admin] PATH_INFO: `/v3/projects/4ebf7cadb7af43beb0b85669f8e1f36c/users/73bde36fce49439bbe49caa877b1b630/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:22:39.370250 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794005d8-2f86-4e7d-b443-9cad43127cb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ebf7cadb7af43beb0b85669f8e1f36c, user_id=73bde36fce49439bbe49caa877b1b630, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:22:39.373818 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794005d8-2f86-4e7d-b443-9cad43127cb0 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:22:39.385121 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:22:39.402817 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1700/3390] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:22:39 2022] PUT /identity/v3/projects/4ebf7cadb7af43beb0b85669f8e1f36c/users/73bde36fce49439bbe49caa877b1b630/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:22:39.405031 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f561f3-a169-4fa6-9d5c-b091ce1819f4 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:22:39.405182 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f561f3-a169-4fa6-9d5c-b091ce1819f4 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:22:39.406020 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f561f3-a169-4fa6-9d5c-b091ce1819f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:22:39.442653 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-99f561f3-a169-4fa6-9d5c-b091ce1819f4 None None] MFA Rules not processed for user `73bde36fce49439bbe49caa877b1b630`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:22:39.443964 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-99f561f3-a169-4fa6-9d5c-b091ce1819f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:22:39.526045 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:22:39.563329 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1691/3391] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:22:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:22:39.573663 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b5d1c8-0d16-49ee-b136-df1e2f264fd4 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:22:39.575007 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b5d1c8-0d16-49ee-b136-df1e2f264fd4 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:22:39.575426 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b5d1c8-0d16-49ee-b136-df1e2f264fd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:22:39.600158 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-f2b5d1c8-0d16-49ee-b136-df1e2f264fd4 None None] MFA Rules not processed for user `73bde36fce49439bbe49caa877b1b630`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:22:39.601462 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-f2b5d1c8-0d16-49ee-b136-df1e2f264fd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:22:39.610503 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1701/3392] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:22:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:22:39.622163 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f561f3-a169-4fa6-9d5c-b091ce1819f4 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:22:39.624080 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-99f561f3-a169-4fa6-9d5c-b091ce1819f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:22:39.741048 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f561f3-a169-4fa6-9d5c-b091ce1819f4 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:22:39.748919 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b61f467-36bb-4905-bec4-011a3b24894e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:22:39.749585 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b61f467-36bb-4905-bec4-011a3b24894e service nova] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:22:39.749914 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b61f467-36bb-4905-bec4-011a3b24894e service nova] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:22:39.750192 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b61f467-36bb-4905-bec4-011a3b24894e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:22:39.759489 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b61f467-36bb-4905-bec4-011a3b24894e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:22:39.761093 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b61f467-36bb-4905-bec4-011a3b24894e service nova] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:22:39.774598 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1692/3393] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:22:39 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:22:42.217773 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b5d1c8-0d16-49ee-b136-df1e2f264fd4 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:22:42.220146 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-f2b5d1c8-0d16-49ee-b136-df1e2f264fd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:22:42.346901 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b5d1c8-0d16-49ee-b136-df1e2f264fd4 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:22:42.354282 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5fe625-d9a3-434b-a3ae-d53f435e7925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:22:42.355392 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5fe625-d9a3-434b-a3ae-d53f435e7925 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:22:42.355908 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5fe625-d9a3-434b-a3ae-d53f435e7925 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:22:42.356329 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5fe625-d9a3-434b-a3ae-d53f435e7925 admin admin] PATH_INFO: `/v3/users/c7acc7eae5f946aaac9f0c8ead2c8d58` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:22:42.358734 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5fe625-d9a3-434b-a3ae-d53f435e7925 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7acc7eae5f946aaac9f0c8ead2c8d58)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:22:42.361353 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5fe625-d9a3-434b-a3ae-d53f435e7925 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:22:42.479579 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-7d5fe625-d9a3-434b-a3ae-d53f435e7925 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7acc7eae5f946aaac9f0c8ead2c8d58'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:22:42.480616 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-7d5fe625-d9a3-434b-a3ae-d53f435e7925 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7acc7eae5f946aaac9f0c8ead2c8d58'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:22:42.492902 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-7d5fe625-d9a3-434b-a3ae-d53f435e7925 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7acc7eae5f946aaac9f0c8ead2c8d58'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:22:42.510030 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-7d5fe625-d9a3-434b-a3ae-d53f435e7925 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7acc7eae5f946aaac9f0c8ead2c8d58'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:22:42.533553 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-7d5fe625-d9a3-434b-a3ae-d53f435e7925 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7acc7eae5f946aaac9f0c8ead2c8d58'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:22:42.541690 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1702/3394] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:22:42 2022] DELETE /identity/v3/users/c7acc7eae5f946aaac9f0c8ead2c8d58 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:22:42.546194 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca922b7-d9ef-440a-8418-88e92137a83f None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:22:42.546718 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca922b7-d9ef-440a-8418-88e92137a83f None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:22:42.546718 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca922b7-d9ef-440a-8418-88e92137a83f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:22:42.590250 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-2ca922b7-d9ef-440a-8418-88e92137a83f None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:22:42.591660 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-2ca922b7-d9ef-440a-8418-88e92137a83f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:22:42.715317 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1693/3395] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:22:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:22:42.737423 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5fe625-d9a3-434b-a3ae-d53f435e7925 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:22:42.740867 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-7d5fe625-d9a3-434b-a3ae-d53f435e7925 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:22:42.838523 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5fe625-d9a3-434b-a3ae-d53f435e7925 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:22:42.842613 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4f5a7e-b1f9-4f49-b10d-7bde63c42405 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:22:42.843290 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4f5a7e-b1f9-4f49-b10d-7bde63c42405 service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:22:42.843599 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4f5a7e-b1f9-4f49-b10d-7bde63c42405 service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:22:42.845143 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4f5a7e-b1f9-4f49-b10d-7bde63c42405 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:22:42.856468 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4f5a7e-b1f9-4f49-b10d-7bde63c42405 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:22:42.857974 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4f5a7e-b1f9-4f49-b10d-7bde63c42405 service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:22:42.872241 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1703/3396] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:22:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:22:43.618552 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca922b7-d9ef-440a-8418-88e92137a83f None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:22:43.620782 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-2ca922b7-d9ef-440a-8418-88e92137a83f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:22:43.643515 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca922b7-d9ef-440a-8418-88e92137a83f None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:22:43.659173 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5456f268-7ff5-44cc-8598-02604b440463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:22:43.660178 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5456f268-7ff5-44cc-8598-02604b440463 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:22:43.660726 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5456f268-7ff5-44cc-8598-02604b440463 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:22:43.661161 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5456f268-7ff5-44cc-8598-02604b440463 admin admin] PATH_INFO: `/v3/projects/7e0f76ca9b734142a90c27f3d3de3a85` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:22:43.662603 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5456f268-7ff5-44cc-8598-02604b440463 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e0f76ca9b734142a90c27f3d3de3a85)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:22:43.664521 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5456f268-7ff5-44cc-8598-02604b440463 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:22:43.757749 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-5456f268-7ff5-44cc-8598-02604b440463 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e0f76ca9b734142a90c27f3d3de3a85', 'request_id': 'req-5456f268-7ff5-44cc-8598-02604b440463'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:22:43.772289 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-5456f268-7ff5-44cc-8598-02604b440463 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e0f76ca9b734142a90c27f3d3de3a85', 'request_id': 'req-5456f268-7ff5-44cc-8598-02604b440463'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:22:43.775665 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:22:43.785792 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-5456f268-7ff5-44cc-8598-02604b440463 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e0f76ca9b734142a90c27f3d3de3a85', 'request_id': 'req-5456f268-7ff5-44cc-8598-02604b440463'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:22:43.827847 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-5456f268-7ff5-44cc-8598-02604b440463 admin admin] The token cache is being invalidate because project 7e0f76ca9b734142a90c27f3d3de3a85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:22:43.828148 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-5456f268-7ff5-44cc-8598-02604b440463 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:22:43.828940 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-5456f268-7ff5-44cc-8598-02604b440463 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:22:43.833637 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1694/3397] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:22:43 2022] DELETE /identity/v3/projects/7e0f76ca9b734142a90c27f3d3de3a85 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:22:43.834855 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4f5a7e-b1f9-4f49-b10d-7bde63c42405 service neutron] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:22:43.849570 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4f5a7e-b1f9-4f49-b10d-7bde63c42405 service neutron] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:22:43.872462 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:22:43.987870 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf9f531-d5e1-420b-a3e4-7844f54a52c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:22:43.989092 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf9f531-d5e1-420b-a3e4-7844f54a52c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:22:43.989856 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf9f531-d5e1-420b-a3e4-7844f54a52c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:22:43.997312 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf9f531-d5e1-420b-a3e4-7844f54a52c2 admin admin] PATH_INFO: `/v3/users/745c84c03045459f948326f8e11b1c72` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:22:43.999016 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf9f531-d5e1-420b-a3e4-7844f54a52c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=745c84c03045459f948326f8e11b1c72)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:22:44.001430 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf9f531-d5e1-420b-a3e4-7844f54a52c2 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:22:44.105428 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-acf9f531-d5e1-420b-a3e4-7844f54a52c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '745c84c03045459f948326f8e11b1c72'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:22:44.106265 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-acf9f531-d5e1-420b-a3e4-7844f54a52c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '745c84c03045459f948326f8e11b1c72'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:22:44.118047 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-acf9f531-d5e1-420b-a3e4-7844f54a52c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '745c84c03045459f948326f8e11b1c72'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:22:44.136432 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-acf9f531-d5e1-420b-a3e4-7844f54a52c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '745c84c03045459f948326f8e11b1c72'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:22:44.150714 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-acf9f531-d5e1-420b-a3e4-7844f54a52c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '745c84c03045459f948326f8e11b1c72'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:22:44.158679 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1704/3398] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:22:43 2022] DELETE /identity/v3/users/745c84c03045459f948326f8e11b1c72 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:22:44.405550 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5456f268-7ff5-44cc-8598-02604b440463 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:22:44.407011 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-5456f268-7ff5-44cc-8598-02604b440463 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:22:44.455719 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5456f268-7ff5-44cc-8598-02604b440463 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:22:44.529713 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941c44d6-96cc-43e0-b7aa-398d69a72e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:22:44.530717 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941c44d6-96cc-43e0-b7aa-398d69a72e3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:22:44.530973 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941c44d6-96cc-43e0-b7aa-398d69a72e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:22:44.531226 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941c44d6-96cc-43e0-b7aa-398d69a72e3f admin admin] PATH_INFO: `/v3/projects/a7a5537ccc0f49c397e9f6bc723a9b7b` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:22:44.532393 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941c44d6-96cc-43e0-b7aa-398d69a72e3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7a5537ccc0f49c397e9f6bc723a9b7b)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:22:44.534387 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941c44d6-96cc-43e0-b7aa-398d69a72e3f admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:22:44.602989 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-941c44d6-96cc-43e0-b7aa-398d69a72e3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7a5537ccc0f49c397e9f6bc723a9b7b', 'request_id': 'req-941c44d6-96cc-43e0-b7aa-398d69a72e3f'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:22:44.618071 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-941c44d6-96cc-43e0-b7aa-398d69a72e3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7a5537ccc0f49c397e9f6bc723a9b7b', 'request_id': 'req-941c44d6-96cc-43e0-b7aa-398d69a72e3f'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:22:44.627949 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-941c44d6-96cc-43e0-b7aa-398d69a72e3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7a5537ccc0f49c397e9f6bc723a9b7b', 'request_id': 'req-941c44d6-96cc-43e0-b7aa-398d69a72e3f'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:22:44.645242 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-941c44d6-96cc-43e0-b7aa-398d69a72e3f admin admin] The token cache is being invalidate because project a7a5537ccc0f49c397e9f6bc723a9b7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:22:44.645599 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-941c44d6-96cc-43e0-b7aa-398d69a72e3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:22:44.649131 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-941c44d6-96cc-43e0-b7aa-398d69a72e3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:22:44.651156 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1695/3399] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:22:44 2022] DELETE /identity/v3/projects/a7a5537ccc0f49c397e9f6bc723a9b7b => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:22:44.660058 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb754c90-1782-435c-90c4-0cbdb9e43abb None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:22:44.660593 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb754c90-1782-435c-90c4-0cbdb9e43abb None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:22:44.660944 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb754c90-1782-435c-90c4-0cbdb9e43abb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:22:44.706892 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-cb754c90-1782-435c-90c4-0cbdb9e43abb None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:22:44.709108 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-cb754c90-1782-435c-90c4-0cbdb9e43abb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:22:44.808132 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1705/3400] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:22:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:22:44.817177 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca3aa09-330b-4800-a1ac-d92cb2cfd348 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:22:44.820641 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca3aa09-330b-4800-a1ac-d92cb2cfd348 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:22:44.821064 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca3aa09-330b-4800-a1ac-d92cb2cfd348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:22:44.847434 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-6ca3aa09-330b-4800-a1ac-d92cb2cfd348 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:22:44.849175 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-6ca3aa09-330b-4800-a1ac-d92cb2cfd348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:22:44.861261 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1696/3401] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:22:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:22:44.866118 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb754c90-1782-435c-90c4-0cbdb9e43abb None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:22:44.878695 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb754c90-1782-435c-90c4-0cbdb9e43abb None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:22:44.885120 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf8ec29-ec35-48f7-a1b8-ab00e63e8e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:22:44.886461 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf8ec29-ec35-48f7-a1b8-ab00e63e8e87 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:22:44.887024 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf8ec29-ec35-48f7-a1b8-ab00e63e8e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:22:44.887699 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf8ec29-ec35-48f7-a1b8-ab00e63e8e87 admin admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:22:44.889375 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf8ec29-ec35-48f7-a1b8-ab00e63e8e87 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:22:44.889787 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf8ec29-ec35-48f7-a1b8-ab00e63e8e87 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:22:44.891634 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf8ec29-ec35-48f7-a1b8-ab00e63e8e87 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:22:44.907787 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1706/3402] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:22:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:22:44.912118 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca3aa09-330b-4800-a1ac-d92cb2cfd348 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:22:44.923575 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca3aa09-330b-4800-a1ac-d92cb2cfd348 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:22:44.929948 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6432e752-8212-4a52-8129-b81c14924929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:22:44.930999 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6432e752-8212-4a52-8129-b81c14924929 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:22:44.931363 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6432e752-8212-4a52-8129-b81c14924929 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:22:44.931643 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6432e752-8212-4a52-8129-b81c14924929 admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:22:44.932462 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6432e752-8212-4a52-8129-b81c14924929 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:22:44.944988 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6432e752-8212-4a52-8129-b81c14924929 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:22:44.991980 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1697/3403] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:22:44 2022] POST /identity/v3/projects => generated 387 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:22:44.998348 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf8ec29-ec35-48f7-a1b8-ab00e63e8e87 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:22:45.013558 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf8ec29-ec35-48f7-a1b8-ab00e63e8e87 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:22:45.057352 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:22:45.153646 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101943c7-2f82-4c78-9589-33724cf98c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:22:45.154754 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101943c7-2f82-4c78-9589-33724cf98c9e admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:22:45.156075 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101943c7-2f82-4c78-9589-33724cf98c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:22:45.156992 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101943c7-2f82-4c78-9589-33724cf98c9e admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:22:45.159312 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101943c7-2f82-4c78-9589-33724cf98c9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:22:45.163311 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101943c7-2f82-4c78-9589-33724cf98c9e admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:22:45.188902 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1707/3404] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:22:44 2022] POST /identity/v3/users => generated 294 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:22:45.193091 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6432e752-8212-4a52-8129-b81c14924929 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:22:45.216525 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6432e752-8212-4a52-8129-b81c14924929 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:22:45.228257 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72976cc-d5a7-4d8b-b360-e31471ef9b3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:22:45.228999 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72976cc-d5a7-4d8b-b360-e31471ef9b3a admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:22:45.229320 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72976cc-d5a7-4d8b-b360-e31471ef9b3a admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:22:45.231064 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72976cc-d5a7-4d8b-b360-e31471ef9b3a admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:22:45.232838 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72976cc-d5a7-4d8b-b360-e31471ef9b3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:22:45.234535 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72976cc-d5a7-4d8b-b360-e31471ef9b3a admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:22:45.251440 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1698/3405] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:22:45 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:22:45.255231 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101943c7-2f82-4c78-9589-33724cf98c9e admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:22:45.267758 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101943c7-2f82-4c78-9589-33724cf98c9e admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:22:45.276222 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eece458f-3dcc-4096-8b44-1a59fc75dd0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:22:45.277126 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eece458f-3dcc-4096-8b44-1a59fc75dd0d admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:22:45.277413 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eece458f-3dcc-4096-8b44-1a59fc75dd0d admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:22:45.277819 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eece458f-3dcc-4096-8b44-1a59fc75dd0d admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:22:45.279073 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eece458f-3dcc-4096-8b44-1a59fc75dd0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:22:45.281019 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eece458f-3dcc-4096-8b44-1a59fc75dd0d admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:22:45.298776 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72976cc-d5a7-4d8b-b360-e31471ef9b3a admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:22:45.299171 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1708/3406] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:22:45 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:22:45.316750 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72976cc-d5a7-4d8b-b360-e31471ef9b3a admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:22:45.328602 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16717b6-b59b-4a97-a32d-f02bc91dd963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:22:45.330283 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16717b6-b59b-4a97-a32d-f02bc91dd963 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:22:45.331297 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16717b6-b59b-4a97-a32d-f02bc91dd963 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:22:45.331867 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16717b6-b59b-4a97-a32d-f02bc91dd963 admin admin] PATH_INFO: `/v3/projects/1e5883af23b74caead47ef27b4fbb7bf/users/0e6d2a0cb8d14246bb42268a159968f7/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:22:45.354519 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16717b6-b59b-4a97-a32d-f02bc91dd963 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e5883af23b74caead47ef27b4fbb7bf, user_id=0e6d2a0cb8d14246bb42268a159968f7, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:22:45.358945 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16717b6-b59b-4a97-a32d-f02bc91dd963 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:22:45.384114 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1699/3407] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:22:45 2022] PUT /identity/v3/projects/1e5883af23b74caead47ef27b4fbb7bf/users/0e6d2a0cb8d14246bb42268a159968f7/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:22:45.389662 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7160ba6f-626b-416e-bb3b-596be3971706 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:22:45.390042 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7160ba6f-626b-416e-bb3b-596be3971706 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:22:45.390345 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7160ba6f-626b-416e-bb3b-596be3971706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:22:45.418541 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-7160ba6f-626b-416e-bb3b-596be3971706 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:22:45.419937 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-7160ba6f-626b-416e-bb3b-596be3971706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:22:45.522347 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1709/3408] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:22:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:22:45.547512 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16717b6-b59b-4a97-a32d-f02bc91dd963 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:22:45.549606 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-f16717b6-b59b-4a97-a32d-f02bc91dd963 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:22:45.567636 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=89,keystone:DELETE=8,keystone:INSERT=3 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:22:45.637998 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16717b6-b59b-4a97-a32d-f02bc91dd963 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:22:45.643209 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074f2978-8b81-4b59-a2b2-a9a80a2a3df2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:22:45.644140 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074f2978-8b81-4b59-a2b2-a9a80a2a3df2 service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:22:45.644540 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074f2978-8b81-4b59-a2b2-a9a80a2a3df2 service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:22:45.644874 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074f2978-8b81-4b59-a2b2-a9a80a2a3df2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:22:45.658728 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074f2978-8b81-4b59-a2b2-a9a80a2a3df2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:22:45.660545 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074f2978-8b81-4b59-a2b2-a9a80a2a3df2 service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:22:45.671971 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1700/3409] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:22:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:22:49.039130 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592cb5c2-41b9-4691-a54d-5778f9d75c0e None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:22:49.039590 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592cb5c2-41b9-4691-a54d-5778f9d75c0e None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:22:49.039699 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592cb5c2-41b9-4691-a54d-5778f9d75c0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:22:49.065295 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-592cb5c2-41b9-4691-a54d-5778f9d75c0e None None] MFA Rules not processed for user `17b779a3e21a415bb42cde5d6863d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:22:49.066855 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-592cb5c2-41b9-4691-a54d-5778f9d75c0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:22:49.204478 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1710/3410] 10.222.0.17 () {58 vars in 967 bytes} [Sat Jul 23 21:22:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:22:49.204869 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074f2978-8b81-4b59-a2b2-a9a80a2a3df2 service neutron] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:22:49.206566 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-074f2978-8b81-4b59-a2b2-a9a80a2a3df2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:22:49.354116 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074f2978-8b81-4b59-a2b2-a9a80a2a3df2 service neutron] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:22:49.362037 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8a022e-586a-4a4b-95eb-a815fa991a74 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f0a685b7da46afb81024848f079d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:22:49.363377 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8a022e-586a-4a4b-95eb-a815fa991a74 service swift] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:22:49.363660 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8a022e-586a-4a4b-95eb-a815fa991a74 service swift] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:22:49.363975 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8a022e-586a-4a4b-95eb-a815fa991a74 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:22:49.424096 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8a022e-586a-4a4b-95eb-a815fa991a74 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:22:49.425824 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8a022e-586a-4a4b-95eb-a815fa991a74 service swift] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:22:49.439444 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1701/3411] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 23 21:22:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 23 21:22:49.649666 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dc3c25-1afc-446b-88eb-24cc47c88acf None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:22:49.649992 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dc3c25-1afc-446b-88eb-24cc47c88acf None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:22:49.650270 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dc3c25-1afc-446b-88eb-24cc47c88acf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:22:49.674641 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-34dc3c25-1afc-446b-88eb-24cc47c88acf None None] MFA Rules not processed for user `17b779a3e21a415bb42cde5d6863d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:22:49.676022 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-34dc3c25-1afc-446b-88eb-24cc47c88acf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:22:49.687020 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1711/3412] 10.222.0.17 () {58 vars in 967 bytes} [Sat Jul 23 21:22:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:22:49.707259 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8a022e-586a-4a4b-95eb-a815fa991a74 service swift] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:22:49.740225 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8a022e-586a-4a4b-95eb-a815fa991a74 service swift] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:22:49.757612 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bae532-1826-4110-a5a8-74db9c7e600e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f0a685b7da46afb81024848f079d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:22:49.758433 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bae532-1826-4110-a5a8-74db9c7e600e service swift] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:22:49.758783 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bae532-1826-4110-a5a8-74db9c7e600e service swift] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:22:49.759115 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bae532-1826-4110-a5a8-74db9c7e600e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:22:49.798102 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bae532-1826-4110-a5a8-74db9c7e600e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:22:49.800027 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bae532-1826-4110-a5a8-74db9c7e600e service swift] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:22:49.828298 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1702/3413] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 23 21:22:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 23 21:22:50.288580 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a45abe-7d23-4f1f-b8a7-5c1dda2b68c8 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:22:50.289430 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a45abe-7d23-4f1f-b8a7-5c1dda2b68c8 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:22:50.290132 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a45abe-7d23-4f1f-b8a7-5c1dda2b68c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:22:50.316217 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-f0a45abe-7d23-4f1f-b8a7-5c1dda2b68c8 None None] MFA Rules not processed for user `17b779a3e21a415bb42cde5d6863d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:22:50.318817 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-f0a45abe-7d23-4f1f-b8a7-5c1dda2b68c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:22:50.352615 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bae532-1826-4110-a5a8-74db9c7e600e service swift] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:22:50.361723 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1712/3414] 10.222.0.17 () {58 vars in 967 bytes} [Sat Jul 23 21:22:50 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:22:50.367719 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bae532-1826-4110-a5a8-74db9c7e600e service swift] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:22:50.375113 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186a4c2c-260e-4f6d-bdda-0ad318bb9b35 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f0a685b7da46afb81024848f079d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:22:50.375903 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186a4c2c-260e-4f6d-bdda-0ad318bb9b35 service swift] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:22:50.376858 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186a4c2c-260e-4f6d-bdda-0ad318bb9b35 service swift] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:22:50.377404 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186a4c2c-260e-4f6d-bdda-0ad318bb9b35 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:22:50.391773 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186a4c2c-260e-4f6d-bdda-0ad318bb9b35 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:22:50.396365 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186a4c2c-260e-4f6d-bdda-0ad318bb9b35 service swift] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:22:50.413612 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1703/3415] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 23 21:22:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 23 21:22:50.604671 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a45abe-7d23-4f1f-b8a7-5c1dda2b68c8 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:22:50.607141 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-f0a45abe-7d23-4f1f-b8a7-5c1dda2b68c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:22:50.650741 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a45abe-7d23-4f1f-b8a7-5c1dda2b68c8 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:22:50.660595 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8c255c-36e1-49ac-ac26-761628bdd267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:22:50.661632 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8c255c-36e1-49ac-ac26-761628bdd267 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:22:50.662197 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8c255c-36e1-49ac-ac26-761628bdd267 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:22:50.662661 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8c255c-36e1-49ac-ac26-761628bdd267 admin admin] PATH_INFO: `/v3/users/f80673ab800441b4bd1f5858e1df7b3c` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:22:50.664962 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8c255c-36e1-49ac-ac26-761628bdd267 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f80673ab800441b4bd1f5858e1df7b3c)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:22:50.667200 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8c255c-36e1-49ac-ac26-761628bdd267 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:22:50.730557 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:22:50.769249 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-8d8c255c-36e1-49ac-ac26-761628bdd267 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f80673ab800441b4bd1f5858e1df7b3c'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:22:50.770382 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-8d8c255c-36e1-49ac-ac26-761628bdd267 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f80673ab800441b4bd1f5858e1df7b3c'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:22:50.788677 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-8d8c255c-36e1-49ac-ac26-761628bdd267 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f80673ab800441b4bd1f5858e1df7b3c'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:22:50.809262 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-8d8c255c-36e1-49ac-ac26-761628bdd267 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f80673ab800441b4bd1f5858e1df7b3c'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:22:50.843275 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-8d8c255c-36e1-49ac-ac26-761628bdd267 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f80673ab800441b4bd1f5858e1df7b3c'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:22:50.860424 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1713/3416] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:22:50 2022] DELETE /identity/v3/users/f80673ab800441b4bd1f5858e1df7b3c => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:22:50.865801 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301a80ff-05cb-4f95-8ddc-e34ea291df3b None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:22:50.867145 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301a80ff-05cb-4f95-8ddc-e34ea291df3b None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:22:50.870070 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301a80ff-05cb-4f95-8ddc-e34ea291df3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:22:50.925530 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-301a80ff-05cb-4f95-8ddc-e34ea291df3b None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:22:50.931437 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-301a80ff-05cb-4f95-8ddc-e34ea291df3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:22:51.051642 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1704/3417] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:22:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:22:51.075309 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8c255c-36e1-49ac-ac26-761628bdd267 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:22:51.077187 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-8d8c255c-36e1-49ac-ac26-761628bdd267 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:22:51.194103 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8c255c-36e1-49ac-ac26-761628bdd267 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:22:51.199543 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632178fd-5b68-46e6-afb1-77ad69be4bdf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:22:51.201379 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632178fd-5b68-46e6-afb1-77ad69be4bdf service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:22:51.201991 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632178fd-5b68-46e6-afb1-77ad69be4bdf service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:22:51.202465 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632178fd-5b68-46e6-afb1-77ad69be4bdf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:22:51.228117 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632178fd-5b68-46e6-afb1-77ad69be4bdf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:22:51.231577 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632178fd-5b68-46e6-afb1-77ad69be4bdf service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:22:51.252793 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1714/3418] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:22:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:22:51.522299 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301a80ff-05cb-4f95-8ddc-e34ea291df3b None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:22:51.524407 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-301a80ff-05cb-4f95-8ddc-e34ea291df3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:22:51.551359 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301a80ff-05cb-4f95-8ddc-e34ea291df3b None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:22:51.570491 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeac56de-6bcf-4037-85ea-7421c798f35f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:22:51.573211 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeac56de-6bcf-4037-85ea-7421c798f35f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:22:51.574199 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeac56de-6bcf-4037-85ea-7421c798f35f admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:22:51.574824 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeac56de-6bcf-4037-85ea-7421c798f35f admin admin] PATH_INFO: `/v3/projects/629d02efac724fa29fcfff53e370b69b` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:22:51.577782 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeac56de-6bcf-4037-85ea-7421c798f35f admin admin] RBAC: Authorizing `identity:delete_project(project_id=629d02efac724fa29fcfff53e370b69b)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:22:51.581837 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeac56de-6bcf-4037-85ea-7421c798f35f admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:22:51.603574 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:22:51.665792 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-eeac56de-6bcf-4037-85ea-7421c798f35f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '629d02efac724fa29fcfff53e370b69b', 'request_id': 'req-eeac56de-6bcf-4037-85ea-7421c798f35f'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:22:51.680466 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-eeac56de-6bcf-4037-85ea-7421c798f35f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '629d02efac724fa29fcfff53e370b69b', 'request_id': 'req-eeac56de-6bcf-4037-85ea-7421c798f35f'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:22:51.698578 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-eeac56de-6bcf-4037-85ea-7421c798f35f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '629d02efac724fa29fcfff53e370b69b', 'request_id': 'req-eeac56de-6bcf-4037-85ea-7421c798f35f'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:22:51.730390 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-eeac56de-6bcf-4037-85ea-7421c798f35f admin admin] The token cache is being invalidate because project 629d02efac724fa29fcfff53e370b69b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:22:51.731211 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-eeac56de-6bcf-4037-85ea-7421c798f35f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:22:51.733763 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-eeac56de-6bcf-4037-85ea-7421c798f35f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:22:51.735753 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1705/3419] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:22:51 2022] DELETE /identity/v3/projects/629d02efac724fa29fcfff53e370b69b => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:22:51.740935 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa00951-43c2-4efa-ad72-75ce16ea6555 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:22:51.741416 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa00951-43c2-4efa-ad72-75ce16ea6555 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:22:51.741508 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa00951-43c2-4efa-ad72-75ce16ea6555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:22:51.767077 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-1fa00951-43c2-4efa-ad72-75ce16ea6555 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:22:51.768711 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-1fa00951-43c2-4efa-ad72-75ce16ea6555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:22:51.852496 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1715/3420] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:22:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:22:51.861650 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2009d5-3adf-4fd0-8130-3f895b8d9fa6 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:22:51.862361 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2009d5-3adf-4fd0-8130-3f895b8d9fa6 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:22:51.862664 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2009d5-3adf-4fd0-8130-3f895b8d9fa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:22:51.891595 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-9a2009d5-3adf-4fd0-8130-3f895b8d9fa6 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:22:51.893229 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-9a2009d5-3adf-4fd0-8130-3f895b8d9fa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:22:51.905728 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1706/3421] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:22:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:22:51.910705 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa00951-43c2-4efa-ad72-75ce16ea6555 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:22:51.928121 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa00951-43c2-4efa-ad72-75ce16ea6555 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:22:51.940617 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecc85c1-c7c5-4a24-a0e9-ea5ee84a4aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:22:51.941288 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecc85c1-c7c5-4a24-a0e9-ea5ee84a4aa7 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:22:51.941575 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecc85c1-c7c5-4a24-a0e9-ea5ee84a4aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:22:51.941850 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecc85c1-c7c5-4a24-a0e9-ea5ee84a4aa7 admin admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:22:51.949770 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecc85c1-c7c5-4a24-a0e9-ea5ee84a4aa7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:22:51.950253 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecc85c1-c7c5-4a24-a0e9-ea5ee84a4aa7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:22:51.951940 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecc85c1-c7c5-4a24-a0e9-ea5ee84a4aa7 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:22:51.981917 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1716/3422] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:22:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:22:51.983181 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2009d5-3adf-4fd0-8130-3f895b8d9fa6 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:22:52.000913 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2009d5-3adf-4fd0-8130-3f895b8d9fa6 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:22:52.007377 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cfe6b3-9bb6-4873-a143-ce61c2c8d908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:22:52.008302 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cfe6b3-9bb6-4873-a143-ce61c2c8d908 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:22:52.008896 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cfe6b3-9bb6-4873-a143-ce61c2c8d908 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:22:52.009347 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cfe6b3-9bb6-4873-a143-ce61c2c8d908 admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:22:52.010360 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cfe6b3-9bb6-4873-a143-ce61c2c8d908 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:22:52.012551 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cfe6b3-9bb6-4873-a143-ce61c2c8d908 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:22:52.069807 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1707/3423] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:22:51 2022] POST /identity/v3/projects => generated 399 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:22:52.070538 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecc85c1-c7c5-4a24-a0e9-ea5ee84a4aa7 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:22:52.090266 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecc85c1-c7c5-4a24-a0e9-ea5ee84a4aa7 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:22:52.156402 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:22:52.213400 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32eb653a-0d4a-4c0b-90e1-fd3c3996a92c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:22:52.214456 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eb653a-0d4a-4c0b-90e1-fd3c3996a92c admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:22:52.214883 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eb653a-0d4a-4c0b-90e1-fd3c3996a92c admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:22:52.215287 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eb653a-0d4a-4c0b-90e1-fd3c3996a92c admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:22:52.216074 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32eb653a-0d4a-4c0b-90e1-fd3c3996a92c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:22:52.218942 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32eb653a-0d4a-4c0b-90e1-fd3c3996a92c admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:22:52.255810 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1717/3424] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:22:52 2022] POST /identity/v3/users => generated 300 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:22:52.260673 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cfe6b3-9bb6-4873-a143-ce61c2c8d908 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:22:52.278904 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cfe6b3-9bb6-4873-a143-ce61c2c8d908 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:22:52.291483 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bd6c3e-fd9f-4e78-8469-64416a3dfeae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:22:52.292204 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bd6c3e-fd9f-4e78-8469-64416a3dfeae admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:22:52.292590 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bd6c3e-fd9f-4e78-8469-64416a3dfeae admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:22:52.292866 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bd6c3e-fd9f-4e78-8469-64416a3dfeae admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:22:52.294236 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bd6c3e-fd9f-4e78-8469-64416a3dfeae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:22:52.298675 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bd6c3e-fd9f-4e78-8469-64416a3dfeae admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:22:52.334432 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1708/3425] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:22:52 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:22:52.338266 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32eb653a-0d4a-4c0b-90e1-fd3c3996a92c admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:22:52.357195 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32eb653a-0d4a-4c0b-90e1-fd3c3996a92c admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:22:52.390370 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7b2db9-5217-4778-a959-cce96c4fa7ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:22:52.392865 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7b2db9-5217-4778-a959-cce96c4fa7ca admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:22:52.393156 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7b2db9-5217-4778-a959-cce96c4fa7ca admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:22:52.395901 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7b2db9-5217-4778-a959-cce96c4fa7ca admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:22:52.395901 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7b2db9-5217-4778-a959-cce96c4fa7ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:22:52.397281 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7b2db9-5217-4778-a959-cce96c4fa7ca admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:22:52.435992 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1718/3426] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:22:52 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:22:52.440519 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bd6c3e-fd9f-4e78-8469-64416a3dfeae admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:22:52.463972 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bd6c3e-fd9f-4e78-8469-64416a3dfeae admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:22:52.480657 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141c87c5-eeb3-49a1-bfe8-aee75673b0fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:22:52.481680 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141c87c5-eeb3-49a1-bfe8-aee75673b0fd admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:22:52.482069 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141c87c5-eeb3-49a1-bfe8-aee75673b0fd admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:22:52.482344 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141c87c5-eeb3-49a1-bfe8-aee75673b0fd admin admin] PATH_INFO: `/v3/projects/df514a56fdad4584b0f15212ff29698c/users/527ad10d4b174992a7e90ae9cd464f42/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:22:52.507291 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141c87c5-eeb3-49a1-bfe8-aee75673b0fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=df514a56fdad4584b0f15212ff29698c, user_id=527ad10d4b174992a7e90ae9cd464f42, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:22:52.511045 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141c87c5-eeb3-49a1-bfe8-aee75673b0fd admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:22:52.548257 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1709/3427] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:22:52 2022] PUT /identity/v3/projects/df514a56fdad4584b0f15212ff29698c/users/527ad10d4b174992a7e90ae9cd464f42/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:22:52.551923 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd264771-a2b1-440f-8cee-d9ea56010df1 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:22:52.552224 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd264771-a2b1-440f-8cee-d9ea56010df1 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:22:52.552509 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd264771-a2b1-440f-8cee-d9ea56010df1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:22:52.644004 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-dd264771-a2b1-440f-8cee-d9ea56010df1 None None] MFA Rules not processed for user `527ad10d4b174992a7e90ae9cd464f42`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:22:52.645519 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-dd264771-a2b1-440f-8cee-d9ea56010df1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:22:52.770558 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1719/3428] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:22:52 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:22:52.781419 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141c87c5-eeb3-49a1-bfe8-aee75673b0fd admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:22:52.782973 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-141c87c5-eeb3-49a1-bfe8-aee75673b0fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:22:52.893666 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141c87c5-eeb3-49a1-bfe8-aee75673b0fd admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:22:52.901107 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87ad3b7-5fef-4016-9511-5c6287e67fa3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:22:52.902308 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87ad3b7-5fef-4016-9511-5c6287e67fa3 service nova] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:22:52.902883 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87ad3b7-5fef-4016-9511-5c6287e67fa3 service nova] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:22:52.903361 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87ad3b7-5fef-4016-9511-5c6287e67fa3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:22:52.916217 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87ad3b7-5fef-4016-9511-5c6287e67fa3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:22:52.918384 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87ad3b7-5fef-4016-9511-5c6287e67fa3 service nova] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:22:52.946801 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1710/3429] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:22:52 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:22:53.002473 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd264771-a2b1-440f-8cee-d9ea56010df1 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:22:53.083818 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd264771-a2b1-440f-8cee-d9ea56010df1 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:22:53.089534 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee835f04-8ab5-4cce-87a1-aad8a5a680c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:22:53.090851 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee835f04-8ab5-4cce-87a1-aad8a5a680c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:22:53.091274 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee835f04-8ab5-4cce-87a1-aad8a5a680c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:22:53.091686 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee835f04-8ab5-4cce-87a1-aad8a5a680c3 admin admin] PATH_INFO: `/v3/users/527ad10d4b174992a7e90ae9cd464f42` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:22:53.093262 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee835f04-8ab5-4cce-87a1-aad8a5a680c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=527ad10d4b174992a7e90ae9cd464f42)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:22:53.096443 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee835f04-8ab5-4cce-87a1-aad8a5a680c3 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:22:53.196589 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185d1cfe-eda5-4967-a5b8-10fccb735caf None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:22:53.197403 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185d1cfe-eda5-4967-a5b8-10fccb735caf None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:22:53.197822 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185d1cfe-eda5-4967-a5b8-10fccb735caf None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:22:53.200489 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1711/3430] 10.222.0.17 () {54 vars in 912 bytes} [Sat Jul 23 21:22:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:22:53.206455 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a79918c-4003-478a-b57c-9d406e998013 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:22:53.207268 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a79918c-4003-478a-b57c-9d406e998013 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:22:53.207868 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a79918c-4003-478a-b57c-9d406e998013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:22:53.220931 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:22:53.224692 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-ee835f04-8ab5-4cce-87a1-aad8a5a680c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '527ad10d4b174992a7e90ae9cd464f42'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:22:53.225655 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-ee835f04-8ab5-4cce-87a1-aad8a5a680c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '527ad10d4b174992a7e90ae9cd464f42'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:22:53.241459 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-ee835f04-8ab5-4cce-87a1-aad8a5a680c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '527ad10d4b174992a7e90ae9cd464f42'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:22:53.248071 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-3a79918c-4003-478a-b57c-9d406e998013 None None] MFA Rules not processed for user `c497326ee890462e8f48b4a56f81990c`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:22:53.250065 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-3a79918c-4003-478a-b57c-9d406e998013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:22:53.257200 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-ee835f04-8ab5-4cce-87a1-aad8a5a680c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '527ad10d4b174992a7e90ae9cd464f42'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:22:53.290616 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:22:53.296018 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-ee835f04-8ab5-4cce-87a1-aad8a5a680c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '527ad10d4b174992a7e90ae9cd464f42'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:22:53.317968 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1720/3431] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:22:53 2022] DELETE /identity/v3/users/527ad10d4b174992a7e90ae9cd464f42 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:22:53.323175 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbacbdb-eb86-44dc-901d-b67145008976 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:22:53.323442 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbacbdb-eb86-44dc-901d-b67145008976 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:22:53.323743 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbacbdb-eb86-44dc-901d-b67145008976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:22:53.349729 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-0dbacbdb-eb86-44dc-901d-b67145008976 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:22:53.350968 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-0dbacbdb-eb86-44dc-901d-b67145008976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:22:53.362927 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1712/3432] 10.222.0.17 () {58 vars in 1009 bytes} [Sat Jul 23 21:22:53 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:22:53.401103 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a79918c-4003-478a-b57c-9d406e998013 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:22:53.403436 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-3a79918c-4003-478a-b57c-9d406e998013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:22:53.433179 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a79918c-4003-478a-b57c-9d406e998013 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:22:53.529690 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1721/3433] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:22:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:22:53.531651 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28660bb-4fab-4ca8-bf7b-db2f11195848 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:22:53.531943 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28660bb-4fab-4ca8-bf7b-db2f11195848 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:22:53.532368 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28660bb-4fab-4ca8-bf7b-db2f11195848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:22:53.547263 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cdb213-2ae4-4430-9bc4-8867388f5711 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:22:53.548060 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cdb213-2ae4-4430-9bc4-8867388f5711 service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:22:53.548346 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cdb213-2ae4-4430-9bc4-8867388f5711 service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:22:53.548890 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cdb213-2ae4-4430-9bc4-8867388f5711 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:22:53.558558 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cdb213-2ae4-4430-9bc4-8867388f5711 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:22:53.560130 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cdb213-2ae4-4430-9bc4-8867388f5711 service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:22:53.569432 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1713/3434] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:22:53 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 23 21:22:53.570265 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-d28660bb-4fab-4ca8-bf7b-db2f11195848 None None] MFA Rules not processed for user `0e6d2a0cb8d14246bb42268a159968f7`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:22:53.570849 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cdb213-2ae4-4430-9bc4-8867388f5711 service neutron] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:22:53.572097 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-d28660bb-4fab-4ca8-bf7b-db2f11195848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:22:53.572600 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-33cdb213-2ae4-4430-9bc4-8867388f5711 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:22:53.593651 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cdb213-2ae4-4430-9bc4-8867388f5711 service neutron] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:22:53.598451 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3498e08a-ee5a-4d3c-be2c-7b7fed449da2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:22:53.599374 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3498e08a-ee5a-4d3c-be2c-7b7fed449da2 service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:22:53.599825 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3498e08a-ee5a-4d3c-be2c-7b7fed449da2 service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:22:53.600327 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3498e08a-ee5a-4d3c-be2c-7b7fed449da2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:22:53.611717 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3498e08a-ee5a-4d3c-be2c-7b7fed449da2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:22:53.614624 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3498e08a-ee5a-4d3c-be2c-7b7fed449da2 service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:22:53.628896 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1714/3435] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:22:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:22:53.711628 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1722/3436] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:22:53 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:22:53.724592 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3498e08a-ee5a-4d3c-be2c-7b7fed449da2 service neutron] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:22:53.726747 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-3498e08a-ee5a-4d3c-be2c-7b7fed449da2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:22:53.858245 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3498e08a-ee5a-4d3c-be2c-7b7fed449da2 service neutron] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:22:53.866682 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8687b78a-fd3f-4f80-afe3-3f814d8d2d56 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:22:53.868690 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8687b78a-fd3f-4f80-afe3-3f814d8d2d56 service nova] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:22:53.869090 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8687b78a-fd3f-4f80-afe3-3f814d8d2d56 service nova] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:22:53.869461 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8687b78a-fd3f-4f80-afe3-3f814d8d2d56 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:22:53.881943 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8687b78a-fd3f-4f80-afe3-3f814d8d2d56 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:22:53.883241 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8687b78a-fd3f-4f80-afe3-3f814d8d2d56 service nova] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:22:53.894540 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1715/3437] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:22:53 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:22:54.342658 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28660bb-4fab-4ca8-bf7b-db2f11195848 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:22:54.344303 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-d28660bb-4fab-4ca8-bf7b-db2f11195848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:22:54.415932 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28660bb-4fab-4ca8-bf7b-db2f11195848 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:22:54.433117 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c71277a-59f2-436b-af29-40a8a7d56518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:22:54.434201 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c71277a-59f2-436b-af29-40a8a7d56518 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:22:54.434513 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c71277a-59f2-436b-af29-40a8a7d56518 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:22:54.434803 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c71277a-59f2-436b-af29-40a8a7d56518 admin admin] PATH_INFO: `/v3/projects/df514a56fdad4584b0f15212ff29698c` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:22:54.436745 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c71277a-59f2-436b-af29-40a8a7d56518 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df514a56fdad4584b0f15212ff29698c)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:22:54.444723 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c71277a-59f2-436b-af29-40a8a7d56518 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:22:54.663587 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:22:54.677333 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-0c71277a-59f2-436b-af29-40a8a7d56518 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df514a56fdad4584b0f15212ff29698c', 'request_id': 'req-0c71277a-59f2-436b-af29-40a8a7d56518'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:22:54.701281 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-0c71277a-59f2-436b-af29-40a8a7d56518 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df514a56fdad4584b0f15212ff29698c', 'request_id': 'req-0c71277a-59f2-436b-af29-40a8a7d56518'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:22:54.722571 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-0c71277a-59f2-436b-af29-40a8a7d56518 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df514a56fdad4584b0f15212ff29698c', 'request_id': 'req-0c71277a-59f2-436b-af29-40a8a7d56518'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:22:54.752490 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-0c71277a-59f2-436b-af29-40a8a7d56518 admin admin] The token cache is being invalidate because project df514a56fdad4584b0f15212ff29698c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:22:54.752907 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-0c71277a-59f2-436b-af29-40a8a7d56518 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:22:54.753854 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-0c71277a-59f2-436b-af29-40a8a7d56518 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:22:54.760842 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1723/3438] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:22:54 2022] DELETE /identity/v3/projects/df514a56fdad4584b0f15212ff29698c => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:22:54.762842 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf9bb8c-13f6-41a2-90d8-a3612ee36332 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:22:54.763283 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf9bb8c-13f6-41a2-90d8-a3612ee36332 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:22:54.763517 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf9bb8c-13f6-41a2-90d8-a3612ee36332 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:22:54.798927 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-bdf9bb8c-13f6-41a2-90d8-a3612ee36332 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:22:54.800457 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-bdf9bb8c-13f6-41a2-90d8-a3612ee36332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:22:54.885210 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:22:54.910117 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1716/3439] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:22:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:22:54.920173 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7263eb5d-0eea-4e73-a0f0-cb25148bce9f None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:22:54.920400 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7263eb5d-0eea-4e73-a0f0-cb25148bce9f None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:22:54.920925 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7263eb5d-0eea-4e73-a0f0-cb25148bce9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:22:54.955987 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-7263eb5d-0eea-4e73-a0f0-cb25148bce9f None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:22:54.959180 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-7263eb5d-0eea-4e73-a0f0-cb25148bce9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:22:54.988091 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf9bb8c-13f6-41a2-90d8-a3612ee36332 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:22:54.995221 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1724/3440] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:22:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:22:55.006216 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf9bb8c-13f6-41a2-90d8-a3612ee36332 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:22:55.016718 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46fb596-5c27-446b-9ba8-077185ac1dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:22:55.017646 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46fb596-5c27-446b-9ba8-077185ac1dea admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:22:55.018251 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46fb596-5c27-446b-9ba8-077185ac1dea admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:22:55.018748 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46fb596-5c27-446b-9ba8-077185ac1dea admin admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:22:55.020217 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46fb596-5c27-446b-9ba8-077185ac1dea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:22:55.020723 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46fb596-5c27-446b-9ba8-077185ac1dea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:22:55.022791 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46fb596-5c27-446b-9ba8-077185ac1dea admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:22:55.050055 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7263eb5d-0eea-4e73-a0f0-cb25148bce9f None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:22:55.051746 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1717/3441] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:22:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:22:55.062550 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7263eb5d-0eea-4e73-a0f0-cb25148bce9f None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:22:55.068199 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dc4b91-095b-481d-bd8c-afd225a37e67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:22:55.069012 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dc4b91-095b-481d-bd8c-afd225a37e67 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:22:55.069390 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dc4b91-095b-481d-bd8c-afd225a37e67 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:22:55.069808 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dc4b91-095b-481d-bd8c-afd225a37e67 admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:22:55.070929 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dc4b91-095b-481d-bd8c-afd225a37e67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:22:55.072976 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dc4b91-095b-481d-bd8c-afd225a37e67 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:22:55.119757 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1725/3442] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:22:55 2022] POST /identity/v3/projects => generated 375 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:22:55.122495 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46fb596-5c27-446b-9ba8-077185ac1dea admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:22:55.139537 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46fb596-5c27-446b-9ba8-077185ac1dea admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:22:55.276527 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31c9d5f-3f8a-48c6-82ab-1734a93b1ae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:22:55.277584 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31c9d5f-3f8a-48c6-82ab-1734a93b1ae9 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:22:55.277901 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31c9d5f-3f8a-48c6-82ab-1734a93b1ae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:22:55.278208 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31c9d5f-3f8a-48c6-82ab-1734a93b1ae9 admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:22:55.278888 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31c9d5f-3f8a-48c6-82ab-1734a93b1ae9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:22:55.280936 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31c9d5f-3f8a-48c6-82ab-1734a93b1ae9 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:22:55.321481 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1718/3443] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:22:55 2022] POST /identity/v3/users => generated 288 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:22:55.323404 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dc4b91-095b-481d-bd8c-afd225a37e67 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:22:55.336908 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dc4b91-095b-481d-bd8c-afd225a37e67 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:22:55.342808 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6e7d83-e60b-4835-b923-024d28b09dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:22:55.343634 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6e7d83-e60b-4835-b923-024d28b09dc5 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:22:55.343998 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6e7d83-e60b-4835-b923-024d28b09dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:22:55.344333 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6e7d83-e60b-4835-b923-024d28b09dc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:22:55.345426 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6e7d83-e60b-4835-b923-024d28b09dc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:22:55.347443 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6e7d83-e60b-4835-b923-024d28b09dc5 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:22:55.360783 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1726/3444] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:22:55 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:22:55.366421 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31c9d5f-3f8a-48c6-82ab-1734a93b1ae9 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:22:55.385401 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31c9d5f-3f8a-48c6-82ab-1734a93b1ae9 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:22:55.392921 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dbc35e-74d9-4f60-9339-c7a90b11bd56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:22:55.394068 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dbc35e-74d9-4f60-9339-c7a90b11bd56 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:22:55.394355 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dbc35e-74d9-4f60-9339-c7a90b11bd56 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:22:55.394629 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dbc35e-74d9-4f60-9339-c7a90b11bd56 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:22:55.395836 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dbc35e-74d9-4f60-9339-c7a90b11bd56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:22:55.398281 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dbc35e-74d9-4f60-9339-c7a90b11bd56 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:22:55.414388 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1719/3445] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:22:55 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:22:55.418757 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6e7d83-e60b-4835-b923-024d28b09dc5 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:22:55.431589 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6e7d83-e60b-4835-b923-024d28b09dc5 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:22:55.440190 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead3ff7b-08e4-4e99-b7b5-ae03bc79c49d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:22:55.443505 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead3ff7b-08e4-4e99-b7b5-ae03bc79c49d admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:22:55.444668 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead3ff7b-08e4-4e99-b7b5-ae03bc79c49d admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:22:55.445000 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead3ff7b-08e4-4e99-b7b5-ae03bc79c49d admin admin] PATH_INFO: `/v3/projects/d3ff73d603ec4069a908452514a59451/users/e74c139b38d74d9ab93695471ccd3a2c/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:22:55.471865 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead3ff7b-08e4-4e99-b7b5-ae03bc79c49d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3ff73d603ec4069a908452514a59451, user_id=e74c139b38d74d9ab93695471ccd3a2c, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:22:55.475486 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead3ff7b-08e4-4e99-b7b5-ae03bc79c49d admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:22:55.525297 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1727/3446] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:22:55 2022] PUT /identity/v3/projects/d3ff73d603ec4069a908452514a59451/users/e74c139b38d74d9ab93695471ccd3a2c/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:22:55.533499 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aea40a8-520b-44fc-818d-d536aa2f9bc0 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:22:55.534004 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aea40a8-520b-44fc-818d-d536aa2f9bc0 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:22:55.534356 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aea40a8-520b-44fc-818d-d536aa2f9bc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:22:55.589778 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-3aea40a8-520b-44fc-818d-d536aa2f9bc0 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:22:55.591465 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-3aea40a8-520b-44fc-818d-d536aa2f9bc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:22:55.730706 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1720/3447] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:22:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:22:55.785099 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead3ff7b-08e4-4e99-b7b5-ae03bc79c49d admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:22:55.791696 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-ead3ff7b-08e4-4e99-b7b5-ae03bc79c49d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:22:55.973792 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead3ff7b-08e4-4e99-b7b5-ae03bc79c49d admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:22:55.978808 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdd3ffa-3974-4baf-83e0-221b7c46a2df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:22:55.979601 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdd3ffa-3974-4baf-83e0-221b7c46a2df service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:22:55.980070 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdd3ffa-3974-4baf-83e0-221b7c46a2df service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:22:55.980460 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdd3ffa-3974-4baf-83e0-221b7c46a2df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:22:56.005409 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdd3ffa-3974-4baf-83e0-221b7c46a2df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:22:56.008879 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdd3ffa-3974-4baf-83e0-221b7c46a2df service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:22:56.025994 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1728/3448] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:22:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:23:00.689109 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb507003-d56e-4786-90db-ade7bb4596db None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:23:00.689725 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb507003-d56e-4786-90db-ade7bb4596db None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:23:00.689725 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb507003-d56e-4786-90db-ade7bb4596db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:23:00.728959 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-cb507003-d56e-4786-90db-ade7bb4596db None None] MFA Rules not processed for user `17b779a3e21a415bb42cde5d6863d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:23:00.730484 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-cb507003-d56e-4786-90db-ade7bb4596db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:23:00.886626 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:23:00.898448 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1721/3449] 10.222.0.17 () {58 vars in 1009 bytes} [Sat Jul 23 21:23:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:23:00.913423 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdd3ffa-3974-4baf-83e0-221b7c46a2df service neutron] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:23:00.915093 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-ffdd3ffa-3974-4baf-83e0-221b7c46a2df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:23:01.045772 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdd3ffa-3974-4baf-83e0-221b7c46a2df service neutron] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:23:01.053925 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd2d924-ecf3-4465-8683-1361cb7336ff service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f0a685b7da46afb81024848f079d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:23:01.054917 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd2d924-ecf3-4465-8683-1361cb7336ff service swift] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:23:01.055359 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd2d924-ecf3-4465-8683-1361cb7336ff service swift] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:23:01.055793 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd2d924-ecf3-4465-8683-1361cb7336ff service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:23:01.075285 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd2d924-ecf3-4465-8683-1361cb7336ff service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:23:01.087721 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd2d924-ecf3-4465-8683-1361cb7336ff service swift] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:23:01.101959 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1729/3450] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 23 21:23:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 23 21:23:03.219988 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd887432-f2d6-4682-98d1-700e437c4635 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:23:03.221836 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd887432-f2d6-4682-98d1-700e437c4635 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:23:03.222991 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd887432-f2d6-4682-98d1-700e437c4635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:23:03.250445 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-cd887432-f2d6-4682-98d1-700e437c4635 None None] MFA Rules not processed for user `63ca7a39a8174a4b97767245e80b2bf7`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:23:03.251789 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-cd887432-f2d6-4682-98d1-700e437c4635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:23:03.337444 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1722/3451] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:23:03 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:23:05.718925 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d770bcf0-f528-4f33-bfc4-661a8a9164b3 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:23:05.720157 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d770bcf0-f528-4f33-bfc4-661a8a9164b3 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:23:05.720860 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d770bcf0-f528-4f33-bfc4-661a8a9164b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:23:05.735190 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:DELETE=4,keystone:SELECT=93,keystone:INSERT=3 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:23:05.814086 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-d770bcf0-f528-4f33-bfc4-661a8a9164b3 None None] MFA Rules not processed for user `e74c139b38d74d9ab93695471ccd3a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:23:05.815733 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-d770bcf0-f528-4f33-bfc4-661a8a9164b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:23:06.006550 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1730/3452] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:23:05 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:23:06.018926 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd887432-f2d6-4682-98d1-700e437c4635 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:23:06.035135 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd887432-f2d6-4682-98d1-700e437c4635 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:23:06.042174 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9d0958-8f91-487f-b947-dd7dcb2598a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:23:06.043883 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9d0958-8f91-487f-b947-dd7dcb2598a3 service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:23:06.044945 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9d0958-8f91-487f-b947-dd7dcb2598a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:23:06.045366 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9d0958-8f91-487f-b947-dd7dcb2598a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:23:06.061432 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9d0958-8f91-487f-b947-dd7dcb2598a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:23:06.063298 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9d0958-8f91-487f-b947-dd7dcb2598a3 service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:23:06.076009 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1723/3453] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:23:06 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:23:13.480073 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dadd0a-b16e-4f3d-9bcc-c9cf647e8171 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:23:13.480633 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dadd0a-b16e-4f3d-9bcc-c9cf647e8171 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:23:13.480727 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dadd0a-b16e-4f3d-9bcc-c9cf647e8171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:23:13.528248 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-87dadd0a-b16e-4f3d-9bcc-c9cf647e8171 None None] MFA Rules not processed for user `e74c139b38d74d9ab93695471ccd3a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:23:13.529480 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-87dadd0a-b16e-4f3d-9bcc-c9cf647e8171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:23:13.544689 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1731/3454] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:23:13 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:23:16.070166 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=31 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:23:17.518495 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9d0958-8f91-487f-b947-dd7dcb2598a3 service neutron] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:23:17.528477 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-fe9d0958-8f91-487f-b947-dd7dcb2598a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:23:17.590447 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9d0958-8f91-487f-b947-dd7dcb2598a3 service neutron] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:23:17.624216 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8fa10d-3495-46fc-9d61-951ab54e2e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:23:17.633674 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8fa10d-3495-46fc-9d61-951ab54e2e65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:23:17.634001 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8fa10d-3495-46fc-9d61-951ab54e2e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:23:17.634473 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8fa10d-3495-46fc-9d61-951ab54e2e65 admin admin] PATH_INFO: `/v3/users/0e6d2a0cb8d14246bb42268a159968f7` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:23:17.637382 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8fa10d-3495-46fc-9d61-951ab54e2e65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e6d2a0cb8d14246bb42268a159968f7)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:23:17.639373 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8fa10d-3495-46fc-9d61-951ab54e2e65 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:23:17.845311 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-9b8fa10d-3495-46fc-9d61-951ab54e2e65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e6d2a0cb8d14246bb42268a159968f7'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:23:17.862604 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-9b8fa10d-3495-46fc-9d61-951ab54e2e65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e6d2a0cb8d14246bb42268a159968f7'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:23:17.865422 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-9b8fa10d-3495-46fc-9d61-951ab54e2e65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e6d2a0cb8d14246bb42268a159968f7'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:23:17.894083 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-9b8fa10d-3495-46fc-9d61-951ab54e2e65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e6d2a0cb8d14246bb42268a159968f7'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:23:17.910334 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-9b8fa10d-3495-46fc-9d61-951ab54e2e65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e6d2a0cb8d14246bb42268a159968f7'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:23:17.934206 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1724/3455] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:23:17 2022] DELETE /identity/v3/users/0e6d2a0cb8d14246bb42268a159968f7 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:23:18.625378 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dadd0a-b16e-4f3d-9bcc-c9cf647e8171 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:23:18.650509 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dadd0a-b16e-4f3d-9bcc-c9cf647e8171 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:23:18.881590 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6806f0-d7c5-4b0c-9dd4-d6637b63a257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:23:18.882902 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6806f0-d7c5-4b0c-9dd4-d6637b63a257 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:23:18.883423 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6806f0-d7c5-4b0c-9dd4-d6637b63a257 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:23:18.884047 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6806f0-d7c5-4b0c-9dd4-d6637b63a257 admin admin] PATH_INFO: `/v3/projects/1e5883af23b74caead47ef27b4fbb7bf` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:23:18.887498 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6806f0-d7c5-4b0c-9dd4-d6637b63a257 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e5883af23b74caead47ef27b4fbb7bf)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:23:18.890493 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6806f0-d7c5-4b0c-9dd4-d6637b63a257 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:23:18.986983 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-1b6806f0-d7c5-4b0c-9dd4-d6637b63a257 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e5883af23b74caead47ef27b4fbb7bf', 'request_id': 'req-1b6806f0-d7c5-4b0c-9dd4-d6637b63a257'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:23:19.003292 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-1b6806f0-d7c5-4b0c-9dd4-d6637b63a257 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e5883af23b74caead47ef27b4fbb7bf', 'request_id': 'req-1b6806f0-d7c5-4b0c-9dd4-d6637b63a257'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:23:19.014245 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-1b6806f0-d7c5-4b0c-9dd4-d6637b63a257 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e5883af23b74caead47ef27b4fbb7bf', 'request_id': 'req-1b6806f0-d7c5-4b0c-9dd4-d6637b63a257'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:23:19.043734 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-1b6806f0-d7c5-4b0c-9dd4-d6637b63a257 admin admin] The token cache is being invalidate because project 1e5883af23b74caead47ef27b4fbb7bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:23:19.044465 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-1b6806f0-d7c5-4b0c-9dd4-d6637b63a257 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:23:19.046369 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-1b6806f0-d7c5-4b0c-9dd4-d6637b63a257 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:23:19.058806 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de87bb8f-9b9c-4949-8519-6bcd29a03ac7 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:23:19.059784 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de87bb8f-9b9c-4949-8519-6bcd29a03ac7 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:23:19.060246 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de87bb8f-9b9c-4949-8519-6bcd29a03ac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:23:19.068870 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1732/3456] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:23:18 2022] DELETE /identity/v3/projects/1e5883af23b74caead47ef27b4fbb7bf => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:23:19.083918 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-de87bb8f-9b9c-4949-8519-6bcd29a03ac7 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:23:19.085648 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-de87bb8f-9b9c-4949-8519-6bcd29a03ac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:23:19.181795 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1725/3457] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:23:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:23:19.195257 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defb1b9c-d8c8-46d1-b3f9-7401639ddc25 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:23:19.198085 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defb1b9c-d8c8-46d1-b3f9-7401639ddc25 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:23:19.198960 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defb1b9c-d8c8-46d1-b3f9-7401639ddc25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:23:19.242298 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-defb1b9c-d8c8-46d1-b3f9-7401639ddc25 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:23:19.244159 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-defb1b9c-d8c8-46d1-b3f9-7401639ddc25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:23:19.272694 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1733/3458] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:23:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:23:19.273615 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de87bb8f-9b9c-4949-8519-6bcd29a03ac7 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:23:19.295094 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de87bb8f-9b9c-4949-8519-6bcd29a03ac7 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:23:19.311867 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8468c9e9-f4d9-4953-b87d-2be4aeb3e750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:23:19.312571 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8468c9e9-f4d9-4953-b87d-2be4aeb3e750 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:23:19.312851 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8468c9e9-f4d9-4953-b87d-2be4aeb3e750 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:23:19.313125 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8468c9e9-f4d9-4953-b87d-2be4aeb3e750 admin admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:23:19.315249 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8468c9e9-f4d9-4953-b87d-2be4aeb3e750 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:23:19.315981 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8468c9e9-f4d9-4953-b87d-2be4aeb3e750 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:23:19.318119 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8468c9e9-f4d9-4953-b87d-2be4aeb3e750 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:23:19.334646 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1726/3459] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:23:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 21:23:19.339413 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defb1b9c-d8c8-46d1-b3f9-7401639ddc25 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:23:19.353437 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defb1b9c-d8c8-46d1-b3f9-7401639ddc25 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:23:19.362520 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eee0feb-1f48-43c3-9fb5-c41b544068c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:23:19.363340 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eee0feb-1f48-43c3-9fb5-c41b544068c6 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:23:19.363684 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eee0feb-1f48-43c3-9fb5-c41b544068c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:23:19.364143 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eee0feb-1f48-43c3-9fb5-c41b544068c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:23:19.364907 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eee0feb-1f48-43c3-9fb5-c41b544068c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:23:19.372994 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eee0feb-1f48-43c3-9fb5-c41b544068c6 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:23:19.378404 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:23:19.443619 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1734/3460] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:23:19 2022] POST /identity/v3/projects => generated 383 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:23:19.447802 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8468c9e9-f4d9-4953-b87d-2be4aeb3e750 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:23:19.462573 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8468c9e9-f4d9-4953-b87d-2be4aeb3e750 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:23:19.594039 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4730b5ec-8895-4045-bde5-2bb15272dc23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:23:19.595916 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4730b5ec-8895-4045-bde5-2bb15272dc23 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:23:19.596362 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4730b5ec-8895-4045-bde5-2bb15272dc23 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:23:19.597310 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4730b5ec-8895-4045-bde5-2bb15272dc23 admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:23:19.598235 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4730b5ec-8895-4045-bde5-2bb15272dc23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:23:19.601199 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4730b5ec-8895-4045-bde5-2bb15272dc23 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:23:19.611859 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:23:19.696699 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1727/3461] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:23:19 2022] POST /identity/v3/users => generated 292 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:23:19.699218 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eee0feb-1f48-43c3-9fb5-c41b544068c6 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:23:19.721387 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eee0feb-1f48-43c3-9fb5-c41b544068c6 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:23:19.737656 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5a93d5-47cd-4726-9889-ba5aa33e7716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:23:19.739225 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5a93d5-47cd-4726-9889-ba5aa33e7716 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:23:19.739957 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5a93d5-47cd-4726-9889-ba5aa33e7716 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:23:19.741196 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5a93d5-47cd-4726-9889-ba5aa33e7716 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:23:19.746391 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5a93d5-47cd-4726-9889-ba5aa33e7716 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:23:19.751040 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5a93d5-47cd-4726-9889-ba5aa33e7716 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:23:19.776690 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1735/3462] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:23:19 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:23:19.781872 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4730b5ec-8895-4045-bde5-2bb15272dc23 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:23:19.797665 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4730b5ec-8895-4045-bde5-2bb15272dc23 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:23:19.812912 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df32c23-3bb4-4cc1-85d8-01e321a8987a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:23:19.814363 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df32c23-3bb4-4cc1-85d8-01e321a8987a admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:23:19.815743 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df32c23-3bb4-4cc1-85d8-01e321a8987a admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:23:19.816032 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df32c23-3bb4-4cc1-85d8-01e321a8987a admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:23:19.817098 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df32c23-3bb4-4cc1-85d8-01e321a8987a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:23:19.818824 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df32c23-3bb4-4cc1-85d8-01e321a8987a admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:23:19.839988 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1728/3463] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:23:19 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:23:19.841488 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5a93d5-47cd-4726-9889-ba5aa33e7716 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:23:19.860537 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5a93d5-47cd-4726-9889-ba5aa33e7716 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:23:19.876509 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ac7834-7674-4d9f-9012-896c1fac1a62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:23:19.878137 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ac7834-7674-4d9f-9012-896c1fac1a62 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:23:19.878529 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ac7834-7674-4d9f-9012-896c1fac1a62 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:23:19.878898 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ac7834-7674-4d9f-9012-896c1fac1a62 admin admin] PATH_INFO: `/v3/projects/1432b2e152894407afae7b6419d80a8c/users/013b521930d54d6d952e566f8e67f466/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:23:19.901324 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ac7834-7674-4d9f-9012-896c1fac1a62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1432b2e152894407afae7b6419d80a8c, user_id=013b521930d54d6d952e566f8e67f466, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:23:19.905002 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ac7834-7674-4d9f-9012-896c1fac1a62 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:23:19.950882 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1736/3464] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:23:19 2022] PUT /identity/v3/projects/1432b2e152894407afae7b6419d80a8c/users/013b521930d54d6d952e566f8e67f466/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:23:19.955032 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9095325-fe71-4d71-9884-8f0e7b64e867 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:23:19.955479 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9095325-fe71-4d71-9884-8f0e7b64e867 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:23:19.955957 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9095325-fe71-4d71-9884-8f0e7b64e867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:23:19.999100 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-b9095325-fe71-4d71-9884-8f0e7b64e867 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:23:20.000346 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-b9095325-fe71-4d71-9884-8f0e7b64e867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:23:20.109214 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1729/3465] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:23:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:23:20.118821 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ac7834-7674-4d9f-9012-896c1fac1a62 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:23:20.121190 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-46ac7834-7674-4d9f-9012-896c1fac1a62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:23:20.204826 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ac7834-7674-4d9f-9012-896c1fac1a62 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:23:20.209760 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f989b63a-aba3-4a41-b7c4-14c80e750965 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:23:20.210538 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f989b63a-aba3-4a41-b7c4-14c80e750965 service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:23:20.210832 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f989b63a-aba3-4a41-b7c4-14c80e750965 service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:23:20.215243 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f989b63a-aba3-4a41-b7c4-14c80e750965 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:23:20.227029 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f989b63a-aba3-4a41-b7c4-14c80e750965 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:23:20.228760 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f989b63a-aba3-4a41-b7c4-14c80e750965 service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:23:20.243917 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1737/3466] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:23:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 23 21:23:25.264217 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc05244-4efa-429a-95fd-4ba8cb0eda25 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:23:25.264805 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc05244-4efa-429a-95fd-4ba8cb0eda25 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:23:25.264805 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc05244-4efa-429a-95fd-4ba8cb0eda25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:23:25.283897 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-1cc05244-4efa-429a-95fd-4ba8cb0eda25 None None] MFA Rules not processed for user `17b779a3e21a415bb42cde5d6863d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:23:25.285477 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-1cc05244-4efa-429a-95fd-4ba8cb0eda25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:23:25.358520 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1730/3467] 10.222.0.17 () {58 vars in 967 bytes} [Sat Jul 23 21:23:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:23:25.370509 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f989b63a-aba3-4a41-b7c4-14c80e750965 service neutron] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:23:25.372328 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-f989b63a-aba3-4a41-b7c4-14c80e750965 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:23:25.469281 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f989b63a-aba3-4a41-b7c4-14c80e750965 service neutron] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:23:25.477058 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96019ce6-8497-4dad-aabc-38b5608d4f6f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f0a685b7da46afb81024848f079d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:23:25.477728 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96019ce6-8497-4dad-aabc-38b5608d4f6f service swift] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:23:25.478105 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96019ce6-8497-4dad-aabc-38b5608d4f6f service swift] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:23:25.478387 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96019ce6-8497-4dad-aabc-38b5608d4f6f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:23:25.487729 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96019ce6-8497-4dad-aabc-38b5608d4f6f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:23:25.489693 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96019ce6-8497-4dad-aabc-38b5608d4f6f service swift] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:23:25.499479 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1738/3468] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 23 21:23:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 23 21:23:27.980882 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc05244-4efa-429a-95fd-4ba8cb0eda25 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:23:27.982480 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-1cc05244-4efa-429a-95fd-4ba8cb0eda25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:23:28.009805 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc05244-4efa-429a-95fd-4ba8cb0eda25 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:23:28.022377 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571ec3a1-1733-4917-8157-425e51959a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:23:28.024435 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571ec3a1-1733-4917-8157-425e51959a99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:23:28.025908 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571ec3a1-1733-4917-8157-425e51959a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:23:28.026172 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571ec3a1-1733-4917-8157-425e51959a99 admin admin] PATH_INFO: `/v3/users/efc72b47672e46659b1a5ebdfd99224c` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:23:28.029701 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571ec3a1-1733-4917-8157-425e51959a99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=efc72b47672e46659b1a5ebdfd99224c)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:23:28.035009 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571ec3a1-1733-4917-8157-425e51959a99 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:23:28.194530 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-571ec3a1-1733-4917-8157-425e51959a99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'efc72b47672e46659b1a5ebdfd99224c'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:23:28.211310 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-571ec3a1-1733-4917-8157-425e51959a99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'efc72b47672e46659b1a5ebdfd99224c'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:23:28.212146 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-571ec3a1-1733-4917-8157-425e51959a99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'efc72b47672e46659b1a5ebdfd99224c'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:23:28.231019 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-571ec3a1-1733-4917-8157-425e51959a99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'efc72b47672e46659b1a5ebdfd99224c'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:23:28.258018 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:INSERT=4,keystone:SELECT=86,keystone:DELETE=10 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:23:28.262601 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-571ec3a1-1733-4917-8157-425e51959a99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'efc72b47672e46659b1a5ebdfd99224c'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:23:28.283505 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1731/3469] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:23:27 2022] DELETE /identity/v3/users/efc72b47672e46659b1a5ebdfd99224c => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:23:29.273828 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96019ce6-8497-4dad-aabc-38b5608d4f6f service swift] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:23:29.312282 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96019ce6-8497-4dad-aabc-38b5608d4f6f service swift] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:23:29.451652 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:23:29.492746 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff52e93a-7930-48ef-92fe-2de39d63ce27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:23:29.494460 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff52e93a-7930-48ef-92fe-2de39d63ce27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:23:29.495085 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff52e93a-7930-48ef-92fe-2de39d63ce27 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:23:29.496210 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff52e93a-7930-48ef-92fe-2de39d63ce27 admin admin] PATH_INFO: `/v3/projects/01cd9b8837554b8daf506ca062ec916b` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:23:29.497929 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff52e93a-7930-48ef-92fe-2de39d63ce27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01cd9b8837554b8daf506ca062ec916b)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:23:29.500301 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff52e93a-7930-48ef-92fe-2de39d63ce27 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:23:29.617912 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-ff52e93a-7930-48ef-92fe-2de39d63ce27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01cd9b8837554b8daf506ca062ec916b', 'request_id': 'req-ff52e93a-7930-48ef-92fe-2de39d63ce27'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:23:29.644533 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-ff52e93a-7930-48ef-92fe-2de39d63ce27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01cd9b8837554b8daf506ca062ec916b', 'request_id': 'req-ff52e93a-7930-48ef-92fe-2de39d63ce27'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:23:29.653372 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-ff52e93a-7930-48ef-92fe-2de39d63ce27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01cd9b8837554b8daf506ca062ec916b', 'request_id': 'req-ff52e93a-7930-48ef-92fe-2de39d63ce27'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:23:29.681958 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-ff52e93a-7930-48ef-92fe-2de39d63ce27 admin admin] The token cache is being invalidate because project 01cd9b8837554b8daf506ca062ec916b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:23:29.682503 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-ff52e93a-7930-48ef-92fe-2de39d63ce27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:23:29.683457 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-ff52e93a-7930-48ef-92fe-2de39d63ce27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:23:29.691219 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1739/3470] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:23:29 2022] DELETE /identity/v3/projects/01cd9b8837554b8daf506ca062ec916b => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:23:29.692383 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafd3d21-6125-47f2-8b23-98f37258e560 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:23:29.692888 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafd3d21-6125-47f2-8b23-98f37258e560 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:23:29.692978 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafd3d21-6125-47f2-8b23-98f37258e560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:23:29.716800 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-aafd3d21-6125-47f2-8b23-98f37258e560 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:23:29.718098 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-aafd3d21-6125-47f2-8b23-98f37258e560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:23:29.802852 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1732/3471] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:23:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:23:29.811420 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789ee7d5-693f-420d-a4cc-5029d0cc1fd9 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:23:29.811718 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789ee7d5-693f-420d-a4cc-5029d0cc1fd9 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:23:29.811993 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789ee7d5-693f-420d-a4cc-5029d0cc1fd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:23:29.832766 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-789ee7d5-693f-420d-a4cc-5029d0cc1fd9 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:23:29.834116 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-789ee7d5-693f-420d-a4cc-5029d0cc1fd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:23:29.843296 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1740/3472] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:23:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:23:29.847462 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafd3d21-6125-47f2-8b23-98f37258e560 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:23:29.858013 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafd3d21-6125-47f2-8b23-98f37258e560 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:23:29.863009 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5425306-2d8a-413d-a7b7-40c1e8d87421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:23:29.863770 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5425306-2d8a-413d-a7b7-40c1e8d87421 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:23:29.864114 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5425306-2d8a-413d-a7b7-40c1e8d87421 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:23:29.864449 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5425306-2d8a-413d-a7b7-40c1e8d87421 admin admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:23:29.866115 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5425306-2d8a-413d-a7b7-40c1e8d87421 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:23:29.866901 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5425306-2d8a-413d-a7b7-40c1e8d87421 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:23:29.870897 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5425306-2d8a-413d-a7b7-40c1e8d87421 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:23:29.884948 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1733/3473] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:23:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:23:29.891106 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789ee7d5-693f-420d-a4cc-5029d0cc1fd9 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:23:29.901444 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789ee7d5-693f-420d-a4cc-5029d0cc1fd9 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:23:29.909807 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5980587a-336c-478e-99b4-82dd28edd259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:23:29.909807 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5980587a-336c-478e-99b4-82dd28edd259 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:23:29.910194 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5980587a-336c-478e-99b4-82dd28edd259 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:23:29.910392 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5980587a-336c-478e-99b4-82dd28edd259 admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:23:29.911002 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5980587a-336c-478e-99b4-82dd28edd259 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:23:29.913214 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5980587a-336c-478e-99b4-82dd28edd259 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:23:29.962060 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1741/3474] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:23:29 2022] POST /identity/v3/projects => generated 397 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:23:29.964145 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5425306-2d8a-413d-a7b7-40c1e8d87421 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:23:29.974309 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5425306-2d8a-413d-a7b7-40c1e8d87421 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:23:30.002813 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5980587a-336c-478e-99b4-82dd28edd259 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:23:30.005527 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-5980587a-336c-478e-99b4-82dd28edd259 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:23:30.064375 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edfb1cf-c2c7-4386-beb9-662d0e692946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:23:30.066409 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edfb1cf-c2c7-4386-beb9-662d0e692946 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:23:30.067318 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edfb1cf-c2c7-4386-beb9-662d0e692946 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:23:30.069552 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edfb1cf-c2c7-4386-beb9-662d0e692946 admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:23:30.070686 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edfb1cf-c2c7-4386-beb9-662d0e692946 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:23:30.073317 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edfb1cf-c2c7-4386-beb9-662d0e692946 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:23:30.085722 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5980587a-336c-478e-99b4-82dd28edd259 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:23:30.097795 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa370cc9-1e54-48ef-995b-87ff5f09e329 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:23:30.098755 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa370cc9-1e54-48ef-995b-87ff5f09e329 service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:23:30.099129 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa370cc9-1e54-48ef-995b-87ff5f09e329 service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:23:30.099598 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa370cc9-1e54-48ef-995b-87ff5f09e329 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:23:30.105569 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-fa370cc9-1e54-48ef-995b-87ff5f09e329 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:23:30.113317 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1734/3475] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:23:29 2022] POST /identity/v3/users => generated 299 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:23:30.126056 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edfb1cf-c2c7-4386-beb9-662d0e692946 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:23:30.147854 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edfb1cf-c2c7-4386-beb9-662d0e692946 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:23:30.165194 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469410b1-7b52-4b4c-9cac-1b9307b8a441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:23:30.165928 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469410b1-7b52-4b4c-9cac-1b9307b8a441 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:23:30.166216 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469410b1-7b52-4b4c-9cac-1b9307b8a441 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:23:30.166491 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469410b1-7b52-4b4c-9cac-1b9307b8a441 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:23:30.167300 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469410b1-7b52-4b4c-9cac-1b9307b8a441 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:23:30.169108 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469410b1-7b52-4b4c-9cac-1b9307b8a441 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:23:30.182156 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1735/3476] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:23:30 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:23:30.185839 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469410b1-7b52-4b4c-9cac-1b9307b8a441 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:23:30.186608 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:23:30.223291 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa370cc9-1e54-48ef-995b-87ff5f09e329 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:23:30.225024 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa370cc9-1e54-48ef-995b-87ff5f09e329 service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:23:30.233103 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469410b1-7b52-4b4c-9cac-1b9307b8a441 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:23:30.240006 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1742/3477] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:23:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 23 21:23:30.242546 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cfc3a9-cfcd-4b42-bab7-a7aec8d310e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:23:30.243316 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cfc3a9-cfcd-4b42-bab7-a7aec8d310e2 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:23:30.243664 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cfc3a9-cfcd-4b42-bab7-a7aec8d310e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:23:30.244019 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cfc3a9-cfcd-4b42-bab7-a7aec8d310e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:23:30.244889 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cfc3a9-cfcd-4b42-bab7-a7aec8d310e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:23:30.249979 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cfc3a9-cfcd-4b42-bab7-a7aec8d310e2 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:23:30.271959 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1736/3478] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:23:30 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 21:23:30.276449 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa370cc9-1e54-48ef-995b-87ff5f09e329 service neutron] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:23:30.299545 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa370cc9-1e54-48ef-995b-87ff5f09e329 service neutron] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:23:30.306139 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02cf29e-e4ff-48b0-95bc-86ee1655eb5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:23:30.307497 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02cf29e-e4ff-48b0-95bc-86ee1655eb5f admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:23:30.307897 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02cf29e-e4ff-48b0-95bc-86ee1655eb5f admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:23:30.308236 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02cf29e-e4ff-48b0-95bc-86ee1655eb5f admin admin] PATH_INFO: `/v3/projects/a14294b18c6e4936b1272a57d4faccce/users/7a812b6571db40a1a2f138dc03d4e1be/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:23:30.333555 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02cf29e-e4ff-48b0-95bc-86ee1655eb5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a14294b18c6e4936b1272a57d4faccce, user_id=7a812b6571db40a1a2f138dc03d4e1be, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:23:30.340399 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02cf29e-e4ff-48b0-95bc-86ee1655eb5f admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:23:30.373348 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1743/3479] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:23:30 2022] PUT /identity/v3/projects/a14294b18c6e4936b1272a57d4faccce/users/7a812b6571db40a1a2f138dc03d4e1be/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:23:30.378526 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ab3ba1-a0b4-48c7-b9d9-9b5006ab4322 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:23:30.378810 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ab3ba1-a0b4-48c7-b9d9-9b5006ab4322 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:23:30.379825 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ab3ba1-a0b4-48c7-b9d9-9b5006ab4322 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:23:30.415792 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-a1ab3ba1-a0b4-48c7-b9d9-9b5006ab4322 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:23:30.417147 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-a1ab3ba1-a0b4-48c7-b9d9-9b5006ab4322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:23:30.469819 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:23:30.496827 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1737/3480] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:23:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:23:30.540396 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02cf29e-e4ff-48b0-95bc-86ee1655eb5f admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:23:30.627289 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02cf29e-e4ff-48b0-95bc-86ee1655eb5f admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:23:30.633947 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc287aa-02d9-4134-9538-f4686c77f8e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:23:30.635128 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc287aa-02d9-4134-9538-f4686c77f8e0 service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:23:30.637166 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc287aa-02d9-4134-9538-f4686c77f8e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:23:30.637663 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc287aa-02d9-4134-9538-f4686c77f8e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:23:30.650464 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc287aa-02d9-4134-9538-f4686c77f8e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:23:30.653016 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc287aa-02d9-4134-9538-f4686c77f8e0 service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:23:30.667941 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1744/3481] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:23:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:23:31.012401 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ab3ba1-a0b4-48c7-b9d9-9b5006ab4322 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:23:31.014049 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-a1ab3ba1-a0b4-48c7-b9d9-9b5006ab4322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:23:31.128755 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ab3ba1-a0b4-48c7-b9d9-9b5006ab4322 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:23:31.133008 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ffcb66-340d-43c0-a71a-888f98d55d57 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7f2db148c8e4d5d81431cae3576434b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:23:31.133692 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ffcb66-340d-43c0-a71a-888f98d55d57 service glance] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:23:31.134164 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ffcb66-340d-43c0-a71a-888f98d55d57 service glance] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:23:31.134331 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ffcb66-340d-43c0-a71a-888f98d55d57 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:23:31.136310 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-05ffcb66-340d-43c0-a71a-888f98d55d57 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:23:31.221068 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ffcb66-340d-43c0-a71a-888f98d55d57 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:23:31.221588 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ffcb66-340d-43c0-a71a-888f98d55d57 service glance] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:23:31.236470 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1738/3482] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:23:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:23:32.228786 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8c47d0-4b17-4d60-9302-a8fa05079881 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:23:32.229290 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8c47d0-4b17-4d60-9302-a8fa05079881 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:23:32.229652 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8c47d0-4b17-4d60-9302-a8fa05079881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:23:32.297643 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-2a8c47d0-4b17-4d60-9302-a8fa05079881 None None] MFA Rules not processed for user `17b779a3e21a415bb42cde5d6863d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:23:32.299357 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-2a8c47d0-4b17-4d60-9302-a8fa05079881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:23:32.467049 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1745/3483] 10.222.0.17 () {58 vars in 1009 bytes} [Sat Jul 23 21:23:32 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:23:32.467416 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ffcb66-340d-43c0-a71a-888f98d55d57 service glance] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:23:32.469056 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-05ffcb66-340d-43c0-a71a-888f98d55d57 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:23:32.699566 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ffcb66-340d-43c0-a71a-888f98d55d57 service glance] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:23:32.732758 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3748d26-512e-447a-8a61-246ad4e64be0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f0a685b7da46afb81024848f079d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:23:32.736455 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3748d26-512e-447a-8a61-246ad4e64be0 service swift] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:23:32.736737 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3748d26-512e-447a-8a61-246ad4e64be0 service swift] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:23:32.737002 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3748d26-512e-447a-8a61-246ad4e64be0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:23:32.786405 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3748d26-512e-447a-8a61-246ad4e64be0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:23:32.788429 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3748d26-512e-447a-8a61-246ad4e64be0 service swift] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:23:32.806631 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1739/3484] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 23 21:23:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 23 21:23:34.495309 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e895f4c8-aa88-4e41-8e0f-f671a898642c None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:23:34.496173 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e895f4c8-aa88-4e41-8e0f-f671a898642c None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:23:34.496249 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e895f4c8-aa88-4e41-8e0f-f671a898642c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:23:34.599838 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-e895f4c8-aa88-4e41-8e0f-f671a898642c None None] MFA Rules not processed for user `013b521930d54d6d952e566f8e67f466`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:23:34.602829 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-e895f4c8-aa88-4e41-8e0f-f671a898642c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:23:34.714923 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:23:34.742980 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1746/3485] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:23:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:23:35.405518 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3748d26-512e-447a-8a61-246ad4e64be0 service swift] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:23:35.408029 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-f3748d26-512e-447a-8a61-246ad4e64be0 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:23:35.427902 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:23:35.456935 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3748d26-512e-447a-8a61-246ad4e64be0 service swift] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:23:35.486308 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea3a721-3e52-4c5f-88f4-ea4b2c995bc9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:23:35.486990 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea3a721-3e52-4c5f-88f4-ea4b2c995bc9 service nova] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:23:35.487270 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea3a721-3e52-4c5f-88f4-ea4b2c995bc9 service nova] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:23:35.487540 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea3a721-3e52-4c5f-88f4-ea4b2c995bc9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:23:35.520687 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea3a721-3e52-4c5f-88f4-ea4b2c995bc9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:23:35.522489 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea3a721-3e52-4c5f-88f4-ea4b2c995bc9 service nova] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:23:35.546225 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1740/3486] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:23:35 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:23:37.678162 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e895f4c8-aa88-4e41-8e0f-f671a898642c None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:23:37.694116 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e895f4c8-aa88-4e41-8e0f-f671a898642c None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:23:37.703451 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0363f0de-e560-4b3a-8893-363dc70cbd46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:23:37.705149 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0363f0de-e560-4b3a-8893-363dc70cbd46 service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:23:37.708458 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0363f0de-e560-4b3a-8893-363dc70cbd46 service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:23:37.708881 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0363f0de-e560-4b3a-8893-363dc70cbd46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:23:37.713725 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-0363f0de-e560-4b3a-8893-363dc70cbd46 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:23:37.738858 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0363f0de-e560-4b3a-8893-363dc70cbd46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:23:37.740812 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0363f0de-e560-4b3a-8893-363dc70cbd46 service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:23:37.765047 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1747/3487] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:23:37 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:23:40.709720 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24736333-b51e-4fd3-9d64-c15bce0967ca None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:23:40.710332 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24736333-b51e-4fd3-9d64-c15bce0967ca None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:23:40.710332 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24736333-b51e-4fd3-9d64-c15bce0967ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:23:40.746616 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-24736333-b51e-4fd3-9d64-c15bce0967ca None None] MFA Rules not processed for user `013b521930d54d6d952e566f8e67f466`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:23:40.747869 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-24736333-b51e-4fd3-9d64-c15bce0967ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:23:40.789787 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1741/3488] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:23:40 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:23:42.799432 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0363f0de-e560-4b3a-8893-363dc70cbd46 service neutron] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:23:42.801027 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-0363f0de-e560-4b3a-8893-363dc70cbd46 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:23:42.989776 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0363f0de-e560-4b3a-8893-363dc70cbd46 service neutron] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:23:43.005879 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c7f42a-6b78-44d1-a4ba-c87ab56cfdd7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc719a3b3ac4461b82ca04ab6451d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:23:43.006753 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c7f42a-6b78-44d1-a4ba-c87ab56cfdd7 service placement] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:23:43.007196 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c7f42a-6b78-44d1-a4ba-c87ab56cfdd7 service placement] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:23:43.007617 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c7f42a-6b78-44d1-a4ba-c87ab56cfdd7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:23:43.015801 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-a8c7f42a-6b78-44d1-a4ba-c87ab56cfdd7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:23:43.055456 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c7f42a-6b78-44d1-a4ba-c87ab56cfdd7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:23:43.057498 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c7f42a-6b78-44d1-a4ba-c87ab56cfdd7 service placement] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:23:43.087376 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1748/3489] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:23:42 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:23:45.836577 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448e1e0c-5c52-4e3b-8028-a25627ddb067 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:23:45.837122 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448e1e0c-5c52-4e3b-8028-a25627ddb067 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:23:45.837122 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448e1e0c-5c52-4e3b-8028-a25627ddb067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:23:45.885285 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-448e1e0c-5c52-4e3b-8028-a25627ddb067 None None] MFA Rules not processed for user `7a812b6571db40a1a2f138dc03d4e1be`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:23:45.894696 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-448e1e0c-5c52-4e3b-8028-a25627ddb067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:23:46.037421 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1742/3490] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:23:45 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:23:46.049998 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ef6345-38a7-4afe-8b17-35cc0494c07f None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:23:46.051023 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ef6345-38a7-4afe-8b17-35cc0494c07f None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:23:46.051450 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ef6345-38a7-4afe-8b17-35cc0494c07f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:23:46.101463 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-a0ef6345-38a7-4afe-8b17-35cc0494c07f None None] MFA Rules not processed for user `7a812b6571db40a1a2f138dc03d4e1be`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:23:46.106991 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-a0ef6345-38a7-4afe-8b17-35cc0494c07f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:23:46.126133 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1749/3491] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:23:46 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:23:46.513633 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448e1e0c-5c52-4e3b-8028-a25627ddb067 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:23:46.535972 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448e1e0c-5c52-4e3b-8028-a25627ddb067 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:23:46.545781 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d28108-0ecb-4088-bbb7-6b3ceb81bbc4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:23:46.546616 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d28108-0ecb-4088-bbb7-6b3ceb81bbc4 service nova] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:23:46.546987 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d28108-0ecb-4088-bbb7-6b3ceb81bbc4 service nova] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:23:46.547355 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d28108-0ecb-4088-bbb7-6b3ceb81bbc4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:23:46.566885 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d28108-0ecb-4088-bbb7-6b3ceb81bbc4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:23:46.568597 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d28108-0ecb-4088-bbb7-6b3ceb81bbc4 service nova] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:23:46.597987 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1743/3492] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:23:46 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:23:47.245630 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ef6345-38a7-4afe-8b17-35cc0494c07f None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:23:47.247080 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-a0ef6345-38a7-4afe-8b17-35cc0494c07f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:23:47.281819 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ef6345-38a7-4afe-8b17-35cc0494c07f None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:23:47.306645 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a1b025-a3cd-43e8-8a37-36bf6032be76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:23:47.307615 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a1b025-a3cd-43e8-8a37-36bf6032be76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:23:47.307896 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a1b025-a3cd-43e8-8a37-36bf6032be76 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:23:47.308171 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a1b025-a3cd-43e8-8a37-36bf6032be76 admin admin] PATH_INFO: `/v3/users/ebf93a4b80cb4e19a36473986950fc75` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:23:47.314873 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a1b025-a3cd-43e8-8a37-36bf6032be76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ebf93a4b80cb4e19a36473986950fc75)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:23:47.317052 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a1b025-a3cd-43e8-8a37-36bf6032be76 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:23:47.419547 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-97a1b025-a3cd-43e8-8a37-36bf6032be76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ebf93a4b80cb4e19a36473986950fc75'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:23:47.422761 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-97a1b025-a3cd-43e8-8a37-36bf6032be76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ebf93a4b80cb4e19a36473986950fc75'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:23:47.446010 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-97a1b025-a3cd-43e8-8a37-36bf6032be76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ebf93a4b80cb4e19a36473986950fc75'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:23:47.486748 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-97a1b025-a3cd-43e8-8a37-36bf6032be76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ebf93a4b80cb4e19a36473986950fc75'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:23:47.509942 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-97a1b025-a3cd-43e8-8a37-36bf6032be76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ebf93a4b80cb4e19a36473986950fc75'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:23:47.523879 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1750/3493] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:23:47 2022] DELETE /identity/v3/users/ebf93a4b80cb4e19a36473986950fc75 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:23:47.528553 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467cbe95-5f5b-489d-bc38-f2e5ff02664d None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:23:47.529091 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467cbe95-5f5b-489d-bc38-f2e5ff02664d None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:23:47.529091 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467cbe95-5f5b-489d-bc38-f2e5ff02664d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:23:47.556912 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-467cbe95-5f5b-489d-bc38-f2e5ff02664d None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:23:47.559013 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-467cbe95-5f5b-489d-bc38-f2e5ff02664d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:23:47.668312 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1744/3494] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:23:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:23:47.669534 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a1b025-a3cd-43e8-8a37-36bf6032be76 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:23:47.671511 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-97a1b025-a3cd-43e8-8a37-36bf6032be76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:23:47.797821 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:23:47.878511 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a1b025-a3cd-43e8-8a37-36bf6032be76 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:23:47.890741 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba57f4c-3e98-488a-a240-0310f0657101 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:23:47.891436 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba57f4c-3e98-488a-a240-0310f0657101 service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:23:47.891716 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba57f4c-3e98-488a-a240-0310f0657101 service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:23:47.891981 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba57f4c-3e98-488a-a240-0310f0657101 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:23:47.912597 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba57f4c-3e98-488a-a240-0310f0657101 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:23:47.916308 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba57f4c-3e98-488a-a240-0310f0657101 service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:23:47.967123 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1751/3495] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:23:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:23:48.799294 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467cbe95-5f5b-489d-bc38-f2e5ff02664d None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:23:48.800978 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-467cbe95-5f5b-489d-bc38-f2e5ff02664d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:23:48.854049 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467cbe95-5f5b-489d-bc38-f2e5ff02664d None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:23:48.864950 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67c8f6e-ec02-454b-ac7b-697cd6974601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:23:48.866135 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67c8f6e-ec02-454b-ac7b-697cd6974601 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:23:48.866654 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67c8f6e-ec02-454b-ac7b-697cd6974601 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:23:48.867139 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67c8f6e-ec02-454b-ac7b-697cd6974601 admin admin] PATH_INFO: `/v3/projects/35c1943188684b45b636541caf587247` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:23:48.868545 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67c8f6e-ec02-454b-ac7b-697cd6974601 admin admin] RBAC: Authorizing `identity:delete_project(project_id=35c1943188684b45b636541caf587247)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:23:48.871116 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67c8f6e-ec02-454b-ac7b-697cd6974601 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:23:49.057159 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-e67c8f6e-ec02-454b-ac7b-697cd6974601 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35c1943188684b45b636541caf587247', 'request_id': 'req-e67c8f6e-ec02-454b-ac7b-697cd6974601'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:23:49.070313 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:23:49.076821 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-e67c8f6e-ec02-454b-ac7b-697cd6974601 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35c1943188684b45b636541caf587247', 'request_id': 'req-e67c8f6e-ec02-454b-ac7b-697cd6974601'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:23:49.088119 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-e67c8f6e-ec02-454b-ac7b-697cd6974601 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35c1943188684b45b636541caf587247', 'request_id': 'req-e67c8f6e-ec02-454b-ac7b-697cd6974601'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:23:49.143480 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-e67c8f6e-ec02-454b-ac7b-697cd6974601 admin admin] The token cache is being invalidate because project 35c1943188684b45b636541caf587247 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:23:49.144437 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-e67c8f6e-ec02-454b-ac7b-697cd6974601 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:23:49.145099 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-e67c8f6e-ec02-454b-ac7b-697cd6974601 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:23:49.149882 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1745/3496] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:23:48 2022] DELETE /identity/v3/projects/35c1943188684b45b636541caf587247 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:23:49.151297 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba57f4c-3e98-488a-a240-0310f0657101 service neutron] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:23:49.164368 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba57f4c-3e98-488a-a240-0310f0657101 service neutron] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:23:49.396962 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c040d0d-60e4-4b74-bffb-2af59164e1f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:23:49.398367 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c040d0d-60e4-4b74-bffb-2af59164e1f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:23:49.398866 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c040d0d-60e4-4b74-bffb-2af59164e1f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:23:49.399767 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c040d0d-60e4-4b74-bffb-2af59164e1f9 admin admin] PATH_INFO: `/v3/users/6cfbfb39775e4b16b4c62322c0d88375` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:23:49.402541 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c040d0d-60e4-4b74-bffb-2af59164e1f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6cfbfb39775e4b16b4c62322c0d88375)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:23:49.405293 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c040d0d-60e4-4b74-bffb-2af59164e1f9 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:23:49.590653 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-0c040d0d-60e4-4b74-bffb-2af59164e1f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6cfbfb39775e4b16b4c62322c0d88375'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:23:49.594622 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-0c040d0d-60e4-4b74-bffb-2af59164e1f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6cfbfb39775e4b16b4c62322c0d88375'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:23:49.622357 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-0c040d0d-60e4-4b74-bffb-2af59164e1f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6cfbfb39775e4b16b4c62322c0d88375'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:23:49.654149 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-0c040d0d-60e4-4b74-bffb-2af59164e1f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6cfbfb39775e4b16b4c62322c0d88375'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:23:49.696218 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-0c040d0d-60e4-4b74-bffb-2af59164e1f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6cfbfb39775e4b16b4c62322c0d88375'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:23:49.710295 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1752/3497] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:23:49 2022] DELETE /identity/v3/users/6cfbfb39775e4b16b4c62322c0d88375 => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:23:50.508299 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67c8f6e-ec02-454b-ac7b-697cd6974601 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:23:50.509789 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-e67c8f6e-ec02-454b-ac7b-697cd6974601 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:23:50.541102 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67c8f6e-ec02-454b-ac7b-697cd6974601 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:23:50.711617 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ee1b79-6de8-4cb5-b157-697c59bae3a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:23:50.712520 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ee1b79-6de8-4cb5-b157-697c59bae3a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:23:50.712803 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ee1b79-6de8-4cb5-b157-697c59bae3a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:23:50.713092 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ee1b79-6de8-4cb5-b157-697c59bae3a8 admin admin] PATH_INFO: `/v3/projects/f76f4ad9750349ef83781bf6ea23416f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:23:50.716659 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ee1b79-6de8-4cb5-b157-697c59bae3a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f76f4ad9750349ef83781bf6ea23416f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:23:50.721317 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ee1b79-6de8-4cb5-b157-697c59bae3a8 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:23:50.868011 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-d1ee1b79-6de8-4cb5-b157-697c59bae3a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f76f4ad9750349ef83781bf6ea23416f', 'request_id': 'req-d1ee1b79-6de8-4cb5-b157-697c59bae3a8'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:23:50.888681 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-d1ee1b79-6de8-4cb5-b157-697c59bae3a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f76f4ad9750349ef83781bf6ea23416f', 'request_id': 'req-d1ee1b79-6de8-4cb5-b157-697c59bae3a8'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:23:50.907404 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-d1ee1b79-6de8-4cb5-b157-697c59bae3a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f76f4ad9750349ef83781bf6ea23416f', 'request_id': 'req-d1ee1b79-6de8-4cb5-b157-697c59bae3a8'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:23:50.930836 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-d1ee1b79-6de8-4cb5-b157-697c59bae3a8 admin admin] The token cache is being invalidate because project f76f4ad9750349ef83781bf6ea23416f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:23:50.931225 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-d1ee1b79-6de8-4cb5-b157-697c59bae3a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:23:50.932175 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-d1ee1b79-6de8-4cb5-b157-697c59bae3a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:23:50.934213 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1746/3498] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:23:50 2022] DELETE /identity/v3/projects/f76f4ad9750349ef83781bf6ea23416f => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:23:50.943345 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b3bb05-313c-44d6-9539-e617211b822e None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:23:50.944655 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b3bb05-313c-44d6-9539-e617211b822e None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:23:50.944944 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b3bb05-313c-44d6-9539-e617211b822e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:23:51.032803 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-03b3bb05-313c-44d6-9539-e617211b822e None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:23:51.046167 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-03b3bb05-313c-44d6-9539-e617211b822e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:23:51.261177 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:23:51.293046 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1753/3499] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:23:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 354 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:23:51.377921 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e0865c-8fe6-4f33-bc6c-f232bb8f9c6a None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:23:51.378423 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e0865c-8fe6-4f33-bc6c-f232bb8f9c6a None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:23:51.378844 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e0865c-8fe6-4f33-bc6c-f232bb8f9c6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:23:51.414948 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-12e0865c-8fe6-4f33-bc6c-f232bb8f9c6a None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:23:51.419188 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-12e0865c-8fe6-4f33-bc6c-f232bb8f9c6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:23:51.448827 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1747/3500] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:23:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:23:51.450344 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b3bb05-313c-44d6-9539-e617211b822e None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:23:51.469432 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b3bb05-313c-44d6-9539-e617211b822e None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:23:51.483083 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b29341-9dfa-42f0-9f85-911337f935a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:23:51.483789 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b29341-9dfa-42f0-9f85-911337f935a8 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:23:51.484072 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b29341-9dfa-42f0-9f85-911337f935a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:23:51.484352 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b29341-9dfa-42f0-9f85-911337f935a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:23:51.485099 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b29341-9dfa-42f0-9f85-911337f935a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:23:51.485404 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b29341-9dfa-42f0-9f85-911337f935a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:23:51.487081 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b29341-9dfa-42f0-9f85-911337f935a8 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:23:51.529007 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1754/3501] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:23:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:23:51.530811 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e0865c-8fe6-4f33-bc6c-f232bb8f9c6a None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:23:51.552460 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e0865c-8fe6-4f33-bc6c-f232bb8f9c6a None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:23:51.578648 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ed814d-d0fa-48b0-8904-80f4aa4a0688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:23:51.579724 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ed814d-d0fa-48b0-8904-80f4aa4a0688 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:23:51.580166 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ed814d-d0fa-48b0-8904-80f4aa4a0688 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:23:51.582824 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ed814d-d0fa-48b0-8904-80f4aa4a0688 admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:23:51.583682 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ed814d-d0fa-48b0-8904-80f4aa4a0688 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:23:51.587256 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ed814d-d0fa-48b0-8904-80f4aa4a0688 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:23:51.671384 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1748/3502] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:23:51 2022] POST /identity/v3/projects => generated 377 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:23:51.674385 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b29341-9dfa-42f0-9f85-911337f935a8 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:23:51.696513 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b29341-9dfa-42f0-9f85-911337f935a8 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:23:51.909406 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca65a170-a1a6-43ce-aef1-84129245b63a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:23:51.910887 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca65a170-a1a6-43ce-aef1-84129245b63a admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:23:51.911309 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca65a170-a1a6-43ce-aef1-84129245b63a admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:23:51.911770 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca65a170-a1a6-43ce-aef1-84129245b63a admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:23:51.913514 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca65a170-a1a6-43ce-aef1-84129245b63a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:23:51.950624 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca65a170-a1a6-43ce-aef1-84129245b63a admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:23:52.025717 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1755/3503] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:23:51 2022] POST /identity/v3/users => generated 289 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:23:52.030112 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ed814d-d0fa-48b0-8904-80f4aa4a0688 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:23:52.048058 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ed814d-d0fa-48b0-8904-80f4aa4a0688 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:23:52.056635 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c71ff0-359e-499a-a760-ddb223895c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:23:52.057894 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c71ff0-359e-499a-a760-ddb223895c99 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:23:52.058442 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c71ff0-359e-499a-a760-ddb223895c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:23:52.058987 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c71ff0-359e-499a-a760-ddb223895c99 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:23:52.066192 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c71ff0-359e-499a-a760-ddb223895c99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:23:52.068572 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c71ff0-359e-499a-a760-ddb223895c99 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:23:52.084586 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1749/3504] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:23:52 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:23:52.092915 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca65a170-a1a6-43ce-aef1-84129245b63a admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:23:52.129524 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca65a170-a1a6-43ce-aef1-84129245b63a admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:23:52.151087 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e371adb5-dfef-4042-90f7-92a4773844bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:23:52.152097 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e371adb5-dfef-4042-90f7-92a4773844bd admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:23:52.152527 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e371adb5-dfef-4042-90f7-92a4773844bd admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:23:52.152948 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e371adb5-dfef-4042-90f7-92a4773844bd admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:23:52.155252 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e371adb5-dfef-4042-90f7-92a4773844bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:23:52.158359 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e371adb5-dfef-4042-90f7-92a4773844bd admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:23:52.198551 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1756/3505] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:23:52 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:23:52.201130 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c71ff0-359e-499a-a760-ddb223895c99 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:23:52.227199 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c71ff0-359e-499a-a760-ddb223895c99 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:23:52.252867 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaf3a3f-a3b5-4161-94e4-e04cf55fb9d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:23:52.254261 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaf3a3f-a3b5-4161-94e4-e04cf55fb9d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:23:52.254689 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaf3a3f-a3b5-4161-94e4-e04cf55fb9d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:23:52.255106 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaf3a3f-a3b5-4161-94e4-e04cf55fb9d5 admin admin] PATH_INFO: `/v3/projects/5f9408b5b6f443ef8bf7145470e98898/users/205d792f772f40299f089509d216d531/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:23:52.306760 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaf3a3f-a3b5-4161-94e4-e04cf55fb9d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f9408b5b6f443ef8bf7145470e98898, user_id=205d792f772f40299f089509d216d531, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:23:52.315829 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaf3a3f-a3b5-4161-94e4-e04cf55fb9d5 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:23:52.344593 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1750/3506] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:23:52 2022] PUT /identity/v3/projects/5f9408b5b6f443ef8bf7145470e98898/users/205d792f772f40299f089509d216d531/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:23:52.355736 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ab6bbb-6781-4e54-aab8-ac668a85ac15 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:23:52.356289 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ab6bbb-6781-4e54-aab8-ac668a85ac15 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:23:52.356747 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ab6bbb-6781-4e54-aab8-ac668a85ac15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:23:52.431980 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-67ab6bbb-6781-4e54-aab8-ac668a85ac15 None None] MFA Rules not processed for user `205d792f772f40299f089509d216d531`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:23:52.432826 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-67ab6bbb-6781-4e54-aab8-ac668a85ac15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:23:52.616184 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1757/3507] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:23:52 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:23:52.621068 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaf3a3f-a3b5-4161-94e4-e04cf55fb9d5 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:23:52.669759 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:23:52.822314 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaf3a3f-a3b5-4161-94e4-e04cf55fb9d5 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:23:52.836168 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819369fd-e9ab-40a6-8a5e-757460f4c29e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:23:52.837449 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819369fd-e9ab-40a6-8a5e-757460f4c29e admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:23:52.837746 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819369fd-e9ab-40a6-8a5e-757460f4c29e admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:23:52.838050 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819369fd-e9ab-40a6-8a5e-757460f4c29e admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:23:52.839022 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819369fd-e9ab-40a6-8a5e-757460f4c29e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:23:52.852909 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819369fd-e9ab-40a6-8a5e-757460f4c29e admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:23:52.927214 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1751/3508] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:23:52 2022] POST /identity/v3/projects => generated 377 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:23:52.931293 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ab6bbb-6781-4e54-aab8-ac668a85ac15 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:23:52.954372 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ab6bbb-6781-4e54-aab8-ac668a85ac15 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:23:53.118949 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:23:53.146628 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93d0f5d-e007-4392-95ed-ceeaa3485e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:23:53.147380 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93d0f5d-e007-4392-95ed-ceeaa3485e7a admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:23:53.147674 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93d0f5d-e007-4392-95ed-ceeaa3485e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:23:53.147949 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93d0f5d-e007-4392-95ed-ceeaa3485e7a admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:23:53.148655 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93d0f5d-e007-4392-95ed-ceeaa3485e7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:23:53.151017 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93d0f5d-e007-4392-95ed-ceeaa3485e7a admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:23:53.189113 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1758/3509] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:23:52 2022] POST /identity/v3/users => generated 295 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:23:53.190390 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819369fd-e9ab-40a6-8a5e-757460f4c29e admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:23:53.225799 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819369fd-e9ab-40a6-8a5e-757460f4c29e admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:23:53.248795 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72391c0-7cbe-4618-8910-7d8576e462f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:23:53.249770 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72391c0-7cbe-4618-8910-7d8576e462f7 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:23:53.250232 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72391c0-7cbe-4618-8910-7d8576e462f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:23:53.250624 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72391c0-7cbe-4618-8910-7d8576e462f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:23:53.251470 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72391c0-7cbe-4618-8910-7d8576e462f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:23:53.260931 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72391c0-7cbe-4618-8910-7d8576e462f7 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:23:53.290788 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1752/3510] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:23:53 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:23:53.292745 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93d0f5d-e007-4392-95ed-ceeaa3485e7a admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:23:53.314369 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93d0f5d-e007-4392-95ed-ceeaa3485e7a admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:23:53.323459 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce1b805-8f22-4e72-9d48-734116c01940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:23:53.324627 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce1b805-8f22-4e72-9d48-734116c01940 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:23:53.324952 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce1b805-8f22-4e72-9d48-734116c01940 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:23:53.326238 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce1b805-8f22-4e72-9d48-734116c01940 admin admin] PATH_INFO: `/v3/projects/3f8b25e2d4464d8089958748c63dbf91/users/e3a4c3a7d832439282e6db39da0681f1/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:23:53.393428 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce1b805-8f22-4e72-9d48-734116c01940 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f8b25e2d4464d8089958748c63dbf91, user_id=e3a4c3a7d832439282e6db39da0681f1, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:23:53.396389 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce1b805-8f22-4e72-9d48-734116c01940 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:23:53.457013 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1759/3511] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:23:53 2022] PUT /identity/v3/projects/3f8b25e2d4464d8089958748c63dbf91/users/e3a4c3a7d832439282e6db39da0681f1/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:23:53.461154 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72391c0-7cbe-4618-8910-7d8576e462f7 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:23:53.475680 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72391c0-7cbe-4618-8910-7d8576e462f7 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:23:53.593631 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4376739b-1851-416f-9884-c0234cf04abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:23:53.594516 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4376739b-1851-416f-9884-c0234cf04abf admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:23:53.594970 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4376739b-1851-416f-9884-c0234cf04abf admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:23:53.595272 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4376739b-1851-416f-9884-c0234cf04abf admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:23:53.596121 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4376739b-1851-416f-9884-c0234cf04abf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:23:53.598644 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4376739b-1851-416f-9884-c0234cf04abf admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:23:53.615693 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1753/3512] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:23:53 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:23:53.617008 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce1b805-8f22-4e72-9d48-734116c01940 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:23:53.631986 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce1b805-8f22-4e72-9d48-734116c01940 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:23:53.648598 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a0be98-f973-4fba-9311-9ad278e27571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:23:53.650108 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a0be98-f973-4fba-9311-9ad278e27571 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:23:53.650468 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a0be98-f973-4fba-9311-9ad278e27571 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:23:53.650820 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a0be98-f973-4fba-9311-9ad278e27571 admin admin] PATH_INFO: `/v3/projects/3f8b25e2d4464d8089958748c63dbf91/users/e3a4c3a7d832439282e6db39da0681f1/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:23:53.653130 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a0be98-f973-4fba-9311-9ad278e27571 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f8b25e2d4464d8089958748c63dbf91, user_id=e3a4c3a7d832439282e6db39da0681f1, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:23:53.657012 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a0be98-f973-4fba-9311-9ad278e27571 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:23:53.679012 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1760/3513] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:23:53 2022] PUT /identity/v3/projects/3f8b25e2d4464d8089958748c63dbf91/users/e3a4c3a7d832439282e6db39da0681f1/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:23:53.688850 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1273135-9a6b-44db-9857-7216516cc26c None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:23:53.689702 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1273135-9a6b-44db-9857-7216516cc26c None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:23:53.690239 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1273135-9a6b-44db-9857-7216516cc26c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:23:53.740804 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-b1273135-9a6b-44db-9857-7216516cc26c None None] MFA Rules not processed for user `e3a4c3a7d832439282e6db39da0681f1`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:23:53.742418 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-b1273135-9a6b-44db-9857-7216516cc26c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:23:53.925687 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1754/3514] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:23:53 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:23:54.018381 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a0be98-f973-4fba-9311-9ad278e27571 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:23:54.020355 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-72a0be98-f973-4fba-9311-9ad278e27571 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:23:54.155805 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a0be98-f973-4fba-9311-9ad278e27571 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:23:54.164305 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a858d2ac-653b-4b37-950c-8e8bc4eeb1ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:23:54.165778 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a858d2ac-653b-4b37-950c-8e8bc4eeb1ee service nova] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:23:54.166245 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a858d2ac-653b-4b37-950c-8e8bc4eeb1ee service nova] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:23:54.166763 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a858d2ac-653b-4b37-950c-8e8bc4eeb1ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:23:54.179979 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a858d2ac-653b-4b37-950c-8e8bc4eeb1ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:23:54.183102 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a858d2ac-653b-4b37-950c-8e8bc4eeb1ee service nova] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:23:54.199085 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1761/3515] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:23:54 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:23:54.696747 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1273135-9a6b-44db-9857-7216516cc26c None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:23:54.703478 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:23:54.871588 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1273135-9a6b-44db-9857-7216516cc26c None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:23:54.889758 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d04243-8513-4d15-b560-141e5f0e66ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:23:54.891483 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d04243-8513-4d15-b560-141e5f0e66ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:23:54.891842 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d04243-8513-4d15-b560-141e5f0e66ca admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:23:54.892189 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d04243-8513-4d15-b560-141e5f0e66ca admin admin] PATH_INFO: `/v3/users/205d792f772f40299f089509d216d531` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:23:54.895018 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d04243-8513-4d15-b560-141e5f0e66ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=205d792f772f40299f089509d216d531)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:23:54.897089 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d04243-8513-4d15-b560-141e5f0e66ca admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:23:55.035072 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-b7d04243-8513-4d15-b560-141e5f0e66ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '205d792f772f40299f089509d216d531'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:23:55.053382 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-b7d04243-8513-4d15-b560-141e5f0e66ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '205d792f772f40299f089509d216d531'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:23:55.056209 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-b7d04243-8513-4d15-b560-141e5f0e66ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '205d792f772f40299f089509d216d531'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:23:55.070550 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-b7d04243-8513-4d15-b560-141e5f0e66ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '205d792f772f40299f089509d216d531'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:23:55.092061 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-b7d04243-8513-4d15-b560-141e5f0e66ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '205d792f772f40299f089509d216d531'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:23:55.105325 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1755/3516] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:23:54 2022] DELETE /identity/v3/users/205d792f772f40299f089509d216d531 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:23:55.112087 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731225fe-0f26-488e-bf02-ffd2eb1be359 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:23:55.112529 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731225fe-0f26-488e-bf02-ffd2eb1be359 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:23:55.112723 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731225fe-0f26-488e-bf02-ffd2eb1be359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:23:55.143904 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-731225fe-0f26-488e-bf02-ffd2eb1be359 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:23:55.145165 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-731225fe-0f26-488e-bf02-ffd2eb1be359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:23:55.300391 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1762/3517] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:23:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:23:55.325274 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d04243-8513-4d15-b560-141e5f0e66ca admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:23:55.327767 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-b7d04243-8513-4d15-b560-141e5f0e66ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:23:55.560411 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d04243-8513-4d15-b560-141e5f0e66ca admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:23:55.568961 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9b581a-91d9-47e6-9255-cdbf0a35374a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:23:55.569938 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9b581a-91d9-47e6-9255-cdbf0a35374a service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:23:55.570203 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9b581a-91d9-47e6-9255-cdbf0a35374a service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:23:55.570409 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9b581a-91d9-47e6-9255-cdbf0a35374a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:23:55.585222 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9b581a-91d9-47e6-9255-cdbf0a35374a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:23:55.586821 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9b581a-91d9-47e6-9255-cdbf0a35374a service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:23:55.615728 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1756/3518] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:23:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 23 21:23:56.801168 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731225fe-0f26-488e-bf02-ffd2eb1be359 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:23:56.803955 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-731225fe-0f26-488e-bf02-ffd2eb1be359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:23:56.862435 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731225fe-0f26-488e-bf02-ffd2eb1be359 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:23:56.879961 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673e2ae3-1fb2-4a77-b0dd-fb5f38cc144f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:23:56.881036 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673e2ae3-1fb2-4a77-b0dd-fb5f38cc144f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:23:56.882080 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673e2ae3-1fb2-4a77-b0dd-fb5f38cc144f admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:23:56.888290 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673e2ae3-1fb2-4a77-b0dd-fb5f38cc144f admin admin] PATH_INFO: `/v3/projects/5f9408b5b6f443ef8bf7145470e98898` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:23:56.890095 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673e2ae3-1fb2-4a77-b0dd-fb5f38cc144f admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f9408b5b6f443ef8bf7145470e98898)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:23:56.894406 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673e2ae3-1fb2-4a77-b0dd-fb5f38cc144f admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:23:56.933445 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:23:56.971203 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-673e2ae3-1fb2-4a77-b0dd-fb5f38cc144f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f9408b5b6f443ef8bf7145470e98898', 'request_id': 'req-673e2ae3-1fb2-4a77-b0dd-fb5f38cc144f'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:23:56.982311 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-673e2ae3-1fb2-4a77-b0dd-fb5f38cc144f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f9408b5b6f443ef8bf7145470e98898', 'request_id': 'req-673e2ae3-1fb2-4a77-b0dd-fb5f38cc144f'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:23:56.992630 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-673e2ae3-1fb2-4a77-b0dd-fb5f38cc144f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f9408b5b6f443ef8bf7145470e98898', 'request_id': 'req-673e2ae3-1fb2-4a77-b0dd-fb5f38cc144f'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:23:57.011824 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-673e2ae3-1fb2-4a77-b0dd-fb5f38cc144f admin admin] The token cache is being invalidate because project 5f9408b5b6f443ef8bf7145470e98898 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:23:57.012280 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-673e2ae3-1fb2-4a77-b0dd-fb5f38cc144f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:23:57.013141 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-673e2ae3-1fb2-4a77-b0dd-fb5f38cc144f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:23:57.015670 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1763/3519] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:23:56 2022] DELETE /identity/v3/projects/5f9408b5b6f443ef8bf7145470e98898 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:23:57.020653 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9b581a-91d9-47e6-9255-cdbf0a35374a service neutron] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:23:57.037835 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9b581a-91d9-47e6-9255-cdbf0a35374a service neutron] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:23:57.069566 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:23:57.115834 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2795f9da-3881-4925-b1eb-60cfd0fe38f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:23:57.117393 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2795f9da-3881-4925-b1eb-60cfd0fe38f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:23:57.117832 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2795f9da-3881-4925-b1eb-60cfd0fe38f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:23:57.118145 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2795f9da-3881-4925-b1eb-60cfd0fe38f0 admin admin] PATH_INFO: `/v3/users/e3a4c3a7d832439282e6db39da0681f1` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:23:57.119687 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2795f9da-3881-4925-b1eb-60cfd0fe38f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3a4c3a7d832439282e6db39da0681f1)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:23:57.122140 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2795f9da-3881-4925-b1eb-60cfd0fe38f0 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:23:57.208036 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-2795f9da-3881-4925-b1eb-60cfd0fe38f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3a4c3a7d832439282e6db39da0681f1'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:23:57.217600 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-2795f9da-3881-4925-b1eb-60cfd0fe38f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3a4c3a7d832439282e6db39da0681f1'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:23:57.218621 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-2795f9da-3881-4925-b1eb-60cfd0fe38f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3a4c3a7d832439282e6db39da0681f1'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:23:57.233161 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-2795f9da-3881-4925-b1eb-60cfd0fe38f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3a4c3a7d832439282e6db39da0681f1'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:23:57.274433 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-2795f9da-3881-4925-b1eb-60cfd0fe38f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3a4c3a7d832439282e6db39da0681f1'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:23:57.287784 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1757/3520] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:23:57 2022] DELETE /identity/v3/users/e3a4c3a7d832439282e6db39da0681f1 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:23:58.543472 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673e2ae3-1fb2-4a77-b0dd-fb5f38cc144f admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:23:58.544981 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-673e2ae3-1fb2-4a77-b0dd-fb5f38cc144f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:23:58.563593 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673e2ae3-1fb2-4a77-b0dd-fb5f38cc144f admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:23:58.633047 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25be8401-b4ab-471e-8b46-4a27e15caef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:23:58.633969 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25be8401-b4ab-471e-8b46-4a27e15caef3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:23:58.634249 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25be8401-b4ab-471e-8b46-4a27e15caef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:23:58.634517 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25be8401-b4ab-471e-8b46-4a27e15caef3 admin admin] PATH_INFO: `/v3/projects/3f8b25e2d4464d8089958748c63dbf91` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:23:58.635819 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25be8401-b4ab-471e-8b46-4a27e15caef3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f8b25e2d4464d8089958748c63dbf91)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:23:58.637846 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25be8401-b4ab-471e-8b46-4a27e15caef3 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:23:58.696333 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-25be8401-b4ab-471e-8b46-4a27e15caef3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f8b25e2d4464d8089958748c63dbf91', 'request_id': 'req-25be8401-b4ab-471e-8b46-4a27e15caef3'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:23:58.710436 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-25be8401-b4ab-471e-8b46-4a27e15caef3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f8b25e2d4464d8089958748c63dbf91', 'request_id': 'req-25be8401-b4ab-471e-8b46-4a27e15caef3'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:23:58.717832 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-25be8401-b4ab-471e-8b46-4a27e15caef3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f8b25e2d4464d8089958748c63dbf91', 'request_id': 'req-25be8401-b4ab-471e-8b46-4a27e15caef3'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:23:58.733243 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-25be8401-b4ab-471e-8b46-4a27e15caef3 admin admin] The token cache is being invalidate because project 3f8b25e2d4464d8089958748c63dbf91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:23:58.733514 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-25be8401-b4ab-471e-8b46-4a27e15caef3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:23:58.734513 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-25be8401-b4ab-471e-8b46-4a27e15caef3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:23:58.736132 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1764/3521] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:23:58 2022] DELETE /identity/v3/projects/3f8b25e2d4464d8089958748c63dbf91 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:23:58.742305 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f95e57-83d7-43aa-92d1-8e78a4590cbc None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:23:58.743817 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f95e57-83d7-43aa-92d1-8e78a4590cbc None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:23:58.744174 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f95e57-83d7-43aa-92d1-8e78a4590cbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:23:58.771781 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-a8f95e57-83d7-43aa-92d1-8e78a4590cbc None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:23:58.773006 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-a8f95e57-83d7-43aa-92d1-8e78a4590cbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:23:58.840192 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1758/3522] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:23:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:23:58.849465 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced75ff5-9c6b-46b6-89e8-e7ae74e07f94 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:23:58.849978 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced75ff5-9c6b-46b6-89e8-e7ae74e07f94 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:23:58.851009 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced75ff5-9c6b-46b6-89e8-e7ae74e07f94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:23:58.878239 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-ced75ff5-9c6b-46b6-89e8-e7ae74e07f94 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:23:58.879846 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-ced75ff5-9c6b-46b6-89e8-e7ae74e07f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:23:58.889190 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1765/3523] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:23:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:23:58.893619 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f95e57-83d7-43aa-92d1-8e78a4590cbc None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:23:58.905304 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f95e57-83d7-43aa-92d1-8e78a4590cbc None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:23:58.910236 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439c2b45-a831-421c-aa71-e15aa8001900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:23:58.910907 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439c2b45-a831-421c-aa71-e15aa8001900 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:23:58.911183 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439c2b45-a831-421c-aa71-e15aa8001900 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:23:58.911454 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439c2b45-a831-421c-aa71-e15aa8001900 admin admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:23:58.912184 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439c2b45-a831-421c-aa71-e15aa8001900 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:23:58.912540 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439c2b45-a831-421c-aa71-e15aa8001900 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:23:58.914346 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439c2b45-a831-421c-aa71-e15aa8001900 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:23:58.930203 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1759/3524] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:23:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:23:58.931810 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced75ff5-9c6b-46b6-89e8-e7ae74e07f94 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:23:58.945628 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced75ff5-9c6b-46b6-89e8-e7ae74e07f94 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:23:58.952401 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5ead80-46ff-4eec-a455-4b360c53e62c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:23:58.953067 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5ead80-46ff-4eec-a455-4b360c53e62c admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:23:58.953497 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5ead80-46ff-4eec-a455-4b360c53e62c admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:23:58.953947 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5ead80-46ff-4eec-a455-4b360c53e62c admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:23:58.954791 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5ead80-46ff-4eec-a455-4b360c53e62c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:23:58.956712 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5ead80-46ff-4eec-a455-4b360c53e62c admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:23:58.991686 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1766/3525] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:23:58 2022] POST /identity/v3/projects => generated 375 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:23:58.992896 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439c2b45-a831-421c-aa71-e15aa8001900 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:23:59.007562 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439c2b45-a831-421c-aa71-e15aa8001900 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:23:59.040250 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:23:59.084656 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d797584-0a21-4468-8f2c-6130f47133be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:23:59.085600 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d797584-0a21-4468-8f2c-6130f47133be admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:23:59.086088 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d797584-0a21-4468-8f2c-6130f47133be admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:23:59.086613 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d797584-0a21-4468-8f2c-6130f47133be admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:23:59.087358 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d797584-0a21-4468-8f2c-6130f47133be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:23:59.089932 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d797584-0a21-4468-8f2c-6130f47133be admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:23:59.124858 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1760/3526] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:23:58 2022] POST /identity/v3/users => generated 288 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:23:59.129675 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5ead80-46ff-4eec-a455-4b360c53e62c admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:23:59.144894 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5ead80-46ff-4eec-a455-4b360c53e62c admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:23:59.150239 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498399f0-bc9d-4c7e-b0ef-c8639f4783de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:23:59.151120 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498399f0-bc9d-4c7e-b0ef-c8639f4783de admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:23:59.151464 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498399f0-bc9d-4c7e-b0ef-c8639f4783de admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:23:59.151869 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498399f0-bc9d-4c7e-b0ef-c8639f4783de admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:23:59.152668 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498399f0-bc9d-4c7e-b0ef-c8639f4783de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:23:59.154423 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498399f0-bc9d-4c7e-b0ef-c8639f4783de admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:23:59.170162 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1767/3527] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:23:59 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:23:59.173738 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d797584-0a21-4468-8f2c-6130f47133be admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:23:59.184342 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d797584-0a21-4468-8f2c-6130f47133be admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:23:59.189077 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63e254d-2a28-4a4f-aa8e-0b989609d875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:23:59.189746 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63e254d-2a28-4a4f-aa8e-0b989609d875 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:23:59.190075 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63e254d-2a28-4a4f-aa8e-0b989609d875 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:23:59.190352 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63e254d-2a28-4a4f-aa8e-0b989609d875 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:23:59.191082 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63e254d-2a28-4a4f-aa8e-0b989609d875 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:23:59.192748 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63e254d-2a28-4a4f-aa8e-0b989609d875 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:23:59.206462 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1761/3528] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:23:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:23:59.208424 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498399f0-bc9d-4c7e-b0ef-c8639f4783de admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:23:59.213193 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:23:59.218887 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498399f0-bc9d-4c7e-b0ef-c8639f4783de admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:23:59.226725 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30baac55-edb9-498b-a981-42ac929f794c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:23:59.227805 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30baac55-edb9-498b-a981-42ac929f794c admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:23:59.227925 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30baac55-edb9-498b-a981-42ac929f794c admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:23:59.228178 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30baac55-edb9-498b-a981-42ac929f794c admin admin] PATH_INFO: `/v3/projects/37510f38df0a45a6bb7771bdb0fbe271/users/8bfb831babfd456e9cd186bab2ca14bb/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:23:59.253999 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30baac55-edb9-498b-a981-42ac929f794c admin admin] RBAC: Authorizing `identity:create_grant(project_id=37510f38df0a45a6bb7771bdb0fbe271, user_id=8bfb831babfd456e9cd186bab2ca14bb, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:23:59.257013 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30baac55-edb9-498b-a981-42ac929f794c admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:23:59.280125 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1768/3529] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:23:59 2022] PUT /identity/v3/projects/37510f38df0a45a6bb7771bdb0fbe271/users/8bfb831babfd456e9cd186bab2ca14bb/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:23:59.291046 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf078777-af36-4621-9a5b-d5b7f1792482 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:23:59.291335 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf078777-af36-4621-9a5b-d5b7f1792482 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:23:59.291684 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf078777-af36-4621-9a5b-d5b7f1792482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:23:59.325444 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-cf078777-af36-4621-9a5b-d5b7f1792482 None None] MFA Rules not processed for user `8bfb831babfd456e9cd186bab2ca14bb`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:23:59.328271 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-cf078777-af36-4621-9a5b-d5b7f1792482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:23:59.501296 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1762/3530] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:23:59 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:23:59.505786 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30baac55-edb9-498b-a981-42ac929f794c admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:23:59.687971 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30baac55-edb9-498b-a981-42ac929f794c admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:23:59.701979 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13912e2c-8a1d-445a-8144-89d3e8552702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:23:59.703190 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13912e2c-8a1d-445a-8144-89d3e8552702 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:23:59.703542 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13912e2c-8a1d-445a-8144-89d3e8552702 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:23:59.704112 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13912e2c-8a1d-445a-8144-89d3e8552702 admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:23:59.705476 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13912e2c-8a1d-445a-8144-89d3e8552702 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:23:59.710310 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13912e2c-8a1d-445a-8144-89d3e8552702 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:23:59.803748 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf078777-af36-4621-9a5b-d5b7f1792482 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:23:59.804333 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1769/3531] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:23:59 2022] POST /identity/v3/projects => generated 377 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:23:59.839772 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf078777-af36-4621-9a5b-d5b7f1792482 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:23:59.969021 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b69ee3-9c24-463b-9b02-a4d2dcb0c9e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:23:59.970679 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b69ee3-9c24-463b-9b02-a4d2dcb0c9e5 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:23:59.971166 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b69ee3-9c24-463b-9b02-a4d2dcb0c9e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:23:59.971586 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b69ee3-9c24-463b-9b02-a4d2dcb0c9e5 admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:23:59.972905 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b69ee3-9c24-463b-9b02-a4d2dcb0c9e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:23:59.976987 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b69ee3-9c24-463b-9b02-a4d2dcb0c9e5 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:24:00.027630 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1763/3532] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:23:59 2022] POST /identity/v3/users => generated 295 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:24:00.029406 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13912e2c-8a1d-445a-8144-89d3e8552702 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:24:00.050687 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13912e2c-8a1d-445a-8144-89d3e8552702 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:24:00.076724 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc657286-01f6-4ce7-b57f-737f1dbf89ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:24:00.078278 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc657286-01f6-4ce7-b57f-737f1dbf89ea admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:24:00.078885 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc657286-01f6-4ce7-b57f-737f1dbf89ea admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:24:00.080298 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc657286-01f6-4ce7-b57f-737f1dbf89ea admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:24:00.081829 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc657286-01f6-4ce7-b57f-737f1dbf89ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:24:00.084137 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc657286-01f6-4ce7-b57f-737f1dbf89ea admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:24:00.106909 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1770/3533] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:24:00 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:24:00.107492 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b69ee3-9c24-463b-9b02-a4d2dcb0c9e5 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:24:00.124831 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b69ee3-9c24-463b-9b02-a4d2dcb0c9e5 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:24:00.149936 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb19caf0-3179-43f6-9533-02149984836e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:24:00.150904 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb19caf0-3179-43f6-9533-02149984836e admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:24:00.151193 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb19caf0-3179-43f6-9533-02149984836e admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:24:00.151456 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb19caf0-3179-43f6-9533-02149984836e admin admin] PATH_INFO: `/v3/projects/abbbd92e685e4e36b00128403f672d4e/users/7915614cf61a40f1b79f84a3fb475b79/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:24:00.215196 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb19caf0-3179-43f6-9533-02149984836e admin admin] RBAC: Authorizing `identity:create_grant(project_id=abbbd92e685e4e36b00128403f672d4e, user_id=7915614cf61a40f1b79f84a3fb475b79, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:24:00.222943 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb19caf0-3179-43f6-9533-02149984836e admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:24:00.264319 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1764/3534] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:24:00 2022] PUT /identity/v3/projects/abbbd92e685e4e36b00128403f672d4e/users/7915614cf61a40f1b79f84a3fb475b79/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:24:00.271331 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc657286-01f6-4ce7-b57f-737f1dbf89ea admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:24:00.284524 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc657286-01f6-4ce7-b57f-737f1dbf89ea admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:24:00.402155 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1107f3ec-ff1d-4eb5-bbd7-677822b5e67c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:24:00.403398 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1107f3ec-ff1d-4eb5-bbd7-677822b5e67c admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:24:00.403960 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1107f3ec-ff1d-4eb5-bbd7-677822b5e67c admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:24:00.404438 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1107f3ec-ff1d-4eb5-bbd7-677822b5e67c admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:24:00.406086 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1107f3ec-ff1d-4eb5-bbd7-677822b5e67c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:24:00.408733 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1107f3ec-ff1d-4eb5-bbd7-677822b5e67c admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:24:00.437247 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1771/3535] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:24:00 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 21:24:00.441942 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb19caf0-3179-43f6-9533-02149984836e admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:24:00.459250 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb19caf0-3179-43f6-9533-02149984836e admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:24:00.479861 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abbf6b3-c9c2-41fa-ba8a-f36720042a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:24:00.480647 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abbf6b3-c9c2-41fa-ba8a-f36720042a1f admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:24:00.480949 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abbf6b3-c9c2-41fa-ba8a-f36720042a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:24:00.481223 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abbf6b3-c9c2-41fa-ba8a-f36720042a1f admin admin] PATH_INFO: `/v3/projects/abbbd92e685e4e36b00128403f672d4e/users/7915614cf61a40f1b79f84a3fb475b79/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:24:00.488277 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abbf6b3-c9c2-41fa-ba8a-f36720042a1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=abbbd92e685e4e36b00128403f672d4e, user_id=7915614cf61a40f1b79f84a3fb475b79, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:24:00.492443 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abbf6b3-c9c2-41fa-ba8a-f36720042a1f admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:24:00.497010 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:24:00.513554 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1765/3536] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:24:00 2022] PUT /identity/v3/projects/abbbd92e685e4e36b00128403f672d4e/users/7915614cf61a40f1b79f84a3fb475b79/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:24:00.529146 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea107076-fc73-4389-bce9-f8cf52b8b9c4 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:24:00.532165 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea107076-fc73-4389-bce9-f8cf52b8b9c4 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:24:00.532665 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea107076-fc73-4389-bce9-f8cf52b8b9c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:24:00.590790 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-ea107076-fc73-4389-bce9-f8cf52b8b9c4 None None] MFA Rules not processed for user `7915614cf61a40f1b79f84a3fb475b79`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:24:00.592681 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-ea107076-fc73-4389-bce9-f8cf52b8b9c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:24:00.662874 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:24:00.724380 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1772/3537] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:24:00 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:24:00.737165 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2686a26d-80a9-43ea-960a-c48d92c8c128 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:24:00.737460 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2686a26d-80a9-43ea-960a-c48d92c8c128 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:24:00.737771 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2686a26d-80a9-43ea-960a-c48d92c8c128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:24:00.752025 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d71655-bf53-4af0-93f7-9bce4c94f5eb None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:24:00.752538 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d71655-bf53-4af0-93f7-9bce4c94f5eb None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:24:00.752961 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d71655-bf53-4af0-93f7-9bce4c94f5eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:24:00.761284 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-2686a26d-80a9-43ea-960a-c48d92c8c128 None None] MFA Rules not processed for user `8bfb831babfd456e9cd186bab2ca14bb`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:24:00.765154 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-2686a26d-80a9-43ea-960a-c48d92c8c128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:24:00.911342 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-f2d71655-bf53-4af0-93f7-9bce4c94f5eb None None] MFA Rules not processed for user `17b779a3e21a415bb42cde5d6863d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:24:00.914738 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-f2d71655-bf53-4af0-93f7-9bce4c94f5eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:24:00.938834 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1766/3538] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:24:00 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:24:00.951673 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2686a26d-80a9-43ea-960a-c48d92c8c128 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:24:00.954964 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-2686a26d-80a9-43ea-960a-c48d92c8c128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:24:01.082994 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1773/3539] 10.222.0.17 () {58 vars in 967 bytes} [Sat Jul 23 21:24:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:24:01.103086 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d71655-bf53-4af0-93f7-9bce4c94f5eb None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:24:01.106687 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-f2d71655-bf53-4af0-93f7-9bce4c94f5eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:24:01.125184 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2686a26d-80a9-43ea-960a-c48d92c8c128 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:24:01.147322 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bce501e-6db8-4120-8e28-7c27f3f43ab7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:24:01.148197 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bce501e-6db8-4120-8e28-7c27f3f43ab7 service nova] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:24:01.148547 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bce501e-6db8-4120-8e28-7c27f3f43ab7 service nova] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:24:01.148885 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bce501e-6db8-4120-8e28-7c27f3f43ab7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:24:01.159397 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bce501e-6db8-4120-8e28-7c27f3f43ab7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:24:01.161789 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bce501e-6db8-4120-8e28-7c27f3f43ab7 service nova] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:24:01.183201 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1767/3540] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:24:00 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:24:01.294304 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d71655-bf53-4af0-93f7-9bce4c94f5eb None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:24:01.301241 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfe1933-516f-4243-9bac-dcde6afcf925 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f0a685b7da46afb81024848f079d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:24:01.301996 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfe1933-516f-4243-9bac-dcde6afcf925 service swift] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:24:01.302280 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfe1933-516f-4243-9bac-dcde6afcf925 service swift] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:24:01.302692 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfe1933-516f-4243-9bac-dcde6afcf925 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:24:01.320836 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfe1933-516f-4243-9bac-dcde6afcf925 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:24:01.324652 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfe1933-516f-4243-9bac-dcde6afcf925 service swift] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:24:01.336494 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1774/3541] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 23 21:24:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 23 21:24:03.169829 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bce501e-6db8-4120-8e28-7c27f3f43ab7 service nova] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:24:03.173121 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-5bce501e-6db8-4120-8e28-7c27f3f43ab7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:24:03.264283 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bce501e-6db8-4120-8e28-7c27f3f43ab7 service nova] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:24:03.271130 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dd549d-1d2f-4bcb-b3c8-8d55a4880244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:24:03.272845 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dd549d-1d2f-4bcb-b3c8-8d55a4880244 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:24:03.273414 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dd549d-1d2f-4bcb-b3c8-8d55a4880244 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:24:03.273768 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dd549d-1d2f-4bcb-b3c8-8d55a4880244 admin admin] PATH_INFO: `/v3/users/63ca7a39a8174a4b97767245e80b2bf7` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:24:03.277986 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dd549d-1d2f-4bcb-b3c8-8d55a4880244 admin admin] RBAC: Authorizing `identity:delete_user(user_id=63ca7a39a8174a4b97767245e80b2bf7)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:24:03.280233 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dd549d-1d2f-4bcb-b3c8-8d55a4880244 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:24:03.314855 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:INSERT=1,keystone:SELECT=95,keystone:DELETE=4 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:24:03.343804 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-42dd549d-1d2f-4bcb-b3c8-8d55a4880244 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63ca7a39a8174a4b97767245e80b2bf7'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:24:03.352877 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-42dd549d-1d2f-4bcb-b3c8-8d55a4880244 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63ca7a39a8174a4b97767245e80b2bf7'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:24:03.354138 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-42dd549d-1d2f-4bcb-b3c8-8d55a4880244 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63ca7a39a8174a4b97767245e80b2bf7'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:24:03.364735 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-42dd549d-1d2f-4bcb-b3c8-8d55a4880244 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63ca7a39a8174a4b97767245e80b2bf7'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:24:03.391898 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-42dd549d-1d2f-4bcb-b3c8-8d55a4880244 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63ca7a39a8174a4b97767245e80b2bf7'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:24:03.402552 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1768/3542] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:24:03 2022] DELETE /identity/v3/users/63ca7a39a8174a4b97767245e80b2bf7 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:24:04.483652 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfe1933-516f-4243-9bac-dcde6afcf925 service swift] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:24:04.509583 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfe1933-516f-4243-9bac-dcde6afcf925 service swift] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:24:04.539667 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:24:04.662375 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5713ac11-8354-4f59-a7f2-8ea52b705e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:24:04.666169 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5713ac11-8354-4f59-a7f2-8ea52b705e66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:24:04.668871 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5713ac11-8354-4f59-a7f2-8ea52b705e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:24:04.668871 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5713ac11-8354-4f59-a7f2-8ea52b705e66 admin admin] PATH_INFO: `/v3/projects/55cfd65431cf4b878ab1c0e25a0ac629` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:24:04.672442 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5713ac11-8354-4f59-a7f2-8ea52b705e66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=55cfd65431cf4b878ab1c0e25a0ac629)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:24:04.683076 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5713ac11-8354-4f59-a7f2-8ea52b705e66 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:24:04.810195 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-5713ac11-8354-4f59-a7f2-8ea52b705e66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55cfd65431cf4b878ab1c0e25a0ac629', 'request_id': 'req-5713ac11-8354-4f59-a7f2-8ea52b705e66'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:24:04.845684 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-5713ac11-8354-4f59-a7f2-8ea52b705e66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55cfd65431cf4b878ab1c0e25a0ac629', 'request_id': 'req-5713ac11-8354-4f59-a7f2-8ea52b705e66'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:24:04.861163 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-5713ac11-8354-4f59-a7f2-8ea52b705e66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55cfd65431cf4b878ab1c0e25a0ac629', 'request_id': 'req-5713ac11-8354-4f59-a7f2-8ea52b705e66'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:24:04.879792 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-5713ac11-8354-4f59-a7f2-8ea52b705e66 admin admin] The token cache is being invalidate because project 55cfd65431cf4b878ab1c0e25a0ac629 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:24:04.880147 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-5713ac11-8354-4f59-a7f2-8ea52b705e66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:24:04.881681 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-5713ac11-8354-4f59-a7f2-8ea52b705e66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:24:04.884477 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1775/3543] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:24:04 2022] DELETE /identity/v3/projects/55cfd65431cf4b878ab1c0e25a0ac629 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:24:04.892066 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46503110-1324-41dd-836b-d7b93daf1edf None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:24:04.892909 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46503110-1324-41dd-836b-d7b93daf1edf None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:24:04.893361 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46503110-1324-41dd-836b-d7b93daf1edf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:24:04.918627 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-46503110-1324-41dd-836b-d7b93daf1edf None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:24:04.920060 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-46503110-1324-41dd-836b-d7b93daf1edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:24:05.038238 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1769/3544] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:24:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:24:05.039321 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c992b03-5651-4da0-a468-e9317f6bd444 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:24:05.039781 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c992b03-5651-4da0-a468-e9317f6bd444 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:24:05.040234 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c992b03-5651-4da0-a468-e9317f6bd444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:24:05.074669 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-7c992b03-5651-4da0-a468-e9317f6bd444 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:24:05.077156 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-7c992b03-5651-4da0-a468-e9317f6bd444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:24:05.104109 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1776/3545] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:24:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:24:05.107554 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46503110-1324-41dd-836b-d7b93daf1edf None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:24:05.127432 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46503110-1324-41dd-836b-d7b93daf1edf None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:24:05.139405 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8d545a-c1b2-47f7-8b26-15830c395556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:24:05.140032 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8d545a-c1b2-47f7-8b26-15830c395556 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:24:05.140461 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8d545a-c1b2-47f7-8b26-15830c395556 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:24:05.140742 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8d545a-c1b2-47f7-8b26-15830c395556 admin admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:24:05.141574 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8d545a-c1b2-47f7-8b26-15830c395556 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:24:05.141798 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8d545a-c1b2-47f7-8b26-15830c395556 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:24:05.143543 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8d545a-c1b2-47f7-8b26-15830c395556 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:24:05.168219 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1770/3546] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:24:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:24:05.172529 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c992b03-5651-4da0-a468-e9317f6bd444 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:24:05.191436 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c992b03-5651-4da0-a468-e9317f6bd444 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:24:05.197458 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12750b18-8dc8-4cd2-a1ea-b25b679ec2b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:24:05.198437 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12750b18-8dc8-4cd2-a1ea-b25b679ec2b6 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:24:05.198722 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12750b18-8dc8-4cd2-a1ea-b25b679ec2b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:24:05.199252 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12750b18-8dc8-4cd2-a1ea-b25b679ec2b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:24:05.200081 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12750b18-8dc8-4cd2-a1ea-b25b679ec2b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:24:05.202514 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12750b18-8dc8-4cd2-a1ea-b25b679ec2b6 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:24:05.245390 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1777/3547] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:24:05 2022] POST /identity/v3/projects => generated 363 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:24:05.250342 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8d545a-c1b2-47f7-8b26-15830c395556 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:24:05.261749 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8d545a-c1b2-47f7-8b26-15830c395556 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:24:05.337900 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d79c31-671a-4804-8ecd-5b1b9c420a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:24:05.338955 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d79c31-671a-4804-8ecd-5b1b9c420a72 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:24:05.339609 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d79c31-671a-4804-8ecd-5b1b9c420a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:24:05.340083 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d79c31-671a-4804-8ecd-5b1b9c420a72 admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:24:05.340929 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d79c31-671a-4804-8ecd-5b1b9c420a72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:24:05.343519 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d79c31-671a-4804-8ecd-5b1b9c420a72 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:24:05.391102 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1771/3548] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:24:05 2022] POST /identity/v3/users => generated 282 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:24:05.396029 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12750b18-8dc8-4cd2-a1ea-b25b679ec2b6 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:24:05.412772 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12750b18-8dc8-4cd2-a1ea-b25b679ec2b6 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:24:05.425895 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a9b01f-00fc-442c-92c6-5395468c0da2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:24:05.426958 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a9b01f-00fc-442c-92c6-5395468c0da2 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:24:05.427457 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a9b01f-00fc-442c-92c6-5395468c0da2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:24:05.427883 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a9b01f-00fc-442c-92c6-5395468c0da2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:24:05.428761 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a9b01f-00fc-442c-92c6-5395468c0da2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:24:05.433477 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a9b01f-00fc-442c-92c6-5395468c0da2 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:24:05.475800 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1778/3549] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:24:05 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 21:24:05.480393 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d79c31-671a-4804-8ecd-5b1b9c420a72 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:24:05.495920 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d79c31-671a-4804-8ecd-5b1b9c420a72 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:24:05.517901 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed2f598-18b6-4d45-936d-5a2b14c07543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:24:05.517901 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed2f598-18b6-4d45-936d-5a2b14c07543 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:24:05.523785 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed2f598-18b6-4d45-936d-5a2b14c07543 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:24:05.523785 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed2f598-18b6-4d45-936d-5a2b14c07543 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:24:05.523785 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed2f598-18b6-4d45-936d-5a2b14c07543 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:24:05.523785 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed2f598-18b6-4d45-936d-5a2b14c07543 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:24:05.540825 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a9b01f-00fc-442c-92c6-5395468c0da2 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:24:05.541619 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1772/3550] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:24:05 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:24:05.555669 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a9b01f-00fc-442c-92c6-5395468c0da2 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:24:05.562649 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c66ea9-bd00-428a-8961-c6b29e424a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:24:05.563791 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c66ea9-bd00-428a-8961-c6b29e424a2b admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:24:05.564219 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c66ea9-bd00-428a-8961-c6b29e424a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:24:05.564723 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c66ea9-bd00-428a-8961-c6b29e424a2b admin admin] PATH_INFO: `/v3/projects/a136ff692aeb4fdeae12dcacd09b3d6f/users/7cd8823a2d134f4ea1e31f92e65df040/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:24:05.593321 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c66ea9-bd00-428a-8961-c6b29e424a2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a136ff692aeb4fdeae12dcacd09b3d6f, user_id=7cd8823a2d134f4ea1e31f92e65df040, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:24:05.598796 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c66ea9-bd00-428a-8961-c6b29e424a2b admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:24:05.638286 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1779/3551] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:24:05 2022] PUT /identity/v3/projects/a136ff692aeb4fdeae12dcacd09b3d6f/users/7cd8823a2d134f4ea1e31f92e65df040/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:24:05.641942 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63fe134-073b-4833-887c-c0e1256c1a9c None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:24:05.642164 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63fe134-073b-4833-887c-c0e1256c1a9c None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:24:05.642446 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63fe134-073b-4833-887c-c0e1256c1a9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:24:05.672170 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-d63fe134-073b-4833-887c-c0e1256c1a9c None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:24:05.674135 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-d63fe134-073b-4833-887c-c0e1256c1a9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:24:05.681023 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:24:05.813966 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1773/3552] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:24:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:24:05.837360 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c66ea9-bd00-428a-8961-c6b29e424a2b admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:24:05.840310 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-29c66ea9-bd00-428a-8961-c6b29e424a2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:24:05.904620 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:24:05.934046 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c66ea9-bd00-428a-8961-c6b29e424a2b admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:24:05.939124 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f432d42-8b81-44cc-8c2b-57a1f949a04d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:24:05.940090 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f432d42-8b81-44cc-8c2b-57a1f949a04d service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:24:05.940556 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f432d42-8b81-44cc-8c2b-57a1f949a04d service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:24:05.940897 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f432d42-8b81-44cc-8c2b-57a1f949a04d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:24:05.970209 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f432d42-8b81-44cc-8c2b-57a1f949a04d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:24:05.974041 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f432d42-8b81-44cc-8c2b-57a1f949a04d service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:24:05.993944 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1780/3553] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:24:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:24:07.443308 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63fe134-073b-4833-887c-c0e1256c1a9c None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:24:07.444860 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-d63fe134-073b-4833-887c-c0e1256c1a9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:24:07.457235 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63fe134-073b-4833-887c-c0e1256c1a9c None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:24:07.465024 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8066c3ab-fb0d-4e2d-a976-200a56673f07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:24:07.466146 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8066c3ab-fb0d-4e2d-a976-200a56673f07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:24:07.466591 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8066c3ab-fb0d-4e2d-a976-200a56673f07 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:24:07.467015 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8066c3ab-fb0d-4e2d-a976-200a56673f07 admin admin] PATH_INFO: `/v3/users/73bde36fce49439bbe49caa877b1b630` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:24:07.468371 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8066c3ab-fb0d-4e2d-a976-200a56673f07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73bde36fce49439bbe49caa877b1b630)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:24:07.470729 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8066c3ab-fb0d-4e2d-a976-200a56673f07 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:24:07.541412 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-8066c3ab-fb0d-4e2d-a976-200a56673f07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73bde36fce49439bbe49caa877b1b630'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:24:07.550825 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-8066c3ab-fb0d-4e2d-a976-200a56673f07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73bde36fce49439bbe49caa877b1b630'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:24:07.551797 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-8066c3ab-fb0d-4e2d-a976-200a56673f07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73bde36fce49439bbe49caa877b1b630'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:24:07.562620 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-8066c3ab-fb0d-4e2d-a976-200a56673f07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73bde36fce49439bbe49caa877b1b630'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:24:07.581975 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-8066c3ab-fb0d-4e2d-a976-200a56673f07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73bde36fce49439bbe49caa877b1b630'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:24:07.589939 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1774/3554] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:24:07 2022] DELETE /identity/v3/users/73bde36fce49439bbe49caa877b1b630 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:24:07.594206 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3451cd-af93-4d48-bb56-52bf11a4fed2 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:24:07.594743 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3451cd-af93-4d48-bb56-52bf11a4fed2 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:24:07.594743 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3451cd-af93-4d48-bb56-52bf11a4fed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:24:07.616101 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-fe3451cd-af93-4d48-bb56-52bf11a4fed2 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:24:07.617645 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-fe3451cd-af93-4d48-bb56-52bf11a4fed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:24:07.711271 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1781/3555] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:24:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:24:07.741829 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8066c3ab-fb0d-4e2d-a976-200a56673f07 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:24:07.743415 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-8066c3ab-fb0d-4e2d-a976-200a56673f07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:24:07.812014 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8066c3ab-fb0d-4e2d-a976-200a56673f07 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:24:07.815866 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ca7839-57f3-422b-9612-540800f887bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:24:07.816541 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ca7839-57f3-422b-9612-540800f887bd service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:24:07.816820 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ca7839-57f3-422b-9612-540800f887bd service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:24:07.817094 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ca7839-57f3-422b-9612-540800f887bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:24:07.834952 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ca7839-57f3-422b-9612-540800f887bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:24:07.836608 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ca7839-57f3-422b-9612-540800f887bd service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:24:07.847982 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1775/3556] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:24:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:24:08.674224 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3451cd-af93-4d48-bb56-52bf11a4fed2 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:24:08.675732 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-fe3451cd-af93-4d48-bb56-52bf11a4fed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:24:08.696613 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3451cd-af93-4d48-bb56-52bf11a4fed2 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:24:08.719261 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ed7e4f-8d82-459e-8b77-b0c64515d0b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:24:08.720404 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ed7e4f-8d82-459e-8b77-b0c64515d0b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:24:08.720900 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ed7e4f-8d82-459e-8b77-b0c64515d0b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:24:08.721384 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ed7e4f-8d82-459e-8b77-b0c64515d0b6 admin admin] PATH_INFO: `/v3/projects/4ebf7cadb7af43beb0b85669f8e1f36c` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:24:08.726809 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ed7e4f-8d82-459e-8b77-b0c64515d0b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ebf7cadb7af43beb0b85669f8e1f36c)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:24:08.729101 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ed7e4f-8d82-459e-8b77-b0c64515d0b6 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:24:08.808403 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-13ed7e4f-8d82-459e-8b77-b0c64515d0b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ebf7cadb7af43beb0b85669f8e1f36c', 'request_id': 'req-13ed7e4f-8d82-459e-8b77-b0c64515d0b6'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:24:08.824908 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-13ed7e4f-8d82-459e-8b77-b0c64515d0b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ebf7cadb7af43beb0b85669f8e1f36c', 'request_id': 'req-13ed7e4f-8d82-459e-8b77-b0c64515d0b6'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:24:08.832347 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-13ed7e4f-8d82-459e-8b77-b0c64515d0b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ebf7cadb7af43beb0b85669f8e1f36c', 'request_id': 'req-13ed7e4f-8d82-459e-8b77-b0c64515d0b6'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:24:08.849395 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-13ed7e4f-8d82-459e-8b77-b0c64515d0b6 admin admin] The token cache is being invalidate because project 4ebf7cadb7af43beb0b85669f8e1f36c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:24:08.849809 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-13ed7e4f-8d82-459e-8b77-b0c64515d0b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:24:08.850589 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-13ed7e4f-8d82-459e-8b77-b0c64515d0b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:24:08.852670 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1782/3557] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:24:08 2022] DELETE /identity/v3/projects/4ebf7cadb7af43beb0b85669f8e1f36c => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:24:08.857900 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45040d17-19f8-4e0f-9a00-d003666cfc4b None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:24:08.858842 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45040d17-19f8-4e0f-9a00-d003666cfc4b None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:24:08.859492 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45040d17-19f8-4e0f-9a00-d003666cfc4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:24:08.901222 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-45040d17-19f8-4e0f-9a00-d003666cfc4b None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:24:08.902809 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-45040d17-19f8-4e0f-9a00-d003666cfc4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:24:08.926364 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:24:08.981817 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1776/3558] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:24:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:24:08.989702 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ced655-da10-4f1f-a54c-5959757babb5 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:24:08.990136 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ced655-da10-4f1f-a54c-5959757babb5 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:24:08.990536 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ced655-da10-4f1f-a54c-5959757babb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:24:09.034339 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-95ced655-da10-4f1f-a54c-5959757babb5 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:24:09.035842 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-95ced655-da10-4f1f-a54c-5959757babb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:24:09.057342 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1783/3559] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:24:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:24:09.061727 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45040d17-19f8-4e0f-9a00-d003666cfc4b None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:24:09.078813 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45040d17-19f8-4e0f-9a00-d003666cfc4b None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:24:09.090252 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec8f787-2f8e-4375-bdbf-16188a46fbb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:24:09.092285 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec8f787-2f8e-4375-bdbf-16188a46fbb5 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:24:09.092816 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec8f787-2f8e-4375-bdbf-16188a46fbb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:24:09.093289 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec8f787-2f8e-4375-bdbf-16188a46fbb5 admin admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:24:09.094297 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec8f787-2f8e-4375-bdbf-16188a46fbb5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:24:09.094804 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec8f787-2f8e-4375-bdbf-16188a46fbb5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:24:09.100012 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec8f787-2f8e-4375-bdbf-16188a46fbb5 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:24:09.136075 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1777/3560] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:24:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 21:24:09.141217 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ced655-da10-4f1f-a54c-5959757babb5 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:24:09.174487 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ced655-da10-4f1f-a54c-5959757babb5 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:24:09.186333 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bb0106-1592-4dd8-a065-8ae6c3ba7c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:24:09.187147 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bb0106-1592-4dd8-a065-8ae6c3ba7c25 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:24:09.187530 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bb0106-1592-4dd8-a065-8ae6c3ba7c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:24:09.187814 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bb0106-1592-4dd8-a065-8ae6c3ba7c25 admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:24:09.189185 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bb0106-1592-4dd8-a065-8ae6c3ba7c25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:24:09.191276 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bb0106-1592-4dd8-a065-8ae6c3ba7c25 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:24:09.260820 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1784/3561] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:24:09 2022] POST /identity/v3/projects => generated 383 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:24:09.264814 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec8f787-2f8e-4375-bdbf-16188a46fbb5 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:24:09.281145 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec8f787-2f8e-4375-bdbf-16188a46fbb5 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:24:09.396486 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeb5ac2-53af-4ccc-a5eb-da38a04da2af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:24:09.397598 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeb5ac2-53af-4ccc-a5eb-da38a04da2af admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:24:09.400095 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeb5ac2-53af-4ccc-a5eb-da38a04da2af admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:24:09.400095 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeb5ac2-53af-4ccc-a5eb-da38a04da2af admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:24:09.401297 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfeb5ac2-53af-4ccc-a5eb-da38a04da2af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:24:09.408603 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfeb5ac2-53af-4ccc-a5eb-da38a04da2af admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:24:09.476322 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bb0106-1592-4dd8-a065-8ae6c3ba7c25 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:24:09.481458 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1778/3562] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:24:09 2022] POST /identity/v3/users => generated 292 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:24:09.508332 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bb0106-1592-4dd8-a065-8ae6c3ba7c25 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:24:09.515072 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b0ca22-ec2d-4e37-90b3-f56198d0b88f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:24:09.515760 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b0ca22-ec2d-4e37-90b3-f56198d0b88f admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:24:09.516040 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b0ca22-ec2d-4e37-90b3-f56198d0b88f admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:24:09.516314 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b0ca22-ec2d-4e37-90b3-f56198d0b88f admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:24:09.517241 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b0ca22-ec2d-4e37-90b3-f56198d0b88f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:24:09.518936 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b0ca22-ec2d-4e37-90b3-f56198d0b88f admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:24:09.531230 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1785/3563] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:24:09 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:24:09.536616 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeb5ac2-53af-4ccc-a5eb-da38a04da2af admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:24:09.564243 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeb5ac2-53af-4ccc-a5eb-da38a04da2af admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:24:09.569374 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8e2cc7-c3e5-4739-9995-5691fb87a2f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:24:09.570170 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8e2cc7-c3e5-4739-9995-5691fb87a2f7 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:24:09.570458 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8e2cc7-c3e5-4739-9995-5691fb87a2f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:24:09.570736 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8e2cc7-c3e5-4739-9995-5691fb87a2f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:24:09.571649 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8e2cc7-c3e5-4739-9995-5691fb87a2f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:24:09.573318 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8e2cc7-c3e5-4739-9995-5691fb87a2f7 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:24:09.588807 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1779/3564] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:24:09 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:24:09.589818 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b0ca22-ec2d-4e37-90b3-f56198d0b88f admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:24:09.603946 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b0ca22-ec2d-4e37-90b3-f56198d0b88f admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:24:09.616454 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9831f805-0871-454a-ac37-d5c0f763b7d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:24:09.618389 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9831f805-0871-454a-ac37-d5c0f763b7d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:24:09.621994 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9831f805-0871-454a-ac37-d5c0f763b7d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:24:09.622294 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9831f805-0871-454a-ac37-d5c0f763b7d0 admin admin] PATH_INFO: `/v3/projects/e009045b8f044e818c4a3cb8d72d9dbc/users/240206b0a6934c64aee715559ce134bd/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:24:09.643619 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9831f805-0871-454a-ac37-d5c0f763b7d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e009045b8f044e818c4a3cb8d72d9dbc, user_id=240206b0a6934c64aee715559ce134bd, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:24:09.646764 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9831f805-0871-454a-ac37-d5c0f763b7d0 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:24:09.668235 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1786/3565] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:24:09 2022] PUT /identity/v3/projects/e009045b8f044e818c4a3cb8d72d9dbc/users/240206b0a6934c64aee715559ce134bd/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:24:09.681192 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71bbfae-fe8e-45ed-9886-6e3e8aa23e80 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:24:09.681487 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71bbfae-fe8e-45ed-9886-6e3e8aa23e80 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:24:09.681821 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71bbfae-fe8e-45ed-9886-6e3e8aa23e80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:24:09.733042 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-d71bbfae-fe8e-45ed-9886-6e3e8aa23e80 None None] MFA Rules not processed for user `240206b0a6934c64aee715559ce134bd`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:24:09.735099 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-d71bbfae-fe8e-45ed-9886-6e3e8aa23e80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:24:09.856203 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1780/3566] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:24:09 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:24:09.872542 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9831f805-0871-454a-ac37-d5c0f763b7d0 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:24:09.875737 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-9831f805-0871-454a-ac37-d5c0f763b7d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:24:09.894954 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:24:10.060777 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9831f805-0871-454a-ac37-d5c0f763b7d0 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:24:10.069170 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45ea220-d364-415e-9c79-ce718c43873a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:24:10.071269 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45ea220-d364-415e-9c79-ce718c43873a service nova] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:24:10.072857 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45ea220-d364-415e-9c79-ce718c43873a service nova] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:24:10.074544 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45ea220-d364-415e-9c79-ce718c43873a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:24:10.090087 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45ea220-d364-415e-9c79-ce718c43873a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:24:10.092087 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45ea220-d364-415e-9c79-ce718c43873a service nova] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:24:10.105800 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1787/3567] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:24:09 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:24:10.239888 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71bbfae-fe8e-45ed-9886-6e3e8aa23e80 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:24:10.289200 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71bbfae-fe8e-45ed-9886-6e3e8aa23e80 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:24:10.309999 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47765edd-945b-4814-b137-32be2546d057 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:24:10.311919 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47765edd-945b-4814-b137-32be2546d057 service nova] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:24:10.312304 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47765edd-945b-4814-b137-32be2546d057 service nova] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:24:10.312668 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47765edd-945b-4814-b137-32be2546d057 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:24:10.320332 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-47765edd-945b-4814-b137-32be2546d057 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:24:10.353203 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47765edd-945b-4814-b137-32be2546d057 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:24:10.354913 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47765edd-945b-4814-b137-32be2546d057 service nova] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:24:10.397970 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1781/3568] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:24:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:24:11.016834 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45ea220-d364-415e-9c79-ce718c43873a service nova] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:24:11.085579 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45ea220-d364-415e-9c79-ce718c43873a service nova] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:24:11.091566 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac3205d-af34-4638-aa3c-a41c746f4f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:24:11.093225 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac3205d-af34-4638-aa3c-a41c746f4f50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:24:11.093509 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac3205d-af34-4638-aa3c-a41c746f4f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:24:11.093782 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac3205d-af34-4638-aa3c-a41c746f4f50 admin admin] PATH_INFO: `/v3/users/240206b0a6934c64aee715559ce134bd` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:24:11.097565 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac3205d-af34-4638-aa3c-a41c746f4f50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=240206b0a6934c64aee715559ce134bd)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:24:11.099369 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac3205d-af34-4638-aa3c-a41c746f4f50 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:24:11.159998 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-eac3205d-af34-4638-aa3c-a41c746f4f50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '240206b0a6934c64aee715559ce134bd'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:24:11.161503 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-eac3205d-af34-4638-aa3c-a41c746f4f50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '240206b0a6934c64aee715559ce134bd'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:24:11.170011 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-eac3205d-af34-4638-aa3c-a41c746f4f50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '240206b0a6934c64aee715559ce134bd'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:24:11.180086 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-eac3205d-af34-4638-aa3c-a41c746f4f50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '240206b0a6934c64aee715559ce134bd'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:24:11.196237 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-eac3205d-af34-4638-aa3c-a41c746f4f50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '240206b0a6934c64aee715559ce134bd'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:24:11.203623 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1788/3569] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:24:11 2022] DELETE /identity/v3/users/240206b0a6934c64aee715559ce134bd => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:24:11.208088 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa82119-a1a3-4453-bcf4-3fe42cd91a9d None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:24:11.208355 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa82119-a1a3-4453-bcf4-3fe42cd91a9d None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:24:11.208689 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa82119-a1a3-4453-bcf4-3fe42cd91a9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:24:11.221674 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:24:11.233603 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-7aa82119-a1a3-4453-bcf4-3fe42cd91a9d None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:24:11.235812 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-7aa82119-a1a3-4453-bcf4-3fe42cd91a9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:24:11.334906 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1782/3570] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:24:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:24:11.344932 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac3205d-af34-4638-aa3c-a41c746f4f50 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:24:11.348223 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-eac3205d-af34-4638-aa3c-a41c746f4f50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:24:11.363135 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:24:11.519014 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac3205d-af34-4638-aa3c-a41c746f4f50 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:24:11.525038 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab106b6-81f4-431d-9426-b0cb00f2f27f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:24:11.526198 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab106b6-81f4-431d-9426-b0cb00f2f27f service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:24:11.526650 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab106b6-81f4-431d-9426-b0cb00f2f27f service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:24:11.527073 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab106b6-81f4-431d-9426-b0cb00f2f27f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:24:11.538760 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab106b6-81f4-431d-9426-b0cb00f2f27f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:24:11.540613 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab106b6-81f4-431d-9426-b0cb00f2f27f service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:24:11.569618 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1789/3571] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:24:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:24:12.346748 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa82119-a1a3-4453-bcf4-3fe42cd91a9d None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:24:12.349825 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-7aa82119-a1a3-4453-bcf4-3fe42cd91a9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:24:12.370680 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa82119-a1a3-4453-bcf4-3fe42cd91a9d None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:24:12.379167 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8ab122-eff9-4724-b476-da733b49b469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:24:12.380841 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8ab122-eff9-4724-b476-da733b49b469 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:24:12.382112 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8ab122-eff9-4724-b476-da733b49b469 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:24:12.382824 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8ab122-eff9-4724-b476-da733b49b469 admin admin] PATH_INFO: `/v3/projects/e009045b8f044e818c4a3cb8d72d9dbc` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:24:12.386125 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8ab122-eff9-4724-b476-da733b49b469 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e009045b8f044e818c4a3cb8d72d9dbc)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:24:12.388868 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8ab122-eff9-4724-b476-da733b49b469 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:24:12.498360 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-0a8ab122-eff9-4724-b476-da733b49b469 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e009045b8f044e818c4a3cb8d72d9dbc', 'request_id': 'req-0a8ab122-eff9-4724-b476-da733b49b469'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:24:12.512152 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-0a8ab122-eff9-4724-b476-da733b49b469 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e009045b8f044e818c4a3cb8d72d9dbc', 'request_id': 'req-0a8ab122-eff9-4724-b476-da733b49b469'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:24:12.521398 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-0a8ab122-eff9-4724-b476-da733b49b469 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e009045b8f044e818c4a3cb8d72d9dbc', 'request_id': 'req-0a8ab122-eff9-4724-b476-da733b49b469'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:24:12.539715 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-0a8ab122-eff9-4724-b476-da733b49b469 admin admin] The token cache is being invalidate because project e009045b8f044e818c4a3cb8d72d9dbc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:24:12.540615 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-0a8ab122-eff9-4724-b476-da733b49b469 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:24:12.541577 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-0a8ab122-eff9-4724-b476-da733b49b469 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:24:12.543508 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1783/3572] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:24:12 2022] DELETE /identity/v3/projects/e009045b8f044e818c4a3cb8d72d9dbc => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:24:12.550298 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9461e0b5-5ae5-4b9b-ad2d-b70de7ee9faf None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:24:12.550838 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9461e0b5-5ae5-4b9b-ad2d-b70de7ee9faf None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:24:12.550920 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9461e0b5-5ae5-4b9b-ad2d-b70de7ee9faf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:24:12.581108 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-9461e0b5-5ae5-4b9b-ad2d-b70de7ee9faf None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:24:12.583258 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-9461e0b5-5ae5-4b9b-ad2d-b70de7ee9faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:24:12.689046 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1790/3573] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:24:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:24:12.697001 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cf996c-3584-45dc-b7db-1c5c57f74bb1 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:24:12.697605 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cf996c-3584-45dc-b7db-1c5c57f74bb1 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:24:12.698059 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cf996c-3584-45dc-b7db-1c5c57f74bb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:24:12.752267 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-d2cf996c-3584-45dc-b7db-1c5c57f74bb1 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:24:12.753830 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-d2cf996c-3584-45dc-b7db-1c5c57f74bb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:24:12.779764 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1784/3574] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:24:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:24:12.783964 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9461e0b5-5ae5-4b9b-ad2d-b70de7ee9faf None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:24:12.794865 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9461e0b5-5ae5-4b9b-ad2d-b70de7ee9faf None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:24:12.817941 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fc6f8f-3771-407a-9d17-2f0ee40bf2a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:24:12.819061 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fc6f8f-3771-407a-9d17-2f0ee40bf2a1 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:24:12.819546 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fc6f8f-3771-407a-9d17-2f0ee40bf2a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:24:12.820177 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fc6f8f-3771-407a-9d17-2f0ee40bf2a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:24:12.822192 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fc6f8f-3771-407a-9d17-2f0ee40bf2a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:24:12.823006 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fc6f8f-3771-407a-9d17-2f0ee40bf2a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:24:12.825915 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fc6f8f-3771-407a-9d17-2f0ee40bf2a1 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:24:12.882567 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1791/3575] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:24:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:24:12.883875 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cf996c-3584-45dc-b7db-1c5c57f74bb1 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:24:12.900157 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cf996c-3584-45dc-b7db-1c5c57f74bb1 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:24:12.913030 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c7b7a4-d46a-4a3c-a07a-8dbfacd27548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:24:12.914148 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c7b7a4-d46a-4a3c-a07a-8dbfacd27548 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:24:12.914645 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c7b7a4-d46a-4a3c-a07a-8dbfacd27548 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:24:12.915114 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c7b7a4-d46a-4a3c-a07a-8dbfacd27548 admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:24:12.915927 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c7b7a4-d46a-4a3c-a07a-8dbfacd27548 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:24:12.919515 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c7b7a4-d46a-4a3c-a07a-8dbfacd27548 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:24:12.986174 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1785/3576] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:24:12 2022] POST /identity/v3/projects => generated 383 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:24:12.992131 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fc6f8f-3771-407a-9d17-2f0ee40bf2a1 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:24:13.007915 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1322a0ba-6c06-4e07-b932-4237643f8c7e None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:24:13.008225 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1322a0ba-6c06-4e07-b932-4237643f8c7e None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:24:13.008628 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1322a0ba-6c06-4e07-b932-4237643f8c7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:24:13.012141 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fc6f8f-3771-407a-9d17-2f0ee40bf2a1 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:24:13.061029 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-1322a0ba-6c06-4e07-b932-4237643f8c7e None None] MFA Rules not processed for user `e74c139b38d74d9ab93695471ccd3a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:24:13.062645 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-1322a0ba-6c06-4e07-b932-4237643f8c7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:24:13.154789 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4f3f7a-9337-47ec-b868-00df6bf13a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:24:13.155658 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4f3f7a-9337-47ec-b868-00df6bf13a45 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:24:13.156052 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4f3f7a-9337-47ec-b868-00df6bf13a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:24:13.156413 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4f3f7a-9337-47ec-b868-00df6bf13a45 admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:24:13.157181 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4f3f7a-9337-47ec-b868-00df6bf13a45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:24:13.159426 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4f3f7a-9337-47ec-b868-00df6bf13a45 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:24:13.166891 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1786/3577] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:24:13 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:24:13.206511 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1792/3578] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:24:12 2022] POST /identity/v3/users => generated 292 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:24:13.208624 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1322a0ba-6c06-4e07-b932-4237643f8c7e None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:24:13.241467 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1322a0ba-6c06-4e07-b932-4237643f8c7e None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:24:13.256616 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e10dbd-fe46-4fe4-85ee-43c7e8e9a594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:24:13.257579 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e10dbd-fe46-4fe4-85ee-43c7e8e9a594 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:24:13.259519 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e10dbd-fe46-4fe4-85ee-43c7e8e9a594 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:24:13.259882 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e10dbd-fe46-4fe4-85ee-43c7e8e9a594 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:24:13.260648 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e10dbd-fe46-4fe4-85ee-43c7e8e9a594 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:24:13.263266 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e10dbd-fe46-4fe4-85ee-43c7e8e9a594 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:24:13.265676 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:24:13.282112 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1787/3579] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:24:13 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:24:13.285905 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4f3f7a-9337-47ec-b868-00df6bf13a45 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:24:13.299459 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4f3f7a-9337-47ec-b868-00df6bf13a45 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:24:13.304761 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339acc4e-f75a-40e6-9ee0-0e2da845f7c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:24:13.305739 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339acc4e-f75a-40e6-9ee0-0e2da845f7c9 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:24:13.306247 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339acc4e-f75a-40e6-9ee0-0e2da845f7c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:24:13.306737 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339acc4e-f75a-40e6-9ee0-0e2da845f7c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:24:13.307660 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339acc4e-f75a-40e6-9ee0-0e2da845f7c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:24:13.309484 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339acc4e-f75a-40e6-9ee0-0e2da845f7c9 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:24:13.328255 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1793/3580] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:24:13 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:24:13.331844 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e10dbd-fe46-4fe4-85ee-43c7e8e9a594 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:24:13.344621 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e10dbd-fe46-4fe4-85ee-43c7e8e9a594 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:24:13.352094 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4494fb-f2e7-444c-b893-3209a9721bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:24:13.353106 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4494fb-f2e7-444c-b893-3209a9721bb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:24:13.353453 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4494fb-f2e7-444c-b893-3209a9721bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:24:13.353843 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4494fb-f2e7-444c-b893-3209a9721bb0 admin admin] PATH_INFO: `/v3/projects/8d6e531d129741b780236ffba8a4c2f9/users/b8b96ecba600424682ee7d55a16b6675/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:24:13.377856 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4494fb-f2e7-444c-b893-3209a9721bb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d6e531d129741b780236ffba8a4c2f9, user_id=b8b96ecba600424682ee7d55a16b6675, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:24:13.382046 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4494fb-f2e7-444c-b893-3209a9721bb0 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:24:13.406924 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1788/3581] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:24:13 2022] PUT /identity/v3/projects/8d6e531d129741b780236ffba8a4c2f9/users/b8b96ecba600424682ee7d55a16b6675/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:24:13.412758 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b392548c-371e-4c8b-ba5d-391465bbf44e None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:24:13.413114 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b392548c-371e-4c8b-ba5d-391465bbf44e None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:24:13.413456 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b392548c-371e-4c8b-ba5d-391465bbf44e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:24:13.462215 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-b392548c-371e-4c8b-ba5d-391465bbf44e None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:24:13.465019 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-b392548c-371e-4c8b-ba5d-391465bbf44e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:24:13.487440 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:24:13.578881 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1794/3582] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:24:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:24:13.599570 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4494fb-f2e7-444c-b893-3209a9721bb0 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:24:13.601885 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-ad4494fb-f2e7-444c-b893-3209a9721bb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:24:13.720095 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4494fb-f2e7-444c-b893-3209a9721bb0 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:24:13.725125 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5702eb9-0aca-42ed-b321-a813de6c1511 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:24:13.726678 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5702eb9-0aca-42ed-b321-a813de6c1511 service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:24:13.727152 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5702eb9-0aca-42ed-b321-a813de6c1511 service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:24:13.727585 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5702eb9-0aca-42ed-b321-a813de6c1511 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:24:13.742962 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5702eb9-0aca-42ed-b321-a813de6c1511 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:24:13.747520 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5702eb9-0aca-42ed-b321-a813de6c1511 service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:24:13.767958 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1789/3583] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:24:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:24:18.954396 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a57a6d-82a8-4805-b51f-c77254fb0e60 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:24:18.954944 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a57a6d-82a8-4805-b51f-c77254fb0e60 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:24:18.954944 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a57a6d-82a8-4805-b51f-c77254fb0e60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:24:19.019141 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-b5a57a6d-82a8-4805-b51f-c77254fb0e60 None None] MFA Rules not processed for user `7cd8823a2d134f4ea1e31f92e65df040`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:24:19.020516 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-b5a57a6d-82a8-4805-b51f-c77254fb0e60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:24:19.197321 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1795/3584] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:24:18 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:24:19.211534 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5702eb9-0aca-42ed-b321-a813de6c1511 service neutron] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:24:19.213155 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-b5702eb9-0aca-42ed-b321-a813de6c1511 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:24:19.370839 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5702eb9-0aca-42ed-b321-a813de6c1511 service neutron] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:24:19.387870 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9527f4d-ae19-4911-a304-7478ae038aa2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:24:19.388949 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9527f4d-ae19-4911-a304-7478ae038aa2 service nova] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:24:19.388949 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9527f4d-ae19-4911-a304-7478ae038aa2 service nova] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:24:19.389114 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9527f4d-ae19-4911-a304-7478ae038aa2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:24:19.408726 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9527f4d-ae19-4911-a304-7478ae038aa2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:24:19.410405 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9527f4d-ae19-4911-a304-7478ae038aa2 service nova] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:24:19.449629 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1790/3585] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:24:19 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:24:21.562035 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a57a6d-82a8-4805-b51f-c77254fb0e60 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:24:21.563681 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-b5a57a6d-82a8-4805-b51f-c77254fb0e60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:24:21.589078 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a57a6d-82a8-4805-b51f-c77254fb0e60 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:24:21.611939 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eceb26-8f7f-4baa-8ada-461927fb7008 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:24:21.612631 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eceb26-8f7f-4baa-8ada-461927fb7008 service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:24:21.612895 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eceb26-8f7f-4baa-8ada-461927fb7008 service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:24:21.613167 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eceb26-8f7f-4baa-8ada-461927fb7008 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:24:21.615088 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-38eceb26-8f7f-4baa-8ada-461927fb7008 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:24:21.634215 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38eceb26-8f7f-4baa-8ada-461927fb7008 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:24:21.635899 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38eceb26-8f7f-4baa-8ada-461927fb7008 service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:24:21.648123 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1796/3586] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:24:21 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:24:22.466134 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9527f4d-ae19-4911-a304-7478ae038aa2 service nova] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:24:22.470083 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-e9527f4d-ae19-4911-a304-7478ae038aa2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:24:22.525955 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eceb26-8f7f-4baa-8ada-461927fb7008 service neutron] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:24:22.527231 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9527f4d-ae19-4911-a304-7478ae038aa2 service nova] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:24:22.527399 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-38eceb26-8f7f-4baa-8ada-461927fb7008 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:24:22.553218 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eceb26-8f7f-4baa-8ada-461927fb7008 service neutron] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:24:22.562018 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff5596a-bdb7-4c41-b7b8-d498d54b0e69 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:24:22.564452 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff5596a-bdb7-4c41-b7b8-d498d54b0e69 service nova] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:24:22.564848 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff5596a-bdb7-4c41-b7b8-d498d54b0e69 service nova] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:24:22.567351 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c967cc-b435-49bc-954f-b8e87e4f4c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:24:22.567986 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff5596a-bdb7-4c41-b7b8-d498d54b0e69 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:24:22.569553 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c967cc-b435-49bc-954f-b8e87e4f4c4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:24:22.569797 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c967cc-b435-49bc-954f-b8e87e4f4c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:24:22.570388 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c967cc-b435-49bc-954f-b8e87e4f4c4f admin admin] PATH_INFO: `/v3/users/7a812b6571db40a1a2f138dc03d4e1be` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:24:22.571937 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c967cc-b435-49bc-954f-b8e87e4f4c4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a812b6571db40a1a2f138dc03d4e1be)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:24:22.572957 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-3ff5596a-bdb7-4c41-b7b8-d498d54b0e69 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:24:22.576941 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c967cc-b435-49bc-954f-b8e87e4f4c4f admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:24:22.700508 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-f1c967cc-b435-49bc-954f-b8e87e4f4c4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a812b6571db40a1a2f138dc03d4e1be'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:24:22.702968 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-f1c967cc-b435-49bc-954f-b8e87e4f4c4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a812b6571db40a1a2f138dc03d4e1be'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:24:22.745783 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-f1c967cc-b435-49bc-954f-b8e87e4f4c4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a812b6571db40a1a2f138dc03d4e1be'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:24:22.769380 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:24:22.770690 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-f1c967cc-b435-49bc-954f-b8e87e4f4c4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a812b6571db40a1a2f138dc03d4e1be'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:24:22.776110 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff5596a-bdb7-4c41-b7b8-d498d54b0e69 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:24:22.778269 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff5596a-bdb7-4c41-b7b8-d498d54b0e69 service nova] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:24:22.793631 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1791/3587] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:24:22 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:24:22.798762 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-f1c967cc-b435-49bc-954f-b8e87e4f4c4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a812b6571db40a1a2f138dc03d4e1be'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:24:22.816650 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1797/3588] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:24:22 2022] DELETE /identity/v3/users/7a812b6571db40a1a2f138dc03d4e1be => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:24:23.095993 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbed5c9-3b55-42c8-ac46-afc70c0d60f7 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:24:23.096579 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbed5c9-3b55-42c8-ac46-afc70c0d60f7 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:24:23.097004 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbed5c9-3b55-42c8-ac46-afc70c0d60f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:24:23.168992 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-fcbed5c9-3b55-42c8-ac46-afc70c0d60f7 None None] MFA Rules not processed for user `b8b96ecba600424682ee7d55a16b6675`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:24:23.171762 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-fcbed5c9-3b55-42c8-ac46-afc70c0d60f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:24:23.353449 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c967cc-b435-49bc-954f-b8e87e4f4c4f admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:24:23.355217 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-f1c967cc-b435-49bc-954f-b8e87e4f4c4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:24:23.372356 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:24:23.417181 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1792/3589] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:24:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:24:23.427762 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f3c8b5-5dda-4ec4-8998-d4959689af63 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:24:23.428262 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f3c8b5-5dda-4ec4-8998-d4959689af63 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:24:23.428693 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f3c8b5-5dda-4ec4-8998-d4959689af63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:24:23.475254 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-15f3c8b5-5dda-4ec4-8998-d4959689af63 None None] MFA Rules not processed for user `b8b96ecba600424682ee7d55a16b6675`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:24:23.480474 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-15f3c8b5-5dda-4ec4-8998-d4959689af63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:24:23.505232 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1793/3590] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:24:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:24:23.511454 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c967cc-b435-49bc-954f-b8e87e4f4c4f admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:24:23.530374 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fc78fa-d0fe-41cd-8f40-b86e4ec3da08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:24:23.531511 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fc78fa-d0fe-41cd-8f40-b86e4ec3da08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:24:23.531859 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fc78fa-d0fe-41cd-8f40-b86e4ec3da08 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:24:23.535781 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fc78fa-d0fe-41cd-8f40-b86e4ec3da08 admin admin] PATH_INFO: `/v3/projects/a14294b18c6e4936b1272a57d4faccce` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:24:23.535781 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fc78fa-d0fe-41cd-8f40-b86e4ec3da08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a14294b18c6e4936b1272a57d4faccce)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:24:23.538577 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fc78fa-d0fe-41cd-8f40-b86e4ec3da08 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:24:23.629792 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-25fc78fa-d0fe-41cd-8f40-b86e4ec3da08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a14294b18c6e4936b1272a57d4faccce', 'request_id': 'req-25fc78fa-d0fe-41cd-8f40-b86e4ec3da08'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:24:23.642112 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-25fc78fa-d0fe-41cd-8f40-b86e4ec3da08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a14294b18c6e4936b1272a57d4faccce', 'request_id': 'req-25fc78fa-d0fe-41cd-8f40-b86e4ec3da08'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:24:23.650795 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-25fc78fa-d0fe-41cd-8f40-b86e4ec3da08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a14294b18c6e4936b1272a57d4faccce', 'request_id': 'req-25fc78fa-d0fe-41cd-8f40-b86e4ec3da08'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:24:23.663506 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-25fc78fa-d0fe-41cd-8f40-b86e4ec3da08 admin admin] The token cache is being invalidate because project a14294b18c6e4936b1272a57d4faccce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:24:23.663746 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-25fc78fa-d0fe-41cd-8f40-b86e4ec3da08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:24:23.665423 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-25fc78fa-d0fe-41cd-8f40-b86e4ec3da08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:24:23.667868 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1798/3591] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:24:23 2022] DELETE /identity/v3/projects/a14294b18c6e4936b1272a57d4faccce => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:24:23.683704 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f6392a-4d12-42af-a4a0-6219ae1aa46b None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:24:23.684373 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f6392a-4d12-42af-a4a0-6219ae1aa46b None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:24:23.685599 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f6392a-4d12-42af-a4a0-6219ae1aa46b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:24:23.748392 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fc78fa-d0fe-41cd-8f40-b86e4ec3da08 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:24:23.748935 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-49f6392a-4d12-42af-a4a0-6219ae1aa46b None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:24:23.751394 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-25fc78fa-d0fe-41cd-8f40-b86e4ec3da08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:24:23.752106 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-49f6392a-4d12-42af-a4a0-6219ae1aa46b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:24:23.888030 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fc78fa-d0fe-41cd-8f40-b86e4ec3da08 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:24:23.895643 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1794/3592] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:24:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:24:23.900491 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9a0266-f349-4ed1-8799-43f4aa3ecf56 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:24:23.901461 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9a0266-f349-4ed1-8799-43f4aa3ecf56 service nova] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:24:23.905010 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1615482-4f1a-43ce-87ac-76a97eb383ff None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:24:23.905664 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1615482-4f1a-43ce-87ac-76a97eb383ff None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:24:23.906448 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1615482-4f1a-43ce-87ac-76a97eb383ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:24:23.908422 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9a0266-f349-4ed1-8799-43f4aa3ecf56 service nova] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:24:23.911637 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9a0266-f349-4ed1-8799-43f4aa3ecf56 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:24:23.917239 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-3d9a0266-f349-4ed1-8799-43f4aa3ecf56 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:24:23.935046 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-c1615482-4f1a-43ce-87ac-76a97eb383ff None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:24:23.936664 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-c1615482-4f1a-43ce-87ac-76a97eb383ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:24:23.948143 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1795/3593] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:24:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:24:23.952752 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1615482-4f1a-43ce-87ac-76a97eb383ff None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:24:23.965657 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1615482-4f1a-43ce-87ac-76a97eb383ff None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:24:23.986033 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:24:23.990352 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45edb0a5-1feb-4769-85ae-7811338b2128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:24:23.991655 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45edb0a5-1feb-4769-85ae-7811338b2128 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:24:23.992026 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45edb0a5-1feb-4769-85ae-7811338b2128 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:24:23.992396 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45edb0a5-1feb-4769-85ae-7811338b2128 admin admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:24:23.993268 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45edb0a5-1feb-4769-85ae-7811338b2128 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:24:23.998728 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45edb0a5-1feb-4769-85ae-7811338b2128 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:24:24.000575 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45edb0a5-1feb-4769-85ae-7811338b2128 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:24:24.036830 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1796/3594] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:24:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:24:24.041672 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45edb0a5-1feb-4769-85ae-7811338b2128 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:24:24.063823 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45edb0a5-1feb-4769-85ae-7811338b2128 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:24:24.065512 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9a0266-f349-4ed1-8799-43f4aa3ecf56 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:24:24.067532 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9a0266-f349-4ed1-8799-43f4aa3ecf56 service nova] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:24:24.075515 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5b034a-2d36-4a31-9135-ef7e6ba3166d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:24:24.076475 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5b034a-2d36-4a31-9135-ef7e6ba3166d admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:24:24.076953 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5b034a-2d36-4a31-9135-ef7e6ba3166d admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:24:24.077377 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5b034a-2d36-4a31-9135-ef7e6ba3166d admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:24:24.078572 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5b034a-2d36-4a31-9135-ef7e6ba3166d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:24:24.080876 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5b034a-2d36-4a31-9135-ef7e6ba3166d admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:24:24.091366 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1799/3595] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:24:23 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:24:24.138804 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1797/3596] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:24:24 2022] POST /identity/v3/projects => generated 377 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:24:24.143083 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9a0266-f349-4ed1-8799-43f4aa3ecf56 service nova] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:24:24.156909 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9a0266-f349-4ed1-8799-43f4aa3ecf56 service nova] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:24:24.285375 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d951a331-945a-4010-9fa7-499f2dc3da3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:24:24.286091 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d951a331-945a-4010-9fa7-499f2dc3da3d admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:24:24.286373 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d951a331-945a-4010-9fa7-499f2dc3da3d admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:24:24.286655 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d951a331-945a-4010-9fa7-499f2dc3da3d admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:24:24.287341 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d951a331-945a-4010-9fa7-499f2dc3da3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:24:24.291221 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d951a331-945a-4010-9fa7-499f2dc3da3d admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:24:24.330985 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1800/3597] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:24:24 2022] POST /identity/v3/users => generated 289 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:24:24.336265 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5b034a-2d36-4a31-9135-ef7e6ba3166d admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:24:24.352115 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5b034a-2d36-4a31-9135-ef7e6ba3166d admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:24:24.373330 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf5786b-353e-4524-95d6-2b7b4306a912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:24:24.374060 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf5786b-353e-4524-95d6-2b7b4306a912 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:24:24.374342 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf5786b-353e-4524-95d6-2b7b4306a912 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:24:24.374617 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf5786b-353e-4524-95d6-2b7b4306a912 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:24:24.375878 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf5786b-353e-4524-95d6-2b7b4306a912 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:24:24.376976 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf5786b-353e-4524-95d6-2b7b4306a912 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:24:24.395160 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1798/3598] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:24:24 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:24:24.398581 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d951a331-945a-4010-9fa7-499f2dc3da3d admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:24:24.410371 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d951a331-945a-4010-9fa7-499f2dc3da3d admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:24:24.415718 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efee2877-d3d6-4a09-8f23-6919db629afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:24:24.416590 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efee2877-d3d6-4a09-8f23-6919db629afc admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:24:24.416969 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efee2877-d3d6-4a09-8f23-6919db629afc admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:24:24.417501 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efee2877-d3d6-4a09-8f23-6919db629afc admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:24:24.418374 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efee2877-d3d6-4a09-8f23-6919db629afc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:24:24.420087 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efee2877-d3d6-4a09-8f23-6919db629afc admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:24:24.459288 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1801/3599] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:24:24 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 21:24:24.466359 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf5786b-353e-4524-95d6-2b7b4306a912 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:24:24.484064 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf5786b-353e-4524-95d6-2b7b4306a912 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:24:24.492794 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610df5b7-dbd9-4baf-977a-105c7ab6c3b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:24:24.495228 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610df5b7-dbd9-4baf-977a-105c7ab6c3b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:24:24.498384 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610df5b7-dbd9-4baf-977a-105c7ab6c3b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:24:24.498944 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610df5b7-dbd9-4baf-977a-105c7ab6c3b4 admin admin] PATH_INFO: `/v3/projects/9116def61aba4631be91f67df63ebab0/users/2a609c39c14343e1bc1edd4b3cd56dd4/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:24:24.521579 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610df5b7-dbd9-4baf-977a-105c7ab6c3b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9116def61aba4631be91f67df63ebab0, user_id=2a609c39c14343e1bc1edd4b3cd56dd4, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:24:24.524909 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610df5b7-dbd9-4baf-977a-105c7ab6c3b4 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:24:24.549172 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:24:24.562473 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1799/3600] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:24:24 2022] PUT /identity/v3/projects/9116def61aba4631be91f67df63ebab0/users/2a609c39c14343e1bc1edd4b3cd56dd4/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:24:24.572353 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cc8667-6c22-4fe8-a19a-41b5a1a0cfa9 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:24:24.573139 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cc8667-6c22-4fe8-a19a-41b5a1a0cfa9 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:24:24.573571 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cc8667-6c22-4fe8-a19a-41b5a1a0cfa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:24:24.592313 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610df5b7-dbd9-4baf-977a-105c7ab6c3b4 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:24:24.594245 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-610df5b7-dbd9-4baf-977a-105c7ab6c3b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:24:24.612478 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-d1cc8667-6c22-4fe8-a19a-41b5a1a0cfa9 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:24:24.613954 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-d1cc8667-6c22-4fe8-a19a-41b5a1a0cfa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:24:24.756164 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610df5b7-dbd9-4baf-977a-105c7ab6c3b4 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:24:24.766215 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5debe518-03c1-4add-aa4c-5fc8be800419 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:24:24.768164 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5debe518-03c1-4add-aa4c-5fc8be800419 service nova] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:24:24.769109 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1802/3601] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:24:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:24:24.778573 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5debe518-03c1-4add-aa4c-5fc8be800419 service nova] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:24:24.779241 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5debe518-03c1-4add-aa4c-5fc8be800419 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:24:24.782439 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-5debe518-03c1-4add-aa4c-5fc8be800419 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:24:24.803936 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cc8667-6c22-4fe8-a19a-41b5a1a0cfa9 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:24:24.805974 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-d1cc8667-6c22-4fe8-a19a-41b5a1a0cfa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:24:24.806870 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5debe518-03c1-4add-aa4c-5fc8be800419 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:24:24.826770 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5debe518-03c1-4add-aa4c-5fc8be800419 service nova] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:24:24.851480 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1800/3602] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:24:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 23 21:24:24.923077 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cc8667-6c22-4fe8-a19a-41b5a1a0cfa9 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:24:24.926890 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a1212a-1365-42e2-a236-437251255ea5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:24:24.928573 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a1212a-1365-42e2-a236-437251255ea5 service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:24:24.928854 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a1212a-1365-42e2-a236-437251255ea5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:24:24.929126 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a1212a-1365-42e2-a236-437251255ea5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:24:24.938130 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:24:24.957591 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a1212a-1365-42e2-a236-437251255ea5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:24:24.960079 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a1212a-1365-42e2-a236-437251255ea5 service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:24:24.987878 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1803/3603] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:24:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:24:26.968404 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0d7975-36ce-4dc9-b260-c3b0aa3fb8e0 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:24:26.968920 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0d7975-36ce-4dc9-b260-c3b0aa3fb8e0 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:24:26.969044 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0d7975-36ce-4dc9-b260-c3b0aa3fb8e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:24:27.000712 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-cb0d7975-36ce-4dc9-b260-c3b0aa3fb8e0 None None] MFA Rules not processed for user `7cd8823a2d134f4ea1e31f92e65df040`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:24:27.018785 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-cb0d7975-36ce-4dc9-b260-c3b0aa3fb8e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:24:27.249265 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1801/3604] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:24:26 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:24:27.790260 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a1212a-1365-42e2-a236-437251255ea5 service neutron] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:24:27.791926 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-c8a1212a-1365-42e2-a236-437251255ea5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:24:27.805810 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a1212a-1365-42e2-a236-437251255ea5 service neutron] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:24:27.808625 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0d7975-36ce-4dc9-b260-c3b0aa3fb8e0 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:24:27.816109 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5da471-950b-48f6-ad99-d7a84934388c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:24:27.817028 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5da471-950b-48f6-ad99-d7a84934388c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:24:27.817310 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5da471-950b-48f6-ad99-d7a84934388c admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:24:27.817587 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5da471-950b-48f6-ad99-d7a84934388c admin admin] PATH_INFO: `/v3/users/8bfb831babfd456e9cd186bab2ca14bb` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:24:27.818854 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0d7975-36ce-4dc9-b260-c3b0aa3fb8e0 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:24:27.820877 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5da471-950b-48f6-ad99-d7a84934388c admin admin] RBAC: Authorizing `identity:delete_user(user_id=8bfb831babfd456e9cd186bab2ca14bb)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:24:27.823424 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5da471-950b-48f6-ad99-d7a84934388c admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:24:27.823969 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af63f463-de06-47e2-b4ce-f0c0d1d5774b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:24:27.824847 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af63f463-de06-47e2-b4ce-f0c0d1d5774b service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:24:27.825325 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af63f463-de06-47e2-b4ce-f0c0d1d5774b service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:24:27.825924 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af63f463-de06-47e2-b4ce-f0c0d1d5774b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:24:27.830599 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-af63f463-de06-47e2-b4ce-f0c0d1d5774b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:24:27.843273 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af63f463-de06-47e2-b4ce-f0c0d1d5774b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:24:27.845058 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af63f463-de06-47e2-b4ce-f0c0d1d5774b service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:24:27.857164 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1802/3605] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:24:27 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:24:27.928268 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-dd5da471-950b-48f6-ad99-d7a84934388c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8bfb831babfd456e9cd186bab2ca14bb'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:24:27.929321 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-dd5da471-950b-48f6-ad99-d7a84934388c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8bfb831babfd456e9cd186bab2ca14bb'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:24:27.939807 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-dd5da471-950b-48f6-ad99-d7a84934388c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8bfb831babfd456e9cd186bab2ca14bb'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:24:27.952924 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-dd5da471-950b-48f6-ad99-d7a84934388c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8bfb831babfd456e9cd186bab2ca14bb'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:24:27.984688 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-dd5da471-950b-48f6-ad99-d7a84934388c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8bfb831babfd456e9cd186bab2ca14bb'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:24:27.992544 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1804/3606] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:24:27 2022] DELETE /identity/v3/users/8bfb831babfd456e9cd186bab2ca14bb => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:24:27.997972 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939a5638-4dfd-4c94-abb1-102899f18f56 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:24:27.998514 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939a5638-4dfd-4c94-abb1-102899f18f56 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:24:27.998761 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939a5638-4dfd-4c94-abb1-102899f18f56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:24:28.026440 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-939a5638-4dfd-4c94-abb1-102899f18f56 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:24:28.027766 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-939a5638-4dfd-4c94-abb1-102899f18f56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:24:28.140367 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1803/3607] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:24:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:24:28.158045 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5da471-950b-48f6-ad99-d7a84934388c admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:24:28.160552 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-dd5da471-950b-48f6-ad99-d7a84934388c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:24:28.318521 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5da471-950b-48f6-ad99-d7a84934388c admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:24:28.326981 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dca2c33-a09a-410e-be99-446203cdc9d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:24:28.327858 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dca2c33-a09a-410e-be99-446203cdc9d8 service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:24:28.328316 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dca2c33-a09a-410e-be99-446203cdc9d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:24:28.328765 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dca2c33-a09a-410e-be99-446203cdc9d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:24:28.352095 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dca2c33-a09a-410e-be99-446203cdc9d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:24:28.355729 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dca2c33-a09a-410e-be99-446203cdc9d8 service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:24:28.369624 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1805/3608] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:24:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:24:28.722879 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939a5638-4dfd-4c94-abb1-102899f18f56 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:24:28.724338 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-939a5638-4dfd-4c94-abb1-102899f18f56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:24:28.746732 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939a5638-4dfd-4c94-abb1-102899f18f56 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:24:28.753582 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071cb0a7-572d-4774-be33-2b7fb7516cc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:24:28.766683 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071cb0a7-572d-4774-be33-2b7fb7516cc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:24:28.767193 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071cb0a7-572d-4774-be33-2b7fb7516cc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:24:28.767495 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071cb0a7-572d-4774-be33-2b7fb7516cc0 admin admin] PATH_INFO: `/v3/projects/37510f38df0a45a6bb7771bdb0fbe271` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:24:28.770046 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071cb0a7-572d-4774-be33-2b7fb7516cc0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=37510f38df0a45a6bb7771bdb0fbe271)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:24:28.772145 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071cb0a7-572d-4774-be33-2b7fb7516cc0 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:24:28.789042 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:24:28.847955 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-071cb0a7-572d-4774-be33-2b7fb7516cc0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37510f38df0a45a6bb7771bdb0fbe271', 'request_id': 'req-071cb0a7-572d-4774-be33-2b7fb7516cc0'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:24:28.860460 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-071cb0a7-572d-4774-be33-2b7fb7516cc0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37510f38df0a45a6bb7771bdb0fbe271', 'request_id': 'req-071cb0a7-572d-4774-be33-2b7fb7516cc0'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:24:28.870092 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-071cb0a7-572d-4774-be33-2b7fb7516cc0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37510f38df0a45a6bb7771bdb0fbe271', 'request_id': 'req-071cb0a7-572d-4774-be33-2b7fb7516cc0'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:24:28.884679 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-071cb0a7-572d-4774-be33-2b7fb7516cc0 admin admin] The token cache is being invalidate because project 37510f38df0a45a6bb7771bdb0fbe271 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:24:28.885073 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-071cb0a7-572d-4774-be33-2b7fb7516cc0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:24:28.885815 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-071cb0a7-572d-4774-be33-2b7fb7516cc0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:24:28.887685 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1804/3609] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:24:28 2022] DELETE /identity/v3/projects/37510f38df0a45a6bb7771bdb0fbe271 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:24:28.892339 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dca2c33-a09a-410e-be99-446203cdc9d8 service neutron] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:24:28.902777 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dca2c33-a09a-410e-be99-446203cdc9d8 service neutron] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:24:28.976574 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bca709f-90b0-4aaf-967b-79a38b291e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:24:28.977488 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bca709f-90b0-4aaf-967b-79a38b291e9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:24:28.977771 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bca709f-90b0-4aaf-967b-79a38b291e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:24:28.978159 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bca709f-90b0-4aaf-967b-79a38b291e9c admin admin] PATH_INFO: `/v3/users/7915614cf61a40f1b79f84a3fb475b79` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:24:28.979392 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bca709f-90b0-4aaf-967b-79a38b291e9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=7915614cf61a40f1b79f84a3fb475b79)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:24:28.981678 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bca709f-90b0-4aaf-967b-79a38b291e9c admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:24:28.996265 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:24:29.044420 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-2bca709f-90b0-4aaf-967b-79a38b291e9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7915614cf61a40f1b79f84a3fb475b79'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:24:29.045088 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-2bca709f-90b0-4aaf-967b-79a38b291e9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7915614cf61a40f1b79f84a3fb475b79'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:24:29.054522 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-2bca709f-90b0-4aaf-967b-79a38b291e9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7915614cf61a40f1b79f84a3fb475b79'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:24:29.065761 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-2bca709f-90b0-4aaf-967b-79a38b291e9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7915614cf61a40f1b79f84a3fb475b79'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:24:29.081110 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-2bca709f-90b0-4aaf-967b-79a38b291e9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7915614cf61a40f1b79f84a3fb475b79'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:24:29.092779 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1806/3610] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:24:28 2022] DELETE /identity/v3/users/7915614cf61a40f1b79f84a3fb475b79 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:24:29.458948 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071cb0a7-572d-4774-be33-2b7fb7516cc0 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:24:29.462310 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-071cb0a7-572d-4774-be33-2b7fb7516cc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:24:29.483675 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071cb0a7-572d-4774-be33-2b7fb7516cc0 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:24:29.652791 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87577fbc-285d-4fe2-98bd-1705d5a28044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:24:29.654291 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87577fbc-285d-4fe2-98bd-1705d5a28044 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:24:29.654778 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87577fbc-285d-4fe2-98bd-1705d5a28044 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:24:29.655261 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87577fbc-285d-4fe2-98bd-1705d5a28044 admin admin] PATH_INFO: `/v3/projects/abbbd92e685e4e36b00128403f672d4e` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:24:29.668638 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87577fbc-285d-4fe2-98bd-1705d5a28044 admin admin] RBAC: Authorizing `identity:delete_project(project_id=abbbd92e685e4e36b00128403f672d4e)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:24:29.676506 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87577fbc-285d-4fe2-98bd-1705d5a28044 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:24:29.763305 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-87577fbc-285d-4fe2-98bd-1705d5a28044 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abbbd92e685e4e36b00128403f672d4e', 'request_id': 'req-87577fbc-285d-4fe2-98bd-1705d5a28044'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:24:29.778068 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-87577fbc-285d-4fe2-98bd-1705d5a28044 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abbbd92e685e4e36b00128403f672d4e', 'request_id': 'req-87577fbc-285d-4fe2-98bd-1705d5a28044'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:24:29.802474 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-87577fbc-285d-4fe2-98bd-1705d5a28044 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abbbd92e685e4e36b00128403f672d4e', 'request_id': 'req-87577fbc-285d-4fe2-98bd-1705d5a28044'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:24:29.833596 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-87577fbc-285d-4fe2-98bd-1705d5a28044 admin admin] The token cache is being invalidate because project abbbd92e685e4e36b00128403f672d4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:24:29.834310 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-87577fbc-285d-4fe2-98bd-1705d5a28044 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:24:29.835246 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-87577fbc-285d-4fe2-98bd-1705d5a28044 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:24:29.839143 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1805/3611] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:24:29 2022] DELETE /identity/v3/projects/abbbd92e685e4e36b00128403f672d4e => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:24:29.848261 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec11aaf-989c-419e-906f-e9f1b53bb658 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:24:29.850179 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec11aaf-989c-419e-906f-e9f1b53bb658 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:24:29.850634 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec11aaf-989c-419e-906f-e9f1b53bb658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:24:29.888947 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-fec11aaf-989c-419e-906f-e9f1b53bb658 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:24:29.891006 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-fec11aaf-989c-419e-906f-e9f1b53bb658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:24:29.986245 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1807/3612] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:24:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:24:29.995101 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836b36b8-aca0-47a3-a95a-61f98d7c038e None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:24:29.995629 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836b36b8-aca0-47a3-a95a-61f98d7c038e None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:24:29.996017 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836b36b8-aca0-47a3-a95a-61f98d7c038e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:24:30.021699 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-836b36b8-aca0-47a3-a95a-61f98d7c038e None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:24:30.023411 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-836b36b8-aca0-47a3-a95a-61f98d7c038e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:24:30.035321 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1806/3613] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:24:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:24:30.039768 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec11aaf-989c-419e-906f-e9f1b53bb658 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:24:30.052457 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec11aaf-989c-419e-906f-e9f1b53bb658 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:24:30.058610 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b40d85-4db3-4880-a653-37dc3bf27a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:24:30.059810 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b40d85-4db3-4880-a653-37dc3bf27a43 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:24:30.060191 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b40d85-4db3-4880-a653-37dc3bf27a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:24:30.060592 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b40d85-4db3-4880-a653-37dc3bf27a43 admin admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:24:30.061453 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b40d85-4db3-4880-a653-37dc3bf27a43 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:24:30.062199 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b40d85-4db3-4880-a653-37dc3bf27a43 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:24:30.064567 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b40d85-4db3-4880-a653-37dc3bf27a43 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:24:30.085524 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1808/3614] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:24:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:24:30.089900 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836b36b8-aca0-47a3-a95a-61f98d7c038e None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:24:30.102915 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836b36b8-aca0-47a3-a95a-61f98d7c038e None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:24:30.108435 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4a77c4-5291-4d06-b373-518dd0378a83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:24:30.109341 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4a77c4-5291-4d06-b373-518dd0378a83 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:24:30.109711 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4a77c4-5291-4d06-b373-518dd0378a83 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:24:30.110121 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4a77c4-5291-4d06-b373-518dd0378a83 admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:24:30.111411 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4a77c4-5291-4d06-b373-518dd0378a83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:24:30.113515 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4a77c4-5291-4d06-b373-518dd0378a83 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:24:30.152336 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1807/3615] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:24:30 2022] POST /identity/v3/projects => generated 379 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:24:30.153786 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b40d85-4db3-4880-a653-37dc3bf27a43 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:24:30.171417 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b40d85-4db3-4880-a653-37dc3bf27a43 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:24:30.271965 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9452392-0c46-4235-a060-0ec05d6d4bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:24:30.273045 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9452392-0c46-4235-a060-0ec05d6d4bde admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:24:30.273765 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9452392-0c46-4235-a060-0ec05d6d4bde admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:24:30.274300 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9452392-0c46-4235-a060-0ec05d6d4bde admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:24:30.275017 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9452392-0c46-4235-a060-0ec05d6d4bde admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:24:30.279107 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9452392-0c46-4235-a060-0ec05d6d4bde admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:24:30.320310 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1809/3616] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:24:30 2022] POST /identity/v3/users => generated 290 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:24:30.322018 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4a77c4-5291-4d06-b373-518dd0378a83 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:24:30.328035 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:24:30.342073 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4a77c4-5291-4d06-b373-518dd0378a83 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:24:30.358821 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aafe70-760f-43a9-9782-bee61753db31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:24:30.360596 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aafe70-760f-43a9-9782-bee61753db31 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:24:30.361116 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aafe70-760f-43a9-9782-bee61753db31 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:24:30.361536 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aafe70-760f-43a9-9782-bee61753db31 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:24:30.363145 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22aafe70-760f-43a9-9782-bee61753db31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:24:30.365908 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22aafe70-760f-43a9-9782-bee61753db31 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:24:30.392375 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9452392-0c46-4235-a060-0ec05d6d4bde admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:24:30.421594 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9452392-0c46-4235-a060-0ec05d6d4bde admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:24:30.421786 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1808/3617] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:24:30 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 21:24:30.440190 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c463ad1-204e-498e-be10-0bb76a2f8035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:24:30.441760 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c463ad1-204e-498e-be10-0bb76a2f8035 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:24:30.443206 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c463ad1-204e-498e-be10-0bb76a2f8035 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:24:30.443839 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c463ad1-204e-498e-be10-0bb76a2f8035 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:24:30.445108 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c463ad1-204e-498e-be10-0bb76a2f8035 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:24:30.447352 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c463ad1-204e-498e-be10-0bb76a2f8035 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:24:30.458648 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:24:30.481911 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1810/3618] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:24:30 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:24:30.485794 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aafe70-760f-43a9-9782-bee61753db31 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:24:30.504662 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aafe70-760f-43a9-9782-bee61753db31 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:24:30.514435 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4732fc6a-0652-4c3c-8f86-7a29c51dc6f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:24:30.515861 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4732fc6a-0652-4c3c-8f86-7a29c51dc6f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:24:30.516142 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4732fc6a-0652-4c3c-8f86-7a29c51dc6f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:24:30.516408 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4732fc6a-0652-4c3c-8f86-7a29c51dc6f2 admin admin] PATH_INFO: `/v3/projects/55c6d68f7ee944a098da7c002ebce6eb/users/2c562b1e809c457ca1fc2f1703075c8c/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:24:30.542086 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4732fc6a-0652-4c3c-8f86-7a29c51dc6f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55c6d68f7ee944a098da7c002ebce6eb, user_id=2c562b1e809c457ca1fc2f1703075c8c, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:24:30.545727 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4732fc6a-0652-4c3c-8f86-7a29c51dc6f2 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:24:30.584024 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1809/3619] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:24:30 2022] PUT /identity/v3/projects/55c6d68f7ee944a098da7c002ebce6eb/users/2c562b1e809c457ca1fc2f1703075c8c/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:24:30.585055 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7ee862-bff4-4454-a3b9-86d43c190c85 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:24:30.585344 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7ee862-bff4-4454-a3b9-86d43c190c85 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:24:30.585619 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7ee862-bff4-4454-a3b9-86d43c190c85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:24:30.616850 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-ea7ee862-bff4-4454-a3b9-86d43c190c85 None None] MFA Rules not processed for user `2c562b1e809c457ca1fc2f1703075c8c`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:24:30.618179 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-ea7ee862-bff4-4454-a3b9-86d43c190c85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:24:30.731699 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1811/3620] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:24:30 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:24:30.741082 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4732fc6a-0652-4c3c-8f86-7a29c51dc6f2 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:24:30.742970 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-4732fc6a-0652-4c3c-8f86-7a29c51dc6f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:24:30.883359 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4732fc6a-0652-4c3c-8f86-7a29c51dc6f2 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:24:30.894184 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a65bc8d-d1e3-45a8-8399-92faee8b4741 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:24:30.895263 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a65bc8d-d1e3-45a8-8399-92faee8b4741 service nova] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:24:30.895769 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a65bc8d-d1e3-45a8-8399-92faee8b4741 service nova] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:24:30.896107 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a65bc8d-d1e3-45a8-8399-92faee8b4741 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:24:30.905214 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a65bc8d-d1e3-45a8-8399-92faee8b4741 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:24:30.907004 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a65bc8d-d1e3-45a8-8399-92faee8b4741 service nova] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:24:30.935304 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1810/3621] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:24:30 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:24:31.142978 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8256cdf1-72c2-4e2f-8fbb-6ce9eb4d7ca0 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:24:31.144561 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8256cdf1-72c2-4e2f-8fbb-6ce9eb4d7ca0 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:24:31.144994 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8256cdf1-72c2-4e2f-8fbb-6ce9eb4d7ca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:24:31.176278 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-8256cdf1-72c2-4e2f-8fbb-6ce9eb4d7ca0 None None] MFA Rules not processed for user `17b779a3e21a415bb42cde5d6863d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:24:31.178822 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-8256cdf1-72c2-4e2f-8fbb-6ce9eb4d7ca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:24:31.281002 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1812/3622] 10.222.0.17 () {58 vars in 1009 bytes} [Sat Jul 23 21:24:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:24:31.325182 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a65bc8d-d1e3-45a8-8399-92faee8b4741 service nova] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:24:31.326989 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-9a65bc8d-d1e3-45a8-8399-92faee8b4741 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:24:31.434980 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a65bc8d-d1e3-45a8-8399-92faee8b4741 service nova] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:24:31.441087 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5fdae8-e015-4541-b013-7013c41c992a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f0a685b7da46afb81024848f079d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:24:31.442977 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5fdae8-e015-4541-b013-7013c41c992a service swift] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:24:31.443289 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5fdae8-e015-4541-b013-7013c41c992a service swift] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:24:31.443582 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5fdae8-e015-4541-b013-7013c41c992a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:24:31.453684 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5fdae8-e015-4541-b013-7013c41c992a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:24:31.455347 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5fdae8-e015-4541-b013-7013c41c992a service swift] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:24:31.465665 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1811/3623] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 23 21:24:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 23 21:24:31.680722 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1858e8a6-c0e2-4638-9957-fada7bd26ee1 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:24:31.681063 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1858e8a6-c0e2-4638-9957-fada7bd26ee1 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:24:31.686390 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1858e8a6-c0e2-4638-9957-fada7bd26ee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:24:31.749487 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-1858e8a6-c0e2-4638-9957-fada7bd26ee1 None None] MFA Rules not processed for user `2c562b1e809c457ca1fc2f1703075c8c`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:24:31.757934 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-1858e8a6-c0e2-4638-9957-fada7bd26ee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:24:31.776335 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1813/3624] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:24:31 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:24:32.911725 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffee5501-ce2b-4e17-b27e-0ea37a84058d None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:24:32.912205 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffee5501-ce2b-4e17-b27e-0ea37a84058d None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:24:32.912467 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffee5501-ce2b-4e17-b27e-0ea37a84058d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:24:32.954696 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-ffee5501-ce2b-4e17-b27e-0ea37a84058d None None] MFA Rules not processed for user `17b779a3e21a415bb42cde5d6863d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:24:32.956419 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-ffee5501-ce2b-4e17-b27e-0ea37a84058d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:24:33.008660 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1812/3625] 10.222.0.17 () {58 vars in 967 bytes} [Sat Jul 23 21:24:32 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:24:33.009907 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1858e8a6-c0e2-4638-9957-fada7bd26ee1 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:24:33.027047 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1858e8a6-c0e2-4638-9957-fada7bd26ee1 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:24:33.032972 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82c4dbe-a10e-4336-bb63-009b3eece61f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f0a685b7da46afb81024848f079d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:24:33.033635 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82c4dbe-a10e-4336-bb63-009b3eece61f service swift] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:24:33.033948 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82c4dbe-a10e-4336-bb63-009b3eece61f service swift] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:24:33.034259 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82c4dbe-a10e-4336-bb63-009b3eece61f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:24:33.049379 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82c4dbe-a10e-4336-bb63-009b3eece61f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:24:33.050992 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82c4dbe-a10e-4336-bb63-009b3eece61f service swift] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:24:33.066571 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1814/3626] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 23 21:24:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 23 21:24:33.262064 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffee5501-ce2b-4e17-b27e-0ea37a84058d None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:24:33.332530 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:24:33.374177 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffee5501-ce2b-4e17-b27e-0ea37a84058d None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:24:33.381493 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346365ec-debd-4682-9037-21a88f76911f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:24:33.383119 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346365ec-debd-4682-9037-21a88f76911f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:24:33.383578 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346365ec-debd-4682-9037-21a88f76911f admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:24:33.384028 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346365ec-debd-4682-9037-21a88f76911f admin admin] PATH_INFO: `/v3/users/2c562b1e809c457ca1fc2f1703075c8c` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:24:33.385792 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346365ec-debd-4682-9037-21a88f76911f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c562b1e809c457ca1fc2f1703075c8c)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:24:33.388927 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346365ec-debd-4682-9037-21a88f76911f admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:24:33.462522 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-346365ec-debd-4682-9037-21a88f76911f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c562b1e809c457ca1fc2f1703075c8c'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:24:33.482352 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-346365ec-debd-4682-9037-21a88f76911f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c562b1e809c457ca1fc2f1703075c8c'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:24:33.483198 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-346365ec-debd-4682-9037-21a88f76911f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c562b1e809c457ca1fc2f1703075c8c'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:24:33.510035 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-346365ec-debd-4682-9037-21a88f76911f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c562b1e809c457ca1fc2f1703075c8c'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:24:33.546717 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-346365ec-debd-4682-9037-21a88f76911f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c562b1e809c457ca1fc2f1703075c8c'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:24:33.561611 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1813/3627] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:24:33 2022] DELETE /identity/v3/users/2c562b1e809c457ca1fc2f1703075c8c => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:24:33.567911 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b883972-9eb8-496d-81cb-50a43f7c3869 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:24:33.568425 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b883972-9eb8-496d-81cb-50a43f7c3869 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:24:33.569734 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b883972-9eb8-496d-81cb-50a43f7c3869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:24:33.616243 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-6b883972-9eb8-496d-81cb-50a43f7c3869 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:24:33.617251 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-6b883972-9eb8-496d-81cb-50a43f7c3869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:24:33.746046 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1815/3628] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:24:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:24:33.765403 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346365ec-debd-4682-9037-21a88f76911f admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:24:33.766970 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-346365ec-debd-4682-9037-21a88f76911f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:24:33.870973 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346365ec-debd-4682-9037-21a88f76911f admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:24:33.875362 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fdac96-525e-4354-8c41-09890131cb08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:24:33.876047 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fdac96-525e-4354-8c41-09890131cb08 service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:24:33.876330 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fdac96-525e-4354-8c41-09890131cb08 service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:24:33.876607 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fdac96-525e-4354-8c41-09890131cb08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:24:33.895469 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fdac96-525e-4354-8c41-09890131cb08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:24:33.897015 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fdac96-525e-4354-8c41-09890131cb08 service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:24:33.923340 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1814/3629] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:24:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:24:34.544985 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b883972-9eb8-496d-81cb-50a43f7c3869 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:24:34.546486 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-6b883972-9eb8-496d-81cb-50a43f7c3869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:24:34.564833 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b883972-9eb8-496d-81cb-50a43f7c3869 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:24:34.571026 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6579fecb-a44d-4352-8acd-a334b8d4f55b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:24:34.572332 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6579fecb-a44d-4352-8acd-a334b8d4f55b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:24:34.572858 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6579fecb-a44d-4352-8acd-a334b8d4f55b admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:24:34.573339 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6579fecb-a44d-4352-8acd-a334b8d4f55b admin admin] PATH_INFO: `/v3/projects/55c6d68f7ee944a098da7c002ebce6eb` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:24:34.577226 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6579fecb-a44d-4352-8acd-a334b8d4f55b admin admin] RBAC: Authorizing `identity:delete_project(project_id=55c6d68f7ee944a098da7c002ebce6eb)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:24:34.580299 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6579fecb-a44d-4352-8acd-a334b8d4f55b admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:24:34.589836 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:24:34.669902 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-6579fecb-a44d-4352-8acd-a334b8d4f55b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55c6d68f7ee944a098da7c002ebce6eb', 'request_id': 'req-6579fecb-a44d-4352-8acd-a334b8d4f55b'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:24:34.682579 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-6579fecb-a44d-4352-8acd-a334b8d4f55b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55c6d68f7ee944a098da7c002ebce6eb', 'request_id': 'req-6579fecb-a44d-4352-8acd-a334b8d4f55b'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:24:34.690760 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-6579fecb-a44d-4352-8acd-a334b8d4f55b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55c6d68f7ee944a098da7c002ebce6eb', 'request_id': 'req-6579fecb-a44d-4352-8acd-a334b8d4f55b'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:24:34.708235 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-6579fecb-a44d-4352-8acd-a334b8d4f55b admin admin] The token cache is being invalidate because project 55c6d68f7ee944a098da7c002ebce6eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:24:34.708537 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-6579fecb-a44d-4352-8acd-a334b8d4f55b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:24:34.709196 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-6579fecb-a44d-4352-8acd-a334b8d4f55b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:24:34.712223 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1816/3630] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:24:34 2022] DELETE /identity/v3/projects/55c6d68f7ee944a098da7c002ebce6eb => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:24:34.716386 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ceba3d-2980-488d-b246-bf3599b15300 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:24:34.716671 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ceba3d-2980-488d-b246-bf3599b15300 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:24:34.716935 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ceba3d-2980-488d-b246-bf3599b15300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:24:34.769807 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-d0ceba3d-2980-488d-b246-bf3599b15300 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:24:34.772939 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-d0ceba3d-2980-488d-b246-bf3599b15300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:24:34.911887 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:24:34.940922 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1815/3631] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:24:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:24:34.942496 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b1c2e9-6a41-4497-830c-1a8787e75563 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:24:34.942785 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b1c2e9-6a41-4497-830c-1a8787e75563 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:24:34.943059 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b1c2e9-6a41-4497-830c-1a8787e75563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:24:34.974213 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-b3b1c2e9-6a41-4497-830c-1a8787e75563 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:24:34.976515 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-b3b1c2e9-6a41-4497-830c-1a8787e75563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:24:34.988140 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1817/3632] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:24:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:24:34.992001 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ceba3d-2980-488d-b246-bf3599b15300 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:24:35.007120 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ceba3d-2980-488d-b246-bf3599b15300 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:24:35.021519 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffe5652-1862-424b-a1e2-f3160234f83f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:24:35.022814 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffe5652-1862-424b-a1e2-f3160234f83f admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:24:35.023323 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffe5652-1862-424b-a1e2-f3160234f83f admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:24:35.023804 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffe5652-1862-424b-a1e2-f3160234f83f admin admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:24:35.025288 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffe5652-1862-424b-a1e2-f3160234f83f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:24:35.026008 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffe5652-1862-424b-a1e2-f3160234f83f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:24:35.028567 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffe5652-1862-424b-a1e2-f3160234f83f admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:24:35.053447 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1816/3633] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:24:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 21:24:35.057109 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b1c2e9-6a41-4497-830c-1a8787e75563 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:24:35.074290 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b1c2e9-6a41-4497-830c-1a8787e75563 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:24:35.086329 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83572fd6-5aad-4649-9834-b8920b9aaf98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:24:35.087165 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83572fd6-5aad-4649-9834-b8920b9aaf98 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:24:35.087621 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83572fd6-5aad-4649-9834-b8920b9aaf98 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:24:35.088187 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83572fd6-5aad-4649-9834-b8920b9aaf98 admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:24:35.088795 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83572fd6-5aad-4649-9834-b8920b9aaf98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:24:35.090852 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83572fd6-5aad-4649-9834-b8920b9aaf98 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:24:35.156897 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1818/3634] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:24:35 2022] POST /identity/v3/projects => generated 399 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:24:35.160921 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffe5652-1862-424b-a1e2-f3160234f83f admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:24:35.171259 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffe5652-1862-424b-a1e2-f3160234f83f admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:24:35.244557 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6c0ba1-a27e-4082-a233-0a0269cf5475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:24:35.245247 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6c0ba1-a27e-4082-a233-0a0269cf5475 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:24:35.245526 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6c0ba1-a27e-4082-a233-0a0269cf5475 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:24:35.246247 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6c0ba1-a27e-4082-a233-0a0269cf5475 admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:24:35.246563 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6c0ba1-a27e-4082-a233-0a0269cf5475 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:24:35.248864 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6c0ba1-a27e-4082-a233-0a0269cf5475 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:24:35.273911 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1817/3635] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:24:35 2022] POST /identity/v3/users => generated 300 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:24:35.277850 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83572fd6-5aad-4649-9834-b8920b9aaf98 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:24:35.292574 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83572fd6-5aad-4649-9834-b8920b9aaf98 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:24:35.334479 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f802d968-bb99-4702-ae8b-de04be218fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:24:35.334845 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f802d968-bb99-4702-ae8b-de04be218fdc admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:24:35.336207 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f802d968-bb99-4702-ae8b-de04be218fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:24:35.336207 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f802d968-bb99-4702-ae8b-de04be218fdc admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:24:35.336207 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f802d968-bb99-4702-ae8b-de04be218fdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:24:35.342289 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f802d968-bb99-4702-ae8b-de04be218fdc admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:24:35.359475 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1819/3636] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:24:35 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 21:24:35.364291 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6c0ba1-a27e-4082-a233-0a0269cf5475 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:24:35.385131 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6c0ba1-a27e-4082-a233-0a0269cf5475 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:24:35.393147 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c28bdb7-f5dc-40b9-bfb5-5aa9861ef01c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:24:35.394828 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c28bdb7-f5dc-40b9-bfb5-5aa9861ef01c admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:24:35.395113 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c28bdb7-f5dc-40b9-bfb5-5aa9861ef01c admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:24:35.395386 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c28bdb7-f5dc-40b9-bfb5-5aa9861ef01c admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:24:35.396128 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c28bdb7-f5dc-40b9-bfb5-5aa9861ef01c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:24:35.397798 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c28bdb7-f5dc-40b9-bfb5-5aa9861ef01c admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:24:35.419112 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1818/3637] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:24:35 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:24:35.421320 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f802d968-bb99-4702-ae8b-de04be218fdc admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:24:35.442992 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f802d968-bb99-4702-ae8b-de04be218fdc admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:24:35.448657 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6c537a-56b9-47b8-be63-e93487b80c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:24:35.449601 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6c537a-56b9-47b8-be63-e93487b80c96 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:24:35.449911 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6c537a-56b9-47b8-be63-e93487b80c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:24:35.450181 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6c537a-56b9-47b8-be63-e93487b80c96 admin admin] PATH_INFO: `/v3/projects/8305585b60d54beeb2b087a37260a89a/users/e961e46ab94f4fffbc606485935ce64d/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:24:35.481542 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6c537a-56b9-47b8-be63-e93487b80c96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8305585b60d54beeb2b087a37260a89a, user_id=e961e46ab94f4fffbc606485935ce64d, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:24:35.485509 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6c537a-56b9-47b8-be63-e93487b80c96 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:24:35.513898 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58827a05-8b90-463e-bebc-c42ee67bf86c None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:24:35.514449 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58827a05-8b90-463e-bebc-c42ee67bf86c None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:24:35.514877 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58827a05-8b90-463e-bebc-c42ee67bf86c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:24:35.516505 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1820/3638] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:24:35 2022] PUT /identity/v3/projects/8305585b60d54beeb2b087a37260a89a/users/e961e46ab94f4fffbc606485935ce64d/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:24:35.538102 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-58827a05-8b90-463e-bebc-c42ee67bf86c None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:24:35.539413 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-58827a05-8b90-463e-bebc-c42ee67bf86c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:24:35.622762 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1819/3639] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:24:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:24:35.800584 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6c537a-56b9-47b8-be63-e93487b80c96 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:24:35.804064 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-ff6c537a-56b9-47b8-be63-e93487b80c96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:24:35.901039 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6c537a-56b9-47b8-be63-e93487b80c96 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:24:35.906039 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084df3a2-1c54-450b-9adc-9a91c1d5c958 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:24:35.906722 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084df3a2-1c54-450b-9adc-9a91c1d5c958 service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:24:35.907003 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084df3a2-1c54-450b-9adc-9a91c1d5c958 service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:24:35.907276 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084df3a2-1c54-450b-9adc-9a91c1d5c958 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:24:35.919773 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084df3a2-1c54-450b-9adc-9a91c1d5c958 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:24:35.921453 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084df3a2-1c54-450b-9adc-9a91c1d5c958 service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:24:35.954869 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1821/3640] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:24:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:24:36.540647 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58827a05-8b90-463e-bebc-c42ee67bf86c None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:24:36.543665 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-58827a05-8b90-463e-bebc-c42ee67bf86c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:24:36.654031 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:24:36.661727 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58827a05-8b90-463e-bebc-c42ee67bf86c None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:24:36.681472 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144964f7-d16c-411e-8df1-e27c75ba2379 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:24:36.681472 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144964f7-d16c-411e-8df1-e27c75ba2379 service nova] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:24:36.681472 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144964f7-d16c-411e-8df1-e27c75ba2379 service nova] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:24:36.681472 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144964f7-d16c-411e-8df1-e27c75ba2379 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:24:36.682410 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-144964f7-d16c-411e-8df1-e27c75ba2379 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:24:36.699852 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144964f7-d16c-411e-8df1-e27c75ba2379 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:24:36.709465 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144964f7-d16c-411e-8df1-e27c75ba2379 service nova] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:24:36.725413 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1820/3641] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:24:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:24:37.152853 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffe4a2d-ea9c-46f6-a853-1aed998afd4b None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:24:37.153345 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffe4a2d-ea9c-46f6-a853-1aed998afd4b None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:24:37.153442 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffe4a2d-ea9c-46f6-a853-1aed998afd4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:24:37.197313 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-dffe4a2d-ea9c-46f6-a853-1aed998afd4b None None] MFA Rules not processed for user `2a609c39c14343e1bc1edd4b3cd56dd4`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:24:37.199055 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-dffe4a2d-ea9c-46f6-a853-1aed998afd4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:24:37.221919 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:24:37.279760 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1822/3642] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:24:37 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:24:37.290977 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacd988e-87b1-4f05-914c-bb8c303fa245 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:24:37.291256 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacd988e-87b1-4f05-914c-bb8c303fa245 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:24:37.291537 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacd988e-87b1-4f05-914c-bb8c303fa245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:24:37.320090 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-bacd988e-87b1-4f05-914c-bb8c303fa245 None None] MFA Rules not processed for user `2a609c39c14343e1bc1edd4b3cd56dd4`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:24:37.323301 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-bacd988e-87b1-4f05-914c-bb8c303fa245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:24:37.332069 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1821/3643] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:24:37 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:24:37.344508 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffe4a2d-ea9c-46f6-a853-1aed998afd4b None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:24:37.359494 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffe4a2d-ea9c-46f6-a853-1aed998afd4b None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:24:37.367174 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f32bf9-2557-4630-b774-91db48242fed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:24:37.367851 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f32bf9-2557-4630-b774-91db48242fed service nova] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:24:37.368138 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f32bf9-2557-4630-b774-91db48242fed service nova] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:24:37.368474 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f32bf9-2557-4630-b774-91db48242fed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:24:37.380411 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f32bf9-2557-4630-b774-91db48242fed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:24:37.382990 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f32bf9-2557-4630-b774-91db48242fed service nova] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:24:37.394775 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1823/3644] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:24:37 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:24:45.862952 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99ea99f-4a8d-4469-9569-de29f0efce9f None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:24:45.864043 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99ea99f-4a8d-4469-9569-de29f0efce9f None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:24:45.864487 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99ea99f-4a8d-4469-9569-de29f0efce9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:24:45.895887 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-d99ea99f-4a8d-4469-9569-de29f0efce9f None None] MFA Rules not processed for user `e961e46ab94f4fffbc606485935ce64d`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:24:45.897422 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-d99ea99f-4a8d-4469-9569-de29f0efce9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:24:45.977185 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1822/3645] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:24:45 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:24:45.978918 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575b7237-55c2-4c3b-bcfe-9dc3aff7784c None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:24:45.980049 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575b7237-55c2-4c3b-bcfe-9dc3aff7784c None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:24:45.980729 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575b7237-55c2-4c3b-bcfe-9dc3aff7784c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:24:46.011594 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-575b7237-55c2-4c3b-bcfe-9dc3aff7784c None None] MFA Rules not processed for user `e961e46ab94f4fffbc606485935ce64d`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:24:46.013400 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-575b7237-55c2-4c3b-bcfe-9dc3aff7784c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:24:46.021794 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1824/3646] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:24:45 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:24:46.155593 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99ea99f-4a8d-4469-9569-de29f0efce9f None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:24:46.181702 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99ea99f-4a8d-4469-9569-de29f0efce9f None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:24:46.188154 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2ce65b-a3ba-49c7-a145-22cb6d3c3908 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:24:46.189104 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2ce65b-a3ba-49c7-a145-22cb6d3c3908 service nova] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:24:46.189536 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2ce65b-a3ba-49c7-a145-22cb6d3c3908 service nova] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:24:46.189996 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2ce65b-a3ba-49c7-a145-22cb6d3c3908 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:24:46.207654 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2ce65b-a3ba-49c7-a145-22cb6d3c3908 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:24:46.209619 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2ce65b-a3ba-49c7-a145-22cb6d3c3908 service nova] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:24:46.234672 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1823/3647] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:24:46 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:24:53.593554 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575b7237-55c2-4c3b-bcfe-9dc3aff7784c None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:24:53.595178 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-575b7237-55c2-4c3b-bcfe-9dc3aff7784c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:24:53.616904 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575b7237-55c2-4c3b-bcfe-9dc3aff7784c None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:24:53.625298 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617249cd-7024-459b-90d9-952a5a1b1ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:24:53.632835 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617249cd-7024-459b-90d9-952a5a1b1ae8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:24:53.633529 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617249cd-7024-459b-90d9-952a5a1b1ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:24:53.634152 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617249cd-7024-459b-90d9-952a5a1b1ae8 admin admin] PATH_INFO: `/v3/users/013b521930d54d6d952e566f8e67f466` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:24:53.636542 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617249cd-7024-459b-90d9-952a5a1b1ae8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=013b521930d54d6d952e566f8e67f466)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:24:53.639628 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617249cd-7024-459b-90d9-952a5a1b1ae8 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:24:53.781136 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-617249cd-7024-459b-90d9-952a5a1b1ae8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '013b521930d54d6d952e566f8e67f466'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:24:53.781832 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-617249cd-7024-459b-90d9-952a5a1b1ae8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '013b521930d54d6d952e566f8e67f466'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:24:53.800570 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-617249cd-7024-459b-90d9-952a5a1b1ae8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '013b521930d54d6d952e566f8e67f466'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:24:53.825751 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-617249cd-7024-459b-90d9-952a5a1b1ae8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '013b521930d54d6d952e566f8e67f466'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:24:53.850816 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-617249cd-7024-459b-90d9-952a5a1b1ae8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '013b521930d54d6d952e566f8e67f466'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:24:53.869003 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1825/3648] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:24:53 2022] DELETE /identity/v3/users/013b521930d54d6d952e566f8e67f466 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:24:54.306870 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2ce65b-a3ba-49c7-a145-22cb6d3c3908 service nova] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:24:54.322449 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2ce65b-a3ba-49c7-a145-22cb6d3c3908 service nova] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:24:54.460132 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5b4284-2d23-45ce-a61d-fe5ce00234e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:24:54.461036 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5b4284-2d23-45ce-a61d-fe5ce00234e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:24:54.461316 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5b4284-2d23-45ce-a61d-fe5ce00234e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:24:54.461586 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5b4284-2d23-45ce-a61d-fe5ce00234e6 admin admin] PATH_INFO: `/v3/projects/1432b2e152894407afae7b6419d80a8c` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:24:54.463603 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5b4284-2d23-45ce-a61d-fe5ce00234e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1432b2e152894407afae7b6419d80a8c)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:24:54.465578 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5b4284-2d23-45ce-a61d-fe5ce00234e6 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:24:54.576666 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-be5b4284-2d23-45ce-a61d-fe5ce00234e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1432b2e152894407afae7b6419d80a8c', 'request_id': 'req-be5b4284-2d23-45ce-a61d-fe5ce00234e6'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:24:54.619532 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-be5b4284-2d23-45ce-a61d-fe5ce00234e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1432b2e152894407afae7b6419d80a8c', 'request_id': 'req-be5b4284-2d23-45ce-a61d-fe5ce00234e6'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:24:54.634846 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:24:54.642598 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-be5b4284-2d23-45ce-a61d-fe5ce00234e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1432b2e152894407afae7b6419d80a8c', 'request_id': 'req-be5b4284-2d23-45ce-a61d-fe5ce00234e6'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:24:54.675945 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-be5b4284-2d23-45ce-a61d-fe5ce00234e6 admin admin] The token cache is being invalidate because project 1432b2e152894407afae7b6419d80a8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:24:54.679341 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-be5b4284-2d23-45ce-a61d-fe5ce00234e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:24:54.682021 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-be5b4284-2d23-45ce-a61d-fe5ce00234e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:24:54.687547 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1824/3649] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:24:54 2022] DELETE /identity/v3/projects/1432b2e152894407afae7b6419d80a8c => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:24:54.694288 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5340b20b-4148-43c7-b246-0257cda1a72b None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:24:54.695740 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5340b20b-4148-43c7-b246-0257cda1a72b None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:24:54.696325 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5340b20b-4148-43c7-b246-0257cda1a72b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:24:54.725206 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-5340b20b-4148-43c7-b246-0257cda1a72b None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:24:54.727362 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-5340b20b-4148-43c7-b246-0257cda1a72b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:24:54.796085 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1826/3650] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:24:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:24:54.804629 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7753da59-a29c-4a7e-b4e5-963b6945c3ec None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:24:54.804988 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7753da59-a29c-4a7e-b4e5-963b6945c3ec None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:24:54.805329 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7753da59-a29c-4a7e-b4e5-963b6945c3ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:24:54.827425 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-7753da59-a29c-4a7e-b4e5-963b6945c3ec None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:24:54.828700 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-7753da59-a29c-4a7e-b4e5-963b6945c3ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:24:54.837458 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1825/3651] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:24:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:24:54.841632 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5340b20b-4148-43c7-b246-0257cda1a72b None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:24:54.859821 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5340b20b-4148-43c7-b246-0257cda1a72b None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:24:54.865650 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089a1d2f-65df-4489-a65e-b8451ca69f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:24:54.866753 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089a1d2f-65df-4489-a65e-b8451ca69f62 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:24:54.867264 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089a1d2f-65df-4489-a65e-b8451ca69f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:24:54.868121 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089a1d2f-65df-4489-a65e-b8451ca69f62 admin admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:24:54.870559 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089a1d2f-65df-4489-a65e-b8451ca69f62 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:24:54.870967 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089a1d2f-65df-4489-a65e-b8451ca69f62 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:24:54.872791 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089a1d2f-65df-4489-a65e-b8451ca69f62 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:24:54.886995 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1827/3652] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:24:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:24:54.891140 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7753da59-a29c-4a7e-b4e5-963b6945c3ec None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:24:54.903498 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7753da59-a29c-4a7e-b4e5-963b6945c3ec None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:24:54.909526 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cab1c18-f60d-4baf-966e-3f75054f0cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:24:54.909526 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cab1c18-f60d-4baf-966e-3f75054f0cd1 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:24:54.909526 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cab1c18-f60d-4baf-966e-3f75054f0cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:24:54.909526 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cab1c18-f60d-4baf-966e-3f75054f0cd1 admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:24:54.910101 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cab1c18-f60d-4baf-966e-3f75054f0cd1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:24:54.910429 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cab1c18-f60d-4baf-966e-3f75054f0cd1 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:24:54.940785 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1826/3653] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:24:54 2022] POST /identity/v3/projects => generated 389 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:24:54.945034 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089a1d2f-65df-4489-a65e-b8451ca69f62 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:24:54.950957 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:24:54.959518 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089a1d2f-65df-4489-a65e-b8451ca69f62 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:24:55.047532 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101e6961-f650-476e-a61d-23e28851848e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:24:55.048634 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101e6961-f650-476e-a61d-23e28851848e admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:24:55.049100 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101e6961-f650-476e-a61d-23e28851848e admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:24:55.049719 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101e6961-f650-476e-a61d-23e28851848e admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:24:55.051002 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101e6961-f650-476e-a61d-23e28851848e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:24:55.054787 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101e6961-f650-476e-a61d-23e28851848e admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:24:55.091638 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1828/3654] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:24:54 2022] POST /identity/v3/users => generated 295 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:24:55.093254 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cab1c18-f60d-4baf-966e-3f75054f0cd1 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:24:55.105923 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cab1c18-f60d-4baf-966e-3f75054f0cd1 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:24:55.112505 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e2b2fc-c78c-45a1-ac56-b663ba60255b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:24:55.113312 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e2b2fc-c78c-45a1-ac56-b663ba60255b admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:24:55.113593 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e2b2fc-c78c-45a1-ac56-b663ba60255b admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:24:55.113891 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e2b2fc-c78c-45a1-ac56-b663ba60255b admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:24:55.114639 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e2b2fc-c78c-45a1-ac56-b663ba60255b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:24:55.116408 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e2b2fc-c78c-45a1-ac56-b663ba60255b admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:24:55.145576 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1827/3655] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:24:55 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:24:55.150867 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101e6961-f650-476e-a61d-23e28851848e admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:24:55.177356 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101e6961-f650-476e-a61d-23e28851848e admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:24:55.183955 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea1a985-5447-4c7b-8b9b-7521b66bef88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:24:55.184897 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea1a985-5447-4c7b-8b9b-7521b66bef88 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:24:55.185284 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea1a985-5447-4c7b-8b9b-7521b66bef88 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:24:55.185704 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea1a985-5447-4c7b-8b9b-7521b66bef88 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:24:55.186602 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea1a985-5447-4c7b-8b9b-7521b66bef88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:24:55.188490 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea1a985-5447-4c7b-8b9b-7521b66bef88 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:24:55.207762 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1829/3656] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:24:55 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:24:55.212387 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e2b2fc-c78c-45a1-ac56-b663ba60255b admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:24:55.224815 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e2b2fc-c78c-45a1-ac56-b663ba60255b admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:24:55.231131 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bb4c2d-1a20-43d2-a785-883f573337b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:24:55.232258 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bb4c2d-1a20-43d2-a785-883f573337b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:24:55.232632 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bb4c2d-1a20-43d2-a785-883f573337b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:24:55.233248 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bb4c2d-1a20-43d2-a785-883f573337b7 admin admin] PATH_INFO: `/v3/projects/892f8e8d61274d54bd996140a9ab38f9/users/8a7b95c6fb6743cf9f1942a6328a1ba7/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:24:55.252346 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bb4c2d-1a20-43d2-a785-883f573337b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=892f8e8d61274d54bd996140a9ab38f9, user_id=8a7b95c6fb6743cf9f1942a6328a1ba7, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:24:55.255878 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bb4c2d-1a20-43d2-a785-883f573337b7 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:24:55.290454 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628561cf-dc63-4acb-becd-ef7badf50312 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:24:55.291011 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628561cf-dc63-4acb-becd-ef7badf50312 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:24:55.291455 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628561cf-dc63-4acb-becd-ef7badf50312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:24:55.297476 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1828/3657] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:24:55 2022] PUT /identity/v3/projects/892f8e8d61274d54bd996140a9ab38f9/users/8a7b95c6fb6743cf9f1942a6328a1ba7/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:24:55.315807 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-628561cf-dc63-4acb-becd-ef7badf50312 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:24:55.317508 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-628561cf-dc63-4acb-becd-ef7badf50312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:24:55.421798 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1830/3658] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:24:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:24:55.428041 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bb4c2d-1a20-43d2-a785-883f573337b7 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:24:55.432102 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-76bb4c2d-1a20-43d2-a785-883f573337b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:24:55.587709 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bb4c2d-1a20-43d2-a785-883f573337b7 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:24:55.597132 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573c5960-46d6-4e22-9fbb-27094ed440e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:24:55.598686 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573c5960-46d6-4e22-9fbb-27094ed440e3 service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:24:55.598965 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573c5960-46d6-4e22-9fbb-27094ed440e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:24:55.599238 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573c5960-46d6-4e22-9fbb-27094ed440e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:24:55.610503 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573c5960-46d6-4e22-9fbb-27094ed440e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:24:55.611991 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573c5960-46d6-4e22-9fbb-27094ed440e3 service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:24:55.624607 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1829/3659] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:24:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:24:55.676743 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628561cf-dc63-4acb-becd-ef7badf50312 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:24:55.677568 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-628561cf-dc63-4acb-becd-ef7badf50312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:24:55.869345 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628561cf-dc63-4acb-becd-ef7badf50312 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:24:55.880031 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f73ad9-5792-4ab8-8dfc-b1eed0d63ed2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:24:55.882698 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f73ad9-5792-4ab8-8dfc-b1eed0d63ed2 service nova] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:24:55.883113 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f73ad9-5792-4ab8-8dfc-b1eed0d63ed2 service nova] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:24:55.883558 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f73ad9-5792-4ab8-8dfc-b1eed0d63ed2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:24:55.886097 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-70f73ad9-5792-4ab8-8dfc-b1eed0d63ed2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:24:55.939645 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:24:56.009408 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f73ad9-5792-4ab8-8dfc-b1eed0d63ed2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:24:56.011159 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f73ad9-5792-4ab8-8dfc-b1eed0d63ed2 service nova] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:24:56.024684 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1831/3660] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:24:55 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:25:01.806163 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573c5960-46d6-4e22-9fbb-27094ed440e3 service neutron] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:25:01.808319 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-573c5960-46d6-4e22-9fbb-27094ed440e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:25:01.842228 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573c5960-46d6-4e22-9fbb-27094ed440e3 service neutron] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:25:01.854521 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e8f923-7a34-4446-b515-97e05b27d818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:25:01.855429 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e8f923-7a34-4446-b515-97e05b27d818 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:25:01.855706 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e8f923-7a34-4446-b515-97e05b27d818 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:25:01.855978 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e8f923-7a34-4446-b515-97e05b27d818 admin admin] PATH_INFO: `/v3/users/b8b96ecba600424682ee7d55a16b6675` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:25:01.857178 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e8f923-7a34-4446-b515-97e05b27d818 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8b96ecba600424682ee7d55a16b6675)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:25:01.859235 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e8f923-7a34-4446-b515-97e05b27d818 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:25:01.986319 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-b2e8f923-7a34-4446-b515-97e05b27d818 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8b96ecba600424682ee7d55a16b6675'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:25:01.994974 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-b2e8f923-7a34-4446-b515-97e05b27d818 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8b96ecba600424682ee7d55a16b6675'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:25:01.995699 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-b2e8f923-7a34-4446-b515-97e05b27d818 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8b96ecba600424682ee7d55a16b6675'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:25:02.008739 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-b2e8f923-7a34-4446-b515-97e05b27d818 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8b96ecba600424682ee7d55a16b6675'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:25:02.041780 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-b2e8f923-7a34-4446-b515-97e05b27d818 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8b96ecba600424682ee7d55a16b6675'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:25:02.044431 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:DELETE=11,keystone:SELECT=86,keystone:INSERT=3 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:25:02.053800 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1830/3661] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:25:01 2022] DELETE /identity/v3/users/b8b96ecba600424682ee7d55a16b6675 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:25:02.948237 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f73ad9-5792-4ab8-8dfc-b1eed0d63ed2 service nova] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:25:02.963038 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f73ad9-5792-4ab8-8dfc-b1eed0d63ed2 service nova] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:25:03.065512 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdd3892-a52f-4068-8ab9-c612f9724185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:25:03.066955 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdd3892-a52f-4068-8ab9-c612f9724185 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:25:03.067699 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdd3892-a52f-4068-8ab9-c612f9724185 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:25:03.069427 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdd3892-a52f-4068-8ab9-c612f9724185 admin admin] PATH_INFO: `/v3/projects/8d6e531d129741b780236ffba8a4c2f9` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:25:03.072429 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdd3892-a52f-4068-8ab9-c612f9724185 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d6e531d129741b780236ffba8a4c2f9)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:25:03.075843 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdd3892-a52f-4068-8ab9-c612f9724185 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:25:03.164074 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-ecdd3892-a52f-4068-8ab9-c612f9724185 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d6e531d129741b780236ffba8a4c2f9', 'request_id': 'req-ecdd3892-a52f-4068-8ab9-c612f9724185'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:25:03.199028 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-ecdd3892-a52f-4068-8ab9-c612f9724185 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d6e531d129741b780236ffba8a4c2f9', 'request_id': 'req-ecdd3892-a52f-4068-8ab9-c612f9724185'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:25:03.226545 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-ecdd3892-a52f-4068-8ab9-c612f9724185 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d6e531d129741b780236ffba8a4c2f9', 'request_id': 'req-ecdd3892-a52f-4068-8ab9-c612f9724185'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:25:03.269447 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-ecdd3892-a52f-4068-8ab9-c612f9724185 admin admin] The token cache is being invalidate because project 8d6e531d129741b780236ffba8a4c2f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:25:03.274859 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-ecdd3892-a52f-4068-8ab9-c612f9724185 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:25:03.275611 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-ecdd3892-a52f-4068-8ab9-c612f9724185 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:25:03.282547 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1832/3662] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:25:02 2022] DELETE /identity/v3/projects/8d6e531d129741b780236ffba8a4c2f9 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:25:03.287782 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526e0282-b941-401e-8d73-2800fab8c933 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:25:03.290299 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526e0282-b941-401e-8d73-2800fab8c933 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:25:03.290588 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526e0282-b941-401e-8d73-2800fab8c933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:25:03.326425 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-526e0282-b941-401e-8d73-2800fab8c933 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:25:03.327575 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-526e0282-b941-401e-8d73-2800fab8c933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:25:03.417844 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1831/3663] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:25:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:25:03.426554 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad45ac4c-7145-4c22-abed-9d3e9d3c11ca None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:25:03.426841 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad45ac4c-7145-4c22-abed-9d3e9d3c11ca None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:25:03.427122 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad45ac4c-7145-4c22-abed-9d3e9d3c11ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:25:03.466561 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-ad45ac4c-7145-4c22-abed-9d3e9d3c11ca None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:25:03.468327 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-ad45ac4c-7145-4c22-abed-9d3e9d3c11ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:25:03.495613 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1833/3664] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:25:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:25:03.499917 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526e0282-b941-401e-8d73-2800fab8c933 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:25:03.528563 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526e0282-b941-401e-8d73-2800fab8c933 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:25:03.542492 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c16b97-920a-4f8c-8789-498c4026f43b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:25:03.543183 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c16b97-920a-4f8c-8789-498c4026f43b admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:25:03.543466 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c16b97-920a-4f8c-8789-498c4026f43b admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:25:03.543752 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c16b97-920a-4f8c-8789-498c4026f43b admin admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:25:03.544479 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c16b97-920a-4f8c-8789-498c4026f43b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:25:03.544785 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c16b97-920a-4f8c-8789-498c4026f43b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:25:03.546451 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c16b97-920a-4f8c-8789-498c4026f43b admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:25:03.575606 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1832/3665] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:25:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:25:03.580712 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad45ac4c-7145-4c22-abed-9d3e9d3c11ca None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:25:03.591132 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad45ac4c-7145-4c22-abed-9d3e9d3c11ca None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:25:03.596033 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8466fd32-1fed-4628-ac78-f69d39033537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:25:03.596707 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8466fd32-1fed-4628-ac78-f69d39033537 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:25:03.596986 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8466fd32-1fed-4628-ac78-f69d39033537 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:25:03.597260 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8466fd32-1fed-4628-ac78-f69d39033537 admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:25:03.597980 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8466fd32-1fed-4628-ac78-f69d39033537 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:25:03.599885 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8466fd32-1fed-4628-ac78-f69d39033537 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:25:03.640902 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1834/3666] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:25:03 2022] POST /identity/v3/projects => generated 385 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:25:03.642337 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c16b97-920a-4f8c-8789-498c4026f43b admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:25:03.657443 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c16b97-920a-4f8c-8789-498c4026f43b admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:25:03.785235 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0f8625-f384-49d4-8fd7-2a20bf301969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:25:03.786061 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0f8625-f384-49d4-8fd7-2a20bf301969 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:25:03.786401 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0f8625-f384-49d4-8fd7-2a20bf301969 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:25:03.786686 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0f8625-f384-49d4-8fd7-2a20bf301969 admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:25:03.788596 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0f8625-f384-49d4-8fd7-2a20bf301969 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:25:03.792805 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0f8625-f384-49d4-8fd7-2a20bf301969 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:25:03.861899 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1833/3667] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:25:03 2022] POST /identity/v3/users => generated 293 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:25:03.866188 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8466fd32-1fed-4628-ac78-f69d39033537 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:25:03.881088 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8466fd32-1fed-4628-ac78-f69d39033537 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:25:03.889609 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35836488-1021-42d2-b743-608ae2795dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:25:03.890638 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35836488-1021-42d2-b743-608ae2795dc7 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:25:03.891091 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35836488-1021-42d2-b743-608ae2795dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:25:03.891558 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35836488-1021-42d2-b743-608ae2795dc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:25:03.894022 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35836488-1021-42d2-b743-608ae2795dc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:25:03.897119 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35836488-1021-42d2-b743-608ae2795dc7 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:25:03.911702 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1835/3668] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:25:03 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:25:03.915692 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0f8625-f384-49d4-8fd7-2a20bf301969 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:25:03.931452 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0f8625-f384-49d4-8fd7-2a20bf301969 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:25:03.942480 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3095bc21-eabd-4b80-bcd9-e84621f02b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:25:03.944317 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3095bc21-eabd-4b80-bcd9-e84621f02b53 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:25:03.944938 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3095bc21-eabd-4b80-bcd9-e84621f02b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:25:03.945558 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3095bc21-eabd-4b80-bcd9-e84621f02b53 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:25:03.946622 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3095bc21-eabd-4b80-bcd9-e84621f02b53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:25:03.950732 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3095bc21-eabd-4b80-bcd9-e84621f02b53 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:25:03.979464 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1834/3669] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:25:03 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:25:03.983566 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35836488-1021-42d2-b743-608ae2795dc7 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:25:03.998826 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35836488-1021-42d2-b743-608ae2795dc7 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:25:04.005313 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee2fd0c-bc88-406c-ba92-02515f501c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:25:04.008683 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee2fd0c-bc88-406c-ba92-02515f501c48 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:25:04.009164 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee2fd0c-bc88-406c-ba92-02515f501c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:25:04.009633 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee2fd0c-bc88-406c-ba92-02515f501c48 admin admin] PATH_INFO: `/v3/projects/b3efb8824be84323b6ec04b604775bd0/users/859c1493a30d4386b74377ab2b9bc81d/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:25:04.014802 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:25:04.041093 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee2fd0c-bc88-406c-ba92-02515f501c48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3efb8824be84323b6ec04b604775bd0, user_id=859c1493a30d4386b74377ab2b9bc81d, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:25:04.045966 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee2fd0c-bc88-406c-ba92-02515f501c48 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:25:04.069010 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1836/3670] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:25:03 2022] PUT /identity/v3/projects/b3efb8824be84323b6ec04b604775bd0/users/859c1493a30d4386b74377ab2b9bc81d/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:25:04.074264 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e95421-2414-41ba-b705-8d46c032f313 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:25:04.075008 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e95421-2414-41ba-b705-8d46c032f313 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:25:04.075685 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e95421-2414-41ba-b705-8d46c032f313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:25:04.109272 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-53e95421-2414-41ba-b705-8d46c032f313 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:25:04.122475 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-53e95421-2414-41ba-b705-8d46c032f313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:25:04.257086 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1835/3671] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:25:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:25:04.326816 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee2fd0c-bc88-406c-ba92-02515f501c48 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:25:04.328657 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-3ee2fd0c-bc88-406c-ba92-02515f501c48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:25:04.433292 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee2fd0c-bc88-406c-ba92-02515f501c48 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:25:04.449160 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4003e3d0-47fa-452c-afde-74e1ab7d2f85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:25:04.449925 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4003e3d0-47fa-452c-afde-74e1ab7d2f85 service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:25:04.450216 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4003e3d0-47fa-452c-afde-74e1ab7d2f85 service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:25:04.450595 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4003e3d0-47fa-452c-afde-74e1ab7d2f85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:25:04.510677 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4003e3d0-47fa-452c-afde-74e1ab7d2f85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:25:04.513902 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4003e3d0-47fa-452c-afde-74e1ab7d2f85 service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:25:04.549437 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1837/3672] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:25:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:25:07.002112 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e95421-2414-41ba-b705-8d46c032f313 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:25:07.004231 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-53e95421-2414-41ba-b705-8d46c032f313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:25:07.033096 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e95421-2414-41ba-b705-8d46c032f313 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:25:07.045719 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc812cb-5cd8-4643-ada5-be31da64847f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:25:07.046659 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc812cb-5cd8-4643-ada5-be31da64847f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:25:07.046937 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc812cb-5cd8-4643-ada5-be31da64847f admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:25:07.047212 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc812cb-5cd8-4643-ada5-be31da64847f admin admin] PATH_INFO: `/v3/users/e74c139b38d74d9ab93695471ccd3a2c` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:25:07.048599 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc812cb-5cd8-4643-ada5-be31da64847f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e74c139b38d74d9ab93695471ccd3a2c)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:25:07.050579 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc812cb-5cd8-4643-ada5-be31da64847f admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:25:07.053580 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:25:07.235742 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ad2b53-0549-4093-9ad1-6ba5211bdb16 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:25:07.236265 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ad2b53-0549-4093-9ad1-6ba5211bdb16 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:25:07.236382 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ad2b53-0549-4093-9ad1-6ba5211bdb16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:25:07.246367 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-bbc812cb-5cd8-4643-ada5-be31da64847f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e74c139b38d74d9ab93695471ccd3a2c'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:25:07.264501 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-bbc812cb-5cd8-4643-ada5-be31da64847f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e74c139b38d74d9ab93695471ccd3a2c'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:25:07.267405 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-bbc812cb-5cd8-4643-ada5-be31da64847f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e74c139b38d74d9ab93695471ccd3a2c'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:25:07.290373 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-bbc812cb-5cd8-4643-ada5-be31da64847f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e74c139b38d74d9ab93695471ccd3a2c'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:25:07.296273 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-55ad2b53-0549-4093-9ad1-6ba5211bdb16 None None] MFA Rules not processed for user `859c1493a30d4386b74377ab2b9bc81d`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:25:07.301434 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-55ad2b53-0549-4093-9ad1-6ba5211bdb16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:25:07.312553 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-bbc812cb-5cd8-4643-ada5-be31da64847f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e74c139b38d74d9ab93695471ccd3a2c'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:25:07.325152 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1836/3673] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:25:07 2022] DELETE /identity/v3/users/e74c139b38d74d9ab93695471ccd3a2c => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:25:07.476026 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249926e8-2c18-45b6-ab80-15d8b67efa65 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:25:07.476608 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249926e8-2c18-45b6-ab80-15d8b67efa65 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:25:07.477044 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249926e8-2c18-45b6-ab80-15d8b67efa65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:25:07.478602 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1838/3674] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:25:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:25:07.564279 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-249926e8-2c18-45b6-ab80-15d8b67efa65 None None] MFA Rules not processed for user `859c1493a30d4386b74377ab2b9bc81d`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:25:07.565563 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-249926e8-2c18-45b6-ab80-15d8b67efa65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:25:07.831463 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1837/3675] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:25:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 357 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:25:07.842417 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd3963e-7180-40b5-a929-aada437e8c88 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:25:07.842881 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd3963e-7180-40b5-a929-aada437e8c88 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:25:07.843047 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd3963e-7180-40b5-a929-aada437e8c88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:25:07.900053 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-1dd3963e-7180-40b5-a929-aada437e8c88 None None] MFA Rules not processed for user `859c1493a30d4386b74377ab2b9bc81d`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:25:07.901313 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-1dd3963e-7180-40b5-a929-aada437e8c88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:25:07.914081 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1839/3676] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:25:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:25:08.073641 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249926e8-2c18-45b6-ab80-15d8b67efa65 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:25:08.075215 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-249926e8-2c18-45b6-ab80-15d8b67efa65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:25:08.228225 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249926e8-2c18-45b6-ab80-15d8b67efa65 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:25:08.240300 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc90303e-db96-4019-9548-596188ff2b1e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:25:08.241111 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc90303e-db96-4019-9548-596188ff2b1e service nova] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:25:08.241485 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc90303e-db96-4019-9548-596188ff2b1e service nova] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:25:08.241848 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc90303e-db96-4019-9548-596188ff2b1e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:25:08.263054 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc90303e-db96-4019-9548-596188ff2b1e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:25:08.264734 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc90303e-db96-4019-9548-596188ff2b1e service nova] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:25:08.284997 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1838/3677] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:25:08 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:25:08.444992 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd3963e-7180-40b5-a929-aada437e8c88 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:25:08.451980 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-1dd3963e-7180-40b5-a929-aada437e8c88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:25:08.663283 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd3963e-7180-40b5-a929-aada437e8c88 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:25:08.674790 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78941cd3-2c89-4182-abe0-5090e18fdd8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:25:08.675951 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78941cd3-2c89-4182-abe0-5090e18fdd8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:25:08.676449 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78941cd3-2c89-4182-abe0-5090e18fdd8f admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:25:08.676946 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78941cd3-2c89-4182-abe0-5090e18fdd8f admin admin] PATH_INFO: `/v3/projects/d3ff73d603ec4069a908452514a59451` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:25:08.678564 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78941cd3-2c89-4182-abe0-5090e18fdd8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3ff73d603ec4069a908452514a59451)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:25:08.683715 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78941cd3-2c89-4182-abe0-5090e18fdd8f admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:25:08.715666 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:25:08.814481 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-78941cd3-2c89-4182-abe0-5090e18fdd8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3ff73d603ec4069a908452514a59451', 'request_id': 'req-78941cd3-2c89-4182-abe0-5090e18fdd8f'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:25:08.832071 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-78941cd3-2c89-4182-abe0-5090e18fdd8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3ff73d603ec4069a908452514a59451', 'request_id': 'req-78941cd3-2c89-4182-abe0-5090e18fdd8f'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:25:08.849792 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-78941cd3-2c89-4182-abe0-5090e18fdd8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3ff73d603ec4069a908452514a59451', 'request_id': 'req-78941cd3-2c89-4182-abe0-5090e18fdd8f'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:25:08.868518 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-78941cd3-2c89-4182-abe0-5090e18fdd8f admin admin] The token cache is being invalidate because project d3ff73d603ec4069a908452514a59451 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:25:08.868806 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-78941cd3-2c89-4182-abe0-5090e18fdd8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:25:08.869481 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-78941cd3-2c89-4182-abe0-5090e18fdd8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:25:08.874051 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1840/3678] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:25:08 2022] DELETE /identity/v3/projects/d3ff73d603ec4069a908452514a59451 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:25:08.877469 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845adab2-1159-4c28-8734-43351854731f None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:25:08.877799 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845adab2-1159-4c28-8734-43351854731f None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:25:08.878070 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845adab2-1159-4c28-8734-43351854731f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:25:08.950193 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-845adab2-1159-4c28-8734-43351854731f None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:25:08.951787 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-845adab2-1159-4c28-8734-43351854731f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:25:08.961271 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:25:08.989041 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07355c9d-933b-48e6-8f86-e4c9963ac665 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:25:08.989681 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07355c9d-933b-48e6-8f86-e4c9963ac665 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:25:08.991532 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07355c9d-933b-48e6-8f86-e4c9963ac665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:25:09.038338 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-07355c9d-933b-48e6-8f86-e4c9963ac665 None None] MFA Rules not processed for user `8a7b95c6fb6743cf9f1942a6328a1ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:25:09.040184 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-07355c9d-933b-48e6-8f86-e4c9963ac665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:25:09.088277 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1839/3679] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:25:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:25:09.096066 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f1c591-de7b-4bc8-9489-418f2dc91ddb None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:25:09.096436 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f1c591-de7b-4bc8-9489-418f2dc91ddb None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:25:09.096770 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f1c591-de7b-4bc8-9489-418f2dc91ddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:25:09.134679 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-b1f1c591-de7b-4bc8-9489-418f2dc91ddb None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:25:09.135935 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-b1f1c591-de7b-4bc8-9489-418f2dc91ddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:25:09.163787 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1840/3680] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:25:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:25:09.168264 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f1c591-de7b-4bc8-9489-418f2dc91ddb None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:25:09.186474 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f1c591-de7b-4bc8-9489-418f2dc91ddb None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:25:09.202066 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7e2742-2c02-4603-80b5-29c1c6f3902d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:25:09.202744 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7e2742-2c02-4603-80b5-29c1c6f3902d admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:25:09.203024 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7e2742-2c02-4603-80b5-29c1c6f3902d admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:25:09.203296 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7e2742-2c02-4603-80b5-29c1c6f3902d admin admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:25:09.204042 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7e2742-2c02-4603-80b5-29c1c6f3902d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:25:09.204350 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7e2742-2c02-4603-80b5-29c1c6f3902d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:25:09.206013 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7e2742-2c02-4603-80b5-29c1c6f3902d admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:25:09.233125 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1841/3681] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:25:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:25:09.237273 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7e2742-2c02-4603-80b5-29c1c6f3902d admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:25:09.242047 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1841/3682] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:25:08 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:25:09.246002 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e6ed70-a1c1-412e-9b1a-ceabf99d3e72 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:25:09.246232 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e6ed70-a1c1-412e-9b1a-ceabf99d3e72 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:25:09.246634 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e6ed70-a1c1-412e-9b1a-ceabf99d3e72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:25:09.258066 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7e2742-2c02-4603-80b5-29c1c6f3902d admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:25:09.272721 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62858e8-3453-49f5-a846-8ec72da9000e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:25:09.273853 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62858e8-3453-49f5-a846-8ec72da9000e admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:25:09.274353 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62858e8-3453-49f5-a846-8ec72da9000e admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:25:09.274865 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62858e8-3453-49f5-a846-8ec72da9000e admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:25:09.275730 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62858e8-3453-49f5-a846-8ec72da9000e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:25:09.279294 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-81e6ed70-a1c1-412e-9b1a-ceabf99d3e72 None None] MFA Rules not processed for user `8a7b95c6fb6743cf9f1942a6328a1ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:25:09.279743 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62858e8-3453-49f5-a846-8ec72da9000e admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:25:09.289713 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-81e6ed70-a1c1-412e-9b1a-ceabf99d3e72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:25:09.308239 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1842/3683] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:25:09 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:25:09.339562 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1842/3684] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:25:09 2022] POST /identity/v3/projects => generated 385 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:25:09.343887 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e6ed70-a1c1-412e-9b1a-ceabf99d3e72 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:25:09.357823 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e6ed70-a1c1-412e-9b1a-ceabf99d3e72 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:25:09.474282 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21dae90-af05-4ccc-bdd6-52492e72e026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:25:09.476220 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21dae90-af05-4ccc-bdd6-52492e72e026 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:25:09.479500 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21dae90-af05-4ccc-bdd6-52492e72e026 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:25:09.479500 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21dae90-af05-4ccc-bdd6-52492e72e026 admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:25:09.479500 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21dae90-af05-4ccc-bdd6-52492e72e026 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:25:09.488441 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21dae90-af05-4ccc-bdd6-52492e72e026 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:25:09.544453 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1843/3685] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:25:09 2022] POST /identity/v3/users => generated 293 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:25:09.546494 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62858e8-3453-49f5-a846-8ec72da9000e admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:25:09.558328 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21dae90-af05-4ccc-bdd6-52492e72e026 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:25:09.560910 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-d21dae90-af05-4ccc-bdd6-52492e72e026 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:25:09.577842 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62858e8-3453-49f5-a846-8ec72da9000e admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:25:09.583275 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:25:09.606021 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a73094c-3b3d-40c5-b5b4-acfe08412419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:25:09.606505 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a73094c-3b3d-40c5-b5b4-acfe08412419 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:25:09.606789 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a73094c-3b3d-40c5-b5b4-acfe08412419 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:25:09.607328 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a73094c-3b3d-40c5-b5b4-acfe08412419 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:25:09.608241 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a73094c-3b3d-40c5-b5b4-acfe08412419 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:25:09.610117 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a73094c-3b3d-40c5-b5b4-acfe08412419 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:25:09.634946 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1843/3686] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:25:09 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:25:09.643620 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a73094c-3b3d-40c5-b5b4-acfe08412419 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:25:09.678519 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a73094c-3b3d-40c5-b5b4-acfe08412419 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:25:09.685409 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f4aeaf-ca5e-45af-acf4-db88bbbfc30e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:25:09.690163 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f4aeaf-ca5e-45af-acf4-db88bbbfc30e admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:25:09.690705 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f4aeaf-ca5e-45af-acf4-db88bbbfc30e admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:25:09.691231 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f4aeaf-ca5e-45af-acf4-db88bbbfc30e admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:25:09.692691 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f4aeaf-ca5e-45af-acf4-db88bbbfc30e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:25:09.694627 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f4aeaf-ca5e-45af-acf4-db88bbbfc30e admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:25:09.707998 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1844/3687] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:25:09 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:25:09.711896 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21dae90-af05-4ccc-bdd6-52492e72e026 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:25:09.712352 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f4aeaf-ca5e-45af-acf4-db88bbbfc30e admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:25:09.724222 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b037a609-78aa-44e5-8aae-b75fc60aefd5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:25:09.724650 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f4aeaf-ca5e-45af-acf4-db88bbbfc30e admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:25:09.725095 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b037a609-78aa-44e5-8aae-b75fc60aefd5 service nova] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:25:09.725386 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b037a609-78aa-44e5-8aae-b75fc60aefd5 service nova] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:25:09.725768 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b037a609-78aa-44e5-8aae-b75fc60aefd5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:25:09.731163 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5848c25a-c767-4967-b401-640b2cb1be04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:25:09.732109 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5848c25a-c767-4967-b401-640b2cb1be04 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:25:09.732389 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5848c25a-c767-4967-b401-640b2cb1be04 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:25:09.732661 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5848c25a-c767-4967-b401-640b2cb1be04 admin admin] PATH_INFO: `/v3/projects/5afdbc378ad64fc58903ea2518717005/users/c8c3d58265714ebba65b1510bd768e19/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:25:09.754530 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5848c25a-c767-4967-b401-640b2cb1be04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5afdbc378ad64fc58903ea2518717005, user_id=c8c3d58265714ebba65b1510bd768e19, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:25:09.757327 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5848c25a-c767-4967-b401-640b2cb1be04 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:25:09.780665 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1845/3688] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:25:09 2022] PUT /identity/v3/projects/5afdbc378ad64fc58903ea2518717005/users/c8c3d58265714ebba65b1510bd768e19/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:25:09.782642 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830f736b-2224-4cd2-b1fb-a35f4ac16848 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:25:09.783033 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830f736b-2224-4cd2-b1fb-a35f4ac16848 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:25:09.783526 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830f736b-2224-4cd2-b1fb-a35f4ac16848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:25:09.805507 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-830f736b-2224-4cd2-b1fb-a35f4ac16848 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:25:09.807181 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-830f736b-2224-4cd2-b1fb-a35f4ac16848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:25:09.840587 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b037a609-78aa-44e5-8aae-b75fc60aefd5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:25:09.842523 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b037a609-78aa-44e5-8aae-b75fc60aefd5 service nova] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:25:09.875943 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1844/3689] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:25:09 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:25:09.921975 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1846/3690] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:25:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:25:09.932190 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b037a609-78aa-44e5-8aae-b75fc60aefd5 service nova] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:25:09.934821 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-b037a609-78aa-44e5-8aae-b75fc60aefd5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:25:10.067623 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03234adf-9080-4fb1-a832-60d4fb6655f0 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:25:10.068082 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03234adf-9080-4fb1-a832-60d4fb6655f0 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:25:10.069468 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03234adf-9080-4fb1-a832-60d4fb6655f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:25:10.140356 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b037a609-78aa-44e5-8aae-b75fc60aefd5 service nova] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:25:10.166174 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-03234adf-9080-4fb1-a832-60d4fb6655f0 None None] MFA Rules not processed for user `859c1493a30d4386b74377ab2b9bc81d`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:25:10.170942 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-03234adf-9080-4fb1-a832-60d4fb6655f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:25:10.211153 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:25:10.280466 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f462ee3-c236-4953-8688-d52833b3a8ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:25:10.281307 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f462ee3-c236-4953-8688-d52833b3a8ad service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:25:10.281918 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f462ee3-c236-4953-8688-d52833b3a8ad service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:25:10.282291 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f462ee3-c236-4953-8688-d52833b3a8ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:25:10.307659 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f462ee3-c236-4953-8688-d52833b3a8ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:25:10.309395 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f462ee3-c236-4953-8688-d52833b3a8ad service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:25:10.323437 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1845/3691] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:25:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:25:10.325051 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1847/3692] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:25:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:25:11.663385 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f537f80-f594-4643-8bd4-878969bcf6b9 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:25:11.663985 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f537f80-f594-4643-8bd4-878969bcf6b9 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:25:11.663985 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f537f80-f594-4643-8bd4-878969bcf6b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:25:11.707450 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-9f537f80-f594-4643-8bd4-878969bcf6b9 None None] MFA Rules not processed for user `859c1493a30d4386b74377ab2b9bc81d`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:25:11.716830 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-9f537f80-f594-4643-8bd4-878969bcf6b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:25:11.741580 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1846/3693] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:25:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:25:20.288076 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=15 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:25:21.684870 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=99 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:25:28.368915 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87283d85-5907-45b0-9170-2d8995a00ab7 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:25:28.369796 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87283d85-5907-45b0-9170-2d8995a00ab7 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:25:28.370561 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87283d85-5907-45b0-9170-2d8995a00ab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:25:28.392208 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-87283d85-5907-45b0-9170-2d8995a00ab7 None None] MFA Rules not processed for user `e961e46ab94f4fffbc606485935ce64d`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:25:28.393705 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-87283d85-5907-45b0-9170-2d8995a00ab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:25:28.500992 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1848/3694] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:25:28 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:25:28.518492 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3a11dd-92e7-458d-9b0f-e64822810f6d None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:25:28.518983 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3a11dd-92e7-458d-9b0f-e64822810f6d None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:25:28.518983 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3a11dd-92e7-458d-9b0f-e64822810f6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:25:28.539148 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-2c3a11dd-92e7-458d-9b0f-e64822810f6d None None] MFA Rules not processed for user `2a609c39c14343e1bc1edd4b3cd56dd4`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:25:28.540379 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-2c3a11dd-92e7-458d-9b0f-e64822810f6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:25:28.675456 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1847/3695] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:25:28 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:25:29.491565 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c42ad2c-0c06-447a-9962-04041478c75c None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:25:29.492149 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c42ad2c-0c06-447a-9962-04041478c75c None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:25:29.492149 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c42ad2c-0c06-447a-9962-04041478c75c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:25:29.533270 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-8c42ad2c-0c06-447a-9962-04041478c75c None None] MFA Rules not processed for user `c8c3d58265714ebba65b1510bd768e19`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:25:29.534922 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-8c42ad2c-0c06-447a-9962-04041478c75c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:25:29.617076 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1849/3696] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:25:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:25:29.628689 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd1aeb6-f6ff-4392-8f92-5ff40845a572 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:25:29.629924 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd1aeb6-f6ff-4392-8f92-5ff40845a572 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:25:29.630359 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd1aeb6-f6ff-4392-8f92-5ff40845a572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:25:29.669569 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-8cd1aeb6-f6ff-4392-8f92-5ff40845a572 None None] MFA Rules not processed for user `c8c3d58265714ebba65b1510bd768e19`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:25:29.671840 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-8cd1aeb6-f6ff-4392-8f92-5ff40845a572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:25:29.683701 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1848/3697] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:25:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:25:30.528343 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c42ad2c-0c06-447a-9962-04041478c75c None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:25:30.530702 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-8c42ad2c-0c06-447a-9962-04041478c75c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:25:30.645115 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c42ad2c-0c06-447a-9962-04041478c75c None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:25:30.656269 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f27a84-1d1a-428a-8a31-54b104bdaf93 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:25:30.657354 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f27a84-1d1a-428a-8a31-54b104bdaf93 service nova] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:25:30.657918 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f27a84-1d1a-428a-8a31-54b104bdaf93 service nova] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:25:30.659251 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f27a84-1d1a-428a-8a31-54b104bdaf93 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:25:30.673304 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f27a84-1d1a-428a-8a31-54b104bdaf93 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:25:30.675303 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f27a84-1d1a-428a-8a31-54b104bdaf93 service nova] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:25:30.691795 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1850/3698] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:25:30 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:25:31.123300 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd1aeb6-f6ff-4392-8f92-5ff40845a572 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:25:31.125617 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-8cd1aeb6-f6ff-4392-8f92-5ff40845a572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:25:31.142500 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd1aeb6-f6ff-4392-8f92-5ff40845a572 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:25:31.147406 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26f9d0e-0bec-423f-98f8-07aba0991772 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:25:31.148065 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26f9d0e-0bec-423f-98f8-07aba0991772 service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:25:31.148802 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26f9d0e-0bec-423f-98f8-07aba0991772 service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:25:31.149365 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26f9d0e-0bec-423f-98f8-07aba0991772 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:25:31.152717 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-c26f9d0e-0bec-423f-98f8-07aba0991772 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:25:31.167557 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26f9d0e-0bec-423f-98f8-07aba0991772 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:25:31.169374 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26f9d0e-0bec-423f-98f8-07aba0991772 service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:25:31.193779 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1849/3699] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:25:31 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:25:40.686074 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=91 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:25:41.175922 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=34 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:25:41.513803 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f27a84-1d1a-428a-8a31-54b104bdaf93 service nova] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:25:41.515454 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-96f27a84-1d1a-428a-8a31-54b104bdaf93 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:25:41.530030 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f27a84-1d1a-428a-8a31-54b104bdaf93 service nova] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:25:41.534900 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a577dca-afaf-4ee5-a32e-3d1834ce8bb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:25:41.535950 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a577dca-afaf-4ee5-a32e-3d1834ce8bb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:25:41.536366 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a577dca-afaf-4ee5-a32e-3d1834ce8bb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:25:41.536645 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a577dca-afaf-4ee5-a32e-3d1834ce8bb9 admin admin] PATH_INFO: `/v3/users/7cd8823a2d134f4ea1e31f92e65df040` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:25:41.538992 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a577dca-afaf-4ee5-a32e-3d1834ce8bb9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7cd8823a2d134f4ea1e31f92e65df040)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:25:41.541432 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a577dca-afaf-4ee5-a32e-3d1834ce8bb9 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:25:41.612290 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-8a577dca-afaf-4ee5-a32e-3d1834ce8bb9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7cd8823a2d134f4ea1e31f92e65df040'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:25:41.623347 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-8a577dca-afaf-4ee5-a32e-3d1834ce8bb9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7cd8823a2d134f4ea1e31f92e65df040'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:25:41.624449 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-8a577dca-afaf-4ee5-a32e-3d1834ce8bb9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7cd8823a2d134f4ea1e31f92e65df040'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:25:41.634729 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-8a577dca-afaf-4ee5-a32e-3d1834ce8bb9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7cd8823a2d134f4ea1e31f92e65df040'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:25:41.653885 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-8a577dca-afaf-4ee5-a32e-3d1834ce8bb9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7cd8823a2d134f4ea1e31f92e65df040'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:25:41.660188 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1851/3700] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:25:41 2022] DELETE /identity/v3/users/7cd8823a2d134f4ea1e31f92e65df040 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:25:41.921996 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26f9d0e-0bec-423f-98f8-07aba0991772 service neutron] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:25:41.936908 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26f9d0e-0bec-423f-98f8-07aba0991772 service neutron] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:25:42.012307 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf269150-5c40-4659-81c4-261b1d317fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:25:42.013196 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf269150-5c40-4659-81c4-261b1d317fef admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:25:42.013598 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf269150-5c40-4659-81c4-261b1d317fef admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:25:42.014124 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf269150-5c40-4659-81c4-261b1d317fef admin admin] PATH_INFO: `/v3/projects/a136ff692aeb4fdeae12dcacd09b3d6f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:25:42.015337 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf269150-5c40-4659-81c4-261b1d317fef admin admin] RBAC: Authorizing `identity:delete_project(project_id=a136ff692aeb4fdeae12dcacd09b3d6f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:25:42.017259 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf269150-5c40-4659-81c4-261b1d317fef admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:25:42.071438 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-cf269150-5c40-4659-81c4-261b1d317fef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a136ff692aeb4fdeae12dcacd09b3d6f', 'request_id': 'req-cf269150-5c40-4659-81c4-261b1d317fef'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:25:42.080576 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-cf269150-5c40-4659-81c4-261b1d317fef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a136ff692aeb4fdeae12dcacd09b3d6f', 'request_id': 'req-cf269150-5c40-4659-81c4-261b1d317fef'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:25:42.087385 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-cf269150-5c40-4659-81c4-261b1d317fef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a136ff692aeb4fdeae12dcacd09b3d6f', 'request_id': 'req-cf269150-5c40-4659-81c4-261b1d317fef'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:25:42.099785 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-cf269150-5c40-4659-81c4-261b1d317fef admin admin] The token cache is being invalidate because project a136ff692aeb4fdeae12dcacd09b3d6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:25:42.100049 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-cf269150-5c40-4659-81c4-261b1d317fef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:25:42.100732 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-cf269150-5c40-4659-81c4-261b1d317fef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:25:42.105838 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1850/3701] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:25:41 2022] DELETE /identity/v3/projects/a136ff692aeb4fdeae12dcacd09b3d6f => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:25:42.107603 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e139d83-f0fe-4890-92ed-c43545feae87 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:25:42.108088 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e139d83-f0fe-4890-92ed-c43545feae87 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:25:42.108202 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e139d83-f0fe-4890-92ed-c43545feae87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:25:42.127308 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-5e139d83-f0fe-4890-92ed-c43545feae87 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:25:42.128515 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-5e139d83-f0fe-4890-92ed-c43545feae87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:25:42.191768 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1852/3702] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:25:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:25:42.199719 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debd0772-43e7-4885-9c25-99665c311805 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:25:42.200331 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debd0772-43e7-4885-9c25-99665c311805 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:25:42.200331 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debd0772-43e7-4885-9c25-99665c311805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:25:42.219637 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-debd0772-43e7-4885-9c25-99665c311805 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:25:42.220749 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-debd0772-43e7-4885-9c25-99665c311805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:25:42.230548 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1851/3703] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:25:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:25:42.235033 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e139d83-f0fe-4890-92ed-c43545feae87 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:25:42.246198 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e139d83-f0fe-4890-92ed-c43545feae87 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:25:42.251710 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccdfdc2-872c-45f1-8d40-377d421cf5e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:25:42.252389 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccdfdc2-872c-45f1-8d40-377d421cf5e3 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:25:42.252845 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccdfdc2-872c-45f1-8d40-377d421cf5e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:25:42.253143 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccdfdc2-872c-45f1-8d40-377d421cf5e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:25:42.253899 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccdfdc2-872c-45f1-8d40-377d421cf5e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:25:42.254211 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccdfdc2-872c-45f1-8d40-377d421cf5e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:25:42.255835 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccdfdc2-872c-45f1-8d40-377d421cf5e3 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:25:42.271933 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1853/3704] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:25:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:25:42.273127 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debd0772-43e7-4885-9c25-99665c311805 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:25:42.284336 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debd0772-43e7-4885-9c25-99665c311805 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:25:42.289790 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdb0acf-60da-4160-b166-9e9d61bd3e37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:25:42.290498 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdb0acf-60da-4160-b166-9e9d61bd3e37 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:25:42.290776 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdb0acf-60da-4160-b166-9e9d61bd3e37 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:25:42.291045 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdb0acf-60da-4160-b166-9e9d61bd3e37 admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:25:42.291743 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdb0acf-60da-4160-b166-9e9d61bd3e37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:25:42.293647 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdb0acf-60da-4160-b166-9e9d61bd3e37 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:25:42.327205 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1852/3705] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:25:42 2022] POST /identity/v3/projects => generated 377 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:25:42.328812 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccdfdc2-872c-45f1-8d40-377d421cf5e3 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:25:42.339783 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccdfdc2-872c-45f1-8d40-377d421cf5e3 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:25:42.440579 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd679ec-8521-42dc-9050-49786d2b3f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:25:42.441637 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd679ec-8521-42dc-9050-49786d2b3f95 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:25:42.442176 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd679ec-8521-42dc-9050-49786d2b3f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:25:42.443104 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd679ec-8521-42dc-9050-49786d2b3f95 admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:25:42.444114 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd679ec-8521-42dc-9050-49786d2b3f95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:25:42.448129 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd679ec-8521-42dc-9050-49786d2b3f95 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:25:42.460724 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:25:42.507999 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdb0acf-60da-4160-b166-9e9d61bd3e37 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:25:42.517081 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1854/3706] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:25:42 2022] POST /identity/v3/users => generated 289 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:25:42.520003 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdb0acf-60da-4160-b166-9e9d61bd3e37 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:25:42.526390 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c262b22-afe5-4d60-bff5-26fed69819e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:25:42.528159 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c262b22-afe5-4d60-bff5-26fed69819e6 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:25:42.528679 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c262b22-afe5-4d60-bff5-26fed69819e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:25:42.529137 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c262b22-afe5-4d60-bff5-26fed69819e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:25:42.533358 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c262b22-afe5-4d60-bff5-26fed69819e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:25:42.558648 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c262b22-afe5-4d60-bff5-26fed69819e6 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:25:42.575206 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd679ec-8521-42dc-9050-49786d2b3f95 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:25:42.575912 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1853/3707] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:25:42 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:25:42.588170 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd679ec-8521-42dc-9050-49786d2b3f95 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:25:42.593952 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edccc8e-68a3-4be9-a094-0ad91a5d64b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:25:42.594852 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edccc8e-68a3-4be9-a094-0ad91a5d64b7 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:25:42.595425 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edccc8e-68a3-4be9-a094-0ad91a5d64b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:25:42.595830 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edccc8e-68a3-4be9-a094-0ad91a5d64b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:25:42.596953 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edccc8e-68a3-4be9-a094-0ad91a5d64b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:25:42.598965 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edccc8e-68a3-4be9-a094-0ad91a5d64b7 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:25:42.620329 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1855/3708] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:25:42 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 21:25:42.620755 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c262b22-afe5-4d60-bff5-26fed69819e6 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:25:42.634192 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c262b22-afe5-4d60-bff5-26fed69819e6 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:25:42.640200 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef203cfb-09b4-45fe-9190-69adf104f141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:25:42.641958 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef203cfb-09b4-45fe-9190-69adf104f141 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:25:42.642422 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef203cfb-09b4-45fe-9190-69adf104f141 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:25:42.642859 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef203cfb-09b4-45fe-9190-69adf104f141 admin admin] PATH_INFO: `/v3/projects/a892bfe56afd4ee5bb6c47e926af7349/users/affc3572ef7d45249f50b5061a681d18/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:25:42.662196 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef203cfb-09b4-45fe-9190-69adf104f141 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a892bfe56afd4ee5bb6c47e926af7349, user_id=affc3572ef7d45249f50b5061a681d18, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:25:42.665733 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef203cfb-09b4-45fe-9190-69adf104f141 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:25:42.688894 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1854/3709] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:25:42 2022] PUT /identity/v3/projects/a892bfe56afd4ee5bb6c47e926af7349/users/affc3572ef7d45249f50b5061a681d18/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:25:42.690466 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030b82fb-6ce6-4f23-8c3f-0cc8adffec5e None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:25:42.690768 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030b82fb-6ce6-4f23-8c3f-0cc8adffec5e None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:25:42.691069 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030b82fb-6ce6-4f23-8c3f-0cc8adffec5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:25:42.738080 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-030b82fb-6ce6-4f23-8c3f-0cc8adffec5e None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:25:42.739884 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-030b82fb-6ce6-4f23-8c3f-0cc8adffec5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:25:42.841202 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1856/3710] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:25:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:25:42.854744 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef203cfb-09b4-45fe-9190-69adf104f141 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:25:42.857639 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-ef203cfb-09b4-45fe-9190-69adf104f141 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:25:42.926327 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:25:42.964087 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef203cfb-09b4-45fe-9190-69adf104f141 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:25:42.969438 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d047a017-b53f-408e-ab44-3ac27fc1c0a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:25:42.970424 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d047a017-b53f-408e-ab44-3ac27fc1c0a5 service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:25:42.970922 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d047a017-b53f-408e-ab44-3ac27fc1c0a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:25:42.971402 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d047a017-b53f-408e-ab44-3ac27fc1c0a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:25:42.993985 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d047a017-b53f-408e-ab44-3ac27fc1c0a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:25:42.995545 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d047a017-b53f-408e-ab44-3ac27fc1c0a5 service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:25:43.019244 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1855/3711] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:25:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:25:49.595229 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0148446-f326-4363-8138-f50bc2f41103 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:25:49.596038 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0148446-f326-4363-8138-f50bc2f41103 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:25:49.596038 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0148446-f326-4363-8138-f50bc2f41103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:25:49.671764 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-d0148446-f326-4363-8138-f50bc2f41103 None None] MFA Rules not processed for user `affc3572ef7d45249f50b5061a681d18`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:25:49.673168 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-d0148446-f326-4363-8138-f50bc2f41103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:25:49.800238 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1857/3712] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:25:49 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:25:49.811981 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7587f139-3a7a-4b26-8241-3d9b14885f94 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:25:49.812591 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7587f139-3a7a-4b26-8241-3d9b14885f94 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:25:49.812591 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7587f139-3a7a-4b26-8241-3d9b14885f94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:25:49.840393 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-7587f139-3a7a-4b26-8241-3d9b14885f94 None None] MFA Rules not processed for user `affc3572ef7d45249f50b5061a681d18`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:25:49.841621 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-7587f139-3a7a-4b26-8241-3d9b14885f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:25:49.872755 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1856/3713] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:25:49 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:25:50.004780 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0148446-f326-4363-8138-f50bc2f41103 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:25:50.006275 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-d0148446-f326-4363-8138-f50bc2f41103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:25:50.107778 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0148446-f326-4363-8138-f50bc2f41103 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:25:50.115126 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3073f0-6373-4c5e-a51b-93558d811bd9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:25:50.116009 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3073f0-6373-4c5e-a51b-93558d811bd9 service nova] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:25:50.116679 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3073f0-6373-4c5e-a51b-93558d811bd9 service nova] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:25:50.117400 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3073f0-6373-4c5e-a51b-93558d811bd9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:25:50.125124 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:25:50.133960 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3073f0-6373-4c5e-a51b-93558d811bd9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:25:50.135610 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3073f0-6373-4c5e-a51b-93558d811bd9 service nova] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:25:50.147352 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1858/3714] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:25:50 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:25:58.256916 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7587f139-3a7a-4b26-8241-3d9b14885f94 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:25:58.259358 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-7587f139-3a7a-4b26-8241-3d9b14885f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:25:58.288061 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7587f139-3a7a-4b26-8241-3d9b14885f94 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:25:58.294120 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b428c266-aa22-49bb-ace2-4838657e369d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:25:58.298889 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b428c266-aa22-49bb-ace2-4838657e369d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:25:58.299242 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b428c266-aa22-49bb-ace2-4838657e369d admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:25:58.299593 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b428c266-aa22-49bb-ace2-4838657e369d admin admin] PATH_INFO: `/v3/users/8a7b95c6fb6743cf9f1942a6328a1ba7` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:25:58.300991 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b428c266-aa22-49bb-ace2-4838657e369d admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a7b95c6fb6743cf9f1942a6328a1ba7)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:25:58.303014 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b428c266-aa22-49bb-ace2-4838657e369d admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:25:58.375324 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-b428c266-aa22-49bb-ace2-4838657e369d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a7b95c6fb6743cf9f1942a6328a1ba7'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:25:58.375967 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-b428c266-aa22-49bb-ace2-4838657e369d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a7b95c6fb6743cf9f1942a6328a1ba7'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:25:58.382995 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-b428c266-aa22-49bb-ace2-4838657e369d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a7b95c6fb6743cf9f1942a6328a1ba7'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:25:58.392276 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-b428c266-aa22-49bb-ace2-4838657e369d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a7b95c6fb6743cf9f1942a6328a1ba7'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:25:58.404679 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-b428c266-aa22-49bb-ace2-4838657e369d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a7b95c6fb6743cf9f1942a6328a1ba7'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:25:58.410757 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1857/3715] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:25:58 2022] DELETE /identity/v3/users/8a7b95c6fb6743cf9f1942a6328a1ba7 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:25:58.592980 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3073f0-6373-4c5e-a51b-93558d811bd9 service nova] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:25:58.606928 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3073f0-6373-4c5e-a51b-93558d811bd9 service nova] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:25:58.679807 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8d8b9d-1584-4096-8f52-843c6903a23a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:25:58.681225 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8d8b9d-1584-4096-8f52-843c6903a23a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:25:58.681683 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8d8b9d-1584-4096-8f52-843c6903a23a admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:25:58.682140 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8d8b9d-1584-4096-8f52-843c6903a23a admin admin] PATH_INFO: `/v3/projects/892f8e8d61274d54bd996140a9ab38f9` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:25:58.683582 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8d8b9d-1584-4096-8f52-843c6903a23a admin admin] RBAC: Authorizing `identity:delete_project(project_id=892f8e8d61274d54bd996140a9ab38f9)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:25:58.685654 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8d8b9d-1584-4096-8f52-843c6903a23a admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:25:58.738126 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-7c8d8b9d-1584-4096-8f52-843c6903a23a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '892f8e8d61274d54bd996140a9ab38f9', 'request_id': 'req-7c8d8b9d-1584-4096-8f52-843c6903a23a'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:25:58.749616 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-7c8d8b9d-1584-4096-8f52-843c6903a23a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '892f8e8d61274d54bd996140a9ab38f9', 'request_id': 'req-7c8d8b9d-1584-4096-8f52-843c6903a23a'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:25:58.763477 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-7c8d8b9d-1584-4096-8f52-843c6903a23a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '892f8e8d61274d54bd996140a9ab38f9', 'request_id': 'req-7c8d8b9d-1584-4096-8f52-843c6903a23a'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:25:58.780138 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-7c8d8b9d-1584-4096-8f52-843c6903a23a admin admin] The token cache is being invalidate because project 892f8e8d61274d54bd996140a9ab38f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:25:58.780728 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-7c8d8b9d-1584-4096-8f52-843c6903a23a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:25:58.781540 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-7c8d8b9d-1584-4096-8f52-843c6903a23a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:25:58.784059 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1859/3716] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:25:58 2022] DELETE /identity/v3/projects/892f8e8d61274d54bd996140a9ab38f9 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:25:58.790402 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4c6d3f-c0d5-409e-8694-e054a0fe9fbf None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:25:58.791250 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4c6d3f-c0d5-409e-8694-e054a0fe9fbf None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:25:58.791682 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4c6d3f-c0d5-409e-8694-e054a0fe9fbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:25:58.820843 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-0f4c6d3f-c0d5-409e-8694-e054a0fe9fbf None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:25:58.822341 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-0f4c6d3f-c0d5-409e-8694-e054a0fe9fbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:25:58.907976 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1858/3717] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:25:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:25:58.915456 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b82b5f-578c-4b0e-b77e-1f38c62bcfc7 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:25:58.915743 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b82b5f-578c-4b0e-b77e-1f38c62bcfc7 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:25:58.916019 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b82b5f-578c-4b0e-b77e-1f38c62bcfc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:25:58.938172 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-72b82b5f-578c-4b0e-b77e-1f38c62bcfc7 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:25:58.939434 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-72b82b5f-578c-4b0e-b77e-1f38c62bcfc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:25:58.949637 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1860/3718] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:25:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:25:58.954248 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4c6d3f-c0d5-409e-8694-e054a0fe9fbf None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:25:58.964350 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4c6d3f-c0d5-409e-8694-e054a0fe9fbf None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:25:58.969535 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27935a6c-0471-4fb4-9c39-95cbcc04ca5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:25:58.970243 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27935a6c-0471-4fb4-9c39-95cbcc04ca5c admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:25:58.970698 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27935a6c-0471-4fb4-9c39-95cbcc04ca5c admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:25:58.971157 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27935a6c-0471-4fb4-9c39-95cbcc04ca5c admin admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:25:58.972049 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27935a6c-0471-4fb4-9c39-95cbcc04ca5c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:25:58.972349 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27935a6c-0471-4fb4-9c39-95cbcc04ca5c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:25:58.973972 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27935a6c-0471-4fb4-9c39-95cbcc04ca5c admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:25:58.988633 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1859/3719] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:25:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:25:58.992848 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b82b5f-578c-4b0e-b77e-1f38c62bcfc7 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:25:59.003275 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b82b5f-578c-4b0e-b77e-1f38c62bcfc7 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:25:59.009441 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91330250-5e66-46fd-9109-a548bf52d1bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:25:59.010293 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91330250-5e66-46fd-9109-a548bf52d1bc admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:25:59.010573 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91330250-5e66-46fd-9109-a548bf52d1bc admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:25:59.010846 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91330250-5e66-46fd-9109-a548bf52d1bc admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:25:59.011550 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91330250-5e66-46fd-9109-a548bf52d1bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:25:59.013668 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91330250-5e66-46fd-9109-a548bf52d1bc admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:25:59.065108 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1861/3720] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:25:58 2022] POST /identity/v3/projects => generated 379 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:25:59.069479 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27935a6c-0471-4fb4-9c39-95cbcc04ca5c admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:25:59.088264 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27935a6c-0471-4fb4-9c39-95cbcc04ca5c admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:25:59.113221 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:25:59.164240 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb7195b-e75e-4ade-9622-d1ec3f83eefa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:25:59.164961 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb7195b-e75e-4ade-9622-d1ec3f83eefa admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:25:59.165237 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb7195b-e75e-4ade-9622-d1ec3f83eefa admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:25:59.165507 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb7195b-e75e-4ade-9622-d1ec3f83eefa admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:25:59.166379 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb7195b-e75e-4ade-9622-d1ec3f83eefa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:25:59.168300 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb7195b-e75e-4ade-9622-d1ec3f83eefa admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:25:59.194360 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1860/3721] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:25:59 2022] POST /identity/v3/users => generated 290 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:25:59.198015 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91330250-5e66-46fd-9109-a548bf52d1bc admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:25:59.209201 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91330250-5e66-46fd-9109-a548bf52d1bc admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:25:59.214392 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59c72ca-5d37-414b-93fc-61b7ab599f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:25:59.215168 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59c72ca-5d37-414b-93fc-61b7ab599f7a admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:25:59.215459 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59c72ca-5d37-414b-93fc-61b7ab599f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:25:59.215815 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59c72ca-5d37-414b-93fc-61b7ab599f7a admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:25:59.216545 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59c72ca-5d37-414b-93fc-61b7ab599f7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:25:59.218216 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59c72ca-5d37-414b-93fc-61b7ab599f7a admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:25:59.230050 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1862/3722] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:25:59 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:25:59.234237 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb7195b-e75e-4ade-9622-d1ec3f83eefa admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:25:59.246783 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb7195b-e75e-4ade-9622-d1ec3f83eefa admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:25:59.251468 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c410b4-bb1d-4864-8f20-2e2913975b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:25:59.252249 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c410b4-bb1d-4864-8f20-2e2913975b41 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:25:59.252414 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c410b4-bb1d-4864-8f20-2e2913975b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:25:59.252731 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c410b4-bb1d-4864-8f20-2e2913975b41 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:25:59.253456 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c410b4-bb1d-4864-8f20-2e2913975b41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:25:59.255071 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c410b4-bb1d-4864-8f20-2e2913975b41 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:25:59.269580 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1861/3723] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:25:59 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 21:25:59.273736 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59c72ca-5d37-414b-93fc-61b7ab599f7a admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:25:59.287896 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59c72ca-5d37-414b-93fc-61b7ab599f7a admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:25:59.293212 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556173e8-01b3-45be-9567-d7157666f1da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:25:59.294233 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556173e8-01b3-45be-9567-d7157666f1da admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:25:59.294595 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556173e8-01b3-45be-9567-d7157666f1da admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:25:59.294931 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556173e8-01b3-45be-9567-d7157666f1da admin admin] PATH_INFO: `/v3/projects/4d8d306759c447edb6d013cf14ac53f9/users/0543f1a561a9442cbc9463ab752bd2aa/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:25:59.312820 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556173e8-01b3-45be-9567-d7157666f1da admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d8d306759c447edb6d013cf14ac53f9, user_id=0543f1a561a9442cbc9463ab752bd2aa, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:25:59.317250 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556173e8-01b3-45be-9567-d7157666f1da admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:25:59.334292 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1863/3724] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:25:59 2022] PUT /identity/v3/projects/4d8d306759c447edb6d013cf14ac53f9/users/0543f1a561a9442cbc9463ab752bd2aa/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:25:59.340327 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2daa74-0735-4215-a1c8-5255ef3ece81 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:25:59.340691 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2daa74-0735-4215-a1c8-5255ef3ece81 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:25:59.341034 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2daa74-0735-4215-a1c8-5255ef3ece81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:25:59.361896 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-3e2daa74-0735-4215-a1c8-5255ef3ece81 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:25:59.363197 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-3e2daa74-0735-4215-a1c8-5255ef3ece81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:25:59.438405 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1862/3725] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:25:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:25:59.456416 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556173e8-01b3-45be-9567-d7157666f1da admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:25:59.460099 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-556173e8-01b3-45be-9567-d7157666f1da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:25:59.482753 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:25:59.527245 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556173e8-01b3-45be-9567-d7157666f1da admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:25:59.530906 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b9c9fd-2e17-4fc7-a8ed-0fd996a14bbf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:25:59.531564 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b9c9fd-2e17-4fc7-a8ed-0fd996a14bbf service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:25:59.531840 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b9c9fd-2e17-4fc7-a8ed-0fd996a14bbf service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:25:59.532252 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b9c9fd-2e17-4fc7-a8ed-0fd996a14bbf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:25:59.545304 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b9c9fd-2e17-4fc7-a8ed-0fd996a14bbf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:25:59.546955 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b9c9fd-2e17-4fc7-a8ed-0fd996a14bbf service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:25:59.558998 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1864/3726] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:25:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:26:03.212117 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0bc3ee-e597-428a-bbc6-f13a4dd238bd None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:26:03.212576 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0bc3ee-e597-428a-bbc6-f13a4dd238bd None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:26:03.212576 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0bc3ee-e597-428a-bbc6-f13a4dd238bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:26:03.231689 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-eb0bc3ee-e597-428a-bbc6-f13a4dd238bd None None] MFA Rules not processed for user `e961e46ab94f4fffbc606485935ce64d`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:26:03.232946 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-eb0bc3ee-e597-428a-bbc6-f13a4dd238bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:26:03.314811 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1863/3727] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:26:03 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:26:08.377068 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e7f038-50f5-4240-8047-1bc522bd1998 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:26:08.377578 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e7f038-50f5-4240-8047-1bc522bd1998 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:26:08.377663 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e7f038-50f5-4240-8047-1bc522bd1998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:26:08.412998 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-91e7f038-50f5-4240-8047-1bc522bd1998 None None] MFA Rules not processed for user `0543f1a561a9442cbc9463ab752bd2aa`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:26:08.414387 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-91e7f038-50f5-4240-8047-1bc522bd1998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:26:08.519207 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1865/3728] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:26:08 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:26:08.520335 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b51f0cc-0d6c-4c4a-a3a0-f49cf7b259aa None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:26:08.520838 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b51f0cc-0d6c-4c4a-a3a0-f49cf7b259aa None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:26:08.520937 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b51f0cc-0d6c-4c4a-a3a0-f49cf7b259aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:26:08.551982 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-9b51f0cc-0d6c-4c4a-a3a0-f49cf7b259aa None None] MFA Rules not processed for user `0543f1a561a9442cbc9463ab752bd2aa`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:26:08.553255 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-9b51f0cc-0d6c-4c4a-a3a0-f49cf7b259aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:26:08.572036 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1864/3729] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:26:08 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:26:08.584818 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e7f038-50f5-4240-8047-1bc522bd1998 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:26:08.586740 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-91e7f038-50f5-4240-8047-1bc522bd1998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:26:08.739164 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e7f038-50f5-4240-8047-1bc522bd1998 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:26:08.757018 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90a6023-6d98-4d3c-b92e-286443e3e15d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:26:08.757848 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90a6023-6d98-4d3c-b92e-286443e3e15d service nova] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:26:08.758776 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90a6023-6d98-4d3c-b92e-286443e3e15d service nova] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:26:08.759209 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90a6023-6d98-4d3c-b92e-286443e3e15d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:26:08.784831 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90a6023-6d98-4d3c-b92e-286443e3e15d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:26:08.786566 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90a6023-6d98-4d3c-b92e-286443e3e15d service nova] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:26:08.799360 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1866/3730] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:26:08 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:26:10.124402 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99d6e60-05c7-47e3-8652-07b81054e79b None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:26:10.124858 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99d6e60-05c7-47e3-8652-07b81054e79b None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:26:10.125202 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99d6e60-05c7-47e3-8652-07b81054e79b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:26:10.159437 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-f99d6e60-05c7-47e3-8652-07b81054e79b None None] MFA Rules not processed for user `affc3572ef7d45249f50b5061a681d18`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:26:10.161678 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-f99d6e60-05c7-47e3-8652-07b81054e79b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:26:10.232313 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:26:10.286373 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1865/3731] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:26:10 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:26:12.037330 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90a6023-6d98-4d3c-b92e-286443e3e15d service nova] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:26:12.039572 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-a90a6023-6d98-4d3c-b92e-286443e3e15d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:26:12.131998 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:26:12.207274 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90a6023-6d98-4d3c-b92e-286443e3e15d service nova] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:26:12.218043 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5db9f88-eda9-4caa-93e4-07663e433491 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc719a3b3ac4461b82ca04ab6451d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:26:12.220793 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5db9f88-eda9-4caa-93e4-07663e433491 service placement] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:26:12.221286 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5db9f88-eda9-4caa-93e4-07663e433491 service placement] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:26:12.222482 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5db9f88-eda9-4caa-93e4-07663e433491 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:26:12.231632 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-a5db9f88-eda9-4caa-93e4-07663e433491 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:26:12.247949 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5db9f88-eda9-4caa-93e4-07663e433491 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:26:12.249744 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5db9f88-eda9-4caa-93e4-07663e433491 service placement] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:26:12.268010 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1867/3732] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:26:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:26:19.162695 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99d6e60-05c7-47e3-8652-07b81054e79b None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:26:19.165620 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-f99d6e60-05c7-47e3-8652-07b81054e79b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:26:19.188009 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99d6e60-05c7-47e3-8652-07b81054e79b None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:26:19.193838 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16111285-2f8d-434c-af83-3d4944db8b88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:26:19.194927 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16111285-2f8d-434c-af83-3d4944db8b88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:26:19.195594 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16111285-2f8d-434c-af83-3d4944db8b88 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:26:19.195887 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16111285-2f8d-434c-af83-3d4944db8b88 admin admin] PATH_INFO: `/v3/users/859c1493a30d4386b74377ab2b9bc81d` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:26:19.198551 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16111285-2f8d-434c-af83-3d4944db8b88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=859c1493a30d4386b74377ab2b9bc81d)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:26:19.200845 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16111285-2f8d-434c-af83-3d4944db8b88 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:26:19.275253 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-16111285-2f8d-434c-af83-3d4944db8b88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '859c1493a30d4386b74377ab2b9bc81d'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:26:19.275972 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-16111285-2f8d-434c-af83-3d4944db8b88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '859c1493a30d4386b74377ab2b9bc81d'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:26:19.297172 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-16111285-2f8d-434c-af83-3d4944db8b88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '859c1493a30d4386b74377ab2b9bc81d'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:26:19.307179 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-16111285-2f8d-434c-af83-3d4944db8b88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '859c1493a30d4386b74377ab2b9bc81d'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:26:19.324717 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-16111285-2f8d-434c-af83-3d4944db8b88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '859c1493a30d4386b74377ab2b9bc81d'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:26:19.333519 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1866/3733] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:26:19 2022] DELETE /identity/v3/users/859c1493a30d4386b74377ab2b9bc81d => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:26:19.577447 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5db9f88-eda9-4caa-93e4-07663e433491 service placement] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:26:19.595039 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5db9f88-eda9-4caa-93e4-07663e433491 service placement] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:26:19.719270 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faad7cf8-29c3-461e-a21c-1d995f8682c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:26:19.720499 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faad7cf8-29c3-461e-a21c-1d995f8682c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:26:19.720902 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faad7cf8-29c3-461e-a21c-1d995f8682c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:26:19.721286 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faad7cf8-29c3-461e-a21c-1d995f8682c9 admin admin] PATH_INFO: `/v3/projects/b3efb8824be84323b6ec04b604775bd0` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:26:19.722652 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faad7cf8-29c3-461e-a21c-1d995f8682c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3efb8824be84323b6ec04b604775bd0)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:26:19.725050 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faad7cf8-29c3-461e-a21c-1d995f8682c9 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:26:19.835925 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-faad7cf8-29c3-461e-a21c-1d995f8682c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3efb8824be84323b6ec04b604775bd0', 'request_id': 'req-faad7cf8-29c3-461e-a21c-1d995f8682c9'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:26:19.849719 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-faad7cf8-29c3-461e-a21c-1d995f8682c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3efb8824be84323b6ec04b604775bd0', 'request_id': 'req-faad7cf8-29c3-461e-a21c-1d995f8682c9'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:26:19.856911 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-faad7cf8-29c3-461e-a21c-1d995f8682c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3efb8824be84323b6ec04b604775bd0', 'request_id': 'req-faad7cf8-29c3-461e-a21c-1d995f8682c9'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:26:19.893195 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-faad7cf8-29c3-461e-a21c-1d995f8682c9 admin admin] The token cache is being invalidate because project b3efb8824be84323b6ec04b604775bd0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:26:19.893574 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-faad7cf8-29c3-461e-a21c-1d995f8682c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:26:19.896373 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-faad7cf8-29c3-461e-a21c-1d995f8682c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:26:19.906767 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1868/3734] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:26:19 2022] DELETE /identity/v3/projects/b3efb8824be84323b6ec04b604775bd0 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:26:19.907939 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd438d37-11c2-4925-9e3d-735bf61e5eae None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:26:19.908232 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd438d37-11c2-4925-9e3d-735bf61e5eae None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:26:19.908537 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd438d37-11c2-4925-9e3d-735bf61e5eae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:26:19.943452 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-cd438d37-11c2-4925-9e3d-735bf61e5eae None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:26:19.945178 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-cd438d37-11c2-4925-9e3d-735bf61e5eae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:26:20.029198 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1867/3735] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:26:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:26:20.037812 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec11b30-6d47-4541-9fdc-6bd847d15f7a None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:26:20.038085 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec11b30-6d47-4541-9fdc-6bd847d15f7a None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:26:20.038739 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec11b30-6d47-4541-9fdc-6bd847d15f7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:26:20.061177 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-3ec11b30-6d47-4541-9fdc-6bd847d15f7a None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:26:20.062461 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-3ec11b30-6d47-4541-9fdc-6bd847d15f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:26:20.071854 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1869/3736] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:26:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:26:20.078029 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd438d37-11c2-4925-9e3d-735bf61e5eae None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:26:20.103232 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd438d37-11c2-4925-9e3d-735bf61e5eae None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:26:20.110955 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a00872-3c1b-40c2-b0d6-9b6254eb3e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:26:20.112017 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a00872-3c1b-40c2-b0d6-9b6254eb3e6d admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:26:20.112918 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a00872-3c1b-40c2-b0d6-9b6254eb3e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:26:20.113355 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a00872-3c1b-40c2-b0d6-9b6254eb3e6d admin admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:26:20.114503 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a00872-3c1b-40c2-b0d6-9b6254eb3e6d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:26:20.114906 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a00872-3c1b-40c2-b0d6-9b6254eb3e6d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:26:20.119633 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a00872-3c1b-40c2-b0d6-9b6254eb3e6d admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:26:20.145900 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1868/3737] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:26:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:26:20.146967 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec11b30-6d47-4541-9fdc-6bd847d15f7a None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:26:20.163754 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec11b30-6d47-4541-9fdc-6bd847d15f7a None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:26:20.171945 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4444052-d4b9-49e0-91c7-c6d49f73795e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:26:20.172925 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4444052-d4b9-49e0-91c7-c6d49f73795e admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:26:20.173354 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4444052-d4b9-49e0-91c7-c6d49f73795e admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:26:20.173826 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4444052-d4b9-49e0-91c7-c6d49f73795e admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:26:20.175209 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4444052-d4b9-49e0-91c7-c6d49f73795e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:26:20.177307 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4444052-d4b9-49e0-91c7-c6d49f73795e admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:26:20.217071 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1870/3738] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:26:20 2022] POST /identity/v3/projects => generated 395 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:26:20.223481 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a00872-3c1b-40c2-b0d6-9b6254eb3e6d admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:26:20.246431 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a00872-3c1b-40c2-b0d6-9b6254eb3e6d admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:26:20.336903 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:26:20.375177 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a0ddc3-92e0-4071-86f8-2f7b5e597618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:26:20.375879 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a0ddc3-92e0-4071-86f8-2f7b5e597618 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:26:20.376157 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a0ddc3-92e0-4071-86f8-2f7b5e597618 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:26:20.376433 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a0ddc3-92e0-4071-86f8-2f7b5e597618 admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:26:20.377132 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a0ddc3-92e0-4071-86f8-2f7b5e597618 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:26:20.390668 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a0ddc3-92e0-4071-86f8-2f7b5e597618 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:26:20.425946 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1869/3739] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:26:20 2022] POST /identity/v3/users => generated 298 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:26:20.430502 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4444052-d4b9-49e0-91c7-c6d49f73795e admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:26:20.445346 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4444052-d4b9-49e0-91c7-c6d49f73795e admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:26:20.454143 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0159d2e-aa25-4d68-9573-953db6543ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:26:20.455039 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0159d2e-aa25-4d68-9573-953db6543ad6 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:26:20.455416 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0159d2e-aa25-4d68-9573-953db6543ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:26:20.455781 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0159d2e-aa25-4d68-9573-953db6543ad6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:26:20.456620 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0159d2e-aa25-4d68-9573-953db6543ad6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:26:20.477430 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0159d2e-aa25-4d68-9573-953db6543ad6 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:26:20.496686 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1871/3740] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:26:20 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:26:20.501312 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a0ddc3-92e0-4071-86f8-2f7b5e597618 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:26:20.520927 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a0ddc3-92e0-4071-86f8-2f7b5e597618 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:26:20.531574 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38772312-4fcf-4961-a7ee-4485db1d6c2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:26:20.532462 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38772312-4fcf-4961-a7ee-4485db1d6c2f admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:26:20.532598 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38772312-4fcf-4961-a7ee-4485db1d6c2f admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:26:20.532828 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38772312-4fcf-4961-a7ee-4485db1d6c2f admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:26:20.533554 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38772312-4fcf-4961-a7ee-4485db1d6c2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:26:20.535236 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38772312-4fcf-4961-a7ee-4485db1d6c2f admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:26:20.550696 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1870/3741] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:26:20 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:26:20.551927 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0159d2e-aa25-4d68-9573-953db6543ad6 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:26:20.567817 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0159d2e-aa25-4d68-9573-953db6543ad6 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:26:20.577552 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466d4cbb-b60e-4795-a941-0a461c1ae3a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:26:20.578496 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466d4cbb-b60e-4795-a941-0a461c1ae3a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:26:20.578778 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466d4cbb-b60e-4795-a941-0a461c1ae3a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:26:20.579053 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466d4cbb-b60e-4795-a941-0a461c1ae3a5 admin admin] PATH_INFO: `/v3/projects/766b3be6b5fb4734bd9aeccbd35e3824/users/38c74aa110064b4f85fef220e2d47b4f/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:26:20.597948 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466d4cbb-b60e-4795-a941-0a461c1ae3a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=766b3be6b5fb4734bd9aeccbd35e3824, user_id=38c74aa110064b4f85fef220e2d47b4f, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:26:20.601031 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466d4cbb-b60e-4795-a941-0a461c1ae3a5 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:26:20.604395 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:26:20.619267 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1872/3742] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:26:20 2022] PUT /identity/v3/projects/766b3be6b5fb4734bd9aeccbd35e3824/users/38c74aa110064b4f85fef220e2d47b4f/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:26:20.624913 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084f4245-1a2b-4740-b15a-ff9ccf95c70e None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:26:20.625339 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084f4245-1a2b-4740-b15a-ff9ccf95c70e None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:26:20.625684 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084f4245-1a2b-4740-b15a-ff9ccf95c70e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:26:20.644559 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-084f4245-1a2b-4740-b15a-ff9ccf95c70e None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:26:20.645880 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-084f4245-1a2b-4740-b15a-ff9ccf95c70e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:26:20.741531 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1871/3743] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:26:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:26:20.759776 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466d4cbb-b60e-4795-a941-0a461c1ae3a5 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:26:20.763736 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-466d4cbb-b60e-4795-a941-0a461c1ae3a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:26:20.859334 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466d4cbb-b60e-4795-a941-0a461c1ae3a5 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:26:20.859334 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efc9b28-cc23-4278-9e62-7d36b0ebde1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:26:20.859334 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efc9b28-cc23-4278-9e62-7d36b0ebde1e service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:26:20.859834 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efc9b28-cc23-4278-9e62-7d36b0ebde1e service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:26:20.860028 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efc9b28-cc23-4278-9e62-7d36b0ebde1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:26:20.874475 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efc9b28-cc23-4278-9e62-7d36b0ebde1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:26:20.891626 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efc9b28-cc23-4278-9e62-7d36b0ebde1e service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:26:20.904795 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1873/3744] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:26:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:26:25.503614 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084f4245-1a2b-4740-b15a-ff9ccf95c70e None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:26:25.506111 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-084f4245-1a2b-4740-b15a-ff9ccf95c70e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:26:25.648250 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084f4245-1a2b-4740-b15a-ff9ccf95c70e None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:26:25.663930 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd31182-2c27-4dec-af4d-ee6ac31c4cf3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc719a3b3ac4461b82ca04ab6451d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:26:25.664983 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd31182-2c27-4dec-af4d-ee6ac31c4cf3 service placement] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:26:25.666602 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd31182-2c27-4dec-af4d-ee6ac31c4cf3 service placement] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:26:25.666891 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd31182-2c27-4dec-af4d-ee6ac31c4cf3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:26:25.677754 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-ebd31182-2c27-4dec-af4d-ee6ac31c4cf3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:26:25.712881 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd31182-2c27-4dec-af4d-ee6ac31c4cf3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:26:25.715125 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd31182-2c27-4dec-af4d-ee6ac31c4cf3 service placement] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:26:25.742519 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1872/3745] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:26:25 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:26:27.448351 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3697853d-e11d-4d93-8869-fd6e81fee62e None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:26:27.448843 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3697853d-e11d-4d93-8869-fd6e81fee62e None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:26:27.448945 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3697853d-e11d-4d93-8869-fd6e81fee62e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:26:27.494333 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-3697853d-e11d-4d93-8869-fd6e81fee62e None None] MFA Rules not processed for user `38c74aa110064b4f85fef220e2d47b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:26:27.495854 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-3697853d-e11d-4d93-8869-fd6e81fee62e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:26:27.619290 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1874/3746] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:26:27 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:26:27.631739 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290563c9-abac-48fd-b25c-f4a94d5ec5b0 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:26:27.633559 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290563c9-abac-48fd-b25c-f4a94d5ec5b0 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:26:27.634259 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290563c9-abac-48fd-b25c-f4a94d5ec5b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:26:27.660385 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-290563c9-abac-48fd-b25c-f4a94d5ec5b0 None None] MFA Rules not processed for user `38c74aa110064b4f85fef220e2d47b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:26:27.661316 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-290563c9-abac-48fd-b25c-f4a94d5ec5b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:26:27.674572 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1873/3747] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:26:27 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:26:27.686320 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3697853d-e11d-4d93-8869-fd6e81fee62e None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:26:27.688906 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-3697853d-e11d-4d93-8869-fd6e81fee62e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:26:27.802296 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3697853d-e11d-4d93-8869-fd6e81fee62e None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:26:27.814929 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92849fb-f359-4f49-b6a6-d926bb6ed614 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:26:27.815734 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92849fb-f359-4f49-b6a6-d926bb6ed614 service nova] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:26:27.816131 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92849fb-f359-4f49-b6a6-d926bb6ed614 service nova] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:26:27.816477 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92849fb-f359-4f49-b6a6-d926bb6ed614 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:26:27.827307 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92849fb-f359-4f49-b6a6-d926bb6ed614 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:26:27.829118 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92849fb-f359-4f49-b6a6-d926bb6ed614 service nova] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:26:27.840553 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1875/3748] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:26:27 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:26:30.375450 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0237ed2a-80f0-4b7c-bcd5-66d095c10b83 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:26:30.375940 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0237ed2a-80f0-4b7c-bcd5-66d095c10b83 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:26:30.376680 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0237ed2a-80f0-4b7c-bcd5-66d095c10b83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:26:30.413422 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-0237ed2a-80f0-4b7c-bcd5-66d095c10b83 None None] MFA Rules not processed for user `0543f1a561a9442cbc9463ab752bd2aa`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:26:30.416839 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-0237ed2a-80f0-4b7c-bcd5-66d095c10b83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:26:30.508314 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:26:30.541368 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1874/3749] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:26:30 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:26:31.777432 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9128d8fc-b02b-44e4-99cc-b2b4d3a68444 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:26:31.778011 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9128d8fc-b02b-44e4-99cc-b2b4d3a68444 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:26:31.778011 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9128d8fc-b02b-44e4-99cc-b2b4d3a68444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:26:31.814976 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-9128d8fc-b02b-44e4-99cc-b2b4d3a68444 None None] MFA Rules not processed for user `affc3572ef7d45249f50b5061a681d18`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:26:31.820446 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-9128d8fc-b02b-44e4-99cc-b2b4d3a68444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:26:31.830924 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:26:31.946119 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1876/3750] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:26:31 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:26:33.848270 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ddfd0e-7a27-43d6-9f09-82ac546a751f None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:26:33.848813 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ddfd0e-7a27-43d6-9f09-82ac546a751f None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:26:33.848813 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ddfd0e-7a27-43d6-9f09-82ac546a751f None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:26:33.851402 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1875/3751] 10.222.0.17 () {54 vars in 912 bytes} [Sat Jul 23 21:26:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:26:33.856523 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d6b791-71ff-4317-bf09-66def5b31276 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:26:33.857124 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d6b791-71ff-4317-bf09-66def5b31276 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:26:33.857124 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d6b791-71ff-4317-bf09-66def5b31276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:26:33.903591 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-79d6b791-71ff-4317-bf09-66def5b31276 None None] MFA Rules not processed for user `abc719a3b3ac4461b82ca04ab6451d81`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:26:33.905164 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-79d6b791-71ff-4317-bf09-66def5b31276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:26:33.920006 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1877/3752] 10.222.0.17 () {58 vars in 1009 bytes} [Sat Jul 23 21:26:33 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:26:33.945444 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ddfd0e-7a27-43d6-9f09-82ac546a751f None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:26:33.947177 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-94ddfd0e-7a27-43d6-9f09-82ac546a751f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:26:33.983272 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ddfd0e-7a27-43d6-9f09-82ac546a751f None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:26:33.989013 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b8f306-d175-4217-9a69-90215ac6653d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc719a3b3ac4461b82ca04ab6451d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:26:33.989825 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b8f306-d175-4217-9a69-90215ac6653d service placement] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:26:33.990188 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b8f306-d175-4217-9a69-90215ac6653d service placement] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:26:33.990472 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b8f306-d175-4217-9a69-90215ac6653d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:26:34.009926 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b8f306-d175-4217-9a69-90215ac6653d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:26:34.011834 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b8f306-d175-4217-9a69-90215ac6653d service placement] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:26:34.033037 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1876/3753] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:26:33 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:26:34.389354 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f833befb-89fc-43d6-b04f-c1edf8875ee0 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:26:34.390742 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f833befb-89fc-43d6-b04f-c1edf8875ee0 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:26:34.392038 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f833befb-89fc-43d6-b04f-c1edf8875ee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:26:34.414621 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-f833befb-89fc-43d6-b04f-c1edf8875ee0 None None] MFA Rules not processed for user `affc3572ef7d45249f50b5061a681d18`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:26:34.416846 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-f833befb-89fc-43d6-b04f-c1edf8875ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:26:34.434163 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1878/3754] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:26:34 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:26:39.493129 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244b0380-390c-4213-9cf4-96cd90e1b601 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:26:39.494082 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244b0380-390c-4213-9cf4-96cd90e1b601 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:26:39.494535 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244b0380-390c-4213-9cf4-96cd90e1b601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:26:39.522901 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-244b0380-390c-4213-9cf4-96cd90e1b601 None None] MFA Rules not processed for user `c8c3d58265714ebba65b1510bd768e19`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:26:39.524692 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-244b0380-390c-4213-9cf4-96cd90e1b601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:26:39.599315 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1877/3755] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:26:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:26:40.912854 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f833befb-89fc-43d6-b04f-c1edf8875ee0 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:26:40.929521 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f833befb-89fc-43d6-b04f-c1edf8875ee0 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:26:40.946614 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbddbefa-8c5e-4768-9d31-ae79d5c5ded8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc719a3b3ac4461b82ca04ab6451d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:26:40.947877 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbddbefa-8c5e-4768-9d31-ae79d5c5ded8 service placement] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:26:40.948248 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbddbefa-8c5e-4768-9d31-ae79d5c5ded8 service placement] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:26:40.948693 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbddbefa-8c5e-4768-9d31-ae79d5c5ded8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:26:40.954198 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-dbddbefa-8c5e-4768-9d31-ae79d5c5ded8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:26:41.007897 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbddbefa-8c5e-4768-9d31-ae79d5c5ded8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:26:41.010576 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbddbefa-8c5e-4768-9d31-ae79d5c5ded8 service placement] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:26:41.066558 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1879/3756] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:26:40 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:26:41.141005 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244b0380-390c-4213-9cf4-96cd90e1b601 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:26:41.142647 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-244b0380-390c-4213-9cf4-96cd90e1b601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:26:41.168176 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244b0380-390c-4213-9cf4-96cd90e1b601 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:26:41.175337 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ac55f7-054d-4d2b-b970-11d4d96e2d2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:26:41.176213 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ac55f7-054d-4d2b-b970-11d4d96e2d2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:26:41.176489 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ac55f7-054d-4d2b-b970-11d4d96e2d2e admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:26:41.176760 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ac55f7-054d-4d2b-b970-11d4d96e2d2e admin admin] PATH_INFO: `/v3/users/e961e46ab94f4fffbc606485935ce64d` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:26:41.178208 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ac55f7-054d-4d2b-b970-11d4d96e2d2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e961e46ab94f4fffbc606485935ce64d)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:26:41.181482 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ac55f7-054d-4d2b-b970-11d4d96e2d2e admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:26:41.299708 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-21ac55f7-054d-4d2b-b970-11d4d96e2d2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e961e46ab94f4fffbc606485935ce64d'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:26:41.300824 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-21ac55f7-054d-4d2b-b970-11d4d96e2d2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e961e46ab94f4fffbc606485935ce64d'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:26:41.321460 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-21ac55f7-054d-4d2b-b970-11d4d96e2d2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e961e46ab94f4fffbc606485935ce64d'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:26:41.344555 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-21ac55f7-054d-4d2b-b970-11d4d96e2d2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e961e46ab94f4fffbc606485935ce64d'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:26:41.364587 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-21ac55f7-054d-4d2b-b970-11d4d96e2d2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e961e46ab94f4fffbc606485935ce64d'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:26:41.382229 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1878/3757] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:26:41 2022] DELETE /identity/v3/users/e961e46ab94f4fffbc606485935ce64d => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:26:42.265435 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbddbefa-8c5e-4768-9d31-ae79d5c5ded8 service placement] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:26:42.280021 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbddbefa-8c5e-4768-9d31-ae79d5c5ded8 service placement] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:26:42.382553 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbf01ed-d81a-4646-a05e-e5448d638fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:26:42.383607 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbf01ed-d81a-4646-a05e-e5448d638fe4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:26:42.384282 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbf01ed-d81a-4646-a05e-e5448d638fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:26:42.384751 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbf01ed-d81a-4646-a05e-e5448d638fe4 admin admin] PATH_INFO: `/v3/projects/8305585b60d54beeb2b087a37260a89a` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:26:42.386395 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbf01ed-d81a-4646-a05e-e5448d638fe4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8305585b60d54beeb2b087a37260a89a)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:26:42.389060 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbf01ed-d81a-4646-a05e-e5448d638fe4 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:26:42.537548 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-5bbf01ed-d81a-4646-a05e-e5448d638fe4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8305585b60d54beeb2b087a37260a89a', 'request_id': 'req-5bbf01ed-d81a-4646-a05e-e5448d638fe4'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:26:42.560615 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-5bbf01ed-d81a-4646-a05e-e5448d638fe4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8305585b60d54beeb2b087a37260a89a', 'request_id': 'req-5bbf01ed-d81a-4646-a05e-e5448d638fe4'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:26:42.587141 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-5bbf01ed-d81a-4646-a05e-e5448d638fe4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8305585b60d54beeb2b087a37260a89a', 'request_id': 'req-5bbf01ed-d81a-4646-a05e-e5448d638fe4'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:26:42.631514 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-5bbf01ed-d81a-4646-a05e-e5448d638fe4 admin admin] The token cache is being invalidate because project 8305585b60d54beeb2b087a37260a89a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:26:42.631789 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-5bbf01ed-d81a-4646-a05e-e5448d638fe4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:26:42.638291 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-5bbf01ed-d81a-4646-a05e-e5448d638fe4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:26:42.649554 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1880/3758] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:26:42 2022] DELETE /identity/v3/projects/8305585b60d54beeb2b087a37260a89a => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:26:42.658423 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209fcf61-023e-4e9b-970e-bfac8c70a456 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:26:42.659696 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209fcf61-023e-4e9b-970e-bfac8c70a456 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:26:42.660313 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209fcf61-023e-4e9b-970e-bfac8c70a456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:26:42.716368 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-209fcf61-023e-4e9b-970e-bfac8c70a456 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:26:42.721802 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-209fcf61-023e-4e9b-970e-bfac8c70a456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:26:42.902482 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:26:42.921813 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1879/3759] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:26:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:26:42.929986 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeadcff5-866c-4680-8919-a9959120ef1f None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:26:42.930354 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeadcff5-866c-4680-8919-a9959120ef1f None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:26:42.930555 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeadcff5-866c-4680-8919-a9959120ef1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:26:42.970417 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:26:42.983304 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-eeadcff5-866c-4680-8919-a9959120ef1f None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:26:42.987351 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-eeadcff5-866c-4680-8919-a9959120ef1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:26:43.013565 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1881/3760] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:26:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:26:43.014459 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209fcf61-023e-4e9b-970e-bfac8c70a456 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:26:43.027632 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209fcf61-023e-4e9b-970e-bfac8c70a456 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:26:43.034841 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdb4134-e09d-48ad-92d4-7f52618c4b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:26:43.035851 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdb4134-e09d-48ad-92d4-7f52618c4b97 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:26:43.036319 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdb4134-e09d-48ad-92d4-7f52618c4b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:26:43.036913 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdb4134-e09d-48ad-92d4-7f52618c4b97 admin admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:26:43.037902 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdb4134-e09d-48ad-92d4-7f52618c4b97 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:26:43.038465 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdb4134-e09d-48ad-92d4-7f52618c4b97 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:26:43.041095 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdb4134-e09d-48ad-92d4-7f52618c4b97 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:26:43.062260 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1880/3761] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:26:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:26:43.067857 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeadcff5-866c-4680-8919-a9959120ef1f None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:26:43.080207 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeadcff5-866c-4680-8919-a9959120ef1f None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:26:43.092591 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a28cee-ba91-45ad-a515-94048dc89790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:26:43.093285 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a28cee-ba91-45ad-a515-94048dc89790 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:26:43.093561 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a28cee-ba91-45ad-a515-94048dc89790 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:26:43.093896 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a28cee-ba91-45ad-a515-94048dc89790 admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:26:43.094602 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a28cee-ba91-45ad-a515-94048dc89790 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:26:43.096525 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a28cee-ba91-45ad-a515-94048dc89790 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:26:43.165486 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1882/3762] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:26:43 2022] POST /identity/v3/projects => generated 395 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:26:43.167531 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdb4134-e09d-48ad-92d4-7f52618c4b97 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:26:43.178735 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdb4134-e09d-48ad-92d4-7f52618c4b97 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:26:43.301673 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1e1a00-5f16-440e-93db-d246e50a4f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:26:43.301916 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1e1a00-5f16-440e-93db-d246e50a4f94 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:26:43.302537 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1e1a00-5f16-440e-93db-d246e50a4f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:26:43.302873 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1e1a00-5f16-440e-93db-d246e50a4f94 admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:26:43.303571 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1e1a00-5f16-440e-93db-d246e50a4f94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:26:43.305509 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1e1a00-5f16-440e-93db-d246e50a4f94 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:26:43.354872 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1881/3763] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:26:43 2022] POST /identity/v3/users => generated 298 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:26:43.358799 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a28cee-ba91-45ad-a515-94048dc89790 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:26:43.372079 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a28cee-ba91-45ad-a515-94048dc89790 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:26:43.379711 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2decb84e-6abc-4ead-8e10-d8aea754aa6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:26:43.379711 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2decb84e-6abc-4ead-8e10-d8aea754aa6d admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:26:43.379711 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2decb84e-6abc-4ead-8e10-d8aea754aa6d admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:26:43.380124 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2decb84e-6abc-4ead-8e10-d8aea754aa6d admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:26:43.380789 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2decb84e-6abc-4ead-8e10-d8aea754aa6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:26:43.383759 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2decb84e-6abc-4ead-8e10-d8aea754aa6d admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:26:43.401181 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1883/3764] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:26:43 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 21:26:43.405102 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1e1a00-5f16-440e-93db-d246e50a4f94 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:26:43.417828 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1e1a00-5f16-440e-93db-d246e50a4f94 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:26:43.423018 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4408aefa-a463-44e1-871a-47357835f7a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:26:43.423418 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4408aefa-a463-44e1-871a-47357835f7a7 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:26:43.423705 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4408aefa-a463-44e1-871a-47357835f7a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:26:43.423976 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4408aefa-a463-44e1-871a-47357835f7a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:26:43.424946 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4408aefa-a463-44e1-871a-47357835f7a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:26:43.426901 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4408aefa-a463-44e1-871a-47357835f7a7 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:26:43.440987 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1882/3765] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:26:43 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:26:43.447726 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2decb84e-6abc-4ead-8e10-d8aea754aa6d admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:26:43.460076 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2decb84e-6abc-4ead-8e10-d8aea754aa6d admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:26:43.466461 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacc59f7-94e9-4c7c-92d0-23b9379d9bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:26:43.467913 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacc59f7-94e9-4c7c-92d0-23b9379d9bb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:26:43.468380 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacc59f7-94e9-4c7c-92d0-23b9379d9bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:26:43.468863 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacc59f7-94e9-4c7c-92d0-23b9379d9bb6 admin admin] PATH_INFO: `/v3/projects/81c256a3f4f34db1b8eb590bb6d4baa7/users/ce9622bd31514e87a45d4cf05a248a00/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:26:43.487411 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacc59f7-94e9-4c7c-92d0-23b9379d9bb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81c256a3f4f34db1b8eb590bb6d4baa7, user_id=ce9622bd31514e87a45d4cf05a248a00, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:26:43.491475 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacc59f7-94e9-4c7c-92d0-23b9379d9bb6 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:26:43.511317 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1884/3766] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:26:43 2022] PUT /identity/v3/projects/81c256a3f4f34db1b8eb590bb6d4baa7/users/ce9622bd31514e87a45d4cf05a248a00/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:26:43.516766 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3a52bf-7c29-46ad-92f5-f8e734b1bbf1 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:26:43.517897 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3a52bf-7c29-46ad-92f5-f8e734b1bbf1 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:26:43.518465 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3a52bf-7c29-46ad-92f5-f8e734b1bbf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:26:43.554189 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-af3a52bf-7c29-46ad-92f5-f8e734b1bbf1 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:26:43.558291 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-af3a52bf-7c29-46ad-92f5-f8e734b1bbf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:26:43.633215 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1883/3767] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:26:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:26:43.648023 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacc59f7-94e9-4c7c-92d0-23b9379d9bb6 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:26:43.650130 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-bacc59f7-94e9-4c7c-92d0-23b9379d9bb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:26:43.744463 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacc59f7-94e9-4c7c-92d0-23b9379d9bb6 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:26:43.750444 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cfb6ba-fd3c-4488-8210-2209cab6e7b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:26:43.751247 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cfb6ba-fd3c-4488-8210-2209cab6e7b0 service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:26:43.752286 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cfb6ba-fd3c-4488-8210-2209cab6e7b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:26:43.752583 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cfb6ba-fd3c-4488-8210-2209cab6e7b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:26:43.782267 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cfb6ba-fd3c-4488-8210-2209cab6e7b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:26:43.784184 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cfb6ba-fd3c-4488-8210-2209cab6e7b0 service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:26:43.800357 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1885/3768] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:26:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:26:48.380858 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe34bc1-bc6e-4547-9610-88593be9fee8 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:26:48.381498 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe34bc1-bc6e-4547-9610-88593be9fee8 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:26:48.382269 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe34bc1-bc6e-4547-9610-88593be9fee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:26:48.436301 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-afe34bc1-bc6e-4547-9610-88593be9fee8 None None] MFA Rules not processed for user `38c74aa110064b4f85fef220e2d47b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:26:48.438376 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-afe34bc1-bc6e-4547-9610-88593be9fee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:26:48.562613 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1884/3769] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:26:48 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:26:48.975408 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75503afc-2bd9-4be7-b8d0-c46163a76965 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:26:48.975989 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75503afc-2bd9-4be7-b8d0-c46163a76965 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:26:48.975989 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75503afc-2bd9-4be7-b8d0-c46163a76965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:26:49.010469 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-75503afc-2bd9-4be7-b8d0-c46163a76965 None None] MFA Rules not processed for user `38c74aa110064b4f85fef220e2d47b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:26:49.014387 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-75503afc-2bd9-4be7-b8d0-c46163a76965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:26:49.032662 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1886/3770] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:26:48 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:26:49.070181 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4355322-8920-45d2-8fa7-21032a26c5bc None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:26:49.070486 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4355322-8920-45d2-8fa7-21032a26c5bc None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:26:49.070755 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4355322-8920-45d2-8fa7-21032a26c5bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:26:49.096981 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:26:49.118044 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-e4355322-8920-45d2-8fa7-21032a26c5bc None None] MFA Rules not processed for user `38c74aa110064b4f85fef220e2d47b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:26:49.119783 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-e4355322-8920-45d2-8fa7-21032a26c5bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:26:49.138540 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1885/3771] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:26:49 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:26:49.222783 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cfe614-eab9-4a6f-93cb-38dc1c644938 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:26:49.223711 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cfe614-eab9-4a6f-93cb-38dc1c644938 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:26:49.224222 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cfe614-eab9-4a6f-93cb-38dc1c644938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:26:49.245827 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-e8cfe614-eab9-4a6f-93cb-38dc1c644938 None None] MFA Rules not processed for user `38c74aa110064b4f85fef220e2d47b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:26:49.247020 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-e8cfe614-eab9-4a6f-93cb-38dc1c644938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:26:49.265344 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1887/3772] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:26:49 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:26:49.293683 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3692c081-8ffe-4a61-ac17-e63fa3c1bd6a None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:26:49.294319 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3692c081-8ffe-4a61-ac17-e63fa3c1bd6a None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:26:49.294788 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3692c081-8ffe-4a61-ac17-e63fa3c1bd6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:26:49.331256 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-3692c081-8ffe-4a61-ac17-e63fa3c1bd6a None None] MFA Rules not processed for user `38c74aa110064b4f85fef220e2d47b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:26:49.332551 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-3692c081-8ffe-4a61-ac17-e63fa3c1bd6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:26:49.356201 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1886/3773] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:26:49 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:26:53.974643 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02946c53-a210-454e-b6dd-5d02c681285f None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:26:53.975115 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02946c53-a210-454e-b6dd-5d02c681285f None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:26:53.975214 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02946c53-a210-454e-b6dd-5d02c681285f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:26:54.012722 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-02946c53-a210-454e-b6dd-5d02c681285f None None] MFA Rules not processed for user `ce9622bd31514e87a45d4cf05a248a00`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:26:54.014160 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-02946c53-a210-454e-b6dd-5d02c681285f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:26:54.095710 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1888/3774] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:26:53 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:26:54.194354 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3692c081-8ffe-4a61-ac17-e63fa3c1bd6a None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:26:54.196432 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-3692c081-8ffe-4a61-ac17-e63fa3c1bd6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:26:54.323469 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02946c53-a210-454e-b6dd-5d02c681285f None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:26:54.325854 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-02946c53-a210-454e-b6dd-5d02c681285f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:26:54.344904 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3692c081-8ffe-4a61-ac17-e63fa3c1bd6a None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:26:54.352956 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618a1c5d-8b54-40f6-866d-20e8965b08b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:26:54.354158 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618a1c5d-8b54-40f6-866d-20e8965b08b2 service nova] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:26:54.354944 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618a1c5d-8b54-40f6-866d-20e8965b08b2 service nova] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:26:54.355372 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618a1c5d-8b54-40f6-866d-20e8965b08b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:26:54.373172 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:26:54.378169 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618a1c5d-8b54-40f6-866d-20e8965b08b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:26:54.381690 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618a1c5d-8b54-40f6-866d-20e8965b08b2 service nova] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:26:54.422687 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1887/3775] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:26:54 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:26:54.430119 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618a1c5d-8b54-40f6-866d-20e8965b08b2 service nova] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:26:54.431714 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-618a1c5d-8b54-40f6-866d-20e8965b08b2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:26:54.470144 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618a1c5d-8b54-40f6-866d-20e8965b08b2 service nova] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:26:54.474956 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcaf1a9-1c19-448e-9e09-69628a8100e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:26:54.475926 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcaf1a9-1c19-448e-9e09-69628a8100e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:26:54.476276 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcaf1a9-1c19-448e-9e09-69628a8100e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:26:54.476630 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcaf1a9-1c19-448e-9e09-69628a8100e1 admin admin] PATH_INFO: `/v3/users/2a609c39c14343e1bc1edd4b3cd56dd4` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:26:54.477964 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcaf1a9-1c19-448e-9e09-69628a8100e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a609c39c14343e1bc1edd4b3cd56dd4)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:26:54.481559 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcaf1a9-1c19-448e-9e09-69628a8100e1 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:26:54.493960 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02946c53-a210-454e-b6dd-5d02c681285f None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:26:54.501303 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7068137-89a7-490b-8275-d5e331cd6f12 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc719a3b3ac4461b82ca04ab6451d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:26:54.502353 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7068137-89a7-490b-8275-d5e331cd6f12 service placement] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:26:54.502707 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7068137-89a7-490b-8275-d5e331cd6f12 service placement] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:26:54.502981 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7068137-89a7-490b-8275-d5e331cd6f12 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:26:54.505277 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-b7068137-89a7-490b-8275-d5e331cd6f12 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:26:54.543100 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7068137-89a7-490b-8275-d5e331cd6f12 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:26:54.544845 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7068137-89a7-490b-8275-d5e331cd6f12 service placement] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:26:54.582219 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1889/3776] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:26:54 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 23 21:26:54.588329 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-0dcaf1a9-1c19-448e-9e09-69628a8100e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a609c39c14343e1bc1edd4b3cd56dd4'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:26:54.589922 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-0dcaf1a9-1c19-448e-9e09-69628a8100e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a609c39c14343e1bc1edd4b3cd56dd4'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:26:54.622570 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-0dcaf1a9-1c19-448e-9e09-69628a8100e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a609c39c14343e1bc1edd4b3cd56dd4'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:26:54.647153 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-0dcaf1a9-1c19-448e-9e09-69628a8100e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a609c39c14343e1bc1edd4b3cd56dd4'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:26:54.672005 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-0dcaf1a9-1c19-448e-9e09-69628a8100e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a609c39c14343e1bc1edd4b3cd56dd4'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:26:54.680554 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1888/3777] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:26:54 2022] DELETE /identity/v3/users/2a609c39c14343e1bc1edd4b3cd56dd4 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:26:55.209960 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7068137-89a7-490b-8275-d5e331cd6f12 service placement] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:26:55.238569 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7068137-89a7-490b-8275-d5e331cd6f12 service placement] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:26:55.373357 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb38f40e-53a8-41a1-b2fe-3c40547eda14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:26:55.374986 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb38f40e-53a8-41a1-b2fe-3c40547eda14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:26:55.375363 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb38f40e-53a8-41a1-b2fe-3c40547eda14 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:26:55.375737 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb38f40e-53a8-41a1-b2fe-3c40547eda14 admin admin] PATH_INFO: `/v3/projects/9116def61aba4631be91f67df63ebab0` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:26:55.377230 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb38f40e-53a8-41a1-b2fe-3c40547eda14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9116def61aba4631be91f67df63ebab0)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:26:55.384025 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb38f40e-53a8-41a1-b2fe-3c40547eda14 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:26:55.501246 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-fb38f40e-53a8-41a1-b2fe-3c40547eda14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9116def61aba4631be91f67df63ebab0', 'request_id': 'req-fb38f40e-53a8-41a1-b2fe-3c40547eda14'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:26:55.523512 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-fb38f40e-53a8-41a1-b2fe-3c40547eda14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9116def61aba4631be91f67df63ebab0', 'request_id': 'req-fb38f40e-53a8-41a1-b2fe-3c40547eda14'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:26:55.537078 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-fb38f40e-53a8-41a1-b2fe-3c40547eda14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9116def61aba4631be91f67df63ebab0', 'request_id': 'req-fb38f40e-53a8-41a1-b2fe-3c40547eda14'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:26:55.560783 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-fb38f40e-53a8-41a1-b2fe-3c40547eda14 admin admin] The token cache is being invalidate because project 9116def61aba4631be91f67df63ebab0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:26:55.561099 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-fb38f40e-53a8-41a1-b2fe-3c40547eda14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:26:55.562311 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-fb38f40e-53a8-41a1-b2fe-3c40547eda14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:26:55.564560 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1890/3778] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:26:55 2022] DELETE /identity/v3/projects/9116def61aba4631be91f67df63ebab0 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:26:55.569325 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73856424-ce28-4ae4-936f-efa4fadb0863 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:26:55.569837 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73856424-ce28-4ae4-936f-efa4fadb0863 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:26:55.570052 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73856424-ce28-4ae4-936f-efa4fadb0863 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:26:55.601337 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-73856424-ce28-4ae4-936f-efa4fadb0863 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:26:55.604698 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-73856424-ce28-4ae4-936f-efa4fadb0863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:26:55.727359 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:26:55.786825 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1889/3779] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:26:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:26:55.788683 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84e9650-db68-4aa5-99df-e0b4a7422400 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:26:55.788973 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84e9650-db68-4aa5-99df-e0b4a7422400 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:26:55.789252 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84e9650-db68-4aa5-99df-e0b4a7422400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:26:55.822841 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-c84e9650-db68-4aa5-99df-e0b4a7422400 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:26:55.827789 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-c84e9650-db68-4aa5-99df-e0b4a7422400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:26:55.837188 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1891/3780] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:26:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:26:55.841450 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73856424-ce28-4ae4-936f-efa4fadb0863 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:26:55.857564 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73856424-ce28-4ae4-936f-efa4fadb0863 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:26:55.863670 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ddb533-32e8-4b32-abe1-880d131ca81e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:26:55.864359 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ddb533-32e8-4b32-abe1-880d131ca81e admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:26:55.864635 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ddb533-32e8-4b32-abe1-880d131ca81e admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:26:55.865635 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ddb533-32e8-4b32-abe1-880d131ca81e admin admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:26:55.866777 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ddb533-32e8-4b32-abe1-880d131ca81e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:26:55.867261 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ddb533-32e8-4b32-abe1-880d131ca81e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:26:55.871703 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ddb533-32e8-4b32-abe1-880d131ca81e admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:26:55.893417 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84e9650-db68-4aa5-99df-e0b4a7422400 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:26:55.902331 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1890/3781] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:26:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:26:55.913311 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84e9650-db68-4aa5-99df-e0b4a7422400 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:26:55.931857 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba909c3b-b62d-4722-81cd-83e2ace0b95c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:26:55.933918 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba909c3b-b62d-4722-81cd-83e2ace0b95c admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:26:55.934350 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba909c3b-b62d-4722-81cd-83e2ace0b95c admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:26:55.934711 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba909c3b-b62d-4722-81cd-83e2ace0b95c admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:26:55.936069 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba909c3b-b62d-4722-81cd-83e2ace0b95c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:26:55.939556 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba909c3b-b62d-4722-81cd-83e2ace0b95c admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:26:55.992982 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1892/3782] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:26:55 2022] POST /identity/v3/projects => generated 385 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:26:55.997414 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ddb533-32e8-4b32-abe1-880d131ca81e admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:26:56.017295 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ddb533-32e8-4b32-abe1-880d131ca81e admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:26:56.089296 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e957c4-7e5d-49c7-b727-27f7f70f9eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:26:56.091108 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e957c4-7e5d-49c7-b727-27f7f70f9eda admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:26:56.091528 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e957c4-7e5d-49c7-b727-27f7f70f9eda admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:26:56.091809 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e957c4-7e5d-49c7-b727-27f7f70f9eda admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:26:56.093118 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e957c4-7e5d-49c7-b727-27f7f70f9eda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:26:56.095682 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e957c4-7e5d-49c7-b727-27f7f70f9eda admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:26:56.130120 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1891/3783] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:26:55 2022] POST /identity/v3/users => generated 293 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:26:56.134599 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba909c3b-b62d-4722-81cd-83e2ace0b95c admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:26:56.151233 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba909c3b-b62d-4722-81cd-83e2ace0b95c admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:26:56.165415 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb5a478-e720-434b-94a5-bce19deb598d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:26:56.166328 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb5a478-e720-434b-94a5-bce19deb598d admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:26:56.166580 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb5a478-e720-434b-94a5-bce19deb598d admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:26:56.167066 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb5a478-e720-434b-94a5-bce19deb598d admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:26:56.168324 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb5a478-e720-434b-94a5-bce19deb598d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:26:56.170092 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb5a478-e720-434b-94a5-bce19deb598d admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:26:56.188725 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e957c4-7e5d-49c7-b727-27f7f70f9eda admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:26:56.195993 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1893/3784] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:26:56 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:26:56.200300 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e957c4-7e5d-49c7-b727-27f7f70f9eda admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:26:56.205612 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c7ebe1-db8d-4ef1-9e26-d7f125651409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:26:56.206310 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c7ebe1-db8d-4ef1-9e26-d7f125651409 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:26:56.206592 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c7ebe1-db8d-4ef1-9e26-d7f125651409 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:26:56.206868 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c7ebe1-db8d-4ef1-9e26-d7f125651409 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:26:56.208385 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c7ebe1-db8d-4ef1-9e26-d7f125651409 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:26:56.211363 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c7ebe1-db8d-4ef1-9e26-d7f125651409 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:26:56.233349 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb5a478-e720-434b-94a5-bce19deb598d admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:26:56.240985 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:26:56.241234 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1892/3785] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:26:56 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:26:56.249029 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb5a478-e720-434b-94a5-bce19deb598d admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:26:56.259421 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8213dacc-ce4d-4e7a-99b2-09ee6719890a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:26:56.261599 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8213dacc-ce4d-4e7a-99b2-09ee6719890a admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:26:56.261906 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8213dacc-ce4d-4e7a-99b2-09ee6719890a admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:26:56.263149 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8213dacc-ce4d-4e7a-99b2-09ee6719890a admin admin] PATH_INFO: `/v3/projects/bd307932213b49888e78e46353998b38/users/17d03db62c3f440d8ffcd52c4c895277/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:26:56.287139 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8213dacc-ce4d-4e7a-99b2-09ee6719890a admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd307932213b49888e78e46353998b38, user_id=17d03db62c3f440d8ffcd52c4c895277, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:26:56.289831 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8213dacc-ce4d-4e7a-99b2-09ee6719890a admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:26:56.318489 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b4c31a-217c-47fb-8274-bdf64953fb93 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:26:56.318858 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b4c31a-217c-47fb-8274-bdf64953fb93 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:26:56.319052 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b4c31a-217c-47fb-8274-bdf64953fb93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:26:56.320650 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1894/3786] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:26:56 2022] PUT /identity/v3/projects/bd307932213b49888e78e46353998b38/users/17d03db62c3f440d8ffcd52c4c895277/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:26:56.353813 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-b2b4c31a-217c-47fb-8274-bdf64953fb93 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:26:56.355646 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-b2b4c31a-217c-47fb-8274-bdf64953fb93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:26:56.499233 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1893/3787] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:26:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:26:56.575470 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8213dacc-ce4d-4e7a-99b2-09ee6719890a admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:26:56.577636 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-8213dacc-ce4d-4e7a-99b2-09ee6719890a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:26:56.691004 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8213dacc-ce4d-4e7a-99b2-09ee6719890a admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:26:56.701964 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6821d1b-df19-473f-a36e-9464c3d1b5f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:26:56.703883 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6821d1b-df19-473f-a36e-9464c3d1b5f3 service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:26:56.705001 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6821d1b-df19-473f-a36e-9464c3d1b5f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:26:56.705560 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6821d1b-df19-473f-a36e-9464c3d1b5f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:26:56.752517 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6821d1b-df19-473f-a36e-9464c3d1b5f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:26:56.754063 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6821d1b-df19-473f-a36e-9464c3d1b5f3 service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:26:56.786508 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1895/3788] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:26:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:27:00.130879 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba5adfe-c3cd-4cdf-849e-d2c998bb8007 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:00.133447 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba5adfe-c3cd-4cdf-849e-d2c998bb8007 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:00.133990 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba5adfe-c3cd-4cdf-849e-d2c998bb8007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:00.179725 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-4ba5adfe-c3cd-4cdf-849e-d2c998bb8007 None None] MFA Rules not processed for user `affc3572ef7d45249f50b5061a681d18`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:27:00.181172 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-4ba5adfe-c3cd-4cdf-849e-d2c998bb8007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:00.328164 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1894/3789] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:27:00 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:27:06.094431 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6821d1b-df19-473f-a36e-9464c3d1b5f3 service neutron] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:06.096578 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-a6821d1b-df19-473f-a36e-9464c3d1b5f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:06.117017 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6821d1b-df19-473f-a36e-9464c3d1b5f3 service neutron] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:06.123816 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d443e7cc-4b03-4d3d-943f-58a5fa3a04f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:06.124988 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d443e7cc-4b03-4d3d-943f-58a5fa3a04f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:06.125779 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d443e7cc-4b03-4d3d-943f-58a5fa3a04f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:06.126302 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d443e7cc-4b03-4d3d-943f-58a5fa3a04f0 admin admin] PATH_INFO: `/v3/users/ce9622bd31514e87a45d4cf05a248a00` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:06.129705 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d443e7cc-4b03-4d3d-943f-58a5fa3a04f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce9622bd31514e87a45d4cf05a248a00)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:06.132479 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d443e7cc-4b03-4d3d-943f-58a5fa3a04f0 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:06.245557 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-d443e7cc-4b03-4d3d-943f-58a5fa3a04f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce9622bd31514e87a45d4cf05a248a00'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:06.275971 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-d443e7cc-4b03-4d3d-943f-58a5fa3a04f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce9622bd31514e87a45d4cf05a248a00'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:06.282986 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-d443e7cc-4b03-4d3d-943f-58a5fa3a04f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce9622bd31514e87a45d4cf05a248a00'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:06.317309 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-d443e7cc-4b03-4d3d-943f-58a5fa3a04f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce9622bd31514e87a45d4cf05a248a00'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:06.358650 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-d443e7cc-4b03-4d3d-943f-58a5fa3a04f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce9622bd31514e87a45d4cf05a248a00'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:06.374094 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1896/3790] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:27:06 2022] DELETE /identity/v3/users/ce9622bd31514e87a45d4cf05a248a00 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:27:07.243591 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba5adfe-c3cd-4cdf-849e-d2c998bb8007 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:07.255587 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:27:07.269057 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba5adfe-c3cd-4cdf-849e-d2c998bb8007 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:07.388844 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c583d93-e3bd-49e3-8647-8b4f3fa7c0aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:07.390617 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c583d93-e3bd-49e3-8647-8b4f3fa7c0aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:07.392288 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c583d93-e3bd-49e3-8647-8b4f3fa7c0aa admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:07.392578 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c583d93-e3bd-49e3-8647-8b4f3fa7c0aa admin admin] PATH_INFO: `/v3/projects/81c256a3f4f34db1b8eb590bb6d4baa7` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:07.399374 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c583d93-e3bd-49e3-8647-8b4f3fa7c0aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=81c256a3f4f34db1b8eb590bb6d4baa7)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:07.405251 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c583d93-e3bd-49e3-8647-8b4f3fa7c0aa admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:07.452178 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d443e7cc-4b03-4d3d-943f-58a5fa3a04f0 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:07.454934 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-d443e7cc-4b03-4d3d-943f-58a5fa3a04f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:07.522734 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d443e7cc-4b03-4d3d-943f-58a5fa3a04f0 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:07.574263 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-0c583d93-e3bd-49e3-8647-8b4f3fa7c0aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81c256a3f4f34db1b8eb590bb6d4baa7', 'request_id': 'req-0c583d93-e3bd-49e3-8647-8b4f3fa7c0aa'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:07.615497 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-0c583d93-e3bd-49e3-8647-8b4f3fa7c0aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81c256a3f4f34db1b8eb590bb6d4baa7', 'request_id': 'req-0c583d93-e3bd-49e3-8647-8b4f3fa7c0aa'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:07.645115 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-0c583d93-e3bd-49e3-8647-8b4f3fa7c0aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81c256a3f4f34db1b8eb590bb6d4baa7', 'request_id': 'req-0c583d93-e3bd-49e3-8647-8b4f3fa7c0aa'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:07.671154 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-0c583d93-e3bd-49e3-8647-8b4f3fa7c0aa admin admin] The token cache is being invalidate because project 81c256a3f4f34db1b8eb590bb6d4baa7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:27:07.671446 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-0c583d93-e3bd-49e3-8647-8b4f3fa7c0aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:07.673761 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-0c583d93-e3bd-49e3-8647-8b4f3fa7c0aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:07.680550 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1895/3791] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:27:07 2022] DELETE /identity/v3/projects/81c256a3f4f34db1b8eb590bb6d4baa7 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:27:07.686980 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc59cc9b-c347-44b5-9c38-80293c645461 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:07.687286 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc59cc9b-c347-44b5-9c38-80293c645461 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:07.687559 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc59cc9b-c347-44b5-9c38-80293c645461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:07.735670 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:27:07.779985 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-bc59cc9b-c347-44b5-9c38-80293c645461 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:27:07.782515 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-bc59cc9b-c347-44b5-9c38-80293c645461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:07.785979 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da104c8-a8a2-4417-915c-775569e59c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:07.786986 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da104c8-a8a2-4417-915c-775569e59c77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:07.787267 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da104c8-a8a2-4417-915c-775569e59c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:07.792343 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da104c8-a8a2-4417-915c-775569e59c77 admin admin] PATH_INFO: `/v3/users/38c74aa110064b4f85fef220e2d47b4f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:07.795620 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da104c8-a8a2-4417-915c-775569e59c77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38c74aa110064b4f85fef220e2d47b4f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:07.799751 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da104c8-a8a2-4417-915c-775569e59c77 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:07.816557 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1896/3792] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:27:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:27:07.818186 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22144b3-5023-47ea-af08-19de59266b76 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:07.818480 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22144b3-5023-47ea-af08-19de59266b76 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:07.818761 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22144b3-5023-47ea-af08-19de59266b76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:07.889096 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-f22144b3-5023-47ea-af08-19de59266b76 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:27:07.893596 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-f22144b3-5023-47ea-af08-19de59266b76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:07.926782 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1897/3793] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:27:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:27:07.928763 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22144b3-5023-47ea-af08-19de59266b76 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:07.953247 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22144b3-5023-47ea-af08-19de59266b76 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:07.963749 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-2da104c8-a8a2-4417-915c-775569e59c77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38c74aa110064b4f85fef220e2d47b4f'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:07.976077 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36571e8a-1dde-4683-af37-c41d8f2953a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:07.977043 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36571e8a-1dde-4683-af37-c41d8f2953a4 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:07.977517 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36571e8a-1dde-4683-af37-c41d8f2953a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:07.978037 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36571e8a-1dde-4683-af37-c41d8f2953a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:07.978969 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36571e8a-1dde-4683-af37-c41d8f2953a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:27:07.982598 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36571e8a-1dde-4683-af37-c41d8f2953a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:07.984671 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36571e8a-1dde-4683-af37-c41d8f2953a4 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:07.986601 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-2da104c8-a8a2-4417-915c-775569e59c77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38c74aa110064b4f85fef220e2d47b4f'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:07.988062 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-2da104c8-a8a2-4417-915c-775569e59c77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38c74aa110064b4f85fef220e2d47b4f'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:08.007345 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1898/3794] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:27:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:27:08.010982 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36571e8a-1dde-4683-af37-c41d8f2953a4 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:08.014036 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-2da104c8-a8a2-4417-915c-775569e59c77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38c74aa110064b4f85fef220e2d47b4f'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:08.029068 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36571e8a-1dde-4683-af37-c41d8f2953a4 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:08.043306 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3716c3bd-10fe-486a-a50e-c3b1fa519410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:08.045610 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3716c3bd-10fe-486a-a50e-c3b1fa519410 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:08.046630 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3716c3bd-10fe-486a-a50e-c3b1fa519410 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:08.047374 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3716c3bd-10fe-486a-a50e-c3b1fa519410 admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:08.048094 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-2da104c8-a8a2-4417-915c-775569e59c77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38c74aa110064b4f85fef220e2d47b4f'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:08.049650 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3716c3bd-10fe-486a-a50e-c3b1fa519410 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:08.054977 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3716c3bd-10fe-486a-a50e-c3b1fa519410 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:08.072864 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1897/3795] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:27:07 2022] DELETE /identity/v3/users/38c74aa110064b4f85fef220e2d47b4f => generated 0 bytes in 621 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:27:08.117692 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da104c8-a8a2-4417-915c-775569e59c77 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:08.119663 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-2da104c8-a8a2-4417-915c-775569e59c77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:08.123227 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1899/3796] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:27:08 2022] POST /identity/v3/projects => generated 361 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:27:08.249002 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da104c8-a8a2-4417-915c-775569e59c77 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:08.339296 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b09dc2d-01cd-466d-9111-d9a856063bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:08.339868 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b09dc2d-01cd-466d-9111-d9a856063bdb admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:08.340147 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b09dc2d-01cd-466d-9111-d9a856063bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:08.340421 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b09dc2d-01cd-466d-9111-d9a856063bdb admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:08.343147 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b09dc2d-01cd-466d-9111-d9a856063bdb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:08.349630 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b09dc2d-01cd-466d-9111-d9a856063bdb admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:08.429032 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3716c3bd-10fe-486a-a50e-c3b1fa519410 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:08.430663 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1898/3797] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:27:08 2022] POST /identity/v3/users => generated 281 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:27:08.453078 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3716c3bd-10fe-486a-a50e-c3b1fa519410 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:08.465940 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0605c142-c212-44ce-9758-024b2bbc4d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:08.466645 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0605c142-c212-44ce-9758-024b2bbc4d00 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:08.466922 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0605c142-c212-44ce-9758-024b2bbc4d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:08.467194 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0605c142-c212-44ce-9758-024b2bbc4d00 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:08.467922 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0605c142-c212-44ce-9758-024b2bbc4d00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:08.469532 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0605c142-c212-44ce-9758-024b2bbc4d00 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:08.483458 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1900/3798] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:27:08 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:27:08.486077 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b09dc2d-01cd-466d-9111-d9a856063bdb admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:08.502089 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b09dc2d-01cd-466d-9111-d9a856063bdb admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:08.520636 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a75868-8a5b-4f21-9415-705a3e7bc31a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:08.523841 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a75868-8a5b-4f21-9415-705a3e7bc31a admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:08.524382 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a75868-8a5b-4f21-9415-705a3e7bc31a admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:08.524810 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a75868-8a5b-4f21-9415-705a3e7bc31a admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:08.527956 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a75868-8a5b-4f21-9415-705a3e7bc31a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:08.533414 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a75868-8a5b-4f21-9415-705a3e7bc31a admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:08.541896 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:27:08.554331 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1899/3799] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:27:08 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:27:08.558450 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0605c142-c212-44ce-9758-024b2bbc4d00 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:08.576595 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0605c142-c212-44ce-9758-024b2bbc4d00 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:08.584602 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3f616d-3e97-4c7b-9f20-1387b989fe94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:08.585532 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3f616d-3e97-4c7b-9f20-1387b989fe94 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:08.585812 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3f616d-3e97-4c7b-9f20-1387b989fe94 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:08.586508 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3f616d-3e97-4c7b-9f20-1387b989fe94 admin admin] PATH_INFO: `/v3/projects/0d087c710faa4760a0affd16cf679c3e/users/011eed383add4d49b525e6ce57cdc0a1/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:08.606694 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3f616d-3e97-4c7b-9f20-1387b989fe94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d087c710faa4760a0affd16cf679c3e, user_id=011eed383add4d49b525e6ce57cdc0a1, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:08.610195 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3f616d-3e97-4c7b-9f20-1387b989fe94 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:08.632191 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1901/3800] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:27:08 2022] PUT /identity/v3/projects/0d087c710faa4760a0affd16cf679c3e/users/011eed383add4d49b525e6ce57cdc0a1/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:27:08.643760 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09605f68-ca48-4691-b9db-c9ab9c20694d None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:08.644466 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09605f68-ca48-4691-b9db-c9ab9c20694d None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:08.644892 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09605f68-ca48-4691-b9db-c9ab9c20694d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:08.687499 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-09605f68-ca48-4691-b9db-c9ab9c20694d None None] MFA Rules not processed for user `011eed383add4d49b525e6ce57cdc0a1`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:27:08.689024 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-09605f68-ca48-4691-b9db-c9ab9c20694d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:08.744506 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3f616d-3e97-4c7b-9f20-1387b989fe94 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:08.745155 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-4b3f616d-3e97-4c7b-9f20-1387b989fe94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:08.767503 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:27:08.878290 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1900/3801] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:27:08 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:27:08.892633 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09605f68-ca48-4691-b9db-c9ab9c20694d None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:08.894105 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-09605f68-ca48-4691-b9db-c9ab9c20694d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:08.910129 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3f616d-3e97-4c7b-9f20-1387b989fe94 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:08.926122 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2e3eb1-1305-4c9c-81c9-cfaa3b07dbdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:08.927093 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2e3eb1-1305-4c9c-81c9-cfaa3b07dbdc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:08.927369 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2e3eb1-1305-4c9c-81c9-cfaa3b07dbdc admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:08.927637 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2e3eb1-1305-4c9c-81c9-cfaa3b07dbdc admin admin] PATH_INFO: `/v3/projects/766b3be6b5fb4734bd9aeccbd35e3824` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:08.928845 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2e3eb1-1305-4c9c-81c9-cfaa3b07dbdc admin admin] RBAC: Authorizing `identity:delete_project(project_id=766b3be6b5fb4734bd9aeccbd35e3824)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:08.930834 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2e3eb1-1305-4c9c-81c9-cfaa3b07dbdc admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:09.045516 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-ef2e3eb1-1305-4c9c-81c9-cfaa3b07dbdc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '766b3be6b5fb4734bd9aeccbd35e3824', 'request_id': 'req-ef2e3eb1-1305-4c9c-81c9-cfaa3b07dbdc'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:09.055616 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-ef2e3eb1-1305-4c9c-81c9-cfaa3b07dbdc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '766b3be6b5fb4734bd9aeccbd35e3824', 'request_id': 'req-ef2e3eb1-1305-4c9c-81c9-cfaa3b07dbdc'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:09.077031 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09605f68-ca48-4691-b9db-c9ab9c20694d None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:09.079429 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-ef2e3eb1-1305-4c9c-81c9-cfaa3b07dbdc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '766b3be6b5fb4734bd9aeccbd35e3824', 'request_id': 'req-ef2e3eb1-1305-4c9c-81c9-cfaa3b07dbdc'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:09.106795 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-ef2e3eb1-1305-4c9c-81c9-cfaa3b07dbdc admin admin] The token cache is being invalidate because project 766b3be6b5fb4734bd9aeccbd35e3824 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:27:09.107701 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-ef2e3eb1-1305-4c9c-81c9-cfaa3b07dbdc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:09.109019 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-ef2e3eb1-1305-4c9c-81c9-cfaa3b07dbdc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:09.113714 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1902/3802] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:27:08 2022] DELETE /identity/v3/projects/766b3be6b5fb4734bd9aeccbd35e3824 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:27:09.124692 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729ea89d-7c72-42af-8551-0f13a0f88860 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:09.125455 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729ea89d-7c72-42af-8551-0f13a0f88860 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:09.125455 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729ea89d-7c72-42af-8551-0f13a0f88860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:09.151381 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-729ea89d-7c72-42af-8551-0f13a0f88860 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:27:09.153623 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-729ea89d-7c72-42af-8551-0f13a0f88860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:09.275223 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6877dcb4-5094-4fb4-9407-ed8e83578361 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:09.275996 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6877dcb4-5094-4fb4-9407-ed8e83578361 service nova] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:09.276187 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6877dcb4-5094-4fb4-9407-ed8e83578361 service nova] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:09.276444 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6877dcb4-5094-4fb4-9407-ed8e83578361 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:09.284258 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-6877dcb4-5094-4fb4-9407-ed8e83578361 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:09.323119 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:27:09.360616 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1903/3803] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:27:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:27:09.362567 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8473b29-6c50-4b09-bdf0-4694d8d352a7 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:09.362852 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8473b29-6c50-4b09-bdf0-4694d8d352a7 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:09.363124 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8473b29-6c50-4b09-bdf0-4694d8d352a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:09.395431 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-a8473b29-6c50-4b09-bdf0-4694d8d352a7 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:27:09.398815 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-a8473b29-6c50-4b09-bdf0-4694d8d352a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:09.406338 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6877dcb4-5094-4fb4-9407-ed8e83578361 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:09.407953 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6877dcb4-5094-4fb4-9407-ed8e83578361 service nova] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:09.432027 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1904/3804] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:27:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:27:09.436585 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8473b29-6c50-4b09-bdf0-4694d8d352a7 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:09.449882 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1901/3805] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:27:08 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 558 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 23 21:27:09.450098 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8473b29-6c50-4b09-bdf0-4694d8d352a7 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:09.461979 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a712ca8-551f-4cc7-8350-395903ec18bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:09.462579 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a712ca8-551f-4cc7-8350-395903ec18bd admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:09.462852 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a712ca8-551f-4cc7-8350-395903ec18bd admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:09.463124 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a712ca8-551f-4cc7-8350-395903ec18bd admin admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:09.463888 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a712ca8-551f-4cc7-8350-395903ec18bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:27:09.464191 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a712ca8-551f-4cc7-8350-395903ec18bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:09.465820 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a712ca8-551f-4cc7-8350-395903ec18bd admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:09.497669 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1905/3806] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:27:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 21:27:09.501979 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6877dcb4-5094-4fb4-9407-ed8e83578361 service nova] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:09.515589 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6877dcb4-5094-4fb4-9407-ed8e83578361 service nova] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:09.520698 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561a9d32-5186-4b37-a2a2-c86f34531ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:09.521636 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561a9d32-5186-4b37-a2a2-c86f34531ccf admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:09.522133 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561a9d32-5186-4b37-a2a2-c86f34531ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:09.522551 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561a9d32-5186-4b37-a2a2-c86f34531ccf admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:09.523805 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561a9d32-5186-4b37-a2a2-c86f34531ccf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:09.526589 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561a9d32-5186-4b37-a2a2-c86f34531ccf admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:09.532634 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a712ca8-551f-4cc7-8350-395903ec18bd admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:09.534902 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-1a712ca8-551f-4cc7-8350-395903ec18bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:09.560290 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a712ca8-551f-4cc7-8350-395903ec18bd admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:09.570214 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5487bd-968d-4ffd-a098-e99889c58a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:09.571354 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5487bd-968d-4ffd-a098-e99889c58a25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:09.571630 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5487bd-968d-4ffd-a098-e99889c58a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:09.572098 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5487bd-968d-4ffd-a098-e99889c58a25 admin admin] PATH_INFO: `/v3/users/011eed383add4d49b525e6ce57cdc0a1` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:09.573498 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5487bd-968d-4ffd-a098-e99889c58a25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=011eed383add4d49b525e6ce57cdc0a1)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:09.586644 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5487bd-968d-4ffd-a098-e99889c58a25 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:09.591013 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1902/3807] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:27:09 2022] POST /identity/v3/projects => generated 365 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:27:09.595384 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561a9d32-5186-4b37-a2a2-c86f34531ccf admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:09.628258 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:27:09.704580 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-db5487bd-968d-4ffd-a098-e99889c58a25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '011eed383add4d49b525e6ce57cdc0a1'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:09.707896 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-db5487bd-968d-4ffd-a098-e99889c58a25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '011eed383add4d49b525e6ce57cdc0a1'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:09.727231 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-db5487bd-968d-4ffd-a098-e99889c58a25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '011eed383add4d49b525e6ce57cdc0a1'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:09.749876 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-db5487bd-968d-4ffd-a098-e99889c58a25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '011eed383add4d49b525e6ce57cdc0a1'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:09.770961 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561a9d32-5186-4b37-a2a2-c86f34531ccf admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:09.773354 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-db5487bd-968d-4ffd-a098-e99889c58a25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '011eed383add4d49b525e6ce57cdc0a1'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:09.795386 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1ff8b3-30be-4c68-bbc5-7a30f8847049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:09.796095 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1ff8b3-30be-4c68-bbc5-7a30f8847049 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:09.796367 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1ff8b3-30be-4c68-bbc5-7a30f8847049 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:09.796633 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1ff8b3-30be-4c68-bbc5-7a30f8847049 admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:09.797338 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1ff8b3-30be-4c68-bbc5-7a30f8847049 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:09.804265 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1906/3808] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:27:09 2022] DELETE /identity/v3/users/011eed383add4d49b525e6ce57cdc0a1 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:27:09.804475 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1ff8b3-30be-4c68-bbc5-7a30f8847049 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:09.806024 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2813d6a0-7af4-450d-be13-49c697ec3a89 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:09.806309 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2813d6a0-7af4-450d-be13-49c697ec3a89 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:09.806581 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2813d6a0-7af4-450d-be13-49c697ec3a89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:09.856164 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-2813d6a0-7af4-450d-be13-49c697ec3a89 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:27:09.871452 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1903/3809] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:27:09 2022] POST /identity/v3/users => generated 283 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:27:09.871677 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-2813d6a0-7af4-450d-be13-49c697ec3a89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:09.872093 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1ff8b3-30be-4c68-bbc5-7a30f8847049 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:09.874301 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-2a1ff8b3-30be-4c68-bbc5-7a30f8847049 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:09.907825 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1ff8b3-30be-4c68-bbc5-7a30f8847049 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:09.999214 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1907/3810] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:27:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:27:10.027474 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379d888d-d914-4f1d-b5ea-072310c82700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:10.028754 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379d888d-d914-4f1d-b5ea-072310c82700 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:10.029132 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379d888d-d914-4f1d-b5ea-072310c82700 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:10.030372 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379d888d-d914-4f1d-b5ea-072310c82700 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:10.031785 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379d888d-d914-4f1d-b5ea-072310c82700 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:10.033649 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379d888d-d914-4f1d-b5ea-072310c82700 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:10.047632 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1904/3811] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:27:09 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:27:10.051646 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2813d6a0-7af4-450d-be13-49c697ec3a89 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:10.073020 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2813d6a0-7af4-450d-be13-49c697ec3a89 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:10.087538 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077bbccb-9981-4bd9-9ac1-45830f61bc8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:10.088313 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077bbccb-9981-4bd9-9ac1-45830f61bc8d admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:10.088701 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077bbccb-9981-4bd9-9ac1-45830f61bc8d admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:10.089065 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077bbccb-9981-4bd9-9ac1-45830f61bc8d admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:10.089968 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077bbccb-9981-4bd9-9ac1-45830f61bc8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:10.091685 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077bbccb-9981-4bd9-9ac1-45830f61bc8d admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:10.115118 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1908/3812] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:27:10 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:27:10.116458 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379d888d-d914-4f1d-b5ea-072310c82700 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:10.133359 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077bbccb-9981-4bd9-9ac1-45830f61bc8d admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:10.135347 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379d888d-d914-4f1d-b5ea-072310c82700 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:10.140042 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-077bbccb-9981-4bd9-9ac1-45830f61bc8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:10.150492 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1d213b-97d2-43ae-9167-8e61e1d3f038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:10.151412 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1d213b-97d2-43ae-9167-8e61e1d3f038 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:10.151688 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1d213b-97d2-43ae-9167-8e61e1d3f038 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:10.151971 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1d213b-97d2-43ae-9167-8e61e1d3f038 admin admin] PATH_INFO: `/v3/projects/e0a9d26d5a054b6f9f4fa5e3ff8d791b/users/332b15ae4121497c8cc6c8fd5f485825/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:10.215423 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1d213b-97d2-43ae-9167-8e61e1d3f038 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0a9d26d5a054b6f9f4fa5e3ff8d791b, user_id=332b15ae4121497c8cc6c8fd5f485825, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:10.218143 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1d213b-97d2-43ae-9167-8e61e1d3f038 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:10.248877 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077bbccb-9981-4bd9-9ac1-45830f61bc8d admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:10.249870 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1905/3813] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:27:10 2022] PUT /identity/v3/projects/e0a9d26d5a054b6f9f4fa5e3ff8d791b/users/332b15ae4121497c8cc6c8fd5f485825/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:27:10.260032 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c2d8b0-65ab-4830-acd0-80c4358a914b None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:10.260343 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c2d8b0-65ab-4830-acd0-80c4358a914b None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:10.260764 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c2d8b0-65ab-4830-acd0-80c4358a914b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:10.267669 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:27:10.294238 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-09c2d8b0-65ab-4830-acd0-80c4358a914b None None] MFA Rules not processed for user `332b15ae4121497c8cc6c8fd5f485825`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:27:10.295494 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-09c2d8b0-65ab-4830-acd0-80c4358a914b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:10.341757 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:27:10.376524 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1906/3814] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:27:10 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:27:10.381470 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c2d8b0-65ab-4830-acd0-80c4358a914b None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:10.388537 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093b2266-20f9-4608-8f70-9eb0ea9805d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:10.389387 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093b2266-20f9-4608-8f70-9eb0ea9805d6 service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:10.389672 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093b2266-20f9-4608-8f70-9eb0ea9805d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:10.389970 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093b2266-20f9-4608-8f70-9eb0ea9805d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:10.493477 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093b2266-20f9-4608-8f70-9eb0ea9805d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:10.495140 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093b2266-20f9-4608-8f70-9eb0ea9805d6 service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:10.497657 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c2d8b0-65ab-4830-acd0-80c4358a914b None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:10.505065 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c134f6-7970-4e56-9bb1-d99800d25a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:10.505776 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c134f6-7970-4e56-9bb1-d99800d25a5f admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:10.506155 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c134f6-7970-4e56-9bb1-d99800d25a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:10.506445 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c134f6-7970-4e56-9bb1-d99800d25a5f admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:10.506972 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1909/3815] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:27:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:27:10.508317 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b25bd6-609a-413b-b7d4-2f0a464c82e7 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:10.508585 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b25bd6-609a-413b-b7d4-2f0a464c82e7 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:10.509026 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b25bd6-609a-413b-b7d4-2f0a464c82e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:10.510359 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c134f6-7970-4e56-9bb1-d99800d25a5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:10.513216 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c134f6-7970-4e56-9bb1-d99800d25a5f admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:10.540449 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-96b25bd6-609a-413b-b7d4-2f0a464c82e7 None None] MFA Rules not processed for user `17d03db62c3f440d8ffcd52c4c895277`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:27:10.541746 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-96b25bd6-609a-413b-b7d4-2f0a464c82e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:10.598287 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1907/3816] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:27:10 2022] POST /identity/v3/projects => generated 367 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:27:10.600611 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c134f6-7970-4e56-9bb1-d99800d25a5f admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:10.619995 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1910/3817] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:27:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:27:10.705532 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c134f6-7970-4e56-9bb1-d99800d25a5f admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:10.713270 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32440d5-8f8b-4b87-a300-1697a4d2985d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:10.714011 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32440d5-8f8b-4b87-a300-1697a4d2985d admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:10.714426 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32440d5-8f8b-4b87-a300-1697a4d2985d admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:10.714690 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32440d5-8f8b-4b87-a300-1697a4d2985d admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:10.715576 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32440d5-8f8b-4b87-a300-1697a4d2985d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:10.717831 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32440d5-8f8b-4b87-a300-1697a4d2985d admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:10.750969 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1908/3818] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:27:10 2022] POST /identity/v3/users => generated 290 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:27:10.752264 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b25bd6-609a-413b-b7d4-2f0a464c82e7 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:10.768970 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b25bd6-609a-413b-b7d4-2f0a464c82e7 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:10.774448 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0125b8cb-3547-432b-8144-7679dc729d72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:10.775616 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0125b8cb-3547-432b-8144-7679dc729d72 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:10.775967 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0125b8cb-3547-432b-8144-7679dc729d72 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:10.776244 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0125b8cb-3547-432b-8144-7679dc729d72 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:10.776980 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0125b8cb-3547-432b-8144-7679dc729d72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:10.779180 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0125b8cb-3547-432b-8144-7679dc729d72 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:10.809466 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1911/3819] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:27:10 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:27:10.818030 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32440d5-8f8b-4b87-a300-1697a4d2985d admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:10.860529 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32440d5-8f8b-4b87-a300-1697a4d2985d admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:10.887538 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da503869-cf81-4bde-87b7-c07087dd8282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:10.890257 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da503869-cf81-4bde-87b7-c07087dd8282 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:10.890969 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da503869-cf81-4bde-87b7-c07087dd8282 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:10.891686 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da503869-cf81-4bde-87b7-c07087dd8282 admin admin] PATH_INFO: `/v3/projects/e9efb263bab548e7be7c326fcda0cae5/users/fa0c4c841f514431aad18f86024154e8/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:10.897098 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:27:10.929601 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da503869-cf81-4bde-87b7-c07087dd8282 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9efb263bab548e7be7c326fcda0cae5, user_id=fa0c4c841f514431aad18f86024154e8, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:10.936652 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da503869-cf81-4bde-87b7-c07087dd8282 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:10.979030 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1909/3820] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:27:10 2022] PUT /identity/v3/projects/e9efb263bab548e7be7c326fcda0cae5/users/fa0c4c841f514431aad18f86024154e8/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:27:10.985925 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0125b8cb-3547-432b-8144-7679dc729d72 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:11.001382 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0125b8cb-3547-432b-8144-7679dc729d72 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:11.115655 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6d4949-5cd0-4ad7-b0d5-e6610cbc2a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:11.116497 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6d4949-5cd0-4ad7-b0d5-e6610cbc2a4d admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:11.116981 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6d4949-5cd0-4ad7-b0d5-e6610cbc2a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:11.117373 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6d4949-5cd0-4ad7-b0d5-e6610cbc2a4d admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:11.118230 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6d4949-5cd0-4ad7-b0d5-e6610cbc2a4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:11.121186 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6d4949-5cd0-4ad7-b0d5-e6610cbc2a4d admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:11.155162 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1912/3821] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:27:10 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:27:11.159438 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da503869-cf81-4bde-87b7-c07087dd8282 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:11.177299 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da503869-cf81-4bde-87b7-c07087dd8282 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:11.192118 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccafbdad-b9cb-48d1-a2bc-b066f2edd3e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:11.192335 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccafbdad-b9cb-48d1-a2bc-b066f2edd3e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:11.192485 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccafbdad-b9cb-48d1-a2bc-b066f2edd3e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:11.192851 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccafbdad-b9cb-48d1-a2bc-b066f2edd3e3 admin admin] PATH_INFO: `/v3/projects/e9efb263bab548e7be7c326fcda0cae5/users/fa0c4c841f514431aad18f86024154e8/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:11.195432 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccafbdad-b9cb-48d1-a2bc-b066f2edd3e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9efb263bab548e7be7c326fcda0cae5, user_id=fa0c4c841f514431aad18f86024154e8, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:11.198158 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccafbdad-b9cb-48d1-a2bc-b066f2edd3e3 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:11.240282 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1910/3822] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:27:11 2022] PUT /identity/v3/projects/e9efb263bab548e7be7c326fcda0cae5/users/fa0c4c841f514431aad18f86024154e8/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:27:11.242480 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf7855b-c2ca-4a72-9e6a-1d0a78852e44 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:11.242885 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf7855b-c2ca-4a72-9e6a-1d0a78852e44 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:11.243038 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf7855b-c2ca-4a72-9e6a-1d0a78852e44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:11.253205 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:27:11.308502 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-ecf7855b-c2ca-4a72-9e6a-1d0a78852e44 None None] MFA Rules not processed for user `fa0c4c841f514431aad18f86024154e8`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:27:11.309757 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-ecf7855b-c2ca-4a72-9e6a-1d0a78852e44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:11.412285 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1913/3823] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:27:11 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:27:11.418333 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccafbdad-b9cb-48d1-a2bc-b066f2edd3e3 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:11.431853 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccafbdad-b9cb-48d1-a2bc-b066f2edd3e3 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:11.436855 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e4feb6-90b2-4931-b018-a56de3a5f5f5 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa0c4c841f514431aad18f86024154e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9efb263bab548e7be7c326fcda0cae5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:11.437524 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e4feb6-90b2-4931-b018-a56de3a5f5f5 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:11.437802 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e4feb6-90b2-4931-b018-a56de3a5f5f5 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:11.438117 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e4feb6-90b2-4931-b018-a56de3a5f5f5 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:11.438802 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e4feb6-90b2-4931-b018-a56de3a5f5f5 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:11.441262 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e4feb6-90b2-4931-b018-a56de3a5f5f5 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:11.494029 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1911/3824] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:27:11 2022] POST /identity/v3/projects => generated 359 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:27:11.494199 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf7855b-c2ca-4a72-9e6a-1d0a78852e44 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:11.505492 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf7855b-c2ca-4a72-9e6a-1d0a78852e44 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:11.603790 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e4feb6-90b2-4931-b018-a56de3a5f5f5 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:11.607314 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-47e4feb6-90b2-4931-b018-a56de3a5f5f5 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:11.645065 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b74a56-0f9b-45bf-a399-7d6d460244da tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa0c4c841f514431aad18f86024154e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9efb263bab548e7be7c326fcda0cae5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:11.646244 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b74a56-0f9b-45bf-a399-7d6d460244da tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:11.646727 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b74a56-0f9b-45bf-a399-7d6d460244da tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:11.648249 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b74a56-0f9b-45bf-a399-7d6d460244da tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:11.649993 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b74a56-0f9b-45bf-a399-7d6d460244da tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:11.654673 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b74a56-0f9b-45bf-a399-7d6d460244da tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:11.656629 ncdv-master-1 devstack@keystone.service[91548]: WARNING keystone.server.flask.common [None req-89b74a56-0f9b-45bf-a399-7d6d460244da tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 23 21:27:11.704174 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1914/3825] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:27:11 2022] POST /identity/v3/users => generated 371 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:27:11.708439 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b74a56-0f9b-45bf-a399-7d6d460244da tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:11.723209 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b74a56-0f9b-45bf-a399-7d6d460244da tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:11.731390 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9446bd7a-854a-4bee-86e0-fd00de5ea41f tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa0c4c841f514431aad18f86024154e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9efb263bab548e7be7c326fcda0cae5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:11.732484 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9446bd7a-854a-4bee-86e0-fd00de5ea41f tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:11.732846 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9446bd7a-854a-4bee-86e0-fd00de5ea41f tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:11.733131 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9446bd7a-854a-4bee-86e0-fd00de5ea41f tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] PATH_INFO: `/v3/users/50f1a20b9ac9407796162d1b051483e5` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:11.753744 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9446bd7a-854a-4bee-86e0-fd00de5ea41f tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] RBAC: Authorizing `identity:get_user(user_id=50f1a20b9ac9407796162d1b051483e5)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:11.756176 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9446bd7a-854a-4bee-86e0-fd00de5ea41f tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:11.758302 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1915/3826] 10.222.0.17 () {58 vars in 1220 bytes} [Sat Jul 23 21:27:11 2022] GET /identity/v3/users/50f1a20b9ac9407796162d1b051483e5 => generated 371 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:27:11.758435 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e4feb6-90b2-4931-b018-a56de3a5f5f5 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:11.762112 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9446bd7a-854a-4bee-86e0-fd00de5ea41f tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:11.772166 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5281288-27e4-4f8a-b182-9be21bb92d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:11.773424 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9446bd7a-854a-4bee-86e0-fd00de5ea41f tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:11.773592 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5281288-27e4-4f8a-b182-9be21bb92d5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:11.773592 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5281288-27e4-4f8a-b182-9be21bb92d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:11.773592 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5281288-27e4-4f8a-b182-9be21bb92d5b admin admin] PATH_INFO: `/v3/projects/0d087c710faa4760a0affd16cf679c3e` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:11.774694 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5281288-27e4-4f8a-b182-9be21bb92d5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d087c710faa4760a0affd16cf679c3e)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:11.777276 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5281288-27e4-4f8a-b182-9be21bb92d5b admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:11.780039 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c973f88d-8c54-427e-9880-39dd3ab4b2b0 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa0c4c841f514431aad18f86024154e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9efb263bab548e7be7c326fcda0cae5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:11.780551 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c973f88d-8c54-427e-9880-39dd3ab4b2b0 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:11.780966 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c973f88d-8c54-427e-9880-39dd3ab4b2b0 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:11.781338 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c973f88d-8c54-427e-9880-39dd3ab4b2b0 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] PATH_INFO: `/v3/users/50f1a20b9ac9407796162d1b051483e5` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:11.782837 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c973f88d-8c54-427e-9880-39dd3ab4b2b0 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] RBAC: Authorizing `identity:delete_user(user_id=50f1a20b9ac9407796162d1b051483e5)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:11.802546 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c973f88d-8c54-427e-9880-39dd3ab4b2b0 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:11.878772 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c973f88d-8c54-427e-9880-39dd3ab4b2b0 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50f1a20b9ac9407796162d1b051483e5'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:11.880828 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c973f88d-8c54-427e-9880-39dd3ab4b2b0 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50f1a20b9ac9407796162d1b051483e5'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:11.892608 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-d5281288-27e4-4f8a-b182-9be21bb92d5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d087c710faa4760a0affd16cf679c3e', 'request_id': 'req-d5281288-27e4-4f8a-b182-9be21bb92d5b'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:11.896772 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c973f88d-8c54-427e-9880-39dd3ab4b2b0 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50f1a20b9ac9407796162d1b051483e5'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:11.900018 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:27:11.916568 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-d5281288-27e4-4f8a-b182-9be21bb92d5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d087c710faa4760a0affd16cf679c3e', 'request_id': 'req-d5281288-27e4-4f8a-b182-9be21bb92d5b'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:11.919014 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-d5281288-27e4-4f8a-b182-9be21bb92d5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d087c710faa4760a0affd16cf679c3e', 'request_id': 'req-d5281288-27e4-4f8a-b182-9be21bb92d5b'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:11.926009 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c973f88d-8c54-427e-9880-39dd3ab4b2b0 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50f1a20b9ac9407796162d1b051483e5'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:11.948812 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c973f88d-8c54-427e-9880-39dd3ab4b2b0 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50f1a20b9ac9407796162d1b051483e5'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:11.956627 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-d5281288-27e4-4f8a-b182-9be21bb92d5b admin admin] The token cache is being invalidate because project 0d087c710faa4760a0affd16cf679c3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:27:11.958357 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-d5281288-27e4-4f8a-b182-9be21bb92d5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:11.959445 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-d5281288-27e4-4f8a-b182-9be21bb92d5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:11.962644 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1916/3827] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:27:11 2022] DELETE /identity/v3/users/50f1a20b9ac9407796162d1b051483e5 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:27:11.966995 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1912/3828] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:27:11 2022] DELETE /identity/v3/projects/0d087c710faa4760a0affd16cf679c3e => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:27:11.968247 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c973f88d-8c54-427e-9880-39dd3ab4b2b0 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:11.973067 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451bc573-3372-49df-82cd-eee5a8807f79 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:11.973505 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451bc573-3372-49df-82cd-eee5a8807f79 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:11.973990 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451bc573-3372-49df-82cd-eee5a8807f79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:11.976369 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-c973f88d-8c54-427e-9880-39dd3ab4b2b0 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:12.032800 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-451bc573-3372-49df-82cd-eee5a8807f79 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:27:12.034934 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-451bc573-3372-49df-82cd-eee5a8807f79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:12.110969 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:27:12.144162 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c973f88d-8c54-427e-9880-39dd3ab4b2b0 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:12.159141 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c824a3e7-2cf8-483d-ad3e-3ce1f8ca8f92 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa0c4c841f514431aad18f86024154e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9efb263bab548e7be7c326fcda0cae5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:12.160164 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c824a3e7-2cf8-483d-ad3e-3ce1f8ca8f92 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:12.161077 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c824a3e7-2cf8-483d-ad3e-3ce1f8ca8f92 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:12.162520 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c824a3e7-2cf8-483d-ad3e-3ce1f8ca8f92 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] PATH_INFO: `/v3/projects/621b6356990d4b53a68b172c81ff982b` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:12.164490 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c824a3e7-2cf8-483d-ad3e-3ce1f8ca8f92 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] RBAC: Authorizing `identity:delete_project(project_id=621b6356990d4b53a68b172c81ff982b)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:12.174004 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c824a3e7-2cf8-483d-ad3e-3ce1f8ca8f92 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:12.178299 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1913/3829] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:27:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:27:12.179369 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451bc573-3372-49df-82cd-eee5a8807f79 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:12.186068 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-451bc573-3372-49df-82cd-eee5a8807f79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:12.207299 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451bc573-3372-49df-82cd-eee5a8807f79 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:12.223425 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ce6ff6-790e-4353-af16-67be48d1cf7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:12.224649 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ce6ff6-790e-4353-af16-67be48d1cf7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:12.224951 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ce6ff6-790e-4353-af16-67be48d1cf7e admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:12.225386 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ce6ff6-790e-4353-af16-67be48d1cf7e admin admin] PATH_INFO: `/v3/users/0543f1a561a9442cbc9463ab752bd2aa` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:12.228507 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ce6ff6-790e-4353-af16-67be48d1cf7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=0543f1a561a9442cbc9463ab752bd2aa)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:12.231213 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ce6ff6-790e-4353-af16-67be48d1cf7e admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:12.278536 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c824a3e7-2cf8-483d-ad3e-3ce1f8ca8f92 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '621b6356990d4b53a68b172c81ff982b', 'request_id': 'req-c824a3e7-2cf8-483d-ad3e-3ce1f8ca8f92'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:12.292050 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c824a3e7-2cf8-483d-ad3e-3ce1f8ca8f92 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '621b6356990d4b53a68b172c81ff982b', 'request_id': 'req-c824a3e7-2cf8-483d-ad3e-3ce1f8ca8f92'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:12.313590 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c824a3e7-2cf8-483d-ad3e-3ce1f8ca8f92 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '621b6356990d4b53a68b172c81ff982b', 'request_id': 'req-c824a3e7-2cf8-483d-ad3e-3ce1f8ca8f92'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:12.328401 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-13ce6ff6-790e-4353-af16-67be48d1cf7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0543f1a561a9442cbc9463ab752bd2aa'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:12.335428 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c824a3e7-2cf8-483d-ad3e-3ce1f8ca8f92 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] The token cache is being invalidate because project 621b6356990d4b53a68b172c81ff982b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:27:12.335776 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c824a3e7-2cf8-483d-ad3e-3ce1f8ca8f92 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:12.336662 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c824a3e7-2cf8-483d-ad3e-3ce1f8ca8f92 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:12.339233 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1917/3830] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:27:11 2022] DELETE /identity/v3/projects/621b6356990d4b53a68b172c81ff982b => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:27:12.340682 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d630c7ac-ee3a-4606-8fea-45b185f9c7d1 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:12.341169 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d630c7ac-ee3a-4606-8fea-45b185f9c7d1 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:12.341501 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d630c7ac-ee3a-4606-8fea-45b185f9c7d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:12.352225 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-13ce6ff6-790e-4353-af16-67be48d1cf7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0543f1a561a9442cbc9463ab752bd2aa'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:12.353103 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-13ce6ff6-790e-4353-af16-67be48d1cf7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0543f1a561a9442cbc9463ab752bd2aa'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:12.367435 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-13ce6ff6-790e-4353-af16-67be48d1cf7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0543f1a561a9442cbc9463ab752bd2aa'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:12.368413 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-d630c7ac-ee3a-4606-8fea-45b185f9c7d1 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:27:12.369738 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-d630c7ac-ee3a-4606-8fea-45b185f9c7d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:12.397548 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-13ce6ff6-790e-4353-af16-67be48d1cf7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0543f1a561a9442cbc9463ab752bd2aa'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:12.409891 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1914/3831] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:27:12 2022] DELETE /identity/v3/users/0543f1a561a9442cbc9463ab752bd2aa => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:27:12.410513 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ce6ff6-790e-4353-af16-67be48d1cf7e admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:12.413245 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-13ce6ff6-790e-4353-af16-67be48d1cf7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:12.529255 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ce6ff6-790e-4353-af16-67be48d1cf7e admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:12.538121 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a74a938-b37c-4bb9-a0c3-61203e17753a tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa0c4c841f514431aad18f86024154e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9efb263bab548e7be7c326fcda0cae5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:12.539385 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a74a938-b37c-4bb9-a0c3-61203e17753a tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:12.539819 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a74a938-b37c-4bb9-a0c3-61203e17753a tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:12.540242 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a74a938-b37c-4bb9-a0c3-61203e17753a tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:12.541187 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a74a938-b37c-4bb9-a0c3-61203e17753a tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:12.545008 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a74a938-b37c-4bb9-a0c3-61203e17753a tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:12.566153 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1918/3832] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:27:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:27:12.570593 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d630c7ac-ee3a-4606-8fea-45b185f9c7d1 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:12.577842 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:INSERT=2,keystone:DELETE=10,keystone:SELECT=88 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:27:12.582252 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d630c7ac-ee3a-4606-8fea-45b185f9c7d1 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:12.604306 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1915/3833] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:27:12 2022] POST /identity/v3/projects => generated 359 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:27:12.608987 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a74a938-b37c-4bb9-a0c3-61203e17753a tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:12.667837 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e51eb4c-9a54-4d63-b9a3-cb8afa75ff9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:12.669380 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e51eb4c-9a54-4d63-b9a3-cb8afa75ff9a admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:12.669741 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e51eb4c-9a54-4d63-b9a3-cb8afa75ff9a admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:12.670086 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e51eb4c-9a54-4d63-b9a3-cb8afa75ff9a admin admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:12.671512 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e51eb4c-9a54-4d63-b9a3-cb8afa75ff9a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:27:12.671840 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e51eb4c-9a54-4d63-b9a3-cb8afa75ff9a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:12.673816 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e51eb4c-9a54-4d63-b9a3-cb8afa75ff9a admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:12.690354 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1919/3834] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:27:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:27:12.695474 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e51eb4c-9a54-4d63-b9a3-cb8afa75ff9a admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:12.715566 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:27:12.721327 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e51eb4c-9a54-4d63-b9a3-cb8afa75ff9a admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:12.749172 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a74a938-b37c-4bb9-a0c3-61203e17753a tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:12.756947 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b7e704-b6ec-4127-a58d-c38b329588ec tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa0c4c841f514431aad18f86024154e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9efb263bab548e7be7c326fcda0cae5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:12.758155 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b7e704-b6ec-4127-a58d-c38b329588ec tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:12.758765 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b7e704-b6ec-4127-a58d-c38b329588ec tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:12.758894 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b7e704-b6ec-4127-a58d-c38b329588ec tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:12.759686 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b7e704-b6ec-4127-a58d-c38b329588ec tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:12.761960 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b7e704-b6ec-4127-a58d-c38b329588ec tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:12.801602 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1916/3835] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:27:12 2022] POST /identity/v3/users => generated 417 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:27:12.803214 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b7e704-b6ec-4127-a58d-c38b329588ec tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:12.818499 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b7e704-b6ec-4127-a58d-c38b329588ec tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:12.832227 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1e9984-a606-42f2-ae29-7db3c55d7daf tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa0c4c841f514431aad18f86024154e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9efb263bab548e7be7c326fcda0cae5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:12.833310 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1e9984-a606-42f2-ae29-7db3c55d7daf tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:12.834308 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1e9984-a606-42f2-ae29-7db3c55d7daf tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:12.834553 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1e9984-a606-42f2-ae29-7db3c55d7daf tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:12.835344 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1e9984-a606-42f2-ae29-7db3c55d7daf tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:12.836590 ncdv-master-1 devstack@keystone.service[91547]: WARNING py.warnings [None req-5b1e9984-a606-42f2-ae29-7db3c55d7daf tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:27:12.836590 ncdv-master-1 devstack@keystone.service[91547]: warnings.warn(msg) Jul 23 21:27:12.836590 ncdv-master-1 devstack@keystone.service[91547]: Jul 23 21:27:12.840793 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1e9984-a606-42f2-ae29-7db3c55d7daf tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:12.861490 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc3d1e8-1bbd-47a1-9615-9db3fdd87ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:12.865592 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc3d1e8-1bbd-47a1-9615-9db3fdd87ae4 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:12.866248 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc3d1e8-1bbd-47a1-9615-9db3fdd87ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:12.866736 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc3d1e8-1bbd-47a1-9615-9db3fdd87ae4 admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:12.868666 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc3d1e8-1bbd-47a1-9615-9db3fdd87ae4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:12.884524 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1917/3836] 10.222.0.17 () {60 vars in 1142 bytes} [Sat Jul 23 21:27:12 2022] POST /identity/v3/roles => generated 239 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:27:12.884729 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc3d1e8-1bbd-47a1-9615-9db3fdd87ae4 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:12.884844 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1e9984-a606-42f2-ae29-7db3c55d7daf tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:12.885149 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-5b1e9984-a606-42f2-ae29-7db3c55d7daf tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:12.902385 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1e9984-a606-42f2-ae29-7db3c55d7daf tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:12.908070 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a67da45-3766-4664-bb10-2cebd5007532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:12.909234 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a67da45-3766-4664-bb10-2cebd5007532 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:12.909519 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a67da45-3766-4664-bb10-2cebd5007532 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:12.909978 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a67da45-3766-4664-bb10-2cebd5007532 admin admin] PATH_INFO: `/v3/projects/4d8d306759c447edb6d013cf14ac53f9` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:12.911683 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a67da45-3766-4664-bb10-2cebd5007532 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d8d306759c447edb6d013cf14ac53f9)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:12.913842 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a67da45-3766-4664-bb10-2cebd5007532 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:12.939322 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1920/3837] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:27:12 2022] POST /identity/v3/projects => generated 393 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:27:12.943676 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc3d1e8-1bbd-47a1-9615-9db3fdd87ae4 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:13.017144 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-7a67da45-3766-4664-bb10-2cebd5007532 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d8d306759c447edb6d013cf14ac53f9', 'request_id': 'req-7a67da45-3766-4664-bb10-2cebd5007532'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:13.038644 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-7a67da45-3766-4664-bb10-2cebd5007532 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d8d306759c447edb6d013cf14ac53f9', 'request_id': 'req-7a67da45-3766-4664-bb10-2cebd5007532'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:13.048252 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-7a67da45-3766-4664-bb10-2cebd5007532 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d8d306759c447edb6d013cf14ac53f9', 'request_id': 'req-7a67da45-3766-4664-bb10-2cebd5007532'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:13.063994 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc3d1e8-1bbd-47a1-9615-9db3fdd87ae4 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:13.083681 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-7a67da45-3766-4664-bb10-2cebd5007532 admin admin] The token cache is being invalidate because project 4d8d306759c447edb6d013cf14ac53f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:27:13.083977 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-7a67da45-3766-4664-bb10-2cebd5007532 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:13.084896 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-7a67da45-3766-4664-bb10-2cebd5007532 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:13.088646 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1918/3838] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:27:12 2022] DELETE /identity/v3/projects/4d8d306759c447edb6d013cf14ac53f9 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:27:13.089566 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a67da45-3766-4664-bb10-2cebd5007532 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:13.091057 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-7a67da45-3766-4664-bb10-2cebd5007532 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:13.134954 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:27:13.213817 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a67da45-3766-4664-bb10-2cebd5007532 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:13.215788 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b89ea8-dea1-4ffc-a24c-637d81a5d017 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa0c4c841f514431aad18f86024154e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9efb263bab548e7be7c326fcda0cae5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:13.217516 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b89ea8-dea1-4ffc-a24c-637d81a5d017 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:13.217757 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b89ea8-dea1-4ffc-a24c-637d81a5d017 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:13.218061 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b89ea8-dea1-4ffc-a24c-637d81a5d017 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] PATH_INFO: `/v3/users/ee5f8e223e214777b4ef5af946783bb3` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:13.219364 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb89755-5481-4ab7-a39e-4963bbb64be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:13.220319 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb89755-5481-4ab7-a39e-4963bbb64be3 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:13.222080 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb89755-5481-4ab7-a39e-4963bbb64be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:13.222462 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb89755-5481-4ab7-a39e-4963bbb64be3 admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:13.223267 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb89755-5481-4ab7-a39e-4963bbb64be3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:13.225772 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb89755-5481-4ab7-a39e-4963bbb64be3 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:13.290550 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1919/3839] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:27:13 2022] POST /identity/v3/users => generated 297 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:27:13.290705 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b89ea8-dea1-4ffc-a24c-637d81a5d017 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] RBAC: Authorizing `identity:get_user(user_id=ee5f8e223e214777b4ef5af946783bb3)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:13.290854 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f14e63-64ba-43bb-a4cc-d40e5b5b8d23 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:13.290854 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f14e63-64ba-43bb-a4cc-d40e5b5b8d23 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:13.290854 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f14e63-64ba-43bb-a4cc-d40e5b5b8d23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:13.291092 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b89ea8-dea1-4ffc-a24c-637d81a5d017 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:13.293281 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1921/3840] 10.222.0.17 () {58 vars in 1220 bytes} [Sat Jul 23 21:27:12 2022] GET /identity/v3/users/ee5f8e223e214777b4ef5af946783bb3 => generated 417 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:27:13.294496 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b89ea8-dea1-4ffc-a24c-637d81a5d017 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:13.318731 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b89ea8-dea1-4ffc-a24c-637d81a5d017 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:13.328155 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efd32b1-9f12-4130-8b8f-aca19fec9850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:13.328850 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efd32b1-9f12-4130-8b8f-aca19fec9850 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:13.329129 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efd32b1-9f12-4130-8b8f-aca19fec9850 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:13.329416 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efd32b1-9f12-4130-8b8f-aca19fec9850 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:13.330160 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efd32b1-9f12-4130-8b8f-aca19fec9850 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:13.331833 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efd32b1-9f12-4130-8b8f-aca19fec9850 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:13.335982 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-87f14e63-64ba-43bb-a4cc-d40e5b5b8d23 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:27:13.337453 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-87f14e63-64ba-43bb-a4cc-d40e5b5b8d23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:13.346808 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1920/3841] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:27:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:27:13.348093 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f14e63-64ba-43bb-a4cc-d40e5b5b8d23 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:13.349747 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-87f14e63-64ba-43bb-a4cc-d40e5b5b8d23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:13.351662 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1922/3842] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:27:13 2022] GET /identity/v3/roles => generated 1650 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:27:13.367787 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f14e63-64ba-43bb-a4cc-d40e5b5b8d23 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:13.369254 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaaea79-94a8-4eb9-ac2c-b0694824cc1d None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:13.370112 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaaea79-94a8-4eb9-ac2c-b0694824cc1d None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:13.370486 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaaea79-94a8-4eb9-ac2c-b0694824cc1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:13.375753 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1911fe-ac90-4b6e-b729-b20f5fdef7d6 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa0c4c841f514431aad18f86024154e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9efb263bab548e7be7c326fcda0cae5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:13.376789 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1911fe-ac90-4b6e-b729-b20f5fdef7d6 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:13.377136 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1911fe-ac90-4b6e-b729-b20f5fdef7d6 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:13.377480 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1911fe-ac90-4b6e-b729-b20f5fdef7d6 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] PATH_INFO: `/v3/roles/7b53fc856cbc4dabb7e7030397ae2220` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:13.379147 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1911fe-ac90-4b6e-b729-b20f5fdef7d6 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] RBAC: Authorizing `identity:get_role(role_id=7b53fc856cbc4dabb7e7030397ae2220)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:13.380419 ncdv-master-1 devstack@keystone.service[91547]: WARNING py.warnings [None req-dc1911fe-ac90-4b6e-b729-b20f5fdef7d6 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:27:13.380419 ncdv-master-1 devstack@keystone.service[91547]: warnings.warn(msg) Jul 23 21:27:13.380419 ncdv-master-1 devstack@keystone.service[91547]: Jul 23 21:27:13.381472 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1911fe-ac90-4b6e-b729-b20f5fdef7d6 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:13.383038 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1921/3843] 10.222.0.17 () {58 vars in 1220 bytes} [Sat Jul 23 21:27:13 2022] GET /identity/v3/roles/7b53fc856cbc4dabb7e7030397ae2220 => generated 239 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:27:13.383976 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1911fe-ac90-4b6e-b729-b20f5fdef7d6 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:13.399894 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1911fe-ac90-4b6e-b729-b20f5fdef7d6 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:13.406586 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c7c074-1c1b-4295-a0c5-9287ad09e389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:13.407353 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c7c074-1c1b-4295-a0c5-9287ad09e389 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:13.407688 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c7c074-1c1b-4295-a0c5-9287ad09e389 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:13.408105 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c7c074-1c1b-4295-a0c5-9287ad09e389 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:13.409024 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c7c074-1c1b-4295-a0c5-9287ad09e389 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:13.410835 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c7c074-1c1b-4295-a0c5-9287ad09e389 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:13.418573 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-caaaea79-94a8-4eb9-ac2c-b0694824cc1d None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:27:13.419853 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-caaaea79-94a8-4eb9-ac2c-b0694824cc1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:13.427317 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1922/3844] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:27:13 2022] GET /identity/v3/roles => generated 1650 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:27:13.428256 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c7c074-1c1b-4295-a0c5-9287ad09e389 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:13.431700 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1923/3845] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:27:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:27:13.432531 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaaea79-94a8-4eb9-ac2c-b0694824cc1d None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:13.435806 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=85,keystone:INSERT=8,keystone:DELETE=7 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:27:13.443306 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaaea79-94a8-4eb9-ac2c-b0694824cc1d None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:13.444176 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c7c074-1c1b-4295-a0c5-9287ad09e389 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:13.448140 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b86e6bc-f79e-45d5-ae11-893b844ce20f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:13.449207 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b86e6bc-f79e-45d5-ae11-893b844ce20f admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:13.449487 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b86e6bc-f79e-45d5-ae11-893b844ce20f admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:13.449795 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b86e6bc-f79e-45d5-ae11-893b844ce20f admin admin] PATH_INFO: `/v3/projects/2b46cc4b1ef64d168bf4184339de54d2/users/e11fb79c253c4a0f955d710ff4626f6d/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:13.451094 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea907ca-ab47-46d9-ad94-146553a1c347 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa0c4c841f514431aad18f86024154e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9efb263bab548e7be7c326fcda0cae5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:13.452257 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea907ca-ab47-46d9-ad94-146553a1c347 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:13.452575 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea907ca-ab47-46d9-ad94-146553a1c347 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:13.452862 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea907ca-ab47-46d9-ad94-146553a1c347 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:13.454352 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea907ca-ab47-46d9-ad94-146553a1c347 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:13.457667 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea907ca-ab47-46d9-ad94-146553a1c347 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:13.468054 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b86e6bc-f79e-45d5-ae11-893b844ce20f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b46cc4b1ef64d168bf4184339de54d2, user_id=e11fb79c253c4a0f955d710ff4626f6d, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:13.470767 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b86e6bc-f79e-45d5-ae11-893b844ce20f admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:13.487079 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1924/3846] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:27:13 2022] PUT /identity/v3/projects/2b46cc4b1ef64d168bf4184339de54d2/users/e11fb79c253c4a0f955d710ff4626f6d/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:27:13.488533 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b86e6bc-f79e-45d5-ae11-893b844ce20f admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:13.494591 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1923/3847] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:27:13 2022] POST /identity/v3/projects => generated 359 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:27:13.495894 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a31fc8-4cb1-4375-bac7-184a40a9d85e None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:13.496166 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a31fc8-4cb1-4375-bac7-184a40a9d85e None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:13.496448 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a31fc8-4cb1-4375-bac7-184a40a9d85e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:13.534111 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-53a31fc8-4cb1-4375-bac7-184a40a9d85e None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:27:13.536009 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-53a31fc8-4cb1-4375-bac7-184a40a9d85e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:13.589418 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b86e6bc-f79e-45d5-ae11-893b844ce20f admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:13.614007 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1924/3848] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:27:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:27:13.615354 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a31fc8-4cb1-4375-bac7-184a40a9d85e None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:13.673066 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0538a18-4f8f-45c5-b7af-5a3bc2123e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:13.673940 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0538a18-4f8f-45c5-b7af-5a3bc2123e15 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:13.674322 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0538a18-4f8f-45c5-b7af-5a3bc2123e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:13.675113 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0538a18-4f8f-45c5-b7af-5a3bc2123e15 admin admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:13.677236 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0538a18-4f8f-45c5-b7af-5a3bc2123e15 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:27:13.678282 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0538a18-4f8f-45c5-b7af-5a3bc2123e15 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:13.680394 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0538a18-4f8f-45c5-b7af-5a3bc2123e15 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:13.693730 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1925/3849] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:27:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:27:13.694835 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0538a18-4f8f-45c5-b7af-5a3bc2123e15 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:13.696622 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-a0538a18-4f8f-45c5-b7af-5a3bc2123e15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:13.727270 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a31fc8-4cb1-4375-bac7-184a40a9d85e None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:13.739014 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb6f528-7e7b-4732-b58f-9c6d2d1ffbda tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa0c4c841f514431aad18f86024154e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9efb263bab548e7be7c326fcda0cae5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:13.741190 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb6f528-7e7b-4732-b58f-9c6d2d1ffbda tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:13.741646 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb6f528-7e7b-4732-b58f-9c6d2d1ffbda tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:13.741949 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb6f528-7e7b-4732-b58f-9c6d2d1ffbda tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] PATH_INFO: `/v3/projects/b2435ce3ad50484c94af87bfc99adadf` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:13.743810 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:27:13.744030 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb6f528-7e7b-4732-b58f-9c6d2d1ffbda tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] RBAC: Authorizing `identity:get_project(project_id=b2435ce3ad50484c94af87bfc99adadf)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:13.747701 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb6f528-7e7b-4732-b58f-9c6d2d1ffbda tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:13.756734 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1925/3850] 10.222.0.17 () {58 vars in 1229 bytes} [Sat Jul 23 21:27:13 2022] GET /identity/v3/projects/b2435ce3ad50484c94af87bfc99adadf => generated 359 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:27:13.757725 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb6f528-7e7b-4732-b58f-9c6d2d1ffbda tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:13.762475 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-2cb6f528-7e7b-4732-b58f-9c6d2d1ffbda tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:13.781637 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0538a18-4f8f-45c5-b7af-5a3bc2123e15 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:13.785451 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a38a7d-6ce3-4082-99e2-71d630f7b62e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec5fd3a489c341b7964704d689037f05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:13.786143 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a38a7d-6ce3-4082-99e2-71d630f7b62e service cinder] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:13.786525 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a38a7d-6ce3-4082-99e2-71d630f7b62e service cinder] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:13.786757 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a38a7d-6ce3-4082-99e2-71d630f7b62e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:13.788625 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-32a38a7d-6ce3-4082-99e2-71d630f7b62e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:13.849567 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb6f528-7e7b-4732-b58f-9c6d2d1ffbda tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:13.858362 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc36dc31-da7a-4690-853a-3cd7f3ae9de8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:13.859308 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc36dc31-da7a-4690-853a-3cd7f3ae9de8 service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:13.860247 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc36dc31-da7a-4690-853a-3cd7f3ae9de8 service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:13.860737 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc36dc31-da7a-4690-853a-3cd7f3ae9de8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:13.873798 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc36dc31-da7a-4690-853a-3cd7f3ae9de8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:13.875578 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc36dc31-da7a-4690-853a-3cd7f3ae9de8 service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:13.889385 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1926/3851] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:27:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:27:13.890558 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc36dc31-da7a-4690-853a-3cd7f3ae9de8 service neutron] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:13.898620 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a38a7d-6ce3-4082-99e2-71d630f7b62e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:13.900617 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a38a7d-6ce3-4082-99e2-71d630f7b62e service cinder] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:13.901220 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc36dc31-da7a-4690-853a-3cd7f3ae9de8 service neutron] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:13.907336 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c0ff1f-351e-45b0-8ae0-d51f8be1de33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:13.908010 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c0ff1f-351e-45b0-8ae0-d51f8be1de33 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:13.908288 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c0ff1f-351e-45b0-8ae0-d51f8be1de33 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:13.908557 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c0ff1f-351e-45b0-8ae0-d51f8be1de33 admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:13.909245 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c0ff1f-351e-45b0-8ae0-d51f8be1de33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:13.914107 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c0ff1f-351e-45b0-8ae0-d51f8be1de33 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:13.914600 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1926/3852] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:27:13 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:27:13.917227 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a38a7d-6ce3-4082-99e2-71d630f7b62e service cinder] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:13.937356 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a38a7d-6ce3-4082-99e2-71d630f7b62e service cinder] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:13.939289 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c847722-476b-40d9-82d6-5740d31f9bb5 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa0c4c841f514431aad18f86024154e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9efb263bab548e7be7c326fcda0cae5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:13.940209 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c847722-476b-40d9-82d6-5740d31f9bb5 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:13.940713 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c847722-476b-40d9-82d6-5740d31f9bb5 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:13.940821 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c847722-476b-40d9-82d6-5740d31f9bb5 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] PATH_INFO: `/v3/projects/b2435ce3ad50484c94af87bfc99adadf/users/ee5f8e223e214777b4ef5af946783bb3/roles/7b53fc856cbc4dabb7e7030397ae2220` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:13.943192 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c847722-476b-40d9-82d6-5740d31f9bb5 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] RBAC: Authorizing `identity:create_grant(project_id=b2435ce3ad50484c94af87bfc99adadf, user_id=ee5f8e223e214777b4ef5af946783bb3, role_id=7b53fc856cbc4dabb7e7030397ae2220)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:13.946079 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c847722-476b-40d9-82d6-5740d31f9bb5 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:13.971679 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1927/3853] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:27:13 2022] PUT /identity/v3/projects/b2435ce3ad50484c94af87bfc99adadf/users/ee5f8e223e214777b4ef5af946783bb3/roles/7b53fc856cbc4dabb7e7030397ae2220 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:27:13.972784 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c847722-476b-40d9-82d6-5740d31f9bb5 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:13.993046 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1927/3854] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:27:13 2022] POST /identity/v3/projects => generated 377 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:27:13.994224 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c0ff1f-351e-45b0-8ae0-d51f8be1de33 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:14.001364 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:27:14.054084 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c847722-476b-40d9-82d6-5740d31f9bb5 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:14.124781 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b707cc-4271-48f6-a13c-25ea323b3c17 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa0c4c841f514431aad18f86024154e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9efb263bab548e7be7c326fcda0cae5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:14.126361 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b707cc-4271-48f6-a13c-25ea323b3c17 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:14.126808 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b707cc-4271-48f6-a13c-25ea323b3c17 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:14.127276 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b707cc-4271-48f6-a13c-25ea323b3c17 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:14.128126 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b707cc-4271-48f6-a13c-25ea323b3c17 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:14.130305 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b707cc-4271-48f6-a13c-25ea323b3c17 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:14.135834 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c0ff1f-351e-45b0-8ae0-d51f8be1de33 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:14.144114 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419f0591-43bb-4eef-960a-611296307800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:14.145200 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419f0591-43bb-4eef-960a-611296307800 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:14.146826 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419f0591-43bb-4eef-960a-611296307800 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:14.147268 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419f0591-43bb-4eef-960a-611296307800 admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:14.149135 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419f0591-43bb-4eef-960a-611296307800 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:14.152331 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419f0591-43bb-4eef-960a-611296307800 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:14.163986 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:27:14.189958 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1928/3856] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:27:13 2022] POST /identity/v3/projects => generated 358 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:27:14.190300 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1928/3856] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:27:13 2022] POST /identity/v3/users => generated 289 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:27:14.191379 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419f0591-43bb-4eef-960a-611296307800 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:14.191725 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b707cc-4271-48f6-a13c-25ea323b3c17 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:14.205316 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419f0591-43bb-4eef-960a-611296307800 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:14.293184 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b707cc-4271-48f6-a13c-25ea323b3c17 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:14.302717 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6ff6bc-78cf-4466-a7cf-5e2ddc906314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:14.303484 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6ff6bc-78cf-4466-a7cf-5e2ddc906314 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:14.303843 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6ff6bc-78cf-4466-a7cf-5e2ddc906314 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:14.304093 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6ff6bc-78cf-4466-a7cf-5e2ddc906314 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:14.306168 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6ff6bc-78cf-4466-a7cf-5e2ddc906314 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:14.308508 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6ff6bc-78cf-4466-a7cf-5e2ddc906314 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:14.332198 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1929/3857] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:27:14 2022] GET /identity/v3/roles => generated 1650 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:27:14.336966 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6ff6bc-78cf-4466-a7cf-5e2ddc906314 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:14.352460 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b76ae1-aa45-4b99-8298-342c77e3f933 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa0c4c841f514431aad18f86024154e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9efb263bab548e7be7c326fcda0cae5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:14.353515 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b76ae1-aa45-4b99-8298-342c77e3f933 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:14.354001 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b76ae1-aa45-4b99-8298-342c77e3f933 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:14.354375 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b76ae1-aa45-4b99-8298-342c77e3f933 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] PATH_INFO: `/v3/projects/ccd87d2847bf4a3cb12c3bd087f1d8db` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:14.355867 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b76ae1-aa45-4b99-8298-342c77e3f933 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] RBAC: Authorizing `identity:get_project(project_id=ccd87d2847bf4a3cb12c3bd087f1d8db)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:14.358392 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6ff6bc-78cf-4466-a7cf-5e2ddc906314 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:14.360808 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b76ae1-aa45-4b99-8298-342c77e3f933 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:14.364113 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1929/3858] 10.222.0.17 () {58 vars in 1229 bytes} [Sat Jul 23 21:27:14 2022] GET /identity/v3/projects/ccd87d2847bf4a3cb12c3bd087f1d8db => generated 358 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:27:14.370373 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b76ae1-aa45-4b99-8298-342c77e3f933 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:14.373276 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d88a545-120f-46f7-b05a-f4d2397083a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:14.374073 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d88a545-120f-46f7-b05a-f4d2397083a6 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:14.374353 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d88a545-120f-46f7-b05a-f4d2397083a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:14.374625 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d88a545-120f-46f7-b05a-f4d2397083a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:14.375371 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d88a545-120f-46f7-b05a-f4d2397083a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:14.376987 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d88a545-120f-46f7-b05a-f4d2397083a6 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:14.390578 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1930/3859] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:27:14 2022] GET /identity/v3/roles => generated 1650 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:27:14.394545 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d88a545-120f-46f7-b05a-f4d2397083a6 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:14.406537 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b76ae1-aa45-4b99-8298-342c77e3f933 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:14.413855 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d88a545-120f-46f7-b05a-f4d2397083a6 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:14.416987 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878997ba-fc4c-4288-9ced-d4463f705f2c tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa0c4c841f514431aad18f86024154e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9efb263bab548e7be7c326fcda0cae5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:14.418408 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878997ba-fc4c-4288-9ced-d4463f705f2c tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:14.418692 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878997ba-fc4c-4288-9ced-d4463f705f2c tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:14.418972 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878997ba-fc4c-4288-9ced-d4463f705f2c tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] PATH_INFO: `/v3/projects/ccd87d2847bf4a3cb12c3bd087f1d8db/users/ee5f8e223e214777b4ef5af946783bb3/roles/7b53fc856cbc4dabb7e7030397ae2220` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:14.422639 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878997ba-fc4c-4288-9ced-d4463f705f2c tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] RBAC: Authorizing `identity:create_grant(project_id=ccd87d2847bf4a3cb12c3bd087f1d8db, user_id=ee5f8e223e214777b4ef5af946783bb3, role_id=7b53fc856cbc4dabb7e7030397ae2220)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:14.425470 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878997ba-fc4c-4288-9ced-d4463f705f2c tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:14.430296 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09402a5c-d234-4ed6-95be-af2ccdb2c9f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:14.431313 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09402a5c-d234-4ed6-95be-af2ccdb2c9f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:14.431706 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09402a5c-d234-4ed6-95be-af2ccdb2c9f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:14.432064 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09402a5c-d234-4ed6-95be-af2ccdb2c9f2 admin admin] PATH_INFO: `/v3/projects/7a91417f3a6b47c7b1acc77c350a6aa2/users/dffbe88f71ae4f2180f89d18f234a016/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:14.456062 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1930/3860] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:27:14 2022] PUT /identity/v3/projects/ccd87d2847bf4a3cb12c3bd087f1d8db/users/ee5f8e223e214777b4ef5af946783bb3/roles/7b53fc856cbc4dabb7e7030397ae2220 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:27:14.460611 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878997ba-fc4c-4288-9ced-d4463f705f2c tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:14.465487 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09402a5c-d234-4ed6-95be-af2ccdb2c9f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a91417f3a6b47c7b1acc77c350a6aa2, user_id=dffbe88f71ae4f2180f89d18f234a016, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:14.472627 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09402a5c-d234-4ed6-95be-af2ccdb2c9f2 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:14.501016 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1931/3861] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:27:14 2022] PUT /identity/v3/projects/7a91417f3a6b47c7b1acc77c350a6aa2/users/dffbe88f71ae4f2180f89d18f234a016/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:27:14.512607 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a1f4c6-fc40-43d3-88b5-470dab362536 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:14.513288 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a1f4c6-fc40-43d3-88b5-470dab362536 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:14.513652 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a1f4c6-fc40-43d3-88b5-470dab362536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:14.567135 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-02a1f4c6-fc40-43d3-88b5-470dab362536 None None] MFA Rules not processed for user `dffbe88f71ae4f2180f89d18f234a016`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:27:14.570687 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-02a1f4c6-fc40-43d3-88b5-470dab362536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:14.591384 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878997ba-fc4c-4288-9ced-d4463f705f2c tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:14.693090 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:27:14.752669 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63929fe4-f599-4d83-935d-e349c1493dec tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa0c4c841f514431aad18f86024154e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9efb263bab548e7be7c326fcda0cae5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:14.753585 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63929fe4-f599-4d83-935d-e349c1493dec tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:14.753876 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63929fe4-f599-4d83-935d-e349c1493dec tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:14.754799 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63929fe4-f599-4d83-935d-e349c1493dec tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] PATH_INFO: `/v3/users/ee5f8e223e214777b4ef5af946783bb3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:14.757494 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1932/3862] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:27:14 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:27:14.758481 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63929fe4-f599-4d83-935d-e349c1493dec tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] RBAC: Authorizing `identity:list_user_projects(user_id=ee5f8e223e214777b4ef5af946783bb3)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:14.760783 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63929fe4-f599-4d83-935d-e349c1493dec tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:14.770888 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86170a9-eabc-4435-880d-e609177fbb24 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:14.771730 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86170a9-eabc-4435-880d-e609177fbb24 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:14.772420 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86170a9-eabc-4435-880d-e609177fbb24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:14.814246 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-f86170a9-eabc-4435-880d-e609177fbb24 None None] MFA Rules not processed for user `dffbe88f71ae4f2180f89d18f234a016`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:27:14.816802 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-f86170a9-eabc-4435-880d-e609177fbb24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:14.840632 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1933/3863] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:27:14 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:27:14.882332 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1931/3864] 10.222.0.17 () {58 vars in 1247 bytes} [Sat Jul 23 21:27:14 2022] GET /identity/v3/users/ee5f8e223e214777b4ef5af946783bb3/projects => generated 841 bytes in 422 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:27:14.886940 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86170a9-eabc-4435-880d-e609177fbb24 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:14.900113 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86170a9-eabc-4435-880d-e609177fbb24 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:14.905174 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea65a8af-8630-44e3-a965-e1527078ae4c tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa0c4c841f514431aad18f86024154e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9efb263bab548e7be7c326fcda0cae5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:14.906119 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea65a8af-8630-44e3-a965-e1527078ae4c tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:14.906397 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea65a8af-8630-44e3-a965-e1527078ae4c tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:14.906670 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea65a8af-8630-44e3-a965-e1527078ae4c tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] PATH_INFO: `/v3/projects/ccd87d2847bf4a3cb12c3bd087f1d8db` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:14.912843 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea65a8af-8630-44e3-a965-e1527078ae4c tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] RBAC: Authorizing `identity:delete_project(project_id=ccd87d2847bf4a3cb12c3bd087f1d8db)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:14.914976 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea65a8af-8630-44e3-a965-e1527078ae4c tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:15.019375 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63929fe4-f599-4d83-935d-e349c1493dec tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:15.021969 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-63929fe4-f599-4d83-935d-e349c1493dec tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:15.058206 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:27:15.073202 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-ea65a8af-8630-44e3-a965-e1527078ae4c tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccd87d2847bf4a3cb12c3bd087f1d8db', 'request_id': 'req-ea65a8af-8630-44e3-a965-e1527078ae4c'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:15.104590 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-ea65a8af-8630-44e3-a965-e1527078ae4c tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccd87d2847bf4a3cb12c3bd087f1d8db', 'request_id': 'req-ea65a8af-8630-44e3-a965-e1527078ae4c'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:15.112842 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-ea65a8af-8630-44e3-a965-e1527078ae4c tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccd87d2847bf4a3cb12c3bd087f1d8db', 'request_id': 'req-ea65a8af-8630-44e3-a965-e1527078ae4c'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:15.131388 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-ea65a8af-8630-44e3-a965-e1527078ae4c tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] The token cache is being invalidate because project ccd87d2847bf4a3cb12c3bd087f1d8db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:27:15.131688 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-ea65a8af-8630-44e3-a965-e1527078ae4c tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:15.132671 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-ea65a8af-8630-44e3-a965-e1527078ae4c tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:15.138180 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1934/3865] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:27:14 2022] DELETE /identity/v3/projects/ccd87d2847bf4a3cb12c3bd087f1d8db => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:27:15.139433 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea65a8af-8630-44e3-a965-e1527078ae4c tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:15.144496 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-ea65a8af-8630-44e3-a965-e1527078ae4c tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:15.196401 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63929fe4-f599-4d83-935d-e349c1493dec tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:15.263786 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea65a8af-8630-44e3-a965-e1527078ae4c tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:15.272451 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca626b2-3770-4811-b33e-30988435f4b1 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa0c4c841f514431aad18f86024154e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9efb263bab548e7be7c326fcda0cae5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:15.274419 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca626b2-3770-4811-b33e-30988435f4b1 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:15.276001 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca626b2-3770-4811-b33e-30988435f4b1 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:15.276364 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca626b2-3770-4811-b33e-30988435f4b1 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] PATH_INFO: `/v3/projects/b2435ce3ad50484c94af87bfc99adadf` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:15.278321 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca626b2-3770-4811-b33e-30988435f4b1 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b2435ce3ad50484c94af87bfc99adadf)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:15.283848 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca626b2-3770-4811-b33e-30988435f4b1 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:15.369618 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932cedbb-4fc3-4be5-af27-b8b80aa9b3b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:15.370840 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932cedbb-4fc3-4be5-af27-b8b80aa9b3b3 service nova] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:15.373341 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932cedbb-4fc3-4be5-af27-b8b80aa9b3b3 service nova] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:15.376301 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932cedbb-4fc3-4be5-af27-b8b80aa9b3b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:15.384736 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-932cedbb-4fc3-4be5-af27-b8b80aa9b3b3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:15.429733 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-fca626b2-3770-4811-b33e-30988435f4b1 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2435ce3ad50484c94af87bfc99adadf', 'request_id': 'req-fca626b2-3770-4811-b33e-30988435f4b1'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:15.461373 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-fca626b2-3770-4811-b33e-30988435f4b1 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2435ce3ad50484c94af87bfc99adadf', 'request_id': 'req-fca626b2-3770-4811-b33e-30988435f4b1'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:15.471270 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-fca626b2-3770-4811-b33e-30988435f4b1 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2435ce3ad50484c94af87bfc99adadf', 'request_id': 'req-fca626b2-3770-4811-b33e-30988435f4b1'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:15.492940 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-fca626b2-3770-4811-b33e-30988435f4b1 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] The token cache is being invalidate because project b2435ce3ad50484c94af87bfc99adadf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:27:15.493200 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-fca626b2-3770-4811-b33e-30988435f4b1 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:15.494040 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-fca626b2-3770-4811-b33e-30988435f4b1 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:15.495134 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:27:15.500284 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1935/3866] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:27:15 2022] DELETE /identity/v3/projects/b2435ce3ad50484c94af87bfc99adadf => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:27:15.501596 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca626b2-3770-4811-b33e-30988435f4b1 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:15.510266 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-fca626b2-3770-4811-b33e-30988435f4b1 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:15.557160 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932cedbb-4fc3-4be5-af27-b8b80aa9b3b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:15.558892 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932cedbb-4fc3-4be5-af27-b8b80aa9b3b3 service nova] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:15.596119 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1932/3867] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:27:15 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 577 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:27:15.631808 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:27:15.655372 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca626b2-3770-4811-b33e-30988435f4b1 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:15.668168 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cc885f-174a-4ecb-8918-dea2eb1e7e6a tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa0c4c841f514431aad18f86024154e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9efb263bab548e7be7c326fcda0cae5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:15.669056 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cc885f-174a-4ecb-8918-dea2eb1e7e6a tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:15.669366 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cc885f-174a-4ecb-8918-dea2eb1e7e6a tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:15.669635 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cc885f-174a-4ecb-8918-dea2eb1e7e6a tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] PATH_INFO: `/v3/roles/7b53fc856cbc4dabb7e7030397ae2220` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:15.672179 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cc885f-174a-4ecb-8918-dea2eb1e7e6a tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] RBAC: Authorizing `identity:delete_role(role_id=7b53fc856cbc4dabb7e7030397ae2220)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:15.673245 ncdv-master-1 devstack@keystone.service[91548]: WARNING py.warnings [None req-69cc885f-174a-4ecb-8918-dea2eb1e7e6a tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:27:15.673245 ncdv-master-1 devstack@keystone.service[91548]: warnings.warn(msg) Jul 23 21:27:15.673245 ncdv-master-1 devstack@keystone.service[91548]: Jul 23 21:27:15.674136 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cc885f-174a-4ecb-8918-dea2eb1e7e6a tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:15.753167 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-69cc885f-174a-4ecb-8918-dea2eb1e7e6a tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] Invalidating the token cache because role 7b53fc856cbc4dabb7e7030397ae2220 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:27:15.753756 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-69cc885f-174a-4ecb-8918-dea2eb1e7e6a tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:15.754832 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-69cc885f-174a-4ecb-8918-dea2eb1e7e6a tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:15.759899 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1936/3868] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:27:15 2022] DELETE /identity/v3/roles/7b53fc856cbc4dabb7e7030397ae2220 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:27:15.763945 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932cedbb-4fc3-4be5-af27-b8b80aa9b3b3 service nova] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:15.784233 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932cedbb-4fc3-4be5-af27-b8b80aa9b3b3 service nova] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:15.943449 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6ed81f-13a2-4816-a297-bf9507240587 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa0c4c841f514431aad18f86024154e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9efb263bab548e7be7c326fcda0cae5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:15.944368 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6ed81f-13a2-4816-a297-bf9507240587 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:15.944650 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6ed81f-13a2-4816-a297-bf9507240587 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:15.944922 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6ed81f-13a2-4816-a297-bf9507240587 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] PATH_INFO: `/v3/users/ee5f8e223e214777b4ef5af946783bb3` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:15.947281 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6ed81f-13a2-4816-a297-bf9507240587 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] RBAC: Authorizing `identity:delete_user(user_id=ee5f8e223e214777b4ef5af946783bb3)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:15.949248 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6ed81f-13a2-4816-a297-bf9507240587 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:16.059264 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-bf6ed81f-13a2-4816-a297-bf9507240587 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee5f8e223e214777b4ef5af946783bb3'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:16.070723 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-bf6ed81f-13a2-4816-a297-bf9507240587 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee5f8e223e214777b4ef5af946783bb3'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:16.071591 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-bf6ed81f-13a2-4816-a297-bf9507240587 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee5f8e223e214777b4ef5af946783bb3'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:16.088423 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-bf6ed81f-13a2-4816-a297-bf9507240587 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee5f8e223e214777b4ef5af946783bb3'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:16.110988 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-bf6ed81f-13a2-4816-a297-bf9507240587 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee5f8e223e214777b4ef5af946783bb3'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:16.122836 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1933/3869] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:27:15 2022] DELETE /identity/v3/users/ee5f8e223e214777b4ef5af946783bb3 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:27:16.128027 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cc885f-174a-4ecb-8918-dea2eb1e7e6a tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:16.130434 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-69cc885f-174a-4ecb-8918-dea2eb1e7e6a tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:16.157585 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cc885f-174a-4ecb-8918-dea2eb1e7e6a tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:16.335487 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f5133a-abda-4d98-b83f-3f001b08c885 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa0c4c841f514431aad18f86024154e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9efb263bab548e7be7c326fcda0cae5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:16.336400 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f5133a-abda-4d98-b83f-3f001b08c885 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:16.336683 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f5133a-abda-4d98-b83f-3f001b08c885 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:16.337071 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f5133a-abda-4d98-b83f-3f001b08c885 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] PATH_INFO: `/v3/projects/2c52069995c5445ab3641b7de758970d` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:16.340022 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f5133a-abda-4d98-b83f-3f001b08c885 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] RBAC: Authorizing `identity:delete_project(project_id=2c52069995c5445ab3641b7de758970d)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:16.342684 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f5133a-abda-4d98-b83f-3f001b08c885 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:16.512186 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-e9f5133a-abda-4d98-b83f-3f001b08c885 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c52069995c5445ab3641b7de758970d', 'request_id': 'req-e9f5133a-abda-4d98-b83f-3f001b08c885'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:16.528159 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-e9f5133a-abda-4d98-b83f-3f001b08c885 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c52069995c5445ab3641b7de758970d', 'request_id': 'req-e9f5133a-abda-4d98-b83f-3f001b08c885'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:16.535702 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-e9f5133a-abda-4d98-b83f-3f001b08c885 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c52069995c5445ab3641b7de758970d', 'request_id': 'req-e9f5133a-abda-4d98-b83f-3f001b08c885'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:16.561174 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-e9f5133a-abda-4d98-b83f-3f001b08c885 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] The token cache is being invalidate because project 2c52069995c5445ab3641b7de758970d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:27:16.561484 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-e9f5133a-abda-4d98-b83f-3f001b08c885 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:16.565527 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-e9f5133a-abda-4d98-b83f-3f001b08c885 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:16.579693 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1937/3870] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:27:16 2022] DELETE /identity/v3/projects/2c52069995c5445ab3641b7de758970d => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:27:16.580602 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6ed81f-13a2-4816-a297-bf9507240587 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:16.582180 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-bf6ed81f-13a2-4816-a297-bf9507240587 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:16.627913 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6ed81f-13a2-4816-a297-bf9507240587 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:16.766502 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:27:16.783554 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb2d078-f0cb-4b4d-b3ec-8befa92fd131 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa0c4c841f514431aad18f86024154e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9efb263bab548e7be7c326fcda0cae5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:16.785151 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb2d078-f0cb-4b4d-b3ec-8befa92fd131 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:16.785648 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb2d078-f0cb-4b4d-b3ec-8befa92fd131 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:16.786736 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb2d078-f0cb-4b4d-b3ec-8befa92fd131 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] PATH_INFO: `/v3/users/332b15ae4121497c8cc6c8fd5f485825` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:16.789383 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb2d078-f0cb-4b4d-b3ec-8befa92fd131 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] RBAC: Authorizing `identity:update_user(user_id=332b15ae4121497c8cc6c8fd5f485825)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:16.792882 ncdv-master-1 devstack@keystone.service[91547]: WARNING py.warnings [None req-3eb2d078-f0cb-4b4d-b3ec-8befa92fd131 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:27:16.792882 ncdv-master-1 devstack@keystone.service[91547]: warnings.warn(msg) Jul 23 21:27:16.792882 ncdv-master-1 devstack@keystone.service[91547]: Jul 23 21:27:16.796256 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb2d078-f0cb-4b4d-b3ec-8befa92fd131 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:16.867778 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-3eb2d078-f0cb-4b4d-b3ec-8befa92fd131 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '332b15ae4121497c8cc6c8fd5f485825'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:16.878854 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-3eb2d078-f0cb-4b4d-b3ec-8befa92fd131 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] Invalidating the token cache because user 332b15ae4121497c8cc6c8fd5f485825 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:27:16.879476 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-3eb2d078-f0cb-4b4d-b3ec-8befa92fd131 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:16.880363 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-3eb2d078-f0cb-4b4d-b3ec-8befa92fd131 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:16.893142 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1934/3871] 10.222.0.17 () {60 vars in 1242 bytes} [Sat Jul 23 21:27:16 2022] PATCH /identity/v3/users/332b15ae4121497c8cc6c8fd5f485825 => generated 296 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 21:27:16.898750 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0065d8-d781-4795-b029-ccf868322960 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:16.899287 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0065d8-d781-4795-b029-ccf868322960 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:16.899379 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0065d8-d781-4795-b029-ccf868322960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:16.964742 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-dc0065d8-d781-4795-b029-ccf868322960 None None] MFA Rules not processed for user `332b15ae4121497c8cc6c8fd5f485825`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:27:16.966434 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-dc0065d8-d781-4795-b029-ccf868322960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:16.971191 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1938/3872] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:27:16 2022] POST /identity/v3/auth/tokens => generated 348 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 23 21:27:16.975592 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb2d078-f0cb-4b4d-b3ec-8befa92fd131 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:16.977392 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-3eb2d078-f0cb-4b4d-b3ec-8befa92fd131 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:16.997649 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb2d078-f0cb-4b4d-b3ec-8befa92fd131 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:17.031326 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825e3817-d204-4d0f-8e32-a12dce088232 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa0c4c841f514431aad18f86024154e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9efb263bab548e7be7c326fcda0cae5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:17.032760 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825e3817-d204-4d0f-8e32-a12dce088232 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:17.042612 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825e3817-d204-4d0f-8e32-a12dce088232 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:17.043139 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825e3817-d204-4d0f-8e32-a12dce088232 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] PATH_INFO: `/v3/users/332b15ae4121497c8cc6c8fd5f485825` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:17.044929 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825e3817-d204-4d0f-8e32-a12dce088232 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] RBAC: Authorizing `identity:update_user(user_id=332b15ae4121497c8cc6c8fd5f485825)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:17.050343 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825e3817-d204-4d0f-8e32-a12dce088232 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:17.140107 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-825e3817-d204-4d0f-8e32-a12dce088232 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '332b15ae4121497c8cc6c8fd5f485825'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:17.163560 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-825e3817-d204-4d0f-8e32-a12dce088232 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] Invalidating the token cache because user 332b15ae4121497c8cc6c8fd5f485825 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:27:17.164439 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-825e3817-d204-4d0f-8e32-a12dce088232 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:17.166807 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-825e3817-d204-4d0f-8e32-a12dce088232 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:17.178936 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1935/3873] 10.222.0.17 () {60 vars in 1242 bytes} [Sat Jul 23 21:27:16 2022] PATCH /identity/v3/users/332b15ae4121497c8cc6c8fd5f485825 => generated 296 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:27:17.182625 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0065d8-d781-4795-b029-ccf868322960 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:17.203067 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0065d8-d781-4795-b029-ccf868322960 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:17.208501 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439f3d6e-4593-4963-970d-861720318ed6 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa0c4c841f514431aad18f86024154e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9efb263bab548e7be7c326fcda0cae5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:17.209263 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439f3d6e-4593-4963-970d-861720318ed6 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:17.209545 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439f3d6e-4593-4963-970d-861720318ed6 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:17.209820 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439f3d6e-4593-4963-970d-861720318ed6 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] PATH_INFO: `/v3/users/332b15ae4121497c8cc6c8fd5f485825` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:17.237048 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439f3d6e-4593-4963-970d-861720318ed6 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] RBAC: Authorizing `identity:update_user(user_id=332b15ae4121497c8cc6c8fd5f485825)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:17.238296 ncdv-master-1 devstack@keystone.service[91548]: WARNING py.warnings [None req-439f3d6e-4593-4963-970d-861720318ed6 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:27:17.238296 ncdv-master-1 devstack@keystone.service[91548]: warnings.warn(msg) Jul 23 21:27:17.238296 ncdv-master-1 devstack@keystone.service[91548]: Jul 23 21:27:17.239940 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439f3d6e-4593-4963-970d-861720318ed6 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:17.346763 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=2,keystone:UPDATE=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:27:17.356468 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-439f3d6e-4593-4963-970d-861720318ed6 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '332b15ae4121497c8cc6c8fd5f485825'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:17.384676 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-439f3d6e-4593-4963-970d-861720318ed6 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] Invalidating the token cache because user 332b15ae4121497c8cc6c8fd5f485825 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:27:17.385622 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-439f3d6e-4593-4963-970d-861720318ed6 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:17.386588 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-439f3d6e-4593-4963-970d-861720318ed6 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:17.393396 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1939/3874] 10.222.0.17 () {60 vars in 1242 bytes} [Sat Jul 23 21:27:17 2022] PATCH /identity/v3/users/332b15ae4121497c8cc6c8fd5f485825 => generated 296 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:27:17.393621 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686174a2-f0f3-4a62-b064-2ee7966755a5 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:17.393842 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686174a2-f0f3-4a62-b064-2ee7966755a5 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:17.395025 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686174a2-f0f3-4a62-b064-2ee7966755a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:17.442073 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-686174a2-f0f3-4a62-b064-2ee7966755a5 None None] MFA Rules not processed for user `332b15ae4121497c8cc6c8fd5f485825`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:27:17.444714 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-686174a2-f0f3-4a62-b064-2ee7966755a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:17.455624 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1936/3875] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:27:17 2022] POST /identity/v3/auth/tokens => generated 348 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 23 21:27:17.456649 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439f3d6e-4593-4963-970d-861720318ed6 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:17.458225 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-439f3d6e-4593-4963-970d-861720318ed6 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:17.475178 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439f3d6e-4593-4963-970d-861720318ed6 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:17.482126 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7cb66d-0331-4564-a537-0b6a242b197f tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa0c4c841f514431aad18f86024154e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9efb263bab548e7be7c326fcda0cae5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:17.483329 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7cb66d-0331-4564-a537-0b6a242b197f tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:17.483808 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7cb66d-0331-4564-a537-0b6a242b197f tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:17.485534 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7cb66d-0331-4564-a537-0b6a242b197f tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] PATH_INFO: `/v3/users/332b15ae4121497c8cc6c8fd5f485825` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:17.487234 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7cb66d-0331-4564-a537-0b6a242b197f tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] RBAC: Authorizing `identity:update_user(user_id=332b15ae4121497c8cc6c8fd5f485825)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:17.490548 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7cb66d-0331-4564-a537-0b6a242b197f tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:17.557702 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-3d7cb66d-0331-4564-a537-0b6a242b197f tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '332b15ae4121497c8cc6c8fd5f485825'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:17.602099 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-3d7cb66d-0331-4564-a537-0b6a242b197f tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] Invalidating the token cache because user 332b15ae4121497c8cc6c8fd5f485825 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:27:17.602444 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-3d7cb66d-0331-4564-a537-0b6a242b197f tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:17.603197 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-3d7cb66d-0331-4564-a537-0b6a242b197f tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:17.605570 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1940/3876] 10.222.0.17 () {60 vars in 1242 bytes} [Sat Jul 23 21:27:17 2022] PATCH /identity/v3/users/332b15ae4121497c8cc6c8fd5f485825 => generated 296 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 21:27:17.612501 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686174a2-f0f3-4a62-b064-2ee7966755a5 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:17.653662 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686174a2-f0f3-4a62-b064-2ee7966755a5 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:17.663625 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f03988-b6c8-423e-b0c3-b9fa448a8e2e tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa0c4c841f514431aad18f86024154e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9efb263bab548e7be7c326fcda0cae5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:17.664969 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f03988-b6c8-423e-b0c3-b9fa448a8e2e tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:17.665349 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f03988-b6c8-423e-b0c3-b9fa448a8e2e tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:17.666182 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f03988-b6c8-423e-b0c3-b9fa448a8e2e tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:17.667144 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f03988-b6c8-423e-b0c3-b9fa448a8e2e tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:17.670263 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f03988-b6c8-423e-b0c3-b9fa448a8e2e tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:17.755605 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1937/3877] 10.222.0.17 () {60 vars in 1142 bytes} [Sat Jul 23 21:27:17 2022] POST /identity/v3/users => generated 265 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:27:17.755795 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7cb66d-0331-4564-a537-0b6a242b197f tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:17.757555 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-3d7cb66d-0331-4564-a537-0b6a242b197f tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:17.779813 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7cb66d-0331-4564-a537-0b6a242b197f tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:17.795249 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99ce4d7-dfac-4010-b711-f0ee390c4951 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa0c4c841f514431aad18f86024154e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9efb263bab548e7be7c326fcda0cae5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:17.796178 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99ce4d7-dfac-4010-b711-f0ee390c4951 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:17.796468 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99ce4d7-dfac-4010-b711-f0ee390c4951 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:17.796750 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99ce4d7-dfac-4010-b711-f0ee390c4951 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] PATH_INFO: `/v3/users/afda3ec65fd54a13ab3fd81444f7f239/password` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:17.957205 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-e99ce4d7-dfac-4010-b711-f0ee390c4951 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'afda3ec65fd54a13ab3fd81444f7f239'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:17.976961 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1941/3878] 10.222.0.17 () {60 vars in 1268 bytes} [Sat Jul 23 21:27:17 2022] POST /identity/v3/users/afda3ec65fd54a13ab3fd81444f7f239/password => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:27:18.672604 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f03988-b6c8-423e-b0c3-b9fa448a8e2e tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:18.675366 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-46f03988-b6c8-423e-b0c3-b9fa448a8e2e tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:18.826819 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f03988-b6c8-423e-b0c3-b9fa448a8e2e tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:18.834006 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326ae000-9a89-473b-955d-60fc7aea5d12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:18.835327 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326ae000-9a89-473b-955d-60fc7aea5d12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:18.836594 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326ae000-9a89-473b-955d-60fc7aea5d12 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:18.837339 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326ae000-9a89-473b-955d-60fc7aea5d12 admin admin] PATH_INFO: `/v3/users/17d03db62c3f440d8ffcd52c4c895277` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:18.838996 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326ae000-9a89-473b-955d-60fc7aea5d12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17d03db62c3f440d8ffcd52c4c895277)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:18.841438 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326ae000-9a89-473b-955d-60fc7aea5d12 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:18.924327 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-326ae000-9a89-473b-955d-60fc7aea5d12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17d03db62c3f440d8ffcd52c4c895277'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:18.944157 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-326ae000-9a89-473b-955d-60fc7aea5d12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17d03db62c3f440d8ffcd52c4c895277'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:18.945029 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-326ae000-9a89-473b-955d-60fc7aea5d12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17d03db62c3f440d8ffcd52c4c895277'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:18.971220 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-326ae000-9a89-473b-955d-60fc7aea5d12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17d03db62c3f440d8ffcd52c4c895277'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:18.982087 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=80,keystone:UPDATE=2,keystone:INSERT=8,keystone:DELETE=10 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:27:18.984971 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6890b337-714e-4132-a78b-3a775135c550 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:18.985486 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6890b337-714e-4132-a78b-3a775135c550 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:18.985595 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6890b337-714e-4132-a78b-3a775135c550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:18.998976 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-326ae000-9a89-473b-955d-60fc7aea5d12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17d03db62c3f440d8ffcd52c4c895277'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:19.014126 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1938/3879] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:27:18 2022] DELETE /identity/v3/users/17d03db62c3f440d8ffcd52c4c895277 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:27:19.024059 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-6890b337-714e-4132-a78b-3a775135c550 None None] MFA Rules not processed for user `afda3ec65fd54a13ab3fd81444f7f239`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:27:19.025476 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-6890b337-714e-4132-a78b-3a775135c550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:19.034689 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1942/3880] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:27:18 2022] POST /identity/v3/auth/tokens => generated 330 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 23 21:27:19.038985 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326ae000-9a89-473b-955d-60fc7aea5d12 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:19.040513 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-326ae000-9a89-473b-955d-60fc7aea5d12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:19.144931 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326ae000-9a89-473b-955d-60fc7aea5d12 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:19.150969 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba74e35-50e6-43ae-b775-e06dd5854e7b tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa0c4c841f514431aad18f86024154e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9efb263bab548e7be7c326fcda0cae5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:19.152211 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba74e35-50e6-43ae-b775-e06dd5854e7b tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:19.152595 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba74e35-50e6-43ae-b775-e06dd5854e7b tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:19.153121 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba74e35-50e6-43ae-b775-e06dd5854e7b tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:19.161312 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba74e35-50e6-43ae-b775-e06dd5854e7b tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:19.164314 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba74e35-50e6-43ae-b775-e06dd5854e7b tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:19.173796 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1939/3881] 10.222.0.17 () {56 vars in 1262 bytes} [Sat Jul 23 21:27:19 2022] GET /identity/v3/auth/tokens => generated 330 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 23 21:27:19.178327 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6890b337-714e-4132-a78b-3a775135c550 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:19.199208 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6890b337-714e-4132-a78b-3a775135c550 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:19.206494 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a34d5b6-582d-470a-a070-eab3b7c39f30 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa0c4c841f514431aad18f86024154e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9efb263bab548e7be7c326fcda0cae5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:19.207615 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a34d5b6-582d-470a-a070-eab3b7c39f30 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:19.208207 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a34d5b6-582d-470a-a070-eab3b7c39f30 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:19.208705 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a34d5b6-582d-470a-a070-eab3b7c39f30 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] PATH_INFO: `/v3/users/afda3ec65fd54a13ab3fd81444f7f239` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:19.210184 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a34d5b6-582d-470a-a070-eab3b7c39f30 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] RBAC: Authorizing `identity:delete_user(user_id=afda3ec65fd54a13ab3fd81444f7f239)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:19.212849 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a34d5b6-582d-470a-a070-eab3b7c39f30 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:19.294487 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-6a34d5b6-582d-470a-a070-eab3b7c39f30 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afda3ec65fd54a13ab3fd81444f7f239'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:19.295948 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-6a34d5b6-582d-470a-a070-eab3b7c39f30 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afda3ec65fd54a13ab3fd81444f7f239'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:19.312449 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-6a34d5b6-582d-470a-a070-eab3b7c39f30 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afda3ec65fd54a13ab3fd81444f7f239'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:19.328193 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-6a34d5b6-582d-470a-a070-eab3b7c39f30 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afda3ec65fd54a13ab3fd81444f7f239'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:19.345368 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-6a34d5b6-582d-470a-a070-eab3b7c39f30 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afda3ec65fd54a13ab3fd81444f7f239'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:19.360199 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba74e35-50e6-43ae-b775-e06dd5854e7b tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:19.371049 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba74e35-50e6-43ae-b775-e06dd5854e7b tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:19.371784 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1943/3882] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:27:19 2022] DELETE /identity/v3/users/afda3ec65fd54a13ab3fd81444f7f239 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:27:19.516519 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab150a4-b10a-4bac-8ec8-afea9f2532a2 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa0c4c841f514431aad18f86024154e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9efb263bab548e7be7c326fcda0cae5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:19.516885 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab150a4-b10a-4bac-8ec8-afea9f2532a2 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:19.517429 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab150a4-b10a-4bac-8ec8-afea9f2532a2 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:19.517808 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab150a4-b10a-4bac-8ec8-afea9f2532a2 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:19.518667 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab150a4-b10a-4bac-8ec8-afea9f2532a2 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:19.526857 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab150a4-b10a-4bac-8ec8-afea9f2532a2 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:19.581909 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1940/3883] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:27:19 2022] POST /identity/v3/users => generated 361 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:27:19.587064 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a34d5b6-582d-470a-a070-eab3b7c39f30 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:19.588808 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-6a34d5b6-582d-470a-a070-eab3b7c39f30 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:19.604482 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab150a4-b10a-4bac-8ec8-afea9f2532a2 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:19.607635 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-fab150a4-b10a-4bac-8ec8-afea9f2532a2 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:19.619123 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a34d5b6-582d-470a-a070-eab3b7c39f30 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:19.627050 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a24b565-960a-4c08-999a-f3253421e05f tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa0c4c841f514431aad18f86024154e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9efb263bab548e7be7c326fcda0cae5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:19.628698 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a24b565-960a-4c08-999a-f3253421e05f tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:19.629176 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a24b565-960a-4c08-999a-f3253421e05f tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:19.629640 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a24b565-960a-4c08-999a-f3253421e05f tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:19.630610 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a24b565-960a-4c08-999a-f3253421e05f tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:19.633679 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a24b565-960a-4c08-999a-f3253421e05f tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:19.679528 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1944/3884] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:27:19 2022] POST /identity/v3/projects => generated 359 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:27:19.683916 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a24b565-960a-4c08-999a-f3253421e05f tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:19.712189 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=77,keystone:INSERT=7,keystone:DELETE=14,keystone:UPDATE=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:27:19.789812 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab150a4-b10a-4bac-8ec8-afea9f2532a2 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:19.821928 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:27:19.839258 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a24b565-960a-4c08-999a-f3253421e05f tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:19.851747 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e0811c-a62a-4b4f-b1cb-c004bfa28397 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa0c4c841f514431aad18f86024154e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9efb263bab548e7be7c326fcda0cae5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:19.853162 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e0811c-a62a-4b4f-b1cb-c004bfa28397 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:19.853778 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e0811c-a62a-4b4f-b1cb-c004bfa28397 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:19.854437 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e0811c-a62a-4b4f-b1cb-c004bfa28397 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] PATH_INFO: `/v3/users/bff4fbbedd6446c299c60e5f6c7500d4` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:19.901650 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e0811c-a62a-4b4f-b1cb-c004bfa28397 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] RBAC: Authorizing `identity:update_user(user_id=bff4fbbedd6446c299c60e5f6c7500d4)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:19.904776 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e0811c-a62a-4b4f-b1cb-c004bfa28397 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:19.931927 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bc1678-c66b-4bb3-b38e-dd08854173c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:19.933559 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bc1678-c66b-4bb3-b38e-dd08854173c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:19.933962 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bc1678-c66b-4bb3-b38e-dd08854173c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:19.934443 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bc1678-c66b-4bb3-b38e-dd08854173c1 admin admin] PATH_INFO: `/v3/projects/bd307932213b49888e78e46353998b38` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:19.950218 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bc1678-c66b-4bb3-b38e-dd08854173c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd307932213b49888e78e46353998b38)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:19.952837 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bc1678-c66b-4bb3-b38e-dd08854173c1 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:20.002283 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1945/3885] 10.222.0.17 () {60 vars in 1243 bytes} [Sat Jul 23 21:27:19 2022] PATCH /identity/v3/users/bff4fbbedd6446c299c60e5f6c7500d4 => generated 521 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:27:20.006251 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e0811c-a62a-4b4f-b1cb-c004bfa28397 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:20.041658 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e0811c-a62a-4b4f-b1cb-c004bfa28397 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:20.081683 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-74bc1678-c66b-4bb3-b38e-dd08854173c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd307932213b49888e78e46353998b38', 'request_id': 'req-74bc1678-c66b-4bb3-b38e-dd08854173c1'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:20.100515 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-74bc1678-c66b-4bb3-b38e-dd08854173c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd307932213b49888e78e46353998b38', 'request_id': 'req-74bc1678-c66b-4bb3-b38e-dd08854173c1'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:20.109626 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-74bc1678-c66b-4bb3-b38e-dd08854173c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd307932213b49888e78e46353998b38', 'request_id': 'req-74bc1678-c66b-4bb3-b38e-dd08854173c1'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:20.123130 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-74bc1678-c66b-4bb3-b38e-dd08854173c1 admin admin] The token cache is being invalidate because project bd307932213b49888e78e46353998b38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:27:20.123586 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-74bc1678-c66b-4bb3-b38e-dd08854173c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:20.124458 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-74bc1678-c66b-4bb3-b38e-dd08854173c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:20.130548 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1941/3886] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:27:19 2022] DELETE /identity/v3/projects/bd307932213b49888e78e46353998b38 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:27:20.132787 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e08a9ea-47bd-4dc5-8b8b-ba6e133ab62a None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:20.133136 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e08a9ea-47bd-4dc5-8b8b-ba6e133ab62a None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:20.133482 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e08a9ea-47bd-4dc5-8b8b-ba6e133ab62a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:20.169408 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-9e08a9ea-47bd-4dc5-8b8b-ba6e133ab62a None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:27:20.170780 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-9e08a9ea-47bd-4dc5-8b8b-ba6e133ab62a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:20.179797 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35503101-aa25-4057-a075-0c6c81b07c54 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa0c4c841f514431aad18f86024154e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9efb263bab548e7be7c326fcda0cae5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:20.180715 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35503101-aa25-4057-a075-0c6c81b07c54 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:20.180995 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35503101-aa25-4057-a075-0c6c81b07c54 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:20.181278 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35503101-aa25-4057-a075-0c6c81b07c54 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] PATH_INFO: `/v3/users/bff4fbbedd6446c299c60e5f6c7500d4` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:20.216335 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35503101-aa25-4057-a075-0c6c81b07c54 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] RBAC: Authorizing `identity:get_user(user_id=bff4fbbedd6446c299c60e5f6c7500d4)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:20.218739 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35503101-aa25-4057-a075-0c6c81b07c54 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:20.226697 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1946/3887] 10.222.0.17 () {58 vars in 1220 bytes} [Sat Jul 23 21:27:20 2022] GET /identity/v3/users/bff4fbbedd6446c299c60e5f6c7500d4 => generated 388 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:27:20.228339 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35503101-aa25-4057-a075-0c6c81b07c54 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:20.231750 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-35503101-aa25-4057-a075-0c6c81b07c54 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:20.252811 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35503101-aa25-4057-a075-0c6c81b07c54 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:20.259197 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373e48c9-5f21-4b52-9591-d73635060e8c tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa0c4c841f514431aad18f86024154e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9efb263bab548e7be7c326fcda0cae5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:20.260101 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373e48c9-5f21-4b52-9591-d73635060e8c tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:20.260623 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373e48c9-5f21-4b52-9591-d73635060e8c tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:20.260910 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373e48c9-5f21-4b52-9591-d73635060e8c tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] PATH_INFO: `/v3/projects/76089bea499f4396b053d0b3d000285f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:20.262194 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373e48c9-5f21-4b52-9591-d73635060e8c tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] RBAC: Authorizing `identity:delete_project(project_id=76089bea499f4396b053d0b3d000285f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:20.264187 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373e48c9-5f21-4b52-9591-d73635060e8c tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:20.304576 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1942/3888] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:27:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:27:20.307502 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f04a99-58b5-43b3-91bd-88b4ffa463ac None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:20.307696 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f04a99-58b5-43b3-91bd-88b4ffa463ac None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:20.307929 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f04a99-58b5-43b3-91bd-88b4ffa463ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:20.347369 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-e4f04a99-58b5-43b3-91bd-88b4ffa463ac None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:27:20.348770 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-e4f04a99-58b5-43b3-91bd-88b4ffa463ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:20.374608 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-373e48c9-5f21-4b52-9591-d73635060e8c tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76089bea499f4396b053d0b3d000285f', 'request_id': 'req-373e48c9-5f21-4b52-9591-d73635060e8c'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:20.391456 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-373e48c9-5f21-4b52-9591-d73635060e8c tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76089bea499f4396b053d0b3d000285f', 'request_id': 'req-373e48c9-5f21-4b52-9591-d73635060e8c'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:20.403982 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-373e48c9-5f21-4b52-9591-d73635060e8c tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76089bea499f4396b053d0b3d000285f', 'request_id': 'req-373e48c9-5f21-4b52-9591-d73635060e8c'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:20.406921 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=90,keystone:UPDATE=2,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:27:20.433523 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-373e48c9-5f21-4b52-9591-d73635060e8c tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] The token cache is being invalidate because project 76089bea499f4396b053d0b3d000285f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:27:20.435598 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-373e48c9-5f21-4b52-9591-d73635060e8c tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:20.439301 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-373e48c9-5f21-4b52-9591-d73635060e8c tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:20.442908 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1947/3889] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:27:20 2022] DELETE /identity/v3/projects/76089bea499f4396b053d0b3d000285f => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:27:20.446721 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373e48c9-5f21-4b52-9591-d73635060e8c tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:20.450413 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-373e48c9-5f21-4b52-9591-d73635060e8c tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:20.453570 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:27:20.498693 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1943/3890] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:27:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:27:20.500223 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f04a99-58b5-43b3-91bd-88b4ffa463ac None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:20.518310 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f04a99-58b5-43b3-91bd-88b4ffa463ac None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:20.531740 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3ac21a-27ca-43d6-91fc-62838bbc7819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:20.532437 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3ac21a-27ca-43d6-91fc-62838bbc7819 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:20.532711 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3ac21a-27ca-43d6-91fc-62838bbc7819 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:20.534538 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3ac21a-27ca-43d6-91fc-62838bbc7819 admin admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:20.534683 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3ac21a-27ca-43d6-91fc-62838bbc7819 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:27:20.534914 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3ac21a-27ca-43d6-91fc-62838bbc7819 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:20.536632 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3ac21a-27ca-43d6-91fc-62838bbc7819 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:20.574082 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1944/3891] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:27:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:27:20.576365 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3ac21a-27ca-43d6-91fc-62838bbc7819 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:20.600646 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3ac21a-27ca-43d6-91fc-62838bbc7819 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:20.606347 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373e48c9-5f21-4b52-9591-d73635060e8c tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:20.612279 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c08808-302b-4861-a0e3-cb687cea2eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:20.612960 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c08808-302b-4861-a0e3-cb687cea2eb7 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:20.613243 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c08808-302b-4861-a0e3-cb687cea2eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:20.613524 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c08808-302b-4861-a0e3-cb687cea2eb7 admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:20.614744 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c08808-302b-4861-a0e3-cb687cea2eb7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:20.628007 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c08808-302b-4861-a0e3-cb687cea2eb7 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:20.632157 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871d36da-beb3-4b4d-a9c6-98690860a8a0 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa0c4c841f514431aad18f86024154e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9efb263bab548e7be7c326fcda0cae5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:20.633303 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871d36da-beb3-4b4d-a9c6-98690860a8a0 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:20.633583 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871d36da-beb3-4b4d-a9c6-98690860a8a0 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:20.633955 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871d36da-beb3-4b4d-a9c6-98690860a8a0 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] PATH_INFO: `/v3/users/bff4fbbedd6446c299c60e5f6c7500d4` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:20.635338 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871d36da-beb3-4b4d-a9c6-98690860a8a0 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] RBAC: Authorizing `identity:delete_user(user_id=bff4fbbedd6446c299c60e5f6c7500d4)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:20.637697 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871d36da-beb3-4b4d-a9c6-98690860a8a0 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:20.687798 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1945/3892] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:27:20 2022] POST /identity/v3/projects => generated 401 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:27:20.689575 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c08808-302b-4861-a0e3-cb687cea2eb7 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:20.725456 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-871d36da-beb3-4b4d-a9c6-98690860a8a0 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bff4fbbedd6446c299c60e5f6c7500d4'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:20.726439 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-871d36da-beb3-4b4d-a9c6-98690860a8a0 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bff4fbbedd6446c299c60e5f6c7500d4'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:20.735174 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-871d36da-beb3-4b4d-a9c6-98690860a8a0 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bff4fbbedd6446c299c60e5f6c7500d4'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:20.748127 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-871d36da-beb3-4b4d-a9c6-98690860a8a0 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bff4fbbedd6446c299c60e5f6c7500d4'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:20.764200 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-871d36da-beb3-4b4d-a9c6-98690860a8a0 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bff4fbbedd6446c299c60e5f6c7500d4'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:20.773756 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1948/3893] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:27:20 2022] DELETE /identity/v3/users/bff4fbbedd6446c299c60e5f6c7500d4 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:27:20.779102 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871d36da-beb3-4b4d-a9c6-98690860a8a0 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:20.784538 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-871d36da-beb3-4b4d-a9c6-98690860a8a0 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:20.801975 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c08808-302b-4861-a0e3-cb687cea2eb7 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:20.875925 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871d36da-beb3-4b4d-a9c6-98690860a8a0 tempest-UsersV3TestJSON-1709285993 tempest-UsersV3TestJSON-1709285993-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:20.883075 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d764e58a-cbd2-4e08-b0b4-e0cfdae96332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:20.884905 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d764e58a-cbd2-4e08-b0b4-e0cfdae96332 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:20.886651 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d764e58a-cbd2-4e08-b0b4-e0cfdae96332 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:20.887250 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d764e58a-cbd2-4e08-b0b4-e0cfdae96332 admin admin] PATH_INFO: `/v3/users/332b15ae4121497c8cc6c8fd5f485825` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:20.892598 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69485afb-394a-4ca7-b7a1-8185315dd53d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:20.893525 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69485afb-394a-4ca7-b7a1-8185315dd53d admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:20.893807 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69485afb-394a-4ca7-b7a1-8185315dd53d admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:20.894116 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69485afb-394a-4ca7-b7a1-8185315dd53d admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:20.895012 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69485afb-394a-4ca7-b7a1-8185315dd53d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:20.897712 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69485afb-394a-4ca7-b7a1-8185315dd53d admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:20.914366 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d764e58a-cbd2-4e08-b0b4-e0cfdae96332 admin admin] RBAC: Authorizing `identity:delete_user(user_id=332b15ae4121497c8cc6c8fd5f485825)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:20.917355 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d764e58a-cbd2-4e08-b0b4-e0cfdae96332 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:20.920137 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:27:20.934769 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1946/3894] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:27:20 2022] POST /identity/v3/users => generated 301 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:27:20.940344 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69485afb-394a-4ca7-b7a1-8185315dd53d admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:20.944843 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-69485afb-394a-4ca7-b7a1-8185315dd53d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:20.960469 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69485afb-394a-4ca7-b7a1-8185315dd53d admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:20.966869 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444bacec-eff3-4586-b9e3-dbffb3148b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:20.967679 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444bacec-eff3-4586-b9e3-dbffb3148b1f admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:20.967998 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444bacec-eff3-4586-b9e3-dbffb3148b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:20.968275 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444bacec-eff3-4586-b9e3-dbffb3148b1f admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:20.969214 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444bacec-eff3-4586-b9e3-dbffb3148b1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:20.971025 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444bacec-eff3-4586-b9e3-dbffb3148b1f admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:20.989771 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-d764e58a-cbd2-4e08-b0b4-e0cfdae96332 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '332b15ae4121497c8cc6c8fd5f485825'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:20.990625 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-d764e58a-cbd2-4e08-b0b4-e0cfdae96332 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '332b15ae4121497c8cc6c8fd5f485825'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:20.992164 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1947/3895] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:27:20 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 21:27:20.993178 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444bacec-eff3-4586-b9e3-dbffb3148b1f admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:20.998817 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-d764e58a-cbd2-4e08-b0b4-e0cfdae96332 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '332b15ae4121497c8cc6c8fd5f485825'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:21.006920 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444bacec-eff3-4586-b9e3-dbffb3148b1f admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:21.011015 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-d764e58a-cbd2-4e08-b0b4-e0cfdae96332 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '332b15ae4121497c8cc6c8fd5f485825'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:21.014010 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8689270a-03c8-4f02-ba14-2e089c4d88b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:21.021397 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8689270a-03c8-4f02-ba14-2e089c4d88b5 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:21.021983 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8689270a-03c8-4f02-ba14-2e089c4d88b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:21.022310 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8689270a-03c8-4f02-ba14-2e089c4d88b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:21.023531 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8689270a-03c8-4f02-ba14-2e089c4d88b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:21.025347 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8689270a-03c8-4f02-ba14-2e089c4d88b5 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:21.027392 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-d764e58a-cbd2-4e08-b0b4-e0cfdae96332 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '332b15ae4121497c8cc6c8fd5f485825'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:21.043734 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1948/3896] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:27:20 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:27:21.045334 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8689270a-03c8-4f02-ba14-2e089c4d88b5 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:21.047180 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-8689270a-03c8-4f02-ba14-2e089c4d88b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:21.056441 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1949/3897] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:27:20 2022] DELETE /identity/v3/users/332b15ae4121497c8cc6c8fd5f485825 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:27:21.060965 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd374c5-869a-45a4-bcd9-dc7507b446e5 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:21.061467 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd374c5-869a-45a4-bcd9-dc7507b446e5 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:21.062305 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd374c5-869a-45a4-bcd9-dc7507b446e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:21.062558 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8689270a-03c8-4f02-ba14-2e089c4d88b5 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:21.109278 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-0bd374c5-869a-45a4-bcd9-dc7507b446e5 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:27:21.110849 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-0bd374c5-869a-45a4-bcd9-dc7507b446e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:21.115331 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:27:21.171114 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bb926d-7c3c-4224-9ada-4b63e86012bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:21.172192 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bb926d-7c3c-4224-9ada-4b63e86012bb admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:21.172572 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bb926d-7c3c-4224-9ada-4b63e86012bb admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:21.173100 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bb926d-7c3c-4224-9ada-4b63e86012bb admin admin] PATH_INFO: `/v3/projects/0410d4155db3469ebc5253d261889d52/users/ed6e56e2df5a4753984d0d632948037e/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:21.192497 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bb926d-7c3c-4224-9ada-4b63e86012bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=0410d4155db3469ebc5253d261889d52, user_id=ed6e56e2df5a4753984d0d632948037e, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:21.195754 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bb926d-7c3c-4224-9ada-4b63e86012bb admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:21.227858 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1949/3898] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:27:21 2022] PUT /identity/v3/projects/0410d4155db3469ebc5253d261889d52/users/ed6e56e2df5a4753984d0d632948037e/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:27:21.240344 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c1d834-1af3-465d-b719-739f9a821d4d None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:21.240344 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c1d834-1af3-465d-b719-739f9a821d4d None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:21.240344 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c1d834-1af3-465d-b719-739f9a821d4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:21.248300 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1950/3899] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:27:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:27:21.259357 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd374c5-869a-45a4-bcd9-dc7507b446e5 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:21.260844 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-0bd374c5-869a-45a4-bcd9-dc7507b446e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:21.299091 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-74c1d834-1af3-465d-b719-739f9a821d4d None None] MFA Rules not processed for user `ed6e56e2df5a4753984d0d632948037e`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:27:21.300605 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-74c1d834-1af3-465d-b719-739f9a821d4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:21.411345 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd374c5-869a-45a4-bcd9-dc7507b446e5 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:21.439116 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1950/3900] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:27:21 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:27:21.451791 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c1d834-1af3-465d-b719-739f9a821d4d None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:21.472485 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:27:21.499917 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de2c993-1c86-4cc9-b9ca-d72005397fa4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:21.501006 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de2c993-1c86-4cc9-b9ca-d72005397fa4 service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:21.502089 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de2c993-1c86-4cc9-b9ca-d72005397fa4 service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:21.502765 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de2c993-1c86-4cc9-b9ca-d72005397fa4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:21.522547 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c1d834-1af3-465d-b719-739f9a821d4d None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:21.528567 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaead892-68cd-42b3-9b77-48d5f96cf155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:21.529488 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaead892-68cd-42b3-9b77-48d5f96cf155 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:21.529768 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaead892-68cd-42b3-9b77-48d5f96cf155 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:21.530072 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaead892-68cd-42b3-9b77-48d5f96cf155 admin admin] PATH_INFO: `/v3/users/ed6e56e2df5a4753984d0d632948037e` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:21.531591 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaead892-68cd-42b3-9b77-48d5f96cf155 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed6e56e2df5a4753984d0d632948037e)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:21.533552 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaead892-68cd-42b3-9b77-48d5f96cf155 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:21.598812 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:27:21.605099 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-eaead892-68cd-42b3-9b77-48d5f96cf155 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed6e56e2df5a4753984d0d632948037e'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:21.616250 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de2c993-1c86-4cc9-b9ca-d72005397fa4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:21.619428 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de2c993-1c86-4cc9-b9ca-d72005397fa4 service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:21.620133 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-eaead892-68cd-42b3-9b77-48d5f96cf155 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed6e56e2df5a4753984d0d632948037e'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:21.620939 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-eaead892-68cd-42b3-9b77-48d5f96cf155 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed6e56e2df5a4753984d0d632948037e'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:21.634967 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1951/3901] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:27:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 23 21:27:21.635213 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-eaead892-68cd-42b3-9b77-48d5f96cf155 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed6e56e2df5a4753984d0d632948037e'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:21.636700 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7461b80c-4f45-407d-a57a-07e526c9dcf2 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:21.637048 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7461b80c-4f45-407d-a57a-07e526c9dcf2 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:21.637850 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7461b80c-4f45-407d-a57a-07e526c9dcf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:21.653689 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-eaead892-68cd-42b3-9b77-48d5f96cf155 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed6e56e2df5a4753984d0d632948037e'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:21.663681 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1951/3902] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:27:21 2022] DELETE /identity/v3/users/ed6e56e2df5a4753984d0d632948037e => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:27:21.669388 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef57ba3-8798-4a07-b1b7-2f7153c48f7a None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:21.669388 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef57ba3-8798-4a07-b1b7-2f7153c48f7a None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:21.669388 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef57ba3-8798-4a07-b1b7-2f7153c48f7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:21.684013 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-7461b80c-4f45-407d-a57a-07e526c9dcf2 None None] MFA Rules not processed for user `e11fb79c253c4a0f955d710ff4626f6d`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:27:21.685339 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-7461b80c-4f45-407d-a57a-07e526c9dcf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:21.706791 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-9ef57ba3-8798-4a07-b1b7-2f7153c48f7a None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:27:21.708484 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-9ef57ba3-8798-4a07-b1b7-2f7153c48f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:21.825038 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1952/3903] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:27:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:27:21.826102 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef57ba3-8798-4a07-b1b7-2f7153c48f7a None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:21.830146 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-9ef57ba3-8798-4a07-b1b7-2f7153c48f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:21.842117 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1952/3904] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:27:21 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:27:21.870072 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f343e922-0312-4a02-a878-99c60fa66965 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:21.870072 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f343e922-0312-4a02-a878-99c60fa66965 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:21.870072 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f343e922-0312-4a02-a878-99c60fa66965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:21.892619 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-f343e922-0312-4a02-a878-99c60fa66965 None None] MFA Rules not processed for user `e11fb79c253c4a0f955d710ff4626f6d`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:27:21.894170 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-f343e922-0312-4a02-a878-99c60fa66965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:21.911161 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1953/3905] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:27:21 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:27:21.924201 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f343e922-0312-4a02-a878-99c60fa66965 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:21.927719 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-f343e922-0312-4a02-a878-99c60fa66965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:21.978382 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef57ba3-8798-4a07-b1b7-2f7153c48f7a None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:21.984287 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc774ba0-b36b-458b-9d25-3bbefd2ff475 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:21.985075 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc774ba0-b36b-458b-9d25-3bbefd2ff475 service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:21.985717 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc774ba0-b36b-458b-9d25-3bbefd2ff475 service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:21.986037 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc774ba0-b36b-458b-9d25-3bbefd2ff475 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:22.013773 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc774ba0-b36b-458b-9d25-3bbefd2ff475 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:22.016285 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc774ba0-b36b-458b-9d25-3bbefd2ff475 service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:22.033052 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1953/3906] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:27:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:27:22.053583 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f343e922-0312-4a02-a878-99c60fa66965 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:22.060656 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732988e6-d071-403f-b941-7d5398bed694 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:22.061341 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732988e6-d071-403f-b941-7d5398bed694 service nova] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:22.061629 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732988e6-d071-403f-b941-7d5398bed694 service nova] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:22.061936 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732988e6-d071-403f-b941-7d5398bed694 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:22.069425 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:27:22.072615 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732988e6-d071-403f-b941-7d5398bed694 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:22.075199 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732988e6-d071-403f-b941-7d5398bed694 service nova] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:22.089582 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1954/3907] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:27:21 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:27:22.308466 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc774ba0-b36b-458b-9d25-3bbefd2ff475 service neutron] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:22.311034 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-cc774ba0-b36b-458b-9d25-3bbefd2ff475 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:22.327167 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc774ba0-b36b-458b-9d25-3bbefd2ff475 service neutron] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:22.333376 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ca8a5b-7f43-4d8c-a36e-d6964db99553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:22.335170 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ca8a5b-7f43-4d8c-a36e-d6964db99553 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:22.336558 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ca8a5b-7f43-4d8c-a36e-d6964db99553 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:22.336918 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ca8a5b-7f43-4d8c-a36e-d6964db99553 admin admin] PATH_INFO: `/v3/projects/e0a9d26d5a054b6f9f4fa5e3ff8d791b` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:22.338307 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ca8a5b-7f43-4d8c-a36e-d6964db99553 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0a9d26d5a054b6f9f4fa5e3ff8d791b)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:22.340225 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ca8a5b-7f43-4d8c-a36e-d6964db99553 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:22.411223 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-51ca8a5b-7f43-4d8c-a36e-d6964db99553 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0a9d26d5a054b6f9f4fa5e3ff8d791b', 'request_id': 'req-51ca8a5b-7f43-4d8c-a36e-d6964db99553'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:22.422462 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-51ca8a5b-7f43-4d8c-a36e-d6964db99553 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0a9d26d5a054b6f9f4fa5e3ff8d791b', 'request_id': 'req-51ca8a5b-7f43-4d8c-a36e-d6964db99553'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:22.425441 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:27:22.443079 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-51ca8a5b-7f43-4d8c-a36e-d6964db99553 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0a9d26d5a054b6f9f4fa5e3ff8d791b', 'request_id': 'req-51ca8a5b-7f43-4d8c-a36e-d6964db99553'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:22.462937 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-51ca8a5b-7f43-4d8c-a36e-d6964db99553 admin admin] The token cache is being invalidate because project e0a9d26d5a054b6f9f4fa5e3ff8d791b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:27:22.463262 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-51ca8a5b-7f43-4d8c-a36e-d6964db99553 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:22.463890 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-51ca8a5b-7f43-4d8c-a36e-d6964db99553 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:22.465514 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1954/3908] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:27:22 2022] DELETE /identity/v3/projects/e0a9d26d5a054b6f9f4fa5e3ff8d791b => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:27:22.469641 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732988e6-d071-403f-b941-7d5398bed694 service nova] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:22.480704 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732988e6-d071-403f-b941-7d5398bed694 service nova] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:22.552134 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e39db22-0431-4100-817c-f9f0b51907f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:22.553085 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e39db22-0431-4100-817c-f9f0b51907f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:22.553504 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e39db22-0431-4100-817c-f9f0b51907f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:22.553854 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e39db22-0431-4100-817c-f9f0b51907f6 admin admin] PATH_INFO: `/v3/users/fa0c4c841f514431aad18f86024154e8` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:22.555209 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e39db22-0431-4100-817c-f9f0b51907f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa0c4c841f514431aad18f86024154e8)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:22.557465 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e39db22-0431-4100-817c-f9f0b51907f6 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:22.621823 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-7e39db22-0431-4100-817c-f9f0b51907f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa0c4c841f514431aad18f86024154e8'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:22.622564 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-7e39db22-0431-4100-817c-f9f0b51907f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa0c4c841f514431aad18f86024154e8'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:22.632111 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-7e39db22-0431-4100-817c-f9f0b51907f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa0c4c841f514431aad18f86024154e8'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:22.644709 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-7e39db22-0431-4100-817c-f9f0b51907f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa0c4c841f514431aad18f86024154e8'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:22.662534 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-7e39db22-0431-4100-817c-f9f0b51907f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa0c4c841f514431aad18f86024154e8'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:22.670586 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1955/3909] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:27:22 2022] DELETE /identity/v3/users/fa0c4c841f514431aad18f86024154e8 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:27:22.827568 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ca8a5b-7f43-4d8c-a36e-d6964db99553 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:22.829989 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-51ca8a5b-7f43-4d8c-a36e-d6964db99553 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:22.891836 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ca8a5b-7f43-4d8c-a36e-d6964db99553 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:23.032494 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303ff975-91e7-4a83-90b1-a19ba656bbe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:23.037039 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303ff975-91e7-4a83-90b1-a19ba656bbe4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:23.037452 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303ff975-91e7-4a83-90b1-a19ba656bbe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:23.037766 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303ff975-91e7-4a83-90b1-a19ba656bbe4 admin admin] PATH_INFO: `/v3/projects/0410d4155db3469ebc5253d261889d52` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:23.041779 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303ff975-91e7-4a83-90b1-a19ba656bbe4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0410d4155db3469ebc5253d261889d52)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:23.048202 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303ff975-91e7-4a83-90b1-a19ba656bbe4 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:23.161308 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-303ff975-91e7-4a83-90b1-a19ba656bbe4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0410d4155db3469ebc5253d261889d52', 'request_id': 'req-303ff975-91e7-4a83-90b1-a19ba656bbe4'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:23.166406 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eded188-705d-4b2e-9778-7693abb8f392 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:23.168839 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eded188-705d-4b2e-9778-7693abb8f392 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:23.169315 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eded188-705d-4b2e-9778-7693abb8f392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:23.189090 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-303ff975-91e7-4a83-90b1-a19ba656bbe4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0410d4155db3469ebc5253d261889d52', 'request_id': 'req-303ff975-91e7-4a83-90b1-a19ba656bbe4'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:23.210494 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-2eded188-705d-4b2e-9778-7693abb8f392 None None] MFA Rules not processed for user `e11fb79c253c4a0f955d710ff4626f6d`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:27:23.211728 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-2eded188-705d-4b2e-9778-7693abb8f392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:23.214392 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-303ff975-91e7-4a83-90b1-a19ba656bbe4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0410d4155db3469ebc5253d261889d52', 'request_id': 'req-303ff975-91e7-4a83-90b1-a19ba656bbe4'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:23.253736 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-303ff975-91e7-4a83-90b1-a19ba656bbe4 admin admin] The token cache is being invalidate because project 0410d4155db3469ebc5253d261889d52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:27:23.254056 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-303ff975-91e7-4a83-90b1-a19ba656bbe4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:23.256743 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-303ff975-91e7-4a83-90b1-a19ba656bbe4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:23.274441 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1955/3910] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:27:22 2022] DELETE /identity/v3/projects/0410d4155db3469ebc5253d261889d52 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:27:23.283965 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832f719d-ac64-47f9-b62b-9669426cb492 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:23.285233 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832f719d-ac64-47f9-b62b-9669426cb492 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:23.285523 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832f719d-ac64-47f9-b62b-9669426cb492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:23.315062 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1956/3911] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:27:23 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:27:23.341485 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-832f719d-ac64-47f9-b62b-9669426cb492 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:27:23.342762 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-832f719d-ac64-47f9-b62b-9669426cb492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:23.450570 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eded188-705d-4b2e-9778-7693abb8f392 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:23.452084 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-2eded188-705d-4b2e-9778-7693abb8f392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:23.483141 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1956/3912] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:27:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:27:23.487679 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c85fcb6-9cb4-438c-9f5d-20f977da1d06 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:23.488326 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c85fcb6-9cb4-438c-9f5d-20f977da1d06 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:23.488813 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c85fcb6-9cb4-438c-9f5d-20f977da1d06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:23.510370 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:27:23.540191 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-7c85fcb6-9cb4-438c-9f5d-20f977da1d06 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:27:23.543603 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-7c85fcb6-9cb4-438c-9f5d-20f977da1d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:23.577758 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1957/3913] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:27:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:27:23.583200 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c85fcb6-9cb4-438c-9f5d-20f977da1d06 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:23.599901 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c85fcb6-9cb4-438c-9f5d-20f977da1d06 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:23.616110 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794ac89e-a06d-4533-a393-a692cac21ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:23.616632 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794ac89e-a06d-4533-a393-a692cac21ed3 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:23.616915 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794ac89e-a06d-4533-a393-a692cac21ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:23.617187 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794ac89e-a06d-4533-a393-a692cac21ed3 admin admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:23.618793 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794ac89e-a06d-4533-a393-a692cac21ed3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:27:23.619104 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794ac89e-a06d-4533-a393-a692cac21ed3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:23.621711 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eded188-705d-4b2e-9778-7693abb8f392 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:23.623451 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794ac89e-a06d-4533-a393-a692cac21ed3 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:23.629812 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:27:23.653818 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1958/3914] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:27:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:27:23.658072 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85571258-1b47-4d1f-aaaf-007631524378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:23.658993 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85571258-1b47-4d1f-aaaf-007631524378 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:23.659345 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85571258-1b47-4d1f-aaaf-007631524378 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:23.659569 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85571258-1b47-4d1f-aaaf-007631524378 admin admin] PATH_INFO: `/v3/projects/e9efb263bab548e7be7c326fcda0cae5` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:23.660772 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794ac89e-a06d-4533-a393-a692cac21ed3 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:23.661534 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85571258-1b47-4d1f-aaaf-007631524378 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9efb263bab548e7be7c326fcda0cae5)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:23.663719 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85571258-1b47-4d1f-aaaf-007631524378 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:23.681605 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794ac89e-a06d-4533-a393-a692cac21ed3 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:23.696234 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f26e608-3655-4121-b7f3-bd932b292223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:23.697233 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f26e608-3655-4121-b7f3-bd932b292223 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:23.697636 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f26e608-3655-4121-b7f3-bd932b292223 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:23.698290 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f26e608-3655-4121-b7f3-bd932b292223 admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:23.699435 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f26e608-3655-4121-b7f3-bd932b292223 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:23.704409 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f26e608-3655-4121-b7f3-bd932b292223 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:23.764371 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-85571258-1b47-4d1f-aaaf-007631524378 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9efb263bab548e7be7c326fcda0cae5', 'request_id': 'req-85571258-1b47-4d1f-aaaf-007631524378'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:23.771509 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1959/3915] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:27:23 2022] POST /identity/v3/projects => generated 403 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:27:23.772744 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f26e608-3655-4121-b7f3-bd932b292223 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:23.776424 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-85571258-1b47-4d1f-aaaf-007631524378 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9efb263bab548e7be7c326fcda0cae5', 'request_id': 'req-85571258-1b47-4d1f-aaaf-007631524378'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:23.785728 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-85571258-1b47-4d1f-aaaf-007631524378 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9efb263bab548e7be7c326fcda0cae5', 'request_id': 'req-85571258-1b47-4d1f-aaaf-007631524378'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:23.855152 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-85571258-1b47-4d1f-aaaf-007631524378 admin admin] The token cache is being invalidate because project e9efb263bab548e7be7c326fcda0cae5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:27:23.857876 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-85571258-1b47-4d1f-aaaf-007631524378 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:23.859793 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-85571258-1b47-4d1f-aaaf-007631524378 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:23.870677 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1957/3916] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:27:23 2022] DELETE /identity/v3/projects/e9efb263bab548e7be7c326fcda0cae5 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:27:23.878512 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d7f4da-cf39-4005-b618-fe36e58173e4 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:23.878891 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d7f4da-cf39-4005-b618-fe36e58173e4 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:23.880645 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d7f4da-cf39-4005-b618-fe36e58173e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:23.931234 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f26e608-3655-4121-b7f3-bd932b292223 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:23.936550 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-57d7f4da-cf39-4005-b618-fe36e58173e4 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:27:23.938426 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-57d7f4da-cf39-4005-b618-fe36e58173e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:23.945452 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dcc546-a30a-4b05-80bc-8149f0d5756d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:23.946213 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dcc546-a30a-4b05-80bc-8149f0d5756d admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:23.946341 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dcc546-a30a-4b05-80bc-8149f0d5756d admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:23.947880 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dcc546-a30a-4b05-80bc-8149f0d5756d admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:23.947880 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dcc546-a30a-4b05-80bc-8149f0d5756d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:23.950132 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dcc546-a30a-4b05-80bc-8149f0d5756d admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:23.967161 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1958/3917] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:27:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:27:24.017764 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1960/3918] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:27:23 2022] POST /identity/v3/users => generated 302 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:27:24.019183 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d7f4da-cf39-4005-b618-fe36e58173e4 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:24.021145 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-57d7f4da-cf39-4005-b618-fe36e58173e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:24.041032 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d7f4da-cf39-4005-b618-fe36e58173e4 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:24.054105 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9c3daa-6652-4495-aa64-89fe3de6d6f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:24.055210 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9c3daa-6652-4495-aa64-89fe3de6d6f9 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:24.056956 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9c3daa-6652-4495-aa64-89fe3de6d6f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:24.057522 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9c3daa-6652-4495-aa64-89fe3de6d6f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:24.059070 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bf59c8-1394-4fe5-9473-70890737d1a4 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:24.059070 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bf59c8-1394-4fe5-9473-70890737d1a4 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:24.059523 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bf59c8-1394-4fe5-9473-70890737d1a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:24.060445 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9c3daa-6652-4495-aa64-89fe3de6d6f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:24.064078 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9c3daa-6652-4495-aa64-89fe3de6d6f9 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:24.083812 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-94bf59c8-1394-4fe5-9473-70890737d1a4 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:27:24.085192 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-94bf59c8-1394-4fe5-9473-70890737d1a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:24.089188 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1959/3919] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:27:24 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:27:24.094344 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9c3daa-6652-4495-aa64-89fe3de6d6f9 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:24.100961 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1961/3920] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:27:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:27:24.102226 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bf59c8-1394-4fe5-9473-70890737d1a4 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:24.126310 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9c3daa-6652-4495-aa64-89fe3de6d6f9 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:24.131094 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bf59c8-1394-4fe5-9473-70890737d1a4 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:24.138399 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef3f090-89b4-4539-8b0d-f26ae39e1bef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:24.139094 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef3f090-89b4-4539-8b0d-f26ae39e1bef admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:24.139374 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef3f090-89b4-4539-8b0d-f26ae39e1bef admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:24.139645 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef3f090-89b4-4539-8b0d-f26ae39e1bef admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:24.141984 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498076a1-df54-49a9-896e-48d1addf48f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:24.142662 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498076a1-df54-49a9-896e-48d1addf48f1 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:24.143048 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498076a1-df54-49a9-896e-48d1addf48f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:24.143320 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498076a1-df54-49a9-896e-48d1addf48f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:24.144853 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498076a1-df54-49a9-896e-48d1addf48f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:27:24.145510 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498076a1-df54-49a9-896e-48d1addf48f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:24.147099 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef3f090-89b4-4539-8b0d-f26ae39e1bef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:24.147443 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498076a1-df54-49a9-896e-48d1addf48f1 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:24.151270 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef3f090-89b4-4539-8b0d-f26ae39e1bef admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:24.163426 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1962/3921] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:27:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:27:24.167860 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498076a1-df54-49a9-896e-48d1addf48f1 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:24.168882 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1960/3922] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:27:24 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:27:24.174972 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef3f090-89b4-4539-8b0d-f26ae39e1bef admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:24.180498 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498076a1-df54-49a9-896e-48d1addf48f1 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:24.191027 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef3f090-89b4-4539-8b0d-f26ae39e1bef admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:24.192162 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4eebf06-3d02-4f63-a979-945314ef24d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:24.193441 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eebf06-3d02-4f63-a979-945314ef24d2 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:24.193722 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eebf06-3d02-4f63-a979-945314ef24d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:24.194020 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eebf06-3d02-4f63-a979-945314ef24d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:24.194725 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4eebf06-3d02-4f63-a979-945314ef24d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:24.198410 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75577fec-0895-4a0c-86e3-d5296074b720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:24.199632 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75577fec-0895-4a0c-86e3-d5296074b720 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:24.200142 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75577fec-0895-4a0c-86e3-d5296074b720 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:24.200624 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75577fec-0895-4a0c-86e3-d5296074b720 admin admin] PATH_INFO: `/v3/projects/62f9873b2e6c418b970c76d0e927a87c/users/0673b055ff614e0f9aaba80784cfb6bd/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:24.202904 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4eebf06-3d02-4f63-a979-945314ef24d2 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:24.220124 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75577fec-0895-4a0c-86e3-d5296074b720 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62f9873b2e6c418b970c76d0e927a87c, user_id=0673b055ff614e0f9aaba80784cfb6bd, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:24.223793 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75577fec-0895-4a0c-86e3-d5296074b720 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:24.248046 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1961/3923] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:27:24 2022] PUT /identity/v3/projects/62f9873b2e6c418b970c76d0e927a87c/users/0673b055ff614e0f9aaba80784cfb6bd/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:27:24.261477 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d42ff3-e6f4-43f3-9365-5133cad6402d None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:24.261886 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d42ff3-e6f4-43f3-9365-5133cad6402d None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:24.262332 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d42ff3-e6f4-43f3-9365-5133cad6402d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:24.277328 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1963/3924] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:27:24 2022] POST /identity/v3/projects => generated 375 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:27:24.281907 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4eebf06-3d02-4f63-a979-945314ef24d2 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:24.335715 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-16d42ff3-e6f4-43f3-9365-5133cad6402d None None] MFA Rules not processed for user `0673b055ff614e0f9aaba80784cfb6bd`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:27:24.336920 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-16d42ff3-e6f4-43f3-9365-5133cad6402d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:24.385339 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4eebf06-3d02-4f63-a979-945314ef24d2 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:24.397319 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c3287f-53b5-4859-89b9-e68e0395d03c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:24.398069 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c3287f-53b5-4859-89b9-e68e0395d03c admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:24.398347 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c3287f-53b5-4859-89b9-e68e0395d03c admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:24.398616 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c3287f-53b5-4859-89b9-e68e0395d03c admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:24.399310 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c3287f-53b5-4859-89b9-e68e0395d03c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:24.401242 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c3287f-53b5-4859-89b9-e68e0395d03c admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:24.458183 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:27:24.466466 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1964/3925] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:27:24 2022] POST /identity/v3/users => generated 288 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:27:24.469284 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c3287f-53b5-4859-89b9-e68e0395d03c admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:24.505802 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1962/3926] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:27:24 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:27:24.506818 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d42ff3-e6f4-43f3-9365-5133cad6402d None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:24.513151 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c3287f-53b5-4859-89b9-e68e0395d03c admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:24.526917 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d42ff3-e6f4-43f3-9365-5133cad6402d None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:24.529110 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ff58ce-850d-474a-a02b-e93ad7599f53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:24.530798 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ff58ce-850d-474a-a02b-e93ad7599f53 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:24.533143 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ff58ce-850d-474a-a02b-e93ad7599f53 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:24.533386 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ff58ce-850d-474a-a02b-e93ad7599f53 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:24.534416 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ff58ce-850d-474a-a02b-e93ad7599f53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:24.537565 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ff58ce-850d-474a-a02b-e93ad7599f53 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:24.541389 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a3f3d8-8c52-4c01-b321-86c25d1a70f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:24.542843 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a3f3d8-8c52-4c01-b321-86c25d1a70f1 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:24.543132 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a3f3d8-8c52-4c01-b321-86c25d1a70f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:24.543378 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a3f3d8-8c52-4c01-b321-86c25d1a70f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:24.544453 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a3f3d8-8c52-4c01-b321-86c25d1a70f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:24.545992 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a3f3d8-8c52-4c01-b321-86c25d1a70f1 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:24.549519 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:27:24.564306 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1965/3927] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:27:24 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:27:24.568705 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ff58ce-850d-474a-a02b-e93ad7599f53 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:24.582458 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ff58ce-850d-474a-a02b-e93ad7599f53 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:24.589007 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2e76f4-365e-423f-bf3f-c9b89e597df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:24.589699 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2e76f4-365e-423f-bf3f-c9b89e597df0 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:24.590089 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2e76f4-365e-423f-bf3f-c9b89e597df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:24.590738 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2e76f4-365e-423f-bf3f-c9b89e597df0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:24.591427 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2e76f4-365e-423f-bf3f-c9b89e597df0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:24.594206 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2e76f4-365e-423f-bf3f-c9b89e597df0 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:24.609812 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1963/3928] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:27:24 2022] POST /identity/v3/projects => generated 401 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:27:24.613854 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1966/3929] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:27:24 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 21:27:24.615252 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a3f3d8-8c52-4c01-b321-86c25d1a70f1 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:24.618469 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2e76f4-365e-423f-bf3f-c9b89e597df0 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:24.634764 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2e76f4-365e-423f-bf3f-c9b89e597df0 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:24.731614 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a3f3d8-8c52-4c01-b321-86c25d1a70f1 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:24.739341 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc99dec5-86f3-45fb-af35-dd4d5f21c986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:24.740680 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc99dec5-86f3-45fb-af35-dd4d5f21c986 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:24.741237 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc99dec5-86f3-45fb-af35-dd4d5f21c986 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:24.741693 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc99dec5-86f3-45fb-af35-dd4d5f21c986 admin admin] PATH_INFO: `/v3/projects/14af6366e2a44b918b14ed9cf5137a1b/users/da80b9f2ac5b4309acbf9814b2e1e095/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:24.754638 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe95891-11dc-4026-a72e-4c3277d5e65a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:24.755570 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe95891-11dc-4026-a72e-4c3277d5e65a admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:24.756211 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe95891-11dc-4026-a72e-4c3277d5e65a admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:24.756535 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe95891-11dc-4026-a72e-4c3277d5e65a admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:24.757193 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe95891-11dc-4026-a72e-4c3277d5e65a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:24.759459 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe95891-11dc-4026-a72e-4c3277d5e65a admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:24.774167 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc99dec5-86f3-45fb-af35-dd4d5f21c986 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14af6366e2a44b918b14ed9cf5137a1b, user_id=da80b9f2ac5b4309acbf9814b2e1e095, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:24.778881 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc99dec5-86f3-45fb-af35-dd4d5f21c986 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:24.827500 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1964/3930] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:27:24 2022] PUT /identity/v3/projects/14af6366e2a44b918b14ed9cf5137a1b/users/da80b9f2ac5b4309acbf9814b2e1e095/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:27:24.849524 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6221a26-9c48-4a37-a0c4-517bef19a720 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:24.849524 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6221a26-9c48-4a37-a0c4-517bef19a720 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:24.849524 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6221a26-9c48-4a37-a0c4-517bef19a720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:24.858590 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1967/3931] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:27:24 2022] POST /identity/v3/users => generated 307 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:27:24.862623 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe95891-11dc-4026-a72e-4c3277d5e65a admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:24.896137 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe95891-11dc-4026-a72e-4c3277d5e65a admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:24.908656 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-e6221a26-9c48-4a37-a0c4-517bef19a720 None None] MFA Rules not processed for user `da80b9f2ac5b4309acbf9814b2e1e095`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:27:24.910046 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-e6221a26-9c48-4a37-a0c4-517bef19a720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:25.132966 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1965/3932] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:27:24 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:27:25.133966 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6221a26-9c48-4a37-a0c4-517bef19a720 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:25.161851 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9570d930-3c92-4eb9-a790-c98b1a33074c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:25.165555 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9570d930-3c92-4eb9-a790-c98b1a33074c admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:25.167383 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9570d930-3c92-4eb9-a790-c98b1a33074c admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:25.167765 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9570d930-3c92-4eb9-a790-c98b1a33074c admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:25.169978 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9570d930-3c92-4eb9-a790-c98b1a33074c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:25.175295 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9570d930-3c92-4eb9-a790-c98b1a33074c admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:25.178224 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6221a26-9c48-4a37-a0c4-517bef19a720 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:25.200096 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208eb979-5e99-442c-a260-e3dee4e6efdb tempest-IdentityV3UsersTest-1588861045 tempest-IdentityV3UsersTest-1588861045-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da80b9f2ac5b4309acbf9814b2e1e095', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14af6366e2a44b918b14ed9cf5137a1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:25.203467 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208eb979-5e99-442c-a260-e3dee4e6efdb tempest-IdentityV3UsersTest-1588861045 tempest-IdentityV3UsersTest-1588861045-project] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:25.203767 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208eb979-5e99-442c-a260-e3dee4e6efdb tempest-IdentityV3UsersTest-1588861045 tempest-IdentityV3UsersTest-1588861045-project] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:25.204048 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208eb979-5e99-442c-a260-e3dee4e6efdb tempest-IdentityV3UsersTest-1588861045 tempest-IdentityV3UsersTest-1588861045-project] PATH_INFO: `/v3/users/da80b9f2ac5b4309acbf9814b2e1e095/password` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:25.220682 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1968/3933] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:27:24 2022] GET /identity/v3/roles => generated 1420 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 21:27:25.221739 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9570d930-3c92-4eb9-a790-c98b1a33074c admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:25.265031 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9570d930-3c92-4eb9-a790-c98b1a33074c admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:25.293170 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478d4b55-cae2-49fb-8e6a-4d24d461e0ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:25.294132 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478d4b55-cae2-49fb-8e6a-4d24d461e0ac admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:25.294413 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478d4b55-cae2-49fb-8e6a-4d24d461e0ac admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:25.294688 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478d4b55-cae2-49fb-8e6a-4d24d461e0ac admin admin] PATH_INFO: `/v3/projects/bf86be7edac74e1d9c89acddab0571c0/users/021fb5f4de19438e91966f67c2b84afb/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:25.318408 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-208eb979-5e99-442c-a260-e3dee4e6efdb tempest-IdentityV3UsersTest-1588861045 tempest-IdentityV3UsersTest-1588861045-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'da80b9f2ac5b4309acbf9814b2e1e095'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:25.324495 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478d4b55-cae2-49fb-8e6a-4d24d461e0ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf86be7edac74e1d9c89acddab0571c0, user_id=021fb5f4de19438e91966f67c2b84afb, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:25.331521 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478d4b55-cae2-49fb-8e6a-4d24d461e0ac admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:25.344364 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1966/3934] 10.222.0.17 () {60 vars in 1268 bytes} [Sat Jul 23 21:27:25 2022] POST /identity/v3/users/da80b9f2ac5b4309acbf9814b2e1e095/password => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:27:25.385381 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1969/3935] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:27:25 2022] PUT /identity/v3/projects/bf86be7edac74e1d9c89acddab0571c0/users/021fb5f4de19438e91966f67c2b84afb/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:27:25.386742 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208eb979-5e99-442c-a260-e3dee4e6efdb tempest-IdentityV3UsersTest-1588861045 tempest-IdentityV3UsersTest-1588861045-project] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:25.396981 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:UPDATE=1,keystone:DELETE=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:27:25.406626 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208eb979-5e99-442c-a260-e3dee4e6efdb tempest-IdentityV3UsersTest-1588861045 tempest-IdentityV3UsersTest-1588861045-project] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:25.622351 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c494432-1879-4a7f-a179-bc6678ea254d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:25.623259 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c494432-1879-4a7f-a179-bc6678ea254d admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:25.624508 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c494432-1879-4a7f-a179-bc6678ea254d admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:25.624886 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c494432-1879-4a7f-a179-bc6678ea254d admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:25.625817 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c494432-1879-4a7f-a179-bc6678ea254d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:25.632686 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c494432-1879-4a7f-a179-bc6678ea254d admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:25.664618 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478d4b55-cae2-49fb-8e6a-4d24d461e0ac admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:25.673012 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1967/3936] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:27:25 2022] GET /identity/v3/roles => generated 1420 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 21:27:25.680805 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478d4b55-cae2-49fb-8e6a-4d24d461e0ac admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:25.695019 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b8836e-9c4b-44b0-a06a-2dce9252124f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:25.696838 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b8836e-9c4b-44b0-a06a-2dce9252124f admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:25.699271 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b8836e-9c4b-44b0-a06a-2dce9252124f admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:25.699825 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b8836e-9c4b-44b0-a06a-2dce9252124f admin admin] PATH_INFO: `/v3/projects/bf86be7edac74e1d9c89acddab0571c0/users/021fb5f4de19438e91966f67c2b84afb/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:25.710347 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b8836e-9c4b-44b0-a06a-2dce9252124f admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf86be7edac74e1d9c89acddab0571c0, user_id=021fb5f4de19438e91966f67c2b84afb, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:25.721391 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b8836e-9c4b-44b0-a06a-2dce9252124f admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:25.782810 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c153493-18f0-4dca-a65a-6d2ee2a01798 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:25.783817 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c153493-18f0-4dca-a65a-6d2ee2a01798 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:25.784249 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c153493-18f0-4dca-a65a-6d2ee2a01798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:25.785786 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1970/3937] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:27:25 2022] PUT /identity/v3/projects/bf86be7edac74e1d9c89acddab0571c0/users/021fb5f4de19438e91966f67c2b84afb/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:27:25.854252 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-5c153493-18f0-4dca-a65a-6d2ee2a01798 None None] MFA Rules not processed for user `021fb5f4de19438e91966f67c2b84afb`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:27:25.855847 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-5c153493-18f0-4dca-a65a-6d2ee2a01798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:25.982324 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1968/3938] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:27:25 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:27:25.987129 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b8836e-9c4b-44b0-a06a-2dce9252124f admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:26.009782 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b8836e-9c4b-44b0-a06a-2dce9252124f admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:26.023269 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dba85f-4e2d-4cd0-8cac-188231feefcf tempest-ApplicationCredentialsV3AdminTest-282620870 tempest-ApplicationCredentialsV3AdminTest-282620870-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '021fb5f4de19438e91966f67c2b84afb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf86be7edac74e1d9c89acddab0571c0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:26.027067 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dba85f-4e2d-4cd0-8cac-188231feefcf tempest-ApplicationCredentialsV3AdminTest-282620870 tempest-ApplicationCredentialsV3AdminTest-282620870-project-admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:26.027475 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dba85f-4e2d-4cd0-8cac-188231feefcf tempest-ApplicationCredentialsV3AdminTest-282620870 tempest-ApplicationCredentialsV3AdminTest-282620870-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:26.027888 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dba85f-4e2d-4cd0-8cac-188231feefcf tempest-ApplicationCredentialsV3AdminTest-282620870 tempest-ApplicationCredentialsV3AdminTest-282620870-project-admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:26.028768 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dba85f-4e2d-4cd0-8cac-188231feefcf tempest-ApplicationCredentialsV3AdminTest-282620870 tempest-ApplicationCredentialsV3AdminTest-282620870-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:26.031482 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dba85f-4e2d-4cd0-8cac-188231feefcf tempest-ApplicationCredentialsV3AdminTest-282620870 tempest-ApplicationCredentialsV3AdminTest-282620870-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:26.052796 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1971/3939] 10.222.0.17 () {60 vars in 1142 bytes} [Sat Jul 23 21:27:25 2022] POST /identity/v3/roles => generated 239 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:27:26.057149 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c153493-18f0-4dca-a65a-6d2ee2a01798 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:26.068149 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c153493-18f0-4dca-a65a-6d2ee2a01798 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:26.076372 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2ab1cb-4c45-4620-ab44-acee864d05de tempest-ApplicationCredentialsV3AdminTest-282620870 tempest-ApplicationCredentialsV3AdminTest-282620870-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '021fb5f4de19438e91966f67c2b84afb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf86be7edac74e1d9c89acddab0571c0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:26.077600 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2ab1cb-4c45-4620-ab44-acee864d05de tempest-ApplicationCredentialsV3AdminTest-282620870 tempest-ApplicationCredentialsV3AdminTest-282620870-project-admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:26.078053 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2ab1cb-4c45-4620-ab44-acee864d05de tempest-ApplicationCredentialsV3AdminTest-282620870 tempest-ApplicationCredentialsV3AdminTest-282620870-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:26.078566 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2ab1cb-4c45-4620-ab44-acee864d05de tempest-ApplicationCredentialsV3AdminTest-282620870 tempest-ApplicationCredentialsV3AdminTest-282620870-project-admin] PATH_INFO: `/v3/projects/62f9873b2e6c418b970c76d0e927a87c/users/0673b055ff614e0f9aaba80784cfb6bd/roles/0d74320dd54646648ab42e4c4c651edc` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:26.082436 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2ab1cb-4c45-4620-ab44-acee864d05de tempest-ApplicationCredentialsV3AdminTest-282620870 tempest-ApplicationCredentialsV3AdminTest-282620870-project-admin] RBAC: Authorizing `identity:create_grant(project_id=62f9873b2e6c418b970c76d0e927a87c, user_id=0673b055ff614e0f9aaba80784cfb6bd, role_id=0d74320dd54646648ab42e4c4c651edc)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:26.086675 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2ab1cb-4c45-4620-ab44-acee864d05de tempest-ApplicationCredentialsV3AdminTest-282620870 tempest-ApplicationCredentialsV3AdminTest-282620870-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:26.111335 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1969/3940] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:27:26 2022] PUT /identity/v3/projects/62f9873b2e6c418b970c76d0e927a87c/users/0673b055ff614e0f9aaba80784cfb6bd/roles/0d74320dd54646648ab42e4c4c651edc => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:27:26.115850 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dba85f-4e2d-4cd0-8cac-188231feefcf tempest-ApplicationCredentialsV3AdminTest-282620870 tempest-ApplicationCredentialsV3AdminTest-282620870-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:26.176355 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:27:26.269390 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dba85f-4e2d-4cd0-8cac-188231feefcf tempest-ApplicationCredentialsV3AdminTest-282620870 tempest-ApplicationCredentialsV3AdminTest-282620870-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:26.348179 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f71c21-0ba4-411b-a5f0-564f03c68b65 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:26.348763 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f71c21-0ba4-411b-a5f0-564f03c68b65 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:26.348763 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f71c21-0ba4-411b-a5f0-564f03c68b65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:26.358223 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8157d9-9d97-46cb-bf0a-da046043ced0 tempest-ApplicationCredentialsV3AdminTest-1267716736 tempest-ApplicationCredentialsV3AdminTest-1267716736-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0673b055ff614e0f9aaba80784cfb6bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f9873b2e6c418b970c76d0e927a87c', 'project_domain_id': 'default', 'roles': ['tempest-test_role-970695589', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:26.359149 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8157d9-9d97-46cb-bf0a-da046043ced0 tempest-ApplicationCredentialsV3AdminTest-1267716736 tempest-ApplicationCredentialsV3AdminTest-1267716736-project] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:26.359545 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8157d9-9d97-46cb-bf0a-da046043ced0 tempest-ApplicationCredentialsV3AdminTest-1267716736 tempest-ApplicationCredentialsV3AdminTest-1267716736-project] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:26.359762 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8157d9-9d97-46cb-bf0a-da046043ced0 tempest-ApplicationCredentialsV3AdminTest-1267716736 tempest-ApplicationCredentialsV3AdminTest-1267716736-project] PATH_INFO: `/v3/users/0673b055ff614e0f9aaba80784cfb6bd/application_credentials` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:26.360514 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8157d9-9d97-46cb-bf0a-da046043ced0 tempest-ApplicationCredentialsV3AdminTest-1267716736 tempest-ApplicationCredentialsV3AdminTest-1267716736-project] RBAC: Authorizing `identity:create_application_credential(user_id=0673b055ff614e0f9aaba80784cfb6bd)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:26.362129 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8157d9-9d97-46cb-bf0a-da046043ced0 tempest-ApplicationCredentialsV3AdminTest-1267716736 tempest-ApplicationCredentialsV3AdminTest-1267716736-project] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:26.373745 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-83f71c21-0ba4-411b-a5f0-564f03c68b65 None None] MFA Rules not processed for user `da80b9f2ac5b4309acbf9814b2e1e095`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:27:26.377419 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-83f71c21-0ba4-411b-a5f0-564f03c68b65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:26.380565 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1970/3941] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:27:26 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 23 21:27:26.385567 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08492360-3c1b-4648-a686-6f2df41f6abb None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:26.386036 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08492360-3c1b-4648-a686-6f2df41f6abb None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:26.386320 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08492360-3c1b-4648-a686-6f2df41f6abb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:26.421102 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-08492360-3c1b-4648-a686-6f2df41f6abb None None] MFA Rules not processed for user `da80b9f2ac5b4309acbf9814b2e1e095`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:27:26.426983 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-08492360-3c1b-4648-a686-6f2df41f6abb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:26.497958 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1972/3942] 10.222.0.17 () {60 vars in 1314 bytes} [Sat Jul 23 21:27:26 2022] POST /identity/v3/users/0673b055ff614e0f9aaba80784cfb6bd/application_credentials => generated 659 bytes in 382 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:27:26.501639 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75564df3-0301-49b6-9b74-4c5c3dc9b9de None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:26.502755 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75564df3-0301-49b6-9b74-4c5c3dc9b9de None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:26.505290 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75564df3-0301-49b6-9b74-4c5c3dc9b9de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:26.542496 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-75564df3-0301-49b6-9b74-4c5c3dc9b9de None None] MFA Rules not processed for user `0673b055ff614e0f9aaba80784cfb6bd`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:27:26.543824 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-75564df3-0301-49b6-9b74-4c5c3dc9b9de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:26.568846 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1971/3943] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:27:26 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:27:26.572937 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08492360-3c1b-4648-a686-6f2df41f6abb None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:26.589668 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08492360-3c1b-4648-a686-6f2df41f6abb None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:26.605906 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c75d63-49f2-4877-bd97-6f4f029ab8d0 tempest-IdentityV3UsersTest-1588861045 tempest-IdentityV3UsersTest-1588861045-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da80b9f2ac5b4309acbf9814b2e1e095', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14af6366e2a44b918b14ed9cf5137a1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:26.607026 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c75d63-49f2-4877-bd97-6f4f029ab8d0 tempest-IdentityV3UsersTest-1588861045 tempest-IdentityV3UsersTest-1588861045-project] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:26.607314 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c75d63-49f2-4877-bd97-6f4f029ab8d0 tempest-IdentityV3UsersTest-1588861045 tempest-IdentityV3UsersTest-1588861045-project] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:26.607587 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c75d63-49f2-4877-bd97-6f4f029ab8d0 tempest-IdentityV3UsersTest-1588861045 tempest-IdentityV3UsersTest-1588861045-project] PATH_INFO: `/v3/users/da80b9f2ac5b4309acbf9814b2e1e095/password` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:26.636270 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:27:26.639030 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:27:26.747094 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-62c75d63-49f2-4877-bd97-6f4f029ab8d0 tempest-IdentityV3UsersTest-1588861045 tempest-IdentityV3UsersTest-1588861045-project] The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2.: keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Jul 23 21:27:26.747094 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 21:27:26.747094 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 21:27:26.747094 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 21:27:26.747094 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 21:27:26.747094 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 21:27:26.747094 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 21:27:26.747094 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 21:27:26.747094 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 21:27:26.747094 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 21:27:26.747094 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 21:27:26.747094 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 21:27:26.747094 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Jul 23 21:27:26.747998 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return f(*args, **kwargs) Jul 23 21:27:26.747998 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 291, in post Jul 23 21:27:26.747998 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application PROVIDERS.identity_api.change_password( Jul 23 21:27:26.747998 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 21:27:26.747998 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 21:27:26.747998 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 23 21:27:26.747998 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 23 21:27:26.747998 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1468, in change_password Jul 23 21:27:26.747998 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application driver.change_password(entity_id, new_password) Jul 23 21:27:26.747998 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 268, in change_password Jul 23 21:27:26.747998 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application self._validate_password_history(new_password, user_ref) Jul 23 21:27:26.747998 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 256, in _validate_password_history Jul 23 21:27:26.747998 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.PasswordHistoryValidationError( Jul 23 21:27:26.747998 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Jul 23 21:27:26.747998 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 21:27:26.752294 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1972/3944] 10.222.0.17 () {60 vars in 1268 bytes} [Sat Jul 23 21:27:26 2022] POST /identity/v3/users/da80b9f2ac5b4309acbf9814b2e1e095/password => generated 188 bytes in 178 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Jul 23 21:27:26.754481 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c75d63-49f2-4877-bd97-6f4f029ab8d0 tempest-IdentityV3UsersTest-1588861045 tempest-IdentityV3UsersTest-1588861045-project] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:26.772961 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c75d63-49f2-4877-bd97-6f4f029ab8d0 tempest-IdentityV3UsersTest-1588861045 tempest-IdentityV3UsersTest-1588861045-project] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:26.786131 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70396669-1502-4015-b8e2-aa02f2f9c2a1 tempest-IdentityV3UsersTest-1588861045 tempest-IdentityV3UsersTest-1588861045-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da80b9f2ac5b4309acbf9814b2e1e095', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14af6366e2a44b918b14ed9cf5137a1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:26.787213 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70396669-1502-4015-b8e2-aa02f2f9c2a1 tempest-IdentityV3UsersTest-1588861045 tempest-IdentityV3UsersTest-1588861045-project] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:26.787545 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70396669-1502-4015-b8e2-aa02f2f9c2a1 tempest-IdentityV3UsersTest-1588861045 tempest-IdentityV3UsersTest-1588861045-project] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:26.787853 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70396669-1502-4015-b8e2-aa02f2f9c2a1 tempest-IdentityV3UsersTest-1588861045 tempest-IdentityV3UsersTest-1588861045-project] PATH_INFO: `/v3/users/da80b9f2ac5b4309acbf9814b2e1e095/password` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:26.795825 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1973/3945] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:27:26 2022] POST /identity/v3/auth/tokens => generated 3386 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Jul 23 21:27:26.797697 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75564df3-0301-49b6-9b74-4c5c3dc9b9de None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:26.800071 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-75564df3-0301-49b6-9b74-4c5c3dc9b9de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:26.897941 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-70396669-1502-4015-b8e2-aa02f2f9c2a1 tempest-IdentityV3UsersTest-1588861045 tempest-IdentityV3UsersTest-1588861045-project] The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2.: keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Jul 23 21:27:26.897941 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 21:27:26.897941 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 21:27:26.897941 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 21:27:26.897941 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 21:27:26.897941 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 21:27:26.897941 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 21:27:26.897941 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 21:27:26.897941 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 21:27:26.897941 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 21:27:26.897941 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 21:27:26.897941 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 21:27:26.897941 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Jul 23 21:27:26.899061 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return f(*args, **kwargs) Jul 23 21:27:26.899061 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 291, in post Jul 23 21:27:26.899061 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application PROVIDERS.identity_api.change_password( Jul 23 21:27:26.899061 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 21:27:26.899061 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 21:27:26.899061 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 23 21:27:26.899061 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 23 21:27:26.899061 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1468, in change_password Jul 23 21:27:26.899061 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application driver.change_password(entity_id, new_password) Jul 23 21:27:26.899061 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 268, in change_password Jul 23 21:27:26.899061 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application self._validate_password_history(new_password, user_ref) Jul 23 21:27:26.899061 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 256, in _validate_password_history Jul 23 21:27:26.899061 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.PasswordHistoryValidationError( Jul 23 21:27:26.899061 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Jul 23 21:27:26.899061 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 21:27:26.904187 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1973/3946] 10.222.0.17 () {60 vars in 1268 bytes} [Sat Jul 23 21:27:26 2022] POST /identity/v3/users/da80b9f2ac5b4309acbf9814b2e1e095/password => generated 188 bytes in 150 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Jul 23 21:27:26.905175 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70396669-1502-4015-b8e2-aa02f2f9c2a1 tempest-IdentityV3UsersTest-1588861045 tempest-IdentityV3UsersTest-1588861045-project] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:26.932971 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70396669-1502-4015-b8e2-aa02f2f9c2a1 tempest-IdentityV3UsersTest-1588861045 tempest-IdentityV3UsersTest-1588861045-project] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:26.943099 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38421164-bd84-4642-a21f-5c31cf21d126 tempest-ApplicationCredentialsV3AdminTest-1267716736 tempest-ApplicationCredentialsV3AdminTest-1267716736-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0673b055ff614e0f9aaba80784cfb6bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62f9873b2e6c418b970c76d0e927a87c', 'project_domain_id': 'default', 'roles': ['tempest-test_role-970695589', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:26.947685 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38421164-bd84-4642-a21f-5c31cf21d126 tempest-ApplicationCredentialsV3AdminTest-1267716736 tempest-ApplicationCredentialsV3AdminTest-1267716736-project] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:26.947977 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38421164-bd84-4642-a21f-5c31cf21d126 tempest-ApplicationCredentialsV3AdminTest-1267716736 tempest-ApplicationCredentialsV3AdminTest-1267716736-project] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:26.948258 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38421164-bd84-4642-a21f-5c31cf21d126 tempest-ApplicationCredentialsV3AdminTest-1267716736 tempest-ApplicationCredentialsV3AdminTest-1267716736-project] PATH_INFO: `/v3/users/0673b055ff614e0f9aaba80784cfb6bd/application_credentials/03d108a9d4fb421ab9e3f727c2b29b22` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:26.949687 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38421164-bd84-4642-a21f-5c31cf21d126 tempest-ApplicationCredentialsV3AdminTest-1267716736 tempest-ApplicationCredentialsV3AdminTest-1267716736-project] RBAC: Authorizing `identity:delete_application_credential(user_id=0673b055ff614e0f9aaba80784cfb6bd, application_credential_id=03d108a9d4fb421ab9e3f727c2b29b22)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:26.954746 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38421164-bd84-4642-a21f-5c31cf21d126 tempest-ApplicationCredentialsV3AdminTest-1267716736 tempest-ApplicationCredentialsV3AdminTest-1267716736-project] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:27.008864 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75564df3-0301-49b6-9b74-4c5c3dc9b9de None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:27.017794 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1974/3947] 10.222.0.17 () {58 vars in 1394 bytes} [Sat Jul 23 21:27:26 2022] DELETE /identity/v3/users/0673b055ff614e0f9aaba80784cfb6bd/application_credentials/03d108a9d4fb421ab9e3f727c2b29b22 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:27:27.018846 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38421164-bd84-4642-a21f-5c31cf21d126 tempest-ApplicationCredentialsV3AdminTest-1267716736 tempest-ApplicationCredentialsV3AdminTest-1267716736-project] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:27.019499 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811eece0-d823-41f7-b934-c53e6ae814c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:27.020710 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811eece0-d823-41f7-b934-c53e6ae814c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:27.023018 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811eece0-d823-41f7-b934-c53e6ae814c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:27.023623 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811eece0-d823-41f7-b934-c53e6ae814c8 admin admin] PATH_INFO: `/v3/users/dffbe88f71ae4f2180f89d18f234a016` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:27.025441 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811eece0-d823-41f7-b934-c53e6ae814c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dffbe88f71ae4f2180f89d18f234a016)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:27.027757 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811eece0-d823-41f7-b934-c53e6ae814c8 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:27.044040 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38421164-bd84-4642-a21f-5c31cf21d126 tempest-ApplicationCredentialsV3AdminTest-1267716736 tempest-ApplicationCredentialsV3AdminTest-1267716736-project] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:27.053112 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8ba0b8-39eb-4c89-ae4a-ebf1ce499941 tempest-IdentityV3UsersTest-1588861045 tempest-IdentityV3UsersTest-1588861045-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da80b9f2ac5b4309acbf9814b2e1e095', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14af6366e2a44b918b14ed9cf5137a1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:27.053379 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8ba0b8-39eb-4c89-ae4a-ebf1ce499941 tempest-IdentityV3UsersTest-1588861045 tempest-IdentityV3UsersTest-1588861045-project] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:27.053753 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8ba0b8-39eb-4c89-ae4a-ebf1ce499941 tempest-IdentityV3UsersTest-1588861045 tempest-IdentityV3UsersTest-1588861045-project] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:27.056272 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8ba0b8-39eb-4c89-ae4a-ebf1ce499941 tempest-IdentityV3UsersTest-1588861045 tempest-IdentityV3UsersTest-1588861045-project] PATH_INFO: `/v3/users/da80b9f2ac5b4309acbf9814b2e1e095/password` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:27.150407 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-811eece0-d823-41f7-b934-c53e6ae814c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dffbe88f71ae4f2180f89d18f234a016'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:27.158609 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-9c8ba0b8-39eb-4c89-ae4a-ebf1ce499941 tempest-IdentityV3UsersTest-1588861045 tempest-IdentityV3UsersTest-1588861045-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'da80b9f2ac5b4309acbf9814b2e1e095'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:27.172758 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-811eece0-d823-41f7-b934-c53e6ae814c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dffbe88f71ae4f2180f89d18f234a016'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:27.174481 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-811eece0-d823-41f7-b934-c53e6ae814c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dffbe88f71ae4f2180f89d18f234a016'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:27.179716 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1975/3948] 10.222.0.17 () {60 vars in 1268 bytes} [Sat Jul 23 21:27:27 2022] POST /identity/v3/users/da80b9f2ac5b4309acbf9814b2e1e095/password => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:27:27.180336 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8ba0b8-39eb-4c89-ae4a-ebf1ce499941 tempest-IdentityV3UsersTest-1588861045 tempest-IdentityV3UsersTest-1588861045-project] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:27.200965 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-811eece0-d823-41f7-b934-c53e6ae814c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dffbe88f71ae4f2180f89d18f234a016'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:27.234025 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-811eece0-d823-41f7-b934-c53e6ae814c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dffbe88f71ae4f2180f89d18f234a016'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:27.263240 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1974/3949] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:27:26 2022] DELETE /identity/v3/users/dffbe88f71ae4f2180f89d18f234a016 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:27:27.267814 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996ed10f-9b73-45db-8da3-7ee87c8a16a0 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:27.277195 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996ed10f-9b73-45db-8da3-7ee87c8a16a0 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:27.277195 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996ed10f-9b73-45db-8da3-7ee87c8a16a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:27.313743 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-996ed10f-9b73-45db-8da3-7ee87c8a16a0 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:27:27.315039 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-996ed10f-9b73-45db-8da3-7ee87c8a16a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:27.362133 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8ba0b8-39eb-4c89-ae4a-ebf1ce499941 tempest-IdentityV3UsersTest-1588861045 tempest-IdentityV3UsersTest-1588861045-project] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:27.367985 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:27:27.454507 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1975/3950] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:27:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:27:27.470428 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8e09e1-5ec5-4df8-9600-1dda606c62d2 tempest-ApplicationCredentialsV3AdminTest-282620870 tempest-ApplicationCredentialsV3AdminTest-282620870-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '021fb5f4de19438e91966f67c2b84afb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf86be7edac74e1d9c89acddab0571c0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:27.471924 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8e09e1-5ec5-4df8-9600-1dda606c62d2 tempest-ApplicationCredentialsV3AdminTest-282620870 tempest-ApplicationCredentialsV3AdminTest-282620870-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:27.472418 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8e09e1-5ec5-4df8-9600-1dda606c62d2 tempest-ApplicationCredentialsV3AdminTest-282620870 tempest-ApplicationCredentialsV3AdminTest-282620870-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:27.472686 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8e09e1-5ec5-4df8-9600-1dda606c62d2 tempest-ApplicationCredentialsV3AdminTest-282620870 tempest-ApplicationCredentialsV3AdminTest-282620870-project-admin] PATH_INFO: `/v3/roles/0d74320dd54646648ab42e4c4c651edc` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:27.473612 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996ed10f-9b73-45db-8da3-7ee87c8a16a0 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:27.474448 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8e09e1-5ec5-4df8-9600-1dda606c62d2 tempest-ApplicationCredentialsV3AdminTest-282620870 tempest-ApplicationCredentialsV3AdminTest-282620870-project-admin] RBAC: Authorizing `identity:delete_role(role_id=0d74320dd54646648ab42e4c4c651edc)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:27.475980 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-996ed10f-9b73-45db-8da3-7ee87c8a16a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:27.476340 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8e09e1-5ec5-4df8-9600-1dda606c62d2 tempest-ApplicationCredentialsV3AdminTest-282620870 tempest-ApplicationCredentialsV3AdminTest-282620870-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:27.499723 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:UPDATE=1,keystone:INSERT=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:27:27.539023 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-1b8e09e1-5ec5-4df8-9600-1dda606c62d2 tempest-ApplicationCredentialsV3AdminTest-282620870 tempest-ApplicationCredentialsV3AdminTest-282620870-project-admin] Invalidating the token cache because role 0d74320dd54646648ab42e4c4c651edc has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:27:27.540294 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-1b8e09e1-5ec5-4df8-9600-1dda606c62d2 tempest-ApplicationCredentialsV3AdminTest-282620870 tempest-ApplicationCredentialsV3AdminTest-282620870-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:27.541314 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-1b8e09e1-5ec5-4df8-9600-1dda606c62d2 tempest-ApplicationCredentialsV3AdminTest-282620870 tempest-ApplicationCredentialsV3AdminTest-282620870-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:27.549591 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1976/3951] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:27:27 2022] DELETE /identity/v3/roles/0d74320dd54646648ab42e4c4c651edc => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:27:27.550858 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8e09e1-5ec5-4df8-9600-1dda606c62d2 tempest-ApplicationCredentialsV3AdminTest-282620870 tempest-ApplicationCredentialsV3AdminTest-282620870-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:27.552888 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-1b8e09e1-5ec5-4df8-9600-1dda606c62d2 tempest-ApplicationCredentialsV3AdminTest-282620870 tempest-ApplicationCredentialsV3AdminTest-282620870-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:27.566116 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996ed10f-9b73-45db-8da3-7ee87c8a16a0 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:27.636150 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3edae22-353a-4015-98fd-d99a6b8a2317 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:27.636933 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3edae22-353a-4015-98fd-d99a6b8a2317 service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:27.637214 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3edae22-353a-4015-98fd-d99a6b8a2317 service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:27.637488 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3edae22-353a-4015-98fd-d99a6b8a2317 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:27.639687 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-e3edae22-353a-4015-98fd-d99a6b8a2317 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:27.738533 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8e09e1-5ec5-4df8-9600-1dda606c62d2 tempest-ApplicationCredentialsV3AdminTest-282620870 tempest-ApplicationCredentialsV3AdminTest-282620870-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:27.740253 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3edae22-353a-4015-98fd-d99a6b8a2317 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:27.741727 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3edae22-353a-4015-98fd-d99a6b8a2317 service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:27.744456 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8aae20-b31c-4797-9560-c3145d6a9c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:27.745367 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8aae20-b31c-4797-9560-c3145d6a9c1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:27.745646 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8aae20-b31c-4797-9560-c3145d6a9c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:27.745958 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8aae20-b31c-4797-9560-c3145d6a9c1f admin admin] PATH_INFO: `/v3/users/0673b055ff614e0f9aaba80784cfb6bd` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:27.747392 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8aae20-b31c-4797-9560-c3145d6a9c1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0673b055ff614e0f9aaba80784cfb6bd)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:27.750227 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8aae20-b31c-4797-9560-c3145d6a9c1f admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:27.761495 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1976/3952] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:27:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:27:27.850280 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-3c8aae20-b31c-4797-9560-c3145d6a9c1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0673b055ff614e0f9aaba80784cfb6bd'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:27.851866 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-3c8aae20-b31c-4797-9560-c3145d6a9c1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0673b055ff614e0f9aaba80784cfb6bd'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:27.870246 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-3c8aae20-b31c-4797-9560-c3145d6a9c1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0673b055ff614e0f9aaba80784cfb6bd'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:27.889326 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-3c8aae20-b31c-4797-9560-c3145d6a9c1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0673b055ff614e0f9aaba80784cfb6bd'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:27.916210 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-3c8aae20-b31c-4797-9560-c3145d6a9c1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0673b055ff614e0f9aaba80784cfb6bd'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:27.930024 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1977/3953] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:27:27 2022] DELETE /identity/v3/users/0673b055ff614e0f9aaba80784cfb6bd => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:27:27.935137 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed00f842-7ce3-4bd8-8f8e-d1577f5f96a0 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:27.935534 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed00f842-7ce3-4bd8-8f8e-d1577f5f96a0 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:27.935880 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed00f842-7ce3-4bd8-8f8e-d1577f5f96a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:27.961847 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-ed00f842-7ce3-4bd8-8f8e-d1577f5f96a0 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:27:27.963333 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-ed00f842-7ce3-4bd8-8f8e-d1577f5f96a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:28.017739 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:27:28.065789 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1977/3954] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:27:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:27:28.116431 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8aae20-b31c-4797-9560-c3145d6a9c1f admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:28.117957 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-3c8aae20-b31c-4797-9560-c3145d6a9c1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:28.184975 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a200dba-70a4-4303-8443-59ac3a9f3fa2 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:28.185187 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a200dba-70a4-4303-8443-59ac3a9f3fa2 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:28.185431 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a200dba-70a4-4303-8443-59ac3a9f3fa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:28.221029 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-8a200dba-70a4-4303-8443-59ac3a9f3fa2 None None] MFA Rules not processed for user `da80b9f2ac5b4309acbf9814b2e1e095`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:27:28.222279 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-8a200dba-70a4-4303-8443-59ac3a9f3fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:28.232958 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8aae20-b31c-4797-9560-c3145d6a9c1f admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:28.237044 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c961e9e6-32a3-486e-9618-1b2079d7578d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:28.237703 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c961e9e6-32a3-486e-9618-1b2079d7578d service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:28.238061 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c961e9e6-32a3-486e-9618-1b2079d7578d service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:28.238333 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c961e9e6-32a3-486e-9618-1b2079d7578d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:28.246177 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1978/3955] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:27:28 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 23 21:27:28.251327 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580470bc-e4dc-4c29-b2c9-14d3ebc9eb87 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:28.251661 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580470bc-e4dc-4c29-b2c9-14d3ebc9eb87 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:28.251939 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580470bc-e4dc-4c29-b2c9-14d3ebc9eb87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:28.266587 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c961e9e6-32a3-486e-9618-1b2079d7578d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:28.271662 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c961e9e6-32a3-486e-9618-1b2079d7578d service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:28.296841 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1978/3956] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:27:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:27:28.313689 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-580470bc-e4dc-4c29-b2c9-14d3ebc9eb87 None None] MFA Rules not processed for user `da80b9f2ac5b4309acbf9814b2e1e095`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:27:28.317554 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-580470bc-e4dc-4c29-b2c9-14d3ebc9eb87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:28.457735 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1979/3957] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:27:28 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:27:28.458681 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c961e9e6-32a3-486e-9618-1b2079d7578d service neutron] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:28.472362 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c961e9e6-32a3-486e-9618-1b2079d7578d service neutron] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:28.477015 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb044861-00a3-4d2d-a9e1-a239fdcdd830 tempest-IdentityV3UsersTest-1588861045 tempest-IdentityV3UsersTest-1588861045-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da80b9f2ac5b4309acbf9814b2e1e095', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14af6366e2a44b918b14ed9cf5137a1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:28.477898 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb044861-00a3-4d2d-a9e1-a239fdcdd830 tempest-IdentityV3UsersTest-1588861045 tempest-IdentityV3UsersTest-1588861045-project] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:28.478188 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb044861-00a3-4d2d-a9e1-a239fdcdd830 tempest-IdentityV3UsersTest-1588861045 tempest-IdentityV3UsersTest-1588861045-project] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:28.478458 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb044861-00a3-4d2d-a9e1-a239fdcdd830 tempest-IdentityV3UsersTest-1588861045 tempest-IdentityV3UsersTest-1588861045-project] PATH_INFO: `/v3/users/da80b9f2ac5b4309acbf9814b2e1e095/password` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:28.482190 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:27:28.567697 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-cb044861-00a3-4d2d-a9e1-a239fdcdd830 tempest-IdentityV3UsersTest-1588861045 tempest-IdentityV3UsersTest-1588861045-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'da80b9f2ac5b4309acbf9814b2e1e095'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:28.584558 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1979/3958] 10.222.0.17 () {60 vars in 1268 bytes} [Sat Jul 23 21:27:28 2022] POST /identity/v3/users/da80b9f2ac5b4309acbf9814b2e1e095/password => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:27:29.007181 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580470bc-e4dc-4c29-b2c9-14d3ebc9eb87 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:29.009395 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-580470bc-e4dc-4c29-b2c9-14d3ebc9eb87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:29.024893 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580470bc-e4dc-4c29-b2c9-14d3ebc9eb87 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:29.036550 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db93f363-8585-405e-9ec1-bd6e3e572518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:29.038062 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db93f363-8585-405e-9ec1-bd6e3e572518 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:29.038582 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db93f363-8585-405e-9ec1-bd6e3e572518 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:29.039557 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db93f363-8585-405e-9ec1-bd6e3e572518 admin admin] PATH_INFO: `/v3/projects/7a91417f3a6b47c7b1acc77c350a6aa2` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:29.042372 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db93f363-8585-405e-9ec1-bd6e3e572518 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a91417f3a6b47c7b1acc77c350a6aa2)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:29.045892 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db93f363-8585-405e-9ec1-bd6e3e572518 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:29.112879 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-db93f363-8585-405e-9ec1-bd6e3e572518 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a91417f3a6b47c7b1acc77c350a6aa2', 'request_id': 'req-db93f363-8585-405e-9ec1-bd6e3e572518'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:29.125385 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-db93f363-8585-405e-9ec1-bd6e3e572518 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a91417f3a6b47c7b1acc77c350a6aa2', 'request_id': 'req-db93f363-8585-405e-9ec1-bd6e3e572518'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:29.136546 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-db93f363-8585-405e-9ec1-bd6e3e572518 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a91417f3a6b47c7b1acc77c350a6aa2', 'request_id': 'req-db93f363-8585-405e-9ec1-bd6e3e572518'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:29.153803 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-db93f363-8585-405e-9ec1-bd6e3e572518 admin admin] The token cache is being invalidate because project 7a91417f3a6b47c7b1acc77c350a6aa2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:27:29.154225 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-db93f363-8585-405e-9ec1-bd6e3e572518 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:29.155031 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-db93f363-8585-405e-9ec1-bd6e3e572518 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:29.163459 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1980/3959] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:27:29 2022] DELETE /identity/v3/projects/7a91417f3a6b47c7b1acc77c350a6aa2 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:27:29.165082 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d79dd24-fadd-428d-bf20-b809c4a82594 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:29.165630 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d79dd24-fadd-428d-bf20-b809c4a82594 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:29.165938 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d79dd24-fadd-428d-bf20-b809c4a82594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:29.202660 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-4d79dd24-fadd-428d-bf20-b809c4a82594 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:27:29.204183 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-4d79dd24-fadd-428d-bf20-b809c4a82594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:29.300796 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1980/3960] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:27:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:27:29.309754 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b59921b-7eb2-4055-ae95-b81796e46ede None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:29.310331 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b59921b-7eb2-4055-ae95-b81796e46ede None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:29.311145 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b59921b-7eb2-4055-ae95-b81796e46ede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:29.341497 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d79dd24-fadd-428d-bf20-b809c4a82594 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:29.344142 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-4d79dd24-fadd-428d-bf20-b809c4a82594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:29.358981 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d79dd24-fadd-428d-bf20-b809c4a82594 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:29.363758 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-1b59921b-7eb2-4055-ae95-b81796e46ede None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:27:29.367350 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-1b59921b-7eb2-4055-ae95-b81796e46ede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:29.375135 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acc3f70-0cb7-46fc-baf2-75498cf46c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:29.376055 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acc3f70-0cb7-46fc-baf2-75498cf46c22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:29.376338 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acc3f70-0cb7-46fc-baf2-75498cf46c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:29.376609 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acc3f70-0cb7-46fc-baf2-75498cf46c22 admin admin] PATH_INFO: `/v3/projects/62f9873b2e6c418b970c76d0e927a87c` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:29.377964 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acc3f70-0cb7-46fc-baf2-75498cf46c22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=62f9873b2e6c418b970c76d0e927a87c)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:29.380309 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acc3f70-0cb7-46fc-baf2-75498cf46c22 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:29.386699 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1981/3961] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:27:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:27:29.401996 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b59921b-7eb2-4055-ae95-b81796e46ede None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:29.427336 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b59921b-7eb2-4055-ae95-b81796e46ede None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:29.438996 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40d33e7-935c-4fba-a600-915b0fd62e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:29.440165 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40d33e7-935c-4fba-a600-915b0fd62e12 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:29.440544 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40d33e7-935c-4fba-a600-915b0fd62e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:29.440826 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40d33e7-935c-4fba-a600-915b0fd62e12 admin admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:29.441787 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40d33e7-935c-4fba-a600-915b0fd62e12 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:27:29.442374 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40d33e7-935c-4fba-a600-915b0fd62e12 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:29.444152 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40d33e7-935c-4fba-a600-915b0fd62e12 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:29.464638 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1982/3962] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:27:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:27:29.470070 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40d33e7-935c-4fba-a600-915b0fd62e12 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:29.483222 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40d33e7-935c-4fba-a600-915b0fd62e12 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:29.499990 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-4acc3f70-0cb7-46fc-baf2-75498cf46c22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62f9873b2e6c418b970c76d0e927a87c', 'request_id': 'req-4acc3f70-0cb7-46fc-baf2-75498cf46c22'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:29.520899 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-4acc3f70-0cb7-46fc-baf2-75498cf46c22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62f9873b2e6c418b970c76d0e927a87c', 'request_id': 'req-4acc3f70-0cb7-46fc-baf2-75498cf46c22'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:29.522329 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:27:29.531324 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-4acc3f70-0cb7-46fc-baf2-75498cf46c22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62f9873b2e6c418b970c76d0e927a87c', 'request_id': 'req-4acc3f70-0cb7-46fc-baf2-75498cf46c22'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:29.545825 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-4acc3f70-0cb7-46fc-baf2-75498cf46c22 admin admin] The token cache is being invalidate because project 62f9873b2e6c418b970c76d0e927a87c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:27:29.546319 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-4acc3f70-0cb7-46fc-baf2-75498cf46c22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:29.547134 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-4acc3f70-0cb7-46fc-baf2-75498cf46c22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:29.548943 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1981/3963] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:27:29 2022] DELETE /identity/v3/projects/62f9873b2e6c418b970c76d0e927a87c => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:27:29.562281 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acc3f70-0cb7-46fc-baf2-75498cf46c22 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:29.563955 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-4acc3f70-0cb7-46fc-baf2-75498cf46c22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:29.564887 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f962ea-e71e-4707-bea4-507bad4107ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:29.565580 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f962ea-e71e-4707-bea4-507bad4107ac admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:29.565896 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f962ea-e71e-4707-bea4-507bad4107ac admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:29.566158 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f962ea-e71e-4707-bea4-507bad4107ac admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:29.566856 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f962ea-e71e-4707-bea4-507bad4107ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:29.571847 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f962ea-e71e-4707-bea4-507bad4107ac admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:29.580144 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acc3f70-0cb7-46fc-baf2-75498cf46c22 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:29.589605 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec2a04c-44e7-416c-a264-0d6b863b2708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:29.591510 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec2a04c-44e7-416c-a264-0d6b863b2708 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:29.591995 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec2a04c-44e7-416c-a264-0d6b863b2708 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:29.592437 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec2a04c-44e7-416c-a264-0d6b863b2708 admin admin] PATH_INFO: `/v3/users/021fb5f4de19438e91966f67c2b84afb` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:29.593751 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec2a04c-44e7-416c-a264-0d6b863b2708 admin admin] RBAC: Authorizing `identity:delete_user(user_id=021fb5f4de19438e91966f67c2b84afb)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:29.595753 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec2a04c-44e7-416c-a264-0d6b863b2708 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:29.618273 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1983/3964] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:27:29 2022] POST /identity/v3/projects => generated 383 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:27:29.619752 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a18b450-ee95-47b3-978c-f9cc2af6ea65 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:29.620309 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a18b450-ee95-47b3-978c-f9cc2af6ea65 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:29.620727 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a18b450-ee95-47b3-978c-f9cc2af6ea65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:29.645205 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-2a18b450-ee95-47b3-978c-f9cc2af6ea65 None None] MFA Rules not processed for user `da80b9f2ac5b4309acbf9814b2e1e095`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:27:29.646489 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-2a18b450-ee95-47b3-978c-f9cc2af6ea65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:29.650670 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1984/3965] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:27:29 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 23 21:27:29.651818 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a18b450-ee95-47b3-978c-f9cc2af6ea65 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:29.653764 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-2a18b450-ee95-47b3-978c-f9cc2af6ea65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:29.686396 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-fec2a04c-44e7-416c-a264-0d6b863b2708 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '021fb5f4de19438e91966f67c2b84afb'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:29.688068 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-fec2a04c-44e7-416c-a264-0d6b863b2708 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '021fb5f4de19438e91966f67c2b84afb'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:29.691418 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=80,keystone:UPDATE=1,keystone:INSERT=3,keystone:DELETE=16 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:27:29.698659 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-fec2a04c-44e7-416c-a264-0d6b863b2708 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '021fb5f4de19438e91966f67c2b84afb'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:29.712374 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-fec2a04c-44e7-416c-a264-0d6b863b2708 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '021fb5f4de19438e91966f67c2b84afb'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:29.740549 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-fec2a04c-44e7-416c-a264-0d6b863b2708 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '021fb5f4de19438e91966f67c2b84afb'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:29.754841 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1982/3966] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:27:29 2022] DELETE /identity/v3/users/021fb5f4de19438e91966f67c2b84afb => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:27:29.757453 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85091813-27de-4405-b039-d770c922ece4 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:29.757809 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85091813-27de-4405-b039-d770c922ece4 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:29.758122 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85091813-27de-4405-b039-d770c922ece4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:29.783911 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a18b450-ee95-47b3-978c-f9cc2af6ea65 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:29.795211 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-85091813-27de-4405-b039-d770c922ece4 None None] MFA Rules not processed for user `da80b9f2ac5b4309acbf9814b2e1e095`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:27:29.796699 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-85091813-27de-4405-b039-d770c922ece4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:29.872683 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305e709a-a5e7-4fa5-acb1-f7c0ec0fd2f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:29.874143 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305e709a-a5e7-4fa5-acb1-f7c0ec0fd2f4 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:29.874620 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305e709a-a5e7-4fa5-acb1-f7c0ec0fd2f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:29.875314 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305e709a-a5e7-4fa5-acb1-f7c0ec0fd2f4 admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:29.876198 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305e709a-a5e7-4fa5-acb1-f7c0ec0fd2f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:29.878369 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305e709a-a5e7-4fa5-acb1-f7c0ec0fd2f4 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:29.905909 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1985/3967] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:27:29 2022] POST /identity/v3/users => generated 292 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:27:29.909714 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305e709a-a5e7-4fa5-acb1-f7c0ec0fd2f4 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:29.910247 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1983/3968] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:27:29 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:27:29.912338 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85091813-27de-4405-b039-d770c922ece4 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:29.914966 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-305e709a-a5e7-4fa5-acb1-f7c0ec0fd2f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:29.927565 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85091813-27de-4405-b039-d770c922ece4 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:29.930928 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305e709a-a5e7-4fa5-acb1-f7c0ec0fd2f4 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:29.938402 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479a4446-326c-40b2-8f22-d5293131688b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:29.939325 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479a4446-326c-40b2-8f22-d5293131688b admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:29.939672 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479a4446-326c-40b2-8f22-d5293131688b admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:29.940335 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479a4446-326c-40b2-8f22-d5293131688b admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:29.941227 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479a4446-326c-40b2-8f22-d5293131688b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:29.955188 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60807a1-58d4-4c2c-b8b5-96276d52f901 tempest-IdentityV3UsersTest-1588861045 tempest-IdentityV3UsersTest-1588861045-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da80b9f2ac5b4309acbf9814b2e1e095', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14af6366e2a44b918b14ed9cf5137a1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:29.956256 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60807a1-58d4-4c2c-b8b5-96276d52f901 tempest-IdentityV3UsersTest-1588861045 tempest-IdentityV3UsersTest-1588861045-project] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:29.958141 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60807a1-58d4-4c2c-b8b5-96276d52f901 tempest-IdentityV3UsersTest-1588861045 tempest-IdentityV3UsersTest-1588861045-project] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:29.958496 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60807a1-58d4-4c2c-b8b5-96276d52f901 tempest-IdentityV3UsersTest-1588861045 tempest-IdentityV3UsersTest-1588861045-project] PATH_INFO: `/v3/users/da80b9f2ac5b4309acbf9814b2e1e095/password` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:29.970257 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479a4446-326c-40b2-8f22-d5293131688b admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:29.984500 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1986/3969] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:27:29 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:27:29.988684 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479a4446-326c-40b2-8f22-d5293131688b admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:30.004276 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479a4446-326c-40b2-8f22-d5293131688b admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:30.015419 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979d5b47-d991-4834-8fa1-4543b723c2d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:30.016205 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979d5b47-d991-4834-8fa1-4543b723c2d2 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:30.016639 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979d5b47-d991-4834-8fa1-4543b723c2d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:30.016935 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979d5b47-d991-4834-8fa1-4543b723c2d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:30.017738 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979d5b47-d991-4834-8fa1-4543b723c2d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:30.019426 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979d5b47-d991-4834-8fa1-4543b723c2d2 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:30.025484 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-e60807a1-58d4-4c2c-b8b5-96276d52f901 tempest-IdentityV3UsersTest-1588861045 tempest-IdentityV3UsersTest-1588861045-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'da80b9f2ac5b4309acbf9814b2e1e095'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:30.035467 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1987/3970] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:27:29 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:27:30.040772 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979d5b47-d991-4834-8fa1-4543b723c2d2 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:30.052620 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979d5b47-d991-4834-8fa1-4543b723c2d2 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:30.054113 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1984/3971] 10.222.0.17 () {60 vars in 1268 bytes} [Sat Jul 23 21:27:29 2022] POST /identity/v3/users/da80b9f2ac5b4309acbf9814b2e1e095/password => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:27:30.061170 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1772e8c-0a23-4cff-8b71-f204f057f1fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:30.062546 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1772e8c-0a23-4cff-8b71-f204f057f1fa admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:30.062976 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1772e8c-0a23-4cff-8b71-f204f057f1fa admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:30.063395 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1772e8c-0a23-4cff-8b71-f204f057f1fa admin admin] PATH_INFO: `/v3/projects/0c005e3bc67b4501949fb72140726a11/users/6411b0f635714320a4f40e9bc5e260e5/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:30.087784 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1772e8c-0a23-4cff-8b71-f204f057f1fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c005e3bc67b4501949fb72140726a11, user_id=6411b0f635714320a4f40e9bc5e260e5, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:30.090568 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1772e8c-0a23-4cff-8b71-f204f057f1fa admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:30.110421 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1988/3972] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:27:30 2022] PUT /identity/v3/projects/0c005e3bc67b4501949fb72140726a11/users/6411b0f635714320a4f40e9bc5e260e5/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:27:30.115927 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e145ab-6b68-450b-937d-40b5bdee6a52 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:30.116337 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e145ab-6b68-450b-937d-40b5bdee6a52 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:30.116713 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e145ab-6b68-450b-937d-40b5bdee6a52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:30.136959 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-79e145ab-6b68-450b-937d-40b5bdee6a52 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:27:30.138336 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-79e145ab-6b68-450b-937d-40b5bdee6a52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:30.240150 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1985/3973] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:27:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:27:30.284765 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1772e8c-0a23-4cff-8b71-f204f057f1fa admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:30.286811 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-e1772e8c-0a23-4cff-8b71-f204f057f1fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:30.295610 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:27:30.358101 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1772e8c-0a23-4cff-8b71-f204f057f1fa admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:30.362205 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5530e504-fb67-4365-9b46-29f7ae717f72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:30.362894 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5530e504-fb67-4365-9b46-29f7ae717f72 service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:30.363168 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5530e504-fb67-4365-9b46-29f7ae717f72 service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:30.363442 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5530e504-fb67-4365-9b46-29f7ae717f72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:30.374085 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5530e504-fb67-4365-9b46-29f7ae717f72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:30.375792 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5530e504-fb67-4365-9b46-29f7ae717f72 service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:30.387327 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1989/3974] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:27:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:27:30.954451 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e145ab-6b68-450b-937d-40b5bdee6a52 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:30.956587 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-79e145ab-6b68-450b-937d-40b5bdee6a52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:30.978329 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e145ab-6b68-450b-937d-40b5bdee6a52 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:30.991041 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8395882-d826-4a21-9347-7abea8671745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:30.994544 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8395882-d826-4a21-9347-7abea8671745 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:30.995961 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8395882-d826-4a21-9347-7abea8671745 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:30.996214 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8395882-d826-4a21-9347-7abea8671745 admin admin] PATH_INFO: `/v3/projects/bf86be7edac74e1d9c89acddab0571c0` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:30.998587 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8395882-d826-4a21-9347-7abea8671745 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf86be7edac74e1d9c89acddab0571c0)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:31.006183 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8395882-d826-4a21-9347-7abea8671745 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:31.059818 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3d359d-6172-4e19-ae3d-eb05bc1e1ebf None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:31.060099 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3d359d-6172-4e19-ae3d-eb05bc1e1ebf None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:31.061275 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3d359d-6172-4e19-ae3d-eb05bc1e1ebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:31.089855 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-5b3d359d-6172-4e19-ae3d-eb05bc1e1ebf None None] MFA Rules not processed for user `da80b9f2ac5b4309acbf9814b2e1e095`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:27:31.092036 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-5b3d359d-6172-4e19-ae3d-eb05bc1e1ebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:31.099910 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1990/3975] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:27:31 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 23 21:27:31.107957 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3acbc7e-fba3-4791-9132-0dba3b070786 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:31.108518 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3acbc7e-fba3-4791-9132-0dba3b070786 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:31.109014 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3acbc7e-fba3-4791-9132-0dba3b070786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:31.109364 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=7,keystone:UPDATE=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:27:31.137713 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-b8395882-d826-4a21-9347-7abea8671745 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf86be7edac74e1d9c89acddab0571c0', 'request_id': 'req-b8395882-d826-4a21-9347-7abea8671745'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:31.147922 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-b3acbc7e-fba3-4791-9132-0dba3b070786 None None] MFA Rules not processed for user `da80b9f2ac5b4309acbf9814b2e1e095`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:27:31.157189 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-b3acbc7e-fba3-4791-9132-0dba3b070786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:31.162784 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-b8395882-d826-4a21-9347-7abea8671745 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf86be7edac74e1d9c89acddab0571c0', 'request_id': 'req-b8395882-d826-4a21-9347-7abea8671745'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:31.169487 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-b8395882-d826-4a21-9347-7abea8671745 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf86be7edac74e1d9c89acddab0571c0', 'request_id': 'req-b8395882-d826-4a21-9347-7abea8671745'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:31.192870 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-b8395882-d826-4a21-9347-7abea8671745 admin admin] The token cache is being invalidate because project bf86be7edac74e1d9c89acddab0571c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:27:31.193163 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-b8395882-d826-4a21-9347-7abea8671745 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:31.195005 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-b8395882-d826-4a21-9347-7abea8671745 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:31.199538 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1986/3976] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:27:30 2022] DELETE /identity/v3/projects/bf86be7edac74e1d9c89acddab0571c0 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:27:31.204242 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc149fa-9720-40ab-98e6-bae306688303 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:31.204532 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc149fa-9720-40ab-98e6-bae306688303 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:31.204839 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc149fa-9720-40ab-98e6-bae306688303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:31.241530 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-8fc149fa-9720-40ab-98e6-bae306688303 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:27:31.245291 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-8fc149fa-9720-40ab-98e6-bae306688303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:31.282441 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1991/3977] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:27:31 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:27:31.285578 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3acbc7e-fba3-4791-9132-0dba3b070786 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:31.334820 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3acbc7e-fba3-4791-9132-0dba3b070786 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:31.341719 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613d10fa-42d6-4d3d-b53b-7632391c8d51 tempest-IdentityV3UsersTest-1588861045 tempest-IdentityV3UsersTest-1588861045-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da80b9f2ac5b4309acbf9814b2e1e095', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14af6366e2a44b918b14ed9cf5137a1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:31.342892 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613d10fa-42d6-4d3d-b53b-7632391c8d51 tempest-IdentityV3UsersTest-1588861045 tempest-IdentityV3UsersTest-1588861045-project] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:31.343563 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613d10fa-42d6-4d3d-b53b-7632391c8d51 tempest-IdentityV3UsersTest-1588861045 tempest-IdentityV3UsersTest-1588861045-project] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:31.344072 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613d10fa-42d6-4d3d-b53b-7632391c8d51 tempest-IdentityV3UsersTest-1588861045 tempest-IdentityV3UsersTest-1588861045-project] PATH_INFO: `/v3/users/da80b9f2ac5b4309acbf9814b2e1e095/password` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:31.416553 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1987/3978] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:27:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:27:31.419196 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-613d10fa-42d6-4d3d-b53b-7632391c8d51 tempest-IdentityV3UsersTest-1588861045 tempest-IdentityV3UsersTest-1588861045-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'da80b9f2ac5b4309acbf9814b2e1e095'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:31.424218 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e81759-c850-48a0-974a-80b8cc651918 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:31.424731 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e81759-c850-48a0-974a-80b8cc651918 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:31.425101 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e81759-c850-48a0-974a-80b8cc651918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:31.448011 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1992/3979] 10.222.0.17 () {60 vars in 1268 bytes} [Sat Jul 23 21:27:31 2022] POST /identity/v3/users/da80b9f2ac5b4309acbf9814b2e1e095/password => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:27:31.463622 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-49e81759-c850-48a0-974a-80b8cc651918 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:27:31.464900 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-49e81759-c850-48a0-974a-80b8cc651918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:31.475638 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1988/3980] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:27:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:27:31.480446 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613d10fa-42d6-4d3d-b53b-7632391c8d51 tempest-IdentityV3UsersTest-1588861045 tempest-IdentityV3UsersTest-1588861045-project] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:31.499257 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613d10fa-42d6-4d3d-b53b-7632391c8d51 tempest-IdentityV3UsersTest-1588861045 tempest-IdentityV3UsersTest-1588861045-project] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:31.505787 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900d7533-f9ec-455a-a3ec-8077251da255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:31.507378 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900d7533-f9ec-455a-a3ec-8077251da255 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:31.507713 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900d7533-f9ec-455a-a3ec-8077251da255 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:31.508322 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900d7533-f9ec-455a-a3ec-8077251da255 admin admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:31.509084 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900d7533-f9ec-455a-a3ec-8077251da255 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:27:31.509375 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900d7533-f9ec-455a-a3ec-8077251da255 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:31.511033 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900d7533-f9ec-455a-a3ec-8077251da255 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:31.528407 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1993/3981] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:27:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:27:31.532908 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e81759-c850-48a0-974a-80b8cc651918 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:31.542825 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e81759-c850-48a0-974a-80b8cc651918 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:31.547918 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd4b5af-1fc6-461d-aa70-b4be8e1e1dbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:31.548402 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd4b5af-1fc6-461d-aa70-b4be8e1e1dbc admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:31.548687 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd4b5af-1fc6-461d-aa70-b4be8e1e1dbc admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:31.548956 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd4b5af-1fc6-461d-aa70-b4be8e1e1dbc admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:31.549699 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd4b5af-1fc6-461d-aa70-b4be8e1e1dbc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:31.552369 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd4b5af-1fc6-461d-aa70-b4be8e1e1dbc admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:31.593085 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1989/3982] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:27:31 2022] POST /identity/v3/projects => generated 391 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:27:31.594146 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900d7533-f9ec-455a-a3ec-8077251da255 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:31.605450 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900d7533-f9ec-455a-a3ec-8077251da255 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:31.675255 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=95,keystone:UPDATE=1,keystone:INSERT=2,keystone:DELETE=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:27:31.684810 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3647230a-bc31-4a65-92c7-ef6e132f5273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:31.685548 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3647230a-bc31-4a65-92c7-ef6e132f5273 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:31.686253 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3647230a-bc31-4a65-92c7-ef6e132f5273 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:31.688743 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3647230a-bc31-4a65-92c7-ef6e132f5273 admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:31.689532 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3647230a-bc31-4a65-92c7-ef6e132f5273 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:31.692421 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3647230a-bc31-4a65-92c7-ef6e132f5273 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:31.719113 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1994/3983] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:27:31 2022] POST /identity/v3/users => generated 296 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:27:31.723685 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd4b5af-1fc6-461d-aa70-b4be8e1e1dbc admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:31.734570 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd4b5af-1fc6-461d-aa70-b4be8e1e1dbc admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:31.739882 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1213bc1-a084-41ee-a591-a0bd28b2dd02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:31.740554 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1213bc1-a084-41ee-a591-a0bd28b2dd02 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:31.740832 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1213bc1-a084-41ee-a591-a0bd28b2dd02 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:31.741106 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1213bc1-a084-41ee-a591-a0bd28b2dd02 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:31.741825 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1213bc1-a084-41ee-a591-a0bd28b2dd02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:31.743463 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1213bc1-a084-41ee-a591-a0bd28b2dd02 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:31.754500 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1990/3984] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:27:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:27:31.758646 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3647230a-bc31-4a65-92c7-ef6e132f5273 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:31.769021 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3647230a-bc31-4a65-92c7-ef6e132f5273 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:31.774187 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4835fcf6-a222-43ee-bb7b-c43133913c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:31.774864 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4835fcf6-a222-43ee-bb7b-c43133913c1e admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:31.775140 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4835fcf6-a222-43ee-bb7b-c43133913c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:31.775412 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4835fcf6-a222-43ee-bb7b-c43133913c1e admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:31.776133 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4835fcf6-a222-43ee-bb7b-c43133913c1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:31.777742 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4835fcf6-a222-43ee-bb7b-c43133913c1e admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:31.788499 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1995/3985] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:27:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 21:27:31.793248 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1213bc1-a084-41ee-a591-a0bd28b2dd02 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:31.804413 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1213bc1-a084-41ee-a591-a0bd28b2dd02 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:31.809319 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87894d8-9c98-4889-997c-3112a6ce329d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:31.810345 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87894d8-9c98-4889-997c-3112a6ce329d admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:31.810696 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87894d8-9c98-4889-997c-3112a6ce329d admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:31.811145 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87894d8-9c98-4889-997c-3112a6ce329d admin admin] PATH_INFO: `/v3/projects/dfcf730c030b41159e2128b5a02faabb/users/0aa1ca8f6ea44d82b847489746f350cb/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:31.829327 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87894d8-9c98-4889-997c-3112a6ce329d admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfcf730c030b41159e2128b5a02faabb, user_id=0aa1ca8f6ea44d82b847489746f350cb, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:31.832232 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87894d8-9c98-4889-997c-3112a6ce329d admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:31.848765 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1991/3986] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:27:31 2022] PUT /identity/v3/projects/dfcf730c030b41159e2128b5a02faabb/users/0aa1ca8f6ea44d82b847489746f350cb/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:27:31.934623 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a944b4-1506-4a1f-ad31-752d9183fcae None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:31.935030 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a944b4-1506-4a1f-ad31-752d9183fcae None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:31.935173 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a944b4-1506-4a1f-ad31-752d9183fcae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:31.965732 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-68a944b4-1506-4a1f-ad31-752d9183fcae None None] MFA Rules not processed for user `0aa1ca8f6ea44d82b847489746f350cb`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:27:31.967900 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-68a944b4-1506-4a1f-ad31-752d9183fcae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:32.071767 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1996/3987] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:27:31 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:27:32.077646 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87894d8-9c98-4889-997c-3112a6ce329d admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:32.155744 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:27:32.160885 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87894d8-9c98-4889-997c-3112a6ce329d admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:32.172227 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132269cf-29d0-4195-8b93-8f2ba15aa763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:32.173271 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132269cf-29d0-4195-8b93-8f2ba15aa763 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:32.174319 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132269cf-29d0-4195-8b93-8f2ba15aa763 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:32.174609 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132269cf-29d0-4195-8b93-8f2ba15aa763 admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:32.175428 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132269cf-29d0-4195-8b93-8f2ba15aa763 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:32.177666 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132269cf-29d0-4195-8b93-8f2ba15aa763 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:32.215921 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1992/3988] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:27:32 2022] POST /identity/v3/projects => generated 391 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:27:32.220248 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a944b4-1506-4a1f-ad31-752d9183fcae None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:32.237203 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a944b4-1506-4a1f-ad31-752d9183fcae None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:32.305211 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13097fff-b8db-406f-b095-bd41af190669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:32.306394 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13097fff-b8db-406f-b095-bd41af190669 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:32.310867 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13097fff-b8db-406f-b095-bd41af190669 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:32.311277 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13097fff-b8db-406f-b095-bd41af190669 admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:32.312163 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13097fff-b8db-406f-b095-bd41af190669 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:32.315210 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13097fff-b8db-406f-b095-bd41af190669 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:32.352773 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1997/3989] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:27:32 2022] POST /identity/v3/users => generated 302 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:27:32.353359 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132269cf-29d0-4195-8b93-8f2ba15aa763 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:32.369752 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132269cf-29d0-4195-8b93-8f2ba15aa763 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:32.376346 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a0fa36-8a87-48f5-98cb-f828b475e70d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:32.377341 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a0fa36-8a87-48f5-98cb-f828b475e70d admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:32.377811 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a0fa36-8a87-48f5-98cb-f828b475e70d admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:32.378320 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a0fa36-8a87-48f5-98cb-f828b475e70d admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:32.379514 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a0fa36-8a87-48f5-98cb-f828b475e70d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:32.382113 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a0fa36-8a87-48f5-98cb-f828b475e70d admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:32.403240 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13097fff-b8db-406f-b095-bd41af190669 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:32.404540 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1993/3990] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:27:32 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:27:32.417012 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13097fff-b8db-406f-b095-bd41af190669 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:32.422246 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3639442-ca1e-4efe-9efa-35ba009ea9b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:32.423834 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3639442-ca1e-4efe-9efa-35ba009ea9b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:32.425503 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3639442-ca1e-4efe-9efa-35ba009ea9b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:32.426037 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3639442-ca1e-4efe-9efa-35ba009ea9b2 admin admin] PATH_INFO: `/v3/projects/8e83f3225a2547ff887f61cb3b55b103/users/be852700449948d3ad94ede728bc82f2/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:32.450166 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3639442-ca1e-4efe-9efa-35ba009ea9b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e83f3225a2547ff887f61cb3b55b103, user_id=be852700449948d3ad94ede728bc82f2, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:32.453354 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3639442-ca1e-4efe-9efa-35ba009ea9b2 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:32.460828 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73371f81-145e-42a2-b867-6c16a765988d None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:32.461220 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73371f81-145e-42a2-b867-6c16a765988d None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:32.461583 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73371f81-145e-42a2-b867-6c16a765988d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:32.482164 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1998/3991] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:27:32 2022] PUT /identity/v3/projects/8e83f3225a2547ff887f61cb3b55b103/users/be852700449948d3ad94ede728bc82f2/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:27:32.483086 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3639442-ca1e-4efe-9efa-35ba009ea9b2 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:32.493923 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-73371f81-145e-42a2-b867-6c16a765988d None None] MFA Rules not processed for user `da80b9f2ac5b4309acbf9814b2e1e095`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:27:32.497097 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-73371f81-145e-42a2-b867-6c16a765988d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:32.506096 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1994/3992] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:27:32 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 23 21:27:32.540424 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:27:32.574739 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3639442-ca1e-4efe-9efa-35ba009ea9b2 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:32.579493 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd6fcd9-8c4c-4538-bd67-bd72003f2cd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:32.580178 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd6fcd9-8c4c-4538-bd67-bd72003f2cd3 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:32.581216 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd6fcd9-8c4c-4538-bd67-bd72003f2cd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:32.581216 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd6fcd9-8c4c-4538-bd67-bd72003f2cd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:32.581751 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd6fcd9-8c4c-4538-bd67-bd72003f2cd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:32.583471 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd6fcd9-8c4c-4538-bd67-bd72003f2cd3 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:32.597321 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 1999/3993] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:27:32 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:27:32.602452 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73371f81-145e-42a2-b867-6c16a765988d None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:32.625896 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73371f81-145e-42a2-b867-6c16a765988d None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:32.632484 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99e4e2c-bea7-413d-aea0-eec7e89649f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:32.633849 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99e4e2c-bea7-413d-aea0-eec7e89649f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:32.633849 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99e4e2c-bea7-413d-aea0-eec7e89649f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:32.633849 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99e4e2c-bea7-413d-aea0-eec7e89649f5 admin admin] PATH_INFO: `/v3/projects/8e83f3225a2547ff887f61cb3b55b103/users/be852700449948d3ad94ede728bc82f2/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:32.637760 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99e4e2c-bea7-413d-aea0-eec7e89649f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e83f3225a2547ff887f61cb3b55b103, user_id=be852700449948d3ad94ede728bc82f2, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:32.640198 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99e4e2c-bea7-413d-aea0-eec7e89649f5 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:32.673483 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1995/3994] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:27:32 2022] PUT /identity/v3/projects/8e83f3225a2547ff887f61cb3b55b103/users/be852700449948d3ad94ede728bc82f2/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:27:32.685306 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afb3126-1027-4a84-afca-7ebf7079b9c1 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:32.685586 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afb3126-1027-4a84-afca-7ebf7079b9c1 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:32.685885 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afb3126-1027-4a84-afca-7ebf7079b9c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:32.736123 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-1afb3126-1027-4a84-afca-7ebf7079b9c1 None None] MFA Rules not processed for user `be852700449948d3ad94ede728bc82f2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:27:32.737532 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-1afb3126-1027-4a84-afca-7ebf7079b9c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:32.879951 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2000/3995] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:27:32 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:27:32.887157 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99e4e2c-bea7-413d-aea0-eec7e89649f5 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:32.908650 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99e4e2c-bea7-413d-aea0-eec7e89649f5 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:32.916374 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1365ad3a-315c-4be8-a319-37ca9a900033 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be852700449948d3ad94ede728bc82f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e83f3225a2547ff887f61cb3b55b103', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:32.917071 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1365ad3a-315c-4be8-a319-37ca9a900033 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:32.917360 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1365ad3a-315c-4be8-a319-37ca9a900033 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:32.917624 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1365ad3a-315c-4be8-a319-37ca9a900033 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:32.918709 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1365ad3a-315c-4be8-a319-37ca9a900033 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:32.920005 ncdv-master-1 devstack@keystone.service[91548]: WARNING py.warnings [None req-1365ad3a-315c-4be8-a319-37ca9a900033 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:27:32.920005 ncdv-master-1 devstack@keystone.service[91548]: warnings.warn(msg) Jul 23 21:27:32.920005 ncdv-master-1 devstack@keystone.service[91548]: Jul 23 21:27:32.921392 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1365ad3a-315c-4be8-a319-37ca9a900033 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:32.942248 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1996/3996] 10.222.0.17 () {60 vars in 1148 bytes} [Sat Jul 23 21:27:32 2022] POST /identity/v3/domains => generated 277 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:27:32.946646 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afb3126-1027-4a84-afca-7ebf7079b9c1 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:32.958145 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afb3126-1027-4a84-afca-7ebf7079b9c1 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:33.082829 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e612c0-e1ac-404e-a609-43735b94b6c6 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be852700449948d3ad94ede728bc82f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e83f3225a2547ff887f61cb3b55b103', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:33.083938 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e612c0-e1ac-404e-a609-43735b94b6c6 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:33.084283 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e612c0-e1ac-404e-a609-43735b94b6c6 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:33.084626 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e612c0-e1ac-404e-a609-43735b94b6c6 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] PATH_INFO: `/v3/domains/9a3cae61052e42b09a34e804dbaa1e76/config` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:33.085458 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e612c0-e1ac-404e-a609-43735b94b6c6 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=9a3cae61052e42b09a34e804dbaa1e76)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:33.086593 ncdv-master-1 devstack@keystone.service[91547]: WARNING py.warnings [None req-d5e612c0-e1ac-404e-a609-43735b94b6c6 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:27:33.086593 ncdv-master-1 devstack@keystone.service[91547]: warnings.warn(msg) Jul 23 21:27:33.086593 ncdv-master-1 devstack@keystone.service[91547]: Jul 23 21:27:33.091114 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e612c0-e1ac-404e-a609-43735b94b6c6 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:33.153667 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2001/3997] 10.222.0.17 () {60 vars in 1268 bytes} [Sat Jul 23 21:27:32 2022] PUT /identity/v3/domains/9a3cae61052e42b09a34e804dbaa1e76/config => generated 138 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:27:33.158771 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1365ad3a-315c-4be8-a319-37ca9a900033 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:33.171155 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1365ad3a-315c-4be8-a319-37ca9a900033 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:33.185438 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fdfdbb-ef32-49b3-9a1f-a77612a171d0 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be852700449948d3ad94ede728bc82f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e83f3225a2547ff887f61cb3b55b103', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:33.186832 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fdfdbb-ef32-49b3-9a1f-a77612a171d0 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:33.187300 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fdfdbb-ef32-49b3-9a1f-a77612a171d0 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:33.187727 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fdfdbb-ef32-49b3-9a1f-a77612a171d0 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] PATH_INFO: `/v3/domains/9a3cae61052e42b09a34e804dbaa1e76/config/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:33.189161 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fdfdbb-ef32-49b3-9a1f-a77612a171d0 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=9a3cae61052e42b09a34e804dbaa1e76, group=identity)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:33.190560 ncdv-master-1 devstack@keystone.service[91548]: WARNING py.warnings [None req-23fdfdbb-ef32-49b3-9a1f-a77612a171d0 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:27:33.190560 ncdv-master-1 devstack@keystone.service[91548]: warnings.warn(msg) Jul 23 21:27:33.190560 ncdv-master-1 devstack@keystone.service[91548]: Jul 23 21:27:33.191813 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fdfdbb-ef32-49b3-9a1f-a77612a171d0 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:33.200360 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1997/3998] 10.222.0.17 () {58 vars in 1274 bytes} [Sat Jul 23 21:27:33 2022] GET /identity/v3/domains/9a3cae61052e42b09a34e804dbaa1e76/config/identity => generated 45 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 23 21:27:33.204680 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e612c0-e1ac-404e-a609-43735b94b6c6 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:33.231336 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e612c0-e1ac-404e-a609-43735b94b6c6 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:33.240467 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fae4823-0fe9-4d07-abd9-acca8a44bc69 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be852700449948d3ad94ede728bc82f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e83f3225a2547ff887f61cb3b55b103', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:33.242087 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fae4823-0fe9-4d07-abd9-acca8a44bc69 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:33.242477 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fae4823-0fe9-4d07-abd9-acca8a44bc69 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:33.242858 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fae4823-0fe9-4d07-abd9-acca8a44bc69 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] PATH_INFO: `/v3/domains/9a3cae61052e42b09a34e804dbaa1e76/config/identity/driver` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:33.244679 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fae4823-0fe9-4d07-abd9-acca8a44bc69 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=9a3cae61052e42b09a34e804dbaa1e76, group=identity, option=driver)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:33.246116 ncdv-master-1 devstack@keystone.service[91547]: WARNING py.warnings [None req-5fae4823-0fe9-4d07-abd9-acca8a44bc69 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:27:33.246116 ncdv-master-1 devstack@keystone.service[91547]: warnings.warn(msg) Jul 23 21:27:33.246116 ncdv-master-1 devstack@keystone.service[91547]: Jul 23 21:27:33.247297 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fae4823-0fe9-4d07-abd9-acca8a44bc69 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:33.258872 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2002/3999] 10.222.0.17 () {58 vars in 1295 bytes} [Sat Jul 23 21:27:33 2022] GET /identity/v3/domains/9a3cae61052e42b09a34e804dbaa1e76/config/identity/driver => generated 31 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 23 21:27:33.259187 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fdfdbb-ef32-49b3-9a1f-a77612a171d0 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:33.272920 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fdfdbb-ef32-49b3-9a1f-a77612a171d0 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:33.280158 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f656a2-22e1-4d8c-b058-09d76a9f3dc3 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be852700449948d3ad94ede728bc82f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e83f3225a2547ff887f61cb3b55b103', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:33.281463 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f656a2-22e1-4d8c-b058-09d76a9f3dc3 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:33.282059 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f656a2-22e1-4d8c-b058-09d76a9f3dc3 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:33.282555 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f656a2-22e1-4d8c-b058-09d76a9f3dc3 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] PATH_INFO: `/v3/domains/9a3cae61052e42b09a34e804dbaa1e76/config/ldap` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:33.284670 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f656a2-22e1-4d8c-b058-09d76a9f3dc3 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=9a3cae61052e42b09a34e804dbaa1e76, group=ldap)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:33.286857 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f656a2-22e1-4d8c-b058-09d76a9f3dc3 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:33.299916 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fae4823-0fe9-4d07-abd9-acca8a44bc69 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:33.310648 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1998/4000] 10.222.0.17 () {58 vars in 1262 bytes} [Sat Jul 23 21:27:33 2022] GET /identity/v3/domains/9a3cae61052e42b09a34e804dbaa1e76/config/ldap => generated 106 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:27:33.312017 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fae4823-0fe9-4d07-abd9-acca8a44bc69 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:33.317458 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382cf7cd-06e5-43dd-9f37-20830622dc07 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be852700449948d3ad94ede728bc82f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e83f3225a2547ff887f61cb3b55b103', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:33.318869 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382cf7cd-06e5-43dd-9f37-20830622dc07 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:33.319349 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382cf7cd-06e5-43dd-9f37-20830622dc07 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:33.319695 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382cf7cd-06e5-43dd-9f37-20830622dc07 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] PATH_INFO: `/v3/domains/9a3cae61052e42b09a34e804dbaa1e76/config/ldap/url` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:33.321926 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382cf7cd-06e5-43dd-9f37-20830622dc07 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=9a3cae61052e42b09a34e804dbaa1e76, group=ldap, option=url)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:33.324368 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382cf7cd-06e5-43dd-9f37-20830622dc07 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:33.335457 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2003/4001] 10.222.0.17 () {58 vars in 1274 bytes} [Sat Jul 23 21:27:33 2022] GET /identity/v3/domains/9a3cae61052e42b09a34e804dbaa1e76/config/ldap/url => generated 46 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 23 21:27:33.337168 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f656a2-22e1-4d8c-b058-09d76a9f3dc3 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:33.348619 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f656a2-22e1-4d8c-b058-09d76a9f3dc3 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:33.354405 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21195fe8-937e-46f7-81e9-1156ecbb577a tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be852700449948d3ad94ede728bc82f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e83f3225a2547ff887f61cb3b55b103', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:33.355397 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21195fe8-937e-46f7-81e9-1156ecbb577a tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:33.355755 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21195fe8-937e-46f7-81e9-1156ecbb577a tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:33.356107 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21195fe8-937e-46f7-81e9-1156ecbb577a tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] PATH_INFO: `/v3/domains/9a3cae61052e42b09a34e804dbaa1e76/config/ldap/user_tree_dn` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:33.357421 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21195fe8-937e-46f7-81e9-1156ecbb577a tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=9a3cae61052e42b09a34e804dbaa1e76, group=ldap, option=user_tree_dn)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:33.359149 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21195fe8-937e-46f7-81e9-1156ecbb577a tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:33.366298 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 1999/4002] 10.222.0.17 () {58 vars in 1301 bytes} [Sat Jul 23 21:27:33 2022] GET /identity/v3/domains/9a3cae61052e42b09a34e804dbaa1e76/config/ldap/user_tree_dn => generated 63 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 23 21:27:33.370458 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382cf7cd-06e5-43dd-9f37-20830622dc07 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:33.381058 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382cf7cd-06e5-43dd-9f37-20830622dc07 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:33.386035 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b459e7e2-16e0-4bc5-839a-357c439b78d9 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be852700449948d3ad94ede728bc82f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e83f3225a2547ff887f61cb3b55b103', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:33.386973 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b459e7e2-16e0-4bc5-839a-357c439b78d9 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:33.387329 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b459e7e2-16e0-4bc5-839a-357c439b78d9 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:33.387674 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b459e7e2-16e0-4bc5-839a-357c439b78d9 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] PATH_INFO: `/v3/domains/9a3cae61052e42b09a34e804dbaa1e76/config` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:33.388420 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b459e7e2-16e0-4bc5-839a-357c439b78d9 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=9a3cae61052e42b09a34e804dbaa1e76)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:33.389528 ncdv-master-1 devstack@keystone.service[91547]: WARNING py.warnings [None req-b459e7e2-16e0-4bc5-839a-357c439b78d9 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:27:33.389528 ncdv-master-1 devstack@keystone.service[91547]: warnings.warn(msg) Jul 23 21:27:33.389528 ncdv-master-1 devstack@keystone.service[91547]: Jul 23 21:27:33.390533 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b459e7e2-16e0-4bc5-839a-357c439b78d9 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:33.392779 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:27:33.402545 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2004/4003] 10.222.0.17 () {58 vars in 1250 bytes} [Sat Jul 23 21:27:33 2022] DELETE /identity/v3/domains/9a3cae61052e42b09a34e804dbaa1e76/config => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:27:33.409024 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21195fe8-937e-46f7-81e9-1156ecbb577a tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:33.420652 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21195fe8-937e-46f7-81e9-1156ecbb577a tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:33.426651 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28974cdf-0e85-4f07-b661-7d7c77d0afb6 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be852700449948d3ad94ede728bc82f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e83f3225a2547ff887f61cb3b55b103', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:33.427842 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28974cdf-0e85-4f07-b661-7d7c77d0afb6 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:33.427842 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28974cdf-0e85-4f07-b661-7d7c77d0afb6 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:33.428127 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28974cdf-0e85-4f07-b661-7d7c77d0afb6 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] PATH_INFO: `/v3/domains/9a3cae61052e42b09a34e804dbaa1e76` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:33.429667 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28974cdf-0e85-4f07-b661-7d7c77d0afb6 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=9a3cae61052e42b09a34e804dbaa1e76)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:33.430868 ncdv-master-1 devstack@keystone.service[91548]: WARNING py.warnings [None req-28974cdf-0e85-4f07-b661-7d7c77d0afb6 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:27:33.430868 ncdv-master-1 devstack@keystone.service[91548]: warnings.warn(msg) Jul 23 21:27:33.430868 ncdv-master-1 devstack@keystone.service[91548]: Jul 23 21:27:33.431933 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28974cdf-0e85-4f07-b661-7d7c77d0afb6 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:33.481262 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-28974cdf-0e85-4f07-b661-7d7c77d0afb6 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '9a3cae61052e42b09a34e804dbaa1e76'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:33.482878 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-28974cdf-0e85-4f07-b661-7d7c77d0afb6 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '9a3cae61052e42b09a34e804dbaa1e76'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:33.508992 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd255d2e-aff8-4139-80f2-49f450fa08f4 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:33.510047 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd255d2e-aff8-4139-80f2-49f450fa08f4 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:33.510546 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd255d2e-aff8-4139-80f2-49f450fa08f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:33.532393 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-dd255d2e-aff8-4139-80f2-49f450fa08f4 None None] MFA Rules not processed for user `da80b9f2ac5b4309acbf9814b2e1e095`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:27:33.534040 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-dd255d2e-aff8-4139-80f2-49f450fa08f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:33.541542 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-28974cdf-0e85-4f07-b661-7d7c77d0afb6 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '9a3cae61052e42b09a34e804dbaa1e76'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:33.544403 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-28974cdf-0e85-4f07-b661-7d7c77d0afb6 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '9a3cae61052e42b09a34e804dbaa1e76'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:33.553852 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2000/4004] 10.222.0.17 () {60 vars in 1248 bytes} [Sat Jul 23 21:27:33 2022] PATCH /identity/v3/domains/9a3cae61052e42b09a34e804dbaa1e76 => generated 278 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 21:27:33.556153 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28974cdf-0e85-4f07-b661-7d7c77d0afb6 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:33.559024 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-28974cdf-0e85-4f07-b661-7d7c77d0afb6 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:33.642983 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2005/4005] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:27:33 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:27:33.650195 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2616e94f-30ba-4864-a064-3ef9c9e55248 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:33.650431 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2616e94f-30ba-4864-a064-3ef9c9e55248 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:33.650601 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2616e94f-30ba-4864-a064-3ef9c9e55248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:33.681623 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28974cdf-0e85-4f07-b661-7d7c77d0afb6 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:33.682403 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-2616e94f-30ba-4864-a064-3ef9c9e55248 None None] MFA Rules not processed for user `da80b9f2ac5b4309acbf9814b2e1e095`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:27:33.683647 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-2616e94f-30ba-4864-a064-3ef9c9e55248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:33.687089 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722b596e-2e2f-4e76-8aaf-3947f2432026 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be852700449948d3ad94ede728bc82f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e83f3225a2547ff887f61cb3b55b103', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:33.688134 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722b596e-2e2f-4e76-8aaf-3947f2432026 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:33.688530 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722b596e-2e2f-4e76-8aaf-3947f2432026 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:33.688888 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722b596e-2e2f-4e76-8aaf-3947f2432026 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] PATH_INFO: `/v3/domains/9a3cae61052e42b09a34e804dbaa1e76` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:33.694491 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2006/4006] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:27:33 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 23 21:27:33.700894 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535be6b1-dc48-4f34-b66a-937f76e57e59 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:33.702371 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535be6b1-dc48-4f34-b66a-937f76e57e59 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:33.702697 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535be6b1-dc48-4f34-b66a-937f76e57e59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:33.704550 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722b596e-2e2f-4e76-8aaf-3947f2432026 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=9a3cae61052e42b09a34e804dbaa1e76)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:33.705695 ncdv-master-1 devstack@keystone.service[91548]: WARNING py.warnings [None req-722b596e-2e2f-4e76-8aaf-3947f2432026 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:27:33.705695 ncdv-master-1 devstack@keystone.service[91548]: warnings.warn(msg) Jul 23 21:27:33.705695 ncdv-master-1 devstack@keystone.service[91548]: Jul 23 21:27:33.706733 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722b596e-2e2f-4e76-8aaf-3947f2432026 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:33.766851 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-722b596e-2e2f-4e76-8aaf-3947f2432026 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '9a3cae61052e42b09a34e804dbaa1e76'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:33.771633 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:UPDATE=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:27:33.790436 ncdv-master-1 devstack@keystone.service[91547]: WARNING keystone.server.flask.application [None req-535be6b1-dc48-4f34-b66a-937f76e57e59 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.17: keystone.exception.Unauthorized: The request you have made requires authentication. Jul 23 21:27:33.797390 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2007/4007] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:27:33 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 99 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Jul 23 21:27:33.798905 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d159497-7dcc-43a0-8482-4e21f8fca72c None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:33.799439 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d159497-7dcc-43a0-8482-4e21f8fca72c None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:33.799653 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d159497-7dcc-43a0-8482-4e21f8fca72c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:33.814590 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-722b596e-2e2f-4e76-8aaf-3947f2432026 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '9a3cae61052e42b09a34e804dbaa1e76'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:33.894229 ncdv-master-1 devstack@keystone.service[91547]: WARNING keystone.server.flask.application [None req-8d159497-7dcc-43a0-8482-4e21f8fca72c None None] Authorization failed. The request you have made requires authentication. from 10.222.0.17: keystone.exception.Unauthorized: The request you have made requires authentication. Jul 23 21:27:33.900367 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2008/4008] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:27:33 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 102 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Jul 23 21:27:33.908441 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15b8a6a-f420-4e78-b373-0e8cfca0d2cf None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:33.910075 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15b8a6a-f420-4e78-b373-0e8cfca0d2cf None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:33.910361 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15b8a6a-f420-4e78-b373-0e8cfca0d2cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:33.923698 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-722b596e-2e2f-4e76-8aaf-3947f2432026 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a3cae61052e42b09a34e804dbaa1e76', 'request_id': 'req-722b596e-2e2f-4e76-8aaf-3947f2432026'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:33.945910 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-722b596e-2e2f-4e76-8aaf-3947f2432026 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a3cae61052e42b09a34e804dbaa1e76', 'request_id': 'req-722b596e-2e2f-4e76-8aaf-3947f2432026'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:33.958848 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-722b596e-2e2f-4e76-8aaf-3947f2432026 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a3cae61052e42b09a34e804dbaa1e76', 'request_id': 'req-722b596e-2e2f-4e76-8aaf-3947f2432026'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:33.975134 ncdv-master-1 devstack@keystone.service[91547]: WARNING keystone.server.flask.application [None req-c15b8a6a-f420-4e78-b373-0e8cfca0d2cf None None] Authorization failed. The request you have made requires authentication. from 10.222.0.17: keystone.exception.Unauthorized: The request you have made requires authentication. Jul 23 21:27:33.981191 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2009/4009] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:27:33 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 75 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Jul 23 21:27:33.985953 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-722b596e-2e2f-4e76-8aaf-3947f2432026 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] The token cache is being invalidate because project 9a3cae61052e42b09a34e804dbaa1e76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:27:33.986583 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-722b596e-2e2f-4e76-8aaf-3947f2432026 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:33.987639 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-722b596e-2e2f-4e76-8aaf-3947f2432026 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:34.001746 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-722b596e-2e2f-4e76-8aaf-3947f2432026 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '9a3cae61052e42b09a34e804dbaa1e76', 'request_id': 'req-722b596e-2e2f-4e76-8aaf-3947f2432026'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:34.005901 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-722b596e-2e2f-4e76-8aaf-3947f2432026 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '9a3cae61052e42b09a34e804dbaa1e76', 'request_id': 'req-722b596e-2e2f-4e76-8aaf-3947f2432026'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:34.006918 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-722b596e-2e2f-4e76-8aaf-3947f2432026 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '9a3cae61052e42b09a34e804dbaa1e76', 'request_id': 'req-722b596e-2e2f-4e76-8aaf-3947f2432026'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:34.017922 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2001/4010] 10.222.0.17 () {58 vars in 1229 bytes} [Sat Jul 23 21:27:33 2022] DELETE /identity/v3/domains/9a3cae61052e42b09a34e804dbaa1e76 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:27:34.019286 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15b8a6a-f420-4e78-b373-0e8cfca0d2cf None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:34.021346 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-c15b8a6a-f420-4e78-b373-0e8cfca0d2cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:34.122407 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15b8a6a-f420-4e78-b373-0e8cfca0d2cf None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:34.127804 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9a9843-3779-4f5d-b02b-cba35805ac2e tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be852700449948d3ad94ede728bc82f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e83f3225a2547ff887f61cb3b55b103', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:34.129048 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9a9843-3779-4f5d-b02b-cba35805ac2e tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:34.129625 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9a9843-3779-4f5d-b02b-cba35805ac2e tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:34.130132 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9a9843-3779-4f5d-b02b-cba35805ac2e tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:34.131106 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9a9843-3779-4f5d-b02b-cba35805ac2e tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:34.132348 ncdv-master-1 devstack@keystone.service[91547]: WARNING py.warnings [None req-ea9a9843-3779-4f5d-b02b-cba35805ac2e tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:27:34.132348 ncdv-master-1 devstack@keystone.service[91547]: warnings.warn(msg) Jul 23 21:27:34.132348 ncdv-master-1 devstack@keystone.service[91547]: Jul 23 21:27:34.133608 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9a9843-3779-4f5d-b02b-cba35805ac2e tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:34.153736 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2010/4011] 10.222.0.17 () {60 vars in 1148 bytes} [Sat Jul 23 21:27:34 2022] POST /identity/v3/domains => generated 276 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:27:34.158072 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722b596e-2e2f-4e76-8aaf-3947f2432026 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:34.172639 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722b596e-2e2f-4e76-8aaf-3947f2432026 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:34.236124 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4856796e-51f2-44fb-9313-f63796756954 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be852700449948d3ad94ede728bc82f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e83f3225a2547ff887f61cb3b55b103', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:34.237759 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4856796e-51f2-44fb-9313-f63796756954 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:34.238495 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4856796e-51f2-44fb-9313-f63796756954 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:34.239208 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4856796e-51f2-44fb-9313-f63796756954 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] PATH_INFO: `/v3/domains/62b4be47fb624ab7be1647ce7be11a8f/config` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:34.241013 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4856796e-51f2-44fb-9313-f63796756954 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=62b4be47fb624ab7be1647ce7be11a8f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:34.242708 ncdv-master-1 devstack@keystone.service[91548]: WARNING py.warnings [None req-4856796e-51f2-44fb-9313-f63796756954 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:27:34.242708 ncdv-master-1 devstack@keystone.service[91548]: warnings.warn(msg) Jul 23 21:27:34.242708 ncdv-master-1 devstack@keystone.service[91548]: Jul 23 21:27:34.243561 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4856796e-51f2-44fb-9313-f63796756954 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:34.294688 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2002/4012] 10.222.0.17 () {60 vars in 1268 bytes} [Sat Jul 23 21:27:34 2022] PUT /identity/v3/domains/62b4be47fb624ab7be1647ce7be11a8f/config => generated 138 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:27:34.298976 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9a9843-3779-4f5d-b02b-cba35805ac2e tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:34.309742 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9a9843-3779-4f5d-b02b-cba35805ac2e tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:34.314382 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a6f487-4fe3-4568-98be-1bda18a5aa97 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be852700449948d3ad94ede728bc82f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e83f3225a2547ff887f61cb3b55b103', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:34.315239 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a6f487-4fe3-4568-98be-1bda18a5aa97 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:34.315521 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a6f487-4fe3-4568-98be-1bda18a5aa97 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:34.315784 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a6f487-4fe3-4568-98be-1bda18a5aa97 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] PATH_INFO: `/v3/domains/62b4be47fb624ab7be1647ce7be11a8f/config` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:34.316557 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a6f487-4fe3-4568-98be-1bda18a5aa97 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=62b4be47fb624ab7be1647ce7be11a8f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:34.317668 ncdv-master-1 devstack@keystone.service[91547]: WARNING py.warnings [None req-22a6f487-4fe3-4568-98be-1bda18a5aa97 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:27:34.317668 ncdv-master-1 devstack@keystone.service[91547]: warnings.warn(msg) Jul 23 21:27:34.317668 ncdv-master-1 devstack@keystone.service[91547]: Jul 23 21:27:34.318580 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a6f487-4fe3-4568-98be-1bda18a5aa97 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:34.351293 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2011/4013] 10.222.0.17 () {60 vars in 1270 bytes} [Sat Jul 23 21:27:34 2022] PATCH /identity/v3/domains/62b4be47fb624ab7be1647ce7be11a8f/config => generated 142 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:27:34.355755 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4856796e-51f2-44fb-9313-f63796756954 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:34.367168 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4856796e-51f2-44fb-9313-f63796756954 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:34.372376 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774a42a4-79c8-4612-871b-b26b9a89b972 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be852700449948d3ad94ede728bc82f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e83f3225a2547ff887f61cb3b55b103', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:34.373307 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774a42a4-79c8-4612-871b-b26b9a89b972 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:34.373660 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774a42a4-79c8-4612-871b-b26b9a89b972 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:34.374049 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774a42a4-79c8-4612-871b-b26b9a89b972 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] PATH_INFO: `/v3/domains/62b4be47fb624ab7be1647ce7be11a8f/config` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:34.375472 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774a42a4-79c8-4612-871b-b26b9a89b972 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=62b4be47fb624ab7be1647ce7be11a8f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:34.377178 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774a42a4-79c8-4612-871b-b26b9a89b972 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:34.386448 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2003/4014] 10.222.0.17 () {58 vars in 1247 bytes} [Sat Jul 23 21:27:34 2022] GET /identity/v3/domains/62b4be47fb624ab7be1647ce7be11a8f/config => generated 142 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 21:27:34.388107 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a6f487-4fe3-4568-98be-1bda18a5aa97 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:34.399164 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a6f487-4fe3-4568-98be-1bda18a5aa97 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:34.404188 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4145539-8b0e-48cc-adc5-c4ae576def5b tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be852700449948d3ad94ede728bc82f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e83f3225a2547ff887f61cb3b55b103', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:34.405141 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4145539-8b0e-48cc-adc5-c4ae576def5b tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:34.405521 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4145539-8b0e-48cc-adc5-c4ae576def5b tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:34.405960 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4145539-8b0e-48cc-adc5-c4ae576def5b tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] PATH_INFO: `/v3/domains/62b4be47fb624ab7be1647ce7be11a8f/config` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:34.406639 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4145539-8b0e-48cc-adc5-c4ae576def5b tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=62b4be47fb624ab7be1647ce7be11a8f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:34.408339 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4145539-8b0e-48cc-adc5-c4ae576def5b tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:34.411419 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:DELETE=8,keystone:SELECT=86,keystone:UPDATE=2,keystone:INSERT=4 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:27:34.425124 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2012/4015] 10.222.0.17 () {58 vars in 1250 bytes} [Sat Jul 23 21:27:34 2022] DELETE /identity/v3/domains/62b4be47fb624ab7be1647ce7be11a8f/config => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:27:34.429292 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774a42a4-79c8-4612-871b-b26b9a89b972 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:34.445665 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774a42a4-79c8-4612-871b-b26b9a89b972 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:34.453456 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cd568c-01bc-48ad-a873-787e20cd3c43 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be852700449948d3ad94ede728bc82f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e83f3225a2547ff887f61cb3b55b103', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:34.454686 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cd568c-01bc-48ad-a873-787e20cd3c43 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:34.455191 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cd568c-01bc-48ad-a873-787e20cd3c43 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:34.455679 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cd568c-01bc-48ad-a873-787e20cd3c43 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] PATH_INFO: `/v3/domains/62b4be47fb624ab7be1647ce7be11a8f/config` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:34.458704 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cd568c-01bc-48ad-a873-787e20cd3c43 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=62b4be47fb624ab7be1647ce7be11a8f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:34.461307 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cd568c-01bc-48ad-a873-787e20cd3c43 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:34.476175 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-77cd568c-01bc-48ad-a873-787e20cd3c43 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Could not find any options in domain configuration for domain 62b4be47fb624ab7be1647ce7be11a8f.: keystone.exception.DomainConfigNotFound: Could not find any options in domain configuration for domain 62b4be47fb624ab7be1647ce7be11a8f. Jul 23 21:27:34.476175 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 21:27:34.476175 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 21:27:34.476175 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 21:27:34.476175 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 21:27:34.476175 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 21:27:34.476175 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 21:27:34.476175 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 21:27:34.476175 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 21:27:34.476175 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 21:27:34.476175 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 21:27:34.476175 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 21:27:34.476175 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 179, in get Jul 23 21:27:34.477147 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application config = self._get_config(domain_id, group, option) Jul 23 21:27:34.477147 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 186, in _get_config Jul 23 21:27:34.477147 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return PROVIDERS.domain_config_api.get_config( Jul 23 21:27:34.477147 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 21:27:34.477147 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 21:27:34.477147 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 1266, in get_config Jul 23 21:27:34.477147 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.DomainConfigNotFound( Jul 23 21:27:34.477147 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.DomainConfigNotFound: Could not find any options in domain configuration for domain 62b4be47fb624ab7be1647ce7be11a8f. Jul 23 21:27:34.477147 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 21:27:34.479450 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2004/4016] 10.222.0.17 () {58 vars in 1247 bytes} [Sat Jul 23 21:27:34 2022] GET /identity/v3/domains/62b4be47fb624ab7be1647ce7be11a8f/config => generated 151 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 23 21:27:34.483788 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4145539-8b0e-48cc-adc5-c4ae576def5b tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:34.496132 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4145539-8b0e-48cc-adc5-c4ae576def5b tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:34.502209 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6d35d0-8f29-42f8-be4e-255ab84380c2 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be852700449948d3ad94ede728bc82f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e83f3225a2547ff887f61cb3b55b103', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:34.503257 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6d35d0-8f29-42f8-be4e-255ab84380c2 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:34.503546 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6d35d0-8f29-42f8-be4e-255ab84380c2 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:34.503878 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6d35d0-8f29-42f8-be4e-255ab84380c2 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] PATH_INFO: `/v3/domains/62b4be47fb624ab7be1647ce7be11a8f/config` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:34.504624 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6d35d0-8f29-42f8-be4e-255ab84380c2 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=62b4be47fb624ab7be1647ce7be11a8f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:34.507013 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6d35d0-8f29-42f8-be4e-255ab84380c2 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:34.525585 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2013/4017] 10.222.0.17 () {58 vars in 1250 bytes} [Sat Jul 23 21:27:34 2022] DELETE /identity/v3/domains/62b4be47fb624ab7be1647ce7be11a8f/config => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:27:34.528610 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cd568c-01bc-48ad-a873-787e20cd3c43 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:34.543180 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cd568c-01bc-48ad-a873-787e20cd3c43 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:34.550841 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8463b6-ec87-4594-8d29-c323cf65e209 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be852700449948d3ad94ede728bc82f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e83f3225a2547ff887f61cb3b55b103', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:34.551932 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8463b6-ec87-4594-8d29-c323cf65e209 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:34.552273 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8463b6-ec87-4594-8d29-c323cf65e209 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:34.552606 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8463b6-ec87-4594-8d29-c323cf65e209 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] PATH_INFO: `/v3/domains/62b4be47fb624ab7be1647ce7be11a8f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:34.554212 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8463b6-ec87-4594-8d29-c323cf65e209 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=62b4be47fb624ab7be1647ce7be11a8f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:34.556069 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8463b6-ec87-4594-8d29-c323cf65e209 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:34.578452 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:27:34.581417 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-3e8463b6-ec87-4594-8d29-c323cf65e209 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '62b4be47fb624ab7be1647ce7be11a8f'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:34.584030 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-3e8463b6-ec87-4594-8d29-c323cf65e209 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '62b4be47fb624ab7be1647ce7be11a8f'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:34.632133 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-3e8463b6-ec87-4594-8d29-c323cf65e209 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '62b4be47fb624ab7be1647ce7be11a8f'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:34.633304 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-3e8463b6-ec87-4594-8d29-c323cf65e209 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '62b4be47fb624ab7be1647ce7be11a8f'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:34.636462 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2005/4018] 10.222.0.17 () {60 vars in 1248 bytes} [Sat Jul 23 21:27:34 2022] PATCH /identity/v3/domains/62b4be47fb624ab7be1647ce7be11a8f => generated 277 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:27:34.640356 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6d35d0-8f29-42f8-be4e-255ab84380c2 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:34.646264 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-8c6d35d0-8f29-42f8-be4e-255ab84380c2 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:34.670603 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6d35d0-8f29-42f8-be4e-255ab84380c2 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:34.839570 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6941f2-61b2-459a-a308-24abf45d9f17 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be852700449948d3ad94ede728bc82f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e83f3225a2547ff887f61cb3b55b103', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:34.840472 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6941f2-61b2-459a-a308-24abf45d9f17 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:34.840748 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6941f2-61b2-459a-a308-24abf45d9f17 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:34.841015 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6941f2-61b2-459a-a308-24abf45d9f17 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] PATH_INFO: `/v3/domains/62b4be47fb624ab7be1647ce7be11a8f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:34.874626 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6941f2-61b2-459a-a308-24abf45d9f17 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=62b4be47fb624ab7be1647ce7be11a8f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:34.876019 ncdv-master-1 devstack@keystone.service[91547]: WARNING py.warnings [None req-6e6941f2-61b2-459a-a308-24abf45d9f17 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:27:34.876019 ncdv-master-1 devstack@keystone.service[91547]: warnings.warn(msg) Jul 23 21:27:34.876019 ncdv-master-1 devstack@keystone.service[91547]: Jul 23 21:27:34.877461 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6941f2-61b2-459a-a308-24abf45d9f17 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:34.928430 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-6e6941f2-61b2-459a-a308-24abf45d9f17 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '62b4be47fb624ab7be1647ce7be11a8f'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:34.974039 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-6e6941f2-61b2-459a-a308-24abf45d9f17 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '62b4be47fb624ab7be1647ce7be11a8f'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:35.062237 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-6e6941f2-61b2-459a-a308-24abf45d9f17 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62b4be47fb624ab7be1647ce7be11a8f', 'request_id': 'req-6e6941f2-61b2-459a-a308-24abf45d9f17'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:35.078315 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-6e6941f2-61b2-459a-a308-24abf45d9f17 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62b4be47fb624ab7be1647ce7be11a8f', 'request_id': 'req-6e6941f2-61b2-459a-a308-24abf45d9f17'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:35.086749 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-6e6941f2-61b2-459a-a308-24abf45d9f17 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62b4be47fb624ab7be1647ce7be11a8f', 'request_id': 'req-6e6941f2-61b2-459a-a308-24abf45d9f17'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:35.103859 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-6e6941f2-61b2-459a-a308-24abf45d9f17 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] The token cache is being invalidate because project 62b4be47fb624ab7be1647ce7be11a8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:27:35.104766 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-6e6941f2-61b2-459a-a308-24abf45d9f17 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:35.106234 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-6e6941f2-61b2-459a-a308-24abf45d9f17 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:35.126411 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-6e6941f2-61b2-459a-a308-24abf45d9f17 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '62b4be47fb624ab7be1647ce7be11a8f', 'request_id': 'req-6e6941f2-61b2-459a-a308-24abf45d9f17'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:35.127312 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-6e6941f2-61b2-459a-a308-24abf45d9f17 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '62b4be47fb624ab7be1647ce7be11a8f', 'request_id': 'req-6e6941f2-61b2-459a-a308-24abf45d9f17'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:35.139249 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-6e6941f2-61b2-459a-a308-24abf45d9f17 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '62b4be47fb624ab7be1647ce7be11a8f', 'request_id': 'req-6e6941f2-61b2-459a-a308-24abf45d9f17'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:35.147803 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2014/4019] 10.222.0.17 () {58 vars in 1229 bytes} [Sat Jul 23 21:27:34 2022] DELETE /identity/v3/domains/62b4be47fb624ab7be1647ce7be11a8f => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:27:35.153224 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8463b6-ec87-4594-8d29-c323cf65e209 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:35.164733 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8463b6-ec87-4594-8d29-c323cf65e209 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:35.234451 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fff286f-0c86-4dea-9c28-2e46720dc53e tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be852700449948d3ad94ede728bc82f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e83f3225a2547ff887f61cb3b55b103', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:35.235932 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fff286f-0c86-4dea-9c28-2e46720dc53e tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:35.236402 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fff286f-0c86-4dea-9c28-2e46720dc53e tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:35.236866 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fff286f-0c86-4dea-9c28-2e46720dc53e tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:35.238148 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fff286f-0c86-4dea-9c28-2e46720dc53e tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:35.240828 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fff286f-0c86-4dea-9c28-2e46720dc53e tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:35.263681 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2006/4020] 10.222.0.17 () {60 vars in 1148 bytes} [Sat Jul 23 21:27:35 2022] POST /identity/v3/domains => generated 276 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:27:35.268161 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6941f2-61b2-459a-a308-24abf45d9f17 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:35.270330 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-6e6941f2-61b2-459a-a308-24abf45d9f17 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:35.291708 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6941f2-61b2-459a-a308-24abf45d9f17 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:35.321327 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:27:35.404638 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7718c8b2-e85e-4a76-abfb-cb547a456d63 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be852700449948d3ad94ede728bc82f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e83f3225a2547ff887f61cb3b55b103', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:35.405852 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7718c8b2-e85e-4a76-abfb-cb547a456d63 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:35.406134 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7718c8b2-e85e-4a76-abfb-cb547a456d63 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:35.406465 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7718c8b2-e85e-4a76-abfb-cb547a456d63 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] PATH_INFO: `/v3/domains/d7378a1a3c8b48508b981e8b98e2ca33/config` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:35.407899 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7718c8b2-e85e-4a76-abfb-cb547a456d63 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=d7378a1a3c8b48508b981e8b98e2ca33)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:35.409322 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7718c8b2-e85e-4a76-abfb-cb547a456d63 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:35.457290 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2015/4021] 10.222.0.17 () {60 vars in 1268 bytes} [Sat Jul 23 21:27:35 2022] PUT /identity/v3/domains/d7378a1a3c8b48508b981e8b98e2ca33/config => generated 138 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:27:35.459162 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fff286f-0c86-4dea-9c28-2e46720dc53e tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:35.475587 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fff286f-0c86-4dea-9c28-2e46720dc53e tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:35.482171 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5477f0c-2b2a-46c7-bd42-7398e2600176 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be852700449948d3ad94ede728bc82f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e83f3225a2547ff887f61cb3b55b103', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:35.483127 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5477f0c-2b2a-46c7-bd42-7398e2600176 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:35.483475 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5477f0c-2b2a-46c7-bd42-7398e2600176 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:35.483818 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5477f0c-2b2a-46c7-bd42-7398e2600176 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] PATH_INFO: `/v3/domains/d7378a1a3c8b48508b981e8b98e2ca33/config/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:35.485027 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5477f0c-2b2a-46c7-bd42-7398e2600176 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=d7378a1a3c8b48508b981e8b98e2ca33, group=identity)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:35.486806 ncdv-master-1 devstack@keystone.service[91548]: WARNING py.warnings [None req-a5477f0c-2b2a-46c7-bd42-7398e2600176 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:27:35.486806 ncdv-master-1 devstack@keystone.service[91548]: warnings.warn(msg) Jul 23 21:27:35.486806 ncdv-master-1 devstack@keystone.service[91548]: Jul 23 21:27:35.487778 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5477f0c-2b2a-46c7-bd42-7398e2600176 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:35.544279 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2007/4022] 10.222.0.17 () {60 vars in 1296 bytes} [Sat Jul 23 21:27:35 2022] PATCH /identity/v3/domains/d7378a1a3c8b48508b981e8b98e2ca33/config/identity => generated 176 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:27:35.548655 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7718c8b2-e85e-4a76-abfb-cb547a456d63 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:35.566584 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7718c8b2-e85e-4a76-abfb-cb547a456d63 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:35.574814 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691611da-279c-44dc-8fec-404f15bf4b29 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be852700449948d3ad94ede728bc82f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e83f3225a2547ff887f61cb3b55b103', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:35.576171 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691611da-279c-44dc-8fec-404f15bf4b29 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:35.576637 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691611da-279c-44dc-8fec-404f15bf4b29 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:35.577101 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691611da-279c-44dc-8fec-404f15bf4b29 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] PATH_INFO: `/v3/domains/d7378a1a3c8b48508b981e8b98e2ca33/config/identity/driver` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:35.578158 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691611da-279c-44dc-8fec-404f15bf4b29 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=d7378a1a3c8b48508b981e8b98e2ca33, group=identity, option=driver)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:35.580837 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691611da-279c-44dc-8fec-404f15bf4b29 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:35.629890 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2016/4023] 10.222.0.17 () {60 vars in 1317 bytes} [Sat Jul 23 21:27:35 2022] PATCH /identity/v3/domains/d7378a1a3c8b48508b981e8b98e2ca33/config/identity/driver => generated 177 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 21:27:35.630117 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5477f0c-2b2a-46c7-bd42-7398e2600176 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:35.643532 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5477f0c-2b2a-46c7-bd42-7398e2600176 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:35.651333 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1889d4c0-468a-487a-b51b-b2bd5d6e1fec tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be852700449948d3ad94ede728bc82f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e83f3225a2547ff887f61cb3b55b103', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:35.652641 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1889d4c0-468a-487a-b51b-b2bd5d6e1fec tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:35.653751 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1889d4c0-468a-487a-b51b-b2bd5d6e1fec tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:35.654287 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1889d4c0-468a-487a-b51b-b2bd5d6e1fec tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] PATH_INFO: `/v3/domains/d7378a1a3c8b48508b981e8b98e2ca33/config/identity/driver` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:35.656106 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1889d4c0-468a-487a-b51b-b2bd5d6e1fec tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=d7378a1a3c8b48508b981e8b98e2ca33, group=identity, option=driver)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:35.658177 ncdv-master-1 devstack@keystone.service[91548]: WARNING py.warnings [None req-1889d4c0-468a-487a-b51b-b2bd5d6e1fec tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:27:35.658177 ncdv-master-1 devstack@keystone.service[91548]: warnings.warn(msg) Jul 23 21:27:35.658177 ncdv-master-1 devstack@keystone.service[91548]: Jul 23 21:27:35.660248 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1889d4c0-468a-487a-b51b-b2bd5d6e1fec tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:35.689472 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2008/4024] 10.222.0.17 () {58 vars in 1298 bytes} [Sat Jul 23 21:27:35 2022] DELETE /identity/v3/domains/d7378a1a3c8b48508b981e8b98e2ca33/config/identity/driver => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:27:35.694085 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691611da-279c-44dc-8fec-404f15bf4b29 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:35.707196 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691611da-279c-44dc-8fec-404f15bf4b29 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:35.712193 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4368e514-367d-467e-a679-f7eee7d5d76c tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be852700449948d3ad94ede728bc82f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e83f3225a2547ff887f61cb3b55b103', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:35.713089 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4368e514-367d-467e-a679-f7eee7d5d76c tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:35.713510 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4368e514-367d-467e-a679-f7eee7d5d76c tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:35.713786 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4368e514-367d-467e-a679-f7eee7d5d76c tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] PATH_INFO: `/v3/domains/d7378a1a3c8b48508b981e8b98e2ca33/config/identity/driver` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:35.715038 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4368e514-367d-467e-a679-f7eee7d5d76c tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=d7378a1a3c8b48508b981e8b98e2ca33, group=identity, option=driver)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:35.716856 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4368e514-367d-467e-a679-f7eee7d5d76c tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:35.731577 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-4368e514-367d-467e-a679-f7eee7d5d76c tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Could not find option driver in group identity in domain configuration for domain d7378a1a3c8b48508b981e8b98e2ca33.: keystone.exception.DomainConfigNotFound: Could not find option driver in group identity in domain configuration for domain d7378a1a3c8b48508b981e8b98e2ca33. Jul 23 21:27:35.731577 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 21:27:35.731577 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 21:27:35.731577 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 21:27:35.731577 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 21:27:35.731577 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 21:27:35.731577 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 21:27:35.731577 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 21:27:35.731577 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 21:27:35.731577 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 21:27:35.731577 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 21:27:35.731577 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 21:27:35.731577 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 179, in get Jul 23 21:27:35.732565 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application config = self._get_config(domain_id, group, option) Jul 23 21:27:35.732565 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 186, in _get_config Jul 23 21:27:35.732565 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return PROVIDERS.domain_config_api.get_config( Jul 23 21:27:35.732565 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 21:27:35.732565 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 21:27:35.732565 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 1266, in get_config Jul 23 21:27:35.732565 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.DomainConfigNotFound( Jul 23 21:27:35.732565 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.DomainConfigNotFound: Could not find option driver in group identity in domain configuration for domain d7378a1a3c8b48508b981e8b98e2ca33. Jul 23 21:27:35.732565 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 21:27:35.733838 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2017/4025] 10.222.0.17 () {58 vars in 1295 bytes} [Sat Jul 23 21:27:35 2022] GET /identity/v3/domains/d7378a1a3c8b48508b981e8b98e2ca33/config/identity/driver => generated 171 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 23 21:27:35.738021 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1889d4c0-468a-487a-b51b-b2bd5d6e1fec tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:35.751339 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1889d4c0-468a-487a-b51b-b2bd5d6e1fec tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:35.759529 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fe1058-c84f-4fe0-9d8f-e3ca20bb066b tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be852700449948d3ad94ede728bc82f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e83f3225a2547ff887f61cb3b55b103', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:35.760634 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fe1058-c84f-4fe0-9d8f-e3ca20bb066b tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:35.760924 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fe1058-c84f-4fe0-9d8f-e3ca20bb066b tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:35.761197 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fe1058-c84f-4fe0-9d8f-e3ca20bb066b tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] PATH_INFO: `/v3/domains/d7378a1a3c8b48508b981e8b98e2ca33/config/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:35.761898 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fe1058-c84f-4fe0-9d8f-e3ca20bb066b tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=d7378a1a3c8b48508b981e8b98e2ca33, group=identity)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:35.763588 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fe1058-c84f-4fe0-9d8f-e3ca20bb066b tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:35.790467 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2009/4026] 10.222.0.17 () {58 vars in 1277 bytes} [Sat Jul 23 21:27:35 2022] DELETE /identity/v3/domains/d7378a1a3c8b48508b981e8b98e2ca33/config/identity => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:27:35.791459 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4368e514-367d-467e-a679-f7eee7d5d76c tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:35.811987 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4368e514-367d-467e-a679-f7eee7d5d76c tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:35.828339 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083b70ec-0c0a-4654-a795-c5b4213120e8 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be852700449948d3ad94ede728bc82f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e83f3225a2547ff887f61cb3b55b103', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:35.829276 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083b70ec-0c0a-4654-a795-c5b4213120e8 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:35.829545 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083b70ec-0c0a-4654-a795-c5b4213120e8 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:35.830113 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083b70ec-0c0a-4654-a795-c5b4213120e8 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] PATH_INFO: `/v3/domains/d7378a1a3c8b48508b981e8b98e2ca33/config/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:35.834907 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083b70ec-0c0a-4654-a795-c5b4213120e8 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=d7378a1a3c8b48508b981e8b98e2ca33, group=identity)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:35.837490 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083b70ec-0c0a-4654-a795-c5b4213120e8 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:35.877646 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-083b70ec-0c0a-4654-a795-c5b4213120e8 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Could not find group identity in domain configuration for domain d7378a1a3c8b48508b981e8b98e2ca33.: keystone.exception.DomainConfigNotFound: Could not find group identity in domain configuration for domain d7378a1a3c8b48508b981e8b98e2ca33. Jul 23 21:27:35.877646 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 21:27:35.877646 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 21:27:35.877646 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 21:27:35.877646 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 21:27:35.877646 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 21:27:35.877646 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 21:27:35.877646 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 21:27:35.877646 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 21:27:35.877646 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 21:27:35.877646 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 21:27:35.877646 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 21:27:35.877646 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 179, in get Jul 23 21:27:35.878967 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application config = self._get_config(domain_id, group, option) Jul 23 21:27:35.878967 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 186, in _get_config Jul 23 21:27:35.878967 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return PROVIDERS.domain_config_api.get_config( Jul 23 21:27:35.878967 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 21:27:35.878967 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 21:27:35.878967 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 1266, in get_config Jul 23 21:27:35.878967 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.DomainConfigNotFound( Jul 23 21:27:35.878967 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.DomainConfigNotFound: Could not find group identity in domain configuration for domain d7378a1a3c8b48508b981e8b98e2ca33. Jul 23 21:27:35.878967 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 21:27:35.888812 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fe1058-c84f-4fe0-9d8f-e3ca20bb066b tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:35.896546 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2018/4027] 10.222.0.17 () {58 vars in 1274 bytes} [Sat Jul 23 21:27:35 2022] GET /identity/v3/domains/d7378a1a3c8b48508b981e8b98e2ca33/config/identity => generated 154 bytes in 104 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 23 21:27:35.901638 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fe1058-c84f-4fe0-9d8f-e3ca20bb066b tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:35.909039 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce85b4d-2617-4293-a897-6b21ed8b934f tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be852700449948d3ad94ede728bc82f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e83f3225a2547ff887f61cb3b55b103', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:35.910902 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce85b4d-2617-4293-a897-6b21ed8b934f tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:35.911189 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce85b4d-2617-4293-a897-6b21ed8b934f tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:35.911465 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce85b4d-2617-4293-a897-6b21ed8b934f tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] PATH_INFO: `/v3/domains/d7378a1a3c8b48508b981e8b98e2ca33/config` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:35.913904 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce85b4d-2617-4293-a897-6b21ed8b934f tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=d7378a1a3c8b48508b981e8b98e2ca33)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:35.915581 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce85b4d-2617-4293-a897-6b21ed8b934f tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:35.960487 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2010/4028] 10.222.0.17 () {58 vars in 1250 bytes} [Sat Jul 23 21:27:35 2022] DELETE /identity/v3/domains/d7378a1a3c8b48508b981e8b98e2ca33/config => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:27:35.965129 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083b70ec-0c0a-4654-a795-c5b4213120e8 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:35.980028 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083b70ec-0c0a-4654-a795-c5b4213120e8 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:36.002202 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f222a7e-ddde-4db2-b45e-87ffdbd2d0bd tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be852700449948d3ad94ede728bc82f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e83f3225a2547ff887f61cb3b55b103', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:36.013820 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f222a7e-ddde-4db2-b45e-87ffdbd2d0bd tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:36.015861 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f222a7e-ddde-4db2-b45e-87ffdbd2d0bd tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:36.016163 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f222a7e-ddde-4db2-b45e-87ffdbd2d0bd tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] PATH_INFO: `/v3/domains/d7378a1a3c8b48508b981e8b98e2ca33` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:36.021883 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f222a7e-ddde-4db2-b45e-87ffdbd2d0bd tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=d7378a1a3c8b48508b981e8b98e2ca33)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:36.023044 ncdv-master-1 devstack@keystone.service[91547]: WARNING py.warnings [None req-4f222a7e-ddde-4db2-b45e-87ffdbd2d0bd tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:27:36.023044 ncdv-master-1 devstack@keystone.service[91547]: warnings.warn(msg) Jul 23 21:27:36.023044 ncdv-master-1 devstack@keystone.service[91547]: Jul 23 21:27:36.025286 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f222a7e-ddde-4db2-b45e-87ffdbd2d0bd tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:36.084518 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-4f222a7e-ddde-4db2-b45e-87ffdbd2d0bd tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'd7378a1a3c8b48508b981e8b98e2ca33'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:36.085739 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-4f222a7e-ddde-4db2-b45e-87ffdbd2d0bd tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'd7378a1a3c8b48508b981e8b98e2ca33'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:36.143066 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-4f222a7e-ddde-4db2-b45e-87ffdbd2d0bd tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'd7378a1a3c8b48508b981e8b98e2ca33'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:36.146220 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-4f222a7e-ddde-4db2-b45e-87ffdbd2d0bd tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'd7378a1a3c8b48508b981e8b98e2ca33'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:36.153998 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2019/4029] 10.222.0.17 () {60 vars in 1248 bytes} [Sat Jul 23 21:27:35 2022] PATCH /identity/v3/domains/d7378a1a3c8b48508b981e8b98e2ca33 => generated 277 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 21:27:36.158067 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce85b4d-2617-4293-a897-6b21ed8b934f tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:36.160793 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-9ce85b4d-2617-4293-a897-6b21ed8b934f tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:36.181239 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce85b4d-2617-4293-a897-6b21ed8b934f tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:36.274391 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=86,keystone:UPDATE=1,keystone:INSERT=3,keystone:DELETE=10 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:27:36.292202 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2014dbe8-51da-4f4b-92cc-b994e06efc8b tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be852700449948d3ad94ede728bc82f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e83f3225a2547ff887f61cb3b55b103', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:36.294237 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2014dbe8-51da-4f4b-92cc-b994e06efc8b tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:36.294879 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2014dbe8-51da-4f4b-92cc-b994e06efc8b tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:36.295456 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2014dbe8-51da-4f4b-92cc-b994e06efc8b tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] PATH_INFO: `/v3/domains/d7378a1a3c8b48508b981e8b98e2ca33` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:36.310025 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2014dbe8-51da-4f4b-92cc-b994e06efc8b tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=d7378a1a3c8b48508b981e8b98e2ca33)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:36.320657 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2014dbe8-51da-4f4b-92cc-b994e06efc8b tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:36.373113 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-2014dbe8-51da-4f4b-92cc-b994e06efc8b tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'd7378a1a3c8b48508b981e8b98e2ca33'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:36.384018 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-2014dbe8-51da-4f4b-92cc-b994e06efc8b tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'd7378a1a3c8b48508b981e8b98e2ca33'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:36.446797 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-2014dbe8-51da-4f4b-92cc-b994e06efc8b tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7378a1a3c8b48508b981e8b98e2ca33', 'request_id': 'req-2014dbe8-51da-4f4b-92cc-b994e06efc8b'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:36.454739 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-2014dbe8-51da-4f4b-92cc-b994e06efc8b tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7378a1a3c8b48508b981e8b98e2ca33', 'request_id': 'req-2014dbe8-51da-4f4b-92cc-b994e06efc8b'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:36.463529 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-2014dbe8-51da-4f4b-92cc-b994e06efc8b tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7378a1a3c8b48508b981e8b98e2ca33', 'request_id': 'req-2014dbe8-51da-4f4b-92cc-b994e06efc8b'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:36.478825 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-2014dbe8-51da-4f4b-92cc-b994e06efc8b tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] The token cache is being invalidate because project d7378a1a3c8b48508b981e8b98e2ca33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:27:36.479016 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-2014dbe8-51da-4f4b-92cc-b994e06efc8b tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:36.479808 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-2014dbe8-51da-4f4b-92cc-b994e06efc8b tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:36.489677 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-2014dbe8-51da-4f4b-92cc-b994e06efc8b tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'd7378a1a3c8b48508b981e8b98e2ca33', 'request_id': 'req-2014dbe8-51da-4f4b-92cc-b994e06efc8b'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:36.493471 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-2014dbe8-51da-4f4b-92cc-b994e06efc8b tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'd7378a1a3c8b48508b981e8b98e2ca33', 'request_id': 'req-2014dbe8-51da-4f4b-92cc-b994e06efc8b'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:36.495446 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-2014dbe8-51da-4f4b-92cc-b994e06efc8b tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'd7378a1a3c8b48508b981e8b98e2ca33', 'request_id': 'req-2014dbe8-51da-4f4b-92cc-b994e06efc8b'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:36.501986 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2011/4030] 10.222.0.17 () {58 vars in 1229 bytes} [Sat Jul 23 21:27:36 2022] DELETE /identity/v3/domains/d7378a1a3c8b48508b981e8b98e2ca33 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:27:36.507212 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f222a7e-ddde-4db2-b45e-87ffdbd2d0bd tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:36.530111 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f222a7e-ddde-4db2-b45e-87ffdbd2d0bd tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:36.635156 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e860e0-8782-4bb3-b76c-dd84f1143d8d tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be852700449948d3ad94ede728bc82f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e83f3225a2547ff887f61cb3b55b103', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:36.635863 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e860e0-8782-4bb3-b76c-dd84f1143d8d tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:36.636976 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e860e0-8782-4bb3-b76c-dd84f1143d8d tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:36.637292 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e860e0-8782-4bb3-b76c-dd84f1143d8d tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] PATH_INFO: `/v3/domains/config/default` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:36.638336 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e860e0-8782-4bb3-b76c-dd84f1143d8d tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorizing `identity:get_domain_config_default()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:36.639435 ncdv-master-1 devstack@keystone.service[91547]: WARNING py.warnings [None req-a5e860e0-8782-4bb3-b76c-dd84f1143d8d tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config_default": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:27:36.639435 ncdv-master-1 devstack@keystone.service[91547]: warnings.warn(msg) Jul 23 21:27:36.639435 ncdv-master-1 devstack@keystone.service[91547]: Jul 23 21:27:36.640517 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e860e0-8782-4bb3-b76c-dd84f1143d8d tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:36.651749 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2020/4031] 10.222.0.17 () {58 vars in 1172 bytes} [Sat Jul 23 21:27:36 2022] GET /identity/v3/domains/config/default => generated 1527 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:27:36.652738 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2014dbe8-51da-4f4b-92cc-b994e06efc8b tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:36.659229 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-2014dbe8-51da-4f4b-92cc-b994e06efc8b tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:36.673822 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2014dbe8-51da-4f4b-92cc-b994e06efc8b tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:36.680941 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f31c372-663f-40ec-9a5d-df43f2cc9d0c tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be852700449948d3ad94ede728bc82f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e83f3225a2547ff887f61cb3b55b103', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:36.681793 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f31c372-663f-40ec-9a5d-df43f2cc9d0c tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:36.683203 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f31c372-663f-40ec-9a5d-df43f2cc9d0c tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:36.683203 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f31c372-663f-40ec-9a5d-df43f2cc9d0c tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] PATH_INFO: `/v3/domains/config/identity/default` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:36.683555 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f31c372-663f-40ec-9a5d-df43f2cc9d0c tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:36.684570 ncdv-master-1 devstack@keystone.service[91548]: WARNING py.warnings [None req-3f31c372-663f-40ec-9a5d-df43f2cc9d0c tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config_default": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:27:36.684570 ncdv-master-1 devstack@keystone.service[91548]: warnings.warn(msg) Jul 23 21:27:36.684570 ncdv-master-1 devstack@keystone.service[91548]: Jul 23 21:27:36.685540 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f31c372-663f-40ec-9a5d-df43f2cc9d0c tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:36.689953 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2012/4032] 10.222.0.17 () {58 vars in 1199 bytes} [Sat Jul 23 21:27:36 2022] GET /identity/v3/domains/config/identity/default => generated 64 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 23 21:27:36.691228 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e860e0-8782-4bb3-b76c-dd84f1143d8d tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:36.704378 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e860e0-8782-4bb3-b76c-dd84f1143d8d tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:36.711129 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b600a4ac-6ec7-440e-ae8f-c500f7619cbb tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be852700449948d3ad94ede728bc82f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e83f3225a2547ff887f61cb3b55b103', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:36.711963 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b600a4ac-6ec7-440e-ae8f-c500f7619cbb tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:36.712247 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b600a4ac-6ec7-440e-ae8f-c500f7619cbb tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:36.712522 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b600a4ac-6ec7-440e-ae8f-c500f7619cbb tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] PATH_INFO: `/v3/domains/config/identity/driver/default` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:36.713719 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b600a4ac-6ec7-440e-ae8f-c500f7619cbb tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity, option=driver)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:36.715449 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b600a4ac-6ec7-440e-ae8f-c500f7619cbb tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:36.717899 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2021/4033] 10.222.0.17 () {58 vars in 1220 bytes} [Sat Jul 23 21:27:36 2022] GET /identity/v3/domains/config/identity/driver/default => generated 30 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 23 21:27:36.720644 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f31c372-663f-40ec-9a5d-df43f2cc9d0c tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:36.731239 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f31c372-663f-40ec-9a5d-df43f2cc9d0c tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:36.737125 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9e6311-cb62-4cc3-b1ac-7ab7d8079bc5 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be852700449948d3ad94ede728bc82f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e83f3225a2547ff887f61cb3b55b103', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:36.737909 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9e6311-cb62-4cc3-b1ac-7ab7d8079bc5 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:36.738271 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9e6311-cb62-4cc3-b1ac-7ab7d8079bc5 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:36.738990 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9e6311-cb62-4cc3-b1ac-7ab7d8079bc5 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] PATH_INFO: `/v3/domains/config/identity/list_limit/default` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:36.739746 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9e6311-cb62-4cc3-b1ac-7ab7d8079bc5 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity, option=list_limit)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:36.741426 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9e6311-cb62-4cc3-b1ac-7ab7d8079bc5 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:36.742758 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2013/4034] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:27:36 2022] GET /identity/v3/domains/config/identity/list_limit/default => generated 33 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 23 21:27:36.746846 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b600a4ac-6ec7-440e-ae8f-c500f7619cbb tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:36.758511 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b600a4ac-6ec7-440e-ae8f-c500f7619cbb tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:36.764455 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9648e2ed-efb3-45dd-9b34-f2f45ce25fdd tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be852700449948d3ad94ede728bc82f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e83f3225a2547ff887f61cb3b55b103', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:36.770476 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9648e2ed-efb3-45dd-9b34-f2f45ce25fdd tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:36.770766 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9648e2ed-efb3-45dd-9b34-f2f45ce25fdd tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:36.772863 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9648e2ed-efb3-45dd-9b34-f2f45ce25fdd tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] PATH_INFO: `/v3/domains/config/ldap/default` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:36.773680 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9648e2ed-efb3-45dd-9b34-f2f45ce25fdd tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:36.775589 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9648e2ed-efb3-45dd-9b34-f2f45ce25fdd tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:36.780491 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2022/4035] 10.222.0.17 () {58 vars in 1187 bytes} [Sat Jul 23 21:27:36 2022] GET /identity/v3/domains/config/ldap/default => generated 1476 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:27:36.782693 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9e6311-cb62-4cc3-b1ac-7ab7d8079bc5 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:36.797441 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9e6311-cb62-4cc3-b1ac-7ab7d8079bc5 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:36.802783 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b80a442-aeb8-4e4e-81a4-2ed8a0c4caf5 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be852700449948d3ad94ede728bc82f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e83f3225a2547ff887f61cb3b55b103', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:36.803670 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b80a442-aeb8-4e4e-81a4-2ed8a0c4caf5 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:36.804023 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b80a442-aeb8-4e4e-81a4-2ed8a0c4caf5 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:36.804530 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b80a442-aeb8-4e4e-81a4-2ed8a0c4caf5 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] PATH_INFO: `/v3/domains/config/ldap/url/default` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:36.805289 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b80a442-aeb8-4e4e-81a4-2ed8a0c4caf5 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=url)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:36.807033 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b80a442-aeb8-4e4e-81a4-2ed8a0c4caf5 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:36.808315 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2014/4036] 10.222.0.17 () {58 vars in 1199 bytes} [Sat Jul 23 21:27:36 2022] GET /identity/v3/domains/config/ldap/url/default => generated 40 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 23 21:27:36.812463 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9648e2ed-efb3-45dd-9b34-f2f45ce25fdd tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:36.821572 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=2,keystone:UPDATE=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:27:36.840643 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9648e2ed-efb3-45dd-9b34-f2f45ce25fdd tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:36.849157 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb6ab39-e4ef-4fc3-a41a-ae2d2d12e620 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be852700449948d3ad94ede728bc82f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e83f3225a2547ff887f61cb3b55b103', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:36.850466 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb6ab39-e4ef-4fc3-a41a-ae2d2d12e620 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:36.851118 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb6ab39-e4ef-4fc3-a41a-ae2d2d12e620 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:36.851770 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb6ab39-e4ef-4fc3-a41a-ae2d2d12e620 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] PATH_INFO: `/v3/domains/config/ldap/user/default` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:36.852434 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb6ab39-e4ef-4fc3-a41a-ae2d2d12e620 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:36.854140 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb6ab39-e4ef-4fc3-a41a-ae2d2d12e620 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:36.855500 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2023/4037] 10.222.0.17 () {58 vars in 1202 bytes} [Sat Jul 23 21:27:36 2022] GET /identity/v3/domains/config/ldap/user/default => generated 27 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 23 21:27:36.859552 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b80a442-aeb8-4e4e-81a4-2ed8a0c4caf5 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:36.871685 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b80a442-aeb8-4e4e-81a4-2ed8a0c4caf5 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:36.877009 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffed8420-1668-4ee8-978d-95a191078c5f tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be852700449948d3ad94ede728bc82f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e83f3225a2547ff887f61cb3b55b103', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:36.878600 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffed8420-1668-4ee8-978d-95a191078c5f tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:36.878955 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffed8420-1668-4ee8-978d-95a191078c5f tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:36.879436 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffed8420-1668-4ee8-978d-95a191078c5f tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] PATH_INFO: `/v3/domains/config/ldap/suffix/default` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:36.880822 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffed8420-1668-4ee8-978d-95a191078c5f tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=suffix)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:36.882989 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffed8420-1668-4ee8-978d-95a191078c5f tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:36.885293 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2015/4038] 10.222.0.17 () {58 vars in 1208 bytes} [Sat Jul 23 21:27:36 2022] GET /identity/v3/domains/config/ldap/suffix/default => generated 44 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Jul 23 21:27:36.889953 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb6ab39-e4ef-4fc3-a41a-ae2d2d12e620 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:36.902465 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb6ab39-e4ef-4fc3-a41a-ae2d2d12e620 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:36.908456 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7ffdb0-c710-46ae-a16a-d25b432406ba tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be852700449948d3ad94ede728bc82f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e83f3225a2547ff887f61cb3b55b103', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:36.909311 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7ffdb0-c710-46ae-a16a-d25b432406ba tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:36.909604 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7ffdb0-c710-46ae-a16a-d25b432406ba tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:36.909918 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7ffdb0-c710-46ae-a16a-d25b432406ba tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] PATH_INFO: `/v3/domains/config/ldap/query_scope/default` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:36.910617 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7ffdb0-c710-46ae-a16a-d25b432406ba tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=query_scope)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:36.912432 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7ffdb0-c710-46ae-a16a-d25b432406ba tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:36.916485 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2024/4039] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:27:36 2022] GET /identity/v3/domains/config/ldap/query_scope/default => generated 35 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 23 21:27:36.925996 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffed8420-1668-4ee8-978d-95a191078c5f tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:36.953500 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffed8420-1668-4ee8-978d-95a191078c5f tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:36.965495 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caaeb74-1e87-4e80-bec8-6e62dff5698b tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be852700449948d3ad94ede728bc82f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e83f3225a2547ff887f61cb3b55b103', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:36.966601 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caaeb74-1e87-4e80-bec8-6e62dff5698b tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:36.967081 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caaeb74-1e87-4e80-bec8-6e62dff5698b tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:36.967582 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caaeb74-1e87-4e80-bec8-6e62dff5698b tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] PATH_INFO: `/v3/domains/config/ldap/page_size/default` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:36.968345 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caaeb74-1e87-4e80-bec8-6e62dff5698b tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=page_size)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:36.970104 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caaeb74-1e87-4e80-bec8-6e62dff5698b tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:36.977076 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7ffdb0-c710-46ae-a16a-d25b432406ba tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:36.977768 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2016/4040] 10.222.0.17 () {58 vars in 1217 bytes} [Sat Jul 23 21:27:36 2022] GET /identity/v3/domains/config/ldap/page_size/default => generated 29 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 23 21:27:36.993033 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7ffdb0-c710-46ae-a16a-d25b432406ba tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:37.031728 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b960ff-b616-4187-adce-a2dd0a70be8c tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be852700449948d3ad94ede728bc82f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e83f3225a2547ff887f61cb3b55b103', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:37.035520 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b960ff-b616-4187-adce-a2dd0a70be8c tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:37.035917 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b960ff-b616-4187-adce-a2dd0a70be8c tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:37.036329 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b960ff-b616-4187-adce-a2dd0a70be8c tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] PATH_INFO: `/v3/domains/config/ldap/alias_dereferencing/default` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:37.040511 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b960ff-b616-4187-adce-a2dd0a70be8c tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=alias_dereferencing)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:37.043066 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b960ff-b616-4187-adce-a2dd0a70be8c tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:37.047240 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2025/4041] 10.222.0.17 () {58 vars in 1247 bytes} [Sat Jul 23 21:27:36 2022] GET /identity/v3/domains/config/ldap/alias_dereferencing/default => generated 47 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 23 21:27:37.051770 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caaeb74-1e87-4e80-bec8-6e62dff5698b tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:37.069758 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caaeb74-1e87-4e80-bec8-6e62dff5698b tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:37.086795 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682e290f-288a-48bd-ab2a-5171da87345c tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be852700449948d3ad94ede728bc82f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e83f3225a2547ff887f61cb3b55b103', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:37.087667 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682e290f-288a-48bd-ab2a-5171da87345c tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:37.087923 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682e290f-288a-48bd-ab2a-5171da87345c tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:37.088199 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682e290f-288a-48bd-ab2a-5171da87345c tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] PATH_INFO: `/v3/domains/config/ldap/debug_level/default` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:37.089001 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682e290f-288a-48bd-ab2a-5171da87345c tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=debug_level)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:37.090674 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682e290f-288a-48bd-ab2a-5171da87345c tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:37.093080 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2017/4042] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:27:37 2022] GET /identity/v3/domains/config/ldap/debug_level/default => generated 34 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 23 21:27:37.097160 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b960ff-b616-4187-adce-a2dd0a70be8c tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:37.111399 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b960ff-b616-4187-adce-a2dd0a70be8c tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:37.129436 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6de1813-6274-4fd3-aa54-01146e46c4be tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be852700449948d3ad94ede728bc82f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e83f3225a2547ff887f61cb3b55b103', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:37.130556 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6de1813-6274-4fd3-aa54-01146e46c4be tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:37.131016 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6de1813-6274-4fd3-aa54-01146e46c4be tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:37.131445 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6de1813-6274-4fd3-aa54-01146e46c4be tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] PATH_INFO: `/v3/domains/config/ldap/chase_referrals/default` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:37.132278 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6de1813-6274-4fd3-aa54-01146e46c4be tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=chase_referrals)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:37.134130 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6de1813-6274-4fd3-aa54-01146e46c4be tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:37.139725 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2026/4043] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:27:37 2022] GET /identity/v3/domains/config/ldap/chase_referrals/default => generated 38 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 23 21:27:37.143631 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682e290f-288a-48bd-ab2a-5171da87345c tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:37.159452 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682e290f-288a-48bd-ab2a-5171da87345c tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:37.165054 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ab1374-e0f7-4258-bf23-593aeefb91c8 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be852700449948d3ad94ede728bc82f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e83f3225a2547ff887f61cb3b55b103', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:37.165914 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ab1374-e0f7-4258-bf23-593aeefb91c8 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:37.166351 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ab1374-e0f7-4258-bf23-593aeefb91c8 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:37.166897 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ab1374-e0f7-4258-bf23-593aeefb91c8 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_tree_dn/default` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:37.167873 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ab1374-e0f7-4258-bf23-593aeefb91c8 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_tree_dn)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:37.169520 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ab1374-e0f7-4258-bf23-593aeefb91c8 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:37.174250 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2018/4044] 10.222.0.17 () {58 vars in 1226 bytes} [Sat Jul 23 21:27:37 2022] GET /identity/v3/domains/config/ldap/user_tree_dn/default => generated 35 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 23 21:27:37.175374 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6de1813-6274-4fd3-aa54-01146e46c4be tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:37.187112 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6de1813-6274-4fd3-aa54-01146e46c4be tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:37.192810 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6d7c65-9b89-45f1-a790-a12f032febd4 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be852700449948d3ad94ede728bc82f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e83f3225a2547ff887f61cb3b55b103', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:37.194917 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6d7c65-9b89-45f1-a790-a12f032febd4 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:37.195536 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6d7c65-9b89-45f1-a790-a12f032febd4 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:37.196033 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6d7c65-9b89-45f1-a790-a12f032febd4 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_filter/default` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:37.197793 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6d7c65-9b89-45f1-a790-a12f032febd4 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_filter)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:37.200103 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6d7c65-9b89-45f1-a790-a12f032febd4 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:37.201901 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2027/4045] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:27:37 2022] GET /identity/v3/domains/config/ldap/user_filter/default => generated 34 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Jul 23 21:27:37.205623 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ab1374-e0f7-4258-bf23-593aeefb91c8 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:37.223063 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ab1374-e0f7-4258-bf23-593aeefb91c8 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:37.232976 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfc87fc-a918-4d8f-bff6-e250dd2cfb67 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be852700449948d3ad94ede728bc82f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e83f3225a2547ff887f61cb3b55b103', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:37.234053 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfc87fc-a918-4d8f-bff6-e250dd2cfb67 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:37.234587 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfc87fc-a918-4d8f-bff6-e250dd2cfb67 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:37.235104 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfc87fc-a918-4d8f-bff6-e250dd2cfb67 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_objectclass/default` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:37.236192 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfc87fc-a918-4d8f-bff6-e250dd2cfb67 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_objectclass)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:37.241064 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfc87fc-a918-4d8f-bff6-e250dd2cfb67 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:37.243088 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2019/4046] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:27:37 2022] GET /identity/v3/domains/config/ldap/user_objectclass/default => generated 50 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Jul 23 21:27:37.246887 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6d7c65-9b89-45f1-a790-a12f032febd4 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:37.262138 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6d7c65-9b89-45f1-a790-a12f032febd4 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:37.286932 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0a45f7-956b-45a7-a51a-28422c59ec28 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be852700449948d3ad94ede728bc82f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e83f3225a2547ff887f61cb3b55b103', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:37.287784 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0a45f7-956b-45a7-a51a-28422c59ec28 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:37.288069 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0a45f7-956b-45a7-a51a-28422c59ec28 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:37.288350 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0a45f7-956b-45a7-a51a-28422c59ec28 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_id_attribute/default` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:37.289069 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0a45f7-956b-45a7-a51a-28422c59ec28 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_id_attribute)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:37.291945 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0a45f7-956b-45a7-a51a-28422c59ec28 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:37.293180 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2028/4047] 10.222.0.17 () {58 vars in 1241 bytes} [Sat Jul 23 21:27:37 2022] GET /identity/v3/domains/config/ldap/user_id_attribute/default => generated 40 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Jul 23 21:27:37.299794 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add4f6a4-c023-4459-968f-34f3b03fc878 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:37.300836 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add4f6a4-c023-4459-968f-34f3b03fc878 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:37.301566 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add4f6a4-c023-4459-968f-34f3b03fc878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:37.310653 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0a45f7-956b-45a7-a51a-28422c59ec28 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:37.331821 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0a45f7-956b-45a7-a51a-28422c59ec28 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:37.337246 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c44573f-340c-48e2-931e-a193240e5328 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be852700449948d3ad94ede728bc82f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e83f3225a2547ff887f61cb3b55b103', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:37.338212 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c44573f-340c-48e2-931e-a193240e5328 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:37.338561 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c44573f-340c-48e2-931e-a193240e5328 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:37.338937 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c44573f-340c-48e2-931e-a193240e5328 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_name_attribute/default` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:37.339708 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c44573f-340c-48e2-931e-a193240e5328 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_name_attribute)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:37.341437 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c44573f-340c-48e2-931e-a193240e5328 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:37.342815 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2029/4048] 10.222.0.17 () {58 vars in 1247 bytes} [Sat Jul 23 21:27:37 2022] GET /identity/v3/domains/config/ldap/user_name_attribute/default => generated 42 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 23 21:27:37.346987 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c44573f-340c-48e2-931e-a193240e5328 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:37.363300 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c44573f-340c-48e2-931e-a193240e5328 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:37.368182 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3168c7e-090f-49fe-8a36-2132f98f4543 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be852700449948d3ad94ede728bc82f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e83f3225a2547ff887f61cb3b55b103', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:37.369393 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3168c7e-090f-49fe-8a36-2132f98f4543 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:37.369393 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3168c7e-090f-49fe-8a36-2132f98f4543 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:37.369663 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3168c7e-090f-49fe-8a36-2132f98f4543 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_mail_attribute/default` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:37.370423 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3168c7e-090f-49fe-8a36-2132f98f4543 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_mail_attribute)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:37.372472 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3168c7e-090f-49fe-8a36-2132f98f4543 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:37.373926 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2030/4049] 10.222.0.17 () {58 vars in 1247 bytes} [Sat Jul 23 21:27:37 2022] GET /identity/v3/domains/config/ldap/user_mail_attribute/default => generated 44 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 23 21:27:37.379240 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3168c7e-090f-49fe-8a36-2132f98f4543 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:37.383846 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-add4f6a4-c023-4459-968f-34f3b03fc878 None None] MFA Rules not processed for user `6411b0f635714320a4f40e9bc5e260e5`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:27:37.386281 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-add4f6a4-c023-4459-968f-34f3b03fc878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:37.404749 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3168c7e-090f-49fe-8a36-2132f98f4543 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:37.412520 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f85dac-a9a4-4b77-8bb9-5cac9672f184 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be852700449948d3ad94ede728bc82f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e83f3225a2547ff887f61cb3b55b103', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:37.413488 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f85dac-a9a4-4b77-8bb9-5cac9672f184 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:37.413904 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f85dac-a9a4-4b77-8bb9-5cac9672f184 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:37.414282 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f85dac-a9a4-4b77-8bb9-5cac9672f184 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_description_attribute/default` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:37.415061 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f85dac-a9a4-4b77-8bb9-5cac9672f184 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_description_attribute)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:37.418385 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f85dac-a9a4-4b77-8bb9-5cac9672f184 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:37.420738 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2031/4050] 10.222.0.17 () {58 vars in 1268 bytes} [Sat Jul 23 21:27:37 2022] GET /identity/v3/domains/config/ldap/user_description_attribute/default => generated 58 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 23 21:27:37.424603 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f85dac-a9a4-4b77-8bb9-5cac9672f184 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:37.449842 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f85dac-a9a4-4b77-8bb9-5cac9672f184 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:37.457542 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d18b1bf-84b0-4d00-8b1e-f3511b3fda40 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be852700449948d3ad94ede728bc82f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e83f3225a2547ff887f61cb3b55b103', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:37.460319 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d18b1bf-84b0-4d00-8b1e-f3511b3fda40 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:37.460900 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d18b1bf-84b0-4d00-8b1e-f3511b3fda40 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:37.461845 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d18b1bf-84b0-4d00-8b1e-f3511b3fda40 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_pass_attribute/default` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:37.463226 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d18b1bf-84b0-4d00-8b1e-f3511b3fda40 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_pass_attribute)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:37.469588 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d18b1bf-84b0-4d00-8b1e-f3511b3fda40 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:37.471583 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2032/4051] 10.222.0.17 () {58 vars in 1247 bytes} [Sat Jul 23 21:27:37 2022] GET /identity/v3/domains/config/ldap/user_pass_attribute/default => generated 52 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 23 21:27:37.481105 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:27:37.486797 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d18b1bf-84b0-4d00-8b1e-f3511b3fda40 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:37.502069 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d18b1bf-84b0-4d00-8b1e-f3511b3fda40 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:37.508491 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4dbe27-fe56-40ec-be45-1c34e46145dd tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be852700449948d3ad94ede728bc82f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e83f3225a2547ff887f61cb3b55b103', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:37.516110 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4dbe27-fe56-40ec-be45-1c34e46145dd tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:37.516505 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4dbe27-fe56-40ec-be45-1c34e46145dd tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:37.516796 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4dbe27-fe56-40ec-be45-1c34e46145dd tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_attribute/default` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:37.517511 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4dbe27-fe56-40ec-be45-1c34e46145dd tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_attribute)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:37.520228 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2020/4052] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:27:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:27:37.523812 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4dbe27-fe56-40ec-be45-1c34e46145dd tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:37.528177 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2033/4053] 10.222.0.17 () {58 vars in 1256 bytes} [Sat Jul 23 21:27:37 2022] GET /identity/v3/domains/config/ldap/user_enabled_attribute/default => generated 50 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 23 21:27:37.529897 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add4f6a4-c023-4459-968f-34f3b03fc878 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:37.530152 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9d61b1-af41-4eea-8e47-cee0c4f234f7 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:37.530365 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9d61b1-af41-4eea-8e47-cee0c4f234f7 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:37.530611 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9d61b1-af41-4eea-8e47-cee0c4f234f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:37.555375 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-fd9d61b1-af41-4eea-8e47-cee0c4f234f7 None None] MFA Rules not processed for user `6411b0f635714320a4f40e9bc5e260e5`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:27:37.557616 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add4f6a4-c023-4459-968f-34f3b03fc878 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:37.557781 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-fd9d61b1-af41-4eea-8e47-cee0c4f234f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:37.569206 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2034/4054] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:27:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:27:37.573694 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f89d32-a560-4889-b200-a4f1c144b281 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be852700449948d3ad94ede728bc82f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e83f3225a2547ff887f61cb3b55b103', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:37.579887 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9d61b1-af41-4eea-8e47-cee0c4f234f7 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:37.582469 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-fd9d61b1-af41-4eea-8e47-cee0c4f234f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:37.583351 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f89d32-a560-4889-b200-a4f1c144b281 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:37.583710 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f89d32-a560-4889-b200-a4f1c144b281 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:37.584065 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f89d32-a560-4889-b200-a4f1c144b281 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_invert/default` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:37.591073 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f89d32-a560-4889-b200-a4f1c144b281 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_invert)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:37.593362 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f89d32-a560-4889-b200-a4f1c144b281 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:37.594812 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2021/4055] 10.222.0.17 () {58 vars in 1247 bytes} [Sat Jul 23 21:27:37 2022] GET /identity/v3/domains/config/ldap/user_enabled_invert/default => generated 43 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 23 21:27:37.600523 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f89d32-a560-4889-b200-a4f1c144b281 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:37.619987 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f89d32-a560-4889-b200-a4f1c144b281 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:37.638457 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd35be3-9f64-4d53-b937-055629827bbf tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be852700449948d3ad94ede728bc82f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e83f3225a2547ff887f61cb3b55b103', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:37.639146 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd35be3-9f64-4d53-b937-055629827bbf tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:37.639390 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd35be3-9f64-4d53-b937-055629827bbf tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:37.639678 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd35be3-9f64-4d53-b937-055629827bbf tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_mask/default` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:37.640321 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd35be3-9f64-4d53-b937-055629827bbf tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_mask)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:37.641941 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd35be3-9f64-4d53-b937-055629827bbf tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:37.643319 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2022/4056] 10.222.0.17 () {58 vars in 1241 bytes} [Sat Jul 23 21:27:37 2022] GET /identity/v3/domains/config/ldap/user_enabled_mask/default => generated 37 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 23 21:27:37.655805 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd35be3-9f64-4d53-b937-055629827bbf tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:37.679563 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd35be3-9f64-4d53-b937-055629827bbf tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:37.689002 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcca8223-cdb6-42e5-8253-0ebb2a87c272 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be852700449948d3ad94ede728bc82f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e83f3225a2547ff887f61cb3b55b103', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:37.689839 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcca8223-cdb6-42e5-8253-0ebb2a87c272 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:37.690144 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcca8223-cdb6-42e5-8253-0ebb2a87c272 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:37.690499 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcca8223-cdb6-42e5-8253-0ebb2a87c272 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_default/default` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:37.691079 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcca8223-cdb6-42e5-8253-0ebb2a87c272 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_default)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:37.692738 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcca8223-cdb6-42e5-8253-0ebb2a87c272 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:37.696138 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2023/4057] 10.222.0.17 () {58 vars in 1250 bytes} [Sat Jul 23 21:27:37 2022] GET /identity/v3/domains/config/ldap/user_enabled_default/default => generated 45 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 23 21:27:37.700498 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcca8223-cdb6-42e5-8253-0ebb2a87c272 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:37.712610 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcca8223-cdb6-42e5-8253-0ebb2a87c272 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:37.718287 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac5912b-0781-446d-be31-6ae8a2b611ea tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be852700449948d3ad94ede728bc82f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e83f3225a2547ff887f61cb3b55b103', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:37.719703 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac5912b-0781-446d-be31-6ae8a2b611ea tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:37.719989 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac5912b-0781-446d-be31-6ae8a2b611ea tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:37.720265 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac5912b-0781-446d-be31-6ae8a2b611ea tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_attribute_ignore/default` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:37.722634 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac5912b-0781-446d-be31-6ae8a2b611ea tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_attribute_ignore)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:37.725182 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac5912b-0781-446d-be31-6ae8a2b611ea tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:37.727737 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2024/4058] 10.222.0.17 () {58 vars in 1253 bytes} [Sat Jul 23 21:27:37 2022] GET /identity/v3/domains/config/ldap/user_attribute_ignore/default => generated 62 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Jul 23 21:27:37.732051 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac5912b-0781-446d-be31-6ae8a2b611ea tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:37.733189 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9d61b1-af41-4eea-8e47-cee0c4f234f7 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:37.741032 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2561fe3-878b-462b-8e80-bc33dcc348ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:37.741875 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2561fe3-878b-462b-8e80-bc33dcc348ba service nova] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:37.742242 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2561fe3-878b-462b-8e80-bc33dcc348ba service nova] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:37.742578 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2561fe3-878b-462b-8e80-bc33dcc348ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:37.751028 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac5912b-0781-446d-be31-6ae8a2b611ea tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:37.752306 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2561fe3-878b-462b-8e80-bc33dcc348ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:37.754677 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2561fe3-878b-462b-8e80-bc33dcc348ba service nova] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:37.768236 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2035/4059] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:27:37 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 23 21:27:37.768781 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c16344-6baa-4833-ae8a-35778285ce57 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be852700449948d3ad94ede728bc82f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e83f3225a2547ff887f61cb3b55b103', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:37.769624 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c16344-6baa-4833-ae8a-35778285ce57 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:37.770062 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c16344-6baa-4833-ae8a-35778285ce57 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:37.770344 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c16344-6baa-4833-ae8a-35778285ce57 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_default_project_id_attribute/default` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:37.771016 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c16344-6baa-4833-ae8a-35778285ce57 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_default_project_id_attribute)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:37.772624 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c16344-6baa-4833-ae8a-35778285ce57 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:37.774225 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2025/4060] 10.222.0.17 () {58 vars in 1289 bytes} [Sat Jul 23 21:27:37 2022] GET /identity/v3/domains/config/ldap/user_default_project_id_attribute/default => generated 56 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Jul 23 21:27:37.778152 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2561fe3-878b-462b-8e80-bc33dcc348ba service nova] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:37.791231 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2561fe3-878b-462b-8e80-bc33dcc348ba service nova] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:37.808676 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235a1757-9095-4a92-b9b2-846a417a2fa9 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be852700449948d3ad94ede728bc82f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e83f3225a2547ff887f61cb3b55b103', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:37.809515 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235a1757-9095-4a92-b9b2-846a417a2fa9 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:37.809974 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235a1757-9095-4a92-b9b2-846a417a2fa9 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:37.810396 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235a1757-9095-4a92-b9b2-846a417a2fa9 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation/default` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:37.811064 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235a1757-9095-4a92-b9b2-846a417a2fa9 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:37.812751 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235a1757-9095-4a92-b9b2-846a417a2fa9 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:37.814694 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2036/4061] 10.222.0.17 () {58 vars in 1256 bytes} [Sat Jul 23 21:27:37 2022] GET /identity/v3/domains/config/ldap/user_enabled_emulation/default => generated 46 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Jul 23 21:27:37.820109 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c16344-6baa-4833-ae8a-35778285ce57 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:37.838281 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c16344-6baa-4833-ae8a-35778285ce57 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:37.847520 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11a34cd-f950-4f36-b024-a1f5098e3b16 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be852700449948d3ad94ede728bc82f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e83f3225a2547ff887f61cb3b55b103', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:37.848478 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11a34cd-f950-4f36-b024-a1f5098e3b16 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:37.848760 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11a34cd-f950-4f36-b024-a1f5098e3b16 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:37.849032 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11a34cd-f950-4f36-b024-a1f5098e3b16 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation_dn/default` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:37.849955 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11a34cd-f950-4f36-b024-a1f5098e3b16 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation_dn)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:37.851776 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11a34cd-f950-4f36-b024-a1f5098e3b16 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:37.853900 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2026/4062] 10.222.0.17 () {58 vars in 1265 bytes} [Sat Jul 23 21:27:37 2022] GET /identity/v3/domains/config/ldap/user_enabled_emulation_dn/default => generated 48 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 23 21:27:37.857729 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235a1757-9095-4a92-b9b2-846a417a2fa9 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:37.869353 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235a1757-9095-4a92-b9b2-846a417a2fa9 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:37.875113 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990faf93-0796-46d8-9d07-118c5611135c tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be852700449948d3ad94ede728bc82f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e83f3225a2547ff887f61cb3b55b103', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:37.875948 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990faf93-0796-46d8-9d07-118c5611135c tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:37.876221 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990faf93-0796-46d8-9d07-118c5611135c tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:37.876490 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990faf93-0796-46d8-9d07-118c5611135c tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation_use_group_config/default` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:37.877145 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990faf93-0796-46d8-9d07-118c5611135c tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation_use_group_config)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:37.878766 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990faf93-0796-46d8-9d07-118c5611135c tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:37.881915 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2037/4063] 10.222.0.17 () {58 vars in 1307 bytes} [Sat Jul 23 21:27:37 2022] GET /identity/v3/domains/config/ldap/user_enabled_emulation_use_group_config/default => generated 63 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Jul 23 21:27:37.884846 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11a34cd-f950-4f36-b024-a1f5098e3b16 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:37.900912 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11a34cd-f950-4f36-b024-a1f5098e3b16 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:37.915175 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31935d00-3196-4cf8-8737-dbe088f6c238 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be852700449948d3ad94ede728bc82f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e83f3225a2547ff887f61cb3b55b103', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:37.916484 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31935d00-3196-4cf8-8737-dbe088f6c238 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:37.916941 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31935d00-3196-4cf8-8737-dbe088f6c238 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:37.917671 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31935d00-3196-4cf8-8737-dbe088f6c238 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_additional_attribute_mapping/default` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:37.919238 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31935d00-3196-4cf8-8737-dbe088f6c238 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_additional_attribute_mapping)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:37.921491 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31935d00-3196-4cf8-8737-dbe088f6c238 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:37.924397 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2027/4064] 10.222.0.17 () {58 vars in 1289 bytes} [Sat Jul 23 21:27:37 2022] GET /identity/v3/domains/config/ldap/user_additional_attribute_mapping/default => generated 54 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 23 21:27:37.927853 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990faf93-0796-46d8-9d07-118c5611135c tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:37.938985 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990faf93-0796-46d8-9d07-118c5611135c tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:37.945143 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ca97b5-15c9-4b82-8bdc-e9d777045352 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be852700449948d3ad94ede728bc82f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e83f3225a2547ff887f61cb3b55b103', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:37.946203 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ca97b5-15c9-4b82-8bdc-e9d777045352 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:37.946977 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ca97b5-15c9-4b82-8bdc-e9d777045352 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:37.947416 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ca97b5-15c9-4b82-8bdc-e9d777045352 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_tree_dn/default` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:37.948452 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ca97b5-15c9-4b82-8bdc-e9d777045352 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_tree_dn)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:37.951511 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ca97b5-15c9-4b82-8bdc-e9d777045352 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:37.953178 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2038/4065] 10.222.0.17 () {58 vars in 1229 bytes} [Sat Jul 23 21:27:37 2022] GET /identity/v3/domains/config/ldap/group_tree_dn/default => generated 36 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 23 21:27:37.957124 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31935d00-3196-4cf8-8737-dbe088f6c238 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:37.967880 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31935d00-3196-4cf8-8737-dbe088f6c238 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:37.973014 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6c1282-d817-48f2-b563-05eba11a6605 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be852700449948d3ad94ede728bc82f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e83f3225a2547ff887f61cb3b55b103', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:37.973842 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6c1282-d817-48f2-b563-05eba11a6605 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:37.974164 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6c1282-d817-48f2-b563-05eba11a6605 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:37.974442 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6c1282-d817-48f2-b563-05eba11a6605 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_filter/default` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:37.975106 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6c1282-d817-48f2-b563-05eba11a6605 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_filter)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:37.984507 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6c1282-d817-48f2-b563-05eba11a6605 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:37.989320 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2028/4066] 10.222.0.17 () {58 vars in 1226 bytes} [Sat Jul 23 21:27:37 2022] GET /identity/v3/domains/config/ldap/group_filter/default => generated 35 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 23 21:27:37.990691 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ca97b5-15c9-4b82-8bdc-e9d777045352 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:38.001663 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ca97b5-15c9-4b82-8bdc-e9d777045352 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:38.014630 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c817e1e8-e481-4040-bb88-7d06a05b1b7d tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be852700449948d3ad94ede728bc82f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e83f3225a2547ff887f61cb3b55b103', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:38.015656 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c817e1e8-e481-4040-bb88-7d06a05b1b7d tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:38.015945 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c817e1e8-e481-4040-bb88-7d06a05b1b7d tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:38.016343 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c817e1e8-e481-4040-bb88-7d06a05b1b7d tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_objectclass/default` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:38.017107 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c817e1e8-e481-4040-bb88-7d06a05b1b7d tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_objectclass)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:38.030502 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c817e1e8-e481-4040-bb88-7d06a05b1b7d tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:38.031851 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2039/4067] 10.222.0.17 () {58 vars in 1241 bytes} [Sat Jul 23 21:27:37 2022] GET /identity/v3/domains/config/ldap/group_objectclass/default => generated 50 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 23 21:27:38.036130 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6c1282-d817-48f2-b563-05eba11a6605 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:38.049436 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6c1282-d817-48f2-b563-05eba11a6605 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:38.054758 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a0241f-d2eb-4ca0-bbff-d512e0d1d00b tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be852700449948d3ad94ede728bc82f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e83f3225a2547ff887f61cb3b55b103', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:38.056817 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a0241f-d2eb-4ca0-bbff-d512e0d1d00b tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:38.056817 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a0241f-d2eb-4ca0-bbff-d512e0d1d00b tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:38.056817 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a0241f-d2eb-4ca0-bbff-d512e0d1d00b tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_id_attribute/default` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:38.056817 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a0241f-d2eb-4ca0-bbff-d512e0d1d00b tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_id_attribute)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:38.058381 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a0241f-d2eb-4ca0-bbff-d512e0d1d00b tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:38.059729 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2029/4068] 10.222.0.17 () {58 vars in 1244 bytes} [Sat Jul 23 21:27:38 2022] GET /identity/v3/domains/config/ldap/group_id_attribute/default => generated 41 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 23 21:27:38.064547 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c817e1e8-e481-4040-bb88-7d06a05b1b7d tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:38.076768 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c817e1e8-e481-4040-bb88-7d06a05b1b7d tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:38.082828 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711498e8-2769-4994-bb67-a4019f2433de tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be852700449948d3ad94ede728bc82f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e83f3225a2547ff887f61cb3b55b103', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:38.083701 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711498e8-2769-4994-bb67-a4019f2433de tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:38.084044 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711498e8-2769-4994-bb67-a4019f2433de tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:38.084386 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711498e8-2769-4994-bb67-a4019f2433de tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_name_attribute/default` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:38.085343 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711498e8-2769-4994-bb67-a4019f2433de tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_name_attribute)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:38.087042 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711498e8-2769-4994-bb67-a4019f2433de tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:38.091435 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2040/4069] 10.222.0.17 () {58 vars in 1250 bytes} [Sat Jul 23 21:27:38 2022] GET /identity/v3/domains/config/ldap/group_name_attribute/default => generated 43 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 23 21:27:38.092801 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a0241f-d2eb-4ca0-bbff-d512e0d1d00b tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:38.107183 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a0241f-d2eb-4ca0-bbff-d512e0d1d00b tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:38.112870 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afee0199-1bc2-40f0-a508-66d419c2b569 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be852700449948d3ad94ede728bc82f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e83f3225a2547ff887f61cb3b55b103', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:38.114330 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afee0199-1bc2-40f0-a508-66d419c2b569 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:38.114822 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afee0199-1bc2-40f0-a508-66d419c2b569 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:38.115440 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afee0199-1bc2-40f0-a508-66d419c2b569 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_members_are_ids/default` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:38.116604 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afee0199-1bc2-40f0-a508-66d419c2b569 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_members_are_ids)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:38.118789 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afee0199-1bc2-40f0-a508-66d419c2b569 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:38.120338 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2030/4070] 10.222.0.17 () {58 vars in 1253 bytes} [Sat Jul 23 21:27:38 2022] GET /identity/v3/domains/config/ldap/group_members_are_ids/default => generated 45 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 23 21:27:38.128144 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711498e8-2769-4994-bb67-a4019f2433de tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:38.139213 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711498e8-2769-4994-bb67-a4019f2433de tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:38.153407 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83946cb-4254-427e-ad08-809f4043070d tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be852700449948d3ad94ede728bc82f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e83f3225a2547ff887f61cb3b55b103', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:38.154347 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83946cb-4254-427e-ad08-809f4043070d tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:38.154691 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83946cb-4254-427e-ad08-809f4043070d tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:38.155034 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83946cb-4254-427e-ad08-809f4043070d tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_member_attribute/default` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:38.155772 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83946cb-4254-427e-ad08-809f4043070d tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_member_attribute)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:38.157455 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83946cb-4254-427e-ad08-809f4043070d tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:38.161197 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2041/4071] 10.222.0.17 () {58 vars in 1256 bytes} [Sat Jul 23 21:27:38 2022] GET /identity/v3/domains/config/ldap/group_member_attribute/default => generated 49 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 23 21:27:38.165267 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afee0199-1bc2-40f0-a508-66d419c2b569 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:38.175877 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afee0199-1bc2-40f0-a508-66d419c2b569 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:38.186669 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf67547-b281-47f5-8d10-a719ec5aabef tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be852700449948d3ad94ede728bc82f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e83f3225a2547ff887f61cb3b55b103', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:38.187606 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf67547-b281-47f5-8d10-a719ec5aabef tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:38.187790 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf67547-b281-47f5-8d10-a719ec5aabef tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:38.188068 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf67547-b281-47f5-8d10-a719ec5aabef tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_desc_attribute/default` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:38.188746 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf67547-b281-47f5-8d10-a719ec5aabef tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_desc_attribute)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:38.195101 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf67547-b281-47f5-8d10-a719ec5aabef tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:38.196709 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2031/4072] 10.222.0.17 () {58 vars in 1250 bytes} [Sat Jul 23 21:27:38 2022] GET /identity/v3/domains/config/ldap/group_desc_attribute/default => generated 52 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 23 21:27:38.200606 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83946cb-4254-427e-ad08-809f4043070d tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:38.211535 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83946cb-4254-427e-ad08-809f4043070d tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:38.217024 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebe1700-750f-46a8-9376-b6f89b67a471 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be852700449948d3ad94ede728bc82f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e83f3225a2547ff887f61cb3b55b103', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:38.217850 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebe1700-750f-46a8-9376-b6f89b67a471 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:38.218272 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebe1700-750f-46a8-9376-b6f89b67a471 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:38.218556 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebe1700-750f-46a8-9376-b6f89b67a471 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_attribute_ignore/default` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:38.219222 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebe1700-750f-46a8-9376-b6f89b67a471 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_attribute_ignore)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:38.220834 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebe1700-750f-46a8-9376-b6f89b67a471 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:38.222044 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2042/4073] 10.222.0.17 () {58 vars in 1256 bytes} [Sat Jul 23 21:27:38 2022] GET /identity/v3/domains/config/ldap/group_attribute_ignore/default => generated 43 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Jul 23 21:27:38.226614 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf67547-b281-47f5-8d10-a719ec5aabef tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:38.237887 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf67547-b281-47f5-8d10-a719ec5aabef tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:38.246075 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3502fd-3363-4c7d-ad33-6db2051cb114 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be852700449948d3ad94ede728bc82f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e83f3225a2547ff887f61cb3b55b103', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:38.246850 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3502fd-3363-4c7d-ad33-6db2051cb114 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:38.247137 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3502fd-3363-4c7d-ad33-6db2051cb114 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:38.247418 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3502fd-3363-4c7d-ad33-6db2051cb114 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_additional_attribute_mapping/default` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:38.248091 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3502fd-3363-4c7d-ad33-6db2051cb114 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_additional_attribute_mapping)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:38.249710 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3502fd-3363-4c7d-ad33-6db2051cb114 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:38.251425 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2032/4074] 10.222.0.17 () {58 vars in 1292 bytes} [Sat Jul 23 21:27:38 2022] GET /identity/v3/domains/config/ldap/group_additional_attribute_mapping/default => generated 55 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 23 21:27:38.255099 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebe1700-750f-46a8-9376-b6f89b67a471 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:38.276555 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebe1700-750f-46a8-9376-b6f89b67a471 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:38.281773 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e904b84-381c-4f5a-88af-46018f613be1 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be852700449948d3ad94ede728bc82f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e83f3225a2547ff887f61cb3b55b103', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:38.283194 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e904b84-381c-4f5a-88af-46018f613be1 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:38.283549 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e904b84-381c-4f5a-88af-46018f613be1 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:38.284581 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e904b84-381c-4f5a-88af-46018f613be1 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_cacertfile/default` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:38.285324 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e904b84-381c-4f5a-88af-46018f613be1 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_cacertfile)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:38.287333 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e904b84-381c-4f5a-88af-46018f613be1 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:38.291004 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2043/4075] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:27:38 2022] GET /identity/v3/domains/config/ldap/tls_cacertfile/default => generated 37 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 23 21:27:38.295313 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3502fd-3363-4c7d-ad33-6db2051cb114 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:38.313563 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3502fd-3363-4c7d-ad33-6db2051cb114 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:38.320327 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fa0c9f-f13e-41b2-ad61-55c7c6b4e066 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be852700449948d3ad94ede728bc82f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e83f3225a2547ff887f61cb3b55b103', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:38.320554 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fa0c9f-f13e-41b2-ad61-55c7c6b4e066 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:38.320934 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fa0c9f-f13e-41b2-ad61-55c7c6b4e066 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:38.321263 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fa0c9f-f13e-41b2-ad61-55c7c6b4e066 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_cacertdir/default` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:38.321964 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fa0c9f-f13e-41b2-ad61-55c7c6b4e066 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_cacertdir)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:38.323674 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fa0c9f-f13e-41b2-ad61-55c7c6b4e066 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:38.328735 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2033/4076] 10.222.0.17 () {58 vars in 1229 bytes} [Sat Jul 23 21:27:38 2022] GET /identity/v3/domains/config/ldap/tls_cacertdir/default => generated 36 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Jul 23 21:27:38.329305 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e904b84-381c-4f5a-88af-46018f613be1 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:38.344009 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e904b84-381c-4f5a-88af-46018f613be1 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:38.350243 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d588d01-6a1c-4c99-95e9-9108caa6c058 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be852700449948d3ad94ede728bc82f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e83f3225a2547ff887f61cb3b55b103', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:38.351231 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d588d01-6a1c-4c99-95e9-9108caa6c058 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:38.351679 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d588d01-6a1c-4c99-95e9-9108caa6c058 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:38.351961 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d588d01-6a1c-4c99-95e9-9108caa6c058 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_tls/default` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:38.352882 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d588d01-6a1c-4c99-95e9-9108caa6c058 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_tls)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:38.359375 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d588d01-6a1c-4c99-95e9-9108caa6c058 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:38.361112 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2044/4077] 10.222.0.17 () {58 vars in 1211 bytes} [Sat Jul 23 21:27:38 2022] GET /identity/v3/domains/config/ldap/use_tls/default => generated 31 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Jul 23 21:27:38.365629 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fa0c9f-f13e-41b2-ad61-55c7c6b4e066 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:38.381016 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fa0c9f-f13e-41b2-ad61-55c7c6b4e066 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:38.390222 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5a9add-7056-4c5e-abfb-b0e3e75ab0d3 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be852700449948d3ad94ede728bc82f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e83f3225a2547ff887f61cb3b55b103', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:38.390764 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5a9add-7056-4c5e-abfb-b0e3e75ab0d3 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:38.391055 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5a9add-7056-4c5e-abfb-b0e3e75ab0d3 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:38.391329 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5a9add-7056-4c5e-abfb-b0e3e75ab0d3 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_req_cert/default` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:38.391986 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5a9add-7056-4c5e-abfb-b0e3e75ab0d3 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_req_cert)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:38.393598 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5a9add-7056-4c5e-abfb-b0e3e75ab0d3 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:38.397945 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2034/4078] 10.222.0.17 () {58 vars in 1226 bytes} [Sat Jul 23 21:27:38 2022] GET /identity/v3/domains/config/ldap/tls_req_cert/default => generated 39 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 23 21:27:38.399166 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d588d01-6a1c-4c99-95e9-9108caa6c058 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:38.416134 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d588d01-6a1c-4c99-95e9-9108caa6c058 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:38.424939 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429ce4dd-c140-4189-87db-d7af5ef13612 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be852700449948d3ad94ede728bc82f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e83f3225a2547ff887f61cb3b55b103', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:38.428245 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429ce4dd-c140-4189-87db-d7af5ef13612 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:38.429062 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429ce4dd-c140-4189-87db-d7af5ef13612 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:38.429645 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429ce4dd-c140-4189-87db-d7af5ef13612 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_pool/default` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:38.430600 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429ce4dd-c140-4189-87db-d7af5ef13612 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_pool)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:38.435076 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429ce4dd-c140-4189-87db-d7af5ef13612 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:38.436315 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2045/4079] 10.222.0.17 () {58 vars in 1214 bytes} [Sat Jul 23 21:27:38 2022] GET /identity/v3/domains/config/ldap/use_pool/default => generated 31 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 23 21:27:38.440783 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5a9add-7056-4c5e-abfb-b0e3e75ab0d3 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:38.453141 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5a9add-7056-4c5e-abfb-b0e3e75ab0d3 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:38.458611 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf16e02-8fc5-48ab-afb5-e528ed762015 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be852700449948d3ad94ede728bc82f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e83f3225a2547ff887f61cb3b55b103', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:38.461792 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf16e02-8fc5-48ab-afb5-e528ed762015 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:38.462303 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf16e02-8fc5-48ab-afb5-e528ed762015 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:38.462865 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf16e02-8fc5-48ab-afb5-e528ed762015 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_size/default` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:38.463703 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf16e02-8fc5-48ab-afb5-e528ed762015 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_size)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:38.465974 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf16e02-8fc5-48ab-afb5-e528ed762015 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:38.469890 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2035/4080] 10.222.0.17 () {58 vars in 1217 bytes} [Sat Jul 23 21:27:38 2022] GET /identity/v3/domains/config/ldap/pool_size/default => generated 30 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 23 21:27:38.474160 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429ce4dd-c140-4189-87db-d7af5ef13612 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:38.489763 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429ce4dd-c140-4189-87db-d7af5ef13612 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:38.502282 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2f9a9b-d2da-4249-b293-962e94c85f40 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be852700449948d3ad94ede728bc82f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e83f3225a2547ff887f61cb3b55b103', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:38.503321 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2f9a9b-d2da-4249-b293-962e94c85f40 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:38.503820 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2f9a9b-d2da-4249-b293-962e94c85f40 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:38.504924 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2f9a9b-d2da-4249-b293-962e94c85f40 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_retry_max/default` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:38.505676 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2f9a9b-d2da-4249-b293-962e94c85f40 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_retry_max)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:38.508798 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2f9a9b-d2da-4249-b293-962e94c85f40 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:38.511000 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2046/4081] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:27:38 2022] GET /identity/v3/domains/config/ldap/pool_retry_max/default => generated 34 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 23 21:27:38.515130 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf16e02-8fc5-48ab-afb5-e528ed762015 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:38.532575 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf16e02-8fc5-48ab-afb5-e528ed762015 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:38.546853 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a537791-5ea5-4170-8add-d453348779d9 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be852700449948d3ad94ede728bc82f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e83f3225a2547ff887f61cb3b55b103', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:38.547722 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a537791-5ea5-4170-8add-d453348779d9 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:38.548048 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a537791-5ea5-4170-8add-d453348779d9 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:38.548308 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a537791-5ea5-4170-8add-d453348779d9 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_retry_delay/default` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:38.549022 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a537791-5ea5-4170-8add-d453348779d9 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_retry_delay)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:38.550793 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a537791-5ea5-4170-8add-d453348779d9 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:38.552474 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2036/4082] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:27:38 2022] GET /identity/v3/domains/config/ldap/pool_retry_delay/default => generated 38 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 23 21:27:38.556433 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2f9a9b-d2da-4249-b293-962e94c85f40 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:38.569388 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2f9a9b-d2da-4249-b293-962e94c85f40 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:38.586075 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52e3297-93ea-4998-ae59-ebf26b19d390 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be852700449948d3ad94ede728bc82f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e83f3225a2547ff887f61cb3b55b103', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:38.586899 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52e3297-93ea-4998-ae59-ebf26b19d390 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:38.587178 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52e3297-93ea-4998-ae59-ebf26b19d390 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:38.587454 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52e3297-93ea-4998-ae59-ebf26b19d390 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_connection_timeout/default` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:38.588454 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52e3297-93ea-4998-ae59-ebf26b19d390 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_connection_timeout)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:38.590800 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52e3297-93ea-4998-ae59-ebf26b19d390 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:38.602599 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2047/4083] 10.222.0.17 () {58 vars in 1259 bytes} [Sat Jul 23 21:27:38 2022] GET /identity/v3/domains/config/ldap/pool_connection_timeout/default => generated 44 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 23 21:27:38.606679 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a537791-5ea5-4170-8add-d453348779d9 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:38.624424 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a537791-5ea5-4170-8add-d453348779d9 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:38.638804 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec571b23-9185-4c32-8e51-0206b7463f82 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be852700449948d3ad94ede728bc82f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e83f3225a2547ff887f61cb3b55b103', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:38.639653 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec571b23-9185-4c32-8e51-0206b7463f82 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:38.640118 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec571b23-9185-4c32-8e51-0206b7463f82 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:38.640243 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec571b23-9185-4c32-8e51-0206b7463f82 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_connection_lifetime/default` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:38.640858 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec571b23-9185-4c32-8e51-0206b7463f82 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_connection_lifetime)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:38.642510 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec571b23-9185-4c32-8e51-0206b7463f82 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:38.644977 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2037/4084] 10.222.0.17 () {58 vars in 1262 bytes} [Sat Jul 23 21:27:38 2022] GET /identity/v3/domains/config/ldap/pool_connection_lifetime/default => generated 46 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 23 21:27:38.649775 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52e3297-93ea-4998-ae59-ebf26b19d390 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:38.678063 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52e3297-93ea-4998-ae59-ebf26b19d390 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:38.689973 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415d5875-e5bc-4ab5-9799-d8d525fff9f1 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be852700449948d3ad94ede728bc82f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e83f3225a2547ff887f61cb3b55b103', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:38.690923 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415d5875-e5bc-4ab5-9799-d8d525fff9f1 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:38.691628 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415d5875-e5bc-4ab5-9799-d8d525fff9f1 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:38.692307 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415d5875-e5bc-4ab5-9799-d8d525fff9f1 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_auth_pool/default` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:38.693078 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415d5875-e5bc-4ab5-9799-d8d525fff9f1 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_auth_pool)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:38.694945 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415d5875-e5bc-4ab5-9799-d8d525fff9f1 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:38.697939 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2048/4085] 10.222.0.17 () {58 vars in 1229 bytes} [Sat Jul 23 21:27:38 2022] GET /identity/v3/domains/config/ldap/use_auth_pool/default => generated 36 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Jul 23 21:27:38.700679 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec571b23-9185-4c32-8e51-0206b7463f82 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:38.715217 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec571b23-9185-4c32-8e51-0206b7463f82 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:38.723925 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a240c79-4ab2-4a61-baf8-079b132eb140 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be852700449948d3ad94ede728bc82f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e83f3225a2547ff887f61cb3b55b103', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:38.725234 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a240c79-4ab2-4a61-baf8-079b132eb140 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:38.725744 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a240c79-4ab2-4a61-baf8-079b132eb140 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:38.726327 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a240c79-4ab2-4a61-baf8-079b132eb140 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] PATH_INFO: `/v3/domains/config/ldap/auth_pool_size/default` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:38.727358 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a240c79-4ab2-4a61-baf8-079b132eb140 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=auth_pool_size)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:38.729233 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a240c79-4ab2-4a61-baf8-079b132eb140 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:38.732511 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2038/4086] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:27:38 2022] GET /identity/v3/domains/config/ldap/auth_pool_size/default => generated 36 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 23 21:27:38.736822 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415d5875-e5bc-4ab5-9799-d8d525fff9f1 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:38.751395 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415d5875-e5bc-4ab5-9799-d8d525fff9f1 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:38.756945 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aaac21-2fca-4cc0-9a5e-7b53fba334b1 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be852700449948d3ad94ede728bc82f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e83f3225a2547ff887f61cb3b55b103', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:38.762390 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aaac21-2fca-4cc0-9a5e-7b53fba334b1 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:38.762767 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aaac21-2fca-4cc0-9a5e-7b53fba334b1 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:38.763133 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aaac21-2fca-4cc0-9a5e-7b53fba334b1 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] PATH_INFO: `/v3/domains/config/ldap/auth_pool_connection_lifetime/default` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:38.763748 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5aaac21-2fca-4cc0-9a5e-7b53fba334b1 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=auth_pool_connection_lifetime)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:38.765383 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5aaac21-2fca-4cc0-9a5e-7b53fba334b1 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:38.766782 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2049/4087] 10.222.0.17 () {58 vars in 1277 bytes} [Sat Jul 23 21:27:38 2022] GET /identity/v3/domains/config/ldap/auth_pool_connection_lifetime/default => generated 50 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Jul 23 21:27:38.774353 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a240c79-4ab2-4a61-baf8-079b132eb140 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:38.788424 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a240c79-4ab2-4a61-baf8-079b132eb140 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:38.800982 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37910591-1779-49b7-aeaf-e24cd3799bcc tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be852700449948d3ad94ede728bc82f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e83f3225a2547ff887f61cb3b55b103', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:38.802002 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37910591-1779-49b7-aeaf-e24cd3799bcc tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:38.802238 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37910591-1779-49b7-aeaf-e24cd3799bcc tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:38.802510 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37910591-1779-49b7-aeaf-e24cd3799bcc tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] PATH_INFO: `/v3/domains/d7378a1a3c8b48508b981e8b98e2ca33` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:38.838709 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37910591-1779-49b7-aeaf-e24cd3799bcc tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 21:27:38.857469 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-37910591-1779-49b7-aeaf-e24cd3799bcc tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Could not find domain: d7378a1a3c8b48508b981e8b98e2ca33.: keystone.exception.DomainNotFound: Could not find domain: d7378a1a3c8b48508b981e8b98e2ca33. Jul 23 21:27:38.857469 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 21:27:38.857469 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 23 21:27:38.857469 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 23 21:27:38.857469 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 23 21:27:38.857469 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 23 21:27:38.857469 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 23 21:27:38.857469 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 23 21:27:38.857469 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: d7378a1a3c8b48508b981e8b98e2ca33. Jul 23 21:27:38.857469 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 21:27:38.857469 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 23 21:27:38.857469 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 21:27:38.857469 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 21:27:38.857469 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 21:27:38.857469 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 21:27:38.858670 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 21:27:38.858670 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 21:27:38.858670 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 21:27:38.858670 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 21:27:38.858670 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 21:27:38.858670 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 21:27:38.858670 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 21:27:38.858670 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 21:27:38.858670 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jul 23 21:27:38.858670 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jul 23 21:27:38.858670 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 21:27:38.858670 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 21:27:38.858670 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 21:27:38.858670 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 21:27:38.858670 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 21:27:38.858670 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 21:27:38.859909 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 21:27:38.859909 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 21:27:38.859909 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 21:27:38.859909 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 21:27:38.859909 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 21:27:38.859909 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application with Lock( Jul 23 21:27:38.859909 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 21:27:38.859909 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._enter() Jul 23 21:27:38.859909 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 21:27:38.859909 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 21:27:38.859909 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 21:27:38.859909 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.creator() Jul 23 21:27:38.859909 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 21:27:38.859909 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application created_value = creator( Jul 23 21:27:38.859909 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 23 21:27:38.859909 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 23 21:27:38.859909 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: d7378a1a3c8b48508b981e8b98e2ca33. Jul 23 21:27:38.861095 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 21:27:38.867189 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2039/4088] 10.222.0.17 () {60 vars in 1248 bytes} [Sat Jul 23 21:27:38 2022] PATCH /identity/v3/domains/d7378a1a3c8b48508b981e8b98e2ca33 => generated 112 bytes in 90 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 23 21:27:38.868447 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aaac21-2fca-4cc0-9a5e-7b53fba334b1 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:38.884583 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aaac21-2fca-4cc0-9a5e-7b53fba334b1 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:38.889714 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0d021d-b4f2-42b5-9bc7-3e1fc4ab793e tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be852700449948d3ad94ede728bc82f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e83f3225a2547ff887f61cb3b55b103', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:38.890749 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0d021d-b4f2-42b5-9bc7-3e1fc4ab793e tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:38.891099 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0d021d-b4f2-42b5-9bc7-3e1fc4ab793e tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:38.891442 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0d021d-b4f2-42b5-9bc7-3e1fc4ab793e tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] PATH_INFO: `/v3/domains/62b4be47fb624ab7be1647ce7be11a8f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:38.906559 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0d021d-b4f2-42b5-9bc7-3e1fc4ab793e tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 21:27:38.929677 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-ab0d021d-b4f2-42b5-9bc7-3e1fc4ab793e tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Could not find domain: 62b4be47fb624ab7be1647ce7be11a8f.: keystone.exception.DomainNotFound: Could not find domain: 62b4be47fb624ab7be1647ce7be11a8f. Jul 23 21:27:38.929677 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 21:27:38.929677 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 23 21:27:38.929677 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 23 21:27:38.929677 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 23 21:27:38.929677 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 23 21:27:38.929677 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 23 21:27:38.929677 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 23 21:27:38.929677 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 62b4be47fb624ab7be1647ce7be11a8f. Jul 23 21:27:38.929677 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 21:27:38.929677 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 23 21:27:38.929677 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 21:27:38.929677 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 21:27:38.929677 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 21:27:38.929677 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 21:27:38.931098 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 21:27:38.931098 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 21:27:38.931098 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 21:27:38.931098 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 21:27:38.931098 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 21:27:38.931098 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 21:27:38.931098 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 21:27:38.931098 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 21:27:38.931098 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jul 23 21:27:38.931098 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jul 23 21:27:38.931098 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 21:27:38.931098 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 21:27:38.931098 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 21:27:38.931098 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 21:27:38.931098 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 21:27:38.931098 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 21:27:38.932629 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 21:27:38.932629 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 21:27:38.932629 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 21:27:38.932629 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 21:27:38.932629 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 21:27:38.932629 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application with Lock( Jul 23 21:27:38.932629 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 21:27:38.932629 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._enter() Jul 23 21:27:38.932629 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 21:27:38.932629 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 21:27:38.932629 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 21:27:38.932629 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.creator() Jul 23 21:27:38.932629 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 21:27:38.932629 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application created_value = creator( Jul 23 21:27:38.932629 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 23 21:27:38.932629 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 23 21:27:38.932629 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 62b4be47fb624ab7be1647ce7be11a8f. Jul 23 21:27:38.934329 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 21:27:38.934329 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2050/4089] 10.222.0.17 () {60 vars in 1248 bytes} [Sat Jul 23 21:27:38 2022] PATCH /identity/v3/domains/62b4be47fb624ab7be1647ce7be11a8f => generated 112 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 23 21:27:38.935510 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37910591-1779-49b7-aeaf-e24cd3799bcc tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:38.953061 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37910591-1779-49b7-aeaf-e24cd3799bcc tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:38.963866 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321699fe-ad84-4f2b-8c19-b80a0567dbc4 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be852700449948d3ad94ede728bc82f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e83f3225a2547ff887f61cb3b55b103', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:38.965087 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321699fe-ad84-4f2b-8c19-b80a0567dbc4 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:38.966289 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321699fe-ad84-4f2b-8c19-b80a0567dbc4 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:38.967381 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321699fe-ad84-4f2b-8c19-b80a0567dbc4 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] PATH_INFO: `/v3/domains/9a3cae61052e42b09a34e804dbaa1e76` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:39.004407 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321699fe-ad84-4f2b-8c19-b80a0567dbc4 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 21:27:39.039415 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-321699fe-ad84-4f2b-8c19-b80a0567dbc4 tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Could not find domain: 9a3cae61052e42b09a34e804dbaa1e76.: keystone.exception.DomainNotFound: Could not find domain: 9a3cae61052e42b09a34e804dbaa1e76. Jul 23 21:27:39.039415 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 21:27:39.039415 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 23 21:27:39.039415 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 23 21:27:39.039415 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 23 21:27:39.039415 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 23 21:27:39.039415 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 23 21:27:39.039415 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 23 21:27:39.039415 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 9a3cae61052e42b09a34e804dbaa1e76. Jul 23 21:27:39.039415 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 21:27:39.039415 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 23 21:27:39.039415 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 21:27:39.039415 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 21:27:39.039415 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 21:27:39.039415 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 21:27:39.041555 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 21:27:39.041555 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 21:27:39.041555 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 21:27:39.041555 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 21:27:39.041555 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 21:27:39.041555 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 21:27:39.041555 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 21:27:39.041555 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 21:27:39.041555 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jul 23 21:27:39.041555 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jul 23 21:27:39.041555 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 21:27:39.041555 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 21:27:39.041555 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 21:27:39.041555 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 21:27:39.041555 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 21:27:39.041555 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 21:27:39.043438 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 21:27:39.043438 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 21:27:39.043438 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 21:27:39.043438 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 21:27:39.043438 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 21:27:39.043438 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application with Lock( Jul 23 21:27:39.043438 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 21:27:39.043438 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._enter() Jul 23 21:27:39.043438 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 21:27:39.043438 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 21:27:39.043438 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 21:27:39.043438 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.creator() Jul 23 21:27:39.043438 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 21:27:39.043438 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application created_value = creator( Jul 23 21:27:39.043438 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 23 21:27:39.043438 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 23 21:27:39.043438 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 9a3cae61052e42b09a34e804dbaa1e76. Jul 23 21:27:39.044784 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 21:27:39.047743 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2040/4090] 10.222.0.17 () {60 vars in 1248 bytes} [Sat Jul 23 21:27:38 2022] PATCH /identity/v3/domains/9a3cae61052e42b09a34e804dbaa1e76 => generated 112 bytes in 113 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 23 21:27:39.051684 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0d021d-b4f2-42b5-9bc7-3e1fc4ab793e tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:39.054464 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-ab0d021d-b4f2-42b5-9bc7-3e1fc4ab793e tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:39.116802 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:27:39.183893 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0d021d-b4f2-42b5-9bc7-3e1fc4ab793e tempest-DomainConfigurationTestJSON-2071639130 tempest-DomainConfigurationTestJSON-2071639130-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:39.192165 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc00be88-e18e-4f30-a8e5-29a36dc82e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:39.193425 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc00be88-e18e-4f30-a8e5-29a36dc82e6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:39.194054 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc00be88-e18e-4f30-a8e5-29a36dc82e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:39.194486 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc00be88-e18e-4f30-a8e5-29a36dc82e6b admin admin] PATH_INFO: `/v3/users/0aa1ca8f6ea44d82b847489746f350cb` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:39.196949 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc00be88-e18e-4f30-a8e5-29a36dc82e6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=0aa1ca8f6ea44d82b847489746f350cb)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:39.199590 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc00be88-e18e-4f30-a8e5-29a36dc82e6b admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:39.286527 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-dc00be88-e18e-4f30-a8e5-29a36dc82e6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0aa1ca8f6ea44d82b847489746f350cb'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:39.312585 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-dc00be88-e18e-4f30-a8e5-29a36dc82e6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0aa1ca8f6ea44d82b847489746f350cb'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:39.315266 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-dc00be88-e18e-4f30-a8e5-29a36dc82e6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0aa1ca8f6ea44d82b847489746f350cb'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:39.338274 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-dc00be88-e18e-4f30-a8e5-29a36dc82e6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0aa1ca8f6ea44d82b847489746f350cb'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:39.362518 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-dc00be88-e18e-4f30-a8e5-29a36dc82e6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0aa1ca8f6ea44d82b847489746f350cb'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:39.377743 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2051/4091] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:27:39 2022] DELETE /identity/v3/users/0aa1ca8f6ea44d82b847489746f350cb => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:27:39.382720 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e46d7b2-fce0-424b-b571-70422aef338d None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:39.383195 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e46d7b2-fce0-424b-b571-70422aef338d None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:39.383770 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e46d7b2-fce0-424b-b571-70422aef338d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:39.426516 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-5e46d7b2-fce0-424b-b571-70422aef338d None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:27:39.428884 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-5e46d7b2-fce0-424b-b571-70422aef338d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:39.574233 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2041/4092] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:27:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:27:39.584591 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc00be88-e18e-4f30-a8e5-29a36dc82e6b admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:39.586081 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-dc00be88-e18e-4f30-a8e5-29a36dc82e6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:39.655979 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc00be88-e18e-4f30-a8e5-29a36dc82e6b admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:39.660788 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca4c6d5-c620-4f89-be8d-79c5c7a4e074 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:39.661842 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca4c6d5-c620-4f89-be8d-79c5c7a4e074 service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:39.662131 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca4c6d5-c620-4f89-be8d-79c5c7a4e074 service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:39.662436 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca4c6d5-c620-4f89-be8d-79c5c7a4e074 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:39.674544 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca4c6d5-c620-4f89-be8d-79c5c7a4e074 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:39.675931 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca4c6d5-c620-4f89-be8d-79c5c7a4e074 service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:39.687452 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2052/4093] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:27:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:27:40.056874 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e46d7b2-fce0-424b-b571-70422aef338d None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:40.058565 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-5e46d7b2-fce0-424b-b571-70422aef338d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:40.077065 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e46d7b2-fce0-424b-b571-70422aef338d None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:40.087548 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca48dcc2-66a8-48ba-8021-2ddc7b72dfd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:40.088447 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca48dcc2-66a8-48ba-8021-2ddc7b72dfd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:40.088890 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca48dcc2-66a8-48ba-8021-2ddc7b72dfd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:40.089165 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca48dcc2-66a8-48ba-8021-2ddc7b72dfd6 admin admin] PATH_INFO: `/v3/projects/dfcf730c030b41159e2128b5a02faabb` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:40.090497 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca48dcc2-66a8-48ba-8021-2ddc7b72dfd6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dfcf730c030b41159e2128b5a02faabb)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:40.092581 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca48dcc2-66a8-48ba-8021-2ddc7b72dfd6 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:40.156636 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:27:40.166885 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-ca48dcc2-66a8-48ba-8021-2ddc7b72dfd6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dfcf730c030b41159e2128b5a02faabb', 'request_id': 'req-ca48dcc2-66a8-48ba-8021-2ddc7b72dfd6'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:40.179762 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-ca48dcc2-66a8-48ba-8021-2ddc7b72dfd6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dfcf730c030b41159e2128b5a02faabb', 'request_id': 'req-ca48dcc2-66a8-48ba-8021-2ddc7b72dfd6'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:40.187445 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-ca48dcc2-66a8-48ba-8021-2ddc7b72dfd6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dfcf730c030b41159e2128b5a02faabb', 'request_id': 'req-ca48dcc2-66a8-48ba-8021-2ddc7b72dfd6'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:40.203373 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-ca48dcc2-66a8-48ba-8021-2ddc7b72dfd6 admin admin] The token cache is being invalidate because project dfcf730c030b41159e2128b5a02faabb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:27:40.203814 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-ca48dcc2-66a8-48ba-8021-2ddc7b72dfd6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:40.206028 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-ca48dcc2-66a8-48ba-8021-2ddc7b72dfd6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:40.228033 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2042/4094] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:27:40 2022] DELETE /identity/v3/projects/dfcf730c030b41159e2128b5a02faabb => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:27:40.231035 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca4c6d5-c620-4f89-be8d-79c5c7a4e074 service neutron] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:40.241709 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca4c6d5-c620-4f89-be8d-79c5c7a4e074 service neutron] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:40.322546 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:27:40.365649 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f9ee6a-7e6f-4bac-9ade-26bff5dba56e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:40.366914 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f9ee6a-7e6f-4bac-9ade-26bff5dba56e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:40.367380 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f9ee6a-7e6f-4bac-9ade-26bff5dba56e admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:40.368064 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f9ee6a-7e6f-4bac-9ade-26bff5dba56e admin admin] PATH_INFO: `/v3/users/be852700449948d3ad94ede728bc82f2` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:40.369659 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f9ee6a-7e6f-4bac-9ade-26bff5dba56e admin admin] RBAC: Authorizing `identity:delete_user(user_id=be852700449948d3ad94ede728bc82f2)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:40.371872 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f9ee6a-7e6f-4bac-9ade-26bff5dba56e admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:40.424166 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-c7f9ee6a-7e6f-4bac-9ade-26bff5dba56e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be852700449948d3ad94ede728bc82f2'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:40.437514 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-c7f9ee6a-7e6f-4bac-9ade-26bff5dba56e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be852700449948d3ad94ede728bc82f2'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:40.438308 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-c7f9ee6a-7e6f-4bac-9ade-26bff5dba56e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be852700449948d3ad94ede728bc82f2'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:40.449900 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-c7f9ee6a-7e6f-4bac-9ade-26bff5dba56e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be852700449948d3ad94ede728bc82f2'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:40.469766 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-c7f9ee6a-7e6f-4bac-9ade-26bff5dba56e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be852700449948d3ad94ede728bc82f2'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:40.478252 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2053/4095] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:27:40 2022] DELETE /identity/v3/users/be852700449948d3ad94ede728bc82f2 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:27:40.973896 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca48dcc2-66a8-48ba-8021-2ddc7b72dfd6 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:40.976450 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-ca48dcc2-66a8-48ba-8021-2ddc7b72dfd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:41.012619 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca48dcc2-66a8-48ba-8021-2ddc7b72dfd6 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:41.112358 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769c7ad2-ed1f-4d3f-ba38-2e546a2e7bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:41.113279 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769c7ad2-ed1f-4d3f-ba38-2e546a2e7bbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:41.113965 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769c7ad2-ed1f-4d3f-ba38-2e546a2e7bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:41.114243 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769c7ad2-ed1f-4d3f-ba38-2e546a2e7bbd admin admin] PATH_INFO: `/v3/projects/8e83f3225a2547ff887f61cb3b55b103` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:41.123845 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769c7ad2-ed1f-4d3f-ba38-2e546a2e7bbd admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e83f3225a2547ff887f61cb3b55b103)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:41.125835 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769c7ad2-ed1f-4d3f-ba38-2e546a2e7bbd admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:41.247255 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-769c7ad2-ed1f-4d3f-ba38-2e546a2e7bbd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e83f3225a2547ff887f61cb3b55b103', 'request_id': 'req-769c7ad2-ed1f-4d3f-ba38-2e546a2e7bbd'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:41.272897 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-769c7ad2-ed1f-4d3f-ba38-2e546a2e7bbd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e83f3225a2547ff887f61cb3b55b103', 'request_id': 'req-769c7ad2-ed1f-4d3f-ba38-2e546a2e7bbd'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:41.287475 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-769c7ad2-ed1f-4d3f-ba38-2e546a2e7bbd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e83f3225a2547ff887f61cb3b55b103', 'request_id': 'req-769c7ad2-ed1f-4d3f-ba38-2e546a2e7bbd'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:41.304543 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-769c7ad2-ed1f-4d3f-ba38-2e546a2e7bbd admin admin] The token cache is being invalidate because project 8e83f3225a2547ff887f61cb3b55b103 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:27:41.305200 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-769c7ad2-ed1f-4d3f-ba38-2e546a2e7bbd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:41.306455 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-769c7ad2-ed1f-4d3f-ba38-2e546a2e7bbd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:41.323935 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2043/4096] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:27:40 2022] DELETE /identity/v3/projects/8e83f3225a2547ff887f61cb3b55b103 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:27:41.329850 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949379ad-5861-4667-9ce8-ff2065f2f98d None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:41.330368 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949379ad-5861-4667-9ce8-ff2065f2f98d None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:41.330459 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949379ad-5861-4667-9ce8-ff2065f2f98d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:41.365451 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-949379ad-5861-4667-9ce8-ff2065f2f98d None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:27:41.367420 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-949379ad-5861-4667-9ce8-ff2065f2f98d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:41.511897 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2054/4097] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:27:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:27:41.521629 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f34de1c-491e-4bc4-b943-2c6f99f4a135 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:41.522147 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f34de1c-491e-4bc4-b943-2c6f99f4a135 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:41.522584 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f34de1c-491e-4bc4-b943-2c6f99f4a135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:41.565296 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-8f34de1c-491e-4bc4-b943-2c6f99f4a135 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:27:41.569645 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-8f34de1c-491e-4bc4-b943-2c6f99f4a135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:41.603298 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949379ad-5861-4667-9ce8-ff2065f2f98d None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:41.603522 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2044/4098] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:27:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:27:41.624826 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949379ad-5861-4667-9ce8-ff2065f2f98d None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:41.647174 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9401d2-b94f-45fa-8611-a3f6fd953173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:41.650408 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9401d2-b94f-45fa-8611-a3f6fd953173 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:41.651065 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9401d2-b94f-45fa-8611-a3f6fd953173 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:41.651506 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9401d2-b94f-45fa-8611-a3f6fd953173 admin admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:41.652457 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9401d2-b94f-45fa-8611-a3f6fd953173 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:27:41.655231 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9401d2-b94f-45fa-8611-a3f6fd953173 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:41.664874 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9401d2-b94f-45fa-8611-a3f6fd953173 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:41.718207 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2055/4099] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:27:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 21:27:41.721813 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f34de1c-491e-4bc4-b943-2c6f99f4a135 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:41.741798 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f34de1c-491e-4bc4-b943-2c6f99f4a135 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:41.749606 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f79c6b9-3adb-4547-9a70-1919118e842b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:41.750331 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f79c6b9-3adb-4547-9a70-1919118e842b admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:41.750517 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f79c6b9-3adb-4547-9a70-1919118e842b admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:41.750791 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f79c6b9-3adb-4547-9a70-1919118e842b admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:41.755318 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f79c6b9-3adb-4547-9a70-1919118e842b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:41.757652 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f79c6b9-3adb-4547-9a70-1919118e842b admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:41.847279 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2045/4100] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:27:41 2022] POST /identity/v3/projects => generated 367 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:27:41.848559 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9401d2-b94f-45fa-8611-a3f6fd953173 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:41.859037 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9401d2-b94f-45fa-8611-a3f6fd953173 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:41.920401 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:27:41.937634 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7f8a77-5c38-44a2-b378-17f9edda0efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:41.940267 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7f8a77-5c38-44a2-b378-17f9edda0efa admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:41.940723 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7f8a77-5c38-44a2-b378-17f9edda0efa admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:41.941196 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7f8a77-5c38-44a2-b378-17f9edda0efa admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:41.942035 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7f8a77-5c38-44a2-b378-17f9edda0efa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:41.944189 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7f8a77-5c38-44a2-b378-17f9edda0efa admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:41.979470 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2056/4101] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:27:41 2022] POST /identity/v3/users => generated 284 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:27:41.986714 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f79c6b9-3adb-4547-9a70-1919118e842b admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:42.013510 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f79c6b9-3adb-4547-9a70-1919118e842b admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:42.020192 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b1bb65-cc3d-4a1c-a95b-ca4af14d22b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:42.030009 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b1bb65-cc3d-4a1c-a95b-ca4af14d22b9 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:42.030855 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b1bb65-cc3d-4a1c-a95b-ca4af14d22b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:42.031299 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b1bb65-cc3d-4a1c-a95b-ca4af14d22b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:42.032497 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b1bb65-cc3d-4a1c-a95b-ca4af14d22b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:42.034571 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b1bb65-cc3d-4a1c-a95b-ca4af14d22b9 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:42.051184 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2046/4102] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:27:41 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:27:42.055549 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7f8a77-5c38-44a2-b378-17f9edda0efa admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:42.074263 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7f8a77-5c38-44a2-b378-17f9edda0efa admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:42.083786 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179f5d6a-95d8-4d4a-8ede-74d28a372c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:42.084741 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179f5d6a-95d8-4d4a-8ede-74d28a372c70 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:42.085187 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179f5d6a-95d8-4d4a-8ede-74d28a372c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:42.085550 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179f5d6a-95d8-4d4a-8ede-74d28a372c70 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:42.086719 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179f5d6a-95d8-4d4a-8ede-74d28a372c70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:42.088522 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179f5d6a-95d8-4d4a-8ede-74d28a372c70 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:42.104758 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2057/4103] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:27:42 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:27:42.108780 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b1bb65-cc3d-4a1c-a95b-ca4af14d22b9 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:42.121168 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b1bb65-cc3d-4a1c-a95b-ca4af14d22b9 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:42.126499 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb1db78-6884-4402-ac99-7d6704a59b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:42.136691 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb1db78-6884-4402-ac99-7d6704a59b1a admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:42.137253 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb1db78-6884-4402-ac99-7d6704a59b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:42.137689 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb1db78-6884-4402-ac99-7d6704a59b1a admin admin] PATH_INFO: `/v3/projects/e714d2516ea94817adf528c0e40579f0/users/18de76aa542c4b1d8769de4193327ed1/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:42.166580 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb1db78-6884-4402-ac99-7d6704a59b1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e714d2516ea94817adf528c0e40579f0, user_id=18de76aa542c4b1d8769de4193327ed1, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:42.169759 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb1db78-6884-4402-ac99-7d6704a59b1a admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:42.174257 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:27:42.196534 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2047/4104] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:27:42 2022] PUT /identity/v3/projects/e714d2516ea94817adf528c0e40579f0/users/18de76aa542c4b1d8769de4193327ed1/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:27:42.207917 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc75f071-fb99-4358-ba05-6b0925b4ab00 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:42.208207 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc75f071-fb99-4358-ba05-6b0925b4ab00 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:42.208482 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc75f071-fb99-4358-ba05-6b0925b4ab00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:42.251107 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-fc75f071-fb99-4358-ba05-6b0925b4ab00 None None] MFA Rules not processed for user `18de76aa542c4b1d8769de4193327ed1`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:27:42.252768 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-fc75f071-fb99-4358-ba05-6b0925b4ab00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:42.356673 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2058/4105] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:27:42 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:27:42.360814 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb1db78-6884-4402-ac99-7d6704a59b1a admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:42.445800 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb1db78-6884-4402-ac99-7d6704a59b1a admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:42.452336 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0991c01c-0057-4aa0-9f81-d23219e4558e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:42.453227 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0991c01c-0057-4aa0-9f81-d23219e4558e admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:42.453594 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0991c01c-0057-4aa0-9f81-d23219e4558e admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:42.454072 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0991c01c-0057-4aa0-9f81-d23219e4558e admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:42.455057 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0991c01c-0057-4aa0-9f81-d23219e4558e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:42.457747 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0991c01c-0057-4aa0-9f81-d23219e4558e admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:42.500337 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2048/4106] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:27:42 2022] POST /identity/v3/projects => generated 369 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:27:42.500959 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc75f071-fb99-4358-ba05-6b0925b4ab00 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:42.513145 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc75f071-fb99-4358-ba05-6b0925b4ab00 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:42.659069 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417cc1f1-fc30-49e2-bbd0-48f5e52c8341 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:42.659361 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417cc1f1-fc30-49e2-bbd0-48f5e52c8341 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:42.659603 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417cc1f1-fc30-49e2-bbd0-48f5e52c8341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:42.689686 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-417cc1f1-fc30-49e2-bbd0-48f5e52c8341 None None] MFA Rules not processed for user `c8c3d58265714ebba65b1510bd768e19`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:27:42.692210 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-417cc1f1-fc30-49e2-bbd0-48f5e52c8341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:42.693206 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4af006-08e7-4d7d-9b5e-4dfd70e63b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:42.694077 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4af006-08e7-4d7d-9b5e-4dfd70e63b52 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:42.694356 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4af006-08e7-4d7d-9b5e-4dfd70e63b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:42.694626 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4af006-08e7-4d7d-9b5e-4dfd70e63b52 admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:42.695347 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4af006-08e7-4d7d-9b5e-4dfd70e63b52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:42.697278 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4af006-08e7-4d7d-9b5e-4dfd70e63b52 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:42.732344 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2059/4107] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:27:42 2022] POST /identity/v3/users => generated 291 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:27:42.736194 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4af006-08e7-4d7d-9b5e-4dfd70e63b52 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:42.763770 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4af006-08e7-4d7d-9b5e-4dfd70e63b52 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:42.783489 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5689722b-1384-4601-963a-bb4232827b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:42.784194 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5689722b-1384-4601-963a-bb4232827b04 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:42.784567 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5689722b-1384-4601-963a-bb4232827b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:42.784848 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5689722b-1384-4601-963a-bb4232827b04 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:42.790358 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5689722b-1384-4601-963a-bb4232827b04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:42.792146 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5689722b-1384-4601-963a-bb4232827b04 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:42.804478 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2049/4108] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:27:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:27:42.829200 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2060/4109] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:27:42 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:27:42.833446 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417cc1f1-fc30-49e2-bbd0-48f5e52c8341 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:42.850836 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417cc1f1-fc30-49e2-bbd0-48f5e52c8341 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:42.862964 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c881460-68b9-401e-bc64-ead7ad0f4c1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:42.864410 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c881460-68b9-401e-bc64-ead7ad0f4c1d admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:42.864766 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c881460-68b9-401e-bc64-ead7ad0f4c1d admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:42.865657 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c881460-68b9-401e-bc64-ead7ad0f4c1d admin admin] PATH_INFO: `/v3/projects/ca8ce3e68eaf4ee7b0e476ca0ab812b1/users/40b220e0191c440d89e9d19c473c6fc8/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:42.901358 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c881460-68b9-401e-bc64-ead7ad0f4c1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca8ce3e68eaf4ee7b0e476ca0ab812b1, user_id=40b220e0191c440d89e9d19c473c6fc8, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:42.905163 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c881460-68b9-401e-bc64-ead7ad0f4c1d admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:42.929251 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2050/4110] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:27:42 2022] PUT /identity/v3/projects/ca8ce3e68eaf4ee7b0e476ca0ab812b1/users/40b220e0191c440d89e9d19c473c6fc8/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:27:42.930608 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5689722b-1384-4601-963a-bb4232827b04 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:42.956597 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5689722b-1384-4601-963a-bb4232827b04 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:43.014017 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:27:43.056443 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd7a90c-59d0-4a10-a949-94f5a9f45269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:43.057373 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd7a90c-59d0-4a10-a949-94f5a9f45269 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:43.057902 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd7a90c-59d0-4a10-a949-94f5a9f45269 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:43.058283 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd7a90c-59d0-4a10-a949-94f5a9f45269 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:43.059300 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd7a90c-59d0-4a10-a949-94f5a9f45269 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:43.061077 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd7a90c-59d0-4a10-a949-94f5a9f45269 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:43.088818 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2061/4111] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:27:42 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 21:27:43.089078 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c881460-68b9-401e-bc64-ead7ad0f4c1d admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:43.109388 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c881460-68b9-401e-bc64-ead7ad0f4c1d admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:43.114984 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5755d9d7-e54f-47f2-a728-06c708cb46c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:43.116356 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5755d9d7-e54f-47f2-a728-06c708cb46c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:43.116634 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5755d9d7-e54f-47f2-a728-06c708cb46c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:43.116905 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5755d9d7-e54f-47f2-a728-06c708cb46c0 admin admin] PATH_INFO: `/v3/projects/ca8ce3e68eaf4ee7b0e476ca0ab812b1/users/40b220e0191c440d89e9d19c473c6fc8/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:43.119034 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5755d9d7-e54f-47f2-a728-06c708cb46c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca8ce3e68eaf4ee7b0e476ca0ab812b1, user_id=40b220e0191c440d89e9d19c473c6fc8, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:43.124069 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5755d9d7-e54f-47f2-a728-06c708cb46c0 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:43.143218 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2051/4112] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:27:43 2022] PUT /identity/v3/projects/ca8ce3e68eaf4ee7b0e476ca0ab812b1/users/40b220e0191c440d89e9d19c473c6fc8/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:27:43.153947 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773fded0-62e3-448b-9d44-317d1a26f2f7 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:43.154372 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773fded0-62e3-448b-9d44-317d1a26f2f7 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:43.154764 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773fded0-62e3-448b-9d44-317d1a26f2f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:43.192901 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-773fded0-62e3-448b-9d44-317d1a26f2f7 None None] MFA Rules not processed for user `40b220e0191c440d89e9d19c473c6fc8`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:27:43.201584 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-773fded0-62e3-448b-9d44-317d1a26f2f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:43.313070 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2062/4113] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:27:43 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:27:43.314563 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5755d9d7-e54f-47f2-a728-06c708cb46c0 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:43.329783 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5755d9d7-e54f-47f2-a728-06c708cb46c0 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:43.345766 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213fb688-c785-45df-b43c-8968667e6bcf tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b220e0191c440d89e9d19c473c6fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca8ce3e68eaf4ee7b0e476ca0ab812b1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:43.346825 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213fb688-c785-45df-b43c-8968667e6bcf tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:43.347268 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213fb688-c785-45df-b43c-8968667e6bcf tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:43.348022 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213fb688-c785-45df-b43c-8968667e6bcf tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:43.349073 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213fb688-c785-45df-b43c-8968667e6bcf tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:43.350875 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213fb688-c785-45df-b43c-8968667e6bcf tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:43.387967 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2052/4114] 10.222.0.17 () {60 vars in 1148 bytes} [Sat Jul 23 21:27:43 2022] POST /identity/v3/domains => generated 275 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:27:43.388382 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773fded0-62e3-448b-9d44-317d1a26f2f7 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:43.402957 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773fded0-62e3-448b-9d44-317d1a26f2f7 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:43.519244 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a11dab4-d78d-4f8f-b093-0563b2c99adf tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b220e0191c440d89e9d19c473c6fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca8ce3e68eaf4ee7b0e476ca0ab812b1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:43.520246 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a11dab4-d78d-4f8f-b093-0563b2c99adf tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:43.520602 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a11dab4-d78d-4f8f-b093-0563b2c99adf tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:43.520947 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a11dab4-d78d-4f8f-b093-0563b2c99adf tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] PATH_INFO: `/v3/groups` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:43.521831 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a11dab4-d78d-4f8f-b093-0563b2c99adf tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:43.523009 ncdv-master-1 devstack@keystone.service[91547]: WARNING py.warnings [None req-4a11dab4-d78d-4f8f-b093-0563b2c99adf tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:27:43.523009 ncdv-master-1 devstack@keystone.service[91547]: warnings.warn(msg) Jul 23 21:27:43.523009 ncdv-master-1 devstack@keystone.service[91547]: Jul 23 21:27:43.524841 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a11dab4-d78d-4f8f-b093-0563b2c99adf tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:43.570823 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213fb688-c785-45df-b43c-8968667e6bcf tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:43.581587 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2063/4115] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:27:43 2022] POST /identity/v3/groups => generated 280 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:27:43.584567 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213fb688-c785-45df-b43c-8968667e6bcf tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:43.602090 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909b2db5-060a-4283-8f54-e452de101b17 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b220e0191c440d89e9d19c473c6fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca8ce3e68eaf4ee7b0e476ca0ab812b1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:43.603300 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909b2db5-060a-4283-8f54-e452de101b17 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:43.603590 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909b2db5-060a-4283-8f54-e452de101b17 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:43.604165 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909b2db5-060a-4283-8f54-e452de101b17 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] PATH_INFO: `/v3/groups/39d3db75a1504afc82cc2f7ca1a85154` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:43.611289 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909b2db5-060a-4283-8f54-e452de101b17 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] RBAC: Authorizing `identity:update_group(group_id=39d3db75a1504afc82cc2f7ca1a85154)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:43.612676 ncdv-master-1 devstack@keystone.service[91548]: WARNING py.warnings [None req-909b2db5-060a-4283-8f54-e452de101b17 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:27:43.612676 ncdv-master-1 devstack@keystone.service[91548]: warnings.warn(msg) Jul 23 21:27:43.612676 ncdv-master-1 devstack@keystone.service[91548]: Jul 23 21:27:43.614305 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909b2db5-060a-4283-8f54-e452de101b17 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:43.654175 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a11dab4-d78d-4f8f-b093-0563b2c99adf tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:43.668740 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a11dab4-d78d-4f8f-b093-0563b2c99adf tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:43.669884 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2053/4116] 10.222.0.17 () {60 vars in 1246 bytes} [Sat Jul 23 21:27:43 2022] PATCH /identity/v3/groups/39d3db75a1504afc82cc2f7ca1a85154 => generated 292 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:27:43.678556 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c260942a-314d-41f9-b13b-5badecc2a82e tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b220e0191c440d89e9d19c473c6fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca8ce3e68eaf4ee7b0e476ca0ab812b1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:43.679563 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c260942a-314d-41f9-b13b-5badecc2a82e tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:43.679848 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c260942a-314d-41f9-b13b-5badecc2a82e tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:43.680125 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c260942a-314d-41f9-b13b-5badecc2a82e tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] PATH_INFO: `/v3/groups/39d3db75a1504afc82cc2f7ca1a85154` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:43.688730 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c260942a-314d-41f9-b13b-5badecc2a82e tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] RBAC: Authorizing `identity:get_group(group_id=39d3db75a1504afc82cc2f7ca1a85154)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:43.689778 ncdv-master-1 devstack@keystone.service[91547]: WARNING py.warnings [None req-c260942a-314d-41f9-b13b-5badecc2a82e tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:27:43.689778 ncdv-master-1 devstack@keystone.service[91547]: warnings.warn(msg) Jul 23 21:27:43.689778 ncdv-master-1 devstack@keystone.service[91547]: Jul 23 21:27:43.692192 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c260942a-314d-41f9-b13b-5badecc2a82e tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:43.697285 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2064/4117] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:27:43 2022] GET /identity/v3/groups/39d3db75a1504afc82cc2f7ca1a85154 => generated 292 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:27:43.702101 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909b2db5-060a-4283-8f54-e452de101b17 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:43.724057 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909b2db5-060a-4283-8f54-e452de101b17 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:43.729466 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5e3d65-3b62-4e08-bcce-3c2aea8e3569 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b220e0191c440d89e9d19c473c6fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca8ce3e68eaf4ee7b0e476ca0ab812b1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:43.730469 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5e3d65-3b62-4e08-bcce-3c2aea8e3569 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:43.730799 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5e3d65-3b62-4e08-bcce-3c2aea8e3569 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:43.731077 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5e3d65-3b62-4e08-bcce-3c2aea8e3569 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] PATH_INFO: `/v3/groups/39d3db75a1504afc82cc2f7ca1a85154` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:43.732392 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5e3d65-3b62-4e08-bcce-3c2aea8e3569 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] RBAC: Authorizing `identity:update_group(group_id=39d3db75a1504afc82cc2f7ca1a85154)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:43.735123 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5e3d65-3b62-4e08-bcce-3c2aea8e3569 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:43.754094 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:UPDATE=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:27:43.771552 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2054/4118] 10.222.0.17 () {60 vars in 1245 bytes} [Sat Jul 23 21:27:43 2022] PATCH /identity/v3/groups/39d3db75a1504afc82cc2f7ca1a85154 => generated 309 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:27:43.772421 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c260942a-314d-41f9-b13b-5badecc2a82e tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:43.789481 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c260942a-314d-41f9-b13b-5badecc2a82e tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:43.804348 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2670b71c-d3eb-4fb9-a415-ba42a1e2c864 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b220e0191c440d89e9d19c473c6fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca8ce3e68eaf4ee7b0e476ca0ab812b1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:43.805140 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2670b71c-d3eb-4fb9-a415-ba42a1e2c864 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:43.805422 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2670b71c-d3eb-4fb9-a415-ba42a1e2c864 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:43.805692 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2670b71c-d3eb-4fb9-a415-ba42a1e2c864 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] PATH_INFO: `/v3/groups/39d3db75a1504afc82cc2f7ca1a85154` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:43.824165 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2670b71c-d3eb-4fb9-a415-ba42a1e2c864 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] RBAC: Authorizing `identity:delete_group(group_id=39d3db75a1504afc82cc2f7ca1a85154)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:43.825672 ncdv-master-1 devstack@keystone.service[91547]: WARNING py.warnings [None req-2670b71c-d3eb-4fb9-a415-ba42a1e2c864 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:27:43.825672 ncdv-master-1 devstack@keystone.service[91547]: warnings.warn(msg) Jul 23 21:27:43.825672 ncdv-master-1 devstack@keystone.service[91547]: Jul 23 21:27:43.828230 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2670b71c-d3eb-4fb9-a415-ba42a1e2c864 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:43.884523 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:27:43.947617 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2065/4119] 10.222.0.17 () {58 vars in 1226 bytes} [Sat Jul 23 21:27:43 2022] DELETE /identity/v3/groups/39d3db75a1504afc82cc2f7ca1a85154 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:27:43.959020 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5e3d65-3b62-4e08-bcce-3c2aea8e3569 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:43.977996 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5e3d65-3b62-4e08-bcce-3c2aea8e3569 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:44.149155 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3252359e-31c9-4c13-91cb-f127021101fb tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b220e0191c440d89e9d19c473c6fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca8ce3e68eaf4ee7b0e476ca0ab812b1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:44.150414 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3252359e-31c9-4c13-91cb-f127021101fb tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:44.151492 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3252359e-31c9-4c13-91cb-f127021101fb tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:44.152007 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3252359e-31c9-4c13-91cb-f127021101fb tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] PATH_INFO: `/v3/groups` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:44.153028 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3252359e-31c9-4c13-91cb-f127021101fb tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:44.154946 ncdv-master-1 devstack@keystone.service[91548]: WARNING py.warnings [None req-3252359e-31c9-4c13-91cb-f127021101fb tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:27:44.154946 ncdv-master-1 devstack@keystone.service[91548]: warnings.warn(msg) Jul 23 21:27:44.154946 ncdv-master-1 devstack@keystone.service[91548]: Jul 23 21:27:44.157404 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3252359e-31c9-4c13-91cb-f127021101fb tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:44.200486 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2055/4120] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:27:43 2022] POST /identity/v3/groups => generated 327 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:27:44.204786 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2670b71c-d3eb-4fb9-a415-ba42a1e2c864 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:44.223235 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2670b71c-d3eb-4fb9-a415-ba42a1e2c864 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:44.231467 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0ad3ef-7805-43fe-8eb7-8d7978aaa801 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b220e0191c440d89e9d19c473c6fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca8ce3e68eaf4ee7b0e476ca0ab812b1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:44.232688 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0ad3ef-7805-43fe-8eb7-8d7978aaa801 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:44.234275 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0ad3ef-7805-43fe-8eb7-8d7978aaa801 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:44.234816 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0ad3ef-7805-43fe-8eb7-8d7978aaa801 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:44.236054 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0ad3ef-7805-43fe-8eb7-8d7978aaa801 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:44.239249 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0ad3ef-7805-43fe-8eb7-8d7978aaa801 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:44.277446 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2066/4121] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:27:44 2022] POST /identity/v3/users => generated 321 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:27:44.287747 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3252359e-31c9-4c13-91cb-f127021101fb tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:44.298751 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3252359e-31c9-4c13-91cb-f127021101fb tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:44.305491 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e2bb52-038b-4aaf-b8c3-484c3329c124 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b220e0191c440d89e9d19c473c6fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca8ce3e68eaf4ee7b0e476ca0ab812b1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:44.306801 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e2bb52-038b-4aaf-b8c3-484c3329c124 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:44.307103 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e2bb52-038b-4aaf-b8c3-484c3329c124 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:44.307393 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e2bb52-038b-4aaf-b8c3-484c3329c124 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] PATH_INFO: `/v3/groups/b2e52b7b91ac491ea0741d2aaabb527c/users/70bd66aaf17946a583d2678b7ed7c53a` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:44.328523 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e2bb52-038b-4aaf-b8c3-484c3329c124 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=b2e52b7b91ac491ea0741d2aaabb527c, user_id=70bd66aaf17946a583d2678b7ed7c53a)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:44.329565 ncdv-master-1 devstack@keystone.service[91548]: WARNING py.warnings [None req-44e2bb52-038b-4aaf-b8c3-484c3329c124 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:add_user_to_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:27:44.329565 ncdv-master-1 devstack@keystone.service[91548]: warnings.warn(msg) Jul 23 21:27:44.329565 ncdv-master-1 devstack@keystone.service[91548]: Jul 23 21:27:44.330821 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e2bb52-038b-4aaf-b8c3-484c3329c124 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:44.372249 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2056/4122] 10.222.0.17 () {60 vars in 1359 bytes} [Sat Jul 23 21:27:44 2022] PUT /identity/v3/groups/b2e52b7b91ac491ea0741d2aaabb527c/users/70bd66aaf17946a583d2678b7ed7c53a => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:27:44.378518 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0ad3ef-7805-43fe-8eb7-8d7978aaa801 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:44.389291 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0ad3ef-7805-43fe-8eb7-8d7978aaa801 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:44.461998 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271e6baf-8814-4a6f-903c-cf1742f3d151 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b220e0191c440d89e9d19c473c6fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca8ce3e68eaf4ee7b0e476ca0ab812b1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:44.462890 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271e6baf-8814-4a6f-903c-cf1742f3d151 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:44.463012 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271e6baf-8814-4a6f-903c-cf1742f3d151 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:44.463233 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271e6baf-8814-4a6f-903c-cf1742f3d151 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:44.463898 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271e6baf-8814-4a6f-903c-cf1742f3d151 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:44.466062 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271e6baf-8814-4a6f-903c-cf1742f3d151 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:44.494151 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2067/4123] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:27:44 2022] POST /identity/v3/users => generated 321 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:27:44.498329 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e2bb52-038b-4aaf-b8c3-484c3329c124 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:44.508625 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e2bb52-038b-4aaf-b8c3-484c3329c124 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:44.514188 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2591e236-6d4b-4944-998c-fe489533dcec tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b220e0191c440d89e9d19c473c6fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca8ce3e68eaf4ee7b0e476ca0ab812b1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:44.515240 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2591e236-6d4b-4944-998c-fe489533dcec tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:44.515526 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2591e236-6d4b-4944-998c-fe489533dcec tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:44.515800 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2591e236-6d4b-4944-998c-fe489533dcec tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] PATH_INFO: `/v3/groups/b2e52b7b91ac491ea0741d2aaabb527c/users/04d8c3c05a5b44538ba7b4a5718fb91a` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:44.534013 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2591e236-6d4b-4944-998c-fe489533dcec tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=b2e52b7b91ac491ea0741d2aaabb527c, user_id=04d8c3c05a5b44538ba7b4a5718fb91a)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:44.536215 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2591e236-6d4b-4944-998c-fe489533dcec tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:44.564053 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2057/4124] 10.222.0.17 () {60 vars in 1359 bytes} [Sat Jul 23 21:27:44 2022] PUT /identity/v3/groups/b2e52b7b91ac491ea0741d2aaabb527c/users/04d8c3c05a5b44538ba7b4a5718fb91a => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:27:44.568550 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271e6baf-8814-4a6f-903c-cf1742f3d151 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:44.580601 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271e6baf-8814-4a6f-903c-cf1742f3d151 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:44.650098 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f295d109-14e0-498c-a4d9-e78a7f458569 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b220e0191c440d89e9d19c473c6fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca8ce3e68eaf4ee7b0e476ca0ab812b1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:44.651615 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f295d109-14e0-498c-a4d9-e78a7f458569 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:44.651976 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f295d109-14e0-498c-a4d9-e78a7f458569 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:44.652181 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f295d109-14e0-498c-a4d9-e78a7f458569 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:44.652893 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f295d109-14e0-498c-a4d9-e78a7f458569 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:44.655138 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f295d109-14e0-498c-a4d9-e78a7f458569 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:44.688422 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2068/4125] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:27:44 2022] POST /identity/v3/users => generated 321 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:27:44.692577 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2591e236-6d4b-4944-998c-fe489533dcec tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:44.704608 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2591e236-6d4b-4944-998c-fe489533dcec tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:44.712640 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401ea221-d9a5-4618-b7f0-fa75857b5f21 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b220e0191c440d89e9d19c473c6fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca8ce3e68eaf4ee7b0e476ca0ab812b1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:44.713779 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401ea221-d9a5-4618-b7f0-fa75857b5f21 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:44.714133 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401ea221-d9a5-4618-b7f0-fa75857b5f21 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:44.714553 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401ea221-d9a5-4618-b7f0-fa75857b5f21 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] PATH_INFO: `/v3/groups/b2e52b7b91ac491ea0741d2aaabb527c/users/bef9ed681c134f4b8f7da2f1754ce996` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:44.740535 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401ea221-d9a5-4618-b7f0-fa75857b5f21 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=b2e52b7b91ac491ea0741d2aaabb527c, user_id=bef9ed681c134f4b8f7da2f1754ce996)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:44.743410 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401ea221-d9a5-4618-b7f0-fa75857b5f21 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:44.808754 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2058/4126] 10.222.0.17 () {60 vars in 1359 bytes} [Sat Jul 23 21:27:44 2022] PUT /identity/v3/groups/b2e52b7b91ac491ea0741d2aaabb527c/users/bef9ed681c134f4b8f7da2f1754ce996 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:27:44.819820 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f295d109-14e0-498c-a4d9-e78a7f458569 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:44.836287 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f295d109-14e0-498c-a4d9-e78a7f458569 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:44.892804 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=89,keystone:DELETE=2,keystone:INSERT=9 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:27:44.912249 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64477fbf-0577-4dbe-8d5a-bacf1cb9cdb1 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b220e0191c440d89e9d19c473c6fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca8ce3e68eaf4ee7b0e476ca0ab812b1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:44.912915 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64477fbf-0577-4dbe-8d5a-bacf1cb9cdb1 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:44.913197 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64477fbf-0577-4dbe-8d5a-bacf1cb9cdb1 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:44.913496 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64477fbf-0577-4dbe-8d5a-bacf1cb9cdb1 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] PATH_INFO: `/v3/groups/b2e52b7b91ac491ea0741d2aaabb527c/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:44.915074 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64477fbf-0577-4dbe-8d5a-bacf1cb9cdb1 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] RBAC: Authorizing `identity:list_users_in_group(group_id=b2e52b7b91ac491ea0741d2aaabb527c)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:44.916452 ncdv-master-1 devstack@keystone.service[91547]: WARNING py.warnings [None req-64477fbf-0577-4dbe-8d5a-bacf1cb9cdb1 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:27:44.916452 ncdv-master-1 devstack@keystone.service[91547]: warnings.warn(msg) Jul 23 21:27:44.916452 ncdv-master-1 devstack@keystone.service[91547]: Jul 23 21:27:44.917985 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64477fbf-0577-4dbe-8d5a-bacf1cb9cdb1 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:44.936319 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2069/4127] 10.222.0.17 () {58 vars in 1241 bytes} [Sat Jul 23 21:27:44 2022] GET /identity/v3/groups/b2e52b7b91ac491ea0741d2aaabb527c/users => generated 1079 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:27:44.940398 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401ea221-d9a5-4618-b7f0-fa75857b5f21 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:44.950673 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401ea221-d9a5-4618-b7f0-fa75857b5f21 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:44.955327 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc846ab-c33b-48c4-856e-2b0410f10c89 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b220e0191c440d89e9d19c473c6fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca8ce3e68eaf4ee7b0e476ca0ab812b1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:44.956238 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc846ab-c33b-48c4-856e-2b0410f10c89 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] REQUEST_METHOD: `HEAD` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:44.956522 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc846ab-c33b-48c4-856e-2b0410f10c89 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:44.956796 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc846ab-c33b-48c4-856e-2b0410f10c89 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] PATH_INFO: `/v3/groups/b2e52b7b91ac491ea0741d2aaabb527c/users/70bd66aaf17946a583d2678b7ed7c53a` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:44.958576 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc846ab-c33b-48c4-856e-2b0410f10c89 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=b2e52b7b91ac491ea0741d2aaabb527c, user_id=70bd66aaf17946a583d2678b7ed7c53a)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:44.959604 ncdv-master-1 devstack@keystone.service[91548]: WARNING py.warnings [None req-0cc846ab-c33b-48c4-856e-2b0410f10c89 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_user_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:27:44.959604 ncdv-master-1 devstack@keystone.service[91548]: warnings.warn(msg) Jul 23 21:27:44.959604 ncdv-master-1 devstack@keystone.service[91548]: Jul 23 21:27:44.960778 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc846ab-c33b-48c4-856e-2b0410f10c89 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:44.974904 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2059/4128] 10.222.0.17 () {58 vars in 1341 bytes} [Sat Jul 23 21:27:44 2022] HEAD /identity/v3/groups/b2e52b7b91ac491ea0741d2aaabb527c/users/70bd66aaf17946a583d2678b7ed7c53a => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:27:44.979144 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64477fbf-0577-4dbe-8d5a-bacf1cb9cdb1 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:44.990208 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64477fbf-0577-4dbe-8d5a-bacf1cb9cdb1 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:44.995055 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abe72e3-beb3-4ece-98e1-7f344c519eec tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b220e0191c440d89e9d19c473c6fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca8ce3e68eaf4ee7b0e476ca0ab812b1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:44.996015 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abe72e3-beb3-4ece-98e1-7f344c519eec tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:44.996289 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abe72e3-beb3-4ece-98e1-7f344c519eec tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:44.996571 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abe72e3-beb3-4ece-98e1-7f344c519eec tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] PATH_INFO: `/v3/groups/b2e52b7b91ac491ea0741d2aaabb527c/users/70bd66aaf17946a583d2678b7ed7c53a` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:44.997226 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de30359e-86c5-4139-9993-b91907227508 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:44.997751 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de30359e-86c5-4139-9993-b91907227508 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:44.998005 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de30359e-86c5-4139-9993-b91907227508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:44.998688 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abe72e3-beb3-4ece-98e1-7f344c519eec tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=b2e52b7b91ac491ea0741d2aaabb527c, user_id=70bd66aaf17946a583d2678b7ed7c53a)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:44.999769 ncdv-master-1 devstack@keystone.service[91547]: WARNING py.warnings [None req-0abe72e3-beb3-4ece-98e1-7f344c519eec tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:remove_user_from_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:27:44.999769 ncdv-master-1 devstack@keystone.service[91547]: warnings.warn(msg) Jul 23 21:27:44.999769 ncdv-master-1 devstack@keystone.service[91547]: Jul 23 21:27:45.001076 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abe72e3-beb3-4ece-98e1-7f344c519eec tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:45.015178 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-0abe72e3-beb3-4ece-98e1-7f344c519eec tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '70bd66aaf17946a583d2678b7ed7c53a'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:45.045982 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2070/4129] 10.222.0.17 () {58 vars in 1343 bytes} [Sat Jul 23 21:27:44 2022] DELETE /identity/v3/groups/b2e52b7b91ac491ea0741d2aaabb527c/users/70bd66aaf17946a583d2678b7ed7c53a => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:27:45.050218 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abe72e3-beb3-4ece-98e1-7f344c519eec tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:45.051270 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-de30359e-86c5-4139-9993-b91907227508 None None] MFA Rules not processed for user `da80b9f2ac5b4309acbf9814b2e1e095`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:27:45.052505 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-de30359e-86c5-4139-9993-b91907227508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:45.056068 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2060/4130] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:27:44 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 23 21:27:45.065069 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de30359e-86c5-4139-9993-b91907227508 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:45.067885 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-de30359e-86c5-4139-9993-b91907227508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:45.093424 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:UPDATE=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:27:45.140732 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abe72e3-beb3-4ece-98e1-7f344c519eec tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:45.146816 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023bb822-b674-4b7d-a705-c73c1f2f5636 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b220e0191c440d89e9d19c473c6fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca8ce3e68eaf4ee7b0e476ca0ab812b1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:45.147820 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023bb822-b674-4b7d-a705-c73c1f2f5636 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] REQUEST_METHOD: `HEAD` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:45.148101 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023bb822-b674-4b7d-a705-c73c1f2f5636 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:45.148792 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023bb822-b674-4b7d-a705-c73c1f2f5636 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] PATH_INFO: `/v3/groups/b2e52b7b91ac491ea0741d2aaabb527c/users/04d8c3c05a5b44538ba7b4a5718fb91a` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:45.150973 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023bb822-b674-4b7d-a705-c73c1f2f5636 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=b2e52b7b91ac491ea0741d2aaabb527c, user_id=04d8c3c05a5b44538ba7b4a5718fb91a)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:45.152198 ncdv-master-1 devstack@keystone.service[91547]: WARNING py.warnings [None req-023bb822-b674-4b7d-a705-c73c1f2f5636 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_user_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:27:45.152198 ncdv-master-1 devstack@keystone.service[91547]: warnings.warn(msg) Jul 23 21:27:45.152198 ncdv-master-1 devstack@keystone.service[91547]: Jul 23 21:27:45.153500 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023bb822-b674-4b7d-a705-c73c1f2f5636 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:45.177455 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2071/4131] 10.222.0.17 () {58 vars in 1341 bytes} [Sat Jul 23 21:27:45 2022] HEAD /identity/v3/groups/b2e52b7b91ac491ea0741d2aaabb527c/users/04d8c3c05a5b44538ba7b4a5718fb91a => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:27:45.179450 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023bb822-b674-4b7d-a705-c73c1f2f5636 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:45.199850 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023bb822-b674-4b7d-a705-c73c1f2f5636 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:45.207536 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964674e0-c741-4e43-bfb9-e20403aedd00 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b220e0191c440d89e9d19c473c6fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca8ce3e68eaf4ee7b0e476ca0ab812b1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:45.209230 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964674e0-c741-4e43-bfb9-e20403aedd00 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:45.209923 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964674e0-c741-4e43-bfb9-e20403aedd00 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:45.210305 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964674e0-c741-4e43-bfb9-e20403aedd00 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] PATH_INFO: `/v3/groups/b2e52b7b91ac491ea0741d2aaabb527c/users/04d8c3c05a5b44538ba7b4a5718fb91a` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:45.212713 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964674e0-c741-4e43-bfb9-e20403aedd00 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=b2e52b7b91ac491ea0741d2aaabb527c, user_id=04d8c3c05a5b44538ba7b4a5718fb91a)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:45.215279 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964674e0-c741-4e43-bfb9-e20403aedd00 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:45.217501 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de30359e-86c5-4139-9993-b91907227508 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:45.221956 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e136ee6-b8a1-45e5-b214-287c3a4364ea tempest-IdentityV3UsersTest-1588861045 tempest-IdentityV3UsersTest-1588861045-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da80b9f2ac5b4309acbf9814b2e1e095', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14af6366e2a44b918b14ed9cf5137a1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:45.226871 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e136ee6-b8a1-45e5-b214-287c3a4364ea tempest-IdentityV3UsersTest-1588861045 tempest-IdentityV3UsersTest-1588861045-project] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:45.227172 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e136ee6-b8a1-45e5-b214-287c3a4364ea tempest-IdentityV3UsersTest-1588861045 tempest-IdentityV3UsersTest-1588861045-project] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:45.227453 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e136ee6-b8a1-45e5-b214-287c3a4364ea tempest-IdentityV3UsersTest-1588861045 tempest-IdentityV3UsersTest-1588861045-project] PATH_INFO: `/v3/users/da80b9f2ac5b4309acbf9814b2e1e095/password` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:45.234766 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-964674e0-c741-4e43-bfb9-e20403aedd00 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '04d8c3c05a5b44538ba7b4a5718fb91a'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:45.257483 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2072/4132] 10.222.0.17 () {58 vars in 1343 bytes} [Sat Jul 23 21:27:45 2022] DELETE /identity/v3/groups/b2e52b7b91ac491ea0741d2aaabb527c/users/04d8c3c05a5b44538ba7b4a5718fb91a => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:27:45.261295 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964674e0-c741-4e43-bfb9-e20403aedd00 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:45.341944 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-9e136ee6-b8a1-45e5-b214-287c3a4364ea tempest-IdentityV3UsersTest-1588861045 tempest-IdentityV3UsersTest-1588861045-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'da80b9f2ac5b4309acbf9814b2e1e095'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:45.364912 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2061/4133] 10.222.0.17 () {60 vars in 1268 bytes} [Sat Jul 23 21:27:45 2022] POST /identity/v3/users/da80b9f2ac5b4309acbf9814b2e1e095/password => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:27:45.369284 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e6d37c-997a-4be0-887d-875fd2581950 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:45.369784 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e6d37c-997a-4be0-887d-875fd2581950 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:45.370232 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e6d37c-997a-4be0-887d-875fd2581950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:45.390323 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964674e0-c741-4e43-bfb9-e20403aedd00 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:45.396817 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69da425c-7c86-459b-97a3-87ce34262bfd tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b220e0191c440d89e9d19c473c6fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca8ce3e68eaf4ee7b0e476ca0ab812b1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:45.398730 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69da425c-7c86-459b-97a3-87ce34262bfd tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] REQUEST_METHOD: `HEAD` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:45.399121 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69da425c-7c86-459b-97a3-87ce34262bfd tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:45.399577 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69da425c-7c86-459b-97a3-87ce34262bfd tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] PATH_INFO: `/v3/groups/b2e52b7b91ac491ea0741d2aaabb527c/users/bef9ed681c134f4b8f7da2f1754ce996` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:45.401927 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69da425c-7c86-459b-97a3-87ce34262bfd tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=b2e52b7b91ac491ea0741d2aaabb527c, user_id=bef9ed681c134f4b8f7da2f1754ce996)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:45.406750 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69da425c-7c86-459b-97a3-87ce34262bfd tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:45.428568 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2073/4134] 10.222.0.17 () {58 vars in 1341 bytes} [Sat Jul 23 21:27:45 2022] HEAD /identity/v3/groups/b2e52b7b91ac491ea0741d2aaabb527c/users/bef9ed681c134f4b8f7da2f1754ce996 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:27:45.433216 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69da425c-7c86-459b-97a3-87ce34262bfd tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:45.435986 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-84e6d37c-997a-4be0-887d-875fd2581950 None None] MFA Rules not processed for user `17b779a3e21a415bb42cde5d6863d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:27:45.438756 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-84e6d37c-997a-4be0-887d-875fd2581950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:45.457928 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69da425c-7c86-459b-97a3-87ce34262bfd tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:45.466895 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229e6b8a-c14c-4e09-89df-bbb1d8529a4a tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b220e0191c440d89e9d19c473c6fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca8ce3e68eaf4ee7b0e476ca0ab812b1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:45.468148 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229e6b8a-c14c-4e09-89df-bbb1d8529a4a tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:45.468668 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229e6b8a-c14c-4e09-89df-bbb1d8529a4a tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:45.469007 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229e6b8a-c14c-4e09-89df-bbb1d8529a4a tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] PATH_INFO: `/v3/groups/b2e52b7b91ac491ea0741d2aaabb527c/users/bef9ed681c134f4b8f7da2f1754ce996` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:45.471307 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229e6b8a-c14c-4e09-89df-bbb1d8529a4a tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=b2e52b7b91ac491ea0741d2aaabb527c, user_id=bef9ed681c134f4b8f7da2f1754ce996)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:45.473456 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229e6b8a-c14c-4e09-89df-bbb1d8529a4a tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:45.489734 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-229e6b8a-c14c-4e09-89df-bbb1d8529a4a tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'bef9ed681c134f4b8f7da2f1754ce996'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:45.495911 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=91,keystone:DELETE=6,keystone:INSERT=3 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:27:45.536595 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2074/4135] 10.222.0.17 () {58 vars in 1343 bytes} [Sat Jul 23 21:27:45 2022] DELETE /identity/v3/groups/b2e52b7b91ac491ea0741d2aaabb527c/users/bef9ed681c134f4b8f7da2f1754ce996 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:27:45.537720 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229e6b8a-c14c-4e09-89df-bbb1d8529a4a tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:45.585699 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2062/4136] 10.222.0.17 () {58 vars in 1009 bytes} [Sat Jul 23 21:27:45 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:27:45.653567 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229e6b8a-c14c-4e09-89df-bbb1d8529a4a tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:45.654022 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e6d37c-997a-4be0-887d-875fd2581950 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:45.655827 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-84e6d37c-997a-4be0-887d-875fd2581950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:45.659124 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04f3ed8-ccee-48f4-881d-41843bf23def tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b220e0191c440d89e9d19c473c6fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca8ce3e68eaf4ee7b0e476ca0ab812b1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:45.660125 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04f3ed8-ccee-48f4-881d-41843bf23def tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:45.660470 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04f3ed8-ccee-48f4-881d-41843bf23def tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:45.660739 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04f3ed8-ccee-48f4-881d-41843bf23def tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] PATH_INFO: `/v3/groups/b2e52b7b91ac491ea0741d2aaabb527c/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:45.662331 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04f3ed8-ccee-48f4-881d-41843bf23def tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] RBAC: Authorizing `identity:list_users_in_group(group_id=b2e52b7b91ac491ea0741d2aaabb527c)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:45.664836 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04f3ed8-ccee-48f4-881d-41843bf23def tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:45.684979 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2075/4137] 10.222.0.17 () {58 vars in 1241 bytes} [Sat Jul 23 21:27:45 2022] GET /identity/v3/groups/b2e52b7b91ac491ea0741d2aaabb527c/users => generated 145 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:27:45.685315 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04f3ed8-ccee-48f4-881d-41843bf23def tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:45.705732 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04f3ed8-ccee-48f4-881d-41843bf23def tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:45.712937 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1debf64-ccd2-4f41-a854-58e5b48bdfef tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b220e0191c440d89e9d19c473c6fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca8ce3e68eaf4ee7b0e476ca0ab812b1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:45.713832 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1debf64-ccd2-4f41-a854-58e5b48bdfef tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:45.714693 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1debf64-ccd2-4f41-a854-58e5b48bdfef tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:45.714693 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1debf64-ccd2-4f41-a854-58e5b48bdfef tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] PATH_INFO: `/v3/users/bef9ed681c134f4b8f7da2f1754ce996` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:45.716987 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1debf64-ccd2-4f41-a854-58e5b48bdfef tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] RBAC: Authorizing `identity:delete_user(user_id=bef9ed681c134f4b8f7da2f1754ce996)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:45.720593 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1debf64-ccd2-4f41-a854-58e5b48bdfef tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:45.775555 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e6d37c-997a-4be0-887d-875fd2581950 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:45.790206 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-d1debf64-ccd2-4f41-a854-58e5b48bdfef tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bef9ed681c134f4b8f7da2f1754ce996'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:45.800213 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-d1debf64-ccd2-4f41-a854-58e5b48bdfef tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bef9ed681c134f4b8f7da2f1754ce996'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:45.801182 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-d1debf64-ccd2-4f41-a854-58e5b48bdfef tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bef9ed681c134f4b8f7da2f1754ce996'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:45.823572 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-d1debf64-ccd2-4f41-a854-58e5b48bdfef tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bef9ed681c134f4b8f7da2f1754ce996'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:45.854583 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=95,keystone:UPDATE=1,keystone:INSERT=2,keystone:DELETE=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:27:45.865154 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-d1debf64-ccd2-4f41-a854-58e5b48bdfef tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bef9ed681c134f4b8f7da2f1754ce996'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:45.879183 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2076/4138] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:27:45 2022] DELETE /identity/v3/users/bef9ed681c134f4b8f7da2f1754ce996 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:27:45.883444 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1debf64-ccd2-4f41-a854-58e5b48bdfef tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:45.885528 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-d1debf64-ccd2-4f41-a854-58e5b48bdfef tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:45.921210 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290cc9df-312a-44d0-82d6-195995715713 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f0a685b7da46afb81024848f079d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:45.922160 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290cc9df-312a-44d0-82d6-195995715713 service swift] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:45.922567 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290cc9df-312a-44d0-82d6-195995715713 service swift] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:45.922886 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290cc9df-312a-44d0-82d6-195995715713 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:45.926709 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-290cc9df-312a-44d0-82d6-195995715713 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:46.035918 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1debf64-ccd2-4f41-a854-58e5b48bdfef tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:46.041457 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abebbd4f-779e-4c46-95cf-932d44b3c9cd tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b220e0191c440d89e9d19c473c6fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca8ce3e68eaf4ee7b0e476ca0ab812b1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:46.042638 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abebbd4f-779e-4c46-95cf-932d44b3c9cd tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:46.043106 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abebbd4f-779e-4c46-95cf-932d44b3c9cd tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:46.043552 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abebbd4f-779e-4c46-95cf-932d44b3c9cd tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] PATH_INFO: `/v3/users/04d8c3c05a5b44538ba7b4a5718fb91a` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:46.045047 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abebbd4f-779e-4c46-95cf-932d44b3c9cd tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] RBAC: Authorizing `identity:delete_user(user_id=04d8c3c05a5b44538ba7b4a5718fb91a)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:46.047228 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abebbd4f-779e-4c46-95cf-932d44b3c9cd tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:46.053515 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:27:46.058792 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290cc9df-312a-44d0-82d6-195995715713 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:46.075310 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290cc9df-312a-44d0-82d6-195995715713 service swift] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:46.097065 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2063/4139] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 23 21:27:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 23 21:27:46.115823 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-abebbd4f-779e-4c46-95cf-932d44b3c9cd tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04d8c3c05a5b44538ba7b4a5718fb91a'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:46.154837 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-abebbd4f-779e-4c46-95cf-932d44b3c9cd tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04d8c3c05a5b44538ba7b4a5718fb91a'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:46.156556 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-abebbd4f-779e-4c46-95cf-932d44b3c9cd tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04d8c3c05a5b44538ba7b4a5718fb91a'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:46.171190 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-abebbd4f-779e-4c46-95cf-932d44b3c9cd tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04d8c3c05a5b44538ba7b4a5718fb91a'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:46.187652 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-abebbd4f-779e-4c46-95cf-932d44b3c9cd tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04d8c3c05a5b44538ba7b4a5718fb91a'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:46.198669 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2077/4140] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:27:45 2022] DELETE /identity/v3/users/04d8c3c05a5b44538ba7b4a5718fb91a => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:27:46.202536 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290cc9df-312a-44d0-82d6-195995715713 service swift] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:46.217982 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290cc9df-312a-44d0-82d6-195995715713 service swift] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:46.344279 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fc431d-3f41-47b7-aece-288994da0867 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b220e0191c440d89e9d19c473c6fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca8ce3e68eaf4ee7b0e476ca0ab812b1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:46.346628 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fc431d-3f41-47b7-aece-288994da0867 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:46.348314 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fc431d-3f41-47b7-aece-288994da0867 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:46.348314 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fc431d-3f41-47b7-aece-288994da0867 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] PATH_INFO: `/v3/users/70bd66aaf17946a583d2678b7ed7c53a` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:46.351307 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fc431d-3f41-47b7-aece-288994da0867 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] RBAC: Authorizing `identity:delete_user(user_id=70bd66aaf17946a583d2678b7ed7c53a)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:46.361907 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fc431d-3f41-47b7-aece-288994da0867 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:46.371172 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49c73c0-3e64-4534-82fe-26a0263126da None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:46.371558 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49c73c0-3e64-4534-82fe-26a0263126da None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:46.371930 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49c73c0-3e64-4534-82fe-26a0263126da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:46.393196 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-f49c73c0-3e64-4534-82fe-26a0263126da None None] MFA Rules not processed for user `da80b9f2ac5b4309acbf9814b2e1e095`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:27:46.394588 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-f49c73c0-3e64-4534-82fe-26a0263126da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:46.398823 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2078/4141] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:27:46 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 23 21:27:46.403656 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b35ffe-f198-48f5-a720-68836653f96f None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:46.404115 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b35ffe-f198-48f5-a720-68836653f96f None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:46.404531 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b35ffe-f198-48f5-a720-68836653f96f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:46.407267 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-69b35ffe-f198-48f5-a720-68836653f96f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:46.440597 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-27fc431d-3f41-47b7-aece-288994da0867 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70bd66aaf17946a583d2678b7ed7c53a'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:46.441647 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-27fc431d-3f41-47b7-aece-288994da0867 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70bd66aaf17946a583d2678b7ed7c53a'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:46.453208 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-27fc431d-3f41-47b7-aece-288994da0867 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70bd66aaf17946a583d2678b7ed7c53a'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:46.468739 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-27fc431d-3f41-47b7-aece-288994da0867 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70bd66aaf17946a583d2678b7ed7c53a'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:46.492017 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-27fc431d-3f41-47b7-aece-288994da0867 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70bd66aaf17946a583d2678b7ed7c53a'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:46.493711 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:27:46.502649 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2064/4142] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:27:46 2022] DELETE /identity/v3/users/70bd66aaf17946a583d2678b7ed7c53a => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:27:46.506779 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fc431d-3f41-47b7-aece-288994da0867 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:46.508791 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-27fc431d-3f41-47b7-aece-288994da0867 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:46.526533 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-69b35ffe-f198-48f5-a720-68836653f96f None None] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Jul 23 21:27:46.526533 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 21:27:46.526533 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 21:27:46.526533 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 21:27:46.526533 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 21:27:46.526533 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 21:27:46.526533 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 21:27:46.526533 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 21:27:46.526533 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 21:27:46.526533 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 21:27:46.526533 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 21:27:46.526533 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 21:27:46.526533 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Jul 23 21:27:46.526533 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return f(*args, **kwargs) Jul 23 21:27:46.526533 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Jul 23 21:27:46.526533 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Jul 23 21:27:46.527797 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 185, in authenticate_for_token Jul 23 21:27:46.527797 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application authenticate(auth_info, auth_context) Jul 23 21:27:46.527797 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 152, in authenticate Jul 23 21:27:46.527797 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = method.authenticate(auth_info.get_method_data(method_name)) Jul 23 21:27:46.527797 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/plugins/token.py", line 42, in authenticate Jul 23 21:27:46.527797 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application token = self._get_token_ref(auth_payload) Jul 23 21:27:46.527797 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/plugins/token.py", line 36, in _get_token_ref Jul 23 21:27:46.527797 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return PROVIDERS.token_provider_api.validate_token(token_id) Jul 23 21:27:46.527797 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 21:27:46.527797 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 21:27:46.527797 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 146, in validate_token Jul 23 21:27:46.527797 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application self._is_valid_token(token, window_seconds=window_seconds) Jul 23 21:27:46.527797 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 199, in _is_valid_token Jul 23 21:27:46.527797 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application self.check_revocation(token) Jul 23 21:27:46.527797 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 21:27:46.527797 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 21:27:46.528888 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 137, in check_revocation Jul 23 21:27:46.528888 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.check_revocation_v3(token) Jul 23 21:27:46.528888 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 21:27:46.528888 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 21:27:46.528888 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 134, in check_revocation_v3 Jul 23 21:27:46.528888 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application PROVIDERS.revoke_api.check_token(token_values) Jul 23 21:27:46.528888 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 21:27:46.528888 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 21:27:46.528888 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/revoke/core.py", line 137, in check_token Jul 23 21:27:46.528888 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.TokenNotFound(_('Failed to validate token')) Jul 23 21:27:46.528888 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.TokenNotFound: Failed to validate token Jul 23 21:27:46.528888 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 21:27:46.535040 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2079/4143] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:27:46 2022] POST /identity/v3/auth/tokens => generated 80 bytes in 133 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 21:27:46.538655 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676e30f9-2ea1-4c85-ace3-24dff9237703 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:46.539805 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676e30f9-2ea1-4c85-ace3-24dff9237703 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:46.540309 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676e30f9-2ea1-4c85-ace3-24dff9237703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:46.615677 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fc431d-3f41-47b7-aece-288994da0867 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:46.625118 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41014163-3657-43e8-a9e8-f7d31687f25c tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b220e0191c440d89e9d19c473c6fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca8ce3e68eaf4ee7b0e476ca0ab812b1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:46.626813 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41014163-3657-43e8-a9e8-f7d31687f25c tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:46.626813 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41014163-3657-43e8-a9e8-f7d31687f25c tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:46.627173 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41014163-3657-43e8-a9e8-f7d31687f25c tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] PATH_INFO: `/v3/groups/b2e52b7b91ac491ea0741d2aaabb527c` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:46.634031 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41014163-3657-43e8-a9e8-f7d31687f25c tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] RBAC: Authorizing `identity:delete_group(group_id=b2e52b7b91ac491ea0741d2aaabb527c)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:46.635091 ncdv-master-1 devstack@keystone.service[91548]: WARNING py.warnings [None req-41014163-3657-43e8-a9e8-f7d31687f25c tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:27:46.635091 ncdv-master-1 devstack@keystone.service[91548]: warnings.warn(msg) Jul 23 21:27:46.635091 ncdv-master-1 devstack@keystone.service[91548]: Jul 23 21:27:46.636465 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41014163-3657-43e8-a9e8-f7d31687f25c tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:46.679712 ncdv-master-1 devstack@keystone.service[91547]: WARNING keystone.server.flask.application [None req-676e30f9-2ea1-4c85-ace3-24dff9237703 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.17: keystone.exception.Unauthorized: The request you have made requires authentication. Jul 23 21:27:46.684825 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2080/4144] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:27:46 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 147 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Jul 23 21:27:46.692331 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b673306-ce66-490f-bf75-7f2e7ab08cad None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:46.693114 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b673306-ce66-490f-bf75-7f2e7ab08cad None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:46.693632 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b673306-ce66-490f-bf75-7f2e7ab08cad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:46.755607 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-7b673306-ce66-490f-bf75-7f2e7ab08cad None None] MFA Rules not processed for user `da80b9f2ac5b4309acbf9814b2e1e095`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:27:46.758351 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-7b673306-ce66-490f-bf75-7f2e7ab08cad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:46.782265 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2065/4145] 10.222.0.17 () {58 vars in 1226 bytes} [Sat Jul 23 21:27:46 2022] DELETE /identity/v3/groups/b2e52b7b91ac491ea0741d2aaabb527c => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:27:46.784570 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41014163-3657-43e8-a9e8-f7d31687f25c tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:46.880766 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=1,keystone:UPDATE=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:27:46.882802 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41014163-3657-43e8-a9e8-f7d31687f25c tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:46.889997 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52306b0a-6e95-4e78-ba5b-0275f93f4119 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b220e0191c440d89e9d19c473c6fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca8ce3e68eaf4ee7b0e476ca0ab812b1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:46.894350 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52306b0a-6e95-4e78-ba5b-0275f93f4119 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:46.894350 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52306b0a-6e95-4e78-ba5b-0275f93f4119 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:46.895616 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52306b0a-6e95-4e78-ba5b-0275f93f4119 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] PATH_INFO: `/v3/groups` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:46.896399 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52306b0a-6e95-4e78-ba5b-0275f93f4119 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:46.896766 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2081/4146] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:27:46 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:27:46.898165 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b673306-ce66-490f-bf75-7f2e7ab08cad None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:46.898644 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52306b0a-6e95-4e78-ba5b-0275f93f4119 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:46.911990 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b673306-ce66-490f-bf75-7f2e7ab08cad None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:46.953208 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2066/4147] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:27:46 2022] POST /identity/v3/groups => generated 326 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:27:46.954939 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52306b0a-6e95-4e78-ba5b-0275f93f4119 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:46.989821 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde98cb7-8b0a-408b-a43e-8dcc1fd8ac3f tempest-IdentityV3UsersTest-1588861045 tempest-IdentityV3UsersTest-1588861045-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da80b9f2ac5b4309acbf9814b2e1e095', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14af6366e2a44b918b14ed9cf5137a1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:46.990470 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde98cb7-8b0a-408b-a43e-8dcc1fd8ac3f tempest-IdentityV3UsersTest-1588861045 tempest-IdentityV3UsersTest-1588861045-project] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:46.990916 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde98cb7-8b0a-408b-a43e-8dcc1fd8ac3f tempest-IdentityV3UsersTest-1588861045 tempest-IdentityV3UsersTest-1588861045-project] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:46.991143 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde98cb7-8b0a-408b-a43e-8dcc1fd8ac3f tempest-IdentityV3UsersTest-1588861045 tempest-IdentityV3UsersTest-1588861045-project] PATH_INFO: `/v3/users/da80b9f2ac5b4309acbf9814b2e1e095/password` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:46.993609 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52306b0a-6e95-4e78-ba5b-0275f93f4119 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:47.014905 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c93dfc6-6b8f-4482-84d7-4900558645d3 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b220e0191c440d89e9d19c473c6fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca8ce3e68eaf4ee7b0e476ca0ab812b1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:47.015871 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c93dfc6-6b8f-4482-84d7-4900558645d3 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:47.016699 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c93dfc6-6b8f-4482-84d7-4900558645d3 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:47.017202 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c93dfc6-6b8f-4482-84d7-4900558645d3 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] PATH_INFO: `/v3/groups` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:47.018417 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c93dfc6-6b8f-4482-84d7-4900558645d3 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:47.021293 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c93dfc6-6b8f-4482-84d7-4900558645d3 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:47.047838 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2067/4148] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:27:46 2022] POST /identity/v3/groups => generated 327 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:27:47.056286 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c93dfc6-6b8f-4482-84d7-4900558645d3 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:47.068599 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c93dfc6-6b8f-4482-84d7-4900558645d3 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:47.069849 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-bde98cb7-8b0a-408b-a43e-8dcc1fd8ac3f tempest-IdentityV3UsersTest-1588861045 tempest-IdentityV3UsersTest-1588861045-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'da80b9f2ac5b4309acbf9814b2e1e095'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:47.077036 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad35459-b002-4772-aae4-52591197901e tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b220e0191c440d89e9d19c473c6fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca8ce3e68eaf4ee7b0e476ca0ab812b1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:47.078226 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad35459-b002-4772-aae4-52591197901e tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:47.078907 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad35459-b002-4772-aae4-52591197901e tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:47.081179 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad35459-b002-4772-aae4-52591197901e tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] PATH_INFO: `/v3/groups` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:47.082220 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad35459-b002-4772-aae4-52591197901e tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:47.084904 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad35459-b002-4772-aae4-52591197901e tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:47.087414 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2082/4149] 10.222.0.17 () {60 vars in 1268 bytes} [Sat Jul 23 21:27:46 2022] POST /identity/v3/users/da80b9f2ac5b4309acbf9814b2e1e095/password => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:27:47.116553 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2068/4150] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:27:47 2022] POST /identity/v3/groups => generated 327 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:27:47.122119 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde98cb7-8b0a-408b-a43e-8dcc1fd8ac3f tempest-IdentityV3UsersTest-1588861045 tempest-IdentityV3UsersTest-1588861045-project] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:47.139228 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde98cb7-8b0a-408b-a43e-8dcc1fd8ac3f tempest-IdentityV3UsersTest-1588861045 tempest-IdentityV3UsersTest-1588861045-project] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:47.164889 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664fade7-33e5-49aa-b1d0-31fbf6cc4d8e tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b220e0191c440d89e9d19c473c6fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca8ce3e68eaf4ee7b0e476ca0ab812b1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:47.164889 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664fade7-33e5-49aa-b1d0-31fbf6cc4d8e tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:47.172365 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664fade7-33e5-49aa-b1d0-31fbf6cc4d8e tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:47.172365 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664fade7-33e5-49aa-b1d0-31fbf6cc4d8e tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] PATH_INFO: `/v3/groups` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:47.172365 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664fade7-33e5-49aa-b1d0-31fbf6cc4d8e tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] RBAC: Authorizing `identity:list_groups()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:47.172804 ncdv-master-1 devstack@keystone.service[91547]: WARNING py.warnings [None req-664fade7-33e5-49aa-b1d0-31fbf6cc4d8e tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_groups": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:27:47.172804 ncdv-master-1 devstack@keystone.service[91547]: warnings.warn(msg) Jul 23 21:27:47.172804 ncdv-master-1 devstack@keystone.service[91547]: Jul 23 21:27:47.190212 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664fade7-33e5-49aa-b1d0-31fbf6cc4d8e tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:47.207606 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2083/4151] 10.222.0.17 () {58 vars in 1124 bytes} [Sat Jul 23 21:27:47 2022] GET /identity/v3/groups => generated 1490 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:27:47.211601 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad35459-b002-4772-aae4-52591197901e tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:47.226895 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad35459-b002-4772-aae4-52591197901e tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:47.243691 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1401b44-61b1-4d9a-b3cf-2a56219d5b23 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b220e0191c440d89e9d19c473c6fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca8ce3e68eaf4ee7b0e476ca0ab812b1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:47.244591 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1401b44-61b1-4d9a-b3cf-2a56219d5b23 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:47.245099 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1401b44-61b1-4d9a-b3cf-2a56219d5b23 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:47.245218 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1401b44-61b1-4d9a-b3cf-2a56219d5b23 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] PATH_INFO: `/v3/groups/169e23cc366a481083d74afc88ae63d1` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:47.258431 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1401b44-61b1-4d9a-b3cf-2a56219d5b23 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] RBAC: Authorizing `identity:delete_group(group_id=169e23cc366a481083d74afc88ae63d1)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:47.260343 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1401b44-61b1-4d9a-b3cf-2a56219d5b23 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:47.288161 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:27:47.366076 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2069/4152] 10.222.0.17 () {58 vars in 1226 bytes} [Sat Jul 23 21:27:47 2022] DELETE /identity/v3/groups/169e23cc366a481083d74afc88ae63d1 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:27:47.370331 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664fade7-33e5-49aa-b1d0-31fbf6cc4d8e tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:47.382655 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664fade7-33e5-49aa-b1d0-31fbf6cc4d8e tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:47.518581 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3539c7c7-f27f-4b83-a798-f49af881ee86 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b220e0191c440d89e9d19c473c6fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca8ce3e68eaf4ee7b0e476ca0ab812b1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:47.519725 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3539c7c7-f27f-4b83-a798-f49af881ee86 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:47.520256 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3539c7c7-f27f-4b83-a798-f49af881ee86 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:47.520633 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3539c7c7-f27f-4b83-a798-f49af881ee86 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] PATH_INFO: `/v3/groups/813199e8daba4f8f80b5a653a367d14a` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:47.541019 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3539c7c7-f27f-4b83-a798-f49af881ee86 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] RBAC: Authorizing `identity:delete_group(group_id=813199e8daba4f8f80b5a653a367d14a)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:47.544959 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3539c7c7-f27f-4b83-a798-f49af881ee86 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:47.655697 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2084/4153] 10.222.0.17 () {58 vars in 1226 bytes} [Sat Jul 23 21:27:47 2022] DELETE /identity/v3/groups/813199e8daba4f8f80b5a653a367d14a => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:27:47.659680 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1401b44-61b1-4d9a-b3cf-2a56219d5b23 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:47.671861 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1401b44-61b1-4d9a-b3cf-2a56219d5b23 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:47.800946 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f744f7d6-dfc2-4c65-a470-ef3733f8c858 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b220e0191c440d89e9d19c473c6fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca8ce3e68eaf4ee7b0e476ca0ab812b1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:47.803890 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f744f7d6-dfc2-4c65-a470-ef3733f8c858 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:47.804143 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f744f7d6-dfc2-4c65-a470-ef3733f8c858 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:47.804568 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f744f7d6-dfc2-4c65-a470-ef3733f8c858 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] PATH_INFO: `/v3/groups/71980ed510654ac3a1c76efb66599d8a` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:47.824952 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f744f7d6-dfc2-4c65-a470-ef3733f8c858 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] RBAC: Authorizing `identity:delete_group(group_id=71980ed510654ac3a1c76efb66599d8a)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:47.827436 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f744f7d6-dfc2-4c65-a470-ef3733f8c858 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:47.888543 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2070/4154] 10.222.0.17 () {58 vars in 1226 bytes} [Sat Jul 23 21:27:47 2022] DELETE /identity/v3/groups/71980ed510654ac3a1c76efb66599d8a => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:27:47.896251 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3539c7c7-f27f-4b83-a798-f49af881ee86 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:47.916975 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3539c7c7-f27f-4b83-a798-f49af881ee86 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:47.944805 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=91,keystone:UPDATE=1,keystone:INSERT=2,keystone:DELETE=6 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:27:48.017562 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ece3ce-8be3-4dd2-b135-9ab1fefdbbda tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b220e0191c440d89e9d19c473c6fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca8ce3e68eaf4ee7b0e476ca0ab812b1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:48.020444 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ece3ce-8be3-4dd2-b135-9ab1fefdbbda tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:48.022160 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ece3ce-8be3-4dd2-b135-9ab1fefdbbda tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:48.022160 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ece3ce-8be3-4dd2-b135-9ab1fefdbbda tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:48.022160 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ece3ce-8be3-4dd2-b135-9ab1fefdbbda tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:48.024542 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ece3ce-8be3-4dd2-b135-9ab1fefdbbda tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:48.073459 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2085/4155] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:27:47 2022] POST /identity/v3/users => generated 321 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:27:48.074827 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f744f7d6-dfc2-4c65-a470-ef3733f8c858 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:48.091910 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732be21f-ace0-40e5-b51f-35d790efbd43 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:48.092212 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732be21f-ace0-40e5-b51f-35d790efbd43 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:48.092357 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f744f7d6-dfc2-4c65-a470-ef3733f8c858 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:48.092473 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732be21f-ace0-40e5-b51f-35d790efbd43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:48.102446 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f0395a-1a51-4d84-9f05-d6a6210afb83 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b220e0191c440d89e9d19c473c6fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca8ce3e68eaf4ee7b0e476ca0ab812b1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:48.105119 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f0395a-1a51-4d84-9f05-d6a6210afb83 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:48.105490 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f0395a-1a51-4d84-9f05-d6a6210afb83 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:48.105839 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f0395a-1a51-4d84-9f05-d6a6210afb83 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] PATH_INFO: `/v3/groups` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:48.107191 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f0395a-1a51-4d84-9f05-d6a6210afb83 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:48.109290 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f0395a-1a51-4d84-9f05-d6a6210afb83 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:48.126021 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-732be21f-ace0-40e5-b51f-35d790efbd43 None None] MFA Rules not processed for user `da80b9f2ac5b4309acbf9814b2e1e095`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:27:48.135270 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-732be21f-ace0-40e5-b51f-35d790efbd43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:48.146953 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2071/4156] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:27:48 2022] POST /identity/v3/groups => generated 326 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:27:48.148728 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f0395a-1a51-4d84-9f05-d6a6210afb83 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:48.150170 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2086/4157] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:27:48 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 23 21:27:48.154797 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739a17d8-55e0-475e-afb9-04b8ba6bc148 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:48.155079 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739a17d8-55e0-475e-afb9-04b8ba6bc148 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:48.159469 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739a17d8-55e0-475e-afb9-04b8ba6bc148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:48.165321 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f0395a-1a51-4d84-9f05-d6a6210afb83 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:48.174435 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27eef67f-e68b-4f94-9e4c-b7608fc96d36 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b220e0191c440d89e9d19c473c6fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca8ce3e68eaf4ee7b0e476ca0ab812b1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:48.175587 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eef67f-e68b-4f94-9e4c-b7608fc96d36 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:48.175999 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eef67f-e68b-4f94-9e4c-b7608fc96d36 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:48.176334 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eef67f-e68b-4f94-9e4c-b7608fc96d36 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] PATH_INFO: `/v3/groups/fc22867dbe8e4ddda1e955986f383c8b/users/9b2ef5603071499b8ce924ed1e490bc6` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:48.199015 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-739a17d8-55e0-475e-afb9-04b8ba6bc148 None None] MFA Rules not processed for user `da80b9f2ac5b4309acbf9814b2e1e095`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:27:48.200404 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-739a17d8-55e0-475e-afb9-04b8ba6bc148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:48.216336 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27eef67f-e68b-4f94-9e4c-b7608fc96d36 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=fc22867dbe8e4ddda1e955986f383c8b, user_id=9b2ef5603071499b8ce924ed1e490bc6)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:48.219448 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27eef67f-e68b-4f94-9e4c-b7608fc96d36 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:48.259053 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2072/4158] 10.222.0.17 () {60 vars in 1359 bytes} [Sat Jul 23 21:27:48 2022] PUT /identity/v3/groups/fc22867dbe8e4ddda1e955986f383c8b/users/9b2ef5603071499b8ce924ed1e490bc6 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:27:48.263784 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27eef67f-e68b-4f94-9e4c-b7608fc96d36 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:48.359640 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2087/4159] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:27:48 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:27:48.364638 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739a17d8-55e0-475e-afb9-04b8ba6bc148 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:48.397775 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=90,keystone:DELETE=8,keystone:INSERT=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:27:48.402460 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739a17d8-55e0-475e-afb9-04b8ba6bc148 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:48.459062 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27eef67f-e68b-4f94-9e4c-b7608fc96d36 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:48.473287 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176fa7ed-cd0f-43f1-87a2-110ef2e0338f tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b220e0191c440d89e9d19c473c6fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca8ce3e68eaf4ee7b0e476ca0ab812b1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:48.474103 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176fa7ed-cd0f-43f1-87a2-110ef2e0338f tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:48.475983 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176fa7ed-cd0f-43f1-87a2-110ef2e0338f tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:48.478086 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176fa7ed-cd0f-43f1-87a2-110ef2e0338f tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] PATH_INFO: `/v3/groups` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:48.478930 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176fa7ed-cd0f-43f1-87a2-110ef2e0338f tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:48.482406 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176fa7ed-cd0f-43f1-87a2-110ef2e0338f tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:48.518479 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2073/4160] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:27:48 2022] POST /identity/v3/groups => generated 325 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:27:48.522705 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176fa7ed-cd0f-43f1-87a2-110ef2e0338f tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:48.556660 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176fa7ed-cd0f-43f1-87a2-110ef2e0338f tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:48.565990 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d5aa17-e403-4f4f-88e0-337b06e03d1f tempest-IdentityV3UsersTest-1588861045 tempest-IdentityV3UsersTest-1588861045-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da80b9f2ac5b4309acbf9814b2e1e095', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14af6366e2a44b918b14ed9cf5137a1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:48.566994 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d5aa17-e403-4f4f-88e0-337b06e03d1f tempest-IdentityV3UsersTest-1588861045 tempest-IdentityV3UsersTest-1588861045-project] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:48.567282 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d5aa17-e403-4f4f-88e0-337b06e03d1f tempest-IdentityV3UsersTest-1588861045 tempest-IdentityV3UsersTest-1588861045-project] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:48.567560 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d5aa17-e403-4f4f-88e0-337b06e03d1f tempest-IdentityV3UsersTest-1588861045 tempest-IdentityV3UsersTest-1588861045-project] PATH_INFO: `/v3/users/da80b9f2ac5b4309acbf9814b2e1e095/password` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:48.578627 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330ec899-f35b-48b0-aa08-ea577e559e53 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b220e0191c440d89e9d19c473c6fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca8ce3e68eaf4ee7b0e476ca0ab812b1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:48.579771 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330ec899-f35b-48b0-aa08-ea577e559e53 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:48.580075 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330ec899-f35b-48b0-aa08-ea577e559e53 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:48.580535 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330ec899-f35b-48b0-aa08-ea577e559e53 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] PATH_INFO: `/v3/groups/eaa0fc1239e5493896b643a58bdc399f/users/9b2ef5603071499b8ce924ed1e490bc6` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:48.592594 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330ec899-f35b-48b0-aa08-ea577e559e53 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=eaa0fc1239e5493896b643a58bdc399f, user_id=9b2ef5603071499b8ce924ed1e490bc6)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:48.595562 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330ec899-f35b-48b0-aa08-ea577e559e53 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:48.662509 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-d4d5aa17-e403-4f4f-88e0-337b06e03d1f tempest-IdentityV3UsersTest-1588861045 tempest-IdentityV3UsersTest-1588861045-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'da80b9f2ac5b4309acbf9814b2e1e095'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:48.670263 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2074/4161] 10.222.0.17 () {60 vars in 1359 bytes} [Sat Jul 23 21:27:48 2022] PUT /identity/v3/groups/eaa0fc1239e5493896b643a58bdc399f/users/9b2ef5603071499b8ce924ed1e490bc6 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:27:48.674646 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330ec899-f35b-48b0-aa08-ea577e559e53 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:48.691528 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2088/4162] 10.222.0.17 () {60 vars in 1268 bytes} [Sat Jul 23 21:27:48 2022] POST /identity/v3/users/da80b9f2ac5b4309acbf9814b2e1e095/password => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:27:48.777077 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330ec899-f35b-48b0-aa08-ea577e559e53 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:48.786242 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b75c36-da52-49b3-96f3-04ce05346e9c tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b220e0191c440d89e9d19c473c6fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca8ce3e68eaf4ee7b0e476ca0ab812b1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:48.787252 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b75c36-da52-49b3-96f3-04ce05346e9c tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:48.787524 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b75c36-da52-49b3-96f3-04ce05346e9c tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:48.791370 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b75c36-da52-49b3-96f3-04ce05346e9c tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] PATH_INFO: `/v3/users/9b2ef5603071499b8ce924ed1e490bc6/groups` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:48.792970 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b75c36-da52-49b3-96f3-04ce05346e9c tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] RBAC: Authorizing `identity:list_groups_for_user(user_id=9b2ef5603071499b8ce924ed1e490bc6)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:48.796222 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b75c36-da52-49b3-96f3-04ce05346e9c tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:48.836910 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2075/4163] 10.222.0.17 () {58 vars in 1241 bytes} [Sat Jul 23 21:27:48 2022] GET /identity/v3/users/9b2ef5603071499b8ce924ed1e490bc6/groups => generated 837 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:27:48.841003 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d5aa17-e403-4f4f-88e0-337b06e03d1f tempest-IdentityV3UsersTest-1588861045 tempest-IdentityV3UsersTest-1588861045-project] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:48.854266 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d5aa17-e403-4f4f-88e0-337b06e03d1f tempest-IdentityV3UsersTest-1588861045 tempest-IdentityV3UsersTest-1588861045-project] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:48.860402 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472ef3fc-2c08-4f20-bfdc-fe9f4cef3f09 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b220e0191c440d89e9d19c473c6fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca8ce3e68eaf4ee7b0e476ca0ab812b1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:48.861373 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472ef3fc-2c08-4f20-bfdc-fe9f4cef3f09 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:48.861659 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472ef3fc-2c08-4f20-bfdc-fe9f4cef3f09 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:48.861961 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472ef3fc-2c08-4f20-bfdc-fe9f4cef3f09 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] PATH_INFO: `/v3/groups/eaa0fc1239e5493896b643a58bdc399f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:48.863764 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472ef3fc-2c08-4f20-bfdc-fe9f4cef3f09 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] RBAC: Authorizing `identity:delete_group(group_id=eaa0fc1239e5493896b643a58bdc399f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:48.866417 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472ef3fc-2c08-4f20-bfdc-fe9f4cef3f09 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:48.897633 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:UPDATE=1,keystone:DELETE=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:27:48.937165 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2089/4164] 10.222.0.17 () {58 vars in 1226 bytes} [Sat Jul 23 21:27:48 2022] DELETE /identity/v3/groups/eaa0fc1239e5493896b643a58bdc399f => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:27:48.937407 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b75c36-da52-49b3-96f3-04ce05346e9c tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:48.949386 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b75c36-da52-49b3-96f3-04ce05346e9c tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:49.156891 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907f9c58-0aa6-4b1a-b520-3a16f7854ed8 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b220e0191c440d89e9d19c473c6fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca8ce3e68eaf4ee7b0e476ca0ab812b1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:49.157955 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907f9c58-0aa6-4b1a-b520-3a16f7854ed8 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:49.158089 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907f9c58-0aa6-4b1a-b520-3a16f7854ed8 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:49.158457 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907f9c58-0aa6-4b1a-b520-3a16f7854ed8 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] PATH_INFO: `/v3/groups/fc22867dbe8e4ddda1e955986f383c8b` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:49.160668 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907f9c58-0aa6-4b1a-b520-3a16f7854ed8 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] RBAC: Authorizing `identity:delete_group(group_id=fc22867dbe8e4ddda1e955986f383c8b)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:49.163411 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907f9c58-0aa6-4b1a-b520-3a16f7854ed8 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:49.229738 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:27:49.234024 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472ef3fc-2c08-4f20-bfdc-fe9f4cef3f09 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:49.234258 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2076/4165] 10.222.0.17 () {58 vars in 1226 bytes} [Sat Jul 23 21:27:48 2022] DELETE /identity/v3/groups/fc22867dbe8e4ddda1e955986f383c8b => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:27:49.250538 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472ef3fc-2c08-4f20-bfdc-fe9f4cef3f09 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:49.396949 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98694a17-dabc-43f7-9dde-fb036abf2163 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b220e0191c440d89e9d19c473c6fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca8ce3e68eaf4ee7b0e476ca0ab812b1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:49.397889 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98694a17-dabc-43f7-9dde-fb036abf2163 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:49.399438 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98694a17-dabc-43f7-9dde-fb036abf2163 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:49.399722 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98694a17-dabc-43f7-9dde-fb036abf2163 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] PATH_INFO: `/v3/users/9b2ef5603071499b8ce924ed1e490bc6` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:49.400982 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98694a17-dabc-43f7-9dde-fb036abf2163 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] RBAC: Authorizing `identity:delete_user(user_id=9b2ef5603071499b8ce924ed1e490bc6)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:49.403112 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98694a17-dabc-43f7-9dde-fb036abf2163 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:49.473199 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-98694a17-dabc-43f7-9dde-fb036abf2163 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b2ef5603071499b8ce924ed1e490bc6'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:49.483768 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-98694a17-dabc-43f7-9dde-fb036abf2163 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b2ef5603071499b8ce924ed1e490bc6'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:49.491395 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-98694a17-dabc-43f7-9dde-fb036abf2163 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b2ef5603071499b8ce924ed1e490bc6'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:49.509335 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-98694a17-dabc-43f7-9dde-fb036abf2163 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b2ef5603071499b8ce924ed1e490bc6'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:49.561304 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-98694a17-dabc-43f7-9dde-fb036abf2163 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b2ef5603071499b8ce924ed1e490bc6'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:49.580773 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2090/4166] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:27:49 2022] DELETE /identity/v3/users/9b2ef5603071499b8ce924ed1e490bc6 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:27:49.586042 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907f9c58-0aa6-4b1a-b520-3a16f7854ed8 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:49.595656 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-907f9c58-0aa6-4b1a-b520-3a16f7854ed8 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:49.611521 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907f9c58-0aa6-4b1a-b520-3a16f7854ed8 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:49.697684 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3682da1-a82d-45b5-8770-a020548f3719 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:49.698028 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3682da1-a82d-45b5-8770-a020548f3719 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:49.698471 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3682da1-a82d-45b5-8770-a020548f3719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:49.735244 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-c3682da1-a82d-45b5-8770-a020548f3719 None None] MFA Rules not processed for user `da80b9f2ac5b4309acbf9814b2e1e095`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:27:49.737540 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-c3682da1-a82d-45b5-8770-a020548f3719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:49.748737 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2091/4167] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:27:49 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 23 21:27:49.753613 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa75d6df-35cf-4af9-9638-6c8495ba39f2 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:49.754556 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa75d6df-35cf-4af9-9638-6c8495ba39f2 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:49.756826 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36e44cc-6718-4759-b330-3f3428e48a44 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b220e0191c440d89e9d19c473c6fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca8ce3e68eaf4ee7b0e476ca0ab812b1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:49.758050 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36e44cc-6718-4759-b330-3f3428e48a44 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:49.758370 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa75d6df-35cf-4af9-9638-6c8495ba39f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:49.760209 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36e44cc-6718-4759-b330-3f3428e48a44 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:49.760706 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36e44cc-6718-4759-b330-3f3428e48a44 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] PATH_INFO: `/v3/domains/74a5d50fdea34474bb0d1a709a038295` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:49.762485 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36e44cc-6718-4759-b330-3f3428e48a44 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=74a5d50fdea34474bb0d1a709a038295)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:49.764338 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36e44cc-6718-4759-b330-3f3428e48a44 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:49.790230 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-e36e44cc-6718-4759-b330-3f3428e48a44 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '74a5d50fdea34474bb0d1a709a038295'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:49.790879 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-aa75d6df-35cf-4af9-9638-6c8495ba39f2 None None] MFA Rules not processed for user `da80b9f2ac5b4309acbf9814b2e1e095`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:27:49.791187 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-e36e44cc-6718-4759-b330-3f3428e48a44 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '74a5d50fdea34474bb0d1a709a038295'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:49.792290 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-aa75d6df-35cf-4af9-9638-6c8495ba39f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:49.844169 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-e36e44cc-6718-4759-b330-3f3428e48a44 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '74a5d50fdea34474bb0d1a709a038295'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:49.845138 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-e36e44cc-6718-4759-b330-3f3428e48a44 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '74a5d50fdea34474bb0d1a709a038295'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:49.857347 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2077/4168] 10.222.0.17 () {60 vars in 1248 bytes} [Sat Jul 23 21:27:49 2022] PATCH /identity/v3/domains/74a5d50fdea34474bb0d1a709a038295 => generated 276 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:27:49.858338 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36e44cc-6718-4759-b330-3f3428e48a44 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:49.861384 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-e36e44cc-6718-4759-b330-3f3428e48a44 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:49.931591 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:27:49.959718 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2092/4169] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:27:49 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:27:49.980205 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa75d6df-35cf-4af9-9638-6c8495ba39f2 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:50.002110 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa75d6df-35cf-4af9-9638-6c8495ba39f2 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:50.023354 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba57811c-87aa-4e20-beca-3905bc141fd4 tempest-IdentityV3UsersTest-1588861045 tempest-IdentityV3UsersTest-1588861045-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da80b9f2ac5b4309acbf9814b2e1e095', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14af6366e2a44b918b14ed9cf5137a1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:50.025120 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba57811c-87aa-4e20-beca-3905bc141fd4 tempest-IdentityV3UsersTest-1588861045 tempest-IdentityV3UsersTest-1588861045-project] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:50.025400 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba57811c-87aa-4e20-beca-3905bc141fd4 tempest-IdentityV3UsersTest-1588861045 tempest-IdentityV3UsersTest-1588861045-project] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:50.025678 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba57811c-87aa-4e20-beca-3905bc141fd4 tempest-IdentityV3UsersTest-1588861045 tempest-IdentityV3UsersTest-1588861045-project] PATH_INFO: `/v3/users/da80b9f2ac5b4309acbf9814b2e1e095/password` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:50.053152 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36e44cc-6718-4759-b330-3f3428e48a44 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:50.061165 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87819112-5038-456c-b45b-a854048443a0 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b220e0191c440d89e9d19c473c6fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca8ce3e68eaf4ee7b0e476ca0ab812b1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:50.062103 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87819112-5038-456c-b45b-a854048443a0 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:50.062979 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87819112-5038-456c-b45b-a854048443a0 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:50.063349 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87819112-5038-456c-b45b-a854048443a0 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] PATH_INFO: `/v3/domains/74a5d50fdea34474bb0d1a709a038295` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:50.089356 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87819112-5038-456c-b45b-a854048443a0 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=74a5d50fdea34474bb0d1a709a038295)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:50.091033 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87819112-5038-456c-b45b-a854048443a0 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:50.111583 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-ba57811c-87aa-4e20-beca-3905bc141fd4 tempest-IdentityV3UsersTest-1588861045 tempest-IdentityV3UsersTest-1588861045-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'da80b9f2ac5b4309acbf9814b2e1e095'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:50.127719 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-87819112-5038-456c-b45b-a854048443a0 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '74a5d50fdea34474bb0d1a709a038295'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:50.131090 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2093/4170] 10.222.0.17 () {60 vars in 1268 bytes} [Sat Jul 23 21:27:49 2022] POST /identity/v3/users/da80b9f2ac5b4309acbf9814b2e1e095/password => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:27:50.142413 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-87819112-5038-456c-b45b-a854048443a0 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '74a5d50fdea34474bb0d1a709a038295'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:50.179642 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=98,keystone:UPDATE=1,keystone:DELETE=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:27:50.195818 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-87819112-5038-456c-b45b-a854048443a0 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74a5d50fdea34474bb0d1a709a038295', 'request_id': 'req-87819112-5038-456c-b45b-a854048443a0'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:50.205383 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-87819112-5038-456c-b45b-a854048443a0 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74a5d50fdea34474bb0d1a709a038295', 'request_id': 'req-87819112-5038-456c-b45b-a854048443a0'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:50.212695 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-87819112-5038-456c-b45b-a854048443a0 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74a5d50fdea34474bb0d1a709a038295', 'request_id': 'req-87819112-5038-456c-b45b-a854048443a0'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:50.227361 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-87819112-5038-456c-b45b-a854048443a0 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] The token cache is being invalidate because project 74a5d50fdea34474bb0d1a709a038295 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:27:50.227649 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-87819112-5038-456c-b45b-a854048443a0 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:50.228400 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-87819112-5038-456c-b45b-a854048443a0 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:50.248855 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-87819112-5038-456c-b45b-a854048443a0 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '74a5d50fdea34474bb0d1a709a038295', 'request_id': 'req-87819112-5038-456c-b45b-a854048443a0'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:50.252709 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-87819112-5038-456c-b45b-a854048443a0 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '74a5d50fdea34474bb0d1a709a038295', 'request_id': 'req-87819112-5038-456c-b45b-a854048443a0'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:50.253961 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-87819112-5038-456c-b45b-a854048443a0 tempest-GroupsV3TestJSON-2133530331 tempest-GroupsV3TestJSON-2133530331-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '74a5d50fdea34474bb0d1a709a038295', 'request_id': 'req-87819112-5038-456c-b45b-a854048443a0'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:50.262197 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2078/4171] 10.222.0.17 () {58 vars in 1229 bytes} [Sat Jul 23 21:27:49 2022] DELETE /identity/v3/domains/74a5d50fdea34474bb0d1a709a038295 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:27:50.263462 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba57811c-87aa-4e20-beca-3905bc141fd4 tempest-IdentityV3UsersTest-1588861045 tempest-IdentityV3UsersTest-1588861045-project] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:50.265723 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-ba57811c-87aa-4e20-beca-3905bc141fd4 tempest-IdentityV3UsersTest-1588861045 tempest-IdentityV3UsersTest-1588861045-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:50.368788 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba57811c-87aa-4e20-beca-3905bc141fd4 tempest-IdentityV3UsersTest-1588861045 tempest-IdentityV3UsersTest-1588861045-project] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:50.483122 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323a111c-d3b6-4055-bc17-168fe35e7723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:50.484029 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323a111c-d3b6-4055-bc17-168fe35e7723 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:50.484305 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323a111c-d3b6-4055-bc17-168fe35e7723 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:50.484580 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323a111c-d3b6-4055-bc17-168fe35e7723 admin admin] PATH_INFO: `/v3/users/18de76aa542c4b1d8769de4193327ed1` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:50.486027 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323a111c-d3b6-4055-bc17-168fe35e7723 admin admin] RBAC: Authorizing `identity:delete_user(user_id=18de76aa542c4b1d8769de4193327ed1)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:50.491902 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323a111c-d3b6-4055-bc17-168fe35e7723 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:50.562655 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-323a111c-d3b6-4055-bc17-168fe35e7723 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18de76aa542c4b1d8769de4193327ed1'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:50.571690 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-323a111c-d3b6-4055-bc17-168fe35e7723 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18de76aa542c4b1d8769de4193327ed1'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:50.572745 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-323a111c-d3b6-4055-bc17-168fe35e7723 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18de76aa542c4b1d8769de4193327ed1'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:50.584209 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-323a111c-d3b6-4055-bc17-168fe35e7723 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18de76aa542c4b1d8769de4193327ed1'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:50.596374 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=86,keystone:UPDATE=1,keystone:INSERT=3,keystone:DELETE=10 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:27:50.607257 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-323a111c-d3b6-4055-bc17-168fe35e7723 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18de76aa542c4b1d8769de4193327ed1'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:50.616493 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2094/4172] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:27:50 2022] DELETE /identity/v3/users/18de76aa542c4b1d8769de4193327ed1 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:27:50.621292 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ce8103-3d80-453c-9711-eb76c2f0703f None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:50.621817 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ce8103-3d80-453c-9711-eb76c2f0703f None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:50.621817 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ce8103-3d80-453c-9711-eb76c2f0703f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:50.644439 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-31ce8103-3d80-453c-9711-eb76c2f0703f None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:27:50.645694 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-31ce8103-3d80-453c-9711-eb76c2f0703f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:50.731102 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2079/4173] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:27:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:27:50.741276 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323a111c-d3b6-4055-bc17-168fe35e7723 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:50.743359 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-323a111c-d3b6-4055-bc17-168fe35e7723 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:50.807151 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323a111c-d3b6-4055-bc17-168fe35e7723 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:50.816744 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dea0e4c-d119-4c47-8d44-1f2c80f75512 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:50.817880 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dea0e4c-d119-4c47-8d44-1f2c80f75512 service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:50.818242 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dea0e4c-d119-4c47-8d44-1f2c80f75512 service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:50.818581 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dea0e4c-d119-4c47-8d44-1f2c80f75512 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:50.834474 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dea0e4c-d119-4c47-8d44-1f2c80f75512 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:50.836088 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dea0e4c-d119-4c47-8d44-1f2c80f75512 service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:50.847341 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2095/4174] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:27:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:27:51.137165 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78191ea5-af6a-40cd-a6ff-f5345a9151d0 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:51.137445 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78191ea5-af6a-40cd-a6ff-f5345a9151d0 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:51.137711 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78191ea5-af6a-40cd-a6ff-f5345a9151d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:51.170051 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-78191ea5-af6a-40cd-a6ff-f5345a9151d0 None None] MFA Rules not processed for user `da80b9f2ac5b4309acbf9814b2e1e095`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:27:51.171359 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-78191ea5-af6a-40cd-a6ff-f5345a9151d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:51.175501 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2080/4175] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:27:51 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 23 21:27:51.328861 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dea0e4c-d119-4c47-8d44-1f2c80f75512 service neutron] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:51.330188 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-4dea0e4c-d119-4c47-8d44-1f2c80f75512 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:51.355296 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dea0e4c-d119-4c47-8d44-1f2c80f75512 service neutron] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:51.371186 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525f91ca-656c-4ed4-b34a-11a5c91fddd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:51.371600 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525f91ca-656c-4ed4-b34a-11a5c91fddd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:51.371846 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525f91ca-656c-4ed4-b34a-11a5c91fddd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:51.372117 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525f91ca-656c-4ed4-b34a-11a5c91fddd2 admin admin] PATH_INFO: `/v3/projects/e714d2516ea94817adf528c0e40579f0` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:51.374888 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525f91ca-656c-4ed4-b34a-11a5c91fddd2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e714d2516ea94817adf528c0e40579f0)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:51.376808 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525f91ca-656c-4ed4-b34a-11a5c91fddd2 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:51.445905 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-525f91ca-656c-4ed4-b34a-11a5c91fddd2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e714d2516ea94817adf528c0e40579f0', 'request_id': 'req-525f91ca-656c-4ed4-b34a-11a5c91fddd2'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:51.454475 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-525f91ca-656c-4ed4-b34a-11a5c91fddd2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e714d2516ea94817adf528c0e40579f0', 'request_id': 'req-525f91ca-656c-4ed4-b34a-11a5c91fddd2'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:51.461083 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-525f91ca-656c-4ed4-b34a-11a5c91fddd2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e714d2516ea94817adf528c0e40579f0', 'request_id': 'req-525f91ca-656c-4ed4-b34a-11a5c91fddd2'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:51.473221 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-525f91ca-656c-4ed4-b34a-11a5c91fddd2 admin admin] The token cache is being invalidate because project e714d2516ea94817adf528c0e40579f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:27:51.473482 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-525f91ca-656c-4ed4-b34a-11a5c91fddd2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:51.474744 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-525f91ca-656c-4ed4-b34a-11a5c91fddd2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:51.480168 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2096/4176] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:27:51 2022] DELETE /identity/v3/projects/e714d2516ea94817adf528c0e40579f0 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:27:51.482390 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78191ea5-af6a-40cd-a6ff-f5345a9151d0 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:51.574889 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78191ea5-af6a-40cd-a6ff-f5345a9151d0 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:51.583104 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc2dac4-a449-4707-9824-c1b0454db6a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:51.584586 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc2dac4-a449-4707-9824-c1b0454db6a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:51.585900 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc2dac4-a449-4707-9824-c1b0454db6a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:51.586398 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc2dac4-a449-4707-9824-c1b0454db6a8 admin admin] PATH_INFO: `/v3/users/40b220e0191c440d89e9d19c473c6fc8` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:51.588396 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc2dac4-a449-4707-9824-c1b0454db6a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=40b220e0191c440d89e9d19c473c6fc8)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:51.595890 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc2dac4-a449-4707-9824-c1b0454db6a8 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:51.699179 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:27:51.744908 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-4fc2dac4-a449-4707-9824-c1b0454db6a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40b220e0191c440d89e9d19c473c6fc8'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:51.745931 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-4fc2dac4-a449-4707-9824-c1b0454db6a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40b220e0191c440d89e9d19c473c6fc8'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:51.754464 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-4fc2dac4-a449-4707-9824-c1b0454db6a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40b220e0191c440d89e9d19c473c6fc8'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:51.769066 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-4fc2dac4-a449-4707-9824-c1b0454db6a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40b220e0191c440d89e9d19c473c6fc8'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:51.801947 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-4fc2dac4-a449-4707-9824-c1b0454db6a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40b220e0191c440d89e9d19c473c6fc8'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:51.818415 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2081/4177] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:27:51 2022] DELETE /identity/v3/users/40b220e0191c440d89e9d19c473c6fc8 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:27:52.181129 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0493f4-12b9-4196-b988-d16b3a6925dc None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:52.181777 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0493f4-12b9-4196-b988-d16b3a6925dc None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:52.181945 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0493f4-12b9-4196-b988-d16b3a6925dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:52.203771 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-1d0493f4-12b9-4196-b988-d16b3a6925dc None None] MFA Rules not processed for user `da80b9f2ac5b4309acbf9814b2e1e095`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:27:52.205148 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-1d0493f4-12b9-4196-b988-d16b3a6925dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:52.251801 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc2dac4-a449-4707-9824-c1b0454db6a8 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:52.255751 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-4fc2dac4-a449-4707-9824-c1b0454db6a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:52.302387 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2097/4178] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:27:52 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:27:52.304741 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0493f4-12b9-4196-b988-d16b3a6925dc None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:52.307211 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-1d0493f4-12b9-4196-b988-d16b3a6925dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:52.344940 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:27:52.423178 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc2dac4-a449-4707-9824-c1b0454db6a8 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:52.448682 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0493f4-12b9-4196-b988-d16b3a6925dc None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:52.459704 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3f0c26-34f9-4d17-af0f-2bf477297292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:52.460843 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3f0c26-34f9-4d17-af0f-2bf477297292 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:52.461004 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd86d81-a608-4477-b285-45655919c23f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:52.461837 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd86d81-a608-4477-b285-45655919c23f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:52.462134 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd86d81-a608-4477-b285-45655919c23f admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:52.462611 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd86d81-a608-4477-b285-45655919c23f admin admin] PATH_INFO: `/v3/users/da80b9f2ac5b4309acbf9814b2e1e095` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:52.464417 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd86d81-a608-4477-b285-45655919c23f admin admin] RBAC: Authorizing `identity:delete_user(user_id=da80b9f2ac5b4309acbf9814b2e1e095)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:52.464686 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3f0c26-34f9-4d17-af0f-2bf477297292 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:52.465291 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3f0c26-34f9-4d17-af0f-2bf477297292 admin admin] PATH_INFO: `/v3/projects/ca8ce3e68eaf4ee7b0e476ca0ab812b1` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:52.466940 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd86d81-a608-4477-b285-45655919c23f admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:52.467885 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3f0c26-34f9-4d17-af0f-2bf477297292 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca8ce3e68eaf4ee7b0e476ca0ab812b1)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:52.483982 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3f0c26-34f9-4d17-af0f-2bf477297292 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:52.564804 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-2fd86d81-a608-4477-b285-45655919c23f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da80b9f2ac5b4309acbf9814b2e1e095'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:52.576656 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-2fd86d81-a608-4477-b285-45655919c23f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da80b9f2ac5b4309acbf9814b2e1e095'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:52.577749 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-2fd86d81-a608-4477-b285-45655919c23f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da80b9f2ac5b4309acbf9814b2e1e095'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:52.593025 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-5a3f0c26-34f9-4d17-af0f-2bf477297292 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca8ce3e68eaf4ee7b0e476ca0ab812b1', 'request_id': 'req-5a3f0c26-34f9-4d17-af0f-2bf477297292'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:52.594054 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-2fd86d81-a608-4477-b285-45655919c23f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da80b9f2ac5b4309acbf9814b2e1e095'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:52.606739 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-5a3f0c26-34f9-4d17-af0f-2bf477297292 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca8ce3e68eaf4ee7b0e476ca0ab812b1', 'request_id': 'req-5a3f0c26-34f9-4d17-af0f-2bf477297292'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:52.613114 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-5a3f0c26-34f9-4d17-af0f-2bf477297292 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca8ce3e68eaf4ee7b0e476ca0ab812b1', 'request_id': 'req-5a3f0c26-34f9-4d17-af0f-2bf477297292'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:52.617130 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-2fd86d81-a608-4477-b285-45655919c23f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da80b9f2ac5b4309acbf9814b2e1e095'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:52.625638 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2098/4179] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:27:52 2022] DELETE /identity/v3/users/da80b9f2ac5b4309acbf9814b2e1e095 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:27:52.630630 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5994ef2-28e8-44f0-bde9-9c0886879ba2 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:52.635543 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5994ef2-28e8-44f0-bde9-9c0886879ba2 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:52.635728 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-5a3f0c26-34f9-4d17-af0f-2bf477297292 admin admin] The token cache is being invalidate because project ca8ce3e68eaf4ee7b0e476ca0ab812b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:27:52.635823 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5994ef2-28e8-44f0-bde9-9c0886879ba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:52.635943 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-5a3f0c26-34f9-4d17-af0f-2bf477297292 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:52.646359 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-5a3f0c26-34f9-4d17-af0f-2bf477297292 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:52.651700 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2082/4180] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:27:52 2022] DELETE /identity/v3/projects/ca8ce3e68eaf4ee7b0e476ca0ab812b1 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:27:52.653104 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80f51af-7ddd-4fc2-8bd1-4c7630ee057c None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:52.653389 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80f51af-7ddd-4fc2-8bd1-4c7630ee057c None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:52.653660 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80f51af-7ddd-4fc2-8bd1-4c7630ee057c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:52.680040 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-d5994ef2-28e8-44f0-bde9-9c0886879ba2 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:27:52.683002 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-d5994ef2-28e8-44f0-bde9-9c0886879ba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:52.691073 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-c80f51af-7ddd-4fc2-8bd1-4c7630ee057c None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:27:52.701308 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-c80f51af-7ddd-4fc2-8bd1-4c7630ee057c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:52.760707 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:27:52.803091 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2099/4181] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:27:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:27:52.820462 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2083/4182] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:27:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:27:52.828671 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc369b1-7aaf-4c5c-9538-18cc555f7cb0 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:52.828671 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc369b1-7aaf-4c5c-9538-18cc555f7cb0 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:52.828922 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc369b1-7aaf-4c5c-9538-18cc555f7cb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:52.845765 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80f51af-7ddd-4fc2-8bd1-4c7630ee057c None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:52.847521 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-c80f51af-7ddd-4fc2-8bd1-4c7630ee057c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:52.876076 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-9fc369b1-7aaf-4c5c-9538-18cc555f7cb0 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:27:52.879683 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-9fc369b1-7aaf-4c5c-9538-18cc555f7cb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:52.902161 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2100/4183] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:27:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:27:52.909431 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc369b1-7aaf-4c5c-9538-18cc555f7cb0 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:52.926469 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc369b1-7aaf-4c5c-9538-18cc555f7cb0 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:52.932434 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fa6893-543f-421b-96ad-4304ea4c5c5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:52.932838 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fa6893-543f-421b-96ad-4304ea4c5c5a admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:52.933213 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fa6893-543f-421b-96ad-4304ea4c5c5a admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:52.933578 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fa6893-543f-421b-96ad-4304ea4c5c5a admin admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:52.935924 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fa6893-543f-421b-96ad-4304ea4c5c5a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:27:52.935924 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fa6893-543f-421b-96ad-4304ea4c5c5a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:52.937225 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fa6893-543f-421b-96ad-4304ea4c5c5a admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:52.958766 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2101/4184] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:27:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 21:27:52.974463 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fa6893-543f-421b-96ad-4304ea4c5c5a admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:52.977012 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80f51af-7ddd-4fc2-8bd1-4c7630ee057c None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:52.989813 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2ba00d-e051-411c-b12f-f79d8831889f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:52.989813 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2ba00d-e051-411c-b12f-f79d8831889f service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:52.991005 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2ba00d-e051-411c-b12f-f79d8831889f service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:52.991115 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2ba00d-e051-411c-b12f-f79d8831889f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:53.008054 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fa6893-543f-421b-96ad-4304ea4c5c5a admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:53.009911 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2ba00d-e051-411c-b12f-f79d8831889f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:53.011383 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2ba00d-e051-411c-b12f-f79d8831889f service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:53.016750 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41442efd-ba5d-4fdf-a12a-e4fbbe22bd06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:53.018475 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41442efd-ba5d-4fdf-a12a-e4fbbe22bd06 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:53.018832 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41442efd-ba5d-4fdf-a12a-e4fbbe22bd06 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:53.019200 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41442efd-ba5d-4fdf-a12a-e4fbbe22bd06 admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:53.020251 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41442efd-ba5d-4fdf-a12a-e4fbbe22bd06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:53.022951 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41442efd-ba5d-4fdf-a12a-e4fbbe22bd06 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:53.039618 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2084/4185] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:27:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 23 21:27:53.041400 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:27:53.071763 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2102/4186] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:27:52 2022] POST /identity/v3/projects => generated 371 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:27:53.075916 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2ba00d-e051-411c-b12f-f79d8831889f service neutron] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:53.090233 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2ba00d-e051-411c-b12f-f79d8831889f service neutron] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:53.173607 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f248d4-c6e6-49cf-a0fb-e33c022d56d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:53.174364 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f248d4-c6e6-49cf-a0fb-e33c022d56d6 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:53.174553 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f248d4-c6e6-49cf-a0fb-e33c022d56d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:53.174830 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f248d4-c6e6-49cf-a0fb-e33c022d56d6 admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:53.176210 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f248d4-c6e6-49cf-a0fb-e33c022d56d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:53.178328 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f248d4-c6e6-49cf-a0fb-e33c022d56d6 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:53.210258 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2085/4187] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:27:53 2022] POST /identity/v3/users => generated 286 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:27:53.211587 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41442efd-ba5d-4fdf-a12a-e4fbbe22bd06 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:53.224710 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41442efd-ba5d-4fdf-a12a-e4fbbe22bd06 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:53.234006 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c758c2e9-8c2c-4e45-a313-d1ef42b5bf17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:53.235496 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c758c2e9-8c2c-4e45-a313-d1ef42b5bf17 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:53.236041 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c758c2e9-8c2c-4e45-a313-d1ef42b5bf17 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:53.236549 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c758c2e9-8c2c-4e45-a313-d1ef42b5bf17 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:53.237573 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c758c2e9-8c2c-4e45-a313-d1ef42b5bf17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:53.240140 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c758c2e9-8c2c-4e45-a313-d1ef42b5bf17 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:53.256157 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2103/4188] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:27:53 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:27:53.262223 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f248d4-c6e6-49cf-a0fb-e33c022d56d6 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:53.280417 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f248d4-c6e6-49cf-a0fb-e33c022d56d6 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:53.297608 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e8f42b-5e90-4789-b61b-36b0818e430c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:53.298497 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e8f42b-5e90-4789-b61b-36b0818e430c admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:53.298881 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e8f42b-5e90-4789-b61b-36b0818e430c admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:53.299630 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e8f42b-5e90-4789-b61b-36b0818e430c admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:53.300882 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e8f42b-5e90-4789-b61b-36b0818e430c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:53.305589 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e8f42b-5e90-4789-b61b-36b0818e430c admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:53.339887 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2086/4189] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:27:53 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:27:53.344662 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c758c2e9-8c2c-4e45-a313-d1ef42b5bf17 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:53.357025 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c758c2e9-8c2c-4e45-a313-d1ef42b5bf17 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:53.366946 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff51c0c2-7f68-404e-8206-f3b053d149a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:53.369071 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff51c0c2-7f68-404e-8206-f3b053d149a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:53.369470 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff51c0c2-7f68-404e-8206-f3b053d149a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:53.369828 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff51c0c2-7f68-404e-8206-f3b053d149a2 admin admin] PATH_INFO: `/v3/projects/3c63f96cf06a4fdaa6220d04f02bbd4c/users/89bb90c8db5e4b59b11d46bcaa77ac53/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:53.389804 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff51c0c2-7f68-404e-8206-f3b053d149a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c63f96cf06a4fdaa6220d04f02bbd4c, user_id=89bb90c8db5e4b59b11d46bcaa77ac53, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:53.392821 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff51c0c2-7f68-404e-8206-f3b053d149a2 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:53.420897 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2104/4190] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:27:53 2022] PUT /identity/v3/projects/3c63f96cf06a4fdaa6220d04f02bbd4c/users/89bb90c8db5e4b59b11d46bcaa77ac53/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:27:53.431032 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9a7f78-6c68-4341-a544-188b05dba4cc None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:53.431229 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9a7f78-6c68-4341-a544-188b05dba4cc None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:53.431507 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9a7f78-6c68-4341-a544-188b05dba4cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:53.460627 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-ad9a7f78-6c68-4341-a544-188b05dba4cc None None] MFA Rules not processed for user `89bb90c8db5e4b59b11d46bcaa77ac53`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:27:53.461853 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-ad9a7f78-6c68-4341-a544-188b05dba4cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:53.519679 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:27:53.553599 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2087/4191] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:27:53 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:27:53.557961 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff51c0c2-7f68-404e-8206-f3b053d149a2 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:53.642199 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9a7f78-6c68-4341-a544-188b05dba4cc None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:53.643557 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-ad9a7f78-6c68-4341-a544-188b05dba4cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:53.683976 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff51c0c2-7f68-404e-8206-f3b053d149a2 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:53.690705 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b9b562-79b1-4dc4-b30c-16a16dbdaa89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:53.692227 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b9b562-79b1-4dc4-b30c-16a16dbdaa89 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:53.692590 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b9b562-79b1-4dc4-b30c-16a16dbdaa89 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:53.692927 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b9b562-79b1-4dc4-b30c-16a16dbdaa89 admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:53.694262 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b9b562-79b1-4dc4-b30c-16a16dbdaa89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:53.696838 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b9b562-79b1-4dc4-b30c-16a16dbdaa89 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:53.760609 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2105/4192] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:27:53 2022] POST /identity/v3/projects => generated 371 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:27:53.761027 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9a7f78-6c68-4341-a544-188b05dba4cc None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:53.761837 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b9b562-79b1-4dc4-b30c-16a16dbdaa89 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:53.833582 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7da894b-ccd5-4b32-8902-da75d7296598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:53.834512 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7da894b-ccd5-4b32-8902-da75d7296598 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:53.834960 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7da894b-ccd5-4b32-8902-da75d7296598 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:53.835230 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7da894b-ccd5-4b32-8902-da75d7296598 admin admin] PATH_INFO: `/v3/projects/14af6366e2a44b918b14ed9cf5137a1b` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:53.836452 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7da894b-ccd5-4b32-8902-da75d7296598 admin admin] RBAC: Authorizing `identity:delete_project(project_id=14af6366e2a44b918b14ed9cf5137a1b)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:53.841053 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7da894b-ccd5-4b32-8902-da75d7296598 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:53.886688 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b9b562-79b1-4dc4-b30c-16a16dbdaa89 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:53.903590 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-d7da894b-ccd5-4b32-8902-da75d7296598 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14af6366e2a44b918b14ed9cf5137a1b', 'request_id': 'req-d7da894b-ccd5-4b32-8902-da75d7296598'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:53.915775 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-d7da894b-ccd5-4b32-8902-da75d7296598 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14af6366e2a44b918b14ed9cf5137a1b', 'request_id': 'req-d7da894b-ccd5-4b32-8902-da75d7296598'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:53.933031 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-d7da894b-ccd5-4b32-8902-da75d7296598 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14af6366e2a44b918b14ed9cf5137a1b', 'request_id': 'req-d7da894b-ccd5-4b32-8902-da75d7296598'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:53.952543 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-d7da894b-ccd5-4b32-8902-da75d7296598 admin admin] The token cache is being invalidate because project 14af6366e2a44b918b14ed9cf5137a1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:27:53.953209 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-d7da894b-ccd5-4b32-8902-da75d7296598 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:53.954918 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-d7da894b-ccd5-4b32-8902-da75d7296598 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:53.957279 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2088/4193] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:27:53 2022] DELETE /identity/v3/projects/14af6366e2a44b918b14ed9cf5137a1b => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:27:53.965420 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6007d4-8d37-4bf9-8690-0a941419aca3 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:53.966064 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6007d4-8d37-4bf9-8690-0a941419aca3 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:53.966660 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6007d4-8d37-4bf9-8690-0a941419aca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:53.984786 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:27:54.006830 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7258fd2-eed9-4bf2-a20b-4fa80e79c803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:54.007530 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7258fd2-eed9-4bf2-a20b-4fa80e79c803 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:54.007809 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7258fd2-eed9-4bf2-a20b-4fa80e79c803 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:54.008443 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7258fd2-eed9-4bf2-a20b-4fa80e79c803 admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:54.008859 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7258fd2-eed9-4bf2-a20b-4fa80e79c803 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:54.013374 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7258fd2-eed9-4bf2-a20b-4fa80e79c803 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:54.019369 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-ef6007d4-8d37-4bf9-8690-0a941419aca3 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:27:54.020773 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-ef6007d4-8d37-4bf9-8690-0a941419aca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:54.050094 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2106/4194] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:27:53 2022] POST /identity/v3/users => generated 292 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:27:54.050270 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2089/4195] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:27:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:27:54.051469 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7258fd2-eed9-4bf2-a20b-4fa80e79c803 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:54.055369 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-f7258fd2-eed9-4bf2-a20b-4fa80e79c803 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:54.059225 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fecbbb-9b4a-449d-839c-4eefc6066e5b None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:54.059508 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fecbbb-9b4a-449d-839c-4eefc6066e5b None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:54.059781 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fecbbb-9b4a-449d-839c-4eefc6066e5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:54.089806 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7258fd2-eed9-4bf2-a20b-4fa80e79c803 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:54.109578 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2293944-182c-409c-89a7-68bfcecba5e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:54.109578 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2293944-182c-409c-89a7-68bfcecba5e4 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:54.109578 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2293944-182c-409c-89a7-68bfcecba5e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:54.109578 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2293944-182c-409c-89a7-68bfcecba5e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:54.110142 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2293944-182c-409c-89a7-68bfcecba5e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:54.110142 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2293944-182c-409c-89a7-68bfcecba5e4 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:54.124402 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-42fecbbb-9b4a-449d-839c-4eefc6066e5b None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:27:54.128281 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-42fecbbb-9b4a-449d-839c-4eefc6066e5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:54.137627 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2107/4196] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:27:54 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 21:27:54.146340 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2293944-182c-409c-89a7-68bfcecba5e4 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:54.154374 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2090/4197] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:27:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:27:54.155355 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fecbbb-9b4a-449d-839c-4eefc6066e5b None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:54.168593 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2293944-182c-409c-89a7-68bfcecba5e4 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:54.179357 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fecbbb-9b4a-449d-839c-4eefc6066e5b None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:54.182441 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c178b28b-a0cd-44bd-a3b4-680581c00377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:54.184737 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c178b28b-a0cd-44bd-a3b4-680581c00377 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:54.185200 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c178b28b-a0cd-44bd-a3b4-680581c00377 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:54.186677 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c178b28b-a0cd-44bd-a3b4-680581c00377 admin admin] PATH_INFO: `/v3/projects/e0caeaf3c9e947b9aefe9b449d31c2ea/users/1994743b2e3c4725aa7e03519b6ab39e/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:54.193319 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ccfc99-b3f0-4486-ae35-58ac2accf453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:54.194053 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ccfc99-b3f0-4486-ae35-58ac2accf453 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:54.194431 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ccfc99-b3f0-4486-ae35-58ac2accf453 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:54.194608 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ccfc99-b3f0-4486-ae35-58ac2accf453 admin admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:54.195433 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ccfc99-b3f0-4486-ae35-58ac2accf453 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:27:54.195646 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ccfc99-b3f0-4486-ae35-58ac2accf453 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:54.202874 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ccfc99-b3f0-4486-ae35-58ac2accf453 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:54.230484 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c178b28b-a0cd-44bd-a3b4-680581c00377 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0caeaf3c9e947b9aefe9b449d31c2ea, user_id=1994743b2e3c4725aa7e03519b6ab39e, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:54.236927 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:27:54.240603 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c178b28b-a0cd-44bd-a3b4-680581c00377 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:54.243613 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2091/4198] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:27:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:27:54.256900 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ccfc99-b3f0-4486-ae35-58ac2accf453 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:54.271722 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ccfc99-b3f0-4486-ae35-58ac2accf453 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:54.272979 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2108/4199] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:27:54 2022] PUT /identity/v3/projects/e0caeaf3c9e947b9aefe9b449d31c2ea/users/1994743b2e3c4725aa7e03519b6ab39e/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:27:54.277700 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c178b28b-a0cd-44bd-a3b4-680581c00377 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:54.366332 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1d7d93-9069-4667-b6f5-9be9c0d03980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:54.367341 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1d7d93-9069-4667-b6f5-9be9c0d03980 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:54.367784 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1d7d93-9069-4667-b6f5-9be9c0d03980 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:54.368225 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1d7d93-9069-4667-b6f5-9be9c0d03980 admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:54.369092 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1d7d93-9069-4667-b6f5-9be9c0d03980 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:54.371194 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1d7d93-9069-4667-b6f5-9be9c0d03980 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:54.414515 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c178b28b-a0cd-44bd-a3b4-680581c00377 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:54.416116 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2092/4200] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:27:54 2022] POST /identity/v3/projects => generated 385 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:27:54.420292 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1d7d93-9069-4667-b6f5-9be9c0d03980 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:54.541675 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1d7d93-9069-4667-b6f5-9be9c0d03980 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:54.544196 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97f83da-5e61-4ec2-8176-541a2d3934a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:54.546029 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97f83da-5e61-4ec2-8176-541a2d3934a2 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:54.546602 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97f83da-5e61-4ec2-8176-541a2d3934a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:54.547223 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97f83da-5e61-4ec2-8176-541a2d3934a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:54.548675 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c010e9-8063-4d74-b487-d59fe691d579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:54.549239 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97f83da-5e61-4ec2-8176-541a2d3934a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:54.549373 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c010e9-8063-4d74-b487-d59fe691d579 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:54.549722 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c010e9-8063-4d74-b487-d59fe691d579 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:54.550110 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c010e9-8063-4d74-b487-d59fe691d579 admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:54.552623 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97f83da-5e61-4ec2-8176-541a2d3934a2 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:54.553775 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c010e9-8063-4d74-b487-d59fe691d579 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:54.555502 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c010e9-8063-4d74-b487-d59fe691d579 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:54.570509 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2109/4201] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:27:54 2022] GET /identity/v3/roles => generated 1420 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:27:54.574781 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97f83da-5e61-4ec2-8176-541a2d3934a2 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:54.586734 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97f83da-5e61-4ec2-8176-541a2d3934a2 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:54.591788 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8172fe8a-af6c-4672-836d-56ea04b6fa79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:54.593022 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8172fe8a-af6c-4672-836d-56ea04b6fa79 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:54.593309 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8172fe8a-af6c-4672-836d-56ea04b6fa79 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:54.593582 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8172fe8a-af6c-4672-836d-56ea04b6fa79 admin admin] PATH_INFO: `/v3/projects/e0caeaf3c9e947b9aefe9b449d31c2ea/users/1994743b2e3c4725aa7e03519b6ab39e/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:54.597430 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2093/4202] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:27:54 2022] POST /identity/v3/users => generated 293 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:27:54.605997 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c010e9-8063-4d74-b487-d59fe691d579 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:54.606169 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8172fe8a-af6c-4672-836d-56ea04b6fa79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0caeaf3c9e947b9aefe9b449d31c2ea, user_id=1994743b2e3c4725aa7e03519b6ab39e, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:54.617712 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8172fe8a-af6c-4672-836d-56ea04b6fa79 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:54.619003 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c010e9-8063-4d74-b487-d59fe691d579 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:54.624800 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f929f03-ce8e-4993-9afb-b58213b689bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:54.625598 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f929f03-ce8e-4993-9afb-b58213b689bd admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:54.626009 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f929f03-ce8e-4993-9afb-b58213b689bd admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:54.626393 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f929f03-ce8e-4993-9afb-b58213b689bd admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:54.627222 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f929f03-ce8e-4993-9afb-b58213b689bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:54.629143 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f929f03-ce8e-4993-9afb-b58213b689bd admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:54.641994 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2094/4203] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:27:54 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:27:54.649959 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f929f03-ce8e-4993-9afb-b58213b689bd admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:54.655416 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2110/4204] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:27:54 2022] PUT /identity/v3/projects/e0caeaf3c9e947b9aefe9b449d31c2ea/users/1994743b2e3c4725aa7e03519b6ab39e/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:27:54.667722 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66c52c8-b15b-46dd-b525-1629d6b843d9 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:54.668011 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66c52c8-b15b-46dd-b525-1629d6b843d9 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:54.668291 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66c52c8-b15b-46dd-b525-1629d6b843d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:54.687561 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f929f03-ce8e-4993-9afb-b58213b689bd admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:54.721690 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-d66c52c8-b15b-46dd-b525-1629d6b843d9 None None] MFA Rules not processed for user `1994743b2e3c4725aa7e03519b6ab39e`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:27:54.724337 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-d66c52c8-b15b-46dd-b525-1629d6b843d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:54.759511 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:27:54.792714 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd067a5-572b-48dd-98f5-a695520bdf57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:54.794158 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd067a5-572b-48dd-98f5-a695520bdf57 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:54.794614 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd067a5-572b-48dd-98f5-a695520bdf57 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:54.795054 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd067a5-572b-48dd-98f5-a695520bdf57 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:54.796248 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd067a5-572b-48dd-98f5-a695520bdf57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:54.798740 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd067a5-572b-48dd-98f5-a695520bdf57 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:54.806202 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:27:54.835010 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2095/4205] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:27:54 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:27:54.836691 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd067a5-572b-48dd-98f5-a695520bdf57 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:54.855211 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd067a5-572b-48dd-98f5-a695520bdf57 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:54.859747 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2111/4206] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:27:54 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:27:54.863677 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0f05df-30a0-4539-a467-22ebee6f7e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:54.864827 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0f05df-30a0-4539-a467-22ebee6f7e10 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:54.865129 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66c52c8-b15b-46dd-b525-1629d6b843d9 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:54.865498 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0f05df-30a0-4539-a467-22ebee6f7e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:54.865971 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0f05df-30a0-4539-a467-22ebee6f7e10 admin admin] PATH_INFO: `/v3/projects/07fa13edc0a74c7e9766e6976fcbbb2c/users/4e9783900bee47efa9dda5e218c7b116/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:54.876560 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66c52c8-b15b-46dd-b525-1629d6b843d9 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:54.885850 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e801e8-5664-472a-bab8-12c725166409 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1994743b2e3c4725aa7e03519b6ab39e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0caeaf3c9e947b9aefe9b449d31c2ea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:54.887032 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e801e8-5664-472a-bab8-12c725166409 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:54.888247 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e801e8-5664-472a-bab8-12c725166409 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:54.888859 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e801e8-5664-472a-bab8-12c725166409 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:54.889619 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e801e8-5664-472a-bab8-12c725166409 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:54.891305 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e801e8-5664-472a-bab8-12c725166409 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:54.895930 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0f05df-30a0-4539-a467-22ebee6f7e10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07fa13edc0a74c7e9766e6976fcbbb2c, user_id=4e9783900bee47efa9dda5e218c7b116, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:54.898695 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0f05df-30a0-4539-a467-22ebee6f7e10 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:54.917651 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2112/4207] 10.222.0.17 () {60 vars in 1148 bytes} [Sat Jul 23 21:27:54 2022] POST /identity/v3/domains => generated 277 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:27:54.921670 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e801e8-5664-472a-bab8-12c725166409 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:54.927618 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2096/4208] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:27:54 2022] PUT /identity/v3/projects/07fa13edc0a74c7e9766e6976fcbbb2c/users/4e9783900bee47efa9dda5e218c7b116/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:27:54.938239 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5ad908-3e3a-48eb-9ee8-2a97292b7a4f None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:54.938809 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5ad908-3e3a-48eb-9ee8-2a97292b7a4f None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:54.939236 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5ad908-3e3a-48eb-9ee8-2a97292b7a4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:54.992869 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-2a5ad908-3e3a-48eb-9ee8-2a97292b7a4f None None] MFA Rules not processed for user `4e9783900bee47efa9dda5e218c7b116`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:27:54.994403 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-2a5ad908-3e3a-48eb-9ee8-2a97292b7a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:55.028889 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e801e8-5664-472a-bab8-12c725166409 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:55.038826 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c0dca7-592c-47dd-9646-35b3eca6c603 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1994743b2e3c4725aa7e03519b6ab39e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0caeaf3c9e947b9aefe9b449d31c2ea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:55.039052 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c0dca7-592c-47dd-9646-35b3eca6c603 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:55.039366 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c0dca7-592c-47dd-9646-35b3eca6c603 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:55.039705 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c0dca7-592c-47dd-9646-35b3eca6c603 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:55.040296 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c0dca7-592c-47dd-9646-35b3eca6c603 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:55.042300 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c0dca7-592c-47dd-9646-35b3eca6c603 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:55.119156 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2097/4209] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:27:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:27:55.120840 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5ad908-3e3a-48eb-9ee8-2a97292b7a4f None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:55.141996 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2113/4210] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:27:54 2022] POST /identity/v3/projects => generated 400 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:27:55.145749 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c0dca7-592c-47dd-9646-35b3eca6c603 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:55.219713 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5ad908-3e3a-48eb-9ee8-2a97292b7a4f None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:55.253456 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c0dca7-592c-47dd-9646-35b3eca6c603 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:55.269403 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74296aa-27d2-4cdf-abea-49c5e004cfc8 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1994743b2e3c4725aa7e03519b6ab39e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0caeaf3c9e947b9aefe9b449d31c2ea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:55.270262 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74296aa-27d2-4cdf-abea-49c5e004cfc8 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:55.270631 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74296aa-27d2-4cdf-abea-49c5e004cfc8 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:55.270912 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74296aa-27d2-4cdf-abea-49c5e004cfc8 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] PATH_INFO: `/v3/groups` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:55.271611 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74296aa-27d2-4cdf-abea-49c5e004cfc8 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:55.273657 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74296aa-27d2-4cdf-abea-49c5e004cfc8 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:55.313488 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2114/4211] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:27:55 2022] POST /identity/v3/groups => generated 301 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:27:55.317370 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74296aa-27d2-4cdf-abea-49c5e004cfc8 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:55.341502 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74296aa-27d2-4cdf-abea-49c5e004cfc8 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:55.351333 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b87729f-c78c-46c4-af0f-07f75aeb7bbf tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1994743b2e3c4725aa7e03519b6ab39e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0caeaf3c9e947b9aefe9b449d31c2ea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:55.352041 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b87729f-c78c-46c4-af0f-07f75aeb7bbf tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:55.352330 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b87729f-c78c-46c4-af0f-07f75aeb7bbf tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:55.352610 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b87729f-c78c-46c4-af0f-07f75aeb7bbf tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:55.353326 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b87729f-c78c-46c4-af0f-07f75aeb7bbf tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:55.355310 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b87729f-c78c-46c4-af0f-07f75aeb7bbf tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:55.361749 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feabe102-c8af-432f-b932-c5383e54d369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:55.361749 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feabe102-c8af-432f-b932-c5383e54d369 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:55.361749 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feabe102-c8af-432f-b932-c5383e54d369 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:55.361749 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feabe102-c8af-432f-b932-c5383e54d369 admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:55.362277 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feabe102-c8af-432f-b932-c5383e54d369 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:55.364610 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feabe102-c8af-432f-b932-c5383e54d369 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:55.380837 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:27:55.392598 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2115/4212] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:27:55 2022] POST /identity/v3/users => generated 445 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:27:55.394164 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b87729f-c78c-46c4-af0f-07f75aeb7bbf tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:55.408780 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b87729f-c78c-46c4-af0f-07f75aeb7bbf tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:55.424119 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:27:55.430039 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f5ad25-5cf6-4223-9660-9d3495d8ef10 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1994743b2e3c4725aa7e03519b6ab39e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0caeaf3c9e947b9aefe9b449d31c2ea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:55.430745 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f5ad25-5cf6-4223-9660-9d3495d8ef10 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:55.431350 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f5ad25-5cf6-4223-9660-9d3495d8ef10 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:55.431638 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f5ad25-5cf6-4223-9660-9d3495d8ef10 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:55.437348 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f5ad25-5cf6-4223-9660-9d3495d8ef10 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:55.439824 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f5ad25-5cf6-4223-9660-9d3495d8ef10 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:55.451637 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2098/4213] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:27:55 2022] POST /identity/v3/projects => generated 385 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:27:55.452565 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feabe102-c8af-432f-b932-c5383e54d369 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:55.471906 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2116/4214] 10.222.0.17 () {60 vars in 1142 bytes} [Sat Jul 23 21:27:55 2022] POST /identity/v3/roles => generated 239 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:27:55.472940 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f5ad25-5cf6-4223-9660-9d3495d8ef10 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:55.484123 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f5ad25-5cf6-4223-9660-9d3495d8ef10 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:55.552336 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7af8553-7cf9-4dc5-bfcc-720a06cad359 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1994743b2e3c4725aa7e03519b6ab39e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0caeaf3c9e947b9aefe9b449d31c2ea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:55.553202 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7af8553-7cf9-4dc5-bfcc-720a06cad359 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:55.553488 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7af8553-7cf9-4dc5-bfcc-720a06cad359 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:55.553765 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7af8553-7cf9-4dc5-bfcc-720a06cad359 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/b361f85d00854f22bb558168b9aabefc/groups/cf24d34665664f94a7566ff7eed31c14/roles/e49e63bd97e54a2cb371fb79aeaa0d41/inherited_to_projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:55.561139 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7af8553-7cf9-4dc5-bfcc-720a06cad359 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] RBAC: Authorizing `identity:create_grant(project_id=b361f85d00854f22bb558168b9aabefc, group_id=cf24d34665664f94a7566ff7eed31c14, role_id=e49e63bd97e54a2cb371fb79aeaa0d41)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:55.563915 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7af8553-7cf9-4dc5-bfcc-720a06cad359 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:55.628734 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2117/4215] 10.222.0.17 () {60 vars in 1584 bytes} [Sat Jul 23 21:27:55 2022] PUT /identity/v3/OS-INHERIT/projects/b361f85d00854f22bb558168b9aabefc/groups/cf24d34665664f94a7566ff7eed31c14/roles/e49e63bd97e54a2cb371fb79aeaa0d41/inherited_to_projects => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:27:55.642151 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7af8553-7cf9-4dc5-bfcc-720a06cad359 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:55.712615 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feabe102-c8af-432f-b932-c5383e54d369 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:55.823604 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7af8553-7cf9-4dc5-bfcc-720a06cad359 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:55.829906 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379a19b0-b837-494b-875f-dd110bfd33ee tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1994743b2e3c4725aa7e03519b6ab39e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0caeaf3c9e947b9aefe9b449d31c2ea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:55.830832 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379a19b0-b837-494b-875f-dd110bfd33ee tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] REQUEST_METHOD: `HEAD` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:55.831116 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379a19b0-b837-494b-875f-dd110bfd33ee tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:55.831410 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379a19b0-b837-494b-875f-dd110bfd33ee tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/b361f85d00854f22bb558168b9aabefc/groups/cf24d34665664f94a7566ff7eed31c14/roles/e49e63bd97e54a2cb371fb79aeaa0d41/inherited_to_projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:55.834071 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379a19b0-b837-494b-875f-dd110bfd33ee tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] RBAC: Authorizing `identity:check_grant(project_id=b361f85d00854f22bb558168b9aabefc, group_id=cf24d34665664f94a7566ff7eed31c14, role_id=e49e63bd97e54a2cb371fb79aeaa0d41)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:55.835559 ncdv-master-1 devstack@keystone.service[91547]: WARNING py.warnings [None req-379a19b0-b837-494b-875f-dd110bfd33ee tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_grant": "(role:reader and system_scope:all) or ((role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:27:55.835559 ncdv-master-1 devstack@keystone.service[91547]: warnings.warn(msg) Jul 23 21:27:55.835559 ncdv-master-1 devstack@keystone.service[91547]: Jul 23 21:27:55.838340 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379a19b0-b837-494b-875f-dd110bfd33ee tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:55.851927 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2118/4216] 10.222.0.17 () {58 vars in 1566 bytes} [Sat Jul 23 21:27:55 2022] HEAD /identity/v3/OS-INHERIT/projects/b361f85d00854f22bb558168b9aabefc/groups/cf24d34665664f94a7566ff7eed31c14/roles/e49e63bd97e54a2cb371fb79aeaa0d41/inherited_to_projects => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:27:55.853162 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379a19b0-b837-494b-875f-dd110bfd33ee tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:55.870350 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379a19b0-b837-494b-875f-dd110bfd33ee tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:55.885570 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bcaadf-2c2a-4f27-bebe-be23378e0a39 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1994743b2e3c4725aa7e03519b6ab39e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0caeaf3c9e947b9aefe9b449d31c2ea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:55.887980 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea640690-f95b-49dd-8450-024112d74258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:55.888677 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea640690-f95b-49dd-8450-024112d74258 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:55.888962 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bcaadf-2c2a-4f27-bebe-be23378e0a39 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:55.889207 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea640690-f95b-49dd-8450-024112d74258 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:55.889207 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea640690-f95b-49dd-8450-024112d74258 admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:55.889388 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bcaadf-2c2a-4f27-bebe-be23378e0a39 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:55.889651 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bcaadf-2c2a-4f27-bebe-be23378e0a39 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/b361f85d00854f22bb558168b9aabefc/groups/cf24d34665664f94a7566ff7eed31c14/roles/e49e63bd97e54a2cb371fb79aeaa0d41/inherited_to_projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:55.889956 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea640690-f95b-49dd-8450-024112d74258 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:55.894429 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea640690-f95b-49dd-8450-024112d74258 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:55.897281 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bcaadf-2c2a-4f27-bebe-be23378e0a39 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=b361f85d00854f22bb558168b9aabefc, group_id=cf24d34665664f94a7566ff7eed31c14, role_id=e49e63bd97e54a2cb371fb79aeaa0d41)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:55.898713 ncdv-master-1 devstack@keystone.service[91547]: WARNING py.warnings [None req-58bcaadf-2c2a-4f27-bebe-be23378e0a39 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:27:55.898713 ncdv-master-1 devstack@keystone.service[91547]: warnings.warn(msg) Jul 23 21:27:55.898713 ncdv-master-1 devstack@keystone.service[91547]: Jul 23 21:27:55.903668 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bcaadf-2c2a-4f27-bebe-be23378e0a39 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:55.920436 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-58bcaadf-2c2a-4f27-bebe-be23378e0a39 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Invalidating the token cache because role e49e63bd97e54a2cb371fb79aeaa0d41 was removed from group cf24d34665664f94a7566ff7eed31c14 on project b361f85d00854f22bb558168b9aabefc. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:27:55.921358 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-58bcaadf-2c2a-4f27-bebe-be23378e0a39 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:55.923119 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-58bcaadf-2c2a-4f27-bebe-be23378e0a39 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:55.947534 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2119/4217] 10.222.0.17 () {58 vars in 1568 bytes} [Sat Jul 23 21:27:55 2022] DELETE /identity/v3/OS-INHERIT/projects/b361f85d00854f22bb558168b9aabefc/groups/cf24d34665664f94a7566ff7eed31c14/roles/e49e63bd97e54a2cb371fb79aeaa0d41/inherited_to_projects => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:27:55.954631 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bcaadf-2c2a-4f27-bebe-be23378e0a39 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:55.958528 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-58bcaadf-2c2a-4f27-bebe-be23378e0a39 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:55.961129 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2099/4218] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:27:55 2022] POST /identity/v3/users => generated 293 bytes in 509 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:27:55.965102 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea640690-f95b-49dd-8450-024112d74258 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:55.968030 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-ea640690-f95b-49dd-8450-024112d74258 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:56.018111 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea640690-f95b-49dd-8450-024112d74258 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:56.066753 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:27:56.075259 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bcaadf-2c2a-4f27-bebe-be23378e0a39 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:56.086804 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5cc767-9d62-45f6-a126-b902f373ebdd tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1994743b2e3c4725aa7e03519b6ab39e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0caeaf3c9e947b9aefe9b449d31c2ea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:56.090645 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5cc767-9d62-45f6-a126-b902f373ebdd tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:56.090928 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5cc767-9d62-45f6-a126-b902f373ebdd tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:56.091205 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5cc767-9d62-45f6-a126-b902f373ebdd tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] PATH_INFO: `/v3/roles/e49e63bd97e54a2cb371fb79aeaa0d41` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:56.093013 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5cc767-9d62-45f6-a126-b902f373ebdd tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] RBAC: Authorizing `identity:delete_role(role_id=e49e63bd97e54a2cb371fb79aeaa0d41)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:56.094084 ncdv-master-1 devstack@keystone.service[91547]: WARNING py.warnings [None req-1b5cc767-9d62-45f6-a126-b902f373ebdd tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:27:56.094084 ncdv-master-1 devstack@keystone.service[91547]: warnings.warn(msg) Jul 23 21:27:56.094084 ncdv-master-1 devstack@keystone.service[91547]: Jul 23 21:27:56.099031 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5cc767-9d62-45f6-a126-b902f373ebdd tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:56.121513 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ead8f81-2452-4ad5-b550-5608451220b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:56.122677 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ead8f81-2452-4ad5-b550-5608451220b8 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:56.123194 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ead8f81-2452-4ad5-b550-5608451220b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:56.123809 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ead8f81-2452-4ad5-b550-5608451220b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:56.124991 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ead8f81-2452-4ad5-b550-5608451220b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:56.127171 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ead8f81-2452-4ad5-b550-5608451220b8 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:56.152294 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2100/4219] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:27:55 2022] GET /identity/v3/roles => generated 1650 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 21:27:56.153582 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ead8f81-2452-4ad5-b550-5608451220b8 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:56.167956 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ead8f81-2452-4ad5-b550-5608451220b8 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:56.180697 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-1b5cc767-9d62-45f6-a126-b902f373ebdd tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Invalidating the token cache because role e49e63bd97e54a2cb371fb79aeaa0d41 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:27:56.180992 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-1b5cc767-9d62-45f6-a126-b902f373ebdd tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:56.182675 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-1b5cc767-9d62-45f6-a126-b902f373ebdd tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:56.185724 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be04bed-9cb7-4f42-a608-fa2f127def7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:56.190048 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2120/4220] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:27:55 2022] DELETE /identity/v3/roles/e49e63bd97e54a2cb371fb79aeaa0d41 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:27:56.191192 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be04bed-9cb7-4f42-a608-fa2f127def7e admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:56.191494 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be04bed-9cb7-4f42-a608-fa2f127def7e admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:56.191778 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be04bed-9cb7-4f42-a608-fa2f127def7e admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:56.192593 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be04bed-9cb7-4f42-a608-fa2f127def7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:56.196266 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be04bed-9cb7-4f42-a608-fa2f127def7e admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:56.203727 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5cc767-9d62-45f6-a126-b902f373ebdd tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:56.209504 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-1b5cc767-9d62-45f6-a126-b902f373ebdd tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:56.223565 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2101/4221] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:27:56 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:27:56.225218 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be04bed-9cb7-4f42-a608-fa2f127def7e admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:56.227518 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-4be04bed-9cb7-4f42-a608-fa2f127def7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:56.244804 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be04bed-9cb7-4f42-a608-fa2f127def7e admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:56.272267 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:27:56.363759 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07ccda1-a86b-4137-9c83-ba744729d862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:56.364780 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07ccda1-a86b-4137-9c83-ba744729d862 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:56.365121 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07ccda1-a86b-4137-9c83-ba744729d862 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:56.365459 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07ccda1-a86b-4137-9c83-ba744729d862 admin admin] PATH_INFO: `/v3/projects/7da3ad75853744c2a08043bc7b7fd4f0/users/a66f5ac0d2ed4898b2889a49b35385ff/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:56.391884 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5cc767-9d62-45f6-a126-b902f373ebdd tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:56.403335 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb98388-52a7-4f2e-a0c6-23fbeb42f402 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1994743b2e3c4725aa7e03519b6ab39e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0caeaf3c9e947b9aefe9b449d31c2ea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:56.404037 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb98388-52a7-4f2e-a0c6-23fbeb42f402 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:56.404597 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb98388-52a7-4f2e-a0c6-23fbeb42f402 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:56.404912 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb98388-52a7-4f2e-a0c6-23fbeb42f402 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:56.405631 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb98388-52a7-4f2e-a0c6-23fbeb42f402 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:56.406034 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07ccda1-a86b-4137-9c83-ba744729d862 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7da3ad75853744c2a08043bc7b7fd4f0, user_id=a66f5ac0d2ed4898b2889a49b35385ff, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:56.407306 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb98388-52a7-4f2e-a0c6-23fbeb42f402 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:56.410561 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07ccda1-a86b-4137-9c83-ba744729d862 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:56.435361 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2121/4222] 10.222.0.17 () {60 vars in 1142 bytes} [Sat Jul 23 21:27:56 2022] POST /identity/v3/roles => generated 240 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:27:56.441971 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb98388-52a7-4f2e-a0c6-23fbeb42f402 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:56.447571 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2102/4223] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:27:56 2022] PUT /identity/v3/projects/7da3ad75853744c2a08043bc7b7fd4f0/users/a66f5ac0d2ed4898b2889a49b35385ff/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:27:56.460653 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949adacb-3c60-4a52-8c6b-1f35803b09ed None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:56.461059 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949adacb-3c60-4a52-8c6b-1f35803b09ed None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:56.461441 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949adacb-3c60-4a52-8c6b-1f35803b09ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:56.472477 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb98388-52a7-4f2e-a0c6-23fbeb42f402 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:56.506712 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-949adacb-3c60-4a52-8c6b-1f35803b09ed None None] MFA Rules not processed for user `a66f5ac0d2ed4898b2889a49b35385ff`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:27:56.508307 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-949adacb-3c60-4a52-8c6b-1f35803b09ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:56.646292 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7cbfa7-681f-40c2-8243-f665584f5c1b tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1994743b2e3c4725aa7e03519b6ab39e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0caeaf3c9e947b9aefe9b449d31c2ea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:56.647468 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7cbfa7-681f-40c2-8243-f665584f5c1b tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:56.650087 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7cbfa7-681f-40c2-8243-f665584f5c1b tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:56.650610 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7cbfa7-681f-40c2-8243-f665584f5c1b tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/b361f85d00854f22bb558168b9aabefc/users/dcf1a072a2464a988f44645c67bff6b3/roles/17008f1374e7421eb46f71f78064d370/inherited_to_projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:56.667018 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2103/4224] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:27:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:27:56.683491 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949adacb-3c60-4a52-8c6b-1f35803b09ed None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:56.688534 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-949adacb-3c60-4a52-8c6b-1f35803b09ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:56.690999 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7cbfa7-681f-40c2-8243-f665584f5c1b tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] RBAC: Authorizing `identity:create_grant(project_id=b361f85d00854f22bb558168b9aabefc, user_id=dcf1a072a2464a988f44645c67bff6b3, role_id=17008f1374e7421eb46f71f78064d370)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:56.694596 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7cbfa7-681f-40c2-8243-f665584f5c1b tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:56.721844 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2122/4225] 10.222.0.17 () {60 vars in 1581 bytes} [Sat Jul 23 21:27:56 2022] PUT /identity/v3/OS-INHERIT/projects/b361f85d00854f22bb558168b9aabefc/users/dcf1a072a2464a988f44645c67bff6b3/roles/17008f1374e7421eb46f71f78064d370/inherited_to_projects => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:27:56.729364 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7cbfa7-681f-40c2-8243-f665584f5c1b tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:56.793891 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:27:56.818633 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7cbfa7-681f-40c2-8243-f665584f5c1b tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:56.823956 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4444915e-a0da-4192-907d-28d1a02f3076 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1994743b2e3c4725aa7e03519b6ab39e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0caeaf3c9e947b9aefe9b449d31c2ea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:56.828223 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949adacb-3c60-4a52-8c6b-1f35803b09ed None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:56.834519 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4444915e-a0da-4192-907d-28d1a02f3076 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] REQUEST_METHOD: `HEAD` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:56.834519 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4444915e-a0da-4192-907d-28d1a02f3076 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:56.835135 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4444915e-a0da-4192-907d-28d1a02f3076 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/b361f85d00854f22bb558168b9aabefc/users/dcf1a072a2464a988f44645c67bff6b3/roles/17008f1374e7421eb46f71f78064d370/inherited_to_projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:56.840707 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4444915e-a0da-4192-907d-28d1a02f3076 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] RBAC: Authorizing `identity:check_grant(project_id=b361f85d00854f22bb558168b9aabefc, user_id=dcf1a072a2464a988f44645c67bff6b3, role_id=17008f1374e7421eb46f71f78064d370)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:56.843903 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4444915e-a0da-4192-907d-28d1a02f3076 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:56.854883 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2123/4226] 10.222.0.17 () {58 vars in 1563 bytes} [Sat Jul 23 21:27:56 2022] HEAD /identity/v3/OS-INHERIT/projects/b361f85d00854f22bb558168b9aabefc/users/dcf1a072a2464a988f44645c67bff6b3/roles/17008f1374e7421eb46f71f78064d370/inherited_to_projects => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:27:56.856043 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4444915e-a0da-4192-907d-28d1a02f3076 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:56.868032 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4444915e-a0da-4192-907d-28d1a02f3076 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:56.874029 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a605a8-91b3-4005-9b03-c3874ffd1ccf tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1994743b2e3c4725aa7e03519b6ab39e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0caeaf3c9e947b9aefe9b449d31c2ea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:56.875110 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a605a8-91b3-4005-9b03-c3874ffd1ccf tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:56.875505 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a605a8-91b3-4005-9b03-c3874ffd1ccf tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:56.875885 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a605a8-91b3-4005-9b03-c3874ffd1ccf tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/b361f85d00854f22bb558168b9aabefc/users/dcf1a072a2464a988f44645c67bff6b3/roles/17008f1374e7421eb46f71f78064d370/inherited_to_projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:56.878932 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a605a8-91b3-4005-9b03-c3874ffd1ccf tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=b361f85d00854f22bb558168b9aabefc, user_id=dcf1a072a2464a988f44645c67bff6b3, role_id=17008f1374e7421eb46f71f78064d370)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:56.881999 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a605a8-91b3-4005-9b03-c3874ffd1ccf tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:56.883076 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:27:56.889175 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-d3a605a8-91b3-4005-9b03-c3874ffd1ccf tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Invalidating the token cache because role 17008f1374e7421eb46f71f78064d370 was removed from user dcf1a072a2464a988f44645c67bff6b3 on project b361f85d00854f22bb558168b9aabefc. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:27:56.889577 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-d3a605a8-91b3-4005-9b03-c3874ffd1ccf tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:56.890432 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-d3a605a8-91b3-4005-9b03-c3874ffd1ccf tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:56.890618 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caafc002-a4a6-49c8-b412-05b57b6cce0c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7f2db148c8e4d5d81431cae3576434b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:56.891220 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caafc002-a4a6-49c8-b412-05b57b6cce0c service glance] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:56.891510 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caafc002-a4a6-49c8-b412-05b57b6cce0c service glance] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:56.891786 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caafc002-a4a6-49c8-b412-05b57b6cce0c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:56.894441 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-caafc002-a4a6-49c8-b412-05b57b6cce0c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:56.919403 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2124/4227] 10.222.0.17 () {58 vars in 1565 bytes} [Sat Jul 23 21:27:56 2022] DELETE /identity/v3/OS-INHERIT/projects/b361f85d00854f22bb558168b9aabefc/users/dcf1a072a2464a988f44645c67bff6b3/roles/17008f1374e7421eb46f71f78064d370/inherited_to_projects => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:27:56.923728 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a605a8-91b3-4005-9b03-c3874ffd1ccf tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:56.927567 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-d3a605a8-91b3-4005-9b03-c3874ffd1ccf tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:57.005849 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caafc002-a4a6-49c8-b412-05b57b6cce0c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:57.007467 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caafc002-a4a6-49c8-b412-05b57b6cce0c service glance] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:57.034102 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2104/4228] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:27:56 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:27:57.052997 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a605a8-91b3-4005-9b03-c3874ffd1ccf tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:57.058254 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14919746-07aa-4f9b-b827-00a28f37f00e tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1994743b2e3c4725aa7e03519b6ab39e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0caeaf3c9e947b9aefe9b449d31c2ea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:57.059265 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14919746-07aa-4f9b-b827-00a28f37f00e tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:57.059557 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14919746-07aa-4f9b-b827-00a28f37f00e tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:57.059838 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14919746-07aa-4f9b-b827-00a28f37f00e tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] PATH_INFO: `/v3/roles/17008f1374e7421eb46f71f78064d370` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:57.061493 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14919746-07aa-4f9b-b827-00a28f37f00e tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] RBAC: Authorizing `identity:delete_role(role_id=17008f1374e7421eb46f71f78064d370)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:57.063284 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14919746-07aa-4f9b-b827-00a28f37f00e tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:57.133996 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-14919746-07aa-4f9b-b827-00a28f37f00e tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Invalidating the token cache because role 17008f1374e7421eb46f71f78064d370 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:27:57.134578 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-14919746-07aa-4f9b-b827-00a28f37f00e tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:57.135774 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-14919746-07aa-4f9b-b827-00a28f37f00e tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:57.138335 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2125/4229] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:27:56 2022] DELETE /identity/v3/roles/17008f1374e7421eb46f71f78064d370 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:27:57.143630 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caafc002-a4a6-49c8-b412-05b57b6cce0c service glance] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:57.202904 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caafc002-a4a6-49c8-b412-05b57b6cce0c service glance] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:57.229554 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14919746-07aa-4f9b-b827-00a28f37f00e tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:57.231611 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-14919746-07aa-4f9b-b827-00a28f37f00e tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:57.285070 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6856b31-0947-4245-9431-86820bae3d1d tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1994743b2e3c4725aa7e03519b6ab39e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0caeaf3c9e947b9aefe9b449d31c2ea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:57.286736 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6856b31-0947-4245-9431-86820bae3d1d tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:57.287190 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6856b31-0947-4245-9431-86820bae3d1d tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:57.287629 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6856b31-0947-4245-9431-86820bae3d1d tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:57.289012 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6856b31-0947-4245-9431-86820bae3d1d tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:57.290266 ncdv-master-1 devstack@keystone.service[91548]: WARNING py.warnings [None req-a6856b31-0947-4245-9431-86820bae3d1d tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:27:57.290266 ncdv-master-1 devstack@keystone.service[91548]: warnings.warn(msg) Jul 23 21:27:57.290266 ncdv-master-1 devstack@keystone.service[91548]: Jul 23 21:27:57.292604 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6856b31-0947-4245-9431-86820bae3d1d tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:57.303673 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14919746-07aa-4f9b-b827-00a28f37f00e tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:57.308712 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76d26f5-c12a-4e03-b6db-a3981aad69cd service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7f2db148c8e4d5d81431cae3576434b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:57.320665 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76d26f5-c12a-4e03-b6db-a3981aad69cd service glance] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:57.322666 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76d26f5-c12a-4e03-b6db-a3981aad69cd service glance] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:57.323209 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76d26f5-c12a-4e03-b6db-a3981aad69cd service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:57.331546 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-d76d26f5-c12a-4e03-b6db-a3981aad69cd service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:57.345004 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2105/4230] 10.222.0.17 () {60 vars in 1142 bytes} [Sat Jul 23 21:27:57 2022] POST /identity/v3/roles => generated 240 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:27:57.350098 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6856b31-0947-4245-9431-86820bae3d1d tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:57.352439 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-a6856b31-0947-4245-9431-86820bae3d1d tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:57.383283 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6856b31-0947-4245-9431-86820bae3d1d tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:57.405839 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa4bfeb-2c29-4770-b865-eb7bb3c1c69a tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1994743b2e3c4725aa7e03519b6ab39e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0caeaf3c9e947b9aefe9b449d31c2ea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:57.406923 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa4bfeb-2c29-4770-b865-eb7bb3c1c69a tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:57.407304 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa4bfeb-2c29-4770-b865-eb7bb3c1c69a tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:57.407687 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa4bfeb-2c29-4770-b865-eb7bb3c1c69a tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/7a0e7ceb30ff4beca0430509ee04a8b8/groups/cf24d34665664f94a7566ff7eed31c14/roles/ff50f6a88aed4e24b7f237f9efc11edb/inherited_to_projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:57.411389 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa4bfeb-2c29-4770-b865-eb7bb3c1c69a tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=7a0e7ceb30ff4beca0430509ee04a8b8, group_id=cf24d34665664f94a7566ff7eed31c14, role_id=ff50f6a88aed4e24b7f237f9efc11edb)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:57.415749 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa4bfeb-2c29-4770-b865-eb7bb3c1c69a tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:57.431590 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:27:57.460496 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2106/4231] 10.222.0.17 () {60 vars in 1581 bytes} [Sat Jul 23 21:27:57 2022] PUT /identity/v3/OS-INHERIT/domains/7a0e7ceb30ff4beca0430509ee04a8b8/groups/cf24d34665664f94a7566ff7eed31c14/roles/ff50f6a88aed4e24b7f237f9efc11edb/inherited_to_projects => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:27:57.467281 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa4bfeb-2c29-4770-b865-eb7bb3c1c69a tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:57.490759 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76d26f5-c12a-4e03-b6db-a3981aad69cd service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:57.492334 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76d26f5-c12a-4e03-b6db-a3981aad69cd service glance] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:57.518262 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2126/4232] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:27:57 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 23 21:27:57.585636 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:27:57.629242 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa4bfeb-2c29-4770-b865-eb7bb3c1c69a tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:57.645500 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec2e870-6713-45be-9842-973724ed6692 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1994743b2e3c4725aa7e03519b6ab39e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0caeaf3c9e947b9aefe9b449d31c2ea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:57.647457 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec2e870-6713-45be-9842-973724ed6692 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:57.647956 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec2e870-6713-45be-9842-973724ed6692 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:57.648447 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec2e870-6713-45be-9842-973724ed6692 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/7a0e7ceb30ff4beca0430509ee04a8b8/groups/cf24d34665664f94a7566ff7eed31c14/roles/inherited_to_projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:57.651922 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec2e870-6713-45be-9842-973724ed6692 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=7a0e7ceb30ff4beca0430509ee04a8b8, group_id=cf24d34665664f94a7566ff7eed31c14)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:57.654039 ncdv-master-1 devstack@keystone.service[91548]: WARNING py.warnings [None req-fec2e870-6713-45be-9842-973724ed6692 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_grants": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:27:57.654039 ncdv-master-1 devstack@keystone.service[91548]: warnings.warn(msg) Jul 23 21:27:57.654039 ncdv-master-1 devstack@keystone.service[91548]: Jul 23 21:27:57.657637 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec2e870-6713-45be-9842-973724ed6692 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:57.679799 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2107/4233] 10.222.0.17 () {58 vars in 1463 bytes} [Sat Jul 23 21:27:57 2022] GET /identity/v3/OS-INHERIT/domains/7a0e7ceb30ff4beca0430509ee04a8b8/groups/cf24d34665664f94a7566ff7eed31c14/roles/inherited_to_projects => generated 448 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:27:57.684311 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76d26f5-c12a-4e03-b6db-a3981aad69cd service glance] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:57.701424 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76d26f5-c12a-4e03-b6db-a3981aad69cd service glance] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:57.708303 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2ae068-f63f-4fff-b483-7008cb0167a7 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1994743b2e3c4725aa7e03519b6ab39e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0caeaf3c9e947b9aefe9b449d31c2ea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:57.709919 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2ae068-f63f-4fff-b483-7008cb0167a7 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] REQUEST_METHOD: `HEAD` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:57.710534 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2ae068-f63f-4fff-b483-7008cb0167a7 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:57.711008 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2ae068-f63f-4fff-b483-7008cb0167a7 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/7a0e7ceb30ff4beca0430509ee04a8b8/groups/cf24d34665664f94a7566ff7eed31c14/roles/ff50f6a88aed4e24b7f237f9efc11edb/inherited_to_projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:57.714277 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2ae068-f63f-4fff-b483-7008cb0167a7 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=7a0e7ceb30ff4beca0430509ee04a8b8, group_id=cf24d34665664f94a7566ff7eed31c14, role_id=ff50f6a88aed4e24b7f237f9efc11edb)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:57.719268 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2ae068-f63f-4fff-b483-7008cb0167a7 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:57.730967 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2127/4234] 10.222.0.17 () {58 vars in 1563 bytes} [Sat Jul 23 21:27:57 2022] HEAD /identity/v3/OS-INHERIT/domains/7a0e7ceb30ff4beca0430509ee04a8b8/groups/cf24d34665664f94a7566ff7eed31c14/roles/ff50f6a88aed4e24b7f237f9efc11edb/inherited_to_projects => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:27:57.735725 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec2e870-6713-45be-9842-973724ed6692 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:57.768990 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec2e870-6713-45be-9842-973724ed6692 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:57.776210 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac11d44f-debf-4c2b-8c39-1df3f84ff54f tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1994743b2e3c4725aa7e03519b6ab39e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0caeaf3c9e947b9aefe9b449d31c2ea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:57.777519 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac11d44f-debf-4c2b-8c39-1df3f84ff54f tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:57.778188 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac11d44f-debf-4c2b-8c39-1df3f84ff54f tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:57.778717 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac11d44f-debf-4c2b-8c39-1df3f84ff54f tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/7a0e7ceb30ff4beca0430509ee04a8b8/groups/cf24d34665664f94a7566ff7eed31c14/roles/ff50f6a88aed4e24b7f237f9efc11edb/inherited_to_projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:57.782036 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac11d44f-debf-4c2b-8c39-1df3f84ff54f tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=7a0e7ceb30ff4beca0430509ee04a8b8, group_id=cf24d34665664f94a7566ff7eed31c14, role_id=ff50f6a88aed4e24b7f237f9efc11edb)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:57.785372 ncdv-master-1 devstack@keystone.service[91548]: WARNING py.warnings [None req-ac11d44f-debf-4c2b-8c39-1df3f84ff54f tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:27:57.785372 ncdv-master-1 devstack@keystone.service[91548]: warnings.warn(msg) Jul 23 21:27:57.785372 ncdv-master-1 devstack@keystone.service[91548]: Jul 23 21:27:57.788477 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac11d44f-debf-4c2b-8c39-1df3f84ff54f tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:57.798890 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-ac11d44f-debf-4c2b-8c39-1df3f84ff54f tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Invalidating the token cache because role ff50f6a88aed4e24b7f237f9efc11edb was removed from group cf24d34665664f94a7566ff7eed31c14 on domain 7a0e7ceb30ff4beca0430509ee04a8b8. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:27:57.800047 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-ac11d44f-debf-4c2b-8c39-1df3f84ff54f tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:57.803048 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-ac11d44f-debf-4c2b-8c39-1df3f84ff54f tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:57.871181 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2108/4235] 10.222.0.17 () {58 vars in 1565 bytes} [Sat Jul 23 21:27:57 2022] DELETE /identity/v3/OS-INHERIT/domains/7a0e7ceb30ff4beca0430509ee04a8b8/groups/cf24d34665664f94a7566ff7eed31c14/roles/ff50f6a88aed4e24b7f237f9efc11edb/inherited_to_projects => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:27:57.875453 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2ae068-f63f-4fff-b483-7008cb0167a7 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:57.878223 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-2c2ae068-f63f-4fff-b483-7008cb0167a7 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:57.914794 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2ae068-f63f-4fff-b483-7008cb0167a7 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:58.079689 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173afefc-df6b-454d-8e82-608c4cfb4b2e tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1994743b2e3c4725aa7e03519b6ab39e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0caeaf3c9e947b9aefe9b449d31c2ea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:58.080594 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173afefc-df6b-454d-8e82-608c4cfb4b2e tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:58.080877 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173afefc-df6b-454d-8e82-608c4cfb4b2e tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:58.081152 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173afefc-df6b-454d-8e82-608c4cfb4b2e tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] PATH_INFO: `/v3/roles/ff50f6a88aed4e24b7f237f9efc11edb` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:58.091635 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173afefc-df6b-454d-8e82-608c4cfb4b2e tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] RBAC: Authorizing `identity:delete_role(role_id=ff50f6a88aed4e24b7f237f9efc11edb)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:58.093466 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173afefc-df6b-454d-8e82-608c4cfb4b2e tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:58.179802 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-173afefc-df6b-454d-8e82-608c4cfb4b2e tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Invalidating the token cache because role ff50f6a88aed4e24b7f237f9efc11edb has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:27:58.180126 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-173afefc-df6b-454d-8e82-608c4cfb4b2e tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:58.180946 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-173afefc-df6b-454d-8e82-608c4cfb4b2e tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:58.188643 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2128/4236] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:27:57 2022] DELETE /identity/v3/roles/ff50f6a88aed4e24b7f237f9efc11edb => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:27:58.191174 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac11d44f-debf-4c2b-8c39-1df3f84ff54f tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:58.208596 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac11d44f-debf-4c2b-8c39-1df3f84ff54f tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:58.268513 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173afefc-df6b-454d-8e82-608c4cfb4b2e tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:58.270500 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-173afefc-df6b-454d-8e82-608c4cfb4b2e tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:58.299496 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e32b27-c2be-4525-a6d6-eb5ebaf0c10e tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1994743b2e3c4725aa7e03519b6ab39e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0caeaf3c9e947b9aefe9b449d31c2ea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:58.300305 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e32b27-c2be-4525-a6d6-eb5ebaf0c10e tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:58.300656 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e32b27-c2be-4525-a6d6-eb5ebaf0c10e tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:58.300929 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e32b27-c2be-4525-a6d6-eb5ebaf0c10e tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:58.301669 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e32b27-c2be-4525-a6d6-eb5ebaf0c10e tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:58.303916 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e32b27-c2be-4525-a6d6-eb5ebaf0c10e tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:58.329633 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2109/4237] 10.222.0.17 () {60 vars in 1142 bytes} [Sat Jul 23 21:27:58 2022] POST /identity/v3/roles => generated 239 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:27:58.334612 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e32b27-c2be-4525-a6d6-eb5ebaf0c10e tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:58.339464 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-b2e32b27-c2be-4525-a6d6-eb5ebaf0c10e tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:58.353626 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e32b27-c2be-4525-a6d6-eb5ebaf0c10e tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:58.359432 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167357fd-185b-490d-92cd-6edda5da0fff tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1994743b2e3c4725aa7e03519b6ab39e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0caeaf3c9e947b9aefe9b449d31c2ea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:58.360374 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167357fd-185b-490d-92cd-6edda5da0fff tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:58.360663 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167357fd-185b-490d-92cd-6edda5da0fff tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:58.360946 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167357fd-185b-490d-92cd-6edda5da0fff tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/7a0e7ceb30ff4beca0430509ee04a8b8/users/dcf1a072a2464a988f44645c67bff6b3/roles/f8c844df44724fd09887f0011d3103b2/inherited_to_projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:58.365140 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167357fd-185b-490d-92cd-6edda5da0fff tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=7a0e7ceb30ff4beca0430509ee04a8b8, user_id=dcf1a072a2464a988f44645c67bff6b3, role_id=f8c844df44724fd09887f0011d3103b2)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:58.368938 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167357fd-185b-490d-92cd-6edda5da0fff tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:58.384716 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2110/4238] 10.222.0.17 () {60 vars in 1578 bytes} [Sat Jul 23 21:27:58 2022] PUT /identity/v3/OS-INHERIT/domains/7a0e7ceb30ff4beca0430509ee04a8b8/users/dcf1a072a2464a988f44645c67bff6b3/roles/f8c844df44724fd09887f0011d3103b2/inherited_to_projects => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:27:58.391361 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167357fd-185b-490d-92cd-6edda5da0fff tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:58.465801 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173afefc-df6b-454d-8e82-608c4cfb4b2e tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:58.473775 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167357fd-185b-490d-92cd-6edda5da0fff tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:58.479973 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbe53a4-4429-4537-8cd4-a630e36c7934 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1994743b2e3c4725aa7e03519b6ab39e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0caeaf3c9e947b9aefe9b449d31c2ea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:58.481027 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbe53a4-4429-4537-8cd4-a630e36c7934 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:58.481492 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbe53a4-4429-4537-8cd4-a630e36c7934 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:58.481841 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbe53a4-4429-4537-8cd4-a630e36c7934 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/7a0e7ceb30ff4beca0430509ee04a8b8/users/dcf1a072a2464a988f44645c67bff6b3/roles/inherited_to_projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:58.483496 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:27:58.484000 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbe53a4-4429-4537-8cd4-a630e36c7934 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=7a0e7ceb30ff4beca0430509ee04a8b8, user_id=dcf1a072a2464a988f44645c67bff6b3)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:58.487686 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbe53a4-4429-4537-8cd4-a630e36c7934 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:58.506514 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2111/4239] 10.222.0.17 () {58 vars in 1460 bytes} [Sat Jul 23 21:27:58 2022] GET /identity/v3/OS-INHERIT/domains/7a0e7ceb30ff4beca0430509ee04a8b8/users/dcf1a072a2464a988f44645c67bff6b3/roles/inherited_to_projects => generated 446 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:27:58.511068 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbe53a4-4429-4537-8cd4-a630e36c7934 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:58.522730 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbe53a4-4429-4537-8cd4-a630e36c7934 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:58.529707 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc4bbe2-7b7d-458a-b374-851b448aaa90 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1994743b2e3c4725aa7e03519b6ab39e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0caeaf3c9e947b9aefe9b449d31c2ea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:58.530768 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc4bbe2-7b7d-458a-b374-851b448aaa90 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] REQUEST_METHOD: `HEAD` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:58.531131 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc4bbe2-7b7d-458a-b374-851b448aaa90 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:58.531535 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc4bbe2-7b7d-458a-b374-851b448aaa90 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/7a0e7ceb30ff4beca0430509ee04a8b8/users/dcf1a072a2464a988f44645c67bff6b3/roles/f8c844df44724fd09887f0011d3103b2/inherited_to_projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:58.534129 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc4bbe2-7b7d-458a-b374-851b448aaa90 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=7a0e7ceb30ff4beca0430509ee04a8b8, user_id=dcf1a072a2464a988f44645c67bff6b3, role_id=f8c844df44724fd09887f0011d3103b2)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:58.535515 ncdv-master-1 devstack@keystone.service[91548]: WARNING py.warnings [None req-3dc4bbe2-7b7d-458a-b374-851b448aaa90 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_grant": "(role:reader and system_scope:all) or ((role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:27:58.535515 ncdv-master-1 devstack@keystone.service[91548]: warnings.warn(msg) Jul 23 21:27:58.535515 ncdv-master-1 devstack@keystone.service[91548]: Jul 23 21:27:58.538257 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc4bbe2-7b7d-458a-b374-851b448aaa90 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:58.545564 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2112/4240] 10.222.0.17 () {58 vars in 1560 bytes} [Sat Jul 23 21:27:58 2022] HEAD /identity/v3/OS-INHERIT/domains/7a0e7ceb30ff4beca0430509ee04a8b8/users/dcf1a072a2464a988f44645c67bff6b3/roles/f8c844df44724fd09887f0011d3103b2/inherited_to_projects => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:27:58.550520 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc4bbe2-7b7d-458a-b374-851b448aaa90 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:58.565814 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc4bbe2-7b7d-458a-b374-851b448aaa90 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:58.572941 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd90b6a-de2c-4ab8-b211-4105bf13597a tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1994743b2e3c4725aa7e03519b6ab39e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0caeaf3c9e947b9aefe9b449d31c2ea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:58.573971 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd90b6a-de2c-4ab8-b211-4105bf13597a tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:58.574255 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78182cda-2c00-47a7-946b-6c03751b5d95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:58.574657 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd90b6a-de2c-4ab8-b211-4105bf13597a tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:58.575029 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd90b6a-de2c-4ab8-b211-4105bf13597a tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/7a0e7ceb30ff4beca0430509ee04a8b8/users/dcf1a072a2464a988f44645c67bff6b3/roles/f8c844df44724fd09887f0011d3103b2/inherited_to_projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:58.575859 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78182cda-2c00-47a7-946b-6c03751b5d95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:58.576301 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78182cda-2c00-47a7-946b-6c03751b5d95 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:58.576741 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78182cda-2c00-47a7-946b-6c03751b5d95 admin admin] PATH_INFO: `/v3/users/4e9783900bee47efa9dda5e218c7b116` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:58.578226 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78182cda-2c00-47a7-946b-6c03751b5d95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e9783900bee47efa9dda5e218c7b116)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:58.579089 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd90b6a-de2c-4ab8-b211-4105bf13597a tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=7a0e7ceb30ff4beca0430509ee04a8b8, user_id=dcf1a072a2464a988f44645c67bff6b3, role_id=f8c844df44724fd09887f0011d3103b2)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:58.581016 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78182cda-2c00-47a7-946b-6c03751b5d95 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:58.582477 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd90b6a-de2c-4ab8-b211-4105bf13597a tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:58.588439 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-5bd90b6a-de2c-4ab8-b211-4105bf13597a tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Invalidating the token cache because role f8c844df44724fd09887f0011d3103b2 was removed from user dcf1a072a2464a988f44645c67bff6b3 on domain 7a0e7ceb30ff4beca0430509ee04a8b8. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:27:58.588841 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-5bd90b6a-de2c-4ab8-b211-4105bf13597a tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:58.589904 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-5bd90b6a-de2c-4ab8-b211-4105bf13597a tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:58.607226 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2113/4241] 10.222.0.17 () {58 vars in 1562 bytes} [Sat Jul 23 21:27:58 2022] DELETE /identity/v3/OS-INHERIT/domains/7a0e7ceb30ff4beca0430509ee04a8b8/users/dcf1a072a2464a988f44645c67bff6b3/roles/f8c844df44724fd09887f0011d3103b2/inherited_to_projects => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:27:58.611906 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd90b6a-de2c-4ab8-b211-4105bf13597a tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:58.614093 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-5bd90b6a-de2c-4ab8-b211-4105bf13597a tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:58.638443 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:27:58.671651 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-78182cda-2c00-47a7-946b-6c03751b5d95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e9783900bee47efa9dda5e218c7b116'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:58.708337 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-78182cda-2c00-47a7-946b-6c03751b5d95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e9783900bee47efa9dda5e218c7b116'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:58.709659 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-78182cda-2c00-47a7-946b-6c03751b5d95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e9783900bee47efa9dda5e218c7b116'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:58.749652 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-78182cda-2c00-47a7-946b-6c03751b5d95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e9783900bee47efa9dda5e218c7b116'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:58.809460 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-78182cda-2c00-47a7-946b-6c03751b5d95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e9783900bee47efa9dda5e218c7b116'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:58.839254 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2129/4242] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:27:58 2022] DELETE /identity/v3/users/4e9783900bee47efa9dda5e218c7b116 => generated 0 bytes in 568 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:27:58.843089 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a159c38e-649f-4610-9c85-c6df6b5f6816 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:58.844236 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a159c38e-649f-4610-9c85-c6df6b5f6816 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:58.844853 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a159c38e-649f-4610-9c85-c6df6b5f6816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:58.931677 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-a159c38e-649f-4610-9c85-c6df6b5f6816 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:27:58.935385 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-a159c38e-649f-4610-9c85-c6df6b5f6816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:59.119830 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd90b6a-de2c-4ab8-b211-4105bf13597a tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:59.122671 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2130/4243] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:27:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:27:59.136407 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a159c38e-649f-4610-9c85-c6df6b5f6816 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:59.143880 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-a159c38e-649f-4610-9c85-c6df6b5f6816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:59.200389 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:27:59.236659 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce4b070-d02c-4f49-b338-24356412d519 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1994743b2e3c4725aa7e03519b6ab39e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0caeaf3c9e947b9aefe9b449d31c2ea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:59.237458 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce4b070-d02c-4f49-b338-24356412d519 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:59.238497 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce4b070-d02c-4f49-b338-24356412d519 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:59.238929 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce4b070-d02c-4f49-b338-24356412d519 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] PATH_INFO: `/v3/roles/f8c844df44724fd09887f0011d3103b2` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:59.240879 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce4b070-d02c-4f49-b338-24356412d519 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] RBAC: Authorizing `identity:delete_role(role_id=f8c844df44724fd09887f0011d3103b2)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:59.242590 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce4b070-d02c-4f49-b338-24356412d519 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:59.332669 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-7ce4b070-d02c-4f49-b338-24356412d519 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Invalidating the token cache because role f8c844df44724fd09887f0011d3103b2 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:27:59.335182 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-7ce4b070-d02c-4f49-b338-24356412d519 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:59.335182 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-7ce4b070-d02c-4f49-b338-24356412d519 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:27:59.337923 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2114/4244] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:27:58 2022] DELETE /identity/v3/roles/f8c844df44724fd09887f0011d3103b2 => generated 0 bytes in 726 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:27:59.343877 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce4b070-d02c-4f49-b338-24356412d519 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:59.348388 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-7ce4b070-d02c-4f49-b338-24356412d519 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:59.358569 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a159c38e-649f-4610-9c85-c6df6b5f6816 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:59.477491 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cb3aac-83cb-4cde-9d64-e0b4a9f8bc48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:59.479006 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cb3aac-83cb-4cde-9d64-e0b4a9f8bc48 service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:59.479568 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cb3aac-83cb-4cde-9d64-e0b4a9f8bc48 service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:59.481389 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cb3aac-83cb-4cde-9d64-e0b4a9f8bc48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:59.488526 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-e9cb3aac-83cb-4cde-9d64-e0b4a9f8bc48 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:27:59.492823 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce4b070-d02c-4f49-b338-24356412d519 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:59.507382 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaded0e-85f9-458e-a617-d5d0271cb3a3 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1994743b2e3c4725aa7e03519b6ab39e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0caeaf3c9e947b9aefe9b449d31c2ea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:59.508250 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaded0e-85f9-458e-a617-d5d0271cb3a3 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:59.508658 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaded0e-85f9-458e-a617-d5d0271cb3a3 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:59.509042 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaded0e-85f9-458e-a617-d5d0271cb3a3 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:59.509919 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaded0e-85f9-458e-a617-d5d0271cb3a3 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:59.511826 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaded0e-85f9-458e-a617-d5d0271cb3a3 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:59.540513 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2115/4245] 10.222.0.17 () {60 vars in 1142 bytes} [Sat Jul 23 21:27:59 2022] POST /identity/v3/roles => generated 240 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:27:59.544338 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaded0e-85f9-458e-a617-d5d0271cb3a3 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:59.567522 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaded0e-85f9-458e-a617-d5d0271cb3a3 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:59.571594 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d722d68-0f0f-46b7-959b-02dcea8b7e8a tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1994743b2e3c4725aa7e03519b6ab39e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0caeaf3c9e947b9aefe9b449d31c2ea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:59.572853 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d722d68-0f0f-46b7-959b-02dcea8b7e8a tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:59.573136 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d722d68-0f0f-46b7-959b-02dcea8b7e8a tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:59.573413 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d722d68-0f0f-46b7-959b-02dcea8b7e8a tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:59.574726 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d722d68-0f0f-46b7-959b-02dcea8b7e8a tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:59.576766 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d722d68-0f0f-46b7-959b-02dcea8b7e8a tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:59.594712 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:27:59.627475 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cb3aac-83cb-4cde-9d64-e0b4a9f8bc48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:59.629481 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cb3aac-83cb-4cde-9d64-e0b4a9f8bc48 service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:59.632163 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2116/4246] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:27:59 2022] POST /identity/v3/projects => generated 409 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:27:59.634201 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d722d68-0f0f-46b7-959b-02dcea8b7e8a tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:59.667236 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2131/4247] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:27:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 531 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:27:59.727926 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d722d68-0f0f-46b7-959b-02dcea8b7e8a tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:59.739475 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7124b6a-a112-459b-b408-4edffd0924cf tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1994743b2e3c4725aa7e03519b6ab39e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0caeaf3c9e947b9aefe9b449d31c2ea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:59.740441 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7124b6a-a112-459b-b408-4edffd0924cf tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:59.740730 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7124b6a-a112-459b-b408-4edffd0924cf tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:59.741006 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7124b6a-a112-459b-b408-4edffd0924cf tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/7a0e7ceb30ff4beca0430509ee04a8b8/users/dcf1a072a2464a988f44645c67bff6b3/roles/4850dec6393e43ff981979b59aa6a9be/inherited_to_projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:59.744042 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7124b6a-a112-459b-b408-4edffd0924cf tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=7a0e7ceb30ff4beca0430509ee04a8b8, user_id=dcf1a072a2464a988f44645c67bff6b3, role_id=4850dec6393e43ff981979b59aa6a9be)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:59.747353 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7124b6a-a112-459b-b408-4edffd0924cf tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:27:59.770023 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2117/4248] 10.222.0.17 () {60 vars in 1578 bytes} [Sat Jul 23 21:27:59 2022] PUT /identity/v3/OS-INHERIT/domains/7a0e7ceb30ff4beca0430509ee04a8b8/users/dcf1a072a2464a988f44645c67bff6b3/roles/4850dec6393e43ff981979b59aa6a9be/inherited_to_projects => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:27:59.771367 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cb3aac-83cb-4cde-9d64-e0b4a9f8bc48 service neutron] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:27:59.785412 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cb3aac-83cb-4cde-9d64-e0b4a9f8bc48 service neutron] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:27:59.890577 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:27:59.905700 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77041a4-2765-496b-9248-35074bbda2a5 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1994743b2e3c4725aa7e03519b6ab39e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0caeaf3c9e947b9aefe9b449d31c2ea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:27:59.908723 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77041a4-2765-496b-9248-35074bbda2a5 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:27:59.909013 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77041a4-2765-496b-9248-35074bbda2a5 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:27:59.909279 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77041a4-2765-496b-9248-35074bbda2a5 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:27:59.910202 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77041a4-2765-496b-9248-35074bbda2a5 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] RBAC: Adding query filter params (scope.project.id=b361f85d00854f22bb558168b9aabefc, user.id=dcf1a072a2464a988f44645c67bff6b3) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:27:59.910505 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77041a4-2765-496b-9248-35074bbda2a5 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:27:59.911538 ncdv-master-1 devstack@keystone.service[91547]: WARNING py.warnings [None req-a77041a4-2765-496b-9248-35074bbda2a5 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:27:59.911538 ncdv-master-1 devstack@keystone.service[91547]: warnings.warn(msg) Jul 23 21:27:59.911538 ncdv-master-1 devstack@keystone.service[91547]: Jul 23 21:27:59.912688 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77041a4-2765-496b-9248-35074bbda2a5 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:00.005916 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2132/4249] 10.222.0.17 () {58 vars in 1355 bytes} [Sat Jul 23 21:27:59 2022] GET /identity/v3/role_assignments?scope.project.id=b361f85d00854f22bb558168b9aabefc&user.id=dcf1a072a2464a988f44645c67bff6b3&effective => generated 648 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 21:28:00.009415 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7124b6a-a112-459b-b408-4edffd0924cf tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:00.024646 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7124b6a-a112-459b-b408-4edffd0924cf tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:00.029831 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9964ce-46fa-4fc9-bec8-f28ef51ccb7e tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1994743b2e3c4725aa7e03519b6ab39e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0caeaf3c9e947b9aefe9b449d31c2ea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:00.042097 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9964ce-46fa-4fc9-bec8-f28ef51ccb7e tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:00.042097 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9964ce-46fa-4fc9-bec8-f28ef51ccb7e tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:00.042097 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9964ce-46fa-4fc9-bec8-f28ef51ccb7e tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:00.042097 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9964ce-46fa-4fc9-bec8-f28ef51ccb7e tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] RBAC: Adding query filter params (scope.project.id=f1e5a42e625140b0bc729eea4b393f20, user.id=dcf1a072a2464a988f44645c67bff6b3) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:28:00.042522 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9964ce-46fa-4fc9-bec8-f28ef51ccb7e tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:00.042522 ncdv-master-1 devstack@keystone.service[91548]: WARNING py.warnings [None req-ac9964ce-46fa-4fc9-bec8-f28ef51ccb7e tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:28:00.042522 ncdv-master-1 devstack@keystone.service[91548]: warnings.warn(msg) Jul 23 21:28:00.042522 ncdv-master-1 devstack@keystone.service[91548]: Jul 23 21:28:00.042522 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9964ce-46fa-4fc9-bec8-f28ef51ccb7e tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:00.127407 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2118/4250] 10.222.0.17 () {58 vars in 1355 bytes} [Sat Jul 23 21:28:00 2022] GET /identity/v3/role_assignments?scope.project.id=f1e5a42e625140b0bc729eea4b393f20&user.id=dcf1a072a2464a988f44645c67bff6b3&effective => generated 648 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:28:00.129832 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77041a4-2765-496b-9248-35074bbda2a5 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:00.148851 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77041a4-2765-496b-9248-35074bbda2a5 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:00.155160 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0fc9c2-9956-4761-8e55-8f48005a8cfc tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1994743b2e3c4725aa7e03519b6ab39e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0caeaf3c9e947b9aefe9b449d31c2ea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:00.156265 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0fc9c2-9956-4761-8e55-8f48005a8cfc tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:00.156721 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0fc9c2-9956-4761-8e55-8f48005a8cfc tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:00.157170 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0fc9c2-9956-4761-8e55-8f48005a8cfc tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/7a0e7ceb30ff4beca0430509ee04a8b8/users/dcf1a072a2464a988f44645c67bff6b3/roles/4850dec6393e43ff981979b59aa6a9be/inherited_to_projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:00.159603 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0fc9c2-9956-4761-8e55-8f48005a8cfc tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=7a0e7ceb30ff4beca0430509ee04a8b8, user_id=dcf1a072a2464a988f44645c67bff6b3, role_id=4850dec6393e43ff981979b59aa6a9be)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:00.163135 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0fc9c2-9956-4761-8e55-8f48005a8cfc tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:00.170390 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-4e0fc9c2-9956-4761-8e55-8f48005a8cfc tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Invalidating the token cache because role 4850dec6393e43ff981979b59aa6a9be was removed from user dcf1a072a2464a988f44645c67bff6b3 on domain 7a0e7ceb30ff4beca0430509ee04a8b8. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:28:00.171231 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-4e0fc9c2-9956-4761-8e55-8f48005a8cfc tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:00.172147 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-4e0fc9c2-9956-4761-8e55-8f48005a8cfc tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:00.194232 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2133/4251] 10.222.0.17 () {58 vars in 1562 bytes} [Sat Jul 23 21:28:00 2022] DELETE /identity/v3/OS-INHERIT/domains/7a0e7ceb30ff4beca0430509ee04a8b8/users/dcf1a072a2464a988f44645c67bff6b3/roles/4850dec6393e43ff981979b59aa6a9be/inherited_to_projects => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:28:00.199322 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9964ce-46fa-4fc9-bec8-f28ef51ccb7e tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:00.201757 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-ac9964ce-46fa-4fc9-bec8-f28ef51ccb7e tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:00.218991 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9964ce-46fa-4fc9-bec8-f28ef51ccb7e tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:00.318604 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a6347a-6262-4fd9-818c-8dc713569f2a tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1994743b2e3c4725aa7e03519b6ab39e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0caeaf3c9e947b9aefe9b449d31c2ea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:00.319424 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a6347a-6262-4fd9-818c-8dc713569f2a tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:00.319710 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a6347a-6262-4fd9-818c-8dc713569f2a tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:00.319984 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a6347a-6262-4fd9-818c-8dc713569f2a tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:00.320853 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a6347a-6262-4fd9-818c-8dc713569f2a tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] RBAC: Adding query filter params (scope.project.id=b361f85d00854f22bb558168b9aabefc, user.id=dcf1a072a2464a988f44645c67bff6b3) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:28:00.321332 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a6347a-6262-4fd9-818c-8dc713569f2a tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:00.323292 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a6347a-6262-4fd9-818c-8dc713569f2a tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:00.371530 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:28:00.401606 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2119/4252] 10.222.0.17 () {58 vars in 1355 bytes} [Sat Jul 23 21:28:00 2022] GET /identity/v3/role_assignments?scope.project.id=b361f85d00854f22bb558168b9aabefc&user.id=dcf1a072a2464a988f44645c67bff6b3&effective => generated 228 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 21:28:00.405789 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0fc9c2-9956-4761-8e55-8f48005a8cfc tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:00.412349 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a6347a-6262-4fd9-818c-8dc713569f2a tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:00.417995 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-a3a6347a-6262-4fd9-818c-8dc713569f2a tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:00.428987 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0fc9c2-9956-4761-8e55-8f48005a8cfc tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:00.446544 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c718194-70fe-4ba4-94df-8997e5d5da8b tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1994743b2e3c4725aa7e03519b6ab39e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0caeaf3c9e947b9aefe9b449d31c2ea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:00.447734 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c718194-70fe-4ba4-94df-8997e5d5da8b tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:00.449260 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c718194-70fe-4ba4-94df-8997e5d5da8b tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:00.449521 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c718194-70fe-4ba4-94df-8997e5d5da8b tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:00.450787 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c718194-70fe-4ba4-94df-8997e5d5da8b tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] RBAC: Adding query filter params (scope.project.id=f1e5a42e625140b0bc729eea4b393f20, user.id=dcf1a072a2464a988f44645c67bff6b3) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:28:00.451000 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c718194-70fe-4ba4-94df-8997e5d5da8b tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:00.466614 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c718194-70fe-4ba4-94df-8997e5d5da8b tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:00.607903 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2134/4253] 10.222.0.17 () {58 vars in 1355 bytes} [Sat Jul 23 21:28:00 2022] GET /identity/v3/role_assignments?scope.project.id=f1e5a42e625140b0bc729eea4b393f20&user.id=dcf1a072a2464a988f44645c67bff6b3&effective => generated 228 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:28:00.610049 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c718194-70fe-4ba4-94df-8997e5d5da8b tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:00.622362 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a6347a-6262-4fd9-818c-8dc713569f2a tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:00.634209 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c718194-70fe-4ba4-94df-8997e5d5da8b tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:00.636236 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daabbaa-ec52-4045-81a0-c9d11ff687c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:00.638403 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daabbaa-ec52-4045-81a0-c9d11ff687c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:00.638970 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daabbaa-ec52-4045-81a0-c9d11ff687c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:00.639431 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daabbaa-ec52-4045-81a0-c9d11ff687c0 admin admin] PATH_INFO: `/v3/projects/07fa13edc0a74c7e9766e6976fcbbb2c` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:00.645511 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7269d9e-c7e8-4c1e-962c-e8188723d2ec tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1994743b2e3c4725aa7e03519b6ab39e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0caeaf3c9e947b9aefe9b449d31c2ea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:00.646560 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daabbaa-ec52-4045-81a0-c9d11ff687c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07fa13edc0a74c7e9766e6976fcbbb2c)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:00.647219 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7269d9e-c7e8-4c1e-962c-e8188723d2ec tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:00.647564 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7269d9e-c7e8-4c1e-962c-e8188723d2ec tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:00.647904 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7269d9e-c7e8-4c1e-962c-e8188723d2ec tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] PATH_INFO: `/v3/projects/f1e5a42e625140b0bc729eea4b393f20` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:00.649498 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daabbaa-ec52-4045-81a0-c9d11ff687c0 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:00.649992 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7269d9e-c7e8-4c1e-962c-e8188723d2ec tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f1e5a42e625140b0bc729eea4b393f20)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:00.652141 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7269d9e-c7e8-4c1e-962c-e8188723d2ec tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:00.760103 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-e7269d9e-c7e8-4c1e-962c-e8188723d2ec tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1e5a42e625140b0bc729eea4b393f20', 'request_id': 'req-e7269d9e-c7e8-4c1e-962c-e8188723d2ec'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:00.777851 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-e7269d9e-c7e8-4c1e-962c-e8188723d2ec tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1e5a42e625140b0bc729eea4b393f20', 'request_id': 'req-e7269d9e-c7e8-4c1e-962c-e8188723d2ec'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:00.782269 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-8daabbaa-ec52-4045-81a0-c9d11ff687c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07fa13edc0a74c7e9766e6976fcbbb2c', 'request_id': 'req-8daabbaa-ec52-4045-81a0-c9d11ff687c0'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:00.788878 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-e7269d9e-c7e8-4c1e-962c-e8188723d2ec tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1e5a42e625140b0bc729eea4b393f20', 'request_id': 'req-e7269d9e-c7e8-4c1e-962c-e8188723d2ec'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:00.800007 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-8daabbaa-ec52-4045-81a0-c9d11ff687c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07fa13edc0a74c7e9766e6976fcbbb2c', 'request_id': 'req-8daabbaa-ec52-4045-81a0-c9d11ff687c0'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:00.812726 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-e7269d9e-c7e8-4c1e-962c-e8188723d2ec tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] The token cache is being invalidate because project f1e5a42e625140b0bc729eea4b393f20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:28:00.813038 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-e7269d9e-c7e8-4c1e-962c-e8188723d2ec tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:00.814242 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-8daabbaa-ec52-4045-81a0-c9d11ff687c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07fa13edc0a74c7e9766e6976fcbbb2c', 'request_id': 'req-8daabbaa-ec52-4045-81a0-c9d11ff687c0'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:00.816246 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-e7269d9e-c7e8-4c1e-962c-e8188723d2ec tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:00.822961 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2135/4254] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:28:00 2022] DELETE /identity/v3/projects/f1e5a42e625140b0bc729eea4b393f20 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:28:00.828974 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7269d9e-c7e8-4c1e-962c-e8188723d2ec tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:00.832336 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-e7269d9e-c7e8-4c1e-962c-e8188723d2ec tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:00.843478 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-8daabbaa-ec52-4045-81a0-c9d11ff687c0 admin admin] The token cache is being invalidate because project 07fa13edc0a74c7e9766e6976fcbbb2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:28:00.843893 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-8daabbaa-ec52-4045-81a0-c9d11ff687c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:00.845855 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-8daabbaa-ec52-4045-81a0-c9d11ff687c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:00.852568 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2120/4255] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:28:00 2022] DELETE /identity/v3/projects/07fa13edc0a74c7e9766e6976fcbbb2c => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:28:00.856595 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daabbaa-ec52-4045-81a0-c9d11ff687c0 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:00.859423 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-8daabbaa-ec52-4045-81a0-c9d11ff687c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:00.913359 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:28:00.979127 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7269d9e-c7e8-4c1e-962c-e8188723d2ec tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:01.011292 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daabbaa-ec52-4045-81a0-c9d11ff687c0 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:01.026457 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55eb302-5c7b-4544-8eba-c5c9a4ecde4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:01.027377 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55eb302-5c7b-4544-8eba-c5c9a4ecde4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:01.027645 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55eb302-5c7b-4544-8eba-c5c9a4ecde4e admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:01.027975 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55eb302-5c7b-4544-8eba-c5c9a4ecde4e admin admin] PATH_INFO: `/v3/users/a66f5ac0d2ed4898b2889a49b35385ff` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:01.029926 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55eb302-5c7b-4544-8eba-c5c9a4ecde4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a66f5ac0d2ed4898b2889a49b35385ff)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:01.032540 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55eb302-5c7b-4544-8eba-c5c9a4ecde4e admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:01.068069 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:28:01.133565 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-b55eb302-5c7b-4544-8eba-c5c9a4ecde4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a66f5ac0d2ed4898b2889a49b35385ff'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:01.138337 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-b55eb302-5c7b-4544-8eba-c5c9a4ecde4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a66f5ac0d2ed4898b2889a49b35385ff'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:01.151189 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ae8562-da03-4c08-8286-a905a8adb308 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1994743b2e3c4725aa7e03519b6ab39e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0caeaf3c9e947b9aefe9b449d31c2ea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:01.152295 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ae8562-da03-4c08-8286-a905a8adb308 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:01.153709 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ae8562-da03-4c08-8286-a905a8adb308 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:01.154262 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ae8562-da03-4c08-8286-a905a8adb308 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] PATH_INFO: `/v3/roles/4850dec6393e43ff981979b59aa6a9be` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:01.154900 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-b55eb302-5c7b-4544-8eba-c5c9a4ecde4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a66f5ac0d2ed4898b2889a49b35385ff'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:01.162060 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ae8562-da03-4c08-8286-a905a8adb308 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] RBAC: Authorizing `identity:delete_role(role_id=4850dec6393e43ff981979b59aa6a9be)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:01.169434 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ae8562-da03-4c08-8286-a905a8adb308 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:01.185258 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-b55eb302-5c7b-4544-8eba-c5c9a4ecde4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a66f5ac0d2ed4898b2889a49b35385ff'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:01.221778 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-b55eb302-5c7b-4544-8eba-c5c9a4ecde4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a66f5ac0d2ed4898b2889a49b35385ff'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:01.248071 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2121/4256] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:28:00 2022] DELETE /identity/v3/users/a66f5ac0d2ed4898b2889a49b35385ff => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:28:01.264559 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-53ae8562-da03-4c08-8286-a905a8adb308 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Invalidating the token cache because role 4850dec6393e43ff981979b59aa6a9be has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:28:01.264991 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-53ae8562-da03-4c08-8286-a905a8adb308 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:01.266046 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-53ae8562-da03-4c08-8286-a905a8adb308 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:01.273562 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55eb302-5c7b-4544-8eba-c5c9a4ecde4e admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:01.276569 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2136/4257] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:28:00 2022] DELETE /identity/v3/roles/4850dec6393e43ff981979b59aa6a9be => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:28:01.277039 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-b55eb302-5c7b-4544-8eba-c5c9a4ecde4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:01.449893 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55eb302-5c7b-4544-8eba-c5c9a4ecde4e admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:01.609776 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455fdc24-8c7c-4c5a-87b7-ba0fa2b8a3d2 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1994743b2e3c4725aa7e03519b6ab39e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0caeaf3c9e947b9aefe9b449d31c2ea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:01.612537 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455fdc24-8c7c-4c5a-87b7-ba0fa2b8a3d2 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:01.613541 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455fdc24-8c7c-4c5a-87b7-ba0fa2b8a3d2 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:01.613831 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455fdc24-8c7c-4c5a-87b7-ba0fa2b8a3d2 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:01.614634 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455fdc24-8c7c-4c5a-87b7-ba0fa2b8a3d2 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:01.616288 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455fdc24-8c7c-4c5a-87b7-ba0fa2b8a3d2 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:01.655497 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2122/4258] 10.222.0.17 () {60 vars in 1142 bytes} [Sat Jul 23 21:28:01 2022] POST /identity/v3/roles => generated 239 bytes in 382 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:28:01.659795 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ae8562-da03-4c08-8286-a905a8adb308 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:01.661294 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-53ae8562-da03-4c08-8286-a905a8adb308 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:01.681269 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ae8562-da03-4c08-8286-a905a8adb308 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:01.700254 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c6ee85-3990-434b-ac19-5f42446e2223 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1994743b2e3c4725aa7e03519b6ab39e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0caeaf3c9e947b9aefe9b449d31c2ea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:01.701058 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c6ee85-3990-434b-ac19-5f42446e2223 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:01.701409 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c6ee85-3990-434b-ac19-5f42446e2223 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:01.701749 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c6ee85-3990-434b-ac19-5f42446e2223 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:01.702729 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c6ee85-3990-434b-ac19-5f42446e2223 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:01.707735 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c6ee85-3990-434b-ac19-5f42446e2223 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:01.746237 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455fdc24-8c7c-4c5a-87b7-ba0fa2b8a3d2 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:01.748765 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-455fdc24-8c7c-4c5a-87b7-ba0fa2b8a3d2 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:01.797554 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2137/4259] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:28:01 2022] POST /identity/v3/projects => generated 408 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:28:01.805097 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c6ee85-3990-434b-ac19-5f42446e2223 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:01.861889 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:28:01.893342 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455fdc24-8c7c-4c5a-87b7-ba0fa2b8a3d2 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:01.903682 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c6ee85-3990-434b-ac19-5f42446e2223 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:01.909327 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08843f61-5a1c-4619-ae9f-67f094894a7f tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1994743b2e3c4725aa7e03519b6ab39e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0caeaf3c9e947b9aefe9b449d31c2ea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:01.910571 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08843f61-5a1c-4619-ae9f-67f094894a7f tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:01.910934 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08843f61-5a1c-4619-ae9f-67f094894a7f tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:01.911215 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08843f61-5a1c-4619-ae9f-67f094894a7f tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/b361f85d00854f22bb558168b9aabefc/users/dcf1a072a2464a988f44645c67bff6b3/roles/b34960eb6330482388ed993fc48be93c/inherited_to_projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:01.913665 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08843f61-5a1c-4619-ae9f-67f094894a7f tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] RBAC: Authorizing `identity:create_grant(project_id=b361f85d00854f22bb558168b9aabefc, user_id=dcf1a072a2464a988f44645c67bff6b3, role_id=b34960eb6330482388ed993fc48be93c)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:01.916935 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08843f61-5a1c-4619-ae9f-67f094894a7f tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:01.951306 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2138/4260] 10.222.0.17 () {60 vars in 1581 bytes} [Sat Jul 23 21:28:01 2022] PUT /identity/v3/OS-INHERIT/projects/b361f85d00854f22bb558168b9aabefc/users/dcf1a072a2464a988f44645c67bff6b3/roles/b34960eb6330482388ed993fc48be93c/inherited_to_projects => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:28:01.955725 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08843f61-5a1c-4619-ae9f-67f094894a7f tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:01.969332 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:28:02.044044 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08843f61-5a1c-4619-ae9f-67f094894a7f tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:02.050182 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dbe853-54e8-491f-b4ca-409b56deb5a7 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1994743b2e3c4725aa7e03519b6ab39e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0caeaf3c9e947b9aefe9b449d31c2ea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:02.051263 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dbe853-54e8-491f-b4ca-409b56deb5a7 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:02.051776 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dbe853-54e8-491f-b4ca-409b56deb5a7 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:02.052170 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dbe853-54e8-491f-b4ca-409b56deb5a7 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:02.053133 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dbe853-54e8-491f-b4ca-409b56deb5a7 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] RBAC: Adding query filter params (scope.project.id=c29844f431ec45928a8322574462f2d1, user.id=dcf1a072a2464a988f44645c67bff6b3) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:28:02.053616 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dbe853-54e8-491f-b4ca-409b56deb5a7 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:02.056474 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dbe853-54e8-491f-b4ca-409b56deb5a7 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:02.062198 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c12814f-5d67-45ad-837f-409c25b742c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:02.063982 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c12814f-5d67-45ad-837f-409c25b742c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:02.064433 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c12814f-5d67-45ad-837f-409c25b742c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:02.064883 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c12814f-5d67-45ad-837f-409c25b742c1 admin admin] PATH_INFO: `/v3/projects/7da3ad75853744c2a08043bc7b7fd4f0` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:02.067131 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c12814f-5d67-45ad-837f-409c25b742c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7da3ad75853744c2a08043bc7b7fd4f0)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:02.069233 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c12814f-5d67-45ad-837f-409c25b742c1 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:02.148174 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2139/4261] 10.222.0.17 () {58 vars in 1355 bytes} [Sat Jul 23 21:28:01 2022] GET /identity/v3/role_assignments?scope.project.id=c29844f431ec45928a8322574462f2d1&user.id=dcf1a072a2464a988f44645c67bff6b3&effective => generated 649 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:28:02.152157 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dbe853-54e8-491f-b4ca-409b56deb5a7 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:02.169888 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dbe853-54e8-491f-b4ca-409b56deb5a7 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:02.182293 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-8c12814f-5d67-45ad-837f-409c25b742c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7da3ad75853744c2a08043bc7b7fd4f0', 'request_id': 'req-8c12814f-5d67-45ad-837f-409c25b742c1'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:02.207798 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-8c12814f-5d67-45ad-837f-409c25b742c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7da3ad75853744c2a08043bc7b7fd4f0', 'request_id': 'req-8c12814f-5d67-45ad-837f-409c25b742c1'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:02.231510 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-8c12814f-5d67-45ad-837f-409c25b742c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7da3ad75853744c2a08043bc7b7fd4f0', 'request_id': 'req-8c12814f-5d67-45ad-837f-409c25b742c1'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:02.280416 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-8c12814f-5d67-45ad-837f-409c25b742c1 admin admin] The token cache is being invalidate because project 7da3ad75853744c2a08043bc7b7fd4f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:28:02.280797 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-8c12814f-5d67-45ad-837f-409c25b742c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:02.282306 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-8c12814f-5d67-45ad-837f-409c25b742c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:02.291800 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2123/4262] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:28:01 2022] DELETE /identity/v3/projects/7da3ad75853744c2a08043bc7b7fd4f0 => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:28:02.293476 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cc9dca-6a4d-4a46-92a3-63786af9fbe8 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:02.294061 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4359eb3e-d2f9-428e-a6a3-7c968aac11e3 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1994743b2e3c4725aa7e03519b6ab39e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0caeaf3c9e947b9aefe9b449d31c2ea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:02.294908 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4359eb3e-d2f9-428e-a6a3-7c968aac11e3 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:02.295186 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4359eb3e-d2f9-428e-a6a3-7c968aac11e3 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:02.295469 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4359eb3e-d2f9-428e-a6a3-7c968aac11e3 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/b361f85d00854f22bb558168b9aabefc/users/dcf1a072a2464a988f44645c67bff6b3/roles/b34960eb6330482388ed993fc48be93c/inherited_to_projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:02.295844 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cc9dca-6a4d-4a46-92a3-63786af9fbe8 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:02.296548 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cc9dca-6a4d-4a46-92a3-63786af9fbe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:02.299618 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4359eb3e-d2f9-428e-a6a3-7c968aac11e3 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=b361f85d00854f22bb558168b9aabefc, user_id=dcf1a072a2464a988f44645c67bff6b3, role_id=b34960eb6330482388ed993fc48be93c)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:02.304356 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4359eb3e-d2f9-428e-a6a3-7c968aac11e3 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:02.312346 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-4359eb3e-d2f9-428e-a6a3-7c968aac11e3 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Invalidating the token cache because role b34960eb6330482388ed993fc48be93c was removed from user dcf1a072a2464a988f44645c67bff6b3 on project b361f85d00854f22bb558168b9aabefc. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:28:02.312647 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-4359eb3e-d2f9-428e-a6a3-7c968aac11e3 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:02.313364 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-4359eb3e-d2f9-428e-a6a3-7c968aac11e3 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:02.340004 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2140/4263] 10.222.0.17 () {58 vars in 1565 bytes} [Sat Jul 23 21:28:02 2022] DELETE /identity/v3/OS-INHERIT/projects/b361f85d00854f22bb558168b9aabefc/users/dcf1a072a2464a988f44645c67bff6b3/roles/b34960eb6330482388ed993fc48be93c/inherited_to_projects => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:28:02.340004 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4359eb3e-d2f9-428e-a6a3-7c968aac11e3 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:02.340004 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-4359eb3e-d2f9-428e-a6a3-7c968aac11e3 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:02.345743 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-c8cc9dca-6a4d-4a46-92a3-63786af9fbe8 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:28:02.347594 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-c8cc9dca-6a4d-4a46-92a3-63786af9fbe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:02.528133 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2124/4264] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:28:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:28:02.538657 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29731532-0864-4f12-a90b-dcf739b6219c None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:02.539063 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29731532-0864-4f12-a90b-dcf739b6219c None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:02.539368 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29731532-0864-4f12-a90b-dcf739b6219c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:02.540769 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:28:02.568737 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-29731532-0864-4f12-a90b-dcf739b6219c None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:28:02.570198 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-29731532-0864-4f12-a90b-dcf739b6219c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:02.571802 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4359eb3e-d2f9-428e-a6a3-7c968aac11e3 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:02.579264 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2125/4265] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:28:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:28:02.583680 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29731532-0864-4f12-a90b-dcf739b6219c None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:02.584141 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ccce57-13f3-4a1d-9bb5-9ec2bfec8d44 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1994743b2e3c4725aa7e03519b6ab39e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0caeaf3c9e947b9aefe9b449d31c2ea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:02.585014 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ccce57-13f3-4a1d-9bb5-9ec2bfec8d44 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:02.585395 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ccce57-13f3-4a1d-9bb5-9ec2bfec8d44 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:02.585854 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ccce57-13f3-4a1d-9bb5-9ec2bfec8d44 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:02.586808 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ccce57-13f3-4a1d-9bb5-9ec2bfec8d44 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] RBAC: Adding query filter params (scope.project.id=c29844f431ec45928a8322574462f2d1, user.id=dcf1a072a2464a988f44645c67bff6b3) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:28:02.587287 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ccce57-13f3-4a1d-9bb5-9ec2bfec8d44 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:02.589869 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ccce57-13f3-4a1d-9bb5-9ec2bfec8d44 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:02.593758 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29731532-0864-4f12-a90b-dcf739b6219c None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:02.599377 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c571e9ea-9d52-4807-bcd1-b249e63d8304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:02.600078 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c571e9ea-9d52-4807-bcd1-b249e63d8304 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:02.600342 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c571e9ea-9d52-4807-bcd1-b249e63d8304 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:02.601109 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c571e9ea-9d52-4807-bcd1-b249e63d8304 admin admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:02.601896 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c571e9ea-9d52-4807-bcd1-b249e63d8304 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:28:02.602408 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c571e9ea-9d52-4807-bcd1-b249e63d8304 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:02.605933 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c571e9ea-9d52-4807-bcd1-b249e63d8304 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:02.619760 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:28:02.624270 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2126/4266] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:28:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:28:02.629913 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c571e9ea-9d52-4807-bcd1-b249e63d8304 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:02.654856 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c571e9ea-9d52-4807-bcd1-b249e63d8304 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:02.662101 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d535a6-faca-49ed-8420-ff3443a27977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:02.663762 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d535a6-faca-49ed-8420-ff3443a27977 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:02.664116 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d535a6-faca-49ed-8420-ff3443a27977 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:02.665456 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d535a6-faca-49ed-8420-ff3443a27977 admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:02.666598 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d535a6-faca-49ed-8420-ff3443a27977 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:02.668956 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d535a6-faca-49ed-8420-ff3443a27977 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:02.732444 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2141/4267] 10.222.0.17 () {58 vars in 1355 bytes} [Sat Jul 23 21:28:02 2022] GET /identity/v3/role_assignments?scope.project.id=c29844f431ec45928a8322574462f2d1&user.id=dcf1a072a2464a988f44645c67bff6b3&effective => generated 228 bytes in 395 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:28:02.733226 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2127/4268] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:28:02 2022] POST /identity/v3/projects => generated 371 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:28:02.733756 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ccce57-13f3-4a1d-9bb5-9ec2bfec8d44 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:02.734174 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d535a6-faca-49ed-8420-ff3443a27977 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:02.759226 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ccce57-13f3-4a1d-9bb5-9ec2bfec8d44 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:02.814363 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d535a6-faca-49ed-8420-ff3443a27977 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:02.821266 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89266269-0ca0-4de6-a141-a395c7a2654b tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1994743b2e3c4725aa7e03519b6ab39e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0caeaf3c9e947b9aefe9b449d31c2ea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:02.822911 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89266269-0ca0-4de6-a141-a395c7a2654b tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:02.822911 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89266269-0ca0-4de6-a141-a395c7a2654b tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:02.823129 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89266269-0ca0-4de6-a141-a395c7a2654b tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] PATH_INFO: `/v3/projects/c29844f431ec45928a8322574462f2d1` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:02.825003 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89266269-0ca0-4de6-a141-a395c7a2654b tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] RBAC: Authorizing `identity:delete_project(project_id=c29844f431ec45928a8322574462f2d1)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:02.829942 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89266269-0ca0-4de6-a141-a395c7a2654b tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:02.851039 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfaadfd-0059-4a38-9078-45586369ce54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:02.851907 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfaadfd-0059-4a38-9078-45586369ce54 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:02.852289 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfaadfd-0059-4a38-9078-45586369ce54 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:02.852661 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfaadfd-0059-4a38-9078-45586369ce54 admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:02.853836 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfaadfd-0059-4a38-9078-45586369ce54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:02.856368 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfaadfd-0059-4a38-9078-45586369ce54 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:02.887954 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2142/4269] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:28:02 2022] POST /identity/v3/users => generated 286 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:28:02.891739 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfaadfd-0059-4a38-9078-45586369ce54 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:02.907074 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfaadfd-0059-4a38-9078-45586369ce54 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:02.907391 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-89266269-0ca0-4de6-a141-a395c7a2654b tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c29844f431ec45928a8322574462f2d1', 'request_id': 'req-89266269-0ca0-4de6-a141-a395c7a2654b'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:02.921990 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-89266269-0ca0-4de6-a141-a395c7a2654b tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c29844f431ec45928a8322574462f2d1', 'request_id': 'req-89266269-0ca0-4de6-a141-a395c7a2654b'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:02.931591 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-89266269-0ca0-4de6-a141-a395c7a2654b tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c29844f431ec45928a8322574462f2d1', 'request_id': 'req-89266269-0ca0-4de6-a141-a395c7a2654b'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:02.948282 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-89266269-0ca0-4de6-a141-a395c7a2654b tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] The token cache is being invalidate because project c29844f431ec45928a8322574462f2d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:28:02.948556 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-89266269-0ca0-4de6-a141-a395c7a2654b tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:02.949932 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-89266269-0ca0-4de6-a141-a395c7a2654b tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:02.951643 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2128/4270] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:28:02 2022] DELETE /identity/v3/projects/c29844f431ec45928a8322574462f2d1 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:28:02.956543 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89266269-0ca0-4de6-a141-a395c7a2654b tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:02.958536 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-89266269-0ca0-4de6-a141-a395c7a2654b tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:03.000716 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091719db-a851-4104-92ba-e7573c680d69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:03.001547 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091719db-a851-4104-92ba-e7573c680d69 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:03.001839 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091719db-a851-4104-92ba-e7573c680d69 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:03.002346 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091719db-a851-4104-92ba-e7573c680d69 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:03.003547 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091719db-a851-4104-92ba-e7573c680d69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:03.005548 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091719db-a851-4104-92ba-e7573c680d69 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:03.021564 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2143/4271] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:28:02 2022] GET /identity/v3/roles => generated 1650 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:28:03.025475 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091719db-a851-4104-92ba-e7573c680d69 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:03.027351 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-091719db-a851-4104-92ba-e7573c680d69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:03.039705 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89266269-0ca0-4de6-a141-a395c7a2654b tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:03.042990 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091719db-a851-4104-92ba-e7573c680d69 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:03.046096 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d2b50c-ed47-4f61-8b92-c2cc9ad08a42 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1994743b2e3c4725aa7e03519b6ab39e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0caeaf3c9e947b9aefe9b449d31c2ea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:03.047397 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d2b50c-ed47-4f61-8b92-c2cc9ad08a42 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:03.047900 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d2b50c-ed47-4f61-8b92-c2cc9ad08a42 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:03.048394 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d2b50c-ed47-4f61-8b92-c2cc9ad08a42 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] PATH_INFO: `/v3/roles/b34960eb6330482388ed993fc48be93c` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:03.049449 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03c9aa6-8fbb-42d8-a00c-e31973bbc319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:03.050353 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d2b50c-ed47-4f61-8b92-c2cc9ad08a42 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] RBAC: Authorizing `identity:delete_role(role_id=b34960eb6330482388ed993fc48be93c)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:03.050571 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03c9aa6-8fbb-42d8-a00c-e31973bbc319 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:03.050961 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03c9aa6-8fbb-42d8-a00c-e31973bbc319 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:03.051577 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03c9aa6-8fbb-42d8-a00c-e31973bbc319 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:03.052415 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03c9aa6-8fbb-42d8-a00c-e31973bbc319 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:03.052842 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d2b50c-ed47-4f61-8b92-c2cc9ad08a42 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:03.056250 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03c9aa6-8fbb-42d8-a00c-e31973bbc319 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:03.071125 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:28:03.079576 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2144/4272] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:28:03 2022] GET /identity/v3/roles => generated 1650 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:28:03.082096 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03c9aa6-8fbb-42d8-a00c-e31973bbc319 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:03.104315 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03c9aa6-8fbb-42d8-a00c-e31973bbc319 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:03.112085 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac78e8e-39c3-4616-8122-8f5a35e2e003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:03.113603 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac78e8e-39c3-4616-8122-8f5a35e2e003 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:03.113904 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac78e8e-39c3-4616-8122-8f5a35e2e003 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:03.114182 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac78e8e-39c3-4616-8122-8f5a35e2e003 admin admin] PATH_INFO: `/v3/projects/de080b6258924a4ea42e954e634692bb/users/3c9db4feb1c4442fa8f58ee69b645623/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:03.124518 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-53d2b50c-ed47-4f61-8b92-c2cc9ad08a42 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Invalidating the token cache because role b34960eb6330482388ed993fc48be93c has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:28:03.124811 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-53d2b50c-ed47-4f61-8b92-c2cc9ad08a42 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:03.125571 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-53d2b50c-ed47-4f61-8b92-c2cc9ad08a42 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:03.127649 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2129/4273] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:28:02 2022] DELETE /identity/v3/roles/b34960eb6330482388ed993fc48be93c => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:28:03.134325 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d2b50c-ed47-4f61-8b92-c2cc9ad08a42 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:03.138145 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-53d2b50c-ed47-4f61-8b92-c2cc9ad08a42 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:03.153215 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac78e8e-39c3-4616-8122-8f5a35e2e003 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de080b6258924a4ea42e954e634692bb, user_id=3c9db4feb1c4442fa8f58ee69b645623, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:03.156760 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac78e8e-39c3-4616-8122-8f5a35e2e003 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:03.160949 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:28:03.191731 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2145/4274] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:28:03 2022] PUT /identity/v3/projects/de080b6258924a4ea42e954e634692bb/users/3c9db4feb1c4442fa8f58ee69b645623/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:28:03.194699 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c1b75a-7e16-4408-9fb6-dc30bba71462 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:03.194987 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c1b75a-7e16-4408-9fb6-dc30bba71462 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:03.195279 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c1b75a-7e16-4408-9fb6-dc30bba71462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:03.267601 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d2b50c-ed47-4f61-8b92-c2cc9ad08a42 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:03.278782 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-15c1b75a-7e16-4408-9fb6-dc30bba71462 None None] MFA Rules not processed for user `3c9db4feb1c4442fa8f58ee69b645623`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:28:03.280463 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-15c1b75a-7e16-4408-9fb6-dc30bba71462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:03.455053 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2807badc-aa85-49c0-a90b-5571ed5937a1 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1994743b2e3c4725aa7e03519b6ab39e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0caeaf3c9e947b9aefe9b449d31c2ea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:03.458785 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2807badc-aa85-49c0-a90b-5571ed5937a1 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:03.459478 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2807badc-aa85-49c0-a90b-5571ed5937a1 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:03.459960 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2807badc-aa85-49c0-a90b-5571ed5937a1 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] PATH_INFO: `/v3/users/dcf1a072a2464a988f44645c67bff6b3` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:03.462858 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2807badc-aa85-49c0-a90b-5571ed5937a1 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] RBAC: Authorizing `identity:delete_user(user_id=dcf1a072a2464a988f44645c67bff6b3)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:03.469515 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2807badc-aa85-49c0-a90b-5571ed5937a1 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:03.483558 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2146/4275] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:28:03 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:28:03.485784 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c1b75a-7e16-4408-9fb6-dc30bba71462 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:03.487254 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-15c1b75a-7e16-4408-9fb6-dc30bba71462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:03.561325 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c1b75a-7e16-4408-9fb6-dc30bba71462 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:03.566521 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5322ce51-2727-4bd9-9193-4a35056319ed service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7f2db148c8e4d5d81431cae3576434b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:03.567385 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5322ce51-2727-4bd9-9193-4a35056319ed service glance] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:03.567672 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5322ce51-2727-4bd9-9193-4a35056319ed service glance] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:03.567934 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5322ce51-2727-4bd9-9193-4a35056319ed service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:03.576175 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-2807badc-aa85-49c0-a90b-5571ed5937a1 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dcf1a072a2464a988f44645c67bff6b3'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:03.577406 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-2807badc-aa85-49c0-a90b-5571ed5937a1 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dcf1a072a2464a988f44645c67bff6b3'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:03.579893 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5322ce51-2727-4bd9-9193-4a35056319ed service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:03.582353 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5322ce51-2727-4bd9-9193-4a35056319ed service glance] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:03.595200 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2147/4276] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:28:03 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:28:03.595886 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-2807badc-aa85-49c0-a90b-5571ed5937a1 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dcf1a072a2464a988f44645c67bff6b3'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:03.638759 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-2807badc-aa85-49c0-a90b-5571ed5937a1 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dcf1a072a2464a988f44645c67bff6b3'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:03.687984 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-2807badc-aa85-49c0-a90b-5571ed5937a1 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dcf1a072a2464a988f44645c67bff6b3'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:03.697105 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:28:03.705771 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2130/4277] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:28:03 2022] DELETE /identity/v3/users/dcf1a072a2464a988f44645c67bff6b3 => generated 0 bytes in 572 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:28:03.709681 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5322ce51-2727-4bd9-9193-4a35056319ed service glance] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:03.726739 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5322ce51-2727-4bd9-9193-4a35056319ed service glance] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:03.888614 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aa18d8-2aff-4ffe-964b-c8faadc72ef6 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1994743b2e3c4725aa7e03519b6ab39e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0caeaf3c9e947b9aefe9b449d31c2ea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:03.889721 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aa18d8-2aff-4ffe-964b-c8faadc72ef6 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:03.890567 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aa18d8-2aff-4ffe-964b-c8faadc72ef6 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:03.890848 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aa18d8-2aff-4ffe-964b-c8faadc72ef6 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] PATH_INFO: `/v3/groups/cf24d34665664f94a7566ff7eed31c14` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:03.894165 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3aa18d8-2aff-4ffe-964b-c8faadc72ef6 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] RBAC: Authorizing `identity:delete_group(group_id=cf24d34665664f94a7566ff7eed31c14)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:03.896196 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3aa18d8-2aff-4ffe-964b-c8faadc72ef6 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:03.968235 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:28:03.993840 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2148/4278] 10.222.0.17 () {58 vars in 1226 bytes} [Sat Jul 23 21:28:03 2022] DELETE /identity/v3/groups/cf24d34665664f94a7566ff7eed31c14 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:28:03.997770 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2807badc-aa85-49c0-a90b-5571ed5937a1 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:03.999564 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-2807badc-aa85-49c0-a90b-5571ed5937a1 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:04.022096 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2807badc-aa85-49c0-a90b-5571ed5937a1 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:04.141042 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b58060-16d3-4429-80ed-57ba4ea7d1d4 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1994743b2e3c4725aa7e03519b6ab39e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0caeaf3c9e947b9aefe9b449d31c2ea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:04.142134 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b58060-16d3-4429-80ed-57ba4ea7d1d4 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:04.142257 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b58060-16d3-4429-80ed-57ba4ea7d1d4 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:04.142585 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b58060-16d3-4429-80ed-57ba4ea7d1d4 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] PATH_INFO: `/v3/projects/b361f85d00854f22bb558168b9aabefc` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:04.144341 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b58060-16d3-4429-80ed-57ba4ea7d1d4 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b361f85d00854f22bb558168b9aabefc)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:04.146412 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b58060-16d3-4429-80ed-57ba4ea7d1d4 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:04.293587 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-30b58060-16d3-4429-80ed-57ba4ea7d1d4 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b361f85d00854f22bb558168b9aabefc', 'request_id': 'req-30b58060-16d3-4429-80ed-57ba4ea7d1d4'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:04.309027 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-30b58060-16d3-4429-80ed-57ba4ea7d1d4 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b361f85d00854f22bb558168b9aabefc', 'request_id': 'req-30b58060-16d3-4429-80ed-57ba4ea7d1d4'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:04.321727 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-30b58060-16d3-4429-80ed-57ba4ea7d1d4 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b361f85d00854f22bb558168b9aabefc', 'request_id': 'req-30b58060-16d3-4429-80ed-57ba4ea7d1d4'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:04.338680 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-30b58060-16d3-4429-80ed-57ba4ea7d1d4 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] The token cache is being invalidate because project b361f85d00854f22bb558168b9aabefc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:28:04.339540 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-30b58060-16d3-4429-80ed-57ba4ea7d1d4 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:04.341564 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-30b58060-16d3-4429-80ed-57ba4ea7d1d4 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:04.348361 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aa18d8-2aff-4ffe-964b-c8faadc72ef6 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:04.349311 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2131/4279] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:28:03 2022] DELETE /identity/v3/projects/b361f85d00854f22bb558168b9aabefc => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:28:04.350148 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-a3aa18d8-2aff-4ffe-964b-c8faadc72ef6 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:04.373187 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aa18d8-2aff-4ffe-964b-c8faadc72ef6 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:04.465425 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951d3955-5f88-4321-b12d-f6119d53c5dd tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1994743b2e3c4725aa7e03519b6ab39e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0caeaf3c9e947b9aefe9b449d31c2ea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:04.466442 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951d3955-5f88-4321-b12d-f6119d53c5dd tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:04.466863 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951d3955-5f88-4321-b12d-f6119d53c5dd tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:04.467306 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951d3955-5f88-4321-b12d-f6119d53c5dd tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] PATH_INFO: `/v3/domains/7a0e7ceb30ff4beca0430509ee04a8b8` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:04.468798 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951d3955-5f88-4321-b12d-f6119d53c5dd tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=7a0e7ceb30ff4beca0430509ee04a8b8)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:04.470608 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951d3955-5f88-4321-b12d-f6119d53c5dd tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:04.503675 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-951d3955-5f88-4321-b12d-f6119d53c5dd tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '7a0e7ceb30ff4beca0430509ee04a8b8'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:04.508048 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-951d3955-5f88-4321-b12d-f6119d53c5dd tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '7a0e7ceb30ff4beca0430509ee04a8b8'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:04.554111 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-951d3955-5f88-4321-b12d-f6119d53c5dd tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '7a0e7ceb30ff4beca0430509ee04a8b8'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:04.555069 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-951d3955-5f88-4321-b12d-f6119d53c5dd tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '7a0e7ceb30ff4beca0430509ee04a8b8'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:04.561671 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2149/4280] 10.222.0.17 () {60 vars in 1248 bytes} [Sat Jul 23 21:28:04 2022] PATCH /identity/v3/domains/7a0e7ceb30ff4beca0430509ee04a8b8 => generated 278 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 21:28:04.565204 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b58060-16d3-4429-80ed-57ba4ea7d1d4 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:04.580439 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b58060-16d3-4429-80ed-57ba4ea7d1d4 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:04.634206 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951d3955-5f88-4321-b12d-f6119d53c5dd tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:04.635698 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-951d3955-5f88-4321-b12d-f6119d53c5dd tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:04.709257 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a44095-5ced-4269-809a-2e039788fd95 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1994743b2e3c4725aa7e03519b6ab39e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0caeaf3c9e947b9aefe9b449d31c2ea', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:04.710753 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a44095-5ced-4269-809a-2e039788fd95 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:04.712198 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a44095-5ced-4269-809a-2e039788fd95 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:04.713126 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a44095-5ced-4269-809a-2e039788fd95 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] PATH_INFO: `/v3/domains/7a0e7ceb30ff4beca0430509ee04a8b8` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:04.739953 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a44095-5ced-4269-809a-2e039788fd95 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=7a0e7ceb30ff4beca0430509ee04a8b8)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:04.741953 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a44095-5ced-4269-809a-2e039788fd95 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:04.744998 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951d3955-5f88-4321-b12d-f6119d53c5dd tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:04.751253 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecd7a1f-8319-4120-b972-4b70aeea1a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:04.752197 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecd7a1f-8319-4120-b972-4b70aeea1a25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:04.752484 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecd7a1f-8319-4120-b972-4b70aeea1a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:04.752789 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecd7a1f-8319-4120-b972-4b70aeea1a25 admin admin] PATH_INFO: `/v3/users/3c9db4feb1c4442fa8f58ee69b645623` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:04.754972 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecd7a1f-8319-4120-b972-4b70aeea1a25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c9db4feb1c4442fa8f58ee69b645623)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:04.758454 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecd7a1f-8319-4120-b972-4b70aeea1a25 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:04.775780 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-05a44095-5ced-4269-809a-2e039788fd95 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '7a0e7ceb30ff4beca0430509ee04a8b8'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:04.778575 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:28:04.793311 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-05a44095-5ced-4269-809a-2e039788fd95 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '7a0e7ceb30ff4beca0430509ee04a8b8'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:04.856559 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-3ecd7a1f-8319-4120-b972-4b70aeea1a25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c9db4feb1c4442fa8f58ee69b645623'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:04.867004 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:UPDATE=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:28:04.871591 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-3ecd7a1f-8319-4120-b972-4b70aeea1a25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c9db4feb1c4442fa8f58ee69b645623'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:04.873598 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-3ecd7a1f-8319-4120-b972-4b70aeea1a25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c9db4feb1c4442fa8f58ee69b645623'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:04.874992 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-05a44095-5ced-4269-809a-2e039788fd95 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a0e7ceb30ff4beca0430509ee04a8b8', 'request_id': 'req-05a44095-5ced-4269-809a-2e039788fd95'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:04.884566 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-05a44095-5ced-4269-809a-2e039788fd95 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a0e7ceb30ff4beca0430509ee04a8b8', 'request_id': 'req-05a44095-5ced-4269-809a-2e039788fd95'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:04.888237 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-3ecd7a1f-8319-4120-b972-4b70aeea1a25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c9db4feb1c4442fa8f58ee69b645623'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:04.891664 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-05a44095-5ced-4269-809a-2e039788fd95 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a0e7ceb30ff4beca0430509ee04a8b8', 'request_id': 'req-05a44095-5ced-4269-809a-2e039788fd95'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:04.902869 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-3ecd7a1f-8319-4120-b972-4b70aeea1a25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c9db4feb1c4442fa8f58ee69b645623'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:04.905662 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-05a44095-5ced-4269-809a-2e039788fd95 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] The token cache is being invalidate because project 7a0e7ceb30ff4beca0430509ee04a8b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:28:04.906089 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-05a44095-5ced-4269-809a-2e039788fd95 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:04.906806 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-05a44095-5ced-4269-809a-2e039788fd95 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:04.911767 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2150/4281] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:28:04 2022] DELETE /identity/v3/users/3c9db4feb1c4442fa8f58ee69b645623 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:28:04.914303 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8f6c87-b553-4d5b-a21f-7783444ef8cf None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:04.914652 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8f6c87-b553-4d5b-a21f-7783444ef8cf None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:04.914985 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8f6c87-b553-4d5b-a21f-7783444ef8cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:04.917385 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-05a44095-5ced-4269-809a-2e039788fd95 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '7a0e7ceb30ff4beca0430509ee04a8b8', 'request_id': 'req-05a44095-5ced-4269-809a-2e039788fd95'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:04.920866 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-05a44095-5ced-4269-809a-2e039788fd95 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '7a0e7ceb30ff4beca0430509ee04a8b8', 'request_id': 'req-05a44095-5ced-4269-809a-2e039788fd95'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:04.921553 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-05a44095-5ced-4269-809a-2e039788fd95 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '7a0e7ceb30ff4beca0430509ee04a8b8', 'request_id': 'req-05a44095-5ced-4269-809a-2e039788fd95'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:04.930387 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2132/4282] 10.222.0.17 () {58 vars in 1229 bytes} [Sat Jul 23 21:28:04 2022] DELETE /identity/v3/domains/7a0e7ceb30ff4beca0430509ee04a8b8 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:28:04.935624 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a44095-5ced-4269-809a-2e039788fd95 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:04.938292 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-ee8f6c87-b553-4d5b-a21f-7783444ef8cf None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:28:04.938695 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-05a44095-5ced-4269-809a-2e039788fd95 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:04.939502 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-ee8f6c87-b553-4d5b-a21f-7783444ef8cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:05.012211 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2151/4283] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:28:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:28:05.022417 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8f6c87-b553-4d5b-a21f-7783444ef8cf None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:05.023680 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a44095-5ced-4269-809a-2e039788fd95 tempest-InheritsV3TestJSON-417218701 tempest-InheritsV3TestJSON-417218701-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:05.023848 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-ee8f6c87-b553-4d5b-a21f-7783444ef8cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:05.028569 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c1eefe-79c4-48df-b4d7-1b8fae018044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:05.029712 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c1eefe-79c4-48df-b4d7-1b8fae018044 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:05.030032 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c1eefe-79c4-48df-b4d7-1b8fae018044 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:05.030310 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c1eefe-79c4-48df-b4d7-1b8fae018044 admin admin] PATH_INFO: `/v3/users/89bb90c8db5e4b59b11d46bcaa77ac53` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:05.031564 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c1eefe-79c4-48df-b4d7-1b8fae018044 admin admin] RBAC: Authorizing `identity:delete_user(user_id=89bb90c8db5e4b59b11d46bcaa77ac53)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:05.034379 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c1eefe-79c4-48df-b4d7-1b8fae018044 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:05.137353 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-60c1eefe-79c4-48df-b4d7-1b8fae018044 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89bb90c8db5e4b59b11d46bcaa77ac53'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:05.138777 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-60c1eefe-79c4-48df-b4d7-1b8fae018044 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89bb90c8db5e4b59b11d46bcaa77ac53'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:05.154813 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-60c1eefe-79c4-48df-b4d7-1b8fae018044 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89bb90c8db5e4b59b11d46bcaa77ac53'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:05.168764 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8f6c87-b553-4d5b-a21f-7783444ef8cf None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:05.173614 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-60c1eefe-79c4-48df-b4d7-1b8fae018044 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89bb90c8db5e4b59b11d46bcaa77ac53'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:05.177242 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad37218-c952-4c48-88e3-8f509335870b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:05.177963 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad37218-c952-4c48-88e3-8f509335870b service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:05.178234 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad37218-c952-4c48-88e3-8f509335870b service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:05.178508 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad37218-c952-4c48-88e3-8f509335870b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:05.185293 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:28:05.199400 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-60c1eefe-79c4-48df-b4d7-1b8fae018044 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89bb90c8db5e4b59b11d46bcaa77ac53'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:05.200740 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad37218-c952-4c48-88e3-8f509335870b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:05.202211 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad37218-c952-4c48-88e3-8f509335870b service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:05.220505 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2133/4284] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:28:04 2022] DELETE /identity/v3/users/89bb90c8db5e4b59b11d46bcaa77ac53 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:28:05.220505 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b19302-ce5b-45bf-964f-6b6f7bb8cc38 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:05.220505 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b19302-ce5b-45bf-964f-6b6f7bb8cc38 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:05.220505 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b19302-ce5b-45bf-964f-6b6f7bb8cc38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:05.230722 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2152/4285] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:28:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 23 21:28:05.245960 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-54b19302-ce5b-45bf-964f-6b6f7bb8cc38 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:28:05.247364 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-54b19302-ce5b-45bf-964f-6b6f7bb8cc38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:05.365942 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2134/4286] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:28:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:28:05.396751 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad37218-c952-4c48-88e3-8f509335870b service neutron] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:05.398429 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-fad37218-c952-4c48-88e3-8f509335870b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:05.420021 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad37218-c952-4c48-88e3-8f509335870b service neutron] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:05.539882 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd86ad4-be24-4839-8d82-c8f0cfc70165 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:05.540610 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd86ad4-be24-4839-8d82-c8f0cfc70165 service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:05.540890 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd86ad4-be24-4839-8d82-c8f0cfc70165 service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:05.541157 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd86ad4-be24-4839-8d82-c8f0cfc70165 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:05.585309 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd86ad4-be24-4839-8d82-c8f0cfc70165 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:05.586816 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd86ad4-be24-4839-8d82-c8f0cfc70165 service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:05.616260 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2153/4287] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:28:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:28:06.217584 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b19302-ce5b-45bf-964f-6b6f7bb8cc38 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:06.219115 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-54b19302-ce5b-45bf-964f-6b6f7bb8cc38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:06.224120 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd86ad4-be24-4839-8d82-c8f0cfc70165 service neutron] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:06.226385 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-9fd86ad4-be24-4839-8d82-c8f0cfc70165 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:06.247001 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b19302-ce5b-45bf-964f-6b6f7bb8cc38 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:06.249899 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd86ad4-be24-4839-8d82-c8f0cfc70165 service neutron] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:06.268869 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ef47ec-6095-4545-8272-5cb14ac815ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:06.269879 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ef47ec-6095-4545-8272-5cb14ac815ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:06.270435 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ef47ec-6095-4545-8272-5cb14ac815ee admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:06.270435 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ef47ec-6095-4545-8272-5cb14ac815ee admin admin] PATH_INFO: `/v3/users/6411b0f635714320a4f40e9bc5e260e5` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:06.271614 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e0088a-1432-46aa-a73f-106366965d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:06.272704 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e0088a-1432-46aa-a73f-106366965d7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:06.273174 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e0088a-1432-46aa-a73f-106366965d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:06.274208 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e0088a-1432-46aa-a73f-106366965d7b admin admin] PATH_INFO: `/v3/projects/de080b6258924a4ea42e954e634692bb` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:06.275633 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ef47ec-6095-4545-8272-5cb14ac815ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=6411b0f635714320a4f40e9bc5e260e5)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:06.276441 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e0088a-1432-46aa-a73f-106366965d7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=de080b6258924a4ea42e954e634692bb)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:06.278627 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ef47ec-6095-4545-8272-5cb14ac815ee admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:06.280751 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e0088a-1432-46aa-a73f-106366965d7b admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:06.309078 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:28:06.369956 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-28e0088a-1432-46aa-a73f-106366965d7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de080b6258924a4ea42e954e634692bb', 'request_id': 'req-28e0088a-1432-46aa-a73f-106366965d7b'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:06.379745 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-a8ef47ec-6095-4545-8272-5cb14ac815ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6411b0f635714320a4f40e9bc5e260e5'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:06.380410 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-a8ef47ec-6095-4545-8272-5cb14ac815ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6411b0f635714320a4f40e9bc5e260e5'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:06.380535 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-28e0088a-1432-46aa-a73f-106366965d7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de080b6258924a4ea42e954e634692bb', 'request_id': 'req-28e0088a-1432-46aa-a73f-106366965d7b'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:06.388184 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-28e0088a-1432-46aa-a73f-106366965d7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de080b6258924a4ea42e954e634692bb', 'request_id': 'req-28e0088a-1432-46aa-a73f-106366965d7b'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:06.391590 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-a8ef47ec-6095-4545-8272-5cb14ac815ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6411b0f635714320a4f40e9bc5e260e5'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:06.401330 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-28e0088a-1432-46aa-a73f-106366965d7b admin admin] The token cache is being invalidate because project de080b6258924a4ea42e954e634692bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:28:06.401711 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-28e0088a-1432-46aa-a73f-106366965d7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:06.402759 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-28e0088a-1432-46aa-a73f-106366965d7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:06.405176 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2154/4288] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:28:06 2022] DELETE /identity/v3/projects/de080b6258924a4ea42e954e634692bb => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:28:06.405712 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-a8ef47ec-6095-4545-8272-5cb14ac815ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6411b0f635714320a4f40e9bc5e260e5'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:06.407565 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e0088a-1432-46aa-a73f-106366965d7b admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:06.411150 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-28e0088a-1432-46aa-a73f-106366965d7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:06.423754 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-a8ef47ec-6095-4545-8272-5cb14ac815ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6411b0f635714320a4f40e9bc5e260e5'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:06.437237 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2135/4289] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:28:06 2022] DELETE /identity/v3/users/6411b0f635714320a4f40e9bc5e260e5 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:28:06.438663 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02810fd9-6e4e-4130-a00f-903fa6b429b0 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:06.438956 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02810fd9-6e4e-4130-a00f-903fa6b429b0 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:06.439787 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02810fd9-6e4e-4130-a00f-903fa6b429b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:06.465931 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-02810fd9-6e4e-4130-a00f-903fa6b429b0 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:28:06.467812 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-02810fd9-6e4e-4130-a00f-903fa6b429b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:06.489909 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e0088a-1432-46aa-a73f-106366965d7b admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:06.537245 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:28:06.570746 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29de5bf-c950-4e42-a5ff-9ee55d3aa97e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:06.571981 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29de5bf-c950-4e42-a5ff-9ee55d3aa97e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:06.572476 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29de5bf-c950-4e42-a5ff-9ee55d3aa97e admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:06.572964 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29de5bf-c950-4e42-a5ff-9ee55d3aa97e admin admin] PATH_INFO: `/v3/projects/3c63f96cf06a4fdaa6220d04f02bbd4c` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:06.574518 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29de5bf-c950-4e42-a5ff-9ee55d3aa97e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c63f96cf06a4fdaa6220d04f02bbd4c)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:06.574650 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2136/4290] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:28:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:28:06.577771 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29de5bf-c950-4e42-a5ff-9ee55d3aa97e admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:06.583229 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161bc42b-f05f-4272-9420-e03ef59132e1 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:06.583520 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161bc42b-f05f-4272-9420-e03ef59132e1 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:06.583801 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161bc42b-f05f-4272-9420-e03ef59132e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:06.619147 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-161bc42b-f05f-4272-9420-e03ef59132e1 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:28:06.620827 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-161bc42b-f05f-4272-9420-e03ef59132e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:06.637068 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2137/4291] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:28:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:28:06.644307 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161bc42b-f05f-4272-9420-e03ef59132e1 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:06.661971 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161bc42b-f05f-4272-9420-e03ef59132e1 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:06.664296 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-b29de5bf-c950-4e42-a5ff-9ee55d3aa97e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c63f96cf06a4fdaa6220d04f02bbd4c', 'request_id': 'req-b29de5bf-c950-4e42-a5ff-9ee55d3aa97e'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:06.667141 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:28:06.685410 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-b29de5bf-c950-4e42-a5ff-9ee55d3aa97e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c63f96cf06a4fdaa6220d04f02bbd4c', 'request_id': 'req-b29de5bf-c950-4e42-a5ff-9ee55d3aa97e'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:06.696354 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-b29de5bf-c950-4e42-a5ff-9ee55d3aa97e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c63f96cf06a4fdaa6220d04f02bbd4c', 'request_id': 'req-b29de5bf-c950-4e42-a5ff-9ee55d3aa97e'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:06.736273 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-b29de5bf-c950-4e42-a5ff-9ee55d3aa97e admin admin] The token cache is being invalidate because project 3c63f96cf06a4fdaa6220d04f02bbd4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:28:06.736484 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-b29de5bf-c950-4e42-a5ff-9ee55d3aa97e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:06.737407 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-b29de5bf-c950-4e42-a5ff-9ee55d3aa97e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:06.740040 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2155/4292] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:28:06 2022] DELETE /identity/v3/projects/3c63f96cf06a4fdaa6220d04f02bbd4c => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:28:06.740859 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29de5bf-c950-4e42-a5ff-9ee55d3aa97e admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:06.742264 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-b29de5bf-c950-4e42-a5ff-9ee55d3aa97e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:06.762059 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41384131-4e60-442f-90aa-e97dcfc6ac5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:06.763280 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41384131-4e60-442f-90aa-e97dcfc6ac5d admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:06.763970 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41384131-4e60-442f-90aa-e97dcfc6ac5d admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:06.764398 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41384131-4e60-442f-90aa-e97dcfc6ac5d admin admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:06.766646 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41384131-4e60-442f-90aa-e97dcfc6ac5d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:28:06.767171 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41384131-4e60-442f-90aa-e97dcfc6ac5d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:06.769570 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41384131-4e60-442f-90aa-e97dcfc6ac5d admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:06.790751 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2138/4293] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:28:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:28:06.790751 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41384131-4e60-442f-90aa-e97dcfc6ac5d admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:06.790751 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-41384131-4e60-442f-90aa-e97dcfc6ac5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:06.807525 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41384131-4e60-442f-90aa-e97dcfc6ac5d admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:06.812387 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ff4e15-3972-49a3-9982-02ae0c5a9ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:06.813240 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ff4e15-3972-49a3-9982-02ae0c5a9ecc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:06.813556 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ff4e15-3972-49a3-9982-02ae0c5a9ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:06.813839 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ff4e15-3972-49a3-9982-02ae0c5a9ecc admin admin] PATH_INFO: `/v3/users/1994743b2e3c4725aa7e03519b6ab39e` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:06.815076 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ff4e15-3972-49a3-9982-02ae0c5a9ecc admin admin] RBAC: Authorizing `identity:delete_user(user_id=1994743b2e3c4725aa7e03519b6ab39e)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:06.817283 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ff4e15-3972-49a3-9982-02ae0c5a9ecc admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:06.842681 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29de5bf-c950-4e42-a5ff-9ee55d3aa97e admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:06.847563 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f1c035-51f0-4632-9ca7-71d71635bb8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:06.848450 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f1c035-51f0-4632-9ca7-71d71635bb8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:06.848750 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f1c035-51f0-4632-9ca7-71d71635bb8a admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:06.849005 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f1c035-51f0-4632-9ca7-71d71635bb8a admin admin] PATH_INFO: `/v3/projects/0c005e3bc67b4501949fb72140726a11` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:06.850248 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f1c035-51f0-4632-9ca7-71d71635bb8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c005e3bc67b4501949fb72140726a11)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:06.852177 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f1c035-51f0-4632-9ca7-71d71635bb8a admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:06.880459 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-01ff4e15-3972-49a3-9982-02ae0c5a9ecc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1994743b2e3c4725aa7e03519b6ab39e'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:06.881318 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-01ff4e15-3972-49a3-9982-02ae0c5a9ecc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1994743b2e3c4725aa7e03519b6ab39e'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:06.889499 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-01ff4e15-3972-49a3-9982-02ae0c5a9ecc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1994743b2e3c4725aa7e03519b6ab39e'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:06.901536 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-01ff4e15-3972-49a3-9982-02ae0c5a9ecc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1994743b2e3c4725aa7e03519b6ab39e'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:06.909708 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-01f1c035-51f0-4632-9ca7-71d71635bb8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c005e3bc67b4501949fb72140726a11', 'request_id': 'req-01f1c035-51f0-4632-9ca7-71d71635bb8a'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:06.916100 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-01ff4e15-3972-49a3-9982-02ae0c5a9ecc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1994743b2e3c4725aa7e03519b6ab39e'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:06.919195 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-01f1c035-51f0-4632-9ca7-71d71635bb8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c005e3bc67b4501949fb72140726a11', 'request_id': 'req-01f1c035-51f0-4632-9ca7-71d71635bb8a'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:06.926336 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2139/4294] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:28:06 2022] DELETE /identity/v3/users/1994743b2e3c4725aa7e03519b6ab39e => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:28:06.926336 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ff4e15-3972-49a3-9982-02ae0c5a9ecc admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:06.926336 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-01ff4e15-3972-49a3-9982-02ae0c5a9ecc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:06.933410 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-01f1c035-51f0-4632-9ca7-71d71635bb8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c005e3bc67b4501949fb72140726a11', 'request_id': 'req-01f1c035-51f0-4632-9ca7-71d71635bb8a'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:06.955224 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-01f1c035-51f0-4632-9ca7-71d71635bb8a admin admin] The token cache is being invalidate because project 0c005e3bc67b4501949fb72140726a11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:28:06.955889 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-01f1c035-51f0-4632-9ca7-71d71635bb8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:06.956960 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-01f1c035-51f0-4632-9ca7-71d71635bb8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:06.961331 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2156/4295] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:28:06 2022] DELETE /identity/v3/projects/0c005e3bc67b4501949fb72140726a11 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:28:06.968353 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d8e9c0-f81c-40c9-8892-fbbf33a27437 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:06.971244 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d8e9c0-f81c-40c9-8892-fbbf33a27437 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:06.972125 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d8e9c0-f81c-40c9-8892-fbbf33a27437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:07.016536 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-71d8e9c0-f81c-40c9-8892-fbbf33a27437 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:28:07.018073 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-71d8e9c0-f81c-40c9-8892-fbbf33a27437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:07.076434 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ff4e15-3972-49a3-9982-02ae0c5a9ecc admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:07.094341 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e754b829-fc35-4470-a466-bb1f7615ca12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:07.101531 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e754b829-fc35-4470-a466-bb1f7615ca12 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:07.101944 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e754b829-fc35-4470-a466-bb1f7615ca12 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:07.102222 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e754b829-fc35-4470-a466-bb1f7615ca12 admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:07.104909 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e754b829-fc35-4470-a466-bb1f7615ca12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:07.106907 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e754b829-fc35-4470-a466-bb1f7615ca12 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:07.110900 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:28:07.184746 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2157/4296] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:28:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:28:07.186165 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2140/4297] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:28:06 2022] POST /identity/v3/projects => generated 361 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:28:07.193654 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cf4666-974c-4592-b6d2-769dbca6534d None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:07.193654 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cf4666-974c-4592-b6d2-769dbca6534d None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:07.193992 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cf4666-974c-4592-b6d2-769dbca6534d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:07.195346 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e754b829-fc35-4470-a466-bb1f7615ca12 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:07.203268 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-e754b829-fc35-4470-a466-bb1f7615ca12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:07.269577 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-c1cf4666-974c-4592-b6d2-769dbca6534d None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:28:07.272817 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-c1cf4666-974c-4592-b6d2-769dbca6534d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:07.286308 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:INSERT=2,keystone:DELETE=10,keystone:SELECT=88 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:28:07.374270 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e754b829-fc35-4470-a466-bb1f7615ca12 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:07.387889 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f30b26-5aa2-4833-8fd4-48b0a0816c79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:07.388598 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f30b26-5aa2-4833-8fd4-48b0a0816c79 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:07.388878 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f30b26-5aa2-4833-8fd4-48b0a0816c79 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:07.389147 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f30b26-5aa2-4833-8fd4-48b0a0816c79 admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:07.389847 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f30b26-5aa2-4833-8fd4-48b0a0816c79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:07.391826 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f30b26-5aa2-4833-8fd4-48b0a0816c79 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:07.432189 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2158/4298] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:28:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:28:07.433199 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cf4666-974c-4592-b6d2-769dbca6534d None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:07.445566 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cf4666-974c-4592-b6d2-769dbca6534d None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:07.456453 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2141/4299] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:28:07 2022] POST /identity/v3/users => generated 281 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:28:07.461586 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f30b26-5aa2-4833-8fd4-48b0a0816c79 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:07.472960 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d776b55e-7557-4f3b-a1e7-acbf4b659919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:07.473672 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d776b55e-7557-4f3b-a1e7-acbf4b659919 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:07.473979 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d776b55e-7557-4f3b-a1e7-acbf4b659919 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:07.474258 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d776b55e-7557-4f3b-a1e7-acbf4b659919 admin admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:07.475001 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d776b55e-7557-4f3b-a1e7-acbf4b659919 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:28:07.475301 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d776b55e-7557-4f3b-a1e7-acbf4b659919 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:07.476931 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d776b55e-7557-4f3b-a1e7-acbf4b659919 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:07.481260 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f30b26-5aa2-4833-8fd4-48b0a0816c79 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:07.494587 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53583fab-d468-493f-9606-e671157a61ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:07.495410 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53583fab-d468-493f-9606-e671157a61ac admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:07.495704 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53583fab-d468-493f-9606-e671157a61ac admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:07.495975 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53583fab-d468-493f-9606-e671157a61ac admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:07.496717 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53583fab-d468-493f-9606-e671157a61ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:07.498370 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53583fab-d468-493f-9606-e671157a61ac admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:07.517064 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2159/4300] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:28:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:28:07.521436 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d776b55e-7557-4f3b-a1e7-acbf4b659919 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:07.522988 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2142/4301] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:28:07 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 21:28:07.527308 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53583fab-d468-493f-9606-e671157a61ac admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:07.543338 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53583fab-d468-493f-9606-e671157a61ac admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:07.546369 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d776b55e-7557-4f3b-a1e7-acbf4b659919 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:07.549448 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060511eb-54db-44f3-b97b-8ae975179e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:07.550368 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060511eb-54db-44f3-b97b-8ae975179e96 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:07.550697 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060511eb-54db-44f3-b97b-8ae975179e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:07.551022 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060511eb-54db-44f3-b97b-8ae975179e96 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:07.551836 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060511eb-54db-44f3-b97b-8ae975179e96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:07.553768 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060511eb-54db-44f3-b97b-8ae975179e96 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:07.555657 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2a25f8-b669-46c3-88bb-ec783939e7bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:07.556469 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2a25f8-b669-46c3-88bb-ec783939e7bc admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:07.556903 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2a25f8-b669-46c3-88bb-ec783939e7bc admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:07.557343 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2a25f8-b669-46c3-88bb-ec783939e7bc admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:07.559293 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2a25f8-b669-46c3-88bb-ec783939e7bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:07.561803 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2a25f8-b669-46c3-88bb-ec783939e7bc admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:07.567718 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2143/4302] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:28:07 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 21:28:07.576680 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060511eb-54db-44f3-b97b-8ae975179e96 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:07.584534 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-060511eb-54db-44f3-b97b-8ae975179e96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:07.603767 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060511eb-54db-44f3-b97b-8ae975179e96 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:07.611752 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e8b714-4a41-43d6-bbc3-ad24a75545e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:07.613493 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e8b714-4a41-43d6-bbc3-ad24a75545e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:07.614060 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e8b714-4a41-43d6-bbc3-ad24a75545e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:07.614522 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e8b714-4a41-43d6-bbc3-ad24a75545e5 admin admin] PATH_INFO: `/v3/projects/e0caeaf3c9e947b9aefe9b449d31c2ea` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:07.616328 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e8b714-4a41-43d6-bbc3-ad24a75545e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0caeaf3c9e947b9aefe9b449d31c2ea)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:07.618708 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e8b714-4a41-43d6-bbc3-ad24a75545e5 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:07.624498 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2160/4303] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:28:07 2022] POST /identity/v3/projects => generated 393 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:28:07.626073 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2a25f8-b669-46c3-88bb-ec783939e7bc admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:07.682115 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-31e8b714-4a41-43d6-bbc3-ad24a75545e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0caeaf3c9e947b9aefe9b449d31c2ea', 'request_id': 'req-31e8b714-4a41-43d6-bbc3-ad24a75545e5'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:07.693279 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-31e8b714-4a41-43d6-bbc3-ad24a75545e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0caeaf3c9e947b9aefe9b449d31c2ea', 'request_id': 'req-31e8b714-4a41-43d6-bbc3-ad24a75545e5'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:07.703350 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-31e8b714-4a41-43d6-bbc3-ad24a75545e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0caeaf3c9e947b9aefe9b449d31c2ea', 'request_id': 'req-31e8b714-4a41-43d6-bbc3-ad24a75545e5'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:07.705769 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2a25f8-b669-46c3-88bb-ec783939e7bc admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:07.735318 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-31e8b714-4a41-43d6-bbc3-ad24a75545e5 admin admin] The token cache is being invalidate because project e0caeaf3c9e947b9aefe9b449d31c2ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:28:07.736233 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-31e8b714-4a41-43d6-bbc3-ad24a75545e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:07.736961 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-31e8b714-4a41-43d6-bbc3-ad24a75545e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:07.744359 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2144/4304] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:28:07 2022] DELETE /identity/v3/projects/e0caeaf3c9e947b9aefe9b449d31c2ea => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:28:07.744359 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e8b714-4a41-43d6-bbc3-ad24a75545e5 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:07.744359 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-31e8b714-4a41-43d6-bbc3-ad24a75545e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:07.799111 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:28:07.815255 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d9272e-b9f6-47ac-9afc-122b41dd4c5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:07.816695 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d9272e-b9f6-47ac-9afc-122b41dd4c5a admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:07.817689 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d9272e-b9f6-47ac-9afc-122b41dd4c5a admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:07.818123 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d9272e-b9f6-47ac-9afc-122b41dd4c5a admin admin] PATH_INFO: `/v3/projects/57ebe731993d416f89513a4bb9af9bed/users/cdce242abcb44d009d67c0d9ec02930b/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:07.831920 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e8b714-4a41-43d6-bbc3-ad24a75545e5 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:07.838766 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff579ad-1e6f-4268-afac-07b8dbf3a5a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:07.839607 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff579ad-1e6f-4268-afac-07b8dbf3a5a8 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:07.839748 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d9272e-b9f6-47ac-9afc-122b41dd4c5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=57ebe731993d416f89513a4bb9af9bed, user_id=cdce242abcb44d009d67c0d9ec02930b, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:07.839884 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff579ad-1e6f-4268-afac-07b8dbf3a5a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:07.840279 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff579ad-1e6f-4268-afac-07b8dbf3a5a8 admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:07.841052 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff579ad-1e6f-4268-afac-07b8dbf3a5a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:07.842745 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d9272e-b9f6-47ac-9afc-122b41dd4c5a admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:07.843178 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff579ad-1e6f-4268-afac-07b8dbf3a5a8 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:07.876228 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2161/4305] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:28:07 2022] PUT /identity/v3/projects/57ebe731993d416f89513a4bb9af9bed/users/cdce242abcb44d009d67c0d9ec02930b/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:28:07.885690 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2145/4306] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:28:07 2022] POST /identity/v3/users => generated 297 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:28:07.885884 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74824084-8f0f-4c5f-9ca4-00b5c12d3f17 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:07.885884 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74824084-8f0f-4c5f-9ca4-00b5c12d3f17 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:07.885884 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74824084-8f0f-4c5f-9ca4-00b5c12d3f17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:07.886427 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68928692-925a-4c4e-843c-bf4152d7d4a5 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:07.886908 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68928692-925a-4c4e-843c-bf4152d7d4a5 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:07.887144 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68928692-925a-4c4e-843c-bf4152d7d4a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:07.895151 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:28:07.908273 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-68928692-925a-4c4e-843c-bf4152d7d4a5 None None] MFA Rules not processed for user `17b779a3e21a415bb42cde5d6863d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:28:07.910376 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-68928692-925a-4c4e-843c-bf4152d7d4a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:07.910635 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-74824084-8f0f-4c5f-9ca4-00b5c12d3f17 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:28:07.912030 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-74824084-8f0f-4c5f-9ca4-00b5c12d3f17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:07.971820 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2146/4307] 10.222.0.17 () {58 vars in 967 bytes} [Sat Jul 23 21:28:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:28:07.973356 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab32635d-ce00-43bb-87ef-dd217488e815 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:07.973708 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab32635d-ce00-43bb-87ef-dd217488e815 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:07.974245 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab32635d-ce00-43bb-87ef-dd217488e815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:07.993304 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2162/4308] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:28:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:28:07.994604 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74824084-8f0f-4c5f-9ca4-00b5c12d3f17 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:08.007221 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74824084-8f0f-4c5f-9ca4-00b5c12d3f17 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:08.010646 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-ab32635d-ce00-43bb-87ef-dd217488e815 None None] MFA Rules not processed for user `cdce242abcb44d009d67c0d9ec02930b`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:28:08.012087 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-ab32635d-ce00-43bb-87ef-dd217488e815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:08.012217 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e27256-9cdd-47d0-b7cb-5bbe4791f372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:08.012788 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e27256-9cdd-47d0-b7cb-5bbe4791f372 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:08.013065 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e27256-9cdd-47d0-b7cb-5bbe4791f372 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:08.013338 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e27256-9cdd-47d0-b7cb-5bbe4791f372 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:08.014098 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e27256-9cdd-47d0-b7cb-5bbe4791f372 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:08.015714 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e27256-9cdd-47d0-b7cb-5bbe4791f372 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:08.030357 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2163/4309] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:28:07 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:28:08.030357 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e27256-9cdd-47d0-b7cb-5bbe4791f372 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:08.030357 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-60e27256-9cdd-47d0-b7cb-5bbe4791f372 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:08.097595 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2147/4310] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:28:07 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:28:08.098775 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33430ac-ed75-4178-8962-337173ef402e None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:08.099064 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33430ac-ed75-4178-8962-337173ef402e None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:08.099334 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33430ac-ed75-4178-8962-337173ef402e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:08.112620 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e27256-9cdd-47d0-b7cb-5bbe4791f372 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:08.118781 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8517dda-b03c-4bef-9228-777771917c4e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f0a685b7da46afb81024848f079d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:08.119417 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-b33430ac-ed75-4178-8962-337173ef402e None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:28:08.119569 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8517dda-b03c-4bef-9228-777771917c4e service swift] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:08.120318 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8517dda-b03c-4bef-9228-777771917c4e service swift] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:08.120318 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8517dda-b03c-4bef-9228-777771917c4e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:08.120701 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-b33430ac-ed75-4178-8962-337173ef402e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:08.129514 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2148/4311] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:28:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:28:08.130229 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33430ac-ed75-4178-8962-337173ef402e None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:08.135544 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8517dda-b03c-4bef-9228-777771917c4e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:08.137185 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8517dda-b03c-4bef-9228-777771917c4e service swift] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:08.140151 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33430ac-ed75-4178-8962-337173ef402e None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:08.145662 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b593324-0c61-42f8-a0b8-24b18d85caf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:08.146641 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b593324-0c61-42f8-a0b8-24b18d85caf7 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:08.146641 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b593324-0c61-42f8-a0b8-24b18d85caf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:08.146898 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b593324-0c61-42f8-a0b8-24b18d85caf7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:08.147701 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b593324-0c61-42f8-a0b8-24b18d85caf7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:08.149197 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b593324-0c61-42f8-a0b8-24b18d85caf7 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:08.153796 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2164/4312] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 23 21:28:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 23 21:28:08.155071 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8517dda-b03c-4bef-9228-777771917c4e service swift] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:08.160740 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-f8517dda-b03c-4bef-9228-777771917c4e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:08.168724 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2149/4313] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:28:08 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:28:08.170138 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b593324-0c61-42f8-a0b8-24b18d85caf7 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:08.187044 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b593324-0c61-42f8-a0b8-24b18d85caf7 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:08.197556 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4847dd77-3871-4a41-be18-49d63d519487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:08.198397 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4847dd77-3871-4a41-be18-49d63d519487 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:08.198697 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4847dd77-3871-4a41-be18-49d63d519487 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:08.199036 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4847dd77-3871-4a41-be18-49d63d519487 admin admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:08.200449 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4847dd77-3871-4a41-be18-49d63d519487 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:28:08.200810 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4847dd77-3871-4a41-be18-49d63d519487 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:08.202549 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4847dd77-3871-4a41-be18-49d63d519487 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:08.220274 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2150/4314] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:28:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:28:08.221403 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4847dd77-3871-4a41-be18-49d63d519487 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:08.237344 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4847dd77-3871-4a41-be18-49d63d519487 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:08.245032 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8660968-5b08-4fad-bf42-2ccd03296490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:08.245573 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8660968-5b08-4fad-bf42-2ccd03296490 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:08.245849 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8660968-5b08-4fad-bf42-2ccd03296490 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:08.246165 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8660968-5b08-4fad-bf42-2ccd03296490 admin admin] PATH_INFO: `/v3/projects/f3eef3db6d5f46c9882fbe98cb732263/users/3b566640463e43aa85ec96a1aa76d3f8/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:08.255634 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8517dda-b03c-4bef-9228-777771917c4e service swift] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:08.259533 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f036d9-c672-4e6e-9fa5-16671ef77239 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7f2db148c8e4d5d81431cae3576434b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:08.260197 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f036d9-c672-4e6e-9fa5-16671ef77239 service glance] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:08.260474 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f036d9-c672-4e6e-9fa5-16671ef77239 service glance] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:08.260746 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f036d9-c672-4e6e-9fa5-16671ef77239 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:08.271806 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f036d9-c672-4e6e-9fa5-16671ef77239 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:08.272424 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8660968-5b08-4fad-bf42-2ccd03296490 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3eef3db6d5f46c9882fbe98cb732263, user_id=3b566640463e43aa85ec96a1aa76d3f8, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:08.273275 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f036d9-c672-4e6e-9fa5-16671ef77239 service glance] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:08.276936 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8660968-5b08-4fad-bf42-2ccd03296490 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:08.284027 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2165/4315] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:28:08 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:28:08.284886 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f036d9-c672-4e6e-9fa5-16671ef77239 service glance] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:08.298622 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f036d9-c672-4e6e-9fa5-16671ef77239 service glance] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:08.305540 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c4812c-522b-44f2-bb88-552d89661f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:08.306713 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c4812c-522b-44f2-bb88-552d89661f29 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:08.307153 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c4812c-522b-44f2-bb88-552d89661f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:08.307720 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c4812c-522b-44f2-bb88-552d89661f29 admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:08.308602 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c4812c-522b-44f2-bb88-552d89661f29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:08.310763 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c4812c-522b-44f2-bb88-552d89661f29 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:08.314122 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2151/4316] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:28:08 2022] PUT /identity/v3/projects/f3eef3db6d5f46c9882fbe98cb732263/users/3b566640463e43aa85ec96a1aa76d3f8/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:28:08.335614 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f245637-1406-4677-bc0c-f6e913a3f9de None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:08.335614 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f245637-1406-4677-bc0c-f6e913a3f9de None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:08.335614 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f245637-1406-4677-bc0c-f6e913a3f9de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:08.340712 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:28:08.355716 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2166/4317] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:28:08 2022] POST /identity/v3/projects => generated 367 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:28:08.358624 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-9f245637-1406-4677-bc0c-f6e913a3f9de None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:28:08.359901 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c4812c-522b-44f2-bb88-552d89661f29 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:08.360403 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-9f245637-1406-4677-bc0c-f6e913a3f9de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:08.375902 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:28:08.488028 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2152/4318] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:28:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:28:08.493397 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c4812c-522b-44f2-bb88-552d89661f29 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:08.499667 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f245637-1406-4677-bc0c-f6e913a3f9de None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:08.501390 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-9f245637-1406-4677-bc0c-f6e913a3f9de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:08.508715 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579d9824-dfcf-486e-afcb-6b4e49f36c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:08.510550 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579d9824-dfcf-486e-afcb-6b4e49f36c3d admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:08.511051 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579d9824-dfcf-486e-afcb-6b4e49f36c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:08.511333 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579d9824-dfcf-486e-afcb-6b4e49f36c3d admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:08.512775 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579d9824-dfcf-486e-afcb-6b4e49f36c3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:08.517924 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579d9824-dfcf-486e-afcb-6b4e49f36c3d admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:08.544901 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2167/4319] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:28:08 2022] POST /identity/v3/users => generated 284 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:28:08.547084 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579d9824-dfcf-486e-afcb-6b4e49f36c3d admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:08.585903 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579d9824-dfcf-486e-afcb-6b4e49f36c3d admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:08.606986 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ea5460-c005-45d5-85a4-ac73ed99349c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:08.607842 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ea5460-c005-45d5-85a4-ac73ed99349c admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:08.608132 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ea5460-c005-45d5-85a4-ac73ed99349c admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:08.608485 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ea5460-c005-45d5-85a4-ac73ed99349c admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:08.609225 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ea5460-c005-45d5-85a4-ac73ed99349c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:08.611080 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ea5460-c005-45d5-85a4-ac73ed99349c admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:08.628229 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2168/4320] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:28:08 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:28:08.629405 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ea5460-c005-45d5-85a4-ac73ed99349c admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:08.643511 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ea5460-c005-45d5-85a4-ac73ed99349c admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:08.649513 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6b7278-336b-493d-afed-42c3a62f739f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:08.650323 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6b7278-336b-493d-afed-42c3a62f739f admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:08.650670 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6b7278-336b-493d-afed-42c3a62f739f admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:08.650950 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6b7278-336b-493d-afed-42c3a62f739f admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:08.651695 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6b7278-336b-493d-afed-42c3a62f739f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:08.653606 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6b7278-336b-493d-afed-42c3a62f739f admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:08.659830 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f245637-1406-4677-bc0c-f6e913a3f9de None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:08.665026 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00d24d1-7b7d-45bb-89bf-280c4069fd74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:08.666059 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00d24d1-7b7d-45bb-89bf-280c4069fd74 service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:08.667096 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00d24d1-7b7d-45bb-89bf-280c4069fd74 service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:08.667455 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00d24d1-7b7d-45bb-89bf-280c4069fd74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:08.678199 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2169/4321] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:28:08 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:28:08.679352 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6b7278-336b-493d-afed-42c3a62f739f admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:08.690970 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00d24d1-7b7d-45bb-89bf-280c4069fd74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:08.694948 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6b7278-336b-493d-afed-42c3a62f739f admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:08.695982 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00d24d1-7b7d-45bb-89bf-280c4069fd74 service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:08.719144 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2545ce6f-51a5-4689-9db2-95ee10151166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:08.720087 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2545ce6f-51a5-4689-9db2-95ee10151166 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:08.720367 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2545ce6f-51a5-4689-9db2-95ee10151166 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:08.720637 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2545ce6f-51a5-4689-9db2-95ee10151166 admin admin] PATH_INFO: `/v3/projects/2027486f1a7b42babefcd2c978363d55/users/2b1108dacf934e4c9c326d05196b9701/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:08.735786 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2153/4322] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:28:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 23 21:28:08.764011 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2545ce6f-51a5-4689-9db2-95ee10151166 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2027486f1a7b42babefcd2c978363d55, user_id=2b1108dacf934e4c9c326d05196b9701, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:08.770874 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2545ce6f-51a5-4689-9db2-95ee10151166 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:08.808454 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2170/4323] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:28:08 2022] PUT /identity/v3/projects/2027486f1a7b42babefcd2c978363d55/users/2b1108dacf934e4c9c326d05196b9701/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:28:08.813394 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7823bec-edb7-4be6-9974-cb32f0de6ae8 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:08.813394 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7823bec-edb7-4be6-9974-cb32f0de6ae8 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:08.813394 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7823bec-edb7-4be6-9974-cb32f0de6ae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:08.887310 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-f7823bec-edb7-4be6-9974-cb32f0de6ae8 None None] MFA Rules not processed for user `2b1108dacf934e4c9c326d05196b9701`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:28:08.893498 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-f7823bec-edb7-4be6-9974-cb32f0de6ae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:08.904503 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2545ce6f-51a5-4689-9db2-95ee10151166 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:08.906470 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-2545ce6f-51a5-4689-9db2-95ee10151166 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:09.021493 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2545ce6f-51a5-4689-9db2-95ee10151166 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:09.025652 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2154/4324] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:28:08 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:28:09.030652 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7823bec-edb7-4be6-9974-cb32f0de6ae8 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:09.037314 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca497cb-d945-4111-a918-94b7b3c5e8a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:09.038671 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca497cb-d945-4111-a918-94b7b3c5e8a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:09.039077 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca497cb-d945-4111-a918-94b7b3c5e8a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:09.039361 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca497cb-d945-4111-a918-94b7b3c5e8a1 admin admin] PATH_INFO: `/v3/users/cdce242abcb44d009d67c0d9ec02930b` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:09.041282 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca497cb-d945-4111-a918-94b7b3c5e8a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cdce242abcb44d009d67c0d9ec02930b)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:09.043517 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca497cb-d945-4111-a918-94b7b3c5e8a1 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:09.047181 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7823bec-edb7-4be6-9974-cb32f0de6ae8 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:09.054311 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c30b26b-da0b-475e-8f3e-cca918a90189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:09.055176 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c30b26b-da0b-475e-8f3e-cca918a90189 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:09.055176 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c30b26b-da0b-475e-8f3e-cca918a90189 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:09.055421 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c30b26b-da0b-475e-8f3e-cca918a90189 admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:09.056146 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c30b26b-da0b-475e-8f3e-cca918a90189 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:09.059082 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c30b26b-da0b-475e-8f3e-cca918a90189 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:09.100724 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2155/4325] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:28:09 2022] POST /identity/v3/projects => generated 365 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:28:09.102756 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c30b26b-da0b-475e-8f3e-cca918a90189 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:09.126997 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-4ca497cb-d945-4111-a918-94b7b3c5e8a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cdce242abcb44d009d67c0d9ec02930b'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:09.127779 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:28:09.133680 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:28:09.146823 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-4ca497cb-d945-4111-a918-94b7b3c5e8a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cdce242abcb44d009d67c0d9ec02930b'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:09.149494 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-4ca497cb-d945-4111-a918-94b7b3c5e8a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cdce242abcb44d009d67c0d9ec02930b'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:09.169807 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-4ca497cb-d945-4111-a918-94b7b3c5e8a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cdce242abcb44d009d67c0d9ec02930b'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:09.188372 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-4ca497cb-d945-4111-a918-94b7b3c5e8a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cdce242abcb44d009d67c0d9ec02930b'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:09.203847 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2171/4326] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:28:08 2022] DELETE /identity/v3/users/cdce242abcb44d009d67c0d9ec02930b => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:28:09.208493 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654f7d8b-a2f3-4803-8576-1f6e9b5a744e None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:09.209231 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654f7d8b-a2f3-4803-8576-1f6e9b5a744e None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:09.209616 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654f7d8b-a2f3-4803-8576-1f6e9b5a744e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:09.235305 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-654f7d8b-a2f3-4803-8576-1f6e9b5a744e None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:28:09.237178 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-654f7d8b-a2f3-4803-8576-1f6e9b5a744e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:09.241603 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c30b26b-da0b-475e-8f3e-cca918a90189 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:09.353558 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82daeddd-5d41-4594-af53-3056a01f8ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:09.354300 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82daeddd-5d41-4594-af53-3056a01f8ee2 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:09.355037 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82daeddd-5d41-4594-af53-3056a01f8ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:09.355308 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82daeddd-5d41-4594-af53-3056a01f8ee2 admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:09.356084 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82daeddd-5d41-4594-af53-3056a01f8ee2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:09.360025 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82daeddd-5d41-4594-af53-3056a01f8ee2 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:09.375439 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2172/4327] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:28:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:28:09.396831 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2156/4328] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:28:09 2022] POST /identity/v3/users => generated 289 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:28:09.400969 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654f7d8b-a2f3-4803-8576-1f6e9b5a744e None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:09.403009 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-654f7d8b-a2f3-4803-8576-1f6e9b5a744e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:09.406792 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82daeddd-5d41-4594-af53-3056a01f8ee2 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:09.411230 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-82daeddd-5d41-4594-af53-3056a01f8ee2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:09.435745 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654f7d8b-a2f3-4803-8576-1f6e9b5a744e None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:09.451110 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae32ae1c-b4c9-491c-9f31-99fc7a46eae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:09.453363 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae32ae1c-b4c9-491c-9f31-99fc7a46eae0 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:09.453835 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae32ae1c-b4c9-491c-9f31-99fc7a46eae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:09.454633 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae32ae1c-b4c9-491c-9f31-99fc7a46eae0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:09.455872 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae32ae1c-b4c9-491c-9f31-99fc7a46eae0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:09.461283 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae32ae1c-b4c9-491c-9f31-99fc7a46eae0 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:09.492246 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82daeddd-5d41-4594-af53-3056a01f8ee2 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:09.496330 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2173/4329] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:28:09 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:28:09.497627 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae32ae1c-b4c9-491c-9f31-99fc7a46eae0 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:09.499340 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a434de29-6111-4341-b0ca-491d30c9a8a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:09.500191 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a434de29-6111-4341-b0ca-491d30c9a8a9 service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:09.500717 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a434de29-6111-4341-b0ca-491d30c9a8a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:09.501095 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a434de29-6111-4341-b0ca-491d30c9a8a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:09.514820 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a434de29-6111-4341-b0ca-491d30c9a8a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:09.517060 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a434de29-6111-4341-b0ca-491d30c9a8a9 service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:09.518718 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae32ae1c-b4c9-491c-9f31-99fc7a46eae0 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:09.531183 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98e6b74-e3f9-4d01-bb81-5de284760874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:09.533357 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98e6b74-e3f9-4d01-bb81-5de284760874 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:09.533357 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98e6b74-e3f9-4d01-bb81-5de284760874 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:09.533357 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98e6b74-e3f9-4d01-bb81-5de284760874 admin admin] PATH_INFO: `/v3/projects/0d2f406f8dcd4b9683267e93d4258802/users/411acf54c9074b19b9cc3fbff27e73f8/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:09.533679 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2157/4330] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:28:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:28:09.562636 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98e6b74-e3f9-4d01-bb81-5de284760874 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d2f406f8dcd4b9683267e93d4258802, user_id=411acf54c9074b19b9cc3fbff27e73f8, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:09.566427 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98e6b74-e3f9-4d01-bb81-5de284760874 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:09.603416 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2174/4331] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:28:09 2022] PUT /identity/v3/projects/0d2f406f8dcd4b9683267e93d4258802/users/411acf54c9074b19b9cc3fbff27e73f8/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:28:09.607231 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a434de29-6111-4341-b0ca-491d30c9a8a9 service neutron] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:09.630694 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a434de29-6111-4341-b0ca-491d30c9a8a9 service neutron] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:09.688110 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:28:09.696755 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6db9e4-e6d3-482c-808e-9c72408c632e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:09.697470 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6db9e4-e6d3-482c-808e-9c72408c632e admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:09.698274 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6db9e4-e6d3-482c-808e-9c72408c632e admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:09.698402 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6db9e4-e6d3-482c-808e-9c72408c632e admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:09.699355 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6db9e4-e6d3-482c-808e-9c72408c632e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:09.701241 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6db9e4-e6d3-482c-808e-9c72408c632e admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:09.714396 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2158/4332] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:28:09 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:28:09.719333 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98e6b74-e3f9-4d01-bb81-5de284760874 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:09.738561 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98e6b74-e3f9-4d01-bb81-5de284760874 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:09.744197 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e682e9-d33a-470f-93d9-849f5a6b215d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:09.745180 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e682e9-d33a-470f-93d9-849f5a6b215d admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:09.746216 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e682e9-d33a-470f-93d9-849f5a6b215d admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:09.746560 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e682e9-d33a-470f-93d9-849f5a6b215d admin admin] PATH_INFO: `/v3/projects/0d2f406f8dcd4b9683267e93d4258802/users/411acf54c9074b19b9cc3fbff27e73f8/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:09.748810 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e682e9-d33a-470f-93d9-849f5a6b215d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d2f406f8dcd4b9683267e93d4258802, user_id=411acf54c9074b19b9cc3fbff27e73f8, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:09.751938 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e682e9-d33a-470f-93d9-849f5a6b215d admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:09.769904 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2175/4333] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:28:09 2022] PUT /identity/v3/projects/0d2f406f8dcd4b9683267e93d4258802/users/411acf54c9074b19b9cc3fbff27e73f8/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:28:09.781280 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba17cd1-0d98-43d8-9631-30ce68d243d2 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:09.781280 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba17cd1-0d98-43d8-9631-30ce68d243d2 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:09.781576 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba17cd1-0d98-43d8-9631-30ce68d243d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:09.821364 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-1ba17cd1-0d98-43d8-9631-30ce68d243d2 None None] MFA Rules not processed for user `411acf54c9074b19b9cc3fbff27e73f8`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:28:09.823138 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-1ba17cd1-0d98-43d8-9631-30ce68d243d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:10.075367 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2159/4334] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:28:09 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:28:10.079668 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e682e9-d33a-470f-93d9-849f5a6b215d admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:10.101204 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e682e9-d33a-470f-93d9-849f5a6b215d admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:10.126606 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967c50d5-b045-42bb-877e-0449fb09a1ce tempest-UsersV3TestJSON-753816012 tempest-UsersV3TestJSON-753816012-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '411acf54c9074b19b9cc3fbff27e73f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d2f406f8dcd4b9683267e93d4258802', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:10.127422 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967c50d5-b045-42bb-877e-0449fb09a1ce tempest-UsersV3TestJSON-753816012 tempest-UsersV3TestJSON-753816012-project-admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:10.128295 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967c50d5-b045-42bb-877e-0449fb09a1ce tempest-UsersV3TestJSON-753816012 tempest-UsersV3TestJSON-753816012-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:10.128295 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967c50d5-b045-42bb-877e-0449fb09a1ce tempest-UsersV3TestJSON-753816012 tempest-UsersV3TestJSON-753816012-project-admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:10.129078 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967c50d5-b045-42bb-877e-0449fb09a1ce tempest-UsersV3TestJSON-753816012 tempest-UsersV3TestJSON-753816012-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:10.131377 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967c50d5-b045-42bb-877e-0449fb09a1ce tempest-UsersV3TestJSON-753816012 tempest-UsersV3TestJSON-753816012-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:10.139142 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e216fe1-9838-4523-874a-f62295dd1077 None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:10.144334 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e216fe1-9838-4523-874a-f62295dd1077 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:10.145015 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e216fe1-9838-4523-874a-f62295dd1077 None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:10.149203 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2160/4335] 10.222.0.17 () {54 vars in 912 bytes} [Sat Jul 23 21:28:10 2022] GET /identity => generated 270 bytes in 18 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:28:10.158910 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5580c087-c543-42ee-9007-1815d0707a1e None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:10.159937 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5580c087-c543-42ee-9007-1815d0707a1e None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:10.159937 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5580c087-c543-42ee-9007-1815d0707a1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:10.167843 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2176/4336] 10.222.0.17 () {60 vars in 1148 bytes} [Sat Jul 23 21:28:10 2022] POST /identity/v3/domains => generated 276 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:28:10.171462 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967c50d5-b045-42bb-877e-0449fb09a1ce tempest-UsersV3TestJSON-753816012 tempest-UsersV3TestJSON-753816012-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:10.202204 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-5580c087-c543-42ee-9007-1815d0707a1e None None] MFA Rules not processed for user `abc719a3b3ac4461b82ca04ab6451d81`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:28:10.209500 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-5580c087-c543-42ee-9007-1815d0707a1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:10.317447 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967c50d5-b045-42bb-877e-0449fb09a1ce tempest-UsersV3TestJSON-753816012 tempest-UsersV3TestJSON-753816012-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:10.323345 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f16b27-8a9f-48d2-a9ff-56622c44ea50 tempest-UsersV3TestJSON-753816012 tempest-UsersV3TestJSON-753816012-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '411acf54c9074b19b9cc3fbff27e73f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d2f406f8dcd4b9683267e93d4258802', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:10.326017 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f16b27-8a9f-48d2-a9ff-56622c44ea50 tempest-UsersV3TestJSON-753816012 tempest-UsersV3TestJSON-753816012-project-admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:10.326916 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f16b27-8a9f-48d2-a9ff-56622c44ea50 tempest-UsersV3TestJSON-753816012 tempest-UsersV3TestJSON-753816012-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:10.327565 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f16b27-8a9f-48d2-a9ff-56622c44ea50 tempest-UsersV3TestJSON-753816012 tempest-UsersV3TestJSON-753816012-project-admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:10.329533 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f16b27-8a9f-48d2-a9ff-56622c44ea50 tempest-UsersV3TestJSON-753816012 tempest-UsersV3TestJSON-753816012-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:10.333724 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f16b27-8a9f-48d2-a9ff-56622c44ea50 tempest-UsersV3TestJSON-753816012 tempest-UsersV3TestJSON-753816012-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:10.345334 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:28:10.349641 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2161/4337] 10.222.0.17 () {58 vars in 1009 bytes} [Sat Jul 23 21:28:10 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:28:10.351135 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5580c087-c543-42ee-9007-1815d0707a1e None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:10.364097 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-5580c087-c543-42ee-9007-1815d0707a1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:10.381461 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2177/4338] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:28:10 2022] POST /identity/v3/users => generated 346 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:28:10.382392 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f16b27-8a9f-48d2-a9ff-56622c44ea50 tempest-UsersV3TestJSON-753816012 tempest-UsersV3TestJSON-753816012-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:10.386468 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-79f16b27-8a9f-48d2-a9ff-56622c44ea50 tempest-UsersV3TestJSON-753816012 tempest-UsersV3TestJSON-753816012-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:10.405176 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f16b27-8a9f-48d2-a9ff-56622c44ea50 tempest-UsersV3TestJSON-753816012 tempest-UsersV3TestJSON-753816012-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:10.411841 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82d6f02-f237-4188-a162-9c44525c2827 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc719a3b3ac4461b82ca04ab6451d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:10.412512 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82d6f02-f237-4188-a162-9c44525c2827 service placement] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:10.413144 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82d6f02-f237-4188-a162-9c44525c2827 service placement] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:10.413144 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82d6f02-f237-4188-a162-9c44525c2827 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:10.422326 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82d6f02-f237-4188-a162-9c44525c2827 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:10.424011 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82d6f02-f237-4188-a162-9c44525c2827 service placement] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:10.437310 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2178/4339] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:28:10 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:28:10.440495 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82d6f02-f237-4188-a162-9c44525c2827 service placement] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:10.464133 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82d6f02-f237-4188-a162-9c44525c2827 service placement] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:10.472750 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5580c087-c543-42ee-9007-1815d0707a1e None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:10.474756 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b292356-821f-40bf-841d-dbaf5f634193 tempest-UsersV3TestJSON-753816012 tempest-UsersV3TestJSON-753816012-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '411acf54c9074b19b9cc3fbff27e73f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d2f406f8dcd4b9683267e93d4258802', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:10.475845 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b292356-821f-40bf-841d-dbaf5f634193 tempest-UsersV3TestJSON-753816012 tempest-UsersV3TestJSON-753816012-project-admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:10.477229 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b292356-821f-40bf-841d-dbaf5f634193 tempest-UsersV3TestJSON-753816012 tempest-UsersV3TestJSON-753816012-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:10.477844 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b292356-821f-40bf-841d-dbaf5f634193 tempest-UsersV3TestJSON-753816012 tempest-UsersV3TestJSON-753816012-project-admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:10.478588 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b292356-821f-40bf-841d-dbaf5f634193 tempest-UsersV3TestJSON-753816012 tempest-UsersV3TestJSON-753816012-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:10.480643 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b292356-821f-40bf-841d-dbaf5f634193 tempest-UsersV3TestJSON-753816012 tempest-UsersV3TestJSON-753816012-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:10.488297 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2edbe64-8204-4c03-a95f-7e0c1ee28a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:10.489270 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2edbe64-8204-4c03-a95f-7e0c1ee28a7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:10.489619 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2edbe64-8204-4c03-a95f-7e0c1ee28a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:10.489977 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2edbe64-8204-4c03-a95f-7e0c1ee28a7d admin admin] PATH_INFO: `/v3/projects/57ebe731993d416f89513a4bb9af9bed` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:10.495064 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2edbe64-8204-4c03-a95f-7e0c1ee28a7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=57ebe731993d416f89513a4bb9af9bed)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:10.497748 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2edbe64-8204-4c03-a95f-7e0c1ee28a7d admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:10.520617 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2179/4340] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:28:10 2022] POST /identity/v3/users => generated 323 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:28:10.527176 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:28:10.529592 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b292356-821f-40bf-841d-dbaf5f634193 tempest-UsersV3TestJSON-753816012 tempest-UsersV3TestJSON-753816012-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:10.548939 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b292356-821f-40bf-841d-dbaf5f634193 tempest-UsersV3TestJSON-753816012 tempest-UsersV3TestJSON-753816012-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:10.560367 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6606bfab-6588-4402-8cb0-ef6a9863afe6 tempest-UsersV3TestJSON-753816012 tempest-UsersV3TestJSON-753816012-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '411acf54c9074b19b9cc3fbff27e73f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d2f406f8dcd4b9683267e93d4258802', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:10.562021 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6606bfab-6588-4402-8cb0-ef6a9863afe6 tempest-UsersV3TestJSON-753816012 tempest-UsersV3TestJSON-753816012-project-admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:10.562602 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6606bfab-6588-4402-8cb0-ef6a9863afe6 tempest-UsersV3TestJSON-753816012 tempest-UsersV3TestJSON-753816012-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:10.563314 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6606bfab-6588-4402-8cb0-ef6a9863afe6 tempest-UsersV3TestJSON-753816012 tempest-UsersV3TestJSON-753816012-project-admin] PATH_INFO: `/v3/users/8d256f2a7a3f4e81916f68b3e6873bf6` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:10.584528 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6606bfab-6588-4402-8cb0-ef6a9863afe6 tempest-UsersV3TestJSON-753816012 tempest-UsersV3TestJSON-753816012-project-admin] RBAC: Authorizing `identity:get_user(user_id=8d256f2a7a3f4e81916f68b3e6873bf6)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:10.587766 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6606bfab-6588-4402-8cb0-ef6a9863afe6 tempest-UsersV3TestJSON-753816012 tempest-UsersV3TestJSON-753816012-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:10.589763 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2180/4341] 10.222.0.17 () {58 vars in 1220 bytes} [Sat Jul 23 21:28:10 2022] GET /identity/v3/users/8d256f2a7a3f4e81916f68b3e6873bf6 => generated 346 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:28:10.595522 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6606bfab-6588-4402-8cb0-ef6a9863afe6 tempest-UsersV3TestJSON-753816012 tempest-UsersV3TestJSON-753816012-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:10.602625 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c2edbe64-8204-4c03-a95f-7e0c1ee28a7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57ebe731993d416f89513a4bb9af9bed', 'request_id': 'req-c2edbe64-8204-4c03-a95f-7e0c1ee28a7d'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:10.612257 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6606bfab-6588-4402-8cb0-ef6a9863afe6 tempest-UsersV3TestJSON-753816012 tempest-UsersV3TestJSON-753816012-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:10.616999 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c2edbe64-8204-4c03-a95f-7e0c1ee28a7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57ebe731993d416f89513a4bb9af9bed', 'request_id': 'req-c2edbe64-8204-4c03-a95f-7e0c1ee28a7d'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:10.630728 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c2edbe64-8204-4c03-a95f-7e0c1ee28a7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57ebe731993d416f89513a4bb9af9bed', 'request_id': 'req-c2edbe64-8204-4c03-a95f-7e0c1ee28a7d'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:10.664693 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c2edbe64-8204-4c03-a95f-7e0c1ee28a7d admin admin] The token cache is being invalidate because project 57ebe731993d416f89513a4bb9af9bed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:28:10.664693 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c2edbe64-8204-4c03-a95f-7e0c1ee28a7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:10.672416 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c2edbe64-8204-4c03-a95f-7e0c1ee28a7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:10.674238 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2162/4342] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:28:10 2022] DELETE /identity/v3/projects/57ebe731993d416f89513a4bb9af9bed => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:28:10.685509 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5cba1d-5b56-4604-b18d-d390fa260eb0 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:10.685810 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5cba1d-5b56-4604-b18d-d390fa260eb0 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:10.686225 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5cba1d-5b56-4604-b18d-d390fa260eb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:10.724409 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-2a5cba1d-5b56-4604-b18d-d390fa260eb0 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:28:10.724679 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b17714c-b0e5-4745-8639-ca3f204e0fc5 tempest-UsersV3TestJSON-753816012 tempest-UsersV3TestJSON-753816012-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '411acf54c9074b19b9cc3fbff27e73f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d2f406f8dcd4b9683267e93d4258802', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:10.725275 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b17714c-b0e5-4745-8639-ca3f204e0fc5 tempest-UsersV3TestJSON-753816012 tempest-UsersV3TestJSON-753816012-project-admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:10.725569 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b17714c-b0e5-4745-8639-ca3f204e0fc5 tempest-UsersV3TestJSON-753816012 tempest-UsersV3TestJSON-753816012-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:10.725672 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-2a5cba1d-5b56-4604-b18d-d390fa260eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:10.725836 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b17714c-b0e5-4745-8639-ca3f204e0fc5 tempest-UsersV3TestJSON-753816012 tempest-UsersV3TestJSON-753816012-project-admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:10.726808 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b17714c-b0e5-4745-8639-ca3f204e0fc5 tempest-UsersV3TestJSON-753816012 tempest-UsersV3TestJSON-753816012-project-admin] RBAC: Adding query filter params (domain_id=84a3f9eca2ee4971b65f3e3201dcb881) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:28:10.727116 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b17714c-b0e5-4745-8639-ca3f204e0fc5 tempest-UsersV3TestJSON-753816012 tempest-UsersV3TestJSON-753816012-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:10.733635 ncdv-master-1 devstack@keystone.service[91547]: WARNING py.warnings [None req-8b17714c-b0e5-4745-8639-ca3f204e0fc5 tempest-UsersV3TestJSON-753816012 tempest-UsersV3TestJSON-753816012-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:28:10.733635 ncdv-master-1 devstack@keystone.service[91547]: warnings.warn(msg) Jul 23 21:28:10.733635 ncdv-master-1 devstack@keystone.service[91547]: Jul 23 21:28:10.735425 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b17714c-b0e5-4745-8639-ca3f204e0fc5 tempest-UsersV3TestJSON-753816012 tempest-UsersV3TestJSON-753816012-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:10.754649 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2181/4343] 10.222.0.17 () {58 vars in 1206 bytes} [Sat Jul 23 21:28:10 2022] GET /identity/v3/users?domain_id=84a3f9eca2ee4971b65f3e3201dcb881 => generated 483 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:28:10.759870 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b17714c-b0e5-4745-8639-ca3f204e0fc5 tempest-UsersV3TestJSON-753816012 tempest-UsersV3TestJSON-753816012-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:10.762843 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-8b17714c-b0e5-4745-8639-ca3f204e0fc5 tempest-UsersV3TestJSON-753816012 tempest-UsersV3TestJSON-753816012-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:10.790473 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b17714c-b0e5-4745-8639-ca3f204e0fc5 tempest-UsersV3TestJSON-753816012 tempest-UsersV3TestJSON-753816012-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:10.802680 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eefd7f-8cc6-4c9c-8b72-ef37caef8394 tempest-UsersV3TestJSON-753816012 tempest-UsersV3TestJSON-753816012-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '411acf54c9074b19b9cc3fbff27e73f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d2f406f8dcd4b9683267e93d4258802', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:10.804118 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eefd7f-8cc6-4c9c-8b72-ef37caef8394 tempest-UsersV3TestJSON-753816012 tempest-UsersV3TestJSON-753816012-project-admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:10.804647 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eefd7f-8cc6-4c9c-8b72-ef37caef8394 tempest-UsersV3TestJSON-753816012 tempest-UsersV3TestJSON-753816012-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:10.804947 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eefd7f-8cc6-4c9c-8b72-ef37caef8394 tempest-UsersV3TestJSON-753816012 tempest-UsersV3TestJSON-753816012-project-admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:10.805948 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3eefd7f-8cc6-4c9c-8b72-ef37caef8394 tempest-UsersV3TestJSON-753816012 tempest-UsersV3TestJSON-753816012-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:10.808505 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3eefd7f-8cc6-4c9c-8b72-ef37caef8394 tempest-UsersV3TestJSON-753816012 tempest-UsersV3TestJSON-753816012-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:10.911092 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2163/4344] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:28:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:28:10.911092 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df513f0d-c607-4c1c-8656-f0af69eaaf9c None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:10.911092 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df513f0d-c607-4c1c-8656-f0af69eaaf9c None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:10.911092 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df513f0d-c607-4c1c-8656-f0af69eaaf9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:10.947531 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2182/4345] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:28:10 2022] GET /identity/v3/users => generated 8324 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:28:10.950923 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e32629-e447-4b2d-bcc4-24517757c1d5 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:10.951201 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e32629-e447-4b2d-bcc4-24517757c1d5 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:10.951476 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e32629-e447-4b2d-bcc4-24517757c1d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:10.954076 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-df513f0d-c607-4c1c-8656-f0af69eaaf9c None None] MFA Rules not processed for user `affc3572ef7d45249f50b5061a681d18`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:28:10.955722 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-df513f0d-c607-4c1c-8656-f0af69eaaf9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:10.989135 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-91e32629-e447-4b2d-bcc4-24517757c1d5 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:28:10.993257 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-91e32629-e447-4b2d-bcc4-24517757c1d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:11.015995 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2183/4346] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:28:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:28:11.015995 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e32629-e447-4b2d-bcc4-24517757c1d5 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:11.037788 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e32629-e447-4b2d-bcc4-24517757c1d5 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:11.057904 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a6ea6d-76f7-4bce-ba71-d45faa9f8db7 tempest-UsersV3TestJSON-753816012 tempest-UsersV3TestJSON-753816012-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '411acf54c9074b19b9cc3fbff27e73f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d2f406f8dcd4b9683267e93d4258802', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:11.059943 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a6ea6d-76f7-4bce-ba71-d45faa9f8db7 tempest-UsersV3TestJSON-753816012 tempest-UsersV3TestJSON-753816012-project-admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:11.060889 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a6ea6d-76f7-4bce-ba71-d45faa9f8db7 tempest-UsersV3TestJSON-753816012 tempest-UsersV3TestJSON-753816012-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:11.061181 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a6ea6d-76f7-4bce-ba71-d45faa9f8db7 tempest-UsersV3TestJSON-753816012 tempest-UsersV3TestJSON-753816012-project-admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:11.064966 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a6ea6d-76f7-4bce-ba71-d45faa9f8db7 tempest-UsersV3TestJSON-753816012 tempest-UsersV3TestJSON-753816012-project-admin] RBAC: Adding query filter params (name=tempest-test_user-898228542) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:28:11.065311 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a6ea6d-76f7-4bce-ba71-d45faa9f8db7 tempest-UsersV3TestJSON-753816012 tempest-UsersV3TestJSON-753816012-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:11.070826 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a6ea6d-76f7-4bce-ba71-d45faa9f8db7 tempest-UsersV3TestJSON-753816012 tempest-UsersV3TestJSON-753816012-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:11.084449 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2164/4347] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:28:10 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:28:11.086578 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df513f0d-c607-4c1c-8656-f0af69eaaf9c None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:11.128704 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df513f0d-c607-4c1c-8656-f0af69eaaf9c None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:11.140297 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2184/4348] 10.222.0.17 () {58 vars in 1186 bytes} [Sat Jul 23 21:28:11 2022] GET /identity/v3/users?name=tempest-test_user-898228542 => generated 473 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:28:11.141424 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a6ea6d-76f7-4bce-ba71-d45faa9f8db7 tempest-UsersV3TestJSON-753816012 tempest-UsersV3TestJSON-753816012-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:11.152050 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aafd2e7-1571-497c-bc6b-5019d46f1414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:11.153186 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aafd2e7-1571-497c-bc6b-5019d46f1414 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:11.153186 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aafd2e7-1571-497c-bc6b-5019d46f1414 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:11.153470 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aafd2e7-1571-497c-bc6b-5019d46f1414 admin admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:11.154498 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aafd2e7-1571-497c-bc6b-5019d46f1414 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:28:11.154910 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aafd2e7-1571-497c-bc6b-5019d46f1414 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:11.156579 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aafd2e7-1571-497c-bc6b-5019d46f1414 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:11.194521 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a6ea6d-76f7-4bce-ba71-d45faa9f8db7 tempest-UsersV3TestJSON-753816012 tempest-UsersV3TestJSON-753816012-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:11.194757 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2165/4349] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:28:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:28:11.196237 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aafd2e7-1571-497c-bc6b-5019d46f1414 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:11.219072 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779510f5-f39d-4ce1-99d5-551071d9b993 tempest-UsersV3TestJSON-753816012 tempest-UsersV3TestJSON-753816012-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '411acf54c9074b19b9cc3fbff27e73f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d2f406f8dcd4b9683267e93d4258802', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:11.219853 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779510f5-f39d-4ce1-99d5-551071d9b993 tempest-UsersV3TestJSON-753816012 tempest-UsersV3TestJSON-753816012-project-admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:11.220198 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779510f5-f39d-4ce1-99d5-551071d9b993 tempest-UsersV3TestJSON-753816012 tempest-UsersV3TestJSON-753816012-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:11.220537 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779510f5-f39d-4ce1-99d5-551071d9b993 tempest-UsersV3TestJSON-753816012 tempest-UsersV3TestJSON-753816012-project-admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:11.222726 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779510f5-f39d-4ce1-99d5-551071d9b993 tempest-UsersV3TestJSON-753816012 tempest-UsersV3TestJSON-753816012-project-admin] RBAC: Adding query filter params (enabled=False) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:28:11.223096 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779510f5-f39d-4ce1-99d5-551071d9b993 tempest-UsersV3TestJSON-753816012 tempest-UsersV3TestJSON-753816012-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:11.223726 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aafd2e7-1571-497c-bc6b-5019d46f1414 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:11.227391 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779510f5-f39d-4ce1-99d5-551071d9b993 tempest-UsersV3TestJSON-753816012 tempest-UsersV3TestJSON-753816012-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:11.232938 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a26a6a-b3f9-47e3-a195-8350e2f1aa43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:11.233696 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a26a6a-b3f9-47e3-a195-8350e2f1aa43 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:11.234082 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a26a6a-b3f9-47e3-a195-8350e2f1aa43 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:11.234437 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a26a6a-b3f9-47e3-a195-8350e2f1aa43 admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:11.235462 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a26a6a-b3f9-47e3-a195-8350e2f1aa43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:11.238095 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a26a6a-b3f9-47e3-a195-8350e2f1aa43 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:11.259379 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2185/4350] 10.222.0.17 () {58 vars in 1148 bytes} [Sat Jul 23 21:28:11 2022] GET /identity/v3/users?enabled=False => generated 431 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:28:11.264692 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779510f5-f39d-4ce1-99d5-551071d9b993 tempest-UsersV3TestJSON-753816012 tempest-UsersV3TestJSON-753816012-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:11.277073 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2166/4351] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:28:11 2022] POST /identity/v3/projects => generated 411 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:28:11.281321 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779510f5-f39d-4ce1-99d5-551071d9b993 tempest-UsersV3TestJSON-753816012 tempest-UsersV3TestJSON-753816012-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:11.281811 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a26a6a-b3f9-47e3-a195-8350e2f1aa43 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:11.309400 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:28:11.366829 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:28:11.392928 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f3b78e-310b-40ba-9ce1-45d616c39e03 tempest-UsersV3TestJSON-753816012 tempest-UsersV3TestJSON-753816012-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '411acf54c9074b19b9cc3fbff27e73f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d2f406f8dcd4b9683267e93d4258802', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:11.394164 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f3b78e-310b-40ba-9ce1-45d616c39e03 tempest-UsersV3TestJSON-753816012 tempest-UsersV3TestJSON-753816012-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:11.394444 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f3b78e-310b-40ba-9ce1-45d616c39e03 tempest-UsersV3TestJSON-753816012 tempest-UsersV3TestJSON-753816012-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:11.394717 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f3b78e-310b-40ba-9ce1-45d616c39e03 tempest-UsersV3TestJSON-753816012 tempest-UsersV3TestJSON-753816012-project-admin] PATH_INFO: `/v3/users/10bd26ba3cc54beba9fc4fdd59b9fe76` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:11.432019 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a26a6a-b3f9-47e3-a195-8350e2f1aa43 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:11.435551 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f3b78e-310b-40ba-9ce1-45d616c39e03 tempest-UsersV3TestJSON-753816012 tempest-UsersV3TestJSON-753816012-project-admin] RBAC: Authorizing `identity:delete_user(user_id=10bd26ba3cc54beba9fc4fdd59b9fe76)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:11.437592 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f3b78e-310b-40ba-9ce1-45d616c39e03 tempest-UsersV3TestJSON-753816012 tempest-UsersV3TestJSON-753816012-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:11.445484 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe56d0b8-00f5-411f-915b-dcb566d48ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:11.446230 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe56d0b8-00f5-411f-915b-dcb566d48ce3 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:11.446515 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe56d0b8-00f5-411f-915b-dcb566d48ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:11.446792 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe56d0b8-00f5-411f-915b-dcb566d48ce3 admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:11.447500 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe56d0b8-00f5-411f-915b-dcb566d48ce3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:11.451628 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe56d0b8-00f5-411f-915b-dcb566d48ce3 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:11.482027 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2167/4352] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:28:11 2022] POST /identity/v3/users => generated 306 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:28:11.488988 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe56d0b8-00f5-411f-915b-dcb566d48ce3 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:11.502177 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe56d0b8-00f5-411f-915b-dcb566d48ce3 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:11.507702 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d918d7-3c9a-4d0f-9fd7-072fbe7120b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:11.508442 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d918d7-3c9a-4d0f-9fd7-072fbe7120b0 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:11.509518 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d918d7-3c9a-4d0f-9fd7-072fbe7120b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:11.509880 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d918d7-3c9a-4d0f-9fd7-072fbe7120b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:11.510692 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d918d7-3c9a-4d0f-9fd7-072fbe7120b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:11.512445 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d918d7-3c9a-4d0f-9fd7-072fbe7120b0 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:11.518087 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-58f3b78e-310b-40ba-9ce1-45d616c39e03 tempest-UsersV3TestJSON-753816012 tempest-UsersV3TestJSON-753816012-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10bd26ba3cc54beba9fc4fdd59b9fe76'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:11.528406 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2168/4353] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:28:11 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:28:11.529292 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-58f3b78e-310b-40ba-9ce1-45d616c39e03 tempest-UsersV3TestJSON-753816012 tempest-UsersV3TestJSON-753816012-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10bd26ba3cc54beba9fc4fdd59b9fe76'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:11.529424 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d918d7-3c9a-4d0f-9fd7-072fbe7120b0 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:11.531020 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-58f3b78e-310b-40ba-9ce1-45d616c39e03 tempest-UsersV3TestJSON-753816012 tempest-UsersV3TestJSON-753816012-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10bd26ba3cc54beba9fc4fdd59b9fe76'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:11.540759 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d918d7-3c9a-4d0f-9fd7-072fbe7120b0 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:11.545855 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-58f3b78e-310b-40ba-9ce1-45d616c39e03 tempest-UsersV3TestJSON-753816012 tempest-UsersV3TestJSON-753816012-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10bd26ba3cc54beba9fc4fdd59b9fe76'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:11.546600 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19e5c11-ba60-4933-8366-9d5f46f8c7f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:11.548029 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19e5c11-ba60-4933-8366-9d5f46f8c7f1 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:11.548429 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19e5c11-ba60-4933-8366-9d5f46f8c7f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:11.548721 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19e5c11-ba60-4933-8366-9d5f46f8c7f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:11.549894 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19e5c11-ba60-4933-8366-9d5f46f8c7f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:11.553201 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19e5c11-ba60-4933-8366-9d5f46f8c7f1 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:11.567200 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2169/4354] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:28:11 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:28:11.575452 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19e5c11-ba60-4933-8366-9d5f46f8c7f1 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:11.586691 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19e5c11-ba60-4933-8366-9d5f46f8c7f1 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:11.594246 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0f3188-5e11-4af0-a742-be2bdfaa8ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:11.595160 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0f3188-5e11-4af0-a742-be2bdfaa8ec7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:11.595446 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0f3188-5e11-4af0-a742-be2bdfaa8ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:11.595726 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0f3188-5e11-4af0-a742-be2bdfaa8ec7 admin admin] PATH_INFO: `/v3/projects/d192125812e3417db2a79f342f4b0236/users/d1a50429fb9e4facbea13a157e38c201/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:11.599004 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-58f3b78e-310b-40ba-9ce1-45d616c39e03 tempest-UsersV3TestJSON-753816012 tempest-UsersV3TestJSON-753816012-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10bd26ba3cc54beba9fc4fdd59b9fe76'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:11.605606 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2186/4355] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:28:11 2022] DELETE /identity/v3/users/10bd26ba3cc54beba9fc4fdd59b9fe76 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:28:11.609789 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f3b78e-310b-40ba-9ce1-45d616c39e03 tempest-UsersV3TestJSON-753816012 tempest-UsersV3TestJSON-753816012-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:11.611423 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-58f3b78e-310b-40ba-9ce1-45d616c39e03 tempest-UsersV3TestJSON-753816012 tempest-UsersV3TestJSON-753816012-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:11.631598 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0f3188-5e11-4af0-a742-be2bdfaa8ec7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d192125812e3417db2a79f342f4b0236, user_id=d1a50429fb9e4facbea13a157e38c201, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:11.639640 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0f3188-5e11-4af0-a742-be2bdfaa8ec7 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:11.689307 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2170/4356] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:28:11 2022] PUT /identity/v3/projects/d192125812e3417db2a79f342f4b0236/users/d1a50429fb9e4facbea13a157e38c201/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:28:11.691218 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b710fb74-25ea-47dc-9409-fd2700922cfd None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:11.691503 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b710fb74-25ea-47dc-9409-fd2700922cfd None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:11.691832 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b710fb74-25ea-47dc-9409-fd2700922cfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:11.734253 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f3b78e-310b-40ba-9ce1-45d616c39e03 tempest-UsersV3TestJSON-753816012 tempest-UsersV3TestJSON-753816012-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:11.755252 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-b710fb74-25ea-47dc-9409-fd2700922cfd None None] MFA Rules not processed for user `d1a50429fb9e4facbea13a157e38c201`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:28:11.756902 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-b710fb74-25ea-47dc-9409-fd2700922cfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:11.843668 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52a5dba-b42b-415a-b0eb-590af6f04919 tempest-UsersV3TestJSON-753816012 tempest-UsersV3TestJSON-753816012-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '411acf54c9074b19b9cc3fbff27e73f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d2f406f8dcd4b9683267e93d4258802', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:11.844882 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52a5dba-b42b-415a-b0eb-590af6f04919 tempest-UsersV3TestJSON-753816012 tempest-UsersV3TestJSON-753816012-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:11.845342 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52a5dba-b42b-415a-b0eb-590af6f04919 tempest-UsersV3TestJSON-753816012 tempest-UsersV3TestJSON-753816012-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:11.845943 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52a5dba-b42b-415a-b0eb-590af6f04919 tempest-UsersV3TestJSON-753816012 tempest-UsersV3TestJSON-753816012-project-admin] PATH_INFO: `/v3/users/8d256f2a7a3f4e81916f68b3e6873bf6` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:11.847639 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52a5dba-b42b-415a-b0eb-590af6f04919 tempest-UsersV3TestJSON-753816012 tempest-UsersV3TestJSON-753816012-project-admin] RBAC: Authorizing `identity:delete_user(user_id=8d256f2a7a3f4e81916f68b3e6873bf6)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:11.850324 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52a5dba-b42b-415a-b0eb-590af6f04919 tempest-UsersV3TestJSON-753816012 tempest-UsersV3TestJSON-753816012-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:11.865081 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:28:11.900745 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2171/4357] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:28:11 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:28:11.902554 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b710fb74-25ea-47dc-9409-fd2700922cfd None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:11.904226 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-b710fb74-25ea-47dc-9409-fd2700922cfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:11.928323 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-b52a5dba-b42b-415a-b0eb-590af6f04919 tempest-UsersV3TestJSON-753816012 tempest-UsersV3TestJSON-753816012-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d256f2a7a3f4e81916f68b3e6873bf6'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:11.937917 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-b52a5dba-b42b-415a-b0eb-590af6f04919 tempest-UsersV3TestJSON-753816012 tempest-UsersV3TestJSON-753816012-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d256f2a7a3f4e81916f68b3e6873bf6'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:11.938814 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-b52a5dba-b42b-415a-b0eb-590af6f04919 tempest-UsersV3TestJSON-753816012 tempest-UsersV3TestJSON-753816012-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d256f2a7a3f4e81916f68b3e6873bf6'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:11.954467 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-b52a5dba-b42b-415a-b0eb-590af6f04919 tempest-UsersV3TestJSON-753816012 tempest-UsersV3TestJSON-753816012-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d256f2a7a3f4e81916f68b3e6873bf6'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:11.983982 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:28:12.001369 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-b52a5dba-b42b-415a-b0eb-590af6f04919 tempest-UsersV3TestJSON-753816012 tempest-UsersV3TestJSON-753816012-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d256f2a7a3f4e81916f68b3e6873bf6'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:12.009419 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b710fb74-25ea-47dc-9409-fd2700922cfd None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:12.012540 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2187/4358] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:28:11 2022] DELETE /identity/v3/users/8d256f2a7a3f4e81916f68b3e6873bf6 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:28:12.018088 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52a5dba-b42b-415a-b0eb-590af6f04919 tempest-UsersV3TestJSON-753816012 tempest-UsersV3TestJSON-753816012-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:12.018843 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9788ce6-9e52-46e1-bd65-dbf557f33e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:12.019594 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9788ce6-9e52-46e1-bd65-dbf557f33e05 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:12.019926 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-b52a5dba-b42b-415a-b0eb-590af6f04919 tempest-UsersV3TestJSON-753816012 tempest-UsersV3TestJSON-753816012-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:12.020062 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9788ce6-9e52-46e1-bd65-dbf557f33e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:12.020315 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9788ce6-9e52-46e1-bd65-dbf557f33e05 admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:12.021085 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9788ce6-9e52-46e1-bd65-dbf557f33e05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:12.023292 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9788ce6-9e52-46e1-bd65-dbf557f33e05 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:12.060348 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2172/4359] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:28:11 2022] POST /identity/v3/projects => generated 409 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:28:12.065198 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9788ce6-9e52-46e1-bd65-dbf557f33e05 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:12.067273 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-a9788ce6-9e52-46e1-bd65-dbf557f33e05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:12.139740 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52a5dba-b42b-415a-b0eb-590af6f04919 tempest-UsersV3TestJSON-753816012 tempest-UsersV3TestJSON-753816012-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:12.171215 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9788ce6-9e52-46e1-bd65-dbf557f33e05 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:12.184415 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67b66eb-d1f2-4073-9a92-18a9e67fab87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:12.186556 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67b66eb-d1f2-4073-9a92-18a9e67fab87 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:12.187459 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67b66eb-d1f2-4073-9a92-18a9e67fab87 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:12.188675 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67b66eb-d1f2-4073-9a92-18a9e67fab87 admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:12.189770 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67b66eb-d1f2-4073-9a92-18a9e67fab87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:12.191997 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67b66eb-d1f2-4073-9a92-18a9e67fab87 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:12.220289 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2173/4360] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:28:12 2022] POST /identity/v3/users => generated 311 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:28:12.224703 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67b66eb-d1f2-4073-9a92-18a9e67fab87 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:12.241482 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67b66eb-d1f2-4073-9a92-18a9e67fab87 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:12.245925 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d17222-3d4b-4c33-8c65-eda11e2acdaf tempest-UsersV3TestJSON-753816012 tempest-UsersV3TestJSON-753816012-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '411acf54c9074b19b9cc3fbff27e73f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d2f406f8dcd4b9683267e93d4258802', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:12.246883 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d17222-3d4b-4c33-8c65-eda11e2acdaf tempest-UsersV3TestJSON-753816012 tempest-UsersV3TestJSON-753816012-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:12.247165 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d17222-3d4b-4c33-8c65-eda11e2acdaf tempest-UsersV3TestJSON-753816012 tempest-UsersV3TestJSON-753816012-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:12.247433 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d17222-3d4b-4c33-8c65-eda11e2acdaf tempest-UsersV3TestJSON-753816012 tempest-UsersV3TestJSON-753816012-project-admin] PATH_INFO: `/v3/domains/84a3f9eca2ee4971b65f3e3201dcb881` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:12.248682 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fc648f-c522-466c-9ffb-a0cf7d23ac92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:12.248964 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d17222-3d4b-4c33-8c65-eda11e2acdaf tempest-UsersV3TestJSON-753816012 tempest-UsersV3TestJSON-753816012-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=84a3f9eca2ee4971b65f3e3201dcb881)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:12.249508 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fc648f-c522-466c-9ffb-a0cf7d23ac92 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:12.249852 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fc648f-c522-466c-9ffb-a0cf7d23ac92 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:12.250243 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fc648f-c522-466c-9ffb-a0cf7d23ac92 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:12.250803 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d17222-3d4b-4c33-8c65-eda11e2acdaf tempest-UsersV3TestJSON-753816012 tempest-UsersV3TestJSON-753816012-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:12.251112 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fc648f-c522-466c-9ffb-a0cf7d23ac92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:12.252793 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fc648f-c522-466c-9ffb-a0cf7d23ac92 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:12.265961 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2174/4361] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:28:12 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:28:12.269002 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fc648f-c522-466c-9ffb-a0cf7d23ac92 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:12.280151 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fc648f-c522-466c-9ffb-a0cf7d23ac92 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:12.284981 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-75d17222-3d4b-4c33-8c65-eda11e2acdaf tempest-UsersV3TestJSON-753816012 tempest-UsersV3TestJSON-753816012-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '84a3f9eca2ee4971b65f3e3201dcb881'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:12.285717 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-75d17222-3d4b-4c33-8c65-eda11e2acdaf tempest-UsersV3TestJSON-753816012 tempest-UsersV3TestJSON-753816012-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '84a3f9eca2ee4971b65f3e3201dcb881'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:12.286060 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cac2b8-cc5a-475a-b641-983d720f8ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:12.287187 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cac2b8-cc5a-475a-b641-983d720f8ea9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:12.287679 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cac2b8-cc5a-475a-b641-983d720f8ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:12.288020 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cac2b8-cc5a-475a-b641-983d720f8ea9 admin admin] PATH_INFO: `/v3/projects/0d72e32ec7e74453a22ced0ab6ef47fb/users/56ab8bed45f447cabf99f5fb9b5c2eb6/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:12.315853 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:28:12.320257 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-75d17222-3d4b-4c33-8c65-eda11e2acdaf tempest-UsersV3TestJSON-753816012 tempest-UsersV3TestJSON-753816012-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '84a3f9eca2ee4971b65f3e3201dcb881'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:12.321388 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-75d17222-3d4b-4c33-8c65-eda11e2acdaf tempest-UsersV3TestJSON-753816012 tempest-UsersV3TestJSON-753816012-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '84a3f9eca2ee4971b65f3e3201dcb881'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:12.329488 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2188/4362] 10.222.0.17 () {60 vars in 1248 bytes} [Sat Jul 23 21:28:12 2022] PATCH /identity/v3/domains/84a3f9eca2ee4971b65f3e3201dcb881 => generated 277 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 21:28:12.329786 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cac2b8-cc5a-475a-b641-983d720f8ea9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d72e32ec7e74453a22ced0ab6ef47fb, user_id=56ab8bed45f447cabf99f5fb9b5c2eb6, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:12.331609 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cac2b8-cc5a-475a-b641-983d720f8ea9 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:12.331938 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d17222-3d4b-4c33-8c65-eda11e2acdaf tempest-UsersV3TestJSON-753816012 tempest-UsersV3TestJSON-753816012-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:12.333575 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-75d17222-3d4b-4c33-8c65-eda11e2acdaf tempest-UsersV3TestJSON-753816012 tempest-UsersV3TestJSON-753816012-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:12.355747 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2175/4363] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:28:12 2022] PUT /identity/v3/projects/0d72e32ec7e74453a22ced0ab6ef47fb/users/56ab8bed45f447cabf99f5fb9b5c2eb6/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:28:12.357030 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cac2b8-cc5a-475a-b641-983d720f8ea9 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:12.358933 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-81cac2b8-cc5a-475a-b641-983d720f8ea9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:12.411996 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d17222-3d4b-4c33-8c65-eda11e2acdaf tempest-UsersV3TestJSON-753816012 tempest-UsersV3TestJSON-753816012-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:12.430638 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cac2b8-cc5a-475a-b641-983d720f8ea9 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:12.436350 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fee4a8a-0449-46cc-8470-1ea8194a4964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:12.437166 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fee4a8a-0449-46cc-8470-1ea8194a4964 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:12.437452 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fee4a8a-0449-46cc-8470-1ea8194a4964 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:12.437823 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fee4a8a-0449-46cc-8470-1ea8194a4964 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:12.438601 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fee4a8a-0449-46cc-8470-1ea8194a4964 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:12.441263 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fee4a8a-0449-46cc-8470-1ea8194a4964 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:12.457608 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2176/4364] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:28:12 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:28:12.458843 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fee4a8a-0449-46cc-8470-1ea8194a4964 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:12.470273 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fee4a8a-0449-46cc-8470-1ea8194a4964 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:12.475472 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c2700a-9093-4d9c-8c17-ba3a1449be6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:12.476460 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c2700a-9093-4d9c-8c17-ba3a1449be6d admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:12.476729 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c2700a-9093-4d9c-8c17-ba3a1449be6d admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:12.477003 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c2700a-9093-4d9c-8c17-ba3a1449be6d admin admin] PATH_INFO: `/v3/projects/0d72e32ec7e74453a22ced0ab6ef47fb/users/56ab8bed45f447cabf99f5fb9b5c2eb6/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:12.479248 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c2700a-9093-4d9c-8c17-ba3a1449be6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d72e32ec7e74453a22ced0ab6ef47fb, user_id=56ab8bed45f447cabf99f5fb9b5c2eb6, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:12.482167 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c2700a-9093-4d9c-8c17-ba3a1449be6d admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:12.503084 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2177/4365] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:28:12 2022] PUT /identity/v3/projects/0d72e32ec7e74453a22ced0ab6ef47fb/users/56ab8bed45f447cabf99f5fb9b5c2eb6/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:28:12.503796 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e66ebe-e060-4862-8319-3726b8ba0f2e tempest-UsersV3TestJSON-753816012 tempest-UsersV3TestJSON-753816012-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '411acf54c9074b19b9cc3fbff27e73f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d2f406f8dcd4b9683267e93d4258802', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:12.503796 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e66ebe-e060-4862-8319-3726b8ba0f2e tempest-UsersV3TestJSON-753816012 tempest-UsersV3TestJSON-753816012-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:12.503796 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e66ebe-e060-4862-8319-3726b8ba0f2e tempest-UsersV3TestJSON-753816012 tempest-UsersV3TestJSON-753816012-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:12.504134 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e66ebe-e060-4862-8319-3726b8ba0f2e tempest-UsersV3TestJSON-753816012 tempest-UsersV3TestJSON-753816012-project-admin] PATH_INFO: `/v3/domains/84a3f9eca2ee4971b65f3e3201dcb881` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:12.505625 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c9c06c-2ffe-40eb-aa4d-93bb4be7b479 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:12.506049 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c9c06c-2ffe-40eb-aa4d-93bb4be7b479 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:12.506430 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c9c06c-2ffe-40eb-aa4d-93bb4be7b479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:12.511480 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e66ebe-e060-4862-8319-3726b8ba0f2e tempest-UsersV3TestJSON-753816012 tempest-UsersV3TestJSON-753816012-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=84a3f9eca2ee4971b65f3e3201dcb881)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:12.513119 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e66ebe-e060-4862-8319-3726b8ba0f2e tempest-UsersV3TestJSON-753816012 tempest-UsersV3TestJSON-753816012-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:12.527512 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:28:12.539923 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-a3c9c06c-2ffe-40eb-aa4d-93bb4be7b479 None None] MFA Rules not processed for user `56ab8bed45f447cabf99f5fb9b5c2eb6`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:28:12.540664 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-16e66ebe-e060-4862-8319-3726b8ba0f2e tempest-UsersV3TestJSON-753816012 tempest-UsersV3TestJSON-753816012-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '84a3f9eca2ee4971b65f3e3201dcb881'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:12.543753 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-a3c9c06c-2ffe-40eb-aa4d-93bb4be7b479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:12.551939 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-16e66ebe-e060-4862-8319-3726b8ba0f2e tempest-UsersV3TestJSON-753816012 tempest-UsersV3TestJSON-753816012-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '84a3f9eca2ee4971b65f3e3201dcb881'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:12.619214 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-16e66ebe-e060-4862-8319-3726b8ba0f2e tempest-UsersV3TestJSON-753816012 tempest-UsersV3TestJSON-753816012-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84a3f9eca2ee4971b65f3e3201dcb881', 'request_id': 'req-16e66ebe-e060-4862-8319-3726b8ba0f2e'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:12.629646 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-16e66ebe-e060-4862-8319-3726b8ba0f2e tempest-UsersV3TestJSON-753816012 tempest-UsersV3TestJSON-753816012-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84a3f9eca2ee4971b65f3e3201dcb881', 'request_id': 'req-16e66ebe-e060-4862-8319-3726b8ba0f2e'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:12.637255 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-16e66ebe-e060-4862-8319-3726b8ba0f2e tempest-UsersV3TestJSON-753816012 tempest-UsersV3TestJSON-753816012-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84a3f9eca2ee4971b65f3e3201dcb881', 'request_id': 'req-16e66ebe-e060-4862-8319-3726b8ba0f2e'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:12.646065 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2178/4366] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:28:12 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:28:12.659763 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c9c06c-2ffe-40eb-aa4d-93bb4be7b479 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:12.660102 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-16e66ebe-e060-4862-8319-3726b8ba0f2e tempest-UsersV3TestJSON-753816012 tempest-UsersV3TestJSON-753816012-project-admin] The token cache is being invalidate because project 84a3f9eca2ee4971b65f3e3201dcb881 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:28:12.660329 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-16e66ebe-e060-4862-8319-3726b8ba0f2e tempest-UsersV3TestJSON-753816012 tempest-UsersV3TestJSON-753816012-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:12.661371 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-16e66ebe-e060-4862-8319-3726b8ba0f2e tempest-UsersV3TestJSON-753816012 tempest-UsersV3TestJSON-753816012-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:12.661581 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-a3c9c06c-2ffe-40eb-aa4d-93bb4be7b479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:12.664933 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:28:12.670589 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-16e66ebe-e060-4862-8319-3726b8ba0f2e tempest-UsersV3TestJSON-753816012 tempest-UsersV3TestJSON-753816012-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '84a3f9eca2ee4971b65f3e3201dcb881', 'request_id': 'req-16e66ebe-e060-4862-8319-3726b8ba0f2e'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:12.671735 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-16e66ebe-e060-4862-8319-3726b8ba0f2e tempest-UsersV3TestJSON-753816012 tempest-UsersV3TestJSON-753816012-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '84a3f9eca2ee4971b65f3e3201dcb881', 'request_id': 'req-16e66ebe-e060-4862-8319-3726b8ba0f2e'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:12.675411 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-16e66ebe-e060-4862-8319-3726b8ba0f2e tempest-UsersV3TestJSON-753816012 tempest-UsersV3TestJSON-753816012-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '84a3f9eca2ee4971b65f3e3201dcb881', 'request_id': 'req-16e66ebe-e060-4862-8319-3726b8ba0f2e'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:12.685046 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2189/4367] 10.222.0.17 () {58 vars in 1229 bytes} [Sat Jul 23 21:28:12 2022] DELETE /identity/v3/domains/84a3f9eca2ee4971b65f3e3201dcb881 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:28:12.689027 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e66ebe-e060-4862-8319-3726b8ba0f2e tempest-UsersV3TestJSON-753816012 tempest-UsersV3TestJSON-753816012-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:12.692164 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-16e66ebe-e060-4862-8319-3726b8ba0f2e tempest-UsersV3TestJSON-753816012 tempest-UsersV3TestJSON-753816012-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:12.761533 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c9c06c-2ffe-40eb-aa4d-93bb4be7b479 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:12.793605 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e66ebe-e060-4862-8319-3726b8ba0f2e tempest-UsersV3TestJSON-753816012 tempest-UsersV3TestJSON-753816012-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:12.799138 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0c2098-16ca-4cec-a674-3a638f4ec689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:12.800912 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0c2098-16ca-4cec-a674-3a638f4ec689 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:12.801193 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0c2098-16ca-4cec-a674-3a638f4ec689 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:12.801592 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0c2098-16ca-4cec-a674-3a638f4ec689 admin admin] PATH_INFO: `/v3/users/2b1108dacf934e4c9c326d05196b9701` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:12.803051 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0c2098-16ca-4cec-a674-3a638f4ec689 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b1108dacf934e4c9c326d05196b9701)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:12.805234 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0c2098-16ca-4cec-a674-3a638f4ec689 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:12.886348 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-ab0c2098-16ca-4cec-a674-3a638f4ec689 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b1108dacf934e4c9c326d05196b9701'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:12.900811 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e26248-ac0f-4533-98d1-ac4ee90b1786 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:12.901661 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e26248-ac0f-4533-98d1-ac4ee90b1786 service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:12.901789 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e26248-ac0f-4533-98d1-ac4ee90b1786 service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:12.902000 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e26248-ac0f-4533-98d1-ac4ee90b1786 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:12.903968 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-ab0c2098-16ca-4cec-a674-3a638f4ec689 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b1108dacf934e4c9c326d05196b9701'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:12.905148 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-ab0c2098-16ca-4cec-a674-3a638f4ec689 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b1108dacf934e4c9c326d05196b9701'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:12.908759 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-76e26248-ac0f-4533-98d1-ac4ee90b1786 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:12.920080 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-ab0c2098-16ca-4cec-a674-3a638f4ec689 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b1108dacf934e4c9c326d05196b9701'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:12.947415 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-ab0c2098-16ca-4cec-a674-3a638f4ec689 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b1108dacf934e4c9c326d05196b9701'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:12.966439 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2190/4368] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:28:12 2022] DELETE /identity/v3/users/2b1108dacf934e4c9c326d05196b9701 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:28:12.967999 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac97aa64-b230-41ce-b823-b44ff451f793 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:12.968283 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac97aa64-b230-41ce-b823-b44ff451f793 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:12.968555 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac97aa64-b230-41ce-b823-b44ff451f793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:13.011081 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-ac97aa64-b230-41ce-b823-b44ff451f793 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:28:13.012256 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-ac97aa64-b230-41ce-b823-b44ff451f793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:13.054823 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e26248-ac0f-4533-98d1-ac4ee90b1786 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:13.056518 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e26248-ac0f-4533-98d1-ac4ee90b1786 service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:13.067897 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:28:13.080569 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2179/4369] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:28:12 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:28:13.210190 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2191/4370] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:28:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:28:13.316011 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e26248-ac0f-4533-98d1-ac4ee90b1786 service neutron] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:13.323751 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-76e26248-ac0f-4533-98d1-ac4ee90b1786 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:13.351915 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e26248-ac0f-4533-98d1-ac4ee90b1786 service neutron] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:13.365504 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac97aa64-b230-41ce-b823-b44ff451f793 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:13.367134 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-ac97aa64-b230-41ce-b823-b44ff451f793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:13.377950 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:28:13.388437 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac97aa64-b230-41ce-b823-b44ff451f793 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:13.412610 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe3460e-6f05-4f50-bfbc-05d9f06733b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:13.413572 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe3460e-6f05-4f50-bfbc-05d9f06733b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:13.416451 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe3460e-6f05-4f50-bfbc-05d9f06733b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:13.416876 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe3460e-6f05-4f50-bfbc-05d9f06733b2 admin admin] PATH_INFO: `/v3/users/c8c3d58265714ebba65b1510bd768e19` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:13.418679 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe3460e-6f05-4f50-bfbc-05d9f06733b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8c3d58265714ebba65b1510bd768e19)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:13.423344 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe3460e-6f05-4f50-bfbc-05d9f06733b2 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:13.519251 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3339d2fe-fd68-4b97-a4a0-dba05df823f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:13.519921 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3339d2fe-fd68-4b97-a4a0-dba05df823f6 service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:13.520205 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3339d2fe-fd68-4b97-a4a0-dba05df823f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:13.522666 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3339d2fe-fd68-4b97-a4a0-dba05df823f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:13.542297 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-5fe3460e-6f05-4f50-bfbc-05d9f06733b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8c3d58265714ebba65b1510bd768e19'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:13.543760 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3339d2fe-fd68-4b97-a4a0-dba05df823f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:13.545260 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3339d2fe-fd68-4b97-a4a0-dba05df823f6 service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:13.560736 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-5fe3460e-6f05-4f50-bfbc-05d9f06733b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8c3d58265714ebba65b1510bd768e19'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:13.561909 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-5fe3460e-6f05-4f50-bfbc-05d9f06733b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8c3d58265714ebba65b1510bd768e19'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:13.571726 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2180/4371] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:28:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:28:13.580927 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-5fe3460e-6f05-4f50-bfbc-05d9f06733b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8c3d58265714ebba65b1510bd768e19'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:13.604450 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-5fe3460e-6f05-4f50-bfbc-05d9f06733b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8c3d58265714ebba65b1510bd768e19'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:13.615950 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2192/4372] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:28:13 2022] DELETE /identity/v3/users/c8c3d58265714ebba65b1510bd768e19 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:28:14.199797 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3339d2fe-fd68-4b97-a4a0-dba05df823f6 service neutron] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:14.212494 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3339d2fe-fd68-4b97-a4a0-dba05df823f6 service neutron] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:14.347649 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237da2af-5a21-4061-ae63-a5b2408e8d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:14.349888 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237da2af-5a21-4061-ae63-a5b2408e8d82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:14.350522 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237da2af-5a21-4061-ae63-a5b2408e8d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:14.350983 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237da2af-5a21-4061-ae63-a5b2408e8d82 admin admin] PATH_INFO: `/v3/projects/5afdbc378ad64fc58903ea2518717005` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:14.354313 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237da2af-5a21-4061-ae63-a5b2408e8d82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5afdbc378ad64fc58903ea2518717005)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:14.357703 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237da2af-5a21-4061-ae63-a5b2408e8d82 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:14.385348 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe3460e-6f05-4f50-bfbc-05d9f06733b2 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:14.387381 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-5fe3460e-6f05-4f50-bfbc-05d9f06733b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:14.417935 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe3460e-6f05-4f50-bfbc-05d9f06733b2 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:14.428108 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef91fec-8f69-4622-aa0d-6df30aebae21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:14.429527 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef91fec-8f69-4622-aa0d-6df30aebae21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:14.430042 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef91fec-8f69-4622-aa0d-6df30aebae21 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:14.430462 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef91fec-8f69-4622-aa0d-6df30aebae21 admin admin] PATH_INFO: `/v3/projects/2027486f1a7b42babefcd2c978363d55` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:14.432260 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef91fec-8f69-4622-aa0d-6df30aebae21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2027486f1a7b42babefcd2c978363d55)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:14.436401 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef91fec-8f69-4622-aa0d-6df30aebae21 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:14.444306 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-237da2af-5a21-4061-ae63-a5b2408e8d82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5afdbc378ad64fc58903ea2518717005', 'request_id': 'req-237da2af-5a21-4061-ae63-a5b2408e8d82'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:14.459247 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-237da2af-5a21-4061-ae63-a5b2408e8d82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5afdbc378ad64fc58903ea2518717005', 'request_id': 'req-237da2af-5a21-4061-ae63-a5b2408e8d82'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:14.484298 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-237da2af-5a21-4061-ae63-a5b2408e8d82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5afdbc378ad64fc58903ea2518717005', 'request_id': 'req-237da2af-5a21-4061-ae63-a5b2408e8d82'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:14.501419 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-237da2af-5a21-4061-ae63-a5b2408e8d82 admin admin] The token cache is being invalidate because project 5afdbc378ad64fc58903ea2518717005 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:28:14.501648 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-237da2af-5a21-4061-ae63-a5b2408e8d82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:14.502462 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-237da2af-5a21-4061-ae63-a5b2408e8d82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:14.505761 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2181/4373] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:28:14 2022] DELETE /identity/v3/projects/5afdbc378ad64fc58903ea2518717005 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:28:14.510459 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e382032-32d2-4ca6-adf5-73861e4326a7 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:14.510804 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e382032-32d2-4ca6-adf5-73861e4326a7 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:14.511138 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e382032-32d2-4ca6-adf5-73861e4326a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:14.561066 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-8e382032-32d2-4ca6-adf5-73861e4326a7 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:28:14.562673 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-8e382032-32d2-4ca6-adf5-73861e4326a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:14.582831 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-6ef91fec-8f69-4622-aa0d-6df30aebae21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2027486f1a7b42babefcd2c978363d55', 'request_id': 'req-6ef91fec-8f69-4622-aa0d-6df30aebae21'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:14.595373 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-6ef91fec-8f69-4622-aa0d-6df30aebae21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2027486f1a7b42babefcd2c978363d55', 'request_id': 'req-6ef91fec-8f69-4622-aa0d-6df30aebae21'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:14.607577 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:28:14.617350 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-6ef91fec-8f69-4622-aa0d-6df30aebae21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2027486f1a7b42babefcd2c978363d55', 'request_id': 'req-6ef91fec-8f69-4622-aa0d-6df30aebae21'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:14.656805 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2182/4374] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:28:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:28:14.657311 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-6ef91fec-8f69-4622-aa0d-6df30aebae21 admin admin] The token cache is being invalidate because project 2027486f1a7b42babefcd2c978363d55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:28:14.658057 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-6ef91fec-8f69-4622-aa0d-6df30aebae21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:14.663666 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-6ef91fec-8f69-4622-aa0d-6df30aebae21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:14.666458 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289f9f18-4aef-4da3-acbc-a8d61d0852c9 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:14.666966 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2193/4375] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:28:14 2022] DELETE /identity/v3/projects/2027486f1a7b42babefcd2c978363d55 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:28:14.667230 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289f9f18-4aef-4da3-acbc-a8d61d0852c9 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:14.667921 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289f9f18-4aef-4da3-acbc-a8d61d0852c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:14.670551 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef91fec-8f69-4622-aa0d-6df30aebae21 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:14.674660 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-6ef91fec-8f69-4622-aa0d-6df30aebae21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:14.700124 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-289f9f18-4aef-4da3-acbc-a8d61d0852c9 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:28:14.701832 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-289f9f18-4aef-4da3-acbc-a8d61d0852c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:14.703790 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef91fec-8f69-4622-aa0d-6df30aebae21 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:14.713761 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f502754-0cbf-4ba9-81bd-2d994d24d3c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:14.717058 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f502754-0cbf-4ba9-81bd-2d994d24d3c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:14.717581 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f502754-0cbf-4ba9-81bd-2d994d24d3c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:14.717762 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2183/4376] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:28:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:28:14.718324 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f502754-0cbf-4ba9-81bd-2d994d24d3c5 admin admin] PATH_INFO: `/v3/users/411acf54c9074b19b9cc3fbff27e73f8` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:14.719457 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289f9f18-4aef-4da3-acbc-a8d61d0852c9 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:14.722300 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f502754-0cbf-4ba9-81bd-2d994d24d3c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=411acf54c9074b19b9cc3fbff27e73f8)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:14.727120 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f502754-0cbf-4ba9-81bd-2d994d24d3c5 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:14.734947 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289f9f18-4aef-4da3-acbc-a8d61d0852c9 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:14.744996 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4472bc-2209-4e40-844e-b72c937e97e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:14.745779 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4472bc-2209-4e40-844e-b72c937e97e8 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:14.746328 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4472bc-2209-4e40-844e-b72c937e97e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:14.746693 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4472bc-2209-4e40-844e-b72c937e97e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:14.747492 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4472bc-2209-4e40-844e-b72c937e97e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:28:14.747849 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4472bc-2209-4e40-844e-b72c937e97e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:14.749709 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4472bc-2209-4e40-844e-b72c937e97e8 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:14.769992 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2184/4377] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:28:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:28:14.775477 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4472bc-2209-4e40-844e-b72c937e97e8 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:14.789063 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4472bc-2209-4e40-844e-b72c937e97e8 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:14.795925 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38955ab-f193-44fa-9476-3d07e40152ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:14.796751 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38955ab-f193-44fa-9476-3d07e40152ce admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:14.797110 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38955ab-f193-44fa-9476-3d07e40152ce admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:14.797499 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38955ab-f193-44fa-9476-3d07e40152ce admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:14.798344 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38955ab-f193-44fa-9476-3d07e40152ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:14.801431 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38955ab-f193-44fa-9476-3d07e40152ce admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:14.841404 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-3f502754-0cbf-4ba9-81bd-2d994d24d3c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '411acf54c9074b19b9cc3fbff27e73f8'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:14.852494 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=74,keystone:DELETE=24,keystone:INSERT=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:28:14.855057 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-3f502754-0cbf-4ba9-81bd-2d994d24d3c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '411acf54c9074b19b9cc3fbff27e73f8'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:14.856139 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-3f502754-0cbf-4ba9-81bd-2d994d24d3c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '411acf54c9074b19b9cc3fbff27e73f8'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:14.876183 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-3f502754-0cbf-4ba9-81bd-2d994d24d3c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '411acf54c9074b19b9cc3fbff27e73f8'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:14.886870 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2185/4378] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:28:14 2022] POST /identity/v3/projects => generated 389 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:28:14.889484 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38955ab-f193-44fa-9476-3d07e40152ce admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:14.901201 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-3f502754-0cbf-4ba9-81bd-2d994d24d3c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '411acf54c9074b19b9cc3fbff27e73f8'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:14.914021 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2194/4379] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:28:14 2022] DELETE /identity/v3/users/411acf54c9074b19b9cc3fbff27e73f8 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:28:14.974876 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38955ab-f193-44fa-9476-3d07e40152ce admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:15.078810 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee82e0f1-9adf-4247-b43e-afa1a4f050fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:15.079566 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee82e0f1-9adf-4247-b43e-afa1a4f050fa admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:15.079888 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee82e0f1-9adf-4247-b43e-afa1a4f050fa admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:15.080266 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee82e0f1-9adf-4247-b43e-afa1a4f050fa admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:15.080849 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee82e0f1-9adf-4247-b43e-afa1a4f050fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:15.083942 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee82e0f1-9adf-4247-b43e-afa1a4f050fa admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:15.118966 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2186/4380] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:28:14 2022] POST /identity/v3/users => generated 295 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:28:15.123201 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f502754-0cbf-4ba9-81bd-2d994d24d3c5 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:15.125107 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-3f502754-0cbf-4ba9-81bd-2d994d24d3c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:15.145527 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f502754-0cbf-4ba9-81bd-2d994d24d3c5 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:15.152547 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66915211-9863-4ccc-9b9e-bbe9b1c5e817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:15.153531 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66915211-9863-4ccc-9b9e-bbe9b1c5e817 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:15.153937 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66915211-9863-4ccc-9b9e-bbe9b1c5e817 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:15.154705 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66915211-9863-4ccc-9b9e-bbe9b1c5e817 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:15.155467 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66915211-9863-4ccc-9b9e-bbe9b1c5e817 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:15.158100 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66915211-9863-4ccc-9b9e-bbe9b1c5e817 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:15.175777 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee82e0f1-9adf-4247-b43e-afa1a4f050fa admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:15.176610 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2195/4381] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:28:15 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:28:15.189839 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee82e0f1-9adf-4247-b43e-afa1a4f050fa admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:15.197899 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8201fe05-778c-4090-9728-59d18c8a06cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:15.199084 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8201fe05-778c-4090-9728-59d18c8a06cf admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:15.200884 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8201fe05-778c-4090-9728-59d18c8a06cf admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:15.201292 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8201fe05-778c-4090-9728-59d18c8a06cf admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:15.202421 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8201fe05-778c-4090-9728-59d18c8a06cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:15.204442 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8201fe05-778c-4090-9728-59d18c8a06cf admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:15.226235 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66915211-9863-4ccc-9b9e-bbe9b1c5e817 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:15.234825 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2187/4382] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:28:15 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:28:15.240916 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66915211-9863-4ccc-9b9e-bbe9b1c5e817 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:15.246943 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26871ca2-105a-4108-a6b6-b346a2334cf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:15.247854 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26871ca2-105a-4108-a6b6-b346a2334cf7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:15.248398 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26871ca2-105a-4108-a6b6-b346a2334cf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:15.248768 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26871ca2-105a-4108-a6b6-b346a2334cf7 admin admin] PATH_INFO: `/v3/projects/15e47587982546ff87e06be741d68b96/users/a7a723a102d34fbfa2662b07f9b10fc8/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:15.271608 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26871ca2-105a-4108-a6b6-b346a2334cf7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15e47587982546ff87e06be741d68b96, user_id=a7a723a102d34fbfa2662b07f9b10fc8, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:15.274832 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26871ca2-105a-4108-a6b6-b346a2334cf7 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:15.302551 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5d9cfd-56de-48b5-b4a1-4d9c0bc0200b None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:15.304492 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5d9cfd-56de-48b5-b4a1-4d9c0bc0200b None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:15.304492 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5d9cfd-56de-48b5-b4a1-4d9c0bc0200b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:15.312040 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2196/4383] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:28:15 2022] PUT /identity/v3/projects/15e47587982546ff87e06be741d68b96/users/a7a723a102d34fbfa2662b07f9b10fc8/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:28:15.326088 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-9f5d9cfd-56de-48b5-b4a1-4d9c0bc0200b None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:28:15.327412 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-9f5d9cfd-56de-48b5-b4a1-4d9c0bc0200b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:15.346221 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:28:15.523094 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2188/4384] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:28:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:28:15.538533 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26871ca2-105a-4108-a6b6-b346a2334cf7 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:15.542199 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-26871ca2-105a-4108-a6b6-b346a2334cf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:15.652469 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26871ca2-105a-4108-a6b6-b346a2334cf7 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:15.657703 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721a7339-ed7d-429f-b12a-0923cab8e409 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:15.659043 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721a7339-ed7d-429f-b12a-0923cab8e409 service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:15.659893 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721a7339-ed7d-429f-b12a-0923cab8e409 service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:15.660368 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721a7339-ed7d-429f-b12a-0923cab8e409 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:15.673359 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721a7339-ed7d-429f-b12a-0923cab8e409 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:15.675466 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721a7339-ed7d-429f-b12a-0923cab8e409 service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:15.687519 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2197/4385] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:28:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:28:16.067635 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5d9cfd-56de-48b5-b4a1-4d9c0bc0200b None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:16.070569 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-9f5d9cfd-56de-48b5-b4a1-4d9c0bc0200b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:16.094840 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5d9cfd-56de-48b5-b4a1-4d9c0bc0200b None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:16.117689 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ca650f-36c5-4702-a79d-f154c294b9b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:16.118676 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ca650f-36c5-4702-a79d-f154c294b9b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:16.118889 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ca650f-36c5-4702-a79d-f154c294b9b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:16.119116 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ca650f-36c5-4702-a79d-f154c294b9b1 admin admin] PATH_INFO: `/v3/projects/0d2f406f8dcd4b9683267e93d4258802` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:16.122873 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ca650f-36c5-4702-a79d-f154c294b9b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d2f406f8dcd4b9683267e93d4258802)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:16.130115 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ca650f-36c5-4702-a79d-f154c294b9b1 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:16.258484 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-a6ca650f-36c5-4702-a79d-f154c294b9b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d2f406f8dcd4b9683267e93d4258802', 'request_id': 'req-a6ca650f-36c5-4702-a79d-f154c294b9b1'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:16.277351 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-a6ca650f-36c5-4702-a79d-f154c294b9b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d2f406f8dcd4b9683267e93d4258802', 'request_id': 'req-a6ca650f-36c5-4702-a79d-f154c294b9b1'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:16.288950 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-a6ca650f-36c5-4702-a79d-f154c294b9b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d2f406f8dcd4b9683267e93d4258802', 'request_id': 'req-a6ca650f-36c5-4702-a79d-f154c294b9b1'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:16.302868 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-a6ca650f-36c5-4702-a79d-f154c294b9b1 admin admin] The token cache is being invalidate because project 0d2f406f8dcd4b9683267e93d4258802 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:28:16.303420 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-a6ca650f-36c5-4702-a79d-f154c294b9b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:16.304454 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-a6ca650f-36c5-4702-a79d-f154c294b9b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:16.306614 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2189/4386] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:28:16 2022] DELETE /identity/v3/projects/0d2f406f8dcd4b9683267e93d4258802 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:28:16.311451 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f55a367-db58-493c-b525-90f0feb1df42 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:16.311737 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f55a367-db58-493c-b525-90f0feb1df42 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:16.312013 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f55a367-db58-493c-b525-90f0feb1df42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:16.342048 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-0f55a367-db58-493c-b525-90f0feb1df42 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:28:16.344960 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-0f55a367-db58-493c-b525-90f0feb1df42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:16.688553 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2198/4387] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:28:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 378 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:28:16.697574 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eece4131-52ae-4cbc-9e00-d15699009932 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:16.697940 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eece4131-52ae-4cbc-9e00-d15699009932 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:16.698244 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eece4131-52ae-4cbc-9e00-d15699009932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:16.736566 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-eece4131-52ae-4cbc-9e00-d15699009932 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:28:16.740630 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-eece4131-52ae-4cbc-9e00-d15699009932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:16.765515 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2190/4388] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:28:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:28:16.769926 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f55a367-db58-493c-b525-90f0feb1df42 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:16.783833 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f55a367-db58-493c-b525-90f0feb1df42 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:16.801152 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a55d77-4582-4e30-b521-85dd8848bd4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:16.802479 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a55d77-4582-4e30-b521-85dd8848bd4e admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:16.803760 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a55d77-4582-4e30-b521-85dd8848bd4e admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:16.804260 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a55d77-4582-4e30-b521-85dd8848bd4e admin admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:16.831321 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a55d77-4582-4e30-b521-85dd8848bd4e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:28:16.831693 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a55d77-4582-4e30-b521-85dd8848bd4e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:16.833306 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a55d77-4582-4e30-b521-85dd8848bd4e admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:16.878529 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2199/4389] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:28:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:28:16.881196 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eece4131-52ae-4cbc-9e00-d15699009932 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:16.898667 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eece4131-52ae-4cbc-9e00-d15699009932 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:16.911256 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a55d77-4582-4e30-b521-85dd8848bd4e admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:16.913223 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-00a55d77-4582-4e30-b521-85dd8848bd4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:16.915737 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7699da9f-0e9d-4494-baaa-c336e265797f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:16.917721 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7699da9f-0e9d-4494-baaa-c336e265797f admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:16.917721 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7699da9f-0e9d-4494-baaa-c336e265797f admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:16.917721 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7699da9f-0e9d-4494-baaa-c336e265797f admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:16.918053 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7699da9f-0e9d-4494-baaa-c336e265797f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:16.920347 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7699da9f-0e9d-4494-baaa-c336e265797f admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:16.929645 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a55d77-4582-4e30-b521-85dd8848bd4e admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:16.938476 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86d158c-6676-41e6-b3f8-baeb5e42ac24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:16.939459 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86d158c-6676-41e6-b3f8-baeb5e42ac24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:16.939793 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86d158c-6676-41e6-b3f8-baeb5e42ac24 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:16.940152 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86d158c-6676-41e6-b3f8-baeb5e42ac24 admin admin] PATH_INFO: `/v3/users/d1a50429fb9e4facbea13a157e38c201` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:16.941762 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86d158c-6676-41e6-b3f8-baeb5e42ac24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1a50429fb9e4facbea13a157e38c201)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:16.944071 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86d158c-6676-41e6-b3f8-baeb5e42ac24 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:16.969292 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:28:16.989551 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2191/4390] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:28:16 2022] POST /identity/v3/projects => generated 369 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:28:16.991088 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7699da9f-0e9d-4494-baaa-c336e265797f admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:17.021389 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-b86d158c-6676-41e6-b3f8-baeb5e42ac24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1a50429fb9e4facbea13a157e38c201'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:17.029363 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-b86d158c-6676-41e6-b3f8-baeb5e42ac24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1a50429fb9e4facbea13a157e38c201'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:17.030149 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-b86d158c-6676-41e6-b3f8-baeb5e42ac24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1a50429fb9e4facbea13a157e38c201'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:17.042143 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-b86d158c-6676-41e6-b3f8-baeb5e42ac24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1a50429fb9e4facbea13a157e38c201'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:17.058881 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-b86d158c-6676-41e6-b3f8-baeb5e42ac24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1a50429fb9e4facbea13a157e38c201'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:17.073710 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2200/4391] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:28:16 2022] DELETE /identity/v3/users/d1a50429fb9e4facbea13a157e38c201 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:28:17.078140 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcf7704-ac44-414b-bee1-3a98a0ca3d80 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:17.078616 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcf7704-ac44-414b-bee1-3a98a0ca3d80 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:17.078832 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7699da9f-0e9d-4494-baaa-c336e265797f admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:17.079677 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcf7704-ac44-414b-bee1-3a98a0ca3d80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:17.103095 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-9fcf7704-ac44-414b-bee1-3a98a0ca3d80 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:28:17.104658 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-9fcf7704-ac44-414b-bee1-3a98a0ca3d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:17.119454 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:28:17.170487 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e183e2ec-8e87-465e-a979-bc81a602d5a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:17.172161 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e183e2ec-8e87-465e-a979-bc81a602d5a4 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:17.172717 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e183e2ec-8e87-465e-a979-bc81a602d5a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:17.173225 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e183e2ec-8e87-465e-a979-bc81a602d5a4 admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:17.174141 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e183e2ec-8e87-465e-a979-bc81a602d5a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:17.176740 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e183e2ec-8e87-465e-a979-bc81a602d5a4 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:17.203775 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2192/4392] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:28:16 2022] POST /identity/v3/users => generated 285 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:28:17.206997 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2201/4393] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:28:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:28:17.208057 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e183e2ec-8e87-465e-a979-bc81a602d5a4 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:17.211966 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-e183e2ec-8e87-465e-a979-bc81a602d5a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:17.219009 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcf7704-ac44-414b-bee1-3a98a0ca3d80 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:17.220835 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-9fcf7704-ac44-414b-bee1-3a98a0ca3d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:17.277179 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e183e2ec-8e87-465e-a979-bc81a602d5a4 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:17.307976 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ed01a0-1798-4ae0-b99b-d67cd9975d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:17.307976 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ed01a0-1798-4ae0-b99b-d67cd9975d82 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:17.307976 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ed01a0-1798-4ae0-b99b-d67cd9975d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:17.307976 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ed01a0-1798-4ae0-b99b-d67cd9975d82 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:17.311809 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ed01a0-1798-4ae0-b99b-d67cd9975d82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:17.313915 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ed01a0-1798-4ae0-b99b-d67cd9975d82 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:17.348602 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2193/4394] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:28:17 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:28:17.359521 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcf7704-ac44-414b-bee1-3a98a0ca3d80 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:17.361007 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ed01a0-1798-4ae0-b99b-d67cd9975d82 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:17.365895 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271c2323-9c6f-49bb-a863-d158b99ed698 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:17.367365 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271c2323-9c6f-49bb-a863-d158b99ed698 service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:17.367959 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271c2323-9c6f-49bb-a863-d158b99ed698 service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:17.368329 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271c2323-9c6f-49bb-a863-d158b99ed698 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:17.383776 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ed01a0-1798-4ae0-b99b-d67cd9975d82 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:17.388103 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271c2323-9c6f-49bb-a863-d158b99ed698 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:17.389790 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271c2323-9c6f-49bb-a863-d158b99ed698 service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:17.392340 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaa2c68-76df-452d-b510-0eb1fe11bc7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:17.393040 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaa2c68-76df-452d-b510-0eb1fe11bc7f admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:17.393844 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaa2c68-76df-452d-b510-0eb1fe11bc7f admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:17.394292 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaa2c68-76df-452d-b510-0eb1fe11bc7f admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:17.395031 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaa2c68-76df-452d-b510-0eb1fe11bc7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:17.397502 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaa2c68-76df-452d-b510-0eb1fe11bc7f admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:17.422169 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2194/4395] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:28:17 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:28:17.424252 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaa2c68-76df-452d-b510-0eb1fe11bc7f admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:17.432190 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2202/4396] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:28:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:28:17.468671 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaa2c68-76df-452d-b510-0eb1fe11bc7f admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:17.485768 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2e126a-073d-4a3a-8314-c57d37f849c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:17.486706 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2e126a-073d-4a3a-8314-c57d37f849c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:17.488394 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2e126a-073d-4a3a-8314-c57d37f849c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:17.488682 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2e126a-073d-4a3a-8314-c57d37f849c4 admin admin] PATH_INFO: `/v3/projects/fd5e3928deee435fa596bd9d0589e99b/users/751126618a9c4d628ecc20d6424b813d/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:17.517788 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2e126a-073d-4a3a-8314-c57d37f849c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd5e3928deee435fa596bd9d0589e99b, user_id=751126618a9c4d628ecc20d6424b813d, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:17.524869 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2e126a-073d-4a3a-8314-c57d37f849c4 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:17.560119 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2195/4397] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:28:17 2022] PUT /identity/v3/projects/fd5e3928deee435fa596bd9d0589e99b/users/751126618a9c4d628ecc20d6424b813d/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:28:17.563298 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cdc77e-3da5-403a-83db-ab3723bb2306 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:17.563746 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cdc77e-3da5-403a-83db-ab3723bb2306 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:17.564102 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cdc77e-3da5-403a-83db-ab3723bb2306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:17.632996 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-b0cdc77e-3da5-403a-83db-ab3723bb2306 None None] MFA Rules not processed for user `751126618a9c4d628ecc20d6424b813d`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:28:17.635518 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-b0cdc77e-3da5-403a-83db-ab3723bb2306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:17.690626 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:28:17.795037 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2e126a-073d-4a3a-8314-c57d37f849c4 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:17.819010 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2203/4398] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:28:17 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:28:17.957707 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2e126a-073d-4a3a-8314-c57d37f849c4 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:17.971602 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fcc0ae-0cde-4da1-b690-a03ceeb4fc64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:17.972641 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fcc0ae-0cde-4da1-b690-a03ceeb4fc64 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:17.973177 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fcc0ae-0cde-4da1-b690-a03ceeb4fc64 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:17.973633 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fcc0ae-0cde-4da1-b690-a03ceeb4fc64 admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:17.974502 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fcc0ae-0cde-4da1-b690-a03ceeb4fc64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:17.976995 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fcc0ae-0cde-4da1-b690-a03ceeb4fc64 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:17.998582 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cdc77e-3da5-403a-83db-ab3723bb2306 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:18.000540 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-b0cdc77e-3da5-403a-83db-ab3723bb2306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:18.050690 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2196/4399] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:28:17 2022] POST /identity/v3/projects => generated 367 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:28:18.069650 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fcc0ae-0cde-4da1-b690-a03ceeb4fc64 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:18.071213 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cdc77e-3da5-403a-83db-ab3723bb2306 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:18.193304 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e94860-f691-4daa-935d-403a973faf82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:18.195160 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e94860-f691-4daa-935d-403a973faf82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:18.198364 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e94860-f691-4daa-935d-403a973faf82 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:18.198934 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e94860-f691-4daa-935d-403a973faf82 admin admin] PATH_INFO: `/v3/projects/d192125812e3417db2a79f342f4b0236` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:18.201074 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:28:18.207807 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e94860-f691-4daa-935d-403a973faf82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d192125812e3417db2a79f342f4b0236)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:18.214502 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e94860-f691-4daa-935d-403a973faf82 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:18.228630 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fcc0ae-0cde-4da1-b690-a03ceeb4fc64 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:18.233475 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33d96c2-5720-46cc-bbd2-ab82eeaddc54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:18.234331 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33d96c2-5720-46cc-bbd2-ab82eeaddc54 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:18.234494 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33d96c2-5720-46cc-bbd2-ab82eeaddc54 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:18.234771 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33d96c2-5720-46cc-bbd2-ab82eeaddc54 admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:18.235464 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33d96c2-5720-46cc-bbd2-ab82eeaddc54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:18.238099 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33d96c2-5720-46cc-bbd2-ab82eeaddc54 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:18.279514 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2197/4400] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:28:18 2022] POST /identity/v3/users => generated 290 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:28:18.284156 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33d96c2-5720-46cc-bbd2-ab82eeaddc54 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:18.300920 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33d96c2-5720-46cc-bbd2-ab82eeaddc54 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:18.313591 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-53e94860-f691-4daa-935d-403a973faf82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd192125812e3417db2a79f342f4b0236', 'request_id': 'req-53e94860-f691-4daa-935d-403a973faf82'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:18.332695 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-53e94860-f691-4daa-935d-403a973faf82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd192125812e3417db2a79f342f4b0236', 'request_id': 'req-53e94860-f691-4daa-935d-403a973faf82'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:18.344173 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-53e94860-f691-4daa-935d-403a973faf82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd192125812e3417db2a79f342f4b0236', 'request_id': 'req-53e94860-f691-4daa-935d-403a973faf82'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:18.373724 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-53e94860-f691-4daa-935d-403a973faf82 admin admin] The token cache is being invalidate because project d192125812e3417db2a79f342f4b0236 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:28:18.374942 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-53e94860-f691-4daa-935d-403a973faf82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:18.376015 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-53e94860-f691-4daa-935d-403a973faf82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:18.379118 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2204/4401] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:28:17 2022] DELETE /identity/v3/projects/d192125812e3417db2a79f342f4b0236 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:28:18.383411 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e94860-f691-4daa-935d-403a973faf82 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:18.391818 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-53e94860-f691-4daa-935d-403a973faf82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:18.419950 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5700534-286c-4b5b-ab63-593465cfb827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:18.420729 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5700534-286c-4b5b-ab63-593465cfb827 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:18.421082 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5700534-286c-4b5b-ab63-593465cfb827 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:18.421427 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5700534-286c-4b5b-ab63-593465cfb827 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:18.422477 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5700534-286c-4b5b-ab63-593465cfb827 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:18.426457 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5700534-286c-4b5b-ab63-593465cfb827 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:18.461437 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2198/4402] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:28:18 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:28:18.463108 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5700534-286c-4b5b-ab63-593465cfb827 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:18.468112 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-c5700534-286c-4b5b-ab63-593465cfb827 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:18.501785 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5700534-286c-4b5b-ab63-593465cfb827 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:18.511532 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bc7f8d-b9ae-4a52-a151-835c57d140f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:18.512453 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bc7f8d-b9ae-4a52-a151-835c57d140f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:18.512732 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bc7f8d-b9ae-4a52-a151-835c57d140f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:18.513004 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bc7f8d-b9ae-4a52-a151-835c57d140f9 admin admin] PATH_INFO: `/v3/projects/d978e54fd1eb48a0b3528526052986c0/users/8f188ef6022445d5b0a95ea953d66869/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:18.524107 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e94860-f691-4daa-935d-403a973faf82 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:18.531349 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56f9e81-b5c3-4d87-b05e-e3884287889d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:18.532562 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56f9e81-b5c3-4d87-b05e-e3884287889d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:18.533029 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56f9e81-b5c3-4d87-b05e-e3884287889d admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:18.533516 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56f9e81-b5c3-4d87-b05e-e3884287889d admin admin] PATH_INFO: `/v3/users/56ab8bed45f447cabf99f5fb9b5c2eb6` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:18.536186 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56f9e81-b5c3-4d87-b05e-e3884287889d admin admin] RBAC: Authorizing `identity:delete_user(user_id=56ab8bed45f447cabf99f5fb9b5c2eb6)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:18.540894 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56f9e81-b5c3-4d87-b05e-e3884287889d admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:18.543991 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bc7f8d-b9ae-4a52-a151-835c57d140f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d978e54fd1eb48a0b3528526052986c0, user_id=8f188ef6022445d5b0a95ea953d66869, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:18.546799 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bc7f8d-b9ae-4a52-a151-835c57d140f9 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:18.547343 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:28:18.574696 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2199/4403] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:28:18 2022] PUT /identity/v3/projects/d978e54fd1eb48a0b3528526052986c0/users/8f188ef6022445d5b0a95ea953d66869/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:28:18.578863 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bc7f8d-b9ae-4a52-a151-835c57d140f9 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:18.631073 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-b56f9e81-b5c3-4d87-b05e-e3884287889d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56ab8bed45f447cabf99f5fb9b5c2eb6'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:18.642119 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-b56f9e81-b5c3-4d87-b05e-e3884287889d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56ab8bed45f447cabf99f5fb9b5c2eb6'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:18.643020 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-b56f9e81-b5c3-4d87-b05e-e3884287889d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56ab8bed45f447cabf99f5fb9b5c2eb6'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:18.667236 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-b56f9e81-b5c3-4d87-b05e-e3884287889d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56ab8bed45f447cabf99f5fb9b5c2eb6'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:18.689232 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-b56f9e81-b5c3-4d87-b05e-e3884287889d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56ab8bed45f447cabf99f5fb9b5c2eb6'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:18.700032 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2205/4404] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:28:18 2022] DELETE /identity/v3/users/56ab8bed45f447cabf99f5fb9b5c2eb6 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:28:18.708167 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bc7f8d-b9ae-4a52-a151-835c57d140f9 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:18.798804 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:28:18.814015 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fabd9b-1500-4878-8630-a3e6ae61a8ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:18.814015 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fabd9b-1500-4878-8630-a3e6ae61a8ed admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:18.814015 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fabd9b-1500-4878-8630-a3e6ae61a8ed admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:18.814015 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fabd9b-1500-4878-8630-a3e6ae61a8ed admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:18.814630 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fabd9b-1500-4878-8630-a3e6ae61a8ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:18.815957 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fabd9b-1500-4878-8630-a3e6ae61a8ed admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:18.833563 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2200/4405] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:28:18 2022] GET /identity/v3/roles => generated 1420 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 21:28:18.838437 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56f9e81-b5c3-4d87-b05e-e3884287889d admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:18.841290 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-b56f9e81-b5c3-4d87-b05e-e3884287889d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:18.857389 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56f9e81-b5c3-4d87-b05e-e3884287889d admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:18.865104 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3685d063-248f-4262-aba1-69594b0dcd08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:18.877126 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3685d063-248f-4262-aba1-69594b0dcd08 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:18.877236 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3685d063-248f-4262-aba1-69594b0dcd08 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:18.877554 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3685d063-248f-4262-aba1-69594b0dcd08 admin admin] PATH_INFO: `/v3/projects/d978e54fd1eb48a0b3528526052986c0/users/8f188ef6022445d5b0a95ea953d66869/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:18.879957 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3685d063-248f-4262-aba1-69594b0dcd08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d978e54fd1eb48a0b3528526052986c0, user_id=8f188ef6022445d5b0a95ea953d66869, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:18.882732 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3685d063-248f-4262-aba1-69594b0dcd08 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:18.900534 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2206/4406] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:28:18 2022] PUT /identity/v3/projects/d978e54fd1eb48a0b3528526052986c0/users/8f188ef6022445d5b0a95ea953d66869/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:28:18.916151 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc077b4-28ea-4629-b61b-ac641d76c74c None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:18.916439 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc077b4-28ea-4629-b61b-ac641d76c74c None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:18.916719 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc077b4-28ea-4629-b61b-ac641d76c74c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:18.977469 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-8cc077b4-28ea-4629-b61b-ac641d76c74c None None] MFA Rules not processed for user `8f188ef6022445d5b0a95ea953d66869`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:28:18.980620 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-8cc077b4-28ea-4629-b61b-ac641d76c74c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:19.136952 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3685d063-248f-4262-aba1-69594b0dcd08 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:19.138426 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2201/4407] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:28:18 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:28:19.163256 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3685d063-248f-4262-aba1-69594b0dcd08 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:19.175872 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6609c857-a21c-4a26-b396-0a15f318ac72 tempest-PoliciesTestJSON-839810381 tempest-PoliciesTestJSON-839810381-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f188ef6022445d5b0a95ea953d66869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd978e54fd1eb48a0b3528526052986c0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:19.176570 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6609c857-a21c-4a26-b396-0a15f318ac72 tempest-PoliciesTestJSON-839810381 tempest-PoliciesTestJSON-839810381-project-admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:19.177219 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6609c857-a21c-4a26-b396-0a15f318ac72 tempest-PoliciesTestJSON-839810381 tempest-PoliciesTestJSON-839810381-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:19.177219 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6609c857-a21c-4a26-b396-0a15f318ac72 tempest-PoliciesTestJSON-839810381 tempest-PoliciesTestJSON-839810381-project-admin] PATH_INFO: `/v3/policies` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:19.178147 ncdv-master-1 devstack@keystone.service[91547]: WARNING oslo_log.versionutils [None req-6609c857-a21c-4a26-b396-0a15f318ac72 tempest-PoliciesTestJSON-839810381 tempest-PoliciesTestJSON-839810381-project-admin] Deprecated: identity:create_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Jul 23 21:28:19.178677 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6609c857-a21c-4a26-b396-0a15f318ac72 tempest-PoliciesTestJSON-839810381 tempest-PoliciesTestJSON-839810381-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:19.179931 ncdv-master-1 devstack@keystone.service[91547]: WARNING py.warnings [None req-6609c857-a21c-4a26-b396-0a15f318ac72 tempest-PoliciesTestJSON-839810381 tempest-PoliciesTestJSON-839810381-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:28:19.179931 ncdv-master-1 devstack@keystone.service[91547]: warnings.warn(msg) Jul 23 21:28:19.179931 ncdv-master-1 devstack@keystone.service[91547]: Jul 23 21:28:19.180819 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6609c857-a21c-4a26-b396-0a15f318ac72 tempest-PoliciesTestJSON-839810381 tempest-PoliciesTestJSON-839810381-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:19.228028 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc077b4-28ea-4629-b61b-ac641d76c74c None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:19.229784 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2207/4408] 10.222.0.17 () {60 vars in 1151 bytes} [Sat Jul 23 21:28:19 2022] POST /identity/v3/policies => generated 229 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:28:19.255108 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc077b4-28ea-4629-b61b-ac641d76c74c None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:19.271427 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafd8db1-4310-436d-a564-970028394cbd tempest-PoliciesTestJSON-839810381 tempest-PoliciesTestJSON-839810381-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f188ef6022445d5b0a95ea953d66869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd978e54fd1eb48a0b3528526052986c0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:19.274002 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafd8db1-4310-436d-a564-970028394cbd tempest-PoliciesTestJSON-839810381 tempest-PoliciesTestJSON-839810381-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:19.274561 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafd8db1-4310-436d-a564-970028394cbd tempest-PoliciesTestJSON-839810381 tempest-PoliciesTestJSON-839810381-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:19.275102 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafd8db1-4310-436d-a564-970028394cbd tempest-PoliciesTestJSON-839810381 tempest-PoliciesTestJSON-839810381-project-admin] PATH_INFO: `/v3/policies/a960ac92d3d543ad8777d5ea3902fe5d` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:19.276420 ncdv-master-1 devstack@keystone.service[91548]: WARNING oslo_log.versionutils [None req-eafd8db1-4310-436d-a564-970028394cbd tempest-PoliciesTestJSON-839810381 tempest-PoliciesTestJSON-839810381-project-admin] Deprecated: identity:update_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Jul 23 21:28:19.277412 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafd8db1-4310-436d-a564-970028394cbd tempest-PoliciesTestJSON-839810381 tempest-PoliciesTestJSON-839810381-project-admin] RBAC: Authorizing `identity:update_policy(policy_id=a960ac92d3d543ad8777d5ea3902fe5d)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:19.288279 ncdv-master-1 devstack@keystone.service[91548]: WARNING py.warnings [None req-eafd8db1-4310-436d-a564-970028394cbd tempest-PoliciesTestJSON-839810381 tempest-PoliciesTestJSON-839810381-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:28:19.288279 ncdv-master-1 devstack@keystone.service[91548]: warnings.warn(msg) Jul 23 21:28:19.288279 ncdv-master-1 devstack@keystone.service[91548]: Jul 23 21:28:19.290627 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafd8db1-4310-436d-a564-970028394cbd tempest-PoliciesTestJSON-839810381 tempest-PoliciesTestJSON-839810381-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:19.373422 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2202/4409] 10.222.0.17 () {60 vars in 1251 bytes} [Sat Jul 23 21:28:19 2022] PATCH /identity/v3/policies/a960ac92d3d543ad8777d5ea3902fe5d => generated 236 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:28:19.378487 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6609c857-a21c-4a26-b396-0a15f318ac72 tempest-PoliciesTestJSON-839810381 tempest-PoliciesTestJSON-839810381-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:19.389155 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6609c857-a21c-4a26-b396-0a15f318ac72 tempest-PoliciesTestJSON-839810381 tempest-PoliciesTestJSON-839810381-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:19.396125 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2599a5-be2f-49a0-bcb5-96242b29fef0 tempest-PoliciesTestJSON-839810381 tempest-PoliciesTestJSON-839810381-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f188ef6022445d5b0a95ea953d66869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd978e54fd1eb48a0b3528526052986c0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:19.397021 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2599a5-be2f-49a0-bcb5-96242b29fef0 tempest-PoliciesTestJSON-839810381 tempest-PoliciesTestJSON-839810381-project-admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:19.398956 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2599a5-be2f-49a0-bcb5-96242b29fef0 tempest-PoliciesTestJSON-839810381 tempest-PoliciesTestJSON-839810381-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:19.399236 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2599a5-be2f-49a0-bcb5-96242b29fef0 tempest-PoliciesTestJSON-839810381 tempest-PoliciesTestJSON-839810381-project-admin] PATH_INFO: `/v3/policies/a960ac92d3d543ad8777d5ea3902fe5d` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:19.404036 ncdv-master-1 devstack@keystone.service[91547]: WARNING oslo_log.versionutils [None req-0b2599a5-be2f-49a0-bcb5-96242b29fef0 tempest-PoliciesTestJSON-839810381 tempest-PoliciesTestJSON-839810381-project-admin] Deprecated: identity:get_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Jul 23 21:28:19.404897 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2599a5-be2f-49a0-bcb5-96242b29fef0 tempest-PoliciesTestJSON-839810381 tempest-PoliciesTestJSON-839810381-project-admin] RBAC: Authorizing `identity:get_policy(policy_id=a960ac92d3d543ad8777d5ea3902fe5d)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:19.406494 ncdv-master-1 devstack@keystone.service[91547]: WARNING py.warnings [None req-0b2599a5-be2f-49a0-bcb5-96242b29fef0 tempest-PoliciesTestJSON-839810381 tempest-PoliciesTestJSON-839810381-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_policy": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:28:19.406494 ncdv-master-1 devstack@keystone.service[91547]: warnings.warn(msg) Jul 23 21:28:19.406494 ncdv-master-1 devstack@keystone.service[91547]: Jul 23 21:28:19.407937 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2599a5-be2f-49a0-bcb5-96242b29fef0 tempest-PoliciesTestJSON-839810381 tempest-PoliciesTestJSON-839810381-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:19.433719 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafd8db1-4310-436d-a564-970028394cbd tempest-PoliciesTestJSON-839810381 tempest-PoliciesTestJSON-839810381-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:19.445965 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2208/4410] 10.222.0.17 () {58 vars in 1229 bytes} [Sat Jul 23 21:28:19 2022] GET /identity/v3/policies/a960ac92d3d543ad8777d5ea3902fe5d => generated 236 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:28:19.447629 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafd8db1-4310-436d-a564-970028394cbd tempest-PoliciesTestJSON-839810381 tempest-PoliciesTestJSON-839810381-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:19.454555 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb941ad-026f-4b26-b74d-acb3acf05efb tempest-PoliciesTestJSON-839810381 tempest-PoliciesTestJSON-839810381-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f188ef6022445d5b0a95ea953d66869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd978e54fd1eb48a0b3528526052986c0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:19.455839 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb941ad-026f-4b26-b74d-acb3acf05efb tempest-PoliciesTestJSON-839810381 tempest-PoliciesTestJSON-839810381-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:19.456522 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb941ad-026f-4b26-b74d-acb3acf05efb tempest-PoliciesTestJSON-839810381 tempest-PoliciesTestJSON-839810381-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:19.456985 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb941ad-026f-4b26-b74d-acb3acf05efb tempest-PoliciesTestJSON-839810381 tempest-PoliciesTestJSON-839810381-project-admin] PATH_INFO: `/v3/policies/a960ac92d3d543ad8777d5ea3902fe5d` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:19.458345 ncdv-master-1 devstack@keystone.service[91548]: WARNING oslo_log.versionutils [None req-1fb941ad-026f-4b26-b74d-acb3acf05efb tempest-PoliciesTestJSON-839810381 tempest-PoliciesTestJSON-839810381-project-admin] Deprecated: identity:delete_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Jul 23 21:28:19.459163 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb941ad-026f-4b26-b74d-acb3acf05efb tempest-PoliciesTestJSON-839810381 tempest-PoliciesTestJSON-839810381-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=a960ac92d3d543ad8777d5ea3902fe5d)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:19.460570 ncdv-master-1 devstack@keystone.service[91548]: WARNING py.warnings [None req-1fb941ad-026f-4b26-b74d-acb3acf05efb tempest-PoliciesTestJSON-839810381 tempest-PoliciesTestJSON-839810381-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:28:19.460570 ncdv-master-1 devstack@keystone.service[91548]: warnings.warn(msg) Jul 23 21:28:19.460570 ncdv-master-1 devstack@keystone.service[91548]: Jul 23 21:28:19.461825 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb941ad-026f-4b26-b74d-acb3acf05efb tempest-PoliciesTestJSON-839810381 tempest-PoliciesTestJSON-839810381-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:19.495025 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2203/4411] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:28:19 2022] DELETE /identity/v3/policies/a960ac92d3d543ad8777d5ea3902fe5d => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:28:19.500727 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2599a5-be2f-49a0-bcb5-96242b29fef0 tempest-PoliciesTestJSON-839810381 tempest-PoliciesTestJSON-839810381-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:19.521236 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2599a5-be2f-49a0-bcb5-96242b29fef0 tempest-PoliciesTestJSON-839810381 tempest-PoliciesTestJSON-839810381-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:19.528770 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775d8fad-2523-4744-905e-80ea6c40141a tempest-PoliciesTestJSON-839810381 tempest-PoliciesTestJSON-839810381-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f188ef6022445d5b0a95ea953d66869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd978e54fd1eb48a0b3528526052986c0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:19.530965 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775d8fad-2523-4744-905e-80ea6c40141a tempest-PoliciesTestJSON-839810381 tempest-PoliciesTestJSON-839810381-project-admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:19.531429 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775d8fad-2523-4744-905e-80ea6c40141a tempest-PoliciesTestJSON-839810381 tempest-PoliciesTestJSON-839810381-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:19.532738 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775d8fad-2523-4744-905e-80ea6c40141a tempest-PoliciesTestJSON-839810381 tempest-PoliciesTestJSON-839810381-project-admin] PATH_INFO: `/v3/policies` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:19.535282 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775d8fad-2523-4744-905e-80ea6c40141a tempest-PoliciesTestJSON-839810381 tempest-PoliciesTestJSON-839810381-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:19.538013 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775d8fad-2523-4744-905e-80ea6c40141a tempest-PoliciesTestJSON-839810381 tempest-PoliciesTestJSON-839810381-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:19.569788 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2209/4412] 10.222.0.17 () {60 vars in 1151 bytes} [Sat Jul 23 21:28:19 2022] POST /identity/v3/policies => generated 229 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:28:19.570948 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb941ad-026f-4b26-b74d-acb3acf05efb tempest-PoliciesTestJSON-839810381 tempest-PoliciesTestJSON-839810381-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:19.585925 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb941ad-026f-4b26-b74d-acb3acf05efb tempest-PoliciesTestJSON-839810381 tempest-PoliciesTestJSON-839810381-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:19.594691 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da0acd6-a33d-4f7f-bded-73a518537701 tempest-PoliciesTestJSON-839810381 tempest-PoliciesTestJSON-839810381-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f188ef6022445d5b0a95ea953d66869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd978e54fd1eb48a0b3528526052986c0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:19.595370 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da0acd6-a33d-4f7f-bded-73a518537701 tempest-PoliciesTestJSON-839810381 tempest-PoliciesTestJSON-839810381-project-admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:19.596444 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da0acd6-a33d-4f7f-bded-73a518537701 tempest-PoliciesTestJSON-839810381 tempest-PoliciesTestJSON-839810381-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:19.596763 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da0acd6-a33d-4f7f-bded-73a518537701 tempest-PoliciesTestJSON-839810381 tempest-PoliciesTestJSON-839810381-project-admin] PATH_INFO: `/v3/policies` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:19.600272 ncdv-master-1 devstack@keystone.service[91548]: WARNING oslo_log.versionutils [None req-3da0acd6-a33d-4f7f-bded-73a518537701 tempest-PoliciesTestJSON-839810381 tempest-PoliciesTestJSON-839810381-project-admin] Deprecated: identity:create_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Jul 23 21:28:19.602545 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da0acd6-a33d-4f7f-bded-73a518537701 tempest-PoliciesTestJSON-839810381 tempest-PoliciesTestJSON-839810381-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:19.604098 ncdv-master-1 devstack@keystone.service[91548]: WARNING py.warnings [None req-3da0acd6-a33d-4f7f-bded-73a518537701 tempest-PoliciesTestJSON-839810381 tempest-PoliciesTestJSON-839810381-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:28:19.604098 ncdv-master-1 devstack@keystone.service[91548]: warnings.warn(msg) Jul 23 21:28:19.604098 ncdv-master-1 devstack@keystone.service[91548]: Jul 23 21:28:19.607446 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da0acd6-a33d-4f7f-bded-73a518537701 tempest-PoliciesTestJSON-839810381 tempest-PoliciesTestJSON-839810381-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:19.660086 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2204/4413] 10.222.0.17 () {60 vars in 1151 bytes} [Sat Jul 23 21:28:19 2022] POST /identity/v3/policies => generated 229 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:28:19.667505 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775d8fad-2523-4744-905e-80ea6c40141a tempest-PoliciesTestJSON-839810381 tempest-PoliciesTestJSON-839810381-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:19.681228 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775d8fad-2523-4744-905e-80ea6c40141a tempest-PoliciesTestJSON-839810381 tempest-PoliciesTestJSON-839810381-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:19.691322 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eeee599-edf2-42e0-9bd4-2ee0315fb510 tempest-PoliciesTestJSON-839810381 tempest-PoliciesTestJSON-839810381-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f188ef6022445d5b0a95ea953d66869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd978e54fd1eb48a0b3528526052986c0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:19.692344 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeee599-edf2-42e0-9bd4-2ee0315fb510 tempest-PoliciesTestJSON-839810381 tempest-PoliciesTestJSON-839810381-project-admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:19.695212 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeee599-edf2-42e0-9bd4-2ee0315fb510 tempest-PoliciesTestJSON-839810381 tempest-PoliciesTestJSON-839810381-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:19.695818 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeee599-edf2-42e0-9bd4-2ee0315fb510 tempest-PoliciesTestJSON-839810381 tempest-PoliciesTestJSON-839810381-project-admin] PATH_INFO: `/v3/policies` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:19.697340 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eeee599-edf2-42e0-9bd4-2ee0315fb510 tempest-PoliciesTestJSON-839810381 tempest-PoliciesTestJSON-839810381-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:19.702193 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eeee599-edf2-42e0-9bd4-2ee0315fb510 tempest-PoliciesTestJSON-839810381 tempest-PoliciesTestJSON-839810381-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:19.757181 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da0acd6-a33d-4f7f-bded-73a518537701 tempest-PoliciesTestJSON-839810381 tempest-PoliciesTestJSON-839810381-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:19.770475 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2210/4414] 10.222.0.17 () {60 vars in 1151 bytes} [Sat Jul 23 21:28:19 2022] POST /identity/v3/policies => generated 229 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:28:19.775613 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da0acd6-a33d-4f7f-bded-73a518537701 tempest-PoliciesTestJSON-839810381 tempest-PoliciesTestJSON-839810381-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:19.782210 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d402e2-892d-4421-925a-f46b1e30647f tempest-PoliciesTestJSON-839810381 tempest-PoliciesTestJSON-839810381-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f188ef6022445d5b0a95ea953d66869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd978e54fd1eb48a0b3528526052986c0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:19.782990 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d402e2-892d-4421-925a-f46b1e30647f tempest-PoliciesTestJSON-839810381 tempest-PoliciesTestJSON-839810381-project-admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:19.783740 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d402e2-892d-4421-925a-f46b1e30647f tempest-PoliciesTestJSON-839810381 tempest-PoliciesTestJSON-839810381-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:19.784142 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d402e2-892d-4421-925a-f46b1e30647f tempest-PoliciesTestJSON-839810381 tempest-PoliciesTestJSON-839810381-project-admin] PATH_INFO: `/v3/policies` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:19.785273 ncdv-master-1 devstack@keystone.service[91548]: WARNING oslo_log.versionutils [None req-37d402e2-892d-4421-925a-f46b1e30647f tempest-PoliciesTestJSON-839810381 tempest-PoliciesTestJSON-839810381-project-admin] Deprecated: identity:list_policies of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Jul 23 21:28:19.785939 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d402e2-892d-4421-925a-f46b1e30647f tempest-PoliciesTestJSON-839810381 tempest-PoliciesTestJSON-839810381-project-admin] RBAC: Authorizing `identity:list_policies()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:19.787625 ncdv-master-1 devstack@keystone.service[91548]: WARNING py.warnings [None req-37d402e2-892d-4421-925a-f46b1e30647f tempest-PoliciesTestJSON-839810381 tempest-PoliciesTestJSON-839810381-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_policies": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:28:19.787625 ncdv-master-1 devstack@keystone.service[91548]: warnings.warn(msg) Jul 23 21:28:19.787625 ncdv-master-1 devstack@keystone.service[91548]: Jul 23 21:28:19.788740 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d402e2-892d-4421-925a-f46b1e30647f tempest-PoliciesTestJSON-839810381 tempest-PoliciesTestJSON-839810381-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:19.805845 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eeee599-edf2-42e0-9bd4-2ee0315fb510 tempest-PoliciesTestJSON-839810381 tempest-PoliciesTestJSON-839810381-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:19.806547 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2205/4415] 10.222.0.17 () {58 vars in 1130 bytes} [Sat Jul 23 21:28:19 2022] GET /identity/v3/policies => generated 763 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:28:19.825907 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eeee599-edf2-42e0-9bd4-2ee0315fb510 tempest-PoliciesTestJSON-839810381 tempest-PoliciesTestJSON-839810381-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:19.846573 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61cdca7-16e7-4c5e-80ce-addd01920a62 tempest-PoliciesTestJSON-839810381 tempest-PoliciesTestJSON-839810381-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f188ef6022445d5b0a95ea953d66869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd978e54fd1eb48a0b3528526052986c0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:19.848799 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61cdca7-16e7-4c5e-80ce-addd01920a62 tempest-PoliciesTestJSON-839810381 tempest-PoliciesTestJSON-839810381-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:19.850395 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61cdca7-16e7-4c5e-80ce-addd01920a62 tempest-PoliciesTestJSON-839810381 tempest-PoliciesTestJSON-839810381-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:19.851291 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61cdca7-16e7-4c5e-80ce-addd01920a62 tempest-PoliciesTestJSON-839810381 tempest-PoliciesTestJSON-839810381-project-admin] PATH_INFO: `/v3/policies/10b7cef0479641c0b8065aeb7e788538` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:19.853008 ncdv-master-1 devstack@keystone.service[91547]: WARNING oslo_log.versionutils [None req-f61cdca7-16e7-4c5e-80ce-addd01920a62 tempest-PoliciesTestJSON-839810381 tempest-PoliciesTestJSON-839810381-project-admin] Deprecated: identity:delete_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Jul 23 21:28:19.854102 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61cdca7-16e7-4c5e-80ce-addd01920a62 tempest-PoliciesTestJSON-839810381 tempest-PoliciesTestJSON-839810381-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=10b7cef0479641c0b8065aeb7e788538)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:19.858903 ncdv-master-1 devstack@keystone.service[91547]: WARNING py.warnings [None req-f61cdca7-16e7-4c5e-80ce-addd01920a62 tempest-PoliciesTestJSON-839810381 tempest-PoliciesTestJSON-839810381-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:28:19.858903 ncdv-master-1 devstack@keystone.service[91547]: warnings.warn(msg) Jul 23 21:28:19.858903 ncdv-master-1 devstack@keystone.service[91547]: Jul 23 21:28:19.861580 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d402e2-892d-4421-925a-f46b1e30647f tempest-PoliciesTestJSON-839810381 tempest-PoliciesTestJSON-839810381-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:19.866275 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-37d402e2-892d-4421-925a-f46b1e30647f tempest-PoliciesTestJSON-839810381 tempest-PoliciesTestJSON-839810381-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:19.871282 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61cdca7-16e7-4c5e-80ce-addd01920a62 tempest-PoliciesTestJSON-839810381 tempest-PoliciesTestJSON-839810381-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:19.962489 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2211/4416] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:28:19 2022] DELETE /identity/v3/policies/10b7cef0479641c0b8065aeb7e788538 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:28:19.965060 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61cdca7-16e7-4c5e-80ce-addd01920a62 tempest-PoliciesTestJSON-839810381 tempest-PoliciesTestJSON-839810381-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:20.008417 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61cdca7-16e7-4c5e-80ce-addd01920a62 tempest-PoliciesTestJSON-839810381 tempest-PoliciesTestJSON-839810381-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:20.019018 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124b0e65-739c-472f-acf0-ae83b3e1bb4e tempest-PoliciesTestJSON-839810381 tempest-PoliciesTestJSON-839810381-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f188ef6022445d5b0a95ea953d66869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd978e54fd1eb48a0b3528526052986c0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:20.025201 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124b0e65-739c-472f-acf0-ae83b3e1bb4e tempest-PoliciesTestJSON-839810381 tempest-PoliciesTestJSON-839810381-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:20.025762 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124b0e65-739c-472f-acf0-ae83b3e1bb4e tempest-PoliciesTestJSON-839810381 tempest-PoliciesTestJSON-839810381-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:20.026293 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124b0e65-739c-472f-acf0-ae83b3e1bb4e tempest-PoliciesTestJSON-839810381 tempest-PoliciesTestJSON-839810381-project-admin] PATH_INFO: `/v3/policies/6ce71822558d421aa65e4ee37837031b` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:20.030221 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124b0e65-739c-472f-acf0-ae83b3e1bb4e tempest-PoliciesTestJSON-839810381 tempest-PoliciesTestJSON-839810381-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=6ce71822558d421aa65e4ee37837031b)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:20.037195 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124b0e65-739c-472f-acf0-ae83b3e1bb4e tempest-PoliciesTestJSON-839810381 tempest-PoliciesTestJSON-839810381-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:20.070060 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2212/4417] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:28:19 2022] DELETE /identity/v3/policies/6ce71822558d421aa65e4ee37837031b => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:28:20.074679 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124b0e65-739c-472f-acf0-ae83b3e1bb4e tempest-PoliciesTestJSON-839810381 tempest-PoliciesTestJSON-839810381-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:20.075006 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d402e2-892d-4421-925a-f46b1e30647f tempest-PoliciesTestJSON-839810381 tempest-PoliciesTestJSON-839810381-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:20.079855 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72a2648-3d44-4fe5-b19b-915529cd40d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:20.080744 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72a2648-3d44-4fe5-b19b-915529cd40d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:20.081079 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72a2648-3d44-4fe5-b19b-915529cd40d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:20.081350 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72a2648-3d44-4fe5-b19b-915529cd40d7 admin admin] PATH_INFO: `/v3/projects/0d72e32ec7e74453a22ced0ab6ef47fb` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:20.082739 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72a2648-3d44-4fe5-b19b-915529cd40d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d72e32ec7e74453a22ced0ab6ef47fb)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:20.084496 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72a2648-3d44-4fe5-b19b-915529cd40d7 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:20.100629 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124b0e65-739c-472f-acf0-ae83b3e1bb4e tempest-PoliciesTestJSON-839810381 tempest-PoliciesTestJSON-839810381-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:20.120191 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064a2a53-bda0-4922-b33f-7295476be977 tempest-PoliciesTestJSON-839810381 tempest-PoliciesTestJSON-839810381-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f188ef6022445d5b0a95ea953d66869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd978e54fd1eb48a0b3528526052986c0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:20.120894 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064a2a53-bda0-4922-b33f-7295476be977 tempest-PoliciesTestJSON-839810381 tempest-PoliciesTestJSON-839810381-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:20.121295 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064a2a53-bda0-4922-b33f-7295476be977 tempest-PoliciesTestJSON-839810381 tempest-PoliciesTestJSON-839810381-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:20.121675 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064a2a53-bda0-4922-b33f-7295476be977 tempest-PoliciesTestJSON-839810381 tempest-PoliciesTestJSON-839810381-project-admin] PATH_INFO: `/v3/policies/8d3cbaf0ce23450eaa3c2acf1b579b23` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:20.122960 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064a2a53-bda0-4922-b33f-7295476be977 tempest-PoliciesTestJSON-839810381 tempest-PoliciesTestJSON-839810381-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=8d3cbaf0ce23450eaa3c2acf1b579b23)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:20.146506 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064a2a53-bda0-4922-b33f-7295476be977 tempest-PoliciesTestJSON-839810381 tempest-PoliciesTestJSON-839810381-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:20.169072 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=95,keystone:UPDATE=1,keystone:DELETE=3,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:28:20.185715 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2213/4418] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:28:20 2022] DELETE /identity/v3/policies/8d3cbaf0ce23450eaa3c2acf1b579b23 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:28:20.187110 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064a2a53-bda0-4922-b33f-7295476be977 tempest-PoliciesTestJSON-839810381 tempest-PoliciesTestJSON-839810381-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:20.195191 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c72a2648-3d44-4fe5-b19b-915529cd40d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d72e32ec7e74453a22ced0ab6ef47fb', 'request_id': 'req-c72a2648-3d44-4fe5-b19b-915529cd40d7'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:20.213786 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064a2a53-bda0-4922-b33f-7295476be977 tempest-PoliciesTestJSON-839810381 tempest-PoliciesTestJSON-839810381-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:20.216508 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c72a2648-3d44-4fe5-b19b-915529cd40d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d72e32ec7e74453a22ced0ab6ef47fb', 'request_id': 'req-c72a2648-3d44-4fe5-b19b-915529cd40d7'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:20.230284 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c72a2648-3d44-4fe5-b19b-915529cd40d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d72e32ec7e74453a22ced0ab6ef47fb', 'request_id': 'req-c72a2648-3d44-4fe5-b19b-915529cd40d7'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:20.255210 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c72a2648-3d44-4fe5-b19b-915529cd40d7 admin admin] The token cache is being invalidate because project 0d72e32ec7e74453a22ced0ab6ef47fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:28:20.255500 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c72a2648-3d44-4fe5-b19b-915529cd40d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:20.258099 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c72a2648-3d44-4fe5-b19b-915529cd40d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:20.269038 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2206/4419] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:28:19 2022] DELETE /identity/v3/projects/0d72e32ec7e74453a22ced0ab6ef47fb => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:28:20.273014 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed09b83-0554-48cc-a95d-24ac325db41a None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:20.273014 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed09b83-0554-48cc-a95d-24ac325db41a None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:20.273226 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed09b83-0554-48cc-a95d-24ac325db41a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:20.296318 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=82,keystone:DELETE=13,keystone:INSERT=5 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:28:20.320226 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-6ed09b83-0554-48cc-a95d-24ac325db41a None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:28:20.321455 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-6ed09b83-0554-48cc-a95d-24ac325db41a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:20.359705 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82913c45-b525-4d8f-b32c-a0bad3b6d4a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:20.361815 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82913c45-b525-4d8f-b32c-a0bad3b6d4a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:20.362625 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82913c45-b525-4d8f-b32c-a0bad3b6d4a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:20.363507 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82913c45-b525-4d8f-b32c-a0bad3b6d4a8 admin admin] PATH_INFO: `/v3/users/751126618a9c4d628ecc20d6424b813d` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:20.365608 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82913c45-b525-4d8f-b32c-a0bad3b6d4a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=751126618a9c4d628ecc20d6424b813d)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:20.373183 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82913c45-b525-4d8f-b32c-a0bad3b6d4a8 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:20.471474 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2207/4420] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:28:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:28:20.473248 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0115284-92b6-4685-9868-e5a9a2fba0f7 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:20.473535 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0115284-92b6-4685-9868-e5a9a2fba0f7 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:20.473809 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0115284-92b6-4685-9868-e5a9a2fba0f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:20.476682 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-82913c45-b525-4d8f-b32c-a0bad3b6d4a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '751126618a9c4d628ecc20d6424b813d'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:20.497339 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-82913c45-b525-4d8f-b32c-a0bad3b6d4a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '751126618a9c4d628ecc20d6424b813d'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:20.498589 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-82913c45-b525-4d8f-b32c-a0bad3b6d4a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '751126618a9c4d628ecc20d6424b813d'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:20.513187 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-a0115284-92b6-4685-9868-e5a9a2fba0f7 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:28:20.514457 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-a0115284-92b6-4685-9868-e5a9a2fba0f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:20.516855 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-82913c45-b525-4d8f-b32c-a0bad3b6d4a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '751126618a9c4d628ecc20d6424b813d'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:20.523487 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2208/4421] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:28:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:28:20.527646 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0115284-92b6-4685-9868-e5a9a2fba0f7 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:20.541411 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0115284-92b6-4685-9868-e5a9a2fba0f7 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:20.547566 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5713443-cb8a-46b5-80d5-29aaa03d223d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:20.548609 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5713443-cb8a-46b5-80d5-29aaa03d223d admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:20.548988 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5713443-cb8a-46b5-80d5-29aaa03d223d admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:20.549482 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5713443-cb8a-46b5-80d5-29aaa03d223d admin admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:20.550447 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5713443-cb8a-46b5-80d5-29aaa03d223d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:28:20.550903 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5713443-cb8a-46b5-80d5-29aaa03d223d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:20.552815 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5713443-cb8a-46b5-80d5-29aaa03d223d admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:20.572730 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-82913c45-b525-4d8f-b32c-a0bad3b6d4a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '751126618a9c4d628ecc20d6424b813d'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:20.581155 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2214/4422] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:28:20 2022] DELETE /identity/v3/users/751126618a9c4d628ecc20d6424b813d => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:28:20.585987 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4cfa99-1010-4748-8309-2a98ee738c34 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:20.586505 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4cfa99-1010-4748-8309-2a98ee738c34 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:20.586950 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4cfa99-1010-4748-8309-2a98ee738c34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:20.595823 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2209/4423] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:28:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 21:28:20.598543 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5713443-cb8a-46b5-80d5-29aaa03d223d admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:20.603319 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-b5713443-cb8a-46b5-80d5-29aaa03d223d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:20.631181 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5713443-cb8a-46b5-80d5-29aaa03d223d admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:20.634843 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-ad4cfa99-1010-4748-8309-2a98ee738c34 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:28:20.636559 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-ad4cfa99-1010-4748-8309-2a98ee738c34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:20.719562 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2215/4424] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:28:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:28:20.755346 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f949000-30df-4db4-bc10-e83886ac605e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:20.756058 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f949000-30df-4db4-bc10-e83886ac605e admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:20.756307 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f949000-30df-4db4-bc10-e83886ac605e admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:20.756578 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f949000-30df-4db4-bc10-e83886ac605e admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:20.757375 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f949000-30df-4db4-bc10-e83886ac605e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:20.759773 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f949000-30df-4db4-bc10-e83886ac605e admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:20.774794 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4cfa99-1010-4748-8309-2a98ee738c34 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:20.776223 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-ad4cfa99-1010-4748-8309-2a98ee738c34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:20.798098 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2210/4425] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:28:20 2022] POST /identity/v3/projects => generated 385 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:28:20.802198 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f949000-30df-4db4-bc10-e83886ac605e admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:20.853810 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:28:20.910382 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f949000-30df-4db4-bc10-e83886ac605e admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:20.917965 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fe20b7-e58c-442e-8b2c-0e40794d8448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:20.918748 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fe20b7-e58c-442e-8b2c-0e40794d8448 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:20.919032 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fe20b7-e58c-442e-8b2c-0e40794d8448 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:20.919304 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fe20b7-e58c-442e-8b2c-0e40794d8448 admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:20.920054 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fe20b7-e58c-442e-8b2c-0e40794d8448 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:20.922028 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fe20b7-e58c-442e-8b2c-0e40794d8448 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:20.940251 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4cfa99-1010-4748-8309-2a98ee738c34 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:20.949940 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:28:20.964390 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2211/4426] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:28:20 2022] POST /identity/v3/users => generated 293 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:28:20.967478 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854b1a1e-4c0a-4e71-9987-51417edaa640 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:20.967965 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854b1a1e-4c0a-4e71-9987-51417edaa640 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:20.968401 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854b1a1e-4c0a-4e71-9987-51417edaa640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:21.017257 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-854b1a1e-4c0a-4e71-9987-51417edaa640 None None] MFA Rules not processed for user `3b566640463e43aa85ec96a1aa76d3f8`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:28:21.018673 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-854b1a1e-4c0a-4e71-9987-51417edaa640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:21.022629 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c92dd5-3d2c-414a-ba94-4d5aa633f1b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:21.023741 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c92dd5-3d2c-414a-ba94-4d5aa633f1b4 service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:21.024875 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c92dd5-3d2c-414a-ba94-4d5aa633f1b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:21.025388 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c92dd5-3d2c-414a-ba94-4d5aa633f1b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:21.039091 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c92dd5-3d2c-414a-ba94-4d5aa633f1b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:21.041012 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c92dd5-3d2c-414a-ba94-4d5aa633f1b4 service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:21.060867 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2216/4427] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:28:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 23 21:28:21.062179 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c92dd5-3d2c-414a-ba94-4d5aa633f1b4 service neutron] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:21.076134 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c92dd5-3d2c-414a-ba94-4d5aa633f1b4 service neutron] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:21.083136 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715e3c69-eb62-468a-a33b-c19fd8c9bb57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:21.084108 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715e3c69-eb62-468a-a33b-c19fd8c9bb57 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:21.084457 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715e3c69-eb62-468a-a33b-c19fd8c9bb57 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:21.084798 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715e3c69-eb62-468a-a33b-c19fd8c9bb57 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:21.085603 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715e3c69-eb62-468a-a33b-c19fd8c9bb57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:21.087606 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715e3c69-eb62-468a-a33b-c19fd8c9bb57 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:21.107939 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2217/4428] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:28:21 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:28:21.112647 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715e3c69-eb62-468a-a33b-c19fd8c9bb57 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:21.123912 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2212/4429] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:28:20 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:28:21.124948 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715e3c69-eb62-468a-a33b-c19fd8c9bb57 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:21.126261 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99688046-190f-4a42-a728-158ccc1d0621 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:21.126610 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99688046-190f-4a42-a728-158ccc1d0621 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:21.128394 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99688046-190f-4a42-a728-158ccc1d0621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:21.132562 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461dc7ff-03f0-4c83-8630-33ef6e88f5e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:21.132562 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461dc7ff-03f0-4c83-8630-33ef6e88f5e3 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:21.132849 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461dc7ff-03f0-4c83-8630-33ef6e88f5e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:21.133199 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461dc7ff-03f0-4c83-8630-33ef6e88f5e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:21.133817 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461dc7ff-03f0-4c83-8630-33ef6e88f5e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:21.135730 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461dc7ff-03f0-4c83-8630-33ef6e88f5e3 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:21.156109 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2218/4430] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:28:21 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 21:28:21.157090 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461dc7ff-03f0-4c83-8630-33ef6e88f5e3 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:21.171247 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461dc7ff-03f0-4c83-8630-33ef6e88f5e3 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:21.179092 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef3eec0-0cfb-489a-ade2-0910f1ca3d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:21.180016 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef3eec0-0cfb-489a-ade2-0910f1ca3d3a admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:21.180296 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef3eec0-0cfb-489a-ade2-0910f1ca3d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:21.180572 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef3eec0-0cfb-489a-ade2-0910f1ca3d3a admin admin] PATH_INFO: `/v3/projects/9385df4bcafb427284c48f80625ec3bc/users/14f49744119b4ac8972363ec795a5e89/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:21.181624 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-99688046-190f-4a42-a728-158ccc1d0621 None None] MFA Rules not processed for user `3b566640463e43aa85ec96a1aa76d3f8`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:28:21.182893 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-99688046-190f-4a42-a728-158ccc1d0621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:21.201980 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef3eec0-0cfb-489a-ade2-0910f1ca3d3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9385df4bcafb427284c48f80625ec3bc, user_id=14f49744119b4ac8972363ec795a5e89, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:21.205361 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef3eec0-0cfb-489a-ade2-0910f1ca3d3a admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:21.206173 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2213/4431] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:28:21 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:28:21.219912 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99688046-190f-4a42-a728-158ccc1d0621 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:21.221931 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-99688046-190f-4a42-a728-158ccc1d0621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:21.237755 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2219/4432] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:28:21 2022] PUT /identity/v3/projects/9385df4bcafb427284c48f80625ec3bc/users/14f49744119b4ac8972363ec795a5e89/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:28:21.247308 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512395a4-8957-4976-a6fc-78318734bf45 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:21.247596 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512395a4-8957-4976-a6fc-78318734bf45 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:21.247869 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512395a4-8957-4976-a6fc-78318734bf45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:21.298793 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-512395a4-8957-4976-a6fc-78318734bf45 None None] MFA Rules not processed for user `14f49744119b4ac8972363ec795a5e89`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:28:21.300203 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-512395a4-8957-4976-a6fc-78318734bf45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:21.376725 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99688046-190f-4a42-a728-158ccc1d0621 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:21.389920 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2220/4433] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:28:21 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:28:21.403006 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512395a4-8957-4976-a6fc-78318734bf45 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:21.405584 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-512395a4-8957-4976-a6fc-78318734bf45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:21.473908 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:28:21.550803 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512395a4-8957-4976-a6fc-78318734bf45 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:21.555395 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed5dedc-39c8-4492-b869-c545a57eb58b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:21.556231 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed5dedc-39c8-4492-b869-c545a57eb58b service nova] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:21.556603 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed5dedc-39c8-4492-b869-c545a57eb58b service nova] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:21.557313 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed5dedc-39c8-4492-b869-c545a57eb58b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:21.562020 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8368c46-fa9f-4170-8c8e-c15af7760e3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:21.563709 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8368c46-fa9f-4170-8c8e-c15af7760e3c service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:21.564495 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8368c46-fa9f-4170-8c8e-c15af7760e3c service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:21.566989 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8368c46-fa9f-4170-8c8e-c15af7760e3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:21.584279 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8368c46-fa9f-4170-8c8e-c15af7760e3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:21.586109 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8368c46-fa9f-4170-8c8e-c15af7760e3c service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:21.593059 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:28:21.611941 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2221/4434] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:28:21 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 23 21:28:21.651983 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed5dedc-39c8-4492-b869-c545a57eb58b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:21.655110 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed5dedc-39c8-4492-b869-c545a57eb58b service nova] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:21.680199 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2214/4435] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:28:21 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 23 21:28:21.911799 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8368c46-fa9f-4170-8c8e-c15af7760e3c service neutron] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:21.925283 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8368c46-fa9f-4170-8c8e-c15af7760e3c service neutron] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:21.944409 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acc308c-be2a-4c54-be58-bf83ad3712d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:21.945205 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acc308c-be2a-4c54-be58-bf83ad3712d4 service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:21.945555 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acc308c-be2a-4c54-be58-bf83ad3712d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:21.945900 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acc308c-be2a-4c54-be58-bf83ad3712d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:21.951851 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-1acc308c-be2a-4c54-be58-bf83ad3712d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:22.086249 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acc308c-be2a-4c54-be58-bf83ad3712d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:22.087878 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acc308c-be2a-4c54-be58-bf83ad3712d4 service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:22.100136 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2222/4436] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:28:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:28:23.075771 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed5dedc-39c8-4492-b869-c545a57eb58b service nova] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:23.077593 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-5ed5dedc-39c8-4492-b869-c545a57eb58b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:23.100454 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed5dedc-39c8-4492-b869-c545a57eb58b service nova] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:23.115284 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ae1546-cb48-430b-8248-39e6f6b8395d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:23.116257 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ae1546-cb48-430b-8248-39e6f6b8395d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:23.116679 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ae1546-cb48-430b-8248-39e6f6b8395d admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:23.116973 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ae1546-cb48-430b-8248-39e6f6b8395d admin admin] PATH_INFO: `/v3/projects/fd5e3928deee435fa596bd9d0589e99b` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:23.120437 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ae1546-cb48-430b-8248-39e6f6b8395d admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd5e3928deee435fa596bd9d0589e99b)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:23.127931 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ae1546-cb48-430b-8248-39e6f6b8395d admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:23.318659 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-14ae1546-cb48-430b-8248-39e6f6b8395d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd5e3928deee435fa596bd9d0589e99b', 'request_id': 'req-14ae1546-cb48-430b-8248-39e6f6b8395d'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:23.338152 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-14ae1546-cb48-430b-8248-39e6f6b8395d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd5e3928deee435fa596bd9d0589e99b', 'request_id': 'req-14ae1546-cb48-430b-8248-39e6f6b8395d'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:23.346299 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-14ae1546-cb48-430b-8248-39e6f6b8395d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd5e3928deee435fa596bd9d0589e99b', 'request_id': 'req-14ae1546-cb48-430b-8248-39e6f6b8395d'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:23.385573 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-14ae1546-cb48-430b-8248-39e6f6b8395d admin admin] The token cache is being invalidate because project fd5e3928deee435fa596bd9d0589e99b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:28:23.385895 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-14ae1546-cb48-430b-8248-39e6f6b8395d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:23.386657 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-14ae1546-cb48-430b-8248-39e6f6b8395d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:23.390306 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2215/4437] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:28:23 2022] DELETE /identity/v3/projects/fd5e3928deee435fa596bd9d0589e99b => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:28:23.394559 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acc308c-be2a-4c54-be58-bf83ad3712d4 service neutron] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:23.408493 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acc308c-be2a-4c54-be58-bf83ad3712d4 service neutron] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:23.527673 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ef01f7-0f5d-4792-8021-0e731cdc4018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:23.529121 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ef01f7-0f5d-4792-8021-0e731cdc4018 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:23.530132 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ef01f7-0f5d-4792-8021-0e731cdc4018 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:23.531304 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ef01f7-0f5d-4792-8021-0e731cdc4018 admin admin] PATH_INFO: `/v3/users/8f188ef6022445d5b0a95ea953d66869` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:23.535355 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ef01f7-0f5d-4792-8021-0e731cdc4018 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f188ef6022445d5b0a95ea953d66869)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:23.539189 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ef01f7-0f5d-4792-8021-0e731cdc4018 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:23.667233 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-d7ef01f7-0f5d-4792-8021-0e731cdc4018 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f188ef6022445d5b0a95ea953d66869'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:23.676484 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-d7ef01f7-0f5d-4792-8021-0e731cdc4018 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f188ef6022445d5b0a95ea953d66869'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:23.677267 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-d7ef01f7-0f5d-4792-8021-0e731cdc4018 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f188ef6022445d5b0a95ea953d66869'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:23.695664 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-d7ef01f7-0f5d-4792-8021-0e731cdc4018 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f188ef6022445d5b0a95ea953d66869'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:23.752478 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-d7ef01f7-0f5d-4792-8021-0e731cdc4018 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f188ef6022445d5b0a95ea953d66869'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:23.767081 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2223/4438] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:28:23 2022] DELETE /identity/v3/users/8f188ef6022445d5b0a95ea953d66869 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:28:25.913574 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ae1546-cb48-430b-8248-39e6f6b8395d admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:25.914829 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-14ae1546-cb48-430b-8248-39e6f6b8395d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:25.969752 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ae1546-cb48-430b-8248-39e6f6b8395d admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:26.083861 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:28:26.107462 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ce629d-5ccd-463b-b75f-f687e6229e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:26.108519 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ce629d-5ccd-463b-b75f-f687e6229e33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:26.109043 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ce629d-5ccd-463b-b75f-f687e6229e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:26.110834 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ce629d-5ccd-463b-b75f-f687e6229e33 admin admin] PATH_INFO: `/v3/projects/d978e54fd1eb48a0b3528526052986c0` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:26.113944 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ce629d-5ccd-463b-b75f-f687e6229e33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d978e54fd1eb48a0b3528526052986c0)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:26.129642 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ce629d-5ccd-463b-b75f-f687e6229e33 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:26.260811 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-a9ce629d-5ccd-463b-b75f-f687e6229e33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd978e54fd1eb48a0b3528526052986c0', 'request_id': 'req-a9ce629d-5ccd-463b-b75f-f687e6229e33'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:26.279609 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-a9ce629d-5ccd-463b-b75f-f687e6229e33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd978e54fd1eb48a0b3528526052986c0', 'request_id': 'req-a9ce629d-5ccd-463b-b75f-f687e6229e33'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:26.324624 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-a9ce629d-5ccd-463b-b75f-f687e6229e33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd978e54fd1eb48a0b3528526052986c0', 'request_id': 'req-a9ce629d-5ccd-463b-b75f-f687e6229e33'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:26.347635 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-a9ce629d-5ccd-463b-b75f-f687e6229e33 admin admin] The token cache is being invalidate because project d978e54fd1eb48a0b3528526052986c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:28:26.347635 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-a9ce629d-5ccd-463b-b75f-f687e6229e33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:26.349882 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-a9ce629d-5ccd-463b-b75f-f687e6229e33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:26.354840 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2216/4439] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:28:25 2022] DELETE /identity/v3/projects/d978e54fd1eb48a0b3528526052986c0 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:28:26.359966 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d935218-e52b-4047-9cbe-9ee0cc264841 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:26.360835 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d935218-e52b-4047-9cbe-9ee0cc264841 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:26.361281 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d935218-e52b-4047-9cbe-9ee0cc264841 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:26.381434 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-5d935218-e52b-4047-9cbe-9ee0cc264841 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:28:26.383098 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-5d935218-e52b-4047-9cbe-9ee0cc264841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:26.403589 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:28:26.520006 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1653a42a-3ec0-4830-9fd1-aa1cf0ef8532 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:26.520281 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1653a42a-3ec0-4830-9fd1-aa1cf0ef8532 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:26.520564 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1653a42a-3ec0-4830-9fd1-aa1cf0ef8532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:26.522669 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2224/4440] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:28:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:28:26.544959 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-1653a42a-3ec0-4830-9fd1-aa1cf0ef8532 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:28:26.546440 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-1653a42a-3ec0-4830-9fd1-aa1cf0ef8532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:26.575183 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2217/4441] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:28:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:28:26.580197 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d935218-e52b-4047-9cbe-9ee0cc264841 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:26.598854 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d935218-e52b-4047-9cbe-9ee0cc264841 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:26.622053 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e057bac-94d7-47f5-bf07-eb509050a889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:26.622878 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e057bac-94d7-47f5-bf07-eb509050a889 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:26.623252 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e057bac-94d7-47f5-bf07-eb509050a889 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:26.623715 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e057bac-94d7-47f5-bf07-eb509050a889 admin admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:26.625188 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e057bac-94d7-47f5-bf07-eb509050a889 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:28:26.625600 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e057bac-94d7-47f5-bf07-eb509050a889 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:26.627408 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e057bac-94d7-47f5-bf07-eb509050a889 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:26.657814 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2225/4442] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:28:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:28:26.658735 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1653a42a-3ec0-4830-9fd1-aa1cf0ef8532 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:26.672044 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1653a42a-3ec0-4830-9fd1-aa1cf0ef8532 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:26.687326 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf72f5e-bf70-4283-9d2f-26b5cac0e536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:26.688132 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf72f5e-bf70-4283-9d2f-26b5cac0e536 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:26.688415 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf72f5e-bf70-4283-9d2f-26b5cac0e536 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:26.688686 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf72f5e-bf70-4283-9d2f-26b5cac0e536 admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:26.689382 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf72f5e-bf70-4283-9d2f-26b5cac0e536 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:26.691450 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf72f5e-bf70-4283-9d2f-26b5cac0e536 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:26.749055 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2218/4443] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:28:26 2022] POST /identity/v3/projects => generated 385 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:28:26.753613 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e057bac-94d7-47f5-bf07-eb509050a889 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:26.767320 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e057bac-94d7-47f5-bf07-eb509050a889 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:26.875599 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c6774b-61b8-4a0e-9577-9ad84be8e924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:26.876463 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c6774b-61b8-4a0e-9577-9ad84be8e924 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:26.876719 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c6774b-61b8-4a0e-9577-9ad84be8e924 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:26.876990 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c6774b-61b8-4a0e-9577-9ad84be8e924 admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:26.878519 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c6774b-61b8-4a0e-9577-9ad84be8e924 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:26.880593 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c6774b-61b8-4a0e-9577-9ad84be8e924 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:26.909469 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2226/4444] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:28:26 2022] POST /identity/v3/users => generated 293 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:28:26.914128 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf72f5e-bf70-4283-9d2f-26b5cac0e536 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:26.929909 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf72f5e-bf70-4283-9d2f-26b5cac0e536 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:26.936146 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d6c853-6ba7-45d7-a525-dc9a845f3018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:26.937034 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d6c853-6ba7-45d7-a525-dc9a845f3018 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:26.937721 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d6c853-6ba7-45d7-a525-dc9a845f3018 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:26.938151 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d6c853-6ba7-45d7-a525-dc9a845f3018 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:26.939296 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d6c853-6ba7-45d7-a525-dc9a845f3018 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:26.941205 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d6c853-6ba7-45d7-a525-dc9a845f3018 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:26.960683 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c6774b-61b8-4a0e-9577-9ad84be8e924 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:26.973034 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2219/4445] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:28:26 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:28:26.976498 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c6774b-61b8-4a0e-9577-9ad84be8e924 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:26.983129 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99270929-2963-4aff-bd8a-0f652c5b5008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:26.984007 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99270929-2963-4aff-bd8a-0f652c5b5008 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:26.984383 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99270929-2963-4aff-bd8a-0f652c5b5008 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:26.984749 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99270929-2963-4aff-bd8a-0f652c5b5008 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:26.985968 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99270929-2963-4aff-bd8a-0f652c5b5008 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:26.988401 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99270929-2963-4aff-bd8a-0f652c5b5008 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:27.008395 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d6c853-6ba7-45d7-a525-dc9a845f3018 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:27.017153 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2227/4446] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:28:26 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:28:27.021643 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d6c853-6ba7-45d7-a525-dc9a845f3018 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:27.028005 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75feb2f5-65c9-41fb-9481-8bc13c4f0436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:27.029212 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75feb2f5-65c9-41fb-9481-8bc13c4f0436 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:27.029548 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75feb2f5-65c9-41fb-9481-8bc13c4f0436 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:27.029923 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75feb2f5-65c9-41fb-9481-8bc13c4f0436 admin admin] PATH_INFO: `/v3/projects/d4f9dbcffefc445cac695e88c40253cd/users/432e006c35534801837c6db5f338fcc7/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:27.052188 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75feb2f5-65c9-41fb-9481-8bc13c4f0436 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4f9dbcffefc445cac695e88c40253cd, user_id=432e006c35534801837c6db5f338fcc7, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:27.056474 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75feb2f5-65c9-41fb-9481-8bc13c4f0436 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:27.105423 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2220/4447] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:28:27 2022] PUT /identity/v3/projects/d4f9dbcffefc445cac695e88c40253cd/users/432e006c35534801837c6db5f338fcc7/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:28:27.109701 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b036badb-4625-47a7-934c-4743a0244cd9 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:27.110140 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b036badb-4625-47a7-934c-4743a0244cd9 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:27.110263 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b036badb-4625-47a7-934c-4743a0244cd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:27.151891 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-b036badb-4625-47a7-934c-4743a0244cd9 None None] MFA Rules not processed for user `432e006c35534801837c6db5f338fcc7`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:28:27.153995 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-b036badb-4625-47a7-934c-4743a0244cd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:27.254020 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2228/4448] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:28:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:28:27.258473 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75feb2f5-65c9-41fb-9481-8bc13c4f0436 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:27.375760 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75feb2f5-65c9-41fb-9481-8bc13c4f0436 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:27.387900 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181af572-49e0-4ac1-b256-37f81e584c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:27.388651 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181af572-49e0-4ac1-b256-37f81e584c31 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:27.388940 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181af572-49e0-4ac1-b256-37f81e584c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:27.389219 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181af572-49e0-4ac1-b256-37f81e584c31 admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:27.390744 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181af572-49e0-4ac1-b256-37f81e584c31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:27.395027 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181af572-49e0-4ac1-b256-37f81e584c31 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:27.439598 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2221/4449] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:28:27 2022] POST /identity/v3/projects => generated 385 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:28:27.441360 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b036badb-4625-47a7-934c-4743a0244cd9 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:27.459590 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b036badb-4625-47a7-934c-4743a0244cd9 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:27.467044 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:28:27.603434 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18052e1b-4a40-4c5a-870a-f2266c616846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:27.604141 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18052e1b-4a40-4c5a-870a-f2266c616846 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:27.604423 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18052e1b-4a40-4c5a-870a-f2266c616846 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:27.604700 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18052e1b-4a40-4c5a-870a-f2266c616846 admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:27.605404 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18052e1b-4a40-4c5a-870a-f2266c616846 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:27.611966 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18052e1b-4a40-4c5a-870a-f2266c616846 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:27.664623 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2229/4450] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:28:27 2022] POST /identity/v3/users => generated 299 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:28:27.668416 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181af572-49e0-4ac1-b256-37f81e584c31 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:27.679581 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:28:27.684544 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181af572-49e0-4ac1-b256-37f81e584c31 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:27.698996 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe7734a-5187-4338-bfbd-12c29e7d4012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:27.700422 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe7734a-5187-4338-bfbd-12c29e7d4012 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:27.700582 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe7734a-5187-4338-bfbd-12c29e7d4012 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:27.700836 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe7734a-5187-4338-bfbd-12c29e7d4012 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:27.701595 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe7734a-5187-4338-bfbd-12c29e7d4012 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:27.706635 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe7734a-5187-4338-bfbd-12c29e7d4012 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:27.736357 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2222/4451] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:28:27 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:28:27.737580 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18052e1b-4a40-4c5a-870a-f2266c616846 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:27.756185 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18052e1b-4a40-4c5a-870a-f2266c616846 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:27.770631 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20714449-8be3-4d90-a59a-b69c97be7651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:27.771579 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20714449-8be3-4d90-a59a-b69c97be7651 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:27.771860 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20714449-8be3-4d90-a59a-b69c97be7651 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:27.772269 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20714449-8be3-4d90-a59a-b69c97be7651 admin admin] PATH_INFO: `/v3/projects/b9e72188cab841c5868f5d2984d8c0ad/users/1773241ed9554dd09628d3aeb840541e/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:27.794994 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20714449-8be3-4d90-a59a-b69c97be7651 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9e72188cab841c5868f5d2984d8c0ad, user_id=1773241ed9554dd09628d3aeb840541e, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:27.798184 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20714449-8be3-4d90-a59a-b69c97be7651 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:27.821512 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2230/4452] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:28:27 2022] PUT /identity/v3/projects/b9e72188cab841c5868f5d2984d8c0ad/users/1773241ed9554dd09628d3aeb840541e/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:28:27.825247 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe7734a-5187-4338-bfbd-12c29e7d4012 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:27.844772 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe7734a-5187-4338-bfbd-12c29e7d4012 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:27.942968 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9113c958-da67-42e4-95dd-85883aa475c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:27.943721 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9113c958-da67-42e4-95dd-85883aa475c4 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:27.944117 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9113c958-da67-42e4-95dd-85883aa475c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:27.944447 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9113c958-da67-42e4-95dd-85883aa475c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:27.945354 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9113c958-da67-42e4-95dd-85883aa475c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:27.947681 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9113c958-da67-42e4-95dd-85883aa475c4 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:27.968363 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2223/4453] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:28:27 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 21:28:27.973262 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20714449-8be3-4d90-a59a-b69c97be7651 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:27.985912 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20714449-8be3-4d90-a59a-b69c97be7651 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:27.993776 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a44a68c-fd04-48d9-88d2-aa3cde50f17f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:27.996862 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a44a68c-fd04-48d9-88d2-aa3cde50f17f admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:27.997425 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a44a68c-fd04-48d9-88d2-aa3cde50f17f admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:27.997805 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a44a68c-fd04-48d9-88d2-aa3cde50f17f admin admin] PATH_INFO: `/v3/projects/b9e72188cab841c5868f5d2984d8c0ad/users/1773241ed9554dd09628d3aeb840541e/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:28.000436 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a44a68c-fd04-48d9-88d2-aa3cde50f17f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9e72188cab841c5868f5d2984d8c0ad, user_id=1773241ed9554dd09628d3aeb840541e, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:28.003822 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a44a68c-fd04-48d9-88d2-aa3cde50f17f admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:28.031337 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2231/4454] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:28:27 2022] PUT /identity/v3/projects/b9e72188cab841c5868f5d2984d8c0ad/users/1773241ed9554dd09628d3aeb840541e/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:28:28.033659 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4316ab-2f3b-4888-94e4-34c92ff22b79 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:28.034128 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4316ab-2f3b-4888-94e4-34c92ff22b79 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:28.034512 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4316ab-2f3b-4888-94e4-34c92ff22b79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:28.069947 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-3d4316ab-2f3b-4888-94e4-34c92ff22b79 None None] MFA Rules not processed for user `1773241ed9554dd09628d3aeb840541e`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:28:28.072137 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-3d4316ab-2f3b-4888-94e4-34c92ff22b79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:28.170007 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2224/4455] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:28:28 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:28:28.193802 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a44a68c-fd04-48d9-88d2-aa3cde50f17f admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:28.218517 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a44a68c-fd04-48d9-88d2-aa3cde50f17f admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:28.231594 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d73471-f12c-4cdd-a19b-5e82f68d540c tempest-ProjectsNegativeTestJSON-1611484850 tempest-ProjectsNegativeTestJSON-1611484850-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1773241ed9554dd09628d3aeb840541e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9e72188cab841c5868f5d2984d8c0ad', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:28.233744 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d73471-f12c-4cdd-a19b-5e82f68d540c tempest-ProjectsNegativeTestJSON-1611484850 tempest-ProjectsNegativeTestJSON-1611484850-project-admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:28.250170 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d73471-f12c-4cdd-a19b-5e82f68d540c tempest-ProjectsNegativeTestJSON-1611484850 tempest-ProjectsNegativeTestJSON-1611484850-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:28.252252 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d73471-f12c-4cdd-a19b-5e82f68d540c tempest-ProjectsNegativeTestJSON-1611484850 tempest-ProjectsNegativeTestJSON-1611484850-project-admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:28.254187 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d73471-f12c-4cdd-a19b-5e82f68d540c tempest-ProjectsNegativeTestJSON-1611484850 tempest-ProjectsNegativeTestJSON-1611484850-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:28.267108 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d73471-f12c-4cdd-a19b-5e82f68d540c tempest-ProjectsNegativeTestJSON-1611484850 tempest-ProjectsNegativeTestJSON-1611484850-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:28.369538 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2232/4456] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:28:28 2022] POST /identity/v3/projects => generated 359 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:28:28.371378 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4316ab-2f3b-4888-94e4-34c92ff22b79 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:28.463589 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4316ab-2f3b-4888-94e4-34c92ff22b79 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:28.496615 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:28:28.551944 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84c3967-fcd8-49a3-b5c5-9d202dd5b0e6 tempest-ProjectsNegativeTestJSON-1826967245 tempest-ProjectsNegativeTestJSON-1826967245-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '432e006c35534801837c6db5f338fcc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4f9dbcffefc445cac695e88c40253cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:28.552662 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84c3967-fcd8-49a3-b5c5-9d202dd5b0e6 tempest-ProjectsNegativeTestJSON-1826967245 tempest-ProjectsNegativeTestJSON-1826967245-project] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:28.553067 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84c3967-fcd8-49a3-b5c5-9d202dd5b0e6 tempest-ProjectsNegativeTestJSON-1826967245 tempest-ProjectsNegativeTestJSON-1826967245-project] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:28.553453 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84c3967-fcd8-49a3-b5c5-9d202dd5b0e6 tempest-ProjectsNegativeTestJSON-1826967245 tempest-ProjectsNegativeTestJSON-1826967245-project] PATH_INFO: `/v3/projects/5f7e08e513a94327a407699ed9ac2961` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:28.555695 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84c3967-fcd8-49a3-b5c5-9d202dd5b0e6 tempest-ProjectsNegativeTestJSON-1826967245 tempest-ProjectsNegativeTestJSON-1826967245-project] RBAC: Authorizing `identity:delete_project(project_id=5f7e08e513a94327a407699ed9ac2961)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:28.571339 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-b84c3967-fcd8-49a3-b5c5-9d202dd5b0e6 tempest-ProjectsNegativeTestJSON-1826967245 tempest-ProjectsNegativeTestJSON-1826967245-project] You are not authorized to perform the requested action: identity:delete_project.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:delete_project. Jul 23 21:28:28.571339 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 21:28:28.571339 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 21:28:28.571339 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 21:28:28.571339 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 21:28:28.571339 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 21:28:28.571339 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 21:28:28.571339 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 21:28:28.571339 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 21:28:28.571339 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 21:28:28.571339 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 21:28:28.571339 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 21:28:28.571339 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 207, in delete Jul 23 21:28:28.571339 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application ENFORCER.enforce_call( Jul 23 21:28:28.572698 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 455, in enforce_call Jul 23 21:28:28.572698 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application enforcer_obj._enforce( Jul 23 21:28:28.572698 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 125, in _enforce Jul 23 21:28:28.572698 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application result = self._enforcer.enforce( Jul 23 21:28:28.572698 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 23 21:28:28.572698 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exc(*args, **kwargs) Jul 23 21:28:28.572698 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:delete_project. Jul 23 21:28:28.572698 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 21:28:28.575774 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2225/4457] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:28:28 2022] DELETE /identity/v3/projects/5f7e08e513a94327a407699ed9ac2961 => generated 136 bytes in 205 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Jul 23 21:28:28.579924 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d73471-f12c-4cdd-a19b-5e82f68d540c tempest-ProjectsNegativeTestJSON-1611484850 tempest-ProjectsNegativeTestJSON-1611484850-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:28.729518 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d73471-f12c-4cdd-a19b-5e82f68d540c tempest-ProjectsNegativeTestJSON-1611484850 tempest-ProjectsNegativeTestJSON-1611484850-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:28.747934 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14da5938-5d84-4f9e-9f72-007b62ce1661 tempest-ProjectsNegativeTestJSON-1611484850 tempest-ProjectsNegativeTestJSON-1611484850-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1773241ed9554dd09628d3aeb840541e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9e72188cab841c5868f5d2984d8c0ad', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:28.748983 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14da5938-5d84-4f9e-9f72-007b62ce1661 tempest-ProjectsNegativeTestJSON-1611484850 tempest-ProjectsNegativeTestJSON-1611484850-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:28.749229 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14da5938-5d84-4f9e-9f72-007b62ce1661 tempest-ProjectsNegativeTestJSON-1611484850 tempest-ProjectsNegativeTestJSON-1611484850-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:28.749454 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14da5938-5d84-4f9e-9f72-007b62ce1661 tempest-ProjectsNegativeTestJSON-1611484850 tempest-ProjectsNegativeTestJSON-1611484850-project-admin] PATH_INFO: `/v3/projects/5f7e08e513a94327a407699ed9ac2961` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:28.750714 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14da5938-5d84-4f9e-9f72-007b62ce1661 tempest-ProjectsNegativeTestJSON-1611484850 tempest-ProjectsNegativeTestJSON-1611484850-project-admin] RBAC: Authorizing `identity:delete_project(project_id=5f7e08e513a94327a407699ed9ac2961)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:28.752909 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14da5938-5d84-4f9e-9f72-007b62ce1661 tempest-ProjectsNegativeTestJSON-1611484850 tempest-ProjectsNegativeTestJSON-1611484850-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:28.864399 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=91,keystone:INSERT=6,keystone:DELETE=3 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:28:28.882108 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-14da5938-5d84-4f9e-9f72-007b62ce1661 tempest-ProjectsNegativeTestJSON-1611484850 tempest-ProjectsNegativeTestJSON-1611484850-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f7e08e513a94327a407699ed9ac2961', 'request_id': 'req-14da5938-5d84-4f9e-9f72-007b62ce1661'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:28.909332 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-14da5938-5d84-4f9e-9f72-007b62ce1661 tempest-ProjectsNegativeTestJSON-1611484850 tempest-ProjectsNegativeTestJSON-1611484850-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f7e08e513a94327a407699ed9ac2961', 'request_id': 'req-14da5938-5d84-4f9e-9f72-007b62ce1661'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:28.917134 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-14da5938-5d84-4f9e-9f72-007b62ce1661 tempest-ProjectsNegativeTestJSON-1611484850 tempest-ProjectsNegativeTestJSON-1611484850-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f7e08e513a94327a407699ed9ac2961', 'request_id': 'req-14da5938-5d84-4f9e-9f72-007b62ce1661'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:28.943674 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-14da5938-5d84-4f9e-9f72-007b62ce1661 tempest-ProjectsNegativeTestJSON-1611484850 tempest-ProjectsNegativeTestJSON-1611484850-project-admin] The token cache is being invalidate because project 5f7e08e513a94327a407699ed9ac2961 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:28:28.944114 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-14da5938-5d84-4f9e-9f72-007b62ce1661 tempest-ProjectsNegativeTestJSON-1611484850 tempest-ProjectsNegativeTestJSON-1611484850-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:28.947281 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-14da5938-5d84-4f9e-9f72-007b62ce1661 tempest-ProjectsNegativeTestJSON-1611484850 tempest-ProjectsNegativeTestJSON-1611484850-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:28.950059 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2233/4458] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:28:28 2022] DELETE /identity/v3/projects/5f7e08e513a94327a407699ed9ac2961 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:28:28.958812 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84c3967-fcd8-49a3-b5c5-9d202dd5b0e6 tempest-ProjectsNegativeTestJSON-1826967245 tempest-ProjectsNegativeTestJSON-1826967245-project] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:28.960769 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-b84c3967-fcd8-49a3-b5c5-9d202dd5b0e6 tempest-ProjectsNegativeTestJSON-1826967245 tempest-ProjectsNegativeTestJSON-1826967245-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:29.185389 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84c3967-fcd8-49a3-b5c5-9d202dd5b0e6 tempest-ProjectsNegativeTestJSON-1826967245 tempest-ProjectsNegativeTestJSON-1826967245-project] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:29.329080 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a28aef-d820-4156-b24a-566d3d5b8654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:29.330426 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a28aef-d820-4156-b24a-566d3d5b8654 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:29.332171 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a28aef-d820-4156-b24a-566d3d5b8654 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:29.332651 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a28aef-d820-4156-b24a-566d3d5b8654 admin admin] PATH_INFO: `/v3/users/432e006c35534801837c6db5f338fcc7` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:29.334340 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a28aef-d820-4156-b24a-566d3d5b8654 admin admin] RBAC: Authorizing `identity:delete_user(user_id=432e006c35534801837c6db5f338fcc7)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:29.336408 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a28aef-d820-4156-b24a-566d3d5b8654 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:29.397811 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-27a28aef-d820-4156-b24a-566d3d5b8654 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '432e006c35534801837c6db5f338fcc7'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:29.398746 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-27a28aef-d820-4156-b24a-566d3d5b8654 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '432e006c35534801837c6db5f338fcc7'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:29.408446 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-27a28aef-d820-4156-b24a-566d3d5b8654 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '432e006c35534801837c6db5f338fcc7'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:29.423467 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-27a28aef-d820-4156-b24a-566d3d5b8654 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '432e006c35534801837c6db5f338fcc7'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:29.453524 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-27a28aef-d820-4156-b24a-566d3d5b8654 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '432e006c35534801837c6db5f338fcc7'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:29.462778 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:28:29.471556 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2226/4459] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:28:28 2022] DELETE /identity/v3/users/432e006c35534801837c6db5f338fcc7 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:28:29.476846 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f20fed-5cca-4b55-ad26-8ce7ac92e7f1 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:29.483264 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f20fed-5cca-4b55-ad26-8ce7ac92e7f1 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:29.483883 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f20fed-5cca-4b55-ad26-8ce7ac92e7f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:29.533960 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-f1f20fed-5cca-4b55-ad26-8ce7ac92e7f1 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:28:29.536516 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-f1f20fed-5cca-4b55-ad26-8ce7ac92e7f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:29.741193 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2234/4460] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:28:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:28:29.762700 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a28aef-d820-4156-b24a-566d3d5b8654 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:29.764183 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-27a28aef-d820-4156-b24a-566d3d5b8654 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:29.923438 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a28aef-d820-4156-b24a-566d3d5b8654 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:29.936874 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167d6453-27f6-43b1-a4aa-4e45d9f580c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:29.937585 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167d6453-27f6-43b1-a4aa-4e45d9f580c7 service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:29.937919 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167d6453-27f6-43b1-a4aa-4e45d9f580c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:29.938151 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167d6453-27f6-43b1-a4aa-4e45d9f580c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:29.990676 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167d6453-27f6-43b1-a4aa-4e45d9f580c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:29.993013 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167d6453-27f6-43b1-a4aa-4e45d9f580c7 service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:30.050612 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2227/4461] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:28:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 23 21:28:30.883244 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f20fed-5cca-4b55-ad26-8ce7ac92e7f1 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:30.887110 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-f1f20fed-5cca-4b55-ad26-8ce7ac92e7f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:30.918038 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f20fed-5cca-4b55-ad26-8ce7ac92e7f1 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:30.923303 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fe08bb-ed60-41eb-85db-3cfdc8d433d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:30.923976 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fe08bb-ed60-41eb-85db-3cfdc8d433d4 service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:30.924247 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fe08bb-ed60-41eb-85db-3cfdc8d433d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:30.925008 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fe08bb-ed60-41eb-85db-3cfdc8d433d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:30.926911 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-27fe08bb-ed60-41eb-85db-3cfdc8d433d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:31.073362 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167d6453-27f6-43b1-a4aa-4e45d9f580c7 service neutron] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:31.084014 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167d6453-27f6-43b1-a4aa-4e45d9f580c7 service neutron] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:31.093162 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147b790b-12a5-4f11-aec4-e18cf86b3e10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:31.094231 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147b790b-12a5-4f11-aec4-e18cf86b3e10 service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:31.094849 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147b790b-12a5-4f11-aec4-e18cf86b3e10 service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:31.095400 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147b790b-12a5-4f11-aec4-e18cf86b3e10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:31.100913 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-147b790b-12a5-4f11-aec4-e18cf86b3e10 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:31.134123 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147b790b-12a5-4f11-aec4-e18cf86b3e10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:31.135218 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fe08bb-ed60-41eb-85db-3cfdc8d433d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:31.135580 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147b790b-12a5-4f11-aec4-e18cf86b3e10 service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:31.136993 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fe08bb-ed60-41eb-85db-3cfdc8d433d4 service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:31.153945 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2235/4462] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:28:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 23 21:28:31.169610 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2228/4463] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:28:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 23 21:28:31.749678 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce1ae5a-22b8-419c-820b-cf1cd7c7ac57 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:31.750363 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce1ae5a-22b8-419c-820b-cf1cd7c7ac57 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:31.750900 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce1ae5a-22b8-419c-820b-cf1cd7c7ac57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:31.816242 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-fce1ae5a-22b8-419c-820b-cf1cd7c7ac57 None None] MFA Rules not processed for user `a7a723a102d34fbfa2662b07f9b10fc8`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:28:31.818467 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-fce1ae5a-22b8-419c-820b-cf1cd7c7ac57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:32.047371 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:28:32.132069 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2236/4464] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:28:31 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 384 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:28:32.142880 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b15021-14e8-44fb-805f-33b10de8e897 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:32.143524 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b15021-14e8-44fb-805f-33b10de8e897 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:32.143832 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b15021-14e8-44fb-805f-33b10de8e897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:32.209259 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-48b15021-14e8-44fb-805f-33b10de8e897 None None] MFA Rules not processed for user `a7a723a102d34fbfa2662b07f9b10fc8`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:28:32.210627 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-48b15021-14e8-44fb-805f-33b10de8e897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:32.250919 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2229/4465] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:28:32 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:28:32.262241 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce1ae5a-22b8-419c-820b-cf1cd7c7ac57 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:32.264403 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-fce1ae5a-22b8-419c-820b-cf1cd7c7ac57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:32.324690 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce1ae5a-22b8-419c-820b-cf1cd7c7ac57 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:32.330629 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26090e5-a9ca-40ac-935a-a6ef3ab4033d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:32.331316 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26090e5-a9ca-40ac-935a-a6ef3ab4033d service nova] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:32.331594 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26090e5-a9ca-40ac-935a-a6ef3ab4033d service nova] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:32.331865 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26090e5-a9ca-40ac-935a-a6ef3ab4033d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:32.343608 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26090e5-a9ca-40ac-935a-a6ef3ab4033d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:32.349071 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26090e5-a9ca-40ac-935a-a6ef3ab4033d service nova] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:32.382014 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2237/4466] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:28:32 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:28:32.529906 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b15021-14e8-44fb-805f-33b10de8e897 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:32.531542 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-48b15021-14e8-44fb-805f-33b10de8e897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:32.566988 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b15021-14e8-44fb-805f-33b10de8e897 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:32.576319 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ed6e59-0b59-42bf-8f0f-f361023aeaac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:32.577415 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ed6e59-0b59-42bf-8f0f-f361023aeaac admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:32.577907 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ed6e59-0b59-42bf-8f0f-f361023aeaac admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:32.578335 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ed6e59-0b59-42bf-8f0f-f361023aeaac admin admin] PATH_INFO: `/v3/projects/d4f9dbcffefc445cac695e88c40253cd` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:32.579737 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ed6e59-0b59-42bf-8f0f-f361023aeaac admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4f9dbcffefc445cac695e88c40253cd)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:32.584653 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ed6e59-0b59-42bf-8f0f-f361023aeaac admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:32.725698 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c4ed6e59-0b59-42bf-8f0f-f361023aeaac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4f9dbcffefc445cac695e88c40253cd', 'request_id': 'req-c4ed6e59-0b59-42bf-8f0f-f361023aeaac'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:32.748467 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c4ed6e59-0b59-42bf-8f0f-f361023aeaac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4f9dbcffefc445cac695e88c40253cd', 'request_id': 'req-c4ed6e59-0b59-42bf-8f0f-f361023aeaac'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:32.770314 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c4ed6e59-0b59-42bf-8f0f-f361023aeaac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4f9dbcffefc445cac695e88c40253cd', 'request_id': 'req-c4ed6e59-0b59-42bf-8f0f-f361023aeaac'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:32.802049 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c4ed6e59-0b59-42bf-8f0f-f361023aeaac admin admin] The token cache is being invalidate because project d4f9dbcffefc445cac695e88c40253cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:28:32.802337 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c4ed6e59-0b59-42bf-8f0f-f361023aeaac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:32.803016 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c4ed6e59-0b59-42bf-8f0f-f361023aeaac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:32.807435 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2230/4467] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:28:32 2022] DELETE /identity/v3/projects/d4f9dbcffefc445cac695e88c40253cd => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:28:32.808829 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26090e5-a9ca-40ac-935a-a6ef3ab4033d service nova] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:32.831313 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26090e5-a9ca-40ac-935a-a6ef3ab4033d service nova] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:32.963694 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815e8107-a6ff-47b4-a932-82ebe06d96d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:32.964618 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815e8107-a6ff-47b4-a932-82ebe06d96d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:32.964895 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815e8107-a6ff-47b4-a932-82ebe06d96d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:32.965169 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815e8107-a6ff-47b4-a932-82ebe06d96d9 admin admin] PATH_INFO: `/v3/users/1773241ed9554dd09628d3aeb840541e` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:32.966442 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815e8107-a6ff-47b4-a932-82ebe06d96d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1773241ed9554dd09628d3aeb840541e)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:32.968928 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815e8107-a6ff-47b4-a932-82ebe06d96d9 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:33.060772 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-815e8107-a6ff-47b4-a932-82ebe06d96d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1773241ed9554dd09628d3aeb840541e'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:33.071463 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-815e8107-a6ff-47b4-a932-82ebe06d96d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1773241ed9554dd09628d3aeb840541e'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:33.072262 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-815e8107-a6ff-47b4-a932-82ebe06d96d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1773241ed9554dd09628d3aeb840541e'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:33.082902 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-815e8107-a6ff-47b4-a932-82ebe06d96d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1773241ed9554dd09628d3aeb840541e'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:33.104152 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-815e8107-a6ff-47b4-a932-82ebe06d96d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1773241ed9554dd09628d3aeb840541e'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:33.114583 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2238/4468] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:28:32 2022] DELETE /identity/v3/users/1773241ed9554dd09628d3aeb840541e => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:28:34.591106 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ed6e59-0b59-42bf-8f0f-f361023aeaac admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:34.596297 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-c4ed6e59-0b59-42bf-8f0f-f361023aeaac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:34.664631 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ed6e59-0b59-42bf-8f0f-f361023aeaac admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:34.869520 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25637c66-0e17-4ae8-b7ee-73ff3613922e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:34.870855 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25637c66-0e17-4ae8-b7ee-73ff3613922e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:34.871354 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25637c66-0e17-4ae8-b7ee-73ff3613922e admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:34.872060 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25637c66-0e17-4ae8-b7ee-73ff3613922e admin admin] PATH_INFO: `/v3/projects/b9e72188cab841c5868f5d2984d8c0ad` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:34.875816 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25637c66-0e17-4ae8-b7ee-73ff3613922e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9e72188cab841c5868f5d2984d8c0ad)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:34.889061 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25637c66-0e17-4ae8-b7ee-73ff3613922e admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:34.915515 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:28:35.039175 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-25637c66-0e17-4ae8-b7ee-73ff3613922e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9e72188cab841c5868f5d2984d8c0ad', 'request_id': 'req-25637c66-0e17-4ae8-b7ee-73ff3613922e'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:35.061577 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-25637c66-0e17-4ae8-b7ee-73ff3613922e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9e72188cab841c5868f5d2984d8c0ad', 'request_id': 'req-25637c66-0e17-4ae8-b7ee-73ff3613922e'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:35.075200 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-25637c66-0e17-4ae8-b7ee-73ff3613922e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9e72188cab841c5868f5d2984d8c0ad', 'request_id': 'req-25637c66-0e17-4ae8-b7ee-73ff3613922e'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:35.101727 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-25637c66-0e17-4ae8-b7ee-73ff3613922e admin admin] The token cache is being invalidate because project b9e72188cab841c5868f5d2984d8c0ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:28:35.102700 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-25637c66-0e17-4ae8-b7ee-73ff3613922e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:35.103552 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-25637c66-0e17-4ae8-b7ee-73ff3613922e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:35.112430 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2231/4469] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:28:34 2022] DELETE /identity/v3/projects/b9e72188cab841c5868f5d2984d8c0ad => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:28:35.118868 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bc44c5-5062-44f7-8c27-8f56c7c4bea9 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:35.119712 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bc44c5-5062-44f7-8c27-8f56c7c4bea9 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:35.120225 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bc44c5-5062-44f7-8c27-8f56c7c4bea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:35.183143 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-e2bc44c5-5062-44f7-8c27-8f56c7c4bea9 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:28:35.184771 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-e2bc44c5-5062-44f7-8c27-8f56c7c4bea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:35.272974 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:28:35.303033 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2239/4470] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:28:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:28:35.310740 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71a3ed4-c085-40a0-b386-7cc39a6efacc None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:35.311334 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71a3ed4-c085-40a0-b386-7cc39a6efacc None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:35.311872 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71a3ed4-c085-40a0-b386-7cc39a6efacc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:35.351339 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-a71a3ed4-c085-40a0-b386-7cc39a6efacc None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:28:35.354661 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-a71a3ed4-c085-40a0-b386-7cc39a6efacc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:35.368878 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2232/4471] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:28:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:28:35.372233 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bc44c5-5062-44f7-8c27-8f56c7c4bea9 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:35.389581 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71a3ed4-c085-40a0-b386-7cc39a6efacc None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:35.389902 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bc44c5-5062-44f7-8c27-8f56c7c4bea9 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:35.391519 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-a71a3ed4-c085-40a0-b386-7cc39a6efacc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:35.396680 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95ea224-a3aa-48a0-a281-b3fea4ea1111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:35.397621 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95ea224-a3aa-48a0-a281-b3fea4ea1111 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:35.398167 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95ea224-a3aa-48a0-a281-b3fea4ea1111 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:35.398634 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95ea224-a3aa-48a0-a281-b3fea4ea1111 admin admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:35.399568 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95ea224-a3aa-48a0-a281-b3fea4ea1111 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:28:35.400070 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95ea224-a3aa-48a0-a281-b3fea4ea1111 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:35.401890 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95ea224-a3aa-48a0-a281-b3fea4ea1111 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:35.420800 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71a3ed4-c085-40a0-b386-7cc39a6efacc None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:35.434443 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067c6466-1b53-44c8-8059-46026b3bf4dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:35.436935 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067c6466-1b53-44c8-8059-46026b3bf4dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:35.437578 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067c6466-1b53-44c8-8059-46026b3bf4dd admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:35.442160 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067c6466-1b53-44c8-8059-46026b3bf4dd admin admin] PATH_INFO: `/v3/users/ba49c745133b44f99ee9a7e4aa86dd54` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:35.442644 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2240/4472] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:28:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:28:35.443312 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067c6466-1b53-44c8-8059-46026b3bf4dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba49c745133b44f99ee9a7e4aa86dd54)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:35.444084 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95ea224-a3aa-48a0-a281-b3fea4ea1111 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:35.447619 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067c6466-1b53-44c8-8059-46026b3bf4dd admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:35.465073 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95ea224-a3aa-48a0-a281-b3fea4ea1111 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:35.487120 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d23b4ff-8b4a-43c6-b0cb-d59f02e0f342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:35.488149 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d23b4ff-8b4a-43c6-b0cb-d59f02e0f342 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:35.488596 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d23b4ff-8b4a-43c6-b0cb-d59f02e0f342 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:35.489034 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d23b4ff-8b4a-43c6-b0cb-d59f02e0f342 admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:35.489952 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d23b4ff-8b4a-43c6-b0cb-d59f02e0f342 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:35.492107 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d23b4ff-8b4a-43c6-b0cb-d59f02e0f342 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:35.539933 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2241/4473] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:28:35 2022] POST /identity/v3/projects => generated 367 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:28:35.554028 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d23b4ff-8b4a-43c6-b0cb-d59f02e0f342 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:35.575302 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-067c6466-1b53-44c8-8059-46026b3bf4dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba49c745133b44f99ee9a7e4aa86dd54'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:35.576422 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-067c6466-1b53-44c8-8059-46026b3bf4dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba49c745133b44f99ee9a7e4aa86dd54'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:35.587382 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-067c6466-1b53-44c8-8059-46026b3bf4dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba49c745133b44f99ee9a7e4aa86dd54'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:35.603694 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-067c6466-1b53-44c8-8059-46026b3bf4dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba49c745133b44f99ee9a7e4aa86dd54'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:35.638059 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-067c6466-1b53-44c8-8059-46026b3bf4dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba49c745133b44f99ee9a7e4aa86dd54'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:35.649773 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2233/4474] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:28:35 2022] DELETE /identity/v3/users/ba49c745133b44f99ee9a7e4aa86dd54 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:28:35.679842 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d23b4ff-8b4a-43c6-b0cb-d59f02e0f342 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:35.796333 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d797f9-0611-4fe5-b0e9-e33d007684d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:35.797371 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d797f9-0611-4fe5-b0e9-e33d007684d1 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:35.797371 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d797f9-0611-4fe5-b0e9-e33d007684d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:35.797675 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d797f9-0611-4fe5-b0e9-e33d007684d1 admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:35.798352 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d797f9-0611-4fe5-b0e9-e33d007684d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:35.801374 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d797f9-0611-4fe5-b0e9-e33d007684d1 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:35.860167 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2242/4475] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:28:35 2022] POST /identity/v3/users => generated 284 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:28:35.862512 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067c6466-1b53-44c8-8059-46026b3bf4dd admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:35.865607 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-067c6466-1b53-44c8-8059-46026b3bf4dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:35.907802 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067c6466-1b53-44c8-8059-46026b3bf4dd admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:35.921221 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1c315d-d566-4652-ad91-0d61bb89e1ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:35.922502 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1c315d-d566-4652-ad91-0d61bb89e1ee admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:35.922935 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1c315d-d566-4652-ad91-0d61bb89e1ee admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:35.923311 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1c315d-d566-4652-ad91-0d61bb89e1ee admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:35.924371 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1c315d-d566-4652-ad91-0d61bb89e1ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:35.926184 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1c315d-d566-4652-ad91-0d61bb89e1ee admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:35.940060 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2234/4476] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:28:35 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:28:35.946466 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d797f9-0611-4fe5-b0e9-e33d007684d1 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:35.963303 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d797f9-0611-4fe5-b0e9-e33d007684d1 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:35.970722 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df03cc0-db06-489b-849d-3089618fd488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:35.972599 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df03cc0-db06-489b-849d-3089618fd488 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:35.972599 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df03cc0-db06-489b-849d-3089618fd488 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:35.973190 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df03cc0-db06-489b-849d-3089618fd488 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:35.974362 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df03cc0-db06-489b-849d-3089618fd488 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:35.976756 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df03cc0-db06-489b-849d-3089618fd488 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:35.991354 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2243/4477] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:28:35 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:28:35.996009 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1c315d-d566-4652-ad91-0d61bb89e1ee admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:36.010401 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1c315d-d566-4652-ad91-0d61bb89e1ee admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:36.016658 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a32790-2a96-4ea8-bbea-d4efe65bc6b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:36.017762 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a32790-2a96-4ea8-bbea-d4efe65bc6b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:36.018244 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a32790-2a96-4ea8-bbea-d4efe65bc6b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:36.018615 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a32790-2a96-4ea8-bbea-d4efe65bc6b5 admin admin] PATH_INFO: `/v3/projects/29cbff2323bf4e599627ba18f23ad04a/users/09023cf9fa874a70818346601874844a/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:36.043781 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a32790-2a96-4ea8-bbea-d4efe65bc6b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29cbff2323bf4e599627ba18f23ad04a, user_id=09023cf9fa874a70818346601874844a, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:36.047926 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a32790-2a96-4ea8-bbea-d4efe65bc6b5 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:36.080244 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2235/4478] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:28:35 2022] PUT /identity/v3/projects/29cbff2323bf4e599627ba18f23ad04a/users/09023cf9fa874a70818346601874844a/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:28:36.092088 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173ebf26-3a1d-441f-9955-f233e7f18fea None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:36.092376 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173ebf26-3a1d-441f-9955-f233e7f18fea None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:36.092935 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173ebf26-3a1d-441f-9955-f233e7f18fea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:36.161625 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-173ebf26-3a1d-441f-9955-f233e7f18fea None None] MFA Rules not processed for user `09023cf9fa874a70818346601874844a`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:28:36.162919 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-173ebf26-3a1d-441f-9955-f233e7f18fea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:36.285356 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:28:36.449369 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2244/4479] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:28:36 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 360 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:28:36.453946 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a32790-2a96-4ea8-bbea-d4efe65bc6b5 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:36.503609 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:28:36.568365 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a32790-2a96-4ea8-bbea-d4efe65bc6b5 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:36.575223 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0346dbf2-cb74-47e1-a70d-4c3ed6fdd03a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:36.576662 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0346dbf2-cb74-47e1-a70d-4c3ed6fdd03a admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:36.577172 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0346dbf2-cb74-47e1-a70d-4c3ed6fdd03a admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:36.577667 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0346dbf2-cb74-47e1-a70d-4c3ed6fdd03a admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:36.578831 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0346dbf2-cb74-47e1-a70d-4c3ed6fdd03a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:36.581297 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0346dbf2-cb74-47e1-a70d-4c3ed6fdd03a admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:36.630857 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2236/4480] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:28:36 2022] POST /identity/v3/projects => generated 369 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:28:36.635007 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173ebf26-3a1d-441f-9955-f233e7f18fea None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:36.649914 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173ebf26-3a1d-441f-9955-f233e7f18fea None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:36.762251 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c677d42-240f-454c-80d8-6fde161bbf03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:36.763659 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c677d42-240f-454c-80d8-6fde161bbf03 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:36.764386 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c677d42-240f-454c-80d8-6fde161bbf03 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:36.764890 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c677d42-240f-454c-80d8-6fde161bbf03 admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:36.766031 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c677d42-240f-454c-80d8-6fde161bbf03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:36.768769 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c677d42-240f-454c-80d8-6fde161bbf03 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:36.798373 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2245/4481] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:28:36 2022] POST /identity/v3/users => generated 291 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:28:36.802356 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0346dbf2-cb74-47e1-a70d-4c3ed6fdd03a admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:36.832082 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0346dbf2-cb74-47e1-a70d-4c3ed6fdd03a admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:36.838524 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882f99bf-0c8f-4a59-8335-ffbe35652f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:36.839817 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882f99bf-0c8f-4a59-8335-ffbe35652f05 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:36.840416 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882f99bf-0c8f-4a59-8335-ffbe35652f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:36.840954 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882f99bf-0c8f-4a59-8335-ffbe35652f05 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:36.842032 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882f99bf-0c8f-4a59-8335-ffbe35652f05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:36.844127 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882f99bf-0c8f-4a59-8335-ffbe35652f05 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:36.862823 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2237/4482] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:28:36 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:28:36.867335 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c677d42-240f-454c-80d8-6fde161bbf03 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:36.882609 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c677d42-240f-454c-80d8-6fde161bbf03 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:36.890943 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec4f1ec-e7f2-44b9-8ae5-28161fa014d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:36.892428 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec4f1ec-e7f2-44b9-8ae5-28161fa014d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:36.893064 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec4f1ec-e7f2-44b9-8ae5-28161fa014d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:36.893795 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec4f1ec-e7f2-44b9-8ae5-28161fa014d4 admin admin] PATH_INFO: `/v3/projects/84ccaff652d244cab7e5e736532f5c02/users/ba8d06e121db4caf92ce215e16fc3324/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:36.916622 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec4f1ec-e7f2-44b9-8ae5-28161fa014d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84ccaff652d244cab7e5e736532f5c02, user_id=ba8d06e121db4caf92ce215e16fc3324, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:36.921254 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec4f1ec-e7f2-44b9-8ae5-28161fa014d4 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:36.947779 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2246/4483] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:28:36 2022] PUT /identity/v3/projects/84ccaff652d244cab7e5e736532f5c02/users/ba8d06e121db4caf92ce215e16fc3324/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:28:36.952173 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882f99bf-0c8f-4a59-8335-ffbe35652f05 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:36.967245 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882f99bf-0c8f-4a59-8335-ffbe35652f05 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:37.084880 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8331bea-fbde-4def-93be-8f261edf3b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:37.085740 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8331bea-fbde-4def-93be-8f261edf3b65 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:37.085968 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8331bea-fbde-4def-93be-8f261edf3b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:37.086295 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8331bea-fbde-4def-93be-8f261edf3b65 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:37.087035 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8331bea-fbde-4def-93be-8f261edf3b65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:37.088900 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8331bea-fbde-4def-93be-8f261edf3b65 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:37.106000 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2238/4484] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:28:36 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:28:37.107569 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec4f1ec-e7f2-44b9-8ae5-28161fa014d4 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:37.127034 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec4f1ec-e7f2-44b9-8ae5-28161fa014d4 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:37.136003 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6d7f65-5abe-4c82-adb4-06d47f5647be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:37.138404 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6d7f65-5abe-4c82-adb4-06d47f5647be admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:37.138948 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6d7f65-5abe-4c82-adb4-06d47f5647be admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:37.139795 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6d7f65-5abe-4c82-adb4-06d47f5647be admin admin] PATH_INFO: `/v3/projects/84ccaff652d244cab7e5e736532f5c02/users/ba8d06e121db4caf92ce215e16fc3324/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:37.144194 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6d7f65-5abe-4c82-adb4-06d47f5647be admin admin] RBAC: Authorizing `identity:create_grant(project_id=84ccaff652d244cab7e5e736532f5c02, user_id=ba8d06e121db4caf92ce215e16fc3324, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:37.147310 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6d7f65-5abe-4c82-adb4-06d47f5647be admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:37.197078 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2247/4485] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:28:37 2022] PUT /identity/v3/projects/84ccaff652d244cab7e5e736532f5c02/users/ba8d06e121db4caf92ce215e16fc3324/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:28:37.210178 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694eb328-ea95-4903-a130-aa0a4c529e66 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:37.210454 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694eb328-ea95-4903-a130-aa0a4c529e66 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:37.210736 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694eb328-ea95-4903-a130-aa0a4c529e66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:37.232174 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6d7f65-5abe-4c82-adb4-06d47f5647be admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:37.234168 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-9f6d7f65-5abe-4c82-adb4-06d47f5647be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:37.296410 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-694eb328-ea95-4903-a130-aa0a4c529e66 None None] MFA Rules not processed for user `ba8d06e121db4caf92ce215e16fc3324`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:28:37.296993 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-694eb328-ea95-4903-a130-aa0a4c529e66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:37.366860 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6d7f65-5abe-4c82-adb4-06d47f5647be admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:37.374469 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a27c06a-300f-4ab0-a625-cee0e28089ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:37.375800 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a27c06a-300f-4ab0-a625-cee0e28089ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:37.376792 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a27c06a-300f-4ab0-a625-cee0e28089ee admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:37.377370 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a27c06a-300f-4ab0-a625-cee0e28089ee admin admin] PATH_INFO: `/v3/projects/ab066f574cfe4405bf9ed948b81c8f24` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:37.387503 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a27c06a-300f-4ab0-a625-cee0e28089ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab066f574cfe4405bf9ed948b81c8f24)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:37.396173 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a27c06a-300f-4ab0-a625-cee0e28089ee admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:37.446413 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2239/4486] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:28:37 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:28:37.447303 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694eb328-ea95-4903-a130-aa0a4c529e66 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:37.460765 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694eb328-ea95-4903-a130-aa0a4c529e66 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:37.466348 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b498691-565d-4155-bd71-718c1ec53bf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:37.466585 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:28:37.467027 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b498691-565d-4155-bd71-718c1ec53bf7 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:37.467306 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b498691-565d-4155-bd71-718c1ec53bf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:37.467584 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b498691-565d-4155-bd71-718c1ec53bf7 admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:37.468277 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b498691-565d-4155-bd71-718c1ec53bf7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:37.470230 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b498691-565d-4155-bd71-718c1ec53bf7 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:37.500790 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:28:37.515779 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2240/4487] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:28:37 2022] POST /identity/v3/projects => generated 369 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:28:37.516875 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b498691-565d-4155-bd71-718c1ec53bf7 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:37.537538 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-0a27c06a-300f-4ab0-a625-cee0e28089ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab066f574cfe4405bf9ed948b81c8f24', 'request_id': 'req-0a27c06a-300f-4ab0-a625-cee0e28089ee'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:37.557730 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-0a27c06a-300f-4ab0-a625-cee0e28089ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab066f574cfe4405bf9ed948b81c8f24', 'request_id': 'req-0a27c06a-300f-4ab0-a625-cee0e28089ee'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:37.570305 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-0a27c06a-300f-4ab0-a625-cee0e28089ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab066f574cfe4405bf9ed948b81c8f24', 'request_id': 'req-0a27c06a-300f-4ab0-a625-cee0e28089ee'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:37.603197 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-0a27c06a-300f-4ab0-a625-cee0e28089ee admin admin] The token cache is being invalidate because project ab066f574cfe4405bf9ed948b81c8f24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:28:37.603197 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-0a27c06a-300f-4ab0-a625-cee0e28089ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:37.609854 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b498691-565d-4155-bd71-718c1ec53bf7 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:37.613230 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-0a27c06a-300f-4ab0-a625-cee0e28089ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:37.618946 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec5ae64-7c7a-4c97-8eaf-ef1449aef401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:37.619164 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2248/4488] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:28:37 2022] DELETE /identity/v3/projects/ab066f574cfe4405bf9ed948b81c8f24 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:28:37.619586 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec5ae64-7c7a-4c97-8eaf-ef1449aef401 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:37.619914 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec5ae64-7c7a-4c97-8eaf-ef1449aef401 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:37.620387 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec5ae64-7c7a-4c97-8eaf-ef1449aef401 admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:37.620556 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a27c06a-300f-4ab0-a625-cee0e28089ee admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:37.621464 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec5ae64-7c7a-4c97-8eaf-ef1449aef401 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:37.622943 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-0a27c06a-300f-4ab0-a625-cee0e28089ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:37.623902 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec5ae64-7c7a-4c97-8eaf-ef1449aef401 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:37.668779 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2241/4489] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:28:37 2022] POST /identity/v3/users => generated 285 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:28:37.674322 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfef4757-1cf1-4d83-a86d-f9f560aa6cf4 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:37.675018 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfef4757-1cf1-4d83-a86d-f9f560aa6cf4 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:37.675624 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfef4757-1cf1-4d83-a86d-f9f560aa6cf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:37.714986 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-bfef4757-1cf1-4d83-a86d-f9f560aa6cf4 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:28:37.716511 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-bfef4757-1cf1-4d83-a86d-f9f560aa6cf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:37.728351 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2242/4490] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:28:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:28:37.729705 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfef4757-1cf1-4d83-a86d-f9f560aa6cf4 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:37.740534 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-bfef4757-1cf1-4d83-a86d-f9f560aa6cf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:37.765841 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfef4757-1cf1-4d83-a86d-f9f560aa6cf4 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:37.778606 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f22205d-62d7-48b4-a5d0-1b96ed5de39e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:37.779646 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f22205d-62d7-48b4-a5d0-1b96ed5de39e admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:37.780122 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f22205d-62d7-48b4-a5d0-1b96ed5de39e admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:37.781216 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f22205d-62d7-48b4-a5d0-1b96ed5de39e admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:37.782290 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f22205d-62d7-48b4-a5d0-1b96ed5de39e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:37.788210 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f22205d-62d7-48b4-a5d0-1b96ed5de39e admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:37.814331 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2243/4491] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:28:37 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:28:37.817542 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04af056b-3dba-4c5f-921e-f4b1ab3a80f4 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:37.818053 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04af056b-3dba-4c5f-921e-f4b1ab3a80f4 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:37.819924 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04af056b-3dba-4c5f-921e-f4b1ab3a80f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:37.850560 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a27c06a-300f-4ab0-a625-cee0e28089ee admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:37.863783 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-04af056b-3dba-4c5f-921e-f4b1ab3a80f4 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:28:37.865022 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-04af056b-3dba-4c5f-921e-f4b1ab3a80f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:37.866234 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0aeb6d-9ec2-4938-b7cd-3e99df36cef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:37.867440 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0aeb6d-9ec2-4938-b7cd-3e99df36cef1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:37.867928 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0aeb6d-9ec2-4938-b7cd-3e99df36cef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:37.868391 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0aeb6d-9ec2-4938-b7cd-3e99df36cef1 admin admin] PATH_INFO: `/v3/users/14f49744119b4ac8972363ec795a5e89` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:37.871817 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0aeb6d-9ec2-4938-b7cd-3e99df36cef1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=14f49744119b4ac8972363ec795a5e89)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:37.874279 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0aeb6d-9ec2-4938-b7cd-3e99df36cef1 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:37.895283 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2244/4492] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:28:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:28:37.896186 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04af056b-3dba-4c5f-921e-f4b1ab3a80f4 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:37.926489 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04af056b-3dba-4c5f-921e-f4b1ab3a80f4 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:37.943139 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25a5803-0503-4d74-9115-87ee18c9ccd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:37.943863 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25a5803-0503-4d74-9115-87ee18c9ccd6 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:37.944150 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25a5803-0503-4d74-9115-87ee18c9ccd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:37.944921 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25a5803-0503-4d74-9115-87ee18c9ccd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:37.945349 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25a5803-0503-4d74-9115-87ee18c9ccd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:37.947321 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25a5803-0503-4d74-9115-87ee18c9ccd6 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:37.977013 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-bd0aeb6d-9ec2-4938-b7cd-3e99df36cef1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14f49744119b4ac8972363ec795a5e89'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:37.978339 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2245/4493] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:28:37 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:28:37.979303 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25a5803-0503-4d74-9115-87ee18c9ccd6 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:37.993842 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-bd0aeb6d-9ec2-4938-b7cd-3e99df36cef1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14f49744119b4ac8972363ec795a5e89'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:37.994923 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-bd0aeb6d-9ec2-4938-b7cd-3e99df36cef1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14f49744119b4ac8972363ec795a5e89'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:38.005949 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25a5803-0503-4d74-9115-87ee18c9ccd6 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:38.013144 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4f3fbb-677a-4cc8-bf70-01f95594dd69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:38.014157 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4f3fbb-677a-4cc8-bf70-01f95594dd69 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:38.014450 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4f3fbb-677a-4cc8-bf70-01f95594dd69 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:38.014729 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4f3fbb-677a-4cc8-bf70-01f95594dd69 admin admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:38.015503 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4f3fbb-677a-4cc8-bf70-01f95594dd69 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:28:38.015811 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4f3fbb-677a-4cc8-bf70-01f95594dd69 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:38.018633 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-bd0aeb6d-9ec2-4938-b7cd-3e99df36cef1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14f49744119b4ac8972363ec795a5e89'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:38.024345 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4f3fbb-677a-4cc8-bf70-01f95594dd69 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:38.042468 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-bd0aeb6d-9ec2-4938-b7cd-3e99df36cef1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14f49744119b4ac8972363ec795a5e89'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:38.055159 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2246/4495] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:28:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:28:38.055842 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2249/4495] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:28:37 2022] DELETE /identity/v3/users/14f49744119b4ac8972363ec795a5e89 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:28:38.056225 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4f3fbb-677a-4cc8-bf70-01f95594dd69 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:38.057056 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0aeb6d-9ec2-4938-b7cd-3e99df36cef1 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:38.058562 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-bd0aeb6d-9ec2-4938-b7cd-3e99df36cef1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:38.067343 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-7c4f3fbb-677a-4cc8-bf70-01f95594dd69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:38.100958 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4f3fbb-677a-4cc8-bf70-01f95594dd69 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:38.176262 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:28:38.251451 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0aeb6d-9ec2-4938-b7cd-3e99df36cef1 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:38.260337 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e231b06d-08f1-4115-be5f-8f74ec8b605d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:38.260337 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e231b06d-08f1-4115-be5f-8f74ec8b605d admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:38.260716 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e231b06d-08f1-4115-be5f-8f74ec8b605d admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:38.260821 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e231b06d-08f1-4115-be5f-8f74ec8b605d admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:38.261626 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e231b06d-08f1-4115-be5f-8f74ec8b605d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:38.265673 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e231b06d-08f1-4115-be5f-8f74ec8b605d admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:38.296965 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45767094-d3da-4677-af26-990a98537beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:38.300780 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45767094-d3da-4677-af26-990a98537beb admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:38.301648 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45767094-d3da-4677-af26-990a98537beb admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:38.302142 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45767094-d3da-4677-af26-990a98537beb admin admin] PATH_INFO: `/v3/projects/8fa2fd3c28f449a8aba03173395139ad/users/01d27c973c614c72be15f495dc0a77eb/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:38.322290 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2250/4496] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:28:38 2022] POST /identity/v3/projects => generated 397 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:28:38.323652 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5496df58-2eac-4c26-830f-0e4317e3970b None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:38.323948 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5496df58-2eac-4c26-830f-0e4317e3970b None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:38.324226 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5496df58-2eac-4c26-830f-0e4317e3970b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:38.347896 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45767094-d3da-4677-af26-990a98537beb admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fa2fd3c28f449a8aba03173395139ad, user_id=01d27c973c614c72be15f495dc0a77eb, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:38.355648 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45767094-d3da-4677-af26-990a98537beb admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:38.372032 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-5496df58-2eac-4c26-830f-0e4317e3970b None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:28:38.375150 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-5496df58-2eac-4c26-830f-0e4317e3970b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:38.392561 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2247/4497] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:28:38 2022] PUT /identity/v3/projects/8fa2fd3c28f449a8aba03173395139ad/users/01d27c973c614c72be15f495dc0a77eb/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:28:38.397834 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45767094-d3da-4677-af26-990a98537beb admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:38.460898 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:28:38.515284 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45767094-d3da-4677-af26-990a98537beb admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:38.523364 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a65f565-8e0d-440c-9482-8f54054b3a20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:38.524436 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a65f565-8e0d-440c-9482-8f54054b3a20 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:38.524990 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a65f565-8e0d-440c-9482-8f54054b3a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:38.525467 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a65f565-8e0d-440c-9482-8f54054b3a20 admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:38.526409 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a65f565-8e0d-440c-9482-8f54054b3a20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:38.529603 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2251/4498] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:28:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:28:38.536286 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a205792-423a-4e6e-88fd-5b595c4d5904 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:38.536598 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a205792-423a-4e6e-88fd-5b595c4d5904 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:38.537094 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a205792-423a-4e6e-88fd-5b595c4d5904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:38.548564 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a65f565-8e0d-440c-9482-8f54054b3a20 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:38.585092 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-3a205792-423a-4e6e-88fd-5b595c4d5904 None None] MFA Rules not processed for user `01d27c973c614c72be15f495dc0a77eb`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:28:38.589356 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-3a205792-423a-4e6e-88fd-5b595c4d5904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:38.598773 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2248/4499] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:28:38 2022] POST /identity/v3/users => generated 299 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:28:38.600541 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a65f565-8e0d-440c-9482-8f54054b3a20 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:38.611663 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-9a65f565-8e0d-440c-9482-8f54054b3a20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:38.724525 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a65f565-8e0d-440c-9482-8f54054b3a20 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:38.730656 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5d874e-d228-4021-9839-cf393bee2959 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:38.731482 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5d874e-d228-4021-9839-cf393bee2959 service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:38.731941 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5d874e-d228-4021-9839-cf393bee2959 service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:38.732626 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5d874e-d228-4021-9839-cf393bee2959 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:38.741634 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2252/4500] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:28:38 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:28:38.742654 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a205792-423a-4e6e-88fd-5b595c4d5904 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:38.758331 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5d874e-d228-4021-9839-cf393bee2959 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:38.759943 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5d874e-d228-4021-9839-cf393bee2959 service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:38.766571 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a205792-423a-4e6e-88fd-5b595c4d5904 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:38.775158 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2249/4501] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:28:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:28:38.776368 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5d874e-d228-4021-9839-cf393bee2959 service neutron] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:38.780032 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbb8df3-34bf-4fd3-8fcc-2b0d1d9ba414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:38.780743 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbb8df3-34bf-4fd3-8fcc-2b0d1d9ba414 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:38.781188 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbb8df3-34bf-4fd3-8fcc-2b0d1d9ba414 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:38.781472 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbb8df3-34bf-4fd3-8fcc-2b0d1d9ba414 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:38.782266 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbb8df3-34bf-4fd3-8fcc-2b0d1d9ba414 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:38.783983 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbb8df3-34bf-4fd3-8fcc-2b0d1d9ba414 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:38.784563 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-1d5d874e-d228-4021-9839-cf393bee2959 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:38.802071 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2253/4502] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:28:38 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:28:38.807171 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbb8df3-34bf-4fd3-8fcc-2b0d1d9ba414 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:38.823123 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbb8df3-34bf-4fd3-8fcc-2b0d1d9ba414 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:38.827032 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21979f5f-1996-4717-8755-dc7779f807d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:38.827875 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21979f5f-1996-4717-8755-dc7779f807d6 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:38.828134 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21979f5f-1996-4717-8755-dc7779f807d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:38.828897 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21979f5f-1996-4717-8755-dc7779f807d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:38.829145 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21979f5f-1996-4717-8755-dc7779f807d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:38.831415 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21979f5f-1996-4717-8755-dc7779f807d6 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:38.845257 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2254/4503] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:28:38 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:28:38.851170 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21979f5f-1996-4717-8755-dc7779f807d6 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:38.866257 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21979f5f-1996-4717-8755-dc7779f807d6 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:38.872181 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7905c8-42a2-4555-831e-65fb180f8046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:38.873193 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7905c8-42a2-4555-831e-65fb180f8046 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:38.873477 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7905c8-42a2-4555-831e-65fb180f8046 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:38.873753 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7905c8-42a2-4555-831e-65fb180f8046 admin admin] PATH_INFO: `/v3/projects/21695c8a68454c07bd8c466671076897/users/896f9085718446cd90ce445c09be4741/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:38.907927 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5d874e-d228-4021-9839-cf393bee2959 service neutron] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:38.908163 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7905c8-42a2-4555-831e-65fb180f8046 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21695c8a68454c07bd8c466671076897, user_id=896f9085718446cd90ce445c09be4741, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:38.911178 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7905c8-42a2-4555-831e-65fb180f8046 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:38.918967 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31ee5cf-fbd7-400b-af24-363fcc712517 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba8d06e121db4caf92ce215e16fc3324', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ccaff652d244cab7e5e736532f5c02', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:38.919947 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31ee5cf-fbd7-400b-af24-363fcc712517 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:38.921097 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31ee5cf-fbd7-400b-af24-363fcc712517 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:38.921629 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31ee5cf-fbd7-400b-af24-363fcc712517 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:38.923569 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31ee5cf-fbd7-400b-af24-363fcc712517 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:38.925817 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31ee5cf-fbd7-400b-af24-363fcc712517 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:38.930764 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:28:38.938723 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2255/4504] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:28:38 2022] PUT /identity/v3/projects/21695c8a68454c07bd8c466671076897/users/896f9085718446cd90ce445c09be4741/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:28:38.945198 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2e837e-f227-4457-8e80-384000c39c3a None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:38.945489 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2e837e-f227-4457-8e80-384000c39c3a None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:38.945767 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2e837e-f227-4457-8e80-384000c39c3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:38.955224 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2250/4505] 10.222.0.17 () {60 vars in 1148 bytes} [Sat Jul 23 21:28:38 2022] POST /identity/v3/domains => generated 275 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:28:38.956472 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31ee5cf-fbd7-400b-af24-363fcc712517 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:38.993048 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-fb2e837e-f227-4457-8e80-384000c39c3a None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:28:38.994332 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-fb2e837e-f227-4457-8e80-384000c39c3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:39.020704 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:28:39.041284 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31ee5cf-fbd7-400b-af24-363fcc712517 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:39.064398 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8f5b68-dd81-4381-8703-ec224e2378b7 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba8d06e121db4caf92ce215e16fc3324', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ccaff652d244cab7e5e736532f5c02', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:39.065164 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8f5b68-dd81-4381-8703-ec224e2378b7 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:39.065450 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8f5b68-dd81-4381-8703-ec224e2378b7 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:39.065727 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8f5b68-dd81-4381-8703-ec224e2378b7 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:39.066514 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8f5b68-dd81-4381-8703-ec224e2378b7 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:39.068143 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8f5b68-dd81-4381-8703-ec224e2378b7 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:39.086658 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2256/4506] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:28:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:28:39.103307 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2e837e-f227-4457-8e80-384000c39c3a None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:39.104969 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-fb2e837e-f227-4457-8e80-384000c39c3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:39.117035 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2251/4507] 10.222.0.17 () {60 vars in 1142 bytes} [Sat Jul 23 21:28:38 2022] POST /identity/v3/roles => generated 239 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:28:39.120939 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8f5b68-dd81-4381-8703-ec224e2378b7 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:39.147728 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8f5b68-dd81-4381-8703-ec224e2378b7 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:39.159556 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8960c4bd-da27-486c-94ab-ec953ec2a0d3 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba8d06e121db4caf92ce215e16fc3324', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ccaff652d244cab7e5e736532f5c02', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:39.160509 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8960c4bd-da27-486c-94ab-ec953ec2a0d3 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:39.160792 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8960c4bd-da27-486c-94ab-ec953ec2a0d3 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:39.161095 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8960c4bd-da27-486c-94ab-ec953ec2a0d3 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] PATH_INFO: `/v3/domains/07738135b8fe498fb1f10f873631e9f6/users/01d27c973c614c72be15f495dc0a77eb/roles/32839aa656914b1884615d4d93511977` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:39.191235 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8960c4bd-da27-486c-94ab-ec953ec2a0d3 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=07738135b8fe498fb1f10f873631e9f6, user_id=01d27c973c614c72be15f495dc0a77eb, role_id=32839aa656914b1884615d4d93511977)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:39.198790 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8960c4bd-da27-486c-94ab-ec953ec2a0d3 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:39.229570 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2252/4508] 10.222.0.17 () {60 vars in 1479 bytes} [Sat Jul 23 21:28:39 2022] PUT /identity/v3/domains/07738135b8fe498fb1f10f873631e9f6/users/01d27c973c614c72be15f495dc0a77eb/roles/32839aa656914b1884615d4d93511977 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:28:39.230970 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8960c4bd-da27-486c-94ab-ec953ec2a0d3 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:39.247025 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2e837e-f227-4457-8e80-384000c39c3a None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:39.321339 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8960c4bd-da27-486c-94ab-ec953ec2a0d3 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:39.327695 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38cdefc-18d4-4ce9-a299-d1ed8a4fd058 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba8d06e121db4caf92ce215e16fc3324', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ccaff652d244cab7e5e736532f5c02', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:39.340911 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38cdefc-18d4-4ce9-a299-d1ed8a4fd058 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:39.341358 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38cdefc-18d4-4ce9-a299-d1ed8a4fd058 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:39.341739 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38cdefc-18d4-4ce9-a299-d1ed8a4fd058 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:39.343163 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38cdefc-18d4-4ce9-a299-d1ed8a4fd058 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:39.347194 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38cdefc-18d4-4ce9-a299-d1ed8a4fd058 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:39.386951 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b86cd1-cf21-4449-b08f-8a05cb463003 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:39.387584 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b86cd1-cf21-4449-b08f-8a05cb463003 service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:39.390499 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b86cd1-cf21-4449-b08f-8a05cb463003 service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:39.392861 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b86cd1-cf21-4449-b08f-8a05cb463003 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:39.395414 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2253/4509] 10.222.0.17 () {60 vars in 1148 bytes} [Sat Jul 23 21:28:39 2022] POST /identity/v3/domains => generated 277 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:28:39.397456 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38cdefc-18d4-4ce9-a299-d1ed8a4fd058 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:39.503814 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38cdefc-18d4-4ce9-a299-d1ed8a4fd058 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:39.514679 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8bf857-9707-415d-9956-1acbc242ca9d tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba8d06e121db4caf92ce215e16fc3324', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ccaff652d244cab7e5e736532f5c02', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:39.515597 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8bf857-9707-415d-9956-1acbc242ca9d tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:39.516034 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8bf857-9707-415d-9956-1acbc242ca9d tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:39.516866 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8bf857-9707-415d-9956-1acbc242ca9d tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:39.517749 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8bf857-9707-415d-9956-1acbc242ca9d tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:39.526525 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8bf857-9707-415d-9956-1acbc242ca9d tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:39.562483 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2254/4510] 10.222.0.17 () {60 vars in 1142 bytes} [Sat Jul 23 21:28:39 2022] POST /identity/v3/roles => generated 239 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:28:39.563408 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b86cd1-cf21-4449-b08f-8a05cb463003 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:39.564992 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b86cd1-cf21-4449-b08f-8a05cb463003 service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:39.570803 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8bf857-9707-415d-9956-1acbc242ca9d tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:39.606639 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8bf857-9707-415d-9956-1acbc242ca9d tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:39.614158 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00378f1-30d7-4814-8b8b-49287eb7e467 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba8d06e121db4caf92ce215e16fc3324', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ccaff652d244cab7e5e736532f5c02', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:39.615171 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00378f1-30d7-4814-8b8b-49287eb7e467 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:39.615703 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00378f1-30d7-4814-8b8b-49287eb7e467 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:39.616077 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00378f1-30d7-4814-8b8b-49287eb7e467 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] PATH_INFO: `/v3/groups` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:39.617061 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00378f1-30d7-4814-8b8b-49287eb7e467 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:39.620454 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2257/4511] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:28:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 517 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:28:39.622960 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00378f1-30d7-4814-8b8b-49287eb7e467 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:39.690103 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2255/4512] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:28:39 2022] POST /identity/v3/groups => generated 327 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:28:39.694138 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b86cd1-cf21-4449-b08f-8a05cb463003 service neutron] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:39.711672 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b86cd1-cf21-4449-b08f-8a05cb463003 service neutron] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:39.718841 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3103727-a27f-4b7c-b62d-a9502afa2c6e tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba8d06e121db4caf92ce215e16fc3324', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ccaff652d244cab7e5e736532f5c02', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:39.720659 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3103727-a27f-4b7c-b62d-a9502afa2c6e tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:39.721271 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3103727-a27f-4b7c-b62d-a9502afa2c6e tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:39.721686 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3103727-a27f-4b7c-b62d-a9502afa2c6e tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] PATH_INFO: `/v3/groups/108a6ae64cd14977a2562b32b37dd93d/users/01d27c973c614c72be15f495dc0a77eb` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:39.725364 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:28:39.732083 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3103727-a27f-4b7c-b62d-a9502afa2c6e tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=108a6ae64cd14977a2562b32b37dd93d, user_id=01d27c973c614c72be15f495dc0a77eb)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:39.733403 ncdv-master-1 devstack@keystone.service[91547]: WARNING py.warnings [None req-d3103727-a27f-4b7c-b62d-a9502afa2c6e tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:add_user_to_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:28:39.733403 ncdv-master-1 devstack@keystone.service[91547]: warnings.warn(msg) Jul 23 21:28:39.733403 ncdv-master-1 devstack@keystone.service[91547]: Jul 23 21:28:39.735493 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3103727-a27f-4b7c-b62d-a9502afa2c6e tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:39.779577 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00378f1-30d7-4814-8b8b-49287eb7e467 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:39.792924 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2258/4513] 10.222.0.17 () {60 vars in 1359 bytes} [Sat Jul 23 21:28:39 2022] PUT /identity/v3/groups/108a6ae64cd14977a2562b32b37dd93d/users/01d27c973c614c72be15f495dc0a77eb => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:28:39.796344 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00378f1-30d7-4814-8b8b-49287eb7e467 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:39.835453 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:28:39.869408 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3103727-a27f-4b7c-b62d-a9502afa2c6e tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:39.872427 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-d3103727-a27f-4b7c-b62d-a9502afa2c6e tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:39.934729 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1fb42e-0490-481b-a06c-c051f9d0097c tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba8d06e121db4caf92ce215e16fc3324', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ccaff652d244cab7e5e736532f5c02', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:39.947007 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1fb42e-0490-481b-a06c-c051f9d0097c tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:39.947319 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1fb42e-0490-481b-a06c-c051f9d0097c tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:39.948583 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1fb42e-0490-481b-a06c-c051f9d0097c tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] PATH_INFO: `/v3/domains/a01c840a8f2a480c8e042aca1ef22f52/groups/108a6ae64cd14977a2562b32b37dd93d/roles/b236346d672242b4ac5377c269c1f0b4` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:39.956227 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1fb42e-0490-481b-a06c-c051f9d0097c tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=a01c840a8f2a480c8e042aca1ef22f52, group_id=108a6ae64cd14977a2562b32b37dd93d, role_id=b236346d672242b4ac5377c269c1f0b4)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:39.967141 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1fb42e-0490-481b-a06c-c051f9d0097c tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:40.008451 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2256/4514] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:28:39 2022] PUT /identity/v3/domains/a01c840a8f2a480c8e042aca1ef22f52/groups/108a6ae64cd14977a2562b32b37dd93d/roles/b236346d672242b4ac5377c269c1f0b4 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:28:40.010488 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1fb42e-0490-481b-a06c-c051f9d0097c tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:40.099636 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3103727-a27f-4b7c-b62d-a9502afa2c6e tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:40.248590 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1fb42e-0490-481b-a06c-c051f9d0097c tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:40.275713 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e728dc-d4b2-4122-89a0-1be9e7a4801e tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba8d06e121db4caf92ce215e16fc3324', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ccaff652d244cab7e5e736532f5c02', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:40.276795 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e728dc-d4b2-4122-89a0-1be9e7a4801e tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:40.277294 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e728dc-d4b2-4122-89a0-1be9e7a4801e tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:40.277772 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e728dc-d4b2-4122-89a0-1be9e7a4801e tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:40.278742 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e728dc-d4b2-4122-89a0-1be9e7a4801e tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:40.280457 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e728dc-d4b2-4122-89a0-1be9e7a4801e tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:40.282569 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc66a52-2447-4229-a9eb-b050e1a9a1ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:40.284686 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc66a52-2447-4229-a9eb-b050e1a9a1ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:40.285239 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc66a52-2447-4229-a9eb-b050e1a9a1ff admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:40.285829 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc66a52-2447-4229-a9eb-b050e1a9a1ff admin admin] PATH_INFO: `/v3/projects/9385df4bcafb427284c48f80625ec3bc` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:40.287484 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc66a52-2447-4229-a9eb-b050e1a9a1ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=9385df4bcafb427284c48f80625ec3bc)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:40.292988 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc66a52-2447-4229-a9eb-b050e1a9a1ff admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:40.334012 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2257/4515] 10.222.0.17 () {60 vars in 1148 bytes} [Sat Jul 23 21:28:40 2022] POST /identity/v3/domains => generated 275 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:28:40.335341 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e728dc-d4b2-4122-89a0-1be9e7a4801e tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:40.399387 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-3bc66a52-2447-4229-a9eb-b050e1a9a1ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9385df4bcafb427284c48f80625ec3bc', 'request_id': 'req-3bc66a52-2447-4229-a9eb-b050e1a9a1ff'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:40.417967 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-3bc66a52-2447-4229-a9eb-b050e1a9a1ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9385df4bcafb427284c48f80625ec3bc', 'request_id': 'req-3bc66a52-2447-4229-a9eb-b050e1a9a1ff'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:40.420397 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e728dc-d4b2-4122-89a0-1be9e7a4801e tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:40.430453 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-3bc66a52-2447-4229-a9eb-b050e1a9a1ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9385df4bcafb427284c48f80625ec3bc', 'request_id': 'req-3bc66a52-2447-4229-a9eb-b050e1a9a1ff'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:40.450654 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-3bc66a52-2447-4229-a9eb-b050e1a9a1ff admin admin] The token cache is being invalidate because project 9385df4bcafb427284c48f80625ec3bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:28:40.450853 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-3bc66a52-2447-4229-a9eb-b050e1a9a1ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:40.453407 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-3bc66a52-2447-4229-a9eb-b050e1a9a1ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:40.456215 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2259/4516] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:28:39 2022] DELETE /identity/v3/projects/9385df4bcafb427284c48f80625ec3bc => generated 0 bytes in 587 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:28:40.457250 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc66a52-2447-4229-a9eb-b050e1a9a1ff admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:40.460053 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-3bc66a52-2447-4229-a9eb-b050e1a9a1ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:40.501661 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:28:40.561765 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33e42f2-9aed-4145-940e-3e0724aab09a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:40.562843 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33e42f2-9aed-4145-940e-3e0724aab09a service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:40.563222 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33e42f2-9aed-4145-940e-3e0724aab09a service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:40.563593 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33e42f2-9aed-4145-940e-3e0724aab09a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:40.571152 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-d33e42f2-9aed-4145-940e-3e0724aab09a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:40.586903 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33e42f2-9aed-4145-940e-3e0724aab09a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:40.589325 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33e42f2-9aed-4145-940e-3e0724aab09a service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:40.594404 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc66a52-2447-4229-a9eb-b050e1a9a1ff admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:40.601620 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2258/4517] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:28:40 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:28:40.601841 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b62cf0-cc34-47d0-8569-237699dbba9d tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba8d06e121db4caf92ce215e16fc3324', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ccaff652d244cab7e5e736532f5c02', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:40.603486 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b62cf0-cc34-47d0-8569-237699dbba9d tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:40.603818 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b62cf0-cc34-47d0-8569-237699dbba9d tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:40.604268 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b62cf0-cc34-47d0-8569-237699dbba9d tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:40.605086 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b62cf0-cc34-47d0-8569-237699dbba9d tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:40.605819 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc5fcfd-3c0b-4d1e-a81a-e49e59fbe6f8 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:40.606644 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc5fcfd-3c0b-4d1e-a81a-e49e59fbe6f8 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:40.606957 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b62cf0-cc34-47d0-8569-237699dbba9d tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:40.608451 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc5fcfd-3c0b-4d1e-a81a-e49e59fbe6f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:40.628267 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2260/4518] 10.222.0.17 () {60 vars in 1142 bytes} [Sat Jul 23 21:28:40 2022] POST /identity/v3/roles => generated 240 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:28:40.632396 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b62cf0-cc34-47d0-8569-237699dbba9d tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:40.653592 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b62cf0-cc34-47d0-8569-237699dbba9d tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:40.660812 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c53ae0e-ed30-44fc-a23d-9aa02d4e85e5 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba8d06e121db4caf92ce215e16fc3324', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ccaff652d244cab7e5e736532f5c02', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:40.661829 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c53ae0e-ed30-44fc-a23d-9aa02d4e85e5 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:40.667300 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c53ae0e-ed30-44fc-a23d-9aa02d4e85e5 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:40.668101 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c53ae0e-ed30-44fc-a23d-9aa02d4e85e5 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] PATH_INFO: `/v3/domains/3aad61227e7a4c7193474598e4bcca39/users/01d27c973c614c72be15f495dc0a77eb/roles/e3760d8776e04a2d94dbd3648dddbee8` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:40.675095 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-3dc5fcfd-3c0b-4d1e-a81a-e49e59fbe6f8 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:28:40.676390 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-3dc5fcfd-3c0b-4d1e-a81a-e49e59fbe6f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:40.693101 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:28:40.715723 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c53ae0e-ed30-44fc-a23d-9aa02d4e85e5 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=3aad61227e7a4c7193474598e4bcca39, user_id=01d27c973c614c72be15f495dc0a77eb, role_id=e3760d8776e04a2d94dbd3648dddbee8)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:40.719300 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c53ae0e-ed30-44fc-a23d-9aa02d4e85e5 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:40.750550 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2261/4519] 10.222.0.17 () {60 vars in 1479 bytes} [Sat Jul 23 21:28:40 2022] PUT /identity/v3/domains/3aad61227e7a4c7193474598e4bcca39/users/01d27c973c614c72be15f495dc0a77eb/roles/e3760d8776e04a2d94dbd3648dddbee8 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:28:40.752458 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c53ae0e-ed30-44fc-a23d-9aa02d4e85e5 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:40.810063 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2259/4520] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:28:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:28:40.815470 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef85888-3ab4-4515-a265-94bb532e346f None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:40.816218 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef85888-3ab4-4515-a265-94bb532e346f None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:40.818930 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef85888-3ab4-4515-a265-94bb532e346f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:40.862709 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-1ef85888-3ab4-4515-a265-94bb532e346f None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:28:40.864100 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-1ef85888-3ab4-4515-a265-94bb532e346f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:40.913206 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c53ae0e-ed30-44fc-a23d-9aa02d4e85e5 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:40.918962 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3b4a34-b145-470b-ab6a-b05777e201c4 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba8d06e121db4caf92ce215e16fc3324', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ccaff652d244cab7e5e736532f5c02', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:40.919823 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3b4a34-b145-470b-ab6a-b05777e201c4 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:40.920205 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3b4a34-b145-470b-ab6a-b05777e201c4 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:40.921492 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3b4a34-b145-470b-ab6a-b05777e201c4 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:40.923667 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3b4a34-b145-470b-ab6a-b05777e201c4 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:40.925387 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3b4a34-b145-470b-ab6a-b05777e201c4 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:40.945920 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2262/4521] 10.222.0.17 () {60 vars in 1148 bytes} [Sat Jul 23 21:28:40 2022] POST /identity/v3/domains => generated 276 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:28:40.950026 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3b4a34-b145-470b-ab6a-b05777e201c4 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:40.985022 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2260/4522] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:28:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:28:40.990389 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef85888-3ab4-4515-a265-94bb532e346f None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:41.008717 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef85888-3ab4-4515-a265-94bb532e346f None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:41.082187 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3b4a34-b145-470b-ab6a-b05777e201c4 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:41.096703 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84baaf3-39ab-49a7-8349-f2613b5476eb tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba8d06e121db4caf92ce215e16fc3324', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ccaff652d244cab7e5e736532f5c02', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:41.097504 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84baaf3-39ab-49a7-8349-f2613b5476eb tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:41.097977 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84baaf3-39ab-49a7-8349-f2613b5476eb tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:41.098301 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84baaf3-39ab-49a7-8349-f2613b5476eb tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:41.099132 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84baaf3-39ab-49a7-8349-f2613b5476eb tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:41.100826 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84baaf3-39ab-49a7-8349-f2613b5476eb tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:41.110182 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8217807e-3e7e-4c47-b8f4-b1bdbb4b6295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:41.110902 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8217807e-3e7e-4c47-b8f4-b1bdbb4b6295 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:41.111252 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8217807e-3e7e-4c47-b8f4-b1bdbb4b6295 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:41.112247 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8217807e-3e7e-4c47-b8f4-b1bdbb4b6295 admin admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:41.113362 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8217807e-3e7e-4c47-b8f4-b1bdbb4b6295 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:28:41.113680 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8217807e-3e7e-4c47-b8f4-b1bdbb4b6295 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:41.115576 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8217807e-3e7e-4c47-b8f4-b1bdbb4b6295 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:41.131996 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2261/4523] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:28:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:28:41.136664 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2263/4524] 10.222.0.17 () {60 vars in 1142 bytes} [Sat Jul 23 21:28:40 2022] POST /identity/v3/roles => generated 239 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:28:41.140565 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84baaf3-39ab-49a7-8349-f2613b5476eb tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:41.140762 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8217807e-3e7e-4c47-b8f4-b1bdbb4b6295 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:41.152477 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84baaf3-39ab-49a7-8349-f2613b5476eb tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:41.155034 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8217807e-3e7e-4c47-b8f4-b1bdbb4b6295 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:41.160492 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90639d86-3f46-414b-8e28-6f6160e8e3e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:41.161177 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90639d86-3f46-414b-8e28-6f6160e8e3e6 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:41.161485 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90639d86-3f46-414b-8e28-6f6160e8e3e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:41.162096 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90639d86-3f46-414b-8e28-6f6160e8e3e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:41.162444 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90639d86-3f46-414b-8e28-6f6160e8e3e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:41.163747 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108113bd-fd3f-4b80-b20d-eb0694fe427d tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba8d06e121db4caf92ce215e16fc3324', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ccaff652d244cab7e5e736532f5c02', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:41.164684 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90639d86-3f46-414b-8e28-6f6160e8e3e6 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:41.164828 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108113bd-fd3f-4b80-b20d-eb0694fe427d tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:41.165363 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108113bd-fd3f-4b80-b20d-eb0694fe427d tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:41.165839 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108113bd-fd3f-4b80-b20d-eb0694fe427d tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] PATH_INFO: `/v3/groups` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:41.166782 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108113bd-fd3f-4b80-b20d-eb0694fe427d tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:41.169043 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108113bd-fd3f-4b80-b20d-eb0694fe427d tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:41.189555 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:28:41.212832 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2264/4525] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:28:41 2022] POST /identity/v3/groups => generated 326 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:28:41.216856 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108113bd-fd3f-4b80-b20d-eb0694fe427d tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:41.232940 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108113bd-fd3f-4b80-b20d-eb0694fe427d tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:41.240515 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2262/4526] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:28:41 2022] POST /identity/v3/projects => generated 375 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:28:41.243725 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f64702-8397-4834-9e11-e1367eb6a245 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba8d06e121db4caf92ce215e16fc3324', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ccaff652d244cab7e5e736532f5c02', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:41.244674 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f64702-8397-4834-9e11-e1367eb6a245 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:41.244953 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90639d86-3f46-414b-8e28-6f6160e8e3e6 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:41.245076 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f64702-8397-4834-9e11-e1367eb6a245 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:41.245246 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f64702-8397-4834-9e11-e1367eb6a245 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] PATH_INFO: `/v3/groups/4ff4850cf8d045f19bea47de68e02729/users/01d27c973c614c72be15f495dc0a77eb` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:41.253246 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f64702-8397-4834-9e11-e1367eb6a245 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=4ff4850cf8d045f19bea47de68e02729, user_id=01d27c973c614c72be15f495dc0a77eb)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:41.255225 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f64702-8397-4834-9e11-e1367eb6a245 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:41.299908 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2265/4527] 10.222.0.17 () {60 vars in 1359 bytes} [Sat Jul 23 21:28:41 2022] PUT /identity/v3/groups/4ff4850cf8d045f19bea47de68e02729/users/01d27c973c614c72be15f495dc0a77eb => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:28:41.304599 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f64702-8397-4834-9e11-e1367eb6a245 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:41.308960 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:28:41.367239 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90639d86-3f46-414b-8e28-6f6160e8e3e6 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:41.407756 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f64702-8397-4834-9e11-e1367eb6a245 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:41.415474 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa969729-d563-453b-ae24-a6138a42530e tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba8d06e121db4caf92ce215e16fc3324', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ccaff652d244cab7e5e736532f5c02', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:41.416517 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa969729-d563-453b-ae24-a6138a42530e tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:41.416969 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa969729-d563-453b-ae24-a6138a42530e tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:41.417347 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa969729-d563-453b-ae24-a6138a42530e tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] PATH_INFO: `/v3/domains/56e67222f4c144bcac51ba824b804a60/groups/4ff4850cf8d045f19bea47de68e02729/roles/445b58dfc6534614ac4b95b032ab05e3` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:41.420421 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa969729-d563-453b-ae24-a6138a42530e tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=56e67222f4c144bcac51ba824b804a60, group_id=4ff4850cf8d045f19bea47de68e02729, role_id=445b58dfc6534614ac4b95b032ab05e3)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:41.425899 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa969729-d563-453b-ae24-a6138a42530e tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:41.448101 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2266/4528] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:28:41 2022] PUT /identity/v3/domains/56e67222f4c144bcac51ba824b804a60/groups/4ff4850cf8d045f19bea47de68e02729/roles/445b58dfc6534614ac4b95b032ab05e3 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:28:41.453082 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa969729-d563-453b-ae24-a6138a42530e tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:41.458245 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-fa969729-d563-453b-ae24-a6138a42530e tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:41.459355 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b6e1f9-ee96-46d9-bb2f-9120f0ba5d07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:41.460223 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b6e1f9-ee96-46d9-bb2f-9120f0ba5d07 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:41.460499 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b6e1f9-ee96-46d9-bb2f-9120f0ba5d07 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:41.460774 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b6e1f9-ee96-46d9-bb2f-9120f0ba5d07 admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:41.461575 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b6e1f9-ee96-46d9-bb2f-9120f0ba5d07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:41.463887 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b6e1f9-ee96-46d9-bb2f-9120f0ba5d07 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:41.498668 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2263/4529] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:28:41 2022] POST /identity/v3/users => generated 288 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:28:41.502750 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b6e1f9-ee96-46d9-bb2f-9120f0ba5d07 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:41.532669 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b6e1f9-ee96-46d9-bb2f-9120f0ba5d07 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:41.594653 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa969729-d563-453b-ae24-a6138a42530e tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:41.599723 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a810e7f-3716-4a75-a110-a309f99bc100 tempest-TokensV3TestJSON-1529499237 tempest-TokensV3TestJSON-1529499237-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01d27c973c614c72be15f495dc0a77eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fa2fd3c28f449a8aba03173395139ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:41.601195 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a810e7f-3716-4a75-a110-a309f99bc100 tempest-TokensV3TestJSON-1529499237 tempest-TokensV3TestJSON-1529499237-project] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:41.601731 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a810e7f-3716-4a75-a110-a309f99bc100 tempest-TokensV3TestJSON-1529499237 tempest-TokensV3TestJSON-1529499237-project] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:41.603302 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a810e7f-3716-4a75-a110-a309f99bc100 tempest-TokensV3TestJSON-1529499237 tempest-TokensV3TestJSON-1529499237-project] PATH_INFO: `/v3/auth/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:41.604059 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a810e7f-3716-4a75-a110-a309f99bc100 tempest-TokensV3TestJSON-1529499237 tempest-TokensV3TestJSON-1529499237-project] RBAC: Authorizing `identity:get_auth_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:41.606059 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a810e7f-3716-4a75-a110-a309f99bc100 tempest-TokensV3TestJSON-1529499237 tempest-TokensV3TestJSON-1529499237-project] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:41.639723 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23083811-9b20-4302-a15c-111787e5de57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:41.640546 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23083811-9b20-4302-a15c-111787e5de57 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:41.641082 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23083811-9b20-4302-a15c-111787e5de57 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:41.641357 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23083811-9b20-4302-a15c-111787e5de57 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:41.642607 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23083811-9b20-4302-a15c-111787e5de57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:41.644702 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23083811-9b20-4302-a15c-111787e5de57 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:41.662424 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2264/4530] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:28:41 2022] GET /identity/v3/roles => generated 2341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 21:28:41.663215 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23083811-9b20-4302-a15c-111787e5de57 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:41.675835 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23083811-9b20-4302-a15c-111787e5de57 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:41.677300 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:28:41.685716 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cfeb71-c3b5-4852-835b-e00a1bd24a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:41.687261 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cfeb71-c3b5-4852-835b-e00a1bd24a1e admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:41.687545 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cfeb71-c3b5-4852-835b-e00a1bd24a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:41.688231 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cfeb71-c3b5-4852-835b-e00a1bd24a1e admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:41.691484 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cfeb71-c3b5-4852-835b-e00a1bd24a1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:41.695826 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cfeb71-c3b5-4852-835b-e00a1bd24a1e admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:41.714581 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2267/4531] 10.222.0.17 () {58 vars in 1142 bytes} [Sat Jul 23 21:28:41 2022] GET /identity/v3/auth/domains => generated 1171 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:28:41.714951 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2265/4532] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:28:41 2022] GET /identity/v3/roles => generated 2341 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:28:41.719231 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a810e7f-3716-4a75-a110-a309f99bc100 tempest-TokensV3TestJSON-1529499237 tempest-TokensV3TestJSON-1529499237-project] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:41.719444 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cfeb71-c3b5-4852-835b-e00a1bd24a1e admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:41.734881 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cfeb71-c3b5-4852-835b-e00a1bd24a1e admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:41.741416 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed496c6-2105-40b3-aee3-4f7907b55ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:41.742433 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed496c6-2105-40b3-aee3-4f7907b55ed3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:41.742768 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed496c6-2105-40b3-aee3-4f7907b55ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:41.743136 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed496c6-2105-40b3-aee3-4f7907b55ed3 admin admin] PATH_INFO: `/v3/projects/bfc71a2fb00248ddbb06060c943fed5c/users/0400e6ceebf44a04ab61bb854778a345/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:41.761309 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed496c6-2105-40b3-aee3-4f7907b55ed3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfc71a2fb00248ddbb06060c943fed5c, user_id=0400e6ceebf44a04ab61bb854778a345, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:41.764625 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed496c6-2105-40b3-aee3-4f7907b55ed3 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:41.786231 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2266/4533] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:28:41 2022] PUT /identity/v3/projects/bfc71a2fb00248ddbb06060c943fed5c/users/0400e6ceebf44a04ab61bb854778a345/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:28:41.797897 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c734378a-f729-4a13-8e77-ceca0e3831e0 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:41.797897 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c734378a-f729-4a13-8e77-ceca0e3831e0 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:41.798235 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c734378a-f729-4a13-8e77-ceca0e3831e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:41.835573 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a810e7f-3716-4a75-a110-a309f99bc100 tempest-TokensV3TestJSON-1529499237 tempest-TokensV3TestJSON-1529499237-project] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:41.886582 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-c734378a-f729-4a13-8e77-ceca0e3831e0 None None] MFA Rules not processed for user `0400e6ceebf44a04ab61bb854778a345`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:28:41.888763 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-c734378a-f729-4a13-8e77-ceca0e3831e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:41.908845 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde286ff-8731-4324-b8b0-614ff2d26490 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba8d06e121db4caf92ce215e16fc3324', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ccaff652d244cab7e5e736532f5c02', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:41.909778 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde286ff-8731-4324-b8b0-614ff2d26490 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:41.910094 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde286ff-8731-4324-b8b0-614ff2d26490 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:41.910374 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde286ff-8731-4324-b8b0-614ff2d26490 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] PATH_INFO: `/v3/domains/56e67222f4c144bcac51ba824b804a60/groups/4ff4850cf8d045f19bea47de68e02729/roles/445b58dfc6534614ac4b95b032ab05e3` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:41.912729 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde286ff-8731-4324-b8b0-614ff2d26490 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=56e67222f4c144bcac51ba824b804a60, group_id=4ff4850cf8d045f19bea47de68e02729, role_id=445b58dfc6534614ac4b95b032ab05e3)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:41.915711 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde286ff-8731-4324-b8b0-614ff2d26490 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:41.923114 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:28:41.924905 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-fde286ff-8731-4324-b8b0-614ff2d26490 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Invalidating the token cache because role 445b58dfc6534614ac4b95b032ab05e3 was removed from group 4ff4850cf8d045f19bea47de68e02729 on domain 56e67222f4c144bcac51ba824b804a60. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:28:41.925339 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-fde286ff-8731-4324-b8b0-614ff2d26490 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:41.926325 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-fde286ff-8731-4324-b8b0-614ff2d26490 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:41.954157 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2268/4534] 10.222.0.17 () {58 vars in 1466 bytes} [Sat Jul 23 21:28:41 2022] DELETE /identity/v3/domains/56e67222f4c144bcac51ba824b804a60/groups/4ff4850cf8d045f19bea47de68e02729/roles/445b58dfc6534614ac4b95b032ab05e3 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:28:41.959438 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde286ff-8731-4324-b8b0-614ff2d26490 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:41.961329 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-fde286ff-8731-4324-b8b0-614ff2d26490 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:42.004122 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2267/4535] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:28:41 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:28:42.021055 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c734378a-f729-4a13-8e77-ceca0e3831e0 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:42.023043 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-c734378a-f729-4a13-8e77-ceca0e3831e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:42.039762 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde286ff-8731-4324-b8b0-614ff2d26490 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:42.045409 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d0ff99-89b3-40e7-bce4-8de3e7c9206f tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba8d06e121db4caf92ce215e16fc3324', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ccaff652d244cab7e5e736532f5c02', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:42.046212 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d0ff99-89b3-40e7-bce4-8de3e7c9206f tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:42.046560 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d0ff99-89b3-40e7-bce4-8de3e7c9206f tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:42.046898 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d0ff99-89b3-40e7-bce4-8de3e7c9206f tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] PATH_INFO: `/v3/groups/4ff4850cf8d045f19bea47de68e02729/users/01d27c973c614c72be15f495dc0a77eb` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:42.048762 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d0ff99-89b3-40e7-bce4-8de3e7c9206f tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=4ff4850cf8d045f19bea47de68e02729, user_id=01d27c973c614c72be15f495dc0a77eb)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:42.051003 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d0ff99-89b3-40e7-bce4-8de3e7c9206f tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:42.061048 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-e0d0ff99-89b3-40e7-bce4-8de3e7c9206f tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '01d27c973c614c72be15f495dc0a77eb'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:42.076056 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:28:42.083874 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2269/4536] 10.222.0.17 () {58 vars in 1343 bytes} [Sat Jul 23 21:28:41 2022] DELETE /identity/v3/groups/4ff4850cf8d045f19bea47de68e02729/users/01d27c973c614c72be15f495dc0a77eb => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:28:42.088898 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d0ff99-89b3-40e7-bce4-8de3e7c9206f tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:42.112293 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c734378a-f729-4a13-8e77-ceca0e3831e0 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:42.165286 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d0ff99-89b3-40e7-bce4-8de3e7c9206f tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:42.170386 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9f9e8a-4fba-478c-ba29-56830372db9e tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba8d06e121db4caf92ce215e16fc3324', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ccaff652d244cab7e5e736532f5c02', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:42.171451 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9f9e8a-4fba-478c-ba29-56830372db9e tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:42.171630 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9f9e8a-4fba-478c-ba29-56830372db9e tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:42.172017 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9f9e8a-4fba-478c-ba29-56830372db9e tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] PATH_INFO: `/v3/groups/4ff4850cf8d045f19bea47de68e02729` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:42.173494 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9f9e8a-4fba-478c-ba29-56830372db9e tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] RBAC: Authorizing `identity:delete_group(group_id=4ff4850cf8d045f19bea47de68e02729)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:42.175296 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1730281c-2dae-467f-b481-e5c5b35c48ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:42.175469 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9f9e8a-4fba-478c-ba29-56830372db9e tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:42.175952 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1730281c-2dae-467f-b481-e5c5b35c48ac service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:42.176230 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1730281c-2dae-467f-b481-e5c5b35c48ac service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:42.176499 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1730281c-2dae-467f-b481-e5c5b35c48ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:42.224842 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2270/4537] 10.222.0.17 () {58 vars in 1226 bytes} [Sat Jul 23 21:28:42 2022] DELETE /identity/v3/groups/4ff4850cf8d045f19bea47de68e02729 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:28:42.229062 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9f9e8a-4fba-478c-ba29-56830372db9e tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:42.249797 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1730281c-2dae-467f-b481-e5c5b35c48ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:42.251611 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1730281c-2dae-467f-b481-e5c5b35c48ac service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:42.262945 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2268/4538] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:28:42 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:28:42.303842 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9f9e8a-4fba-478c-ba29-56830372db9e tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:42.308842 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d5720b-0743-4b1b-91dd-e7e583e5f62b tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba8d06e121db4caf92ce215e16fc3324', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ccaff652d244cab7e5e736532f5c02', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:42.309822 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d5720b-0743-4b1b-91dd-e7e583e5f62b tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:42.310049 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d5720b-0743-4b1b-91dd-e7e583e5f62b tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:42.310469 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d5720b-0743-4b1b-91dd-e7e583e5f62b tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] PATH_INFO: `/v3/roles/445b58dfc6534614ac4b95b032ab05e3` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:42.311977 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d5720b-0743-4b1b-91dd-e7e583e5f62b tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] RBAC: Authorizing `identity:delete_role(role_id=445b58dfc6534614ac4b95b032ab05e3)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:42.313589 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d5720b-0743-4b1b-91dd-e7e583e5f62b tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:42.362011 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-78d5720b-0743-4b1b-91dd-e7e583e5f62b tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Invalidating the token cache because role 445b58dfc6534614ac4b95b032ab05e3 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:28:42.362346 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-78d5720b-0743-4b1b-91dd-e7e583e5f62b tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:42.363066 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-78d5720b-0743-4b1b-91dd-e7e583e5f62b tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:42.365750 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2271/4539] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:28:42 2022] DELETE /identity/v3/roles/445b58dfc6534614ac4b95b032ab05e3 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:28:42.370204 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1730281c-2dae-467f-b481-e5c5b35c48ac service neutron] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:42.383485 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1730281c-2dae-467f-b481-e5c5b35c48ac service neutron] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:42.447454 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:28:42.497969 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72313048-e6ec-4788-b4f0-6ec9054613f5 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba8d06e121db4caf92ce215e16fc3324', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ccaff652d244cab7e5e736532f5c02', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:42.503673 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72313048-e6ec-4788-b4f0-6ec9054613f5 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:42.504436 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72313048-e6ec-4788-b4f0-6ec9054613f5 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:42.505419 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72313048-e6ec-4788-b4f0-6ec9054613f5 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] PATH_INFO: `/v3/domains/56e67222f4c144bcac51ba824b804a60` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:42.507668 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72313048-e6ec-4788-b4f0-6ec9054613f5 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=56e67222f4c144bcac51ba824b804a60)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:42.509475 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72313048-e6ec-4788-b4f0-6ec9054613f5 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:42.579591 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-72313048-e6ec-4788-b4f0-6ec9054613f5 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '56e67222f4c144bcac51ba824b804a60'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:42.580389 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-72313048-e6ec-4788-b4f0-6ec9054613f5 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '56e67222f4c144bcac51ba824b804a60'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:42.618151 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-72313048-e6ec-4788-b4f0-6ec9054613f5 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '56e67222f4c144bcac51ba824b804a60'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:42.619160 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-72313048-e6ec-4788-b4f0-6ec9054613f5 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '56e67222f4c144bcac51ba824b804a60'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:42.626923 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d5720b-0743-4b1b-91dd-e7e583e5f62b tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:42.628525 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-78d5720b-0743-4b1b-91dd-e7e583e5f62b tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:42.631497 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2269/4540] 10.222.0.17 () {60 vars in 1248 bytes} [Sat Jul 23 21:28:42 2022] PATCH /identity/v3/domains/56e67222f4c144bcac51ba824b804a60 => generated 277 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:28:42.645144 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d5720b-0743-4b1b-91dd-e7e583e5f62b tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:42.683389 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:28:42.744362 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f0ede5-c5f0-45a5-90a9-f34ccd83ae17 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba8d06e121db4caf92ce215e16fc3324', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ccaff652d244cab7e5e736532f5c02', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:42.745277 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f0ede5-c5f0-45a5-90a9-f34ccd83ae17 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:42.745556 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f0ede5-c5f0-45a5-90a9-f34ccd83ae17 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:42.745827 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f0ede5-c5f0-45a5-90a9-f34ccd83ae17 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] PATH_INFO: `/v3/domains/56e67222f4c144bcac51ba824b804a60` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:42.769521 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f0ede5-c5f0-45a5-90a9-f34ccd83ae17 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=56e67222f4c144bcac51ba824b804a60)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:42.771436 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f0ede5-c5f0-45a5-90a9-f34ccd83ae17 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:42.830069 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-c3f0ede5-c5f0-45a5-90a9-f34ccd83ae17 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '56e67222f4c144bcac51ba824b804a60'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:42.847873 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-c3f0ede5-c5f0-45a5-90a9-f34ccd83ae17 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '56e67222f4c144bcac51ba824b804a60'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:42.937943 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-c3f0ede5-c5f0-45a5-90a9-f34ccd83ae17 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56e67222f4c144bcac51ba824b804a60', 'request_id': 'req-c3f0ede5-c5f0-45a5-90a9-f34ccd83ae17'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:42.957732 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-c3f0ede5-c5f0-45a5-90a9-f34ccd83ae17 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56e67222f4c144bcac51ba824b804a60', 'request_id': 'req-c3f0ede5-c5f0-45a5-90a9-f34ccd83ae17'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:42.968870 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-c3f0ede5-c5f0-45a5-90a9-f34ccd83ae17 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56e67222f4c144bcac51ba824b804a60', 'request_id': 'req-c3f0ede5-c5f0-45a5-90a9-f34ccd83ae17'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:42.998121 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-c3f0ede5-c5f0-45a5-90a9-f34ccd83ae17 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] The token cache is being invalidate because project 56e67222f4c144bcac51ba824b804a60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:28:42.998408 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-c3f0ede5-c5f0-45a5-90a9-f34ccd83ae17 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:43.000924 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-c3f0ede5-c5f0-45a5-90a9-f34ccd83ae17 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:43.014376 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-c3f0ede5-c5f0-45a5-90a9-f34ccd83ae17 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '56e67222f4c144bcac51ba824b804a60', 'request_id': 'req-c3f0ede5-c5f0-45a5-90a9-f34ccd83ae17'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:43.015805 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-c3f0ede5-c5f0-45a5-90a9-f34ccd83ae17 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '56e67222f4c144bcac51ba824b804a60', 'request_id': 'req-c3f0ede5-c5f0-45a5-90a9-f34ccd83ae17'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:43.022281 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-c3f0ede5-c5f0-45a5-90a9-f34ccd83ae17 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '56e67222f4c144bcac51ba824b804a60', 'request_id': 'req-c3f0ede5-c5f0-45a5-90a9-f34ccd83ae17'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:43.039823 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2272/4541] 10.222.0.17 () {58 vars in 1229 bytes} [Sat Jul 23 21:28:42 2022] DELETE /identity/v3/domains/56e67222f4c144bcac51ba824b804a60 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:28:43.043073 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72313048-e6ec-4788-b4f0-6ec9054613f5 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:43.044659 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-72313048-e6ec-4788-b4f0-6ec9054613f5 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:43.058911 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72313048-e6ec-4788-b4f0-6ec9054613f5 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:43.197199 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82fc25f-cae2-4291-9848-6a0da04dddaa tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba8d06e121db4caf92ce215e16fc3324', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ccaff652d244cab7e5e736532f5c02', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:43.198426 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82fc25f-cae2-4291-9848-6a0da04dddaa tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:43.198835 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82fc25f-cae2-4291-9848-6a0da04dddaa tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:43.199211 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82fc25f-cae2-4291-9848-6a0da04dddaa tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] PATH_INFO: `/v3/domains/3aad61227e7a4c7193474598e4bcca39/users/01d27c973c614c72be15f495dc0a77eb/roles/e3760d8776e04a2d94dbd3648dddbee8` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:43.203362 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82fc25f-cae2-4291-9848-6a0da04dddaa tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=3aad61227e7a4c7193474598e4bcca39, user_id=01d27c973c614c72be15f495dc0a77eb, role_id=e3760d8776e04a2d94dbd3648dddbee8)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:43.208771 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82fc25f-cae2-4291-9848-6a0da04dddaa tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:43.217680 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-b82fc25f-cae2-4291-9848-6a0da04dddaa tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Invalidating the token cache because role e3760d8776e04a2d94dbd3648dddbee8 was removed from user 01d27c973c614c72be15f495dc0a77eb on domain 3aad61227e7a4c7193474598e4bcca39. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:28:43.218123 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-b82fc25f-cae2-4291-9848-6a0da04dddaa tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:43.218973 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-b82fc25f-cae2-4291-9848-6a0da04dddaa tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:43.247732 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2270/4542] 10.222.0.17 () {58 vars in 1463 bytes} [Sat Jul 23 21:28:43 2022] DELETE /identity/v3/domains/3aad61227e7a4c7193474598e4bcca39/users/01d27c973c614c72be15f495dc0a77eb/roles/e3760d8776e04a2d94dbd3648dddbee8 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:28:43.249328 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f0ede5-c5f0-45a5-90a9-f34ccd83ae17 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:43.257257 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-c3f0ede5-c5f0-45a5-90a9-f34ccd83ae17 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:43.285518 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f0ede5-c5f0-45a5-90a9-f34ccd83ae17 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:43.371924 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe5cec6-0d21-4a98-a5cf-f71fa2b321b9 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba8d06e121db4caf92ce215e16fc3324', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ccaff652d244cab7e5e736532f5c02', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:43.373391 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe5cec6-0d21-4a98-a5cf-f71fa2b321b9 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:43.373818 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe5cec6-0d21-4a98-a5cf-f71fa2b321b9 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:43.374224 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe5cec6-0d21-4a98-a5cf-f71fa2b321b9 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] PATH_INFO: `/v3/roles/e3760d8776e04a2d94dbd3648dddbee8` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:43.376591 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe5cec6-0d21-4a98-a5cf-f71fa2b321b9 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] RBAC: Authorizing `identity:delete_role(role_id=e3760d8776e04a2d94dbd3648dddbee8)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:43.378704 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe5cec6-0d21-4a98-a5cf-f71fa2b321b9 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:43.382522 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:28:43.476072 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-0fe5cec6-0d21-4a98-a5cf-f71fa2b321b9 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Invalidating the token cache because role e3760d8776e04a2d94dbd3648dddbee8 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:28:43.476268 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-0fe5cec6-0d21-4a98-a5cf-f71fa2b321b9 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:43.478104 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-0fe5cec6-0d21-4a98-a5cf-f71fa2b321b9 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:43.485754 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2273/4543] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:28:43 2022] DELETE /identity/v3/roles/e3760d8776e04a2d94dbd3648dddbee8 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:28:43.490243 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82fc25f-cae2-4291-9848-6a0da04dddaa tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:43.491795 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-b82fc25f-cae2-4291-9848-6a0da04dddaa tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:43.519773 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82fc25f-cae2-4291-9848-6a0da04dddaa tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:43.654876 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0426fde-5cef-47bf-a70a-7cc81b662a41 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba8d06e121db4caf92ce215e16fc3324', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ccaff652d244cab7e5e736532f5c02', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:43.656144 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0426fde-5cef-47bf-a70a-7cc81b662a41 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:43.656468 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0426fde-5cef-47bf-a70a-7cc81b662a41 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:43.656839 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0426fde-5cef-47bf-a70a-7cc81b662a41 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] PATH_INFO: `/v3/domains/3aad61227e7a4c7193474598e4bcca39` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:43.659026 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0426fde-5cef-47bf-a70a-7cc81b662a41 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=3aad61227e7a4c7193474598e4bcca39)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:43.660955 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0426fde-5cef-47bf-a70a-7cc81b662a41 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:43.688741 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-d0426fde-5cef-47bf-a70a-7cc81b662a41 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '3aad61227e7a4c7193474598e4bcca39'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:43.691045 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-d0426fde-5cef-47bf-a70a-7cc81b662a41 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '3aad61227e7a4c7193474598e4bcca39'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:43.700004 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=98,keystone:UPDATE=1,keystone:DELETE=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:28:43.744248 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-d0426fde-5cef-47bf-a70a-7cc81b662a41 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '3aad61227e7a4c7193474598e4bcca39'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:43.746096 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-d0426fde-5cef-47bf-a70a-7cc81b662a41 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '3aad61227e7a4c7193474598e4bcca39'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:43.754954 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2271/4544] 10.222.0.17 () {60 vars in 1248 bytes} [Sat Jul 23 21:28:43 2022] PATCH /identity/v3/domains/3aad61227e7a4c7193474598e4bcca39 => generated 276 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 21:28:43.756858 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe5cec6-0d21-4a98-a5cf-f71fa2b321b9 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:43.758685 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-0fe5cec6-0d21-4a98-a5cf-f71fa2b321b9 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:43.783860 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe5cec6-0d21-4a98-a5cf-f71fa2b321b9 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:43.943503 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f8d3af-1191-4a2b-8ff3-bee33ff271d1 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba8d06e121db4caf92ce215e16fc3324', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ccaff652d244cab7e5e736532f5c02', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:43.945650 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f8d3af-1191-4a2b-8ff3-bee33ff271d1 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:43.946150 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f8d3af-1191-4a2b-8ff3-bee33ff271d1 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:43.946648 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f8d3af-1191-4a2b-8ff3-bee33ff271d1 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] PATH_INFO: `/v3/domains/3aad61227e7a4c7193474598e4bcca39` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:43.962970 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f8d3af-1191-4a2b-8ff3-bee33ff271d1 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=3aad61227e7a4c7193474598e4bcca39)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:43.966380 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f8d3af-1191-4a2b-8ff3-bee33ff271d1 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:44.008401 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-e7f8d3af-1191-4a2b-8ff3-bee33ff271d1 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '3aad61227e7a4c7193474598e4bcca39'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:44.028908 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-e7f8d3af-1191-4a2b-8ff3-bee33ff271d1 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '3aad61227e7a4c7193474598e4bcca39'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:44.118901 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-e7f8d3af-1191-4a2b-8ff3-bee33ff271d1 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3aad61227e7a4c7193474598e4bcca39', 'request_id': 'req-e7f8d3af-1191-4a2b-8ff3-bee33ff271d1'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:44.174169 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-e7f8d3af-1191-4a2b-8ff3-bee33ff271d1 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3aad61227e7a4c7193474598e4bcca39', 'request_id': 'req-e7f8d3af-1191-4a2b-8ff3-bee33ff271d1'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:44.199864 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-e7f8d3af-1191-4a2b-8ff3-bee33ff271d1 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3aad61227e7a4c7193474598e4bcca39', 'request_id': 'req-e7f8d3af-1191-4a2b-8ff3-bee33ff271d1'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:44.215798 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-e7f8d3af-1191-4a2b-8ff3-bee33ff271d1 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] The token cache is being invalidate because project 3aad61227e7a4c7193474598e4bcca39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:28:44.216142 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-e7f8d3af-1191-4a2b-8ff3-bee33ff271d1 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:44.216748 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-e7f8d3af-1191-4a2b-8ff3-bee33ff271d1 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:44.225469 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-e7f8d3af-1191-4a2b-8ff3-bee33ff271d1 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '3aad61227e7a4c7193474598e4bcca39', 'request_id': 'req-e7f8d3af-1191-4a2b-8ff3-bee33ff271d1'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:44.226187 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-e7f8d3af-1191-4a2b-8ff3-bee33ff271d1 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '3aad61227e7a4c7193474598e4bcca39', 'request_id': 'req-e7f8d3af-1191-4a2b-8ff3-bee33ff271d1'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:44.229987 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-e7f8d3af-1191-4a2b-8ff3-bee33ff271d1 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '3aad61227e7a4c7193474598e4bcca39', 'request_id': 'req-e7f8d3af-1191-4a2b-8ff3-bee33ff271d1'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:44.237875 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2274/4545] 10.222.0.17 () {58 vars in 1229 bytes} [Sat Jul 23 21:28:43 2022] DELETE /identity/v3/domains/3aad61227e7a4c7193474598e4bcca39 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:28:44.241722 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0426fde-5cef-47bf-a70a-7cc81b662a41 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:44.252221 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-d0426fde-5cef-47bf-a70a-7cc81b662a41 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:44.282926 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0426fde-5cef-47bf-a70a-7cc81b662a41 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:44.373673 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efd66f5-af81-4983-a777-7568e421efb4 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba8d06e121db4caf92ce215e16fc3324', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ccaff652d244cab7e5e736532f5c02', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:44.374898 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efd66f5-af81-4983-a777-7568e421efb4 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:44.375298 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efd66f5-af81-4983-a777-7568e421efb4 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:44.376345 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efd66f5-af81-4983-a777-7568e421efb4 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] PATH_INFO: `/v3/domains/a01c840a8f2a480c8e042aca1ef22f52/groups/108a6ae64cd14977a2562b32b37dd93d/roles/b236346d672242b4ac5377c269c1f0b4` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:44.378828 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efd66f5-af81-4983-a777-7568e421efb4 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=a01c840a8f2a480c8e042aca1ef22f52, group_id=108a6ae64cd14977a2562b32b37dd93d, role_id=b236346d672242b4ac5377c269c1f0b4)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:44.381578 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efd66f5-af81-4983-a777-7568e421efb4 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:44.390147 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-8efd66f5-af81-4983-a777-7568e421efb4 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Invalidating the token cache because role b236346d672242b4ac5377c269c1f0b4 was removed from group 108a6ae64cd14977a2562b32b37dd93d on domain a01c840a8f2a480c8e042aca1ef22f52. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:28:44.390587 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-8efd66f5-af81-4983-a777-7568e421efb4 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:44.391382 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-8efd66f5-af81-4983-a777-7568e421efb4 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:44.418984 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2272/4546] 10.222.0.17 () {58 vars in 1466 bytes} [Sat Jul 23 21:28:44 2022] DELETE /identity/v3/domains/a01c840a8f2a480c8e042aca1ef22f52/groups/108a6ae64cd14977a2562b32b37dd93d/roles/b236346d672242b4ac5377c269c1f0b4 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:28:44.420090 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f8d3af-1191-4a2b-8ff3-bee33ff271d1 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:44.421795 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-e7f8d3af-1191-4a2b-8ff3-bee33ff271d1 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:44.434561 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:28:44.439633 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f8d3af-1191-4a2b-8ff3-bee33ff271d1 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:44.534381 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d185ccb2-dcfb-444f-ba9d-2a5c00588c43 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba8d06e121db4caf92ce215e16fc3324', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ccaff652d244cab7e5e736532f5c02', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:44.535710 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d185ccb2-dcfb-444f-ba9d-2a5c00588c43 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:44.536120 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d185ccb2-dcfb-444f-ba9d-2a5c00588c43 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:44.537306 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d185ccb2-dcfb-444f-ba9d-2a5c00588c43 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] PATH_INFO: `/v3/groups/108a6ae64cd14977a2562b32b37dd93d/users/01d27c973c614c72be15f495dc0a77eb` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:44.539409 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d185ccb2-dcfb-444f-ba9d-2a5c00588c43 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=108a6ae64cd14977a2562b32b37dd93d, user_id=01d27c973c614c72be15f495dc0a77eb)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:44.541464 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d185ccb2-dcfb-444f-ba9d-2a5c00588c43 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:44.554763 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-d185ccb2-dcfb-444f-ba9d-2a5c00588c43 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '01d27c973c614c72be15f495dc0a77eb'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:44.582096 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efd66f5-af81-4983-a777-7568e421efb4 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:44.582442 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2275/4547] 10.222.0.17 () {58 vars in 1343 bytes} [Sat Jul 23 21:28:44 2022] DELETE /identity/v3/groups/108a6ae64cd14977a2562b32b37dd93d/users/01d27c973c614c72be15f495dc0a77eb => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:28:44.583308 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-8efd66f5-af81-4983-a777-7568e421efb4 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:44.587619 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d185ccb2-dcfb-444f-ba9d-2a5c00588c43 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:44.596157 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-d185ccb2-dcfb-444f-ba9d-2a5c00588c43 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:44.606078 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efd66f5-af81-4983-a777-7568e421efb4 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:44.706545 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153437eb-435c-480e-80fc-560e0f18b110 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba8d06e121db4caf92ce215e16fc3324', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ccaff652d244cab7e5e736532f5c02', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:44.707673 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153437eb-435c-480e-80fc-560e0f18b110 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:44.708063 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153437eb-435c-480e-80fc-560e0f18b110 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:44.708473 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153437eb-435c-480e-80fc-560e0f18b110 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] PATH_INFO: `/v3/groups/108a6ae64cd14977a2562b32b37dd93d` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:44.710143 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153437eb-435c-480e-80fc-560e0f18b110 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] RBAC: Authorizing `identity:delete_group(group_id=108a6ae64cd14977a2562b32b37dd93d)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:44.712206 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153437eb-435c-480e-80fc-560e0f18b110 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:44.713698 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d185ccb2-dcfb-444f-ba9d-2a5c00588c43 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:44.720249 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e01e229-41da-4786-a0b8-5607523b4b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:44.721209 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e01e229-41da-4786-a0b8-5607523b4b84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:44.721486 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e01e229-41da-4786-a0b8-5607523b4b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:44.721807 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e01e229-41da-4786-a0b8-5607523b4b84 admin admin] PATH_INFO: `/v3/users/e11fb79c253c4a0f955d710ff4626f6d` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:44.723064 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e01e229-41da-4786-a0b8-5607523b4b84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e11fb79c253c4a0f955d710ff4626f6d)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:44.725055 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e01e229-41da-4786-a0b8-5607523b4b84 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:44.784669 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2273/4548] 10.222.0.17 () {58 vars in 1226 bytes} [Sat Jul 23 21:28:44 2022] DELETE /identity/v3/groups/108a6ae64cd14977a2562b32b37dd93d => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:28:44.785817 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153437eb-435c-480e-80fc-560e0f18b110 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:44.792578 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-1e01e229-41da-4786-a0b8-5607523b4b84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e11fb79c253c4a0f955d710ff4626f6d'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:44.819156 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-1e01e229-41da-4786-a0b8-5607523b4b84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e11fb79c253c4a0f955d710ff4626f6d'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:44.821365 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-1e01e229-41da-4786-a0b8-5607523b4b84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e11fb79c253c4a0f955d710ff4626f6d'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:44.840936 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-1e01e229-41da-4786-a0b8-5607523b4b84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e11fb79c253c4a0f955d710ff4626f6d'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:44.879868 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-1e01e229-41da-4786-a0b8-5607523b4b84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e11fb79c253c4a0f955d710ff4626f6d'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:44.881413 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=94,keystone:UPDATE=1,keystone:DELETE=5 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:28:44.898049 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2276/4549] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:28:44 2022] DELETE /identity/v3/users/e11fb79c253c4a0f955d710ff4626f6d => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:28:44.917742 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153437eb-435c-480e-80fc-560e0f18b110 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:44.994225 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443e98cd-0d79-410d-9a5b-87b0058018b1 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba8d06e121db4caf92ce215e16fc3324', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ccaff652d244cab7e5e736532f5c02', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:44.995200 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443e98cd-0d79-410d-9a5b-87b0058018b1 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:44.995854 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443e98cd-0d79-410d-9a5b-87b0058018b1 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:44.998182 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443e98cd-0d79-410d-9a5b-87b0058018b1 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] PATH_INFO: `/v3/roles/b236346d672242b4ac5377c269c1f0b4` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:45.000210 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443e98cd-0d79-410d-9a5b-87b0058018b1 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] RBAC: Authorizing `identity:delete_role(role_id=b236346d672242b4ac5377c269c1f0b4)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:45.003106 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443e98cd-0d79-410d-9a5b-87b0058018b1 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:45.095522 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-443e98cd-0d79-410d-9a5b-87b0058018b1 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Invalidating the token cache because role b236346d672242b4ac5377c269c1f0b4 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:28:45.096783 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-443e98cd-0d79-410d-9a5b-87b0058018b1 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:45.097906 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-443e98cd-0d79-410d-9a5b-87b0058018b1 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:45.129586 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e01e229-41da-4786-a0b8-5607523b4b84 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:45.131225 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-1e01e229-41da-4786-a0b8-5607523b4b84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:45.139758 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2274/4550] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:28:44 2022] DELETE /identity/v3/roles/b236346d672242b4ac5377c269c1f0b4 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:28:45.157245 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e01e229-41da-4786-a0b8-5607523b4b84 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:45.167961 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:28:45.269398 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57aabf2-cf7e-430f-8a83-0c17568d2cba tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba8d06e121db4caf92ce215e16fc3324', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ccaff652d244cab7e5e736532f5c02', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:45.270783 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57aabf2-cf7e-430f-8a83-0c17568d2cba tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:45.271073 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57aabf2-cf7e-430f-8a83-0c17568d2cba tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:45.271349 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57aabf2-cf7e-430f-8a83-0c17568d2cba tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] PATH_INFO: `/v3/domains/a01c840a8f2a480c8e042aca1ef22f52` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:45.273070 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57aabf2-cf7e-430f-8a83-0c17568d2cba tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=a01c840a8f2a480c8e042aca1ef22f52)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:45.275135 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57aabf2-cf7e-430f-8a83-0c17568d2cba tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:45.307871 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-e57aabf2-cf7e-430f-8a83-0c17568d2cba tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'a01c840a8f2a480c8e042aca1ef22f52'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:45.308654 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-e57aabf2-cf7e-430f-8a83-0c17568d2cba tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'a01c840a8f2a480c8e042aca1ef22f52'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:45.356451 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-e57aabf2-cf7e-430f-8a83-0c17568d2cba tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'a01c840a8f2a480c8e042aca1ef22f52'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:45.358415 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-e57aabf2-cf7e-430f-8a83-0c17568d2cba tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'a01c840a8f2a480c8e042aca1ef22f52'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:45.367852 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2277/4551] 10.222.0.17 () {60 vars in 1248 bytes} [Sat Jul 23 21:28:45 2022] PATCH /identity/v3/domains/a01c840a8f2a480c8e042aca1ef22f52 => generated 278 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:28:45.369672 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443e98cd-0d79-410d-9a5b-87b0058018b1 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:45.371770 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-443e98cd-0d79-410d-9a5b-87b0058018b1 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:45.419597 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443e98cd-0d79-410d-9a5b-87b0058018b1 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:45.537156 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9831165-f23a-4cbe-83f5-6349c91af409 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba8d06e121db4caf92ce215e16fc3324', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ccaff652d244cab7e5e736532f5c02', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:45.538856 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9831165-f23a-4cbe-83f5-6349c91af409 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:45.539299 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9831165-f23a-4cbe-83f5-6349c91af409 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:45.540523 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9831165-f23a-4cbe-83f5-6349c91af409 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] PATH_INFO: `/v3/domains/a01c840a8f2a480c8e042aca1ef22f52` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:45.556256 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9831165-f23a-4cbe-83f5-6349c91af409 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=a01c840a8f2a480c8e042aca1ef22f52)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:45.558219 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9831165-f23a-4cbe-83f5-6349c91af409 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:45.585588 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57aabf2-cf7e-430f-8a83-0c17568d2cba tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:45.587359 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-e57aabf2-cf7e-430f-8a83-0c17568d2cba tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:45.611395 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c9831165-f23a-4cbe-83f5-6349c91af409 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'a01c840a8f2a480c8e042aca1ef22f52'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:45.634601 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c9831165-f23a-4cbe-83f5-6349c91af409 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'a01c840a8f2a480c8e042aca1ef22f52'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:45.651821 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:28:45.711478 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c9831165-f23a-4cbe-83f5-6349c91af409 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a01c840a8f2a480c8e042aca1ef22f52', 'request_id': 'req-c9831165-f23a-4cbe-83f5-6349c91af409'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:45.718994 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57aabf2-cf7e-430f-8a83-0c17568d2cba tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:45.725629 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c9831165-f23a-4cbe-83f5-6349c91af409 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a01c840a8f2a480c8e042aca1ef22f52', 'request_id': 'req-c9831165-f23a-4cbe-83f5-6349c91af409'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:45.749700 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c9831165-f23a-4cbe-83f5-6349c91af409 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a01c840a8f2a480c8e042aca1ef22f52', 'request_id': 'req-c9831165-f23a-4cbe-83f5-6349c91af409'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:45.777906 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c9831165-f23a-4cbe-83f5-6349c91af409 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] The token cache is being invalidate because project a01c840a8f2a480c8e042aca1ef22f52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:28:45.777906 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c9831165-f23a-4cbe-83f5-6349c91af409 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:45.777906 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c9831165-f23a-4cbe-83f5-6349c91af409 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:45.792003 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c9831165-f23a-4cbe-83f5-6349c91af409 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'a01c840a8f2a480c8e042aca1ef22f52', 'request_id': 'req-c9831165-f23a-4cbe-83f5-6349c91af409'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:45.796425 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c9831165-f23a-4cbe-83f5-6349c91af409 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'a01c840a8f2a480c8e042aca1ef22f52', 'request_id': 'req-c9831165-f23a-4cbe-83f5-6349c91af409'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:45.797358 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c9831165-f23a-4cbe-83f5-6349c91af409 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'a01c840a8f2a480c8e042aca1ef22f52', 'request_id': 'req-c9831165-f23a-4cbe-83f5-6349c91af409'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:45.815574 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2275/4552] 10.222.0.17 () {58 vars in 1229 bytes} [Sat Jul 23 21:28:45 2022] DELETE /identity/v3/domains/a01c840a8f2a480c8e042aca1ef22f52 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:28:45.821704 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9831165-f23a-4cbe-83f5-6349c91af409 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:45.828581 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-c9831165-f23a-4cbe-83f5-6349c91af409 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:45.868261 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20da7a4e-af17-40d6-aa42-5f0a8d2104d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:45.869269 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20da7a4e-af17-40d6-aa42-5f0a8d2104d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:45.869621 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20da7a4e-af17-40d6-aa42-5f0a8d2104d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:45.873591 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20da7a4e-af17-40d6-aa42-5f0a8d2104d4 admin admin] PATH_INFO: `/v3/projects/2b46cc4b1ef64d168bf4184339de54d2` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:45.873591 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20da7a4e-af17-40d6-aa42-5f0a8d2104d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b46cc4b1ef64d168bf4184339de54d2)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:45.874271 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20da7a4e-af17-40d6-aa42-5f0a8d2104d4 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:45.912969 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=98,keystone:UPDATE=1,keystone:DELETE=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:28:45.933933 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9831165-f23a-4cbe-83f5-6349c91af409 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:45.956558 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-20da7a4e-af17-40d6-aa42-5f0a8d2104d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b46cc4b1ef64d168bf4184339de54d2', 'request_id': 'req-20da7a4e-af17-40d6-aa42-5f0a8d2104d4'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:45.978001 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-20da7a4e-af17-40d6-aa42-5f0a8d2104d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b46cc4b1ef64d168bf4184339de54d2', 'request_id': 'req-20da7a4e-af17-40d6-aa42-5f0a8d2104d4'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:45.994124 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-20da7a4e-af17-40d6-aa42-5f0a8d2104d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b46cc4b1ef64d168bf4184339de54d2', 'request_id': 'req-20da7a4e-af17-40d6-aa42-5f0a8d2104d4'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:46.009272 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-20da7a4e-af17-40d6-aa42-5f0a8d2104d4 admin admin] The token cache is being invalidate because project 2b46cc4b1ef64d168bf4184339de54d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:28:46.009984 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-20da7a4e-af17-40d6-aa42-5f0a8d2104d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:46.010867 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-20da7a4e-af17-40d6-aa42-5f0a8d2104d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:46.013777 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2278/4553] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:28:45 2022] DELETE /identity/v3/projects/2b46cc4b1ef64d168bf4184339de54d2 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:28:46.023529 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71db1c9-0942-4815-a1eb-2605ebf1e529 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:46.025513 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71db1c9-0942-4815-a1eb-2605ebf1e529 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:46.027496 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71db1c9-0942-4815-a1eb-2605ebf1e529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:46.069372 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47074098-82b8-4c3b-940f-c6e0a1b84bc8 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba8d06e121db4caf92ce215e16fc3324', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ccaff652d244cab7e5e736532f5c02', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:46.070363 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47074098-82b8-4c3b-940f-c6e0a1b84bc8 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:46.070633 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47074098-82b8-4c3b-940f-c6e0a1b84bc8 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:46.070878 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-b71db1c9-0942-4815-a1eb-2605ebf1e529 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:28:46.071006 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47074098-82b8-4c3b-940f-c6e0a1b84bc8 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] PATH_INFO: `/v3/domains/07738135b8fe498fb1f10f873631e9f6/users/01d27c973c614c72be15f495dc0a77eb/roles/32839aa656914b1884615d4d93511977` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:46.072951 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-b71db1c9-0942-4815-a1eb-2605ebf1e529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:46.082930 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47074098-82b8-4c3b-940f-c6e0a1b84bc8 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=07738135b8fe498fb1f10f873631e9f6, user_id=01d27c973c614c72be15f495dc0a77eb, role_id=32839aa656914b1884615d4d93511977)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:46.086177 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47074098-82b8-4c3b-940f-c6e0a1b84bc8 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:46.099503 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-47074098-82b8-4c3b-940f-c6e0a1b84bc8 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Invalidating the token cache because role 32839aa656914b1884615d4d93511977 was removed from user 01d27c973c614c72be15f495dc0a77eb on domain 07738135b8fe498fb1f10f873631e9f6. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:28:46.099797 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-47074098-82b8-4c3b-940f-c6e0a1b84bc8 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:46.100599 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-47074098-82b8-4c3b-940f-c6e0a1b84bc8 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:46.127665 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2276/4554] 10.222.0.17 () {58 vars in 1463 bytes} [Sat Jul 23 21:28:45 2022] DELETE /identity/v3/domains/07738135b8fe498fb1f10f873631e9f6/users/01d27c973c614c72be15f495dc0a77eb/roles/32839aa656914b1884615d4d93511977 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:28:46.133665 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47074098-82b8-4c3b-940f-c6e0a1b84bc8 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:46.138806 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-47074098-82b8-4c3b-940f-c6e0a1b84bc8 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:46.187658 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2279/4555] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:28:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:28:46.195577 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086fb5c2-ce72-4ffd-99fa-4d0110b9b601 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:46.196007 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086fb5c2-ce72-4ffd-99fa-4d0110b9b601 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:46.196383 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086fb5c2-ce72-4ffd-99fa-4d0110b9b601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:46.211526 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:28:46.239591 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-086fb5c2-ce72-4ffd-99fa-4d0110b9b601 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:28:46.245639 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-086fb5c2-ce72-4ffd-99fa-4d0110b9b601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:46.291640 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47074098-82b8-4c3b-940f-c6e0a1b84bc8 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:46.302267 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde09992-d313-4fa5-9a8d-bc6e6f61fbe8 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba8d06e121db4caf92ce215e16fc3324', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ccaff652d244cab7e5e736532f5c02', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:46.303333 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde09992-d313-4fa5-9a8d-bc6e6f61fbe8 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:46.303830 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde09992-d313-4fa5-9a8d-bc6e6f61fbe8 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:46.304317 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde09992-d313-4fa5-9a8d-bc6e6f61fbe8 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] PATH_INFO: `/v3/roles/32839aa656914b1884615d4d93511977` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:46.306219 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde09992-d313-4fa5-9a8d-bc6e6f61fbe8 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] RBAC: Authorizing `identity:delete_role(role_id=32839aa656914b1884615d4d93511977)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:46.309780 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde09992-d313-4fa5-9a8d-bc6e6f61fbe8 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:46.372647 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-fde09992-d313-4fa5-9a8d-bc6e6f61fbe8 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Invalidating the token cache because role 32839aa656914b1884615d4d93511977 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:28:46.373228 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-fde09992-d313-4fa5-9a8d-bc6e6f61fbe8 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:46.374756 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-fde09992-d313-4fa5-9a8d-bc6e6f61fbe8 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:46.378941 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2277/4556] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:28:46 2022] DELETE /identity/v3/roles/32839aa656914b1884615d4d93511977 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:28:46.383534 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde09992-d313-4fa5-9a8d-bc6e6f61fbe8 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:46.387674 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-fde09992-d313-4fa5-9a8d-bc6e6f61fbe8 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:46.414881 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2280/4557] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:28:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:28:46.419370 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086fb5c2-ce72-4ffd-99fa-4d0110b9b601 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:46.437284 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086fb5c2-ce72-4ffd-99fa-4d0110b9b601 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:46.536580 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:28:46.541090 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde09992-d313-4fa5-9a8d-bc6e6f61fbe8 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:46.547618 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e6d68a-5b49-41a3-bffa-fa3754cb125d tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba8d06e121db4caf92ce215e16fc3324', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ccaff652d244cab7e5e736532f5c02', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:46.548703 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e6d68a-5b49-41a3-bffa-fa3754cb125d tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:46.549262 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e6d68a-5b49-41a3-bffa-fa3754cb125d tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:46.549649 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e6d68a-5b49-41a3-bffa-fa3754cb125d tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] PATH_INFO: `/v3/domains/07738135b8fe498fb1f10f873631e9f6` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:46.551270 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e6d68a-5b49-41a3-bffa-fa3754cb125d tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=07738135b8fe498fb1f10f873631e9f6)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:46.553216 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e6d68a-5b49-41a3-bffa-fa3754cb125d tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:46.565579 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a315bc5-2dcf-4b74-bc72-b97680fa687e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:46.566346 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a315bc5-2dcf-4b74-bc72-b97680fa687e admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:46.566867 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a315bc5-2dcf-4b74-bc72-b97680fa687e admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:46.567015 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a315bc5-2dcf-4b74-bc72-b97680fa687e admin admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:46.567783 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a315bc5-2dcf-4b74-bc72-b97680fa687e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:28:46.568936 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a315bc5-2dcf-4b74-bc72-b97680fa687e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:46.576760 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a315bc5-2dcf-4b74-bc72-b97680fa687e admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:46.596587 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-b7e6d68a-5b49-41a3-bffa-fa3754cb125d tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '07738135b8fe498fb1f10f873631e9f6'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:46.600893 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-b7e6d68a-5b49-41a3-bffa-fa3754cb125d tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '07738135b8fe498fb1f10f873631e9f6'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:46.601081 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2281/4558] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:28:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:28:46.601964 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a315bc5-2dcf-4b74-bc72-b97680fa687e admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:46.604073 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-5a315bc5-2dcf-4b74-bc72-b97680fa687e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:46.622069 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a315bc5-2dcf-4b74-bc72-b97680fa687e admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:46.648363 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-b7e6d68a-5b49-41a3-bffa-fa3754cb125d tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '07738135b8fe498fb1f10f873631e9f6'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:46.649570 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-b7e6d68a-5b49-41a3-bffa-fa3754cb125d tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '07738135b8fe498fb1f10f873631e9f6'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:46.658597 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2278/4559] 10.222.0.17 () {60 vars in 1248 bytes} [Sat Jul 23 21:28:46 2022] PATCH /identity/v3/domains/07738135b8fe498fb1f10f873631e9f6 => generated 276 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:28:46.668266 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e6d68a-5b49-41a3-bffa-fa3754cb125d tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:46.668266 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-b7e6d68a-5b49-41a3-bffa-fa3754cb125d tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:46.732202 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16702916-fef9-495d-a72f-439aa9fa06b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:46.733218 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16702916-fef9-495d-a72f-439aa9fa06b0 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:46.733471 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16702916-fef9-495d-a72f-439aa9fa06b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:46.733835 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16702916-fef9-495d-a72f-439aa9fa06b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:46.734752 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16702916-fef9-495d-a72f-439aa9fa06b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:46.738048 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16702916-fef9-495d-a72f-439aa9fa06b0 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:46.738961 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:UPDATE=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:28:46.754446 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e6d68a-5b49-41a3-bffa-fa3754cb125d tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:46.761285 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999b83e1-adbc-4d38-b7a1-e6add9b20080 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba8d06e121db4caf92ce215e16fc3324', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ccaff652d244cab7e5e736532f5c02', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:46.763344 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999b83e1-adbc-4d38-b7a1-e6add9b20080 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:46.763344 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999b83e1-adbc-4d38-b7a1-e6add9b20080 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:46.763344 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999b83e1-adbc-4d38-b7a1-e6add9b20080 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] PATH_INFO: `/v3/domains/07738135b8fe498fb1f10f873631e9f6` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:46.785722 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999b83e1-adbc-4d38-b7a1-e6add9b20080 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=07738135b8fe498fb1f10f873631e9f6)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:46.790060 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999b83e1-adbc-4d38-b7a1-e6add9b20080 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:46.810244 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2282/4560] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:28:46 2022] POST /identity/v3/projects => generated 367 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:28:46.818954 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16702916-fef9-495d-a72f-439aa9fa06b0 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:46.821934 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-16702916-fef9-495d-a72f-439aa9fa06b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:46.829390 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-999b83e1-adbc-4d38-b7a1-e6add9b20080 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '07738135b8fe498fb1f10f873631e9f6'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:46.840720 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-999b83e1-adbc-4d38-b7a1-e6add9b20080 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '07738135b8fe498fb1f10f873631e9f6'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:46.912197 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-999b83e1-adbc-4d38-b7a1-e6add9b20080 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07738135b8fe498fb1f10f873631e9f6', 'request_id': 'req-999b83e1-adbc-4d38-b7a1-e6add9b20080'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:46.925914 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-999b83e1-adbc-4d38-b7a1-e6add9b20080 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07738135b8fe498fb1f10f873631e9f6', 'request_id': 'req-999b83e1-adbc-4d38-b7a1-e6add9b20080'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:46.933532 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-999b83e1-adbc-4d38-b7a1-e6add9b20080 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07738135b8fe498fb1f10f873631e9f6', 'request_id': 'req-999b83e1-adbc-4d38-b7a1-e6add9b20080'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:46.938539 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16702916-fef9-495d-a72f-439aa9fa06b0 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:46.947785 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-999b83e1-adbc-4d38-b7a1-e6add9b20080 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] The token cache is being invalidate because project 07738135b8fe498fb1f10f873631e9f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:28:46.948226 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-999b83e1-adbc-4d38-b7a1-e6add9b20080 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:46.949064 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-999b83e1-adbc-4d38-b7a1-e6add9b20080 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:46.961756 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-999b83e1-adbc-4d38-b7a1-e6add9b20080 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '07738135b8fe498fb1f10f873631e9f6', 'request_id': 'req-999b83e1-adbc-4d38-b7a1-e6add9b20080'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:46.967367 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-999b83e1-adbc-4d38-b7a1-e6add9b20080 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '07738135b8fe498fb1f10f873631e9f6', 'request_id': 'req-999b83e1-adbc-4d38-b7a1-e6add9b20080'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:46.968488 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-999b83e1-adbc-4d38-b7a1-e6add9b20080 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '07738135b8fe498fb1f10f873631e9f6', 'request_id': 'req-999b83e1-adbc-4d38-b7a1-e6add9b20080'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:46.977486 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2279/4561] 10.222.0.17 () {58 vars in 1229 bytes} [Sat Jul 23 21:28:46 2022] DELETE /identity/v3/domains/07738135b8fe498fb1f10f873631e9f6 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:28:46.985193 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999b83e1-adbc-4d38-b7a1-e6add9b20080 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:46.987028 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-999b83e1-adbc-4d38-b7a1-e6add9b20080 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:47.031949 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b1376a-b38b-4822-8488-9b54389c14de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:47.032913 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b1376a-b38b-4822-8488-9b54389c14de admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:47.033612 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b1376a-b38b-4822-8488-9b54389c14de admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:47.033980 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b1376a-b38b-4822-8488-9b54389c14de admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:47.034932 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b1376a-b38b-4822-8488-9b54389c14de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:47.037656 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b1376a-b38b-4822-8488-9b54389c14de admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:47.071578 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2283/4562] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:28:46 2022] POST /identity/v3/users => generated 284 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:28:47.072632 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b1376a-b38b-4822-8488-9b54389c14de admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:47.075074 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-28b1376a-b38b-4822-8488-9b54389c14de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:47.076405 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999b83e1-adbc-4d38-b7a1-e6add9b20080 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:47.081615 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d4746a-cb8d-47b1-bd47-a7f49263d93d tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba8d06e121db4caf92ce215e16fc3324', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ccaff652d244cab7e5e736532f5c02', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:47.082616 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d4746a-cb8d-47b1-bd47-a7f49263d93d tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:47.083065 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d4746a-cb8d-47b1-bd47-a7f49263d93d tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:47.083608 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d4746a-cb8d-47b1-bd47-a7f49263d93d tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:47.084546 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d4746a-cb8d-47b1-bd47-a7f49263d93d tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:47.086809 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d4746a-cb8d-47b1-bd47-a7f49263d93d tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:47.089714 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b1376a-b38b-4822-8488-9b54389c14de admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:47.097090 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79720eeb-4371-4485-80a2-7fd53096592a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:47.097845 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79720eeb-4371-4485-80a2-7fd53096592a admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:47.098243 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79720eeb-4371-4485-80a2-7fd53096592a admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:47.098527 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79720eeb-4371-4485-80a2-7fd53096592a admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:47.099325 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79720eeb-4371-4485-80a2-7fd53096592a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:47.101355 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2280/4563] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:28:46 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:28:47.105316 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79720eeb-4371-4485-80a2-7fd53096592a admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:47.106169 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d4746a-cb8d-47b1-bd47-a7f49263d93d tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:47.108276 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:28:47.123444 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2284/4564] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:28:47 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:28:47.124447 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79720eeb-4371-4485-80a2-7fd53096592a admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:47.129185 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d4746a-cb8d-47b1-bd47-a7f49263d93d tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:47.136303 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b634dd5c-91af-4405-b16d-0e24e3de1e3f tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba8d06e121db4caf92ce215e16fc3324', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ccaff652d244cab7e5e736532f5c02', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:47.138227 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79720eeb-4371-4485-80a2-7fd53096592a admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:47.138613 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b634dd5c-91af-4405-b16d-0e24e3de1e3f tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:47.141991 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b634dd5c-91af-4405-b16d-0e24e3de1e3f tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:47.142284 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b634dd5c-91af-4405-b16d-0e24e3de1e3f tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] PATH_INFO: `/v3/projects/29cbff2323bf4e599627ba18f23ad04a/users/ba8d06e121db4caf92ce215e16fc3324/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:47.145642 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adf7813-e704-44c8-a672-2faec225bab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:47.146876 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adf7813-e704-44c8-a672-2faec225bab1 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:47.147166 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adf7813-e704-44c8-a672-2faec225bab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:47.147446 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adf7813-e704-44c8-a672-2faec225bab1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:47.148194 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adf7813-e704-44c8-a672-2faec225bab1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:47.149845 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adf7813-e704-44c8-a672-2faec225bab1 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:47.151926 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b634dd5c-91af-4405-b16d-0e24e3de1e3f tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] RBAC: Authorizing `identity:create_grant(project_id=29cbff2323bf4e599627ba18f23ad04a, user_id=ba8d06e121db4caf92ce215e16fc3324, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:47.158763 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b634dd5c-91af-4405-b16d-0e24e3de1e3f tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:47.169778 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2285/4565] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:28:47 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:28:47.171353 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adf7813-e704-44c8-a672-2faec225bab1 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:47.184994 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adf7813-e704-44c8-a672-2faec225bab1 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:47.187741 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2281/4566] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:28:47 2022] PUT /identity/v3/projects/29cbff2323bf4e599627ba18f23ad04a/users/ba8d06e121db4caf92ce215e16fc3324/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:28:47.193215 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b634dd5c-91af-4405-b16d-0e24e3de1e3f tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:47.218644 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:28:47.292671 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17c0cc9-42ef-45bd-984c-ca9c239fdc20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:47.293598 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17c0cc9-42ef-45bd-984c-ca9c239fdc20 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:47.293898 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17c0cc9-42ef-45bd-984c-ca9c239fdc20 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:47.297627 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17c0cc9-42ef-45bd-984c-ca9c239fdc20 admin admin] PATH_INFO: `/v3/projects/1890022bd460485dae0ea94b152a6746/users/5efda1c40f494592bf1e6af1add120f3/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:47.327069 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17c0cc9-42ef-45bd-984c-ca9c239fdc20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1890022bd460485dae0ea94b152a6746, user_id=5efda1c40f494592bf1e6af1add120f3, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:47.327888 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b634dd5c-91af-4405-b16d-0e24e3de1e3f tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:47.330148 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17c0cc9-42ef-45bd-984c-ca9c239fdc20 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:47.335676 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a494fcaa-c224-4a91-a152-c0e9bc490fb8 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba8d06e121db4caf92ce215e16fc3324', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ccaff652d244cab7e5e736532f5c02', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:47.337493 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a494fcaa-c224-4a91-a152-c0e9bc490fb8 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:47.338313 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a494fcaa-c224-4a91-a152-c0e9bc490fb8 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:47.339401 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a494fcaa-c224-4a91-a152-c0e9bc490fb8 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] PATH_INFO: `/v3/auth/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:47.340392 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a494fcaa-c224-4a91-a152-c0e9bc490fb8 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] RBAC: Authorizing `identity:get_auth_projects()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:47.343325 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a494fcaa-c224-4a91-a152-c0e9bc490fb8 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:47.354120 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2286/4567] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:28:47 2022] PUT /identity/v3/projects/1890022bd460485dae0ea94b152a6746/users/5efda1c40f494592bf1e6af1add120f3/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:28:47.359514 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3f0a38-c723-42ec-a428-fe964fdbb0ae None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:47.362019 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3f0a38-c723-42ec-a428-fe964fdbb0ae None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:47.362374 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3f0a38-c723-42ec-a428-fe964fdbb0ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:47.406375 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-4e3f0a38-c723-42ec-a428-fe964fdbb0ae None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:28:47.408325 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-4e3f0a38-c723-42ec-a428-fe964fdbb0ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:47.460021 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2282/4568] 10.222.0.17 () {58 vars in 1145 bytes} [Sat Jul 23 21:28:47 2022] GET /identity/v3/auth/projects => generated 826 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:28:47.469569 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a494fcaa-c224-4a91-a152-c0e9bc490fb8 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:47.484788 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a494fcaa-c224-4a91-a152-c0e9bc490fb8 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:47.515630 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2287/4569] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:28:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:28:47.576020 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3f0a38-c723-42ec-a428-fe964fdbb0ae None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:47.580648 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9f0bfe-f925-4e0d-babe-c07f02e60dfe tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba8d06e121db4caf92ce215e16fc3324', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ccaff652d244cab7e5e736532f5c02', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:47.580648 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9f0bfe-f925-4e0d-babe-c07f02e60dfe tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:47.580648 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9f0bfe-f925-4e0d-babe-c07f02e60dfe tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:47.580998 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9f0bfe-f925-4e0d-babe-c07f02e60dfe tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] PATH_INFO: `/v3/projects/29cbff2323bf4e599627ba18f23ad04a/users/ba8d06e121db4caf92ce215e16fc3324/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:47.580998 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9f0bfe-f925-4e0d-babe-c07f02e60dfe tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=29cbff2323bf4e599627ba18f23ad04a, user_id=ba8d06e121db4caf92ce215e16fc3324, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:47.582832 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9f0bfe-f925-4e0d-babe-c07f02e60dfe tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:47.588773 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-4e3f0a38-c723-42ec-a428-fe964fdbb0ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:47.589305 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-4e9f0bfe-f925-4e0d-babe-c07f02e60dfe tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Invalidating the token cache because role fec17bfdc65349a2b9c06a89131191df was removed from user ba8d06e121db4caf92ce215e16fc3324 on project 29cbff2323bf4e599627ba18f23ad04a. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:28:47.589650 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-4e9f0bfe-f925-4e0d-babe-c07f02e60dfe tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:47.590830 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-4e9f0bfe-f925-4e0d-babe-c07f02e60dfe tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:47.612557 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2283/4570] 10.222.0.17 () {58 vars in 1466 bytes} [Sat Jul 23 21:28:47 2022] DELETE /identity/v3/projects/29cbff2323bf4e599627ba18f23ad04a/users/ba8d06e121db4caf92ce215e16fc3324/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:28:47.613574 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9f0bfe-f925-4e0d-babe-c07f02e60dfe tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:47.615835 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-4e9f0bfe-f925-4e0d-babe-c07f02e60dfe tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:47.679885 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3f0a38-c723-42ec-a428-fe964fdbb0ae None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:47.739565 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9f0bfe-f925-4e0d-babe-c07f02e60dfe tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:47.745342 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:28:47.747446 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00938455-f3b3-46c7-97f6-8f0f4c8b6c3d tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba8d06e121db4caf92ce215e16fc3324', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ccaff652d244cab7e5e736532f5c02', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:47.748150 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00938455-f3b3-46c7-97f6-8f0f4c8b6c3d tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:47.749067 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00938455-f3b3-46c7-97f6-8f0f4c8b6c3d tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:47.749360 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00938455-f3b3-46c7-97f6-8f0f4c8b6c3d tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:47.753273 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00938455-f3b3-46c7-97f6-8f0f4c8b6c3d tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:47.755947 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00938455-f3b3-46c7-97f6-8f0f4c8b6c3d tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:47.770475 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=97,keystone:DELETE=1,keystone:INSERT=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:28:47.799990 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bbc109-259e-4ab9-a09f-2b123705be67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:47.800271 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2284/4571] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:28:47 2022] POST /identity/v3/users => generated 321 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:28:47.803249 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00938455-f3b3-46c7-97f6-8f0f4c8b6c3d tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:47.803405 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bbc109-259e-4ab9-a09f-2b123705be67 service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:47.803405 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bbc109-259e-4ab9-a09f-2b123705be67 service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:47.803405 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bbc109-259e-4ab9-a09f-2b123705be67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:47.807774 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-c4bbc109-259e-4ab9-a09f-2b123705be67 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:47.815278 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00938455-f3b3-46c7-97f6-8f0f4c8b6c3d tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:47.821200 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea93f2c-f0c4-4ae3-a5d0-189f64b16eed tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba8d06e121db4caf92ce215e16fc3324', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ccaff652d244cab7e5e736532f5c02', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:47.823405 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea93f2c-f0c4-4ae3-a5d0-189f64b16eed tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:47.823695 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea93f2c-f0c4-4ae3-a5d0-189f64b16eed tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:47.823973 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea93f2c-f0c4-4ae3-a5d0-189f64b16eed tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:47.824944 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea93f2c-f0c4-4ae3-a5d0-189f64b16eed tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:47.827663 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea93f2c-f0c4-4ae3-a5d0-189f64b16eed tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:47.917112 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2285/4572] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:28:47 2022] POST /identity/v3/projects => generated 364 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:28:47.918293 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea93f2c-f0c4-4ae3-a5d0-189f64b16eed tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:47.959733 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bbc109-259e-4ab9-a09f-2b123705be67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:47.960994 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bbc109-259e-4ab9-a09f-2b123705be67 service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:47.974640 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2288/4573] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:28:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 23 21:28:48.050637 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea93f2c-f0c4-4ae3-a5d0-189f64b16eed tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:48.059727 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1a42d5-8e5d-4d4c-8cc2-648236411f26 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba8d06e121db4caf92ce215e16fc3324', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ccaff652d244cab7e5e736532f5c02', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:48.060429 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1a42d5-8e5d-4d4c-8cc2-648236411f26 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:48.060716 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1a42d5-8e5d-4d4c-8cc2-648236411f26 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:48.061039 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1a42d5-8e5d-4d4c-8cc2-648236411f26 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:48.061748 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1a42d5-8e5d-4d4c-8cc2-648236411f26 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:48.064311 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1a42d5-8e5d-4d4c-8cc2-648236411f26 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:48.116556 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2286/4574] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:28:47 2022] POST /identity/v3/projects => generated 363 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:28:48.121970 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bbc109-259e-4ab9-a09f-2b123705be67 service neutron] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:48.135573 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bbc109-259e-4ab9-a09f-2b123705be67 service neutron] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:48.283377 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7409030-2877-497d-a93c-3c80c669fdba tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba8d06e121db4caf92ce215e16fc3324', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ccaff652d244cab7e5e736532f5c02', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:48.284195 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7409030-2877-497d-a93c-3c80c669fdba tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:48.285037 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7409030-2877-497d-a93c-3c80c669fdba tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:48.285242 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7409030-2877-497d-a93c-3c80c669fdba tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:48.286966 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7409030-2877-497d-a93c-3c80c669fdba tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:48.289193 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7409030-2877-497d-a93c-3c80c669fdba tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:48.340964 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2289/4575] 10.222.0.17 () {60 vars in 1142 bytes} [Sat Jul 23 21:28:48 2022] POST /identity/v3/roles => generated 240 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:28:48.344805 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1a42d5-8e5d-4d4c-8cc2-648236411f26 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:48.368300 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1a42d5-8e5d-4d4c-8cc2-648236411f26 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:48.377535 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40be94c-fc1e-4516-8e7b-bdac5daa66a9 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba8d06e121db4caf92ce215e16fc3324', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ccaff652d244cab7e5e736532f5c02', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:48.378521 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40be94c-fc1e-4516-8e7b-bdac5daa66a9 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:48.378807 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40be94c-fc1e-4516-8e7b-bdac5daa66a9 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:48.379058 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40be94c-fc1e-4516-8e7b-bdac5daa66a9 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] PATH_INFO: `/v3/projects/becb33297e6a45819e806def6e8b3cda/users/902df4f85fb6434589028824a42bbe07/roles/d7bc68c0d1284cc3b6ef328ea8dd33c2` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:48.414623 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40be94c-fc1e-4516-8e7b-bdac5daa66a9 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] RBAC: Authorizing `identity:create_grant(project_id=becb33297e6a45819e806def6e8b3cda, user_id=902df4f85fb6434589028824a42bbe07, role_id=d7bc68c0d1284cc3b6ef328ea8dd33c2)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:48.417315 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40be94c-fc1e-4516-8e7b-bdac5daa66a9 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:48.456088 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2287/4576] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:28:48 2022] PUT /identity/v3/projects/becb33297e6a45819e806def6e8b3cda/users/902df4f85fb6434589028824a42bbe07/roles/d7bc68c0d1284cc3b6ef328ea8dd33c2 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:28:48.461063 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7409030-2877-497d-a93c-3c80c669fdba tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:48.474222 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7409030-2877-497d-a93c-3c80c669fdba tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:48.615929 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c522e3-ab0b-4b00-ab80-a02c9d960b22 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba8d06e121db4caf92ce215e16fc3324', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ccaff652d244cab7e5e736532f5c02', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:48.621069 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c522e3-ab0b-4b00-ab80-a02c9d960b22 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:48.621333 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c522e3-ab0b-4b00-ab80-a02c9d960b22 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:48.622459 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c522e3-ab0b-4b00-ab80-a02c9d960b22 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] PATH_INFO: `/v3/projects/52f30fcab9c943b5a4d4b927511eec12/users/902df4f85fb6434589028824a42bbe07/roles/d7bc68c0d1284cc3b6ef328ea8dd33c2` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:48.635961 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c522e3-ab0b-4b00-ab80-a02c9d960b22 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] RBAC: Authorizing `identity:create_grant(project_id=52f30fcab9c943b5a4d4b927511eec12, user_id=902df4f85fb6434589028824a42bbe07, role_id=d7bc68c0d1284cc3b6ef328ea8dd33c2)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:48.641842 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c522e3-ab0b-4b00-ab80-a02c9d960b22 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:48.678828 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2290/4577] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:28:48 2022] PUT /identity/v3/projects/52f30fcab9c943b5a4d4b927511eec12/users/902df4f85fb6434589028824a42bbe07/roles/d7bc68c0d1284cc3b6ef328ea8dd33c2 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:28:48.684239 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217ee419-394b-42f0-9b6a-ccd7d3c38232 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:48.684793 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217ee419-394b-42f0-9b6a-ccd7d3c38232 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:48.685053 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217ee419-394b-42f0-9b6a-ccd7d3c38232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:48.740314 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-217ee419-394b-42f0-9b6a-ccd7d3c38232 None None] MFA Rules not processed for user `902df4f85fb6434589028824a42bbe07`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:28:48.742137 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-217ee419-394b-42f0-9b6a-ccd7d3c38232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:48.746615 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2288/4578] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:28:48 2022] POST /identity/v3/auth/tokens => generated 334 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 23 21:28:48.752091 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e83f9f6-cdd9-428c-a02f-4ee796746b07 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:48.754294 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e83f9f6-cdd9-428c-a02f-4ee796746b07 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:48.754294 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e83f9f6-cdd9-428c-a02f-4ee796746b07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:48.768612 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:28:48.771362 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-8e83f9f6-cdd9-428c-a02f-4ee796746b07 None None] MFA Rules not processed for user `902df4f85fb6434589028824a42bbe07`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:28:48.774225 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-8e83f9f6-cdd9-428c-a02f-4ee796746b07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:48.877069 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2291/4579] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:28:48 2022] POST /identity/v3/auth/tokens => generated 3215 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Jul 23 21:28:48.881681 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217ee419-394b-42f0-9b6a-ccd7d3c38232 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:48.975303 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217ee419-394b-42f0-9b6a-ccd7d3c38232 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:48.980819 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a54d410-79a8-4c15-bf95-b8d76350f525 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba8d06e121db4caf92ce215e16fc3324', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ccaff652d244cab7e5e736532f5c02', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:48.984825 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a54d410-79a8-4c15-bf95-b8d76350f525 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:48.985580 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a54d410-79a8-4c15-bf95-b8d76350f525 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:48.986060 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a54d410-79a8-4c15-bf95-b8d76350f525 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:48.996968 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a54d410-79a8-4c15-bf95-b8d76350f525 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] RBAC: Authorizing `identity:revoke_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:48.999719 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a54d410-79a8-4c15-bf95-b8d76350f525 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:49.067006 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919160bd-84e5-4ed4-a67a-3638f4c92c54 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:49.067845 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919160bd-84e5-4ed4-a67a-3638f4c92c54 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:49.068437 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919160bd-84e5-4ed4-a67a-3638f4c92c54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:49.070051 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2289/4580] 10.222.0.17 () {56 vars in 1307 bytes} [Sat Jul 23 21:28:48 2022] DELETE /identity/v3/auth/tokens => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:28:49.086780 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-919160bd-84e5-4ed4-a67a-3638f4c92c54 None None] MFA Rules not processed for user `902df4f85fb6434589028824a42bbe07`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:28:49.088124 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-919160bd-84e5-4ed4-a67a-3638f4c92c54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:49.202760 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2292/4581] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:28:49 2022] POST /identity/v3/auth/tokens => generated 3215 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Jul 23 21:28:49.208252 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a54d410-79a8-4c15-bf95-b8d76350f525 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:49.221842 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a54d410-79a8-4c15-bf95-b8d76350f525 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:49.228767 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0b8938-6a29-45d3-b8b4-ec6d376ab056 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba8d06e121db4caf92ce215e16fc3324', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ccaff652d244cab7e5e736532f5c02', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:49.230535 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0b8938-6a29-45d3-b8b4-ec6d376ab056 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:49.230831 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0b8938-6a29-45d3-b8b4-ec6d376ab056 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:49.231206 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0b8938-6a29-45d3-b8b4-ec6d376ab056 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] PATH_INFO: `/v3/roles/d7bc68c0d1284cc3b6ef328ea8dd33c2` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:49.233490 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0b8938-6a29-45d3-b8b4-ec6d376ab056 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] RBAC: Authorizing `identity:delete_role(role_id=d7bc68c0d1284cc3b6ef328ea8dd33c2)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:49.235810 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0b8938-6a29-45d3-b8b4-ec6d376ab056 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:49.238029 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:INSERT=5,keystone:SELECT=94,keystone:DELETE=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:28:49.305348 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-ef0b8938-6a29-45d3-b8b4-ec6d376ab056 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Invalidating the token cache because role d7bc68c0d1284cc3b6ef328ea8dd33c2 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:28:49.305643 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-ef0b8938-6a29-45d3-b8b4-ec6d376ab056 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:49.306586 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-ef0b8938-6a29-45d3-b8b4-ec6d376ab056 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:49.310151 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2290/4582] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:28:49 2022] DELETE /identity/v3/roles/d7bc68c0d1284cc3b6ef328ea8dd33c2 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:28:49.316986 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919160bd-84e5-4ed4-a67a-3638f4c92c54 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:49.333652 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919160bd-84e5-4ed4-a67a-3638f4c92c54 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:49.460078 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e291a4c-bf48-456f-b92d-eee032799723 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba8d06e121db4caf92ce215e16fc3324', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ccaff652d244cab7e5e736532f5c02', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:49.460904 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e291a4c-bf48-456f-b92d-eee032799723 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:49.461183 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e291a4c-bf48-456f-b92d-eee032799723 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:49.461621 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e291a4c-bf48-456f-b92d-eee032799723 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] PATH_INFO: `/v3/projects/52f30fcab9c943b5a4d4b927511eec12` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:49.462911 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e291a4c-bf48-456f-b92d-eee032799723 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] RBAC: Authorizing `identity:delete_project(project_id=52f30fcab9c943b5a4d4b927511eec12)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:49.465051 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e291a4c-bf48-456f-b92d-eee032799723 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:49.539841 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-1e291a4c-bf48-456f-b92d-eee032799723 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52f30fcab9c943b5a4d4b927511eec12', 'request_id': 'req-1e291a4c-bf48-456f-b92d-eee032799723'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:49.544180 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:28:49.563297 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-1e291a4c-bf48-456f-b92d-eee032799723 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52f30fcab9c943b5a4d4b927511eec12', 'request_id': 'req-1e291a4c-bf48-456f-b92d-eee032799723'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:49.581303 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-1e291a4c-bf48-456f-b92d-eee032799723 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52f30fcab9c943b5a4d4b927511eec12', 'request_id': 'req-1e291a4c-bf48-456f-b92d-eee032799723'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:49.601720 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-1e291a4c-bf48-456f-b92d-eee032799723 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] The token cache is being invalidate because project 52f30fcab9c943b5a4d4b927511eec12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:28:49.602515 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-1e291a4c-bf48-456f-b92d-eee032799723 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:49.603863 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-1e291a4c-bf48-456f-b92d-eee032799723 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:49.612993 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0b8938-6a29-45d3-b8b4-ec6d376ab056 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:49.615182 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2293/4583] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:28:49 2022] DELETE /identity/v3/projects/52f30fcab9c943b5a4d4b927511eec12 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:28:49.615552 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-ef0b8938-6a29-45d3-b8b4-ec6d376ab056 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:49.643073 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0b8938-6a29-45d3-b8b4-ec6d376ab056 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:49.762032 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cef8bd-fad8-44a4-911f-92b597ee7b95 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba8d06e121db4caf92ce215e16fc3324', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ccaff652d244cab7e5e736532f5c02', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:49.763147 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cef8bd-fad8-44a4-911f-92b597ee7b95 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:49.763525 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cef8bd-fad8-44a4-911f-92b597ee7b95 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:49.763900 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cef8bd-fad8-44a4-911f-92b597ee7b95 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] PATH_INFO: `/v3/projects/52f30fcab9c943b5a4d4b927511eec12` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:49.773766 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cef8bd-fad8-44a4-911f-92b597ee7b95 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] RBAC: Authorizing `identity:delete_project(project_id=52f30fcab9c943b5a4d4b927511eec12)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:49.776072 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cef8bd-fad8-44a4-911f-92b597ee7b95 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:49.807864 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-11cef8bd-fad8-44a4-911f-92b597ee7b95 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Could not find project: 52f30fcab9c943b5a4d4b927511eec12.: keystone.exception.ProjectNotFound: Could not find project: 52f30fcab9c943b5a4d4b927511eec12. Jul 23 21:28:49.807864 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 21:28:49.807864 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 21:28:49.807864 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 21:28:49.807864 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 21:28:49.807864 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 21:28:49.807864 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 21:28:49.807864 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 21:28:49.807864 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 21:28:49.807864 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 21:28:49.807864 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 21:28:49.807864 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 21:28:49.807864 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 211, in delete Jul 23 21:28:49.807864 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_project( Jul 23 21:28:49.809213 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 21:28:49.809213 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 21:28:49.809213 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 478, in delete_project Jul 23 21:28:49.809213 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application project = self.driver.get_project(project_id) Jul 23 21:28:49.809213 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 23 21:28:49.809213 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 23 21:28:49.809213 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 23 21:28:49.809213 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 23 21:28:49.809213 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 52f30fcab9c943b5a4d4b927511eec12. Jul 23 21:28:49.809213 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 21:28:49.816915 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2291/4584] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:28:49 2022] DELETE /identity/v3/projects/52f30fcab9c943b5a4d4b927511eec12 => generated 113 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 23 21:28:49.817431 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e291a4c-bf48-456f-b92d-eee032799723 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:49.817750 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-1e291a4c-bf48-456f-b92d-eee032799723 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:49.837756 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e291a4c-bf48-456f-b92d-eee032799723 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:49.854623 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83d4119-8418-48b8-abbd-7420685abd62 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba8d06e121db4caf92ce215e16fc3324', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ccaff652d244cab7e5e736532f5c02', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:49.855549 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83d4119-8418-48b8-abbd-7420685abd62 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:49.855827 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83d4119-8418-48b8-abbd-7420685abd62 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:49.856098 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83d4119-8418-48b8-abbd-7420685abd62 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] PATH_INFO: `/v3/projects/becb33297e6a45819e806def6e8b3cda` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:49.863171 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83d4119-8418-48b8-abbd-7420685abd62 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] RBAC: Authorizing `identity:delete_project(project_id=becb33297e6a45819e806def6e8b3cda)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:49.865227 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83d4119-8418-48b8-abbd-7420685abd62 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:49.955103 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-f83d4119-8418-48b8-abbd-7420685abd62 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'becb33297e6a45819e806def6e8b3cda', 'request_id': 'req-f83d4119-8418-48b8-abbd-7420685abd62'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:49.970196 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-f83d4119-8418-48b8-abbd-7420685abd62 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'becb33297e6a45819e806def6e8b3cda', 'request_id': 'req-f83d4119-8418-48b8-abbd-7420685abd62'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:49.981654 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-f83d4119-8418-48b8-abbd-7420685abd62 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'becb33297e6a45819e806def6e8b3cda', 'request_id': 'req-f83d4119-8418-48b8-abbd-7420685abd62'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:50.000877 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-f83d4119-8418-48b8-abbd-7420685abd62 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] The token cache is being invalidate because project becb33297e6a45819e806def6e8b3cda was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:28:50.003030 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-f83d4119-8418-48b8-abbd-7420685abd62 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:50.004041 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-f83d4119-8418-48b8-abbd-7420685abd62 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:50.007738 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2294/4585] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:28:49 2022] DELETE /identity/v3/projects/becb33297e6a45819e806def6e8b3cda => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:28:50.011539 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cef8bd-fad8-44a4-911f-92b597ee7b95 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:50.015731 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-11cef8bd-fad8-44a4-911f-92b597ee7b95 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:50.054745 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cef8bd-fad8-44a4-911f-92b597ee7b95 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:50.206978 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b13da05-6a1d-496e-bb98-1b414a0abb52 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba8d06e121db4caf92ce215e16fc3324', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ccaff652d244cab7e5e736532f5c02', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:50.209713 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b13da05-6a1d-496e-bb98-1b414a0abb52 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:50.210048 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b13da05-6a1d-496e-bb98-1b414a0abb52 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:50.210835 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b13da05-6a1d-496e-bb98-1b414a0abb52 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] PATH_INFO: `/v3/users/902df4f85fb6434589028824a42bbe07` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:50.212579 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b13da05-6a1d-496e-bb98-1b414a0abb52 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] RBAC: Authorizing `identity:delete_user(user_id=902df4f85fb6434589028824a42bbe07)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:50.215865 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b13da05-6a1d-496e-bb98-1b414a0abb52 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:50.296718 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-8b13da05-6a1d-496e-bb98-1b414a0abb52 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '902df4f85fb6434589028824a42bbe07'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:50.297619 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-8b13da05-6a1d-496e-bb98-1b414a0abb52 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '902df4f85fb6434589028824a42bbe07'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:50.308359 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-8b13da05-6a1d-496e-bb98-1b414a0abb52 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '902df4f85fb6434589028824a42bbe07'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:50.313725 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:28:50.321136 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-8b13da05-6a1d-496e-bb98-1b414a0abb52 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '902df4f85fb6434589028824a42bbe07'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:50.348866 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-8b13da05-6a1d-496e-bb98-1b414a0abb52 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '902df4f85fb6434589028824a42bbe07'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:50.362140 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2292/4586] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:28:50 2022] DELETE /identity/v3/users/902df4f85fb6434589028824a42bbe07 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:28:50.372210 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83d4119-8418-48b8-abbd-7420685abd62 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:50.388556 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83d4119-8418-48b8-abbd-7420685abd62 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:50.527607 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a916ec29-31b3-4161-8b12-a74b53ae9303 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba8d06e121db4caf92ce215e16fc3324', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ccaff652d244cab7e5e736532f5c02', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:50.528828 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a916ec29-31b3-4161-8b12-a74b53ae9303 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:50.529389 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a916ec29-31b3-4161-8b12-a74b53ae9303 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:50.529808 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a916ec29-31b3-4161-8b12-a74b53ae9303 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] PATH_INFO: `/v3/domains/56e67222f4c144bcac51ba824b804a60` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:50.579558 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a916ec29-31b3-4161-8b12-a74b53ae9303 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 21:28:50.595950 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-a916ec29-31b3-4161-8b12-a74b53ae9303 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Could not find domain: 56e67222f4c144bcac51ba824b804a60.: keystone.exception.DomainNotFound: Could not find domain: 56e67222f4c144bcac51ba824b804a60. Jul 23 21:28:50.595950 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 21:28:50.595950 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 23 21:28:50.595950 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 23 21:28:50.595950 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 23 21:28:50.595950 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 23 21:28:50.595950 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 23 21:28:50.595950 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 23 21:28:50.595950 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 56e67222f4c144bcac51ba824b804a60. Jul 23 21:28:50.595950 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 21:28:50.595950 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 23 21:28:50.595950 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 21:28:50.595950 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 21:28:50.595950 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 21:28:50.595950 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 21:28:50.595950 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 21:28:50.597494 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 21:28:50.597494 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 21:28:50.597494 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 21:28:50.597494 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 21:28:50.597494 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 21:28:50.597494 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 21:28:50.597494 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 21:28:50.597494 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jul 23 21:28:50.597494 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jul 23 21:28:50.597494 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 21:28:50.597494 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 21:28:50.597494 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 21:28:50.597494 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 21:28:50.597494 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 21:28:50.597494 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 21:28:50.597494 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 21:28:50.598850 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 21:28:50.598850 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 21:28:50.598850 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 21:28:50.598850 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 21:28:50.598850 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application with Lock( Jul 23 21:28:50.598850 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 21:28:50.598850 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._enter() Jul 23 21:28:50.598850 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 21:28:50.598850 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 21:28:50.598850 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 21:28:50.598850 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.creator() Jul 23 21:28:50.598850 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 21:28:50.598850 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application created_value = creator( Jul 23 21:28:50.598850 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 23 21:28:50.598850 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 23 21:28:50.598850 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 56e67222f4c144bcac51ba824b804a60. Jul 23 21:28:50.598850 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 21:28:50.600222 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2295/4587] 10.222.0.17 () {60 vars in 1248 bytes} [Sat Jul 23 21:28:50 2022] PATCH /identity/v3/domains/56e67222f4c144bcac51ba824b804a60 => generated 112 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 23 21:28:50.601945 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b13da05-6a1d-496e-bb98-1b414a0abb52 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:50.603861 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-8b13da05-6a1d-496e-bb98-1b414a0abb52 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:50.624862 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b13da05-6a1d-496e-bb98-1b414a0abb52 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:50.637540 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0bda74-287f-45e5-917e-097f98186408 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba8d06e121db4caf92ce215e16fc3324', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ccaff652d244cab7e5e736532f5c02', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:50.637540 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0bda74-287f-45e5-917e-097f98186408 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:50.637540 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0bda74-287f-45e5-917e-097f98186408 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:50.638137 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0bda74-287f-45e5-917e-097f98186408 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] PATH_INFO: `/v3/domains/3aad61227e7a4c7193474598e4bcca39` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:50.664427 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0bda74-287f-45e5-917e-097f98186408 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 21:28:50.679427 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-6a0bda74-287f-45e5-917e-097f98186408 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Could not find domain: 3aad61227e7a4c7193474598e4bcca39.: keystone.exception.DomainNotFound: Could not find domain: 3aad61227e7a4c7193474598e4bcca39. Jul 23 21:28:50.679427 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 21:28:50.679427 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 23 21:28:50.679427 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 23 21:28:50.679427 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 23 21:28:50.679427 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 23 21:28:50.679427 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 23 21:28:50.679427 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 23 21:28:50.679427 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 3aad61227e7a4c7193474598e4bcca39. Jul 23 21:28:50.679427 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 21:28:50.679427 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 23 21:28:50.679427 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 21:28:50.679427 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 21:28:50.679427 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 21:28:50.679427 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 21:28:50.679427 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 21:28:50.681069 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 21:28:50.681069 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 21:28:50.681069 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 21:28:50.681069 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 21:28:50.681069 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 21:28:50.681069 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 21:28:50.681069 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 21:28:50.681069 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jul 23 21:28:50.681069 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jul 23 21:28:50.681069 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 21:28:50.681069 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 21:28:50.681069 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 21:28:50.681069 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 21:28:50.681069 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 21:28:50.681069 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 21:28:50.681069 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 21:28:50.686837 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 21:28:50.686837 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 21:28:50.686837 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 21:28:50.686837 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 21:28:50.686837 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application with Lock( Jul 23 21:28:50.686837 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 21:28:50.686837 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._enter() Jul 23 21:28:50.686837 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 21:28:50.686837 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 21:28:50.686837 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 21:28:50.686837 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.creator() Jul 23 21:28:50.686837 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 21:28:50.686837 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application created_value = creator( Jul 23 21:28:50.686837 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 23 21:28:50.686837 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 23 21:28:50.686837 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 3aad61227e7a4c7193474598e4bcca39. Jul 23 21:28:50.686837 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 21:28:50.688729 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2293/4588] 10.222.0.17 () {60 vars in 1248 bytes} [Sat Jul 23 21:28:50 2022] PATCH /identity/v3/domains/3aad61227e7a4c7193474598e4bcca39 => generated 112 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 23 21:28:50.688831 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a916ec29-31b3-4161-8b12-a74b53ae9303 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:50.706685 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a916ec29-31b3-4161-8b12-a74b53ae9303 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:50.723972 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225cae33-b9b1-4645-b2c2-b7ab45a120de tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba8d06e121db4caf92ce215e16fc3324', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ccaff652d244cab7e5e736532f5c02', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:50.724925 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225cae33-b9b1-4645-b2c2-b7ab45a120de tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:50.726934 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225cae33-b9b1-4645-b2c2-b7ab45a120de tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:50.727418 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225cae33-b9b1-4645-b2c2-b7ab45a120de tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] PATH_INFO: `/v3/domains/a01c840a8f2a480c8e042aca1ef22f52` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:50.751015 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225cae33-b9b1-4645-b2c2-b7ab45a120de tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 21:28:50.763715 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-225cae33-b9b1-4645-b2c2-b7ab45a120de tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Could not find domain: a01c840a8f2a480c8e042aca1ef22f52.: keystone.exception.DomainNotFound: Could not find domain: a01c840a8f2a480c8e042aca1ef22f52. Jul 23 21:28:50.763715 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 21:28:50.763715 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 23 21:28:50.763715 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 23 21:28:50.763715 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 23 21:28:50.763715 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 23 21:28:50.763715 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 23 21:28:50.763715 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 23 21:28:50.763715 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: a01c840a8f2a480c8e042aca1ef22f52. Jul 23 21:28:50.763715 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 21:28:50.763715 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 23 21:28:50.763715 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 21:28:50.763715 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 21:28:50.763715 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 21:28:50.763715 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 21:28:50.763715 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 21:28:50.765185 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 21:28:50.765185 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 21:28:50.765185 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 21:28:50.765185 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 21:28:50.765185 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 21:28:50.765185 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 21:28:50.765185 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 21:28:50.765185 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jul 23 21:28:50.765185 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jul 23 21:28:50.765185 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 21:28:50.765185 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 21:28:50.765185 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 21:28:50.765185 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 21:28:50.765185 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 21:28:50.765185 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 21:28:50.765185 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 21:28:50.766605 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 21:28:50.766605 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 21:28:50.766605 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 21:28:50.766605 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 21:28:50.766605 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application with Lock( Jul 23 21:28:50.766605 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 21:28:50.766605 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._enter() Jul 23 21:28:50.766605 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 21:28:50.766605 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 21:28:50.766605 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 21:28:50.766605 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.creator() Jul 23 21:28:50.766605 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 21:28:50.766605 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application created_value = creator( Jul 23 21:28:50.766605 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 23 21:28:50.766605 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 23 21:28:50.766605 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: a01c840a8f2a480c8e042aca1ef22f52. Jul 23 21:28:50.766605 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 21:28:50.768563 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2296/4589] 10.222.0.17 () {60 vars in 1248 bytes} [Sat Jul 23 21:28:50 2022] PATCH /identity/v3/domains/a01c840a8f2a480c8e042aca1ef22f52 => generated 112 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 23 21:28:50.769603 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0bda74-287f-45e5-917e-097f98186408 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:50.785433 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0bda74-287f-45e5-917e-097f98186408 tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:50.802004 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25847007-60fe-4588-a92e-45aa12401ccd tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba8d06e121db4caf92ce215e16fc3324', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84ccaff652d244cab7e5e736532f5c02', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:50.803009 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25847007-60fe-4588-a92e-45aa12401ccd tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:50.803409 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25847007-60fe-4588-a92e-45aa12401ccd tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:50.803755 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25847007-60fe-4588-a92e-45aa12401ccd tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] PATH_INFO: `/v3/domains/07738135b8fe498fb1f10f873631e9f6` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:50.822064 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25847007-60fe-4588-a92e-45aa12401ccd tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 21:28:50.848853 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-25847007-60fe-4588-a92e-45aa12401ccd tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Could not find domain: 07738135b8fe498fb1f10f873631e9f6.: keystone.exception.DomainNotFound: Could not find domain: 07738135b8fe498fb1f10f873631e9f6. Jul 23 21:28:50.848853 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 21:28:50.848853 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 23 21:28:50.848853 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 23 21:28:50.848853 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 23 21:28:50.848853 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 23 21:28:50.848853 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 23 21:28:50.848853 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 23 21:28:50.848853 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 07738135b8fe498fb1f10f873631e9f6. Jul 23 21:28:50.848853 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 21:28:50.848853 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 23 21:28:50.848853 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 21:28:50.848853 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 21:28:50.848853 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 21:28:50.848853 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 21:28:50.848853 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 21:28:50.850345 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 21:28:50.850345 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 21:28:50.850345 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 21:28:50.850345 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 21:28:50.850345 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 21:28:50.850345 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 21:28:50.850345 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 21:28:50.850345 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jul 23 21:28:50.850345 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jul 23 21:28:50.850345 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 21:28:50.850345 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 21:28:50.850345 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 21:28:50.850345 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 21:28:50.850345 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 21:28:50.850345 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 21:28:50.850345 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 21:28:50.851795 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 21:28:50.851795 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 21:28:50.851795 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 21:28:50.851795 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 21:28:50.851795 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application with Lock( Jul 23 21:28:50.851795 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 21:28:50.851795 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._enter() Jul 23 21:28:50.851795 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 21:28:50.851795 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 21:28:50.851795 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 21:28:50.851795 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.creator() Jul 23 21:28:50.851795 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 21:28:50.851795 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application created_value = creator( Jul 23 21:28:50.851795 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 23 21:28:50.851795 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 23 21:28:50.851795 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 07738135b8fe498fb1f10f873631e9f6. Jul 23 21:28:50.851795 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 21:28:50.852949 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2294/4590] 10.222.0.17 () {60 vars in 1248 bytes} [Sat Jul 23 21:28:50 2022] PATCH /identity/v3/domains/07738135b8fe498fb1f10f873631e9f6 => generated 112 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 23 21:28:50.856199 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225cae33-b9b1-4645-b2c2-b7ab45a120de tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:50.860224 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-225cae33-b9b1-4645-b2c2-b7ab45a120de tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:50.883172 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15deb80-c9f0-458b-99a3-9a97030f5f3c None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:50.883817 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15deb80-c9f0-458b-99a3-9a97030f5f3c None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:50.884308 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15deb80-c9f0-458b-99a3-9a97030f5f3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:50.955480 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-c15deb80-c9f0-458b-99a3-9a97030f5f3c None None] MFA Rules not processed for user `896f9085718446cd90ce445c09be4741`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:28:50.958223 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-c15deb80-c9f0-458b-99a3-9a97030f5f3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:51.032228 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:28:51.066821 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225cae33-b9b1-4645-b2c2-b7ab45a120de tempest-TokensV3TestJSON-1658847551 tempest-TokensV3TestJSON-1658847551-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:51.073740 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df55f6da-7df4-4609-a295-8e3c3dbae2b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:51.075242 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df55f6da-7df4-4609-a295-8e3c3dbae2b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:51.075680 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df55f6da-7df4-4609-a295-8e3c3dbae2b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:51.076171 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df55f6da-7df4-4609-a295-8e3c3dbae2b1 admin admin] PATH_INFO: `/v3/users/09023cf9fa874a70818346601874844a` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:51.077731 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df55f6da-7df4-4609-a295-8e3c3dbae2b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=09023cf9fa874a70818346601874844a)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:51.080117 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df55f6da-7df4-4609-a295-8e3c3dbae2b1 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:51.166808 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2295/4591] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:28:50 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:28:51.178311 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c057983-8ac3-4c83-a407-06d2ddfe0dde None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:51.178771 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c057983-8ac3-4c83-a407-06d2ddfe0dde None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:51.179278 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c057983-8ac3-4c83-a407-06d2ddfe0dde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:51.208898 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-df55f6da-7df4-4609-a295-8e3c3dbae2b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09023cf9fa874a70818346601874844a'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:51.221719 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-9c057983-8ac3-4c83-a407-06d2ddfe0dde None None] MFA Rules not processed for user `896f9085718446cd90ce445c09be4741`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:28:51.223485 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-9c057983-8ac3-4c83-a407-06d2ddfe0dde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:51.224507 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-df55f6da-7df4-4609-a295-8e3c3dbae2b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09023cf9fa874a70818346601874844a'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:51.226031 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-df55f6da-7df4-4609-a295-8e3c3dbae2b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09023cf9fa874a70818346601874844a'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:51.245223 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-df55f6da-7df4-4609-a295-8e3c3dbae2b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09023cf9fa874a70818346601874844a'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:51.250387 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2296/4592] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:28:51 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:28:51.268742 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-df55f6da-7df4-4609-a295-8e3c3dbae2b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09023cf9fa874a70818346601874844a'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:51.285454 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2297/4593] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:28:50 2022] DELETE /identity/v3/users/09023cf9fa874a70818346601874844a => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:28:51.288284 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10e588a-edf7-4649-9c15-3815a7f0b893 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:51.289009 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10e588a-edf7-4649-9c15-3815a7f0b893 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:51.289385 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10e588a-edf7-4649-9c15-3815a7f0b893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:51.328692 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-a10e588a-edf7-4649-9c15-3815a7f0b893 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:28:51.330078 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-a10e588a-edf7-4649-9c15-3815a7f0b893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:51.435023 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2297/4594] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:28:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:28:51.468432 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df55f6da-7df4-4609-a295-8e3c3dbae2b1 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:51.470035 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-df55f6da-7df4-4609-a295-8e3c3dbae2b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:51.595814 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df55f6da-7df4-4609-a295-8e3c3dbae2b1 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:51.616289 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e7601b-0295-4e04-9ba2-e8782feccb75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:51.617004 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e7601b-0295-4e04-9ba2-e8782feccb75 service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:51.617301 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e7601b-0295-4e04-9ba2-e8782feccb75 service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:51.617591 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e7601b-0295-4e04-9ba2-e8782feccb75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:51.632648 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e7601b-0295-4e04-9ba2-e8782feccb75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:51.634515 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e7601b-0295-4e04-9ba2-e8782feccb75 service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:51.670410 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2298/4595] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:28:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:28:51.695570 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10e588a-edf7-4649-9c15-3815a7f0b893 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:51.697010 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-a10e588a-edf7-4649-9c15-3815a7f0b893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:51.829176 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:28:51.907796 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10e588a-edf7-4649-9c15-3815a7f0b893 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:51.921287 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1c8ed7-e8e0-4301-9901-37bb4cb9cff7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:51.922349 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1c8ed7-e8e0-4301-9901-37bb4cb9cff7 service nova] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:51.922795 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1c8ed7-e8e0-4301-9901-37bb4cb9cff7 service nova] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:51.923236 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1c8ed7-e8e0-4301-9901-37bb4cb9cff7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:51.927260 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-8f1c8ed7-e8e0-4301-9901-37bb4cb9cff7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:52.067982 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1c8ed7-e8e0-4301-9901-37bb4cb9cff7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:52.070248 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1c8ed7-e8e0-4301-9901-37bb4cb9cff7 service nova] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:52.101103 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2298/4596] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:28:51 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:28:52.430917 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e7601b-0295-4e04-9ba2-e8782feccb75 service neutron] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:52.433793 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-e6e7601b-0295-4e04-9ba2-e8782feccb75 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:52.458898 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e7601b-0295-4e04-9ba2-e8782feccb75 service neutron] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:52.471962 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa06415-399d-499e-9eec-3cce9bd520d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:52.473186 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa06415-399d-499e-9eec-3cce9bd520d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:52.473472 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa06415-399d-499e-9eec-3cce9bd520d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:52.473792 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa06415-399d-499e-9eec-3cce9bd520d2 admin admin] PATH_INFO: `/v3/projects/29cbff2323bf4e599627ba18f23ad04a` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:52.475598 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa06415-399d-499e-9eec-3cce9bd520d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=29cbff2323bf4e599627ba18f23ad04a)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:52.479136 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa06415-399d-499e-9eec-3cce9bd520d2 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:52.599405 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-cfa06415-399d-499e-9eec-3cce9bd520d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29cbff2323bf4e599627ba18f23ad04a', 'request_id': 'req-cfa06415-399d-499e-9eec-3cce9bd520d2'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:52.610651 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-cfa06415-399d-499e-9eec-3cce9bd520d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29cbff2323bf4e599627ba18f23ad04a', 'request_id': 'req-cfa06415-399d-499e-9eec-3cce9bd520d2'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:52.621169 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-cfa06415-399d-499e-9eec-3cce9bd520d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29cbff2323bf4e599627ba18f23ad04a', 'request_id': 'req-cfa06415-399d-499e-9eec-3cce9bd520d2'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:52.631281 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:28:52.640600 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-cfa06415-399d-499e-9eec-3cce9bd520d2 admin admin] The token cache is being invalidate because project 29cbff2323bf4e599627ba18f23ad04a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:28:52.640971 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-cfa06415-399d-499e-9eec-3cce9bd520d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:52.642083 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-cfa06415-399d-499e-9eec-3cce9bd520d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:52.646440 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2299/4597] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:28:52 2022] DELETE /identity/v3/projects/29cbff2323bf4e599627ba18f23ad04a => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:28:52.649389 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1c8ed7-e8e0-4301-9901-37bb4cb9cff7 service nova] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:52.669473 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1c8ed7-e8e0-4301-9901-37bb4cb9cff7 service nova] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:52.755462 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d66db0-f74a-4bda-b168-168618ae2ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:52.756748 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d66db0-f74a-4bda-b168-168618ae2ad6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:52.756886 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d66db0-f74a-4bda-b168-168618ae2ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:52.757239 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d66db0-f74a-4bda-b168-168618ae2ad6 admin admin] PATH_INFO: `/v3/users/ba8d06e121db4caf92ce215e16fc3324` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:52.759569 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d66db0-f74a-4bda-b168-168618ae2ad6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba8d06e121db4caf92ce215e16fc3324)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:52.763049 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d66db0-f74a-4bda-b168-168618ae2ad6 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:52.862189 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c6d66db0-f74a-4bda-b168-168618ae2ad6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba8d06e121db4caf92ce215e16fc3324'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:52.864504 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c6d66db0-f74a-4bda-b168-168618ae2ad6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba8d06e121db4caf92ce215e16fc3324'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:52.874237 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c6d66db0-f74a-4bda-b168-168618ae2ad6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba8d06e121db4caf92ce215e16fc3324'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:52.891486 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c6d66db0-f74a-4bda-b168-168618ae2ad6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba8d06e121db4caf92ce215e16fc3324'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:52.905039 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c6d66db0-f74a-4bda-b168-168618ae2ad6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba8d06e121db4caf92ce215e16fc3324'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:52.909321 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:28:52.917997 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2299/4598] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:28:52 2022] DELETE /identity/v3/users/ba8d06e121db4caf92ce215e16fc3324 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:28:53.337288 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa06415-399d-499e-9eec-3cce9bd520d2 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:53.340213 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-cfa06415-399d-499e-9eec-3cce9bd520d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:53.585414 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa06415-399d-499e-9eec-3cce9bd520d2 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:53.692469 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eb60d2-ed3d-4c13-bc57-251c898c67d2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc719a3b3ac4461b82ca04ab6451d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:53.693533 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eb60d2-ed3d-4c13-bc57-251c898c67d2 service placement] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:53.694048 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eb60d2-ed3d-4c13-bc57-251c898c67d2 service placement] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:53.694487 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eb60d2-ed3d-4c13-bc57-251c898c67d2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:53.698512 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-87eb60d2-ed3d-4c13-bc57-251c898c67d2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:53.718740 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87eb60d2-ed3d-4c13-bc57-251c898c67d2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:53.720362 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87eb60d2-ed3d-4c13-bc57-251c898c67d2 service placement] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:53.760536 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2300/4599] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:28:53 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:28:54.628516 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d66db0-f74a-4bda-b168-168618ae2ad6 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:54.631053 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-c6d66db0-f74a-4bda-b168-168618ae2ad6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:54.789410 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d66db0-f74a-4bda-b168-168618ae2ad6 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:54.799936 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d159928-a5cc-4aad-84b8-8d675b7a51e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:54.800874 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d159928-a5cc-4aad-84b8-8d675b7a51e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:54.801165 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d159928-a5cc-4aad-84b8-8d675b7a51e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:54.801440 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d159928-a5cc-4aad-84b8-8d675b7a51e0 admin admin] PATH_INFO: `/v3/projects/84ccaff652d244cab7e5e736532f5c02` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:54.805317 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d159928-a5cc-4aad-84b8-8d675b7a51e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84ccaff652d244cab7e5e736532f5c02)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:54.807402 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d159928-a5cc-4aad-84b8-8d675b7a51e0 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:54.947409 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-8d159928-a5cc-4aad-84b8-8d675b7a51e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84ccaff652d244cab7e5e736532f5c02', 'request_id': 'req-8d159928-a5cc-4aad-84b8-8d675b7a51e0'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:54.988463 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-8d159928-a5cc-4aad-84b8-8d675b7a51e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84ccaff652d244cab7e5e736532f5c02', 'request_id': 'req-8d159928-a5cc-4aad-84b8-8d675b7a51e0'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:55.000275 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-8d159928-a5cc-4aad-84b8-8d675b7a51e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84ccaff652d244cab7e5e736532f5c02', 'request_id': 'req-8d159928-a5cc-4aad-84b8-8d675b7a51e0'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:55.052306 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-8d159928-a5cc-4aad-84b8-8d675b7a51e0 admin admin] The token cache is being invalidate because project 84ccaff652d244cab7e5e736532f5c02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:28:55.052306 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-8d159928-a5cc-4aad-84b8-8d675b7a51e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:55.053519 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-8d159928-a5cc-4aad-84b8-8d675b7a51e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:55.056761 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2300/4600] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:28:54 2022] DELETE /identity/v3/projects/84ccaff652d244cab7e5e736532f5c02 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:28:55.060623 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eb60d2-ed3d-4c13-bc57-251c898c67d2 service placement] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:55.097089 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d159928-a5cc-4aad-84b8-8d675b7a51e0 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:55.097995 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eb60d2-ed3d-4c13-bc57-251c898c67d2 service placement] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:55.102062 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-8d159928-a5cc-4aad-84b8-8d675b7a51e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:55.232611 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d159928-a5cc-4aad-84b8-8d675b7a51e0 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:55.246670 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13022e30-3017-4797-af20-0650e29117b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:55.248410 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13022e30-3017-4797-af20-0650e29117b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:55.248410 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13022e30-3017-4797-af20-0650e29117b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:55.248410 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13022e30-3017-4797-af20-0650e29117b1 admin admin] PATH_INFO: `/v3/users/0400e6ceebf44a04ab61bb854778a345` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:55.250749 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13022e30-3017-4797-af20-0650e29117b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0400e6ceebf44a04ab61bb854778a345)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:55.256444 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13022e30-3017-4797-af20-0650e29117b1 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:55.330810 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:28:55.377487 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3353a6-d33c-4968-bf7a-b513c36931bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:55.378343 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3353a6-d33c-4968-bf7a-b513c36931bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:55.378631 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3353a6-d33c-4968-bf7a-b513c36931bb admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:55.378904 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3353a6-d33c-4968-bf7a-b513c36931bb admin admin] PATH_INFO: `/v3/users/01d27c973c614c72be15f495dc0a77eb` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:55.382621 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3353a6-d33c-4968-bf7a-b513c36931bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=01d27c973c614c72be15f495dc0a77eb)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:55.384842 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3353a6-d33c-4968-bf7a-b513c36931bb admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:55.402038 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-13022e30-3017-4797-af20-0650e29117b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0400e6ceebf44a04ab61bb854778a345'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:55.407545 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-13022e30-3017-4797-af20-0650e29117b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0400e6ceebf44a04ab61bb854778a345'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:55.439575 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-13022e30-3017-4797-af20-0650e29117b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0400e6ceebf44a04ab61bb854778a345'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:55.459047 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:28:55.466415 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-13022e30-3017-4797-af20-0650e29117b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0400e6ceebf44a04ab61bb854778a345'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:55.483721 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-6e3353a6-d33c-4968-bf7a-b513c36931bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01d27c973c614c72be15f495dc0a77eb'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:55.501316 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-6e3353a6-d33c-4968-bf7a-b513c36931bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01d27c973c614c72be15f495dc0a77eb'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:55.503964 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-6e3353a6-d33c-4968-bf7a-b513c36931bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01d27c973c614c72be15f495dc0a77eb'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:55.515071 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-13022e30-3017-4797-af20-0650e29117b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0400e6ceebf44a04ab61bb854778a345'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:55.525443 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-6e3353a6-d33c-4968-bf7a-b513c36931bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01d27c973c614c72be15f495dc0a77eb'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:55.533248 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2301/4601] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:28:55 2022] DELETE /identity/v3/users/0400e6ceebf44a04ab61bb854778a345 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:28:55.537584 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c233d93-8b04-492e-93cd-282562ed2841 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:55.538578 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c233d93-8b04-492e-93cd-282562ed2841 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:55.539502 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c233d93-8b04-492e-93cd-282562ed2841 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:55.562067 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-6e3353a6-d33c-4968-bf7a-b513c36931bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01d27c973c614c72be15f495dc0a77eb'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:55.582820 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2301/4602] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:28:55 2022] DELETE /identity/v3/users/01d27c973c614c72be15f495dc0a77eb => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:28:55.588948 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-4c233d93-8b04-492e-93cd-282562ed2841 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:28:55.590965 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-4c233d93-8b04-492e-93cd-282562ed2841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:55.803646 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2302/4603] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:28:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:28:55.931708 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3353a6-d33c-4968-bf7a-b513c36931bb admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:55.933314 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-6e3353a6-d33c-4968-bf7a-b513c36931bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:56.078628 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3353a6-d33c-4968-bf7a-b513c36931bb admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:56.087931 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa96b24f-635d-4d0c-8fd4-9a51c2b640a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:56.089977 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa96b24f-635d-4d0c-8fd4-9a51c2b640a9 service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:56.089977 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa96b24f-635d-4d0c-8fd4-9a51c2b640a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:56.089977 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa96b24f-635d-4d0c-8fd4-9a51c2b640a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:56.113232 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa96b24f-635d-4d0c-8fd4-9a51c2b640a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:56.116002 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa96b24f-635d-4d0c-8fd4-9a51c2b640a9 service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:56.136135 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2302/4604] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:28:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:28:56.303168 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c233d93-8b04-492e-93cd-282562ed2841 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:56.304725 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-4c233d93-8b04-492e-93cd-282562ed2841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:56.323773 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c233d93-8b04-492e-93cd-282562ed2841 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:56.338595 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef1547d-a4c3-4686-ba9b-2b1247780342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:56.339225 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef1547d-a4c3-4686-ba9b-2b1247780342 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:56.339503 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef1547d-a4c3-4686-ba9b-2b1247780342 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:56.339772 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef1547d-a4c3-4686-ba9b-2b1247780342 admin admin] PATH_INFO: `/v3/projects/8fa2fd3c28f449a8aba03173395139ad` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:56.342217 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef1547d-a4c3-4686-ba9b-2b1247780342 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8fa2fd3c28f449a8aba03173395139ad)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:56.344154 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef1547d-a4c3-4686-ba9b-2b1247780342 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:56.470756 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-3ef1547d-a4c3-4686-ba9b-2b1247780342 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8fa2fd3c28f449a8aba03173395139ad', 'request_id': 'req-3ef1547d-a4c3-4686-ba9b-2b1247780342'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:56.488773 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-3ef1547d-a4c3-4686-ba9b-2b1247780342 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8fa2fd3c28f449a8aba03173395139ad', 'request_id': 'req-3ef1547d-a4c3-4686-ba9b-2b1247780342'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:56.496920 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-3ef1547d-a4c3-4686-ba9b-2b1247780342 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8fa2fd3c28f449a8aba03173395139ad', 'request_id': 'req-3ef1547d-a4c3-4686-ba9b-2b1247780342'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:56.525720 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-3ef1547d-a4c3-4686-ba9b-2b1247780342 admin admin] The token cache is being invalidate because project 8fa2fd3c28f449a8aba03173395139ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:28:56.526049 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-3ef1547d-a4c3-4686-ba9b-2b1247780342 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:56.528438 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-3ef1547d-a4c3-4686-ba9b-2b1247780342 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:56.532884 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2303/4605] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:28:56 2022] DELETE /identity/v3/projects/8fa2fd3c28f449a8aba03173395139ad => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:28:56.537854 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9e14dc-d865-45fc-a4fb-347da116d58e None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:56.538165 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9e14dc-d865-45fc-a4fb-347da116d58e None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:56.540068 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9e14dc-d865-45fc-a4fb-347da116d58e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:56.575195 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-df9e14dc-d865-45fc-a4fb-347da116d58e None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:28:56.577980 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-df9e14dc-d865-45fc-a4fb-347da116d58e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:56.717672 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef1547d-a4c3-4686-ba9b-2b1247780342 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:56.719440 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-3ef1547d-a4c3-4686-ba9b-2b1247780342 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:56.786961 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:28:56.819767 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2303/4606] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:28:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:28:56.828045 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a898a63a-a6a7-4dbb-a672-a21883d82a13 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:56.828332 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a898a63a-a6a7-4dbb-a672-a21883d82a13 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:56.828609 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a898a63a-a6a7-4dbb-a672-a21883d82a13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:56.865088 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-a898a63a-a6a7-4dbb-a672-a21883d82a13 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:28:56.866496 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-a898a63a-a6a7-4dbb-a672-a21883d82a13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:56.871983 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef1547d-a4c3-4686-ba9b-2b1247780342 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:56.877908 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2304/4607] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:28:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:28:56.882446 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a898a63a-a6a7-4dbb-a672-a21883d82a13 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:56.884702 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429d7d54-1132-4ddf-81a1-b8af1f3acb6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:56.885602 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429d7d54-1132-4ddf-81a1-b8af1f3acb6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:56.885922 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429d7d54-1132-4ddf-81a1-b8af1f3acb6b admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:56.886170 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429d7d54-1132-4ddf-81a1-b8af1f3acb6b admin admin] PATH_INFO: `/v3/projects/bfc71a2fb00248ddbb06060c943fed5c` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:56.887646 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429d7d54-1132-4ddf-81a1-b8af1f3acb6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfc71a2fb00248ddbb06060c943fed5c)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:56.895035 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429d7d54-1132-4ddf-81a1-b8af1f3acb6b admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:56.899862 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a898a63a-a6a7-4dbb-a672-a21883d82a13 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:56.905270 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbfd057-961f-4902-b1f9-e0d74daa2282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:56.906367 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbfd057-961f-4902-b1f9-e0d74daa2282 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:56.906501 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbfd057-961f-4902-b1f9-e0d74daa2282 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:56.906800 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbfd057-961f-4902-b1f9-e0d74daa2282 admin admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:56.908037 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbfd057-961f-4902-b1f9-e0d74daa2282 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:28:56.908037 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbfd057-961f-4902-b1f9-e0d74daa2282 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:56.910362 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbfd057-961f-4902-b1f9-e0d74daa2282 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:56.931277 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2305/4608] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:28:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:28:56.935539 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbfd057-961f-4902-b1f9-e0d74daa2282 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:56.954188 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbfd057-961f-4902-b1f9-e0d74daa2282 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:56.962147 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01758087-af02-424b-8867-b0173c110876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:56.967717 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01758087-af02-424b-8867-b0173c110876 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:56.968164 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01758087-af02-424b-8867-b0173c110876 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:56.968311 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01758087-af02-424b-8867-b0173c110876 admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:56.969123 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01758087-af02-424b-8867-b0173c110876 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:56.971049 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01758087-af02-424b-8867-b0173c110876 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:56.991064 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-429d7d54-1132-4ddf-81a1-b8af1f3acb6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfc71a2fb00248ddbb06060c943fed5c', 'request_id': 'req-429d7d54-1132-4ddf-81a1-b8af1f3acb6b'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:57.033362 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-429d7d54-1132-4ddf-81a1-b8af1f3acb6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfc71a2fb00248ddbb06060c943fed5c', 'request_id': 'req-429d7d54-1132-4ddf-81a1-b8af1f3acb6b'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:57.045403 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2306/4609] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:28:56 2022] POST /identity/v3/projects => generated 369 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:28:57.047172 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01758087-af02-424b-8867-b0173c110876 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:57.048125 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-429d7d54-1132-4ddf-81a1-b8af1f3acb6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfc71a2fb00248ddbb06060c943fed5c', 'request_id': 'req-429d7d54-1132-4ddf-81a1-b8af1f3acb6b'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:57.072339 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-429d7d54-1132-4ddf-81a1-b8af1f3acb6b admin admin] The token cache is being invalidate because project bfc71a2fb00248ddbb06060c943fed5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:28:57.072634 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-429d7d54-1132-4ddf-81a1-b8af1f3acb6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:57.073411 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-429d7d54-1132-4ddf-81a1-b8af1f3acb6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:28:57.075672 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:28:57.077969 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2304/4610] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:28:56 2022] DELETE /identity/v3/projects/bfc71a2fb00248ddbb06060c943fed5c => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:28:57.083010 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38d19e9-d017-425f-af23-de07f7893956 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:57.085936 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38d19e9-d017-425f-af23-de07f7893956 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:57.089502 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38d19e9-d017-425f-af23-de07f7893956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:57.158524 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-b38d19e9-d017-425f-af23-de07f7893956 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:28:57.162492 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-b38d19e9-d017-425f-af23-de07f7893956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:57.230318 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01758087-af02-424b-8867-b0173c110876 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:57.244567 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e620de2c-d8b2-4361-8632-23dc74cf49bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:57.245681 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e620de2c-d8b2-4361-8632-23dc74cf49bf admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:57.246377 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e620de2c-d8b2-4361-8632-23dc74cf49bf admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:57.247723 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e620de2c-d8b2-4361-8632-23dc74cf49bf admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:57.248779 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e620de2c-d8b2-4361-8632-23dc74cf49bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:57.254686 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e620de2c-d8b2-4361-8632-23dc74cf49bf admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:57.306397 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2307/4611] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:28:57 2022] POST /identity/v3/users => generated 285 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:28:57.308505 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e620de2c-d8b2-4361-8632-23dc74cf49bf admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:57.313934 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-e620de2c-d8b2-4361-8632-23dc74cf49bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:57.321656 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2305/4612] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:28:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:28:57.331107 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17d6f9b-3e51-4545-b289-07715a412b48 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:57.331736 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17d6f9b-3e51-4545-b289-07715a412b48 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:57.332312 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17d6f9b-3e51-4545-b289-07715a412b48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:57.355232 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e620de2c-d8b2-4361-8632-23dc74cf49bf admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:57.366214 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d09b8e-55c2-41d9-8200-154049e5fa22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:57.366918 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d09b8e-55c2-41d9-8200-154049e5fa22 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:57.367200 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d09b8e-55c2-41d9-8200-154049e5fa22 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:57.367474 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d09b8e-55c2-41d9-8200-154049e5fa22 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:57.368399 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d09b8e-55c2-41d9-8200-154049e5fa22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:57.381132 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d09b8e-55c2-41d9-8200-154049e5fa22 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:57.389634 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-c17d6f9b-3e51-4545-b289-07715a412b48 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:28:57.391597 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-c17d6f9b-3e51-4545-b289-07715a412b48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:57.408814 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2308/4613] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:28:57 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:28:57.410665 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d09b8e-55c2-41d9-8200-154049e5fa22 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:57.422008 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2306/4614] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:28:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:28:57.426727 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17d6f9b-3e51-4545-b289-07715a412b48 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:57.453210 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d09b8e-55c2-41d9-8200-154049e5fa22 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:57.463478 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ba0797-23a4-4e73-aed9-e43fb610346a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:57.465185 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ba0797-23a4-4e73-aed9-e43fb610346a admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:57.465185 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ba0797-23a4-4e73-aed9-e43fb610346a admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:57.465185 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ba0797-23a4-4e73-aed9-e43fb610346a admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:57.466622 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ba0797-23a4-4e73-aed9-e43fb610346a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:57.466716 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17d6f9b-3e51-4545-b289-07715a412b48 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:57.469256 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ba0797-23a4-4e73-aed9-e43fb610346a admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:57.477680 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7a8f91-0bdf-4b5d-93f0-024a39baa2f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:57.478439 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7a8f91-0bdf-4b5d-93f0-024a39baa2f9 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:57.478666 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7a8f91-0bdf-4b5d-93f0-024a39baa2f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:57.479017 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7a8f91-0bdf-4b5d-93f0-024a39baa2f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:57.479665 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7a8f91-0bdf-4b5d-93f0-024a39baa2f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:28:57.479971 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7a8f91-0bdf-4b5d-93f0-024a39baa2f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:57.481593 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7a8f91-0bdf-4b5d-93f0-024a39baa2f9 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:57.494542 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2309/4615] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:28:57 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:28:57.495472 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ba0797-23a4-4e73-aed9-e43fb610346a admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:57.516220 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ba0797-23a4-4e73-aed9-e43fb610346a admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:57.518746 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2307/4616] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:28:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:28:57.523002 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7a8f91-0bdf-4b5d-93f0-024a39baa2f9 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:57.524997 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06571cf2-b036-4c16-9a42-a4484946c324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:57.525958 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06571cf2-b036-4c16-9a42-a4484946c324 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:57.526239 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06571cf2-b036-4c16-9a42-a4484946c324 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:57.526511 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06571cf2-b036-4c16-9a42-a4484946c324 admin admin] PATH_INFO: `/v3/projects/879105d7fbda4367969eefeabc330666/users/75cae2c37e77442c8f5433e611f5163e/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:57.538799 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7a8f91-0bdf-4b5d-93f0-024a39baa2f9 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:57.549262 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6accf573-ac03-4e34-9029-dd08652ebd39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:57.550156 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6accf573-ac03-4e34-9029-dd08652ebd39 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:57.550442 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6accf573-ac03-4e34-9029-dd08652ebd39 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:57.552900 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6accf573-ac03-4e34-9029-dd08652ebd39 admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:57.553826 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6accf573-ac03-4e34-9029-dd08652ebd39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:57.554896 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06571cf2-b036-4c16-9a42-a4484946c324 admin admin] RBAC: Authorizing `identity:create_grant(project_id=879105d7fbda4367969eefeabc330666, user_id=75cae2c37e77442c8f5433e611f5163e, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:57.557680 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06571cf2-b036-4c16-9a42-a4484946c324 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:57.560828 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6accf573-ac03-4e34-9029-dd08652ebd39 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:57.577299 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2310/4617] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:28:57 2022] PUT /identity/v3/projects/879105d7fbda4367969eefeabc330666/users/75cae2c37e77442c8f5433e611f5163e/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:28:57.596470 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eb7e39-52b6-4191-9a7d-5cf5451eb5cc None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:57.596746 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eb7e39-52b6-4191-9a7d-5cf5451eb5cc None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:57.597033 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eb7e39-52b6-4191-9a7d-5cf5451eb5cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:57.614980 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2308/4618] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:28:57 2022] POST /identity/v3/projects => generated 373 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:28:57.616053 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6accf573-ac03-4e34-9029-dd08652ebd39 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:57.646100 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:28:57.667854 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-96eb7e39-52b6-4191-9a7d-5cf5451eb5cc None None] MFA Rules not processed for user `75cae2c37e77442c8f5433e611f5163e`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:28:57.670350 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-96eb7e39-52b6-4191-9a7d-5cf5451eb5cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:57.728326 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6accf573-ac03-4e34-9029-dd08652ebd39 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:57.741744 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6b7eb6-09de-4e28-ab0d-9d8c7354eb08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:57.742601 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6b7eb6-09de-4e28-ab0d-9d8c7354eb08 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:57.743766 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6b7eb6-09de-4e28-ab0d-9d8c7354eb08 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:57.744826 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6b7eb6-09de-4e28-ab0d-9d8c7354eb08 admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:57.746691 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6b7eb6-09de-4e28-ab0d-9d8c7354eb08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:57.748868 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6b7eb6-09de-4e28-ab0d-9d8c7354eb08 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:57.791351 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2309/4619] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:28:57 2022] POST /identity/v3/users => generated 287 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:28:57.795860 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6b7eb6-09de-4e28-ab0d-9d8c7354eb08 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:57.822858 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6b7eb6-09de-4e28-ab0d-9d8c7354eb08 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:57.832777 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2311/4620] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:28:57 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:28:57.833718 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eb7e39-52b6-4191-9a7d-5cf5451eb5cc None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:57.841292 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00f6ec8-ab39-45f4-988c-09fb212cc4a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:57.842074 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00f6ec8-ab39-45f4-988c-09fb212cc4a3 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:57.842353 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00f6ec8-ab39-45f4-988c-09fb212cc4a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:57.842625 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00f6ec8-ab39-45f4-988c-09fb212cc4a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:57.843355 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00f6ec8-ab39-45f4-988c-09fb212cc4a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:57.844961 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00f6ec8-ab39-45f4-988c-09fb212cc4a3 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:57.859447 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eb7e39-52b6-4191-9a7d-5cf5451eb5cc None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:57.868000 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2310/4621] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:28:57 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:28:57.868974 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00f6ec8-ab39-45f4-988c-09fb212cc4a3 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:57.874451 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978830cf-17df-4b0d-a22c-a6380780b3e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:57.876924 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978830cf-17df-4b0d-a22c-a6380780b3e1 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:57.877470 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978830cf-17df-4b0d-a22c-a6380780b3e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:57.878021 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978830cf-17df-4b0d-a22c-a6380780b3e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:57.879800 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978830cf-17df-4b0d-a22c-a6380780b3e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:57.880580 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00f6ec8-ab39-45f4-988c-09fb212cc4a3 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:57.883037 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978830cf-17df-4b0d-a22c-a6380780b3e1 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:57.890086 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c0df05-e5b6-42a9-a479-314fb3d4d6e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:57.891086 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c0df05-e5b6-42a9-a479-314fb3d4d6e8 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:57.891470 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c0df05-e5b6-42a9-a479-314fb3d4d6e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:57.891707 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c0df05-e5b6-42a9-a479-314fb3d4d6e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:57.892465 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c0df05-e5b6-42a9-a479-314fb3d4d6e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:57.894147 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c0df05-e5b6-42a9-a479-314fb3d4d6e8 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:57.932004 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2311/4622] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:28:57 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:28:57.934455 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c0df05-e5b6-42a9-a479-314fb3d4d6e8 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:57.944546 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2312/4623] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:28:57 2022] POST /identity/v3/projects => generated 367 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:28:57.950363 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978830cf-17df-4b0d-a22c-a6380780b3e1 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:57.956702 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c0df05-e5b6-42a9-a479-314fb3d4d6e8 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:58.013554 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:28:58.099875 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122b2fa4-db62-45a4-a29a-2756c1c6a8f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:58.099875 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122b2fa4-db62-45a4-a29a-2756c1c6a8f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:58.099875 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122b2fa4-db62-45a4-a29a-2756c1c6a8f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:58.101911 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122b2fa4-db62-45a4-a29a-2756c1c6a8f0 admin admin] PATH_INFO: `/v3/projects/f99c3a6d103a449784f4a02a353b3980/users/6c26f9f04fd84c34b077ededc6de20de/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:58.113769 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978830cf-17df-4b0d-a22c-a6380780b3e1 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:58.120283 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f22adf-ae44-4e93-b8ba-2e6073fc8e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:58.121219 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f22adf-ae44-4e93-b8ba-2e6073fc8e61 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:58.121466 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f22adf-ae44-4e93-b8ba-2e6073fc8e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:58.121910 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f22adf-ae44-4e93-b8ba-2e6073fc8e61 admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:58.122955 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f22adf-ae44-4e93-b8ba-2e6073fc8e61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:58.125070 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f22adf-ae44-4e93-b8ba-2e6073fc8e61 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:58.127737 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122b2fa4-db62-45a4-a29a-2756c1c6a8f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f99c3a6d103a449784f4a02a353b3980, user_id=6c26f9f04fd84c34b077ededc6de20de, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:58.131618 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122b2fa4-db62-45a4-a29a-2756c1c6a8f0 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:58.161149 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2313/4624] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:28:57 2022] POST /identity/v3/users => generated 290 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:28:58.165691 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f22adf-ae44-4e93-b8ba-2e6073fc8e61 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:58.177992 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2312/4625] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:28:57 2022] PUT /identity/v3/projects/f99c3a6d103a449784f4a02a353b3980/users/6c26f9f04fd84c34b077ededc6de20de/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:28:58.180194 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35c3999-d793-4f71-8d5f-ddad3b413916 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:58.186089 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35c3999-d793-4f71-8d5f-ddad3b413916 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:58.186636 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35c3999-d793-4f71-8d5f-ddad3b413916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:58.194969 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f22adf-ae44-4e93-b8ba-2e6073fc8e61 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:58.224931 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-e35c3999-d793-4f71-8d5f-ddad3b413916 None None] MFA Rules not processed for user `6c26f9f04fd84c34b077ededc6de20de`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:28:58.226159 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-e35c3999-d793-4f71-8d5f-ddad3b413916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:58.290047 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e237ac-6f96-4ec2-82c6-8b9634a173f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:58.291113 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e237ac-6f96-4ec2-82c6-8b9634a173f7 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:58.291483 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e237ac-6f96-4ec2-82c6-8b9634a173f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:58.291885 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e237ac-6f96-4ec2-82c6-8b9634a173f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:58.295934 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e237ac-6f96-4ec2-82c6-8b9634a173f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:58.298906 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e237ac-6f96-4ec2-82c6-8b9634a173f7 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:58.323744 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2314/4626] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:28:58 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:28:58.325256 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e237ac-6f96-4ec2-82c6-8b9634a173f7 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:58.343664 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2313/4627] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:28:58 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:28:58.346982 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e237ac-6f96-4ec2-82c6-8b9634a173f7 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:58.358681 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a330ac1-ab89-4ca6-acc8-1ec0b0b08dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:58.373772 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a330ac1-ab89-4ca6-acc8-1ec0b0b08dab admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:58.374298 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a330ac1-ab89-4ca6-acc8-1ec0b0b08dab admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:58.374567 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a330ac1-ab89-4ca6-acc8-1ec0b0b08dab admin admin] PATH_INFO: `/v3/projects/fd2d040691b34adeb5ae75a50f416642/users/b077945a37bc4bf29f5c62b95ff45562/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:58.402686 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a330ac1-ab89-4ca6-acc8-1ec0b0b08dab admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd2d040691b34adeb5ae75a50f416642, user_id=b077945a37bc4bf29f5c62b95ff45562, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:58.406018 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a330ac1-ab89-4ca6-acc8-1ec0b0b08dab admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:58.409956 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35c3999-d793-4f71-8d5f-ddad3b413916 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:58.411995 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-e35c3999-d793-4f71-8d5f-ddad3b413916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:58.420013 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:28:58.460105 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2315/4628] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:28:58 2022] PUT /identity/v3/projects/fd2d040691b34adeb5ae75a50f416642/users/b077945a37bc4bf29f5c62b95ff45562/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:28:58.464287 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a330ac1-ab89-4ca6-acc8-1ec0b0b08dab admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:58.634376 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a330ac1-ab89-4ca6-acc8-1ec0b0b08dab admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:58.639718 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45e6ef1-735f-407e-8c3e-ce46d835bff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:58.640412 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45e6ef1-735f-407e-8c3e-ce46d835bff9 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:58.640690 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45e6ef1-735f-407e-8c3e-ce46d835bff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:58.641626 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45e6ef1-735f-407e-8c3e-ce46d835bff9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:58.642594 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45e6ef1-735f-407e-8c3e-ce46d835bff9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:58.647333 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45e6ef1-735f-407e-8c3e-ce46d835bff9 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:58.652532 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35c3999-d793-4f71-8d5f-ddad3b413916 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:58.675633 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2316/4629] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:28:58 2022] GET /identity/v3/roles => generated 1420 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:28:58.677324 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45e6ef1-735f-407e-8c3e-ce46d835bff9 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:58.702279 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45e6ef1-735f-407e-8c3e-ce46d835bff9 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:58.716219 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1969c7-f42b-4af3-b94d-9bfc6ac2d490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:58.717478 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1969c7-f42b-4af3-b94d-9bfc6ac2d490 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:58.717656 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1969c7-f42b-4af3-b94d-9bfc6ac2d490 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:58.717878 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1969c7-f42b-4af3-b94d-9bfc6ac2d490 admin admin] PATH_INFO: `/v3/projects/fd2d040691b34adeb5ae75a50f416642/users/b077945a37bc4bf29f5c62b95ff45562/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:58.731605 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1969c7-f42b-4af3-b94d-9bfc6ac2d490 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd2d040691b34adeb5ae75a50f416642, user_id=b077945a37bc4bf29f5c62b95ff45562, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:58.734271 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1969c7-f42b-4af3-b94d-9bfc6ac2d490 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:58.764326 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2317/4630] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:28:58 2022] PUT /identity/v3/projects/fd2d040691b34adeb5ae75a50f416642/users/b077945a37bc4bf29f5c62b95ff45562/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:28:58.774729 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b9a78a-4030-4e26-9c98-fb7b97654356 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:58.775023 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b9a78a-4030-4e26-9c98-fb7b97654356 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:58.775286 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b9a78a-4030-4e26-9c98-fb7b97654356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:58.799162 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3639b557-ce14-471d-89b3-495c9bfe3355 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:58.799872 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3639b557-ce14-471d-89b3-495c9bfe3355 service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:58.800150 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3639b557-ce14-471d-89b3-495c9bfe3355 service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:58.800425 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3639b557-ce14-471d-89b3-495c9bfe3355 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:58.805854 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:28:58.847045 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-d5b9a78a-4030-4e26-9c98-fb7b97654356 None None] MFA Rules not processed for user `b077945a37bc4bf29f5c62b95ff45562`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:28:58.848299 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-d5b9a78a-4030-4e26-9c98-fb7b97654356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:28:58.946595 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3639b557-ce14-471d-89b3-495c9bfe3355 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:58.950397 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3639b557-ce14-471d-89b3-495c9bfe3355 service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:58.974510 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2314/4631] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:28:58 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 565 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:28:59.010221 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2318/4632] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:28:58 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:28:59.015090 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3639b557-ce14-471d-89b3-495c9bfe3355 service neutron] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:59.200090 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3639b557-ce14-471d-89b3-495c9bfe3355 service neutron] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:59.206726 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513c0370-5055-4108-99f4-8b2eb5b96f73 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b077945a37bc4bf29f5c62b95ff45562', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd2d040691b34adeb5ae75a50f416642', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:59.207768 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513c0370-5055-4108-99f4-8b2eb5b96f73 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:59.208228 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513c0370-5055-4108-99f4-8b2eb5b96f73 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:59.208672 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513c0370-5055-4108-99f4-8b2eb5b96f73 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:59.209532 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513c0370-5055-4108-99f4-8b2eb5b96f73 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:59.211681 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513c0370-5055-4108-99f4-8b2eb5b96f73 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:59.265073 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:28:59.277438 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2315/4633] 10.222.0.17 () {60 vars in 1151 bytes} [Sat Jul 23 21:28:59 2022] POST /identity/v3/projects => generated 328 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:28:59.281831 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b9a78a-4030-4e26-9c98-fb7b97654356 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:59.297171 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b9a78a-4030-4e26-9c98-fb7b97654356 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:59.430501 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccdcd13-bc6f-47e9-8c4d-de180db65ba0 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b077945a37bc4bf29f5c62b95ff45562', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd2d040691b34adeb5ae75a50f416642', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:59.435026 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccdcd13-bc6f-47e9-8c4d-de180db65ba0 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:59.435361 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccdcd13-bc6f-47e9-8c4d-de180db65ba0 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:59.435599 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccdcd13-bc6f-47e9-8c4d-de180db65ba0 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:59.436608 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccdcd13-bc6f-47e9-8c4d-de180db65ba0 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:59.438525 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccdcd13-bc6f-47e9-8c4d-de180db65ba0 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:59.485459 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2319/4634] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:28:59 2022] POST /identity/v3/users => generated 413 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:28:59.490984 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513c0370-5055-4108-99f4-8b2eb5b96f73 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:59.512454 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513c0370-5055-4108-99f4-8b2eb5b96f73 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:59.521030 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ebbae5-9625-4758-9bde-5f5665fc3b73 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b077945a37bc4bf29f5c62b95ff45562', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd2d040691b34adeb5ae75a50f416642', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:59.521807 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ebbae5-9625-4758-9bde-5f5665fc3b73 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:59.522145 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ebbae5-9625-4758-9bde-5f5665fc3b73 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:59.522439 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ebbae5-9625-4758-9bde-5f5665fc3b73 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:59.523309 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ebbae5-9625-4758-9bde-5f5665fc3b73 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:59.524928 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ebbae5-9625-4758-9bde-5f5665fc3b73 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:59.554237 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2316/4635] 10.222.0.17 () {60 vars in 1142 bytes} [Sat Jul 23 21:28:59 2022] POST /identity/v3/roles => generated 242 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:28:59.558298 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccdcd13-bc6f-47e9-8c4d-de180db65ba0 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:59.573769 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccdcd13-bc6f-47e9-8c4d-de180db65ba0 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:59.581352 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b464cdd5-fcf0-4ac8-a8c7-957f8da35551 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b077945a37bc4bf29f5c62b95ff45562', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd2d040691b34adeb5ae75a50f416642', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:59.582386 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b464cdd5-fcf0-4ac8-a8c7-957f8da35551 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:59.582742 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b464cdd5-fcf0-4ac8-a8c7-957f8da35551 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:59.583084 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b464cdd5-fcf0-4ac8-a8c7-957f8da35551 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:59.583916 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b464cdd5-fcf0-4ac8-a8c7-957f8da35551 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:59.586102 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b464cdd5-fcf0-4ac8-a8c7-957f8da35551 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:59.617383 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2320/4636] 10.222.0.17 () {60 vars in 1142 bytes} [Sat Jul 23 21:28:59 2022] POST /identity/v3/roles => generated 247 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:28:59.618873 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ebbae5-9625-4758-9bde-5f5665fc3b73 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:59.637504 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ebbae5-9625-4758-9bde-5f5665fc3b73 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:59.657270 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506cc7c4-4072-4f34-8ff1-c9500b9d950b tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b077945a37bc4bf29f5c62b95ff45562', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd2d040691b34adeb5ae75a50f416642', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:59.658798 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506cc7c4-4072-4f34-8ff1-c9500b9d950b tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:59.658798 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506cc7c4-4072-4f34-8ff1-c9500b9d950b tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:59.659599 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506cc7c4-4072-4f34-8ff1-c9500b9d950b tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] PATH_INFO: `/v3/projects/547311c8578a4914a11900114088db14/users/23fd4a57a8164fdf811ffb64df3b8953/roles/c6628af4f79c4f799b41b97289c0c8c6` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:59.679913 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506cc7c4-4072-4f34-8ff1-c9500b9d950b tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: Authorizing `identity:create_grant(project_id=547311c8578a4914a11900114088db14, user_id=23fd4a57a8164fdf811ffb64df3b8953, role_id=c6628af4f79c4f799b41b97289c0c8c6)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:59.683555 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506cc7c4-4072-4f34-8ff1-c9500b9d950b tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:59.711613 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2317/4637] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:28:59 2022] PUT /identity/v3/projects/547311c8578a4914a11900114088db14/users/23fd4a57a8164fdf811ffb64df3b8953/roles/c6628af4f79c4f799b41b97289c0c8c6 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:28:59.711866 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b464cdd5-fcf0-4ac8-a8c7-957f8da35551 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:59.728245 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b464cdd5-fcf0-4ac8-a8c7-957f8da35551 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:59.854398 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c560cd81-91c4-4b2f-a270-98337bffad83 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b077945a37bc4bf29f5c62b95ff45562', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd2d040691b34adeb5ae75a50f416642', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:59.856415 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c560cd81-91c4-4b2f-a270-98337bffad83 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:59.856844 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c560cd81-91c4-4b2f-a270-98337bffad83 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:59.857058 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c560cd81-91c4-4b2f-a270-98337bffad83 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] PATH_INFO: `/v3/projects/547311c8578a4914a11900114088db14/users/23fd4a57a8164fdf811ffb64df3b8953/roles/77b764cbdc6a4abda88cff1cd74ac3b0` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:59.860966 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c560cd81-91c4-4b2f-a270-98337bffad83 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: Authorizing `identity:create_grant(project_id=547311c8578a4914a11900114088db14, user_id=23fd4a57a8164fdf811ffb64df3b8953, role_id=77b764cbdc6a4abda88cff1cd74ac3b0)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:59.866140 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c560cd81-91c4-4b2f-a270-98337bffad83 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:28:59.900847 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2321/4638] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:28:59 2022] PUT /identity/v3/projects/547311c8578a4914a11900114088db14/users/23fd4a57a8164fdf811ffb64df3b8953/roles/77b764cbdc6a4abda88cff1cd74ac3b0 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:28:59.904842 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506cc7c4-4072-4f34-8ff1-c9500b9d950b tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:28:59.923438 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506cc7c4-4072-4f34-8ff1-c9500b9d950b tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:28:59.996027 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feab02e8-db79-4284-8cf2-18d7505561b5 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b077945a37bc4bf29f5c62b95ff45562', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd2d040691b34adeb5ae75a50f416642', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:28:59.996027 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feab02e8-db79-4284-8cf2-18d7505561b5 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:28:59.996854 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feab02e8-db79-4284-8cf2-18d7505561b5 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:28:59.996854 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feab02e8-db79-4284-8cf2-18d7505561b5 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:28:59.997645 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feab02e8-db79-4284-8cf2-18d7505561b5 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:28:59.998881 ncdv-master-1 devstack@keystone.service[91548]: WARNING py.warnings [None req-feab02e8-db79-4284-8cf2-18d7505561b5 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:28:59.998881 ncdv-master-1 devstack@keystone.service[91548]: warnings.warn(msg) Jul 23 21:28:59.998881 ncdv-master-1 devstack@keystone.service[91548]: Jul 23 21:29:00.000034 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feab02e8-db79-4284-8cf2-18d7505561b5 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:00.050942 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2318/4639] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:28:59 2022] GET /identity/v3/users => generated 8352 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:29:00.055917 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ae8452-952e-4ff7-9b32-0c32e4798cde None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:00.056204 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ae8452-952e-4ff7-9b32-0c32e4798cde None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:00.056477 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ae8452-952e-4ff7-9b32-0c32e4798cde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:00.065172 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:29:00.127277 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-d3ae8452-952e-4ff7-9b32-0c32e4798cde None None] MFA Rules not processed for user `23fd4a57a8164fdf811ffb64df3b8953`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:29:00.129019 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-d3ae8452-952e-4ff7-9b32-0c32e4798cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:00.258007 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2322/4640] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:29:00 2022] POST /identity/v3/auth/tokens => generated 3267 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:29:00.260442 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2231b2-c0ba-4119-8290-884a35380c53 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:00.260774 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2231b2-c0ba-4119-8290-884a35380c53 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:00.261345 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2231b2-c0ba-4119-8290-884a35380c53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:00.297972 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-bd2231b2-c0ba-4119-8290-884a35380c53 None None] MFA Rules not processed for user `23fd4a57a8164fdf811ffb64df3b8953`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:29:00.299400 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-bd2231b2-c0ba-4119-8290-884a35380c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:00.310104 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2319/4641] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:29:00 2022] POST /identity/v3/auth/tokens => generated 3267 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:29:00.311624 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ae8452-952e-4ff7-9b32-0c32e4798cde None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:00.325120 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ae8452-952e-4ff7-9b32-0c32e4798cde None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:00.330786 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c73e516-e8ba-485f-b079-c467e814800f tempest-TrustsV3TestJSON-318535794 tempest-user-929254261] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23fd4a57a8164fdf811ffb64df3b8953', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '547311c8578a4914a11900114088db14', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-76405029', 'tempest-NotDelegatedRole-1851880069'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:00.331712 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c73e516-e8ba-485f-b079-c467e814800f tempest-TrustsV3TestJSON-318535794 tempest-user-929254261] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:00.331997 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c73e516-e8ba-485f-b079-c467e814800f tempest-TrustsV3TestJSON-318535794 tempest-user-929254261] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:00.332267 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c73e516-e8ba-485f-b079-c467e814800f tempest-TrustsV3TestJSON-318535794 tempest-user-929254261] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:00.333020 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c73e516-e8ba-485f-b079-c467e814800f tempest-TrustsV3TestJSON-318535794 tempest-user-929254261] RBAC: Authorizing `identity:create_trust()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:00.334959 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c73e516-e8ba-485f-b079-c467e814800f tempest-TrustsV3TestJSON-318535794 tempest-user-929254261] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:00.352569 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2231b2-c0ba-4119-8290-884a35380c53 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:00.438069 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2323/4642] 10.222.0.17 () {60 vars in 1173 bytes} [Sat Jul 23 21:29:00 2022] POST /identity/v3/OS-TRUST/trusts => generated 832 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:29:00.441496 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c73e516-e8ba-485f-b079-c467e814800f tempest-TrustsV3TestJSON-318535794 tempest-user-929254261] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:00.463306 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2231b2-c0ba-4119-8290-884a35380c53 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:00.465008 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c73e516-e8ba-485f-b079-c467e814800f tempest-TrustsV3TestJSON-318535794 tempest-user-929254261] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:00.470342 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcdef9e-0804-478f-b0a3-1eee610a1b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:00.471266 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcdef9e-0804-478f-b0a3-1eee610a1b36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:00.471542 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcdef9e-0804-478f-b0a3-1eee610a1b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:00.471812 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcdef9e-0804-478f-b0a3-1eee610a1b36 admin admin] PATH_INFO: `/v3/users/6c26f9f04fd84c34b077ededc6de20de` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:00.472286 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ee2cf1-e735-453f-a971-0f5b7a745f7d tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b077945a37bc4bf29f5c62b95ff45562', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd2d040691b34adeb5ae75a50f416642', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:00.473226 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcdef9e-0804-478f-b0a3-1eee610a1b36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c26f9f04fd84c34b077ededc6de20de)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:00.473389 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ee2cf1-e735-453f-a971-0f5b7a745f7d tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:00.473726 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ee2cf1-e735-453f-a971-0f5b7a745f7d tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:00.475070 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ee2cf1-e735-453f-a971-0f5b7a745f7d tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:00.475198 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcdef9e-0804-478f-b0a3-1eee610a1b36 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:00.482271 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ee2cf1-e735-453f-a971-0f5b7a745f7d tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: Authorizing `identity:list_trusts()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:00.484333 ncdv-master-1 devstack@keystone.service[91547]: WARNING py.warnings [None req-67ee2cf1-e735-453f-a971-0f5b7a745f7d tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_trusts": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:29:00.484333 ncdv-master-1 devstack@keystone.service[91547]: warnings.warn(msg) Jul 23 21:29:00.484333 ncdv-master-1 devstack@keystone.service[91547]: Jul 23 21:29:00.485458 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ee2cf1-e735-453f-a971-0f5b7a745f7d tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:00.502438 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2324/4643] 10.222.0.17 () {58 vars in 1154 bytes} [Sat Jul 23 21:29:00 2022] GET /identity/v3/OS-TRUST/trusts/ => generated 562 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 21:29:00.510509 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ee2cf1-e735-453f-a971-0f5b7a745f7d tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:00.530488 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ee2cf1-e735-453f-a971-0f5b7a745f7d tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:00.535924 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350efc70-ab44-4306-a9c3-8e81835642b4 tempest-TrustsV3TestJSON-318535794 tempest-user-929254261] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23fd4a57a8164fdf811ffb64df3b8953', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '547311c8578a4914a11900114088db14', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-76405029', 'tempest-NotDelegatedRole-1851880069'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:00.539007 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350efc70-ab44-4306-a9c3-8e81835642b4 tempest-TrustsV3TestJSON-318535794 tempest-user-929254261] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:00.539523 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350efc70-ab44-4306-a9c3-8e81835642b4 tempest-TrustsV3TestJSON-318535794 tempest-user-929254261] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:00.540157 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350efc70-ab44-4306-a9c3-8e81835642b4 tempest-TrustsV3TestJSON-318535794 tempest-user-929254261] PATH_INFO: `/v3/OS-TRUST/trusts/e8cf653981b04e21a067adc93571ef54` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:00.554144 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-8dcdef9e-0804-478f-b0a3-1eee610a1b36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c26f9f04fd84c34b077ededc6de20de'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:00.555035 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-8dcdef9e-0804-478f-b0a3-1eee610a1b36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c26f9f04fd84c34b077ededc6de20de'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:00.565446 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350efc70-ab44-4306-a9c3-8e81835642b4 tempest-TrustsV3TestJSON-318535794 tempest-user-929254261] RBAC: Authorizing `identity:delete_trust(trust_id=e8cf653981b04e21a067adc93571ef54)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:00.566432 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:29:00.568544 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350efc70-ab44-4306-a9c3-8e81835642b4 tempest-TrustsV3TestJSON-318535794 tempest-user-929254261] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:00.575057 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-8dcdef9e-0804-478f-b0a3-1eee610a1b36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c26f9f04fd84c34b077ededc6de20de'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:00.605023 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-350efc70-ab44-4306-a9c3-8e81835642b4 tempest-TrustsV3TestJSON-318535794 tempest-user-929254261] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'e8cf653981b04e21a067adc93571ef54', 'request_id': 'req-350efc70-ab44-4306-a9c3-8e81835642b4'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:00.607242 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-350efc70-ab44-4306-a9c3-8e81835642b4 tempest-TrustsV3TestJSON-318535794 tempest-user-929254261] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': 'e8cf653981b04e21a067adc93571ef54', 'request_id': 'req-350efc70-ab44-4306-a9c3-8e81835642b4'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:00.619781 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-8dcdef9e-0804-478f-b0a3-1eee610a1b36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c26f9f04fd84c34b077ededc6de20de'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:00.633730 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-350efc70-ab44-4306-a9c3-8e81835642b4 tempest-TrustsV3TestJSON-318535794 tempest-user-929254261] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'e8cf653981b04e21a067adc93571ef54', 'request_id': 'req-350efc70-ab44-4306-a9c3-8e81835642b4'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:00.657407 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2325/4644] 10.222.0.17 () {58 vars in 1253 bytes} [Sat Jul 23 21:29:00 2022] DELETE /identity/v3/OS-TRUST/trusts/e8cf653981b04e21a067adc93571ef54 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:29:00.658400 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-8dcdef9e-0804-478f-b0a3-1eee610a1b36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c26f9f04fd84c34b077ededc6de20de'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:00.660624 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350efc70-ab44-4306-a9c3-8e81835642b4 tempest-TrustsV3TestJSON-318535794 tempest-user-929254261] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:00.666855 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-350efc70-ab44-4306-a9c3-8e81835642b4 tempest-TrustsV3TestJSON-318535794 tempest-user-929254261] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:00.683174 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2320/4645] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:29:00 2022] DELETE /identity/v3/users/6c26f9f04fd84c34b077ededc6de20de => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:29:00.694710 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e554719-87f6-42b2-b06b-a24f889f5054 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:00.694974 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e554719-87f6-42b2-b06b-a24f889f5054 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:00.695225 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e554719-87f6-42b2-b06b-a24f889f5054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:00.713562 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350efc70-ab44-4306-a9c3-8e81835642b4 tempest-TrustsV3TestJSON-318535794 tempest-user-929254261] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:00.742580 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-4e554719-87f6-42b2-b06b-a24f889f5054 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:29:00.751825 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-4e554719-87f6-42b2-b06b-a24f889f5054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:00.806618 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:UPDATE=1,keystone:DELETE=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:29:00.887990 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abb8171-c6a0-422e-9df0-5f2908fc9ac2 tempest-TrustsV3TestJSON-318535794 tempest-user-929254261] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23fd4a57a8164fdf811ffb64df3b8953', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '547311c8578a4914a11900114088db14', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-76405029', 'tempest-NotDelegatedRole-1851880069'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:00.887990 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abb8171-c6a0-422e-9df0-5f2908fc9ac2 tempest-TrustsV3TestJSON-318535794 tempest-user-929254261] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:00.887990 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abb8171-c6a0-422e-9df0-5f2908fc9ac2 tempest-TrustsV3TestJSON-318535794 tempest-user-929254261] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:00.888453 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abb8171-c6a0-422e-9df0-5f2908fc9ac2 tempest-TrustsV3TestJSON-318535794 tempest-user-929254261] PATH_INFO: `/v3/OS-TRUST/trusts/e8cf653981b04e21a067adc93571ef54` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:00.897851 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2321/4646] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:29:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:29:00.929706 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e554719-87f6-42b2-b06b-a24f889f5054 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:00.931690 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-3abb8171-c6a0-422e-9df0-5f2908fc9ac2 tempest-TrustsV3TestJSON-318535794 tempest-user-929254261] Could not find trust: e8cf653981b04e21a067adc93571ef54.: keystone.exception.TrustNotFound: Could not find trust: e8cf653981b04e21a067adc93571ef54. Jul 23 21:29:00.931690 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 21:29:00.931690 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 21:29:00.931690 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 21:29:00.931690 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 21:29:00.931690 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 21:29:00.931690 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 21:29:00.931690 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 21:29:00.931690 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 21:29:00.931690 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 21:29:00.931690 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 21:29:00.931690 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 21:29:00.931690 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Jul 23 21:29:00.931690 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Jul 23 21:29:00.931690 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Jul 23 21:29:00.933129 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Jul 23 21:29:00.933129 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Jul 23 21:29:00.933129 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Jul 23 21:29:00.933129 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Jul 23 21:29:00.933129 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Jul 23 21:29:00.933129 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 21:29:00.933129 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 21:29:00.933129 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Jul 23 21:29:00.933129 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Jul 23 21:29:00.933129 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Jul 23 21:29:00.933129 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Jul 23 21:29:00.933129 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: e8cf653981b04e21a067adc93571ef54. Jul 23 21:29:00.933129 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 21:29:00.934337 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2326/4647] 10.222.0.17 () {58 vars in 1250 bytes} [Sat Jul 23 21:29:00 2022] GET /identity/v3/OS-TRUST/trusts/e8cf653981b04e21a067adc93571ef54 => generated 111 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 23 21:29:00.934896 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-4e554719-87f6-42b2-b06b-a24f889f5054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:00.937383 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abb8171-c6a0-422e-9df0-5f2908fc9ac2 tempest-TrustsV3TestJSON-318535794 tempest-user-929254261] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:00.939434 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-3abb8171-c6a0-422e-9df0-5f2908fc9ac2 tempest-TrustsV3TestJSON-318535794 tempest-user-929254261] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:01.072163 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e554719-87f6-42b2-b06b-a24f889f5054 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:01.088439 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbcd46d-7236-4889-9263-1d7dce6da591 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:01.089134 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbcd46d-7236-4889-9263-1d7dce6da591 service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:01.089414 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbcd46d-7236-4889-9263-1d7dce6da591 service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:01.089686 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbcd46d-7236-4889-9263-1d7dce6da591 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:01.109730 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbcd46d-7236-4889-9263-1d7dce6da591 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:01.114543 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbcd46d-7236-4889-9263-1d7dce6da591 service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:01.127492 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abb8171-c6a0-422e-9df0-5f2908fc9ac2 tempest-TrustsV3TestJSON-318535794 tempest-user-929254261] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:01.144721 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17e3101-2fe5-4602-a579-345981b90e0c tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b077945a37bc4bf29f5c62b95ff45562', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd2d040691b34adeb5ae75a50f416642', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:01.146789 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17e3101-2fe5-4602-a579-345981b90e0c tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:01.148500 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17e3101-2fe5-4602-a579-345981b90e0c tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:01.149455 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17e3101-2fe5-4602-a579-345981b90e0c tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] PATH_INFO: `/v3/roles/77b764cbdc6a4abda88cff1cd74ac3b0` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:01.153300 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17e3101-2fe5-4602-a579-345981b90e0c tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: Authorizing `identity:delete_role(role_id=77b764cbdc6a4abda88cff1cd74ac3b0)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:01.156820 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17e3101-2fe5-4602-a579-345981b90e0c tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:01.163315 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2322/4648] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:29:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:29:01.297604 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-c17e3101-2fe5-4602-a579-345981b90e0c tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Invalidating the token cache because role 77b764cbdc6a4abda88cff1cd74ac3b0 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:29:01.298472 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-c17e3101-2fe5-4602-a579-345981b90e0c tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:01.301472 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-c17e3101-2fe5-4602-a579-345981b90e0c tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:01.309659 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2327/4649] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:29:00 2022] DELETE /identity/v3/roles/77b764cbdc6a4abda88cff1cd74ac3b0 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:29:01.314090 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbcd46d-7236-4889-9263-1d7dce6da591 service neutron] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:01.328815 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbcd46d-7236-4889-9263-1d7dce6da591 service neutron] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:01.475514 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851f7a2c-96d2-43f0-abe4-13954f14f9bc tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b077945a37bc4bf29f5c62b95ff45562', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd2d040691b34adeb5ae75a50f416642', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:01.476585 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851f7a2c-96d2-43f0-abe4-13954f14f9bc tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:01.476867 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851f7a2c-96d2-43f0-abe4-13954f14f9bc tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:01.478771 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851f7a2c-96d2-43f0-abe4-13954f14f9bc tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] PATH_INFO: `/v3/roles/c6628af4f79c4f799b41b97289c0c8c6` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:01.484073 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851f7a2c-96d2-43f0-abe4-13954f14f9bc tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: Authorizing `identity:delete_role(role_id=c6628af4f79c4f799b41b97289c0c8c6)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:01.488836 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851f7a2c-96d2-43f0-abe4-13954f14f9bc tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:01.518416 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:29:01.572542 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-851f7a2c-96d2-43f0-abe4-13954f14f9bc tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Invalidating the token cache because role c6628af4f79c4f799b41b97289c0c8c6 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:29:01.572929 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-851f7a2c-96d2-43f0-abe4-13954f14f9bc tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:01.573957 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-851f7a2c-96d2-43f0-abe4-13954f14f9bc tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:01.579728 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2323/4650] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:29:01 2022] DELETE /identity/v3/roles/c6628af4f79c4f799b41b97289c0c8c6 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:29:01.580458 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17e3101-2fe5-4602-a579-345981b90e0c tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:01.582055 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-c17e3101-2fe5-4602-a579-345981b90e0c tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:01.597191 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17e3101-2fe5-4602-a579-345981b90e0c tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:01.719941 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d305464f-6e3c-4d8d-a600-4faebf254337 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b077945a37bc4bf29f5c62b95ff45562', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd2d040691b34adeb5ae75a50f416642', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:01.721452 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d305464f-6e3c-4d8d-a600-4faebf254337 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:01.721803 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d305464f-6e3c-4d8d-a600-4faebf254337 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:01.722244 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d305464f-6e3c-4d8d-a600-4faebf254337 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] PATH_INFO: `/v3/users/23fd4a57a8164fdf811ffb64df3b8953` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:01.723861 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d305464f-6e3c-4d8d-a600-4faebf254337 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: Authorizing `identity:delete_user(user_id=23fd4a57a8164fdf811ffb64df3b8953)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:01.726406 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d305464f-6e3c-4d8d-a600-4faebf254337 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:01.842414 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:29:01.865617 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-d305464f-6e3c-4d8d-a600-4faebf254337 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23fd4a57a8164fdf811ffb64df3b8953'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:01.881226 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-d305464f-6e3c-4d8d-a600-4faebf254337 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23fd4a57a8164fdf811ffb64df3b8953'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:01.882543 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-d305464f-6e3c-4d8d-a600-4faebf254337 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23fd4a57a8164fdf811ffb64df3b8953'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:01.898360 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-d305464f-6e3c-4d8d-a600-4faebf254337 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23fd4a57a8164fdf811ffb64df3b8953'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:01.925972 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-d305464f-6e3c-4d8d-a600-4faebf254337 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23fd4a57a8164fdf811ffb64df3b8953'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:01.936410 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2328/4651] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:29:01 2022] DELETE /identity/v3/users/23fd4a57a8164fdf811ffb64df3b8953 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:29:01.940234 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851f7a2c-96d2-43f0-abe4-13954f14f9bc tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:01.942607 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-851f7a2c-96d2-43f0-abe4-13954f14f9bc tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:01.959016 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851f7a2c-96d2-43f0-abe4-13954f14f9bc tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:01.999547 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d23134f-b00a-46db-b966-9f25b57e37dc None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:01.999843 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d23134f-b00a-46db-b966-9f25b57e37dc None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:02.000136 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d23134f-b00a-46db-b966-9f25b57e37dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:02.075410 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16667b9b-e674-4b14-8f3d-7412a2ce3e49 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b077945a37bc4bf29f5c62b95ff45562', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd2d040691b34adeb5ae75a50f416642', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:02.077764 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16667b9b-e674-4b14-8f3d-7412a2ce3e49 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:02.078553 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16667b9b-e674-4b14-8f3d-7412a2ce3e49 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:02.078742 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16667b9b-e674-4b14-8f3d-7412a2ce3e49 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] PATH_INFO: `/v3/projects/547311c8578a4914a11900114088db14` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:02.083794 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16667b9b-e674-4b14-8f3d-7412a2ce3e49 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: Authorizing `identity:delete_project(project_id=547311c8578a4914a11900114088db14)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:02.091812 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-4d23134f-b00a-46db-b966-9f25b57e37dc None None] MFA Rules not processed for user `5efda1c40f494592bf1e6af1add120f3`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:29:02.095810 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16667b9b-e674-4b14-8f3d-7412a2ce3e49 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:02.096845 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-4d23134f-b00a-46db-b966-9f25b57e37dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:02.258509 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-16667b9b-e674-4b14-8f3d-7412a2ce3e49 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '547311c8578a4914a11900114088db14', 'request_id': 'req-16667b9b-e674-4b14-8f3d-7412a2ce3e49'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:02.278345 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-16667b9b-e674-4b14-8f3d-7412a2ce3e49 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '547311c8578a4914a11900114088db14', 'request_id': 'req-16667b9b-e674-4b14-8f3d-7412a2ce3e49'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:02.284962 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-16667b9b-e674-4b14-8f3d-7412a2ce3e49 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '547311c8578a4914a11900114088db14', 'request_id': 'req-16667b9b-e674-4b14-8f3d-7412a2ce3e49'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:02.327967 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2329/4652] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:29:01 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:29:02.340148 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-16667b9b-e674-4b14-8f3d-7412a2ce3e49 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] The token cache is being invalidate because project 547311c8578a4914a11900114088db14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:29:02.340428 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-16667b9b-e674-4b14-8f3d-7412a2ce3e49 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:02.341214 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-16667b9b-e674-4b14-8f3d-7412a2ce3e49 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:02.343151 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2324/4653] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:29:01 2022] DELETE /identity/v3/projects/547311c8578a4914a11900114088db14 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:29:02.344020 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16667b9b-e674-4b14-8f3d-7412a2ce3e49 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:02.350222 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decf35ac-531b-430b-8ca3-7b35f073753e None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:02.350610 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decf35ac-531b-430b-8ca3-7b35f073753e None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:02.350892 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decf35ac-531b-430b-8ca3-7b35f073753e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:02.351472 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-16667b9b-e674-4b14-8f3d-7412a2ce3e49 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:02.386564 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-decf35ac-531b-430b-8ca3-7b35f073753e None None] MFA Rules not processed for user `5efda1c40f494592bf1e6af1add120f3`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:29:02.395855 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-decf35ac-531b-430b-8ca3-7b35f073753e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:02.531189 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16667b9b-e674-4b14-8f3d-7412a2ce3e49 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:02.543575 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26fa191-190d-42c6-8b22-a74a0d5d790a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:02.544587 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26fa191-190d-42c6-8b22-a74a0d5d790a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:02.544923 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26fa191-190d-42c6-8b22-a74a0d5d790a admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:02.545283 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26fa191-190d-42c6-8b22-a74a0d5d790a admin admin] PATH_INFO: `/v3/projects/f99c3a6d103a449784f4a02a353b3980` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:02.546615 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26fa191-190d-42c6-8b22-a74a0d5d790a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f99c3a6d103a449784f4a02a353b3980)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:02.549499 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26fa191-190d-42c6-8b22-a74a0d5d790a admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:02.572453 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=90,keystone:DELETE=8,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:29:02.613647 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2330/4654] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:29:02 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:29:02.623016 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decf35ac-531b-430b-8ca3-7b35f073753e None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:02.626816 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-decf35ac-531b-430b-8ca3-7b35f073753e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:02.683255 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-a26fa191-190d-42c6-8b22-a74a0d5d790a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f99c3a6d103a449784f4a02a353b3980', 'request_id': 'req-a26fa191-190d-42c6-8b22-a74a0d5d790a'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:02.705256 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-a26fa191-190d-42c6-8b22-a74a0d5d790a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f99c3a6d103a449784f4a02a353b3980', 'request_id': 'req-a26fa191-190d-42c6-8b22-a74a0d5d790a'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:02.714608 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-a26fa191-190d-42c6-8b22-a74a0d5d790a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f99c3a6d103a449784f4a02a353b3980', 'request_id': 'req-a26fa191-190d-42c6-8b22-a74a0d5d790a'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:02.729332 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-a26fa191-190d-42c6-8b22-a74a0d5d790a admin admin] The token cache is being invalidate because project f99c3a6d103a449784f4a02a353b3980 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:29:02.729654 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-a26fa191-190d-42c6-8b22-a74a0d5d790a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:02.730652 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-a26fa191-190d-42c6-8b22-a74a0d5d790a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:02.741898 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2325/4655] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:29:02 2022] DELETE /identity/v3/projects/f99c3a6d103a449784f4a02a353b3980 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:29:02.741898 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26fa191-190d-42c6-8b22-a74a0d5d790a admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:02.742588 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-a26fa191-190d-42c6-8b22-a74a0d5d790a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:02.761032 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:29:02.796900 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decf35ac-531b-430b-8ca3-7b35f073753e None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:02.881132 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26fa191-190d-42c6-8b22-a74a0d5d790a admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:02.891271 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7551c9-447a-4dbb-8e17-bbb69a20a298 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:02.891940 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7551c9-447a-4dbb-8e17-bbb69a20a298 service nova] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:02.892254 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7551c9-447a-4dbb-8e17-bbb69a20a298 service nova] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:02.892525 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7551c9-447a-4dbb-8e17-bbb69a20a298 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:02.895659 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-ee7551c9-447a-4dbb-8e17-bbb69a20a298 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:02.916128 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6ea13f-7713-45e1-af91-63ac58cc36c2 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b077945a37bc4bf29f5c62b95ff45562', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd2d040691b34adeb5ae75a50f416642', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:02.916841 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6ea13f-7713-45e1-af91-63ac58cc36c2 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:02.917121 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6ea13f-7713-45e1-af91-63ac58cc36c2 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:02.917397 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6ea13f-7713-45e1-af91-63ac58cc36c2 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:02.918984 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6ea13f-7713-45e1-af91-63ac58cc36c2 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:02.920935 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6ea13f-7713-45e1-af91-63ac58cc36c2 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:02.978751 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2331/4656] 10.222.0.17 () {60 vars in 1151 bytes} [Sat Jul 23 21:29:02 2022] POST /identity/v3/projects => generated 328 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:29:02.978751 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65584db2-9bc5-4f10-a3fd-743070086bcb None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:02.978751 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65584db2-9bc5-4f10-a3fd-743070086bcb None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:02.978751 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65584db2-9bc5-4f10-a3fd-743070086bcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:03.017557 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7551c9-447a-4dbb-8e17-bbb69a20a298 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:03.019208 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7551c9-447a-4dbb-8e17-bbb69a20a298 service nova] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:03.025377 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-65584db2-9bc5-4f10-a3fd-743070086bcb None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:29:03.026509 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-65584db2-9bc5-4f10-a3fd-743070086bcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:03.041170 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2326/4657] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:29:02 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:29:03.055201 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7551c9-447a-4dbb-8e17-bbb69a20a298 service nova] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:03.061046 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-ee7551c9-447a-4dbb-8e17-bbb69a20a298 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:03.096675 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7551c9-447a-4dbb-8e17-bbb69a20a298 service nova] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:03.175967 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:29:03.195798 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2332/4658] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:29:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:29:03.205554 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e889ab32-b620-4833-8dee-03f0708f11dc None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:03.205828 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e889ab32-b620-4833-8dee-03f0708f11dc None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:03.206210 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e889ab32-b620-4833-8dee-03f0708f11dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:03.230421 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-e889ab32-b620-4833-8dee-03f0708f11dc None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:29:03.233124 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-e889ab32-b620-4833-8dee-03f0708f11dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:03.248663 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2333/4659] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:29:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:29:03.249624 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e889ab32-b620-4833-8dee-03f0708f11dc None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:03.250500 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b6b28c-d839-42b1-a8ba-4f09d4d3ad07 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b077945a37bc4bf29f5c62b95ff45562', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd2d040691b34adeb5ae75a50f416642', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:03.252176 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b6b28c-d839-42b1-a8ba-4f09d4d3ad07 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:03.252462 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b6b28c-d839-42b1-a8ba-4f09d4d3ad07 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:03.252749 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b6b28c-d839-42b1-a8ba-4f09d4d3ad07 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:03.253464 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b6b28c-d839-42b1-a8ba-4f09d4d3ad07 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:03.262058 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e889ab32-b620-4833-8dee-03f0708f11dc None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:03.262279 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b6b28c-d839-42b1-a8ba-4f09d4d3ad07 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:03.268373 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bfd634-49f5-4edb-b647-8aba95376230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:03.269512 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bfd634-49f5-4edb-b647-8aba95376230 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:03.269512 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bfd634-49f5-4edb-b647-8aba95376230 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:03.269742 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bfd634-49f5-4edb-b647-8aba95376230 admin admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:03.270483 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bfd634-49f5-4edb-b647-8aba95376230 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:29:03.270818 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bfd634-49f5-4edb-b647-8aba95376230 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:03.272787 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bfd634-49f5-4edb-b647-8aba95376230 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:03.291356 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2334/4660] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:29:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:29:03.297459 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bfd634-49f5-4edb-b647-8aba95376230 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:03.310248 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2327/4661] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:29:03 2022] POST /identity/v3/users => generated 416 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:29:03.313331 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bfd634-49f5-4edb-b647-8aba95376230 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:03.314550 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b6b28c-d839-42b1-a8ba-4f09d4d3ad07 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:03.320725 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1245478-aef4-42b8-899b-8b12abbc03d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:03.321486 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1245478-aef4-42b8-899b-8b12abbc03d5 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:03.321772 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1245478-aef4-42b8-899b-8b12abbc03d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:03.322082 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1245478-aef4-42b8-899b-8b12abbc03d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:03.323526 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1245478-aef4-42b8-899b-8b12abbc03d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:03.325904 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1245478-aef4-42b8-899b-8b12abbc03d5 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:03.336423 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b6b28c-d839-42b1-a8ba-4f09d4d3ad07 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:03.356691 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1369e0-1207-4a53-99c2-4620da538482 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b077945a37bc4bf29f5c62b95ff45562', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd2d040691b34adeb5ae75a50f416642', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:03.357392 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1369e0-1207-4a53-99c2-4620da538482 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:03.357678 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1369e0-1207-4a53-99c2-4620da538482 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:03.357983 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1369e0-1207-4a53-99c2-4620da538482 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:03.358921 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1369e0-1207-4a53-99c2-4620da538482 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:03.365733 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1369e0-1207-4a53-99c2-4620da538482 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:03.375546 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2335/4662] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:29:03 2022] POST /identity/v3/projects => generated 367 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:29:03.376709 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1245478-aef4-42b8-899b-8b12abbc03d5 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:03.399765 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2328/4663] 10.222.0.17 () {60 vars in 1142 bytes} [Sat Jul 23 21:29:03 2022] POST /identity/v3/roles => generated 244 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:29:03.404651 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1369e0-1207-4a53-99c2-4620da538482 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:03.432342 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1369e0-1207-4a53-99c2-4620da538482 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:03.511562 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:29:03.553326 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1245478-aef4-42b8-899b-8b12abbc03d5 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:03.572801 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dea9e3-2b23-43fa-b74b-9cd99241033d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:03.573507 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dea9e3-2b23-43fa-b74b-9cd99241033d admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:03.573795 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dea9e3-2b23-43fa-b74b-9cd99241033d admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:03.574097 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dea9e3-2b23-43fa-b74b-9cd99241033d admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:03.574802 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dea9e3-2b23-43fa-b74b-9cd99241033d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:03.579617 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dea9e3-2b23-43fa-b74b-9cd99241033d admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:03.583529 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cdbe82-a963-443d-87b5-ee7c2cf0f8ec tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b077945a37bc4bf29f5c62b95ff45562', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd2d040691b34adeb5ae75a50f416642', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:03.584343 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cdbe82-a963-443d-87b5-ee7c2cf0f8ec tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:03.584747 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cdbe82-a963-443d-87b5-ee7c2cf0f8ec tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:03.585120 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cdbe82-a963-443d-87b5-ee7c2cf0f8ec tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:03.586559 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cdbe82-a963-443d-87b5-ee7c2cf0f8ec tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:03.592503 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cdbe82-a963-443d-87b5-ee7c2cf0f8ec tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:03.617089 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2336/4664] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:29:03 2022] POST /identity/v3/users => generated 284 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:29:03.620835 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dea9e3-2b23-43fa-b74b-9cd99241033d admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:03.625254 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2329/4665] 10.222.0.17 () {60 vars in 1142 bytes} [Sat Jul 23 21:29:03 2022] POST /identity/v3/roles => generated 247 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:29:03.629404 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cdbe82-a963-443d-87b5-ee7c2cf0f8ec tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:03.652699 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dea9e3-2b23-43fa-b74b-9cd99241033d admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:03.660779 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cdbe82-a963-443d-87b5-ee7c2cf0f8ec tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:03.667620 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109fede5-302f-436b-a005-962700b21350 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b077945a37bc4bf29f5c62b95ff45562', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd2d040691b34adeb5ae75a50f416642', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:03.667973 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebca9c2-06d0-4e0e-bf16-fd5a39dba6cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:03.668682 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebca9c2-06d0-4e0e-bf16-fd5a39dba6cf admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:03.668965 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebca9c2-06d0-4e0e-bf16-fd5a39dba6cf admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:03.669236 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebca9c2-06d0-4e0e-bf16-fd5a39dba6cf admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:03.669701 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109fede5-302f-436b-a005-962700b21350 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:03.670086 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109fede5-302f-436b-a005-962700b21350 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:03.670599 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109fede5-302f-436b-a005-962700b21350 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] PATH_INFO: `/v3/projects/98b0b78a49e14bada1f69a4ffb0a5851/users/2b94533a347544d0ab299330970a8d13/roles/0408d6ea56b3402c9f80d9b5d354c02c` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:03.672214 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebca9c2-06d0-4e0e-bf16-fd5a39dba6cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:03.678087 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebca9c2-06d0-4e0e-bf16-fd5a39dba6cf admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:03.707674 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109fede5-302f-436b-a005-962700b21350 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: Authorizing `identity:create_grant(project_id=98b0b78a49e14bada1f69a4ffb0a5851, user_id=2b94533a347544d0ab299330970a8d13, role_id=0408d6ea56b3402c9f80d9b5d354c02c)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:03.707922 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2337/4666] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:29:03 2022] GET /identity/v3/roles => generated 1893 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:29:03.710429 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109fede5-302f-436b-a005-962700b21350 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:03.710582 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebca9c2-06d0-4e0e-bf16-fd5a39dba6cf admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:03.729025 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebca9c2-06d0-4e0e-bf16-fd5a39dba6cf admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:03.749960 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2330/4667] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:29:03 2022] PUT /identity/v3/projects/98b0b78a49e14bada1f69a4ffb0a5851/users/2b94533a347544d0ab299330970a8d13/roles/0408d6ea56b3402c9f80d9b5d354c02c => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:29:03.751534 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e94b69b-fc5a-4ca3-9a21-0505dcc03831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:03.753962 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109fede5-302f-436b-a005-962700b21350 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:03.755143 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e94b69b-fc5a-4ca3-9a21-0505dcc03831 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:03.758215 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e94b69b-fc5a-4ca3-9a21-0505dcc03831 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:03.759525 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e94b69b-fc5a-4ca3-9a21-0505dcc03831 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:03.762380 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e94b69b-fc5a-4ca3-9a21-0505dcc03831 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:03.764487 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e94b69b-fc5a-4ca3-9a21-0505dcc03831 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:03.807168 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2338/4668] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:29:03 2022] GET /identity/v3/roles => generated 1893 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:29:03.813192 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e94b69b-fc5a-4ca3-9a21-0505dcc03831 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:03.826557 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e94b69b-fc5a-4ca3-9a21-0505dcc03831 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:03.920326 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109fede5-302f-436b-a005-962700b21350 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:03.938362 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61183260-33c4-4bfe-9391-19918d742bd2 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b077945a37bc4bf29f5c62b95ff45562', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd2d040691b34adeb5ae75a50f416642', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:03.939512 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61183260-33c4-4bfe-9391-19918d742bd2 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:03.939855 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61183260-33c4-4bfe-9391-19918d742bd2 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:03.940189 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61183260-33c4-4bfe-9391-19918d742bd2 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] PATH_INFO: `/v3/projects/98b0b78a49e14bada1f69a4ffb0a5851/users/2b94533a347544d0ab299330970a8d13/roles/75159f108d994e6ca6820251488f1770` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:03.946732 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61183260-33c4-4bfe-9391-19918d742bd2 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: Authorizing `identity:create_grant(project_id=98b0b78a49e14bada1f69a4ffb0a5851, user_id=2b94533a347544d0ab299330970a8d13, role_id=75159f108d994e6ca6820251488f1770)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:03.955199 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61183260-33c4-4bfe-9391-19918d742bd2 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:03.974965 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd55750c-0d5a-4e00-bef4-bfe9b06d2a78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:03.980172 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd55750c-0d5a-4e00-bef4-bfe9b06d2a78 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:03.980466 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd55750c-0d5a-4e00-bef4-bfe9b06d2a78 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:03.980762 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd55750c-0d5a-4e00-bef4-bfe9b06d2a78 admin admin] PATH_INFO: `/v3/projects/89d2c91f663b4786b37492389360b431/users/b2195c4a35b84440ab6be41a7aeccc0c/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:04.012604 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2331/4669] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:29:03 2022] PUT /identity/v3/projects/98b0b78a49e14bada1f69a4ffb0a5851/users/2b94533a347544d0ab299330970a8d13/roles/75159f108d994e6ca6820251488f1770 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:29:04.015346 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61183260-33c4-4bfe-9391-19918d742bd2 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:04.017600 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd55750c-0d5a-4e00-bef4-bfe9b06d2a78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89d2c91f663b4786b37492389360b431, user_id=b2195c4a35b84440ab6be41a7aeccc0c, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:04.023649 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd55750c-0d5a-4e00-bef4-bfe9b06d2a78 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:04.068209 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2339/4670] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:29:03 2022] PUT /identity/v3/projects/89d2c91f663b4786b37492389360b431/users/b2195c4a35b84440ab6be41a7aeccc0c/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:29:04.072263 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b6db4d-67e8-4a6f-9e9e-6e320b8d9066 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:04.072868 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:29:04.073671 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b6db4d-67e8-4a6f-9e9e-6e320b8d9066 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:04.074044 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b6db4d-67e8-4a6f-9e9e-6e320b8d9066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:04.141234 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-16b6db4d-67e8-4a6f-9e9e-6e320b8d9066 None None] MFA Rules not processed for user `b2195c4a35b84440ab6be41a7aeccc0c`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:29:04.145121 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-16b6db4d-67e8-4a6f-9e9e-6e320b8d9066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:04.196557 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61183260-33c4-4bfe-9391-19918d742bd2 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:04.339122 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2340/4671] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:29:04 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:29:04.339519 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061904ea-de79-4044-b77e-14dd3933a68c tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b077945a37bc4bf29f5c62b95ff45562', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd2d040691b34adeb5ae75a50f416642', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:04.340234 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061904ea-de79-4044-b77e-14dd3933a68c tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:04.340364 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b6db4d-67e8-4a6f-9e9e-6e320b8d9066 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:04.340573 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061904ea-de79-4044-b77e-14dd3933a68c tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:04.340958 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061904ea-de79-4044-b77e-14dd3933a68c tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:04.341666 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061904ea-de79-4044-b77e-14dd3933a68c tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:04.343579 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061904ea-de79-4044-b77e-14dd3933a68c tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:04.409815 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:29:04.410366 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2332/4672] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:29:04 2022] GET /identity/v3/users => generated 8352 bytes in 396 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:29:04.415072 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f92ce9f-f1ba-45a6-8de4-44c0656d3b07 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:04.415072 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f92ce9f-f1ba-45a6-8de4-44c0656d3b07 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:04.415072 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f92ce9f-f1ba-45a6-8de4-44c0656d3b07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:04.503630 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-1f92ce9f-f1ba-45a6-8de4-44c0656d3b07 None None] MFA Rules not processed for user `2b94533a347544d0ab299330970a8d13`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:29:04.505219 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-1f92ce9f-f1ba-45a6-8de4-44c0656d3b07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:04.553561 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b6db4d-67e8-4a6f-9e9e-6e320b8d9066 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:04.582913 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f37bdcd-24fa-4bbb-a1a8-a21496adbd2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:04.583777 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f37bdcd-24fa-4bbb-a1a8-a21496adbd2d admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:04.584262 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f37bdcd-24fa-4bbb-a1a8-a21496adbd2d admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:04.585518 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f37bdcd-24fa-4bbb-a1a8-a21496adbd2d admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:04.586374 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f37bdcd-24fa-4bbb-a1a8-a21496adbd2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:04.591865 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f37bdcd-24fa-4bbb-a1a8-a21496adbd2d admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:04.656602 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2341/4673] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:29:04 2022] POST /identity/v3/projects => generated 367 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:29:04.657876 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f37bdcd-24fa-4bbb-a1a8-a21496adbd2d admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:04.691219 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2333/4674] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:29:04 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:29:04.695853 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdba98da-4706-4c42-bfeb-17b069b9814d None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:04.696187 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdba98da-4706-4c42-bfeb-17b069b9814d None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:04.696542 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdba98da-4706-4c42-bfeb-17b069b9814d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:04.738011 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-bdba98da-4706-4c42-bfeb-17b069b9814d None None] MFA Rules not processed for user `2b94533a347544d0ab299330970a8d13`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:29:04.742296 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-bdba98da-4706-4c42-bfeb-17b069b9814d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:04.864040 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:29:04.921543 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2334/4675] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:29:04 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:29:04.922719 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdba98da-4706-4c42-bfeb-17b069b9814d None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:04.958628 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdba98da-4706-4c42-bfeb-17b069b9814d None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:04.972078 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed1ce65-f3c7-4dc6-92e8-8a07bb20ba79 tempest-TrustsV3TestJSON-606366867 tempest-user-1402762843] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b94533a347544d0ab299330970a8d13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98b0b78a49e14bada1f69a4ffb0a5851', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1748174186', 'tempest-DelegatedRole-1560626018'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:04.972746 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f37bdcd-24fa-4bbb-a1a8-a21496adbd2d admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:04.973030 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed1ce65-f3c7-4dc6-92e8-8a07bb20ba79 tempest-TrustsV3TestJSON-606366867 tempest-user-1402762843] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:04.973487 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed1ce65-f3c7-4dc6-92e8-8a07bb20ba79 tempest-TrustsV3TestJSON-606366867 tempest-user-1402762843] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:04.973870 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed1ce65-f3c7-4dc6-92e8-8a07bb20ba79 tempest-TrustsV3TestJSON-606366867 tempest-user-1402762843] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:04.974731 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed1ce65-f3c7-4dc6-92e8-8a07bb20ba79 tempest-TrustsV3TestJSON-606366867 tempest-user-1402762843] RBAC: Authorizing `identity:create_trust()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:04.977779 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed1ce65-f3c7-4dc6-92e8-8a07bb20ba79 tempest-TrustsV3TestJSON-606366867 tempest-user-1402762843] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:05.030013 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bab770f-e7e4-4b23-9f90-c22e660957fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:05.030743 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bab770f-e7e4-4b23-9f90-c22e660957fb admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:05.031034 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bab770f-e7e4-4b23-9f90-c22e660957fb admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:05.031300 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bab770f-e7e4-4b23-9f90-c22e660957fb admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:05.032117 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bab770f-e7e4-4b23-9f90-c22e660957fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:05.045448 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bab770f-e7e4-4b23-9f90-c22e660957fb admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:05.131342 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2342/4676] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:29:04 2022] POST /identity/v3/users => generated 290 bytes in 474 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:29:05.139761 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bab770f-e7e4-4b23-9f90-c22e660957fb admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:05.161123 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bab770f-e7e4-4b23-9f90-c22e660957fb admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:05.177464 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d98ba3-f72a-4373-a510-4a95bd0b20c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:05.178364 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d98ba3-f72a-4373-a510-4a95bd0b20c5 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:05.178651 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d98ba3-f72a-4373-a510-4a95bd0b20c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:05.178964 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d98ba3-f72a-4373-a510-4a95bd0b20c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:05.179648 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d98ba3-f72a-4373-a510-4a95bd0b20c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:05.181281 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d98ba3-f72a-4373-a510-4a95bd0b20c5 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:05.232526 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2343/4677] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:29:05 2022] GET /identity/v3/roles => generated 1893 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:29:05.239366 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d98ba3-f72a-4373-a510-4a95bd0b20c5 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:05.299170 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2335/4678] 10.222.0.17 () {60 vars in 1173 bytes} [Sat Jul 23 21:29:04 2022] POST /identity/v3/OS-TRUST/trusts => generated 834 bytes in 376 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:29:05.301802 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed1ce65-f3c7-4dc6-92e8-8a07bb20ba79 tempest-TrustsV3TestJSON-606366867 tempest-user-1402762843] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:05.323996 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed1ce65-f3c7-4dc6-92e8-8a07bb20ba79 tempest-TrustsV3TestJSON-606366867 tempest-user-1402762843] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:05.333557 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d98ba3-f72a-4373-a510-4a95bd0b20c5 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:05.337700 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30ef283-a6fc-4b59-ab69-9c73b428b12f tempest-TrustsV3TestJSON-606366867 tempest-user-1402762843] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b94533a347544d0ab299330970a8d13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98b0b78a49e14bada1f69a4ffb0a5851', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1748174186', 'tempest-DelegatedRole-1560626018'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:05.338420 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30ef283-a6fc-4b59-ab69-9c73b428b12f tempest-TrustsV3TestJSON-606366867 tempest-user-1402762843] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:05.338699 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30ef283-a6fc-4b59-ab69-9c73b428b12f tempest-TrustsV3TestJSON-606366867 tempest-user-1402762843] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:05.338968 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30ef283-a6fc-4b59-ab69-9c73b428b12f tempest-TrustsV3TestJSON-606366867 tempest-user-1402762843] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:05.339690 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30ef283-a6fc-4b59-ab69-9c73b428b12f tempest-TrustsV3TestJSON-606366867 tempest-user-1402762843] RBAC: Authorizing `identity:list_trusts_for_trustor()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:05.341064 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30ef283-a6fc-4b59-ab69-9c73b428b12f tempest-TrustsV3TestJSON-606366867 tempest-user-1402762843] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:05.359007 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2336/4679] 10.222.0.17 () {58 vars in 1251 bytes} [Sat Jul 23 21:29:05 2022] GET /identity/v3/OS-TRUST/trusts/?trustor_user_id=2b94533a347544d0ab299330970a8d13 => generated 611 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:29:05.359516 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8919f8a-e296-4bdf-a150-dd77c4451ba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:05.363260 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30ef283-a6fc-4b59-ab69-9c73b428b12f tempest-TrustsV3TestJSON-606366867 tempest-user-1402762843] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:05.381463 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30ef283-a6fc-4b59-ab69-9c73b428b12f tempest-TrustsV3TestJSON-606366867 tempest-user-1402762843] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:05.382209 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8919f8a-e296-4bdf-a150-dd77c4451ba2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:05.384703 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8919f8a-e296-4bdf-a150-dd77c4451ba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:05.385110 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8919f8a-e296-4bdf-a150-dd77c4451ba2 admin admin] PATH_INFO: `/v3/projects/f813c3919aa44c8f8b95fa3beee0436f/users/515c50d1e3d64c6992100e7d1fa49e2f/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:05.404237 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35371560-03f5-4ddb-a1cd-11fe313798aa tempest-TrustsV3TestJSON-606366867 tempest-user-1402762843] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b94533a347544d0ab299330970a8d13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98b0b78a49e14bada1f69a4ffb0a5851', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1748174186', 'tempest-DelegatedRole-1560626018'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:05.405122 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35371560-03f5-4ddb-a1cd-11fe313798aa tempest-TrustsV3TestJSON-606366867 tempest-user-1402762843] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:05.405403 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35371560-03f5-4ddb-a1cd-11fe313798aa tempest-TrustsV3TestJSON-606366867 tempest-user-1402762843] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:05.405671 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35371560-03f5-4ddb-a1cd-11fe313798aa tempest-TrustsV3TestJSON-606366867 tempest-user-1402762843] PATH_INFO: `/v3/OS-TRUST/trusts/e465fcf7a6d84ff18054610fd520efdb` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:05.438441 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35371560-03f5-4ddb-a1cd-11fe313798aa tempest-TrustsV3TestJSON-606366867 tempest-user-1402762843] RBAC: Authorizing `identity:delete_trust(trust_id=e465fcf7a6d84ff18054610fd520efdb)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:05.440160 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35371560-03f5-4ddb-a1cd-11fe313798aa tempest-TrustsV3TestJSON-606366867 tempest-user-1402762843] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:05.467533 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8919f8a-e296-4bdf-a150-dd77c4451ba2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f813c3919aa44c8f8b95fa3beee0436f, user_id=515c50d1e3d64c6992100e7d1fa49e2f, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:05.487869 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8919f8a-e296-4bdf-a150-dd77c4451ba2 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:05.534737 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-35371560-03f5-4ddb-a1cd-11fe313798aa tempest-TrustsV3TestJSON-606366867 tempest-user-1402762843] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': 'e465fcf7a6d84ff18054610fd520efdb', 'request_id': 'req-35371560-03f5-4ddb-a1cd-11fe313798aa'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:05.543383 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2344/4680] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:29:05 2022] PUT /identity/v3/projects/f813c3919aa44c8f8b95fa3beee0436f/users/515c50d1e3d64c6992100e7d1fa49e2f/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:29:05.552004 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8919f8a-e296-4bdf-a150-dd77c4451ba2 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:05.560748 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-35371560-03f5-4ddb-a1cd-11fe313798aa tempest-TrustsV3TestJSON-606366867 tempest-user-1402762843] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'e465fcf7a6d84ff18054610fd520efdb', 'request_id': 'req-35371560-03f5-4ddb-a1cd-11fe313798aa'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:05.561894 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-35371560-03f5-4ddb-a1cd-11fe313798aa tempest-TrustsV3TestJSON-606366867 tempest-user-1402762843] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'e465fcf7a6d84ff18054610fd520efdb', 'request_id': 'req-35371560-03f5-4ddb-a1cd-11fe313798aa'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:05.583951 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2337/4681] 10.222.0.17 () {58 vars in 1253 bytes} [Sat Jul 23 21:29:05 2022] DELETE /identity/v3/OS-TRUST/trusts/e465fcf7a6d84ff18054610fd520efdb => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:29:05.587745 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35371560-03f5-4ddb-a1cd-11fe313798aa tempest-TrustsV3TestJSON-606366867 tempest-user-1402762843] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:05.589538 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-35371560-03f5-4ddb-a1cd-11fe313798aa tempest-TrustsV3TestJSON-606366867 tempest-user-1402762843] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:05.616926 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35371560-03f5-4ddb-a1cd-11fe313798aa tempest-TrustsV3TestJSON-606366867 tempest-user-1402762843] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:05.738253 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8919f8a-e296-4bdf-a150-dd77c4451ba2 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:05.745839 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866f6e46-1ffc-448c-bc92-5560ee62825c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:05.746780 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866f6e46-1ffc-448c-bc92-5560ee62825c admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:05.747204 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866f6e46-1ffc-448c-bc92-5560ee62825c admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:05.747486 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866f6e46-1ffc-448c-bc92-5560ee62825c admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:05.748222 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866f6e46-1ffc-448c-bc92-5560ee62825c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:05.751132 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866f6e46-1ffc-448c-bc92-5560ee62825c admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:05.754158 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:29:05.761043 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f867f4-41dd-4fbb-b351-2bea1547c8d1 tempest-TrustsV3TestJSON-606366867 tempest-user-1402762843] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b94533a347544d0ab299330970a8d13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98b0b78a49e14bada1f69a4ffb0a5851', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1748174186', 'tempest-DelegatedRole-1560626018'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:05.762780 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f867f4-41dd-4fbb-b351-2bea1547c8d1 tempest-TrustsV3TestJSON-606366867 tempest-user-1402762843] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:05.762922 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f867f4-41dd-4fbb-b351-2bea1547c8d1 tempest-TrustsV3TestJSON-606366867 tempest-user-1402762843] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:05.763174 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f867f4-41dd-4fbb-b351-2bea1547c8d1 tempest-TrustsV3TestJSON-606366867 tempest-user-1402762843] PATH_INFO: `/v3/OS-TRUST/trusts/e465fcf7a6d84ff18054610fd520efdb` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:05.780030 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2345/4682] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:29:05 2022] GET /identity/v3/roles => generated 1893 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:29:05.781211 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866f6e46-1ffc-448c-bc92-5560ee62825c admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:05.785549 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-866f6e46-1ffc-448c-bc92-5560ee62825c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:05.792225 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-c3f867f4-41dd-4fbb-b351-2bea1547c8d1 tempest-TrustsV3TestJSON-606366867 tempest-user-1402762843] Could not find trust: e465fcf7a6d84ff18054610fd520efdb.: keystone.exception.TrustNotFound: Could not find trust: e465fcf7a6d84ff18054610fd520efdb. Jul 23 21:29:05.792225 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 21:29:05.792225 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 21:29:05.792225 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 21:29:05.792225 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 21:29:05.792225 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 21:29:05.792225 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 21:29:05.792225 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 21:29:05.792225 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 21:29:05.792225 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 21:29:05.792225 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 21:29:05.792225 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 21:29:05.792225 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Jul 23 21:29:05.792225 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Jul 23 21:29:05.792225 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Jul 23 21:29:05.793606 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Jul 23 21:29:05.793606 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Jul 23 21:29:05.793606 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Jul 23 21:29:05.793606 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Jul 23 21:29:05.793606 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Jul 23 21:29:05.793606 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 21:29:05.793606 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 21:29:05.793606 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Jul 23 21:29:05.793606 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Jul 23 21:29:05.793606 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Jul 23 21:29:05.793606 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Jul 23 21:29:05.793606 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: e465fcf7a6d84ff18054610fd520efdb. Jul 23 21:29:05.793606 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 21:29:05.794693 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2338/4683] 10.222.0.17 () {58 vars in 1250 bytes} [Sat Jul 23 21:29:05 2022] GET /identity/v3/OS-TRUST/trusts/e465fcf7a6d84ff18054610fd520efdb => generated 111 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 23 21:29:05.797524 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f867f4-41dd-4fbb-b351-2bea1547c8d1 tempest-TrustsV3TestJSON-606366867 tempest-user-1402762843] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:05.799279 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-c3f867f4-41dd-4fbb-b351-2bea1547c8d1 tempest-TrustsV3TestJSON-606366867 tempest-user-1402762843] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:05.810254 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866f6e46-1ffc-448c-bc92-5560ee62825c admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:05.817554 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3dd631-ae1b-42c7-95a3-91c9e356bd54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:05.821121 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3dd631-ae1b-42c7-95a3-91c9e356bd54 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:05.821579 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3dd631-ae1b-42c7-95a3-91c9e356bd54 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:05.822583 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3dd631-ae1b-42c7-95a3-91c9e356bd54 admin admin] PATH_INFO: `/v3/projects/f813c3919aa44c8f8b95fa3beee0436f/users/515c50d1e3d64c6992100e7d1fa49e2f/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:05.827427 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3dd631-ae1b-42c7-95a3-91c9e356bd54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f813c3919aa44c8f8b95fa3beee0436f, user_id=515c50d1e3d64c6992100e7d1fa49e2f, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:05.832320 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3dd631-ae1b-42c7-95a3-91c9e356bd54 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:05.844912 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:UPDATE=1,keystone:DELETE=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:29:05.848746 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2346/4684] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:29:05 2022] PUT /identity/v3/projects/f813c3919aa44c8f8b95fa3beee0436f/users/515c50d1e3d64c6992100e7d1fa49e2f/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:29:05.860141 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ccc51d-084f-44be-8e28-e6701cea473d None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:05.860717 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ccc51d-084f-44be-8e28-e6701cea473d None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:05.861726 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ccc51d-084f-44be-8e28-e6701cea473d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:05.900867 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f867f4-41dd-4fbb-b351-2bea1547c8d1 tempest-TrustsV3TestJSON-606366867 tempest-user-1402762843] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:05.906314 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-58ccc51d-084f-44be-8e28-e6701cea473d None None] MFA Rules not processed for user `515c50d1e3d64c6992100e7d1fa49e2f`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:29:05.909078 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-58ccc51d-084f-44be-8e28-e6701cea473d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:05.984837 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa06058-8b52-482c-9b9e-7d8e83e77bba tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b077945a37bc4bf29f5c62b95ff45562', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd2d040691b34adeb5ae75a50f416642', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:05.986144 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa06058-8b52-482c-9b9e-7d8e83e77bba tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:05.986567 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa06058-8b52-482c-9b9e-7d8e83e77bba tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:05.986961 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa06058-8b52-482c-9b9e-7d8e83e77bba tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] PATH_INFO: `/v3/roles/75159f108d994e6ca6820251488f1770` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:05.989312 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa06058-8b52-482c-9b9e-7d8e83e77bba tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: Authorizing `identity:delete_role(role_id=75159f108d994e6ca6820251488f1770)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:05.991564 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa06058-8b52-482c-9b9e-7d8e83e77bba tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:06.055276 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2347/4685] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:29:05 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:29:06.065235 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ccc51d-084f-44be-8e28-e6701cea473d None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:06.067815 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-58ccc51d-084f-44be-8e28-e6701cea473d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:06.070241 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-6fa06058-8b52-482c-9b9e-7d8e83e77bba tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Invalidating the token cache because role 75159f108d994e6ca6820251488f1770 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:29:06.070779 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-6fa06058-8b52-482c-9b9e-7d8e83e77bba tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:06.072922 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-6fa06058-8b52-482c-9b9e-7d8e83e77bba tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:06.076154 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2339/4686] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:29:05 2022] DELETE /identity/v3/roles/75159f108d994e6ca6820251488f1770 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:29:06.081528 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa06058-8b52-482c-9b9e-7d8e83e77bba tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:06.085733 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-6fa06058-8b52-482c-9b9e-7d8e83e77bba tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:06.156343 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ccc51d-084f-44be-8e28-e6701cea473d None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:06.189255 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa06058-8b52-482c-9b9e-7d8e83e77bba tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:06.194865 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0ba9a5-cd88-4063-aac4-73a75572335d tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b077945a37bc4bf29f5c62b95ff45562', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd2d040691b34adeb5ae75a50f416642', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:06.195958 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0ba9a5-cd88-4063-aac4-73a75572335d tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:06.196243 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0ba9a5-cd88-4063-aac4-73a75572335d tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:06.196517 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0ba9a5-cd88-4063-aac4-73a75572335d tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] PATH_INFO: `/v3/roles/0408d6ea56b3402c9f80d9b5d354c02c` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:06.199005 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0ba9a5-cd88-4063-aac4-73a75572335d tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: Authorizing `identity:delete_role(role_id=0408d6ea56b3402c9f80d9b5d354c02c)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:06.201372 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0ba9a5-cd88-4063-aac4-73a75572335d tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:06.264685 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-cb0ba9a5-cd88-4063-aac4-73a75572335d tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Invalidating the token cache because role 0408d6ea56b3402c9f80d9b5d354c02c has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:29:06.264977 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-cb0ba9a5-cd88-4063-aac4-73a75572335d tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:06.265688 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-cb0ba9a5-cd88-4063-aac4-73a75572335d tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:06.270944 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2340/4687] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:29:06 2022] DELETE /identity/v3/roles/0408d6ea56b3402c9f80d9b5d354c02c => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:29:06.271355 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b44d25d-750e-4c0d-bea5-5ca997865000 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec5fd3a489c341b7964704d689037f05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:06.271932 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b44d25d-750e-4c0d-bea5-5ca997865000 service cinder] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:06.272566 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b44d25d-750e-4c0d-bea5-5ca997865000 service cinder] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:06.272663 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0ba9a5-cd88-4063-aac4-73a75572335d tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:06.272754 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b44d25d-750e-4c0d-bea5-5ca997865000 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:06.274144 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-cb0ba9a5-cd88-4063-aac4-73a75572335d tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:06.274574 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-1b44d25d-750e-4c0d-bea5-5ca997865000 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:06.285695 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:29:06.322800 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:29:06.358630 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b44d25d-750e-4c0d-bea5-5ca997865000 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:06.361587 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b44d25d-750e-4c0d-bea5-5ca997865000 service cinder] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:06.389152 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2348/4688] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:29:06 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:29:06.390136 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0ba9a5-cd88-4063-aac4-73a75572335d tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:06.402452 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ac60ac-7d83-4de3-b319-874de5f6ee65 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b077945a37bc4bf29f5c62b95ff45562', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd2d040691b34adeb5ae75a50f416642', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:06.403392 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ac60ac-7d83-4de3-b319-874de5f6ee65 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:06.403958 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ac60ac-7d83-4de3-b319-874de5f6ee65 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:06.404560 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ac60ac-7d83-4de3-b319-874de5f6ee65 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] PATH_INFO: `/v3/users/2b94533a347544d0ab299330970a8d13` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:06.405782 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ac60ac-7d83-4de3-b319-874de5f6ee65 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: Authorizing `identity:delete_user(user_id=2b94533a347544d0ab299330970a8d13)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:06.408079 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ac60ac-7d83-4de3-b319-874de5f6ee65 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:06.492390 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-07ac60ac-7d83-4de3-b319-874de5f6ee65 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b94533a347544d0ab299330970a8d13'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:06.493213 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-07ac60ac-7d83-4de3-b319-874de5f6ee65 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b94533a347544d0ab299330970a8d13'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:06.507240 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-07ac60ac-7d83-4de3-b319-874de5f6ee65 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b94533a347544d0ab299330970a8d13'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:06.513063 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-07ac60ac-7d83-4de3-b319-874de5f6ee65 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b94533a347544d0ab299330970a8d13'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:06.521026 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b44d25d-750e-4c0d-bea5-5ca997865000 service cinder] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:06.522763 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-1b44d25d-750e-4c0d-bea5-5ca997865000 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:06.541972 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b44d25d-750e-4c0d-bea5-5ca997865000 service cinder] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:06.551535 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-07ac60ac-7d83-4de3-b319-874de5f6ee65 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b94533a347544d0ab299330970a8d13'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:06.564161 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2341/4689] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:29:06 2022] DELETE /identity/v3/users/2b94533a347544d0ab299330970a8d13 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:29:06.566439 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ac60ac-7d83-4de3-b319-874de5f6ee65 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:06.569128 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-07ac60ac-7d83-4de3-b319-874de5f6ee65 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:06.663205 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ac60ac-7d83-4de3-b319-874de5f6ee65 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:06.681773 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc692d7f-4f7b-415f-98c7-8ba916aad0d2 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b077945a37bc4bf29f5c62b95ff45562', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd2d040691b34adeb5ae75a50f416642', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:06.682891 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc692d7f-4f7b-415f-98c7-8ba916aad0d2 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:06.683283 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc692d7f-4f7b-415f-98c7-8ba916aad0d2 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:06.683667 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc692d7f-4f7b-415f-98c7-8ba916aad0d2 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] PATH_INFO: `/v3/projects/98b0b78a49e14bada1f69a4ffb0a5851` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:06.683787 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe500b6-bf10-4937-8b82-47e29ff3ec1e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec5fd3a489c341b7964704d689037f05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:06.684538 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe500b6-bf10-4937-8b82-47e29ff3ec1e service cinder] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:06.684832 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe500b6-bf10-4937-8b82-47e29ff3ec1e service cinder] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:06.685652 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc692d7f-4f7b-415f-98c7-8ba916aad0d2 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: Authorizing `identity:delete_project(project_id=98b0b78a49e14bada1f69a4ffb0a5851)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:06.687706 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc692d7f-4f7b-415f-98c7-8ba916aad0d2 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:06.688354 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe500b6-bf10-4937-8b82-47e29ff3ec1e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:06.692977 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-dfe500b6-bf10-4937-8b82-47e29ff3ec1e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:06.730948 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:29:06.760568 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-cc692d7f-4f7b-415f-98c7-8ba916aad0d2 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98b0b78a49e14bada1f69a4ffb0a5851', 'request_id': 'req-cc692d7f-4f7b-415f-98c7-8ba916aad0d2'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:06.770288 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-cc692d7f-4f7b-415f-98c7-8ba916aad0d2 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98b0b78a49e14bada1f69a4ffb0a5851', 'request_id': 'req-cc692d7f-4f7b-415f-98c7-8ba916aad0d2'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:06.780888 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-cc692d7f-4f7b-415f-98c7-8ba916aad0d2 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98b0b78a49e14bada1f69a4ffb0a5851', 'request_id': 'req-cc692d7f-4f7b-415f-98c7-8ba916aad0d2'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:06.807729 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe500b6-bf10-4937-8b82-47e29ff3ec1e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:06.808800 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-cc692d7f-4f7b-415f-98c7-8ba916aad0d2 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] The token cache is being invalidate because project 98b0b78a49e14bada1f69a4ffb0a5851 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:29:06.809031 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-cc692d7f-4f7b-415f-98c7-8ba916aad0d2 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:06.810143 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe500b6-bf10-4937-8b82-47e29ff3ec1e service cinder] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:06.814393 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-cc692d7f-4f7b-415f-98c7-8ba916aad0d2 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:06.822330 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2342/4690] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:29:06 2022] DELETE /identity/v3/projects/98b0b78a49e14bada1f69a4ffb0a5851 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:29:06.823899 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554fe25e-cf56-4d19-94b9-d54e30375336 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:06.824191 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554fe25e-cf56-4d19-94b9-d54e30375336 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:06.824469 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554fe25e-cf56-4d19-94b9-d54e30375336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:06.825623 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2349/4691] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:29:06 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:29:06.826785 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe500b6-bf10-4937-8b82-47e29ff3ec1e service cinder] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:06.842781 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe500b6-bf10-4937-8b82-47e29ff3ec1e service cinder] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:06.874809 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-554fe25e-cf56-4d19-94b9-d54e30375336 None None] MFA Rules not processed for user `affc3572ef7d45249f50b5061a681d18`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:29:06.876585 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-554fe25e-cf56-4d19-94b9-d54e30375336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:06.984452 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42364276-1659-4779-89ff-4ce26b715178 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b077945a37bc4bf29f5c62b95ff45562', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd2d040691b34adeb5ae75a50f416642', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:06.993267 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42364276-1659-4779-89ff-4ce26b715178 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:06.993990 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42364276-1659-4779-89ff-4ce26b715178 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:06.994495 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42364276-1659-4779-89ff-4ce26b715178 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:06.996225 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42364276-1659-4779-89ff-4ce26b715178 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:06.998423 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42364276-1659-4779-89ff-4ce26b715178 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:07.018008 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2343/4692] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:29:06 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:29:07.067550 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2350/4693] 10.222.0.17 () {60 vars in 1151 bytes} [Sat Jul 23 21:29:06 2022] POST /identity/v3/projects => generated 328 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:29:07.069025 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554fe25e-cf56-4d19-94b9-d54e30375336 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:07.073059 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-554fe25e-cf56-4d19-94b9-d54e30375336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:07.102699 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554fe25e-cf56-4d19-94b9-d54e30375336 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:07.335320 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0c58c4-01e9-4b76-8fb8-e10b6ed9780c tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b077945a37bc4bf29f5c62b95ff45562', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd2d040691b34adeb5ae75a50f416642', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:07.337774 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0c58c4-01e9-4b76-8fb8-e10b6ed9780c tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:07.338291 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0c58c4-01e9-4b76-8fb8-e10b6ed9780c tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:07.338966 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0c58c4-01e9-4b76-8fb8-e10b6ed9780c tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:07.346168 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0c58c4-01e9-4b76-8fb8-e10b6ed9780c tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:07.347966 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0c58c4-01e9-4b76-8fb8-e10b6ed9780c tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:07.401688 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2344/4694] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:29:07 2022] POST /identity/v3/users => generated 416 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:29:07.405515 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42364276-1659-4779-89ff-4ce26b715178 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:07.420720 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42364276-1659-4779-89ff-4ce26b715178 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:07.437893 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f5b2c0-5897-4ffe-a9b9-67f0a889dcc0 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b077945a37bc4bf29f5c62b95ff45562', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd2d040691b34adeb5ae75a50f416642', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:07.438597 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f5b2c0-5897-4ffe-a9b9-67f0a889dcc0 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:07.438956 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f5b2c0-5897-4ffe-a9b9-67f0a889dcc0 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:07.439234 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f5b2c0-5897-4ffe-a9b9-67f0a889dcc0 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:07.440658 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f5b2c0-5897-4ffe-a9b9-67f0a889dcc0 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:07.441681 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f5b2c0-5897-4ffe-a9b9-67f0a889dcc0 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:07.452712 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:29:07.461894 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2351/4695] 10.222.0.17 () {60 vars in 1142 bytes} [Sat Jul 23 21:29:07 2022] POST /identity/v3/roles => generated 244 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:29:07.468745 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0c58c4-01e9-4b76-8fb8-e10b6ed9780c tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:07.488246 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0c58c4-01e9-4b76-8fb8-e10b6ed9780c tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:07.500670 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b86f3c-3a40-4829-aaee-eb5cc7b630a7 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b077945a37bc4bf29f5c62b95ff45562', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd2d040691b34adeb5ae75a50f416642', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:07.501742 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b86f3c-3a40-4829-aaee-eb5cc7b630a7 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:07.502211 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b86f3c-3a40-4829-aaee-eb5cc7b630a7 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:07.503346 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b86f3c-3a40-4829-aaee-eb5cc7b630a7 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:07.505043 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b86f3c-3a40-4829-aaee-eb5cc7b630a7 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:07.507878 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b86f3c-3a40-4829-aaee-eb5cc7b630a7 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:07.555400 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2345/4696] 10.222.0.17 () {60 vars in 1142 bytes} [Sat Jul 23 21:29:07 2022] POST /identity/v3/roles => generated 245 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:29:07.558882 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f5b2c0-5897-4ffe-a9b9-67f0a889dcc0 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:07.575839 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f5b2c0-5897-4ffe-a9b9-67f0a889dcc0 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:07.589184 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f195dad7-54a5-4c00-9aef-2bf2e49fbbeb tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b077945a37bc4bf29f5c62b95ff45562', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd2d040691b34adeb5ae75a50f416642', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:07.590171 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f195dad7-54a5-4c00-9aef-2bf2e49fbbeb tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:07.590453 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f195dad7-54a5-4c00-9aef-2bf2e49fbbeb tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:07.590921 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f195dad7-54a5-4c00-9aef-2bf2e49fbbeb tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] PATH_INFO: `/v3/projects/2e8182e92169495db6f3647baae244f6/users/f6b70c79a07141d5b38e4a95e1f845be/roles/9036ec41af504117b62484de6123e5b4` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:07.610129 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f195dad7-54a5-4c00-9aef-2bf2e49fbbeb tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: Authorizing `identity:create_grant(project_id=2e8182e92169495db6f3647baae244f6, user_id=f6b70c79a07141d5b38e4a95e1f845be, role_id=9036ec41af504117b62484de6123e5b4)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:07.614786 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f195dad7-54a5-4c00-9aef-2bf2e49fbbeb tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:07.649019 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2352/4697] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:29:07 2022] PUT /identity/v3/projects/2e8182e92169495db6f3647baae244f6/users/f6b70c79a07141d5b38e4a95e1f845be/roles/9036ec41af504117b62484de6123e5b4 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:29:07.651592 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b86f3c-3a40-4829-aaee-eb5cc7b630a7 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:07.677692 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b86f3c-3a40-4829-aaee-eb5cc7b630a7 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:07.759663 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=89,keystone:DELETE=5,keystone:UPDATE=1,keystone:INSERT=5 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:29:07.817670 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee27f6ed-fd29-4c11-8398-d9aab9177f61 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b077945a37bc4bf29f5c62b95ff45562', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd2d040691b34adeb5ae75a50f416642', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:07.818900 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee27f6ed-fd29-4c11-8398-d9aab9177f61 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:07.819285 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee27f6ed-fd29-4c11-8398-d9aab9177f61 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:07.819668 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee27f6ed-fd29-4c11-8398-d9aab9177f61 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] PATH_INFO: `/v3/projects/2e8182e92169495db6f3647baae244f6/users/f6b70c79a07141d5b38e4a95e1f845be/roles/6c0b8e6a0b79425b84eb9e5ecf3bc94d` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:07.822438 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee27f6ed-fd29-4c11-8398-d9aab9177f61 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: Authorizing `identity:create_grant(project_id=2e8182e92169495db6f3647baae244f6, user_id=f6b70c79a07141d5b38e4a95e1f845be, role_id=6c0b8e6a0b79425b84eb9e5ecf3bc94d)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:07.825716 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee27f6ed-fd29-4c11-8398-d9aab9177f61 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:07.852234 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2346/4698] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:29:07 2022] PUT /identity/v3/projects/2e8182e92169495db6f3647baae244f6/users/f6b70c79a07141d5b38e4a95e1f845be/roles/6c0b8e6a0b79425b84eb9e5ecf3bc94d => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:29:07.852986 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f195dad7-54a5-4c00-9aef-2bf2e49fbbeb tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:07.868181 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f195dad7-54a5-4c00-9aef-2bf2e49fbbeb tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:07.953952 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f542610e-fdb8-4ab2-8e8c-c15fe365265a tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b077945a37bc4bf29f5c62b95ff45562', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd2d040691b34adeb5ae75a50f416642', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:07.955019 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f542610e-fdb8-4ab2-8e8c-c15fe365265a tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:07.955453 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f542610e-fdb8-4ab2-8e8c-c15fe365265a tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:07.955823 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f542610e-fdb8-4ab2-8e8c-c15fe365265a tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:07.956747 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f542610e-fdb8-4ab2-8e8c-c15fe365265a tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:07.961603 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f542610e-fdb8-4ab2-8e8c-c15fe365265a tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:08.007411 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2353/4699] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:29:07 2022] GET /identity/v3/users => generated 8633 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:29:08.009520 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28eb297-9ea9-4b97-bd9f-3a36b899f453 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:08.009816 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28eb297-9ea9-4b97-bd9f-3a36b899f453 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:08.010127 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28eb297-9ea9-4b97-bd9f-3a36b899f453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:08.075001 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-d28eb297-9ea9-4b97-bd9f-3a36b899f453 None None] MFA Rules not processed for user `f6b70c79a07141d5b38e4a95e1f845be`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:29:08.076348 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-d28eb297-9ea9-4b97-bd9f-3a36b899f453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:08.158442 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2347/4700] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:29:08 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:29:08.168960 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d717c465-a28b-4087-ab35-64a9ae76ff44 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:08.169390 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d717c465-a28b-4087-ab35-64a9ae76ff44 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:08.169816 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d717c465-a28b-4087-ab35-64a9ae76ff44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:08.194958 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-d717c465-a28b-4087-ab35-64a9ae76ff44 None None] MFA Rules not processed for user `f6b70c79a07141d5b38e4a95e1f845be`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:29:08.197301 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-d717c465-a28b-4087-ab35-64a9ae76ff44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:08.216851 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28eb297-9ea9-4b97-bd9f-3a36b899f453 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:08.222277 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2354/4701] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:29:08 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:29:08.237454 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28eb297-9ea9-4b97-bd9f-3a36b899f453 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:08.245072 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ced7229-427b-4f05-8232-902ee335cff2 tempest-TrustsV3TestJSON-472269080 tempest-user-2070268009] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b70c79a07141d5b38e4a95e1f845be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8182e92169495db6f3647baae244f6', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-89887914', 'tempest-DelegatedRole-1241590961'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:08.246032 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ced7229-427b-4f05-8232-902ee335cff2 tempest-TrustsV3TestJSON-472269080 tempest-user-2070268009] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:08.246485 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ced7229-427b-4f05-8232-902ee335cff2 tempest-TrustsV3TestJSON-472269080 tempest-user-2070268009] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:08.247434 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ced7229-427b-4f05-8232-902ee335cff2 tempest-TrustsV3TestJSON-472269080 tempest-user-2070268009] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:08.248555 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ced7229-427b-4f05-8232-902ee335cff2 tempest-TrustsV3TestJSON-472269080 tempest-user-2070268009] RBAC: Authorizing `identity:create_trust()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:08.250536 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ced7229-427b-4f05-8232-902ee335cff2 tempest-TrustsV3TestJSON-472269080 tempest-user-2070268009] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:08.389756 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d717c465-a28b-4087-ab35-64a9ae76ff44 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:08.394101 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2348/4702] 10.222.0.17 () {60 vars in 1173 bytes} [Sat Jul 23 21:29:08 2022] POST /identity/v3/OS-TRUST/trusts => generated 859 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:29:08.402989 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d717c465-a28b-4087-ab35-64a9ae76ff44 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:08.414855 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2c2096-99fc-49b5-af3c-569aa7a9181a tempest-TrustsV3TestJSON-472269080 tempest-user-2070268009] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b70c79a07141d5b38e4a95e1f845be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8182e92169495db6f3647baae244f6', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-89887914', 'tempest-DelegatedRole-1241590961'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:08.415622 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2c2096-99fc-49b5-af3c-569aa7a9181a tempest-TrustsV3TestJSON-472269080 tempest-user-2070268009] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:08.416116 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2c2096-99fc-49b5-af3c-569aa7a9181a tempest-TrustsV3TestJSON-472269080 tempest-user-2070268009] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:08.416267 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2c2096-99fc-49b5-af3c-569aa7a9181a tempest-TrustsV3TestJSON-472269080 tempest-user-2070268009] PATH_INFO: `/v3/OS-TRUST/trusts/14d515ee3165495e8adfd08ea7d06e2e` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:08.436287 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2c2096-99fc-49b5-af3c-569aa7a9181a tempest-TrustsV3TestJSON-472269080 tempest-user-2070268009] RBAC: Authorizing `identity:get_trust(trust_id=14d515ee3165495e8adfd08ea7d06e2e)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:08.438499 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2c2096-99fc-49b5-af3c-569aa7a9181a tempest-TrustsV3TestJSON-472269080 tempest-user-2070268009] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:08.453220 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2355/4703] 10.222.0.17 () {58 vars in 1250 bytes} [Sat Jul 23 21:29:08 2022] GET /identity/v3/OS-TRUST/trusts/14d515ee3165495e8adfd08ea7d06e2e => generated 859 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:29:08.458060 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ced7229-427b-4f05-8232-902ee335cff2 tempest-TrustsV3TestJSON-472269080 tempest-user-2070268009] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:08.480014 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ced7229-427b-4f05-8232-902ee335cff2 tempest-TrustsV3TestJSON-472269080 tempest-user-2070268009] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:08.486522 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e5c8c8-f82f-46e8-b8a9-006ba95492da tempest-TrustsV3TestJSON-472269080 tempest-user-2070268009] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b70c79a07141d5b38e4a95e1f845be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8182e92169495db6f3647baae244f6', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-89887914', 'tempest-DelegatedRole-1241590961'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:08.487741 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e5c8c8-f82f-46e8-b8a9-006ba95492da tempest-TrustsV3TestJSON-472269080 tempest-user-2070268009] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:08.488033 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e5c8c8-f82f-46e8-b8a9-006ba95492da tempest-TrustsV3TestJSON-472269080 tempest-user-2070268009] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:08.488319 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e5c8c8-f82f-46e8-b8a9-006ba95492da tempest-TrustsV3TestJSON-472269080 tempest-user-2070268009] PATH_INFO: `/v3/OS-TRUST/trusts/14d515ee3165495e8adfd08ea7d06e2e/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:08.511011 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e5c8c8-f82f-46e8-b8a9-006ba95492da tempest-TrustsV3TestJSON-472269080 tempest-user-2070268009] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=14d515ee3165495e8adfd08ea7d06e2e)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:08.512477 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e5c8c8-f82f-46e8-b8a9-006ba95492da tempest-TrustsV3TestJSON-472269080 tempest-user-2070268009] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:08.529781 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2349/4704] 10.222.0.17 () {58 vars in 1268 bytes} [Sat Jul 23 21:29:08 2022] GET /identity/v3/OS-TRUST/trusts/14d515ee3165495e8adfd08ea7d06e2e/roles => generated 371 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:29:08.534534 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2c2096-99fc-49b5-af3c-569aa7a9181a tempest-TrustsV3TestJSON-472269080 tempest-user-2070268009] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:08.551938 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2c2096-99fc-49b5-af3c-569aa7a9181a tempest-TrustsV3TestJSON-472269080 tempest-user-2070268009] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:08.559417 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7ab2c2-0fa5-43b6-9235-3d38b842e699 tempest-TrustsV3TestJSON-472269080 tempest-user-2070268009] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b70c79a07141d5b38e4a95e1f845be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8182e92169495db6f3647baae244f6', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-89887914', 'tempest-DelegatedRole-1241590961'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:08.560434 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7ab2c2-0fa5-43b6-9235-3d38b842e699 tempest-TrustsV3TestJSON-472269080 tempest-user-2070268009] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:08.562401 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7ab2c2-0fa5-43b6-9235-3d38b842e699 tempest-TrustsV3TestJSON-472269080 tempest-user-2070268009] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:08.562719 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7ab2c2-0fa5-43b6-9235-3d38b842e699 tempest-TrustsV3TestJSON-472269080 tempest-user-2070268009] PATH_INFO: `/v3/OS-TRUST/trusts/14d515ee3165495e8adfd08ea7d06e2e/roles/9036ec41af504117b62484de6123e5b4` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:08.587425 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7ab2c2-0fa5-43b6-9235-3d38b842e699 tempest-TrustsV3TestJSON-472269080 tempest-user-2070268009] RBAC: Authorizing `identity:get_role_for_trust(trust_id=14d515ee3165495e8adfd08ea7d06e2e, role_id=9036ec41af504117b62484de6123e5b4)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:08.591239 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7ab2c2-0fa5-43b6-9235-3d38b842e699 tempest-TrustsV3TestJSON-472269080 tempest-user-2070268009] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:08.606950 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e5c8c8-f82f-46e8-b8a9-006ba95492da tempest-TrustsV3TestJSON-472269080 tempest-user-2070268009] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:08.620992 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e5c8c8-f82f-46e8-b8a9-006ba95492da tempest-TrustsV3TestJSON-472269080 tempest-user-2070268009] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:08.621932 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2356/4705] 10.222.0.17 () {58 vars in 1367 bytes} [Sat Jul 23 21:29:08 2022] GET /identity/v3/OS-TRUST/trusts/14d515ee3165495e8adfd08ea7d06e2e/roles/9036ec41af504117b62484de6123e5b4 => generated 244 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:29:08.627101 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19766b82-4a4f-4c50-9d1b-32c3b92eff37 tempest-TrustsV3TestJSON-472269080 tempest-user-2070268009] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b70c79a07141d5b38e4a95e1f845be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8182e92169495db6f3647baae244f6', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-89887914', 'tempest-DelegatedRole-1241590961'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:08.627966 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19766b82-4a4f-4c50-9d1b-32c3b92eff37 tempest-TrustsV3TestJSON-472269080 tempest-user-2070268009] REQUEST_METHOD: `HEAD` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:08.628248 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19766b82-4a4f-4c50-9d1b-32c3b92eff37 tempest-TrustsV3TestJSON-472269080 tempest-user-2070268009] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:08.628815 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19766b82-4a4f-4c50-9d1b-32c3b92eff37 tempest-TrustsV3TestJSON-472269080 tempest-user-2070268009] PATH_INFO: `/v3/OS-TRUST/trusts/14d515ee3165495e8adfd08ea7d06e2e/roles/9036ec41af504117b62484de6123e5b4` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:08.639959 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19766b82-4a4f-4c50-9d1b-32c3b92eff37 tempest-TrustsV3TestJSON-472269080 tempest-user-2070268009] RBAC: Authorizing `identity:get_role_for_trust(trust_id=14d515ee3165495e8adfd08ea7d06e2e, role_id=9036ec41af504117b62484de6123e5b4)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:08.642420 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19766b82-4a4f-4c50-9d1b-32c3b92eff37 tempest-TrustsV3TestJSON-472269080 tempest-user-2070268009] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:08.660995 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7ab2c2-0fa5-43b6-9235-3d38b842e699 tempest-TrustsV3TestJSON-472269080 tempest-user-2070268009] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:08.661360 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2350/4706] 10.222.0.17 () {58 vars in 1368 bytes} [Sat Jul 23 21:29:08 2022] HEAD /identity/v3/OS-TRUST/trusts/14d515ee3165495e8adfd08ea7d06e2e/roles/9036ec41af504117b62484de6123e5b4 => generated 0 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Jul 23 21:29:08.687207 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7ab2c2-0fa5-43b6-9235-3d38b842e699 tempest-TrustsV3TestJSON-472269080 tempest-user-2070268009] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:08.705012 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a4426b-cdff-41a1-971f-8d0b5f0b6363 tempest-TrustsV3TestJSON-472269080 tempest-user-2070268009] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b70c79a07141d5b38e4a95e1f845be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8182e92169495db6f3647baae244f6', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-89887914', 'tempest-DelegatedRole-1241590961'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:08.708959 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a4426b-cdff-41a1-971f-8d0b5f0b6363 tempest-TrustsV3TestJSON-472269080 tempest-user-2070268009] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:08.709168 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a4426b-cdff-41a1-971f-8d0b5f0b6363 tempest-TrustsV3TestJSON-472269080 tempest-user-2070268009] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:08.709484 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a4426b-cdff-41a1-971f-8d0b5f0b6363 tempest-TrustsV3TestJSON-472269080 tempest-user-2070268009] PATH_INFO: `/v3/OS-TRUST/trusts/14d515ee3165495e8adfd08ea7d06e2e/roles/6c0b8e6a0b79425b84eb9e5ecf3bc94d` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:08.735248 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a4426b-cdff-41a1-971f-8d0b5f0b6363 tempest-TrustsV3TestJSON-472269080 tempest-user-2070268009] RBAC: Authorizing `identity:get_role_for_trust(trust_id=14d515ee3165495e8adfd08ea7d06e2e, role_id=6c0b8e6a0b79425b84eb9e5ecf3bc94d)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:08.739118 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a4426b-cdff-41a1-971f-8d0b5f0b6363 tempest-TrustsV3TestJSON-472269080 tempest-user-2070268009] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:08.762372 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-f6a4426b-cdff-41a1-971f-8d0b5f0b6363 tempest-TrustsV3TestJSON-472269080 tempest-user-2070268009] Could not find role: 6c0b8e6a0b79425b84eb9e5ecf3bc94d.: keystone.exception.RoleNotFound: Could not find role: 6c0b8e6a0b79425b84eb9e5ecf3bc94d. Jul 23 21:29:08.762372 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 21:29:08.762372 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 21:29:08.762372 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 21:29:08.762372 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 21:29:08.762372 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 21:29:08.762372 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 21:29:08.762372 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 21:29:08.762372 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 21:29:08.762372 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 21:29:08.762372 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 21:29:08.762372 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 21:29:08.762372 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Jul 23 21:29:08.762372 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 21:29:08.763728 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 6c0b8e6a0b79425b84eb9e5ecf3bc94d. Jul 23 21:29:08.763728 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 21:29:08.764154 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2357/4707] 10.222.0.17 () {58 vars in 1367 bytes} [Sat Jul 23 21:29:08 2022] GET /identity/v3/OS-TRUST/trusts/14d515ee3165495e8adfd08ea7d06e2e/roles/6c0b8e6a0b79425b84eb9e5ecf3bc94d => generated 110 bytes in 106 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 23 21:29:08.768325 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19766b82-4a4f-4c50-9d1b-32c3b92eff37 tempest-TrustsV3TestJSON-472269080 tempest-user-2070268009] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:08.779997 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19766b82-4a4f-4c50-9d1b-32c3b92eff37 tempest-TrustsV3TestJSON-472269080 tempest-user-2070268009] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:08.785902 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59730245-a7ac-40a0-84ea-512cf98a4547 tempest-TrustsV3TestJSON-472269080 tempest-user-2070268009] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b70c79a07141d5b38e4a95e1f845be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8182e92169495db6f3647baae244f6', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-89887914', 'tempest-DelegatedRole-1241590961'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:08.788134 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59730245-a7ac-40a0-84ea-512cf98a4547 tempest-TrustsV3TestJSON-472269080 tempest-user-2070268009] REQUEST_METHOD: `HEAD` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:08.789167 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59730245-a7ac-40a0-84ea-512cf98a4547 tempest-TrustsV3TestJSON-472269080 tempest-user-2070268009] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:08.789167 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59730245-a7ac-40a0-84ea-512cf98a4547 tempest-TrustsV3TestJSON-472269080 tempest-user-2070268009] PATH_INFO: `/v3/OS-TRUST/trusts/14d515ee3165495e8adfd08ea7d06e2e/roles/6c0b8e6a0b79425b84eb9e5ecf3bc94d` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:08.794733 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:29:08.804065 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59730245-a7ac-40a0-84ea-512cf98a4547 tempest-TrustsV3TestJSON-472269080 tempest-user-2070268009] RBAC: Authorizing `identity:get_role_for_trust(trust_id=14d515ee3165495e8adfd08ea7d06e2e, role_id=6c0b8e6a0b79425b84eb9e5ecf3bc94d)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:08.808946 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59730245-a7ac-40a0-84ea-512cf98a4547 tempest-TrustsV3TestJSON-472269080 tempest-user-2070268009] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:08.847856 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-59730245-a7ac-40a0-84ea-512cf98a4547 tempest-TrustsV3TestJSON-472269080 tempest-user-2070268009] Could not find role: 6c0b8e6a0b79425b84eb9e5ecf3bc94d.: keystone.exception.RoleNotFound: Could not find role: 6c0b8e6a0b79425b84eb9e5ecf3bc94d. Jul 23 21:29:08.847856 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 21:29:08.847856 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 21:29:08.847856 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 21:29:08.847856 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 21:29:08.847856 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 21:29:08.847856 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 21:29:08.847856 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 21:29:08.847856 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 21:29:08.847856 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 21:29:08.847856 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 21:29:08.847856 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 21:29:08.847856 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Jul 23 21:29:08.847856 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 21:29:08.849348 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 6c0b8e6a0b79425b84eb9e5ecf3bc94d. Jul 23 21:29:08.849348 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 21:29:08.849693 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2351/4708] 10.222.0.17 () {58 vars in 1368 bytes} [Sat Jul 23 21:29:08 2022] HEAD /identity/v3/OS-TRUST/trusts/14d515ee3165495e8adfd08ea7d06e2e/roles/6c0b8e6a0b79425b84eb9e5ecf3bc94d => generated 0 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 184 bytes (0 switches on core 0) Jul 23 21:29:08.853669 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a4426b-cdff-41a1-971f-8d0b5f0b6363 tempest-TrustsV3TestJSON-472269080 tempest-user-2070268009] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:08.868012 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a4426b-cdff-41a1-971f-8d0b5f0b6363 tempest-TrustsV3TestJSON-472269080 tempest-user-2070268009] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:08.873721 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24e41be-e4a6-412d-a716-14bca0b04765 tempest-TrustsV3TestJSON-472269080 tempest-user-2070268009] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b70c79a07141d5b38e4a95e1f845be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8182e92169495db6f3647baae244f6', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-89887914', 'tempest-DelegatedRole-1241590961'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:08.874942 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24e41be-e4a6-412d-a716-14bca0b04765 tempest-TrustsV3TestJSON-472269080 tempest-user-2070268009] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:08.876024 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24e41be-e4a6-412d-a716-14bca0b04765 tempest-TrustsV3TestJSON-472269080 tempest-user-2070268009] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:08.876579 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24e41be-e4a6-412d-a716-14bca0b04765 tempest-TrustsV3TestJSON-472269080 tempest-user-2070268009] PATH_INFO: `/v3/OS-TRUST/trusts/14d515ee3165495e8adfd08ea7d06e2e` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:08.897343 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24e41be-e4a6-412d-a716-14bca0b04765 tempest-TrustsV3TestJSON-472269080 tempest-user-2070268009] RBAC: Authorizing `identity:delete_trust(trust_id=14d515ee3165495e8adfd08ea7d06e2e)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:08.900577 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24e41be-e4a6-412d-a716-14bca0b04765 tempest-TrustsV3TestJSON-472269080 tempest-user-2070268009] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:08.964254 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-c24e41be-e4a6-412d-a716-14bca0b04765 tempest-TrustsV3TestJSON-472269080 tempest-user-2070268009] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '14d515ee3165495e8adfd08ea7d06e2e', 'request_id': 'req-c24e41be-e4a6-412d-a716-14bca0b04765'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:08.965040 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-c24e41be-e4a6-412d-a716-14bca0b04765 tempest-TrustsV3TestJSON-472269080 tempest-user-2070268009] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '14d515ee3165495e8adfd08ea7d06e2e', 'request_id': 'req-c24e41be-e4a6-412d-a716-14bca0b04765'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:08.983870 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-c24e41be-e4a6-412d-a716-14bca0b04765 tempest-TrustsV3TestJSON-472269080 tempest-user-2070268009] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '14d515ee3165495e8adfd08ea7d06e2e', 'request_id': 'req-c24e41be-e4a6-412d-a716-14bca0b04765'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:08.999153 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2358/4709] 10.222.0.17 () {58 vars in 1253 bytes} [Sat Jul 23 21:29:08 2022] DELETE /identity/v3/OS-TRUST/trusts/14d515ee3165495e8adfd08ea7d06e2e => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:29:09.000901 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59730245-a7ac-40a0-84ea-512cf98a4547 tempest-TrustsV3TestJSON-472269080 tempest-user-2070268009] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:09.003229 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-59730245-a7ac-40a0-84ea-512cf98a4547 tempest-TrustsV3TestJSON-472269080 tempest-user-2070268009] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:09.032741 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59730245-a7ac-40a0-84ea-512cf98a4547 tempest-TrustsV3TestJSON-472269080 tempest-user-2070268009] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:09.036126 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6ff210-3915-4be3-9929-b9c9f55f97e9 tempest-TrustsV3TestJSON-472269080 tempest-user-2070268009] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b70c79a07141d5b38e4a95e1f845be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8182e92169495db6f3647baae244f6', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-89887914', 'tempest-DelegatedRole-1241590961'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:09.036641 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6ff210-3915-4be3-9929-b9c9f55f97e9 tempest-TrustsV3TestJSON-472269080 tempest-user-2070268009] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:09.036927 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6ff210-3915-4be3-9929-b9c9f55f97e9 tempest-TrustsV3TestJSON-472269080 tempest-user-2070268009] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:09.037247 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6ff210-3915-4be3-9929-b9c9f55f97e9 tempest-TrustsV3TestJSON-472269080 tempest-user-2070268009] PATH_INFO: `/v3/OS-TRUST/trusts/14d515ee3165495e8adfd08ea7d06e2e` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:09.068862 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-1c6ff210-3915-4be3-9929-b9c9f55f97e9 tempest-TrustsV3TestJSON-472269080 tempest-user-2070268009] Could not find trust: 14d515ee3165495e8adfd08ea7d06e2e.: keystone.exception.TrustNotFound: Could not find trust: 14d515ee3165495e8adfd08ea7d06e2e. Jul 23 21:29:09.068862 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 21:29:09.068862 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 21:29:09.068862 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 21:29:09.068862 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 21:29:09.068862 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 21:29:09.068862 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 21:29:09.068862 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 21:29:09.068862 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 21:29:09.068862 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 21:29:09.068862 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 21:29:09.068862 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 21:29:09.068862 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Jul 23 21:29:09.068862 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Jul 23 21:29:09.068862 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Jul 23 21:29:09.070577 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Jul 23 21:29:09.070577 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Jul 23 21:29:09.070577 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Jul 23 21:29:09.070577 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Jul 23 21:29:09.070577 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Jul 23 21:29:09.070577 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 21:29:09.070577 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 21:29:09.070577 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Jul 23 21:29:09.070577 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Jul 23 21:29:09.070577 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Jul 23 21:29:09.070577 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Jul 23 21:29:09.070577 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: 14d515ee3165495e8adfd08ea7d06e2e. Jul 23 21:29:09.070577 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 21:29:09.073815 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2352/4710] 10.222.0.17 () {58 vars in 1250 bytes} [Sat Jul 23 21:29:08 2022] GET /identity/v3/OS-TRUST/trusts/14d515ee3165495e8adfd08ea7d06e2e => generated 111 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Jul 23 21:29:09.079873 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24e41be-e4a6-412d-a716-14bca0b04765 tempest-TrustsV3TestJSON-472269080 tempest-user-2070268009] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:09.082476 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-c24e41be-e4a6-412d-a716-14bca0b04765 tempest-TrustsV3TestJSON-472269080 tempest-user-2070268009] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:09.117143 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6ff210-3915-4be3-9929-b9c9f55f97e9 tempest-TrustsV3TestJSON-472269080 tempest-user-2070268009] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:09.119284 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-1c6ff210-3915-4be3-9929-b9c9f55f97e9 tempest-TrustsV3TestJSON-472269080 tempest-user-2070268009] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:09.153096 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24e41be-e4a6-412d-a716-14bca0b04765 tempest-TrustsV3TestJSON-472269080 tempest-user-2070268009] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:09.167166 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7718c5a-6295-4fe2-b827-1a36d140621e tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b077945a37bc4bf29f5c62b95ff45562', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd2d040691b34adeb5ae75a50f416642', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:09.174062 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7718c5a-6295-4fe2-b827-1a36d140621e tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:09.174628 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7718c5a-6295-4fe2-b827-1a36d140621e tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:09.175132 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7718c5a-6295-4fe2-b827-1a36d140621e tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] PATH_INFO: `/v3/roles/6c0b8e6a0b79425b84eb9e5ecf3bc94d` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:09.182301 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7718c5a-6295-4fe2-b827-1a36d140621e tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: Authorizing `identity:delete_role(role_id=6c0b8e6a0b79425b84eb9e5ecf3bc94d)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:09.186844 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7718c5a-6295-4fe2-b827-1a36d140621e tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:09.257208 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:UPDATE=1,keystone:DELETE=3 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:29:09.300900 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-c7718c5a-6295-4fe2-b827-1a36d140621e tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Invalidating the token cache because role 6c0b8e6a0b79425b84eb9e5ecf3bc94d has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:29:09.301284 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-c7718c5a-6295-4fe2-b827-1a36d140621e tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:09.302062 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-c7718c5a-6295-4fe2-b827-1a36d140621e tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:09.304274 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2359/4711] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:29:09 2022] DELETE /identity/v3/roles/6c0b8e6a0b79425b84eb9e5ecf3bc94d => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:29:09.315270 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7718c5a-6295-4fe2-b827-1a36d140621e tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:09.317179 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-c7718c5a-6295-4fe2-b827-1a36d140621e tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:09.320011 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6ff210-3915-4be3-9929-b9c9f55f97e9 tempest-TrustsV3TestJSON-472269080 tempest-user-2070268009] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:09.536534 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7718c5a-6295-4fe2-b827-1a36d140621e tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:09.555807 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57de5c8e-3391-4d77-a94a-c89f2bb03d9d tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b077945a37bc4bf29f5c62b95ff45562', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd2d040691b34adeb5ae75a50f416642', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:09.558770 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57de5c8e-3391-4d77-a94a-c89f2bb03d9d tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:09.559066 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57de5c8e-3391-4d77-a94a-c89f2bb03d9d tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:09.560500 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57de5c8e-3391-4d77-a94a-c89f2bb03d9d tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] PATH_INFO: `/v3/roles/9036ec41af504117b62484de6123e5b4` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:09.563504 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57de5c8e-3391-4d77-a94a-c89f2bb03d9d tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: Authorizing `identity:delete_role(role_id=9036ec41af504117b62484de6123e5b4)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:09.563825 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be5eb8c-26b1-40a2-a248-03fa443829b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:09.567190 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be5eb8c-26b1-40a2-a248-03fa443829b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:09.568271 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be5eb8c-26b1-40a2-a248-03fa443829b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:09.568573 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be5eb8c-26b1-40a2-a248-03fa443829b0 admin admin] PATH_INFO: `/v3/users/a7a723a102d34fbfa2662b07f9b10fc8` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:09.570930 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57de5c8e-3391-4d77-a94a-c89f2bb03d9d tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:09.575668 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be5eb8c-26b1-40a2-a248-03fa443829b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7a723a102d34fbfa2662b07f9b10fc8)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:09.584595 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be5eb8c-26b1-40a2-a248-03fa443829b0 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:09.681297 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-57de5c8e-3391-4d77-a94a-c89f2bb03d9d tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Invalidating the token cache because role 9036ec41af504117b62484de6123e5b4 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:29:09.682003 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-57de5c8e-3391-4d77-a94a-c89f2bb03d9d tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:09.683994 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-57de5c8e-3391-4d77-a94a-c89f2bb03d9d tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:09.691075 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2360/4712] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:29:09 2022] DELETE /identity/v3/roles/9036ec41af504117b62484de6123e5b4 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:29:09.695516 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57de5c8e-3391-4d77-a94a-c89f2bb03d9d tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:09.697243 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-57de5c8e-3391-4d77-a94a-c89f2bb03d9d tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:09.744673 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-7be5eb8c-26b1-40a2-a248-03fa443829b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7a723a102d34fbfa2662b07f9b10fc8'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:09.748255 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-7be5eb8c-26b1-40a2-a248-03fa443829b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7a723a102d34fbfa2662b07f9b10fc8'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:09.761054 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-7be5eb8c-26b1-40a2-a248-03fa443829b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7a723a102d34fbfa2662b07f9b10fc8'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:09.773052 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-7be5eb8c-26b1-40a2-a248-03fa443829b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7a723a102d34fbfa2662b07f9b10fc8'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:09.788363 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-7be5eb8c-26b1-40a2-a248-03fa443829b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7a723a102d34fbfa2662b07f9b10fc8'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:09.800820 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2353/4713] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:29:09 2022] DELETE /identity/v3/users/a7a723a102d34fbfa2662b07f9b10fc8 => generated 0 bytes in 681 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:29:09.818490 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57de5c8e-3391-4d77-a94a-c89f2bb03d9d tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:09.930639 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996ad6fa-00bb-4a06-9843-fe676d077a99 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b077945a37bc4bf29f5c62b95ff45562', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd2d040691b34adeb5ae75a50f416642', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:09.931693 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996ad6fa-00bb-4a06-9843-fe676d077a99 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:09.932461 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996ad6fa-00bb-4a06-9843-fe676d077a99 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:09.932749 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996ad6fa-00bb-4a06-9843-fe676d077a99 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] PATH_INFO: `/v3/users/f6b70c79a07141d5b38e4a95e1f845be` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:09.934297 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996ad6fa-00bb-4a06-9843-fe676d077a99 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: Authorizing `identity:delete_user(user_id=f6b70c79a07141d5b38e4a95e1f845be)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:09.936372 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996ad6fa-00bb-4a06-9843-fe676d077a99 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:09.942665 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:29:10.027468 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-996ad6fa-00bb-4a06-9843-fe676d077a99 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6b70c79a07141d5b38e4a95e1f845be'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:10.053092 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-996ad6fa-00bb-4a06-9843-fe676d077a99 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6b70c79a07141d5b38e4a95e1f845be'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:10.054217 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-996ad6fa-00bb-4a06-9843-fe676d077a99 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6b70c79a07141d5b38e4a95e1f845be'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:10.069830 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-996ad6fa-00bb-4a06-9843-fe676d077a99 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6b70c79a07141d5b38e4a95e1f845be'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:10.089424 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-996ad6fa-00bb-4a06-9843-fe676d077a99 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6b70c79a07141d5b38e4a95e1f845be'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:10.096532 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2361/4714] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:29:09 2022] DELETE /identity/v3/users/f6b70c79a07141d5b38e4a95e1f845be => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:29:10.100744 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be5eb8c-26b1-40a2-a248-03fa443829b0 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:10.102253 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-7be5eb8c-26b1-40a2-a248-03fa443829b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:10.168084 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be5eb8c-26b1-40a2-a248-03fa443829b0 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:10.178627 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:29:10.265457 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bba271-52bb-4ed9-b821-aefbc5239b7b tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b077945a37bc4bf29f5c62b95ff45562', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd2d040691b34adeb5ae75a50f416642', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:10.265457 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bba271-52bb-4ed9-b821-aefbc5239b7b tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:10.265457 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bba271-52bb-4ed9-b821-aefbc5239b7b tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:10.265982 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bba271-52bb-4ed9-b821-aefbc5239b7b tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] PATH_INFO: `/v3/projects/2e8182e92169495db6f3647baae244f6` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:10.265982 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bba271-52bb-4ed9-b821-aefbc5239b7b tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: Authorizing `identity:delete_project(project_id=2e8182e92169495db6f3647baae244f6)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:10.265982 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bba271-52bb-4ed9-b821-aefbc5239b7b tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:10.302702 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996ad6fa-00bb-4a06-9843-fe676d077a99 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:10.304401 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-996ad6fa-00bb-4a06-9843-fe676d077a99 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:10.346077 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-e0bba271-52bb-4ed9-b821-aefbc5239b7b tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e8182e92169495db6f3647baae244f6', 'request_id': 'req-e0bba271-52bb-4ed9-b821-aefbc5239b7b'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:10.356651 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-e0bba271-52bb-4ed9-b821-aefbc5239b7b tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e8182e92169495db6f3647baae244f6', 'request_id': 'req-e0bba271-52bb-4ed9-b821-aefbc5239b7b'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:10.366068 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-e0bba271-52bb-4ed9-b821-aefbc5239b7b tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e8182e92169495db6f3647baae244f6', 'request_id': 'req-e0bba271-52bb-4ed9-b821-aefbc5239b7b'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:10.379259 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-e0bba271-52bb-4ed9-b821-aefbc5239b7b tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] The token cache is being invalidate because project 2e8182e92169495db6f3647baae244f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:29:10.379547 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-e0bba271-52bb-4ed9-b821-aefbc5239b7b tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:10.380230 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-e0bba271-52bb-4ed9-b821-aefbc5239b7b tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:10.386506 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2354/4715] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:29:10 2022] DELETE /identity/v3/projects/2e8182e92169495db6f3647baae244f6 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:29:10.397961 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bba271-52bb-4ed9-b821-aefbc5239b7b tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:10.399371 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-e0bba271-52bb-4ed9-b821-aefbc5239b7b tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:10.407747 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996ad6fa-00bb-4a06-9843-fe676d077a99 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:10.496534 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83b5ae8-14ed-4660-98e2-71efc2809c79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:10.497481 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83b5ae8-14ed-4660-98e2-71efc2809c79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:10.497759 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83b5ae8-14ed-4660-98e2-71efc2809c79 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:10.498057 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83b5ae8-14ed-4660-98e2-71efc2809c79 admin admin] PATH_INFO: `/v3/projects/15e47587982546ff87e06be741d68b96` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:10.499701 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83b5ae8-14ed-4660-98e2-71efc2809c79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=15e47587982546ff87e06be741d68b96)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:10.501741 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83b5ae8-14ed-4660-98e2-71efc2809c79 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:10.556193 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bba271-52bb-4ed9-b821-aefbc5239b7b tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:10.568694 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d5e0ef-18fb-4776-bb25-ba521f7a8d70 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b077945a37bc4bf29f5c62b95ff45562', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd2d040691b34adeb5ae75a50f416642', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:10.569533 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d5e0ef-18fb-4776-bb25-ba521f7a8d70 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:10.569905 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d5e0ef-18fb-4776-bb25-ba521f7a8d70 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:10.570239 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d5e0ef-18fb-4776-bb25-ba521f7a8d70 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:10.572108 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d5e0ef-18fb-4776-bb25-ba521f7a8d70 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:10.579576 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d5e0ef-18fb-4776-bb25-ba521f7a8d70 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:10.580987 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:29:10.615405 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-e83b5ae8-14ed-4660-98e2-71efc2809c79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15e47587982546ff87e06be741d68b96', 'request_id': 'req-e83b5ae8-14ed-4660-98e2-71efc2809c79'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:10.645614 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2355/4716] 10.222.0.17 () {60 vars in 1151 bytes} [Sat Jul 23 21:29:10 2022] POST /identity/v3/projects => generated 328 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:29:10.646675 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d5e0ef-18fb-4776-bb25-ba521f7a8d70 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:10.669883 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-e83b5ae8-14ed-4660-98e2-71efc2809c79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15e47587982546ff87e06be741d68b96', 'request_id': 'req-e83b5ae8-14ed-4660-98e2-71efc2809c79'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:10.677148 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-e83b5ae8-14ed-4660-98e2-71efc2809c79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15e47587982546ff87e06be741d68b96', 'request_id': 'req-e83b5ae8-14ed-4660-98e2-71efc2809c79'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:10.694213 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:UPDATE=1,keystone:INSERT=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:29:10.719043 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-e83b5ae8-14ed-4660-98e2-71efc2809c79 admin admin] The token cache is being invalidate because project 15e47587982546ff87e06be741d68b96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:29:10.719335 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-e83b5ae8-14ed-4660-98e2-71efc2809c79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:10.720088 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-e83b5ae8-14ed-4660-98e2-71efc2809c79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:10.727138 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2362/4717] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:29:10 2022] DELETE /identity/v3/projects/15e47587982546ff87e06be741d68b96 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:29:10.729794 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766f0dae-b7a3-466c-819c-db2bb20aaa24 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:10.729794 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766f0dae-b7a3-466c-819c-db2bb20aaa24 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:10.730062 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766f0dae-b7a3-466c-819c-db2bb20aaa24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:10.785768 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-766f0dae-b7a3-466c-819c-db2bb20aaa24 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:29:10.790365 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-766f0dae-b7a3-466c-819c-db2bb20aaa24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:10.817656 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d5e0ef-18fb-4776-bb25-ba521f7a8d70 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:10.825018 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccd52e3-69ba-405b-afed-7fe2660626ea tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b077945a37bc4bf29f5c62b95ff45562', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd2d040691b34adeb5ae75a50f416642', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:10.825725 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccd52e3-69ba-405b-afed-7fe2660626ea tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:10.826143 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccd52e3-69ba-405b-afed-7fe2660626ea tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:10.826270 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccd52e3-69ba-405b-afed-7fe2660626ea tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:10.831953 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccd52e3-69ba-405b-afed-7fe2660626ea tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:10.834270 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccd52e3-69ba-405b-afed-7fe2660626ea tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:10.878670 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2356/4718] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:29:10 2022] POST /identity/v3/users => generated 413 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:29:10.882869 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccd52e3-69ba-405b-afed-7fe2660626ea tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:10.888156 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-5ccd52e3-69ba-405b-afed-7fe2660626ea tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:10.903785 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2363/4719] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:29:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:29:10.911363 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255f9426-1975-44ae-9577-a4efe6ce50f9 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:10.911649 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255f9426-1975-44ae-9577-a4efe6ce50f9 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:10.911924 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255f9426-1975-44ae-9577-a4efe6ce50f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:10.913640 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccd52e3-69ba-405b-afed-7fe2660626ea tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:10.921661 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0ab5ac-4cf4-406f-8340-c7c77317aab0 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b077945a37bc4bf29f5c62b95ff45562', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd2d040691b34adeb5ae75a50f416642', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:10.922704 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0ab5ac-4cf4-406f-8340-c7c77317aab0 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:10.923184 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0ab5ac-4cf4-406f-8340-c7c77317aab0 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:10.923635 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0ab5ac-4cf4-406f-8340-c7c77317aab0 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:10.924615 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0ab5ac-4cf4-406f-8340-c7c77317aab0 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:10.926873 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0ab5ac-4cf4-406f-8340-c7c77317aab0 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:10.942232 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-255f9426-1975-44ae-9577-a4efe6ce50f9 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:29:10.944191 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-255f9426-1975-44ae-9577-a4efe6ce50f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:10.949417 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2357/4720] 10.222.0.17 () {60 vars in 1142 bytes} [Sat Jul 23 21:29:10 2022] POST /identity/v3/roles => generated 243 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:29:10.953326 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0ab5ac-4cf4-406f-8340-c7c77317aab0 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:10.954739 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2364/4721] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:29:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:29:10.960706 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255f9426-1975-44ae-9577-a4efe6ce50f9 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:10.973355 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0ab5ac-4cf4-406f-8340-c7c77317aab0 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:10.973936 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255f9426-1975-44ae-9577-a4efe6ce50f9 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:10.980303 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332805a2-80ce-4f38-97b4-a5677b0779a1 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b077945a37bc4bf29f5c62b95ff45562', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd2d040691b34adeb5ae75a50f416642', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:10.981540 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332805a2-80ce-4f38-97b4-a5677b0779a1 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:10.981540 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332805a2-80ce-4f38-97b4-a5677b0779a1 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:10.981815 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332805a2-80ce-4f38-97b4-a5677b0779a1 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:10.982482 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e66c49-3762-43f7-9ef1-7c92b489f47d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:10.983082 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332805a2-80ce-4f38-97b4-a5677b0779a1 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:10.983592 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e66c49-3762-43f7-9ef1-7c92b489f47d admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:10.983818 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e66c49-3762-43f7-9ef1-7c92b489f47d admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:10.984155 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e66c49-3762-43f7-9ef1-7c92b489f47d admin admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:10.985110 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e66c49-3762-43f7-9ef1-7c92b489f47d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:29:10.985467 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e66c49-3762-43f7-9ef1-7c92b489f47d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:10.986509 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332805a2-80ce-4f38-97b4-a5677b0779a1 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:10.987554 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e66c49-3762-43f7-9ef1-7c92b489f47d admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:11.008686 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2358/4722] 10.222.0.17 () {60 vars in 1142 bytes} [Sat Jul 23 21:29:10 2022] POST /identity/v3/roles => generated 246 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:29:11.009279 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2365/4723] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:29:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 21:29:11.013913 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e66c49-3762-43f7-9ef1-7c92b489f47d admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:11.014223 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332805a2-80ce-4f38-97b4-a5677b0779a1 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:11.029385 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332805a2-80ce-4f38-97b4-a5677b0779a1 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:11.035170 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e66c49-3762-43f7-9ef1-7c92b489f47d admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:11.036037 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33e0879-449d-4fc8-b5ec-01160fd174eb tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b077945a37bc4bf29f5c62b95ff45562', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd2d040691b34adeb5ae75a50f416642', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:11.037481 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33e0879-449d-4fc8-b5ec-01160fd174eb tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:11.038152 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33e0879-449d-4fc8-b5ec-01160fd174eb tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:11.038385 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33e0879-449d-4fc8-b5ec-01160fd174eb tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] PATH_INFO: `/v3/projects/1614a7d30d754e2f8570115fe323890f/users/008dfe20cb454a73a7b3898a58b31eef/roles/2e6fce3bd7334952ac756a915c30f2ff` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:11.041710 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9388b7c4-8c89-45f1-b5d6-cc29a9f76584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:11.042643 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9388b7c4-8c89-45f1-b5d6-cc29a9f76584 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:11.043102 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9388b7c4-8c89-45f1-b5d6-cc29a9f76584 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:11.043522 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9388b7c4-8c89-45f1-b5d6-cc29a9f76584 admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:11.045380 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9388b7c4-8c89-45f1-b5d6-cc29a9f76584 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:11.047717 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9388b7c4-8c89-45f1-b5d6-cc29a9f76584 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:11.065978 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33e0879-449d-4fc8-b5ec-01160fd174eb tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: Authorizing `identity:create_grant(project_id=1614a7d30d754e2f8570115fe323890f, user_id=008dfe20cb454a73a7b3898a58b31eef, role_id=2e6fce3bd7334952ac756a915c30f2ff)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:11.069197 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33e0879-449d-4fc8-b5ec-01160fd174eb tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:11.094325 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2359/4724] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:29:11 2022] PUT /identity/v3/projects/1614a7d30d754e2f8570115fe323890f/users/008dfe20cb454a73a7b3898a58b31eef/roles/2e6fce3bd7334952ac756a915c30f2ff => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:29:11.098817 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33e0879-449d-4fc8-b5ec-01160fd174eb tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:11.107138 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2366/4725] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:29:11 2022] POST /identity/v3/projects => generated 371 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:29:11.109056 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9388b7c4-8c89-45f1-b5d6-cc29a9f76584 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:11.211465 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9388b7c4-8c89-45f1-b5d6-cc29a9f76584 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:11.216942 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323dab31-81ab-4299-87c4-66438bace8c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:11.217746 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323dab31-81ab-4299-87c4-66438bace8c6 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:11.218058 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323dab31-81ab-4299-87c4-66438bace8c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:11.218363 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323dab31-81ab-4299-87c4-66438bace8c6 admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:11.219178 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323dab31-81ab-4299-87c4-66438bace8c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:11.221537 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323dab31-81ab-4299-87c4-66438bace8c6 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:11.223188 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33e0879-449d-4fc8-b5ec-01160fd174eb tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:11.263815 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2367/4726] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:29:11 2022] POST /identity/v3/users => generated 286 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:29:11.268274 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323dab31-81ab-4299-87c4-66438bace8c6 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:11.293728 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323dab31-81ab-4299-87c4-66438bace8c6 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:11.310709 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c4f800-2939-4938-ab62-a8c1357354c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:11.312082 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c4f800-2939-4938-ab62-a8c1357354c0 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:11.312082 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c4f800-2939-4938-ab62-a8c1357354c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:11.312082 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c4f800-2939-4938-ab62-a8c1357354c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:11.312890 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c4f800-2939-4938-ab62-a8c1357354c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:11.314790 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c4f800-2939-4938-ab62-a8c1357354c0 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:11.329131 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:29:11.341749 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2368/4727] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:29:11 2022] GET /identity/v3/roles => generated 1891 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 21:29:11.346990 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c4f800-2939-4938-ab62-a8c1357354c0 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:11.380334 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c4f800-2939-4938-ab62-a8c1357354c0 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:11.394850 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc724dcf-1517-4672-babb-7ea591d86a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:11.395202 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7e6fb6-2366-4f4f-aafc-a1e2a19b114e tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b077945a37bc4bf29f5c62b95ff45562', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd2d040691b34adeb5ae75a50f416642', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:11.395624 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc724dcf-1517-4672-babb-7ea591d86a8a admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:11.395908 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc724dcf-1517-4672-babb-7ea591d86a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:11.396177 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc724dcf-1517-4672-babb-7ea591d86a8a admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:11.396923 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc724dcf-1517-4672-babb-7ea591d86a8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:11.397190 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7e6fb6-2366-4f4f-aafc-a1e2a19b114e tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:11.398022 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7e6fb6-2366-4f4f-aafc-a1e2a19b114e tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:11.398498 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7e6fb6-2366-4f4f-aafc-a1e2a19b114e tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] PATH_INFO: `/v3/projects/1614a7d30d754e2f8570115fe323890f/users/008dfe20cb454a73a7b3898a58b31eef/roles/61c85d5deef34d7390761e98eae61bbb` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:11.402388 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7e6fb6-2366-4f4f-aafc-a1e2a19b114e tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: Authorizing `identity:create_grant(project_id=1614a7d30d754e2f8570115fe323890f, user_id=008dfe20cb454a73a7b3898a58b31eef, role_id=61c85d5deef34d7390761e98eae61bbb)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:11.402575 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc724dcf-1517-4672-babb-7ea591d86a8a admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:11.406360 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7e6fb6-2366-4f4f-aafc-a1e2a19b114e tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:11.420517 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2369/4728] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:29:11 2022] GET /identity/v3/roles => generated 1891 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 21:29:11.425444 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc724dcf-1517-4672-babb-7ea591d86a8a admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:11.431409 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:29:11.444202 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2360/4729] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:29:11 2022] PUT /identity/v3/projects/1614a7d30d754e2f8570115fe323890f/users/008dfe20cb454a73a7b3898a58b31eef/roles/61c85d5deef34d7390761e98eae61bbb => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:29:11.453052 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc724dcf-1517-4672-babb-7ea591d86a8a admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:11.456542 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7e6fb6-2366-4f4f-aafc-a1e2a19b114e tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:11.599437 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7e6fb6-2366-4f4f-aafc-a1e2a19b114e tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:11.607166 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f67366-58f2-44d8-85d3-e62516e245f4 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b077945a37bc4bf29f5c62b95ff45562', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd2d040691b34adeb5ae75a50f416642', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:11.608364 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f67366-58f2-44d8-85d3-e62516e245f4 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:11.608728 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f67366-58f2-44d8-85d3-e62516e245f4 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:11.609098 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f67366-58f2-44d8-85d3-e62516e245f4 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:11.609970 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f67366-58f2-44d8-85d3-e62516e245f4 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:11.625794 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f67366-58f2-44d8-85d3-e62516e245f4 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:11.626894 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba80c133-47da-4b0c-954a-d1be980b5d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:11.627826 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba80c133-47da-4b0c-954a-d1be980b5d46 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:11.628104 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba80c133-47da-4b0c-954a-d1be980b5d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:11.628377 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba80c133-47da-4b0c-954a-d1be980b5d46 admin admin] PATH_INFO: `/v3/projects/aa1e19260e3448e08f349cbd4c4a3f70/users/ca13fa56f9a342b69f198080ef10acaa/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:11.665102 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba80c133-47da-4b0c-954a-d1be980b5d46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa1e19260e3448e08f349cbd4c4a3f70, user_id=ca13fa56f9a342b69f198080ef10acaa, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:11.668061 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba80c133-47da-4b0c-954a-d1be980b5d46 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:11.674351 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2361/4730] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:29:11 2022] GET /identity/v3/users => generated 8621 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:29:11.675881 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbfd12c-69a2-46fc-8859-aabc95c3128c None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:11.676223 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbfd12c-69a2-46fc-8859-aabc95c3128c None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:11.676561 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbfd12c-69a2-46fc-8859-aabc95c3128c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:11.691594 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2370/4731] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:29:11 2022] PUT /identity/v3/projects/aa1e19260e3448e08f349cbd4c4a3f70/users/ca13fa56f9a342b69f198080ef10acaa/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:29:11.697518 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba80c133-47da-4b0c-954a-d1be980b5d46 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:11.700048 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-ba80c133-47da-4b0c-954a-d1be980b5d46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:11.743870 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-ddbfd12c-69a2-46fc-8859-aabc95c3128c None None] MFA Rules not processed for user `008dfe20cb454a73a7b3898a58b31eef`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:29:11.745831 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-ddbfd12c-69a2-46fc-8859-aabc95c3128c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:11.832855 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba80c133-47da-4b0c-954a-d1be980b5d46 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:11.839513 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b54ffbd-0dd4-4cfd-a54c-d5dad6fc7c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:11.840492 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b54ffbd-0dd4-4cfd-a54c-d5dad6fc7c12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:11.840836 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b54ffbd-0dd4-4cfd-a54c-d5dad6fc7c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:11.841341 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b54ffbd-0dd4-4cfd-a54c-d5dad6fc7c12 admin admin] PATH_INFO: `/v3/users/b2195c4a35b84440ab6be41a7aeccc0c` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:11.843591 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b54ffbd-0dd4-4cfd-a54c-d5dad6fc7c12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2195c4a35b84440ab6be41a7aeccc0c)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:11.845786 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b54ffbd-0dd4-4cfd-a54c-d5dad6fc7c12 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:11.850287 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2362/4732] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:29:11 2022] POST /identity/v3/auth/tokens => generated 3267 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:29:11.864807 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdb6961-31cb-4b28-a42e-e59fbd333f87 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:11.869422 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdb6961-31cb-4b28-a42e-e59fbd333f87 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:11.869855 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdb6961-31cb-4b28-a42e-e59fbd333f87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:11.894100 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-7bdb6961-31cb-4b28-a42e-e59fbd333f87 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:29:11.895748 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-7bdb6961-31cb-4b28-a42e-e59fbd333f87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:11.904800 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2363/4733] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:29:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:29:11.906279 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ed1fc0-b2a3-4706-bbad-220d6b3a8046 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:11.906680 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ed1fc0-b2a3-4706-bbad-220d6b3a8046 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:11.907048 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ed1fc0-b2a3-4706-bbad-220d6b3a8046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:11.934703 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-e7ed1fc0-b2a3-4706-bbad-220d6b3a8046 None None] MFA Rules not processed for user `008dfe20cb454a73a7b3898a58b31eef`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:29:11.936306 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-e7ed1fc0-b2a3-4706-bbad-220d6b3a8046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:11.956463 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2364/4734] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:29:11 2022] POST /identity/v3/auth/tokens => generated 3267 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:29:11.956463 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ed1fc0-b2a3-4706-bbad-220d6b3a8046 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:11.956931 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-e7ed1fc0-b2a3-4706-bbad-220d6b3a8046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:11.982448 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-7b54ffbd-0dd4-4cfd-a54c-d5dad6fc7c12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2195c4a35b84440ab6be41a7aeccc0c'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:12.005181 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-7b54ffbd-0dd4-4cfd-a54c-d5dad6fc7c12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2195c4a35b84440ab6be41a7aeccc0c'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:12.006866 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-7b54ffbd-0dd4-4cfd-a54c-d5dad6fc7c12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2195c4a35b84440ab6be41a7aeccc0c'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:12.028749 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-7b54ffbd-0dd4-4cfd-a54c-d5dad6fc7c12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2195c4a35b84440ab6be41a7aeccc0c'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:12.044359 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:29:12.056915 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-7b54ffbd-0dd4-4cfd-a54c-d5dad6fc7c12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2195c4a35b84440ab6be41a7aeccc0c'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:12.072029 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ed1fc0-b2a3-4706-bbad-220d6b3a8046 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:12.076980 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa20de7-62c4-4283-a51d-b6e38818f507 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:12.077655 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa20de7-62c4-4283-a51d-b6e38818f507 service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:12.077967 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa20de7-62c4-4283-a51d-b6e38818f507 service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:12.078293 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa20de7-62c4-4283-a51d-b6e38818f507 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:12.080255 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-0aa20de7-62c4-4283-a51d-b6e38818f507 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:12.086254 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2371/4735] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:29:11 2022] DELETE /identity/v3/users/b2195c4a35b84440ab6be41a7aeccc0c => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:29:12.087424 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b54ffbd-0dd4-4cfd-a54c-d5dad6fc7c12 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:12.090834 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-7b54ffbd-0dd4-4cfd-a54c-d5dad6fc7c12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:12.099530 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa20de7-62c4-4283-a51d-b6e38818f507 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:12.101072 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa20de7-62c4-4283-a51d-b6e38818f507 service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:12.112628 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2365/4736] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:29:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:29:12.114063 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1bb107-175e-40e7-b1a5-540543efb2b8 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:12.114398 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1bb107-175e-40e7-b1a5-540543efb2b8 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:12.114658 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1bb107-175e-40e7-b1a5-540543efb2b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:12.134031 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-ad1bb107-175e-40e7-b1a5-540543efb2b8 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:29:12.135247 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-ad1bb107-175e-40e7-b1a5-540543efb2b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:12.141261 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:29:12.185382 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b54ffbd-0dd4-4cfd-a54c-d5dad6fc7c12 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:12.190252 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950b4c6c-1666-4567-b61a-dc311260ca84 tempest-TrustsV3TestJSON-663555667 tempest-user-817194743] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '008dfe20cb454a73a7b3898a58b31eef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1614a7d30d754e2f8570115fe323890f', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-128030487', 'tempest-DelegatedRole-193936420'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:12.190786 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950b4c6c-1666-4567-b61a-dc311260ca84 tempest-TrustsV3TestJSON-663555667 tempest-user-817194743] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:12.191046 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950b4c6c-1666-4567-b61a-dc311260ca84 tempest-TrustsV3TestJSON-663555667 tempest-user-817194743] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:12.191412 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950b4c6c-1666-4567-b61a-dc311260ca84 tempest-TrustsV3TestJSON-663555667 tempest-user-817194743] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:12.192423 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950b4c6c-1666-4567-b61a-dc311260ca84 tempest-TrustsV3TestJSON-663555667 tempest-user-817194743] RBAC: Authorizing `identity:create_trust()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:12.194728 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950b4c6c-1666-4567-b61a-dc311260ca84 tempest-TrustsV3TestJSON-663555667 tempest-user-817194743] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:12.234096 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2366/4737] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:29:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:29:12.246830 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1bb107-175e-40e7-b1a5-540543efb2b8 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:12.250303 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-ad1bb107-175e-40e7-b1a5-540543efb2b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:12.316218 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-950b4c6c-1666-4567-b61a-dc311260ca84 tempest-TrustsV3TestJSON-663555667 tempest-user-817194743] Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationTimeStampError: Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Jul 23 21:29:12.316218 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 21:29:12.316218 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py", line 44, in parse_isotime Jul 23 21:29:12.316218 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return iso8601.parse_date(timestr) Jul 23 21:29:12.316218 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/iso8601/iso8601.py", line 127, in parse_date Jul 23 21:29:12.316218 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise ParseError(f"Unable to parse date string {datestring!r}") Jul 23 21:29:12.316218 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application iso8601.iso8601.ParseError: Unable to parse date string 'bad.123Z' Jul 23 21:29:12.316218 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 21:29:12.316218 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 23 21:29:12.316218 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 21:29:12.316218 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 21:29:12.316218 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/utils.py", line 346, in parse_expiration_date Jul 23 21:29:12.316218 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application expiration_time = timeutils.parse_isotime(expiration_date) Jul 23 21:29:12.316218 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py", line 46, in parse_isotime Jul 23 21:29:12.317463 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise ValueError(str(e)) Jul 23 21:29:12.317463 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application ValueError: Unable to parse date string 'bad.123Z' Jul 23 21:29:12.317463 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 21:29:12.317463 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 23 21:29:12.317463 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 21:29:12.317463 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 21:29:12.317463 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 21:29:12.317463 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 21:29:12.317463 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 21:29:12.317463 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 21:29:12.317463 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 21:29:12.317463 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 21:29:12.317463 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 21:29:12.317463 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 21:29:12.317463 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 21:29:12.317463 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 21:29:12.317463 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 296, in post Jul 23 21:29:12.317463 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application trust['expires_at'] = self._parse_expiration_date( Jul 23 21:29:12.320782 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 127, in _parse_expiration_date Jul 23 21:29:12.320782 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return utils.parse_expiration_date(expiration_date) Jul 23 21:29:12.320782 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/utils.py", line 348, in parse_expiration_date Jul 23 21:29:12.320782 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.ValidationTimeStampError() Jul 23 21:29:12.320782 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.ValidationTimeStampError: Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Jul 23 21:29:12.320782 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 21:29:12.320782 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2372/4738] 10.222.0.17 () {60 vars in 1173 bytes} [Sat Jul 23 21:29:12 2022] POST /identity/v3/OS-TRUST/trusts => generated 227 bytes in 231 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Jul 23 21:29:12.321954 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950b4c6c-1666-4567-b61a-dc311260ca84 tempest-TrustsV3TestJSON-663555667 tempest-user-817194743] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:12.325099 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-950b4c6c-1666-4567-b61a-dc311260ca84 tempest-TrustsV3TestJSON-663555667 tempest-user-817194743] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:12.393209 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1bb107-175e-40e7-b1a5-540543efb2b8 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:12.403111 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1b81c3-081e-4aba-8a4f-78dc8c06f79d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:12.403798 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1b81c3-081e-4aba-8a4f-78dc8c06f79d service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:12.404076 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1b81c3-081e-4aba-8a4f-78dc8c06f79d service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:12.404456 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1b81c3-081e-4aba-8a4f-78dc8c06f79d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:12.428339 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1b81c3-081e-4aba-8a4f-78dc8c06f79d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:12.431751 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1b81c3-081e-4aba-8a4f-78dc8c06f79d service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:12.460659 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2367/4739] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:29:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:29:12.489625 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950b4c6c-1666-4567-b61a-dc311260ca84 tempest-TrustsV3TestJSON-663555667 tempest-user-817194743] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:12.495119 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662b8ea2-f547-4012-87ae-1bf69720e283 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b077945a37bc4bf29f5c62b95ff45562', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd2d040691b34adeb5ae75a50f416642', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:12.496555 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662b8ea2-f547-4012-87ae-1bf69720e283 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:12.496840 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662b8ea2-f547-4012-87ae-1bf69720e283 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:12.497121 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662b8ea2-f547-4012-87ae-1bf69720e283 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] PATH_INFO: `/v3/roles/61c85d5deef34d7390761e98eae61bbb` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:12.501822 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662b8ea2-f547-4012-87ae-1bf69720e283 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: Authorizing `identity:delete_role(role_id=61c85d5deef34d7390761e98eae61bbb)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:12.511530 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662b8ea2-f547-4012-87ae-1bf69720e283 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:12.590876 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-662b8ea2-f547-4012-87ae-1bf69720e283 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Invalidating the token cache because role 61c85d5deef34d7390761e98eae61bbb has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:29:12.591220 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-662b8ea2-f547-4012-87ae-1bf69720e283 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:12.592103 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-662b8ea2-f547-4012-87ae-1bf69720e283 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:12.594961 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2373/4740] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:29:12 2022] DELETE /identity/v3/roles/61c85d5deef34d7390761e98eae61bbb => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:29:12.599936 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1b81c3-081e-4aba-8a4f-78dc8c06f79d service neutron] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:12.616402 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1b81c3-081e-4aba-8a4f-78dc8c06f79d service neutron] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:12.703817 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4548fa-d9af-4440-8c64-c0103cd1cb94 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b077945a37bc4bf29f5c62b95ff45562', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd2d040691b34adeb5ae75a50f416642', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:12.705236 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4548fa-d9af-4440-8c64-c0103cd1cb94 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:12.706039 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4548fa-d9af-4440-8c64-c0103cd1cb94 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:12.706483 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4548fa-d9af-4440-8c64-c0103cd1cb94 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] PATH_INFO: `/v3/roles/2e6fce3bd7334952ac756a915c30f2ff` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:12.709049 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4548fa-d9af-4440-8c64-c0103cd1cb94 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: Authorizing `identity:delete_role(role_id=2e6fce3bd7334952ac756a915c30f2ff)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:12.711222 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4548fa-d9af-4440-8c64-c0103cd1cb94 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:12.810112 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-ad4548fa-d9af-4440-8c64-c0103cd1cb94 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Invalidating the token cache because role 2e6fce3bd7334952ac756a915c30f2ff has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:29:12.810533 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-ad4548fa-d9af-4440-8c64-c0103cd1cb94 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:12.811288 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-ad4548fa-d9af-4440-8c64-c0103cd1cb94 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:12.817168 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2368/4741] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:29:12 2022] DELETE /identity/v3/roles/2e6fce3bd7334952ac756a915c30f2ff => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:29:12.819041 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662b8ea2-f547-4012-87ae-1bf69720e283 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:12.823965 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-662b8ea2-f547-4012-87ae-1bf69720e283 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:12.869739 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662b8ea2-f547-4012-87ae-1bf69720e283 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:12.880222 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:29:12.973841 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8460a7-d31a-4372-aa09-1b38b4605d6a tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b077945a37bc4bf29f5c62b95ff45562', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd2d040691b34adeb5ae75a50f416642', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:12.974898 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8460a7-d31a-4372-aa09-1b38b4605d6a tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:12.975298 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8460a7-d31a-4372-aa09-1b38b4605d6a tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:12.975657 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8460a7-d31a-4372-aa09-1b38b4605d6a tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] PATH_INFO: `/v3/users/008dfe20cb454a73a7b3898a58b31eef` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:12.979207 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8460a7-d31a-4372-aa09-1b38b4605d6a tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: Authorizing `identity:delete_user(user_id=008dfe20cb454a73a7b3898a58b31eef)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:12.983843 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8460a7-d31a-4372-aa09-1b38b4605d6a tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:13.048456 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-9d8460a7-d31a-4372-aa09-1b38b4605d6a tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '008dfe20cb454a73a7b3898a58b31eef'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:13.055738 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-9d8460a7-d31a-4372-aa09-1b38b4605d6a tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '008dfe20cb454a73a7b3898a58b31eef'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:13.056605 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-9d8460a7-d31a-4372-aa09-1b38b4605d6a tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '008dfe20cb454a73a7b3898a58b31eef'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:13.069496 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-9d8460a7-d31a-4372-aa09-1b38b4605d6a tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '008dfe20cb454a73a7b3898a58b31eef'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:13.086242 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-9d8460a7-d31a-4372-aa09-1b38b4605d6a tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '008dfe20cb454a73a7b3898a58b31eef'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:13.105196 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4548fa-d9af-4440-8c64-c0103cd1cb94 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:13.105802 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2374/4742] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:29:12 2022] DELETE /identity/v3/users/008dfe20cb454a73a7b3898a58b31eef => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:29:13.107192 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-ad4548fa-d9af-4440-8c64-c0103cd1cb94 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:13.123384 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4548fa-d9af-4440-8c64-c0103cd1cb94 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:13.144930 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:29:13.193386 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8460a7-d31a-4372-aa09-1b38b4605d6a tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:13.195201 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-9d8460a7-d31a-4372-aa09-1b38b4605d6a tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:13.262978 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7687a993-6d4e-40e2-b6be-70bf658a3333 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b077945a37bc4bf29f5c62b95ff45562', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd2d040691b34adeb5ae75a50f416642', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:13.264369 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7687a993-6d4e-40e2-b6be-70bf658a3333 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:13.264769 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7687a993-6d4e-40e2-b6be-70bf658a3333 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:13.265526 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7687a993-6d4e-40e2-b6be-70bf658a3333 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] PATH_INFO: `/v3/projects/1614a7d30d754e2f8570115fe323890f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:13.269433 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7687a993-6d4e-40e2-b6be-70bf658a3333 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: Authorizing `identity:delete_project(project_id=1614a7d30d754e2f8570115fe323890f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:13.274246 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7687a993-6d4e-40e2-b6be-70bf658a3333 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:13.331192 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8460a7-d31a-4372-aa09-1b38b4605d6a tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:13.342683 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9a941c-c57e-4285-8fd6-ca29ee671006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:13.345345 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9a941c-c57e-4285-8fd6-ca29ee671006 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:13.346466 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9a941c-c57e-4285-8fd6-ca29ee671006 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:13.347886 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9a941c-c57e-4285-8fd6-ca29ee671006 admin admin] PATH_INFO: `/v3/projects/89d2c91f663b4786b37492389360b431` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:13.351270 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9a941c-c57e-4285-8fd6-ca29ee671006 admin admin] RBAC: Authorizing `identity:delete_project(project_id=89d2c91f663b4786b37492389360b431)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:13.353722 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9a941c-c57e-4285-8fd6-ca29ee671006 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:13.376027 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-7687a993-6d4e-40e2-b6be-70bf658a3333 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1614a7d30d754e2f8570115fe323890f', 'request_id': 'req-7687a993-6d4e-40e2-b6be-70bf658a3333'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:13.408840 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-7687a993-6d4e-40e2-b6be-70bf658a3333 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1614a7d30d754e2f8570115fe323890f', 'request_id': 'req-7687a993-6d4e-40e2-b6be-70bf658a3333'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:13.416016 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-7687a993-6d4e-40e2-b6be-70bf658a3333 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1614a7d30d754e2f8570115fe323890f', 'request_id': 'req-7687a993-6d4e-40e2-b6be-70bf658a3333'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:13.418305 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:29:13.448936 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-0d9a941c-c57e-4285-8fd6-ca29ee671006 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89d2c91f663b4786b37492389360b431', 'request_id': 'req-0d9a941c-c57e-4285-8fd6-ca29ee671006'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:13.452267 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-7687a993-6d4e-40e2-b6be-70bf658a3333 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] The token cache is being invalidate because project 1614a7d30d754e2f8570115fe323890f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:29:13.452267 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-7687a993-6d4e-40e2-b6be-70bf658a3333 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:13.452267 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-7687a993-6d4e-40e2-b6be-70bf658a3333 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:13.454801 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2369/4743] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:29:13 2022] DELETE /identity/v3/projects/1614a7d30d754e2f8570115fe323890f => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:29:13.460655 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7687a993-6d4e-40e2-b6be-70bf658a3333 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:13.462316 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-7687a993-6d4e-40e2-b6be-70bf658a3333 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:13.467886 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-0d9a941c-c57e-4285-8fd6-ca29ee671006 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89d2c91f663b4786b37492389360b431', 'request_id': 'req-0d9a941c-c57e-4285-8fd6-ca29ee671006'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:13.475939 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-0d9a941c-c57e-4285-8fd6-ca29ee671006 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89d2c91f663b4786b37492389360b431', 'request_id': 'req-0d9a941c-c57e-4285-8fd6-ca29ee671006'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:13.502224 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-0d9a941c-c57e-4285-8fd6-ca29ee671006 admin admin] The token cache is being invalidate because project 89d2c91f663b4786b37492389360b431 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:29:13.502610 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-0d9a941c-c57e-4285-8fd6-ca29ee671006 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:13.505280 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-0d9a941c-c57e-4285-8fd6-ca29ee671006 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:13.507274 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2375/4744] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:29:13 2022] DELETE /identity/v3/projects/89d2c91f663b4786b37492389360b431 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:29:13.512553 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9a941c-c57e-4285-8fd6-ca29ee671006 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:13.515901 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-0d9a941c-c57e-4285-8fd6-ca29ee671006 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:13.553255 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7687a993-6d4e-40e2-b6be-70bf658a3333 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:13.633946 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9a941c-c57e-4285-8fd6-ca29ee671006 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:13.635403 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:29:13.644522 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d09d4c-0ec7-475b-adb2-13255d11cc2e tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b077945a37bc4bf29f5c62b95ff45562', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd2d040691b34adeb5ae75a50f416642', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:13.645340 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d09d4c-0ec7-475b-adb2-13255d11cc2e tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:13.646204 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d09d4c-0ec7-475b-adb2-13255d11cc2e tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:13.647339 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d09d4c-0ec7-475b-adb2-13255d11cc2e tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:13.648052 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d09d4c-0ec7-475b-adb2-13255d11cc2e tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:13.650424 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d09d4c-0ec7-475b-adb2-13255d11cc2e tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:13.656004 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77432475-908b-4329-8737-36b730f002b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:13.656979 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77432475-908b-4329-8737-36b730f002b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:13.657298 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77432475-908b-4329-8737-36b730f002b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:13.657580 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77432475-908b-4329-8737-36b730f002b6 admin admin] PATH_INFO: `/v3/users/515c50d1e3d64c6992100e7d1fa49e2f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:13.659065 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77432475-908b-4329-8737-36b730f002b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=515c50d1e3d64c6992100e7d1fa49e2f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:13.661023 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77432475-908b-4329-8737-36b730f002b6 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:13.690014 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2370/4745] 10.222.0.17 () {60 vars in 1151 bytes} [Sat Jul 23 21:29:13 2022] POST /identity/v3/projects => generated 329 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:29:13.692175 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d09d4c-0ec7-475b-adb2-13255d11cc2e tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:13.697533 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-d7d09d4c-0ec7-475b-adb2-13255d11cc2e tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:13.733330 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-77432475-908b-4329-8737-36b730f002b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '515c50d1e3d64c6992100e7d1fa49e2f'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:13.743862 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-77432475-908b-4329-8737-36b730f002b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '515c50d1e3d64c6992100e7d1fa49e2f'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:13.744696 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-77432475-908b-4329-8737-36b730f002b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '515c50d1e3d64c6992100e7d1fa49e2f'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:13.756804 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-77432475-908b-4329-8737-36b730f002b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '515c50d1e3d64c6992100e7d1fa49e2f'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:13.774779 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-77432475-908b-4329-8737-36b730f002b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '515c50d1e3d64c6992100e7d1fa49e2f'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:13.782842 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2376/4746] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:29:13 2022] DELETE /identity/v3/users/515c50d1e3d64c6992100e7d1fa49e2f => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:29:13.792422 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d09d4c-0ec7-475b-adb2-13255d11cc2e tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:13.877085 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d38db4-b130-4d7b-a2e5-b24f253b9234 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b077945a37bc4bf29f5c62b95ff45562', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd2d040691b34adeb5ae75a50f416642', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:13.877801 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d38db4-b130-4d7b-a2e5-b24f253b9234 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:13.879115 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d38db4-b130-4d7b-a2e5-b24f253b9234 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:13.879493 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d38db4-b130-4d7b-a2e5-b24f253b9234 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:13.880227 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d38db4-b130-4d7b-a2e5-b24f253b9234 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:13.882243 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d38db4-b130-4d7b-a2e5-b24f253b9234 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:13.909325 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2371/4747] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:29:13 2022] POST /identity/v3/users => generated 413 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:29:13.913339 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77432475-908b-4329-8737-36b730f002b6 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:13.914917 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-77432475-908b-4329-8737-36b730f002b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:13.931080 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77432475-908b-4329-8737-36b730f002b6 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:13.937229 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5520ac6e-00b3-4766-84fb-9db4595521f9 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b077945a37bc4bf29f5c62b95ff45562', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd2d040691b34adeb5ae75a50f416642', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:13.938585 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5520ac6e-00b3-4766-84fb-9db4595521f9 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:13.939093 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5520ac6e-00b3-4766-84fb-9db4595521f9 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:13.939362 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5520ac6e-00b3-4766-84fb-9db4595521f9 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:13.940228 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5520ac6e-00b3-4766-84fb-9db4595521f9 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:13.942375 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5520ac6e-00b3-4766-84fb-9db4595521f9 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:13.970628 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2377/4748] 10.222.0.17 () {60 vars in 1142 bytes} [Sat Jul 23 21:29:13 2022] POST /identity/v3/roles => generated 243 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:29:13.971312 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d38db4-b130-4d7b-a2e5-b24f253b9234 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:13.987798 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d38db4-b130-4d7b-a2e5-b24f253b9234 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:13.992938 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e5c64e-f099-4d47-a034-b54da157fca9 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b077945a37bc4bf29f5c62b95ff45562', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd2d040691b34adeb5ae75a50f416642', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:13.994030 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e5c64e-f099-4d47-a034-b54da157fca9 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:13.994475 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e5c64e-f099-4d47-a034-b54da157fca9 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:13.995068 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e5c64e-f099-4d47-a034-b54da157fca9 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:13.996289 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e5c64e-f099-4d47-a034-b54da157fca9 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:13.997931 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e5c64e-f099-4d47-a034-b54da157fca9 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:14.018581 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2372/4749] 10.222.0.17 () {60 vars in 1142 bytes} [Sat Jul 23 21:29:13 2022] POST /identity/v3/roles => generated 247 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:29:14.023440 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5520ac6e-00b3-4766-84fb-9db4595521f9 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:14.038254 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5520ac6e-00b3-4766-84fb-9db4595521f9 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:14.044406 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58554e0-1e12-4c93-9b3b-e724451bc3c6 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b077945a37bc4bf29f5c62b95ff45562', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd2d040691b34adeb5ae75a50f416642', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:14.045576 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58554e0-1e12-4c93-9b3b-e724451bc3c6 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:14.045879 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58554e0-1e12-4c93-9b3b-e724451bc3c6 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:14.046407 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58554e0-1e12-4c93-9b3b-e724451bc3c6 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] PATH_INFO: `/v3/projects/335502ef2119483d9525ae78534a07e7/users/f7e886e537f44bfdb9fff32cf4d84677/roles/1f0f04ae264b4e79a92d3b3df67b50a8` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:14.066075 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58554e0-1e12-4c93-9b3b-e724451bc3c6 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: Authorizing `identity:create_grant(project_id=335502ef2119483d9525ae78534a07e7, user_id=f7e886e537f44bfdb9fff32cf4d84677, role_id=1f0f04ae264b4e79a92d3b3df67b50a8)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:14.069693 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58554e0-1e12-4c93-9b3b-e724451bc3c6 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:14.081557 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=81,keystone:DELETE=15,keystone:INSERT=4 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:29:14.092881 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2378/4750] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:29:14 2022] PUT /identity/v3/projects/335502ef2119483d9525ae78534a07e7/users/f7e886e537f44bfdb9fff32cf4d84677/roles/1f0f04ae264b4e79a92d3b3df67b50a8 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:29:14.095415 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e5c64e-f099-4d47-a034-b54da157fca9 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:14.111370 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e5c64e-f099-4d47-a034-b54da157fca9 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:14.253477 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acdf80b-cb42-43f8-83b6-246751dc8468 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b077945a37bc4bf29f5c62b95ff45562', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd2d040691b34adeb5ae75a50f416642', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:14.254484 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acdf80b-cb42-43f8-83b6-246751dc8468 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:14.254768 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acdf80b-cb42-43f8-83b6-246751dc8468 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:14.255041 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acdf80b-cb42-43f8-83b6-246751dc8468 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] PATH_INFO: `/v3/projects/335502ef2119483d9525ae78534a07e7/users/f7e886e537f44bfdb9fff32cf4d84677/roles/d158fe1d79ae451db6ea8ce2b7c3551d` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:14.257395 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acdf80b-cb42-43f8-83b6-246751dc8468 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: Authorizing `identity:create_grant(project_id=335502ef2119483d9525ae78534a07e7, user_id=f7e886e537f44bfdb9fff32cf4d84677, role_id=d158fe1d79ae451db6ea8ce2b7c3551d)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:14.260487 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acdf80b-cb42-43f8-83b6-246751dc8468 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:14.277493 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:29:14.299800 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2373/4751] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:29:14 2022] PUT /identity/v3/projects/335502ef2119483d9525ae78534a07e7/users/f7e886e537f44bfdb9fff32cf4d84677/roles/d158fe1d79ae451db6ea8ce2b7c3551d => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:29:14.309128 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58554e0-1e12-4c93-9b3b-e724451bc3c6 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:14.321193 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58554e0-1e12-4c93-9b3b-e724451bc3c6 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:14.373030 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acdf80b-cb42-43f8-83b6-246751dc8468 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:14.375363 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-5acdf80b-cb42-43f8-83b6-246751dc8468 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:14.453185 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26087b9-71fd-4704-8587-4e3495fb10d6 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b077945a37bc4bf29f5c62b95ff45562', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd2d040691b34adeb5ae75a50f416642', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:14.454044 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26087b9-71fd-4704-8587-4e3495fb10d6 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:14.454395 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26087b9-71fd-4704-8587-4e3495fb10d6 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:14.455356 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26087b9-71fd-4704-8587-4e3495fb10d6 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:14.456159 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26087b9-71fd-4704-8587-4e3495fb10d6 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:14.458924 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26087b9-71fd-4704-8587-4e3495fb10d6 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:14.497811 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2379/4752] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:29:14 2022] GET /identity/v3/users => generated 8065 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:29:14.506696 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f13396-3be0-4abf-9c82-d5a3e1c6be95 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:14.506988 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f13396-3be0-4abf-9c82-d5a3e1c6be95 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:14.508092 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f13396-3be0-4abf-9c82-d5a3e1c6be95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:14.514288 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acdf80b-cb42-43f8-83b6-246751dc8468 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:14.521293 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e02952a-60f3-48a6-b842-09d6b2a5ef19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:14.523041 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e02952a-60f3-48a6-b842-09d6b2a5ef19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:14.523343 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e02952a-60f3-48a6-b842-09d6b2a5ef19 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:14.523623 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e02952a-60f3-48a6-b842-09d6b2a5ef19 admin admin] PATH_INFO: `/v3/projects/f813c3919aa44c8f8b95fa3beee0436f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:14.524928 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e02952a-60f3-48a6-b842-09d6b2a5ef19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f813c3919aa44c8f8b95fa3beee0436f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:14.528857 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e02952a-60f3-48a6-b842-09d6b2a5ef19 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:14.565210 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-31f13396-3be0-4abf-9c82-d5a3e1c6be95 None None] MFA Rules not processed for user `f7e886e537f44bfdb9fff32cf4d84677`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:29:14.566493 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-31f13396-3be0-4abf-9c82-d5a3e1c6be95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:14.618861 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-1e02952a-60f3-48a6-b842-09d6b2a5ef19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f813c3919aa44c8f8b95fa3beee0436f', 'request_id': 'req-1e02952a-60f3-48a6-b842-09d6b2a5ef19'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:14.634448 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-1e02952a-60f3-48a6-b842-09d6b2a5ef19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f813c3919aa44c8f8b95fa3beee0436f', 'request_id': 'req-1e02952a-60f3-48a6-b842-09d6b2a5ef19'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:14.645188 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-1e02952a-60f3-48a6-b842-09d6b2a5ef19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f813c3919aa44c8f8b95fa3beee0436f', 'request_id': 'req-1e02952a-60f3-48a6-b842-09d6b2a5ef19'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:14.657712 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-1e02952a-60f3-48a6-b842-09d6b2a5ef19 admin admin] The token cache is being invalidate because project f813c3919aa44c8f8b95fa3beee0436f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:29:14.658226 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-1e02952a-60f3-48a6-b842-09d6b2a5ef19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:14.658920 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-1e02952a-60f3-48a6-b842-09d6b2a5ef19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:14.660910 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2374/4753] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:29:14 2022] DELETE /identity/v3/projects/f813c3919aa44c8f8b95fa3beee0436f => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:29:14.666015 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408b12ee-3551-460a-8e6d-2b22f897a7d7 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:14.666309 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408b12ee-3551-460a-8e6d-2b22f897a7d7 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:14.666719 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408b12ee-3551-460a-8e6d-2b22f897a7d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:14.690642 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2380/4754] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:29:14 2022] POST /identity/v3/auth/tokens => generated 3269 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:29:14.692574 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e70171b-cacf-4f12-8d50-c8485927879b None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:14.692885 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e70171b-cacf-4f12-8d50-c8485927879b None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:14.693117 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e70171b-cacf-4f12-8d50-c8485927879b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:14.708636 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-408b12ee-3551-460a-8e6d-2b22f897a7d7 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:29:14.709905 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-408b12ee-3551-460a-8e6d-2b22f897a7d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:14.733742 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-5e70171b-cacf-4f12-8d50-c8485927879b None None] MFA Rules not processed for user `f7e886e537f44bfdb9fff32cf4d84677`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:29:14.735140 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-5e70171b-cacf-4f12-8d50-c8485927879b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:14.797457 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2375/4755] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:29:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:29:14.806516 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783057cd-97ca-4904-88ac-5f98846aec63 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:14.807096 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783057cd-97ca-4904-88ac-5f98846aec63 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:14.807727 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783057cd-97ca-4904-88ac-5f98846aec63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:14.815456 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2381/4756] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:29:14 2022] POST /identity/v3/auth/tokens => generated 3269 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:29:14.816386 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e70171b-cacf-4f12-8d50-c8485927879b None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:14.827710 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e70171b-cacf-4f12-8d50-c8485927879b None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:14.833256 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb0419a-c6bb-4e53-bad3-a94cbe2c1ebd tempest-TrustsV3TestJSON-1507505510 tempest-user-625313893] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7e886e537f44bfdb9fff32cf4d84677', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '335502ef2119483d9525ae78534a07e7', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1842562212', 'tempest-DelegatedRole-114766401'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:14.834077 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb0419a-c6bb-4e53-bad3-a94cbe2c1ebd tempest-TrustsV3TestJSON-1507505510 tempest-user-625313893] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:14.834443 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb0419a-c6bb-4e53-bad3-a94cbe2c1ebd tempest-TrustsV3TestJSON-1507505510 tempest-user-625313893] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:14.834827 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb0419a-c6bb-4e53-bad3-a94cbe2c1ebd tempest-TrustsV3TestJSON-1507505510 tempest-user-625313893] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:14.836090 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb0419a-c6bb-4e53-bad3-a94cbe2c1ebd tempest-TrustsV3TestJSON-1507505510 tempest-user-625313893] RBAC: Authorizing `identity:create_trust()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:14.837629 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb0419a-c6bb-4e53-bad3-a94cbe2c1ebd tempest-TrustsV3TestJSON-1507505510 tempest-user-625313893] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:14.842514 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-783057cd-97ca-4904-88ac-5f98846aec63 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:29:14.846158 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-783057cd-97ca-4904-88ac-5f98846aec63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:14.860915 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2376/4757] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:29:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:29:14.864372 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:29:14.865633 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783057cd-97ca-4904-88ac-5f98846aec63 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:14.883888 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783057cd-97ca-4904-88ac-5f98846aec63 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:14.890405 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f984f85-f9b3-4ce9-b9e7-415d0ec02079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:14.892227 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f984f85-f9b3-4ce9-b9e7-415d0ec02079 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:14.892897 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f984f85-f9b3-4ce9-b9e7-415d0ec02079 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:14.894311 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f984f85-f9b3-4ce9-b9e7-415d0ec02079 admin admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:14.895562 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f984f85-f9b3-4ce9-b9e7-415d0ec02079 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:29:14.896715 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f984f85-f9b3-4ce9-b9e7-415d0ec02079 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:14.899932 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f984f85-f9b3-4ce9-b9e7-415d0ec02079 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:14.924158 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2377/4758] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:29:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 21:29:14.929592 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f984f85-f9b3-4ce9-b9e7-415d0ec02079 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:14.948112 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f984f85-f9b3-4ce9-b9e7-415d0ec02079 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:14.958489 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a114256-c5bf-4933-85ac-8bcea46cd067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:14.959291 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a114256-c5bf-4933-85ac-8bcea46cd067 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:14.959647 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a114256-c5bf-4933-85ac-8bcea46cd067 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:14.960465 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a114256-c5bf-4933-85ac-8bcea46cd067 admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:14.960715 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2382/4759] 10.222.0.17 () {60 vars in 1173 bytes} [Sat Jul 23 21:29:14 2022] POST /identity/v3/OS-TRUST/trusts => generated 833 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:29:14.966809 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb0419a-c6bb-4e53-bad3-a94cbe2c1ebd tempest-TrustsV3TestJSON-1507505510 tempest-user-625313893] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:14.967019 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a114256-c5bf-4933-85ac-8bcea46cd067 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:14.968798 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a114256-c5bf-4933-85ac-8bcea46cd067 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:14.985917 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:29:14.987870 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb0419a-c6bb-4e53-bad3-a94cbe2c1ebd tempest-TrustsV3TestJSON-1507505510 tempest-user-625313893] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:15.004085 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fb4917-d58b-4dd1-ac12-5c7a08f4f59c tempest-TrustsV3TestJSON-1507505510 tempest-user-625313893] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7e886e537f44bfdb9fff32cf4d84677', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '335502ef2119483d9525ae78534a07e7', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1842562212', 'tempest-DelegatedRole-114766401'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:15.008669 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fb4917-d58b-4dd1-ac12-5c7a08f4f59c tempest-TrustsV3TestJSON-1507505510 tempest-user-625313893] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:15.011220 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fb4917-d58b-4dd1-ac12-5c7a08f4f59c tempest-TrustsV3TestJSON-1507505510 tempest-user-625313893] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:15.013318 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fb4917-d58b-4dd1-ac12-5c7a08f4f59c tempest-TrustsV3TestJSON-1507505510 tempest-user-625313893] PATH_INFO: `/v3/OS-TRUST/trusts/bcebce65a6c54542b7b114b3dc947bc0` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:15.032590 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2378/4760] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:29:14 2022] POST /identity/v3/projects => generated 387 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:29:15.035441 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a114256-c5bf-4933-85ac-8bcea46cd067 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:15.039102 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fb4917-d58b-4dd1-ac12-5c7a08f4f59c tempest-TrustsV3TestJSON-1507505510 tempest-user-625313893] RBAC: Authorizing `identity:get_trust(trust_id=bcebce65a6c54542b7b114b3dc947bc0)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:15.042362 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fb4917-d58b-4dd1-ac12-5c7a08f4f59c tempest-TrustsV3TestJSON-1507505510 tempest-user-625313893] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:15.067700 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2383/4761] 10.222.0.17 () {58 vars in 1250 bytes} [Sat Jul 23 21:29:14 2022] GET /identity/v3/OS-TRUST/trusts/bcebce65a6c54542b7b114b3dc947bc0 => generated 833 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:29:15.069534 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fb4917-d58b-4dd1-ac12-5c7a08f4f59c tempest-TrustsV3TestJSON-1507505510 tempest-user-625313893] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:15.084469 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fb4917-d58b-4dd1-ac12-5c7a08f4f59c tempest-TrustsV3TestJSON-1507505510 tempest-user-625313893] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:15.174309 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2258774-6037-429f-a336-4a3b2ee9462f tempest-TrustsV3TestJSON-1507505510 tempest-user-625313893] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7e886e537f44bfdb9fff32cf4d84677', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '335502ef2119483d9525ae78534a07e7', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1842562212', 'tempest-DelegatedRole-114766401'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:15.175556 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2258774-6037-429f-a336-4a3b2ee9462f tempest-TrustsV3TestJSON-1507505510 tempest-user-625313893] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:15.175905 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2258774-6037-429f-a336-4a3b2ee9462f tempest-TrustsV3TestJSON-1507505510 tempest-user-625313893] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:15.176320 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2258774-6037-429f-a336-4a3b2ee9462f tempest-TrustsV3TestJSON-1507505510 tempest-user-625313893] PATH_INFO: `/v3/OS-TRUST/trusts/bcebce65a6c54542b7b114b3dc947bc0/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:15.184229 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2258774-6037-429f-a336-4a3b2ee9462f tempest-TrustsV3TestJSON-1507505510 tempest-user-625313893] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=bcebce65a6c54542b7b114b3dc947bc0)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:15.186253 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2258774-6037-429f-a336-4a3b2ee9462f tempest-TrustsV3TestJSON-1507505510 tempest-user-625313893] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:15.198318 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2384/4762] 10.222.0.17 () {58 vars in 1268 bytes} [Sat Jul 23 21:29:15 2022] GET /identity/v3/OS-TRUST/trusts/bcebce65a6c54542b7b114b3dc947bc0/roles => generated 370 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:29:15.203192 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2258774-6037-429f-a336-4a3b2ee9462f tempest-TrustsV3TestJSON-1507505510 tempest-user-625313893] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:15.223247 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a114256-c5bf-4933-85ac-8bcea46cd067 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:15.229636 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2258774-6037-429f-a336-4a3b2ee9462f tempest-TrustsV3TestJSON-1507505510 tempest-user-625313893] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:15.234456 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34de4973-51f0-480e-a4c1-92b999a5e80f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:15.235860 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34de4973-51f0-480e-a4c1-92b999a5e80f admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:15.236706 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34de4973-51f0-480e-a4c1-92b999a5e80f admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:15.237484 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34de4973-51f0-480e-a4c1-92b999a5e80f admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:15.239808 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34de4973-51f0-480e-a4c1-92b999a5e80f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:15.241128 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a9d266-3574-4efb-a302-2fe4263a48fc tempest-TrustsV3TestJSON-1507505510 tempest-user-625313893] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7e886e537f44bfdb9fff32cf4d84677', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '335502ef2119483d9525ae78534a07e7', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1842562212', 'tempest-DelegatedRole-114766401'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:15.243685 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a9d266-3574-4efb-a302-2fe4263a48fc tempest-TrustsV3TestJSON-1507505510 tempest-user-625313893] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:15.245127 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a9d266-3574-4efb-a302-2fe4263a48fc tempest-TrustsV3TestJSON-1507505510 tempest-user-625313893] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:15.245451 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a9d266-3574-4efb-a302-2fe4263a48fc tempest-TrustsV3TestJSON-1507505510 tempest-user-625313893] PATH_INFO: `/v3/OS-TRUST/trusts/bcebce65a6c54542b7b114b3dc947bc0/roles/1f0f04ae264b4e79a92d3b3df67b50a8` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:15.246037 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34de4973-51f0-480e-a4c1-92b999a5e80f admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:15.261172 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a9d266-3574-4efb-a302-2fe4263a48fc tempest-TrustsV3TestJSON-1507505510 tempest-user-625313893] RBAC: Authorizing `identity:get_role_for_trust(trust_id=bcebce65a6c54542b7b114b3dc947bc0, role_id=1f0f04ae264b4e79a92d3b3df67b50a8)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:15.266208 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a9d266-3574-4efb-a302-2fe4263a48fc tempest-TrustsV3TestJSON-1507505510 tempest-user-625313893] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:15.283354 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2385/4763] 10.222.0.17 () {58 vars in 1367 bytes} [Sat Jul 23 21:29:15 2022] GET /identity/v3/OS-TRUST/trusts/bcebce65a6c54542b7b114b3dc947bc0/roles/1f0f04ae264b4e79a92d3b3df67b50a8 => generated 243 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 21:29:15.285928 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a9d266-3574-4efb-a302-2fe4263a48fc tempest-TrustsV3TestJSON-1507505510 tempest-user-625313893] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:15.296195 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2379/4764] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:29:15 2022] POST /identity/v3/users => generated 294 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:29:15.300883 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34de4973-51f0-480e-a4c1-92b999a5e80f admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:15.315599 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a9d266-3574-4efb-a302-2fe4263a48fc tempest-TrustsV3TestJSON-1507505510 tempest-user-625313893] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:15.321114 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34de4973-51f0-480e-a4c1-92b999a5e80f admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:15.326220 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fb0c27-dd72-44dd-a6cc-c63b0e598922 tempest-TrustsV3TestJSON-1507505510 tempest-user-625313893] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7e886e537f44bfdb9fff32cf4d84677', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '335502ef2119483d9525ae78534a07e7', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1842562212', 'tempest-DelegatedRole-114766401'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:15.328137 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fb0c27-dd72-44dd-a6cc-c63b0e598922 tempest-TrustsV3TestJSON-1507505510 tempest-user-625313893] REQUEST_METHOD: `HEAD` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:15.328495 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fb0c27-dd72-44dd-a6cc-c63b0e598922 tempest-TrustsV3TestJSON-1507505510 tempest-user-625313893] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:15.329821 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fb0c27-dd72-44dd-a6cc-c63b0e598922 tempest-TrustsV3TestJSON-1507505510 tempest-user-625313893] PATH_INFO: `/v3/OS-TRUST/trusts/bcebce65a6c54542b7b114b3dc947bc0/roles/1f0f04ae264b4e79a92d3b3df67b50a8` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:15.335152 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108bbfc1-b186-45cb-bb46-43a4e0a90090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:15.335766 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108bbfc1-b186-45cb-bb46-43a4e0a90090 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:15.336046 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108bbfc1-b186-45cb-bb46-43a4e0a90090 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:15.336315 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108bbfc1-b186-45cb-bb46-43a4e0a90090 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:15.337050 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108bbfc1-b186-45cb-bb46-43a4e0a90090 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:15.342329 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108bbfc1-b186-45cb-bb46-43a4e0a90090 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:15.345887 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fb0c27-dd72-44dd-a6cc-c63b0e598922 tempest-TrustsV3TestJSON-1507505510 tempest-user-625313893] RBAC: Authorizing `identity:get_role_for_trust(trust_id=bcebce65a6c54542b7b114b3dc947bc0, role_id=1f0f04ae264b4e79a92d3b3df67b50a8)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:15.348140 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fb0c27-dd72-44dd-a6cc-c63b0e598922 tempest-TrustsV3TestJSON-1507505510 tempest-user-625313893] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:15.366998 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2386/4765] 10.222.0.17 () {58 vars in 1368 bytes} [Sat Jul 23 21:29:15 2022] HEAD /identity/v3/OS-TRUST/trusts/bcebce65a6c54542b7b114b3dc947bc0/roles/1f0f04ae264b4e79a92d3b3df67b50a8 => generated 0 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:29:15.369912 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2380/4766] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:29:15 2022] GET /identity/v3/roles => generated 1892 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:29:15.371232 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fb0c27-dd72-44dd-a6cc-c63b0e598922 tempest-TrustsV3TestJSON-1507505510 tempest-user-625313893] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:15.376237 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108bbfc1-b186-45cb-bb46-43a4e0a90090 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:15.392595 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108bbfc1-b186-45cb-bb46-43a4e0a90090 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:15.393416 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fb0c27-dd72-44dd-a6cc-c63b0e598922 tempest-TrustsV3TestJSON-1507505510 tempest-user-625313893] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:15.401337 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e9c5b2-faf4-4e43-af6e-f0d3e8cb3896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:15.402260 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e9c5b2-faf4-4e43-af6e-f0d3e8cb3896 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:15.402644 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e9c5b2-faf4-4e43-af6e-f0d3e8cb3896 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:15.403275 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e9c5b2-faf4-4e43-af6e-f0d3e8cb3896 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:15.404176 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e9c5b2-faf4-4e43-af6e-f0d3e8cb3896 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:15.406380 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6700566c-c03a-4704-8c3f-ad4b90730366 tempest-TrustsV3TestJSON-1507505510 tempest-user-625313893] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7e886e537f44bfdb9fff32cf4d84677', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '335502ef2119483d9525ae78534a07e7', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1842562212', 'tempest-DelegatedRole-114766401'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:15.406785 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e9c5b2-faf4-4e43-af6e-f0d3e8cb3896 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:15.407306 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6700566c-c03a-4704-8c3f-ad4b90730366 tempest-TrustsV3TestJSON-1507505510 tempest-user-625313893] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:15.407576 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6700566c-c03a-4704-8c3f-ad4b90730366 tempest-TrustsV3TestJSON-1507505510 tempest-user-625313893] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:15.407852 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6700566c-c03a-4704-8c3f-ad4b90730366 tempest-TrustsV3TestJSON-1507505510 tempest-user-625313893] PATH_INFO: `/v3/OS-TRUST/trusts/bcebce65a6c54542b7b114b3dc947bc0/roles/d158fe1d79ae451db6ea8ce2b7c3551d` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:15.424572 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6700566c-c03a-4704-8c3f-ad4b90730366 tempest-TrustsV3TestJSON-1507505510 tempest-user-625313893] RBAC: Authorizing `identity:get_role_for_trust(trust_id=bcebce65a6c54542b7b114b3dc947bc0, role_id=d158fe1d79ae451db6ea8ce2b7c3551d)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:15.426438 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6700566c-c03a-4704-8c3f-ad4b90730366 tempest-TrustsV3TestJSON-1507505510 tempest-user-625313893] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:15.429744 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2381/4767] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:29:15 2022] GET /identity/v3/roles => generated 1892 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:29:15.431923 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e9c5b2-faf4-4e43-af6e-f0d3e8cb3896 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:15.450292 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e9c5b2-faf4-4e43-af6e-f0d3e8cb3896 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:15.459771 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f861c95-0021-44d7-a4c3-fcfb49bd329c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:15.459771 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f861c95-0021-44d7-a4c3-fcfb49bd329c admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:15.459771 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f861c95-0021-44d7-a4c3-fcfb49bd329c admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:15.459771 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f861c95-0021-44d7-a4c3-fcfb49bd329c admin admin] PATH_INFO: `/v3/projects/de93b7f53330426ca289a8ab0f36302d/users/d7e7d655656f4d748ee71fe1fe2b9236/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:15.475047 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-6700566c-c03a-4704-8c3f-ad4b90730366 tempest-TrustsV3TestJSON-1507505510 tempest-user-625313893] Could not find role: d158fe1d79ae451db6ea8ce2b7c3551d.: keystone.exception.RoleNotFound: Could not find role: d158fe1d79ae451db6ea8ce2b7c3551d. Jul 23 21:29:15.475047 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 21:29:15.475047 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 21:29:15.475047 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 21:29:15.475047 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 21:29:15.475047 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 21:29:15.475047 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 21:29:15.475047 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 21:29:15.475047 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 21:29:15.475047 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 21:29:15.475047 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 21:29:15.475047 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 21:29:15.475047 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Jul 23 21:29:15.475047 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 21:29:15.476196 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: d158fe1d79ae451db6ea8ce2b7c3551d. Jul 23 21:29:15.476196 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 21:29:15.481943 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2387/4768] 10.222.0.17 () {58 vars in 1367 bytes} [Sat Jul 23 21:29:15 2022] GET /identity/v3/OS-TRUST/trusts/bcebce65a6c54542b7b114b3dc947bc0/roles/d158fe1d79ae451db6ea8ce2b7c3551d => generated 110 bytes in 111 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 23 21:29:15.482227 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f861c95-0021-44d7-a4c3-fcfb49bd329c admin admin] RBAC: Authorizing `identity:create_grant(project_id=de93b7f53330426ca289a8ab0f36302d, user_id=d7e7d655656f4d748ee71fe1fe2b9236, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:15.486598 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6700566c-c03a-4704-8c3f-ad4b90730366 tempest-TrustsV3TestJSON-1507505510 tempest-user-625313893] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:15.487019 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f861c95-0021-44d7-a4c3-fcfb49bd329c admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:15.512726 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2382/4769] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:29:15 2022] PUT /identity/v3/projects/de93b7f53330426ca289a8ab0f36302d/users/d7e7d655656f4d748ee71fe1fe2b9236/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:29:15.517173 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6700566c-c03a-4704-8c3f-ad4b90730366 tempest-TrustsV3TestJSON-1507505510 tempest-user-625313893] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:15.523381 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a842c76-0ae8-4672-b8ce-fcb627ace001 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:15.527125 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a842c76-0ae8-4672-b8ce-fcb627ace001 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:15.527414 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a842c76-0ae8-4672-b8ce-fcb627ace001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:15.575930 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-6a842c76-0ae8-4672-b8ce-fcb627ace001 None None] MFA Rules not processed for user `d7e7d655656f4d748ee71fe1fe2b9236`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:29:15.577856 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-6a842c76-0ae8-4672-b8ce-fcb627ace001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:15.615947 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:29:15.663826 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12b9f16-afad-4180-aa8f-8d9df9601d4f tempest-TrustsV3TestJSON-1507505510 tempest-user-625313893] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7e886e537f44bfdb9fff32cf4d84677', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '335502ef2119483d9525ae78534a07e7', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1842562212', 'tempest-DelegatedRole-114766401'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:15.664697 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12b9f16-afad-4180-aa8f-8d9df9601d4f tempest-TrustsV3TestJSON-1507505510 tempest-user-625313893] REQUEST_METHOD: `HEAD` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:15.664979 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12b9f16-afad-4180-aa8f-8d9df9601d4f tempest-TrustsV3TestJSON-1507505510 tempest-user-625313893] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:15.667274 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12b9f16-afad-4180-aa8f-8d9df9601d4f tempest-TrustsV3TestJSON-1507505510 tempest-user-625313893] PATH_INFO: `/v3/OS-TRUST/trusts/bcebce65a6c54542b7b114b3dc947bc0/roles/d158fe1d79ae451db6ea8ce2b7c3551d` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:15.682920 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12b9f16-afad-4180-aa8f-8d9df9601d4f tempest-TrustsV3TestJSON-1507505510 tempest-user-625313893] RBAC: Authorizing `identity:get_role_for_trust(trust_id=bcebce65a6c54542b7b114b3dc947bc0, role_id=d158fe1d79ae451db6ea8ce2b7c3551d)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:15.686691 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12b9f16-afad-4180-aa8f-8d9df9601d4f tempest-TrustsV3TestJSON-1507505510 tempest-user-625313893] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:15.692956 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2383/4770] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:29:15 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:29:15.698008 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a842c76-0ae8-4672-b8ce-fcb627ace001 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:15.720295 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-f12b9f16-afad-4180-aa8f-8d9df9601d4f tempest-TrustsV3TestJSON-1507505510 tempest-user-625313893] Could not find role: d158fe1d79ae451db6ea8ce2b7c3551d.: keystone.exception.RoleNotFound: Could not find role: d158fe1d79ae451db6ea8ce2b7c3551d. Jul 23 21:29:15.720295 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 21:29:15.720295 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 21:29:15.720295 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 21:29:15.720295 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 21:29:15.720295 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 21:29:15.720295 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 21:29:15.720295 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 21:29:15.720295 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 21:29:15.720295 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 21:29:15.720295 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 21:29:15.720295 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 21:29:15.720295 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Jul 23 21:29:15.720295 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 21:29:15.721500 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: d158fe1d79ae451db6ea8ce2b7c3551d. Jul 23 21:29:15.721500 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 21:29:15.725968 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2388/4771] 10.222.0.17 () {58 vars in 1368 bytes} [Sat Jul 23 21:29:15 2022] HEAD /identity/v3/OS-TRUST/trusts/bcebce65a6c54542b7b114b3dc947bc0/roles/d158fe1d79ae451db6ea8ce2b7c3551d => generated 0 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 23 21:29:15.730982 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12b9f16-afad-4180-aa8f-8d9df9601d4f tempest-TrustsV3TestJSON-1507505510 tempest-user-625313893] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:15.755823 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12b9f16-afad-4180-aa8f-8d9df9601d4f tempest-TrustsV3TestJSON-1507505510 tempest-user-625313893] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:15.769558 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:29:15.770678 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09aec03-da52-4f89-abac-d38b02d93d98 tempest-TrustsV3TestJSON-1507505510 tempest-user-625313893] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7e886e537f44bfdb9fff32cf4d84677', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '335502ef2119483d9525ae78534a07e7', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1842562212', 'tempest-DelegatedRole-114766401'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:15.771722 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09aec03-da52-4f89-abac-d38b02d93d98 tempest-TrustsV3TestJSON-1507505510 tempest-user-625313893] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:15.772061 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09aec03-da52-4f89-abac-d38b02d93d98 tempest-TrustsV3TestJSON-1507505510 tempest-user-625313893] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:15.772404 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09aec03-da52-4f89-abac-d38b02d93d98 tempest-TrustsV3TestJSON-1507505510 tempest-user-625313893] PATH_INFO: `/v3/OS-TRUST/trusts/bcebce65a6c54542b7b114b3dc947bc0` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:15.788269 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09aec03-da52-4f89-abac-d38b02d93d98 tempest-TrustsV3TestJSON-1507505510 tempest-user-625313893] RBAC: Authorizing `identity:delete_trust(trust_id=bcebce65a6c54542b7b114b3dc947bc0)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:15.791077 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09aec03-da52-4f89-abac-d38b02d93d98 tempest-TrustsV3TestJSON-1507505510 tempest-user-625313893] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:15.829306 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-f09aec03-da52-4f89-abac-d38b02d93d98 tempest-TrustsV3TestJSON-1507505510 tempest-user-625313893] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'bcebce65a6c54542b7b114b3dc947bc0', 'request_id': 'req-f09aec03-da52-4f89-abac-d38b02d93d98'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:15.831225 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-f09aec03-da52-4f89-abac-d38b02d93d98 tempest-TrustsV3TestJSON-1507505510 tempest-user-625313893] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': 'bcebce65a6c54542b7b114b3dc947bc0', 'request_id': 'req-f09aec03-da52-4f89-abac-d38b02d93d98'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:15.850236 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-f09aec03-da52-4f89-abac-d38b02d93d98 tempest-TrustsV3TestJSON-1507505510 tempest-user-625313893] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'bcebce65a6c54542b7b114b3dc947bc0', 'request_id': 'req-f09aec03-da52-4f89-abac-d38b02d93d98'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:15.863367 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2389/4772] 10.222.0.17 () {58 vars in 1253 bytes} [Sat Jul 23 21:29:15 2022] DELETE /identity/v3/OS-TRUST/trusts/bcebce65a6c54542b7b114b3dc947bc0 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:29:15.876125 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09aec03-da52-4f89-abac-d38b02d93d98 tempest-TrustsV3TestJSON-1507505510 tempest-user-625313893] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:15.879632 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-f09aec03-da52-4f89-abac-d38b02d93d98 tempest-TrustsV3TestJSON-1507505510 tempest-user-625313893] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:15.928674 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09aec03-da52-4f89-abac-d38b02d93d98 tempest-TrustsV3TestJSON-1507505510 tempest-user-625313893] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:15.948249 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca17d8f-ade3-434d-b18d-dade8290f350 tempest-TrustsV3TestJSON-1507505510 tempest-user-625313893] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7e886e537f44bfdb9fff32cf4d84677', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '335502ef2119483d9525ae78534a07e7', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1842562212', 'tempest-DelegatedRole-114766401'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:15.949113 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca17d8f-ade3-434d-b18d-dade8290f350 tempest-TrustsV3TestJSON-1507505510 tempest-user-625313893] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:15.951829 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca17d8f-ade3-434d-b18d-dade8290f350 tempest-TrustsV3TestJSON-1507505510 tempest-user-625313893] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:15.952137 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca17d8f-ade3-434d-b18d-dade8290f350 tempest-TrustsV3TestJSON-1507505510 tempest-user-625313893] PATH_INFO: `/v3/OS-TRUST/trusts/bcebce65a6c54542b7b114b3dc947bc0` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:15.965086 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a842c76-0ae8-4672-b8ce-fcb627ace001 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:15.975913 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48652e14-9ea8-4af4-8c08-e6f71d362cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:15.977987 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48652e14-9ea8-4af4-8c08-e6f71d362cec admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:15.978721 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48652e14-9ea8-4af4-8c08-e6f71d362cec admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:15.979446 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48652e14-9ea8-4af4-8c08-e6f71d362cec admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:15.980941 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48652e14-9ea8-4af4-8c08-e6f71d362cec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:15.987132 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48652e14-9ea8-4af4-8c08-e6f71d362cec admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:15.994870 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-3ca17d8f-ade3-434d-b18d-dade8290f350 tempest-TrustsV3TestJSON-1507505510 tempest-user-625313893] Could not find trust: bcebce65a6c54542b7b114b3dc947bc0.: keystone.exception.TrustNotFound: Could not find trust: bcebce65a6c54542b7b114b3dc947bc0. Jul 23 21:29:15.994870 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 21:29:15.994870 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 21:29:15.994870 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 21:29:15.994870 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 21:29:15.994870 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 21:29:15.994870 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 21:29:15.994870 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 21:29:15.994870 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 21:29:15.994870 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 21:29:15.994870 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 21:29:15.994870 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 21:29:15.994870 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Jul 23 21:29:15.994870 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Jul 23 21:29:15.994870 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Jul 23 21:29:15.996954 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Jul 23 21:29:15.996954 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Jul 23 21:29:15.996954 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Jul 23 21:29:15.996954 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Jul 23 21:29:15.996954 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Jul 23 21:29:15.996954 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 21:29:15.996954 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 21:29:15.996954 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Jul 23 21:29:15.996954 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Jul 23 21:29:15.996954 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Jul 23 21:29:15.996954 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Jul 23 21:29:15.996954 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: bcebce65a6c54542b7b114b3dc947bc0. Jul 23 21:29:15.996954 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 21:29:16.001650 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2390/4773] 10.222.0.17 () {58 vars in 1250 bytes} [Sat Jul 23 21:29:15 2022] GET /identity/v3/OS-TRUST/trusts/bcebce65a6c54542b7b114b3dc947bc0 => generated 111 bytes in 126 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 23 21:29:16.007081 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca17d8f-ade3-434d-b18d-dade8290f350 tempest-TrustsV3TestJSON-1507505510 tempest-user-625313893] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:16.009089 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-3ca17d8f-ade3-434d-b18d-dade8290f350 tempest-TrustsV3TestJSON-1507505510 tempest-user-625313893] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:16.079645 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2384/4774] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:29:15 2022] POST /identity/v3/projects => generated 387 bytes in 377 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:29:16.080842 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48652e14-9ea8-4af4-8c08-e6f71d362cec admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:16.083089 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-48652e14-9ea8-4af4-8c08-e6f71d362cec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:16.174077 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca17d8f-ade3-434d-b18d-dade8290f350 tempest-TrustsV3TestJSON-1507505510 tempest-user-625313893] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:16.237104 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48652e14-9ea8-4af4-8c08-e6f71d362cec admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:16.246736 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baf2b53-a152-4688-9413-d6e02ed14e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:16.247536 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baf2b53-a152-4688-9413-d6e02ed14e87 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:16.247878 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baf2b53-a152-4688-9413-d6e02ed14e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:16.248217 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baf2b53-a152-4688-9413-d6e02ed14e87 admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:16.248977 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baf2b53-a152-4688-9413-d6e02ed14e87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:16.252386 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baf2b53-a152-4688-9413-d6e02ed14e87 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:16.263267 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad18852-567a-4bf5-90a4-407f01f78ddb tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b077945a37bc4bf29f5c62b95ff45562', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd2d040691b34adeb5ae75a50f416642', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:16.264295 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad18852-567a-4bf5-90a4-407f01f78ddb tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:16.264679 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad18852-567a-4bf5-90a4-407f01f78ddb tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:16.265045 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad18852-567a-4bf5-90a4-407f01f78ddb tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] PATH_INFO: `/v3/roles/d158fe1d79ae451db6ea8ce2b7c3551d` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:16.267923 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad18852-567a-4bf5-90a4-407f01f78ddb tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: Authorizing `identity:delete_role(role_id=d158fe1d79ae451db6ea8ce2b7c3551d)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:16.269655 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad18852-567a-4bf5-90a4-407f01f78ddb tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:16.341443 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2385/4775] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:29:16 2022] POST /identity/v3/users => generated 300 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:29:16.345636 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baf2b53-a152-4688-9413-d6e02ed14e87 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:16.376036 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=95,keystone:UPDATE=1,keystone:INSERT=1,keystone:DELETE=3 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:29:16.418313 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-1ad18852-567a-4bf5-90a4-407f01f78ddb tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Invalidating the token cache because role d158fe1d79ae451db6ea8ce2b7c3551d has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:29:16.419081 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-1ad18852-567a-4bf5-90a4-407f01f78ddb tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:16.420112 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-1ad18852-567a-4bf5-90a4-407f01f78ddb tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:16.422664 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2391/4776] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:29:16 2022] DELETE /identity/v3/roles/d158fe1d79ae451db6ea8ce2b7c3551d => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:29:16.431557 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baf2b53-a152-4688-9413-d6e02ed14e87 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:16.438698 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad18852-567a-4bf5-90a4-407f01f78ddb tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:16.440846 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-1ad18852-567a-4bf5-90a4-407f01f78ddb tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:16.559666 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad18852-567a-4bf5-90a4-407f01f78ddb tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:16.568120 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39eeadf-8074-410f-a5b9-2e66626fa454 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b077945a37bc4bf29f5c62b95ff45562', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd2d040691b34adeb5ae75a50f416642', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:16.569031 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39eeadf-8074-410f-a5b9-2e66626fa454 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:16.569304 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39eeadf-8074-410f-a5b9-2e66626fa454 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:16.569597 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39eeadf-8074-410f-a5b9-2e66626fa454 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] PATH_INFO: `/v3/roles/1f0f04ae264b4e79a92d3b3df67b50a8` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:16.571437 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39eeadf-8074-410f-a5b9-2e66626fa454 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: Authorizing `identity:delete_role(role_id=1f0f04ae264b4e79a92d3b3df67b50a8)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:16.573062 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39eeadf-8074-410f-a5b9-2e66626fa454 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:16.627184 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dfe75c-be7e-4a65-8b21-1d18b3e82ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:16.628091 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dfe75c-be7e-4a65-8b21-1d18b3e82ec7 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:16.628558 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dfe75c-be7e-4a65-8b21-1d18b3e82ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:16.628890 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dfe75c-be7e-4a65-8b21-1d18b3e82ec7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:16.629695 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dfe75c-be7e-4a65-8b21-1d18b3e82ec7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:16.631518 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dfe75c-be7e-4a65-8b21-1d18b3e82ec7 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:16.645689 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-c39eeadf-8074-410f-a5b9-2e66626fa454 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Invalidating the token cache because role 1f0f04ae264b4e79a92d3b3df67b50a8 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:29:16.646048 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-c39eeadf-8074-410f-a5b9-2e66626fa454 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:16.647128 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-c39eeadf-8074-410f-a5b9-2e66626fa454 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:16.653008 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2392/4777] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:29:16 2022] DELETE /identity/v3/roles/1f0f04ae264b4e79a92d3b3df67b50a8 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:29:16.654350 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39eeadf-8074-410f-a5b9-2e66626fa454 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:16.658379 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-c39eeadf-8074-410f-a5b9-2e66626fa454 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:16.663729 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2386/4778] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:29:16 2022] GET /identity/v3/roles => generated 1654 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:29:16.668103 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dfe75c-be7e-4a65-8b21-1d18b3e82ec7 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:16.672556 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-47dfe75c-be7e-4a65-8b21-1d18b3e82ec7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:16.699885 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dfe75c-be7e-4a65-8b21-1d18b3e82ec7 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:16.824212 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:29:16.870834 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39eeadf-8074-410f-a5b9-2e66626fa454 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:16.891771 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21330316-ead0-425c-89e3-394c44500e4b tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b077945a37bc4bf29f5c62b95ff45562', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd2d040691b34adeb5ae75a50f416642', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:16.892703 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21330316-ead0-425c-89e3-394c44500e4b tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:16.892983 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21330316-ead0-425c-89e3-394c44500e4b tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:16.893256 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21330316-ead0-425c-89e3-394c44500e4b tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] PATH_INFO: `/v3/users/f7e886e537f44bfdb9fff32cf4d84677` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:16.899359 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21330316-ead0-425c-89e3-394c44500e4b tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: Authorizing `identity:delete_user(user_id=f7e886e537f44bfdb9fff32cf4d84677)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:16.906215 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21330316-ead0-425c-89e3-394c44500e4b tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:16.910855 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105c5615-61b8-4efe-80f2-8e2a244315d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:16.911859 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105c5615-61b8-4efe-80f2-8e2a244315d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:16.912379 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105c5615-61b8-4efe-80f2-8e2a244315d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:16.912725 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105c5615-61b8-4efe-80f2-8e2a244315d5 admin admin] PATH_INFO: `/v3/projects/e8cfa74dbc1a44a4b790d89f517171dd/users/78f441e59aa04412a44568b3992a84cc/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:16.950140 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105c5615-61b8-4efe-80f2-8e2a244315d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8cfa74dbc1a44a4b790d89f517171dd, user_id=78f441e59aa04412a44568b3992a84cc, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:16.954743 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105c5615-61b8-4efe-80f2-8e2a244315d5 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:16.990508 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2387/4779] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:29:16 2022] PUT /identity/v3/projects/e8cfa74dbc1a44a4b790d89f517171dd/users/78f441e59aa04412a44568b3992a84cc/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:29:16.992366 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105c5615-61b8-4efe-80f2-8e2a244315d5 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:16.995690 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-105c5615-61b8-4efe-80f2-8e2a244315d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:16.998863 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-21330316-ead0-425c-89e3-394c44500e4b tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7e886e537f44bfdb9fff32cf4d84677'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:17.014955 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-21330316-ead0-425c-89e3-394c44500e4b tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7e886e537f44bfdb9fff32cf4d84677'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:17.015703 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-21330316-ead0-425c-89e3-394c44500e4b tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7e886e537f44bfdb9fff32cf4d84677'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:17.028722 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:29:17.044586 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-21330316-ead0-425c-89e3-394c44500e4b tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7e886e537f44bfdb9fff32cf4d84677'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:17.067487 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-21330316-ead0-425c-89e3-394c44500e4b tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7e886e537f44bfdb9fff32cf4d84677'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:17.108554 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2393/4780] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:29:16 2022] DELETE /identity/v3/users/f7e886e537f44bfdb9fff32cf4d84677 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:29:17.112039 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21330316-ead0-425c-89e3-394c44500e4b tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:17.116323 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-21330316-ead0-425c-89e3-394c44500e4b tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:17.180657 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105c5615-61b8-4efe-80f2-8e2a244315d5 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:17.298807 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21330316-ead0-425c-89e3-394c44500e4b tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:17.308145 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a586899-56b1-4158-9f7e-6659ca51b16a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:17.309502 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a586899-56b1-4158-9f7e-6659ca51b16a admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:17.310021 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a586899-56b1-4158-9f7e-6659ca51b16a admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:17.310553 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a586899-56b1-4158-9f7e-6659ca51b16a admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:17.311630 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a586899-56b1-4158-9f7e-6659ca51b16a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:17.313790 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a586899-56b1-4158-9f7e-6659ca51b16a admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:17.317237 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341f13ed-1f7e-4096-acbc-3b4b2a83c0bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:17.319906 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341f13ed-1f7e-4096-acbc-3b4b2a83c0bf service nova] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:17.320075 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341f13ed-1f7e-4096-acbc-3b4b2a83c0bf service nova] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:17.320458 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341f13ed-1f7e-4096-acbc-3b4b2a83c0bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:17.326729 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-341f13ed-1f7e-4096-acbc-3b4b2a83c0bf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:17.336947 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2394/4781] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:29:17 2022] GET /identity/v3/roles => generated 1420 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:29:17.338294 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a586899-56b1-4158-9f7e-6659ca51b16a admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:17.340625 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-9a586899-56b1-4158-9f7e-6659ca51b16a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:17.355024 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341f13ed-1f7e-4096-acbc-3b4b2a83c0bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:17.358408 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341f13ed-1f7e-4096-acbc-3b4b2a83c0bf service nova] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:17.383495 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2388/4782] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:29:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:29:17.384884 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341f13ed-1f7e-4096-acbc-3b4b2a83c0bf service nova] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:17.408317 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341f13ed-1f7e-4096-acbc-3b4b2a83c0bf service nova] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:17.417727 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acabded-0ed5-487c-b6ea-5b0d8b3b9828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:17.418811 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acabded-0ed5-487c-b6ea-5b0d8b3b9828 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:17.419095 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acabded-0ed5-487c-b6ea-5b0d8b3b9828 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:17.419367 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acabded-0ed5-487c-b6ea-5b0d8b3b9828 admin admin] PATH_INFO: `/v3/projects/e8cfa74dbc1a44a4b790d89f517171dd/users/78f441e59aa04412a44568b3992a84cc/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:17.421446 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acabded-0ed5-487c-b6ea-5b0d8b3b9828 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8cfa74dbc1a44a4b790d89f517171dd, user_id=78f441e59aa04412a44568b3992a84cc, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:17.435948 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acabded-0ed5-487c-b6ea-5b0d8b3b9828 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:17.445297 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a586899-56b1-4158-9f7e-6659ca51b16a admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:17.455171 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd662a8-770a-47ba-98d4-119962f4ae32 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b077945a37bc4bf29f5c62b95ff45562', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd2d040691b34adeb5ae75a50f416642', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:17.456674 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd662a8-770a-47ba-98d4-119962f4ae32 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:17.457121 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd662a8-770a-47ba-98d4-119962f4ae32 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:17.457584 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd662a8-770a-47ba-98d4-119962f4ae32 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] PATH_INFO: `/v3/projects/335502ef2119483d9525ae78534a07e7` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:17.459578 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd662a8-770a-47ba-98d4-119962f4ae32 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: Authorizing `identity:delete_project(project_id=335502ef2119483d9525ae78534a07e7)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:17.462395 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd662a8-770a-47ba-98d4-119962f4ae32 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:17.472675 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2389/4783] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:29:17 2022] PUT /identity/v3/projects/e8cfa74dbc1a44a4b790d89f517171dd/users/78f441e59aa04412a44568b3992a84cc/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:29:17.474554 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd68598e-489d-407d-8d18-9a381a98e1c5 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:17.474960 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd68598e-489d-407d-8d18-9a381a98e1c5 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:17.475304 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd68598e-489d-407d-8d18-9a381a98e1c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:17.519141 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-fd68598e-489d-407d-8d18-9a381a98e1c5 None None] MFA Rules not processed for user `78f441e59aa04412a44568b3992a84cc`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:29:17.519141 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-fd68598e-489d-407d-8d18-9a381a98e1c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:17.545322 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:29:17.602077 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-afd662a8-770a-47ba-98d4-119962f4ae32 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '335502ef2119483d9525ae78534a07e7', 'request_id': 'req-afd662a8-770a-47ba-98d4-119962f4ae32'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:17.631715 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-afd662a8-770a-47ba-98d4-119962f4ae32 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '335502ef2119483d9525ae78534a07e7', 'request_id': 'req-afd662a8-770a-47ba-98d4-119962f4ae32'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:17.643850 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-afd662a8-770a-47ba-98d4-119962f4ae32 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '335502ef2119483d9525ae78534a07e7', 'request_id': 'req-afd662a8-770a-47ba-98d4-119962f4ae32'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:17.650939 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2390/4784] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:29:17 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:29:17.663010 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd68598e-489d-407d-8d18-9a381a98e1c5 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:17.665767 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-fd68598e-489d-407d-8d18-9a381a98e1c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:17.679176 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-afd662a8-770a-47ba-98d4-119962f4ae32 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] The token cache is being invalidate because project 335502ef2119483d9525ae78534a07e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:29:17.680054 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-afd662a8-770a-47ba-98d4-119962f4ae32 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:17.682693 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-afd662a8-770a-47ba-98d4-119962f4ae32 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:17.684649 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2395/4785] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:29:17 2022] DELETE /identity/v3/projects/335502ef2119483d9525ae78534a07e7 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:29:17.691585 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd662a8-770a-47ba-98d4-119962f4ae32 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:17.693151 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-afd662a8-770a-47ba-98d4-119962f4ae32 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:17.699798 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:29:17.805218 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd68598e-489d-407d-8d18-9a381a98e1c5 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:17.848585 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd662a8-770a-47ba-98d4-119962f4ae32 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:17.855495 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c797f4-8043-4184-87be-0367aef9190d tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b077945a37bc4bf29f5c62b95ff45562', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd2d040691b34adeb5ae75a50f416642', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:17.856344 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c797f4-8043-4184-87be-0367aef9190d tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:17.856681 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c797f4-8043-4184-87be-0367aef9190d tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:17.857408 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c797f4-8043-4184-87be-0367aef9190d tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:17.858075 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c797f4-8043-4184-87be-0367aef9190d tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:17.860340 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c797f4-8043-4184-87be-0367aef9190d tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:17.922998 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2396/4786] 10.222.0.17 () {60 vars in 1151 bytes} [Sat Jul 23 21:29:17 2022] POST /identity/v3/projects => generated 329 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:29:17.930921 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c797f4-8043-4184-87be-0367aef9190d tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:17.951283 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bac271-1299-4e73-816d-9bca4b4b5f34 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec5fd3a489c341b7964704d689037f05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:17.952277 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bac271-1299-4e73-816d-9bca4b4b5f34 service cinder] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:17.952717 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bac271-1299-4e73-816d-9bca4b4b5f34 service cinder] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:17.953224 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bac271-1299-4e73-816d-9bca4b4b5f34 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:17.959726 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-48bac271-1299-4e73-816d-9bca4b4b5f34 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:18.096281 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bac271-1299-4e73-816d-9bca4b4b5f34 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:18.097913 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bac271-1299-4e73-816d-9bca4b4b5f34 service cinder] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:18.109426 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c797f4-8043-4184-87be-0367aef9190d tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:18.115719 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd4f90a-57d1-44db-bb43-dea002b66ecd tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b077945a37bc4bf29f5c62b95ff45562', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd2d040691b34adeb5ae75a50f416642', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:18.116608 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd4f90a-57d1-44db-bb43-dea002b66ecd tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:18.116727 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd4f90a-57d1-44db-bb43-dea002b66ecd tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:18.118321 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2391/4787] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:29:17 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 23 21:29:18.133172 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd4f90a-57d1-44db-bb43-dea002b66ecd tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:18.134537 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd4f90a-57d1-44db-bb43-dea002b66ecd tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:18.137094 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd4f90a-57d1-44db-bb43-dea002b66ecd tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:18.202039 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2397/4788] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:29:17 2022] POST /identity/v3/users => generated 413 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:29:18.203726 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bac271-1299-4e73-816d-9bca4b4b5f34 service cinder] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:18.233701 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bac271-1299-4e73-816d-9bca4b4b5f34 service cinder] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:18.242167 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd4f90a-57d1-44db-bb43-dea002b66ecd tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:18.245705 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-7cd4f90a-57d1-44db-bb43-dea002b66ecd tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:18.267937 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d3f9e2-e4a4-4230-9473-774e5688f6d3 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b077945a37bc4bf29f5c62b95ff45562', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd2d040691b34adeb5ae75a50f416642', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:18.280507 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d3f9e2-e4a4-4230-9473-774e5688f6d3 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:18.281209 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d3f9e2-e4a4-4230-9473-774e5688f6d3 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:18.281584 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d3f9e2-e4a4-4230-9473-774e5688f6d3 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:18.283056 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d3f9e2-e4a4-4230-9473-774e5688f6d3 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:18.284566 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d3f9e2-e4a4-4230-9473-774e5688f6d3 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:18.320998 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2392/4789] 10.222.0.17 () {60 vars in 1142 bytes} [Sat Jul 23 21:29:18 2022] POST /identity/v3/roles => generated 243 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:29:18.326796 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d3f9e2-e4a4-4230-9473-774e5688f6d3 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:18.335169 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:29:18.342132 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d3f9e2-e4a4-4230-9473-774e5688f6d3 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:18.357927 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca78bfee-4d6f-4cc3-95a6-c14aeaa7e906 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b077945a37bc4bf29f5c62b95ff45562', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd2d040691b34adeb5ae75a50f416642', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:18.357927 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca78bfee-4d6f-4cc3-95a6-c14aeaa7e906 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:18.357927 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca78bfee-4d6f-4cc3-95a6-c14aeaa7e906 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:18.358855 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca78bfee-4d6f-4cc3-95a6-c14aeaa7e906 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:18.358855 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca78bfee-4d6f-4cc3-95a6-c14aeaa7e906 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:18.358855 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca78bfee-4d6f-4cc3-95a6-c14aeaa7e906 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:18.378990 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2393/4790] 10.222.0.17 () {60 vars in 1142 bytes} [Sat Jul 23 21:29:18 2022] POST /identity/v3/roles => generated 247 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:29:18.383851 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca78bfee-4d6f-4cc3-95a6-c14aeaa7e906 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:18.393366 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd4f90a-57d1-44db-bb43-dea002b66ecd tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:18.398198 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca78bfee-4d6f-4cc3-95a6-c14aeaa7e906 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:18.398586 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3216ab0f-36cb-4cf1-a593-fcad5b126145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:18.399501 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3216ab0f-36cb-4cf1-a593-fcad5b126145 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:18.399782 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3216ab0f-36cb-4cf1-a593-fcad5b126145 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:18.400055 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3216ab0f-36cb-4cf1-a593-fcad5b126145 admin admin] PATH_INFO: `/v3/users/d7e7d655656f4d748ee71fe1fe2b9236` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:18.401445 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3216ab0f-36cb-4cf1-a593-fcad5b126145 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7e7d655656f4d748ee71fe1fe2b9236)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:18.405191 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc18e64-c604-4edd-a4d5-29ff4d05faca tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b077945a37bc4bf29f5c62b95ff45562', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd2d040691b34adeb5ae75a50f416642', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:18.406154 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc18e64-c604-4edd-a4d5-29ff4d05faca tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:18.406304 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3216ab0f-36cb-4cf1-a593-fcad5b126145 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:18.406499 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc18e64-c604-4edd-a4d5-29ff4d05faca tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:18.406699 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc18e64-c604-4edd-a4d5-29ff4d05faca tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] PATH_INFO: `/v3/projects/0b29c67d30cb4e45b8a436c52eccc1b6/users/b3383e5bd3a14f8796c06a26d7893c26/roles/e23a13c1a267406993bc9e562ef90f50` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:18.435665 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:29:18.444264 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc18e64-c604-4edd-a4d5-29ff4d05faca tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: Authorizing `identity:create_grant(project_id=0b29c67d30cb4e45b8a436c52eccc1b6, user_id=b3383e5bd3a14f8796c06a26d7893c26, role_id=e23a13c1a267406993bc9e562ef90f50)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:18.447512 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc18e64-c604-4edd-a4d5-29ff4d05faca tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:18.475638 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2394/4791] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:29:18 2022] PUT /identity/v3/projects/0b29c67d30cb4e45b8a436c52eccc1b6/users/b3383e5bd3a14f8796c06a26d7893c26/roles/e23a13c1a267406993bc9e562ef90f50 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:29:18.484130 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc18e64-c604-4edd-a4d5-29ff4d05faca tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:18.489339 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-3216ab0f-36cb-4cf1-a593-fcad5b126145 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7e7d655656f4d748ee71fe1fe2b9236'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:18.501421 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-3216ab0f-36cb-4cf1-a593-fcad5b126145 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7e7d655656f4d748ee71fe1fe2b9236'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:18.502209 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-3216ab0f-36cb-4cf1-a593-fcad5b126145 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7e7d655656f4d748ee71fe1fe2b9236'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:18.513299 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-3216ab0f-36cb-4cf1-a593-fcad5b126145 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7e7d655656f4d748ee71fe1fe2b9236'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:18.533286 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-3216ab0f-36cb-4cf1-a593-fcad5b126145 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7e7d655656f4d748ee71fe1fe2b9236'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:18.545581 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2398/4792] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:29:18 2022] DELETE /identity/v3/users/d7e7d655656f4d748ee71fe1fe2b9236 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:29:18.548685 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2ea5d6-fcd0-4c81-a619-f08c58fb0292 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:18.549103 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2ea5d6-fcd0-4c81-a619-f08c58fb0292 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:18.549649 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2ea5d6-fcd0-4c81-a619-f08c58fb0292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:18.574561 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-bd2ea5d6-fcd0-4c81-a619-f08c58fb0292 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:29:18.575802 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-bd2ea5d6-fcd0-4c81-a619-f08c58fb0292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:18.577932 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc18e64-c604-4edd-a4d5-29ff4d05faca tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:18.680997 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2399/4793] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:29:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:29:18.695600 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2ea5d6-fcd0-4c81-a619-f08c58fb0292 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:18.697252 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-bd2ea5d6-fcd0-4c81-a619-f08c58fb0292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:18.729807 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb24204c-43ed-4803-b0ad-baa073478ec7 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b077945a37bc4bf29f5c62b95ff45562', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd2d040691b34adeb5ae75a50f416642', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:18.734021 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb24204c-43ed-4803-b0ad-baa073478ec7 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:18.744611 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb24204c-43ed-4803-b0ad-baa073478ec7 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:18.744611 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb24204c-43ed-4803-b0ad-baa073478ec7 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] PATH_INFO: `/v3/projects/0b29c67d30cb4e45b8a436c52eccc1b6/users/b3383e5bd3a14f8796c06a26d7893c26/roles/7fefdc98a40747049d042be889dc23a8` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:18.749678 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb24204c-43ed-4803-b0ad-baa073478ec7 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: Authorizing `identity:create_grant(project_id=0b29c67d30cb4e45b8a436c52eccc1b6, user_id=b3383e5bd3a14f8796c06a26d7893c26, role_id=7fefdc98a40747049d042be889dc23a8)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:18.753225 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb24204c-43ed-4803-b0ad-baa073478ec7 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:18.786122 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2395/4794] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:29:18 2022] PUT /identity/v3/projects/0b29c67d30cb4e45b8a436c52eccc1b6/users/b3383e5bd3a14f8796c06a26d7893c26/roles/7fefdc98a40747049d042be889dc23a8 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:29:18.790188 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb24204c-43ed-4803-b0ad-baa073478ec7 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:18.792412 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-fb24204c-43ed-4803-b0ad-baa073478ec7 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:18.842259 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2ea5d6-fcd0-4c81-a619-f08c58fb0292 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:18.906819 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1881bfc4-0975-4945-af49-13beab53aa90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:18.907378 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1881bfc4-0975-4945-af49-13beab53aa90 service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:18.907641 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1881bfc4-0975-4945-af49-13beab53aa90 service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:18.908358 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1881bfc4-0975-4945-af49-13beab53aa90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:18.914457 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:29:18.941461 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb24204c-43ed-4803-b0ad-baa073478ec7 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:18.951767 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc29cdd-9950-45da-961f-96e187f0d0e8 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b077945a37bc4bf29f5c62b95ff45562', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd2d040691b34adeb5ae75a50f416642', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:18.952986 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc29cdd-9950-45da-961f-96e187f0d0e8 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:18.953664 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc29cdd-9950-45da-961f-96e187f0d0e8 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:18.954295 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc29cdd-9950-45da-961f-96e187f0d0e8 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:18.955341 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc29cdd-9950-45da-961f-96e187f0d0e8 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:18.957679 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc29cdd-9950-45da-961f-96e187f0d0e8 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:19.003148 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1881bfc4-0975-4945-af49-13beab53aa90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:19.004479 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1881bfc4-0975-4945-af49-13beab53aa90 service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:19.006874 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2396/4795] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:29:18 2022] GET /identity/v3/users => generated 8356 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:29:19.015248 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fb7de7-99fc-416a-a090-061d46a0e16d None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:19.015895 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2400/4796] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:29:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 23 21:29:19.016225 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fb7de7-99fc-416a-a090-061d46a0e16d None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:19.016960 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fb7de7-99fc-416a-a090-061d46a0e16d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:19.025910 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:29:19.082495 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-88fb7de7-99fc-416a-a090-061d46a0e16d None None] MFA Rules not processed for user `b3383e5bd3a14f8796c06a26d7893c26`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:29:19.083892 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-88fb7de7-99fc-416a-a090-061d46a0e16d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:19.187574 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2397/4797] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:29:19 2022] POST /identity/v3/auth/tokens => generated 3269 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:29:19.197340 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f34883-bc51-4ec3-a5c4-10a5b8f57d1b None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:19.197608 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f34883-bc51-4ec3-a5c4-10a5b8f57d1b None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:19.197907 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f34883-bc51-4ec3-a5c4-10a5b8f57d1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:19.220531 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-10f34883-bc51-4ec3-a5c4-10a5b8f57d1b None None] MFA Rules not processed for user `b3383e5bd3a14f8796c06a26d7893c26`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:29:19.222295 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-10f34883-bc51-4ec3-a5c4-10a5b8f57d1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:19.232295 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2401/4798] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:29:19 2022] POST /identity/v3/auth/tokens => generated 3269 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:29:19.236953 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fb7de7-99fc-416a-a090-061d46a0e16d None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:19.253025 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fb7de7-99fc-416a-a090-061d46a0e16d None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:19.267883 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15a0285-c922-4383-89cb-322e605ce274 tempest-TrustsV3TestJSON-2082339297 tempest-user-989783349] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3383e5bd3a14f8796c06a26d7893c26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b29c67d30cb4e45b8a436c52eccc1b6', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-549813097', 'tempest-NotDelegatedRole-1021385602'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:19.268750 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15a0285-c922-4383-89cb-322e605ce274 tempest-TrustsV3TestJSON-2082339297 tempest-user-989783349] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:19.269030 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15a0285-c922-4383-89cb-322e605ce274 tempest-TrustsV3TestJSON-2082339297 tempest-user-989783349] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:19.269766 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15a0285-c922-4383-89cb-322e605ce274 tempest-TrustsV3TestJSON-2082339297 tempest-user-989783349] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:19.270172 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15a0285-c922-4383-89cb-322e605ce274 tempest-TrustsV3TestJSON-2082339297 tempest-user-989783349] RBAC: Authorizing `identity:create_trust()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:19.271303 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15a0285-c922-4383-89cb-322e605ce274 tempest-TrustsV3TestJSON-2082339297 tempest-user-989783349] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:19.379207 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2398/4799] 10.222.0.17 () {60 vars in 1173 bytes} [Sat Jul 23 21:29:19 2022] POST /identity/v3/OS-TRUST/trusts => generated 834 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:29:19.383038 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f34883-bc51-4ec3-a5c4-10a5b8f57d1b None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:19.396413 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f34883-bc51-4ec3-a5c4-10a5b8f57d1b None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:19.401568 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a6e499-3756-42df-8206-a70afbbd582d tempest-TrustsV3TestJSON-2082339297 tempest-user-989783349] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3383e5bd3a14f8796c06a26d7893c26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b29c67d30cb4e45b8a436c52eccc1b6', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-549813097', 'tempest-NotDelegatedRole-1021385602'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:19.402463 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a6e499-3756-42df-8206-a70afbbd582d tempest-TrustsV3TestJSON-2082339297 tempest-user-989783349] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:19.402742 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a6e499-3756-42df-8206-a70afbbd582d tempest-TrustsV3TestJSON-2082339297 tempest-user-989783349] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:19.403017 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a6e499-3756-42df-8206-a70afbbd582d tempest-TrustsV3TestJSON-2082339297 tempest-user-989783349] PATH_INFO: `/v3/OS-TRUST/trusts/557c766070ba4fa796f748af64926e7e` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:19.414638 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a6e499-3756-42df-8206-a70afbbd582d tempest-TrustsV3TestJSON-2082339297 tempest-user-989783349] RBAC: Authorizing `identity:get_trust(trust_id=557c766070ba4fa796f748af64926e7e)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:19.416197 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a6e499-3756-42df-8206-a70afbbd582d tempest-TrustsV3TestJSON-2082339297 tempest-user-989783349] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:19.436252 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2402/4800] 10.222.0.17 () {58 vars in 1250 bytes} [Sat Jul 23 21:29:19 2022] GET /identity/v3/OS-TRUST/trusts/557c766070ba4fa796f748af64926e7e => generated 834 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:29:19.440952 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15a0285-c922-4383-89cb-322e605ce274 tempest-TrustsV3TestJSON-2082339297 tempest-user-989783349] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:19.455664 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15a0285-c922-4383-89cb-322e605ce274 tempest-TrustsV3TestJSON-2082339297 tempest-user-989783349] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:19.462243 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f211163-cea2-47ea-80ef-3fd985ca4c0f tempest-TrustsV3TestJSON-2082339297 tempest-user-989783349] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3383e5bd3a14f8796c06a26d7893c26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b29c67d30cb4e45b8a436c52eccc1b6', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-549813097', 'tempest-NotDelegatedRole-1021385602'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:19.463638 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f211163-cea2-47ea-80ef-3fd985ca4c0f tempest-TrustsV3TestJSON-2082339297 tempest-user-989783349] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:19.463967 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f211163-cea2-47ea-80ef-3fd985ca4c0f tempest-TrustsV3TestJSON-2082339297 tempest-user-989783349] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:19.464246 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f211163-cea2-47ea-80ef-3fd985ca4c0f tempest-TrustsV3TestJSON-2082339297 tempest-user-989783349] PATH_INFO: `/v3/OS-TRUST/trusts/557c766070ba4fa796f748af64926e7e/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:19.474237 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f211163-cea2-47ea-80ef-3fd985ca4c0f tempest-TrustsV3TestJSON-2082339297 tempest-user-989783349] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=557c766070ba4fa796f748af64926e7e)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:19.476118 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f211163-cea2-47ea-80ef-3fd985ca4c0f tempest-TrustsV3TestJSON-2082339297 tempest-user-989783349] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:19.487447 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2399/4801] 10.222.0.17 () {58 vars in 1268 bytes} [Sat Jul 23 21:29:19 2022] GET /identity/v3/OS-TRUST/trusts/557c766070ba4fa796f748af64926e7e/roles => generated 370 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:29:19.491191 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a6e499-3756-42df-8206-a70afbbd582d tempest-TrustsV3TestJSON-2082339297 tempest-user-989783349] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:19.502088 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a6e499-3756-42df-8206-a70afbbd582d tempest-TrustsV3TestJSON-2082339297 tempest-user-989783349] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:19.510588 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c1a3c7-055e-4e5c-b2a5-bc614de480aa tempest-TrustsV3TestJSON-2082339297 tempest-user-989783349] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3383e5bd3a14f8796c06a26d7893c26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b29c67d30cb4e45b8a436c52eccc1b6', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-549813097', 'tempest-NotDelegatedRole-1021385602'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:19.511919 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c1a3c7-055e-4e5c-b2a5-bc614de480aa tempest-TrustsV3TestJSON-2082339297 tempest-user-989783349] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:19.512135 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c1a3c7-055e-4e5c-b2a5-bc614de480aa tempest-TrustsV3TestJSON-2082339297 tempest-user-989783349] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:19.512374 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c1a3c7-055e-4e5c-b2a5-bc614de480aa tempest-TrustsV3TestJSON-2082339297 tempest-user-989783349] PATH_INFO: `/v3/OS-TRUST/trusts/557c766070ba4fa796f748af64926e7e/roles/e23a13c1a267406993bc9e562ef90f50` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:19.520985 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c1a3c7-055e-4e5c-b2a5-bc614de480aa tempest-TrustsV3TestJSON-2082339297 tempest-user-989783349] RBAC: Authorizing `identity:get_role_for_trust(trust_id=557c766070ba4fa796f748af64926e7e, role_id=e23a13c1a267406993bc9e562ef90f50)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:19.522703 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c1a3c7-055e-4e5c-b2a5-bc614de480aa tempest-TrustsV3TestJSON-2082339297 tempest-user-989783349] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:19.534554 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2403/4802] 10.222.0.17 () {58 vars in 1367 bytes} [Sat Jul 23 21:29:19 2022] GET /identity/v3/OS-TRUST/trusts/557c766070ba4fa796f748af64926e7e/roles/e23a13c1a267406993bc9e562ef90f50 => generated 243 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:29:19.535913 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f211163-cea2-47ea-80ef-3fd985ca4c0f tempest-TrustsV3TestJSON-2082339297 tempest-user-989783349] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:19.553658 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f211163-cea2-47ea-80ef-3fd985ca4c0f tempest-TrustsV3TestJSON-2082339297 tempest-user-989783349] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:19.560037 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9616a09e-f253-44ba-b588-b804ee5d7ca1 tempest-TrustsV3TestJSON-2082339297 tempest-user-989783349] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3383e5bd3a14f8796c06a26d7893c26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b29c67d30cb4e45b8a436c52eccc1b6', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-549813097', 'tempest-NotDelegatedRole-1021385602'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:19.560990 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9616a09e-f253-44ba-b588-b804ee5d7ca1 tempest-TrustsV3TestJSON-2082339297 tempest-user-989783349] REQUEST_METHOD: `HEAD` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:19.561322 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9616a09e-f253-44ba-b588-b804ee5d7ca1 tempest-TrustsV3TestJSON-2082339297 tempest-user-989783349] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:19.561659 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9616a09e-f253-44ba-b588-b804ee5d7ca1 tempest-TrustsV3TestJSON-2082339297 tempest-user-989783349] PATH_INFO: `/v3/OS-TRUST/trusts/557c766070ba4fa796f748af64926e7e/roles/e23a13c1a267406993bc9e562ef90f50` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:19.572238 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9616a09e-f253-44ba-b588-b804ee5d7ca1 tempest-TrustsV3TestJSON-2082339297 tempest-user-989783349] RBAC: Authorizing `identity:get_role_for_trust(trust_id=557c766070ba4fa796f748af64926e7e, role_id=e23a13c1a267406993bc9e562ef90f50)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:19.572667 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9616a09e-f253-44ba-b588-b804ee5d7ca1 tempest-TrustsV3TestJSON-2082339297 tempest-user-989783349] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:19.583876 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2400/4803] 10.222.0.17 () {58 vars in 1368 bytes} [Sat Jul 23 21:29:19 2022] HEAD /identity/v3/OS-TRUST/trusts/557c766070ba4fa796f748af64926e7e/roles/e23a13c1a267406993bc9e562ef90f50 => generated 0 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Jul 23 21:29:19.585164 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c1a3c7-055e-4e5c-b2a5-bc614de480aa tempest-TrustsV3TestJSON-2082339297 tempest-user-989783349] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:19.595221 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c1a3c7-055e-4e5c-b2a5-bc614de480aa tempest-TrustsV3TestJSON-2082339297 tempest-user-989783349] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:19.599492 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2b9ac7-92b3-40af-8714-9e713996b1b0 tempest-TrustsV3TestJSON-2082339297 tempest-user-989783349] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3383e5bd3a14f8796c06a26d7893c26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b29c67d30cb4e45b8a436c52eccc1b6', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-549813097', 'tempest-NotDelegatedRole-1021385602'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:19.600407 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2b9ac7-92b3-40af-8714-9e713996b1b0 tempest-TrustsV3TestJSON-2082339297 tempest-user-989783349] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:19.600747 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2b9ac7-92b3-40af-8714-9e713996b1b0 tempest-TrustsV3TestJSON-2082339297 tempest-user-989783349] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:19.601093 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2b9ac7-92b3-40af-8714-9e713996b1b0 tempest-TrustsV3TestJSON-2082339297 tempest-user-989783349] PATH_INFO: `/v3/OS-TRUST/trusts/557c766070ba4fa796f748af64926e7e/roles/7fefdc98a40747049d042be889dc23a8` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:19.608491 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2b9ac7-92b3-40af-8714-9e713996b1b0 tempest-TrustsV3TestJSON-2082339297 tempest-user-989783349] RBAC: Authorizing `identity:get_role_for_trust(trust_id=557c766070ba4fa796f748af64926e7e, role_id=7fefdc98a40747049d042be889dc23a8)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:19.609560 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2b9ac7-92b3-40af-8714-9e713996b1b0 tempest-TrustsV3TestJSON-2082339297 tempest-user-989783349] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:19.627695 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-eb2b9ac7-92b3-40af-8714-9e713996b1b0 tempest-TrustsV3TestJSON-2082339297 tempest-user-989783349] Could not find role: 7fefdc98a40747049d042be889dc23a8.: keystone.exception.RoleNotFound: Could not find role: 7fefdc98a40747049d042be889dc23a8. Jul 23 21:29:19.627695 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 21:29:19.627695 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 21:29:19.627695 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 21:29:19.627695 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 21:29:19.627695 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 21:29:19.627695 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 21:29:19.627695 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 21:29:19.627695 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 21:29:19.627695 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 21:29:19.627695 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 21:29:19.627695 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 21:29:19.627695 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Jul 23 21:29:19.627695 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 21:29:19.628864 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 7fefdc98a40747049d042be889dc23a8. Jul 23 21:29:19.628864 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 21:29:19.633524 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9616a09e-f253-44ba-b588-b804ee5d7ca1 tempest-TrustsV3TestJSON-2082339297 tempest-user-989783349] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:19.646091 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2404/4804] 10.222.0.17 () {58 vars in 1367 bytes} [Sat Jul 23 21:29:19 2022] GET /identity/v3/OS-TRUST/trusts/557c766070ba4fa796f748af64926e7e/roles/7fefdc98a40747049d042be889dc23a8 => generated 110 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Jul 23 21:29:19.668488 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9616a09e-f253-44ba-b588-b804ee5d7ca1 tempest-TrustsV3TestJSON-2082339297 tempest-user-989783349] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:19.672983 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c56fbf1-1eef-481a-bd10-a7e030d2b948 tempest-TrustsV3TestJSON-2082339297 tempest-user-989783349] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3383e5bd3a14f8796c06a26d7893c26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b29c67d30cb4e45b8a436c52eccc1b6', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-549813097', 'tempest-NotDelegatedRole-1021385602'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:19.674053 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c56fbf1-1eef-481a-bd10-a7e030d2b948 tempest-TrustsV3TestJSON-2082339297 tempest-user-989783349] REQUEST_METHOD: `HEAD` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:19.674405 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c56fbf1-1eef-481a-bd10-a7e030d2b948 tempest-TrustsV3TestJSON-2082339297 tempest-user-989783349] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:19.674753 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c56fbf1-1eef-481a-bd10-a7e030d2b948 tempest-TrustsV3TestJSON-2082339297 tempest-user-989783349] PATH_INFO: `/v3/OS-TRUST/trusts/557c766070ba4fa796f748af64926e7e/roles/7fefdc98a40747049d042be889dc23a8` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:19.681963 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c56fbf1-1eef-481a-bd10-a7e030d2b948 tempest-TrustsV3TestJSON-2082339297 tempest-user-989783349] RBAC: Authorizing `identity:get_role_for_trust(trust_id=557c766070ba4fa796f748af64926e7e, role_id=7fefdc98a40747049d042be889dc23a8)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:19.683494 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c56fbf1-1eef-481a-bd10-a7e030d2b948 tempest-TrustsV3TestJSON-2082339297 tempest-user-989783349] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:19.699783 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-4c56fbf1-1eef-481a-bd10-a7e030d2b948 tempest-TrustsV3TestJSON-2082339297 tempest-user-989783349] Could not find role: 7fefdc98a40747049d042be889dc23a8.: keystone.exception.RoleNotFound: Could not find role: 7fefdc98a40747049d042be889dc23a8. Jul 23 21:29:19.699783 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 21:29:19.699783 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 21:29:19.699783 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 21:29:19.699783 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 21:29:19.699783 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 21:29:19.699783 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 21:29:19.699783 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 21:29:19.699783 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 21:29:19.699783 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 21:29:19.699783 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 21:29:19.699783 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 21:29:19.699783 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Jul 23 21:29:19.699783 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 21:29:19.701735 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 7fefdc98a40747049d042be889dc23a8. Jul 23 21:29:19.701735 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 21:29:19.701735 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2401/4805] 10.222.0.17 () {58 vars in 1368 bytes} [Sat Jul 23 21:29:19 2022] HEAD /identity/v3/OS-TRUST/trusts/557c766070ba4fa796f748af64926e7e/roles/7fefdc98a40747049d042be889dc23a8 => generated 0 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 23 21:29:19.709277 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2b9ac7-92b3-40af-8714-9e713996b1b0 tempest-TrustsV3TestJSON-2082339297 tempest-user-989783349] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:19.724444 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2b9ac7-92b3-40af-8714-9e713996b1b0 tempest-TrustsV3TestJSON-2082339297 tempest-user-989783349] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:19.736515 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d868cc-80bf-48c3-b0ed-37010670c628 tempest-TrustsV3TestJSON-2082339297 tempest-user-989783349] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3383e5bd3a14f8796c06a26d7893c26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b29c67d30cb4e45b8a436c52eccc1b6', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-549813097', 'tempest-NotDelegatedRole-1021385602'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:19.737756 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d868cc-80bf-48c3-b0ed-37010670c628 tempest-TrustsV3TestJSON-2082339297 tempest-user-989783349] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:19.738142 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d868cc-80bf-48c3-b0ed-37010670c628 tempest-TrustsV3TestJSON-2082339297 tempest-user-989783349] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:19.738528 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d868cc-80bf-48c3-b0ed-37010670c628 tempest-TrustsV3TestJSON-2082339297 tempest-user-989783349] PATH_INFO: `/v3/OS-TRUST/trusts/557c766070ba4fa796f748af64926e7e` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:19.751930 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d868cc-80bf-48c3-b0ed-37010670c628 tempest-TrustsV3TestJSON-2082339297 tempest-user-989783349] RBAC: Authorizing `identity:delete_trust(trust_id=557c766070ba4fa796f748af64926e7e)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:19.753572 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d868cc-80bf-48c3-b0ed-37010670c628 tempest-TrustsV3TestJSON-2082339297 tempest-user-989783349] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:19.785227 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-91d868cc-80bf-48c3-b0ed-37010670c628 tempest-TrustsV3TestJSON-2082339297 tempest-user-989783349] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '557c766070ba4fa796f748af64926e7e', 'request_id': 'req-91d868cc-80bf-48c3-b0ed-37010670c628'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:19.786544 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-91d868cc-80bf-48c3-b0ed-37010670c628 tempest-TrustsV3TestJSON-2082339297 tempest-user-989783349] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '557c766070ba4fa796f748af64926e7e', 'request_id': 'req-91d868cc-80bf-48c3-b0ed-37010670c628'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:19.806441 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-91d868cc-80bf-48c3-b0ed-37010670c628 tempest-TrustsV3TestJSON-2082339297 tempest-user-989783349] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '557c766070ba4fa796f748af64926e7e', 'request_id': 'req-91d868cc-80bf-48c3-b0ed-37010670c628'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:19.818794 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2405/4806] 10.222.0.17 () {58 vars in 1253 bytes} [Sat Jul 23 21:29:19 2022] DELETE /identity/v3/OS-TRUST/trusts/557c766070ba4fa796f748af64926e7e => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:29:19.823349 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c56fbf1-1eef-481a-bd10-a7e030d2b948 tempest-TrustsV3TestJSON-2082339297 tempest-user-989783349] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:19.826127 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-4c56fbf1-1eef-481a-bd10-a7e030d2b948 tempest-TrustsV3TestJSON-2082339297 tempest-user-989783349] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:19.845987 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c56fbf1-1eef-481a-bd10-a7e030d2b948 tempest-TrustsV3TestJSON-2082339297 tempest-user-989783349] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:19.850608 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6e41e2-3359-4ebd-a2a0-e84a1e47eed8 tempest-TrustsV3TestJSON-2082339297 tempest-user-989783349] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3383e5bd3a14f8796c06a26d7893c26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b29c67d30cb4e45b8a436c52eccc1b6', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-549813097', 'tempest-NotDelegatedRole-1021385602'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:19.856790 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6e41e2-3359-4ebd-a2a0-e84a1e47eed8 tempest-TrustsV3TestJSON-2082339297 tempest-user-989783349] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:19.857628 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6e41e2-3359-4ebd-a2a0-e84a1e47eed8 tempest-TrustsV3TestJSON-2082339297 tempest-user-989783349] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:19.859986 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6e41e2-3359-4ebd-a2a0-e84a1e47eed8 tempest-TrustsV3TestJSON-2082339297 tempest-user-989783349] PATH_INFO: `/v3/OS-TRUST/trusts/557c766070ba4fa796f748af64926e7e` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:19.890734 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-ae6e41e2-3359-4ebd-a2a0-e84a1e47eed8 tempest-TrustsV3TestJSON-2082339297 tempest-user-989783349] Could not find trust: 557c766070ba4fa796f748af64926e7e.: keystone.exception.TrustNotFound: Could not find trust: 557c766070ba4fa796f748af64926e7e. Jul 23 21:29:19.890734 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 21:29:19.890734 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 21:29:19.890734 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 21:29:19.890734 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 21:29:19.890734 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 21:29:19.890734 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 21:29:19.890734 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 21:29:19.890734 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 21:29:19.890734 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 21:29:19.890734 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 21:29:19.890734 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 21:29:19.890734 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Jul 23 21:29:19.890734 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Jul 23 21:29:19.890734 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Jul 23 21:29:19.892003 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Jul 23 21:29:19.892003 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Jul 23 21:29:19.892003 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Jul 23 21:29:19.892003 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Jul 23 21:29:19.892003 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Jul 23 21:29:19.892003 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 21:29:19.892003 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 21:29:19.892003 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Jul 23 21:29:19.892003 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Jul 23 21:29:19.892003 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Jul 23 21:29:19.892003 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Jul 23 21:29:19.892003 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: 557c766070ba4fa796f748af64926e7e. Jul 23 21:29:19.892003 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 21:29:19.897800 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2402/4807] 10.222.0.17 () {58 vars in 1250 bytes} [Sat Jul 23 21:29:19 2022] GET /identity/v3/OS-TRUST/trusts/557c766070ba4fa796f748af64926e7e => generated 111 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 23 21:29:19.903364 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d868cc-80bf-48c3-b0ed-37010670c628 tempest-TrustsV3TestJSON-2082339297 tempest-user-989783349] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:19.906636 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-91d868cc-80bf-48c3-b0ed-37010670c628 tempest-TrustsV3TestJSON-2082339297 tempest-user-989783349] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:19.944116 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d868cc-80bf-48c3-b0ed-37010670c628 tempest-TrustsV3TestJSON-2082339297 tempest-user-989783349] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:19.958621 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b6977f-6397-465c-b6ad-a7900faa2496 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b077945a37bc4bf29f5c62b95ff45562', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd2d040691b34adeb5ae75a50f416642', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:19.959636 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b6977f-6397-465c-b6ad-a7900faa2496 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:19.961437 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b6977f-6397-465c-b6ad-a7900faa2496 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:19.962737 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b6977f-6397-465c-b6ad-a7900faa2496 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] PATH_INFO: `/v3/roles/7fefdc98a40747049d042be889dc23a8` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:19.968745 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b6977f-6397-465c-b6ad-a7900faa2496 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: Authorizing `identity:delete_role(role_id=7fefdc98a40747049d042be889dc23a8)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:19.970795 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b6977f-6397-465c-b6ad-a7900faa2496 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:20.054389 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-84b6977f-6397-465c-b6ad-a7900faa2496 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Invalidating the token cache because role 7fefdc98a40747049d042be889dc23a8 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:29:20.055020 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-84b6977f-6397-465c-b6ad-a7900faa2496 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:20.055942 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-84b6977f-6397-465c-b6ad-a7900faa2496 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:20.061848 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2406/4808] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:29:19 2022] DELETE /identity/v3/roles/7fefdc98a40747049d042be889dc23a8 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:29:20.066383 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6e41e2-3359-4ebd-a2a0-e84a1e47eed8 tempest-TrustsV3TestJSON-2082339297 tempest-user-989783349] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:20.069132 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-ae6e41e2-3359-4ebd-a2a0-e84a1e47eed8 tempest-TrustsV3TestJSON-2082339297 tempest-user-989783349] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:20.090294 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6e41e2-3359-4ebd-a2a0-e84a1e47eed8 tempest-TrustsV3TestJSON-2082339297 tempest-user-989783349] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:20.110974 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:29:20.197041 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a262ba7-6daa-47f1-ac1b-ab769eca2926 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b077945a37bc4bf29f5c62b95ff45562', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd2d040691b34adeb5ae75a50f416642', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:20.198312 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a262ba7-6daa-47f1-ac1b-ab769eca2926 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:20.199181 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a262ba7-6daa-47f1-ac1b-ab769eca2926 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:20.199691 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a262ba7-6daa-47f1-ac1b-ab769eca2926 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] PATH_INFO: `/v3/roles/e23a13c1a267406993bc9e562ef90f50` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:20.202577 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a262ba7-6daa-47f1-ac1b-ab769eca2926 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: Authorizing `identity:delete_role(role_id=e23a13c1a267406993bc9e562ef90f50)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:20.204688 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a262ba7-6daa-47f1-ac1b-ab769eca2926 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:20.303209 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-2a262ba7-6daa-47f1-ac1b-ab769eca2926 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Invalidating the token cache because role e23a13c1a267406993bc9e562ef90f50 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:29:20.303570 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-2a262ba7-6daa-47f1-ac1b-ab769eca2926 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:20.308993 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-2a262ba7-6daa-47f1-ac1b-ab769eca2926 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:20.311396 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2403/4809] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:29:20 2022] DELETE /identity/v3/roles/e23a13c1a267406993bc9e562ef90f50 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:29:20.316411 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b6977f-6397-465c-b6ad-a7900faa2496 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:20.333901 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b6977f-6397-465c-b6ad-a7900faa2496 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:20.382175 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=94,keystone:UPDATE=1,keystone:INSERT=1,keystone:DELETE=4 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:29:20.451398 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaea0fcb-e142-40db-a929-c216a0c46478 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b077945a37bc4bf29f5c62b95ff45562', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd2d040691b34adeb5ae75a50f416642', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:20.454442 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaea0fcb-e142-40db-a929-c216a0c46478 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:20.455008 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaea0fcb-e142-40db-a929-c216a0c46478 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:20.455445 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaea0fcb-e142-40db-a929-c216a0c46478 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] PATH_INFO: `/v3/users/b3383e5bd3a14f8796c06a26d7893c26` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:20.458170 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaea0fcb-e142-40db-a929-c216a0c46478 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: Authorizing `identity:delete_user(user_id=b3383e5bd3a14f8796c06a26d7893c26)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:20.463753 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaea0fcb-e142-40db-a929-c216a0c46478 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:20.548566 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-aaea0fcb-e142-40db-a929-c216a0c46478 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3383e5bd3a14f8796c06a26d7893c26'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:20.570939 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-aaea0fcb-e142-40db-a929-c216a0c46478 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3383e5bd3a14f8796c06a26d7893c26'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:20.572848 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-aaea0fcb-e142-40db-a929-c216a0c46478 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3383e5bd3a14f8796c06a26d7893c26'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:20.595246 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-aaea0fcb-e142-40db-a929-c216a0c46478 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3383e5bd3a14f8796c06a26d7893c26'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:20.626456 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-aaea0fcb-e142-40db-a929-c216a0c46478 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3383e5bd3a14f8796c06a26d7893c26'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:20.638141 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2407/4810] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:29:20 2022] DELETE /identity/v3/users/b3383e5bd3a14f8796c06a26d7893c26 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:29:20.638912 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a262ba7-6daa-47f1-ac1b-ab769eca2926 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:20.640474 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-2a262ba7-6daa-47f1-ac1b-ab769eca2926 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:20.658595 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a262ba7-6daa-47f1-ac1b-ab769eca2926 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:20.754095 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b89ff4-db30-4e6e-8f4b-af0d00600b04 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b077945a37bc4bf29f5c62b95ff45562', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd2d040691b34adeb5ae75a50f416642', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:20.755394 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b89ff4-db30-4e6e-8f4b-af0d00600b04 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:20.755909 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b89ff4-db30-4e6e-8f4b-af0d00600b04 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:20.756415 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b89ff4-db30-4e6e-8f4b-af0d00600b04 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] PATH_INFO: `/v3/projects/0b29c67d30cb4e45b8a436c52eccc1b6` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:20.758091 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b89ff4-db30-4e6e-8f4b-af0d00600b04 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: Authorizing `identity:delete_project(project_id=0b29c67d30cb4e45b8a436c52eccc1b6)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:20.761626 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b89ff4-db30-4e6e-8f4b-af0d00600b04 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:20.857502 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-88b89ff4-db30-4e6e-8f4b-af0d00600b04 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b29c67d30cb4e45b8a436c52eccc1b6', 'request_id': 'req-88b89ff4-db30-4e6e-8f4b-af0d00600b04'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:20.868728 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-88b89ff4-db30-4e6e-8f4b-af0d00600b04 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b29c67d30cb4e45b8a436c52eccc1b6', 'request_id': 'req-88b89ff4-db30-4e6e-8f4b-af0d00600b04'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:20.878255 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-88b89ff4-db30-4e6e-8f4b-af0d00600b04 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b29c67d30cb4e45b8a436c52eccc1b6', 'request_id': 'req-88b89ff4-db30-4e6e-8f4b-af0d00600b04'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:20.899892 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-88b89ff4-db30-4e6e-8f4b-af0d00600b04 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] The token cache is being invalidate because project 0b29c67d30cb4e45b8a436c52eccc1b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:29:20.900345 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-88b89ff4-db30-4e6e-8f4b-af0d00600b04 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:20.901779 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-88b89ff4-db30-4e6e-8f4b-af0d00600b04 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:20.903915 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2404/4811] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:29:20 2022] DELETE /identity/v3/projects/0b29c67d30cb4e45b8a436c52eccc1b6 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:29:20.909395 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaea0fcb-e142-40db-a929-c216a0c46478 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:20.910966 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-aaea0fcb-e142-40db-a929-c216a0c46478 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:20.984532 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaea0fcb-e142-40db-a929-c216a0c46478 tempest-TrustsV3TestJSON-885185998 tempest-TrustsV3TestJSON-885185998-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:21.054449 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:29:21.068183 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6518737a-caea-49bd-8359-9fe1307fe466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:21.069132 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6518737a-caea-49bd-8359-9fe1307fe466 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:21.069459 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6518737a-caea-49bd-8359-9fe1307fe466 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:21.069820 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6518737a-caea-49bd-8359-9fe1307fe466 admin admin] PATH_INFO: `/v3/users/75cae2c37e77442c8f5433e611f5163e` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:21.071647 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6518737a-caea-49bd-8359-9fe1307fe466 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75cae2c37e77442c8f5433e611f5163e)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:21.073305 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6518737a-caea-49bd-8359-9fe1307fe466 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:21.154618 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-6518737a-caea-49bd-8359-9fe1307fe466 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75cae2c37e77442c8f5433e611f5163e'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:21.167663 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-6518737a-caea-49bd-8359-9fe1307fe466 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75cae2c37e77442c8f5433e611f5163e'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:21.168569 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-6518737a-caea-49bd-8359-9fe1307fe466 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75cae2c37e77442c8f5433e611f5163e'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:21.184086 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-6518737a-caea-49bd-8359-9fe1307fe466 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75cae2c37e77442c8f5433e611f5163e'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:21.200337 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-6518737a-caea-49bd-8359-9fe1307fe466 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75cae2c37e77442c8f5433e611f5163e'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:21.216638 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4237ee2b-ca8b-4d31-9975-181d7808f313 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:21.217200 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4237ee2b-ca8b-4d31-9975-181d7808f313 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:21.217415 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4237ee2b-ca8b-4d31-9975-181d7808f313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:21.221827 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2408/4812] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:29:20 2022] DELETE /identity/v3/users/75cae2c37e77442c8f5433e611f5163e => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:29:21.245060 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:29:21.257845 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-4237ee2b-ca8b-4d31-9975-181d7808f313 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:29:21.261295 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-4237ee2b-ca8b-4d31-9975-181d7808f313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:21.289005 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6518737a-caea-49bd-8359-9fe1307fe466 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:21.291283 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-6518737a-caea-49bd-8359-9fe1307fe466 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:21.399683 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2405/4813] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:29:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:29:21.472594 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6518737a-caea-49bd-8359-9fe1307fe466 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:21.473323 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4237ee2b-ca8b-4d31-9975-181d7808f313 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:21.475594 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-4237ee2b-ca8b-4d31-9975-181d7808f313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:21.481229 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11d432b-b4d9-4dee-bbe6-92999f9f31d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:21.482643 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11d432b-b4d9-4dee-bbe6-92999f9f31d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:21.483087 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11d432b-b4d9-4dee-bbe6-92999f9f31d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:21.483522 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11d432b-b4d9-4dee-bbe6-92999f9f31d4 admin admin] PATH_INFO: `/v3/projects/de93b7f53330426ca289a8ab0f36302d` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:21.484984 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11d432b-b4d9-4dee-bbe6-92999f9f31d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de93b7f53330426ca289a8ab0f36302d)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:21.487662 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11d432b-b4d9-4dee-bbe6-92999f9f31d4 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:21.563627 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-b11d432b-b4d9-4dee-bbe6-92999f9f31d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de93b7f53330426ca289a8ab0f36302d', 'request_id': 'req-b11d432b-b4d9-4dee-bbe6-92999f9f31d4'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:21.580582 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4237ee2b-ca8b-4d31-9975-181d7808f313 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:21.581446 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-b11d432b-b4d9-4dee-bbe6-92999f9f31d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de93b7f53330426ca289a8ab0f36302d', 'request_id': 'req-b11d432b-b4d9-4dee-bbe6-92999f9f31d4'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:21.588470 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-b11d432b-b4d9-4dee-bbe6-92999f9f31d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de93b7f53330426ca289a8ab0f36302d', 'request_id': 'req-b11d432b-b4d9-4dee-bbe6-92999f9f31d4'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:21.602885 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:29:21.612274 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-b11d432b-b4d9-4dee-bbe6-92999f9f31d4 admin admin] The token cache is being invalidate because project de93b7f53330426ca289a8ab0f36302d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:29:21.614004 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-b11d432b-b4d9-4dee-bbe6-92999f9f31d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:21.616816 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-b11d432b-b4d9-4dee-bbe6-92999f9f31d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:21.624337 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2409/4814] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:29:21 2022] DELETE /identity/v3/projects/de93b7f53330426ca289a8ab0f36302d => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:29:21.626705 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11d432b-b4d9-4dee-bbe6-92999f9f31d4 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:21.628561 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-b11d432b-b4d9-4dee-bbe6-92999f9f31d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:21.677148 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0dc0d7-ed84-4c97-a68f-715b0f0053ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:21.677430 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0dc0d7-ed84-4c97-a68f-715b0f0053ed service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:21.677670 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0dc0d7-ed84-4c97-a68f-715b0f0053ed service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:21.679585 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0dc0d7-ed84-4c97-a68f-715b0f0053ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:21.682291 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-8f0dc0d7-ed84-4c97-a68f-715b0f0053ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:21.769601 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11d432b-b4d9-4dee-bbe6-92999f9f31d4 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:21.776870 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0dc0d7-ed84-4c97-a68f-715b0f0053ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:21.778662 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0dc0d7-ed84-4c97-a68f-715b0f0053ed service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:21.780438 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467d822f-9c65-4cf4-ae80-c580e8f5f8f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:21.781348 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467d822f-9c65-4cf4-ae80-c580e8f5f8f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:21.781628 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467d822f-9c65-4cf4-ae80-c580e8f5f8f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:21.784013 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467d822f-9c65-4cf4-ae80-c580e8f5f8f2 admin admin] PATH_INFO: `/v3/users/78f441e59aa04412a44568b3992a84cc` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:21.786510 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467d822f-9c65-4cf4-ae80-c580e8f5f8f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=78f441e59aa04412a44568b3992a84cc)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:21.791599 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467d822f-9c65-4cf4-ae80-c580e8f5f8f2 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:21.792549 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2406/4815] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:29:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:29:21.859479 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4737ab6a-94c2-4668-ab99-b3f1c7dd5204 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:21.860254 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4737ab6a-94c2-4668-ab99-b3f1c7dd5204 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:21.861815 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4737ab6a-94c2-4668-ab99-b3f1c7dd5204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:21.904740 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-4737ab6a-94c2-4668-ab99-b3f1c7dd5204 None None] MFA Rules not processed for user `5efda1c40f494592bf1e6af1add120f3`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:29:21.905104 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-467d822f-9c65-4cf4-ae80-c580e8f5f8f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78f441e59aa04412a44568b3992a84cc'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:21.909537 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-4737ab6a-94c2-4668-ab99-b3f1c7dd5204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:21.931639 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-467d822f-9c65-4cf4-ae80-c580e8f5f8f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78f441e59aa04412a44568b3992a84cc'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:21.934350 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-467d822f-9c65-4cf4-ae80-c580e8f5f8f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78f441e59aa04412a44568b3992a84cc'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:21.935410 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:29:21.951087 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-467d822f-9c65-4cf4-ae80-c580e8f5f8f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78f441e59aa04412a44568b3992a84cc'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:21.976802 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-467d822f-9c65-4cf4-ae80-c580e8f5f8f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78f441e59aa04412a44568b3992a84cc'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:21.990545 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2410/4816] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:29:21 2022] DELETE /identity/v3/users/78f441e59aa04412a44568b3992a84cc => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:29:22.088538 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2407/4817] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:29:21 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:29:22.777696 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467d822f-9c65-4cf4-ae80-c580e8f5f8f2 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:22.779819 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-467d822f-9c65-4cf4-ae80-c580e8f5f8f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:22.916249 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467d822f-9c65-4cf4-ae80-c580e8f5f8f2 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:22.924239 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8561214e-3845-472f-9da4-145899ebfe94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:22.925341 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8561214e-3845-472f-9da4-145899ebfe94 service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:22.925954 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8561214e-3845-472f-9da4-145899ebfe94 service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:22.926423 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8561214e-3845-472f-9da4-145899ebfe94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:22.929166 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-8561214e-3845-472f-9da4-145899ebfe94 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:22.947899 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8561214e-3845-472f-9da4-145899ebfe94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:22.951820 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8561214e-3845-472f-9da4-145899ebfe94 service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:22.966933 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2411/4818] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:29:22 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:29:23.038797 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4737ab6a-94c2-4668-ab99-b3f1c7dd5204 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:23.040791 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-4737ab6a-94c2-4668-ab99-b3f1c7dd5204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:23.061648 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4737ab6a-94c2-4668-ab99-b3f1c7dd5204 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:23.197240 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618b5f7b-2b35-465c-9809-11800baeb779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:23.198401 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618b5f7b-2b35-465c-9809-11800baeb779 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:23.198748 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618b5f7b-2b35-465c-9809-11800baeb779 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:23.199091 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618b5f7b-2b35-465c-9809-11800baeb779 admin admin] PATH_INFO: `/v3/projects/e8cfa74dbc1a44a4b790d89f517171dd` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:23.201034 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618b5f7b-2b35-465c-9809-11800baeb779 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8cfa74dbc1a44a4b790d89f517171dd)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:23.204258 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618b5f7b-2b35-465c-9809-11800baeb779 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:23.290256 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-618b5f7b-2b35-465c-9809-11800baeb779 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8cfa74dbc1a44a4b790d89f517171dd', 'request_id': 'req-618b5f7b-2b35-465c-9809-11800baeb779'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:23.302462 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-618b5f7b-2b35-465c-9809-11800baeb779 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8cfa74dbc1a44a4b790d89f517171dd', 'request_id': 'req-618b5f7b-2b35-465c-9809-11800baeb779'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:23.310609 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-618b5f7b-2b35-465c-9809-11800baeb779 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8cfa74dbc1a44a4b790d89f517171dd', 'request_id': 'req-618b5f7b-2b35-465c-9809-11800baeb779'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:23.325960 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-618b5f7b-2b35-465c-9809-11800baeb779 admin admin] The token cache is being invalidate because project e8cfa74dbc1a44a4b790d89f517171dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:29:23.326271 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-618b5f7b-2b35-465c-9809-11800baeb779 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:23.327199 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-618b5f7b-2b35-465c-9809-11800baeb779 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:23.330137 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2408/4819] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:29:23 2022] DELETE /identity/v3/projects/e8cfa74dbc1a44a4b790d89f517171dd => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:29:23.336544 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e4e4fe-987c-4b31-b273-cbef20137bb7 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:23.337031 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e4e4fe-987c-4b31-b273-cbef20137bb7 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:23.337513 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e4e4fe-987c-4b31-b273-cbef20137bb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:23.365314 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-83e4e4fe-987c-4b31-b273-cbef20137bb7 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:29:23.367210 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-83e4e4fe-987c-4b31-b273-cbef20137bb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:23.420018 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:29:23.555760 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2412/4820] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:29:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:29:23.556027 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a354e2d7-1434-4bc2-9209-fe5030e71ae6 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:23.556421 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a354e2d7-1434-4bc2-9209-fe5030e71ae6 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:23.556813 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a354e2d7-1434-4bc2-9209-fe5030e71ae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:23.591771 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-a354e2d7-1434-4bc2-9209-fe5030e71ae6 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:29:23.593288 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-a354e2d7-1434-4bc2-9209-fe5030e71ae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:23.604934 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2409/4821] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:29:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:29:23.609627 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e4e4fe-987c-4b31-b273-cbef20137bb7 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:23.624898 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e4e4fe-987c-4b31-b273-cbef20137bb7 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:23.645474 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb7e525-fcb7-4ee6-845f-3c42e52868dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:23.646211 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb7e525-fcb7-4ee6-845f-3c42e52868dc admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:23.646488 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb7e525-fcb7-4ee6-845f-3c42e52868dc admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:23.646758 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb7e525-fcb7-4ee6-845f-3c42e52868dc admin admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:23.647672 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb7e525-fcb7-4ee6-845f-3c42e52868dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:29:23.647967 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb7e525-fcb7-4ee6-845f-3c42e52868dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:23.650868 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb7e525-fcb7-4ee6-845f-3c42e52868dc admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:23.676083 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a354e2d7-1434-4bc2-9209-fe5030e71ae6 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:23.680648 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2413/4822] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:29:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:29:23.690406 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a354e2d7-1434-4bc2-9209-fe5030e71ae6 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:23.698312 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3ef5d7-5bbc-4ccc-b01c-726eddbdf662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:23.699001 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3ef5d7-5bbc-4ccc-b01c-726eddbdf662 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:23.699277 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3ef5d7-5bbc-4ccc-b01c-726eddbdf662 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:23.699546 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3ef5d7-5bbc-4ccc-b01c-726eddbdf662 admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:23.702062 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3ef5d7-5bbc-4ccc-b01c-726eddbdf662 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:23.708802 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3ef5d7-5bbc-4ccc-b01c-726eddbdf662 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:23.764726 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2410/4823] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:29:23 2022] POST /identity/v3/projects => generated 383 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:29:23.769156 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb7e525-fcb7-4ee6-845f-3c42e52868dc admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:23.780261 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb7e525-fcb7-4ee6-845f-3c42e52868dc admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:23.880894 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603bc1fe-138a-4c7e-b1d7-6cc4fb7ed905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:23.881795 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603bc1fe-138a-4c7e-b1d7-6cc4fb7ed905 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:23.882115 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603bc1fe-138a-4c7e-b1d7-6cc4fb7ed905 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:23.882471 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603bc1fe-138a-4c7e-b1d7-6cc4fb7ed905 admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:23.883234 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603bc1fe-138a-4c7e-b1d7-6cc4fb7ed905 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:23.891166 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603bc1fe-138a-4c7e-b1d7-6cc4fb7ed905 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:23.949794 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2414/4824] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:29:23 2022] POST /identity/v3/users => generated 292 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:29:23.951849 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3ef5d7-5bbc-4ccc-b01c-726eddbdf662 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:23.964051 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3ef5d7-5bbc-4ccc-b01c-726eddbdf662 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:23.982651 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0850eab-b307-468b-a209-559a81dc1a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:23.983949 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0850eab-b307-468b-a209-559a81dc1a70 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:23.984222 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0850eab-b307-468b-a209-559a81dc1a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:23.985063 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0850eab-b307-468b-a209-559a81dc1a70 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:23.985729 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0850eab-b307-468b-a209-559a81dc1a70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:23.988704 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0850eab-b307-468b-a209-559a81dc1a70 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:24.008435 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2411/4825] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:29:23 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:29:24.009003 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603bc1fe-138a-4c7e-b1d7-6cc4fb7ed905 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:24.025691 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603bc1fe-138a-4c7e-b1d7-6cc4fb7ed905 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:24.045311 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaab859-10c1-4ad8-b761-505e80e5e394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:24.045768 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaab859-10c1-4ad8-b761-505e80e5e394 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:24.046089 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaab859-10c1-4ad8-b761-505e80e5e394 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:24.046371 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaab859-10c1-4ad8-b761-505e80e5e394 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:24.047461 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaab859-10c1-4ad8-b761-505e80e5e394 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:24.049187 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaab859-10c1-4ad8-b761-505e80e5e394 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:24.077321 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0850eab-b307-468b-a209-559a81dc1a70 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:24.077926 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2415/4826] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:29:24 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:29:24.091101 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0850eab-b307-468b-a209-559a81dc1a70 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:24.097438 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59f4efd-7e91-44a4-9994-2c3067cff247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:24.099229 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59f4efd-7e91-44a4-9994-2c3067cff247 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:24.099785 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59f4efd-7e91-44a4-9994-2c3067cff247 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:24.100272 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59f4efd-7e91-44a4-9994-2c3067cff247 admin admin] PATH_INFO: `/v3/projects/7547a3c3da774046a965b63a318c6835/users/55e8d7bc6744442390ea121b5b3cb948/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:24.106204 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:29:24.127877 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59f4efd-7e91-44a4-9994-2c3067cff247 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7547a3c3da774046a965b63a318c6835, user_id=55e8d7bc6744442390ea121b5b3cb948, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:24.131005 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59f4efd-7e91-44a4-9994-2c3067cff247 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:24.180330 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaab859-10c1-4ad8-b761-505e80e5e394 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:24.183190 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-1eaab859-10c1-4ad8-b761-505e80e5e394 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:24.191262 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2412/4827] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:29:24 2022] PUT /identity/v3/projects/7547a3c3da774046a965b63a318c6835/users/55e8d7bc6744442390ea121b5b3cb948/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:29:24.202938 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba8644b-41d2-4fd3-a1d9-84195879c301 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:24.203231 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba8644b-41d2-4fd3-a1d9-84195879c301 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:24.203563 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba8644b-41d2-4fd3-a1d9-84195879c301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:24.221006 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaab859-10c1-4ad8-b761-505e80e5e394 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:24.284640 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-eba8644b-41d2-4fd3-a1d9-84195879c301 None None] MFA Rules not processed for user `55e8d7bc6744442390ea121b5b3cb948`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:29:24.286014 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-eba8644b-41d2-4fd3-a1d9-84195879c301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:24.440152 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e862f65b-fbce-4cd3-94a0-c18b07dd7a0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:24.441060 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e862f65b-fbce-4cd3-94a0-c18b07dd7a0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:24.441336 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e862f65b-fbce-4cd3-94a0-c18b07dd7a0c admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:24.441604 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e862f65b-fbce-4cd3-94a0-c18b07dd7a0c admin admin] PATH_INFO: `/v3/projects/879105d7fbda4367969eefeabc330666` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:24.450871 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e862f65b-fbce-4cd3-94a0-c18b07dd7a0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=879105d7fbda4367969eefeabc330666)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:24.452986 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e862f65b-fbce-4cd3-94a0-c18b07dd7a0c admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:24.478244 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2413/4828] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:29:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:29:24.479267 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba8644b-41d2-4fd3-a1d9-84195879c301 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:24.496635 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba8644b-41d2-4fd3-a1d9-84195879c301 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:24.503279 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd5e771-5f5c-46fe-a4f2-22ca4020c817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:24.505749 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd5e771-5f5c-46fe-a4f2-22ca4020c817 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:24.505749 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd5e771-5f5c-46fe-a4f2-22ca4020c817 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:24.506234 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd5e771-5f5c-46fe-a4f2-22ca4020c817 admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:24.506827 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd5e771-5f5c-46fe-a4f2-22ca4020c817 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:24.508973 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd5e771-5f5c-46fe-a4f2-22ca4020c817 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:24.538681 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:29:24.562034 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2414/4829] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:29:24 2022] POST /identity/v3/projects => generated 383 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:29:24.567164 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd5e771-5f5c-46fe-a4f2-22ca4020c817 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:24.577924 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-e862f65b-fbce-4cd3-94a0-c18b07dd7a0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '879105d7fbda4367969eefeabc330666', 'request_id': 'req-e862f65b-fbce-4cd3-94a0-c18b07dd7a0c'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:24.601573 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-e862f65b-fbce-4cd3-94a0-c18b07dd7a0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '879105d7fbda4367969eefeabc330666', 'request_id': 'req-e862f65b-fbce-4cd3-94a0-c18b07dd7a0c'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:24.643802 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-e862f65b-fbce-4cd3-94a0-c18b07dd7a0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '879105d7fbda4367969eefeabc330666', 'request_id': 'req-e862f65b-fbce-4cd3-94a0-c18b07dd7a0c'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:24.662701 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-e862f65b-fbce-4cd3-94a0-c18b07dd7a0c admin admin] The token cache is being invalidate because project 879105d7fbda4367969eefeabc330666 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:29:24.663088 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-e862f65b-fbce-4cd3-94a0-c18b07dd7a0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:24.664390 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-e862f65b-fbce-4cd3-94a0-c18b07dd7a0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:24.667043 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2416/4830] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:29:24 2022] DELETE /identity/v3/projects/879105d7fbda4367969eefeabc330666 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:29:24.670933 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e862f65b-fbce-4cd3-94a0-c18b07dd7a0c admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:24.673798 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-e862f65b-fbce-4cd3-94a0-c18b07dd7a0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:24.778294 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd5e771-5f5c-46fe-a4f2-22ca4020c817 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:24.788029 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3806836-afc7-4f37-aab9-d17700acee6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:24.789150 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3806836-afc7-4f37-aab9-d17700acee6b admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:24.789439 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3806836-afc7-4f37-aab9-d17700acee6b admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:24.789712 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3806836-afc7-4f37-aab9-d17700acee6b admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:24.790665 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3806836-afc7-4f37-aab9-d17700acee6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:24.792845 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3806836-afc7-4f37-aab9-d17700acee6b admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:24.836843 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2415/4831] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:29:24 2022] POST /identity/v3/users => generated 298 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:29:24.840777 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3806836-afc7-4f37-aab9-d17700acee6b admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:24.847007 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-c3806836-afc7-4f37-aab9-d17700acee6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:24.862145 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e862f65b-fbce-4cd3-94a0-c18b07dd7a0c admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:24.872086 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3806836-afc7-4f37-aab9-d17700acee6b admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:24.879047 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccdf324-d312-4ce0-bd8b-4872be17a0ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:24.879968 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccdf324-d312-4ce0-bd8b-4872be17a0ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:24.880270 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccdf324-d312-4ce0-bd8b-4872be17a0ad admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:24.880509 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccdf324-d312-4ce0-bd8b-4872be17a0ad admin admin] PATH_INFO: `/v3/users/b077945a37bc4bf29f5c62b95ff45562` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:24.884560 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccdf324-d312-4ce0-bd8b-4872be17a0ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=b077945a37bc4bf29f5c62b95ff45562)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:24.886803 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d352ac-bfdf-4e14-8bcd-253d485a1d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:24.886966 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccdf324-d312-4ce0-bd8b-4872be17a0ad admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:24.887695 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d352ac-bfdf-4e14-8bcd-253d485a1d26 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:24.887980 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d352ac-bfdf-4e14-8bcd-253d485a1d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:24.888392 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d352ac-bfdf-4e14-8bcd-253d485a1d26 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:24.889584 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d352ac-bfdf-4e14-8bcd-253d485a1d26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:24.890911 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d352ac-bfdf-4e14-8bcd-253d485a1d26 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:24.933159 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2416/4832] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:29:24 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:29:24.937583 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d352ac-bfdf-4e14-8bcd-253d485a1d26 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:24.976436 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d352ac-bfdf-4e14-8bcd-253d485a1d26 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:25.001029 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df16cc7-9986-44ac-94e3-37a69ded58ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:25.003819 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df16cc7-9986-44ac-94e3-37a69ded58ee admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:25.004106 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df16cc7-9986-44ac-94e3-37a69ded58ee admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:25.004379 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df16cc7-9986-44ac-94e3-37a69ded58ee admin admin] PATH_INFO: `/v3/projects/4bc8472d82854533a6165a2fb9a2f0f0/users/10a1d0c21ab6437db19db76969979444/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:25.033169 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-8ccdf324-d312-4ce0-bd8b-4872be17a0ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b077945a37bc4bf29f5c62b95ff45562'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:25.048333 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-8ccdf324-d312-4ce0-bd8b-4872be17a0ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b077945a37bc4bf29f5c62b95ff45562'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:25.049381 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-8ccdf324-d312-4ce0-bd8b-4872be17a0ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b077945a37bc4bf29f5c62b95ff45562'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:25.069832 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df16cc7-9986-44ac-94e3-37a69ded58ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bc8472d82854533a6165a2fb9a2f0f0, user_id=10a1d0c21ab6437db19db76969979444, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:25.073166 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df16cc7-9986-44ac-94e3-37a69ded58ee admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:25.077357 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-8ccdf324-d312-4ce0-bd8b-4872be17a0ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b077945a37bc4bf29f5c62b95ff45562'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:25.116127 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-8ccdf324-d312-4ce0-bd8b-4872be17a0ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b077945a37bc4bf29f5c62b95ff45562'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:25.123180 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2417/4833] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:29:24 2022] PUT /identity/v3/projects/4bc8472d82854533a6165a2fb9a2f0f0/users/10a1d0c21ab6437db19db76969979444/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:29:25.125200 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df16cc7-9986-44ac-94e3-37a69ded58ee admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:25.135689 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2417/4834] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:29:24 2022] DELETE /identity/v3/users/b077945a37bc4bf29f5c62b95ff45562 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:29:25.141550 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:29:25.206631 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccdf324-d312-4ce0-bd8b-4872be17a0ad admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:25.208706 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df16cc7-9986-44ac-94e3-37a69ded58ee admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:25.208987 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-8ccdf324-d312-4ce0-bd8b-4872be17a0ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:25.286206 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ced3744-3e72-44c9-983e-fdac8b5bb669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:25.286895 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ced3744-3e72-44c9-983e-fdac8b5bb669 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:25.287174 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ced3744-3e72-44c9-983e-fdac8b5bb669 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:25.287443 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ced3744-3e72-44c9-983e-fdac8b5bb669 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:25.288169 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ced3744-3e72-44c9-983e-fdac8b5bb669 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:25.290362 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ced3744-3e72-44c9-983e-fdac8b5bb669 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:25.304743 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2418/4835] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:29:25 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:29:25.312741 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ced3744-3e72-44c9-983e-fdac8b5bb669 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:25.316412 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-8ced3744-3e72-44c9-983e-fdac8b5bb669 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:25.330838 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:29:25.335618 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ced3744-3e72-44c9-983e-fdac8b5bb669 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:25.344815 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd6637d-6af8-4ceb-b251-d9fb6b7a7c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:25.347461 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd6637d-6af8-4ceb-b251-d9fb6b7a7c6f admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:25.347461 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd6637d-6af8-4ceb-b251-d9fb6b7a7c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:25.347725 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd6637d-6af8-4ceb-b251-d9fb6b7a7c6f admin admin] PATH_INFO: `/v3/projects/4bc8472d82854533a6165a2fb9a2f0f0/users/10a1d0c21ab6437db19db76969979444/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:25.350792 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd6637d-6af8-4ceb-b251-d9fb6b7a7c6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bc8472d82854533a6165a2fb9a2f0f0, user_id=10a1d0c21ab6437db19db76969979444, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:25.354592 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd6637d-6af8-4ceb-b251-d9fb6b7a7c6f admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:25.371396 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2419/4836] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:29:25 2022] PUT /identity/v3/projects/4bc8472d82854533a6165a2fb9a2f0f0/users/10a1d0c21ab6437db19db76969979444/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:29:25.388943 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b221cf-ced6-4f69-b781-7fbe2c933820 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:25.392105 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b221cf-ced6-4f69-b781-7fbe2c933820 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:25.392794 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b221cf-ced6-4f69-b781-7fbe2c933820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:25.427617 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccdf324-d312-4ce0-bd8b-4872be17a0ad admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:25.456214 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-c4b221cf-ced6-4f69-b781-7fbe2c933820 None None] MFA Rules not processed for user `10a1d0c21ab6437db19db76969979444`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:29:25.458490 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-c4b221cf-ced6-4f69-b781-7fbe2c933820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:25.571737 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86062da6-f40c-49d7-81b8-6be409e3f8aa service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc719a3b3ac4461b82ca04ab6451d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:25.573957 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86062da6-f40c-49d7-81b8-6be409e3f8aa service placement] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:25.575568 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86062da6-f40c-49d7-81b8-6be409e3f8aa service placement] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:25.575968 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86062da6-f40c-49d7-81b8-6be409e3f8aa service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:25.581627 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-86062da6-f40c-49d7-81b8-6be409e3f8aa service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:25.613977 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86062da6-f40c-49d7-81b8-6be409e3f8aa service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:25.616707 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86062da6-f40c-49d7-81b8-6be409e3f8aa service placement] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:25.645430 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2420/4837] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:29:25 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:29:25.650627 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2418/4838] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:29:25 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:29:25.656158 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b221cf-ced6-4f69-b781-7fbe2c933820 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:25.657629 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-c4b221cf-ced6-4f69-b781-7fbe2c933820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:25.695039 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:29:25.795729 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b221cf-ced6-4f69-b781-7fbe2c933820 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:25.802475 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9254e3ff-4c80-4a0b-a1b8-ec43232f8a73 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec5fd3a489c341b7964704d689037f05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:25.803157 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9254e3ff-4c80-4a0b-a1b8-ec43232f8a73 service cinder] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:25.803573 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9254e3ff-4c80-4a0b-a1b8-ec43232f8a73 service cinder] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:25.803846 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9254e3ff-4c80-4a0b-a1b8-ec43232f8a73 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:25.822002 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9254e3ff-4c80-4a0b-a1b8-ec43232f8a73 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:25.823822 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9254e3ff-4c80-4a0b-a1b8-ec43232f8a73 service cinder] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:25.842410 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2421/4839] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:29:25 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:29:25.992147 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f82fe2-c862-432e-980f-f134c30d2a76 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:25.992686 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f82fe2-c862-432e-980f-f134c30d2a76 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:25.993339 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f82fe2-c862-432e-980f-f134c30d2a76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:26.039973 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-f9f82fe2-c862-432e-980f-f134c30d2a76 None None] MFA Rules not processed for user `5efda1c40f494592bf1e6af1add120f3`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:29:26.046082 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-f9f82fe2-c862-432e-980f-f134c30d2a76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:26.089495 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9254e3ff-4c80-4a0b-a1b8-ec43232f8a73 service cinder] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:26.101338 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9254e3ff-4c80-4a0b-a1b8-ec43232f8a73 service cinder] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:26.113848 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5318652-c91f-493b-a393-1692bb7aac98 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec5fd3a489c341b7964704d689037f05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:26.114583 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5318652-c91f-493b-a393-1692bb7aac98 service cinder] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:26.116761 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5318652-c91f-493b-a393-1692bb7aac98 service cinder] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:26.117414 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5318652-c91f-493b-a393-1692bb7aac98 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:26.123734 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-f5318652-c91f-493b-a393-1692bb7aac98 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:26.164156 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2419/4840] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:29:25 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:29:26.193372 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5318652-c91f-493b-a393-1692bb7aac98 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:26.194903 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5318652-c91f-493b-a393-1692bb7aac98 service cinder] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:26.205348 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2422/4841] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:29:26 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 23 21:29:26.604302 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f82fe2-c862-432e-980f-f134c30d2a76 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:26.606703 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-f9f82fe2-c862-432e-980f-f134c30d2a76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:26.762596 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f82fe2-c862-432e-980f-f134c30d2a76 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:26.780611 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e42317-24b2-4aea-8b0f-e189ee4b14dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:26.781598 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e42317-24b2-4aea-8b0f-e189ee4b14dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:26.781988 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e42317-24b2-4aea-8b0f-e189ee4b14dd admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:26.782270 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e42317-24b2-4aea-8b0f-e189ee4b14dd admin admin] PATH_INFO: `/v3/projects/fd2d040691b34adeb5ae75a50f416642` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:26.785984 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e42317-24b2-4aea-8b0f-e189ee4b14dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd2d040691b34adeb5ae75a50f416642)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:26.790451 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e42317-24b2-4aea-8b0f-e189ee4b14dd admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:26.849225 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:29:26.922828 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-a7e42317-24b2-4aea-8b0f-e189ee4b14dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd2d040691b34adeb5ae75a50f416642', 'request_id': 'req-a7e42317-24b2-4aea-8b0f-e189ee4b14dd'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:26.936907 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-a7e42317-24b2-4aea-8b0f-e189ee4b14dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd2d040691b34adeb5ae75a50f416642', 'request_id': 'req-a7e42317-24b2-4aea-8b0f-e189ee4b14dd'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:26.949072 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-a7e42317-24b2-4aea-8b0f-e189ee4b14dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd2d040691b34adeb5ae75a50f416642', 'request_id': 'req-a7e42317-24b2-4aea-8b0f-e189ee4b14dd'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:26.968861 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-a7e42317-24b2-4aea-8b0f-e189ee4b14dd admin admin] The token cache is being invalidate because project fd2d040691b34adeb5ae75a50f416642 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:29:26.969460 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-a7e42317-24b2-4aea-8b0f-e189ee4b14dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:26.983774 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-a7e42317-24b2-4aea-8b0f-e189ee4b14dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:26.987621 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2420/4842] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:29:26 2022] DELETE /identity/v3/projects/fd2d040691b34adeb5ae75a50f416642 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:29:26.994799 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42b55a2-4de7-44da-b0be-e1f7d23fbb3e None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:26.995456 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42b55a2-4de7-44da-b0be-e1f7d23fbb3e None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:26.995902 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42b55a2-4de7-44da-b0be-e1f7d23fbb3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:27.027503 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-d42b55a2-4de7-44da-b0be-e1f7d23fbb3e None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:29:27.029403 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-d42b55a2-4de7-44da-b0be-e1f7d23fbb3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:27.064314 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a8d893-1b96-4f5b-98ad-0b2b546b236d None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:27.065909 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a8d893-1b96-4f5b-98ad-0b2b546b236d None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:27.066585 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a8d893-1b96-4f5b-98ad-0b2b546b236d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:27.139277 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-b4a8d893-1b96-4f5b-98ad-0b2b546b236d None None] MFA Rules not processed for user `ca13fa56f9a342b69f198080ef10acaa`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:29:27.140787 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-b4a8d893-1b96-4f5b-98ad-0b2b546b236d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:27.241231 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2421/4843] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:29:27 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:29:27.251434 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8410fe7-5df3-45ce-8bef-8532103fb872 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:27.252128 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8410fe7-5df3-45ce-8bef-8532103fb872 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:27.262157 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2423/4844] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:29:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:29:27.264495 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8410fe7-5df3-45ce-8bef-8532103fb872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:27.348513 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-e8410fe7-5df3-45ce-8bef-8532103fb872 None None] MFA Rules not processed for user `ca13fa56f9a342b69f198080ef10acaa`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:29:27.352824 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-e8410fe7-5df3-45ce-8bef-8532103fb872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:27.371727 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c54bde-2644-4752-b4ef-ffcf0a31baa8 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:27.372008 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c54bde-2644-4752-b4ef-ffcf0a31baa8 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:27.372279 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c54bde-2644-4752-b4ef-ffcf0a31baa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:27.381968 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2422/4845] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:29:27 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:29:27.384938 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8410fe7-5df3-45ce-8bef-8532103fb872 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:27.397217 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-e8410fe7-5df3-45ce-8bef-8532103fb872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:27.412818 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-65c54bde-2644-4752-b4ef-ffcf0a31baa8 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:29:27.416265 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-65c54bde-2644-4752-b4ef-ffcf0a31baa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:27.436491 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2424/4846] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:29:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:29:27.444805 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c54bde-2644-4752-b4ef-ffcf0a31baa8 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:27.468760 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c54bde-2644-4752-b4ef-ffcf0a31baa8 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:27.492554 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a696f4-fcb8-43a3-aa8c-63c4ed7df779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:27.493496 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a696f4-fcb8-43a3-aa8c-63c4ed7df779 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:27.493772 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a696f4-fcb8-43a3-aa8c-63c4ed7df779 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:27.495869 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a696f4-fcb8-43a3-aa8c-63c4ed7df779 admin admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:27.497952 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a696f4-fcb8-43a3-aa8c-63c4ed7df779 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:29:27.497952 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a696f4-fcb8-43a3-aa8c-63c4ed7df779 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:27.499449 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a696f4-fcb8-43a3-aa8c-63c4ed7df779 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:27.534533 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2425/4847] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:29:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:29:27.540171 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a696f4-fcb8-43a3-aa8c-63c4ed7df779 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:27.558632 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8410fe7-5df3-45ce-8bef-8532103fb872 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:27.563173 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a696f4-fcb8-43a3-aa8c-63c4ed7df779 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:27.569236 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dc4b53-a748-4bf8-b22a-0e052addfc81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:27.569942 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dc4b53-a748-4bf8-b22a-0e052addfc81 service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:27.570221 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dc4b53-a748-4bf8-b22a-0e052addfc81 service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:27.570489 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dc4b53-a748-4bf8-b22a-0e052addfc81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:27.573768 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-90dc4b53-a748-4bf8-b22a-0e052addfc81 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:27.577845 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4299112-d279-4db4-b12d-d8031007b80d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:27.578570 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4299112-d279-4db4-b12d-d8031007b80d admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:27.578921 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4299112-d279-4db4-b12d-d8031007b80d admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:27.579192 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4299112-d279-4db4-b12d-d8031007b80d admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:27.579903 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4299112-d279-4db4-b12d-d8031007b80d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:27.583751 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4299112-d279-4db4-b12d-d8031007b80d admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:27.602377 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dc4b53-a748-4bf8-b22a-0e052addfc81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:27.604757 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dc4b53-a748-4bf8-b22a-0e052addfc81 service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:27.627446 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2423/4848] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:29:27 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:29:27.653056 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2426/4849] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:29:27 2022] POST /identity/v3/projects => generated 369 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:29:27.658656 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dc4b53-a748-4bf8-b22a-0e052addfc81 service neutron] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:27.689545 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dc4b53-a748-4bf8-b22a-0e052addfc81 service neutron] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:27.774899 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:29:27.845571 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ba68db-14d6-4c04-afe2-e991cacdbb67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:27.846644 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ba68db-14d6-4c04-afe2-e991cacdbb67 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:27.847160 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ba68db-14d6-4c04-afe2-e991cacdbb67 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:27.847790 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ba68db-14d6-4c04-afe2-e991cacdbb67 admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:27.848830 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ba68db-14d6-4c04-afe2-e991cacdbb67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:27.851046 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ba68db-14d6-4c04-afe2-e991cacdbb67 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:27.910861 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2424/4850] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:29:27 2022] POST /identity/v3/users => generated 285 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:29:27.912048 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4299112-d279-4db4-b12d-d8031007b80d admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:27.918464 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:29:27.929452 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4299112-d279-4db4-b12d-d8031007b80d admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:27.936943 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f449497-127e-4e71-8f38-c7663f0a0955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:27.938538 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f449497-127e-4e71-8f38-c7663f0a0955 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:27.939388 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f449497-127e-4e71-8f38-c7663f0a0955 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:27.939913 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f449497-127e-4e71-8f38-c7663f0a0955 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:27.956813 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f449497-127e-4e71-8f38-c7663f0a0955 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:27.959065 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f449497-127e-4e71-8f38-c7663f0a0955 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:27.987795 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2427/4851] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:29:27 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:29:27.988508 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ba68db-14d6-4c04-afe2-e991cacdbb67 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:28.007598 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ba68db-14d6-4c04-afe2-e991cacdbb67 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:28.024274 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78ac6a7-4e83-4c62-9d39-f2099bd737b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:28.025249 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78ac6a7-4e83-4c62-9d39-f2099bd737b0 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:28.025707 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78ac6a7-4e83-4c62-9d39-f2099bd737b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:28.026190 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78ac6a7-4e83-4c62-9d39-f2099bd737b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:28.027116 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78ac6a7-4e83-4c62-9d39-f2099bd737b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:28.042852 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78ac6a7-4e83-4c62-9d39-f2099bd737b0 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:28.069340 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2425/4852] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:29:27 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 21:29:28.073586 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f449497-127e-4e71-8f38-c7663f0a0955 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:28.093425 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f449497-127e-4e71-8f38-c7663f0a0955 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:28.105577 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cd4448-a571-4ade-957e-edc29634cf9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:28.107244 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cd4448-a571-4ade-957e-edc29634cf9e admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:28.110782 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cd4448-a571-4ade-957e-edc29634cf9e admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:28.111179 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cd4448-a571-4ade-957e-edc29634cf9e admin admin] PATH_INFO: `/v3/projects/94f04d6184b2415a9dd9adccd55084fa/users/d8ca1172b55e4c55b0e0158317ff38a0/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:28.168499 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cd4448-a571-4ade-957e-edc29634cf9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=94f04d6184b2415a9dd9adccd55084fa, user_id=d8ca1172b55e4c55b0e0158317ff38a0, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:28.171623 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cd4448-a571-4ade-957e-edc29634cf9e admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:28.215424 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2428/4853] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:29:28 2022] PUT /identity/v3/projects/94f04d6184b2415a9dd9adccd55084fa/users/d8ca1172b55e4c55b0e0158317ff38a0/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:29:28.225396 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b00a4d1-e055-493e-8421-dd2cc2055aa0 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:28.226526 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b00a4d1-e055-493e-8421-dd2cc2055aa0 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:28.227091 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b00a4d1-e055-493e-8421-dd2cc2055aa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:28.288461 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cd4448-a571-4ade-957e-edc29634cf9e admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:28.290473 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-f7cd4448-a571-4ade-957e-edc29634cf9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:28.323310 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-7b00a4d1-e055-493e-8421-dd2cc2055aa0 None None] MFA Rules not processed for user `d8ca1172b55e4c55b0e0158317ff38a0`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:29:28.324608 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-7b00a4d1-e055-493e-8421-dd2cc2055aa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:28.496619 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cd4448-a571-4ade-957e-edc29634cf9e admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:28.506186 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168d7926-b10a-4bf9-a51e-f7cccc0aab7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:28.507124 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168d7926-b10a-4bf9-a51e-f7cccc0aab7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:28.507408 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168d7926-b10a-4bf9-a51e-f7cccc0aab7d admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:28.507758 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168d7926-b10a-4bf9-a51e-f7cccc0aab7d admin admin] PATH_INFO: `/v3/users/55e8d7bc6744442390ea121b5b3cb948` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:28.516934 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168d7926-b10a-4bf9-a51e-f7cccc0aab7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=55e8d7bc6744442390ea121b5b3cb948)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:28.520308 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168d7926-b10a-4bf9-a51e-f7cccc0aab7d admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:28.534467 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2426/4854] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:29:28 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:29:28.535528 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b00a4d1-e055-493e-8421-dd2cc2055aa0 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:28.540299 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-7b00a4d1-e055-493e-8421-dd2cc2055aa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:28.644373 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-168d7926-b10a-4bf9-a51e-f7cccc0aab7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55e8d7bc6744442390ea121b5b3cb948'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:28.645117 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-168d7926-b10a-4bf9-a51e-f7cccc0aab7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55e8d7bc6744442390ea121b5b3cb948'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:28.657231 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-168d7926-b10a-4bf9-a51e-f7cccc0aab7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55e8d7bc6744442390ea121b5b3cb948'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:28.672478 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-168d7926-b10a-4bf9-a51e-f7cccc0aab7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55e8d7bc6744442390ea121b5b3cb948'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:28.703868 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-168d7926-b10a-4bf9-a51e-f7cccc0aab7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55e8d7bc6744442390ea121b5b3cb948'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:28.716636 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2429/4855] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:29:28 2022] DELETE /identity/v3/users/55e8d7bc6744442390ea121b5b3cb948 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:29:28.716636 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168d7926-b10a-4bf9-a51e-f7cccc0aab7d admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:28.716636 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-168d7926-b10a-4bf9-a51e-f7cccc0aab7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:28.768340 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b00a4d1-e055-493e-8421-dd2cc2055aa0 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:28.789545 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:29:28.827685 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:29:28.844346 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168d7926-b10a-4bf9-a51e-f7cccc0aab7d admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:28.852130 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce66a64-8296-4a9f-83c5-65c3ecf042d3 tempest-AccessRulesV3Test-928914649 tempest-AccessRulesV3Test-928914649-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8ca1172b55e4c55b0e0158317ff38a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94f04d6184b2415a9dd9adccd55084fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:28.853799 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce66a64-8296-4a9f-83c5-65c3ecf042d3 tempest-AccessRulesV3Test-928914649 tempest-AccessRulesV3Test-928914649-project] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:28.854582 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce66a64-8296-4a9f-83c5-65c3ecf042d3 tempest-AccessRulesV3Test-928914649 tempest-AccessRulesV3Test-928914649-project] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:28.855080 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce66a64-8296-4a9f-83c5-65c3ecf042d3 tempest-AccessRulesV3Test-928914649 tempest-AccessRulesV3Test-928914649-project] PATH_INFO: `/v3/users/d8ca1172b55e4c55b0e0158317ff38a0/application_credentials` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:28.856082 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce66a64-8296-4a9f-83c5-65c3ecf042d3 tempest-AccessRulesV3Test-928914649 tempest-AccessRulesV3Test-928914649-project] RBAC: Authorizing `identity:create_application_credential(user_id=d8ca1172b55e4c55b0e0158317ff38a0)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:28.862249 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce66a64-8296-4a9f-83c5-65c3ecf042d3 tempest-AccessRulesV3Test-928914649 tempest-AccessRulesV3Test-928914649-project] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:28.929853 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97895146-277f-4772-9caf-5808233578b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:28.930662 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97895146-277f-4772-9caf-5808233578b2 service nova] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:28.931173 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97895146-277f-4772-9caf-5808233578b2 service nova] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:28.931539 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97895146-277f-4772-9caf-5808233578b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:28.935207 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-97895146-277f-4772-9caf-5808233578b2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:28.966879 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97895146-277f-4772-9caf-5808233578b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:28.968605 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97895146-277f-4772-9caf-5808233578b2 service nova] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:28.997264 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2427/4856] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:29:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:29:28.998837 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bbc6c4-e3e4-4bcd-adbc-98f22b9d0a64 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:29.000920 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bbc6c4-e3e4-4bcd-adbc-98f22b9d0a64 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:29.002097 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bbc6c4-e3e4-4bcd-adbc-98f22b9d0a64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:29.047136 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-93bbc6c4-e3e4-4bcd-adbc-98f22b9d0a64 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:29:29.047993 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2430/4857] 10.222.0.17 () {60 vars in 1314 bytes} [Sat Jul 23 21:29:28 2022] POST /identity/v3/users/d8ca1172b55e4c55b0e0158317ff38a0/application_credentials => generated 921 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:29:29.053052 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce66a64-8296-4a9f-83c5-65c3ecf042d3 tempest-AccessRulesV3Test-928914649 tempest-AccessRulesV3Test-928914649-project] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:29.058610 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-93bbc6c4-e3e4-4bcd-adbc-98f22b9d0a64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:29.073989 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce66a64-8296-4a9f-83c5-65c3ecf042d3 tempest-AccessRulesV3Test-928914649 tempest-AccessRulesV3Test-928914649-project] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:29.083937 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9275856c-b787-481c-af2c-6acfc7a91898 tempest-AccessRulesV3Test-928914649 tempest-AccessRulesV3Test-928914649-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8ca1172b55e4c55b0e0158317ff38a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94f04d6184b2415a9dd9adccd55084fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:29.089342 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9275856c-b787-481c-af2c-6acfc7a91898 tempest-AccessRulesV3Test-928914649 tempest-AccessRulesV3Test-928914649-project] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:29.089948 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9275856c-b787-481c-af2c-6acfc7a91898 tempest-AccessRulesV3Test-928914649 tempest-AccessRulesV3Test-928914649-project] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:29.090420 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9275856c-b787-481c-af2c-6acfc7a91898 tempest-AccessRulesV3Test-928914649 tempest-AccessRulesV3Test-928914649-project] PATH_INFO: `/v3/users/d8ca1172b55e4c55b0e0158317ff38a0/access_rules/776cfd3aca3a41e5ac35eb483b312e7d` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:29.091955 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9275856c-b787-481c-af2c-6acfc7a91898 tempest-AccessRulesV3Test-928914649 tempest-AccessRulesV3Test-928914649-project] RBAC: Authorizing `identity:delete_access_rule(user_id=d8ca1172b55e4c55b0e0158317ff38a0, access_rule_id=776cfd3aca3a41e5ac35eb483b312e7d)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:29.095056 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9275856c-b787-481c-af2c-6acfc7a91898 tempest-AccessRulesV3Test-928914649 tempest-AccessRulesV3Test-928914649-project] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:29.216457 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-9275856c-b787-481c-af2c-6acfc7a91898 tempest-AccessRulesV3Test-928914649 tempest-AccessRulesV3Test-928914649-project] May not delete access rule in use: keystone.exception.ForbiddenNotSecurity: May not delete access rule in use Jul 23 21:29:29.216457 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 21:29:29.216457 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/application_credential/backends/sql.py", line 256, in delete_access_rule Jul 23 21:29:29.216457 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application session.delete(ref) Jul 23 21:29:29.216457 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 23 21:29:29.216457 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application next(self.gen) Jul 23 21:29:29.216457 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 23 21:29:29.216457 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application yield resource Jul 23 21:29:29.216457 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 23 21:29:29.216457 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application next(self.gen) Jul 23 21:29:29.216457 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 23 21:29:29.216457 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application self.session.rollback() Jul 23 21:29:29.216457 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 23 21:29:29.216457 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application self.force_reraise() Jul 23 21:29:29.216457 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 23 21:29:29.216457 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise self.value Jul 23 21:29:29.217922 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 23 21:29:29.217922 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 23 21:29:29.217922 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 23 21:29:29.217922 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application session.commit() Jul 23 21:29:29.217922 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 23 21:29:29.217922 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 23 21:29:29.217922 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 23 21:29:29.217922 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application self._prepare_impl() Jul 23 21:29:29.217922 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 23 21:29:29.217922 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application self.session.flush() Jul 23 21:29:29.217922 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 23 21:29:29.217922 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application self._flush(objects) Jul 23 21:29:29.217922 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 23 21:29:29.217922 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 23 21:29:29.217922 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 23 21:29:29.217922 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application compat.raise_( Jul 23 21:29:29.219547 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 23 21:29:29.219547 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception Jul 23 21:29:29.219547 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 23 21:29:29.219547 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application flush_context.execute() Jul 23 21:29:29.219547 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 23 21:29:29.219547 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rec.execute(self) Jul 23 21:29:29.219547 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 577, in execute Jul 23 21:29:29.219547 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application self.dependency_processor.process_deletes(uow, states) Jul 23 21:29:29.219547 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/dependency.py", line 552, in process_deletes Jul 23 21:29:29.219547 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application self._synchronize( Jul 23 21:29:29.219547 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/dependency.py", line 610, in _synchronize Jul 23 21:29:29.219547 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application sync.clear(dest, self.mapper, self.prop.synchronize_pairs) Jul 23 21:29:29.219547 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/sync.py", line 86, in clear Jul 23 21:29:29.219547 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise AssertionError( Jul 23 21:29:29.219547 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application AssertionError: Dependency rule tried to blank-out primary key column 'application_credential_access_rule.access_rule_id' on instance '' Jul 23 21:29:29.219547 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 21:29:29.220985 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 23 21:29:29.220985 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 21:29:29.220985 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 21:29:29.220985 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 21:29:29.220985 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 21:29:29.220985 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 21:29:29.220985 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 21:29:29.220985 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 21:29:29.220985 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 21:29:29.220985 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 21:29:29.220985 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 21:29:29.220985 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 21:29:29.220985 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 21:29:29.220985 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 763, in delete Jul 23 21:29:29.220985 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application PROVIDERS.application_credential_api.delete_access_rule( Jul 23 21:29:29.220985 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 21:29:29.220985 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 21:29:29.222532 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/application_credential/core.py", line 252, in delete_access_rule Jul 23 21:29:29.222532 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application self.driver.delete_access_rule(access_rule_id) Jul 23 21:29:29.222532 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/application_credential/backends/sql.py", line 258, in delete_access_rule Jul 23 21:29:29.222532 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.ForbiddenNotSecurity( Jul 23 21:29:29.222532 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.ForbiddenNotSecurity: May not delete access rule in use Jul 23 21:29:29.222532 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 21:29:29.225010 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2431/4858] 10.222.0.17 () {58 vars in 1361 bytes} [Sat Jul 23 21:29:29 2022] DELETE /identity/v3/users/d8ca1172b55e4c55b0e0158317ff38a0/access_rules/776cfd3aca3a41e5ac35eb483b312e7d => generated 89 bytes in 172 msecs (HTTP/1.1 403) 5 headers in 183 bytes (1 switches on core 0) Jul 23 21:29:29.228996 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9275856c-b787-481c-af2c-6acfc7a91898 tempest-AccessRulesV3Test-928914649 tempest-AccessRulesV3Test-928914649-project] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:29.243245 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2428/4859] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:29:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:29:29.249263 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9275856c-b787-481c-af2c-6acfc7a91898 tempest-AccessRulesV3Test-928914649 tempest-AccessRulesV3Test-928914649-project] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:29.268018 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4eeb28-6d63-4fba-b422-4fa7771b9370 tempest-AccessRulesV3Test-928914649 tempest-AccessRulesV3Test-928914649-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8ca1172b55e4c55b0e0158317ff38a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94f04d6184b2415a9dd9adccd55084fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:29.269014 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4eeb28-6d63-4fba-b422-4fa7771b9370 tempest-AccessRulesV3Test-928914649 tempest-AccessRulesV3Test-928914649-project] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:29.269298 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4eeb28-6d63-4fba-b422-4fa7771b9370 tempest-AccessRulesV3Test-928914649 tempest-AccessRulesV3Test-928914649-project] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:29.269574 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4eeb28-6d63-4fba-b422-4fa7771b9370 tempest-AccessRulesV3Test-928914649 tempest-AccessRulesV3Test-928914649-project] PATH_INFO: `/v3/users/d8ca1172b55e4c55b0e0158317ff38a0/application_credentials/ba87e160bb39404f907cea1d3c859001` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:29.322805 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4eeb28-6d63-4fba-b422-4fa7771b9370 tempest-AccessRulesV3Test-928914649 tempest-AccessRulesV3Test-928914649-project] RBAC: Authorizing `identity:delete_application_credential(user_id=d8ca1172b55e4c55b0e0158317ff38a0, application_credential_id=ba87e160bb39404f907cea1d3c859001)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:29.324391 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4eeb28-6d63-4fba-b422-4fa7771b9370 tempest-AccessRulesV3Test-928914649 tempest-AccessRulesV3Test-928914649-project] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:29.332217 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bbc6c4-e3e4-4bcd-adbc-98f22b9d0a64 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:29.334092 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-93bbc6c4-e3e4-4bcd-adbc-98f22b9d0a64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:29.372729 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2432/4860] 10.222.0.17 () {58 vars in 1394 bytes} [Sat Jul 23 21:29:29 2022] DELETE /identity/v3/users/d8ca1172b55e4c55b0e0158317ff38a0/application_credentials/ba87e160bb39404f907cea1d3c859001 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:29:29.376678 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4eeb28-6d63-4fba-b422-4fa7771b9370 tempest-AccessRulesV3Test-928914649 tempest-AccessRulesV3Test-928914649-project] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:29.398545 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4eeb28-6d63-4fba-b422-4fa7771b9370 tempest-AccessRulesV3Test-928914649 tempest-AccessRulesV3Test-928914649-project] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:29.420512 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581994d8-b073-4196-94f0-86698ccd651f tempest-AccessRulesV3Test-928914649 tempest-AccessRulesV3Test-928914649-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8ca1172b55e4c55b0e0158317ff38a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94f04d6184b2415a9dd9adccd55084fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:29.421182 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581994d8-b073-4196-94f0-86698ccd651f tempest-AccessRulesV3Test-928914649 tempest-AccessRulesV3Test-928914649-project] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:29.421384 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581994d8-b073-4196-94f0-86698ccd651f tempest-AccessRulesV3Test-928914649 tempest-AccessRulesV3Test-928914649-project] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:29.421651 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581994d8-b073-4196-94f0-86698ccd651f tempest-AccessRulesV3Test-928914649 tempest-AccessRulesV3Test-928914649-project] PATH_INFO: `/v3/users/d8ca1172b55e4c55b0e0158317ff38a0/access_rules` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:29.424368 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581994d8-b073-4196-94f0-86698ccd651f tempest-AccessRulesV3Test-928914649 tempest-AccessRulesV3Test-928914649-project] RBAC: Authorizing `identity:list_access_rules(user_id=d8ca1172b55e4c55b0e0158317ff38a0)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:29.425906 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581994d8-b073-4196-94f0-86698ccd651f tempest-AccessRulesV3Test-928914649 tempest-AccessRulesV3Test-928914649-project] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:29.445090 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2433/4861] 10.222.0.17 () {58 vars in 1259 bytes} [Sat Jul 23 21:29:29 2022] GET /identity/v3/users/d8ca1172b55e4c55b0e0158317ff38a0/access_rules => generated 369 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:29:29.449135 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581994d8-b073-4196-94f0-86698ccd651f tempest-AccessRulesV3Test-928914649 tempest-AccessRulesV3Test-928914649-project] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:29.478548 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581994d8-b073-4196-94f0-86698ccd651f tempest-AccessRulesV3Test-928914649 tempest-AccessRulesV3Test-928914649-project] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:29.496133 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cc1c08-6025-4641-8985-3de410be5263 tempest-AccessRulesV3Test-928914649 tempest-AccessRulesV3Test-928914649-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8ca1172b55e4c55b0e0158317ff38a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94f04d6184b2415a9dd9adccd55084fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:29.497549 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cc1c08-6025-4641-8985-3de410be5263 tempest-AccessRulesV3Test-928914649 tempest-AccessRulesV3Test-928914649-project] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:29.498115 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cc1c08-6025-4641-8985-3de410be5263 tempest-AccessRulesV3Test-928914649 tempest-AccessRulesV3Test-928914649-project] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:29.499107 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cc1c08-6025-4641-8985-3de410be5263 tempest-AccessRulesV3Test-928914649 tempest-AccessRulesV3Test-928914649-project] PATH_INFO: `/v3/users/d8ca1172b55e4c55b0e0158317ff38a0/access_rules/776cfd3aca3a41e5ac35eb483b312e7d` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:29.501046 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cc1c08-6025-4641-8985-3de410be5263 tempest-AccessRulesV3Test-928914649 tempest-AccessRulesV3Test-928914649-project] RBAC: Authorizing `identity:delete_access_rule(user_id=d8ca1172b55e4c55b0e0158317ff38a0, access_rule_id=776cfd3aca3a41e5ac35eb483b312e7d)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:29.504428 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cc1c08-6025-4641-8985-3de410be5263 tempest-AccessRulesV3Test-928914649 tempest-AccessRulesV3Test-928914649-project] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:29.519300 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bbc6c4-e3e4-4bcd-adbc-98f22b9d0a64 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:29.526629 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4d9cc2-d311-4ecc-aaac-7491b1bf4849 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:29.531244 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4d9cc2-d311-4ecc-aaac-7491b1bf4849 service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:29.531713 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4d9cc2-d311-4ecc-aaac-7491b1bf4849 service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:29.531991 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4d9cc2-d311-4ecc-aaac-7491b1bf4849 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:29.540008 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2434/4862] 10.222.0.17 () {58 vars in 1361 bytes} [Sat Jul 23 21:29:29 2022] DELETE /identity/v3/users/d8ca1172b55e4c55b0e0158317ff38a0/access_rules/776cfd3aca3a41e5ac35eb483b312e7d => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:29:29.543802 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cc1c08-6025-4641-8985-3de410be5263 tempest-AccessRulesV3Test-928914649 tempest-AccessRulesV3Test-928914649-project] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:29.545686 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-75cc1c08-6025-4641-8985-3de410be5263 tempest-AccessRulesV3Test-928914649 tempest-AccessRulesV3Test-928914649-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:29.548762 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4d9cc2-d311-4ecc-aaac-7491b1bf4849 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:29.550295 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4d9cc2-d311-4ecc-aaac-7491b1bf4849 service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:29.566039 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2429/4863] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:29:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:29:29.567301 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4d9cc2-d311-4ecc-aaac-7491b1bf4849 service neutron] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:29.582403 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cc1c08-6025-4641-8985-3de410be5263 tempest-AccessRulesV3Test-928914649 tempest-AccessRulesV3Test-928914649-project] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:29.593946 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4d9cc2-d311-4ecc-aaac-7491b1bf4849 service neutron] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:29.597453 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce7c3ec-e4a9-449b-8054-3349f7d34e60 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:29.599656 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce7c3ec-e4a9-449b-8054-3349f7d34e60 service nova] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:29.599972 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce7c3ec-e4a9-449b-8054-3349f7d34e60 service nova] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:29.600248 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce7c3ec-e4a9-449b-8054-3349f7d34e60 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:29.600617 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4996b5-e59b-4142-a319-f3180f014023 tempest-AccessRulesV3Test-928914649 tempest-AccessRulesV3Test-928914649-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8ca1172b55e4c55b0e0158317ff38a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94f04d6184b2415a9dd9adccd55084fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:29.602511 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4996b5-e59b-4142-a319-f3180f014023 tempest-AccessRulesV3Test-928914649 tempest-AccessRulesV3Test-928914649-project] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:29.602863 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4996b5-e59b-4142-a319-f3180f014023 tempest-AccessRulesV3Test-928914649 tempest-AccessRulesV3Test-928914649-project] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:29.603213 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4996b5-e59b-4142-a319-f3180f014023 tempest-AccessRulesV3Test-928914649 tempest-AccessRulesV3Test-928914649-project] PATH_INFO: `/v3/users/d8ca1172b55e4c55b0e0158317ff38a0/access_rules` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:29.605853 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4996b5-e59b-4142-a319-f3180f014023 tempest-AccessRulesV3Test-928914649 tempest-AccessRulesV3Test-928914649-project] RBAC: Authorizing `identity:list_access_rules(user_id=d8ca1172b55e4c55b0e0158317ff38a0)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:29.607939 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-3ce7c3ec-e4a9-449b-8054-3349f7d34e60 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:29.608376 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4996b5-e59b-4142-a319-f3180f014023 tempest-AccessRulesV3Test-928914649 tempest-AccessRulesV3Test-928914649-project] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:29.619776 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2430/4864] 10.222.0.17 () {58 vars in 1259 bytes} [Sat Jul 23 21:29:29 2022] GET /identity/v3/users/d8ca1172b55e4c55b0e0158317ff38a0/access_rules => generated 158 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:29:29.623383 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4996b5-e59b-4142-a319-f3180f014023 tempest-AccessRulesV3Test-928914649 tempest-AccessRulesV3Test-928914649-project] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:29.648392 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4996b5-e59b-4142-a319-f3180f014023 tempest-AccessRulesV3Test-928914649 tempest-AccessRulesV3Test-928914649-project] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:29.653448 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae9da2d-a1cf-4173-8200-dd46e5531a6f tempest-AccessRulesV3Test-928914649 tempest-AccessRulesV3Test-928914649-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8ca1172b55e4c55b0e0158317ff38a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94f04d6184b2415a9dd9adccd55084fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:29.654848 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae9da2d-a1cf-4173-8200-dd46e5531a6f tempest-AccessRulesV3Test-928914649 tempest-AccessRulesV3Test-928914649-project] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:29.655379 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae9da2d-a1cf-4173-8200-dd46e5531a6f tempest-AccessRulesV3Test-928914649 tempest-AccessRulesV3Test-928914649-project] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:29.656357 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae9da2d-a1cf-4173-8200-dd46e5531a6f tempest-AccessRulesV3Test-928914649 tempest-AccessRulesV3Test-928914649-project] PATH_INFO: `/v3/users/d8ca1172b55e4c55b0e0158317ff38a0/application_credentials` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:29.657686 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae9da2d-a1cf-4173-8200-dd46e5531a6f tempest-AccessRulesV3Test-928914649 tempest-AccessRulesV3Test-928914649-project] RBAC: Authorizing `identity:create_application_credential(user_id=d8ca1172b55e4c55b0e0158317ff38a0)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:29.659435 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae9da2d-a1cf-4173-8200-dd46e5531a6f tempest-AccessRulesV3Test-928914649 tempest-AccessRulesV3Test-928914649-project] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:29.763890 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce7c3ec-e4a9-449b-8054-3349f7d34e60 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:29.765533 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce7c3ec-e4a9-449b-8054-3349f7d34e60 service nova] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:29.798731 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2435/4865] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:29:29 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:29:29.807731 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:29:29.896861 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2431/4866] 10.222.0.17 () {60 vars in 1314 bytes} [Sat Jul 23 21:29:29 2022] POST /identity/v3/users/d8ca1172b55e4c55b0e0158317ff38a0/application_credentials => generated 921 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:29:29.901500 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce7c3ec-e4a9-449b-8054-3349f7d34e60 service nova] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:29.917066 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce7c3ec-e4a9-449b-8054-3349f7d34e60 service nova] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:29.926381 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7cf154-9910-4bf8-9a88-131e312639e8 tempest-AccessRulesV3Test-928914649 tempest-AccessRulesV3Test-928914649-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8ca1172b55e4c55b0e0158317ff38a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94f04d6184b2415a9dd9adccd55084fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:29.927288 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7cf154-9910-4bf8-9a88-131e312639e8 tempest-AccessRulesV3Test-928914649 tempest-AccessRulesV3Test-928914649-project] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:29.927743 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7cf154-9910-4bf8-9a88-131e312639e8 tempest-AccessRulesV3Test-928914649 tempest-AccessRulesV3Test-928914649-project] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:29.928017 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7cf154-9910-4bf8-9a88-131e312639e8 tempest-AccessRulesV3Test-928914649 tempest-AccessRulesV3Test-928914649-project] PATH_INFO: `/v3/users/d8ca1172b55e4c55b0e0158317ff38a0/access_rules` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:29.935938 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7cf154-9910-4bf8-9a88-131e312639e8 tempest-AccessRulesV3Test-928914649 tempest-AccessRulesV3Test-928914649-project] RBAC: Authorizing `identity:list_access_rules(user_id=d8ca1172b55e4c55b0e0158317ff38a0)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:29.941425 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7cf154-9910-4bf8-9a88-131e312639e8 tempest-AccessRulesV3Test-928914649 tempest-AccessRulesV3Test-928914649-project] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:29.951073 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=92,keystone:INSERT=4,keystone:DELETE=4 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:29:29.966916 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2436/4867] 10.222.0.17 () {58 vars in 1259 bytes} [Sat Jul 23 21:29:29 2022] GET /identity/v3/users/d8ca1172b55e4c55b0e0158317ff38a0/access_rules => generated 369 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:29:29.973810 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae9da2d-a1cf-4173-8200-dd46e5531a6f tempest-AccessRulesV3Test-928914649 tempest-AccessRulesV3Test-928914649-project] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:29.990521 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae9da2d-a1cf-4173-8200-dd46e5531a6f tempest-AccessRulesV3Test-928914649 tempest-AccessRulesV3Test-928914649-project] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:30.006742 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b091db-6d92-490d-a355-d322bd2ceaab tempest-AccessRulesV3Test-928914649 tempest-AccessRulesV3Test-928914649-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8ca1172b55e4c55b0e0158317ff38a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94f04d6184b2415a9dd9adccd55084fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:30.006742 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b091db-6d92-490d-a355-d322bd2ceaab tempest-AccessRulesV3Test-928914649 tempest-AccessRulesV3Test-928914649-project] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:30.006742 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b091db-6d92-490d-a355-d322bd2ceaab tempest-AccessRulesV3Test-928914649 tempest-AccessRulesV3Test-928914649-project] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:30.007363 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b091db-6d92-490d-a355-d322bd2ceaab tempest-AccessRulesV3Test-928914649 tempest-AccessRulesV3Test-928914649-project] PATH_INFO: `/v3/users/d8ca1172b55e4c55b0e0158317ff38a0/application_credentials` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:30.008908 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7cf154-9910-4bf8-9a88-131e312639e8 tempest-AccessRulesV3Test-928914649 tempest-AccessRulesV3Test-928914649-project] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:30.011221 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-3a7cf154-9910-4bf8-9a88-131e312639e8 tempest-AccessRulesV3Test-928914649 tempest-AccessRulesV3Test-928914649-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:30.013595 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b091db-6d92-490d-a355-d322bd2ceaab tempest-AccessRulesV3Test-928914649 tempest-AccessRulesV3Test-928914649-project] RBAC: Authorizing `identity:create_application_credential(user_id=d8ca1172b55e4c55b0e0158317ff38a0)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:30.016441 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b091db-6d92-490d-a355-d322bd2ceaab tempest-AccessRulesV3Test-928914649 tempest-AccessRulesV3Test-928914649-project] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:30.054165 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7cf154-9910-4bf8-9a88-131e312639e8 tempest-AccessRulesV3Test-928914649 tempest-AccessRulesV3Test-928914649-project] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:30.075640 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b15895b-5294-4f0d-b727-8265f7d1bba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:30.081938 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b15895b-5294-4f0d-b727-8265f7d1bba6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:30.082254 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b15895b-5294-4f0d-b727-8265f7d1bba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:30.082509 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b15895b-5294-4f0d-b727-8265f7d1bba6 admin admin] PATH_INFO: `/v3/users/896f9085718446cd90ce445c09be4741` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:30.084123 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b15895b-5294-4f0d-b727-8265f7d1bba6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=896f9085718446cd90ce445c09be4741)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:30.094029 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b15895b-5294-4f0d-b727-8265f7d1bba6 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:30.196068 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-3b15895b-5294-4f0d-b727-8265f7d1bba6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '896f9085718446cd90ce445c09be4741'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:30.197203 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-3b15895b-5294-4f0d-b727-8265f7d1bba6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '896f9085718446cd90ce445c09be4741'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:30.206793 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-3b15895b-5294-4f0d-b727-8265f7d1bba6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '896f9085718446cd90ce445c09be4741'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:30.220936 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-3b15895b-5294-4f0d-b727-8265f7d1bba6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '896f9085718446cd90ce445c09be4741'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:30.232787 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2432/4868] 10.222.0.17 () {60 vars in 1314 bytes} [Sat Jul 23 21:29:29 2022] POST /identity/v3/users/d8ca1172b55e4c55b0e0158317ff38a0/application_credentials => generated 921 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:29:30.234018 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b091db-6d92-490d-a355-d322bd2ceaab tempest-AccessRulesV3Test-928914649 tempest-AccessRulesV3Test-928914649-project] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:30.249564 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-3b15895b-5294-4f0d-b727-8265f7d1bba6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '896f9085718446cd90ce445c09be4741'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:30.257901 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2437/4869] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:29:30 2022] DELETE /identity/v3/users/896f9085718446cd90ce445c09be4741 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:29:30.265182 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b091db-6d92-490d-a355-d322bd2ceaab tempest-AccessRulesV3Test-928914649 tempest-AccessRulesV3Test-928914649-project] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:30.384423 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabdff74-ad31-4967-b2e7-9340f5256a22 tempest-AccessRulesV3Test-928914649 tempest-AccessRulesV3Test-928914649-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8ca1172b55e4c55b0e0158317ff38a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94f04d6184b2415a9dd9adccd55084fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:30.385546 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabdff74-ad31-4967-b2e7-9340f5256a22 tempest-AccessRulesV3Test-928914649 tempest-AccessRulesV3Test-928914649-project] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:30.385828 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabdff74-ad31-4967-b2e7-9340f5256a22 tempest-AccessRulesV3Test-928914649 tempest-AccessRulesV3Test-928914649-project] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:30.386207 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabdff74-ad31-4967-b2e7-9340f5256a22 tempest-AccessRulesV3Test-928914649 tempest-AccessRulesV3Test-928914649-project] PATH_INFO: `/v3/users/d8ca1172b55e4c55b0e0158317ff38a0/access_rules/20cc7d0955d9414a926135ed72dd95ed` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:30.388162 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabdff74-ad31-4967-b2e7-9340f5256a22 tempest-AccessRulesV3Test-928914649 tempest-AccessRulesV3Test-928914649-project] RBAC: Authorizing `identity:get_access_rule(user_id=d8ca1172b55e4c55b0e0158317ff38a0, access_rule_id=20cc7d0955d9414a926135ed72dd95ed)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:30.390439 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabdff74-ad31-4967-b2e7-9340f5256a22 tempest-AccessRulesV3Test-928914649 tempest-AccessRulesV3Test-928914649-project] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:30.431392 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2433/4870] 10.222.0.17 () {58 vars in 1358 bytes} [Sat Jul 23 21:29:30 2022] GET /identity/v3/users/d8ca1172b55e4c55b0e0158317ff38a0/access_rules/20cc7d0955d9414a926135ed72dd95ed => generated 229 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:29:30.432924 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b15895b-5294-4f0d-b727-8265f7d1bba6 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:30.434706 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-3b15895b-5294-4f0d-b727-8265f7d1bba6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:30.547550 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b15895b-5294-4f0d-b727-8265f7d1bba6 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:30.553628 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08b6fd2-1717-4428-aa8a-e8fb3adb3d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:30.554976 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08b6fd2-1717-4428-aa8a-e8fb3adb3d17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:30.555425 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08b6fd2-1717-4428-aa8a-e8fb3adb3d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:30.555870 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08b6fd2-1717-4428-aa8a-e8fb3adb3d17 admin admin] PATH_INFO: `/v3/users/d8ca1172b55e4c55b0e0158317ff38a0` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:30.557253 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08b6fd2-1717-4428-aa8a-e8fb3adb3d17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8ca1172b55e4c55b0e0158317ff38a0)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:30.560887 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08b6fd2-1717-4428-aa8a-e8fb3adb3d17 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:30.637373 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-b08b6fd2-1717-4428-aa8a-e8fb3adb3d17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8ca1172b55e4c55b0e0158317ff38a0'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:30.638502 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-b08b6fd2-1717-4428-aa8a-e8fb3adb3d17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8ca1172b55e4c55b0e0158317ff38a0'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:30.649108 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-b08b6fd2-1717-4428-aa8a-e8fb3adb3d17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8ca1172b55e4c55b0e0158317ff38a0'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:30.664595 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-b08b6fd2-1717-4428-aa8a-e8fb3adb3d17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8ca1172b55e4c55b0e0158317ff38a0'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:30.668078 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabdff74-ad31-4967-b2e7-9340f5256a22 tempest-AccessRulesV3Test-928914649 tempest-AccessRulesV3Test-928914649-project] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:30.669910 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-eabdff74-ad31-4967-b2e7-9340f5256a22 tempest-AccessRulesV3Test-928914649 tempest-AccessRulesV3Test-928914649-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:30.699673 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:29:30.705985 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabdff74-ad31-4967-b2e7-9340f5256a22 tempest-AccessRulesV3Test-928914649 tempest-AccessRulesV3Test-928914649-project] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:30.717832 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3354e2-3470-4763-ae3e-82abfdd44473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:30.719012 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3354e2-3470-4763-ae3e-82abfdd44473 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:30.719446 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3354e2-3470-4763-ae3e-82abfdd44473 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:30.719789 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3354e2-3470-4763-ae3e-82abfdd44473 admin admin] PATH_INFO: `/v3/projects/21695c8a68454c07bd8c466671076897` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:30.721765 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3354e2-3470-4763-ae3e-82abfdd44473 admin admin] RBAC: Authorizing `identity:delete_project(project_id=21695c8a68454c07bd8c466671076897)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:30.724395 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3354e2-3470-4763-ae3e-82abfdd44473 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:30.778766 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-b08b6fd2-1717-4428-aa8a-e8fb3adb3d17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8ca1172b55e4c55b0e0158317ff38a0'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:30.792382 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2438/4871] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:29:30 2022] DELETE /identity/v3/users/d8ca1172b55e4c55b0e0158317ff38a0 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:29:30.807897 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fb7224-6695-458d-a9c3-8e7a6c761c58 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:30.808242 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fb7224-6695-458d-a9c3-8e7a6c761c58 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:30.808686 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fb7224-6695-458d-a9c3-8e7a6c761c58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:30.846991 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-91fb7224-6695-458d-a9c3-8e7a6c761c58 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:29:30.848470 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-91fb7224-6695-458d-a9c3-8e7a6c761c58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:30.908542 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-ab3354e2-3470-4763-ae3e-82abfdd44473 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21695c8a68454c07bd8c466671076897', 'request_id': 'req-ab3354e2-3470-4763-ae3e-82abfdd44473'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:30.938672 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-ab3354e2-3470-4763-ae3e-82abfdd44473 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21695c8a68454c07bd8c466671076897', 'request_id': 'req-ab3354e2-3470-4763-ae3e-82abfdd44473'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:30.951012 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-ab3354e2-3470-4763-ae3e-82abfdd44473 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21695c8a68454c07bd8c466671076897', 'request_id': 'req-ab3354e2-3470-4763-ae3e-82abfdd44473'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:30.952513 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:INSERT=8,keystone:SELECT=85,keystone:DELETE=7 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:29:30.975561 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-ab3354e2-3470-4763-ae3e-82abfdd44473 admin admin] The token cache is being invalidate because project 21695c8a68454c07bd8c466671076897 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:29:30.977694 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-ab3354e2-3470-4763-ae3e-82abfdd44473 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:30.980740 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-ab3354e2-3470-4763-ae3e-82abfdd44473 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:30.983395 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2434/4872] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:29:30 2022] DELETE /identity/v3/projects/21695c8a68454c07bd8c466671076897 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:29:30.988270 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3354e2-3470-4763-ae3e-82abfdd44473 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:30.994439 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-ab3354e2-3470-4763-ae3e-82abfdd44473 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:31.046392 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2439/4873] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:29:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:29:31.047668 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948d903e-a6d1-47a0-b69d-ba6909d1478c None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:31.048013 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948d903e-a6d1-47a0-b69d-ba6909d1478c None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:31.048355 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948d903e-a6d1-47a0-b69d-ba6909d1478c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:31.070261 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-948d903e-a6d1-47a0-b69d-ba6909d1478c None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:29:31.071604 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-948d903e-a6d1-47a0-b69d-ba6909d1478c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:31.086491 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2440/4874] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:29:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:29:31.095297 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eacb768-63ec-416e-9441-f03e38477270 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:31.095676 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eacb768-63ec-416e-9441-f03e38477270 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:31.096021 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eacb768-63ec-416e-9441-f03e38477270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:31.140006 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3354e2-3470-4763-ae3e-82abfdd44473 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:31.142777 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-3eacb768-63ec-416e-9441-f03e38477270 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:29:31.145273 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-3eacb768-63ec-416e-9441-f03e38477270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:31.152653 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52c21b0-ed18-4ed2-9ec8-3b0d57f19fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:31.153926 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52c21b0-ed18-4ed2-9ec8-3b0d57f19fa3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:31.154519 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52c21b0-ed18-4ed2-9ec8-3b0d57f19fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:31.155149 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52c21b0-ed18-4ed2-9ec8-3b0d57f19fa3 admin admin] PATH_INFO: `/v3/projects/7547a3c3da774046a965b63a318c6835` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:31.157615 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52c21b0-ed18-4ed2-9ec8-3b0d57f19fa3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7547a3c3da774046a965b63a318c6835)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:31.162212 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52c21b0-ed18-4ed2-9ec8-3b0d57f19fa3 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:31.166716 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2441/4875] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:29:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:29:31.171692 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eacb768-63ec-416e-9441-f03e38477270 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:31.175418 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-3eacb768-63ec-416e-9441-f03e38477270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:31.272855 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-c52c21b0-ed18-4ed2-9ec8-3b0d57f19fa3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7547a3c3da774046a965b63a318c6835', 'request_id': 'req-c52c21b0-ed18-4ed2-9ec8-3b0d57f19fa3'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:31.288751 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-c52c21b0-ed18-4ed2-9ec8-3b0d57f19fa3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7547a3c3da774046a965b63a318c6835', 'request_id': 'req-c52c21b0-ed18-4ed2-9ec8-3b0d57f19fa3'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:31.292487 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eacb768-63ec-416e-9441-f03e38477270 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:31.301816 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-c52c21b0-ed18-4ed2-9ec8-3b0d57f19fa3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7547a3c3da774046a965b63a318c6835', 'request_id': 'req-c52c21b0-ed18-4ed2-9ec8-3b0d57f19fa3'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:31.320704 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-c52c21b0-ed18-4ed2-9ec8-3b0d57f19fa3 admin admin] The token cache is being invalidate because project 7547a3c3da774046a965b63a318c6835 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:29:31.321071 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-c52c21b0-ed18-4ed2-9ec8-3b0d57f19fa3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:31.322168 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-c52c21b0-ed18-4ed2-9ec8-3b0d57f19fa3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:31.326853 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2435/4876] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:29:30 2022] DELETE /identity/v3/projects/7547a3c3da774046a965b63a318c6835 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:29:31.326853 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52c21b0-ed18-4ed2-9ec8-3b0d57f19fa3 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:31.327411 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-c52c21b0-ed18-4ed2-9ec8-3b0d57f19fa3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:31.355460 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dca67c-b9e9-45aa-9fee-1b2ad7fab5ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:31.356170 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dca67c-b9e9-45aa-9fee-1b2ad7fab5ef service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:31.356455 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dca67c-b9e9-45aa-9fee-1b2ad7fab5ef service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:31.356823 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dca67c-b9e9-45aa-9fee-1b2ad7fab5ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:31.362359 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-23dca67c-b9e9-45aa-9fee-1b2ad7fab5ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:31.430058 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:29:31.433963 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52c21b0-ed18-4ed2-9ec8-3b0d57f19fa3 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:31.441581 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4706c849-c55c-4032-ba3a-7c4a4462514a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:31.442408 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4706c849-c55c-4032-ba3a-7c4a4462514a admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:31.444456 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4706c849-c55c-4032-ba3a-7c4a4462514a admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:31.444456 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4706c849-c55c-4032-ba3a-7c4a4462514a admin admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:31.444456 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4706c849-c55c-4032-ba3a-7c4a4462514a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:29:31.444456 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4706c849-c55c-4032-ba3a-7c4a4462514a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:31.446475 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4706c849-c55c-4032-ba3a-7c4a4462514a admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:31.471992 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2436/4877] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:29:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:29:31.473044 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4706c849-c55c-4032-ba3a-7c4a4462514a admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:31.479237 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-4706c849-c55c-4032-ba3a-7c4a4462514a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:31.502019 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4706c849-c55c-4032-ba3a-7c4a4462514a admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:31.521268 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dca67c-b9e9-45aa-9fee-1b2ad7fab5ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:31.522768 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dca67c-b9e9-45aa-9fee-1b2ad7fab5ef service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:31.531247 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7376392-6ad7-449e-a04b-436d3b04c25c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:31.532998 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7376392-6ad7-449e-a04b-436d3b04c25c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:31.533357 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7376392-6ad7-449e-a04b-436d3b04c25c admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:31.533636 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7376392-6ad7-449e-a04b-436d3b04c25c admin admin] PATH_INFO: `/v3/users/10a1d0c21ab6437db19db76969979444` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:31.536261 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2442/4878] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:29:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:29:31.537852 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7376392-6ad7-449e-a04b-436d3b04c25c admin admin] RBAC: Authorizing `identity:delete_user(user_id=10a1d0c21ab6437db19db76969979444)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:31.541537 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7376392-6ad7-449e-a04b-436d3b04c25c admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:31.541695 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dca67c-b9e9-45aa-9fee-1b2ad7fab5ef service neutron] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:31.557804 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dca67c-b9e9-45aa-9fee-1b2ad7fab5ef service neutron] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:31.563588 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c02524-613c-4639-a8bf-2d558c3c4b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:31.564288 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c02524-613c-4639-a8bf-2d558c3c4b2f admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:31.564556 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c02524-613c-4639-a8bf-2d558c3c4b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:31.564823 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c02524-613c-4639-a8bf-2d558c3c4b2f admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:31.565605 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c02524-613c-4639-a8bf-2d558c3c4b2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:31.567590 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c02524-613c-4639-a8bf-2d558c3c4b2f admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:31.571509 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:29:31.616754 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2443/4879] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:29:31 2022] POST /identity/v3/projects => generated 393 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:29:31.618744 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c02524-613c-4639-a8bf-2d558c3c4b2f admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:31.649943 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-d7376392-6ad7-449e-a04b-436d3b04c25c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10a1d0c21ab6437db19db76969979444'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:31.664569 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-d7376392-6ad7-449e-a04b-436d3b04c25c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10a1d0c21ab6437db19db76969979444'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:31.666724 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-d7376392-6ad7-449e-a04b-436d3b04c25c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10a1d0c21ab6437db19db76969979444'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:31.685281 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-d7376392-6ad7-449e-a04b-436d3b04c25c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10a1d0c21ab6437db19db76969979444'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:31.710062 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-d7376392-6ad7-449e-a04b-436d3b04c25c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10a1d0c21ab6437db19db76969979444'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:31.718621 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2437/4880] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:29:31 2022] DELETE /identity/v3/users/10a1d0c21ab6437db19db76969979444 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:29:31.765412 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c02524-613c-4639-a8bf-2d558c3c4b2f admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:31.864314 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaf9f96-440c-4077-9ce8-520536600ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:31.865357 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaf9f96-440c-4077-9ce8-520536600ce5 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:31.866026 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaf9f96-440c-4077-9ce8-520536600ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:31.866512 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaf9f96-440c-4077-9ce8-520536600ce5 admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:31.867468 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaf9f96-440c-4077-9ce8-520536600ce5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:31.870450 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaf9f96-440c-4077-9ce8-520536600ce5 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:31.897930 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2444/4881] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:29:31 2022] POST /identity/v3/users => generated 297 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:29:31.901603 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7376392-6ad7-449e-a04b-436d3b04c25c admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:31.903526 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-d7376392-6ad7-449e-a04b-436d3b04c25c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:31.945899 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7376392-6ad7-449e-a04b-436d3b04c25c admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:31.952517 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49725472-ffb8-482d-af6c-d31c74aaf75d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:31.953337 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49725472-ffb8-482d-af6c-d31c74aaf75d admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:31.953768 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49725472-ffb8-482d-af6c-d31c74aaf75d admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:31.954274 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49725472-ffb8-482d-af6c-d31c74aaf75d admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:31.955113 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49725472-ffb8-482d-af6c-d31c74aaf75d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:31.960620 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49725472-ffb8-482d-af6c-d31c74aaf75d admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:31.985323 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2438/4882] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:29:31 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:29:31.989289 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaf9f96-440c-4077-9ce8-520536600ce5 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:32.020122 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaf9f96-440c-4077-9ce8-520536600ce5 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:32.031093 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3910326-3611-4819-b8bb-634702592993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:32.032477 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3910326-3611-4819-b8bb-634702592993 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:32.032980 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3910326-3611-4819-b8bb-634702592993 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:32.033512 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3910326-3611-4819-b8bb-634702592993 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:32.034512 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3910326-3611-4819-b8bb-634702592993 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:32.037390 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3910326-3611-4819-b8bb-634702592993 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:32.056832 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49725472-ffb8-482d-af6c-d31c74aaf75d admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:32.057034 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2445/4883] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:29:31 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:29:32.073152 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49725472-ffb8-482d-af6c-d31c74aaf75d admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:32.083315 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0901d5a-88d7-48c1-9888-83fa02c8b038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:32.086132 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0901d5a-88d7-48c1-9888-83fa02c8b038 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:32.086427 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0901d5a-88d7-48c1-9888-83fa02c8b038 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:32.088354 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0901d5a-88d7-48c1-9888-83fa02c8b038 admin admin] PATH_INFO: `/v3/projects/367436136ccc4e6ca0860bc24de14d61/users/8221fb61600c4282a0590117563082cd/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:32.134626 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0901d5a-88d7-48c1-9888-83fa02c8b038 admin admin] RBAC: Authorizing `identity:create_grant(project_id=367436136ccc4e6ca0860bc24de14d61, user_id=8221fb61600c4282a0590117563082cd, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:32.140503 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0901d5a-88d7-48c1-9888-83fa02c8b038 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:32.171521 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2439/4884] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:29:32 2022] PUT /identity/v3/projects/367436136ccc4e6ca0860bc24de14d61/users/8221fb61600c4282a0590117563082cd/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:29:32.184160 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bf195d-a897-41f4-940b-cf0caf95c64a None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:32.184415 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bf195d-a897-41f4-940b-cf0caf95c64a None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:32.184639 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bf195d-a897-41f4-940b-cf0caf95c64a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:32.251039 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-a1bf195d-a897-41f4-940b-cf0caf95c64a None None] MFA Rules not processed for user `8221fb61600c4282a0590117563082cd`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:29:32.252578 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-a1bf195d-a897-41f4-940b-cf0caf95c64a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:32.279658 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:29:32.404057 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2446/4885] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:29:32 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:29:32.419826 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065cc2d7-2b58-41b6-af37-2ff7d13ed194 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:32.420368 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065cc2d7-2b58-41b6-af37-2ff7d13ed194 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:32.420368 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065cc2d7-2b58-41b6-af37-2ff7d13ed194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:32.464768 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-065cc2d7-2b58-41b6-af37-2ff7d13ed194 None None] MFA Rules not processed for user `8221fb61600c4282a0590117563082cd`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:29:32.469013 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-065cc2d7-2b58-41b6-af37-2ff7d13ed194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:32.490050 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bf195d-a897-41f4-940b-cf0caf95c64a None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:32.491017 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2440/4886] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:29:32 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:29:32.491605 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-a1bf195d-a897-41f4-940b-cf0caf95c64a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:32.645404 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bf195d-a897-41f4-940b-cf0caf95c64a None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:32.666114 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc8327e-33dc-4741-990a-a4a4f9d5a5f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:32.667274 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc8327e-33dc-4741-990a-a4a4f9d5a5f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:32.667554 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc8327e-33dc-4741-990a-a4a4f9d5a5f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:32.667834 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc8327e-33dc-4741-990a-a4a4f9d5a5f6 admin admin] PATH_INFO: `/v3/projects/94f04d6184b2415a9dd9adccd55084fa` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:32.669424 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc8327e-33dc-4741-990a-a4a4f9d5a5f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=94f04d6184b2415a9dd9adccd55084fa)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:32.671522 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc8327e-33dc-4741-990a-a4a4f9d5a5f6 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:32.824914 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-0bc8327e-33dc-4741-990a-a4a4f9d5a5f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94f04d6184b2415a9dd9adccd55084fa', 'request_id': 'req-0bc8327e-33dc-4741-990a-a4a4f9d5a5f6'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:32.850612 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-0bc8327e-33dc-4741-990a-a4a4f9d5a5f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94f04d6184b2415a9dd9adccd55084fa', 'request_id': 'req-0bc8327e-33dc-4741-990a-a4a4f9d5a5f6'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:32.864341 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-0bc8327e-33dc-4741-990a-a4a4f9d5a5f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94f04d6184b2415a9dd9adccd55084fa', 'request_id': 'req-0bc8327e-33dc-4741-990a-a4a4f9d5a5f6'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:32.912190 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-0bc8327e-33dc-4741-990a-a4a4f9d5a5f6 admin admin] The token cache is being invalidate because project 94f04d6184b2415a9dd9adccd55084fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:29:32.912190 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-0bc8327e-33dc-4741-990a-a4a4f9d5a5f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:32.924979 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-0bc8327e-33dc-4741-990a-a4a4f9d5a5f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:32.927695 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2447/4887] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:29:32 2022] DELETE /identity/v3/projects/94f04d6184b2415a9dd9adccd55084fa => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:29:32.933977 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5122eb1f-c91b-4b26-b8a0-3ccc10fd9baa None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:32.934267 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5122eb1f-c91b-4b26-b8a0-3ccc10fd9baa None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:32.934611 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5122eb1f-c91b-4b26-b8a0-3ccc10fd9baa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:32.995945 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-5122eb1f-c91b-4b26-b8a0-3ccc10fd9baa None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:29:32.997623 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-5122eb1f-c91b-4b26-b8a0-3ccc10fd9baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:33.103433 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2441/4888] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:29:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:29:33.106651 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937cebcb-d15e-43a2-8184-1d1a1d6335d2 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:33.107253 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937cebcb-d15e-43a2-8184-1d1a1d6335d2 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:33.107705 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937cebcb-d15e-43a2-8184-1d1a1d6335d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:33.129829 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-937cebcb-d15e-43a2-8184-1d1a1d6335d2 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:29:33.131258 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-937cebcb-d15e-43a2-8184-1d1a1d6335d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:33.173601 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2448/4889] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:29:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:29:33.176672 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5122eb1f-c91b-4b26-b8a0-3ccc10fd9baa None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:33.193723 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5122eb1f-c91b-4b26-b8a0-3ccc10fd9baa None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:33.202605 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08e3eb7-e20d-486c-a97d-29983cab1618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:33.203886 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08e3eb7-e20d-486c-a97d-29983cab1618 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:33.204579 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08e3eb7-e20d-486c-a97d-29983cab1618 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:33.206423 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08e3eb7-e20d-486c-a97d-29983cab1618 admin admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:33.208415 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08e3eb7-e20d-486c-a97d-29983cab1618 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:29:33.210341 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08e3eb7-e20d-486c-a97d-29983cab1618 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:33.217670 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08e3eb7-e20d-486c-a97d-29983cab1618 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:33.250480 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2442/4890] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:29:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:29:33.252287 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937cebcb-d15e-43a2-8184-1d1a1d6335d2 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:33.266986 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937cebcb-d15e-43a2-8184-1d1a1d6335d2 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:33.278936 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08e3eb7-e20d-486c-a97d-29983cab1618 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:33.279896 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b50bab-e3dc-495b-b029-b10811de24f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:33.281706 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b50bab-e3dc-495b-b029-b10811de24f7 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:33.282048 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b50bab-e3dc-495b-b029-b10811de24f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:33.282324 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b50bab-e3dc-495b-b029-b10811de24f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:33.283074 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b50bab-e3dc-495b-b029-b10811de24f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:33.285475 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-d08e3eb7-e20d-486c-a97d-29983cab1618 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:33.286725 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b50bab-e3dc-495b-b029-b10811de24f7 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:33.299854 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08e3eb7-e20d-486c-a97d-29983cab1618 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:33.313439 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96465c3d-7acd-4bbd-809a-df57739607a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:33.314734 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96465c3d-7acd-4bbd-809a-df57739607a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:33.315306 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96465c3d-7acd-4bbd-809a-df57739607a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:33.315758 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96465c3d-7acd-4bbd-809a-df57739607a5 admin admin] PATH_INFO: `/v3/projects/4bc8472d82854533a6165a2fb9a2f0f0` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:33.317481 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96465c3d-7acd-4bbd-809a-df57739607a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4bc8472d82854533a6165a2fb9a2f0f0)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:33.321252 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96465c3d-7acd-4bbd-809a-df57739607a5 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:33.371681 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:29:33.374075 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2449/4891] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:29:33 2022] POST /identity/v3/projects => generated 379 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:29:33.386161 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b50bab-e3dc-495b-b029-b10811de24f7 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:33.414896 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-96465c3d-7acd-4bbd-809a-df57739607a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4bc8472d82854533a6165a2fb9a2f0f0', 'request_id': 'req-96465c3d-7acd-4bbd-809a-df57739607a5'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:33.444332 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:29:33.444805 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-96465c3d-7acd-4bbd-809a-df57739607a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4bc8472d82854533a6165a2fb9a2f0f0', 'request_id': 'req-96465c3d-7acd-4bbd-809a-df57739607a5'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:33.454513 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-96465c3d-7acd-4bbd-809a-df57739607a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4bc8472d82854533a6165a2fb9a2f0f0', 'request_id': 'req-96465c3d-7acd-4bbd-809a-df57739607a5'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:33.490682 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-96465c3d-7acd-4bbd-809a-df57739607a5 admin admin] The token cache is being invalidate because project 4bc8472d82854533a6165a2fb9a2f0f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:29:33.491294 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-96465c3d-7acd-4bbd-809a-df57739607a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:33.493082 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-96465c3d-7acd-4bbd-809a-df57739607a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:33.495315 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2443/4892] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:29:33 2022] DELETE /identity/v3/projects/4bc8472d82854533a6165a2fb9a2f0f0 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:29:33.500314 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffcc3f9-3995-4678-a826-f647e02b271e None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:33.502271 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffcc3f9-3995-4678-a826-f647e02b271e None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:33.502271 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffcc3f9-3995-4678-a826-f647e02b271e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:33.530075 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-bffcc3f9-3995-4678-a826-f647e02b271e None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:29:33.531812 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-bffcc3f9-3995-4678-a826-f647e02b271e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:33.582973 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b50bab-e3dc-495b-b029-b10811de24f7 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:33.595277 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f3c9b3-4e4b-45e4-bff6-5a126b904fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:33.596430 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f3c9b3-4e4b-45e4-bff6-5a126b904fa2 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:33.596877 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f3c9b3-4e4b-45e4-bff6-5a126b904fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:33.597313 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f3c9b3-4e4b-45e4-bff6-5a126b904fa2 admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:33.598281 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f3c9b3-4e4b-45e4-bff6-5a126b904fa2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:33.600873 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f3c9b3-4e4b-45e4-bff6-5a126b904fa2 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:33.656950 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2450/4893] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:29:33 2022] POST /identity/v3/users => generated 296 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:29:33.657979 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f3c9b3-4e4b-45e4-bff6-5a126b904fa2 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:33.662685 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-d0f3c9b3-4e4b-45e4-bff6-5a126b904fa2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:33.680156 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2444/4894] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:29:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:29:33.687592 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffcc3f9-3995-4678-a826-f647e02b271e None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:33.689472 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-bffcc3f9-3995-4678-a826-f647e02b271e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:33.691047 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f3c9b3-4e4b-45e4-bff6-5a126b904fa2 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:33.708929 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e96ede2-c37e-4cbd-8c89-8c16566b34bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:33.709647 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e96ede2-c37e-4cbd-8c89-8c16566b34bc admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:33.709975 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e96ede2-c37e-4cbd-8c89-8c16566b34bc admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:33.710362 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e96ede2-c37e-4cbd-8c89-8c16566b34bc admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:33.711118 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e96ede2-c37e-4cbd-8c89-8c16566b34bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:33.712757 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e96ede2-c37e-4cbd-8c89-8c16566b34bc admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:33.750749 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2451/4895] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:29:33 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:29:33.751664 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c0944f-5bf6-4308-9de3-dca8598a56db None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:33.752005 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c0944f-5bf6-4308-9de3-dca8598a56db None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:33.752287 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c0944f-5bf6-4308-9de3-dca8598a56db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:33.805618 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-91c0944f-5bf6-4308-9de3-dca8598a56db None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:29:33.806927 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-91c0944f-5bf6-4308-9de3-dca8598a56db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:33.846944 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2452/4896] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:29:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:29:33.848016 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c0944f-5bf6-4308-9de3-dca8598a56db None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:33.868308 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c0944f-5bf6-4308-9de3-dca8598a56db None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:33.879019 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffcc3f9-3995-4678-a826-f647e02b271e None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:33.885599 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f4127e-71d8-4996-9a75-538014fdb9d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:33.886340 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f4127e-71d8-4996-9a75-538014fdb9d2 service nova] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:33.886620 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f4127e-71d8-4996-9a75-538014fdb9d2 service nova] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:33.886994 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f4127e-71d8-4996-9a75-538014fdb9d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:33.887521 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa2f39d-2d3f-4783-8a84-36eaf4ec566d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:33.888572 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa2f39d-2d3f-4783-8a84-36eaf4ec566d admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:33.888937 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa2f39d-2d3f-4783-8a84-36eaf4ec566d admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:33.889323 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa2f39d-2d3f-4783-8a84-36eaf4ec566d admin admin] PATH_INFO: `/v3/projects/466733592d654baaa781832e25eb344f/users/16a1661274f840a5bbe98699b892f1cf/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:33.890351 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-a8f4127e-71d8-4996-9a75-538014fdb9d2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:33.929591 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa2f39d-2d3f-4783-8a84-36eaf4ec566d admin admin] RBAC: Authorizing `identity:create_grant(project_id=466733592d654baaa781832e25eb344f, user_id=16a1661274f840a5bbe98699b892f1cf, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:33.932341 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa2f39d-2d3f-4783-8a84-36eaf4ec566d admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:33.963492 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2453/4897] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:29:33 2022] PUT /identity/v3/projects/466733592d654baaa781832e25eb344f/users/16a1661274f840a5bbe98699b892f1cf/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:29:33.964389 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa2f39d-2d3f-4783-8a84-36eaf4ec566d admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:34.003980 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:29:34.010157 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f4127e-71d8-4996-9a75-538014fdb9d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:34.012248 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f4127e-71d8-4996-9a75-538014fdb9d2 service nova] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:34.041530 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2445/4898] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:29:33 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:29:34.042485 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f4127e-71d8-4996-9a75-538014fdb9d2 service nova] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:34.058507 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f4127e-71d8-4996-9a75-538014fdb9d2 service nova] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:34.137223 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e4cb9d-e2bc-46e3-9e74-c24cae36ba8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:34.137995 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e4cb9d-e2bc-46e3-9e74-c24cae36ba8c admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:34.138408 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e4cb9d-e2bc-46e3-9e74-c24cae36ba8c admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:34.138689 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e4cb9d-e2bc-46e3-9e74-c24cae36ba8c admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:34.140217 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e4cb9d-e2bc-46e3-9e74-c24cae36ba8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:34.142284 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e4cb9d-e2bc-46e3-9e74-c24cae36ba8c admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:34.157934 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2446/4899] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:29:34 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:29:34.160562 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa2f39d-2d3f-4783-8a84-36eaf4ec566d admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:34.161645 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4a380e-4eda-4189-b5cb-abf6687a66d9 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:34.161962 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4a380e-4eda-4189-b5cb-abf6687a66d9 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:34.162244 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4a380e-4eda-4189-b5cb-abf6687a66d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:34.179010 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecd81e9-d63d-45bd-a405-1614e93c6aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:34.179693 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecd81e9-d63d-45bd-a405-1614e93c6aea admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:34.179977 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecd81e9-d63d-45bd-a405-1614e93c6aea admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:34.180248 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecd81e9-d63d-45bd-a405-1614e93c6aea admin admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:34.180983 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecd81e9-d63d-45bd-a405-1614e93c6aea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:29:34.181336 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecd81e9-d63d-45bd-a405-1614e93c6aea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:34.188248 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecd81e9-d63d-45bd-a405-1614e93c6aea admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:34.198465 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-df4a380e-4eda-4189-b5cb-abf6687a66d9 None None] MFA Rules not processed for user `8221fb61600c4282a0590117563082cd`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:29:34.199675 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-df4a380e-4eda-4189-b5cb-abf6687a66d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:34.222403 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2454/4900] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:29:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:29:34.223250 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecd81e9-d63d-45bd-a405-1614e93c6aea admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:34.247986 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecd81e9-d63d-45bd-a405-1614e93c6aea admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:34.266429 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2e059b-328d-4c2c-8d3e-47d286ab1e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:34.267510 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2e059b-328d-4c2c-8d3e-47d286ab1e28 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:34.267794 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2e059b-328d-4c2c-8d3e-47d286ab1e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:34.268110 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2e059b-328d-4c2c-8d3e-47d286ab1e28 admin admin] PATH_INFO: `/v3/projects/466733592d654baaa781832e25eb344f/users/16a1661274f840a5bbe98699b892f1cf/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:34.284573 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2e059b-328d-4c2c-8d3e-47d286ab1e28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=466733592d654baaa781832e25eb344f, user_id=16a1661274f840a5bbe98699b892f1cf, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:34.287338 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2e059b-328d-4c2c-8d3e-47d286ab1e28 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:34.308753 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2447/4901] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:29:34 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:29:34.308753 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4a380e-4eda-4189-b5cb-abf6687a66d9 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:34.320734 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2455/4902] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:29:34 2022] PUT /identity/v3/projects/466733592d654baaa781832e25eb344f/users/16a1661274f840a5bbe98699b892f1cf/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:29:34.327535 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4a380e-4eda-4189-b5cb-abf6687a66d9 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:34.333504 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db45af34-4203-4f90-a343-afc7af764d93 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:34.333792 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db45af34-4203-4f90-a343-afc7af764d93 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:34.334089 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db45af34-4203-4f90-a343-afc7af764d93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:34.392906 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-db45af34-4203-4f90-a343-afc7af764d93 None None] MFA Rules not processed for user `16a1661274f840a5bbe98699b892f1cf`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:29:34.396721 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-db45af34-4203-4f90-a343-afc7af764d93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:34.466310 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:29:34.472645 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ad27a9-1894-43bc-9201-2ce300843e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:34.473429 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ad27a9-1894-43bc-9201-2ce300843e25 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:34.473840 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ad27a9-1894-43bc-9201-2ce300843e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:34.474313 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ad27a9-1894-43bc-9201-2ce300843e25 admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:34.476356 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ad27a9-1894-43bc-9201-2ce300843e25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:34.478598 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ad27a9-1894-43bc-9201-2ce300843e25 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:34.548082 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2456/4903] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:29:34 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:29:34.550288 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2448/4904] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:29:34 2022] POST /identity/v3/projects => generated 385 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:29:34.556868 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db45af34-4203-4f90-a343-afc7af764d93 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:34.557960 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ad27a9-1894-43bc-9201-2ce300843e25 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:34.571572 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db45af34-4203-4f90-a343-afc7af764d93 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:34.638969 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:29:34.721343 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ad27a9-1894-43bc-9201-2ce300843e25 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:34.724936 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd39e171-a503-4be6-b093-a21250ac6a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:34.725591 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd39e171-a503-4be6-b093-a21250ac6a7f admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:34.725838 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd39e171-a503-4be6-b093-a21250ac6a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:34.726127 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd39e171-a503-4be6-b093-a21250ac6a7f admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:34.726946 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd39e171-a503-4be6-b093-a21250ac6a7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:34.730485 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd39e171-a503-4be6-b093-a21250ac6a7f admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:34.741585 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41433123-5f34-498b-be21-1f2d7212fb8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:34.744374 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41433123-5f34-498b-be21-1f2d7212fb8a admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:34.745633 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41433123-5f34-498b-be21-1f2d7212fb8a admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:34.746172 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41433123-5f34-498b-be21-1f2d7212fb8a admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:34.747224 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41433123-5f34-498b-be21-1f2d7212fb8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:34.753801 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41433123-5f34-498b-be21-1f2d7212fb8a admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:34.809638 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2457/4905] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:29:34 2022] POST /identity/v3/projects => generated 381 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:29:34.810800 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2449/4906] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:29:34 2022] POST /identity/v3/users => generated 293 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:29:34.832466 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41433123-5f34-498b-be21-1f2d7212fb8a admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:34.841591 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd39e171-a503-4be6-b093-a21250ac6a7f admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:34.846833 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41433123-5f34-498b-be21-1f2d7212fb8a admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:35.005264 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd39e171-a503-4be6-b093-a21250ac6a7f admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:35.021719 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3c4c57-2b3c-4d33-bf4e-a38c39c9346f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:35.022501 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3c4c57-2b3c-4d33-bf4e-a38c39c9346f admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:35.022776 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3c4c57-2b3c-4d33-bf4e-a38c39c9346f admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:35.030936 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3c4c57-2b3c-4d33-bf4e-a38c39c9346f admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:35.036488 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3c4c57-2b3c-4d33-bf4e-a38c39c9346f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:35.040063 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3c4c57-2b3c-4d33-bf4e-a38c39c9346f admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:35.047074 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74de6168-483d-4a58-afb0-c53e4009ffa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:35.047858 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74de6168-483d-4a58-afb0-c53e4009ffa3 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:35.048140 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74de6168-483d-4a58-afb0-c53e4009ffa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:35.048417 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74de6168-483d-4a58-afb0-c53e4009ffa3 admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:35.049118 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74de6168-483d-4a58-afb0-c53e4009ffa3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:35.057770 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74de6168-483d-4a58-afb0-c53e4009ffa3 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:35.066638 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2450/4907] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:29:34 2022] GET /identity/v3/roles => generated 1420 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:29:35.070532 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3c4c57-2b3c-4d33-bf4e-a38c39c9346f admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:35.090813 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3c4c57-2b3c-4d33-bf4e-a38c39c9346f admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:35.096986 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478485d2-5f96-4ad8-9d79-1e668baf7265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:35.097682 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478485d2-5f96-4ad8-9d79-1e668baf7265 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:35.098009 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478485d2-5f96-4ad8-9d79-1e668baf7265 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:35.098441 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478485d2-5f96-4ad8-9d79-1e668baf7265 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:35.099005 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478485d2-5f96-4ad8-9d79-1e668baf7265 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:35.100640 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478485d2-5f96-4ad8-9d79-1e668baf7265 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:35.126261 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2451/4908] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:29:35 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 21:29:35.128420 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478485d2-5f96-4ad8-9d79-1e668baf7265 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:35.132133 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2458/4909] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:29:34 2022] POST /identity/v3/users => generated 291 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:29:35.133155 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74de6168-483d-4a58-afb0-c53e4009ffa3 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:35.170831 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478485d2-5f96-4ad8-9d79-1e668baf7265 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:35.182629 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411fed54-d49a-4a4b-91bf-6c3a5f04add3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:35.183596 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411fed54-d49a-4a4b-91bf-6c3a5f04add3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:35.183898 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411fed54-d49a-4a4b-91bf-6c3a5f04add3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:35.184164 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411fed54-d49a-4a4b-91bf-6c3a5f04add3 admin admin] PATH_INFO: `/v3/projects/c2739a3cc1c44f03b91d41cb88c72333/users/3a5cbc905ada46cb90904942f1cea740/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:35.186384 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74de6168-483d-4a58-afb0-c53e4009ffa3 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:35.209028 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0b0325-5ca4-4efa-a31e-9718224fe91c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:35.211464 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0b0325-5ca4-4efa-a31e-9718224fe91c admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:35.212406 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0b0325-5ca4-4efa-a31e-9718224fe91c admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:35.212798 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0b0325-5ca4-4efa-a31e-9718224fe91c admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:35.213703 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0b0325-5ca4-4efa-a31e-9718224fe91c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:35.221776 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0b0325-5ca4-4efa-a31e-9718224fe91c admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:35.239143 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411fed54-d49a-4a4b-91bf-6c3a5f04add3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2739a3cc1c44f03b91d41cb88c72333, user_id=3a5cbc905ada46cb90904942f1cea740, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:35.246413 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2459/4910] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:29:35 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:29:35.248762 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60430ecc-6352-4523-a39c-df8702166cf4 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:35.249342 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60430ecc-6352-4523-a39c-df8702166cf4 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:35.249910 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60430ecc-6352-4523-a39c-df8702166cf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:35.251968 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411fed54-d49a-4a4b-91bf-6c3a5f04add3 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:35.276529 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-60430ecc-6352-4523-a39c-df8702166cf4 None None] MFA Rules not processed for user `8221fb61600c4282a0590117563082cd`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:29:35.278743 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-60430ecc-6352-4523-a39c-df8702166cf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:35.307006 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2452/4911] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:29:35 2022] PUT /identity/v3/projects/c2739a3cc1c44f03b91d41cb88c72333/users/3a5cbc905ada46cb90904942f1cea740/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:29:35.307006 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411fed54-d49a-4a4b-91bf-6c3a5f04add3 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:35.355658 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:29:35.418231 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2460/4912] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:29:35 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:29:35.426226 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5437cedd-0f92-4135-a796-649f5f25103e None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:35.426536 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5437cedd-0f92-4135-a796-649f5f25103e None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:35.426824 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5437cedd-0f92-4135-a796-649f5f25103e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:35.462299 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411fed54-d49a-4a4b-91bf-6c3a5f04add3 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:35.477677 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb133310-2eb3-454d-a349-f06426811151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:35.478402 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb133310-2eb3-454d-a349-f06426811151 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:35.478753 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb133310-2eb3-454d-a349-f06426811151 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:35.479016 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb133310-2eb3-454d-a349-f06426811151 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:35.479754 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb133310-2eb3-454d-a349-f06426811151 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:35.481388 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb133310-2eb3-454d-a349-f06426811151 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:35.489067 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-5437cedd-0f92-4135-a796-649f5f25103e None None] MFA Rules not processed for user `3a5cbc905ada46cb90904942f1cea740`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:29:35.491302 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-5437cedd-0f92-4135-a796-649f5f25103e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:35.493082 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2453/4913] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:29:35 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:29:35.497486 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb133310-2eb3-454d-a349-f06426811151 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:35.515681 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb133310-2eb3-454d-a349-f06426811151 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:35.524570 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058ee528-16ae-4724-948e-44cc080d16b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:35.525946 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058ee528-16ae-4724-948e-44cc080d16b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:35.526483 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058ee528-16ae-4724-948e-44cc080d16b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:35.526876 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058ee528-16ae-4724-948e-44cc080d16b2 admin admin] PATH_INFO: `/v3/projects/97271e0b700b40caae256a7166a626a7/users/a3272ba9e72f4111a6982f24be1e2e81/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:35.531925 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:29:35.555904 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058ee528-16ae-4724-948e-44cc080d16b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97271e0b700b40caae256a7166a626a7, user_id=a3272ba9e72f4111a6982f24be1e2e81, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:35.562612 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058ee528-16ae-4724-948e-44cc080d16b2 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:35.588484 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2454/4914] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:29:35 2022] PUT /identity/v3/projects/97271e0b700b40caae256a7166a626a7/users/a3272ba9e72f4111a6982f24be1e2e81/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:29:35.599308 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9294eb85-0160-4813-847d-40aeaef9b332 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:35.599949 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9294eb85-0160-4813-847d-40aeaef9b332 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:35.600457 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9294eb85-0160-4813-847d-40aeaef9b332 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:35.616055 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2461/4915] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:29:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:29:35.623085 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5437cedd-0f92-4135-a796-649f5f25103e None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:35.638033 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5437cedd-0f92-4135-a796-649f5f25103e None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:35.641201 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-9294eb85-0160-4813-847d-40aeaef9b332 None None] MFA Rules not processed for user `a3272ba9e72f4111a6982f24be1e2e81`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:29:35.642870 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-9294eb85-0160-4813-847d-40aeaef9b332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:35.805820 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9709e136-c1e5-4c9f-96da-fc7ab0102c18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:35.806585 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9709e136-c1e5-4c9f-96da-fc7ab0102c18 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:35.806871 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9709e136-c1e5-4c9f-96da-fc7ab0102c18 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:35.807191 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9709e136-c1e5-4c9f-96da-fc7ab0102c18 admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:35.807905 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9709e136-c1e5-4c9f-96da-fc7ab0102c18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:35.812103 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9709e136-c1e5-4c9f-96da-fc7ab0102c18 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:35.873010 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2455/4916] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:29:35 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:29:35.888486 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9294eb85-0160-4813-847d-40aeaef9b332 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:35.891502 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-9294eb85-0160-4813-847d-40aeaef9b332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:35.906267 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2462/4917] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:29:35 2022] POST /identity/v3/projects => generated 385 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:29:35.908075 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9709e136-c1e5-4c9f-96da-fc7ab0102c18 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:36.033919 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9294eb85-0160-4813-847d-40aeaef9b332 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:36.050588 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:29:36.068207 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9709e136-c1e5-4c9f-96da-fc7ab0102c18 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:36.085012 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c099538c-159c-4b46-b31a-71b0fc3e8b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:36.085012 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c099538c-159c-4b46-b31a-71b0fc3e8b94 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:36.085012 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c099538c-159c-4b46-b31a-71b0fc3e8b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:36.086013 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c099538c-159c-4b46-b31a-71b0fc3e8b94 admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:36.086966 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c099538c-159c-4b46-b31a-71b0fc3e8b94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:36.089610 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c099538c-159c-4b46-b31a-71b0fc3e8b94 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:36.144500 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2463/4918] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:29:35 2022] POST /identity/v3/users => generated 299 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:29:36.144500 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5bcce9-6009-4981-be0a-78e0a923b5c7 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:36.144500 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5bcce9-6009-4981-be0a-78e0a923b5c7 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:36.144500 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5bcce9-6009-4981-be0a-78e0a923b5c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:36.146151 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a27f291-fd3f-42fe-b3da-2cd1e80d20f5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7f2db148c8e4d5d81431cae3576434b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:36.147193 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a27f291-fd3f-42fe-b3da-2cd1e80d20f5 service glance] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:36.147835 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a27f291-fd3f-42fe-b3da-2cd1e80d20f5 service glance] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:36.148280 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a27f291-fd3f-42fe-b3da-2cd1e80d20f5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:36.183635 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-8e5bcce9-6009-4981-be0a-78e0a923b5c7 None None] MFA Rules not processed for user `8221fb61600c4282a0590117563082cd`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:29:36.191682 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-8e5bcce9-6009-4981-be0a-78e0a923b5c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:36.219026 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:29:36.245952 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a27f291-fd3f-42fe-b3da-2cd1e80d20f5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:36.253351 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a27f291-fd3f-42fe-b3da-2cd1e80d20f5 service glance] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:36.270543 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2456/4919] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:29:35 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:29:36.271665 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a27f291-fd3f-42fe-b3da-2cd1e80d20f5 service glance] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:36.295410 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a27f291-fd3f-42fe-b3da-2cd1e80d20f5 service glance] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:36.297038 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2464/4920] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:29:36 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:29:36.303807 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91278b03-dfa1-4a80-b643-26741cb1702e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:36.304452 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91278b03-dfa1-4a80-b643-26741cb1702e admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:36.304783 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91278b03-dfa1-4a80-b643-26741cb1702e admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:36.305061 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91278b03-dfa1-4a80-b643-26741cb1702e admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:36.305797 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91278b03-dfa1-4a80-b643-26741cb1702e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:36.307738 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91278b03-dfa1-4a80-b643-26741cb1702e admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:36.328072 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5bcce9-6009-4981-be0a-78e0a923b5c7 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:36.328395 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2457/4921] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:29:36 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:29:36.348109 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5bcce9-6009-4981-be0a-78e0a923b5c7 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:36.359165 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971ba470-03a6-446b-9183-bb64d040f48d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:36.359165 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971ba470-03a6-446b-9183-bb64d040f48d admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:36.359165 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971ba470-03a6-446b-9183-bb64d040f48d admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:36.359165 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971ba470-03a6-446b-9183-bb64d040f48d admin admin] PATH_INFO: `/v3/projects/bbfbd4b3959a4f00807ab63d3c33c078/users/cc3e9b84a602480aaa001fd6ded11005/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:36.375502 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e205ed08-dce4-4054-9efe-fa6305639704 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:36.375792 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e205ed08-dce4-4054-9efe-fa6305639704 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:36.376116 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e205ed08-dce4-4054-9efe-fa6305639704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:36.405829 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971ba470-03a6-446b-9183-bb64d040f48d admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbfbd4b3959a4f00807ab63d3c33c078, user_id=cc3e9b84a602480aaa001fd6ded11005, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:36.410157 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971ba470-03a6-446b-9183-bb64d040f48d admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:36.423767 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-e205ed08-dce4-4054-9efe-fa6305639704 None None] MFA Rules not processed for user `8221fb61600c4282a0590117563082cd`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:29:36.426500 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-e205ed08-dce4-4054-9efe-fa6305639704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:36.443254 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2458/4922] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:29:36 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:29:36.451410 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2465/4923] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:29:36 2022] PUT /identity/v3/projects/bbfbd4b3959a4f00807ab63d3c33c078/users/cc3e9b84a602480aaa001fd6ded11005/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:29:36.452529 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e205ed08-dce4-4054-9efe-fa6305639704 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:36.474861 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e205ed08-dce4-4054-9efe-fa6305639704 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:36.515660 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971ba470-03a6-446b-9183-bb64d040f48d admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:36.515660 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-971ba470-03a6-446b-9183-bb64d040f48d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:36.607702 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8583152-c647-482f-90d8-5ab467a1aa2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:36.609316 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8583152-c647-482f-90d8-5ab467a1aa2c admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:36.609316 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8583152-c647-482f-90d8-5ab467a1aa2c admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:36.609316 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8583152-c647-482f-90d8-5ab467a1aa2c admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:36.612315 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8583152-c647-482f-90d8-5ab467a1aa2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:36.614005 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8583152-c647-482f-90d8-5ab467a1aa2c admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:36.635154 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2459/4924] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:29:36 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:29:36.644236 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8583152-c647-482f-90d8-5ab467a1aa2c admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:36.670702 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8583152-c647-482f-90d8-5ab467a1aa2c admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:36.682356 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7632473-9f58-4ed4-bb27-943ed9fda459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:36.685054 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7632473-9f58-4ed4-bb27-943ed9fda459 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:36.685962 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7632473-9f58-4ed4-bb27-943ed9fda459 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:36.687406 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7632473-9f58-4ed4-bb27-943ed9fda459 admin admin] PATH_INFO: `/v3/projects/bbfbd4b3959a4f00807ab63d3c33c078/users/cc3e9b84a602480aaa001fd6ded11005/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:36.688553 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971ba470-03a6-446b-9183-bb64d040f48d admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:36.692256 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7632473-9f58-4ed4-bb27-943ed9fda459 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbfbd4b3959a4f00807ab63d3c33c078, user_id=cc3e9b84a602480aaa001fd6ded11005, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:36.694949 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b521211-9c8c-40bb-b4cb-7510a598f594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:36.696160 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b521211-9c8c-40bb-b4cb-7510a598f594 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:36.696689 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b521211-9c8c-40bb-b4cb-7510a598f594 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:36.698402 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b521211-9c8c-40bb-b4cb-7510a598f594 admin admin] PATH_INFO: `/v3/users/8221fb61600c4282a0590117563082cd` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:36.699834 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7632473-9f58-4ed4-bb27-943ed9fda459 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:36.700178 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b521211-9c8c-40bb-b4cb-7510a598f594 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8221fb61600c4282a0590117563082cd)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:36.722211 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b521211-9c8c-40bb-b4cb-7510a598f594 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:36.731365 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2460/4925] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:29:36 2022] PUT /identity/v3/projects/bbfbd4b3959a4f00807ab63d3c33c078/users/cc3e9b84a602480aaa001fd6ded11005/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:29:36.852005 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d65bf4-fc91-4cd2-8ae7-6fc6ab53d3b5 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:36.852287 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d65bf4-fc91-4cd2-8ae7-6fc6ab53d3b5 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:36.852566 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d65bf4-fc91-4cd2-8ae7-6fc6ab53d3b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:36.887712 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-f7d65bf4-fc91-4cd2-8ae7-6fc6ab53d3b5 None None] MFA Rules not processed for user `cc3e9b84a602480aaa001fd6ded11005`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:29:36.889030 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-f7d65bf4-fc91-4cd2-8ae7-6fc6ab53d3b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:36.962299 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-4b521211-9c8c-40bb-b4cb-7510a598f594 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8221fb61600c4282a0590117563082cd'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:36.964475 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-4b521211-9c8c-40bb-b4cb-7510a598f594 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8221fb61600c4282a0590117563082cd'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:36.976801 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2461/4926] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:29:36 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:29:36.988833 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d65bf4-fc91-4cd2-8ae7-6fc6ab53d3b5 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:36.991214 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-f7d65bf4-fc91-4cd2-8ae7-6fc6ab53d3b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:36.997446 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-4b521211-9c8c-40bb-b4cb-7510a598f594 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8221fb61600c4282a0590117563082cd'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:37.027517 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-4b521211-9c8c-40bb-b4cb-7510a598f594 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8221fb61600c4282a0590117563082cd'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:37.031937 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=87,keystone:INSERT=5,keystone:DELETE=8 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:29:37.079827 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-4b521211-9c8c-40bb-b4cb-7510a598f594 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8221fb61600c4282a0590117563082cd'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:37.082849 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:29:37.096242 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2466/4927] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:29:36 2022] DELETE /identity/v3/users/8221fb61600c4282a0590117563082cd => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:29:37.101100 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46bb78f-ae33-4397-9b1d-98e800302cd8 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:37.101800 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46bb78f-ae33-4397-9b1d-98e800302cd8 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:37.102757 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46bb78f-ae33-4397-9b1d-98e800302cd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:37.180371 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-d46bb78f-ae33-4397-9b1d-98e800302cd8 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:29:37.184097 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-d46bb78f-ae33-4397-9b1d-98e800302cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:37.193155 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d65bf4-fc91-4cd2-8ae7-6fc6ab53d3b5 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:37.268151 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5950f010-547e-4fea-8de7-fc3bffd7dc88 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec5fd3a489c341b7964704d689037f05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:37.268975 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5950f010-547e-4fea-8de7-fc3bffd7dc88 service cinder] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:37.269260 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5950f010-547e-4fea-8de7-fc3bffd7dc88 service cinder] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:37.269550 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5950f010-547e-4fea-8de7-fc3bffd7dc88 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:37.272724 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-5950f010-547e-4fea-8de7-fc3bffd7dc88 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:37.302070 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2467/4928] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:29:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:29:37.331496 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46bb78f-ae33-4397-9b1d-98e800302cd8 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:37.333731 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-d46bb78f-ae33-4397-9b1d-98e800302cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:37.410544 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5950f010-547e-4fea-8de7-fc3bffd7dc88 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:37.413745 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5950f010-547e-4fea-8de7-fc3bffd7dc88 service cinder] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:37.459621 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2462/4929] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:29:36 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 23 21:29:37.478605 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46bb78f-ae33-4397-9b1d-98e800302cd8 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:37.490520 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4587ec76-1c2b-4409-84dd-f403b9709d84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:37.491366 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4587ec76-1c2b-4409-84dd-f403b9709d84 service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:37.491642 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4587ec76-1c2b-4409-84dd-f403b9709d84 service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:37.492033 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4587ec76-1c2b-4409-84dd-f403b9709d84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:37.524167 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4587ec76-1c2b-4409-84dd-f403b9709d84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:37.530787 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4587ec76-1c2b-4409-84dd-f403b9709d84 service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:37.553750 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2468/4930] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:29:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 23 21:29:37.615972 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5950f010-547e-4fea-8de7-fc3bffd7dc88 service cinder] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:37.617240 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-5950f010-547e-4fea-8de7-fc3bffd7dc88 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:37.644161 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5950f010-547e-4fea-8de7-fc3bffd7dc88 service cinder] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:37.656034 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeb2335-8c46-44e3-a5b1-515a0bd74008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:37.656916 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeb2335-8c46-44e3-a5b1-515a0bd74008 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:37.656916 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeb2335-8c46-44e3-a5b1-515a0bd74008 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:37.657280 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeb2335-8c46-44e3-a5b1-515a0bd74008 admin admin] PATH_INFO: `/v3/users/16a1661274f840a5bbe98699b892f1cf` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:37.658238 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeb2335-8c46-44e3-a5b1-515a0bd74008 admin admin] RBAC: Authorizing `identity:delete_user(user_id=16a1661274f840a5bbe98699b892f1cf)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:37.660193 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeb2335-8c46-44e3-a5b1-515a0bd74008 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:37.767179 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-afeb2335-8c46-44e3-a5b1-515a0bd74008 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16a1661274f840a5bbe98699b892f1cf'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:37.787647 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-afeb2335-8c46-44e3-a5b1-515a0bd74008 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16a1661274f840a5bbe98699b892f1cf'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:37.788572 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-afeb2335-8c46-44e3-a5b1-515a0bd74008 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16a1661274f840a5bbe98699b892f1cf'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:37.815110 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-afeb2335-8c46-44e3-a5b1-515a0bd74008 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16a1661274f840a5bbe98699b892f1cf'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:37.836555 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-afeb2335-8c46-44e3-a5b1-515a0bd74008 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16a1661274f840a5bbe98699b892f1cf'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:37.850858 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2463/4931] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:29:37 2022] DELETE /identity/v3/users/16a1661274f840a5bbe98699b892f1cf => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:29:37.852732 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482ec9b2-3683-47f3-9afe-a432ba10fd7e None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:37.853269 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482ec9b2-3683-47f3-9afe-a432ba10fd7e None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:37.853912 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482ec9b2-3683-47f3-9afe-a432ba10fd7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:37.876169 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-482ec9b2-3683-47f3-9afe-a432ba10fd7e None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:29:37.877544 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-482ec9b2-3683-47f3-9afe-a432ba10fd7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:37.993104 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2469/4932] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:29:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:29:38.012857 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeb2335-8c46-44e3-a5b1-515a0bd74008 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:38.014782 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-afeb2335-8c46-44e3-a5b1-515a0bd74008 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:38.042574 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:29:38.145491 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeb2335-8c46-44e3-a5b1-515a0bd74008 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:38.149523 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80dc383-75fd-4077-b94e-2c9a874b429a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:38.150168 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80dc383-75fd-4077-b94e-2c9a874b429a service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:38.152210 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80dc383-75fd-4077-b94e-2c9a874b429a service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:38.152835 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80dc383-75fd-4077-b94e-2c9a874b429a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:38.168551 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80dc383-75fd-4077-b94e-2c9a874b429a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:38.168551 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80dc383-75fd-4077-b94e-2c9a874b429a service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:38.183346 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2464/4933] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:29:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:29:38.652349 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482ec9b2-3683-47f3-9afe-a432ba10fd7e None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:38.655598 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-482ec9b2-3683-47f3-9afe-a432ba10fd7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:38.676124 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482ec9b2-3683-47f3-9afe-a432ba10fd7e None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:38.686436 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cb7454-a304-4cae-8418-345df1eef102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:38.687709 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cb7454-a304-4cae-8418-345df1eef102 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:38.689294 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cb7454-a304-4cae-8418-345df1eef102 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:38.689743 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cb7454-a304-4cae-8418-345df1eef102 admin admin] PATH_INFO: `/v3/users/3a5cbc905ada46cb90904942f1cea740` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:38.691425 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cb7454-a304-4cae-8418-345df1eef102 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a5cbc905ada46cb90904942f1cea740)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:38.694315 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cb7454-a304-4cae-8418-345df1eef102 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:38.696263 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80dc383-75fd-4077-b94e-2c9a874b429a service neutron] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:38.699819 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-c80dc383-75fd-4077-b94e-2c9a874b429a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:38.719943 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80dc383-75fd-4077-b94e-2c9a874b429a service neutron] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:38.737746 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4330e0-e82f-42c0-899b-364aa9de26a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:38.739720 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4330e0-e82f-42c0-899b-364aa9de26a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:38.741615 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4330e0-e82f-42c0-899b-364aa9de26a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:38.743674 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4330e0-e82f-42c0-899b-364aa9de26a8 admin admin] PATH_INFO: `/v3/projects/367436136ccc4e6ca0860bc24de14d61` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:38.745500 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4330e0-e82f-42c0-899b-364aa9de26a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=367436136ccc4e6ca0860bc24de14d61)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:38.747854 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4330e0-e82f-42c0-899b-364aa9de26a8 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:38.763741 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:29:38.854786 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-91cb7454-a304-4cae-8418-345df1eef102 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a5cbc905ada46cb90904942f1cea740'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:38.855804 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-8c4330e0-e82f-42c0-899b-364aa9de26a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '367436136ccc4e6ca0860bc24de14d61', 'request_id': 'req-8c4330e0-e82f-42c0-899b-364aa9de26a8'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:38.855939 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-91cb7454-a304-4cae-8418-345df1eef102 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a5cbc905ada46cb90904942f1cea740'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:38.870452 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-91cb7454-a304-4cae-8418-345df1eef102 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a5cbc905ada46cb90904942f1cea740'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:38.871524 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-8c4330e0-e82f-42c0-899b-364aa9de26a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '367436136ccc4e6ca0860bc24de14d61', 'request_id': 'req-8c4330e0-e82f-42c0-899b-364aa9de26a8'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:38.885835 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-91cb7454-a304-4cae-8418-345df1eef102 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a5cbc905ada46cb90904942f1cea740'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:38.887515 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-8c4330e0-e82f-42c0-899b-364aa9de26a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '367436136ccc4e6ca0860bc24de14d61', 'request_id': 'req-8c4330e0-e82f-42c0-899b-364aa9de26a8'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:38.908450 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-8c4330e0-e82f-42c0-899b-364aa9de26a8 admin admin] The token cache is being invalidate because project 367436136ccc4e6ca0860bc24de14d61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:29:38.908897 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-8c4330e0-e82f-42c0-899b-364aa9de26a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:38.909944 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-8c4330e0-e82f-42c0-899b-364aa9de26a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:38.912131 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2465/4934] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:29:38 2022] DELETE /identity/v3/projects/367436136ccc4e6ca0860bc24de14d61 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:29:38.913591 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-91cb7454-a304-4cae-8418-345df1eef102 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a5cbc905ada46cb90904942f1cea740'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:38.919512 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49aa401-7032-49af-ba66-96b6bba9603f None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:38.919854 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49aa401-7032-49af-ba66-96b6bba9603f None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:38.920287 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49aa401-7032-49af-ba66-96b6bba9603f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:38.923659 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2470/4935] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:29:38 2022] DELETE /identity/v3/users/3a5cbc905ada46cb90904942f1cea740 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:29:38.928203 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4add3c39-4ba9-4ce6-8eb0-bd8ae1976fee None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:38.929072 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4add3c39-4ba9-4ce6-8eb0-bd8ae1976fee None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:38.929511 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4add3c39-4ba9-4ce6-8eb0-bd8ae1976fee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:38.970596 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-a49aa401-7032-49af-ba66-96b6bba9603f None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:29:38.973073 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-a49aa401-7032-49af-ba66-96b6bba9603f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:38.974704 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-4add3c39-4ba9-4ce6-8eb0-bd8ae1976fee None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:29:38.978234 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-4add3c39-4ba9-4ce6-8eb0-bd8ae1976fee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:39.118947 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2471/4936] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:29:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:29:39.121731 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4add3c39-4ba9-4ce6-8eb0-bd8ae1976fee None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:39.127825 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-4add3c39-4ba9-4ce6-8eb0-bd8ae1976fee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:39.145711 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2466/4937] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:29:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:29:39.147212 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49aa401-7032-49af-ba66-96b6bba9603f None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:39.150693 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-a49aa401-7032-49af-ba66-96b6bba9603f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:39.173888 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4add3c39-4ba9-4ce6-8eb0-bd8ae1976fee None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:39.178595 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a561f9-5a8f-4d51-9cce-c1ea16aecd0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:39.179644 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a561f9-5a8f-4d51-9cce-c1ea16aecd0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:39.179927 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a561f9-5a8f-4d51-9cce-c1ea16aecd0e admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:39.180200 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a561f9-5a8f-4d51-9cce-c1ea16aecd0e admin admin] PATH_INFO: `/v3/projects/466733592d654baaa781832e25eb344f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:39.181479 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a561f9-5a8f-4d51-9cce-c1ea16aecd0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=466733592d654baaa781832e25eb344f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:39.184015 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a561f9-5a8f-4d51-9cce-c1ea16aecd0e admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:39.259055 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:29:39.275821 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-40a561f9-5a8f-4d51-9cce-c1ea16aecd0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '466733592d654baaa781832e25eb344f', 'request_id': 'req-40a561f9-5a8f-4d51-9cce-c1ea16aecd0e'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:39.292211 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-40a561f9-5a8f-4d51-9cce-c1ea16aecd0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '466733592d654baaa781832e25eb344f', 'request_id': 'req-40a561f9-5a8f-4d51-9cce-c1ea16aecd0e'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:39.298799 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49aa401-7032-49af-ba66-96b6bba9603f None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:39.304781 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-40a561f9-5a8f-4d51-9cce-c1ea16aecd0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '466733592d654baaa781832e25eb344f', 'request_id': 'req-40a561f9-5a8f-4d51-9cce-c1ea16aecd0e'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:39.322479 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-40a561f9-5a8f-4d51-9cce-c1ea16aecd0e admin admin] The token cache is being invalidate because project 466733592d654baaa781832e25eb344f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:29:39.322904 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-40a561f9-5a8f-4d51-9cce-c1ea16aecd0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:39.323648 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-40a561f9-5a8f-4d51-9cce-c1ea16aecd0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:39.327375 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2472/4938] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:29:39 2022] DELETE /identity/v3/projects/466733592d654baaa781832e25eb344f => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:29:39.336549 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91b819a-b795-476c-9c80-da118af84fab None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:39.336790 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91b819a-b795-476c-9c80-da118af84fab None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:39.337119 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91b819a-b795-476c-9c80-da118af84fab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:39.371164 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-e91b819a-b795-476c-9c80-da118af84fab None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:29:39.372393 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-e91b819a-b795-476c-9c80-da118af84fab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:39.383748 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9802c81a-a5e4-4ad5-a3cc-bad92f8a9c68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:39.385123 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9802c81a-a5e4-4ad5-a3cc-bad92f8a9c68 service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:39.385506 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9802c81a-a5e4-4ad5-a3cc-bad92f8a9c68 service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:39.386164 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9802c81a-a5e4-4ad5-a3cc-bad92f8a9c68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:39.388349 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-9802c81a-a5e4-4ad5-a3cc-bad92f8a9c68 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:39.395058 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:29:39.464784 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2473/4939] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:29:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:29:39.466044 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91b819a-b795-476c-9c80-da118af84fab None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:39.468257 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-e91b819a-b795-476c-9c80-da118af84fab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:39.480495 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9802c81a-a5e4-4ad5-a3cc-bad92f8a9c68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:39.483315 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9802c81a-a5e4-4ad5-a3cc-bad92f8a9c68 service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:39.487909 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91b819a-b795-476c-9c80-da118af84fab None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:39.494882 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ea4c56-67a5-4657-82f4-fc956773f4be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:39.496147 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ea4c56-67a5-4657-82f4-fc956773f4be admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:39.496437 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ea4c56-67a5-4657-82f4-fc956773f4be admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:39.496750 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2467/4940] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:29:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:29:39.496885 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ea4c56-67a5-4657-82f4-fc956773f4be admin admin] PATH_INFO: `/v3/users/a3272ba9e72f4111a6982f24be1e2e81` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:39.497651 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9802c81a-a5e4-4ad5-a3cc-bad92f8a9c68 service neutron] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:39.498958 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ea4c56-67a5-4657-82f4-fc956773f4be admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3272ba9e72f4111a6982f24be1e2e81)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:39.516504 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9802c81a-a5e4-4ad5-a3cc-bad92f8a9c68 service neutron] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:39.516664 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ea4c56-67a5-4657-82f4-fc956773f4be admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:39.516800 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8b32ad-9fdf-4da2-acbb-b173c6248b6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:39.516800 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8b32ad-9fdf-4da2-acbb-b173c6248b6d admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:39.516800 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8b32ad-9fdf-4da2-acbb-b173c6248b6d admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:39.516800 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8b32ad-9fdf-4da2-acbb-b173c6248b6d admin admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:39.517151 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8b32ad-9fdf-4da2-acbb-b173c6248b6d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:29:39.517151 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8b32ad-9fdf-4da2-acbb-b173c6248b6d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:39.518533 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8b32ad-9fdf-4da2-acbb-b173c6248b6d admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:39.532437 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2468/4941] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:29:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:29:39.537217 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8b32ad-9fdf-4da2-acbb-b173c6248b6d admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:39.558507 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8b32ad-9fdf-4da2-acbb-b173c6248b6d admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:39.575378 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a136c59e-5a46-4127-b18b-5b329d72274f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:39.576965 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a136c59e-5a46-4127-b18b-5b329d72274f admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:39.577305 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a136c59e-5a46-4127-b18b-5b329d72274f admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:39.577786 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a136c59e-5a46-4127-b18b-5b329d72274f admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:39.578870 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a136c59e-5a46-4127-b18b-5b329d72274f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:39.582966 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a136c59e-5a46-4127-b18b-5b329d72274f admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:39.618446 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-28ea4c56-67a5-4657-82f4-fc956773f4be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3272ba9e72f4111a6982f24be1e2e81'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:39.621134 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-28ea4c56-67a5-4657-82f4-fc956773f4be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3272ba9e72f4111a6982f24be1e2e81'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:39.632240 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2469/4942] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:29:39 2022] POST /identity/v3/projects => generated 371 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:29:39.634762 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a136c59e-5a46-4127-b18b-5b329d72274f admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:39.639576 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-28ea4c56-67a5-4657-82f4-fc956773f4be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3272ba9e72f4111a6982f24be1e2e81'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:39.651114 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-28ea4c56-67a5-4657-82f4-fc956773f4be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3272ba9e72f4111a6982f24be1e2e81'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:39.666824 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-28ea4c56-67a5-4657-82f4-fc956773f4be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3272ba9e72f4111a6982f24be1e2e81'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:39.675118 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2474/4943] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:29:39 2022] DELETE /identity/v3/users/a3272ba9e72f4111a6982f24be1e2e81 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:29:39.759364 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a136c59e-5a46-4127-b18b-5b329d72274f admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:39.781622 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ea4c56-67a5-4657-82f4-fc956773f4be admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:39.783269 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-28ea4c56-67a5-4657-82f4-fc956773f4be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:39.795945 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:29:39.896774 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3f897d-52f3-4cbe-a7bf-ce600c785474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:39.897685 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3f897d-52f3-4cbe-a7bf-ce600c785474 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:39.898053 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3f897d-52f3-4cbe-a7bf-ce600c785474 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:39.898379 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3f897d-52f3-4cbe-a7bf-ce600c785474 admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:39.899562 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3f897d-52f3-4cbe-a7bf-ce600c785474 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:39.902868 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3f897d-52f3-4cbe-a7bf-ce600c785474 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:39.921414 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ea4c56-67a5-4657-82f4-fc956773f4be admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:39.929788 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e05f85-12d6-477c-be56-113cde0ebb10 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:39.930712 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e05f85-12d6-477c-be56-113cde0ebb10 service nova] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:39.931097 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e05f85-12d6-477c-be56-113cde0ebb10 service nova] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:39.931368 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e05f85-12d6-477c-be56-113cde0ebb10 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:39.933258 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-a7e05f85-12d6-477c-be56-113cde0ebb10 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:39.943677 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2470/4944] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:29:39 2022] POST /identity/v3/users => generated 286 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:29:39.947269 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3f897d-52f3-4cbe-a7bf-ce600c785474 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:39.949195 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-2e3f897d-52f3-4cbe-a7bf-ce600c785474 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:39.954766 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e05f85-12d6-477c-be56-113cde0ebb10 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:39.957290 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e05f85-12d6-477c-be56-113cde0ebb10 service nova] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:39.964931 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3f897d-52f3-4cbe-a7bf-ce600c785474 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:39.970662 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc1066a-a758-4abf-a4ec-f71e5876ab09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:39.971350 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc1066a-a758-4abf-a4ec-f71e5876ab09 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:39.971626 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc1066a-a758-4abf-a4ec-f71e5876ab09 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:39.971896 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc1066a-a758-4abf-a4ec-f71e5876ab09 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:39.972621 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc1066a-a758-4abf-a4ec-f71e5876ab09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:39.973480 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2475/4945] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:29:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 23 21:29:39.974281 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc1066a-a758-4abf-a4ec-f71e5876ab09 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:39.987205 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2471/4946] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:29:39 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 21:29:39.991414 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e05f85-12d6-477c-be56-113cde0ebb10 service nova] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:40.004237 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e05f85-12d6-477c-be56-113cde0ebb10 service nova] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:40.009182 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743e2bc2-8fd6-4d52-b5a6-3a0ceeed037f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:40.010112 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743e2bc2-8fd6-4d52-b5a6-3a0ceeed037f admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:40.010392 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743e2bc2-8fd6-4d52-b5a6-3a0ceeed037f admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:40.010660 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743e2bc2-8fd6-4d52-b5a6-3a0ceeed037f admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:40.011404 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743e2bc2-8fd6-4d52-b5a6-3a0ceeed037f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:40.013061 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743e2bc2-8fd6-4d52-b5a6-3a0ceeed037f admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:40.027583 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2476/4947] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:29:39 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:29:40.028909 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc1066a-a758-4abf-a4ec-f71e5876ab09 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:40.040661 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc1066a-a758-4abf-a4ec-f71e5876ab09 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:40.058680 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2aa095-42d7-4970-b1f7-f38bded31b4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:40.059817 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2aa095-42d7-4970-b1f7-f38bded31b4f admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:40.060201 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2aa095-42d7-4970-b1f7-f38bded31b4f admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:40.060483 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2aa095-42d7-4970-b1f7-f38bded31b4f admin admin] PATH_INFO: `/v3/projects/e751dfada40945a69472003d08f1bb0b/users/cadc4fac778e4eaf905a3fbc26fbb090/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:40.083751 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2aa095-42d7-4970-b1f7-f38bded31b4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e751dfada40945a69472003d08f1bb0b, user_id=cadc4fac778e4eaf905a3fbc26fbb090, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:40.086841 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2aa095-42d7-4970-b1f7-f38bded31b4f admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:40.112424 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2472/4948] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:29:40 2022] PUT /identity/v3/projects/e751dfada40945a69472003d08f1bb0b/users/cadc4fac778e4eaf905a3fbc26fbb090/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:29:40.123960 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa13073-ffea-4c6e-a5dc-dd3c0ae8e93a None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:40.124513 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa13073-ffea-4c6e-a5dc-dd3c0ae8e93a None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:40.124513 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa13073-ffea-4c6e-a5dc-dd3c0ae8e93a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:40.145378 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:29:40.155761 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-0fa13073-ffea-4c6e-a5dc-dd3c0ae8e93a None None] MFA Rules not processed for user `cadc4fac778e4eaf905a3fbc26fbb090`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:29:40.157180 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-0fa13073-ffea-4c6e-a5dc-dd3c0ae8e93a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:40.175993 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2aa095-42d7-4970-b1f7-f38bded31b4f admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:40.178971 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-2b2aa095-42d7-4970-b1f7-f38bded31b4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:40.263626 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2477/4949] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:29:40 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:29:40.276753 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa13073-ffea-4c6e-a5dc-dd3c0ae8e93a None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:40.278878 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-0fa13073-ffea-4c6e-a5dc-dd3c0ae8e93a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:40.300268 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2aa095-42d7-4970-b1f7-f38bded31b4f admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:40.305240 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285e917d-501d-40d3-8e3d-90ab5e83019e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:40.306167 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285e917d-501d-40d3-8e3d-90ab5e83019e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:40.306449 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285e917d-501d-40d3-8e3d-90ab5e83019e admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:40.306722 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285e917d-501d-40d3-8e3d-90ab5e83019e admin admin] PATH_INFO: `/v3/projects/c2739a3cc1c44f03b91d41cb88c72333` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:40.307955 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285e917d-501d-40d3-8e3d-90ab5e83019e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2739a3cc1c44f03b91d41cb88c72333)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:40.309931 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285e917d-501d-40d3-8e3d-90ab5e83019e admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:40.347061 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa13073-ffea-4c6e-a5dc-dd3c0ae8e93a None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:40.360252 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-285e917d-501d-40d3-8e3d-90ab5e83019e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2739a3cc1c44f03b91d41cb88c72333', 'request_id': 'req-285e917d-501d-40d3-8e3d-90ab5e83019e'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:40.368949 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-285e917d-501d-40d3-8e3d-90ab5e83019e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2739a3cc1c44f03b91d41cb88c72333', 'request_id': 'req-285e917d-501d-40d3-8e3d-90ab5e83019e'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:40.375782 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-285e917d-501d-40d3-8e3d-90ab5e83019e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2739a3cc1c44f03b91d41cb88c72333', 'request_id': 'req-285e917d-501d-40d3-8e3d-90ab5e83019e'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:40.382742 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:29:40.388683 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-285e917d-501d-40d3-8e3d-90ab5e83019e admin admin] The token cache is being invalidate because project c2739a3cc1c44f03b91d41cb88c72333 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:29:40.389174 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-285e917d-501d-40d3-8e3d-90ab5e83019e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:40.390527 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-285e917d-501d-40d3-8e3d-90ab5e83019e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:40.395380 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2473/4950] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:29:40 2022] DELETE /identity/v3/projects/c2739a3cc1c44f03b91d41cb88c72333 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:29:40.395380 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7024d16c-17f4-4132-badc-76187d3e8ae9 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:40.395380 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7024d16c-17f4-4132-badc-76187d3e8ae9 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:40.395380 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7024d16c-17f4-4132-badc-76187d3e8ae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:40.410567 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c23702c-9db4-4c79-a8e2-f36114045eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:40.411465 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c23702c-9db4-4c79-a8e2-f36114045eaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:40.411861 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c23702c-9db4-4c79-a8e2-f36114045eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:40.412134 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c23702c-9db4-4c79-a8e2-f36114045eaf admin admin] PATH_INFO: `/v3/projects/97271e0b700b40caae256a7166a626a7` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:40.412909 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-7024d16c-17f4-4132-badc-76187d3e8ae9 None None] MFA Rules not processed for user `cadc4fac778e4eaf905a3fbc26fbb090`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:29:40.413492 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c23702c-9db4-4c79-a8e2-f36114045eaf admin admin] RBAC: Authorizing `identity:delete_project(project_id=97271e0b700b40caae256a7166a626a7)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:40.414152 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-7024d16c-17f4-4132-badc-76187d3e8ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:40.415503 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c23702c-9db4-4c79-a8e2-f36114045eaf admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:40.470303 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:29:40.471728 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-0c23702c-9db4-4c79-a8e2-f36114045eaf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97271e0b700b40caae256a7166a626a7', 'request_id': 'req-0c23702c-9db4-4c79-a8e2-f36114045eaf'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:40.481970 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-0c23702c-9db4-4c79-a8e2-f36114045eaf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97271e0b700b40caae256a7166a626a7', 'request_id': 'req-0c23702c-9db4-4c79-a8e2-f36114045eaf'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:40.489107 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-0c23702c-9db4-4c79-a8e2-f36114045eaf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97271e0b700b40caae256a7166a626a7', 'request_id': 'req-0c23702c-9db4-4c79-a8e2-f36114045eaf'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:40.494009 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2474/4951] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:29:40 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:29:40.494953 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7024d16c-17f4-4132-badc-76187d3e8ae9 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:40.496284 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-7024d16c-17f4-4132-badc-76187d3e8ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:40.510262 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-0c23702c-9db4-4c79-a8e2-f36114045eaf admin admin] The token cache is being invalidate because project 97271e0b700b40caae256a7166a626a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:29:40.510607 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-0c23702c-9db4-4c79-a8e2-f36114045eaf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:40.511239 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7024d16c-17f4-4132-badc-76187d3e8ae9 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:40.511389 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-0c23702c-9db4-4c79-a8e2-f36114045eaf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:40.513003 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2478/4952] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:29:40 2022] DELETE /identity/v3/projects/97271e0b700b40caae256a7166a626a7 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:29:40.516628 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c23702c-9db4-4c79-a8e2-f36114045eaf admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:40.518393 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-0c23702c-9db4-4c79-a8e2-f36114045eaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:40.580657 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2449dada-80a0-49aa-b867-d586975ea037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:40.581558 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2449dada-80a0-49aa-b867-d586975ea037 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:40.581837 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2449dada-80a0-49aa-b867-d586975ea037 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:40.582146 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2449dada-80a0-49aa-b867-d586975ea037 admin admin] PATH_INFO: `/v3/users/cc3e9b84a602480aaa001fd6ded11005` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:40.583395 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2449dada-80a0-49aa-b867-d586975ea037 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc3e9b84a602480aaa001fd6ded11005)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:40.585328 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2449dada-80a0-49aa-b867-d586975ea037 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:40.602829 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c23702c-9db4-4c79-a8e2-f36114045eaf admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:40.611787 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6a666e-b7b5-4e67-8aeb-f4b80f593f8c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:40.612030 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6a666e-b7b5-4e67-8aeb-f4b80f593f8c service nova] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:40.612302 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6a666e-b7b5-4e67-8aeb-f4b80f593f8c service nova] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:40.612577 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6a666e-b7b5-4e67-8aeb-f4b80f593f8c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:40.614870 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-9d6a666e-b7b5-4e67-8aeb-f4b80f593f8c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:40.649462 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-2449dada-80a0-49aa-b867-d586975ea037 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc3e9b84a602480aaa001fd6ded11005'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:40.658839 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-2449dada-80a0-49aa-b867-d586975ea037 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc3e9b84a602480aaa001fd6ded11005'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:40.660289 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-2449dada-80a0-49aa-b867-d586975ea037 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc3e9b84a602480aaa001fd6ded11005'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:40.672405 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-2449dada-80a0-49aa-b867-d586975ea037 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc3e9b84a602480aaa001fd6ded11005'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:40.689411 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6a666e-b7b5-4e67-8aeb-f4b80f593f8c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:40.689897 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-2449dada-80a0-49aa-b867-d586975ea037 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc3e9b84a602480aaa001fd6ded11005'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:40.691594 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6a666e-b7b5-4e67-8aeb-f4b80f593f8c service nova] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:40.697409 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2475/4953] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:29:40 2022] DELETE /identity/v3/users/cc3e9b84a602480aaa001fd6ded11005 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:29:40.699025 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0b460f-4532-4d2e-90c3-3a0ee86a457e None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:40.699305 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0b460f-4532-4d2e-90c3-3a0ee86a457e None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:40.699581 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0b460f-4532-4d2e-90c3-3a0ee86a457e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:40.707935 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2479/4954] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:29:40 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:29:40.725787 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-9e0b460f-4532-4d2e-90c3-3a0ee86a457e None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:29:40.728171 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-9e0b460f-4532-4d2e-90c3-3a0ee86a457e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:40.768285 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:29:40.832978 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2476/4955] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:29:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:29:40.840898 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062379b5-9b3b-4f03-bdf8-37762f958eaa None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:40.841294 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062379b5-9b3b-4f03-bdf8-37762f958eaa None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:40.841712 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062379b5-9b3b-4f03-bdf8-37762f958eaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:40.864942 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-062379b5-9b3b-4f03-bdf8-37762f958eaa None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:29:40.866467 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-062379b5-9b3b-4f03-bdf8-37762f958eaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:40.878480 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2480/4956] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:29:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:29:40.882698 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0b460f-4532-4d2e-90c3-3a0ee86a457e None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:40.898828 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0b460f-4532-4d2e-90c3-3a0ee86a457e None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:40.904532 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cb2fd1-d302-4db2-85f6-32d91ebba1d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:40.905311 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cb2fd1-d302-4db2-85f6-32d91ebba1d8 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:40.905601 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cb2fd1-d302-4db2-85f6-32d91ebba1d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:40.905896 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cb2fd1-d302-4db2-85f6-32d91ebba1d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:40.906807 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cb2fd1-d302-4db2-85f6-32d91ebba1d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:29:40.907159 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cb2fd1-d302-4db2-85f6-32d91ebba1d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:40.909113 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cb2fd1-d302-4db2-85f6-32d91ebba1d8 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:40.925920 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2477/4957] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:29:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:29:40.928098 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062379b5-9b3b-4f03-bdf8-37762f958eaa None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:40.939762 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062379b5-9b3b-4f03-bdf8-37762f958eaa None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:40.945415 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64b50e8-2517-479e-a73c-db450fc84de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:40.946264 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64b50e8-2517-479e-a73c-db450fc84de5 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:40.946653 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64b50e8-2517-479e-a73c-db450fc84de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:40.947064 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64b50e8-2517-479e-a73c-db450fc84de5 admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:40.947853 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64b50e8-2517-479e-a73c-db450fc84de5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:40.949950 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64b50e8-2517-479e-a73c-db450fc84de5 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:41.009918 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2481/4958] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:29:40 2022] POST /identity/v3/projects => generated 373 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:29:41.011084 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cb2fd1-d302-4db2-85f6-32d91ebba1d8 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:41.027083 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cb2fd1-d302-4db2-85f6-32d91ebba1d8 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:41.106042 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcc1c16-98d8-43d7-88f4-aeff200a008a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:41.107388 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcc1c16-98d8-43d7-88f4-aeff200a008a admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:41.107827 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcc1c16-98d8-43d7-88f4-aeff200a008a admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:41.108292 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcc1c16-98d8-43d7-88f4-aeff200a008a admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:41.109462 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcc1c16-98d8-43d7-88f4-aeff200a008a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:41.112458 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcc1c16-98d8-43d7-88f4-aeff200a008a admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:41.172829 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2478/4959] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:29:41 2022] POST /identity/v3/users => generated 287 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:29:41.174491 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64b50e8-2517-479e-a73c-db450fc84de5 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:41.186285 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64b50e8-2517-479e-a73c-db450fc84de5 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:41.191893 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daa9a3f-bb1c-4b93-951e-65c56feb30e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:41.192570 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daa9a3f-bb1c-4b93-951e-65c56feb30e6 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:41.192865 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daa9a3f-bb1c-4b93-951e-65c56feb30e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:41.193140 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daa9a3f-bb1c-4b93-951e-65c56feb30e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:41.194298 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daa9a3f-bb1c-4b93-951e-65c56feb30e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:41.196562 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daa9a3f-bb1c-4b93-951e-65c56feb30e6 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:41.208800 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2482/4960] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:29:41 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:29:41.213153 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcc1c16-98d8-43d7-88f4-aeff200a008a admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:41.226118 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcc1c16-98d8-43d7-88f4-aeff200a008a admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:41.232111 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e191e317-3929-4cde-8e7b-1e48f197968f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:41.232905 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e191e317-3929-4cde-8e7b-1e48f197968f admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:41.233379 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e191e317-3929-4cde-8e7b-1e48f197968f admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:41.233730 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e191e317-3929-4cde-8e7b-1e48f197968f admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:41.235086 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e191e317-3929-4cde-8e7b-1e48f197968f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:41.237394 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e191e317-3929-4cde-8e7b-1e48f197968f admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:41.254214 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2479/4961] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:29:41 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:29:41.256078 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daa9a3f-bb1c-4b93-951e-65c56feb30e6 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:41.269057 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daa9a3f-bb1c-4b93-951e-65c56feb30e6 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:41.283908 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44224ade-2cb0-4499-9864-8e3998146c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:41.284893 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44224ade-2cb0-4499-9864-8e3998146c4b admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:41.285170 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44224ade-2cb0-4499-9864-8e3998146c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:41.285444 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44224ade-2cb0-4499-9864-8e3998146c4b admin admin] PATH_INFO: `/v3/projects/7c4d1263fd2149fa93e9ebe1455477cf/users/e72196ba3f73429f9852e1d1280a178c/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:41.313726 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44224ade-2cb0-4499-9864-8e3998146c4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c4d1263fd2149fa93e9ebe1455477cf, user_id=e72196ba3f73429f9852e1d1280a178c, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:41.317464 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44224ade-2cb0-4499-9864-8e3998146c4b admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:41.355226 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2483/4962] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:29:41 2022] PUT /identity/v3/projects/7c4d1263fd2149fa93e9ebe1455477cf/users/e72196ba3f73429f9852e1d1280a178c/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:29:41.367289 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66f7494-c2b9-434e-b8e6-97f2dc1fb6be None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:41.367594 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66f7494-c2b9-434e-b8e6-97f2dc1fb6be None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:41.367849 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66f7494-c2b9-434e-b8e6-97f2dc1fb6be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:41.405601 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-d66f7494-c2b9-434e-b8e6-97f2dc1fb6be None None] MFA Rules not processed for user `e72196ba3f73429f9852e1d1280a178c`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:29:41.408138 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-d66f7494-c2b9-434e-b8e6-97f2dc1fb6be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:41.528207 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2480/4963] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:29:41 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:29:41.547350 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44224ade-2cb0-4499-9864-8e3998146c4b admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:41.549940 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-44224ade-2cb0-4499-9864-8e3998146c4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:41.582743 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66f7494-c2b9-434e-b8e6-97f2dc1fb6be None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:41.584525 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-d66f7494-c2b9-434e-b8e6-97f2dc1fb6be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:41.606392 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:29:41.635994 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:29:41.673051 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44224ade-2cb0-4499-9864-8e3998146c4b admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:41.678519 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173d5b5d-0689-42ee-94ea-6628d2c2a603 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7f2db148c8e4d5d81431cae3576434b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:41.679291 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173d5b5d-0689-42ee-94ea-6628d2c2a603 service glance] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:41.679573 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173d5b5d-0689-42ee-94ea-6628d2c2a603 service glance] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:41.679847 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173d5b5d-0689-42ee-94ea-6628d2c2a603 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:41.691751 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173d5b5d-0689-42ee-94ea-6628d2c2a603 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:41.694023 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173d5b5d-0689-42ee-94ea-6628d2c2a603 service glance] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:41.699998 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66f7494-c2b9-434e-b8e6-97f2dc1fb6be None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:41.707037 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2484/4964] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:29:41 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:29:41.707949 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8085661e-361f-4743-924c-abb745a2dc5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:41.708914 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8085661e-361f-4743-924c-abb745a2dc5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:41.709201 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8085661e-361f-4743-924c-abb745a2dc5e admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:41.709469 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8085661e-361f-4743-924c-abb745a2dc5e admin admin] PATH_INFO: `/v3/projects/bbfbd4b3959a4f00807ab63d3c33c078` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:41.710810 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8085661e-361f-4743-924c-abb745a2dc5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbfbd4b3959a4f00807ab63d3c33c078)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:41.713035 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8085661e-361f-4743-924c-abb745a2dc5e admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:41.785900 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-8085661e-361f-4743-924c-abb745a2dc5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbfbd4b3959a4f00807ab63d3c33c078', 'request_id': 'req-8085661e-361f-4743-924c-abb745a2dc5e'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:41.798523 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-8085661e-361f-4743-924c-abb745a2dc5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbfbd4b3959a4f00807ab63d3c33c078', 'request_id': 'req-8085661e-361f-4743-924c-abb745a2dc5e'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:41.808942 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-8085661e-361f-4743-924c-abb745a2dc5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbfbd4b3959a4f00807ab63d3c33c078', 'request_id': 'req-8085661e-361f-4743-924c-abb745a2dc5e'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:41.830499 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-8085661e-361f-4743-924c-abb745a2dc5e admin admin] The token cache is being invalidate because project bbfbd4b3959a4f00807ab63d3c33c078 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:29:41.830831 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-8085661e-361f-4743-924c-abb745a2dc5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:41.831685 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-8085661e-361f-4743-924c-abb745a2dc5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:41.833692 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2481/4965] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:29:41 2022] DELETE /identity/v3/projects/bbfbd4b3959a4f00807ab63d3c33c078 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:29:41.838459 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87776b9-2d75-4b83-b526-f6dd12ce0806 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:41.838754 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87776b9-2d75-4b83-b526-f6dd12ce0806 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:41.839030 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87776b9-2d75-4b83-b526-f6dd12ce0806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:41.862730 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-f87776b9-2d75-4b83-b526-f6dd12ce0806 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:29:41.864203 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-f87776b9-2d75-4b83-b526-f6dd12ce0806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:41.889508 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a76aac1-8538-480b-ace1-fe54965e35e8 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:41.889791 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a76aac1-8538-480b-ace1-fe54965e35e8 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:41.890090 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a76aac1-8538-480b-ace1-fe54965e35e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:41.935172 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-3a76aac1-8538-480b-ace1-fe54965e35e8 None None] MFA Rules not processed for user `17b779a3e21a415bb42cde5d6863d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:29:41.935172 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-3a76aac1-8538-480b-ace1-fe54965e35e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:41.962547 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2485/4966] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:29:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:29:41.973100 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cfcdee-74c0-469f-8a58-817289373be8 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:41.973482 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cfcdee-74c0-469f-8a58-817289373be8 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:41.973891 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cfcdee-74c0-469f-8a58-817289373be8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:42.005394 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-86cfcdee-74c0-469f-8a58-817289373be8 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:29:42.017691 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-86cfcdee-74c0-469f-8a58-817289373be8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:42.018281 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2482/4967] 10.222.0.17 () {58 vars in 1009 bytes} [Sat Jul 23 21:29:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:29:42.034029 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2486/4968] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:29:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:29:42.037202 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a76aac1-8538-480b-ace1-fe54965e35e8 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:42.057364 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a76aac1-8538-480b-ace1-fe54965e35e8 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:42.063845 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2294505-6a20-4718-9ea8-e0e52e497c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:42.064653 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2294505-6a20-4718-9ea8-e0e52e497c3c admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:42.065030 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2294505-6a20-4718-9ea8-e0e52e497c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:42.068154 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2294505-6a20-4718-9ea8-e0e52e497c3c admin admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:42.069160 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2294505-6a20-4718-9ea8-e0e52e497c3c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:29:42.069979 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2294505-6a20-4718-9ea8-e0e52e497c3c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:42.073980 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2294505-6a20-4718-9ea8-e0e52e497c3c admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:42.093323 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cfcdee-74c0-469f-8a58-817289373be8 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:42.095244 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-86cfcdee-74c0-469f-8a58-817289373be8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:42.101682 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2483/4969] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:29:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:29:42.102765 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2294505-6a20-4718-9ea8-e0e52e497c3c admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:42.118915 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2294505-6a20-4718-9ea8-e0e52e497c3c admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:42.125079 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbda68c3-ac2b-4744-9ec5-f20a1629ed2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:42.126224 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbda68c3-ac2b-4744-9ec5-f20a1629ed2e admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:42.126454 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbda68c3-ac2b-4744-9ec5-f20a1629ed2e admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:42.126837 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbda68c3-ac2b-4744-9ec5-f20a1629ed2e admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:42.127715 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbda68c3-ac2b-4744-9ec5-f20a1629ed2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:42.131054 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbda68c3-ac2b-4744-9ec5-f20a1629ed2e admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:42.167623 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2484/4970] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:29:42 2022] POST /identity/v3/projects => generated 383 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:29:42.168563 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbda68c3-ac2b-4744-9ec5-f20a1629ed2e admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:42.193594 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:29:42.231918 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cfcdee-74c0-469f-8a58-817289373be8 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:42.268338 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbda68c3-ac2b-4744-9ec5-f20a1629ed2e admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:42.273910 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3670c62-b5e2-4777-80d5-bbc7dcf87736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:42.274630 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3670c62-b5e2-4777-80d5-bbc7dcf87736 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:42.274897 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3670c62-b5e2-4777-80d5-bbc7dcf87736 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:42.275171 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3670c62-b5e2-4777-80d5-bbc7dcf87736 admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:42.275979 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3670c62-b5e2-4777-80d5-bbc7dcf87736 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:42.278243 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3670c62-b5e2-4777-80d5-bbc7dcf87736 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:42.315196 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2485/4971] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:29:42 2022] POST /identity/v3/users => generated 292 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:29:42.319367 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3670c62-b5e2-4777-80d5-bbc7dcf87736 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:42.330361 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:29:42.337065 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3670c62-b5e2-4777-80d5-bbc7dcf87736 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:42.344040 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78ea826-63be-4485-8ebc-e46f425047ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:42.344729 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78ea826-63be-4485-8ebc-e46f425047ec admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:42.345008 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78ea826-63be-4485-8ebc-e46f425047ec admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:42.345281 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78ea826-63be-4485-8ebc-e46f425047ec admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:42.346042 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78ea826-63be-4485-8ebc-e46f425047ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:42.347990 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78ea826-63be-4485-8ebc-e46f425047ec admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:42.352725 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95639bd-8a7a-40b6-9a0e-33d1c12393cc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f0a685b7da46afb81024848f079d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:42.353530 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95639bd-8a7a-40b6-9a0e-33d1c12393cc service swift] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:42.354096 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95639bd-8a7a-40b6-9a0e-33d1c12393cc service swift] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:42.354554 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95639bd-8a7a-40b6-9a0e-33d1c12393cc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:42.362474 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2486/4972] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:29:42 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:29:42.363252 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78ea826-63be-4485-8ebc-e46f425047ec admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:42.374366 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78ea826-63be-4485-8ebc-e46f425047ec admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:42.381165 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dcde27-4e3d-4ac2-a1bc-41a811ab0327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:42.382159 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dcde27-4e3d-4ac2-a1bc-41a811ab0327 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:42.382442 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dcde27-4e3d-4ac2-a1bc-41a811ab0327 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:42.382710 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dcde27-4e3d-4ac2-a1bc-41a811ab0327 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:42.383449 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dcde27-4e3d-4ac2-a1bc-41a811ab0327 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:42.385056 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dcde27-4e3d-4ac2-a1bc-41a811ab0327 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:42.404064 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2487/4973] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:29:42 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:29:42.405075 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dcde27-4e3d-4ac2-a1bc-41a811ab0327 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:42.417369 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dcde27-4e3d-4ac2-a1bc-41a811ab0327 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:42.423752 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9c01f6-5844-4bd1-96e0-90d66b03d636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:42.424509 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95639bd-8a7a-40b6-9a0e-33d1c12393cc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:42.424804 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9c01f6-5844-4bd1-96e0-90d66b03d636 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:42.425268 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9c01f6-5844-4bd1-96e0-90d66b03d636 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:42.425548 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9c01f6-5844-4bd1-96e0-90d66b03d636 admin admin] PATH_INFO: `/v3/projects/6971d29cf60845978f632a71cc0e333a/users/a30c5f78586e4dea8557a918224eec18/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:42.426284 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95639bd-8a7a-40b6-9a0e-33d1c12393cc service swift] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:42.446741 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9c01f6-5844-4bd1-96e0-90d66b03d636 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6971d29cf60845978f632a71cc0e333a, user_id=a30c5f78586e4dea8557a918224eec18, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:42.451003 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9c01f6-5844-4bd1-96e0-90d66b03d636 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:42.467116 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2487/4974] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 23 21:29:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 23 21:29:42.497405 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2488/4975] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:29:42 2022] PUT /identity/v3/projects/6971d29cf60845978f632a71cc0e333a/users/a30c5f78586e4dea8557a918224eec18/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:29:42.509157 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f12736-475c-4062-ac58-61b3c0d7a212 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:42.509785 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f12736-475c-4062-ac58-61b3c0d7a212 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:42.510262 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f12736-475c-4062-ac58-61b3c0d7a212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:42.555972 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-79f12736-475c-4062-ac58-61b3c0d7a212 None None] MFA Rules not processed for user `a30c5f78586e4dea8557a918224eec18`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:29:42.557194 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-79f12736-475c-4062-ac58-61b3c0d7a212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:42.688128 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2488/4976] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:29:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:29:42.693927 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9c01f6-5844-4bd1-96e0-90d66b03d636 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:42.831032 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbdfc6c-b6a7-47ed-aaa7-739e1be5fa73 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:42.831833 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbdfc6c-b6a7-47ed-aaa7-739e1be5fa73 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:42.832322 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbdfc6c-b6a7-47ed-aaa7-739e1be5fa73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:42.860278 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-4dbdfc6c-b6a7-47ed-aaa7-739e1be5fa73 None None] MFA Rules not processed for user `17b779a3e21a415bb42cde5d6863d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:29:42.861036 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9c01f6-5844-4bd1-96e0-90d66b03d636 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:42.863232 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-4dbdfc6c-b6a7-47ed-aaa7-739e1be5fa73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:42.870725 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6866d362-072e-46b2-a351-4b2b26b0f761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:42.871428 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6866d362-072e-46b2-a351-4b2b26b0f761 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:42.871694 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6866d362-072e-46b2-a351-4b2b26b0f761 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:42.871962 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6866d362-072e-46b2-a351-4b2b26b0f761 admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:42.874709 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6866d362-072e-46b2-a351-4b2b26b0f761 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:42.879363 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6866d362-072e-46b2-a351-4b2b26b0f761 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:42.932781 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2489/4977] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:29:42 2022] POST /identity/v3/projects => generated 379 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:29:42.937308 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6866d362-072e-46b2-a351-4b2b26b0f761 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:42.943012 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2489/4978] 10.222.0.17 () {58 vars in 1009 bytes} [Sat Jul 23 21:29:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:29:42.956932 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbdfc6c-b6a7-47ed-aaa7-739e1be5fa73 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:42.991347 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:29:43.031403 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:29:43.045779 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbdfc6c-b6a7-47ed-aaa7-739e1be5fa73 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:43.055311 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6866d362-072e-46b2-a351-4b2b26b0f761 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:43.061410 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8534802d-f7dd-4fb6-a367-f2248ec9592b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:43.062142 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8534802d-f7dd-4fb6-a367-f2248ec9592b admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:43.062461 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8534802d-f7dd-4fb6-a367-f2248ec9592b admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:43.062742 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8534802d-f7dd-4fb6-a367-f2248ec9592b admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:43.063643 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8534802d-f7dd-4fb6-a367-f2248ec9592b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:43.065606 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8534802d-f7dd-4fb6-a367-f2248ec9592b admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:43.090714 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2490/4979] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:29:42 2022] POST /identity/v3/users => generated 296 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:29:43.095179 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8534802d-f7dd-4fb6-a367-f2248ec9592b admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:43.108990 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8534802d-f7dd-4fb6-a367-f2248ec9592b admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:43.124989 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d24da5f-f23d-4e3c-a1d1-8d896e33dcb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:43.125890 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d24da5f-f23d-4e3c-a1d1-8d896e33dcb6 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:43.126203 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d24da5f-f23d-4e3c-a1d1-8d896e33dcb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:43.126465 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d24da5f-f23d-4e3c-a1d1-8d896e33dcb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:43.127291 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d24da5f-f23d-4e3c-a1d1-8d896e33dcb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:43.129064 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d24da5f-f23d-4e3c-a1d1-8d896e33dcb6 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:43.137607 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7e93f1-ccd2-445b-92c6-bb66da4b822e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f0a685b7da46afb81024848f079d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:43.138856 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7e93f1-ccd2-445b-92c6-bb66da4b822e service swift] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:43.139442 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7e93f1-ccd2-445b-92c6-bb66da4b822e service swift] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:43.140408 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7e93f1-ccd2-445b-92c6-bb66da4b822e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:43.148031 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2491/4980] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:29:43 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:29:43.152269 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d24da5f-f23d-4e3c-a1d1-8d896e33dcb6 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:43.165049 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d24da5f-f23d-4e3c-a1d1-8d896e33dcb6 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:43.171458 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0546e01-f489-4c7b-99b8-f3cffa71c3cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:43.172716 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0546e01-f489-4c7b-99b8-f3cffa71c3cd admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:43.178762 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0546e01-f489-4c7b-99b8-f3cffa71c3cd admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:43.179864 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0546e01-f489-4c7b-99b8-f3cffa71c3cd admin admin] PATH_INFO: `/v3/projects/51bf3ead0308428cbc9aace00324dfce/users/a68d088809a4468d98eaf93192dc09b2/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:43.198077 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0546e01-f489-4c7b-99b8-f3cffa71c3cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=51bf3ead0308428cbc9aace00324dfce, user_id=a68d088809a4468d98eaf93192dc09b2, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:43.201134 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0546e01-f489-4c7b-99b8-f3cffa71c3cd admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:43.216881 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2492/4981] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:29:43 2022] PUT /identity/v3/projects/51bf3ead0308428cbc9aace00324dfce/users/a68d088809a4468d98eaf93192dc09b2/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:29:43.222505 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0546e01-f489-4c7b-99b8-f3cffa71c3cd admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:43.235842 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7e93f1-ccd2-445b-92c6-bb66da4b822e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:43.239980 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7e93f1-ccd2-445b-92c6-bb66da4b822e service swift] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:43.305943 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2490/4982] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 23 21:29:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 23 21:29:43.364666 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0546e01-f489-4c7b-99b8-f3cffa71c3cd admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:43.370748 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44232633-5f21-4a55-8ccd-8aa115978b26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:43.371445 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44232633-5f21-4a55-8ccd-8aa115978b26 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:43.371721 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44232633-5f21-4a55-8ccd-8aa115978b26 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:43.371993 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44232633-5f21-4a55-8ccd-8aa115978b26 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:43.372966 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44232633-5f21-4a55-8ccd-8aa115978b26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:43.375547 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44232633-5f21-4a55-8ccd-8aa115978b26 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:43.392425 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2493/4983] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:29:43 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:29:43.395809 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7e93f1-ccd2-445b-92c6-bb66da4b822e service swift] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:43.413449 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7e93f1-ccd2-445b-92c6-bb66da4b822e service swift] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:43.420608 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32896004-03fc-451b-9c0c-4785b1ba6b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:43.421628 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32896004-03fc-451b-9c0c-4785b1ba6b1f admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:43.422021 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32896004-03fc-451b-9c0c-4785b1ba6b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:43.422448 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32896004-03fc-451b-9c0c-4785b1ba6b1f admin admin] PATH_INFO: `/v3/projects/51bf3ead0308428cbc9aace00324dfce/users/a68d088809a4468d98eaf93192dc09b2/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:43.432492 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32896004-03fc-451b-9c0c-4785b1ba6b1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=51bf3ead0308428cbc9aace00324dfce, user_id=a68d088809a4468d98eaf93192dc09b2, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:43.440682 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32896004-03fc-451b-9c0c-4785b1ba6b1f admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:43.476480 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2491/4984] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:29:43 2022] PUT /identity/v3/projects/51bf3ead0308428cbc9aace00324dfce/users/a68d088809a4468d98eaf93192dc09b2/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:29:43.490384 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fb512a-6a73-4f4f-bfcd-845b4e4ccf74 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:43.490643 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fb512a-6a73-4f4f-bfcd-845b4e4ccf74 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:43.490921 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fb512a-6a73-4f4f-bfcd-845b4e4ccf74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:43.558213 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-d1fb512a-6a73-4f4f-bfcd-845b4e4ccf74 None None] MFA Rules not processed for user `a68d088809a4468d98eaf93192dc09b2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:29:43.559922 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-d1fb512a-6a73-4f4f-bfcd-845b4e4ccf74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:43.661225 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1f7801-dca2-40e4-9e1b-e80def969aa5 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:43.661511 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1f7801-dca2-40e4-9e1b-e80def969aa5 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:43.661790 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1f7801-dca2-40e4-9e1b-e80def969aa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:43.694406 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-1d1f7801-dca2-40e4-9e1b-e80def969aa5 None None] MFA Rules not processed for user `17b779a3e21a415bb42cde5d6863d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:29:43.695202 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2494/4985] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:29:43 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:29:43.696576 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-1d1f7801-dca2-40e4-9e1b-e80def969aa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:43.712159 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fb512a-6a73-4f4f-bfcd-845b4e4ccf74 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:43.713612 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-d1fb512a-6a73-4f4f-bfcd-845b4e4ccf74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:43.776159 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:29:43.785597 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:29:43.793450 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2492/4986] 10.222.0.17 () {58 vars in 1009 bytes} [Sat Jul 23 21:29:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:29:43.807699 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1f7801-dca2-40e4-9e1b-e80def969aa5 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:43.829212 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fb512a-6a73-4f4f-bfcd-845b4e4ccf74 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:43.833161 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c7dfef-68e0-4e10-9b30-d62f1f5fee1e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec5fd3a489c341b7964704d689037f05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:43.833826 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c7dfef-68e0-4e10-9b30-d62f1f5fee1e service cinder] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:43.834138 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c7dfef-68e0-4e10-9b30-d62f1f5fee1e service cinder] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:43.834412 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c7dfef-68e0-4e10-9b30-d62f1f5fee1e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:43.845430 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c7dfef-68e0-4e10-9b30-d62f1f5fee1e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:43.845908 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c7dfef-68e0-4e10-9b30-d62f1f5fee1e service cinder] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:43.857151 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2495/4987] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:29:43 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 23 21:29:44.003346 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1f7801-dca2-40e4-9e1b-e80def969aa5 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:44.021887 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15060aa3-81b5-406c-8823-bcb9ac08e38f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f0a685b7da46afb81024848f079d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:44.022503 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15060aa3-81b5-406c-8823-bcb9ac08e38f service swift] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:44.022777 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15060aa3-81b5-406c-8823-bcb9ac08e38f service swift] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:44.023048 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15060aa3-81b5-406c-8823-bcb9ac08e38f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:44.043294 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15060aa3-81b5-406c-8823-bcb9ac08e38f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:44.045843 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15060aa3-81b5-406c-8823-bcb9ac08e38f service swift] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:44.057365 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2493/4988] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 23 21:29:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 23 21:29:44.123172 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c7dfef-68e0-4e10-9b30-d62f1f5fee1e service cinder] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:44.148008 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c7dfef-68e0-4e10-9b30-d62f1f5fee1e service cinder] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:44.161308 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79775fd-4e8f-4cae-9c1f-44712afdd43f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec5fd3a489c341b7964704d689037f05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:44.162278 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79775fd-4e8f-4cae-9c1f-44712afdd43f service cinder] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:44.162726 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79775fd-4e8f-4cae-9c1f-44712afdd43f service cinder] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:44.162990 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79775fd-4e8f-4cae-9c1f-44712afdd43f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:44.309996 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79775fd-4e8f-4cae-9c1f-44712afdd43f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:44.312821 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79775fd-4e8f-4cae-9c1f-44712afdd43f service cinder] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:44.324542 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2496/4989] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:29:44 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:29:44.508304 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ba44b6-d14a-4f7a-b447-492ed3d7dfd9 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:44.508794 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ba44b6-d14a-4f7a-b447-492ed3d7dfd9 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:44.509306 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ba44b6-d14a-4f7a-b447-492ed3d7dfd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:44.552256 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-f7ba44b6-d14a-4f7a-b447-492ed3d7dfd9 None None] MFA Rules not processed for user `17b779a3e21a415bb42cde5d6863d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:29:44.555213 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-f7ba44b6-d14a-4f7a-b447-492ed3d7dfd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:44.578338 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2494/4990] 10.222.0.17 () {58 vars in 1009 bytes} [Sat Jul 23 21:29:44 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:29:44.591153 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79775fd-4e8f-4cae-9c1f-44712afdd43f service cinder] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:44.611585 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79775fd-4e8f-4cae-9c1f-44712afdd43f service cinder] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:44.628144 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed334979-e0a6-4a6d-aa19-044fc9e38696 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f0a685b7da46afb81024848f079d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:44.629323 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed334979-e0a6-4a6d-aa19-044fc9e38696 service swift] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:44.629323 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed334979-e0a6-4a6d-aa19-044fc9e38696 service swift] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:44.629532 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed334979-e0a6-4a6d-aa19-044fc9e38696 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:44.642024 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed334979-e0a6-4a6d-aa19-044fc9e38696 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:44.644713 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed334979-e0a6-4a6d-aa19-044fc9e38696 service swift] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:44.672960 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2497/4991] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 23 21:29:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 23 21:29:44.861248 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ba44b6-d14a-4f7a-b447-492ed3d7dfd9 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:44.953982 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ba44b6-d14a-4f7a-b447-492ed3d7dfd9 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:44.973199 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ca9df1-cfd4-452a-a96f-55dddb70a7a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:44.974802 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ca9df1-cfd4-452a-a96f-55dddb70a7a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:44.975208 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ca9df1-cfd4-452a-a96f-55dddb70a7a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:44.975488 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ca9df1-cfd4-452a-a96f-55dddb70a7a0 admin admin] PATH_INFO: `/v3/users/a30c5f78586e4dea8557a918224eec18` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:44.976912 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ca9df1-cfd4-452a-a96f-55dddb70a7a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a30c5f78586e4dea8557a918224eec18)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:44.979143 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ca9df1-cfd4-452a-a96f-55dddb70a7a0 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:45.051006 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da3792d-f08b-46fd-854e-26d561591ff6 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:45.051506 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da3792d-f08b-46fd-854e-26d561591ff6 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:45.051907 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da3792d-f08b-46fd-854e-26d561591ff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:45.076712 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-39ca9df1-cfd4-452a-a96f-55dddb70a7a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a30c5f78586e4dea8557a918224eec18'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:45.077598 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-39ca9df1-cfd4-452a-a96f-55dddb70a7a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a30c5f78586e4dea8557a918224eec18'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:45.087091 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-39ca9df1-cfd4-452a-a96f-55dddb70a7a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a30c5f78586e4dea8557a918224eec18'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:45.090276 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-5da3792d-f08b-46fd-854e-26d561591ff6 None None] MFA Rules not processed for user `17b779a3e21a415bb42cde5d6863d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:29:45.091617 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-5da3792d-f08b-46fd-854e-26d561591ff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:45.103197 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2498/4992] 10.222.0.17 () {58 vars in 1009 bytes} [Sat Jul 23 21:29:45 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:29:45.103902 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-39ca9df1-cfd4-452a-a96f-55dddb70a7a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a30c5f78586e4dea8557a918224eec18'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:45.121819 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da3792d-f08b-46fd-854e-26d561591ff6 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:45.127592 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-39ca9df1-cfd4-452a-a96f-55dddb70a7a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a30c5f78586e4dea8557a918224eec18'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:45.135743 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2495/4993] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:29:44 2022] DELETE /identity/v3/users/a30c5f78586e4dea8557a918224eec18 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:29:45.140055 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce01bc2-36c8-4fb6-adb3-249e6a29e72d None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:45.140321 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce01bc2-36c8-4fb6-adb3-249e6a29e72d None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:45.140670 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce01bc2-36c8-4fb6-adb3-249e6a29e72d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:45.157632 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:29:45.168295 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-4ce01bc2-36c8-4fb6-adb3-249e6a29e72d None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:29:45.170031 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-4ce01bc2-36c8-4fb6-adb3-249e6a29e72d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:45.173913 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da3792d-f08b-46fd-854e-26d561591ff6 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:45.250500 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2496/4994] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:29:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:29:45.258027 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b57a72-43d7-4237-a8d4-b3306233d3ef service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f0a685b7da46afb81024848f079d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:45.259293 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce01bc2-36c8-4fb6-adb3-249e6a29e72d None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:45.260706 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b57a72-43d7-4237-a8d4-b3306233d3ef service swift] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:45.260994 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b57a72-43d7-4237-a8d4-b3306233d3ef service swift] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:45.261272 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b57a72-43d7-4237-a8d4-b3306233d3ef service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:45.264389 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-4ce01bc2-36c8-4fb6-adb3-249e6a29e72d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:45.264503 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-06b57a72-43d7-4237-a8d4-b3306233d3ef service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:45.325255 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:29:45.347008 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b57a72-43d7-4237-a8d4-b3306233d3ef service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:45.348630 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b57a72-43d7-4237-a8d4-b3306233d3ef service swift] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:45.352201 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce01bc2-36c8-4fb6-adb3-249e6a29e72d None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:45.361944 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aa298d-7e12-42aa-9f9c-2384eed42085 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:45.362590 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2499/4995] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 23 21:29:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 23 21:29:45.370617 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aa298d-7e12-42aa-9f9c-2384eed42085 service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:45.371750 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aa298d-7e12-42aa-9f9c-2384eed42085 service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:45.372134 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aa298d-7e12-42aa-9f9c-2384eed42085 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:45.386190 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97aa298d-7e12-42aa-9f9c-2384eed42085 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:45.394823 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97aa298d-7e12-42aa-9f9c-2384eed42085 service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:45.409349 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2497/4996] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:29:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 23 21:29:45.703276 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e4911b-4b2d-48bd-81cd-e7038aa00088 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:45.703487 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e4911b-4b2d-48bd-81cd-e7038aa00088 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:45.703766 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e4911b-4b2d-48bd-81cd-e7038aa00088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:45.725211 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-63e4911b-4b2d-48bd-81cd-e7038aa00088 None None] MFA Rules not processed for user `17b779a3e21a415bb42cde5d6863d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:29:45.726748 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-63e4911b-4b2d-48bd-81cd-e7038aa00088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:45.742202 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2500/4997] 10.222.0.17 () {58 vars in 1009 bytes} [Sat Jul 23 21:29:45 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:29:45.756642 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aa298d-7e12-42aa-9f9c-2384eed42085 service neutron] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:45.758749 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-97aa298d-7e12-42aa-9f9c-2384eed42085 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:45.782166 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aa298d-7e12-42aa-9f9c-2384eed42085 service neutron] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:45.789507 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a837a0b8-abf7-49a8-9272-874130f2b414 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f0a685b7da46afb81024848f079d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:45.790419 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a837a0b8-abf7-49a8-9272-874130f2b414 service swift] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:45.791057 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a837a0b8-abf7-49a8-9272-874130f2b414 service swift] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:45.791521 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a837a0b8-abf7-49a8-9272-874130f2b414 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:45.807447 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a837a0b8-abf7-49a8-9272-874130f2b414 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:45.809933 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a837a0b8-abf7-49a8-9272-874130f2b414 service swift] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:45.823942 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2498/4998] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 23 21:29:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 23 21:29:46.322454 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e4911b-4b2d-48bd-81cd-e7038aa00088 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:46.324670 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-63e4911b-4b2d-48bd-81cd-e7038aa00088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:46.360015 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e4911b-4b2d-48bd-81cd-e7038aa00088 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:46.373824 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e8bda8-decc-432c-8501-bc2a9e8997b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:46.375122 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e8bda8-decc-432c-8501-bc2a9e8997b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:46.376428 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e8bda8-decc-432c-8501-bc2a9e8997b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:46.376891 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e8bda8-decc-432c-8501-bc2a9e8997b1 admin admin] PATH_INFO: `/v3/projects/6971d29cf60845978f632a71cc0e333a` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:46.381711 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e8bda8-decc-432c-8501-bc2a9e8997b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6971d29cf60845978f632a71cc0e333a)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:46.384667 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e8bda8-decc-432c-8501-bc2a9e8997b1 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:46.473242 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-25e8bda8-decc-432c-8501-bc2a9e8997b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6971d29cf60845978f632a71cc0e333a', 'request_id': 'req-25e8bda8-decc-432c-8501-bc2a9e8997b1'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:46.492975 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-25e8bda8-decc-432c-8501-bc2a9e8997b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6971d29cf60845978f632a71cc0e333a', 'request_id': 'req-25e8bda8-decc-432c-8501-bc2a9e8997b1'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:46.504359 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-25e8bda8-decc-432c-8501-bc2a9e8997b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6971d29cf60845978f632a71cc0e333a', 'request_id': 'req-25e8bda8-decc-432c-8501-bc2a9e8997b1'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:46.532057 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-25e8bda8-decc-432c-8501-bc2a9e8997b1 admin admin] The token cache is being invalidate because project 6971d29cf60845978f632a71cc0e333a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:29:46.532524 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-25e8bda8-decc-432c-8501-bc2a9e8997b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:46.534240 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-25e8bda8-decc-432c-8501-bc2a9e8997b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:46.539106 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2501/4999] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:29:46 2022] DELETE /identity/v3/projects/6971d29cf60845978f632a71cc0e333a => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:29:46.543654 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a837a0b8-abf7-49a8-9272-874130f2b414 service swift] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:46.564146 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a837a0b8-abf7-49a8-9272-874130f2b414 service swift] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:46.731222 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f053fdb0-cb15-477c-94eb-0b07dce24f8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:46.739353 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f053fdb0-cb15-477c-94eb-0b07dce24f8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:46.739552 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f053fdb0-cb15-477c-94eb-0b07dce24f8d admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:46.739831 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f053fdb0-cb15-477c-94eb-0b07dce24f8d admin admin] PATH_INFO: `/v3/users/a68d088809a4468d98eaf93192dc09b2` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:46.743657 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f053fdb0-cb15-477c-94eb-0b07dce24f8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a68d088809a4468d98eaf93192dc09b2)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:46.748146 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f053fdb0-cb15-477c-94eb-0b07dce24f8d admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:46.880644 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:29:46.906236 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-f053fdb0-cb15-477c-94eb-0b07dce24f8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a68d088809a4468d98eaf93192dc09b2'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:46.908117 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-f053fdb0-cb15-477c-94eb-0b07dce24f8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a68d088809a4468d98eaf93192dc09b2'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:46.922788 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-f053fdb0-cb15-477c-94eb-0b07dce24f8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a68d088809a4468d98eaf93192dc09b2'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:46.935792 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-f053fdb0-cb15-477c-94eb-0b07dce24f8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a68d088809a4468d98eaf93192dc09b2'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:46.969111 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-f053fdb0-cb15-477c-94eb-0b07dce24f8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a68d088809a4468d98eaf93192dc09b2'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:46.978574 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2499/5000] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:29:46 2022] DELETE /identity/v3/users/a68d088809a4468d98eaf93192dc09b2 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:29:47.737057 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1b36a0-c109-406a-a12d-77793252fcb7 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:47.737664 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1b36a0-c109-406a-a12d-77793252fcb7 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:47.737842 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1b36a0-c109-406a-a12d-77793252fcb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:47.773480 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-5a1b36a0-c109-406a-a12d-77793252fcb7 None None] MFA Rules not processed for user `17b779a3e21a415bb42cde5d6863d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:29:47.775683 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-5a1b36a0-c109-406a-a12d-77793252fcb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:47.863571 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2502/5001] 10.222.0.17 () {58 vars in 967 bytes} [Sat Jul 23 21:29:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:29:47.872968 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f053fdb0-cb15-477c-94eb-0b07dce24f8d admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:47.875167 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-f053fdb0-cb15-477c-94eb-0b07dce24f8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:48.003205 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f053fdb0-cb15-477c-94eb-0b07dce24f8d admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:48.013613 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31751ae-76ab-494c-962b-0dae03021ed5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f0a685b7da46afb81024848f079d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:48.014494 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31751ae-76ab-494c-962b-0dae03021ed5 service swift] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:48.014915 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31751ae-76ab-494c-962b-0dae03021ed5 service swift] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:48.015422 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31751ae-76ab-494c-962b-0dae03021ed5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:48.026305 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31751ae-76ab-494c-962b-0dae03021ed5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:48.029618 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31751ae-76ab-494c-962b-0dae03021ed5 service swift] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:48.043147 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2500/5002] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 23 21:29:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 23 21:29:48.294691 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e30f3e-264e-4bb7-8989-ebe05c57f328 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:48.295185 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e30f3e-264e-4bb7-8989-ebe05c57f328 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:48.295622 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e30f3e-264e-4bb7-8989-ebe05c57f328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:48.317703 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-17e30f3e-264e-4bb7-8989-ebe05c57f328 None None] MFA Rules not processed for user `17b779a3e21a415bb42cde5d6863d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:29:48.319711 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-17e30f3e-264e-4bb7-8989-ebe05c57f328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:48.336370 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2503/5003] 10.222.0.17 () {58 vars in 967 bytes} [Sat Jul 23 21:29:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:29:48.352907 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31751ae-76ab-494c-962b-0dae03021ed5 service swift] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:48.372035 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31751ae-76ab-494c-962b-0dae03021ed5 service swift] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:48.386406 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cc8a03-f0a0-43ce-b076-6fe3c7595a65 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f0a685b7da46afb81024848f079d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:48.387075 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cc8a03-f0a0-43ce-b076-6fe3c7595a65 service swift] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:48.387355 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cc8a03-f0a0-43ce-b076-6fe3c7595a65 service swift] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:48.387631 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cc8a03-f0a0-43ce-b076-6fe3c7595a65 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:48.408749 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cc8a03-f0a0-43ce-b076-6fe3c7595a65 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:48.410639 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cc8a03-f0a0-43ce-b076-6fe3c7595a65 service swift] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:48.428310 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2501/5004] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 23 21:29:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 23 21:29:48.492907 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e30f3e-264e-4bb7-8989-ebe05c57f328 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:48.495363 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-17e30f3e-264e-4bb7-8989-ebe05c57f328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:48.659974 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e30f3e-264e-4bb7-8989-ebe05c57f328 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:48.662755 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d066a23-1e69-4a9a-a857-c0819b7cc7be None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:48.663215 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d066a23-1e69-4a9a-a857-c0819b7cc7be None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:48.663788 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d066a23-1e69-4a9a-a857-c0819b7cc7be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:48.673437 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176fb1fa-91db-4040-8bf7-ebda8c7ea60d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:48.674385 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176fb1fa-91db-4040-8bf7-ebda8c7ea60d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:48.674665 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176fb1fa-91db-4040-8bf7-ebda8c7ea60d admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:48.674940 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176fb1fa-91db-4040-8bf7-ebda8c7ea60d admin admin] PATH_INFO: `/v3/projects/51bf3ead0308428cbc9aace00324dfce` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:48.678113 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176fb1fa-91db-4040-8bf7-ebda8c7ea60d admin admin] RBAC: Authorizing `identity:delete_project(project_id=51bf3ead0308428cbc9aace00324dfce)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:48.680159 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176fb1fa-91db-4040-8bf7-ebda8c7ea60d admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:48.687480 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:29:48.690018 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-7d066a23-1e69-4a9a-a857-c0819b7cc7be None None] MFA Rules not processed for user `17b779a3e21a415bb42cde5d6863d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:29:48.691260 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-7d066a23-1e69-4a9a-a857-c0819b7cc7be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:48.718076 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2502/5005] 10.222.0.17 () {58 vars in 967 bytes} [Sat Jul 23 21:29:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:29:48.728273 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d066a23-1e69-4a9a-a857-c0819b7cc7be None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:48.764123 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d066a23-1e69-4a9a-a857-c0819b7cc7be None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:48.784532 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15719d4-92e8-49c3-9cc8-0702bba14997 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f0a685b7da46afb81024848f079d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:48.787709 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15719d4-92e8-49c3-9cc8-0702bba14997 service swift] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:48.787996 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15719d4-92e8-49c3-9cc8-0702bba14997 service swift] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:48.792684 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15719d4-92e8-49c3-9cc8-0702bba14997 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:48.818753 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15719d4-92e8-49c3-9cc8-0702bba14997 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:48.824192 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-176fb1fa-91db-4040-8bf7-ebda8c7ea60d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51bf3ead0308428cbc9aace00324dfce', 'request_id': 'req-176fb1fa-91db-4040-8bf7-ebda8c7ea60d'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:48.826126 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15719d4-92e8-49c3-9cc8-0702bba14997 service swift] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:48.848750 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2503/5006] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 23 21:29:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 23 21:29:48.850978 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-176fb1fa-91db-4040-8bf7-ebda8c7ea60d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51bf3ead0308428cbc9aace00324dfce', 'request_id': 'req-176fb1fa-91db-4040-8bf7-ebda8c7ea60d'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:48.860964 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-176fb1fa-91db-4040-8bf7-ebda8c7ea60d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51bf3ead0308428cbc9aace00324dfce', 'request_id': 'req-176fb1fa-91db-4040-8bf7-ebda8c7ea60d'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:48.886668 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-176fb1fa-91db-4040-8bf7-ebda8c7ea60d admin admin] The token cache is being invalidate because project 51bf3ead0308428cbc9aace00324dfce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:29:48.886882 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-176fb1fa-91db-4040-8bf7-ebda8c7ea60d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:48.889136 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-176fb1fa-91db-4040-8bf7-ebda8c7ea60d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:48.895314 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2504/5007] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:29:48 2022] DELETE /identity/v3/projects/51bf3ead0308428cbc9aace00324dfce => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:29:48.897107 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e647fc6c-8bd6-472f-9d56-fe81be883527 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:48.897397 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e647fc6c-8bd6-472f-9d56-fe81be883527 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:48.897674 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e647fc6c-8bd6-472f-9d56-fe81be883527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:48.936147 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-e647fc6c-8bd6-472f-9d56-fe81be883527 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:29:48.938291 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-e647fc6c-8bd6-472f-9d56-fe81be883527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:49.111915 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2504/5008] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:29:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:29:49.120037 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2aa640-43d1-4b56-b4ad-23018189bb5c None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:49.120494 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2aa640-43d1-4b56-b4ad-23018189bb5c None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:49.120923 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2aa640-43d1-4b56-b4ad-23018189bb5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:49.125359 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfeac84-b961-4a50-b9d0-52a46b47cf3f None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:49.127323 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfeac84-b961-4a50-b9d0-52a46b47cf3f None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:49.128758 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfeac84-b961-4a50-b9d0-52a46b47cf3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:49.192249 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-4e2aa640-43d1-4b56-b4ad-23018189bb5c None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:29:49.197891 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-4e2aa640-43d1-4b56-b4ad-23018189bb5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:49.210133 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-ecfeac84-b961-4a50-b9d0-52a46b47cf3f None None] MFA Rules not processed for user `17b779a3e21a415bb42cde5d6863d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:29:49.212121 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-ecfeac84-b961-4a50-b9d0-52a46b47cf3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:49.223183 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2505/5009] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:29:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:29:49.238141 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:29:49.239133 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2aa640-43d1-4b56-b4ad-23018189bb5c None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:49.274104 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2aa640-43d1-4b56-b4ad-23018189bb5c None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:49.295733 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308843aa-cec9-4dea-b027-ede9488007aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:49.296531 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308843aa-cec9-4dea-b027-ede9488007aa admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:49.296931 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308843aa-cec9-4dea-b027-ede9488007aa admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:49.297270 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308843aa-cec9-4dea-b027-ede9488007aa admin admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:49.298150 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308843aa-cec9-4dea-b027-ede9488007aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:29:49.299589 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308843aa-cec9-4dea-b027-ede9488007aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:49.306135 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308843aa-cec9-4dea-b027-ede9488007aa admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:49.312634 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2505/5010] 10.222.0.17 () {58 vars in 967 bytes} [Sat Jul 23 21:29:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:29:49.330315 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfeac84-b961-4a50-b9d0-52a46b47cf3f None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:49.336805 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-ecfeac84-b961-4a50-b9d0-52a46b47cf3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:49.349012 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2506/5011] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:29:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:29:49.352706 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308843aa-cec9-4dea-b027-ede9488007aa admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:49.384689 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308843aa-cec9-4dea-b027-ede9488007aa admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:49.407577 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a215cfb-d2a9-47a9-8bd3-d624341c2967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:49.408522 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a215cfb-d2a9-47a9-8bd3-d624341c2967 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:49.408953 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a215cfb-d2a9-47a9-8bd3-d624341c2967 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:49.409358 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a215cfb-d2a9-47a9-8bd3-d624341c2967 admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:49.410210 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a215cfb-d2a9-47a9-8bd3-d624341c2967 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:49.412329 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a215cfb-d2a9-47a9-8bd3-d624341c2967 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:49.470250 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfeac84-b961-4a50-b9d0-52a46b47cf3f None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:49.479648 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ea8a8b-725c-46a5-be68-91cca65ab49a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f0a685b7da46afb81024848f079d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:49.481678 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ea8a8b-725c-46a5-be68-91cca65ab49a service swift] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:49.482201 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ea8a8b-725c-46a5-be68-91cca65ab49a service swift] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:49.482673 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ea8a8b-725c-46a5-be68-91cca65ab49a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:49.503762 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ea8a8b-725c-46a5-be68-91cca65ab49a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:49.506027 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ea8a8b-725c-46a5-be68-91cca65ab49a service swift] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:49.509211 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2507/5012] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:29:49 2022] POST /identity/v3/projects => generated 381 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:29:49.510811 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5582f076-e262-4b52-992b-6924f4f58a4e None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:49.511221 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5582f076-e262-4b52-992b-6924f4f58a4e None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:49.511755 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5582f076-e262-4b52-992b-6924f4f58a4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:49.517439 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2506/5013] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 23 21:29:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 23 21:29:49.518488 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ea8a8b-725c-46a5-be68-91cca65ab49a service swift] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:49.538209 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ea8a8b-725c-46a5-be68-91cca65ab49a service swift] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:49.552944 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-5582f076-e262-4b52-992b-6924f4f58a4e None None] MFA Rules not processed for user `5efda1c40f494592bf1e6af1add120f3`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:29:49.556121 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-5582f076-e262-4b52-992b-6924f4f58a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:49.630645 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7af3e67-860e-4531-8329-3e240c43eed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:49.631372 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7af3e67-860e-4531-8329-3e240c43eed9 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:49.631655 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7af3e67-860e-4531-8329-3e240c43eed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:49.631934 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7af3e67-860e-4531-8329-3e240c43eed9 admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:49.633174 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7af3e67-860e-4531-8329-3e240c43eed9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:49.635963 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7af3e67-860e-4531-8329-3e240c43eed9 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:49.688900 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2507/5014] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:29:49 2022] POST /identity/v3/users => generated 291 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:29:49.696484 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7af3e67-860e-4531-8329-3e240c43eed9 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:49.702448 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2508/5015] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:29:49 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:29:49.752555 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7af3e67-860e-4531-8329-3e240c43eed9 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:49.763103 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac0f8d6-cfbf-49d2-94c6-e47e474179be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:49.764615 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac0f8d6-cfbf-49d2-94c6-e47e474179be admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:49.765169 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac0f8d6-cfbf-49d2-94c6-e47e474179be admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:49.765674 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac0f8d6-cfbf-49d2-94c6-e47e474179be admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:49.766702 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac0f8d6-cfbf-49d2-94c6-e47e474179be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:49.785421 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac0f8d6-cfbf-49d2-94c6-e47e474179be admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:49.816298 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2508/5016] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:29:49 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:29:49.821558 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5582f076-e262-4b52-992b-6924f4f58a4e None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:49.847364 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5582f076-e262-4b52-992b-6924f4f58a4e None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:49.855811 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad620f42-970e-4df1-bc7d-ab9182b326ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:49.856901 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad620f42-970e-4df1-bc7d-ab9182b326ba admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:49.857372 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad620f42-970e-4df1-bc7d-ab9182b326ba admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:49.857833 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad620f42-970e-4df1-bc7d-ab9182b326ba admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:49.862223 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad620f42-970e-4df1-bc7d-ab9182b326ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:49.864716 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad620f42-970e-4df1-bc7d-ab9182b326ba admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:49.874327 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e939e4dd-f530-4e8a-a4a2-372a8d6f1546 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:49.875267 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e939e4dd-f530-4e8a-a4a2-372a8d6f1546 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:49.875973 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e939e4dd-f530-4e8a-a4a2-372a8d6f1546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:49.908180 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2509/5017] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:29:49 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 21:29:49.917649 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad620f42-970e-4df1-bc7d-ab9182b326ba admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:49.930361 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-e939e4dd-f530-4e8a-a4a2-372a8d6f1546 None None] MFA Rules not processed for user `17b779a3e21a415bb42cde5d6863d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:29:49.943429 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-e939e4dd-f530-4e8a-a4a2-372a8d6f1546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:49.955233 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad620f42-970e-4df1-bc7d-ab9182b326ba admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:49.980829 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356cf87a-35c1-48ae-a397-274b1c7c92e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:49.982509 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356cf87a-35c1-48ae-a397-274b1c7c92e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:49.982964 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356cf87a-35c1-48ae-a397-274b1c7c92e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:49.983822 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356cf87a-35c1-48ae-a397-274b1c7c92e9 admin admin] PATH_INFO: `/v3/projects/3ea6a37075c14ffd82ebba0f0940b8c0/users/7ce962c9e3f742a184121d8ba4a2b0da/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:49.999696 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:29:50.030173 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356cf87a-35c1-48ae-a397-274b1c7c92e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ea6a37075c14ffd82ebba0f0940b8c0, user_id=7ce962c9e3f742a184121d8ba4a2b0da, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:50.034746 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356cf87a-35c1-48ae-a397-274b1c7c92e9 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:50.073528 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2510/5018] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:29:49 2022] PUT /identity/v3/projects/3ea6a37075c14ffd82ebba0f0940b8c0/users/7ce962c9e3f742a184121d8ba4a2b0da/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:29:50.089671 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a5fb82-4c3a-47eb-9165-58858edbfbe5 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:50.089984 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a5fb82-4c3a-47eb-9165-58858edbfbe5 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:50.104505 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a5fb82-4c3a-47eb-9165-58858edbfbe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:50.137647 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2509/5019] 10.222.0.17 () {58 vars in 967 bytes} [Sat Jul 23 21:29:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:29:50.140121 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e939e4dd-f530-4e8a-a4a2-372a8d6f1546 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:50.153495 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-b4a5fb82-4c3a-47eb-9165-58858edbfbe5 None None] MFA Rules not processed for user `7ce962c9e3f742a184121d8ba4a2b0da`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:29:50.157275 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-b4a5fb82-4c3a-47eb-9165-58858edbfbe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:50.165244 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:29:50.287594 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2511/5020] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:29:50 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:29:50.290705 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e939e4dd-f530-4e8a-a4a2-372a8d6f1546 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:50.292709 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a5fb82-4c3a-47eb-9165-58858edbfbe5 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:50.385702 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be80c187-1aa7-481a-a069-4d6102d65c07 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f0a685b7da46afb81024848f079d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:50.386406 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be80c187-1aa7-481a-a069-4d6102d65c07 service swift] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:50.387009 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be80c187-1aa7-481a-a069-4d6102d65c07 service swift] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:50.387009 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be80c187-1aa7-481a-a069-4d6102d65c07 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:50.465400 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a5fb82-4c3a-47eb-9165-58858edbfbe5 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:50.478873 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10ef2f2-8174-40cf-b387-432ede3c468f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:50.479565 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10ef2f2-8174-40cf-b387-432ede3c468f admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:50.479842 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10ef2f2-8174-40cf-b387-432ede3c468f admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:50.480114 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10ef2f2-8174-40cf-b387-432ede3c468f admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:50.480820 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10ef2f2-8174-40cf-b387-432ede3c468f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:50.482777 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10ef2f2-8174-40cf-b387-432ede3c468f admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:50.518569 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be80c187-1aa7-481a-a069-4d6102d65c07 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:50.520547 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be80c187-1aa7-481a-a069-4d6102d65c07 service swift] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:50.527541 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2512/5021] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:29:50 2022] POST /identity/v3/projects => generated 383 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:29:50.532007 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10ef2f2-8174-40cf-b387-432ede3c468f admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:50.544967 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2510/5022] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 23 21:29:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 23 21:29:50.704171 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10ef2f2-8174-40cf-b387-432ede3c468f admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:50.718774 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbd1c9f-184a-4e94-8a1f-7be4223683ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:50.720029 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbd1c9f-184a-4e94-8a1f-7be4223683ba admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:50.720966 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbd1c9f-184a-4e94-8a1f-7be4223683ba admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:50.721383 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbd1c9f-184a-4e94-8a1f-7be4223683ba admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:50.722499 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbd1c9f-184a-4e94-8a1f-7be4223683ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:50.746326 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbd1c9f-184a-4e94-8a1f-7be4223683ba admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:50.801620 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2513/5023] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:29:50 2022] POST /identity/v3/users => generated 298 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:29:50.806351 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be80c187-1aa7-481a-a069-4d6102d65c07 service swift] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:50.815623 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbf41fc-ef33-4207-b2f2-8c2c5dbf72b3 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:50.815915 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbf41fc-ef33-4207-b2f2-8c2c5dbf72b3 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:50.816185 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbf41fc-ef33-4207-b2f2-8c2c5dbf72b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:50.829462 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be80c187-1aa7-481a-a069-4d6102d65c07 service swift] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:50.836488 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfb0a6c-8df4-4d4f-be0f-cda0b9f88a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:50.837564 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfb0a6c-8df4-4d4f-be0f-cda0b9f88a65 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:50.838080 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfb0a6c-8df4-4d4f-be0f-cda0b9f88a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:50.838551 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfb0a6c-8df4-4d4f-be0f-cda0b9f88a65 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:50.839489 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfb0a6c-8df4-4d4f-be0f-cda0b9f88a65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:50.841271 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-edbf41fc-ef33-4207-b2f2-8c2c5dbf72b3 None None] MFA Rules not processed for user `17b779a3e21a415bb42cde5d6863d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:29:50.841732 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfb0a6c-8df4-4d4f-be0f-cda0b9f88a65 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:50.842672 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-edbf41fc-ef33-4207-b2f2-8c2c5dbf72b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:50.851771 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:29:50.864796 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2511/5024] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:29:50 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:29:50.866708 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfb0a6c-8df4-4d4f-be0f-cda0b9f88a65 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:50.874504 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:29:50.878749 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfb0a6c-8df4-4d4f-be0f-cda0b9f88a65 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:50.900183 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e3c7dc-52a1-4b89-a82d-a2ff29f71c68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:50.901434 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e3c7dc-52a1-4b89-a82d-a2ff29f71c68 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:50.901727 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e3c7dc-52a1-4b89-a82d-a2ff29f71c68 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:50.902052 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e3c7dc-52a1-4b89-a82d-a2ff29f71c68 admin admin] PATH_INFO: `/v3/projects/5f74c53385f74e4fb72cf1ba5631c595/users/c56b837eebf54b7fa1f6019d604396dc/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:50.925642 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2514/5025] 10.222.0.17 () {58 vars in 967 bytes} [Sat Jul 23 21:29:50 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:29:50.927243 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e3c7dc-52a1-4b89-a82d-a2ff29f71c68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f74c53385f74e4fb72cf1ba5631c595, user_id=c56b837eebf54b7fa1f6019d604396dc, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:50.930694 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e3c7dc-52a1-4b89-a82d-a2ff29f71c68 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:50.940967 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbf41fc-ef33-4207-b2f2-8c2c5dbf72b3 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:50.965041 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2512/5026] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:29:50 2022] PUT /identity/v3/projects/5f74c53385f74e4fb72cf1ba5631c595/users/c56b837eebf54b7fa1f6019d604396dc/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:29:50.969297 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e3c7dc-52a1-4b89-a82d-a2ff29f71c68 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:51.084379 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbf41fc-ef33-4207-b2f2-8c2c5dbf72b3 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:51.125593 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e3c7dc-52a1-4b89-a82d-a2ff29f71c68 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:51.131833 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e3d94a-35c7-4dc0-bbef-a6e874615cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:51.132747 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e3d94a-35c7-4dc0-bbef-a6e874615cc1 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:51.133119 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e3d94a-35c7-4dc0-bbef-a6e874615cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:51.133463 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e3d94a-35c7-4dc0-bbef-a6e874615cc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:51.134427 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e3d94a-35c7-4dc0-bbef-a6e874615cc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:51.136337 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e3d94a-35c7-4dc0-bbef-a6e874615cc1 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:51.153669 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2513/5027] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:29:50 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 21:29:51.170359 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e3d94a-35c7-4dc0-bbef-a6e874615cc1 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:51.198706 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e3d94a-35c7-4dc0-bbef-a6e874615cc1 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:51.209812 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a20817-35e1-4b32-b575-435babb0feb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:51.211573 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a20817-35e1-4b32-b575-435babb0feb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:51.212009 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a20817-35e1-4b32-b575-435babb0feb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:51.212315 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a20817-35e1-4b32-b575-435babb0feb2 admin admin] PATH_INFO: `/v3/projects/5f74c53385f74e4fb72cf1ba5631c595/users/c56b837eebf54b7fa1f6019d604396dc/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:51.214526 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a20817-35e1-4b32-b575-435babb0feb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f74c53385f74e4fb72cf1ba5631c595, user_id=c56b837eebf54b7fa1f6019d604396dc, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:51.217696 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a20817-35e1-4b32-b575-435babb0feb2 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:51.227908 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfb3da0-7cee-4859-b2bd-3d9d330ef131 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f0a685b7da46afb81024848f079d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:51.228593 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfb3da0-7cee-4859-b2bd-3d9d330ef131 service swift] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:51.228868 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfb3da0-7cee-4859-b2bd-3d9d330ef131 service swift] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:51.229146 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfb3da0-7cee-4859-b2bd-3d9d330ef131 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:51.287850 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2514/5028] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:29:51 2022] PUT /identity/v3/projects/5f74c53385f74e4fb72cf1ba5631c595/users/c56b837eebf54b7fa1f6019d604396dc/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:29:51.290686 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc83242-dded-44fd-acf2-cde09fa9e3e1 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:51.290980 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc83242-dded-44fd-acf2-cde09fa9e3e1 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:51.292716 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc83242-dded-44fd-acf2-cde09fa9e3e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:51.375131 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-4dc83242-dded-44fd-acf2-cde09fa9e3e1 None None] MFA Rules not processed for user `c56b837eebf54b7fa1f6019d604396dc`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:29:51.376701 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-4dc83242-dded-44fd-acf2-cde09fa9e3e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:51.385937 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfb3da0-7cee-4859-b2bd-3d9d330ef131 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:51.388877 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfb3da0-7cee-4859-b2bd-3d9d330ef131 service swift] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:51.401331 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2515/5029] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 23 21:29:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 23 21:29:51.423050 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfb3da0-7cee-4859-b2bd-3d9d330ef131 service swift] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:51.424486 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-7bfb3da0-7cee-4859-b2bd-3d9d330ef131 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:51.459423 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfb3da0-7cee-4859-b2bd-3d9d330ef131 service swift] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:51.490105 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:29:51.608019 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2515/5030] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:29:51 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:29:51.613986 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc83242-dded-44fd-acf2-cde09fa9e3e1 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:51.623556 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-4dc83242-dded-44fd-acf2-cde09fa9e3e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:51.635378 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7481b32b-f9f3-429e-b102-c3184ce88307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:51.636428 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7481b32b-f9f3-429e-b102-c3184ce88307 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:51.636807 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7481b32b-f9f3-429e-b102-c3184ce88307 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:51.637183 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7481b32b-f9f3-429e-b102-c3184ce88307 admin admin] PATH_INFO: `/v3/users/3b566640463e43aa85ec96a1aa76d3f8` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:51.638947 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7481b32b-f9f3-429e-b102-c3184ce88307 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b566640463e43aa85ec96a1aa76d3f8)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:51.641057 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7481b32b-f9f3-429e-b102-c3184ce88307 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:51.723591 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-7481b32b-f9f3-429e-b102-c3184ce88307 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b566640463e43aa85ec96a1aa76d3f8'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:51.745765 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-7481b32b-f9f3-429e-b102-c3184ce88307 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b566640463e43aa85ec96a1aa76d3f8'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:51.746702 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-7481b32b-f9f3-429e-b102-c3184ce88307 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b566640463e43aa85ec96a1aa76d3f8'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:51.760226 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:29:51.764145 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-7481b32b-f9f3-429e-b102-c3184ce88307 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b566640463e43aa85ec96a1aa76d3f8'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:51.797263 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-7481b32b-f9f3-429e-b102-c3184ce88307 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b566640463e43aa85ec96a1aa76d3f8'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:51.819528 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc83242-dded-44fd-acf2-cde09fa9e3e1 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:51.820619 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2516/5031] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:29:51 2022] DELETE /identity/v3/users/3b566640463e43aa85ec96a1aa76d3f8 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:29:51.825034 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7481b32b-f9f3-429e-b102-c3184ce88307 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:51.829298 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-7481b32b-f9f3-429e-b102-c3184ce88307 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:51.993060 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7481b32b-f9f3-429e-b102-c3184ce88307 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:51.997113 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0115a1e-980d-442e-8518-c1653b3f2be6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec5fd3a489c341b7964704d689037f05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:51.997781 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0115a1e-980d-442e-8518-c1653b3f2be6 service cinder] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:52.002389 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0115a1e-980d-442e-8518-c1653b3f2be6 service cinder] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:52.002698 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0115a1e-980d-442e-8518-c1653b3f2be6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:52.006391 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-d0115a1e-980d-442e-8518-c1653b3f2be6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:52.023081 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954c604c-597b-47c2-9ba0-a6f3a1607274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:52.026947 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954c604c-597b-47c2-9ba0-a6f3a1607274 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:52.027930 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954c604c-597b-47c2-9ba0-a6f3a1607274 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:52.029010 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954c604c-597b-47c2-9ba0-a6f3a1607274 admin admin] PATH_INFO: `/v3/users/e72196ba3f73429f9852e1d1280a178c` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:52.034280 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954c604c-597b-47c2-9ba0-a6f3a1607274 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e72196ba3f73429f9852e1d1280a178c)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:52.040262 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954c604c-597b-47c2-9ba0-a6f3a1607274 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:52.075737 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:29:52.097891 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0115a1e-980d-442e-8518-c1653b3f2be6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:52.099423 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0115a1e-980d-442e-8518-c1653b3f2be6 service cinder] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:52.111630 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2517/5032] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:29:51 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:29:52.179838 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-954c604c-597b-47c2-9ba0-a6f3a1607274 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e72196ba3f73429f9852e1d1280a178c'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:52.180435 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-954c604c-597b-47c2-9ba0-a6f3a1607274 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e72196ba3f73429f9852e1d1280a178c'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:52.195780 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-954c604c-597b-47c2-9ba0-a6f3a1607274 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e72196ba3f73429f9852e1d1280a178c'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:52.214747 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-954c604c-597b-47c2-9ba0-a6f3a1607274 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e72196ba3f73429f9852e1d1280a178c'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:52.235526 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0115a1e-980d-442e-8518-c1653b3f2be6 service cinder] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:52.236934 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-d0115a1e-980d-442e-8518-c1653b3f2be6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:52.261210 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-954c604c-597b-47c2-9ba0-a6f3a1607274 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e72196ba3f73429f9852e1d1280a178c'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:52.267945 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0115a1e-980d-442e-8518-c1653b3f2be6 service cinder] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:52.274704 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2516/5033] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:29:51 2022] DELETE /identity/v3/users/e72196ba3f73429f9852e1d1280a178c => generated 0 bytes in 661 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:29:52.279295 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae4024d-5c4a-49b8-b972-3158dea538ae None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:52.279295 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae4024d-5c4a-49b8-b972-3158dea538ae None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:52.279536 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae4024d-5c4a-49b8-b972-3158dea538ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:52.289112 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f425f50-9900-454c-a577-05c8c7e81a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:52.290162 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f425f50-9900-454c-a577-05c8c7e81a52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:52.290359 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f425f50-9900-454c-a577-05c8c7e81a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:52.290703 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f425f50-9900-454c-a577-05c8c7e81a52 admin admin] PATH_INFO: `/v3/projects/f3eef3db6d5f46c9882fbe98cb732263` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:52.291937 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f425f50-9900-454c-a577-05c8c7e81a52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3eef3db6d5f46c9882fbe98cb732263)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:52.294351 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f425f50-9900-454c-a577-05c8c7e81a52 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:52.314412 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-6ae4024d-5c4a-49b8-b972-3158dea538ae None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:29:52.319626 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-6ae4024d-5c4a-49b8-b972-3158dea538ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:52.363122 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-9f425f50-9900-454c-a577-05c8c7e81a52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3eef3db6d5f46c9882fbe98cb732263', 'request_id': 'req-9f425f50-9900-454c-a577-05c8c7e81a52'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:52.382046 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-9f425f50-9900-454c-a577-05c8c7e81a52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3eef3db6d5f46c9882fbe98cb732263', 'request_id': 'req-9f425f50-9900-454c-a577-05c8c7e81a52'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:52.393955 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-9f425f50-9900-454c-a577-05c8c7e81a52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3eef3db6d5f46c9882fbe98cb732263', 'request_id': 'req-9f425f50-9900-454c-a577-05c8c7e81a52'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:52.429042 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-9f425f50-9900-454c-a577-05c8c7e81a52 admin admin] The token cache is being invalidate because project f3eef3db6d5f46c9882fbe98cb732263 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:29:52.429419 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-9f425f50-9900-454c-a577-05c8c7e81a52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:52.430729 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-9f425f50-9900-454c-a577-05c8c7e81a52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:52.433462 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2518/5034] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:29:52 2022] DELETE /identity/v3/projects/f3eef3db6d5f46c9882fbe98cb732263 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:29:52.435126 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f425f50-9900-454c-a577-05c8c7e81a52 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:52.439984 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-9f425f50-9900-454c-a577-05c8c7e81a52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:52.473660 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2517/5035] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:29:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:29:52.475235 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80298f37-b092-412e-9d6b-eb6b2bb40eb6 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:52.475663 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80298f37-b092-412e-9d6b-eb6b2bb40eb6 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:52.475867 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80298f37-b092-412e-9d6b-eb6b2bb40eb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:52.498095 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-80298f37-b092-412e-9d6b-eb6b2bb40eb6 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:29:52.499342 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-80298f37-b092-412e-9d6b-eb6b2bb40eb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:52.506752 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:29:52.563402 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f425f50-9900-454c-a577-05c8c7e81a52 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:52.569516 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b6e332-b124-469c-ae99-b4624584f2ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:52.573798 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b6e332-b124-469c-ae99-b4624584f2ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:52.574351 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b6e332-b124-469c-ae99-b4624584f2ce admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:52.574444 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b6e332-b124-469c-ae99-b4624584f2ce admin admin] PATH_INFO: `/v3/users/affc3572ef7d45249f50b5061a681d18` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:52.576309 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b6e332-b124-469c-ae99-b4624584f2ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=affc3572ef7d45249f50b5061a681d18)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:52.579011 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b6e332-b124-469c-ae99-b4624584f2ce admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:52.622603 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2518/5036] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:29:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:29:52.623482 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80298f37-b092-412e-9d6b-eb6b2bb40eb6 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:52.624802 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-80298f37-b092-412e-9d6b-eb6b2bb40eb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:52.654644 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-06b6e332-b124-469c-ae99-b4624584f2ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'affc3572ef7d45249f50b5061a681d18'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:52.664120 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-06b6e332-b124-469c-ae99-b4624584f2ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'affc3572ef7d45249f50b5061a681d18'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:52.666132 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-06b6e332-b124-469c-ae99-b4624584f2ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'affc3572ef7d45249f50b5061a681d18'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:52.676266 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-06b6e332-b124-469c-ae99-b4624584f2ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'affc3572ef7d45249f50b5061a681d18'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:52.684359 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:29:52.693719 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-06b6e332-b124-469c-ae99-b4624584f2ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'affc3572ef7d45249f50b5061a681d18'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:52.705443 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2519/5037] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:29:52 2022] DELETE /identity/v3/users/affc3572ef7d45249f50b5061a681d18 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:29:52.707063 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae38ba17-380b-4d3f-b97d-21812206f6e1 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:52.707413 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae38ba17-380b-4d3f-b97d-21812206f6e1 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:52.708532 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae38ba17-380b-4d3f-b97d-21812206f6e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:52.720212 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80298f37-b092-412e-9d6b-eb6b2bb40eb6 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:52.733526 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-ae38ba17-380b-4d3f-b97d-21812206f6e1 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:29:52.735167 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-ae38ba17-380b-4d3f-b97d-21812206f6e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:52.794283 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36671869-e9ac-4ed2-9507-832891ea880c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:52.794949 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36671869-e9ac-4ed2-9507-832891ea880c service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:52.795223 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36671869-e9ac-4ed2-9507-832891ea880c service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:52.795494 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36671869-e9ac-4ed2-9507-832891ea880c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:52.799216 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-36671869-e9ac-4ed2-9507-832891ea880c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:52.814643 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2520/5038] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:29:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:29:52.819421 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae38ba17-380b-4d3f-b97d-21812206f6e1 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:52.830649 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae38ba17-380b-4d3f-b97d-21812206f6e1 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:52.840646 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4abc7c-c8d2-4b20-ac72-d0368c2fbe14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:52.841515 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4abc7c-c8d2-4b20-ac72-d0368c2fbe14 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:52.842452 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4abc7c-c8d2-4b20-ac72-d0368c2fbe14 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:52.842760 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4abc7c-c8d2-4b20-ac72-d0368c2fbe14 admin admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:52.844195 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4abc7c-c8d2-4b20-ac72-d0368c2fbe14 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:29:52.844511 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4abc7c-c8d2-4b20-ac72-d0368c2fbe14 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:52.849276 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4abc7c-c8d2-4b20-ac72-d0368c2fbe14 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:52.877932 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2521/5039] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:29:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:29:52.882890 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4abc7c-c8d2-4b20-ac72-d0368c2fbe14 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:52.900208 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4abc7c-c8d2-4b20-ac72-d0368c2fbe14 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:52.905329 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6f2f81-5ac8-47ad-aacb-20f7ade78e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:52.905796 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6f2f81-5ac8-47ad-aacb-20f7ade78e7b admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:52.906457 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6f2f81-5ac8-47ad-aacb-20f7ade78e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:52.906744 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6f2f81-5ac8-47ad-aacb-20f7ade78e7b admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:52.907447 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6f2f81-5ac8-47ad-aacb-20f7ade78e7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:52.910758 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6f2f81-5ac8-47ad-aacb-20f7ade78e7b admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:52.944654 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36671869-e9ac-4ed2-9507-832891ea880c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:52.944854 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2522/5040] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:29:52 2022] POST /identity/v3/projects => generated 383 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:29:52.947373 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36671869-e9ac-4ed2-9507-832891ea880c service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:52.949570 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6f2f81-5ac8-47ad-aacb-20f7ade78e7b admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:52.959808 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2519/5041] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:29:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:29:52.970738 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36671869-e9ac-4ed2-9507-832891ea880c service neutron] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:52.972679 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-36671869-e9ac-4ed2-9507-832891ea880c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:52.990456 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36671869-e9ac-4ed2-9507-832891ea880c service neutron] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:53.023845 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:29:53.033262 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6f2f81-5ac8-47ad-aacb-20f7ade78e7b admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:53.039543 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faa198d-b6ac-46d6-9235-48c5f59480b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:53.040389 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faa198d-b6ac-46d6-9235-48c5f59480b5 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:53.041383 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faa198d-b6ac-46d6-9235-48c5f59480b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:53.041685 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faa198d-b6ac-46d6-9235-48c5f59480b5 admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:53.042897 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faa198d-b6ac-46d6-9235-48c5f59480b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:53.046508 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faa198d-b6ac-46d6-9235-48c5f59480b5 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:53.071706 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2523/5042] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:29:52 2022] POST /identity/v3/users => generated 292 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:29:53.076039 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faa198d-b6ac-46d6-9235-48c5f59480b5 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:53.085111 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da653393-e0dd-47c5-b82e-23cee64cf49c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:53.086025 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faa198d-b6ac-46d6-9235-48c5f59480b5 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:53.086682 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da653393-e0dd-47c5-b82e-23cee64cf49c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:53.086961 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da653393-e0dd-47c5-b82e-23cee64cf49c admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:53.087444 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da653393-e0dd-47c5-b82e-23cee64cf49c admin admin] PATH_INFO: `/v3/projects/a892bfe56afd4ee5bb6c47e926af7349` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:53.088921 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da653393-e0dd-47c5-b82e-23cee64cf49c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a892bfe56afd4ee5bb6c47e926af7349)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:53.090809 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19504cf8-8efb-4147-aa66-c676f68de7b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:53.091405 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da653393-e0dd-47c5-b82e-23cee64cf49c admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:53.091508 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19504cf8-8efb-4147-aa66-c676f68de7b4 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:53.091733 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19504cf8-8efb-4147-aa66-c676f68de7b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:53.092004 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19504cf8-8efb-4147-aa66-c676f68de7b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:53.092754 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19504cf8-8efb-4147-aa66-c676f68de7b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:53.094500 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19504cf8-8efb-4147-aa66-c676f68de7b4 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:53.104834 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2524/5043] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:29:53 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:29:53.110928 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19504cf8-8efb-4147-aa66-c676f68de7b4 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:53.123951 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19504cf8-8efb-4147-aa66-c676f68de7b4 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:53.129982 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a09c0c-250b-4883-9aed-34dd2d2d8f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:53.130728 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a09c0c-250b-4883-9aed-34dd2d2d8f84 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:53.131016 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a09c0c-250b-4883-9aed-34dd2d2d8f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:53.131298 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a09c0c-250b-4883-9aed-34dd2d2d8f84 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:53.132061 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a09c0c-250b-4883-9aed-34dd2d2d8f84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:53.134121 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a09c0c-250b-4883-9aed-34dd2d2d8f84 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:53.148984 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2525/5044] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:29:53 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:29:53.153708 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a09c0c-250b-4883-9aed-34dd2d2d8f84 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:53.165413 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a09c0c-250b-4883-9aed-34dd2d2d8f84 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:53.171028 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-da653393-e0dd-47c5-b82e-23cee64cf49c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a892bfe56afd4ee5bb6c47e926af7349', 'request_id': 'req-da653393-e0dd-47c5-b82e-23cee64cf49c'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:53.190065 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-da653393-e0dd-47c5-b82e-23cee64cf49c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a892bfe56afd4ee5bb6c47e926af7349', 'request_id': 'req-da653393-e0dd-47c5-b82e-23cee64cf49c'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:53.190663 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=95,keystone:DELETE=1,keystone:INSERT=4 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:29:53.198133 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-da653393-e0dd-47c5-b82e-23cee64cf49c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a892bfe56afd4ee5bb6c47e926af7349', 'request_id': 'req-da653393-e0dd-47c5-b82e-23cee64cf49c'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:53.218022 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-da653393-e0dd-47c5-b82e-23cee64cf49c admin admin] The token cache is being invalidate because project a892bfe56afd4ee5bb6c47e926af7349 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:29:53.218374 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-da653393-e0dd-47c5-b82e-23cee64cf49c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:53.219556 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-da653393-e0dd-47c5-b82e-23cee64cf49c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:53.226314 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2520/5045] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:29:52 2022] DELETE /identity/v3/projects/a892bfe56afd4ee5bb6c47e926af7349 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:29:53.227793 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1cbf12-9b23-4a65-a491-36cd590c93a2 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:53.228075 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1cbf12-9b23-4a65-a491-36cd590c93a2 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:53.228345 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1cbf12-9b23-4a65-a491-36cd590c93a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:53.254897 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-7e1cbf12-9b23-4a65-a491-36cd590c93a2 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:29:53.256732 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-7e1cbf12-9b23-4a65-a491-36cd590c93a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:53.290167 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346eeb92-7190-4f53-bf68-9d3dfb876ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:53.291773 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346eeb92-7190-4f53-bf68-9d3dfb876ee0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:53.292056 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346eeb92-7190-4f53-bf68-9d3dfb876ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:53.292334 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346eeb92-7190-4f53-bf68-9d3dfb876ee0 admin admin] PATH_INFO: `/v3/projects/d70f6c96e1ad484aa3207fc01a12d519/users/6ca9644a73d9468aa39b21548a72bded/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:53.327954 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346eeb92-7190-4f53-bf68-9d3dfb876ee0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d70f6c96e1ad484aa3207fc01a12d519, user_id=6ca9644a73d9468aa39b21548a72bded, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:53.341131 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346eeb92-7190-4f53-bf68-9d3dfb876ee0 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:53.373900 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2526/5046] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:29:53 2022] PUT /identity/v3/projects/d70f6c96e1ad484aa3207fc01a12d519/users/6ca9644a73d9468aa39b21548a72bded/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:29:53.383926 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83104e50-0585-4cf9-8670-204d87bfa95e None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:53.388093 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83104e50-0585-4cf9-8670-204d87bfa95e None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:53.388467 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83104e50-0585-4cf9-8670-204d87bfa95e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:53.404745 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2521/5047] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:29:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:29:53.415053 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256fd219-b304-487d-b986-e207d3dfc25c None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:53.415432 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256fd219-b304-487d-b986-e207d3dfc25c None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:53.416865 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256fd219-b304-487d-b986-e207d3dfc25c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:53.440784 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-83104e50-0585-4cf9-8670-204d87bfa95e None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:29:53.442205 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-83104e50-0585-4cf9-8670-204d87bfa95e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:53.451038 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-256fd219-b304-487d-b986-e207d3dfc25c None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:29:53.452295 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-256fd219-b304-487d-b986-e207d3dfc25c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:53.522458 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:29:53.546883 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2522/5048] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:29:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:29:53.547356 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2527/5049] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:29:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:29:53.552618 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256fd219-b304-487d-b986-e207d3dfc25c None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:53.564346 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83104e50-0585-4cf9-8670-204d87bfa95e None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:53.564802 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256fd219-b304-487d-b986-e207d3dfc25c None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:53.565877 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-83104e50-0585-4cf9-8670-204d87bfa95e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:53.570590 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74914631-20d4-4250-9476-8ceca587c59b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:53.571381 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74914631-20d4-4250-9476-8ceca587c59b admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:53.571746 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74914631-20d4-4250-9476-8ceca587c59b admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:53.572072 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74914631-20d4-4250-9476-8ceca587c59b admin admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:53.572883 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74914631-20d4-4250-9476-8ceca587c59b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:29:53.573255 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74914631-20d4-4250-9476-8ceca587c59b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:53.575099 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74914631-20d4-4250-9476-8ceca587c59b admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:53.589904 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2523/5050] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:29:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:29:53.595390 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74914631-20d4-4250-9476-8ceca587c59b admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:53.597191 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-74914631-20d4-4250-9476-8ceca587c59b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:53.611464 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83104e50-0585-4cf9-8670-204d87bfa95e None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:53.620934 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5814bf-adec-4e4c-bc9b-f55bbe0422f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:53.623885 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5814bf-adec-4e4c-bc9b-f55bbe0422f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:53.624558 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5814bf-adec-4e4c-bc9b-f55bbe0422f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:53.626497 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5814bf-adec-4e4c-bc9b-f55bbe0422f1 admin admin] PATH_INFO: `/v3/projects/7c4d1263fd2149fa93e9ebe1455477cf` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:53.628902 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5814bf-adec-4e4c-bc9b-f55bbe0422f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c4d1263fd2149fa93e9ebe1455477cf)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:53.631742 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5814bf-adec-4e4c-bc9b-f55bbe0422f1 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:53.730959 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74914631-20d4-4250-9476-8ceca587c59b admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:53.734952 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-6d5814bf-adec-4e4c-bc9b-f55bbe0422f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c4d1263fd2149fa93e9ebe1455477cf', 'request_id': 'req-6d5814bf-adec-4e4c-bc9b-f55bbe0422f1'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:53.755738 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-6d5814bf-adec-4e4c-bc9b-f55bbe0422f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c4d1263fd2149fa93e9ebe1455477cf', 'request_id': 'req-6d5814bf-adec-4e4c-bc9b-f55bbe0422f1'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:53.769833 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-6d5814bf-adec-4e4c-bc9b-f55bbe0422f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c4d1263fd2149fa93e9ebe1455477cf', 'request_id': 'req-6d5814bf-adec-4e4c-bc9b-f55bbe0422f1'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:53.792690 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-6d5814bf-adec-4e4c-bc9b-f55bbe0422f1 admin admin] The token cache is being invalidate because project 7c4d1263fd2149fa93e9ebe1455477cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:29:53.794699 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-6d5814bf-adec-4e4c-bc9b-f55bbe0422f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:53.796051 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-6d5814bf-adec-4e4c-bc9b-f55bbe0422f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:53.805664 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2528/5051] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:29:53 2022] DELETE /identity/v3/projects/7c4d1263fd2149fa93e9ebe1455477cf => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:29:53.806762 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5814bf-adec-4e4c-bc9b-f55bbe0422f1 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:53.809502 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-6d5814bf-adec-4e4c-bc9b-f55bbe0422f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:53.822757 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcedd74-3e37-4673-a118-fcbb89c00c7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:53.826673 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcedd74-3e37-4673-a118-fcbb89c00c7a service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:53.829244 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcedd74-3e37-4673-a118-fcbb89c00c7a service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:53.830365 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcedd74-3e37-4673-a118-fcbb89c00c7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:53.833219 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-7dcedd74-3e37-4673-a118-fcbb89c00c7a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:53.885115 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:29:53.924254 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcedd74-3e37-4673-a118-fcbb89c00c7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:53.926557 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcedd74-3e37-4673-a118-fcbb89c00c7a service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:53.932126 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5814bf-adec-4e4c-bc9b-f55bbe0422f1 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:53.938245 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d49ba24-c752-4d22-befe-2fe668979be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:53.939436 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d49ba24-c752-4d22-befe-2fe668979be5 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:53.939908 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d49ba24-c752-4d22-befe-2fe668979be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:53.940775 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d49ba24-c752-4d22-befe-2fe668979be5 admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:53.941647 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d49ba24-c752-4d22-befe-2fe668979be5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:53.943514 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2524/5052] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:29:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:29:53.944518 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d49ba24-c752-4d22-befe-2fe668979be5 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:53.947095 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b61a7ca-e5bf-4e5d-8e6b-9d28b23749dd None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:53.947500 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b61a7ca-e5bf-4e5d-8e6b-9d28b23749dd None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:53.948008 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b61a7ca-e5bf-4e5d-8e6b-9d28b23749dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:53.983457 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2529/5053] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:29:53 2022] POST /identity/v3/projects => generated 377 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:29:53.985089 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d49ba24-c752-4d22-befe-2fe668979be5 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:53.999412 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-0b61a7ca-e5bf-4e5d-8e6b-9d28b23749dd None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:29:54.000964 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-0b61a7ca-e5bf-4e5d-8e6b-9d28b23749dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:54.091205 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d49ba24-c752-4d22-befe-2fe668979be5 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:54.102514 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:29:54.112370 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317ac8e3-0290-48fb-bb0f-3cea7b15fde9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:54.113098 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317ac8e3-0290-48fb-bb0f-3cea7b15fde9 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:54.113756 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317ac8e3-0290-48fb-bb0f-3cea7b15fde9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:54.114073 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317ac8e3-0290-48fb-bb0f-3cea7b15fde9 admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:54.114774 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317ac8e3-0290-48fb-bb0f-3cea7b15fde9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:54.119812 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317ac8e3-0290-48fb-bb0f-3cea7b15fde9 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:54.163770 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2525/5054] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:29:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:29:54.169768 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2530/5055] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:29:53 2022] POST /identity/v3/users => generated 289 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:29:54.174889 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317ac8e3-0290-48fb-bb0f-3cea7b15fde9 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:54.175324 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e5cc25-ca43-462c-9355-c4466e067604 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:54.175639 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e5cc25-ca43-462c-9355-c4466e067604 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:54.175971 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e5cc25-ca43-462c-9355-c4466e067604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:54.199108 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317ac8e3-0290-48fb-bb0f-3cea7b15fde9 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:54.206717 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1870dd14-f7fb-4caf-b610-adf50639ce4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:54.208451 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1870dd14-f7fb-4caf-b610-adf50639ce4c admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:54.208954 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1870dd14-f7fb-4caf-b610-adf50639ce4c admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:54.209702 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1870dd14-f7fb-4caf-b610-adf50639ce4c admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:54.210552 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1870dd14-f7fb-4caf-b610-adf50639ce4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:54.212860 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1870dd14-f7fb-4caf-b610-adf50639ce4c admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:54.213698 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-76e5cc25-ca43-462c-9355-c4466e067604 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:29:54.216432 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-76e5cc25-ca43-462c-9355-c4466e067604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:54.225662 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2526/5056] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:29:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:29:54.228990 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2531/5057] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:29:54 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:29:54.229792 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e5cc25-ca43-462c-9355-c4466e067604 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:54.230503 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1870dd14-f7fb-4caf-b610-adf50639ce4c admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:54.241963 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e5cc25-ca43-462c-9355-c4466e067604 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:54.242424 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1870dd14-f7fb-4caf-b610-adf50639ce4c admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:54.247183 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbd8454-593c-4d20-99f1-7253ab72da19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:54.247398 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fae9aa-b4d5-4619-abeb-38280179c3d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:54.248000 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbd8454-593c-4d20-99f1-7253ab72da19 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:54.248179 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fae9aa-b4d5-4619-abeb-38280179c3d0 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:54.248431 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbd8454-593c-4d20-99f1-7253ab72da19 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:54.248546 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fae9aa-b4d5-4619-abeb-38280179c3d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:54.248706 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbd8454-593c-4d20-99f1-7253ab72da19 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:54.248803 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fae9aa-b4d5-4619-abeb-38280179c3d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:54.249437 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbd8454-593c-4d20-99f1-7253ab72da19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:54.250012 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fae9aa-b4d5-4619-abeb-38280179c3d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:29:54.250292 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fae9aa-b4d5-4619-abeb-38280179c3d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:54.251280 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbd8454-593c-4d20-99f1-7253ab72da19 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:54.252087 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fae9aa-b4d5-4619-abeb-38280179c3d0 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:54.268753 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2532/5058] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:29:54 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:29:54.269831 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbd8454-593c-4d20-99f1-7253ab72da19 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:54.274142 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2527/5059] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:29:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 21:29:54.278291 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fae9aa-b4d5-4619-abeb-38280179c3d0 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:54.284323 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbd8454-593c-4d20-99f1-7253ab72da19 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:54.289052 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5716ea24-6560-4176-a64a-ae8716f00f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:54.289216 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fae9aa-b4d5-4619-abeb-38280179c3d0 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:54.290021 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5716ea24-6560-4176-a64a-ae8716f00f57 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:54.290365 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5716ea24-6560-4176-a64a-ae8716f00f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:54.290664 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5716ea24-6560-4176-a64a-ae8716f00f57 admin admin] PATH_INFO: `/v3/projects/283ad662e4b142c7b948cf19fa81146b/users/db63ee7259e14b1a84a90bd6c0387df2/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:54.294166 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d5c81a-8f53-4702-a5b6-785898a869b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:54.294841 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d5c81a-8f53-4702-a5b6-785898a869b0 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:54.295131 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d5c81a-8f53-4702-a5b6-785898a869b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:54.295406 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d5c81a-8f53-4702-a5b6-785898a869b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:54.296144 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d5c81a-8f53-4702-a5b6-785898a869b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:54.298223 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d5c81a-8f53-4702-a5b6-785898a869b0 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:54.307322 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5716ea24-6560-4176-a64a-ae8716f00f57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=283ad662e4b142c7b948cf19fa81146b, user_id=db63ee7259e14b1a84a90bd6c0387df2, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:54.310040 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5716ea24-6560-4176-a64a-ae8716f00f57 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:54.329065 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2533/5060] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:29:54 2022] PUT /identity/v3/projects/283ad662e4b142c7b948cf19fa81146b/users/db63ee7259e14b1a84a90bd6c0387df2/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:29:54.332585 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2528/5061] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:29:54 2022] POST /identity/v3/projects => generated 391 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:29:54.333781 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d5c81a-8f53-4702-a5b6-785898a869b0 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:54.335134 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984608cb-e9f7-443c-88b8-17160300d60b None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:54.335608 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984608cb-e9f7-443c-88b8-17160300d60b None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:54.336021 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984608cb-e9f7-443c-88b8-17160300d60b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:54.355212 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-984608cb-e9f7-443c-88b8-17160300d60b None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:29:54.356447 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-984608cb-e9f7-443c-88b8-17160300d60b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:54.411382 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d5c81a-8f53-4702-a5b6-785898a869b0 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:54.414784 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:29:54.416948 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1762349f-9a2d-4db0-a54e-e912d22c58a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:54.417754 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1762349f-9a2d-4db0-a54e-e912d22c58a3 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:54.418139 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1762349f-9a2d-4db0-a54e-e912d22c58a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:54.418492 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1762349f-9a2d-4db0-a54e-e912d22c58a3 admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:54.419263 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1762349f-9a2d-4db0-a54e-e912d22c58a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:54.421464 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1762349f-9a2d-4db0-a54e-e912d22c58a3 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:54.428400 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2534/5062] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:29:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:29:54.441005 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984608cb-e9f7-443c-88b8-17160300d60b None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:54.445292 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-984608cb-e9f7-443c-88b8-17160300d60b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:54.450010 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2529/5063] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:29:54 2022] POST /identity/v3/users => generated 296 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:29:54.450827 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1762349f-9a2d-4db0-a54e-e912d22c58a3 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:54.462107 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1762349f-9a2d-4db0-a54e-e912d22c58a3 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:54.467093 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b0dfcc-0738-47b9-bb0f-62035cec1854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:54.467856 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b0dfcc-0738-47b9-bb0f-62035cec1854 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:54.468204 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b0dfcc-0738-47b9-bb0f-62035cec1854 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:54.468695 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b0dfcc-0738-47b9-bb0f-62035cec1854 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:54.469492 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b0dfcc-0738-47b9-bb0f-62035cec1854 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:54.471254 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b0dfcc-0738-47b9-bb0f-62035cec1854 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:54.499363 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2530/5064] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:29:54 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:29:54.500570 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b0dfcc-0738-47b9-bb0f-62035cec1854 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:54.514800 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b0dfcc-0738-47b9-bb0f-62035cec1854 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:54.521727 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4952a81a-f864-4876-8caf-feb0a0538f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:54.522168 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984608cb-e9f7-443c-88b8-17160300d60b None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:54.522859 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4952a81a-f864-4876-8caf-feb0a0538f2e admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:54.523204 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4952a81a-f864-4876-8caf-feb0a0538f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:54.523539 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4952a81a-f864-4876-8caf-feb0a0538f2e admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:54.524432 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4952a81a-f864-4876-8caf-feb0a0538f2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:54.526386 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4952a81a-f864-4876-8caf-feb0a0538f2e admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:54.526749 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6944477d-e5c5-4208-a0e2-fcb6dcac13e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:54.527674 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6944477d-e5c5-4208-a0e2-fcb6dcac13e0 service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:54.528145 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6944477d-e5c5-4208-a0e2-fcb6dcac13e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:54.528485 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6944477d-e5c5-4208-a0e2-fcb6dcac13e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:54.539624 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6944477d-e5c5-4208-a0e2-fcb6dcac13e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:54.541216 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6944477d-e5c5-4208-a0e2-fcb6dcac13e0 service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:54.544837 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2531/5065] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:29:54 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:29:54.545845 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4952a81a-f864-4876-8caf-feb0a0538f2e admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:54.555658 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2535/5066] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:29:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 23 21:29:54.561524 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4952a81a-f864-4876-8caf-feb0a0538f2e admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:54.568155 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8331ab2e-3fc3-42be-b803-ae5e91a7527d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:54.570378 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8331ab2e-3fc3-42be-b803-ae5e91a7527d admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:54.570756 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8331ab2e-3fc3-42be-b803-ae5e91a7527d admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:54.571133 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8331ab2e-3fc3-42be-b803-ae5e91a7527d admin admin] PATH_INFO: `/v3/projects/12170b240cf14473905dd80f9eb8f66f/users/80c676ef6f4c4102a3395f9eb8f37d6f/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:54.599042 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8331ab2e-3fc3-42be-b803-ae5e91a7527d admin admin] RBAC: Authorizing `identity:create_grant(project_id=12170b240cf14473905dd80f9eb8f66f, user_id=80c676ef6f4c4102a3395f9eb8f37d6f, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:54.603979 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8331ab2e-3fc3-42be-b803-ae5e91a7527d admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:54.629259 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2532/5067] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:29:54 2022] PUT /identity/v3/projects/12170b240cf14473905dd80f9eb8f66f/users/80c676ef6f4c4102a3395f9eb8f37d6f/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:29:54.641211 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4090c7ce-1a08-4590-bc31-990f5997c035 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:54.641836 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4090c7ce-1a08-4590-bc31-990f5997c035 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:54.642549 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4090c7ce-1a08-4590-bc31-990f5997c035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:54.685360 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-4090c7ce-1a08-4590-bc31-990f5997c035 None None] MFA Rules not processed for user `80c676ef6f4c4102a3395f9eb8f37d6f`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:29:54.686890 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-4090c7ce-1a08-4590-bc31-990f5997c035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:54.847674 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2536/5068] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:29:54 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:29:54.852093 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8331ab2e-3fc3-42be-b803-ae5e91a7527d admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:54.998234 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:29:55.040705 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8331ab2e-3fc3-42be-b803-ae5e91a7527d admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:55.046379 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3708f394-3408-4140-a58b-fb041c60aad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:55.047212 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3708f394-3408-4140-a58b-fb041c60aad8 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:55.047504 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3708f394-3408-4140-a58b-fb041c60aad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:55.047780 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3708f394-3408-4140-a58b-fb041c60aad8 admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:55.048511 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3708f394-3408-4140-a58b-fb041c60aad8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:55.050578 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3708f394-3408-4140-a58b-fb041c60aad8 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:55.084437 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2533/5069] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:29:54 2022] POST /identity/v3/projects => generated 393 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:29:55.085423 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4090c7ce-1a08-4590-bc31-990f5997c035 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:55.097345 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4090c7ce-1a08-4590-bc31-990f5997c035 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:55.200304 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926a298b-c96d-4a67-adbd-45122dabfb7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:55.201040 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926a298b-c96d-4a67-adbd-45122dabfb7c admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:55.201351 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926a298b-c96d-4a67-adbd-45122dabfb7c admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:55.201627 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926a298b-c96d-4a67-adbd-45122dabfb7c admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:55.202409 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926a298b-c96d-4a67-adbd-45122dabfb7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:55.204533 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926a298b-c96d-4a67-adbd-45122dabfb7c admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:55.244515 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2537/5070] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:29:55 2022] POST /identity/v3/users => generated 303 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:29:55.249072 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3708f394-3408-4140-a58b-fb041c60aad8 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:55.272834 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3708f394-3408-4140-a58b-fb041c60aad8 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:55.279086 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bfd39f-0f97-4d9d-b46b-2e71aca10b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:55.280632 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bfd39f-0f97-4d9d-b46b-2e71aca10b42 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:55.281038 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bfd39f-0f97-4d9d-b46b-2e71aca10b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:55.282461 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bfd39f-0f97-4d9d-b46b-2e71aca10b42 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:55.282461 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bfd39f-0f97-4d9d-b46b-2e71aca10b42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:55.284427 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bfd39f-0f97-4d9d-b46b-2e71aca10b42 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:55.306635 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2534/5071] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:29:55 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:29:55.307419 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926a298b-c96d-4a67-adbd-45122dabfb7c admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:55.321029 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926a298b-c96d-4a67-adbd-45122dabfb7c admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:55.345391 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99ced60-fbf1-405d-8141-7393218748ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:55.346348 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99ced60-fbf1-405d-8141-7393218748ca admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:55.346630 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99ced60-fbf1-405d-8141-7393218748ca admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:55.346903 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99ced60-fbf1-405d-8141-7393218748ca admin admin] PATH_INFO: `/v3/projects/b9fa76f9f00a49bab65c73c82c4e88ad/users/6fd62a7b74b14cf0b1a3e27ad4762f39/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:55.380996 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99ced60-fbf1-405d-8141-7393218748ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9fa76f9f00a49bab65c73c82c4e88ad, user_id=6fd62a7b74b14cf0b1a3e27ad4762f39, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:55.385310 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99ced60-fbf1-405d-8141-7393218748ca admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:55.389090 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:29:55.426840 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2538/5072] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:29:55 2022] PUT /identity/v3/projects/b9fa76f9f00a49bab65c73c82c4e88ad/users/6fd62a7b74b14cf0b1a3e27ad4762f39/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:29:55.431198 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bfd39f-0f97-4d9d-b46b-2e71aca10b42 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:55.449202 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bfd39f-0f97-4d9d-b46b-2e71aca10b42 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:55.619751 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccf121f-3720-4063-a6c5-9d883c58d69d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:55.622537 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccf121f-3720-4063-a6c5-9d883c58d69d admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:55.635923 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccf121f-3720-4063-a6c5-9d883c58d69d admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:55.637902 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccf121f-3720-4063-a6c5-9d883c58d69d admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:55.638858 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccf121f-3720-4063-a6c5-9d883c58d69d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:55.641442 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccf121f-3720-4063-a6c5-9d883c58d69d admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:55.670567 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2535/5073] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:29:55 2022] GET /identity/v3/roles => generated 1420 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:29:55.674326 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99ced60-fbf1-405d-8141-7393218748ca admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:55.696730 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99ced60-fbf1-405d-8141-7393218748ca admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:55.708034 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b466b107-b6a2-4d7c-b053-d0ecd61e4096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:55.709285 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b466b107-b6a2-4d7c-b053-d0ecd61e4096 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:55.710294 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b466b107-b6a2-4d7c-b053-d0ecd61e4096 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:55.710501 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b466b107-b6a2-4d7c-b053-d0ecd61e4096 admin admin] PATH_INFO: `/v3/projects/b9fa76f9f00a49bab65c73c82c4e88ad/users/6fd62a7b74b14cf0b1a3e27ad4762f39/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:55.714147 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b466b107-b6a2-4d7c-b053-d0ecd61e4096 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9fa76f9f00a49bab65c73c82c4e88ad, user_id=6fd62a7b74b14cf0b1a3e27ad4762f39, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:55.717978 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b466b107-b6a2-4d7c-b053-d0ecd61e4096 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:55.736208 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2539/5074] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:29:55 2022] PUT /identity/v3/projects/b9fa76f9f00a49bab65c73c82c4e88ad/users/6fd62a7b74b14cf0b1a3e27ad4762f39/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:29:55.752489 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf74c1e8-ddf6-42b5-a71d-a2814fb6f0f7 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:55.753713 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf74c1e8-ddf6-42b5-a71d-a2814fb6f0f7 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:55.753713 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf74c1e8-ddf6-42b5-a71d-a2814fb6f0f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:55.805356 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b466b107-b6a2-4d7c-b053-d0ecd61e4096 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:55.807693 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-b466b107-b6a2-4d7c-b053-d0ecd61e4096 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:55.814437 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-bf74c1e8-ddf6-42b5-a71d-a2814fb6f0f7 None None] MFA Rules not processed for user `6fd62a7b74b14cf0b1a3e27ad4762f39`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:29:55.816253 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-bf74c1e8-ddf6-42b5-a71d-a2814fb6f0f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:55.912705 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b466b107-b6a2-4d7c-b053-d0ecd61e4096 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:55.942730 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e223c82-046f-4905-9f71-fe8b95a28c42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:55.947913 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e223c82-046f-4905-9f71-fe8b95a28c42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:55.948493 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e223c82-046f-4905-9f71-fe8b95a28c42 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:55.948847 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e223c82-046f-4905-9f71-fe8b95a28c42 admin admin] PATH_INFO: `/v3/users/7ce962c9e3f742a184121d8ba4a2b0da` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:55.955086 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e223c82-046f-4905-9f71-fe8b95a28c42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ce962c9e3f742a184121d8ba4a2b0da)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:55.958880 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e223c82-046f-4905-9f71-fe8b95a28c42 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:55.981137 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2536/5075] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:29:55 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:29:55.981834 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf74c1e8-ddf6-42b5-a71d-a2814fb6f0f7 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:55.991547 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-bf74c1e8-ddf6-42b5-a71d-a2814fb6f0f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:56.030437 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-6e223c82-046f-4905-9f71-fe8b95a28c42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ce962c9e3f742a184121d8ba4a2b0da'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:56.043265 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-6e223c82-046f-4905-9f71-fe8b95a28c42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ce962c9e3f742a184121d8ba4a2b0da'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:56.058506 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-6e223c82-046f-4905-9f71-fe8b95a28c42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ce962c9e3f742a184121d8ba4a2b0da'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:56.084352 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-6e223c82-046f-4905-9f71-fe8b95a28c42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ce962c9e3f742a184121d8ba4a2b0da'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:56.099453 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:29:56.115983 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-6e223c82-046f-4905-9f71-fe8b95a28c42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ce962c9e3f742a184121d8ba4a2b0da'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:56.135880 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2540/5076] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:29:55 2022] DELETE /identity/v3/users/7ce962c9e3f742a184121d8ba4a2b0da => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:29:56.139527 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e223c82-046f-4905-9f71-fe8b95a28c42 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:56.145175 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-6e223c82-046f-4905-9f71-fe8b95a28c42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:56.163555 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf74c1e8-ddf6-42b5-a71d-a2814fb6f0f7 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:56.224911 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e223c82-046f-4905-9f71-fe8b95a28c42 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:56.233469 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18f40da-0243-44df-814c-1b13cace87cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:56.233469 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18f40da-0243-44df-814c-1b13cace87cf service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:56.233720 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18f40da-0243-44df-814c-1b13cace87cf service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:56.235117 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18f40da-0243-44df-814c-1b13cace87cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:56.236397 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-d18f40da-0243-44df-814c-1b13cace87cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:56.238850 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118ee923-c091-4ba5-a7cf-322d6ae259f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:56.240852 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118ee923-c091-4ba5-a7cf-322d6ae259f5 service nova] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:56.241843 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118ee923-c091-4ba5-a7cf-322d6ae259f5 service nova] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:56.242627 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118ee923-c091-4ba5-a7cf-322d6ae259f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:56.250229 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-118ee923-c091-4ba5-a7cf-322d6ae259f5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:56.254740 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:INSERT=3,keystone:SELECT=87,keystone:DELETE=10 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:29:56.375615 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18f40da-0243-44df-814c-1b13cace87cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:56.378864 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18f40da-0243-44df-814c-1b13cace87cf service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:56.405683 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2541/5077] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:29:56 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:29:56.408141 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118ee923-c091-4ba5-a7cf-322d6ae259f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:56.410359 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64e8289-2520-4c9b-b599-ec61dd875278 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:56.410969 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118ee923-c091-4ba5-a7cf-322d6ae259f5 service nova] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:56.411349 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64e8289-2520-4c9b-b599-ec61dd875278 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:56.411845 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64e8289-2520-4c9b-b599-ec61dd875278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:56.451644 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-c64e8289-2520-4c9b-b599-ec61dd875278 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:29:56.455393 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-c64e8289-2520-4c9b-b599-ec61dd875278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:56.475474 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2537/5078] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:29:55 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:29:56.570271 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2542/5079] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:29:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:29:56.591264 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118ee923-c091-4ba5-a7cf-322d6ae259f5 service nova] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:56.597564 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-118ee923-c091-4ba5-a7cf-322d6ae259f5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:56.617688 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118ee923-c091-4ba5-a7cf-322d6ae259f5 service nova] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:56.622013 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae10d6c8-86e6-4a1c-8b4e-1e3e65b422e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:56.623844 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae10d6c8-86e6-4a1c-8b4e-1e3e65b422e9 service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:56.624466 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae10d6c8-86e6-4a1c-8b4e-1e3e65b422e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:56.626498 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae10d6c8-86e6-4a1c-8b4e-1e3e65b422e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:56.641764 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae10d6c8-86e6-4a1c-8b4e-1e3e65b422e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:56.644115 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae10d6c8-86e6-4a1c-8b4e-1e3e65b422e9 service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:56.661307 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2538/5080] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:29:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:29:58.430074 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64e8289-2520-4c9b-b599-ec61dd875278 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:58.431822 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-c64e8289-2520-4c9b-b599-ec61dd875278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:29:58.457040 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64e8289-2520-4c9b-b599-ec61dd875278 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:58.474467 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd5dee9-e849-4778-8dd0-14565fa43071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:58.479035 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd5dee9-e849-4778-8dd0-14565fa43071 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:58.479376 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd5dee9-e849-4778-8dd0-14565fa43071 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:58.479662 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd5dee9-e849-4778-8dd0-14565fa43071 admin admin] PATH_INFO: `/v3/projects/3ea6a37075c14ffd82ebba0f0940b8c0` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:58.481173 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd5dee9-e849-4778-8dd0-14565fa43071 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ea6a37075c14ffd82ebba0f0940b8c0)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:58.483219 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd5dee9-e849-4778-8dd0-14565fa43071 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:58.629764 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-9cd5dee9-e849-4778-8dd0-14565fa43071 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ea6a37075c14ffd82ebba0f0940b8c0', 'request_id': 'req-9cd5dee9-e849-4778-8dd0-14565fa43071'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:58.650392 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-9cd5dee9-e849-4778-8dd0-14565fa43071 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ea6a37075c14ffd82ebba0f0940b8c0', 'request_id': 'req-9cd5dee9-e849-4778-8dd0-14565fa43071'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:58.661344 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-9cd5dee9-e849-4778-8dd0-14565fa43071 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ea6a37075c14ffd82ebba0f0940b8c0', 'request_id': 'req-9cd5dee9-e849-4778-8dd0-14565fa43071'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:58.705343 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-9cd5dee9-e849-4778-8dd0-14565fa43071 admin admin] The token cache is being invalidate because project 3ea6a37075c14ffd82ebba0f0940b8c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:29:58.705708 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-9cd5dee9-e849-4778-8dd0-14565fa43071 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:58.706876 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-9cd5dee9-e849-4778-8dd0-14565fa43071 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:58.708573 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2543/5081] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:29:58 2022] DELETE /identity/v3/projects/3ea6a37075c14ffd82ebba0f0940b8c0 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:29:58.713027 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae10d6c8-86e6-4a1c-8b4e-1e3e65b422e9 service neutron] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:29:58.736816 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae10d6c8-86e6-4a1c-8b4e-1e3e65b422e9 service neutron] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:29:58.795037 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:29:58.827318 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ce728e-7569-43b7-aac2-72513a382d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:29:58.828438 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ce728e-7569-43b7-aac2-72513a382d7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:29:58.828853 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ce728e-7569-43b7-aac2-72513a382d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:29:58.829123 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ce728e-7569-43b7-aac2-72513a382d7e admin admin] PATH_INFO: `/v3/users/c56b837eebf54b7fa1f6019d604396dc` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:29:58.830734 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ce728e-7569-43b7-aac2-72513a382d7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c56b837eebf54b7fa1f6019d604396dc)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:29:58.832769 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ce728e-7569-43b7-aac2-72513a382d7e admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:29:58.905607 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c6ce728e-7569-43b7-aac2-72513a382d7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c56b837eebf54b7fa1f6019d604396dc'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:58.906460 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c6ce728e-7569-43b7-aac2-72513a382d7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c56b837eebf54b7fa1f6019d604396dc'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:58.915998 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c6ce728e-7569-43b7-aac2-72513a382d7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c56b837eebf54b7fa1f6019d604396dc'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:58.931944 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c6ce728e-7569-43b7-aac2-72513a382d7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c56b837eebf54b7fa1f6019d604396dc'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:58.948921 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c6ce728e-7569-43b7-aac2-72513a382d7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c56b837eebf54b7fa1f6019d604396dc'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:29:58.960427 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2539/5082] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:29:58 2022] DELETE /identity/v3/users/c56b837eebf54b7fa1f6019d604396dc => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:30:01.187946 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd5dee9-e849-4778-8dd0-14565fa43071 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:30:01.191493 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-9cd5dee9-e849-4778-8dd0-14565fa43071 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:30:01.214147 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd5dee9-e849-4778-8dd0-14565fa43071 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:30:01.279204 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:30:01.335854 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9d041d-0d3d-492d-ace0-16174c7d85d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:30:01.336768 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9d041d-0d3d-492d-ace0-16174c7d85d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:01.337050 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9d041d-0d3d-492d-ace0-16174c7d85d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:01.337334 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9d041d-0d3d-492d-ace0-16174c7d85d4 admin admin] PATH_INFO: `/v3/projects/5f74c53385f74e4fb72cf1ba5631c595` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:01.339629 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9d041d-0d3d-492d-ace0-16174c7d85d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f74c53385f74e4fb72cf1ba5631c595)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:30:01.341594 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9d041d-0d3d-492d-ace0-16174c7d85d4 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:30:01.449397 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-2a9d041d-0d3d-492d-ace0-16174c7d85d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f74c53385f74e4fb72cf1ba5631c595', 'request_id': 'req-2a9d041d-0d3d-492d-ace0-16174c7d85d4'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:30:01.463798 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-2a9d041d-0d3d-492d-ace0-16174c7d85d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f74c53385f74e4fb72cf1ba5631c595', 'request_id': 'req-2a9d041d-0d3d-492d-ace0-16174c7d85d4'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:30:01.478741 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-2a9d041d-0d3d-492d-ace0-16174c7d85d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f74c53385f74e4fb72cf1ba5631c595', 'request_id': 'req-2a9d041d-0d3d-492d-ace0-16174c7d85d4'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:30:01.506669 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-2a9d041d-0d3d-492d-ace0-16174c7d85d4 admin admin] The token cache is being invalidate because project 5f74c53385f74e4fb72cf1ba5631c595 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:30:01.506960 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-2a9d041d-0d3d-492d-ace0-16174c7d85d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:30:01.507767 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-2a9d041d-0d3d-492d-ace0-16174c7d85d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:30:01.509735 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2544/5083] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:30:01 2022] DELETE /identity/v3/projects/5f74c53385f74e4fb72cf1ba5631c595 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:30:01.514585 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041d4fce-3655-49a0-8814-87dc5b49db90 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:01.515144 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041d4fce-3655-49a0-8814-87dc5b49db90 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:01.515240 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041d4fce-3655-49a0-8814-87dc5b49db90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:01.546878 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-041d4fce-3655-49a0-8814-87dc5b49db90 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:30:01.548409 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-041d4fce-3655-49a0-8814-87dc5b49db90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:30:01.655387 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2540/5084] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:30:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:30:01.657109 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675fe5ce-cdb9-4a5a-a238-c4d4c19d5a6c None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:01.657471 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675fe5ce-cdb9-4a5a-a238-c4d4c19d5a6c None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:01.657831 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675fe5ce-cdb9-4a5a-a238-c4d4c19d5a6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:01.679333 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-675fe5ce-cdb9-4a5a-a238-c4d4c19d5a6c None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:30:01.681273 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-675fe5ce-cdb9-4a5a-a238-c4d4c19d5a6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:30:01.693991 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2545/5085] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:30:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:30:01.698211 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041d4fce-3655-49a0-8814-87dc5b49db90 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:30:01.708993 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041d4fce-3655-49a0-8814-87dc5b49db90 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:30:01.714058 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff50f260-26f5-427d-89de-8a7d1ff5a7d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:30:01.714730 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff50f260-26f5-427d-89de-8a7d1ff5a7d2 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:01.715010 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff50f260-26f5-427d-89de-8a7d1ff5a7d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:01.715286 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff50f260-26f5-427d-89de-8a7d1ff5a7d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:01.716024 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff50f260-26f5-427d-89de-8a7d1ff5a7d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:30:01.716322 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff50f260-26f5-427d-89de-8a7d1ff5a7d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:30:01.718165 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff50f260-26f5-427d-89de-8a7d1ff5a7d2 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:30:01.738125 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2541/5086] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:30:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:30:01.738721 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675fe5ce-cdb9-4a5a-a238-c4d4c19d5a6c None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:30:01.752845 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675fe5ce-cdb9-4a5a-a238-c4d4c19d5a6c None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:30:01.759485 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483500fd-acc1-4b54-aa10-9454e8982a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:30:01.760739 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483500fd-acc1-4b54-aa10-9454e8982a93 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:01.761027 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483500fd-acc1-4b54-aa10-9454e8982a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:01.761341 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483500fd-acc1-4b54-aa10-9454e8982a93 admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:01.762042 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483500fd-acc1-4b54-aa10-9454e8982a93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:30:01.763997 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483500fd-acc1-4b54-aa10-9454e8982a93 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:30:01.803538 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2546/5087] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:30:01 2022] POST /identity/v3/projects => generated 385 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:30:01.808591 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff50f260-26f5-427d-89de-8a7d1ff5a7d2 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:30:01.822381 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff50f260-26f5-427d-89de-8a7d1ff5a7d2 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:30:01.876611 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:30:01.912252 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb230398-8f27-495c-9751-3ba5f3a1dcc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:30:01.913729 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb230398-8f27-495c-9751-3ba5f3a1dcc2 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:01.914064 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb230398-8f27-495c-9751-3ba5f3a1dcc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:01.914339 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb230398-8f27-495c-9751-3ba5f3a1dcc2 admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:01.915237 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb230398-8f27-495c-9751-3ba5f3a1dcc2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:30:01.917300 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb230398-8f27-495c-9751-3ba5f3a1dcc2 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:30:01.950939 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2542/5088] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:30:01 2022] POST /identity/v3/users => generated 293 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:30:01.954930 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483500fd-acc1-4b54-aa10-9454e8982a93 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:30:01.971170 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483500fd-acc1-4b54-aa10-9454e8982a93 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:30:01.982191 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217adef0-5343-4263-8ebe-42d17bffe95c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:30:01.984560 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217adef0-5343-4263-8ebe-42d17bffe95c admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:01.985489 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217adef0-5343-4263-8ebe-42d17bffe95c admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:01.985982 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217adef0-5343-4263-8ebe-42d17bffe95c admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:01.987747 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217adef0-5343-4263-8ebe-42d17bffe95c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:30:01.989790 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217adef0-5343-4263-8ebe-42d17bffe95c admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:30:02.009451 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2547/5089] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:30:01 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:30:02.014049 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb230398-8f27-495c-9751-3ba5f3a1dcc2 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:30:02.032474 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb230398-8f27-495c-9751-3ba5f3a1dcc2 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:30:02.070594 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4af04a-4ab3-4150-b6e5-7d3d418ddc0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:30:02.072277 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4af04a-4ab3-4150-b6e5-7d3d418ddc0f admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:02.073628 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4af04a-4ab3-4150-b6e5-7d3d418ddc0f admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:02.074150 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4af04a-4ab3-4150-b6e5-7d3d418ddc0f admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:02.075103 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4af04a-4ab3-4150-b6e5-7d3d418ddc0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:30:02.077671 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4af04a-4ab3-4150-b6e5-7d3d418ddc0f admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:30:02.096895 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2543/5090] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:30:02 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:30:02.101263 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217adef0-5343-4263-8ebe-42d17bffe95c admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:30:02.112144 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217adef0-5343-4263-8ebe-42d17bffe95c admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:30:02.117259 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56079ea9-324f-4a75-90ec-545244942c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:30:02.118170 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56079ea9-324f-4a75-90ec-545244942c08 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:02.118518 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56079ea9-324f-4a75-90ec-545244942c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:02.118806 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56079ea9-324f-4a75-90ec-545244942c08 admin admin] PATH_INFO: `/v3/projects/73fc917381914b7eb60d35f046459b0e/users/b66e12db984b468385568f9fc56b4ddb/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:02.138248 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56079ea9-324f-4a75-90ec-545244942c08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73fc917381914b7eb60d35f046459b0e, user_id=b66e12db984b468385568f9fc56b4ddb, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:30:02.141065 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56079ea9-324f-4a75-90ec-545244942c08 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:30:02.187299 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2548/5091] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:30:02 2022] PUT /identity/v3/projects/73fc917381914b7eb60d35f046459b0e/users/b66e12db984b468385568f9fc56b4ddb/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:30:02.192927 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7034b0e-204e-4065-bdab-c7a886602ae0 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:02.193295 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7034b0e-204e-4065-bdab-c7a886602ae0 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:02.193713 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7034b0e-204e-4065-bdab-c7a886602ae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:02.249688 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-f7034b0e-204e-4065-bdab-c7a886602ae0 None None] MFA Rules not processed for user `b66e12db984b468385568f9fc56b4ddb`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:30:02.251442 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-f7034b0e-204e-4065-bdab-c7a886602ae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:30:02.396022 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2544/5092] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:30:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:30:02.397830 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56079ea9-324f-4a75-90ec-545244942c08 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:30:02.551220 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56079ea9-324f-4a75-90ec-545244942c08 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:30:02.564411 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d56b05-a1c9-46b2-a0d8-8b77c249aefe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:30:02.565037 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d56b05-a1c9-46b2-a0d8-8b77c249aefe admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:02.565315 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d56b05-a1c9-46b2-a0d8-8b77c249aefe admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:02.565593 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d56b05-a1c9-46b2-a0d8-8b77c249aefe admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:02.566348 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d56b05-a1c9-46b2-a0d8-8b77c249aefe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:30:02.568257 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d56b05-a1c9-46b2-a0d8-8b77c249aefe admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:30:02.578825 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:30:02.639818 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2549/5093] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:30:02 2022] POST /identity/v3/projects => generated 383 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:30:02.641155 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7034b0e-204e-4065-bdab-c7a886602ae0 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:30:02.663164 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7034b0e-204e-4065-bdab-c7a886602ae0 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:30:02.795738 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2c0ce5-8da9-4a60-9be6-3e6348d43a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:30:02.796504 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2c0ce5-8da9-4a60-9be6-3e6348d43a87 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:02.796787 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2c0ce5-8da9-4a60-9be6-3e6348d43a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:02.797058 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2c0ce5-8da9-4a60-9be6-3e6348d43a87 admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:02.797753 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2c0ce5-8da9-4a60-9be6-3e6348d43a87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:30:02.799731 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2c0ce5-8da9-4a60-9be6-3e6348d43a87 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:30:02.871956 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2545/5094] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:30:02 2022] POST /identity/v3/users => generated 298 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:30:02.873214 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d56b05-a1c9-46b2-a0d8-8b77c249aefe admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:30:02.886872 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d56b05-a1c9-46b2-a0d8-8b77c249aefe admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:30:02.898389 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1655f29a-073d-4741-8479-941823a74741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:30:02.899082 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1655f29a-073d-4741-8479-941823a74741 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:02.899361 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1655f29a-073d-4741-8479-941823a74741 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:02.899632 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1655f29a-073d-4741-8479-941823a74741 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:02.900364 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1655f29a-073d-4741-8479-941823a74741 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:30:02.902016 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1655f29a-073d-4741-8479-941823a74741 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:30:02.937605 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2c0ce5-8da9-4a60-9be6-3e6348d43a87 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:30:02.938056 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2550/5095] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:30:02 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:30:02.949786 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2c0ce5-8da9-4a60-9be6-3e6348d43a87 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:30:02.971099 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b256bb-84a4-4988-a38c-6d4805d76a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:30:02.972039 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b256bb-84a4-4988-a38c-6d4805d76a95 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:02.972314 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b256bb-84a4-4988-a38c-6d4805d76a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:02.972581 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b256bb-84a4-4988-a38c-6d4805d76a95 admin admin] PATH_INFO: `/v3/projects/7528a2b240f440248c1db211d6c5dbf4/users/a1a673168f544a79a94333cbaa606486/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:03.001220 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b256bb-84a4-4988-a38c-6d4805d76a95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7528a2b240f440248c1db211d6c5dbf4, user_id=a1a673168f544a79a94333cbaa606486, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:30:03.003927 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b256bb-84a4-4988-a38c-6d4805d76a95 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:30:03.033928 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2546/5096] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:30:02 2022] PUT /identity/v3/projects/7528a2b240f440248c1db211d6c5dbf4/users/a1a673168f544a79a94333cbaa606486/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:30:03.038072 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1655f29a-073d-4741-8479-941823a74741 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:30:03.052768 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1655f29a-073d-4741-8479-941823a74741 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:30:03.195155 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58c3a24-6d68-411e-ae11-5bb7725ae241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:30:03.201530 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58c3a24-6d68-411e-ae11-5bb7725ae241 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:03.202181 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58c3a24-6d68-411e-ae11-5bb7725ae241 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:03.202840 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58c3a24-6d68-411e-ae11-5bb7725ae241 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:03.204582 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58c3a24-6d68-411e-ae11-5bb7725ae241 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:30:03.206439 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58c3a24-6d68-411e-ae11-5bb7725ae241 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:30:03.228825 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2551/5097] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:30:03 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 21:30:03.233234 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b256bb-84a4-4988-a38c-6d4805d76a95 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:30:03.248601 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b256bb-84a4-4988-a38c-6d4805d76a95 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:30:03.264069 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991f62ef-418b-490b-b162-9481fa0ce44a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:30:03.266352 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991f62ef-418b-490b-b162-9481fa0ce44a admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:03.266785 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991f62ef-418b-490b-b162-9481fa0ce44a admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:03.270185 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991f62ef-418b-490b-b162-9481fa0ce44a admin admin] PATH_INFO: `/v3/projects/7528a2b240f440248c1db211d6c5dbf4/users/a1a673168f544a79a94333cbaa606486/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:03.273216 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991f62ef-418b-490b-b162-9481fa0ce44a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7528a2b240f440248c1db211d6c5dbf4, user_id=a1a673168f544a79a94333cbaa606486, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:30:03.278766 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991f62ef-418b-490b-b162-9481fa0ce44a admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:30:03.290123 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:30:03.307072 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2547/5098] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:30:03 2022] PUT /identity/v3/projects/7528a2b240f440248c1db211d6c5dbf4/users/a1a673168f544a79a94333cbaa606486/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:30:03.318806 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2da5bfe-33f4-4fbb-9300-7eaacf8be59d None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:03.319667 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2da5bfe-33f4-4fbb-9300-7eaacf8be59d None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:03.320013 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2da5bfe-33f4-4fbb-9300-7eaacf8be59d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:03.352660 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-e2da5bfe-33f4-4fbb-9300-7eaacf8be59d None None] MFA Rules not processed for user `a1a673168f544a79a94333cbaa606486`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:30:03.354562 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-e2da5bfe-33f4-4fbb-9300-7eaacf8be59d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:30:03.493049 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2552/5099] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:30:03 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:30:03.499715 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991f62ef-418b-490b-b162-9481fa0ce44a admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:30:03.501429 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-991f62ef-418b-490b-b162-9481fa0ce44a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:30:03.613552 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991f62ef-418b-490b-b162-9481fa0ce44a admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:30:03.617967 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2640f4ae-3749-4391-899e-100b1d762277 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec5fd3a489c341b7964704d689037f05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:30:03.618658 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2640f4ae-3749-4391-899e-100b1d762277 service cinder] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:03.618930 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2640f4ae-3749-4391-899e-100b1d762277 service cinder] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:03.619200 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2640f4ae-3749-4391-899e-100b1d762277 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:03.735809 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2640f4ae-3749-4391-899e-100b1d762277 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:30:03.737740 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2640f4ae-3749-4391-899e-100b1d762277 service cinder] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:30:03.763126 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2548/5100] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:30:03 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:30:04.653229 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdef5d03-19da-4692-bcf3-3b4ee64aa879 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:04.653772 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdef5d03-19da-4692-bcf3-3b4ee64aa879 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:04.654236 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdef5d03-19da-4692-bcf3-3b4ee64aa879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:04.694173 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-fdef5d03-19da-4692-bcf3-3b4ee64aa879 None None] MFA Rules not processed for user `db63ee7259e14b1a84a90bd6c0387df2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:30:04.695472 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-fdef5d03-19da-4692-bcf3-3b4ee64aa879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:30:04.807317 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:30:04.852529 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2553/5101] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:30:04 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:30:04.857732 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2640f4ae-3749-4391-899e-100b1d762277 service cinder] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:30:04.876599 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-2640f4ae-3749-4391-899e-100b1d762277 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:30:05.077264 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2640f4ae-3749-4391-899e-100b1d762277 service cinder] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:30:05.088799 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ed8d0a-dbd9-4c81-81ab-2a609aebc4d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:30:05.090475 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ed8d0a-dbd9-4c81-81ab-2a609aebc4d2 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:05.091056 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ed8d0a-dbd9-4c81-81ab-2a609aebc4d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:05.094420 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ed8d0a-dbd9-4c81-81ab-2a609aebc4d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:05.094420 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ed8d0a-dbd9-4c81-81ab-2a609aebc4d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:30:05.097121 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ed8d0a-dbd9-4c81-81ab-2a609aebc4d2 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:30:05.165838 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2549/5102] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:30:04 2022] POST /identity/v3/projects => generated 377 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:30:05.172920 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdef5d03-19da-4692-bcf3-3b4ee64aa879 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:30:05.194309 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdef5d03-19da-4692-bcf3-3b4ee64aa879 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:30:05.388285 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d24784-85a0-4466-8afe-0d7d1007afb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:30:05.390900 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d24784-85a0-4466-8afe-0d7d1007afb0 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:05.390900 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d24784-85a0-4466-8afe-0d7d1007afb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:05.390900 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d24784-85a0-4466-8afe-0d7d1007afb0 admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:05.391141 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d24784-85a0-4466-8afe-0d7d1007afb0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:30:05.397131 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d24784-85a0-4466-8afe-0d7d1007afb0 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:30:05.447626 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2554/5103] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:30:05 2022] POST /identity/v3/users => generated 295 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:30:05.454815 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ed8d0a-dbd9-4c81-81ab-2a609aebc4d2 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:30:05.508327 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ed8d0a-dbd9-4c81-81ab-2a609aebc4d2 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:30:05.526429 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d24784-85a0-4466-8afe-0d7d1007afb0 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:30:05.528215 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-81d24784-85a0-4466-8afe-0d7d1007afb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:30:05.545527 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8242f586-1434-42b1-ba61-8639abe97154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:30:05.545527 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8242f586-1434-42b1-ba61-8639abe97154 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:05.545527 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8242f586-1434-42b1-ba61-8639abe97154 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:05.545527 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8242f586-1434-42b1-ba61-8639abe97154 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:05.578045 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8242f586-1434-42b1-ba61-8639abe97154 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:30:05.593064 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d24784-85a0-4466-8afe-0d7d1007afb0 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:30:05.604717 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8242f586-1434-42b1-ba61-8639abe97154 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:30:05.610492 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ca2275-ba76-41cf-8c22-512e8ecfec8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:30:05.611618 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ca2275-ba76-41cf-8c22-512e8ecfec8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:05.622006 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ca2275-ba76-41cf-8c22-512e8ecfec8e admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:05.623726 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ca2275-ba76-41cf-8c22-512e8ecfec8e admin admin] PATH_INFO: `/v3/users/80c676ef6f4c4102a3395f9eb8f37d6f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:05.626359 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ca2275-ba76-41cf-8c22-512e8ecfec8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=80c676ef6f4c4102a3395f9eb8f37d6f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:30:05.632781 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ca2275-ba76-41cf-8c22-512e8ecfec8e admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:30:05.688251 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2550/5104] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:30:05 2022] GET /identity/v3/roles => generated 1420 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:30:05.689258 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8242f586-1434-42b1-ba61-8639abe97154 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:30:05.728341 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8242f586-1434-42b1-ba61-8639abe97154 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:30:05.739648 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adf9f52-7325-4195-bf05-fa17f4cdbe85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:30:05.740609 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adf9f52-7325-4195-bf05-fa17f4cdbe85 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:05.741044 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adf9f52-7325-4195-bf05-fa17f4cdbe85 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:05.741437 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adf9f52-7325-4195-bf05-fa17f4cdbe85 admin admin] PATH_INFO: `/v3/projects/83653c6402584422a314855a924c1d0c/users/a40e57fa4476483ab518a4a9d2ed7989/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:05.793079 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-98ca2275-ba76-41cf-8c22-512e8ecfec8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80c676ef6f4c4102a3395f9eb8f37d6f'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:30:05.797850 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adf9f52-7325-4195-bf05-fa17f4cdbe85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83653c6402584422a314855a924c1d0c, user_id=a40e57fa4476483ab518a4a9d2ed7989, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:30:05.802080 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adf9f52-7325-4195-bf05-fa17f4cdbe85 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:30:05.829611 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-98ca2275-ba76-41cf-8c22-512e8ecfec8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80c676ef6f4c4102a3395f9eb8f37d6f'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:30:05.830924 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-98ca2275-ba76-41cf-8c22-512e8ecfec8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80c676ef6f4c4102a3395f9eb8f37d6f'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:30:05.853124 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-98ca2275-ba76-41cf-8c22-512e8ecfec8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80c676ef6f4c4102a3395f9eb8f37d6f'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:30:05.873310 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2551/5105] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:30:05 2022] PUT /identity/v3/projects/83653c6402584422a314855a924c1d0c/users/a40e57fa4476483ab518a4a9d2ed7989/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:30:05.881430 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adf9f52-7325-4195-bf05-fa17f4cdbe85 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:30:05.895542 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:30:05.901237 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-98ca2275-ba76-41cf-8c22-512e8ecfec8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80c676ef6f4c4102a3395f9eb8f37d6f'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:30:05.919894 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2555/5106] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:30:05 2022] DELETE /identity/v3/users/80c676ef6f4c4102a3395f9eb8f37d6f => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:30:05.927261 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fbeff5-e06e-49c8-bda0-08ac93ed5006 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:05.927890 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fbeff5-e06e-49c8-bda0-08ac93ed5006 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:05.928488 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fbeff5-e06e-49c8-bda0-08ac93ed5006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:05.970170 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-53fbeff5-e06e-49c8-bda0-08ac93ed5006 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:30:05.972251 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-53fbeff5-e06e-49c8-bda0-08ac93ed5006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:30:06.066313 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adf9f52-7325-4195-bf05-fa17f4cdbe85 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:30:06.086489 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:30:06.129146 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2556/5107] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:30:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:30:06.130477 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fbeff5-e06e-49c8-bda0-08ac93ed5006 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:30:06.132205 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-53fbeff5-e06e-49c8-bda0-08ac93ed5006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:30:06.152205 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fbeff5-e06e-49c8-bda0-08ac93ed5006 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:30:06.165790 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db4e940-b612-4fc8-91a4-e1654840d232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:30:06.166968 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db4e940-b612-4fc8-91a4-e1654840d232 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:06.167521 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db4e940-b612-4fc8-91a4-e1654840d232 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:06.168108 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db4e940-b612-4fc8-91a4-e1654840d232 admin admin] PATH_INFO: `/v3/users/b66e12db984b468385568f9fc56b4ddb` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:06.169400 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db4e940-b612-4fc8-91a4-e1654840d232 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b66e12db984b468385568f9fc56b4ddb)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:30:06.181731 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db4e940-b612-4fc8-91a4-e1654840d232 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:30:06.248740 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f455117-1025-41e8-968f-eaba996b7206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:30:06.249515 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f455117-1025-41e8-968f-eaba996b7206 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:06.250880 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f455117-1025-41e8-968f-eaba996b7206 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:06.251166 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f455117-1025-41e8-968f-eaba996b7206 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:06.253917 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f455117-1025-41e8-968f-eaba996b7206 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:30:06.258239 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f455117-1025-41e8-968f-eaba996b7206 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:30:06.297054 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2552/5108] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:30:05 2022] GET /identity/v3/roles => generated 1420 bytes in 416 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:30:06.300589 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f455117-1025-41e8-968f-eaba996b7206 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:30:06.303856 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-8f455117-1025-41e8-968f-eaba996b7206 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:30:06.307823 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-1db4e940-b612-4fc8-91a4-e1654840d232 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b66e12db984b468385568f9fc56b4ddb'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:30:06.330339 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-1db4e940-b612-4fc8-91a4-e1654840d232 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b66e12db984b468385568f9fc56b4ddb'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:30:06.333063 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-1db4e940-b612-4fc8-91a4-e1654840d232 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b66e12db984b468385568f9fc56b4ddb'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:30:06.352612 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-1db4e940-b612-4fc8-91a4-e1654840d232 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b66e12db984b468385568f9fc56b4ddb'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:30:06.388533 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-1db4e940-b612-4fc8-91a4-e1654840d232 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b66e12db984b468385568f9fc56b4ddb'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:30:06.409621 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2557/5109] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:30:06 2022] DELETE /identity/v3/users/b66e12db984b468385568f9fc56b4ddb => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:30:06.411302 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db4e940-b612-4fc8-91a4-e1654840d232 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:30:06.415180 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-1db4e940-b612-4fc8-91a4-e1654840d232 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:30:06.503705 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f455117-1025-41e8-968f-eaba996b7206 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:30:06.604830 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db4e940-b612-4fc8-91a4-e1654840d232 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:30:06.627856 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e48d901-5537-4873-af21-ff298f57129c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:30:06.629108 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e48d901-5537-4873-af21-ff298f57129c admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:06.629550 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e48d901-5537-4873-af21-ff298f57129c admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:06.630564 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e48d901-5537-4873-af21-ff298f57129c admin admin] PATH_INFO: `/v3/projects/83653c6402584422a314855a924c1d0c/users/a40e57fa4476483ab518a4a9d2ed7989/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:06.646588 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e48d901-5537-4873-af21-ff298f57129c admin admin] RBAC: Authorizing `identity:create_grant(project_id=83653c6402584422a314855a924c1d0c, user_id=a40e57fa4476483ab518a4a9d2ed7989, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:30:06.650427 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e48d901-5537-4873-af21-ff298f57129c admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:30:06.671294 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2558/5110] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:30:06 2022] PUT /identity/v3/projects/83653c6402584422a314855a924c1d0c/users/a40e57fa4476483ab518a4a9d2ed7989/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:30:06.674131 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd8fd54-3d2e-4549-9168-cebe411cce41 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:06.674653 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd8fd54-3d2e-4549-9168-cebe411cce41 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:06.675127 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd8fd54-3d2e-4549-9168-cebe411cce41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:06.677657 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a6f5f1-4348-4e0a-a2b5-de7666c73c6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:30:06.678420 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a6f5f1-4348-4e0a-a2b5-de7666c73c6b service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:06.678711 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a6f5f1-4348-4e0a-a2b5-de7666c73c6b service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:06.678986 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a6f5f1-4348-4e0a-a2b5-de7666c73c6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:06.683267 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-c1a6f5f1-4348-4e0a-a2b5-de7666c73c6b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:30:06.697640 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-ccd8fd54-3d2e-4549-9168-cebe411cce41 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:30:06.699999 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-ccd8fd54-3d2e-4549-9168-cebe411cce41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:30:06.712303 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a6f5f1-4348-4e0a-a2b5-de7666c73c6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:30:06.713784 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a6f5f1-4348-4e0a-a2b5-de7666c73c6b service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:30:06.735359 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2553/5111] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:30:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:30:06.793818 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:30:06.822684 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2559/5112] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:30:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:30:06.838208 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a6f5f1-4348-4e0a-a2b5-de7666c73c6b service neutron] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:30:06.839588 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-c1a6f5f1-4348-4e0a-a2b5-de7666c73c6b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:30:06.861991 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a6f5f1-4348-4e0a-a2b5-de7666c73c6b service neutron] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:30:06.871492 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:30:06.946943 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb45cca-350e-4c98-81e8-576e8a75cdef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:30:06.947637 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb45cca-350e-4c98-81e8-576e8a75cdef service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:06.948274 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb45cca-350e-4c98-81e8-576e8a75cdef service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:06.948792 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb45cca-350e-4c98-81e8-576e8a75cdef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:06.985371 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb45cca-350e-4c98-81e8-576e8a75cdef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:30:06.986995 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb45cca-350e-4c98-81e8-576e8a75cdef service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:30:07.005582 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2554/5113] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:30:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:30:07.592042 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd8fd54-3d2e-4549-9168-cebe411cce41 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:30:07.593618 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-ccd8fd54-3d2e-4549-9168-cebe411cce41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:30:07.625603 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd8fd54-3d2e-4549-9168-cebe411cce41 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:30:07.646624 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97388ab-53e0-4b7c-a5db-40604937e600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:30:07.650293 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97388ab-53e0-4b7c-a5db-40604937e600 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:07.650719 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97388ab-53e0-4b7c-a5db-40604937e600 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:07.652039 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97388ab-53e0-4b7c-a5db-40604937e600 admin admin] PATH_INFO: `/v3/users/ca13fa56f9a342b69f198080ef10acaa` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:07.654734 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97388ab-53e0-4b7c-a5db-40604937e600 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca13fa56f9a342b69f198080ef10acaa)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:30:07.665984 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97388ab-53e0-4b7c-a5db-40604937e600 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:30:07.792570 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-f97388ab-53e0-4b7c-a5db-40604937e600 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca13fa56f9a342b69f198080ef10acaa'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:30:07.810266 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-f97388ab-53e0-4b7c-a5db-40604937e600 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca13fa56f9a342b69f198080ef10acaa'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:30:07.819281 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-f97388ab-53e0-4b7c-a5db-40604937e600 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca13fa56f9a342b69f198080ef10acaa'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:30:07.839062 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-f97388ab-53e0-4b7c-a5db-40604937e600 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca13fa56f9a342b69f198080ef10acaa'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:30:07.870578 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b231c6-798b-4e15-ae74-a0ecdc573ac2 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:07.870695 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b231c6-798b-4e15-ae74-a0ecdc573ac2 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:07.871008 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b231c6-798b-4e15-ae74-a0ecdc573ac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:07.880317 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-f97388ab-53e0-4b7c-a5db-40604937e600 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca13fa56f9a342b69f198080ef10acaa'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:30:07.929038 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2560/5114] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:30:07 2022] DELETE /identity/v3/users/ca13fa56f9a342b69f198080ef10acaa => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:30:07.961828 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-b7b231c6-798b-4e15-ae74-a0ecdc573ac2 None None] MFA Rules not processed for user `6ca9644a73d9468aa39b21548a72bded`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:30:07.964377 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-b7b231c6-798b-4e15-ae74-a0ecdc573ac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:30:08.139910 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2555/5115] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:30:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:30:08.152123 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98be5926-dcd8-426f-8988-15e2f818df65 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:08.152856 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98be5926-dcd8-426f-8988-15e2f818df65 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:08.153607 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98be5926-dcd8-426f-8988-15e2f818df65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:08.179675 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-98be5926-dcd8-426f-8988-15e2f818df65 None None] MFA Rules not processed for user `6ca9644a73d9468aa39b21548a72bded`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:30:08.181225 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-98be5926-dcd8-426f-8988-15e2f818df65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:30:08.197364 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2561/5116] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:30:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:30:08.209105 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b231c6-798b-4e15-ae74-a0ecdc573ac2 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:30:08.210887 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-b7b231c6-798b-4e15-ae74-a0ecdc573ac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:30:08.343134 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b231c6-798b-4e15-ae74-a0ecdc573ac2 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:30:08.350938 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9993eb5-fac6-4280-848f-fb19ceedd4cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:30:08.351865 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9993eb5-fac6-4280-848f-fb19ceedd4cc service nova] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:08.352367 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9993eb5-fac6-4280-848f-fb19ceedd4cc service nova] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:08.352793 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9993eb5-fac6-4280-848f-fb19ceedd4cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:08.364827 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9993eb5-fac6-4280-848f-fb19ceedd4cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:30:08.367539 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9993eb5-fac6-4280-848f-fb19ceedd4cc service nova] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:30:08.394039 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2556/5117] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:30:08 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:30:08.432753 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98be5926-dcd8-426f-8988-15e2f818df65 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:30:08.440648 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-98be5926-dcd8-426f-8988-15e2f818df65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:30:08.565600 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98be5926-dcd8-426f-8988-15e2f818df65 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:30:08.570705 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884e7d39-f8ee-4f69-b59d-922b40548c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:30:08.571599 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884e7d39-f8ee-4f69-b59d-922b40548c4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:08.571857 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884e7d39-f8ee-4f69-b59d-922b40548c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:08.572125 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884e7d39-f8ee-4f69-b59d-922b40548c4c admin admin] PATH_INFO: `/v3/projects/73fc917381914b7eb60d35f046459b0e` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:08.573664 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884e7d39-f8ee-4f69-b59d-922b40548c4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=73fc917381914b7eb60d35f046459b0e)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:30:08.576284 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884e7d39-f8ee-4f69-b59d-922b40548c4c admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:30:08.707064 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-884e7d39-f8ee-4f69-b59d-922b40548c4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73fc917381914b7eb60d35f046459b0e', 'request_id': 'req-884e7d39-f8ee-4f69-b59d-922b40548c4c'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:30:08.719829 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-884e7d39-f8ee-4f69-b59d-922b40548c4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73fc917381914b7eb60d35f046459b0e', 'request_id': 'req-884e7d39-f8ee-4f69-b59d-922b40548c4c'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:30:08.730666 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:30:08.735426 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-884e7d39-f8ee-4f69-b59d-922b40548c4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73fc917381914b7eb60d35f046459b0e', 'request_id': 'req-884e7d39-f8ee-4f69-b59d-922b40548c4c'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:30:08.765364 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-884e7d39-f8ee-4f69-b59d-922b40548c4c admin admin] The token cache is being invalidate because project 73fc917381914b7eb60d35f046459b0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:30:08.765364 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-884e7d39-f8ee-4f69-b59d-922b40548c4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:30:08.766499 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-884e7d39-f8ee-4f69-b59d-922b40548c4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:30:08.767248 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9993eb5-fac6-4280-848f-fb19ceedd4cc service nova] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:30:08.767938 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2562/5118] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:30:08 2022] DELETE /identity/v3/projects/73fc917381914b7eb60d35f046459b0e => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:30:08.771083 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-c9993eb5-fac6-4280-848f-fb19ceedd4cc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:30:08.775193 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884e7d39-f8ee-4f69-b59d-922b40548c4c admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:30:08.776991 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-884e7d39-f8ee-4f69-b59d-922b40548c4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:30:08.791256 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9993eb5-fac6-4280-848f-fb19ceedd4cc service nova] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:30:08.819753 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:30:08.910039 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc144e1-d3c8-4387-90ce-753ded79c742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:30:08.911164 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc144e1-d3c8-4387-90ce-753ded79c742 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:08.911770 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc144e1-d3c8-4387-90ce-753ded79c742 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:08.912058 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc144e1-d3c8-4387-90ce-753ded79c742 admin admin] PATH_INFO: `/v3/projects/aa1e19260e3448e08f349cbd4c4a3f70` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:08.917323 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc144e1-d3c8-4387-90ce-753ded79c742 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa1e19260e3448e08f349cbd4c4a3f70)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:30:08.919378 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc144e1-d3c8-4387-90ce-753ded79c742 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:30:08.944202 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884e7d39-f8ee-4f69-b59d-922b40548c4c admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:30:08.951884 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733e2bb4-c2c1-462b-a24c-1eb63ca0a607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:30:08.953721 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733e2bb4-c2c1-462b-a24c-1eb63ca0a607 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:08.953991 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733e2bb4-c2c1-462b-a24c-1eb63ca0a607 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:08.954386 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733e2bb4-c2c1-462b-a24c-1eb63ca0a607 admin admin] PATH_INFO: `/v3/users/a1a673168f544a79a94333cbaa606486` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:08.955827 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733e2bb4-c2c1-462b-a24c-1eb63ca0a607 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1a673168f544a79a94333cbaa606486)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:30:08.958153 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733e2bb4-c2c1-462b-a24c-1eb63ca0a607 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:30:09.002810 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-1dc144e1-d3c8-4387-90ce-753ded79c742 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa1e19260e3448e08f349cbd4c4a3f70', 'request_id': 'req-1dc144e1-d3c8-4387-90ce-753ded79c742'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:30:09.019905 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-1dc144e1-d3c8-4387-90ce-753ded79c742 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa1e19260e3448e08f349cbd4c4a3f70', 'request_id': 'req-1dc144e1-d3c8-4387-90ce-753ded79c742'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:30:09.030803 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-1dc144e1-d3c8-4387-90ce-753ded79c742 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa1e19260e3448e08f349cbd4c4a3f70', 'request_id': 'req-1dc144e1-d3c8-4387-90ce-753ded79c742'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:30:09.049158 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-1dc144e1-d3c8-4387-90ce-753ded79c742 admin admin] The token cache is being invalidate because project aa1e19260e3448e08f349cbd4c4a3f70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:30:09.050717 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-1dc144e1-d3c8-4387-90ce-753ded79c742 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:30:09.052190 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-1dc144e1-d3c8-4387-90ce-753ded79c742 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:30:09.058327 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2557/5119] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:30:08 2022] DELETE /identity/v3/projects/aa1e19260e3448e08f349cbd4c4a3f70 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:30:09.061127 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-733e2bb4-c2c1-462b-a24c-1eb63ca0a607 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1a673168f544a79a94333cbaa606486'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:30:09.062740 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc144e1-d3c8-4387-90ce-753ded79c742 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:30:09.066958 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-1dc144e1-d3c8-4387-90ce-753ded79c742 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:30:09.071306 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-733e2bb4-c2c1-462b-a24c-1eb63ca0a607 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1a673168f544a79a94333cbaa606486'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:30:09.072248 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-733e2bb4-c2c1-462b-a24c-1eb63ca0a607 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1a673168f544a79a94333cbaa606486'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:30:09.082499 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-733e2bb4-c2c1-462b-a24c-1eb63ca0a607 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1a673168f544a79a94333cbaa606486'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:30:09.113681 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-733e2bb4-c2c1-462b-a24c-1eb63ca0a607 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1a673168f544a79a94333cbaa606486'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:30:09.124072 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2563/5120] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:30:08 2022] DELETE /identity/v3/users/a1a673168f544a79a94333cbaa606486 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:30:09.138586 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bec3f3-942f-4294-be16-cc580c2077cf None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:09.138879 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bec3f3-942f-4294-be16-cc580c2077cf None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:09.139240 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bec3f3-942f-4294-be16-cc580c2077cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:09.212286 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-c6bec3f3-942f-4294-be16-cc580c2077cf None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:30:09.215338 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-c6bec3f3-942f-4294-be16-cc580c2077cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:30:09.239425 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc144e1-d3c8-4387-90ce-753ded79c742 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:30:09.458935 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2564/5121] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:30:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:30:09.466717 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752fb62d-4e5c-4d06-9502-b5421fe9ab66 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:09.467052 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752fb62d-4e5c-4d06-9502-b5421fe9ab66 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:09.467338 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752fb62d-4e5c-4d06-9502-b5421fe9ab66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:09.473250 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae66fcd-7220-4c8e-bbfa-5e9171bbae18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:30:09.477828 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae66fcd-7220-4c8e-bbfa-5e9171bbae18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:09.478781 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae66fcd-7220-4c8e-bbfa-5e9171bbae18 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:09.479080 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae66fcd-7220-4c8e-bbfa-5e9171bbae18 admin admin] PATH_INFO: `/v3/projects/12170b240cf14473905dd80f9eb8f66f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:09.482063 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae66fcd-7220-4c8e-bbfa-5e9171bbae18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=12170b240cf14473905dd80f9eb8f66f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:30:09.488101 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae66fcd-7220-4c8e-bbfa-5e9171bbae18 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:30:09.495429 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:30:09.513964 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-752fb62d-4e5c-4d06-9502-b5421fe9ab66 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:30:09.518979 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-752fb62d-4e5c-4d06-9502-b5421fe9ab66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:30:09.543806 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2565/5122] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:30:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:30:09.544967 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752fb62d-4e5c-4d06-9502-b5421fe9ab66 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:30:09.549958 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:30:09.573475 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752fb62d-4e5c-4d06-9502-b5421fe9ab66 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:30:09.587826 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7946b2f-70c0-46e1-8125-833083529738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:30:09.588446 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7946b2f-70c0-46e1-8125-833083529738 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:09.588901 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7946b2f-70c0-46e1-8125-833083529738 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:09.589190 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7946b2f-70c0-46e1-8125-833083529738 admin admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:09.589980 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7946b2f-70c0-46e1-8125-833083529738 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:30:09.590520 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7946b2f-70c0-46e1-8125-833083529738 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:30:09.592906 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7946b2f-70c0-46e1-8125-833083529738 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:30:09.620902 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-dae66fcd-7220-4c8e-bbfa-5e9171bbae18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12170b240cf14473905dd80f9eb8f66f', 'request_id': 'req-dae66fcd-7220-4c8e-bbfa-5e9171bbae18'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:30:09.627195 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2566/5123] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:30:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 21:30:09.628487 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7946b2f-70c0-46e1-8125-833083529738 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:30:09.640239 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-dae66fcd-7220-4c8e-bbfa-5e9171bbae18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12170b240cf14473905dd80f9eb8f66f', 'request_id': 'req-dae66fcd-7220-4c8e-bbfa-5e9171bbae18'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:30:09.645340 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7946b2f-70c0-46e1-8125-833083529738 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:30:09.652795 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-dae66fcd-7220-4c8e-bbfa-5e9171bbae18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12170b240cf14473905dd80f9eb8f66f', 'request_id': 'req-dae66fcd-7220-4c8e-bbfa-5e9171bbae18'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:30:09.680296 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-dae66fcd-7220-4c8e-bbfa-5e9171bbae18 admin admin] The token cache is being invalidate because project 12170b240cf14473905dd80f9eb8f66f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:30:09.680632 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-dae66fcd-7220-4c8e-bbfa-5e9171bbae18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:30:09.682575 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-dae66fcd-7220-4c8e-bbfa-5e9171bbae18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:30:09.689924 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2558/5124] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:30:09 2022] DELETE /identity/v3/projects/12170b240cf14473905dd80f9eb8f66f => generated 0 bytes in 628 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:30:09.692389 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae66fcd-7220-4c8e-bbfa-5e9171bbae18 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:30:09.695084 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-dae66fcd-7220-4c8e-bbfa-5e9171bbae18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:30:09.833427 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae66fcd-7220-4c8e-bbfa-5e9171bbae18 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:30:09.850129 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe0edcb-f2db-4581-82da-5654122839f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:30:09.854728 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe0edcb-f2db-4581-82da-5654122839f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:09.855033 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe0edcb-f2db-4581-82da-5654122839f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:09.855314 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe0edcb-f2db-4581-82da-5654122839f5 admin admin] PATH_INFO: `/v3/users/6fd62a7b74b14cf0b1a3e27ad4762f39` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:09.857478 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d3e715-2ce1-4f99-bb56-7e6ee6130c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:30:09.858089 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe0edcb-f2db-4581-82da-5654122839f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6fd62a7b74b14cf0b1a3e27ad4762f39)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:30:09.858610 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d3e715-2ce1-4f99-bb56-7e6ee6130c21 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:09.859242 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d3e715-2ce1-4f99-bb56-7e6ee6130c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:09.859516 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d3e715-2ce1-4f99-bb56-7e6ee6130c21 admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:09.860216 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d3e715-2ce1-4f99-bb56-7e6ee6130c21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:30:09.863427 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d3e715-2ce1-4f99-bb56-7e6ee6130c21 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:30:09.864453 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe0edcb-f2db-4581-82da-5654122839f5 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:30:09.928982 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2567/5125] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:30:09 2022] POST /identity/v3/projects => generated 383 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:30:09.930472 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d3e715-2ce1-4f99-bb56-7e6ee6130c21 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:30:09.934513 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-a0d3e715-2ce1-4f99-bb56-7e6ee6130c21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:30:10.027668 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-afe0edcb-f2db-4581-82da-5654122839f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6fd62a7b74b14cf0b1a3e27ad4762f39'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:30:10.031440 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-afe0edcb-f2db-4581-82da-5654122839f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6fd62a7b74b14cf0b1a3e27ad4762f39'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:30:10.082454 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d3e715-2ce1-4f99-bb56-7e6ee6130c21 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:30:10.087991 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-afe0edcb-f2db-4581-82da-5654122839f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6fd62a7b74b14cf0b1a3e27ad4762f39'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:30:10.097451 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9072c612-ef40-47d8-b828-a3f06b9112e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:30:10.098190 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9072c612-ef40-47d8-b828-a3f06b9112e1 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:10.104107 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9072c612-ef40-47d8-b828-a3f06b9112e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:10.123466 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9072c612-ef40-47d8-b828-a3f06b9112e1 admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:10.128826 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9072c612-ef40-47d8-b828-a3f06b9112e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:30:10.135335 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9072c612-ef40-47d8-b828-a3f06b9112e1 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:30:10.143475 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-afe0edcb-f2db-4581-82da-5654122839f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6fd62a7b74b14cf0b1a3e27ad4762f39'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:30:10.170618 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-afe0edcb-f2db-4581-82da-5654122839f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6fd62a7b74b14cf0b1a3e27ad4762f39'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:30:10.193432 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2559/5126] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:30:09 2022] DELETE /identity/v3/users/6fd62a7b74b14cf0b1a3e27ad4762f39 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:30:10.193564 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2568/5127] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:30:09 2022] POST /identity/v3/users => generated 292 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:30:10.209046 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe0edcb-f2db-4581-82da-5654122839f5 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:30:10.211185 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-afe0edcb-f2db-4581-82da-5654122839f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:30:10.244690 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:30:10.478009 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe0edcb-f2db-4581-82da-5654122839f5 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:30:10.492370 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6aefb0-5918-45aa-bc32-3c620d1d6734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:30:10.494705 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6aefb0-5918-45aa-bc32-3c620d1d6734 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:10.495526 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6aefb0-5918-45aa-bc32-3c620d1d6734 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:10.495919 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6aefb0-5918-45aa-bc32-3c620d1d6734 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:10.499187 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6aefb0-5918-45aa-bc32-3c620d1d6734 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:30:10.518949 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6aefb0-5918-45aa-bc32-3c620d1d6734 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:30:10.564882 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2560/5128] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:30:10 2022] GET /identity/v3/roles => generated 1420 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:30:10.566129 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9072c612-ef40-47d8-b828-a3f06b9112e1 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:30:10.584658 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9072c612-ef40-47d8-b828-a3f06b9112e1 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:30:10.605975 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6aec70-a455-4508-bbbc-a28826b7edc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:30:10.612115 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6aec70-a455-4508-bbbc-a28826b7edc5 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:10.613560 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6aec70-a455-4508-bbbc-a28826b7edc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:10.614108 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6aec70-a455-4508-bbbc-a28826b7edc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:10.617084 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6aec70-a455-4508-bbbc-a28826b7edc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:30:10.624353 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6aec70-a455-4508-bbbc-a28826b7edc5 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:30:10.667288 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2569/5129] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:30:10 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:30:10.669511 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6aefb0-5918-45aa-bc32-3c620d1d6734 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:30:10.727345 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6aefb0-5918-45aa-bc32-3c620d1d6734 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:30:10.742588 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216c7991-dfbc-4203-8af8-f3bb423d165d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:30:10.743529 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216c7991-dfbc-4203-8af8-f3bb423d165d admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:10.743806 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216c7991-dfbc-4203-8af8-f3bb423d165d admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:10.744077 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216c7991-dfbc-4203-8af8-f3bb423d165d admin admin] PATH_INFO: `/v3/projects/ebcf55bcaba04bf8ae8a9b2ac09e8d98/users/37b1e260651b4dffa7c1efe8e9d0f144/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:10.763807 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6aec70-a455-4508-bbbc-a28826b7edc5 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:30:10.766065 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-0b6aec70-a455-4508-bbbc-a28826b7edc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:30:10.799092 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216c7991-dfbc-4203-8af8-f3bb423d165d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebcf55bcaba04bf8ae8a9b2ac09e8d98, user_id=37b1e260651b4dffa7c1efe8e9d0f144, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:30:10.804887 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216c7991-dfbc-4203-8af8-f3bb423d165d admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:30:10.806350 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6aec70-a455-4508-bbbc-a28826b7edc5 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:30:10.825742 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421cc1ff-3a08-49f2-bc34-d2df88e67c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:30:10.826689 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421cc1ff-3a08-49f2-bc34-d2df88e67c96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:10.834019 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421cc1ff-3a08-49f2-bc34-d2df88e67c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:10.847656 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421cc1ff-3a08-49f2-bc34-d2df88e67c96 admin admin] PATH_INFO: `/v3/projects/7528a2b240f440248c1db211d6c5dbf4` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:10.847656 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421cc1ff-3a08-49f2-bc34-d2df88e67c96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7528a2b240f440248c1db211d6c5dbf4)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:30:10.847656 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421cc1ff-3a08-49f2-bc34-d2df88e67c96 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:30:10.869914 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2561/5130] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:30:10 2022] PUT /identity/v3/projects/ebcf55bcaba04bf8ae8a9b2ac09e8d98/users/37b1e260651b4dffa7c1efe8e9d0f144/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:30:10.871178 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216c7991-dfbc-4203-8af8-f3bb423d165d admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:30:10.876586 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-216c7991-dfbc-4203-8af8-f3bb423d165d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:30:10.982012 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=92,keystone:INSERT=4,keystone:DELETE=4 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:30:10.985575 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-421cc1ff-3a08-49f2-bc34-d2df88e67c96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7528a2b240f440248c1db211d6c5dbf4', 'request_id': 'req-421cc1ff-3a08-49f2-bc34-d2df88e67c96'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:30:11.010990 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-421cc1ff-3a08-49f2-bc34-d2df88e67c96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7528a2b240f440248c1db211d6c5dbf4', 'request_id': 'req-421cc1ff-3a08-49f2-bc34-d2df88e67c96'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:30:11.018701 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-421cc1ff-3a08-49f2-bc34-d2df88e67c96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7528a2b240f440248c1db211d6c5dbf4', 'request_id': 'req-421cc1ff-3a08-49f2-bc34-d2df88e67c96'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:30:11.043022 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-421cc1ff-3a08-49f2-bc34-d2df88e67c96 admin admin] The token cache is being invalidate because project 7528a2b240f440248c1db211d6c5dbf4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:30:11.043508 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-421cc1ff-3a08-49f2-bc34-d2df88e67c96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:30:11.045271 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-421cc1ff-3a08-49f2-bc34-d2df88e67c96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:30:11.047892 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2570/5131] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:30:10 2022] DELETE /identity/v3/projects/7528a2b240f440248c1db211d6c5dbf4 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:30:11.049373 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bc837a-4881-4c5c-90f0-ab511ef129c5 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:11.050350 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bc837a-4881-4c5c-90f0-ab511ef129c5 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:11.050683 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bc837a-4881-4c5c-90f0-ab511ef129c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:11.075294 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-48bc837a-4881-4c5c-90f0-ab511ef129c5 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:30:11.076766 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-48bc837a-4881-4c5c-90f0-ab511ef129c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:30:11.121773 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216c7991-dfbc-4203-8af8-f3bb423d165d admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:30:11.169528 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2571/5132] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:30:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:30:11.171109 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a67e974-653a-4555-8159-d53a909fdf0f None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:11.171403 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a67e974-653a-4555-8159-d53a909fdf0f None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:11.171680 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a67e974-653a-4555-8159-d53a909fdf0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:11.225955 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-3a67e974-653a-4555-8159-d53a909fdf0f None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:30:11.228676 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-3a67e974-653a-4555-8159-d53a909fdf0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:30:11.239278 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7819156f-7bf7-4ef0-97c7-b4e2218e8156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:30:11.240219 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7819156f-7bf7-4ef0-97c7-b4e2218e8156 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:11.240894 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7819156f-7bf7-4ef0-97c7-b4e2218e8156 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:11.241767 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7819156f-7bf7-4ef0-97c7-b4e2218e8156 admin admin] PATH_INFO: `/v3/projects/b9fa76f9f00a49bab65c73c82c4e88ad` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:11.244295 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7819156f-7bf7-4ef0-97c7-b4e2218e8156 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9fa76f9f00a49bab65c73c82c4e88ad)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:30:11.246630 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7819156f-7bf7-4ef0-97c7-b4e2218e8156 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:30:11.267635 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2572/5133] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:30:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:30:11.272149 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a67e974-653a-4555-8159-d53a909fdf0f None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:30:11.275411 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-3a67e974-653a-4555-8159-d53a909fdf0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:30:11.403544 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:30:11.462028 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-7819156f-7bf7-4ef0-97c7-b4e2218e8156 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9fa76f9f00a49bab65c73c82c4e88ad', 'request_id': 'req-7819156f-7bf7-4ef0-97c7-b4e2218e8156'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:30:11.490923 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-7819156f-7bf7-4ef0-97c7-b4e2218e8156 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9fa76f9f00a49bab65c73c82c4e88ad', 'request_id': 'req-7819156f-7bf7-4ef0-97c7-b4e2218e8156'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:30:11.513984 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-7819156f-7bf7-4ef0-97c7-b4e2218e8156 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9fa76f9f00a49bab65c73c82c4e88ad', 'request_id': 'req-7819156f-7bf7-4ef0-97c7-b4e2218e8156'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:30:11.532479 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a67e974-653a-4555-8159-d53a909fdf0f None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:30:11.554768 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-7819156f-7bf7-4ef0-97c7-b4e2218e8156 admin admin] The token cache is being invalidate because project b9fa76f9f00a49bab65c73c82c4e88ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:30:11.555004 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-7819156f-7bf7-4ef0-97c7-b4e2218e8156 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:30:11.564803 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-7819156f-7bf7-4ef0-97c7-b4e2218e8156 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:30:11.570153 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2562/5134] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:30:10 2022] DELETE /identity/v3/projects/b9fa76f9f00a49bab65c73c82c4e88ad => generated 0 bytes in 699 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:30:11.578365 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e66f6d-4aac-4d92-ae51-7b01804b3f97 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:11.581224 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e66f6d-4aac-4d92-ae51-7b01804b3f97 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:11.584805 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e66f6d-4aac-4d92-ae51-7b01804b3f97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:11.670333 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-c2e66f6d-4aac-4d92-ae51-7b01804b3f97 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:30:11.673840 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-c2e66f6d-4aac-4d92-ae51-7b01804b3f97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:30:11.770775 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87569d5d-b63e-4830-b261-9c8eae043d32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:30:11.771474 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87569d5d-b63e-4830-b261-9c8eae043d32 service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:11.771756 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87569d5d-b63e-4830-b261-9c8eae043d32 service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:11.772028 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87569d5d-b63e-4830-b261-9c8eae043d32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:11.779010 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-87569d5d-b63e-4830-b261-9c8eae043d32 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:30:11.862866 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:30:11.915143 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87569d5d-b63e-4830-b261-9c8eae043d32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:30:11.916885 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87569d5d-b63e-4830-b261-9c8eae043d32 service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:30:11.927924 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2563/5135] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:30:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 357 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:30:11.929666 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c67d7e-8814-4387-8cce-3328b7fa3e2c None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:11.930195 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c67d7e-8814-4387-8cce-3328b7fa3e2c None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:11.930675 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c67d7e-8814-4387-8cce-3328b7fa3e2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:11.943617 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2573/5136] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:30:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 675 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:30:11.944848 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87569d5d-b63e-4830-b261-9c8eae043d32 service neutron] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:30:11.958126 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87569d5d-b63e-4830-b261-9c8eae043d32 service neutron] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:30:11.977577 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634322c2-1f52-40a6-90d9-389d3449b2d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:30:11.979801 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634322c2-1f52-40a6-90d9-389d3449b2d4 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:11.980296 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634322c2-1f52-40a6-90d9-389d3449b2d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:11.981273 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634322c2-1f52-40a6-90d9-389d3449b2d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:11.984822 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634322c2-1f52-40a6-90d9-389d3449b2d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:30:11.985698 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634322c2-1f52-40a6-90d9-389d3449b2d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:30:11.987946 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-43c67d7e-8814-4387-8cce-3328b7fa3e2c None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:30:11.989201 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-43c67d7e-8814-4387-8cce-3328b7fa3e2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:30:11.991698 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634322c2-1f52-40a6-90d9-389d3449b2d4 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:30:12.019877 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2564/5137] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:30:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:30:12.022034 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fc4600-4b2f-4d14-bfd4-0b6685ec34ef None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:12.022356 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fc4600-4b2f-4d14-bfd4-0b6685ec34ef None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:12.022617 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fc4600-4b2f-4d14-bfd4-0b6685ec34ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:12.039845 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2574/5138] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:30:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:30:12.041202 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634322c2-1f52-40a6-90d9-389d3449b2d4 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:30:12.072150 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634322c2-1f52-40a6-90d9-389d3449b2d4 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:30:12.082260 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7a22d7-d7b2-41ed-88f4-9175048fc617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:30:12.083177 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7a22d7-d7b2-41ed-88f4-9175048fc617 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:12.083641 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7a22d7-d7b2-41ed-88f4-9175048fc617 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:12.084097 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7a22d7-d7b2-41ed-88f4-9175048fc617 admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:12.085182 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7a22d7-d7b2-41ed-88f4-9175048fc617 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:30:12.094208 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-00fc4600-4b2f-4d14-bfd4-0b6685ec34ef None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:30:12.097684 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-00fc4600-4b2f-4d14-bfd4-0b6685ec34ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:30:12.110034 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7a22d7-d7b2-41ed-88f4-9175048fc617 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:30:12.117008 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2565/5139] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:30:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:30:12.118488 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fc4600-4b2f-4d14-bfd4-0b6685ec34ef None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:30:12.136334 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fc4600-4b2f-4d14-bfd4-0b6685ec34ef None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:30:12.156746 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e215671-3427-4423-9038-df9e4ff7f0f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:30:12.157602 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e215671-3427-4423-9038-df9e4ff7f0f3 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:12.158340 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e215671-3427-4423-9038-df9e4ff7f0f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:12.158851 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e215671-3427-4423-9038-df9e4ff7f0f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:12.159696 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e215671-3427-4423-9038-df9e4ff7f0f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:30:12.160848 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e215671-3427-4423-9038-df9e4ff7f0f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:30:12.162992 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e215671-3427-4423-9038-df9e4ff7f0f3 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:30:12.186324 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2575/5140] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:30:12 2022] POST /identity/v3/projects => generated 375 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:30:12.190652 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7a22d7-d7b2-41ed-88f4-9175048fc617 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:30:12.198523 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2566/5141] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:30:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:30:12.204031 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e215671-3427-4423-9038-df9e4ff7f0f3 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:30:12.220884 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e215671-3427-4423-9038-df9e4ff7f0f3 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:30:12.378236 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7a22d7-d7b2-41ed-88f4-9175048fc617 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:30:12.401107 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3e70dd-36a6-4e7b-9a82-3b266ed05b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:30:12.402513 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdd62d8-bbbb-414e-a86e-641775058c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:30:12.403268 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdd62d8-bbbb-414e-a86e-641775058c09 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:12.404704 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3e70dd-36a6-4e7b-9a82-3b266ed05b67 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:12.405221 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdd62d8-bbbb-414e-a86e-641775058c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:12.405588 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdd62d8-bbbb-414e-a86e-641775058c09 admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:12.406414 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdd62d8-bbbb-414e-a86e-641775058c09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:30:12.407003 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3e70dd-36a6-4e7b-9a82-3b266ed05b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:12.407802 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3e70dd-36a6-4e7b-9a82-3b266ed05b67 admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:12.409235 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdd62d8-bbbb-414e-a86e-641775058c09 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:30:12.437423 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3e70dd-36a6-4e7b-9a82-3b266ed05b67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:30:12.444731 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3e70dd-36a6-4e7b-9a82-3b266ed05b67 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:30:12.513709 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2576/5142] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:30:12 2022] POST /identity/v3/users => generated 288 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:30:12.517810 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2567/5143] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:30:12 2022] POST /identity/v3/projects => generated 385 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:30:12.518806 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdd62d8-bbbb-414e-a86e-641775058c09 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:30:12.539052 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3e70dd-36a6-4e7b-9a82-3b266ed05b67 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:30:12.570114 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3e70dd-36a6-4e7b-9a82-3b266ed05b67 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:30:12.588322 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:30:12.704380 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdd62d8-bbbb-414e-a86e-641775058c09 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:30:12.731431 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472a469d-2919-4931-996f-fd79e3c6898f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:30:12.737827 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9872b9-0f9a-4002-be55-6c5164f388ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:30:12.738858 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472a469d-2919-4931-996f-fd79e3c6898f admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:12.740020 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472a469d-2919-4931-996f-fd79e3c6898f admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:12.743025 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472a469d-2919-4931-996f-fd79e3c6898f admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:12.743154 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9872b9-0f9a-4002-be55-6c5164f388ec admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:12.743422 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9872b9-0f9a-4002-be55-6c5164f388ec admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:12.743711 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9872b9-0f9a-4002-be55-6c5164f388ec admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:12.744460 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9872b9-0f9a-4002-be55-6c5164f388ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:30:12.745929 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472a469d-2919-4931-996f-fd79e3c6898f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:30:12.750828 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9872b9-0f9a-4002-be55-6c5164f388ec admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:30:12.754174 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472a469d-2919-4931-996f-fd79e3c6898f admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:30:12.809332 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2568/5144] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:30:12 2022] POST /identity/v3/users => generated 293 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:30:12.809665 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2577/5145] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:30:12 2022] GET /identity/v3/roles => generated 1420 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:30:12.809759 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9872b9-0f9a-4002-be55-6c5164f388ec admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:30:12.828149 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472a469d-2919-4931-996f-fd79e3c6898f admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:30:12.829098 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9872b9-0f9a-4002-be55-6c5164f388ec admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:30:12.847804 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e962f6c-22aa-44c3-954f-58b89dfb85a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:30:12.850909 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e962f6c-22aa-44c3-954f-58b89dfb85a3 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:12.851203 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e962f6c-22aa-44c3-954f-58b89dfb85a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:12.851485 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e962f6c-22aa-44c3-954f-58b89dfb85a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:12.851832 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472a469d-2919-4931-996f-fd79e3c6898f admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:30:12.852246 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e962f6c-22aa-44c3-954f-58b89dfb85a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:30:12.853992 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e962f6c-22aa-44c3-954f-58b89dfb85a3 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:30:12.872992 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cfb2e2-0fb4-45ed-9e3e-3a420ab0dde3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:30:12.873775 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cfb2e2-0fb4-45ed-9e3e-3a420ab0dde3 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:12.874140 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cfb2e2-0fb4-45ed-9e3e-3a420ab0dde3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:12.874420 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cfb2e2-0fb4-45ed-9e3e-3a420ab0dde3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:12.875160 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cfb2e2-0fb4-45ed-9e3e-3a420ab0dde3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:30:12.877220 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cfb2e2-0fb4-45ed-9e3e-3a420ab0dde3 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:30:12.900108 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2578/5146] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:30:12 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:30:12.904076 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cfb2e2-0fb4-45ed-9e3e-3a420ab0dde3 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:30:12.918107 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cfb2e2-0fb4-45ed-9e3e-3a420ab0dde3 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:30:12.920516 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2569/5147] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:30:12 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:30:12.925571 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e962f6c-22aa-44c3-954f-58b89dfb85a3 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:30:12.927127 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebac34c-9095-4f28-878e-ee15bb9c6faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:30:12.927712 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebac34c-9095-4f28-878e-ee15bb9c6faa admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:12.928021 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebac34c-9095-4f28-878e-ee15bb9c6faa admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:12.928265 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebac34c-9095-4f28-878e-ee15bb9c6faa admin admin] PATH_INFO: `/v3/projects/386485cd4c3d42b3a70e7a983c462a35/users/6ca45dfdb0554928b0de3376bf397e8f/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:12.959342 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e962f6c-22aa-44c3-954f-58b89dfb85a3 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:30:12.959842 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:30:12.967820 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03529dd2-f2e0-42bb-9bb8-5f032edc771b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:30:12.968470 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03529dd2-f2e0-42bb-9bb8-5f032edc771b admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:12.968774 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03529dd2-f2e0-42bb-9bb8-5f032edc771b admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:12.970035 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebac34c-9095-4f28-878e-ee15bb9c6faa admin admin] RBAC: Authorizing `identity:create_grant(project_id=386485cd4c3d42b3a70e7a983c462a35, user_id=6ca45dfdb0554928b0de3376bf397e8f, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:30:12.972948 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebac34c-9095-4f28-878e-ee15bb9c6faa admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:30:12.986954 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03529dd2-f2e0-42bb-9bb8-5f032edc771b admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:12.988910 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03529dd2-f2e0-42bb-9bb8-5f032edc771b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:30:12.997768 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03529dd2-f2e0-42bb-9bb8-5f032edc771b admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:30:13.003169 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2579/5148] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:30:12 2022] PUT /identity/v3/projects/386485cd4c3d42b3a70e7a983c462a35/users/6ca45dfdb0554928b0de3376bf397e8f/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:30:13.014290 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ff4f4a-18f6-45f1-8d31-12798eaf795e None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:13.015286 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ff4f4a-18f6-45f1-8d31-12798eaf795e None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:13.015568 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ff4f4a-18f6-45f1-8d31-12798eaf795e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:13.050318 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2570/5149] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:30:12 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 21:30:13.051327 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03529dd2-f2e0-42bb-9bb8-5f032edc771b admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:30:13.094182 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03529dd2-f2e0-42bb-9bb8-5f032edc771b admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:30:13.117142 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-48ff4f4a-18f6-45f1-8d31-12798eaf795e None None] MFA Rules not processed for user `6ca45dfdb0554928b0de3376bf397e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:30:13.118495 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-48ff4f4a-18f6-45f1-8d31-12798eaf795e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:30:13.293460 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469d94ef-7821-49eb-af0b-26d0df9796ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:30:13.295268 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469d94ef-7821-49eb-af0b-26d0df9796ce admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:13.295813 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469d94ef-7821-49eb-af0b-26d0df9796ce admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:13.296616 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469d94ef-7821-49eb-af0b-26d0df9796ce admin admin] PATH_INFO: `/v3/projects/ae9d008924284315ba5985b10277b403/users/d96d482192c3490ca3345a98c75c1740/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:13.349814 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469d94ef-7821-49eb-af0b-26d0df9796ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae9d008924284315ba5985b10277b403, user_id=d96d482192c3490ca3345a98c75c1740, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:30:13.357969 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469d94ef-7821-49eb-af0b-26d0df9796ce admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:30:13.381977 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2580/5150] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:30:13 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 360 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:30:13.381977 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ff4f4a-18f6-45f1-8d31-12798eaf795e None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:30:13.412600 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2571/5151] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:30:13 2022] PUT /identity/v3/projects/ae9d008924284315ba5985b10277b403/users/d96d482192c3490ca3345a98c75c1740/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:30:13.417714 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d9429c-64e8-46c1-b9a1-891f039daed2 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:13.417916 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ff4f4a-18f6-45f1-8d31-12798eaf795e None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:30:13.418219 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d9429c-64e8-46c1-b9a1-891f039daed2 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:13.418700 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d9429c-64e8-46c1-b9a1-891f039daed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:13.543482 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-b5d9429c-64e8-46c1-b9a1-891f039daed2 None None] MFA Rules not processed for user `d96d482192c3490ca3345a98c75c1740`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:30:13.546668 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-b5d9429c-64e8-46c1-b9a1-891f039daed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:30:13.550100 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186e636d-346b-43d1-9415-aa7b8eaa169b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:30:13.550819 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186e636d-346b-43d1-9415-aa7b8eaa169b admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:13.551102 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186e636d-346b-43d1-9415-aa7b8eaa169b admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:13.551743 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186e636d-346b-43d1-9415-aa7b8eaa169b admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:13.552393 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186e636d-346b-43d1-9415-aa7b8eaa169b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:30:13.554401 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186e636d-346b-43d1-9415-aa7b8eaa169b admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:30:13.653431 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2581/5152] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:30:13 2022] POST /identity/v3/projects => generated 373 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:30:13.657749 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186e636d-346b-43d1-9415-aa7b8eaa169b admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:30:13.711085 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:30:13.721892 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2572/5153] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:30:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:30:13.725592 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d9429c-64e8-46c1-b9a1-891f039daed2 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:30:13.768364 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d9429c-64e8-46c1-b9a1-891f039daed2 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:30:13.872823 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186e636d-346b-43d1-9415-aa7b8eaa169b admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:30:13.889051 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19c3a6f-ede1-4c6e-a0c9-8fe663d6f1bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:30:13.889816 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19c3a6f-ede1-4c6e-a0c9-8fe663d6f1bd admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:13.890131 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19c3a6f-ede1-4c6e-a0c9-8fe663d6f1bd admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:13.890405 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19c3a6f-ede1-4c6e-a0c9-8fe663d6f1bd admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:13.891308 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19c3a6f-ede1-4c6e-a0c9-8fe663d6f1bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:30:13.905735 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19c3a6f-ede1-4c6e-a0c9-8fe663d6f1bd admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:30:13.937595 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7b27c5-0917-4254-838b-417150c37a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:30:13.938926 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7b27c5-0917-4254-838b-417150c37a9c admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:13.939308 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7b27c5-0917-4254-838b-417150c37a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:13.939817 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7b27c5-0917-4254-838b-417150c37a9c admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:13.940929 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7b27c5-0917-4254-838b-417150c37a9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:30:13.944015 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7b27c5-0917-4254-838b-417150c37a9c admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:30:13.951953 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:30:13.990435 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2582/5154] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:30:13 2022] POST /identity/v3/users => generated 293 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:30:14.002111 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19c3a6f-ede1-4c6e-a0c9-8fe663d6f1bd admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:30:14.005285 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2573/5155] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:30:13 2022] POST /identity/v3/projects => generated 385 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:30:14.010754 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7b27c5-0917-4254-838b-417150c37a9c admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:30:14.029269 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19c3a6f-ede1-4c6e-a0c9-8fe663d6f1bd admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:30:14.183962 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7b27c5-0917-4254-838b-417150c37a9c admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:30:14.204474 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e012757-549e-430b-9760-b5db807aa88d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:30:14.205526 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e012757-549e-430b-9760-b5db807aa88d admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:14.206419 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e012757-549e-430b-9760-b5db807aa88d admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:14.206892 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e012757-549e-430b-9760-b5db807aa88d admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:14.208237 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8ad9c8-16cf-4ba0-9ea1-404596c05868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:30:14.208660 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e012757-549e-430b-9760-b5db807aa88d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:30:14.208945 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8ad9c8-16cf-4ba0-9ea1-404596c05868 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:14.209228 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8ad9c8-16cf-4ba0-9ea1-404596c05868 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:14.209503 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8ad9c8-16cf-4ba0-9ea1-404596c05868 admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:14.210235 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8ad9c8-16cf-4ba0-9ea1-404596c05868 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:30:14.211827 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e012757-549e-430b-9760-b5db807aa88d admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:30:14.212678 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8ad9c8-16cf-4ba0-9ea1-404596c05868 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:30:14.236262 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2583/5156] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:30:14 2022] GET /identity/v3/roles => generated 1420 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:30:14.241036 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e012757-549e-430b-9760-b5db807aa88d admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:30:14.257100 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2574/5157] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:30:14 2022] POST /identity/v3/users => generated 299 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:30:14.260112 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e012757-549e-430b-9760-b5db807aa88d admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:30:14.260867 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8ad9c8-16cf-4ba0-9ea1-404596c05868 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:30:14.283225 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c041d3c-3979-41d5-928a-86bd50e7a423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:30:14.300980 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8ad9c8-16cf-4ba0-9ea1-404596c05868 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:30:14.306248 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c041d3c-3979-41d5-928a-86bd50e7a423 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:14.307523 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c041d3c-3979-41d5-928a-86bd50e7a423 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:14.307820 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c041d3c-3979-41d5-928a-86bd50e7a423 admin admin] PATH_INFO: `/v3/projects/fe591cb2b9f24f8a8ba51e27c537da44/users/8cd84babf31a4533815fff327bc0564a/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:14.312905 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edd20ef-ba94-4376-bc88-c5e30c16f71b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:30:14.313890 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edd20ef-ba94-4376-bc88-c5e30c16f71b admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:14.314117 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edd20ef-ba94-4376-bc88-c5e30c16f71b admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:14.314487 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edd20ef-ba94-4376-bc88-c5e30c16f71b admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:14.315322 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edd20ef-ba94-4376-bc88-c5e30c16f71b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:30:14.317826 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edd20ef-ba94-4376-bc88-c5e30c16f71b admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:30:14.343091 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c041d3c-3979-41d5-928a-86bd50e7a423 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe591cb2b9f24f8a8ba51e27c537da44, user_id=8cd84babf31a4533815fff327bc0564a, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:30:14.350569 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c041d3c-3979-41d5-928a-86bd50e7a423 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:30:14.359289 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2575/5158] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:30:14 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:30:14.368123 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edd20ef-ba94-4376-bc88-c5e30c16f71b admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:30:14.379731 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2584/5159] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:30:14 2022] PUT /identity/v3/projects/fe591cb2b9f24f8a8ba51e27c537da44/users/8cd84babf31a4533815fff327bc0564a/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:30:14.384300 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c041d3c-3979-41d5-928a-86bd50e7a423 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:30:14.403547 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edd20ef-ba94-4376-bc88-c5e30c16f71b admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:30:14.485451 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df37ff6a-d0b1-4b10-8a99-0c13592dbf76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:30:14.487063 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df37ff6a-d0b1-4b10-8a99-0c13592dbf76 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:14.487341 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df37ff6a-d0b1-4b10-8a99-0c13592dbf76 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:14.487615 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df37ff6a-d0b1-4b10-8a99-0c13592dbf76 admin admin] PATH_INFO: `/v3/projects/c62cad5e9ffe4e6388272d5aeba41152/users/2ca5de8be752482d8535331281a34922/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:14.519449 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:30:14.552127 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df37ff6a-d0b1-4b10-8a99-0c13592dbf76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c62cad5e9ffe4e6388272d5aeba41152, user_id=2ca5de8be752482d8535331281a34922, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:30:14.553642 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c041d3c-3979-41d5-928a-86bd50e7a423 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:30:14.555910 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df37ff6a-d0b1-4b10-8a99-0c13592dbf76 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:30:14.567255 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3f170c-d9ec-482b-a994-e962a2c8e7fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:30:14.568749 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3f170c-d9ec-482b-a994-e962a2c8e7fe admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:14.571688 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3f170c-d9ec-482b-a994-e962a2c8e7fe admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:14.571688 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3f170c-d9ec-482b-a994-e962a2c8e7fe admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:14.571688 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3f170c-d9ec-482b-a994-e962a2c8e7fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:30:14.572222 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3f170c-d9ec-482b-a994-e962a2c8e7fe admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:30:14.614485 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2576/5160] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:30:14 2022] PUT /identity/v3/projects/c62cad5e9ffe4e6388272d5aeba41152/users/2ca5de8be752482d8535331281a34922/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:30:14.616003 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2585/5161] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:30:14 2022] GET /identity/v3/roles => generated 1420 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:30:14.617529 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df37ff6a-d0b1-4b10-8a99-0c13592dbf76 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:30:14.618904 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3f170c-d9ec-482b-a994-e962a2c8e7fe admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:30:14.657908 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3f170c-d9ec-482b-a994-e962a2c8e7fe admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:30:14.946217 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec9646d-d980-4267-849f-47e8f5d47095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:30:14.947295 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec9646d-d980-4267-849f-47e8f5d47095 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:14.948775 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec9646d-d980-4267-849f-47e8f5d47095 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:14.949140 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec9646d-d980-4267-849f-47e8f5d47095 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:14.955267 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec9646d-d980-4267-849f-47e8f5d47095 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:30:14.959800 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec9646d-d980-4267-849f-47e8f5d47095 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:30:14.964179 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df37ff6a-d0b1-4b10-8a99-0c13592dbf76 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:30:14.974581 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218f8a96-dbca-4983-9bf2-9ffad1ad7331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:30:14.975870 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:30:14.977168 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218f8a96-dbca-4983-9bf2-9ffad1ad7331 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:14.977460 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218f8a96-dbca-4983-9bf2-9ffad1ad7331 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:14.979525 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218f8a96-dbca-4983-9bf2-9ffad1ad7331 admin admin] PATH_INFO: `/v3/projects/fe591cb2b9f24f8a8ba51e27c537da44/users/8cd84babf31a4533815fff327bc0564a/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:14.986350 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218f8a96-dbca-4983-9bf2-9ffad1ad7331 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe591cb2b9f24f8a8ba51e27c537da44, user_id=8cd84babf31a4533815fff327bc0564a, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:30:14.990012 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2586/5162] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:30:14 2022] GET /identity/v3/roles => generated 1420 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:30:14.994908 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec9646d-d980-4267-849f-47e8f5d47095 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:30:14.998115 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218f8a96-dbca-4983-9bf2-9ffad1ad7331 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:30:15.013554 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec9646d-d980-4267-849f-47e8f5d47095 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:30:15.016364 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2577/5163] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:30:14 2022] PUT /identity/v3/projects/fe591cb2b9f24f8a8ba51e27c537da44/users/8cd84babf31a4533815fff327bc0564a/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:30:15.027231 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc12f9b-5579-445c-b7c0-d49ce35d4173 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:15.027562 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc12f9b-5579-445c-b7c0-d49ce35d4173 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:15.027991 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc12f9b-5579-445c-b7c0-d49ce35d4173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:15.094604 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-ccc12f9b-5579-445c-b7c0-d49ce35d4173 None None] MFA Rules not processed for user `8cd84babf31a4533815fff327bc0564a`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:30:15.097475 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-ccc12f9b-5579-445c-b7c0-d49ce35d4173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:30:15.165552 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfb336f-b64f-4e1c-8255-e8abacaadd81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:30:15.169103 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfb336f-b64f-4e1c-8255-e8abacaadd81 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:15.169548 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfb336f-b64f-4e1c-8255-e8abacaadd81 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:15.170090 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfb336f-b64f-4e1c-8255-e8abacaadd81 admin admin] PATH_INFO: `/v3/projects/c62cad5e9ffe4e6388272d5aeba41152/users/2ca5de8be752482d8535331281a34922/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:15.177526 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfb336f-b64f-4e1c-8255-e8abacaadd81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c62cad5e9ffe4e6388272d5aeba41152, user_id=2ca5de8be752482d8535331281a34922, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:30:15.182066 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfb336f-b64f-4e1c-8255-e8abacaadd81 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:30:15.216174 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2587/5164] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:30:14 2022] PUT /identity/v3/projects/c62cad5e9ffe4e6388272d5aeba41152/users/2ca5de8be752482d8535331281a34922/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:30:15.219492 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51e2f3c-a450-40ec-98d0-66cbd647dcf8 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:15.219847 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51e2f3c-a450-40ec-98d0-66cbd647dcf8 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:15.220481 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51e2f3c-a450-40ec-98d0-66cbd647dcf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:15.243855 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2578/5165] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:30:15 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:30:15.262508 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc12f9b-5579-445c-b7c0-d49ce35d4173 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:30:15.264047 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-ccc12f9b-5579-445c-b7c0-d49ce35d4173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:30:15.298974 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-f51e2f3c-a450-40ec-98d0-66cbd647dcf8 None None] MFA Rules not processed for user `2ca5de8be752482d8535331281a34922`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:30:15.301143 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-f51e2f3c-a450-40ec-98d0-66cbd647dcf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:30:15.459905 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc12f9b-5579-445c-b7c0-d49ce35d4173 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:30:15.514481 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:30:15.540206 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2588/5166] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:30:15 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:30:15.573070 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51e2f3c-a450-40ec-98d0-66cbd647dcf8 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:30:15.574699 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-f51e2f3c-a450-40ec-98d0-66cbd647dcf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:30:15.590718 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5284314c-465a-424d-9168-da3f68306a0b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec5fd3a489c341b7964704d689037f05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:30:15.592321 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5284314c-465a-424d-9168-da3f68306a0b service cinder] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:15.592895 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5284314c-465a-424d-9168-da3f68306a0b service cinder] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:15.593277 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5284314c-465a-424d-9168-da3f68306a0b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:15.710712 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51e2f3c-a450-40ec-98d0-66cbd647dcf8 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:30:15.714525 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc52f5e7-6999-4819-9cb1-9c61782d634e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:30:15.715203 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc52f5e7-6999-4819-9cb1-9c61782d634e service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:15.715487 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc52f5e7-6999-4819-9cb1-9c61782d634e service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:15.715757 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc52f5e7-6999-4819-9cb1-9c61782d634e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:15.737665 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc52f5e7-6999-4819-9cb1-9c61782d634e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:30:15.739512 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc52f5e7-6999-4819-9cb1-9c61782d634e service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:30:15.761678 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5284314c-465a-424d-9168-da3f68306a0b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:30:15.762957 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5284314c-465a-424d-9168-da3f68306a0b service cinder] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:30:15.767600 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2589/5167] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:30:15 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:30:15.783753 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2579/5168] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:30:15 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 523 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:30:18.355962 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda54a80-8d03-40e8-bb56-374884fac196 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:18.356442 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda54a80-8d03-40e8-bb56-374884fac196 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:18.356539 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda54a80-8d03-40e8-bb56-374884fac196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:18.387046 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-fda54a80-8d03-40e8-bb56-374884fac196 None None] MFA Rules not processed for user `5efda1c40f494592bf1e6af1add120f3`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:30:18.387896 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-fda54a80-8d03-40e8-bb56-374884fac196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:30:18.455295 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:30:18.494140 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5284314c-465a-424d-9168-da3f68306a0b service cinder] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:30:18.564065 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2590/5169] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:30:18 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:30:18.729349 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5284314c-465a-424d-9168-da3f68306a0b service cinder] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:30:18.751232 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc801cbe-7e25-416e-8dc3-1809bca70ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:30:18.752369 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc801cbe-7e25-416e-8dc3-1809bca70ea5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:18.753050 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc801cbe-7e25-416e-8dc3-1809bca70ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:18.753464 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc801cbe-7e25-416e-8dc3-1809bca70ea5 admin admin] PATH_INFO: `/v3/users/6ca45dfdb0554928b0de3376bf397e8f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:18.756196 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc801cbe-7e25-416e-8dc3-1809bca70ea5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ca45dfdb0554928b0de3376bf397e8f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:30:18.762636 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc801cbe-7e25-416e-8dc3-1809bca70ea5 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:30:18.940577 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-dc801cbe-7e25-416e-8dc3-1809bca70ea5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ca45dfdb0554928b0de3376bf397e8f'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:30:18.941461 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-dc801cbe-7e25-416e-8dc3-1809bca70ea5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ca45dfdb0554928b0de3376bf397e8f'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:30:18.954176 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-dc801cbe-7e25-416e-8dc3-1809bca70ea5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ca45dfdb0554928b0de3376bf397e8f'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:30:18.978939 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-dc801cbe-7e25-416e-8dc3-1809bca70ea5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ca45dfdb0554928b0de3376bf397e8f'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:30:19.000907 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:30:19.004620 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-dc801cbe-7e25-416e-8dc3-1809bca70ea5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ca45dfdb0554928b0de3376bf397e8f'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:30:19.022078 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2580/5170] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:30:18 2022] DELETE /identity/v3/users/6ca45dfdb0554928b0de3376bf397e8f => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:30:19.026984 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819a2844-0213-4726-85d9-04af0e8b6c77 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:19.027491 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819a2844-0213-4726-85d9-04af0e8b6c77 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:19.027901 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819a2844-0213-4726-85d9-04af0e8b6c77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:19.065982 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-819a2844-0213-4726-85d9-04af0e8b6c77 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:30:19.068854 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-819a2844-0213-4726-85d9-04af0e8b6c77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:30:19.193642 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2591/5171] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:30:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:30:19.257651 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc801cbe-7e25-416e-8dc3-1809bca70ea5 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:30:19.286747 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-dc801cbe-7e25-416e-8dc3-1809bca70ea5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:30:19.435079 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc801cbe-7e25-416e-8dc3-1809bca70ea5 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:30:19.448024 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332a9fcc-f40f-4ce9-9c39-bf14e131f69c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:30:19.449445 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332a9fcc-f40f-4ce9-9c39-bf14e131f69c service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:19.449445 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332a9fcc-f40f-4ce9-9c39-bf14e131f69c service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:19.449445 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332a9fcc-f40f-4ce9-9c39-bf14e131f69c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:19.477106 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332a9fcc-f40f-4ce9-9c39-bf14e131f69c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:30:19.479574 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332a9fcc-f40f-4ce9-9c39-bf14e131f69c service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:30:19.496446 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2581/5172] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:30:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:30:21.350363 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819a2844-0213-4726-85d9-04af0e8b6c77 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:30:21.351876 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-819a2844-0213-4726-85d9-04af0e8b6c77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:30:21.370881 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819a2844-0213-4726-85d9-04af0e8b6c77 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:30:21.385289 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5150bc11-6215-4e00-b3c3-b12141bceb85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:30:21.386233 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5150bc11-6215-4e00-b3c3-b12141bceb85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:21.386510 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5150bc11-6215-4e00-b3c3-b12141bceb85 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:21.386781 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5150bc11-6215-4e00-b3c3-b12141bceb85 admin admin] PATH_INFO: `/v3/projects/386485cd4c3d42b3a70e7a983c462a35` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:21.389008 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5150bc11-6215-4e00-b3c3-b12141bceb85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=386485cd4c3d42b3a70e7a983c462a35)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:30:21.391051 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5150bc11-6215-4e00-b3c3-b12141bceb85 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:30:21.544561 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-5150bc11-6215-4e00-b3c3-b12141bceb85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '386485cd4c3d42b3a70e7a983c462a35', 'request_id': 'req-5150bc11-6215-4e00-b3c3-b12141bceb85'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:30:21.568624 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-5150bc11-6215-4e00-b3c3-b12141bceb85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '386485cd4c3d42b3a70e7a983c462a35', 'request_id': 'req-5150bc11-6215-4e00-b3c3-b12141bceb85'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:30:21.589786 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-5150bc11-6215-4e00-b3c3-b12141bceb85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '386485cd4c3d42b3a70e7a983c462a35', 'request_id': 'req-5150bc11-6215-4e00-b3c3-b12141bceb85'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:30:21.617125 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-5150bc11-6215-4e00-b3c3-b12141bceb85 admin admin] The token cache is being invalidate because project 386485cd4c3d42b3a70e7a983c462a35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:30:21.617125 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-5150bc11-6215-4e00-b3c3-b12141bceb85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:30:21.618085 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-5150bc11-6215-4e00-b3c3-b12141bceb85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:30:21.622252 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2592/5173] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:30:21 2022] DELETE /identity/v3/projects/386485cd4c3d42b3a70e7a983c462a35 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:30:21.627953 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332a9fcc-f40f-4ce9-9c39-bf14e131f69c service neutron] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:30:21.658494 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332a9fcc-f40f-4ce9-9c39-bf14e131f69c service neutron] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:30:21.862098 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bbbc97-396a-479a-941f-15e29f23fcd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:30:21.863514 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bbbc97-396a-479a-941f-15e29f23fcd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:21.863514 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bbbc97-396a-479a-941f-15e29f23fcd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:21.863729 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bbbc97-396a-479a-941f-15e29f23fcd9 admin admin] PATH_INFO: `/v3/users/8cd84babf31a4533815fff327bc0564a` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:21.867246 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bbbc97-396a-479a-941f-15e29f23fcd9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8cd84babf31a4533815fff327bc0564a)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:30:21.868085 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bbbc97-396a-479a-941f-15e29f23fcd9 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:30:22.010037 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-34bbbc97-396a-479a-941f-15e29f23fcd9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8cd84babf31a4533815fff327bc0564a'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:30:22.010752 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-34bbbc97-396a-479a-941f-15e29f23fcd9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8cd84babf31a4533815fff327bc0564a'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:30:22.043654 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-34bbbc97-396a-479a-941f-15e29f23fcd9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8cd84babf31a4533815fff327bc0564a'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:30:22.082361 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-34bbbc97-396a-479a-941f-15e29f23fcd9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8cd84babf31a4533815fff327bc0564a'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:30:22.111783 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5150bc11-6215-4e00-b3c3-b12141bceb85 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:30:22.113277 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-5150bc11-6215-4e00-b3c3-b12141bceb85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:30:22.131310 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-34bbbc97-396a-479a-941f-15e29f23fcd9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8cd84babf31a4533815fff327bc0564a'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:30:22.134145 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5150bc11-6215-4e00-b3c3-b12141bceb85 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:30:22.142157 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0494ef4f-e894-4936-8ae3-b351bbb60922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:30:22.143499 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0494ef4f-e894-4936-8ae3-b351bbb60922 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:22.143499 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0494ef4f-e894-4936-8ae3-b351bbb60922 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:22.143758 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0494ef4f-e894-4936-8ae3-b351bbb60922 admin admin] PATH_INFO: `/v3/users/cadc4fac778e4eaf905a3fbc26fbb090` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:22.146319 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2582/5174] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:30:21 2022] DELETE /identity/v3/users/8cd84babf31a4533815fff327bc0564a => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:30:22.150456 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0494ef4f-e894-4936-8ae3-b351bbb60922 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cadc4fac778e4eaf905a3fbc26fbb090)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:30:22.153017 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0494ef4f-e894-4936-8ae3-b351bbb60922 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:30:22.231063 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:30:22.234815 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-0494ef4f-e894-4936-8ae3-b351bbb60922 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cadc4fac778e4eaf905a3fbc26fbb090'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:30:22.249073 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-0494ef4f-e894-4936-8ae3-b351bbb60922 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cadc4fac778e4eaf905a3fbc26fbb090'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:30:22.251582 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-0494ef4f-e894-4936-8ae3-b351bbb60922 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cadc4fac778e4eaf905a3fbc26fbb090'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:30:22.266241 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-0494ef4f-e894-4936-8ae3-b351bbb60922 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cadc4fac778e4eaf905a3fbc26fbb090'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:30:22.291755 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-0494ef4f-e894-4936-8ae3-b351bbb60922 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cadc4fac778e4eaf905a3fbc26fbb090'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:30:22.316875 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2593/5175] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:30:22 2022] DELETE /identity/v3/users/cadc4fac778e4eaf905a3fbc26fbb090 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:30:22.321807 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f9c89d-cbc1-49cc-9c4e-d02240ab2d0a None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:22.322512 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f9c89d-cbc1-49cc-9c4e-d02240ab2d0a None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:22.322800 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f9c89d-cbc1-49cc-9c4e-d02240ab2d0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:22.376928 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-62f9c89d-cbc1-49cc-9c4e-d02240ab2d0a None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:30:22.382410 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-62f9c89d-cbc1-49cc-9c4e-d02240ab2d0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:30:22.432875 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:30:22.597081 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2583/5176] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:30:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:30:22.620600 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0494ef4f-e894-4936-8ae3-b351bbb60922 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:30:22.623658 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-0494ef4f-e894-4936-8ae3-b351bbb60922 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:30:22.757008 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0494ef4f-e894-4936-8ae3-b351bbb60922 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:30:22.761775 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceeaee54-f70e-470c-be52-d7dd5dbd11cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:30:22.763197 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeaee54-f70e-470c-be52-d7dd5dbd11cf service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:22.763475 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeaee54-f70e-470c-be52-d7dd5dbd11cf service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:22.763747 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeaee54-f70e-470c-be52-d7dd5dbd11cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:22.775765 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceeaee54-f70e-470c-be52-d7dd5dbd11cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:30:22.777370 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceeaee54-f70e-470c-be52-d7dd5dbd11cf service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:30:22.793544 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2594/5177] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:30:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 23 21:30:24.181056 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f9c89d-cbc1-49cc-9c4e-d02240ab2d0a None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:30:24.182667 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-62f9c89d-cbc1-49cc-9c4e-d02240ab2d0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:30:24.199807 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f9c89d-cbc1-49cc-9c4e-d02240ab2d0a None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:30:24.205374 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44044ef9-4f30-4f6d-9ad1-85581e5d484d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:30:24.206455 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44044ef9-4f30-4f6d-9ad1-85581e5d484d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:24.206766 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44044ef9-4f30-4f6d-9ad1-85581e5d484d admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:24.207113 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44044ef9-4f30-4f6d-9ad1-85581e5d484d admin admin] PATH_INFO: `/v3/users/d96d482192c3490ca3345a98c75c1740` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:24.208433 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44044ef9-4f30-4f6d-9ad1-85581e5d484d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d96d482192c3490ca3345a98c75c1740)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:30:24.211256 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44044ef9-4f30-4f6d-9ad1-85581e5d484d admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:30:24.261378 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceeaee54-f70e-470c-be52-d7dd5dbd11cf service neutron] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:30:24.263506 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-ceeaee54-f70e-470c-be52-d7dd5dbd11cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:30:24.286314 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceeaee54-f70e-470c-be52-d7dd5dbd11cf service neutron] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:30:24.306123 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba80c6c9-f797-4319-92ee-2d67916aca21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:30:24.307390 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba80c6c9-f797-4319-92ee-2d67916aca21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:24.308214 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba80c6c9-f797-4319-92ee-2d67916aca21 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:24.308823 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba80c6c9-f797-4319-92ee-2d67916aca21 admin admin] PATH_INFO: `/v3/projects/e751dfada40945a69472003d08f1bb0b` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:24.311902 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba80c6c9-f797-4319-92ee-2d67916aca21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e751dfada40945a69472003d08f1bb0b)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:30:24.314050 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-44044ef9-4f30-4f6d-9ad1-85581e5d484d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd96d482192c3490ca3345a98c75c1740'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:30:24.315731 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba80c6c9-f797-4319-92ee-2d67916aca21 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:30:24.317612 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-44044ef9-4f30-4f6d-9ad1-85581e5d484d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd96d482192c3490ca3345a98c75c1740'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:30:24.332334 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-44044ef9-4f30-4f6d-9ad1-85581e5d484d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd96d482192c3490ca3345a98c75c1740'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:30:24.357345 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-44044ef9-4f30-4f6d-9ad1-85581e5d484d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd96d482192c3490ca3345a98c75c1740'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:30:24.373435 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-44044ef9-4f30-4f6d-9ad1-85581e5d484d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd96d482192c3490ca3345a98c75c1740'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:30:24.389908 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2584/5178] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:30:24 2022] DELETE /identity/v3/users/d96d482192c3490ca3345a98c75c1740 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:30:24.393403 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d3fea7-993a-4729-a9ab-bb74192fca2e None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:24.393781 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d3fea7-993a-4729-a9ab-bb74192fca2e None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:24.394170 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d3fea7-993a-4729-a9ab-bb74192fca2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:24.398269 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-ba80c6c9-f797-4319-92ee-2d67916aca21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e751dfada40945a69472003d08f1bb0b', 'request_id': 'req-ba80c6c9-f797-4319-92ee-2d67916aca21'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:30:24.422540 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-ba80c6c9-f797-4319-92ee-2d67916aca21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e751dfada40945a69472003d08f1bb0b', 'request_id': 'req-ba80c6c9-f797-4319-92ee-2d67916aca21'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:30:24.426142 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-d3d3fea7-993a-4729-a9ab-bb74192fca2e None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:30:24.427516 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-d3d3fea7-993a-4729-a9ab-bb74192fca2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:30:24.438145 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-ba80c6c9-f797-4319-92ee-2d67916aca21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e751dfada40945a69472003d08f1bb0b', 'request_id': 'req-ba80c6c9-f797-4319-92ee-2d67916aca21'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:30:24.457785 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-ba80c6c9-f797-4319-92ee-2d67916aca21 admin admin] The token cache is being invalidate because project e751dfada40945a69472003d08f1bb0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:30:24.458480 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-ba80c6c9-f797-4319-92ee-2d67916aca21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:30:24.459580 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-ba80c6c9-f797-4319-92ee-2d67916aca21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:30:24.461768 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2595/5179] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:30:24 2022] DELETE /identity/v3/projects/e751dfada40945a69472003d08f1bb0b => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:30:24.467491 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201e59af-1f3a-42e1-823f-09a983fd98ce None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:24.468054 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201e59af-1f3a-42e1-823f-09a983fd98ce None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:24.468543 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201e59af-1f3a-42e1-823f-09a983fd98ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:24.506751 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-201e59af-1f3a-42e1-823f-09a983fd98ce None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:30:24.508212 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-201e59af-1f3a-42e1-823f-09a983fd98ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:30:24.582469 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2585/5180] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:30:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:30:24.585784 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34008619-9d43-4012-9a5d-12b6bb9c2edc None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:24.585784 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34008619-9d43-4012-9a5d-12b6bb9c2edc None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:24.585784 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34008619-9d43-4012-9a5d-12b6bb9c2edc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:24.613653 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:30:24.645838 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2596/5181] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:30:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:30:24.647048 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201e59af-1f3a-42e1-823f-09a983fd98ce None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:30:24.653960 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-201e59af-1f3a-42e1-823f-09a983fd98ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:30:24.678403 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201e59af-1f3a-42e1-823f-09a983fd98ce None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:30:24.679311 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-34008619-9d43-4012-9a5d-12b6bb9c2edc None None] MFA Rules not processed for user `a40e57fa4476483ab518a4a9d2ed7989`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:30:24.681471 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-34008619-9d43-4012-9a5d-12b6bb9c2edc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:30:24.691080 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6a9e5c-0c88-45b4-8c3c-b28aeed8b0d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:30:24.691993 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6a9e5c-0c88-45b4-8c3c-b28aeed8b0d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:24.692242 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6a9e5c-0c88-45b4-8c3c-b28aeed8b0d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:24.692568 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6a9e5c-0c88-45b4-8c3c-b28aeed8b0d3 admin admin] PATH_INFO: `/v3/projects/fe591cb2b9f24f8a8ba51e27c537da44` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:24.695264 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6a9e5c-0c88-45b4-8c3c-b28aeed8b0d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe591cb2b9f24f8a8ba51e27c537da44)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:30:24.698867 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6a9e5c-0c88-45b4-8c3c-b28aeed8b0d3 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:30:24.713374 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:30:24.803668 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-5f6a9e5c-0c88-45b4-8c3c-b28aeed8b0d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe591cb2b9f24f8a8ba51e27c537da44', 'request_id': 'req-5f6a9e5c-0c88-45b4-8c3c-b28aeed8b0d3'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:30:24.826105 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-5f6a9e5c-0c88-45b4-8c3c-b28aeed8b0d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe591cb2b9f24f8a8ba51e27c537da44', 'request_id': 'req-5f6a9e5c-0c88-45b4-8c3c-b28aeed8b0d3'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:30:24.834059 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-5f6a9e5c-0c88-45b4-8c3c-b28aeed8b0d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe591cb2b9f24f8a8ba51e27c537da44', 'request_id': 'req-5f6a9e5c-0c88-45b4-8c3c-b28aeed8b0d3'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:30:24.840872 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2586/5182] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:30:24 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:30:24.843164 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34008619-9d43-4012-9a5d-12b6bb9c2edc None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:30:24.851414 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-34008619-9d43-4012-9a5d-12b6bb9c2edc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:30:24.867544 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-5f6a9e5c-0c88-45b4-8c3c-b28aeed8b0d3 admin admin] The token cache is being invalidate because project fe591cb2b9f24f8a8ba51e27c537da44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:30:24.867832 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-5f6a9e5c-0c88-45b4-8c3c-b28aeed8b0d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:30:24.868516 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-5f6a9e5c-0c88-45b4-8c3c-b28aeed8b0d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:30:24.870433 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2597/5183] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:30:24 2022] DELETE /identity/v3/projects/fe591cb2b9f24f8a8ba51e27c537da44 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:30:24.871844 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dde0c1-abeb-4bb1-833d-f13118811402 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:24.872100 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dde0c1-abeb-4bb1-833d-f13118811402 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:24.872377 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dde0c1-abeb-4bb1-833d-f13118811402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:24.909980 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-09dde0c1-abeb-4bb1-833d-f13118811402 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:30:24.911221 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-09dde0c1-abeb-4bb1-833d-f13118811402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:30:24.963841 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34008619-9d43-4012-9a5d-12b6bb9c2edc None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:30:25.027650 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a359ee2a-838f-403e-bd21-565aeed4f4c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:30:25.028457 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a359ee2a-838f-403e-bd21-565aeed4f4c2 service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:25.028811 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a359ee2a-838f-403e-bd21-565aeed4f4c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:25.029153 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a359ee2a-838f-403e-bd21-565aeed4f4c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:25.032129 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-a359ee2a-838f-403e-bd21-565aeed4f4c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:30:25.046500 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2598/5184] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:30:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:30:25.050003 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a359ee2a-838f-403e-bd21-565aeed4f4c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:30:25.050185 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dde0c1-abeb-4bb1-833d-f13118811402 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:30:25.050452 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a359ee2a-838f-403e-bd21-565aeed4f4c2 service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:30:25.054319 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-09dde0c1-abeb-4bb1-833d-f13118811402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:30:25.066613 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2587/5185] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:30:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:30:25.069153 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcda18d0-3d61-404a-bc72-4a31a0d56b27 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:25.072552 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcda18d0-3d61-404a-bc72-4a31a0d56b27 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:25.072999 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcda18d0-3d61-404a-bc72-4a31a0d56b27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:25.118039 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-dcda18d0-3d61-404a-bc72-4a31a0d56b27 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:30:25.119311 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-dcda18d0-3d61-404a-bc72-4a31a0d56b27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:30:25.147647 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2588/5186] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:30:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:30:25.147647 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcda18d0-3d61-404a-bc72-4a31a0d56b27 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:30:25.168002 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcda18d0-3d61-404a-bc72-4a31a0d56b27 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:30:25.181298 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f20309-85a7-47bb-9baf-5d3aad4799d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:30:25.182123 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f20309-85a7-47bb-9baf-5d3aad4799d3 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:25.182355 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f20309-85a7-47bb-9baf-5d3aad4799d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:25.182635 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f20309-85a7-47bb-9baf-5d3aad4799d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:25.183378 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f20309-85a7-47bb-9baf-5d3aad4799d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:30:25.186595 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f20309-85a7-47bb-9baf-5d3aad4799d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:30:25.189586 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f20309-85a7-47bb-9baf-5d3aad4799d3 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:30:25.196007 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dde0c1-abeb-4bb1-833d-f13118811402 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:30:25.206793 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7a896d-2bcc-48f6-a0e7-82fdaf108102 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec5fd3a489c341b7964704d689037f05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:30:25.207490 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7a896d-2bcc-48f6-a0e7-82fdaf108102 service cinder] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:25.207751 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7a896d-2bcc-48f6-a0e7-82fdaf108102 service cinder] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:25.209383 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7a896d-2bcc-48f6-a0e7-82fdaf108102 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:25.216702 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-9a7a896d-2bcc-48f6-a0e7-82fdaf108102 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:30:25.218591 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2589/5187] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:30:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:30:25.220107 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbb3546-fb80-4dc6-81de-06205cb7249c None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:25.220395 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbb3546-fb80-4dc6-81de-06205cb7249c None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:25.220675 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbb3546-fb80-4dc6-81de-06205cb7249c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:25.265959 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-0fbb3546-fb80-4dc6-81de-06205cb7249c None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:30:25.267230 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-0fbb3546-fb80-4dc6-81de-06205cb7249c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:30:25.272024 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:30:25.290063 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2590/5188] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:30:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:30:25.291970 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbb3546-fb80-4dc6-81de-06205cb7249c None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:30:25.312745 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbb3546-fb80-4dc6-81de-06205cb7249c None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:30:25.326451 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef2aea2-cabd-4577-a53d-08f48cb89c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:30:25.327203 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef2aea2-cabd-4577-a53d-08f48cb89c0a admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:25.327837 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef2aea2-cabd-4577-a53d-08f48cb89c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:25.327837 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef2aea2-cabd-4577-a53d-08f48cb89c0a admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:25.328442 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef2aea2-cabd-4577-a53d-08f48cb89c0a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:30:25.333808 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef2aea2-cabd-4577-a53d-08f48cb89c0a admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:30:25.346364 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7a896d-2bcc-48f6-a0e7-82fdaf108102 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:30:25.350343 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7a896d-2bcc-48f6-a0e7-82fdaf108102 service cinder] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:30:25.374689 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2599/5189] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:30:25 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:30:25.374907 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7a896d-2bcc-48f6-a0e7-82fdaf108102 service cinder] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:30:25.396793 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2591/5190] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:30:25 2022] POST /identity/v3/projects => generated 405 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:30:25.399585 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef2aea2-cabd-4577-a53d-08f48cb89c0a admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:30:25.405498 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7a896d-2bcc-48f6-a0e7-82fdaf108102 service cinder] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:30:25.468263 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:30:25.534485 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32e0ce2-862b-462b-8e4d-5b26c105d792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:30:25.535195 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32e0ce2-862b-462b-8e4d-5b26c105d792 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:25.536993 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32e0ce2-862b-462b-8e4d-5b26c105d792 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:25.537282 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32e0ce2-862b-462b-8e4d-5b26c105d792 admin admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:25.538057 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32e0ce2-862b-462b-8e4d-5b26c105d792 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:30:25.538365 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32e0ce2-862b-462b-8e4d-5b26c105d792 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:30:25.542665 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef2aea2-cabd-4577-a53d-08f48cb89c0a admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:30:25.543574 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32e0ce2-862b-462b-8e4d-5b26c105d792 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:30:25.557012 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45b8ca8-71f6-402d-be35-b9669cfa1fae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:30:25.559341 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45b8ca8-71f6-402d-be35-b9669cfa1fae admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:25.559650 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45b8ca8-71f6-402d-be35-b9669cfa1fae admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:25.559934 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45b8ca8-71f6-402d-be35-b9669cfa1fae admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:25.560680 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45b8ca8-71f6-402d-be35-b9669cfa1fae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:30:25.566754 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45b8ca8-71f6-402d-be35-b9669cfa1fae admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:30:25.580762 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2600/5191] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:30:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:30:25.581849 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32e0ce2-862b-462b-8e4d-5b26c105d792 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:30:25.608559 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32e0ce2-862b-462b-8e4d-5b26c105d792 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:30:25.628479 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2592/5192] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:30:25 2022] POST /identity/v3/users => generated 303 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:30:25.637282 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45b8ca8-71f6-402d-be35-b9669cfa1fae admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:30:25.643606 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b2e511-878a-4a8b-aed2-09a131ff1dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:30:25.646191 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b2e511-878a-4a8b-aed2-09a131ff1dad admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:25.646482 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b2e511-878a-4a8b-aed2-09a131ff1dad admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:25.646758 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b2e511-878a-4a8b-aed2-09a131ff1dad admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:25.655818 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b2e511-878a-4a8b-aed2-09a131ff1dad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:30:25.657772 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b2e511-878a-4a8b-aed2-09a131ff1dad admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:30:25.671093 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45b8ca8-71f6-402d-be35-b9669cfa1fae admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:30:25.690037 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f32c66a-7403-4beb-9936-2bafed0aa4e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:30:25.690734 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f32c66a-7403-4beb-9936-2bafed0aa4e2 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:25.691016 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f32c66a-7403-4beb-9936-2bafed0aa4e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:25.691290 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f32c66a-7403-4beb-9936-2bafed0aa4e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:25.693202 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f32c66a-7403-4beb-9936-2bafed0aa4e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:30:25.698393 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f32c66a-7403-4beb-9936-2bafed0aa4e2 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:30:25.717805 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2593/5193] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:30:25 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:30:25.718696 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f32c66a-7403-4beb-9936-2bafed0aa4e2 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:30:25.735722 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2601/5194] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:30:25 2022] POST /identity/v3/projects => generated 375 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:30:25.739940 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b2e511-878a-4a8b-aed2-09a131ff1dad admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:30:25.756129 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f32c66a-7403-4beb-9936-2bafed0aa4e2 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:30:25.863310 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fac79e-e979-4e50-9f4a-8a57089c3c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:30:25.863949 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fac79e-e979-4e50-9f4a-8a57089c3c6d admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:25.864272 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fac79e-e979-4e50-9f4a-8a57089c3c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:25.864593 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fac79e-e979-4e50-9f4a-8a57089c3c6d admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:25.865438 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fac79e-e979-4e50-9f4a-8a57089c3c6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:30:25.867146 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fac79e-e979-4e50-9f4a-8a57089c3c6d admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:30:25.898654 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2594/5195] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:30:25 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 21:30:25.899644 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fac79e-e979-4e50-9f4a-8a57089c3c6d admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:30:25.925946 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fac79e-e979-4e50-9f4a-8a57089c3c6d admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:30:25.938755 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e4e3f5-5514-449c-bad0-57aa6e31f98d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:30:25.939676 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e4e3f5-5514-449c-bad0-57aa6e31f98d admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:25.939954 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e4e3f5-5514-449c-bad0-57aa6e31f98d admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:25.940228 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e4e3f5-5514-449c-bad0-57aa6e31f98d admin admin] PATH_INFO: `/v3/projects/3d547fc8e53d43888e35c3e8ef5caada/users/fc0782a98aca44f18bf86a9f6ad5eb60/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:25.941115 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b2e511-878a-4a8b-aed2-09a131ff1dad admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:30:25.957913 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98623fb1-6b8b-4205-bead-bd0da7e655ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:30:25.958967 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98623fb1-6b8b-4205-bead-bd0da7e655ab admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:25.959417 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98623fb1-6b8b-4205-bead-bd0da7e655ab admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:25.959862 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98623fb1-6b8b-4205-bead-bd0da7e655ab admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:25.961553 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98623fb1-6b8b-4205-bead-bd0da7e655ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:30:25.967687 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98623fb1-6b8b-4205-bead-bd0da7e655ab admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:30:26.007755 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e4e3f5-5514-449c-bad0-57aa6e31f98d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d547fc8e53d43888e35c3e8ef5caada, user_id=fc0782a98aca44f18bf86a9f6ad5eb60, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:30:26.016608 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e4e3f5-5514-449c-bad0-57aa6e31f98d admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:30:26.034069 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2602/5196] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:30:25 2022] POST /identity/v3/users => generated 288 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:30:26.035189 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98623fb1-6b8b-4205-bead-bd0da7e655ab admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:30:26.055760 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98623fb1-6b8b-4205-bead-bd0da7e655ab admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:30:26.062747 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2595/5197] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:30:25 2022] PUT /identity/v3/projects/3d547fc8e53d43888e35c3e8ef5caada/users/fc0782a98aca44f18bf86a9f6ad5eb60/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:30:26.068235 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e25501e-d939-4a63-b977-4a8e30ba604c None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:26.068838 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e25501e-d939-4a63-b977-4a8e30ba604c None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:26.069382 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e25501e-d939-4a63-b977-4a8e30ba604c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:26.123902 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-1e25501e-d939-4a63-b977-4a8e30ba604c None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:30:26.128084 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-1e25501e-d939-4a63-b977-4a8e30ba604c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:30:26.168197 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:30:26.234542 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b97381-adaf-403c-aa66-e9da9e4fe18d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:30:26.235591 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b97381-adaf-403c-aa66-e9da9e4fe18d admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:26.235978 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b97381-adaf-403c-aa66-e9da9e4fe18d admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:26.236258 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b97381-adaf-403c-aa66-e9da9e4fe18d admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:26.237406 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b97381-adaf-403c-aa66-e9da9e4fe18d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:30:26.244138 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b97381-adaf-403c-aa66-e9da9e4fe18d admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:30:26.258939 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2603/5198] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:30:26 2022] GET /identity/v3/roles => generated 1420 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:30:26.260776 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b97381-adaf-403c-aa66-e9da9e4fe18d admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:30:26.275279 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b97381-adaf-403c-aa66-e9da9e4fe18d admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:30:26.284048 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12766236-d974-4f2a-930b-815f99b4d902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:30:26.284820 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12766236-d974-4f2a-930b-815f99b4d902 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:26.285110 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12766236-d974-4f2a-930b-815f99b4d902 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:26.285387 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12766236-d974-4f2a-930b-815f99b4d902 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:26.286307 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12766236-d974-4f2a-930b-815f99b4d902 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:30:26.288165 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12766236-d974-4f2a-930b-815f99b4d902 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:30:26.318207 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2604/5199] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:30:26 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:30:26.321689 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12766236-d974-4f2a-930b-815f99b4d902 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:30:26.368638 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2596/5200] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:30:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:30:26.377645 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12766236-d974-4f2a-930b-815f99b4d902 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:30:26.387423 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dcb67f-0fb0-43f6-aa0f-164670696cb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:30:26.390779 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dcb67f-0fb0-43f6-aa0f-164670696cb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:26.391560 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dcb67f-0fb0-43f6-aa0f-164670696cb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:26.391743 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dcb67f-0fb0-43f6-aa0f-164670696cb9 admin admin] PATH_INFO: `/v3/projects/de9da53f1e2a486aa8f7332a9f259fbc/users/459dea8d02d34ad9a468bbc459d9926b/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:26.403275 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e25501e-d939-4a63-b977-4a8e30ba604c None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:30:26.404651 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-1e25501e-d939-4a63-b977-4a8e30ba604c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:30:26.434303 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dcb67f-0fb0-43f6-aa0f-164670696cb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de9da53f1e2a486aa8f7332a9f259fbc, user_id=459dea8d02d34ad9a468bbc459d9926b, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:30:26.437066 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dcb67f-0fb0-43f6-aa0f-164670696cb9 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:30:26.464706 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:30:26.469775 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2605/5201] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:30:26 2022] PUT /identity/v3/projects/de9da53f1e2a486aa8f7332a9f259fbc/users/459dea8d02d34ad9a468bbc459d9926b/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:30:26.481169 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90270b29-40c8-4355-b7cb-8648cd65b41e None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:26.481449 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90270b29-40c8-4355-b7cb-8648cd65b41e None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:26.481721 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90270b29-40c8-4355-b7cb-8648cd65b41e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:26.551598 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-90270b29-40c8-4355-b7cb-8648cd65b41e None None] MFA Rules not processed for user `459dea8d02d34ad9a468bbc459d9926b`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:30:26.552842 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-90270b29-40c8-4355-b7cb-8648cd65b41e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:30:26.554107 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e25501e-d939-4a63-b977-4a8e30ba604c None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:30:26.685554 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003d5bf2-7880-4893-b896-a000c85818e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:30:26.686286 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003d5bf2-7880-4893-b896-a000c85818e6 service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:26.686565 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003d5bf2-7880-4893-b896-a000c85818e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:26.686882 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003d5bf2-7880-4893-b896-a000c85818e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:26.767304 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2606/5202] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:30:26 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:30:26.775513 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90270b29-40c8-4355-b7cb-8648cd65b41e None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:30:26.869030 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003d5bf2-7880-4893-b896-a000c85818e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:30:26.873142 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003d5bf2-7880-4893-b896-a000c85818e6 service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:30:26.888212 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2597/5203] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:30:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 23 21:30:26.917597 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90270b29-40c8-4355-b7cb-8648cd65b41e None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:30:26.928323 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad5b3d1-dcb4-48fa-9a88-9087a688a8ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec5fd3a489c341b7964704d689037f05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:30:26.929009 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad5b3d1-dcb4-48fa-9a88-9087a688a8ac service cinder] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:26.929344 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad5b3d1-dcb4-48fa-9a88-9087a688a8ac service cinder] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:26.929619 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad5b3d1-dcb4-48fa-9a88-9087a688a8ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:26.941201 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad5b3d1-dcb4-48fa-9a88-9087a688a8ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:30:26.942884 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad5b3d1-dcb4-48fa-9a88-9087a688a8ac service cinder] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:30:26.954829 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2607/5204] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:30:26 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:30:27.460568 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003d5bf2-7880-4893-b896-a000c85818e6 service neutron] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:30:27.463513 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-003d5bf2-7880-4893-b896-a000c85818e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:30:27.498491 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003d5bf2-7880-4893-b896-a000c85818e6 service neutron] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:30:27.505607 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e10263-16d8-4820-91f2-79e526098754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:30:27.507116 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e10263-16d8-4820-91f2-79e526098754 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:27.507587 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e10263-16d8-4820-91f2-79e526098754 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:27.507938 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e10263-16d8-4820-91f2-79e526098754 admin admin] PATH_INFO: `/v3/projects/ae9d008924284315ba5985b10277b403` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:27.509357 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e10263-16d8-4820-91f2-79e526098754 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae9d008924284315ba5985b10277b403)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:30:27.511647 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e10263-16d8-4820-91f2-79e526098754 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:30:27.639440 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-71e10263-16d8-4820-91f2-79e526098754 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae9d008924284315ba5985b10277b403', 'request_id': 'req-71e10263-16d8-4820-91f2-79e526098754'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:30:27.677636 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-71e10263-16d8-4820-91f2-79e526098754 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae9d008924284315ba5985b10277b403', 'request_id': 'req-71e10263-16d8-4820-91f2-79e526098754'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:30:27.690162 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-71e10263-16d8-4820-91f2-79e526098754 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae9d008924284315ba5985b10277b403', 'request_id': 'req-71e10263-16d8-4820-91f2-79e526098754'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:30:27.720480 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-71e10263-16d8-4820-91f2-79e526098754 admin admin] The token cache is being invalidate because project ae9d008924284315ba5985b10277b403 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:30:27.720969 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-71e10263-16d8-4820-91f2-79e526098754 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:30:27.723229 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-71e10263-16d8-4820-91f2-79e526098754 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:30:27.731629 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2598/5205] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:30:27 2022] DELETE /identity/v3/projects/ae9d008924284315ba5985b10277b403 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:30:27.736197 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad5b3d1-dcb4-48fa-9a88-9087a688a8ac service cinder] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:30:27.755617 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad5b3d1-dcb4-48fa-9a88-9087a688a8ac service cinder] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:30:27.801370 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:30:27.982686 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e165746b-2ade-4c00-b10d-7ee2dc11681a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:30:27.984740 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e165746b-2ade-4c00-b10d-7ee2dc11681a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:27.985019 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e165746b-2ade-4c00-b10d-7ee2dc11681a admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:27.985290 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e165746b-2ade-4c00-b10d-7ee2dc11681a admin admin] PATH_INFO: `/v3/users/2ca5de8be752482d8535331281a34922` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:27.986613 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e165746b-2ade-4c00-b10d-7ee2dc11681a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ca5de8be752482d8535331281a34922)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:30:27.988812 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e165746b-2ade-4c00-b10d-7ee2dc11681a admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:30:28.154712 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-e165746b-2ade-4c00-b10d-7ee2dc11681a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ca5de8be752482d8535331281a34922'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:30:28.168884 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-e165746b-2ade-4c00-b10d-7ee2dc11681a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ca5de8be752482d8535331281a34922'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:30:28.169653 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-e165746b-2ade-4c00-b10d-7ee2dc11681a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ca5de8be752482d8535331281a34922'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:30:28.189985 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-e165746b-2ade-4c00-b10d-7ee2dc11681a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ca5de8be752482d8535331281a34922'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:30:28.212392 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-e165746b-2ade-4c00-b10d-7ee2dc11681a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ca5de8be752482d8535331281a34922'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:30:28.225941 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2608/5206] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:30:27 2022] DELETE /identity/v3/users/2ca5de8be752482d8535331281a34922 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:30:29.107367 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e10263-16d8-4820-91f2-79e526098754 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:30:29.109227 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-71e10263-16d8-4820-91f2-79e526098754 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:30:29.128775 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e10263-16d8-4820-91f2-79e526098754 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:30:29.134521 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:30:29.269149 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fd31ee-ed27-4426-8583-a9bd2fa7969f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:30:29.270563 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fd31ee-ed27-4426-8583-a9bd2fa7969f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:29.271007 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fd31ee-ed27-4426-8583-a9bd2fa7969f admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:29.271291 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fd31ee-ed27-4426-8583-a9bd2fa7969f admin admin] PATH_INFO: `/v3/users/459dea8d02d34ad9a468bbc459d9926b` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:29.282124 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fd31ee-ed27-4426-8583-a9bd2fa7969f admin admin] RBAC: Authorizing `identity:delete_user(user_id=459dea8d02d34ad9a468bbc459d9926b)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:30:29.284761 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fd31ee-ed27-4426-8583-a9bd2fa7969f admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:30:29.391309 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-a7fd31ee-ed27-4426-8583-a9bd2fa7969f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '459dea8d02d34ad9a468bbc459d9926b'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:30:29.397401 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-a7fd31ee-ed27-4426-8583-a9bd2fa7969f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '459dea8d02d34ad9a468bbc459d9926b'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:30:29.407651 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-a7fd31ee-ed27-4426-8583-a9bd2fa7969f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '459dea8d02d34ad9a468bbc459d9926b'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:30:29.430085 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-a7fd31ee-ed27-4426-8583-a9bd2fa7969f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '459dea8d02d34ad9a468bbc459d9926b'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:30:29.461142 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-a7fd31ee-ed27-4426-8583-a9bd2fa7969f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '459dea8d02d34ad9a468bbc459d9926b'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:30:29.470814 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2599/5207] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:30:29 2022] DELETE /identity/v3/users/459dea8d02d34ad9a468bbc459d9926b => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:30:29.476190 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c21dc6-7e10-44ed-8960-3a1fc5ce7bbb None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:29.476742 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c21dc6-7e10-44ed-8960-3a1fc5ce7bbb None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:29.476830 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c21dc6-7e10-44ed-8960-3a1fc5ce7bbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:29.511364 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-61c21dc6-7e10-44ed-8960-3a1fc5ce7bbb None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:30:29.512750 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-61c21dc6-7e10-44ed-8960-3a1fc5ce7bbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:30:29.718290 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2609/5208] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:30:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:30:29.741327 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fd31ee-ed27-4426-8583-a9bd2fa7969f admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:30:29.743321 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-a7fd31ee-ed27-4426-8583-a9bd2fa7969f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:30:29.771367 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fd31ee-ed27-4426-8583-a9bd2fa7969f admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:30:29.799003 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c21dc6-7e10-44ed-8960-3a1fc5ce7bbb None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:30:29.800986 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-61c21dc6-7e10-44ed-8960-3a1fc5ce7bbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:30:29.809405 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c0a500-93a0-4e1a-aa1e-ed6fc82ae486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:30:29.811708 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c0a500-93a0-4e1a-aa1e-ed6fc82ae486 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:29.812308 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c0a500-93a0-4e1a-aa1e-ed6fc82ae486 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:29.812586 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c0a500-93a0-4e1a-aa1e-ed6fc82ae486 admin admin] PATH_INFO: `/v3/projects/c62cad5e9ffe4e6388272d5aeba41152` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:29.816641 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c0a500-93a0-4e1a-aa1e-ed6fc82ae486 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c62cad5e9ffe4e6388272d5aeba41152)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:30:29.821723 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c0a500-93a0-4e1a-aa1e-ed6fc82ae486 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:30:29.933028 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-06c0a500-93a0-4e1a-aa1e-ed6fc82ae486 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c62cad5e9ffe4e6388272d5aeba41152', 'request_id': 'req-06c0a500-93a0-4e1a-aa1e-ed6fc82ae486'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:30:29.953706 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-06c0a500-93a0-4e1a-aa1e-ed6fc82ae486 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c62cad5e9ffe4e6388272d5aeba41152', 'request_id': 'req-06c0a500-93a0-4e1a-aa1e-ed6fc82ae486'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:30:30.001790 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-06c0a500-93a0-4e1a-aa1e-ed6fc82ae486 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c62cad5e9ffe4e6388272d5aeba41152', 'request_id': 'req-06c0a500-93a0-4e1a-aa1e-ed6fc82ae486'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:30:30.041002 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:30:30.050653 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-06c0a500-93a0-4e1a-aa1e-ed6fc82ae486 admin admin] The token cache is being invalidate because project c62cad5e9ffe4e6388272d5aeba41152 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:30:30.050952 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-06c0a500-93a0-4e1a-aa1e-ed6fc82ae486 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:30:30.051630 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-06c0a500-93a0-4e1a-aa1e-ed6fc82ae486 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:30:30.054927 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2600/5209] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:30:29 2022] DELETE /identity/v3/projects/c62cad5e9ffe4e6388272d5aeba41152 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:30:30.060071 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28038f1d-f922-4945-9fdc-8ef5edc7910a None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:30.060352 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28038f1d-f922-4945-9fdc-8ef5edc7910a None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:30.060764 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28038f1d-f922-4945-9fdc-8ef5edc7910a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:30.097762 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-28038f1d-f922-4945-9fdc-8ef5edc7910a None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:30:30.099025 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-28038f1d-f922-4945-9fdc-8ef5edc7910a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:30:30.112909 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:30:30.114859 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c21dc6-7e10-44ed-8960-3a1fc5ce7bbb None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:30:30.253028 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2601/5210] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:30:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:30:30.262716 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfac6ccb-032e-4041-bc64-71f2c37647f8 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:30.263011 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfac6ccb-032e-4041-bc64-71f2c37647f8 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:30.263281 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfac6ccb-032e-4041-bc64-71f2c37647f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:30.265389 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80f396b-92ac-4b91-aa9e-285ef7e9ef4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:30:30.266088 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80f396b-92ac-4b91-aa9e-285ef7e9ef4d service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:30.266361 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80f396b-92ac-4b91-aa9e-285ef7e9ef4d service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:30.266629 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80f396b-92ac-4b91-aa9e-285ef7e9ef4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:30.269291 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-c80f396b-92ac-4b91-aa9e-285ef7e9ef4d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:30:30.299407 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-dfac6ccb-032e-4041-bc64-71f2c37647f8 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:30:30.300577 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-dfac6ccb-032e-4041-bc64-71f2c37647f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:30:30.302309 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80f396b-92ac-4b91-aa9e-285ef7e9ef4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:30:30.303836 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80f396b-92ac-4b91-aa9e-285ef7e9ef4d service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:30:30.323856 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2602/5212] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:30:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:30:30.324055 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2610/5212] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:30:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 524 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 23 21:30:30.329472 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfac6ccb-032e-4041-bc64-71f2c37647f8 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:30:30.341676 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfac6ccb-032e-4041-bc64-71f2c37647f8 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:30:30.346546 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb2b3a8-0df6-4590-a94a-93931f12b96d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:30:30.347234 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb2b3a8-0df6-4590-a94a-93931f12b96d admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:30.347513 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb2b3a8-0df6-4590-a94a-93931f12b96d admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:30.347788 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb2b3a8-0df6-4590-a94a-93931f12b96d admin admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:30.351986 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb2b3a8-0df6-4590-a94a-93931f12b96d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:30:30.352339 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb2b3a8-0df6-4590-a94a-93931f12b96d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:30:30.357225 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb2b3a8-0df6-4590-a94a-93931f12b96d admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:30:30.387445 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80f396b-92ac-4b91-aa9e-285ef7e9ef4d service neutron] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:30:30.394921 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2603/5213] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:30:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:30:30.410989 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80f396b-92ac-4b91-aa9e-285ef7e9ef4d service neutron] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:30:30.419142 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d37f219-1504-4560-9514-42e107ade009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:30:30.426380 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d37f219-1504-4560-9514-42e107ade009 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:30.426850 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d37f219-1504-4560-9514-42e107ade009 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:30.428837 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d37f219-1504-4560-9514-42e107ade009 admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:30.430357 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d37f219-1504-4560-9514-42e107ade009 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:30:30.432676 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d37f219-1504-4560-9514-42e107ade009 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:30:30.550248 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb2b3a8-0df6-4590-a94a-93931f12b96d admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:30:30.570637 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2611/5214] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:30:30 2022] POST /identity/v3/projects => generated 361 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:30:30.579798 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb2b3a8-0df6-4590-a94a-93931f12b96d admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:30:30.710477 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf434fa-318f-45e7-8847-1cdca753bcf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:30:30.712942 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf434fa-318f-45e7-8847-1cdca753bcf6 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:30.713475 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf434fa-318f-45e7-8847-1cdca753bcf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:30.714633 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf434fa-318f-45e7-8847-1cdca753bcf6 admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:30.716959 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf434fa-318f-45e7-8847-1cdca753bcf6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:30:30.721844 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf434fa-318f-45e7-8847-1cdca753bcf6 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:30:30.776461 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d37f219-1504-4560-9514-42e107ade009 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:30:30.779350 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2604/5215] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:30:30 2022] POST /identity/v3/users => generated 281 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:30:30.791091 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d37f219-1504-4560-9514-42e107ade009 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:30:30.796740 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13d51d6-51b2-4a4d-9a8f-823489114807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:30:30.798102 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13d51d6-51b2-4a4d-9a8f-823489114807 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:30.798557 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13d51d6-51b2-4a4d-9a8f-823489114807 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:30.799165 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13d51d6-51b2-4a4d-9a8f-823489114807 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:30.800230 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13d51d6-51b2-4a4d-9a8f-823489114807 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:30:30.802324 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13d51d6-51b2-4a4d-9a8f-823489114807 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:30:30.820699 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2612/5216] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:30:30 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:30:30.825935 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf434fa-318f-45e7-8847-1cdca753bcf6 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:30:30.858929 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf434fa-318f-45e7-8847-1cdca753bcf6 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:30:30.875205 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfbaa58-1fee-4079-a969-6912c1550a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:30:30.875908 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfbaa58-1fee-4079-a969-6912c1550a4a admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:30.876517 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfbaa58-1fee-4079-a969-6912c1550a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:30.876517 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfbaa58-1fee-4079-a969-6912c1550a4a admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:30.877246 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfbaa58-1fee-4079-a969-6912c1550a4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:30:30.879913 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfbaa58-1fee-4079-a969-6912c1550a4a admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:30:30.897328 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13d51d6-51b2-4a4d-9a8f-823489114807 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:30:30.906047 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2605/5217] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:30:30 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 21:30:30.913379 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13d51d6-51b2-4a4d-9a8f-823489114807 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:30:30.919632 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e18ae77-8038-4958-8391-ef1ae1b7cd64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:30:30.921605 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e18ae77-8038-4958-8391-ef1ae1b7cd64 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:30.922356 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e18ae77-8038-4958-8391-ef1ae1b7cd64 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:30.923176 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e18ae77-8038-4958-8391-ef1ae1b7cd64 admin admin] PATH_INFO: `/v3/projects/e5f69bc7e16b468395579ec531b616a6/users/e75e9cbfb23a47f2bad4e546b8156f00/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:30.949970 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e18ae77-8038-4958-8391-ef1ae1b7cd64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5f69bc7e16b468395579ec531b616a6, user_id=e75e9cbfb23a47f2bad4e546b8156f00, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:30:30.953806 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e18ae77-8038-4958-8391-ef1ae1b7cd64 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:30:30.987537 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1b25e6-e7ef-4cfc-ae1c-215e60c8461d None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:30.987870 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1b25e6-e7ef-4cfc-ae1c-215e60c8461d None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:30.988088 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1b25e6-e7ef-4cfc-ae1c-215e60c8461d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:30.998368 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2613/5218] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:30:30 2022] PUT /identity/v3/projects/e5f69bc7e16b468395579ec531b616a6/users/e75e9cbfb23a47f2bad4e546b8156f00/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:30:31.049808 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-0e1b25e6-e7ef-4cfc-ae1c-215e60c8461d None None] MFA Rules not processed for user `e75e9cbfb23a47f2bad4e546b8156f00`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:30:31.051055 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-0e1b25e6-e7ef-4cfc-ae1c-215e60c8461d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:30:31.179885 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:30:31.199131 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2606/5219] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:30:30 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:30:31.249837 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e18ae77-8038-4958-8391-ef1ae1b7cd64 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:30:31.254133 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-3e18ae77-8038-4958-8391-ef1ae1b7cd64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:30:31.360151 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e18ae77-8038-4958-8391-ef1ae1b7cd64 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:30:31.364606 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8f78d5-cebb-47f5-adb8-6da4601598fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:30:31.365647 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8f78d5-cebb-47f5-adb8-6da4601598fc service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:31.365919 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8f78d5-cebb-47f5-adb8-6da4601598fc service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:31.366547 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8f78d5-cebb-47f5-adb8-6da4601598fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:31.378357 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8f78d5-cebb-47f5-adb8-6da4601598fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:30:31.380629 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8f78d5-cebb-47f5-adb8-6da4601598fc service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:30:31.395966 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2614/5220] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:30:31 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:30:31.751944 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1b25e6-e7ef-4cfc-ae1c-215e60c8461d None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:30:31.753004 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-0e1b25e6-e7ef-4cfc-ae1c-215e60c8461d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:30:31.890304 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1b25e6-e7ef-4cfc-ae1c-215e60c8461d None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:30:31.904144 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7be31d9-7f75-41a8-bb74-9e6aaedbd5d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:30:31.905929 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7be31d9-7f75-41a8-bb74-9e6aaedbd5d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:31.905929 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7be31d9-7f75-41a8-bb74-9e6aaedbd5d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:31.905929 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7be31d9-7f75-41a8-bb74-9e6aaedbd5d6 admin admin] PATH_INFO: `/v3/projects/de9da53f1e2a486aa8f7332a9f259fbc` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:31.907417 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7be31d9-7f75-41a8-bb74-9e6aaedbd5d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de9da53f1e2a486aa8f7332a9f259fbc)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:30:31.909656 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7be31d9-7f75-41a8-bb74-9e6aaedbd5d6 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:30:31.986203 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c7be31d9-7f75-41a8-bb74-9e6aaedbd5d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de9da53f1e2a486aa8f7332a9f259fbc', 'request_id': 'req-c7be31d9-7f75-41a8-bb74-9e6aaedbd5d6'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:30:32.002485 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c7be31d9-7f75-41a8-bb74-9e6aaedbd5d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de9da53f1e2a486aa8f7332a9f259fbc', 'request_id': 'req-c7be31d9-7f75-41a8-bb74-9e6aaedbd5d6'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:30:32.060095 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c7be31d9-7f75-41a8-bb74-9e6aaedbd5d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de9da53f1e2a486aa8f7332a9f259fbc', 'request_id': 'req-c7be31d9-7f75-41a8-bb74-9e6aaedbd5d6'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:30:32.085836 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c7be31d9-7f75-41a8-bb74-9e6aaedbd5d6 admin admin] The token cache is being invalidate because project de9da53f1e2a486aa8f7332a9f259fbc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:30:32.086262 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c7be31d9-7f75-41a8-bb74-9e6aaedbd5d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:30:32.086857 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c7be31d9-7f75-41a8-bb74-9e6aaedbd5d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:30:32.095640 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2607/5221] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:30:31 2022] DELETE /identity/v3/projects/de9da53f1e2a486aa8f7332a9f259fbc => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:30:32.105072 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed8cb3a-fb83-4295-9c2d-b86fec6e54f4 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:32.106825 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed8cb3a-fb83-4295-9c2d-b86fec6e54f4 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:32.107299 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed8cb3a-fb83-4295-9c2d-b86fec6e54f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:32.164694 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-1ed8cb3a-fb83-4295-9c2d-b86fec6e54f4 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:30:32.166293 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-1ed8cb3a-fb83-4295-9c2d-b86fec6e54f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:30:32.249055 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:30:32.283402 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2615/5222] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:30:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:30:32.286225 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d70b7b4-c650-4383-b20e-bd001e85a1f8 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:32.286225 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d70b7b4-c650-4383-b20e-bd001e85a1f8 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:32.286225 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d70b7b4-c650-4383-b20e-bd001e85a1f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:32.313949 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-1d70b7b4-c650-4383-b20e-bd001e85a1f8 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:30:32.315371 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-1d70b7b4-c650-4383-b20e-bd001e85a1f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:30:32.335868 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2608/5223] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:30:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:30:32.337132 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed8cb3a-fb83-4295-9c2d-b86fec6e54f4 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:30:32.360612 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed8cb3a-fb83-4295-9c2d-b86fec6e54f4 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:30:32.367649 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47bddd3-b3a3-4c75-b9ec-0edbeb550081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:30:32.368383 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47bddd3-b3a3-4c75-b9ec-0edbeb550081 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:32.368693 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47bddd3-b3a3-4c75-b9ec-0edbeb550081 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:32.368968 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47bddd3-b3a3-4c75-b9ec-0edbeb550081 admin admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:32.369770 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47bddd3-b3a3-4c75-b9ec-0edbeb550081 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:30:32.370171 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47bddd3-b3a3-4c75-b9ec-0edbeb550081 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:30:32.371818 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47bddd3-b3a3-4c75-b9ec-0edbeb550081 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:30:32.397630 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2616/5224] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:30:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:30:32.400192 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d70b7b4-c650-4383-b20e-bd001e85a1f8 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:30:32.424359 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d70b7b4-c650-4383-b20e-bd001e85a1f8 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:30:32.433946 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb4d8f8-a4f1-48c6-9e85-f590d5e20315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:30:32.435060 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb4d8f8-a4f1-48c6-9e85-f590d5e20315 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:32.435346 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb4d8f8-a4f1-48c6-9e85-f590d5e20315 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:32.435739 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb4d8f8-a4f1-48c6-9e85-f590d5e20315 admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:32.437062 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb4d8f8-a4f1-48c6-9e85-f590d5e20315 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:30:32.443026 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb4d8f8-a4f1-48c6-9e85-f590d5e20315 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:30:32.493221 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2609/5225] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:30:32 2022] POST /identity/v3/projects => generated 369 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:30:32.499885 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47bddd3-b3a3-4c75-b9ec-0edbeb550081 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:30:32.533499 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47bddd3-b3a3-4c75-b9ec-0edbeb550081 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:30:32.686227 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a906c8ae-dbd1-4f22-a825-d1c28f2c4efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:30:32.687490 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a906c8ae-dbd1-4f22-a825-d1c28f2c4efc admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:32.687896 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a906c8ae-dbd1-4f22-a825-d1c28f2c4efc admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:32.688367 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a906c8ae-dbd1-4f22-a825-d1c28f2c4efc admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:32.689279 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a906c8ae-dbd1-4f22-a825-d1c28f2c4efc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:30:32.693639 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a906c8ae-dbd1-4f22-a825-d1c28f2c4efc admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:30:32.744381 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb4d8f8-a4f1-48c6-9e85-f590d5e20315 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:30:32.752940 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2617/5226] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:30:32 2022] POST /identity/v3/users => generated 285 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:30:32.761639 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb4d8f8-a4f1-48c6-9e85-f590d5e20315 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:30:32.774941 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4d3e39-20fe-4ed4-af5e-f3cc0fb40eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:30:32.775692 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4d3e39-20fe-4ed4-af5e-f3cc0fb40eef admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:32.775969 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4d3e39-20fe-4ed4-af5e-f3cc0fb40eef admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:32.776239 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4d3e39-20fe-4ed4-af5e-f3cc0fb40eef admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:32.777964 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4d3e39-20fe-4ed4-af5e-f3cc0fb40eef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:30:32.784443 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4d3e39-20fe-4ed4-af5e-f3cc0fb40eef admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:30:32.821628 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2610/5227] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:30:32 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:30:32.824550 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a906c8ae-dbd1-4f22-a825-d1c28f2c4efc admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:30:32.848800 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a906c8ae-dbd1-4f22-a825-d1c28f2c4efc admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:30:32.867532 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfccd00-8a8e-4bf1-bd18-dbe1949cbf46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:30:32.869762 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfccd00-8a8e-4bf1-bd18-dbe1949cbf46 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:32.870253 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfccd00-8a8e-4bf1-bd18-dbe1949cbf46 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:32.870591 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfccd00-8a8e-4bf1-bd18-dbe1949cbf46 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:32.871407 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfccd00-8a8e-4bf1-bd18-dbe1949cbf46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:30:32.878681 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfccd00-8a8e-4bf1-bd18-dbe1949cbf46 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:30:32.896228 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2618/5228] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:30:32 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:30:32.900323 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4d3e39-20fe-4ed4-af5e-f3cc0fb40eef admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:30:32.916905 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4d3e39-20fe-4ed4-af5e-f3cc0fb40eef admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:30:32.930616 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1c1338-ad2a-4ebc-abc7-44c821a32c73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:30:32.932073 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1c1338-ad2a-4ebc-abc7-44c821a32c73 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:32.932687 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1c1338-ad2a-4ebc-abc7-44c821a32c73 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:32.933165 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1c1338-ad2a-4ebc-abc7-44c821a32c73 admin admin] PATH_INFO: `/v3/projects/b5f95eb2028749208a60ffcbc8081e8e/users/2cafc576a9884009bf5f07601d8e63b9/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:32.999937 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1c1338-ad2a-4ebc-abc7-44c821a32c73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5f95eb2028749208a60ffcbc8081e8e, user_id=2cafc576a9884009bf5f07601d8e63b9, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:30:33.002945 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1c1338-ad2a-4ebc-abc7-44c821a32c73 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:30:33.041249 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2611/5229] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:30:32 2022] PUT /identity/v3/projects/b5f95eb2028749208a60ffcbc8081e8e/users/2cafc576a9884009bf5f07601d8e63b9/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:30:33.054569 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f238524b-09c1-4055-a1ed-1e4e27956dba None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:33.054960 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f238524b-09c1-4055-a1ed-1e4e27956dba None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:33.055152 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f238524b-09c1-4055-a1ed-1e4e27956dba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:33.105716 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-f238524b-09c1-4055-a1ed-1e4e27956dba None None] MFA Rules not processed for user `2cafc576a9884009bf5f07601d8e63b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:30:33.107408 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-f238524b-09c1-4055-a1ed-1e4e27956dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:30:33.300832 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2619/5230] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:30:33 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:30:33.312588 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1c1338-ad2a-4ebc-abc7-44c821a32c73 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:30:33.315704 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-ab1c1338-ad2a-4ebc-abc7-44c821a32c73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:30:33.369618 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:30:33.444354 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1c1338-ad2a-4ebc-abc7-44c821a32c73 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:30:33.458743 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82da7ae3-0c0e-4c9b-8745-201483793436 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7f2db148c8e4d5d81431cae3576434b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:30:33.459600 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82da7ae3-0c0e-4c9b-8745-201483793436 service glance] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:33.459977 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82da7ae3-0c0e-4c9b-8745-201483793436 service glance] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:33.460357 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82da7ae3-0c0e-4c9b-8745-201483793436 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:33.476796 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82da7ae3-0c0e-4c9b-8745-201483793436 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:30:33.481049 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82da7ae3-0c0e-4c9b-8745-201483793436 service glance] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:30:33.497638 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2612/5231] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:30:33 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:30:33.992629 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089c0a82-3729-4f2b-a467-70900b115b91 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:33.992917 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089c0a82-3729-4f2b-a467-70900b115b91 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:33.993194 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089c0a82-3729-4f2b-a467-70900b115b91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:34.083463 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-089c0a82-3729-4f2b-a467-70900b115b91 None None] MFA Rules not processed for user `37b1e260651b4dffa7c1efe8e9d0f144`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:30:34.089329 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-089c0a82-3729-4f2b-a467-70900b115b91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:30:34.212464 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:30:34.356325 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2620/5232] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:30:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 365 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:30:34.971709 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c22ad5-5551-4696-8251-df2bd78d57c6 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:34.972239 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c22ad5-5551-4696-8251-df2bd78d57c6 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:34.972239 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c22ad5-5551-4696-8251-df2bd78d57c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:35.002213 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-f1c22ad5-5551-4696-8251-df2bd78d57c6 None None] MFA Rules not processed for user `6ca9644a73d9468aa39b21548a72bded`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:30:35.008970 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-f1c22ad5-5551-4696-8251-df2bd78d57c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:30:35.168441 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2613/5233] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:30:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:30:35.289921 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089c0a82-3729-4f2b-a467-70900b115b91 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:30:35.293284 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-089c0a82-3729-4f2b-a467-70900b115b91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:30:35.551079 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089c0a82-3729-4f2b-a467-70900b115b91 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:30:35.569428 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3385f08-d32e-47f0-be69-c7b7b7c32df6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:30:35.570958 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3385f08-d32e-47f0-be69-c7b7b7c32df6 service nova] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:35.571255 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3385f08-d32e-47f0-be69-c7b7b7c32df6 service nova] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:35.571525 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3385f08-d32e-47f0-be69-c7b7b7c32df6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:35.594069 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3385f08-d32e-47f0-be69-c7b7b7c32df6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:30:35.596308 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3385f08-d32e-47f0-be69-c7b7b7c32df6 service nova] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:30:35.620149 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2621/5234] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:30:35 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:30:38.741420 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c22ad5-5551-4696-8251-df2bd78d57c6 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:30:38.909208 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c22ad5-5551-4696-8251-df2bd78d57c6 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:30:38.916273 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b5cdab-6ef8-4eca-85d6-0db12cc2463d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:30:38.941014 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b5cdab-6ef8-4eca-85d6-0db12cc2463d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:38.941473 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b5cdab-6ef8-4eca-85d6-0db12cc2463d admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:38.941904 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b5cdab-6ef8-4eca-85d6-0db12cc2463d admin admin] PATH_INFO: `/v3/users/2cafc576a9884009bf5f07601d8e63b9` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:38.946098 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b5cdab-6ef8-4eca-85d6-0db12cc2463d admin admin] RBAC: Authorizing `identity:delete_user(user_id=2cafc576a9884009bf5f07601d8e63b9)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:30:38.952631 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b5cdab-6ef8-4eca-85d6-0db12cc2463d admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:30:39.111863 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-48b5cdab-6ef8-4eca-85d6-0db12cc2463d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2cafc576a9884009bf5f07601d8e63b9'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:30:39.113998 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-48b5cdab-6ef8-4eca-85d6-0db12cc2463d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2cafc576a9884009bf5f07601d8e63b9'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:30:39.135871 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-48b5cdab-6ef8-4eca-85d6-0db12cc2463d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2cafc576a9884009bf5f07601d8e63b9'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:30:39.154400 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-48b5cdab-6ef8-4eca-85d6-0db12cc2463d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2cafc576a9884009bf5f07601d8e63b9'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:30:39.174072 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:30:39.197006 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-48b5cdab-6ef8-4eca-85d6-0db12cc2463d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2cafc576a9884009bf5f07601d8e63b9'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:30:39.220966 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2614/5235] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:30:38 2022] DELETE /identity/v3/users/2cafc576a9884009bf5f07601d8e63b9 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:30:39.225565 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d884a44-ac4f-4d1c-adf3-10eef528330f None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:39.226443 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d884a44-ac4f-4d1c-adf3-10eef528330f None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:39.227492 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d884a44-ac4f-4d1c-adf3-10eef528330f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:39.272464 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-4d884a44-ac4f-4d1c-adf3-10eef528330f None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:30:39.274752 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-4d884a44-ac4f-4d1c-adf3-10eef528330f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:30:39.467403 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2622/5236] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:30:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:30:39.552100 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b5cdab-6ef8-4eca-85d6-0db12cc2463d admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:30:39.554123 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-48b5cdab-6ef8-4eca-85d6-0db12cc2463d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:30:39.786185 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b5cdab-6ef8-4eca-85d6-0db12cc2463d admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:30:39.798601 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ee87a1-9429-4824-8bf8-3f53550e8054 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:30:39.799587 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ee87a1-9429-4824-8bf8-3f53550e8054 service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:39.800083 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ee87a1-9429-4824-8bf8-3f53550e8054 service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:39.800939 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ee87a1-9429-4824-8bf8-3f53550e8054 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:39.838604 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ee87a1-9429-4824-8bf8-3f53550e8054 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:30:39.847673 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ee87a1-9429-4824-8bf8-3f53550e8054 service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:30:39.880223 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2615/5237] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:30:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:30:41.897415 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112e9fbf-13d6-49e8-b783-79bb0485f274 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:41.898438 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112e9fbf-13d6-49e8-b783-79bb0485f274 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:41.898921 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112e9fbf-13d6-49e8-b783-79bb0485f274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:41.934195 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-112e9fbf-13d6-49e8-b783-79bb0485f274 None None] MFA Rules not processed for user `5efda1c40f494592bf1e6af1add120f3`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:30:41.935825 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-112e9fbf-13d6-49e8-b783-79bb0485f274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:30:42.128211 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2623/5238] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:30:41 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:30:42.481485 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ee87a1-9429-4824-8bf8-3f53550e8054 service neutron] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:30:42.484251 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-43ee87a1-9429-4824-8bf8-3f53550e8054 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:30:42.509538 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ee87a1-9429-4824-8bf8-3f53550e8054 service neutron] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:30:42.534843 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e69c918-87db-4536-a44c-ca094655cb18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:30:42.535769 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e69c918-87db-4536-a44c-ca094655cb18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:42.536047 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e69c918-87db-4536-a44c-ca094655cb18 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:42.536318 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e69c918-87db-4536-a44c-ca094655cb18 admin admin] PATH_INFO: `/v3/projects/b5f95eb2028749208a60ffcbc8081e8e` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:42.543494 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e69c918-87db-4536-a44c-ca094655cb18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5f95eb2028749208a60ffcbc8081e8e)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:30:42.552934 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e69c918-87db-4536-a44c-ca094655cb18 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:30:42.723106 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-1e69c918-87db-4536-a44c-ca094655cb18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5f95eb2028749208a60ffcbc8081e8e', 'request_id': 'req-1e69c918-87db-4536-a44c-ca094655cb18'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:30:42.750006 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-1e69c918-87db-4536-a44c-ca094655cb18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5f95eb2028749208a60ffcbc8081e8e', 'request_id': 'req-1e69c918-87db-4536-a44c-ca094655cb18'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:30:42.774762 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-1e69c918-87db-4536-a44c-ca094655cb18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5f95eb2028749208a60ffcbc8081e8e', 'request_id': 'req-1e69c918-87db-4536-a44c-ca094655cb18'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:30:42.805094 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-1e69c918-87db-4536-a44c-ca094655cb18 admin admin] The token cache is being invalidate because project b5f95eb2028749208a60ffcbc8081e8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:30:42.805094 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-1e69c918-87db-4536-a44c-ca094655cb18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:30:42.805799 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-1e69c918-87db-4536-a44c-ca094655cb18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:30:42.816187 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2616/5239] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:30:42 2022] DELETE /identity/v3/projects/b5f95eb2028749208a60ffcbc8081e8e => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:30:42.817551 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de05460-005d-4a6b-b8fd-2feb94b65a31 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:42.818086 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de05460-005d-4a6b-b8fd-2feb94b65a31 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:42.818986 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de05460-005d-4a6b-b8fd-2feb94b65a31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:42.831685 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:30:42.865899 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-4de05460-005d-4a6b-b8fd-2feb94b65a31 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:30:42.874373 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-4de05460-005d-4a6b-b8fd-2feb94b65a31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:30:42.999002 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2624/5240] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:30:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:30:43.007725 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b9054f-e7cb-40cc-86b5-c434d5f941f3 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:43.008337 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b9054f-e7cb-40cc-86b5-c434d5f941f3 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:43.008813 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b9054f-e7cb-40cc-86b5-c434d5f941f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:43.043578 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-d0b9054f-e7cb-40cc-86b5-c434d5f941f3 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:30:43.046668 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-d0b9054f-e7cb-40cc-86b5-c434d5f941f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:30:43.060935 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2617/5241] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:30:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:30:43.066060 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de05460-005d-4a6b-b8fd-2feb94b65a31 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:30:43.078931 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de05460-005d-4a6b-b8fd-2feb94b65a31 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:30:43.093982 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a39fc91-0e45-46b9-8b81-94f0aa528287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:30:43.094986 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a39fc91-0e45-46b9-8b81-94f0aa528287 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:43.095428 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a39fc91-0e45-46b9-8b81-94f0aa528287 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:43.095712 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a39fc91-0e45-46b9-8b81-94f0aa528287 admin admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:43.096475 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a39fc91-0e45-46b9-8b81-94f0aa528287 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:30:43.096784 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a39fc91-0e45-46b9-8b81-94f0aa528287 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:30:43.099164 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a39fc91-0e45-46b9-8b81-94f0aa528287 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:30:43.134615 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2625/5242] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:30:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 21:30:43.139109 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b9054f-e7cb-40cc-86b5-c434d5f941f3 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:30:43.156927 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b9054f-e7cb-40cc-86b5-c434d5f941f3 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:30:43.168040 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3de5bb8-0a7e-4ffe-a48d-b38ec36b56fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:30:43.168753 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3de5bb8-0a7e-4ffe-a48d-b38ec36b56fe admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:43.169036 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3de5bb8-0a7e-4ffe-a48d-b38ec36b56fe admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:43.169311 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3de5bb8-0a7e-4ffe-a48d-b38ec36b56fe admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:43.170122 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3de5bb8-0a7e-4ffe-a48d-b38ec36b56fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:30:43.176194 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3de5bb8-0a7e-4ffe-a48d-b38ec36b56fe admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:30:43.250976 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2618/5243] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:30:43 2022] POST /identity/v3/projects => generated 381 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:30:43.255118 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a39fc91-0e45-46b9-8b81-94f0aa528287 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:30:43.273395 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a39fc91-0e45-46b9-8b81-94f0aa528287 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:30:43.400791 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf082f0-00f2-4795-b616-a92f8ba2df40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:30:43.401500 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf082f0-00f2-4795-b616-a92f8ba2df40 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:43.401780 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf082f0-00f2-4795-b616-a92f8ba2df40 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:43.402280 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf082f0-00f2-4795-b616-a92f8ba2df40 admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:43.402993 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf082f0-00f2-4795-b616-a92f8ba2df40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:30:43.405053 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf082f0-00f2-4795-b616-a92f8ba2df40 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:30:43.460430 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2626/5244] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:30:43 2022] POST /identity/v3/users => generated 291 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:30:43.466040 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3de5bb8-0a7e-4ffe-a48d-b38ec36b56fe admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:30:43.489748 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3de5bb8-0a7e-4ffe-a48d-b38ec36b56fe admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:30:43.503897 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a27f8cb-a06c-4b9e-b3d4-379f546806d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:30:43.504840 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a27f8cb-a06c-4b9e-b3d4-379f546806d5 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:43.505299 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a27f8cb-a06c-4b9e-b3d4-379f546806d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:43.505957 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a27f8cb-a06c-4b9e-b3d4-379f546806d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:43.508014 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a27f8cb-a06c-4b9e-b3d4-379f546806d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:30:43.510821 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a27f8cb-a06c-4b9e-b3d4-379f546806d5 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:30:43.579274 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2619/5245] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:30:43 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:30:43.583466 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf082f0-00f2-4795-b616-a92f8ba2df40 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:30:43.613621 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf082f0-00f2-4795-b616-a92f8ba2df40 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:30:43.626153 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6058c76e-c144-4762-afd3-7451c79561e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:30:43.626882 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6058c76e-c144-4762-afd3-7451c79561e9 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:43.627168 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6058c76e-c144-4762-afd3-7451c79561e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:43.627448 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6058c76e-c144-4762-afd3-7451c79561e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:43.628201 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6058c76e-c144-4762-afd3-7451c79561e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:30:43.629888 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6058c76e-c144-4762-afd3-7451c79561e9 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:30:43.635739 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a27f8cb-a06c-4b9e-b3d4-379f546806d5 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:30:43.637658 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-0a27f8cb-a06c-4b9e-b3d4-379f546806d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:30:43.704825 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2627/5246] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:30:43 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:30:43.716191 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54d7cd5-e904-4342-8aac-56b7f7b22198 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:43.716595 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54d7cd5-e904-4342-8aac-56b7f7b22198 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:43.716891 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54d7cd5-e904-4342-8aac-56b7f7b22198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:43.833440 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=90,keystone:DELETE=8,keystone:INSERT=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:30:43.847747 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-d54d7cd5-e904-4342-8aac-56b7f7b22198 None None] MFA Rules not processed for user `fc0782a98aca44f18bf86a9f6ad5eb60`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:30:43.850108 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-d54d7cd5-e904-4342-8aac-56b7f7b22198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:30:43.918395 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a27f8cb-a06c-4b9e-b3d4-379f546806d5 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:30:43.930120 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ded25ee-34ed-4781-8e7e-8b97d23ae942 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:30:43.930810 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ded25ee-34ed-4781-8e7e-8b97d23ae942 service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:43.931083 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ded25ee-34ed-4781-8e7e-8b97d23ae942 service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:43.931457 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ded25ee-34ed-4781-8e7e-8b97d23ae942 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:43.935275 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-6ded25ee-34ed-4781-8e7e-8b97d23ae942 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:30:43.961106 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ded25ee-34ed-4781-8e7e-8b97d23ae942 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:30:43.965403 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ded25ee-34ed-4781-8e7e-8b97d23ae942 service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:30:43.989760 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2620/5247] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:30:43 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 23 21:30:43.992021 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ded25ee-34ed-4781-8e7e-8b97d23ae942 service neutron] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:30:44.036232 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ded25ee-34ed-4781-8e7e-8b97d23ae942 service neutron] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:30:44.051206 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10a7087-2df2-40da-a258-f2f1bac5c6b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:30:44.053895 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10a7087-2df2-40da-a258-f2f1bac5c6b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:44.053895 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10a7087-2df2-40da-a258-f2f1bac5c6b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:44.053895 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10a7087-2df2-40da-a258-f2f1bac5c6b3 admin admin] PATH_INFO: `/v3/projects/29441a0b75424fab9eca20d7a4f2917b/users/7c16e4f017614596bb4126d1e878d67e/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:44.059006 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:30:44.070742 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2628/5248] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:30:43 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 365 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:30:44.075396 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54d7cd5-e904-4342-8aac-56b7f7b22198 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:30:44.077102 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-d54d7cd5-e904-4342-8aac-56b7f7b22198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:30:44.115975 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10a7087-2df2-40da-a258-f2f1bac5c6b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29441a0b75424fab9eca20d7a4f2917b, user_id=7c16e4f017614596bb4126d1e878d67e, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:30:44.116792 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54d7cd5-e904-4342-8aac-56b7f7b22198 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:30:44.122239 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10a7087-2df2-40da-a258-f2f1bac5c6b3 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:30:44.136543 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2961a1a-de60-4d87-9a2d-e9f17f6ee5ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:30:44.137275 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2961a1a-de60-4d87-9a2d-e9f17f6ee5ca admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:44.137552 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2961a1a-de60-4d87-9a2d-e9f17f6ee5ca admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:44.137821 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2961a1a-de60-4d87-9a2d-e9f17f6ee5ca admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:44.139415 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2961a1a-de60-4d87-9a2d-e9f17f6ee5ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:30:44.141395 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2961a1a-de60-4d87-9a2d-e9f17f6ee5ca admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:30:44.185542 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2621/5249] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:30:43 2022] PUT /identity/v3/projects/29441a0b75424fab9eca20d7a4f2917b/users/7c16e4f017614596bb4126d1e878d67e/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:30:44.189436 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9324528d-a53b-4374-94a5-d195675c4775 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:44.189727 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9324528d-a53b-4374-94a5-d195675c4775 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:44.190033 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9324528d-a53b-4374-94a5-d195675c4775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:44.255081 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2629/5250] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:30:44 2022] POST /identity/v3/projects => generated 405 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:30:44.258682 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2961a1a-de60-4d87-9a2d-e9f17f6ee5ca admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:30:44.284484 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-9324528d-a53b-4374-94a5-d195675c4775 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:30:44.286811 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-9324528d-a53b-4374-94a5-d195675c4775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:30:44.451455 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2961a1a-de60-4d87-9a2d-e9f17f6ee5ca admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:30:44.464354 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc12107e-f0a0-4f71-93a1-e5d62cfeb1ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:30:44.465054 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc12107e-f0a0-4f71-93a1-e5d62cfeb1ec admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:44.465405 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc12107e-f0a0-4f71-93a1-e5d62cfeb1ec admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:44.465677 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc12107e-f0a0-4f71-93a1-e5d62cfeb1ec admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:44.466617 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc12107e-f0a0-4f71-93a1-e5d62cfeb1ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:30:44.469298 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc12107e-f0a0-4f71-93a1-e5d62cfeb1ec admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:30:44.517667 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2630/5251] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:30:44 2022] POST /identity/v3/users => generated 303 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:30:44.520221 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc12107e-f0a0-4f71-93a1-e5d62cfeb1ec admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:30:44.526447 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2622/5252] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:30:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:30:44.549288 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc12107e-f0a0-4f71-93a1-e5d62cfeb1ec admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:30:44.562755 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bbe684-0db1-4735-8590-cb71de21a437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:30:44.564595 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bbe684-0db1-4735-8590-cb71de21a437 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:44.564944 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bbe684-0db1-4735-8590-cb71de21a437 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:44.565220 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bbe684-0db1-4735-8590-cb71de21a437 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:44.567760 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bbe684-0db1-4735-8590-cb71de21a437 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:30:44.571792 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bbe684-0db1-4735-8590-cb71de21a437 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:30:44.576798 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9324528d-a53b-4374-94a5-d195675c4775 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:30:44.600889 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2631/5253] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:30:44 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:30:44.603111 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bbe684-0db1-4735-8590-cb71de21a437 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:30:44.631919 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bbe684-0db1-4735-8590-cb71de21a437 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:30:44.644463 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f8a1b1-5ec3-4171-b7a4-be444d6fa0b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:30:44.644987 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f8a1b1-5ec3-4171-b7a4-be444d6fa0b4 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:44.645266 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f8a1b1-5ec3-4171-b7a4-be444d6fa0b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:44.645588 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f8a1b1-5ec3-4171-b7a4-be444d6fa0b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:44.646546 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f8a1b1-5ec3-4171-b7a4-be444d6fa0b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:30:44.648256 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f8a1b1-5ec3-4171-b7a4-be444d6fa0b4 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:30:44.675622 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2632/5254] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:30:44 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:30:44.679207 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f8a1b1-5ec3-4171-b7a4-be444d6fa0b4 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:30:44.703842 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f8a1b1-5ec3-4171-b7a4-be444d6fa0b4 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:30:44.720168 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390e0957-f06c-4a41-92eb-b659ed7d1e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:30:44.721096 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390e0957-f06c-4a41-92eb-b659ed7d1e63 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:44.721373 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390e0957-f06c-4a41-92eb-b659ed7d1e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:44.722099 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390e0957-f06c-4a41-92eb-b659ed7d1e63 admin admin] PATH_INFO: `/v3/projects/866e33e7818341c2b4105db2241ef067/users/8e191bb795f848bf939124faae84add1/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:44.762767 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390e0957-f06c-4a41-92eb-b659ed7d1e63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=866e33e7818341c2b4105db2241ef067, user_id=8e191bb795f848bf939124faae84add1, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:30:44.774141 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390e0957-f06c-4a41-92eb-b659ed7d1e63 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:30:44.788870 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9324528d-a53b-4374-94a5-d195675c4775 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:30:44.797636 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d46006-2414-4ea7-afc3-e391c278c504 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:30:44.800480 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d46006-2414-4ea7-afc3-e391c278c504 service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:44.800790 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d46006-2414-4ea7-afc3-e391c278c504 service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:44.801123 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d46006-2414-4ea7-afc3-e391c278c504 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:44.807292 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2633/5255] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:30:44 2022] PUT /identity/v3/projects/866e33e7818341c2b4105db2241ef067/users/8e191bb795f848bf939124faae84add1/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:30:44.844839 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d46006-2414-4ea7-afc3-e391c278c504 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:30:44.846732 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d46006-2414-4ea7-afc3-e391c278c504 service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:30:44.874382 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2623/5256] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:30:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:30:45.587350 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa940876-061a-4043-84e2-68f7e0b92560 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:45.587851 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa940876-061a-4043-84e2-68f7e0b92560 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:45.588186 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa940876-061a-4043-84e2-68f7e0b92560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:45.650019 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-aa940876-061a-4043-84e2-68f7e0b92560 None None] MFA Rules not processed for user `37b1e260651b4dffa7c1efe8e9d0f144`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:30:45.656225 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-aa940876-061a-4043-84e2-68f7e0b92560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:30:45.823310 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2634/5257] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:30:45 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:30:49.110964 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419a5a44-0bf1-4f59-8ab6-49719fc0e090 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:49.111875 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419a5a44-0bf1-4f59-8ab6-49719fc0e090 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:49.112332 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419a5a44-0bf1-4f59-8ab6-49719fc0e090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:49.177247 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-419a5a44-0bf1-4f59-8ab6-49719fc0e090 None None] MFA Rules not processed for user `7c16e4f017614596bb4126d1e878d67e`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:30:49.178927 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-419a5a44-0bf1-4f59-8ab6-49719fc0e090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:30:49.311521 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:30:49.350563 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2624/5258] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:30:49 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:30:49.358583 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa940876-061a-4043-84e2-68f7e0b92560 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:30:49.360833 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-aa940876-061a-4043-84e2-68f7e0b92560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:30:49.456865 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:30:49.587348 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa940876-061a-4043-84e2-68f7e0b92560 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:30:49.599661 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d77ae3-b8a4-40ea-92d4-bb029f5259a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec5fd3a489c341b7964704d689037f05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:30:49.601190 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d77ae3-b8a4-40ea-92d4-bb029f5259a9 service cinder] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:49.601733 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d77ae3-b8a4-40ea-92d4-bb029f5259a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:49.602118 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d77ae3-b8a4-40ea-92d4-bb029f5259a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:49.621482 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d77ae3-b8a4-40ea-92d4-bb029f5259a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:30:49.625839 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d77ae3-b8a4-40ea-92d4-bb029f5259a9 service cinder] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:30:49.645014 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2635/5259] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:30:49 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:30:55.217959 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419a5a44-0bf1-4f59-8ab6-49719fc0e090 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:30:55.373387 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419a5a44-0bf1-4f59-8ab6-49719fc0e090 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:30:55.380772 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d7f8b5-4949-4faf-afd1-19e7cf3bdfe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:30:55.383070 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d7f8b5-4949-4faf-afd1-19e7cf3bdfe9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:55.383511 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d7f8b5-4949-4faf-afd1-19e7cf3bdfe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:55.383926 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d7f8b5-4949-4faf-afd1-19e7cf3bdfe9 admin admin] PATH_INFO: `/v3/users/7c16e4f017614596bb4126d1e878d67e` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:55.389802 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d7f8b5-4949-4faf-afd1-19e7cf3bdfe9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c16e4f017614596bb4126d1e878d67e)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:30:55.396703 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d7f8b5-4949-4faf-afd1-19e7cf3bdfe9 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:30:55.523184 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-42d7f8b5-4949-4faf-afd1-19e7cf3bdfe9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c16e4f017614596bb4126d1e878d67e'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:30:55.523819 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-42d7f8b5-4949-4faf-afd1-19e7cf3bdfe9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c16e4f017614596bb4126d1e878d67e'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:30:55.541187 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-42d7f8b5-4949-4faf-afd1-19e7cf3bdfe9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c16e4f017614596bb4126d1e878d67e'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:30:55.554357 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-42d7f8b5-4949-4faf-afd1-19e7cf3bdfe9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c16e4f017614596bb4126d1e878d67e'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:30:55.571987 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-42d7f8b5-4949-4faf-afd1-19e7cf3bdfe9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c16e4f017614596bb4126d1e878d67e'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:30:55.602970 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2625/5260] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:30:55 2022] DELETE /identity/v3/users/7c16e4f017614596bb4126d1e878d67e => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:30:56.761669 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d77ae3-b8a4-40ea-92d4-bb029f5259a9 service cinder] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:30:56.782280 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d77ae3-b8a4-40ea-92d4-bb029f5259a9 service cinder] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:30:56.961463 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f0a842-8be3-427b-9874-45d840720f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:30:56.962697 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f0a842-8be3-427b-9874-45d840720f29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:56.962976 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f0a842-8be3-427b-9874-45d840720f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:56.963250 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f0a842-8be3-427b-9874-45d840720f29 admin admin] PATH_INFO: `/v3/projects/29441a0b75424fab9eca20d7a4f2917b` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:56.966755 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f0a842-8be3-427b-9874-45d840720f29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=29441a0b75424fab9eca20d7a4f2917b)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:30:56.971733 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f0a842-8be3-427b-9874-45d840720f29 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:30:57.078545 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-84f0a842-8be3-427b-9874-45d840720f29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29441a0b75424fab9eca20d7a4f2917b', 'request_id': 'req-84f0a842-8be3-427b-9874-45d840720f29'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:30:57.110642 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-84f0a842-8be3-427b-9874-45d840720f29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29441a0b75424fab9eca20d7a4f2917b', 'request_id': 'req-84f0a842-8be3-427b-9874-45d840720f29'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:30:57.120260 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-84f0a842-8be3-427b-9874-45d840720f29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29441a0b75424fab9eca20d7a4f2917b', 'request_id': 'req-84f0a842-8be3-427b-9874-45d840720f29'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:30:57.152524 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-84f0a842-8be3-427b-9874-45d840720f29 admin admin] The token cache is being invalidate because project 29441a0b75424fab9eca20d7a4f2917b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:30:57.152942 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-84f0a842-8be3-427b-9874-45d840720f29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:30:57.157174 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-84f0a842-8be3-427b-9874-45d840720f29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:30:57.159384 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2636/5261] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:30:56 2022] DELETE /identity/v3/projects/29441a0b75424fab9eca20d7a4f2917b => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:30:57.171919 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af3a17b-0dea-4fba-8bdb-742ce34699ec None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:57.172526 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af3a17b-0dea-4fba-8bdb-742ce34699ec None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:57.172526 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af3a17b-0dea-4fba-8bdb-742ce34699ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:57.226935 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-8af3a17b-0dea-4fba-8bdb-742ce34699ec None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:30:57.228182 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-8af3a17b-0dea-4fba-8bdb-742ce34699ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:30:57.427386 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2626/5262] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:30:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:30:57.436459 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29292ffe-b432-4d6a-af3f-1ca9b46e21cb None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:57.436736 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29292ffe-b432-4d6a-af3f-1ca9b46e21cb None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:57.437017 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29292ffe-b432-4d6a-af3f-1ca9b46e21cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:57.460092 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-29292ffe-b432-4d6a-af3f-1ca9b46e21cb None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:30:57.461571 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-29292ffe-b432-4d6a-af3f-1ca9b46e21cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:30:57.477518 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2637/5263] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:30:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:30:57.478841 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af3a17b-0dea-4fba-8bdb-742ce34699ec None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:30:57.497146 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af3a17b-0dea-4fba-8bdb-742ce34699ec None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:30:57.514229 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d2fdab-def4-4ce6-a73c-9866d39bc0d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:30:57.514939 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d2fdab-def4-4ce6-a73c-9866d39bc0d4 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:57.515219 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d2fdab-def4-4ce6-a73c-9866d39bc0d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:57.515509 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d2fdab-def4-4ce6-a73c-9866d39bc0d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:57.516264 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d2fdab-def4-4ce6-a73c-9866d39bc0d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:30:57.516571 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d2fdab-def4-4ce6-a73c-9866d39bc0d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:30:57.518260 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d2fdab-def4-4ce6-a73c-9866d39bc0d4 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:30:57.524091 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:30:57.545796 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2627/5264] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:30:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:30:57.550866 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29292ffe-b432-4d6a-af3f-1ca9b46e21cb None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:30:57.564049 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29292ffe-b432-4d6a-af3f-1ca9b46e21cb None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:30:57.575620 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da015f7-6f10-4105-b478-74d3ccb75cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:30:57.576634 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da015f7-6f10-4105-b478-74d3ccb75cec admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:57.577076 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da015f7-6f10-4105-b478-74d3ccb75cec admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:57.577461 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da015f7-6f10-4105-b478-74d3ccb75cec admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:57.578404 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da015f7-6f10-4105-b478-74d3ccb75cec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:30:57.583597 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da015f7-6f10-4105-b478-74d3ccb75cec admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:30:57.642235 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2638/5265] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:30:57 2022] POST /identity/v3/projects => generated 387 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:30:57.643577 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d2fdab-def4-4ce6-a73c-9866d39bc0d4 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:30:57.668602 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d2fdab-def4-4ce6-a73c-9866d39bc0d4 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:30:57.765138 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c38ae4-36b3-46c8-9536-be0a8c1c6547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:30:57.766071 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c38ae4-36b3-46c8-9536-be0a8c1c6547 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:57.766522 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c38ae4-36b3-46c8-9536-be0a8c1c6547 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:57.766900 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c38ae4-36b3-46c8-9536-be0a8c1c6547 admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:57.767712 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c38ae4-36b3-46c8-9536-be0a8c1c6547 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:30:57.770548 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c38ae4-36b3-46c8-9536-be0a8c1c6547 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:30:57.807933 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da015f7-6f10-4105-b478-74d3ccb75cec admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:30:57.808515 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2628/5266] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:30:57 2022] POST /identity/v3/users => generated 294 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:30:57.832795 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da015f7-6f10-4105-b478-74d3ccb75cec admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:30:57.838026 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d5f03e-0d9c-4464-a6d5-fec8fcecb61d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:30:57.838922 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d5f03e-0d9c-4464-a6d5-fec8fcecb61d admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:57.839347 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d5f03e-0d9c-4464-a6d5-fec8fcecb61d admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:57.839764 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d5f03e-0d9c-4464-a6d5-fec8fcecb61d admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:57.840649 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d5f03e-0d9c-4464-a6d5-fec8fcecb61d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:30:57.842502 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d5f03e-0d9c-4464-a6d5-fec8fcecb61d admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:30:57.854847 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2639/5267] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:30:57 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:30:57.859368 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c38ae4-36b3-46c8-9536-be0a8c1c6547 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:30:57.876377 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c38ae4-36b3-46c8-9536-be0a8c1c6547 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:30:57.884828 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9a153d-e989-4a25-b4ed-eaead02099fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:30:57.885946 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9a153d-e989-4a25-b4ed-eaead02099fb admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:57.886449 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9a153d-e989-4a25-b4ed-eaead02099fb admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:57.886839 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9a153d-e989-4a25-b4ed-eaead02099fb admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:57.887825 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9a153d-e989-4a25-b4ed-eaead02099fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:30:57.889802 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9a153d-e989-4a25-b4ed-eaead02099fb admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:30:57.906160 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2629/5268] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:30:57 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:30:57.906450 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d5f03e-0d9c-4464-a6d5-fec8fcecb61d admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:30:57.924581 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d5f03e-0d9c-4464-a6d5-fec8fcecb61d admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:30:57.931262 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778f0aad-fa4c-4f85-b538-1d6675ca02ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:30:57.932754 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778f0aad-fa4c-4f85-b538-1d6675ca02ec admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:57.933279 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778f0aad-fa4c-4f85-b538-1d6675ca02ec admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:57.933700 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778f0aad-fa4c-4f85-b538-1d6675ca02ec admin admin] PATH_INFO: `/v3/projects/842a1aca542f416eab5d43b881325917/users/0bd49331138a4dbc912bc7bf6f6b0215/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:57.956414 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778f0aad-fa4c-4f85-b538-1d6675ca02ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=842a1aca542f416eab5d43b881325917, user_id=0bd49331138a4dbc912bc7bf6f6b0215, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:30:57.959948 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778f0aad-fa4c-4f85-b538-1d6675ca02ec admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:30:57.962691 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:30:57.991036 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2640/5269] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:30:57 2022] PUT /identity/v3/projects/842a1aca542f416eab5d43b881325917/users/0bd49331138a4dbc912bc7bf6f6b0215/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:30:58.011474 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8346dc0a-175d-4144-876b-46bb1be1d59f None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:58.011890 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8346dc0a-175d-4144-876b-46bb1be1d59f None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:58.012277 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8346dc0a-175d-4144-876b-46bb1be1d59f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:58.076023 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-8346dc0a-175d-4144-876b-46bb1be1d59f None None] MFA Rules not processed for user `0bd49331138a4dbc912bc7bf6f6b0215`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:30:58.078182 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-8346dc0a-175d-4144-876b-46bb1be1d59f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:30:58.228720 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2630/5270] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:30:58 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:30:58.233733 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778f0aad-fa4c-4f85-b538-1d6675ca02ec admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:30:58.394980 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778f0aad-fa4c-4f85-b538-1d6675ca02ec admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:30:58.432172 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5460a92e-a999-4298-93a0-56087f9d2f61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:30:58.435983 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5460a92e-a999-4298-93a0-56087f9d2f61 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:58.436798 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5460a92e-a999-4298-93a0-56087f9d2f61 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:58.437216 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5460a92e-a999-4298-93a0-56087f9d2f61 admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:58.438456 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5460a92e-a999-4298-93a0-56087f9d2f61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:30:58.440983 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5460a92e-a999-4298-93a0-56087f9d2f61 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:30:58.501412 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2641/5271] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:30:58 2022] POST /identity/v3/projects => generated 387 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:30:58.506166 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8346dc0a-175d-4144-876b-46bb1be1d59f None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:30:58.524027 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8346dc0a-175d-4144-876b-46bb1be1d59f None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:30:58.656027 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbf7edd-5656-4e4b-bee4-7525f6e32b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:30:58.656775 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbf7edd-5656-4e4b-bee4-7525f6e32b53 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:58.658211 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbf7edd-5656-4e4b-bee4-7525f6e32b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:58.658211 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbf7edd-5656-4e4b-bee4-7525f6e32b53 admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:58.658823 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbf7edd-5656-4e4b-bee4-7525f6e32b53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:30:58.661722 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbf7edd-5656-4e4b-bee4-7525f6e32b53 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:30:58.673528 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:30:58.715177 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2631/5272] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:30:58 2022] POST /identity/v3/users => generated 294 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:30:58.724881 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5460a92e-a999-4298-93a0-56087f9d2f61 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:30:58.810609 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5460a92e-a999-4298-93a0-56087f9d2f61 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:30:58.840478 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777b97ae-cc85-4024-9c15-ca6a3b6dacb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:30:58.841208 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777b97ae-cc85-4024-9c15-ca6a3b6dacb4 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:58.842203 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777b97ae-cc85-4024-9c15-ca6a3b6dacb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:58.842487 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777b97ae-cc85-4024-9c15-ca6a3b6dacb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:58.843299 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777b97ae-cc85-4024-9c15-ca6a3b6dacb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:30:58.844951 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777b97ae-cc85-4024-9c15-ca6a3b6dacb4 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:30:58.896239 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbf7edd-5656-4e4b-bee4-7525f6e32b53 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:30:58.903590 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2642/5273] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:30:58 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:30:58.915884 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbf7edd-5656-4e4b-bee4-7525f6e32b53 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:30:58.934009 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d753010-c485-41d8-87c4-d548533f32e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:30:58.934933 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d753010-c485-41d8-87c4-d548533f32e9 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:58.935269 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d753010-c485-41d8-87c4-d548533f32e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:58.935548 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d753010-c485-41d8-87c4-d548533f32e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:58.936457 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d753010-c485-41d8-87c4-d548533f32e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:30:58.938786 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d753010-c485-41d8-87c4-d548533f32e9 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:30:58.963443 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2632/5274] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:30:58 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:30:58.967861 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777b97ae-cc85-4024-9c15-ca6a3b6dacb4 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:30:58.984135 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777b97ae-cc85-4024-9c15-ca6a3b6dacb4 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:30:58.994949 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d0fd0a-5507-469e-917d-661b953c9592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:30:58.995875 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d0fd0a-5507-469e-917d-661b953c9592 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:58.996154 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d0fd0a-5507-469e-917d-661b953c9592 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:58.996713 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d0fd0a-5507-469e-917d-661b953c9592 admin admin] PATH_INFO: `/v3/projects/0285ccffb913497abb0e61b90df0f918/users/d796e9b844ce4b9e9dc9285ca2ad4c5f/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:59.035311 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d0fd0a-5507-469e-917d-661b953c9592 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0285ccffb913497abb0e61b90df0f918, user_id=d796e9b844ce4b9e9dc9285ca2ad4c5f, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:30:59.038353 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d0fd0a-5507-469e-917d-661b953c9592 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:30:59.070309 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2643/5275] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:30:58 2022] PUT /identity/v3/projects/0285ccffb913497abb0e61b90df0f918/users/d796e9b844ce4b9e9dc9285ca2ad4c5f/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:30:59.081495 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0749a6-7e4b-49e8-960d-a7d8871d82a9 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:59.081818 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0749a6-7e4b-49e8-960d-a7d8871d82a9 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:59.082104 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0749a6-7e4b-49e8-960d-a7d8871d82a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:59.142536 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-ae0749a6-7e4b-49e8-960d-a7d8871d82a9 None None] MFA Rules not processed for user `d796e9b844ce4b9e9dc9285ca2ad4c5f`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:30:59.143737 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-ae0749a6-7e4b-49e8-960d-a7d8871d82a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:30:59.303110 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2633/5276] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:30:59 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:30:59.306888 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d0fd0a-5507-469e-917d-661b953c9592 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:30:59.393055 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d0fd0a-5507-469e-917d-661b953c9592 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:30:59.399600 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dae595-d606-4376-a50d-9babc08b95f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:30:59.400781 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dae595-d606-4376-a50d-9babc08b95f7 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:59.401470 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dae595-d606-4376-a50d-9babc08b95f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:59.401961 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dae595-d606-4376-a50d-9babc08b95f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:59.403944 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dae595-d606-4376-a50d-9babc08b95f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:30:59.425559 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dae595-d606-4376-a50d-9babc08b95f7 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:30:59.483417 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2644/5277] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:30:59 2022] POST /identity/v3/projects => generated 389 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:30:59.487566 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0749a6-7e4b-49e8-960d-a7d8871d82a9 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:30:59.510217 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0749a6-7e4b-49e8-960d-a7d8871d82a9 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:30:59.612261 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b2541e-5146-4d75-83a8-3dfe7af5fada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:30:59.612963 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b2541e-5146-4d75-83a8-3dfe7af5fada admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:59.613274 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b2541e-5146-4d75-83a8-3dfe7af5fada admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:59.613510 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b2541e-5146-4d75-83a8-3dfe7af5fada admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:59.614271 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b2541e-5146-4d75-83a8-3dfe7af5fada admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:30:59.616206 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b2541e-5146-4d75-83a8-3dfe7af5fada admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:30:59.657293 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2634/5278] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:30:59 2022] POST /identity/v3/users => generated 301 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:30:59.661296 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dae595-d606-4376-a50d-9babc08b95f7 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:30:59.689351 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dae595-d606-4376-a50d-9babc08b95f7 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:30:59.705414 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1dfa1a-cc0e-438e-8361-98c70ad910c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:30:59.706142 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1dfa1a-cc0e-438e-8361-98c70ad910c0 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:59.706424 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1dfa1a-cc0e-438e-8361-98c70ad910c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:59.706697 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1dfa1a-cc0e-438e-8361-98c70ad910c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:59.707436 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1dfa1a-cc0e-438e-8361-98c70ad910c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:30:59.709085 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1dfa1a-cc0e-438e-8361-98c70ad910c0 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:30:59.736280 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2645/5279] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:30:59 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:30:59.740896 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b2541e-5146-4d75-83a8-3dfe7af5fada admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:30:59.761594 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b2541e-5146-4d75-83a8-3dfe7af5fada admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:30:59.771607 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0c43b2-1bc7-4e54-ba71-ebf5018ae1d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:30:59.774118 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0c43b2-1bc7-4e54-ba71-ebf5018ae1d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:30:59.786463 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0c43b2-1bc7-4e54-ba71-ebf5018ae1d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:30:59.787536 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0c43b2-1bc7-4e54-ba71-ebf5018ae1d2 admin admin] PATH_INFO: `/v3/projects/3063d44927d94fdfaec3fccfc55163eb/users/c6aa1ebebef940e48508ae8dc936808a/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:30:59.813457 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0c43b2-1bc7-4e54-ba71-ebf5018ae1d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3063d44927d94fdfaec3fccfc55163eb, user_id=c6aa1ebebef940e48508ae8dc936808a, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:30:59.817455 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0c43b2-1bc7-4e54-ba71-ebf5018ae1d2 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:30:59.864084 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2635/5280] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:30:59 2022] PUT /identity/v3/projects/3063d44927d94fdfaec3fccfc55163eb/users/c6aa1ebebef940e48508ae8dc936808a/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:30:59.869298 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1dfa1a-cc0e-438e-8361-98c70ad910c0 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:30:59.901382 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1dfa1a-cc0e-438e-8361-98c70ad910c0 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:30:59.955447 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:31:00.050404 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c04a1f-7525-4b68-b61a-49f413984350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:31:00.051465 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c04a1f-7525-4b68-b61a-49f413984350 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:31:00.051948 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c04a1f-7525-4b68-b61a-49f413984350 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:31:00.052360 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c04a1f-7525-4b68-b61a-49f413984350 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:31:00.053582 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c04a1f-7525-4b68-b61a-49f413984350 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:31:00.056932 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c04a1f-7525-4b68-b61a-49f413984350 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:31:00.079613 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2646/5281] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:30:59 2022] GET /identity/v3/roles => generated 1420 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 21:31:00.084171 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0c43b2-1bc7-4e54-ba71-ebf5018ae1d2 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:31:00.110742 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0c43b2-1bc7-4e54-ba71-ebf5018ae1d2 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:31:00.130188 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4ce175-ec55-4763-81ea-4fb50cfb75fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:31:00.130824 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4ce175-ec55-4763-81ea-4fb50cfb75fb admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:31:00.131210 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4ce175-ec55-4763-81ea-4fb50cfb75fb admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:31:00.131600 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4ce175-ec55-4763-81ea-4fb50cfb75fb admin admin] PATH_INFO: `/v3/projects/3063d44927d94fdfaec3fccfc55163eb/users/c6aa1ebebef940e48508ae8dc936808a/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:31:00.136833 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4ce175-ec55-4763-81ea-4fb50cfb75fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=3063d44927d94fdfaec3fccfc55163eb, user_id=c6aa1ebebef940e48508ae8dc936808a, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:31:00.145732 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4ce175-ec55-4763-81ea-4fb50cfb75fb admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:31:00.168092 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2636/5282] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:31:00 2022] PUT /identity/v3/projects/3063d44927d94fdfaec3fccfc55163eb/users/c6aa1ebebef940e48508ae8dc936808a/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:31:00.187346 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1fa312-d2af-46c1-a295-9bb81030baf1 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:31:00.187725 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1fa312-d2af-46c1-a295-9bb81030baf1 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:31:00.188036 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1fa312-d2af-46c1-a295-9bb81030baf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:31:00.254794 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-fb1fa312-d2af-46c1-a295-9bb81030baf1 None None] MFA Rules not processed for user `c6aa1ebebef940e48508ae8dc936808a`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:31:00.256283 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-fb1fa312-d2af-46c1-a295-9bb81030baf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:31:00.420728 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2647/5283] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:31:00 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:31:00.435877 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4ce175-ec55-4763-81ea-4fb50cfb75fb admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:31:00.438327 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-5a4ce175-ec55-4763-81ea-4fb50cfb75fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:31:00.488797 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:31:00.579529 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4ce175-ec55-4763-81ea-4fb50cfb75fb admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:31:00.591498 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4350a0-4c3f-486c-a6a1-67d062979cd8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:31:00.592330 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4350a0-4c3f-486c-a6a1-67d062979cd8 service nova] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:31:00.592680 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4350a0-4c3f-486c-a6a1-67d062979cd8 service nova] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:31:00.593022 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4350a0-4c3f-486c-a6a1-67d062979cd8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:31:00.772570 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4350a0-4c3f-486c-a6a1-67d062979cd8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:31:00.776606 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4350a0-4c3f-486c-a6a1-67d062979cd8 service nova] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:31:00.846618 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2637/5284] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:31:00 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:31:01.563308 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1fa312-d2af-46c1-a295-9bb81030baf1 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:31:01.565593 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-fb1fa312-d2af-46c1-a295-9bb81030baf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:31:01.731402 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1fa312-d2af-46c1-a295-9bb81030baf1 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:31:01.748614 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee044e7-6764-4033-a7cc-c626f243d123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:31:01.750903 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee044e7-6764-4033-a7cc-c626f243d123 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:31:01.752564 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee044e7-6764-4033-a7cc-c626f243d123 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:31:01.753182 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee044e7-6764-4033-a7cc-c626f243d123 admin admin] PATH_INFO: `/v3/users/db63ee7259e14b1a84a90bd6c0387df2` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:31:01.760743 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee044e7-6764-4033-a7cc-c626f243d123 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db63ee7259e14b1a84a90bd6c0387df2)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:31:01.767225 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee044e7-6764-4033-a7cc-c626f243d123 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:31:01.849273 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:31:01.860084 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-4ee044e7-6764-4033-a7cc-c626f243d123 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db63ee7259e14b1a84a90bd6c0387df2'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:31:01.872326 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-4ee044e7-6764-4033-a7cc-c626f243d123 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db63ee7259e14b1a84a90bd6c0387df2'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:31:01.874065 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-4ee044e7-6764-4033-a7cc-c626f243d123 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db63ee7259e14b1a84a90bd6c0387df2'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:31:01.888353 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-4ee044e7-6764-4033-a7cc-c626f243d123 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db63ee7259e14b1a84a90bd6c0387df2'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:31:01.907939 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-4ee044e7-6764-4033-a7cc-c626f243d123 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db63ee7259e14b1a84a90bd6c0387df2'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:31:01.917766 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2648/5285] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:31:01 2022] DELETE /identity/v3/users/db63ee7259e14b1a84a90bd6c0387df2 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:31:03.461032 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4350a0-4c3f-486c-a6a1-67d062979cd8 service nova] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:31:03.473192 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4350a0-4c3f-486c-a6a1-67d062979cd8 service nova] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:31:03.559723 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77229270-0a89-4f91-b83b-d559aad785f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:31:03.560959 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77229270-0a89-4f91-b83b-d559aad785f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:31:03.561655 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77229270-0a89-4f91-b83b-d559aad785f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:31:03.561655 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77229270-0a89-4f91-b83b-d559aad785f7 admin admin] PATH_INFO: `/v3/projects/283ad662e4b142c7b948cf19fa81146b` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:31:03.562935 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77229270-0a89-4f91-b83b-d559aad785f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=283ad662e4b142c7b948cf19fa81146b)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:31:03.565367 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77229270-0a89-4f91-b83b-d559aad785f7 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:31:03.641131 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-77229270-0a89-4f91-b83b-d559aad785f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '283ad662e4b142c7b948cf19fa81146b', 'request_id': 'req-77229270-0a89-4f91-b83b-d559aad785f7'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:31:03.660634 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-77229270-0a89-4f91-b83b-d559aad785f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '283ad662e4b142c7b948cf19fa81146b', 'request_id': 'req-77229270-0a89-4f91-b83b-d559aad785f7'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:31:03.674431 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:31:03.677383 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-77229270-0a89-4f91-b83b-d559aad785f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '283ad662e4b142c7b948cf19fa81146b', 'request_id': 'req-77229270-0a89-4f91-b83b-d559aad785f7'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:31:03.699138 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-77229270-0a89-4f91-b83b-d559aad785f7 admin admin] The token cache is being invalidate because project 283ad662e4b142c7b948cf19fa81146b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:31:03.699138 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-77229270-0a89-4f91-b83b-d559aad785f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:31:03.700144 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-77229270-0a89-4f91-b83b-d559aad785f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:31:03.704613 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2638/5286] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:31:03 2022] DELETE /identity/v3/projects/283ad662e4b142c7b948cf19fa81146b => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:31:03.708575 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee044e7-6764-4033-a7cc-c626f243d123 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:31:03.710521 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-4ee044e7-6764-4033-a7cc-c626f243d123 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:31:03.726663 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee044e7-6764-4033-a7cc-c626f243d123 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:31:03.816262 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0fc154-de25-4c69-ad35-e03aa3f3d6ae None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:31:03.816925 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0fc154-de25-4c69-ad35-e03aa3f3d6ae None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:31:03.818179 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0fc154-de25-4c69-ad35-e03aa3f3d6ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:31:03.892388 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-5c0fc154-de25-4c69-ad35-e03aa3f3d6ae None None] MFA Rules not processed for user `8e191bb795f848bf939124faae84add1`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:31:03.893532 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-5c0fc154-de25-4c69-ad35-e03aa3f3d6ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:31:03.897850 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcb9326-8a74-4280-89c8-b8e68ce64620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:31:03.898830 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcb9326-8a74-4280-89c8-b8e68ce64620 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:31:03.899070 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcb9326-8a74-4280-89c8-b8e68ce64620 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:31:03.899337 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcb9326-8a74-4280-89c8-b8e68ce64620 admin admin] PATH_INFO: `/v3/users/a40e57fa4476483ab518a4a9d2ed7989` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:31:03.901042 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcb9326-8a74-4280-89c8-b8e68ce64620 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a40e57fa4476483ab518a4a9d2ed7989)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:31:03.902828 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcb9326-8a74-4280-89c8-b8e68ce64620 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:31:04.003648 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-6fcb9326-8a74-4280-89c8-b8e68ce64620 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a40e57fa4476483ab518a4a9d2ed7989'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:31:04.025365 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-6fcb9326-8a74-4280-89c8-b8e68ce64620 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a40e57fa4476483ab518a4a9d2ed7989'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:31:04.026184 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-6fcb9326-8a74-4280-89c8-b8e68ce64620 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a40e57fa4476483ab518a4a9d2ed7989'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:31:04.047830 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-6fcb9326-8a74-4280-89c8-b8e68ce64620 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a40e57fa4476483ab518a4a9d2ed7989'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:31:04.078486 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-6fcb9326-8a74-4280-89c8-b8e68ce64620 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a40e57fa4476483ab518a4a9d2ed7989'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:31:04.086595 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2649/5287] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:31:03 2022] DELETE /identity/v3/users/a40e57fa4476483ab518a4a9d2ed7989 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:31:04.129258 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2639/5288] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:31:03 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:31:04.139462 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e71cb1-5151-4e76-855e-6e377b587723 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:31:04.139908 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e71cb1-5151-4e76-855e-6e377b587723 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:31:04.140028 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e71cb1-5151-4e76-855e-6e377b587723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:31:04.174830 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-55e71cb1-5151-4e76-855e-6e377b587723 None None] MFA Rules not processed for user `fc0782a98aca44f18bf86a9f6ad5eb60`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:31:04.176042 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-55e71cb1-5151-4e76-855e-6e377b587723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:31:04.237738 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:31:04.272193 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2650/5289] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:31:04 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:31:04.287597 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0fc154-de25-4c69-ad35-e03aa3f3d6ae None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:31:04.289662 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-5c0fc154-de25-4c69-ad35-e03aa3f3d6ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:31:04.423935 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0fc154-de25-4c69-ad35-e03aa3f3d6ae None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:31:04.598543 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e08f0b-70ce-452f-b008-06f5b56d8265 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:31:04.599094 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e08f0b-70ce-452f-b008-06f5b56d8265 service nova] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:31:04.599319 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e08f0b-70ce-452f-b008-06f5b56d8265 service nova] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:31:04.599496 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e08f0b-70ce-452f-b008-06f5b56d8265 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:31:04.622466 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-81e08f0b-70ce-452f-b008-06f5b56d8265 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:31:04.645406 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e08f0b-70ce-452f-b008-06f5b56d8265 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:31:04.653483 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e08f0b-70ce-452f-b008-06f5b56d8265 service nova] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:31:04.698366 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2640/5290] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:31:04 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:31:05.479801 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e71cb1-5151-4e76-855e-6e377b587723 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:31:05.481588 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-55e71cb1-5151-4e76-855e-6e377b587723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:31:05.549808 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e71cb1-5151-4e76-855e-6e377b587723 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:31:05.556361 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11c33c5-f260-4c0d-aa38-48956001f113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:31:05.557312 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11c33c5-f260-4c0d-aa38-48956001f113 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:31:05.557584 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11c33c5-f260-4c0d-aa38-48956001f113 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:31:05.557853 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11c33c5-f260-4c0d-aa38-48956001f113 admin admin] PATH_INFO: `/v3/projects/83653c6402584422a314855a924c1d0c` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:31:05.559253 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11c33c5-f260-4c0d-aa38-48956001f113 admin admin] RBAC: Authorizing `identity:delete_project(project_id=83653c6402584422a314855a924c1d0c)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:31:05.561424 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11c33c5-f260-4c0d-aa38-48956001f113 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:31:05.620103 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-b11c33c5-f260-4c0d-aa38-48956001f113 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83653c6402584422a314855a924c1d0c', 'request_id': 'req-b11c33c5-f260-4c0d-aa38-48956001f113'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:31:05.630890 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-b11c33c5-f260-4c0d-aa38-48956001f113 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83653c6402584422a314855a924c1d0c', 'request_id': 'req-b11c33c5-f260-4c0d-aa38-48956001f113'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:31:05.638321 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-b11c33c5-f260-4c0d-aa38-48956001f113 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83653c6402584422a314855a924c1d0c', 'request_id': 'req-b11c33c5-f260-4c0d-aa38-48956001f113'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:31:05.651740 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-b11c33c5-f260-4c0d-aa38-48956001f113 admin admin] The token cache is being invalidate because project 83653c6402584422a314855a924c1d0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:31:05.652072 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-b11c33c5-f260-4c0d-aa38-48956001f113 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:31:05.652864 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-b11c33c5-f260-4c0d-aa38-48956001f113 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:31:05.657911 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2651/5291] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:31:05 2022] DELETE /identity/v3/projects/83653c6402584422a314855a924c1d0c => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:31:05.660255 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3aaded-c595-41ee-8a39-610c4eeffde5 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:31:05.660748 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3aaded-c595-41ee-8a39-610c4eeffde5 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:31:05.661094 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3aaded-c595-41ee-8a39-610c4eeffde5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:31:05.666405 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:31:05.709794 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-ee3aaded-c595-41ee-8a39-610c4eeffde5 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:31:05.712383 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-ee3aaded-c595-41ee-8a39-610c4eeffde5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:31:05.844047 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2641/5292] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:31:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:31:05.846352 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0abaa05-a4e2-4c7d-ac19-0577eed7d0f9 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:31:05.846769 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0abaa05-a4e2-4c7d-ac19-0577eed7d0f9 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:31:05.847140 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0abaa05-a4e2-4c7d-ac19-0577eed7d0f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:31:05.870602 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-d0abaa05-a4e2-4c7d-ac19-0577eed7d0f9 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:31:05.872300 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-d0abaa05-a4e2-4c7d-ac19-0577eed7d0f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:31:05.885013 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2652/5293] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:31:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:31:05.886374 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3aaded-c595-41ee-8a39-610c4eeffde5 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:31:05.898806 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3aaded-c595-41ee-8a39-610c4eeffde5 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:31:05.905103 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c238a34-4d49-49fb-90c7-7e5bcec8e179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:31:05.906241 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c238a34-4d49-49fb-90c7-7e5bcec8e179 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:31:05.906509 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c238a34-4d49-49fb-90c7-7e5bcec8e179 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:31:05.906842 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c238a34-4d49-49fb-90c7-7e5bcec8e179 admin admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:31:05.907663 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c238a34-4d49-49fb-90c7-7e5bcec8e179 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:31:05.908027 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c238a34-4d49-49fb-90c7-7e5bcec8e179 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:31:05.909847 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c238a34-4d49-49fb-90c7-7e5bcec8e179 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:31:05.936578 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2642/5294] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:31:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:31:05.937943 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0abaa05-a4e2-4c7d-ac19-0577eed7d0f9 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:31:05.949204 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0abaa05-a4e2-4c7d-ac19-0577eed7d0f9 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:31:05.955831 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0e08bc-5b90-4567-b5b0-18e61ec46c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:31:05.956879 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e08bc-5b90-4567-b5b0-18e61ec46c24 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:31:05.956879 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e08bc-5b90-4567-b5b0-18e61ec46c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:31:05.957081 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e08bc-5b90-4567-b5b0-18e61ec46c24 admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:31:05.957741 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0e08bc-5b90-4567-b5b0-18e61ec46c24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:31:05.960144 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0e08bc-5b90-4567-b5b0-18e61ec46c24 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:31:05.989956 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2653/5295] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:31:05 2022] POST /identity/v3/projects => generated 371 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:31:05.994523 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c238a34-4d49-49fb-90c7-7e5bcec8e179 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:31:06.011374 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c238a34-4d49-49fb-90c7-7e5bcec8e179 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:31:06.130268 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0251ce3-01af-42fa-9710-2782372803db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:31:06.131533 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0251ce3-01af-42fa-9710-2782372803db admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:31:06.132093 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0251ce3-01af-42fa-9710-2782372803db admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:31:06.132708 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0251ce3-01af-42fa-9710-2782372803db admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:31:06.133647 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0251ce3-01af-42fa-9710-2782372803db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:31:06.136027 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0251ce3-01af-42fa-9710-2782372803db admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:31:06.171688 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2643/5296] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:31:05 2022] POST /identity/v3/users => generated 286 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:31:06.172841 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0e08bc-5b90-4567-b5b0-18e61ec46c24 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:31:06.189024 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0e08bc-5b90-4567-b5b0-18e61ec46c24 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:31:06.200315 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578012ae-8b92-4a79-8380-ef287589c444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:31:06.201263 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578012ae-8b92-4a79-8380-ef287589c444 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:31:06.201417 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578012ae-8b92-4a79-8380-ef287589c444 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:31:06.201716 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578012ae-8b92-4a79-8380-ef287589c444 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:31:06.204978 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578012ae-8b92-4a79-8380-ef287589c444 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:31:06.208898 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578012ae-8b92-4a79-8380-ef287589c444 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:31:06.239809 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2654/5297] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:31:06 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 21:31:06.244023 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0251ce3-01af-42fa-9710-2782372803db admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:31:06.266260 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0251ce3-01af-42fa-9710-2782372803db admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:31:06.275195 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8447c1b-7a1c-4ae7-956a-fffead649867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:31:06.276408 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8447c1b-7a1c-4ae7-956a-fffead649867 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:31:06.277119 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8447c1b-7a1c-4ae7-956a-fffead649867 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:31:06.277530 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8447c1b-7a1c-4ae7-956a-fffead649867 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:31:06.279216 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8447c1b-7a1c-4ae7-956a-fffead649867 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:31:06.281424 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8447c1b-7a1c-4ae7-956a-fffead649867 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:31:06.349491 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2644/5298] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:31:06 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:31:06.354443 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578012ae-8b92-4a79-8380-ef287589c444 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:31:06.371409 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578012ae-8b92-4a79-8380-ef287589c444 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:31:06.398489 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c786243-84de-424a-9138-f5c45693e0e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:31:06.400594 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c786243-84de-424a-9138-f5c45693e0e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:31:06.401060 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c786243-84de-424a-9138-f5c45693e0e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:31:06.401523 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c786243-84de-424a-9138-f5c45693e0e7 admin admin] PATH_INFO: `/v3/projects/0ffb5a534beb4a4eab7e16c936a22362/users/d3d6440acdb14f7a8e24fb642f65a919/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:31:06.440085 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c786243-84de-424a-9138-f5c45693e0e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ffb5a534beb4a4eab7e16c936a22362, user_id=d3d6440acdb14f7a8e24fb642f65a919, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:31:06.444758 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c786243-84de-424a-9138-f5c45693e0e7 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:31:06.482961 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2655/5299] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:31:06 2022] PUT /identity/v3/projects/0ffb5a534beb4a4eab7e16c936a22362/users/d3d6440acdb14f7a8e24fb642f65a919/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:31:06.494671 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f9972c-2dff-4f87-bd45-bb77e952d565 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:31:06.497162 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f9972c-2dff-4f87-bd45-bb77e952d565 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:31:06.497531 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f9972c-2dff-4f87-bd45-bb77e952d565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:31:06.574866 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-d8f9972c-2dff-4f87-bd45-bb77e952d565 None None] MFA Rules not processed for user `d3d6440acdb14f7a8e24fb642f65a919`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:31:06.576222 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-d8f9972c-2dff-4f87-bd45-bb77e952d565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:31:06.690433 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:31:06.727684 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2645/5300] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:31:06 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:31:06.740964 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90f359a-343e-4bc7-8398-def6da4d1e10 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:31:06.741237 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90f359a-343e-4bc7-8398-def6da4d1e10 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:31:06.741641 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90f359a-343e-4bc7-8398-def6da4d1e10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:31:06.769913 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-d90f359a-343e-4bc7-8398-def6da4d1e10 None None] MFA Rules not processed for user `d3d6440acdb14f7a8e24fb642f65a919`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:31:06.771479 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-d90f359a-343e-4bc7-8398-def6da4d1e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:31:06.785936 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2656/5301] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:31:06 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:31:06.955938 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f9972c-2dff-4f87-bd45-bb77e952d565 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:31:06.957802 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-d8f9972c-2dff-4f87-bd45-bb77e952d565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:31:07.007116 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d30f239-2013-40ad-9df1-00e32e0edabb None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:31:07.007392 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d30f239-2013-40ad-9df1-00e32e0edabb None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:31:07.007670 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d30f239-2013-40ad-9df1-00e32e0edabb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:31:07.013727 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:31:07.039768 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-3d30f239-2013-40ad-9df1-00e32e0edabb None None] MFA Rules not processed for user `6ca9644a73d9468aa39b21548a72bded`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:31:07.041486 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-3d30f239-2013-40ad-9df1-00e32e0edabb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:31:07.172030 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2657/5302] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:31:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:31:07.205944 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f9972c-2dff-4f87-bd45-bb77e952d565 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:31:07.226057 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb8bf5b-240a-4999-9e00-3786fd32f474 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:31:07.227788 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb8bf5b-240a-4999-9e00-3786fd32f474 service nova] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:31:07.227788 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb8bf5b-240a-4999-9e00-3786fd32f474 service nova] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:31:07.228199 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb8bf5b-240a-4999-9e00-3786fd32f474 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:31:07.260954 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb8bf5b-240a-4999-9e00-3786fd32f474 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:31:07.265467 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb8bf5b-240a-4999-9e00-3786fd32f474 service nova] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:31:07.282271 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2646/5303] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:31:06 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:31:07.951165 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9801755-b119-47bb-b3b9-f12afa545dc8 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:31:07.952671 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9801755-b119-47bb-b3b9-f12afa545dc8 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:31:07.953294 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9801755-b119-47bb-b3b9-f12afa545dc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:31:08.055540 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-f9801755-b119-47bb-b3b9-f12afa545dc8 None None] MFA Rules not processed for user `d3d6440acdb14f7a8e24fb642f65a919`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:31:08.058760 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-f9801755-b119-47bb-b3b9-f12afa545dc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:31:08.096454 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2658/5304] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:31:07 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:31:09.735358 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb8bf5b-240a-4999-9e00-3786fd32f474 service nova] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:31:09.738232 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-beb8bf5b-240a-4999-9e00-3786fd32f474 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:31:09.882476 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb8bf5b-240a-4999-9e00-3786fd32f474 service nova] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:31:09.887748 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b7b2f1-12fd-4800-8ef0-cbf3debfa83b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:31:09.888450 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b7b2f1-12fd-4800-8ef0-cbf3debfa83b service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:31:09.888730 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b7b2f1-12fd-4800-8ef0-cbf3debfa83b service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:31:09.891246 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b7b2f1-12fd-4800-8ef0-cbf3debfa83b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:31:09.909048 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-28b7b2f1-12fd-4800-8ef0-cbf3debfa83b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:31:10.116176 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b7b2f1-12fd-4800-8ef0-cbf3debfa83b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:31:10.125377 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b7b2f1-12fd-4800-8ef0-cbf3debfa83b service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:31:10.167641 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2647/5305] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:31:09 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:31:14.232450 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9801755-b119-47bb-b3b9-f12afa545dc8 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:31:14.234046 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-f9801755-b119-47bb-b3b9-f12afa545dc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:31:14.440131 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9801755-b119-47bb-b3b9-f12afa545dc8 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:31:14.447448 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914e5ccb-f9dc-4ebb-b0ef-9beaee7bb7a9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc719a3b3ac4461b82ca04ab6451d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:31:14.448178 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914e5ccb-f9dc-4ebb-b0ef-9beaee7bb7a9 service placement] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:31:14.448466 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914e5ccb-f9dc-4ebb-b0ef-9beaee7bb7a9 service placement] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:31:14.448741 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914e5ccb-f9dc-4ebb-b0ef-9beaee7bb7a9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:31:14.452413 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-914e5ccb-f9dc-4ebb-b0ef-9beaee7bb7a9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:31:14.522279 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914e5ccb-f9dc-4ebb-b0ef-9beaee7bb7a9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:31:14.524399 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914e5ccb-f9dc-4ebb-b0ef-9beaee7bb7a9 service placement] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:31:14.550880 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2659/5306] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:31:14 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:31:15.118869 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e28a969-e649-4cee-b3e4-6cac45690628 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:31:15.119443 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e28a969-e649-4cee-b3e4-6cac45690628 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:31:15.119443 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e28a969-e649-4cee-b3e4-6cac45690628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:31:15.166421 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-1e28a969-e649-4cee-b3e4-6cac45690628 None None] MFA Rules not processed for user `6ca9644a73d9468aa39b21548a72bded`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:31:15.167682 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-1e28a969-e649-4cee-b3e4-6cac45690628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:31:15.224210 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2648/5307] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:31:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:31:16.837123 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05aae08-b9aa-4fb7-bca1-0334cd694e7a None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:31:16.837726 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05aae08-b9aa-4fb7-bca1-0334cd694e7a None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:31:16.837726 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05aae08-b9aa-4fb7-bca1-0334cd694e7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:31:16.868640 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-a05aae08-b9aa-4fb7-bca1-0334cd694e7a None None] MFA Rules not processed for user `6ca9644a73d9468aa39b21548a72bded`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:31:16.870146 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-a05aae08-b9aa-4fb7-bca1-0334cd694e7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:31:16.884232 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2660/5308] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:31:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:31:17.570438 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5c1598-1b40-457f-afeb-708254500c9e None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:31:17.571007 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5c1598-1b40-457f-afeb-708254500c9e None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:31:17.571131 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5c1598-1b40-457f-afeb-708254500c9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:31:17.595414 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-ff5c1598-1b40-457f-afeb-708254500c9e None None] MFA Rules not processed for user `6ca9644a73d9468aa39b21548a72bded`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:31:17.598275 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-ff5c1598-1b40-457f-afeb-708254500c9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:31:17.612670 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2649/5309] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:31:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:31:19.345538 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eac4556-9357-4712-9e77-97fc2862853d None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:31:19.346162 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eac4556-9357-4712-9e77-97fc2862853d None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:31:19.346355 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eac4556-9357-4712-9e77-97fc2862853d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:31:19.377282 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-8eac4556-9357-4712-9e77-97fc2862853d None None] MFA Rules not processed for user `6ca9644a73d9468aa39b21548a72bded`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:31:19.378700 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-8eac4556-9357-4712-9e77-97fc2862853d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:31:19.406963 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2661/5310] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:31:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:31:19.989737 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d8f3b4-c7a7-47a7-bab5-a94dc1be3a70 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:31:19.993151 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d8f3b4-c7a7-47a7-bab5-a94dc1be3a70 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:31:19.993646 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d8f3b4-c7a7-47a7-bab5-a94dc1be3a70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:31:20.036850 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a8bbf8-4751-4993-9147-215cc0114119 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:31:20.037062 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-16d8f3b4-c7a7-47a7-bab5-a94dc1be3a70 None None] MFA Rules not processed for user `0bd49331138a4dbc912bc7bf6f6b0215`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:31:20.037440 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a8bbf8-4751-4993-9147-215cc0114119 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:31:20.037778 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a8bbf8-4751-4993-9147-215cc0114119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:31:20.038743 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-16d8f3b4-c7a7-47a7-bab5-a94dc1be3a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:31:20.061606 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:31:20.067163 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-02a8bbf8-4751-4993-9147-215cc0114119 None None] MFA Rules not processed for user `6ca9644a73d9468aa39b21548a72bded`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:31:20.068494 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-02a8bbf8-4751-4993-9147-215cc0114119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:31:20.090069 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2662/5311] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:31:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:31:20.165399 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2650/5312] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:31:19 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:31:20.977990 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70535bf-e202-4d41-b7ac-f1ba124b5be1 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:31:20.978456 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70535bf-e202-4d41-b7ac-f1ba124b5be1 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:31:20.978562 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70535bf-e202-4d41-b7ac-f1ba124b5be1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:31:20.999482 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-d70535bf-e202-4d41-b7ac-f1ba124b5be1 None None] MFA Rules not processed for user `6ca9644a73d9468aa39b21548a72bded`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:31:21.000694 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-d70535bf-e202-4d41-b7ac-f1ba124b5be1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:31:21.008296 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2663/5313] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:31:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:31:23.146809 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bab9560-eb93-41f6-be3d-5749b5eff055 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:31:23.147300 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bab9560-eb93-41f6-be3d-5749b5eff055 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:31:23.147481 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bab9560-eb93-41f6-be3d-5749b5eff055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:31:23.177301 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-8bab9560-eb93-41f6-be3d-5749b5eff055 None None] MFA Rules not processed for user `6ca9644a73d9468aa39b21548a72bded`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:31:23.178996 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-8bab9560-eb93-41f6-be3d-5749b5eff055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:31:23.194624 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2651/5314] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:31:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:31:25.113056 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70535bf-e202-4d41-b7ac-f1ba124b5be1 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:31:25.114444 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-d70535bf-e202-4d41-b7ac-f1ba124b5be1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:31:25.151810 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70535bf-e202-4d41-b7ac-f1ba124b5be1 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:31:25.157320 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f780afa4-3e9e-4da0-83b2-e5ceb11adb9d None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:31:25.157825 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f780afa4-3e9e-4da0-83b2-e5ceb11adb9d None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:31:25.158364 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f780afa4-3e9e-4da0-83b2-e5ceb11adb9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:31:25.171904 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9444b23-5db3-41f6-8f0d-78f2a46e218d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:31:25.172746 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9444b23-5db3-41f6-8f0d-78f2a46e218d service nova] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:31:25.173434 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9444b23-5db3-41f6-8f0d-78f2a46e218d service nova] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:31:25.174008 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9444b23-5db3-41f6-8f0d-78f2a46e218d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:31:25.182179 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-c9444b23-5db3-41f6-8f0d-78f2a46e218d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:31:25.185968 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-f780afa4-3e9e-4da0-83b2-e5ceb11adb9d None None] MFA Rules not processed for user `5efda1c40f494592bf1e6af1add120f3`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:31:25.188271 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-f780afa4-3e9e-4da0-83b2-e5ceb11adb9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:31:25.262823 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:31:25.270693 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2652/5315] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:31:25 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:31:25.288579 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9444b23-5db3-41f6-8f0d-78f2a46e218d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:31:25.291260 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9444b23-5db3-41f6-8f0d-78f2a46e218d service nova] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:31:25.322925 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2664/5316] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:31:25 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:31:26.937845 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f780afa4-3e9e-4da0-83b2-e5ceb11adb9d None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:31:26.951733 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f780afa4-3e9e-4da0-83b2-e5ceb11adb9d None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:31:26.958218 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34481f87-75ca-46d2-8fb9-a04e7cda6c63 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc719a3b3ac4461b82ca04ab6451d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:31:26.958946 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34481f87-75ca-46d2-8fb9-a04e7cda6c63 service placement] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:31:26.959226 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34481f87-75ca-46d2-8fb9-a04e7cda6c63 service placement] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:31:26.959788 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34481f87-75ca-46d2-8fb9-a04e7cda6c63 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:31:26.962027 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-34481f87-75ca-46d2-8fb9-a04e7cda6c63 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:31:26.977947 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34481f87-75ca-46d2-8fb9-a04e7cda6c63 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:31:26.979638 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34481f87-75ca-46d2-8fb9-a04e7cda6c63 service placement] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:31:26.994978 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2653/5317] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:31:26 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:31:31.861815 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e9397b-cbd4-48dc-ab98-7c225d8b6259 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:31:31.862762 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e9397b-cbd4-48dc-ab98-7c225d8b6259 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:31:31.863263 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e9397b-cbd4-48dc-ab98-7c225d8b6259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:31:31.889222 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-58e9397b-cbd4-48dc-ab98-7c225d8b6259 None None] MFA Rules not processed for user `6ca9644a73d9468aa39b21548a72bded`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:31:31.890687 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-58e9397b-cbd4-48dc-ab98-7c225d8b6259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:31:31.922912 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2665/5318] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:31:31 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:31:32.643763 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18330a7a-9b15-4140-81de-4270d7a2efac None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:31:32.644281 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18330a7a-9b15-4140-81de-4270d7a2efac None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:31:32.644281 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18330a7a-9b15-4140-81de-4270d7a2efac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:31:32.663878 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-18330a7a-9b15-4140-81de-4270d7a2efac None None] MFA Rules not processed for user `6ca9644a73d9468aa39b21548a72bded`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:31:32.665460 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-18330a7a-9b15-4140-81de-4270d7a2efac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:31:32.673627 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2654/5319] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:31:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:31:41.885419 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=11 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:31:42.658041 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=56 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:31:44.781068 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab302517-98b7-4609-9d8d-17cf61eca42e None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:31:44.781573 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab302517-98b7-4609-9d8d-17cf61eca42e None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:31:44.781667 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab302517-98b7-4609-9d8d-17cf61eca42e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:31:44.815248 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-ab302517-98b7-4609-9d8d-17cf61eca42e None None] MFA Rules not processed for user `5efda1c40f494592bf1e6af1add120f3`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:31:44.825111 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-ab302517-98b7-4609-9d8d-17cf61eca42e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:31:44.840329 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2666/5320] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:31:44 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:31:45.543129 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18330a7a-9b15-4140-81de-4270d7a2efac None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:31:45.561408 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18330a7a-9b15-4140-81de-4270d7a2efac None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:31:45.567709 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbea40fd-981c-4f3e-b0cc-5f1594cd5b2a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc719a3b3ac4461b82ca04ab6451d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:31:45.568721 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbea40fd-981c-4f3e-b0cc-5f1594cd5b2a service placement] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:31:45.569099 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbea40fd-981c-4f3e-b0cc-5f1594cd5b2a service placement] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:31:45.569466 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbea40fd-981c-4f3e-b0cc-5f1594cd5b2a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:31:45.571808 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-bbea40fd-981c-4f3e-b0cc-5f1594cd5b2a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:31:45.588546 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbea40fd-981c-4f3e-b0cc-5f1594cd5b2a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:31:45.590878 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbea40fd-981c-4f3e-b0cc-5f1594cd5b2a service placement] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:31:45.611974 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2655/5321] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:31:45 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:31:45.633417 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab302517-98b7-4609-9d8d-17cf61eca42e None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:31:45.634879 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-ab302517-98b7-4609-9d8d-17cf61eca42e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:31:45.737331 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab302517-98b7-4609-9d8d-17cf61eca42e None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:31:45.742177 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05babf07-07c1-4555-88a0-1a32be495ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:31:45.743285 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05babf07-07c1-4555-88a0-1a32be495ea5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:31:45.743746 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05babf07-07c1-4555-88a0-1a32be495ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:31:45.744194 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05babf07-07c1-4555-88a0-1a32be495ea5 admin admin] PATH_INFO: `/v3/users/e75e9cbfb23a47f2bad4e546b8156f00` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:31:45.745634 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05babf07-07c1-4555-88a0-1a32be495ea5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e75e9cbfb23a47f2bad4e546b8156f00)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:31:45.748463 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05babf07-07c1-4555-88a0-1a32be495ea5 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:31:45.817812 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-05babf07-07c1-4555-88a0-1a32be495ea5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e75e9cbfb23a47f2bad4e546b8156f00'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:31:45.835941 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-05babf07-07c1-4555-88a0-1a32be495ea5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e75e9cbfb23a47f2bad4e546b8156f00'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:31:45.837948 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-05babf07-07c1-4555-88a0-1a32be495ea5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e75e9cbfb23a47f2bad4e546b8156f00'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:31:45.850459 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-05babf07-07c1-4555-88a0-1a32be495ea5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e75e9cbfb23a47f2bad4e546b8156f00'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:31:45.876334 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-05babf07-07c1-4555-88a0-1a32be495ea5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e75e9cbfb23a47f2bad4e546b8156f00'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:31:45.896253 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2667/5322] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:31:45 2022] DELETE /identity/v3/users/e75e9cbfb23a47f2bad4e546b8156f00 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:31:45.898127 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470d7f8e-975c-40fb-b494-ea8420416162 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:31:45.898764 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470d7f8e-975c-40fb-b494-ea8420416162 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:31:45.899358 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470d7f8e-975c-40fb-b494-ea8420416162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:31:45.923330 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-470d7f8e-975c-40fb-b494-ea8420416162 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:31:45.924793 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-470d7f8e-975c-40fb-b494-ea8420416162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:31:46.099175 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05babf07-07c1-4555-88a0-1a32be495ea5 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:31:46.101290 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-05babf07-07c1-4555-88a0-1a32be495ea5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:31:46.137020 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2656/5323] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:31:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:31:46.175105 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470d7f8e-975c-40fb-b494-ea8420416162 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:31:46.178169 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-470d7f8e-975c-40fb-b494-ea8420416162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:31:46.237045 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05babf07-07c1-4555-88a0-1a32be495ea5 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:31:46.242449 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd4e0ca-3ab7-4bca-9070-0e841578b1cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:31:46.243469 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd4e0ca-3ab7-4bca-9070-0e841578b1cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:31:46.243836 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd4e0ca-3ab7-4bca-9070-0e841578b1cc admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:31:46.244228 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd4e0ca-3ab7-4bca-9070-0e841578b1cc admin admin] PATH_INFO: `/v3/users/fc0782a98aca44f18bf86a9f6ad5eb60` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:31:46.246685 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd4e0ca-3ab7-4bca-9070-0e841578b1cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc0782a98aca44f18bf86a9f6ad5eb60)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:31:46.248764 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd4e0ca-3ab7-4bca-9070-0e841578b1cc admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:31:46.267546 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:31:46.289122 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470d7f8e-975c-40fb-b494-ea8420416162 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:31:46.293909 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762a0cf0-e9b7-4c54-9f0c-d2b879289d15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:31:46.295088 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762a0cf0-e9b7-4c54-9f0c-d2b879289d15 service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:31:46.295700 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762a0cf0-e9b7-4c54-9f0c-d2b879289d15 service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:31:46.296209 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762a0cf0-e9b7-4c54-9f0c-d2b879289d15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:31:46.311600 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762a0cf0-e9b7-4c54-9f0c-d2b879289d15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:31:46.314179 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762a0cf0-e9b7-4c54-9f0c-d2b879289d15 service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:31:46.331280 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-8dd4e0ca-3ab7-4bca-9070-0e841578b1cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc0782a98aca44f18bf86a9f6ad5eb60'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:31:46.341556 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-8dd4e0ca-3ab7-4bca-9070-0e841578b1cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc0782a98aca44f18bf86a9f6ad5eb60'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:31:46.341806 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2657/5324] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:31:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 23 21:31:46.342967 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-8dd4e0ca-3ab7-4bca-9070-0e841578b1cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc0782a98aca44f18bf86a9f6ad5eb60'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:31:46.357148 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-8dd4e0ca-3ab7-4bca-9070-0e841578b1cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc0782a98aca44f18bf86a9f6ad5eb60'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:31:46.377186 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-8dd4e0ca-3ab7-4bca-9070-0e841578b1cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc0782a98aca44f18bf86a9f6ad5eb60'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:31:46.388687 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2668/5325] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:31:46 2022] DELETE /identity/v3/users/fc0782a98aca44f18bf86a9f6ad5eb60 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:31:46.669716 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8c1e3f-0155-43d8-8fa7-84bf4029594c None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:31:46.670493 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8c1e3f-0155-43d8-8fa7-84bf4029594c None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:31:46.670493 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8c1e3f-0155-43d8-8fa7-84bf4029594c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:31:46.677997 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd4e0ca-3ab7-4bca-9070-0e841578b1cc admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:31:46.686743 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-8dd4e0ca-3ab7-4bca-9070-0e841578b1cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:31:46.710160 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-ba8c1e3f-0155-43d8-8fa7-84bf4029594c None None] MFA Rules not processed for user `6ca9644a73d9468aa39b21548a72bded`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:31:46.712253 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-ba8c1e3f-0155-43d8-8fa7-84bf4029594c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:31:46.785234 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd4e0ca-3ab7-4bca-9070-0e841578b1cc admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:31:46.790896 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dab683-8f93-436b-b45f-5283aff4d40d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:31:46.791734 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dab683-8f93-436b-b45f-5283aff4d40d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:31:46.792251 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dab683-8f93-436b-b45f-5283aff4d40d admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:31:46.792651 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dab683-8f93-436b-b45f-5283aff4d40d admin admin] PATH_INFO: `/v3/projects/e5f69bc7e16b468395579ec531b616a6` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:31:46.794173 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dab683-8f93-436b-b45f-5283aff4d40d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5f69bc7e16b468395579ec531b616a6)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:31:46.796089 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dab683-8f93-436b-b45f-5283aff4d40d admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:31:46.805560 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2658/5326] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:31:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:31:46.806783 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8c1e3f-0155-43d8-8fa7-84bf4029594c None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:31:46.808282 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-ba8c1e3f-0155-43d8-8fa7-84bf4029594c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:31:46.831723 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8c1e3f-0155-43d8-8fa7-84bf4029594c None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:31:46.857029 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb72ad8-a9cd-4234-a9c6-954e9acd2fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:31:46.858281 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb72ad8-a9cd-4234-a9c6-954e9acd2fa4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:31:46.858618 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb72ad8-a9cd-4234-a9c6-954e9acd2fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:31:46.859409 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb72ad8-a9cd-4234-a9c6-954e9acd2fa4 admin admin] PATH_INFO: `/v3/projects/3d547fc8e53d43888e35c3e8ef5caada` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:31:46.861265 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb72ad8-a9cd-4234-a9c6-954e9acd2fa4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d547fc8e53d43888e35c3e8ef5caada)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:31:46.863723 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb72ad8-a9cd-4234-a9c6-954e9acd2fa4 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:31:46.875895 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-b6dab683-8f93-436b-b45f-5283aff4d40d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5f69bc7e16b468395579ec531b616a6', 'request_id': 'req-b6dab683-8f93-436b-b45f-5283aff4d40d'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:31:46.887242 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-b6dab683-8f93-436b-b45f-5283aff4d40d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5f69bc7e16b468395579ec531b616a6', 'request_id': 'req-b6dab683-8f93-436b-b45f-5283aff4d40d'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:31:46.897411 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-b6dab683-8f93-436b-b45f-5283aff4d40d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5f69bc7e16b468395579ec531b616a6', 'request_id': 'req-b6dab683-8f93-436b-b45f-5283aff4d40d'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:31:46.912844 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:31:46.914932 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-b6dab683-8f93-436b-b45f-5283aff4d40d admin admin] The token cache is being invalidate because project e5f69bc7e16b468395579ec531b616a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:31:46.915340 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-b6dab683-8f93-436b-b45f-5283aff4d40d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:31:46.916865 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-b6dab683-8f93-436b-b45f-5283aff4d40d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:31:46.919062 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2669/5327] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:31:46 2022] DELETE /identity/v3/projects/e5f69bc7e16b468395579ec531b616a6 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:31:46.924467 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888687ac-cc78-41f5-99bf-25aee5699f4d None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:31:46.924752 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888687ac-cc78-41f5-99bf-25aee5699f4d None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:31:46.925353 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888687ac-cc78-41f5-99bf-25aee5699f4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:31:46.934862 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-fbb72ad8-a9cd-4234-a9c6-954e9acd2fa4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d547fc8e53d43888e35c3e8ef5caada', 'request_id': 'req-fbb72ad8-a9cd-4234-a9c6-954e9acd2fa4'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:31:46.946107 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-fbb72ad8-a9cd-4234-a9c6-954e9acd2fa4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d547fc8e53d43888e35c3e8ef5caada', 'request_id': 'req-fbb72ad8-a9cd-4234-a9c6-954e9acd2fa4'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:31:46.947786 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-888687ac-cc78-41f5-99bf-25aee5699f4d None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:31:46.949544 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-888687ac-cc78-41f5-99bf-25aee5699f4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:31:46.953815 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-fbb72ad8-a9cd-4234-a9c6-954e9acd2fa4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d547fc8e53d43888e35c3e8ef5caada', 'request_id': 'req-fbb72ad8-a9cd-4234-a9c6-954e9acd2fa4'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:31:46.970595 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-fbb72ad8-a9cd-4234-a9c6-954e9acd2fa4 admin admin] The token cache is being invalidate because project 3d547fc8e53d43888e35c3e8ef5caada was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:31:46.971102 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-fbb72ad8-a9cd-4234-a9c6-954e9acd2fa4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:31:46.972897 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-fbb72ad8-a9cd-4234-a9c6-954e9acd2fa4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:31:46.975099 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2659/5328] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:31:46 2022] DELETE /identity/v3/projects/3d547fc8e53d43888e35c3e8ef5caada => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:31:46.979124 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb72ad8-a9cd-4234-a9c6-954e9acd2fa4 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:31:46.981677 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-fbb72ad8-a9cd-4234-a9c6-954e9acd2fa4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:31:46.984282 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:31:47.041842 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2670/5329] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:31:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:31:47.051322 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f4c59c-f7b1-49eb-9853-bef682728e7b None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:31:47.051840 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f4c59c-f7b1-49eb-9853-bef682728e7b None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:31:47.052116 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f4c59c-f7b1-49eb-9853-bef682728e7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:31:47.081203 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-95f4c59c-f7b1-49eb-9853-bef682728e7b None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:31:47.082472 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-95f4c59c-f7b1-49eb-9853-bef682728e7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:31:47.089726 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb72ad8-a9cd-4234-a9c6-954e9acd2fa4 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:31:47.100273 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2671/5330] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:31:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:31:47.104271 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e7e41f-34e6-4b5f-9e95-22077eed8248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:31:47.104705 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f4c59c-f7b1-49eb-9853-bef682728e7b None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:31:47.106128 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e7e41f-34e6-4b5f-9e95-22077eed8248 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:31:47.113919 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e7e41f-34e6-4b5f-9e95-22077eed8248 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:31:47.114317 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e7e41f-34e6-4b5f-9e95-22077eed8248 admin admin] PATH_INFO: `/v3/users/8e191bb795f848bf939124faae84add1` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:31:47.115690 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e7e41f-34e6-4b5f-9e95-22077eed8248 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e191bb795f848bf939124faae84add1)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:31:47.116036 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f4c59c-f7b1-49eb-9853-bef682728e7b None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:31:47.118825 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e7e41f-34e6-4b5f-9e95-22077eed8248 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:31:47.122196 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a8e9da-6297-49bc-b543-c4cc2b6a6910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:31:47.123126 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a8e9da-6297-49bc-b543-c4cc2b6a6910 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:31:47.123611 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a8e9da-6297-49bc-b543-c4cc2b6a6910 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:31:47.124110 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a8e9da-6297-49bc-b543-c4cc2b6a6910 admin admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:31:47.125066 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a8e9da-6297-49bc-b543-c4cc2b6a6910 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:31:47.125611 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a8e9da-6297-49bc-b543-c4cc2b6a6910 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:31:47.127480 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a8e9da-6297-49bc-b543-c4cc2b6a6910 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:31:47.144478 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2672/5331] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:31:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 21:31:47.145730 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a8e9da-6297-49bc-b543-c4cc2b6a6910 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:31:47.157551 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a8e9da-6297-49bc-b543-c4cc2b6a6910 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:31:47.164659 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae6182a-5ff2-43e7-9aea-dee9a23010ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:31:47.165589 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae6182a-5ff2-43e7-9aea-dee9a23010ac admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:31:47.166207 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae6182a-5ff2-43e7-9aea-dee9a23010ac admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:31:47.166808 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae6182a-5ff2-43e7-9aea-dee9a23010ac admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:31:47.167841 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae6182a-5ff2-43e7-9aea-dee9a23010ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:31:47.170194 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae6182a-5ff2-43e7-9aea-dee9a23010ac admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:31:47.196243 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-73e7e41f-34e6-4b5f-9e95-22077eed8248 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e191bb795f848bf939124faae84add1'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:31:47.197112 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-73e7e41f-34e6-4b5f-9e95-22077eed8248 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e191bb795f848bf939124faae84add1'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:31:47.212506 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-73e7e41f-34e6-4b5f-9e95-22077eed8248 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e191bb795f848bf939124faae84add1'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:31:47.218420 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2673/5332] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:31:47 2022] POST /identity/v3/projects => generated 367 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:31:47.219420 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae6182a-5ff2-43e7-9aea-dee9a23010ac admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:31:47.225630 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-73e7e41f-34e6-4b5f-9e95-22077eed8248 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e191bb795f848bf939124faae84add1'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:31:47.252000 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-73e7e41f-34e6-4b5f-9e95-22077eed8248 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e191bb795f848bf939124faae84add1'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:31:47.272873 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2660/5333] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:31:46 2022] DELETE /identity/v3/users/8e191bb795f848bf939124faae84add1 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:31:47.349902 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae6182a-5ff2-43e7-9aea-dee9a23010ac admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:31:47.479735 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f2e4fc-b066-442e-b428-6c74dcc48cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:31:47.480858 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f2e4fc-b066-442e-b428-6c74dcc48cf0 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:31:47.481201 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f2e4fc-b066-442e-b428-6c74dcc48cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:31:47.481481 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f2e4fc-b066-442e-b428-6c74dcc48cf0 admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:31:47.482231 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f2e4fc-b066-442e-b428-6c74dcc48cf0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:31:47.484582 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f2e4fc-b066-442e-b428-6c74dcc48cf0 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:31:47.518152 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2674/5334] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:31:47 2022] POST /identity/v3/users => generated 284 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:31:47.522093 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e7e41f-34e6-4b5f-9e95-22077eed8248 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:31:47.523556 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-73e7e41f-34e6-4b5f-9e95-22077eed8248 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:31:47.539914 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e7e41f-34e6-4b5f-9e95-22077eed8248 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:31:47.549628 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daefc081-43b6-4dc7-804b-5ae28e2bb1c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:31:47.550475 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daefc081-43b6-4dc7-804b-5ae28e2bb1c4 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:31:47.550979 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daefc081-43b6-4dc7-804b-5ae28e2bb1c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:31:47.551331 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daefc081-43b6-4dc7-804b-5ae28e2bb1c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:31:47.552155 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daefc081-43b6-4dc7-804b-5ae28e2bb1c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:31:47.553889 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daefc081-43b6-4dc7-804b-5ae28e2bb1c4 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:31:47.568538 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2661/5335] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:31:47 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 21:31:47.572823 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f2e4fc-b066-442e-b428-6c74dcc48cf0 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:31:47.583593 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f2e4fc-b066-442e-b428-6c74dcc48cf0 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:31:47.588305 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e932d2-a224-4d40-9499-dca9a088690c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:31:47.588984 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e932d2-a224-4d40-9499-dca9a088690c admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:31:47.589412 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e932d2-a224-4d40-9499-dca9a088690c admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:31:47.589609 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e932d2-a224-4d40-9499-dca9a088690c admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:31:47.590356 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e932d2-a224-4d40-9499-dca9a088690c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:31:47.591996 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e932d2-a224-4d40-9499-dca9a088690c admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:31:47.602367 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2675/5336] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:31:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 21:31:47.606968 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daefc081-43b6-4dc7-804b-5ae28e2bb1c4 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:31:47.617898 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daefc081-43b6-4dc7-804b-5ae28e2bb1c4 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:31:47.623032 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8031edc-b000-4904-8a27-4d70bf2e7fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:31:47.623934 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8031edc-b000-4904-8a27-4d70bf2e7fab admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:31:47.624220 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8031edc-b000-4904-8a27-4d70bf2e7fab admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:31:47.624496 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8031edc-b000-4904-8a27-4d70bf2e7fab admin admin] PATH_INFO: `/v3/projects/a30103c4b81e4b068da15bb8c75c57ee/users/4a93c2d5457047328d2da89eeb77ff72/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:31:47.641647 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8031edc-b000-4904-8a27-4d70bf2e7fab admin admin] RBAC: Authorizing `identity:create_grant(project_id=a30103c4b81e4b068da15bb8c75c57ee, user_id=4a93c2d5457047328d2da89eeb77ff72, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:31:47.644589 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8031edc-b000-4904-8a27-4d70bf2e7fab admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:31:47.659991 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2662/5337] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:31:47 2022] PUT /identity/v3/projects/a30103c4b81e4b068da15bb8c75c57ee/users/4a93c2d5457047328d2da89eeb77ff72/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:31:47.670570 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c1b161-dcd5-491f-87a2-8d53295b20a1 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:31:47.671078 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c1b161-dcd5-491f-87a2-8d53295b20a1 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:31:47.671387 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c1b161-dcd5-491f-87a2-8d53295b20a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:31:47.684726 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:31:47.702794 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-a3c1b161-dcd5-491f-87a2-8d53295b20a1 None None] MFA Rules not processed for user `4a93c2d5457047328d2da89eeb77ff72`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:31:47.704255 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-a3c1b161-dcd5-491f-87a2-8d53295b20a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:31:47.792169 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2676/5338] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:31:47 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:31:47.804406 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8031edc-b000-4904-8a27-4d70bf2e7fab admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:31:47.807083 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-f8031edc-b000-4904-8a27-4d70bf2e7fab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:31:47.827976 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=82,keystone:DELETE=15,keystone:INSERT=3 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:31:47.866825 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c1b161-dcd5-491f-87a2-8d53295b20a1 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:31:47.868909 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-a3c1b161-dcd5-491f-87a2-8d53295b20a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:31:47.922302 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8031edc-b000-4904-8a27-4d70bf2e7fab admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:31:47.927244 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71992fa2-4faa-4a7b-ac41-c8fbec956565 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:31:47.928770 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71992fa2-4faa-4a7b-ac41-c8fbec956565 service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:31:47.929139 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71992fa2-4faa-4a7b-ac41-c8fbec956565 service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:31:47.929594 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71992fa2-4faa-4a7b-ac41-c8fbec956565 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:31:47.942374 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71992fa2-4faa-4a7b-ac41-c8fbec956565 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:31:47.944142 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71992fa2-4faa-4a7b-ac41-c8fbec956565 service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:31:47.958634 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2663/5339] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:31:47 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:31:47.994204 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c1b161-dcd5-491f-87a2-8d53295b20a1 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:31:47.999426 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d5625d-e979-496c-9301-e6b46fdace9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:31:48.000340 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d5625d-e979-496c-9301-e6b46fdace9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:31:48.000624 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d5625d-e979-496c-9301-e6b46fdace9e admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:31:48.000899 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d5625d-e979-496c-9301-e6b46fdace9e admin admin] PATH_INFO: `/v3/projects/866e33e7818341c2b4105db2241ef067` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:31:48.002305 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d5625d-e979-496c-9301-e6b46fdace9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=866e33e7818341c2b4105db2241ef067)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:31:48.004483 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d5625d-e979-496c-9301-e6b46fdace9e admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:31:48.104006 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-b9d5625d-e979-496c-9301-e6b46fdace9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '866e33e7818341c2b4105db2241ef067', 'request_id': 'req-b9d5625d-e979-496c-9301-e6b46fdace9e'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:31:48.118559 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-b9d5625d-e979-496c-9301-e6b46fdace9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '866e33e7818341c2b4105db2241ef067', 'request_id': 'req-b9d5625d-e979-496c-9301-e6b46fdace9e'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:31:48.127346 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-b9d5625d-e979-496c-9301-e6b46fdace9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '866e33e7818341c2b4105db2241ef067', 'request_id': 'req-b9d5625d-e979-496c-9301-e6b46fdace9e'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:31:48.142988 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-b9d5625d-e979-496c-9301-e6b46fdace9e admin admin] The token cache is being invalidate because project 866e33e7818341c2b4105db2241ef067 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:31:48.143346 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-b9d5625d-e979-496c-9301-e6b46fdace9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:31:48.144626 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-b9d5625d-e979-496c-9301-e6b46fdace9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:31:48.150563 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2677/5340] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:31:47 2022] DELETE /identity/v3/projects/866e33e7818341c2b4105db2241ef067 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:31:48.152371 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad1cbe6-56dd-4607-b800-f67e61e7bbd5 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:31:48.152656 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad1cbe6-56dd-4607-b800-f67e61e7bbd5 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:31:48.152929 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad1cbe6-56dd-4607-b800-f67e61e7bbd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:31:48.174581 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-aad1cbe6-56dd-4607-b800-f67e61e7bbd5 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:31:48.176342 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-aad1cbe6-56dd-4607-b800-f67e61e7bbd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:31:48.248793 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2664/5341] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:31:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:31:48.257368 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6236ab17-722f-4945-99f9-6c88f0805462 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:31:48.257767 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6236ab17-722f-4945-99f9-6c88f0805462 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:31:48.258607 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6236ab17-722f-4945-99f9-6c88f0805462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:31:48.279484 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-6236ab17-722f-4945-99f9-6c88f0805462 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:31:48.280413 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-6236ab17-722f-4945-99f9-6c88f0805462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:31:48.289803 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2678/5342] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:31:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:31:48.294376 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad1cbe6-56dd-4607-b800-f67e61e7bbd5 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:31:48.305231 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad1cbe6-56dd-4607-b800-f67e61e7bbd5 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:31:48.311902 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1637c5f-aa54-4176-999d-d08680fa9df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:31:48.312795 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1637c5f-aa54-4176-999d-d08680fa9df7 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:31:48.313244 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1637c5f-aa54-4176-999d-d08680fa9df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:31:48.313847 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1637c5f-aa54-4176-999d-d08680fa9df7 admin admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:31:48.315028 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1637c5f-aa54-4176-999d-d08680fa9df7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:31:48.315489 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1637c5f-aa54-4176-999d-d08680fa9df7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:31:48.317686 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1637c5f-aa54-4176-999d-d08680fa9df7 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:31:48.335006 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2665/5343] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:31:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:31:48.346537 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6236ab17-722f-4945-99f9-6c88f0805462 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:31:48.360972 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6236ab17-722f-4945-99f9-6c88f0805462 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:31:48.365843 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5176f533-0c06-4b1c-8008-c1184fbd62a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:31:48.366606 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5176f533-0c06-4b1c-8008-c1184fbd62a3 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:31:48.366886 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5176f533-0c06-4b1c-8008-c1184fbd62a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:31:48.367251 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5176f533-0c06-4b1c-8008-c1184fbd62a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:31:48.367870 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5176f533-0c06-4b1c-8008-c1184fbd62a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:31:48.370174 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5176f533-0c06-4b1c-8008-c1184fbd62a3 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:31:48.394429 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:31:48.405906 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2679/5344] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:31:48 2022] POST /identity/v3/projects => generated 359 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:31:48.409353 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1637c5f-aa54-4176-999d-d08680fa9df7 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:31:48.424782 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1637c5f-aa54-4176-999d-d08680fa9df7 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:31:48.544792 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce128c3-705f-4c65-8d56-a921c35522de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:31:48.546010 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce128c3-705f-4c65-8d56-a921c35522de admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:31:48.546612 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce128c3-705f-4c65-8d56-a921c35522de admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:31:48.547048 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce128c3-705f-4c65-8d56-a921c35522de admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:31:48.548246 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce128c3-705f-4c65-8d56-a921c35522de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:31:48.551627 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce128c3-705f-4c65-8d56-a921c35522de admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:31:48.584518 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2666/5345] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:31:48 2022] POST /identity/v3/users => generated 280 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:31:48.588559 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5176f533-0c06-4b1c-8008-c1184fbd62a3 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:31:48.604746 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5176f533-0c06-4b1c-8008-c1184fbd62a3 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:31:48.612413 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe5f33d-d259-40a0-a37f-157fcf43214c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:31:48.613095 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe5f33d-d259-40a0-a37f-157fcf43214c admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:31:48.613580 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe5f33d-d259-40a0-a37f-157fcf43214c admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:31:48.613912 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe5f33d-d259-40a0-a37f-157fcf43214c admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:31:48.614681 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe5f33d-d259-40a0-a37f-157fcf43214c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:31:48.616540 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe5f33d-d259-40a0-a37f-157fcf43214c admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:31:48.638315 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce128c3-705f-4c65-8d56-a921c35522de admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:31:48.646518 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2680/5346] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:31:48 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:31:48.650726 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce128c3-705f-4c65-8d56-a921c35522de admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:31:48.657260 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acafc957-a4cf-4185-ac6a-66fcc7ee0159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:31:48.658101 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acafc957-a4cf-4185-ac6a-66fcc7ee0159 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:31:48.658392 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acafc957-a4cf-4185-ac6a-66fcc7ee0159 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:31:48.658667 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acafc957-a4cf-4185-ac6a-66fcc7ee0159 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:31:48.659498 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acafc957-a4cf-4185-ac6a-66fcc7ee0159 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:31:48.661134 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acafc957-a4cf-4185-ac6a-66fcc7ee0159 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:31:48.672910 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2667/5347] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:31:48 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:31:48.677237 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe5f33d-d259-40a0-a37f-157fcf43214c admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:31:48.688207 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe5f33d-d259-40a0-a37f-157fcf43214c admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:31:48.693840 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d98964-e537-48cb-80be-dc722121cf4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:31:48.695469 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d98964-e537-48cb-80be-dc722121cf4a admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:31:48.695756 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d98964-e537-48cb-80be-dc722121cf4a admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:31:48.696153 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d98964-e537-48cb-80be-dc722121cf4a admin admin] PATH_INFO: `/v3/projects/919c8ac55fc14bb6a2e88fbcd1f5f201/users/d2f7afa099084894a49115f286788611/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:31:48.716467 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d98964-e537-48cb-80be-dc722121cf4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=919c8ac55fc14bb6a2e88fbcd1f5f201, user_id=d2f7afa099084894a49115f286788611, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:31:48.719607 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d98964-e537-48cb-80be-dc722121cf4a admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:31:48.739901 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2681/5348] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:31:48 2022] PUT /identity/v3/projects/919c8ac55fc14bb6a2e88fbcd1f5f201/users/d2f7afa099084894a49115f286788611/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:31:48.752657 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0b6766-6bec-4171-8cf0-02fe8849a988 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:31:48.752657 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0b6766-6bec-4171-8cf0-02fe8849a988 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:31:48.752657 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0b6766-6bec-4171-8cf0-02fe8849a988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:31:48.788908 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:31:48.801279 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-cf0b6766-6bec-4171-8cf0-02fe8849a988 None None] MFA Rules not processed for user `d2f7afa099084894a49115f286788611`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:31:48.803354 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-cf0b6766-6bec-4171-8cf0-02fe8849a988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:31:48.908977 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2668/5349] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:31:48 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:31:49.195812 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d98964-e537-48cb-80be-dc722121cf4a admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:31:49.292675 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d98964-e537-48cb-80be-dc722121cf4a admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:31:49.297478 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f87c22-a846-4fe9-a8e7-b64f67bb028e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:31:49.308078 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f87c22-a846-4fe9-a8e7-b64f67bb028e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:31:49.313021 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f87c22-a846-4fe9-a8e7-b64f67bb028e admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:31:49.313484 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f87c22-a846-4fe9-a8e7-b64f67bb028e admin admin] PATH_INFO: `/v3/users/d2f7afa099084894a49115f286788611` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:31:49.316340 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f87c22-a846-4fe9-a8e7-b64f67bb028e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2f7afa099084894a49115f286788611)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:31:49.319961 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f87c22-a846-4fe9-a8e7-b64f67bb028e admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:31:49.416234 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-c8f87c22-a846-4fe9-a8e7-b64f67bb028e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2f7afa099084894a49115f286788611'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:31:49.426249 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-c8f87c22-a846-4fe9-a8e7-b64f67bb028e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2f7afa099084894a49115f286788611'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:31:49.427156 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-c8f87c22-a846-4fe9-a8e7-b64f67bb028e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2f7afa099084894a49115f286788611'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:31:49.438035 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-c8f87c22-a846-4fe9-a8e7-b64f67bb028e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2f7afa099084894a49115f286788611'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:31:49.456076 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-c8f87c22-a846-4fe9-a8e7-b64f67bb028e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2f7afa099084894a49115f286788611'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:31:49.465656 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2682/5350] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:31:49 2022] DELETE /identity/v3/users/d2f7afa099084894a49115f286788611 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:31:49.468955 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fa95fd-b38c-49ae-8c1a-0a8fcea60fbe None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:31:49.469486 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fa95fd-b38c-49ae-8c1a-0a8fcea60fbe None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:31:49.470082 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fa95fd-b38c-49ae-8c1a-0a8fcea60fbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:31:49.508706 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-82fa95fd-b38c-49ae-8c1a-0a8fcea60fbe None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:31:49.509781 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-82fa95fd-b38c-49ae-8c1a-0a8fcea60fbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:31:49.588024 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2669/5351] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:31:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:31:49.627133 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f87c22-a846-4fe9-a8e7-b64f67bb028e admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:31:49.629381 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-c8f87c22-a846-4fe9-a8e7-b64f67bb028e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:31:49.686785 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:31:49.703974 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f87c22-a846-4fe9-a8e7-b64f67bb028e admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:31:49.710401 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a2b816-4bed-4365-8a28-2096a1deb521 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:31:49.711240 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a2b816-4bed-4365-8a28-2096a1deb521 service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:31:49.711790 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a2b816-4bed-4365-8a28-2096a1deb521 service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:31:49.713719 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a2b816-4bed-4365-8a28-2096a1deb521 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:31:49.728709 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a2b816-4bed-4365-8a28-2096a1deb521 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:31:49.732114 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a2b816-4bed-4365-8a28-2096a1deb521 service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:31:49.745340 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2683/5352] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:31:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:31:50.486444 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fa95fd-b38c-49ae-8c1a-0a8fcea60fbe None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:31:50.489805 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-82fa95fd-b38c-49ae-8c1a-0a8fcea60fbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:31:50.553999 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fa95fd-b38c-49ae-8c1a-0a8fcea60fbe None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:31:50.569694 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbab9290-6428-4d52-8087-886a249c2f85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:31:50.570924 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbab9290-6428-4d52-8087-886a249c2f85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:31:50.571357 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbab9290-6428-4d52-8087-886a249c2f85 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:31:50.571822 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbab9290-6428-4d52-8087-886a249c2f85 admin admin] PATH_INFO: `/v3/projects/919c8ac55fc14bb6a2e88fbcd1f5f201` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:31:50.574475 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbab9290-6428-4d52-8087-886a249c2f85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=919c8ac55fc14bb6a2e88fbcd1f5f201)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:31:50.578998 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbab9290-6428-4d52-8087-886a249c2f85 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:31:50.687633 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-cbab9290-6428-4d52-8087-886a249c2f85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '919c8ac55fc14bb6a2e88fbcd1f5f201', 'request_id': 'req-cbab9290-6428-4d52-8087-886a249c2f85'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:31:50.710531 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-cbab9290-6428-4d52-8087-886a249c2f85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '919c8ac55fc14bb6a2e88fbcd1f5f201', 'request_id': 'req-cbab9290-6428-4d52-8087-886a249c2f85'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:31:50.727328 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-cbab9290-6428-4d52-8087-886a249c2f85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '919c8ac55fc14bb6a2e88fbcd1f5f201', 'request_id': 'req-cbab9290-6428-4d52-8087-886a249c2f85'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:31:50.768495 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-cbab9290-6428-4d52-8087-886a249c2f85 admin admin] The token cache is being invalidate because project 919c8ac55fc14bb6a2e88fbcd1f5f201 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:31:50.769108 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-cbab9290-6428-4d52-8087-886a249c2f85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:31:50.770981 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-cbab9290-6428-4d52-8087-886a249c2f85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:31:50.776015 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2670/5353] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:31:50 2022] DELETE /identity/v3/projects/919c8ac55fc14bb6a2e88fbcd1f5f201 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:31:50.781596 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3451a63b-8dc0-4a98-85e0-4b852e9ee20f None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:31:50.785692 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3451a63b-8dc0-4a98-85e0-4b852e9ee20f None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:31:50.786011 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3451a63b-8dc0-4a98-85e0-4b852e9ee20f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:31:50.877666 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-3451a63b-8dc0-4a98-85e0-4b852e9ee20f None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:31:50.879164 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-3451a63b-8dc0-4a98-85e0-4b852e9ee20f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:31:50.970986 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2684/5354] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:31:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:31:50.973083 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bcbf3d-6005-445a-b4da-af4e087ed072 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:31:50.973373 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bcbf3d-6005-445a-b4da-af4e087ed072 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:31:50.973645 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bcbf3d-6005-445a-b4da-af4e087ed072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:31:51.016159 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-43bcbf3d-6005-445a-b4da-af4e087ed072 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:31:51.027125 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-43bcbf3d-6005-445a-b4da-af4e087ed072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:31:51.043044 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2671/5355] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:31:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:31:51.044484 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3451a63b-8dc0-4a98-85e0-4b852e9ee20f None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:31:51.060945 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3451a63b-8dc0-4a98-85e0-4b852e9ee20f None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:31:51.071261 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcac02d-acef-4dfa-a614-269fc051052e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:31:51.072165 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcac02d-acef-4dfa-a614-269fc051052e admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:31:51.072571 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcac02d-acef-4dfa-a614-269fc051052e admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:31:51.073854 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcac02d-acef-4dfa-a614-269fc051052e admin admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:31:51.074840 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcac02d-acef-4dfa-a614-269fc051052e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:31:51.075337 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcac02d-acef-4dfa-a614-269fc051052e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:31:51.077214 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcac02d-acef-4dfa-a614-269fc051052e admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:31:51.095028 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2685/5356] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:31:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:31:51.100178 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bcbf3d-6005-445a-b4da-af4e087ed072 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:31:51.114059 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bcbf3d-6005-445a-b4da-af4e087ed072 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:31:51.119351 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dbf8f0-6069-4055-9d7f-0de74aa9c76c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:31:51.120127 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dbf8f0-6069-4055-9d7f-0de74aa9c76c admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:31:51.120587 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dbf8f0-6069-4055-9d7f-0de74aa9c76c admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:31:51.120929 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dbf8f0-6069-4055-9d7f-0de74aa9c76c admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:31:51.121701 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dbf8f0-6069-4055-9d7f-0de74aa9c76c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:31:51.123848 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dbf8f0-6069-4055-9d7f-0de74aa9c76c admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:31:51.141368 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:31:51.171325 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2672/5357] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:31:51 2022] POST /identity/v3/projects => generated 389 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:31:51.182391 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcac02d-acef-4dfa-a614-269fc051052e admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:31:51.199293 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcac02d-acef-4dfa-a614-269fc051052e admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:31:51.356873 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d47e69-4a19-44e8-92f7-9e254f5d8379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:31:51.357711 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d47e69-4a19-44e8-92f7-9e254f5d8379 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:31:51.358058 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d47e69-4a19-44e8-92f7-9e254f5d8379 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:31:51.358353 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d47e69-4a19-44e8-92f7-9e254f5d8379 admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:31:51.359611 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d47e69-4a19-44e8-92f7-9e254f5d8379 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:31:51.361673 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d47e69-4a19-44e8-92f7-9e254f5d8379 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:31:51.410696 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2686/5358] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:31:51 2022] POST /identity/v3/users => generated 295 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:31:51.416490 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dbf8f0-6069-4055-9d7f-0de74aa9c76c admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:31:51.432536 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dbf8f0-6069-4055-9d7f-0de74aa9c76c admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:31:51.438428 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf22922-44eb-43ea-b46f-5ffffd03e879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:31:51.439207 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf22922-44eb-43ea-b46f-5ffffd03e879 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:31:51.439584 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf22922-44eb-43ea-b46f-5ffffd03e879 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:31:51.439961 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf22922-44eb-43ea-b46f-5ffffd03e879 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:31:51.441004 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf22922-44eb-43ea-b46f-5ffffd03e879 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:31:51.443392 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf22922-44eb-43ea-b46f-5ffffd03e879 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:31:51.457269 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2673/5359] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:31:51 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:31:51.461362 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d47e69-4a19-44e8-92f7-9e254f5d8379 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:31:51.475201 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d47e69-4a19-44e8-92f7-9e254f5d8379 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:31:51.482076 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47cdc7a-4ecc-42c1-a635-6a4536165b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:31:51.483232 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47cdc7a-4ecc-42c1-a635-6a4536165b96 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:31:51.483232 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47cdc7a-4ecc-42c1-a635-6a4536165b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:31:51.483670 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47cdc7a-4ecc-42c1-a635-6a4536165b96 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:31:51.484411 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47cdc7a-4ecc-42c1-a635-6a4536165b96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:31:51.486895 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47cdc7a-4ecc-42c1-a635-6a4536165b96 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:31:51.508575 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2687/5360] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:31:51 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 21:31:51.509463 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf22922-44eb-43ea-b46f-5ffffd03e879 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:31:51.522796 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf22922-44eb-43ea-b46f-5ffffd03e879 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:31:51.529452 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c020d5-b5a0-43a0-8aef-6db7921d90a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:31:51.530560 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c020d5-b5a0-43a0-8aef-6db7921d90a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:31:51.531633 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c020d5-b5a0-43a0-8aef-6db7921d90a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:31:51.531768 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c020d5-b5a0-43a0-8aef-6db7921d90a2 admin admin] PATH_INFO: `/v3/projects/49da2dec096c474199da94d7c7a83258/users/048f5756139b4283b695c057647983ba/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:31:51.568819 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c020d5-b5a0-43a0-8aef-6db7921d90a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49da2dec096c474199da94d7c7a83258, user_id=048f5756139b4283b695c057647983ba, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:31:51.571992 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c020d5-b5a0-43a0-8aef-6db7921d90a2 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:31:51.630943 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2674/5361] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:31:51 2022] PUT /identity/v3/projects/49da2dec096c474199da94d7c7a83258/users/048f5756139b4283b695c057647983ba/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:31:51.636271 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b66989-4eda-4612-ada2-ed171f65d303 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:31:51.636548 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b66989-4eda-4612-ada2-ed171f65d303 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:31:51.636844 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b66989-4eda-4612-ada2-ed171f65d303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:31:51.666809 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-65b66989-4eda-4612-ada2-ed171f65d303 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:31:51.668530 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-65b66989-4eda-4612-ada2-ed171f65d303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:31:51.731568 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:31:51.798613 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2688/5362] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:31:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:31:51.819522 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c020d5-b5a0-43a0-8aef-6db7921d90a2 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:31:51.821700 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-41c020d5-b5a0-43a0-8aef-6db7921d90a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:31:51.956040 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c020d5-b5a0-43a0-8aef-6db7921d90a2 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:31:51.960533 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6a60a7-66ec-48fe-8f4b-dfa0037f27d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:31:51.961219 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6a60a7-66ec-48fe-8f4b-dfa0037f27d6 service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:31:51.961488 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6a60a7-66ec-48fe-8f4b-dfa0037f27d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:31:51.961821 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6a60a7-66ec-48fe-8f4b-dfa0037f27d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:31:51.973483 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6a60a7-66ec-48fe-8f4b-dfa0037f27d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:31:51.975108 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6a60a7-66ec-48fe-8f4b-dfa0037f27d6 service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:31:51.995076 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2675/5363] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:31:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:31:55.597668 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bf3b96-8c96-4926-b833-a7c684333e23 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:31:55.598249 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bf3b96-8c96-4926-b833-a7c684333e23 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:31:55.598249 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bf3b96-8c96-4926-b833-a7c684333e23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:31:55.639334 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-28bf3b96-8c96-4926-b833-a7c684333e23 None None] MFA Rules not processed for user `37b1e260651b4dffa7c1efe8e9d0f144`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:31:55.641474 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-28bf3b96-8c96-4926-b833-a7c684333e23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:31:55.780929 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2689/5364] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:31:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:31:59.503508 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6a60a7-66ec-48fe-8f4b-dfa0037f27d6 service neutron] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:31:59.509960 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-6e6a60a7-66ec-48fe-8f4b-dfa0037f27d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:31:59.524636 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6a60a7-66ec-48fe-8f4b-dfa0037f27d6 service neutron] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:31:59.530701 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22a99b8-be32-49f7-9497-27b6e2e7e2f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:31:59.531886 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22a99b8-be32-49f7-9497-27b6e2e7e2f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:31:59.532469 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22a99b8-be32-49f7-9497-27b6e2e7e2f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:31:59.532895 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22a99b8-be32-49f7-9497-27b6e2e7e2f8 admin admin] PATH_INFO: `/v3/users/d3d6440acdb14f7a8e24fb642f65a919` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:31:59.534355 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22a99b8-be32-49f7-9497-27b6e2e7e2f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3d6440acdb14f7a8e24fb642f65a919)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:31:59.537010 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22a99b8-be32-49f7-9497-27b6e2e7e2f8 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:31:59.612955 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-b22a99b8-be32-49f7-9497-27b6e2e7e2f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3d6440acdb14f7a8e24fb642f65a919'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:31:59.614452 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-b22a99b8-be32-49f7-9497-27b6e2e7e2f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3d6440acdb14f7a8e24fb642f65a919'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:31:59.625223 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-b22a99b8-be32-49f7-9497-27b6e2e7e2f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3d6440acdb14f7a8e24fb642f65a919'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:31:59.642782 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-b22a99b8-be32-49f7-9497-27b6e2e7e2f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3d6440acdb14f7a8e24fb642f65a919'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:31:59.685790 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-b22a99b8-be32-49f7-9497-27b6e2e7e2f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3d6440acdb14f7a8e24fb642f65a919'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:31:59.721708 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2676/5365] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:31:59 2022] DELETE /identity/v3/users/d3d6440acdb14f7a8e24fb642f65a919 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:31:59.723592 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f70cff-db29-4208-9c8b-33254df97c45 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:31:59.724380 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f70cff-db29-4208-9c8b-33254df97c45 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:31:59.724802 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f70cff-db29-4208-9c8b-33254df97c45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:31:59.757162 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-61f70cff-db29-4208-9c8b-33254df97c45 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:31:59.760569 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-61f70cff-db29-4208-9c8b-33254df97c45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:31:59.955774 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2690/5366] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:31:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:31:59.982170 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22a99b8-be32-49f7-9497-27b6e2e7e2f8 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:31:59.984832 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-b22a99b8-be32-49f7-9497-27b6e2e7e2f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:32:00.084755 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:32:00.111229 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22a99b8-be32-49f7-9497-27b6e2e7e2f8 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:32:00.115360 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1615bbdb-58aa-4ce4-b5c5-4962d4076e5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:32:00.115797 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1615bbdb-58aa-4ce4-b5c5-4962d4076e5b service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:32:00.116079 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1615bbdb-58aa-4ce4-b5c5-4962d4076e5b service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:32:00.116493 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1615bbdb-58aa-4ce4-b5c5-4962d4076e5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:32:00.129558 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1615bbdb-58aa-4ce4-b5c5-4962d4076e5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:32:00.131142 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1615bbdb-58aa-4ce4-b5c5-4962d4076e5b service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:32:00.145570 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2677/5367] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:31:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:32:01.179597 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96875eff-ca3a-4a88-8d90-ff43f6ab8722 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:32:01.181441 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96875eff-ca3a-4a88-8d90-ff43f6ab8722 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:32:01.182019 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96875eff-ca3a-4a88-8d90-ff43f6ab8722 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:32:01.196130 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1615bbdb-58aa-4ce4-b5c5-4962d4076e5b service neutron] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:32:01.198241 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-1615bbdb-58aa-4ce4-b5c5-4962d4076e5b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:32:01.228352 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1615bbdb-58aa-4ce4-b5c5-4962d4076e5b service neutron] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:32:01.242865 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64488c62-6332-45f8-a6b6-7c3dd435a932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:32:01.243783 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64488c62-6332-45f8-a6b6-7c3dd435a932 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:32:01.244061 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64488c62-6332-45f8-a6b6-7c3dd435a932 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:32:01.244335 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64488c62-6332-45f8-a6b6-7c3dd435a932 admin admin] PATH_INFO: `/v3/projects/0ffb5a534beb4a4eab7e16c936a22362` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:32:01.246936 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64488c62-6332-45f8-a6b6-7c3dd435a932 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ffb5a534beb4a4eab7e16c936a22362)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:32:01.249747 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64488c62-6332-45f8-a6b6-7c3dd435a932 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:32:01.254096 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-96875eff-ca3a-4a88-8d90-ff43f6ab8722 None None] MFA Rules not processed for user `048f5756139b4283b695c057647983ba`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:32:01.255510 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-96875eff-ca3a-4a88-8d90-ff43f6ab8722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:32:01.379917 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-64488c62-6332-45f8-a6b6-7c3dd435a932 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ffb5a534beb4a4eab7e16c936a22362', 'request_id': 'req-64488c62-6332-45f8-a6b6-7c3dd435a932'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:32:01.402484 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-64488c62-6332-45f8-a6b6-7c3dd435a932 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ffb5a534beb4a4eab7e16c936a22362', 'request_id': 'req-64488c62-6332-45f8-a6b6-7c3dd435a932'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:32:01.446057 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-64488c62-6332-45f8-a6b6-7c3dd435a932 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ffb5a534beb4a4eab7e16c936a22362', 'request_id': 'req-64488c62-6332-45f8-a6b6-7c3dd435a932'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:32:01.466205 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2691/5368] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:32:01 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:32:01.474132 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-64488c62-6332-45f8-a6b6-7c3dd435a932 admin admin] The token cache is being invalidate because project 0ffb5a534beb4a4eab7e16c936a22362 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:32:01.474825 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-64488c62-6332-45f8-a6b6-7c3dd435a932 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:32:01.475956 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-64488c62-6332-45f8-a6b6-7c3dd435a932 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:32:01.478231 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2678/5369] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:32:01 2022] DELETE /identity/v3/projects/0ffb5a534beb4a4eab7e16c936a22362 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:32:01.480808 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96875eff-ca3a-4a88-8d90-ff43f6ab8722 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:32:01.484606 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-96875eff-ca3a-4a88-8d90-ff43f6ab8722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:32:01.491752 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ac53a6-8a3c-4e78-a33f-28731044139f None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:32:01.492041 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ac53a6-8a3c-4e78-a33f-28731044139f None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:32:01.493200 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ac53a6-8a3c-4e78-a33f-28731044139f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:32:01.512348 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:32:01.556559 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-b5ac53a6-8a3c-4e78-a33f-28731044139f None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:32:01.558934 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-b5ac53a6-8a3c-4e78-a33f-28731044139f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:32:01.711921 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2679/5370] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:32:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:32:01.724102 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c68b60-54f4-4f9f-a15b-d7ec2e0a96ee None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:32:01.725784 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c68b60-54f4-4f9f-a15b-d7ec2e0a96ee None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:32:01.726135 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c68b60-54f4-4f9f-a15b-d7ec2e0a96ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:32:01.770058 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96875eff-ca3a-4a88-8d90-ff43f6ab8722 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:32:01.787745 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-20c68b60-54f4-4f9f-a15b-d7ec2e0a96ee None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:32:01.789074 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-20c68b60-54f4-4f9f-a15b-d7ec2e0a96ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:32:01.831513 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2680/5371] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:32:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:32:01.835914 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c68b60-54f4-4f9f-a15b-d7ec2e0a96ee None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:32:01.862321 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c68b60-54f4-4f9f-a15b-d7ec2e0a96ee None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:32:01.879560 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf10006-4428-44f1-979c-4d1b5c691728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:32:01.880249 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf10006-4428-44f1-979c-4d1b5c691728 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:32:01.880528 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf10006-4428-44f1-979c-4d1b5c691728 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:32:01.880799 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf10006-4428-44f1-979c-4d1b5c691728 admin admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:32:01.881533 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf10006-4428-44f1-979c-4d1b5c691728 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:32:01.881830 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf10006-4428-44f1-979c-4d1b5c691728 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:32:01.883472 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf10006-4428-44f1-979c-4d1b5c691728 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:32:01.910460 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a6a4c4-b712-4368-8872-cd9cf507d51a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:32:01.910641 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2681/5372] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:32:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:32:01.911833 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a6a4c4-b712-4368-8872-cd9cf507d51a service nova] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:32:01.912273 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a6a4c4-b712-4368-8872-cd9cf507d51a service nova] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:32:01.912552 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a6a4c4-b712-4368-8872-cd9cf507d51a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:32:01.917733 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf10006-4428-44f1-979c-4d1b5c691728 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:32:01.926738 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-f5a6a4c4-b712-4368-8872-cd9cf507d51a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:32:01.937601 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf10006-4428-44f1-979c-4d1b5c691728 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:32:01.951241 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4818437f-a60c-4de0-8a54-c5f64f8ce1d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:32:01.953490 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4818437f-a60c-4de0-8a54-c5f64f8ce1d1 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:32:01.954023 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4818437f-a60c-4de0-8a54-c5f64f8ce1d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:32:01.954476 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4818437f-a60c-4de0-8a54-c5f64f8ce1d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:32:01.962310 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4818437f-a60c-4de0-8a54-c5f64f8ce1d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:32:01.964600 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4818437f-a60c-4de0-8a54-c5f64f8ce1d1 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:32:02.028844 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2682/5373] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:32:01 2022] POST /identity/v3/projects => generated 377 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:32:02.033118 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4818437f-a60c-4de0-8a54-c5f64f8ce1d1 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:32:02.091437 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:32:02.119954 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a6a4c4-b712-4368-8872-cd9cf507d51a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:32:02.123123 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a6a4c4-b712-4368-8872-cd9cf507d51a service nova] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:32:02.147870 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2692/5374] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:32:01 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 668 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:32:02.224356 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4818437f-a60c-4de0-8a54-c5f64f8ce1d1 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:32:02.238024 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9106b26c-3106-4a3d-bd40-c8ab680554e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:32:02.238931 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9106b26c-3106-4a3d-bd40-c8ab680554e9 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:32:02.239685 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9106b26c-3106-4a3d-bd40-c8ab680554e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:32:02.248706 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9106b26c-3106-4a3d-bd40-c8ab680554e9 admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:32:02.256167 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9106b26c-3106-4a3d-bd40-c8ab680554e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:32:02.259143 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9106b26c-3106-4a3d-bd40-c8ab680554e9 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:32:02.313797 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2683/5375] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:32:02 2022] POST /identity/v3/users => generated 289 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:32:02.314902 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a6a4c4-b712-4368-8872-cd9cf507d51a service nova] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:32:02.344301 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a6a4c4-b712-4368-8872-cd9cf507d51a service nova] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:32:02.356879 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be62cff-d8da-48d3-be47-88391a90c308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:32:02.359014 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be62cff-d8da-48d3-be47-88391a90c308 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:32:02.361086 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be62cff-d8da-48d3-be47-88391a90c308 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:32:02.362139 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be62cff-d8da-48d3-be47-88391a90c308 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:32:02.364302 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be62cff-d8da-48d3-be47-88391a90c308 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:32:02.366962 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be62cff-d8da-48d3-be47-88391a90c308 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:32:02.384303 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2693/5376] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:32:02 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:32:02.389715 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9106b26c-3106-4a3d-bd40-c8ab680554e9 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:32:02.402556 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd90a37f-c8bf-4044-ace5-a0e64ea7c6e5 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:32:02.406370 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9106b26c-3106-4a3d-bd40-c8ab680554e9 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:32:02.407104 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd90a37f-c8bf-4044-ace5-a0e64ea7c6e5 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:32:02.407458 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd90a37f-c8bf-4044-ace5-a0e64ea7c6e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:32:02.422163 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1827e778-343b-41ae-b54f-6c9962f3a2ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:32:02.422882 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1827e778-343b-41ae-b54f-6c9962f3a2ef admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:32:02.423159 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1827e778-343b-41ae-b54f-6c9962f3a2ef admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:32:02.424076 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1827e778-343b-41ae-b54f-6c9962f3a2ef admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:32:02.424818 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1827e778-343b-41ae-b54f-6c9962f3a2ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:32:02.426608 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1827e778-343b-41ae-b54f-6c9962f3a2ef admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:32:02.432067 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:32:02.443277 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2684/5377] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:32:02 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:32:02.448237 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1827e778-343b-41ae-b54f-6c9962f3a2ef admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:32:02.467981 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1827e778-343b-41ae-b54f-6c9962f3a2ef admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:32:02.471673 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-cd90a37f-c8bf-4044-ace5-a0e64ea7c6e5 None None] MFA Rules not processed for user `17b779a3e21a415bb42cde5d6863d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:32:02.473186 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-cd90a37f-c8bf-4044-ace5-a0e64ea7c6e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:32:02.478743 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc738ec3-8f13-4873-8148-4eea2b6c5d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:32:02.484091 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc738ec3-8f13-4873-8148-4eea2b6c5d94 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:32:02.485187 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc738ec3-8f13-4873-8148-4eea2b6c5d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:32:02.486228 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc738ec3-8f13-4873-8148-4eea2b6c5d94 admin admin] PATH_INFO: `/v3/projects/6bc1475019924837a8be47347f6bbd75/users/bc4aa131e63349b2aa8f37fdf6d2fe00/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:32:02.516866 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc738ec3-8f13-4873-8148-4eea2b6c5d94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bc1475019924837a8be47347f6bbd75, user_id=bc4aa131e63349b2aa8f37fdf6d2fe00, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:32:02.521202 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc738ec3-8f13-4873-8148-4eea2b6c5d94 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:32:02.547994 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2685/5378] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:32:02 2022] PUT /identity/v3/projects/6bc1475019924837a8be47347f6bbd75/users/bc4aa131e63349b2aa8f37fdf6d2fe00/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:32:02.549743 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2ae43b-2dd4-457f-af39-a53f3fddd472 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:32:02.550166 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2ae43b-2dd4-457f-af39-a53f3fddd472 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:32:02.550534 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2ae43b-2dd4-457f-af39-a53f3fddd472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:32:02.575583 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-cc2ae43b-2dd4-457f-af39-a53f3fddd472 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:32:02.577327 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-cc2ae43b-2dd4-457f-af39-a53f3fddd472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:32:02.586013 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2694/5379] 10.222.0.17 () {58 vars in 1009 bytes} [Sat Jul 23 21:32:02 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:32:02.655029 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd90a37f-c8bf-4044-ace5-a0e64ea7c6e5 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:32:02.656803 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-cd90a37f-c8bf-4044-ace5-a0e64ea7c6e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:32:02.752856 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2686/5380] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:32:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:32:02.772402 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2ae43b-2dd4-457f-af39-a53f3fddd472 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:32:02.778127 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-cc2ae43b-2dd4-457f-af39-a53f3fddd472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:32:02.846822 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd90a37f-c8bf-4044-ace5-a0e64ea7c6e5 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:32:02.928393 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2ae43b-2dd4-457f-af39-a53f3fddd472 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:32:02.934209 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f853dff8-c86e-4d3f-b455-14cb0bac0d72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:32:02.934896 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f853dff8-c86e-4d3f-b455-14cb0bac0d72 service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:32:02.935290 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f853dff8-c86e-4d3f-b455-14cb0bac0d72 service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:32:02.935841 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f853dff8-c86e-4d3f-b455-14cb0bac0d72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:32:02.947279 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f853dff8-c86e-4d3f-b455-14cb0bac0d72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:32:02.949130 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f853dff8-c86e-4d3f-b455-14cb0bac0d72 service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:32:02.963051 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2687/5381] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:32:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:32:02.967866 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea28c167-559e-47d6-8460-e20aade74d44 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f0a685b7da46afb81024848f079d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:32:02.968564 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea28c167-559e-47d6-8460-e20aade74d44 service swift] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:32:02.969246 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea28c167-559e-47d6-8460-e20aade74d44 service swift] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:32:02.969531 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea28c167-559e-47d6-8460-e20aade74d44 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:32:03.040397 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:32:03.056471 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea28c167-559e-47d6-8460-e20aade74d44 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:32:03.059593 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea28c167-559e-47d6-8460-e20aade74d44 service swift] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:32:03.074181 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2695/5382] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 23 21:32:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 23 21:32:06.566406 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f853dff8-c86e-4d3f-b455-14cb0bac0d72 service neutron] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:32:06.568382 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-f853dff8-c86e-4d3f-b455-14cb0bac0d72 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:32:06.619251 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f853dff8-c86e-4d3f-b455-14cb0bac0d72 service neutron] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:32:06.641532 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0913c9-5a62-48ac-919e-9fcc0bcf892f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:32:06.642528 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0913c9-5a62-48ac-919e-9fcc0bcf892f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:32:06.642805 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0913c9-5a62-48ac-919e-9fcc0bcf892f admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:32:06.643081 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0913c9-5a62-48ac-919e-9fcc0bcf892f admin admin] PATH_INFO: `/v3/users/4a93c2d5457047328d2da89eeb77ff72` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:32:06.645801 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0913c9-5a62-48ac-919e-9fcc0bcf892f admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a93c2d5457047328d2da89eeb77ff72)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:32:06.647862 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0913c9-5a62-48ac-919e-9fcc0bcf892f admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:32:06.692821 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:32:06.789631 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-af0913c9-5a62-48ac-919e-9fcc0bcf892f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a93c2d5457047328d2da89eeb77ff72'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:32:06.790999 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-af0913c9-5a62-48ac-919e-9fcc0bcf892f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a93c2d5457047328d2da89eeb77ff72'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:32:06.809508 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-af0913c9-5a62-48ac-919e-9fcc0bcf892f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a93c2d5457047328d2da89eeb77ff72'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:32:06.822813 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-af0913c9-5a62-48ac-919e-9fcc0bcf892f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a93c2d5457047328d2da89eeb77ff72'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:32:06.855688 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-af0913c9-5a62-48ac-919e-9fcc0bcf892f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a93c2d5457047328d2da89eeb77ff72'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:32:06.868943 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2688/5383] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:32:06 2022] DELETE /identity/v3/users/4a93c2d5457047328d2da89eeb77ff72 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:32:06.870305 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa84b5f4-7d6c-4119-8fd9-c31b03094c33 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:32:06.880971 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa84b5f4-7d6c-4119-8fd9-c31b03094c33 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:32:06.881293 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa84b5f4-7d6c-4119-8fd9-c31b03094c33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:32:06.930041 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-fa84b5f4-7d6c-4119-8fd9-c31b03094c33 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:32:06.931312 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-fa84b5f4-7d6c-4119-8fd9-c31b03094c33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:32:07.133335 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2696/5384] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:32:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:32:07.164075 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0913c9-5a62-48ac-919e-9fcc0bcf892f admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:32:07.166225 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-af0913c9-5a62-48ac-919e-9fcc0bcf892f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:32:07.350985 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0913c9-5a62-48ac-919e-9fcc0bcf892f admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:32:07.361684 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a798316-716b-4061-8190-f237507c0e9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:32:07.362398 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a798316-716b-4061-8190-f237507c0e9c service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:32:07.362680 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a798316-716b-4061-8190-f237507c0e9c service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:32:07.362950 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a798316-716b-4061-8190-f237507c0e9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:32:07.396976 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a798316-716b-4061-8190-f237507c0e9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:32:07.398590 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a798316-716b-4061-8190-f237507c0e9c service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:32:07.421835 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2689/5385] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:32:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 23 21:32:07.845717 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa84b5f4-7d6c-4119-8fd9-c31b03094c33 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:32:07.847262 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-fa84b5f4-7d6c-4119-8fd9-c31b03094c33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:32:07.875882 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa84b5f4-7d6c-4119-8fd9-c31b03094c33 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:32:07.893038 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047c1140-48de-47f6-bec6-d30ec60404b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:32:07.894116 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047c1140-48de-47f6-bec6-d30ec60404b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:32:07.894340 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047c1140-48de-47f6-bec6-d30ec60404b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:32:07.894615 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047c1140-48de-47f6-bec6-d30ec60404b5 admin admin] PATH_INFO: `/v3/projects/a30103c4b81e4b068da15bb8c75c57ee` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:32:07.896061 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047c1140-48de-47f6-bec6-d30ec60404b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a30103c4b81e4b068da15bb8c75c57ee)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:32:07.901372 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047c1140-48de-47f6-bec6-d30ec60404b5 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:32:07.995501 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-047c1140-48de-47f6-bec6-d30ec60404b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a30103c4b81e4b068da15bb8c75c57ee', 'request_id': 'req-047c1140-48de-47f6-bec6-d30ec60404b5'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:32:08.018003 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-047c1140-48de-47f6-bec6-d30ec60404b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a30103c4b81e4b068da15bb8c75c57ee', 'request_id': 'req-047c1140-48de-47f6-bec6-d30ec60404b5'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:32:08.028765 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-047c1140-48de-47f6-bec6-d30ec60404b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a30103c4b81e4b068da15bb8c75c57ee', 'request_id': 'req-047c1140-48de-47f6-bec6-d30ec60404b5'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:32:08.063481 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-047c1140-48de-47f6-bec6-d30ec60404b5 admin admin] The token cache is being invalidate because project a30103c4b81e4b068da15bb8c75c57ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:32:08.064160 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-047c1140-48de-47f6-bec6-d30ec60404b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:32:08.065212 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-047c1140-48de-47f6-bec6-d30ec60404b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:32:08.070981 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2697/5386] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:32:07 2022] DELETE /identity/v3/projects/a30103c4b81e4b068da15bb8c75c57ee => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:32:08.073967 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef8b3ee-e3b6-4d78-ba2f-5af33c4db59a None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:32:08.074528 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef8b3ee-e3b6-4d78-ba2f-5af33c4db59a None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:32:08.074640 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef8b3ee-e3b6-4d78-ba2f-5af33c4db59a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:32:08.113511 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-8ef8b3ee-e3b6-4d78-ba2f-5af33c4db59a None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:32:08.116665 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-8ef8b3ee-e3b6-4d78-ba2f-5af33c4db59a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:32:08.222963 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2690/5387] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:32:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:32:08.230768 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9335395-d80c-4b1e-86e6-ec7ba73c79c8 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:32:08.231055 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9335395-d80c-4b1e-86e6-ec7ba73c79c8 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:32:08.231334 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9335395-d80c-4b1e-86e6-ec7ba73c79c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:32:08.260270 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-e9335395-d80c-4b1e-86e6-ec7ba73c79c8 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:32:08.262268 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-e9335395-d80c-4b1e-86e6-ec7ba73c79c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:32:08.271964 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2698/5388] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:32:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:32:08.278645 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef8b3ee-e3b6-4d78-ba2f-5af33c4db59a None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:32:08.291135 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef8b3ee-e3b6-4d78-ba2f-5af33c4db59a None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:32:08.313220 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f90b098-4eaf-404b-ba5a-a9c9a8291b7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:32:08.313980 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f90b098-4eaf-404b-ba5a-a9c9a8291b7a admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:32:08.314303 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f90b098-4eaf-404b-ba5a-a9c9a8291b7a admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:32:08.314587 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f90b098-4eaf-404b-ba5a-a9c9a8291b7a admin admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:32:08.315334 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f90b098-4eaf-404b-ba5a-a9c9a8291b7a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:32:08.315640 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f90b098-4eaf-404b-ba5a-a9c9a8291b7a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:32:08.317297 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f90b098-4eaf-404b-ba5a-a9c9a8291b7a admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:32:08.334199 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2691/5389] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:32:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:32:08.337171 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9335395-d80c-4b1e-86e6-ec7ba73c79c8 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:32:08.365817 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9335395-d80c-4b1e-86e6-ec7ba73c79c8 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:32:08.376459 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cbe855-81a7-46ea-ace2-9a7cfbfbac15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:32:08.378857 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cbe855-81a7-46ea-ace2-9a7cfbfbac15 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:32:08.379852 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cbe855-81a7-46ea-ace2-9a7cfbfbac15 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:32:08.380349 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cbe855-81a7-46ea-ace2-9a7cfbfbac15 admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:32:08.381273 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cbe855-81a7-46ea-ace2-9a7cfbfbac15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:32:08.383447 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cbe855-81a7-46ea-ace2-9a7cfbfbac15 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:32:08.432798 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2699/5390] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:32:08 2022] POST /identity/v3/projects => generated 361 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:32:08.433018 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f90b098-4eaf-404b-ba5a-a9c9a8291b7a admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:32:08.449109 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f90b098-4eaf-404b-ba5a-a9c9a8291b7a admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:32:08.502516 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed141fcd-f1b8-49d0-818e-d37a72972a31 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:32:08.502817 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed141fcd-f1b8-49d0-818e-d37a72972a31 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:32:08.503078 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed141fcd-f1b8-49d0-818e-d37a72972a31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:32:08.505249 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:32:08.529662 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-ed141fcd-f1b8-49d0-818e-d37a72972a31 None None] MFA Rules not processed for user `048f5756139b4283b695c057647983ba`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:32:08.530939 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-ed141fcd-f1b8-49d0-818e-d37a72972a31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:32:08.580829 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76b78b4-5444-47b9-a3cf-b1c752e74ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:32:08.587906 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76b78b4-5444-47b9-a3cf-b1c752e74ee3 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:32:08.588827 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76b78b4-5444-47b9-a3cf-b1c752e74ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:32:08.588952 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76b78b4-5444-47b9-a3cf-b1c752e74ee3 admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:32:08.589704 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76b78b4-5444-47b9-a3cf-b1c752e74ee3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:32:08.597525 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76b78b4-5444-47b9-a3cf-b1c752e74ee3 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:32:08.630993 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:32:08.649335 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2692/5391] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:32:08 2022] POST /identity/v3/users => generated 281 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:32:08.651223 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76b78b4-5444-47b9-a3cf-b1c752e74ee3 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:32:08.669986 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76b78b4-5444-47b9-a3cf-b1c752e74ee3 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:32:08.671211 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2700/5392] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:32:08 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:32:08.677130 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f278ea1-c97a-4fc1-bfec-0b4877f478b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:32:08.677976 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f278ea1-c97a-4fc1-bfec-0b4877f478b6 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:32:08.678383 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f278ea1-c97a-4fc1-bfec-0b4877f478b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:32:08.678829 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f278ea1-c97a-4fc1-bfec-0b4877f478b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:32:08.679963 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f278ea1-c97a-4fc1-bfec-0b4877f478b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:32:08.682409 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f278ea1-c97a-4fc1-bfec-0b4877f478b6 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:32:08.735377 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2693/5393] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:32:08 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:32:08.737419 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed141fcd-f1b8-49d0-818e-d37a72972a31 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:32:08.770648 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed141fcd-f1b8-49d0-818e-d37a72972a31 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:32:08.781562 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0db0e1-1f11-4fcd-8114-b4df51bf06da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:32:08.803648 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0db0e1-1f11-4fcd-8114-b4df51bf06da admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:32:08.804383 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0db0e1-1f11-4fcd-8114-b4df51bf06da admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:32:08.806410 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0db0e1-1f11-4fcd-8114-b4df51bf06da admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:32:08.812770 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0db0e1-1f11-4fcd-8114-b4df51bf06da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:32:08.825411 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0db0e1-1f11-4fcd-8114-b4df51bf06da admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:32:08.890058 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2701/5394] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:32:08 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:32:08.892326 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f278ea1-c97a-4fc1-bfec-0b4877f478b6 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:32:08.911743 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f278ea1-c97a-4fc1-bfec-0b4877f478b6 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:32:08.924608 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4f1030-2fde-413e-b093-7c05a97b39eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:32:08.925584 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4f1030-2fde-413e-b093-7c05a97b39eb admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:32:08.925959 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4f1030-2fde-413e-b093-7c05a97b39eb admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:32:08.926167 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4f1030-2fde-413e-b093-7c05a97b39eb admin admin] PATH_INFO: `/v3/projects/2e49f5dc9c5e487aa5d9f797cfbe17e0/users/2f99016437d241b086147206d2df7ce9/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:32:08.962821 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4f1030-2fde-413e-b093-7c05a97b39eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e49f5dc9c5e487aa5d9f797cfbe17e0, user_id=2f99016437d241b086147206d2df7ce9, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:32:08.971976 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4f1030-2fde-413e-b093-7c05a97b39eb admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:32:09.001017 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2694/5395] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:32:08 2022] PUT /identity/v3/projects/2e49f5dc9c5e487aa5d9f797cfbe17e0/users/2f99016437d241b086147206d2df7ce9/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:32:09.012527 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d213f993-506f-4cc9-a5b8-daaee1ac80e1 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:32:09.012672 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d213f993-506f-4cc9-a5b8-daaee1ac80e1 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:32:09.012913 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d213f993-506f-4cc9-a5b8-daaee1ac80e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:32:09.077961 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-d213f993-506f-4cc9-a5b8-daaee1ac80e1 None None] MFA Rules not processed for user `2f99016437d241b086147206d2df7ce9`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:32:09.079333 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-d213f993-506f-4cc9-a5b8-daaee1ac80e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:32:09.377193 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2702/5396] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:32:09 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 366 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:32:09.397799 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4f1030-2fde-413e-b093-7c05a97b39eb admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:32:09.399694 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-0a4f1030-2fde-413e-b093-7c05a97b39eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:32:09.550569 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4f1030-2fde-413e-b093-7c05a97b39eb admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:32:09.556592 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0532cc4f-584e-47b8-90af-59e7bdacdc76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:32:09.557730 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0532cc4f-584e-47b8-90af-59e7bdacdc76 service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:32:09.558251 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0532cc4f-584e-47b8-90af-59e7bdacdc76 service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:32:09.558753 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0532cc4f-584e-47b8-90af-59e7bdacdc76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:32:09.569811 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0532cc4f-584e-47b8-90af-59e7bdacdc76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:32:09.571727 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0532cc4f-584e-47b8-90af-59e7bdacdc76 service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:32:09.583274 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2695/5397] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:32:09 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:32:15.046931 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab37c7ba-eb33-4b87-b5bc-742ac537ecbd None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:32:15.047513 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab37c7ba-eb33-4b87-b5bc-742ac537ecbd None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:32:15.047513 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab37c7ba-eb33-4b87-b5bc-742ac537ecbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:32:15.121688 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-ab37c7ba-eb33-4b87-b5bc-742ac537ecbd None None] MFA Rules not processed for user `bc4aa131e63349b2aa8f37fdf6d2fe00`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:32:15.122996 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-ab37c7ba-eb33-4b87-b5bc-742ac537ecbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:32:15.312920 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2703/5398] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:32:15 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:32:15.325359 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0532cc4f-584e-47b8-90af-59e7bdacdc76 service neutron] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:32:15.330662 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-0532cc4f-584e-47b8-90af-59e7bdacdc76 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:32:15.514796 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0532cc4f-584e-47b8-90af-59e7bdacdc76 service neutron] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:32:15.525839 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53c09a8-094c-4b28-9e20-43be91da98d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:32:15.526859 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53c09a8-094c-4b28-9e20-43be91da98d9 service nova] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:32:15.527390 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53c09a8-094c-4b28-9e20-43be91da98d9 service nova] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:32:15.527816 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53c09a8-094c-4b28-9e20-43be91da98d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:32:15.544315 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53c09a8-094c-4b28-9e20-43be91da98d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:32:15.548840 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53c09a8-094c-4b28-9e20-43be91da98d9 service nova] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:32:15.560132 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2696/5399] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:32:15 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:32:20.467761 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001035d2-bc0d-4983-926f-448c43c11689 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:32:20.467761 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001035d2-bc0d-4983-926f-448c43c11689 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:32:20.468885 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001035d2-bc0d-4983-926f-448c43c11689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:32:20.503863 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-001035d2-bc0d-4983-926f-448c43c11689 None None] MFA Rules not processed for user `bc4aa131e63349b2aa8f37fdf6d2fe00`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:32:20.505313 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-001035d2-bc0d-4983-926f-448c43c11689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:32:20.515750 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2704/5400] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:32:20 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:32:25.560255 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=95,keystone:INSERT=4 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:32:30.494916 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=77 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:32:31.434194 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88b8f27-ad2a-47ef-8696-0c4e26cb4493 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:32:31.434664 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88b8f27-ad2a-47ef-8696-0c4e26cb4493 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:32:31.434664 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88b8f27-ad2a-47ef-8696-0c4e26cb4493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:32:31.459406 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-a88b8f27-ad2a-47ef-8696-0c4e26cb4493 None None] MFA Rules not processed for user `0bd49331138a4dbc912bc7bf6f6b0215`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:32:31.461174 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-a88b8f27-ad2a-47ef-8696-0c4e26cb4493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:32:31.566786 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2697/5401] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:32:31 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:32:33.795938 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001035d2-bc0d-4983-926f-448c43c11689 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:32:33.798155 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-001035d2-bc0d-4983-926f-448c43c11689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:32:34.024871 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001035d2-bc0d-4983-926f-448c43c11689 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:32:34.035814 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640bf5fc-c393-4364-8a5f-075468cbc26d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7f2db148c8e4d5d81431cae3576434b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:32:34.037158 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640bf5fc-c393-4364-8a5f-075468cbc26d service glance] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:32:34.038797 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640bf5fc-c393-4364-8a5f-075468cbc26d service glance] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:32:34.039000 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640bf5fc-c393-4364-8a5f-075468cbc26d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:32:34.054679 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-640bf5fc-c393-4364-8a5f-075468cbc26d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:32:34.091661 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640bf5fc-c393-4364-8a5f-075468cbc26d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:32:34.093143 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640bf5fc-c393-4364-8a5f-075468cbc26d service glance] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:32:34.125685 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2705/5402] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:32:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:32:34.327639 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88b8f27-ad2a-47ef-8696-0c4e26cb4493 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:32:34.343593 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88b8f27-ad2a-47ef-8696-0c4e26cb4493 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:32:34.351291 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6138f88c-947f-4cf8-a06d-5cbdf21087f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:32:34.352080 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6138f88c-947f-4cf8-a06d-5cbdf21087f1 service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:32:34.352436 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6138f88c-947f-4cf8-a06d-5cbdf21087f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:32:34.352785 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6138f88c-947f-4cf8-a06d-5cbdf21087f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:32:34.356834 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-6138f88c-947f-4cf8-a06d-5cbdf21087f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:32:34.387596 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6138f88c-947f-4cf8-a06d-5cbdf21087f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:32:34.389434 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6138f88c-947f-4cf8-a06d-5cbdf21087f1 service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:32:34.402938 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2698/5403] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:32:34 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:32:34.526809 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640bf5fc-c393-4364-8a5f-075468cbc26d service glance] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:32:34.548653 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640bf5fc-c393-4364-8a5f-075468cbc26d service glance] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:32:34.557012 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117f613a-39e7-4ddb-9813-727296573b45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:32:34.557012 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117f613a-39e7-4ddb-9813-727296573b45 service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:32:34.557012 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117f613a-39e7-4ddb-9813-727296573b45 service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:32:34.557012 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117f613a-39e7-4ddb-9813-727296573b45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:32:34.558330 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-117f613a-39e7-4ddb-9813-727296573b45 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:32:34.582714 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117f613a-39e7-4ddb-9813-727296573b45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:32:34.584869 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117f613a-39e7-4ddb-9813-727296573b45 service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:32:34.602212 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2706/5404] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:32:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:32:35.923796 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6138f88c-947f-4cf8-a06d-5cbdf21087f1 service neutron] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:32:36.024426 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6138f88c-947f-4cf8-a06d-5cbdf21087f1 service neutron] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:32:36.030513 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4105dae2-4a76-4eca-9492-cacd1d70d4be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:32:36.031540 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4105dae2-4a76-4eca-9492-cacd1d70d4be admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:32:36.031965 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4105dae2-4a76-4eca-9492-cacd1d70d4be admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:32:36.032339 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4105dae2-4a76-4eca-9492-cacd1d70d4be admin admin] PATH_INFO: `/v3/users/2f99016437d241b086147206d2df7ce9` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:32:36.033915 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4105dae2-4a76-4eca-9492-cacd1d70d4be admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f99016437d241b086147206d2df7ce9)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:32:36.036021 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4105dae2-4a76-4eca-9492-cacd1d70d4be admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:32:36.092372 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-4105dae2-4a76-4eca-9492-cacd1d70d4be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f99016437d241b086147206d2df7ce9'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:32:36.093027 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-4105dae2-4a76-4eca-9492-cacd1d70d4be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f99016437d241b086147206d2df7ce9'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:32:36.108496 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-4105dae2-4a76-4eca-9492-cacd1d70d4be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f99016437d241b086147206d2df7ce9'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:32:36.120819 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-4105dae2-4a76-4eca-9492-cacd1d70d4be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f99016437d241b086147206d2df7ce9'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:32:36.149233 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-4105dae2-4a76-4eca-9492-cacd1d70d4be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f99016437d241b086147206d2df7ce9'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:32:36.183038 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2699/5405] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:32:35 2022] DELETE /identity/v3/users/2f99016437d241b086147206d2df7ce9 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:32:36.190053 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e1383c-eb8f-42a2-b92c-bb7d51fa195d None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:32:36.191461 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e1383c-eb8f-42a2-b92c-bb7d51fa195d None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:32:36.192409 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e1383c-eb8f-42a2-b92c-bb7d51fa195d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:32:36.235514 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-b4e1383c-eb8f-42a2-b92c-bb7d51fa195d None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:32:36.237140 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-b4e1383c-eb8f-42a2-b92c-bb7d51fa195d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:32:36.319471 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2707/5406] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:32:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:32:36.342099 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4105dae2-4a76-4eca-9492-cacd1d70d4be admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:32:36.343863 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-4105dae2-4a76-4eca-9492-cacd1d70d4be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:32:36.364899 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:32:36.429238 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4105dae2-4a76-4eca-9492-cacd1d70d4be admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:32:36.433459 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6d5d76-1520-413c-ba94-f7c82c682e5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:32:36.434173 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6d5d76-1520-413c-ba94-f7c82c682e5c service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:32:36.434457 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6d5d76-1520-413c-ba94-f7c82c682e5c service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:32:36.434733 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6d5d76-1520-413c-ba94-f7c82c682e5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:32:36.445167 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6d5d76-1520-413c-ba94-f7c82c682e5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:32:36.446656 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6d5d76-1520-413c-ba94-f7c82c682e5c service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:32:36.456984 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2700/5407] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:32:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:32:37.047553 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e1383c-eb8f-42a2-b92c-bb7d51fa195d None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:32:37.049703 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-b4e1383c-eb8f-42a2-b92c-bb7d51fa195d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:32:37.073013 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e1383c-eb8f-42a2-b92c-bb7d51fa195d None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:32:37.104042 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90995e10-a28e-465c-bc56-5bcbbe80f145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:32:37.105155 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90995e10-a28e-465c-bc56-5bcbbe80f145 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:32:37.108151 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90995e10-a28e-465c-bc56-5bcbbe80f145 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:32:37.118307 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90995e10-a28e-465c-bc56-5bcbbe80f145 admin admin] PATH_INFO: `/v3/projects/2e49f5dc9c5e487aa5d9f797cfbe17e0` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:32:37.118307 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90995e10-a28e-465c-bc56-5bcbbe80f145 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e49f5dc9c5e487aa5d9f797cfbe17e0)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:32:37.121709 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90995e10-a28e-465c-bc56-5bcbbe80f145 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:32:37.210588 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-90995e10-a28e-465c-bc56-5bcbbe80f145 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e49f5dc9c5e487aa5d9f797cfbe17e0', 'request_id': 'req-90995e10-a28e-465c-bc56-5bcbbe80f145'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:32:37.219563 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-90995e10-a28e-465c-bc56-5bcbbe80f145 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e49f5dc9c5e487aa5d9f797cfbe17e0', 'request_id': 'req-90995e10-a28e-465c-bc56-5bcbbe80f145'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:32:37.226602 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-90995e10-a28e-465c-bc56-5bcbbe80f145 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e49f5dc9c5e487aa5d9f797cfbe17e0', 'request_id': 'req-90995e10-a28e-465c-bc56-5bcbbe80f145'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:32:37.239387 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-90995e10-a28e-465c-bc56-5bcbbe80f145 admin admin] The token cache is being invalidate because project 2e49f5dc9c5e487aa5d9f797cfbe17e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:32:37.239674 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-90995e10-a28e-465c-bc56-5bcbbe80f145 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:32:37.240674 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-90995e10-a28e-465c-bc56-5bcbbe80f145 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:32:37.241976 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2708/5408] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:32:37 2022] DELETE /identity/v3/projects/2e49f5dc9c5e487aa5d9f797cfbe17e0 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:32:37.247166 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1377f50-ae33-49c6-98fc-5c7abc28136d None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:32:37.248116 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1377f50-ae33-49c6-98fc-5c7abc28136d None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:32:37.248573 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1377f50-ae33-49c6-98fc-5c7abc28136d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:32:37.268438 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-d1377f50-ae33-49c6-98fc-5c7abc28136d None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:32:37.270070 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-d1377f50-ae33-49c6-98fc-5c7abc28136d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:32:37.345048 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2701/5409] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:32:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:32:37.347070 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c45369d-02aa-4e77-b637-b0d376132a82 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:32:37.347628 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c45369d-02aa-4e77-b637-b0d376132a82 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:32:37.348122 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c45369d-02aa-4e77-b637-b0d376132a82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:32:37.375680 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-1c45369d-02aa-4e77-b637-b0d376132a82 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:32:37.378123 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-1c45369d-02aa-4e77-b637-b0d376132a82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:32:37.391324 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2709/5410] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:32:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:32:37.395628 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1377f50-ae33-49c6-98fc-5c7abc28136d None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:32:37.412058 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1377f50-ae33-49c6-98fc-5c7abc28136d None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:32:37.421023 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175d8f8e-aa52-4d52-8c77-237b20367563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:32:37.423185 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175d8f8e-aa52-4d52-8c77-237b20367563 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:32:37.424108 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175d8f8e-aa52-4d52-8c77-237b20367563 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:32:37.424724 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175d8f8e-aa52-4d52-8c77-237b20367563 admin admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:32:37.426389 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175d8f8e-aa52-4d52-8c77-237b20367563 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:32:37.427500 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175d8f8e-aa52-4d52-8c77-237b20367563 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:32:37.429360 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175d8f8e-aa52-4d52-8c77-237b20367563 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:32:37.449849 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2702/5411] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:32:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 21:32:37.454096 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c45369d-02aa-4e77-b637-b0d376132a82 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:32:37.470620 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c45369d-02aa-4e77-b637-b0d376132a82 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:32:37.489597 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e382543f-4037-4f53-b983-e7557d1d9219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:32:37.490776 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e382543f-4037-4f53-b983-e7557d1d9219 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:32:37.502493 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e382543f-4037-4f53-b983-e7557d1d9219 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:32:37.503214 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e382543f-4037-4f53-b983-e7557d1d9219 admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:32:37.505239 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e382543f-4037-4f53-b983-e7557d1d9219 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:32:37.508282 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e382543f-4037-4f53-b983-e7557d1d9219 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:32:37.514847 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:32:37.593282 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2710/5412] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:32:37 2022] POST /identity/v3/projects => generated 385 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:32:37.604748 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175d8f8e-aa52-4d52-8c77-237b20367563 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:32:37.633020 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175d8f8e-aa52-4d52-8c77-237b20367563 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:32:37.745891 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f8da5b-663f-4a62-a2e0-4d38fe7ce6af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:32:37.746697 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f8da5b-663f-4a62-a2e0-4d38fe7ce6af admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:32:37.747383 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f8da5b-663f-4a62-a2e0-4d38fe7ce6af admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:32:37.747667 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f8da5b-663f-4a62-a2e0-4d38fe7ce6af admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:32:37.748833 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f8da5b-663f-4a62-a2e0-4d38fe7ce6af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:32:37.751232 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f8da5b-663f-4a62-a2e0-4d38fe7ce6af admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:32:37.804319 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2703/5413] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:32:37 2022] POST /identity/v3/users => generated 293 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:32:37.808710 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e382543f-4037-4f53-b983-e7557d1d9219 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:32:37.830141 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e382543f-4037-4f53-b983-e7557d1d9219 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:32:37.838307 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673afc43-9d6b-4eac-aba0-e60e505f0dbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:32:37.839083 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673afc43-9d6b-4eac-aba0-e60e505f0dbc admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:32:37.839769 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673afc43-9d6b-4eac-aba0-e60e505f0dbc admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:32:37.840116 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673afc43-9d6b-4eac-aba0-e60e505f0dbc admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:32:37.840926 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673afc43-9d6b-4eac-aba0-e60e505f0dbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:32:37.846145 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673afc43-9d6b-4eac-aba0-e60e505f0dbc admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:32:37.865597 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2711/5414] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:32:37 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 21:32:37.866995 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f8da5b-663f-4a62-a2e0-4d38fe7ce6af admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:32:37.882798 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f8da5b-663f-4a62-a2e0-4d38fe7ce6af admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:32:37.897182 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ca15fa-f927-4af4-a300-8eca2a134dbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:32:37.898292 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ca15fa-f927-4af4-a300-8eca2a134dbc admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:32:37.898906 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ca15fa-f927-4af4-a300-8eca2a134dbc admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:32:37.899573 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ca15fa-f927-4af4-a300-8eca2a134dbc admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:32:37.900871 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ca15fa-f927-4af4-a300-8eca2a134dbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:32:37.905175 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ca15fa-f927-4af4-a300-8eca2a134dbc admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:32:37.936231 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2704/5415] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:32:37 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:32:37.940723 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673afc43-9d6b-4eac-aba0-e60e505f0dbc admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:32:37.959737 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673afc43-9d6b-4eac-aba0-e60e505f0dbc admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:32:37.966244 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc320e34-160a-4153-9cc9-cc2aa1c53e39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:32:37.967170 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc320e34-160a-4153-9cc9-cc2aa1c53e39 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:32:37.967499 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc320e34-160a-4153-9cc9-cc2aa1c53e39 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:32:37.967773 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc320e34-160a-4153-9cc9-cc2aa1c53e39 admin admin] PATH_INFO: `/v3/projects/98b9df8f8c464edfaea78ac31af7d1c9/users/0dba8b031a6f42f1bdf7699a30ff0251/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:32:37.988830 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc320e34-160a-4153-9cc9-cc2aa1c53e39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98b9df8f8c464edfaea78ac31af7d1c9, user_id=0dba8b031a6f42f1bdf7699a30ff0251, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:32:37.992845 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc320e34-160a-4153-9cc9-cc2aa1c53e39 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:32:38.022095 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2712/5416] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:32:37 2022] PUT /identity/v3/projects/98b9df8f8c464edfaea78ac31af7d1c9/users/0dba8b031a6f42f1bdf7699a30ff0251/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:32:38.033077 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f08632-6dd5-4cd1-96c8-adc33daaa523 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:32:38.033368 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f08632-6dd5-4cd1-96c8-adc33daaa523 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:32:38.033631 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f08632-6dd5-4cd1-96c8-adc33daaa523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:32:38.072989 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-a7f08632-6dd5-4cd1-96c8-adc33daaa523 None None] MFA Rules not processed for user `0dba8b031a6f42f1bdf7699a30ff0251`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:32:38.075810 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-a7f08632-6dd5-4cd1-96c8-adc33daaa523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:32:38.087144 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:32:38.230329 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2705/5417] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:32:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:32:38.235307 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc320e34-160a-4153-9cc9-cc2aa1c53e39 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:32:38.323709 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc320e34-160a-4153-9cc9-cc2aa1c53e39 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:32:38.329302 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7af54a1-2317-4c07-94c0-9b77bb770407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:32:38.337985 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7af54a1-2317-4c07-94c0-9b77bb770407 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:32:38.338569 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7af54a1-2317-4c07-94c0-9b77bb770407 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:32:38.339153 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7af54a1-2317-4c07-94c0-9b77bb770407 admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:32:38.340198 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7af54a1-2317-4c07-94c0-9b77bb770407 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:32:38.344813 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7af54a1-2317-4c07-94c0-9b77bb770407 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:32:38.393627 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2713/5418] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:32:38 2022] POST /identity/v3/projects => generated 385 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:32:38.397913 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f08632-6dd5-4cd1-96c8-adc33daaa523 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:32:38.420922 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f08632-6dd5-4cd1-96c8-adc33daaa523 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:32:38.552439 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9fa034-bc5a-48a4-b2dd-fbc1e21be1f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:32:38.553339 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9fa034-bc5a-48a4-b2dd-fbc1e21be1f8 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:32:38.553774 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9fa034-bc5a-48a4-b2dd-fbc1e21be1f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:32:38.554240 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9fa034-bc5a-48a4-b2dd-fbc1e21be1f8 admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:32:38.555094 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9fa034-bc5a-48a4-b2dd-fbc1e21be1f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:32:38.557604 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9fa034-bc5a-48a4-b2dd-fbc1e21be1f8 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:32:38.642622 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2706/5419] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:32:38 2022] POST /identity/v3/users => generated 293 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:32:38.646802 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7af54a1-2317-4c07-94c0-9b77bb770407 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:32:38.663216 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7af54a1-2317-4c07-94c0-9b77bb770407 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:32:38.675238 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac58f00b-513a-49c3-8cc5-227a389f7000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:32:38.676045 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac58f00b-513a-49c3-8cc5-227a389f7000 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:32:38.676397 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac58f00b-513a-49c3-8cc5-227a389f7000 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:32:38.676747 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac58f00b-513a-49c3-8cc5-227a389f7000 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:32:38.677561 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac58f00b-513a-49c3-8cc5-227a389f7000 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:32:38.679431 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac58f00b-513a-49c3-8cc5-227a389f7000 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:32:38.707588 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2714/5420] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:32:38 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:32:38.711767 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9fa034-bc5a-48a4-b2dd-fbc1e21be1f8 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:32:38.726377 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9fa034-bc5a-48a4-b2dd-fbc1e21be1f8 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:32:38.744390 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f775a2-f5d2-4d07-b160-a11bcae81b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:32:38.745009 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f775a2-f5d2-4d07-b160-a11bcae81b17 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:32:38.745303 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f775a2-f5d2-4d07-b160-a11bcae81b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:32:38.745546 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f775a2-f5d2-4d07-b160-a11bcae81b17 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:32:38.748118 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f775a2-f5d2-4d07-b160-a11bcae81b17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:32:38.751303 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f775a2-f5d2-4d07-b160-a11bcae81b17 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:32:38.785252 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2707/5421] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:32:38 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:32:38.788917 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac58f00b-513a-49c3-8cc5-227a389f7000 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:32:38.817069 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac58f00b-513a-49c3-8cc5-227a389f7000 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:32:38.831425 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271f11ea-d522-47a9-b555-28d8f5663066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:32:38.832365 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271f11ea-d522-47a9-b555-28d8f5663066 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:32:38.832644 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271f11ea-d522-47a9-b555-28d8f5663066 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:32:38.832915 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271f11ea-d522-47a9-b555-28d8f5663066 admin admin] PATH_INFO: `/v3/projects/a36583e021804dab8c1ddb897bbaa4e6/users/25425f0640d147259149ffd7f6008cd6/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:32:38.855071 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271f11ea-d522-47a9-b555-28d8f5663066 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a36583e021804dab8c1ddb897bbaa4e6, user_id=25425f0640d147259149ffd7f6008cd6, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:32:38.858920 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271f11ea-d522-47a9-b555-28d8f5663066 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:32:38.907567 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2715/5422] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:32:38 2022] PUT /identity/v3/projects/a36583e021804dab8c1ddb897bbaa4e6/users/25425f0640d147259149ffd7f6008cd6/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:32:38.910442 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc1d4de-8420-4eff-839c-6eb7c8701677 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:32:38.910442 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc1d4de-8420-4eff-839c-6eb7c8701677 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:32:38.910689 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc1d4de-8420-4eff-839c-6eb7c8701677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:32:38.966285 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-bcc1d4de-8420-4eff-839c-6eb7c8701677 None None] MFA Rules not processed for user `25425f0640d147259149ffd7f6008cd6`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:32:38.974912 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-bcc1d4de-8420-4eff-839c-6eb7c8701677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:32:39.141606 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2708/5423] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:32:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:32:39.142450 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271f11ea-d522-47a9-b555-28d8f5663066 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:32:39.275442 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271f11ea-d522-47a9-b555-28d8f5663066 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:32:39.285364 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69341250-00c6-4caa-a51e-b325643f2de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:32:39.286441 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69341250-00c6-4caa-a51e-b325643f2de3 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:32:39.286441 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69341250-00c6-4caa-a51e-b325643f2de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:32:39.286645 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69341250-00c6-4caa-a51e-b325643f2de3 admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:32:39.287605 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69341250-00c6-4caa-a51e-b325643f2de3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:32:39.289767 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69341250-00c6-4caa-a51e-b325643f2de3 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:32:39.306155 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:32:39.337011 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc1d4de-8420-4eff-839c-6eb7c8701677 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:32:39.344882 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2716/5424] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:32:39 2022] POST /identity/v3/projects => generated 383 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:32:39.351223 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc1d4de-8420-4eff-839c-6eb7c8701677 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:32:39.385180 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:32:39.455401 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c0a4df-c7a1-4ab7-8a44-098e8a2412b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:32:39.456313 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c0a4df-c7a1-4ab7-8a44-098e8a2412b0 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:32:39.456460 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c0a4df-c7a1-4ab7-8a44-098e8a2412b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:32:39.456714 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c0a4df-c7a1-4ab7-8a44-098e8a2412b0 admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:32:39.457544 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c0a4df-c7a1-4ab7-8a44-098e8a2412b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:32:39.461848 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c0a4df-c7a1-4ab7-8a44-098e8a2412b0 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:32:39.516524 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69341250-00c6-4caa-a51e-b325643f2de3 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:32:39.517408 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2709/5425] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:32:39 2022] POST /identity/v3/users => generated 298 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:32:39.529092 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69341250-00c6-4caa-a51e-b325643f2de3 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:32:39.538000 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415bef90-57af-48bb-a041-a215d1016931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:32:39.538705 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415bef90-57af-48bb-a041-a215d1016931 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:32:39.538987 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415bef90-57af-48bb-a041-a215d1016931 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:32:39.539267 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415bef90-57af-48bb-a041-a215d1016931 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:32:39.540004 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415bef90-57af-48bb-a041-a215d1016931 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:32:39.542417 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415bef90-57af-48bb-a041-a215d1016931 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:32:39.561918 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2717/5426] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:32:39 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 21:32:39.564718 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c0a4df-c7a1-4ab7-8a44-098e8a2412b0 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:32:39.581738 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c0a4df-c7a1-4ab7-8a44-098e8a2412b0 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:32:39.598483 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f25b55-ecfd-45fe-ba3d-9aa7e53c5316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:32:39.599626 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f25b55-ecfd-45fe-ba3d-9aa7e53c5316 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:32:39.600059 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f25b55-ecfd-45fe-ba3d-9aa7e53c5316 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:32:39.627349 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f25b55-ecfd-45fe-ba3d-9aa7e53c5316 admin admin] PATH_INFO: `/v3/projects/2dd8eabc8d0c4889bfb3579e6fc47ac3/users/d6d5e4ec2eb44c61b91da72b4d97bad8/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:32:39.695115 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f25b55-ecfd-45fe-ba3d-9aa7e53c5316 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2dd8eabc8d0c4889bfb3579e6fc47ac3, user_id=d6d5e4ec2eb44c61b91da72b4d97bad8, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:32:39.704074 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f25b55-ecfd-45fe-ba3d-9aa7e53c5316 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:32:39.707457 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822f9bf2-13af-4cd9-886b-0a080515ed92 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:32:39.707966 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822f9bf2-13af-4cd9-886b-0a080515ed92 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:32:39.709543 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822f9bf2-13af-4cd9-886b-0a080515ed92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:32:39.753409 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2710/5427] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:32:39 2022] PUT /identity/v3/projects/2dd8eabc8d0c4889bfb3579e6fc47ac3/users/d6d5e4ec2eb44c61b91da72b4d97bad8/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:32:39.760645 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f25b55-ecfd-45fe-ba3d-9aa7e53c5316 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:32:39.766472 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-822f9bf2-13af-4cd9-886b-0a080515ed92 None None] MFA Rules not processed for user `17b779a3e21a415bb42cde5d6863d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:32:39.773741 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-822f9bf2-13af-4cd9-886b-0a080515ed92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:32:39.903270 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f25b55-ecfd-45fe-ba3d-9aa7e53c5316 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:32:39.911529 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae67377f-86eb-4697-b7b3-0f7b5d79d6ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:32:39.912081 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae67377f-86eb-4697-b7b3-0f7b5d79d6ed admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:32:39.912365 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae67377f-86eb-4697-b7b3-0f7b5d79d6ed admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:32:39.912638 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae67377f-86eb-4697-b7b3-0f7b5d79d6ed admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:32:39.914185 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae67377f-86eb-4697-b7b3-0f7b5d79d6ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:32:39.916102 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae67377f-86eb-4697-b7b3-0f7b5d79d6ed admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:32:39.927950 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2711/5428] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:32:39 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:32:39.934039 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae67377f-86eb-4697-b7b3-0f7b5d79d6ed admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:32:39.962402 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae67377f-86eb-4697-b7b3-0f7b5d79d6ed admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:32:39.976074 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602a9f78-2cc0-49cf-a6bd-20abb07e46b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:32:39.978194 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602a9f78-2cc0-49cf-a6bd-20abb07e46b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:32:39.979423 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602a9f78-2cc0-49cf-a6bd-20abb07e46b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:32:39.979888 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602a9f78-2cc0-49cf-a6bd-20abb07e46b3 admin admin] PATH_INFO: `/v3/projects/2dd8eabc8d0c4889bfb3579e6fc47ac3/users/d6d5e4ec2eb44c61b91da72b4d97bad8/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:32:39.982595 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602a9f78-2cc0-49cf-a6bd-20abb07e46b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2dd8eabc8d0c4889bfb3579e6fc47ac3, user_id=d6d5e4ec2eb44c61b91da72b4d97bad8, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:32:39.985938 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602a9f78-2cc0-49cf-a6bd-20abb07e46b3 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:32:39.995139 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2718/5429] 10.222.0.17 () {58 vars in 1009 bytes} [Sat Jul 23 21:32:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:32:39.996280 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822f9bf2-13af-4cd9-886b-0a080515ed92 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:32:39.999163 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-822f9bf2-13af-4cd9-886b-0a080515ed92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:32:40.001778 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2712/5430] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:32:39 2022] PUT /identity/v3/projects/2dd8eabc8d0c4889bfb3579e6fc47ac3/users/d6d5e4ec2eb44c61b91da72b4d97bad8/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:32:40.014895 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930790e4-058a-4ff5-bb68-3a028d732a53 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:32:40.015759 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930790e4-058a-4ff5-bb68-3a028d732a53 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:32:40.016474 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930790e4-058a-4ff5-bb68-3a028d732a53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:32:40.056786 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-930790e4-058a-4ff5-bb68-3a028d732a53 None None] MFA Rules not processed for user `d6d5e4ec2eb44c61b91da72b4d97bad8`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:32:40.059191 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-930790e4-058a-4ff5-bb68-3a028d732a53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:32:40.175417 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822f9bf2-13af-4cd9-886b-0a080515ed92 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:32:40.181542 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:32:40.238486 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2713/5431] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:32:40 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:32:40.251534 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930790e4-058a-4ff5-bb68-3a028d732a53 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:32:40.253134 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-930790e4-058a-4ff5-bb68-3a028d732a53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:32:40.330974 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fc3887-7e63-43b1-a66a-638326f2a2ba service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f0a685b7da46afb81024848f079d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:32:40.331572 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fc3887-7e63-43b1-a66a-638326f2a2ba service swift] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:32:40.331669 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fc3887-7e63-43b1-a66a-638326f2a2ba service swift] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:32:40.331941 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fc3887-7e63-43b1-a66a-638326f2a2ba service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:32:40.356698 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930790e4-058a-4ff5-bb68-3a028d732a53 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:32:40.361419 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:32:40.367687 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a619ff-8ba1-4bfe-af29-2a2618efa9e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec5fd3a489c341b7964704d689037f05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:32:40.368656 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a619ff-8ba1-4bfe-af29-2a2618efa9e4 service cinder] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:32:40.368956 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a619ff-8ba1-4bfe-af29-2a2618efa9e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:32:40.369226 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a619ff-8ba1-4bfe-af29-2a2618efa9e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:32:40.418867 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fc3887-7e63-43b1-a66a-638326f2a2ba service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:32:40.420589 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fc3887-7e63-43b1-a66a-638326f2a2ba service swift] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:32:40.432682 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2719/5432] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 23 21:32:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 23 21:32:40.465398 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a619ff-8ba1-4bfe-af29-2a2618efa9e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:32:40.467974 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a619ff-8ba1-4bfe-af29-2a2618efa9e4 service cinder] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:32:40.487511 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2714/5433] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:32:40 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 23 21:32:44.363038 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fc3887-7e63-43b1-a66a-638326f2a2ba service swift] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:32:44.452406 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fc3887-7e63-43b1-a66a-638326f2a2ba service swift] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:32:44.457153 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f30416-86c9-4cc0-8226-cb3b605f1a83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:32:44.458318 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f30416-86c9-4cc0-8226-cb3b605f1a83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:32:44.458604 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f30416-86c9-4cc0-8226-cb3b605f1a83 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:32:44.458884 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f30416-86c9-4cc0-8226-cb3b605f1a83 admin admin] PATH_INFO: `/v3/users/0dba8b031a6f42f1bdf7699a30ff0251` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:32:44.470072 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f30416-86c9-4cc0-8226-cb3b605f1a83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0dba8b031a6f42f1bdf7699a30ff0251)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:32:44.480303 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f30416-86c9-4cc0-8226-cb3b605f1a83 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:32:44.567420 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-e7f30416-86c9-4cc0-8226-cb3b605f1a83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0dba8b031a6f42f1bdf7699a30ff0251'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:32:44.584722 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-e7f30416-86c9-4cc0-8226-cb3b605f1a83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0dba8b031a6f42f1bdf7699a30ff0251'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:32:44.585794 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-e7f30416-86c9-4cc0-8226-cb3b605f1a83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0dba8b031a6f42f1bdf7699a30ff0251'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:32:44.607759 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-e7f30416-86c9-4cc0-8226-cb3b605f1a83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0dba8b031a6f42f1bdf7699a30ff0251'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:32:44.623352 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-e7f30416-86c9-4cc0-8226-cb3b605f1a83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0dba8b031a6f42f1bdf7699a30ff0251'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:32:44.641951 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2720/5434] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:32:44 2022] DELETE /identity/v3/users/0dba8b031a6f42f1bdf7699a30ff0251 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:32:44.643477 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55cff5f-f946-4335-8cb7-90f57312dd40 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:32:44.644008 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55cff5f-f946-4335-8cb7-90f57312dd40 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:32:44.644129 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55cff5f-f946-4335-8cb7-90f57312dd40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:32:44.662796 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-a55cff5f-f946-4335-8cb7-90f57312dd40 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:32:44.671586 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-a55cff5f-f946-4335-8cb7-90f57312dd40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:32:44.832287 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f30416-86c9-4cc0-8226-cb3b605f1a83 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:32:44.834011 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-e7f30416-86c9-4cc0-8226-cb3b605f1a83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:32:44.836677 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2715/5435] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:32:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:32:44.941438 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:32:44.960175 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f30416-86c9-4cc0-8226-cb3b605f1a83 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:32:44.966051 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b108e2-f697-48f8-b6d4-72e23e63e719 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:32:44.967200 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b108e2-f697-48f8-b6d4-72e23e63e719 service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:32:44.967673 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b108e2-f697-48f8-b6d4-72e23e63e719 service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:32:44.968285 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b108e2-f697-48f8-b6d4-72e23e63e719 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:32:44.980917 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b108e2-f697-48f8-b6d4-72e23e63e719 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:32:44.983519 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b108e2-f697-48f8-b6d4-72e23e63e719 service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:32:44.994994 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2721/5436] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:32:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:32:46.031039 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55cff5f-f946-4335-8cb7-90f57312dd40 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:32:46.032727 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-a55cff5f-f946-4335-8cb7-90f57312dd40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:32:46.058361 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55cff5f-f946-4335-8cb7-90f57312dd40 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:32:46.068030 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4436882e-6046-4f9c-8564-5623f745e12a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:32:46.075602 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4436882e-6046-4f9c-8564-5623f745e12a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:32:46.076140 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4436882e-6046-4f9c-8564-5623f745e12a admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:32:46.076609 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4436882e-6046-4f9c-8564-5623f745e12a admin admin] PATH_INFO: `/v3/projects/98b9df8f8c464edfaea78ac31af7d1c9` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:32:46.078672 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4436882e-6046-4f9c-8564-5623f745e12a admin admin] RBAC: Authorizing `identity:delete_project(project_id=98b9df8f8c464edfaea78ac31af7d1c9)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:32:46.080847 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4436882e-6046-4f9c-8564-5623f745e12a admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:32:46.174528 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:32:46.187253 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-4436882e-6046-4f9c-8564-5623f745e12a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98b9df8f8c464edfaea78ac31af7d1c9', 'request_id': 'req-4436882e-6046-4f9c-8564-5623f745e12a'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:32:46.198248 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-4436882e-6046-4f9c-8564-5623f745e12a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98b9df8f8c464edfaea78ac31af7d1c9', 'request_id': 'req-4436882e-6046-4f9c-8564-5623f745e12a'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:32:46.205233 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-4436882e-6046-4f9c-8564-5623f745e12a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98b9df8f8c464edfaea78ac31af7d1c9', 'request_id': 'req-4436882e-6046-4f9c-8564-5623f745e12a'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:32:46.217172 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-4436882e-6046-4f9c-8564-5623f745e12a admin admin] The token cache is being invalidate because project 98b9df8f8c464edfaea78ac31af7d1c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:32:46.217455 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-4436882e-6046-4f9c-8564-5623f745e12a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:32:46.218719 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-4436882e-6046-4f9c-8564-5623f745e12a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:32:46.220318 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2716/5437] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:32:46 2022] DELETE /identity/v3/projects/98b9df8f8c464edfaea78ac31af7d1c9 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:32:46.225110 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b108e2-f697-48f8-b6d4-72e23e63e719 service neutron] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:32:46.235980 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b108e2-f697-48f8-b6d4-72e23e63e719 service neutron] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:32:46.319700 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1e82f0-7858-4625-9aad-0e7aa4455236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:32:46.320598 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1e82f0-7858-4625-9aad-0e7aa4455236 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:32:46.320874 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1e82f0-7858-4625-9aad-0e7aa4455236 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:32:46.321142 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1e82f0-7858-4625-9aad-0e7aa4455236 admin admin] PATH_INFO: `/v3/users/25425f0640d147259149ffd7f6008cd6` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:32:46.322454 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1e82f0-7858-4625-9aad-0e7aa4455236 admin admin] RBAC: Authorizing `identity:delete_user(user_id=25425f0640d147259149ffd7f6008cd6)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:32:46.324372 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1e82f0-7858-4625-9aad-0e7aa4455236 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:32:46.418092 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-bb1e82f0-7858-4625-9aad-0e7aa4455236 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25425f0640d147259149ffd7f6008cd6'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:32:46.432629 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-bb1e82f0-7858-4625-9aad-0e7aa4455236 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25425f0640d147259149ffd7f6008cd6'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:32:46.433468 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-bb1e82f0-7858-4625-9aad-0e7aa4455236 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25425f0640d147259149ffd7f6008cd6'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:32:46.433576 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4436882e-6046-4f9c-8564-5623f745e12a admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:32:46.439475 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-4436882e-6046-4f9c-8564-5623f745e12a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:32:46.446803 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-bb1e82f0-7858-4625-9aad-0e7aa4455236 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25425f0640d147259149ffd7f6008cd6'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:32:46.463931 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-bb1e82f0-7858-4625-9aad-0e7aa4455236 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25425f0640d147259149ffd7f6008cd6'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:32:46.475671 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2722/5438] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:32:46 2022] DELETE /identity/v3/users/25425f0640d147259149ffd7f6008cd6 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:32:46.484674 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4436882e-6046-4f9c-8564-5623f745e12a admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:32:46.608387 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4650231e-3ff5-46a8-9515-f37afca45dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:32:46.609475 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4650231e-3ff5-46a8-9515-f37afca45dec admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:32:46.610455 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4650231e-3ff5-46a8-9515-f37afca45dec admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:32:46.610726 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4650231e-3ff5-46a8-9515-f37afca45dec admin admin] PATH_INFO: `/v3/users/5efda1c40f494592bf1e6af1add120f3` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:32:46.612679 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4650231e-3ff5-46a8-9515-f37afca45dec admin admin] RBAC: Authorizing `identity:delete_user(user_id=5efda1c40f494592bf1e6af1add120f3)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:32:46.615525 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4650231e-3ff5-46a8-9515-f37afca45dec admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:32:46.710478 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-4650231e-3ff5-46a8-9515-f37afca45dec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5efda1c40f494592bf1e6af1add120f3'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:32:46.711182 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-4650231e-3ff5-46a8-9515-f37afca45dec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5efda1c40f494592bf1e6af1add120f3'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:32:46.734533 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-4650231e-3ff5-46a8-9515-f37afca45dec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5efda1c40f494592bf1e6af1add120f3'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:32:46.767853 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-4650231e-3ff5-46a8-9515-f37afca45dec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5efda1c40f494592bf1e6af1add120f3'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:32:46.814756 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-4650231e-3ff5-46a8-9515-f37afca45dec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5efda1c40f494592bf1e6af1add120f3'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:32:46.827657 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2717/5439] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:32:46 2022] DELETE /identity/v3/users/5efda1c40f494592bf1e6af1add120f3 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:32:47.084344 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1e82f0-7858-4625-9aad-0e7aa4455236 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:32:47.086018 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-bb1e82f0-7858-4625-9aad-0e7aa4455236 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:32:47.119744 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1e82f0-7858-4625-9aad-0e7aa4455236 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:32:47.121476 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4650231e-3ff5-46a8-9515-f37afca45dec admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:32:47.123890 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-4650231e-3ff5-46a8-9515-f37afca45dec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:32:47.195071 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:32:47.217792 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4650231e-3ff5-46a8-9515-f37afca45dec admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:32:47.224913 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed30cbc-ef21-4ac0-a264-6b308df7c330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:32:47.226591 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed30cbc-ef21-4ac0-a264-6b308df7c330 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:32:47.227079 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed30cbc-ef21-4ac0-a264-6b308df7c330 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:32:47.227537 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed30cbc-ef21-4ac0-a264-6b308df7c330 admin admin] PATH_INFO: `/v3/projects/1890022bd460485dae0ea94b152a6746` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:32:47.229498 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed30cbc-ef21-4ac0-a264-6b308df7c330 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1890022bd460485dae0ea94b152a6746)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:32:47.231681 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed30cbc-ef21-4ac0-a264-6b308df7c330 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:32:47.236273 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66ea220-f155-4a9c-a21c-f32c46edadba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:32:47.237170 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66ea220-f155-4a9c-a21c-f32c46edadba admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:32:47.237599 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66ea220-f155-4a9c-a21c-f32c46edadba admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:32:47.237903 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66ea220-f155-4a9c-a21c-f32c46edadba admin admin] PATH_INFO: `/v3/projects/a36583e021804dab8c1ddb897bbaa4e6` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:32:47.239290 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66ea220-f155-4a9c-a21c-f32c46edadba admin admin] RBAC: Authorizing `identity:delete_project(project_id=a36583e021804dab8c1ddb897bbaa4e6)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:32:47.241995 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66ea220-f155-4a9c-a21c-f32c46edadba admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:32:47.250413 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:32:47.299021 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-b66ea220-f155-4a9c-a21c-f32c46edadba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a36583e021804dab8c1ddb897bbaa4e6', 'request_id': 'req-b66ea220-f155-4a9c-a21c-f32c46edadba'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:32:47.300402 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-9ed30cbc-ef21-4ac0-a264-6b308df7c330 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1890022bd460485dae0ea94b152a6746', 'request_id': 'req-9ed30cbc-ef21-4ac0-a264-6b308df7c330'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:32:47.310276 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-b66ea220-f155-4a9c-a21c-f32c46edadba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a36583e021804dab8c1ddb897bbaa4e6', 'request_id': 'req-b66ea220-f155-4a9c-a21c-f32c46edadba'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:32:47.317591 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-b66ea220-f155-4a9c-a21c-f32c46edadba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a36583e021804dab8c1ddb897bbaa4e6', 'request_id': 'req-b66ea220-f155-4a9c-a21c-f32c46edadba'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:32:47.324564 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-9ed30cbc-ef21-4ac0-a264-6b308df7c330 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1890022bd460485dae0ea94b152a6746', 'request_id': 'req-9ed30cbc-ef21-4ac0-a264-6b308df7c330'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:32:47.335239 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-b66ea220-f155-4a9c-a21c-f32c46edadba admin admin] The token cache is being invalidate because project a36583e021804dab8c1ddb897bbaa4e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:32:47.336216 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-b66ea220-f155-4a9c-a21c-f32c46edadba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:32:47.337159 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-9ed30cbc-ef21-4ac0-a264-6b308df7c330 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1890022bd460485dae0ea94b152a6746', 'request_id': 'req-9ed30cbc-ef21-4ac0-a264-6b308df7c330'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:32:47.337468 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-b66ea220-f155-4a9c-a21c-f32c46edadba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:32:47.339659 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2723/5440] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:32:47 2022] DELETE /identity/v3/projects/a36583e021804dab8c1ddb897bbaa4e6 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:32:47.343658 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66ea220-f155-4a9c-a21c-f32c46edadba admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:32:47.345040 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-b66ea220-f155-4a9c-a21c-f32c46edadba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:32:47.355231 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-9ed30cbc-ef21-4ac0-a264-6b308df7c330 admin admin] The token cache is being invalidate because project 1890022bd460485dae0ea94b152a6746 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:32:47.355548 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-9ed30cbc-ef21-4ac0-a264-6b308df7c330 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:32:47.356264 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-9ed30cbc-ef21-4ac0-a264-6b308df7c330 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:32:47.357906 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2718/5441] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:32:47 2022] DELETE /identity/v3/projects/1890022bd460485dae0ea94b152a6746 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:32:47.362732 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fe3e16-feff-41c5-88f0-1e17c0c92078 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:32:47.363019 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fe3e16-feff-41c5-88f0-1e17c0c92078 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:32:47.363297 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fe3e16-feff-41c5-88f0-1e17c0c92078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:32:47.383789 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-c1fe3e16-feff-41c5-88f0-1e17c0c92078 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:32:47.385078 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-c1fe3e16-feff-41c5-88f0-1e17c0c92078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:32:47.425444 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66ea220-f155-4a9c-a21c-f32c46edadba admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:32:47.430384 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd9c32a-6a92-4d8e-adad-c616e6bcfcc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:32:47.431352 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd9c32a-6a92-4d8e-adad-c616e6bcfcc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:32:47.431626 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd9c32a-6a92-4d8e-adad-c616e6bcfcc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:32:47.431900 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd9c32a-6a92-4d8e-adad-c616e6bcfcc2 admin admin] PATH_INFO: `/v3/users/d6d5e4ec2eb44c61b91da72b4d97bad8` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:32:47.433143 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd9c32a-6a92-4d8e-adad-c616e6bcfcc2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6d5e4ec2eb44c61b91da72b4d97bad8)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:32:47.435419 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd9c32a-6a92-4d8e-adad-c616e6bcfcc2 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:32:47.468404 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2719/5442] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:32:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:32:47.477791 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562dfe4c-c722-484f-a2a5-b490e6711241 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:32:47.478114 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562dfe4c-c722-484f-a2a5-b490e6711241 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:32:47.478763 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562dfe4c-c722-484f-a2a5-b490e6711241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:32:47.498518 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-5cd9c32a-6a92-4d8e-adad-c616e6bcfcc2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6d5e4ec2eb44c61b91da72b4d97bad8'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:32:47.504552 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-562dfe4c-c722-484f-a2a5-b490e6711241 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:32:47.507226 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-562dfe4c-c722-484f-a2a5-b490e6711241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:32:47.507529 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-5cd9c32a-6a92-4d8e-adad-c616e6bcfcc2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6d5e4ec2eb44c61b91da72b4d97bad8'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:32:47.508475 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-5cd9c32a-6a92-4d8e-adad-c616e6bcfcc2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6d5e4ec2eb44c61b91da72b4d97bad8'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:32:47.519974 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-5cd9c32a-6a92-4d8e-adad-c616e6bcfcc2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6d5e4ec2eb44c61b91da72b4d97bad8'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:32:47.521916 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2720/5443] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:32:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:32:47.525145 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562dfe4c-c722-484f-a2a5-b490e6711241 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:32:47.535389 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562dfe4c-c722-484f-a2a5-b490e6711241 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:32:47.539730 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-5cd9c32a-6a92-4d8e-adad-c616e6bcfcc2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6d5e4ec2eb44c61b91da72b4d97bad8'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:32:47.541230 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3320fdd1-3e77-4399-83dd-af9e93c109b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:32:47.542176 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3320fdd1-3e77-4399-83dd-af9e93c109b1 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:32:47.543571 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3320fdd1-3e77-4399-83dd-af9e93c109b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:32:47.543853 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3320fdd1-3e77-4399-83dd-af9e93c109b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:32:47.544601 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3320fdd1-3e77-4399-83dd-af9e93c109b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:32:47.544907 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3320fdd1-3e77-4399-83dd-af9e93c109b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:32:47.546568 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3320fdd1-3e77-4399-83dd-af9e93c109b1 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:32:47.546798 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2724/5444] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:32:47 2022] DELETE /identity/v3/users/d6d5e4ec2eb44c61b91da72b4d97bad8 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:32:47.559512 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2721/5445] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:32:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:32:47.563741 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd9c32a-6a92-4d8e-adad-c616e6bcfcc2 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:32:47.565317 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-5cd9c32a-6a92-4d8e-adad-c616e6bcfcc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:32:47.581302 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:32:47.678964 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd9c32a-6a92-4d8e-adad-c616e6bcfcc2 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:32:47.684272 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3669528c-a92a-420e-9b79-5b11d3e9ce59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:32:47.685205 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3669528c-a92a-420e-9b79-5b11d3e9ce59 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:32:47.685711 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3669528c-a92a-420e-9b79-5b11d3e9ce59 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:32:47.686180 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3669528c-a92a-420e-9b79-5b11d3e9ce59 admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:32:47.687233 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3669528c-a92a-420e-9b79-5b11d3e9ce59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:32:47.689373 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3669528c-a92a-420e-9b79-5b11d3e9ce59 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:32:47.734658 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2725/5446] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:32:47 2022] POST /identity/v3/projects => generated 373 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:32:47.738829 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3320fdd1-3e77-4399-83dd-af9e93c109b1 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:32:47.753626 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3320fdd1-3e77-4399-83dd-af9e93c109b1 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:32:47.916450 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1778f002-a3f2-41ab-b54f-a74683cef8d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:32:47.918056 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1778f002-a3f2-41ab-b54f-a74683cef8d9 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:32:47.918544 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1778f002-a3f2-41ab-b54f-a74683cef8d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:32:47.919106 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1778f002-a3f2-41ab-b54f-a74683cef8d9 admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:32:47.920033 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1778f002-a3f2-41ab-b54f-a74683cef8d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:32:47.922719 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1778f002-a3f2-41ab-b54f-a74683cef8d9 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:32:47.931345 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:32:47.975984 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2722/5447] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:32:47 2022] POST /identity/v3/users => generated 287 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:32:47.977660 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3669528c-a92a-420e-9b79-5b11d3e9ce59 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:32:47.998444 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3669528c-a92a-420e-9b79-5b11d3e9ce59 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:32:48.010061 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de0b315-881c-4ee6-8334-9f4d2b6c8438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:32:48.011095 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de0b315-881c-4ee6-8334-9f4d2b6c8438 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:32:48.011593 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de0b315-881c-4ee6-8334-9f4d2b6c8438 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:32:48.011981 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de0b315-881c-4ee6-8334-9f4d2b6c8438 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:32:48.013031 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de0b315-881c-4ee6-8334-9f4d2b6c8438 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:32:48.015656 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de0b315-881c-4ee6-8334-9f4d2b6c8438 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:32:48.028633 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2726/5448] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:32:47 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:32:48.033067 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1778f002-a3f2-41ab-b54f-a74683cef8d9 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:32:48.045309 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1778f002-a3f2-41ab-b54f-a74683cef8d9 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:32:48.051098 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0e24c8-30ad-4564-ba04-ea58b6ad9125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:32:48.051729 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0e24c8-30ad-4564-ba04-ea58b6ad9125 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:32:48.052118 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0e24c8-30ad-4564-ba04-ea58b6ad9125 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:32:48.052403 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0e24c8-30ad-4564-ba04-ea58b6ad9125 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:32:48.053140 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0e24c8-30ad-4564-ba04-ea58b6ad9125 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:32:48.054973 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0e24c8-30ad-4564-ba04-ea58b6ad9125 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:32:48.069840 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2723/5449] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:32:48 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:32:48.071478 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0e24c8-30ad-4564-ba04-ea58b6ad9125 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:32:48.071609 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de0b315-881c-4ee6-8334-9f4d2b6c8438 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:32:48.074347 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-1de0b315-881c-4ee6-8334-9f4d2b6c8438 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:32:48.094165 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0e24c8-30ad-4564-ba04-ea58b6ad9125 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:32:48.099992 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355e5766-7d01-465b-8014-8b0dfcd2fb2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:32:48.100910 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355e5766-7d01-465b-8014-8b0dfcd2fb2b admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:32:48.101189 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355e5766-7d01-465b-8014-8b0dfcd2fb2b admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:32:48.101460 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355e5766-7d01-465b-8014-8b0dfcd2fb2b admin admin] PATH_INFO: `/v3/projects/967b5ba16feb4b88bd4bacf0ec6194c2/users/0400e69a5bee4dcc9b55cd38de32eb76/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:32:48.119180 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de0b315-881c-4ee6-8334-9f4d2b6c8438 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:32:48.124565 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fad708-92a6-4bc0-89ac-85ae3a722c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:32:48.126546 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fad708-92a6-4bc0-89ac-85ae3a722c97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:32:48.126794 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fad708-92a6-4bc0-89ac-85ae3a722c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:32:48.127134 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fad708-92a6-4bc0-89ac-85ae3a722c97 admin admin] PATH_INFO: `/v3/projects/2dd8eabc8d0c4889bfb3579e6fc47ac3` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:32:48.128597 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fad708-92a6-4bc0-89ac-85ae3a722c97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2dd8eabc8d0c4889bfb3579e6fc47ac3)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:32:48.131073 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fad708-92a6-4bc0-89ac-85ae3a722c97 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:32:48.131658 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355e5766-7d01-465b-8014-8b0dfcd2fb2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=967b5ba16feb4b88bd4bacf0ec6194c2, user_id=0400e69a5bee4dcc9b55cd38de32eb76, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:32:48.135073 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355e5766-7d01-465b-8014-8b0dfcd2fb2b admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:32:48.165598 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2724/5450] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:32:48 2022] PUT /identity/v3/projects/967b5ba16feb4b88bd4bacf0ec6194c2/users/0400e69a5bee4dcc9b55cd38de32eb76/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:32:48.178361 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095c6b86-fdd6-41da-b9fa-5a59c5094fa6 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:32:48.178721 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095c6b86-fdd6-41da-b9fa-5a59c5094fa6 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:32:48.178997 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095c6b86-fdd6-41da-b9fa-5a59c5094fa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:32:48.226658 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-095c6b86-fdd6-41da-b9fa-5a59c5094fa6 None None] MFA Rules not processed for user `0400e69a5bee4dcc9b55cd38de32eb76`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:32:48.228994 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-095c6b86-fdd6-41da-b9fa-5a59c5094fa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:32:48.245618 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-47fad708-92a6-4bc0-89ac-85ae3a722c97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2dd8eabc8d0c4889bfb3579e6fc47ac3', 'request_id': 'req-47fad708-92a6-4bc0-89ac-85ae3a722c97'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:32:48.271411 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-47fad708-92a6-4bc0-89ac-85ae3a722c97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2dd8eabc8d0c4889bfb3579e6fc47ac3', 'request_id': 'req-47fad708-92a6-4bc0-89ac-85ae3a722c97'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:32:48.284823 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-47fad708-92a6-4bc0-89ac-85ae3a722c97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2dd8eabc8d0c4889bfb3579e6fc47ac3', 'request_id': 'req-47fad708-92a6-4bc0-89ac-85ae3a722c97'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:32:48.307027 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-47fad708-92a6-4bc0-89ac-85ae3a722c97 admin admin] The token cache is being invalidate because project 2dd8eabc8d0c4889bfb3579e6fc47ac3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:32:48.307396 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-47fad708-92a6-4bc0-89ac-85ae3a722c97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:32:48.309792 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-47fad708-92a6-4bc0-89ac-85ae3a722c97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:32:48.312262 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2727/5451] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:32:48 2022] DELETE /identity/v3/projects/2dd8eabc8d0c4889bfb3579e6fc47ac3 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:32:48.316859 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89616a75-3b73-4d2f-878e-24a23e36a70d None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:32:48.317057 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89616a75-3b73-4d2f-878e-24a23e36a70d None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:32:48.317331 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89616a75-3b73-4d2f-878e-24a23e36a70d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:32:48.336360 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-89616a75-3b73-4d2f-878e-24a23e36a70d None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:32:48.338262 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-89616a75-3b73-4d2f-878e-24a23e36a70d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:32:48.341293 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2725/5452] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:32:48 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:32:48.364657 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ce740d-5014-4484-9e23-e8bdd7442629 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:32:48.364941 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ce740d-5014-4484-9e23-e8bdd7442629 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:32:48.365244 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ce740d-5014-4484-9e23-e8bdd7442629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:32:48.386179 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-38ce740d-5014-4484-9e23-e8bdd7442629 None None] MFA Rules not processed for user `0400e69a5bee4dcc9b55cd38de32eb76`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:32:48.387445 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-38ce740d-5014-4484-9e23-e8bdd7442629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:32:48.399122 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2726/5453] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:32:48 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:32:48.406572 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ce740d-5014-4484-9e23-e8bdd7442629 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:32:48.408693 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-38ce740d-5014-4484-9e23-e8bdd7442629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:32:48.478041 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2728/5454] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:32:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:32:48.481177 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108ea3da-c744-48a6-8e42-273c280067c2 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:32:48.481626 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108ea3da-c744-48a6-8e42-273c280067c2 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:32:48.482218 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108ea3da-c744-48a6-8e42-273c280067c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:32:48.506139 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-108ea3da-c744-48a6-8e42-273c280067c2 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:32:48.507630 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-108ea3da-c744-48a6-8e42-273c280067c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:32:48.512931 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ce740d-5014-4484-9e23-e8bdd7442629 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:32:48.516540 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2729/5455] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:32:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:32:48.518925 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3450736b-c895-498b-8026-8950303d4a0d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:32:48.519594 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3450736b-c895-498b-8026-8950303d4a0d service nova] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:32:48.519865 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3450736b-c895-498b-8026-8950303d4a0d service nova] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:32:48.520367 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3450736b-c895-498b-8026-8950303d4a0d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:32:48.521073 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108ea3da-c744-48a6-8e42-273c280067c2 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:32:48.530846 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3450736b-c895-498b-8026-8950303d4a0d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:32:48.532675 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3450736b-c895-498b-8026-8950303d4a0d service nova] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:32:48.543353 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:32:48.545169 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2727/5456] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:32:48 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 23 21:32:48.548446 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108ea3da-c744-48a6-8e42-273c280067c2 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:32:48.554610 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3193c06-091d-4a68-a815-f41e6072bb66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:32:48.555532 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3193c06-091d-4a68-a815-f41e6072bb66 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:32:48.556268 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3193c06-091d-4a68-a815-f41e6072bb66 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:32:48.556601 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3193c06-091d-4a68-a815-f41e6072bb66 admin admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:32:48.557829 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3193c06-091d-4a68-a815-f41e6072bb66 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:32:48.557829 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3193c06-091d-4a68-a815-f41e6072bb66 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:32:48.559968 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3193c06-091d-4a68-a815-f41e6072bb66 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:32:48.577232 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2730/5457] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:32:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:32:48.581627 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3450736b-c895-498b-8026-8950303d4a0d service nova] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:32:48.600580 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3450736b-c895-498b-8026-8950303d4a0d service nova] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:32:48.606028 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e7ce5f-e887-4ade-8aa9-06c6ade0fd0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:32:48.606904 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e7ce5f-e887-4ade-8aa9-06c6ade0fd0b admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:32:48.607471 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e7ce5f-e887-4ade-8aa9-06c6ade0fd0b admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:32:48.607908 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e7ce5f-e887-4ade-8aa9-06c6ade0fd0b admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:32:48.608767 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e7ce5f-e887-4ade-8aa9-06c6ade0fd0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:32:48.627452 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e7ce5f-e887-4ade-8aa9-06c6ade0fd0b admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:32:48.658085 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:32:48.665653 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2728/5458] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:32:48 2022] POST /identity/v3/projects => generated 373 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:32:48.670005 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3193c06-091d-4a68-a815-f41e6072bb66 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:32:48.680616 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3193c06-091d-4a68-a815-f41e6072bb66 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:32:48.784393 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b19dbf3-9b22-4eb7-a461-b5720e580919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:32:48.785292 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b19dbf3-9b22-4eb7-a461-b5720e580919 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:32:48.785777 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b19dbf3-9b22-4eb7-a461-b5720e580919 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:32:48.786298 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b19dbf3-9b22-4eb7-a461-b5720e580919 admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:32:48.787376 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b19dbf3-9b22-4eb7-a461-b5720e580919 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:32:48.790477 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b19dbf3-9b22-4eb7-a461-b5720e580919 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:32:48.836487 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2731/5459] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:32:48 2022] POST /identity/v3/users => generated 287 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:32:48.837744 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e7ce5f-e887-4ade-8aa9-06c6ade0fd0b admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:32:48.857937 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e7ce5f-e887-4ade-8aa9-06c6ade0fd0b admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:32:48.872521 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd20fe27-ae73-438b-b7ea-b090e2694f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:32:48.873556 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd20fe27-ae73-438b-b7ea-b090e2694f12 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:32:48.874006 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd20fe27-ae73-438b-b7ea-b090e2694f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:32:48.874418 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd20fe27-ae73-438b-b7ea-b090e2694f12 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:32:48.875367 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd20fe27-ae73-438b-b7ea-b090e2694f12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:32:48.878438 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd20fe27-ae73-438b-b7ea-b090e2694f12 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:32:48.897762 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2729/5460] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:32:48 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:32:48.904044 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b19dbf3-9b22-4eb7-a461-b5720e580919 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:32:48.917778 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b19dbf3-9b22-4eb7-a461-b5720e580919 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:32:48.924700 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a1aed1-29b3-4cf5-8fe5-0fb17e2d5370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:32:48.925625 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a1aed1-29b3-4cf5-8fe5-0fb17e2d5370 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:32:48.926016 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a1aed1-29b3-4cf5-8fe5-0fb17e2d5370 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:32:48.926462 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a1aed1-29b3-4cf5-8fe5-0fb17e2d5370 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:32:48.927473 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a1aed1-29b3-4cf5-8fe5-0fb17e2d5370 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:32:48.929777 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a1aed1-29b3-4cf5-8fe5-0fb17e2d5370 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:32:48.949970 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2732/5461] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:32:48 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:32:48.951177 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd20fe27-ae73-438b-b7ea-b090e2694f12 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:32:48.969316 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd20fe27-ae73-438b-b7ea-b090e2694f12 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:32:48.976519 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b5b0fc-5ec6-4e71-ad05-511b9c298062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:32:48.978061 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b5b0fc-5ec6-4e71-ad05-511b9c298062 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:32:48.979105 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b5b0fc-5ec6-4e71-ad05-511b9c298062 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:32:48.979482 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b5b0fc-5ec6-4e71-ad05-511b9c298062 admin admin] PATH_INFO: `/v3/projects/93b69135fa1e4f94a240ff29d4cc2a18/users/ebd5aac04a6042d4b90b8192ce91351d/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:32:49.035036 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b5b0fc-5ec6-4e71-ad05-511b9c298062 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93b69135fa1e4f94a240ff29d4cc2a18, user_id=ebd5aac04a6042d4b90b8192ce91351d, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:32:49.038090 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b5b0fc-5ec6-4e71-ad05-511b9c298062 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:32:49.070901 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2730/5462] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:32:48 2022] PUT /identity/v3/projects/93b69135fa1e4f94a240ff29d4cc2a18/users/ebd5aac04a6042d4b90b8192ce91351d/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:32:49.072851 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c59b864-4e3f-47ab-a209-78fca2456c22 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:32:49.073330 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c59b864-4e3f-47ab-a209-78fca2456c22 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:32:49.073754 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c59b864-4e3f-47ab-a209-78fca2456c22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:32:49.136199 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-3c59b864-4e3f-47ab-a209-78fca2456c22 None None] MFA Rules not processed for user `ebd5aac04a6042d4b90b8192ce91351d`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:32:49.138192 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-3c59b864-4e3f-47ab-a209-78fca2456c22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:32:49.302179 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2733/5463] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:32:49 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:32:49.470306 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b5b0fc-5ec6-4e71-ad05-511b9c298062 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:32:49.472436 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-91b5b0fc-5ec6-4e71-ad05-511b9c298062 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:32:49.604499 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b5b0fc-5ec6-4e71-ad05-511b9c298062 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:32:49.613584 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc0156a-9983-4714-b5a2-c7c7ad25cca6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec5fd3a489c341b7964704d689037f05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:32:49.614481 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc0156a-9983-4714-b5a2-c7c7ad25cca6 service cinder] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:32:49.614762 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc0156a-9983-4714-b5a2-c7c7ad25cca6 service cinder] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:32:49.615035 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc0156a-9983-4714-b5a2-c7c7ad25cca6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:32:49.629375 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc0156a-9983-4714-b5a2-c7c7ad25cca6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:32:49.631128 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc0156a-9983-4714-b5a2-c7c7ad25cca6 service cinder] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:32:49.642736 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2731/5464] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:32:49 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:32:49.683046 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c59b864-4e3f-47ab-a209-78fca2456c22 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:32:49.754723 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c59b864-4e3f-47ab-a209-78fca2456c22 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:32:49.765487 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e2398d-26fe-4f49-a647-ec4bdb75610d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:32:49.766435 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e2398d-26fe-4f49-a647-ec4bdb75610d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:32:49.766724 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e2398d-26fe-4f49-a647-ec4bdb75610d admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:32:49.767079 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e2398d-26fe-4f49-a647-ec4bdb75610d admin admin] PATH_INFO: `/v3/users/ebd5aac04a6042d4b90b8192ce91351d` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:32:49.768463 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e2398d-26fe-4f49-a647-ec4bdb75610d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ebd5aac04a6042d4b90b8192ce91351d)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:32:49.770471 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e2398d-26fe-4f49-a647-ec4bdb75610d admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:32:49.772297 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:32:49.824544 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-79e2398d-26fe-4f49-a647-ec4bdb75610d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ebd5aac04a6042d4b90b8192ce91351d'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:32:49.832063 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-79e2398d-26fe-4f49-a647-ec4bdb75610d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ebd5aac04a6042d4b90b8192ce91351d'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:32:49.832843 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-79e2398d-26fe-4f49-a647-ec4bdb75610d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ebd5aac04a6042d4b90b8192ce91351d'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:32:49.841478 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-79e2398d-26fe-4f49-a647-ec4bdb75610d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ebd5aac04a6042d4b90b8192ce91351d'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:32:49.856024 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-79e2398d-26fe-4f49-a647-ec4bdb75610d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ebd5aac04a6042d4b90b8192ce91351d'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:32:49.863506 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2734/5465] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:32:49 2022] DELETE /identity/v3/users/ebd5aac04a6042d4b90b8192ce91351d => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:32:49.867978 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f43e67f-678e-403d-a40c-76397b5b46fa None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:32:49.868391 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f43e67f-678e-403d-a40c-76397b5b46fa None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:32:49.868672 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f43e67f-678e-403d-a40c-76397b5b46fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:32:49.888560 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-8f43e67f-678e-403d-a40c-76397b5b46fa None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:32:49.889883 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-8f43e67f-678e-403d-a40c-76397b5b46fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:32:49.951826 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2732/5466] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:32:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:32:49.963368 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e2398d-26fe-4f49-a647-ec4bdb75610d admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:32:49.964884 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-79e2398d-26fe-4f49-a647-ec4bdb75610d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:32:50.022945 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e2398d-26fe-4f49-a647-ec4bdb75610d admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:32:50.027510 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57760977-9459-4eb1-923d-80c213f9c4a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:32:50.028172 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57760977-9459-4eb1-923d-80c213f9c4a8 service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:32:50.028456 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57760977-9459-4eb1-923d-80c213f9c4a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:32:50.028787 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57760977-9459-4eb1-923d-80c213f9c4a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:32:50.038993 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57760977-9459-4eb1-923d-80c213f9c4a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:32:50.041404 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57760977-9459-4eb1-923d-80c213f9c4a8 service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:32:50.051369 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2735/5467] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:32:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 23 21:32:50.392431 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f43e67f-678e-403d-a40c-76397b5b46fa None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:32:50.393888 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-8f43e67f-678e-403d-a40c-76397b5b46fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:32:50.408055 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f43e67f-678e-403d-a40c-76397b5b46fa None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:32:50.413825 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf6833d-86b0-445f-b592-8920b71e1fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:32:50.414826 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf6833d-86b0-445f-b592-8920b71e1fa8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:32:50.415146 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf6833d-86b0-445f-b592-8920b71e1fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:32:50.415423 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf6833d-86b0-445f-b592-8920b71e1fa8 admin admin] PATH_INFO: `/v3/projects/93b69135fa1e4f94a240ff29d4cc2a18` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:32:50.416637 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf6833d-86b0-445f-b592-8920b71e1fa8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=93b69135fa1e4f94a240ff29d4cc2a18)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:32:50.418621 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf6833d-86b0-445f-b592-8920b71e1fa8 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:32:50.472305 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-dbf6833d-86b0-445f-b592-8920b71e1fa8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93b69135fa1e4f94a240ff29d4cc2a18', 'request_id': 'req-dbf6833d-86b0-445f-b592-8920b71e1fa8'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:32:50.481512 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-dbf6833d-86b0-445f-b592-8920b71e1fa8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93b69135fa1e4f94a240ff29d4cc2a18', 'request_id': 'req-dbf6833d-86b0-445f-b592-8920b71e1fa8'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:32:50.486579 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:32:50.487887 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-dbf6833d-86b0-445f-b592-8920b71e1fa8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93b69135fa1e4f94a240ff29d4cc2a18', 'request_id': 'req-dbf6833d-86b0-445f-b592-8920b71e1fa8'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:32:50.500856 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-dbf6833d-86b0-445f-b592-8920b71e1fa8 admin admin] The token cache is being invalidate because project 93b69135fa1e4f94a240ff29d4cc2a18 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:32:50.501253 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-dbf6833d-86b0-445f-b592-8920b71e1fa8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:32:50.501928 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-dbf6833d-86b0-445f-b592-8920b71e1fa8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:32:50.503577 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2733/5468] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:32:50 2022] DELETE /identity/v3/projects/93b69135fa1e4f94a240ff29d4cc2a18 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:32:50.508708 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b626c3-5306-470a-a0d2-7fd24fa6e25f None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:32:50.509898 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b626c3-5306-470a-a0d2-7fd24fa6e25f None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:32:50.510230 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b626c3-5306-470a-a0d2-7fd24fa6e25f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:32:50.535545 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-74b626c3-5306-470a-a0d2-7fd24fa6e25f None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:32:50.536738 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-74b626c3-5306-470a-a0d2-7fd24fa6e25f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:32:50.611364 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2736/5469] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:32:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:32:50.619456 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34d42c4-a5c3-4115-8250-eaafedb53092 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:32:50.619741 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34d42c4-a5c3-4115-8250-eaafedb53092 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:32:50.620019 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34d42c4-a5c3-4115-8250-eaafedb53092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:32:50.658801 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-b34d42c4-a5c3-4115-8250-eaafedb53092 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:32:50.660070 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-b34d42c4-a5c3-4115-8250-eaafedb53092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:32:50.668946 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2734/5470] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:32:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:32:50.673012 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b626c3-5306-470a-a0d2-7fd24fa6e25f None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:32:50.683930 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b626c3-5306-470a-a0d2-7fd24fa6e25f None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:32:50.689894 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c0270b-17af-4733-a837-5912363ce011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:32:50.690636 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c0270b-17af-4733-a837-5912363ce011 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:32:50.690918 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c0270b-17af-4733-a837-5912363ce011 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:32:50.691192 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c0270b-17af-4733-a837-5912363ce011 admin admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:32:50.691937 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c0270b-17af-4733-a837-5912363ce011 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:32:50.692565 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c0270b-17af-4733-a837-5912363ce011 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:32:50.694136 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c0270b-17af-4733-a837-5912363ce011 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:32:50.709925 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2737/5471] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:32:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:32:50.711986 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34d42c4-a5c3-4115-8250-eaafedb53092 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:32:50.725663 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34d42c4-a5c3-4115-8250-eaafedb53092 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:32:50.731061 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930e2b3e-1e09-43ec-a562-3e7f235873e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:32:50.731749 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930e2b3e-1e09-43ec-a562-3e7f235873e0 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:32:50.732031 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930e2b3e-1e09-43ec-a562-3e7f235873e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:32:50.732305 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930e2b3e-1e09-43ec-a562-3e7f235873e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:32:50.733004 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930e2b3e-1e09-43ec-a562-3e7f235873e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:32:50.735125 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930e2b3e-1e09-43ec-a562-3e7f235873e0 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:32:50.769198 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2735/5472] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:32:50 2022] POST /identity/v3/projects => generated 385 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:32:50.773496 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c0270b-17af-4733-a837-5912363ce011 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:32:50.786295 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c0270b-17af-4733-a837-5912363ce011 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:32:50.792458 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:32:50.867455 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f889c6a0-b0b9-4323-a211-43cb4fe948d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:32:50.868185 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f889c6a0-b0b9-4323-a211-43cb4fe948d6 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:32:50.868507 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f889c6a0-b0b9-4323-a211-43cb4fe948d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:32:50.868785 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f889c6a0-b0b9-4323-a211-43cb4fe948d6 admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:32:50.869484 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f889c6a0-b0b9-4323-a211-43cb4fe948d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:32:50.871621 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f889c6a0-b0b9-4323-a211-43cb4fe948d6 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:32:50.892378 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2738/5473] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:32:50 2022] POST /identity/v3/users => generated 293 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:32:50.896588 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930e2b3e-1e09-43ec-a562-3e7f235873e0 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:32:50.907922 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930e2b3e-1e09-43ec-a562-3e7f235873e0 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:32:50.913213 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6e7bbe-5773-41c8-9956-c227b94515ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:32:50.913907 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6e7bbe-5773-41c8-9956-c227b94515ef admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:32:50.914192 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6e7bbe-5773-41c8-9956-c227b94515ef admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:32:50.914461 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6e7bbe-5773-41c8-9956-c227b94515ef admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:32:50.915361 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6e7bbe-5773-41c8-9956-c227b94515ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:32:50.917072 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6e7bbe-5773-41c8-9956-c227b94515ef admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:32:50.928371 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2736/5474] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:32:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:32:50.932767 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f889c6a0-b0b9-4323-a211-43cb4fe948d6 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:32:50.943617 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f889c6a0-b0b9-4323-a211-43cb4fe948d6 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:32:50.949279 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af12f165-8ba4-4e3e-aca8-e97dc22b2a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:32:50.950044 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af12f165-8ba4-4e3e-aca8-e97dc22b2a21 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:32:50.950434 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af12f165-8ba4-4e3e-aca8-e97dc22b2a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:32:50.950717 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af12f165-8ba4-4e3e-aca8-e97dc22b2a21 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:32:50.951448 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af12f165-8ba4-4e3e-aca8-e97dc22b2a21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:32:50.953112 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af12f165-8ba4-4e3e-aca8-e97dc22b2a21 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:32:50.964443 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2739/5475] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:32:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:32:50.968645 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6e7bbe-5773-41c8-9956-c227b94515ef admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:32:50.982455 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6e7bbe-5773-41c8-9956-c227b94515ef admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:32:50.987415 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72403947-a54f-40be-9cf5-5b3d70513889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:32:50.988558 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72403947-a54f-40be-9cf5-5b3d70513889 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:32:50.988907 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72403947-a54f-40be-9cf5-5b3d70513889 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:32:50.989259 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72403947-a54f-40be-9cf5-5b3d70513889 admin admin] PATH_INFO: `/v3/projects/dff2bd5dd9da463b862a6709f247bcb6/users/f29e3f7b992c47939a25fadf858d4c8e/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:32:51.005816 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72403947-a54f-40be-9cf5-5b3d70513889 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dff2bd5dd9da463b862a6709f247bcb6, user_id=f29e3f7b992c47939a25fadf858d4c8e, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:32:51.008666 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72403947-a54f-40be-9cf5-5b3d70513889 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:32:51.029042 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2737/5476] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:32:50 2022] PUT /identity/v3/projects/dff2bd5dd9da463b862a6709f247bcb6/users/f29e3f7b992c47939a25fadf858d4c8e/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:32:51.040916 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f2a9d2-eb10-427a-b62d-785bf810606f None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:32:51.041205 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f2a9d2-eb10-427a-b62d-785bf810606f None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:32:51.041473 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f2a9d2-eb10-427a-b62d-785bf810606f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:32:51.078141 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-b4f2a9d2-eb10-427a-b62d-785bf810606f None None] MFA Rules not processed for user `f29e3f7b992c47939a25fadf858d4c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:32:51.079591 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-b4f2a9d2-eb10-427a-b62d-785bf810606f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:32:51.147826 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2740/5477] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:32:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:32:51.152336 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72403947-a54f-40be-9cf5-5b3d70513889 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:32:51.216933 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72403947-a54f-40be-9cf5-5b3d70513889 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:32:51.222244 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb8acca-4524-40e2-913b-4cb8af4287a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:32:51.222920 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb8acca-4524-40e2-913b-4cb8af4287a0 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:32:51.223193 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb8acca-4524-40e2-913b-4cb8af4287a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:32:51.223465 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb8acca-4524-40e2-913b-4cb8af4287a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:32:51.224163 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb8acca-4524-40e2-913b-4cb8af4287a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:32:51.226095 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb8acca-4524-40e2-913b-4cb8af4287a0 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:32:51.256609 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2738/5478] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:32:51 2022] POST /identity/v3/projects => generated 385 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:32:51.258265 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f2a9d2-eb10-427a-b62d-785bf810606f None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:32:51.269459 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f2a9d2-eb10-427a-b62d-785bf810606f None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:32:51.325056 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361f9b84-45ae-4ac1-b3e8-b5311711b312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:32:51.325719 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361f9b84-45ae-4ac1-b3e8-b5311711b312 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:32:51.326029 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361f9b84-45ae-4ac1-b3e8-b5311711b312 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:32:51.326302 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361f9b84-45ae-4ac1-b3e8-b5311711b312 admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:32:51.326984 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361f9b84-45ae-4ac1-b3e8-b5311711b312 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:32:51.328967 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361f9b84-45ae-4ac1-b3e8-b5311711b312 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:32:51.350153 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2741/5479] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:32:51 2022] POST /identity/v3/users => generated 300 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:32:51.355185 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb8acca-4524-40e2-913b-4cb8af4287a0 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:32:51.367319 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb8acca-4524-40e2-913b-4cb8af4287a0 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:32:51.372642 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf752c62-a521-46e3-af32-1c8e55f0c39a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:32:51.373321 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf752c62-a521-46e3-af32-1c8e55f0c39a admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:32:51.373603 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf752c62-a521-46e3-af32-1c8e55f0c39a admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:32:51.373904 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf752c62-a521-46e3-af32-1c8e55f0c39a admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:32:51.374638 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf752c62-a521-46e3-af32-1c8e55f0c39a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:32:51.376259 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf752c62-a521-46e3-af32-1c8e55f0c39a admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:32:51.388880 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2739/5480] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:32:51 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:32:51.393244 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361f9b84-45ae-4ac1-b3e8-b5311711b312 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:32:51.403826 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361f9b84-45ae-4ac1-b3e8-b5311711b312 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:32:51.408610 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60797f99-b4d0-4c84-ba2c-b85a2fd7c1e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:32:51.409743 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60797f99-b4d0-4c84-ba2c-b85a2fd7c1e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:32:51.410118 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60797f99-b4d0-4c84-ba2c-b85a2fd7c1e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:32:51.410434 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60797f99-b4d0-4c84-ba2c-b85a2fd7c1e7 admin admin] PATH_INFO: `/v3/projects/31044749aba94e06ba24b45686c84744/users/0de76d9e605145eb9259b1f6df4cb66f/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:32:51.412913 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:32:51.430317 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60797f99-b4d0-4c84-ba2c-b85a2fd7c1e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31044749aba94e06ba24b45686c84744, user_id=0de76d9e605145eb9259b1f6df4cb66f, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:32:51.433081 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60797f99-b4d0-4c84-ba2c-b85a2fd7c1e7 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:32:51.448156 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2742/5481] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:32:51 2022] PUT /identity/v3/projects/31044749aba94e06ba24b45686c84744/users/0de76d9e605145eb9259b1f6df4cb66f/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:32:51.458522 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360defbb-35a0-43a4-bac4-e9fe379edf2d None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:32:51.458839 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360defbb-35a0-43a4-bac4-e9fe379edf2d None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:32:51.459115 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360defbb-35a0-43a4-bac4-e9fe379edf2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:32:51.486122 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-360defbb-35a0-43a4-bac4-e9fe379edf2d None None] MFA Rules not processed for user `0de76d9e605145eb9259b1f6df4cb66f`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:32:51.487373 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-360defbb-35a0-43a4-bac4-e9fe379edf2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:32:51.538551 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:32:51.557116 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2740/5482] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:32:51 2022] POST /identity/v3/auth/tokens => generated 3259 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:32:51.586548 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60797f99-b4d0-4c84-ba2c-b85a2fd7c1e7 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:32:51.588565 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-60797f99-b4d0-4c84-ba2c-b85a2fd7c1e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:32:51.668639 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60797f99-b4d0-4c84-ba2c-b85a2fd7c1e7 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:32:51.674134 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05bf577-ebbd-4686-a728-698f7ed3c043 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f0a685b7da46afb81024848f079d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:32:51.674796 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05bf577-ebbd-4686-a728-698f7ed3c043 service swift] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:32:51.675066 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05bf577-ebbd-4686-a728-698f7ed3c043 service swift] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:32:51.675335 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05bf577-ebbd-4686-a728-698f7ed3c043 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:32:51.683826 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05bf577-ebbd-4686-a728-698f7ed3c043 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:32:51.685412 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05bf577-ebbd-4686-a728-698f7ed3c043 service swift] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:32:51.693583 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2743/5483] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 23 21:32:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 678 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 23 21:32:52.409790 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360defbb-35a0-43a4-bac4-e9fe379edf2d None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:32:52.475164 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360defbb-35a0-43a4-bac4-e9fe379edf2d None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:32:52.480187 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd2229c-f609-4e83-b68c-abe521d1ff82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:32:52.481079 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd2229c-f609-4e83-b68c-abe521d1ff82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:32:52.481362 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd2229c-f609-4e83-b68c-abe521d1ff82 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:32:52.481636 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd2229c-f609-4e83-b68c-abe521d1ff82 admin admin] PATH_INFO: `/v3/users/f29e3f7b992c47939a25fadf858d4c8e` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:32:52.482874 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd2229c-f609-4e83-b68c-abe521d1ff82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f29e3f7b992c47939a25fadf858d4c8e)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:32:52.485055 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd2229c-f609-4e83-b68c-abe521d1ff82 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:32:52.537198 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-efd2229c-f609-4e83-b68c-abe521d1ff82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f29e3f7b992c47939a25fadf858d4c8e'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:32:52.537977 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-efd2229c-f609-4e83-b68c-abe521d1ff82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f29e3f7b992c47939a25fadf858d4c8e'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:32:52.545585 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-efd2229c-f609-4e83-b68c-abe521d1ff82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f29e3f7b992c47939a25fadf858d4c8e'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:32:52.553470 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-efd2229c-f609-4e83-b68c-abe521d1ff82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f29e3f7b992c47939a25fadf858d4c8e'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:32:52.567685 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-efd2229c-f609-4e83-b68c-abe521d1ff82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f29e3f7b992c47939a25fadf858d4c8e'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:32:52.573916 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2741/5484] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:32:52 2022] DELETE /identity/v3/users/f29e3f7b992c47939a25fadf858d4c8e => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:32:52.578886 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5268d580-ca33-4e57-9476-497d5f83f4f5 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:32:52.579310 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5268d580-ca33-4e57-9476-497d5f83f4f5 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:32:52.579620 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5268d580-ca33-4e57-9476-497d5f83f4f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:32:52.598203 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-5268d580-ca33-4e57-9476-497d5f83f4f5 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:32:52.599435 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-5268d580-ca33-4e57-9476-497d5f83f4f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:32:52.668828 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2744/5485] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:32:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:32:52.699758 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd2229c-f609-4e83-b68c-abe521d1ff82 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:32:52.701185 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-efd2229c-f609-4e83-b68c-abe521d1ff82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:32:52.794991 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd2229c-f609-4e83-b68c-abe521d1ff82 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:32:52.798845 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6b7bda-1bbd-44a7-9b97-960f6787d53d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:32:52.799598 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6b7bda-1bbd-44a7-9b97-960f6787d53d service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:32:52.800099 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6b7bda-1bbd-44a7-9b97-960f6787d53d service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:32:52.800382 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6b7bda-1bbd-44a7-9b97-960f6787d53d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:32:52.812414 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6b7bda-1bbd-44a7-9b97-960f6787d53d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:32:52.814274 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6b7bda-1bbd-44a7-9b97-960f6787d53d service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:32:52.826633 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2742/5486] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:32:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 23 21:32:53.505181 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5268d580-ca33-4e57-9476-497d5f83f4f5 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:32:53.506635 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-5268d580-ca33-4e57-9476-497d5f83f4f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:32:53.520901 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5268d580-ca33-4e57-9476-497d5f83f4f5 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:32:53.541222 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4444b235-50d1-44d9-bc2d-ff138d825539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:32:53.542477 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4444b235-50d1-44d9-bc2d-ff138d825539 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:32:53.542839 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4444b235-50d1-44d9-bc2d-ff138d825539 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:32:53.544023 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4444b235-50d1-44d9-bc2d-ff138d825539 admin admin] PATH_INFO: `/v3/projects/dff2bd5dd9da463b862a6709f247bcb6` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:32:53.545490 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4444b235-50d1-44d9-bc2d-ff138d825539 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dff2bd5dd9da463b862a6709f247bcb6)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:32:53.549090 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4444b235-50d1-44d9-bc2d-ff138d825539 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:32:53.649513 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-4444b235-50d1-44d9-bc2d-ff138d825539 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dff2bd5dd9da463b862a6709f247bcb6', 'request_id': 'req-4444b235-50d1-44d9-bc2d-ff138d825539'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:32:53.659470 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-4444b235-50d1-44d9-bc2d-ff138d825539 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dff2bd5dd9da463b862a6709f247bcb6', 'request_id': 'req-4444b235-50d1-44d9-bc2d-ff138d825539'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:32:53.667182 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-4444b235-50d1-44d9-bc2d-ff138d825539 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dff2bd5dd9da463b862a6709f247bcb6', 'request_id': 'req-4444b235-50d1-44d9-bc2d-ff138d825539'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:32:53.671923 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:32:53.685430 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-4444b235-50d1-44d9-bc2d-ff138d825539 admin admin] The token cache is being invalidate because project dff2bd5dd9da463b862a6709f247bcb6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:32:53.686078 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-4444b235-50d1-44d9-bc2d-ff138d825539 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:32:53.687688 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-4444b235-50d1-44d9-bc2d-ff138d825539 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:32:53.690233 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2745/5487] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:32:53 2022] DELETE /identity/v3/projects/dff2bd5dd9da463b862a6709f247bcb6 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:32:53.694977 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6b7bda-1bbd-44a7-9b97-960f6787d53d service neutron] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:32:53.708524 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6b7bda-1bbd-44a7-9b97-960f6787d53d service neutron] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:32:53.720630 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:32:53.801470 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b029cf4-5e74-45a6-991c-2d63ed6ef172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:32:53.802938 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b029cf4-5e74-45a6-991c-2d63ed6ef172 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:32:53.803449 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b029cf4-5e74-45a6-991c-2d63ed6ef172 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:32:53.803929 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b029cf4-5e74-45a6-991c-2d63ed6ef172 admin admin] PATH_INFO: `/v3/users/0de76d9e605145eb9259b1f6df4cb66f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:32:53.805463 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b029cf4-5e74-45a6-991c-2d63ed6ef172 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0de76d9e605145eb9259b1f6df4cb66f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:32:53.807945 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b029cf4-5e74-45a6-991c-2d63ed6ef172 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:32:53.875531 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-0b029cf4-5e74-45a6-991c-2d63ed6ef172 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0de76d9e605145eb9259b1f6df4cb66f'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:32:53.876468 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-0b029cf4-5e74-45a6-991c-2d63ed6ef172 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0de76d9e605145eb9259b1f6df4cb66f'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:32:53.885007 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-0b029cf4-5e74-45a6-991c-2d63ed6ef172 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0de76d9e605145eb9259b1f6df4cb66f'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:32:53.895852 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-0b029cf4-5e74-45a6-991c-2d63ed6ef172 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0de76d9e605145eb9259b1f6df4cb66f'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:32:53.910208 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-0b029cf4-5e74-45a6-991c-2d63ed6ef172 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0de76d9e605145eb9259b1f6df4cb66f'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:32:53.917069 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2743/5488] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:32:53 2022] DELETE /identity/v3/users/0de76d9e605145eb9259b1f6df4cb66f => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:32:54.430910 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4444b235-50d1-44d9-bc2d-ff138d825539 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:32:54.431909 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-4444b235-50d1-44d9-bc2d-ff138d825539 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:32:54.448735 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4444b235-50d1-44d9-bc2d-ff138d825539 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:32:54.518296 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b0db83-501d-453e-a2e8-92d55b1655e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:32:54.520283 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b0db83-501d-453e-a2e8-92d55b1655e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:32:54.520562 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b0db83-501d-453e-a2e8-92d55b1655e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:32:54.520834 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b0db83-501d-453e-a2e8-92d55b1655e6 admin admin] PATH_INFO: `/v3/projects/31044749aba94e06ba24b45686c84744` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:32:54.522556 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b0db83-501d-453e-a2e8-92d55b1655e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=31044749aba94e06ba24b45686c84744)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:32:54.525102 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b0db83-501d-453e-a2e8-92d55b1655e6 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:32:54.614595 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-14b0db83-501d-453e-a2e8-92d55b1655e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31044749aba94e06ba24b45686c84744', 'request_id': 'req-14b0db83-501d-453e-a2e8-92d55b1655e6'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:32:54.625037 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-14b0db83-501d-453e-a2e8-92d55b1655e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31044749aba94e06ba24b45686c84744', 'request_id': 'req-14b0db83-501d-453e-a2e8-92d55b1655e6'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:32:54.632697 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-14b0db83-501d-453e-a2e8-92d55b1655e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31044749aba94e06ba24b45686c84744', 'request_id': 'req-14b0db83-501d-453e-a2e8-92d55b1655e6'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:32:54.654033 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-14b0db83-501d-453e-a2e8-92d55b1655e6 admin admin] The token cache is being invalidate because project 31044749aba94e06ba24b45686c84744 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:32:54.655139 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-14b0db83-501d-453e-a2e8-92d55b1655e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:32:54.655904 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-14b0db83-501d-453e-a2e8-92d55b1655e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:32:54.657986 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2746/5489] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:32:54 2022] DELETE /identity/v3/projects/31044749aba94e06ba24b45686c84744 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:32:54.662900 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15e37a1-11c8-49d2-aac4-4b34ba1ee8bc None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:32:54.663191 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15e37a1-11c8-49d2-aac4-4b34ba1ee8bc None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:32:54.663470 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15e37a1-11c8-49d2-aac4-4b34ba1ee8bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:32:54.684043 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-b15e37a1-11c8-49d2-aac4-4b34ba1ee8bc None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:32:54.685549 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-b15e37a1-11c8-49d2-aac4-4b34ba1ee8bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:32:54.770879 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2744/5490] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:32:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:32:54.780193 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44f9c27-8b19-4b00-9072-24fe54408d91 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:32:54.780550 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44f9c27-8b19-4b00-9072-24fe54408d91 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:32:54.780893 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44f9c27-8b19-4b00-9072-24fe54408d91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:32:54.806409 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-e44f9c27-8b19-4b00-9072-24fe54408d91 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:32:54.807570 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-e44f9c27-8b19-4b00-9072-24fe54408d91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:32:54.821658 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2747/5491] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:32:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:32:54.825834 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15e37a1-11c8-49d2-aac4-4b34ba1ee8bc None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:32:54.836873 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15e37a1-11c8-49d2-aac4-4b34ba1ee8bc None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:32:54.841697 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70dfe7a-41e6-4fae-86ae-f71283a51e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:32:54.842644 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70dfe7a-41e6-4fae-86ae-f71283a51e66 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:32:54.843079 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70dfe7a-41e6-4fae-86ae-f71283a51e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:32:54.843503 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70dfe7a-41e6-4fae-86ae-f71283a51e66 admin admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:32:54.845563 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70dfe7a-41e6-4fae-86ae-f71283a51e66 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:32:54.846056 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70dfe7a-41e6-4fae-86ae-f71283a51e66 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:32:54.848476 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70dfe7a-41e6-4fae-86ae-f71283a51e66 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:32:54.866125 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2745/5492] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:32:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 21:32:54.869261 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44f9c27-8b19-4b00-9072-24fe54408d91 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:32:54.885012 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44f9c27-8b19-4b00-9072-24fe54408d91 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:32:54.894816 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177900d5-6970-448a-a369-649a0dd9ccec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:32:54.895765 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177900d5-6970-448a-a369-649a0dd9ccec admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:32:54.896302 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177900d5-6970-448a-a369-649a0dd9ccec admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:32:54.896588 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177900d5-6970-448a-a369-649a0dd9ccec admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:32:54.897415 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177900d5-6970-448a-a369-649a0dd9ccec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:32:54.899560 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177900d5-6970-448a-a369-649a0dd9ccec admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:32:54.967682 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2748/5493] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:32:54 2022] POST /identity/v3/projects => generated 371 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:32:54.972345 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70dfe7a-41e6-4fae-86ae-f71283a51e66 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:32:54.985301 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70dfe7a-41e6-4fae-86ae-f71283a51e66 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:32:55.014642 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:32:55.074896 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525d5bd8-d296-409c-a619-5ee9b2312161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:32:55.075936 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525d5bd8-d296-409c-a619-5ee9b2312161 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:32:55.076376 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525d5bd8-d296-409c-a619-5ee9b2312161 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:32:55.076865 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525d5bd8-d296-409c-a619-5ee9b2312161 admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:32:55.077716 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525d5bd8-d296-409c-a619-5ee9b2312161 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:32:55.079966 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525d5bd8-d296-409c-a619-5ee9b2312161 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:32:55.118275 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2746/5494] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:32:54 2022] POST /identity/v3/users => generated 286 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:32:55.119745 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177900d5-6970-448a-a369-649a0dd9ccec admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:32:55.143430 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177900d5-6970-448a-a369-649a0dd9ccec admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:32:55.167225 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014b570d-694d-48ed-b1e3-26029c5cca73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:32:55.167948 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014b570d-694d-48ed-b1e3-26029c5cca73 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:32:55.168236 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014b570d-694d-48ed-b1e3-26029c5cca73 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:32:55.168530 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014b570d-694d-48ed-b1e3-26029c5cca73 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:32:55.172950 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014b570d-694d-48ed-b1e3-26029c5cca73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:32:55.174658 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014b570d-694d-48ed-b1e3-26029c5cca73 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:32:55.194114 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2749/5495] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:32:55 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:32:55.197814 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525d5bd8-d296-409c-a619-5ee9b2312161 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:32:55.212251 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525d5bd8-d296-409c-a619-5ee9b2312161 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:32:55.217818 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58650d42-de64-4ead-8cff-4ac3a7740368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:32:55.218549 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58650d42-de64-4ead-8cff-4ac3a7740368 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:32:55.218828 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58650d42-de64-4ead-8cff-4ac3a7740368 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:32:55.219102 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58650d42-de64-4ead-8cff-4ac3a7740368 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:32:55.219831 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58650d42-de64-4ead-8cff-4ac3a7740368 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:32:55.221475 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58650d42-de64-4ead-8cff-4ac3a7740368 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:32:55.232611 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2747/5496] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:32:55 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:32:55.237022 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014b570d-694d-48ed-b1e3-26029c5cca73 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:32:55.248280 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014b570d-694d-48ed-b1e3-26029c5cca73 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:32:55.253410 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8794d891-f0be-4cde-9f8a-dee822c77f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:32:55.254761 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8794d891-f0be-4cde-9f8a-dee822c77f29 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:32:55.254961 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8794d891-f0be-4cde-9f8a-dee822c77f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:32:55.256489 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8794d891-f0be-4cde-9f8a-dee822c77f29 admin admin] PATH_INFO: `/v3/projects/6f1825873b0849ea98136c0979b251c4/users/47bdbd5d201c465a82540c1d8c0fdf57/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:32:55.272762 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8794d891-f0be-4cde-9f8a-dee822c77f29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f1825873b0849ea98136c0979b251c4, user_id=47bdbd5d201c465a82540c1d8c0fdf57, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:32:55.276346 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8794d891-f0be-4cde-9f8a-dee822c77f29 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:32:55.290816 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2750/5497] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:32:55 2022] PUT /identity/v3/projects/6f1825873b0849ea98136c0979b251c4/users/47bdbd5d201c465a82540c1d8c0fdf57/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:32:55.296937 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d07c110-78ae-491d-8ee8-1fedd4b1bb94 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:32:55.297230 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d07c110-78ae-491d-8ee8-1fedd4b1bb94 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:32:55.297513 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d07c110-78ae-491d-8ee8-1fedd4b1bb94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:32:55.318485 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-4d07c110-78ae-491d-8ee8-1fedd4b1bb94 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:32:55.319724 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-4d07c110-78ae-491d-8ee8-1fedd4b1bb94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:32:55.389813 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2748/5498] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:32:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:32:55.399883 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8794d891-f0be-4cde-9f8a-dee822c77f29 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:32:55.401727 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-8794d891-f0be-4cde-9f8a-dee822c77f29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:32:55.428885 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:32:55.466714 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8794d891-f0be-4cde-9f8a-dee822c77f29 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:32:55.470471 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a7f15f-4d97-42c6-9366-aede58df1d4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:32:55.471133 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a7f15f-4d97-42c6-9366-aede58df1d4d service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:32:55.471408 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a7f15f-4d97-42c6-9366-aede58df1d4d service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:32:55.471676 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a7f15f-4d97-42c6-9366-aede58df1d4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:32:55.482417 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a7f15f-4d97-42c6-9366-aede58df1d4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:32:55.483875 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a7f15f-4d97-42c6-9366-aede58df1d4d service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:32:55.495387 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2751/5499] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:32:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:32:58.256662 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f645af8-01a1-4493-8cf4-204e585599ab None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:32:58.257187 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f645af8-01a1-4493-8cf4-204e585599ab None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:32:58.257273 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f645af8-01a1-4493-8cf4-204e585599ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:32:58.285991 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-3f645af8-01a1-4493-8cf4-204e585599ab None None] MFA Rules not processed for user `37b1e260651b4dffa7c1efe8e9d0f144`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:32:58.287217 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-3f645af8-01a1-4493-8cf4-204e585599ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:32:58.368028 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2749/5500] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:32:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:32:59.303228 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eb2613-22cb-4799-9a60-1e9ab8a95d68 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:32:59.304332 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eb2613-22cb-4799-9a60-1e9ab8a95d68 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:32:59.305164 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eb2613-22cb-4799-9a60-1e9ab8a95d68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:32:59.331719 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-54eb2613-22cb-4799-9a60-1e9ab8a95d68 None None] MFA Rules not processed for user `17b779a3e21a415bb42cde5d6863d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:32:59.333442 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-54eb2613-22cb-4799-9a60-1e9ab8a95d68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:32:59.425302 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2752/5501] 10.222.0.17 () {58 vars in 967 bytes} [Sat Jul 23 21:32:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:32:59.432712 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f645af8-01a1-4493-8cf4-204e585599ab None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:32:59.435211 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-3f645af8-01a1-4493-8cf4-204e585599ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:32:59.505353 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:32:59.607258 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f645af8-01a1-4493-8cf4-204e585599ab None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:32:59.619096 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00310fa8-19f7-4139-b82f-4059c0855244 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f0a685b7da46afb81024848f079d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:32:59.619847 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00310fa8-19f7-4139-b82f-4059c0855244 service swift] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:32:59.620130 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00310fa8-19f7-4139-b82f-4059c0855244 service swift] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:32:59.620721 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00310fa8-19f7-4139-b82f-4059c0855244 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:32:59.634669 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00310fa8-19f7-4139-b82f-4059c0855244 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:32:59.636918 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00310fa8-19f7-4139-b82f-4059c0855244 service swift] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:32:59.651148 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2750/5502] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 23 21:32:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 23 21:33:05.356092 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7065f1-d96f-4757-879a-b464cebc12cc None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:05.356596 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7065f1-d96f-4757-879a-b464cebc12cc None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:05.356802 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7065f1-d96f-4757-879a-b464cebc12cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:05.401773 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-ac7065f1-d96f-4757-879a-b464cebc12cc None None] MFA Rules not processed for user `47bdbd5d201c465a82540c1d8c0fdf57`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:33:05.403164 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-ac7065f1-d96f-4757-879a-b464cebc12cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:05.510096 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2753/5503] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:33:05 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:33:05.515637 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00310fa8-19f7-4139-b82f-4059c0855244 service swift] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:05.536425 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00310fa8-19f7-4139-b82f-4059c0855244 service swift] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:05.553290 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c562a13-04aa-4082-9187-254068675af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:05.554894 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c562a13-04aa-4082-9187-254068675af1 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:05.556113 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c562a13-04aa-4082-9187-254068675af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:05.556497 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c562a13-04aa-4082-9187-254068675af1 admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:05.557881 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c562a13-04aa-4082-9187-254068675af1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:05.560001 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c562a13-04aa-4082-9187-254068675af1 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:05.614648 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2751/5504] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:33:05 2022] POST /identity/v3/projects => generated 373 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:33:05.623755 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7065f1-d96f-4757-879a-b464cebc12cc None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:05.657256 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7065f1-d96f-4757-879a-b464cebc12cc None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:05.793832 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b73465c-d5ad-4e28-9837-3d1e6e2b7fd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:05.794579 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b73465c-d5ad-4e28-9837-3d1e6e2b7fd9 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:05.795049 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b73465c-d5ad-4e28-9837-3d1e6e2b7fd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:05.795364 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b73465c-d5ad-4e28-9837-3d1e6e2b7fd9 admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:05.798260 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b73465c-d5ad-4e28-9837-3d1e6e2b7fd9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:05.800876 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b73465c-d5ad-4e28-9837-3d1e6e2b7fd9 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:05.818190 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:33:05.856004 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2754/5505] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:33:05 2022] POST /identity/v3/users => generated 293 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:33:05.860603 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c562a13-04aa-4082-9187-254068675af1 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:05.879603 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c562a13-04aa-4082-9187-254068675af1 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:05.898789 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b244ccb-399c-44a4-8914-70f8d4918fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:05.902157 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b244ccb-399c-44a4-8914-70f8d4918fc0 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:05.902443 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b244ccb-399c-44a4-8914-70f8d4918fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:05.902720 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b244ccb-399c-44a4-8914-70f8d4918fc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:05.903467 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b244ccb-399c-44a4-8914-70f8d4918fc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:05.907851 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b244ccb-399c-44a4-8914-70f8d4918fc0 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:05.951506 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2752/5506] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:33:05 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:33:05.956345 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b73465c-d5ad-4e28-9837-3d1e6e2b7fd9 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:05.993335 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b73465c-d5ad-4e28-9837-3d1e6e2b7fd9 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:05.999290 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9446c822-cbad-45a0-b449-cc5fa2ea197c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:06.000381 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9446c822-cbad-45a0-b449-cc5fa2ea197c admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:06.001145 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9446c822-cbad-45a0-b449-cc5fa2ea197c admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:06.001429 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9446c822-cbad-45a0-b449-cc5fa2ea197c admin admin] PATH_INFO: `/v3/projects/6bba4cc301d8412ea4b79e2403d58ce2/users/b338527a084f45d3bb03e2b69c486d8d/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:06.051185 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9446c822-cbad-45a0-b449-cc5fa2ea197c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bba4cc301d8412ea4b79e2403d58ce2, user_id=b338527a084f45d3bb03e2b69c486d8d, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:06.054599 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9446c822-cbad-45a0-b449-cc5fa2ea197c admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:06.078921 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2755/5507] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:33:05 2022] PUT /identity/v3/projects/6bba4cc301d8412ea4b79e2403d58ce2/users/b338527a084f45d3bb03e2b69c486d8d/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:33:06.083037 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b244ccb-399c-44a4-8914-70f8d4918fc0 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:06.104783 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b244ccb-399c-44a4-8914-70f8d4918fc0 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:06.271518 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38acc3f-7f9b-4700-ac05-c2be155c9382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:06.272341 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38acc3f-7f9b-4700-ac05-c2be155c9382 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:06.272695 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38acc3f-7f9b-4700-ac05-c2be155c9382 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:06.273051 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38acc3f-7f9b-4700-ac05-c2be155c9382 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:06.273948 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38acc3f-7f9b-4700-ac05-c2be155c9382 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:06.280713 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38acc3f-7f9b-4700-ac05-c2be155c9382 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:06.314061 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2753/5508] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:33:06 2022] GET /identity/v3/roles => generated 1420 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:33:06.318152 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9446c822-cbad-45a0-b449-cc5fa2ea197c admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:06.352893 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9446c822-cbad-45a0-b449-cc5fa2ea197c admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:06.368356 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd096ba-b15f-469b-8a3b-540e4238a58c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:06.372583 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd096ba-b15f-469b-8a3b-540e4238a58c admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:06.373059 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd096ba-b15f-469b-8a3b-540e4238a58c admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:06.373501 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd096ba-b15f-469b-8a3b-540e4238a58c admin admin] PATH_INFO: `/v3/projects/6bba4cc301d8412ea4b79e2403d58ce2/users/b338527a084f45d3bb03e2b69c486d8d/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:06.377214 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd096ba-b15f-469b-8a3b-540e4238a58c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bba4cc301d8412ea4b79e2403d58ce2, user_id=b338527a084f45d3bb03e2b69c486d8d, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:06.380745 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd096ba-b15f-469b-8a3b-540e4238a58c admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:06.420491 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2756/5509] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:33:06 2022] PUT /identity/v3/projects/6bba4cc301d8412ea4b79e2403d58ce2/users/b338527a084f45d3bb03e2b69c486d8d/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:33:07.981393 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38acc3f-7f9b-4700-ac05-c2be155c9382 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:07.983438 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-c38acc3f-7f9b-4700-ac05-c2be155c9382 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:08.151777 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38acc3f-7f9b-4700-ac05-c2be155c9382 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:08.252215 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:33:08.295514 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee38c7ae-5080-402a-ad66-5fd3e00cd2e6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc719a3b3ac4461b82ca04ab6451d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:08.296657 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee38c7ae-5080-402a-ad66-5fd3e00cd2e6 service placement] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:08.297199 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee38c7ae-5080-402a-ad66-5fd3e00cd2e6 service placement] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:08.297682 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee38c7ae-5080-402a-ad66-5fd3e00cd2e6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:08.300194 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-ee38c7ae-5080-402a-ad66-5fd3e00cd2e6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:08.323427 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee38c7ae-5080-402a-ad66-5fd3e00cd2e6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:08.327451 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee38c7ae-5080-402a-ad66-5fd3e00cd2e6 service placement] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:08.356574 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2754/5510] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:33:07 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:33:16.111389 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78be2ed6-eb4c-44aa-a2c1-8d7462df6d18 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:16.112798 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78be2ed6-eb4c-44aa-a2c1-8d7462df6d18 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:16.113128 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78be2ed6-eb4c-44aa-a2c1-8d7462df6d18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:16.157616 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-78be2ed6-eb4c-44aa-a2c1-8d7462df6d18 None None] MFA Rules not processed for user `b338527a084f45d3bb03e2b69c486d8d`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:33:16.159770 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-78be2ed6-eb4c-44aa-a2c1-8d7462df6d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:16.295344 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2757/5511] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:33:16 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:33:16.331495 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee38c7ae-5080-402a-ad66-5fd3e00cd2e6 service placement] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:16.333135 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-ee38c7ae-5080-402a-ad66-5fd3e00cd2e6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:16.482636 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee38c7ae-5080-402a-ad66-5fd3e00cd2e6 service placement] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:16.489907 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625c6f0f-78ee-443b-91b4-058a7178d2f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:16.491710 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625c6f0f-78ee-443b-91b4-058a7178d2f0 service nova] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:16.492083 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625c6f0f-78ee-443b-91b4-058a7178d2f0 service nova] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:16.492594 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625c6f0f-78ee-443b-91b4-058a7178d2f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:16.576809 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625c6f0f-78ee-443b-91b4-058a7178d2f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:16.579496 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625c6f0f-78ee-443b-91b4-058a7178d2f0 service nova] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:16.606463 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2755/5512] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:33:16 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:33:21.368580 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909df020-ed3f-4c32-be77-ed56c751d570 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:21.369144 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909df020-ed3f-4c32-be77-ed56c751d570 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:21.369144 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909df020-ed3f-4c32-be77-ed56c751d570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:21.407900 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-909df020-ed3f-4c32-be77-ed56c751d570 None None] MFA Rules not processed for user `47bdbd5d201c465a82540c1d8c0fdf57`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:33:21.410249 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-909df020-ed3f-4c32-be77-ed56c751d570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:21.422912 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2758/5513] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:33:21 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:33:25.925559 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613403ed-675b-439a-a9d9-641211c8b342 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:25.926782 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613403ed-675b-439a-a9d9-641211c8b342 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:25.927392 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613403ed-675b-439a-a9d9-641211c8b342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:25.953854 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-613403ed-675b-439a-a9d9-641211c8b342 None None] MFA Rules not processed for user `bc4aa131e63349b2aa8f37fdf6d2fe00`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:33:25.956611 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-613403ed-675b-439a-a9d9-641211c8b342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:26.078275 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2756/5514] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:33:25 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:33:28.294764 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909df020-ed3f-4c32-be77-ed56c751d570 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:28.296456 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-909df020-ed3f-4c32-be77-ed56c751d570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:28.463042 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909df020-ed3f-4c32-be77-ed56c751d570 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:28.469697 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d0df92-12d6-49b7-b4ff-59014d98f403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:28.470851 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d0df92-12d6-49b7-b4ff-59014d98f403 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:28.471226 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d0df92-12d6-49b7-b4ff-59014d98f403 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:28.471655 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d0df92-12d6-49b7-b4ff-59014d98f403 admin admin] PATH_INFO: `/v3/users/0bd49331138a4dbc912bc7bf6f6b0215` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:28.473501 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d0df92-12d6-49b7-b4ff-59014d98f403 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0bd49331138a4dbc912bc7bf6f6b0215)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:28.476084 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d0df92-12d6-49b7-b4ff-59014d98f403 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:28.567161 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:INSERT=5,keystone:SELECT=90,keystone:DELETE=5 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:33:28.596613 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-a0d0df92-12d6-49b7-b4ff-59014d98f403 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0bd49331138a4dbc912bc7bf6f6b0215'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:28.612736 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-a0d0df92-12d6-49b7-b4ff-59014d98f403 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0bd49331138a4dbc912bc7bf6f6b0215'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:28.614623 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-a0d0df92-12d6-49b7-b4ff-59014d98f403 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0bd49331138a4dbc912bc7bf6f6b0215'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:28.633512 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-a0d0df92-12d6-49b7-b4ff-59014d98f403 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0bd49331138a4dbc912bc7bf6f6b0215'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:28.651484 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-a0d0df92-12d6-49b7-b4ff-59014d98f403 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0bd49331138a4dbc912bc7bf6f6b0215'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:28.659018 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2759/5515] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:33:28 2022] DELETE /identity/v3/users/0bd49331138a4dbc912bc7bf6f6b0215 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:33:28.663976 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c158a62f-c08c-4fc7-a96f-a41cc7be879f None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:28.664503 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c158a62f-c08c-4fc7-a96f-a41cc7be879f None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:28.664813 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c158a62f-c08c-4fc7-a96f-a41cc7be879f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:28.695978 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-c158a62f-c08c-4fc7-a96f-a41cc7be879f None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:33:28.697544 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-c158a62f-c08c-4fc7-a96f-a41cc7be879f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:28.709923 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:33:28.858813 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2757/5516] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:33:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:33:28.891646 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d0df92-12d6-49b7-b4ff-59014d98f403 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:28.893501 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-a0d0df92-12d6-49b7-b4ff-59014d98f403 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:29.000755 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d0df92-12d6-49b7-b4ff-59014d98f403 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:29.005295 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afd0cc8-019c-4340-8646-0d89f008fb0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:29.005994 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afd0cc8-019c-4340-8646-0d89f008fb0e service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:29.006280 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afd0cc8-019c-4340-8646-0d89f008fb0e service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:29.006661 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afd0cc8-019c-4340-8646-0d89f008fb0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:29.030291 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afd0cc8-019c-4340-8646-0d89f008fb0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:29.031900 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afd0cc8-019c-4340-8646-0d89f008fb0e service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:29.064582 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2760/5517] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:33:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:33:29.390658 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c158a62f-c08c-4fc7-a96f-a41cc7be879f None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:29.392366 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-c158a62f-c08c-4fc7-a96f-a41cc7be879f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:29.411484 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c158a62f-c08c-4fc7-a96f-a41cc7be879f None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:29.419843 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f92be6-2f82-4e50-b96b-281558e4730e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:29.420916 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f92be6-2f82-4e50-b96b-281558e4730e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:29.421205 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f92be6-2f82-4e50-b96b-281558e4730e admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:29.422214 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f92be6-2f82-4e50-b96b-281558e4730e admin admin] PATH_INFO: `/v3/users/6ca9644a73d9468aa39b21548a72bded` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:29.423904 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f92be6-2f82-4e50-b96b-281558e4730e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ca9644a73d9468aa39b21548a72bded)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:29.426828 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f92be6-2f82-4e50-b96b-281558e4730e admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:29.520362 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-92f92be6-2f82-4e50-b96b-281558e4730e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ca9644a73d9468aa39b21548a72bded'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:29.521441 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-92f92be6-2f82-4e50-b96b-281558e4730e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ca9644a73d9468aa39b21548a72bded'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:29.532690 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-92f92be6-2f82-4e50-b96b-281558e4730e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ca9644a73d9468aa39b21548a72bded'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:29.553722 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-92f92be6-2f82-4e50-b96b-281558e4730e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ca9644a73d9468aa39b21548a72bded'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:29.574038 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-92f92be6-2f82-4e50-b96b-281558e4730e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ca9644a73d9468aa39b21548a72bded'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:29.586407 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2758/5518] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:33:29 2022] DELETE /identity/v3/users/6ca9644a73d9468aa39b21548a72bded => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:33:29.606121 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afd0cc8-019c-4340-8646-0d89f008fb0e service neutron] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:29.615245 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-4afd0cc8-019c-4340-8646-0d89f008fb0e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:29.630745 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afd0cc8-019c-4340-8646-0d89f008fb0e service neutron] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:29.834540 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9b843d-e0be-4ad3-91b5-8773ed73a2d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:29.835705 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9b843d-e0be-4ad3-91b5-8773ed73a2d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:29.836025 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9b843d-e0be-4ad3-91b5-8773ed73a2d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:29.836418 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9b843d-e0be-4ad3-91b5-8773ed73a2d2 admin admin] PATH_INFO: `/v3/projects/842a1aca542f416eab5d43b881325917` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:29.837762 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9b843d-e0be-4ad3-91b5-8773ed73a2d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=842a1aca542f416eab5d43b881325917)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:29.840174 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9b843d-e0be-4ad3-91b5-8773ed73a2d2 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:29.928822 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-6e9b843d-e0be-4ad3-91b5-8773ed73a2d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '842a1aca542f416eab5d43b881325917', 'request_id': 'req-6e9b843d-e0be-4ad3-91b5-8773ed73a2d2'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:29.947177 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:33:29.955443 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-6e9b843d-e0be-4ad3-91b5-8773ed73a2d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '842a1aca542f416eab5d43b881325917', 'request_id': 'req-6e9b843d-e0be-4ad3-91b5-8773ed73a2d2'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:29.967536 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-6e9b843d-e0be-4ad3-91b5-8773ed73a2d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '842a1aca542f416eab5d43b881325917', 'request_id': 'req-6e9b843d-e0be-4ad3-91b5-8773ed73a2d2'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:29.988355 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-6e9b843d-e0be-4ad3-91b5-8773ed73a2d2 admin admin] The token cache is being invalidate because project 842a1aca542f416eab5d43b881325917 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:33:29.988879 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-6e9b843d-e0be-4ad3-91b5-8773ed73a2d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:29.990142 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-6e9b843d-e0be-4ad3-91b5-8773ed73a2d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:29.992786 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2761/5519] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:33:29 2022] DELETE /identity/v3/projects/842a1aca542f416eab5d43b881325917 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:33:29.996415 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f92be6-2f82-4e50-b96b-281558e4730e admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:29.998350 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-92f92be6-2f82-4e50-b96b-281558e4730e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:30.017924 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f92be6-2f82-4e50-b96b-281558e4730e admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:30.128118 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab1e364-5f72-4496-80e1-ff7b35e89283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:30.129725 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab1e364-5f72-4496-80e1-ff7b35e89283 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:30.131256 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab1e364-5f72-4496-80e1-ff7b35e89283 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:30.131400 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab1e364-5f72-4496-80e1-ff7b35e89283 admin admin] PATH_INFO: `/v3/users/d796e9b844ce4b9e9dc9285ca2ad4c5f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:30.133809 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab1e364-5f72-4496-80e1-ff7b35e89283 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d796e9b844ce4b9e9dc9285ca2ad4c5f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:30.136891 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab1e364-5f72-4496-80e1-ff7b35e89283 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:30.187118 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:33:30.231856 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-3ab1e364-5f72-4496-80e1-ff7b35e89283 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd796e9b844ce4b9e9dc9285ca2ad4c5f'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:30.232819 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-3ab1e364-5f72-4496-80e1-ff7b35e89283 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd796e9b844ce4b9e9dc9285ca2ad4c5f'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:30.242927 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-3ab1e364-5f72-4496-80e1-ff7b35e89283 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd796e9b844ce4b9e9dc9285ca2ad4c5f'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:30.261558 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-3ab1e364-5f72-4496-80e1-ff7b35e89283 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd796e9b844ce4b9e9dc9285ca2ad4c5f'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:30.290437 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-3ab1e364-5f72-4496-80e1-ff7b35e89283 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd796e9b844ce4b9e9dc9285ca2ad4c5f'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:30.298590 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2759/5520] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:33:29 2022] DELETE /identity/v3/users/d796e9b844ce4b9e9dc9285ca2ad4c5f => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:33:30.627533 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9b843d-e0be-4ad3-91b5-8773ed73a2d2 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:30.628974 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-6e9b843d-e0be-4ad3-91b5-8773ed73a2d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:30.649468 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9b843d-e0be-4ad3-91b5-8773ed73a2d2 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:30.771098 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1b1576-6023-4002-90d0-1d016a608599 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:30.771456 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1b1576-6023-4002-90d0-1d016a608599 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:30.771758 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1b1576-6023-4002-90d0-1d016a608599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:30.777444 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d271272-31a4-4081-81b2-95961a3ccfc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:30.779417 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d271272-31a4-4081-81b2-95961a3ccfc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:30.779834 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d271272-31a4-4081-81b2-95961a3ccfc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:30.780205 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d271272-31a4-4081-81b2-95961a3ccfc1 admin admin] PATH_INFO: `/v3/projects/d70f6c96e1ad484aa3207fc01a12d519` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:30.782162 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d271272-31a4-4081-81b2-95961a3ccfc1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d70f6c96e1ad484aa3207fc01a12d519)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:30.785657 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d271272-31a4-4081-81b2-95961a3ccfc1 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:30.810806 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-bb1b1576-6023-4002-90d0-1d016a608599 None None] MFA Rules not processed for user `048f5756139b4283b695c057647983ba`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:33:30.813509 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-bb1b1576-6023-4002-90d0-1d016a608599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:30.861685 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-8d271272-31a4-4081-81b2-95961a3ccfc1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd70f6c96e1ad484aa3207fc01a12d519', 'request_id': 'req-8d271272-31a4-4081-81b2-95961a3ccfc1'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:30.873197 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-8d271272-31a4-4081-81b2-95961a3ccfc1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd70f6c96e1ad484aa3207fc01a12d519', 'request_id': 'req-8d271272-31a4-4081-81b2-95961a3ccfc1'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:30.887287 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-8d271272-31a4-4081-81b2-95961a3ccfc1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd70f6c96e1ad484aa3207fc01a12d519', 'request_id': 'req-8d271272-31a4-4081-81b2-95961a3ccfc1'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:30.892335 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2760/5521] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:33:30 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:33:30.901589 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-8d271272-31a4-4081-81b2-95961a3ccfc1 admin admin] The token cache is being invalidate because project d70f6c96e1ad484aa3207fc01a12d519 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:33:30.901589 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-8d271272-31a4-4081-81b2-95961a3ccfc1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:30.902353 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-8d271272-31a4-4081-81b2-95961a3ccfc1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:30.905910 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2762/5522] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:33:30 2022] DELETE /identity/v3/projects/d70f6c96e1ad484aa3207fc01a12d519 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:33:30.909018 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9150fb-76bf-476f-94c6-306f2a996742 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:30.909312 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9150fb-76bf-476f-94c6-306f2a996742 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:30.909589 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9150fb-76bf-476f-94c6-306f2a996742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:30.938893 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-7c9150fb-76bf-476f-94c6-306f2a996742 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:33:30.940316 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-7c9150fb-76bf-476f-94c6-306f2a996742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:31.063499 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe4e164-789a-44c3-b94f-40c98c399747 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:31.063883 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe4e164-789a-44c3-b94f-40c98c399747 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:31.064055 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2761/5523] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:33:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:33:31.064597 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe4e164-789a-44c3-b94f-40c98c399747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:31.103219 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-ebe4e164-789a-44c3-b94f-40c98c399747 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:33:31.104648 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-ebe4e164-789a-44c3-b94f-40c98c399747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:31.119028 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2763/5524] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:33:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:33:31.123762 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9150fb-76bf-476f-94c6-306f2a996742 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:31.142546 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9150fb-76bf-476f-94c6-306f2a996742 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:31.160706 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6971ea4-ba63-44b2-a9c5-a90cc7271c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:31.161391 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6971ea4-ba63-44b2-a9c5-a90cc7271c29 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:31.161673 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6971ea4-ba63-44b2-a9c5-a90cc7271c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:31.161973 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6971ea4-ba63-44b2-a9c5-a90cc7271c29 admin admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:31.162710 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6971ea4-ba63-44b2-a9c5-a90cc7271c29 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:33:31.163013 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6971ea4-ba63-44b2-a9c5-a90cc7271c29 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:31.164655 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6971ea4-ba63-44b2-a9c5-a90cc7271c29 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:31.182477 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2762/5525] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:33:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:33:31.186825 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe4e164-789a-44c3-b94f-40c98c399747 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:31.198632 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe4e164-789a-44c3-b94f-40c98c399747 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:31.204831 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f4c9b4-ed1d-4e90-89f1-d9dc36baaba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:31.205695 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f4c9b4-ed1d-4e90-89f1-d9dc36baaba3 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:31.206100 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f4c9b4-ed1d-4e90-89f1-d9dc36baaba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:31.206500 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f4c9b4-ed1d-4e90-89f1-d9dc36baaba3 admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:31.207300 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f4c9b4-ed1d-4e90-89f1-d9dc36baaba3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:31.209726 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f4c9b4-ed1d-4e90-89f1-d9dc36baaba3 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:31.256647 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6971ea4-ba63-44b2-a9c5-a90cc7271c29 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:31.260028 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-a6971ea4-ba63-44b2-a9c5-a90cc7271c29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:31.269174 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2764/5526] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:33:31 2022] POST /identity/v3/projects => generated 387 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:33:31.277238 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f4c9b4-ed1d-4e90-89f1-d9dc36baaba3 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:31.282378 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6971ea4-ba63-44b2-a9c5-a90cc7271c29 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:31.328337 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:33:31.328656 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:33:31.366817 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a5d026-2d10-487c-858c-4e1d60e27962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:31.368465 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a5d026-2d10-487c-858c-4e1d60e27962 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:31.368465 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a5d026-2d10-487c-858c-4e1d60e27962 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:31.368465 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a5d026-2d10-487c-858c-4e1d60e27962 admin admin] PATH_INFO: `/v3/projects/0285ccffb913497abb0e61b90df0f918` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:31.372853 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a5d026-2d10-487c-858c-4e1d60e27962 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0285ccffb913497abb0e61b90df0f918)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:31.372853 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a5d026-2d10-487c-858c-4e1d60e27962 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:31.396610 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f4c9b4-ed1d-4e90-89f1-d9dc36baaba3 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:31.404407 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631d4321-8413-4aec-999f-916e121a9b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:31.405344 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631d4321-8413-4aec-999f-916e121a9b0d admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:31.406205 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631d4321-8413-4aec-999f-916e121a9b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:31.406497 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631d4321-8413-4aec-999f-916e121a9b0d admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:31.407216 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631d4321-8413-4aec-999f-916e121a9b0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:31.413417 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631d4321-8413-4aec-999f-916e121a9b0d admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:31.437367 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2765/5527] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:33:31 2022] POST /identity/v3/users => generated 294 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:33:31.438700 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631d4321-8413-4aec-999f-916e121a9b0d admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:31.440950 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-631d4321-8413-4aec-999f-916e121a9b0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:31.442147 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c0a5d026-2d10-487c-858c-4e1d60e27962 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0285ccffb913497abb0e61b90df0f918', 'request_id': 'req-c0a5d026-2d10-487c-858c-4e1d60e27962'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:31.453302 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c0a5d026-2d10-487c-858c-4e1d60e27962 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0285ccffb913497abb0e61b90df0f918', 'request_id': 'req-c0a5d026-2d10-487c-858c-4e1d60e27962'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:31.461318 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c0a5d026-2d10-487c-858c-4e1d60e27962 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0285ccffb913497abb0e61b90df0f918', 'request_id': 'req-c0a5d026-2d10-487c-858c-4e1d60e27962'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:31.482666 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c0a5d026-2d10-487c-858c-4e1d60e27962 admin admin] The token cache is being invalidate because project 0285ccffb913497abb0e61b90df0f918 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:33:31.482944 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c0a5d026-2d10-487c-858c-4e1d60e27962 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:31.484131 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c0a5d026-2d10-487c-858c-4e1d60e27962 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:31.488744 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2763/5528] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:33:31 2022] DELETE /identity/v3/projects/0285ccffb913497abb0e61b90df0f918 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:33:31.488744 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a5d026-2d10-487c-858c-4e1d60e27962 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:31.489895 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-c0a5d026-2d10-487c-858c-4e1d60e27962 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:31.514476 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631d4321-8413-4aec-999f-916e121a9b0d admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:31.565255 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a5d026-2d10-487c-858c-4e1d60e27962 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:31.570481 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d1287c-bef4-4025-8e88-8216505a152f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:31.571384 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d1287c-bef4-4025-8e88-8216505a152f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:31.571745 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d1287c-bef4-4025-8e88-8216505a152f admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:31.571944 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d1287c-bef4-4025-8e88-8216505a152f admin admin] PATH_INFO: `/v3/users/0400e69a5bee4dcc9b55cd38de32eb76` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:31.572487 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4e0d11-14f1-428e-8d27-dce8d18a183c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:31.573092 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4e0d11-14f1-428e-8d27-dce8d18a183c service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:31.573246 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d1287c-bef4-4025-8e88-8216505a152f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0400e69a5bee4dcc9b55cd38de32eb76)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:31.573415 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4e0d11-14f1-428e-8d27-dce8d18a183c service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:31.573661 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4e0d11-14f1-428e-8d27-dce8d18a183c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:31.575251 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d1287c-bef4-4025-8e88-8216505a152f admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:31.575512 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-0e4e0d11-14f1-428e-8d27-dce8d18a183c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:31.642124 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-99d1287c-bef4-4025-8e88-8216505a152f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0400e69a5bee4dcc9b55cd38de32eb76'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:31.642820 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-99d1287c-bef4-4025-8e88-8216505a152f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0400e69a5bee4dcc9b55cd38de32eb76'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:31.651682 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-99d1287c-bef4-4025-8e88-8216505a152f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0400e69a5bee4dcc9b55cd38de32eb76'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:31.662160 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-99d1287c-bef4-4025-8e88-8216505a152f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0400e69a5bee4dcc9b55cd38de32eb76'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:31.667933 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:33:31.681730 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-99d1287c-bef4-4025-8e88-8216505a152f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0400e69a5bee4dcc9b55cd38de32eb76'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:31.683683 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4e0d11-14f1-428e-8d27-dce8d18a183c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:31.685160 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4e0d11-14f1-428e-8d27-dce8d18a183c service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:31.689350 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2764/5529] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:33:31 2022] DELETE /identity/v3/users/0400e69a5bee4dcc9b55cd38de32eb76 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:33:31.690390 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d1287c-bef4-4025-8e88-8216505a152f admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:31.692104 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-99d1287c-bef4-4025-8e88-8216505a152f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:31.702550 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2766/5530] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:33:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:33:31.703802 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4e0d11-14f1-428e-8d27-dce8d18a183c service neutron] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:31.706082 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-0e4e0d11-14f1-428e-8d27-dce8d18a183c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:31.725156 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4e0d11-14f1-428e-8d27-dce8d18a183c service neutron] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:31.767757 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:33:31.785269 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d1287c-bef4-4025-8e88-8216505a152f admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:31.793945 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae17cb4-b0dd-49bb-915b-bf869b7a4ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:31.794171 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae17cb4-b0dd-49bb-915b-bf869b7a4ba3 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:31.794451 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae17cb4-b0dd-49bb-915b-bf869b7a4ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:31.794743 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae17cb4-b0dd-49bb-915b-bf869b7a4ba3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:31.795893 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae17cb4-b0dd-49bb-915b-bf869b7a4ba3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:31.798173 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae17cb4-b0dd-49bb-915b-bf869b7a4ba3 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:31.832333 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2765/5531] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:33:31 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:33:31.832333 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae17cb4-b0dd-49bb-915b-bf869b7a4ba3 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:31.837945 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-4ae17cb4-b0dd-49bb-915b-bf869b7a4ba3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:31.839996 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97486c32-8a44-4042-ac57-99aa1ff97650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:31.841673 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97486c32-8a44-4042-ac57-99aa1ff97650 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:31.841673 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97486c32-8a44-4042-ac57-99aa1ff97650 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:31.841961 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97486c32-8a44-4042-ac57-99aa1ff97650 admin admin] PATH_INFO: `/v3/users/c6aa1ebebef940e48508ae8dc936808a` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:31.843289 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97486c32-8a44-4042-ac57-99aa1ff97650 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6aa1ebebef940e48508ae8dc936808a)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:31.845508 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97486c32-8a44-4042-ac57-99aa1ff97650 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:31.955791 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-97486c32-8a44-4042-ac57-99aa1ff97650 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6aa1ebebef940e48508ae8dc936808a'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:31.958612 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae17cb4-b0dd-49bb-915b-bf869b7a4ba3 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:31.967080 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e10f24e-d556-4ec2-b669-55104c1ff30c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:31.968575 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-97486c32-8a44-4042-ac57-99aa1ff97650 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6aa1ebebef940e48508ae8dc936808a'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:31.969584 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e10f24e-d556-4ec2-b669-55104c1ff30c service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:31.970208 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e10f24e-d556-4ec2-b669-55104c1ff30c service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:31.970511 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-97486c32-8a44-4042-ac57-99aa1ff97650 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6aa1ebebef940e48508ae8dc936808a'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:31.971019 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e10f24e-d556-4ec2-b669-55104c1ff30c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:31.977951 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-5e10f24e-d556-4ec2-b669-55104c1ff30c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:31.992317 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-97486c32-8a44-4042-ac57-99aa1ff97650 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6aa1ebebef940e48508ae8dc936808a'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:32.008557 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-97486c32-8a44-4042-ac57-99aa1ff97650 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6aa1ebebef940e48508ae8dc936808a'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:32.030903 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2767/5532] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:33:31 2022] DELETE /identity/v3/users/c6aa1ebebef940e48508ae8dc936808a => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:33:32.030903 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967bf604-db24-4160-bcf5-6734ccb56ea7 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:32.030903 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967bf604-db24-4160-bcf5-6734ccb56ea7 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:32.031376 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967bf604-db24-4160-bcf5-6734ccb56ea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:32.052106 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-967bf604-db24-4160-bcf5-6734ccb56ea7 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:33:32.053528 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-967bf604-db24-4160-bcf5-6734ccb56ea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:32.112884 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e10f24e-d556-4ec2-b669-55104c1ff30c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:32.115069 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e10f24e-d556-4ec2-b669-55104c1ff30c service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:32.135307 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2766/5533] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:33:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:33:32.138816 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e10f24e-d556-4ec2-b669-55104c1ff30c service neutron] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:32.153952 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2768/5534] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:33:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:33:32.159684 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e10f24e-d556-4ec2-b669-55104c1ff30c service neutron] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:32.165766 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f12434-8ecd-4f3b-a109-94edf824c10d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:32.166894 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f12434-8ecd-4f3b-a109-94edf824c10d admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:32.167235 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f12434-8ecd-4f3b-a109-94edf824c10d admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:32.170389 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f12434-8ecd-4f3b-a109-94edf824c10d admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:32.171539 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f12434-8ecd-4f3b-a109-94edf824c10d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:32.175014 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f12434-8ecd-4f3b-a109-94edf824c10d admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:32.176318 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967bf604-db24-4160-bcf5-6734ccb56ea7 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:32.178066 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-967bf604-db24-4160-bcf5-6734ccb56ea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:32.191472 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2767/5535] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:33:32 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:33:32.192742 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f12434-8ecd-4f3b-a109-94edf824c10d admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:32.195957 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-e2f12434-8ecd-4f3b-a109-94edf824c10d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:32.231231 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f12434-8ecd-4f3b-a109-94edf824c10d admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:32.244581 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6695ca-43d4-4599-8f5d-26942a789b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:32.245627 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6695ca-43d4-4599-8f5d-26942a789b07 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:32.246195 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6695ca-43d4-4599-8f5d-26942a789b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:32.247795 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6695ca-43d4-4599-8f5d-26942a789b07 admin admin] PATH_INFO: `/v3/projects/3cf551a226f54301b3e27870070d09c1/users/f2820493570c4f7da44ae6461dbd207f/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:32.273920 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:DELETE=2,keystone:SELECT=98 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:33:32.290204 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6695ca-43d4-4599-8f5d-26942a789b07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cf551a226f54301b3e27870070d09c1, user_id=f2820493570c4f7da44ae6461dbd207f, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:32.301783 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6695ca-43d4-4599-8f5d-26942a789b07 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:32.302715 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:33:32.350177 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967bf604-db24-4160-bcf5-6734ccb56ea7 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:32.354623 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2768/5536] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:33:32 2022] PUT /identity/v3/projects/3cf551a226f54301b3e27870070d09c1/users/f2820493570c4f7da44ae6461dbd207f/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:33:32.356209 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6695ca-43d4-4599-8f5d-26942a789b07 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:32.364752 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-5c6695ca-43d4-4599-8f5d-26942a789b07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:32.464656 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6072c047-257d-49ca-90ca-ec6c4425ab24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:32.466947 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6072c047-257d-49ca-90ca-ec6c4425ab24 service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:32.468609 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6072c047-257d-49ca-90ca-ec6c4425ab24 service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:32.468894 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6072c047-257d-49ca-90ca-ec6c4425ab24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:32.514411 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6695ca-43d4-4599-8f5d-26942a789b07 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:32.520338 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df68bf1-68e7-4600-9c47-ecf422836d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:32.521438 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df68bf1-68e7-4600-9c47-ecf422836d70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:32.521732 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df68bf1-68e7-4600-9c47-ecf422836d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:32.522137 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df68bf1-68e7-4600-9c47-ecf422836d70 admin admin] PATH_INFO: `/v3/projects/3063d44927d94fdfaec3fccfc55163eb` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:32.523500 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df68bf1-68e7-4600-9c47-ecf422836d70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3063d44927d94fdfaec3fccfc55163eb)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:32.525508 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df68bf1-68e7-4600-9c47-ecf422836d70 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:32.614475 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-8df68bf1-68e7-4600-9c47-ecf422836d70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3063d44927d94fdfaec3fccfc55163eb', 'request_id': 'req-8df68bf1-68e7-4600-9c47-ecf422836d70'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:32.622269 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6072c047-257d-49ca-90ca-ec6c4425ab24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:32.624866 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6072c047-257d-49ca-90ca-ec6c4425ab24 service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:32.636684 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-8df68bf1-68e7-4600-9c47-ecf422836d70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3063d44927d94fdfaec3fccfc55163eb', 'request_id': 'req-8df68bf1-68e7-4600-9c47-ecf422836d70'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:32.640034 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2769/5537] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:33:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:33:32.642005 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f02ab3-2842-4afd-940c-af97c5a8e729 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:32.642568 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f02ab3-2842-4afd-940c-af97c5a8e729 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:32.642989 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f02ab3-2842-4afd-940c-af97c5a8e729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:32.650058 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-8df68bf1-68e7-4600-9c47-ecf422836d70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3063d44927d94fdfaec3fccfc55163eb', 'request_id': 'req-8df68bf1-68e7-4600-9c47-ecf422836d70'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:32.665533 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-51f02ab3-2842-4afd-940c-af97c5a8e729 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:33:32.667001 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-51f02ab3-2842-4afd-940c-af97c5a8e729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:32.674522 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-8df68bf1-68e7-4600-9c47-ecf422836d70 admin admin] The token cache is being invalidate because project 3063d44927d94fdfaec3fccfc55163eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:33:32.674842 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-8df68bf1-68e7-4600-9c47-ecf422836d70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:32.675707 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-8df68bf1-68e7-4600-9c47-ecf422836d70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:32.681908 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2769/5538] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:33:32 2022] DELETE /identity/v3/projects/3063d44927d94fdfaec3fccfc55163eb => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:33:32.797324 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2770/5539] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:33:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:33:32.864063 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df68bf1-68e7-4600-9c47-ecf422836d70 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:32.865640 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-8df68bf1-68e7-4600-9c47-ecf422836d70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:33.107098 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df68bf1-68e7-4600-9c47-ecf422836d70 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:33.117992 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197913b8-0f73-4cf8-8c1b-51f613ba86c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:33.130958 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197913b8-0f73-4cf8-8c1b-51f613ba86c8 service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:33.135222 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197913b8-0f73-4cf8-8c1b-51f613ba86c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:33.135636 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197913b8-0f73-4cf8-8c1b-51f613ba86c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:33.182190 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197913b8-0f73-4cf8-8c1b-51f613ba86c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:33.184558 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197913b8-0f73-4cf8-8c1b-51f613ba86c8 service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:33.224498 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2770/5540] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:33:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:33:33.299285 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f02ab3-2842-4afd-940c-af97c5a8e729 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:33.300794 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-51f02ab3-2842-4afd-940c-af97c5a8e729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:33.319400 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f02ab3-2842-4afd-940c-af97c5a8e729 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:33.324452 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a230f1-8c8f-4e6a-8267-2acd50d8e348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:33.325373 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a230f1-8c8f-4e6a-8267-2acd50d8e348 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:33.325649 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a230f1-8c8f-4e6a-8267-2acd50d8e348 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:33.325963 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a230f1-8c8f-4e6a-8267-2acd50d8e348 admin admin] PATH_INFO: `/v3/projects/967b5ba16feb4b88bd4bacf0ec6194c2` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:33.327161 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a230f1-8c8f-4e6a-8267-2acd50d8e348 admin admin] RBAC: Authorizing `identity:delete_project(project_id=967b5ba16feb4b88bd4bacf0ec6194c2)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:33.329552 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a230f1-8c8f-4e6a-8267-2acd50d8e348 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:33.381003 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:33:33.386116 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-d5a230f1-8c8f-4e6a-8267-2acd50d8e348 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '967b5ba16feb4b88bd4bacf0ec6194c2', 'request_id': 'req-d5a230f1-8c8f-4e6a-8267-2acd50d8e348'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:33.394536 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-d5a230f1-8c8f-4e6a-8267-2acd50d8e348 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '967b5ba16feb4b88bd4bacf0ec6194c2', 'request_id': 'req-d5a230f1-8c8f-4e6a-8267-2acd50d8e348'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:33.400647 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-d5a230f1-8c8f-4e6a-8267-2acd50d8e348 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '967b5ba16feb4b88bd4bacf0ec6194c2', 'request_id': 'req-d5a230f1-8c8f-4e6a-8267-2acd50d8e348'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:33.413522 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-d5a230f1-8c8f-4e6a-8267-2acd50d8e348 admin admin] The token cache is being invalidate because project 967b5ba16feb4b88bd4bacf0ec6194c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:33:33.413825 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-d5a230f1-8c8f-4e6a-8267-2acd50d8e348 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:33.414512 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-d5a230f1-8c8f-4e6a-8267-2acd50d8e348 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:33.416212 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2771/5541] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:33:33 2022] DELETE /identity/v3/projects/967b5ba16feb4b88bd4bacf0ec6194c2 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:33:33.422299 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756dd6e1-3a54-48d0-b31c-2ac92aed6278 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:33.422586 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756dd6e1-3a54-48d0-b31c-2ac92aed6278 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:33.422858 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756dd6e1-3a54-48d0-b31c-2ac92aed6278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:33.441680 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-756dd6e1-3a54-48d0-b31c-2ac92aed6278 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:33:33.444276 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-756dd6e1-3a54-48d0-b31c-2ac92aed6278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:33.463765 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:33:33.553208 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2771/5542] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:33:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:33:33.562621 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43615dfc-6f7a-432c-82be-f73ed5a91407 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:33.562965 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43615dfc-6f7a-432c-82be-f73ed5a91407 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:33.563383 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43615dfc-6f7a-432c-82be-f73ed5a91407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:33.620296 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-43615dfc-6f7a-432c-82be-f73ed5a91407 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:33:33.623302 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-43615dfc-6f7a-432c-82be-f73ed5a91407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:33.657721 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2772/5543] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:33:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:33:33.660630 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756dd6e1-3a54-48d0-b31c-2ac92aed6278 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:33.678592 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756dd6e1-3a54-48d0-b31c-2ac92aed6278 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:33.691973 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e91e835-354e-4f2f-9bea-7d87e39414d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:33.693678 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e91e835-354e-4f2f-9bea-7d87e39414d9 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:33.694137 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e91e835-354e-4f2f-9bea-7d87e39414d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:33.694813 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e91e835-354e-4f2f-9bea-7d87e39414d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:33.695564 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e91e835-354e-4f2f-9bea-7d87e39414d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:33:33.695999 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e91e835-354e-4f2f-9bea-7d87e39414d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:33.698377 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e91e835-354e-4f2f-9bea-7d87e39414d9 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:33.744877 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2772/5544] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:33:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:33:33.745793 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43615dfc-6f7a-432c-82be-f73ed5a91407 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:33.758755 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43615dfc-6f7a-432c-82be-f73ed5a91407 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:33.764470 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285daa18-e6ae-4c37-97ee-5fc4b8b785b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:33.765536 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285daa18-e6ae-4c37-97ee-5fc4b8b785b8 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:33.766013 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285daa18-e6ae-4c37-97ee-5fc4b8b785b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:33.766558 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285daa18-e6ae-4c37-97ee-5fc4b8b785b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:33.767410 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285daa18-e6ae-4c37-97ee-5fc4b8b785b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:33.784119 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285daa18-e6ae-4c37-97ee-5fc4b8b785b8 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:33.847981 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2773/5545] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:33:33 2022] POST /identity/v3/projects => generated 367 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:33:33.851342 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e91e835-354e-4f2f-9bea-7d87e39414d9 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:33.876470 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e91e835-354e-4f2f-9bea-7d87e39414d9 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:33.965347 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91e7fba-c5c2-4484-88c0-adec93b46df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:33.966179 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91e7fba-c5c2-4484-88c0-adec93b46df0 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:33.967051 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91e7fba-c5c2-4484-88c0-adec93b46df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:33.967051 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91e7fba-c5c2-4484-88c0-adec93b46df0 admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:33.967853 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91e7fba-c5c2-4484-88c0-adec93b46df0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:33.969987 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91e7fba-c5c2-4484-88c0-adec93b46df0 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:33.997981 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2773/5546] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:33:33 2022] POST /identity/v3/users => generated 284 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:33:33.999615 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285daa18-e6ae-4c37-97ee-5fc4b8b785b8 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:34.010587 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285daa18-e6ae-4c37-97ee-5fc4b8b785b8 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:34.015557 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa6564f-7a66-4160-b09d-be13ca7b1c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:34.028176 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa6564f-7a66-4160-b09d-be13ca7b1c49 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:34.028500 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa6564f-7a66-4160-b09d-be13ca7b1c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:34.028737 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa6564f-7a66-4160-b09d-be13ca7b1c49 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:34.029647 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa6564f-7a66-4160-b09d-be13ca7b1c49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:34.031478 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa6564f-7a66-4160-b09d-be13ca7b1c49 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:34.043571 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2774/5547] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:33:33 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:33:34.047800 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91e7fba-c5c2-4484-88c0-adec93b46df0 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:34.059056 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91e7fba-c5c2-4484-88c0-adec93b46df0 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:34.063711 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23544288-1400-486d-8050-7049e06038f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:34.064389 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23544288-1400-486d-8050-7049e06038f8 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:34.064674 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23544288-1400-486d-8050-7049e06038f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:34.064951 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23544288-1400-486d-8050-7049e06038f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:34.065758 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23544288-1400-486d-8050-7049e06038f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:34.067469 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23544288-1400-486d-8050-7049e06038f8 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:34.082100 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2774/5548] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:33:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:33:34.083928 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa6564f-7a66-4160-b09d-be13ca7b1c49 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:34.094643 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa6564f-7a66-4160-b09d-be13ca7b1c49 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:34.099563 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5139839-c9a9-40fd-8ee4-6de0e2c3d03a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:34.100455 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5139839-c9a9-40fd-8ee4-6de0e2c3d03a admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:34.100714 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5139839-c9a9-40fd-8ee4-6de0e2c3d03a admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:34.101066 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5139839-c9a9-40fd-8ee4-6de0e2c3d03a admin admin] PATH_INFO: `/v3/projects/07962039f22549e58562f56c8dafed08/users/18a98750e3244b0583d85b22f946b132/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:34.124158 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5139839-c9a9-40fd-8ee4-6de0e2c3d03a admin admin] RBAC: Authorizing `identity:create_grant(project_id=07962039f22549e58562f56c8dafed08, user_id=18a98750e3244b0583d85b22f946b132, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:34.128616 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5139839-c9a9-40fd-8ee4-6de0e2c3d03a admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:34.153540 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2775/5549] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:33:34 2022] PUT /identity/v3/projects/07962039f22549e58562f56c8dafed08/users/18a98750e3244b0583d85b22f946b132/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:33:34.163964 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e150be-b5a3-472b-bd1a-fcc8080096b6 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:34.164525 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e150be-b5a3-472b-bd1a-fcc8080096b6 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:34.164525 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e150be-b5a3-472b-bd1a-fcc8080096b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:34.203044 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-65e150be-b5a3-472b-bd1a-fcc8080096b6 None None] MFA Rules not processed for user `18a98750e3244b0583d85b22f946b132`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:33:34.204419 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-65e150be-b5a3-472b-bd1a-fcc8080096b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:34.294243 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2775/5550] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:33:34 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:33:34.307484 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5139839-c9a9-40fd-8ee4-6de0e2c3d03a admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:34.309541 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-c5139839-c9a9-40fd-8ee4-6de0e2c3d03a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:34.393576 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5139839-c9a9-40fd-8ee4-6de0e2c3d03a admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:34.397757 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84bbba7-23ba-4b72-9f4b-95bf914760ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec5fd3a489c341b7964704d689037f05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:34.400075 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84bbba7-23ba-4b72-9f4b-95bf914760ad service cinder] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:34.401152 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84bbba7-23ba-4b72-9f4b-95bf914760ad service cinder] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:34.401668 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84bbba7-23ba-4b72-9f4b-95bf914760ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:34.413296 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84bbba7-23ba-4b72-9f4b-95bf914760ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:34.415236 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84bbba7-23ba-4b72-9f4b-95bf914760ad service cinder] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:34.427961 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2776/5551] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:33:34 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:33:34.519012 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb95c67-fc00-400b-b283-d60dc01ca56b None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:34.519274 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb95c67-fc00-400b-b283-d60dc01ca56b None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:34.519522 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb95c67-fc00-400b-b283-d60dc01ca56b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:34.570730 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-eeb95c67-fc00-400b-b283-d60dc01ca56b None None] MFA Rules not processed for user `f2820493570c4f7da44ae6461dbd207f`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:33:34.572371 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-eeb95c67-fc00-400b-b283-d60dc01ca56b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:34.584934 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:33:34.673964 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2776/5552] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:33:34 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:33:34.676190 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a49383-c0e1-486d-9213-a292dc7e6a38 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:34.676652 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a49383-c0e1-486d-9213-a292dc7e6a38 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:34.676943 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a49383-c0e1-486d-9213-a292dc7e6a38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:34.703726 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-f3a49383-c0e1-486d-9213-a292dc7e6a38 None None] MFA Rules not processed for user `f2820493570c4f7da44ae6461dbd207f`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:33:34.705046 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-f3a49383-c0e1-486d-9213-a292dc7e6a38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:34.713771 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2777/5553] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:33:34 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:33:34.725778 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb95c67-fc00-400b-b283-d60dc01ca56b None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:34.727824 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-eeb95c67-fc00-400b-b283-d60dc01ca56b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:34.866678 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb95c67-fc00-400b-b283-d60dc01ca56b None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:34.873153 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c947602-d6db-4481-a2c0-fd34bf3bdc52 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:34.873912 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c947602-d6db-4481-a2c0-fd34bf3bdc52 service nova] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:34.874263 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c947602-d6db-4481-a2c0-fd34bf3bdc52 service nova] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:34.874603 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c947602-d6db-4481-a2c0-fd34bf3bdc52 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:34.885850 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c947602-d6db-4481-a2c0-fd34bf3bdc52 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:34.889345 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c947602-d6db-4481-a2c0-fd34bf3bdc52 service nova] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:34.912587 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2777/5554] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:33:34 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 23 21:33:35.835379 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a49383-c0e1-486d-9213-a292dc7e6a38 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:35.836878 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-f3a49383-c0e1-486d-9213-a292dc7e6a38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:35.927182 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a49383-c0e1-486d-9213-a292dc7e6a38 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:35.940987 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7537f0-d469-4e2a-91ba-1500ab70b69e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:35.941952 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7537f0-d469-4e2a-91ba-1500ab70b69e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:35.942222 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7537f0-d469-4e2a-91ba-1500ab70b69e admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:35.942498 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7537f0-d469-4e2a-91ba-1500ab70b69e admin admin] PATH_INFO: `/v3/users/f2820493570c4f7da44ae6461dbd207f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:35.946891 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7537f0-d469-4e2a-91ba-1500ab70b69e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2820493570c4f7da44ae6461dbd207f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:35.948990 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7537f0-d469-4e2a-91ba-1500ab70b69e admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:35.954647 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:33:36.031102 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-8f7537f0-d469-4e2a-91ba-1500ab70b69e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2820493570c4f7da44ae6461dbd207f'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:36.046657 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-8f7537f0-d469-4e2a-91ba-1500ab70b69e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2820493570c4f7da44ae6461dbd207f'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:36.048291 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-8f7537f0-d469-4e2a-91ba-1500ab70b69e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2820493570c4f7da44ae6461dbd207f'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:36.067328 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-8f7537f0-d469-4e2a-91ba-1500ab70b69e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2820493570c4f7da44ae6461dbd207f'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:36.090452 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-8f7537f0-d469-4e2a-91ba-1500ab70b69e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2820493570c4f7da44ae6461dbd207f'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:36.105267 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2778/5555] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:33:35 2022] DELETE /identity/v3/users/f2820493570c4f7da44ae6461dbd207f => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:33:36.215378 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c947602-d6db-4481-a2c0-fd34bf3bdc52 service nova] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:36.232186 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c947602-d6db-4481-a2c0-fd34bf3bdc52 service nova] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:36.312985 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1e8f26-4473-4e61-bc45-8b0ae77d184d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:36.314279 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1e8f26-4473-4e61-bc45-8b0ae77d184d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:36.314559 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1e8f26-4473-4e61-bc45-8b0ae77d184d admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:36.315272 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1e8f26-4473-4e61-bc45-8b0ae77d184d admin admin] PATH_INFO: `/v3/users/18a98750e3244b0583d85b22f946b132` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:36.316120 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1e8f26-4473-4e61-bc45-8b0ae77d184d admin admin] RBAC: Authorizing `identity:delete_user(user_id=18a98750e3244b0583d85b22f946b132)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:36.318562 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1e8f26-4473-4e61-bc45-8b0ae77d184d admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:36.364806 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:33:36.384690 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-9e1e8f26-4473-4e61-bc45-8b0ae77d184d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18a98750e3244b0583d85b22f946b132'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:36.385615 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-9e1e8f26-4473-4e61-bc45-8b0ae77d184d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18a98750e3244b0583d85b22f946b132'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:36.394073 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-9e1e8f26-4473-4e61-bc45-8b0ae77d184d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18a98750e3244b0583d85b22f946b132'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:36.405447 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-9e1e8f26-4473-4e61-bc45-8b0ae77d184d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18a98750e3244b0583d85b22f946b132'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:36.452833 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-9e1e8f26-4473-4e61-bc45-8b0ae77d184d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18a98750e3244b0583d85b22f946b132'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:36.487337 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2778/5556] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:33:36 2022] DELETE /identity/v3/users/18a98750e3244b0583d85b22f946b132 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:33:36.488418 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ef3693-4880-40d5-b5cf-1c5acd61ee0e None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:36.488734 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ef3693-4880-40d5-b5cf-1c5acd61ee0e None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:36.489061 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ef3693-4880-40d5-b5cf-1c5acd61ee0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:36.520533 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-06ef3693-4880-40d5-b5cf-1c5acd61ee0e None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:33:36.521796 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-06ef3693-4880-40d5-b5cf-1c5acd61ee0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:36.632064 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2779/5557] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:33:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:33:36.659810 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1e8f26-4473-4e61-bc45-8b0ae77d184d admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:36.662083 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-9e1e8f26-4473-4e61-bc45-8b0ae77d184d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:36.748117 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1e8f26-4473-4e61-bc45-8b0ae77d184d admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:36.753758 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0946b51f-d8ab-412f-bbc0-56dd48f44922 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:36.754747 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0946b51f-d8ab-412f-bbc0-56dd48f44922 service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:36.755193 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0946b51f-d8ab-412f-bbc0-56dd48f44922 service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:36.755758 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0946b51f-d8ab-412f-bbc0-56dd48f44922 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:36.773514 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0946b51f-d8ab-412f-bbc0-56dd48f44922 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:36.781425 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0946b51f-d8ab-412f-bbc0-56dd48f44922 service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:36.800796 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2779/5558] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:33:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:33:36.854012 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ef3693-4880-40d5-b5cf-1c5acd61ee0e None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:36.856157 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-06ef3693-4880-40d5-b5cf-1c5acd61ee0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:36.911977 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ef3693-4880-40d5-b5cf-1c5acd61ee0e None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:36.924613 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f80b17-2d9e-45e9-8a4d-82806a76ff5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:36.926234 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f80b17-2d9e-45e9-8a4d-82806a76ff5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:36.926738 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f80b17-2d9e-45e9-8a4d-82806a76ff5b admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:36.927183 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f80b17-2d9e-45e9-8a4d-82806a76ff5b admin admin] PATH_INFO: `/v3/projects/3cf551a226f54301b3e27870070d09c1` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:36.942048 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f80b17-2d9e-45e9-8a4d-82806a76ff5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=3cf551a226f54301b3e27870070d09c1)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:36.944221 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f80b17-2d9e-45e9-8a4d-82806a76ff5b admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:37.075053 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-e6f80b17-2d9e-45e9-8a4d-82806a76ff5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3cf551a226f54301b3e27870070d09c1', 'request_id': 'req-e6f80b17-2d9e-45e9-8a4d-82806a76ff5b'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:37.091695 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-e6f80b17-2d9e-45e9-8a4d-82806a76ff5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3cf551a226f54301b3e27870070d09c1', 'request_id': 'req-e6f80b17-2d9e-45e9-8a4d-82806a76ff5b'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:37.098862 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-e6f80b17-2d9e-45e9-8a4d-82806a76ff5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3cf551a226f54301b3e27870070d09c1', 'request_id': 'req-e6f80b17-2d9e-45e9-8a4d-82806a76ff5b'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:37.130087 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-e6f80b17-2d9e-45e9-8a4d-82806a76ff5b admin admin] The token cache is being invalidate because project 3cf551a226f54301b3e27870070d09c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:33:37.130643 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-e6f80b17-2d9e-45e9-8a4d-82806a76ff5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:37.131516 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-e6f80b17-2d9e-45e9-8a4d-82806a76ff5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:37.137175 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2780/5559] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:33:36 2022] DELETE /identity/v3/projects/3cf551a226f54301b3e27870070d09c1 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:33:37.139049 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88e0c7f-89f2-4a1b-ae34-98a0fe0e5b10 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:37.140690 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88e0c7f-89f2-4a1b-ae34-98a0fe0e5b10 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:37.140994 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88e0c7f-89f2-4a1b-ae34-98a0fe0e5b10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:37.175163 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-b88e0c7f-89f2-4a1b-ae34-98a0fe0e5b10 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:33:37.176413 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-b88e0c7f-89f2-4a1b-ae34-98a0fe0e5b10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:37.266512 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2780/5560] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:33:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:33:37.275535 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f12fb35-e37b-4197-8876-545188924740 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:37.275826 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f12fb35-e37b-4197-8876-545188924740 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:37.276105 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f12fb35-e37b-4197-8876-545188924740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:37.294382 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:33:37.305366 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-0f12fb35-e37b-4197-8876-545188924740 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:33:37.306753 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-0f12fb35-e37b-4197-8876-545188924740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:37.323813 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2781/5561] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:33:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:33:37.325056 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88e0c7f-89f2-4a1b-ae34-98a0fe0e5b10 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:37.336719 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88e0c7f-89f2-4a1b-ae34-98a0fe0e5b10 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:37.342827 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4b9b4e-b58e-472a-9db8-dd836a0dce4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:37.343646 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4b9b4e-b58e-472a-9db8-dd836a0dce4d admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:37.344161 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4b9b4e-b58e-472a-9db8-dd836a0dce4d admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:37.344573 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4b9b4e-b58e-472a-9db8-dd836a0dce4d admin admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:37.345542 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4b9b4e-b58e-472a-9db8-dd836a0dce4d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:33:37.345972 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4b9b4e-b58e-472a-9db8-dd836a0dce4d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:37.347717 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4b9b4e-b58e-472a-9db8-dd836a0dce4d admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:37.370632 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2781/5562] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:33:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 21:33:37.371693 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f12fb35-e37b-4197-8876-545188924740 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:37.383473 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f12fb35-e37b-4197-8876-545188924740 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:37.390401 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef00c00-6f6b-4d2c-9448-f63427fc6f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:37.391618 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef00c00-6f6b-4d2c-9448-f63427fc6f73 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:37.391915 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef00c00-6f6b-4d2c-9448-f63427fc6f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:37.392192 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef00c00-6f6b-4d2c-9448-f63427fc6f73 admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:37.392972 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef00c00-6f6b-4d2c-9448-f63427fc6f73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:37.395095 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef00c00-6f6b-4d2c-9448-f63427fc6f73 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:37.426573 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2782/5563] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:33:37 2022] POST /identity/v3/projects => generated 371 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:33:37.431893 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4b9b4e-b58e-472a-9db8-dd836a0dce4d admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:37.457639 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4b9b4e-b58e-472a-9db8-dd836a0dce4d admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:37.553592 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:33:37.595382 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e75d1b-1585-4db2-833a-4f6ee4404e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:37.596300 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e75d1b-1585-4db2-833a-4f6ee4404e4c admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:37.596599 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e75d1b-1585-4db2-833a-4f6ee4404e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:37.596875 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e75d1b-1585-4db2-833a-4f6ee4404e4c admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:37.597591 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e75d1b-1585-4db2-833a-4f6ee4404e4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:37.600927 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e75d1b-1585-4db2-833a-4f6ee4404e4c admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:37.631841 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2782/5564] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:33:37 2022] POST /identity/v3/users => generated 286 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:33:37.636650 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef00c00-6f6b-4d2c-9448-f63427fc6f73 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:37.652127 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef00c00-6f6b-4d2c-9448-f63427fc6f73 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:37.660892 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c72588-9e85-4d08-ae4b-be97a90ba3fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:37.661819 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c72588-9e85-4d08-ae4b-be97a90ba3fe admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:37.662363 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c72588-9e85-4d08-ae4b-be97a90ba3fe admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:37.662841 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c72588-9e85-4d08-ae4b-be97a90ba3fe admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:37.663879 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c72588-9e85-4d08-ae4b-be97a90ba3fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:37.665790 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c72588-9e85-4d08-ae4b-be97a90ba3fe admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:37.686419 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e75d1b-1585-4db2-833a-4f6ee4404e4c admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:37.687612 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2783/5565] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:33:37 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:33:37.700675 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e75d1b-1585-4db2-833a-4f6ee4404e4c admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:37.706955 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0e4c2c-f78f-4c90-88f3-d5df7b553131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:37.707856 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0e4c2c-f78f-4c90-88f3-d5df7b553131 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:37.708208 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0e4c2c-f78f-4c90-88f3-d5df7b553131 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:37.708551 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0e4c2c-f78f-4c90-88f3-d5df7b553131 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:37.709465 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0e4c2c-f78f-4c90-88f3-d5df7b553131 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:37.711363 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0e4c2c-f78f-4c90-88f3-d5df7b553131 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:37.741056 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2783/5566] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:33:37 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:33:37.745563 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c72588-9e85-4d08-ae4b-be97a90ba3fe admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:37.755207 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0e4c2c-f78f-4c90-88f3-d5df7b553131 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:37.760344 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-cf0e4c2c-f78f-4c90-88f3-d5df7b553131 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:37.761710 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c72588-9e85-4d08-ae4b-be97a90ba3fe admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:37.771936 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeed7e2-38e4-4d88-b42f-3a5ac1b1db9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:37.772886 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeed7e2-38e4-4d88-b42f-3a5ac1b1db9f admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:37.773246 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeed7e2-38e4-4d88-b42f-3a5ac1b1db9f admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:37.773776 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeed7e2-38e4-4d88-b42f-3a5ac1b1db9f admin admin] PATH_INFO: `/v3/projects/52dbc9317e564a6a8e238a99dbc0abf5/users/8765950120c54fb39cce94ef5170c11f/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:37.781299 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0e4c2c-f78f-4c90-88f3-d5df7b553131 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:37.792877 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60088673-409f-485e-8d9c-22ae16244da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:37.793921 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60088673-409f-485e-8d9c-22ae16244da0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:37.794311 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60088673-409f-485e-8d9c-22ae16244da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:37.794594 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60088673-409f-485e-8d9c-22ae16244da0 admin admin] PATH_INFO: `/v3/projects/07962039f22549e58562f56c8dafed08` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:37.797671 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60088673-409f-485e-8d9c-22ae16244da0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07962039f22549e58562f56c8dafed08)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:37.800140 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60088673-409f-485e-8d9c-22ae16244da0 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:37.818342 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebeed7e2-38e4-4d88-b42f-3a5ac1b1db9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=52dbc9317e564a6a8e238a99dbc0abf5, user_id=8765950120c54fb39cce94ef5170c11f, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:37.821152 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebeed7e2-38e4-4d88-b42f-3a5ac1b1db9f admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:37.871524 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2784/5567] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:33:37 2022] PUT /identity/v3/projects/52dbc9317e564a6a8e238a99dbc0abf5/users/8765950120c54fb39cce94ef5170c11f/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:33:37.886620 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a708c66f-e607-45bc-bad3-45c60ffd6fc3 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:37.889783 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a708c66f-e607-45bc-bad3-45c60ffd6fc3 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:37.890510 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a708c66f-e607-45bc-bad3-45c60ffd6fc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:37.959175 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-60088673-409f-485e-8d9c-22ae16244da0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07962039f22549e58562f56c8dafed08', 'request_id': 'req-60088673-409f-485e-8d9c-22ae16244da0'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:37.967888 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-a708c66f-e607-45bc-bad3-45c60ffd6fc3 None None] MFA Rules not processed for user `8765950120c54fb39cce94ef5170c11f`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:33:37.970345 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-a708c66f-e607-45bc-bad3-45c60ffd6fc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:37.979440 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-60088673-409f-485e-8d9c-22ae16244da0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07962039f22549e58562f56c8dafed08', 'request_id': 'req-60088673-409f-485e-8d9c-22ae16244da0'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:37.987339 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-60088673-409f-485e-8d9c-22ae16244da0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07962039f22549e58562f56c8dafed08', 'request_id': 'req-60088673-409f-485e-8d9c-22ae16244da0'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:38.002486 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-60088673-409f-485e-8d9c-22ae16244da0 admin admin] The token cache is being invalidate because project 07962039f22549e58562f56c8dafed08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:33:38.002779 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-60088673-409f-485e-8d9c-22ae16244da0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:38.003470 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-60088673-409f-485e-8d9c-22ae16244da0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:38.006024 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2784/5568] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:33:37 2022] DELETE /identity/v3/projects/07962039f22549e58562f56c8dafed08 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:33:38.012792 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014da43d-3e3d-4665-9a73-baaecf575085 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:38.013087 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014da43d-3e3d-4665-9a73-baaecf575085 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:38.013370 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014da43d-3e3d-4665-9a73-baaecf575085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:38.035566 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-014da43d-3e3d-4665-9a73-baaecf575085 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:33:38.036708 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-014da43d-3e3d-4665-9a73-baaecf575085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:38.053124 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2785/5569] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:33:37 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:33:38.064134 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a708c66f-e607-45bc-bad3-45c60ffd6fc3 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:38.065721 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-a708c66f-e607-45bc-bad3-45c60ffd6fc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:38.110013 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2785/5570] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:33:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:33:38.118257 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74713540-e63e-47a3-a139-0ed59d80ccb9 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:38.118549 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74713540-e63e-47a3-a139-0ed59d80ccb9 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:38.118832 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74713540-e63e-47a3-a139-0ed59d80ccb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:38.136988 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-74713540-e63e-47a3-a139-0ed59d80ccb9 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:33:38.138235 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-74713540-e63e-47a3-a139-0ed59d80ccb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:38.146251 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2786/5571] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:33:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:33:38.150671 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74713540-e63e-47a3-a139-0ed59d80ccb9 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:38.153052 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a708c66f-e607-45bc-bad3-45c60ffd6fc3 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:38.158671 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bcebd2-6010-4ac1-9b95-a590323b0be2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:38.159326 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bcebd2-6010-4ac1-9b95-a590323b0be2 service nova] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:38.159603 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bcebd2-6010-4ac1-9b95-a590323b0be2 service nova] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:38.159871 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bcebd2-6010-4ac1-9b95-a590323b0be2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:38.160415 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74713540-e63e-47a3-a139-0ed59d80ccb9 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:38.165934 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ab4bd1-68e9-43eb-a0ef-1945abe0a527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:38.166598 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ab4bd1-68e9-43eb-a0ef-1945abe0a527 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:38.166872 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ab4bd1-68e9-43eb-a0ef-1945abe0a527 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:38.167138 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ab4bd1-68e9-43eb-a0ef-1945abe0a527 admin admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:38.167859 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ab4bd1-68e9-43eb-a0ef-1945abe0a527 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:33:38.168163 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ab4bd1-68e9-43eb-a0ef-1945abe0a527 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:38.168526 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bcebd2-6010-4ac1-9b95-a590323b0be2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:38.169799 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ab4bd1-68e9-43eb-a0ef-1945abe0a527 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:38.170273 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bcebd2-6010-4ac1-9b95-a590323b0be2 service nova] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:38.179548 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2786/5572] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:33:38 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:33:38.182274 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2787/5573] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:33:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 21:33:38.186958 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bcebd2-6010-4ac1-9b95-a590323b0be2 service nova] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:38.198583 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bcebd2-6010-4ac1-9b95-a590323b0be2 service nova] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:38.203651 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371d9fa3-0d86-4c87-84c9-f37096416bd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:38.204345 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371d9fa3-0d86-4c87-84c9-f37096416bd4 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:38.204622 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371d9fa3-0d86-4c87-84c9-f37096416bd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:38.204887 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371d9fa3-0d86-4c87-84c9-f37096416bd4 admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:38.205591 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371d9fa3-0d86-4c87-84c9-f37096416bd4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:38.207634 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371d9fa3-0d86-4c87-84c9-f37096416bd4 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:38.224055 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:33:38.245034 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2787/5574] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:33:38 2022] POST /identity/v3/projects => generated 375 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:33:38.250160 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ab4bd1-68e9-43eb-a0ef-1945abe0a527 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:38.260792 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ab4bd1-68e9-43eb-a0ef-1945abe0a527 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:38.280271 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:33:38.320268 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ffa6e8-e644-4a6d-a28f-408ad291e722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:38.320864 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ffa6e8-e644-4a6d-a28f-408ad291e722 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:38.321208 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ffa6e8-e644-4a6d-a28f-408ad291e722 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:38.321418 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ffa6e8-e644-4a6d-a28f-408ad291e722 admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:38.322133 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ffa6e8-e644-4a6d-a28f-408ad291e722 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:38.324051 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ffa6e8-e644-4a6d-a28f-408ad291e722 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:38.345039 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2788/5575] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:33:38 2022] POST /identity/v3/users => generated 288 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:33:38.349379 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371d9fa3-0d86-4c87-84c9-f37096416bd4 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:38.360501 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371d9fa3-0d86-4c87-84c9-f37096416bd4 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:38.365123 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809ab8e5-04a7-48a4-93ec-f107c4e42185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:38.365793 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809ab8e5-04a7-48a4-93ec-f107c4e42185 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:38.366107 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809ab8e5-04a7-48a4-93ec-f107c4e42185 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:38.366425 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809ab8e5-04a7-48a4-93ec-f107c4e42185 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:38.367187 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809ab8e5-04a7-48a4-93ec-f107c4e42185 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:38.369020 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809ab8e5-04a7-48a4-93ec-f107c4e42185 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:38.380075 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2788/5576] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:33:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:33:38.384309 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ffa6e8-e644-4a6d-a28f-408ad291e722 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:38.395234 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ffa6e8-e644-4a6d-a28f-408ad291e722 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:38.400392 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed4b58b-f376-450e-80db-0581d23c21eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:38.401164 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed4b58b-f376-450e-80db-0581d23c21eb admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:38.401521 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed4b58b-f376-450e-80db-0581d23c21eb admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:38.401831 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed4b58b-f376-450e-80db-0581d23c21eb admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:38.402658 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed4b58b-f376-450e-80db-0581d23c21eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:38.404366 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed4b58b-f376-450e-80db-0581d23c21eb admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:38.416505 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2789/5577] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:33:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:33:38.420582 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809ab8e5-04a7-48a4-93ec-f107c4e42185 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:38.431416 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809ab8e5-04a7-48a4-93ec-f107c4e42185 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:38.436186 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bde046-ef7e-4e3b-8b8b-7227112dd525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:38.437222 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bde046-ef7e-4e3b-8b8b-7227112dd525 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:38.437493 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bde046-ef7e-4e3b-8b8b-7227112dd525 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:38.437757 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bde046-ef7e-4e3b-8b8b-7227112dd525 admin admin] PATH_INFO: `/v3/projects/e416466bf1c742f5b56e651f847ca0be/users/62a539d943a54052b2881de540073140/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:38.454415 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bde046-ef7e-4e3b-8b8b-7227112dd525 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e416466bf1c742f5b56e651f847ca0be, user_id=62a539d943a54052b2881de540073140, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:38.457257 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bde046-ef7e-4e3b-8b8b-7227112dd525 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:38.472491 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2789/5578] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:33:38 2022] PUT /identity/v3/projects/e416466bf1c742f5b56e651f847ca0be/users/62a539d943a54052b2881de540073140/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:33:38.484343 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb272aa-fdb5-429c-98c3-04337a3449de None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:38.484636 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb272aa-fdb5-429c-98c3-04337a3449de None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:38.484953 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb272aa-fdb5-429c-98c3-04337a3449de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:38.518449 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-9fb272aa-fdb5-429c-98c3-04337a3449de None None] MFA Rules not processed for user `62a539d943a54052b2881de540073140`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:33:38.519898 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-9fb272aa-fdb5-429c-98c3-04337a3449de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:38.596206 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2790/5579] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:33:38 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:33:38.611196 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bde046-ef7e-4e3b-8b8b-7227112dd525 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:38.685725 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bde046-ef7e-4e3b-8b8b-7227112dd525 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:38.691818 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c552c064-ece3-46be-8498-091f47a52401 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:38.692480 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c552c064-ece3-46be-8498-091f47a52401 service nova] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:38.692791 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c552c064-ece3-46be-8498-091f47a52401 service nova] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:38.693088 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c552c064-ece3-46be-8498-091f47a52401 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:38.702521 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c552c064-ece3-46be-8498-091f47a52401 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:38.704118 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c552c064-ece3-46be-8498-091f47a52401 service nova] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:38.713548 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2790/5580] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:33:38 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:33:38.941904 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb272aa-fdb5-429c-98c3-04337a3449de None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:39.139779 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb272aa-fdb5-429c-98c3-04337a3449de None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:39.152303 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c79d02-2834-483d-8416-ff78ac8dab2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:39.153229 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c79d02-2834-483d-8416-ff78ac8dab2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:39.153516 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c79d02-2834-483d-8416-ff78ac8dab2b admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:39.153790 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c79d02-2834-483d-8416-ff78ac8dab2b admin admin] PATH_INFO: `/v3/users/62a539d943a54052b2881de540073140` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:39.157144 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c79d02-2834-483d-8416-ff78ac8dab2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=62a539d943a54052b2881de540073140)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:39.159206 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c79d02-2834-483d-8416-ff78ac8dab2b admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:39.300216 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:33:39.332922 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-49c79d02-2834-483d-8416-ff78ac8dab2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62a539d943a54052b2881de540073140'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:39.333525 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-49c79d02-2834-483d-8416-ff78ac8dab2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62a539d943a54052b2881de540073140'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:39.352679 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-49c79d02-2834-483d-8416-ff78ac8dab2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62a539d943a54052b2881de540073140'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:39.364622 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-49c79d02-2834-483d-8416-ff78ac8dab2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62a539d943a54052b2881de540073140'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:39.383127 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-49c79d02-2834-483d-8416-ff78ac8dab2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62a539d943a54052b2881de540073140'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:39.392101 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2791/5581] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:33:38 2022] DELETE /identity/v3/users/62a539d943a54052b2881de540073140 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:33:39.396317 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17581ea-17a1-4971-8481-fbe0161205aa None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:39.396838 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17581ea-17a1-4971-8481-fbe0161205aa None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:39.396947 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17581ea-17a1-4971-8481-fbe0161205aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:39.430237 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-c17581ea-17a1-4971-8481-fbe0161205aa None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:33:39.431888 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-c17581ea-17a1-4971-8481-fbe0161205aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:39.494681 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2791/5582] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:33:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:33:39.504789 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c79d02-2834-483d-8416-ff78ac8dab2b admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:39.506354 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-49c79d02-2834-483d-8416-ff78ac8dab2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:39.567745 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c79d02-2834-483d-8416-ff78ac8dab2b admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:39.571753 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d30e847-cfe1-4151-a982-56d0cf0e2403 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:39.572422 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d30e847-cfe1-4151-a982-56d0cf0e2403 service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:39.572708 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d30e847-cfe1-4151-a982-56d0cf0e2403 service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:39.572987 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d30e847-cfe1-4151-a982-56d0cf0e2403 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:39.582855 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d30e847-cfe1-4151-a982-56d0cf0e2403 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:39.584350 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d30e847-cfe1-4151-a982-56d0cf0e2403 service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:39.594818 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2792/5583] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:33:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:33:39.901258 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17581ea-17a1-4971-8481-fbe0161205aa None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:39.901258 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-c17581ea-17a1-4971-8481-fbe0161205aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:39.919026 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17581ea-17a1-4971-8481-fbe0161205aa None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:39.923971 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccde93c-3c6f-4a54-a7bd-0ec059d92d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:39.925058 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccde93c-3c6f-4a54-a7bd-0ec059d92d43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:39.925340 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccde93c-3c6f-4a54-a7bd-0ec059d92d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:39.925890 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccde93c-3c6f-4a54-a7bd-0ec059d92d43 admin admin] PATH_INFO: `/v3/users/8765950120c54fb39cce94ef5170c11f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:39.927071 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccde93c-3c6f-4a54-a7bd-0ec059d92d43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8765950120c54fb39cce94ef5170c11f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:39.930110 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccde93c-3c6f-4a54-a7bd-0ec059d92d43 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:39.987359 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:33:39.995683 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-9ccde93c-3c6f-4a54-a7bd-0ec059d92d43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8765950120c54fb39cce94ef5170c11f'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:40.008499 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-9ccde93c-3c6f-4a54-a7bd-0ec059d92d43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8765950120c54fb39cce94ef5170c11f'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:40.012293 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-9ccde93c-3c6f-4a54-a7bd-0ec059d92d43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8765950120c54fb39cce94ef5170c11f'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:40.026014 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-9ccde93c-3c6f-4a54-a7bd-0ec059d92d43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8765950120c54fb39cce94ef5170c11f'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:40.039056 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d30e847-cfe1-4151-a982-56d0cf0e2403 service neutron] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:40.040644 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-0d30e847-cfe1-4151-a982-56d0cf0e2403 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:40.047796 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-9ccde93c-3c6f-4a54-a7bd-0ec059d92d43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8765950120c54fb39cce94ef5170c11f'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:40.057728 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d30e847-cfe1-4151-a982-56d0cf0e2403 service neutron] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:40.063530 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94c45d6-08bc-4b59-985d-4968e75170ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:40.064431 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94c45d6-08bc-4b59-985d-4968e75170ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:40.064706 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94c45d6-08bc-4b59-985d-4968e75170ca admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:40.064978 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94c45d6-08bc-4b59-985d-4968e75170ca admin admin] PATH_INFO: `/v3/projects/e416466bf1c742f5b56e651f847ca0be` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:40.065953 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2792/5584] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:33:39 2022] DELETE /identity/v3/users/8765950120c54fb39cce94ef5170c11f => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:33:40.069948 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fe098f-68d8-4780-b189-b53827658afa None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:40.069948 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fe098f-68d8-4780-b189-b53827658afa None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:40.070225 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fe098f-68d8-4780-b189-b53827658afa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:40.072289 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94c45d6-08bc-4b59-985d-4968e75170ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=e416466bf1c742f5b56e651f847ca0be)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:40.074482 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94c45d6-08bc-4b59-985d-4968e75170ca admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:40.095722 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-35fe098f-68d8-4780-b189-b53827658afa None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:33:40.096958 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-35fe098f-68d8-4780-b189-b53827658afa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:40.134557 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-f94c45d6-08bc-4b59-985d-4968e75170ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e416466bf1c742f5b56e651f847ca0be', 'request_id': 'req-f94c45d6-08bc-4b59-985d-4968e75170ca'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:40.144141 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-f94c45d6-08bc-4b59-985d-4968e75170ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e416466bf1c742f5b56e651f847ca0be', 'request_id': 'req-f94c45d6-08bc-4b59-985d-4968e75170ca'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:40.152120 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-f94c45d6-08bc-4b59-985d-4968e75170ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e416466bf1c742f5b56e651f847ca0be', 'request_id': 'req-f94c45d6-08bc-4b59-985d-4968e75170ca'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:40.165120 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-f94c45d6-08bc-4b59-985d-4968e75170ca admin admin] The token cache is being invalidate because project e416466bf1c742f5b56e651f847ca0be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:33:40.165434 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-f94c45d6-08bc-4b59-985d-4968e75170ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:40.166189 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-f94c45d6-08bc-4b59-985d-4968e75170ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:40.167867 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2793/5585] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:33:40 2022] DELETE /identity/v3/projects/e416466bf1c742f5b56e651f847ca0be => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:33:40.175237 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d225f394-e3f0-4d7e-be6a-b0763ba381a0 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:40.175433 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2793/5586] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:33:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:33:40.175541 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d225f394-e3f0-4d7e-be6a-b0763ba381a0 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:40.175541 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d225f394-e3f0-4d7e-be6a-b0763ba381a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:40.181957 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fe098f-68d8-4780-b189-b53827658afa None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:40.183630 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-35fe098f-68d8-4780-b189-b53827658afa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:40.194135 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-d225f394-e3f0-4d7e-be6a-b0763ba381a0 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:33:40.195475 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-d225f394-e3f0-4d7e-be6a-b0763ba381a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:40.230945 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:33:40.255767 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fe098f-68d8-4780-b189-b53827658afa None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:40.262763 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2794/5587] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:33:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:33:40.270771 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36b2fe1-34c4-414e-904c-3714862a7046 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:40.271056 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36b2fe1-34c4-414e-904c-3714862a7046 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:40.271352 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36b2fe1-34c4-414e-904c-3714862a7046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:40.289262 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-d36b2fe1-34c4-414e-904c-3714862a7046 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:33:40.290502 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-d36b2fe1-34c4-414e-904c-3714862a7046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:40.300051 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2795/5588] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:33:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:33:40.304064 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36b2fe1-34c4-414e-904c-3714862a7046 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:40.306322 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae4b20b-73e2-4d71-9b81-1cf3fc8e5da9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:40.306989 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae4b20b-73e2-4d71-9b81-1cf3fc8e5da9 service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:40.307266 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae4b20b-73e2-4d71-9b81-1cf3fc8e5da9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:40.307537 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae4b20b-73e2-4d71-9b81-1cf3fc8e5da9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:40.313779 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36b2fe1-34c4-414e-904c-3714862a7046 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:40.318558 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae4b20b-73e2-4d71-9b81-1cf3fc8e5da9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:40.318739 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0fd050-bf43-4d33-b17c-16a1572caa42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:40.319437 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0fd050-bf43-4d33-b17c-16a1572caa42 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:40.319717 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0fd050-bf43-4d33-b17c-16a1572caa42 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:40.319987 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0fd050-bf43-4d33-b17c-16a1572caa42 admin admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:40.320118 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae4b20b-73e2-4d71-9b81-1cf3fc8e5da9 service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:40.320714 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0fd050-bf43-4d33-b17c-16a1572caa42 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:33:40.321012 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0fd050-bf43-4d33-b17c-16a1572caa42 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:40.322632 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0fd050-bf43-4d33-b17c-16a1572caa42 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:40.331382 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2794/5589] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:33:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:33:40.339846 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2796/5590] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:33:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:33:40.344636 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae4b20b-73e2-4d71-9b81-1cf3fc8e5da9 service neutron] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:40.356008 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae4b20b-73e2-4d71-9b81-1cf3fc8e5da9 service neutron] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:40.361166 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f3b9ab-14e1-41f0-ba26-cd840b9524b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:40.361836 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f3b9ab-14e1-41f0-ba26-cd840b9524b1 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:40.362148 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f3b9ab-14e1-41f0-ba26-cd840b9524b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:40.362430 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f3b9ab-14e1-41f0-ba26-cd840b9524b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:40.363124 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f3b9ab-14e1-41f0-ba26-cd840b9524b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:40.365060 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f3b9ab-14e1-41f0-ba26-cd840b9524b1 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:40.380370 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:33:40.398937 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2795/5591] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:33:40 2022] POST /identity/v3/projects => generated 375 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:33:40.400157 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0fd050-bf43-4d33-b17c-16a1572caa42 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:40.411182 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0fd050-bf43-4d33-b17c-16a1572caa42 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:40.482525 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b459ce9-2769-4e0e-b483-7e0ad69242e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:40.483309 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b459ce9-2769-4e0e-b483-7e0ad69242e1 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:40.483606 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b459ce9-2769-4e0e-b483-7e0ad69242e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:40.484041 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b459ce9-2769-4e0e-b483-7e0ad69242e1 admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:40.484896 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b459ce9-2769-4e0e-b483-7e0ad69242e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:40.486840 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b459ce9-2769-4e0e-b483-7e0ad69242e1 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:40.516796 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2797/5592] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:33:40 2022] POST /identity/v3/users => generated 288 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:33:40.518782 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f3b9ab-14e1-41f0-ba26-cd840b9524b1 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:40.530563 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f3b9ab-14e1-41f0-ba26-cd840b9524b1 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:40.537558 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8c16a4-2c5c-4867-91bb-0a342a281180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:40.538636 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8c16a4-2c5c-4867-91bb-0a342a281180 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:40.539074 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8c16a4-2c5c-4867-91bb-0a342a281180 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:40.540025 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8c16a4-2c5c-4867-91bb-0a342a281180 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:40.541291 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8c16a4-2c5c-4867-91bb-0a342a281180 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:40.544510 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8c16a4-2c5c-4867-91bb-0a342a281180 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:40.561257 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2796/5593] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:33:40 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:33:40.567866 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b459ce9-2769-4e0e-b483-7e0ad69242e1 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:40.581894 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b459ce9-2769-4e0e-b483-7e0ad69242e1 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:40.589649 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d803bc-56c2-4eda-8a04-fcc6785a283b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:40.590678 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d803bc-56c2-4eda-8a04-fcc6785a283b admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:40.590957 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d803bc-56c2-4eda-8a04-fcc6785a283b admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:40.591488 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d803bc-56c2-4eda-8a04-fcc6785a283b admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:40.592480 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d803bc-56c2-4eda-8a04-fcc6785a283b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:40.594106 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d803bc-56c2-4eda-8a04-fcc6785a283b admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:40.609900 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2798/5594] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:33:40 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:33:40.614282 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8c16a4-2c5c-4867-91bb-0a342a281180 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:40.627163 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8c16a4-2c5c-4867-91bb-0a342a281180 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:40.636433 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7eaa280-9efe-4168-a2dd-c4deed9d329e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:40.638404 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eaa280-9efe-4168-a2dd-c4deed9d329e admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:40.638577 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eaa280-9efe-4168-a2dd-c4deed9d329e admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:40.638987 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eaa280-9efe-4168-a2dd-c4deed9d329e admin admin] PATH_INFO: `/v3/projects/4ab51920cb5441df8d5750d1ce130a49/users/5b3350df45b34075ae375e2d11ff914a/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:40.658682 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7eaa280-9efe-4168-a2dd-c4deed9d329e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ab51920cb5441df8d5750d1ce130a49, user_id=5b3350df45b34075ae375e2d11ff914a, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:40.662276 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7eaa280-9efe-4168-a2dd-c4deed9d329e admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:40.679905 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2797/5595] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:33:40 2022] PUT /identity/v3/projects/4ab51920cb5441df8d5750d1ce130a49/users/5b3350df45b34075ae375e2d11ff914a/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:33:40.690411 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aed8cd-b4c7-4701-8694-d5887ff3e206 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:40.690710 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aed8cd-b4c7-4701-8694-d5887ff3e206 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:40.690994 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aed8cd-b4c7-4701-8694-d5887ff3e206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:40.723374 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-c5aed8cd-b4c7-4701-8694-d5887ff3e206 None None] MFA Rules not processed for user `5b3350df45b34075ae375e2d11ff914a`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:33:40.724802 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-c5aed8cd-b4c7-4701-8694-d5887ff3e206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:40.787823 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7eaa280-9efe-4168-a2dd-c4deed9d329e admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:40.789769 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-d7eaa280-9efe-4168-a2dd-c4deed9d329e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:40.822793 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2799/5596] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:33:40 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:33:40.835666 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5aed8cd-b4c7-4701-8694-d5887ff3e206 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:40.864300 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:33:40.896355 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7eaa280-9efe-4168-a2dd-c4deed9d329e admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:40.901456 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23416b86-c490-4bfa-84cb-1859bab2ed7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:40.902408 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23416b86-c490-4bfa-84cb-1859bab2ed7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:40.902688 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23416b86-c490-4bfa-84cb-1859bab2ed7d admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:40.902963 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23416b86-c490-4bfa-84cb-1859bab2ed7d admin admin] PATH_INFO: `/v3/projects/52dbc9317e564a6a8e238a99dbc0abf5` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:40.904162 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23416b86-c490-4bfa-84cb-1859bab2ed7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=52dbc9317e564a6a8e238a99dbc0abf5)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:40.906294 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23416b86-c490-4bfa-84cb-1859bab2ed7d admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:40.909778 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5aed8cd-b4c7-4701-8694-d5887ff3e206 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:40.915826 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa17b0e3-bda7-4681-b190-3f7c0c1b9e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:40.916586 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa17b0e3-bda7-4681-b190-3f7c0c1b9e91 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:40.916939 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa17b0e3-bda7-4681-b190-3f7c0c1b9e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:40.917283 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa17b0e3-bda7-4681-b190-3f7c0c1b9e91 admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:40.918083 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa17b0e3-bda7-4681-b190-3f7c0c1b9e91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:40.920561 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa17b0e3-bda7-4681-b190-3f7c0c1b9e91 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:40.949936 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2800/5597] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:33:40 2022] POST /identity/v3/projects => generated 377 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:33:40.952231 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa17b0e3-bda7-4681-b190-3f7c0c1b9e91 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:40.964169 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-23416b86-c490-4bfa-84cb-1859bab2ed7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52dbc9317e564a6a8e238a99dbc0abf5', 'request_id': 'req-23416b86-c490-4bfa-84cb-1859bab2ed7d'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:40.974825 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-23416b86-c490-4bfa-84cb-1859bab2ed7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52dbc9317e564a6a8e238a99dbc0abf5', 'request_id': 'req-23416b86-c490-4bfa-84cb-1859bab2ed7d'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:40.981727 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-23416b86-c490-4bfa-84cb-1859bab2ed7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52dbc9317e564a6a8e238a99dbc0abf5', 'request_id': 'req-23416b86-c490-4bfa-84cb-1859bab2ed7d'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:40.994604 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-23416b86-c490-4bfa-84cb-1859bab2ed7d admin admin] The token cache is being invalidate because project 52dbc9317e564a6a8e238a99dbc0abf5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:33:40.995054 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-23416b86-c490-4bfa-84cb-1859bab2ed7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:40.995765 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-23416b86-c490-4bfa-84cb-1859bab2ed7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:40.997597 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2798/5598] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:33:40 2022] DELETE /identity/v3/projects/52dbc9317e564a6a8e238a99dbc0abf5 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:33:40.998417 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23416b86-c490-4bfa-84cb-1859bab2ed7d admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:40.999860 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-23416b86-c490-4bfa-84cb-1859bab2ed7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:41.025553 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa17b0e3-bda7-4681-b190-3f7c0c1b9e91 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:41.031040 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319d9188-fdb3-4826-893b-fefc04b1aca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:41.031748 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319d9188-fdb3-4826-893b-fefc04b1aca1 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:41.032033 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319d9188-fdb3-4826-893b-fefc04b1aca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:41.032313 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319d9188-fdb3-4826-893b-fefc04b1aca1 admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:41.033018 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319d9188-fdb3-4826-893b-fefc04b1aca1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:41.035029 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319d9188-fdb3-4826-893b-fefc04b1aca1 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:41.057906 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2801/5599] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:33:40 2022] POST /identity/v3/users => generated 295 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:33:41.065249 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8123273c-c977-4e36-8d22-20e2e2bfcce9 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:41.065681 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8123273c-c977-4e36-8d22-20e2e2bfcce9 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:41.066098 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8123273c-c977-4e36-8d22-20e2e2bfcce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:41.070249 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23416b86-c490-4bfa-84cb-1859bab2ed7d admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:41.075073 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:33:41.090339 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-8123273c-c977-4e36-8d22-20e2e2bfcce9 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:33:41.091775 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-8123273c-c977-4e36-8d22-20e2e2bfcce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:41.108340 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2802/5600] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:33:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:33:41.108340 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8123273c-c977-4e36-8d22-20e2e2bfcce9 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:41.109919 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-8123273c-c977-4e36-8d22-20e2e2bfcce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:41.123090 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8123273c-c977-4e36-8d22-20e2e2bfcce9 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:41.132253 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0c03b1-fde6-44d6-898f-34fa75b851c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:41.132936 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0c03b1-fde6-44d6-898f-34fa75b851c3 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:41.133215 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0c03b1-fde6-44d6-898f-34fa75b851c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:41.134697 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0c03b1-fde6-44d6-898f-34fa75b851c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:41.135601 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0c03b1-fde6-44d6-898f-34fa75b851c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:41.137380 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0c03b1-fde6-44d6-898f-34fa75b851c3 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:41.144211 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b80432-1349-442a-a3bc-59781d371e83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:41.144915 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b80432-1349-442a-a3bc-59781d371e83 service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:41.145628 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b80432-1349-442a-a3bc-59781d371e83 service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:41.145997 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b80432-1349-442a-a3bc-59781d371e83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:41.148249 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-06b80432-1349-442a-a3bc-59781d371e83 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:41.151049 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2803/5601] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:33:41 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:33:41.151862 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9c5c3c-fde1-433f-a837-ee0b15684779 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:41.152216 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9c5c3c-fde1-433f-a837-ee0b15684779 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:41.152560 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9c5c3c-fde1-433f-a837-ee0b15684779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:41.171330 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-9e9c5c3c-fde1-433f-a837-ee0b15684779 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:33:41.172634 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-9e9c5c3c-fde1-433f-a837-ee0b15684779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:41.181255 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2804/5602] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:33:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:33:41.182149 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9c5c3c-fde1-433f-a837-ee0b15684779 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:41.191855 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9c5c3c-fde1-433f-a837-ee0b15684779 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:41.199563 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b28cc5-955f-47b4-985e-0741c96f6e9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:41.200586 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b28cc5-955f-47b4-985e-0741c96f6e9a admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:41.200787 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b28cc5-955f-47b4-985e-0741c96f6e9a admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:41.201063 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b28cc5-955f-47b4-985e-0741c96f6e9a admin admin] PATH_INFO: `/v3/projects/a01981a2762e4f9096ba51cbb3d8b8b9/users/166e11093cb8485eb68fa894b72eac47/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:41.218953 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b28cc5-955f-47b4-985e-0741c96f6e9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a01981a2762e4f9096ba51cbb3d8b8b9, user_id=166e11093cb8485eb68fa894b72eac47, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:41.222087 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b28cc5-955f-47b4-985e-0741c96f6e9a admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:41.228780 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b80432-1349-442a-a3bc-59781d371e83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:41.230548 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b80432-1349-442a-a3bc-59781d371e83 service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:41.244159 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2805/5603] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:33:41 2022] PUT /identity/v3/projects/a01981a2762e4f9096ba51cbb3d8b8b9/users/166e11093cb8485eb68fa894b72eac47/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:33:41.244159 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b28cc5-955f-47b4-985e-0741c96f6e9a admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:41.247618 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2799/5604] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:33:40 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:33:41.248373 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b80432-1349-442a-a3bc-59781d371e83 service neutron] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:41.278463 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b80432-1349-442a-a3bc-59781d371e83 service neutron] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:41.335379 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:33:41.371202 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b28cc5-955f-47b4-985e-0741c96f6e9a admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:41.385440 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79e4c2a-ee34-45df-8028-b64824b996c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:41.386195 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79e4c2a-ee34-45df-8028-b64824b996c1 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:41.386479 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79e4c2a-ee34-45df-8028-b64824b996c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:41.386754 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79e4c2a-ee34-45df-8028-b64824b996c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:41.387494 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79e4c2a-ee34-45df-8028-b64824b996c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:33:41.387955 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79e4c2a-ee34-45df-8028-b64824b996c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:41.389569 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79e4c2a-ee34-45df-8028-b64824b996c1 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:41.405495 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f16c33e-3bbf-4374-a54b-118bdaa4af01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:41.407733 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f16c33e-3bbf-4374-a54b-118bdaa4af01 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:41.408156 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f16c33e-3bbf-4374-a54b-118bdaa4af01 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:41.408376 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f16c33e-3bbf-4374-a54b-118bdaa4af01 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:41.409346 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f16c33e-3bbf-4374-a54b-118bdaa4af01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:41.412032 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f16c33e-3bbf-4374-a54b-118bdaa4af01 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:41.419486 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2806/5605] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:33:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:33:41.420828 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79e4c2a-ee34-45df-8028-b64824b996c1 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:41.425045 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2800/5606] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:33:41 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:33:41.429621 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f16c33e-3bbf-4374-a54b-118bdaa4af01 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:41.434991 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79e4c2a-ee34-45df-8028-b64824b996c1 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:41.443179 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f16c33e-3bbf-4374-a54b-118bdaa4af01 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:41.445301 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4be020b-0bfc-4a10-a615-8e6722f81225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:41.447258 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4be020b-0bfc-4a10-a615-8e6722f81225 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:41.447889 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4be020b-0bfc-4a10-a615-8e6722f81225 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:41.449374 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d81dcec-65ac-42da-abd7-4a6b39ee9347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:41.449744 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4be020b-0bfc-4a10-a615-8e6722f81225 admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:41.450308 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d81dcec-65ac-42da-abd7-4a6b39ee9347 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:41.450661 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d81dcec-65ac-42da-abd7-4a6b39ee9347 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:41.451012 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d81dcec-65ac-42da-abd7-4a6b39ee9347 admin admin] PATH_INFO: `/v3/projects/a01981a2762e4f9096ba51cbb3d8b8b9/users/166e11093cb8485eb68fa894b72eac47/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:41.451285 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4be020b-0bfc-4a10-a615-8e6722f81225 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:41.453907 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d81dcec-65ac-42da-abd7-4a6b39ee9347 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a01981a2762e4f9096ba51cbb3d8b8b9, user_id=166e11093cb8485eb68fa894b72eac47, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:41.456373 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4be020b-0bfc-4a10-a615-8e6722f81225 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:41.456814 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d81dcec-65ac-42da-abd7-4a6b39ee9347 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:41.477980 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2801/5607] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:33:41 2022] PUT /identity/v3/projects/a01981a2762e4f9096ba51cbb3d8b8b9/users/166e11093cb8485eb68fa894b72eac47/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:33:41.488889 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a429eeac-274e-4e2a-b05a-2346c1e2e109 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:41.490065 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a429eeac-274e-4e2a-b05a-2346c1e2e109 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:41.490065 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a429eeac-274e-4e2a-b05a-2346c1e2e109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:41.496456 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2807/5608] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:33:41 2022] POST /identity/v3/projects => generated 377 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:33:41.500937 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4be020b-0bfc-4a10-a615-8e6722f81225 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:41.527883 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-a429eeac-274e-4e2a-b05a-2346c1e2e109 None None] MFA Rules not processed for user `166e11093cb8485eb68fa894b72eac47`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:33:41.529195 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-a429eeac-274e-4e2a-b05a-2346c1e2e109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:41.566366 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:33:41.583658 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4be020b-0bfc-4a10-a615-8e6722f81225 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:41.588582 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b07557-4268-4080-945a-10412ef2dde8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:41.589399 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b07557-4268-4080-945a-10412ef2dde8 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:41.589692 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b07557-4268-4080-945a-10412ef2dde8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:41.590020 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b07557-4268-4080-945a-10412ef2dde8 admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:41.591211 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b07557-4268-4080-945a-10412ef2dde8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:41.593146 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b07557-4268-4080-945a-10412ef2dde8 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:41.619959 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2802/5609] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:33:41 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:33:41.620170 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2808/5610] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:33:41 2022] POST /identity/v3/users => generated 289 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:33:41.621032 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a429eeac-274e-4e2a-b05a-2346c1e2e109 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:41.621762 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b07557-4268-4080-945a-10412ef2dde8 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:41.632795 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a429eeac-274e-4e2a-b05a-2346c1e2e109 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:41.633579 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b07557-4268-4080-945a-10412ef2dde8 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:41.638782 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec31273-6742-4813-ba80-6830c38c3863 tempest-TestDefaultProjectId-1184223139 tempest-TestDefaultProjectId-1184223139-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '166e11093cb8485eb68fa894b72eac47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a01981a2762e4f9096ba51cbb3d8b8b9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:41.638973 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578c6a2c-1faf-41d7-b3e0-daae6091d58a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:41.640064 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec31273-6742-4813-ba80-6830c38c3863 tempest-TestDefaultProjectId-1184223139 tempest-TestDefaultProjectId-1184223139-project-admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:41.640185 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578c6a2c-1faf-41d7-b3e0-daae6091d58a admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:41.640185 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578c6a2c-1faf-41d7-b3e0-daae6091d58a admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:41.640387 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec31273-6742-4813-ba80-6830c38c3863 tempest-TestDefaultProjectId-1184223139 tempest-TestDefaultProjectId-1184223139-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:41.640551 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578c6a2c-1faf-41d7-b3e0-daae6091d58a admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:41.640651 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec31273-6742-4813-ba80-6830c38c3863 tempest-TestDefaultProjectId-1184223139 tempest-TestDefaultProjectId-1184223139-project-admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:41.641158 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec31273-6742-4813-ba80-6830c38c3863 tempest-TestDefaultProjectId-1184223139 tempest-TestDefaultProjectId-1184223139-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:41.641297 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578c6a2c-1faf-41d7-b3e0-daae6091d58a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:41.643134 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec31273-6742-4813-ba80-6830c38c3863 tempest-TestDefaultProjectId-1184223139 tempest-TestDefaultProjectId-1184223139-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:41.643278 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578c6a2c-1faf-41d7-b3e0-daae6091d58a admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:41.656619 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2809/5611] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:33:41 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 21:33:41.660028 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578c6a2c-1faf-41d7-b3e0-daae6091d58a admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:41.667344 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2803/5612] 10.222.0.17 () {60 vars in 1148 bytes} [Sat Jul 23 21:33:41 2022] POST /identity/v3/domains => generated 246 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:33:41.672152 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec31273-6742-4813-ba80-6830c38c3863 tempest-TestDefaultProjectId-1184223139 tempest-TestDefaultProjectId-1184223139-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:41.676743 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578c6a2c-1faf-41d7-b3e0-daae6091d58a admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:41.762613 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec31273-6742-4813-ba80-6830c38c3863 tempest-TestDefaultProjectId-1184223139 tempest-TestDefaultProjectId-1184223139-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:41.764309 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4964a4-a2ac-4b0d-b371-62618b9dba72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:41.765823 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4964a4-a2ac-4b0d-b371-62618b9dba72 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:41.766328 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4964a4-a2ac-4b0d-b371-62618b9dba72 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:41.766592 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4964a4-a2ac-4b0d-b371-62618b9dba72 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:41.767716 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4964a4-a2ac-4b0d-b371-62618b9dba72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:41.770074 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4964a4-a2ac-4b0d-b371-62618b9dba72 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:41.771762 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0a7249-a8e3-4d6f-ab7b-b4e18bbec0de tempest-TestDefaultProjectId-1184223139 tempest-TestDefaultProjectId-1184223139-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '166e11093cb8485eb68fa894b72eac47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a01981a2762e4f9096ba51cbb3d8b8b9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:41.772910 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0a7249-a8e3-4d6f-ab7b-b4e18bbec0de tempest-TestDefaultProjectId-1184223139 tempest-TestDefaultProjectId-1184223139-project-admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:41.773277 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0a7249-a8e3-4d6f-ab7b-b4e18bbec0de tempest-TestDefaultProjectId-1184223139 tempest-TestDefaultProjectId-1184223139-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:41.773599 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0a7249-a8e3-4d6f-ab7b-b4e18bbec0de tempest-TestDefaultProjectId-1184223139 tempest-TestDefaultProjectId-1184223139-project-admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:41.774577 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0a7249-a8e3-4d6f-ab7b-b4e18bbec0de tempest-TestDefaultProjectId-1184223139 tempest-TestDefaultProjectId-1184223139-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:41.776854 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0a7249-a8e3-4d6f-ab7b-b4e18bbec0de tempest-TestDefaultProjectId-1184223139 tempest-TestDefaultProjectId-1184223139-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:41.790070 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2810/5613] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:33:41 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:33:41.794687 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4964a4-a2ac-4b0d-b371-62618b9dba72 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:41.824357 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4964a4-a2ac-4b0d-b371-62618b9dba72 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:41.830191 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86723d4b-d8df-410e-a7b7-09e3fc917c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:41.831108 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86723d4b-d8df-410e-a7b7-09e3fc917c5c admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:41.831695 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86723d4b-d8df-410e-a7b7-09e3fc917c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:41.831813 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86723d4b-d8df-410e-a7b7-09e3fc917c5c admin admin] PATH_INFO: `/v3/projects/7b9c8d66179945899c085f25b1d09faa/users/24581feb84654bc7a874cc1a2cb59da3/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:41.853053 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86723d4b-d8df-410e-a7b7-09e3fc917c5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b9c8d66179945899c085f25b1d09faa, user_id=24581feb84654bc7a874cc1a2cb59da3, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:41.856024 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86723d4b-d8df-410e-a7b7-09e3fc917c5c admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:41.885899 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2804/5614] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:33:41 2022] POST /identity/v3/projects => generated 408 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:33:41.886833 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0a7249-a8e3-4d6f-ab7b-b4e18bbec0de tempest-TestDefaultProjectId-1184223139 tempest-TestDefaultProjectId-1184223139-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:41.888825 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2811/5615] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:33:41 2022] PUT /identity/v3/projects/7b9c8d66179945899c085f25b1d09faa/users/24581feb84654bc7a874cc1a2cb59da3/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:33:41.900873 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824331f1-cda2-42e2-95a3-1e42045defbf None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:41.901230 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824331f1-cda2-42e2-95a3-1e42045defbf None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:41.901410 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824331f1-cda2-42e2-95a3-1e42045defbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:41.992314 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0a7249-a8e3-4d6f-ab7b-b4e18bbec0de tempest-TestDefaultProjectId-1184223139 tempest-TestDefaultProjectId-1184223139-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:42.038559 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:33:42.066600 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e403976d-dce9-4243-8ca0-a3cce09f1f11 tempest-TestDefaultProjectId-1184223139 tempest-TestDefaultProjectId-1184223139-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '166e11093cb8485eb68fa894b72eac47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a01981a2762e4f9096ba51cbb3d8b8b9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:42.067604 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e403976d-dce9-4243-8ca0-a3cce09f1f11 tempest-TestDefaultProjectId-1184223139 tempest-TestDefaultProjectId-1184223139-project-admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:42.068117 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e403976d-dce9-4243-8ca0-a3cce09f1f11 tempest-TestDefaultProjectId-1184223139 tempest-TestDefaultProjectId-1184223139-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:42.068399 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e403976d-dce9-4243-8ca0-a3cce09f1f11 tempest-TestDefaultProjectId-1184223139 tempest-TestDefaultProjectId-1184223139-project-admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:42.069131 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e403976d-dce9-4243-8ca0-a3cce09f1f11 tempest-TestDefaultProjectId-1184223139 tempest-TestDefaultProjectId-1184223139-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:42.071286 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e403976d-dce9-4243-8ca0-a3cce09f1f11 tempest-TestDefaultProjectId-1184223139 tempest-TestDefaultProjectId-1184223139-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:42.098434 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2805/5616] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:33:41 2022] POST /identity/v3/users => generated 347 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:33:42.099839 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e403976d-dce9-4243-8ca0-a3cce09f1f11 tempest-TestDefaultProjectId-1184223139 tempest-TestDefaultProjectId-1184223139-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:42.108698 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:33:42.112222 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-824331f1-cda2-42e2-95a3-1e42045defbf None None] MFA Rules not processed for user `24581feb84654bc7a874cc1a2cb59da3`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:33:42.112384 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e403976d-dce9-4243-8ca0-a3cce09f1f11 tempest-TestDefaultProjectId-1184223139 tempest-TestDefaultProjectId-1184223139-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:42.114374 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-824331f1-cda2-42e2-95a3-1e42045defbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:42.118357 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a4f8e5-6ba8-451e-b2ee-42d3c94edfdc tempest-TestDefaultProjectId-1184223139 tempest-TestDefaultProjectId-1184223139-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '166e11093cb8485eb68fa894b72eac47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a01981a2762e4f9096ba51cbb3d8b8b9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:42.119349 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a4f8e5-6ba8-451e-b2ee-42d3c94edfdc tempest-TestDefaultProjectId-1184223139 tempest-TestDefaultProjectId-1184223139-project-admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:42.119808 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a4f8e5-6ba8-451e-b2ee-42d3c94edfdc tempest-TestDefaultProjectId-1184223139 tempest-TestDefaultProjectId-1184223139-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:42.120226 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a4f8e5-6ba8-451e-b2ee-42d3c94edfdc tempest-TestDefaultProjectId-1184223139 tempest-TestDefaultProjectId-1184223139-project-admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:42.121011 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a4f8e5-6ba8-451e-b2ee-42d3c94edfdc tempest-TestDefaultProjectId-1184223139 tempest-TestDefaultProjectId-1184223139-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:42.122733 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a4f8e5-6ba8-451e-b2ee-42d3c94edfdc tempest-TestDefaultProjectId-1184223139 tempest-TestDefaultProjectId-1184223139-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:42.135436 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2806/5617] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:33:42 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:33:42.140236 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a4f8e5-6ba8-451e-b2ee-42d3c94edfdc tempest-TestDefaultProjectId-1184223139 tempest-TestDefaultProjectId-1184223139-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:42.151617 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a4f8e5-6ba8-451e-b2ee-42d3c94edfdc tempest-TestDefaultProjectId-1184223139 tempest-TestDefaultProjectId-1184223139-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:42.156649 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb87392c-108f-4d23-ab23-f0f750bc73ba tempest-TestDefaultProjectId-1184223139 tempest-TestDefaultProjectId-1184223139-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '166e11093cb8485eb68fa894b72eac47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a01981a2762e4f9096ba51cbb3d8b8b9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:42.157674 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb87392c-108f-4d23-ab23-f0f750bc73ba tempest-TestDefaultProjectId-1184223139 tempest-TestDefaultProjectId-1184223139-project-admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:42.158094 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb87392c-108f-4d23-ab23-f0f750bc73ba tempest-TestDefaultProjectId-1184223139 tempest-TestDefaultProjectId-1184223139-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:42.158474 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb87392c-108f-4d23-ab23-f0f750bc73ba tempest-TestDefaultProjectId-1184223139 tempest-TestDefaultProjectId-1184223139-project-admin] PATH_INFO: `/v3/projects/e2a45950966d4d699395bd4ec4f9bdc0/users/2b75c9071583485abca3e52ba3a287a8/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:42.176662 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb87392c-108f-4d23-ab23-f0f750bc73ba tempest-TestDefaultProjectId-1184223139 tempest-TestDefaultProjectId-1184223139-project-admin] RBAC: Authorizing `identity:create_grant(project_id=e2a45950966d4d699395bd4ec4f9bdc0, user_id=2b75c9071583485abca3e52ba3a287a8, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:42.179789 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb87392c-108f-4d23-ab23-f0f750bc73ba tempest-TestDefaultProjectId-1184223139 tempest-TestDefaultProjectId-1184223139-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:42.189679 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2812/5618] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:33:41 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:33:42.194261 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824331f1-cda2-42e2-95a3-1e42045defbf None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:42.196243 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2807/5619] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:33:42 2022] PUT /identity/v3/projects/e2a45950966d4d699395bd4ec4f9bdc0/users/2b75c9071583485abca3e52ba3a287a8/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:33:42.200988 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125c5d46-ffc7-4336-8397-c93ce3bc3918 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:42.201274 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125c5d46-ffc7-4336-8397-c93ce3bc3918 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:42.201554 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125c5d46-ffc7-4336-8397-c93ce3bc3918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:42.272007 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824331f1-cda2-42e2-95a3-1e42045defbf None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:42.319856 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-125c5d46-ffc7-4336-8397-c93ce3bc3918 None None] MFA Rules not processed for user `2b75c9071583485abca3e52ba3a287a8`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:33:42.321100 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-125c5d46-ffc7-4336-8397-c93ce3bc3918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:42.347935 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2808/5620] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:33:42 2022] POST /identity/v3/auth/tokens => generated 3352 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:33:42.358533 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9048a3ed-6831-4ae6-9f75-fa74629d9d92 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:42.358744 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efe83a3-a4ce-413e-ad80-63c87bacb7a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:42.359212 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9048a3ed-6831-4ae6-9f75-fa74629d9d92 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:42.359212 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9048a3ed-6831-4ae6-9f75-fa74629d9d92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:42.359573 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efe83a3-a4ce-413e-ad80-63c87bacb7a2 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:42.359916 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efe83a3-a4ce-413e-ad80-63c87bacb7a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:42.360248 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efe83a3-a4ce-413e-ad80-63c87bacb7a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:42.361005 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efe83a3-a4ce-413e-ad80-63c87bacb7a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:42.363115 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efe83a3-a4ce-413e-ad80-63c87bacb7a2 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:42.381010 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-9048a3ed-6831-4ae6-9f75-fa74629d9d92 None None] MFA Rules not processed for user `2b75c9071583485abca3e52ba3a287a8`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:33:42.382409 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-9048a3ed-6831-4ae6-9f75-fa74629d9d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:42.391837 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2809/5621] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:33:42 2022] POST /identity/v3/auth/tokens => generated 3352 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:33:42.397161 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9048a3ed-6831-4ae6-9f75-fa74629d9d92 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:42.408667 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2813/5622] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:33:42 2022] POST /identity/v3/projects => generated 375 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:33:42.414850 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9048a3ed-6831-4ae6-9f75-fa74629d9d92 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:42.422950 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efe83a3-a4ce-413e-ad80-63c87bacb7a2 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:42.499662 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:33:42.506812 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:33:42.527293 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66145ef-6e31-45cc-8d67-3ecf439942ad tempest-test_project-1855171200 tempest-user-727992356] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b75c9071583485abca3e52ba3a287a8', 'user_domain_id': '2033070f7ae8401881e52afee818026c', 'system_scope': None, 'project_id': 'e2a45950966d4d699395bd4ec4f9bdc0', 'project_domain_id': '2033070f7ae8401881e52afee818026c', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:42.527969 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66145ef-6e31-45cc-8d67-3ecf439942ad tempest-test_project-1855171200 tempest-user-727992356] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:42.528978 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66145ef-6e31-45cc-8d67-3ecf439942ad tempest-test_project-1855171200 tempest-user-727992356] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:42.529262 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66145ef-6e31-45cc-8d67-3ecf439942ad tempest-test_project-1855171200 tempest-user-727992356] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:42.530857 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efe83a3-a4ce-413e-ad80-63c87bacb7a2 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:42.539917 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66145ef-6e31-45cc-8d67-3ecf439942ad tempest-test_project-1855171200 tempest-user-727992356] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:42.541978 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66145ef-6e31-45cc-8d67-3ecf439942ad tempest-test_project-1855171200 tempest-user-727992356] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:42.543092 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342db859-0f46-4e8c-ad80-ff127e4aaffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:42.543893 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342db859-0f46-4e8c-ad80-ff127e4aaffb admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:42.544270 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342db859-0f46-4e8c-ad80-ff127e4aaffb admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:42.544632 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342db859-0f46-4e8c-ad80-ff127e4aaffb admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:42.545411 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342db859-0f46-4e8c-ad80-ff127e4aaffb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:42.547454 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342db859-0f46-4e8c-ad80-ff127e4aaffb admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:42.552624 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2810/5623] 10.222.0.17 () {56 vars in 1283 bytes} [Sat Jul 23 21:33:42 2022] GET /identity/v3/auth/tokens => generated 3352 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:33:42.556862 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66145ef-6e31-45cc-8d67-3ecf439942ad tempest-test_project-1855171200 tempest-user-727992356] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:42.579637 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2814/5624] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:33:42 2022] POST /identity/v3/users => generated 294 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:33:42.582419 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342db859-0f46-4e8c-ad80-ff127e4aaffb admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:42.599442 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342db859-0f46-4e8c-ad80-ff127e4aaffb admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:42.615370 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13035fc-a3dd-421f-98fd-1201565fc4d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:42.616097 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13035fc-a3dd-421f-98fd-1201565fc4d5 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:42.616456 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13035fc-a3dd-421f-98fd-1201565fc4d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:42.616735 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13035fc-a3dd-421f-98fd-1201565fc4d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:42.617470 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13035fc-a3dd-421f-98fd-1201565fc4d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:42.619239 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13035fc-a3dd-421f-98fd-1201565fc4d5 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:42.632415 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2815/5625] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:33:42 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:33:42.636580 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13035fc-a3dd-421f-98fd-1201565fc4d5 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:42.649551 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13035fc-a3dd-421f-98fd-1201565fc4d5 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:42.651168 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66145ef-6e31-45cc-8d67-3ecf439942ad tempest-test_project-1855171200 tempest-user-727992356] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:42.655590 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567b5605-8be9-485d-9fd8-1041ff7d5483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:42.656597 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567b5605-8be9-485d-9fd8-1041ff7d5483 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:42.656889 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567b5605-8be9-485d-9fd8-1041ff7d5483 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:42.657151 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567b5605-8be9-485d-9fd8-1041ff7d5483 admin admin] PATH_INFO: `/v3/projects/6444c58ca5d24ebebb9b9897e70be1f0/users/d7c592ae7eab41c89477d91e0eb4b662/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:42.657445 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9441f536-b723-45d5-afc2-15ed39c0ce28 tempest-TestDefaultProjectId-1184223139 tempest-TestDefaultProjectId-1184223139-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '166e11093cb8485eb68fa894b72eac47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a01981a2762e4f9096ba51cbb3d8b8b9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:42.658384 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9441f536-b723-45d5-afc2-15ed39c0ce28 tempest-TestDefaultProjectId-1184223139 tempest-TestDefaultProjectId-1184223139-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:42.658665 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9441f536-b723-45d5-afc2-15ed39c0ce28 tempest-TestDefaultProjectId-1184223139 tempest-TestDefaultProjectId-1184223139-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:42.658984 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9441f536-b723-45d5-afc2-15ed39c0ce28 tempest-TestDefaultProjectId-1184223139 tempest-TestDefaultProjectId-1184223139-project-admin] PATH_INFO: `/v3/users/2b75c9071583485abca3e52ba3a287a8` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:42.660420 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9441f536-b723-45d5-afc2-15ed39c0ce28 tempest-TestDefaultProjectId-1184223139 tempest-TestDefaultProjectId-1184223139-project-admin] RBAC: Authorizing `identity:delete_user(user_id=2b75c9071583485abca3e52ba3a287a8)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:42.663838 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9441f536-b723-45d5-afc2-15ed39c0ce28 tempest-TestDefaultProjectId-1184223139 tempest-TestDefaultProjectId-1184223139-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:42.677916 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567b5605-8be9-485d-9fd8-1041ff7d5483 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6444c58ca5d24ebebb9b9897e70be1f0, user_id=d7c592ae7eab41c89477d91e0eb4b662, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:42.681100 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567b5605-8be9-485d-9fd8-1041ff7d5483 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:42.709382 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2816/5626] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:33:42 2022] PUT /identity/v3/projects/6444c58ca5d24ebebb9b9897e70be1f0/users/d7c592ae7eab41c89477d91e0eb4b662/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:33:42.713769 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567b5605-8be9-485d-9fd8-1041ff7d5483 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:42.755984 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-9441f536-b723-45d5-afc2-15ed39c0ce28 tempest-TestDefaultProjectId-1184223139 tempest-TestDefaultProjectId-1184223139-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b75c9071583485abca3e52ba3a287a8'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:42.768904 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-9441f536-b723-45d5-afc2-15ed39c0ce28 tempest-TestDefaultProjectId-1184223139 tempest-TestDefaultProjectId-1184223139-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b75c9071583485abca3e52ba3a287a8'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:42.771157 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-9441f536-b723-45d5-afc2-15ed39c0ce28 tempest-TestDefaultProjectId-1184223139 tempest-TestDefaultProjectId-1184223139-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b75c9071583485abca3e52ba3a287a8'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:42.787676 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-9441f536-b723-45d5-afc2-15ed39c0ce28 tempest-TestDefaultProjectId-1184223139 tempest-TestDefaultProjectId-1184223139-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b75c9071583485abca3e52ba3a287a8'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:42.797022 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567b5605-8be9-485d-9fd8-1041ff7d5483 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:42.802404 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd792c8-10c9-41d7-b149-6d8d52ebf15a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:42.803189 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd792c8-10c9-41d7-b149-6d8d52ebf15a admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:42.803474 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd792c8-10c9-41d7-b149-6d8d52ebf15a admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:42.803788 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd792c8-10c9-41d7-b149-6d8d52ebf15a admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:42.804877 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd792c8-10c9-41d7-b149-6d8d52ebf15a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:42.806616 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd792c8-10c9-41d7-b149-6d8d52ebf15a admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:42.816280 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-9441f536-b723-45d5-afc2-15ed39c0ce28 tempest-TestDefaultProjectId-1184223139 tempest-TestDefaultProjectId-1184223139-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b75c9071583485abca3e52ba3a287a8'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:42.826649 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2817/5627] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:33:42 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:33:42.827438 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd792c8-10c9-41d7-b149-6d8d52ebf15a admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:42.828248 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2811/5628] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:33:42 2022] DELETE /identity/v3/users/2b75c9071583485abca3e52ba3a287a8 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:33:42.832345 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-6dd792c8-10c9-41d7-b149-6d8d52ebf15a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:42.832532 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9441f536-b723-45d5-afc2-15ed39c0ce28 tempest-TestDefaultProjectId-1184223139 tempest-TestDefaultProjectId-1184223139-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:42.834030 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-9441f536-b723-45d5-afc2-15ed39c0ce28 tempest-TestDefaultProjectId-1184223139 tempest-TestDefaultProjectId-1184223139-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:42.847040 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd792c8-10c9-41d7-b149-6d8d52ebf15a admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:42.915700 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd48874-c4a3-45e5-adb6-56ce5ede3fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:42.916673 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd48874-c4a3-45e5-adb6-56ce5ede3fc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:42.917043 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd48874-c4a3-45e5-adb6-56ce5ede3fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:42.917432 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd48874-c4a3-45e5-adb6-56ce5ede3fc1 admin admin] PATH_INFO: `/v3/projects/6444c58ca5d24ebebb9b9897e70be1f0/users/d7c592ae7eab41c89477d91e0eb4b662/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:42.919912 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd48874-c4a3-45e5-adb6-56ce5ede3fc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6444c58ca5d24ebebb9b9897e70be1f0, user_id=d7c592ae7eab41c89477d91e0eb4b662, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:42.922587 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd48874-c4a3-45e5-adb6-56ce5ede3fc1 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:42.923945 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9441f536-b723-45d5-afc2-15ed39c0ce28 tempest-TestDefaultProjectId-1184223139 tempest-TestDefaultProjectId-1184223139-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:42.930903 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8758bf22-5a52-4e66-8b7a-3fdea72ac8c7 tempest-TestDefaultProjectId-1184223139 tempest-TestDefaultProjectId-1184223139-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '166e11093cb8485eb68fa894b72eac47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a01981a2762e4f9096ba51cbb3d8b8b9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:42.932202 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8758bf22-5a52-4e66-8b7a-3fdea72ac8c7 tempest-TestDefaultProjectId-1184223139 tempest-TestDefaultProjectId-1184223139-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:42.932753 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8758bf22-5a52-4e66-8b7a-3fdea72ac8c7 tempest-TestDefaultProjectId-1184223139 tempest-TestDefaultProjectId-1184223139-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:42.933032 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8758bf22-5a52-4e66-8b7a-3fdea72ac8c7 tempest-TestDefaultProjectId-1184223139 tempest-TestDefaultProjectId-1184223139-project-admin] PATH_INFO: `/v3/projects/e2a45950966d4d699395bd4ec4f9bdc0` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:42.934308 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8758bf22-5a52-4e66-8b7a-3fdea72ac8c7 tempest-TestDefaultProjectId-1184223139 tempest-TestDefaultProjectId-1184223139-project-admin] RBAC: Authorizing `identity:delete_project(project_id=e2a45950966d4d699395bd4ec4f9bdc0)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:42.936317 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8758bf22-5a52-4e66-8b7a-3fdea72ac8c7 tempest-TestDefaultProjectId-1184223139 tempest-TestDefaultProjectId-1184223139-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:42.937105 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2818/5629] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:33:42 2022] PUT /identity/v3/projects/6444c58ca5d24ebebb9b9897e70be1f0/users/d7c592ae7eab41c89477d91e0eb4b662/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:33:42.947333 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:33:42.951013 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310b2768-6d88-40ef-a60f-8e48dc7367ac None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:42.951587 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310b2768-6d88-40ef-a60f-8e48dc7367ac None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:42.952703 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310b2768-6d88-40ef-a60f-8e48dc7367ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:42.990929 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-310b2768-6d88-40ef-a60f-8e48dc7367ac None None] MFA Rules not processed for user `d7c592ae7eab41c89477d91e0eb4b662`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:33:42.992306 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-310b2768-6d88-40ef-a60f-8e48dc7367ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:43.001081 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:33:43.008570 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-8758bf22-5a52-4e66-8b7a-3fdea72ac8c7 tempest-TestDefaultProjectId-1184223139 tempest-TestDefaultProjectId-1184223139-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2a45950966d4d699395bd4ec4f9bdc0', 'request_id': 'req-8758bf22-5a52-4e66-8b7a-3fdea72ac8c7'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:43.023777 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-8758bf22-5a52-4e66-8b7a-3fdea72ac8c7 tempest-TestDefaultProjectId-1184223139 tempest-TestDefaultProjectId-1184223139-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2a45950966d4d699395bd4ec4f9bdc0', 'request_id': 'req-8758bf22-5a52-4e66-8b7a-3fdea72ac8c7'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:43.035953 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-8758bf22-5a52-4e66-8b7a-3fdea72ac8c7 tempest-TestDefaultProjectId-1184223139 tempest-TestDefaultProjectId-1184223139-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2a45950966d4d699395bd4ec4f9bdc0', 'request_id': 'req-8758bf22-5a52-4e66-8b7a-3fdea72ac8c7'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:43.065612 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-8758bf22-5a52-4e66-8b7a-3fdea72ac8c7 tempest-TestDefaultProjectId-1184223139 tempest-TestDefaultProjectId-1184223139-project-admin] The token cache is being invalidate because project e2a45950966d4d699395bd4ec4f9bdc0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:33:43.066188 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-8758bf22-5a52-4e66-8b7a-3fdea72ac8c7 tempest-TestDefaultProjectId-1184223139 tempest-TestDefaultProjectId-1184223139-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:43.067021 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-8758bf22-5a52-4e66-8b7a-3fdea72ac8c7 tempest-TestDefaultProjectId-1184223139 tempest-TestDefaultProjectId-1184223139-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:43.068953 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2812/5630] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:33:42 2022] DELETE /identity/v3/projects/e2a45950966d4d699395bd4ec4f9bdc0 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:33:43.073940 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8758bf22-5a52-4e66-8b7a-3fdea72ac8c7 tempest-TestDefaultProjectId-1184223139 tempest-TestDefaultProjectId-1184223139-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:43.076260 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-8758bf22-5a52-4e66-8b7a-3fdea72ac8c7 tempest-TestDefaultProjectId-1184223139 tempest-TestDefaultProjectId-1184223139-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:43.088443 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2819/5631] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:33:42 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:33:43.094368 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310b2768-6d88-40ef-a60f-8e48dc7367ac None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:43.104465 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310b2768-6d88-40ef-a60f-8e48dc7367ac None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:43.111509 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdff56d4-6ae9-4b4d-a7d3-a73f9a756c19 tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7c592ae7eab41c89477d91e0eb4b662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6444c58ca5d24ebebb9b9897e70be1f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:43.112192 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdff56d4-6ae9-4b4d-a7d3-a73f9a756c19 tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:43.112482 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdff56d4-6ae9-4b4d-a7d3-a73f9a756c19 tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:43.112758 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdff56d4-6ae9-4b4d-a7d3-a73f9a756c19 tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:43.114152 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdff56d4-6ae9-4b4d-a7d3-a73f9a756c19 tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:43.115997 ncdv-master-1 devstack@keystone.service[91548]: WARNING py.warnings [None req-cdff56d4-6ae9-4b4d-a7d3-a73f9a756c19 tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:33:43.115997 ncdv-master-1 devstack@keystone.service[91548]: warnings.warn(msg) Jul 23 21:33:43.115997 ncdv-master-1 devstack@keystone.service[91548]: Jul 23 21:33:43.117013 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdff56d4-6ae9-4b4d-a7d3-a73f9a756c19 tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:43.137685 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2820/5632] 10.222.0.17 () {60 vars in 1184 bytes} [Sat Jul 23 21:33:43 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 267 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:33:43.142699 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdff56d4-6ae9-4b4d-a7d3-a73f9a756c19 tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:43.154155 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdff56d4-6ae9-4b4d-a7d3-a73f9a756c19 tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:43.160818 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33050b8-e9d9-4582-8f4b-9943c1e51f8d tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7c592ae7eab41c89477d91e0eb4b662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6444c58ca5d24ebebb9b9897e70be1f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:43.161693 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33050b8-e9d9-4582-8f4b-9943c1e51f8d tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:43.161961 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8758bf22-5a52-4e66-8b7a-3fdea72ac8c7 tempest-TestDefaultProjectId-1184223139 tempest-TestDefaultProjectId-1184223139-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:43.162115 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33050b8-e9d9-4582-8f4b-9943c1e51f8d tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:43.162265 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33050b8-e9d9-4582-8f4b-9943c1e51f8d tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/89dc82037acf4de7a25a4a434597a158` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:43.163060 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33050b8-e9d9-4582-8f4b-9943c1e51f8d tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=89dc82037acf4de7a25a4a434597a158)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:43.164135 ncdv-master-1 devstack@keystone.service[91548]: WARNING py.warnings [None req-a33050b8-e9d9-4582-8f4b-9943c1e51f8d tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_consumer": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:33:43.164135 ncdv-master-1 devstack@keystone.service[91548]: warnings.warn(msg) Jul 23 21:33:43.164135 ncdv-master-1 devstack@keystone.service[91548]: Jul 23 21:33:43.165033 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33050b8-e9d9-4582-8f4b-9943c1e51f8d tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:43.168820 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1614576-bc48-4ca7-9bb5-6a19a350390a tempest-TestDefaultProjectId-1184223139 tempest-TestDefaultProjectId-1184223139-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '166e11093cb8485eb68fa894b72eac47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a01981a2762e4f9096ba51cbb3d8b8b9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:43.170024 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1614576-bc48-4ca7-9bb5-6a19a350390a tempest-TestDefaultProjectId-1184223139 tempest-TestDefaultProjectId-1184223139-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:43.170817 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1614576-bc48-4ca7-9bb5-6a19a350390a tempest-TestDefaultProjectId-1184223139 tempest-TestDefaultProjectId-1184223139-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:43.171282 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1614576-bc48-4ca7-9bb5-6a19a350390a tempest-TestDefaultProjectId-1184223139 tempest-TestDefaultProjectId-1184223139-project-admin] PATH_INFO: `/v3/domains/2033070f7ae8401881e52afee818026c` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:43.173213 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1614576-bc48-4ca7-9bb5-6a19a350390a tempest-TestDefaultProjectId-1184223139 tempest-TestDefaultProjectId-1184223139-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=2033070f7ae8401881e52afee818026c)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:43.175278 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1614576-bc48-4ca7-9bb5-6a19a350390a tempest-TestDefaultProjectId-1184223139 tempest-TestDefaultProjectId-1184223139-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:43.178511 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2821/5633] 10.222.0.17 () {58 vars in 1262 bytes} [Sat Jul 23 21:33:43 2022] GET /identity/v3/OS-OAUTH1/consumers/89dc82037acf4de7a25a4a434597a158 => generated 221 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:33:43.180513 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33050b8-e9d9-4582-8f4b-9943c1e51f8d tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:43.193421 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33050b8-e9d9-4582-8f4b-9943c1e51f8d tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:43.200161 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206a1107-1f62-4000-bed6-0b33d31f57a3 tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7c592ae7eab41c89477d91e0eb4b662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6444c58ca5d24ebebb9b9897e70be1f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:43.201572 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206a1107-1f62-4000-bed6-0b33d31f57a3 tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:43.201720 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206a1107-1f62-4000-bed6-0b33d31f57a3 tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:43.202180 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206a1107-1f62-4000-bed6-0b33d31f57a3 tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/89dc82037acf4de7a25a4a434597a158` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:43.202939 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206a1107-1f62-4000-bed6-0b33d31f57a3 tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=89dc82037acf4de7a25a4a434597a158)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:43.203667 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-a1614576-bc48-4ca7-9bb5-6a19a350390a tempest-TestDefaultProjectId-1184223139 tempest-TestDefaultProjectId-1184223139-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '2033070f7ae8401881e52afee818026c'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:43.204164 ncdv-master-1 devstack@keystone.service[91548]: WARNING py.warnings [None req-206a1107-1f62-4000-bed6-0b33d31f57a3 tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:33:43.204164 ncdv-master-1 devstack@keystone.service[91548]: warnings.warn(msg) Jul 23 21:33:43.204164 ncdv-master-1 devstack@keystone.service[91548]: Jul 23 21:33:43.204825 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-a1614576-bc48-4ca7-9bb5-6a19a350390a tempest-TestDefaultProjectId-1184223139 tempest-TestDefaultProjectId-1184223139-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '2033070f7ae8401881e52afee818026c'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:43.205199 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206a1107-1f62-4000-bed6-0b33d31f57a3 tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:43.205471 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-206a1107-1f62-4000-bed6-0b33d31f57a3 tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] Invalidating token cache because consumer 89dc82037acf4de7a25a4a434597a158 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:33:43.205752 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-206a1107-1f62-4000-bed6-0b33d31f57a3 tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:43.206712 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-206a1107-1f62-4000-bed6-0b33d31f57a3 tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:43.231867 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-206a1107-1f62-4000-bed6-0b33d31f57a3 tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '89dc82037acf4de7a25a4a434597a158', 'request_id': 'req-206a1107-1f62-4000-bed6-0b33d31f57a3'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:43.245394 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-a1614576-bc48-4ca7-9bb5-6a19a350390a tempest-TestDefaultProjectId-1184223139 tempest-TestDefaultProjectId-1184223139-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '2033070f7ae8401881e52afee818026c'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:43.247023 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-a1614576-bc48-4ca7-9bb5-6a19a350390a tempest-TestDefaultProjectId-1184223139 tempest-TestDefaultProjectId-1184223139-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '2033070f7ae8401881e52afee818026c'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:43.252674 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2813/5634] 10.222.0.17 () {60 vars in 1248 bytes} [Sat Jul 23 21:33:43 2022] PATCH /identity/v3/domains/2033070f7ae8401881e52afee818026c => generated 247 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:33:43.252890 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2822/5635] 10.222.0.17 () {58 vars in 1265 bytes} [Sat Jul 23 21:33:43 2022] DELETE /identity/v3/OS-OAUTH1/consumers/89dc82037acf4de7a25a4a434597a158 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:33:43.253854 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1614576-bc48-4ca7-9bb5-6a19a350390a tempest-TestDefaultProjectId-1184223139 tempest-TestDefaultProjectId-1184223139-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:43.257545 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206a1107-1f62-4000-bed6-0b33d31f57a3 tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:43.258676 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-a1614576-bc48-4ca7-9bb5-6a19a350390a tempest-TestDefaultProjectId-1184223139 tempest-TestDefaultProjectId-1184223139-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:43.259427 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-206a1107-1f62-4000-bed6-0b33d31f57a3 tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:43.276363 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206a1107-1f62-4000-bed6-0b33d31f57a3 tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:43.363894 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58e420e-a2cf-470a-893a-9761d881aed3 tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7c592ae7eab41c89477d91e0eb4b662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6444c58ca5d24ebebb9b9897e70be1f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:43.364582 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58e420e-a2cf-470a-893a-9761d881aed3 tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:43.365389 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58e420e-a2cf-470a-893a-9761d881aed3 tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:43.365835 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58e420e-a2cf-470a-893a-9761d881aed3 tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:43.367583 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58e420e-a2cf-470a-893a-9761d881aed3 tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:43.370853 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58e420e-a2cf-470a-893a-9761d881aed3 tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:43.399025 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1614576-bc48-4ca7-9bb5-6a19a350390a tempest-TestDefaultProjectId-1184223139 tempest-TestDefaultProjectId-1184223139-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:43.404239 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f964e440-85a5-486e-a5d8-cb57ddc1ce2e tempest-TestDefaultProjectId-1184223139 tempest-TestDefaultProjectId-1184223139-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '166e11093cb8485eb68fa894b72eac47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a01981a2762e4f9096ba51cbb3d8b8b9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:43.404946 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2823/5636] 10.222.0.17 () {60 vars in 1184 bytes} [Sat Jul 23 21:33:43 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 267 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:33:43.406089 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f964e440-85a5-486e-a5d8-cb57ddc1ce2e tempest-TestDefaultProjectId-1184223139 tempest-TestDefaultProjectId-1184223139-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:43.406375 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f964e440-85a5-486e-a5d8-cb57ddc1ce2e tempest-TestDefaultProjectId-1184223139 tempest-TestDefaultProjectId-1184223139-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:43.406646 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f964e440-85a5-486e-a5d8-cb57ddc1ce2e tempest-TestDefaultProjectId-1184223139 tempest-TestDefaultProjectId-1184223139-project-admin] PATH_INFO: `/v3/domains/2033070f7ae8401881e52afee818026c` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:43.409519 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58e420e-a2cf-470a-893a-9761d881aed3 tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:43.411002 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:33:43.413832 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-b58e420e-a2cf-470a-893a-9761d881aed3 tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:43.426223 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f964e440-85a5-486e-a5d8-cb57ddc1ce2e tempest-TestDefaultProjectId-1184223139 tempest-TestDefaultProjectId-1184223139-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=2033070f7ae8401881e52afee818026c)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:43.429667 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f964e440-85a5-486e-a5d8-cb57ddc1ce2e tempest-TestDefaultProjectId-1184223139 tempest-TestDefaultProjectId-1184223139-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:43.443941 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58e420e-a2cf-470a-893a-9761d881aed3 tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:43.458288 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548f2307-c9ae-415b-b8a6-8dba7752de27 tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7c592ae7eab41c89477d91e0eb4b662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6444c58ca5d24ebebb9b9897e70be1f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:43.460327 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548f2307-c9ae-415b-b8a6-8dba7752de27 tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:43.460709 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548f2307-c9ae-415b-b8a6-8dba7752de27 tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:43.461385 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548f2307-c9ae-415b-b8a6-8dba7752de27 tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/199c5128f6c141efb08ce8bcd727aa2e` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:43.466278 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548f2307-c9ae-415b-b8a6-8dba7752de27 tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=199c5128f6c141efb08ce8bcd727aa2e)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:43.470808 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548f2307-c9ae-415b-b8a6-8dba7752de27 tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:43.484463 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2824/5637] 10.222.0.17 () {58 vars in 1262 bytes} [Sat Jul 23 21:33:43 2022] GET /identity/v3/OS-OAUTH1/consumers/199c5128f6c141efb08ce8bcd727aa2e => generated 221 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 21:33:43.487815 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548f2307-c9ae-415b-b8a6-8dba7752de27 tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:43.495341 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-f964e440-85a5-486e-a5d8-cb57ddc1ce2e tempest-TestDefaultProjectId-1184223139 tempest-TestDefaultProjectId-1184223139-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '2033070f7ae8401881e52afee818026c'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:43.503168 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548f2307-c9ae-415b-b8a6-8dba7752de27 tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:43.513438 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-f964e440-85a5-486e-a5d8-cb57ddc1ce2e tempest-TestDefaultProjectId-1184223139 tempest-TestDefaultProjectId-1184223139-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '2033070f7ae8401881e52afee818026c'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:43.517764 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd26bff2-5519-40c8-b016-f6294e95949d tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7c592ae7eab41c89477d91e0eb4b662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6444c58ca5d24ebebb9b9897e70be1f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:43.519478 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd26bff2-5519-40c8-b016-f6294e95949d tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:43.519990 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd26bff2-5519-40c8-b016-f6294e95949d tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:43.521524 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd26bff2-5519-40c8-b016-f6294e95949d tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/199c5128f6c141efb08ce8bcd727aa2e` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:43.522291 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd26bff2-5519-40c8-b016-f6294e95949d tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=199c5128f6c141efb08ce8bcd727aa2e)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:43.525645 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd26bff2-5519-40c8-b016-f6294e95949d tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:43.525645 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-cd26bff2-5519-40c8-b016-f6294e95949d tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] Invalidating token cache because consumer 199c5128f6c141efb08ce8bcd727aa2e has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:33:43.525645 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-cd26bff2-5519-40c8-b016-f6294e95949d tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:43.529530 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-cd26bff2-5519-40c8-b016-f6294e95949d tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:43.554029 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-cd26bff2-5519-40c8-b016-f6294e95949d tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '199c5128f6c141efb08ce8bcd727aa2e', 'request_id': 'req-cd26bff2-5519-40c8-b016-f6294e95949d'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:43.585231 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2825/5638] 10.222.0.17 () {58 vars in 1265 bytes} [Sat Jul 23 21:33:43 2022] DELETE /identity/v3/OS-OAUTH1/consumers/199c5128f6c141efb08ce8bcd727aa2e => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:33:43.586944 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd26bff2-5519-40c8-b016-f6294e95949d tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:43.589415 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-cd26bff2-5519-40c8-b016-f6294e95949d tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:43.603323 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-f964e440-85a5-486e-a5d8-cb57ddc1ce2e tempest-TestDefaultProjectId-1184223139 tempest-TestDefaultProjectId-1184223139-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2033070f7ae8401881e52afee818026c', 'request_id': 'req-f964e440-85a5-486e-a5d8-cb57ddc1ce2e'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:43.619558 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-f964e440-85a5-486e-a5d8-cb57ddc1ce2e tempest-TestDefaultProjectId-1184223139 tempest-TestDefaultProjectId-1184223139-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2033070f7ae8401881e52afee818026c', 'request_id': 'req-f964e440-85a5-486e-a5d8-cb57ddc1ce2e'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:43.624455 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd26bff2-5519-40c8-b016-f6294e95949d tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:43.628580 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-f964e440-85a5-486e-a5d8-cb57ddc1ce2e tempest-TestDefaultProjectId-1184223139 tempest-TestDefaultProjectId-1184223139-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2033070f7ae8401881e52afee818026c', 'request_id': 'req-f964e440-85a5-486e-a5d8-cb57ddc1ce2e'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:43.648837 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-f964e440-85a5-486e-a5d8-cb57ddc1ce2e tempest-TestDefaultProjectId-1184223139 tempest-TestDefaultProjectId-1184223139-project-admin] The token cache is being invalidate because project 2033070f7ae8401881e52afee818026c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:33:43.649255 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-f964e440-85a5-486e-a5d8-cb57ddc1ce2e tempest-TestDefaultProjectId-1184223139 tempest-TestDefaultProjectId-1184223139-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:43.650420 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-f964e440-85a5-486e-a5d8-cb57ddc1ce2e tempest-TestDefaultProjectId-1184223139 tempest-TestDefaultProjectId-1184223139-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:43.652366 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=92,keystone:INSERT=4,keystone:DELETE=4 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:33:43.663350 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-f964e440-85a5-486e-a5d8-cb57ddc1ce2e tempest-TestDefaultProjectId-1184223139 tempest-TestDefaultProjectId-1184223139-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '2033070f7ae8401881e52afee818026c', 'request_id': 'req-f964e440-85a5-486e-a5d8-cb57ddc1ce2e'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:43.664467 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-f964e440-85a5-486e-a5d8-cb57ddc1ce2e tempest-TestDefaultProjectId-1184223139 tempest-TestDefaultProjectId-1184223139-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '2033070f7ae8401881e52afee818026c', 'request_id': 'req-f964e440-85a5-486e-a5d8-cb57ddc1ce2e'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:43.684767 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-f964e440-85a5-486e-a5d8-cb57ddc1ce2e tempest-TestDefaultProjectId-1184223139 tempest-TestDefaultProjectId-1184223139-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '2033070f7ae8401881e52afee818026c', 'request_id': 'req-f964e440-85a5-486e-a5d8-cb57ddc1ce2e'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:43.701643 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2814/5639] 10.222.0.17 () {58 vars in 1229 bytes} [Sat Jul 23 21:33:43 2022] DELETE /identity/v3/domains/2033070f7ae8401881e52afee818026c => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:33:43.707884 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f964e440-85a5-486e-a5d8-cb57ddc1ce2e tempest-TestDefaultProjectId-1184223139 tempest-TestDefaultProjectId-1184223139-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:43.713666 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-f964e440-85a5-486e-a5d8-cb57ddc1ce2e tempest-TestDefaultProjectId-1184223139 tempest-TestDefaultProjectId-1184223139-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:43.752482 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4ae3e7-3cfc-4180-a745-7915832716d6 tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7c592ae7eab41c89477d91e0eb4b662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6444c58ca5d24ebebb9b9897e70be1f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:43.753351 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4ae3e7-3cfc-4180-a745-7915832716d6 tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:43.753633 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4ae3e7-3cfc-4180-a745-7915832716d6 tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:43.753931 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4ae3e7-3cfc-4180-a745-7915832716d6 tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/199c5128f6c141efb08ce8bcd727aa2e` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:43.755478 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4ae3e7-3cfc-4180-a745-7915832716d6 tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=199c5128f6c141efb08ce8bcd727aa2e)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:43.757243 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4ae3e7-3cfc-4180-a745-7915832716d6 tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:43.802299 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-1e4ae3e7-3cfc-4180-a745-7915832716d6 tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] Consumer not found: keystone.exception.NotFound: Consumer not found Jul 23 21:33:43.802299 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 21:33:43.802299 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 21:33:43.802299 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 21:33:43.802299 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 21:33:43.802299 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 21:33:43.802299 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 21:33:43.802299 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 21:33:43.802299 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 21:33:43.802299 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 21:33:43.802299 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 21:33:43.802299 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 21:33:43.802299 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_oauth1.py", line 100, in get Jul 23 21:33:43.802299 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_consumer(consumer_id) Jul 23 21:33:43.802299 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_oauth1.py", line 95, in _get_consumer Jul 23 21:33:43.803367 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.oauth_api.get_consumer(consumer_id)) Jul 23 21:33:43.803367 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 101, in get_consumer Jul 23 21:33:43.803367 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application self.get_consumer_with_secret(consumer_id)) Jul 23 21:33:43.803367 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 96, in get_consumer_with_secret Jul 23 21:33:43.803367 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application consumer_ref = self._get_consumer(session, consumer_id) Jul 23 21:33:43.803367 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 91, in _get_consumer Jul 23 21:33:43.803367 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.NotFound(_('Consumer not found')) Jul 23 21:33:43.803367 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.NotFound: Consumer not found Jul 23 21:33:43.803367 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 21:33:43.809381 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2826/5640] 10.222.0.17 () {58 vars in 1262 bytes} [Sat Jul 23 21:33:43 2022] GET /identity/v3/OS-OAUTH1/consumers/199c5128f6c141efb08ce8bcd727aa2e => generated 74 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 21:33:43.810963 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4ae3e7-3cfc-4180-a745-7915832716d6 tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:43.821856 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-1e4ae3e7-3cfc-4180-a745-7915832716d6 tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:43.842393 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4ae3e7-3cfc-4180-a745-7915832716d6 tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:43.847991 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697a31c3-b1ce-4c05-bf1c-e85705cca9e5 tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7c592ae7eab41c89477d91e0eb4b662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6444c58ca5d24ebebb9b9897e70be1f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:43.848930 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697a31c3-b1ce-4c05-bf1c-e85705cca9e5 tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:43.849214 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697a31c3-b1ce-4c05-bf1c-e85705cca9e5 tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:43.849491 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697a31c3-b1ce-4c05-bf1c-e85705cca9e5 tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/199c5128f6c141efb08ce8bcd727aa2e` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:43.850286 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697a31c3-b1ce-4c05-bf1c-e85705cca9e5 tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=199c5128f6c141efb08ce8bcd727aa2e)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:43.852283 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697a31c3-b1ce-4c05-bf1c-e85705cca9e5 tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:43.852725 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-697a31c3-b1ce-4c05-bf1c-e85705cca9e5 tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] Invalidating token cache because consumer 199c5128f6c141efb08ce8bcd727aa2e has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:33:43.852847 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-697a31c3-b1ce-4c05-bf1c-e85705cca9e5 tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:43.853513 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-697a31c3-b1ce-4c05-bf1c-e85705cca9e5 tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:43.879462 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-697a31c3-b1ce-4c05-bf1c-e85705cca9e5 tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] Consumer not found: keystone.exception.NotFound: Consumer not found Jul 23 21:33:43.879462 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 21:33:43.879462 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 21:33:43.879462 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 21:33:43.879462 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 21:33:43.879462 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 21:33:43.879462 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 21:33:43.879462 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 21:33:43.879462 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 21:33:43.879462 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 21:33:43.879462 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 21:33:43.879462 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 21:33:43.879462 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_oauth1.py", line 123, in delete Jul 23 21:33:43.879462 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application PROVIDERS.oauth_api.delete_consumer( Jul 23 21:33:43.879462 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 21:33:43.880444 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 21:33:43.880444 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/core.py", line 139, in delete_consumer Jul 23 21:33:43.880444 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application ret = self.driver.delete_consumer(consumer_id) Jul 23 21:33:43.880444 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 133, in delete_consumer Jul 23 21:33:43.880444 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application self._delete_consumer(session, consumer_id) Jul 23 21:33:43.880444 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 110, in _delete_consumer Jul 23 21:33:43.880444 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application consumer_ref = self._get_consumer(session, consumer_id) Jul 23 21:33:43.880444 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 91, in _get_consumer Jul 23 21:33:43.880444 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.NotFound(_('Consumer not found')) Jul 23 21:33:43.880444 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.NotFound: Consumer not found Jul 23 21:33:43.880444 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 21:33:43.887538 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2827/5641] 10.222.0.17 () {58 vars in 1265 bytes} [Sat Jul 23 21:33:43 2022] DELETE /identity/v3/OS-OAUTH1/consumers/199c5128f6c141efb08ce8bcd727aa2e => generated 74 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 21:33:43.888791 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697a31c3-b1ce-4c05-bf1c-e85705cca9e5 tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:43.888944 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f964e440-85a5-486e-a5d8-cb57ddc1ce2e tempest-TestDefaultProjectId-1184223139 tempest-TestDefaultProjectId-1184223139-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:43.890526 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-697a31c3-b1ce-4c05-bf1c-e85705cca9e5 tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:43.900036 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e4181a-8905-48cb-8346-ab34880cdaaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:43.902613 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e4181a-8905-48cb-8346-ab34880cdaaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:43.903238 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e4181a-8905-48cb-8346-ab34880cdaaa admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:43.903730 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e4181a-8905-48cb-8346-ab34880cdaaa admin admin] PATH_INFO: `/v3/users/5b3350df45b34075ae375e2d11ff914a` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:43.905235 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e4181a-8905-48cb-8346-ab34880cdaaa admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b3350df45b34075ae375e2d11ff914a)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:43.907695 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e4181a-8905-48cb-8346-ab34880cdaaa admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:43.909208 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697a31c3-b1ce-4c05-bf1c-e85705cca9e5 tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:43.916030 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3c9da2-32ea-4ee6-9fe4-76ab1a12caa4 tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7c592ae7eab41c89477d91e0eb4b662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6444c58ca5d24ebebb9b9897e70be1f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:43.916689 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3c9da2-32ea-4ee6-9fe4-76ab1a12caa4 tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:43.916974 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3c9da2-32ea-4ee6-9fe4-76ab1a12caa4 tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:43.917383 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3c9da2-32ea-4ee6-9fe4-76ab1a12caa4 tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:43.919015 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3c9da2-32ea-4ee6-9fe4-76ab1a12caa4 tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:43.920623 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3c9da2-32ea-4ee6-9fe4-76ab1a12caa4 tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:43.939441 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2828/5642] 10.222.0.17 () {60 vars in 1184 bytes} [Sat Jul 23 21:33:43 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 266 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:33:43.944115 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3c9da2-32ea-4ee6-9fe4-76ab1a12caa4 tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:43.959750 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3c9da2-32ea-4ee6-9fe4-76ab1a12caa4 tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:43.975193 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbfa7a2-97a1-476d-98e8-6d58f2604d35 tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7c592ae7eab41c89477d91e0eb4b662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6444c58ca5d24ebebb9b9897e70be1f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:43.976771 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbfa7a2-97a1-476d-98e8-6d58f2604d35 tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:43.977172 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbfa7a2-97a1-476d-98e8-6d58f2604d35 tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:43.977452 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbfa7a2-97a1-476d-98e8-6d58f2604d35 tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:43.978451 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbfa7a2-97a1-476d-98e8-6d58f2604d35 tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:43.980930 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbfa7a2-97a1-476d-98e8-6d58f2604d35 tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:43.982931 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:33:43.994589 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-f6e4181a-8905-48cb-8346-ab34880cdaaa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b3350df45b34075ae375e2d11ff914a'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:44.006747 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2829/5643] 10.222.0.17 () {60 vars in 1184 bytes} [Sat Jul 23 21:33:43 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 267 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:33:44.011415 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbfa7a2-97a1-476d-98e8-6d58f2604d35 tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:44.015305 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-f6e4181a-8905-48cb-8346-ab34880cdaaa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b3350df45b34075ae375e2d11ff914a'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:44.018291 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-f6e4181a-8905-48cb-8346-ab34880cdaaa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b3350df45b34075ae375e2d11ff914a'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:44.030722 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbfa7a2-97a1-476d-98e8-6d58f2604d35 tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:44.034218 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-f6e4181a-8905-48cb-8346-ab34880cdaaa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b3350df45b34075ae375e2d11ff914a'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:44.035858 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e10253-1353-45b2-9a2f-815c7bd683d2 tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7c592ae7eab41c89477d91e0eb4b662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6444c58ca5d24ebebb9b9897e70be1f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:44.036509 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e10253-1353-45b2-9a2f-815c7bd683d2 tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:44.037062 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e10253-1353-45b2-9a2f-815c7bd683d2 tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:44.037062 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e10253-1353-45b2-9a2f-815c7bd683d2 tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:44.037746 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e10253-1353-45b2-9a2f-815c7bd683d2 tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] RBAC: Authorizing `identity:list_consumers()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:44.038881 ncdv-master-1 devstack@keystone.service[91548]: WARNING py.warnings [None req-82e10253-1353-45b2-9a2f-815c7bd683d2 tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_consumers": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:33:44.038881 ncdv-master-1 devstack@keystone.service[91548]: warnings.warn(msg) Jul 23 21:33:44.038881 ncdv-master-1 devstack@keystone.service[91548]: Jul 23 21:33:44.039784 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e10253-1353-45b2-9a2f-815c7bd683d2 tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:44.049782 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2830/5644] 10.222.0.17 () {58 vars in 1163 bytes} [Sat Jul 23 21:33:44 2022] GET /identity/v3/OS-OAUTH1/consumers => generated 536 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:33:44.050866 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e10253-1353-45b2-9a2f-815c7bd683d2 tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:44.065835 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e10253-1353-45b2-9a2f-815c7bd683d2 tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:44.078218 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63967f8-3b18-46a4-bccf-c04099501a0e tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7c592ae7eab41c89477d91e0eb4b662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6444c58ca5d24ebebb9b9897e70be1f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:44.078218 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63967f8-3b18-46a4-bccf-c04099501a0e tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:44.078218 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63967f8-3b18-46a4-bccf-c04099501a0e tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:44.078468 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-f6e4181a-8905-48cb-8346-ab34880cdaaa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b3350df45b34075ae375e2d11ff914a'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:44.078563 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63967f8-3b18-46a4-bccf-c04099501a0e tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/096cb4078b414eaba357e83302a4a169` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:44.078563 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63967f8-3b18-46a4-bccf-c04099501a0e tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=096cb4078b414eaba357e83302a4a169)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:44.078718 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63967f8-3b18-46a4-bccf-c04099501a0e tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:44.079005 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c63967f8-3b18-46a4-bccf-c04099501a0e tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] Invalidating token cache because consumer 096cb4078b414eaba357e83302a4a169 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:33:44.079209 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c63967f8-3b18-46a4-bccf-c04099501a0e tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:44.079898 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c63967f8-3b18-46a4-bccf-c04099501a0e tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:44.085071 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2815/5645] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:33:43 2022] DELETE /identity/v3/users/5b3350df45b34075ae375e2d11ff914a => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:33:44.087408 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b5597b-26a5-431e-b286-1c96408ece63 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:44.087724 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b5597b-26a5-431e-b286-1c96408ece63 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:44.087972 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b5597b-26a5-431e-b286-1c96408ece63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:44.094615 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c63967f8-3b18-46a4-bccf-c04099501a0e tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '096cb4078b414eaba357e83302a4a169', 'request_id': 'req-c63967f8-3b18-46a4-bccf-c04099501a0e'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:44.115419 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-14b5597b-26a5-431e-b286-1c96408ece63 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:33:44.117998 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2831/5646] 10.222.0.17 () {58 vars in 1265 bytes} [Sat Jul 23 21:33:44 2022] DELETE /identity/v3/OS-OAUTH1/consumers/096cb4078b414eaba357e83302a4a169 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:33:44.118174 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-14b5597b-26a5-431e-b286-1c96408ece63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:44.122533 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63967f8-3b18-46a4-bccf-c04099501a0e tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:44.126377 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-c63967f8-3b18-46a4-bccf-c04099501a0e tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:44.153123 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63967f8-3b18-46a4-bccf-c04099501a0e tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:44.229465 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2816/5647] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:33:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:33:44.237227 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b16aabc-2de8-44c9-8dc5-b54f5daa4640 tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7c592ae7eab41c89477d91e0eb4b662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6444c58ca5d24ebebb9b9897e70be1f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:44.238527 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b16aabc-2de8-44c9-8dc5-b54f5daa4640 tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:44.239007 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b16aabc-2de8-44c9-8dc5-b54f5daa4640 tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:44.239435 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b16aabc-2de8-44c9-8dc5-b54f5daa4640 tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/2b3af7841156492f826da5570a135049` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:44.240446 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b16aabc-2de8-44c9-8dc5-b54f5daa4640 tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=2b3af7841156492f826da5570a135049)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:44.242695 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b16aabc-2de8-44c9-8dc5-b54f5daa4640 tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:44.243615 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-7b16aabc-2de8-44c9-8dc5-b54f5daa4640 tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] Invalidating token cache because consumer 2b3af7841156492f826da5570a135049 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:33:44.244318 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-7b16aabc-2de8-44c9-8dc5-b54f5daa4640 tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:44.245447 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-7b16aabc-2de8-44c9-8dc5-b54f5daa4640 tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:44.256406 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b5597b-26a5-431e-b286-1c96408ece63 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:44.257547 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-14b5597b-26a5-431e-b286-1c96408ece63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:44.280792 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-7b16aabc-2de8-44c9-8dc5-b54f5daa4640 tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '2b3af7841156492f826da5570a135049', 'request_id': 'req-7b16aabc-2de8-44c9-8dc5-b54f5daa4640'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:44.307232 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2832/5648] 10.222.0.17 () {58 vars in 1265 bytes} [Sat Jul 23 21:33:44 2022] DELETE /identity/v3/OS-OAUTH1/consumers/2b3af7841156492f826da5570a135049 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:33:44.312854 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b16aabc-2de8-44c9-8dc5-b54f5daa4640 tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:44.314749 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-7b16aabc-2de8-44c9-8dc5-b54f5daa4640 tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:44.330824 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b16aabc-2de8-44c9-8dc5-b54f5daa4640 tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:44.337788 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6c8e1f-65cd-482e-b093-ef04cf1cc98f tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7c592ae7eab41c89477d91e0eb4b662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6444c58ca5d24ebebb9b9897e70be1f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:44.338692 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6c8e1f-65cd-482e-b093-ef04cf1cc98f tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:44.339060 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6c8e1f-65cd-482e-b093-ef04cf1cc98f tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:44.339476 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6c8e1f-65cd-482e-b093-ef04cf1cc98f tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:44.340372 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6c8e1f-65cd-482e-b093-ef04cf1cc98f tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:44.342639 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6c8e1f-65cd-482e-b093-ef04cf1cc98f tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:44.362683 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2833/5649] 10.222.0.17 () {60 vars in 1184 bytes} [Sat Jul 23 21:33:44 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 266 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:33:44.368643 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6c8e1f-65cd-482e-b093-ef04cf1cc98f tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:44.380720 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6c8e1f-65cd-482e-b093-ef04cf1cc98f tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:44.389533 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229f4617-4c32-417f-b6d6-699f5d14e68e tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7c592ae7eab41c89477d91e0eb4b662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6444c58ca5d24ebebb9b9897e70be1f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:44.390499 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229f4617-4c32-417f-b6d6-699f5d14e68e tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:44.390789 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229f4617-4c32-417f-b6d6-699f5d14e68e tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:44.391173 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229f4617-4c32-417f-b6d6-699f5d14e68e tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/ca659d3cef9a40e7b985e6f07cbccbb4` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:44.391918 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229f4617-4c32-417f-b6d6-699f5d14e68e tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] RBAC: Authorizing `identity:update_consumer(consumer_id=ca659d3cef9a40e7b985e6f07cbccbb4)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:44.392978 ncdv-master-1 devstack@keystone.service[91548]: WARNING py.warnings [None req-229f4617-4c32-417f-b6d6-699f5d14e68e tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:33:44.392978 ncdv-master-1 devstack@keystone.service[91548]: warnings.warn(msg) Jul 23 21:33:44.392978 ncdv-master-1 devstack@keystone.service[91548]: Jul 23 21:33:44.393893 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229f4617-4c32-417f-b6d6-699f5d14e68e tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:44.396275 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:33:44.423147 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2834/5650] 10.222.0.17 () {60 vars in 1284 bytes} [Sat Jul 23 21:33:44 2022] PATCH /identity/v3/OS-OAUTH1/consumers/ca659d3cef9a40e7b985e6f07cbccbb4 => generated 221 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:33:44.424215 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229f4617-4c32-417f-b6d6-699f5d14e68e tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:44.432435 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b5597b-26a5-431e-b286-1c96408ece63 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:44.437040 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e576dee-84fd-4f26-bbad-3d6fedccec8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:44.437359 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229f4617-4c32-417f-b6d6-699f5d14e68e tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:44.438472 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e576dee-84fd-4f26-bbad-3d6fedccec8c service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:44.438759 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e576dee-84fd-4f26-bbad-3d6fedccec8c service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:44.439046 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e576dee-84fd-4f26-bbad-3d6fedccec8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:44.441165 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-9e576dee-84fd-4f26-bbad-3d6fedccec8c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:44.442645 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0719d10-3909-4fae-87e0-4415b9c6ddf7 tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7c592ae7eab41c89477d91e0eb4b662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6444c58ca5d24ebebb9b9897e70be1f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:44.443939 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0719d10-3909-4fae-87e0-4415b9c6ddf7 tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:44.444452 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0719d10-3909-4fae-87e0-4415b9c6ddf7 tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:44.444685 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0719d10-3909-4fae-87e0-4415b9c6ddf7 tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/ca659d3cef9a40e7b985e6f07cbccbb4` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:44.445591 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0719d10-3909-4fae-87e0-4415b9c6ddf7 tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=ca659d3cef9a40e7b985e6f07cbccbb4)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:44.447430 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0719d10-3909-4fae-87e0-4415b9c6ddf7 tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:44.456882 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2835/5651] 10.222.0.17 () {58 vars in 1262 bytes} [Sat Jul 23 21:33:44 2022] GET /identity/v3/OS-OAUTH1/consumers/ca659d3cef9a40e7b985e6f07cbccbb4 => generated 221 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:33:44.457532 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e576dee-84fd-4f26-bbad-3d6fedccec8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:44.458189 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0719d10-3909-4fae-87e0-4415b9c6ddf7 tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:44.459210 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e576dee-84fd-4f26-bbad-3d6fedccec8c service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:44.460373 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-a0719d10-3909-4fae-87e0-4415b9c6ddf7 tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:44.471563 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2817/5652] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:33:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 23 21:33:44.472436 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e576dee-84fd-4f26-bbad-3d6fedccec8c service neutron] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:44.477200 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0719d10-3909-4fae-87e0-4415b9c6ddf7 tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:44.488789 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba21bcd-16a2-4922-9662-9991b1a6876c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:44.489718 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba21bcd-16a2-4922-9662-9991b1a6876c service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:44.490679 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba21bcd-16a2-4922-9662-9991b1a6876c service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:44.491007 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e576dee-84fd-4f26-bbad-3d6fedccec8c service neutron] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:44.491173 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba21bcd-16a2-4922-9662-9991b1a6876c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:44.498259 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-bba21bcd-16a2-4922-9662-9991b1a6876c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:44.503840 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bc20b7-a190-4b79-af2b-e21d2d2d75fc tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7c592ae7eab41c89477d91e0eb4b662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6444c58ca5d24ebebb9b9897e70be1f0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:44.506159 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bc20b7-a190-4b79-af2b-e21d2d2d75fc tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:44.507360 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bc20b7-a190-4b79-af2b-e21d2d2d75fc tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:44.509895 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bc20b7-a190-4b79-af2b-e21d2d2d75fc tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/ca659d3cef9a40e7b985e6f07cbccbb4` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:44.510753 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bc20b7-a190-4b79-af2b-e21d2d2d75fc tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=ca659d3cef9a40e7b985e6f07cbccbb4)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:44.511827 ncdv-master-1 devstack@keystone.service[91547]: WARNING py.warnings [None req-f8bc20b7-a190-4b79-af2b-e21d2d2d75fc tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:33:44.511827 ncdv-master-1 devstack@keystone.service[91547]: warnings.warn(msg) Jul 23 21:33:44.511827 ncdv-master-1 devstack@keystone.service[91547]: Jul 23 21:33:44.512753 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bc20b7-a190-4b79-af2b-e21d2d2d75fc tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:44.513002 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-f8bc20b7-a190-4b79-af2b-e21d2d2d75fc tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] Invalidating token cache because consumer ca659d3cef9a40e7b985e6f07cbccbb4 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:33:44.513286 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-f8bc20b7-a190-4b79-af2b-e21d2d2d75fc tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:44.515050 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-f8bc20b7-a190-4b79-af2b-e21d2d2d75fc tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:44.524761 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba21bcd-16a2-4922-9662-9991b1a6876c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:44.530858 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba21bcd-16a2-4922-9662-9991b1a6876c service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:44.557418 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2836/5653] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:33:44 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:33:44.565262 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-f8bc20b7-a190-4b79-af2b-e21d2d2d75fc tempest-OAUTHConsumersV3Test-905243687 tempest-OAUTHConsumersV3Test-905243687-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': 'ca659d3cef9a40e7b985e6f07cbccbb4', 'request_id': 'req-f8bc20b7-a190-4b79-af2b-e21d2d2d75fc'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:44.587431 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2818/5654] 10.222.0.17 () {58 vars in 1265 bytes} [Sat Jul 23 21:33:44 2022] DELETE /identity/v3/OS-OAUTH1/consumers/ca659d3cef9a40e7b985e6f07cbccbb4 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:33:44.593979 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba21bcd-16a2-4922-9662-9991b1a6876c service neutron] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:44.597129 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-bba21bcd-16a2-4922-9662-9991b1a6876c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:44.623772 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba21bcd-16a2-4922-9662-9991b1a6876c service neutron] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:44.630956 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccc3006-8a1e-4b0c-a8de-c35e0f6fe385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:44.631923 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccc3006-8a1e-4b0c-a8de-c35e0f6fe385 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:44.633491 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccc3006-8a1e-4b0c-a8de-c35e0f6fe385 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:44.633797 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccc3006-8a1e-4b0c-a8de-c35e0f6fe385 admin admin] PATH_INFO: `/v3/users/24581feb84654bc7a874cc1a2cb59da3` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:44.635230 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccc3006-8a1e-4b0c-a8de-c35e0f6fe385 admin admin] RBAC: Authorizing `identity:delete_user(user_id=24581feb84654bc7a874cc1a2cb59da3)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:44.638757 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccc3006-8a1e-4b0c-a8de-c35e0f6fe385 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:44.705714 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-0ccc3006-8a1e-4b0c-a8de-c35e0f6fe385 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24581feb84654bc7a874cc1a2cb59da3'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:44.706416 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-0ccc3006-8a1e-4b0c-a8de-c35e0f6fe385 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24581feb84654bc7a874cc1a2cb59da3'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:44.717756 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-0ccc3006-8a1e-4b0c-a8de-c35e0f6fe385 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24581feb84654bc7a874cc1a2cb59da3'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:44.729375 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-0ccc3006-8a1e-4b0c-a8de-c35e0f6fe385 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24581feb84654bc7a874cc1a2cb59da3'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:44.746612 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-0ccc3006-8a1e-4b0c-a8de-c35e0f6fe385 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24581feb84654bc7a874cc1a2cb59da3'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:44.760527 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998b988d-2d99-4db1-b9f9-50f403c9f301 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:44.760812 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998b988d-2d99-4db1-b9f9-50f403c9f301 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:44.761091 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998b988d-2d99-4db1-b9f9-50f403c9f301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:44.761996 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2837/5655] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:33:44 2022] DELETE /identity/v3/users/24581feb84654bc7a874cc1a2cb59da3 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:33:44.784297 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-998b988d-2d99-4db1-b9f9-50f403c9f301 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:33:44.785573 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-998b988d-2d99-4db1-b9f9-50f403c9f301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:44.845670 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:33:44.898854 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2819/5656] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:33:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:33:44.911173 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccc3006-8a1e-4b0c-a8de-c35e0f6fe385 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:44.913475 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-0ccc3006-8a1e-4b0c-a8de-c35e0f6fe385 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:45.042612 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccc3006-8a1e-4b0c-a8de-c35e0f6fe385 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:45.047026 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af06323e-137e-4189-ba66-4fc95d6d605b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:45.053303 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af06323e-137e-4189-ba66-4fc95d6d605b service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:45.053303 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af06323e-137e-4189-ba66-4fc95d6d605b service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:45.053303 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af06323e-137e-4189-ba66-4fc95d6d605b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:45.062627 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af06323e-137e-4189-ba66-4fc95d6d605b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:45.064350 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af06323e-137e-4189-ba66-4fc95d6d605b service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:45.077320 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2838/5657] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:33:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:33:45.555350 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998b988d-2d99-4db1-b9f9-50f403c9f301 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:45.560447 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-998b988d-2d99-4db1-b9f9-50f403c9f301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:45.590971 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998b988d-2d99-4db1-b9f9-50f403c9f301 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:45.602718 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2849b94-6e94-4b4b-8585-163fb2dcdf13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:45.603866 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2849b94-6e94-4b4b-8585-163fb2dcdf13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:45.604343 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2849b94-6e94-4b4b-8585-163fb2dcdf13 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:45.604806 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2849b94-6e94-4b4b-8585-163fb2dcdf13 admin admin] PATH_INFO: `/v3/projects/4ab51920cb5441df8d5750d1ce130a49` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:45.606364 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2849b94-6e94-4b4b-8585-163fb2dcdf13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ab51920cb5441df8d5750d1ce130a49)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:45.609403 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2849b94-6e94-4b4b-8585-163fb2dcdf13 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:45.740587 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-b2849b94-6e94-4b4b-8585-163fb2dcdf13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ab51920cb5441df8d5750d1ce130a49', 'request_id': 'req-b2849b94-6e94-4b4b-8585-163fb2dcdf13'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:45.753958 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-b2849b94-6e94-4b4b-8585-163fb2dcdf13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ab51920cb5441df8d5750d1ce130a49', 'request_id': 'req-b2849b94-6e94-4b4b-8585-163fb2dcdf13'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:45.763109 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-b2849b94-6e94-4b4b-8585-163fb2dcdf13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ab51920cb5441df8d5750d1ce130a49', 'request_id': 'req-b2849b94-6e94-4b4b-8585-163fb2dcdf13'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:45.784098 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-b2849b94-6e94-4b4b-8585-163fb2dcdf13 admin admin] The token cache is being invalidate because project 4ab51920cb5441df8d5750d1ce130a49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:33:45.784431 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-b2849b94-6e94-4b4b-8585-163fb2dcdf13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:45.785243 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-b2849b94-6e94-4b4b-8585-163fb2dcdf13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:45.787802 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2820/5658] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:33:45 2022] DELETE /identity/v3/projects/4ab51920cb5441df8d5750d1ce130a49 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:33:45.792445 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af06323e-137e-4189-ba66-4fc95d6d605b service neutron] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:45.805896 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af06323e-137e-4189-ba66-4fc95d6d605b service neutron] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:45.868542 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=88,keystone:UPDATE=1,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:33:45.875235 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2849b94-6e94-4b4b-8585-163fb2dcdf13 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:45.878650 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-b2849b94-6e94-4b4b-8585-163fb2dcdf13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:45.895772 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5b466b-170a-4e75-8c68-40675ea8c92a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:45.897039 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5b466b-170a-4e75-8c68-40675ea8c92a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:45.897538 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5b466b-170a-4e75-8c68-40675ea8c92a admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:45.899214 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5b466b-170a-4e75-8c68-40675ea8c92a admin admin] PATH_INFO: `/v3/users/166e11093cb8485eb68fa894b72eac47` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:45.901079 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5b466b-170a-4e75-8c68-40675ea8c92a admin admin] RBAC: Authorizing `identity:delete_user(user_id=166e11093cb8485eb68fa894b72eac47)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:45.903240 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5b466b-170a-4e75-8c68-40675ea8c92a admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:45.975455 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2849b94-6e94-4b4b-8585-163fb2dcdf13 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:45.981319 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2f54bd-8f54-44d1-864d-3b8dab1b7480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:45.982830 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2f54bd-8f54-44d1-864d-3b8dab1b7480 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:45.983329 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2f54bd-8f54-44d1-864d-3b8dab1b7480 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:45.983790 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2f54bd-8f54-44d1-864d-3b8dab1b7480 admin admin] PATH_INFO: `/v3/projects/7b9c8d66179945899c085f25b1d09faa` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:45.985392 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2f54bd-8f54-44d1-864d-3b8dab1b7480 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b9c8d66179945899c085f25b1d09faa)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:45.987409 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-bd5b466b-170a-4e75-8c68-40675ea8c92a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '166e11093cb8485eb68fa894b72eac47'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:45.988095 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2f54bd-8f54-44d1-864d-3b8dab1b7480 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:45.988671 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-bd5b466b-170a-4e75-8c68-40675ea8c92a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '166e11093cb8485eb68fa894b72eac47'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:45.999965 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-bd5b466b-170a-4e75-8c68-40675ea8c92a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '166e11093cb8485eb68fa894b72eac47'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:46.011571 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-bd5b466b-170a-4e75-8c68-40675ea8c92a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '166e11093cb8485eb68fa894b72eac47'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:46.027305 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-bd5b466b-170a-4e75-8c68-40675ea8c92a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '166e11093cb8485eb68fa894b72eac47'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:46.036098 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2839/5659] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:33:45 2022] DELETE /identity/v3/users/166e11093cb8485eb68fa894b72eac47 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:33:46.060643 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-0e2f54bd-8f54-44d1-864d-3b8dab1b7480 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b9c8d66179945899c085f25b1d09faa', 'request_id': 'req-0e2f54bd-8f54-44d1-864d-3b8dab1b7480'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:46.082395 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-0e2f54bd-8f54-44d1-864d-3b8dab1b7480 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b9c8d66179945899c085f25b1d09faa', 'request_id': 'req-0e2f54bd-8f54-44d1-864d-3b8dab1b7480'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:46.088797 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:33:46.090356 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-0e2f54bd-8f54-44d1-864d-3b8dab1b7480 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b9c8d66179945899c085f25b1d09faa', 'request_id': 'req-0e2f54bd-8f54-44d1-864d-3b8dab1b7480'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:46.112416 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-0e2f54bd-8f54-44d1-864d-3b8dab1b7480 admin admin] The token cache is being invalidate because project 7b9c8d66179945899c085f25b1d09faa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:33:46.112416 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-0e2f54bd-8f54-44d1-864d-3b8dab1b7480 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:46.114382 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-0e2f54bd-8f54-44d1-864d-3b8dab1b7480 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:46.117020 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2821/5660] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:33:45 2022] DELETE /identity/v3/projects/7b9c8d66179945899c085f25b1d09faa => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:33:46.121096 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5b466b-170a-4e75-8c68-40675ea8c92a admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:46.122587 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-bd5b466b-170a-4e75-8c68-40675ea8c92a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:46.208705 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5b466b-170a-4e75-8c68-40675ea8c92a admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:46.280235 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbfeb0f-2ec2-4a0f-99e9-b1e330e3346c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:46.281154 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbfeb0f-2ec2-4a0f-99e9-b1e330e3346c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:46.281440 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbfeb0f-2ec2-4a0f-99e9-b1e330e3346c admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:46.282296 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbfeb0f-2ec2-4a0f-99e9-b1e330e3346c admin admin] PATH_INFO: `/v3/users/d7c592ae7eab41c89477d91e0eb4b662` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:46.282975 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbfeb0f-2ec2-4a0f-99e9-b1e330e3346c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7c592ae7eab41c89477d91e0eb4b662)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:46.284997 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbfeb0f-2ec2-4a0f-99e9-b1e330e3346c admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:46.303314 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:33:46.351491 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-3cbfeb0f-2ec2-4a0f-99e9-b1e330e3346c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7c592ae7eab41c89477d91e0eb4b662'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:46.352169 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-3cbfeb0f-2ec2-4a0f-99e9-b1e330e3346c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7c592ae7eab41c89477d91e0eb4b662'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:46.359385 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-3cbfeb0f-2ec2-4a0f-99e9-b1e330e3346c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7c592ae7eab41c89477d91e0eb4b662'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:46.368124 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-3cbfeb0f-2ec2-4a0f-99e9-b1e330e3346c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7c592ae7eab41c89477d91e0eb4b662'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:46.382341 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-3cbfeb0f-2ec2-4a0f-99e9-b1e330e3346c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7c592ae7eab41c89477d91e0eb4b662'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:46.388491 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2840/5661] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:33:46 2022] DELETE /identity/v3/users/d7c592ae7eab41c89477d91e0eb4b662 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:33:46.431660 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2f54bd-8f54-44d1-864d-3b8dab1b7480 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:46.433506 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-0e2f54bd-8f54-44d1-864d-3b8dab1b7480 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:46.451904 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2f54bd-8f54-44d1-864d-3b8dab1b7480 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:46.517202 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8f7085-4d2e-489b-b50f-a033826152f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:46.518130 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8f7085-4d2e-489b-b50f-a033826152f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:46.518411 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8f7085-4d2e-489b-b50f-a033826152f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:46.518685 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8f7085-4d2e-489b-b50f-a033826152f6 admin admin] PATH_INFO: `/v3/projects/a01981a2762e4f9096ba51cbb3d8b8b9` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:46.519873 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8f7085-4d2e-489b-b50f-a033826152f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a01981a2762e4f9096ba51cbb3d8b8b9)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:46.521855 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8f7085-4d2e-489b-b50f-a033826152f6 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:46.578160 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-fc8f7085-4d2e-489b-b50f-a033826152f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a01981a2762e4f9096ba51cbb3d8b8b9', 'request_id': 'req-fc8f7085-4d2e-489b-b50f-a033826152f6'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:46.586539 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-fc8f7085-4d2e-489b-b50f-a033826152f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a01981a2762e4f9096ba51cbb3d8b8b9', 'request_id': 'req-fc8f7085-4d2e-489b-b50f-a033826152f6'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:46.592436 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-fc8f7085-4d2e-489b-b50f-a033826152f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a01981a2762e4f9096ba51cbb3d8b8b9', 'request_id': 'req-fc8f7085-4d2e-489b-b50f-a033826152f6'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:46.604641 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-fc8f7085-4d2e-489b-b50f-a033826152f6 admin admin] The token cache is being invalidate because project a01981a2762e4f9096ba51cbb3d8b8b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:33:46.604996 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-fc8f7085-4d2e-489b-b50f-a033826152f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:46.605606 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-fc8f7085-4d2e-489b-b50f-a033826152f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:46.607328 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2822/5662] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:33:46 2022] DELETE /identity/v3/projects/a01981a2762e4f9096ba51cbb3d8b8b9 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:33:46.613697 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b7062e-6019-4f2e-9862-9b0f09a2c764 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:46.613931 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b7062e-6019-4f2e-9862-9b0f09a2c764 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:46.614211 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b7062e-6019-4f2e-9862-9b0f09a2c764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:46.632907 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-67b7062e-6019-4f2e-9862-9b0f09a2c764 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:33:46.634434 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-67b7062e-6019-4f2e-9862-9b0f09a2c764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:46.687734 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8f7085-4d2e-489b-b50f-a033826152f6 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:46.689308 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-fc8f7085-4d2e-489b-b50f-a033826152f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:46.714850 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2841/5663] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:33:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:33:46.723689 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3245aa03-4873-4f7d-95bf-1d6d81312e0d None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:46.724060 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3245aa03-4873-4f7d-95bf-1d6d81312e0d None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:46.724380 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3245aa03-4873-4f7d-95bf-1d6d81312e0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:46.747353 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-3245aa03-4873-4f7d-95bf-1d6d81312e0d None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:33:46.748711 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-3245aa03-4873-4f7d-95bf-1d6d81312e0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:46.757381 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2842/5664] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:33:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:33:46.761179 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3245aa03-4873-4f7d-95bf-1d6d81312e0d None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:46.771417 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3245aa03-4873-4f7d-95bf-1d6d81312e0d None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:46.776618 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8586289-ef47-4f47-9283-65b76f29beed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:46.777408 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8586289-ef47-4f47-9283-65b76f29beed admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:46.777740 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8586289-ef47-4f47-9283-65b76f29beed admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:46.778204 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8586289-ef47-4f47-9283-65b76f29beed admin admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:46.778969 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8586289-ef47-4f47-9283-65b76f29beed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:33:46.779270 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8586289-ef47-4f47-9283-65b76f29beed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:46.780834 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8586289-ef47-4f47-9283-65b76f29beed admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:46.803858 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8f7085-4d2e-489b-b50f-a033826152f6 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:46.805819 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2843/5665] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:33:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:33:46.806853 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8586289-ef47-4f47-9283-65b76f29beed admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:46.822968 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8586289-ef47-4f47-9283-65b76f29beed admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:46.826612 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0fcf13-af71-45fc-b444-784f3f219fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:46.828120 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0fcf13-af71-45fc-b444-784f3f219fa9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:46.828403 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0fcf13-af71-45fc-b444-784f3f219fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:46.828677 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0fcf13-af71-45fc-b444-784f3f219fa9 admin admin] PATH_INFO: `/v3/projects/6444c58ca5d24ebebb9b9897e70be1f0` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:46.830432 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0fcf13-af71-45fc-b444-784f3f219fa9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6444c58ca5d24ebebb9b9897e70be1f0)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:46.832378 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0fcf13-af71-45fc-b444-784f3f219fa9 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:46.836294 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae12c4f3-7e06-4327-bdd9-3cd6b172be8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:46.837083 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae12c4f3-7e06-4327-bdd9-3cd6b172be8f admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:46.837642 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae12c4f3-7e06-4327-bdd9-3cd6b172be8f admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:46.837999 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae12c4f3-7e06-4327-bdd9-3cd6b172be8f admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:46.838829 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae12c4f3-7e06-4327-bdd9-3cd6b172be8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:46.841018 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae12c4f3-7e06-4327-bdd9-3cd6b172be8f admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:46.860026 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:33:46.888231 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2844/5666] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:33:46 2022] POST /identity/v3/projects => generated 369 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:33:46.892209 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-cf0fcf13-af71-45fc-b444-784f3f219fa9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6444c58ca5d24ebebb9b9897e70be1f0', 'request_id': 'req-cf0fcf13-af71-45fc-b444-784f3f219fa9'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:46.892561 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae12c4f3-7e06-4327-bdd9-3cd6b172be8f admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:46.902341 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-cf0fcf13-af71-45fc-b444-784f3f219fa9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6444c58ca5d24ebebb9b9897e70be1f0', 'request_id': 'req-cf0fcf13-af71-45fc-b444-784f3f219fa9'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:46.911182 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-cf0fcf13-af71-45fc-b444-784f3f219fa9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6444c58ca5d24ebebb9b9897e70be1f0', 'request_id': 'req-cf0fcf13-af71-45fc-b444-784f3f219fa9'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:46.924712 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-cf0fcf13-af71-45fc-b444-784f3f219fa9 admin admin] The token cache is being invalidate because project 6444c58ca5d24ebebb9b9897e70be1f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:33:46.925001 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-cf0fcf13-af71-45fc-b444-784f3f219fa9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:46.925927 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-cf0fcf13-af71-45fc-b444-784f3f219fa9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:46.927771 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2823/5667] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:33:46 2022] DELETE /identity/v3/projects/6444c58ca5d24ebebb9b9897e70be1f0 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:33:46.933690 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b7a872-f0d1-4fd6-ad73-713dfd8751bb None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:46.934077 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b7a872-f0d1-4fd6-ad73-713dfd8751bb None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:46.934355 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b7a872-f0d1-4fd6-ad73-713dfd8751bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:46.948680 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:33:46.954149 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-f8b7a872-f0d1-4fd6-ad73-713dfd8751bb None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:33:46.955409 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-f8b7a872-f0d1-4fd6-ad73-713dfd8751bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:46.963972 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2824/5668] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:33:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:33:46.971467 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae12c4f3-7e06-4327-bdd9-3cd6b172be8f admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:46.972319 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca98fbbb-2b3c-4b89-b1bd-7621656101fb None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:46.972608 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca98fbbb-2b3c-4b89-b1bd-7621656101fb None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:46.972891 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca98fbbb-2b3c-4b89-b1bd-7621656101fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:46.977455 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60920575-2b5b-4fe8-acce-502e5373032b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:46.978181 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60920575-2b5b-4fe8-acce-502e5373032b admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:46.978462 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60920575-2b5b-4fe8-acce-502e5373032b admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:46.978742 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60920575-2b5b-4fe8-acce-502e5373032b admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:46.979426 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60920575-2b5b-4fe8-acce-502e5373032b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:46.982377 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60920575-2b5b-4fe8-acce-502e5373032b admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:46.993007 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-ca98fbbb-2b3c-4b89-b1bd-7621656101fb None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:33:46.994271 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-ca98fbbb-2b3c-4b89-b1bd-7621656101fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:47.005715 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2825/5669] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:33:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:33:47.009519 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2845/5670] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:33:46 2022] POST /identity/v3/users => generated 285 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:33:47.009670 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca98fbbb-2b3c-4b89-b1bd-7621656101fb None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:47.010779 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60920575-2b5b-4fe8-acce-502e5373032b admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:47.012412 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-60920575-2b5b-4fe8-acce-502e5373032b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:47.019516 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca98fbbb-2b3c-4b89-b1bd-7621656101fb None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:47.026050 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ce34a9-c4fd-4f7a-933a-5da5d25816df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:47.026989 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60920575-2b5b-4fe8-acce-502e5373032b admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:47.027139 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ce34a9-c4fd-4f7a-933a-5da5d25816df admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:47.027602 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ce34a9-c4fd-4f7a-933a-5da5d25816df admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:47.028291 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ce34a9-c4fd-4f7a-933a-5da5d25816df admin admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:47.029221 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ce34a9-c4fd-4f7a-933a-5da5d25816df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:33:47.029708 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ce34a9-c4fd-4f7a-933a-5da5d25816df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:47.031634 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ce34a9-c4fd-4f7a-933a-5da5d25816df admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:47.032352 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af20667f-c052-40af-b159-9683fc40bbb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:47.033013 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af20667f-c052-40af-b159-9683fc40bbb7 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:47.033314 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af20667f-c052-40af-b159-9683fc40bbb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:47.033578 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af20667f-c052-40af-b159-9683fc40bbb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:47.034329 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af20667f-c052-40af-b159-9683fc40bbb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:47.036176 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af20667f-c052-40af-b159-9683fc40bbb7 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:47.046890 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2826/5671] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:33:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 21:33:47.051382 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ce34a9-c4fd-4f7a-933a-5da5d25816df admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:47.052107 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2846/5672] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:33:47 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:33:47.056290 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af20667f-c052-40af-b159-9683fc40bbb7 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:47.061914 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ce34a9-c4fd-4f7a-933a-5da5d25816df admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:47.067423 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8792267-21f2-4bb4-8647-5bbce343afb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:47.068078 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8792267-21f2-4bb4-8647-5bbce343afb2 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:47.068320 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af20667f-c052-40af-b159-9683fc40bbb7 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:47.068454 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8792267-21f2-4bb4-8647-5bbce343afb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:47.068608 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8792267-21f2-4bb4-8647-5bbce343afb2 admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:47.069335 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8792267-21f2-4bb4-8647-5bbce343afb2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:47.071295 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8792267-21f2-4bb4-8647-5bbce343afb2 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:47.074466 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf6a022-7ed2-424a-94de-0d100fcc14f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:47.075133 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf6a022-7ed2-424a-94de-0d100fcc14f6 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:47.075420 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf6a022-7ed2-424a-94de-0d100fcc14f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:47.075978 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf6a022-7ed2-424a-94de-0d100fcc14f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:47.076406 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf6a022-7ed2-424a-94de-0d100fcc14f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:47.079486 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf6a022-7ed2-424a-94de-0d100fcc14f6 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:47.093056 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2847/5673] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:33:47 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 21:33:47.097579 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf6a022-7ed2-424a-94de-0d100fcc14f6 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:47.103035 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2827/5674] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:33:47 2022] POST /identity/v3/projects => generated 367 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:33:47.107053 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8792267-21f2-4bb4-8647-5bbce343afb2 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:47.112243 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf6a022-7ed2-424a-94de-0d100fcc14f6 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:47.176192 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2356dd0-be14-4ef9-926f-0711b7467604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:47.177207 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2356dd0-be14-4ef9-926f-0711b7467604 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:47.177567 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2356dd0-be14-4ef9-926f-0711b7467604 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:47.177925 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2356dd0-be14-4ef9-926f-0711b7467604 admin admin] PATH_INFO: `/v3/projects/b3cb66482f614bfab820c21bc9d877fa/users/b184aabdc36e423b9292f946f1dc36ff/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:47.182027 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8792267-21f2-4bb4-8647-5bbce343afb2 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:47.187502 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312eddeb-d260-430d-8b85-56ea992b9dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:47.188402 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312eddeb-d260-430d-8b85-56ea992b9dde admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:47.188876 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312eddeb-d260-430d-8b85-56ea992b9dde admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:47.189376 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312eddeb-d260-430d-8b85-56ea992b9dde admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:47.190406 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312eddeb-d260-430d-8b85-56ea992b9dde admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:47.192563 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312eddeb-d260-430d-8b85-56ea992b9dde admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:47.192754 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2356dd0-be14-4ef9-926f-0711b7467604 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3cb66482f614bfab820c21bc9d877fa, user_id=b184aabdc36e423b9292f946f1dc36ff, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:47.195478 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2356dd0-be14-4ef9-926f-0711b7467604 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:47.212108 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2848/5675] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:33:47 2022] PUT /identity/v3/projects/b3cb66482f614bfab820c21bc9d877fa/users/b184aabdc36e423b9292f946f1dc36ff/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:33:47.215138 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2828/5676] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:33:47 2022] POST /identity/v3/users => generated 284 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:33:47.222023 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312eddeb-d260-430d-8b85-56ea992b9dde admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:47.222551 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d101256f-ec3d-4280-af60-bbfb73f447fe None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:47.222859 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d101256f-ec3d-4280-af60-bbfb73f447fe None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:47.223105 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d101256f-ec3d-4280-af60-bbfb73f447fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:47.235666 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312eddeb-d260-430d-8b85-56ea992b9dde admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:47.252080 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-d101256f-ec3d-4280-af60-bbfb73f447fe None None] MFA Rules not processed for user `b184aabdc36e423b9292f946f1dc36ff`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:33:47.253290 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-d101256f-ec3d-4280-af60-bbfb73f447fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:47.289123 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:DELETE=7,keystone:SELECT=88,keystone:INSERT=5 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:33:47.301385 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702c4959-6deb-481b-a9d5-29f746a14dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:47.302170 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702c4959-6deb-481b-a9d5-29f746a14dc9 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:47.302461 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702c4959-6deb-481b-a9d5-29f746a14dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:47.302944 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702c4959-6deb-481b-a9d5-29f746a14dc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:47.303825 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702c4959-6deb-481b-a9d5-29f746a14dc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:47.305912 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702c4959-6deb-481b-a9d5-29f746a14dc9 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:47.316327 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2829/5677] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:33:47 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:33:47.320377 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702c4959-6deb-481b-a9d5-29f746a14dc9 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:47.328704 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2849/5678] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:33:47 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:33:47.331153 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702c4959-6deb-481b-a9d5-29f746a14dc9 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:47.334583 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d101256f-ec3d-4280-af60-bbfb73f447fe None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:47.344742 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d101256f-ec3d-4280-af60-bbfb73f447fe None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:47.346731 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402f3518-839e-4199-a7e9-f4d044a0f261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:47.347479 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402f3518-839e-4199-a7e9-f4d044a0f261 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:47.347922 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402f3518-839e-4199-a7e9-f4d044a0f261 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:47.348297 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402f3518-839e-4199-a7e9-f4d044a0f261 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:47.349160 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402f3518-839e-4199-a7e9-f4d044a0f261 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:47.349344 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c823b4e7-adbd-4d36-9fc7-4d6092365add tempest-TestApiDiscovery-1566494789 tempest-TestApiDiscovery-1566494789-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b184aabdc36e423b9292f946f1dc36ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3cb66482f614bfab820c21bc9d877fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:47.350063 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c823b4e7-adbd-4d36-9fc7-4d6092365add tempest-TestApiDiscovery-1566494789 tempest-TestApiDiscovery-1566494789-project] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:47.350303 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c823b4e7-adbd-4d36-9fc7-4d6092365add tempest-TestApiDiscovery-1566494789 tempest-TestApiDiscovery-1566494789-project] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:47.350652 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c823b4e7-adbd-4d36-9fc7-4d6092365add tempest-TestApiDiscovery-1566494789 tempest-TestApiDiscovery-1566494789-project] PATH_INFO: `/v3` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:47.352799 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2850/5679] 10.222.0.17 () {58 vars in 1103 bytes} [Sat Jul 23 21:33:47 2022] GET /identity/v3 => generated 255 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:33:47.354962 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402f3518-839e-4199-a7e9-f4d044a0f261 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:47.357476 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c823b4e7-adbd-4d36-9fc7-4d6092365add tempest-TestApiDiscovery-1566494789 tempest-TestApiDiscovery-1566494789-project] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:47.370823 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c823b4e7-adbd-4d36-9fc7-4d6092365add tempest-TestApiDiscovery-1566494789 tempest-TestApiDiscovery-1566494789-project] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:47.375652 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09285dd6-8bf5-4abf-8ca4-ca68141fe906 tempest-TestApiDiscovery-1566494789 tempest-TestApiDiscovery-1566494789-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b184aabdc36e423b9292f946f1dc36ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3cb66482f614bfab820c21bc9d877fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:47.376419 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09285dd6-8bf5-4abf-8ca4-ca68141fe906 tempest-TestApiDiscovery-1566494789 tempest-TestApiDiscovery-1566494789-project] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:47.376711 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09285dd6-8bf5-4abf-8ca4-ca68141fe906 tempest-TestApiDiscovery-1566494789 tempest-TestApiDiscovery-1566494789-project] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:47.376987 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09285dd6-8bf5-4abf-8ca4-ca68141fe906 tempest-TestApiDiscovery-1566494789 tempest-TestApiDiscovery-1566494789-project] PATH_INFO: `/v3` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:47.378455 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2851/5680] 10.222.0.17 () {58 vars in 1103 bytes} [Sat Jul 23 21:33:47 2022] GET /identity/v3 => generated 255 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:33:47.383248 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2830/5681] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:33:47 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:33:47.383401 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09285dd6-8bf5-4abf-8ca4-ca68141fe906 tempest-TestApiDiscovery-1566494789 tempest-TestApiDiscovery-1566494789-project] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:47.384710 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402f3518-839e-4199-a7e9-f4d044a0f261 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:47.395649 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09285dd6-8bf5-4abf-8ca4-ca68141fe906 tempest-TestApiDiscovery-1566494789 tempest-TestApiDiscovery-1566494789-project] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:47.398591 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402f3518-839e-4199-a7e9-f4d044a0f261 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:47.400542 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef3a551-b971-414a-8787-eb6b69356c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:47.401439 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef3a551-b971-414a-8787-eb6b69356c1c admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:47.401719 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef3a551-b971-414a-8787-eb6b69356c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:47.402040 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef3a551-b971-414a-8787-eb6b69356c1c admin admin] PATH_INFO: `/v3/projects/daa33686e214485c9cdfc98deb50c686/users/c33fb870862041d7bf4068c3947cc0fb/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:47.406833 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bec07e8-78a9-4d4c-8a9a-00933ce8bce4 tempest-TestApiDiscovery-1566494789 tempest-TestApiDiscovery-1566494789-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b184aabdc36e423b9292f946f1dc36ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3cb66482f614bfab820c21bc9d877fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:47.408311 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bec07e8-78a9-4d4c-8a9a-00933ce8bce4 tempest-TestApiDiscovery-1566494789 tempest-TestApiDiscovery-1566494789-project] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:47.409079 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bec07e8-78a9-4d4c-8a9a-00933ce8bce4 tempest-TestApiDiscovery-1566494789 tempest-TestApiDiscovery-1566494789-project] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:47.410596 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bec07e8-78a9-4d4c-8a9a-00933ce8bce4 tempest-TestApiDiscovery-1566494789 tempest-TestApiDiscovery-1566494789-project] PATH_INFO: `/v3` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:47.414415 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2831/5682] 10.222.0.17 () {58 vars in 1103 bytes} [Sat Jul 23 21:33:47 2022] GET /identity/v3 => generated 255 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:33:47.420117 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323f101d-96e9-47da-bcef-36425fb515aa None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:47.421182 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323f101d-96e9-47da-bcef-36425fb515aa None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:47.421748 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323f101d-96e9-47da-bcef-36425fb515aa None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:47.421894 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef3a551-b971-414a-8787-eb6b69356c1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=daa33686e214485c9cdfc98deb50c686, user_id=c33fb870862041d7bf4068c3947cc0fb, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:47.424092 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2832/5683] 10.222.0.17 () {56 vars in 894 bytes} [Sat Jul 23 21:33:47 2022] GET /identity/ => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:33:47.424754 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef3a551-b971-414a-8787-eb6b69356c1c admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:47.428780 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e82a22-0d58-416f-ad57-8711418e6cc0 None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:47.429065 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e82a22-0d58-416f-ad57-8711418e6cc0 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:47.429338 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e82a22-0d58-416f-ad57-8711418e6cc0 None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:47.430788 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2833/5684] 10.222.0.17 () {56 vars in 894 bytes} [Sat Jul 23 21:33:47 2022] GET /identity/ => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 23 21:33:47.431281 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:33:47.435099 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e82a22-0d58-416f-ad57-8711418e6cc0 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:47.449353 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e82a22-0d58-416f-ad57-8711418e6cc0 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:47.453910 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2852/5685] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:33:47 2022] PUT /identity/v3/projects/daa33686e214485c9cdfc98deb50c686/users/c33fb870862041d7bf4068c3947cc0fb/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:33:47.466230 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b804861-2f0f-4ca1-96ed-c4733c158d94 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:47.466518 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b804861-2f0f-4ca1-96ed-c4733c158d94 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:47.466800 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b804861-2f0f-4ca1-96ed-c4733c158d94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:47.500799 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-3b804861-2f0f-4ca1-96ed-c4733c158d94 None None] MFA Rules not processed for user `c33fb870862041d7bf4068c3947cc0fb`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:33:47.502049 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-3b804861-2f0f-4ca1-96ed-c4733c158d94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:47.518067 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a932a3b2-cd6d-44a0-966d-0c8f296c4e6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:47.519064 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a932a3b2-cd6d-44a0-966d-0c8f296c4e6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:47.519458 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a932a3b2-cd6d-44a0-966d-0c8f296c4e6e admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:47.520819 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a932a3b2-cd6d-44a0-966d-0c8f296c4e6e admin admin] PATH_INFO: `/v3/users/b184aabdc36e423b9292f946f1dc36ff` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:47.521265 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a932a3b2-cd6d-44a0-966d-0c8f296c4e6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b184aabdc36e423b9292f946f1dc36ff)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:47.523532 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a932a3b2-cd6d-44a0-966d-0c8f296c4e6e admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:47.581327 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-a932a3b2-cd6d-44a0-966d-0c8f296c4e6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b184aabdc36e423b9292f946f1dc36ff'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:47.587378 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2853/5686] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:33:47 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:33:47.588846 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-a932a3b2-cd6d-44a0-966d-0c8f296c4e6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b184aabdc36e423b9292f946f1dc36ff'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:47.591330 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-a932a3b2-cd6d-44a0-966d-0c8f296c4e6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b184aabdc36e423b9292f946f1dc36ff'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:47.592588 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b804861-2f0f-4ca1-96ed-c4733c158d94 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:47.602648 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-a932a3b2-cd6d-44a0-966d-0c8f296c4e6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b184aabdc36e423b9292f946f1dc36ff'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:47.606823 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b804861-2f0f-4ca1-96ed-c4733c158d94 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:47.612155 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fa4638-5388-4e8c-812f-aabb3984264a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:47.613077 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fa4638-5388-4e8c-812f-aabb3984264a admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:47.613321 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fa4638-5388-4e8c-812f-aabb3984264a admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:47.613744 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fa4638-5388-4e8c-812f-aabb3984264a admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:47.614392 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fa4638-5388-4e8c-812f-aabb3984264a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:47.616435 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fa4638-5388-4e8c-812f-aabb3984264a admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:47.618036 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-a932a3b2-cd6d-44a0-966d-0c8f296c4e6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b184aabdc36e423b9292f946f1dc36ff'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:47.625285 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2834/5687] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:33:47 2022] DELETE /identity/v3/users/b184aabdc36e423b9292f946f1dc36ff => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:33:47.630183 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98677c2b-0e59-4720-b465-b90b0e561345 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:47.630521 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98677c2b-0e59-4720-b465-b90b0e561345 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:47.631236 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98677c2b-0e59-4720-b465-b90b0e561345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:47.647789 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2854/5688] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:33:47 2022] POST /identity/v3/projects => generated 367 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:33:47.651707 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fa4638-5388-4e8c-812f-aabb3984264a admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:47.653611 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-98677c2b-0e59-4720-b465-b90b0e561345 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:33:47.653756 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-26fa4638-5388-4e8c-812f-aabb3984264a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:47.654861 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-98677c2b-0e59-4720-b465-b90b0e561345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:47.704372 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:33:47.726465 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2835/5689] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:33:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:33:47.732921 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98677c2b-0e59-4720-b465-b90b0e561345 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:47.734426 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-98677c2b-0e59-4720-b465-b90b0e561345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:47.737558 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fa4638-5388-4e8c-812f-aabb3984264a admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:47.745304 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9e87aa-56c6-4258-8697-09aa780d414c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:47.746031 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9e87aa-56c6-4258-8697-09aa780d414c admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:47.746318 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9e87aa-56c6-4258-8697-09aa780d414c admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:47.746699 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9e87aa-56c6-4258-8697-09aa780d414c admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:47.747395 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9e87aa-56c6-4258-8697-09aa780d414c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:47.749303 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9e87aa-56c6-4258-8697-09aa780d414c admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:47.776341 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2855/5690] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:33:47 2022] POST /identity/v3/users => generated 290 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:33:47.780223 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9e87aa-56c6-4258-8697-09aa780d414c admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:47.790864 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9e87aa-56c6-4258-8697-09aa780d414c admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:47.795634 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fcdd14-68ac-41bc-9381-bb92a1aa733f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:47.796400 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fcdd14-68ac-41bc-9381-bb92a1aa733f admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:47.796679 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fcdd14-68ac-41bc-9381-bb92a1aa733f admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:47.797055 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fcdd14-68ac-41bc-9381-bb92a1aa733f admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:47.797833 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fcdd14-68ac-41bc-9381-bb92a1aa733f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:47.799486 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fcdd14-68ac-41bc-9381-bb92a1aa733f admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:47.803072 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98677c2b-0e59-4720-b465-b90b0e561345 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:47.807442 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a7c831-4d1b-44f2-815b-dc5d8870975c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:47.808729 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a7c831-4d1b-44f2-815b-dc5d8870975c service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:47.814030 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a7c831-4d1b-44f2-815b-dc5d8870975c service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:47.814030 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a7c831-4d1b-44f2-815b-dc5d8870975c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:47.814271 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2856/5691] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:33:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 21:33:47.815520 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fcdd14-68ac-41bc-9381-bb92a1aa733f admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:47.825896 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fcdd14-68ac-41bc-9381-bb92a1aa733f admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:47.827341 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a7c831-4d1b-44f2-815b-dc5d8870975c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:47.828910 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a7c831-4d1b-44f2-815b-dc5d8870975c service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:47.831301 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ab4ef3-0933-494c-aeae-1c111aaee15f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:47.832255 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ab4ef3-0933-494c-aeae-1c111aaee15f admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:47.832470 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ab4ef3-0933-494c-aeae-1c111aaee15f admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:47.832736 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ab4ef3-0933-494c-aeae-1c111aaee15f admin admin] PATH_INFO: `/v3/projects/5496ab260afb4aa4b58054dad376a5d3/users/6329fc7fa93c45b7be7350e34ad6bd1c/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:47.839812 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2836/5692] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:33:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 23 21:33:47.849327 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ab4ef3-0933-494c-aeae-1c111aaee15f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5496ab260afb4aa4b58054dad376a5d3, user_id=6329fc7fa93c45b7be7350e34ad6bd1c, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:47.852625 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ab4ef3-0933-494c-aeae-1c111aaee15f admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:47.870924 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2857/5693] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:33:47 2022] PUT /identity/v3/projects/5496ab260afb4aa4b58054dad376a5d3/users/6329fc7fa93c45b7be7350e34ad6bd1c/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:33:47.875178 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a7c831-4d1b-44f2-815b-dc5d8870975c service neutron] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:47.886698 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a7c831-4d1b-44f2-815b-dc5d8870975c service neutron] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:47.949045 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e9ef4e-d2fd-4f34-803a-a0521be638f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:47.950018 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e9ef4e-d2fd-4f34-803a-a0521be638f0 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:47.950304 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e9ef4e-d2fd-4f34-803a-a0521be638f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:47.950579 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e9ef4e-d2fd-4f34-803a-a0521be638f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:47.951315 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e9ef4e-d2fd-4f34-803a-a0521be638f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:47.953186 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e9ef4e-d2fd-4f34-803a-a0521be638f0 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:47.964681 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2837/5694] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:33:47 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 21:33:47.969019 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ab4ef3-0933-494c-aeae-1c111aaee15f admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:47.982574 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ab4ef3-0933-494c-aeae-1c111aaee15f admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:47.988076 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ca8c80-7e0b-4dd2-b919-888734e1f086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:47.988979 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ca8c80-7e0b-4dd2-b919-888734e1f086 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:47.989251 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ca8c80-7e0b-4dd2-b919-888734e1f086 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:47.989518 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ca8c80-7e0b-4dd2-b919-888734e1f086 admin admin] PATH_INFO: `/v3/projects/5496ab260afb4aa4b58054dad376a5d3/users/6329fc7fa93c45b7be7350e34ad6bd1c/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:47.991613 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ca8c80-7e0b-4dd2-b919-888734e1f086 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5496ab260afb4aa4b58054dad376a5d3, user_id=6329fc7fa93c45b7be7350e34ad6bd1c, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:47.994468 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ca8c80-7e0b-4dd2-b919-888734e1f086 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:48.025636 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2858/5695] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:33:47 2022] PUT /identity/v3/projects/5496ab260afb4aa4b58054dad376a5d3/users/6329fc7fa93c45b7be7350e34ad6bd1c/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:33:48.033480 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a4d43c-79a6-44fc-801d-0f0e7beeab36 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:48.033772 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a4d43c-79a6-44fc-801d-0f0e7beeab36 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:48.034082 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a4d43c-79a6-44fc-801d-0f0e7beeab36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:48.063357 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-79a4d43c-79a6-44fc-801d-0f0e7beeab36 None None] MFA Rules not processed for user `6329fc7fa93c45b7be7350e34ad6bd1c`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:33:48.064600 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-79a4d43c-79a6-44fc-801d-0f0e7beeab36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:48.165251 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ca8c80-7e0b-4dd2-b919-888734e1f086 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:48.167675 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-12ca8c80-7e0b-4dd2-b919-888734e1f086 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:48.176529 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:33:48.226983 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2838/5696] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:33:48 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:33:48.232111 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a4d43c-79a6-44fc-801d-0f0e7beeab36 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:48.242916 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a4d43c-79a6-44fc-801d-0f0e7beeab36 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:48.247931 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16d9a65-a4bc-4f76-9300-438cc58d1f97 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6329fc7fa93c45b7be7350e34ad6bd1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5496ab260afb4aa4b58054dad376a5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:48.248926 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16d9a65-a4bc-4f76-9300-438cc58d1f97 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:48.249518 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16d9a65-a4bc-4f76-9300-438cc58d1f97 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:48.249744 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16d9a65-a4bc-4f76-9300-438cc58d1f97 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:48.250468 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16d9a65-a4bc-4f76-9300-438cc58d1f97 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:48.253260 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16d9a65-a4bc-4f76-9300-438cc58d1f97 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:48.267218 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ca8c80-7e0b-4dd2-b919-888734e1f086 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:48.271323 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:33:48.275136 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf809da7-cafa-4e9e-af25-5c1101acf285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:48.276340 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf809da7-cafa-4e9e-af25-5c1101acf285 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:48.276863 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf809da7-cafa-4e9e-af25-5c1101acf285 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:48.277149 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf809da7-cafa-4e9e-af25-5c1101acf285 admin admin] PATH_INFO: `/v3/projects/b3cb66482f614bfab820c21bc9d877fa` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:48.278554 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf809da7-cafa-4e9e-af25-5c1101acf285 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3cb66482f614bfab820c21bc9d877fa)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:48.286711 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf809da7-cafa-4e9e-af25-5c1101acf285 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:48.296576 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2839/5697] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:33:48 2022] POST /identity/v3/projects => generated 359 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:33:48.299771 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16d9a65-a4bc-4f76-9300-438cc58d1f97 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:48.360712 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-bf809da7-cafa-4e9e-af25-5c1101acf285 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3cb66482f614bfab820c21bc9d877fa', 'request_id': 'req-bf809da7-cafa-4e9e-af25-5c1101acf285'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:48.369770 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-bf809da7-cafa-4e9e-af25-5c1101acf285 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3cb66482f614bfab820c21bc9d877fa', 'request_id': 'req-bf809da7-cafa-4e9e-af25-5c1101acf285'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:48.377271 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-bf809da7-cafa-4e9e-af25-5c1101acf285 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3cb66482f614bfab820c21bc9d877fa', 'request_id': 'req-bf809da7-cafa-4e9e-af25-5c1101acf285'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:48.391915 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16d9a65-a4bc-4f76-9300-438cc58d1f97 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:48.393060 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-bf809da7-cafa-4e9e-af25-5c1101acf285 admin admin] The token cache is being invalidate because project b3cb66482f614bfab820c21bc9d877fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:33:48.393351 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-bf809da7-cafa-4e9e-af25-5c1101acf285 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:48.394143 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-bf809da7-cafa-4e9e-af25-5c1101acf285 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:48.396363 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2859/5698] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:33:48 2022] DELETE /identity/v3/projects/b3cb66482f614bfab820c21bc9d877fa => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:33:48.402550 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fba7d7-482b-4189-b194-99989d47dc7a None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:48.402847 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fba7d7-482b-4189-b194-99989d47dc7a None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:48.403109 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fba7d7-482b-4189-b194-99989d47dc7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:48.424770 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-e2fba7d7-482b-4189-b194-99989d47dc7a None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:33:48.426146 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-e2fba7d7-482b-4189-b194-99989d47dc7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:48.475243 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7c25c6-0e60-4fb3-9771-91a0e47e564d tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6329fc7fa93c45b7be7350e34ad6bd1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5496ab260afb4aa4b58054dad376a5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:48.476745 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7c25c6-0e60-4fb3-9771-91a0e47e564d tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:48.477032 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7c25c6-0e60-4fb3-9771-91a0e47e564d tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:48.477305 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7c25c6-0e60-4fb3-9771-91a0e47e564d tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:48.478270 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7c25c6-0e60-4fb3-9771-91a0e47e564d tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:48.481578 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7c25c6-0e60-4fb3-9771-91a0e47e564d tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:48.499599 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2860/5699] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:33:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:33:48.508221 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0854fb5-8332-4d58-b99c-fa78733eec22 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:48.508850 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0854fb5-8332-4d58-b99c-fa78733eec22 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:48.509380 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0854fb5-8332-4d58-b99c-fa78733eec22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:48.537461 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2840/5700] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:33:48 2022] POST /identity/v3/users => generated 416 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:33:48.541625 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7c25c6-0e60-4fb3-9771-91a0e47e564d tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:48.543995 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-2a7c25c6-0e60-4fb3-9771-91a0e47e564d tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:48.544864 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-f0854fb5-8332-4d58-b99c-fa78733eec22 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:33:48.549904 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-f0854fb5-8332-4d58-b99c-fa78733eec22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:48.557317 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7c25c6-0e60-4fb3-9771-91a0e47e564d tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:48.559934 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2861/5701] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:33:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:33:48.566355 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0854fb5-8332-4d58-b99c-fa78733eec22 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:48.580611 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0854fb5-8332-4d58-b99c-fa78733eec22 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:48.583665 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f6f45e-4993-4db0-a2fa-e89d0ffa81b0 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6329fc7fa93c45b7be7350e34ad6bd1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5496ab260afb4aa4b58054dad376a5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:48.584856 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f6f45e-4993-4db0-a2fa-e89d0ffa81b0 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:48.585708 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f6f45e-4993-4db0-a2fa-e89d0ffa81b0 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:48.586174 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f6f45e-4993-4db0-a2fa-e89d0ffa81b0 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] PATH_INFO: `/v3/users/4946acc5c1474b52b93fa27ca9851b13` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:48.595199 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1a7e5f-0678-4943-a575-7bb9340422bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:48.596038 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1a7e5f-0678-4943-a575-7bb9340422bb admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:48.596419 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1a7e5f-0678-4943-a575-7bb9340422bb admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:48.598105 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1a7e5f-0678-4943-a575-7bb9340422bb admin admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:48.598930 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1a7e5f-0678-4943-a575-7bb9340422bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:33:48.601725 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1a7e5f-0678-4943-a575-7bb9340422bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:48.603580 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1a7e5f-0678-4943-a575-7bb9340422bb admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:48.619009 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f6f45e-4993-4db0-a2fa-e89d0ffa81b0 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] RBAC: Authorizing `identity:get_user(user_id=4946acc5c1474b52b93fa27ca9851b13)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:48.621270 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f6f45e-4993-4db0-a2fa-e89d0ffa81b0 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:48.626839 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2841/5702] 10.222.0.17 () {58 vars in 1220 bytes} [Sat Jul 23 21:33:48 2022] GET /identity/v3/users/4946acc5c1474b52b93fa27ca9851b13 => generated 416 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 21:33:48.627734 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f6f45e-4993-4db0-a2fa-e89d0ffa81b0 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:48.628376 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2862/5703] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:33:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 21:33:48.638191 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f6f45e-4993-4db0-a2fa-e89d0ffa81b0 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:48.640728 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1a7e5f-0678-4943-a575-7bb9340422bb admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:48.643404 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac71ece-a1c1-4273-8c62-c017341f8189 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6329fc7fa93c45b7be7350e34ad6bd1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5496ab260afb4aa4b58054dad376a5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:48.644293 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac71ece-a1c1-4273-8c62-c017341f8189 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:48.644572 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac71ece-a1c1-4273-8c62-c017341f8189 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:48.644844 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac71ece-a1c1-4273-8c62-c017341f8189 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] PATH_INFO: `/v3/users/4946acc5c1474b52b93fa27ca9851b13` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:48.646085 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac71ece-a1c1-4273-8c62-c017341f8189 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] RBAC: Authorizing `identity:delete_user(user_id=4946acc5c1474b52b93fa27ca9851b13)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:48.648367 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac71ece-a1c1-4273-8c62-c017341f8189 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:48.655400 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1a7e5f-0678-4943-a575-7bb9340422bb admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:48.661151 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4ea7c6-764d-4af7-a3b0-3046c642ffd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:48.661979 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4ea7c6-764d-4af7-a3b0-3046c642ffd7 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:48.662353 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4ea7c6-764d-4af7-a3b0-3046c642ffd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:48.662715 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4ea7c6-764d-4af7-a3b0-3046c642ffd7 admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:48.663564 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4ea7c6-764d-4af7-a3b0-3046c642ffd7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:48.665727 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4ea7c6-764d-4af7-a3b0-3046c642ffd7 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:48.682265 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:33:48.702363 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-1ac71ece-a1c1-4273-8c62-c017341f8189 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4946acc5c1474b52b93fa27ca9851b13'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:48.702584 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2863/5704] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:33:48 2022] POST /identity/v3/projects => generated 393 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:33:48.706721 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4ea7c6-764d-4af7-a3b0-3046c642ffd7 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:48.712653 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-1ac71ece-a1c1-4273-8c62-c017341f8189 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4946acc5c1474b52b93fa27ca9851b13'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:48.713640 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-1ac71ece-a1c1-4273-8c62-c017341f8189 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4946acc5c1474b52b93fa27ca9851b13'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:48.733211 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-1ac71ece-a1c1-4273-8c62-c017341f8189 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4946acc5c1474b52b93fa27ca9851b13'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:48.745135 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:INSERT=5,keystone:SELECT=86,keystone:DELETE=9 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:33:48.763321 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-1ac71ece-a1c1-4273-8c62-c017341f8189 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4946acc5c1474b52b93fa27ca9851b13'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:48.776414 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2842/5705] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:33:48 2022] DELETE /identity/v3/users/4946acc5c1474b52b93fa27ca9851b13 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:33:48.781772 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac71ece-a1c1-4273-8c62-c017341f8189 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:48.789524 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-1ac71ece-a1c1-4273-8c62-c017341f8189 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:48.801160 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4ea7c6-764d-4af7-a3b0-3046c642ffd7 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:48.868220 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a08c07-2803-4ac8-ba41-b29db2161360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:48.869657 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a08c07-2803-4ac8-ba41-b29db2161360 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:48.869976 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a08c07-2803-4ac8-ba41-b29db2161360 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:48.870255 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a08c07-2803-4ac8-ba41-b29db2161360 admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:48.870947 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac71ece-a1c1-4273-8c62-c017341f8189 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:48.871062 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a08c07-2803-4ac8-ba41-b29db2161360 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:48.873268 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a08c07-2803-4ac8-ba41-b29db2161360 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:48.876112 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642f0131-bf4f-4035-af47-cfa9b47456ea tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6329fc7fa93c45b7be7350e34ad6bd1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5496ab260afb4aa4b58054dad376a5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:48.877242 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642f0131-bf4f-4035-af47-cfa9b47456ea tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:48.877597 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642f0131-bf4f-4035-af47-cfa9b47456ea tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:48.877966 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642f0131-bf4f-4035-af47-cfa9b47456ea tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] PATH_INFO: `/v3/projects/130116aed4b7441abc908c6dff8c923d` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:48.879242 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642f0131-bf4f-4035-af47-cfa9b47456ea tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] RBAC: Authorizing `identity:delete_project(project_id=130116aed4b7441abc908c6dff8c923d)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:48.881724 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642f0131-bf4f-4035-af47-cfa9b47456ea tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:48.898913 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2864/5706] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:33:48 2022] POST /identity/v3/users => generated 297 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:33:48.906943 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a08c07-2803-4ac8-ba41-b29db2161360 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:48.908926 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-20a08c07-2803-4ac8-ba41-b29db2161360 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:48.927068 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a08c07-2803-4ac8-ba41-b29db2161360 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:48.935680 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-642f0131-bf4f-4035-af47-cfa9b47456ea tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '130116aed4b7441abc908c6dff8c923d', 'request_id': 'req-642f0131-bf4f-4035-af47-cfa9b47456ea'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:48.945486 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-642f0131-bf4f-4035-af47-cfa9b47456ea tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '130116aed4b7441abc908c6dff8c923d', 'request_id': 'req-642f0131-bf4f-4035-af47-cfa9b47456ea'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:48.952725 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-642f0131-bf4f-4035-af47-cfa9b47456ea tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '130116aed4b7441abc908c6dff8c923d', 'request_id': 'req-642f0131-bf4f-4035-af47-cfa9b47456ea'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:48.964762 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-642f0131-bf4f-4035-af47-cfa9b47456ea tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] The token cache is being invalidate because project 130116aed4b7441abc908c6dff8c923d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:33:48.965056 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-642f0131-bf4f-4035-af47-cfa9b47456ea tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:48.965786 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-642f0131-bf4f-4035-af47-cfa9b47456ea tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:48.968013 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2843/5707] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:33:48 2022] DELETE /identity/v3/projects/130116aed4b7441abc908c6dff8c923d => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:33:48.973002 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642f0131-bf4f-4035-af47-cfa9b47456ea tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:48.974425 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-642f0131-bf4f-4035-af47-cfa9b47456ea tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:48.994083 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd03323-2df4-4a58-b1d8-d457624f82f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:48.994923 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd03323-2df4-4a58-b1d8-d457624f82f7 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:48.995637 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd03323-2df4-4a58-b1d8-d457624f82f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:48.995923 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd03323-2df4-4a58-b1d8-d457624f82f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:48.996735 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd03323-2df4-4a58-b1d8-d457624f82f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:48.999829 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd03323-2df4-4a58-b1d8-d457624f82f7 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:49.014273 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2865/5708] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:33:48 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:33:49.015388 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd03323-2df4-4a58-b1d8-d457624f82f7 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:49.017197 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-2cd03323-2df4-4a58-b1d8-d457624f82f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:49.031436 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd03323-2df4-4a58-b1d8-d457624f82f7 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:49.036209 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5798e3-e4b9-40a7-9fa1-aebdc8b652c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:49.037146 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5798e3-e4b9-40a7-9fa1-aebdc8b652c8 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:49.037512 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5798e3-e4b9-40a7-9fa1-aebdc8b652c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:49.037941 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5798e3-e4b9-40a7-9fa1-aebdc8b652c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:49.038734 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5798e3-e4b9-40a7-9fa1-aebdc8b652c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:49.040377 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5798e3-e4b9-40a7-9fa1-aebdc8b652c8 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:49.044451 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642f0131-bf4f-4035-af47-cfa9b47456ea tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:49.049724 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e603a76-a666-466a-9973-9bd91fdf2133 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6329fc7fa93c45b7be7350e34ad6bd1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5496ab260afb4aa4b58054dad376a5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:49.050429 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e603a76-a666-466a-9973-9bd91fdf2133 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:49.050708 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e603a76-a666-466a-9973-9bd91fdf2133 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:49.051158 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e603a76-a666-466a-9973-9bd91fdf2133 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:49.051519 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2866/5709] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:33:49 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:33:49.051858 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e603a76-a666-466a-9973-9bd91fdf2133 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:49.053742 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e603a76-a666-466a-9973-9bd91fdf2133 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:49.056146 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5798e3-e4b9-40a7-9fa1-aebdc8b652c8 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:49.067141 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5798e3-e4b9-40a7-9fa1-aebdc8b652c8 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:49.072164 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe932514-451f-4d75-b273-5b29c5ce3cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:49.073077 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe932514-451f-4d75-b273-5b29c5ce3cd0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:49.073478 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe932514-451f-4d75-b273-5b29c5ce3cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:49.073759 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe932514-451f-4d75-b273-5b29c5ce3cd0 admin admin] PATH_INFO: `/v3/projects/6442eb45f7724798b21ae1c4dc11ddcd/users/4eefebb908fd4df0a8e5e8e53ce140cd/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:49.074695 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2844/5710] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:33:48 2022] POST /identity/v3/projects => generated 348 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:33:49.079772 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e603a76-a666-466a-9973-9bd91fdf2133 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:49.096463 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=90,keystone:DELETE=8,keystone:INSERT=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:33:49.097629 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:33:49.102175 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe932514-451f-4d75-b273-5b29c5ce3cd0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6442eb45f7724798b21ae1c4dc11ddcd, user_id=4eefebb908fd4df0a8e5e8e53ce140cd, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:49.105758 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe932514-451f-4d75-b273-5b29c5ce3cd0 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:49.129179 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2867/5711] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:33:49 2022] PUT /identity/v3/projects/6442eb45f7724798b21ae1c4dc11ddcd/users/4eefebb908fd4df0a8e5e8e53ce140cd/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:33:49.142814 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831324cf-4ec0-4fb4-9a4f-d3c6d0d71b44 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:49.143176 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831324cf-4ec0-4fb4-9a4f-d3c6d0d71b44 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:49.143845 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831324cf-4ec0-4fb4-9a4f-d3c6d0d71b44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:49.154724 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e603a76-a666-466a-9973-9bd91fdf2133 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:49.179829 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-831324cf-4ec0-4fb4-9a4f-d3c6d0d71b44 None None] MFA Rules not processed for user `4eefebb908fd4df0a8e5e8e53ce140cd`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:33:49.181052 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-831324cf-4ec0-4fb4-9a4f-d3c6d0d71b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:49.231475 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15d164c-4ba6-4b8e-b5a5-2543d49f98ac tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6329fc7fa93c45b7be7350e34ad6bd1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5496ab260afb4aa4b58054dad376a5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:49.232541 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15d164c-4ba6-4b8e-b5a5-2543d49f98ac tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:49.233922 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15d164c-4ba6-4b8e-b5a5-2543d49f98ac tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:49.234495 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15d164c-4ba6-4b8e-b5a5-2543d49f98ac tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:49.235627 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15d164c-4ba6-4b8e-b5a5-2543d49f98ac tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] RBAC: Adding query filter params (is_domain=True) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:33:49.235938 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15d164c-4ba6-4b8e-b5a5-2543d49f98ac tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:49.237235 ncdv-master-1 devstack@keystone.service[91547]: WARNING py.warnings [None req-a15d164c-4ba6-4b8e-b5a5-2543d49f98ac tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:33:49.237235 ncdv-master-1 devstack@keystone.service[91547]: warnings.warn(msg) Jul 23 21:33:49.237235 ncdv-master-1 devstack@keystone.service[91547]: Jul 23 21:33:49.238514 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15d164c-4ba6-4b8e-b5a5-2543d49f98ac tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:49.264701 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2845/5712] 10.222.0.17 () {58 vars in 1159 bytes} [Sat Jul 23 21:33:49 2022] GET /identity/v3/projects?is_domain=True => generated 1020 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:33:49.265979 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15d164c-4ba6-4b8e-b5a5-2543d49f98ac tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:49.276912 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15d164c-4ba6-4b8e-b5a5-2543d49f98ac tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:49.283446 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07fe3af-c42f-4a1a-aaa7-adcd224287db tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6329fc7fa93c45b7be7350e34ad6bd1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5496ab260afb4aa4b58054dad376a5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:49.284191 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07fe3af-c42f-4a1a-aaa7-adcd224287db tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:49.284481 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07fe3af-c42f-4a1a-aaa7-adcd224287db tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:49.284788 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07fe3af-c42f-4a1a-aaa7-adcd224287db tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:49.285523 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07fe3af-c42f-4a1a-aaa7-adcd224287db tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:49.287209 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07fe3af-c42f-4a1a-aaa7-adcd224287db tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:49.304073 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2868/5713] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:33:49 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:33:49.305091 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831324cf-4ec0-4fb4-9a4f-d3c6d0d71b44 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:49.307241 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2846/5714] 10.222.0.17 () {58 vars in 1127 bytes} [Sat Jul 23 21:33:49 2022] GET /identity/v3/domains => generated 829 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:33:49.312146 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07fe3af-c42f-4a1a-aaa7-adcd224287db tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:49.319198 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831324cf-4ec0-4fb4-9a4f-d3c6d0d71b44 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:49.324547 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46557b5d-8a45-4e42-942f-2ff418b02a6c tempest-ApplicationCredentialsV3Test-1010884817 tempest-ApplicationCredentialsV3Test-1010884817-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eefebb908fd4df0a8e5e8e53ce140cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6442eb45f7724798b21ae1c4dc11ddcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:49.326529 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46557b5d-8a45-4e42-942f-2ff418b02a6c tempest-ApplicationCredentialsV3Test-1010884817 tempest-ApplicationCredentialsV3Test-1010884817-project] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:49.326529 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46557b5d-8a45-4e42-942f-2ff418b02a6c tempest-ApplicationCredentialsV3Test-1010884817 tempest-ApplicationCredentialsV3Test-1010884817-project] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:49.326802 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46557b5d-8a45-4e42-942f-2ff418b02a6c tempest-ApplicationCredentialsV3Test-1010884817 tempest-ApplicationCredentialsV3Test-1010884817-project] PATH_INFO: `/v3/users/4eefebb908fd4df0a8e5e8e53ce140cd/application_credentials` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:49.327815 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46557b5d-8a45-4e42-942f-2ff418b02a6c tempest-ApplicationCredentialsV3Test-1010884817 tempest-ApplicationCredentialsV3Test-1010884817-project] RBAC: Authorizing `identity:create_application_credential(user_id=4eefebb908fd4df0a8e5e8e53ce140cd)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:49.329172 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46557b5d-8a45-4e42-942f-2ff418b02a6c tempest-ApplicationCredentialsV3Test-1010884817 tempest-ApplicationCredentialsV3Test-1010884817-project] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:49.332049 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07fe3af-c42f-4a1a-aaa7-adcd224287db tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:49.339524 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c7518b-022b-4e36-b88b-0376e40e3a51 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6329fc7fa93c45b7be7350e34ad6bd1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5496ab260afb4aa4b58054dad376a5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:49.341794 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c7518b-022b-4e36-b88b-0376e40e3a51 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:49.342305 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c7518b-022b-4e36-b88b-0376e40e3a51 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:49.342773 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c7518b-022b-4e36-b88b-0376e40e3a51 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] PATH_INFO: `/v3/projects/7358ccdb8ad548f3acbd257993516eda` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:49.344975 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c7518b-022b-4e36-b88b-0376e40e3a51 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] RBAC: Authorizing `identity:update_project(project_id=7358ccdb8ad548f3acbd257993516eda)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:49.346217 ncdv-master-1 devstack@keystone.service[91547]: WARNING py.warnings [None req-a7c7518b-022b-4e36-b88b-0376e40e3a51 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:33:49.346217 ncdv-master-1 devstack@keystone.service[91547]: warnings.warn(msg) Jul 23 21:33:49.346217 ncdv-master-1 devstack@keystone.service[91547]: Jul 23 21:33:49.347768 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c7518b-022b-4e36-b88b-0376e40e3a51 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:49.362468 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-a7c7518b-022b-4e36-b88b-0376e40e3a51 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '7358ccdb8ad548f3acbd257993516eda'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:49.364011 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-a7c7518b-022b-4e36-b88b-0376e40e3a51 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '7358ccdb8ad548f3acbd257993516eda'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:49.397003 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-a7c7518b-022b-4e36-b88b-0376e40e3a51 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '7358ccdb8ad548f3acbd257993516eda'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:49.398214 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-a7c7518b-022b-4e36-b88b-0376e40e3a51 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '7358ccdb8ad548f3acbd257993516eda'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:49.401995 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2847/5715] 10.222.0.17 () {60 vars in 1251 bytes} [Sat Jul 23 21:33:49 2022] PATCH /identity/v3/projects/7358ccdb8ad548f3acbd257993516eda => generated 362 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 21:33:49.406097 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c7518b-022b-4e36-b88b-0376e40e3a51 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:49.407702 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-a7c7518b-022b-4e36-b88b-0376e40e3a51 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:49.462453 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2869/5716] 10.222.0.17 () {60 vars in 1313 bytes} [Sat Jul 23 21:33:49 2022] POST /identity/v3/users/4eefebb908fd4df0a8e5e8e53ce140cd/application_credentials => generated 788 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:33:49.467484 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46557b5d-8a45-4e42-942f-2ff418b02a6c tempest-ApplicationCredentialsV3Test-1010884817 tempest-ApplicationCredentialsV3Test-1010884817-project] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:49.469277 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-46557b5d-8a45-4e42-942f-2ff418b02a6c tempest-ApplicationCredentialsV3Test-1010884817 tempest-ApplicationCredentialsV3Test-1010884817-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:49.481311 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46557b5d-8a45-4e42-942f-2ff418b02a6c tempest-ApplicationCredentialsV3Test-1010884817 tempest-ApplicationCredentialsV3Test-1010884817-project] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:49.496179 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c7518b-022b-4e36-b88b-0376e40e3a51 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:49.500914 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baaccfe-29f0-4715-9cde-83a761d46868 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6329fc7fa93c45b7be7350e34ad6bd1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5496ab260afb4aa4b58054dad376a5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:49.501809 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baaccfe-29f0-4715-9cde-83a761d46868 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:49.502121 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baaccfe-29f0-4715-9cde-83a761d46868 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:49.502392 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baaccfe-29f0-4715-9cde-83a761d46868 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] PATH_INFO: `/v3/projects/7358ccdb8ad548f3acbd257993516eda` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:49.511332 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:33:49.514856 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baaccfe-29f0-4715-9cde-83a761d46868 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] RBAC: Authorizing `identity:delete_project(project_id=7358ccdb8ad548f3acbd257993516eda)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:49.517381 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baaccfe-29f0-4715-9cde-83a761d46868 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:49.537415 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c95ea7-e219-477f-a4d9-961693c88efc tempest-ApplicationCredentialsV3Test-1010884817 tempest-ApplicationCredentialsV3Test-1010884817-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eefebb908fd4df0a8e5e8e53ce140cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6442eb45f7724798b21ae1c4dc11ddcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:49.538533 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c95ea7-e219-477f-a4d9-961693c88efc tempest-ApplicationCredentialsV3Test-1010884817 tempest-ApplicationCredentialsV3Test-1010884817-project] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:49.538808 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c95ea7-e219-477f-a4d9-961693c88efc tempest-ApplicationCredentialsV3Test-1010884817 tempest-ApplicationCredentialsV3Test-1010884817-project] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:49.539080 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c95ea7-e219-477f-a4d9-961693c88efc tempest-ApplicationCredentialsV3Test-1010884817 tempest-ApplicationCredentialsV3Test-1010884817-project] PATH_INFO: `/v3/users/4eefebb908fd4df0a8e5e8e53ce140cd/application_credentials/27d0cc1c3b5847d5ab2b767350de3e19` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:49.540968 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-4baaccfe-29f0-4715-9cde-83a761d46868 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '7358ccdb8ad548f3acbd257993516eda'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:49.549214 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c95ea7-e219-477f-a4d9-961693c88efc tempest-ApplicationCredentialsV3Test-1010884817 tempest-ApplicationCredentialsV3Test-1010884817-project] RBAC: Authorizing `identity:get_application_credential(user_id=4eefebb908fd4df0a8e5e8e53ce140cd, application_credential_id=27d0cc1c3b5847d5ab2b767350de3e19)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:49.550864 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c95ea7-e219-477f-a4d9-961693c88efc tempest-ApplicationCredentialsV3Test-1010884817 tempest-ApplicationCredentialsV3Test-1010884817-project] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:49.552397 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-4baaccfe-29f0-4715-9cde-83a761d46868 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '7358ccdb8ad548f3acbd257993516eda'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:49.552538 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2870/5717] 10.222.0.17 () {58 vars in 1391 bytes} [Sat Jul 23 21:33:49 2022] GET /identity/v3/users/4eefebb908fd4df0a8e5e8e53ce140cd/application_credentials/27d0cc1c3b5847d5ab2b767350de3e19 => generated 688 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 21:33:49.557092 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed36db9b-84f0-4c0f-afa5-7da855c73d9a None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:49.557415 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed36db9b-84f0-4c0f-afa5-7da855c73d9a None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:49.557654 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed36db9b-84f0-4c0f-afa5-7da855c73d9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:49.570572 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-ed36db9b-84f0-4c0f-afa5-7da855c73d9a None None] MFA Rules not processed for user `4eefebb908fd4df0a8e5e8e53ce140cd`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:33:49.571781 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-ed36db9b-84f0-4c0f-afa5-7da855c73d9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:49.579992 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:33:49.594549 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-4baaccfe-29f0-4715-9cde-83a761d46868 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7358ccdb8ad548f3acbd257993516eda', 'request_id': 'req-4baaccfe-29f0-4715-9cde-83a761d46868'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:49.604445 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-4baaccfe-29f0-4715-9cde-83a761d46868 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7358ccdb8ad548f3acbd257993516eda', 'request_id': 'req-4baaccfe-29f0-4715-9cde-83a761d46868'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:49.610379 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-4baaccfe-29f0-4715-9cde-83a761d46868 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7358ccdb8ad548f3acbd257993516eda', 'request_id': 'req-4baaccfe-29f0-4715-9cde-83a761d46868'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:49.623115 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-4baaccfe-29f0-4715-9cde-83a761d46868 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] The token cache is being invalidate because project 7358ccdb8ad548f3acbd257993516eda was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:33:49.623332 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-4baaccfe-29f0-4715-9cde-83a761d46868 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:49.624048 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-4baaccfe-29f0-4715-9cde-83a761d46868 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:49.631929 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-4baaccfe-29f0-4715-9cde-83a761d46868 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '7358ccdb8ad548f3acbd257993516eda', 'request_id': 'req-4baaccfe-29f0-4715-9cde-83a761d46868'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:49.632575 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-4baaccfe-29f0-4715-9cde-83a761d46868 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '7358ccdb8ad548f3acbd257993516eda', 'request_id': 'req-4baaccfe-29f0-4715-9cde-83a761d46868'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:49.638069 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-4baaccfe-29f0-4715-9cde-83a761d46868 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '7358ccdb8ad548f3acbd257993516eda', 'request_id': 'req-4baaccfe-29f0-4715-9cde-83a761d46868'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:49.645091 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2848/5718] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:33:49 2022] DELETE /identity/v3/projects/7358ccdb8ad548f3acbd257993516eda => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:33:49.650159 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baaccfe-29f0-4715-9cde-83a761d46868 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:49.651776 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-4baaccfe-29f0-4715-9cde-83a761d46868 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:49.684813 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2871/5719] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:33:49 2022] POST /identity/v3/auth/tokens => generated 3416 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 406 bytes (2 switches on core 0) Jul 23 21:33:49.690400 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed36db9b-84f0-4c0f-afa5-7da855c73d9a None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:49.693631 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-ed36db9b-84f0-4c0f-afa5-7da855c73d9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:49.737905 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baaccfe-29f0-4715-9cde-83a761d46868 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:49.739526 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c01fa3-f250-4bba-9bf0-ffa68386dd68 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6329fc7fa93c45b7be7350e34ad6bd1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5496ab260afb4aa4b58054dad376a5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:49.740209 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c01fa3-f250-4bba-9bf0-ffa68386dd68 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:49.740493 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c01fa3-f250-4bba-9bf0-ffa68386dd68 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:49.741009 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c01fa3-f250-4bba-9bf0-ffa68386dd68 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:49.741503 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c01fa3-f250-4bba-9bf0-ffa68386dd68 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:49.743486 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c01fa3-f250-4bba-9bf0-ffa68386dd68 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:49.765489 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed36db9b-84f0-4c0f-afa5-7da855c73d9a None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:49.770107 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d2a153-aa3a-43a4-9c63-3fab75d47052 tempest-ApplicationCredentialsV3Test-1010884817 tempest-ApplicationCredentialsV3Test-1010884817-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eefebb908fd4df0a8e5e8e53ce140cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6442eb45f7724798b21ae1c4dc11ddcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:49.771084 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d2a153-aa3a-43a4-9c63-3fab75d47052 tempest-ApplicationCredentialsV3Test-1010884817 tempest-ApplicationCredentialsV3Test-1010884817-project] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:49.771363 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d2a153-aa3a-43a4-9c63-3fab75d47052 tempest-ApplicationCredentialsV3Test-1010884817 tempest-ApplicationCredentialsV3Test-1010884817-project] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:49.771636 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d2a153-aa3a-43a4-9c63-3fab75d47052 tempest-ApplicationCredentialsV3Test-1010884817 tempest-ApplicationCredentialsV3Test-1010884817-project] PATH_INFO: `/v3/users/4eefebb908fd4df0a8e5e8e53ce140cd/application_credentials/27d0cc1c3b5847d5ab2b767350de3e19` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:49.773071 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d2a153-aa3a-43a4-9c63-3fab75d47052 tempest-ApplicationCredentialsV3Test-1010884817 tempest-ApplicationCredentialsV3Test-1010884817-project] RBAC: Authorizing `identity:delete_application_credential(user_id=4eefebb908fd4df0a8e5e8e53ce140cd, application_credential_id=27d0cc1c3b5847d5ab2b767350de3e19)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:49.774830 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d2a153-aa3a-43a4-9c63-3fab75d47052 tempest-ApplicationCredentialsV3Test-1010884817 tempest-ApplicationCredentialsV3Test-1010884817-project] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:49.775777 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2849/5720] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:33:49 2022] POST /identity/v3/projects => generated 359 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:33:49.780034 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c01fa3-f250-4bba-9bf0-ffa68386dd68 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:49.797470 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2872/5721] 10.222.0.17 () {58 vars in 1394 bytes} [Sat Jul 23 21:33:49 2022] DELETE /identity/v3/users/4eefebb908fd4df0a8e5e8e53ce140cd/application_credentials/27d0cc1c3b5847d5ab2b767350de3e19 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:33:49.802814 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d2a153-aa3a-43a4-9c63-3fab75d47052 tempest-ApplicationCredentialsV3Test-1010884817 tempest-ApplicationCredentialsV3Test-1010884817-project] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:49.804848 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-b5d2a153-aa3a-43a4-9c63-3fab75d47052 tempest-ApplicationCredentialsV3Test-1010884817 tempest-ApplicationCredentialsV3Test-1010884817-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:49.815066 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:33:49.818995 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d2a153-aa3a-43a4-9c63-3fab75d47052 tempest-ApplicationCredentialsV3Test-1010884817 tempest-ApplicationCredentialsV3Test-1010884817-project] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:49.849237 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c01fa3-f250-4bba-9bf0-ffa68386dd68 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:49.854701 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c77b44-e80e-485a-bb3d-eb550f0ce23d tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6329fc7fa93c45b7be7350e34ad6bd1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5496ab260afb4aa4b58054dad376a5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:49.855589 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c77b44-e80e-485a-bb3d-eb550f0ce23d tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:49.855868 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c77b44-e80e-485a-bb3d-eb550f0ce23d tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:49.856139 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c77b44-e80e-485a-bb3d-eb550f0ce23d tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] PATH_INFO: `/v3/projects/6fcc64c8a4c1477b9b12942ca39f67d5` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:49.857339 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c77b44-e80e-485a-bb3d-eb550f0ce23d tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] RBAC: Authorizing `identity:get_project(project_id=6fcc64c8a4c1477b9b12942ca39f67d5)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:49.859626 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c77b44-e80e-485a-bb3d-eb550f0ce23d tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:49.861538 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2850/5722] 10.222.0.17 () {58 vars in 1229 bytes} [Sat Jul 23 21:33:49 2022] GET /identity/v3/projects/6fcc64c8a4c1477b9b12942ca39f67d5 => generated 359 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:33:49.865679 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c77b44-e80e-485a-bb3d-eb550f0ce23d tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:49.873722 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab75020-9482-49b0-a995-f0a36f9a7ba5 tempest-ApplicationCredentialsV3Test-1010884817 tempest-ApplicationCredentialsV3Test-1010884817-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eefebb908fd4df0a8e5e8e53ce140cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6442eb45f7724798b21ae1c4dc11ddcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:49.874598 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab75020-9482-49b0-a995-f0a36f9a7ba5 tempest-ApplicationCredentialsV3Test-1010884817 tempest-ApplicationCredentialsV3Test-1010884817-project] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:49.874879 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab75020-9482-49b0-a995-f0a36f9a7ba5 tempest-ApplicationCredentialsV3Test-1010884817 tempest-ApplicationCredentialsV3Test-1010884817-project] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:49.875154 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab75020-9482-49b0-a995-f0a36f9a7ba5 tempest-ApplicationCredentialsV3Test-1010884817 tempest-ApplicationCredentialsV3Test-1010884817-project] PATH_INFO: `/v3/users/4eefebb908fd4df0a8e5e8e53ce140cd/application_credentials` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:49.875782 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c77b44-e80e-485a-bb3d-eb550f0ce23d tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:49.875898 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab75020-9482-49b0-a995-f0a36f9a7ba5 tempest-ApplicationCredentialsV3Test-1010884817 tempest-ApplicationCredentialsV3Test-1010884817-project] RBAC: Authorizing `identity:create_application_credential(user_id=4eefebb908fd4df0a8e5e8e53ce140cd)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:49.877053 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab75020-9482-49b0-a995-f0a36f9a7ba5 tempest-ApplicationCredentialsV3Test-1010884817 tempest-ApplicationCredentialsV3Test-1010884817-project] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:49.880686 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c9c215-11eb-4cec-9ab3-8428e531a9d0 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6329fc7fa93c45b7be7350e34ad6bd1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5496ab260afb4aa4b58054dad376a5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:49.882075 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c9c215-11eb-4cec-9ab3-8428e531a9d0 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:49.882357 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c9c215-11eb-4cec-9ab3-8428e531a9d0 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:49.882637 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c9c215-11eb-4cec-9ab3-8428e531a9d0 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] PATH_INFO: `/v3/projects/6fcc64c8a4c1477b9b12942ca39f67d5` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:49.883817 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c9c215-11eb-4cec-9ab3-8428e531a9d0 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] RBAC: Authorizing `identity:delete_project(project_id=6fcc64c8a4c1477b9b12942ca39f67d5)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:49.884665 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:33:49.885826 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c9c215-11eb-4cec-9ab3-8428e531a9d0 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:49.935233 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-90c9c215-11eb-4cec-9ab3-8428e531a9d0 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6fcc64c8a4c1477b9b12942ca39f67d5', 'request_id': 'req-90c9c215-11eb-4cec-9ab3-8428e531a9d0'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:49.942829 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-90c9c215-11eb-4cec-9ab3-8428e531a9d0 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6fcc64c8a4c1477b9b12942ca39f67d5', 'request_id': 'req-90c9c215-11eb-4cec-9ab3-8428e531a9d0'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:49.948653 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-90c9c215-11eb-4cec-9ab3-8428e531a9d0 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6fcc64c8a4c1477b9b12942ca39f67d5', 'request_id': 'req-90c9c215-11eb-4cec-9ab3-8428e531a9d0'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:49.959433 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2873/5723] 10.222.0.17 () {60 vars in 1314 bytes} [Sat Jul 23 21:33:49 2022] POST /identity/v3/users/4eefebb908fd4df0a8e5e8e53ce140cd/application_credentials => generated 920 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:33:49.961026 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab75020-9482-49b0-a995-f0a36f9a7ba5 tempest-ApplicationCredentialsV3Test-1010884817 tempest-ApplicationCredentialsV3Test-1010884817-project] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:49.963969 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-90c9c215-11eb-4cec-9ab3-8428e531a9d0 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] The token cache is being invalidate because project 6fcc64c8a4c1477b9b12942ca39f67d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:33:49.964263 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-90c9c215-11eb-4cec-9ab3-8428e531a9d0 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:49.965078 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-90c9c215-11eb-4cec-9ab3-8428e531a9d0 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:49.966757 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2851/5724] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:33:49 2022] DELETE /identity/v3/projects/6fcc64c8a4c1477b9b12942ca39f67d5 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:33:49.971703 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c9c215-11eb-4cec-9ab3-8428e531a9d0 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:49.973313 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-90c9c215-11eb-4cec-9ab3-8428e531a9d0 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:49.974034 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab75020-9482-49b0-a995-f0a36f9a7ba5 tempest-ApplicationCredentialsV3Test-1010884817 tempest-ApplicationCredentialsV3Test-1010884817-project] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:50.027257 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e232b96-5818-4ac4-8cc3-41605b645609 tempest-ApplicationCredentialsV3Test-1010884817 tempest-ApplicationCredentialsV3Test-1010884817-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eefebb908fd4df0a8e5e8e53ce140cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6442eb45f7724798b21ae1c4dc11ddcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:50.028321 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e232b96-5818-4ac4-8cc3-41605b645609 tempest-ApplicationCredentialsV3Test-1010884817 tempest-ApplicationCredentialsV3Test-1010884817-project] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:50.028676 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e232b96-5818-4ac4-8cc3-41605b645609 tempest-ApplicationCredentialsV3Test-1010884817 tempest-ApplicationCredentialsV3Test-1010884817-project] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:50.029023 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e232b96-5818-4ac4-8cc3-41605b645609 tempest-ApplicationCredentialsV3Test-1010884817 tempest-ApplicationCredentialsV3Test-1010884817-project] PATH_INFO: `/v3/users/4eefebb908fd4df0a8e5e8e53ce140cd/application_credentials/1ea557b7299c4f019b3b66322ab5ad46` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:50.037992 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c9c215-11eb-4cec-9ab3-8428e531a9d0 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:50.039623 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e232b96-5818-4ac4-8cc3-41605b645609 tempest-ApplicationCredentialsV3Test-1010884817 tempest-ApplicationCredentialsV3Test-1010884817-project] RBAC: Authorizing `identity:delete_application_credential(user_id=4eefebb908fd4df0a8e5e8e53ce140cd, application_credential_id=1ea557b7299c4f019b3b66322ab5ad46)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:50.041135 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e232b96-5818-4ac4-8cc3-41605b645609 tempest-ApplicationCredentialsV3Test-1010884817 tempest-ApplicationCredentialsV3Test-1010884817-project] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:50.042894 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413dbffe-f9c5-4848-94c8-18afed7bad03 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6329fc7fa93c45b7be7350e34ad6bd1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5496ab260afb4aa4b58054dad376a5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:50.043567 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413dbffe-f9c5-4848-94c8-18afed7bad03 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:50.043882 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413dbffe-f9c5-4848-94c8-18afed7bad03 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:50.044158 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413dbffe-f9c5-4848-94c8-18afed7bad03 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:50.044848 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413dbffe-f9c5-4848-94c8-18afed7bad03 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:50.046793 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413dbffe-f9c5-4848-94c8-18afed7bad03 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:50.063364 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2874/5725] 10.222.0.17 () {58 vars in 1394 bytes} [Sat Jul 23 21:33:49 2022] DELETE /identity/v3/users/4eefebb908fd4df0a8e5e8e53ce140cd/application_credentials/1ea557b7299c4f019b3b66322ab5ad46 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:33:50.069009 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e232b96-5818-4ac4-8cc3-41605b645609 tempest-ApplicationCredentialsV3Test-1010884817 tempest-ApplicationCredentialsV3Test-1010884817-project] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:50.070853 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-7e232b96-5818-4ac4-8cc3-41605b645609 tempest-ApplicationCredentialsV3Test-1010884817 tempest-ApplicationCredentialsV3Test-1010884817-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:50.079133 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2852/5726] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:33:49 2022] POST /identity/v3/projects => generated 361 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:33:50.082620 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e232b96-5818-4ac4-8cc3-41605b645609 tempest-ApplicationCredentialsV3Test-1010884817 tempest-ApplicationCredentialsV3Test-1010884817-project] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:50.083247 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413dbffe-f9c5-4848-94c8-18afed7bad03 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:50.128214 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:33:50.139727 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d19c78d-8145-4f9c-89ce-31874d875f04 tempest-ApplicationCredentialsV3Test-1010884817 tempest-ApplicationCredentialsV3Test-1010884817-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eefebb908fd4df0a8e5e8e53ce140cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6442eb45f7724798b21ae1c4dc11ddcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:50.140688 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d19c78d-8145-4f9c-89ce-31874d875f04 tempest-ApplicationCredentialsV3Test-1010884817 tempest-ApplicationCredentialsV3Test-1010884817-project] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:50.140975 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d19c78d-8145-4f9c-89ce-31874d875f04 tempest-ApplicationCredentialsV3Test-1010884817 tempest-ApplicationCredentialsV3Test-1010884817-project] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:50.141253 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d19c78d-8145-4f9c-89ce-31874d875f04 tempest-ApplicationCredentialsV3Test-1010884817 tempest-ApplicationCredentialsV3Test-1010884817-project] PATH_INFO: `/v3/users/4eefebb908fd4df0a8e5e8e53ce140cd/application_credentials` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:50.142078 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d19c78d-8145-4f9c-89ce-31874d875f04 tempest-ApplicationCredentialsV3Test-1010884817 tempest-ApplicationCredentialsV3Test-1010884817-project] RBAC: Authorizing `identity:create_application_credential(user_id=4eefebb908fd4df0a8e5e8e53ce140cd)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:50.143256 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d19c78d-8145-4f9c-89ce-31874d875f04 tempest-ApplicationCredentialsV3Test-1010884817 tempest-ApplicationCredentialsV3Test-1010884817-project] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:50.150738 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413dbffe-f9c5-4848-94c8-18afed7bad03 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:50.156197 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d7ff0c-6776-4826-952c-df7bd72fdc06 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6329fc7fa93c45b7be7350e34ad6bd1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5496ab260afb4aa4b58054dad376a5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:50.157099 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d7ff0c-6776-4826-952c-df7bd72fdc06 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:50.157382 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d7ff0c-6776-4826-952c-df7bd72fdc06 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:50.157793 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d7ff0c-6776-4826-952c-df7bd72fdc06 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] PATH_INFO: `/v3/projects/da824578401841ceb4724a30d0edd8c3` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:50.159090 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d7ff0c-6776-4826-952c-df7bd72fdc06 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] RBAC: Authorizing `identity:get_project(project_id=da824578401841ceb4724a30d0edd8c3)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:50.161285 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d7ff0c-6776-4826-952c-df7bd72fdc06 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:50.163131 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2853/5727] 10.222.0.17 () {58 vars in 1229 bytes} [Sat Jul 23 21:33:50 2022] GET /identity/v3/projects/da824578401841ceb4724a30d0edd8c3 => generated 361 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 21:33:50.166754 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:33:50.167661 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d7ff0c-6776-4826-952c-df7bd72fdc06 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:50.177959 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d7ff0c-6776-4826-952c-df7bd72fdc06 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:50.182758 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4e5723-f262-4da0-bc7c-2ef467db4213 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6329fc7fa93c45b7be7350e34ad6bd1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5496ab260afb4aa4b58054dad376a5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:50.183598 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4e5723-f262-4da0-bc7c-2ef467db4213 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:50.183879 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4e5723-f262-4da0-bc7c-2ef467db4213 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:50.184151 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4e5723-f262-4da0-bc7c-2ef467db4213 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] PATH_INFO: `/v3/projects/da824578401841ceb4724a30d0edd8c3` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:50.185362 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4e5723-f262-4da0-bc7c-2ef467db4213 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] RBAC: Authorizing `identity:delete_project(project_id=da824578401841ceb4724a30d0edd8c3)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:50.187353 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4e5723-f262-4da0-bc7c-2ef467db4213 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:50.215389 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2875/5728] 10.222.0.17 () {60 vars in 1314 bytes} [Sat Jul 23 21:33:50 2022] POST /identity/v3/users/4eefebb908fd4df0a8e5e8e53ce140cd/application_credentials => generated 812 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:33:50.220166 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d19c78d-8145-4f9c-89ce-31874d875f04 tempest-ApplicationCredentialsV3Test-1010884817 tempest-ApplicationCredentialsV3Test-1010884817-project] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:50.230138 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d19c78d-8145-4f9c-89ce-31874d875f04 tempest-ApplicationCredentialsV3Test-1010884817 tempest-ApplicationCredentialsV3Test-1010884817-project] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:50.243677 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-ca4e5723-f262-4da0-bc7c-2ef467db4213 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da824578401841ceb4724a30d0edd8c3', 'request_id': 'req-ca4e5723-f262-4da0-bc7c-2ef467db4213'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:50.252433 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-ca4e5723-f262-4da0-bc7c-2ef467db4213 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da824578401841ceb4724a30d0edd8c3', 'request_id': 'req-ca4e5723-f262-4da0-bc7c-2ef467db4213'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:50.258823 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-ca4e5723-f262-4da0-bc7c-2ef467db4213 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da824578401841ceb4724a30d0edd8c3', 'request_id': 'req-ca4e5723-f262-4da0-bc7c-2ef467db4213'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:50.270675 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-ca4e5723-f262-4da0-bc7c-2ef467db4213 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] The token cache is being invalidate because project da824578401841ceb4724a30d0edd8c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:33:50.270960 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-ca4e5723-f262-4da0-bc7c-2ef467db4213 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:50.271788 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-ca4e5723-f262-4da0-bc7c-2ef467db4213 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:50.273630 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2854/5729] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:33:50 2022] DELETE /identity/v3/projects/da824578401841ceb4724a30d0edd8c3 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:33:50.278437 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4e5723-f262-4da0-bc7c-2ef467db4213 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:50.280068 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-ca4e5723-f262-4da0-bc7c-2ef467db4213 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:50.286525 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e64c82-1cd7-4666-b3a1-aecd604c4954 tempest-ApplicationCredentialsV3Test-1010884817 tempest-ApplicationCredentialsV3Test-1010884817-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eefebb908fd4df0a8e5e8e53ce140cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6442eb45f7724798b21ae1c4dc11ddcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:50.287493 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e64c82-1cd7-4666-b3a1-aecd604c4954 tempest-ApplicationCredentialsV3Test-1010884817 tempest-ApplicationCredentialsV3Test-1010884817-project] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:50.287813 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e64c82-1cd7-4666-b3a1-aecd604c4954 tempest-ApplicationCredentialsV3Test-1010884817 tempest-ApplicationCredentialsV3Test-1010884817-project] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:50.288182 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e64c82-1cd7-4666-b3a1-aecd604c4954 tempest-ApplicationCredentialsV3Test-1010884817 tempest-ApplicationCredentialsV3Test-1010884817-project] PATH_INFO: `/v3/users/4eefebb908fd4df0a8e5e8e53ce140cd/application_credentials/213e607d03df4d489d378077b2981be6` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:50.296730 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e64c82-1cd7-4666-b3a1-aecd604c4954 tempest-ApplicationCredentialsV3Test-1010884817 tempest-ApplicationCredentialsV3Test-1010884817-project] RBAC: Authorizing `identity:delete_application_credential(user_id=4eefebb908fd4df0a8e5e8e53ce140cd, application_credential_id=213e607d03df4d489d378077b2981be6)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:50.298955 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e64c82-1cd7-4666-b3a1-aecd604c4954 tempest-ApplicationCredentialsV3Test-1010884817 tempest-ApplicationCredentialsV3Test-1010884817-project] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:50.318382 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2876/5730] 10.222.0.17 () {58 vars in 1394 bytes} [Sat Jul 23 21:33:50 2022] DELETE /identity/v3/users/4eefebb908fd4df0a8e5e8e53ce140cd/application_credentials/213e607d03df4d489d378077b2981be6 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:33:50.323372 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e64c82-1cd7-4666-b3a1-aecd604c4954 tempest-ApplicationCredentialsV3Test-1010884817 tempest-ApplicationCredentialsV3Test-1010884817-project] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:50.325082 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-a6e64c82-1cd7-4666-b3a1-aecd604c4954 tempest-ApplicationCredentialsV3Test-1010884817 tempest-ApplicationCredentialsV3Test-1010884817-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:50.337063 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e64c82-1cd7-4666-b3a1-aecd604c4954 tempest-ApplicationCredentialsV3Test-1010884817 tempest-ApplicationCredentialsV3Test-1010884817-project] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:50.341202 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54555365-b968-4654-8e30-940627c6513c tempest-ApplicationCredentialsV3Test-1010884817 tempest-ApplicationCredentialsV3Test-1010884817-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eefebb908fd4df0a8e5e8e53ce140cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6442eb45f7724798b21ae1c4dc11ddcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:50.342254 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54555365-b968-4654-8e30-940627c6513c tempest-ApplicationCredentialsV3Test-1010884817 tempest-ApplicationCredentialsV3Test-1010884817-project] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:50.342599 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54555365-b968-4654-8e30-940627c6513c tempest-ApplicationCredentialsV3Test-1010884817 tempest-ApplicationCredentialsV3Test-1010884817-project] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:50.342880 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54555365-b968-4654-8e30-940627c6513c tempest-ApplicationCredentialsV3Test-1010884817 tempest-ApplicationCredentialsV3Test-1010884817-project] PATH_INFO: `/v3/users/4eefebb908fd4df0a8e5e8e53ce140cd/application_credentials` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:50.343605 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54555365-b968-4654-8e30-940627c6513c tempest-ApplicationCredentialsV3Test-1010884817 tempest-ApplicationCredentialsV3Test-1010884817-project] RBAC: Authorizing `identity:create_application_credential(user_id=4eefebb908fd4df0a8e5e8e53ce140cd)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:50.344780 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54555365-b968-4654-8e30-940627c6513c tempest-ApplicationCredentialsV3Test-1010884817 tempest-ApplicationCredentialsV3Test-1010884817-project] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:50.347336 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4e5723-f262-4da0-bc7c-2ef467db4213 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:50.353170 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b027fb7-2ab0-4ec5-9728-ae449b127e3a tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6329fc7fa93c45b7be7350e34ad6bd1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5496ab260afb4aa4b58054dad376a5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:50.353836 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b027fb7-2ab0-4ec5-9728-ae449b127e3a tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:50.354146 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b027fb7-2ab0-4ec5-9728-ae449b127e3a tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:50.354429 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b027fb7-2ab0-4ec5-9728-ae449b127e3a tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:50.355114 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b027fb7-2ab0-4ec5-9728-ae449b127e3a tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:50.356960 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b027fb7-2ab0-4ec5-9728-ae449b127e3a tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:50.393040 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2855/5731] 10.222.0.17 () {60 vars in 1151 bytes} [Sat Jul 23 21:33:50 2022] POST /identity/v3/projects => generated 346 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:33:50.394588 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b027fb7-2ab0-4ec5-9728-ae449b127e3a tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:50.417127 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2877/5732] 10.222.0.17 () {60 vars in 1313 bytes} [Sat Jul 23 21:33:50 2022] POST /identity/v3/users/4eefebb908fd4df0a8e5e8e53ce140cd/application_credentials => generated 789 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:33:50.418404 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54555365-b968-4654-8e30-940627c6513c tempest-ApplicationCredentialsV3Test-1010884817 tempest-ApplicationCredentialsV3Test-1010884817-project] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:50.429318 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54555365-b968-4654-8e30-940627c6513c tempest-ApplicationCredentialsV3Test-1010884817 tempest-ApplicationCredentialsV3Test-1010884817-project] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:50.448690 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:33:50.463312 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b027fb7-2ab0-4ec5-9728-ae449b127e3a tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:50.469348 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84207ca-7e41-4e45-9619-605725092e85 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6329fc7fa93c45b7be7350e34ad6bd1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5496ab260afb4aa4b58054dad376a5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:50.470388 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84207ca-7e41-4e45-9619-605725092e85 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:50.471214 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84207ca-7e41-4e45-9619-605725092e85 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:50.471561 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84207ca-7e41-4e45-9619-605725092e85 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] PATH_INFO: `/v3/projects/3df07aa75fe94ef8b6961537b28a45a2` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:50.472913 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84207ca-7e41-4e45-9619-605725092e85 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] RBAC: Authorizing `identity:get_project(project_id=3df07aa75fe94ef8b6961537b28a45a2)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:50.474443 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:33:50.475375 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84207ca-7e41-4e45-9619-605725092e85 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:50.480858 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2856/5733] 10.222.0.17 () {58 vars in 1229 bytes} [Sat Jul 23 21:33:50 2022] GET /identity/v3/projects/3df07aa75fe94ef8b6961537b28a45a2 => generated 346 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:33:50.482082 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84207ca-7e41-4e45-9619-605725092e85 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:50.495264 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84207ca-7e41-4e45-9619-605725092e85 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:50.499875 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb9943c-7210-43d2-8c5e-1e5d1b35a160 tempest-ApplicationCredentialsV3Test-1010884817 tempest-ApplicationCredentialsV3Test-1010884817-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eefebb908fd4df0a8e5e8e53ce140cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6442eb45f7724798b21ae1c4dc11ddcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:50.500816 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb9943c-7210-43d2-8c5e-1e5d1b35a160 tempest-ApplicationCredentialsV3Test-1010884817 tempest-ApplicationCredentialsV3Test-1010884817-project] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:50.501095 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb9943c-7210-43d2-8c5e-1e5d1b35a160 tempest-ApplicationCredentialsV3Test-1010884817 tempest-ApplicationCredentialsV3Test-1010884817-project] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:50.501343 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3984a8-17ef-45b4-ae06-3429c240488f tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6329fc7fa93c45b7be7350e34ad6bd1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5496ab260afb4aa4b58054dad376a5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:50.501474 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb9943c-7210-43d2-8c5e-1e5d1b35a160 tempest-ApplicationCredentialsV3Test-1010884817 tempest-ApplicationCredentialsV3Test-1010884817-project] PATH_INFO: `/v3/users/4eefebb908fd4df0a8e5e8e53ce140cd/application_credentials` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:50.502190 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb9943c-7210-43d2-8c5e-1e5d1b35a160 tempest-ApplicationCredentialsV3Test-1010884817 tempest-ApplicationCredentialsV3Test-1010884817-project] RBAC: Authorizing `identity:create_application_credential(user_id=4eefebb908fd4df0a8e5e8e53ce140cd)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:50.502537 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3984a8-17ef-45b4-ae06-3429c240488f tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:50.502922 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3984a8-17ef-45b4-ae06-3429c240488f tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:50.503297 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3984a8-17ef-45b4-ae06-3429c240488f tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] PATH_INFO: `/v3/projects/3df07aa75fe94ef8b6961537b28a45a2` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:50.503461 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb9943c-7210-43d2-8c5e-1e5d1b35a160 tempest-ApplicationCredentialsV3Test-1010884817 tempest-ApplicationCredentialsV3Test-1010884817-project] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:50.504992 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3984a8-17ef-45b4-ae06-3429c240488f tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] RBAC: Authorizing `identity:delete_project(project_id=3df07aa75fe94ef8b6961537b28a45a2)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:50.507489 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3984a8-17ef-45b4-ae06-3429c240488f tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:50.564387 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-1e3984a8-17ef-45b4-ae06-3429c240488f tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3df07aa75fe94ef8b6961537b28a45a2', 'request_id': 'req-1e3984a8-17ef-45b4-ae06-3429c240488f'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:50.575593 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-1e3984a8-17ef-45b4-ae06-3429c240488f tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3df07aa75fe94ef8b6961537b28a45a2', 'request_id': 'req-1e3984a8-17ef-45b4-ae06-3429c240488f'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:50.581947 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-1e3984a8-17ef-45b4-ae06-3429c240488f tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3df07aa75fe94ef8b6961537b28a45a2', 'request_id': 'req-1e3984a8-17ef-45b4-ae06-3429c240488f'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:50.583776 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2878/5734] 10.222.0.17 () {60 vars in 1313 bytes} [Sat Jul 23 21:33:50 2022] POST /identity/v3/users/4eefebb908fd4df0a8e5e8e53ce140cd/application_credentials => generated 789 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:33:50.587806 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb9943c-7210-43d2-8c5e-1e5d1b35a160 tempest-ApplicationCredentialsV3Test-1010884817 tempest-ApplicationCredentialsV3Test-1010884817-project] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:50.594221 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-1e3984a8-17ef-45b4-ae06-3429c240488f tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] The token cache is being invalidate because project 3df07aa75fe94ef8b6961537b28a45a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:33:50.594537 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-1e3984a8-17ef-45b4-ae06-3429c240488f tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:50.595391 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-1e3984a8-17ef-45b4-ae06-3429c240488f tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:50.597433 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2857/5735] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:33:50 2022] DELETE /identity/v3/projects/3df07aa75fe94ef8b6961537b28a45a2 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:33:50.600765 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb9943c-7210-43d2-8c5e-1e5d1b35a160 tempest-ApplicationCredentialsV3Test-1010884817 tempest-ApplicationCredentialsV3Test-1010884817-project] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:50.606278 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3984a8-17ef-45b4-ae06-3429c240488f tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:50.607849 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-1e3984a8-17ef-45b4-ae06-3429c240488f tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:50.660801 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91833db9-7a3e-48f6-a5c7-8a982be36502 tempest-ApplicationCredentialsV3Test-1010884817 tempest-ApplicationCredentialsV3Test-1010884817-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eefebb908fd4df0a8e5e8e53ce140cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6442eb45f7724798b21ae1c4dc11ddcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:50.661847 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91833db9-7a3e-48f6-a5c7-8a982be36502 tempest-ApplicationCredentialsV3Test-1010884817 tempest-ApplicationCredentialsV3Test-1010884817-project] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:50.662651 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91833db9-7a3e-48f6-a5c7-8a982be36502 tempest-ApplicationCredentialsV3Test-1010884817 tempest-ApplicationCredentialsV3Test-1010884817-project] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:50.662651 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91833db9-7a3e-48f6-a5c7-8a982be36502 tempest-ApplicationCredentialsV3Test-1010884817 tempest-ApplicationCredentialsV3Test-1010884817-project] PATH_INFO: `/v3/users/4eefebb908fd4df0a8e5e8e53ce140cd/application_credentials` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:50.663129 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91833db9-7a3e-48f6-a5c7-8a982be36502 tempest-ApplicationCredentialsV3Test-1010884817 tempest-ApplicationCredentialsV3Test-1010884817-project] RBAC: Authorizing `identity:list_application_credentials(user_id=4eefebb908fd4df0a8e5e8e53ce140cd)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:50.664739 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91833db9-7a3e-48f6-a5c7-8a982be36502 tempest-ApplicationCredentialsV3Test-1010884817 tempest-ApplicationCredentialsV3Test-1010884817-project] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:50.677736 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2879/5736] 10.222.0.17 () {58 vars in 1292 bytes} [Sat Jul 23 21:33:50 2022] GET /identity/v3/users/4eefebb908fd4df0a8e5e8e53ce140cd/application_credentials => generated 1502 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 21:33:50.678780 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3984a8-17ef-45b4-ae06-3429c240488f tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:50.682027 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91833db9-7a3e-48f6-a5c7-8a982be36502 tempest-ApplicationCredentialsV3Test-1010884817 tempest-ApplicationCredentialsV3Test-1010884817-project] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:50.683555 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-91833db9-7a3e-48f6-a5c7-8a982be36502 tempest-ApplicationCredentialsV3Test-1010884817 tempest-ApplicationCredentialsV3Test-1010884817-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:50.684407 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eb49b6-2854-46be-b248-5cdac07c0de6 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6329fc7fa93c45b7be7350e34ad6bd1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5496ab260afb4aa4b58054dad376a5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:50.685163 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eb49b6-2854-46be-b248-5cdac07c0de6 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:50.685532 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eb49b6-2854-46be-b248-5cdac07c0de6 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:50.685889 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eb49b6-2854-46be-b248-5cdac07c0de6 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:50.686701 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45eb49b6-2854-46be-b248-5cdac07c0de6 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:50.688376 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45eb49b6-2854-46be-b248-5cdac07c0de6 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:50.696258 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91833db9-7a3e-48f6-a5c7-8a982be36502 tempest-ApplicationCredentialsV3Test-1010884817 tempest-ApplicationCredentialsV3Test-1010884817-project] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:50.701175 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc319035-26a1-4246-b3a7-c22257220a77 tempest-ApplicationCredentialsV3Test-1010884817 tempest-ApplicationCredentialsV3Test-1010884817-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eefebb908fd4df0a8e5e8e53ce140cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6442eb45f7724798b21ae1c4dc11ddcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:50.702213 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc319035-26a1-4246-b3a7-c22257220a77 tempest-ApplicationCredentialsV3Test-1010884817 tempest-ApplicationCredentialsV3Test-1010884817-project] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:50.702476 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc319035-26a1-4246-b3a7-c22257220a77 tempest-ApplicationCredentialsV3Test-1010884817 tempest-ApplicationCredentialsV3Test-1010884817-project] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:50.702750 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc319035-26a1-4246-b3a7-c22257220a77 tempest-ApplicationCredentialsV3Test-1010884817 tempest-ApplicationCredentialsV3Test-1010884817-project] PATH_INFO: `/v3/users/4eefebb908fd4df0a8e5e8e53ce140cd/application_credentials/a4f703a143e84f4c8ddabae3cecbd3b7` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:50.705034 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2858/5737] 10.222.0.17 () {60 vars in 1148 bytes} [Sat Jul 23 21:33:50 2022] POST /identity/v3/domains => generated 276 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:33:50.709286 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eb49b6-2854-46be-b248-5cdac07c0de6 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:50.712397 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc319035-26a1-4246-b3a7-c22257220a77 tempest-ApplicationCredentialsV3Test-1010884817 tempest-ApplicationCredentialsV3Test-1010884817-project] RBAC: Authorizing `identity:delete_application_credential(user_id=4eefebb908fd4df0a8e5e8e53ce140cd, application_credential_id=a4f703a143e84f4c8ddabae3cecbd3b7)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:50.713976 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc319035-26a1-4246-b3a7-c22257220a77 tempest-ApplicationCredentialsV3Test-1010884817 tempest-ApplicationCredentialsV3Test-1010884817-project] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:50.740308 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2880/5738] 10.222.0.17 () {58 vars in 1394 bytes} [Sat Jul 23 21:33:50 2022] DELETE /identity/v3/users/4eefebb908fd4df0a8e5e8e53ce140cd/application_credentials/a4f703a143e84f4c8ddabae3cecbd3b7 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:33:50.744576 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc319035-26a1-4246-b3a7-c22257220a77 tempest-ApplicationCredentialsV3Test-1010884817 tempest-ApplicationCredentialsV3Test-1010884817-project] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:50.756107 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc319035-26a1-4246-b3a7-c22257220a77 tempest-ApplicationCredentialsV3Test-1010884817 tempest-ApplicationCredentialsV3Test-1010884817-project] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:50.804236 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eb49b6-2854-46be-b248-5cdac07c0de6 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:50.810278 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2137f177-eff9-4ccb-be63-cb21a7eadaf0 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6329fc7fa93c45b7be7350e34ad6bd1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5496ab260afb4aa4b58054dad376a5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:50.811166 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2137f177-eff9-4ccb-be63-cb21a7eadaf0 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:50.811613 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2137f177-eff9-4ccb-be63-cb21a7eadaf0 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:50.812056 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2137f177-eff9-4ccb-be63-cb21a7eadaf0 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:50.812935 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2137f177-eff9-4ccb-be63-cb21a7eadaf0 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:50.823231 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2137f177-eff9-4ccb-be63-cb21a7eadaf0 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:50.827198 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:33:50.835795 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8553b68-6ef7-4cb9-8626-2b94feb4bca5 tempest-ApplicationCredentialsV3Test-1010884817 tempest-ApplicationCredentialsV3Test-1010884817-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eefebb908fd4df0a8e5e8e53ce140cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6442eb45f7724798b21ae1c4dc11ddcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:50.837300 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8553b68-6ef7-4cb9-8626-2b94feb4bca5 tempest-ApplicationCredentialsV3Test-1010884817 tempest-ApplicationCredentialsV3Test-1010884817-project] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:50.837651 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8553b68-6ef7-4cb9-8626-2b94feb4bca5 tempest-ApplicationCredentialsV3Test-1010884817 tempest-ApplicationCredentialsV3Test-1010884817-project] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:50.838032 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8553b68-6ef7-4cb9-8626-2b94feb4bca5 tempest-ApplicationCredentialsV3Test-1010884817 tempest-ApplicationCredentialsV3Test-1010884817-project] PATH_INFO: `/v3/users/4eefebb908fd4df0a8e5e8e53ce140cd/application_credentials/727dc1dbefad4e9690de78bd9f7e8ccd` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:50.847876 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8553b68-6ef7-4cb9-8626-2b94feb4bca5 tempest-ApplicationCredentialsV3Test-1010884817 tempest-ApplicationCredentialsV3Test-1010884817-project] RBAC: Authorizing `identity:delete_application_credential(user_id=4eefebb908fd4df0a8e5e8e53ce140cd, application_credential_id=727dc1dbefad4e9690de78bd9f7e8ccd)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:50.849547 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8553b68-6ef7-4cb9-8626-2b94feb4bca5 tempest-ApplicationCredentialsV3Test-1010884817 tempest-ApplicationCredentialsV3Test-1010884817-project] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:50.851240 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:33:50.874958 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2881/5739] 10.222.0.17 () {58 vars in 1394 bytes} [Sat Jul 23 21:33:50 2022] DELETE /identity/v3/users/4eefebb908fd4df0a8e5e8e53ce140cd/application_credentials/727dc1dbefad4e9690de78bd9f7e8ccd => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:33:50.880339 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8553b68-6ef7-4cb9-8626-2b94feb4bca5 tempest-ApplicationCredentialsV3Test-1010884817 tempest-ApplicationCredentialsV3Test-1010884817-project] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:50.881187 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2859/5740] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:33:50 2022] POST /identity/v3/projects => generated 405 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:33:50.885226 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2137f177-eff9-4ccb-be63-cb21a7eadaf0 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:50.892428 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8553b68-6ef7-4cb9-8626-2b94feb4bca5 tempest-ApplicationCredentialsV3Test-1010884817 tempest-ApplicationCredentialsV3Test-1010884817-project] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:50.945674 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a748c66d-14d9-422d-99ee-b077f6953d6e tempest-ApplicationCredentialsV3Test-1010884817 tempest-ApplicationCredentialsV3Test-1010884817-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eefebb908fd4df0a8e5e8e53ce140cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6442eb45f7724798b21ae1c4dc11ddcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:50.945913 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2137f177-eff9-4ccb-be63-cb21a7eadaf0 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:50.946520 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a748c66d-14d9-422d-99ee-b077f6953d6e tempest-ApplicationCredentialsV3Test-1010884817 tempest-ApplicationCredentialsV3Test-1010884817-project] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:50.946800 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a748c66d-14d9-422d-99ee-b077f6953d6e tempest-ApplicationCredentialsV3Test-1010884817 tempest-ApplicationCredentialsV3Test-1010884817-project] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:50.947073 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a748c66d-14d9-422d-99ee-b077f6953d6e tempest-ApplicationCredentialsV3Test-1010884817 tempest-ApplicationCredentialsV3Test-1010884817-project] PATH_INFO: `/v3/users/4eefebb908fd4df0a8e5e8e53ce140cd/application_credentials` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:50.947796 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a748c66d-14d9-422d-99ee-b077f6953d6e tempest-ApplicationCredentialsV3Test-1010884817 tempest-ApplicationCredentialsV3Test-1010884817-project] RBAC: Authorizing `identity:create_application_credential(user_id=4eefebb908fd4df0a8e5e8e53ce140cd)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:50.948935 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a748c66d-14d9-422d-99ee-b077f6953d6e tempest-ApplicationCredentialsV3Test-1010884817 tempest-ApplicationCredentialsV3Test-1010884817-project] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:50.951622 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9dffae-9ab8-44ba-8fc8-2a77f4a32136 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6329fc7fa93c45b7be7350e34ad6bd1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5496ab260afb4aa4b58054dad376a5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:50.952568 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9dffae-9ab8-44ba-8fc8-2a77f4a32136 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:50.952847 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9dffae-9ab8-44ba-8fc8-2a77f4a32136 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:50.953176 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9dffae-9ab8-44ba-8fc8-2a77f4a32136 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] PATH_INFO: `/v3/projects/007822e31e354443bacbda63298aa7dc` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:50.954523 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9dffae-9ab8-44ba-8fc8-2a77f4a32136 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] RBAC: Authorizing `identity:get_project(project_id=007822e31e354443bacbda63298aa7dc)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:50.956616 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9dffae-9ab8-44ba-8fc8-2a77f4a32136 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:50.958420 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2860/5741] 10.222.0.17 () {58 vars in 1229 bytes} [Sat Jul 23 21:33:50 2022] GET /identity/v3/projects/007822e31e354443bacbda63298aa7dc => generated 405 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 21:33:50.962653 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9dffae-9ab8-44ba-8fc8-2a77f4a32136 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:50.972919 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9dffae-9ab8-44ba-8fc8-2a77f4a32136 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:50.978785 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aab975b-0a7b-4c9a-8131-57974e501574 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6329fc7fa93c45b7be7350e34ad6bd1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5496ab260afb4aa4b58054dad376a5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:50.979680 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aab975b-0a7b-4c9a-8131-57974e501574 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:50.979967 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aab975b-0a7b-4c9a-8131-57974e501574 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:50.980272 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aab975b-0a7b-4c9a-8131-57974e501574 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] PATH_INFO: `/v3/projects/007822e31e354443bacbda63298aa7dc` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:50.981486 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aab975b-0a7b-4c9a-8131-57974e501574 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] RBAC: Authorizing `identity:delete_project(project_id=007822e31e354443bacbda63298aa7dc)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:50.983411 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aab975b-0a7b-4c9a-8131-57974e501574 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:51.019636 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2882/5742] 10.222.0.17 () {60 vars in 1313 bytes} [Sat Jul 23 21:33:50 2022] POST /identity/v3/users/4eefebb908fd4df0a8e5e8e53ce140cd/application_credentials => generated 787 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:33:51.023672 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a748c66d-14d9-422d-99ee-b077f6953d6e tempest-ApplicationCredentialsV3Test-1010884817 tempest-ApplicationCredentialsV3Test-1010884817-project] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:51.032463 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-3aab975b-0a7b-4c9a-8131-57974e501574 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '007822e31e354443bacbda63298aa7dc', 'request_id': 'req-3aab975b-0a7b-4c9a-8131-57974e501574'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:51.032986 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a748c66d-14d9-422d-99ee-b077f6953d6e tempest-ApplicationCredentialsV3Test-1010884817 tempest-ApplicationCredentialsV3Test-1010884817-project] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:51.040148 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-3aab975b-0a7b-4c9a-8131-57974e501574 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '007822e31e354443bacbda63298aa7dc', 'request_id': 'req-3aab975b-0a7b-4c9a-8131-57974e501574'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:51.045996 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-3aab975b-0a7b-4c9a-8131-57974e501574 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '007822e31e354443bacbda63298aa7dc', 'request_id': 'req-3aab975b-0a7b-4c9a-8131-57974e501574'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:51.057009 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-3aab975b-0a7b-4c9a-8131-57974e501574 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] The token cache is being invalidate because project 007822e31e354443bacbda63298aa7dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:33:51.057296 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-3aab975b-0a7b-4c9a-8131-57974e501574 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:51.057978 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-3aab975b-0a7b-4c9a-8131-57974e501574 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:51.059594 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2861/5743] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:33:50 2022] DELETE /identity/v3/projects/007822e31e354443bacbda63298aa7dc => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:33:51.063828 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aab975b-0a7b-4c9a-8131-57974e501574 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:51.065180 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-3aab975b-0a7b-4c9a-8131-57974e501574 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:51.089877 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dd639f-6fa8-4bcb-9b9a-85625bc8de68 tempest-ApplicationCredentialsV3Test-1010884817 tempest-ApplicationCredentialsV3Test-1010884817-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eefebb908fd4df0a8e5e8e53ce140cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6442eb45f7724798b21ae1c4dc11ddcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:51.090786 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dd639f-6fa8-4bcb-9b9a-85625bc8de68 tempest-ApplicationCredentialsV3Test-1010884817 tempest-ApplicationCredentialsV3Test-1010884817-project] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:51.091066 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dd639f-6fa8-4bcb-9b9a-85625bc8de68 tempest-ApplicationCredentialsV3Test-1010884817 tempest-ApplicationCredentialsV3Test-1010884817-project] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:51.091337 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dd639f-6fa8-4bcb-9b9a-85625bc8de68 tempest-ApplicationCredentialsV3Test-1010884817 tempest-ApplicationCredentialsV3Test-1010884817-project] PATH_INFO: `/v3/users/4eefebb908fd4df0a8e5e8e53ce140cd/application_credentials` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:51.092067 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dd639f-6fa8-4bcb-9b9a-85625bc8de68 tempest-ApplicationCredentialsV3Test-1010884817 tempest-ApplicationCredentialsV3Test-1010884817-project] RBAC: Authorizing `identity:create_application_credential(user_id=4eefebb908fd4df0a8e5e8e53ce140cd)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:51.093206 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dd639f-6fa8-4bcb-9b9a-85625bc8de68 tempest-ApplicationCredentialsV3Test-1010884817 tempest-ApplicationCredentialsV3Test-1010884817-project] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:51.119008 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:33:51.132280 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aab975b-0a7b-4c9a-8131-57974e501574 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:51.137186 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08481d4-b111-497b-bf3c-6b26fc0a9d88 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6329fc7fa93c45b7be7350e34ad6bd1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5496ab260afb4aa4b58054dad376a5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:51.138176 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08481d4-b111-497b-bf3c-6b26fc0a9d88 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:51.138462 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08481d4-b111-497b-bf3c-6b26fc0a9d88 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:51.138845 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08481d4-b111-497b-bf3c-6b26fc0a9d88 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] PATH_INFO: `/v3/domains/f8656ec7dfa74f86b43193fa659fdc14` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:51.140281 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08481d4-b111-497b-bf3c-6b26fc0a9d88 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=f8656ec7dfa74f86b43193fa659fdc14)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:51.142183 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08481d4-b111-497b-bf3c-6b26fc0a9d88 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:51.159221 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:33:51.163290 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-d08481d4-b111-497b-bf3c-6b26fc0a9d88 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'f8656ec7dfa74f86b43193fa659fdc14'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:51.164408 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-d08481d4-b111-497b-bf3c-6b26fc0a9d88 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'f8656ec7dfa74f86b43193fa659fdc14'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:51.164563 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2883/5744] 10.222.0.17 () {60 vars in 1313 bytes} [Sat Jul 23 21:33:51 2022] POST /identity/v3/users/4eefebb908fd4df0a8e5e8e53ce140cd/application_credentials => generated 788 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:33:51.168897 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dd639f-6fa8-4bcb-9b9a-85625bc8de68 tempest-ApplicationCredentialsV3Test-1010884817 tempest-ApplicationCredentialsV3Test-1010884817-project] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:51.170744 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-31dd639f-6fa8-4bcb-9b9a-85625bc8de68 tempest-ApplicationCredentialsV3Test-1010884817 tempest-ApplicationCredentialsV3Test-1010884817-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:51.182018 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dd639f-6fa8-4bcb-9b9a-85625bc8de68 tempest-ApplicationCredentialsV3Test-1010884817 tempest-ApplicationCredentialsV3Test-1010884817-project] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:51.191888 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-d08481d4-b111-497b-bf3c-6b26fc0a9d88 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'f8656ec7dfa74f86b43193fa659fdc14'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:51.192625 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-d08481d4-b111-497b-bf3c-6b26fc0a9d88 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'f8656ec7dfa74f86b43193fa659fdc14'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:51.198019 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2862/5745] 10.222.0.17 () {60 vars in 1248 bytes} [Sat Jul 23 21:33:51 2022] PATCH /identity/v3/domains/f8656ec7dfa74f86b43193fa659fdc14 => generated 277 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 21:33:51.200014 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08481d4-b111-497b-bf3c-6b26fc0a9d88 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:51.202611 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-d08481d4-b111-497b-bf3c-6b26fc0a9d88 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:51.238332 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6105ac75-47fb-4db6-b6b0-c408ebb9d720 tempest-ApplicationCredentialsV3Test-1010884817 tempest-ApplicationCredentialsV3Test-1010884817-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eefebb908fd4df0a8e5e8e53ce140cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6442eb45f7724798b21ae1c4dc11ddcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:51.239342 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6105ac75-47fb-4db6-b6b0-c408ebb9d720 tempest-ApplicationCredentialsV3Test-1010884817 tempest-ApplicationCredentialsV3Test-1010884817-project] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:51.239625 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6105ac75-47fb-4db6-b6b0-c408ebb9d720 tempest-ApplicationCredentialsV3Test-1010884817 tempest-ApplicationCredentialsV3Test-1010884817-project] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:51.239892 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6105ac75-47fb-4db6-b6b0-c408ebb9d720 tempest-ApplicationCredentialsV3Test-1010884817 tempest-ApplicationCredentialsV3Test-1010884817-project] PATH_INFO: `/v3/users/4eefebb908fd4df0a8e5e8e53ce140cd/application_credentials` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:51.240593 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6105ac75-47fb-4db6-b6b0-c408ebb9d720 tempest-ApplicationCredentialsV3Test-1010884817 tempest-ApplicationCredentialsV3Test-1010884817-project] RBAC: Adding query filter params (name=tempest-application_credential-928030796) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:33:51.240990 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6105ac75-47fb-4db6-b6b0-c408ebb9d720 tempest-ApplicationCredentialsV3Test-1010884817 tempest-ApplicationCredentialsV3Test-1010884817-project] RBAC: Authorizing `identity:list_application_credentials(user_id=4eefebb908fd4df0a8e5e8e53ce140cd)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:51.242675 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6105ac75-47fb-4db6-b6b0-c408ebb9d720 tempest-ApplicationCredentialsV3Test-1010884817 tempest-ApplicationCredentialsV3Test-1010884817-project] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:51.256335 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2884/5746] 10.222.0.17 () {58 vars in 1383 bytes} [Sat Jul 23 21:33:51 2022] GET /identity/v3/users/4eefebb908fd4df0a8e5e8e53ce140cd/application_credentials?name=tempest-application_credential-928030796 => generated 885 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 21:33:51.257492 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6105ac75-47fb-4db6-b6b0-c408ebb9d720 tempest-ApplicationCredentialsV3Test-1010884817 tempest-ApplicationCredentialsV3Test-1010884817-project] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:51.259251 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-6105ac75-47fb-4db6-b6b0-c408ebb9d720 tempest-ApplicationCredentialsV3Test-1010884817 tempest-ApplicationCredentialsV3Test-1010884817-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:51.268979 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08481d4-b111-497b-bf3c-6b26fc0a9d88 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:51.270900 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6105ac75-47fb-4db6-b6b0-c408ebb9d720 tempest-ApplicationCredentialsV3Test-1010884817 tempest-ApplicationCredentialsV3Test-1010884817-project] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:51.274664 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcca2f14-678a-4d98-b65c-13b19a5ce323 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6329fc7fa93c45b7be7350e34ad6bd1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5496ab260afb4aa4b58054dad376a5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:51.275092 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c9d21d-7251-4967-95f2-1aad770a59f0 tempest-ApplicationCredentialsV3Test-1010884817 tempest-ApplicationCredentialsV3Test-1010884817-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eefebb908fd4df0a8e5e8e53ce140cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6442eb45f7724798b21ae1c4dc11ddcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:51.275566 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcca2f14-678a-4d98-b65c-13b19a5ce323 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:51.275854 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcca2f14-678a-4d98-b65c-13b19a5ce323 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:51.276068 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c9d21d-7251-4967-95f2-1aad770a59f0 tempest-ApplicationCredentialsV3Test-1010884817 tempest-ApplicationCredentialsV3Test-1010884817-project] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:51.276190 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcca2f14-678a-4d98-b65c-13b19a5ce323 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] PATH_INFO: `/v3/domains/f8656ec7dfa74f86b43193fa659fdc14` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:51.276349 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c9d21d-7251-4967-95f2-1aad770a59f0 tempest-ApplicationCredentialsV3Test-1010884817 tempest-ApplicationCredentialsV3Test-1010884817-project] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:51.276675 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c9d21d-7251-4967-95f2-1aad770a59f0 tempest-ApplicationCredentialsV3Test-1010884817 tempest-ApplicationCredentialsV3Test-1010884817-project] PATH_INFO: `/v3/users/4eefebb908fd4df0a8e5e8e53ce140cd/application_credentials/872aeef5544740859fdd610c60edf3b6` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:51.285040 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c9d21d-7251-4967-95f2-1aad770a59f0 tempest-ApplicationCredentialsV3Test-1010884817 tempest-ApplicationCredentialsV3Test-1010884817-project] RBAC: Authorizing `identity:delete_application_credential(user_id=4eefebb908fd4df0a8e5e8e53ce140cd, application_credential_id=872aeef5544740859fdd610c60edf3b6)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:51.286569 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c9d21d-7251-4967-95f2-1aad770a59f0 tempest-ApplicationCredentialsV3Test-1010884817 tempest-ApplicationCredentialsV3Test-1010884817-project] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:51.287164 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcca2f14-678a-4d98-b65c-13b19a5ce323 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=f8656ec7dfa74f86b43193fa659fdc14)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:51.288818 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcca2f14-678a-4d98-b65c-13b19a5ce323 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:51.309374 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2885/5747] 10.222.0.17 () {58 vars in 1394 bytes} [Sat Jul 23 21:33:51 2022] DELETE /identity/v3/users/4eefebb908fd4df0a8e5e8e53ce140cd/application_credentials/872aeef5544740859fdd610c60edf3b6 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:33:51.313212 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-dcca2f14-678a-4d98-b65c-13b19a5ce323 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'f8656ec7dfa74f86b43193fa659fdc14'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:51.314109 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c9d21d-7251-4967-95f2-1aad770a59f0 tempest-ApplicationCredentialsV3Test-1010884817 tempest-ApplicationCredentialsV3Test-1010884817-project] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:51.323449 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-dcca2f14-678a-4d98-b65c-13b19a5ce323 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'f8656ec7dfa74f86b43193fa659fdc14'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:51.323893 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c9d21d-7251-4967-95f2-1aad770a59f0 tempest-ApplicationCredentialsV3Test-1010884817 tempest-ApplicationCredentialsV3Test-1010884817-project] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:51.328512 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29395c9a-ef5a-441f-ac3b-da2158d09adb tempest-ApplicationCredentialsV3Test-1010884817 tempest-ApplicationCredentialsV3Test-1010884817-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eefebb908fd4df0a8e5e8e53ce140cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6442eb45f7724798b21ae1c4dc11ddcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:51.329448 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29395c9a-ef5a-441f-ac3b-da2158d09adb tempest-ApplicationCredentialsV3Test-1010884817 tempest-ApplicationCredentialsV3Test-1010884817-project] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:51.329726 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29395c9a-ef5a-441f-ac3b-da2158d09adb tempest-ApplicationCredentialsV3Test-1010884817 tempest-ApplicationCredentialsV3Test-1010884817-project] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:51.330036 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29395c9a-ef5a-441f-ac3b-da2158d09adb tempest-ApplicationCredentialsV3Test-1010884817 tempest-ApplicationCredentialsV3Test-1010884817-project] PATH_INFO: `/v3/users/4eefebb908fd4df0a8e5e8e53ce140cd/application_credentials/8f35c70038b54022a0a30b625eb3bbf4` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:51.338529 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29395c9a-ef5a-441f-ac3b-da2158d09adb tempest-ApplicationCredentialsV3Test-1010884817 tempest-ApplicationCredentialsV3Test-1010884817-project] RBAC: Authorizing `identity:delete_application_credential(user_id=4eefebb908fd4df0a8e5e8e53ce140cd, application_credential_id=8f35c70038b54022a0a30b625eb3bbf4)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:51.340046 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29395c9a-ef5a-441f-ac3b-da2158d09adb tempest-ApplicationCredentialsV3Test-1010884817 tempest-ApplicationCredentialsV3Test-1010884817-project] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:51.358594 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2886/5748] 10.222.0.17 () {58 vars in 1394 bytes} [Sat Jul 23 21:33:51 2022] DELETE /identity/v3/users/4eefebb908fd4df0a8e5e8e53ce140cd/application_credentials/8f35c70038b54022a0a30b625eb3bbf4 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:33:51.363515 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29395c9a-ef5a-441f-ac3b-da2158d09adb tempest-ApplicationCredentialsV3Test-1010884817 tempest-ApplicationCredentialsV3Test-1010884817-project] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:51.365117 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-29395c9a-ef5a-441f-ac3b-da2158d09adb tempest-ApplicationCredentialsV3Test-1010884817 tempest-ApplicationCredentialsV3Test-1010884817-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:51.367818 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-dcca2f14-678a-4d98-b65c-13b19a5ce323 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8656ec7dfa74f86b43193fa659fdc14', 'request_id': 'req-dcca2f14-678a-4d98-b65c-13b19a5ce323'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:51.375831 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-dcca2f14-678a-4d98-b65c-13b19a5ce323 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8656ec7dfa74f86b43193fa659fdc14', 'request_id': 'req-dcca2f14-678a-4d98-b65c-13b19a5ce323'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:51.381526 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-dcca2f14-678a-4d98-b65c-13b19a5ce323 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8656ec7dfa74f86b43193fa659fdc14', 'request_id': 'req-dcca2f14-678a-4d98-b65c-13b19a5ce323'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:51.392965 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-dcca2f14-678a-4d98-b65c-13b19a5ce323 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] The token cache is being invalidate because project f8656ec7dfa74f86b43193fa659fdc14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:33:51.393247 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-dcca2f14-678a-4d98-b65c-13b19a5ce323 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:51.393911 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-dcca2f14-678a-4d98-b65c-13b19a5ce323 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:51.402231 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-dcca2f14-678a-4d98-b65c-13b19a5ce323 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'f8656ec7dfa74f86b43193fa659fdc14', 'request_id': 'req-dcca2f14-678a-4d98-b65c-13b19a5ce323'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:51.402892 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-dcca2f14-678a-4d98-b65c-13b19a5ce323 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'f8656ec7dfa74f86b43193fa659fdc14', 'request_id': 'req-dcca2f14-678a-4d98-b65c-13b19a5ce323'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:51.406494 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-dcca2f14-678a-4d98-b65c-13b19a5ce323 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'f8656ec7dfa74f86b43193fa659fdc14', 'request_id': 'req-dcca2f14-678a-4d98-b65c-13b19a5ce323'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:51.412522 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2863/5749] 10.222.0.17 () {58 vars in 1229 bytes} [Sat Jul 23 21:33:51 2022] DELETE /identity/v3/domains/f8656ec7dfa74f86b43193fa659fdc14 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:33:51.417481 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcca2f14-678a-4d98-b65c-13b19a5ce323 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:51.419015 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-dcca2f14-678a-4d98-b65c-13b19a5ce323 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:51.434145 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29395c9a-ef5a-441f-ac3b-da2158d09adb tempest-ApplicationCredentialsV3Test-1010884817 tempest-ApplicationCredentialsV3Test-1010884817-project] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:51.439406 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=87,keystone:UPDATE=1,keystone:DELETE=11,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:33:51.439579 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:33:51.490273 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcca2f14-678a-4d98-b65c-13b19a5ce323 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:51.492891 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74093db0-e8b8-401e-ba84-abdb02551b3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:51.493789 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74093db0-e8b8-401e-ba84-abdb02551b3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:51.494578 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74093db0-e8b8-401e-ba84-abdb02551b3d admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:51.494857 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74093db0-e8b8-401e-ba84-abdb02551b3d admin admin] PATH_INFO: `/v3/users/4eefebb908fd4df0a8e5e8e53ce140cd` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:51.495152 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c8bcd8-2573-4425-8225-fdfdeb37624e tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6329fc7fa93c45b7be7350e34ad6bd1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5496ab260afb4aa4b58054dad376a5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:51.495877 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c8bcd8-2573-4425-8225-fdfdeb37624e tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:51.496053 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74093db0-e8b8-401e-ba84-abdb02551b3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=4eefebb908fd4df0a8e5e8e53ce140cd)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:51.496183 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c8bcd8-2573-4425-8225-fdfdeb37624e tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:51.496435 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c8bcd8-2573-4425-8225-fdfdeb37624e tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:51.497170 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c8bcd8-2573-4425-8225-fdfdeb37624e tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:51.498008 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74093db0-e8b8-401e-ba84-abdb02551b3d admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:51.498812 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c8bcd8-2573-4425-8225-fdfdeb37624e tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:51.517550 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2864/5750] 10.222.0.17 () {60 vars in 1148 bytes} [Sat Jul 23 21:33:51 2022] POST /identity/v3/domains => generated 277 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:33:51.518763 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c8bcd8-2573-4425-8225-fdfdeb37624e tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:51.547721 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-74093db0-e8b8-401e-ba84-abdb02551b3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4eefebb908fd4df0a8e5e8e53ce140cd'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:51.548531 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-74093db0-e8b8-401e-ba84-abdb02551b3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4eefebb908fd4df0a8e5e8e53ce140cd'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:51.555778 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-74093db0-e8b8-401e-ba84-abdb02551b3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4eefebb908fd4df0a8e5e8e53ce140cd'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:51.563427 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-74093db0-e8b8-401e-ba84-abdb02551b3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4eefebb908fd4df0a8e5e8e53ce140cd'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:51.583063 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c8bcd8-2573-4425-8225-fdfdeb37624e tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:51.584916 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-74093db0-e8b8-401e-ba84-abdb02551b3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4eefebb908fd4df0a8e5e8e53ce140cd'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:51.587982 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d25dca-8821-485f-9e98-99083dd1e184 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6329fc7fa93c45b7be7350e34ad6bd1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5496ab260afb4aa4b58054dad376a5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:51.588652 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d25dca-8821-485f-9e98-99083dd1e184 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:51.588942 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d25dca-8821-485f-9e98-99083dd1e184 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:51.589219 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d25dca-8821-485f-9e98-99083dd1e184 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:51.589942 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d25dca-8821-485f-9e98-99083dd1e184 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:51.591388 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2887/5751] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:33:51 2022] DELETE /identity/v3/users/4eefebb908fd4df0a8e5e8e53ce140cd => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:33:51.591859 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d25dca-8821-485f-9e98-99083dd1e184 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:51.595738 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62299446-f610-48eb-bf47-22693fa12593 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:51.596024 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62299446-f610-48eb-bf47-22693fa12593 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:51.596328 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62299446-f610-48eb-bf47-22693fa12593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:51.614180 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-62299446-f610-48eb-bf47-22693fa12593 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:33:51.615385 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-62299446-f610-48eb-bf47-22693fa12593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:51.632265 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2865/5752] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:33:51 2022] POST /identity/v3/projects => generated 408 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:33:51.633242 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d25dca-8821-485f-9e98-99083dd1e184 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:51.634944 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-28d25dca-8821-485f-9e98-99083dd1e184 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:51.674524 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2888/5753] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:33:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:33:51.684625 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62299446-f610-48eb-bf47-22693fa12593 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:51.686138 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-62299446-f610-48eb-bf47-22693fa12593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:51.702773 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d25dca-8821-485f-9e98-99083dd1e184 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:51.708998 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ba3372-b0e4-4f1f-88f5-85d7d9bf58ae tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6329fc7fa93c45b7be7350e34ad6bd1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5496ab260afb4aa4b58054dad376a5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:51.709780 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ba3372-b0e4-4f1f-88f5-85d7d9bf58ae tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:51.710369 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ba3372-b0e4-4f1f-88f5-85d7d9bf58ae tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:51.710645 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ba3372-b0e4-4f1f-88f5-85d7d9bf58ae tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:51.711357 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ba3372-b0e4-4f1f-88f5-85d7d9bf58ae tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:51.713280 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ba3372-b0e4-4f1f-88f5-85d7d9bf58ae tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:51.714249 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:33:51.749664 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62299446-f610-48eb-bf47-22693fa12593 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:51.754482 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2866/5754] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:33:51 2022] POST /identity/v3/projects => generated 402 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:33:51.755518 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ba3372-b0e4-4f1f-88f5-85d7d9bf58ae tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:51.761854 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:33:51.801022 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683e8004-7863-45ac-86ae-27744b31dfb6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:51.801713 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683e8004-7863-45ac-86ae-27744b31dfb6 service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:51.802029 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683e8004-7863-45ac-86ae-27744b31dfb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:51.802309 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683e8004-7863-45ac-86ae-27744b31dfb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:51.823275 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ba3372-b0e4-4f1f-88f5-85d7d9bf58ae tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:51.830357 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6140f3-4124-4dba-ba58-882d1d7c32d0 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6329fc7fa93c45b7be7350e34ad6bd1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5496ab260afb4aa4b58054dad376a5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:51.832022 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6140f3-4124-4dba-ba58-882d1d7c32d0 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:51.832213 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6140f3-4124-4dba-ba58-882d1d7c32d0 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:51.832510 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6140f3-4124-4dba-ba58-882d1d7c32d0 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] PATH_INFO: `/v3/projects/4d180c00907e4d5895ade5bfb086f42a` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:51.834308 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6140f3-4124-4dba-ba58-882d1d7c32d0 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] RBAC: Authorizing `identity:delete_project(project_id=4d180c00907e4d5895ade5bfb086f42a)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:51.836450 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6140f3-4124-4dba-ba58-882d1d7c32d0 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:51.877366 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683e8004-7863-45ac-86ae-27744b31dfb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:51.879000 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683e8004-7863-45ac-86ae-27744b31dfb6 service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:51.889787 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-6d6140f3-4124-4dba-ba58-882d1d7c32d0 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d180c00907e4d5895ade5bfb086f42a', 'request_id': 'req-6d6140f3-4124-4dba-ba58-882d1d7c32d0'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:51.890057 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2889/5755] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:33:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 23 21:33:51.901879 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-6d6140f3-4124-4dba-ba58-882d1d7c32d0 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d180c00907e4d5895ade5bfb086f42a', 'request_id': 'req-6d6140f3-4124-4dba-ba58-882d1d7c32d0'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:51.908530 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-6d6140f3-4124-4dba-ba58-882d1d7c32d0 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d180c00907e4d5895ade5bfb086f42a', 'request_id': 'req-6d6140f3-4124-4dba-ba58-882d1d7c32d0'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:51.921938 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-6d6140f3-4124-4dba-ba58-882d1d7c32d0 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] The token cache is being invalidate because project 4d180c00907e4d5895ade5bfb086f42a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:33:51.922492 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-6d6140f3-4124-4dba-ba58-882d1d7c32d0 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:51.924416 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-6d6140f3-4124-4dba-ba58-882d1d7c32d0 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:51.931002 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2867/5756] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:33:51 2022] DELETE /identity/v3/projects/4d180c00907e4d5895ade5bfb086f42a => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:33:51.931680 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683e8004-7863-45ac-86ae-27744b31dfb6 service neutron] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:51.942868 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683e8004-7863-45ac-86ae-27744b31dfb6 service neutron] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:52.021444 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e65c52-da81-4d7a-9f83-564777a9c2ff tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6329fc7fa93c45b7be7350e34ad6bd1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5496ab260afb4aa4b58054dad376a5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:52.022504 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e65c52-da81-4d7a-9f83-564777a9c2ff tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:52.022849 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e65c52-da81-4d7a-9f83-564777a9c2ff tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:52.023132 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e65c52-da81-4d7a-9f83-564777a9c2ff tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] PATH_INFO: `/v3/projects/d60b0e96d38f447da9f4e0cc070b66c7` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:52.024592 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e65c52-da81-4d7a-9f83-564777a9c2ff tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] RBAC: Authorizing `identity:delete_project(project_id=d60b0e96d38f447da9f4e0cc070b66c7)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:52.026730 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e65c52-da81-4d7a-9f83-564777a9c2ff tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:52.074119 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:33:52.088421 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-68e65c52-da81-4d7a-9f83-564777a9c2ff tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd60b0e96d38f447da9f4e0cc070b66c7', 'request_id': 'req-68e65c52-da81-4d7a-9f83-564777a9c2ff'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:52.096587 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-68e65c52-da81-4d7a-9f83-564777a9c2ff tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd60b0e96d38f447da9f4e0cc070b66c7', 'request_id': 'req-68e65c52-da81-4d7a-9f83-564777a9c2ff'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:52.104806 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-68e65c52-da81-4d7a-9f83-564777a9c2ff tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd60b0e96d38f447da9f4e0cc070b66c7', 'request_id': 'req-68e65c52-da81-4d7a-9f83-564777a9c2ff'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:52.119246 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-68e65c52-da81-4d7a-9f83-564777a9c2ff tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] The token cache is being invalidate because project d60b0e96d38f447da9f4e0cc070b66c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:33:52.119670 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-68e65c52-da81-4d7a-9f83-564777a9c2ff tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:52.120402 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-68e65c52-da81-4d7a-9f83-564777a9c2ff tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:52.122259 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2890/5757] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:33:51 2022] DELETE /identity/v3/projects/d60b0e96d38f447da9f4e0cc070b66c7 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:33:52.126383 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6140f3-4124-4dba-ba58-882d1d7c32d0 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:52.128551 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-6d6140f3-4124-4dba-ba58-882d1d7c32d0 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:52.141609 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6140f3-4124-4dba-ba58-882d1d7c32d0 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:52.202059 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de2966d-608b-40ed-b182-99e2566456dc tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6329fc7fa93c45b7be7350e34ad6bd1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5496ab260afb4aa4b58054dad376a5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:52.203591 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de2966d-608b-40ed-b182-99e2566456dc tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:52.203591 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de2966d-608b-40ed-b182-99e2566456dc tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:52.203591 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de2966d-608b-40ed-b182-99e2566456dc tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] PATH_INFO: `/v3/domains/d4c451efc2444ced89e6243c23782590` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:52.205388 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de2966d-608b-40ed-b182-99e2566456dc tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=d4c451efc2444ced89e6243c23782590)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:52.206920 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de2966d-608b-40ed-b182-99e2566456dc tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:52.230091 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-3de2966d-608b-40ed-b182-99e2566456dc tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'd4c451efc2444ced89e6243c23782590'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:52.230692 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-3de2966d-608b-40ed-b182-99e2566456dc tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'd4c451efc2444ced89e6243c23782590'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:52.262320 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:33:52.266915 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-3de2966d-608b-40ed-b182-99e2566456dc tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'd4c451efc2444ced89e6243c23782590'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:52.267458 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-3de2966d-608b-40ed-b182-99e2566456dc tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'd4c451efc2444ced89e6243c23782590'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:52.274533 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2868/5758] 10.222.0.17 () {60 vars in 1248 bytes} [Sat Jul 23 21:33:52 2022] PATCH /identity/v3/domains/d4c451efc2444ced89e6243c23782590 => generated 278 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:33:52.275362 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e65c52-da81-4d7a-9f83-564777a9c2ff tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:52.277230 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-68e65c52-da81-4d7a-9f83-564777a9c2ff tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:52.292385 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e65c52-da81-4d7a-9f83-564777a9c2ff tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:52.364138 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de2966d-608b-40ed-b182-99e2566456dc tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:52.367529 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-3de2966d-608b-40ed-b182-99e2566456dc tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:52.378422 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec01ad7-9a75-47b8-bf35-06ca1eb942e0 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6329fc7fa93c45b7be7350e34ad6bd1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5496ab260afb4aa4b58054dad376a5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:52.379450 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec01ad7-9a75-47b8-bf35-06ca1eb942e0 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:52.379740 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec01ad7-9a75-47b8-bf35-06ca1eb942e0 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:52.380016 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec01ad7-9a75-47b8-bf35-06ca1eb942e0 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] PATH_INFO: `/v3/domains/d4c451efc2444ced89e6243c23782590` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:52.393646 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec01ad7-9a75-47b8-bf35-06ca1eb942e0 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=d4c451efc2444ced89e6243c23782590)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:52.395540 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec01ad7-9a75-47b8-bf35-06ca1eb942e0 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:52.424374 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-eec01ad7-9a75-47b8-bf35-06ca1eb942e0 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'd4c451efc2444ced89e6243c23782590'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:52.436347 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-eec01ad7-9a75-47b8-bf35-06ca1eb942e0 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'd4c451efc2444ced89e6243c23782590'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:52.453197 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de2966d-608b-40ed-b182-99e2566456dc tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:52.459934 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cce97f-3448-41a2-936e-1005132da1f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:52.460983 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cce97f-3448-41a2-936e-1005132da1f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:52.461404 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cce97f-3448-41a2-936e-1005132da1f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:52.461656 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cce97f-3448-41a2-936e-1005132da1f1 admin admin] PATH_INFO: `/v3/projects/6442eb45f7724798b21ae1c4dc11ddcd` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:52.463490 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cce97f-3448-41a2-936e-1005132da1f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6442eb45f7724798b21ae1c4dc11ddcd)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:52.465481 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cce97f-3448-41a2-936e-1005132da1f1 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:52.485725 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-eec01ad7-9a75-47b8-bf35-06ca1eb942e0 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4c451efc2444ced89e6243c23782590', 'request_id': 'req-eec01ad7-9a75-47b8-bf35-06ca1eb942e0'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:52.496226 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-eec01ad7-9a75-47b8-bf35-06ca1eb942e0 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4c451efc2444ced89e6243c23782590', 'request_id': 'req-eec01ad7-9a75-47b8-bf35-06ca1eb942e0'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:52.504385 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-eec01ad7-9a75-47b8-bf35-06ca1eb942e0 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4c451efc2444ced89e6243c23782590', 'request_id': 'req-eec01ad7-9a75-47b8-bf35-06ca1eb942e0'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:52.518305 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-d6cce97f-3448-41a2-936e-1005132da1f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6442eb45f7724798b21ae1c4dc11ddcd', 'request_id': 'req-d6cce97f-3448-41a2-936e-1005132da1f1'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:52.519526 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-eec01ad7-9a75-47b8-bf35-06ca1eb942e0 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] The token cache is being invalidate because project d4c451efc2444ced89e6243c23782590 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:33:52.519808 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-eec01ad7-9a75-47b8-bf35-06ca1eb942e0 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:52.520687 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-eec01ad7-9a75-47b8-bf35-06ca1eb942e0 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:52.527420 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-d6cce97f-3448-41a2-936e-1005132da1f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6442eb45f7724798b21ae1c4dc11ddcd', 'request_id': 'req-d6cce97f-3448-41a2-936e-1005132da1f1'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:52.533946 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-d6cce97f-3448-41a2-936e-1005132da1f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6442eb45f7724798b21ae1c4dc11ddcd', 'request_id': 'req-d6cce97f-3448-41a2-936e-1005132da1f1'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:52.534152 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-eec01ad7-9a75-47b8-bf35-06ca1eb942e0 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'd4c451efc2444ced89e6243c23782590', 'request_id': 'req-eec01ad7-9a75-47b8-bf35-06ca1eb942e0'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:52.538711 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-eec01ad7-9a75-47b8-bf35-06ca1eb942e0 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'd4c451efc2444ced89e6243c23782590', 'request_id': 'req-eec01ad7-9a75-47b8-bf35-06ca1eb942e0'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:52.539474 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-eec01ad7-9a75-47b8-bf35-06ca1eb942e0 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'd4c451efc2444ced89e6243c23782590', 'request_id': 'req-eec01ad7-9a75-47b8-bf35-06ca1eb942e0'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:52.541058 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:33:52.546803 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2891/5759] 10.222.0.17 () {58 vars in 1229 bytes} [Sat Jul 23 21:33:52 2022] DELETE /identity/v3/domains/d4c451efc2444ced89e6243c23782590 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:33:52.551177 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-d6cce97f-3448-41a2-936e-1005132da1f1 admin admin] The token cache is being invalidate because project 6442eb45f7724798b21ae1c4dc11ddcd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:33:52.551177 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-d6cce97f-3448-41a2-936e-1005132da1f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:52.552113 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec01ad7-9a75-47b8-bf35-06ca1eb942e0 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:52.553154 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-d6cce97f-3448-41a2-936e-1005132da1f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:52.553726 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-eec01ad7-9a75-47b8-bf35-06ca1eb942e0 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:52.555027 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2869/5760] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:33:52 2022] DELETE /identity/v3/projects/6442eb45f7724798b21ae1c4dc11ddcd => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:33:52.559684 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23b8d9f-fc62-4116-891d-fa8fb78ecd0f None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:52.560117 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23b8d9f-fc62-4116-891d-fa8fb78ecd0f None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:52.560461 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23b8d9f-fc62-4116-891d-fa8fb78ecd0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:52.581389 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-c23b8d9f-fc62-4116-891d-fa8fb78ecd0f None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:33:52.583025 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-c23b8d9f-fc62-4116-891d-fa8fb78ecd0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:52.624703 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec01ad7-9a75-47b8-bf35-06ca1eb942e0 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:52.670943 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2870/5761] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:33:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:33:52.674396 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3355d1ed-3288-45f8-b02a-6b61068718c3 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:52.674690 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3355d1ed-3288-45f8-b02a-6b61068718c3 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:52.674969 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3355d1ed-3288-45f8-b02a-6b61068718c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:52.686464 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e22112-f8b0-4b12-887a-510a2f7de005 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6329fc7fa93c45b7be7350e34ad6bd1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5496ab260afb4aa4b58054dad376a5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:52.687150 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e22112-f8b0-4b12-887a-510a2f7de005 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:52.687431 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e22112-f8b0-4b12-887a-510a2f7de005 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:52.687702 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e22112-f8b0-4b12-887a-510a2f7de005 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:52.688407 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e22112-f8b0-4b12-887a-510a2f7de005 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:52.690549 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e22112-f8b0-4b12-887a-510a2f7de005 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:52.696497 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-3355d1ed-3288-45f8-b02a-6b61068718c3 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:33:52.697724 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-3355d1ed-3288-45f8-b02a-6b61068718c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:52.707040 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2871/5762] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:33:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:33:52.712059 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3355d1ed-3288-45f8-b02a-6b61068718c3 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:52.727514 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3355d1ed-3288-45f8-b02a-6b61068718c3 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:52.733539 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0be426d-ce42-48da-9d62-d2ce28fff998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:52.734481 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0be426d-ce42-48da-9d62-d2ce28fff998 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:52.735068 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0be426d-ce42-48da-9d62-d2ce28fff998 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:52.735554 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0be426d-ce42-48da-9d62-d2ce28fff998 admin admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:52.736465 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0be426d-ce42-48da-9d62-d2ce28fff998 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:33:52.736925 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0be426d-ce42-48da-9d62-d2ce28fff998 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:52.739026 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0be426d-ce42-48da-9d62-d2ce28fff998 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:52.741897 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2892/5763] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:33:52 2022] POST /identity/v3/projects => generated 377 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:33:52.746218 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e22112-f8b0-4b12-887a-510a2f7de005 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:52.748950 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-45e22112-f8b0-4b12-887a-510a2f7de005 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:52.757189 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2872/5764] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:33:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:33:52.759805 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0be426d-ce42-48da-9d62-d2ce28fff998 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:52.769583 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0be426d-ce42-48da-9d62-d2ce28fff998 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:52.779724 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:33:52.836119 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e22112-f8b0-4b12-887a-510a2f7de005 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:52.841073 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3645fe92-8b6f-4b6f-8b43-46e4b119bb16 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6329fc7fa93c45b7be7350e34ad6bd1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5496ab260afb4aa4b58054dad376a5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:52.842027 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3645fe92-8b6f-4b6f-8b43-46e4b119bb16 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:52.842512 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3645fe92-8b6f-4b6f-8b43-46e4b119bb16 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:52.842751 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3645fe92-8b6f-4b6f-8b43-46e4b119bb16 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] PATH_INFO: `/v3/projects/7b03491a3e6f4988a4c2ebb8ca4dedc8` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:52.843304 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b0a5b8-f06e-45d4-9c4e-12c3f308d020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:52.843995 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3645fe92-8b6f-4b6f-8b43-46e4b119bb16 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] RBAC: Authorizing `identity:get_project(project_id=7b03491a3e6f4988a4c2ebb8ca4dedc8)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:52.844133 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b0a5b8-f06e-45d4-9c4e-12c3f308d020 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:52.844561 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b0a5b8-f06e-45d4-9c4e-12c3f308d020 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:52.844925 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b0a5b8-f06e-45d4-9c4e-12c3f308d020 admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:52.846393 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3645fe92-8b6f-4b6f-8b43-46e4b119bb16 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:52.846964 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b0a5b8-f06e-45d4-9c4e-12c3f308d020 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:52.848200 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2893/5765] 10.222.0.17 () {58 vars in 1229 bytes} [Sat Jul 23 21:33:52 2022] GET /identity/v3/projects/7b03491a3e6f4988a4c2ebb8ca4dedc8 => generated 377 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 21:33:52.849006 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b0a5b8-f06e-45d4-9c4e-12c3f308d020 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:52.852638 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3645fe92-8b6f-4b6f-8b43-46e4b119bb16 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:52.862927 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3645fe92-8b6f-4b6f-8b43-46e4b119bb16 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:52.867861 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbc28cc-196e-40a0-865c-8dd751aff722 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6329fc7fa93c45b7be7350e34ad6bd1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5496ab260afb4aa4b58054dad376a5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:52.868595 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbc28cc-196e-40a0-865c-8dd751aff722 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:52.868949 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbc28cc-196e-40a0-865c-8dd751aff722 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:52.869294 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbc28cc-196e-40a0-865c-8dd751aff722 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:52.870144 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbc28cc-196e-40a0-865c-8dd751aff722 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:52.872714 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbc28cc-196e-40a0-865c-8dd751aff722 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:52.886336 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2873/5766] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:33:52 2022] POST /identity/v3/projects => generated 373 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:33:52.890480 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b0a5b8-f06e-45d4-9c4e-12c3f308d020 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:52.900866 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2894/5767] 10.222.0.17 () {58 vars in 1130 bytes} [Sat Jul 23 21:33:52 2022] GET /identity/v3/projects => generated 6213 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 21:33:52.902852 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbc28cc-196e-40a0-865c-8dd751aff722 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:52.916148 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbc28cc-196e-40a0-865c-8dd751aff722 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:52.929606 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:33:52.966674 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b0a5b8-f06e-45d4-9c4e-12c3f308d020 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:52.971930 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d848d894-de0a-4d56-807f-8dfc3a41d567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:52.972632 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d848d894-de0a-4d56-807f-8dfc3a41d567 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:52.972990 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d848d894-de0a-4d56-807f-8dfc3a41d567 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:52.973393 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d848d894-de0a-4d56-807f-8dfc3a41d567 admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:52.974130 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d848d894-de0a-4d56-807f-8dfc3a41d567 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:52.976505 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d848d894-de0a-4d56-807f-8dfc3a41d567 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:52.977640 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f127044a-b048-4eec-9654-774453928bd3 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6329fc7fa93c45b7be7350e34ad6bd1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5496ab260afb4aa4b58054dad376a5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:52.978595 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f127044a-b048-4eec-9654-774453928bd3 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:52.978864 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f127044a-b048-4eec-9654-774453928bd3 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:52.979145 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f127044a-b048-4eec-9654-774453928bd3 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] PATH_INFO: `/v3/projects/7b03491a3e6f4988a4c2ebb8ca4dedc8` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:52.980455 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f127044a-b048-4eec-9654-774453928bd3 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] RBAC: Authorizing `identity:delete_project(project_id=7b03491a3e6f4988a4c2ebb8ca4dedc8)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:52.982398 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f127044a-b048-4eec-9654-774453928bd3 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:53.001813 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2874/5768] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:33:52 2022] POST /identity/v3/users => generated 287 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:33:53.005906 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d848d894-de0a-4d56-807f-8dfc3a41d567 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:53.017475 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d848d894-de0a-4d56-807f-8dfc3a41d567 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:53.030603 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65895634-2f2d-4feb-aabf-9b1e935f3cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:53.031811 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65895634-2f2d-4feb-aabf-9b1e935f3cf4 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:53.032425 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65895634-2f2d-4feb-aabf-9b1e935f3cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:53.033242 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65895634-2f2d-4feb-aabf-9b1e935f3cf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:53.034675 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65895634-2f2d-4feb-aabf-9b1e935f3cf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:53.037521 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65895634-2f2d-4feb-aabf-9b1e935f3cf4 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:53.045759 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-f127044a-b048-4eec-9654-774453928bd3 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b03491a3e6f4988a4c2ebb8ca4dedc8', 'request_id': 'req-f127044a-b048-4eec-9654-774453928bd3'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:53.055219 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2875/5769] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:33:53 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 21:33:53.059813 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65895634-2f2d-4feb-aabf-9b1e935f3cf4 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:53.060109 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-f127044a-b048-4eec-9654-774453928bd3 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b03491a3e6f4988a4c2ebb8ca4dedc8', 'request_id': 'req-f127044a-b048-4eec-9654-774453928bd3'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:53.073069 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-f127044a-b048-4eec-9654-774453928bd3 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b03491a3e6f4988a4c2ebb8ca4dedc8', 'request_id': 'req-f127044a-b048-4eec-9654-774453928bd3'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:53.078624 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65895634-2f2d-4feb-aabf-9b1e935f3cf4 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:53.096985 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-f127044a-b048-4eec-9654-774453928bd3 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] The token cache is being invalidate because project 7b03491a3e6f4988a4c2ebb8ca4dedc8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:33:53.097463 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-f127044a-b048-4eec-9654-774453928bd3 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:53.099097 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-f127044a-b048-4eec-9654-774453928bd3 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:53.103122 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2895/5770] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:33:52 2022] DELETE /identity/v3/projects/7b03491a3e6f4988a4c2ebb8ca4dedc8 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:33:53.108208 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f127044a-b048-4eec-9654-774453928bd3 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:53.112438 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-f127044a-b048-4eec-9654-774453928bd3 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:53.182171 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4111b658-f2f8-4d4f-bf2e-a60742d54a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:53.183039 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4111b658-f2f8-4d4f-bf2e-a60742d54a36 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:53.183426 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4111b658-f2f8-4d4f-bf2e-a60742d54a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:53.183766 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4111b658-f2f8-4d4f-bf2e-a60742d54a36 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:53.184581 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4111b658-f2f8-4d4f-bf2e-a60742d54a36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:53.186336 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4111b658-f2f8-4d4f-bf2e-a60742d54a36 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:53.195992 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f127044a-b048-4eec-9654-774453928bd3 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:53.197620 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2876/5771] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:33:53 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:33:53.202060 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4111b658-f2f8-4d4f-bf2e-a60742d54a36 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:53.202232 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ec4ee0-a579-4a9b-a1c3-e82e019dceab tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6329fc7fa93c45b7be7350e34ad6bd1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5496ab260afb4aa4b58054dad376a5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:53.202786 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ec4ee0-a579-4a9b-a1c3-e82e019dceab tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:53.203208 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ec4ee0-a579-4a9b-a1c3-e82e019dceab tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:53.203485 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ec4ee0-a579-4a9b-a1c3-e82e019dceab tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:53.204188 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ec4ee0-a579-4a9b-a1c3-e82e019dceab tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:53.204412 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-4111b658-f2f8-4d4f-bf2e-a60742d54a36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:53.206113 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ec4ee0-a579-4a9b-a1c3-e82e019dceab tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:53.221059 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4111b658-f2f8-4d4f-bf2e-a60742d54a36 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:53.230804 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52ab2fc-4981-4dba-b985-2ef17ec2f4ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:53.231865 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52ab2fc-4981-4dba-b985-2ef17ec2f4ca admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:53.232150 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52ab2fc-4981-4dba-b985-2ef17ec2f4ca admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:53.232425 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52ab2fc-4981-4dba-b985-2ef17ec2f4ca admin admin] PATH_INFO: `/v3/projects/3dccdf05512344c09951e6a909ec1489/users/1a893d3e78e849b59368125c395fc720/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:53.247100 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2896/5772] 10.222.0.17 () {60 vars in 1151 bytes} [Sat Jul 23 21:33:53 2022] POST /identity/v3/projects => generated 348 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:33:53.247593 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:33:53.250955 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ec4ee0-a579-4a9b-a1c3-e82e019dceab tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:53.257431 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52ab2fc-4981-4dba-b985-2ef17ec2f4ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=3dccdf05512344c09951e6a909ec1489, user_id=1a893d3e78e849b59368125c395fc720, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:53.260244 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52ab2fc-4981-4dba-b985-2ef17ec2f4ca admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:53.283852 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2877/5773] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:33:53 2022] PUT /identity/v3/projects/3dccdf05512344c09951e6a909ec1489/users/1a893d3e78e849b59368125c395fc720/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:33:53.294450 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22597a76-67d0-4ccc-899d-f3c7641aab4e None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:53.295003 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22597a76-67d0-4ccc-899d-f3c7641aab4e None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:53.295493 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22597a76-67d0-4ccc-899d-f3c7641aab4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:53.295934 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=90,keystone:DELETE=8,keystone:INSERT=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:33:53.324228 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-22597a76-67d0-4ccc-899d-f3c7641aab4e None None] MFA Rules not processed for user `1a893d3e78e849b59368125c395fc720`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:33:53.325679 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-22597a76-67d0-4ccc-899d-f3c7641aab4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:53.336676 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ec4ee0-a579-4a9b-a1c3-e82e019dceab tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:53.394739 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2878/5774] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:33:53 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:33:53.399584 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22597a76-67d0-4ccc-899d-f3c7641aab4e None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:53.405765 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d041746-7aed-4ea4-8c09-e1240b1fca0b tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6329fc7fa93c45b7be7350e34ad6bd1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5496ab260afb4aa4b58054dad376a5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:53.406990 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d041746-7aed-4ea4-8c09-e1240b1fca0b tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:53.407268 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d041746-7aed-4ea4-8c09-e1240b1fca0b tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:53.407653 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d041746-7aed-4ea4-8c09-e1240b1fca0b tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] PATH_INFO: `/v3/projects/6b084ece4b434ab58966367db8f9b4fc` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:53.408548 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22597a76-67d0-4ccc-899d-f3c7641aab4e None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:53.408829 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d041746-7aed-4ea4-8c09-e1240b1fca0b tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] RBAC: Authorizing `identity:update_project(project_id=6b084ece4b434ab58966367db8f9b4fc)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:53.410806 ncdv-master-1 devstack@keystone.service[91548]: WARNING py.warnings [None req-1d041746-7aed-4ea4-8c09-e1240b1fca0b tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:33:53.410806 ncdv-master-1 devstack@keystone.service[91548]: warnings.warn(msg) Jul 23 21:33:53.410806 ncdv-master-1 devstack@keystone.service[91548]: Jul 23 21:33:53.411295 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d041746-7aed-4ea4-8c09-e1240b1fca0b tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:53.422169 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7066ad01-3623-4ba3-97db-d15d152c112f tempest-IdentityCatalogTest-710355051 tempest-IdentityCatalogTest-710355051-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a893d3e78e849b59368125c395fc720', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dccdf05512344c09951e6a909ec1489', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:53.424250 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7066ad01-3623-4ba3-97db-d15d152c112f tempest-IdentityCatalogTest-710355051 tempest-IdentityCatalogTest-710355051-project] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:53.424672 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7066ad01-3623-4ba3-97db-d15d152c112f tempest-IdentityCatalogTest-710355051 tempest-IdentityCatalogTest-710355051-project] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:53.425056 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7066ad01-3623-4ba3-97db-d15d152c112f tempest-IdentityCatalogTest-710355051 tempest-IdentityCatalogTest-710355051-project] PATH_INFO: `/v3/auth/catalog` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:53.426087 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7066ad01-3623-4ba3-97db-d15d152c112f tempest-IdentityCatalogTest-710355051 tempest-IdentityCatalogTest-710355051-project] RBAC: Authorizing `identity:get_auth_catalog()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:53.427275 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7066ad01-3623-4ba3-97db-d15d152c112f tempest-IdentityCatalogTest-710355051 tempest-IdentityCatalogTest-710355051-project] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:53.430797 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2879/5775] 10.222.0.17 () {58 vars in 1142 bytes} [Sat Jul 23 21:33:53 2022] GET /identity/v3/auth/catalog => generated 2648 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 21:33:53.440070 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7066ad01-3623-4ba3-97db-d15d152c112f tempest-IdentityCatalogTest-710355051 tempest-IdentityCatalogTest-710355051-project] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:53.462399 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2897/5776] 10.222.0.17 () {60 vars in 1251 bytes} [Sat Jul 23 21:33:53 2022] PATCH /identity/v3/projects/6b084ece4b434ab58966367db8f9b4fc => generated 361 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:33:53.466734 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d041746-7aed-4ea4-8c09-e1240b1fca0b tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:53.480106 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d041746-7aed-4ea4-8c09-e1240b1fca0b tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:53.486694 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaae8b43-d449-4289-8010-36fee8aaaeda tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6329fc7fa93c45b7be7350e34ad6bd1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5496ab260afb4aa4b58054dad376a5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:53.487621 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaae8b43-d449-4289-8010-36fee8aaaeda tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:53.488017 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaae8b43-d449-4289-8010-36fee8aaaeda tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:53.488848 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaae8b43-d449-4289-8010-36fee8aaaeda tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] PATH_INFO: `/v3/projects/6b084ece4b434ab58966367db8f9b4fc` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:53.507484 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaae8b43-d449-4289-8010-36fee8aaaeda tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] RBAC: Authorizing `identity:get_project(project_id=6b084ece4b434ab58966367db8f9b4fc)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:53.510913 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaae8b43-d449-4289-8010-36fee8aaaeda tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:53.516466 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2898/5777] 10.222.0.17 () {58 vars in 1229 bytes} [Sat Jul 23 21:33:53 2022] GET /identity/v3/projects/6b084ece4b434ab58966367db8f9b4fc => generated 348 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:33:53.518014 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaae8b43-d449-4289-8010-36fee8aaaeda tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:53.552031 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaae8b43-d449-4289-8010-36fee8aaaeda tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:53.553894 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7066ad01-3623-4ba3-97db-d15d152c112f tempest-IdentityCatalogTest-710355051 tempest-IdentityCatalogTest-710355051-project] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:53.559274 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11b9ce2-8d48-4afa-852b-c32673a4282a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:53.560184 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11b9ce2-8d48-4afa-852b-c32673a4282a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:53.560463 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11b9ce2-8d48-4afa-852b-c32673a4282a admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:53.560738 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11b9ce2-8d48-4afa-852b-c32673a4282a admin admin] PATH_INFO: `/v3/users/1a893d3e78e849b59368125c395fc720` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:53.562139 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11b9ce2-8d48-4afa-852b-c32673a4282a admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a893d3e78e849b59368125c395fc720)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:53.564153 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11b9ce2-8d48-4afa-852b-c32673a4282a admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:53.568112 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e85f83-4a07-4266-baed-38276568c771 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6329fc7fa93c45b7be7350e34ad6bd1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5496ab260afb4aa4b58054dad376a5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:53.570902 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e85f83-4a07-4266-baed-38276568c771 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:53.571360 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e85f83-4a07-4266-baed-38276568c771 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:53.571836 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e85f83-4a07-4266-baed-38276568c771 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] PATH_INFO: `/v3/projects/6b084ece4b434ab58966367db8f9b4fc` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:53.573512 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e85f83-4a07-4266-baed-38276568c771 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] RBAC: Authorizing `identity:delete_project(project_id=6b084ece4b434ab58966367db8f9b4fc)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:53.576401 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e85f83-4a07-4266-baed-38276568c771 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:53.655299 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-05e85f83-4a07-4266-baed-38276568c771 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b084ece4b434ab58966367db8f9b4fc', 'request_id': 'req-05e85f83-4a07-4266-baed-38276568c771'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:53.661308 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-d11b9ce2-8d48-4afa-852b-c32673a4282a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a893d3e78e849b59368125c395fc720'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:53.671328 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-d11b9ce2-8d48-4afa-852b-c32673a4282a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a893d3e78e849b59368125c395fc720'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:53.672845 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-d11b9ce2-8d48-4afa-852b-c32673a4282a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a893d3e78e849b59368125c395fc720'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:53.679759 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-05e85f83-4a07-4266-baed-38276568c771 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b084ece4b434ab58966367db8f9b4fc', 'request_id': 'req-05e85f83-4a07-4266-baed-38276568c771'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:53.686928 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-d11b9ce2-8d48-4afa-852b-c32673a4282a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a893d3e78e849b59368125c395fc720'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:53.688811 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-05e85f83-4a07-4266-baed-38276568c771 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b084ece4b434ab58966367db8f9b4fc', 'request_id': 'req-05e85f83-4a07-4266-baed-38276568c771'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:53.696427 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:33:53.704609 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-d11b9ce2-8d48-4afa-852b-c32673a4282a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a893d3e78e849b59368125c395fc720'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:53.710159 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-05e85f83-4a07-4266-baed-38276568c771 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] The token cache is being invalidate because project 6b084ece4b434ab58966367db8f9b4fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:33:53.710770 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-05e85f83-4a07-4266-baed-38276568c771 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:53.712907 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-05e85f83-4a07-4266-baed-38276568c771 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:53.715569 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2899/5778] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:33:53 2022] DELETE /identity/v3/projects/6b084ece4b434ab58966367db8f9b4fc => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:33:53.722460 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2880/5779] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:33:53 2022] DELETE /identity/v3/users/1a893d3e78e849b59368125c395fc720 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:33:53.727359 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e85f83-4a07-4266-baed-38276568c771 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:53.727843 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03bbb56-ed73-49f2-8c05-413b5a35af25 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:53.728133 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03bbb56-ed73-49f2-8c05-413b5a35af25 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:53.728414 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03bbb56-ed73-49f2-8c05-413b5a35af25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:53.730333 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-05e85f83-4a07-4266-baed-38276568c771 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:53.748702 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-e03bbb56-ed73-49f2-8c05-413b5a35af25 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:33:53.750030 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-e03bbb56-ed73-49f2-8c05-413b5a35af25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:53.771338 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=91,keystone:UPDATE=1,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:33:53.818305 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e85f83-4a07-4266-baed-38276568c771 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:53.825828 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2881/5780] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:33:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:33:53.835827 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03bbb56-ed73-49f2-8c05-413b5a35af25 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:53.837383 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-e03bbb56-ed73-49f2-8c05-413b5a35af25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:53.882256 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0237ea43-8c9e-4157-a1ab-9c8a5fa5491c tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6329fc7fa93c45b7be7350e34ad6bd1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5496ab260afb4aa4b58054dad376a5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:53.882939 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0237ea43-8c9e-4157-a1ab-9c8a5fa5491c tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:53.883218 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0237ea43-8c9e-4157-a1ab-9c8a5fa5491c tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:53.883499 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0237ea43-8c9e-4157-a1ab-9c8a5fa5491c tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:53.884182 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0237ea43-8c9e-4157-a1ab-9c8a5fa5491c tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:53.886151 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0237ea43-8c9e-4157-a1ab-9c8a5fa5491c tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:53.911798 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03bbb56-ed73-49f2-8c05-413b5a35af25 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:53.916859 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83eabeb-0b41-48d4-b0d2-1c5f93c35854 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:53.917603 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83eabeb-0b41-48d4-b0d2-1c5f93c35854 service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:53.918009 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83eabeb-0b41-48d4-b0d2-1c5f93c35854 service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:53.918262 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83eabeb-0b41-48d4-b0d2-1c5f93c35854 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:53.929460 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2900/5781] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:33:53 2022] POST /identity/v3/projects => generated 360 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:33:53.931098 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0237ea43-8c9e-4157-a1ab-9c8a5fa5491c tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:53.932387 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83eabeb-0b41-48d4-b0d2-1c5f93c35854 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:53.934067 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83eabeb-0b41-48d4-b0d2-1c5f93c35854 service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:53.947296 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2882/5782] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:33:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 23 21:33:54.024608 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0237ea43-8c9e-4157-a1ab-9c8a5fa5491c tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:54.039521 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e8c674-9ae9-4b1c-a32b-bd25326157b9 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6329fc7fa93c45b7be7350e34ad6bd1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5496ab260afb4aa4b58054dad376a5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:54.041113 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e8c674-9ae9-4b1c-a32b-bd25326157b9 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:54.041416 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e8c674-9ae9-4b1c-a32b-bd25326157b9 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:54.041695 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e8c674-9ae9-4b1c-a32b-bd25326157b9 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] PATH_INFO: `/v3/projects/58a18d70fc854975b547bfbd2ebe0ae2` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:54.043766 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e8c674-9ae9-4b1c-a32b-bd25326157b9 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] RBAC: Authorizing `identity:update_project(project_id=58a18d70fc854975b547bfbd2ebe0ae2)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:54.046917 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e8c674-9ae9-4b1c-a32b-bd25326157b9 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:54.109393 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2901/5783] 10.222.0.17 () {60 vars in 1251 bytes} [Sat Jul 23 21:33:53 2022] PATCH /identity/v3/projects/58a18d70fc854975b547bfbd2ebe0ae2 => generated 372 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 21:33:54.110754 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83eabeb-0b41-48d4-b0d2-1c5f93c35854 service neutron] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:54.121890 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83eabeb-0b41-48d4-b0d2-1c5f93c35854 service neutron] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:54.127066 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fea105f-2869-4012-a0ab-a90cd01a2d46 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6329fc7fa93c45b7be7350e34ad6bd1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5496ab260afb4aa4b58054dad376a5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:54.127946 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fea105f-2869-4012-a0ab-a90cd01a2d46 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:54.128229 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fea105f-2869-4012-a0ab-a90cd01a2d46 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:54.128499 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fea105f-2869-4012-a0ab-a90cd01a2d46 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] PATH_INFO: `/v3/projects/58a18d70fc854975b547bfbd2ebe0ae2` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:54.162755 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fea105f-2869-4012-a0ab-a90cd01a2d46 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] RBAC: Authorizing `identity:get_project(project_id=58a18d70fc854975b547bfbd2ebe0ae2)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:54.164874 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fea105f-2869-4012-a0ab-a90cd01a2d46 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:54.169880 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2883/5784] 10.222.0.17 () {58 vars in 1229 bytes} [Sat Jul 23 21:33:54 2022] GET /identity/v3/projects/58a18d70fc854975b547bfbd2ebe0ae2 => generated 359 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:33:54.171146 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e8c674-9ae9-4b1c-a32b-bd25326157b9 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:54.183833 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e8c674-9ae9-4b1c-a32b-bd25326157b9 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:54.190987 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772f38bd-1afc-4828-b74c-0dec158e2185 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6329fc7fa93c45b7be7350e34ad6bd1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5496ab260afb4aa4b58054dad376a5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:54.194368 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772f38bd-1afc-4828-b74c-0dec158e2185 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:54.194512 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772f38bd-1afc-4828-b74c-0dec158e2185 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:54.195883 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772f38bd-1afc-4828-b74c-0dec158e2185 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] PATH_INFO: `/v3/projects/58a18d70fc854975b547bfbd2ebe0ae2` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:54.198999 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772f38bd-1afc-4828-b74c-0dec158e2185 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] RBAC: Authorizing `identity:delete_project(project_id=58a18d70fc854975b547bfbd2ebe0ae2)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:54.201034 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772f38bd-1afc-4828-b74c-0dec158e2185 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:54.220943 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:33:54.270555 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-772f38bd-1afc-4828-b74c-0dec158e2185 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58a18d70fc854975b547bfbd2ebe0ae2', 'request_id': 'req-772f38bd-1afc-4828-b74c-0dec158e2185'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:54.284340 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-772f38bd-1afc-4828-b74c-0dec158e2185 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58a18d70fc854975b547bfbd2ebe0ae2', 'request_id': 'req-772f38bd-1afc-4828-b74c-0dec158e2185'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:54.296493 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-772f38bd-1afc-4828-b74c-0dec158e2185 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58a18d70fc854975b547bfbd2ebe0ae2', 'request_id': 'req-772f38bd-1afc-4828-b74c-0dec158e2185'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:54.312735 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-772f38bd-1afc-4828-b74c-0dec158e2185 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] The token cache is being invalidate because project 58a18d70fc854975b547bfbd2ebe0ae2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:33:54.313035 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-772f38bd-1afc-4828-b74c-0dec158e2185 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:54.315458 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-772f38bd-1afc-4828-b74c-0dec158e2185 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:54.317168 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2902/5785] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:33:54 2022] DELETE /identity/v3/projects/58a18d70fc854975b547bfbd2ebe0ae2 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:33:54.323216 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fea105f-2869-4012-a0ab-a90cd01a2d46 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:54.325195 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-9fea105f-2869-4012-a0ab-a90cd01a2d46 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:54.345456 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fea105f-2869-4012-a0ab-a90cd01a2d46 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:54.384405 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772f38bd-1afc-4828-b74c-0dec158e2185 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:54.386471 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-772f38bd-1afc-4828-b74c-0dec158e2185 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:54.437715 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356add76-9c6a-46be-8c2b-c868c1a96e76 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6329fc7fa93c45b7be7350e34ad6bd1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5496ab260afb4aa4b58054dad376a5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:54.438445 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356add76-9c6a-46be-8c2b-c868c1a96e76 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:54.438758 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356add76-9c6a-46be-8c2b-c868c1a96e76 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:54.439038 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356add76-9c6a-46be-8c2b-c868c1a96e76 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:54.440143 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356add76-9c6a-46be-8c2b-c868c1a96e76 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:54.441741 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356add76-9c6a-46be-8c2b-c868c1a96e76 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:54.497398 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772f38bd-1afc-4828-b74c-0dec158e2185 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:54.507189 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2884/5786] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:33:54 2022] POST /identity/v3/projects => generated 355 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:33:54.511642 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356add76-9c6a-46be-8c2b-c868c1a96e76 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:54.530608 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:33:54.589838 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f55190b-8d32-46cd-97b3-335b8320080b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:54.591127 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f55190b-8d32-46cd-97b3-335b8320080b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:54.592162 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f55190b-8d32-46cd-97b3-335b8320080b admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:54.592792 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f55190b-8d32-46cd-97b3-335b8320080b admin admin] PATH_INFO: `/v3/projects/3dccdf05512344c09951e6a909ec1489` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:54.594360 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f55190b-8d32-46cd-97b3-335b8320080b admin admin] RBAC: Authorizing `identity:delete_project(project_id=3dccdf05512344c09951e6a909ec1489)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:54.596851 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f55190b-8d32-46cd-97b3-335b8320080b admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:54.625825 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356add76-9c6a-46be-8c2b-c868c1a96e76 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:54.631903 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d02d73-3ec2-4b86-b052-56178922459c tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6329fc7fa93c45b7be7350e34ad6bd1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5496ab260afb4aa4b58054dad376a5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:54.633012 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d02d73-3ec2-4b86-b052-56178922459c tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:54.633388 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d02d73-3ec2-4b86-b052-56178922459c tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:54.633705 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d02d73-3ec2-4b86-b052-56178922459c tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] PATH_INFO: `/v3/projects/6ce49ad57b8d447db1ef44b1baa00a8a` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:54.635464 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d02d73-3ec2-4b86-b052-56178922459c tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] RBAC: Authorizing `identity:update_project(project_id=6ce49ad57b8d447db1ef44b1baa00a8a)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:54.638086 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d02d73-3ec2-4b86-b052-56178922459c tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:54.657696 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-8f55190b-8d32-46cd-97b3-335b8320080b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3dccdf05512344c09951e6a909ec1489', 'request_id': 'req-8f55190b-8d32-46cd-97b3-335b8320080b'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:54.661653 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:33:54.668141 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-8f55190b-8d32-46cd-97b3-335b8320080b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3dccdf05512344c09951e6a909ec1489', 'request_id': 'req-8f55190b-8d32-46cd-97b3-335b8320080b'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:54.676830 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-8f55190b-8d32-46cd-97b3-335b8320080b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3dccdf05512344c09951e6a909ec1489', 'request_id': 'req-8f55190b-8d32-46cd-97b3-335b8320080b'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:54.682720 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2885/5787] 10.222.0.17 () {60 vars in 1251 bytes} [Sat Jul 23 21:33:54 2022] PATCH /identity/v3/projects/6ce49ad57b8d447db1ef44b1baa00a8a => generated 368 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 21:33:54.687579 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d02d73-3ec2-4b86-b052-56178922459c tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:54.695985 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-8f55190b-8d32-46cd-97b3-335b8320080b admin admin] The token cache is being invalidate because project 3dccdf05512344c09951e6a909ec1489 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:33:54.696436 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-8f55190b-8d32-46cd-97b3-335b8320080b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:54.697203 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-8f55190b-8d32-46cd-97b3-335b8320080b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:54.702456 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2903/5788] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:33:54 2022] DELETE /identity/v3/projects/3dccdf05512344c09951e6a909ec1489 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:33:54.707857 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d2c195-9022-48b5-b5dc-07ecb867bc19 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:54.708277 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d2c195-9022-48b5-b5dc-07ecb867bc19 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:54.708647 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d2c195-9022-48b5-b5dc-07ecb867bc19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:54.709467 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d02d73-3ec2-4b86-b052-56178922459c tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:54.738582 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-45d2c195-9022-48b5-b5dc-07ecb867bc19 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:33:54.740333 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-45d2c195-9022-48b5-b5dc-07ecb867bc19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:54.797192 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4a1d9c-31f9-49c5-85c4-c0df1fcd2d91 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6329fc7fa93c45b7be7350e34ad6bd1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5496ab260afb4aa4b58054dad376a5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:54.798555 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4a1d9c-31f9-49c5-85c4-c0df1fcd2d91 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:54.799042 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4a1d9c-31f9-49c5-85c4-c0df1fcd2d91 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:54.799566 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4a1d9c-31f9-49c5-85c4-c0df1fcd2d91 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] PATH_INFO: `/v3/projects/6ce49ad57b8d447db1ef44b1baa00a8a` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:54.822813 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2904/5789] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:33:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:33:54.823051 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4a1d9c-31f9-49c5-85c4-c0df1fcd2d91 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] RBAC: Authorizing `identity:get_project(project_id=6ce49ad57b8d447db1ef44b1baa00a8a)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:54.823051 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4a1d9c-31f9-49c5-85c4-c0df1fcd2d91 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:54.823051 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2886/5790] 10.222.0.17 () {58 vars in 1229 bytes} [Sat Jul 23 21:33:54 2022] GET /identity/v3/projects/6ce49ad57b8d447db1ef44b1baa00a8a => generated 355 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 21:33:54.837005 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d2c195-9022-48b5-b5dc-07ecb867bc19 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:54.837211 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df05650-4fe5-4017-8830-e08948c41723 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:54.837211 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df05650-4fe5-4017-8830-e08948c41723 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:54.837211 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df05650-4fe5-4017-8830-e08948c41723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:54.837480 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-45d2c195-9022-48b5-b5dc-07ecb867bc19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:54.853692 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d2c195-9022-48b5-b5dc-07ecb867bc19 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:54.858618 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cdb8f7-6e7a-4f73-bb4d-190804a1bf04 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6329fc7fa93c45b7be7350e34ad6bd1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5496ab260afb4aa4b58054dad376a5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:54.859504 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cdb8f7-6e7a-4f73-bb4d-190804a1bf04 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:54.859789 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cdb8f7-6e7a-4f73-bb4d-190804a1bf04 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:54.860063 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cdb8f7-6e7a-4f73-bb4d-190804a1bf04 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] PATH_INFO: `/v3/projects/6ce49ad57b8d447db1ef44b1baa00a8a` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:54.861308 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cdb8f7-6e7a-4f73-bb4d-190804a1bf04 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] RBAC: Authorizing `identity:delete_project(project_id=6ce49ad57b8d447db1ef44b1baa00a8a)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:54.861790 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-6df05650-4fe5-4017-8830-e08948c41723 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:33:54.863336 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cdb8f7-6e7a-4f73-bb4d-190804a1bf04 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:54.863466 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-6df05650-4fe5-4017-8830-e08948c41723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:54.875843 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2887/5791] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:33:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:33:54.878421 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df05650-4fe5-4017-8830-e08948c41723 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:54.888312 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df05650-4fe5-4017-8830-e08948c41723 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:54.894177 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c94199b-2da1-45de-b1c3-fb58b97047e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:54.894977 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c94199b-2da1-45de-b1c3-fb58b97047e1 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:54.895259 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c94199b-2da1-45de-b1c3-fb58b97047e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:54.895735 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c94199b-2da1-45de-b1c3-fb58b97047e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:54.896532 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c94199b-2da1-45de-b1c3-fb58b97047e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:33:54.896900 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c94199b-2da1-45de-b1c3-fb58b97047e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:54.899011 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c94199b-2da1-45de-b1c3-fb58b97047e1 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:54.912363 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2888/5792] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:33:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:33:54.916831 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c94199b-2da1-45de-b1c3-fb58b97047e1 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:54.917015 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-60cdb8f7-6e7a-4f73-bb4d-190804a1bf04 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ce49ad57b8d447db1ef44b1baa00a8a', 'request_id': 'req-60cdb8f7-6e7a-4f73-bb4d-190804a1bf04'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:54.930011 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-60cdb8f7-6e7a-4f73-bb4d-190804a1bf04 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ce49ad57b8d447db1ef44b1baa00a8a', 'request_id': 'req-60cdb8f7-6e7a-4f73-bb4d-190804a1bf04'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:54.930736 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c94199b-2da1-45de-b1c3-fb58b97047e1 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:54.939648 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-60cdb8f7-6e7a-4f73-bb4d-190804a1bf04 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ce49ad57b8d447db1ef44b1baa00a8a', 'request_id': 'req-60cdb8f7-6e7a-4f73-bb4d-190804a1bf04'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:54.952252 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-60cdb8f7-6e7a-4f73-bb4d-190804a1bf04 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] The token cache is being invalidate because project 6ce49ad57b8d447db1ef44b1baa00a8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:33:54.953550 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-60cdb8f7-6e7a-4f73-bb4d-190804a1bf04 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:54.954438 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-60cdb8f7-6e7a-4f73-bb4d-190804a1bf04 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:54.957039 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2905/5793] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:33:54 2022] DELETE /identity/v3/projects/6ce49ad57b8d447db1ef44b1baa00a8a => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:33:54.962502 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cdb8f7-6e7a-4f73-bb4d-190804a1bf04 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:54.965285 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-60cdb8f7-6e7a-4f73-bb4d-190804a1bf04 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:54.995580 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a9b297-9e8b-414c-92d7-4f12af3b5af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:54.996272 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a9b297-9e8b-414c-92d7-4f12af3b5af1 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:54.996563 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a9b297-9e8b-414c-92d7-4f12af3b5af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:54.997028 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a9b297-9e8b-414c-92d7-4f12af3b5af1 admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:54.997731 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a9b297-9e8b-414c-92d7-4f12af3b5af1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:55.000146 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a9b297-9e8b-414c-92d7-4f12af3b5af1 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:55.006971 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:33:55.035289 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2889/5794] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:33:54 2022] POST /identity/v3/projects => generated 393 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:33:55.039706 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a9b297-9e8b-414c-92d7-4f12af3b5af1 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:55.041507 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-f3a9b297-9e8b-414c-92d7-4f12af3b5af1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:55.052923 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cdb8f7-6e7a-4f73-bb4d-190804a1bf04 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:55.071002 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:33:55.133390 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a9b297-9e8b-414c-92d7-4f12af3b5af1 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:55.138511 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95989d75-0653-41a2-b22c-e22011dce079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:55.139294 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95989d75-0653-41a2-b22c-e22011dce079 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:55.139890 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95989d75-0653-41a2-b22c-e22011dce079 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:55.140244 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95989d75-0653-41a2-b22c-e22011dce079 admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:55.140995 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95989d75-0653-41a2-b22c-e22011dce079 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:55.141392 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a827c4-7353-4b2e-9388-3078016129d8 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6329fc7fa93c45b7be7350e34ad6bd1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5496ab260afb4aa4b58054dad376a5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:55.143081 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a827c4-7353-4b2e-9388-3078016129d8 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:55.143227 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95989d75-0653-41a2-b22c-e22011dce079 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:55.143450 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a827c4-7353-4b2e-9388-3078016129d8 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:55.143794 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a827c4-7353-4b2e-9388-3078016129d8 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] PATH_INFO: `/v3/domains/d4c451efc2444ced89e6243c23782590` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:55.151664 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a827c4-7353-4b2e-9388-3078016129d8 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 21:33:55.163061 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-53a827c4-7353-4b2e-9388-3078016129d8 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Could not find domain: d4c451efc2444ced89e6243c23782590.: keystone.exception.DomainNotFound: Could not find domain: d4c451efc2444ced89e6243c23782590. Jul 23 21:33:55.163061 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 21:33:55.163061 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 23 21:33:55.163061 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 23 21:33:55.163061 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 23 21:33:55.163061 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 23 21:33:55.163061 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 23 21:33:55.163061 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 23 21:33:55.163061 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: d4c451efc2444ced89e6243c23782590. Jul 23 21:33:55.163061 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 21:33:55.163061 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 23 21:33:55.163061 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 21:33:55.163061 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 21:33:55.163061 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 21:33:55.163061 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 21:33:55.163061 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 21:33:55.164460 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 21:33:55.164460 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 21:33:55.164460 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 21:33:55.164460 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 21:33:55.164460 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 21:33:55.164460 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 21:33:55.164460 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 21:33:55.164460 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jul 23 21:33:55.164460 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jul 23 21:33:55.164460 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 21:33:55.164460 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 21:33:55.164460 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 21:33:55.164460 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 21:33:55.164460 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 21:33:55.164460 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 21:33:55.164460 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 21:33:55.165613 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 21:33:55.165613 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 21:33:55.165613 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 21:33:55.165613 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 21:33:55.165613 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application with Lock( Jul 23 21:33:55.165613 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 21:33:55.165613 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._enter() Jul 23 21:33:55.165613 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 21:33:55.165613 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 21:33:55.165613 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 21:33:55.165613 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.creator() Jul 23 21:33:55.165613 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 21:33:55.165613 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application created_value = creator( Jul 23 21:33:55.165613 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 23 21:33:55.165613 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 23 21:33:55.165613 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: d4c451efc2444ced89e6243c23782590. Jul 23 21:33:55.165613 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 21:33:55.166919 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2906/5795] 10.222.0.17 () {60 vars in 1248 bytes} [Sat Jul 23 21:33:54 2022] PATCH /identity/v3/domains/d4c451efc2444ced89e6243c23782590 => generated 112 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 23 21:33:55.168812 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a827c4-7353-4b2e-9388-3078016129d8 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:55.174302 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2890/5796] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:33:55 2022] POST /identity/v3/users => generated 303 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:33:55.175144 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95989d75-0653-41a2-b22c-e22011dce079 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:55.179491 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a827c4-7353-4b2e-9388-3078016129d8 tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:55.184662 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74185c0c-fa30-4c0a-852d-993b09297ddf tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6329fc7fa93c45b7be7350e34ad6bd1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5496ab260afb4aa4b58054dad376a5d3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:55.185603 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74185c0c-fa30-4c0a-852d-993b09297ddf tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:55.185912 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74185c0c-fa30-4c0a-852d-993b09297ddf tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:55.186210 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74185c0c-fa30-4c0a-852d-993b09297ddf tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] PATH_INFO: `/v3/domains/f8656ec7dfa74f86b43193fa659fdc14` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:55.186934 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95989d75-0653-41a2-b22c-e22011dce079 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:55.194308 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244c3418-d95f-4682-928c-d42960cfd945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:55.195216 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244c3418-d95f-4682-928c-d42960cfd945 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:55.195637 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244c3418-d95f-4682-928c-d42960cfd945 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:55.198396 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244c3418-d95f-4682-928c-d42960cfd945 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:55.198396 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244c3418-d95f-4682-928c-d42960cfd945 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:55.198593 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74185c0c-fa30-4c0a-852d-993b09297ddf tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 21:33:55.198785 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244c3418-d95f-4682-928c-d42960cfd945 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:55.208994 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-74185c0c-fa30-4c0a-852d-993b09297ddf tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Could not find domain: f8656ec7dfa74f86b43193fa659fdc14.: keystone.exception.DomainNotFound: Could not find domain: f8656ec7dfa74f86b43193fa659fdc14. Jul 23 21:33:55.208994 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 21:33:55.208994 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 23 21:33:55.208994 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 23 21:33:55.208994 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 23 21:33:55.208994 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 23 21:33:55.208994 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 23 21:33:55.208994 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 23 21:33:55.208994 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: f8656ec7dfa74f86b43193fa659fdc14. Jul 23 21:33:55.208994 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 21:33:55.208994 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 23 21:33:55.208994 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 21:33:55.208994 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 21:33:55.208994 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 21:33:55.208994 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 21:33:55.208994 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 21:33:55.210362 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 21:33:55.210362 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 21:33:55.210362 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 21:33:55.210362 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 21:33:55.210362 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 21:33:55.210362 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 21:33:55.210362 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 21:33:55.210362 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jul 23 21:33:55.210362 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jul 23 21:33:55.210362 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 21:33:55.210362 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 21:33:55.210362 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 21:33:55.210362 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 21:33:55.210362 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 21:33:55.210362 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 21:33:55.210362 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 21:33:55.211382 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 21:33:55.211382 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 21:33:55.211382 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 21:33:55.211382 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 21:33:55.211382 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application with Lock( Jul 23 21:33:55.211382 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 21:33:55.211382 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._enter() Jul 23 21:33:55.211382 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 21:33:55.211382 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 21:33:55.211382 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 21:33:55.211382 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.creator() Jul 23 21:33:55.211382 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 21:33:55.211382 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application created_value = creator( Jul 23 21:33:55.211382 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 23 21:33:55.211382 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 23 21:33:55.211382 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: f8656ec7dfa74f86b43193fa659fdc14. Jul 23 21:33:55.211382 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 21:33:55.212388 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2907/5797] 10.222.0.17 () {60 vars in 1248 bytes} [Sat Jul 23 21:33:55 2022] PATCH /identity/v3/domains/f8656ec7dfa74f86b43193fa659fdc14 => generated 112 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 23 21:33:55.212463 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2891/5798] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:33:55 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:33:55.215761 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244c3418-d95f-4682-928c-d42960cfd945 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:55.216415 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74185c0c-fa30-4c0a-852d-993b09297ddf tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:55.218141 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-74185c0c-fa30-4c0a-852d-993b09297ddf tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:55.228481 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244c3418-d95f-4682-928c-d42960cfd945 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:55.232933 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74185c0c-fa30-4c0a-852d-993b09297ddf tempest-ProjectsTestJSON-356097388 tempest-ProjectsTestJSON-356097388-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:55.233192 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1ff12b-dc1b-4af1-baf5-905bcf83965f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:55.234713 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1ff12b-dc1b-4af1-baf5-905bcf83965f admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:55.234713 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1ff12b-dc1b-4af1-baf5-905bcf83965f admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:55.234947 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1ff12b-dc1b-4af1-baf5-905bcf83965f admin admin] PATH_INFO: `/v3/projects/21f30fe3d8ed46819952f3c6cbb5eb67/users/2df8b3e8b4fa4615881f6b54a11e417b/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:55.238403 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e16e30d-647f-484a-8809-ca7119ec098b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:55.239560 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e16e30d-647f-484a-8809-ca7119ec098b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:55.239842 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e16e30d-647f-484a-8809-ca7119ec098b admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:55.240551 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e16e30d-647f-484a-8809-ca7119ec098b admin admin] PATH_INFO: `/v3/users/c33fb870862041d7bf4068c3947cc0fb` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:55.241454 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e16e30d-647f-484a-8809-ca7119ec098b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c33fb870862041d7bf4068c3947cc0fb)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:55.243734 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e16e30d-647f-484a-8809-ca7119ec098b admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:55.252395 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1ff12b-dc1b-4af1-baf5-905bcf83965f admin admin] RBAC: Authorizing `identity:create_grant(project_id=21f30fe3d8ed46819952f3c6cbb5eb67, user_id=2df8b3e8b4fa4615881f6b54a11e417b, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:55.256768 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1ff12b-dc1b-4af1-baf5-905bcf83965f admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:55.273323 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2892/5799] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:33:55 2022] PUT /identity/v3/projects/21f30fe3d8ed46819952f3c6cbb5eb67/users/2df8b3e8b4fa4615881f6b54a11e417b/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:33:55.277527 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1ff12b-dc1b-4af1-baf5-905bcf83965f admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:55.304215 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-1e16e30d-647f-484a-8809-ca7119ec098b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c33fb870862041d7bf4068c3947cc0fb'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:55.305317 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-1e16e30d-647f-484a-8809-ca7119ec098b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c33fb870862041d7bf4068c3947cc0fb'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:55.313237 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-1e16e30d-647f-484a-8809-ca7119ec098b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c33fb870862041d7bf4068c3947cc0fb'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:55.331109 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-1e16e30d-647f-484a-8809-ca7119ec098b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c33fb870862041d7bf4068c3947cc0fb'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:55.350009 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-1e16e30d-647f-484a-8809-ca7119ec098b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c33fb870862041d7bf4068c3947cc0fb'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:55.361340 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2908/5800] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:33:55 2022] DELETE /identity/v3/users/c33fb870862041d7bf4068c3947cc0fb => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:33:55.361504 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1ff12b-dc1b-4af1-baf5-905bcf83965f admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:55.363497 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67318079-5d82-469f-92d9-add049839463 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:55.363497 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67318079-5d82-469f-92d9-add049839463 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:55.363735 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67318079-5d82-469f-92d9-add049839463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:55.388123 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-67318079-5d82-469f-92d9-add049839463 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:33:55.389502 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-67318079-5d82-469f-92d9-add049839463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:55.420139 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:33:55.436675 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becae37f-f97e-4799-9c90-0c3aa57f5931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:55.437447 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becae37f-f97e-4799-9c90-0c3aa57f5931 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:55.437735 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becae37f-f97e-4799-9c90-0c3aa57f5931 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:55.438054 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becae37f-f97e-4799-9c90-0c3aa57f5931 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:55.438818 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becae37f-f97e-4799-9c90-0c3aa57f5931 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:55.440485 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becae37f-f97e-4799-9c90-0c3aa57f5931 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:55.450969 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2893/5801] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:33:55 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:33:55.455218 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becae37f-f97e-4799-9c90-0c3aa57f5931 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:55.457025 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-becae37f-f97e-4799-9c90-0c3aa57f5931 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:55.473649 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becae37f-f97e-4799-9c90-0c3aa57f5931 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:55.477218 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2909/5802] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:33:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:33:55.481695 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16462ca2-e4d1-41e6-aa2e-efa3efb4de47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:55.482926 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16462ca2-e4d1-41e6-aa2e-efa3efb4de47 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:55.483273 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16462ca2-e4d1-41e6-aa2e-efa3efb4de47 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:55.483614 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16462ca2-e4d1-41e6-aa2e-efa3efb4de47 admin admin] PATH_INFO: `/v3/projects/21f30fe3d8ed46819952f3c6cbb5eb67/users/2df8b3e8b4fa4615881f6b54a11e417b/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:55.487125 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16462ca2-e4d1-41e6-aa2e-efa3efb4de47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21f30fe3d8ed46819952f3c6cbb5eb67, user_id=2df8b3e8b4fa4615881f6b54a11e417b, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:55.488310 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67318079-5d82-469f-92d9-add049839463 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:55.488810 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16462ca2-e4d1-41e6-aa2e-efa3efb4de47 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:55.489756 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-67318079-5d82-469f-92d9-add049839463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:55.509492 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2894/5803] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:33:55 2022] PUT /identity/v3/projects/21f30fe3d8ed46819952f3c6cbb5eb67/users/2df8b3e8b4fa4615881f6b54a11e417b/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:33:55.509668 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:33:55.511826 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e08c1a-ff8c-4122-8665-9eb0247bb498 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:55.512118 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e08c1a-ff8c-4122-8665-9eb0247bb498 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:55.512690 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e08c1a-ff8c-4122-8665-9eb0247bb498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:55.541658 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-53e08c1a-ff8c-4122-8665-9eb0247bb498 None None] MFA Rules not processed for user `2df8b3e8b4fa4615881f6b54a11e417b`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:33:55.543404 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-53e08c1a-ff8c-4122-8665-9eb0247bb498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:55.563377 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67318079-5d82-469f-92d9-add049839463 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:55.625834 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c49fc2-6eb7-430b-92ae-b16e0719a47b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:55.626644 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c49fc2-6eb7-430b-92ae-b16e0719a47b service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:55.626988 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c49fc2-6eb7-430b-92ae-b16e0719a47b service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:55.627198 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c49fc2-6eb7-430b-92ae-b16e0719a47b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:55.629636 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2895/5804] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:33:55 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:33:55.630636 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e08c1a-ff8c-4122-8665-9eb0247bb498 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:55.714736 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e08c1a-ff8c-4122-8665-9eb0247bb498 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:55.719200 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7a24bb-371f-4eea-bc51-345621a57041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:55.719938 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7a24bb-371f-4eea-bc51-345621a57041 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:55.720219 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7a24bb-371f-4eea-bc51-345621a57041 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:55.720494 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7a24bb-371f-4eea-bc51-345621a57041 admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:55.721233 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7a24bb-371f-4eea-bc51-345621a57041 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:55.723198 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7a24bb-371f-4eea-bc51-345621a57041 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:55.753111 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c49fc2-6eb7-430b-92ae-b16e0719a47b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:55.754755 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c49fc2-6eb7-430b-92ae-b16e0719a47b service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:55.762042 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2896/5805] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:33:55 2022] POST /identity/v3/projects => generated 393 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:33:55.766251 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7a24bb-371f-4eea-bc51-345621a57041 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:55.768803 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2910/5806] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:33:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:33:55.840961 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:33:55.871413 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7a24bb-371f-4eea-bc51-345621a57041 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:55.876799 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34f59f5-8cf9-4899-aa2d-726ee88a0594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:55.877480 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34f59f5-8cf9-4899-aa2d-726ee88a0594 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:55.877757 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34f59f5-8cf9-4899-aa2d-726ee88a0594 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:55.878110 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34f59f5-8cf9-4899-aa2d-726ee88a0594 admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:55.878748 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34f59f5-8cf9-4899-aa2d-726ee88a0594 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:55.880766 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34f59f5-8cf9-4899-aa2d-726ee88a0594 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:55.909125 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2897/5807] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:33:55 2022] POST /identity/v3/users => generated 297 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:33:55.911105 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c49fc2-6eb7-430b-92ae-b16e0719a47b service neutron] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:55.927093 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c49fc2-6eb7-430b-92ae-b16e0719a47b service neutron] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:55.933440 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24106f4d-24bd-49df-bc33-a5495b396953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:55.934137 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24106f4d-24bd-49df-bc33-a5495b396953 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:55.934437 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24106f4d-24bd-49df-bc33-a5495b396953 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:55.934644 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24106f4d-24bd-49df-bc33-a5495b396953 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:55.935396 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24106f4d-24bd-49df-bc33-a5495b396953 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:55.937488 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24106f4d-24bd-49df-bc33-a5495b396953 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:55.949555 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2911/5808] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:33:55 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:33:55.957847 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34f59f5-8cf9-4899-aa2d-726ee88a0594 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:55.968474 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34f59f5-8cf9-4899-aa2d-726ee88a0594 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:55.975591 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861f4d99-bb2d-4be6-87ca-e9df9fa239a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:55.976757 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861f4d99-bb2d-4be6-87ca-e9df9fa239a4 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:55.977108 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861f4d99-bb2d-4be6-87ca-e9df9fa239a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:55.977474 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861f4d99-bb2d-4be6-87ca-e9df9fa239a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:55.978757 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861f4d99-bb2d-4be6-87ca-e9df9fa239a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:55.980322 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861f4d99-bb2d-4be6-87ca-e9df9fa239a4 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:55.995901 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2898/5809] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:33:55 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:33:55.999926 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24106f4d-24bd-49df-bc33-a5495b396953 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:56.012203 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24106f4d-24bd-49df-bc33-a5495b396953 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:56.017590 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da7b934-01e3-483b-88a2-c0ff0de50911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:56.018271 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da7b934-01e3-483b-88a2-c0ff0de50911 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:56.018553 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da7b934-01e3-483b-88a2-c0ff0de50911 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:56.018828 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da7b934-01e3-483b-88a2-c0ff0de50911 admin admin] PATH_INFO: `/v3/projects/af927d08ee6e40f69c10baf15ac73456/users/7a13307400074ebfa64f74cb0a38e520/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:56.035218 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da7b934-01e3-483b-88a2-c0ff0de50911 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af927d08ee6e40f69c10baf15ac73456, user_id=7a13307400074ebfa64f74cb0a38e520, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:56.038097 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da7b934-01e3-483b-88a2-c0ff0de50911 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:56.055764 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2912/5810] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:33:55 2022] PUT /identity/v3/projects/af927d08ee6e40f69c10baf15ac73456/users/7a13307400074ebfa64f74cb0a38e520/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:33:56.066080 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8286e280-8a45-43a8-9835-96c87c364c5b None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:56.066450 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8286e280-8a45-43a8-9835-96c87c364c5b None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:56.066824 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8286e280-8a45-43a8-9835-96c87c364c5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:56.106059 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-8286e280-8a45-43a8-9835-96c87c364c5b None None] MFA Rules not processed for user `7a13307400074ebfa64f74cb0a38e520`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:33:56.108030 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-8286e280-8a45-43a8-9835-96c87c364c5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:56.134115 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da7b934-01e3-483b-88a2-c0ff0de50911 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:56.135895 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-0da7b934-01e3-483b-88a2-c0ff0de50911 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:56.188791 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:33:56.208673 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2899/5811] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:33:56 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:33:56.209963 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da7b934-01e3-483b-88a2-c0ff0de50911 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:56.217308 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090ec5d4-2794-446b-a802-2c1c958c58c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:56.218312 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090ec5d4-2794-446b-a802-2c1c958c58c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:56.218678 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090ec5d4-2794-446b-a802-2c1c958c58c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:56.219019 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090ec5d4-2794-446b-a802-2c1c958c58c4 admin admin] PATH_INFO: `/v3/projects/daa33686e214485c9cdfc98deb50c686` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:56.220293 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090ec5d4-2794-446b-a802-2c1c958c58c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=daa33686e214485c9cdfc98deb50c686)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:56.222352 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090ec5d4-2794-446b-a802-2c1c958c58c4 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:56.225187 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8286e280-8a45-43a8-9835-96c87c364c5b None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:56.227043 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-8286e280-8a45-43a8-9835-96c87c364c5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:56.281802 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-090ec5d4-2794-446b-a802-2c1c958c58c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'daa33686e214485c9cdfc98deb50c686', 'request_id': 'req-090ec5d4-2794-446b-a802-2c1c958c58c4'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:56.292315 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-090ec5d4-2794-446b-a802-2c1c958c58c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'daa33686e214485c9cdfc98deb50c686', 'request_id': 'req-090ec5d4-2794-446b-a802-2c1c958c58c4'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:56.299534 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-090ec5d4-2794-446b-a802-2c1c958c58c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'daa33686e214485c9cdfc98deb50c686', 'request_id': 'req-090ec5d4-2794-446b-a802-2c1c958c58c4'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:56.312310 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8286e280-8a45-43a8-9835-96c87c364c5b None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:56.313956 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-090ec5d4-2794-446b-a802-2c1c958c58c4 admin admin] The token cache is being invalidate because project daa33686e214485c9cdfc98deb50c686 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:33:56.314250 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-090ec5d4-2794-446b-a802-2c1c958c58c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:56.314918 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-090ec5d4-2794-446b-a802-2c1c958c58c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:56.317895 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2913/5812] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:33:56 2022] DELETE /identity/v3/projects/daa33686e214485c9cdfc98deb50c686 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:33:56.320513 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090ec5d4-2794-446b-a802-2c1c958c58c4 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:56.321899 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-090ec5d4-2794-446b-a802-2c1c958c58c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:56.365583 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:33:56.377335 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce59c24d-2559-437a-9d50-afb70c037fc7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7f2db148c8e4d5d81431cae3576434b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:56.377969 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce59c24d-2559-437a-9d50-afb70c037fc7 service glance] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:56.378708 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce59c24d-2559-437a-9d50-afb70c037fc7 service glance] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:56.378708 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce59c24d-2559-437a-9d50-afb70c037fc7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:56.380366 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-ce59c24d-2559-437a-9d50-afb70c037fc7 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:56.398420 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090ec5d4-2794-446b-a802-2c1c958c58c4 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:56.403469 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588091c3-2008-4ed8-8d13-fe75b75d29d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:56.404443 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588091c3-2008-4ed8-8d13-fe75b75d29d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:56.404794 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588091c3-2008-4ed8-8d13-fe75b75d29d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:56.405134 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588091c3-2008-4ed8-8d13-fe75b75d29d6 admin admin] PATH_INFO: `/v3/users/6329fc7fa93c45b7be7350e34ad6bd1c` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:56.406461 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588091c3-2008-4ed8-8d13-fe75b75d29d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6329fc7fa93c45b7be7350e34ad6bd1c)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:56.408479 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588091c3-2008-4ed8-8d13-fe75b75d29d6 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:56.461896 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce59c24d-2559-437a-9d50-afb70c037fc7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:56.463754 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce59c24d-2559-437a-9d50-afb70c037fc7 service glance] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:56.476726 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2900/5813] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:33:56 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:33:56.488856 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-588091c3-2008-4ed8-8d13-fe75b75d29d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6329fc7fa93c45b7be7350e34ad6bd1c'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:56.489789 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-588091c3-2008-4ed8-8d13-fe75b75d29d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6329fc7fa93c45b7be7350e34ad6bd1c'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:56.499944 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-588091c3-2008-4ed8-8d13-fe75b75d29d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6329fc7fa93c45b7be7350e34ad6bd1c'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:56.514787 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-588091c3-2008-4ed8-8d13-fe75b75d29d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6329fc7fa93c45b7be7350e34ad6bd1c'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:56.541483 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:33:56.543969 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-588091c3-2008-4ed8-8d13-fe75b75d29d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6329fc7fa93c45b7be7350e34ad6bd1c'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:56.553925 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2914/5814] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:33:56 2022] DELETE /identity/v3/users/6329fc7fa93c45b7be7350e34ad6bd1c => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:33:57.031610 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce59c24d-2559-437a-9d50-afb70c037fc7 service glance] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:57.047256 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce59c24d-2559-437a-9d50-afb70c037fc7 service glance] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:57.109484 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cb381c-3c59-487e-ab45-d54b42446648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:57.110821 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cb381c-3c59-487e-ab45-d54b42446648 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:57.111175 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cb381c-3c59-487e-ab45-d54b42446648 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:57.111805 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cb381c-3c59-487e-ab45-d54b42446648 admin admin] PATH_INFO: `/v3/projects/5496ab260afb4aa4b58054dad376a5d3` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:57.113249 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cb381c-3c59-487e-ab45-d54b42446648 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5496ab260afb4aa4b58054dad376a5d3)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:57.115832 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cb381c-3c59-487e-ab45-d54b42446648 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:57.145976 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588091c3-2008-4ed8-8d13-fe75b75d29d6 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:57.148302 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-588091c3-2008-4ed8-8d13-fe75b75d29d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:57.165794 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588091c3-2008-4ed8-8d13-fe75b75d29d6 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:57.176234 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f3f7c0-8df0-4753-913e-f6ad5c4888fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:57.177960 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f3f7c0-8df0-4753-913e-f6ad5c4888fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:57.178423 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f3f7c0-8df0-4753-913e-f6ad5c4888fa admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:57.178539 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f3f7c0-8df0-4753-913e-f6ad5c4888fa admin admin] PATH_INFO: `/v3/users/2df8b3e8b4fa4615881f6b54a11e417b` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:57.179910 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f3f7c0-8df0-4753-913e-f6ad5c4888fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=2df8b3e8b4fa4615881f6b54a11e417b)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:57.181904 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f3f7c0-8df0-4753-913e-f6ad5c4888fa admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:57.192438 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-d3cb381c-3c59-487e-ab45-d54b42446648 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5496ab260afb4aa4b58054dad376a5d3', 'request_id': 'req-d3cb381c-3c59-487e-ab45-d54b42446648'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:57.203914 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-d3cb381c-3c59-487e-ab45-d54b42446648 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5496ab260afb4aa4b58054dad376a5d3', 'request_id': 'req-d3cb381c-3c59-487e-ab45-d54b42446648'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:57.211389 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-d3cb381c-3c59-487e-ab45-d54b42446648 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5496ab260afb4aa4b58054dad376a5d3', 'request_id': 'req-d3cb381c-3c59-487e-ab45-d54b42446648'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:57.225079 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-d3cb381c-3c59-487e-ab45-d54b42446648 admin admin] The token cache is being invalidate because project 5496ab260afb4aa4b58054dad376a5d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:33:57.225386 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-d3cb381c-3c59-487e-ab45-d54b42446648 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:57.226968 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-d3cb381c-3c59-487e-ab45-d54b42446648 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:57.229738 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2901/5815] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:33:57 2022] DELETE /identity/v3/projects/5496ab260afb4aa4b58054dad376a5d3 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:33:57.235991 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59326fbe-5466-49b9-9c11-42cb3654345d None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:57.236365 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59326fbe-5466-49b9-9c11-42cb3654345d None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:57.236856 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59326fbe-5466-49b9-9c11-42cb3654345d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:57.246287 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-54f3f7c0-8df0-4753-913e-f6ad5c4888fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2df8b3e8b4fa4615881f6b54a11e417b'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:57.247004 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-54f3f7c0-8df0-4753-913e-f6ad5c4888fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2df8b3e8b4fa4615881f6b54a11e417b'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:57.256423 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-54f3f7c0-8df0-4753-913e-f6ad5c4888fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2df8b3e8b4fa4615881f6b54a11e417b'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:57.258250 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-59326fbe-5466-49b9-9c11-42cb3654345d None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:33:57.261476 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-59326fbe-5466-49b9-9c11-42cb3654345d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:57.267131 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-54f3f7c0-8df0-4753-913e-f6ad5c4888fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2df8b3e8b4fa4615881f6b54a11e417b'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:57.284320 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:33:57.285496 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-54f3f7c0-8df0-4753-913e-f6ad5c4888fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2df8b3e8b4fa4615881f6b54a11e417b'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:57.294037 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2915/5816] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:33:57 2022] DELETE /identity/v3/users/2df8b3e8b4fa4615881f6b54a11e417b => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:33:57.299310 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0a83f3-6e82-4440-8b38-5956896caf5f None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:57.299778 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0a83f3-6e82-4440-8b38-5956896caf5f None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:57.300399 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0a83f3-6e82-4440-8b38-5956896caf5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:57.321972 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-ca0a83f3-6e82-4440-8b38-5956896caf5f None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:33:57.323201 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-ca0a83f3-6e82-4440-8b38-5956896caf5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:57.342194 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2902/5817] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:33:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:33:57.350163 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e242a8-8107-41bb-8647-f4952a9dcb82 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:57.351322 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e242a8-8107-41bb-8647-f4952a9dcb82 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:57.351750 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e242a8-8107-41bb-8647-f4952a9dcb82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:57.372565 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-18e242a8-8107-41bb-8647-f4952a9dcb82 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:33:57.373600 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-18e242a8-8107-41bb-8647-f4952a9dcb82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:57.423107 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2916/5818] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:33:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:33:57.433015 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0a83f3-6e82-4440-8b38-5956896caf5f None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:57.434854 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-ca0a83f3-6e82-4440-8b38-5956896caf5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:57.453915 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2903/5819] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:33:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:33:57.461460 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e242a8-8107-41bb-8647-f4952a9dcb82 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:57.471666 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e242a8-8107-41bb-8647-f4952a9dcb82 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:57.477658 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0999e0ed-113f-4909-94d9-e1c9139fe6b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:57.478439 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0999e0ed-113f-4909-94d9-e1c9139fe6b4 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:57.478716 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0999e0ed-113f-4909-94d9-e1c9139fe6b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:57.478995 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0999e0ed-113f-4909-94d9-e1c9139fe6b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:57.479717 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0999e0ed-113f-4909-94d9-e1c9139fe6b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:33:57.480032 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0999e0ed-113f-4909-94d9-e1c9139fe6b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:57.481655 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0999e0ed-113f-4909-94d9-e1c9139fe6b4 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:57.495625 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2904/5820] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:33:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 21:33:57.500932 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0999e0ed-113f-4909-94d9-e1c9139fe6b4 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:57.506425 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0a83f3-6e82-4440-8b38-5956896caf5f None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:57.510066 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2044a3-1250-41a6-a28c-ed24ff3383fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:57.511138 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2044a3-1250-41a6-a28c-ed24ff3383fd service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:57.511138 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2044a3-1250-41a6-a28c-ed24ff3383fd service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:57.511387 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2044a3-1250-41a6-a28c-ed24ff3383fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:57.515788 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0999e0ed-113f-4909-94d9-e1c9139fe6b4 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:57.521145 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281c873c-e25b-43f4-a8a3-6c65c6ea5d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:57.521764 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2044a3-1250-41a6-a28c-ed24ff3383fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:57.522114 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281c873c-e25b-43f4-a8a3-6c65c6ea5d3e admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:57.522382 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281c873c-e25b-43f4-a8a3-6c65c6ea5d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:57.522726 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281c873c-e25b-43f4-a8a3-6c65c6ea5d3e admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:57.523340 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2044a3-1250-41a6-a28c-ed24ff3383fd service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:57.523532 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281c873c-e25b-43f4-a8a3-6c65c6ea5d3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:57.525541 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281c873c-e25b-43f4-a8a3-6c65c6ea5d3e admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:57.534016 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2917/5821] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:33:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:33:57.563436 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2905/5822] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:33:57 2022] POST /identity/v3/projects => generated 397 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:33:57.564712 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2044a3-1250-41a6-a28c-ed24ff3383fd service neutron] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:57.577114 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2044a3-1250-41a6-a28c-ed24ff3383fd service neutron] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:57.587733 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:33:57.659897 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838673c7-7c64-4b50-8224-17ce66b0ff72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:57.660708 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838673c7-7c64-4b50-8224-17ce66b0ff72 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:57.660984 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838673c7-7c64-4b50-8224-17ce66b0ff72 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:57.661266 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838673c7-7c64-4b50-8224-17ce66b0ff72 admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:57.662050 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838673c7-7c64-4b50-8224-17ce66b0ff72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:57.664043 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838673c7-7c64-4b50-8224-17ce66b0ff72 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:57.707079 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2918/5823] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:33:57 2022] POST /identity/v3/users => generated 299 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:33:57.719247 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281c873c-e25b-43f4-a8a3-6c65c6ea5d3e admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:57.732683 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281c873c-e25b-43f4-a8a3-6c65c6ea5d3e admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:57.742753 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f35592b-3bdd-4c0a-bf37-e7e6d7d68ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:57.743850 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f35592b-3bdd-4c0a-bf37-e7e6d7d68ed0 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:57.744285 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f35592b-3bdd-4c0a-bf37-e7e6d7d68ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:57.744710 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f35592b-3bdd-4c0a-bf37-e7e6d7d68ed0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:57.745659 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f35592b-3bdd-4c0a-bf37-e7e6d7d68ed0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:57.747861 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f35592b-3bdd-4c0a-bf37-e7e6d7d68ed0 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:57.767294 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2906/5824] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:33:57 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:33:57.768534 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838673c7-7c64-4b50-8224-17ce66b0ff72 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:57.791039 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838673c7-7c64-4b50-8224-17ce66b0ff72 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:57.799710 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0142cb77-eb86-4f91-a1a6-e39d0eaad8c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:57.800611 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0142cb77-eb86-4f91-a1a6-e39d0eaad8c9 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:57.801080 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0142cb77-eb86-4f91-a1a6-e39d0eaad8c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:57.801355 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0142cb77-eb86-4f91-a1a6-e39d0eaad8c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:57.802149 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0142cb77-eb86-4f91-a1a6-e39d0eaad8c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:57.804137 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0142cb77-eb86-4f91-a1a6-e39d0eaad8c9 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:57.824908 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2919/5825] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:33:57 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:33:57.829383 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f35592b-3bdd-4c0a-bf37-e7e6d7d68ed0 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:57.847663 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f35592b-3bdd-4c0a-bf37-e7e6d7d68ed0 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:57.857616 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a440f2-788f-4dc3-b0ff-2bd26d7beb5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:57.858752 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a440f2-788f-4dc3-b0ff-2bd26d7beb5f admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:57.859921 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a440f2-788f-4dc3-b0ff-2bd26d7beb5f admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:57.860331 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a440f2-788f-4dc3-b0ff-2bd26d7beb5f admin admin] PATH_INFO: `/v3/projects/b29a6f04e89a456abd89c29907e06220/users/5d74e63e8c044840b6434d063afd352a/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:57.891454 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a440f2-788f-4dc3-b0ff-2bd26d7beb5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b29a6f04e89a456abd89c29907e06220, user_id=5d74e63e8c044840b6434d063afd352a, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:57.895260 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a440f2-788f-4dc3-b0ff-2bd26d7beb5f admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:57.919680 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2907/5826] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:33:57 2022] PUT /identity/v3/projects/b29a6f04e89a456abd89c29907e06220/users/5d74e63e8c044840b6434d063afd352a/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:33:57.930878 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04debf57-f6b9-4b77-aa63-75c37c8f5d94 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:57.932303 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04debf57-f6b9-4b77-aa63-75c37c8f5d94 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:57.932801 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04debf57-f6b9-4b77-aa63-75c37c8f5d94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:57.949462 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a440f2-788f-4dc3-b0ff-2bd26d7beb5f admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:57.951562 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-e7a440f2-788f-4dc3-b0ff-2bd26d7beb5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:57.994602 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-04debf57-f6b9-4b77-aa63-75c37c8f5d94 None None] MFA Rules not processed for user `5d74e63e8c044840b6434d063afd352a`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:33:57.996077 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-04debf57-f6b9-4b77-aa63-75c37c8f5d94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:58.071156 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:33:58.078250 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a440f2-788f-4dc3-b0ff-2bd26d7beb5f admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:58.085362 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671541c4-a2cf-4bc2-a3cb-07136fbbb836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:58.086987 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671541c4-a2cf-4bc2-a3cb-07136fbbb836 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:58.087536 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671541c4-a2cf-4bc2-a3cb-07136fbbb836 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:58.087980 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671541c4-a2cf-4bc2-a3cb-07136fbbb836 admin admin] PATH_INFO: `/v3/projects/21f30fe3d8ed46819952f3c6cbb5eb67` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:58.089847 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671541c4-a2cf-4bc2-a3cb-07136fbbb836 admin admin] RBAC: Authorizing `identity:delete_project(project_id=21f30fe3d8ed46819952f3c6cbb5eb67)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:58.092228 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671541c4-a2cf-4bc2-a3cb-07136fbbb836 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:58.099896 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2920/5827] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:33:57 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:33:58.101360 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04debf57-f6b9-4b77-aa63-75c37c8f5d94 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:58.114926 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04debf57-f6b9-4b77-aa63-75c37c8f5d94 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:58.121264 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29470b94-9fad-4fbe-ba6c-ce8bf52ce8fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:58.122199 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29470b94-9fad-4fbe-ba6c-ce8bf52ce8fe admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:58.122489 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29470b94-9fad-4fbe-ba6c-ce8bf52ce8fe admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:58.122767 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29470b94-9fad-4fbe-ba6c-ce8bf52ce8fe admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:58.123469 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29470b94-9fad-4fbe-ba6c-ce8bf52ce8fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:58.125798 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29470b94-9fad-4fbe-ba6c-ce8bf52ce8fe admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:58.161177 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2921/5828] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:33:58 2022] POST /identity/v3/projects => generated 397 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:33:58.166044 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29470b94-9fad-4fbe-ba6c-ce8bf52ce8fe admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:58.167089 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-671541c4-a2cf-4bc2-a3cb-07136fbbb836 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21f30fe3d8ed46819952f3c6cbb5eb67', 'request_id': 'req-671541c4-a2cf-4bc2-a3cb-07136fbbb836'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:58.178716 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-671541c4-a2cf-4bc2-a3cb-07136fbbb836 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21f30fe3d8ed46819952f3c6cbb5eb67', 'request_id': 'req-671541c4-a2cf-4bc2-a3cb-07136fbbb836'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:58.189758 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-671541c4-a2cf-4bc2-a3cb-07136fbbb836 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21f30fe3d8ed46819952f3c6cbb5eb67', 'request_id': 'req-671541c4-a2cf-4bc2-a3cb-07136fbbb836'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:58.204786 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-671541c4-a2cf-4bc2-a3cb-07136fbbb836 admin admin] The token cache is being invalidate because project 21f30fe3d8ed46819952f3c6cbb5eb67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:33:58.205128 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-671541c4-a2cf-4bc2-a3cb-07136fbbb836 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:58.206140 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-671541c4-a2cf-4bc2-a3cb-07136fbbb836 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:58.208403 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2908/5829] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:33:57 2022] DELETE /identity/v3/projects/21f30fe3d8ed46819952f3c6cbb5eb67 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:33:58.212835 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671541c4-a2cf-4bc2-a3cb-07136fbbb836 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:58.216715 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-671541c4-a2cf-4bc2-a3cb-07136fbbb836 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:58.251010 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:33:58.257092 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29470b94-9fad-4fbe-ba6c-ce8bf52ce8fe admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:58.264082 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9965b3-a73b-4485-adad-4f208954cb17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:58.265465 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9965b3-a73b-4485-adad-4f208954cb17 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:58.266073 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9965b3-a73b-4485-adad-4f208954cb17 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:58.266517 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9965b3-a73b-4485-adad-4f208954cb17 admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:58.267480 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9965b3-a73b-4485-adad-4f208954cb17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:58.269949 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9965b3-a73b-4485-adad-4f208954cb17 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:58.302660 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2922/5830] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:33:58 2022] POST /identity/v3/users => generated 305 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:33:58.307682 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9965b3-a73b-4485-adad-4f208954cb17 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:58.310734 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-1c9965b3-a73b-4485-adad-4f208954cb17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:58.323945 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671541c4-a2cf-4bc2-a3cb-07136fbbb836 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:58.324261 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9965b3-a73b-4485-adad-4f208954cb17 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:58.329618 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f95aaf-ef57-48f6-829f-97e907ec84e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:58.329784 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92ec14a-70ad-42ad-87ae-5a85d383ab28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:58.330390 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f95aaf-ef57-48f6-829f-97e907ec84e4 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:58.330746 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92ec14a-70ad-42ad-87ae-5a85d383ab28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:58.330859 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f95aaf-ef57-48f6-829f-97e907ec84e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:58.331097 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92ec14a-70ad-42ad-87ae-5a85d383ab28 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:58.331206 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f95aaf-ef57-48f6-829f-97e907ec84e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:58.331375 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92ec14a-70ad-42ad-87ae-5a85d383ab28 admin admin] PATH_INFO: `/v3/users/7a13307400074ebfa64f74cb0a38e520` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:58.332077 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f95aaf-ef57-48f6-829f-97e907ec84e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:58.333161 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92ec14a-70ad-42ad-87ae-5a85d383ab28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a13307400074ebfa64f74cb0a38e520)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:58.334246 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f95aaf-ef57-48f6-829f-97e907ec84e4 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:58.335606 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92ec14a-70ad-42ad-87ae-5a85d383ab28 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:58.345828 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2923/5831] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:33:58 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 21:33:58.350037 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f95aaf-ef57-48f6-829f-97e907ec84e4 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:58.364294 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f95aaf-ef57-48f6-829f-97e907ec84e4 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:58.371266 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3086f1e3-ff47-401f-b9ad-a2c5d9205fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:58.372415 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3086f1e3-ff47-401f-b9ad-a2c5d9205fa8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:58.372726 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3086f1e3-ff47-401f-b9ad-a2c5d9205fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:58.373006 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3086f1e3-ff47-401f-b9ad-a2c5d9205fa8 admin admin] PATH_INFO: `/v3/projects/4de224fbae5147eca4191ac7458f8078/users/52f280d8738f4853ae6b4e7921cc56e3/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:58.394385 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-d92ec14a-70ad-42ad-87ae-5a85d383ab28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a13307400074ebfa64f74cb0a38e520'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:58.396393 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3086f1e3-ff47-401f-b9ad-a2c5d9205fa8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4de224fbae5147eca4191ac7458f8078, user_id=52f280d8738f4853ae6b4e7921cc56e3, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:58.399724 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3086f1e3-ff47-401f-b9ad-a2c5d9205fa8 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:58.403879 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-d92ec14a-70ad-42ad-87ae-5a85d383ab28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a13307400074ebfa64f74cb0a38e520'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:58.404662 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-d92ec14a-70ad-42ad-87ae-5a85d383ab28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a13307400074ebfa64f74cb0a38e520'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:58.413670 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-d92ec14a-70ad-42ad-87ae-5a85d383ab28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a13307400074ebfa64f74cb0a38e520'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:58.417639 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2924/5832] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:33:58 2022] PUT /identity/v3/projects/4de224fbae5147eca4191ac7458f8078/users/52f280d8738f4853ae6b4e7921cc56e3/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:33:58.421477 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3086f1e3-ff47-401f-b9ad-a2c5d9205fa8 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:58.428654 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-d92ec14a-70ad-42ad-87ae-5a85d383ab28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a13307400074ebfa64f74cb0a38e520'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:58.437514 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2909/5833] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:33:58 2022] DELETE /identity/v3/users/7a13307400074ebfa64f74cb0a38e520 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:33:58.507033 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3086f1e3-ff47-401f-b9ad-a2c5d9205fa8 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:58.579872 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb133b89-f8af-46ef-b8dc-aa6fd503bb03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:58.580879 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb133b89-f8af-46ef-b8dc-aa6fd503bb03 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:58.581292 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb133b89-f8af-46ef-b8dc-aa6fd503bb03 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:58.581631 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb133b89-f8af-46ef-b8dc-aa6fd503bb03 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:58.582466 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb133b89-f8af-46ef-b8dc-aa6fd503bb03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:58.584180 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb133b89-f8af-46ef-b8dc-aa6fd503bb03 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:58.599039 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2925/5834] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:33:58 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:33:58.606499 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92ec14a-70ad-42ad-87ae-5a85d383ab28 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:58.608567 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-d92ec14a-70ad-42ad-87ae-5a85d383ab28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:58.621561 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:33:58.634078 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92ec14a-70ad-42ad-87ae-5a85d383ab28 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:58.640212 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3d0624-ae45-4e48-a58f-a660cf6cec8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:58.641226 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3d0624-ae45-4e48-a58f-a660cf6cec8f admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:58.641450 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3d0624-ae45-4e48-a58f-a660cf6cec8f admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:58.641698 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3d0624-ae45-4e48-a58f-a660cf6cec8f admin admin] PATH_INFO: `/v3/projects/4de224fbae5147eca4191ac7458f8078/users/52f280d8738f4853ae6b4e7921cc56e3/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:58.649010 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3d0624-ae45-4e48-a58f-a660cf6cec8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4de224fbae5147eca4191ac7458f8078, user_id=52f280d8738f4853ae6b4e7921cc56e3, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:58.653140 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3d0624-ae45-4e48-a58f-a660cf6cec8f admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:58.666837 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2910/5835] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:33:58 2022] PUT /identity/v3/projects/4de224fbae5147eca4191ac7458f8078/users/52f280d8738f4853ae6b4e7921cc56e3/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:33:58.677272 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d15a73c-c695-4883-9364-001a1d2b9c56 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:58.677808 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d15a73c-c695-4883-9364-001a1d2b9c56 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:58.678377 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d15a73c-c695-4883-9364-001a1d2b9c56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:58.736603 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-1d15a73c-c695-4883-9364-001a1d2b9c56 None None] MFA Rules not processed for user `52f280d8738f4853ae6b4e7921cc56e3`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:33:58.739337 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-1d15a73c-c695-4883-9364-001a1d2b9c56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:58.809696 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3d0624-ae45-4e48-a58f-a660cf6cec8f admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:58.809696 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-6c3d0624-ae45-4e48-a58f-a660cf6cec8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:58.858976 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:33:58.883654 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2926/5836] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:33:58 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:33:58.889380 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d15a73c-c695-4883-9364-001a1d2b9c56 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:58.896628 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-1d15a73c-c695-4883-9364-001a1d2b9c56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:58.933901 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3d0624-ae45-4e48-a58f-a660cf6cec8f admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:58.940173 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537d6abf-688f-4281-a386-5402462e2697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:58.941552 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537d6abf-688f-4281-a386-5402462e2697 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:58.941846 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537d6abf-688f-4281-a386-5402462e2697 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:58.942182 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537d6abf-688f-4281-a386-5402462e2697 admin admin] PATH_INFO: `/v3/projects/af927d08ee6e40f69c10baf15ac73456` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:58.943480 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537d6abf-688f-4281-a386-5402462e2697 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af927d08ee6e40f69c10baf15ac73456)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:58.948050 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537d6abf-688f-4281-a386-5402462e2697 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:58.962596 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d15a73c-c695-4883-9364-001a1d2b9c56 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:58.967978 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c842a3df-60e7-45e3-84f5-45e812838ac6 tempest-ProjectsNegativeStaticTestJSON-1875953852 tempest-ProjectsNegativeStaticTestJSON-1875953852-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d74e63e8c044840b6434d063afd352a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b29a6f04e89a456abd89c29907e06220', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:58.968689 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c842a3df-60e7-45e3-84f5-45e812838ac6 tempest-ProjectsNegativeStaticTestJSON-1875953852 tempest-ProjectsNegativeStaticTestJSON-1875953852-project] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:58.968972 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c842a3df-60e7-45e3-84f5-45e812838ac6 tempest-ProjectsNegativeStaticTestJSON-1875953852 tempest-ProjectsNegativeStaticTestJSON-1875953852-project] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:58.969253 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c842a3df-60e7-45e3-84f5-45e812838ac6 tempest-ProjectsNegativeStaticTestJSON-1875953852 tempest-ProjectsNegativeStaticTestJSON-1875953852-project] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:58.970051 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c842a3df-60e7-45e3-84f5-45e812838ac6 tempest-ProjectsNegativeStaticTestJSON-1875953852 tempest-ProjectsNegativeStaticTestJSON-1875953852-project] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:58.976727 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-c842a3df-60e7-45e3-84f5-45e812838ac6 tempest-ProjectsNegativeStaticTestJSON-1875953852 tempest-ProjectsNegativeStaticTestJSON-1875953852-project] You are not authorized to perform the requested action: identity:create_project.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:create_project. Jul 23 21:33:58.976727 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 21:33:58.976727 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 21:33:58.976727 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 21:33:58.976727 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 21:33:58.976727 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 21:33:58.976727 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 21:33:58.976727 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 21:33:58.976727 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 21:33:58.976727 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 21:33:58.976727 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 21:33:58.976727 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 21:33:58.976727 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 162, in post Jul 23 21:33:58.976727 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application ENFORCER.enforce_call( Jul 23 21:33:58.978098 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 455, in enforce_call Jul 23 21:33:58.978098 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application enforcer_obj._enforce( Jul 23 21:33:58.978098 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 125, in _enforce Jul 23 21:33:58.978098 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application result = self._enforcer.enforce( Jul 23 21:33:58.978098 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 23 21:33:58.978098 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exc(*args, **kwargs) Jul 23 21:33:58.978098 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:create_project. Jul 23 21:33:58.978098 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 21:33:58.979023 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2927/5837] 10.222.0.17 () {60 vars in 1151 bytes} [Sat Jul 23 21:33:58 2022] POST /identity/v3/projects => generated 136 bytes in 89 msecs (HTTP/1.1 403) 5 headers in 184 bytes (2 switches on core 0) Jul 23 21:33:58.983361 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c842a3df-60e7-45e3-84f5-45e812838ac6 tempest-ProjectsNegativeStaticTestJSON-1875953852 tempest-ProjectsNegativeStaticTestJSON-1875953852-project] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:59.000312 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c842a3df-60e7-45e3-84f5-45e812838ac6 tempest-ProjectsNegativeStaticTestJSON-1875953852 tempest-ProjectsNegativeStaticTestJSON-1875953852-project] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:59.010508 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-537d6abf-688f-4281-a386-5402462e2697 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af927d08ee6e40f69c10baf15ac73456', 'request_id': 'req-537d6abf-688f-4281-a386-5402462e2697'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:59.020753 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-537d6abf-688f-4281-a386-5402462e2697 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af927d08ee6e40f69c10baf15ac73456', 'request_id': 'req-537d6abf-688f-4281-a386-5402462e2697'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:59.026820 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-537d6abf-688f-4281-a386-5402462e2697 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af927d08ee6e40f69c10baf15ac73456', 'request_id': 'req-537d6abf-688f-4281-a386-5402462e2697'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:59.040085 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-537d6abf-688f-4281-a386-5402462e2697 admin admin] The token cache is being invalidate because project af927d08ee6e40f69c10baf15ac73456 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:33:59.040309 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-537d6abf-688f-4281-a386-5402462e2697 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:59.040971 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-537d6abf-688f-4281-a386-5402462e2697 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:59.045843 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2911/5838] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:33:58 2022] DELETE /identity/v3/projects/af927d08ee6e40f69c10baf15ac73456 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:33:59.048555 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acce795c-a834-4d1e-b56d-580073dbb404 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:59.048847 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acce795c-a834-4d1e-b56d-580073dbb404 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:59.049126 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acce795c-a834-4d1e-b56d-580073dbb404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:59.068066 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-acce795c-a834-4d1e-b56d-580073dbb404 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:33:59.069322 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-acce795c-a834-4d1e-b56d-580073dbb404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:59.069813 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688669b2-c401-40d2-8d27-205137c50c27 tempest-ProjectsNegativeStaticTestJSON-1207424173 tempest-ProjectsNegativeStaticTestJSON-1207424173-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52f280d8738f4853ae6b4e7921cc56e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4de224fbae5147eca4191ac7458f8078', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:59.070647 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688669b2-c401-40d2-8d27-205137c50c27 tempest-ProjectsNegativeStaticTestJSON-1207424173 tempest-ProjectsNegativeStaticTestJSON-1207424173-project-admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:59.070986 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688669b2-c401-40d2-8d27-205137c50c27 tempest-ProjectsNegativeStaticTestJSON-1207424173 tempest-ProjectsNegativeStaticTestJSON-1207424173-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:59.071327 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688669b2-c401-40d2-8d27-205137c50c27 tempest-ProjectsNegativeStaticTestJSON-1207424173 tempest-ProjectsNegativeStaticTestJSON-1207424173-project-admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:59.072547 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688669b2-c401-40d2-8d27-205137c50c27 tempest-ProjectsNegativeStaticTestJSON-1207424173 tempest-ProjectsNegativeStaticTestJSON-1207424173-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:59.074200 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688669b2-c401-40d2-8d27-205137c50c27 tempest-ProjectsNegativeStaticTestJSON-1207424173 tempest-ProjectsNegativeStaticTestJSON-1207424173-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:59.094540 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-688669b2-c401-40d2-8d27-205137c50c27 tempest-ProjectsNegativeStaticTestJSON-1207424173 tempest-ProjectsNegativeStaticTestJSON-1207424173-project-admin] Invalid input for field 'name': '' is too short Jul 23 21:33:59.094540 ncdv-master-1 devstack@keystone.service[91548]: Failed validating 'minLength' in schema['properties']['name']: Jul 23 21:33:59.094540 ncdv-master-1 devstack@keystone.service[91548]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jul 23 21:33:59.094540 ncdv-master-1 devstack@keystone.service[91548]: On instance['name']: Jul 23 21:33:59.094540 ncdv-master-1 devstack@keystone.service[91548]: '': keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Jul 23 21:33:59.094540 ncdv-master-1 devstack@keystone.service[91548]: Failed validating 'minLength' in schema['properties']['name']: Jul 23 21:33:59.094540 ncdv-master-1 devstack@keystone.service[91548]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jul 23 21:33:59.094540 ncdv-master-1 devstack@keystone.service[91548]: On instance['name']: Jul 23 21:33:59.094540 ncdv-master-1 devstack@keystone.service[91548]: '' Jul 23 21:33:59.094540 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 21:33:59.094540 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Jul 23 21:33:59.094540 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Jul 23 21:33:59.094540 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 23 21:33:59.094540 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise error Jul 23 21:33:59.094540 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: '' is too short Jul 23 21:33:59.094540 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 21:33:59.094540 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Jul 23 21:33:59.094540 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jul 23 21:33:59.094540 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 21:33:59.094540 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application On instance['name']: Jul 23 21:33:59.094540 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application '' Jul 23 21:33:59.094540 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 21:33:59.094540 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 23 21:33:59.096071 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 21:33:59.096071 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 21:33:59.096071 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 21:33:59.096071 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 21:33:59.096071 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 21:33:59.096071 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 21:33:59.096071 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 21:33:59.096071 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 21:33:59.096071 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 21:33:59.096071 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 21:33:59.096071 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 21:33:59.096071 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 21:33:59.096071 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 165, in post Jul 23 21:33:59.096071 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application validation.lazy_validate(schema.project_create, project) Jul 23 21:33:59.096071 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Jul 23 21:33:59.096071 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Jul 23 21:33:59.096071 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Jul 23 21:33:59.097093 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Jul 23 21:33:59.097093 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Jul 23 21:33:59.097093 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 21:33:59.097093 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Jul 23 21:33:59.097093 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jul 23 21:33:59.097093 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 21:33:59.097093 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application On instance['name']: Jul 23 21:33:59.097093 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application '' Jul 23 21:33:59.097093 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 21:33:59.097093 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2928/5839] 10.222.0.17 () {60 vars in 1151 bytes} [Sat Jul 23 21:33:58 2022] POST /identity/v3/projects => generated 283 bytes in 113 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Jul 23 21:33:59.101918 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688669b2-c401-40d2-8d27-205137c50c27 tempest-ProjectsNegativeStaticTestJSON-1207424173 tempest-ProjectsNegativeStaticTestJSON-1207424173-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:59.103912 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-688669b2-c401-40d2-8d27-205137c50c27 tempest-ProjectsNegativeStaticTestJSON-1207424173 tempest-ProjectsNegativeStaticTestJSON-1207424173-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:59.122558 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688669b2-c401-40d2-8d27-205137c50c27 tempest-ProjectsNegativeStaticTestJSON-1207424173 tempest-ProjectsNegativeStaticTestJSON-1207424173-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:59.132030 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605dfdf0-5f18-4efb-bf4b-cf781f0f24a8 tempest-ProjectsNegativeStaticTestJSON-1207424173 tempest-ProjectsNegativeStaticTestJSON-1207424173-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52f280d8738f4853ae6b4e7921cc56e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4de224fbae5147eca4191ac7458f8078', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:59.132720 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605dfdf0-5f18-4efb-bf4b-cf781f0f24a8 tempest-ProjectsNegativeStaticTestJSON-1207424173 tempest-ProjectsNegativeStaticTestJSON-1207424173-project-admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:59.133108 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605dfdf0-5f18-4efb-bf4b-cf781f0f24a8 tempest-ProjectsNegativeStaticTestJSON-1207424173 tempest-ProjectsNegativeStaticTestJSON-1207424173-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:59.133387 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605dfdf0-5f18-4efb-bf4b-cf781f0f24a8 tempest-ProjectsNegativeStaticTestJSON-1207424173 tempest-ProjectsNegativeStaticTestJSON-1207424173-project-admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:59.134169 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605dfdf0-5f18-4efb-bf4b-cf781f0f24a8 tempest-ProjectsNegativeStaticTestJSON-1207424173 tempest-ProjectsNegativeStaticTestJSON-1207424173-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:59.136171 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605dfdf0-5f18-4efb-bf4b-cf781f0f24a8 tempest-ProjectsNegativeStaticTestJSON-1207424173 tempest-ProjectsNegativeStaticTestJSON-1207424173-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:59.142989 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-605dfdf0-5f18-4efb-bf4b-cf781f0f24a8 tempest-ProjectsNegativeStaticTestJSON-1207424173 tempest-ProjectsNegativeStaticTestJSON-1207424173-project-admin] Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 23 21:33:59.142989 ncdv-master-1 devstack@keystone.service[91548]: Failed validating 'maxLength' in schema['properties']['name']: Jul 23 21:33:59.142989 ncdv-master-1 devstack@keystone.service[91548]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jul 23 21:33:59.142989 ncdv-master-1 devstack@keystone.service[91548]: On instance['name']: Jul 23 21:33:59.142989 ncdv-master-1 devstack@keystone.service[91548]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 23 21:33:59.142989 ncdv-master-1 devstack@keystone.service[91548]: Failed validating 'maxLength' in schema['properties']['name']: Jul 23 21:33:59.142989 ncdv-master-1 devstack@keystone.service[91548]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jul 23 21:33:59.142989 ncdv-master-1 devstack@keystone.service[91548]: On instance['name']: Jul 23 21:33:59.142989 ncdv-master-1 devstack@keystone.service[91548]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 23 21:33:59.142989 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 21:33:59.142989 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Jul 23 21:33:59.142989 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Jul 23 21:33:59.142989 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 23 21:33:59.142989 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise error Jul 23 21:33:59.142989 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 23 21:33:59.142989 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 21:33:59.142989 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Jul 23 21:33:59.142989 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jul 23 21:33:59.144674 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 21:33:59.144674 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application On instance['name']: Jul 23 21:33:59.144674 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 23 21:33:59.144674 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 21:33:59.144674 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 23 21:33:59.144674 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 21:33:59.144674 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 21:33:59.144674 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 21:33:59.144674 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 21:33:59.144674 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 21:33:59.144674 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 21:33:59.144674 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 21:33:59.144674 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 21:33:59.144674 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 21:33:59.144674 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 21:33:59.144674 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 21:33:59.144674 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 21:33:59.144674 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 165, in post Jul 23 21:33:59.146260 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application validation.lazy_validate(schema.project_create, project) Jul 23 21:33:59.146260 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Jul 23 21:33:59.146260 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Jul 23 21:33:59.146260 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Jul 23 21:33:59.146260 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Jul 23 21:33:59.146260 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 23 21:33:59.146260 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 21:33:59.146260 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Jul 23 21:33:59.146260 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jul 23 21:33:59.146260 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 21:33:59.146260 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application On instance['name']: Jul 23 21:33:59.146260 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 23 21:33:59.146260 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 21:33:59.146260 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2929/5840] 10.222.0.17 () {60 vars in 1151 bytes} [Sat Jul 23 21:33:59 2022] POST /identity/v3/projects => generated 412 bytes in 43 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Jul 23 21:33:59.150090 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605dfdf0-5f18-4efb-bf4b-cf781f0f24a8 tempest-ProjectsNegativeStaticTestJSON-1207424173 tempest-ProjectsNegativeStaticTestJSON-1207424173-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:59.162700 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605dfdf0-5f18-4efb-bf4b-cf781f0f24a8 tempest-ProjectsNegativeStaticTestJSON-1207424173 tempest-ProjectsNegativeStaticTestJSON-1207424173-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:59.164109 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2912/5841] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:33:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:33:59.168364 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b0588e-d643-4b12-836b-55ca1820425f tempest-ProjectsNegativeStaticTestJSON-1207424173 tempest-ProjectsNegativeStaticTestJSON-1207424173-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52f280d8738f4853ae6b4e7921cc56e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4de224fbae5147eca4191ac7458f8078', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:59.169268 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b0588e-d643-4b12-836b-55ca1820425f tempest-ProjectsNegativeStaticTestJSON-1207424173 tempest-ProjectsNegativeStaticTestJSON-1207424173-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:59.169570 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b0588e-d643-4b12-836b-55ca1820425f tempest-ProjectsNegativeStaticTestJSON-1207424173 tempest-ProjectsNegativeStaticTestJSON-1207424173-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:59.169830 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b0588e-d643-4b12-836b-55ca1820425f tempest-ProjectsNegativeStaticTestJSON-1207424173 tempest-ProjectsNegativeStaticTestJSON-1207424173-project-admin] PATH_INFO: `/v3/projects/64c118e4887a41e49e8b90184156eaa2` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:59.173759 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbee0e0-9879-48f2-86e3-076d2c4fa579 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:59.174465 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbee0e0-9879-48f2-86e3-076d2c4fa579 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:59.174946 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbee0e0-9879-48f2-86e3-076d2c4fa579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:59.178558 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b0588e-d643-4b12-836b-55ca1820425f tempest-ProjectsNegativeStaticTestJSON-1207424173 tempest-ProjectsNegativeStaticTestJSON-1207424173-project-admin] RBAC: Authorizing `identity:delete_project(project_id=64c118e4887a41e49e8b90184156eaa2)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:59.180983 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b0588e-d643-4b12-836b-55ca1820425f tempest-ProjectsNegativeStaticTestJSON-1207424173 tempest-ProjectsNegativeStaticTestJSON-1207424173-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:59.199047 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-82b0588e-d643-4b12-836b-55ca1820425f tempest-ProjectsNegativeStaticTestJSON-1207424173 tempest-ProjectsNegativeStaticTestJSON-1207424173-project-admin] Could not find project: 64c118e4887a41e49e8b90184156eaa2.: keystone.exception.ProjectNotFound: Could not find project: 64c118e4887a41e49e8b90184156eaa2. Jul 23 21:33:59.199047 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 21:33:59.199047 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 21:33:59.199047 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 21:33:59.199047 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 21:33:59.199047 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 21:33:59.199047 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 21:33:59.199047 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 21:33:59.199047 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 21:33:59.199047 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 21:33:59.199047 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 21:33:59.199047 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 21:33:59.199047 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 211, in delete Jul 23 21:33:59.199047 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_project( Jul 23 21:33:59.199964 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 21:33:59.199964 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 21:33:59.199964 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 478, in delete_project Jul 23 21:33:59.199964 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application project = self.driver.get_project(project_id) Jul 23 21:33:59.199964 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 23 21:33:59.199964 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 23 21:33:59.199964 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 23 21:33:59.199964 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 23 21:33:59.199964 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 64c118e4887a41e49e8b90184156eaa2. Jul 23 21:33:59.199964 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 21:33:59.201014 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2930/5842] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:33:59 2022] DELETE /identity/v3/projects/64c118e4887a41e49e8b90184156eaa2 => generated 113 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 23 21:33:59.202013 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-4bbee0e0-9879-48f2-86e3-076d2c4fa579 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:33:59.204011 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-4bbee0e0-9879-48f2-86e3-076d2c4fa579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:59.205487 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b0588e-d643-4b12-836b-55ca1820425f tempest-ProjectsNegativeStaticTestJSON-1207424173 tempest-ProjectsNegativeStaticTestJSON-1207424173-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:59.208461 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-82b0588e-d643-4b12-836b-55ca1820425f tempest-ProjectsNegativeStaticTestJSON-1207424173 tempest-ProjectsNegativeStaticTestJSON-1207424173-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:59.222223 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2913/5843] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:33:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:33:59.226860 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbee0e0-9879-48f2-86e3-076d2c4fa579 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:59.240070 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbee0e0-9879-48f2-86e3-076d2c4fa579 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:59.247142 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420c29d3-bebc-4899-bf95-0ddbd75a072a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:59.247964 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420c29d3-bebc-4899-bf95-0ddbd75a072a admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:59.248459 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420c29d3-bebc-4899-bf95-0ddbd75a072a admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:59.249331 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420c29d3-bebc-4899-bf95-0ddbd75a072a admin admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:59.250249 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420c29d3-bebc-4899-bf95-0ddbd75a072a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:33:59.251140 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420c29d3-bebc-4899-bf95-0ddbd75a072a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:59.253447 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420c29d3-bebc-4899-bf95-0ddbd75a072a admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:59.277425 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2914/5844] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:33:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:33:59.278576 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420c29d3-bebc-4899-bf95-0ddbd75a072a admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:59.290560 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:33:59.299566 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420c29d3-bebc-4899-bf95-0ddbd75a072a admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:59.301176 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b0588e-d643-4b12-836b-55ca1820425f tempest-ProjectsNegativeStaticTestJSON-1207424173 tempest-ProjectsNegativeStaticTestJSON-1207424173-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:59.306504 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824c71b1-193e-4328-973f-078edae905e9 tempest-ProjectsNegativeStaticTestJSON-1875953852 tempest-ProjectsNegativeStaticTestJSON-1875953852-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d74e63e8c044840b6434d063afd352a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b29a6f04e89a456abd89c29907e06220', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:59.307892 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824c71b1-193e-4328-973f-078edae905e9 tempest-ProjectsNegativeStaticTestJSON-1875953852 tempest-ProjectsNegativeStaticTestJSON-1875953852-project] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:59.308252 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537a83f5-4b79-45ba-b109-45435dfa2ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:59.308401 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824c71b1-193e-4328-973f-078edae905e9 tempest-ProjectsNegativeStaticTestJSON-1875953852 tempest-ProjectsNegativeStaticTestJSON-1875953852-project] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:59.308770 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824c71b1-193e-4328-973f-078edae905e9 tempest-ProjectsNegativeStaticTestJSON-1875953852 tempest-ProjectsNegativeStaticTestJSON-1875953852-project] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:59.309059 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537a83f5-4b79-45ba-b109-45435dfa2ca9 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:59.309928 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824c71b1-193e-4328-973f-078edae905e9 tempest-ProjectsNegativeStaticTestJSON-1875953852 tempest-ProjectsNegativeStaticTestJSON-1875953852-project] RBAC: Authorizing `identity:list_projects()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:59.310508 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537a83f5-4b79-45ba-b109-45435dfa2ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:59.310863 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537a83f5-4b79-45ba-b109-45435dfa2ca9 admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:59.312382 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537a83f5-4b79-45ba-b109-45435dfa2ca9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:59.315423 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537a83f5-4b79-45ba-b109-45435dfa2ca9 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:59.317540 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-824c71b1-193e-4328-973f-078edae905e9 tempest-ProjectsNegativeStaticTestJSON-1875953852 tempest-ProjectsNegativeStaticTestJSON-1875953852-project] You are not authorized to perform the requested action: identity:list_projects.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:list_projects. Jul 23 21:33:59.317540 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 21:33:59.317540 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 21:33:59.317540 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 21:33:59.317540 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 21:33:59.317540 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 21:33:59.317540 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 21:33:59.317540 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 21:33:59.317540 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 21:33:59.317540 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 21:33:59.317540 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 21:33:59.317540 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 21:33:59.317540 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 153, in get Jul 23 21:33:59.317540 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._list_projects() Jul 23 21:33:59.318678 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 120, in _list_projects Jul 23 21:33:59.318678 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:list_projects', Jul 23 21:33:59.318678 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 455, in enforce_call Jul 23 21:33:59.318678 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application enforcer_obj._enforce( Jul 23 21:33:59.318678 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 125, in _enforce Jul 23 21:33:59.318678 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application result = self._enforcer.enforce( Jul 23 21:33:59.318678 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 23 21:33:59.318678 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exc(*args, **kwargs) Jul 23 21:33:59.318678 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:list_projects. Jul 23 21:33:59.318678 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 21:33:59.322046 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2931/5845] 10.222.0.17 () {58 vars in 1130 bytes} [Sat Jul 23 21:33:59 2022] GET /identity/v3/projects => generated 135 bytes in 117 msecs (HTTP/1.1 403) 5 headers in 184 bytes (2 switches on core 0) Jul 23 21:33:59.325076 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824c71b1-193e-4328-973f-078edae905e9 tempest-ProjectsNegativeStaticTestJSON-1875953852 tempest-ProjectsNegativeStaticTestJSON-1875953852-project] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:59.357945 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2915/5846] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:33:59 2022] POST /identity/v3/projects => generated 399 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:33:59.360237 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537a83f5-4b79-45ba-b109-45435dfa2ca9 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:59.363557 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824c71b1-193e-4328-973f-078edae905e9 tempest-ProjectsNegativeStaticTestJSON-1875953852 tempest-ProjectsNegativeStaticTestJSON-1875953852-project] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:59.389700 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:33:59.445919 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537a83f5-4b79-45ba-b109-45435dfa2ca9 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:59.452003 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7dbe8a-7ff0-409b-8133-656b59721e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:59.453328 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7dbe8a-7ff0-409b-8133-656b59721e1f admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:59.453688 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7dbe8a-7ff0-409b-8133-656b59721e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:59.454117 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7dbe8a-7ff0-409b-8133-656b59721e1f admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:59.455119 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7dbe8a-7ff0-409b-8133-656b59721e1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:59.456733 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c44b51-e29b-49d1-bab1-0d2b6f39c249 tempest-ProjectsNegativeStaticTestJSON-1207424173 tempest-ProjectsNegativeStaticTestJSON-1207424173-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52f280d8738f4853ae6b4e7921cc56e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4de224fbae5147eca4191ac7458f8078', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:59.458034 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c44b51-e29b-49d1-bab1-0d2b6f39c249 tempest-ProjectsNegativeStaticTestJSON-1207424173 tempest-ProjectsNegativeStaticTestJSON-1207424173-project-admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:59.458152 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c44b51-e29b-49d1-bab1-0d2b6f39c249 tempest-ProjectsNegativeStaticTestJSON-1207424173 tempest-ProjectsNegativeStaticTestJSON-1207424173-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:59.458381 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c44b51-e29b-49d1-bab1-0d2b6f39c249 tempest-ProjectsNegativeStaticTestJSON-1207424173 tempest-ProjectsNegativeStaticTestJSON-1207424173-project-admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:59.458512 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7dbe8a-7ff0-409b-8133-656b59721e1f admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:59.459316 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c44b51-e29b-49d1-bab1-0d2b6f39c249 tempest-ProjectsNegativeStaticTestJSON-1207424173 tempest-ProjectsNegativeStaticTestJSON-1207424173-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:59.464654 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c44b51-e29b-49d1-bab1-0d2b6f39c249 tempest-ProjectsNegativeStaticTestJSON-1207424173 tempest-ProjectsNegativeStaticTestJSON-1207424173-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:59.492077 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2916/5847] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:33:59 2022] POST /identity/v3/users => generated 306 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:33:59.512610 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7dbe8a-7ff0-409b-8133-656b59721e1f admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:59.524263 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2932/5848] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:33:59 2022] POST /identity/v3/projects => generated 358 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:33:59.528113 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7dbe8a-7ff0-409b-8133-656b59721e1f admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:59.529204 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c44b51-e29b-49d1-bab1-0d2b6f39c249 tempest-ProjectsNegativeStaticTestJSON-1207424173 tempest-ProjectsNegativeStaticTestJSON-1207424173-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:59.639111 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c44b51-e29b-49d1-bab1-0d2b6f39c249 tempest-ProjectsNegativeStaticTestJSON-1207424173 tempest-ProjectsNegativeStaticTestJSON-1207424173-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:59.644321 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10149115-372a-4f12-9b4f-7912974172a8 tempest-ProjectsNegativeStaticTestJSON-1207424173 tempest-ProjectsNegativeStaticTestJSON-1207424173-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52f280d8738f4853ae6b4e7921cc56e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4de224fbae5147eca4191ac7458f8078', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:59.645370 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10149115-372a-4f12-9b4f-7912974172a8 tempest-ProjectsNegativeStaticTestJSON-1207424173 tempest-ProjectsNegativeStaticTestJSON-1207424173-project-admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:59.645623 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb51ad27-5b57-4c91-8638-91aa3160bc39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:59.645756 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10149115-372a-4f12-9b4f-7912974172a8 tempest-ProjectsNegativeStaticTestJSON-1207424173 tempest-ProjectsNegativeStaticTestJSON-1207424173-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:59.646464 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb51ad27-5b57-4c91-8638-91aa3160bc39 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:59.646648 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10149115-372a-4f12-9b4f-7912974172a8 tempest-ProjectsNegativeStaticTestJSON-1207424173 tempest-ProjectsNegativeStaticTestJSON-1207424173-project-admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:59.646953 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb51ad27-5b57-4c91-8638-91aa3160bc39 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:59.647311 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb51ad27-5b57-4c91-8638-91aa3160bc39 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:59.647641 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10149115-372a-4f12-9b4f-7912974172a8 tempest-ProjectsNegativeStaticTestJSON-1207424173 tempest-ProjectsNegativeStaticTestJSON-1207424173-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:59.648176 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb51ad27-5b57-4c91-8638-91aa3160bc39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:59.649976 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10149115-372a-4f12-9b4f-7912974172a8 tempest-ProjectsNegativeStaticTestJSON-1207424173 tempest-ProjectsNegativeStaticTestJSON-1207424173-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:59.650107 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb51ad27-5b57-4c91-8638-91aa3160bc39 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:59.664635 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2917/5849] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:33:59 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:33:59.667462 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb51ad27-5b57-4c91-8638-91aa3160bc39 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:59.678311 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.sql.core [None req-10149115-372a-4f12-9b4f-7912974172a8 tempest-ProjectsNegativeStaticTestJSON-1207424173 tempest-ProjectsNegativeStaticTestJSON-1207424173-project-admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-tempest-project-dup-325565820' for key 'project.ixu_project_name_domain_id'") Jul 23 21:33:59.678311 ncdv-master-1 devstack@keystone.service[91548]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 23 21:33:59.678311 ncdv-master-1 devstack@keystone.service[91548]: [parameters: {'id': 'c0abe2cfe7a14a6e820c0c9d8fd490b3', 'name': 'tempest-project-dup-325565820', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 23 21:33:59.678311 ncdv-master-1 devstack@keystone.service[91548]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=91548) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 23 21:33:59.687421 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb51ad27-5b57-4c91-8638-91aa3160bc39 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:59.689109 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-10149115-372a-4f12-9b4f-7912974172a8 tempest-ProjectsNegativeStaticTestJSON-1207424173 tempest-ProjectsNegativeStaticTestJSON-1207424173-project-admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-325565820, project id c0abe2cfe7a14a6e820c0c9d8fd490b3.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-325565820, project id c0abe2cfe7a14a6e820c0c9d8fd490b3. Jul 23 21:33:59.689109 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 21:33:59.689109 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 23 21:33:59.689109 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 23 21:33:59.689109 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 23 21:33:59.689109 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 23 21:33:59.689109 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 23 21:33:59.689109 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application result = self._query(query) Jul 23 21:33:59.689109 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 23 21:33:59.689109 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application conn.query(q) Jul 23 21:33:59.689109 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 23 21:33:59.689109 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 23 21:33:59.690324 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 23 21:33:59.690324 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application result.read() Jul 23 21:33:59.690324 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 23 21:33:59.690324 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 23 21:33:59.690324 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 23 21:33:59.690324 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 23 21:33:59.690324 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 23 21:33:59.690324 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 23 21:33:59.690324 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 23 21:33:59.690324 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 23 21:33:59.690324 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-tempest-project-dup-325565820' for key 'project.ixu_project_name_domain_id'") Jul 23 21:33:59.690324 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 21:33:59.690324 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 23 21:33:59.690324 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 21:33:59.690324 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 21:33:59.690324 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 23 21:33:59.690324 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 23 21:33:59.691585 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 23 21:33:59.691585 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 23 21:33:59.691585 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 23 21:33:59.691585 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application next(self.gen) Jul 23 21:33:59.691585 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 23 21:33:59.691585 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application yield resource Jul 23 21:33:59.691585 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 23 21:33:59.691585 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application next(self.gen) Jul 23 21:33:59.691585 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 23 21:33:59.691585 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application self.session.rollback() Jul 23 21:33:59.691585 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 23 21:33:59.691585 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application self.force_reraise() Jul 23 21:33:59.691585 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 23 21:33:59.691585 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise self.value Jul 23 21:33:59.691585 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 23 21:33:59.691585 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 23 21:33:59.691585 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 23 21:33:59.691585 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application session.commit() Jul 23 21:33:59.696509 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 23 21:33:59.696509 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 23 21:33:59.696509 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 23 21:33:59.696509 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application self._prepare_impl() Jul 23 21:33:59.696509 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 23 21:33:59.696509 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application self.session.flush() Jul 23 21:33:59.696509 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 23 21:33:59.696509 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application self._flush(objects) Jul 23 21:33:59.696509 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 23 21:33:59.696509 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 23 21:33:59.696509 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 23 21:33:59.696509 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application compat.raise_( Jul 23 21:33:59.696509 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 23 21:33:59.696509 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception Jul 23 21:33:59.696509 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 23 21:33:59.696509 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application flush_context.execute() Jul 23 21:33:59.696509 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 23 21:33:59.697624 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rec.execute(self) Jul 23 21:33:59.697624 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 23 21:33:59.697624 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 23 21:33:59.697624 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 23 21:33:59.697624 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 23 21:33:59.697624 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 23 21:33:59.697624 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 23 21:33:59.697624 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 23 21:33:59.697624 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 23 21:33:59.697624 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 23 21:33:59.697624 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 23 21:33:59.697624 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 23 21:33:59.697624 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 23 21:33:59.697624 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 23 21:33:59.697624 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 23 21:33:59.697624 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 23 21:33:59.698716 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 23 21:33:59.698716 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 23 21:33:59.698716 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception Jul 23 21:33:59.698716 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 23 21:33:59.698716 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 23 21:33:59.698716 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 23 21:33:59.698716 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 23 21:33:59.698716 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 23 21:33:59.698716 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application result = self._query(query) Jul 23 21:33:59.698716 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 23 21:33:59.698716 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application conn.query(q) Jul 23 21:33:59.698716 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 23 21:33:59.698716 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 23 21:33:59.698716 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 23 21:33:59.698716 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application result.read() Jul 23 21:33:59.698716 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 23 21:33:59.698716 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 23 21:33:59.699771 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 23 21:33:59.699771 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 23 21:33:59.699771 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 23 21:33:59.699771 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 23 21:33:59.699771 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 23 21:33:59.699771 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 23 21:33:59.699771 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-tempest-project-dup-325565820' for key 'project.ixu_project_name_domain_id'") Jul 23 21:33:59.699771 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 23 21:33:59.699771 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [parameters: {'id': 'c0abe2cfe7a14a6e820c0c9d8fd490b3', 'name': 'tempest-project-dup-325565820', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 23 21:33:59.699771 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 23 21:33:59.699771 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 21:33:59.699771 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 23 21:33:59.699771 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 21:33:59.699771 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 21:33:59.699771 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 23 21:33:59.700660 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 23 21:33:59.700660 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 23 21:33:59.700660 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 23 21:33:59.700660 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name tempest-project-dup-325565820 at domain ID default. Jul 23 21:33:59.700660 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 21:33:59.700660 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 23 21:33:59.700660 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 21:33:59.700660 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 21:33:59.700660 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 21:33:59.700660 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 21:33:59.700660 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 21:33:59.700660 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 21:33:59.700660 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 21:33:59.700660 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 21:33:59.700660 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 21:33:59.700660 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 21:33:59.700660 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 21:33:59.701735 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 21:33:59.701735 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 23 21:33:59.701735 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 23 21:33:59.701735 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 21:33:59.701735 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 21:33:59.701735 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 23 21:33:59.701735 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 23 21:33:59.701735 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-325565820, project id c0abe2cfe7a14a6e820c0c9d8fd490b3. Jul 23 21:33:59.701735 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 21:33:59.701735 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2933/5850] 10.222.0.17 () {60 vars in 1151 bytes} [Sat Jul 23 21:33:59 2022] POST /identity/v3/projects => generated 284 bytes in 163 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 23 21:33:59.701735 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10149115-372a-4f12-9b4f-7912974172a8 tempest-ProjectsNegativeStaticTestJSON-1207424173 tempest-ProjectsNegativeStaticTestJSON-1207424173-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:59.710599 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10149115-372a-4f12-9b4f-7912974172a8 tempest-ProjectsNegativeStaticTestJSON-1207424173 tempest-ProjectsNegativeStaticTestJSON-1207424173-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:59.711832 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf56f81-8c8c-490d-8af7-f1303fdc4b6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:59.713072 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf56f81-8c8c-490d-8af7-f1303fdc4b6d admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:59.713792 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf56f81-8c8c-490d-8af7-f1303fdc4b6d admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:59.714365 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf56f81-8c8c-490d-8af7-f1303fdc4b6d admin admin] PATH_INFO: `/v3/projects/cf919783310d49d39328cc7c11b90c17/users/85633a1ad8ec49339664c56c001bbdae/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:59.716081 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66faeafd-c860-4149-be8f-3a1a8e414e89 tempest-ProjectsNegativeStaticTestJSON-1207424173 tempest-ProjectsNegativeStaticTestJSON-1207424173-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52f280d8738f4853ae6b4e7921cc56e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4de224fbae5147eca4191ac7458f8078', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:59.716975 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66faeafd-c860-4149-be8f-3a1a8e414e89 tempest-ProjectsNegativeStaticTestJSON-1207424173 tempest-ProjectsNegativeStaticTestJSON-1207424173-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:59.717259 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66faeafd-c860-4149-be8f-3a1a8e414e89 tempest-ProjectsNegativeStaticTestJSON-1207424173 tempest-ProjectsNegativeStaticTestJSON-1207424173-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:59.717540 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66faeafd-c860-4149-be8f-3a1a8e414e89 tempest-ProjectsNegativeStaticTestJSON-1207424173 tempest-ProjectsNegativeStaticTestJSON-1207424173-project-admin] PATH_INFO: `/v3/projects/2cd4ddea93924a8e96010766a7f65dee` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:59.718966 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66faeafd-c860-4149-be8f-3a1a8e414e89 tempest-ProjectsNegativeStaticTestJSON-1207424173 tempest-ProjectsNegativeStaticTestJSON-1207424173-project-admin] RBAC: Authorizing `identity:delete_project(project_id=2cd4ddea93924a8e96010766a7f65dee)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:59.721361 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66faeafd-c860-4149-be8f-3a1a8e414e89 tempest-ProjectsNegativeStaticTestJSON-1207424173 tempest-ProjectsNegativeStaticTestJSON-1207424173-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:59.749321 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf56f81-8c8c-490d-8af7-f1303fdc4b6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf919783310d49d39328cc7c11b90c17, user_id=85633a1ad8ec49339664c56c001bbdae, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:59.758395 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf56f81-8c8c-490d-8af7-f1303fdc4b6d admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:59.786014 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2918/5851] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:33:59 2022] PUT /identity/v3/projects/cf919783310d49d39328cc7c11b90c17/users/85633a1ad8ec49339664c56c001bbdae/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:33:59.789516 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf56f81-8c8c-490d-8af7-f1303fdc4b6d admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:59.799333 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-66faeafd-c860-4149-be8f-3a1a8e414e89 tempest-ProjectsNegativeStaticTestJSON-1207424173 tempest-ProjectsNegativeStaticTestJSON-1207424173-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2cd4ddea93924a8e96010766a7f65dee', 'request_id': 'req-66faeafd-c860-4149-be8f-3a1a8e414e89'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:59.811096 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-66faeafd-c860-4149-be8f-3a1a8e414e89 tempest-ProjectsNegativeStaticTestJSON-1207424173 tempest-ProjectsNegativeStaticTestJSON-1207424173-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2cd4ddea93924a8e96010766a7f65dee', 'request_id': 'req-66faeafd-c860-4149-be8f-3a1a8e414e89'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:59.821798 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-66faeafd-c860-4149-be8f-3a1a8e414e89 tempest-ProjectsNegativeStaticTestJSON-1207424173 tempest-ProjectsNegativeStaticTestJSON-1207424173-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2cd4ddea93924a8e96010766a7f65dee', 'request_id': 'req-66faeafd-c860-4149-be8f-3a1a8e414e89'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:59.836281 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-66faeafd-c860-4149-be8f-3a1a8e414e89 tempest-ProjectsNegativeStaticTestJSON-1207424173 tempest-ProjectsNegativeStaticTestJSON-1207424173-project-admin] The token cache is being invalidate because project 2cd4ddea93924a8e96010766a7f65dee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:33:59.836568 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-66faeafd-c860-4149-be8f-3a1a8e414e89 tempest-ProjectsNegativeStaticTestJSON-1207424173 tempest-ProjectsNegativeStaticTestJSON-1207424173-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:59.838705 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-66faeafd-c860-4149-be8f-3a1a8e414e89 tempest-ProjectsNegativeStaticTestJSON-1207424173 tempest-ProjectsNegativeStaticTestJSON-1207424173-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:33:59.840962 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2934/5852] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:33:59 2022] DELETE /identity/v3/projects/2cd4ddea93924a8e96010766a7f65dee => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:33:59.845725 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66faeafd-c860-4149-be8f-3a1a8e414e89 tempest-ProjectsNegativeStaticTestJSON-1207424173 tempest-ProjectsNegativeStaticTestJSON-1207424173-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:59.849702 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-66faeafd-c860-4149-be8f-3a1a8e414e89 tempest-ProjectsNegativeStaticTestJSON-1207424173 tempest-ProjectsNegativeStaticTestJSON-1207424173-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:33:59.851504 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:33:59.875538 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:33:59.876657 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf56f81-8c8c-490d-8af7-f1303fdc4b6d admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:59.971435 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65468d67-9baf-4bef-87f4-9147a2df8f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:33:59.972123 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65468d67-9baf-4bef-87f4-9147a2df8f6c admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:33:59.972444 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65468d67-9baf-4bef-87f4-9147a2df8f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:33:59.972767 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65468d67-9baf-4bef-87f4-9147a2df8f6c admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:33:59.973502 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65468d67-9baf-4bef-87f4-9147a2df8f6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:33:59.975421 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65468d67-9baf-4bef-87f4-9147a2df8f6c admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:33:59.986282 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66faeafd-c860-4149-be8f-3a1a8e414e89 tempest-ProjectsNegativeStaticTestJSON-1207424173 tempest-ProjectsNegativeStaticTestJSON-1207424173-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:33:59.990136 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2919/5853] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:33:59 2022] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:33:59.994473 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65468d67-9baf-4bef-87f4-9147a2df8f6c admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:33:59.996420 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-65468d67-9baf-4bef-87f4-9147a2df8f6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:00.007760 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca305fb-8147-4aee-aff2-626c94289f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:00.008860 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca305fb-8147-4aee-aff2-626c94289f06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:00.009295 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca305fb-8147-4aee-aff2-626c94289f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:00.009576 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca305fb-8147-4aee-aff2-626c94289f06 admin admin] PATH_INFO: `/v3/users/5d74e63e8c044840b6434d063afd352a` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:00.010891 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca305fb-8147-4aee-aff2-626c94289f06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d74e63e8c044840b6434d063afd352a)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:00.011560 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65468d67-9baf-4bef-87f4-9147a2df8f6c admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:00.013009 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca305fb-8147-4aee-aff2-626c94289f06 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:00.016719 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c357c261-03e7-4c30-baac-d1df52f1182f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:00.017967 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c357c261-03e7-4c30-baac-d1df52f1182f admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:00.018380 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c357c261-03e7-4c30-baac-d1df52f1182f admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:00.018657 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c357c261-03e7-4c30-baac-d1df52f1182f admin admin] PATH_INFO: `/v3/projects/cf919783310d49d39328cc7c11b90c17/users/85633a1ad8ec49339664c56c001bbdae/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:00.021002 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c357c261-03e7-4c30-baac-d1df52f1182f admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf919783310d49d39328cc7c11b90c17, user_id=85633a1ad8ec49339664c56c001bbdae, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:00.024642 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c357c261-03e7-4c30-baac-d1df52f1182f admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:00.045996 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2920/5854] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:33:59 2022] PUT /identity/v3/projects/cf919783310d49d39328cc7c11b90c17/users/85633a1ad8ec49339664c56c001bbdae/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:00.056673 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b18db58-bcbd-494a-b3b6-d74153d3b8bb None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:00.058152 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b18db58-bcbd-494a-b3b6-d74153d3b8bb None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:00.058684 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b18db58-bcbd-494a-b3b6-d74153d3b8bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:00.090391 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-dca305fb-8147-4aee-aff2-626c94289f06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d74e63e8c044840b6434d063afd352a'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:00.091140 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-dca305fb-8147-4aee-aff2-626c94289f06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d74e63e8c044840b6434d063afd352a'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:00.096661 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-5b18db58-bcbd-494a-b3b6-d74153d3b8bb None None] MFA Rules not processed for user `85633a1ad8ec49339664c56c001bbdae`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:34:00.097919 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-5b18db58-bcbd-494a-b3b6-d74153d3b8bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:00.103553 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-dca305fb-8147-4aee-aff2-626c94289f06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d74e63e8c044840b6434d063afd352a'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:00.116705 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-dca305fb-8147-4aee-aff2-626c94289f06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d74e63e8c044840b6434d063afd352a'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:00.125952 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-dca305fb-8147-4aee-aff2-626c94289f06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d74e63e8c044840b6434d063afd352a'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:00.131924 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2935/5855] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:33:59 2022] DELETE /identity/v3/users/5d74e63e8c044840b6434d063afd352a => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:00.132826 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca305fb-8147-4aee-aff2-626c94289f06 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:00.134210 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-dca305fb-8147-4aee-aff2-626c94289f06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:00.169586 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2921/5856] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:34:00 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:34:00.174412 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf640826-dc07-4b4d-9983-d8b8c4191dfb None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:00.174698 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf640826-dc07-4b4d-9983-d8b8c4191dfb None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:00.174973 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf640826-dc07-4b4d-9983-d8b8c4191dfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:00.191849 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-cf640826-dc07-4b4d-9983-d8b8c4191dfb None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:34:00.193050 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-cf640826-dc07-4b4d-9983-d8b8c4191dfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:00.200616 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca305fb-8147-4aee-aff2-626c94289f06 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:00.201218 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2922/5857] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:34:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:34:00.202007 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf640826-dc07-4b4d-9983-d8b8c4191dfb None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:00.205059 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-cf640826-dc07-4b4d-9983-d8b8c4191dfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:00.205605 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe8ecae-5335-47f5-b8c8-30f03237de58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:00.206528 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe8ecae-5335-47f5-b8c8-30f03237de58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:00.206809 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe8ecae-5335-47f5-b8c8-30f03237de58 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:00.207082 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe8ecae-5335-47f5-b8c8-30f03237de58 admin admin] PATH_INFO: `/v3/users/37b1e260651b4dffa7c1efe8e9d0f144` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:00.208319 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe8ecae-5335-47f5-b8c8-30f03237de58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37b1e260651b4dffa7c1efe8e9d0f144)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:00.210550 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe8ecae-5335-47f5-b8c8-30f03237de58 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:00.217186 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf640826-dc07-4b4d-9983-d8b8c4191dfb None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:00.221804 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a4b578-a829-4415-acd4-7826bc051573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:00.222520 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a4b578-a829-4415-acd4-7826bc051573 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:00.222802 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a4b578-a829-4415-acd4-7826bc051573 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:00.223074 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a4b578-a829-4415-acd4-7826bc051573 admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:00.223806 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a4b578-a829-4415-acd4-7826bc051573 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:00.226206 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a4b578-a829-4415-acd4-7826bc051573 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:00.257446 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2923/5858] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:34:00 2022] POST /identity/v3/projects => generated 397 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:34:00.257446 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a4b578-a829-4415-acd4-7826bc051573 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:00.257727 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:00.257822 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-f9a4b578-a829-4415-acd4-7826bc051573 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:00.262893 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-4fe8ecae-5335-47f5-b8c8-30f03237de58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37b1e260651b4dffa7c1efe8e9d0f144'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:00.263591 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-4fe8ecae-5335-47f5-b8c8-30f03237de58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37b1e260651b4dffa7c1efe8e9d0f144'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:00.271190 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-4fe8ecae-5335-47f5-b8c8-30f03237de58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37b1e260651b4dffa7c1efe8e9d0f144'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:00.279039 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-4fe8ecae-5335-47f5-b8c8-30f03237de58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37b1e260651b4dffa7c1efe8e9d0f144'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:00.291493 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:00.291773 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-4fe8ecae-5335-47f5-b8c8-30f03237de58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37b1e260651b4dffa7c1efe8e9d0f144'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:00.299020 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2936/5859] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:34:00 2022] DELETE /identity/v3/users/37b1e260651b4dffa7c1efe8e9d0f144 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:00.299882 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe8ecae-5335-47f5-b8c8-30f03237de58 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:00.301305 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-4fe8ecae-5335-47f5-b8c8-30f03237de58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:00.323824 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a4b578-a829-4415-acd4-7826bc051573 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:00.378502 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2249191f-6001-41ec-a8f2-9884a2b6c47d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:00.379128 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe8ecae-5335-47f5-b8c8-30f03237de58 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:00.379707 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2249191f-6001-41ec-a8f2-9884a2b6c47d service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:00.379990 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2249191f-6001-41ec-a8f2-9884a2b6c47d service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:00.380258 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2249191f-6001-41ec-a8f2-9884a2b6c47d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:00.382614 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-2249191f-6001-41ec-a8f2-9884a2b6c47d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:00.385116 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48258ceb-33f1-4a23-ba32-02b22a6c0fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:00.385885 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48258ceb-33f1-4a23-ba32-02b22a6c0fc0 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:00.386250 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48258ceb-33f1-4a23-ba32-02b22a6c0fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:00.386595 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48258ceb-33f1-4a23-ba32-02b22a6c0fc0 admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:00.387436 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48258ceb-33f1-4a23-ba32-02b22a6c0fc0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:00.389417 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48258ceb-33f1-4a23-ba32-02b22a6c0fc0 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:00.396392 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2249191f-6001-41ec-a8f2-9884a2b6c47d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:00.398410 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2249191f-6001-41ec-a8f2-9884a2b6c47d service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:00.411379 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2924/5860] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:34:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:34:00.423546 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2937/5861] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:34:00 2022] POST /identity/v3/users => generated 299 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:34:00.425112 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2249191f-6001-41ec-a8f2-9884a2b6c47d service neutron] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:00.435902 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2249191f-6001-41ec-a8f2-9884a2b6c47d service neutron] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:00.441288 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c59d95f-e60d-41f9-b68a-2aec39f498bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:00.442244 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c59d95f-e60d-41f9-b68a-2aec39f498bc admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:00.442590 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c59d95f-e60d-41f9-b68a-2aec39f498bc admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:00.442930 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c59d95f-e60d-41f9-b68a-2aec39f498bc admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:00.443777 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c59d95f-e60d-41f9-b68a-2aec39f498bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:00.445542 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c59d95f-e60d-41f9-b68a-2aec39f498bc admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:00.456476 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2925/5862] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:34:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:34:00.462159 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48258ceb-33f1-4a23-ba32-02b22a6c0fc0 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:00.476876 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48258ceb-33f1-4a23-ba32-02b22a6c0fc0 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:00.482652 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683e7d95-246f-4bb0-90fa-f5b86dc60666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:00.483539 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683e7d95-246f-4bb0-90fa-f5b86dc60666 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:00.483923 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683e7d95-246f-4bb0-90fa-f5b86dc60666 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:00.484360 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683e7d95-246f-4bb0-90fa-f5b86dc60666 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:00.485300 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683e7d95-246f-4bb0-90fa-f5b86dc60666 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:00.487133 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683e7d95-246f-4bb0-90fa-f5b86dc60666 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:00.495093 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c59d95f-e60d-41f9-b68a-2aec39f498bc admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:00.497458 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-0c59d95f-e60d-41f9-b68a-2aec39f498bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:00.501062 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2938/5863] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:34:00 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:34:00.505038 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683e7d95-246f-4bb0-90fa-f5b86dc60666 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:00.515195 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c59d95f-e60d-41f9-b68a-2aec39f498bc admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:00.518003 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683e7d95-246f-4bb0-90fa-f5b86dc60666 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:00.523395 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce19eda8-e20c-420e-9b16-c0001d3c991d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:00.524925 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce19eda8-e20c-420e-9b16-c0001d3c991d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:00.525111 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b1d402-8d52-44ea-9e5c-b758a4bab33c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:00.525252 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce19eda8-e20c-420e-9b16-c0001d3c991d admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:00.525483 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce19eda8-e20c-420e-9b16-c0001d3c991d admin admin] PATH_INFO: `/v3/projects/ebcf55bcaba04bf8ae8a9b2ac09e8d98` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:00.526137 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b1d402-8d52-44ea-9e5c-b758a4bab33c admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:00.526360 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b1d402-8d52-44ea-9e5c-b758a4bab33c admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:00.526630 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b1d402-8d52-44ea-9e5c-b758a4bab33c admin admin] PATH_INFO: `/v3/projects/3352fa96c34f476f9413d05dc420c38e/users/bed35b81374c409c877638f8212ad257/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:00.526794 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce19eda8-e20c-420e-9b16-c0001d3c991d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebcf55bcaba04bf8ae8a9b2ac09e8d98)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:00.528717 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce19eda8-e20c-420e-9b16-c0001d3c991d admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:00.556947 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b1d402-8d52-44ea-9e5c-b758a4bab33c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3352fa96c34f476f9413d05dc420c38e, user_id=bed35b81374c409c877638f8212ad257, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:00.560194 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b1d402-8d52-44ea-9e5c-b758a4bab33c admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:00.578977 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2939/5864] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:34:00 2022] PUT /identity/v3/projects/3352fa96c34f476f9413d05dc420c38e/users/bed35b81374c409c877638f8212ad257/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:00.587272 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-ce19eda8-e20c-420e-9b16-c0001d3c991d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebcf55bcaba04bf8ae8a9b2ac09e8d98', 'request_id': 'req-ce19eda8-e20c-420e-9b16-c0001d3c991d'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:00.592372 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97503a03-06d2-4482-a1bf-720e2ba74830 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:00.592850 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97503a03-06d2-4482-a1bf-720e2ba74830 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:00.594366 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97503a03-06d2-4482-a1bf-720e2ba74830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:00.602738 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-ce19eda8-e20c-420e-9b16-c0001d3c991d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebcf55bcaba04bf8ae8a9b2ac09e8d98', 'request_id': 'req-ce19eda8-e20c-420e-9b16-c0001d3c991d'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:00.614385 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-ce19eda8-e20c-420e-9b16-c0001d3c991d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebcf55bcaba04bf8ae8a9b2ac09e8d98', 'request_id': 'req-ce19eda8-e20c-420e-9b16-c0001d3c991d'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:00.629774 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-ce19eda8-e20c-420e-9b16-c0001d3c991d admin admin] The token cache is being invalidate because project ebcf55bcaba04bf8ae8a9b2ac09e8d98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:34:00.629996 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-ce19eda8-e20c-420e-9b16-c0001d3c991d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:00.630931 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-ce19eda8-e20c-420e-9b16-c0001d3c991d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:00.633750 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2926/5865] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:34:00 2022] DELETE /identity/v3/projects/ebcf55bcaba04bf8ae8a9b2ac09e8d98 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:00.640695 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3ca214-0497-4396-a2c9-1c7817385e12 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:00.640978 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3ca214-0497-4396-a2c9-1c7817385e12 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:00.641148 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-97503a03-06d2-4482-a1bf-720e2ba74830 None None] MFA Rules not processed for user `bed35b81374c409c877638f8212ad257`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:34:00.641255 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3ca214-0497-4396-a2c9-1c7817385e12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:00.642653 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-97503a03-06d2-4482-a1bf-720e2ba74830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:00.661893 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-bf3ca214-0497-4396-a2c9-1c7817385e12 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:34:00.663605 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-bf3ca214-0497-4396-a2c9-1c7817385e12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:00.724883 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:00.734288 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:DELETE=5,keystone:SELECT=90,keystone:INSERT=5 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:00.737515 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2927/5866] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:34:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:34:00.738501 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3ca214-0497-4396-a2c9-1c7817385e12 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:00.744400 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-bf3ca214-0497-4396-a2c9-1c7817385e12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:00.750407 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2940/5867] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:34:00 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:34:00.752892 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7716572-cae1-4f14-92f8-c9be21e0d8e5 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:00.753722 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7716572-cae1-4f14-92f8-c9be21e0d8e5 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:00.755678 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7716572-cae1-4f14-92f8-c9be21e0d8e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:00.763621 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3ca214-0497-4396-a2c9-1c7817385e12 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:00.768503 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7caebc2-5f5b-4fec-af5c-1d9e6501013f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:00.769475 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7caebc2-5f5b-4fec-af5c-1d9e6501013f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:00.769834 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7caebc2-5f5b-4fec-af5c-1d9e6501013f admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:00.770201 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7caebc2-5f5b-4fec-af5c-1d9e6501013f admin admin] PATH_INFO: `/v3/projects/b29a6f04e89a456abd89c29907e06220` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:00.771465 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7caebc2-5f5b-4fec-af5c-1d9e6501013f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b29a6f04e89a456abd89c29907e06220)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:00.773478 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7caebc2-5f5b-4fec-af5c-1d9e6501013f admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:00.779179 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-c7716572-cae1-4f14-92f8-c9be21e0d8e5 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:34:00.781040 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-c7716572-cae1-4f14-92f8-c9be21e0d8e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:00.791057 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2941/5868] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:34:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:34:00.794869 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7716572-cae1-4f14-92f8-c9be21e0d8e5 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:00.794869 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-c7716572-cae1-4f14-92f8-c9be21e0d8e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:00.853456 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-d7caebc2-5f5b-4fec-af5c-1d9e6501013f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b29a6f04e89a456abd89c29907e06220', 'request_id': 'req-d7caebc2-5f5b-4fec-af5c-1d9e6501013f'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:00.858399 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7716572-cae1-4f14-92f8-c9be21e0d8e5 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:00.861492 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-d7caebc2-5f5b-4fec-af5c-1d9e6501013f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b29a6f04e89a456abd89c29907e06220', 'request_id': 'req-d7caebc2-5f5b-4fec-af5c-1d9e6501013f'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:00.870710 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-d7caebc2-5f5b-4fec-af5c-1d9e6501013f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b29a6f04e89a456abd89c29907e06220', 'request_id': 'req-d7caebc2-5f5b-4fec-af5c-1d9e6501013f'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:00.884677 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-d7caebc2-5f5b-4fec-af5c-1d9e6501013f admin admin] The token cache is being invalidate because project b29a6f04e89a456abd89c29907e06220 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:34:00.885409 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-d7caebc2-5f5b-4fec-af5c-1d9e6501013f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:00.886212 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-d7caebc2-5f5b-4fec-af5c-1d9e6501013f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:00.888259 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2928/5869] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:34:00 2022] DELETE /identity/v3/projects/b29a6f04e89a456abd89c29907e06220 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:00.892923 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7caebc2-5f5b-4fec-af5c-1d9e6501013f admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:00.894461 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-d7caebc2-5f5b-4fec-af5c-1d9e6501013f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:00.911081 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93997bf-4cd5-4680-9b4b-ca7b31ea39c4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7f2db148c8e4d5d81431cae3576434b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:00.911744 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93997bf-4cd5-4680-9b4b-ca7b31ea39c4 service glance] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:00.912023 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93997bf-4cd5-4680-9b4b-ca7b31ea39c4 service glance] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:00.912296 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93997bf-4cd5-4680-9b4b-ca7b31ea39c4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:00.914309 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-d93997bf-4cd5-4680-9b4b-ca7b31ea39c4 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:00.960829 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7caebc2-5f5b-4fec-af5c-1d9e6501013f admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:00.966157 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4853e4-27ed-4ea0-ba50-eef5cf101e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:00.966840 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4853e4-27ed-4ea0-ba50-eef5cf101e5b admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:00.967391 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4853e4-27ed-4ea0-ba50-eef5cf101e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:00.967391 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4853e4-27ed-4ea0-ba50-eef5cf101e5b admin admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:00.968147 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4853e4-27ed-4ea0-ba50-eef5cf101e5b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:34:00.968455 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4853e4-27ed-4ea0-ba50-eef5cf101e5b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:00.970089 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4853e4-27ed-4ea0-ba50-eef5cf101e5b admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:00.979833 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93997bf-4cd5-4680-9b4b-ca7b31ea39c4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:00.981282 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93997bf-4cd5-4680-9b4b-ca7b31ea39c4 service glance] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:00.982449 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2929/5870] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:34:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:34:00.983257 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4853e4-27ed-4ea0-ba50-eef5cf101e5b admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:00.984956 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-8a4853e4-27ed-4ea0-ba50-eef5cf101e5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:00.995451 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2942/5871] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:34:00 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:34:00.996234 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93997bf-4cd5-4680-9b4b-ca7b31ea39c4 service glance] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:00.998196 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4853e4-27ed-4ea0-ba50-eef5cf101e5b admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:01.003370 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ccbc54-a037-4fcb-9090-9274962b618e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:01.004222 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ccbc54-a037-4fcb-9090-9274962b618e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:01.004503 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ccbc54-a037-4fcb-9090-9274962b618e admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:01.004774 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ccbc54-a037-4fcb-9090-9274962b618e admin admin] PATH_INFO: `/v3/users/52f280d8738f4853ae6b4e7921cc56e3` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:01.006174 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ccbc54-a037-4fcb-9090-9274962b618e admin admin] RBAC: Authorizing `identity:delete_user(user_id=52f280d8738f4853ae6b4e7921cc56e3)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:01.009786 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93997bf-4cd5-4680-9b4b-ca7b31ea39c4 service glance] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:01.009944 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ccbc54-a037-4fcb-9090-9274962b618e admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:01.015658 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bca875-577e-4de0-8650-6157ea5a43e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:01.016392 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bca875-577e-4de0-8650-6157ea5a43e0 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:01.016739 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bca875-577e-4de0-8650-6157ea5a43e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:01.017092 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bca875-577e-4de0-8650-6157ea5a43e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:01.017820 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bca875-577e-4de0-8650-6157ea5a43e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:01.020153 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bca875-577e-4de0-8650-6157ea5a43e0 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:01.050834 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2943/5872] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:34:00 2022] POST /identity/v3/projects => generated 383 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:34:01.055188 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bca875-577e-4de0-8650-6157ea5a43e0 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:01.066803 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-12ccbc54-a037-4fcb-9090-9274962b618e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52f280d8738f4853ae6b4e7921cc56e3'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:01.075872 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-12ccbc54-a037-4fcb-9090-9274962b618e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52f280d8738f4853ae6b4e7921cc56e3'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:01.076728 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-12ccbc54-a037-4fcb-9090-9274962b618e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52f280d8738f4853ae6b4e7921cc56e3'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:01.090261 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-12ccbc54-a037-4fcb-9090-9274962b618e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52f280d8738f4853ae6b4e7921cc56e3'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:01.103725 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:01.110130 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-12ccbc54-a037-4fcb-9090-9274962b618e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52f280d8738f4853ae6b4e7921cc56e3'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:01.119197 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2930/5873] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:34:00 2022] DELETE /identity/v3/users/52f280d8738f4853ae6b4e7921cc56e3 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:01.121967 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:01.159691 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bca875-577e-4de0-8650-6157ea5a43e0 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:01.224417 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71decaf8-1b47-4ab4-ac12-a9ccf05724f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:01.225166 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71decaf8-1b47-4ab4-ac12-a9ccf05724f1 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:01.225444 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71decaf8-1b47-4ab4-ac12-a9ccf05724f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:01.226102 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71decaf8-1b47-4ab4-ac12-a9ccf05724f1 admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:01.226789 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71decaf8-1b47-4ab4-ac12-a9ccf05724f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:01.228704 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71decaf8-1b47-4ab4-ac12-a9ccf05724f1 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:01.253535 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2944/5874] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:34:01 2022] POST /identity/v3/users => generated 292 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:34:01.258700 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ccbc54-a037-4fcb-9090-9274962b618e admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:01.260524 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-12ccbc54-a037-4fcb-9090-9274962b618e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:01.278182 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ccbc54-a037-4fcb-9090-9274962b618e admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:01.283790 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5851dd-534e-4f95-91a2-ce682d923da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:01.284476 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5851dd-534e-4f95-91a2-ce682d923da0 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:01.284747 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5851dd-534e-4f95-91a2-ce682d923da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:01.285558 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5851dd-534e-4f95-91a2-ce682d923da0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:01.286454 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5851dd-534e-4f95-91a2-ce682d923da0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:01.289050 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5851dd-534e-4f95-91a2-ce682d923da0 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:01.304806 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2931/5875] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:34:01 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:34:01.306689 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71decaf8-1b47-4ab4-ac12-a9ccf05724f1 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:01.324223 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71decaf8-1b47-4ab4-ac12-a9ccf05724f1 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:01.332749 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2e212f-3afb-41b7-be35-dc46dac90720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:01.333756 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2e212f-3afb-41b7-be35-dc46dac90720 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:01.334092 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2e212f-3afb-41b7-be35-dc46dac90720 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:01.334413 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2e212f-3afb-41b7-be35-dc46dac90720 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:01.335156 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2e212f-3afb-41b7-be35-dc46dac90720 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:01.337194 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2e212f-3afb-41b7-be35-dc46dac90720 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:01.354278 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2945/5876] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:34:01 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:34:01.356022 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5851dd-534e-4f95-91a2-ce682d923da0 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:01.370814 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5851dd-534e-4f95-91a2-ce682d923da0 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:01.376825 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629f9dac-d967-43ba-a077-d406e6176531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:01.377738 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629f9dac-d967-43ba-a077-d406e6176531 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:01.378076 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629f9dac-d967-43ba-a077-d406e6176531 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:01.378357 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629f9dac-d967-43ba-a077-d406e6176531 admin admin] PATH_INFO: `/v3/projects/f513ed4c7e7c425c8f6f49af300011b3/users/8eaf6b159ca34c96a44ab7e62c4537b8/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:01.394801 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629f9dac-d967-43ba-a077-d406e6176531 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f513ed4c7e7c425c8f6f49af300011b3, user_id=8eaf6b159ca34c96a44ab7e62c4537b8, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:01.401052 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629f9dac-d967-43ba-a077-d406e6176531 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:01.402902 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2e212f-3afb-41b7-be35-dc46dac90720 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:01.405031 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-ab2e212f-3afb-41b7-be35-dc46dac90720 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:01.415610 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2932/5877] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:34:01 2022] PUT /identity/v3/projects/f513ed4c7e7c425c8f6f49af300011b3/users/8eaf6b159ca34c96a44ab7e62c4537b8/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:01.418862 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2e212f-3afb-41b7-be35-dc46dac90720 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:01.425983 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b3177d-7811-4e2e-ad85-77e7e2cb6bab None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:01.426285 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b3177d-7811-4e2e-ad85-77e7e2cb6bab None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:01.426547 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b3177d-7811-4e2e-ad85-77e7e2cb6bab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:01.454544 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-56b3177d-7811-4e2e-ad85-77e7e2cb6bab None None] MFA Rules not processed for user `8eaf6b159ca34c96a44ab7e62c4537b8`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:34:01.455896 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-56b3177d-7811-4e2e-ad85-77e7e2cb6bab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:01.494970 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9c2ccc-53e4-449e-8195-6b615427445d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:01.496061 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9c2ccc-53e4-449e-8195-6b615427445d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:01.496401 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9c2ccc-53e4-449e-8195-6b615427445d admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:01.496742 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9c2ccc-53e4-449e-8195-6b615427445d admin admin] PATH_INFO: `/v3/users/85633a1ad8ec49339664c56c001bbdae` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:01.498210 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9c2ccc-53e4-449e-8195-6b615427445d admin admin] RBAC: Authorizing `identity:delete_user(user_id=85633a1ad8ec49339664c56c001bbdae)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:01.500044 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9c2ccc-53e4-449e-8195-6b615427445d admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:01.539941 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2933/5878] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:34:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:34:01.543594 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b3177d-7811-4e2e-ad85-77e7e2cb6bab None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:01.543594 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-56b3177d-7811-4e2e-ad85-77e7e2cb6bab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:01.550259 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-cb9c2ccc-53e4-449e-8195-6b615427445d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85633a1ad8ec49339664c56c001bbdae'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:01.551461 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-cb9c2ccc-53e4-449e-8195-6b615427445d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85633a1ad8ec49339664c56c001bbdae'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:01.555437 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b3177d-7811-4e2e-ad85-77e7e2cb6bab None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:01.558322 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-cb9c2ccc-53e4-449e-8195-6b615427445d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85633a1ad8ec49339664c56c001bbdae'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:01.560065 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138417af-7771-4cda-a301-95cd4ddeb268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:01.560920 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138417af-7771-4cda-a301-95cd4ddeb268 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:01.561196 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138417af-7771-4cda-a301-95cd4ddeb268 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:01.561459 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138417af-7771-4cda-a301-95cd4ddeb268 admin admin] PATH_INFO: `/v3/projects/4de224fbae5147eca4191ac7458f8078` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:01.562670 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138417af-7771-4cda-a301-95cd4ddeb268 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4de224fbae5147eca4191ac7458f8078)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:01.564571 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138417af-7771-4cda-a301-95cd4ddeb268 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:01.567132 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-cb9c2ccc-53e4-449e-8195-6b615427445d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85633a1ad8ec49339664c56c001bbdae'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:01.569272 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:01.581465 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-cb9c2ccc-53e4-449e-8195-6b615427445d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85633a1ad8ec49339664c56c001bbdae'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:01.587664 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2946/5879] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:34:01 2022] DELETE /identity/v3/users/85633a1ad8ec49339664c56c001bbdae => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:01.588736 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9c2ccc-53e4-449e-8195-6b615427445d admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:01.590272 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-cb9c2ccc-53e4-449e-8195-6b615427445d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:01.616879 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-138417af-7771-4cda-a301-95cd4ddeb268 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4de224fbae5147eca4191ac7458f8078', 'request_id': 'req-138417af-7771-4cda-a301-95cd4ddeb268'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:01.625626 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-138417af-7771-4cda-a301-95cd4ddeb268 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4de224fbae5147eca4191ac7458f8078', 'request_id': 'req-138417af-7771-4cda-a301-95cd4ddeb268'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:01.632115 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-138417af-7771-4cda-a301-95cd4ddeb268 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4de224fbae5147eca4191ac7458f8078', 'request_id': 'req-138417af-7771-4cda-a301-95cd4ddeb268'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:01.644463 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-138417af-7771-4cda-a301-95cd4ddeb268 admin admin] The token cache is being invalidate because project 4de224fbae5147eca4191ac7458f8078 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:34:01.644783 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-138417af-7771-4cda-a301-95cd4ddeb268 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:01.645412 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-138417af-7771-4cda-a301-95cd4ddeb268 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:01.647067 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2934/5880] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:34:01 2022] DELETE /identity/v3/projects/4de224fbae5147eca4191ac7458f8078 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:01.648301 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21c519e-5ea6-433b-8001-bf6df51d188b None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:01.648587 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21c519e-5ea6-433b-8001-bf6df51d188b None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:01.648889 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21c519e-5ea6-433b-8001-bf6df51d188b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:01.658261 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9c2ccc-53e4-449e-8195-6b615427445d admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:01.666088 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-c21c519e-5ea6-433b-8001-bf6df51d188b None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:34:01.667282 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-c21c519e-5ea6-433b-8001-bf6df51d188b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:01.687115 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=90,keystone:DELETE=8,keystone:INSERT=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:01.718111 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31a7c95-d144-4f0a-bb5b-bffd5f46982c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:01.718830 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31a7c95-d144-4f0a-bb5b-bffd5f46982c admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:01.719113 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31a7c95-d144-4f0a-bb5b-bffd5f46982c admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:01.719648 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31a7c95-d144-4f0a-bb5b-bffd5f46982c admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:01.720078 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31a7c95-d144-4f0a-bb5b-bffd5f46982c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:01.722016 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31a7c95-d144-4f0a-bb5b-bffd5f46982c admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:01.728137 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2935/5881] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:34:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:34:01.731527 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c51e9f3-a206-4d01-b571-d81b6947b154 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:01.731527 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c51e9f3-a206-4d01-b571-d81b6947b154 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:01.731527 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c51e9f3-a206-4d01-b571-d81b6947b154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:01.749134 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2947/5882] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:34:01 2022] POST /identity/v3/projects => generated 383 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:34:01.750331 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31a7c95-d144-4f0a-bb5b-bffd5f46982c admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:01.751270 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-3c51e9f3-a206-4d01-b571-d81b6947b154 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:34:01.751632 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-b31a7c95-d144-4f0a-bb5b-bffd5f46982c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:01.753215 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-3c51e9f3-a206-4d01-b571-d81b6947b154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:01.813292 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31a7c95-d144-4f0a-bb5b-bffd5f46982c admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:01.816960 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2936/5883] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:34:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:34:01.817798 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c51e9f3-a206-4d01-b571-d81b6947b154 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:01.819242 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-3c51e9f3-a206-4d01-b571-d81b6947b154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:01.825139 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d17f43d-c173-4674-882f-ac356359b368 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:01.826042 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d17f43d-c173-4674-882f-ac356359b368 service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:01.826485 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d17f43d-c173-4674-882f-ac356359b368 service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:01.826762 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d17f43d-c173-4674-882f-ac356359b368 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:01.831572 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c51e9f3-a206-4d01-b571-d81b6947b154 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:01.836572 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a429c34f-a7e8-4e9b-88dc-b77615142dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:01.837342 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a429c34f-a7e8-4e9b-88dc-b77615142dce admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:01.837549 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a429c34f-a7e8-4e9b-88dc-b77615142dce admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:01.837787 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d17f43d-c173-4674-882f-ac356359b368 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:01.837917 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a429c34f-a7e8-4e9b-88dc-b77615142dce admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:01.838503 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a429c34f-a7e8-4e9b-88dc-b77615142dce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:01.839603 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d17f43d-c173-4674-882f-ac356359b368 service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:01.840414 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a429c34f-a7e8-4e9b-88dc-b77615142dce admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:01.850372 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2948/5884] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:34:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:34:01.852284 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0636c14e-b3fb-4518-a908-e7b796dbca3c None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:01.852608 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0636c14e-b3fb-4518-a908-e7b796dbca3c None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:01.852846 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0636c14e-b3fb-4518-a908-e7b796dbca3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:01.861995 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2937/5885] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:34:01 2022] POST /identity/v3/users => generated 298 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:34:01.866100 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a429c34f-a7e8-4e9b-88dc-b77615142dce admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:01.872113 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-0636c14e-b3fb-4518-a908-e7b796dbca3c None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:34:01.873320 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-0636c14e-b3fb-4518-a908-e7b796dbca3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:01.875988 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a429c34f-a7e8-4e9b-88dc-b77615142dce admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:01.880493 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8c22bb-b41c-4f16-9537-742533bf78c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:01.881204 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8c22bb-b41c-4f16-9537-742533bf78c5 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:01.881483 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8c22bb-b41c-4f16-9537-742533bf78c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:01.881598 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2949/5886] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:34:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:34:01.881747 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8c22bb-b41c-4f16-9537-742533bf78c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:01.882756 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8c22bb-b41c-4f16-9537-742533bf78c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:01.884227 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8c22bb-b41c-4f16-9537-742533bf78c5 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:01.886101 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0636c14e-b3fb-4518-a908-e7b796dbca3c None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:01.894302 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2938/5887] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:34:01 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 21:34:01.895698 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0636c14e-b3fb-4518-a908-e7b796dbca3c None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:01.898662 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8c22bb-b41c-4f16-9537-742533bf78c5 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:01.903355 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b179d8-9fc2-4a04-a7fe-57857b3176f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:01.904308 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b179d8-9fc2-4a04-a7fe-57857b3176f0 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:01.904880 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b179d8-9fc2-4a04-a7fe-57857b3176f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:01.905162 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b179d8-9fc2-4a04-a7fe-57857b3176f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:01.906238 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b179d8-9fc2-4a04-a7fe-57857b3176f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:34:01.906711 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b179d8-9fc2-4a04-a7fe-57857b3176f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:01.908346 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b179d8-9fc2-4a04-a7fe-57857b3176f0 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:01.909548 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8c22bb-b41c-4f16-9537-742533bf78c5 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:01.914488 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844a2296-d89f-44c6-b6fd-14ce0f543a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:01.915352 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844a2296-d89f-44c6-b6fd-14ce0f543a7f admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:01.915631 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844a2296-d89f-44c6-b6fd-14ce0f543a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:01.915954 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844a2296-d89f-44c6-b6fd-14ce0f543a7f admin admin] PATH_INFO: `/v3/projects/278e3e9d87a94780a6adbbf6f4a97e00/users/39ece4c7ec804be8bdba07f21f179804/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:01.918757 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:01.928404 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2950/5888] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:34:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 21:34:01.933835 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b179d8-9fc2-4a04-a7fe-57857b3176f0 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:01.936248 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844a2296-d89f-44c6-b6fd-14ce0f543a7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=278e3e9d87a94780a6adbbf6f4a97e00, user_id=39ece4c7ec804be8bdba07f21f179804, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:01.939122 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844a2296-d89f-44c6-b6fd-14ce0f543a7f admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:01.946637 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b179d8-9fc2-4a04-a7fe-57857b3176f0 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:01.953198 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2939/5889] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:34:01 2022] PUT /identity/v3/projects/278e3e9d87a94780a6adbbf6f4a97e00/users/39ece4c7ec804be8bdba07f21f179804/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:34:01.957900 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844a2296-d89f-44c6-b6fd-14ce0f543a7f admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:02.019508 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7f87b9-d72d-4c20-a4eb-60e598379f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:02.019897 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7f87b9-d72d-4c20-a4eb-60e598379f1b admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:02.020191 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7f87b9-d72d-4c20-a4eb-60e598379f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:02.020458 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7f87b9-d72d-4c20-a4eb-60e598379f1b admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:02.021159 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7f87b9-d72d-4c20-a4eb-60e598379f1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:02.023354 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7f87b9-d72d-4c20-a4eb-60e598379f1b admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:02.030704 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844a2296-d89f-44c6-b6fd-14ce0f543a7f admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:02.036587 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436a6687-baa5-443c-81cf-3c970e2d737f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:02.037200 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436a6687-baa5-443c-81cf-3c970e2d737f admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:02.037608 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436a6687-baa5-443c-81cf-3c970e2d737f admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:02.037792 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436a6687-baa5-443c-81cf-3c970e2d737f admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:02.038683 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436a6687-baa5-443c-81cf-3c970e2d737f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:02.040357 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436a6687-baa5-443c-81cf-3c970e2d737f admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:02.055296 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2940/5890] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:34:01 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:34:02.057909 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2951/5891] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:34:01 2022] POST /identity/v3/projects => generated 367 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:34:02.058061 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436a6687-baa5-443c-81cf-3c970e2d737f admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:02.061753 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7f87b9-d72d-4c20-a4eb-60e598379f1b admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:02.072255 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436a6687-baa5-443c-81cf-3c970e2d737f admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:02.080952 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:02.128985 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7f87b9-d72d-4c20-a4eb-60e598379f1b admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:02.133219 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f603f3-d278-4f6f-9444-3f8928bbed78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:02.134174 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f603f3-d278-4f6f-9444-3f8928bbed78 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:02.134457 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f603f3-d278-4f6f-9444-3f8928bbed78 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:02.134738 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f603f3-d278-4f6f-9444-3f8928bbed78 admin admin] PATH_INFO: `/v3/projects/278e3e9d87a94780a6adbbf6f4a97e00/users/39ece4c7ec804be8bdba07f21f179804/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:02.135247 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d8f54c-83bd-4236-8a1a-7ba2ececdbd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:02.135924 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d8f54c-83bd-4236-8a1a-7ba2ececdbd8 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:02.136206 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d8f54c-83bd-4236-8a1a-7ba2ececdbd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:02.136483 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d8f54c-83bd-4236-8a1a-7ba2ececdbd8 admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:02.136891 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f603f3-d278-4f6f-9444-3f8928bbed78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=278e3e9d87a94780a6adbbf6f4a97e00, user_id=39ece4c7ec804be8bdba07f21f179804, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:02.137210 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d8f54c-83bd-4236-8a1a-7ba2ececdbd8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:02.139248 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d8f54c-83bd-4236-8a1a-7ba2ececdbd8 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:02.139763 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f603f3-d278-4f6f-9444-3f8928bbed78 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:02.152562 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2941/5892] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:34:02 2022] PUT /identity/v3/projects/278e3e9d87a94780a6adbbf6f4a97e00/users/39ece4c7ec804be8bdba07f21f179804/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:02.163191 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6adaf0-0d34-4677-98fe-2881d202c327 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:02.163483 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6adaf0-0d34-4677-98fe-2881d202c327 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:02.163844 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6adaf0-0d34-4677-98fe-2881d202c327 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:02.176265 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2952/5893] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:34:02 2022] POST /identity/v3/users => generated 284 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:34:02.177205 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d8f54c-83bd-4236-8a1a-7ba2ececdbd8 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:02.179268 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-30d8f54c-83bd-4236-8a1a-7ba2ececdbd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:02.192695 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d8f54c-83bd-4236-8a1a-7ba2ececdbd8 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:02.197822 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-bc6adaf0-0d34-4677-98fe-2881d202c327 None None] MFA Rules not processed for user `39ece4c7ec804be8bdba07f21f179804`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:34:02.199160 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-bc6adaf0-0d34-4677-98fe-2881d202c327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:02.254206 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba84d9e1-ac5b-490c-a7bf-3eb5eae34e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:02.255879 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba84d9e1-ac5b-490c-a7bf-3eb5eae34e33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:02.255879 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba84d9e1-ac5b-490c-a7bf-3eb5eae34e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:02.256129 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba84d9e1-ac5b-490c-a7bf-3eb5eae34e33 admin admin] PATH_INFO: `/v3/projects/cf919783310d49d39328cc7c11b90c17` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:02.257311 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba84d9e1-ac5b-490c-a7bf-3eb5eae34e33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf919783310d49d39328cc7c11b90c17)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:02.259797 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba84d9e1-ac5b-490c-a7bf-3eb5eae34e33 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:02.277077 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:02.277702 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2942/5894] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:34:02 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:34:02.278528 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6adaf0-0d34-4677-98fe-2881d202c327 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:02.290556 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6adaf0-0d34-4677-98fe-2881d202c327 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:02.295559 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd05733-4f9d-4e69-94cd-c6b7f03598f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:02.296208 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd05733-4f9d-4e69-94cd-c6b7f03598f5 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:02.296628 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd05733-4f9d-4e69-94cd-c6b7f03598f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:02.296906 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd05733-4f9d-4e69-94cd-c6b7f03598f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:02.297637 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd05733-4f9d-4e69-94cd-c6b7f03598f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:02.299433 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd05733-4f9d-4e69-94cd-c6b7f03598f5 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:02.310573 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2943/5895] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:34:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:34:02.311308 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd05733-4f9d-4e69-94cd-c6b7f03598f5 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:02.318010 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-ba84d9e1-ac5b-490c-a7bf-3eb5eae34e33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf919783310d49d39328cc7c11b90c17', 'request_id': 'req-ba84d9e1-ac5b-490c-a7bf-3eb5eae34e33'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:02.324579 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd05733-4f9d-4e69-94cd-c6b7f03598f5 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:02.327769 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-ba84d9e1-ac5b-490c-a7bf-3eb5eae34e33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf919783310d49d39328cc7c11b90c17', 'request_id': 'req-ba84d9e1-ac5b-490c-a7bf-3eb5eae34e33'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:02.345352 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-ba84d9e1-ac5b-490c-a7bf-3eb5eae34e33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf919783310d49d39328cc7c11b90c17', 'request_id': 'req-ba84d9e1-ac5b-490c-a7bf-3eb5eae34e33'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:02.357716 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-ba84d9e1-ac5b-490c-a7bf-3eb5eae34e33 admin admin] The token cache is being invalidate because project cf919783310d49d39328cc7c11b90c17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:34:02.358042 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-ba84d9e1-ac5b-490c-a7bf-3eb5eae34e33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:02.358707 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-ba84d9e1-ac5b-490c-a7bf-3eb5eae34e33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:02.360301 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2953/5896] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:34:02 2022] DELETE /identity/v3/projects/cf919783310d49d39328cc7c11b90c17 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:02.363069 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba84d9e1-ac5b-490c-a7bf-3eb5eae34e33 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:02.365024 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-ba84d9e1-ac5b-490c-a7bf-3eb5eae34e33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:02.380535 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c2716c-fbd3-4dc3-b8cd-77fe4a0a2460 tempest-DomainsNegativeTestJSON-1427612564 tempest-DomainsNegativeTestJSON-1427612564-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39ece4c7ec804be8bdba07f21f179804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '278e3e9d87a94780a6adbbf6f4a97e00', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:02.381268 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c2716c-fbd3-4dc3-b8cd-77fe4a0a2460 tempest-DomainsNegativeTestJSON-1427612564 tempest-DomainsNegativeTestJSON-1427612564-project-admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:02.381554 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c2716c-fbd3-4dc3-b8cd-77fe4a0a2460 tempest-DomainsNegativeTestJSON-1427612564 tempest-DomainsNegativeTestJSON-1427612564-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:02.381830 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c2716c-fbd3-4dc3-b8cd-77fe4a0a2460 tempest-DomainsNegativeTestJSON-1427612564 tempest-DomainsNegativeTestJSON-1427612564-project-admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:02.382586 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c2716c-fbd3-4dc3-b8cd-77fe4a0a2460 tempest-DomainsNegativeTestJSON-1427612564 tempest-DomainsNegativeTestJSON-1427612564-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:02.384210 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c2716c-fbd3-4dc3-b8cd-77fe4a0a2460 tempest-DomainsNegativeTestJSON-1427612564 tempest-DomainsNegativeTestJSON-1427612564-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:02.391380 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-d6c2716c-fbd3-4dc3-b8cd-77fe4a0a2460 tempest-DomainsNegativeTestJSON-1427612564 tempest-DomainsNegativeTestJSON-1427612564-project-admin] Invalid input for field 'name': '' is too short Jul 23 21:34:02.391380 ncdv-master-1 devstack@keystone.service[91547]: Failed validating 'minLength' in schema['properties']['name']: Jul 23 21:34:02.391380 ncdv-master-1 devstack@keystone.service[91547]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jul 23 21:34:02.391380 ncdv-master-1 devstack@keystone.service[91547]: On instance['name']: Jul 23 21:34:02.391380 ncdv-master-1 devstack@keystone.service[91547]: '': keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Jul 23 21:34:02.391380 ncdv-master-1 devstack@keystone.service[91547]: Failed validating 'minLength' in schema['properties']['name']: Jul 23 21:34:02.391380 ncdv-master-1 devstack@keystone.service[91547]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jul 23 21:34:02.391380 ncdv-master-1 devstack@keystone.service[91547]: On instance['name']: Jul 23 21:34:02.391380 ncdv-master-1 devstack@keystone.service[91547]: '' Jul 23 21:34:02.391380 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 21:34:02.391380 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Jul 23 21:34:02.391380 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Jul 23 21:34:02.391380 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 23 21:34:02.391380 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise error Jul 23 21:34:02.391380 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: '' is too short Jul 23 21:34:02.391380 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 21:34:02.391380 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Jul 23 21:34:02.391380 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jul 23 21:34:02.391380 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 21:34:02.391380 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application On instance['name']: Jul 23 21:34:02.391380 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application '' Jul 23 21:34:02.391380 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 21:34:02.391380 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 23 21:34:02.393042 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 21:34:02.393042 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 21:34:02.393042 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 21:34:02.393042 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 21:34:02.393042 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 21:34:02.393042 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 21:34:02.393042 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 21:34:02.393042 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 21:34:02.393042 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 21:34:02.393042 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 21:34:02.393042 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 21:34:02.393042 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 21:34:02.393042 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 115, in post Jul 23 21:34:02.393042 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application validation.lazy_validate(schema.domain_create, domain) Jul 23 21:34:02.393042 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Jul 23 21:34:02.393042 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Jul 23 21:34:02.393042 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Jul 23 21:34:02.394177 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Jul 23 21:34:02.394177 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Jul 23 21:34:02.394177 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 21:34:02.394177 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Jul 23 21:34:02.394177 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jul 23 21:34:02.394177 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 21:34:02.394177 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application On instance['name']: Jul 23 21:34:02.394177 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application '' Jul 23 21:34:02.394177 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 21:34:02.394177 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2944/5897] 10.222.0.17 () {60 vars in 1148 bytes} [Sat Jul 23 21:34:02 2022] POST /identity/v3/domains => generated 283 bytes in 82 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Jul 23 21:34:02.394177 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c2716c-fbd3-4dc3-b8cd-77fe4a0a2460 tempest-DomainsNegativeTestJSON-1427612564 tempest-DomainsNegativeTestJSON-1427612564-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:02.395094 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-d6c2716c-fbd3-4dc3-b8cd-77fe4a0a2460 tempest-DomainsNegativeTestJSON-1427612564 tempest-DomainsNegativeTestJSON-1427612564-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:02.422211 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:02.433259 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba84d9e1-ac5b-490c-a7bf-3eb5eae34e33 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:02.438216 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4c2510-f5e0-4187-a092-dd5be8cabbfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:02.438909 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4c2510-f5e0-4187-a092-dd5be8cabbfb admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:02.439194 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4c2510-f5e0-4187-a092-dd5be8cabbfb admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:02.439466 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4c2510-f5e0-4187-a092-dd5be8cabbfb admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:02.440190 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4c2510-f5e0-4187-a092-dd5be8cabbfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:02.441794 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4c2510-f5e0-4187-a092-dd5be8cabbfb admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:02.452323 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2954/5898] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:34:02 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:34:02.453110 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4c2510-f5e0-4187-a092-dd5be8cabbfb admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:02.454898 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-bf4c2510-f5e0-4187-a092-dd5be8cabbfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:02.462684 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c2716c-fbd3-4dc3-b8cd-77fe4a0a2460 tempest-DomainsNegativeTestJSON-1427612564 tempest-DomainsNegativeTestJSON-1427612564-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:02.467521 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2dfddc-9da6-43a4-83e8-3cc12bab11ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:02.468343 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4c2510-f5e0-4187-a092-dd5be8cabbfb admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:02.468481 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2dfddc-9da6-43a4-83e8-3cc12bab11ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:02.468747 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2dfddc-9da6-43a4-83e8-3cc12bab11ff admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:02.469027 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2dfddc-9da6-43a4-83e8-3cc12bab11ff admin admin] PATH_INFO: `/v3/users/bed35b81374c409c877638f8212ad257` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:02.470297 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2dfddc-9da6-43a4-83e8-3cc12bab11ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=bed35b81374c409c877638f8212ad257)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:02.472250 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2dfddc-9da6-43a4-83e8-3cc12bab11ff admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:02.472859 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd219f1-4712-4b36-9362-f8a728e00034 tempest-DomainsNegativeTestJSON-1427612564 tempest-DomainsNegativeTestJSON-1427612564-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39ece4c7ec804be8bdba07f21f179804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '278e3e9d87a94780a6adbbf6f4a97e00', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:02.473506 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd219f1-4712-4b36-9362-f8a728e00034 tempest-DomainsNegativeTestJSON-1427612564 tempest-DomainsNegativeTestJSON-1427612564-project-admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:02.473789 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd219f1-4712-4b36-9362-f8a728e00034 tempest-DomainsNegativeTestJSON-1427612564 tempest-DomainsNegativeTestJSON-1427612564-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:02.474096 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd219f1-4712-4b36-9362-f8a728e00034 tempest-DomainsNegativeTestJSON-1427612564 tempest-DomainsNegativeTestJSON-1427612564-project-admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:02.474864 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd219f1-4712-4b36-9362-f8a728e00034 tempest-DomainsNegativeTestJSON-1427612564 tempest-DomainsNegativeTestJSON-1427612564-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:02.476804 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd219f1-4712-4b36-9362-f8a728e00034 tempest-DomainsNegativeTestJSON-1427612564 tempest-DomainsNegativeTestJSON-1427612564-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:02.482838 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-2bd219f1-4712-4b36-9362-f8a728e00034 tempest-DomainsNegativeTestJSON-1427612564 tempest-DomainsNegativeTestJSON-1427612564-project-admin] Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 23 21:34:02.482838 ncdv-master-1 devstack@keystone.service[91548]: Failed validating 'maxLength' in schema['properties']['name']: Jul 23 21:34:02.482838 ncdv-master-1 devstack@keystone.service[91548]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jul 23 21:34:02.482838 ncdv-master-1 devstack@keystone.service[91548]: On instance['name']: Jul 23 21:34:02.482838 ncdv-master-1 devstack@keystone.service[91548]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 23 21:34:02.482838 ncdv-master-1 devstack@keystone.service[91548]: Failed validating 'maxLength' in schema['properties']['name']: Jul 23 21:34:02.482838 ncdv-master-1 devstack@keystone.service[91548]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jul 23 21:34:02.482838 ncdv-master-1 devstack@keystone.service[91548]: On instance['name']: Jul 23 21:34:02.482838 ncdv-master-1 devstack@keystone.service[91548]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 23 21:34:02.482838 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 21:34:02.482838 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Jul 23 21:34:02.482838 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Jul 23 21:34:02.482838 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 23 21:34:02.482838 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise error Jul 23 21:34:02.482838 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 23 21:34:02.482838 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 21:34:02.482838 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Jul 23 21:34:02.482838 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jul 23 21:34:02.482838 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 21:34:02.484549 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application On instance['name']: Jul 23 21:34:02.484549 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 23 21:34:02.484549 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 21:34:02.484549 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 23 21:34:02.484549 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 21:34:02.484549 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 21:34:02.484549 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 21:34:02.484549 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 21:34:02.484549 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 21:34:02.484549 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 21:34:02.484549 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 21:34:02.484549 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 21:34:02.484549 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 21:34:02.484549 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 21:34:02.484549 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 21:34:02.484549 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 21:34:02.484549 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 115, in post Jul 23 21:34:02.484549 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application validation.lazy_validate(schema.domain_create, domain) Jul 23 21:34:02.485962 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Jul 23 21:34:02.485962 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Jul 23 21:34:02.485962 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Jul 23 21:34:02.485962 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Jul 23 21:34:02.485962 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 23 21:34:02.485962 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 21:34:02.485962 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Jul 23 21:34:02.485962 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jul 23 21:34:02.485962 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 21:34:02.485962 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application On instance['name']: Jul 23 21:34:02.485962 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 23 21:34:02.485962 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 21:34:02.485962 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2955/5899] 10.222.0.17 () {60 vars in 1148 bytes} [Sat Jul 23 21:34:02 2022] POST /identity/v3/domains => generated 412 bytes in 31 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Jul 23 21:34:02.485962 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd219f1-4712-4b36-9362-f8a728e00034 tempest-DomainsNegativeTestJSON-1427612564 tempest-DomainsNegativeTestJSON-1427612564-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:02.499065 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd219f1-4712-4b36-9362-f8a728e00034 tempest-DomainsNegativeTestJSON-1427612564 tempest-DomainsNegativeTestJSON-1427612564-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:02.504446 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22812846-7b4d-4b1c-86ca-627db570a94a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:02.505372 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22812846-7b4d-4b1c-86ca-627db570a94a admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:02.505608 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22812846-7b4d-4b1c-86ca-627db570a94a admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:02.506037 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22812846-7b4d-4b1c-86ca-627db570a94a admin admin] PATH_INFO: `/v3/projects/5dbaad3719404b20b0d83e19790476a2/users/69d2d60a0aa34f7db613fad33fadb579/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:02.521628 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22812846-7b4d-4b1c-86ca-627db570a94a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5dbaad3719404b20b0d83e19790476a2, user_id=69d2d60a0aa34f7db613fad33fadb579, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:02.523263 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-5b2dfddc-9da6-43a4-83e8-3cc12bab11ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bed35b81374c409c877638f8212ad257'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:02.524350 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22812846-7b4d-4b1c-86ca-627db570a94a admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:02.530309 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-5b2dfddc-9da6-43a4-83e8-3cc12bab11ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bed35b81374c409c877638f8212ad257'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:02.531210 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-5b2dfddc-9da6-43a4-83e8-3cc12bab11ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bed35b81374c409c877638f8212ad257'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:02.538373 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2956/5900] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:34:02 2022] PUT /identity/v3/projects/5dbaad3719404b20b0d83e19790476a2/users/69d2d60a0aa34f7db613fad33fadb579/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:02.539423 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22812846-7b4d-4b1c-86ca-627db570a94a admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:02.539571 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-5b2dfddc-9da6-43a4-83e8-3cc12bab11ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bed35b81374c409c877638f8212ad257'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:02.560289 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-5b2dfddc-9da6-43a4-83e8-3cc12bab11ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bed35b81374c409c877638f8212ad257'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:02.566425 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2945/5901] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:34:02 2022] DELETE /identity/v3/users/bed35b81374c409c877638f8212ad257 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:02.568281 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f497b21c-af54-430e-89f0-50ae050260e4 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:02.568752 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f497b21c-af54-430e-89f0-50ae050260e4 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:02.569024 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f497b21c-af54-430e-89f0-50ae050260e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:02.601423 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-f497b21c-af54-430e-89f0-50ae050260e4 None None] MFA Rules not processed for user `69d2d60a0aa34f7db613fad33fadb579`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:34:02.603474 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-f497b21c-af54-430e-89f0-50ae050260e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:02.606567 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22812846-7b4d-4b1c-86ca-627db570a94a admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:02.619788 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:02.683268 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9e2c5f-305e-4b35-b6d5-0549a5b7f9f0 tempest-DomainsNegativeTestJSON-1427612564 tempest-DomainsNegativeTestJSON-1427612564-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39ece4c7ec804be8bdba07f21f179804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '278e3e9d87a94780a6adbbf6f4a97e00', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:02.684060 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9e2c5f-305e-4b35-b6d5-0549a5b7f9f0 tempest-DomainsNegativeTestJSON-1427612564 tempest-DomainsNegativeTestJSON-1427612564-project-admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:02.684487 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9e2c5f-305e-4b35-b6d5-0549a5b7f9f0 tempest-DomainsNegativeTestJSON-1427612564 tempest-DomainsNegativeTestJSON-1427612564-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:02.684925 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9e2c5f-305e-4b35-b6d5-0549a5b7f9f0 tempest-DomainsNegativeTestJSON-1427612564 tempest-DomainsNegativeTestJSON-1427612564-project-admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:02.685680 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9e2c5f-305e-4b35-b6d5-0549a5b7f9f0 tempest-DomainsNegativeTestJSON-1427612564 tempest-DomainsNegativeTestJSON-1427612564-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:02.687376 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9e2c5f-305e-4b35-b6d5-0549a5b7f9f0 tempest-DomainsNegativeTestJSON-1427612564 tempest-DomainsNegativeTestJSON-1427612564-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:02.694912 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2946/5902] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:34:02 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:34:02.702872 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f497b21c-af54-430e-89f0-50ae050260e4 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:02.704363 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-f497b21c-af54-430e-89f0-50ae050260e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:02.710793 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2957/5903] 10.222.0.17 () {60 vars in 1148 bytes} [Sat Jul 23 21:34:02 2022] POST /identity/v3/domains => generated 277 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:34:02.712648 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9e2c5f-305e-4b35-b6d5-0549a5b7f9f0 tempest-DomainsNegativeTestJSON-1427612564 tempest-DomainsNegativeTestJSON-1427612564-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:02.715045 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-1b9e2c5f-305e-4b35-b6d5-0549a5b7f9f0 tempest-DomainsNegativeTestJSON-1427612564 tempest-DomainsNegativeTestJSON-1427612564-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:02.758940 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:02.799398 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9e2c5f-305e-4b35-b6d5-0549a5b7f9f0 tempest-DomainsNegativeTestJSON-1427612564 tempest-DomainsNegativeTestJSON-1427612564-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:02.804254 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f497b21c-af54-430e-89f0-50ae050260e4 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:02.806282 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16468b36-42bd-4949-86c9-9eb9c06b410a tempest-DomainsNegativeTestJSON-1427612564 tempest-DomainsNegativeTestJSON-1427612564-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39ece4c7ec804be8bdba07f21f179804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '278e3e9d87a94780a6adbbf6f4a97e00', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:02.807194 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16468b36-42bd-4949-86c9-9eb9c06b410a tempest-DomainsNegativeTestJSON-1427612564 tempest-DomainsNegativeTestJSON-1427612564-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:02.807479 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16468b36-42bd-4949-86c9-9eb9c06b410a tempest-DomainsNegativeTestJSON-1427612564 tempest-DomainsNegativeTestJSON-1427612564-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:02.807957 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16468b36-42bd-4949-86c9-9eb9c06b410a tempest-DomainsNegativeTestJSON-1427612564 tempest-DomainsNegativeTestJSON-1427612564-project-admin] PATH_INFO: `/v3/domains/c44717b1398c4a80bb9c9e4390ad6754` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:02.829410 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16468b36-42bd-4949-86c9-9eb9c06b410a tempest-DomainsNegativeTestJSON-1427612564 tempest-DomainsNegativeTestJSON-1427612564-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=c44717b1398c4a80bb9c9e4390ad6754)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:02.831175 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16468b36-42bd-4949-86c9-9eb9c06b410a tempest-DomainsNegativeTestJSON-1427612564 tempest-DomainsNegativeTestJSON-1427612564-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:02.854923 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-16468b36-42bd-4949-86c9-9eb9c06b410a tempest-DomainsNegativeTestJSON-1427612564 tempest-DomainsNegativeTestJSON-1427612564-project-admin] Cannot delete a domain that is enabled, please disable it first.: keystone.exception.ForbiddenNotSecurity: Cannot delete a domain that is enabled, please disable it first. Jul 23 21:34:02.854923 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 21:34:02.854923 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 21:34:02.854923 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 21:34:02.854923 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 21:34:02.854923 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 21:34:02.854923 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 21:34:02.854923 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 21:34:02.854923 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 21:34:02.854923 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 21:34:02.854923 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 21:34:02.854923 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 21:34:02.854923 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 151, in delete Jul 23 21:34:02.854923 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_domain( Jul 23 21:34:02.855968 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 21:34:02.855968 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 21:34:02.855968 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 802, in delete_domain Jul 23 21:34:02.855968 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application self._delete_domain(domain, initiator) Jul 23 21:34:02.855968 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 815, in _delete_domain Jul 23 21:34:02.855968 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.ForbiddenNotSecurity( Jul 23 21:34:02.855968 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.ForbiddenNotSecurity: Cannot delete a domain that is enabled, please disable it first. Jul 23 21:34:02.855968 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 21:34:02.861110 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2958/5904] 10.222.0.17 () {58 vars in 1229 bytes} [Sat Jul 23 21:34:02 2022] DELETE /identity/v3/domains/c44717b1398c4a80bb9c9e4390ad6754 => generated 120 bytes in 144 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Jul 23 21:34:02.861110 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16468b36-42bd-4949-86c9-9eb9c06b410a tempest-DomainsNegativeTestJSON-1427612564 tempest-DomainsNegativeTestJSON-1427612564-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:02.873844 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16468b36-42bd-4949-86c9-9eb9c06b410a tempest-DomainsNegativeTestJSON-1427612564 tempest-DomainsNegativeTestJSON-1427612564-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:02.879074 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4d2c40-c312-43ad-a0df-acd09617d456 tempest-DomainsNegativeTestJSON-1427612564 tempest-DomainsNegativeTestJSON-1427612564-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39ece4c7ec804be8bdba07f21f179804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '278e3e9d87a94780a6adbbf6f4a97e00', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:02.879893 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4d2c40-c312-43ad-a0df-acd09617d456 tempest-DomainsNegativeTestJSON-1427612564 tempest-DomainsNegativeTestJSON-1427612564-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:02.880169 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4d2c40-c312-43ad-a0df-acd09617d456 tempest-DomainsNegativeTestJSON-1427612564 tempest-DomainsNegativeTestJSON-1427612564-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:02.880437 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4d2c40-c312-43ad-a0df-acd09617d456 tempest-DomainsNegativeTestJSON-1427612564 tempest-DomainsNegativeTestJSON-1427612564-project-admin] PATH_INFO: `/v3/domains/c44717b1398c4a80bb9c9e4390ad6754` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:02.881779 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4d2c40-c312-43ad-a0df-acd09617d456 tempest-DomainsNegativeTestJSON-1427612564 tempest-DomainsNegativeTestJSON-1427612564-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=c44717b1398c4a80bb9c9e4390ad6754)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:02.883591 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4d2c40-c312-43ad-a0df-acd09617d456 tempest-DomainsNegativeTestJSON-1427612564 tempest-DomainsNegativeTestJSON-1427612564-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:02.887341 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb344b8-7c1f-406e-ad05-274ece4bb929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:02.890608 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb344b8-7c1f-406e-ad05-274ece4bb929 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:02.891156 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb344b8-7c1f-406e-ad05-274ece4bb929 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:02.891488 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb344b8-7c1f-406e-ad05-274ece4bb929 admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:02.892195 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb344b8-7c1f-406e-ad05-274ece4bb929 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:02.894211 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb344b8-7c1f-406e-ad05-274ece4bb929 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:02.912549 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-4f4d2c40-c312-43ad-a0df-acd09617d456 tempest-DomainsNegativeTestJSON-1427612564 tempest-DomainsNegativeTestJSON-1427612564-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'c44717b1398c4a80bb9c9e4390ad6754'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:02.913359 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-4f4d2c40-c312-43ad-a0df-acd09617d456 tempest-DomainsNegativeTestJSON-1427612564 tempest-DomainsNegativeTestJSON-1427612564-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'c44717b1398c4a80bb9c9e4390ad6754'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:02.930251 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2947/5905] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:34:02 2022] POST /identity/v3/projects => generated 367 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:34:02.930361 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb344b8-7c1f-406e-ad05-274ece4bb929 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:02.934188 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-6bb344b8-7c1f-406e-ad05-274ece4bb929 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:02.943684 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-4f4d2c40-c312-43ad-a0df-acd09617d456 tempest-DomainsNegativeTestJSON-1427612564 tempest-DomainsNegativeTestJSON-1427612564-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'c44717b1398c4a80bb9c9e4390ad6754'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:02.944316 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-4f4d2c40-c312-43ad-a0df-acd09617d456 tempest-DomainsNegativeTestJSON-1427612564 tempest-DomainsNegativeTestJSON-1427612564-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'c44717b1398c4a80bb9c9e4390ad6754'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:02.949898 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2959/5906] 10.222.0.17 () {60 vars in 1248 bytes} [Sat Jul 23 21:34:02 2022] PATCH /identity/v3/domains/c44717b1398c4a80bb9c9e4390ad6754 => generated 278 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 21:34:02.949898 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4d2c40-c312-43ad-a0df-acd09617d456 tempest-DomainsNegativeTestJSON-1427612564 tempest-DomainsNegativeTestJSON-1427612564-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:02.949898 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-4f4d2c40-c312-43ad-a0df-acd09617d456 tempest-DomainsNegativeTestJSON-1427612564 tempest-DomainsNegativeTestJSON-1427612564-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:03.004362 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb344b8-7c1f-406e-ad05-274ece4bb929 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:03.009615 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdaacc1-f89f-429e-94e5-638483dd6d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:03.010509 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdaacc1-f89f-429e-94e5-638483dd6d60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:03.010783 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdaacc1-f89f-429e-94e5-638483dd6d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:03.011053 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdaacc1-f89f-429e-94e5-638483dd6d60 admin admin] PATH_INFO: `/v3/projects/3352fa96c34f476f9413d05dc420c38e` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:03.012294 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdaacc1-f89f-429e-94e5-638483dd6d60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3352fa96c34f476f9413d05dc420c38e)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:03.013166 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:03.014720 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdaacc1-f89f-429e-94e5-638483dd6d60 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:03.019303 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4d2c40-c312-43ad-a0df-acd09617d456 tempest-DomainsNegativeTestJSON-1427612564 tempest-DomainsNegativeTestJSON-1427612564-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:03.025975 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ae9490-be85-49cf-9c5e-2fd4d41a75e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:03.026655 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ae9490-be85-49cf-9c5e-2fd4d41a75e0 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:03.026930 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ae9490-be85-49cf-9c5e-2fd4d41a75e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:03.027201 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ae9490-be85-49cf-9c5e-2fd4d41a75e0 admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:03.027884 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ae9490-be85-49cf-9c5e-2fd4d41a75e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:03.029784 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ae9490-be85-49cf-9c5e-2fd4d41a75e0 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:03.055203 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2960/5907] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:34:02 2022] POST /identity/v3/users => generated 290 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:34:03.055203 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ae9490-be85-49cf-9c5e-2fd4d41a75e0 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:03.057078 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-e4ae9490-be85-49cf-9c5e-2fd4d41a75e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:03.068662 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-4bdaacc1-f89f-429e-94e5-638483dd6d60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3352fa96c34f476f9413d05dc420c38e', 'request_id': 'req-4bdaacc1-f89f-429e-94e5-638483dd6d60'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:03.078675 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-4bdaacc1-f89f-429e-94e5-638483dd6d60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3352fa96c34f476f9413d05dc420c38e', 'request_id': 'req-4bdaacc1-f89f-429e-94e5-638483dd6d60'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:03.084946 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-4bdaacc1-f89f-429e-94e5-638483dd6d60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3352fa96c34f476f9413d05dc420c38e', 'request_id': 'req-4bdaacc1-f89f-429e-94e5-638483dd6d60'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:03.086070 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:03.099010 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-4bdaacc1-f89f-429e-94e5-638483dd6d60 admin admin] The token cache is being invalidate because project 3352fa96c34f476f9413d05dc420c38e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:34:03.099399 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-4bdaacc1-f89f-429e-94e5-638483dd6d60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:03.100116 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-4bdaacc1-f89f-429e-94e5-638483dd6d60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:03.102032 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2948/5908] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:34:02 2022] DELETE /identity/v3/projects/3352fa96c34f476f9413d05dc420c38e => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:03.105638 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdaacc1-f89f-429e-94e5-638483dd6d60 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:03.105638 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-4bdaacc1-f89f-429e-94e5-638483dd6d60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:03.129722 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ae9490-be85-49cf-9c5e-2fd4d41a75e0 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:03.167787 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdaacc1-f89f-429e-94e5-638483dd6d60 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:03.172295 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1ef390-624c-4b91-a95e-edee8ea73fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:03.172968 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1ef390-624c-4b91-a95e-edee8ea73fc8 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:03.173252 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1ef390-624c-4b91-a95e-edee8ea73fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:03.173528 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1ef390-624c-4b91-a95e-edee8ea73fc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:03.174549 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1ef390-624c-4b91-a95e-edee8ea73fc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:03.176009 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1ef390-624c-4b91-a95e-edee8ea73fc8 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:03.185971 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2949/5909] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:34:03 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:34:03.187261 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44db0f5-a8af-4d18-9422-a0ca89132b2e None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:03.187550 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44db0f5-a8af-4d18-9422-a0ca89132b2e None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:03.187820 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44db0f5-a8af-4d18-9422-a0ca89132b2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:03.189615 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca12bb79-39d9-4ee2-94e9-a78b4c822725 tempest-DomainsNegativeTestJSON-1427612564 tempest-DomainsNegativeTestJSON-1427612564-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39ece4c7ec804be8bdba07f21f179804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '278e3e9d87a94780a6adbbf6f4a97e00', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:03.190550 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca12bb79-39d9-4ee2-94e9-a78b4c822725 tempest-DomainsNegativeTestJSON-1427612564 tempest-DomainsNegativeTestJSON-1427612564-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:03.190835 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca12bb79-39d9-4ee2-94e9-a78b4c822725 tempest-DomainsNegativeTestJSON-1427612564 tempest-DomainsNegativeTestJSON-1427612564-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:03.191108 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca12bb79-39d9-4ee2-94e9-a78b4c822725 tempest-DomainsNegativeTestJSON-1427612564 tempest-DomainsNegativeTestJSON-1427612564-project-admin] PATH_INFO: `/v3/domains/c44717b1398c4a80bb9c9e4390ad6754` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:03.202429 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca12bb79-39d9-4ee2-94e9-a78b4c822725 tempest-DomainsNegativeTestJSON-1427612564 tempest-DomainsNegativeTestJSON-1427612564-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=c44717b1398c4a80bb9c9e4390ad6754)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:03.204086 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca12bb79-39d9-4ee2-94e9-a78b4c822725 tempest-DomainsNegativeTestJSON-1427612564 tempest-DomainsNegativeTestJSON-1427612564-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:03.205993 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-c44db0f5-a8af-4d18-9422-a0ca89132b2e None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:34:03.207207 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-c44db0f5-a8af-4d18-9422-a0ca89132b2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:03.215234 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2950/5910] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:34:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:34:03.215984 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44db0f5-a8af-4d18-9422-a0ca89132b2e None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:03.225766 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44db0f5-a8af-4d18-9422-a0ca89132b2e None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:03.226770 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-ca12bb79-39d9-4ee2-94e9-a78b4c822725 tempest-DomainsNegativeTestJSON-1427612564 tempest-DomainsNegativeTestJSON-1427612564-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'c44717b1398c4a80bb9c9e4390ad6754'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:03.230480 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95a5e3f-ad5a-481d-b1e1-6fb28bbc96ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:03.231358 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95a5e3f-ad5a-481d-b1e1-6fb28bbc96ec admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:03.231640 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95a5e3f-ad5a-481d-b1e1-6fb28bbc96ec admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:03.231916 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95a5e3f-ad5a-481d-b1e1-6fb28bbc96ec admin admin] PATH_INFO: `/v3/projects/2a2d65a60ebe469792ab253f3f0a7f0f/users/798de34847c247fd9810711c363627ba/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:03.236378 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-ca12bb79-39d9-4ee2-94e9-a78b4c822725 tempest-DomainsNegativeTestJSON-1427612564 tempest-DomainsNegativeTestJSON-1427612564-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'c44717b1398c4a80bb9c9e4390ad6754'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:03.246565 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95a5e3f-ad5a-481d-b1e1-6fb28bbc96ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a2d65a60ebe469792ab253f3f0a7f0f, user_id=798de34847c247fd9810711c363627ba, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:03.249269 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95a5e3f-ad5a-481d-b1e1-6fb28bbc96ec admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:03.264964 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2951/5911] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:34:03 2022] PUT /identity/v3/projects/2a2d65a60ebe469792ab253f3f0a7f0f/users/798de34847c247fd9810711c363627ba/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:03.266350 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84293197-3a9d-4055-9a53-eb0498330bfc None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:03.266556 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84293197-3a9d-4055-9a53-eb0498330bfc None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:03.266826 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84293197-3a9d-4055-9a53-eb0498330bfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:03.277711 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-ca12bb79-39d9-4ee2-94e9-a78b4c822725 tempest-DomainsNegativeTestJSON-1427612564 tempest-DomainsNegativeTestJSON-1427612564-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c44717b1398c4a80bb9c9e4390ad6754', 'request_id': 'req-ca12bb79-39d9-4ee2-94e9-a78b4c822725'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:03.284072 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-84293197-3a9d-4055-9a53-eb0498330bfc None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:34:03.285478 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-84293197-3a9d-4055-9a53-eb0498330bfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:03.286315 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-ca12bb79-39d9-4ee2-94e9-a78b4c822725 tempest-DomainsNegativeTestJSON-1427612564 tempest-DomainsNegativeTestJSON-1427612564-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c44717b1398c4a80bb9c9e4390ad6754', 'request_id': 'req-ca12bb79-39d9-4ee2-94e9-a78b4c822725'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:03.290280 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=90,keystone:INSERT=4,keystone:DELETE=6 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:03.292573 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-ca12bb79-39d9-4ee2-94e9-a78b4c822725 tempest-DomainsNegativeTestJSON-1427612564 tempest-DomainsNegativeTestJSON-1427612564-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c44717b1398c4a80bb9c9e4390ad6754', 'request_id': 'req-ca12bb79-39d9-4ee2-94e9-a78b4c822725'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:03.305784 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-ca12bb79-39d9-4ee2-94e9-a78b4c822725 tempest-DomainsNegativeTestJSON-1427612564 tempest-DomainsNegativeTestJSON-1427612564-project-admin] The token cache is being invalidate because project c44717b1398c4a80bb9c9e4390ad6754 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:34:03.306076 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-ca12bb79-39d9-4ee2-94e9-a78b4c822725 tempest-DomainsNegativeTestJSON-1427612564 tempest-DomainsNegativeTestJSON-1427612564-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:03.306741 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-ca12bb79-39d9-4ee2-94e9-a78b4c822725 tempest-DomainsNegativeTestJSON-1427612564 tempest-DomainsNegativeTestJSON-1427612564-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:03.314506 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-ca12bb79-39d9-4ee2-94e9-a78b4c822725 tempest-DomainsNegativeTestJSON-1427612564 tempest-DomainsNegativeTestJSON-1427612564-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'c44717b1398c4a80bb9c9e4390ad6754', 'request_id': 'req-ca12bb79-39d9-4ee2-94e9-a78b4c822725'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:03.318358 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-ca12bb79-39d9-4ee2-94e9-a78b4c822725 tempest-DomainsNegativeTestJSON-1427612564 tempest-DomainsNegativeTestJSON-1427612564-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'c44717b1398c4a80bb9c9e4390ad6754', 'request_id': 'req-ca12bb79-39d9-4ee2-94e9-a78b4c822725'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:03.319240 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-ca12bb79-39d9-4ee2-94e9-a78b4c822725 tempest-DomainsNegativeTestJSON-1427612564 tempest-DomainsNegativeTestJSON-1427612564-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'c44717b1398c4a80bb9c9e4390ad6754', 'request_id': 'req-ca12bb79-39d9-4ee2-94e9-a78b4c822725'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:03.325209 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2961/5912] 10.222.0.17 () {58 vars in 1229 bytes} [Sat Jul 23 21:34:03 2022] DELETE /identity/v3/domains/c44717b1398c4a80bb9c9e4390ad6754 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:03.330298 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca12bb79-39d9-4ee2-94e9-a78b4c822725 tempest-DomainsNegativeTestJSON-1427612564 tempest-DomainsNegativeTestJSON-1427612564-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:03.331780 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-ca12bb79-39d9-4ee2-94e9-a78b4c822725 tempest-DomainsNegativeTestJSON-1427612564 tempest-DomainsNegativeTestJSON-1427612564-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:03.355293 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2952/5913] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:34:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:34:03.356013 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84293197-3a9d-4055-9a53-eb0498330bfc None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:03.357465 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-84293197-3a9d-4055-9a53-eb0498330bfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:03.408750 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca12bb79-39d9-4ee2-94e9-a78b4c822725 tempest-DomainsNegativeTestJSON-1427612564 tempest-DomainsNegativeTestJSON-1427612564-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:03.414281 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfaa343-908a-4d8d-a393-72289ad9440a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:03.414969 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfaa343-908a-4d8d-a393-72289ad9440a admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:03.415245 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfaa343-908a-4d8d-a393-72289ad9440a admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:03.415531 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfaa343-908a-4d8d-a393-72289ad9440a admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:03.416387 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfaa343-908a-4d8d-a393-72289ad9440a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:03.418058 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfaa343-908a-4d8d-a393-72289ad9440a admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:03.428618 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2962/5914] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:34:03 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:34:03.429773 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfaa343-908a-4d8d-a393-72289ad9440a admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:03.433192 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84293197-3a9d-4055-9a53-eb0498330bfc None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:03.439494 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedf1f95-5f70-410f-8e88-12536e6c9647 tempest-DomainsNegativeTestJSON-1427612564 tempest-DomainsNegativeTestJSON-1427612564-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39ece4c7ec804be8bdba07f21f179804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '278e3e9d87a94780a6adbbf6f4a97e00', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:03.440515 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedf1f95-5f70-410f-8e88-12536e6c9647 tempest-DomainsNegativeTestJSON-1427612564 tempest-DomainsNegativeTestJSON-1427612564-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:03.440805 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedf1f95-5f70-410f-8e88-12536e6c9647 tempest-DomainsNegativeTestJSON-1427612564 tempest-DomainsNegativeTestJSON-1427612564-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:03.441085 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedf1f95-5f70-410f-8e88-12536e6c9647 tempest-DomainsNegativeTestJSON-1427612564 tempest-DomainsNegativeTestJSON-1427612564-project-admin] PATH_INFO: `/v3/domains/ce61e5c8871443d0a5712aa34390ba0b` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:03.441267 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfaa343-908a-4d8d-a393-72289ad9440a admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:03.453814 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:03.453992 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f72899-dac5-49de-9869-5bbdb66b5c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:03.453992 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f72899-dac5-49de-9869-5bbdb66b5c8a admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:03.453992 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f72899-dac5-49de-9869-5bbdb66b5c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:03.453992 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f72899-dac5-49de-9869-5bbdb66b5c8a admin admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:03.454370 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f72899-dac5-49de-9869-5bbdb66b5c8a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:34:03.454370 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f72899-dac5-49de-9869-5bbdb66b5c8a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:03.454538 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedf1f95-5f70-410f-8e88-12536e6c9647 tempest-DomainsNegativeTestJSON-1427612564 tempest-DomainsNegativeTestJSON-1427612564-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 21:34:03.454629 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f72899-dac5-49de-9869-5bbdb66b5c8a admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:03.462059 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-bedf1f95-5f70-410f-8e88-12536e6c9647 tempest-DomainsNegativeTestJSON-1427612564 tempest-DomainsNegativeTestJSON-1427612564-project-admin] Could not find domain: ce61e5c8871443d0a5712aa34390ba0b.: keystone.exception.DomainNotFound: Could not find domain: ce61e5c8871443d0a5712aa34390ba0b. Jul 23 21:34:03.462059 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 21:34:03.462059 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 23 21:34:03.462059 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 23 21:34:03.462059 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 23 21:34:03.462059 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 23 21:34:03.462059 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 23 21:34:03.462059 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 23 21:34:03.462059 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: ce61e5c8871443d0a5712aa34390ba0b. Jul 23 21:34:03.462059 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 21:34:03.462059 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 23 21:34:03.462059 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 21:34:03.462059 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 21:34:03.462059 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 21:34:03.462059 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 21:34:03.463033 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 21:34:03.463033 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 21:34:03.463033 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 21:34:03.463033 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 21:34:03.463033 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 21:34:03.463033 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 21:34:03.463033 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 21:34:03.463033 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 21:34:03.463033 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 150, in delete Jul 23 21:34:03.463033 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_domain') Jul 23 21:34:03.463033 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 21:34:03.463033 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 21:34:03.463033 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 21:34:03.463033 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 21:34:03.463033 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 21:34:03.463033 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 21:34:03.467380 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 21:34:03.467380 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 21:34:03.467380 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 21:34:03.467380 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 21:34:03.467380 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 21:34:03.467380 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application with Lock( Jul 23 21:34:03.467380 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 21:34:03.467380 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._enter() Jul 23 21:34:03.467380 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 21:34:03.467380 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 21:34:03.467380 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 21:34:03.467380 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.creator() Jul 23 21:34:03.467380 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 21:34:03.467380 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application created_value = creator( Jul 23 21:34:03.467380 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 23 21:34:03.467380 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 23 21:34:03.467380 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: ce61e5c8871443d0a5712aa34390ba0b. Jul 23 21:34:03.468471 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 21:34:03.468471 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2953/5915] 10.222.0.17 () {58 vars in 1229 bytes} [Sat Jul 23 21:34:03 2022] DELETE /identity/v3/domains/ce61e5c8871443d0a5712aa34390ba0b => generated 112 bytes in 108 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 23 21:34:03.468619 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2963/5916] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:34:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:34:03.468709 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedf1f95-5f70-410f-8e88-12536e6c9647 tempest-DomainsNegativeTestJSON-1427612564 tempest-DomainsNegativeTestJSON-1427612564-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:03.468788 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f72899-dac5-49de-9869-5bbdb66b5c8a admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:03.477952 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedf1f95-5f70-410f-8e88-12536e6c9647 tempest-DomainsNegativeTestJSON-1427612564 tempest-DomainsNegativeTestJSON-1427612564-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:03.478589 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f72899-dac5-49de-9869-5bbdb66b5c8a admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:03.482630 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231a1a14-3d39-4e11-8686-c8fcdd0fd06f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:03.483346 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3c7274-78da-4f00-8fea-e95198629520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:03.483505 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231a1a14-3d39-4e11-8686-c8fcdd0fd06f admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:03.483782 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231a1a14-3d39-4e11-8686-c8fcdd0fd06f admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:03.483997 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3c7274-78da-4f00-8fea-e95198629520 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:03.484115 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231a1a14-3d39-4e11-8686-c8fcdd0fd06f admin admin] PATH_INFO: `/v3/projects/2a2d65a60ebe469792ab253f3f0a7f0f/users/798de34847c247fd9810711c363627ba/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:03.484282 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3c7274-78da-4f00-8fea-e95198629520 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:03.484559 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3c7274-78da-4f00-8fea-e95198629520 admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:03.485242 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3c7274-78da-4f00-8fea-e95198629520 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:03.486033 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231a1a14-3d39-4e11-8686-c8fcdd0fd06f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a2d65a60ebe469792ab253f3f0a7f0f, user_id=798de34847c247fd9810711c363627ba, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:03.487182 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3c7274-78da-4f00-8fea-e95198629520 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:03.488640 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231a1a14-3d39-4e11-8686-c8fcdd0fd06f admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:03.499967 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2954/5917] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:34:03 2022] PUT /identity/v3/projects/2a2d65a60ebe469792ab253f3f0a7f0f/users/798de34847c247fd9810711c363627ba/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:03.500737 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231a1a14-3d39-4e11-8686-c8fcdd0fd06f admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:03.517425 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2964/5918] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:34:03 2022] POST /identity/v3/projects => generated 387 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:34:03.517425 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb217a0-6cd0-4c78-9388-11743c42b210 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:03.517425 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb217a0-6cd0-4c78-9388-11743c42b210 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:03.517425 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb217a0-6cd0-4c78-9388-11743c42b210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:03.543172 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-eeb217a0-6cd0-4c78-9388-11743c42b210 None None] MFA Rules not processed for user `798de34847c247fd9810711c363627ba`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:34:03.544443 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-eeb217a0-6cd0-4c78-9388-11743c42b210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:03.569102 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231a1a14-3d39-4e11-8686-c8fcdd0fd06f admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:03.614647 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2965/5919] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:34:03 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:34:03.615422 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb217a0-6cd0-4c78-9388-11743c42b210 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:03.628869 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e04ee2-8d92-421c-9e00-80bfd7b3e80a tempest-DomainsNegativeTestJSON-1427612564 tempest-DomainsNegativeTestJSON-1427612564-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39ece4c7ec804be8bdba07f21f179804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '278e3e9d87a94780a6adbbf6f4a97e00', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:03.629558 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e04ee2-8d92-421c-9e00-80bfd7b3e80a tempest-DomainsNegativeTestJSON-1427612564 tempest-DomainsNegativeTestJSON-1427612564-project-admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:03.629847 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e04ee2-8d92-421c-9e00-80bfd7b3e80a tempest-DomainsNegativeTestJSON-1427612564 tempest-DomainsNegativeTestJSON-1427612564-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:03.630160 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e04ee2-8d92-421c-9e00-80bfd7b3e80a tempest-DomainsNegativeTestJSON-1427612564 tempest-DomainsNegativeTestJSON-1427612564-project-admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:03.630901 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e04ee2-8d92-421c-9e00-80bfd7b3e80a tempest-DomainsNegativeTestJSON-1427612564 tempest-DomainsNegativeTestJSON-1427612564-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:03.632543 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e04ee2-8d92-421c-9e00-80bfd7b3e80a tempest-DomainsNegativeTestJSON-1427612564 tempest-DomainsNegativeTestJSON-1427612564-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:03.634428 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:03.648960 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2955/5920] 10.222.0.17 () {60 vars in 1148 bytes} [Sat Jul 23 21:34:03 2022] POST /identity/v3/domains => generated 252 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:34:03.649753 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e04ee2-8d92-421c-9e00-80bfd7b3e80a tempest-DomainsNegativeTestJSON-1427612564 tempest-DomainsNegativeTestJSON-1427612564-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:03.686020 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb217a0-6cd0-4c78-9388-11743c42b210 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:03.710995 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e04ee2-8d92-421c-9e00-80bfd7b3e80a tempest-DomainsNegativeTestJSON-1427612564 tempest-DomainsNegativeTestJSON-1427612564-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:03.716294 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b610b2c-94e3-4d22-93eb-32c446534a6e tempest-RegionsTestJSON-1454873385 tempest-RegionsTestJSON-1454873385-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '798de34847c247fd9810711c363627ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a2d65a60ebe469792ab253f3f0a7f0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:03.716984 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b610b2c-94e3-4d22-93eb-32c446534a6e tempest-RegionsTestJSON-1454873385 tempest-RegionsTestJSON-1454873385-project-admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:03.717276 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b610b2c-94e3-4d22-93eb-32c446534a6e tempest-RegionsTestJSON-1454873385 tempest-RegionsTestJSON-1454873385-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:03.717552 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b610b2c-94e3-4d22-93eb-32c446534a6e tempest-RegionsTestJSON-1454873385 tempest-RegionsTestJSON-1454873385-project-admin] PATH_INFO: `/v3/regions` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:03.718308 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b610b2c-94e3-4d22-93eb-32c446534a6e tempest-RegionsTestJSON-1454873385 tempest-RegionsTestJSON-1454873385-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:03.719346 ncdv-master-1 devstack@keystone.service[91547]: WARNING py.warnings [None req-6b610b2c-94e3-4d22-93eb-32c446534a6e tempest-RegionsTestJSON-1454873385 tempest-RegionsTestJSON-1454873385-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:34:03.719346 ncdv-master-1 devstack@keystone.service[91547]: warnings.warn(msg) Jul 23 21:34:03.719346 ncdv-master-1 devstack@keystone.service[91547]: Jul 23 21:34:03.720289 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b610b2c-94e3-4d22-93eb-32c446534a6e tempest-RegionsTestJSON-1454873385 tempest-RegionsTestJSON-1454873385-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:03.746581 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2956/5921] 10.222.0.17 () {60 vars in 1148 bytes} [Sat Jul 23 21:34:03 2022] POST /identity/v3/regions => generated 224 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:34:03.746581 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b610b2c-94e3-4d22-93eb-32c446534a6e tempest-RegionsTestJSON-1454873385 tempest-RegionsTestJSON-1454873385-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:03.758437 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816e770f-d18a-487a-bbe4-017ed4539421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:03.759117 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816e770f-d18a-487a-bbe4-017ed4539421 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:03.759396 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816e770f-d18a-487a-bbe4-017ed4539421 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:03.759668 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816e770f-d18a-487a-bbe4-017ed4539421 admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:03.760342 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816e770f-d18a-487a-bbe4-017ed4539421 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:03.762290 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816e770f-d18a-487a-bbe4-017ed4539421 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:03.763305 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:03.784038 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2966/5922] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:34:03 2022] POST /identity/v3/users => generated 300 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:34:03.784881 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816e770f-d18a-487a-bbe4-017ed4539421 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:03.807079 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816e770f-d18a-487a-bbe4-017ed4539421 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:03.812755 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b494e62a-1c72-4725-b14c-ad0508eba326 tempest-RegionsTestJSON-1454873385 tempest-RegionsTestJSON-1454873385-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '798de34847c247fd9810711c363627ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a2d65a60ebe469792ab253f3f0a7f0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:03.813438 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b494e62a-1c72-4725-b14c-ad0508eba326 tempest-RegionsTestJSON-1454873385 tempest-RegionsTestJSON-1454873385-project-admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:03.813756 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b494e62a-1c72-4725-b14c-ad0508eba326 tempest-RegionsTestJSON-1454873385 tempest-RegionsTestJSON-1454873385-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:03.814045 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b494e62a-1c72-4725-b14c-ad0508eba326 tempest-RegionsTestJSON-1454873385 tempest-RegionsTestJSON-1454873385-project-admin] PATH_INFO: `/v3/regions` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:03.814742 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b494e62a-1c72-4725-b14c-ad0508eba326 tempest-RegionsTestJSON-1454873385 tempest-RegionsTestJSON-1454873385-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:03.815767 ncdv-master-1 devstack@keystone.service[91548]: WARNING py.warnings [None req-b494e62a-1c72-4725-b14c-ad0508eba326 tempest-RegionsTestJSON-1454873385 tempest-RegionsTestJSON-1454873385-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:34:03.815767 ncdv-master-1 devstack@keystone.service[91548]: warnings.warn(msg) Jul 23 21:34:03.815767 ncdv-master-1 devstack@keystone.service[91548]: Jul 23 21:34:03.816658 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b494e62a-1c72-4725-b14c-ad0508eba326 tempest-RegionsTestJSON-1454873385 tempest-RegionsTestJSON-1454873385-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:03.823701 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b610b2c-94e3-4d22-93eb-32c446534a6e tempest-RegionsTestJSON-1454873385 tempest-RegionsTestJSON-1454873385-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:03.830191 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d7cd92-358c-4c66-b504-6ef9006a790a tempest-DomainsNegativeTestJSON-1427612564 tempest-DomainsNegativeTestJSON-1427612564-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39ece4c7ec804be8bdba07f21f179804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '278e3e9d87a94780a6adbbf6f4a97e00', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:03.830865 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d7cd92-358c-4c66-b504-6ef9006a790a tempest-DomainsNegativeTestJSON-1427612564 tempest-DomainsNegativeTestJSON-1427612564-project-admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:03.831147 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d7cd92-358c-4c66-b504-6ef9006a790a tempest-DomainsNegativeTestJSON-1427612564 tempest-DomainsNegativeTestJSON-1427612564-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:03.831426 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d7cd92-358c-4c66-b504-6ef9006a790a tempest-DomainsNegativeTestJSON-1427612564 tempest-DomainsNegativeTestJSON-1427612564-project-admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:03.832158 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d7cd92-358c-4c66-b504-6ef9006a790a tempest-DomainsNegativeTestJSON-1427612564 tempest-DomainsNegativeTestJSON-1427612564-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:03.833793 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d7cd92-358c-4c66-b504-6ef9006a790a tempest-DomainsNegativeTestJSON-1427612564 tempest-DomainsNegativeTestJSON-1427612564-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:03.841013 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.sql.core [None req-f2d7cd92-358c-4c66-b504-6ef9006a790a tempest-DomainsNegativeTestJSON-1427612564 tempest-DomainsNegativeTestJSON-1427612564-project-admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-tempest-domain-dup-604916729' for key 'project.ixu_project_name_domain_id'") Jul 23 21:34:03.841013 ncdv-master-1 devstack@keystone.service[91547]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 23 21:34:03.841013 ncdv-master-1 devstack@keystone.service[91547]: [parameters: {'id': '7090147b961444f2a02f586ad484ef71', 'name': 'tempest-domain-dup-604916729', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Jul 23 21:34:03.841013 ncdv-master-1 devstack@keystone.service[91547]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=91547) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 23 21:34:03.845708 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2967/5923] 10.222.0.17 () {60 vars in 1148 bytes} [Sat Jul 23 21:34:03 2022] POST /identity/v3/regions => generated 224 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:34:03.846921 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b494e62a-1c72-4725-b14c-ad0508eba326 tempest-RegionsTestJSON-1454873385 tempest-RegionsTestJSON-1454873385-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:03.848441 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-f2d7cd92-358c-4c66-b504-6ef9006a790a tempest-DomainsNegativeTestJSON-1427612564 tempest-DomainsNegativeTestJSON-1427612564-project-admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-604916729.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-604916729. Jul 23 21:34:03.848441 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 21:34:03.848441 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 23 21:34:03.848441 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 23 21:34:03.848441 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 23 21:34:03.848441 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 23 21:34:03.848441 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 23 21:34:03.848441 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application result = self._query(query) Jul 23 21:34:03.848441 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 23 21:34:03.848441 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application conn.query(q) Jul 23 21:34:03.848441 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 23 21:34:03.848441 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 23 21:34:03.848441 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 23 21:34:03.849535 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application result.read() Jul 23 21:34:03.849535 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 23 21:34:03.849535 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 23 21:34:03.849535 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 23 21:34:03.849535 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 23 21:34:03.849535 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 23 21:34:03.849535 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 23 21:34:03.849535 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 23 21:34:03.849535 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 23 21:34:03.849535 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-tempest-domain-dup-604916729' for key 'project.ixu_project_name_domain_id'") Jul 23 21:34:03.849535 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 21:34:03.849535 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 23 21:34:03.849535 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 21:34:03.849535 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 21:34:03.849535 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 23 21:34:03.849535 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 23 21:34:03.849535 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 23 21:34:03.849535 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 23 21:34:03.851687 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 23 21:34:03.851687 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application next(self.gen) Jul 23 21:34:03.851687 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 23 21:34:03.851687 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application yield resource Jul 23 21:34:03.851687 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 23 21:34:03.851687 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application next(self.gen) Jul 23 21:34:03.851687 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 23 21:34:03.851687 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application self.session.rollback() Jul 23 21:34:03.851687 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 23 21:34:03.851687 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application self.force_reraise() Jul 23 21:34:03.851687 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 23 21:34:03.851687 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise self.value Jul 23 21:34:03.851687 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 23 21:34:03.851687 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 23 21:34:03.851687 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 23 21:34:03.851687 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application session.commit() Jul 23 21:34:03.851687 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 23 21:34:03.852987 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 23 21:34:03.852987 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 23 21:34:03.852987 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application self._prepare_impl() Jul 23 21:34:03.852987 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 23 21:34:03.852987 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application self.session.flush() Jul 23 21:34:03.852987 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 23 21:34:03.852987 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application self._flush(objects) Jul 23 21:34:03.852987 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 23 21:34:03.852987 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 23 21:34:03.852987 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 23 21:34:03.852987 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application compat.raise_( Jul 23 21:34:03.852987 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 23 21:34:03.852987 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception Jul 23 21:34:03.852987 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 23 21:34:03.852987 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application flush_context.execute() Jul 23 21:34:03.852987 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 23 21:34:03.852987 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rec.execute(self) Jul 23 21:34:03.854502 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 23 21:34:03.854502 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 23 21:34:03.854502 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 23 21:34:03.854502 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 23 21:34:03.854502 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 23 21:34:03.854502 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 23 21:34:03.854502 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 23 21:34:03.854502 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 23 21:34:03.854502 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 23 21:34:03.854502 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 23 21:34:03.854502 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 23 21:34:03.854502 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 23 21:34:03.854502 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 23 21:34:03.854502 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 23 21:34:03.854502 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 23 21:34:03.855630 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 23 21:34:03.855630 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 23 21:34:03.855630 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception Jul 23 21:34:03.855630 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 23 21:34:03.855630 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 23 21:34:03.855630 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 23 21:34:03.855630 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 23 21:34:03.855630 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 23 21:34:03.855630 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application result = self._query(query) Jul 23 21:34:03.855630 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 23 21:34:03.855630 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application conn.query(q) Jul 23 21:34:03.855630 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 23 21:34:03.855630 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 23 21:34:03.855630 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 23 21:34:03.855630 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application result.read() Jul 23 21:34:03.855630 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 23 21:34:03.855630 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 23 21:34:03.856939 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 23 21:34:03.856939 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 23 21:34:03.856939 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 23 21:34:03.856939 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 23 21:34:03.856939 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 23 21:34:03.856939 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 23 21:34:03.856939 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-tempest-domain-dup-604916729' for key 'project.ixu_project_name_domain_id'") Jul 23 21:34:03.856939 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 23 21:34:03.856939 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [parameters: {'id': '7090147b961444f2a02f586ad484ef71', 'name': 'tempest-domain-dup-604916729', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Jul 23 21:34:03.856939 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 23 21:34:03.856939 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 21:34:03.856939 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 23 21:34:03.856939 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 21:34:03.856939 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 21:34:03.858006 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 23 21:34:03.858006 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 23 21:34:03.858006 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 23 21:34:03.858006 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 23 21:34:03.858006 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name tempest-domain-dup-604916729. Jul 23 21:34:03.858006 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 21:34:03.858006 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 23 21:34:03.858006 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 21:34:03.858006 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 21:34:03.858006 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 21:34:03.858006 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 21:34:03.858006 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 21:34:03.858006 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 21:34:03.858006 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 21:34:03.858006 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 21:34:03.858006 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 21:34:03.858006 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 21:34:03.860490 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 21:34:03.860490 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 21:34:03.860490 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Jul 23 21:34:03.860490 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Jul 23 21:34:03.860490 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 21:34:03.860490 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 21:34:03.860490 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Jul 23 21:34:03.860490 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Jul 23 21:34:03.860490 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 21:34:03.860490 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 21:34:03.860490 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 23 21:34:03.860490 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 23 21:34:03.860490 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-604916729. Jul 23 21:34:03.860490 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 21:34:03.860490 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2957/5924] 10.222.0.17 () {60 vars in 1148 bytes} [Sat Jul 23 21:34:03 2022] POST /identity/v3/domains => generated 211 bytes in 109 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 23 21:34:03.862128 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d7cd92-358c-4c66-b504-6ef9006a790a tempest-DomainsNegativeTestJSON-1427612564 tempest-DomainsNegativeTestJSON-1427612564-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:03.865804 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d7cd92-358c-4c66-b504-6ef9006a790a tempest-DomainsNegativeTestJSON-1427612564 tempest-DomainsNegativeTestJSON-1427612564-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:03.877636 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b494e62a-1c72-4725-b14c-ad0508eba326 tempest-RegionsTestJSON-1454873385 tempest-RegionsTestJSON-1454873385-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:03.882925 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07666002-981b-427b-86c9-64b88b0f6ec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:03.883646 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07666002-981b-427b-86c9-64b88b0f6ec6 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:03.883920 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07666002-981b-427b-86c9-64b88b0f6ec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:03.884216 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07666002-981b-427b-86c9-64b88b0f6ec6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:03.884959 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07666002-981b-427b-86c9-64b88b0f6ec6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:03.886699 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07666002-981b-427b-86c9-64b88b0f6ec6 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:03.901818 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2968/5925] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:34:03 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:34:03.901818 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07666002-981b-427b-86c9-64b88b0f6ec6 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:03.923653 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07666002-981b-427b-86c9-64b88b0f6ec6 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:03.928862 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ee9629-de3c-405e-9e6e-d8b2abe6a34d tempest-DomainsNegativeTestJSON-1427612564 tempest-DomainsNegativeTestJSON-1427612564-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39ece4c7ec804be8bdba07f21f179804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '278e3e9d87a94780a6adbbf6f4a97e00', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:03.929779 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ee9629-de3c-405e-9e6e-d8b2abe6a34d tempest-DomainsNegativeTestJSON-1427612564 tempest-DomainsNegativeTestJSON-1427612564-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:03.930093 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ee9629-de3c-405e-9e6e-d8b2abe6a34d tempest-DomainsNegativeTestJSON-1427612564 tempest-DomainsNegativeTestJSON-1427612564-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:03.930370 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ee9629-de3c-405e-9e6e-d8b2abe6a34d tempest-DomainsNegativeTestJSON-1427612564 tempest-DomainsNegativeTestJSON-1427612564-project-admin] PATH_INFO: `/v3/domains/e88d8cbed8774739ab5ec95a98c43eab` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:03.944191 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ee9629-de3c-405e-9e6e-d8b2abe6a34d tempest-DomainsNegativeTestJSON-1427612564 tempest-DomainsNegativeTestJSON-1427612564-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=e88d8cbed8774739ab5ec95a98c43eab)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:03.945908 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ee9629-de3c-405e-9e6e-d8b2abe6a34d tempest-DomainsNegativeTestJSON-1427612564 tempest-DomainsNegativeTestJSON-1427612564-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:03.969405 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-47ee9629-de3c-405e-9e6e-d8b2abe6a34d tempest-DomainsNegativeTestJSON-1427612564 tempest-DomainsNegativeTestJSON-1427612564-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'e88d8cbed8774739ab5ec95a98c43eab'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:03.970397 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-47ee9629-de3c-405e-9e6e-d8b2abe6a34d tempest-DomainsNegativeTestJSON-1427612564 tempest-DomainsNegativeTestJSON-1427612564-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'e88d8cbed8774739ab5ec95a98c43eab'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:03.995016 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:UPDATE=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:04.000749 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-47ee9629-de3c-405e-9e6e-d8b2abe6a34d tempest-DomainsNegativeTestJSON-1427612564 tempest-DomainsNegativeTestJSON-1427612564-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'e88d8cbed8774739ab5ec95a98c43eab'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:04.001845 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-47ee9629-de3c-405e-9e6e-d8b2abe6a34d tempest-DomainsNegativeTestJSON-1427612564 tempest-DomainsNegativeTestJSON-1427612564-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'e88d8cbed8774739ab5ec95a98c43eab'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:04.005393 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2969/5926] 10.222.0.17 () {60 vars in 1248 bytes} [Sat Jul 23 21:34:03 2022] PATCH /identity/v3/domains/e88d8cbed8774739ab5ec95a98c43eab => generated 253 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:34:04.006269 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ee9629-de3c-405e-9e6e-d8b2abe6a34d tempest-DomainsNegativeTestJSON-1427612564 tempest-DomainsNegativeTestJSON-1427612564-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:04.007690 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-47ee9629-de3c-405e-9e6e-d8b2abe6a34d tempest-DomainsNegativeTestJSON-1427612564 tempest-DomainsNegativeTestJSON-1427612564-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:04.026687 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec64af3-f597-4afb-8736-785e03dc956c tempest-RegionsTestJSON-1454873385 tempest-RegionsTestJSON-1454873385-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '798de34847c247fd9810711c363627ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a2d65a60ebe469792ab253f3f0a7f0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:04.027552 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec64af3-f597-4afb-8736-785e03dc956c tempest-RegionsTestJSON-1454873385 tempest-RegionsTestJSON-1454873385-project-admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:04.027832 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec64af3-f597-4afb-8736-785e03dc956c tempest-RegionsTestJSON-1454873385 tempest-RegionsTestJSON-1454873385-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:04.028104 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec64af3-f597-4afb-8736-785e03dc956c tempest-RegionsTestJSON-1454873385 tempest-RegionsTestJSON-1454873385-project-admin] PATH_INFO: `/v3/regions/914032c7-6f20-40ef-a71c-78782f7e7943` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:04.028823 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec64af3-f597-4afb-8736-785e03dc956c tempest-RegionsTestJSON-1454873385 tempest-RegionsTestJSON-1454873385-project-admin] RBAC: Authorizing `identity:create_region(region_id=914032c7-6f20-40ef-a71c-78782f7e7943)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:04.030454 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec64af3-f597-4afb-8736-785e03dc956c tempest-RegionsTestJSON-1454873385 tempest-RegionsTestJSON-1454873385-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:04.050087 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2958/5927] 10.222.0.17 () {60 vars in 1258 bytes} [Sat Jul 23 21:34:03 2022] PUT /identity/v3/regions/914032c7-6f20-40ef-a71c-78782f7e7943 => generated 232 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:34:04.050914 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec64af3-f597-4afb-8736-785e03dc956c tempest-RegionsTestJSON-1454873385 tempest-RegionsTestJSON-1454873385-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:04.052528 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-1ec64af3-f597-4afb-8736-785e03dc956c tempest-RegionsTestJSON-1454873385 tempest-RegionsTestJSON-1454873385-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:04.075658 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec64af3-f597-4afb-8736-785e03dc956c tempest-RegionsTestJSON-1454873385 tempest-RegionsTestJSON-1454873385-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:04.083057 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ee9629-de3c-405e-9e6e-d8b2abe6a34d tempest-DomainsNegativeTestJSON-1427612564 tempest-DomainsNegativeTestJSON-1427612564-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:04.098024 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdf7fad-e2c5-475c-b062-87798b88993b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:04.099138 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdf7fad-e2c5-475c-b062-87798b88993b admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:04.099417 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdf7fad-e2c5-475c-b062-87798b88993b admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:04.099692 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdf7fad-e2c5-475c-b062-87798b88993b admin admin] PATH_INFO: `/v3/projects/d012d6fb46e34ea0983f2a24947b363b/users/ff06e1136db04365971a14be7ab18721/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:04.114637 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdf7fad-e2c5-475c-b062-87798b88993b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d012d6fb46e34ea0983f2a24947b363b, user_id=ff06e1136db04365971a14be7ab18721, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:04.117461 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdf7fad-e2c5-475c-b062-87798b88993b admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:04.131680 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2970/5928] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:34:04 2022] PUT /identity/v3/projects/d012d6fb46e34ea0983f2a24947b363b/users/ff06e1136db04365971a14be7ab18721/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:04.133169 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdf7fad-e2c5-475c-b062-87798b88993b admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:04.134893 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-7cdf7fad-e2c5-475c-b062-87798b88993b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:04.136452 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4937bf8a-be57-4f03-afff-d9ab77551ae2 tempest-DomainsNegativeTestJSON-1427612564 tempest-DomainsNegativeTestJSON-1427612564-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39ece4c7ec804be8bdba07f21f179804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '278e3e9d87a94780a6adbbf6f4a97e00', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:04.137374 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4937bf8a-be57-4f03-afff-d9ab77551ae2 tempest-DomainsNegativeTestJSON-1427612564 tempest-DomainsNegativeTestJSON-1427612564-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:04.137657 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4937bf8a-be57-4f03-afff-d9ab77551ae2 tempest-DomainsNegativeTestJSON-1427612564 tempest-DomainsNegativeTestJSON-1427612564-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:04.137964 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4937bf8a-be57-4f03-afff-d9ab77551ae2 tempest-DomainsNegativeTestJSON-1427612564 tempest-DomainsNegativeTestJSON-1427612564-project-admin] PATH_INFO: `/v3/domains/e88d8cbed8774739ab5ec95a98c43eab` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:04.149741 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4937bf8a-be57-4f03-afff-d9ab77551ae2 tempest-DomainsNegativeTestJSON-1427612564 tempest-DomainsNegativeTestJSON-1427612564-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=e88d8cbed8774739ab5ec95a98c43eab)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:04.151410 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4937bf8a-be57-4f03-afff-d9ab77551ae2 tempest-DomainsNegativeTestJSON-1427612564 tempest-DomainsNegativeTestJSON-1427612564-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:04.173332 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-4937bf8a-be57-4f03-afff-d9ab77551ae2 tempest-DomainsNegativeTestJSON-1427612564 tempest-DomainsNegativeTestJSON-1427612564-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'e88d8cbed8774739ab5ec95a98c43eab'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:04.182911 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-4937bf8a-be57-4f03-afff-d9ab77551ae2 tempest-DomainsNegativeTestJSON-1427612564 tempest-DomainsNegativeTestJSON-1427612564-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'e88d8cbed8774739ab5ec95a98c43eab'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:04.210336 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdf7fad-e2c5-475c-b062-87798b88993b admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:04.217596 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:04.226987 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-4937bf8a-be57-4f03-afff-d9ab77551ae2 tempest-DomainsNegativeTestJSON-1427612564 tempest-DomainsNegativeTestJSON-1427612564-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e88d8cbed8774739ab5ec95a98c43eab', 'request_id': 'req-4937bf8a-be57-4f03-afff-d9ab77551ae2'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:04.234766 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-4937bf8a-be57-4f03-afff-d9ab77551ae2 tempest-DomainsNegativeTestJSON-1427612564 tempest-DomainsNegativeTestJSON-1427612564-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e88d8cbed8774739ab5ec95a98c43eab', 'request_id': 'req-4937bf8a-be57-4f03-afff-d9ab77551ae2'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:04.240476 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-4937bf8a-be57-4f03-afff-d9ab77551ae2 tempest-DomainsNegativeTestJSON-1427612564 tempest-DomainsNegativeTestJSON-1427612564-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e88d8cbed8774739ab5ec95a98c43eab', 'request_id': 'req-4937bf8a-be57-4f03-afff-d9ab77551ae2'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:04.252186 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-4937bf8a-be57-4f03-afff-d9ab77551ae2 tempest-DomainsNegativeTestJSON-1427612564 tempest-DomainsNegativeTestJSON-1427612564-project-admin] The token cache is being invalidate because project e88d8cbed8774739ab5ec95a98c43eab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:34:04.252492 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-4937bf8a-be57-4f03-afff-d9ab77551ae2 tempest-DomainsNegativeTestJSON-1427612564 tempest-DomainsNegativeTestJSON-1427612564-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:04.253222 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-4937bf8a-be57-4f03-afff-d9ab77551ae2 tempest-DomainsNegativeTestJSON-1427612564 tempest-DomainsNegativeTestJSON-1427612564-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:04.261335 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-4937bf8a-be57-4f03-afff-d9ab77551ae2 tempest-DomainsNegativeTestJSON-1427612564 tempest-DomainsNegativeTestJSON-1427612564-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'e88d8cbed8774739ab5ec95a98c43eab', 'request_id': 'req-4937bf8a-be57-4f03-afff-d9ab77551ae2'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:04.262118 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-4937bf8a-be57-4f03-afff-d9ab77551ae2 tempest-DomainsNegativeTestJSON-1427612564 tempest-DomainsNegativeTestJSON-1427612564-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'e88d8cbed8774739ab5ec95a98c43eab', 'request_id': 'req-4937bf8a-be57-4f03-afff-d9ab77551ae2'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:04.265412 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-4937bf8a-be57-4f03-afff-d9ab77551ae2 tempest-DomainsNegativeTestJSON-1427612564 tempest-DomainsNegativeTestJSON-1427612564-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'e88d8cbed8774739ab5ec95a98c43eab', 'request_id': 'req-4937bf8a-be57-4f03-afff-d9ab77551ae2'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:04.267388 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8824631-12cb-4426-8138-dd928a90a3bf tempest-RegionsTestJSON-1454873385 tempest-RegionsTestJSON-1454873385-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '798de34847c247fd9810711c363627ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a2d65a60ebe469792ab253f3f0a7f0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:04.268279 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8824631-12cb-4426-8138-dd928a90a3bf tempest-RegionsTestJSON-1454873385 tempest-RegionsTestJSON-1454873385-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:04.268558 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8824631-12cb-4426-8138-dd928a90a3bf tempest-RegionsTestJSON-1454873385 tempest-RegionsTestJSON-1454873385-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:04.268813 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8824631-12cb-4426-8138-dd928a90a3bf tempest-RegionsTestJSON-1454873385 tempest-RegionsTestJSON-1454873385-project-admin] PATH_INFO: `/v3/regions/914032c7-6f20-40ef-a71c-78782f7e7943` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:04.269481 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8824631-12cb-4426-8138-dd928a90a3bf tempest-RegionsTestJSON-1454873385 tempest-RegionsTestJSON-1454873385-project-admin] RBAC: Authorizing `identity:delete_region(region_id=914032c7-6f20-40ef-a71c-78782f7e7943)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:04.270526 ncdv-master-1 devstack@keystone.service[91548]: WARNING py.warnings [None req-a8824631-12cb-4426-8138-dd928a90a3bf tempest-RegionsTestJSON-1454873385 tempest-RegionsTestJSON-1454873385-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:34:04.270526 ncdv-master-1 devstack@keystone.service[91548]: warnings.warn(msg) Jul 23 21:34:04.270526 ncdv-master-1 devstack@keystone.service[91548]: Jul 23 21:34:04.271049 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2959/5929] 10.222.0.17 () {58 vars in 1229 bytes} [Sat Jul 23 21:34:04 2022] DELETE /identity/v3/domains/e88d8cbed8774739ab5ec95a98c43eab => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:04.271415 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8824631-12cb-4426-8138-dd928a90a3bf tempest-RegionsTestJSON-1454873385 tempest-RegionsTestJSON-1454873385-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:04.274653 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4937bf8a-be57-4f03-afff-d9ab77551ae2 tempest-DomainsNegativeTestJSON-1427612564 tempest-DomainsNegativeTestJSON-1427612564-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:04.276075 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-4937bf8a-be57-4f03-afff-d9ab77551ae2 tempest-DomainsNegativeTestJSON-1427612564 tempest-DomainsNegativeTestJSON-1427612564-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:04.285121 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:04.297805 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2971/5930] 10.222.0.17 () {58 vars in 1241 bytes} [Sat Jul 23 21:34:04 2022] DELETE /identity/v3/regions/914032c7-6f20-40ef-a71c-78782f7e7943 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:04.299123 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8824631-12cb-4426-8138-dd928a90a3bf tempest-RegionsTestJSON-1454873385 tempest-RegionsTestJSON-1454873385-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:04.302707 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-a8824631-12cb-4426-8138-dd928a90a3bf tempest-RegionsTestJSON-1454873385 tempest-RegionsTestJSON-1454873385-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:04.341011 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4937bf8a-be57-4f03-afff-d9ab77551ae2 tempest-DomainsNegativeTestJSON-1427612564 tempest-DomainsNegativeTestJSON-1427612564-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:04.356850 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70658151-a956-4c22-8c55-6c1bba65d92b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:04.357737 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70658151-a956-4c22-8c55-6c1bba65d92b admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:04.358084 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70658151-a956-4c22-8c55-6c1bba65d92b admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:04.358339 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70658151-a956-4c22-8c55-6c1bba65d92b admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:04.359072 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70658151-a956-4c22-8c55-6c1bba65d92b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:04.360652 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70658151-a956-4c22-8c55-6c1bba65d92b admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:04.371365 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2960/5931] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:34:04 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:34:04.372154 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70658151-a956-4c22-8c55-6c1bba65d92b admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:04.373814 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-70658151-a956-4c22-8c55-6c1bba65d92b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:04.382424 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8824631-12cb-4426-8138-dd928a90a3bf tempest-RegionsTestJSON-1454873385 tempest-RegionsTestJSON-1454873385-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:04.387254 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c918d61a-a43a-4cfc-b0f8-f97e89537393 tempest-DomainsNegativeTestJSON-1427612564 tempest-DomainsNegativeTestJSON-1427612564-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39ece4c7ec804be8bdba07f21f179804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '278e3e9d87a94780a6adbbf6f4a97e00', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:04.388143 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c918d61a-a43a-4cfc-b0f8-f97e89537393 tempest-DomainsNegativeTestJSON-1427612564 tempest-DomainsNegativeTestJSON-1427612564-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:04.388424 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c918d61a-a43a-4cfc-b0f8-f97e89537393 tempest-DomainsNegativeTestJSON-1427612564 tempest-DomainsNegativeTestJSON-1427612564-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:04.388699 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c918d61a-a43a-4cfc-b0f8-f97e89537393 tempest-DomainsNegativeTestJSON-1427612564 tempest-DomainsNegativeTestJSON-1427612564-project-admin] PATH_INFO: `/v3/domains/c44717b1398c4a80bb9c9e4390ad6754` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:04.395732 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c918d61a-a43a-4cfc-b0f8-f97e89537393 tempest-DomainsNegativeTestJSON-1427612564 tempest-DomainsNegativeTestJSON-1427612564-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 21:34:04.398156 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70658151-a956-4c22-8c55-6c1bba65d92b admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:04.403064 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6261dfa-94ab-4a8f-b685-c3e9a96ea294 tempest-RegionsTestJSON-1454873385 tempest-RegionsTestJSON-1454873385-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '798de34847c247fd9810711c363627ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a2d65a60ebe469792ab253f3f0a7f0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:04.403756 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6261dfa-94ab-4a8f-b685-c3e9a96ea294 tempest-RegionsTestJSON-1454873385 tempest-RegionsTestJSON-1454873385-project-admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:04.404042 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6261dfa-94ab-4a8f-b685-c3e9a96ea294 tempest-RegionsTestJSON-1454873385 tempest-RegionsTestJSON-1454873385-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:04.404322 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6261dfa-94ab-4a8f-b685-c3e9a96ea294 tempest-RegionsTestJSON-1454873385 tempest-RegionsTestJSON-1454873385-project-admin] PATH_INFO: `/v3/regions` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:04.405032 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6261dfa-94ab-4a8f-b685-c3e9a96ea294 tempest-RegionsTestJSON-1454873385 tempest-RegionsTestJSON-1454873385-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:04.405807 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-c918d61a-a43a-4cfc-b0f8-f97e89537393 tempest-DomainsNegativeTestJSON-1427612564 tempest-DomainsNegativeTestJSON-1427612564-project-admin] Could not find domain: c44717b1398c4a80bb9c9e4390ad6754.: keystone.exception.DomainNotFound: Could not find domain: c44717b1398c4a80bb9c9e4390ad6754. Jul 23 21:34:04.405807 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 21:34:04.405807 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 23 21:34:04.405807 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 23 21:34:04.405807 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 23 21:34:04.405807 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 23 21:34:04.405807 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 23 21:34:04.405807 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 23 21:34:04.405807 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: c44717b1398c4a80bb9c9e4390ad6754. Jul 23 21:34:04.405807 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 21:34:04.405807 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 23 21:34:04.405807 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 21:34:04.405807 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 21:34:04.405807 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 21:34:04.405807 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 21:34:04.406801 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 21:34:04.406801 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 21:34:04.406801 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 21:34:04.406801 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 21:34:04.406801 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 21:34:04.406801 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 21:34:04.406801 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 21:34:04.406801 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 21:34:04.406801 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jul 23 21:34:04.406801 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jul 23 21:34:04.406801 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 21:34:04.406801 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 21:34:04.406801 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 21:34:04.406801 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 21:34:04.406801 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 21:34:04.406801 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 21:34:04.411167 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 21:34:04.411167 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 21:34:04.411167 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 21:34:04.411167 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 21:34:04.411167 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 21:34:04.411167 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application with Lock( Jul 23 21:34:04.411167 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 21:34:04.411167 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._enter() Jul 23 21:34:04.411167 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 21:34:04.411167 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 21:34:04.411167 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 21:34:04.411167 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.creator() Jul 23 21:34:04.411167 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 21:34:04.411167 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application created_value = creator( Jul 23 21:34:04.411167 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 23 21:34:04.411167 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 23 21:34:04.411167 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: c44717b1398c4a80bb9c9e4390ad6754. Jul 23 21:34:04.412476 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 21:34:04.412572 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6261dfa-94ab-4a8f-b685-c3e9a96ea294 tempest-RegionsTestJSON-1454873385 tempest-RegionsTestJSON-1454873385-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:04.412677 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2972/5932] 10.222.0.17 () {60 vars in 1248 bytes} [Sat Jul 23 21:34:04 2022] PATCH /identity/v3/domains/c44717b1398c4a80bb9c9e4390ad6754 => generated 112 bytes in 109 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 23 21:34:04.412677 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c918d61a-a43a-4cfc-b0f8-f97e89537393 tempest-DomainsNegativeTestJSON-1427612564 tempest-DomainsNegativeTestJSON-1427612564-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:04.423455 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c918d61a-a43a-4cfc-b0f8-f97e89537393 tempest-DomainsNegativeTestJSON-1427612564 tempest-DomainsNegativeTestJSON-1427612564-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:04.429287 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072e3b5c-cc9d-41b6-ba21-1a4af008f7f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:04.430190 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072e3b5c-cc9d-41b6-ba21-1a4af008f7f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:04.430466 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072e3b5c-cc9d-41b6-ba21-1a4af008f7f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:04.430735 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072e3b5c-cc9d-41b6-ba21-1a4af008f7f1 admin admin] PATH_INFO: `/v3/projects/d012d6fb46e34ea0983f2a24947b363b/users/ff06e1136db04365971a14be7ab18721/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:04.431264 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2961/5933] 10.222.0.17 () {60 vars in 1149 bytes} [Sat Jul 23 21:34:04 2022] POST /identity/v3/regions => generated 253 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:34:04.432169 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6261dfa-94ab-4a8f-b685-c3e9a96ea294 tempest-RegionsTestJSON-1454873385 tempest-RegionsTestJSON-1454873385-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:04.432963 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072e3b5c-cc9d-41b6-ba21-1a4af008f7f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d012d6fb46e34ea0983f2a24947b363b, user_id=ff06e1136db04365971a14be7ab18721, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:04.433852 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-f6261dfa-94ab-4a8f-b685-c3e9a96ea294 tempest-RegionsTestJSON-1454873385 tempest-RegionsTestJSON-1454873385-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:04.435750 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072e3b5c-cc9d-41b6-ba21-1a4af008f7f1 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:04.447817 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2973/5934] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:34:04 2022] PUT /identity/v3/projects/d012d6fb46e34ea0983f2a24947b363b/users/ff06e1136db04365971a14be7ab18721/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:04.457179 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072e3b5c-cc9d-41b6-ba21-1a4af008f7f1 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:04.468507 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6261dfa-94ab-4a8f-b685-c3e9a96ea294 tempest-RegionsTestJSON-1454873385 tempest-RegionsTestJSON-1454873385-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:04.520523 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072e3b5c-cc9d-41b6-ba21-1a4af008f7f1 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:04.525525 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=90,keystone:DELETE=8,keystone:INSERT=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:04.533097 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1de300c-b2a6-4494-9040-637e0d5b0770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:04.534034 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1de300c-b2a6-4494-9040-637e0d5b0770 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:04.534515 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1de300c-b2a6-4494-9040-637e0d5b0770 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:04.534660 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1de300c-b2a6-4494-9040-637e0d5b0770 admin admin] PATH_INFO: `/v3/users/8eaf6b159ca34c96a44ab7e62c4537b8` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:04.536035 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1de300c-b2a6-4494-9040-637e0d5b0770 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8eaf6b159ca34c96a44ab7e62c4537b8)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:04.538398 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1de300c-b2a6-4494-9040-637e0d5b0770 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:04.539712 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6067fa-2e25-49bf-9f51-cb8f98651c45 tempest-RegionsTestJSON-1454873385 tempest-RegionsTestJSON-1454873385-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '798de34847c247fd9810711c363627ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a2d65a60ebe469792ab253f3f0a7f0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:04.540608 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6067fa-2e25-49bf-9f51-cb8f98651c45 tempest-RegionsTestJSON-1454873385 tempest-RegionsTestJSON-1454873385-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:04.541251 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6067fa-2e25-49bf-9f51-cb8f98651c45 tempest-RegionsTestJSON-1454873385 tempest-RegionsTestJSON-1454873385-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:04.541251 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6067fa-2e25-49bf-9f51-cb8f98651c45 tempest-RegionsTestJSON-1454873385 tempest-RegionsTestJSON-1454873385-project-admin] PATH_INFO: `/v3/regions/a4cd7871eaf94ff9815dc8c55a0c11cc` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:04.541896 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6067fa-2e25-49bf-9f51-cb8f98651c45 tempest-RegionsTestJSON-1454873385 tempest-RegionsTestJSON-1454873385-project-admin] RBAC: Authorizing `identity:update_region(region_id=a4cd7871eaf94ff9815dc8c55a0c11cc)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:04.542918 ncdv-master-1 devstack@keystone.service[91548]: WARNING py.warnings [None req-de6067fa-2e25-49bf-9f51-cb8f98651c45 tempest-RegionsTestJSON-1454873385 tempest-RegionsTestJSON-1454873385-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:34:04.542918 ncdv-master-1 devstack@keystone.service[91548]: warnings.warn(msg) Jul 23 21:34:04.542918 ncdv-master-1 devstack@keystone.service[91548]: Jul 23 21:34:04.543822 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6067fa-2e25-49bf-9f51-cb8f98651c45 tempest-RegionsTestJSON-1454873385 tempest-RegionsTestJSON-1454873385-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:04.570261 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2974/5935] 10.222.0.17 () {60 vars in 1249 bytes} [Sat Jul 23 21:34:04 2022] PATCH /identity/v3/regions/a4cd7871eaf94ff9815dc8c55a0c11cc => generated 253 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:34:04.571423 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2754af-4c57-40c6-9609-464b6221c428 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:04.571712 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2754af-4c57-40c6-9609-464b6221c428 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:04.571975 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2754af-4c57-40c6-9609-464b6221c428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:04.598059 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-4f2754af-4c57-40c6-9609-464b6221c428 None None] MFA Rules not processed for user `ff06e1136db04365971a14be7ab18721`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:34:04.600165 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-4f2754af-4c57-40c6-9609-464b6221c428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:04.600788 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-d1de300c-b2a6-4494-9040-637e0d5b0770 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8eaf6b159ca34c96a44ab7e62c4537b8'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:04.608482 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-d1de300c-b2a6-4494-9040-637e0d5b0770 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8eaf6b159ca34c96a44ab7e62c4537b8'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:04.609170 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-d1de300c-b2a6-4494-9040-637e0d5b0770 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8eaf6b159ca34c96a44ab7e62c4537b8'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:04.617929 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-d1de300c-b2a6-4494-9040-637e0d5b0770 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8eaf6b159ca34c96a44ab7e62c4537b8'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:04.629948 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-d1de300c-b2a6-4494-9040-637e0d5b0770 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8eaf6b159ca34c96a44ab7e62c4537b8'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:04.635847 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2962/5936] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:34:04 2022] DELETE /identity/v3/users/8eaf6b159ca34c96a44ab7e62c4537b8 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:04.636593 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1de300c-b2a6-4494-9040-637e0d5b0770 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:04.638074 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-d1de300c-b2a6-4494-9040-637e0d5b0770 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:04.644516 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:04.679226 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2975/5937] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:34:04 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:34:04.679226 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0743fa1-d2ed-43ae-b528-a03c05edd6b0 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:04.679226 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0743fa1-d2ed-43ae-b528-a03c05edd6b0 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:04.679226 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0743fa1-d2ed-43ae-b528-a03c05edd6b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:04.696185 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-c0743fa1-d2ed-43ae-b528-a03c05edd6b0 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:34:04.697388 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-c0743fa1-d2ed-43ae-b528-a03c05edd6b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:04.709800 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1de300c-b2a6-4494-9040-637e0d5b0770 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:04.726289 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1c6582-6fc5-4f3c-9708-ea8ebcc3d23d tempest-RegionsTestJSON-1454873385 tempest-RegionsTestJSON-1454873385-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '798de34847c247fd9810711c363627ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a2d65a60ebe469792ab253f3f0a7f0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:04.727283 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1c6582-6fc5-4f3c-9708-ea8ebcc3d23d tempest-RegionsTestJSON-1454873385 tempest-RegionsTestJSON-1454873385-project-admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:04.727596 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1c6582-6fc5-4f3c-9708-ea8ebcc3d23d tempest-RegionsTestJSON-1454873385 tempest-RegionsTestJSON-1454873385-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:04.727873 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1c6582-6fc5-4f3c-9708-ea8ebcc3d23d tempest-RegionsTestJSON-1454873385 tempest-RegionsTestJSON-1454873385-project-admin] PATH_INFO: `/v3/regions/a4cd7871eaf94ff9815dc8c55a0c11cc` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:04.728675 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1c6582-6fc5-4f3c-9708-ea8ebcc3d23d tempest-RegionsTestJSON-1454873385 tempest-RegionsTestJSON-1454873385-project-admin] RBAC: Authorizing `identity:get_region(region_id=a4cd7871eaf94ff9815dc8c55a0c11cc)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:04.729777 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1c6582-6fc5-4f3c-9708-ea8ebcc3d23d tempest-RegionsTestJSON-1454873385 tempest-RegionsTestJSON-1454873385-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:04.735587 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2963/5938] 10.222.0.17 () {58 vars in 1226 bytes} [Sat Jul 23 21:34:04 2022] GET /identity/v3/regions/a4cd7871eaf94ff9815dc8c55a0c11cc => generated 253 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:34:04.736358 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1c6582-6fc5-4f3c-9708-ea8ebcc3d23d tempest-RegionsTestJSON-1454873385 tempest-RegionsTestJSON-1454873385-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:04.738010 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-ed1c6582-6fc5-4f3c-9708-ea8ebcc3d23d tempest-RegionsTestJSON-1454873385 tempest-RegionsTestJSON-1454873385-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:04.770532 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2976/5939] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:34:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:34:04.770532 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0743fa1-d2ed-43ae-b528-a03c05edd6b0 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:04.778890 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0743fa1-d2ed-43ae-b528-a03c05edd6b0 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:04.785216 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c0a4e6-fc7d-4f12-90b9-91c24dde4825 tempest-RegionsTestJSON-1454873385 tempest-RegionsTestJSON-1454873385-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '798de34847c247fd9810711c363627ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a2d65a60ebe469792ab253f3f0a7f0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:04.786396 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c0a4e6-fc7d-4f12-90b9-91c24dde4825 tempest-RegionsTestJSON-1454873385 tempest-RegionsTestJSON-1454873385-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:04.786735 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c0a4e6-fc7d-4f12-90b9-91c24dde4825 tempest-RegionsTestJSON-1454873385 tempest-RegionsTestJSON-1454873385-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:04.787011 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c0a4e6-fc7d-4f12-90b9-91c24dde4825 tempest-RegionsTestJSON-1454873385 tempest-RegionsTestJSON-1454873385-project-admin] PATH_INFO: `/v3/regions/a4cd7871eaf94ff9815dc8c55a0c11cc` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:04.788016 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c0a4e6-fc7d-4f12-90b9-91c24dde4825 tempest-RegionsTestJSON-1454873385 tempest-RegionsTestJSON-1454873385-project-admin] RBAC: Authorizing `identity:delete_region(region_id=a4cd7871eaf94ff9815dc8c55a0c11cc)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:04.789838 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c0a4e6-fc7d-4f12-90b9-91c24dde4825 tempest-RegionsTestJSON-1454873385 tempest-RegionsTestJSON-1454873385-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:04.802952 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1c6582-6fc5-4f3c-9708-ea8ebcc3d23d tempest-RegionsTestJSON-1454873385 tempest-RegionsTestJSON-1454873385-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:04.808059 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14609548-22d1-4a83-905c-27d354b6fa68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:04.809186 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14609548-22d1-4a83-905c-27d354b6fa68 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:04.809465 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14609548-22d1-4a83-905c-27d354b6fa68 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:04.809846 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14609548-22d1-4a83-905c-27d354b6fa68 admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:04.810567 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14609548-22d1-4a83-905c-27d354b6fa68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:04.812545 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2977/5940] 10.222.0.17 () {58 vars in 1229 bytes} [Sat Jul 23 21:34:04 2022] DELETE /identity/v3/regions/a4cd7871eaf94ff9815dc8c55a0c11cc => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:04.812666 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14609548-22d1-4a83-905c-27d354b6fa68 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:04.813435 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c0a4e6-fc7d-4f12-90b9-91c24dde4825 tempest-RegionsTestJSON-1454873385 tempest-RegionsTestJSON-1454873385-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:04.815147 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-a1c0a4e6-fc7d-4f12-90b9-91c24dde4825 tempest-RegionsTestJSON-1454873385 tempest-RegionsTestJSON-1454873385-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:04.823758 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:04.843841 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2964/5941] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:34:04 2022] POST /identity/v3/projects => generated 387 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:34:04.845178 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14609548-22d1-4a83-905c-27d354b6fa68 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:04.893999 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c0a4e6-fc7d-4f12-90b9-91c24dde4825 tempest-RegionsTestJSON-1454873385 tempest-RegionsTestJSON-1454873385-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:04.911580 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14609548-22d1-4a83-905c-27d354b6fa68 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:04.925944 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018aabfa-103d-47ef-b716-93fe03a140e4 tempest-RegionsTestJSON-1454873385 tempest-RegionsTestJSON-1454873385-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '798de34847c247fd9810711c363627ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a2d65a60ebe469792ab253f3f0a7f0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:04.926722 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018aabfa-103d-47ef-b716-93fe03a140e4 tempest-RegionsTestJSON-1454873385 tempest-RegionsTestJSON-1454873385-project-admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:04.927011 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018aabfa-103d-47ef-b716-93fe03a140e4 tempest-RegionsTestJSON-1454873385 tempest-RegionsTestJSON-1454873385-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:04.927309 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018aabfa-103d-47ef-b716-93fe03a140e4 tempest-RegionsTestJSON-1454873385 tempest-RegionsTestJSON-1454873385-project-admin] PATH_INFO: `/v3/regions` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:04.928056 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018aabfa-103d-47ef-b716-93fe03a140e4 tempest-RegionsTestJSON-1454873385 tempest-RegionsTestJSON-1454873385-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:04.929138 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018aabfa-103d-47ef-b716-93fe03a140e4 tempest-RegionsTestJSON-1454873385 tempest-RegionsTestJSON-1454873385-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:04.935182 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2965/5942] 10.222.0.17 () {58 vars in 1127 bytes} [Sat Jul 23 21:34:04 2022] GET /identity/v3/regions => generated 670 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:34:04.935907 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018aabfa-103d-47ef-b716-93fe03a140e4 tempest-RegionsTestJSON-1454873385 tempest-RegionsTestJSON-1454873385-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:04.945717 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2135bb03-47ba-4eef-b809-931e0081ec3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:04.946409 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2135bb03-47ba-4eef-b809-931e0081ec3e service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:04.946692 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2135bb03-47ba-4eef-b809-931e0081ec3e service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:04.946970 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2135bb03-47ba-4eef-b809-931e0081ec3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:04.952432 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:05.008177 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018aabfa-103d-47ef-b716-93fe03a140e4 tempest-RegionsTestJSON-1454873385 tempest-RegionsTestJSON-1454873385-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:05.011916 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2135bb03-47ba-4eef-b809-931e0081ec3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:05.012832 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a402250f-d8b3-4b72-8d37-7e1d08ac315b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:05.013399 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2135bb03-47ba-4eef-b809-931e0081ec3e service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:05.013518 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a402250f-d8b3-4b72-8d37-7e1d08ac315b admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:05.013744 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a402250f-d8b3-4b72-8d37-7e1d08ac315b admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:05.014041 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a402250f-d8b3-4b72-8d37-7e1d08ac315b admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:05.014711 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a402250f-d8b3-4b72-8d37-7e1d08ac315b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:05.016600 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a402250f-d8b3-4b72-8d37-7e1d08ac315b admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:05.023531 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2978/5943] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:34:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:34:05.024424 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2135bb03-47ba-4eef-b809-931e0081ec3e service neutron] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:05.036529 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2135bb03-47ba-4eef-b809-931e0081ec3e service neutron] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:05.041676 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2966/5944] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:34:04 2022] POST /identity/v3/users => generated 294 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:34:05.042797 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a402250f-d8b3-4b72-8d37-7e1d08ac315b admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:05.048076 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78e0fc5-ef4d-4b20-9357-8e8ca5c54193 tempest-RegionsTestJSON-1454873385 tempest-RegionsTestJSON-1454873385-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '798de34847c247fd9810711c363627ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a2d65a60ebe469792ab253f3f0a7f0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:05.049040 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78e0fc5-ef4d-4b20-9357-8e8ca5c54193 tempest-RegionsTestJSON-1454873385 tempest-RegionsTestJSON-1454873385-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:05.049411 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78e0fc5-ef4d-4b20-9357-8e8ca5c54193 tempest-RegionsTestJSON-1454873385 tempest-RegionsTestJSON-1454873385-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:05.049682 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78e0fc5-ef4d-4b20-9357-8e8ca5c54193 tempest-RegionsTestJSON-1454873385 tempest-RegionsTestJSON-1454873385-project-admin] PATH_INFO: `/v3/regions/a4cd7871eaf94ff9815dc8c55a0c11cc` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:05.050377 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78e0fc5-ef4d-4b20-9357-8e8ca5c54193 tempest-RegionsTestJSON-1454873385 tempest-RegionsTestJSON-1454873385-project-admin] RBAC: Authorizing `identity:delete_region(region_id=a4cd7871eaf94ff9815dc8c55a0c11cc)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:05.052002 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78e0fc5-ef4d-4b20-9357-8e8ca5c54193 tempest-RegionsTestJSON-1454873385 tempest-RegionsTestJSON-1454873385-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:05.055696 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a402250f-d8b3-4b72-8d37-7e1d08ac315b admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:05.060606 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b0a064-c638-47ff-9e30-5aaf456238ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:05.062291 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b0a064-c638-47ff-9e30-5aaf456238ad admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:05.062434 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b0a064-c638-47ff-9e30-5aaf456238ad admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:05.062668 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b0a064-c638-47ff-9e30-5aaf456238ad admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:05.063340 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b0a064-c638-47ff-9e30-5aaf456238ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:05.064906 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b0a064-c638-47ff-9e30-5aaf456238ad admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:05.071392 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-c78e0fc5-ef4d-4b20-9357-8e8ca5c54193 tempest-RegionsTestJSON-1454873385 tempest-RegionsTestJSON-1454873385-project-admin] Could not find region: a4cd7871eaf94ff9815dc8c55a0c11cc.: keystone.exception.RegionNotFound: Could not find region: a4cd7871eaf94ff9815dc8c55a0c11cc. Jul 23 21:34:05.071392 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 21:34:05.071392 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 129, in delete_region Jul 23 21:34:05.071392 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application ret = self.driver.delete_region(region_id) Jul 23 21:34:05.071392 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 152, in delete_region Jul 23 21:34:05.071392 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application ref = self._get_region(session, region_id) Jul 23 21:34:05.071392 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 103, in _get_region Jul 23 21:34:05.071392 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.RegionNotFound(region_id=region_id) Jul 23 21:34:05.071392 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.RegionNotFound: Could not find region: a4cd7871eaf94ff9815dc8c55a0c11cc. Jul 23 21:34:05.071392 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 21:34:05.071392 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 23 21:34:05.071392 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 21:34:05.071392 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 21:34:05.071392 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 21:34:05.071392 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 21:34:05.071392 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 21:34:05.072451 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 21:34:05.072451 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 21:34:05.072451 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 21:34:05.072451 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 21:34:05.072451 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 21:34:05.072451 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 21:34:05.072451 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 21:34:05.072451 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/regions.py", line 92, in delete Jul 23 21:34:05.072451 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return PROVIDERS.catalog_api.delete_region( Jul 23 21:34:05.072451 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 21:34:05.072451 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 21:34:05.072451 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 135, in delete_region Jul 23 21:34:05.072451 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.RegionNotFound(region_id=region_id) Jul 23 21:34:05.072451 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.RegionNotFound: Could not find region: a4cd7871eaf94ff9815dc8c55a0c11cc. Jul 23 21:34:05.072451 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 21:34:05.074348 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2979/5945] 10.222.0.17 () {58 vars in 1229 bytes} [Sat Jul 23 21:34:05 2022] DELETE /identity/v3/regions/a4cd7871eaf94ff9815dc8c55a0c11cc => generated 112 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 23 21:34:05.077578 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2967/5946] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:34:05 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 21:34:05.078351 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78e0fc5-ef4d-4b20-9357-8e8ca5c54193 tempest-RegionsTestJSON-1454873385 tempest-RegionsTestJSON-1454873385-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:05.080723 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b0a064-c638-47ff-9e30-5aaf456238ad admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:05.089268 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78e0fc5-ef4d-4b20-9357-8e8ca5c54193 tempest-RegionsTestJSON-1454873385 tempest-RegionsTestJSON-1454873385-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:05.092807 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b0a064-c638-47ff-9e30-5aaf456238ad admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:05.094350 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76231f9b-799c-4f7b-b194-74b95d8fb6b6 tempest-RegionsTestJSON-1454873385 tempest-RegionsTestJSON-1454873385-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '798de34847c247fd9810711c363627ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a2d65a60ebe469792ab253f3f0a7f0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:05.095024 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76231f9b-799c-4f7b-b194-74b95d8fb6b6 tempest-RegionsTestJSON-1454873385 tempest-RegionsTestJSON-1454873385-project-admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:05.095315 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76231f9b-799c-4f7b-b194-74b95d8fb6b6 tempest-RegionsTestJSON-1454873385 tempest-RegionsTestJSON-1454873385-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:05.095590 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76231f9b-799c-4f7b-b194-74b95d8fb6b6 tempest-RegionsTestJSON-1454873385 tempest-RegionsTestJSON-1454873385-project-admin] PATH_INFO: `/v3/regions` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:05.096259 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76231f9b-799c-4f7b-b194-74b95d8fb6b6 tempest-RegionsTestJSON-1454873385 tempest-RegionsTestJSON-1454873385-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:05.097336 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76231f9b-799c-4f7b-b194-74b95d8fb6b6 tempest-RegionsTestJSON-1454873385 tempest-RegionsTestJSON-1454873385-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:05.100098 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46428816-421f-48f0-8058-d342b64b3754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:05.101335 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46428816-421f-48f0-8058-d342b64b3754 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:05.101694 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46428816-421f-48f0-8058-d342b64b3754 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:05.102044 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46428816-421f-48f0-8058-d342b64b3754 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:05.102921 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46428816-421f-48f0-8058-d342b64b3754 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:05.104727 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46428816-421f-48f0-8058-d342b64b3754 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:05.104987 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2980/5947] 10.222.0.17 () {58 vars in 1127 bytes} [Sat Jul 23 21:34:05 2022] GET /identity/v3/regions => generated 670 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 21:34:05.114935 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76231f9b-799c-4f7b-b194-74b95d8fb6b6 tempest-RegionsTestJSON-1454873385 tempest-RegionsTestJSON-1454873385-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:05.120035 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2968/5948] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:34:05 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 21:34:05.122160 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46428816-421f-48f0-8058-d342b64b3754 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:05.125830 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76231f9b-799c-4f7b-b194-74b95d8fb6b6 tempest-RegionsTestJSON-1454873385 tempest-RegionsTestJSON-1454873385-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:05.130580 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e96ab69-979e-4f63-a31b-f0afc8b4e02b tempest-RegionsTestJSON-1454873385 tempest-RegionsTestJSON-1454873385-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '798de34847c247fd9810711c363627ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a2d65a60ebe469792ab253f3f0a7f0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:05.131326 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e96ab69-979e-4f63-a31b-f0afc8b4e02b tempest-RegionsTestJSON-1454873385 tempest-RegionsTestJSON-1454873385-project-admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:05.131588 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e96ab69-979e-4f63-a31b-f0afc8b4e02b tempest-RegionsTestJSON-1454873385 tempest-RegionsTestJSON-1454873385-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:05.131866 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e96ab69-979e-4f63-a31b-f0afc8b4e02b tempest-RegionsTestJSON-1454873385 tempest-RegionsTestJSON-1454873385-project-admin] PATH_INFO: `/v3/regions` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:05.132167 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46428816-421f-48f0-8058-d342b64b3754 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:05.132611 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e96ab69-979e-4f63-a31b-f0afc8b4e02b tempest-RegionsTestJSON-1454873385 tempest-RegionsTestJSON-1454873385-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:05.134267 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e96ab69-979e-4f63-a31b-f0afc8b4e02b tempest-RegionsTestJSON-1454873385 tempest-RegionsTestJSON-1454873385-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:05.138607 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7175fbc-d521-4b81-8e48-41ca6b9085bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:05.139564 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7175fbc-d521-4b81-8e48-41ca6b9085bc admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:05.139845 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7175fbc-d521-4b81-8e48-41ca6b9085bc admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:05.140159 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7175fbc-d521-4b81-8e48-41ca6b9085bc admin admin] PATH_INFO: `/v3/projects/adbd3af81848426c9671fbd25ea31248/users/91b97cc2acbf48a1b92376922559dc05/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:05.157240 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7175fbc-d521-4b81-8e48-41ca6b9085bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=adbd3af81848426c9671fbd25ea31248, user_id=91b97cc2acbf48a1b92376922559dc05, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:05.159945 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7175fbc-d521-4b81-8e48-41ca6b9085bc admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:05.160437 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2981/5949] 10.222.0.17 () {60 vars in 1149 bytes} [Sat Jul 23 21:34:05 2022] POST /identity/v3/regions => generated 254 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:34:05.164543 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e96ab69-979e-4f63-a31b-f0afc8b4e02b tempest-RegionsTestJSON-1454873385 tempest-RegionsTestJSON-1454873385-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:05.179089 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2969/5950] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:34:05 2022] PUT /identity/v3/projects/adbd3af81848426c9671fbd25ea31248/users/91b97cc2acbf48a1b92376922559dc05/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:05.199275 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e96ab69-979e-4f63-a31b-f0afc8b4e02b tempest-RegionsTestJSON-1454873385 tempest-RegionsTestJSON-1454873385-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:05.266942 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e0c503-6fe4-4d21-a273-9f0e48c49676 tempest-RegionsTestJSON-1454873385 tempest-RegionsTestJSON-1454873385-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '798de34847c247fd9810711c363627ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a2d65a60ebe469792ab253f3f0a7f0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:05.267826 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e0c503-6fe4-4d21-a273-9f0e48c49676 tempest-RegionsTestJSON-1454873385 tempest-RegionsTestJSON-1454873385-project-admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:05.268245 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e0c503-6fe4-4d21-a273-9f0e48c49676 tempest-RegionsTestJSON-1454873385 tempest-RegionsTestJSON-1454873385-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:05.268593 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e0c503-6fe4-4d21-a273-9f0e48c49676 tempest-RegionsTestJSON-1454873385 tempest-RegionsTestJSON-1454873385-project-admin] PATH_INFO: `/v3/regions` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:05.269374 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e0c503-6fe4-4d21-a273-9f0e48c49676 tempest-RegionsTestJSON-1454873385 tempest-RegionsTestJSON-1454873385-project-admin] RBAC: Adding query filter params (parent_region_id=45f779abfdc84822808203692931b07d) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:34:05.269684 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e0c503-6fe4-4d21-a273-9f0e48c49676 tempest-RegionsTestJSON-1454873385 tempest-RegionsTestJSON-1454873385-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:05.270819 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e0c503-6fe4-4d21-a273-9f0e48c49676 tempest-RegionsTestJSON-1454873385 tempest-RegionsTestJSON-1454873385-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:05.271405 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da785493-6671-4f9b-ac1a-351b1969043b None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:05.271726 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da785493-6671-4f9b-ac1a-351b1969043b None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:05.272026 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da785493-6671-4f9b-ac1a-351b1969043b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:05.276417 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2982/5951] 10.222.0.17 () {58 vars in 1226 bytes} [Sat Jul 23 21:34:05 2022] GET /identity/v3/regions?parent_region_id=45f779abfdc84822808203692931b07d => generated 400 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 21:34:05.280358 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e0c503-6fe4-4d21-a273-9f0e48c49676 tempest-RegionsTestJSON-1454873385 tempest-RegionsTestJSON-1454873385-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:05.290886 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e0c503-6fe4-4d21-a273-9f0e48c49676 tempest-RegionsTestJSON-1454873385 tempest-RegionsTestJSON-1454873385-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:05.296535 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6c312f-7da4-46f3-92fa-e3f789755988 tempest-RegionsTestJSON-1454873385 tempest-RegionsTestJSON-1454873385-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '798de34847c247fd9810711c363627ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a2d65a60ebe469792ab253f3f0a7f0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:05.297412 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6c312f-7da4-46f3-92fa-e3f789755988 tempest-RegionsTestJSON-1454873385 tempest-RegionsTestJSON-1454873385-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:05.297700 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6c312f-7da4-46f3-92fa-e3f789755988 tempest-RegionsTestJSON-1454873385 tempest-RegionsTestJSON-1454873385-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:05.298015 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6c312f-7da4-46f3-92fa-e3f789755988 tempest-RegionsTestJSON-1454873385 tempest-RegionsTestJSON-1454873385-project-admin] PATH_INFO: `/v3/regions/1c92fbd70c8942a8b974b3894bf8d92f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:05.298679 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6c312f-7da4-46f3-92fa-e3f789755988 tempest-RegionsTestJSON-1454873385 tempest-RegionsTestJSON-1454873385-project-admin] RBAC: Authorizing `identity:delete_region(region_id=1c92fbd70c8942a8b974b3894bf8d92f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:05.300275 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6c312f-7da4-46f3-92fa-e3f789755988 tempest-RegionsTestJSON-1454873385 tempest-RegionsTestJSON-1454873385-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:05.304303 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-da785493-6671-4f9b-ac1a-351b1969043b None None] MFA Rules not processed for user `91b97cc2acbf48a1b92376922559dc05`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:34:05.305530 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-da785493-6671-4f9b-ac1a-351b1969043b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:05.309678 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:05.327330 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2983/5952] 10.222.0.17 () {58 vars in 1229 bytes} [Sat Jul 23 21:34:05 2022] DELETE /identity/v3/regions/1c92fbd70c8942a8b974b3894bf8d92f => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:34:05.331773 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6c312f-7da4-46f3-92fa-e3f789755988 tempest-RegionsTestJSON-1454873385 tempest-RegionsTestJSON-1454873385-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:05.366530 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6c312f-7da4-46f3-92fa-e3f789755988 tempest-RegionsTestJSON-1454873385 tempest-RegionsTestJSON-1454873385-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:05.372448 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3d7046-3fbc-4bec-9a4a-63b3e9b135b1 tempest-RegionsTestJSON-1454873385 tempest-RegionsTestJSON-1454873385-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '798de34847c247fd9810711c363627ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a2d65a60ebe469792ab253f3f0a7f0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:05.373319 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3d7046-3fbc-4bec-9a4a-63b3e9b135b1 tempest-RegionsTestJSON-1454873385 tempest-RegionsTestJSON-1454873385-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:05.373612 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3d7046-3fbc-4bec-9a4a-63b3e9b135b1 tempest-RegionsTestJSON-1454873385 tempest-RegionsTestJSON-1454873385-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:05.373924 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3d7046-3fbc-4bec-9a4a-63b3e9b135b1 tempest-RegionsTestJSON-1454873385 tempest-RegionsTestJSON-1454873385-project-admin] PATH_INFO: `/v3/regions/50dc99a19ca94328bbb4deaf170c03a1` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:05.374587 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3d7046-3fbc-4bec-9a4a-63b3e9b135b1 tempest-RegionsTestJSON-1454873385 tempest-RegionsTestJSON-1454873385-project-admin] RBAC: Authorizing `identity:delete_region(region_id=50dc99a19ca94328bbb4deaf170c03a1)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:05.376228 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3d7046-3fbc-4bec-9a4a-63b3e9b135b1 tempest-RegionsTestJSON-1454873385 tempest-RegionsTestJSON-1454873385-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:05.378080 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2970/5953] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:34:05 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:34:05.378080 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da785493-6671-4f9b-ac1a-351b1969043b None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:05.379594 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-da785493-6671-4f9b-ac1a-351b1969043b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:05.400042 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2984/5954] 10.222.0.17 () {58 vars in 1229 bytes} [Sat Jul 23 21:34:05 2022] DELETE /identity/v3/regions/50dc99a19ca94328bbb4deaf170c03a1 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:34:05.400955 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3d7046-3fbc-4bec-9a4a-63b3e9b135b1 tempest-RegionsTestJSON-1454873385 tempest-RegionsTestJSON-1454873385-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:05.402574 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-bf3d7046-3fbc-4bec-9a4a-63b3e9b135b1 tempest-RegionsTestJSON-1454873385 tempest-RegionsTestJSON-1454873385-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:05.407849 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:05.458363 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da785493-6671-4f9b-ac1a-351b1969043b None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:05.472316 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66792017-6b29-4844-b02f-de32bbfa8d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:05.473192 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66792017-6b29-4844-b02f-de32bbfa8d59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:05.473470 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66792017-6b29-4844-b02f-de32bbfa8d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:05.473744 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66792017-6b29-4844-b02f-de32bbfa8d59 admin admin] PATH_INFO: `/v3/projects/f513ed4c7e7c425c8f6f49af300011b3` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:05.475056 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66792017-6b29-4844-b02f-de32bbfa8d59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f513ed4c7e7c425c8f6f49af300011b3)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:05.476061 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3d7046-3fbc-4bec-9a4a-63b3e9b135b1 tempest-RegionsTestJSON-1454873385 tempest-RegionsTestJSON-1454873385-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:05.477319 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66792017-6b29-4844-b02f-de32bbfa8d59 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:05.479900 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db467df-8414-4b1e-859d-2f0360b3070c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7f2db148c8e4d5d81431cae3576434b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:05.480553 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db467df-8414-4b1e-859d-2f0360b3070c service glance] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:05.480880 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db467df-8414-4b1e-859d-2f0360b3070c service glance] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:05.481144 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db467df-8414-4b1e-859d-2f0360b3070c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:05.524848 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-66792017-6b29-4844-b02f-de32bbfa8d59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f513ed4c7e7c425c8f6f49af300011b3', 'request_id': 'req-66792017-6b29-4844-b02f-de32bbfa8d59'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:05.533543 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-66792017-6b29-4844-b02f-de32bbfa8d59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f513ed4c7e7c425c8f6f49af300011b3', 'request_id': 'req-66792017-6b29-4844-b02f-de32bbfa8d59'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:05.539401 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-66792017-6b29-4844-b02f-de32bbfa8d59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f513ed4c7e7c425c8f6f49af300011b3', 'request_id': 'req-66792017-6b29-4844-b02f-de32bbfa8d59'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:05.544901 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db467df-8414-4b1e-859d-2f0360b3070c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:05.546398 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db467df-8414-4b1e-859d-2f0360b3070c service glance] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:05.550846 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-66792017-6b29-4844-b02f-de32bbfa8d59 admin admin] The token cache is being invalidate because project f513ed4c7e7c425c8f6f49af300011b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:34:05.551130 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-66792017-6b29-4844-b02f-de32bbfa8d59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:05.551784 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-66792017-6b29-4844-b02f-de32bbfa8d59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:05.556479 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2971/5955] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:34:05 2022] DELETE /identity/v3/projects/f513ed4c7e7c425c8f6f49af300011b3 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:05.556479 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66792017-6b29-4844-b02f-de32bbfa8d59 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:05.556479 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-66792017-6b29-4844-b02f-de32bbfa8d59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:05.566005 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2985/5956] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:34:05 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:34:05.566702 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db467df-8414-4b1e-859d-2f0360b3070c service glance] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:05.575884 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:05.590396 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db467df-8414-4b1e-859d-2f0360b3070c service glance] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:05.646908 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66792017-6b29-4844-b02f-de32bbfa8d59 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:05.652212 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9900da81-fc44-4a1f-82d4-03143e933a86 tempest-RegionsTestJSON-1454873385 tempest-RegionsTestJSON-1454873385-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '798de34847c247fd9810711c363627ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a2d65a60ebe469792ab253f3f0a7f0f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:05.653253 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9900da81-fc44-4a1f-82d4-03143e933a86 tempest-RegionsTestJSON-1454873385 tempest-RegionsTestJSON-1454873385-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:05.653537 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9900da81-fc44-4a1f-82d4-03143e933a86 tempest-RegionsTestJSON-1454873385 tempest-RegionsTestJSON-1454873385-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:05.653811 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9900da81-fc44-4a1f-82d4-03143e933a86 tempest-RegionsTestJSON-1454873385 tempest-RegionsTestJSON-1454873385-project-admin] PATH_INFO: `/v3/regions/45f779abfdc84822808203692931b07d` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:05.654529 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9900da81-fc44-4a1f-82d4-03143e933a86 tempest-RegionsTestJSON-1454873385 tempest-RegionsTestJSON-1454873385-project-admin] RBAC: Authorizing `identity:delete_region(region_id=45f779abfdc84822808203692931b07d)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:05.655556 ncdv-master-1 devstack@keystone.service[91547]: WARNING py.warnings [None req-9900da81-fc44-4a1f-82d4-03143e933a86 tempest-RegionsTestJSON-1454873385 tempest-RegionsTestJSON-1454873385-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:34:05.655556 ncdv-master-1 devstack@keystone.service[91547]: warnings.warn(msg) Jul 23 21:34:05.655556 ncdv-master-1 devstack@keystone.service[91547]: Jul 23 21:34:05.656447 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9900da81-fc44-4a1f-82d4-03143e933a86 tempest-RegionsTestJSON-1454873385 tempest-RegionsTestJSON-1454873385-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:05.669508 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984d6755-3d53-49dd-ad87-fdfd934b7691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:05.670773 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984d6755-3d53-49dd-ad87-fdfd934b7691 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:05.671277 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984d6755-3d53-49dd-ad87-fdfd934b7691 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:05.671620 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984d6755-3d53-49dd-ad87-fdfd934b7691 admin admin] PATH_INFO: `/v3/users/39ece4c7ec804be8bdba07f21f179804` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:05.673802 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984d6755-3d53-49dd-ad87-fdfd934b7691 admin admin] RBAC: Authorizing `identity:delete_user(user_id=39ece4c7ec804be8bdba07f21f179804)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:05.678167 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984d6755-3d53-49dd-ad87-fdfd934b7691 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:05.688298 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2972/5957] 10.222.0.17 () {58 vars in 1229 bytes} [Sat Jul 23 21:34:05 2022] DELETE /identity/v3/regions/45f779abfdc84822808203692931b07d => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:05.691632 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9900da81-fc44-4a1f-82d4-03143e933a86 tempest-RegionsTestJSON-1454873385 tempest-RegionsTestJSON-1454873385-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:05.709607 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-9900da81-fc44-4a1f-82d4-03143e933a86 tempest-RegionsTestJSON-1454873385 tempest-RegionsTestJSON-1454873385-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:05.734207 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:05.735957 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9900da81-fc44-4a1f-82d4-03143e933a86 tempest-RegionsTestJSON-1454873385 tempest-RegionsTestJSON-1454873385-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:05.743664 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff5d6a9-011f-48e0-b4b7-6010fa55f4a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:05.744628 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff5d6a9-011f-48e0-b4b7-6010fa55f4a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:05.745617 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-984d6755-3d53-49dd-ad87-fdfd934b7691 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39ece4c7ec804be8bdba07f21f179804'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:05.745781 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff5d6a9-011f-48e0-b4b7-6010fa55f4a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:05.746049 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff5d6a9-011f-48e0-b4b7-6010fa55f4a2 admin admin] PATH_INFO: `/v3/users/69d2d60a0aa34f7db613fad33fadb579` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:05.746463 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-984d6755-3d53-49dd-ad87-fdfd934b7691 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39ece4c7ec804be8bdba07f21f179804'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:05.747373 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff5d6a9-011f-48e0-b4b7-6010fa55f4a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=69d2d60a0aa34f7db613fad33fadb579)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:05.749319 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff5d6a9-011f-48e0-b4b7-6010fa55f4a2 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:05.755188 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-984d6755-3d53-49dd-ad87-fdfd934b7691 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39ece4c7ec804be8bdba07f21f179804'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:05.765736 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-984d6755-3d53-49dd-ad87-fdfd934b7691 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39ece4c7ec804be8bdba07f21f179804'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:05.783334 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-984d6755-3d53-49dd-ad87-fdfd934b7691 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39ece4c7ec804be8bdba07f21f179804'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:05.791461 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2986/5958] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:34:05 2022] DELETE /identity/v3/users/39ece4c7ec804be8bdba07f21f179804 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:05.829339 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-3ff5d6a9-011f-48e0-b4b7-6010fa55f4a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69d2d60a0aa34f7db613fad33fadb579'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:05.838502 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-3ff5d6a9-011f-48e0-b4b7-6010fa55f4a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69d2d60a0aa34f7db613fad33fadb579'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:05.839169 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-3ff5d6a9-011f-48e0-b4b7-6010fa55f4a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69d2d60a0aa34f7db613fad33fadb579'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:05.847882 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984d6755-3d53-49dd-ad87-fdfd934b7691 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:05.849491 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-984d6755-3d53-49dd-ad87-fdfd934b7691 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:05.851843 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-3ff5d6a9-011f-48e0-b4b7-6010fa55f4a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69d2d60a0aa34f7db613fad33fadb579'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:05.871217 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-3ff5d6a9-011f-48e0-b4b7-6010fa55f4a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69d2d60a0aa34f7db613fad33fadb579'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:05.884820 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2973/5959] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:34:05 2022] DELETE /identity/v3/users/69d2d60a0aa34f7db613fad33fadb579 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:34:05.888835 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ccb3d1-09b7-4cea-a111-1888cf0f0f79 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:05.889289 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ccb3d1-09b7-4cea-a111-1888cf0f0f79 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:05.889917 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ccb3d1-09b7-4cea-a111-1888cf0f0f79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:05.914019 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-d4ccb3d1-09b7-4cea-a111-1888cf0f0f79 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:34:05.915400 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-d4ccb3d1-09b7-4cea-a111-1888cf0f0f79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:05.926245 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984d6755-3d53-49dd-ad87-fdfd934b7691 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:05.975803 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:05.993128 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2974/5960] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:34:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:34:06.001046 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab76c6b-43b4-4d93-be0e-4a5e3dbd00a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:06.001740 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ccb3d1-09b7-4cea-a111-1888cf0f0f79 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:06.002558 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab76c6b-43b4-4d93-be0e-4a5e3dbd00a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:06.003063 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab76c6b-43b4-4d93-be0e-4a5e3dbd00a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:06.003367 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-d4ccb3d1-09b7-4cea-a111-1888cf0f0f79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:06.003759 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab76c6b-43b4-4d93-be0e-4a5e3dbd00a1 admin admin] PATH_INFO: `/v3/users/ff06e1136db04365971a14be7ab18721` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:06.005823 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab76c6b-43b4-4d93-be0e-4a5e3dbd00a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff06e1136db04365971a14be7ab18721)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:06.008044 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab76c6b-43b4-4d93-be0e-4a5e3dbd00a1 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:06.065442 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-2ab76c6b-43b4-4d93-be0e-4a5e3dbd00a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff06e1136db04365971a14be7ab18721'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:06.066126 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-2ab76c6b-43b4-4d93-be0e-4a5e3dbd00a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff06e1136db04365971a14be7ab18721'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:06.073888 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-2ab76c6b-43b4-4d93-be0e-4a5e3dbd00a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff06e1136db04365971a14be7ab18721'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:06.092436 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-2ab76c6b-43b4-4d93-be0e-4a5e3dbd00a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff06e1136db04365971a14be7ab18721'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:06.096178 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:06.098860 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ccb3d1-09b7-4cea-a111-1888cf0f0f79 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:06.103666 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c72b80-4484-422d-9b96-773f5d17418f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:06.104336 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c72b80-4484-422d-9b96-773f5d17418f service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:06.104635 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c72b80-4484-422d-9b96-773f5d17418f service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:06.104896 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c72b80-4484-422d-9b96-773f5d17418f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:06.113541 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-2ab76c6b-43b4-4d93-be0e-4a5e3dbd00a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff06e1136db04365971a14be7ab18721'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:06.118472 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c72b80-4484-422d-9b96-773f5d17418f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:06.121320 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c72b80-4484-422d-9b96-773f5d17418f service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:06.126153 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2987/5961] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:34:05 2022] DELETE /identity/v3/users/ff06e1136db04365971a14be7ab18721 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:06.127085 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab76c6b-43b4-4d93-be0e-4a5e3dbd00a1 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:06.128605 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-2ab76c6b-43b4-4d93-be0e-4a5e3dbd00a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:06.135603 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2975/5962] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:34:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 23 21:34:06.136923 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19628b0-70f0-4082-9460-a35431161da2 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:06.137219 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19628b0-70f0-4082-9460-a35431161da2 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:06.137581 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19628b0-70f0-4082-9460-a35431161da2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:06.157633 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-b19628b0-70f0-4082-9460-a35431161da2 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:34:06.158895 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-b19628b0-70f0-4082-9460-a35431161da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:06.201913 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab76c6b-43b4-4d93-be0e-4a5e3dbd00a1 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:06.207631 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f77760-9f90-4c1c-a2fc-7e3209254c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:06.208647 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f77760-9f90-4c1c-a2fc-7e3209254c4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:06.209054 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f77760-9f90-4c1c-a2fc-7e3209254c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:06.209424 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f77760-9f90-4c1c-a2fc-7e3209254c4c admin admin] PATH_INFO: `/v3/projects/278e3e9d87a94780a6adbbf6f4a97e00` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:06.210984 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f77760-9f90-4c1c-a2fc-7e3209254c4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=278e3e9d87a94780a6adbbf6f4a97e00)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:06.213256 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f77760-9f90-4c1c-a2fc-7e3209254c4c admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:06.221160 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2976/5963] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:34:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:34:06.234105 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19628b0-70f0-4082-9460-a35431161da2 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:06.236905 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-b19628b0-70f0-4082-9460-a35431161da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:06.268650 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-67f77760-9f90-4c1c-a2fc-7e3209254c4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '278e3e9d87a94780a6adbbf6f4a97e00', 'request_id': 'req-67f77760-9f90-4c1c-a2fc-7e3209254c4c'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:06.278748 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-67f77760-9f90-4c1c-a2fc-7e3209254c4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '278e3e9d87a94780a6adbbf6f4a97e00', 'request_id': 'req-67f77760-9f90-4c1c-a2fc-7e3209254c4c'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:06.285046 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-67f77760-9f90-4c1c-a2fc-7e3209254c4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '278e3e9d87a94780a6adbbf6f4a97e00', 'request_id': 'req-67f77760-9f90-4c1c-a2fc-7e3209254c4c'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:06.298023 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-67f77760-9f90-4c1c-a2fc-7e3209254c4c admin admin] The token cache is being invalidate because project 278e3e9d87a94780a6adbbf6f4a97e00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:34:06.298664 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-67f77760-9f90-4c1c-a2fc-7e3209254c4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:06.299091 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-67f77760-9f90-4c1c-a2fc-7e3209254c4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:06.300694 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2988/5964] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:34:06 2022] DELETE /identity/v3/projects/278e3e9d87a94780a6adbbf6f4a97e00 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:06.301830 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19628b0-70f0-4082-9460-a35431161da2 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:06.306094 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb51484-f93c-4378-8bf3-52adf8af801e None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:06.306382 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb51484-f93c-4378-8bf3-52adf8af801e None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:06.306655 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb51484-f93c-4378-8bf3-52adf8af801e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:06.341976 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-beb51484-f93c-4378-8bf3-52adf8af801e None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:34:06.343436 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-beb51484-f93c-4378-8bf3-52adf8af801e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:06.356357 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:06.366482 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006b406f-192d-4de8-a4cc-5443a218d6aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:06.367599 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006b406f-192d-4de8-a4cc-5443a218d6aa service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:06.368082 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006b406f-192d-4de8-a4cc-5443a218d6aa service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:06.368215 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006b406f-192d-4de8-a4cc-5443a218d6aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:06.370078 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-006b406f-192d-4de8-a4cc-5443a218d6aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:06.412245 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2989/5965] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:34:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:34:06.420681 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd05f9cc-ce79-49eb-b91c-6c1deb0994ab None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:06.420983 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd05f9cc-ce79-49eb-b91c-6c1deb0994ab None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:06.421275 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd05f9cc-ce79-49eb-b91c-6c1deb0994ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:06.441411 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-bd05f9cc-ce79-49eb-b91c-6c1deb0994ab None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:34:06.442951 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-bd05f9cc-ce79-49eb-b91c-6c1deb0994ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:06.449392 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006b406f-192d-4de8-a4cc-5443a218d6aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:06.451321 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006b406f-192d-4de8-a4cc-5443a218d6aa service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:06.456865 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2990/5966] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:34:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:34:06.457963 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd05f9cc-ce79-49eb-b91c-6c1deb0994ab None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:06.463393 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2977/5967] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:34:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:34:06.464268 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006b406f-192d-4de8-a4cc-5443a218d6aa service neutron] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:06.465168 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:06.465578 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-006b406f-192d-4de8-a4cc-5443a218d6aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:06.469812 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd05f9cc-ce79-49eb-b91c-6c1deb0994ab None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:06.477946 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94df5490-eb4b-4e19-9653-eb0c6811bdb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:06.478758 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94df5490-eb4b-4e19-9653-eb0c6811bdb9 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:06.479059 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006b406f-192d-4de8-a4cc-5443a218d6aa service neutron] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:06.479258 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94df5490-eb4b-4e19-9653-eb0c6811bdb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:06.479821 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94df5490-eb4b-4e19-9653-eb0c6811bdb9 admin admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:06.480776 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94df5490-eb4b-4e19-9653-eb0c6811bdb9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:34:06.481385 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94df5490-eb4b-4e19-9653-eb0c6811bdb9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:06.483323 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94df5490-eb4b-4e19-9653-eb0c6811bdb9 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:06.484098 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b6f262-b6d1-48c3-ba96-5626b3cc29fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:06.485057 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b6f262-b6d1-48c3-ba96-5626b3cc29fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:06.485398 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b6f262-b6d1-48c3-ba96-5626b3cc29fa admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:06.485740 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b6f262-b6d1-48c3-ba96-5626b3cc29fa admin admin] PATH_INFO: `/v3/projects/5dbaad3719404b20b0d83e19790476a2` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:06.487065 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b6f262-b6d1-48c3-ba96-5626b3cc29fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=5dbaad3719404b20b0d83e19790476a2)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:06.489117 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b6f262-b6d1-48c3-ba96-5626b3cc29fa admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:06.497556 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2991/5968] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:34:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 21:34:06.503765 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94df5490-eb4b-4e19-9653-eb0c6811bdb9 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:06.515973 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94df5490-eb4b-4e19-9653-eb0c6811bdb9 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:06.523812 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5276dd5b-034e-4cfd-b8c2-b754a715fee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:06.524449 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5276dd5b-034e-4cfd-b8c2-b754a715fee3 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:06.524747 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5276dd5b-034e-4cfd-b8c2-b754a715fee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:06.525001 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5276dd5b-034e-4cfd-b8c2-b754a715fee3 admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:06.525693 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5276dd5b-034e-4cfd-b8c2-b754a715fee3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:06.527709 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5276dd5b-034e-4cfd-b8c2-b754a715fee3 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:06.552289 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-96b6f262-b6d1-48c3-ba96-5626b3cc29fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5dbaad3719404b20b0d83e19790476a2', 'request_id': 'req-96b6f262-b6d1-48c3-ba96-5626b3cc29fa'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:06.561363 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2992/5969] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:34:06 2022] POST /identity/v3/projects => generated 373 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:34:06.562645 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5276dd5b-034e-4cfd-b8c2-b754a715fee3 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:06.563386 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-96b6f262-b6d1-48c3-ba96-5626b3cc29fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5dbaad3719404b20b0d83e19790476a2', 'request_id': 'req-96b6f262-b6d1-48c3-ba96-5626b3cc29fa'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:06.570349 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-96b6f262-b6d1-48c3-ba96-5626b3cc29fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5dbaad3719404b20b0d83e19790476a2', 'request_id': 'req-96b6f262-b6d1-48c3-ba96-5626b3cc29fa'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:06.582398 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-96b6f262-b6d1-48c3-ba96-5626b3cc29fa admin admin] The token cache is being invalidate because project 5dbaad3719404b20b0d83e19790476a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:34:06.582684 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-96b6f262-b6d1-48c3-ba96-5626b3cc29fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:06.583369 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-96b6f262-b6d1-48c3-ba96-5626b3cc29fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:06.585024 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2978/5970] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:34:06 2022] DELETE /identity/v3/projects/5dbaad3719404b20b0d83e19790476a2 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:06.588969 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b6f262-b6d1-48c3-ba96-5626b3cc29fa admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:06.591069 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-96b6f262-b6d1-48c3-ba96-5626b3cc29fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:06.636730 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5276dd5b-034e-4cfd-b8c2-b754a715fee3 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:06.641590 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a84add-d8a4-4f86-b041-4e700d791d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:06.642349 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a84add-d8a4-4f86-b041-4e700d791d43 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:06.642627 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a84add-d8a4-4f86-b041-4e700d791d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:06.643053 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a84add-d8a4-4f86-b041-4e700d791d43 admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:06.643773 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a84add-d8a4-4f86-b041-4e700d791d43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:06.645724 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a84add-d8a4-4f86-b041-4e700d791d43 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:06.669639 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2993/5971] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:34:06 2022] POST /identity/v3/users => generated 287 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:34:06.673529 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a84add-d8a4-4f86-b041-4e700d791d43 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:06.675719 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-e1a84add-d8a4-4f86-b041-4e700d791d43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:06.681550 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b6f262-b6d1-48c3-ba96-5626b3cc29fa admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:06.686768 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87981db2-a9e3-4d35-8af2-956f907581e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:06.687761 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87981db2-a9e3-4d35-8af2-956f907581e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:06.688139 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87981db2-a9e3-4d35-8af2-956f907581e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:06.688423 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87981db2-a9e3-4d35-8af2-956f907581e5 admin admin] PATH_INFO: `/v3/users/798de34847c247fd9810711c363627ba` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:06.689643 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87981db2-a9e3-4d35-8af2-956f907581e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=798de34847c247fd9810711c363627ba)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:06.690586 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a84add-d8a4-4f86-b041-4e700d791d43 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:06.691631 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87981db2-a9e3-4d35-8af2-956f907581e5 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:06.698506 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f346c9e-a075-498c-8b80-45a897abe07b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:06.699245 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f346c9e-a075-498c-8b80-45a897abe07b admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:06.699531 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f346c9e-a075-498c-8b80-45a897abe07b admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:06.699812 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f346c9e-a075-498c-8b80-45a897abe07b admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:06.700543 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f346c9e-a075-498c-8b80-45a897abe07b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:06.702331 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f346c9e-a075-498c-8b80-45a897abe07b admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:06.716624 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2994/5972] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:34:06 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:34:06.718891 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f346c9e-a075-498c-8b80-45a897abe07b admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:06.730100 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:06.734167 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f346c9e-a075-498c-8b80-45a897abe07b admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:06.739525 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bb4b93-df79-4dbf-9be7-73757500e154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:06.740320 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bb4b93-df79-4dbf-9be7-73757500e154 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:06.740692 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bb4b93-df79-4dbf-9be7-73757500e154 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:06.741168 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bb4b93-df79-4dbf-9be7-73757500e154 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:06.742087 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bb4b93-df79-4dbf-9be7-73757500e154 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:06.743963 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bb4b93-df79-4dbf-9be7-73757500e154 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:06.761569 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2995/5973] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:34:06 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:34:06.762358 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bb4b93-df79-4dbf-9be7-73757500e154 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:06.778333 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-87981db2-a9e3-4d35-8af2-956f907581e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '798de34847c247fd9810711c363627ba'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:06.779887 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bb4b93-df79-4dbf-9be7-73757500e154 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:06.785848 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e49795e-4cd4-4155-b3b9-266e780dc32c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:06.786895 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e49795e-4cd4-4155-b3b9-266e780dc32c admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:06.787227 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e49795e-4cd4-4155-b3b9-266e780dc32c admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:06.787507 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e49795e-4cd4-4155-b3b9-266e780dc32c admin admin] PATH_INFO: `/v3/projects/8e285c381e7d4f2fab088ae6cb19615c/users/a1a0b60fd50447f486bc7b3cc9df5208/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:06.792957 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-87981db2-a9e3-4d35-8af2-956f907581e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '798de34847c247fd9810711c363627ba'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:06.793742 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-87981db2-a9e3-4d35-8af2-956f907581e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '798de34847c247fd9810711c363627ba'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:06.807487 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-87981db2-a9e3-4d35-8af2-956f907581e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '798de34847c247fd9810711c363627ba'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:06.807759 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e49795e-4cd4-4155-b3b9-266e780dc32c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e285c381e7d4f2fab088ae6cb19615c, user_id=a1a0b60fd50447f486bc7b3cc9df5208, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:06.814078 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e49795e-4cd4-4155-b3b9-266e780dc32c admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:06.825267 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-87981db2-a9e3-4d35-8af2-956f907581e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '798de34847c247fd9810711c363627ba'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:06.835313 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2979/5974] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:34:06 2022] DELETE /identity/v3/users/798de34847c247fd9810711c363627ba => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:34:06.835674 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2996/5975] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:34:06 2022] PUT /identity/v3/projects/8e285c381e7d4f2fab088ae6cb19615c/users/a1a0b60fd50447f486bc7b3cc9df5208/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:06.835779 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87981db2-a9e3-4d35-8af2-956f907581e5 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:06.837267 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-87981db2-a9e3-4d35-8af2-956f907581e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:06.843500 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d6481b-57b9-4b8a-ad5b-1425ba9389eb None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:06.843791 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d6481b-57b9-4b8a-ad5b-1425ba9389eb None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:06.844068 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d6481b-57b9-4b8a-ad5b-1425ba9389eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:06.882081 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-47d6481b-57b9-4b8a-ad5b-1425ba9389eb None None] MFA Rules not processed for user `a1a0b60fd50447f486bc7b3cc9df5208`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:34:06.883417 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-47d6481b-57b9-4b8a-ad5b-1425ba9389eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:06.928730 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87981db2-a9e3-4d35-8af2-956f907581e5 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:06.933567 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75e2e4d-f035-40da-a6c4-392e1d087f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:06.934590 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75e2e4d-f035-40da-a6c4-392e1d087f8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:06.934759 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75e2e4d-f035-40da-a6c4-392e1d087f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:06.935043 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75e2e4d-f035-40da-a6c4-392e1d087f8c admin admin] PATH_INFO: `/v3/projects/d012d6fb46e34ea0983f2a24947b363b` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:06.936373 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75e2e4d-f035-40da-a6c4-392e1d087f8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d012d6fb46e34ea0983f2a24947b363b)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:06.938327 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75e2e4d-f035-40da-a6c4-392e1d087f8c admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:06.957273 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2997/5976] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:34:06 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:34:06.962038 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d6481b-57b9-4b8a-ad5b-1425ba9389eb None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:06.963490 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-47d6481b-57b9-4b8a-ad5b-1425ba9389eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:06.974957 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:06.979736 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d6481b-57b9-4b8a-ad5b-1425ba9389eb None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:06.996860 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-c75e2e4d-f035-40da-a6c4-392e1d087f8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd012d6fb46e34ea0983f2a24947b363b', 'request_id': 'req-c75e2e4d-f035-40da-a6c4-392e1d087f8c'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:07.007329 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-c75e2e4d-f035-40da-a6c4-392e1d087f8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd012d6fb46e34ea0983f2a24947b363b', 'request_id': 'req-c75e2e4d-f035-40da-a6c4-392e1d087f8c'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:07.015249 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-c75e2e4d-f035-40da-a6c4-392e1d087f8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd012d6fb46e34ea0983f2a24947b363b', 'request_id': 'req-c75e2e4d-f035-40da-a6c4-392e1d087f8c'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:07.036091 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-c75e2e4d-f035-40da-a6c4-392e1d087f8c admin admin] The token cache is being invalidate because project d012d6fb46e34ea0983f2a24947b363b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:34:07.036241 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-c75e2e4d-f035-40da-a6c4-392e1d087f8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:07.037601 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-c75e2e4d-f035-40da-a6c4-392e1d087f8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:07.039692 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2980/5977] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:34:06 2022] DELETE /identity/v3/projects/d012d6fb46e34ea0983f2a24947b363b => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:07.043516 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75e2e4d-f035-40da-a6c4-392e1d087f8c admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:07.046330 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-c75e2e4d-f035-40da-a6c4-392e1d087f8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:07.052753 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d01c94-13ca-4b6a-8dc9-7370ef97c0f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:07.053498 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d01c94-13ca-4b6a-8dc9-7370ef97c0f5 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:07.053786 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d01c94-13ca-4b6a-8dc9-7370ef97c0f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:07.054117 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d01c94-13ca-4b6a-8dc9-7370ef97c0f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:07.054844 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d01c94-13ca-4b6a-8dc9-7370ef97c0f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:07.056767 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d01c94-13ca-4b6a-8dc9-7370ef97c0f5 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:07.067900 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75e2e4d-f035-40da-a6c4-392e1d087f8c admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:07.075079 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cf823e-3611-4b6c-85ef-76849acaf65e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:07.076554 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cf823e-3611-4b6c-85ef-76849acaf65e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:07.077067 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cf823e-3611-4b6c-85ef-76849acaf65e admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:07.077569 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cf823e-3611-4b6c-85ef-76849acaf65e admin admin] PATH_INFO: `/v3/users/91b97cc2acbf48a1b92376922559dc05` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:07.079635 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cf823e-3611-4b6c-85ef-76849acaf65e admin admin] RBAC: Authorizing `identity:delete_user(user_id=91b97cc2acbf48a1b92376922559dc05)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:07.083044 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cf823e-3611-4b6c-85ef-76849acaf65e admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:07.092977 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2998/5978] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:34:06 2022] POST /identity/v3/projects => generated 373 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:34:07.094212 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d01c94-13ca-4b6a-8dc9-7370ef97c0f5 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:07.095976 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-f3d01c94-13ca-4b6a-8dc9-7370ef97c0f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:07.121706 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:07.149682 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-b4cf823e-3611-4b6c-85ef-76849acaf65e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91b97cc2acbf48a1b92376922559dc05'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:07.159278 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-b4cf823e-3611-4b6c-85ef-76849acaf65e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91b97cc2acbf48a1b92376922559dc05'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:07.161831 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-b4cf823e-3611-4b6c-85ef-76849acaf65e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91b97cc2acbf48a1b92376922559dc05'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:07.169413 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-b4cf823e-3611-4b6c-85ef-76849acaf65e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91b97cc2acbf48a1b92376922559dc05'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:07.172222 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d01c94-13ca-4b6a-8dc9-7370ef97c0f5 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:07.177581 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856de614-5ec8-4b77-90f3-be6a0161a454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:07.178358 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856de614-5ec8-4b77-90f3-be6a0161a454 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:07.178639 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856de614-5ec8-4b77-90f3-be6a0161a454 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:07.178910 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856de614-5ec8-4b77-90f3-be6a0161a454 admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:07.179870 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856de614-5ec8-4b77-90f3-be6a0161a454 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:07.181726 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856de614-5ec8-4b77-90f3-be6a0161a454 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:07.185716 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-b4cf823e-3611-4b6c-85ef-76849acaf65e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91b97cc2acbf48a1b92376922559dc05'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:07.194982 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2981/5979] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:34:07 2022] DELETE /identity/v3/users/91b97cc2acbf48a1b92376922559dc05 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:07.196028 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cf823e-3611-4b6c-85ef-76849acaf65e admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:07.206773 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-b4cf823e-3611-4b6c-85ef-76849acaf65e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:07.211071 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 2999/5980] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:34:07 2022] POST /identity/v3/users => generated 293 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:34:07.214365 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856de614-5ec8-4b77-90f3-be6a0161a454 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:07.215916 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-856de614-5ec8-4b77-90f3-be6a0161a454 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:07.229149 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856de614-5ec8-4b77-90f3-be6a0161a454 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:07.286670 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cf823e-3611-4b6c-85ef-76849acaf65e admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:07.291788 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22cebbb-69bc-45c3-ac42-1921699eda7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:07.292670 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22cebbb-69bc-45c3-ac42-1921699eda7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:07.292967 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22cebbb-69bc-45c3-ac42-1921699eda7d admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:07.293646 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22cebbb-69bc-45c3-ac42-1921699eda7d admin admin] PATH_INFO: `/v3/projects/2a2d65a60ebe469792ab253f3f0a7f0f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:07.294511 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7505c8b3-894c-4e8f-82f5-b7b42fc515b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:07.294646 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22cebbb-69bc-45c3-ac42-1921699eda7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a2d65a60ebe469792ab253f3f0a7f0f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:07.295321 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7505c8b3-894c-4e8f-82f5-b7b42fc515b1 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:07.295818 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7505c8b3-894c-4e8f-82f5-b7b42fc515b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:07.296162 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7505c8b3-894c-4e8f-82f5-b7b42fc515b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:07.296858 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22cebbb-69bc-45c3-ac42-1921699eda7d admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:07.297067 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7505c8b3-894c-4e8f-82f5-b7b42fc515b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:07.298790 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7505c8b3-894c-4e8f-82f5-b7b42fc515b1 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:07.313021 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3000/5981] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:34:07 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 21:34:07.314440 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7505c8b3-894c-4e8f-82f5-b7b42fc515b1 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:07.324498 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7505c8b3-894c-4e8f-82f5-b7b42fc515b1 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:07.330309 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf2bc25-008e-4cc2-93bd-5c0306af5f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:07.331520 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf2bc25-008e-4cc2-93bd-5c0306af5f64 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:07.332014 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf2bc25-008e-4cc2-93bd-5c0306af5f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:07.332311 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf2bc25-008e-4cc2-93bd-5c0306af5f64 admin admin] PATH_INFO: `/v3/projects/f83eca4118fa4866959f771b4e87f0fb/users/2fc17b0c69fd4e059e1de02356899ae5/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:07.345676 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:07.350887 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf2bc25-008e-4cc2-93bd-5c0306af5f64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f83eca4118fa4866959f771b4e87f0fb, user_id=2fc17b0c69fd4e059e1de02356899ae5, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:07.353782 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf2bc25-008e-4cc2-93bd-5c0306af5f64 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:07.355069 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-d22cebbb-69bc-45c3-ac42-1921699eda7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a2d65a60ebe469792ab253f3f0a7f0f', 'request_id': 'req-d22cebbb-69bc-45c3-ac42-1921699eda7d'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:07.371403 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-d22cebbb-69bc-45c3-ac42-1921699eda7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a2d65a60ebe469792ab253f3f0a7f0f', 'request_id': 'req-d22cebbb-69bc-45c3-ac42-1921699eda7d'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:07.377019 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3001/5982] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:34:07 2022] PUT /identity/v3/projects/f83eca4118fa4866959f771b4e87f0fb/users/2fc17b0c69fd4e059e1de02356899ae5/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:07.380743 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf2bc25-008e-4cc2-93bd-5c0306af5f64 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:07.383311 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-d22cebbb-69bc-45c3-ac42-1921699eda7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a2d65a60ebe469792ab253f3f0a7f0f', 'request_id': 'req-d22cebbb-69bc-45c3-ac42-1921699eda7d'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:07.396698 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-d22cebbb-69bc-45c3-ac42-1921699eda7d admin admin] The token cache is being invalidate because project 2a2d65a60ebe469792ab253f3f0a7f0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:34:07.397079 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-d22cebbb-69bc-45c3-ac42-1921699eda7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:07.397823 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-d22cebbb-69bc-45c3-ac42-1921699eda7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:07.399806 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2982/5983] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:34:07 2022] DELETE /identity/v3/projects/2a2d65a60ebe469792ab253f3f0a7f0f => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:07.406038 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d28241-cc5d-45ae-aad0-22c797c7820c None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:07.406471 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d28241-cc5d-45ae-aad0-22c797c7820c None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:07.406875 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d28241-cc5d-45ae-aad0-22c797c7820c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:07.432558 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-95d28241-cc5d-45ae-aad0-22c797c7820c None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:34:07.433906 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-95d28241-cc5d-45ae-aad0-22c797c7820c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:07.454089 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf2bc25-008e-4cc2-93bd-5c0306af5f64 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:07.458800 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f9b575-8246-424d-a5ec-4d2af777df67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:07.459554 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f9b575-8246-424d-a5ec-4d2af777df67 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:07.459841 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f9b575-8246-424d-a5ec-4d2af777df67 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:07.460118 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f9b575-8246-424d-a5ec-4d2af777df67 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:07.460902 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f9b575-8246-424d-a5ec-4d2af777df67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:07.463165 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f9b575-8246-424d-a5ec-4d2af777df67 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:07.467310 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:07.474518 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3002/5984] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:34:07 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 21:34:07.478904 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f9b575-8246-424d-a5ec-4d2af777df67 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:07.480666 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-d2f9b575-8246-424d-a5ec-4d2af777df67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:07.495220 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f9b575-8246-424d-a5ec-4d2af777df67 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:07.501086 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3727276-a848-4116-939f-4016b3330e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:07.502034 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3727276-a848-4116-939f-4016b3330e82 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:07.502323 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3727276-a848-4116-939f-4016b3330e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:07.502603 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3727276-a848-4116-939f-4016b3330e82 admin admin] PATH_INFO: `/v3/projects/f83eca4118fa4866959f771b4e87f0fb/users/2fc17b0c69fd4e059e1de02356899ae5/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:07.504978 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3727276-a848-4116-939f-4016b3330e82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f83eca4118fa4866959f771b4e87f0fb, user_id=2fc17b0c69fd4e059e1de02356899ae5, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:07.508003 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3727276-a848-4116-939f-4016b3330e82 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:07.518921 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2983/5985] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:34:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:34:07.520140 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d28241-cc5d-45ae-aad0-22c797c7820c None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:07.521693 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-95d28241-cc5d-45ae-aad0-22c797c7820c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:07.529001 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3003/5986] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:34:07 2022] PUT /identity/v3/projects/f83eca4118fa4866959f771b4e87f0fb/users/2fc17b0c69fd4e059e1de02356899ae5/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:34:07.530618 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2a8750-5d1b-4a25-9eac-09dd1897bb5c None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:07.530918 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2a8750-5d1b-4a25-9eac-09dd1897bb5c None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:07.531200 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2a8750-5d1b-4a25-9eac-09dd1897bb5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:07.535188 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d28241-cc5d-45ae-aad0-22c797c7820c None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:07.551635 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-9e2a8750-5d1b-4a25-9eac-09dd1897bb5c None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:34:07.552901 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-9e2a8750-5d1b-4a25-9eac-09dd1897bb5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:07.596789 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2e94fb-cadd-4734-8c56-1edd4b29e6df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:07.597725 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2e94fb-cadd-4734-8c56-1edd4b29e6df admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:07.598037 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2e94fb-cadd-4734-8c56-1edd4b29e6df admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:07.598309 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2e94fb-cadd-4734-8c56-1edd4b29e6df admin admin] PATH_INFO: `/v3/projects/adbd3af81848426c9671fbd25ea31248` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:07.599492 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2e94fb-cadd-4734-8c56-1edd4b29e6df admin admin] RBAC: Authorizing `identity:delete_project(project_id=adbd3af81848426c9671fbd25ea31248)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:07.601850 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2e94fb-cadd-4734-8c56-1edd4b29e6df admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:07.614500 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3004/5987] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:34:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:34:07.615850 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c09f9b8-7da9-42bf-ac29-a91f4c1565a7 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:07.616173 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c09f9b8-7da9-42bf-ac29-a91f4c1565a7 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:07.616445 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c09f9b8-7da9-42bf-ac29-a91f4c1565a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:07.643149 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-2c09f9b8-7da9-42bf-ac29-a91f4c1565a7 None None] MFA Rules not processed for user `2fc17b0c69fd4e059e1de02356899ae5`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:34:07.644351 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-2c09f9b8-7da9-42bf-ac29-a91f4c1565a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:07.647696 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-cf2e94fb-cadd-4734-8c56-1edd4b29e6df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'adbd3af81848426c9671fbd25ea31248', 'request_id': 'req-cf2e94fb-cadd-4734-8c56-1edd4b29e6df'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:07.656987 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-cf2e94fb-cadd-4734-8c56-1edd4b29e6df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'adbd3af81848426c9671fbd25ea31248', 'request_id': 'req-cf2e94fb-cadd-4734-8c56-1edd4b29e6df'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:07.663101 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-cf2e94fb-cadd-4734-8c56-1edd4b29e6df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'adbd3af81848426c9671fbd25ea31248', 'request_id': 'req-cf2e94fb-cadd-4734-8c56-1edd4b29e6df'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:07.674942 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-cf2e94fb-cadd-4734-8c56-1edd4b29e6df admin admin] The token cache is being invalidate because project adbd3af81848426c9671fbd25ea31248 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:34:07.675236 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-cf2e94fb-cadd-4734-8c56-1edd4b29e6df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:07.676641 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-cf2e94fb-cadd-4734-8c56-1edd4b29e6df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:07.678624 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2984/5988] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:34:07 2022] DELETE /identity/v3/projects/adbd3af81848426c9671fbd25ea31248 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:07.679183 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2e94fb-cadd-4734-8c56-1edd4b29e6df admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:07.680575 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-cf2e94fb-cadd-4734-8c56-1edd4b29e6df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:07.712855 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:07.719683 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3005/5989] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:34:07 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:34:07.721760 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2138c28-69f3-47ab-b0c3-a154ff01bbc2 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:07.722567 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2138c28-69f3-47ab-b0c3-a154ff01bbc2 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:07.723122 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2138c28-69f3-47ab-b0c3-a154ff01bbc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:07.742749 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-b2138c28-69f3-47ab-b0c3-a154ff01bbc2 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:34:07.743994 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-b2138c28-69f3-47ab-b0c3-a154ff01bbc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:07.744659 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2e94fb-cadd-4734-8c56-1edd4b29e6df admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:07.749426 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12196607-f710-440f-9c70-cbfc566884ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:07.750518 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12196607-f710-440f-9c70-cbfc566884ea admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:07.750850 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12196607-f710-440f-9c70-cbfc566884ea admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:07.751243 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12196607-f710-440f-9c70-cbfc566884ea admin admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:07.751976 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12196607-f710-440f-9c70-cbfc566884ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:34:07.752283 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12196607-f710-440f-9c70-cbfc566884ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:07.752395 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3006/5990] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:34:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:34:07.753156 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2138c28-69f3-47ab-b0c3-a154ff01bbc2 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:07.753967 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12196607-f710-440f-9c70-cbfc566884ea admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:07.761022 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:07.767913 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2985/5991] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:34:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:34:07.768380 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2138c28-69f3-47ab-b0c3-a154ff01bbc2 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:07.770538 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8369030c-ad8b-4fc2-a9a9-7d672076176f None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:07.771336 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8369030c-ad8b-4fc2-a9a9-7d672076176f None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:07.771832 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8369030c-ad8b-4fc2-a9a9-7d672076176f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:07.773910 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf57752-2a98-46d3-a254-c1a165eda673 tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fc17b0c69fd4e059e1de02356899ae5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f83eca4118fa4866959f771b4e87f0fb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:07.774583 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf57752-2a98-46d3-a254-c1a165eda673 tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:07.774874 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf57752-2a98-46d3-a254-c1a165eda673 tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:07.775158 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf57752-2a98-46d3-a254-c1a165eda673 tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] PATH_INFO: `/v3/services` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:07.775943 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf57752-2a98-46d3-a254-c1a165eda673 tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:07.776937 ncdv-master-1 devstack@keystone.service[91548]: WARNING py.warnings [None req-8cf57752-2a98-46d3-a254-c1a165eda673 tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:34:07.776937 ncdv-master-1 devstack@keystone.service[91548]: warnings.warn(msg) Jul 23 21:34:07.776937 ncdv-master-1 devstack@keystone.service[91548]: Jul 23 21:34:07.777936 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf57752-2a98-46d3-a254-c1a165eda673 tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:07.793133 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-8369030c-ad8b-4fc2-a9a9-7d672076176f None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:34:07.793567 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3007/5992] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:34:07 2022] POST /identity/v3/services => generated 290 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:34:07.794416 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf57752-2a98-46d3-a254-c1a165eda673 tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:07.795256 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-8369030c-ad8b-4fc2-a9a9-7d672076176f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:07.823278 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2986/5993] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:34:07 2022] POST /identity/v3/auth/tokens => generated 3363 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:34:07.823278 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8369030c-ad8b-4fc2-a9a9-7d672076176f None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:07.824413 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf57752-2a98-46d3-a254-c1a165eda673 tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:07.829201 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1c30e8-f606-45ab-b9ff-fa8e508695af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:07.829888 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1c30e8-f606-45ab-b9ff-fa8e508695af admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:07.830193 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1c30e8-f606-45ab-b9ff-fa8e508695af admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:07.830656 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1c30e8-f606-45ab-b9ff-fa8e508695af admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:07.831411 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1c30e8-f606-45ab-b9ff-fa8e508695af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:07.833362 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1c30e8-f606-45ab-b9ff-fa8e508695af admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:07.842019 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8369030c-ad8b-4fc2-a9a9-7d672076176f None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:07.847233 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5770126c-4e6a-4929-ab73-732da1b1b9e2 tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fc17b0c69fd4e059e1de02356899ae5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f83eca4118fa4866959f771b4e87f0fb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:07.848074 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5770126c-4e6a-4929-ab73-732da1b1b9e2 tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:07.848347 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5770126c-4e6a-4929-ab73-732da1b1b9e2 tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:07.848622 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5770126c-4e6a-4929-ab73-732da1b1b9e2 tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:07.849352 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5770126c-4e6a-4929-ab73-732da1b1b9e2 tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:07.851215 ncdv-master-1 devstack@keystone.service[91547]: WARNING py.warnings [None req-5770126c-4e6a-4929-ab73-732da1b1b9e2 tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:34:07.851215 ncdv-master-1 devstack@keystone.service[91547]: warnings.warn(msg) Jul 23 21:34:07.851215 ncdv-master-1 devstack@keystone.service[91547]: Jul 23 21:34:07.852377 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5770126c-4e6a-4929-ab73-732da1b1b9e2 tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:07.864195 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3008/5994] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:34:07 2022] POST /identity/v3/projects => generated 367 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:34:07.864195 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1c30e8-f606-45ab-b9ff-fa8e508695af admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:07.864500 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2987/5995] 10.222.0.17 () {60 vars in 1212 bytes} [Sat Jul 23 21:34:07 2022] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 334 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:34:07.867080 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5770126c-4e6a-4929-ab73-732da1b1b9e2 tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:07.878061 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5770126c-4e6a-4929-ab73-732da1b1b9e2 tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:07.931024 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1c30e8-f606-45ab-b9ff-fa8e508695af admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:07.935992 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555dc08f-8585-4bd5-a8da-3e3da93cdf46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:07.936740 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555dc08f-8585-4bd5-a8da-3e3da93cdf46 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:07.937025 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555dc08f-8585-4bd5-a8da-3e3da93cdf46 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:07.937310 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555dc08f-8585-4bd5-a8da-3e3da93cdf46 admin admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:07.938188 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555dc08f-8585-4bd5-a8da-3e3da93cdf46 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:34:07.938494 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555dc08f-8585-4bd5-a8da-3e3da93cdf46 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:07.940337 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555dc08f-8585-4bd5-a8da-3e3da93cdf46 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:07.948573 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d090ec94-f80a-481b-bc2e-2decd527831f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:07.949916 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d090ec94-f80a-481b-bc2e-2decd527831f admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:07.950048 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d090ec94-f80a-481b-bc2e-2decd527831f admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:07.950279 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d090ec94-f80a-481b-bc2e-2decd527831f admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:07.951145 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d090ec94-f80a-481b-bc2e-2decd527831f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:07.952731 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3009/5996] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:34:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:34:07.953103 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d090ec94-f80a-481b-bc2e-2decd527831f admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:07.957095 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555dc08f-8585-4bd5-a8da-3e3da93cdf46 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:07.982793 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2988/5997] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:34:07 2022] POST /identity/v3/users => generated 284 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:34:07.982793 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d090ec94-f80a-481b-bc2e-2decd527831f admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:07.999565 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d090ec94-f80a-481b-bc2e-2decd527831f admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:08.004795 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3b491c-5089-450e-9e4d-8fed09917fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:08.005493 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3b491c-5089-450e-9e4d-8fed09917fb3 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:08.005779 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3b491c-5089-450e-9e4d-8fed09917fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:08.006200 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3b491c-5089-450e-9e4d-8fed09917fb3 admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:08.006899 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3b491c-5089-450e-9e4d-8fed09917fb3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:08.008862 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3b491c-5089-450e-9e4d-8fed09917fb3 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:08.024875 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555dc08f-8585-4bd5-a8da-3e3da93cdf46 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:08.030156 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68ccff0-4613-4fba-aa29-850215c63910 tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fc17b0c69fd4e059e1de02356899ae5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f83eca4118fa4866959f771b4e87f0fb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:08.030833 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68ccff0-4613-4fba-aa29-850215c63910 tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:08.031121 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68ccff0-4613-4fba-aa29-850215c63910 tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:08.031396 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68ccff0-4613-4fba-aa29-850215c63910 tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] PATH_INFO: `/v3/services` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:08.032114 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68ccff0-4613-4fba-aa29-850215c63910 tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:08.033721 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68ccff0-4613-4fba-aa29-850215c63910 tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:08.040267 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2989/5998] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:34:07 2022] POST /identity/v3/projects => generated 385 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:34:08.040267 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3b491c-5089-450e-9e4d-8fed09917fb3 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:08.052178 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3010/5999] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:34:07 2022] POST /identity/v3/services => generated 289 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:34:08.053147 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68ccff0-4613-4fba-aa29-850215c63910 tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:08.073160 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68ccff0-4613-4fba-aa29-850215c63910 tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:08.097182 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:08.105093 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3b491c-5089-450e-9e4d-8fed09917fb3 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:08.109989 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857d3918-974f-4719-9e13-70256bc3898f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:08.110662 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857d3918-974f-4719-9e13-70256bc3898f admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:08.110992 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857d3918-974f-4719-9e13-70256bc3898f admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:08.111222 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857d3918-974f-4719-9e13-70256bc3898f admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:08.111950 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857d3918-974f-4719-9e13-70256bc3898f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:08.113508 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857d3918-974f-4719-9e13-70256bc3898f admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:08.123748 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2990/6000] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:34:08 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:34:08.124512 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857d3918-974f-4719-9e13-70256bc3898f admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:08.133447 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f8fbbb-4a79-4c90-bf09-6e72015e2901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:08.134291 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f8fbbb-4a79-4c90-bf09-6e72015e2901 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:08.134582 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f8fbbb-4a79-4c90-bf09-6e72015e2901 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:08.134859 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f8fbbb-4a79-4c90-bf09-6e72015e2901 admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:08.135583 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f8fbbb-4a79-4c90-bf09-6e72015e2901 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:08.137547 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f8fbbb-4a79-4c90-bf09-6e72015e2901 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:08.156288 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:08.163643 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3011/6001] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:34:08 2022] POST /identity/v3/users => generated 293 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:34:08.163643 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f8fbbb-4a79-4c90-bf09-6e72015e2901 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:08.171751 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f8fbbb-4a79-4c90-bf09-6e72015e2901 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:08.176425 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ecc861-05a0-4a06-b83f-3e738bed6859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:08.177086 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ecc861-05a0-4a06-b83f-3e738bed6859 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:08.177377 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ecc861-05a0-4a06-b83f-3e738bed6859 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:08.177648 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ecc861-05a0-4a06-b83f-3e738bed6859 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:08.178489 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ecc861-05a0-4a06-b83f-3e738bed6859 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:08.180093 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ecc861-05a0-4a06-b83f-3e738bed6859 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:08.194067 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3012/6002] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:34:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:34:08.194067 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ecc861-05a0-4a06-b83f-3e738bed6859 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:08.201585 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857d3918-974f-4719-9e13-70256bc3898f admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:08.202017 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ecc861-05a0-4a06-b83f-3e738bed6859 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:08.206483 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58213f5-7824-4d93-868b-abc022c9e321 tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fc17b0c69fd4e059e1de02356899ae5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f83eca4118fa4866959f771b4e87f0fb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:08.206871 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296bd493-59a7-4ec0-8bad-bc3f5fe50e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:08.207130 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58213f5-7824-4d93-868b-abc022c9e321 tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:08.207417 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58213f5-7824-4d93-868b-abc022c9e321 tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:08.207522 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296bd493-59a7-4ec0-8bad-bc3f5fe50e63 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:08.207696 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58213f5-7824-4d93-868b-abc022c9e321 tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:08.207801 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296bd493-59a7-4ec0-8bad-bc3f5fe50e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:08.208045 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296bd493-59a7-4ec0-8bad-bc3f5fe50e63 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:08.208419 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58213f5-7824-4d93-868b-abc022c9e321 tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:08.208746 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296bd493-59a7-4ec0-8bad-bc3f5fe50e63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:08.210121 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58213f5-7824-4d93-868b-abc022c9e321 tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:08.210491 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296bd493-59a7-4ec0-8bad-bc3f5fe50e63 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:08.219402 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2991/6003] 10.222.0.17 () {60 vars in 1212 bytes} [Sat Jul 23 21:34:08 2022] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 334 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:34:08.220142 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58213f5-7824-4d93-868b-abc022c9e321 tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:08.224531 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3013/6004] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:34:08 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:34:08.225829 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296bd493-59a7-4ec0-8bad-bc3f5fe50e63 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:08.234120 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58213f5-7824-4d93-868b-abc022c9e321 tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:08.236994 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296bd493-59a7-4ec0-8bad-bc3f5fe50e63 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:08.239062 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219a5a95-28d5-4fe4-9009-84b75866f515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:08.239969 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219a5a95-28d5-4fe4-9009-84b75866f515 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:08.240311 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219a5a95-28d5-4fe4-9009-84b75866f515 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:08.240586 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219a5a95-28d5-4fe4-9009-84b75866f515 admin admin] PATH_INFO: `/v3/projects/672228c1a6fd4d0b9a4c6a3a9c739179/users/9e5e875987db4003a8655200463d9667/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:08.241749 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552b8a72-dbc8-479f-86e4-a1a2a2b51a6a tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fc17b0c69fd4e059e1de02356899ae5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f83eca4118fa4866959f771b4e87f0fb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:08.242441 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552b8a72-dbc8-479f-86e4-a1a2a2b51a6a tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:08.242720 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552b8a72-dbc8-479f-86e4-a1a2a2b51a6a tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:08.243002 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552b8a72-dbc8-479f-86e4-a1a2a2b51a6a tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:08.243706 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552b8a72-dbc8-479f-86e4-a1a2a2b51a6a tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] RBAC: Authorizing `identity:list_endpoint_groups()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:08.244722 ncdv-master-1 devstack@keystone.service[91548]: WARNING py.warnings [None req-552b8a72-dbc8-479f-86e4-a1a2a2b51a6a tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_endpoint_groups": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:34:08.244722 ncdv-master-1 devstack@keystone.service[91548]: warnings.warn(msg) Jul 23 21:34:08.244722 ncdv-master-1 devstack@keystone.service[91548]: Jul 23 21:34:08.245610 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552b8a72-dbc8-479f-86e4-a1a2a2b51a6a tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:08.252886 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3014/6005] 10.222.0.17 () {58 vars in 1190 bytes} [Sat Jul 23 21:34:08 2022] GET /identity/v3/OS-EP-FILTER/endpoint_groups => generated 766 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:34:08.253513 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552b8a72-dbc8-479f-86e4-a1a2a2b51a6a tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:08.256335 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219a5a95-28d5-4fe4-9009-84b75866f515 admin admin] RBAC: Authorizing `identity:create_grant(project_id=672228c1a6fd4d0b9a4c6a3a9c739179, user_id=9e5e875987db4003a8655200463d9667, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:08.259035 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219a5a95-28d5-4fe4-9009-84b75866f515 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:08.264512 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552b8a72-dbc8-479f-86e4-a1a2a2b51a6a tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:08.269580 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfd3cbe-90c3-4532-994b-55d1da96973f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:08.270343 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfd3cbe-90c3-4532-994b-55d1da96973f admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:08.270629 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfd3cbe-90c3-4532-994b-55d1da96973f admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:08.270899 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfd3cbe-90c3-4532-994b-55d1da96973f admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:08.271607 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfd3cbe-90c3-4532-994b-55d1da96973f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:08.272298 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2992/6006] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:34:08 2022] PUT /identity/v3/projects/672228c1a6fd4d0b9a4c6a3a9c739179/users/9e5e875987db4003a8655200463d9667/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:08.273163 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfd3cbe-90c3-4532-994b-55d1da96973f admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:08.273267 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219a5a95-28d5-4fe4-9009-84b75866f515 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:08.283771 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3015/6007] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:34:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:34:08.285147 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dd5b34-7e5a-4122-b340-1214892bad22 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:08.285436 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dd5b34-7e5a-4122-b340-1214892bad22 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:08.285694 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dd5b34-7e5a-4122-b340-1214892bad22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:08.312128 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-e3dd5b34-7e5a-4122-b340-1214892bad22 None None] MFA Rules not processed for user `9e5e875987db4003a8655200463d9667`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:34:08.313434 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-e3dd5b34-7e5a-4122-b340-1214892bad22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:08.335207 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219a5a95-28d5-4fe4-9009-84b75866f515 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:08.340033 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042acad7-9b5f-4f77-b7f3-9107987031d5 tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fc17b0c69fd4e059e1de02356899ae5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f83eca4118fa4866959f771b4e87f0fb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:08.340904 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042acad7-9b5f-4f77-b7f3-9107987031d5 tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:08.341173 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042acad7-9b5f-4f77-b7f3-9107987031d5 tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:08.341448 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042acad7-9b5f-4f77-b7f3-9107987031d5 tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/3a8f2ebc36c947479164cfbb014e8911` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:08.342129 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042acad7-9b5f-4f77-b7f3-9107987031d5 tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] RBAC: Authorizing `identity:get_endpoint_group(endpoint_group_id=3a8f2ebc36c947479164cfbb014e8911)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:08.343142 ncdv-master-1 devstack@keystone.service[91547]: WARNING py.warnings [None req-042acad7-9b5f-4f77-b7f3-9107987031d5 tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_endpoint_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:34:08.343142 ncdv-master-1 devstack@keystone.service[91547]: warnings.warn(msg) Jul 23 21:34:08.343142 ncdv-master-1 devstack@keystone.service[91547]: Jul 23 21:34:08.344017 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042acad7-9b5f-4f77-b7f3-9107987031d5 tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:08.351189 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2993/6008] 10.222.0.17 () {58 vars in 1289 bytes} [Sat Jul 23 21:34:08 2022] GET /identity/v3/OS-EP-FILTER/endpoint_groups/3a8f2ebc36c947479164cfbb014e8911 => generated 334 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:34:08.351954 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042acad7-9b5f-4f77-b7f3-9107987031d5 tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:08.381423 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3016/6009] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:34:08 2022] POST /identity/v3/auth/tokens => generated 3501 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:34:08.382332 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dd5b34-7e5a-4122-b340-1214892bad22 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:08.392856 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dd5b34-7e5a-4122-b340-1214892bad22 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:08.397737 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c605e3-106e-4148-976d-8748d47aa403 tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fc17b0c69fd4e059e1de02356899ae5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f83eca4118fa4866959f771b4e87f0fb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:08.398621 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c605e3-106e-4148-976d-8748d47aa403 tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] REQUEST_METHOD: `HEAD` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:08.398904 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c605e3-106e-4148-976d-8748d47aa403 tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:08.399182 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c605e3-106e-4148-976d-8748d47aa403 tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/3a8f2ebc36c947479164cfbb014e8911` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:08.399879 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c605e3-106e-4148-976d-8748d47aa403 tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] RBAC: Authorizing `identity:get_endpoint_group(endpoint_group_id=3a8f2ebc36c947479164cfbb014e8911)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:08.400891 ncdv-master-1 devstack@keystone.service[91548]: WARNING py.warnings [None req-63c605e3-106e-4148-976d-8748d47aa403 tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_endpoint_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:34:08.400891 ncdv-master-1 devstack@keystone.service[91548]: warnings.warn(msg) Jul 23 21:34:08.400891 ncdv-master-1 devstack@keystone.service[91548]: Jul 23 21:34:08.401776 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c605e3-106e-4148-976d-8748d47aa403 tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:08.407801 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3017/6010] 10.222.0.17 () {58 vars in 1290 bytes} [Sat Jul 23 21:34:08 2022] HEAD /identity/v3/OS-EP-FILTER/endpoint_groups/3a8f2ebc36c947479164cfbb014e8911 => generated 0 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Jul 23 21:34:08.408352 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c605e3-106e-4148-976d-8748d47aa403 tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:08.420420 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042acad7-9b5f-4f77-b7f3-9107987031d5 tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:08.425206 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023d7f7b-d6c0-4104-8f7c-07afc4af9a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:08.426147 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023d7f7b-d6c0-4104-8f7c-07afc4af9a41 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:08.426428 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023d7f7b-d6c0-4104-8f7c-07afc4af9a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:08.426705 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023d7f7b-d6c0-4104-8f7c-07afc4af9a41 admin admin] PATH_INFO: `/v3/projects/033dc11a6c2144be9959e00ced250baa/users/45f24ffc31ee4e8687a38581cd062fd0/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:08.441192 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023d7f7b-d6c0-4104-8f7c-07afc4af9a41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=033dc11a6c2144be9959e00ced250baa, user_id=45f24ffc31ee4e8687a38581cd062fd0, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:08.444025 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023d7f7b-d6c0-4104-8f7c-07afc4af9a41 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:08.467110 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2994/6011] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:34:08 2022] PUT /identity/v3/projects/033dc11a6c2144be9959e00ced250baa/users/45f24ffc31ee4e8687a38581cd062fd0/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:08.467110 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023d7f7b-d6c0-4104-8f7c-07afc4af9a41 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:08.474787 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:08.477295 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:08.483328 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c605e3-106e-4148-976d-8748d47aa403 tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:08.522900 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023d7f7b-d6c0-4104-8f7c-07afc4af9a41 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:08.527641 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56fcb13-290d-47aa-b1fd-0d1b78ad5a67 tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fc17b0c69fd4e059e1de02356899ae5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f83eca4118fa4866959f771b4e87f0fb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:08.528508 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56fcb13-290d-47aa-b1fd-0d1b78ad5a67 tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:08.528814 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56fcb13-290d-47aa-b1fd-0d1b78ad5a67 tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:08.529122 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56fcb13-290d-47aa-b1fd-0d1b78ad5a67 tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/3a8f2ebc36c947479164cfbb014e8911` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:08.529783 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56fcb13-290d-47aa-b1fd-0d1b78ad5a67 tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=3a8f2ebc36c947479164cfbb014e8911)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:08.530895 ncdv-master-1 devstack@keystone.service[91547]: WARNING py.warnings [None req-c56fcb13-290d-47aa-b1fd-0d1b78ad5a67 tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:34:08.530895 ncdv-master-1 devstack@keystone.service[91547]: warnings.warn(msg) Jul 23 21:34:08.530895 ncdv-master-1 devstack@keystone.service[91547]: Jul 23 21:34:08.531786 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56fcb13-290d-47aa-b1fd-0d1b78ad5a67 tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:08.541072 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f512c84e-64a9-4393-bce8-0e1264987d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:08.541817 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f512c84e-64a9-4393-bce8-0e1264987d3c admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:08.542195 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f512c84e-64a9-4393-bce8-0e1264987d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:08.542533 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f512c84e-64a9-4393-bce8-0e1264987d3c admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:08.542769 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2995/6012] 10.222.0.17 () {58 vars in 1292 bytes} [Sat Jul 23 21:34:08 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/3a8f2ebc36c947479164cfbb014e8911 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:08.543344 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f512c84e-64a9-4393-bce8-0e1264987d3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:08.544123 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae104fe1-9779-412f-b69d-3581ca7d3476 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:08.544407 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae104fe1-9779-412f-b69d-3581ca7d3476 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:08.544680 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae104fe1-9779-412f-b69d-3581ca7d3476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:08.545510 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f512c84e-64a9-4393-bce8-0e1264987d3c admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:08.575214 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3018/6013] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:34:08 2022] POST /identity/v3/projects => generated 367 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:34:08.575428 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-ae104fe1-9779-412f-b69d-3581ca7d3476 None None] MFA Rules not processed for user `45f24ffc31ee4e8687a38581cd062fd0`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:34:08.575537 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f512c84e-64a9-4393-bce8-0e1264987d3c admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:08.575637 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-ae104fe1-9779-412f-b69d-3581ca7d3476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:08.636957 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f512c84e-64a9-4393-bce8-0e1264987d3c admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:08.639351 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2996/6014] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:34:08 2022] POST /identity/v3/auth/tokens => generated 3519 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:34:08.640256 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae104fe1-9779-412f-b69d-3581ca7d3476 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:08.641829 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e817a939-dc47-4292-8f22-7b348aa72e80 tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fc17b0c69fd4e059e1de02356899ae5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f83eca4118fa4866959f771b4e87f0fb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:08.642524 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e817a939-dc47-4292-8f22-7b348aa72e80 tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:08.642810 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e817a939-dc47-4292-8f22-7b348aa72e80 tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:08.643086 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e817a939-dc47-4292-8f22-7b348aa72e80 tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:08.643832 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e817a939-dc47-4292-8f22-7b348aa72e80 tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] RBAC: Authorizing `identity:list_endpoint_groups()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:08.645441 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e817a939-dc47-4292-8f22-7b348aa72e80 tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:08.653904 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3019/6015] 10.222.0.17 () {58 vars in 1190 bytes} [Sat Jul 23 21:34:08 2022] GET /identity/v3/OS-EP-FILTER/endpoint_groups => generated 451 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:34:08.654873 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e817a939-dc47-4292-8f22-7b348aa72e80 tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:08.656566 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-e817a939-dc47-4292-8f22-7b348aa72e80 tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:08.708452 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae104fe1-9779-412f-b69d-3581ca7d3476 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:08.713237 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e9efd2-f2de-43de-bb9e-7089945dd3f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:08.713980 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e9efd2-f2de-43de-bb9e-7089945dd3f7 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:08.714265 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e9efd2-f2de-43de-bb9e-7089945dd3f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:08.714547 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e9efd2-f2de-43de-bb9e-7089945dd3f7 admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:08.715240 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e9efd2-f2de-43de-bb9e-7089945dd3f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:08.717196 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e9efd2-f2de-43de-bb9e-7089945dd3f7 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:08.726061 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e817a939-dc47-4292-8f22-7b348aa72e80 tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:08.729962 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2699ac8d-ce1a-428e-b847-9e14c3802b66 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7f2db148c8e4d5d81431cae3576434b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:08.730733 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2699ac8d-ce1a-428e-b847-9e14c3802b66 service glance] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:08.731020 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2699ac8d-ce1a-428e-b847-9e14c3802b66 service glance] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:08.731295 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2699ac8d-ce1a-428e-b847-9e14c3802b66 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:08.738236 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2997/6016] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:34:08 2022] POST /identity/v3/users => generated 290 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:34:08.739741 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e9efd2-f2de-43de-bb9e-7089945dd3f7 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:08.740843 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2699ac8d-ce1a-428e-b847-9e14c3802b66 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:08.742583 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2699ac8d-ce1a-428e-b847-9e14c3802b66 service glance] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:08.751964 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e9efd2-f2de-43de-bb9e-7089945dd3f7 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:08.752286 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3020/6017] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:34:08 2022] GET /identity/v3/auth/tokens => generated 3519 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 23 21:34:08.753129 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2699ac8d-ce1a-428e-b847-9e14c3802b66 service glance] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:08.757215 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e88ae6-660b-4bc5-8f10-94478c19f969 tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fc17b0c69fd4e059e1de02356899ae5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f83eca4118fa4866959f771b4e87f0fb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:08.758195 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e88ae6-660b-4bc5-8f10-94478c19f969 tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:08.758535 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e88ae6-660b-4bc5-8f10-94478c19f969 tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:08.758890 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e88ae6-660b-4bc5-8f10-94478c19f969 tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/3a8f2ebc36c947479164cfbb014e8911` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:08.759616 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e88ae6-660b-4bc5-8f10-94478c19f969 tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=3a8f2ebc36c947479164cfbb014e8911)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:08.761294 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e88ae6-660b-4bc5-8f10-94478c19f969 tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:08.764289 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2699ac8d-ce1a-428e-b847-9e14c3802b66 service glance] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:08.768874 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885bfd7b-6820-4fb2-b254-46a764a91ab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:08.769525 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885bfd7b-6820-4fb2-b254-46a764a91ab3 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:08.769801 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885bfd7b-6820-4fb2-b254-46a764a91ab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:08.770110 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885bfd7b-6820-4fb2-b254-46a764a91ab3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:08.770818 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885bfd7b-6820-4fb2-b254-46a764a91ab3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:08.772468 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885bfd7b-6820-4fb2-b254-46a764a91ab3 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:08.775659 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-b4e88ae6-660b-4bc5-8f10-94478c19f969 tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] Could not find Endpoint Group: 3a8f2ebc36c947479164cfbb014e8911.: keystone.exception.EndpointGroupNotFound: Could not find Endpoint Group: 3a8f2ebc36c947479164cfbb014e8911. Jul 23 21:34:08.775659 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 21:34:08.775659 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 21:34:08.775659 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 21:34:08.775659 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 21:34:08.775659 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 21:34:08.775659 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 21:34:08.775659 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 21:34:08.775659 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 21:34:08.775659 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 21:34:08.775659 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 21:34:08.775659 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 21:34:08.775659 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_ep_filter.py", line 107, in delete Jul 23 21:34:08.775659 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return (PROVIDERS.catalog_api.delete_endpoint_group(endpoint_group_id), Jul 23 21:34:08.777028 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 519, in delete_endpoint_group Jul 23 21:34:08.777028 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application endpoint_group_ref = self._get_endpoint_group(session, Jul 23 21:34:08.777028 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 495, in _get_endpoint_group Jul 23 21:34:08.777028 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.EndpointGroupNotFound( Jul 23 21:34:08.777028 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.EndpointGroupNotFound: Could not find Endpoint Group: 3a8f2ebc36c947479164cfbb014e8911. Jul 23 21:34:08.777028 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 21:34:08.777028 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2998/6018] 10.222.0.17 () {58 vars in 1292 bytes} [Sat Jul 23 21:34:08 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/3a8f2ebc36c947479164cfbb014e8911 => generated 120 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 23 21:34:08.781040 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e88ae6-660b-4bc5-8f10-94478c19f969 tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:08.786952 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3021/6019] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:34:08 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:34:08.791550 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885bfd7b-6820-4fb2-b254-46a764a91ab3 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:08.793134 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e88ae6-660b-4bc5-8f10-94478c19f969 tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:08.801289 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd955c52-925e-45f3-a601-799f0df1f24d tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fc17b0c69fd4e059e1de02356899ae5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f83eca4118fa4866959f771b4e87f0fb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:08.801903 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd955c52-925e-45f3-a601-799f0df1f24d tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:08.802204 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd955c52-925e-45f3-a601-799f0df1f24d tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:08.802481 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd955c52-925e-45f3-a601-799f0df1f24d tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] PATH_INFO: `/v3/services/1b870ee4074e4f478a92c20956e57068` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:08.803221 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd955c52-925e-45f3-a601-799f0df1f24d tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] RBAC: Authorizing `identity:delete_service(service_id=1b870ee4074e4f478a92c20956e57068)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:08.804452 ncdv-master-1 devstack@keystone.service[91547]: WARNING py.warnings [None req-bd955c52-925e-45f3-a601-799f0df1f24d tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:34:08.804452 ncdv-master-1 devstack@keystone.service[91547]: warnings.warn(msg) Jul 23 21:34:08.804452 ncdv-master-1 devstack@keystone.service[91547]: Jul 23 21:34:08.805344 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd955c52-925e-45f3-a601-799f0df1f24d tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:08.806354 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885bfd7b-6820-4fb2-b254-46a764a91ab3 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:08.820912 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40815dfc-5d55-4163-8974-a0cee624f1a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:08.822830 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40815dfc-5d55-4163-8974-a0cee624f1a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:08.823029 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:08.823206 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40815dfc-5d55-4163-8974-a0cee624f1a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:08.823588 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40815dfc-5d55-4163-8974-a0cee624f1a8 admin admin] PATH_INFO: `/v3/projects/816984c605114e4680f81fb019e5229f/users/ce5b7c9a7e31401d8c04a24af809ed81/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:08.827464 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:08.840310 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 2999/6020] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:34:08 2022] DELETE /identity/v3/services/1b870ee4074e4f478a92c20956e57068 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:34:08.845635 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd955c52-925e-45f3-a601-799f0df1f24d tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:08.846769 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40815dfc-5d55-4163-8974-a0cee624f1a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=816984c605114e4680f81fb019e5229f, user_id=ce5b7c9a7e31401d8c04a24af809ed81, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:08.849227 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40815dfc-5d55-4163-8974-a0cee624f1a8 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:08.868076 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3022/6021] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:34:08 2022] PUT /identity/v3/projects/816984c605114e4680f81fb019e5229f/users/ce5b7c9a7e31401d8c04a24af809ed81/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:34:08.868971 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40815dfc-5d55-4163-8974-a0cee624f1a8 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:08.870318 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd955c52-925e-45f3-a601-799f0df1f24d tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:08.927423 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f10e1ad-228b-4589-b8b2-5e9f7957d59d tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fc17b0c69fd4e059e1de02356899ae5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f83eca4118fa4866959f771b4e87f0fb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:08.928179 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f10e1ad-228b-4589-b8b2-5e9f7957d59d tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:08.928610 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f10e1ad-228b-4589-b8b2-5e9f7957d59d tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:08.928900 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f10e1ad-228b-4589-b8b2-5e9f7957d59d tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] PATH_INFO: `/v3/services` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:08.929782 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f10e1ad-228b-4589-b8b2-5e9f7957d59d tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:08.930840 ncdv-master-1 devstack@keystone.service[91547]: WARNING py.warnings [None req-4f10e1ad-228b-4589-b8b2-5e9f7957d59d tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:34:08.930840 ncdv-master-1 devstack@keystone.service[91547]: warnings.warn(msg) Jul 23 21:34:08.930840 ncdv-master-1 devstack@keystone.service[91547]: Jul 23 21:34:08.931788 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f10e1ad-228b-4589-b8b2-5e9f7957d59d tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:08.934143 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40815dfc-5d55-4163-8974-a0cee624f1a8 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:08.947238 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3000/6022] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:34:08 2022] POST /identity/v3/services => generated 288 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:34:08.948595 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef94b87-8ec7-4bc3-b139-189950d2791e None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:08.949004 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef94b87-8ec7-4bc3-b139-189950d2791e None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:08.949756 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef94b87-8ec7-4bc3-b139-189950d2791e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:08.953091 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fdb30c-9275-4bfe-8019-3bb3bb0e102b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:08.953769 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fdb30c-9275-4bfe-8019-3bb3bb0e102b admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:08.954088 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fdb30c-9275-4bfe-8019-3bb3bb0e102b admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:08.954363 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fdb30c-9275-4bfe-8019-3bb3bb0e102b admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:08.955086 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fdb30c-9275-4bfe-8019-3bb3bb0e102b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:08.956735 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fdb30c-9275-4bfe-8019-3bb3bb0e102b admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:08.970050 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3023/6023] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:34:08 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:34:08.970050 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fdb30c-9275-4bfe-8019-3bb3bb0e102b admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:08.978608 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fdb30c-9275-4bfe-8019-3bb3bb0e102b admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:08.994333 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53489d57-81ed-4998-95ff-fabbbbfeb53d tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fc17b0c69fd4e059e1de02356899ae5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f83eca4118fa4866959f771b4e87f0fb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:08.995207 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53489d57-81ed-4998-95ff-fabbbbfeb53d tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:08.995653 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53489d57-81ed-4998-95ff-fabbbbfeb53d tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:08.996027 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53489d57-81ed-4998-95ff-fabbbbfeb53d tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:08.996834 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53489d57-81ed-4998-95ff-fabbbbfeb53d tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:08.997835 ncdv-master-1 devstack@keystone.service[91548]: WARNING py.warnings [None req-53489d57-81ed-4998-95ff-fabbbbfeb53d tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:34:08.997835 ncdv-master-1 devstack@keystone.service[91548]: warnings.warn(msg) Jul 23 21:34:08.997835 ncdv-master-1 devstack@keystone.service[91548]: Jul 23 21:34:08.998730 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53489d57-81ed-4998-95ff-fabbbbfeb53d tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:09.003223 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-1ef94b87-8ec7-4bc3-b139-189950d2791e None None] MFA Rules not processed for user `17b779a3e21a415bb42cde5d6863d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:34:09.004735 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-1ef94b87-8ec7-4bc3-b139-189950d2791e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:09.011862 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3024/6024] 10.222.0.17 () {60 vars in 1212 bytes} [Sat Jul 23 21:34:08 2022] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 334 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:34:09.011862 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53489d57-81ed-4998-95ff-fabbbbfeb53d tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:09.036338 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53489d57-81ed-4998-95ff-fabbbbfeb53d tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:09.041251 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899283a6-a0bb-4f7d-aee4-5605ff170338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:09.042180 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899283a6-a0bb-4f7d-aee4-5605ff170338 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:09.042451 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899283a6-a0bb-4f7d-aee4-5605ff170338 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:09.042721 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899283a6-a0bb-4f7d-aee4-5605ff170338 admin admin] PATH_INFO: `/v3/projects/816984c605114e4680f81fb019e5229f/users/ce5b7c9a7e31401d8c04a24af809ed81/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:09.044716 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899283a6-a0bb-4f7d-aee4-5605ff170338 admin admin] RBAC: Authorizing `identity:create_grant(project_id=816984c605114e4680f81fb019e5229f, user_id=ce5b7c9a7e31401d8c04a24af809ed81, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:09.047520 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899283a6-a0bb-4f7d-aee4-5605ff170338 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:09.059931 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3025/6025] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:34:09 2022] PUT /identity/v3/projects/816984c605114e4680f81fb019e5229f/users/ce5b7c9a7e31401d8c04a24af809ed81/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:09.061146 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899283a6-a0bb-4f7d-aee4-5605ff170338 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:09.091754 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3001/6026] 10.222.0.17 () {58 vars in 1009 bytes} [Sat Jul 23 21:34:08 2022] POST /identity/v3/auth/tokens => generated 3452 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:34:09.093971 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de8c1b5-93bb-43da-90ed-dc18f9688eda None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:09.094277 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de8c1b5-93bb-43da-90ed-dc18f9688eda None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:09.094559 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de8c1b5-93bb-43da-90ed-dc18f9688eda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:09.123154 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-9de8c1b5-93bb-43da-90ed-dc18f9688eda None None] MFA Rules not processed for user `ce5b7c9a7e31401d8c04a24af809ed81`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:34:09.124384 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-9de8c1b5-93bb-43da-90ed-dc18f9688eda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:09.144774 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899283a6-a0bb-4f7d-aee4-5605ff170338 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:09.153634 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9c4310-f02d-47be-92d2-bfa83395049e tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fc17b0c69fd4e059e1de02356899ae5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f83eca4118fa4866959f771b4e87f0fb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:09.154360 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9c4310-f02d-47be-92d2-bfa83395049e tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:09.154641 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9c4310-f02d-47be-92d2-bfa83395049e tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:09.154911 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9c4310-f02d-47be-92d2-bfa83395049e tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] PATH_INFO: `/v3/services` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:09.155842 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9c4310-f02d-47be-92d2-bfa83395049e tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:09.157474 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9c4310-f02d-47be-92d2-bfa83395049e tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:09.169685 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:09.175006 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3026/6027] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:34:09 2022] POST /identity/v3/services => generated 287 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:34:09.175006 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9c4310-f02d-47be-92d2-bfa83395049e tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:09.175006 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-9d9c4310-f02d-47be-92d2-bfa83395049e tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:09.197294 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3002/6028] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:34:09 2022] POST /identity/v3/auth/tokens => generated 3701 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:34:09.198139 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de8c1b5-93bb-43da-90ed-dc18f9688eda None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:09.205902 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:09.217342 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de8c1b5-93bb-43da-90ed-dc18f9688eda None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:09.222017 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a42c77-fcb2-45bb-95be-2d2adc30d0aa tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fc17b0c69fd4e059e1de02356899ae5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f83eca4118fa4866959f771b4e87f0fb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:09.222864 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a42c77-fcb2-45bb-95be-2d2adc30d0aa tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:09.223144 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a42c77-fcb2-45bb-95be-2d2adc30d0aa tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:09.223424 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a42c77-fcb2-45bb-95be-2d2adc30d0aa tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/bd806ac03c20499586dc1ae8048277f0` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:09.224148 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a42c77-fcb2-45bb-95be-2d2adc30d0aa tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] RBAC: Authorizing `identity:update_endpoint_group(endpoint_group_id=bd806ac03c20499586dc1ae8048277f0)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:09.225645 ncdv-master-1 devstack@keystone.service[91547]: WARNING py.warnings [None req-58a42c77-fcb2-45bb-95be-2d2adc30d0aa tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:34:09.225645 ncdv-master-1 devstack@keystone.service[91547]: warnings.warn(msg) Jul 23 21:34:09.225645 ncdv-master-1 devstack@keystone.service[91547]: Jul 23 21:34:09.226558 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a42c77-fcb2-45bb-95be-2d2adc30d0aa tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:09.237626 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3003/6029] 10.222.0.17 () {60 vars in 1312 bytes} [Sat Jul 23 21:34:09 2022] PATCH /identity/v3/OS-EP-FILTER/endpoint_groups/bd806ac03c20499586dc1ae8048277f0 => generated 336 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:34:09.238324 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a42c77-fcb2-45bb-95be-2d2adc30d0aa tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:09.248925 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a42c77-fcb2-45bb-95be-2d2adc30d0aa tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:09.253660 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dceda5-c4ec-4957-b082-755bdeeaa679 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce5b7c9a7e31401d8c04a24af809ed81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '816984c605114e4680f81fb019e5229f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:09.254344 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dceda5-c4ec-4957-b082-755bdeeaa679 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:09.254635 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dceda5-c4ec-4957-b082-755bdeeaa679 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:09.254914 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dceda5-c4ec-4957-b082-755bdeeaa679 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:09.255634 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dceda5-c4ec-4957-b082-755bdeeaa679 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:09.257304 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dceda5-c4ec-4957-b082-755bdeeaa679 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:09.271025 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3004/6030] 10.222.0.17 () {60 vars in 1142 bytes} [Sat Jul 23 21:34:09 2022] POST /identity/v3/roles => generated 234 bytes in 33 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:34:09.271456 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9c4310-f02d-47be-92d2-bfa83395049e tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:09.271849 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dceda5-c4ec-4957-b082-755bdeeaa679 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:09.277071 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe254e5-924a-43df-b818-3382202d2f07 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f0a685b7da46afb81024848f079d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:09.277734 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe254e5-924a-43df-b818-3382202d2f07 service swift] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:09.278054 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe254e5-924a-43df-b818-3382202d2f07 service swift] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:09.278334 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe254e5-924a-43df-b818-3382202d2f07 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:09.282010 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dceda5-c4ec-4957-b082-755bdeeaa679 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:09.286808 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2975dd-e6f3-4ad3-ae75-94afdc336a7d tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fc17b0c69fd4e059e1de02356899ae5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f83eca4118fa4866959f771b4e87f0fb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:09.287723 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2975dd-e6f3-4ad3-ae75-94afdc336a7d tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:09.288000 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2975dd-e6f3-4ad3-ae75-94afdc336a7d tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:09.288266 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2975dd-e6f3-4ad3-ae75-94afdc336a7d tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] PATH_INFO: `/v3/services/de7b8c1f376741d4a1f1a91acc275b21` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:09.288903 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2975dd-e6f3-4ad3-ae75-94afdc336a7d tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] RBAC: Authorizing `identity:delete_service(service_id=de7b8c1f376741d4a1f1a91acc275b21)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:09.290512 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2975dd-e6f3-4ad3-ae75-94afdc336a7d tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:09.312970 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3005/6031] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:34:09 2022] DELETE /identity/v3/services/de7b8c1f376741d4a1f1a91acc275b21 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:09.313951 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2975dd-e6f3-4ad3-ae75-94afdc336a7d tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:09.334754 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2975dd-e6f3-4ad3-ae75-94afdc336a7d tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:09.339541 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464aad94-660d-4594-93a8-b768c9cf6582 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce5b7c9a7e31401d8c04a24af809ed81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '816984c605114e4680f81fb019e5229f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:09.340136 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe254e5-924a-43df-b818-3382202d2f07 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:09.340585 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464aad94-660d-4594-93a8-b768c9cf6582 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:09.340585 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464aad94-660d-4594-93a8-b768c9cf6582 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:09.340787 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464aad94-660d-4594-93a8-b768c9cf6582 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:09.341447 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464aad94-660d-4594-93a8-b768c9cf6582 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:09.341740 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe254e5-924a-43df-b818-3382202d2f07 service swift] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:09.343192 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464aad94-660d-4594-93a8-b768c9cf6582 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:09.351460 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3027/6032] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 23 21:34:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 23 21:34:09.352398 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe254e5-924a-43df-b818-3382202d2f07 service swift] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:09.363125 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3006/6033] 10.222.0.17 () {60 vars in 1142 bytes} [Sat Jul 23 21:34:09 2022] POST /identity/v3/roles => generated 234 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:34:09.363294 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe254e5-924a-43df-b818-3382202d2f07 service swift] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:09.364344 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464aad94-660d-4594-93a8-b768c9cf6582 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:09.375673 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464aad94-660d-4594-93a8-b768c9cf6582 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:09.380562 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0839b940-8a82-4413-9cf3-62d3c03be3b5 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce5b7c9a7e31401d8c04a24af809ed81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '816984c605114e4680f81fb019e5229f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:09.381279 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0839b940-8a82-4413-9cf3-62d3c03be3b5 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:09.381568 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0839b940-8a82-4413-9cf3-62d3c03be3b5 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:09.381846 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0839b940-8a82-4413-9cf3-62d3c03be3b5 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:09.382762 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0839b940-8a82-4413-9cf3-62d3c03be3b5 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:09.384378 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0839b940-8a82-4413-9cf3-62d3c03be3b5 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:09.387164 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84db1ec-bc8f-44f3-9808-4d747a4cdb1f tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fc17b0c69fd4e059e1de02356899ae5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f83eca4118fa4866959f771b4e87f0fb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:09.388041 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84db1ec-bc8f-44f3-9808-4d747a4cdb1f tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:09.388423 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84db1ec-bc8f-44f3-9808-4d747a4cdb1f tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:09.388595 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84db1ec-bc8f-44f3-9808-4d747a4cdb1f tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/bd806ac03c20499586dc1ae8048277f0` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:09.389444 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84db1ec-bc8f-44f3-9808-4d747a4cdb1f tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=bd806ac03c20499586dc1ae8048277f0)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:09.390472 ncdv-master-1 devstack@keystone.service[91548]: WARNING py.warnings [None req-d84db1ec-bc8f-44f3-9808-4d747a4cdb1f tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:34:09.390472 ncdv-master-1 devstack@keystone.service[91548]: warnings.warn(msg) Jul 23 21:34:09.390472 ncdv-master-1 devstack@keystone.service[91548]: Jul 23 21:34:09.391356 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84db1ec-bc8f-44f3-9808-4d747a4cdb1f tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:09.404648 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3007/6034] 10.222.0.17 () {60 vars in 1142 bytes} [Sat Jul 23 21:34:09 2022] POST /identity/v3/roles => generated 234 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:34:09.405039 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3028/6035] 10.222.0.17 () {58 vars in 1292 bytes} [Sat Jul 23 21:34:09 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/bd806ac03c20499586dc1ae8048277f0 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:09.405767 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0839b940-8a82-4413-9cf3-62d3c03be3b5 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:09.408711 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84db1ec-bc8f-44f3-9808-4d747a4cdb1f tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:09.417027 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0839b940-8a82-4413-9cf3-62d3c03be3b5 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:09.418858 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84db1ec-bc8f-44f3-9808-4d747a4cdb1f tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:09.421847 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d9c19f-00dc-4034-861e-b838cfd66800 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce5b7c9a7e31401d8c04a24af809ed81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '816984c605114e4680f81fb019e5229f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:09.422546 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d9c19f-00dc-4034-861e-b838cfd66800 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:09.422833 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d9c19f-00dc-4034-861e-b838cfd66800 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:09.423172 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d9c19f-00dc-4034-861e-b838cfd66800 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:09.423644 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad77462-dc26-485a-a41a-030e7a352112 tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fc17b0c69fd4e059e1de02356899ae5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f83eca4118fa4866959f771b4e87f0fb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:09.424209 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d9c19f-00dc-4034-861e-b838cfd66800 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:09.424500 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad77462-dc26-485a-a41a-030e7a352112 tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:09.424781 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad77462-dc26-485a-a41a-030e7a352112 tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:09.425054 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad77462-dc26-485a-a41a-030e7a352112 tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] PATH_INFO: `/v3/services/ef26792fae504c6b85db6a2f8a2d3278` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:09.425702 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad77462-dc26-485a-a41a-030e7a352112 tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] RBAC: Authorizing `identity:delete_service(service_id=ef26792fae504c6b85db6a2f8a2d3278)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:09.425837 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d9c19f-00dc-4034-861e-b838cfd66800 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:09.426723 ncdv-master-1 devstack@keystone.service[91548]: WARNING py.warnings [None req-fad77462-dc26-485a-a41a-030e7a352112 tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:34:09.426723 ncdv-master-1 devstack@keystone.service[91548]: warnings.warn(msg) Jul 23 21:34:09.426723 ncdv-master-1 devstack@keystone.service[91548]: Jul 23 21:34:09.427598 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad77462-dc26-485a-a41a-030e7a352112 tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:09.444201 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3008/6036] 10.222.0.17 () {60 vars in 1148 bytes} [Sat Jul 23 21:34:09 2022] POST /identity/v3/domains => generated 277 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:34:09.448797 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d9c19f-00dc-4034-861e-b838cfd66800 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:09.460445 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3029/6037] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:34:09 2022] DELETE /identity/v3/services/ef26792fae504c6b85db6a2f8a2d3278 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:34:09.466015 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad77462-dc26-485a-a41a-030e7a352112 tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:09.492371 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad77462-dc26-485a-a41a-030e7a352112 tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:09.520407 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d9c19f-00dc-4034-861e-b838cfd66800 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:09.538696 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db96c479-0b63-4c80-abc1-311f6fcf5264 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce5b7c9a7e31401d8c04a24af809ed81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '816984c605114e4680f81fb019e5229f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:09.539535 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db96c479-0b63-4c80-abc1-311f6fcf5264 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:09.539870 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db96c479-0b63-4c80-abc1-311f6fcf5264 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:09.540150 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db96c479-0b63-4c80-abc1-311f6fcf5264 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:09.541154 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db96c479-0b63-4c80-abc1-311f6fcf5264 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:09.543184 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db96c479-0b63-4c80-abc1-311f6fcf5264 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:09.554410 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:09.575868 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab68b94-f7a6-4864-ae2c-9084b0fd607c tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fc17b0c69fd4e059e1de02356899ae5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f83eca4118fa4866959f771b4e87f0fb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:09.576860 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab68b94-f7a6-4864-ae2c-9084b0fd607c tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:09.577197 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab68b94-f7a6-4864-ae2c-9084b0fd607c tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:09.577725 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab68b94-f7a6-4864-ae2c-9084b0fd607c tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/d23715ac990447bebd2e3c2bca913866` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:09.578470 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab68b94-f7a6-4864-ae2c-9084b0fd607c tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=d23715ac990447bebd2e3c2bca913866)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:09.580195 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab68b94-f7a6-4864-ae2c-9084b0fd607c tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:09.583563 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=92,keystone:UPDATE=1,keystone:INSERT=5,keystone:DELETE=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:09.595767 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3030/6039] 10.222.0.17 () {58 vars in 1292 bytes} [Sat Jul 23 21:34:09 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/d23715ac990447bebd2e3c2bca913866 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:34:09.596447 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab68b94-f7a6-4864-ae2c-9084b0fd607c tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:09.598544 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3009/6039] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:34:09 2022] POST /identity/v3/projects => generated 401 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:34:09.600970 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db96c479-0b63-4c80-abc1-311f6fcf5264 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:09.609224 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab68b94-f7a6-4864-ae2c-9084b0fd607c tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:09.677135 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db96c479-0b63-4c80-abc1-311f6fcf5264 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:09.683171 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb4431f-777e-4632-a793-bebbe5414929 tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fc17b0c69fd4e059e1de02356899ae5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f83eca4118fa4866959f771b4e87f0fb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:09.684426 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb4431f-777e-4632-a793-bebbe5414929 tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:09.684774 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb4431f-777e-4632-a793-bebbe5414929 tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:09.685055 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb4431f-777e-4632-a793-bebbe5414929 tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] PATH_INFO: `/v3/services/0dfc73bf40264d4aa6ccb45e4392069a` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:09.685854 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb4431f-777e-4632-a793-bebbe5414929 tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] RBAC: Authorizing `identity:delete_service(service_id=0dfc73bf40264d4aa6ccb45e4392069a)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:09.687627 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb4431f-777e-4632-a793-bebbe5414929 tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:09.690191 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d821d2ba-967f-4b1e-946e-a7cbcd7115c1 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce5b7c9a7e31401d8c04a24af809ed81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '816984c605114e4680f81fb019e5229f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:09.690668 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d821d2ba-967f-4b1e-946e-a7cbcd7115c1 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:09.690948 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d821d2ba-967f-4b1e-946e-a7cbcd7115c1 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:09.691225 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d821d2ba-967f-4b1e-946e-a7cbcd7115c1 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] PATH_INFO: `/v3/groups` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:09.692156 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d821d2ba-967f-4b1e-946e-a7cbcd7115c1 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:09.694288 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d821d2ba-967f-4b1e-946e-a7cbcd7115c1 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:09.716899 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3031/6040] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:34:09 2022] POST /identity/v3/groups => generated 301 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:34:09.720685 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d821d2ba-967f-4b1e-946e-a7cbcd7115c1 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:09.723122 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3010/6041] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:34:09 2022] DELETE /identity/v3/services/0dfc73bf40264d4aa6ccb45e4392069a => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:09.728452 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb4431f-777e-4632-a793-bebbe5414929 tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:09.732134 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-2bb4431f-777e-4632-a793-bebbe5414929 tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:09.733322 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d821d2ba-967f-4b1e-946e-a7cbcd7115c1 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:09.756120 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98610fd2-7fad-4b39-b3b2-58aa413f5171 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce5b7c9a7e31401d8c04a24af809ed81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '816984c605114e4680f81fb019e5229f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:09.756895 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98610fd2-7fad-4b39-b3b2-58aa413f5171 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:09.757363 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98610fd2-7fad-4b39-b3b2-58aa413f5171 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:09.757723 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98610fd2-7fad-4b39-b3b2-58aa413f5171 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:09.758604 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98610fd2-7fad-4b39-b3b2-58aa413f5171 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:09.760388 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98610fd2-7fad-4b39-b3b2-58aa413f5171 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:09.777914 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3032/6042] 10.222.0.17 () {60 vars in 1142 bytes} [Sat Jul 23 21:34:09 2022] POST /identity/v3/roles => generated 235 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:34:09.780255 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba6e1c4-e3d2-411b-b6bf-0e6d2a377a54 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:09.780563 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba6e1c4-e3d2-411b-b6bf-0e6d2a377a54 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:09.781511 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba6e1c4-e3d2-411b-b6bf-0e6d2a377a54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:09.801901 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-8ba6e1c4-e3d2-411b-b6bf-0e6d2a377a54 None None] MFA Rules not processed for user `17b779a3e21a415bb42cde5d6863d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:34:09.803288 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-8ba6e1c4-e3d2-411b-b6bf-0e6d2a377a54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:09.834166 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb4431f-777e-4632-a793-bebbe5414929 tempest-EndPointGroupsTest-1474075388 tempest-EndPointGroupsTest-1474075388-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:09.839083 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a027d0c-97ec-4a40-8d38-2fe26513cd17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:09.839970 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a027d0c-97ec-4a40-8d38-2fe26513cd17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:09.840244 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a027d0c-97ec-4a40-8d38-2fe26513cd17 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:09.840512 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a027d0c-97ec-4a40-8d38-2fe26513cd17 admin admin] PATH_INFO: `/v3/users/a1a0b60fd50447f486bc7b3cc9df5208` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:09.841693 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a027d0c-97ec-4a40-8d38-2fe26513cd17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1a0b60fd50447f486bc7b3cc9df5208)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:09.843667 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a027d0c-97ec-4a40-8d38-2fe26513cd17 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:09.878735 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3033/6043] 10.222.0.17 () {58 vars in 1009 bytes} [Sat Jul 23 21:34:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:34:09.879574 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba6e1c4-e3d2-411b-b6bf-0e6d2a377a54 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:09.891563 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-0a027d0c-97ec-4a40-8d38-2fe26513cd17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1a0b60fd50447f486bc7b3cc9df5208'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:09.893453 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba6e1c4-e3d2-411b-b6bf-0e6d2a377a54 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:09.898433 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d7fad0-0a2b-489e-b435-322ff7b3dd7c tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce5b7c9a7e31401d8c04a24af809ed81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '816984c605114e4680f81fb019e5229f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:09.898758 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-0a027d0c-97ec-4a40-8d38-2fe26513cd17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1a0b60fd50447f486bc7b3cc9df5208'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:09.899118 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d7fad0-0a2b-489e-b435-322ff7b3dd7c tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:09.899402 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d7fad0-0a2b-489e-b435-322ff7b3dd7c tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:09.899628 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-0a027d0c-97ec-4a40-8d38-2fe26513cd17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1a0b60fd50447f486bc7b3cc9df5208'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:09.899773 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d7fad0-0a2b-489e-b435-322ff7b3dd7c tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:09.900566 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d7fad0-0a2b-489e-b435-322ff7b3dd7c tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:09.903010 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d7fad0-0a2b-489e-b435-322ff7b3dd7c tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:09.907901 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-0a027d0c-97ec-4a40-8d38-2fe26513cd17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1a0b60fd50447f486bc7b3cc9df5208'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:09.919313 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:09.921940 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-0a027d0c-97ec-4a40-8d38-2fe26513cd17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1a0b60fd50447f486bc7b3cc9df5208'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:09.924835 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3034/6044] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:34:09 2022] POST /identity/v3/users => generated 439 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:34:09.925725 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d7fad0-0a2b-489e-b435-322ff7b3dd7c tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:09.927818 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-94d7fad0-0a2b-489e-b435-322ff7b3dd7c tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:09.929826 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3011/6045] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:34:09 2022] DELETE /identity/v3/users/a1a0b60fd50447f486bc7b3cc9df5208 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:09.931236 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a027d0c-97ec-4a40-8d38-2fe26513cd17 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:09.932780 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-0a027d0c-97ec-4a40-8d38-2fe26513cd17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:09.971877 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=93,keystone:DELETE=2,keystone:INSERT=5 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:09.998597 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a027d0c-97ec-4a40-8d38-2fe26513cd17 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:10.003288 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236efa9d-4e39-449c-9989-771a728225a4 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce5b7c9a7e31401d8c04a24af809ed81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '816984c605114e4680f81fb019e5229f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:10.003964 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236efa9d-4e39-449c-9989-771a728225a4 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:10.004245 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236efa9d-4e39-449c-9989-771a728225a4 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:10.004517 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236efa9d-4e39-449c-9989-771a728225a4 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:10.005299 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236efa9d-4e39-449c-9989-771a728225a4 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:10.006401 ncdv-master-1 devstack@keystone.service[91547]: WARNING py.warnings [None req-236efa9d-4e39-449c-9989-771a728225a4 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:34:10.006401 ncdv-master-1 devstack@keystone.service[91547]: warnings.warn(msg) Jul 23 21:34:10.006401 ncdv-master-1 devstack@keystone.service[91547]: Jul 23 21:34:10.007283 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236efa9d-4e39-449c-9989-771a728225a4 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:10.013362 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d7fad0-0a2b-489e-b435-322ff7b3dd7c tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:10.033900 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3012/6046] 10.222.0.17 () {60 vars in 1142 bytes} [Sat Jul 23 21:34:09 2022] POST /identity/v3/roles => generated 269 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:34:10.033900 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87fc130-02d9-466b-99b4-d402282aafd5 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:10.033900 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87fc130-02d9-466b-99b4-d402282aafd5 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:10.033900 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87fc130-02d9-466b-99b4-d402282aafd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:10.045302 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-b87fc130-02d9-466b-99b4-d402282aafd5 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:34:10.046923 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-b87fc130-02d9-466b-99b4-d402282aafd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:10.085255 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a35b70-5fc7-47f7-9a18-80f298b2575a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f0a685b7da46afb81024848f079d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:10.086100 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a35b70-5fc7-47f7-9a18-80f298b2575a service swift] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:10.086446 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a35b70-5fc7-47f7-9a18-80f298b2575a service swift] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:10.086860 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a35b70-5fc7-47f7-9a18-80f298b2575a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:10.090075 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-e1a35b70-5fc7-47f7-9a18-80f298b2575a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:10.123324 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3013/6047] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:34:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:34:10.123324 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87fc130-02d9-466b-99b4-d402282aafd5 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:10.133135 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87fc130-02d9-466b-99b4-d402282aafd5 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:10.139506 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4596f896-4654-4918-ab92-cfd1523d4c3b tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce5b7c9a7e31401d8c04a24af809ed81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '816984c605114e4680f81fb019e5229f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:10.140773 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4596f896-4654-4918-ab92-cfd1523d4c3b tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:10.141352 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4596f896-4654-4918-ab92-cfd1523d4c3b tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:10.141964 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4596f896-4654-4918-ab92-cfd1523d4c3b tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] PATH_INFO: `/v3/projects/359def4ccd9e4902b9bb28c95fc66cbc/users/c65996abac84448da544ada89ddeef1f/roles/fcf9321121454a53b2c662fa830dbd4c` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:10.160528 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4596f896-4654-4918-ab92-cfd1523d4c3b tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorizing `identity:create_grant(project_id=359def4ccd9e4902b9bb28c95fc66cbc, user_id=c65996abac84448da544ada89ddeef1f, role_id=fcf9321121454a53b2c662fa830dbd4c)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:10.161152 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a35b70-5fc7-47f7-9a18-80f298b2575a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:10.162818 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a35b70-5fc7-47f7-9a18-80f298b2575a service swift] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:10.163978 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4596f896-4654-4918-ab92-cfd1523d4c3b tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:10.172059 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3035/6048] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 23 21:34:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 23 21:34:10.172736 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a35b70-5fc7-47f7-9a18-80f298b2575a service swift] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:10.174427 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-e1a35b70-5fc7-47f7-9a18-80f298b2575a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:10.187601 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3014/6049] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:34:10 2022] PUT /identity/v3/projects/359def4ccd9e4902b9bb28c95fc66cbc/users/c65996abac84448da544ada89ddeef1f/roles/fcf9321121454a53b2c662fa830dbd4c => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:10.202941 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4596f896-4654-4918-ab92-cfd1523d4c3b tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:10.269116 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a35b70-5fc7-47f7-9a18-80f298b2575a service swift] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:10.282124 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4596f896-4654-4918-ab92-cfd1523d4c3b tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:10.287066 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ac19e6-68bc-4f4a-9bd6-05a44408e758 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce5b7c9a7e31401d8c04a24af809ed81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '816984c605114e4680f81fb019e5229f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:10.287878 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ac19e6-68bc-4f4a-9bd6-05a44408e758 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:10.288223 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ac19e6-68bc-4f4a-9bd6-05a44408e758 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:10.288561 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ac19e6-68bc-4f4a-9bd6-05a44408e758 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:10.289453 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ac19e6-68bc-4f4a-9bd6-05a44408e758 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Adding query filter params (scope.project.id=359def4ccd9e4902b9bb28c95fc66cbc, user.id=c65996abac84448da544ada89ddeef1f) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:34:10.289823 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ac19e6-68bc-4f4a-9bd6-05a44408e758 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:10.290994 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:10.291930 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ac19e6-68bc-4f4a-9bd6-05a44408e758 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:10.299577 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:DELETE=1,keystone:SELECT=97,keystone:INSERT=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:10.332718 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ced359-ae99-4ed6-afe5-f09545a86dd2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:10.333535 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ced359-ae99-4ed6-afe5-f09545a86dd2 service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:10.333817 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ced359-ae99-4ed6-afe5-f09545a86dd2 service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:10.334191 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ced359-ae99-4ed6-afe5-f09545a86dd2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:10.353054 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3015/6050] 10.222.0.17 () {58 vars in 1355 bytes} [Sat Jul 23 21:34:10 2022] GET /identity/v3/role_assignments?scope.project.id=359def4ccd9e4902b9bb28c95fc66cbc&user.id=c65996abac84448da544ada89ddeef1f&effective => generated 228 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:34:10.357888 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ac19e6-68bc-4f4a-9bd6-05a44408e758 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:10.371860 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ac19e6-68bc-4f4a-9bd6-05a44408e758 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:10.379383 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0fc597-9773-4fb7-be3b-564b79c062ab tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce5b7c9a7e31401d8c04a24af809ed81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '816984c605114e4680f81fb019e5229f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:10.380294 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0fc597-9773-4fb7-be3b-564b79c062ab tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:10.380579 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0fc597-9773-4fb7-be3b-564b79c062ab tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:10.380969 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0fc597-9773-4fb7-be3b-564b79c062ab tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] PATH_INFO: `/v3/projects/359def4ccd9e4902b9bb28c95fc66cbc/users/c65996abac84448da544ada89ddeef1f/roles/fcf9321121454a53b2c662fa830dbd4c` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:10.383291 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0fc597-9773-4fb7-be3b-564b79c062ab tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=359def4ccd9e4902b9bb28c95fc66cbc, user_id=c65996abac84448da544ada89ddeef1f, role_id=fcf9321121454a53b2c662fa830dbd4c)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:10.385983 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0fc597-9773-4fb7-be3b-564b79c062ab tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:10.391610 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-3f0fc597-9773-4fb7-be3b-564b79c062ab tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Invalidating the token cache because role fcf9321121454a53b2c662fa830dbd4c was removed from user c65996abac84448da544ada89ddeef1f on project 359def4ccd9e4902b9bb28c95fc66cbc. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:34:10.392096 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-3f0fc597-9773-4fb7-be3b-564b79c062ab tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:10.392698 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-3f0fc597-9773-4fb7-be3b-564b79c062ab tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:10.408592 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ced359-ae99-4ed6-afe5-f09545a86dd2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:10.410244 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ced359-ae99-4ed6-afe5-f09545a86dd2 service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:10.412808 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3016/6051] 10.222.0.17 () {58 vars in 1466 bytes} [Sat Jul 23 21:34:10 2022] DELETE /identity/v3/projects/359def4ccd9e4902b9bb28c95fc66cbc/users/c65996abac84448da544ada89ddeef1f/roles/fcf9321121454a53b2c662fa830dbd4c => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:10.413991 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0fc597-9773-4fb7-be3b-564b79c062ab tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:10.420627 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3036/6052] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:34:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:34:10.423190 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-3f0fc597-9773-4fb7-be3b-564b79c062ab tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:10.508360 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0fc597-9773-4fb7-be3b-564b79c062ab tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:10.513291 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7602ca45-589c-415f-92d0-b5c5a2f2191b tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce5b7c9a7e31401d8c04a24af809ed81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '816984c605114e4680f81fb019e5229f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:10.514383 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7602ca45-589c-415f-92d0-b5c5a2f2191b tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:10.514505 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7602ca45-589c-415f-92d0-b5c5a2f2191b tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:10.514714 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7602ca45-589c-415f-92d0-b5c5a2f2191b tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] PATH_INFO: `/v3/roles/fcf9321121454a53b2c662fa830dbd4c` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:10.515946 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7602ca45-589c-415f-92d0-b5c5a2f2191b tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=fcf9321121454a53b2c662fa830dbd4c)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:10.516295 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5015bb-2288-4686-ae24-5df361312dd1 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:10.516677 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5015bb-2288-4686-ae24-5df361312dd1 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:10.516936 ncdv-master-1 devstack@keystone.service[91547]: WARNING py.warnings [None req-7602ca45-589c-415f-92d0-b5c5a2f2191b tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:34:10.516936 ncdv-master-1 devstack@keystone.service[91547]: warnings.warn(msg) Jul 23 21:34:10.516936 ncdv-master-1 devstack@keystone.service[91547]: Jul 23 21:34:10.517254 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5015bb-2288-4686-ae24-5df361312dd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:10.517816 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7602ca45-589c-415f-92d0-b5c5a2f2191b tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:10.538809 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-4d5015bb-2288-4686-ae24-5df361312dd1 None None] MFA Rules not processed for user `17b779a3e21a415bb42cde5d6863d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:34:10.540299 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-4d5015bb-2288-4686-ae24-5df361312dd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:10.558138 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-7602ca45-589c-415f-92d0-b5c5a2f2191b tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Invalidating the token cache because role fcf9321121454a53b2c662fa830dbd4c has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:34:10.558736 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-7602ca45-589c-415f-92d0-b5c5a2f2191b tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:10.559380 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-7602ca45-589c-415f-92d0-b5c5a2f2191b tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:10.562338 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3017/6053] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:34:10 2022] DELETE /identity/v3/roles/fcf9321121454a53b2c662fa830dbd4c => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:10.567967 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7602ca45-589c-415f-92d0-b5c5a2f2191b tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:10.569243 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-7602ca45-589c-415f-92d0-b5c5a2f2191b tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:10.615964 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3037/6054] 10.222.0.17 () {58 vars in 1009 bytes} [Sat Jul 23 21:34:10 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:34:10.632527 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5015bb-2288-4686-ae24-5df361312dd1 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:10.634190 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-4d5015bb-2288-4686-ae24-5df361312dd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:10.667040 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7602ca45-589c-415f-92d0-b5c5a2f2191b tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:10.671946 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a32204d-c482-4c92-baf6-41fe7217e8d8 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce5b7c9a7e31401d8c04a24af809ed81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '816984c605114e4680f81fb019e5229f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:10.672929 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a32204d-c482-4c92-baf6-41fe7217e8d8 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:10.673280 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a32204d-c482-4c92-baf6-41fe7217e8d8 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:10.673720 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a32204d-c482-4c92-baf6-41fe7217e8d8 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] PATH_INFO: `/v3/projects/359def4ccd9e4902b9bb28c95fc66cbc/users/c65996abac84448da544ada89ddeef1f/roles/c95110eb6beb4ed794fdbd9884cad174` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:10.676782 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a32204d-c482-4c92-baf6-41fe7217e8d8 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorizing `identity:create_grant(project_id=359def4ccd9e4902b9bb28c95fc66cbc, user_id=c65996abac84448da544ada89ddeef1f, role_id=c95110eb6beb4ed794fdbd9884cad174)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:10.679957 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a32204d-c482-4c92-baf6-41fe7217e8d8 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:10.696307 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3018/6055] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:34:10 2022] PUT /identity/v3/projects/359def4ccd9e4902b9bb28c95fc66cbc/users/c65996abac84448da544ada89ddeef1f/roles/c95110eb6beb4ed794fdbd9884cad174 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:10.700384 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a32204d-c482-4c92-baf6-41fe7217e8d8 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:10.706630 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:10.716663 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5015bb-2288-4686-ae24-5df361312dd1 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:10.733943 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:10.789568 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafcf939-863f-4b38-b862-5094b60c3785 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f0a685b7da46afb81024848f079d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:10.790524 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafcf939-863f-4b38-b862-5094b60c3785 service swift] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:10.790819 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafcf939-863f-4b38-b862-5094b60c3785 service swift] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:10.791089 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafcf939-863f-4b38-b862-5094b60c3785 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:10.793032 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a32204d-c482-4c92-baf6-41fe7217e8d8 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:10.798033 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeb8029-eeed-461f-812a-b947a6cb43c0 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce5b7c9a7e31401d8c04a24af809ed81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '816984c605114e4680f81fb019e5229f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:10.798906 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeb8029-eeed-461f-812a-b947a6cb43c0 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:10.799200 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeb8029-eeed-461f-812a-b947a6cb43c0 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:10.799470 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeb8029-eeed-461f-812a-b947a6cb43c0 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] PATH_INFO: `/v3/roles/c95110eb6beb4ed794fdbd9884cad174/implies/ba52c8c461774400a925c36f55ed56fb` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:10.801765 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abeb8029-eeed-461f-812a-b947a6cb43c0 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=c95110eb6beb4ed794fdbd9884cad174, implied_role_id=ba52c8c461774400a925c36f55ed56fb)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:10.804100 ncdv-master-1 devstack@keystone.service[91547]: WARNING py.warnings [None req-abeb8029-eeed-461f-812a-b947a6cb43c0 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:34:10.804100 ncdv-master-1 devstack@keystone.service[91547]: warnings.warn(msg) Jul 23 21:34:10.804100 ncdv-master-1 devstack@keystone.service[91547]: Jul 23 21:34:10.805016 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abeb8029-eeed-461f-812a-b947a6cb43c0 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:10.837758 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3019/6056] 10.222.0.17 () {60 vars in 1362 bytes} [Sat Jul 23 21:34:10 2022] PUT /identity/v3/roles/c95110eb6beb4ed794fdbd9884cad174/implies/ba52c8c461774400a925c36f55ed56fb => generated 519 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:34:10.838536 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeb8029-eeed-461f-812a-b947a6cb43c0 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:10.840571 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-abeb8029-eeed-461f-812a-b947a6cb43c0 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:10.857921 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafcf939-863f-4b38-b862-5094b60c3785 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:10.859519 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafcf939-863f-4b38-b862-5094b60c3785 service swift] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:10.867938 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3038/6057] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 23 21:34:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 23 21:34:10.868590 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafcf939-863f-4b38-b862-5094b60c3785 service swift] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:10.878299 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafcf939-863f-4b38-b862-5094b60c3785 service swift] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:10.912965 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeb8029-eeed-461f-812a-b947a6cb43c0 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:10.919091 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bab0369-f6f0-4827-b69f-457f645c82ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:10.920129 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bab0369-f6f0-4827-b69f-457f645c82ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:10.920481 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bab0369-f6f0-4827-b69f-457f645c82ce admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:10.920796 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bab0369-f6f0-4827-b69f-457f645c82ce admin admin] PATH_INFO: `/v3/projects/8e285c381e7d4f2fab088ae6cb19615c` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:10.922463 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bab0369-f6f0-4827-b69f-457f645c82ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e285c381e7d4f2fab088ae6cb19615c)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:10.924410 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bab0369-f6f0-4827-b69f-457f645c82ce admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:10.950290 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07fef4b-a262-417a-ab7d-de469ec2c8e6 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce5b7c9a7e31401d8c04a24af809ed81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '816984c605114e4680f81fb019e5229f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:10.950969 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07fef4b-a262-417a-ab7d-de469ec2c8e6 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:10.951250 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07fef4b-a262-417a-ab7d-de469ec2c8e6 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:10.951529 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07fef4b-a262-417a-ab7d-de469ec2c8e6 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:10.952356 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07fef4b-a262-417a-ab7d-de469ec2c8e6 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Adding query filter params (scope.project.id=359def4ccd9e4902b9bb28c95fc66cbc, user.id=c65996abac84448da544ada89ddeef1f) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:34:10.952668 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07fef4b-a262-417a-ab7d-de469ec2c8e6 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:10.955032 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07fef4b-a262-417a-ab7d-de469ec2c8e6 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:10.980453 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-7bab0369-f6f0-4827-b69f-457f645c82ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e285c381e7d4f2fab088ae6cb19615c', 'request_id': 'req-7bab0369-f6f0-4827-b69f-457f645c82ce'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:10.992226 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-7bab0369-f6f0-4827-b69f-457f645c82ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e285c381e7d4f2fab088ae6cb19615c', 'request_id': 'req-7bab0369-f6f0-4827-b69f-457f645c82ce'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:10.999812 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-7bab0369-f6f0-4827-b69f-457f645c82ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e285c381e7d4f2fab088ae6cb19615c', 'request_id': 'req-7bab0369-f6f0-4827-b69f-457f645c82ce'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:11.015740 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-7bab0369-f6f0-4827-b69f-457f645c82ce admin admin] The token cache is being invalidate because project 8e285c381e7d4f2fab088ae6cb19615c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:34:11.016026 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-7bab0369-f6f0-4827-b69f-457f645c82ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:11.016688 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-7bab0369-f6f0-4827-b69f-457f645c82ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:11.021263 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3039/6058] 10.222.0.17 () {58 vars in 1355 bytes} [Sat Jul 23 21:34:10 2022] GET /identity/v3/role_assignments?scope.project.id=359def4ccd9e4902b9bb28c95fc66cbc&user.id=c65996abac84448da544ada89ddeef1f&effective => generated 1061 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:34:11.021501 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3020/6059] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:34:10 2022] DELETE /identity/v3/projects/8e285c381e7d4f2fab088ae6cb19615c => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:11.022293 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bab0369-f6f0-4827-b69f-457f645c82ce admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:11.022475 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07fef4b-a262-417a-ab7d-de469ec2c8e6 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:11.023760 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-7bab0369-f6f0-4827-b69f-457f645c82ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:11.024755 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-b07fef4b-a262-417a-ab7d-de469ec2c8e6 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:11.040690 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07fef4b-a262-417a-ab7d-de469ec2c8e6 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:11.046842 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:11.052520 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:11.097050 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bab0369-f6f0-4827-b69f-457f645c82ce admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:11.102681 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a71050a-6593-4125-b9cf-5f62bd021aa1 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce5b7c9a7e31401d8c04a24af809ed81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '816984c605114e4680f81fb019e5229f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:11.103782 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a71050a-6593-4125-b9cf-5f62bd021aa1 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:11.104278 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a71050a-6593-4125-b9cf-5f62bd021aa1 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:11.104580 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a71050a-6593-4125-b9cf-5f62bd021aa1 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] PATH_INFO: `/v3/roles/c95110eb6beb4ed794fdbd9884cad174/implies/ba52c8c461774400a925c36f55ed56fb` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:11.106515 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a71050a-6593-4125-b9cf-5f62bd021aa1 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=c95110eb6beb4ed794fdbd9884cad174, implied_role_id=ba52c8c461774400a925c36f55ed56fb)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:11.106935 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f79a57-68cf-41cf-9f0a-41e541e55bba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:11.107825 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f79a57-68cf-41cf-9f0a-41e541e55bba admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:11.107930 ncdv-master-1 devstack@keystone.service[91547]: WARNING py.warnings [None req-1a71050a-6593-4125-b9cf-5f62bd021aa1 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:34:11.107930 ncdv-master-1 devstack@keystone.service[91547]: warnings.warn(msg) Jul 23 21:34:11.107930 ncdv-master-1 devstack@keystone.service[91547]: Jul 23 21:34:11.108176 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f79a57-68cf-41cf-9f0a-41e541e55bba admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:11.108358 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f79a57-68cf-41cf-9f0a-41e541e55bba admin admin] PATH_INFO: `/v3/users/2fc17b0c69fd4e059e1de02356899ae5` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:11.109065 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a71050a-6593-4125-b9cf-5f62bd021aa1 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:11.110339 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f79a57-68cf-41cf-9f0a-41e541e55bba admin admin] RBAC: Authorizing `identity:delete_user(user_id=2fc17b0c69fd4e059e1de02356899ae5)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:11.112283 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f79a57-68cf-41cf-9f0a-41e541e55bba admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:11.119666 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3021/6060] 10.222.0.17 () {58 vars in 1346 bytes} [Sat Jul 23 21:34:11 2022] DELETE /identity/v3/roles/c95110eb6beb4ed794fdbd9884cad174/implies/ba52c8c461774400a925c36f55ed56fb => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:11.121177 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f98756-6b01-46f8-a104-4cc47427f420 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:11.121749 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f98756-6b01-46f8-a104-4cc47427f420 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:11.122148 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f98756-6b01-46f8-a104-4cc47427f420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:11.143016 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-45f98756-6b01-46f8-a104-4cc47427f420 None None] MFA Rules not processed for user `17b779a3e21a415bb42cde5d6863d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:34:11.144250 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-45f98756-6b01-46f8-a104-4cc47427f420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:11.162537 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-a5f79a57-68cf-41cf-9f0a-41e541e55bba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2fc17b0c69fd4e059e1de02356899ae5'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:11.163270 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-a5f79a57-68cf-41cf-9f0a-41e541e55bba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2fc17b0c69fd4e059e1de02356899ae5'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:11.170623 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-a5f79a57-68cf-41cf-9f0a-41e541e55bba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2fc17b0c69fd4e059e1de02356899ae5'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:11.179634 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-a5f79a57-68cf-41cf-9f0a-41e541e55bba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2fc17b0c69fd4e059e1de02356899ae5'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:11.192176 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-a5f79a57-68cf-41cf-9f0a-41e541e55bba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2fc17b0c69fd4e059e1de02356899ae5'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:11.198597 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3040/6061] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:34:11 2022] DELETE /identity/v3/users/2fc17b0c69fd4e059e1de02356899ae5 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:34:11.199867 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3022/6062] 10.222.0.17 () {58 vars in 1009 bytes} [Sat Jul 23 21:34:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:34:11.202505 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f79a57-68cf-41cf-9f0a-41e541e55bba admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:11.203954 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-a5f79a57-68cf-41cf-9f0a-41e541e55bba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:11.214260 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f98756-6b01-46f8-a104-4cc47427f420 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:11.215795 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-45f98756-6b01-46f8-a104-4cc47427f420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:11.279034 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f79a57-68cf-41cf-9f0a-41e541e55bba admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:11.284979 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2501ad0f-4ff7-4335-9507-4c6edfb64869 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce5b7c9a7e31401d8c04a24af809ed81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '816984c605114e4680f81fb019e5229f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:11.285650 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2501ad0f-4ff7-4335-9507-4c6edfb64869 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:11.286196 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2501ad0f-4ff7-4335-9507-4c6edfb64869 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:11.286527 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2501ad0f-4ff7-4335-9507-4c6edfb64869 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:11.287514 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2501ad0f-4ff7-4335-9507-4c6edfb64869 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Adding query filter params (scope.project.id=359def4ccd9e4902b9bb28c95fc66cbc, user.id=c65996abac84448da544ada89ddeef1f) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:34:11.287915 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2501ad0f-4ff7-4335-9507-4c6edfb64869 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:11.290282 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2501ad0f-4ff7-4335-9507-4c6edfb64869 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:11.310915 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f98756-6b01-46f8-a104-4cc47427f420 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:11.331787 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:11.347351 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3041/6063] 10.222.0.17 () {58 vars in 1355 bytes} [Sat Jul 23 21:34:11 2022] GET /identity/v3/role_assignments?scope.project.id=359def4ccd9e4902b9bb28c95fc66cbc&user.id=c65996abac84448da544ada89ddeef1f&effective => generated 577 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:34:11.351656 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2501ad0f-4ff7-4335-9507-4c6edfb64869 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:11.369398 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2501ad0f-4ff7-4335-9507-4c6edfb64869 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:11.379705 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f362541a-cd74-43df-a03c-1a787dfaebfe tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce5b7c9a7e31401d8c04a24af809ed81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '816984c605114e4680f81fb019e5229f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:11.380895 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f362541a-cd74-43df-a03c-1a787dfaebfe tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:11.381269 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f362541a-cd74-43df-a03c-1a787dfaebfe tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:11.381652 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f362541a-cd74-43df-a03c-1a787dfaebfe tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] PATH_INFO: `/v3/roles/c95110eb6beb4ed794fdbd9884cad174/implies/ba52c8c461774400a925c36f55ed56fb` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:11.383548 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f362541a-cd74-43df-a03c-1a787dfaebfe tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=c95110eb6beb4ed794fdbd9884cad174, implied_role_id=ba52c8c461774400a925c36f55ed56fb)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:11.384833 ncdv-master-1 devstack@keystone.service[91548]: WARNING py.warnings [None req-f362541a-cd74-43df-a03c-1a787dfaebfe tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:34:11.384833 ncdv-master-1 devstack@keystone.service[91548]: warnings.warn(msg) Jul 23 21:34:11.384833 ncdv-master-1 devstack@keystone.service[91548]: Jul 23 21:34:11.386042 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f362541a-cd74-43df-a03c-1a787dfaebfe tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:11.386189 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:11.395788 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f210e3-83c8-44d5-8203-80ed6e628588 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f0a685b7da46afb81024848f079d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:11.396513 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f210e3-83c8-44d5-8203-80ed6e628588 service swift] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:11.396953 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f210e3-83c8-44d5-8203-80ed6e628588 service swift] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:11.397425 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f210e3-83c8-44d5-8203-80ed6e628588 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:11.406894 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-f362541a-cd74-43df-a03c-1a787dfaebfe tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] c95110eb6beb4ed794fdbd9884cad174 does not imply ba52c8c461774400a925c36f55ed56fb.: keystone.exception.ImpliedRoleNotFound: c95110eb6beb4ed794fdbd9884cad174 does not imply ba52c8c461774400a925c36f55ed56fb. Jul 23 21:34:11.406894 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 21:34:11.406894 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 105, in _get_implied_role Jul 23 21:34:11.406894 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application ref = query.one() Jul 23 21:34:11.406894 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2865, in one Jul 23 21:34:11.406894 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._iter().one() Jul 23 21:34:11.406894 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1417, in one Jul 23 21:34:11.406894 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._only_one_row( Jul 23 21:34:11.406894 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Jul 23 21:34:11.406894 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exc.NoResultFound( Jul 23 21:34:11.406894 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Jul 23 21:34:11.406894 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 21:34:11.406894 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 23 21:34:11.406894 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 21:34:11.406894 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 21:34:11.406894 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 21:34:11.408204 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 21:34:11.408204 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 21:34:11.408204 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 21:34:11.408204 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 21:34:11.408204 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 21:34:11.408204 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 21:34:11.408204 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 21:34:11.408204 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 21:34:11.408204 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 21:34:11.408204 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 270, in delete Jul 23 21:34:11.408204 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application PROVIDERS.role_api.delete_implied_role(prior_role_id, implied_role_id) Jul 23 21:34:11.408204 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 21:34:11.408204 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 21:34:11.408204 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1369, in delete_implied_role Jul 23 21:34:11.408204 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application self.driver.delete_implied_role(prior_role_id, implied_role_id) Jul 23 21:34:11.408204 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 129, in delete_implied_role Jul 23 21:34:11.409808 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application ref = self._get_implied_role(session, prior_role_id, Jul 23 21:34:11.409808 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 107, in _get_implied_role Jul 23 21:34:11.409808 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.ImpliedRoleNotFound( Jul 23 21:34:11.409808 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.ImpliedRoleNotFound: c95110eb6beb4ed794fdbd9884cad174 does not imply ba52c8c461774400a925c36f55ed56fb. Jul 23 21:34:11.409808 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 21:34:11.412707 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3042/6064] 10.222.0.17 () {58 vars in 1346 bytes} [Sat Jul 23 21:34:11 2022] DELETE /identity/v3/roles/c95110eb6beb4ed794fdbd9884cad174/implies/ba52c8c461774400a925c36f55ed56fb => generated 137 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 23 21:34:11.413521 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f362541a-cd74-43df-a03c-1a787dfaebfe tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:11.424864 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f362541a-cd74-43df-a03c-1a787dfaebfe tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:11.432497 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5830243-5cf6-47d1-92a4-0b9ed8562189 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce5b7c9a7e31401d8c04a24af809ed81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '816984c605114e4680f81fb019e5229f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:11.433647 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5830243-5cf6-47d1-92a4-0b9ed8562189 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:11.433979 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5830243-5cf6-47d1-92a4-0b9ed8562189 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:11.434261 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5830243-5cf6-47d1-92a4-0b9ed8562189 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] PATH_INFO: `/v3/projects/359def4ccd9e4902b9bb28c95fc66cbc/users/c65996abac84448da544ada89ddeef1f/roles/c95110eb6beb4ed794fdbd9884cad174` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:11.436505 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5830243-5cf6-47d1-92a4-0b9ed8562189 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=359def4ccd9e4902b9bb28c95fc66cbc, user_id=c65996abac84448da544ada89ddeef1f, role_id=c95110eb6beb4ed794fdbd9884cad174)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:11.439243 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5830243-5cf6-47d1-92a4-0b9ed8562189 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:11.444893 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-a5830243-5cf6-47d1-92a4-0b9ed8562189 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Invalidating the token cache because role c95110eb6beb4ed794fdbd9884cad174 was removed from user c65996abac84448da544ada89ddeef1f on project 359def4ccd9e4902b9bb28c95fc66cbc. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:34:11.445178 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-a5830243-5cf6-47d1-92a4-0b9ed8562189 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:11.445927 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-a5830243-5cf6-47d1-92a4-0b9ed8562189 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:11.463448 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3043/6065] 10.222.0.17 () {58 vars in 1466 bytes} [Sat Jul 23 21:34:11 2022] DELETE /identity/v3/projects/359def4ccd9e4902b9bb28c95fc66cbc/users/c65996abac84448da544ada89ddeef1f/roles/c95110eb6beb4ed794fdbd9884cad174 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:11.468735 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5830243-5cf6-47d1-92a4-0b9ed8562189 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:11.468901 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f210e3-83c8-44d5-8203-80ed6e628588 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:11.470246 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-a5830243-5cf6-47d1-92a4-0b9ed8562189 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:11.470576 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f210e3-83c8-44d5-8203-80ed6e628588 service swift] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:11.482094 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3023/6066] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 23 21:34:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 23 21:34:11.558028 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f210e3-83c8-44d5-8203-80ed6e628588 service swift] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:11.559494 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-41f210e3-83c8-44d5-8203-80ed6e628588 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:11.561054 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5830243-5cf6-47d1-92a4-0b9ed8562189 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:11.570188 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd852f0-1229-46a1-a42f-af0f8139a071 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce5b7c9a7e31401d8c04a24af809ed81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '816984c605114e4680f81fb019e5229f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:11.570188 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd852f0-1229-46a1-a42f-af0f8139a071 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:11.570188 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd852f0-1229-46a1-a42f-af0f8139a071 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:11.570608 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd852f0-1229-46a1-a42f-af0f8139a071 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:11.570608 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd852f0-1229-46a1-a42f-af0f8139a071 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:11.570873 ncdv-master-1 devstack@keystone.service[91548]: WARNING py.warnings [None req-fbd852f0-1229-46a1-a42f-af0f8139a071 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:34:11.570873 ncdv-master-1 devstack@keystone.service[91548]: warnings.warn(msg) Jul 23 21:34:11.570873 ncdv-master-1 devstack@keystone.service[91548]: Jul 23 21:34:11.571913 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd852f0-1229-46a1-a42f-af0f8139a071 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:11.592467 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3044/6067] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:34:11 2022] POST /identity/v3/roles => generated 271 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:34:11.597079 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd852f0-1229-46a1-a42f-af0f8139a071 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:11.613376 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd852f0-1229-46a1-a42f-af0f8139a071 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:11.618648 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3271df9-579c-449b-8a26-7882c8983110 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce5b7c9a7e31401d8c04a24af809ed81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '816984c605114e4680f81fb019e5229f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:11.619527 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3271df9-579c-449b-8a26-7882c8983110 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:11.620430 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3271df9-579c-449b-8a26-7882c8983110 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:11.620840 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3271df9-579c-449b-8a26-7882c8983110 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:11.621840 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3271df9-579c-449b-8a26-7882c8983110 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Adding query filter params (domain_id=dc17eda5ad6a4b88955633ee14bd6b57) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:34:11.622261 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3271df9-579c-449b-8a26-7882c8983110 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorizing `identity:list_domain_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:11.623880 ncdv-master-1 devstack@keystone.service[91548]: WARNING py.warnings [None req-f3271df9-579c-449b-8a26-7882c8983110 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domain_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:34:11.623880 ncdv-master-1 devstack@keystone.service[91548]: warnings.warn(msg) Jul 23 21:34:11.623880 ncdv-master-1 devstack@keystone.service[91548]: Jul 23 21:34:11.625255 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3271df9-579c-449b-8a26-7882c8983110 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:11.637240 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3045/6068] 10.222.0.17 () {58 vars in 1206 bytes} [Sat Jul 23 21:34:11 2022] GET /identity/v3/roles?domain_id=dc17eda5ad6a4b88955633ee14bd6b57 => generated 408 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:34:11.638515 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3271df9-579c-449b-8a26-7882c8983110 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:11.649709 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3271df9-579c-449b-8a26-7882c8983110 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:11.655681 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a45e7f-75cc-424b-b102-f393622ad9ff tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce5b7c9a7e31401d8c04a24af809ed81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '816984c605114e4680f81fb019e5229f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:11.656930 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a45e7f-75cc-424b-b102-f393622ad9ff tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:11.657471 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a45e7f-75cc-424b-b102-f393622ad9ff tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:11.658617 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a45e7f-75cc-424b-b102-f393622ad9ff tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] PATH_INFO: `/v3/roles/fbb5f5e3cbe842cca60350fb32c3e040` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:11.660248 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a45e7f-75cc-424b-b102-f393622ad9ff tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=fbb5f5e3cbe842cca60350fb32c3e040)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:11.660634 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f210e3-83c8-44d5-8203-80ed6e628588 service swift] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:11.661608 ncdv-master-1 devstack@keystone.service[91548]: WARNING py.warnings [None req-85a45e7f-75cc-424b-b102-f393622ad9ff tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:34:11.661608 ncdv-master-1 devstack@keystone.service[91548]: warnings.warn(msg) Jul 23 21:34:11.661608 ncdv-master-1 devstack@keystone.service[91548]: Jul 23 21:34:11.662844 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a45e7f-75cc-424b-b102-f393622ad9ff tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:11.705560 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-85a45e7f-75cc-424b-b102-f393622ad9ff tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Invalidating the token cache because role fbb5f5e3cbe842cca60350fb32c3e040 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:34:11.705981 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-85a45e7f-75cc-424b-b102-f393622ad9ff tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:11.706714 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-85a45e7f-75cc-424b-b102-f393622ad9ff tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:11.708711 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3046/6069] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:34:11 2022] DELETE /identity/v3/roles/fbb5f5e3cbe842cca60350fb32c3e040 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:34:11.713192 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a45e7f-75cc-424b-b102-f393622ad9ff tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:11.715329 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-85a45e7f-75cc-424b-b102-f393622ad9ff tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:11.722103 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab0b6c9-3908-4d3a-9a46-861aceda24b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:11.723056 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab0b6c9-3908-4d3a-9a46-861aceda24b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:11.723363 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab0b6c9-3908-4d3a-9a46-861aceda24b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:11.723700 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab0b6c9-3908-4d3a-9a46-861aceda24b5 admin admin] PATH_INFO: `/v3/projects/f83eca4118fa4866959f771b4e87f0fb` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:11.725960 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab0b6c9-3908-4d3a-9a46-861aceda24b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f83eca4118fa4866959f771b4e87f0fb)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:11.728166 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab0b6c9-3908-4d3a-9a46-861aceda24b5 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:11.784752 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-aab0b6c9-3908-4d3a-9a46-861aceda24b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f83eca4118fa4866959f771b4e87f0fb', 'request_id': 'req-aab0b6c9-3908-4d3a-9a46-861aceda24b5'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:11.786612 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:11.793951 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a45e7f-75cc-424b-b102-f393622ad9ff tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:11.794133 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-aab0b6c9-3908-4d3a-9a46-861aceda24b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f83eca4118fa4866959f771b4e87f0fb', 'request_id': 'req-aab0b6c9-3908-4d3a-9a46-861aceda24b5'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:11.799703 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-aab0b6c9-3908-4d3a-9a46-861aceda24b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f83eca4118fa4866959f771b4e87f0fb', 'request_id': 'req-aab0b6c9-3908-4d3a-9a46-861aceda24b5'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:11.803055 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:11.815387 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-aab0b6c9-3908-4d3a-9a46-861aceda24b5 admin admin] The token cache is being invalidate because project f83eca4118fa4866959f771b4e87f0fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:34:11.815756 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-aab0b6c9-3908-4d3a-9a46-861aceda24b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:11.816484 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-aab0b6c9-3908-4d3a-9a46-861aceda24b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:11.821633 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3024/6070] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:34:11 2022] DELETE /identity/v3/projects/f83eca4118fa4866959f771b4e87f0fb => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:11.821633 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c8c282-b1d1-4abd-98da-dc1f20ca7855 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:11.821633 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c8c282-b1d1-4abd-98da-dc1f20ca7855 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:11.821633 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c8c282-b1d1-4abd-98da-dc1f20ca7855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:11.839674 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-21c8c282-b1d1-4abd-98da-dc1f20ca7855 None None] MFA Rules not processed for user `17b779a3e21a415bb42cde5d6863d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:34:11.840884 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-21c8c282-b1d1-4abd-98da-dc1f20ca7855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:11.857736 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b33d4f-833e-4840-b30b-d5eaf57f74f8 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce5b7c9a7e31401d8c04a24af809ed81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '816984c605114e4680f81fb019e5229f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:11.858458 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b33d4f-833e-4840-b30b-d5eaf57f74f8 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:11.858743 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b33d4f-833e-4840-b30b-d5eaf57f74f8 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:11.859019 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b33d4f-833e-4840-b30b-d5eaf57f74f8 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:11.859761 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b33d4f-833e-4840-b30b-d5eaf57f74f8 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Adding query filter params (domain_id=dc17eda5ad6a4b88955633ee14bd6b57) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:34:11.860065 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b33d4f-833e-4840-b30b-d5eaf57f74f8 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorizing `identity:list_domain_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:11.861670 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b33d4f-833e-4840-b30b-d5eaf57f74f8 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:11.871816 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3047/6071] 10.222.0.17 () {58 vars in 1206 bytes} [Sat Jul 23 21:34:11 2022] GET /identity/v3/roles?domain_id=dc17eda5ad6a4b88955633ee14bd6b57 => generated 148 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 21:34:11.871816 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c304d00a-b591-4a19-88c4-23f26f73bf78 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:11.871816 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c304d00a-b591-4a19-88c4-23f26f73bf78 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:11.871816 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c304d00a-b591-4a19-88c4-23f26f73bf78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:11.888843 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-c304d00a-b591-4a19-88c4-23f26f73bf78 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:34:11.890095 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-c304d00a-b591-4a19-88c4-23f26f73bf78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:11.899619 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3025/6072] 10.222.0.17 () {58 vars in 967 bytes} [Sat Jul 23 21:34:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:34:11.900586 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c8c282-b1d1-4abd-98da-dc1f20ca7855 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:11.902478 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-21c8c282-b1d1-4abd-98da-dc1f20ca7855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:11.917917 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c8c282-b1d1-4abd-98da-dc1f20ca7855 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:11.924404 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccc3928-ce38-4630-ae6c-d21954de680d tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce5b7c9a7e31401d8c04a24af809ed81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '816984c605114e4680f81fb019e5229f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:11.925236 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccc3928-ce38-4630-ae6c-d21954de680d tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:11.925522 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccc3928-ce38-4630-ae6c-d21954de680d tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:11.925801 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccc3928-ce38-4630-ae6c-d21954de680d tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] PATH_INFO: `/v3/roles/fbb5f5e3cbe842cca60350fb32c3e040` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:11.936810 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccc3928-ce38-4630-ae6c-d21954de680d tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 21:34:11.946751 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-eccc3928-ce38-4630-ae6c-d21954de680d tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Could not find role: fbb5f5e3cbe842cca60350fb32c3e040.: keystone.exception.RoleNotFound: Could not find role: fbb5f5e3cbe842cca60350fb32c3e040. Jul 23 21:34:11.946751 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 21:34:11.946751 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 21:34:11.946751 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 21:34:11.946751 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 21:34:11.946751 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 21:34:11.946751 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 21:34:11.946751 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 21:34:11.946751 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 21:34:11.946751 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 21:34:11.946751 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 21:34:11.946751 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 21:34:11.946751 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 165, in delete Jul 23 21:34:11.946751 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_role') Jul 23 21:34:11.947832 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 21:34:11.947832 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 21:34:11.947832 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 21:34:11.947832 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 21:34:11.947832 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 21:34:11.947832 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 21:34:11.947832 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 21:34:11.947832 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 21:34:11.947832 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 21:34:11.947832 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 21:34:11.947832 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 21:34:11.947832 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application with Lock( Jul 23 21:34:11.947832 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 21:34:11.947832 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._enter() Jul 23 21:34:11.947832 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 21:34:11.947832 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 21:34:11.948928 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 21:34:11.948928 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.creator() Jul 23 21:34:11.948928 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 21:34:11.948928 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application created_value = creator( Jul 23 21:34:11.948928 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 23 21:34:11.948928 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 23 21:34:11.948928 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 23 21:34:11.948928 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 23 21:34:11.948928 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 23 21:34:11.948928 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 23 21:34:11.948928 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: fbb5f5e3cbe842cca60350fb32c3e040. Jul 23 21:34:11.948928 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 21:34:11.949813 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3026/6073] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:34:11 2022] DELETE /identity/v3/roles/fbb5f5e3cbe842cca60350fb32c3e040 => generated 110 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 23 21:34:11.949813 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccc3928-ce38-4630-ae6c-d21954de680d tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:11.951361 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-eccc3928-ce38-4630-ae6c-d21954de680d tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:11.955351 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3048/6074] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:34:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:34:11.956179 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c304d00a-b591-4a19-88c4-23f26f73bf78 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:11.966924 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c304d00a-b591-4a19-88c4-23f26f73bf78 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:11.971634 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a62e66-45bd-4e5e-b4d1-ddbc079a3e31 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce5b7c9a7e31401d8c04a24af809ed81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '816984c605114e4680f81fb019e5229f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:11.972540 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a62e66-45bd-4e5e-b4d1-ddbc079a3e31 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:11.972829 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a62e66-45bd-4e5e-b4d1-ddbc079a3e31 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:11.973108 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a62e66-45bd-4e5e-b4d1-ddbc079a3e31 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] PATH_INFO: `/v3/domains/dc17eda5ad6a4b88955633ee14bd6b57/groups/fe4b6277c85b487cbf3b663b0c6a5101/roles/2564d3143890441ba9b4a9ae8a4875d3` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:11.980268 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a62e66-45bd-4e5e-b4d1-ddbc079a3e31 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=dc17eda5ad6a4b88955633ee14bd6b57, group_id=fe4b6277c85b487cbf3b663b0c6a5101, role_id=2564d3143890441ba9b4a9ae8a4875d3)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:11.983020 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a62e66-45bd-4e5e-b4d1-ddbc079a3e31 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:11.996480 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3049/6075] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:34:11 2022] PUT /identity/v3/domains/dc17eda5ad6a4b88955633ee14bd6b57/groups/fe4b6277c85b487cbf3b663b0c6a5101/roles/2564d3143890441ba9b4a9ae8a4875d3 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:11.997733 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f519f7a-78cf-4c7c-b830-9aeaf1dd8a47 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:11.998048 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f519f7a-78cf-4c7c-b830-9aeaf1dd8a47 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:11.998327 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f519f7a-78cf-4c7c-b830-9aeaf1dd8a47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:12.016493 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-6f519f7a-78cf-4c7c-b830-9aeaf1dd8a47 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:34:12.019051 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-6f519f7a-78cf-4c7c-b830-9aeaf1dd8a47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:12.030508 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccc3928-ce38-4630-ae6c-d21954de680d tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:12.082487 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3050/6076] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:34:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:34:12.083423 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f519f7a-78cf-4c7c-b830-9aeaf1dd8a47 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:12.096141 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714206a8-0c12-42e9-a90f-55bb0ca61452 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f0a685b7da46afb81024848f079d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:12.096797 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714206a8-0c12-42e9-a90f-55bb0ca61452 service swift] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:12.097093 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714206a8-0c12-42e9-a90f-55bb0ca61452 service swift] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:12.097339 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714206a8-0c12-42e9-a90f-55bb0ca61452 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:12.109713 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:INSERT=1,keystone:DELETE=3,keystone:SELECT=96 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:12.123464 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:12.149847 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f519f7a-78cf-4c7c-b830-9aeaf1dd8a47 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:12.154529 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9f08d7-b6ab-41cc-bb14-e20a7e40d2ca tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce5b7c9a7e31401d8c04a24af809ed81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '816984c605114e4680f81fb019e5229f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:12.155412 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9f08d7-b6ab-41cc-bb14-e20a7e40d2ca tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:12.155703 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9f08d7-b6ab-41cc-bb14-e20a7e40d2ca tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:12.155971 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9f08d7-b6ab-41cc-bb14-e20a7e40d2ca tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] PATH_INFO: `/v3/domains/dc17eda5ad6a4b88955633ee14bd6b57/groups/fe4b6277c85b487cbf3b663b0c6a5101/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:12.157752 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9f08d7-b6ab-41cc-bb14-e20a7e40d2ca tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=dc17eda5ad6a4b88955633ee14bd6b57, group_id=fe4b6277c85b487cbf3b663b0c6a5101)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:12.158029 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714206a8-0c12-42e9-a90f-55bb0ca61452 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:12.159616 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714206a8-0c12-42e9-a90f-55bb0ca61452 service swift] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:12.160403 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9f08d7-b6ab-41cc-bb14-e20a7e40d2ca tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:12.168062 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3027/6077] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 23 21:34:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 23 21:34:12.168905 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714206a8-0c12-42e9-a90f-55bb0ca61452 service swift] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:12.180164 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714206a8-0c12-42e9-a90f-55bb0ca61452 service swift] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:12.180817 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3051/6078] 10.222.0.17 () {58 vars in 1364 bytes} [Sat Jul 23 21:34:12 2022] GET /identity/v3/domains/dc17eda5ad6a4b88955633ee14bd6b57/groups/fe4b6277c85b487cbf3b663b0c6a5101/roles => generated 410 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:34:12.184999 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9f08d7-b6ab-41cc-bb14-e20a7e40d2ca tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:12.185286 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d715824-856b-4428-b07b-09e9a231dc03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:12.186096 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d715824-856b-4428-b07b-09e9a231dc03 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:12.186269 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d715824-856b-4428-b07b-09e9a231dc03 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:12.186547 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d715824-856b-4428-b07b-09e9a231dc03 admin admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:12.187284 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d715824-856b-4428-b07b-09e9a231dc03 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:34:12.187567 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d715824-856b-4428-b07b-09e9a231dc03 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:12.189180 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d715824-856b-4428-b07b-09e9a231dc03 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:12.195874 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9f08d7-b6ab-41cc-bb14-e20a7e40d2ca tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:12.200960 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afdd69d-59af-4bde-93a7-086ac51d1035 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce5b7c9a7e31401d8c04a24af809ed81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '816984c605114e4680f81fb019e5229f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:12.205028 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3028/6079] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:34:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:34:12.205193 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afdd69d-59af-4bde-93a7-086ac51d1035 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] REQUEST_METHOD: `HEAD` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:12.205193 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afdd69d-59af-4bde-93a7-086ac51d1035 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:12.205193 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afdd69d-59af-4bde-93a7-086ac51d1035 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] PATH_INFO: `/v3/domains/dc17eda5ad6a4b88955633ee14bd6b57/groups/fe4b6277c85b487cbf3b663b0c6a5101/roles/2564d3143890441ba9b4a9ae8a4875d3` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:12.205193 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afdd69d-59af-4bde-93a7-086ac51d1035 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=dc17eda5ad6a4b88955633ee14bd6b57, group_id=fe4b6277c85b487cbf3b663b0c6a5101, role_id=2564d3143890441ba9b4a9ae8a4875d3)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:12.206443 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d715824-856b-4428-b07b-09e9a231dc03 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:12.208392 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afdd69d-59af-4bde-93a7-086ac51d1035 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:12.218056 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d715824-856b-4428-b07b-09e9a231dc03 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:12.218312 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3052/6080] 10.222.0.17 () {58 vars in 1464 bytes} [Sat Jul 23 21:34:12 2022] HEAD /identity/v3/domains/dc17eda5ad6a4b88955633ee14bd6b57/groups/fe4b6277c85b487cbf3b663b0c6a5101/roles/2564d3143890441ba9b4a9ae8a4875d3 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:12.226386 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b308de2-c545-4b5a-ac76-63db692e711b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:12.226805 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afdd69d-59af-4bde-93a7-086ac51d1035 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:12.227214 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b308de2-c545-4b5a-ac76-63db692e711b admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:12.229364 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b308de2-c545-4b5a-ac76-63db692e711b admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:12.229364 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b308de2-c545-4b5a-ac76-63db692e711b admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:12.229364 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b308de2-c545-4b5a-ac76-63db692e711b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:12.230394 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b308de2-c545-4b5a-ac76-63db692e711b admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:12.240709 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afdd69d-59af-4bde-93a7-086ac51d1035 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:12.246445 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23662e87-a7c0-466a-b405-9e3b6e61a4bd tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce5b7c9a7e31401d8c04a24af809ed81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '816984c605114e4680f81fb019e5229f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:12.247379 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23662e87-a7c0-466a-b405-9e3b6e61a4bd tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:12.247641 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23662e87-a7c0-466a-b405-9e3b6e61a4bd tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:12.247912 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23662e87-a7c0-466a-b405-9e3b6e61a4bd tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] PATH_INFO: `/v3/domains/dc17eda5ad6a4b88955633ee14bd6b57/groups/fe4b6277c85b487cbf3b663b0c6a5101/roles/2564d3143890441ba9b4a9ae8a4875d3` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:12.250451 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23662e87-a7c0-466a-b405-9e3b6e61a4bd tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=dc17eda5ad6a4b88955633ee14bd6b57, group_id=fe4b6277c85b487cbf3b663b0c6a5101, role_id=2564d3143890441ba9b4a9ae8a4875d3)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:12.253258 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23662e87-a7c0-466a-b405-9e3b6e61a4bd tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:12.259496 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-23662e87-a7c0-466a-b405-9e3b6e61a4bd tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Invalidating the token cache because role 2564d3143890441ba9b4a9ae8a4875d3 was removed from group fe4b6277c85b487cbf3b663b0c6a5101 on domain dc17eda5ad6a4b88955633ee14bd6b57. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:34:12.259789 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-23662e87-a7c0-466a-b405-9e3b6e61a4bd tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:12.260428 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3029/6081] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:34:12 2022] POST /identity/v3/projects => generated 377 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:34:12.260569 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-23662e87-a7c0-466a-b405-9e3b6e61a4bd tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:12.264775 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b308de2-c545-4b5a-ac76-63db692e711b admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:12.266658 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-2b308de2-c545-4b5a-ac76-63db692e711b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:12.277607 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3053/6082] 10.222.0.17 () {58 vars in 1466 bytes} [Sat Jul 23 21:34:12 2022] DELETE /identity/v3/domains/dc17eda5ad6a4b88955633ee14bd6b57/groups/fe4b6277c85b487cbf3b663b0c6a5101/roles/2564d3143890441ba9b4a9ae8a4875d3 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:12.283101 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23662e87-a7c0-466a-b405-9e3b6e61a4bd tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:12.284494 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-23662e87-a7c0-466a-b405-9e3b6e61a4bd tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:12.336107 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b308de2-c545-4b5a-ac76-63db692e711b admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:12.353370 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23662e87-a7c0-466a-b405-9e3b6e61a4bd tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:12.358624 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ffd3b7-5919-4b21-bce0-a98c9be63ee2 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce5b7c9a7e31401d8c04a24af809ed81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '816984c605114e4680f81fb019e5229f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:12.359520 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ffd3b7-5919-4b21-bce0-a98c9be63ee2 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:12.359803 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ffd3b7-5919-4b21-bce0-a98c9be63ee2 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:12.360077 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ffd3b7-5919-4b21-bce0-a98c9be63ee2 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] PATH_INFO: `/v3/projects/359def4ccd9e4902b9bb28c95fc66cbc/groups/fe4b6277c85b487cbf3b663b0c6a5101/roles/2564d3143890441ba9b4a9ae8a4875d3` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:12.362322 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ffd3b7-5919-4b21-bce0-a98c9be63ee2 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorizing `identity:create_grant(project_id=359def4ccd9e4902b9bb28c95fc66cbc, group_id=fe4b6277c85b487cbf3b663b0c6a5101, role_id=2564d3143890441ba9b4a9ae8a4875d3)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:12.364984 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ffd3b7-5919-4b21-bce0-a98c9be63ee2 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:12.380352 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3054/6083] 10.222.0.17 () {60 vars in 1485 bytes} [Sat Jul 23 21:34:12 2022] PUT /identity/v3/projects/359def4ccd9e4902b9bb28c95fc66cbc/groups/fe4b6277c85b487cbf3b663b0c6a5101/roles/2564d3143890441ba9b4a9ae8a4875d3 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:34:12.384619 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53ebaf8-194b-4d3c-ad06-16650093ec01 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:12.385272 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53ebaf8-194b-4d3c-ad06-16650093ec01 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:12.385272 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53ebaf8-194b-4d3c-ad06-16650093ec01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:12.403798 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-a53ebaf8-194b-4d3c-ad06-16650093ec01 None None] MFA Rules not processed for user `17b779a3e21a415bb42cde5d6863d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:34:12.404993 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-a53ebaf8-194b-4d3c-ad06-16650093ec01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:12.410638 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a91276-1748-412c-a1eb-ccfd2a4cef2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:12.411371 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a91276-1748-412c-a1eb-ccfd2a4cef2a admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:12.411653 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a91276-1748-412c-a1eb-ccfd2a4cef2a admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:12.412020 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a91276-1748-412c-a1eb-ccfd2a4cef2a admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:12.412775 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a91276-1748-412c-a1eb-ccfd2a4cef2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:12.415660 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a91276-1748-412c-a1eb-ccfd2a4cef2a admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:12.449418 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3030/6084] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:34:12 2022] POST /identity/v3/users => generated 289 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:34:12.449418 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a91276-1748-412c-a1eb-ccfd2a4cef2a admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:12.459908 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a91276-1748-412c-a1eb-ccfd2a4cef2a admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:12.473059 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:12.476206 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3055/6085] 10.222.0.17 () {58 vars in 967 bytes} [Sat Jul 23 21:34:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:34:12.477092 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53ebaf8-194b-4d3c-ad06-16650093ec01 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:12.521102 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744b39a0-c70a-42e6-b404-166732a2f727 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce5b7c9a7e31401d8c04a24af809ed81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '816984c605114e4680f81fb019e5229f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:12.522107 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744b39a0-c70a-42e6-b404-166732a2f727 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:12.522394 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744b39a0-c70a-42e6-b404-166732a2f727 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:12.522687 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744b39a0-c70a-42e6-b404-166732a2f727 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] PATH_INFO: `/v3/projects/359def4ccd9e4902b9bb28c95fc66cbc/groups/fe4b6277c85b487cbf3b663b0c6a5101/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:12.524458 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744b39a0-c70a-42e6-b404-166732a2f727 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorizing `identity:list_grants(project_id=359def4ccd9e4902b9bb28c95fc66cbc, group_id=fe4b6277c85b487cbf3b663b0c6a5101)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:12.525533 ncdv-master-1 devstack@keystone.service[91547]: WARNING py.warnings [None req-744b39a0-c70a-42e6-b404-166732a2f727 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_grants": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:34:12.525533 ncdv-master-1 devstack@keystone.service[91547]: warnings.warn(msg) Jul 23 21:34:12.525533 ncdv-master-1 devstack@keystone.service[91547]: Jul 23 21:34:12.526162 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:12.527585 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744b39a0-c70a-42e6-b404-166732a2f727 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:12.542536 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3031/6086] 10.222.0.17 () {58 vars in 1367 bytes} [Sat Jul 23 21:34:12 2022] GET /identity/v3/projects/359def4ccd9e4902b9bb28c95fc66cbc/groups/fe4b6277c85b487cbf3b663b0c6a5101/roles => generated 411 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:34:12.543798 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744b39a0-c70a-42e6-b404-166732a2f727 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:12.545652 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-744b39a0-c70a-42e6-b404-166732a2f727 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:12.550787 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53ebaf8-194b-4d3c-ad06-16650093ec01 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:12.555439 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20614e03-bf32-4959-a2f5-4656fa603957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:12.556112 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20614e03-bf32-4959-a2f5-4656fa603957 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:12.556398 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20614e03-bf32-4959-a2f5-4656fa603957 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:12.556662 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20614e03-bf32-4959-a2f5-4656fa603957 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:12.557382 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20614e03-bf32-4959-a2f5-4656fa603957 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:12.559013 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20614e03-bf32-4959-a2f5-4656fa603957 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:12.573633 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3056/6087] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:34:12 2022] GET /identity/v3/roles => generated 2321 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:34:12.573633 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20614e03-bf32-4959-a2f5-4656fa603957 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:12.581748 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20614e03-bf32-4959-a2f5-4656fa603957 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:12.586632 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd58899c-d7ba-43f8-9f55-bb8eca6ae440 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce5b7c9a7e31401d8c04a24af809ed81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '816984c605114e4680f81fb019e5229f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:12.587593 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd58899c-d7ba-43f8-9f55-bb8eca6ae440 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:12.588176 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd58899c-d7ba-43f8-9f55-bb8eca6ae440 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:12.588176 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd58899c-d7ba-43f8-9f55-bb8eca6ae440 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] PATH_INFO: `/v3/groups/fe4b6277c85b487cbf3b663b0c6a5101/users/c65996abac84448da544ada89ddeef1f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:12.590084 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd58899c-d7ba-43f8-9f55-bb8eca6ae440 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=fe4b6277c85b487cbf3b663b0c6a5101, user_id=c65996abac84448da544ada89ddeef1f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:12.591986 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd58899c-d7ba-43f8-9f55-bb8eca6ae440 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:12.617529 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3057/6088] 10.222.0.17 () {60 vars in 1359 bytes} [Sat Jul 23 21:34:12 2022] PUT /identity/v3/groups/fe4b6277c85b487cbf3b663b0c6a5101/users/c65996abac84448da544ada89ddeef1f => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:12.618314 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd58899c-d7ba-43f8-9f55-bb8eca6ae440 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:12.621318 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744b39a0-c70a-42e6-b404-166732a2f727 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:12.681906 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd58899c-d7ba-43f8-9f55-bb8eca6ae440 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:12.682890 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e0176e-09c3-4f92-8c4d-c638281d292c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f0a685b7da46afb81024848f079d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:12.683555 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e0176e-09c3-4f92-8c4d-c638281d292c service swift] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:12.683840 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e0176e-09c3-4f92-8c4d-c638281d292c service swift] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:12.684116 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e0176e-09c3-4f92-8c4d-c638281d292c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:12.686478 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0898cff-12f8-4bd9-bee9-66d94ba4c76f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:12.687150 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0898cff-12f8-4bd9-bee9-66d94ba4c76f admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:12.687428 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0898cff-12f8-4bd9-bee9-66d94ba4c76f admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:12.687701 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0898cff-12f8-4bd9-bee9-66d94ba4c76f admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:12.688424 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0898cff-12f8-4bd9-bee9-66d94ba4c76f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:12.690050 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0898cff-12f8-4bd9-bee9-66d94ba4c76f admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:12.704419 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3058/6089] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:34:12 2022] GET /identity/v3/roles => generated 2321 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:34:12.704419 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752f2be6-3c95-4ebd-8f08-63ae85f7d2be None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:12.704419 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752f2be6-3c95-4ebd-8f08-63ae85f7d2be None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:12.704419 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752f2be6-3c95-4ebd-8f08-63ae85f7d2be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:12.739213 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:12.744247 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-752f2be6-3c95-4ebd-8f08-63ae85f7d2be None None] MFA Rules not processed for user `c65996abac84448da544ada89ddeef1f`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:34:12.745485 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-752f2be6-3c95-4ebd-8f08-63ae85f7d2be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:12.748762 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e0176e-09c3-4f92-8c4d-c638281d292c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:12.750589 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e0176e-09c3-4f92-8c4d-c638281d292c service swift] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:12.759475 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3032/6090] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 23 21:34:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 23 21:34:12.760321 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e0176e-09c3-4f92-8c4d-c638281d292c service swift] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:12.774062 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e0176e-09c3-4f92-8c4d-c638281d292c service swift] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:12.779708 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ffa5af-9ae2-4c8b-943c-3e47e54b7086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:12.780798 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ffa5af-9ae2-4c8b-943c-3e47e54b7086 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:12.781233 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ffa5af-9ae2-4c8b-943c-3e47e54b7086 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:12.782219 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ffa5af-9ae2-4c8b-943c-3e47e54b7086 admin admin] PATH_INFO: `/v3/projects/e9d6915d244441ef85a94e208fe3e579/users/a66f1c9daffb44a0bb03b05ee58ccb0f/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:12.803787 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ffa5af-9ae2-4c8b-943c-3e47e54b7086 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9d6915d244441ef85a94e208fe3e579, user_id=a66f1c9daffb44a0bb03b05ee58ccb0f, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:12.807226 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ffa5af-9ae2-4c8b-943c-3e47e54b7086 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:12.832286 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3033/6091] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:34:12 2022] PUT /identity/v3/projects/e9d6915d244441ef85a94e208fe3e579/users/a66f1c9daffb44a0bb03b05ee58ccb0f/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:12.842960 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad1331e-aa9a-427c-9bd7-fa74a264f240 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:12.843394 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad1331e-aa9a-427c-9bd7-fa74a264f240 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:12.843770 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad1331e-aa9a-427c-9bd7-fa74a264f240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:12.854185 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3059/6092] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:34:12 2022] POST /identity/v3/auth/tokens => generated 3257 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:34:12.855251 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752f2be6-3c95-4ebd-8f08-63ae85f7d2be None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:12.863730 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:12.878341 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-6ad1331e-aa9a-427c-9bd7-fa74a264f240 None None] MFA Rules not processed for user `a66f1c9daffb44a0bb03b05ee58ccb0f`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:34:12.879765 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-6ad1331e-aa9a-427c-9bd7-fa74a264f240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:12.938848 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752f2be6-3c95-4ebd-8f08-63ae85f7d2be None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:12.949079 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3034/6093] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:34:12 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:34:12.949969 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad1331e-aa9a-427c-9bd7-fa74a264f240 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:12.951238 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-6ad1331e-aa9a-427c-9bd7-fa74a264f240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:12.994172 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26c62ad-cfa6-4c98-98b9-55facf00a5b5 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce5b7c9a7e31401d8c04a24af809ed81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '816984c605114e4680f81fb019e5229f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:12.995064 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26c62ad-cfa6-4c98-98b9-55facf00a5b5 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] REQUEST_METHOD: `HEAD` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:12.995342 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26c62ad-cfa6-4c98-98b9-55facf00a5b5 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:12.995613 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26c62ad-cfa6-4c98-98b9-55facf00a5b5 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] PATH_INFO: `/v3/projects/359def4ccd9e4902b9bb28c95fc66cbc/groups/fe4b6277c85b487cbf3b663b0c6a5101/roles/2564d3143890441ba9b4a9ae8a4875d3` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:12.997798 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26c62ad-cfa6-4c98-98b9-55facf00a5b5 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorizing `identity:check_grant(project_id=359def4ccd9e4902b9bb28c95fc66cbc, group_id=fe4b6277c85b487cbf3b663b0c6a5101, role_id=2564d3143890441ba9b4a9ae8a4875d3)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:13.000491 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26c62ad-cfa6-4c98-98b9-55facf00a5b5 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:13.006329 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3060/6094] 10.222.0.17 () {58 vars in 1467 bytes} [Sat Jul 23 21:34:12 2022] HEAD /identity/v3/projects/359def4ccd9e4902b9bb28c95fc66cbc/groups/fe4b6277c85b487cbf3b663b0c6a5101/roles/2564d3143890441ba9b4a9ae8a4875d3 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:34:13.009655 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26c62ad-cfa6-4c98-98b9-55facf00a5b5 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:13.017094 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26c62ad-cfa6-4c98-98b9-55facf00a5b5 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:13.017608 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad1331e-aa9a-427c-9bd7-fa74a264f240 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:13.021568 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac008489-3a2a-47fa-a9c1-8f1ddb8daa86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:13.022220 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac008489-3a2a-47fa-a9c1-8f1ddb8daa86 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:13.022336 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b216a0c3-a9a6-4b56-8902-5146a544a90f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:13.022497 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac008489-3a2a-47fa-a9c1-8f1ddb8daa86 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:13.022768 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac008489-3a2a-47fa-a9c1-8f1ddb8daa86 admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:13.023366 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b216a0c3-a9a6-4b56-8902-5146a544a90f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:13.023480 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac008489-3a2a-47fa-a9c1-8f1ddb8daa86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:13.023766 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b216a0c3-a9a6-4b56-8902-5146a544a90f admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:13.024100 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b216a0c3-a9a6-4b56-8902-5146a544a90f admin admin] PATH_INFO: `/v3/users/45f24ffc31ee4e8687a38581cd062fd0` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:13.025261 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac008489-3a2a-47fa-a9c1-8f1ddb8daa86 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:13.025365 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b216a0c3-a9a6-4b56-8902-5146a544a90f admin admin] RBAC: Authorizing `identity:delete_user(user_id=45f24ffc31ee4e8687a38581cd062fd0)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:13.027282 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b216a0c3-a9a6-4b56-8902-5146a544a90f admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:13.052594 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3061/6095] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:34:13 2022] POST /identity/v3/projects => generated 377 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:34:13.053458 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac008489-3a2a-47fa-a9c1-8f1ddb8daa86 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:13.079787 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-b216a0c3-a9a6-4b56-8902-5146a544a90f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45f24ffc31ee4e8687a38581cd062fd0'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:13.086485 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-b216a0c3-a9a6-4b56-8902-5146a544a90f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45f24ffc31ee4e8687a38581cd062fd0'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:13.087166 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-b216a0c3-a9a6-4b56-8902-5146a544a90f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45f24ffc31ee4e8687a38581cd062fd0'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:13.089672 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:13.096014 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-b216a0c3-a9a6-4b56-8902-5146a544a90f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45f24ffc31ee4e8687a38581cd062fd0'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:13.109759 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-b216a0c3-a9a6-4b56-8902-5146a544a90f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45f24ffc31ee4e8687a38581cd062fd0'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:13.115983 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3035/6096] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:34:12 2022] DELETE /identity/v3/users/45f24ffc31ee4e8687a38581cd062fd0 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:13.116137 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac008489-3a2a-47fa-a9c1-8f1ddb8daa86 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:13.116882 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b216a0c3-a9a6-4b56-8902-5146a544a90f admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:13.118361 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-b216a0c3-a9a6-4b56-8902-5146a544a90f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:13.154673 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:13.178203 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb61384-58bf-48a1-a172-c68d73e07bb5 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce5b7c9a7e31401d8c04a24af809ed81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '816984c605114e4680f81fb019e5229f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:13.179107 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb61384-58bf-48a1-a172-c68d73e07bb5 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:13.179388 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb61384-58bf-48a1-a172-c68d73e07bb5 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:13.179661 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb61384-58bf-48a1-a172-c68d73e07bb5 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] PATH_INFO: `/v3/projects/359def4ccd9e4902b9bb28c95fc66cbc/groups/fe4b6277c85b487cbf3b663b0c6a5101/roles/2564d3143890441ba9b4a9ae8a4875d3` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:13.181988 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb61384-58bf-48a1-a172-c68d73e07bb5 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=359def4ccd9e4902b9bb28c95fc66cbc, group_id=fe4b6277c85b487cbf3b663b0c6a5101, role_id=2564d3143890441ba9b4a9ae8a4875d3)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:13.182696 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b216a0c3-a9a6-4b56-8902-5146a544a90f admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:13.184697 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb61384-58bf-48a1-a172-c68d73e07bb5 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:13.187509 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e707d49-9f11-4078-a677-6e2e769e9c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:13.188161 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e707d49-9f11-4078-a677-6e2e769e9c09 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:13.188434 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e707d49-9f11-4078-a677-6e2e769e9c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:13.188705 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e707d49-9f11-4078-a677-6e2e769e9c09 admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:13.189392 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e707d49-9f11-4078-a677-6e2e769e9c09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:13.190123 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-7eb61384-58bf-48a1-a172-c68d73e07bb5 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Invalidating the token cache because role 2564d3143890441ba9b4a9ae8a4875d3 was removed from group fe4b6277c85b487cbf3b663b0c6a5101 on project 359def4ccd9e4902b9bb28c95fc66cbc. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:34:13.190430 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-7eb61384-58bf-48a1-a172-c68d73e07bb5 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:13.191084 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-7eb61384-58bf-48a1-a172-c68d73e07bb5 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:13.191387 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e707d49-9f11-4078-a677-6e2e769e9c09 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:13.205573 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3062/6097] 10.222.0.17 () {58 vars in 1469 bytes} [Sat Jul 23 21:34:13 2022] DELETE /identity/v3/projects/359def4ccd9e4902b9bb28c95fc66cbc/groups/fe4b6277c85b487cbf3b663b0c6a5101/roles/2564d3143890441ba9b4a9ae8a4875d3 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:13.207013 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc66f0bf-2e1f-456f-af0e-a061414a726e None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:13.207430 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc66f0bf-2e1f-456f-af0e-a061414a726e None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:13.207711 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc66f0bf-2e1f-456f-af0e-a061414a726e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:13.210180 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3036/6098] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:34:13 2022] POST /identity/v3/users => generated 295 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:34:13.210863 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e707d49-9f11-4078-a677-6e2e769e9c09 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:13.212411 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-5e707d49-9f11-4078-a677-6e2e769e9c09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:13.225651 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e707d49-9f11-4078-a677-6e2e769e9c09 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:13.226487 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-dc66f0bf-2e1f-456f-af0e-a061414a726e None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:34:13.227688 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-dc66f0bf-2e1f-456f-af0e-a061414a726e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:13.280560 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b7ab8e-0627-4cf1-aa33-41afa4b59748 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce5b7c9a7e31401d8c04a24af809ed81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '816984c605114e4680f81fb019e5229f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:13.281472 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b7ab8e-0627-4cf1-aa33-41afa4b59748 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:13.281777 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b7ab8e-0627-4cf1-aa33-41afa4b59748 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:13.282090 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b7ab8e-0627-4cf1-aa33-41afa4b59748 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] PATH_INFO: `/v3/groups/fe4b6277c85b487cbf3b663b0c6a5101/users/c65996abac84448da544ada89ddeef1f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:13.283760 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b7ab8e-0627-4cf1-aa33-41afa4b59748 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=fe4b6277c85b487cbf3b663b0c6a5101, user_id=c65996abac84448da544ada89ddeef1f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:13.285426 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3063/6099] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:34:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:34:13.285702 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b7ab8e-0627-4cf1-aa33-41afa4b59748 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:13.286635 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc66f0bf-2e1f-456f-af0e-a061414a726e None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:13.289164 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-dc66f0bf-2e1f-456f-af0e-a061414a726e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:13.295437 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-d3b7ab8e-0627-4cf1-aa33-41afa4b59748 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'c65996abac84448da544ada89ddeef1f'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:13.302728 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc66f0bf-2e1f-456f-af0e-a061414a726e None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:13.307694 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ad97eb-5771-47b3-93fa-bb5d53e34399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:13.308392 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ad97eb-5771-47b3-93fa-bb5d53e34399 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:13.308657 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ad97eb-5771-47b3-93fa-bb5d53e34399 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:13.308926 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ad97eb-5771-47b3-93fa-bb5d53e34399 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:13.309647 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ad97eb-5771-47b3-93fa-bb5d53e34399 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:13.317961 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3037/6100] 10.222.0.17 () {58 vars in 1343 bytes} [Sat Jul 23 21:34:13 2022] DELETE /identity/v3/groups/fe4b6277c85b487cbf3b663b0c6a5101/users/c65996abac84448da544ada89ddeef1f => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:13.318181 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ad97eb-5771-47b3-93fa-bb5d53e34399 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:13.318307 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b7ab8e-0627-4cf1-aa33-41afa4b59748 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:13.318307 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-d3b7ab8e-0627-4cf1-aa33-41afa4b59748 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:13.326158 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3064/6101] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:34:13 2022] GET /identity/v3/roles => generated 2321 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:34:13.326158 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ad97eb-5771-47b3-93fa-bb5d53e34399 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:13.334459 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ad97eb-5771-47b3-93fa-bb5d53e34399 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:13.375069 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b7ab8e-0627-4cf1-aa33-41afa4b59748 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:13.378807 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0429b0de-3af4-459c-8b55-ae9c1eb81eaa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:13.379459 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0429b0de-3af4-459c-8b55-ae9c1eb81eaa service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:13.379739 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0429b0de-3af4-459c-8b55-ae9c1eb81eaa service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:13.380015 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0429b0de-3af4-459c-8b55-ae9c1eb81eaa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:13.384241 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:13.391297 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb56fddf-fabb-4dbf-8f8c-13aa4ec6e06f tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce5b7c9a7e31401d8c04a24af809ed81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '816984c605114e4680f81fb019e5229f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:13.392181 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb56fddf-fabb-4dbf-8f8c-13aa4ec6e06f tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:13.392483 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb56fddf-fabb-4dbf-8f8c-13aa4ec6e06f tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:13.392761 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb56fddf-fabb-4dbf-8f8c-13aa4ec6e06f tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] PATH_INFO: `/v3/system/groups/fe4b6277c85b487cbf3b663b0c6a5101/roles/2564d3143890441ba9b4a9ae8a4875d3` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:13.394577 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb56fddf-fabb-4dbf-8f8c-13aa4ec6e06f tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorizing `identity:create_system_grant_for_group(group_id=fe4b6277c85b487cbf3b663b0c6a5101, role_id=2564d3143890441ba9b4a9ae8a4875d3)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:13.395781 ncdv-master-1 devstack@keystone.service[91548]: WARNING py.warnings [None req-fb56fddf-fabb-4dbf-8f8c-13aa4ec6e06f tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_system_grant_for_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:34:13.395781 ncdv-master-1 devstack@keystone.service[91548]: warnings.warn(msg) Jul 23 21:34:13.395781 ncdv-master-1 devstack@keystone.service[91548]: Jul 23 21:34:13.396669 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb56fddf-fabb-4dbf-8f8c-13aa4ec6e06f tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:13.404429 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3065/6102] 10.222.0.17 () {60 vars in 1380 bytes} [Sat Jul 23 21:34:13 2022] PUT /identity/v3/system/groups/fe4b6277c85b487cbf3b663b0c6a5101/roles/2564d3143890441ba9b4a9ae8a4875d3 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:13.405320 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb56fddf-fabb-4dbf-8f8c-13aa4ec6e06f tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:13.443278 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0429b0de-3af4-459c-8b55-ae9c1eb81eaa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:13.444778 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0429b0de-3af4-459c-8b55-ae9c1eb81eaa service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:13.455099 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3038/6103] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:34:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:34:13.456178 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0429b0de-3af4-459c-8b55-ae9c1eb81eaa service neutron] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:13.462925 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:13.468102 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0429b0de-3af4-459c-8b55-ae9c1eb81eaa service neutron] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:13.468641 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb56fddf-fabb-4dbf-8f8c-13aa4ec6e06f tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:13.474088 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77975c49-5fc5-45e5-8c04-f475411d1b4a tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce5b7c9a7e31401d8c04a24af809ed81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '816984c605114e4680f81fb019e5229f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:13.474918 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77975c49-5fc5-45e5-8c04-f475411d1b4a tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:13.475552 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77975c49-5fc5-45e5-8c04-f475411d1b4a tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:13.475824 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77975c49-5fc5-45e5-8c04-f475411d1b4a tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] PATH_INFO: `/v3/system/groups/fe4b6277c85b487cbf3b663b0c6a5101/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:13.476500 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdc8f66-ad95-45a0-b547-b8072ac0e43e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:13.477127 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77975c49-5fc5-45e5-8c04-f475411d1b4a tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorizing `identity:list_system_grants_for_group(group_id=fe4b6277c85b487cbf3b663b0c6a5101)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:13.478247 ncdv-master-1 devstack@keystone.service[91547]: WARNING py.warnings [None req-77975c49-5fc5-45e5-8c04-f475411d1b4a tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_system_grants_for_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:34:13.478247 ncdv-master-1 devstack@keystone.service[91547]: warnings.warn(msg) Jul 23 21:34:13.478247 ncdv-master-1 devstack@keystone.service[91547]: Jul 23 21:34:13.478615 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdc8f66-ad95-45a0-b547-b8072ac0e43e admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:13.479134 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77975c49-5fc5-45e5-8c04-f475411d1b4a tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:13.479426 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdc8f66-ad95-45a0-b547-b8072ac0e43e admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:13.480292 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdc8f66-ad95-45a0-b547-b8072ac0e43e admin admin] PATH_INFO: `/v3/projects/be55450fe3654224b6455aec3063ca29/users/b8d487c62e984d8facfc6069763007d4/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:13.493565 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3039/6104] 10.222.0.17 () {58 vars in 1262 bytes} [Sat Jul 23 21:34:13 2022] GET /identity/v3/system/groups/fe4b6277c85b487cbf3b663b0c6a5101/roles => generated 376 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:34:13.497718 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77975c49-5fc5-45e5-8c04-f475411d1b4a tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:13.503306 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdc8f66-ad95-45a0-b547-b8072ac0e43e admin admin] RBAC: Authorizing `identity:create_grant(project_id=be55450fe3654224b6455aec3063ca29, user_id=b8d487c62e984d8facfc6069763007d4, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:13.506183 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdc8f66-ad95-45a0-b547-b8072ac0e43e admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:13.509028 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77975c49-5fc5-45e5-8c04-f475411d1b4a tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:13.514895 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d210390b-05b7-4775-8cf2-53bc90745f1d tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce5b7c9a7e31401d8c04a24af809ed81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '816984c605114e4680f81fb019e5229f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:13.515801 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d210390b-05b7-4775-8cf2-53bc90745f1d tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] REQUEST_METHOD: `HEAD` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:13.516085 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d210390b-05b7-4775-8cf2-53bc90745f1d tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:13.516401 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d210390b-05b7-4775-8cf2-53bc90745f1d tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] PATH_INFO: `/v3/system/groups/fe4b6277c85b487cbf3b663b0c6a5101/roles/2564d3143890441ba9b4a9ae8a4875d3` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:13.518556 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d210390b-05b7-4775-8cf2-53bc90745f1d tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorizing `identity:check_system_grant_for_group(group_id=fe4b6277c85b487cbf3b663b0c6a5101, role_id=2564d3143890441ba9b4a9ae8a4875d3)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:13.519822 ncdv-master-1 devstack@keystone.service[91547]: WARNING py.warnings [None req-d210390b-05b7-4775-8cf2-53bc90745f1d tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_system_grant_for_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:34:13.519822 ncdv-master-1 devstack@keystone.service[91547]: warnings.warn(msg) Jul 23 21:34:13.519822 ncdv-master-1 devstack@keystone.service[91547]: Jul 23 21:34:13.520863 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d210390b-05b7-4775-8cf2-53bc90745f1d tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:13.526752 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3066/6105] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:34:13 2022] PUT /identity/v3/projects/be55450fe3654224b6455aec3063ca29/users/b8d487c62e984d8facfc6069763007d4/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:13.528084 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdc8f66-ad95-45a0-b547-b8072ac0e43e admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:13.528927 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3040/6106] 10.222.0.17 () {58 vars in 1362 bytes} [Sat Jul 23 21:34:13 2022] HEAD /identity/v3/system/groups/fe4b6277c85b487cbf3b663b0c6a5101/roles/2564d3143890441ba9b4a9ae8a4875d3 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:34:13.532874 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d210390b-05b7-4775-8cf2-53bc90745f1d tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:13.545317 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d210390b-05b7-4775-8cf2-53bc90745f1d tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:13.611462 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde301cf-87d4-41ac-9499-b388142b4d68 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce5b7c9a7e31401d8c04a24af809ed81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '816984c605114e4680f81fb019e5229f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:13.612354 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde301cf-87d4-41ac-9499-b388142b4d68 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:13.612648 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde301cf-87d4-41ac-9499-b388142b4d68 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:13.612922 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde301cf-87d4-41ac-9499-b388142b4d68 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] PATH_INFO: `/v3/system/groups/fe4b6277c85b487cbf3b663b0c6a5101/roles/2564d3143890441ba9b4a9ae8a4875d3` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:13.616006 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde301cf-87d4-41ac-9499-b388142b4d68 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorizing `identity:revoke_system_grant_for_group(group_id=fe4b6277c85b487cbf3b663b0c6a5101, role_id=2564d3143890441ba9b4a9ae8a4875d3)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:13.617067 ncdv-master-1 devstack@keystone.service[91547]: WARNING py.warnings [None req-fde301cf-87d4-41ac-9499-b388142b4d68 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_system_grant_for_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:34:13.617067 ncdv-master-1 devstack@keystone.service[91547]: warnings.warn(msg) Jul 23 21:34:13.617067 ncdv-master-1 devstack@keystone.service[91547]: Jul 23 21:34:13.618237 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde301cf-87d4-41ac-9499-b388142b4d68 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:13.620205 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdc8f66-ad95-45a0-b547-b8072ac0e43e admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:13.629670 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3041/6107] 10.222.0.17 () {58 vars in 1364 bytes} [Sat Jul 23 21:34:13 2022] DELETE /identity/v3/system/groups/fe4b6277c85b487cbf3b663b0c6a5101/roles/2564d3143890441ba9b4a9ae8a4875d3 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:34:13.636704 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf33a377-814a-484e-be91-1458e649634b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:13.637514 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde301cf-87d4-41ac-9499-b388142b4d68 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:13.637647 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf33a377-814a-484e-be91-1458e649634b admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:13.638135 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf33a377-814a-484e-be91-1458e649634b admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:13.638690 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf33a377-814a-484e-be91-1458e649634b admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:13.639756 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf33a377-814a-484e-be91-1458e649634b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:13.641505 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf33a377-814a-484e-be91-1458e649634b admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:13.649063 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde301cf-87d4-41ac-9499-b388142b4d68 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:13.658474 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7266bf-a35e-46b6-9e92-1f3dd41c9f0c tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce5b7c9a7e31401d8c04a24af809ed81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '816984c605114e4680f81fb019e5229f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:13.658673 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3067/6108] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:34:13 2022] GET /identity/v3/roles => generated 2321 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 21:34:13.658778 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7266bf-a35e-46b6-9e92-1f3dd41c9f0c tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:13.658778 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7266bf-a35e-46b6-9e92-1f3dd41c9f0c tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:13.658778 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7266bf-a35e-46b6-9e92-1f3dd41c9f0c tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] PATH_INFO: `/v3/domains/dc17eda5ad6a4b88955633ee14bd6b57/users/c65996abac84448da544ada89ddeef1f/roles/2564d3143890441ba9b4a9ae8a4875d3` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:13.659947 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7266bf-a35e-46b6-9e92-1f3dd41c9f0c tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=dc17eda5ad6a4b88955633ee14bd6b57, user_id=c65996abac84448da544ada89ddeef1f, role_id=2564d3143890441ba9b4a9ae8a4875d3)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:13.660817 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf33a377-814a-484e-be91-1458e649634b admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:13.662719 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7266bf-a35e-46b6-9e92-1f3dd41c9f0c tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:13.672409 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf33a377-814a-484e-be91-1458e649634b admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:13.681683 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3042/6109] 10.222.0.17 () {60 vars in 1479 bytes} [Sat Jul 23 21:34:13 2022] PUT /identity/v3/domains/dc17eda5ad6a4b88955633ee14bd6b57/users/c65996abac84448da544ada89ddeef1f/roles/2564d3143890441ba9b4a9ae8a4875d3 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:34:13.685696 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7266bf-a35e-46b6-9e92-1f3dd41c9f0c tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:13.739946 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8654db-2a1a-4e23-8508-5e674a958d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:13.741053 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8654db-2a1a-4e23-8508-5e674a958d7d admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:13.741333 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8654db-2a1a-4e23-8508-5e674a958d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:13.741606 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8654db-2a1a-4e23-8508-5e674a958d7d admin admin] PATH_INFO: `/v3/projects/be55450fe3654224b6455aec3063ca29/users/b8d487c62e984d8facfc6069763007d4/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:13.743748 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8654db-2a1a-4e23-8508-5e674a958d7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=be55450fe3654224b6455aec3063ca29, user_id=b8d487c62e984d8facfc6069763007d4, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:13.746503 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8654db-2a1a-4e23-8508-5e674a958d7d admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:13.757853 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3068/6110] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:34:13 2022] PUT /identity/v3/projects/be55450fe3654224b6455aec3063ca29/users/b8d487c62e984d8facfc6069763007d4/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:13.762822 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7266bf-a35e-46b6-9e92-1f3dd41c9f0c tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:13.769020 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede3a665-2b87-4609-ae9b-3499106cf16c None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:13.769351 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede3a665-2b87-4609-ae9b-3499106cf16c None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:13.769629 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede3a665-2b87-4609-ae9b-3499106cf16c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:13.770868 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:13.800794 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-ede3a665-2b87-4609-ae9b-3499106cf16c None None] MFA Rules not processed for user `b8d487c62e984d8facfc6069763007d4`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:34:13.802269 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-ede3a665-2b87-4609-ae9b-3499106cf16c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:13.841852 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7435cfe-8b38-4f26-b7e4-4e624c1814a1 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce5b7c9a7e31401d8c04a24af809ed81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '816984c605114e4680f81fb019e5229f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:13.842985 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7435cfe-8b38-4f26-b7e4-4e624c1814a1 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:13.843338 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7435cfe-8b38-4f26-b7e4-4e624c1814a1 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:13.843703 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7435cfe-8b38-4f26-b7e4-4e624c1814a1 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] PATH_INFO: `/v3/domains/dc17eda5ad6a4b88955633ee14bd6b57/users/c65996abac84448da544ada89ddeef1f/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:13.845825 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7435cfe-8b38-4f26-b7e4-4e624c1814a1 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=dc17eda5ad6a4b88955633ee14bd6b57, user_id=c65996abac84448da544ada89ddeef1f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:13.848351 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7435cfe-8b38-4f26-b7e4-4e624c1814a1 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:13.861814 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3043/6111] 10.222.0.17 () {58 vars in 1361 bytes} [Sat Jul 23 21:34:13 2022] GET /identity/v3/domains/dc17eda5ad6a4b88955633ee14bd6b57/users/c65996abac84448da544ada89ddeef1f/roles => generated 409 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:34:13.862944 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7435cfe-8b38-4f26-b7e4-4e624c1814a1 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:13.866878 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-f7435cfe-8b38-4f26-b7e4-4e624c1814a1 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:13.876683 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:13.888876 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3069/6112] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:34:13 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:34:13.889941 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede3a665-2b87-4609-ae9b-3499106cf16c None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:13.900231 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede3a665-2b87-4609-ae9b-3499106cf16c None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:13.904940 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ee35ac-b8c4-4f35-8e2f-1f2fec7c87fc tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce5b7c9a7e31401d8c04a24af809ed81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '816984c605114e4680f81fb019e5229f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:13.905852 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ee35ac-b8c4-4f35-8e2f-1f2fec7c87fc tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] REQUEST_METHOD: `HEAD` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:13.906158 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ee35ac-b8c4-4f35-8e2f-1f2fec7c87fc tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:13.906430 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ee35ac-b8c4-4f35-8e2f-1f2fec7c87fc tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] PATH_INFO: `/v3/domains/dc17eda5ad6a4b88955633ee14bd6b57/users/c65996abac84448da544ada89ddeef1f/roles/2564d3143890441ba9b4a9ae8a4875d3` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:13.909160 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ee35ac-b8c4-4f35-8e2f-1f2fec7c87fc tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=dc17eda5ad6a4b88955633ee14bd6b57, user_id=c65996abac84448da544ada89ddeef1f, role_id=2564d3143890441ba9b4a9ae8a4875d3)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:13.911876 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ee35ac-b8c4-4f35-8e2f-1f2fec7c87fc tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:13.918884 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3070/6113] 10.222.0.17 () {58 vars in 1461 bytes} [Sat Jul 23 21:34:13 2022] HEAD /identity/v3/domains/dc17eda5ad6a4b88955633ee14bd6b57/users/c65996abac84448da544ada89ddeef1f/roles/2564d3143890441ba9b4a9ae8a4875d3 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:13.919826 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ee35ac-b8c4-4f35-8e2f-1f2fec7c87fc tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:13.932896 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ee35ac-b8c4-4f35-8e2f-1f2fec7c87fc tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:13.937669 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7b3fc1-abc1-4ba2-8f5e-cd97d9864151 tempest-ListProjectsTestJSON-1307190150 tempest-ListProjectsTestJSON-1307190150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8d487c62e984d8facfc6069763007d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be55450fe3654224b6455aec3063ca29', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:13.938378 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7b3fc1-abc1-4ba2-8f5e-cd97d9864151 tempest-ListProjectsTestJSON-1307190150 tempest-ListProjectsTestJSON-1307190150-project-admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:13.938664 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7b3fc1-abc1-4ba2-8f5e-cd97d9864151 tempest-ListProjectsTestJSON-1307190150 tempest-ListProjectsTestJSON-1307190150-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:13.938941 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7b3fc1-abc1-4ba2-8f5e-cd97d9864151 tempest-ListProjectsTestJSON-1307190150 tempest-ListProjectsTestJSON-1307190150-project-admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:13.939641 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7b3fc1-abc1-4ba2-8f5e-cd97d9864151 tempest-ListProjectsTestJSON-1307190150 tempest-ListProjectsTestJSON-1307190150-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:13.941550 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7b3fc1-abc1-4ba2-8f5e-cd97d9864151 tempest-ListProjectsTestJSON-1307190150 tempest-ListProjectsTestJSON-1307190150-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:13.950130 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7435cfe-8b38-4f26-b7e4-4e624c1814a1 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:13.955416 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ad1797-374d-4e6e-bbaa-623f0e535a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:13.956295 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ad1797-374d-4e6e-bbaa-623f0e535a63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:13.956573 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ad1797-374d-4e6e-bbaa-623f0e535a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:13.956850 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ad1797-374d-4e6e-bbaa-623f0e535a63 admin admin] PATH_INFO: `/v3/projects/033dc11a6c2144be9959e00ced250baa` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:13.958171 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ad1797-374d-4e6e-bbaa-623f0e535a63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=033dc11a6c2144be9959e00ced250baa)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:13.960600 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ad1797-374d-4e6e-bbaa-623f0e535a63 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:13.972776 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3071/6114] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:34:13 2022] POST /identity/v3/projects => generated 334 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:34:13.972776 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7b3fc1-abc1-4ba2-8f5e-cd97d9864151 tempest-ListProjectsTestJSON-1307190150 tempest-ListProjectsTestJSON-1307190150-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:14.012782 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-97ad1797-374d-4e6e-bbaa-623f0e535a63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '033dc11a6c2144be9959e00ced250baa', 'request_id': 'req-97ad1797-374d-4e6e-bbaa-623f0e535a63'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:14.021542 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-97ad1797-374d-4e6e-bbaa-623f0e535a63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '033dc11a6c2144be9959e00ced250baa', 'request_id': 'req-97ad1797-374d-4e6e-bbaa-623f0e535a63'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:14.027250 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-97ad1797-374d-4e6e-bbaa-623f0e535a63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '033dc11a6c2144be9959e00ced250baa', 'request_id': 'req-97ad1797-374d-4e6e-bbaa-623f0e535a63'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:14.034478 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7b3fc1-abc1-4ba2-8f5e-cd97d9864151 tempest-ListProjectsTestJSON-1307190150 tempest-ListProjectsTestJSON-1307190150-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:14.038220 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-97ad1797-374d-4e6e-bbaa-623f0e535a63 admin admin] The token cache is being invalidate because project 033dc11a6c2144be9959e00ced250baa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:34:14.038506 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-97ad1797-374d-4e6e-bbaa-623f0e535a63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:14.039161 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-97ad1797-374d-4e6e-bbaa-623f0e535a63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:14.040747 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3044/6115] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:34:13 2022] DELETE /identity/v3/projects/033dc11a6c2144be9959e00ced250baa => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:14.041490 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ad1797-374d-4e6e-bbaa-623f0e535a63 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:14.042824 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-97ad1797-374d-4e6e-bbaa-623f0e535a63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:14.079624 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:14.095923 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350da416-6f6e-43bd-b676-6b685afdba66 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce5b7c9a7e31401d8c04a24af809ed81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '816984c605114e4680f81fb019e5229f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:14.096901 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350da416-6f6e-43bd-b676-6b685afdba66 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:14.097128 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350da416-6f6e-43bd-b676-6b685afdba66 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:14.097422 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350da416-6f6e-43bd-b676-6b685afdba66 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] PATH_INFO: `/v3/domains/dc17eda5ad6a4b88955633ee14bd6b57/users/c65996abac84448da544ada89ddeef1f/roles/2564d3143890441ba9b4a9ae8a4875d3` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:14.099737 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350da416-6f6e-43bd-b676-6b685afdba66 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=dc17eda5ad6a4b88955633ee14bd6b57, user_id=c65996abac84448da544ada89ddeef1f, role_id=2564d3143890441ba9b4a9ae8a4875d3)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:14.102794 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350da416-6f6e-43bd-b676-6b685afdba66 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:14.108219 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-350da416-6f6e-43bd-b676-6b685afdba66 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Invalidating the token cache because role 2564d3143890441ba9b4a9ae8a4875d3 was removed from user c65996abac84448da544ada89ddeef1f on domain dc17eda5ad6a4b88955633ee14bd6b57. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:34:14.108554 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-350da416-6f6e-43bd-b676-6b685afdba66 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:14.109311 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-350da416-6f6e-43bd-b676-6b685afdba66 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:14.112540 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ad1797-374d-4e6e-bbaa-623f0e535a63 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:14.117546 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c505c3c-f24f-47a4-9f5f-ae8703ab213b tempest-ListProjectsTestJSON-1307190150 tempest-ListProjectsTestJSON-1307190150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8d487c62e984d8facfc6069763007d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be55450fe3654224b6455aec3063ca29', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:14.118250 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c505c3c-f24f-47a4-9f5f-ae8703ab213b tempest-ListProjectsTestJSON-1307190150 tempest-ListProjectsTestJSON-1307190150-project-admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:14.118534 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c505c3c-f24f-47a4-9f5f-ae8703ab213b tempest-ListProjectsTestJSON-1307190150 tempest-ListProjectsTestJSON-1307190150-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:14.118808 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c505c3c-f24f-47a4-9f5f-ae8703ab213b tempest-ListProjectsTestJSON-1307190150 tempest-ListProjectsTestJSON-1307190150-project-admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:14.119604 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c505c3c-f24f-47a4-9f5f-ae8703ab213b tempest-ListProjectsTestJSON-1307190150 tempest-ListProjectsTestJSON-1307190150-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:14.121524 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c505c3c-f24f-47a4-9f5f-ae8703ab213b tempest-ListProjectsTestJSON-1307190150 tempest-ListProjectsTestJSON-1307190150-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:14.123393 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3072/6116] 10.222.0.17 () {58 vars in 1463 bytes} [Sat Jul 23 21:34:13 2022] DELETE /identity/v3/domains/dc17eda5ad6a4b88955633ee14bd6b57/users/c65996abac84448da544ada89ddeef1f/roles/2564d3143890441ba9b4a9ae8a4875d3 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:14.124665 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60190557-2640-4055-9065-b3950a87fea4 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:14.124942 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60190557-2640-4055-9065-b3950a87fea4 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:14.125211 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60190557-2640-4055-9065-b3950a87fea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:14.143176 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-60190557-2640-4055-9065-b3950a87fea4 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:34:14.144502 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-60190557-2640-4055-9065-b3950a87fea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:14.160115 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3045/6117] 10.222.0.17 () {60 vars in 1151 bytes} [Sat Jul 23 21:34:14 2022] POST /identity/v3/projects => generated 333 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:34:14.160115 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c505c3c-f24f-47a4-9f5f-ae8703ab213b tempest-ListProjectsTestJSON-1307190150 tempest-ListProjectsTestJSON-1307190150-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:14.160115 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-3c505c3c-f24f-47a4-9f5f-ae8703ab213b tempest-ListProjectsTestJSON-1307190150 tempest-ListProjectsTestJSON-1307190150-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:14.201924 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:14.213188 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3073/6118] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:34:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:34:14.214101 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60190557-2640-4055-9065-b3950a87fea4 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:14.215432 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-60190557-2640-4055-9065-b3950a87fea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:14.226525 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c505c3c-f24f-47a4-9f5f-ae8703ab213b tempest-ListProjectsTestJSON-1307190150 tempest-ListProjectsTestJSON-1307190150-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:14.231133 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d823b965-afda-46ef-be5c-47e59313b17b tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce5b7c9a7e31401d8c04a24af809ed81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '816984c605114e4680f81fb019e5229f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:14.232065 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d823b965-afda-46ef-be5c-47e59313b17b tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:14.232345 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d823b965-afda-46ef-be5c-47e59313b17b tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:14.232620 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d823b965-afda-46ef-be5c-47e59313b17b tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] PATH_INFO: `/v3/projects/359def4ccd9e4902b9bb28c95fc66cbc/users/c65996abac84448da544ada89ddeef1f/roles/2564d3143890441ba9b4a9ae8a4875d3` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:14.234937 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d823b965-afda-46ef-be5c-47e59313b17b tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorizing `identity:create_grant(project_id=359def4ccd9e4902b9bb28c95fc66cbc, user_id=c65996abac84448da544ada89ddeef1f, role_id=2564d3143890441ba9b4a9ae8a4875d3)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:14.237823 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d823b965-afda-46ef-be5c-47e59313b17b tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:14.253771 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3046/6119] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:34:14 2022] PUT /identity/v3/projects/359def4ccd9e4902b9bb28c95fc66cbc/users/c65996abac84448da544ada89ddeef1f/roles/2564d3143890441ba9b4a9ae8a4875d3 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:14.255393 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b069a43-90c1-43d2-b7d2-4f3749100071 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:14.255897 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b069a43-90c1-43d2-b7d2-4f3749100071 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:14.256286 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b069a43-90c1-43d2-b7d2-4f3749100071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:14.276706 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-5b069a43-90c1-43d2-b7d2-4f3749100071 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:34:14.278029 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-5b069a43-90c1-43d2-b7d2-4f3749100071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:14.297806 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60190557-2640-4055-9065-b3950a87fea4 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:14.337064 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3047/6120] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:34:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:34:14.337959 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b069a43-90c1-43d2-b7d2-4f3749100071 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:14.360892 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3c1bab-2068-41dd-a345-169d778c39f3 tempest-ListProjectsTestJSON-1307190150 tempest-ListProjectsTestJSON-1307190150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8d487c62e984d8facfc6069763007d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be55450fe3654224b6455aec3063ca29', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:14.361462 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3c1bab-2068-41dd-a345-169d778c39f3 tempest-ListProjectsTestJSON-1307190150 tempest-ListProjectsTestJSON-1307190150-project-admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:14.361747 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3c1bab-2068-41dd-a345-169d778c39f3 tempest-ListProjectsTestJSON-1307190150 tempest-ListProjectsTestJSON-1307190150-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:14.362069 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3c1bab-2068-41dd-a345-169d778c39f3 tempest-ListProjectsTestJSON-1307190150 tempest-ListProjectsTestJSON-1307190150-project-admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:14.362845 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3c1bab-2068-41dd-a345-169d778c39f3 tempest-ListProjectsTestJSON-1307190150 tempest-ListProjectsTestJSON-1307190150-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:14.364704 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3c1bab-2068-41dd-a345-169d778c39f3 tempest-ListProjectsTestJSON-1307190150 tempest-ListProjectsTestJSON-1307190150-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:14.391172 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:14.404607 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b069a43-90c1-43d2-b7d2-4f3749100071 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:14.409063 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3074/6121] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:34:14 2022] POST /identity/v3/projects => generated 357 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:34:14.409063 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3c1bab-2068-41dd-a345-169d778c39f3 tempest-ListProjectsTestJSON-1307190150 tempest-ListProjectsTestJSON-1307190150-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:14.463965 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc8ce74-eb4d-499e-a08d-ee7069d9db64 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce5b7c9a7e31401d8c04a24af809ed81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '816984c605114e4680f81fb019e5229f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:14.465012 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc8ce74-eb4d-499e-a08d-ee7069d9db64 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:14.465415 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc8ce74-eb4d-499e-a08d-ee7069d9db64 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:14.466351 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc8ce74-eb4d-499e-a08d-ee7069d9db64 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] PATH_INFO: `/v3/projects/359def4ccd9e4902b9bb28c95fc66cbc/users/c65996abac84448da544ada89ddeef1f/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:14.468187 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc8ce74-eb4d-499e-a08d-ee7069d9db64 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorizing `identity:list_grants(project_id=359def4ccd9e4902b9bb28c95fc66cbc, user_id=c65996abac84448da544ada89ddeef1f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:14.470500 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3c1bab-2068-41dd-a345-169d778c39f3 tempest-ListProjectsTestJSON-1307190150 tempest-ListProjectsTestJSON-1307190150-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:14.470993 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc8ce74-eb4d-499e-a08d-ee7069d9db64 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:14.476647 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5df9cf-f63e-4c51-8405-ff15faff000d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:14.477326 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5df9cf-f63e-4c51-8405-ff15faff000d admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:14.477609 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5df9cf-f63e-4c51-8405-ff15faff000d admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:14.477922 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5df9cf-f63e-4c51-8405-ff15faff000d admin admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:14.478660 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5df9cf-f63e-4c51-8405-ff15faff000d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:34:14.478965 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5df9cf-f63e-4c51-8405-ff15faff000d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:14.480748 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5df9cf-f63e-4c51-8405-ff15faff000d admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:14.484049 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3048/6122] 10.222.0.17 () {58 vars in 1364 bytes} [Sat Jul 23 21:34:14 2022] GET /identity/v3/projects/359def4ccd9e4902b9bb28c95fc66cbc/users/c65996abac84448da544ada89ddeef1f/roles => generated 410 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:34:14.484883 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc8ce74-eb4d-499e-a08d-ee7069d9db64 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:14.493515 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3075/6123] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:34:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:34:14.494275 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5df9cf-f63e-4c51-8405-ff15faff000d admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:14.505752 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5df9cf-f63e-4c51-8405-ff15faff000d admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:14.510525 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127f0ca3-9d24-4095-8124-1af0b878d6f0 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce5b7c9a7e31401d8c04a24af809ed81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '816984c605114e4680f81fb019e5229f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:14.511418 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127f0ca3-9d24-4095-8124-1af0b878d6f0 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] REQUEST_METHOD: `HEAD` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:14.511705 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127f0ca3-9d24-4095-8124-1af0b878d6f0 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:14.511984 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127f0ca3-9d24-4095-8124-1af0b878d6f0 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] PATH_INFO: `/v3/projects/359def4ccd9e4902b9bb28c95fc66cbc/users/c65996abac84448da544ada89ddeef1f/roles/2564d3143890441ba9b4a9ae8a4875d3` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:14.514309 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127f0ca3-9d24-4095-8124-1af0b878d6f0 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorizing `identity:check_grant(project_id=359def4ccd9e4902b9bb28c95fc66cbc, user_id=c65996abac84448da544ada89ddeef1f, role_id=2564d3143890441ba9b4a9ae8a4875d3)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:14.516955 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127f0ca3-9d24-4095-8124-1af0b878d6f0 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:14.523225 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3076/6124] 10.222.0.17 () {58 vars in 1464 bytes} [Sat Jul 23 21:34:14 2022] HEAD /identity/v3/projects/359def4ccd9e4902b9bb28c95fc66cbc/users/c65996abac84448da544ada89ddeef1f/roles/2564d3143890441ba9b4a9ae8a4875d3 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:14.524100 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127f0ca3-9d24-4095-8124-1af0b878d6f0 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:14.535533 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127f0ca3-9d24-4095-8124-1af0b878d6f0 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:14.541252 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d61995-1262-4a12-8a68-b61def50294b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:14.541926 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d61995-1262-4a12-8a68-b61def50294b admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:14.542213 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d61995-1262-4a12-8a68-b61def50294b admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:14.542491 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d61995-1262-4a12-8a68-b61def50294b admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:14.543175 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d61995-1262-4a12-8a68-b61def50294b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:14.545103 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d61995-1262-4a12-8a68-b61def50294b admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:14.548479 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc8ce74-eb4d-499e-a08d-ee7069d9db64 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:14.553471 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0cdc4e-20db-421c-a124-d6b1e9a06d90 tempest-ListProjectsTestJSON-1307190150 tempest-ListProjectsTestJSON-1307190150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8d487c62e984d8facfc6069763007d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be55450fe3654224b6455aec3063ca29', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:14.554180 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0cdc4e-20db-421c-a124-d6b1e9a06d90 tempest-ListProjectsTestJSON-1307190150 tempest-ListProjectsTestJSON-1307190150-project-admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:14.554346 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:14.554460 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0cdc4e-20db-421c-a124-d6b1e9a06d90 tempest-ListProjectsTestJSON-1307190150 tempest-ListProjectsTestJSON-1307190150-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:14.554761 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0cdc4e-20db-421c-a124-d6b1e9a06d90 tempest-ListProjectsTestJSON-1307190150 tempest-ListProjectsTestJSON-1307190150-project-admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:14.555531 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0cdc4e-20db-421c-a124-d6b1e9a06d90 tempest-ListProjectsTestJSON-1307190150 tempest-ListProjectsTestJSON-1307190150-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:14.557444 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0cdc4e-20db-421c-a124-d6b1e9a06d90 tempest-ListProjectsTestJSON-1307190150 tempest-ListProjectsTestJSON-1307190150-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:14.576907 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3077/6125] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:34:14 2022] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:34:14.576907 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d61995-1262-4a12-8a68-b61def50294b admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:14.584335 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3049/6126] 10.222.0.17 () {58 vars in 1130 bytes} [Sat Jul 23 21:34:14 2022] GET /identity/v3/projects => generated 7584 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:34:14.585278 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0cdc4e-20db-421c-a124-d6b1e9a06d90 tempest-ListProjectsTestJSON-1307190150 tempest-ListProjectsTestJSON-1307190150-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:14.596050 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0cdc4e-20db-421c-a124-d6b1e9a06d90 tempest-ListProjectsTestJSON-1307190150 tempest-ListProjectsTestJSON-1307190150-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:14.650312 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d61995-1262-4a12-8a68-b61def50294b admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:14.655342 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3106c11d-94de-480a-9c55-ae1923138fc4 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce5b7c9a7e31401d8c04a24af809ed81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '816984c605114e4680f81fb019e5229f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:14.656260 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3106c11d-94de-480a-9c55-ae1923138fc4 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:14.656546 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3106c11d-94de-480a-9c55-ae1923138fc4 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:14.657008 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3106c11d-94de-480a-9c55-ae1923138fc4 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] PATH_INFO: `/v3/projects/359def4ccd9e4902b9bb28c95fc66cbc/users/c65996abac84448da544ada89ddeef1f/roles/2564d3143890441ba9b4a9ae8a4875d3` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:14.657373 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830c787b-09b5-4165-a01a-67b23e789417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:14.658161 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830c787b-09b5-4165-a01a-67b23e789417 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:14.658679 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830c787b-09b5-4165-a01a-67b23e789417 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:14.659011 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830c787b-09b5-4165-a01a-67b23e789417 admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:14.659803 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830c787b-09b5-4165-a01a-67b23e789417 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:14.661275 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3106c11d-94de-480a-9c55-ae1923138fc4 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=359def4ccd9e4902b9bb28c95fc66cbc, user_id=c65996abac84448da544ada89ddeef1f, role_id=2564d3143890441ba9b4a9ae8a4875d3)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:14.661657 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830c787b-09b5-4165-a01a-67b23e789417 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:14.664003 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3106c11d-94de-480a-9c55-ae1923138fc4 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:14.669940 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-3106c11d-94de-480a-9c55-ae1923138fc4 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Invalidating the token cache because role 2564d3143890441ba9b4a9ae8a4875d3 was removed from user c65996abac84448da544ada89ddeef1f on project 359def4ccd9e4902b9bb28c95fc66cbc. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:34:14.670234 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-3106c11d-94de-480a-9c55-ae1923138fc4 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:14.671046 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-3106c11d-94de-480a-9c55-ae1923138fc4 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:14.689306 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3050/6128] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:34:14 2022] POST /identity/v3/users => generated 293 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:34:14.689558 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3078/6128] 10.222.0.17 () {58 vars in 1466 bytes} [Sat Jul 23 21:34:14 2022] DELETE /identity/v3/projects/359def4ccd9e4902b9bb28c95fc66cbc/users/c65996abac84448da544ada89ddeef1f/roles/2564d3143890441ba9b4a9ae8a4875d3 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:14.689558 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3106c11d-94de-480a-9c55-ae1923138fc4 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:14.691979 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830c787b-09b5-4165-a01a-67b23e789417 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:14.693667 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-830c787b-09b5-4165-a01a-67b23e789417 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:14.699194 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-3106c11d-94de-480a-9c55-ae1923138fc4 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:14.706456 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830c787b-09b5-4165-a01a-67b23e789417 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:14.716190 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:14.772390 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb0a50a-1999-4ab6-aca5-51831a05fd19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:14.773080 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb0a50a-1999-4ab6-aca5-51831a05fd19 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:14.773415 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb0a50a-1999-4ab6-aca5-51831a05fd19 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:14.773699 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb0a50a-1999-4ab6-aca5-51831a05fd19 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:14.774513 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb0a50a-1999-4ab6-aca5-51831a05fd19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:14.776164 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb0a50a-1999-4ab6-aca5-51831a05fd19 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:14.781450 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3106c11d-94de-480a-9c55-ae1923138fc4 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:14.787044 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fe5243-d67f-4787-81c0-4254435f0d96 tempest-ListProjectsTestJSON-1307190150 tempest-ListProjectsTestJSON-1307190150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8d487c62e984d8facfc6069763007d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be55450fe3654224b6455aec3063ca29', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:14.787884 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fe5243-d67f-4787-81c0-4254435f0d96 tempest-ListProjectsTestJSON-1307190150 tempest-ListProjectsTestJSON-1307190150-project-admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:14.788123 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fe5243-d67f-4787-81c0-4254435f0d96 tempest-ListProjectsTestJSON-1307190150 tempest-ListProjectsTestJSON-1307190150-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:14.788435 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fe5243-d67f-4787-81c0-4254435f0d96 tempest-ListProjectsTestJSON-1307190150 tempest-ListProjectsTestJSON-1307190150-project-admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:14.791950 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3051/6129] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:34:14 2022] GET /identity/v3/roles => generated 2321 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:34:14.792095 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fe5243-d67f-4787-81c0-4254435f0d96 tempest-ListProjectsTestJSON-1307190150 tempest-ListProjectsTestJSON-1307190150-project-admin] RBAC: Adding query filter params (enabled=False) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:34:14.792095 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fe5243-d67f-4787-81c0-4254435f0d96 tempest-ListProjectsTestJSON-1307190150 tempest-ListProjectsTestJSON-1307190150-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:14.792293 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb0a50a-1999-4ab6-aca5-51831a05fd19 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:14.792293 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-ffb0a50a-1999-4ab6-aca5-51831a05fd19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:14.792484 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fe5243-d67f-4787-81c0-4254435f0d96 tempest-ListProjectsTestJSON-1307190150 tempest-ListProjectsTestJSON-1307190150-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:14.814706 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3079/6130] 10.222.0.17 () {58 vars in 1157 bytes} [Sat Jul 23 21:34:14 2022] GET /identity/v3/projects?enabled=False => generated 445 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:34:14.815610 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fe5243-d67f-4787-81c0-4254435f0d96 tempest-ListProjectsTestJSON-1307190150 tempest-ListProjectsTestJSON-1307190150-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:14.826677 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fe5243-d67f-4787-81c0-4254435f0d96 tempest-ListProjectsTestJSON-1307190150 tempest-ListProjectsTestJSON-1307190150-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:14.831314 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a2136d-216e-46d1-91d5-16084742d197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:14.831982 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a2136d-216e-46d1-91d5-16084742d197 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:14.832268 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a2136d-216e-46d1-91d5-16084742d197 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:14.832550 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a2136d-216e-46d1-91d5-16084742d197 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:14.833276 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a2136d-216e-46d1-91d5-16084742d197 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:14.835018 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a2136d-216e-46d1-91d5-16084742d197 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:14.846708 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3080/6131] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:34:14 2022] GET /identity/v3/roles => generated 2321 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:34:14.847512 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a2136d-216e-46d1-91d5-16084742d197 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:14.858285 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a2136d-216e-46d1-91d5-16084742d197 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:14.862837 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f471225a-b874-4674-b5f6-37b1edaa7db3 tempest-ListProjectsTestJSON-1307190150 tempest-ListProjectsTestJSON-1307190150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8d487c62e984d8facfc6069763007d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be55450fe3654224b6455aec3063ca29', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:14.863469 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f471225a-b874-4674-b5f6-37b1edaa7db3 tempest-ListProjectsTestJSON-1307190150 tempest-ListProjectsTestJSON-1307190150-project-admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:14.863756 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f471225a-b874-4674-b5f6-37b1edaa7db3 tempest-ListProjectsTestJSON-1307190150 tempest-ListProjectsTestJSON-1307190150-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:14.864043 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f471225a-b874-4674-b5f6-37b1edaa7db3 tempest-ListProjectsTestJSON-1307190150 tempest-ListProjectsTestJSON-1307190150-project-admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:14.864781 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f471225a-b874-4674-b5f6-37b1edaa7db3 tempest-ListProjectsTestJSON-1307190150 tempest-ListProjectsTestJSON-1307190150-project-admin] RBAC: Adding query filter params (parent_id=fc0a406920f047ab94d9bf5150a82211) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:34:14.865157 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f471225a-b874-4674-b5f6-37b1edaa7db3 tempest-ListProjectsTestJSON-1307190150 tempest-ListProjectsTestJSON-1307190150-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:14.865329 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb0a50a-1999-4ab6-aca5-51831a05fd19 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:14.867011 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f471225a-b874-4674-b5f6-37b1edaa7db3 tempest-ListProjectsTestJSON-1307190150 tempest-ListProjectsTestJSON-1307190150-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:14.869959 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98927fd3-0ed3-4605-8f7d-81f80fd4f612 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce5b7c9a7e31401d8c04a24af809ed81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '816984c605114e4680f81fb019e5229f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:14.870831 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98927fd3-0ed3-4605-8f7d-81f80fd4f612 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:14.871109 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98927fd3-0ed3-4605-8f7d-81f80fd4f612 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:14.871590 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98927fd3-0ed3-4605-8f7d-81f80fd4f612 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] PATH_INFO: `/v3/system/users/c65996abac84448da544ada89ddeef1f/roles/2564d3143890441ba9b4a9ae8a4875d3` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:14.873331 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98927fd3-0ed3-4605-8f7d-81f80fd4f612 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=c65996abac84448da544ada89ddeef1f, role_id=2564d3143890441ba9b4a9ae8a4875d3)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:14.874379 ncdv-master-1 devstack@keystone.service[91547]: WARNING py.warnings [None req-98927fd3-0ed3-4605-8f7d-81f80fd4f612 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:34:14.874379 ncdv-master-1 devstack@keystone.service[91547]: warnings.warn(msg) Jul 23 21:34:14.874379 ncdv-master-1 devstack@keystone.service[91547]: Jul 23 21:34:14.875260 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98927fd3-0ed3-4605-8f7d-81f80fd4f612 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:14.886299 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3052/6132] 10.222.0.17 () {60 vars in 1377 bytes} [Sat Jul 23 21:34:14 2022] PUT /identity/v3/system/users/c65996abac84448da544ada89ddeef1f/roles/2564d3143890441ba9b4a9ae8a4875d3 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:14.886299 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98927fd3-0ed3-4605-8f7d-81f80fd4f612 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:14.886558 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3081/6133] 10.222.0.17 () {58 vars in 1215 bytes} [Sat Jul 23 21:34:14 2022] GET /identity/v3/projects?parent_id=fc0a406920f047ab94d9bf5150a82211 => generated 497 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:34:14.889610 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f471225a-b874-4674-b5f6-37b1edaa7db3 tempest-ListProjectsTestJSON-1307190150 tempest-ListProjectsTestJSON-1307190150-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:14.896954 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98927fd3-0ed3-4605-8f7d-81f80fd4f612 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:14.901330 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f471225a-b874-4674-b5f6-37b1edaa7db3 tempest-ListProjectsTestJSON-1307190150 tempest-ListProjectsTestJSON-1307190150-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:14.901487 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2890f41-2387-4d48-a88b-d8b5eceefeaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:14.902421 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2890f41-2387-4d48-a88b-d8b5eceefeaa admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:14.902706 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2890f41-2387-4d48-a88b-d8b5eceefeaa admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:14.902985 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2890f41-2387-4d48-a88b-d8b5eceefeaa admin admin] PATH_INFO: `/v3/projects/ca2f781f289346149505ff184d564e1b/users/fb86139c0aae43e8983e0a92e4553307/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:14.906981 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45624584-a7e4-426d-a903-cc772e2c6593 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce5b7c9a7e31401d8c04a24af809ed81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '816984c605114e4680f81fb019e5229f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:14.907800 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45624584-a7e4-426d-a903-cc772e2c6593 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:14.908083 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45624584-a7e4-426d-a903-cc772e2c6593 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:14.908358 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45624584-a7e4-426d-a903-cc772e2c6593 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] PATH_INFO: `/v3/system/users/c65996abac84448da544ada89ddeef1f/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:14.909688 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45624584-a7e4-426d-a903-cc772e2c6593 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorizing `identity:list_system_grants_for_user(user_id=c65996abac84448da544ada89ddeef1f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:14.910755 ncdv-master-1 devstack@keystone.service[91548]: WARNING py.warnings [None req-45624584-a7e4-426d-a903-cc772e2c6593 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_system_grants_for_user": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:34:14.910755 ncdv-master-1 devstack@keystone.service[91548]: warnings.warn(msg) Jul 23 21:34:14.910755 ncdv-master-1 devstack@keystone.service[91548]: Jul 23 21:34:14.911662 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45624584-a7e4-426d-a903-cc772e2c6593 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:14.918023 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2890f41-2387-4d48-a88b-d8b5eceefeaa admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca2f781f289346149505ff184d564e1b, user_id=fb86139c0aae43e8983e0a92e4553307, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:14.920701 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2890f41-2387-4d48-a88b-d8b5eceefeaa admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:14.925658 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3082/6134] 10.222.0.17 () {58 vars in 1259 bytes} [Sat Jul 23 21:34:14 2022] GET /identity/v3/system/users/c65996abac84448da544ada89ddeef1f/roles => generated 375 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 21:34:14.926693 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45624584-a7e4-426d-a903-cc772e2c6593 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:14.936744 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3053/6135] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:34:14 2022] PUT /identity/v3/projects/ca2f781f289346149505ff184d564e1b/users/fb86139c0aae43e8983e0a92e4553307/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:14.937578 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2890f41-2387-4d48-a88b-d8b5eceefeaa admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:14.943453 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45624584-a7e4-426d-a903-cc772e2c6593 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:14.978141 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:15.000561 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2890f41-2387-4d48-a88b-d8b5eceefeaa admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:15.005217 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f40c923-e1f4-41a1-bd38-aaebc2fc5675 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce5b7c9a7e31401d8c04a24af809ed81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '816984c605114e4680f81fb019e5229f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:15.005417 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72c53b0-9e12-425f-937f-e0e5f882b3d9 tempest-ListProjectsTestJSON-1307190150 tempest-ListProjectsTestJSON-1307190150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8d487c62e984d8facfc6069763007d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be55450fe3654224b6455aec3063ca29', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:15.006183 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f40c923-e1f4-41a1-bd38-aaebc2fc5675 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] REQUEST_METHOD: `HEAD` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:15.006378 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72c53b0-9e12-425f-937f-e0e5f882b3d9 tempest-ListProjectsTestJSON-1307190150 tempest-ListProjectsTestJSON-1307190150-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:15.006471 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f40c923-e1f4-41a1-bd38-aaebc2fc5675 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:15.006655 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72c53b0-9e12-425f-937f-e0e5f882b3d9 tempest-ListProjectsTestJSON-1307190150 tempest-ListProjectsTestJSON-1307190150-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:15.006763 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f40c923-e1f4-41a1-bd38-aaebc2fc5675 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] PATH_INFO: `/v3/system/users/c65996abac84448da544ada89ddeef1f/roles/2564d3143890441ba9b4a9ae8a4875d3` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:15.006926 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72c53b0-9e12-425f-937f-e0e5f882b3d9 tempest-ListProjectsTestJSON-1307190150 tempest-ListProjectsTestJSON-1307190150-project-admin] PATH_INFO: `/v3/projects/b6ce1f4da3b44eb3b72d0c723463484b` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:15.008102 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72c53b0-9e12-425f-937f-e0e5f882b3d9 tempest-ListProjectsTestJSON-1307190150 tempest-ListProjectsTestJSON-1307190150-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b6ce1f4da3b44eb3b72d0c723463484b)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:15.008485 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f40c923-e1f4-41a1-bd38-aaebc2fc5675 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorizing `identity:check_system_grant_for_user(user_id=c65996abac84448da544ada89ddeef1f, role_id=2564d3143890441ba9b4a9ae8a4875d3)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:15.009520 ncdv-master-1 devstack@keystone.service[91547]: WARNING py.warnings [None req-1f40c923-e1f4-41a1-bd38-aaebc2fc5675 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_system_grant_for_user": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:34:15.009520 ncdv-master-1 devstack@keystone.service[91547]: warnings.warn(msg) Jul 23 21:34:15.009520 ncdv-master-1 devstack@keystone.service[91547]: Jul 23 21:34:15.010029 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72c53b0-9e12-425f-937f-e0e5f882b3d9 tempest-ListProjectsTestJSON-1307190150 tempest-ListProjectsTestJSON-1307190150-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:15.010436 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f40c923-e1f4-41a1-bd38-aaebc2fc5675 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:15.015414 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3054/6136] 10.222.0.17 () {58 vars in 1359 bytes} [Sat Jul 23 21:34:14 2022] HEAD /identity/v3/system/users/c65996abac84448da544ada89ddeef1f/roles/2564d3143890441ba9b4a9ae8a4875d3 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:15.019652 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2c01b0-93de-4223-a798-840a990b7a91 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:15.019944 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2c01b0-93de-4223-a798-840a990b7a91 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:15.020225 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2c01b0-93de-4223-a798-840a990b7a91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:15.049220 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-5d2c01b0-93de-4223-a798-840a990b7a91 None None] MFA Rules not processed for user `fb86139c0aae43e8983e0a92e4553307`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:34:15.050634 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-5d2c01b0-93de-4223-a798-840a990b7a91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:15.057572 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-a72c53b0-9e12-425f-937f-e0e5f882b3d9 tempest-ListProjectsTestJSON-1307190150 tempest-ListProjectsTestJSON-1307190150-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6ce1f4da3b44eb3b72d0c723463484b', 'request_id': 'req-a72c53b0-9e12-425f-937f-e0e5f882b3d9'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:15.060087 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:15.065959 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-a72c53b0-9e12-425f-937f-e0e5f882b3d9 tempest-ListProjectsTestJSON-1307190150 tempest-ListProjectsTestJSON-1307190150-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6ce1f4da3b44eb3b72d0c723463484b', 'request_id': 'req-a72c53b0-9e12-425f-937f-e0e5f882b3d9'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:15.072975 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-a72c53b0-9e12-425f-937f-e0e5f882b3d9 tempest-ListProjectsTestJSON-1307190150 tempest-ListProjectsTestJSON-1307190150-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6ce1f4da3b44eb3b72d0c723463484b', 'request_id': 'req-a72c53b0-9e12-425f-937f-e0e5f882b3d9'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:15.085446 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-a72c53b0-9e12-425f-937f-e0e5f882b3d9 tempest-ListProjectsTestJSON-1307190150 tempest-ListProjectsTestJSON-1307190150-project-admin] The token cache is being invalidate because project b6ce1f4da3b44eb3b72d0c723463484b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:34:15.085729 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-a72c53b0-9e12-425f-937f-e0e5f882b3d9 tempest-ListProjectsTestJSON-1307190150 tempest-ListProjectsTestJSON-1307190150-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:15.086523 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-a72c53b0-9e12-425f-937f-e0e5f882b3d9 tempest-ListProjectsTestJSON-1307190150 tempest-ListProjectsTestJSON-1307190150-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:15.088187 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3083/6137] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:34:14 2022] DELETE /identity/v3/projects/b6ce1f4da3b44eb3b72d0c723463484b => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:15.089095 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72c53b0-9e12-425f-937f-e0e5f882b3d9 tempest-ListProjectsTestJSON-1307190150 tempest-ListProjectsTestJSON-1307190150-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:15.090651 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-a72c53b0-9e12-425f-937f-e0e5f882b3d9 tempest-ListProjectsTestJSON-1307190150 tempest-ListProjectsTestJSON-1307190150-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:15.118977 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3055/6138] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:34:15 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:34:15.119975 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2c01b0-93de-4223-a798-840a990b7a91 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:15.121443 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-5d2c01b0-93de-4223-a798-840a990b7a91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:15.158308 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72c53b0-9e12-425f-937f-e0e5f882b3d9 tempest-ListProjectsTestJSON-1307190150 tempest-ListProjectsTestJSON-1307190150-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:15.163385 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de082ac-1841-4e84-9cdf-a45b7659ad0c tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce5b7c9a7e31401d8c04a24af809ed81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '816984c605114e4680f81fb019e5229f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:15.164271 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de082ac-1841-4e84-9cdf-a45b7659ad0c tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:15.164558 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de082ac-1841-4e84-9cdf-a45b7659ad0c tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:15.164842 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de082ac-1841-4e84-9cdf-a45b7659ad0c tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] PATH_INFO: `/v3/system/users/c65996abac84448da544ada89ddeef1f/roles/2564d3143890441ba9b4a9ae8a4875d3` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:15.166684 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de082ac-1841-4e84-9cdf-a45b7659ad0c tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorizing `identity:revoke_system_grant_for_user(user_id=c65996abac84448da544ada89ddeef1f, role_id=2564d3143890441ba9b4a9ae8a4875d3)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:15.167717 ncdv-master-1 devstack@keystone.service[91548]: WARNING py.warnings [None req-1de082ac-1841-4e84-9cdf-a45b7659ad0c tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:34:15.167717 ncdv-master-1 devstack@keystone.service[91548]: warnings.warn(msg) Jul 23 21:34:15.167717 ncdv-master-1 devstack@keystone.service[91548]: Jul 23 21:34:15.168628 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de082ac-1841-4e84-9cdf-a45b7659ad0c tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:15.177096 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3084/6139] 10.222.0.17 () {58 vars in 1361 bytes} [Sat Jul 23 21:34:15 2022] DELETE /identity/v3/system/users/c65996abac84448da544ada89ddeef1f/roles/2564d3143890441ba9b4a9ae8a4875d3 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:15.177948 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de082ac-1841-4e84-9cdf-a45b7659ad0c tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:15.179549 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-1de082ac-1841-4e84-9cdf-a45b7659ad0c tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:15.187193 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2c01b0-93de-4223-a798-840a990b7a91 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:15.192103 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274718f3-3099-4143-9fa3-18f8cf716244 tempest-ListProjectsTestJSON-1307190150 tempest-ListProjectsTestJSON-1307190150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8d487c62e984d8facfc6069763007d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be55450fe3654224b6455aec3063ca29', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:15.193316 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274718f3-3099-4143-9fa3-18f8cf716244 tempest-ListProjectsTestJSON-1307190150 tempest-ListProjectsTestJSON-1307190150-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:15.193579 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274718f3-3099-4143-9fa3-18f8cf716244 tempest-ListProjectsTestJSON-1307190150 tempest-ListProjectsTestJSON-1307190150-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:15.193879 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274718f3-3099-4143-9fa3-18f8cf716244 tempest-ListProjectsTestJSON-1307190150 tempest-ListProjectsTestJSON-1307190150-project-admin] PATH_INFO: `/v3/projects/fc0a406920f047ab94d9bf5150a82211` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:15.195080 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274718f3-3099-4143-9fa3-18f8cf716244 tempest-ListProjectsTestJSON-1307190150 tempest-ListProjectsTestJSON-1307190150-project-admin] RBAC: Authorizing `identity:delete_project(project_id=fc0a406920f047ab94d9bf5150a82211)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:15.196998 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274718f3-3099-4143-9fa3-18f8cf716244 tempest-ListProjectsTestJSON-1307190150 tempest-ListProjectsTestJSON-1307190150-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:15.244148 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-274718f3-3099-4143-9fa3-18f8cf716244 tempest-ListProjectsTestJSON-1307190150 tempest-ListProjectsTestJSON-1307190150-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc0a406920f047ab94d9bf5150a82211', 'request_id': 'req-274718f3-3099-4143-9fa3-18f8cf716244'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:15.245064 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de082ac-1841-4e84-9cdf-a45b7659ad0c tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:15.250383 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:15.251681 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-274718f3-3099-4143-9fa3-18f8cf716244 tempest-ListProjectsTestJSON-1307190150 tempest-ListProjectsTestJSON-1307190150-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc0a406920f047ab94d9bf5150a82211', 'request_id': 'req-274718f3-3099-4143-9fa3-18f8cf716244'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:15.257964 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-274718f3-3099-4143-9fa3-18f8cf716244 tempest-ListProjectsTestJSON-1307190150 tempest-ListProjectsTestJSON-1307190150-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc0a406920f047ab94d9bf5150a82211', 'request_id': 'req-274718f3-3099-4143-9fa3-18f8cf716244'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:15.269746 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-274718f3-3099-4143-9fa3-18f8cf716244 tempest-ListProjectsTestJSON-1307190150 tempest-ListProjectsTestJSON-1307190150-project-admin] The token cache is being invalidate because project fc0a406920f047ab94d9bf5150a82211 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:34:15.270059 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-274718f3-3099-4143-9fa3-18f8cf716244 tempest-ListProjectsTestJSON-1307190150 tempest-ListProjectsTestJSON-1307190150-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:15.270704 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-274718f3-3099-4143-9fa3-18f8cf716244 tempest-ListProjectsTestJSON-1307190150 tempest-ListProjectsTestJSON-1307190150-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:15.272495 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3056/6140] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:34:15 2022] DELETE /identity/v3/projects/fc0a406920f047ab94d9bf5150a82211 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:15.273324 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274718f3-3099-4143-9fa3-18f8cf716244 tempest-ListProjectsTestJSON-1307190150 tempest-ListProjectsTestJSON-1307190150-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:15.274771 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-274718f3-3099-4143-9fa3-18f8cf716244 tempest-ListProjectsTestJSON-1307190150 tempest-ListProjectsTestJSON-1307190150-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:15.305313 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2c7a3f-8ec8-45c4-8167-e5860aa8360a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:15.306140 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2c7a3f-8ec8-45c4-8167-e5860aa8360a admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:15.306396 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2c7a3f-8ec8-45c4-8167-e5860aa8360a admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:15.306704 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2c7a3f-8ec8-45c4-8167-e5860aa8360a admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:15.307376 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2c7a3f-8ec8-45c4-8167-e5860aa8360a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:15.309371 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2c7a3f-8ec8-45c4-8167-e5860aa8360a admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:15.319283 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:15.339447 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3085/6141] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:34:15 2022] POST /identity/v3/projects => generated 385 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:34:15.339447 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2c7a3f-8ec8-45c4-8167-e5860aa8360a admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:15.339447 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-df2c7a3f-8ec8-45c4-8167-e5860aa8360a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:15.340835 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274718f3-3099-4143-9fa3-18f8cf716244 tempest-ListProjectsTestJSON-1307190150 tempest-ListProjectsTestJSON-1307190150-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:15.397654 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71f2c7b-78c3-4083-a5a5-b384cb3f707b tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce5b7c9a7e31401d8c04a24af809ed81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '816984c605114e4680f81fb019e5229f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:15.398510 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71f2c7b-78c3-4083-a5a5-b384cb3f707b tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:15.398790 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71f2c7b-78c3-4083-a5a5-b384cb3f707b tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:15.399061 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71f2c7b-78c3-4083-a5a5-b384cb3f707b tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:15.399808 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71f2c7b-78c3-4083-a5a5-b384cb3f707b tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:15.401424 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71f2c7b-78c3-4083-a5a5-b384cb3f707b tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:15.407017 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2c7a3f-8ec8-45c4-8167-e5860aa8360a admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:15.412155 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae117448-3051-4413-9d35-460f959d5b8d tempest-ListProjectsTestJSON-1307190150 tempest-ListProjectsTestJSON-1307190150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8d487c62e984d8facfc6069763007d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be55450fe3654224b6455aec3063ca29', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:15.412974 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae117448-3051-4413-9d35-460f959d5b8d tempest-ListProjectsTestJSON-1307190150 tempest-ListProjectsTestJSON-1307190150-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:15.413260 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae117448-3051-4413-9d35-460f959d5b8d tempest-ListProjectsTestJSON-1307190150 tempest-ListProjectsTestJSON-1307190150-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:15.413535 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae117448-3051-4413-9d35-460f959d5b8d tempest-ListProjectsTestJSON-1307190150 tempest-ListProjectsTestJSON-1307190150-project-admin] PATH_INFO: `/v3/projects/486eb7b5a6e148279d8a9f1d0d9baa35` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:15.414775 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae117448-3051-4413-9d35-460f959d5b8d tempest-ListProjectsTestJSON-1307190150 tempest-ListProjectsTestJSON-1307190150-project-admin] RBAC: Authorizing `identity:delete_project(project_id=486eb7b5a6e148279d8a9f1d0d9baa35)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:15.415387 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3057/6142] 10.222.0.17 () {60 vars in 1142 bytes} [Sat Jul 23 21:34:15 2022] POST /identity/v3/roles => generated 270 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:34:15.416326 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71f2c7b-78c3-4083-a5a5-b384cb3f707b tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:15.416690 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae117448-3051-4413-9d35-460f959d5b8d tempest-ListProjectsTestJSON-1307190150 tempest-ListProjectsTestJSON-1307190150-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:15.418342 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-a71f2c7b-78c3-4083-a5a5-b384cb3f707b tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:15.464636 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-ae117448-3051-4413-9d35-460f959d5b8d tempest-ListProjectsTestJSON-1307190150 tempest-ListProjectsTestJSON-1307190150-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '486eb7b5a6e148279d8a9f1d0d9baa35', 'request_id': 'req-ae117448-3051-4413-9d35-460f959d5b8d'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:15.472224 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-ae117448-3051-4413-9d35-460f959d5b8d tempest-ListProjectsTestJSON-1307190150 tempest-ListProjectsTestJSON-1307190150-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '486eb7b5a6e148279d8a9f1d0d9baa35', 'request_id': 'req-ae117448-3051-4413-9d35-460f959d5b8d'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:15.478267 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-ae117448-3051-4413-9d35-460f959d5b8d tempest-ListProjectsTestJSON-1307190150 tempest-ListProjectsTestJSON-1307190150-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '486eb7b5a6e148279d8a9f1d0d9baa35', 'request_id': 'req-ae117448-3051-4413-9d35-460f959d5b8d'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:15.485529 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71f2c7b-78c3-4083-a5a5-b384cb3f707b tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:15.490253 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-ae117448-3051-4413-9d35-460f959d5b8d tempest-ListProjectsTestJSON-1307190150 tempest-ListProjectsTestJSON-1307190150-project-admin] The token cache is being invalidate because project 486eb7b5a6e148279d8a9f1d0d9baa35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:34:15.490549 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-ae117448-3051-4413-9d35-460f959d5b8d tempest-ListProjectsTestJSON-1307190150 tempest-ListProjectsTestJSON-1307190150-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:15.491291 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-ae117448-3051-4413-9d35-460f959d5b8d tempest-ListProjectsTestJSON-1307190150 tempest-ListProjectsTestJSON-1307190150-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:15.493025 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3086/6143] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:34:15 2022] DELETE /identity/v3/projects/486eb7b5a6e148279d8a9f1d0d9baa35 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:15.493790 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae117448-3051-4413-9d35-460f959d5b8d tempest-ListProjectsTestJSON-1307190150 tempest-ListProjectsTestJSON-1307190150-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:15.495225 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-ae117448-3051-4413-9d35-460f959d5b8d tempest-ListProjectsTestJSON-1307190150 tempest-ListProjectsTestJSON-1307190150-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:15.523566 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:15.545635 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e0865a-34a0-4aac-8546-87a1639d2831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:15.546346 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e0865a-34a0-4aac-8546-87a1639d2831 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:15.546604 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e0865a-34a0-4aac-8546-87a1639d2831 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:15.546883 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e0865a-34a0-4aac-8546-87a1639d2831 admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:15.547573 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e0865a-34a0-4aac-8546-87a1639d2831 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:15.549559 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e0865a-34a0-4aac-8546-87a1639d2831 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:15.566676 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae117448-3051-4413-9d35-460f959d5b8d tempest-ListProjectsTestJSON-1307190150 tempest-ListProjectsTestJSON-1307190150-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:15.570719 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3058/6144] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:34:15 2022] POST /identity/v3/users => generated 299 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:34:15.571525 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75e0c94-d181-40f7-8132-eb8e37167893 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce5b7c9a7e31401d8c04a24af809ed81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '816984c605114e4680f81fb019e5229f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:15.571688 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e0865a-34a0-4aac-8546-87a1639d2831 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:15.572184 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75e0c94-d181-40f7-8132-eb8e37167893 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:15.572498 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75e0c94-d181-40f7-8132-eb8e37167893 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:15.572746 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75e0c94-d181-40f7-8132-eb8e37167893 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:15.573385 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-56e0865a-34a0-4aac-8546-87a1639d2831 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:15.573488 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75e0c94-d181-40f7-8132-eb8e37167893 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:15.575118 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75e0c94-d181-40f7-8132-eb8e37167893 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:15.585853 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e0865a-34a0-4aac-8546-87a1639d2831 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:15.593514 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3087/6145] 10.222.0.17 () {60 vars in 1142 bytes} [Sat Jul 23 21:34:15 2022] POST /identity/v3/roles => generated 269 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:34:15.593668 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96032811-f00c-4b3a-9832-53cbfa9d859d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:15.593786 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75e0c94-d181-40f7-8132-eb8e37167893 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:15.593905 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96032811-f00c-4b3a-9832-53cbfa9d859d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:15.593905 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96032811-f00c-4b3a-9832-53cbfa9d859d admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:15.593905 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96032811-f00c-4b3a-9832-53cbfa9d859d admin admin] PATH_INFO: `/v3/users/a66f1c9daffb44a0bb03b05ee58ccb0f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:15.594176 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-c75e0c94-d181-40f7-8132-eb8e37167893 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:15.594267 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96032811-f00c-4b3a-9832-53cbfa9d859d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a66f1c9daffb44a0bb03b05ee58ccb0f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:15.595728 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96032811-f00c-4b3a-9832-53cbfa9d859d admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:15.610244 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:15.610671 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75e0c94-d181-40f7-8132-eb8e37167893 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:15.615671 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd37a6a9-1334-41cb-a2f5-6c76fa208c82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:15.616344 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd37a6a9-1334-41cb-a2f5-6c76fa208c82 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:15.616624 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd37a6a9-1334-41cb-a2f5-6c76fa208c82 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:15.616898 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd37a6a9-1334-41cb-a2f5-6c76fa208c82 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:15.617620 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd37a6a9-1334-41cb-a2f5-6c76fa208c82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:15.619253 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd37a6a9-1334-41cb-a2f5-6c76fa208c82 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:15.632632 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3088/6146] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:34:15 2022] GET /identity/v3/roles => generated 2321 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:34:15.633467 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd37a6a9-1334-41cb-a2f5-6c76fa208c82 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:15.648697 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd37a6a9-1334-41cb-a2f5-6c76fa208c82 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:15.653272 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617e7732-58f9-4e31-a0f6-da531c3e5a4e tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce5b7c9a7e31401d8c04a24af809ed81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '816984c605114e4680f81fb019e5229f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:15.653475 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-96032811-f00c-4b3a-9832-53cbfa9d859d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a66f1c9daffb44a0bb03b05ee58ccb0f'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:15.654252 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617e7732-58f9-4e31-a0f6-da531c3e5a4e tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:15.654543 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617e7732-58f9-4e31-a0f6-da531c3e5a4e tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:15.654817 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617e7732-58f9-4e31-a0f6-da531c3e5a4e tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] PATH_INFO: `/v3/roles/5ae32785b5604713976721b42543d631/implies/8d9d459534cc496eb3c2cf2cdf236d6a` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:15.656532 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617e7732-58f9-4e31-a0f6-da531c3e5a4e tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=5ae32785b5604713976721b42543d631, implied_role_id=8d9d459534cc496eb3c2cf2cdf236d6a)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:15.657546 ncdv-master-1 devstack@keystone.service[91548]: WARNING py.warnings [None req-617e7732-58f9-4e31-a0f6-da531c3e5a4e tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:34:15.657546 ncdv-master-1 devstack@keystone.service[91548]: warnings.warn(msg) Jul 23 21:34:15.657546 ncdv-master-1 devstack@keystone.service[91548]: Jul 23 21:34:15.658466 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617e7732-58f9-4e31-a0f6-da531c3e5a4e tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:15.662776 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-96032811-f00c-4b3a-9832-53cbfa9d859d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a66f1c9daffb44a0bb03b05ee58ccb0f'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:15.663540 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-96032811-f00c-4b3a-9832-53cbfa9d859d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a66f1c9daffb44a0bb03b05ee58ccb0f'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:15.672596 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-96032811-f00c-4b3a-9832-53cbfa9d859d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a66f1c9daffb44a0bb03b05ee58ccb0f'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:15.686376 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-96032811-f00c-4b3a-9832-53cbfa9d859d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a66f1c9daffb44a0bb03b05ee58ccb0f'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:15.687109 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3089/6147] 10.222.0.17 () {60 vars in 1362 bytes} [Sat Jul 23 21:34:15 2022] PUT /identity/v3/roles/5ae32785b5604713976721b42543d631/implies/8d9d459534cc496eb3c2cf2cdf236d6a => generated 530 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:34:15.688125 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617e7732-58f9-4e31-a0f6-da531c3e5a4e tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:15.689674 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-617e7732-58f9-4e31-a0f6-da531c3e5a4e tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:15.693127 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3059/6148] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:34:15 2022] DELETE /identity/v3/users/a66f1c9daffb44a0bb03b05ee58ccb0f => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:15.693942 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96032811-f00c-4b3a-9832-53cbfa9d859d admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:15.695525 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-96032811-f00c-4b3a-9832-53cbfa9d859d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:15.758040 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617e7732-58f9-4e31-a0f6-da531c3e5a4e tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:15.773887 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96032811-f00c-4b3a-9832-53cbfa9d859d admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:15.781063 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303b60fc-9f70-4dee-8439-ec42f4f0f78a tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce5b7c9a7e31401d8c04a24af809ed81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '816984c605114e4680f81fb019e5229f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:15.781891 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303b60fc-9f70-4dee-8439-ec42f4f0f78a tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:15.782202 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303b60fc-9f70-4dee-8439-ec42f4f0f78a tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:15.782519 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303b60fc-9f70-4dee-8439-ec42f4f0f78a tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:15.783351 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303b60fc-9f70-4dee-8439-ec42f4f0f78a tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:15.785302 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303b60fc-9f70-4dee-8439-ec42f4f0f78a tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:15.808214 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3060/6149] 10.222.0.17 () {60 vars in 1148 bytes} [Sat Jul 23 21:34:15 2022] POST /identity/v3/domains => generated 275 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:34:15.808214 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517fd187-83b6-40cf-9f0c-07330a15a15f None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:15.808214 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517fd187-83b6-40cf-9f0c-07330a15a15f None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:15.808214 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517fd187-83b6-40cf-9f0c-07330a15a15f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:15.830608 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-517fd187-83b6-40cf-9f0c-07330a15a15f None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:34:15.831687 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb49d64e-64ba-4c9b-bdc6-d265439c14c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:15.831931 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-517fd187-83b6-40cf-9f0c-07330a15a15f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:15.832797 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb49d64e-64ba-4c9b-bdc6-d265439c14c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:15.833149 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb49d64e-64ba-4c9b-bdc6-d265439c14c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:15.833495 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb49d64e-64ba-4c9b-bdc6-d265439c14c1 admin admin] PATH_INFO: `/v3/projects/72d64c19d9f74f349c0624e38d6e9456/users/09dc53f57ec74aa9bbc8fe9be47d1f58/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:15.851124 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb49d64e-64ba-4c9b-bdc6-d265439c14c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72d64c19d9f74f349c0624e38d6e9456, user_id=09dc53f57ec74aa9bbc8fe9be47d1f58, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:15.854037 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb49d64e-64ba-4c9b-bdc6-d265439c14c1 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:15.872657 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3090/6150] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:34:15 2022] PUT /identity/v3/projects/72d64c19d9f74f349c0624e38d6e9456/users/09dc53f57ec74aa9bbc8fe9be47d1f58/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:15.873825 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb49d64e-64ba-4c9b-bdc6-d265439c14c1 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:15.887929 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:15.910245 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3061/6151] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:34:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:34:15.911112 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517fd187-83b6-40cf-9f0c-07330a15a15f None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:15.921364 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517fd187-83b6-40cf-9f0c-07330a15a15f None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:15.942452 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb49d64e-64ba-4c9b-bdc6-d265439c14c1 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:15.947321 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a54692-9eee-4425-a538-575cedcf378b tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce5b7c9a7e31401d8c04a24af809ed81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '816984c605114e4680f81fb019e5229f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:15.947999 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a54692-9eee-4425-a538-575cedcf378b tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:15.948289 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a54692-9eee-4425-a538-575cedcf378b tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:15.948680 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:15.949032 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a54692-9eee-4425-a538-575cedcf378b tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:15.949833 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a54692-9eee-4425-a538-575cedcf378b tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:15.952157 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a54692-9eee-4425-a538-575cedcf378b tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:15.967547 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3091/6152] 10.222.0.17 () {60 vars in 1142 bytes} [Sat Jul 23 21:34:15 2022] POST /identity/v3/roles => generated 270 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:34:15.971383 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a54692-9eee-4425-a538-575cedcf378b tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:15.973071 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-d2a54692-9eee-4425-a538-575cedcf378b tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:15.993516 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6684c127-7556-4465-8043-c9b2fcc012eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:15.994260 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6684c127-7556-4465-8043-c9b2fcc012eb admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:15.994521 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6684c127-7556-4465-8043-c9b2fcc012eb admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:15.994814 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6684c127-7556-4465-8043-c9b2fcc012eb admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:15.995543 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6684c127-7556-4465-8043-c9b2fcc012eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:15.997317 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6684c127-7556-4465-8043-c9b2fcc012eb admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:16.008791 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3062/6153] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:34:15 2022] GET /identity/v3/roles => generated 2321 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:34:16.009634 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6684c127-7556-4465-8043-c9b2fcc012eb admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:16.020236 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6684c127-7556-4465-8043-c9b2fcc012eb admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:16.024865 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760de8d3-79d6-4b52-a63d-48d9bec8f8b7 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce5b7c9a7e31401d8c04a24af809ed81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '816984c605114e4680f81fb019e5229f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:16.025766 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760de8d3-79d6-4b52-a63d-48d9bec8f8b7 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:16.026087 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760de8d3-79d6-4b52-a63d-48d9bec8f8b7 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:16.026363 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760de8d3-79d6-4b52-a63d-48d9bec8f8b7 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] PATH_INFO: `/v3/roles/5ae32785b5604713976721b42543d631/implies/8d42cbe973314011adcf52461710fab7` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:16.028067 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760de8d3-79d6-4b52-a63d-48d9bec8f8b7 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=5ae32785b5604713976721b42543d631, implied_role_id=8d42cbe973314011adcf52461710fab7)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:16.029675 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760de8d3-79d6-4b52-a63d-48d9bec8f8b7 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:16.037764 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a54692-9eee-4425-a538-575cedcf378b tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:16.041514 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217d3ce2-4d85-434d-af1f-99d0b82387ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:16.042182 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217d3ce2-4d85-434d-af1f-99d0b82387ba service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:16.042468 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217d3ce2-4d85-434d-af1f-99d0b82387ba service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:16.042759 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217d3ce2-4d85-434d-af1f-99d0b82387ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:16.052868 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217d3ce2-4d85-434d-af1f-99d0b82387ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:16.054453 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217d3ce2-4d85-434d-af1f-99d0b82387ba service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:16.057845 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3063/6154] 10.222.0.17 () {60 vars in 1362 bytes} [Sat Jul 23 21:34:16 2022] PUT /identity/v3/roles/5ae32785b5604713976721b42543d631/implies/8d42cbe973314011adcf52461710fab7 => generated 531 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:34:16.058927 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760de8d3-79d6-4b52-a63d-48d9bec8f8b7 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:16.065200 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3092/6155] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:34:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:34:16.066035 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217d3ce2-4d85-434d-af1f-99d0b82387ba service neutron] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:16.076699 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217d3ce2-4d85-434d-af1f-99d0b82387ba service neutron] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:16.138724 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760de8d3-79d6-4b52-a63d-48d9bec8f8b7 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:16.155160 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92519ae-1db9-4588-ac56-a62f933d06ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:16.156134 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92519ae-1db9-4588-ac56-a62f933d06ee admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:16.156413 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92519ae-1db9-4588-ac56-a62f933d06ee admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:16.156754 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92519ae-1db9-4588-ac56-a62f933d06ee admin admin] PATH_INFO: `/v3/projects/72d64c19d9f74f349c0624e38d6e9456/users/09dc53f57ec74aa9bbc8fe9be47d1f58/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:16.159586 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92519ae-1db9-4588-ac56-a62f933d06ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=72d64c19d9f74f349c0624e38d6e9456, user_id=09dc53f57ec74aa9bbc8fe9be47d1f58, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:16.162696 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92519ae-1db9-4588-ac56-a62f933d06ee admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:16.162882 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76d454c-aabc-4c74-aebe-237fc0279324 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce5b7c9a7e31401d8c04a24af809ed81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '816984c605114e4680f81fb019e5229f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:16.164171 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76d454c-aabc-4c74-aebe-237fc0279324 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:16.164670 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76d454c-aabc-4c74-aebe-237fc0279324 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:16.165076 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76d454c-aabc-4c74-aebe-237fc0279324 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] PATH_INFO: `/v3/roles/5ae32785b5604713976721b42543d631/implies/2564d3143890441ba9b4a9ae8a4875d3` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:16.167733 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76d454c-aabc-4c74-aebe-237fc0279324 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=5ae32785b5604713976721b42543d631, implied_role_id=2564d3143890441ba9b4a9ae8a4875d3)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:16.169446 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76d454c-aabc-4c74-aebe-237fc0279324 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:16.176271 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3064/6156] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:34:16 2022] PUT /identity/v3/projects/72d64c19d9f74f349c0624e38d6e9456/users/09dc53f57ec74aa9bbc8fe9be47d1f58/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:16.187124 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1f5541-b076-4adf-b676-3a6dbe157f9e None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:16.187315 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1f5541-b076-4adf-b676-3a6dbe157f9e None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:16.187649 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1f5541-b076-4adf-b676-3a6dbe157f9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:16.202224 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3093/6157] 10.222.0.17 () {60 vars in 1362 bytes} [Sat Jul 23 21:34:16 2022] PUT /identity/v3/roles/5ae32785b5604713976721b42543d631/implies/2564d3143890441ba9b4a9ae8a4875d3 => generated 526 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:34:16.206295 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76d454c-aabc-4c74-aebe-237fc0279324 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:16.217438 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-8d1f5541-b076-4adf-b676-3a6dbe157f9e None None] MFA Rules not processed for user `09dc53f57ec74aa9bbc8fe9be47d1f58`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:34:16.218837 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-8d1f5541-b076-4adf-b676-3a6dbe157f9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:16.248239 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:16.286234 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76d454c-aabc-4c74-aebe-237fc0279324 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:16.291695 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937b2883-4e57-4905-b1fd-5fef2be53454 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce5b7c9a7e31401d8c04a24af809ed81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '816984c605114e4680f81fb019e5229f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:16.292722 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937b2883-4e57-4905-b1fd-5fef2be53454 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:16.293070 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937b2883-4e57-4905-b1fd-5fef2be53454 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:16.293328 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937b2883-4e57-4905-b1fd-5fef2be53454 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] PATH_INFO: `/v3/roles/2564d3143890441ba9b4a9ae8a4875d3/implies/5ae32785b5604713976721b42543d631` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:16.295166 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937b2883-4e57-4905-b1fd-5fef2be53454 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=2564d3143890441ba9b4a9ae8a4875d3, implied_role_id=5ae32785b5604713976721b42543d631)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:16.297062 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937b2883-4e57-4905-b1fd-5fef2be53454 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:16.300640 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3065/6158] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:34:16 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:34:16.310553 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1f5541-b076-4adf-b676-3a6dbe157f9e None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:16.326053 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-937b2883-4e57-4905-b1fd-5fef2be53454 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] 5ae32785b5604713976721b42543d631 cannot be an implied roles.: keystone.exception.InvalidImpliedRole: 5ae32785b5604713976721b42543d631 cannot be an implied roles. Jul 23 21:34:16.326053 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 21:34:16.326053 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 21:34:16.326053 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 21:34:16.326053 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 21:34:16.326053 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 21:34:16.326053 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 21:34:16.326053 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 21:34:16.326053 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 21:34:16.326053 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 21:34:16.326053 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 21:34:16.326053 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 21:34:16.326053 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 259, in put Jul 23 21:34:16.326053 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application PROVIDERS.role_api.create_implied_role(prior_role_id, implied_role_id) Jul 23 21:34:16.327137 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 21:34:16.327137 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 21:34:16.327137 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1361, in create_implied_role Jul 23 21:34:16.327137 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.InvalidImpliedRole(msg, Jul 23 21:34:16.327137 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.InvalidImpliedRole: 5ae32785b5604713976721b42543d631 cannot be an implied roles. Jul 23 21:34:16.327137 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 21:34:16.327531 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3094/6159] 10.222.0.17 () {60 vars in 1362 bytes} [Sat Jul 23 21:34:16 2022] PUT /identity/v3/roles/2564d3143890441ba9b4a9ae8a4875d3/implies/5ae32785b5604713976721b42543d631 => generated 116 bytes in 121 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Jul 23 21:34:16.328252 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:16.331567 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937b2883-4e57-4905-b1fd-5fef2be53454 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:16.342987 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937b2883-4e57-4905-b1fd-5fef2be53454 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:16.347829 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddd2b11-b725-4ab3-bb8d-c4588f8ce68a tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce5b7c9a7e31401d8c04a24af809ed81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '816984c605114e4680f81fb019e5229f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:16.348843 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddd2b11-b725-4ab3-bb8d-c4588f8ce68a tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:16.349136 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddd2b11-b725-4ab3-bb8d-c4588f8ce68a tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:16.349608 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddd2b11-b725-4ab3-bb8d-c4588f8ce68a tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] PATH_INFO: `/v3/roles/5ae32785b5604713976721b42543d631/implies/2564d3143890441ba9b4a9ae8a4875d3` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:16.351739 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddd2b11-b725-4ab3-bb8d-c4588f8ce68a tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=5ae32785b5604713976721b42543d631, implied_role_id=2564d3143890441ba9b4a9ae8a4875d3)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:16.353361 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddd2b11-b725-4ab3-bb8d-c4588f8ce68a tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:16.364025 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3095/6160] 10.222.0.17 () {58 vars in 1346 bytes} [Sat Jul 23 21:34:16 2022] DELETE /identity/v3/roles/5ae32785b5604713976721b42543d631/implies/2564d3143890441ba9b4a9ae8a4875d3 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:34:16.368444 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddd2b11-b725-4ab3-bb8d-c4588f8ce68a tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:16.379065 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1f5541-b076-4adf-b676-3a6dbe157f9e None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:16.441075 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddd2b11-b725-4ab3-bb8d-c4588f8ce68a tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:16.445985 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690f640d-0be1-4eb2-87ed-63e8ab79280a tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce5b7c9a7e31401d8c04a24af809ed81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '816984c605114e4680f81fb019e5229f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:16.446940 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690f640d-0be1-4eb2-87ed-63e8ab79280a tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:16.447063 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127d916b-6ce2-4557-a704-37d19ccc28b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:16.447249 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690f640d-0be1-4eb2-87ed-63e8ab79280a tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:16.447503 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690f640d-0be1-4eb2-87ed-63e8ab79280a tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] PATH_INFO: `/v3/roles/5ae32785b5604713976721b42543d631/implies/8d42cbe973314011adcf52461710fab7` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:16.447699 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127d916b-6ce2-4557-a704-37d19ccc28b0 service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:16.447980 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127d916b-6ce2-4557-a704-37d19ccc28b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:16.448276 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127d916b-6ce2-4557-a704-37d19ccc28b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:16.449223 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690f640d-0be1-4eb2-87ed-63e8ab79280a tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=5ae32785b5604713976721b42543d631, implied_role_id=8d42cbe973314011adcf52461710fab7)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:16.450093 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-127d916b-6ce2-4557-a704-37d19ccc28b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:16.450947 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690f640d-0be1-4eb2-87ed-63e8ab79280a tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:16.460704 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3096/6161] 10.222.0.17 () {58 vars in 1346 bytes} [Sat Jul 23 21:34:16 2022] DELETE /identity/v3/roles/5ae32785b5604713976721b42543d631/implies/8d42cbe973314011adcf52461710fab7 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:34:16.464695 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690f640d-0be1-4eb2-87ed-63e8ab79280a tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:16.466420 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-690f640d-0be1-4eb2-87ed-63e8ab79280a tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:16.513067 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127d916b-6ce2-4557-a704-37d19ccc28b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:16.514630 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127d916b-6ce2-4557-a704-37d19ccc28b0 service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:16.524095 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3066/6162] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:34:16 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 23 21:34:16.524911 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127d916b-6ce2-4557-a704-37d19ccc28b0 service neutron] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:16.531401 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690f640d-0be1-4eb2-87ed-63e8ab79280a tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:16.535274 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127d916b-6ce2-4557-a704-37d19ccc28b0 service neutron] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:16.536620 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fae3b0d-59f1-4cbc-8364-a14e0b5f5484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:16.537650 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fae3b0d-59f1-4cbc-8364-a14e0b5f5484 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:16.537961 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fae3b0d-59f1-4cbc-8364-a14e0b5f5484 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:16.538234 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fae3b0d-59f1-4cbc-8364-a14e0b5f5484 admin admin] PATH_INFO: `/v3/projects/e9d6915d244441ef85a94e208fe3e579` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:16.539812 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fae3b0d-59f1-4cbc-8364-a14e0b5f5484 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9d6915d244441ef85a94e208fe3e579)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:16.541409 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fae3b0d-59f1-4cbc-8364-a14e0b5f5484 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:16.592798 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:16.596676 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-2fae3b0d-59f1-4cbc-8364-a14e0b5f5484 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9d6915d244441ef85a94e208fe3e579', 'request_id': 'req-2fae3b0d-59f1-4cbc-8364-a14e0b5f5484'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:16.597755 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33023635-0fcf-4618-bc27-e4206c17328b tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce5b7c9a7e31401d8c04a24af809ed81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '816984c605114e4680f81fb019e5229f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:16.598688 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33023635-0fcf-4618-bc27-e4206c17328b tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:16.599097 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33023635-0fcf-4618-bc27-e4206c17328b tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:16.599461 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33023635-0fcf-4618-bc27-e4206c17328b tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] PATH_INFO: `/v3/roles/8d42cbe973314011adcf52461710fab7` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:16.601104 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33023635-0fcf-4618-bc27-e4206c17328b tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=8d42cbe973314011adcf52461710fab7)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:16.602770 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33023635-0fcf-4618-bc27-e4206c17328b tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:16.607490 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-2fae3b0d-59f1-4cbc-8364-a14e0b5f5484 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9d6915d244441ef85a94e208fe3e579', 'request_id': 'req-2fae3b0d-59f1-4cbc-8364-a14e0b5f5484'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:16.614213 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-2fae3b0d-59f1-4cbc-8364-a14e0b5f5484 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9d6915d244441ef85a94e208fe3e579', 'request_id': 'req-2fae3b0d-59f1-4cbc-8364-a14e0b5f5484'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:16.629522 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-2fae3b0d-59f1-4cbc-8364-a14e0b5f5484 admin admin] The token cache is being invalidate because project e9d6915d244441ef85a94e208fe3e579 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:34:16.629799 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-2fae3b0d-59f1-4cbc-8364-a14e0b5f5484 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:16.630761 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-2fae3b0d-59f1-4cbc-8364-a14e0b5f5484 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:16.632488 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:16.635621 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3097/6163] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:34:16 2022] DELETE /identity/v3/projects/e9d6915d244441ef85a94e208fe3e579 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:16.636767 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fae3b0d-59f1-4cbc-8364-a14e0b5f5484 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:16.638225 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-2fae3b0d-59f1-4cbc-8364-a14e0b5f5484 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:16.647181 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-33023635-0fcf-4618-bc27-e4206c17328b tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Invalidating the token cache because role 8d42cbe973314011adcf52461710fab7 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:34:16.647467 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-33023635-0fcf-4618-bc27-e4206c17328b tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:16.648137 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-33023635-0fcf-4618-bc27-e4206c17328b tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:16.650073 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3067/6164] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:34:16 2022] DELETE /identity/v3/roles/8d42cbe973314011adcf52461710fab7 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:16.654139 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33023635-0fcf-4618-bc27-e4206c17328b tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:16.656009 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-33023635-0fcf-4618-bc27-e4206c17328b tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:16.721092 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fae3b0d-59f1-4cbc-8364-a14e0b5f5484 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:16.743441 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33023635-0fcf-4618-bc27-e4206c17328b tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:16.748273 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3571215-23f3-4ad1-98d1-8a88b93d5aaf tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce5b7c9a7e31401d8c04a24af809ed81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '816984c605114e4680f81fb019e5229f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:16.749166 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3571215-23f3-4ad1-98d1-8a88b93d5aaf tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:16.749468 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3571215-23f3-4ad1-98d1-8a88b93d5aaf tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:16.749848 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3571215-23f3-4ad1-98d1-8a88b93d5aaf tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] PATH_INFO: `/v3/domains/3f676e65b6ae45f9a9725bfc6965dfa5` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:16.763180 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3571215-23f3-4ad1-98d1-8a88b93d5aaf tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=3f676e65b6ae45f9a9725bfc6965dfa5)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:16.764818 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3571215-23f3-4ad1-98d1-8a88b93d5aaf tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:16.790324 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c5b0d8-c2cc-4465-9082-f5196cd55743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:16.791207 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c5b0d8-c2cc-4465-9082-f5196cd55743 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:16.791481 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-b3571215-23f3-4ad1-98d1-8a88b93d5aaf tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '3f676e65b6ae45f9a9725bfc6965dfa5'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:16.791629 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c5b0d8-c2cc-4465-9082-f5196cd55743 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:16.791788 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c5b0d8-c2cc-4465-9082-f5196cd55743 admin admin] PATH_INFO: `/v3/users/b8d487c62e984d8facfc6069763007d4` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:16.792388 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-b3571215-23f3-4ad1-98d1-8a88b93d5aaf tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '3f676e65b6ae45f9a9725bfc6965dfa5'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:16.793247 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c5b0d8-c2cc-4465-9082-f5196cd55743 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8d487c62e984d8facfc6069763007d4)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:16.795376 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c5b0d8-c2cc-4465-9082-f5196cd55743 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:16.832438 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-b3571215-23f3-4ad1-98d1-8a88b93d5aaf tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '3f676e65b6ae45f9a9725bfc6965dfa5'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:16.833157 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-b3571215-23f3-4ad1-98d1-8a88b93d5aaf tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '3f676e65b6ae45f9a9725bfc6965dfa5'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:16.836343 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3068/6165] 10.222.0.17 () {60 vars in 1248 bytes} [Sat Jul 23 21:34:16 2022] PATCH /identity/v3/domains/3f676e65b6ae45f9a9725bfc6965dfa5 => generated 276 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 21:34:16.840542 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3571215-23f3-4ad1-98d1-8a88b93d5aaf tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:16.842570 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-b3571215-23f3-4ad1-98d1-8a88b93d5aaf tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:16.851803 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-d1c5b0d8-c2cc-4465-9082-f5196cd55743 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8d487c62e984d8facfc6069763007d4'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:16.852980 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-d1c5b0d8-c2cc-4465-9082-f5196cd55743 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8d487c62e984d8facfc6069763007d4'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:16.861676 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-d1c5b0d8-c2cc-4465-9082-f5196cd55743 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8d487c62e984d8facfc6069763007d4'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:16.874387 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-d1c5b0d8-c2cc-4465-9082-f5196cd55743 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8d487c62e984d8facfc6069763007d4'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:16.897261 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-d1c5b0d8-c2cc-4465-9082-f5196cd55743 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8d487c62e984d8facfc6069763007d4'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:16.900318 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:16.905550 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3098/6166] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:34:16 2022] DELETE /identity/v3/users/b8d487c62e984d8facfc6069763007d4 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:34:16.921577 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c5b0d8-c2cc-4465-9082-f5196cd55743 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:16.925570 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-d1c5b0d8-c2cc-4465-9082-f5196cd55743 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:16.940894 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3571215-23f3-4ad1-98d1-8a88b93d5aaf tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:17.030976 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:UPDATE=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:17.033750 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c5b0d8-c2cc-4465-9082-f5196cd55743 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:17.038567 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf2f664-1133-42fc-a05b-7defb1e1e867 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:17.039238 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf2f664-1133-42fc-a05b-7defb1e1e867 service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:17.039531 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf2f664-1133-42fc-a05b-7defb1e1e867 service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:17.039795 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf2f664-1133-42fc-a05b-7defb1e1e867 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:17.040849 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e708f788-8bcc-4582-a88e-c7e306e7f831 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce5b7c9a7e31401d8c04a24af809ed81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '816984c605114e4680f81fb019e5229f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:17.041759 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-8cf2f664-1133-42fc-a05b-7defb1e1e867 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:17.042495 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e708f788-8bcc-4582-a88e-c7e306e7f831 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:17.043211 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e708f788-8bcc-4582-a88e-c7e306e7f831 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:17.043769 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e708f788-8bcc-4582-a88e-c7e306e7f831 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] PATH_INFO: `/v3/domains/3f676e65b6ae45f9a9725bfc6965dfa5` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:17.057698 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e708f788-8bcc-4582-a88e-c7e306e7f831 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=3f676e65b6ae45f9a9725bfc6965dfa5)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:17.059576 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e708f788-8bcc-4582-a88e-c7e306e7f831 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:17.085452 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-e708f788-8bcc-4582-a88e-c7e306e7f831 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '3f676e65b6ae45f9a9725bfc6965dfa5'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:17.098833 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-e708f788-8bcc-4582-a88e-c7e306e7f831 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '3f676e65b6ae45f9a9725bfc6965dfa5'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:17.125159 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf2f664-1133-42fc-a05b-7defb1e1e867 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:17.126735 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf2f664-1133-42fc-a05b-7defb1e1e867 service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:17.138051 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3099/6167] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:34:16 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:34:17.150386 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-e708f788-8bcc-4582-a88e-c7e306e7f831 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f676e65b6ae45f9a9725bfc6965dfa5', 'request_id': 'req-e708f788-8bcc-4582-a88e-c7e306e7f831'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:17.160397 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-e708f788-8bcc-4582-a88e-c7e306e7f831 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f676e65b6ae45f9a9725bfc6965dfa5', 'request_id': 'req-e708f788-8bcc-4582-a88e-c7e306e7f831'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:17.168158 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-e708f788-8bcc-4582-a88e-c7e306e7f831 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f676e65b6ae45f9a9725bfc6965dfa5', 'request_id': 'req-e708f788-8bcc-4582-a88e-c7e306e7f831'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:17.181480 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-e708f788-8bcc-4582-a88e-c7e306e7f831 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] The token cache is being invalidate because project 3f676e65b6ae45f9a9725bfc6965dfa5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:34:17.181770 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-e708f788-8bcc-4582-a88e-c7e306e7f831 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:17.182494 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-e708f788-8bcc-4582-a88e-c7e306e7f831 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:17.190522 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-e708f788-8bcc-4582-a88e-c7e306e7f831 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '3f676e65b6ae45f9a9725bfc6965dfa5', 'request_id': 'req-e708f788-8bcc-4582-a88e-c7e306e7f831'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:17.191208 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-e708f788-8bcc-4582-a88e-c7e306e7f831 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '3f676e65b6ae45f9a9725bfc6965dfa5', 'request_id': 'req-e708f788-8bcc-4582-a88e-c7e306e7f831'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:17.194696 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-e708f788-8bcc-4582-a88e-c7e306e7f831 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '3f676e65b6ae45f9a9725bfc6965dfa5', 'request_id': 'req-e708f788-8bcc-4582-a88e-c7e306e7f831'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:17.200561 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3069/6168] 10.222.0.17 () {58 vars in 1229 bytes} [Sat Jul 23 21:34:16 2022] DELETE /identity/v3/domains/3f676e65b6ae45f9a9725bfc6965dfa5 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:34:17.205588 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf2f664-1133-42fc-a05b-7defb1e1e867 service neutron] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:17.207259 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-8cf2f664-1133-42fc-a05b-7defb1e1e867 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:17.223476 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf2f664-1133-42fc-a05b-7defb1e1e867 service neutron] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:17.244157 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e708f788-8bcc-4582-a88e-c7e306e7f831 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:17.245596 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-e708f788-8bcc-4582-a88e-c7e306e7f831 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:17.309162 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f4f49c-e5fe-4eab-97e3-455a3252cf0b tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce5b7c9a7e31401d8c04a24af809ed81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '816984c605114e4680f81fb019e5229f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:17.310816 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f4f49c-e5fe-4eab-97e3-455a3252cf0b tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:17.311282 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f4f49c-e5fe-4eab-97e3-455a3252cf0b tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:17.311580 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f4f49c-e5fe-4eab-97e3-455a3252cf0b tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] PATH_INFO: `/v3/roles/5ae32785b5604713976721b42543d631/implies/8d9d459534cc496eb3c2cf2cdf236d6a` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:17.315386 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f4f49c-e5fe-4eab-97e3-455a3252cf0b tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=5ae32785b5604713976721b42543d631, implied_role_id=8d9d459534cc496eb3c2cf2cdf236d6a)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:17.317487 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f4f49c-e5fe-4eab-97e3-455a3252cf0b tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:17.322924 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e708f788-8bcc-4582-a88e-c7e306e7f831 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:17.327845 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27373de5-ebd0-4564-a839-29c847a2aa28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:17.328730 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27373de5-ebd0-4564-a839-29c847a2aa28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:17.329019 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27373de5-ebd0-4564-a839-29c847a2aa28 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:17.337394 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27373de5-ebd0-4564-a839-29c847a2aa28 admin admin] PATH_INFO: `/v3/projects/be55450fe3654224b6455aec3063ca29` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:17.337649 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3100/6169] 10.222.0.17 () {58 vars in 1346 bytes} [Sat Jul 23 21:34:17 2022] DELETE /identity/v3/roles/5ae32785b5604713976721b42543d631/implies/8d9d459534cc496eb3c2cf2cdf236d6a => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:17.337649 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f4f49c-e5fe-4eab-97e3-455a3252cf0b tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:17.339071 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27373de5-ebd0-4564-a839-29c847a2aa28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be55450fe3654224b6455aec3063ca29)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:17.340399 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-45f4f49c-e5fe-4eab-97e3-455a3252cf0b tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:17.341215 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27373de5-ebd0-4564-a839-29c847a2aa28 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:17.386560 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:17.399906 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-27373de5-ebd0-4564-a839-29c847a2aa28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be55450fe3654224b6455aec3063ca29', 'request_id': 'req-27373de5-ebd0-4564-a839-29c847a2aa28'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:17.406720 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:17.408851 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-27373de5-ebd0-4564-a839-29c847a2aa28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be55450fe3654224b6455aec3063ca29', 'request_id': 'req-27373de5-ebd0-4564-a839-29c847a2aa28'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:17.416785 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-27373de5-ebd0-4564-a839-29c847a2aa28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be55450fe3654224b6455aec3063ca29', 'request_id': 'req-27373de5-ebd0-4564-a839-29c847a2aa28'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:17.426295 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f4f49c-e5fe-4eab-97e3-455a3252cf0b tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:17.430401 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-27373de5-ebd0-4564-a839-29c847a2aa28 admin admin] The token cache is being invalidate because project be55450fe3654224b6455aec3063ca29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:34:17.430401 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-27373de5-ebd0-4564-a839-29c847a2aa28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:17.431112 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-27373de5-ebd0-4564-a839-29c847a2aa28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:17.432820 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3070/6170] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:34:17 2022] DELETE /identity/v3/projects/be55450fe3654224b6455aec3063ca29 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:34:17.437635 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f852ce8-ed56-432f-9735-490351d497be None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:17.438023 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f852ce8-ed56-432f-9735-490351d497be None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:17.438364 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f852ce8-ed56-432f-9735-490351d497be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:17.462863 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-9f852ce8-ed56-432f-9735-490351d497be None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:34:17.464378 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-9f852ce8-ed56-432f-9735-490351d497be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:17.502914 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d93bf8-2b12-4628-a57d-d9574721e540 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce5b7c9a7e31401d8c04a24af809ed81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '816984c605114e4680f81fb019e5229f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:17.503720 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d93bf8-2b12-4628-a57d-d9574721e540 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:17.504000 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d93bf8-2b12-4628-a57d-d9574721e540 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:17.504292 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d93bf8-2b12-4628-a57d-d9574721e540 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] PATH_INFO: `/v3/roles/8d9d459534cc496eb3c2cf2cdf236d6a` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:17.506726 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d93bf8-2b12-4628-a57d-d9574721e540 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=8d9d459534cc496eb3c2cf2cdf236d6a)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:17.508866 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d93bf8-2b12-4628-a57d-d9574721e540 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:17.552551 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3071/6171] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:34:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:34:17.560877 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1865637c-a80c-4b2b-ace9-82eeffceee2c None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:17.561272 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1865637c-a80c-4b2b-ace9-82eeffceee2c None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:17.561620 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1865637c-a80c-4b2b-ace9-82eeffceee2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:17.570400 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-77d93bf8-2b12-4628-a57d-d9574721e540 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Invalidating the token cache because role 8d9d459534cc496eb3c2cf2cdf236d6a has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:34:17.570400 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-77d93bf8-2b12-4628-a57d-d9574721e540 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:17.571085 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-77d93bf8-2b12-4628-a57d-d9574721e540 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:17.574115 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3101/6172] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:34:17 2022] DELETE /identity/v3/roles/8d9d459534cc496eb3c2cf2cdf236d6a => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:34:17.579930 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d93bf8-2b12-4628-a57d-d9574721e540 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:17.581717 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-77d93bf8-2b12-4628-a57d-d9574721e540 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:17.588388 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-1865637c-a80c-4b2b-ace9-82eeffceee2c None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:34:17.590109 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-1865637c-a80c-4b2b-ace9-82eeffceee2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:17.660199 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d93bf8-2b12-4628-a57d-d9574721e540 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:17.665918 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3072/6173] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:34:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:34:17.666099 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7ac7b1-3c93-4af8-8319-af030913f9e8 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce5b7c9a7e31401d8c04a24af809ed81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '816984c605114e4680f81fb019e5229f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:17.666546 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7ac7b1-3c93-4af8-8319-af030913f9e8 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:17.666898 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7ac7b1-3c93-4af8-8319-af030913f9e8 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:17.667242 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7ac7b1-3c93-4af8-8319-af030913f9e8 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] PATH_INFO: `/v3/roles/5ae32785b5604713976721b42543d631` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:17.668329 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1865637c-a80c-4b2b-ace9-82eeffceee2c None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:17.668608 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7ac7b1-3c93-4af8-8319-af030913f9e8 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=5ae32785b5604713976721b42543d631)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:17.670437 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7ac7b1-3c93-4af8-8319-af030913f9e8 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:17.681666 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1865637c-a80c-4b2b-ace9-82eeffceee2c None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:17.688575 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcce60b6-d529-440c-8a8c-b5b47f02911e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:17.689716 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcce60b6-d529-440c-8a8c-b5b47f02911e admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:17.690444 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcce60b6-d529-440c-8a8c-b5b47f02911e admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:17.690761 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcce60b6-d529-440c-8a8c-b5b47f02911e admin admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:17.692282 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcce60b6-d529-440c-8a8c-b5b47f02911e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:34:17.692603 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcce60b6-d529-440c-8a8c-b5b47f02911e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:17.694382 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcce60b6-d529-440c-8a8c-b5b47f02911e admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:17.707780 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3073/6174] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:34:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:34:17.708667 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-4a7ac7b1-3c93-4af8-8319-af030913f9e8 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Invalidating the token cache because role 5ae32785b5604713976721b42543d631 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:34:17.709294 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-4a7ac7b1-3c93-4af8-8319-af030913f9e8 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:17.710182 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-4a7ac7b1-3c93-4af8-8319-af030913f9e8 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:17.712196 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcce60b6-d529-440c-8a8c-b5b47f02911e admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:17.712824 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3102/6175] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:34:17 2022] DELETE /identity/v3/roles/5ae32785b5604713976721b42543d631 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:17.714208 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-fcce60b6-d529-440c-8a8c-b5b47f02911e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:17.718807 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7ac7b1-3c93-4af8-8319-af030913f9e8 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:17.720179 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-4a7ac7b1-3c93-4af8-8319-af030913f9e8 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:17.729226 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcce60b6-d529-440c-8a8c-b5b47f02911e admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:17.750515 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:17.796916 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:17.803108 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7ac7b1-3c93-4af8-8319-af030913f9e8 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:17.808335 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecddff3-e4db-4af1-8432-e18aa4b3aff5 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce5b7c9a7e31401d8c04a24af809ed81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '816984c605114e4680f81fb019e5229f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:17.810048 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecddff3-e4db-4af1-8432-e18aa4b3aff5 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:17.810305 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecddff3-e4db-4af1-8432-e18aa4b3aff5 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:17.810582 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecddff3-e4db-4af1-8432-e18aa4b3aff5 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] PATH_INFO: `/v3/roles/c95110eb6beb4ed794fdbd9884cad174/implies/ba52c8c461774400a925c36f55ed56fb` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:17.812647 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecddff3-e4db-4af1-8432-e18aa4b3aff5 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=c95110eb6beb4ed794fdbd9884cad174, implied_role_id=ba52c8c461774400a925c36f55ed56fb)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:17.814327 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecddff3-e4db-4af1-8432-e18aa4b3aff5 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:17.823440 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0084baf-ea1f-4da6-a322-5859f1aec570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:17.830365 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0084baf-ea1f-4da6-a322-5859f1aec570 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:17.830633 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0084baf-ea1f-4da6-a322-5859f1aec570 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:17.830936 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0084baf-ea1f-4da6-a322-5859f1aec570 admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:17.831686 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0084baf-ea1f-4da6-a322-5859f1aec570 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:17.833694 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0084baf-ea1f-4da6-a322-5859f1aec570 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:17.856729 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3103/6176] 10.222.0.17 () {60 vars in 1362 bytes} [Sat Jul 23 21:34:17 2022] PUT /identity/v3/roles/c95110eb6beb4ed794fdbd9884cad174/implies/ba52c8c461774400a925c36f55ed56fb => generated 519 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:34:17.860720 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecddff3-e4db-4af1-8432-e18aa4b3aff5 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:17.896761 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3074/6177] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:34:17 2022] POST /identity/v3/projects => generated 377 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:34:17.901117 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0084baf-ea1f-4da6-a322-5859f1aec570 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:17.957373 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecddff3-e4db-4af1-8432-e18aa4b3aff5 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:18.024635 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0084baf-ea1f-4da6-a322-5859f1aec570 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:18.036080 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be25fd16-56dc-4d01-9665-38221ae27279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:18.037984 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be25fd16-56dc-4d01-9665-38221ae27279 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:18.038203 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be25fd16-56dc-4d01-9665-38221ae27279 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:18.038483 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be25fd16-56dc-4d01-9665-38221ae27279 admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:18.039355 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be25fd16-56dc-4d01-9665-38221ae27279 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:18.041201 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be25fd16-56dc-4d01-9665-38221ae27279 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:18.050030 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544df596-57ee-4f63-bc42-34ec851699d7 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce5b7c9a7e31401d8c04a24af809ed81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '816984c605114e4680f81fb019e5229f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:18.051021 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544df596-57ee-4f63-bc42-34ec851699d7 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] REQUEST_METHOD: `HEAD` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:18.051307 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544df596-57ee-4f63-bc42-34ec851699d7 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:18.051591 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544df596-57ee-4f63-bc42-34ec851699d7 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] PATH_INFO: `/v3/roles/c95110eb6beb4ed794fdbd9884cad174/implies/ba52c8c461774400a925c36f55ed56fb` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:18.053796 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544df596-57ee-4f63-bc42-34ec851699d7 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorizing `identity:check_implied_role(prior_role_id=c95110eb6beb4ed794fdbd9884cad174, implied_role_id=ba52c8c461774400a925c36f55ed56fb)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:18.055211 ncdv-master-1 devstack@keystone.service[91548]: WARNING py.warnings [None req-544df596-57ee-4f63-bc42-34ec851699d7 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_implied_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:34:18.055211 ncdv-master-1 devstack@keystone.service[91548]: warnings.warn(msg) Jul 23 21:34:18.055211 ncdv-master-1 devstack@keystone.service[91548]: Jul 23 21:34:18.056198 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544df596-57ee-4f63-bc42-34ec851699d7 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:18.057221 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544df596-57ee-4f63-bc42-34ec851699d7 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=c95110eb6beb4ed794fdbd9884cad174, implied_role_id=ba52c8c461774400a925c36f55ed56fb)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:18.058217 ncdv-master-1 devstack@keystone.service[91548]: WARNING py.warnings [None req-544df596-57ee-4f63-bc42-34ec851699d7 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_implied_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:34:18.058217 ncdv-master-1 devstack@keystone.service[91548]: warnings.warn(msg) Jul 23 21:34:18.058217 ncdv-master-1 devstack@keystone.service[91548]: Jul 23 21:34:18.059050 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544df596-57ee-4f63-bc42-34ec851699d7 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:18.069417 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3104/6178] 10.222.0.17 () {58 vars in 1344 bytes} [Sat Jul 23 21:34:17 2022] HEAD /identity/v3/roles/c95110eb6beb4ed794fdbd9884cad174/implies/ba52c8c461774400a925c36f55ed56fb => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:18.070431 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544df596-57ee-4f63-bc42-34ec851699d7 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:18.082483 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544df596-57ee-4f63-bc42-34ec851699d7 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:18.088637 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4209dd1-a6ff-4bb1-bcbe-7e9a7d4ea7fa tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce5b7c9a7e31401d8c04a24af809ed81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '816984c605114e4680f81fb019e5229f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:18.089705 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4209dd1-a6ff-4bb1-bcbe-7e9a7d4ea7fa tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:18.089934 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4209dd1-a6ff-4bb1-bcbe-7e9a7d4ea7fa tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:18.090210 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4209dd1-a6ff-4bb1-bcbe-7e9a7d4ea7fa tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] PATH_INFO: `/v3/roles/c95110eb6beb4ed794fdbd9884cad174/implies/ba52c8c461774400a925c36f55ed56fb` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:18.092246 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4209dd1-a6ff-4bb1-bcbe-7e9a7d4ea7fa tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=c95110eb6beb4ed794fdbd9884cad174, implied_role_id=ba52c8c461774400a925c36f55ed56fb)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:18.094280 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4209dd1-a6ff-4bb1-bcbe-7e9a7d4ea7fa tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:18.102458 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3105/6179] 10.222.0.17 () {58 vars in 1343 bytes} [Sat Jul 23 21:34:18 2022] GET /identity/v3/roles/c95110eb6beb4ed794fdbd9884cad174/implies/ba52c8c461774400a925c36f55ed56fb => generated 519 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:34:18.107403 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3075/6180] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:34:17 2022] POST /identity/v3/users => generated 289 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:34:18.107581 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4209dd1-a6ff-4bb1-bcbe-7e9a7d4ea7fa tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:18.113198 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be25fd16-56dc-4d01-9665-38221ae27279 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:18.118669 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4209dd1-a6ff-4bb1-bcbe-7e9a7d4ea7fa tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:18.123679 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b225ab81-15df-48b1-b92b-2fef25cb0752 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce5b7c9a7e31401d8c04a24af809ed81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '816984c605114e4680f81fb019e5229f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:18.124725 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b225ab81-15df-48b1-b92b-2fef25cb0752 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:18.125009 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b225ab81-15df-48b1-b92b-2fef25cb0752 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:18.125416 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b225ab81-15df-48b1-b92b-2fef25cb0752 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] PATH_INFO: `/v3/roles/c95110eb6beb4ed794fdbd9884cad174/implies/ba52c8c461774400a925c36f55ed56fb` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:18.127708 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b225ab81-15df-48b1-b92b-2fef25cb0752 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=c95110eb6beb4ed794fdbd9884cad174, implied_role_id=ba52c8c461774400a925c36f55ed56fb)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:18.129583 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b225ab81-15df-48b1-b92b-2fef25cb0752 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:18.143831 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be25fd16-56dc-4d01-9665-38221ae27279 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:18.149914 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3106/6181] 10.222.0.17 () {58 vars in 1346 bytes} [Sat Jul 23 21:34:18 2022] DELETE /identity/v3/roles/c95110eb6beb4ed794fdbd9884cad174/implies/ba52c8c461774400a925c36f55ed56fb => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:18.152471 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b225ab81-15df-48b1-b92b-2fef25cb0752 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:18.227378 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:18.247767 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86385feb-06f7-4dd5-b2c6-cea0d01e2d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:18.248552 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86385feb-06f7-4dd5-b2c6-cea0d01e2d4c admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:18.249179 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86385feb-06f7-4dd5-b2c6-cea0d01e2d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:18.249465 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86385feb-06f7-4dd5-b2c6-cea0d01e2d4c admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:18.250233 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86385feb-06f7-4dd5-b2c6-cea0d01e2d4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:18.252043 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86385feb-06f7-4dd5-b2c6-cea0d01e2d4c admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:18.266469 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3076/6182] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:34:18 2022] GET /identity/v3/roles => generated 2321 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:34:18.271115 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86385feb-06f7-4dd5-b2c6-cea0d01e2d4c admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:18.283360 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86385feb-06f7-4dd5-b2c6-cea0d01e2d4c admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:18.285788 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b225ab81-15df-48b1-b92b-2fef25cb0752 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:18.288629 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1020da5f-f2f8-4718-a0f8-cf9bde3a63a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:18.289500 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1020da5f-f2f8-4718-a0f8-cf9bde3a63a4 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:18.289996 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1020da5f-f2f8-4718-a0f8-cf9bde3a63a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:18.290370 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1020da5f-f2f8-4718-a0f8-cf9bde3a63a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:18.291242 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1020da5f-f2f8-4718-a0f8-cf9bde3a63a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:18.293614 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1020da5f-f2f8-4718-a0f8-cf9bde3a63a4 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:18.302748 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c072ecb-a666-404a-8b68-51361e30afc1 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce5b7c9a7e31401d8c04a24af809ed81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '816984c605114e4680f81fb019e5229f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:18.303795 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c072ecb-a666-404a-8b68-51361e30afc1 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:18.304976 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c072ecb-a666-404a-8b68-51361e30afc1 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:18.304976 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c072ecb-a666-404a-8b68-51361e30afc1 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] PATH_INFO: `/v3/roles/c95110eb6beb4ed794fdbd9884cad174/implies/ba52c8c461774400a925c36f55ed56fb` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:18.308297 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3077/6183] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:34:18 2022] GET /identity/v3/roles => generated 2321 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:34:18.310982 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c072ecb-a666-404a-8b68-51361e30afc1 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=c95110eb6beb4ed794fdbd9884cad174, implied_role_id=ba52c8c461774400a925c36f55ed56fb)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:18.313015 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1020da5f-f2f8-4718-a0f8-cf9bde3a63a4 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:18.314853 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c072ecb-a666-404a-8b68-51361e30afc1 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:18.328885 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1020da5f-f2f8-4718-a0f8-cf9bde3a63a4 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:18.335374 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be06be2b-ba3b-46e9-bbf4-3b02c09efbd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:18.336210 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be06be2b-ba3b-46e9-bbf4-3b02c09efbd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:18.336560 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be06be2b-ba3b-46e9-bbf4-3b02c09efbd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:18.337027 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be06be2b-ba3b-46e9-bbf4-3b02c09efbd6 admin admin] PATH_INFO: `/v3/projects/7b70d1854a1c4c889b83b9186376fae1/users/1de9a5c15bdf4247880773a71c830315/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:18.342316 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-2c072ecb-a666-404a-8b68-51361e30afc1 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] c95110eb6beb4ed794fdbd9884cad174 does not imply ba52c8c461774400a925c36f55ed56fb.: keystone.exception.ImpliedRoleNotFound: c95110eb6beb4ed794fdbd9884cad174 does not imply ba52c8c461774400a925c36f55ed56fb. Jul 23 21:34:18.342316 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 21:34:18.342316 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 105, in _get_implied_role Jul 23 21:34:18.342316 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application ref = query.one() Jul 23 21:34:18.342316 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2865, in one Jul 23 21:34:18.342316 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._iter().one() Jul 23 21:34:18.342316 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1417, in one Jul 23 21:34:18.342316 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._only_one_row( Jul 23 21:34:18.342316 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Jul 23 21:34:18.342316 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exc.NoResultFound( Jul 23 21:34:18.342316 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Jul 23 21:34:18.342316 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 21:34:18.342316 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 23 21:34:18.342316 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 21:34:18.342316 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 21:34:18.342316 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 21:34:18.343468 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 21:34:18.343468 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 21:34:18.343468 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 21:34:18.343468 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 21:34:18.343468 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 21:34:18.343468 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 21:34:18.343468 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 21:34:18.343468 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 21:34:18.343468 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 21:34:18.343468 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 235, in get Jul 23 21:34:18.343468 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_implied_role(prior_role_id, implied_role_id) Jul 23 21:34:18.343468 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 239, in _get_implied_role Jul 23 21:34:18.343468 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application PROVIDERS.role_api.get_implied_role( Jul 23 21:34:18.343468 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 149, in get_implied_role Jul 23 21:34:18.343468 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application ref = self._get_implied_role(session, prior_role_id, Jul 23 21:34:18.343468 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 107, in _get_implied_role Jul 23 21:34:18.344612 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.ImpliedRoleNotFound( Jul 23 21:34:18.344612 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.ImpliedRoleNotFound: c95110eb6beb4ed794fdbd9884cad174 does not imply ba52c8c461774400a925c36f55ed56fb. Jul 23 21:34:18.344612 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 21:34:18.346862 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3107/6184] 10.222.0.17 () {58 vars in 1343 bytes} [Sat Jul 23 21:34:18 2022] GET /identity/v3/roles/c95110eb6beb4ed794fdbd9884cad174/implies/ba52c8c461774400a925c36f55ed56fb => generated 137 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 23 21:34:18.351357 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c072ecb-a666-404a-8b68-51361e30afc1 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:18.361215 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be06be2b-ba3b-46e9-bbf4-3b02c09efbd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b70d1854a1c4c889b83b9186376fae1, user_id=1de9a5c15bdf4247880773a71c830315, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:18.364314 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be06be2b-ba3b-46e9-bbf4-3b02c09efbd6 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:18.367353 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c072ecb-a666-404a-8b68-51361e30afc1 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:18.374085 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610cef30-7775-408c-b9cc-c9bfdc9c245b tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce5b7c9a7e31401d8c04a24af809ed81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '816984c605114e4680f81fb019e5229f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:18.375584 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610cef30-7775-408c-b9cc-c9bfdc9c245b tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:18.376105 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610cef30-7775-408c-b9cc-c9bfdc9c245b tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:18.376517 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610cef30-7775-408c-b9cc-c9bfdc9c245b tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] PATH_INFO: `/v3/roles/c95110eb6beb4ed794fdbd9884cad174/implies/ba52c8c461774400a925c36f55ed56fb` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:18.378548 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610cef30-7775-408c-b9cc-c9bfdc9c245b tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=c95110eb6beb4ed794fdbd9884cad174, implied_role_id=ba52c8c461774400a925c36f55ed56fb)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:18.380251 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610cef30-7775-408c-b9cc-c9bfdc9c245b tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:18.382866 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3078/6185] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:34:18 2022] PUT /identity/v3/projects/7b70d1854a1c4c889b83b9186376fae1/users/1de9a5c15bdf4247880773a71c830315/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:18.393633 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d8b288-b786-4a44-be76-c75a43556d38 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:18.394520 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d8b288-b786-4a44-be76-c75a43556d38 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:18.395174 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d8b288-b786-4a44-be76-c75a43556d38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:18.399228 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-610cef30-7775-408c-b9cc-c9bfdc9c245b tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] c95110eb6beb4ed794fdbd9884cad174 does not imply ba52c8c461774400a925c36f55ed56fb.: keystone.exception.ImpliedRoleNotFound: c95110eb6beb4ed794fdbd9884cad174 does not imply ba52c8c461774400a925c36f55ed56fb. Jul 23 21:34:18.399228 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 21:34:18.399228 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 105, in _get_implied_role Jul 23 21:34:18.399228 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application ref = query.one() Jul 23 21:34:18.399228 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2865, in one Jul 23 21:34:18.399228 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._iter().one() Jul 23 21:34:18.399228 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1417, in one Jul 23 21:34:18.399228 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._only_one_row( Jul 23 21:34:18.399228 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Jul 23 21:34:18.399228 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exc.NoResultFound( Jul 23 21:34:18.399228 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Jul 23 21:34:18.399228 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 21:34:18.399228 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 23 21:34:18.399228 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 21:34:18.399228 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 21:34:18.399228 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 21:34:18.400395 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 21:34:18.400395 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 21:34:18.400395 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 21:34:18.400395 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 21:34:18.400395 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 21:34:18.400395 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 21:34:18.400395 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 21:34:18.400395 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 21:34:18.400395 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 21:34:18.400395 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 270, in delete Jul 23 21:34:18.400395 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application PROVIDERS.role_api.delete_implied_role(prior_role_id, implied_role_id) Jul 23 21:34:18.400395 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 21:34:18.400395 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 21:34:18.400395 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1369, in delete_implied_role Jul 23 21:34:18.400395 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application self.driver.delete_implied_role(prior_role_id, implied_role_id) Jul 23 21:34:18.400395 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 129, in delete_implied_role Jul 23 21:34:18.401415 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application ref = self._get_implied_role(session, prior_role_id, Jul 23 21:34:18.401415 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 107, in _get_implied_role Jul 23 21:34:18.401415 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.ImpliedRoleNotFound( Jul 23 21:34:18.401415 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.ImpliedRoleNotFound: c95110eb6beb4ed794fdbd9884cad174 does not imply ba52c8c461774400a925c36f55ed56fb. Jul 23 21:34:18.401415 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 21:34:18.407031 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3108/6186] 10.222.0.17 () {58 vars in 1346 bytes} [Sat Jul 23 21:34:18 2022] DELETE /identity/v3/roles/c95110eb6beb4ed794fdbd9884cad174/implies/ba52c8c461774400a925c36f55ed56fb => generated 137 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 23 21:34:18.407976 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610cef30-7775-408c-b9cc-c9bfdc9c245b tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:18.423289 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610cef30-7775-408c-b9cc-c9bfdc9c245b tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:18.444509 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-04d8b288-b786-4a44-be76-c75a43556d38 None None] MFA Rules not processed for user `1de9a5c15bdf4247880773a71c830315`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:34:18.446527 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-04d8b288-b786-4a44-be76-c75a43556d38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:18.469712 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:18.517934 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197dc9e3-d1d5-48af-8b20-aaebcbc79811 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce5b7c9a7e31401d8c04a24af809ed81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '816984c605114e4680f81fb019e5229f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:18.519046 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197dc9e3-d1d5-48af-8b20-aaebcbc79811 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:18.519325 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197dc9e3-d1d5-48af-8b20-aaebcbc79811 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:18.519601 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197dc9e3-d1d5-48af-8b20-aaebcbc79811 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] PATH_INFO: `/v3/roles/c95110eb6beb4ed794fdbd9884cad174/implies/ba52c8c461774400a925c36f55ed56fb` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:18.527835 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197dc9e3-d1d5-48af-8b20-aaebcbc79811 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=c95110eb6beb4ed794fdbd9884cad174, implied_role_id=ba52c8c461774400a925c36f55ed56fb)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:18.529770 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197dc9e3-d1d5-48af-8b20-aaebcbc79811 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:18.548541 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3079/6187] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:34:18 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:34:18.554932 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d8b288-b786-4a44-be76-c75a43556d38 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:18.566749 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d8b288-b786-4a44-be76-c75a43556d38 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:18.580428 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3109/6188] 10.222.0.17 () {60 vars in 1362 bytes} [Sat Jul 23 21:34:18 2022] PUT /identity/v3/roles/c95110eb6beb4ed794fdbd9884cad174/implies/ba52c8c461774400a925c36f55ed56fb => generated 519 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:34:18.582263 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197dc9e3-d1d5-48af-8b20-aaebcbc79811 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:18.650936 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c0918d-3530-4980-af92-d1e6949c43a5 tempest-DefaultDomainTestJSON-825457492 tempest-DefaultDomainTestJSON-825457492-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1de9a5c15bdf4247880773a71c830315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b70d1854a1c4c889b83b9186376fae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:18.652034 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c0918d-3530-4980-af92-d1e6949c43a5 tempest-DefaultDomainTestJSON-825457492 tempest-DefaultDomainTestJSON-825457492-project] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:18.652318 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c0918d-3530-4980-af92-d1e6949c43a5 tempest-DefaultDomainTestJSON-825457492 tempest-DefaultDomainTestJSON-825457492-project] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:18.652593 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c0918d-3530-4980-af92-d1e6949c43a5 tempest-DefaultDomainTestJSON-825457492 tempest-DefaultDomainTestJSON-825457492-project] PATH_INFO: `/v3/domains/default` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:18.654232 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c0918d-3530-4980-af92-d1e6949c43a5 tempest-DefaultDomainTestJSON-825457492 tempest-DefaultDomainTestJSON-825457492-project] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:18.656001 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c0918d-3530-4980-af92-d1e6949c43a5 tempest-DefaultDomainTestJSON-825457492 tempest-DefaultDomainTestJSON-825457492-project] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:18.658240 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3080/6189] 10.222.0.17 () {58 vars in 1151 bytes} [Sat Jul 23 21:34:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:34:18.663085 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c0918d-3530-4980-af92-d1e6949c43a5 tempest-DefaultDomainTestJSON-825457492 tempest-DefaultDomainTestJSON-825457492-project] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:18.686051 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197dc9e3-d1d5-48af-8b20-aaebcbc79811 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:18.693123 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee5db4b-82db-48ce-a9e7-165b9d9d24f3 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce5b7c9a7e31401d8c04a24af809ed81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '816984c605114e4680f81fb019e5229f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:18.693779 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee5db4b-82db-48ce-a9e7-165b9d9d24f3 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:18.694135 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee5db4b-82db-48ce-a9e7-165b9d9d24f3 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:18.694418 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee5db4b-82db-48ce-a9e7-165b9d9d24f3 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] PATH_INFO: `/v3/roles/c95110eb6beb4ed794fdbd9884cad174/implies/249a1b48454b46c18c7063167ea08160` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:18.696188 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee5db4b-82db-48ce-a9e7-165b9d9d24f3 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=c95110eb6beb4ed794fdbd9884cad174, implied_role_id=249a1b48454b46c18c7063167ea08160)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:18.697824 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee5db4b-82db-48ce-a9e7-165b9d9d24f3 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:18.729962 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3110/6190] 10.222.0.17 () {60 vars in 1362 bytes} [Sat Jul 23 21:34:18 2022] PUT /identity/v3/roles/c95110eb6beb4ed794fdbd9884cad174/implies/249a1b48454b46c18c7063167ea08160 => generated 519 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:34:18.732137 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee5db4b-82db-48ce-a9e7-165b9d9d24f3 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:18.737450 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c0918d-3530-4980-af92-d1e6949c43a5 tempest-DefaultDomainTestJSON-825457492 tempest-DefaultDomainTestJSON-825457492-project] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:18.761057 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:18.808536 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee5db4b-82db-48ce-a9e7-165b9d9d24f3 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:18.821515 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b1871e-a128-436c-98e6-528797f9db05 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce5b7c9a7e31401d8c04a24af809ed81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '816984c605114e4680f81fb019e5229f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:18.821926 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b1871e-a128-436c-98e6-528797f9db05 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:18.822501 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b1871e-a128-436c-98e6-528797f9db05 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:18.822501 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b1871e-a128-436c-98e6-528797f9db05 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] PATH_INFO: `/v3/roles/249a1b48454b46c18c7063167ea08160/implies/2564d3143890441ba9b4a9ae8a4875d3` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:18.824158 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed826e0-1b1b-492e-8bee-aac998462ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:18.824561 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b1871e-a128-436c-98e6-528797f9db05 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=249a1b48454b46c18c7063167ea08160, implied_role_id=2564d3143890441ba9b4a9ae8a4875d3)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:18.825076 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed826e0-1b1b-492e-8bee-aac998462ea6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:18.825364 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed826e0-1b1b-492e-8bee-aac998462ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:18.825638 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed826e0-1b1b-492e-8bee-aac998462ea6 admin admin] PATH_INFO: `/v3/users/1de9a5c15bdf4247880773a71c830315` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:18.826156 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b1871e-a128-436c-98e6-528797f9db05 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:18.827076 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed826e0-1b1b-492e-8bee-aac998462ea6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1de9a5c15bdf4247880773a71c830315)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:18.829015 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed826e0-1b1b-492e-8bee-aac998462ea6 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:18.843141 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:18.858728 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3111/6191] 10.222.0.17 () {60 vars in 1362 bytes} [Sat Jul 23 21:34:18 2022] PUT /identity/v3/roles/249a1b48454b46c18c7063167ea08160/implies/2564d3143890441ba9b4a9ae8a4875d3 => generated 520 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:34:18.863038 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b1871e-a128-436c-98e6-528797f9db05 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:18.883537 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-fed826e0-1b1b-492e-8bee-aac998462ea6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1de9a5c15bdf4247880773a71c830315'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:18.891092 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-fed826e0-1b1b-492e-8bee-aac998462ea6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1de9a5c15bdf4247880773a71c830315'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:18.891808 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-fed826e0-1b1b-492e-8bee-aac998462ea6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1de9a5c15bdf4247880773a71c830315'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:18.901978 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-fed826e0-1b1b-492e-8bee-aac998462ea6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1de9a5c15bdf4247880773a71c830315'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:18.918122 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-fed826e0-1b1b-492e-8bee-aac998462ea6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1de9a5c15bdf4247880773a71c830315'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:18.924829 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3081/6192] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:34:18 2022] DELETE /identity/v3/users/1de9a5c15bdf4247880773a71c830315 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:18.929059 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98303e3e-f9a0-4ebf-abf1-a7822901e5c3 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:18.929348 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98303e3e-f9a0-4ebf-abf1-a7822901e5c3 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:18.929628 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98303e3e-f9a0-4ebf-abf1-a7822901e5c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:18.938157 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b1871e-a128-436c-98e6-528797f9db05 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:18.957062 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-98303e3e-f9a0-4ebf-abf1-a7822901e5c3 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:34:18.958980 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-98303e3e-f9a0-4ebf-abf1-a7822901e5c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:19.023806 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d287de7d-4285-4bc6-803d-abc11a3f1907 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce5b7c9a7e31401d8c04a24af809ed81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '816984c605114e4680f81fb019e5229f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:19.024698 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d287de7d-4285-4bc6-803d-abc11a3f1907 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:19.025001 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d287de7d-4285-4bc6-803d-abc11a3f1907 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:19.025267 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d287de7d-4285-4bc6-803d-abc11a3f1907 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] PATH_INFO: `/v3/role_inferences` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:19.026597 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d287de7d-4285-4bc6-803d-abc11a3f1907 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorizing `identity:list_role_inference_rules()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:19.027751 ncdv-master-1 devstack@keystone.service[91548]: WARNING py.warnings [None req-d287de7d-4285-4bc6-803d-abc11a3f1907 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_role_inference_rules": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:34:19.027751 ncdv-master-1 devstack@keystone.service[91548]: warnings.warn(msg) Jul 23 21:34:19.027751 ncdv-master-1 devstack@keystone.service[91548]: Jul 23 21:34:19.028655 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d287de7d-4285-4bc6-803d-abc11a3f1907 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:19.041824 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3082/6193] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:34:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:34:19.055425 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98303e3e-f9a0-4ebf-abf1-a7822901e5c3 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:19.057126 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3112/6194] 10.222.0.17 () {58 vars in 1151 bytes} [Sat Jul 23 21:34:18 2022] GET /identity/v3/role_inferences => generated 1604 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 21:34:19.058097 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-98303e3e-f9a0-4ebf-abf1-a7822901e5c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:19.058292 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d287de7d-4285-4bc6-803d-abc11a3f1907 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:19.060174 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-d287de7d-4285-4bc6-803d-abc11a3f1907 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:19.080576 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d287de7d-4285-4bc6-803d-abc11a3f1907 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:19.087799 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d19135-f8c4-4eab-8907-7248a9cc1891 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce5b7c9a7e31401d8c04a24af809ed81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '816984c605114e4680f81fb019e5229f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:19.088957 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d19135-f8c4-4eab-8907-7248a9cc1891 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:19.089243 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d19135-f8c4-4eab-8907-7248a9cc1891 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:19.089518 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d19135-f8c4-4eab-8907-7248a9cc1891 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] PATH_INFO: `/v3/roles/249a1b48454b46c18c7063167ea08160/implies/2564d3143890441ba9b4a9ae8a4875d3` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:19.091456 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d19135-f8c4-4eab-8907-7248a9cc1891 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=249a1b48454b46c18c7063167ea08160, implied_role_id=2564d3143890441ba9b4a9ae8a4875d3)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:19.093323 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d19135-f8c4-4eab-8907-7248a9cc1891 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:19.110013 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3113/6195] 10.222.0.17 () {58 vars in 1346 bytes} [Sat Jul 23 21:34:19 2022] DELETE /identity/v3/roles/249a1b48454b46c18c7063167ea08160/implies/2564d3143890441ba9b4a9ae8a4875d3 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:19.114626 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d19135-f8c4-4eab-8907-7248a9cc1891 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:19.137453 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98303e3e-f9a0-4ebf-abf1-a7822901e5c3 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:19.162164 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:19.197830 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:19.199294 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d19135-f8c4-4eab-8907-7248a9cc1891 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:19.205053 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d7cbed-1cec-4d77-9d10-11247f1f0d5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:19.206339 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eab5faf-364b-47da-bb71-4d54f7c19fe7 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce5b7c9a7e31401d8c04a24af809ed81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '816984c605114e4680f81fb019e5229f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:19.206507 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d7cbed-1cec-4d77-9d10-11247f1f0d5f service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:19.206851 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d7cbed-1cec-4d77-9d10-11247f1f0d5f service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:19.207227 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d7cbed-1cec-4d77-9d10-11247f1f0d5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:19.207442 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eab5faf-364b-47da-bb71-4d54f7c19fe7 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:19.207729 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eab5faf-364b-47da-bb71-4d54f7c19fe7 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:19.208621 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eab5faf-364b-47da-bb71-4d54f7c19fe7 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] PATH_INFO: `/v3/roles/c95110eb6beb4ed794fdbd9884cad174/implies/249a1b48454b46c18c7063167ea08160` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:19.211031 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eab5faf-364b-47da-bb71-4d54f7c19fe7 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=c95110eb6beb4ed794fdbd9884cad174, implied_role_id=249a1b48454b46c18c7063167ea08160)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:19.212900 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eab5faf-364b-47da-bb71-4d54f7c19fe7 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:19.226769 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3114/6196] 10.222.0.17 () {58 vars in 1346 bytes} [Sat Jul 23 21:34:19 2022] DELETE /identity/v3/roles/c95110eb6beb4ed794fdbd9884cad174/implies/249a1b48454b46c18c7063167ea08160 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:19.246746 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eab5faf-364b-47da-bb71-4d54f7c19fe7 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:19.294853 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d7cbed-1cec-4d77-9d10-11247f1f0d5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:19.298049 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d7cbed-1cec-4d77-9d10-11247f1f0d5f service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:19.310677 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3083/6197] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:34:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 23 21:34:19.363632 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eab5faf-364b-47da-bb71-4d54f7c19fe7 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:19.377817 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d255b70-6ab6-4733-b352-b9ae0bbd2367 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce5b7c9a7e31401d8c04a24af809ed81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '816984c605114e4680f81fb019e5229f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:19.377817 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d255b70-6ab6-4733-b352-b9ae0bbd2367 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:19.377817 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d255b70-6ab6-4733-b352-b9ae0bbd2367 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:19.378297 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d255b70-6ab6-4733-b352-b9ae0bbd2367 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] PATH_INFO: `/v3/roles/c95110eb6beb4ed794fdbd9884cad174/implies/ba52c8c461774400a925c36f55ed56fb` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:19.378720 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d255b70-6ab6-4733-b352-b9ae0bbd2367 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=c95110eb6beb4ed794fdbd9884cad174, implied_role_id=ba52c8c461774400a925c36f55ed56fb)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:19.380977 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d255b70-6ab6-4733-b352-b9ae0bbd2367 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:19.402215 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3115/6198] 10.222.0.17 () {58 vars in 1346 bytes} [Sat Jul 23 21:34:19 2022] DELETE /identity/v3/roles/c95110eb6beb4ed794fdbd9884cad174/implies/ba52c8c461774400a925c36f55ed56fb => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:19.403361 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d7cbed-1cec-4d77-9d10-11247f1f0d5f service neutron] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:19.419425 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d7cbed-1cec-4d77-9d10-11247f1f0d5f service neutron] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:19.558460 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04c7f70-5b5e-475b-ba08-cd4d08469491 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce5b7c9a7e31401d8c04a24af809ed81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '816984c605114e4680f81fb019e5229f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:19.560582 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04c7f70-5b5e-475b-ba08-cd4d08469491 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:19.561106 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04c7f70-5b5e-475b-ba08-cd4d08469491 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:19.562222 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04c7f70-5b5e-475b-ba08-cd4d08469491 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:19.563318 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04c7f70-5b5e-475b-ba08-cd4d08469491 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:19.567297 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16e58a6-88e6-457c-9268-ba638e1c6d40 None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:19.567840 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16e58a6-88e6-457c-9268-ba638e1c6d40 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:19.568397 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16e58a6-88e6-457c-9268-ba638e1c6d40 None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:19.570515 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3116/6199] 10.222.0.17 () {54 vars in 912 bytes} [Sat Jul 23 21:34:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 23 21:34:19.571215 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04c7f70-5b5e-475b-ba08-cd4d08469491 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:19.578057 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be247fd9-26f7-4baf-b606-e0b701311ee6 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:19.578347 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be247fd9-26f7-4baf-b606-e0b701311ee6 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:19.578629 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be247fd9-26f7-4baf-b606-e0b701311ee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:19.603473 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3084/6200] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:34:19 2022] GET /identity/v3/roles => generated 2321 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 21:34:19.603788 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04c7f70-5b5e-475b-ba08-cd4d08469491 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:19.616755 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04c7f70-5b5e-475b-ba08-cd4d08469491 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:19.624798 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f8424f-b455-41aa-a6ea-726e2eede788 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce5b7c9a7e31401d8c04a24af809ed81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '816984c605114e4680f81fb019e5229f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:19.626202 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f8424f-b455-41aa-a6ea-726e2eede788 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:19.626666 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f8424f-b455-41aa-a6ea-726e2eede788 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:19.626954 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f8424f-b455-41aa-a6ea-726e2eede788 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:19.627891 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f8424f-b455-41aa-a6ea-726e2eede788 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:19.630773 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f8424f-b455-41aa-a6ea-726e2eede788 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:19.663275 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3085/6201] 10.222.0.17 () {60 vars in 1142 bytes} [Sat Jul 23 21:34:19 2022] POST /identity/v3/roles => generated 234 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:34:19.665042 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f8424f-b455-41aa-a6ea-726e2eede788 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:19.680887 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-be247fd9-26f7-4baf-b606-e0b701311ee6 None None] MFA Rules not processed for user `c497326ee890462e8f48b4a56f81990c`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:34:19.682169 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-be247fd9-26f7-4baf-b606-e0b701311ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:19.685654 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f8424f-b455-41aa-a6ea-726e2eede788 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:19.698829 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849a7b02-8f3c-445a-a254-96a9fcc2cf2d tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce5b7c9a7e31401d8c04a24af809ed81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '816984c605114e4680f81fb019e5229f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:19.700265 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849a7b02-8f3c-445a-a254-96a9fcc2cf2d tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:19.700388 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849a7b02-8f3c-445a-a254-96a9fcc2cf2d tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:19.700613 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849a7b02-8f3c-445a-a254-96a9fcc2cf2d tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] PATH_INFO: `/v3/roles/bd0d10a50f4f403dbde96ac2910e88bd` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:19.705305 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849a7b02-8f3c-445a-a254-96a9fcc2cf2d tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorizing `identity:update_role(role_id=bd0d10a50f4f403dbde96ac2910e88bd)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:19.706290 ncdv-master-1 devstack@keystone.service[91547]: WARNING py.warnings [None req-849a7b02-8f3c-445a-a254-96a9fcc2cf2d tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:34:19.706290 ncdv-master-1 devstack@keystone.service[91547]: warnings.warn(msg) Jul 23 21:34:19.706290 ncdv-master-1 devstack@keystone.service[91547]: Jul 23 21:34:19.707927 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849a7b02-8f3c-445a-a254-96a9fcc2cf2d tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:19.775326 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3086/6202] 10.222.0.17 () {60 vars in 1242 bytes} [Sat Jul 23 21:34:19 2022] PATCH /identity/v3/roles/bd0d10a50f4f403dbde96ac2910e88bd => generated 237 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:34:19.776316 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849a7b02-8f3c-445a-a254-96a9fcc2cf2d tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:19.799900 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3117/6203] 10.222.0.17 () {58 vars in 1009 bytes} [Sat Jul 23 21:34:19 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:34:19.805790 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849a7b02-8f3c-445a-a254-96a9fcc2cf2d tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:19.831124 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10547e38-bf9f-4af8-a8b8-c0984cfc0242 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce5b7c9a7e31401d8c04a24af809ed81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '816984c605114e4680f81fb019e5229f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:19.832575 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10547e38-bf9f-4af8-a8b8-c0984cfc0242 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:19.832928 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10547e38-bf9f-4af8-a8b8-c0984cfc0242 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:19.833347 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10547e38-bf9f-4af8-a8b8-c0984cfc0242 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] PATH_INFO: `/v3/roles/bd0d10a50f4f403dbde96ac2910e88bd` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:19.833493 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be247fd9-26f7-4baf-b606-e0b701311ee6 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:19.835351 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-be247fd9-26f7-4baf-b606-e0b701311ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:19.848500 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10547e38-bf9f-4af8-a8b8-c0984cfc0242 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorizing `identity:get_role(role_id=bd0d10a50f4f403dbde96ac2910e88bd)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:19.850765 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10547e38-bf9f-4af8-a8b8-c0984cfc0242 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:19.854856 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be247fd9-26f7-4baf-b606-e0b701311ee6 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:19.864220 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3087/6204] 10.222.0.17 () {58 vars in 1220 bytes} [Sat Jul 23 21:34:19 2022] GET /identity/v3/roles/bd0d10a50f4f403dbde96ac2910e88bd => generated 237 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:34:19.864220 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10547e38-bf9f-4af8-a8b8-c0984cfc0242 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:19.864482 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-10547e38-bf9f-4af8-a8b8-c0984cfc0242 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:19.867803 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9560dca-861d-4c1c-a1fd-68e23e88d5ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:19.868655 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9560dca-861d-4c1c-a1fd-68e23e88d5ae service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:19.868926 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9560dca-861d-4c1c-a1fd-68e23e88d5ae service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:19.869307 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9560dca-861d-4c1c-a1fd-68e23e88d5ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:19.878335 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9560dca-861d-4c1c-a1fd-68e23e88d5ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:19.880624 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9560dca-861d-4c1c-a1fd-68e23e88d5ae service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:19.892867 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3118/6205] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:34:19 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 23 21:34:19.893825 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9560dca-861d-4c1c-a1fd-68e23e88d5ae service neutron] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:19.909658 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9560dca-861d-4c1c-a1fd-68e23e88d5ae service neutron] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:19.915612 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2c3617-d2cd-4533-8498-1329d5424da9 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce5b7c9a7e31401d8c04a24af809ed81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '816984c605114e4680f81fb019e5229f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:19.916402 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2c3617-d2cd-4533-8498-1329d5424da9 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:19.916778 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2c3617-d2cd-4533-8498-1329d5424da9 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:19.917144 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2c3617-d2cd-4533-8498-1329d5424da9 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:19.918640 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2c3617-d2cd-4533-8498-1329d5424da9 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:19.920470 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2c3617-d2cd-4533-8498-1329d5424da9 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:19.942059 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3119/6206] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:34:19 2022] GET /identity/v3/roles => generated 2549 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:34:19.945087 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2c3617-d2cd-4533-8498-1329d5424da9 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:19.947108 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:19.960809 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2c3617-d2cd-4533-8498-1329d5424da9 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:19.968530 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbae57a7-ff77-4b1b-90ba-be28d6ef716f tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce5b7c9a7e31401d8c04a24af809ed81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '816984c605114e4680f81fb019e5229f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:19.969851 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbae57a7-ff77-4b1b-90ba-be28d6ef716f tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:19.970364 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbae57a7-ff77-4b1b-90ba-be28d6ef716f tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:19.970735 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbae57a7-ff77-4b1b-90ba-be28d6ef716f tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] PATH_INFO: `/v3/roles/bd0d10a50f4f403dbde96ac2910e88bd` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:19.970855 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10547e38-bf9f-4af8-a8b8-c0984cfc0242 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:19.972776 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbae57a7-ff77-4b1b-90ba-be28d6ef716f tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorizing `identity:delete_role(role_id=bd0d10a50f4f403dbde96ac2910e88bd)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:19.975106 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbae57a7-ff77-4b1b-90ba-be28d6ef716f tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:19.981083 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a746d4-e77a-4d8d-bec6-49653d5078e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:19.982385 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a746d4-e77a-4d8d-bec6-49653d5078e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:19.982769 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a746d4-e77a-4d8d-bec6-49653d5078e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:19.983110 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a746d4-e77a-4d8d-bec6-49653d5078e2 admin admin] PATH_INFO: `/v3/projects/7b70d1854a1c4c889b83b9186376fae1` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:19.984487 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a746d4-e77a-4d8d-bec6-49653d5078e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b70d1854a1c4c889b83b9186376fae1)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:19.986569 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a746d4-e77a-4d8d-bec6-49653d5078e2 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:20.019079 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:20.039729 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-dbae57a7-ff77-4b1b-90ba-be28d6ef716f tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Invalidating the token cache because role bd0d10a50f4f403dbde96ac2910e88bd has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:34:20.040190 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-dbae57a7-ff77-4b1b-90ba-be28d6ef716f tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:20.045628 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-dbae57a7-ff77-4b1b-90ba-be28d6ef716f tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:20.048091 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3120/6207] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:34:19 2022] DELETE /identity/v3/roles/bd0d10a50f4f403dbde96ac2910e88bd => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:34:20.049235 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-e4a746d4-e77a-4d8d-bec6-49653d5078e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b70d1854a1c4c889b83b9186376fae1', 'request_id': 'req-e4a746d4-e77a-4d8d-bec6-49653d5078e2'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:20.053598 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbae57a7-ff77-4b1b-90ba-be28d6ef716f tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:20.055476 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-dbae57a7-ff77-4b1b-90ba-be28d6ef716f tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:20.060175 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-e4a746d4-e77a-4d8d-bec6-49653d5078e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b70d1854a1c4c889b83b9186376fae1', 'request_id': 'req-e4a746d4-e77a-4d8d-bec6-49653d5078e2'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:20.067024 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-e4a746d4-e77a-4d8d-bec6-49653d5078e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b70d1854a1c4c889b83b9186376fae1', 'request_id': 'req-e4a746d4-e77a-4d8d-bec6-49653d5078e2'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:20.083113 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-e4a746d4-e77a-4d8d-bec6-49653d5078e2 admin admin] The token cache is being invalidate because project 7b70d1854a1c4c889b83b9186376fae1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:34:20.083758 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-e4a746d4-e77a-4d8d-bec6-49653d5078e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:20.084584 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-e4a746d4-e77a-4d8d-bec6-49653d5078e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:20.090560 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3088/6208] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:34:19 2022] DELETE /identity/v3/projects/7b70d1854a1c4c889b83b9186376fae1 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:20.096555 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9856430d-1ef8-4040-ad74-4b4299846da4 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:20.098474 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9856430d-1ef8-4040-ad74-4b4299846da4 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:20.098983 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9856430d-1ef8-4040-ad74-4b4299846da4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:20.122115 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-9856430d-1ef8-4040-ad74-4b4299846da4 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:34:20.123336 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-9856430d-1ef8-4040-ad74-4b4299846da4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:20.135167 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbae57a7-ff77-4b1b-90ba-be28d6ef716f tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:20.140329 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42c2d05-c90f-4bb4-9ecb-65f843c33081 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce5b7c9a7e31401d8c04a24af809ed81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '816984c605114e4680f81fb019e5229f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:20.141284 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42c2d05-c90f-4bb4-9ecb-65f843c33081 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:20.141567 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42c2d05-c90f-4bb4-9ecb-65f843c33081 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:20.141940 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42c2d05-c90f-4bb4-9ecb-65f843c33081 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] PATH_INFO: `/v3/roles/c95110eb6beb4ed794fdbd9884cad174/implies/ba52c8c461774400a925c36f55ed56fb` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:20.143846 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42c2d05-c90f-4bb4-9ecb-65f843c33081 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=c95110eb6beb4ed794fdbd9884cad174, implied_role_id=ba52c8c461774400a925c36f55ed56fb)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:20.145452 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42c2d05-c90f-4bb4-9ecb-65f843c33081 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:20.181095 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3121/6209] 10.222.0.17 () {60 vars in 1362 bytes} [Sat Jul 23 21:34:20 2022] PUT /identity/v3/roles/c95110eb6beb4ed794fdbd9884cad174/implies/ba52c8c461774400a925c36f55ed56fb => generated 519 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:34:20.185177 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42c2d05-c90f-4bb4-9ecb-65f843c33081 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:20.186918 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-f42c2d05-c90f-4bb4-9ecb-65f843c33081 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:20.192814 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3089/6210] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:34:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:34:20.203571 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753a3ac3-ffe4-4a5d-947f-c6b44489208c None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:20.203830 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753a3ac3-ffe4-4a5d-947f-c6b44489208c None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:20.204052 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753a3ac3-ffe4-4a5d-947f-c6b44489208c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:20.222650 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-753a3ac3-ffe4-4a5d-947f-c6b44489208c None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:34:20.223929 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-753a3ac3-ffe4-4a5d-947f-c6b44489208c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:20.269640 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42c2d05-c90f-4bb4-9ecb-65f843c33081 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:20.274707 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b5d8ff-1c00-4e61-b28b-11716e4e5411 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce5b7c9a7e31401d8c04a24af809ed81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '816984c605114e4680f81fb019e5229f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:20.275854 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b5d8ff-1c00-4e61-b28b-11716e4e5411 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:20.276273 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b5d8ff-1c00-4e61-b28b-11716e4e5411 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:20.276554 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b5d8ff-1c00-4e61-b28b-11716e4e5411 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] PATH_INFO: `/v3/roles/c95110eb6beb4ed794fdbd9884cad174/implies/249a1b48454b46c18c7063167ea08160` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:20.278363 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b5d8ff-1c00-4e61-b28b-11716e4e5411 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=c95110eb6beb4ed794fdbd9884cad174, implied_role_id=249a1b48454b46c18c7063167ea08160)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:20.280001 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b5d8ff-1c00-4e61-b28b-11716e4e5411 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:20.292768 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3090/6211] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:34:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:34:20.297623 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753a3ac3-ffe4-4a5d-947f-c6b44489208c None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:20.307768 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753a3ac3-ffe4-4a5d-947f-c6b44489208c None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:20.312767 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3122/6212] 10.222.0.17 () {60 vars in 1362 bytes} [Sat Jul 23 21:34:20 2022] PUT /identity/v3/roles/c95110eb6beb4ed794fdbd9884cad174/implies/249a1b48454b46c18c7063167ea08160 => generated 519 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:34:20.313827 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b5d8ff-1c00-4e61-b28b-11716e4e5411 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:20.322155 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:20.376178 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:DELETE=1,keystone:SELECT=97,keystone:INSERT=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:20.382010 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b5d8ff-1c00-4e61-b28b-11716e4e5411 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:20.388060 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12899c1-25af-4f74-973d-5f5069d59cb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:20.388888 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12899c1-25af-4f74-973d-5f5069d59cb2 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:20.389180 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12899c1-25af-4f74-973d-5f5069d59cb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:20.389442 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f646ff6d-fd50-4b78-89ca-cda93f6fba51 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce5b7c9a7e31401d8c04a24af809ed81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '816984c605114e4680f81fb019e5229f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:20.389579 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12899c1-25af-4f74-973d-5f5069d59cb2 admin admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:20.390310 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12899c1-25af-4f74-973d-5f5069d59cb2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:34:20.390515 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f646ff6d-fd50-4b78-89ca-cda93f6fba51 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:20.390639 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12899c1-25af-4f74-973d-5f5069d59cb2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:20.391389 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f646ff6d-fd50-4b78-89ca-cda93f6fba51 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:20.391929 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f646ff6d-fd50-4b78-89ca-cda93f6fba51 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] PATH_INFO: `/v3/roles/249a1b48454b46c18c7063167ea08160/implies/2564d3143890441ba9b4a9ae8a4875d3` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:20.392347 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12899c1-25af-4f74-973d-5f5069d59cb2 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:20.394229 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f646ff6d-fd50-4b78-89ca-cda93f6fba51 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=249a1b48454b46c18c7063167ea08160, implied_role_id=2564d3143890441ba9b4a9ae8a4875d3)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:20.395867 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f646ff6d-fd50-4b78-89ca-cda93f6fba51 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:20.408747 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3091/6213] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:34:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:34:20.410474 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12899c1-25af-4f74-973d-5f5069d59cb2 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:20.420958 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12899c1-25af-4f74-973d-5f5069d59cb2 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:20.426338 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e696daa7-9006-4cff-8d42-b79db5ed4c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:20.427268 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e696daa7-9006-4cff-8d42-b79db5ed4c2c admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:20.427512 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e696daa7-9006-4cff-8d42-b79db5ed4c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:20.427833 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e696daa7-9006-4cff-8d42-b79db5ed4c2c admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:20.428527 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e696daa7-9006-4cff-8d42-b79db5ed4c2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:20.430696 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e696daa7-9006-4cff-8d42-b79db5ed4c2c admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:20.438096 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3123/6214] 10.222.0.17 () {60 vars in 1362 bytes} [Sat Jul 23 21:34:20 2022] PUT /identity/v3/roles/249a1b48454b46c18c7063167ea08160/implies/2564d3143890441ba9b4a9ae8a4875d3 => generated 520 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:34:20.439066 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f646ff6d-fd50-4b78-89ca-cda93f6fba51 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:20.468360 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3092/6215] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:34:20 2022] POST /identity/v3/projects => generated 385 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:34:20.471006 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e696daa7-9006-4cff-8d42-b79db5ed4c2c admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:20.556951 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f646ff6d-fd50-4b78-89ca-cda93f6fba51 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:20.565761 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e696daa7-9006-4cff-8d42-b79db5ed4c2c admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:20.571517 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf1826d-dee6-4b04-8aae-7d9bd1922bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:20.572432 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf1826d-dee6-4b04-8aae-7d9bd1922bd2 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:20.572882 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf1826d-dee6-4b04-8aae-7d9bd1922bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:20.573828 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf1826d-dee6-4b04-8aae-7d9bd1922bd2 admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:20.574747 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf1826d-dee6-4b04-8aae-7d9bd1922bd2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:20.576785 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf1826d-dee6-4b04-8aae-7d9bd1922bd2 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:20.611186 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3093/6216] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:34:20 2022] POST /identity/v3/users => generated 299 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:34:20.620066 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf1826d-dee6-4b04-8aae-7d9bd1922bd2 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:20.638533 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf1826d-dee6-4b04-8aae-7d9bd1922bd2 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:20.644820 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d6f70e-4a45-45c5-bd8d-0365141f7f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:20.646328 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d6f70e-4a45-45c5-bd8d-0365141f7f0e admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:20.646651 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d6f70e-4a45-45c5-bd8d-0365141f7f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:20.647136 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d6f70e-4a45-45c5-bd8d-0365141f7f0e admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:20.647876 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d6f70e-4a45-45c5-bd8d-0365141f7f0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:20.650465 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d6f70e-4a45-45c5-bd8d-0365141f7f0e admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:20.661292 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbb0a08-02ee-4c0a-8c1c-fbbae1bce799 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce5b7c9a7e31401d8c04a24af809ed81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '816984c605114e4680f81fb019e5229f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:20.662648 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbb0a08-02ee-4c0a-8c1c-fbbae1bce799 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:20.663013 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbb0a08-02ee-4c0a-8c1c-fbbae1bce799 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:20.663337 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbb0a08-02ee-4c0a-8c1c-fbbae1bce799 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] PATH_INFO: `/v3/roles/249a1b48454b46c18c7063167ea08160/implies` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:20.667337 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3094/6217] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:34:20 2022] GET /identity/v3/roles => generated 2321 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:34:20.668422 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbb0a08-02ee-4c0a-8c1c-fbbae1bce799 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorizing `identity:list_implied_roles(prior_role_id=249a1b48454b46c18c7063167ea08160)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:20.668808 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d6f70e-4a45-45c5-bd8d-0365141f7f0e admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:20.670832 ncdv-master-1 devstack@keystone.service[91548]: WARNING py.warnings [None req-3dbb0a08-02ee-4c0a-8c1c-fbbae1bce799 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_implied_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:34:20.670832 ncdv-master-1 devstack@keystone.service[91548]: warnings.warn(msg) Jul 23 21:34:20.670832 ncdv-master-1 devstack@keystone.service[91548]: Jul 23 21:34:20.671952 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbb0a08-02ee-4c0a-8c1c-fbbae1bce799 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:20.681130 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3124/6218] 10.222.0.17 () {58 vars in 1244 bytes} [Sat Jul 23 21:34:20 2022] GET /identity/v3/roles/249a1b48454b46c18c7063167ea08160/implies => generated 489 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:34:20.684869 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbb0a08-02ee-4c0a-8c1c-fbbae1bce799 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:20.687343 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d6f70e-4a45-45c5-bd8d-0365141f7f0e admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:20.694076 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2361ff3-fea0-4da2-9f7a-76963f964f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:20.695364 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2361ff3-fea0-4da2-9f7a-76963f964f62 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:20.695651 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2361ff3-fea0-4da2-9f7a-76963f964f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:20.695930 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2361ff3-fea0-4da2-9f7a-76963f964f62 admin admin] PATH_INFO: `/v3/projects/7efdb9d4d7a445848e991290ea11ca84/users/873073bc0c964e3fbbdc105cab73b276/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:20.699605 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbb0a08-02ee-4c0a-8c1c-fbbae1bce799 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:20.706297 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d45187f-43cf-41e1-85cb-189de96b830c tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce5b7c9a7e31401d8c04a24af809ed81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '816984c605114e4680f81fb019e5229f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:20.707395 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d45187f-43cf-41e1-85cb-189de96b830c tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:20.707746 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d45187f-43cf-41e1-85cb-189de96b830c tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:20.708206 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d45187f-43cf-41e1-85cb-189de96b830c tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] PATH_INFO: `/v3/roles/c95110eb6beb4ed794fdbd9884cad174/implies` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:20.710111 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d45187f-43cf-41e1-85cb-189de96b830c tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorizing `identity:list_implied_roles(prior_role_id=c95110eb6beb4ed794fdbd9884cad174)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:20.712136 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d45187f-43cf-41e1-85cb-189de96b830c tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:20.716135 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2361ff3-fea0-4da2-9f7a-76963f964f62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7efdb9d4d7a445848e991290ea11ca84, user_id=873073bc0c964e3fbbdc105cab73b276, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:20.719816 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2361ff3-fea0-4da2-9f7a-76963f964f62 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:20.721087 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3125/6219] 10.222.0.17 () {58 vars in 1244 bytes} [Sat Jul 23 21:34:20 2022] GET /identity/v3/roles/c95110eb6beb4ed794fdbd9884cad174/implies => generated 658 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:34:20.727125 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d45187f-43cf-41e1-85cb-189de96b830c tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:20.739038 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d45187f-43cf-41e1-85cb-189de96b830c tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:20.742626 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3095/6220] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:34:20 2022] PUT /identity/v3/projects/7efdb9d4d7a445848e991290ea11ca84/users/873073bc0c964e3fbbdc105cab73b276/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:20.746867 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2361ff3-fea0-4da2-9f7a-76963f964f62 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:20.839999 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:20.854374 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b156f9e8-45a5-4e8d-9035-63fd740062aa tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce5b7c9a7e31401d8c04a24af809ed81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '816984c605114e4680f81fb019e5229f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:20.855349 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b156f9e8-45a5-4e8d-9035-63fd740062aa tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:20.855629 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b156f9e8-45a5-4e8d-9035-63fd740062aa tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:20.855908 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b156f9e8-45a5-4e8d-9035-63fd740062aa tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] PATH_INFO: `/v3/roles/249a1b48454b46c18c7063167ea08160/implies/2564d3143890441ba9b4a9ae8a4875d3` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:20.857732 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b156f9e8-45a5-4e8d-9035-63fd740062aa tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=249a1b48454b46c18c7063167ea08160, implied_role_id=2564d3143890441ba9b4a9ae8a4875d3)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:20.860050 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b156f9e8-45a5-4e8d-9035-63fd740062aa tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:20.869779 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2361ff3-fea0-4da2-9f7a-76963f964f62 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:20.870936 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3126/6221] 10.222.0.17 () {58 vars in 1346 bytes} [Sat Jul 23 21:34:20 2022] DELETE /identity/v3/roles/249a1b48454b46c18c7063167ea08160/implies/2564d3143890441ba9b4a9ae8a4875d3 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:20.874846 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b156f9e8-45a5-4e8d-9035-63fd740062aa tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:20.885203 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:20.942426 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ac10c4-b8a0-49bd-8084-87d45d2b5406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:20.943221 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ac10c4-b8a0-49bd-8084-87d45d2b5406 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:20.943572 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ac10c4-b8a0-49bd-8084-87d45d2b5406 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:20.943846 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ac10c4-b8a0-49bd-8084-87d45d2b5406 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:20.944912 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ac10c4-b8a0-49bd-8084-87d45d2b5406 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:20.946556 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ac10c4-b8a0-49bd-8084-87d45d2b5406 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:20.946966 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b156f9e8-45a5-4e8d-9035-63fd740062aa tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:20.952257 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ac2314-56e6-45eb-99b4-079e6946d958 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce5b7c9a7e31401d8c04a24af809ed81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '816984c605114e4680f81fb019e5229f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:20.953787 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ac2314-56e6-45eb-99b4-079e6946d958 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:20.954284 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ac2314-56e6-45eb-99b4-079e6946d958 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:20.954873 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ac2314-56e6-45eb-99b4-079e6946d958 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] PATH_INFO: `/v3/roles/c95110eb6beb4ed794fdbd9884cad174/implies/249a1b48454b46c18c7063167ea08160` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:20.957522 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ac2314-56e6-45eb-99b4-079e6946d958 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=c95110eb6beb4ed794fdbd9884cad174, implied_role_id=249a1b48454b46c18c7063167ea08160)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:20.958601 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3096/6222] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:34:20 2022] GET /identity/v3/roles => generated 2321 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 21:34:20.959599 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ac2314-56e6-45eb-99b4-079e6946d958 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:20.963059 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ac10c4-b8a0-49bd-8084-87d45d2b5406 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:20.975216 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ac10c4-b8a0-49bd-8084-87d45d2b5406 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:20.979854 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3127/6223] 10.222.0.17 () {58 vars in 1346 bytes} [Sat Jul 23 21:34:20 2022] DELETE /identity/v3/roles/c95110eb6beb4ed794fdbd9884cad174/implies/249a1b48454b46c18c7063167ea08160 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:34:20.981056 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ac2314-56e6-45eb-99b4-079e6946d958 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:21.053931 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b7e0bb-d3ac-4578-b074-cbdea87b5186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:21.055280 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b7e0bb-d3ac-4578-b074-cbdea87b5186 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:21.055564 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b7e0bb-d3ac-4578-b074-cbdea87b5186 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:21.055840 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b7e0bb-d3ac-4578-b074-cbdea87b5186 admin admin] PATH_INFO: `/v3/projects/7efdb9d4d7a445848e991290ea11ca84/users/873073bc0c964e3fbbdc105cab73b276/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:21.058015 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ac2314-56e6-45eb-99b4-079e6946d958 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:21.058167 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b7e0bb-d3ac-4578-b074-cbdea87b5186 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7efdb9d4d7a445848e991290ea11ca84, user_id=873073bc0c964e3fbbdc105cab73b276, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:21.060901 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b7e0bb-d3ac-4578-b074-cbdea87b5186 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:21.064086 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4327ff34-8316-4ed9-af63-05462fec0e7c tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce5b7c9a7e31401d8c04a24af809ed81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '816984c605114e4680f81fb019e5229f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:21.066123 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4327ff34-8316-4ed9-af63-05462fec0e7c tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:21.066473 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4327ff34-8316-4ed9-af63-05462fec0e7c tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:21.066946 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4327ff34-8316-4ed9-af63-05462fec0e7c tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] PATH_INFO: `/v3/roles/c95110eb6beb4ed794fdbd9884cad174/implies/ba52c8c461774400a925c36f55ed56fb` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:21.069111 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4327ff34-8316-4ed9-af63-05462fec0e7c tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=c95110eb6beb4ed794fdbd9884cad174, implied_role_id=ba52c8c461774400a925c36f55ed56fb)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:21.070869 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4327ff34-8316-4ed9-af63-05462fec0e7c tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:21.079586 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3097/6224] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:34:20 2022] PUT /identity/v3/projects/7efdb9d4d7a445848e991290ea11ca84/users/873073bc0c964e3fbbdc105cab73b276/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:34:21.091911 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3128/6225] 10.222.0.17 () {58 vars in 1346 bytes} [Sat Jul 23 21:34:20 2022] DELETE /identity/v3/roles/c95110eb6beb4ed794fdbd9884cad174/implies/ba52c8c461774400a925c36f55ed56fb => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:21.096145 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4327ff34-8316-4ed9-af63-05462fec0e7c tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:21.096946 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0c2e73-39d0-4903-87f0-3beb71d2bb98 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:21.099002 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0c2e73-39d0-4903-87f0-3beb71d2bb98 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:21.099410 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0c2e73-39d0-4903-87f0-3beb71d2bb98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:21.136248 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-0d0c2e73-39d0-4903-87f0-3beb71d2bb98 None None] MFA Rules not processed for user `873073bc0c964e3fbbdc105cab73b276`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:34:21.137935 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-0d0c2e73-39d0-4903-87f0-3beb71d2bb98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:21.174107 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4327ff34-8316-4ed9-af63-05462fec0e7c tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:21.180860 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94472137-a843-4ce8-a397-10656a9dc97c tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce5b7c9a7e31401d8c04a24af809ed81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '816984c605114e4680f81fb019e5229f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:21.181742 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94472137-a843-4ce8-a397-10656a9dc97c tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:21.182059 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94472137-a843-4ce8-a397-10656a9dc97c tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:21.182334 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94472137-a843-4ce8-a397-10656a9dc97c tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] PATH_INFO: `/v3/domains/3f676e65b6ae45f9a9725bfc6965dfa5` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:21.191088 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94472137-a843-4ce8-a397-10656a9dc97c tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 21:34:21.201895 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-94472137-a843-4ce8-a397-10656a9dc97c tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Could not find domain: 3f676e65b6ae45f9a9725bfc6965dfa5.: keystone.exception.DomainNotFound: Could not find domain: 3f676e65b6ae45f9a9725bfc6965dfa5. Jul 23 21:34:21.201895 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 21:34:21.201895 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 23 21:34:21.201895 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 23 21:34:21.201895 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 23 21:34:21.201895 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 23 21:34:21.201895 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 23 21:34:21.201895 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 23 21:34:21.201895 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 3f676e65b6ae45f9a9725bfc6965dfa5. Jul 23 21:34:21.201895 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 21:34:21.201895 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 23 21:34:21.201895 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 21:34:21.201895 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 21:34:21.201895 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 21:34:21.201895 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 21:34:21.201895 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 21:34:21.203671 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 21:34:21.203671 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 21:34:21.203671 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 21:34:21.203671 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 21:34:21.203671 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 21:34:21.203671 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 21:34:21.203671 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 21:34:21.203671 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jul 23 21:34:21.203671 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jul 23 21:34:21.203671 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 21:34:21.203671 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 21:34:21.203671 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 21:34:21.203671 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 21:34:21.203671 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 21:34:21.203671 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 21:34:21.203671 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 21:34:21.204694 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 21:34:21.204694 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 21:34:21.204694 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 21:34:21.204694 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 21:34:21.204694 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application with Lock( Jul 23 21:34:21.204694 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 21:34:21.204694 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._enter() Jul 23 21:34:21.204694 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 21:34:21.204694 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 21:34:21.204694 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 21:34:21.204694 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.creator() Jul 23 21:34:21.204694 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 21:34:21.204694 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application created_value = creator( Jul 23 21:34:21.204694 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 23 21:34:21.204694 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 23 21:34:21.204694 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 3f676e65b6ae45f9a9725bfc6965dfa5. Jul 23 21:34:21.204694 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 21:34:21.207157 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3129/6226] 10.222.0.17 () {60 vars in 1248 bytes} [Sat Jul 23 21:34:21 2022] PATCH /identity/v3/domains/3f676e65b6ae45f9a9725bfc6965dfa5 => generated 112 bytes in 112 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Jul 23 21:34:21.208135 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94472137-a843-4ce8-a397-10656a9dc97c tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:21.220796 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94472137-a843-4ce8-a397-10656a9dc97c tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:21.226109 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3d29ab-c7bf-4f3f-9075-d15cfbc34cdb tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce5b7c9a7e31401d8c04a24af809ed81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '816984c605114e4680f81fb019e5229f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:21.227076 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3d29ab-c7bf-4f3f-9075-d15cfbc34cdb tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:21.227429 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3d29ab-c7bf-4f3f-9075-d15cfbc34cdb tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:21.227772 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3d29ab-c7bf-4f3f-9075-d15cfbc34cdb tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] PATH_INFO: `/v3/users/c65996abac84448da544ada89ddeef1f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:21.229081 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3d29ab-c7bf-4f3f-9075-d15cfbc34cdb tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorizing `identity:delete_user(user_id=c65996abac84448da544ada89ddeef1f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:21.231105 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3d29ab-c7bf-4f3f-9075-d15cfbc34cdb tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:21.233906 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3098/6227] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:34:21 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:34:21.238625 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0c2e73-39d0-4903-87f0-3beb71d2bb98 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:21.244834 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:21.273394 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:21.284470 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-3d3d29ab-c7bf-4f3f-9075-d15cfbc34cdb tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c65996abac84448da544ada89ddeef1f'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:21.286533 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-3d3d29ab-c7bf-4f3f-9075-d15cfbc34cdb tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c65996abac84448da544ada89ddeef1f'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:21.295403 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-3d3d29ab-c7bf-4f3f-9075-d15cfbc34cdb tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c65996abac84448da544ada89ddeef1f'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:21.306635 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-3d3d29ab-c7bf-4f3f-9075-d15cfbc34cdb tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c65996abac84448da544ada89ddeef1f'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:21.317280 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0c2e73-39d0-4903-87f0-3beb71d2bb98 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:21.319975 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-3d3d29ab-c7bf-4f3f-9075-d15cfbc34cdb tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c65996abac84448da544ada89ddeef1f'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:21.322346 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f96f85-ef23-4678-90bb-128e0e93db25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:21.323120 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f96f85-ef23-4678-90bb-128e0e93db25 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:21.323732 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f96f85-ef23-4678-90bb-128e0e93db25 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:21.324113 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f96f85-ef23-4678-90bb-128e0e93db25 admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:21.324918 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f96f85-ef23-4678-90bb-128e0e93db25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:21.327151 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3130/6228] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:34:21 2022] DELETE /identity/v3/users/c65996abac84448da544ada89ddeef1f => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:21.327285 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f96f85-ef23-4678-90bb-128e0e93db25 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:21.330849 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3d29ab-c7bf-4f3f-9075-d15cfbc34cdb tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:21.332306 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-3d3d29ab-c7bf-4f3f-9075-d15cfbc34cdb tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:21.357809 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3099/6229] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:34:21 2022] POST /identity/v3/projects => generated 387 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:34:21.362000 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f96f85-ef23-4678-90bb-128e0e93db25 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:21.363735 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-a5f96f85-ef23-4678-90bb-128e0e93db25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:21.400062 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3d29ab-c7bf-4f3f-9075-d15cfbc34cdb tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:21.440607 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f96f85-ef23-4678-90bb-128e0e93db25 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:21.446343 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ca93fd-0e8a-45df-a9d4-07ba91466a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:21.447396 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ca93fd-0e8a-45df-a9d4-07ba91466a66 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:21.447563 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ca93fd-0e8a-45df-a9d4-07ba91466a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:21.447863 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ca93fd-0e8a-45df-a9d4-07ba91466a66 admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:21.448553 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ca93fd-0e8a-45df-a9d4-07ba91466a66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:21.450526 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ca93fd-0e8a-45df-a9d4-07ba91466a66 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:21.465807 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325b3cbc-8182-4a21-b369-b4248ac134a6 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce5b7c9a7e31401d8c04a24af809ed81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '816984c605114e4680f81fb019e5229f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:21.466816 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325b3cbc-8182-4a21-b369-b4248ac134a6 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:21.467345 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325b3cbc-8182-4a21-b369-b4248ac134a6 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:21.467851 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325b3cbc-8182-4a21-b369-b4248ac134a6 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] PATH_INFO: `/v3/roles/2564d3143890441ba9b4a9ae8a4875d3` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:21.469408 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325b3cbc-8182-4a21-b369-b4248ac134a6 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorizing `identity:delete_role(role_id=2564d3143890441ba9b4a9ae8a4875d3)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:21.471132 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325b3cbc-8182-4a21-b369-b4248ac134a6 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:21.477283 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3100/6230] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:34:21 2022] POST /identity/v3/users => generated 294 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:34:21.478219 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ca93fd-0e8a-45df-a9d4-07ba91466a66 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:21.492444 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ca93fd-0e8a-45df-a9d4-07ba91466a66 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:21.499515 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455e1377-bc86-4c7e-ba3b-0e5b01d2f406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:21.500334 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455e1377-bc86-4c7e-ba3b-0e5b01d2f406 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:21.500677 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455e1377-bc86-4c7e-ba3b-0e5b01d2f406 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:21.501046 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455e1377-bc86-4c7e-ba3b-0e5b01d2f406 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:21.501889 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455e1377-bc86-4c7e-ba3b-0e5b01d2f406 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:21.503786 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455e1377-bc86-4c7e-ba3b-0e5b01d2f406 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:21.517503 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3101/6231] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:34:21 2022] GET /identity/v3/roles => generated 2321 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:34:21.521785 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455e1377-bc86-4c7e-ba3b-0e5b01d2f406 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:21.527867 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-325b3cbc-8182-4a21-b369-b4248ac134a6 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Invalidating the token cache because role 2564d3143890441ba9b4a9ae8a4875d3 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:34:21.528158 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-325b3cbc-8182-4a21-b369-b4248ac134a6 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:21.529522 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-325b3cbc-8182-4a21-b369-b4248ac134a6 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:21.534662 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3131/6232] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:34:21 2022] DELETE /identity/v3/roles/2564d3143890441ba9b4a9ae8a4875d3 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:34:21.535715 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325b3cbc-8182-4a21-b369-b4248ac134a6 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:21.536058 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455e1377-bc86-4c7e-ba3b-0e5b01d2f406 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:21.537160 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-325b3cbc-8182-4a21-b369-b4248ac134a6 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:21.571245 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:21.618005 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325b3cbc-8182-4a21-b369-b4248ac134a6 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:21.624341 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4f339f-1689-487f-83fc-791a331f7a59 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce5b7c9a7e31401d8c04a24af809ed81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '816984c605114e4680f81fb019e5229f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:21.625389 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4f339f-1689-487f-83fc-791a331f7a59 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:21.625678 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4f339f-1689-487f-83fc-791a331f7a59 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:21.625978 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4f339f-1689-487f-83fc-791a331f7a59 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] PATH_INFO: `/v3/groups/fe4b6277c85b487cbf3b663b0c6a5101` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:21.627265 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4f339f-1689-487f-83fc-791a331f7a59 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorizing `identity:delete_group(group_id=fe4b6277c85b487cbf3b663b0c6a5101)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:21.628876 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e27ddd-3745-4a8d-8b93-ed59513518ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:21.629205 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4f339f-1689-487f-83fc-791a331f7a59 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:21.629835 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e27ddd-3745-4a8d-8b93-ed59513518ac admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:21.630214 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e27ddd-3745-4a8d-8b93-ed59513518ac admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:21.630559 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e27ddd-3745-4a8d-8b93-ed59513518ac admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:21.631367 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e27ddd-3745-4a8d-8b93-ed59513518ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:21.633994 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e27ddd-3745-4a8d-8b93-ed59513518ac admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:21.649942 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3102/6233] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:34:21 2022] GET /identity/v3/roles => generated 2095 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 21:34:21.652660 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e27ddd-3745-4a8d-8b93-ed59513518ac admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:21.654489 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-64e27ddd-3745-4a8d-8b93-ed59513518ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:21.670743 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:21.679741 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e27ddd-3745-4a8d-8b93-ed59513518ac admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:21.687941 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c9e778-17e4-4523-b0b3-5de25549704d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:21.689069 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c9e778-17e4-4523-b0b3-5de25549704d admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:21.689561 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c9e778-17e4-4523-b0b3-5de25549704d admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:21.690125 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c9e778-17e4-4523-b0b3-5de25549704d admin admin] PATH_INFO: `/v3/projects/f0ccdb01d5724c9b9b8c6590e385e12c/users/ba8a239f18c94d488a12cd3c0e0fd78d/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:21.709634 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c9e778-17e4-4523-b0b3-5de25549704d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0ccdb01d5724c9b9b8c6590e385e12c, user_id=ba8a239f18c94d488a12cd3c0e0fd78d, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:21.714344 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c9e778-17e4-4523-b0b3-5de25549704d admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:21.720084 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3132/6234] 10.222.0.17 () {58 vars in 1226 bytes} [Sat Jul 23 21:34:21 2022] DELETE /identity/v3/groups/fe4b6277c85b487cbf3b663b0c6a5101 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:21.726332 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4f339f-1689-487f-83fc-791a331f7a59 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:21.746815 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3103/6235] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:34:21 2022] PUT /identity/v3/projects/f0ccdb01d5724c9b9b8c6590e385e12c/users/ba8a239f18c94d488a12cd3c0e0fd78d/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:21.757421 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69627cfa-8c86-41a4-887f-d612f9286a6c None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:21.757717 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69627cfa-8c86-41a4-887f-d612f9286a6c None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:21.758017 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69627cfa-8c86-41a4-887f-d612f9286a6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:21.807887 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-69627cfa-8c86-41a4-887f-d612f9286a6c None None] MFA Rules not processed for user `ba8a239f18c94d488a12cd3c0e0fd78d`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:34:21.810238 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-69627cfa-8c86-41a4-887f-d612f9286a6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:21.832767 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4f339f-1689-487f-83fc-791a331f7a59 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:21.904295 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3104/6236] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:34:21 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:34:21.910043 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69627cfa-8c86-41a4-887f-d612f9286a6c None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:21.912067 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-69627cfa-8c86-41a4-887f-d612f9286a6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:21.959110 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf540ce5-9030-45e0-a071-d10f593edafe tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce5b7c9a7e31401d8c04a24af809ed81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '816984c605114e4680f81fb019e5229f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:21.960421 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf540ce5-9030-45e0-a071-d10f593edafe tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:21.960814 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf540ce5-9030-45e0-a071-d10f593edafe tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:21.961199 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf540ce5-9030-45e0-a071-d10f593edafe tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] PATH_INFO: `/v3/projects/359def4ccd9e4902b9bb28c95fc66cbc` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:21.963647 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf540ce5-9030-45e0-a071-d10f593edafe tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorizing `identity:delete_project(project_id=359def4ccd9e4902b9bb28c95fc66cbc)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:21.966321 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf540ce5-9030-45e0-a071-d10f593edafe tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:22.010973 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69627cfa-8c86-41a4-887f-d612f9286a6c None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:22.021692 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:22.024981 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652aaf1e-42ad-4ed1-a88c-28729e85d667 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7f2db148c8e4d5d81431cae3576434b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:22.025774 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652aaf1e-42ad-4ed1-a88c-28729e85d667 service glance] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:22.026146 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652aaf1e-42ad-4ed1-a88c-28729e85d667 service glance] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:22.026280 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652aaf1e-42ad-4ed1-a88c-28729e85d667 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:22.028221 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-652aaf1e-42ad-4ed1-a88c-28729e85d667 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:22.045006 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-cf540ce5-9030-45e0-a071-d10f593edafe tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '359def4ccd9e4902b9bb28c95fc66cbc', 'request_id': 'req-cf540ce5-9030-45e0-a071-d10f593edafe'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:22.062093 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-cf540ce5-9030-45e0-a071-d10f593edafe tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '359def4ccd9e4902b9bb28c95fc66cbc', 'request_id': 'req-cf540ce5-9030-45e0-a071-d10f593edafe'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:22.078460 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-cf540ce5-9030-45e0-a071-d10f593edafe tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '359def4ccd9e4902b9bb28c95fc66cbc', 'request_id': 'req-cf540ce5-9030-45e0-a071-d10f593edafe'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:22.104334 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-cf540ce5-9030-45e0-a071-d10f593edafe tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] The token cache is being invalidate because project 359def4ccd9e4902b9bb28c95fc66cbc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:34:22.106119 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-cf540ce5-9030-45e0-a071-d10f593edafe tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:22.108108 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-cf540ce5-9030-45e0-a071-d10f593edafe tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:22.112191 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3133/6237] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:34:21 2022] DELETE /identity/v3/projects/359def4ccd9e4902b9bb28c95fc66cbc => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:22.119040 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf540ce5-9030-45e0-a071-d10f593edafe tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:22.126317 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-cf540ce5-9030-45e0-a071-d10f593edafe tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:22.160821 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652aaf1e-42ad-4ed1-a88c-28729e85d667 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:22.162594 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652aaf1e-42ad-4ed1-a88c-28729e85d667 service glance] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:22.204749 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3105/6238] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:34:21 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:34:22.234268 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf540ce5-9030-45e0-a071-d10f593edafe tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:22.240741 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68728b7a-9a58-4e7c-8347-c6529e90dffb tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce5b7c9a7e31401d8c04a24af809ed81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '816984c605114e4680f81fb019e5229f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:22.241813 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68728b7a-9a58-4e7c-8347-c6529e90dffb tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:22.242191 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68728b7a-9a58-4e7c-8347-c6529e90dffb tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:22.242534 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68728b7a-9a58-4e7c-8347-c6529e90dffb tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] PATH_INFO: `/v3/domains/dc17eda5ad6a4b88955633ee14bd6b57` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:22.244164 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68728b7a-9a58-4e7c-8347-c6529e90dffb tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=dc17eda5ad6a4b88955633ee14bd6b57)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:22.245914 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68728b7a-9a58-4e7c-8347-c6529e90dffb tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:22.276364 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-68728b7a-9a58-4e7c-8347-c6529e90dffb tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'dc17eda5ad6a4b88955633ee14bd6b57'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:22.277961 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-68728b7a-9a58-4e7c-8347-c6529e90dffb tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'dc17eda5ad6a4b88955633ee14bd6b57'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:22.320697 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-68728b7a-9a58-4e7c-8347-c6529e90dffb tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'dc17eda5ad6a4b88955633ee14bd6b57'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:22.321589 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-68728b7a-9a58-4e7c-8347-c6529e90dffb tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'dc17eda5ad6a4b88955633ee14bd6b57'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:22.326269 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3134/6239] 10.222.0.17 () {60 vars in 1248 bytes} [Sat Jul 23 21:34:22 2022] PATCH /identity/v3/domains/dc17eda5ad6a4b88955633ee14bd6b57 => generated 278 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:34:22.329159 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652aaf1e-42ad-4ed1-a88c-28729e85d667 service glance] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:22.341846 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652aaf1e-42ad-4ed1-a88c-28729e85d667 service glance] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:22.375316 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:22.501019 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd532f20-d493-4cf3-8a61-c17ca3aae467 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce5b7c9a7e31401d8c04a24af809ed81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '816984c605114e4680f81fb019e5229f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:22.505981 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd532f20-d493-4cf3-8a61-c17ca3aae467 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:22.506509 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd532f20-d493-4cf3-8a61-c17ca3aae467 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:22.506879 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd532f20-d493-4cf3-8a61-c17ca3aae467 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] PATH_INFO: `/v3/domains/dc17eda5ad6a4b88955633ee14bd6b57` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:22.559597 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd532f20-d493-4cf3-8a61-c17ca3aae467 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=dc17eda5ad6a4b88955633ee14bd6b57)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:22.563268 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd532f20-d493-4cf3-8a61-c17ca3aae467 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:22.616069 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-dd532f20-d493-4cf3-8a61-c17ca3aae467 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'dc17eda5ad6a4b88955633ee14bd6b57'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:22.629654 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-dd532f20-d493-4cf3-8a61-c17ca3aae467 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'dc17eda5ad6a4b88955633ee14bd6b57'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:22.759541 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-dd532f20-d493-4cf3-8a61-c17ca3aae467 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc17eda5ad6a4b88955633ee14bd6b57', 'request_id': 'req-dd532f20-d493-4cf3-8a61-c17ca3aae467'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:22.779267 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-dd532f20-d493-4cf3-8a61-c17ca3aae467 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc17eda5ad6a4b88955633ee14bd6b57', 'request_id': 'req-dd532f20-d493-4cf3-8a61-c17ca3aae467'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:22.792343 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-dd532f20-d493-4cf3-8a61-c17ca3aae467 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc17eda5ad6a4b88955633ee14bd6b57', 'request_id': 'req-dd532f20-d493-4cf3-8a61-c17ca3aae467'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:22.834805 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-dd532f20-d493-4cf3-8a61-c17ca3aae467 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] The token cache is being invalidate because project dc17eda5ad6a4b88955633ee14bd6b57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:34:22.835124 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-dd532f20-d493-4cf3-8a61-c17ca3aae467 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:22.835869 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-dd532f20-d493-4cf3-8a61-c17ca3aae467 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:22.846402 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-dd532f20-d493-4cf3-8a61-c17ca3aae467 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'dc17eda5ad6a4b88955633ee14bd6b57', 'request_id': 'req-dd532f20-d493-4cf3-8a61-c17ca3aae467'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:22.847107 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-dd532f20-d493-4cf3-8a61-c17ca3aae467 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'dc17eda5ad6a4b88955633ee14bd6b57', 'request_id': 'req-dd532f20-d493-4cf3-8a61-c17ca3aae467'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:22.852024 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-dd532f20-d493-4cf3-8a61-c17ca3aae467 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'dc17eda5ad6a4b88955633ee14bd6b57', 'request_id': 'req-dd532f20-d493-4cf3-8a61-c17ca3aae467'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:22.872860 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3106/6240] 10.222.0.17 () {58 vars in 1229 bytes} [Sat Jul 23 21:34:22 2022] DELETE /identity/v3/domains/dc17eda5ad6a4b88955633ee14bd6b57 => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:34:22.874343 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68728b7a-9a58-4e7c-8347-c6529e90dffb tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:22.876995 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-68728b7a-9a58-4e7c-8347-c6529e90dffb tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:22.917311 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68728b7a-9a58-4e7c-8347-c6529e90dffb tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:23.023120 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd532f20-d493-4cf3-8a61-c17ca3aae467 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:23.024624 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-dd532f20-d493-4cf3-8a61-c17ca3aae467 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:23.039443 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf46d04-ed07-42ab-aefb-b55cd4e6b99d tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce5b7c9a7e31401d8c04a24af809ed81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '816984c605114e4680f81fb019e5229f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:23.040341 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf46d04-ed07-42ab-aefb-b55cd4e6b99d tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:23.040620 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf46d04-ed07-42ab-aefb-b55cd4e6b99d tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:23.041034 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf46d04-ed07-42ab-aefb-b55cd4e6b99d tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] PATH_INFO: `/v3/roles/249a1b48454b46c18c7063167ea08160` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:23.043316 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf46d04-ed07-42ab-aefb-b55cd4e6b99d tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorizing `identity:delete_role(role_id=249a1b48454b46c18c7063167ea08160)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:23.045895 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf46d04-ed07-42ab-aefb-b55cd4e6b99d tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:23.083594 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:23.107678 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-5cf46d04-ed07-42ab-aefb-b55cd4e6b99d tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Invalidating the token cache because role 249a1b48454b46c18c7063167ea08160 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:34:23.108157 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-5cf46d04-ed07-42ab-aefb-b55cd4e6b99d tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:23.110492 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:23.111469 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-5cf46d04-ed07-42ab-aefb-b55cd4e6b99d tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:23.115479 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3135/6241] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:34:22 2022] DELETE /identity/v3/roles/249a1b48454b46c18c7063167ea08160 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:23.119343 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf46d04-ed07-42ab-aefb-b55cd4e6b99d tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:23.123366 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-5cf46d04-ed07-42ab-aefb-b55cd4e6b99d tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:23.147305 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd532f20-d493-4cf3-8a61-c17ca3aae467 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:23.238558 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf46d04-ed07-42ab-aefb-b55cd4e6b99d tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:23.243713 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b312a3dd-1c5b-4d16-8d93-bbd6ec25132b tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce5b7c9a7e31401d8c04a24af809ed81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '816984c605114e4680f81fb019e5229f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:23.244568 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b312a3dd-1c5b-4d16-8d93-bbd6ec25132b tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:23.244681 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646f3634-0b43-4713-ba9e-6c6791959b3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:23.244850 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b312a3dd-1c5b-4d16-8d93-bbd6ec25132b tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:23.245124 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b312a3dd-1c5b-4d16-8d93-bbd6ec25132b tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] PATH_INFO: `/v3/roles/ba52c8c461774400a925c36f55ed56fb` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:23.245885 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646f3634-0b43-4713-ba9e-6c6791959b3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:23.246642 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b312a3dd-1c5b-4d16-8d93-bbd6ec25132b tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorizing `identity:delete_role(role_id=ba52c8c461774400a925c36f55ed56fb)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:23.247160 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646f3634-0b43-4713-ba9e-6c6791959b3d admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:23.247535 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646f3634-0b43-4713-ba9e-6c6791959b3d admin admin] PATH_INFO: `/v3/users/873073bc0c964e3fbbdc105cab73b276` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:23.248252 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b312a3dd-1c5b-4d16-8d93-bbd6ec25132b tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:23.249933 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646f3634-0b43-4713-ba9e-6c6791959b3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=873073bc0c964e3fbbdc105cab73b276)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:23.254684 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646f3634-0b43-4713-ba9e-6c6791959b3d admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:23.298398 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-b312a3dd-1c5b-4d16-8d93-bbd6ec25132b tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Invalidating the token cache because role ba52c8c461774400a925c36f55ed56fb has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:34:23.298774 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-b312a3dd-1c5b-4d16-8d93-bbd6ec25132b tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:23.299520 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-b312a3dd-1c5b-4d16-8d93-bbd6ec25132b tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:23.304088 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3136/6242] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:34:23 2022] DELETE /identity/v3/roles/ba52c8c461774400a925c36f55ed56fb => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:23.308274 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b312a3dd-1c5b-4d16-8d93-bbd6ec25132b tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:23.310048 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-b312a3dd-1c5b-4d16-8d93-bbd6ec25132b tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:23.336466 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-646f3634-0b43-4713-ba9e-6c6791959b3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '873073bc0c964e3fbbdc105cab73b276'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:23.352937 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-646f3634-0b43-4713-ba9e-6c6791959b3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '873073bc0c964e3fbbdc105cab73b276'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:23.354034 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-646f3634-0b43-4713-ba9e-6c6791959b3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '873073bc0c964e3fbbdc105cab73b276'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:23.368156 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-646f3634-0b43-4713-ba9e-6c6791959b3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '873073bc0c964e3fbbdc105cab73b276'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:23.395525 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-646f3634-0b43-4713-ba9e-6c6791959b3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '873073bc0c964e3fbbdc105cab73b276'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:23.409621 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3107/6243] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:34:23 2022] DELETE /identity/v3/users/873073bc0c964e3fbbdc105cab73b276 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:23.412285 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646f3634-0b43-4713-ba9e-6c6791959b3d admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:23.413699 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-646f3634-0b43-4713-ba9e-6c6791959b3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:23.420688 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b312a3dd-1c5b-4d16-8d93-bbd6ec25132b tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:23.490082 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538a1fd5-910c-45df-9e1c-fa45aea93fa4 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce5b7c9a7e31401d8c04a24af809ed81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '816984c605114e4680f81fb019e5229f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:23.491517 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538a1fd5-910c-45df-9e1c-fa45aea93fa4 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:23.491802 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538a1fd5-910c-45df-9e1c-fa45aea93fa4 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:23.492126 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538a1fd5-910c-45df-9e1c-fa45aea93fa4 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] PATH_INFO: `/v3/roles/c95110eb6beb4ed794fdbd9884cad174` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:23.494280 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538a1fd5-910c-45df-9e1c-fa45aea93fa4 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorizing `identity:delete_role(role_id=c95110eb6beb4ed794fdbd9884cad174)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:23.496213 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538a1fd5-910c-45df-9e1c-fa45aea93fa4 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:23.506070 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:23.552845 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-538a1fd5-910c-45df-9e1c-fa45aea93fa4 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Invalidating the token cache because role c95110eb6beb4ed794fdbd9884cad174 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:34:23.553137 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-538a1fd5-910c-45df-9e1c-fa45aea93fa4 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:23.553939 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-538a1fd5-910c-45df-9e1c-fa45aea93fa4 tempest-RolesV3TestJSON-2098747728 tempest-RolesV3TestJSON-2098747728-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:23.561580 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3137/6244] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:34:23 2022] DELETE /identity/v3/roles/c95110eb6beb4ed794fdbd9884cad174 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:23.561580 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6418f0-4617-4562-80eb-78b48affcb57 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:23.561580 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6418f0-4617-4562-80eb-78b48affcb57 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:23.561580 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6418f0-4617-4562-80eb-78b48affcb57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:23.577493 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:23.584004 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646f3634-0b43-4713-ba9e-6c6791959b3d admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:23.596796 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-ee6418f0-4617-4562-80eb-78b48affcb57 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:34:23.603692 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-ee6418f0-4617-4562-80eb-78b48affcb57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:23.719049 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3138/6245] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:34:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:34:23.719974 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6418f0-4617-4562-80eb-78b48affcb57 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:23.721474 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-ee6418f0-4617-4562-80eb-78b48affcb57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:23.751993 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee27e7f-39af-4fba-8296-9dd93738055c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:23.756974 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee27e7f-39af-4fba-8296-9dd93738055c service nova] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:23.757291 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee27e7f-39af-4fba-8296-9dd93738055c service nova] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:23.760040 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee27e7f-39af-4fba-8296-9dd93738055c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:23.762015 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6418f0-4617-4562-80eb-78b48affcb57 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:23.767608 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-aee27e7f-39af-4fba-8296-9dd93738055c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:23.768019 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0c54df-ef8c-4af2-a8d4-7700fb130676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:23.768942 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0c54df-ef8c-4af2-a8d4-7700fb130676 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:23.769217 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0c54df-ef8c-4af2-a8d4-7700fb130676 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:23.769495 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0c54df-ef8c-4af2-a8d4-7700fb130676 admin admin] PATH_INFO: `/v3/users/9e5e875987db4003a8655200463d9667` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:23.771113 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0c54df-ef8c-4af2-a8d4-7700fb130676 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e5e875987db4003a8655200463d9667)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:23.773642 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0c54df-ef8c-4af2-a8d4-7700fb130676 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:23.827283 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee27e7f-39af-4fba-8296-9dd93738055c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:23.828925 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee27e7f-39af-4fba-8296-9dd93738055c service nova] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:23.859721 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3108/6246] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:34:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:34:23.864840 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee27e7f-39af-4fba-8296-9dd93738055c service nova] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:23.870890 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-aee27e7f-39af-4fba-8296-9dd93738055c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:23.913256 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-5c0c54df-ef8c-4af2-a8d4-7700fb130676 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e5e875987db4003a8655200463d9667'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:23.914548 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-5c0c54df-ef8c-4af2-a8d4-7700fb130676 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e5e875987db4003a8655200463d9667'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:23.934529 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-5c0c54df-ef8c-4af2-a8d4-7700fb130676 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e5e875987db4003a8655200463d9667'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:23.955353 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-5c0c54df-ef8c-4af2-a8d4-7700fb130676 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e5e875987db4003a8655200463d9667'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:23.975358 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-5c0c54df-ef8c-4af2-a8d4-7700fb130676 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e5e875987db4003a8655200463d9667'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:23.995520 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3139/6247] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:34:23 2022] DELETE /identity/v3/users/9e5e875987db4003a8655200463d9667 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:23.999493 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa73c06-504f-4380-8f0a-9d9f88279b74 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:24.001126 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa73c06-504f-4380-8f0a-9d9f88279b74 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:24.001126 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa73c06-504f-4380-8f0a-9d9f88279b74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:24.013259 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee27e7f-39af-4fba-8296-9dd93738055c service nova] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:24.023998 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-1aa73c06-504f-4380-8f0a-9d9f88279b74 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:34:24.025795 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-1aa73c06-504f-4380-8f0a-9d9f88279b74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:24.142600 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:24.161354 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1993ce-db6d-4d39-bcb9-5e4dda4b10a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:24.162205 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1993ce-db6d-4d39-bcb9-5e4dda4b10a1 service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:24.163390 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1993ce-db6d-4d39-bcb9-5e4dda4b10a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:24.163610 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1993ce-db6d-4d39-bcb9-5e4dda4b10a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:24.169352 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-6d1993ce-db6d-4d39-bcb9-5e4dda4b10a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:24.198083 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3140/6248] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:34:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:34:24.203239 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa73c06-504f-4380-8f0a-9d9f88279b74 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:24.210090 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-1aa73c06-504f-4380-8f0a-9d9f88279b74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:24.264320 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa73c06-504f-4380-8f0a-9d9f88279b74 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:24.272850 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689047b5-a941-4a9d-bc6e-e4f37b710c7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:24.273806 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689047b5-a941-4a9d-bc6e-e4f37b710c7a service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:24.274134 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689047b5-a941-4a9d-bc6e-e4f37b710c7a service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:24.274703 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689047b5-a941-4a9d-bc6e-e4f37b710c7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:24.279793 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:24.283203 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1993ce-db6d-4d39-bcb9-5e4dda4b10a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:24.284679 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1993ce-db6d-4d39-bcb9-5e4dda4b10a1 service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:24.297026 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3109/6249] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:34:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:34:24.299761 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689047b5-a941-4a9d-bc6e-e4f37b710c7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:24.301230 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689047b5-a941-4a9d-bc6e-e4f37b710c7a service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:24.328423 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3141/6250] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:34:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:34:25.296092 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1993ce-db6d-4d39-bcb9-5e4dda4b10a1 service neutron] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:25.297628 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-6d1993ce-db6d-4d39-bcb9-5e4dda4b10a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:25.315956 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1993ce-db6d-4d39-bcb9-5e4dda4b10a1 service neutron] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:25.334160 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb6f5ea-8f19-4ef3-acfa-a4e0d6a3fcb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:25.336681 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb6f5ea-8f19-4ef3-acfa-a4e0d6a3fcb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:25.336681 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb6f5ea-8f19-4ef3-acfa-a4e0d6a3fcb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:25.336681 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb6f5ea-8f19-4ef3-acfa-a4e0d6a3fcb0 admin admin] PATH_INFO: `/v3/projects/7efdb9d4d7a445848e991290ea11ca84` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:25.337910 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb6f5ea-8f19-4ef3-acfa-a4e0d6a3fcb0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7efdb9d4d7a445848e991290ea11ca84)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:25.339991 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb6f5ea-8f19-4ef3-acfa-a4e0d6a3fcb0 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:25.435301 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-4bb6f5ea-8f19-4ef3-acfa-a4e0d6a3fcb0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7efdb9d4d7a445848e991290ea11ca84', 'request_id': 'req-4bb6f5ea-8f19-4ef3-acfa-a4e0d6a3fcb0'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:25.453456 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-4bb6f5ea-8f19-4ef3-acfa-a4e0d6a3fcb0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7efdb9d4d7a445848e991290ea11ca84', 'request_id': 'req-4bb6f5ea-8f19-4ef3-acfa-a4e0d6a3fcb0'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:25.464348 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-4bb6f5ea-8f19-4ef3-acfa-a4e0d6a3fcb0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7efdb9d4d7a445848e991290ea11ca84', 'request_id': 'req-4bb6f5ea-8f19-4ef3-acfa-a4e0d6a3fcb0'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:25.465081 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689047b5-a941-4a9d-bc6e-e4f37b710c7a service neutron] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:25.467142 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-689047b5-a941-4a9d-bc6e-e4f37b710c7a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:25.479373 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-4bb6f5ea-8f19-4ef3-acfa-a4e0d6a3fcb0 admin admin] The token cache is being invalidate because project 7efdb9d4d7a445848e991290ea11ca84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:34:25.479659 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-4bb6f5ea-8f19-4ef3-acfa-a4e0d6a3fcb0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:25.480981 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-4bb6f5ea-8f19-4ef3-acfa-a4e0d6a3fcb0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:25.482691 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689047b5-a941-4a9d-bc6e-e4f37b710c7a service neutron] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:25.482921 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3110/6251] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:34:25 2022] DELETE /identity/v3/projects/7efdb9d4d7a445848e991290ea11ca84 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:25.487177 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb6f5ea-8f19-4ef3-acfa-a4e0d6a3fcb0 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:25.488643 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-4bb6f5ea-8f19-4ef3-acfa-a4e0d6a3fcb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:25.552892 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5793cae4-2f61-4d55-aa18-1f7a817e6c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:25.554000 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5793cae4-2f61-4d55-aa18-1f7a817e6c89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:25.554434 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5793cae4-2f61-4d55-aa18-1f7a817e6c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:25.554775 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5793cae4-2f61-4d55-aa18-1f7a817e6c89 admin admin] PATH_INFO: `/v3/projects/672228c1a6fd4d0b9a4c6a3a9c739179` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:25.556191 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5793cae4-2f61-4d55-aa18-1f7a817e6c89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=672228c1a6fd4d0b9a4c6a3a9c739179)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:25.558408 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5793cae4-2f61-4d55-aa18-1f7a817e6c89 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:25.582024 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb6f5ea-8f19-4ef3-acfa-a4e0d6a3fcb0 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:25.587952 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2fcc26-483e-4ff6-bdc1-9c68d17d43e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:25.588855 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2fcc26-483e-4ff6-bdc1-9c68d17d43e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:25.589143 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2fcc26-483e-4ff6-bdc1-9c68d17d43e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:25.589406 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2fcc26-483e-4ff6-bdc1-9c68d17d43e8 admin admin] PATH_INFO: `/v3/users/ba8a239f18c94d488a12cd3c0e0fd78d` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:25.590718 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2fcc26-483e-4ff6-bdc1-9c68d17d43e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba8a239f18c94d488a12cd3c0e0fd78d)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:25.593047 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2fcc26-483e-4ff6-bdc1-9c68d17d43e8 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:25.648973 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-5793cae4-2f61-4d55-aa18-1f7a817e6c89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '672228c1a6fd4d0b9a4c6a3a9c739179', 'request_id': 'req-5793cae4-2f61-4d55-aa18-1f7a817e6c89'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:25.662476 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-5793cae4-2f61-4d55-aa18-1f7a817e6c89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '672228c1a6fd4d0b9a4c6a3a9c739179', 'request_id': 'req-5793cae4-2f61-4d55-aa18-1f7a817e6c89'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:25.692813 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-5793cae4-2f61-4d55-aa18-1f7a817e6c89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '672228c1a6fd4d0b9a4c6a3a9c739179', 'request_id': 'req-5793cae4-2f61-4d55-aa18-1f7a817e6c89'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:25.705839 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-cf2fcc26-483e-4ff6-bdc1-9c68d17d43e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba8a239f18c94d488a12cd3c0e0fd78d'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:25.712035 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-5793cae4-2f61-4d55-aa18-1f7a817e6c89 admin admin] The token cache is being invalidate because project 672228c1a6fd4d0b9a4c6a3a9c739179 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:34:25.712862 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-5793cae4-2f61-4d55-aa18-1f7a817e6c89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:25.714232 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-5793cae4-2f61-4d55-aa18-1f7a817e6c89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:25.716995 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3142/6252] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:34:25 2022] DELETE /identity/v3/projects/672228c1a6fd4d0b9a4c6a3a9c739179 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:25.723817 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5793cae4-2f61-4d55-aa18-1f7a817e6c89 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:25.726126 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-5793cae4-2f61-4d55-aa18-1f7a817e6c89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:25.729228 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-cf2fcc26-483e-4ff6-bdc1-9c68d17d43e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba8a239f18c94d488a12cd3c0e0fd78d'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:25.730198 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-cf2fcc26-483e-4ff6-bdc1-9c68d17d43e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba8a239f18c94d488a12cd3c0e0fd78d'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:25.757384 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-cf2fcc26-483e-4ff6-bdc1-9c68d17d43e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba8a239f18c94d488a12cd3c0e0fd78d'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:25.779790 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-cf2fcc26-483e-4ff6-bdc1-9c68d17d43e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba8a239f18c94d488a12cd3c0e0fd78d'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:25.784761 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:25.789287 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3111/6253] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:34:25 2022] DELETE /identity/v3/users/ba8a239f18c94d488a12cd3c0e0fd78d => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:34:25.859728 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5793cae4-2f61-4d55-aa18-1f7a817e6c89 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:25.864115 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:25.940824 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d552b7cb-4b17-4478-80e3-d1c5d5021e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:25.941887 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d552b7cb-4b17-4478-80e3-d1c5d5021e46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:25.942254 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d552b7cb-4b17-4478-80e3-d1c5d5021e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:25.942634 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d552b7cb-4b17-4478-80e3-d1c5d5021e46 admin admin] PATH_INFO: `/v3/users/ce5b7c9a7e31401d8c04a24af809ed81` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:25.944312 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d552b7cb-4b17-4478-80e3-d1c5d5021e46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce5b7c9a7e31401d8c04a24af809ed81)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:25.946503 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d552b7cb-4b17-4478-80e3-d1c5d5021e46 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:26.029697 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-d552b7cb-4b17-4478-80e3-d1c5d5021e46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce5b7c9a7e31401d8c04a24af809ed81'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:26.030768 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-d552b7cb-4b17-4478-80e3-d1c5d5021e46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce5b7c9a7e31401d8c04a24af809ed81'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:26.040041 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-d552b7cb-4b17-4478-80e3-d1c5d5021e46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce5b7c9a7e31401d8c04a24af809ed81'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:26.052975 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-d552b7cb-4b17-4478-80e3-d1c5d5021e46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce5b7c9a7e31401d8c04a24af809ed81'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:26.083543 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-d552b7cb-4b17-4478-80e3-d1c5d5021e46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce5b7c9a7e31401d8c04a24af809ed81'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:26.090715 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3143/6254] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:34:25 2022] DELETE /identity/v3/users/ce5b7c9a7e31401d8c04a24af809ed81 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:26.436545 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2fcc26-483e-4ff6-bdc1-9c68d17d43e8 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:26.438270 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-cf2fcc26-483e-4ff6-bdc1-9c68d17d43e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:26.457055 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2fcc26-483e-4ff6-bdc1-9c68d17d43e8 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:26.560999 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e449c07c-d800-4767-8302-e151c0095a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:26.562045 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e449c07c-d800-4767-8302-e151c0095a9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:26.562332 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e449c07c-d800-4767-8302-e151c0095a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:26.562690 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e449c07c-d800-4767-8302-e151c0095a9c admin admin] PATH_INFO: `/v3/projects/816984c605114e4680f81fb019e5229f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:26.563963 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e449c07c-d800-4767-8302-e151c0095a9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=816984c605114e4680f81fb019e5229f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:26.566321 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e449c07c-d800-4767-8302-e151c0095a9c admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:26.625649 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-e449c07c-d800-4767-8302-e151c0095a9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '816984c605114e4680f81fb019e5229f', 'request_id': 'req-e449c07c-d800-4767-8302-e151c0095a9c'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:26.636949 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-e449c07c-d800-4767-8302-e151c0095a9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '816984c605114e4680f81fb019e5229f', 'request_id': 'req-e449c07c-d800-4767-8302-e151c0095a9c'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:26.645314 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-e449c07c-d800-4767-8302-e151c0095a9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '816984c605114e4680f81fb019e5229f', 'request_id': 'req-e449c07c-d800-4767-8302-e151c0095a9c'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:26.659973 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-e449c07c-d800-4767-8302-e151c0095a9c admin admin] The token cache is being invalidate because project 816984c605114e4680f81fb019e5229f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:34:26.660264 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-e449c07c-d800-4767-8302-e151c0095a9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:26.660926 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-e449c07c-d800-4767-8302-e151c0095a9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:26.666197 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3112/6255] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:34:26 2022] DELETE /identity/v3/projects/816984c605114e4680f81fb019e5229f => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:26.668014 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c479f2-c8ed-41fe-a31c-ffa1a26bef53 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:26.668555 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c479f2-c8ed-41fe-a31c-ffa1a26bef53 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:26.668752 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c479f2-c8ed-41fe-a31c-ffa1a26bef53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:26.689558 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-27c479f2-c8ed-41fe-a31c-ffa1a26bef53 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:34:26.691176 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-27c479f2-c8ed-41fe-a31c-ffa1a26bef53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:26.769700 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3144/6256] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:34:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:34:26.777565 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26776f8c-7ca3-494a-b8c0-39a290b763c0 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:26.778699 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26776f8c-7ca3-494a-b8c0-39a290b763c0 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:26.779022 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26776f8c-7ca3-494a-b8c0-39a290b763c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:26.802810 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-26776f8c-7ca3-494a-b8c0-39a290b763c0 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:34:26.804327 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-26776f8c-7ca3-494a-b8c0-39a290b763c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:26.840220 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3113/6257] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:34:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:34:26.840854 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c479f2-c8ed-41fe-a31c-ffa1a26bef53 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:26.852216 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c479f2-c8ed-41fe-a31c-ffa1a26bef53 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:26.858714 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9017eabf-b3a0-45b2-89e6-f55f49251616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:26.859608 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9017eabf-b3a0-45b2-89e6-f55f49251616 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:26.860028 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9017eabf-b3a0-45b2-89e6-f55f49251616 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:26.860514 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9017eabf-b3a0-45b2-89e6-f55f49251616 admin admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:26.861442 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9017eabf-b3a0-45b2-89e6-f55f49251616 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:34:26.862651 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9017eabf-b3a0-45b2-89e6-f55f49251616 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:26.865608 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9017eabf-b3a0-45b2-89e6-f55f49251616 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:26.891763 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26776f8c-7ca3-494a-b8c0-39a290b763c0 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:26.892596 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3145/6258] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:34:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 21:34:26.903549 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26776f8c-7ca3-494a-b8c0-39a290b763c0 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:26.908715 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06255cd-fae6-4495-8903-8c69e6dd6070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:26.909387 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06255cd-fae6-4495-8903-8c69e6dd6070 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:26.909664 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06255cd-fae6-4495-8903-8c69e6dd6070 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:26.909978 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06255cd-fae6-4495-8903-8c69e6dd6070 admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:26.910655 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06255cd-fae6-4495-8903-8c69e6dd6070 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:26.912641 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06255cd-fae6-4495-8903-8c69e6dd6070 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:26.945894 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3114/6259] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:34:26 2022] POST /identity/v3/projects => generated 377 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:34:26.950202 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9017eabf-b3a0-45b2-89e6-f55f49251616 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:26.961737 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9017eabf-b3a0-45b2-89e6-f55f49251616 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:26.980357 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:27.046046 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e45e67-6778-4c1a-ac6a-9a69a29055a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:27.046806 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e45e67-6778-4c1a-ac6a-9a69a29055a1 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:27.047090 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e45e67-6778-4c1a-ac6a-9a69a29055a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:27.047372 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e45e67-6778-4c1a-ac6a-9a69a29055a1 admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:27.048066 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e45e67-6778-4c1a-ac6a-9a69a29055a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:27.050046 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e45e67-6778-4c1a-ac6a-9a69a29055a1 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:27.085794 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3146/6260] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:34:26 2022] POST /identity/v3/users => generated 289 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:34:27.086805 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06255cd-fae6-4495-8903-8c69e6dd6070 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:27.104844 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06255cd-fae6-4495-8903-8c69e6dd6070 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:27.114913 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11fc278-e8cd-43b1-9be7-ae0a9e66a615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:27.115680 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11fc278-e8cd-43b1-9be7-ae0a9e66a615 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:27.116711 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11fc278-e8cd-43b1-9be7-ae0a9e66a615 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:27.116997 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11fc278-e8cd-43b1-9be7-ae0a9e66a615 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:27.117742 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11fc278-e8cd-43b1-9be7-ae0a9e66a615 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:27.121145 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11fc278-e8cd-43b1-9be7-ae0a9e66a615 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:27.136248 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3115/6261] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:34:27 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 21:34:27.140159 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e45e67-6778-4c1a-ac6a-9a69a29055a1 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:27.152828 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e45e67-6778-4c1a-ac6a-9a69a29055a1 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:27.157838 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4cab0f-bae9-48c7-8dbe-0a984e286c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:27.158618 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4cab0f-bae9-48c7-8dbe-0a984e286c43 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:27.158904 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4cab0f-bae9-48c7-8dbe-0a984e286c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:27.159181 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4cab0f-bae9-48c7-8dbe-0a984e286c43 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:27.160057 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4cab0f-bae9-48c7-8dbe-0a984e286c43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:27.161746 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4cab0f-bae9-48c7-8dbe-0a984e286c43 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:27.177039 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3147/6262] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:34:27 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:34:27.178486 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11fc278-e8cd-43b1-9be7-ae0a9e66a615 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:27.206627 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11fc278-e8cd-43b1-9be7-ae0a9e66a615 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:27.213367 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65906ccd-85cc-46a6-8872-f34b634e6b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:27.214420 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65906ccd-85cc-46a6-8872-f34b634e6b02 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:27.214891 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65906ccd-85cc-46a6-8872-f34b634e6b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:27.215258 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65906ccd-85cc-46a6-8872-f34b634e6b02 admin admin] PATH_INFO: `/v3/projects/31b598de1e444d1b9fb43bc5126ca64c/users/a34d714101a1439c83fea8ed7a1b86fd/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:27.243507 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65906ccd-85cc-46a6-8872-f34b634e6b02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31b598de1e444d1b9fb43bc5126ca64c, user_id=a34d714101a1439c83fea8ed7a1b86fd, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:27.249679 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65906ccd-85cc-46a6-8872-f34b634e6b02 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:27.284363 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3116/6263] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:34:27 2022] PUT /identity/v3/projects/31b598de1e444d1b9fb43bc5126ca64c/users/a34d714101a1439c83fea8ed7a1b86fd/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:34:27.296372 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de62995-b782-4785-ab62-9297d240a378 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:27.296697 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de62995-b782-4785-ab62-9297d240a378 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:27.296957 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de62995-b782-4785-ab62-9297d240a378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:27.331493 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-5de62995-b782-4785-ab62-9297d240a378 None None] MFA Rules not processed for user `a34d714101a1439c83fea8ed7a1b86fd`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:34:27.332731 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-5de62995-b782-4785-ab62-9297d240a378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:27.369802 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65906ccd-85cc-46a6-8872-f34b634e6b02 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:27.371654 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-65906ccd-85cc-46a6-8872-f34b634e6b02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:27.424543 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:27.455820 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3148/6264] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:34:27 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:34:27.458352 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de62995-b782-4785-ab62-9297d240a378 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:27.516252 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65906ccd-85cc-46a6-8872-f34b634e6b02 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:27.526205 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72ab034-e1c0-4603-8538-3e1b2a4e7ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:27.528132 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72ab034-e1c0-4603-8538-3e1b2a4e7ff6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:27.528629 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72ab034-e1c0-4603-8538-3e1b2a4e7ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:27.529115 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72ab034-e1c0-4603-8538-3e1b2a4e7ff6 admin admin] PATH_INFO: `/v3/projects/f0ccdb01d5724c9b9b8c6590e385e12c` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:27.529437 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de62995-b782-4785-ab62-9297d240a378 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:27.530872 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72ab034-e1c0-4603-8538-3e1b2a4e7ff6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0ccdb01d5724c9b9b8c6590e385e12c)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:27.533822 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72ab034-e1c0-4603-8538-3e1b2a4e7ff6 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:27.536019 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0935e793-a7ed-42c9-a83c-7f3091ce9405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:27.537130 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0935e793-a7ed-42c9-a83c-7f3091ce9405 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:27.537324 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0935e793-a7ed-42c9-a83c-7f3091ce9405 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:27.537705 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0935e793-a7ed-42c9-a83c-7f3091ce9405 admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:27.538442 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0935e793-a7ed-42c9-a83c-7f3091ce9405 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:27.540870 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0935e793-a7ed-42c9-a83c-7f3091ce9405 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:27.586965 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3149/6265] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:34:27 2022] POST /identity/v3/projects => generated 381 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:34:27.588881 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0935e793-a7ed-42c9-a83c-7f3091ce9405 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:27.604419 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:27.628385 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-c72ab034-e1c0-4603-8538-3e1b2a4e7ff6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0ccdb01d5724c9b9b8c6590e385e12c', 'request_id': 'req-c72ab034-e1c0-4603-8538-3e1b2a4e7ff6'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:27.642960 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-c72ab034-e1c0-4603-8538-3e1b2a4e7ff6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0ccdb01d5724c9b9b8c6590e385e12c', 'request_id': 'req-c72ab034-e1c0-4603-8538-3e1b2a4e7ff6'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:27.662559 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-c72ab034-e1c0-4603-8538-3e1b2a4e7ff6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0ccdb01d5724c9b9b8c6590e385e12c', 'request_id': 'req-c72ab034-e1c0-4603-8538-3e1b2a4e7ff6'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:27.694985 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-c72ab034-e1c0-4603-8538-3e1b2a4e7ff6 admin admin] The token cache is being invalidate because project f0ccdb01d5724c9b9b8c6590e385e12c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:34:27.695293 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-c72ab034-e1c0-4603-8538-3e1b2a4e7ff6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:27.696048 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-c72ab034-e1c0-4603-8538-3e1b2a4e7ff6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:27.700992 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3117/6266] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:34:27 2022] DELETE /identity/v3/projects/f0ccdb01d5724c9b9b8c6590e385e12c => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:34:27.701195 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0935e793-a7ed-42c9-a83c-7f3091ce9405 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:27.703459 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9baa6ee-96df-4e3f-b5ca-9cc2e04cfc91 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:27.703757 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9baa6ee-96df-4e3f-b5ca-9cc2e04cfc91 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:27.704044 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9baa6ee-96df-4e3f-b5ca-9cc2e04cfc91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:27.746872 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-c9baa6ee-96df-4e3f-b5ca-9cc2e04cfc91 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:34:27.748141 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-c9baa6ee-96df-4e3f-b5ca-9cc2e04cfc91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:27.852005 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941c639c-c464-4895-bd82-b1091a5247df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:27.852915 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941c639c-c464-4895-bd82-b1091a5247df admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:27.853329 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941c639c-c464-4895-bd82-b1091a5247df admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:27.859466 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941c639c-c464-4895-bd82-b1091a5247df admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:27.860305 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941c639c-c464-4895-bd82-b1091a5247df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:27.863007 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941c639c-c464-4895-bd82-b1091a5247df admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:27.907029 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3118/6267] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:34:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:34:27.909148 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9baa6ee-96df-4e3f-b5ca-9cc2e04cfc91 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:27.912378 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-c9baa6ee-96df-4e3f-b5ca-9cc2e04cfc91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:27.932820 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3150/6268] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:34:27 2022] POST /identity/v3/users => generated 291 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:34:27.934219 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa44fa0-9993-43b0-a017-a5e2d8d38693 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:27.934514 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa44fa0-9993-43b0-a017-a5e2d8d38693 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:27.934800 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa44fa0-9993-43b0-a017-a5e2d8d38693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:27.998536 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-faa44fa0-9993-43b0-a017-a5e2d8d38693 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:34:28.012967 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-faa44fa0-9993-43b0-a017-a5e2d8d38693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:28.031778 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:28.055409 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3151/6269] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:34:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:34:28.055409 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa44fa0-9993-43b0-a017-a5e2d8d38693 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:28.059181 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-faa44fa0-9993-43b0-a017-a5e2d8d38693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:28.078522 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9baa6ee-96df-4e3f-b5ca-9cc2e04cfc91 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:28.081705 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa44fa0-9993-43b0-a017-a5e2d8d38693 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:28.090398 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcddd293-e2c5-45d3-b8f8-bd24f7dc9196 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:28.091265 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcddd293-e2c5-45d3-b8f8-bd24f7dc9196 service nova] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:28.091688 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcddd293-e2c5-45d3-b8f8-bd24f7dc9196 service nova] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:28.092120 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcddd293-e2c5-45d3-b8f8-bd24f7dc9196 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:28.102601 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-fcddd293-e2c5-45d3-b8f8-bd24f7dc9196 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:28.105756 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3d6194-75d7-4168-bccb-da6806a5fece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:28.106497 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3d6194-75d7-4168-bccb-da6806a5fece admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:28.107353 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3d6194-75d7-4168-bccb-da6806a5fece admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:28.107636 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3d6194-75d7-4168-bccb-da6806a5fece admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:28.108382 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3d6194-75d7-4168-bccb-da6806a5fece admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:28.111127 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3d6194-75d7-4168-bccb-da6806a5fece admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:28.126454 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3152/6270] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:34:28 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:34:28.127302 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcddd293-e2c5-45d3-b8f8-bd24f7dc9196 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:28.128122 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3d6194-75d7-4168-bccb-da6806a5fece admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:28.129013 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcddd293-e2c5-45d3-b8f8-bd24f7dc9196 service nova] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:28.130828 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-ab3d6194-75d7-4168-bccb-da6806a5fece admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:28.148670 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3119/6271] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:34:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:34:28.151391 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3d6194-75d7-4168-bccb-da6806a5fece admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:28.154817 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcddd293-e2c5-45d3-b8f8-bd24f7dc9196 service nova] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:28.157790 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27c7f84-430f-40d6-8713-6a4384dae18b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:28.159026 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27c7f84-430f-40d6-8713-6a4384dae18b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:28.159459 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27c7f84-430f-40d6-8713-6a4384dae18b admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:28.160186 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27c7f84-430f-40d6-8713-6a4384dae18b admin admin] PATH_INFO: `/v3/users/fb86139c0aae43e8983e0a92e4553307` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:28.161697 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27c7f84-430f-40d6-8713-6a4384dae18b admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb86139c0aae43e8983e0a92e4553307)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:28.164691 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27c7f84-430f-40d6-8713-6a4384dae18b admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:28.182188 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcddd293-e2c5-45d3-b8f8-bd24f7dc9196 service nova] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:28.188737 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1438a9fa-cf28-41e2-9bf4-4e32faef2542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:28.189033 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1438a9fa-cf28-41e2-9bf4-4e32faef2542 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:28.189383 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1438a9fa-cf28-41e2-9bf4-4e32faef2542 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:28.189565 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1438a9fa-cf28-41e2-9bf4-4e32faef2542 admin admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:28.190329 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1438a9fa-cf28-41e2-9bf4-4e32faef2542 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:34:28.190747 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1438a9fa-cf28-41e2-9bf4-4e32faef2542 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:28.197972 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1438a9fa-cf28-41e2-9bf4-4e32faef2542 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:28.211691 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3120/6272] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:34:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:34:28.212531 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1438a9fa-cf28-41e2-9bf4-4e32faef2542 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:28.233004 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1438a9fa-cf28-41e2-9bf4-4e32faef2542 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:28.239914 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-e27c7f84-430f-40d6-8713-6a4384dae18b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb86139c0aae43e8983e0a92e4553307'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:28.240715 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-e27c7f84-430f-40d6-8713-6a4384dae18b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb86139c0aae43e8983e0a92e4553307'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:28.241079 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfcfd50-7157-4564-9dcc-c0dab988ba97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:28.241766 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfcfd50-7157-4564-9dcc-c0dab988ba97 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:28.242104 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfcfd50-7157-4564-9dcc-c0dab988ba97 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:28.242342 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfcfd50-7157-4564-9dcc-c0dab988ba97 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:28.243328 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfcfd50-7157-4564-9dcc-c0dab988ba97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:28.244665 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfcfd50-7157-4564-9dcc-c0dab988ba97 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:28.249210 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-e27c7f84-430f-40d6-8713-6a4384dae18b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb86139c0aae43e8983e0a92e4553307'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:28.259799 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-e27c7f84-430f-40d6-8713-6a4384dae18b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb86139c0aae43e8983e0a92e4553307'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:28.276480 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3121/6273] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:34:28 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:34:28.276480 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfcfd50-7157-4564-9dcc-c0dab988ba97 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:28.284947 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-e27c7f84-430f-40d6-8713-6a4384dae18b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb86139c0aae43e8983e0a92e4553307'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:28.287418 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:28.292251 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfcfd50-7157-4564-9dcc-c0dab988ba97 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:28.299897 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a820dd96-a225-4080-b109-ddb4ca9cd8cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:28.300734 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a820dd96-a225-4080-b109-ddb4ca9cd8cc admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:28.301019 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a820dd96-a225-4080-b109-ddb4ca9cd8cc admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:28.301294 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a820dd96-a225-4080-b109-ddb4ca9cd8cc admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:28.302294 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a820dd96-a225-4080-b109-ddb4ca9cd8cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:28.304389 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a820dd96-a225-4080-b109-ddb4ca9cd8cc admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:28.317471 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3153/6274] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:34:28 2022] DELETE /identity/v3/users/fb86139c0aae43e8983e0a92e4553307 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:28.319342 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27c7f84-430f-40d6-8713-6a4384dae18b admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:28.320961 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-e27c7f84-430f-40d6-8713-6a4384dae18b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:28.356276 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3122/6275] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:34:28 2022] POST /identity/v3/projects => generated 375 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:34:28.356276 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3657c96-134d-4722-903b-c837132d609f None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:28.356276 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3657c96-134d-4722-903b-c837132d609f None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:28.356276 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3657c96-134d-4722-903b-c837132d609f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:28.385342 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-c3657c96-134d-4722-903b-c837132d609f None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:34:28.387400 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-c3657c96-134d-4722-903b-c837132d609f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:28.418549 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27c7f84-430f-40d6-8713-6a4384dae18b admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:28.523441 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3123/6276] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:34:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:34:28.528031 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3657c96-134d-4722-903b-c837132d609f None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:28.530687 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-c3657c96-134d-4722-903b-c837132d609f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:28.540700 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bae9e40-b4ee-4f17-8e4f-8e6417a19d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:28.541842 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bae9e40-b4ee-4f17-8e4f-8e6417a19d96 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:28.542284 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bae9e40-b4ee-4f17-8e4f-8e6417a19d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:28.542563 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bae9e40-b4ee-4f17-8e4f-8e6417a19d96 admin admin] PATH_INFO: `/v3/projects/984076ce7e814ab7a6dfb9d0b95d46c5/users/f650b24ade1f4e53ae00a78fed2e8eeb/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:28.558185 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3657c96-134d-4722-903b-c837132d609f None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:28.574842 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bae9e40-b4ee-4f17-8e4f-8e6417a19d96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=984076ce7e814ab7a6dfb9d0b95d46c5, user_id=f650b24ade1f4e53ae00a78fed2e8eeb, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:28.578696 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bae9e40-b4ee-4f17-8e4f-8e6417a19d96 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:28.581702 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb4bb13-262e-46e4-9d78-69fd328c70ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:28.582966 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb4bb13-262e-46e4-9d78-69fd328c70ca admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:28.586372 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb4bb13-262e-46e4-9d78-69fd328c70ca admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:28.587369 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb4bb13-262e-46e4-9d78-69fd328c70ca admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:28.589312 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb4bb13-262e-46e4-9d78-69fd328c70ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:28.591898 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb4bb13-262e-46e4-9d78-69fd328c70ca admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:28.606323 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3154/6277] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:34:28 2022] PUT /identity/v3/projects/984076ce7e814ab7a6dfb9d0b95d46c5/users/f650b24ade1f4e53ae00a78fed2e8eeb/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:28.608177 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bae9e40-b4ee-4f17-8e4f-8e6417a19d96 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:28.610461 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-8bae9e40-b4ee-4f17-8e4f-8e6417a19d96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:28.649680 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3124/6278] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:34:28 2022] POST /identity/v3/users => generated 288 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:34:28.650182 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab603c0d-58af-4a15-a360-9607303df071 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:28.650561 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab603c0d-58af-4a15-a360-9607303df071 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:28.650904 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab603c0d-58af-4a15-a360-9607303df071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:28.706947 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bae9e40-b4ee-4f17-8e4f-8e6417a19d96 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:28.711569 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906e0898-da0c-459b-842e-379e9457ca50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:28.712329 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906e0898-da0c-459b-842e-379e9457ca50 service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:28.712690 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906e0898-da0c-459b-842e-379e9457ca50 service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:28.712825 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-ab603c0d-58af-4a15-a360-9607303df071 None None] MFA Rules not processed for user `f650b24ade1f4e53ae00a78fed2e8eeb`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:34:28.714136 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906e0898-da0c-459b-842e-379e9457ca50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:28.714288 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-ab603c0d-58af-4a15-a360-9607303df071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:28.784306 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:28.827040 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906e0898-da0c-459b-842e-379e9457ca50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:28.829600 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906e0898-da0c-459b-842e-379e9457ca50 service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:28.857453 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3155/6279] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:34:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:34:28.858577 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906e0898-da0c-459b-842e-379e9457ca50 service neutron] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:28.877514 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906e0898-da0c-459b-842e-379e9457ca50 service neutron] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:28.885315 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3125/6280] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:34:28 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:34:28.896408 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0f01d6-8bf5-4565-8228-1512abac85b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:28.897352 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0f01d6-8bf5-4565-8228-1512abac85b5 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:28.897797 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0f01d6-8bf5-4565-8228-1512abac85b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:28.898263 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0f01d6-8bf5-4565-8228-1512abac85b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:28.899163 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0f01d6-8bf5-4565-8228-1512abac85b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:28.901143 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0f01d6-8bf5-4565-8228-1512abac85b5 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:28.902418 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab603c0d-58af-4a15-a360-9607303df071 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:28.906124 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-ab603c0d-58af-4a15-a360-9607303df071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:28.918127 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:28.936917 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3156/6281] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:34:28 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:34:28.938216 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0f01d6-8bf5-4565-8228-1512abac85b5 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:28.964921 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0f01d6-8bf5-4565-8228-1512abac85b5 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:28.970809 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3476520-4df9-491f-85ae-7cf3fb62ddf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:28.971758 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3476520-4df9-491f-85ae-7cf3fb62ddf2 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:28.972193 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3476520-4df9-491f-85ae-7cf3fb62ddf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:28.972629 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3476520-4df9-491f-85ae-7cf3fb62ddf2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:28.973537 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3476520-4df9-491f-85ae-7cf3fb62ddf2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:28.976319 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3476520-4df9-491f-85ae-7cf3fb62ddf2 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:28.995040 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3157/6282] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:34:28 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:34:28.998990 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3476520-4df9-491f-85ae-7cf3fb62ddf2 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:29.006330 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab603c0d-58af-4a15-a360-9607303df071 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:29.009916 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3476520-4df9-491f-85ae-7cf3fb62ddf2 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:29.010703 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b776bf3f-bd6a-4261-98b2-749d8f2196c6 tempest-IdentityV3ProjectsTest-59558330 tempest-IdentityV3ProjectsTest-59558330-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a34d714101a1439c83fea8ed7a1b86fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b598de1e444d1b9fb43bc5126ca64c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:29.011614 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b776bf3f-bd6a-4261-98b2-749d8f2196c6 tempest-IdentityV3ProjectsTest-59558330 tempest-IdentityV3ProjectsTest-59558330-project] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:29.011900 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b776bf3f-bd6a-4261-98b2-749d8f2196c6 tempest-IdentityV3ProjectsTest-59558330 tempest-IdentityV3ProjectsTest-59558330-project] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:29.012177 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b776bf3f-bd6a-4261-98b2-749d8f2196c6 tempest-IdentityV3ProjectsTest-59558330 tempest-IdentityV3ProjectsTest-59558330-project] PATH_INFO: `/v3/users/a34d714101a1439c83fea8ed7a1b86fd/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:29.013432 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b776bf3f-bd6a-4261-98b2-749d8f2196c6 tempest-IdentityV3ProjectsTest-59558330 tempest-IdentityV3ProjectsTest-59558330-project] RBAC: Authorizing `identity:list_user_projects(user_id=a34d714101a1439c83fea8ed7a1b86fd)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:29.015636 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b776bf3f-bd6a-4261-98b2-749d8f2196c6 tempest-IdentityV3ProjectsTest-59558330 tempest-IdentityV3ProjectsTest-59558330-project] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:29.016313 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fc4587-208c-46d4-ac77-5f7dd7108ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:29.017382 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fc4587-208c-46d4-ac77-5f7dd7108ea2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:29.017825 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fc4587-208c-46d4-ac77-5f7dd7108ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:29.018394 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fc4587-208c-46d4-ac77-5f7dd7108ea2 admin admin] PATH_INFO: `/v3/projects/27b3e8db48f04b4892b3e0ce24c20c96/users/c560c0afd9cd4661855d1d45796509fa/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:29.036744 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fc4587-208c-46d4-ac77-5f7dd7108ea2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27b3e8db48f04b4892b3e0ce24c20c96, user_id=c560c0afd9cd4661855d1d45796509fa, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:29.041367 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fc4587-208c-46d4-ac77-5f7dd7108ea2 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:29.069956 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3158/6283] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:34:28 2022] PUT /identity/v3/projects/27b3e8db48f04b4892b3e0ce24c20c96/users/c560c0afd9cd4661855d1d45796509fa/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:29.070549 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3126/6284] 10.222.0.17 () {58 vars in 1247 bytes} [Sat Jul 23 21:34:28 2022] GET /identity/v3/users/a34d714101a1439c83fea8ed7a1b86fd/projects => generated 513 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:34:29.072341 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1632bf22-989f-4f88-aa61-353d2908c289 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:29.072835 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1632bf22-989f-4f88-aa61-353d2908c289 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:29.073110 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1632bf22-989f-4f88-aa61-353d2908c289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:29.074328 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6886e75c-3344-466b-80f5-65b7ec70d94f None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:29.074805 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6886e75c-3344-466b-80f5-65b7ec70d94f None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:29.075388 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6886e75c-3344-466b-80f5-65b7ec70d94f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:29.131056 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-1632bf22-989f-4f88-aa61-353d2908c289 None None] MFA Rules not processed for user `a34d714101a1439c83fea8ed7a1b86fd`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:34:29.131287 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-6886e75c-3344-466b-80f5-65b7ec70d94f None None] MFA Rules not processed for user `c560c0afd9cd4661855d1d45796509fa`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:34:29.132481 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-6886e75c-3344-466b-80f5-65b7ec70d94f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:29.132709 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-1632bf22-989f-4f88-aa61-353d2908c289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:29.223265 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3127/6285] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:34:29 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:34:29.243319 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6886e75c-3344-466b-80f5-65b7ec70d94f None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:29.249075 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3159/6286] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:34:29 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:34:29.250912 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1632bf22-989f-4f88-aa61-353d2908c289 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:29.337083 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6886e75c-3344-466b-80f5-65b7ec70d94f None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:29.342698 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8797a25c-2935-482e-a5ab-9d79c89056fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:29.343699 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8797a25c-2935-482e-a5ab-9d79c89056fa service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:29.344130 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8797a25c-2935-482e-a5ab-9d79c89056fa service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:29.344810 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8797a25c-2935-482e-a5ab-9d79c89056fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:29.345058 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1632bf22-989f-4f88-aa61-353d2908c289 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:29.347285 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-8797a25c-2935-482e-a5ab-9d79c89056fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:29.351763 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0db4e76-0ae4-4f1a-908b-ea593304db11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:29.352577 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0db4e76-0ae4-4f1a-908b-ea593304db11 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:29.352975 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0db4e76-0ae4-4f1a-908b-ea593304db11 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:29.353344 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0db4e76-0ae4-4f1a-908b-ea593304db11 admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:29.354283 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0db4e76-0ae4-4f1a-908b-ea593304db11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:29.356891 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0db4e76-0ae4-4f1a-908b-ea593304db11 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:29.366307 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8797a25c-2935-482e-a5ab-9d79c89056fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:29.368067 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8797a25c-2935-482e-a5ab-9d79c89056fa service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:29.383553 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3128/6287] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:34:29 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:34:29.385261 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d34e74-7f04-4feb-916f-11300fccaf3f None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:29.385769 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d34e74-7f04-4feb-916f-11300fccaf3f None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:29.386227 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d34e74-7f04-4feb-916f-11300fccaf3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:29.400663 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3160/6288] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:34:29 2022] POST /identity/v3/projects => generated 377 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:34:29.404831 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0db4e76-0ae4-4f1a-908b-ea593304db11 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:29.408613 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-a8d34e74-7f04-4feb-916f-11300fccaf3f None None] MFA Rules not processed for user `a34d714101a1439c83fea8ed7a1b86fd`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:34:29.410047 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-a8d34e74-7f04-4feb-916f-11300fccaf3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:29.415142 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:29.455147 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:29.532488 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.models.token_model [None req-a8d34e74-7f04-4feb-916f-11300fccaf3f None None] User a34d714101a1439c83fea8ed7a1b86fd has no access to project 984076ce7e814ab7a6dfb9d0b95d46c5 {{(pid=91547) _validate_project_scope /opt/stack/keystone/keystone/models/token_model.py:539}} Jul 23 21:34:29.541962 ncdv-master-1 devstack@keystone.service[91547]: WARNING keystone.server.flask.application [None req-a8d34e74-7f04-4feb-916f-11300fccaf3f None None] Authorization failed. The request you have made requires authentication. from 10.222.0.17: keystone.exception.Unauthorized: The request you have made requires authentication. Jul 23 21:34:29.549921 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3129/6289] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:34:29 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 166 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Jul 23 21:34:29.555774 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d34e74-7f04-4feb-916f-11300fccaf3f None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:29.614135 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0db4e76-0ae4-4f1a-908b-ea593304db11 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:29.629040 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deae6ded-8248-4a9d-8870-dae5e4a982b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:29.629959 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deae6ded-8248-4a9d-8870-dae5e4a982b3 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:29.630248 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deae6ded-8248-4a9d-8870-dae5e4a982b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:29.630527 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deae6ded-8248-4a9d-8870-dae5e4a982b3 admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:29.631241 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deae6ded-8248-4a9d-8870-dae5e4a982b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:29.636876 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deae6ded-8248-4a9d-8870-dae5e4a982b3 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:29.656811 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d34e74-7f04-4feb-916f-11300fccaf3f None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:29.667081 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f6acbb-30c6-44c4-bc6a-8ae534ec4a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:29.668946 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f6acbb-30c6-44c4-bc6a-8ae534ec4a63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:29.669437 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f6acbb-30c6-44c4-bc6a-8ae534ec4a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:29.670235 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f6acbb-30c6-44c4-bc6a-8ae534ec4a63 admin admin] PATH_INFO: `/v3/users/a34d714101a1439c83fea8ed7a1b86fd` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:29.671924 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f6acbb-30c6-44c4-bc6a-8ae534ec4a63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a34d714101a1439c83fea8ed7a1b86fd)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:29.675781 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f6acbb-30c6-44c4-bc6a-8ae534ec4a63 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:29.685040 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3161/6290] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:34:29 2022] POST /identity/v3/users => generated 289 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:34:29.690134 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deae6ded-8248-4a9d-8870-dae5e4a982b3 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:29.742847 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deae6ded-8248-4a9d-8870-dae5e4a982b3 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:29.774245 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783e88b9-0a5e-4272-9fd0-b78860d5e2e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:29.776645 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783e88b9-0a5e-4272-9fd0-b78860d5e2e8 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:29.778845 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783e88b9-0a5e-4272-9fd0-b78860d5e2e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:29.779705 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783e88b9-0a5e-4272-9fd0-b78860d5e2e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:29.781987 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783e88b9-0a5e-4272-9fd0-b78860d5e2e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:29.785607 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-e9f6acbb-30c6-44c4-bc6a-8ae534ec4a63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a34d714101a1439c83fea8ed7a1b86fd'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:29.793675 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783e88b9-0a5e-4272-9fd0-b78860d5e2e8 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:29.804361 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-e9f6acbb-30c6-44c4-bc6a-8ae534ec4a63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a34d714101a1439c83fea8ed7a1b86fd'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:29.806272 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-e9f6acbb-30c6-44c4-bc6a-8ae534ec4a63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a34d714101a1439c83fea8ed7a1b86fd'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:29.831869 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-e9f6acbb-30c6-44c4-bc6a-8ae534ec4a63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a34d714101a1439c83fea8ed7a1b86fd'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:29.837156 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3162/6291] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:34:29 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 21:34:29.837156 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783e88b9-0a5e-4272-9fd0-b78860d5e2e8 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:29.839173 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-783e88b9-0a5e-4272-9fd0-b78860d5e2e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:29.854551 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-e9f6acbb-30c6-44c4-bc6a-8ae534ec4a63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a34d714101a1439c83fea8ed7a1b86fd'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:29.863061 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783e88b9-0a5e-4272-9fd0-b78860d5e2e8 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:29.868644 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bca0f52-615e-40db-b837-8cdc0f4359e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:29.869701 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bca0f52-615e-40db-b837-8cdc0f4359e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:29.870766 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bca0f52-615e-40db-b837-8cdc0f4359e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:29.871182 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bca0f52-615e-40db-b837-8cdc0f4359e2 admin admin] PATH_INFO: `/v3/projects/ca2f781f289346149505ff184d564e1b` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:29.872449 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bca0f52-615e-40db-b837-8cdc0f4359e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca2f781f289346149505ff184d564e1b)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:29.875355 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bca0f52-615e-40db-b837-8cdc0f4359e2 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:29.880402 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3130/6292] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:34:29 2022] DELETE /identity/v3/users/a34d714101a1439c83fea8ed7a1b86fd => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:29.881628 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f6acbb-30c6-44c4-bc6a-8ae534ec4a63 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:29.888705 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-e9f6acbb-30c6-44c4-bc6a-8ae534ec4a63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:29.979304 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-9bca0f52-615e-40db-b837-8cdc0f4359e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca2f781f289346149505ff184d564e1b', 'request_id': 'req-9bca0f52-615e-40db-b837-8cdc0f4359e2'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:29.999900 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-9bca0f52-615e-40db-b837-8cdc0f4359e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca2f781f289346149505ff184d564e1b', 'request_id': 'req-9bca0f52-615e-40db-b837-8cdc0f4359e2'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:30.002230 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:30.007437 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-9bca0f52-615e-40db-b837-8cdc0f4359e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca2f781f289346149505ff184d564e1b', 'request_id': 'req-9bca0f52-615e-40db-b837-8cdc0f4359e2'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:30.034233 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-9bca0f52-615e-40db-b837-8cdc0f4359e2 admin admin] The token cache is being invalidate because project ca2f781f289346149505ff184d564e1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:34:30.034511 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-9bca0f52-615e-40db-b837-8cdc0f4359e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:30.035404 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-9bca0f52-615e-40db-b837-8cdc0f4359e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:30.038261 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3163/6293] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:34:29 2022] DELETE /identity/v3/projects/ca2f781f289346149505ff184d564e1b => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:30.039697 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a379b532-8041-467a-8ffb-839d0ce7275e None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:30.039982 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a379b532-8041-467a-8ffb-839d0ce7275e None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:30.040256 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a379b532-8041-467a-8ffb-839d0ce7275e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:30.044465 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f6acbb-30c6-44c4-bc6a-8ae534ec4a63 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:30.075529 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-a379b532-8041-467a-8ffb-839d0ce7275e None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:34:30.077992 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-a379b532-8041-467a-8ffb-839d0ce7275e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:30.161835 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3640b7-6a95-4829-ace1-e87590d4374b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:30.162148 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3640b7-6a95-4829-ace1-e87590d4374b admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:30.162237 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3640b7-6a95-4829-ace1-e87590d4374b admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:30.162447 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3640b7-6a95-4829-ace1-e87590d4374b admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:30.163190 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3640b7-6a95-4829-ace1-e87590d4374b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:30.166309 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3640b7-6a95-4829-ace1-e87590d4374b admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:30.183418 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3131/6294] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:34:29 2022] GET /identity/v3/roles => generated 1420 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:34:30.184298 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3640b7-6a95-4829-ace1-e87590d4374b admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:30.189334 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-ca3640b7-6a95-4829-ace1-e87590d4374b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:30.203061 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3164/6295] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:34:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:34:30.204100 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a379b532-8041-467a-8ffb-839d0ce7275e None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:30.204247 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3640b7-6a95-4829-ace1-e87590d4374b admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:30.205702 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-a379b532-8041-467a-8ffb-839d0ce7275e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:30.210180 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c955e2-2f36-4ce0-8dd3-3a3f457015b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:30.211116 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c955e2-2f36-4ce0-8dd3-3a3f457015b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:30.211447 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c955e2-2f36-4ce0-8dd3-3a3f457015b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:30.211789 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c955e2-2f36-4ce0-8dd3-3a3f457015b7 admin admin] PATH_INFO: `/v3/users/09dc53f57ec74aa9bbc8fe9be47d1f58` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:30.213000 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c955e2-2f36-4ce0-8dd3-3a3f457015b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=09dc53f57ec74aa9bbc8fe9be47d1f58)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:30.215007 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c955e2-2f36-4ce0-8dd3-3a3f457015b7 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:30.220492 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a379b532-8041-467a-8ffb-839d0ce7275e None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:30.226219 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86267d40-0bac-43dd-8da1-16cc4c0a4610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:30.227141 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86267d40-0bac-43dd-8da1-16cc4c0a4610 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:30.227425 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86267d40-0bac-43dd-8da1-16cc4c0a4610 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:30.227701 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86267d40-0bac-43dd-8da1-16cc4c0a4610 admin admin] PATH_INFO: `/v3/projects/e06b3f0da51d41ca8cf377c683f5698b/users/0b2f9e14e3c84bc9a8b2e3f0a35cf289/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:30.246257 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86267d40-0bac-43dd-8da1-16cc4c0a4610 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e06b3f0da51d41ca8cf377c683f5698b, user_id=0b2f9e14e3c84bc9a8b2e3f0a35cf289, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:30.250341 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86267d40-0bac-43dd-8da1-16cc4c0a4610 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:30.253159 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:30.276238 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3165/6296] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:34:30 2022] PUT /identity/v3/projects/e06b3f0da51d41ca8cf377c683f5698b/users/0b2f9e14e3c84bc9a8b2e3f0a35cf289/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:30.287044 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-15c955e2-2f36-4ce0-8dd3-3a3f457015b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09dc53f57ec74aa9bbc8fe9be47d1f58'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:30.293164 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86267d40-0bac-43dd-8da1-16cc4c0a4610 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:30.295538 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-86267d40-0bac-43dd-8da1-16cc4c0a4610 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:30.296644 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-15c955e2-2f36-4ce0-8dd3-3a3f457015b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09dc53f57ec74aa9bbc8fe9be47d1f58'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:30.297679 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-15c955e2-2f36-4ce0-8dd3-3a3f457015b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09dc53f57ec74aa9bbc8fe9be47d1f58'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:30.309329 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-15c955e2-2f36-4ce0-8dd3-3a3f457015b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09dc53f57ec74aa9bbc8fe9be47d1f58'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:30.327139 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-15c955e2-2f36-4ce0-8dd3-3a3f457015b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09dc53f57ec74aa9bbc8fe9be47d1f58'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:30.334381 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3132/6297] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:34:30 2022] DELETE /identity/v3/users/09dc53f57ec74aa9bbc8fe9be47d1f58 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:30.335710 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e057899-088b-41a1-b3a7-6350e861c996 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:30.335998 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e057899-088b-41a1-b3a7-6350e861c996 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:30.336275 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e057899-088b-41a1-b3a7-6350e861c996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:30.372513 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-8e057899-088b-41a1-b3a7-6350e861c996 None None] MFA Rules not processed for user `0b2f9e14e3c84bc9a8b2e3f0a35cf289`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:34:30.373671 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-8e057899-088b-41a1-b3a7-6350e861c996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:30.399120 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86267d40-0bac-43dd-8da1-16cc4c0a4610 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:30.431530 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:30.468176 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3133/6298] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:34:30 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:34:30.478825 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11af5714-dd3a-45af-bc88-9e20fc3cbe40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:30.479586 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11af5714-dd3a-45af-bc88-9e20fc3cbe40 service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:30.479957 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11af5714-dd3a-45af-bc88-9e20fc3cbe40 service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:30.480238 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11af5714-dd3a-45af-bc88-9e20fc3cbe40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:30.482154 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-11af5714-dd3a-45af-bc88-9e20fc3cbe40 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:30.483961 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e057899-088b-41a1-b3a7-6350e861c996 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:30.486515 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-8e057899-088b-41a1-b3a7-6350e861c996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:30.581040 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11af5714-dd3a-45af-bc88-9e20fc3cbe40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:30.582727 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11af5714-dd3a-45af-bc88-9e20fc3cbe40 service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:30.595058 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3166/6299] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:34:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:34:30.609337 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e057899-088b-41a1-b3a7-6350e861c996 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:30.613209 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c90bdd-a29a-475a-b457-dbfa874653d2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7f2db148c8e4d5d81431cae3576434b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:30.614169 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c90bdd-a29a-475a-b457-dbfa874653d2 service glance] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:30.614548 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c90bdd-a29a-475a-b457-dbfa874653d2 service glance] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:30.614823 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c90bdd-a29a-475a-b457-dbfa874653d2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:30.616637 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-d7c90bdd-a29a-475a-b457-dbfa874653d2 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:30.752827 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c90bdd-a29a-475a-b457-dbfa874653d2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:30.754563 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c90bdd-a29a-475a-b457-dbfa874653d2 service glance] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:30.768304 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3134/6300] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:34:30 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 23 21:34:30.965067 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc34d1ca-ef1c-4ab1-aad7-bdcb84aee550 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:30.966212 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc34d1ca-ef1c-4ab1-aad7-bdcb84aee550 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:30.966637 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc34d1ca-ef1c-4ab1-aad7-bdcb84aee550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:30.987216 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-bc34d1ca-ef1c-4ab1-aad7-bdcb84aee550 None None] MFA Rules not processed for user `17b779a3e21a415bb42cde5d6863d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:34:30.988451 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-bc34d1ca-ef1c-4ab1-aad7-bdcb84aee550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:31.032330 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c90bdd-a29a-475a-b457-dbfa874653d2 service glance] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:31.034092 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-d7c90bdd-a29a-475a-b457-dbfa874653d2 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:31.065020 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c90bdd-a29a-475a-b457-dbfa874653d2 service glance] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:31.082637 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff06f10a-b880-49b3-86be-eff1f832bb23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:31.085183 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff06f10a-b880-49b3-86be-eff1f832bb23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:31.086079 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff06f10a-b880-49b3-86be-eff1f832bb23 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:31.086369 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff06f10a-b880-49b3-86be-eff1f832bb23 admin admin] PATH_INFO: `/v3/projects/72d64c19d9f74f349c0624e38d6e9456` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:31.089641 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff06f10a-b880-49b3-86be-eff1f832bb23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=72d64c19d9f74f349c0624e38d6e9456)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:31.095678 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff06f10a-b880-49b3-86be-eff1f832bb23 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:31.116965 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3167/6301] 10.222.0.17 () {58 vars in 1009 bytes} [Sat Jul 23 21:34:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:34:31.135469 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc34d1ca-ef1c-4ab1-aad7-bdcb84aee550 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:31.137249 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-bc34d1ca-ef1c-4ab1-aad7-bdcb84aee550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:31.147679 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:31.194529 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-ff06f10a-b880-49b3-86be-eff1f832bb23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72d64c19d9f74f349c0624e38d6e9456', 'request_id': 'req-ff06f10a-b880-49b3-86be-eff1f832bb23'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:31.205369 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-ff06f10a-b880-49b3-86be-eff1f832bb23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72d64c19d9f74f349c0624e38d6e9456', 'request_id': 'req-ff06f10a-b880-49b3-86be-eff1f832bb23'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:31.213662 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-ff06f10a-b880-49b3-86be-eff1f832bb23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72d64c19d9f74f349c0624e38d6e9456', 'request_id': 'req-ff06f10a-b880-49b3-86be-eff1f832bb23'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:31.231185 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-ff06f10a-b880-49b3-86be-eff1f832bb23 admin admin] The token cache is being invalidate because project 72d64c19d9f74f349c0624e38d6e9456 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:34:31.231585 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-ff06f10a-b880-49b3-86be-eff1f832bb23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:31.232516 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-ff06f10a-b880-49b3-86be-eff1f832bb23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:31.234629 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3135/6302] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:34:31 2022] DELETE /identity/v3/projects/72d64c19d9f74f349c0624e38d6e9456 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:31.240036 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dba36e-198f-4b9c-a12d-aaeadbda2a5a None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:31.240338 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dba36e-198f-4b9c-a12d-aaeadbda2a5a None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:31.240608 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dba36e-198f-4b9c-a12d-aaeadbda2a5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:31.268419 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc34d1ca-ef1c-4ab1-aad7-bdcb84aee550 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:31.284007 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-54dba36e-198f-4b9c-a12d-aaeadbda2a5a None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:34:31.286510 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-54dba36e-198f-4b9c-a12d-aaeadbda2a5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:31.320389 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:31.388158 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b894d3bb-e71a-45a7-8692-691dcf26460e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f0a685b7da46afb81024848f079d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:31.389267 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b894d3bb-e71a-45a7-8692-691dcf26460e service swift] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:31.389729 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b894d3bb-e71a-45a7-8692-691dcf26460e service swift] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:31.390692 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b894d3bb-e71a-45a7-8692-691dcf26460e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:31.394089 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-b894d3bb-e71a-45a7-8692-691dcf26460e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:31.402436 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3136/6303] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:34:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:34:31.421046 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845e261e-9756-4bf1-b387-6e60b3fdf7a7 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:31.421349 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845e261e-9756-4bf1-b387-6e60b3fdf7a7 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:31.421616 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845e261e-9756-4bf1-b387-6e60b3fdf7a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:31.452074 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-845e261e-9756-4bf1-b387-6e60b3fdf7a7 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:34:31.453350 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-845e261e-9756-4bf1-b387-6e60b3fdf7a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:31.474707 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3137/6304] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:34:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:34:31.477811 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845e261e-9756-4bf1-b387-6e60b3fdf7a7 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:31.481115 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-845e261e-9756-4bf1-b387-6e60b3fdf7a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:31.510528 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845e261e-9756-4bf1-b387-6e60b3fdf7a7 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:31.527446 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0099312b-c143-451e-930a-d97f12b18e71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:31.528524 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0099312b-c143-451e-930a-d97f12b18e71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:31.529339 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0099312b-c143-451e-930a-d97f12b18e71 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:31.529339 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0099312b-c143-451e-930a-d97f12b18e71 admin admin] PATH_INFO: `/v3/projects/31b598de1e444d1b9fb43bc5126ca64c` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:31.530987 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0099312b-c143-451e-930a-d97f12b18e71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=31b598de1e444d1b9fb43bc5126ca64c)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:31.534993 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0099312b-c143-451e-930a-d97f12b18e71 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:31.570971 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b894d3bb-e71a-45a7-8692-691dcf26460e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:31.573286 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b894d3bb-e71a-45a7-8692-691dcf26460e service swift] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:31.614075 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3168/6305] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 23 21:34:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 23 21:34:31.615978 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b894d3bb-e71a-45a7-8692-691dcf26460e service swift] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:31.639007 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b894d3bb-e71a-45a7-8692-691dcf26460e service swift] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:31.646587 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-0099312b-c143-451e-930a-d97f12b18e71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31b598de1e444d1b9fb43bc5126ca64c', 'request_id': 'req-0099312b-c143-451e-930a-d97f12b18e71'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:31.660554 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-0099312b-c143-451e-930a-d97f12b18e71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31b598de1e444d1b9fb43bc5126ca64c', 'request_id': 'req-0099312b-c143-451e-930a-d97f12b18e71'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:31.676181 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-0099312b-c143-451e-930a-d97f12b18e71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31b598de1e444d1b9fb43bc5126ca64c', 'request_id': 'req-0099312b-c143-451e-930a-d97f12b18e71'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:31.700883 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-0099312b-c143-451e-930a-d97f12b18e71 admin admin] The token cache is being invalidate because project 31b598de1e444d1b9fb43bc5126ca64c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:34:31.701192 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-0099312b-c143-451e-930a-d97f12b18e71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:31.702865 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-0099312b-c143-451e-930a-d97f12b18e71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:31.705354 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3138/6306] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:34:31 2022] DELETE /identity/v3/projects/31b598de1e444d1b9fb43bc5126ca64c => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:31.709799 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0099312b-c143-451e-930a-d97f12b18e71 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:31.712802 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-0099312b-c143-451e-930a-d97f12b18e71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:31.764110 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:31.784464 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2deb4b3-8f7e-43d8-8392-0ecd4923b114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:31.786030 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2deb4b3-8f7e-43d8-8392-0ecd4923b114 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:31.786642 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2deb4b3-8f7e-43d8-8392-0ecd4923b114 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:31.787195 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2deb4b3-8f7e-43d8-8392-0ecd4923b114 admin admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:31.788093 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2deb4b3-8f7e-43d8-8392-0ecd4923b114 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:34:31.788556 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2deb4b3-8f7e-43d8-8392-0ecd4923b114 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:31.790719 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2deb4b3-8f7e-43d8-8392-0ecd4923b114 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:31.812276 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3169/6307] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:34:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:34:31.814374 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2deb4b3-8f7e-43d8-8392-0ecd4923b114 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:31.818164 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-c2deb4b3-8f7e-43d8-8392-0ecd4923b114 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:31.834343 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0099312b-c143-451e-930a-d97f12b18e71 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:31.844148 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2deb4b3-8f7e-43d8-8392-0ecd4923b114 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:31.846729 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afb74e3-f002-4a65-95de-9835db2cb037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:31.847910 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afb74e3-f002-4a65-95de-9835db2cb037 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:31.848197 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afb74e3-f002-4a65-95de-9835db2cb037 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:31.848471 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afb74e3-f002-4a65-95de-9835db2cb037 admin admin] PATH_INFO: `/v3/users/f650b24ade1f4e53ae00a78fed2e8eeb` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:31.852098 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5b56bf-ccdf-4d50-b8f8-b0c0a8e7300a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:31.852513 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afb74e3-f002-4a65-95de-9835db2cb037 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f650b24ade1f4e53ae00a78fed2e8eeb)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:31.852991 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5b56bf-ccdf-4d50-b8f8-b0c0a8e7300a admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:31.853396 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5b56bf-ccdf-4d50-b8f8-b0c0a8e7300a admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:31.853783 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5b56bf-ccdf-4d50-b8f8-b0c0a8e7300a admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:31.854519 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afb74e3-f002-4a65-95de-9835db2cb037 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:31.854687 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5b56bf-ccdf-4d50-b8f8-b0c0a8e7300a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:31.858087 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5b56bf-ccdf-4d50-b8f8-b0c0a8e7300a admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:31.900983 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3170/6308] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:34:31 2022] POST /identity/v3/projects => generated 407 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:34:31.902049 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5b56bf-ccdf-4d50-b8f8-b0c0a8e7300a admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:31.903801 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-3d5b56bf-ccdf-4d50-b8f8-b0c0a8e7300a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:31.936781 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:31.947201 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-3afb74e3-f002-4a65-95de-9835db2cb037 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f650b24ade1f4e53ae00a78fed2e8eeb'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:31.965131 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-3afb74e3-f002-4a65-95de-9835db2cb037 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f650b24ade1f4e53ae00a78fed2e8eeb'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:31.966096 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-3afb74e3-f002-4a65-95de-9835db2cb037 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f650b24ade1f4e53ae00a78fed2e8eeb'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:31.984248 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-3afb74e3-f002-4a65-95de-9835db2cb037 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f650b24ade1f4e53ae00a78fed2e8eeb'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:32.003887 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-3afb74e3-f002-4a65-95de-9835db2cb037 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f650b24ade1f4e53ae00a78fed2e8eeb'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:32.027217 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3139/6309] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:34:31 2022] DELETE /identity/v3/users/f650b24ade1f4e53ae00a78fed2e8eeb => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:32.028339 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afb74e3-f002-4a65-95de-9835db2cb037 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:32.033855 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-3afb74e3-f002-4a65-95de-9835db2cb037 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:32.146371 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5b56bf-ccdf-4d50-b8f8-b0c0a8e7300a admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:32.197341 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afb74e3-f002-4a65-95de-9835db2cb037 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:32.202767 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b09af8b-11b1-41e9-aef6-75e1995ad57e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:32.207390 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b09af8b-11b1-41e9-aef6-75e1995ad57e admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:32.207697 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b09af8b-11b1-41e9-aef6-75e1995ad57e admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:32.207976 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b09af8b-11b1-41e9-aef6-75e1995ad57e admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:32.208947 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b09af8b-11b1-41e9-aef6-75e1995ad57e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:32.211070 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b09af8b-11b1-41e9-aef6-75e1995ad57e admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:32.264308 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3140/6310] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:34:32 2022] POST /identity/v3/users => generated 304 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:34:32.266140 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bcc254-c338-483f-b0d9-240b67d41152 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7f2db148c8e4d5d81431cae3576434b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:32.268534 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bcc254-c338-483f-b0d9-240b67d41152 service glance] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:32.269179 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b09af8b-11b1-41e9-aef6-75e1995ad57e admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:32.270073 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bcc254-c338-483f-b0d9-240b67d41152 service glance] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:32.270945 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bcc254-c338-483f-b0d9-240b67d41152 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:32.277689 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-79bcc254-c338-483f-b0d9-240b67d41152 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:32.290394 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b09af8b-11b1-41e9-aef6-75e1995ad57e admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:32.309275 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2391ac9c-cd10-4ec5-b026-74147c6b59be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:32.310020 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2391ac9c-cd10-4ec5-b026-74147c6b59be admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:32.310311 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2391ac9c-cd10-4ec5-b026-74147c6b59be admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:32.310598 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2391ac9c-cd10-4ec5-b026-74147c6b59be admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:32.311347 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2391ac9c-cd10-4ec5-b026-74147c6b59be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:32.312995 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2391ac9c-cd10-4ec5-b026-74147c6b59be admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:32.327490 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3141/6311] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:34:32 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:34:32.332638 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2391ac9c-cd10-4ec5-b026-74147c6b59be admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:32.371242 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2391ac9c-cd10-4ec5-b026-74147c6b59be admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:32.383222 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49ad8a7-52c1-4a8a-9f09-6dc2aaa27159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:32.383933 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49ad8a7-52c1-4a8a-9f09-6dc2aaa27159 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:32.384353 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49ad8a7-52c1-4a8a-9f09-6dc2aaa27159 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:32.384461 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49ad8a7-52c1-4a8a-9f09-6dc2aaa27159 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:32.385245 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49ad8a7-52c1-4a8a-9f09-6dc2aaa27159 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:32.386861 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49ad8a7-52c1-4a8a-9f09-6dc2aaa27159 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:32.414227 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3142/6312] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:34:32 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:34:32.421006 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49ad8a7-52c1-4a8a-9f09-6dc2aaa27159 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:32.431701 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bcc254-c338-483f-b0d9-240b67d41152 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:32.433175 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bcc254-c338-483f-b0d9-240b67d41152 service glance] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:32.443432 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49ad8a7-52c1-4a8a-9f09-6dc2aaa27159 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:32.455424 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c088ac1f-a91a-4149-b78e-1d5760733dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:32.456341 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c088ac1f-a91a-4149-b78e-1d5760733dad admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:32.459948 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3171/6313] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:34:31 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 558 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:34:32.460309 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c088ac1f-a91a-4149-b78e-1d5760733dad admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:32.469176 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c088ac1f-a91a-4149-b78e-1d5760733dad admin admin] PATH_INFO: `/v3/projects/2171da48188747b88033b7148304cbe3/users/6f37216382024474a012fc0fbf310723/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:32.522521 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c088ac1f-a91a-4149-b78e-1d5760733dad admin admin] RBAC: Authorizing `identity:create_grant(project_id=2171da48188747b88033b7148304cbe3, user_id=6f37216382024474a012fc0fbf310723, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:32.526868 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c088ac1f-a91a-4149-b78e-1d5760733dad admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:32.560336 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3143/6314] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:34:32 2022] PUT /identity/v3/projects/2171da48188747b88033b7148304cbe3/users/6f37216382024474a012fc0fbf310723/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:32.575502 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aef5a65-e32a-40da-ba72-45bf68076aba None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:32.575502 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aef5a65-e32a-40da-ba72-45bf68076aba None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:32.580523 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aef5a65-e32a-40da-ba72-45bf68076aba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:32.643106 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-5aef5a65-e32a-40da-ba72-45bf68076aba None None] MFA Rules not processed for user `6f37216382024474a012fc0fbf310723`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:34:32.646034 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-5aef5a65-e32a-40da-ba72-45bf68076aba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:32.651205 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6ad70c-bc15-462c-b7c7-90e27b09d4da None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:32.651699 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6ad70c-bc15-462c-b7c7-90e27b09d4da None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:32.651807 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6ad70c-bc15-462c-b7c7-90e27b09d4da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:32.692613 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:32.694444 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-fb6ad70c-bc15-462c-b7c7-90e27b09d4da None None] MFA Rules not processed for user `17b779a3e21a415bb42cde5d6863d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:34:32.695897 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-fb6ad70c-bc15-462c-b7c7-90e27b09d4da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:32.846105 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3172/6315] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:34:32 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:34:32.855153 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aef5a65-e32a-40da-ba72-45bf68076aba None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:32.865101 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3144/6316] 10.222.0.17 () {58 vars in 967 bytes} [Sat Jul 23 21:34:32 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:34:32.886739 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6ad70c-bc15-462c-b7c7-90e27b09d4da None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:32.888282 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-fb6ad70c-bc15-462c-b7c7-90e27b09d4da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:32.907418 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:DELETE=4,keystone:SELECT=91,keystone:INSERT=5 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:32.986275 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aef5a65-e32a-40da-ba72-45bf68076aba None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:32.998244 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240e60c0-91ff-485d-91d3-59c06a654bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:32.999377 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240e60c0-91ff-485d-91d3-59c06a654bab admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:33.006736 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240e60c0-91ff-485d-91d3-59c06a654bab admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:33.009385 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240e60c0-91ff-485d-91d3-59c06a654bab admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:33.010369 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240e60c0-91ff-485d-91d3-59c06a654bab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:33.013351 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240e60c0-91ff-485d-91d3-59c06a654bab admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:33.067070 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6ad70c-bc15-462c-b7c7-90e27b09d4da None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:33.075321 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691f4a8c-d632-47bb-b316-6f0c1cabb065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:33.076446 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691f4a8c-d632-47bb-b316-6f0c1cabb065 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:33.076914 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691f4a8c-d632-47bb-b316-6f0c1cabb065 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:33.077326 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691f4a8c-d632-47bb-b316-6f0c1cabb065 admin admin] PATH_INFO: `/v3/projects/984076ce7e814ab7a6dfb9d0b95d46c5` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:33.079327 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691f4a8c-d632-47bb-b316-6f0c1cabb065 admin admin] RBAC: Authorizing `identity:delete_project(project_id=984076ce7e814ab7a6dfb9d0b95d46c5)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:33.081676 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691f4a8c-d632-47bb-b316-6f0c1cabb065 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:33.117429 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3173/6317] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:34:32 2022] POST /identity/v3/projects => generated 405 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:34:33.117429 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240e60c0-91ff-485d-91d3-59c06a654bab admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:33.122970 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-240e60c0-91ff-485d-91d3-59c06a654bab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:33.164503 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-691f4a8c-d632-47bb-b316-6f0c1cabb065 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '984076ce7e814ab7a6dfb9d0b95d46c5', 'request_id': 'req-691f4a8c-d632-47bb-b316-6f0c1cabb065'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:33.176093 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-691f4a8c-d632-47bb-b316-6f0c1cabb065 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '984076ce7e814ab7a6dfb9d0b95d46c5', 'request_id': 'req-691f4a8c-d632-47bb-b316-6f0c1cabb065'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:33.184143 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-691f4a8c-d632-47bb-b316-6f0c1cabb065 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '984076ce7e814ab7a6dfb9d0b95d46c5', 'request_id': 'req-691f4a8c-d632-47bb-b316-6f0c1cabb065'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:33.198663 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-691f4a8c-d632-47bb-b316-6f0c1cabb065 admin admin] The token cache is being invalidate because project 984076ce7e814ab7a6dfb9d0b95d46c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:34:33.198850 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-691f4a8c-d632-47bb-b316-6f0c1cabb065 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:33.199520 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-691f4a8c-d632-47bb-b316-6f0c1cabb065 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:33.201298 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3145/6318] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:34:32 2022] DELETE /identity/v3/projects/984076ce7e814ab7a6dfb9d0b95d46c5 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:33.212266 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691f4a8c-d632-47bb-b316-6f0c1cabb065 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:33.213822 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-691f4a8c-d632-47bb-b316-6f0c1cabb065 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:33.234208 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240e60c0-91ff-485d-91d3-59c06a654bab admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:33.295991 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:33.307753 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691f4a8c-d632-47bb-b316-6f0c1cabb065 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:33.312870 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9856619d-bf0a-44d6-805e-2113e50b98d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:33.314042 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de667076-80d3-4436-b2a5-b862b6fdf8e2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f0a685b7da46afb81024848f079d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:33.314150 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9856619d-bf0a-44d6-805e-2113e50b98d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:33.314572 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9856619d-bf0a-44d6-805e-2113e50b98d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:33.314684 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de667076-80d3-4436-b2a5-b862b6fdf8e2 service swift] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:33.314844 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9856619d-bf0a-44d6-805e-2113e50b98d8 admin admin] PATH_INFO: `/v3/users/bc4aa131e63349b2aa8f37fdf6d2fe00` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:33.314958 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de667076-80d3-4436-b2a5-b862b6fdf8e2 service swift] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:33.315218 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de667076-80d3-4436-b2a5-b862b6fdf8e2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:33.316084 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9856619d-bf0a-44d6-805e-2113e50b98d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc4aa131e63349b2aa8f37fdf6d2fe00)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:33.318334 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9856619d-bf0a-44d6-805e-2113e50b98d8 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:33.325171 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-de667076-80d3-4436-b2a5-b862b6fdf8e2 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:33.371053 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:33.379930 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-9856619d-bf0a-44d6-805e-2113e50b98d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc4aa131e63349b2aa8f37fdf6d2fe00'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:33.390238 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-9856619d-bf0a-44d6-805e-2113e50b98d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc4aa131e63349b2aa8f37fdf6d2fe00'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:33.391488 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-9856619d-bf0a-44d6-805e-2113e50b98d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc4aa131e63349b2aa8f37fdf6d2fe00'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:33.400898 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-9856619d-bf0a-44d6-805e-2113e50b98d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc4aa131e63349b2aa8f37fdf6d2fe00'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:33.402749 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de667076-80d3-4436-b2a5-b862b6fdf8e2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:33.405392 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de667076-80d3-4436-b2a5-b862b6fdf8e2 service swift] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:33.415152 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-9856619d-bf0a-44d6-805e-2113e50b98d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc4aa131e63349b2aa8f37fdf6d2fe00'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:33.415408 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3174/6319] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 23 21:34:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 23 21:34:33.418786 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de667076-80d3-4436-b2a5-b862b6fdf8e2 service swift] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:33.420669 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-de667076-80d3-4436-b2a5-b862b6fdf8e2 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:33.434463 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3146/6320] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:34:33 2022] DELETE /identity/v3/users/bc4aa131e63349b2aa8f37fdf6d2fe00 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:33.436048 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758316a4-bcd4-4c6a-a827-dcfdd0ecd280 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:33.436334 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758316a4-bcd4-4c6a-a827-dcfdd0ecd280 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:33.436610 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758316a4-bcd4-4c6a-a827-dcfdd0ecd280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:33.438281 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de667076-80d3-4436-b2a5-b862b6fdf8e2 service swift] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:33.488780 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-758316a4-bcd4-4c6a-a827-dcfdd0ecd280 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:34:33.490289 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-758316a4-bcd4-4c6a-a827-dcfdd0ecd280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:33.541106 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6ebbcb-03a3-4863-85bb-4acad2ea0c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:33.543164 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6ebbcb-03a3-4863-85bb-4acad2ea0c6e admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:33.543743 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6ebbcb-03a3-4863-85bb-4acad2ea0c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:33.544934 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6ebbcb-03a3-4863-85bb-4acad2ea0c6e admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:33.546696 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6ebbcb-03a3-4863-85bb-4acad2ea0c6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:33.549020 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6ebbcb-03a3-4863-85bb-4acad2ea0c6e admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:33.570429 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3147/6321] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:34:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:34:33.578381 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3175/6322] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:34:33 2022] POST /identity/v3/users => generated 309 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:34:33.580170 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aaf3b6-7c61-4b5b-8248-00805535e5f0 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:33.581111 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aaf3b6-7c61-4b5b-8248-00805535e5f0 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:33.581693 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aaf3b6-7c61-4b5b-8248-00805535e5f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:33.582731 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6ebbcb-03a3-4863-85bb-4acad2ea0c6e admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:33.588838 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-da6ebbcb-03a3-4863-85bb-4acad2ea0c6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:33.610529 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6ebbcb-03a3-4863-85bb-4acad2ea0c6e admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:33.615748 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97035b6f-b56a-448a-8a0e-769a114db996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:33.616653 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97035b6f-b56a-448a-8a0e-769a114db996 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:33.617063 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-b1aaf3b6-7c61-4b5b-8248-00805535e5f0 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:34:33.617262 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97035b6f-b56a-448a-8a0e-769a114db996 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:33.617688 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97035b6f-b56a-448a-8a0e-769a114db996 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:33.618375 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-b1aaf3b6-7c61-4b5b-8248-00805535e5f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:33.618963 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97035b6f-b56a-448a-8a0e-769a114db996 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:33.621003 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97035b6f-b56a-448a-8a0e-769a114db996 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:33.629463 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3148/6323] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:34:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:34:33.630602 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1aaf3b6-7c61-4b5b-8248-00805535e5f0 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:33.636492 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-b1aaf3b6-7c61-4b5b-8248-00805535e5f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:33.637154 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3176/6324] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:34:33 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:34:33.638303 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97035b6f-b56a-448a-8a0e-769a114db996 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:33.650426 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97035b6f-b56a-448a-8a0e-769a114db996 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:33.650630 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1aaf3b6-7c61-4b5b-8248-00805535e5f0 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:33.658173 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9512008f-564a-4760-abce-d2034d4525b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:33.658580 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0e3fd5-41ab-426f-aa7a-c63a7b159510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:33.659970 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9512008f-564a-4760-abce-d2034d4525b6 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:33.660092 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0e3fd5-41ab-426f-aa7a-c63a7b159510 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:33.660384 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0e3fd5-41ab-426f-aa7a-c63a7b159510 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:33.660660 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0e3fd5-41ab-426f-aa7a-c63a7b159510 admin admin] PATH_INFO: `/v3/users/c560c0afd9cd4661855d1d45796509fa` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:33.661002 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9512008f-564a-4760-abce-d2034d4525b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:33.661512 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9512008f-564a-4760-abce-d2034d4525b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:33.662289 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0e3fd5-41ab-426f-aa7a-c63a7b159510 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c560c0afd9cd4661855d1d45796509fa)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:33.662834 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9512008f-564a-4760-abce-d2034d4525b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:34:33.664015 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9512008f-564a-4760-abce-d2034d4525b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:33.664970 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0e3fd5-41ab-426f-aa7a-c63a7b159510 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:33.667667 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9512008f-564a-4760-abce-d2034d4525b6 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:33.683963 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3177/6325] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:34:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:34:33.685083 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9512008f-564a-4760-abce-d2034d4525b6 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:33.700176 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9512008f-564a-4760-abce-d2034d4525b6 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:33.706598 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee18689-81b6-4db7-889d-4704841f72d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:33.707514 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee18689-81b6-4db7-889d-4704841f72d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:33.707790 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee18689-81b6-4db7-889d-4704841f72d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:33.708105 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee18689-81b6-4db7-889d-4704841f72d2 admin admin] PATH_INFO: `/v3/projects/3322852c2a7248e9a4c0ba3eb1684cbb/users/c273890567f648c5b8e335b15d4b1c70/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:33.736167 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee18689-81b6-4db7-889d-4704841f72d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3322852c2a7248e9a4c0ba3eb1684cbb, user_id=c273890567f648c5b8e335b15d4b1c70, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:33.738903 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee18689-81b6-4db7-889d-4704841f72d2 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:33.741138 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-7f0e3fd5-41ab-426f-aa7a-c63a7b159510 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c560c0afd9cd4661855d1d45796509fa'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:33.750356 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-7f0e3fd5-41ab-426f-aa7a-c63a7b159510 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c560c0afd9cd4661855d1d45796509fa'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:33.751482 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-7f0e3fd5-41ab-426f-aa7a-c63a7b159510 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c560c0afd9cd4661855d1d45796509fa'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:33.760536 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-7f0e3fd5-41ab-426f-aa7a-c63a7b159510 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c560c0afd9cd4661855d1d45796509fa'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:33.765340 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3178/6326] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:34:33 2022] PUT /identity/v3/projects/3322852c2a7248e9a4c0ba3eb1684cbb/users/c273890567f648c5b8e335b15d4b1c70/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:33.766488 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee18689-81b6-4db7-889d-4704841f72d2 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:33.768370 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-7ee18689-81b6-4db7-889d-4704841f72d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:33.776490 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-7f0e3fd5-41ab-426f-aa7a-c63a7b159510 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c560c0afd9cd4661855d1d45796509fa'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:33.786032 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3149/6327] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:34:33 2022] DELETE /identity/v3/users/c560c0afd9cd4661855d1d45796509fa => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:33.787674 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0e3fd5-41ab-426f-aa7a-c63a7b159510 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:33.789491 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-7f0e3fd5-41ab-426f-aa7a-c63a7b159510 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:33.822578 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:33.832297 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:33.873356 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee18689-81b6-4db7-889d-4704841f72d2 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:33.879258 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cb5676-fbd2-410d-809f-59319cafeabc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:33.879831 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0e3fd5-41ab-426f-aa7a-c63a7b159510 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:33.880225 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cb5676-fbd2-410d-809f-59319cafeabc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:33.880512 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cb5676-fbd2-410d-809f-59319cafeabc admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:33.880794 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cb5676-fbd2-410d-809f-59319cafeabc admin admin] PATH_INFO: `/v3/projects/6bc1475019924837a8be47347f6bbd75` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:33.882259 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cb5676-fbd2-410d-809f-59319cafeabc admin admin] RBAC: Authorizing `identity:delete_project(project_id=6bc1475019924837a8be47347f6bbd75)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:33.884451 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cb5676-fbd2-410d-809f-59319cafeabc admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:33.885426 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383b1fde-ddd5-4e72-9348-bb3d3fb0c01c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:33.887043 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383b1fde-ddd5-4e72-9348-bb3d3fb0c01c admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:33.887635 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383b1fde-ddd5-4e72-9348-bb3d3fb0c01c admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:33.888431 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383b1fde-ddd5-4e72-9348-bb3d3fb0c01c admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:33.889056 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383b1fde-ddd5-4e72-9348-bb3d3fb0c01c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:33.891601 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383b1fde-ddd5-4e72-9348-bb3d3fb0c01c admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:33.931596 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3150/6328] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:34:33 2022] POST /identity/v3/projects => generated 373 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:34:33.932557 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383b1fde-ddd5-4e72-9348-bb3d3fb0c01c admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:33.934503 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-383b1fde-ddd5-4e72-9348-bb3d3fb0c01c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:33.950959 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-22cb5676-fbd2-410d-809f-59319cafeabc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6bc1475019924837a8be47347f6bbd75', 'request_id': 'req-22cb5676-fbd2-410d-809f-59319cafeabc'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:33.962147 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-22cb5676-fbd2-410d-809f-59319cafeabc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6bc1475019924837a8be47347f6bbd75', 'request_id': 'req-22cb5676-fbd2-410d-809f-59319cafeabc'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:33.969727 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-22cb5676-fbd2-410d-809f-59319cafeabc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6bc1475019924837a8be47347f6bbd75', 'request_id': 'req-22cb5676-fbd2-410d-809f-59319cafeabc'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:33.985569 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-22cb5676-fbd2-410d-809f-59319cafeabc admin admin] The token cache is being invalidate because project 6bc1475019924837a8be47347f6bbd75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:34:33.986184 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-22cb5676-fbd2-410d-809f-59319cafeabc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:33.987415 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-22cb5676-fbd2-410d-809f-59319cafeabc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:33.990425 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3179/6329] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:34:33 2022] DELETE /identity/v3/projects/6bc1475019924837a8be47347f6bbd75 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:33.992761 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68751c5e-9b17-41e7-a88b-8d9892af55da None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:33.993504 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68751c5e-9b17-41e7-a88b-8d9892af55da None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:33.994154 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68751c5e-9b17-41e7-a88b-8d9892af55da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:34.015402 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-68751c5e-9b17-41e7-a88b-8d9892af55da None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:34:34.016990 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-68751c5e-9b17-41e7-a88b-8d9892af55da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:34.037797 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383b1fde-ddd5-4e72-9348-bb3d3fb0c01c admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:34.091747 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3180/6330] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:34:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:34:34.092966 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68751c5e-9b17-41e7-a88b-8d9892af55da None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:34.094839 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-68751c5e-9b17-41e7-a88b-8d9892af55da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:34.109762 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68751c5e-9b17-41e7-a88b-8d9892af55da None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:34.116031 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373a8eff-1c75-400d-bc4b-b9ccada0a700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:34.117237 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373a8eff-1c75-400d-bc4b-b9ccada0a700 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:34.117683 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373a8eff-1c75-400d-bc4b-b9ccada0a700 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:34.118151 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373a8eff-1c75-400d-bc4b-b9ccada0a700 admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:34.118495 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5eca61-01f3-4158-a68f-b593a7ea76e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:34.119228 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373a8eff-1c75-400d-bc4b-b9ccada0a700 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:34.119356 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5eca61-01f3-4158-a68f-b593a7ea76e0 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:34.119516 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5eca61-01f3-4158-a68f-b593a7ea76e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:34.119797 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5eca61-01f3-4158-a68f-b593a7ea76e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:34.120540 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5eca61-01f3-4158-a68f-b593a7ea76e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:34.122423 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5eca61-01f3-4158-a68f-b593a7ea76e0 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:34.122795 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373a8eff-1c75-400d-bc4b-b9ccada0a700 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:34.138412 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3151/6331] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:34:33 2022] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:34:34.138412 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad11c397-94dd-4cfc-ab2a-44ee5ca4a0e3 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:34.138726 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad11c397-94dd-4cfc-ab2a-44ee5ca4a0e3 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:34.138849 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad11c397-94dd-4cfc-ab2a-44ee5ca4a0e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:34.159486 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3181/6332] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:34:34 2022] POST /identity/v3/users => generated 287 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:34:34.159486 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373a8eff-1c75-400d-bc4b-b9ccada0a700 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:34.161700 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-373a8eff-1c75-400d-bc4b-b9ccada0a700 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:34.167405 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-ad11c397-94dd-4cfc-ab2a-44ee5ca4a0e3 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:34:34.169327 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-ad11c397-94dd-4cfc-ab2a-44ee5ca4a0e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:34.187673 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3152/6333] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:34:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:34:34.188486 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad11c397-94dd-4cfc-ab2a-44ee5ca4a0e3 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:34.191269 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-ad11c397-94dd-4cfc-ab2a-44ee5ca4a0e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:34.213778 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad11c397-94dd-4cfc-ab2a-44ee5ca4a0e3 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:34.219564 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92574200-86ae-497a-a62a-480812da48ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:34.220629 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92574200-86ae-497a-a62a-480812da48ec admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:34.220908 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92574200-86ae-497a-a62a-480812da48ec admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:34.221182 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92574200-86ae-497a-a62a-480812da48ec admin admin] PATH_INFO: `/v3/projects/3322852c2a7248e9a4c0ba3eb1684cbb/users/c273890567f648c5b8e335b15d4b1c70/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:34.223959 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:34.224894 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92574200-86ae-497a-a62a-480812da48ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=3322852c2a7248e9a4c0ba3eb1684cbb, user_id=c273890567f648c5b8e335b15d4b1c70, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:34.228218 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92574200-86ae-497a-a62a-480812da48ec admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:34.242247 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373a8eff-1c75-400d-bc4b-b9ccada0a700 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:34.243515 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3153/6334] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:34:34 2022] PUT /identity/v3/projects/3322852c2a7248e9a4c0ba3eb1684cbb/users/c273890567f648c5b8e335b15d4b1c70/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:34.246978 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92574200-86ae-497a-a62a-480812da48ec admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:34.302028 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:34.309456 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701563f2-bdf5-464d-88f9-f971e591eddd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:34.310289 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701563f2-bdf5-464d-88f9-f971e591eddd service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:34.310289 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701563f2-bdf5-464d-88f9-f971e591eddd service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:34.311948 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701563f2-bdf5-464d-88f9-f971e591eddd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:34.348358 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92574200-86ae-497a-a62a-480812da48ec admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:34.355592 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a121ea-b6d6-4a6e-89ac-b5360c3732b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:34.356764 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a121ea-b6d6-4a6e-89ac-b5360c3732b4 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:34.357451 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a121ea-b6d6-4a6e-89ac-b5360c3732b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:34.357790 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a121ea-b6d6-4a6e-89ac-b5360c3732b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:34.358570 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a121ea-b6d6-4a6e-89ac-b5360c3732b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:34.361312 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a121ea-b6d6-4a6e-89ac-b5360c3732b4 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:34.376176 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3154/6335] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:34:34 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:34:34.381739 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38879e31-8ffb-48c2-8506-5b039dcfaafd None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:34.382111 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38879e31-8ffb-48c2-8506-5b039dcfaafd None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:34.382333 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38879e31-8ffb-48c2-8506-5b039dcfaafd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:34.407070 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-38879e31-8ffb-48c2-8506-5b039dcfaafd None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:34:34.409178 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-38879e31-8ffb-48c2-8506-5b039dcfaafd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:34.411201 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701563f2-bdf5-464d-88f9-f971e591eddd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:34.412776 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701563f2-bdf5-464d-88f9-f971e591eddd service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:34.419503 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3155/6336] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:34:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:34:34.421170 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf48d4f3-db67-413a-9e9d-5c31f9fc6e08 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:34.421471 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf48d4f3-db67-413a-9e9d-5c31f9fc6e08 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:34.421779 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf48d4f3-db67-413a-9e9d-5c31f9fc6e08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:34.426181 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3182/6337] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:34:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:34:34.434649 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701563f2-bdf5-464d-88f9-f971e591eddd service neutron] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:34.447708 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701563f2-bdf5-464d-88f9-f971e591eddd service neutron] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:34.454130 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f20bff-42bb-40d3-b126-4be3c2df7554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:34.455179 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f20bff-42bb-40d3-b126-4be3c2df7554 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:34.456212 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f20bff-42bb-40d3-b126-4be3c2df7554 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:34.456726 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f20bff-42bb-40d3-b126-4be3c2df7554 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:34.456841 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-bf48d4f3-db67-413a-9e9d-5c31f9fc6e08 None None] MFA Rules not processed for user `c273890567f648c5b8e335b15d4b1c70`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:34:34.457793 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f20bff-42bb-40d3-b126-4be3c2df7554 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:34.458184 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-bf48d4f3-db67-413a-9e9d-5c31f9fc6e08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:34.460713 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f20bff-42bb-40d3-b126-4be3c2df7554 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:34.475402 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3183/6338] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:34:34 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:34:34.476772 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f20bff-42bb-40d3-b126-4be3c2df7554 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:34.490250 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f20bff-42bb-40d3-b126-4be3c2df7554 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:34.495435 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ff48b2-2833-45e7-b961-843f67f8726e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:34.496172 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ff48b2-2833-45e7-b961-843f67f8726e admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:34.496550 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ff48b2-2833-45e7-b961-843f67f8726e admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:34.496994 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ff48b2-2833-45e7-b961-843f67f8726e admin admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:34.497827 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ff48b2-2833-45e7-b961-843f67f8726e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:34:34.498299 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ff48b2-2833-45e7-b961-843f67f8726e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:34.500123 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ff48b2-2833-45e7-b961-843f67f8726e admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:34.518780 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3184/6339] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:34:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:34:34.520513 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ff48b2-2833-45e7-b961-843f67f8726e admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:34.539897 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ff48b2-2833-45e7-b961-843f67f8726e admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:34.551971 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3451b27c-0e76-4385-8aa0-16fca84af4e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:34.553034 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3451b27c-0e76-4385-8aa0-16fca84af4e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:34.553224 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3451b27c-0e76-4385-8aa0-16fca84af4e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:34.553506 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3451b27c-0e76-4385-8aa0-16fca84af4e4 admin admin] PATH_INFO: `/v3/projects/955d6b15592b4e448fd5a4bbef2f7d17/users/abd1d27939c5411cadd2624ef8963ab4/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:34.575553 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3451b27c-0e76-4385-8aa0-16fca84af4e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=955d6b15592b4e448fd5a4bbef2f7d17, user_id=abd1d27939c5411cadd2624ef8963ab4, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:34.580489 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3451b27c-0e76-4385-8aa0-16fca84af4e4 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:34.594860 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3156/6340] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:34:34 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:34:34.595836 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf48d4f3-db67-413a-9e9d-5c31f9fc6e08 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:34.600213 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3185/6341] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:34:34 2022] PUT /identity/v3/projects/955d6b15592b4e448fd5a4bbef2f7d17/users/abd1d27939c5411cadd2624ef8963ab4/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:34.612485 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6778ddbc-5a6c-435f-ab7d-f308b8d99986 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:34.612771 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6778ddbc-5a6c-435f-ab7d-f308b8d99986 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:34.613108 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6778ddbc-5a6c-435f-ab7d-f308b8d99986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:34.628079 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf48d4f3-db67-413a-9e9d-5c31f9fc6e08 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:34.661457 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-6778ddbc-5a6c-435f-ab7d-f308b8d99986 None None] MFA Rules not processed for user `abd1d27939c5411cadd2624ef8963ab4`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:34:34.663422 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-6778ddbc-5a6c-435f-ab7d-f308b8d99986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:34.728849 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a111340-b063-4c9a-b060-84cd008d783d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:34.728849 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a111340-b063-4c9a-b060-84cd008d783d admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:34.728849 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a111340-b063-4c9a-b060-84cd008d783d admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:34.728849 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a111340-b063-4c9a-b060-84cd008d783d admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:34.729566 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a111340-b063-4c9a-b060-84cd008d783d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:34.731644 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a111340-b063-4c9a-b060-84cd008d783d admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:34.757851 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:34.769588 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3157/6342] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:34:34 2022] POST /identity/v3/projects => generated 375 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:34:34.769588 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a111340-b063-4c9a-b060-84cd008d783d admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:34.771812 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-1a111340-b063-4c9a-b060-84cd008d783d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:34.803884 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3186/6343] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:34:34 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:34:34.803884 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6778ddbc-5a6c-435f-ab7d-f308b8d99986 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:34.817221 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6778ddbc-5a6c-435f-ab7d-f308b8d99986 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:34.828014 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:34.875795 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a111340-b063-4c9a-b060-84cd008d783d admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:34.885777 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c69887-832a-4b7d-8e74-40f5013eb8e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:34.886555 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c69887-832a-4b7d-8e74-40f5013eb8e7 service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:34.887330 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c69887-832a-4b7d-8e74-40f5013eb8e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:34.887587 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c69887-832a-4b7d-8e74-40f5013eb8e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:34.890537 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-46c69887-832a-4b7d-8e74-40f5013eb8e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:34.913791 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f165bd62-fdf7-47c3-aebd-1259b7f65a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:34.914585 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f165bd62-fdf7-47c3-aebd-1259b7f65a6a admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:34.914872 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f165bd62-fdf7-47c3-aebd-1259b7f65a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:34.915166 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f165bd62-fdf7-47c3-aebd-1259b7f65a6a admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:34.915876 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f165bd62-fdf7-47c3-aebd-1259b7f65a6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:34.917817 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f165bd62-fdf7-47c3-aebd-1259b7f65a6a admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:34.943978 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3187/6344] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:34:34 2022] POST /identity/v3/users => generated 288 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:34:34.943978 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f165bd62-fdf7-47c3-aebd-1259b7f65a6a admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:34.953812 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f165bd62-fdf7-47c3-aebd-1259b7f65a6a admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:34.958798 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439aef31-a1df-48a5-9771-20901ba60975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:34.959596 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439aef31-a1df-48a5-9771-20901ba60975 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:34.959879 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439aef31-a1df-48a5-9771-20901ba60975 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:34.960159 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439aef31-a1df-48a5-9771-20901ba60975 admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:34.960979 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439aef31-a1df-48a5-9771-20901ba60975 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:34.963142 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439aef31-a1df-48a5-9771-20901ba60975 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:34.981045 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c69887-832a-4b7d-8e74-40f5013eb8e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:34.982659 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c69887-832a-4b7d-8e74-40f5013eb8e7 service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:34.993995 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3158/6345] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:34:34 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:34:34.996423 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c69887-832a-4b7d-8e74-40f5013eb8e7 service neutron] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:34.996575 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3188/6346] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:34:34 2022] POST /identity/v3/projects => generated 371 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:34:34.996575 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439aef31-a1df-48a5-9771-20901ba60975 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:34.999830 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-46c69887-832a-4b7d-8e74-40f5013eb8e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:35.016841 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c69887-832a-4b7d-8e74-40f5013eb8e7 service neutron] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:35.107072 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439aef31-a1df-48a5-9771-20901ba60975 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:35.110193 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30296ad7-beac-4c6f-9176-f908fb4cad97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:35.111083 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30296ad7-beac-4c6f-9176-f908fb4cad97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:35.111369 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30296ad7-beac-4c6f-9176-f908fb4cad97 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:35.111753 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30296ad7-beac-4c6f-9176-f908fb4cad97 admin admin] PATH_INFO: `/v3/projects/27b3e8db48f04b4892b3e0ce24c20c96` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:35.113033 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30296ad7-beac-4c6f-9176-f908fb4cad97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=27b3e8db48f04b4892b3e0ce24c20c96)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:35.115161 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30296ad7-beac-4c6f-9176-f908fb4cad97 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:35.121119 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9789b1-a18c-44f4-a05a-b5d872054524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:35.122103 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9789b1-a18c-44f4-a05a-b5d872054524 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:35.122393 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9789b1-a18c-44f4-a05a-b5d872054524 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:35.122825 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9789b1-a18c-44f4-a05a-b5d872054524 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:35.123797 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9789b1-a18c-44f4-a05a-b5d872054524 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:35.126001 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9789b1-a18c-44f4-a05a-b5d872054524 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:35.144381 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3189/6347] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:34:34 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:34:35.146683 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9789b1-a18c-44f4-a05a-b5d872054524 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:35.166633 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9789b1-a18c-44f4-a05a-b5d872054524 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:35.183966 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1875b53-7fe2-46fc-babc-81cf05c706ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:35.186928 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1875b53-7fe2-46fc-babc-81cf05c706ec admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:35.187815 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1875b53-7fe2-46fc-babc-81cf05c706ec admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:35.188293 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1875b53-7fe2-46fc-babc-81cf05c706ec admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:35.189060 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1875b53-7fe2-46fc-babc-81cf05c706ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:35.191811 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1875b53-7fe2-46fc-babc-81cf05c706ec admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:35.204319 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-30296ad7-beac-4c6f-9176-f908fb4cad97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27b3e8db48f04b4892b3e0ce24c20c96', 'request_id': 'req-30296ad7-beac-4c6f-9176-f908fb4cad97'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:35.218317 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-30296ad7-beac-4c6f-9176-f908fb4cad97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27b3e8db48f04b4892b3e0ce24c20c96', 'request_id': 'req-30296ad7-beac-4c6f-9176-f908fb4cad97'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:35.230962 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-30296ad7-beac-4c6f-9176-f908fb4cad97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27b3e8db48f04b4892b3e0ce24c20c96', 'request_id': 'req-30296ad7-beac-4c6f-9176-f908fb4cad97'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:35.238044 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3190/6348] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:34:35 2022] POST /identity/v3/users => generated 292 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:34:35.238044 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1875b53-7fe2-46fc-babc-81cf05c706ec admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:35.248189 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1875b53-7fe2-46fc-babc-81cf05c706ec admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:35.250081 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-30296ad7-beac-4c6f-9176-f908fb4cad97 admin admin] The token cache is being invalidate because project 27b3e8db48f04b4892b3e0ce24c20c96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:34:35.250384 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-30296ad7-beac-4c6f-9176-f908fb4cad97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:35.251256 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-30296ad7-beac-4c6f-9176-f908fb4cad97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:35.254414 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3159/6349] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:34:34 2022] DELETE /identity/v3/projects/27b3e8db48f04b4892b3e0ce24c20c96 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:35.256257 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30296ad7-beac-4c6f-9176-f908fb4cad97 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:35.258274 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-30296ad7-beac-4c6f-9176-f908fb4cad97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:35.285925 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:35.297276 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:35.347899 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2853ec71-41ab-4982-9132-dd0451723882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:35.348729 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2853ec71-41ab-4982-9132-dd0451723882 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:35.349909 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2853ec71-41ab-4982-9132-dd0451723882 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:35.350521 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2853ec71-41ab-4982-9132-dd0451723882 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:35.351819 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2853ec71-41ab-4982-9132-dd0451723882 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:35.368849 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2853ec71-41ab-4982-9132-dd0451723882 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:35.389769 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30296ad7-beac-4c6f-9176-f908fb4cad97 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:35.391090 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3191/6350] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:34:35 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:34:35.392429 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2853ec71-41ab-4982-9132-dd0451723882 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:35.396379 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-2853ec71-41ab-4982-9132-dd0451723882 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:35.410229 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbd1fb8-979c-4a7f-b0b9-92a506f1af82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:35.410933 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbd1fb8-979c-4a7f-b0b9-92a506f1af82 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:35.411355 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbd1fb8-979c-4a7f-b0b9-92a506f1af82 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:35.411633 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbd1fb8-979c-4a7f-b0b9-92a506f1af82 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:35.412375 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbd1fb8-979c-4a7f-b0b9-92a506f1af82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:35.414033 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbd1fb8-979c-4a7f-b0b9-92a506f1af82 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:35.421172 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2853ec71-41ab-4982-9132-dd0451723882 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:35.432577 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ad7705-b231-46c2-aaf1-41177e9548f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:35.433038 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3160/6351] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:34:35 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:34:35.433930 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbd1fb8-979c-4a7f-b0b9-92a506f1af82 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:35.434260 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ad7705-b231-46c2-aaf1-41177e9548f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:35.434744 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ad7705-b231-46c2-aaf1-41177e9548f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:35.435176 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ad7705-b231-46c2-aaf1-41177e9548f7 admin admin] PATH_INFO: `/v3/users/0b2f9e14e3c84bc9a8b2e3f0a35cf289` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:35.435900 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-8bbd1fb8-979c-4a7f-b0b9-92a506f1af82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:35.436877 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ad7705-b231-46c2-aaf1-41177e9548f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b2f9e14e3c84bc9a8b2e3f0a35cf289)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:35.439370 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ad7705-b231-46c2-aaf1-41177e9548f7 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:35.453180 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbd1fb8-979c-4a7f-b0b9-92a506f1af82 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:35.464391 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0b7522-c15a-408e-ae5e-f4af9e2c33ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:35.465360 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0b7522-c15a-408e-ae5e-f4af9e2c33ba admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:35.465642 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0b7522-c15a-408e-ae5e-f4af9e2c33ba admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:35.466532 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0b7522-c15a-408e-ae5e-f4af9e2c33ba admin admin] PATH_INFO: `/v3/projects/306389761eba44ccb42836342dfe14b2/users/eed53e9aba1148f0b88447645d3b3fa5/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:35.484711 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0b7522-c15a-408e-ae5e-f4af9e2c33ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=306389761eba44ccb42836342dfe14b2, user_id=eed53e9aba1148f0b88447645d3b3fa5, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:35.487547 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0b7522-c15a-408e-ae5e-f4af9e2c33ba admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:35.533959 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3161/6352] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:34:35 2022] PUT /identity/v3/projects/306389761eba44ccb42836342dfe14b2/users/eed53e9aba1148f0b88447645d3b3fa5/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:35.533959 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0b7522-c15a-408e-ae5e-f4af9e2c33ba admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:35.549103 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-19ad7705-b231-46c2-aaf1-41177e9548f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b2f9e14e3c84bc9a8b2e3f0a35cf289'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:35.550987 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-19ad7705-b231-46c2-aaf1-41177e9548f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b2f9e14e3c84bc9a8b2e3f0a35cf289'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:35.568431 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-19ad7705-b231-46c2-aaf1-41177e9548f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b2f9e14e3c84bc9a8b2e3f0a35cf289'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:35.593155 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-19ad7705-b231-46c2-aaf1-41177e9548f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b2f9e14e3c84bc9a8b2e3f0a35cf289'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:35.616043 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-19ad7705-b231-46c2-aaf1-41177e9548f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b2f9e14e3c84bc9a8b2e3f0a35cf289'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:35.623473 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3192/6353] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:34:35 2022] DELETE /identity/v3/users/0b2f9e14e3c84bc9a8b2e3f0a35cf289 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:35.625046 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b579ace1-658e-4982-810e-98caa55722ef None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:35.625450 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b579ace1-658e-4982-810e-98caa55722ef None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:35.625830 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b579ace1-658e-4982-810e-98caa55722ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:35.644672 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0b7522-c15a-408e-ae5e-f4af9e2c33ba admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:35.677478 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-b579ace1-658e-4982-810e-98caa55722ef None None] MFA Rules not processed for user `eed53e9aba1148f0b88447645d3b3fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:34:35.692957 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-b579ace1-658e-4982-810e-98caa55722ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:35.814042 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9b08c2-f884-4715-bf24-c0b5958aa3b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:35.814042 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9b08c2-f884-4715-bf24-c0b5958aa3b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:35.814042 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9b08c2-f884-4715-bf24-c0b5958aa3b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:35.814042 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9b08c2-f884-4715-bf24-c0b5958aa3b1 admin admin] PATH_INFO: `/v3/projects/44974b353e804139a110f4005cffa04d/users/cbc7092d01464ead81c9bf7156a90405/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:35.834744 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9b08c2-f884-4715-bf24-c0b5958aa3b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44974b353e804139a110f4005cffa04d, user_id=cbc7092d01464ead81c9bf7156a90405, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:35.835365 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3193/6354] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:34:35 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:34:35.837452 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b579ace1-658e-4982-810e-98caa55722ef None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:35.837612 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9b08c2-f884-4715-bf24-c0b5958aa3b1 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:35.842683 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-b579ace1-658e-4982-810e-98caa55722ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:35.867077 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3162/6355] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:34:35 2022] PUT /identity/v3/projects/44974b353e804139a110f4005cffa04d/users/cbc7092d01464ead81c9bf7156a90405/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:35.868371 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9b08c2-f884-4715-bf24-c0b5958aa3b1 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:35.877171 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-5a9b08c2-f884-4715-bf24-c0b5958aa3b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:35.896506 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:35.901037 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:35.944848 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b579ace1-658e-4982-810e-98caa55722ef None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:35.958946 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9b08c2-f884-4715-bf24-c0b5958aa3b1 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:35.964079 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65efdd12-b45c-4110-957e-1d86316bd443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:35.964774 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65efdd12-b45c-4110-957e-1d86316bd443 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:35.965026 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65efdd12-b45c-4110-957e-1d86316bd443 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:35.965307 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65efdd12-b45c-4110-957e-1d86316bd443 admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:35.966318 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65efdd12-b45c-4110-957e-1d86316bd443 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:35.968421 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65efdd12-b45c-4110-957e-1d86316bd443 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:36.008178 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3163/6356] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:34:35 2022] POST /identity/v3/projects => generated 373 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:34:36.008857 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65efdd12-b45c-4110-957e-1d86316bd443 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:36.014788 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-65efdd12-b45c-4110-957e-1d86316bd443 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:36.041477 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cd3e7a-b40e-46d8-a91a-eaead606d268 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:36.042351 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cd3e7a-b40e-46d8-a91a-eaead606d268 service nova] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:36.042698 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cd3e7a-b40e-46d8-a91a-eaead606d268 service nova] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:36.043386 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cd3e7a-b40e-46d8-a91a-eaead606d268 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:36.046361 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-e7cd3e7a-b40e-46d8-a91a-eaead606d268 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:36.137207 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65efdd12-b45c-4110-957e-1d86316bd443 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:36.143210 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b769f49-7131-43e2-b8ed-f13b0ff63842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:36.144050 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b769f49-7131-43e2-b8ed-f13b0ff63842 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:36.144486 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b769f49-7131-43e2-b8ed-f13b0ff63842 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:36.144813 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b769f49-7131-43e2-b8ed-f13b0ff63842 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:36.145824 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b769f49-7131-43e2-b8ed-f13b0ff63842 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:36.147572 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b769f49-7131-43e2-b8ed-f13b0ff63842 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:36.162089 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3164/6357] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:34:36 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:34:36.163152 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b769f49-7131-43e2-b8ed-f13b0ff63842 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:36.175095 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b769f49-7131-43e2-b8ed-f13b0ff63842 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:36.182569 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd418f9-2988-4c9b-9f42-61863a3115a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:36.183553 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd418f9-2988-4c9b-9f42-61863a3115a0 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:36.183838 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd418f9-2988-4c9b-9f42-61863a3115a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:36.184173 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd418f9-2988-4c9b-9f42-61863a3115a0 admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:36.186112 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd418f9-2988-4c9b-9f42-61863a3115a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:36.193330 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd418f9-2988-4c9b-9f42-61863a3115a0 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:36.203543 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cd3e7a-b40e-46d8-a91a-eaead606d268 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:36.205248 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cd3e7a-b40e-46d8-a91a-eaead606d268 service nova] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:36.222836 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3194/6359] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:34:35 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:34:36.225000 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cd3e7a-b40e-46d8-a91a-eaead606d268 service nova] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:36.229964 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3165/6359] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:34:36 2022] POST /identity/v3/users => generated 293 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:34:36.231510 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd418f9-2988-4c9b-9f42-61863a3115a0 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:36.234629 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-bfd418f9-2988-4c9b-9f42-61863a3115a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:36.238255 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cd3e7a-b40e-46d8-a91a-eaead606d268 service nova] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:36.243817 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c0c08b-d43e-4a46-b566-e81f61fdce9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:36.245032 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c0c08b-d43e-4a46-b566-e81f61fdce9b admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:36.246019 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c0c08b-d43e-4a46-b566-e81f61fdce9b admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:36.246019 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c0c08b-d43e-4a46-b566-e81f61fdce9b admin admin] PATH_INFO: `/v3/projects/44974b353e804139a110f4005cffa04d/users/cbc7092d01464ead81c9bf7156a90405/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:36.248550 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c0c08b-d43e-4a46-b566-e81f61fdce9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=44974b353e804139a110f4005cffa04d, user_id=cbc7092d01464ead81c9bf7156a90405, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:36.251285 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c0c08b-d43e-4a46-b566-e81f61fdce9b admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:36.260497 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd418f9-2988-4c9b-9f42-61863a3115a0 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:36.270923 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3195/6360] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:34:36 2022] PUT /identity/v3/projects/44974b353e804139a110f4005cffa04d/users/cbc7092d01464ead81c9bf7156a90405/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:36.271800 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c0c08b-d43e-4a46-b566-e81f61fdce9b admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:36.345406 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c8ddbe-d08f-4472-8cf2-23bda812c5e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:36.346831 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c8ddbe-d08f-4472-8cf2-23bda812c5e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:36.347335 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c8ddbe-d08f-4472-8cf2-23bda812c5e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:36.347839 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c8ddbe-d08f-4472-8cf2-23bda812c5e2 admin admin] PATH_INFO: `/v3/projects/e06b3f0da51d41ca8cf377c683f5698b` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:36.350579 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c8ddbe-d08f-4472-8cf2-23bda812c5e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e06b3f0da51d41ca8cf377c683f5698b)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:36.353427 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c8ddbe-d08f-4472-8cf2-23bda812c5e2 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:36.367459 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:36.386868 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c0c08b-d43e-4a46-b566-e81f61fdce9b admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:36.394503 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934f6d6e-9412-4290-8014-80dba7bf89a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:36.395210 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934f6d6e-9412-4290-8014-80dba7bf89a2 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:36.395990 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934f6d6e-9412-4290-8014-80dba7bf89a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:36.395990 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934f6d6e-9412-4290-8014-80dba7bf89a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:36.396933 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934f6d6e-9412-4290-8014-80dba7bf89a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:36.399059 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934f6d6e-9412-4290-8014-80dba7bf89a2 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:36.402495 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:36.417191 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3196/6361] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:34:36 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:34:36.417191 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065109e6-84cb-43ed-a86e-4a3c6a8da909 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:36.417191 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065109e6-84cb-43ed-a86e-4a3c6a8da909 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:36.417191 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065109e6-84cb-43ed-a86e-4a3c6a8da909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:36.439390 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-87c8ddbe-d08f-4472-8cf2-23bda812c5e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e06b3f0da51d41ca8cf377c683f5698b', 'request_id': 'req-87c8ddbe-d08f-4472-8cf2-23bda812c5e2'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:36.449015 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-87c8ddbe-d08f-4472-8cf2-23bda812c5e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e06b3f0da51d41ca8cf377c683f5698b', 'request_id': 'req-87c8ddbe-d08f-4472-8cf2-23bda812c5e2'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:36.461231 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-87c8ddbe-d08f-4472-8cf2-23bda812c5e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e06b3f0da51d41ca8cf377c683f5698b', 'request_id': 'req-87c8ddbe-d08f-4472-8cf2-23bda812c5e2'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:36.477525 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-065109e6-84cb-43ed-a86e-4a3c6a8da909 None None] MFA Rules not processed for user `cbc7092d01464ead81c9bf7156a90405`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:34:36.480715 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-87c8ddbe-d08f-4472-8cf2-23bda812c5e2 admin admin] The token cache is being invalidate because project e06b3f0da51d41ca8cf377c683f5698b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:34:36.481106 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-87c8ddbe-d08f-4472-8cf2-23bda812c5e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:36.481892 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-87c8ddbe-d08f-4472-8cf2-23bda812c5e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:36.482034 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-065109e6-84cb-43ed-a86e-4a3c6a8da909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:36.488379 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3166/6362] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:34:36 2022] DELETE /identity/v3/projects/e06b3f0da51d41ca8cf377c683f5698b => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:36.488379 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c8ddbe-d08f-4472-8cf2-23bda812c5e2 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:36.488379 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-87c8ddbe-d08f-4472-8cf2-23bda812c5e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:36.576032 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c8ddbe-d08f-4472-8cf2-23bda812c5e2 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:36.580569 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3197/6363] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:34:36 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:34:36.580803 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035a4129-52f5-4f6b-bd00-fba40e1d07da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:36.581836 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035a4129-52f5-4f6b-bd00-fba40e1d07da admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:36.582153 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035a4129-52f5-4f6b-bd00-fba40e1d07da admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:36.582428 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035a4129-52f5-4f6b-bd00-fba40e1d07da admin admin] PATH_INFO: `/v3/projects/0de025a9cc0942b3b8d27d1e0988b39b/users/ee6dc6326d854402ace906811c02d207/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:36.583331 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9119ba8-027e-49d3-9e4f-d019ee497356 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:36.584300 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9119ba8-027e-49d3-9e4f-d019ee497356 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:36.584738 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9119ba8-027e-49d3-9e4f-d019ee497356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:36.601096 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035a4129-52f5-4f6b-bd00-fba40e1d07da admin admin] RBAC: Authorizing `identity:create_grant(project_id=0de025a9cc0942b3b8d27d1e0988b39b, user_id=ee6dc6326d854402ace906811c02d207, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:36.603899 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-c9119ba8-027e-49d3-9e4f-d019ee497356 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:34:36.604065 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035a4129-52f5-4f6b-bd00-fba40e1d07da admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:36.605274 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-c9119ba8-027e-49d3-9e4f-d019ee497356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:36.615820 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3198/6364] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:34:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:34:36.616595 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9119ba8-027e-49d3-9e4f-d019ee497356 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:36.617946 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-c9119ba8-027e-49d3-9e4f-d019ee497356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:36.627507 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3167/6365] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:34:36 2022] PUT /identity/v3/projects/0de025a9cc0942b3b8d27d1e0988b39b/users/ee6dc6326d854402ace906811c02d207/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:36.629343 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035a4129-52f5-4f6b-bd00-fba40e1d07da admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:36.631412 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9119ba8-027e-49d3-9e4f-d019ee497356 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:36.696394 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caa7c4b-9f8e-4986-8f3a-bfb8928ead45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:36.697441 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caa7c4b-9f8e-4986-8f3a-bfb8928ead45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:36.697788 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caa7c4b-9f8e-4986-8f3a-bfb8928ead45 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:36.698151 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caa7c4b-9f8e-4986-8f3a-bfb8928ead45 admin admin] PATH_INFO: `/v3/users/048f5756139b4283b695c057647983ba` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:36.699592 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caa7c4b-9f8e-4986-8f3a-bfb8928ead45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=048f5756139b4283b695c057647983ba)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:36.700017 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035a4129-52f5-4f6b-bd00-fba40e1d07da admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:36.701794 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caa7c4b-9f8e-4986-8f3a-bfb8928ead45 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:36.705315 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9988b407-38d7-488d-b47a-fa28e3875d3a tempest-QuotasNegativeTest-434732875 tempest-QuotasNegativeTest-434732875-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbc7092d01464ead81c9bf7156a90405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44974b353e804139a110f4005cffa04d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:36.706068 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9988b407-38d7-488d-b47a-fa28e3875d3a tempest-QuotasNegativeTest-434732875 tempest-QuotasNegativeTest-434732875-project-admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:36.706737 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9988b407-38d7-488d-b47a-fa28e3875d3a tempest-QuotasNegativeTest-434732875 tempest-QuotasNegativeTest-434732875-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:36.706737 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9988b407-38d7-488d-b47a-fa28e3875d3a tempest-QuotasNegativeTest-434732875 tempest-QuotasNegativeTest-434732875-project-admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:36.707407 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9988b407-38d7-488d-b47a-fa28e3875d3a tempest-QuotasNegativeTest-434732875 tempest-QuotasNegativeTest-434732875-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:34:36.707714 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9988b407-38d7-488d-b47a-fa28e3875d3a tempest-QuotasNegativeTest-434732875 tempest-QuotasNegativeTest-434732875-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:36.709592 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9988b407-38d7-488d-b47a-fa28e3875d3a tempest-QuotasNegativeTest-434732875 tempest-QuotasNegativeTest-434732875-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:36.727187 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3168/6366] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:34:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:34:36.727187 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3719b56-df86-4d99-a013-12625b6da88d None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:36.727187 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3719b56-df86-4d99-a013-12625b6da88d None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:36.727187 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3719b56-df86-4d99-a013-12625b6da88d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:36.750271 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-c3719b56-df86-4d99-a013-12625b6da88d None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:34:36.753165 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-c3719b56-df86-4d99-a013-12625b6da88d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:36.761213 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-7caa7c4b-9f8e-4986-8f3a-bfb8928ead45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '048f5756139b4283b695c057647983ba'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:36.762104 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-7caa7c4b-9f8e-4986-8f3a-bfb8928ead45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '048f5756139b4283b695c057647983ba'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:36.766229 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3169/6367] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:34:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:34:36.767440 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3719b56-df86-4d99-a013-12625b6da88d None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:36.772465 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-7caa7c4b-9f8e-4986-8f3a-bfb8928ead45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '048f5756139b4283b695c057647983ba'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:36.779671 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3719b56-df86-4d99-a013-12625b6da88d None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:36.787765 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81275f06-6813-4578-9950-b06e52247379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:36.788543 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81275f06-6813-4578-9950-b06e52247379 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:36.788829 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81275f06-6813-4578-9950-b06e52247379 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:36.789234 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81275f06-6813-4578-9950-b06e52247379 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:36.789959 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-7caa7c4b-9f8e-4986-8f3a-bfb8928ead45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '048f5756139b4283b695c057647983ba'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:36.790104 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81275f06-6813-4578-9950-b06e52247379 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:36.791881 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81275f06-6813-4578-9950-b06e52247379 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:36.799771 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:36.812972 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3170/6368] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:34:36 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:34:36.818036 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81275f06-6813-4578-9950-b06e52247379 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:36.826588 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-7caa7c4b-9f8e-4986-8f3a-bfb8928ead45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '048f5756139b4283b695c057647983ba'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:36.846933 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3199/6369] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:34:36 2022] DELETE /identity/v3/users/048f5756139b4283b695c057647983ba => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:36.847043 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81275f06-6813-4578-9950-b06e52247379 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:36.847245 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caa7c4b-9f8e-4986-8f3a-bfb8928ead45 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:36.848348 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-7caa7c4b-9f8e-4986-8f3a-bfb8928ead45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:36.870962 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:36.958585 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37f432a-9c18-4037-b50d-447ae763e399 tempest-QuotasNegativeTest-434732875 tempest-QuotasNegativeTest-434732875-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbc7092d01464ead81c9bf7156a90405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44974b353e804139a110f4005cffa04d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:36.959404 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37f432a-9c18-4037-b50d-447ae763e399 tempest-QuotasNegativeTest-434732875 tempest-QuotasNegativeTest-434732875-project-admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:36.959696 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37f432a-9c18-4037-b50d-447ae763e399 tempest-QuotasNegativeTest-434732875 tempest-QuotasNegativeTest-434732875-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:36.959972 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37f432a-9c18-4037-b50d-447ae763e399 tempest-QuotasNegativeTest-434732875 tempest-QuotasNegativeTest-434732875-project-admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:36.960673 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37f432a-9c18-4037-b50d-447ae763e399 tempest-QuotasNegativeTest-434732875 tempest-QuotasNegativeTest-434732875-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:36.962647 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37f432a-9c18-4037-b50d-447ae763e399 tempest-QuotasNegativeTest-434732875 tempest-QuotasNegativeTest-434732875-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:36.972383 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caa7c4b-9f8e-4986-8f3a-bfb8928ead45 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:36.979142 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce3737a-6cd9-40a3-ab27-b224f365c193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:36.979976 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce3737a-6cd9-40a3-ab27-b224f365c193 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:36.980262 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce3737a-6cd9-40a3-ab27-b224f365c193 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:36.980535 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce3737a-6cd9-40a3-ab27-b224f365c193 admin admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:36.981273 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce3737a-6cd9-40a3-ab27-b224f365c193 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:34:36.981573 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce3737a-6cd9-40a3-ab27-b224f365c193 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:36.983470 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce3737a-6cd9-40a3-ab27-b224f365c193 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:37.004536 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3200/6370] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:34:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:34:37.006011 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce3737a-6cd9-40a3-ab27-b224f365c193 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:37.008134 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-8ce3737a-6cd9-40a3-ab27-b224f365c193 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:37.020599 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3171/6371] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:34:36 2022] POST /identity/v3/projects => generated 347 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:34:37.021839 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37f432a-9c18-4037-b50d-447ae763e399 tempest-QuotasNegativeTest-434732875 tempest-QuotasNegativeTest-434732875-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:37.022783 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce3737a-6cd9-40a3-ab27-b224f365c193 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:37.086427 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cd0a59-e666-4dad-be92-72d33744a351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:37.087508 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cd0a59-e666-4dad-be92-72d33744a351 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:37.087641 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cd0a59-e666-4dad-be92-72d33744a351 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:37.087907 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cd0a59-e666-4dad-be92-72d33744a351 admin admin] PATH_INFO: `/v3/projects/0de025a9cc0942b3b8d27d1e0988b39b/users/ee6dc6326d854402ace906811c02d207/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:37.090186 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cd0a59-e666-4dad-be92-72d33744a351 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0de025a9cc0942b3b8d27d1e0988b39b, user_id=ee6dc6326d854402ace906811c02d207, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:37.092858 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cd0a59-e666-4dad-be92-72d33744a351 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:37.106089 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3201/6372] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:34:37 2022] PUT /identity/v3/projects/0de025a9cc0942b3b8d27d1e0988b39b/users/ee6dc6326d854402ace906811c02d207/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:37.110362 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cd0a59-e666-4dad-be92-72d33744a351 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:37.113400 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-f5cd0a59-e666-4dad-be92-72d33744a351 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:37.114666 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37f432a-9c18-4037-b50d-447ae763e399 tempest-QuotasNegativeTest-434732875 tempest-QuotasNegativeTest-434732875-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:37.190143 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da51e042-3384-4370-bf78-2e7407b8967d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:37.191486 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da51e042-3384-4370-bf78-2e7407b8967d admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:37.191836 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da51e042-3384-4370-bf78-2e7407b8967d admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:37.192200 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da51e042-3384-4370-bf78-2e7407b8967d admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:37.192950 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da51e042-3384-4370-bf78-2e7407b8967d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:37.195052 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da51e042-3384-4370-bf78-2e7407b8967d admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:37.199614 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cd0a59-e666-4dad-be92-72d33744a351 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:37.204768 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc84c52b-6642-49a9-9c0d-6954d844314d tempest-QuotasNegativeTest-434732875 tempest-QuotasNegativeTest-434732875-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbc7092d01464ead81c9bf7156a90405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44974b353e804139a110f4005cffa04d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:37.205451 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc84c52b-6642-49a9-9c0d-6954d844314d tempest-QuotasNegativeTest-434732875 tempest-QuotasNegativeTest-434732875-project-admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:37.205739 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc84c52b-6642-49a9-9c0d-6954d844314d tempest-QuotasNegativeTest-434732875 tempest-QuotasNegativeTest-434732875-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:37.206042 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc84c52b-6642-49a9-9c0d-6954d844314d tempest-QuotasNegativeTest-434732875 tempest-QuotasNegativeTest-434732875-project-admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:37.206775 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc84c52b-6642-49a9-9c0d-6954d844314d tempest-QuotasNegativeTest-434732875 tempest-QuotasNegativeTest-434732875-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:34:37.207073 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc84c52b-6642-49a9-9c0d-6954d844314d tempest-QuotasNegativeTest-434732875 tempest-QuotasNegativeTest-434732875-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:37.208725 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc84c52b-6642-49a9-9c0d-6954d844314d tempest-QuotasNegativeTest-434732875 tempest-QuotasNegativeTest-434732875-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:37.231635 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3202/6373] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:34:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:34:37.234228 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3172/6374] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:34:37 2022] POST /identity/v3/projects => generated 371 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:34:37.235308 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da51e042-3384-4370-bf78-2e7407b8967d admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:37.237676 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-da51e042-3384-4370-bf78-2e7407b8967d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:37.248736 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8555a52b-a147-4da6-bfa5-988c2744d394 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:37.249638 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8555a52b-a147-4da6-bfa5-988c2744d394 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:37.249638 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8555a52b-a147-4da6-bfa5-988c2744d394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:37.271181 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:37.283398 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-8555a52b-a147-4da6-bfa5-988c2744d394 None None] MFA Rules not processed for user `ee6dc6326d854402ace906811c02d207`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:34:37.283717 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:37.285456 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-8555a52b-a147-4da6-bfa5-988c2744d394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:37.324427 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da51e042-3384-4370-bf78-2e7407b8967d admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:37.330233 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c407a6-acf3-4052-813e-518d013aa4cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:37.331117 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c407a6-acf3-4052-813e-518d013aa4cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:37.331503 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c407a6-acf3-4052-813e-518d013aa4cf admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:37.331782 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c407a6-acf3-4052-813e-518d013aa4cf admin admin] PATH_INFO: `/v3/projects/49da2dec096c474199da94d7c7a83258` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:37.333112 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c407a6-acf3-4052-813e-518d013aa4cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=49da2dec096c474199da94d7c7a83258)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:37.335075 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c407a6-acf3-4052-813e-518d013aa4cf admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:37.369027 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3203/6375] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:34:37 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:34:37.369908 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8555a52b-a147-4da6-bfa5-988c2744d394 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:37.381721 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8555a52b-a147-4da6-bfa5-988c2744d394 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:37.386965 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-61c407a6-acf3-4052-813e-518d013aa4cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49da2dec096c474199da94d7c7a83258', 'request_id': 'req-61c407a6-acf3-4052-813e-518d013aa4cf'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:37.398202 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-61c407a6-acf3-4052-813e-518d013aa4cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49da2dec096c474199da94d7c7a83258', 'request_id': 'req-61c407a6-acf3-4052-813e-518d013aa4cf'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:37.405339 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-61c407a6-acf3-4052-813e-518d013aa4cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49da2dec096c474199da94d7c7a83258', 'request_id': 'req-61c407a6-acf3-4052-813e-518d013aa4cf'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:37.423199 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-61c407a6-acf3-4052-813e-518d013aa4cf admin admin] The token cache is being invalidate because project 49da2dec096c474199da94d7c7a83258 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:34:37.423813 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-61c407a6-acf3-4052-813e-518d013aa4cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:37.424481 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-61c407a6-acf3-4052-813e-518d013aa4cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:37.430184 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3173/6376] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:34:37 2022] DELETE /identity/v3/projects/49da2dec096c474199da94d7c7a83258 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:37.430184 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c407a6-acf3-4052-813e-518d013aa4cf admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:37.430184 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-61c407a6-acf3-4052-813e-518d013aa4cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:37.463305 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b64722-4ff5-4c1d-8f97-db25c2d5f12e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:37.463999 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b64722-4ff5-4c1d-8f97-db25c2d5f12e admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:37.464290 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b64722-4ff5-4c1d-8f97-db25c2d5f12e admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:37.464564 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b64722-4ff5-4c1d-8f97-db25c2d5f12e admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:37.465263 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b64722-4ff5-4c1d-8f97-db25c2d5f12e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:37.467675 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b64722-4ff5-4c1d-8f97-db25c2d5f12e admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:37.491488 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3204/6377] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:34:37 2022] POST /identity/v3/users => generated 286 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:34:37.493265 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b64722-4ff5-4c1d-8f97-db25c2d5f12e admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:37.495937 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-40b64722-4ff5-4c1d-8f97-db25c2d5f12e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:37.497308 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c407a6-acf3-4052-813e-518d013aa4cf admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:37.502531 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11123e25-1bc4-4e77-97db-ec382cba1b39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:37.502773 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11123e25-1bc4-4e77-97db-ec382cba1b39 service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:37.503113 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11123e25-1bc4-4e77-97db-ec382cba1b39 service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:37.503446 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11123e25-1bc4-4e77-97db-ec382cba1b39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:37.506370 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-11123e25-1bc4-4e77-97db-ec382cba1b39 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:37.570444 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b64722-4ff5-4c1d-8f97-db25c2d5f12e admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:37.575594 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0831fc8d-9801-4467-9509-c09e58e97b1a tempest-CredentialsTestJSON-508638540 tempest-CredentialsTestJSON-508638540-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee6dc6326d854402ace906811c02d207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0de025a9cc0942b3b8d27d1e0988b39b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:37.576386 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0831fc8d-9801-4467-9509-c09e58e97b1a tempest-CredentialsTestJSON-508638540 tempest-CredentialsTestJSON-508638540-project-admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:37.576689 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0831fc8d-9801-4467-9509-c09e58e97b1a tempest-CredentialsTestJSON-508638540 tempest-CredentialsTestJSON-508638540-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:37.577032 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0831fc8d-9801-4467-9509-c09e58e97b1a tempest-CredentialsTestJSON-508638540 tempest-CredentialsTestJSON-508638540-project-admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:37.577955 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0831fc8d-9801-4467-9509-c09e58e97b1a tempest-CredentialsTestJSON-508638540 tempest-CredentialsTestJSON-508638540-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:37.578602 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11123e25-1bc4-4e77-97db-ec382cba1b39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:37.580070 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0831fc8d-9801-4467-9509-c09e58e97b1a tempest-CredentialsTestJSON-508638540 tempest-CredentialsTestJSON-508638540-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:37.580253 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11123e25-1bc4-4e77-97db-ec382cba1b39 service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:37.591604 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3174/6378] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:34:37 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:34:37.592635 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1e967d-3834-4443-b3af-656599ec28a1 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:37.593422 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1e967d-3834-4443-b3af-656599ec28a1 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:37.593422 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1e967d-3834-4443-b3af-656599ec28a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:37.613724 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-ad1e967d-3834-4443-b3af-656599ec28a1 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:34:37.614838 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-ad1e967d-3834-4443-b3af-656599ec28a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:37.622724 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3205/6379] 10.222.0.17 () {60 vars in 1151 bytes} [Sat Jul 23 21:34:37 2022] POST /identity/v3/projects => generated 349 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:34:37.622911 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:37.623015 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0831fc8d-9801-4467-9509-c09e58e97b1a tempest-CredentialsTestJSON-508638540 tempest-CredentialsTestJSON-508638540-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:37.624662 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-0831fc8d-9801-4467-9509-c09e58e97b1a tempest-CredentialsTestJSON-508638540 tempest-CredentialsTestJSON-508638540-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:37.637280 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:37.707456 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3175/6380] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:34:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:34:37.708181 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1e967d-3834-4443-b3af-656599ec28a1 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:37.721688 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0831fc8d-9801-4467-9509-c09e58e97b1a tempest-CredentialsTestJSON-508638540 tempest-CredentialsTestJSON-508638540-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:37.727393 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caab5757-4d32-4d2d-9533-4380da659a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:37.728159 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caab5757-4d32-4d2d-9533-4380da659a98 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:37.728513 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caab5757-4d32-4d2d-9533-4380da659a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:37.728860 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caab5757-4d32-4d2d-9533-4380da659a98 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:37.729662 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caab5757-4d32-4d2d-9533-4380da659a98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:37.731702 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caab5757-4d32-4d2d-9533-4380da659a98 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:37.756951 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3206/6381] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:34:37 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:34:37.758979 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f26b0b-d578-4155-b200-75cb261900fd None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:37.759457 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f26b0b-d578-4155-b200-75cb261900fd None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:37.760012 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f26b0b-d578-4155-b200-75cb261900fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:37.786203 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-08f26b0b-d578-4155-b200-75cb261900fd None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:34:37.787747 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-08f26b0b-d578-4155-b200-75cb261900fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:37.797496 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3207/6382] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:34:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:34:37.798831 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f26b0b-d578-4155-b200-75cb261900fd None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:37.809571 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1e967d-3834-4443-b3af-656599ec28a1 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:37.819682 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c525d324-8793-4483-9f5c-b6da4a03877f tempest-CredentialsTestJSON-508638540 tempest-CredentialsTestJSON-508638540-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee6dc6326d854402ace906811c02d207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0de025a9cc0942b3b8d27d1e0988b39b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:37.820553 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c525d324-8793-4483-9f5c-b6da4a03877f tempest-CredentialsTestJSON-508638540 tempest-CredentialsTestJSON-508638540-project-admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:37.820993 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c525d324-8793-4483-9f5c-b6da4a03877f tempest-CredentialsTestJSON-508638540 tempest-CredentialsTestJSON-508638540-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:37.821410 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c525d324-8793-4483-9f5c-b6da4a03877f tempest-CredentialsTestJSON-508638540 tempest-CredentialsTestJSON-508638540-project-admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:37.822351 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c525d324-8793-4483-9f5c-b6da4a03877f tempest-CredentialsTestJSON-508638540 tempest-CredentialsTestJSON-508638540-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:37.824581 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f26b0b-d578-4155-b200-75cb261900fd None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:37.825694 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c525d324-8793-4483-9f5c-b6da4a03877f tempest-CredentialsTestJSON-508638540 tempest-CredentialsTestJSON-508638540-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:37.831301 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cba43c9-f8b8-44dd-b31f-2bb37e5f4656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:37.832703 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cba43c9-f8b8-44dd-b31f-2bb37e5f4656 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:37.833195 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cba43c9-f8b8-44dd-b31f-2bb37e5f4656 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:37.833618 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cba43c9-f8b8-44dd-b31f-2bb37e5f4656 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:37.834575 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cba43c9-f8b8-44dd-b31f-2bb37e5f4656 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:37.837111 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cba43c9-f8b8-44dd-b31f-2bb37e5f4656 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:37.851825 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3208/6383] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:34:37 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:34:37.853020 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cba43c9-f8b8-44dd-b31f-2bb37e5f4656 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:37.863689 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cba43c9-f8b8-44dd-b31f-2bb37e5f4656 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:37.870278 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f173a00-f4ae-45cd-af2c-e352a5824e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:37.871317 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f173a00-f4ae-45cd-af2c-e352a5824e3c admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:37.871822 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f173a00-f4ae-45cd-af2c-e352a5824e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:37.872243 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f173a00-f4ae-45cd-af2c-e352a5824e3c admin admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:37.873117 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f173a00-f4ae-45cd-af2c-e352a5824e3c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:34:37.874171 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f173a00-f4ae-45cd-af2c-e352a5824e3c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:37.877719 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3176/6384] 10.222.0.17 () {60 vars in 1151 bytes} [Sat Jul 23 21:34:37 2022] POST /identity/v3/projects => generated 349 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:34:37.877719 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c525d324-8793-4483-9f5c-b6da4a03877f tempest-CredentialsTestJSON-508638540 tempest-CredentialsTestJSON-508638540-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:37.879757 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f173a00-f4ae-45cd-af2c-e352a5824e3c admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:37.896082 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3209/6385] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:34:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:34:37.896541 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f173a00-f4ae-45cd-af2c-e352a5824e3c admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:37.909202 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f173a00-f4ae-45cd-af2c-e352a5824e3c admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:37.966521 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c525d324-8793-4483-9f5c-b6da4a03877f tempest-CredentialsTestJSON-508638540 tempest-CredentialsTestJSON-508638540-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:37.975928 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14291e08-aff1-4d51-bd5d-f5284c935aac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:37.977102 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14291e08-aff1-4d51-bd5d-f5284c935aac admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:37.977631 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14291e08-aff1-4d51-bd5d-f5284c935aac admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:37.978162 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14291e08-aff1-4d51-bd5d-f5284c935aac admin admin] PATH_INFO: `/v3/projects/e2fbac9ddb1c488c9f447d3d2122fb9e/users/a6ffeb2286094e5cbf9839c62a496411/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:37.999600 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14291e08-aff1-4d51-bd5d-f5284c935aac admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2fbac9ddb1c488c9f447d3d2122fb9e, user_id=a6ffeb2286094e5cbf9839c62a496411, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:38.002876 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1314865-ac95-44fa-99cf-6ba2f4c6171c tempest-CredentialsTestJSON-508638540 tempest-CredentialsTestJSON-508638540-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee6dc6326d854402ace906811c02d207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0de025a9cc0942b3b8d27d1e0988b39b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:38.003161 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14291e08-aff1-4d51-bd5d-f5284c935aac admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:38.004617 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1314865-ac95-44fa-99cf-6ba2f4c6171c tempest-CredentialsTestJSON-508638540 tempest-CredentialsTestJSON-508638540-project-admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:38.005031 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1314865-ac95-44fa-99cf-6ba2f4c6171c tempest-CredentialsTestJSON-508638540 tempest-CredentialsTestJSON-508638540-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:38.005400 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1314865-ac95-44fa-99cf-6ba2f4c6171c tempest-CredentialsTestJSON-508638540 tempest-CredentialsTestJSON-508638540-project-admin] PATH_INFO: `/v3/users/eed53e9aba1148f0b88447645d3b3fa5` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:38.007710 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1314865-ac95-44fa-99cf-6ba2f4c6171c tempest-CredentialsTestJSON-508638540 tempest-CredentialsTestJSON-508638540-project-admin] RBAC: Authorizing `identity:get_user(user_id=eed53e9aba1148f0b88447645d3b3fa5)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:38.012079 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1314865-ac95-44fa-99cf-6ba2f4c6171c tempest-CredentialsTestJSON-508638540 tempest-CredentialsTestJSON-508638540-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:38.016976 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3210/6386] 10.222.0.17 () {58 vars in 1220 bytes} [Sat Jul 23 21:34:37 2022] GET /identity/v3/users/eed53e9aba1148f0b88447645d3b3fa5 => generated 288 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:34:38.016976 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1314865-ac95-44fa-99cf-6ba2f4c6171c tempest-CredentialsTestJSON-508638540 tempest-CredentialsTestJSON-508638540-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:38.026843 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3177/6387] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:34:37 2022] PUT /identity/v3/projects/e2fbac9ddb1c488c9f447d3d2122fb9e/users/a6ffeb2286094e5cbf9839c62a496411/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:38.028281 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14291e08-aff1-4d51-bd5d-f5284c935aac admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:38.028913 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1314865-ac95-44fa-99cf-6ba2f4c6171c tempest-CredentialsTestJSON-508638540 tempest-CredentialsTestJSON-508638540-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:38.060994 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:38.128131 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7059630-a349-4135-a267-bf94294871f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:38.128728 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7059630-a349-4135-a267-bf94294871f2 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:38.129056 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7059630-a349-4135-a267-bf94294871f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:38.129335 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7059630-a349-4135-a267-bf94294871f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:38.130197 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7059630-a349-4135-a267-bf94294871f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:38.134527 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7059630-a349-4135-a267-bf94294871f2 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:38.137525 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14291e08-aff1-4d51-bd5d-f5284c935aac admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:38.143934 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a907c3a6-1d85-4b3e-bb96-e01f056a8183 tempest-CredentialsTestJSON-508638540 tempest-CredentialsTestJSON-508638540-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee6dc6326d854402ace906811c02d207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0de025a9cc0942b3b8d27d1e0988b39b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:38.144632 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a907c3a6-1d85-4b3e-bb96-e01f056a8183 tempest-CredentialsTestJSON-508638540 tempest-CredentialsTestJSON-508638540-project-admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:38.144919 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a907c3a6-1d85-4b3e-bb96-e01f056a8183 tempest-CredentialsTestJSON-508638540 tempest-CredentialsTestJSON-508638540-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:38.145202 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a907c3a6-1d85-4b3e-bb96-e01f056a8183 tempest-CredentialsTestJSON-508638540 tempest-CredentialsTestJSON-508638540-project-admin] PATH_INFO: `/v3/credentials` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:38.146018 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a907c3a6-1d85-4b3e-bb96-e01f056a8183 tempest-CredentialsTestJSON-508638540 tempest-CredentialsTestJSON-508638540-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:38.149931 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a907c3a6-1d85-4b3e-bb96-e01f056a8183 tempest-CredentialsTestJSON-508638540 tempest-CredentialsTestJSON-508638540-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:38.168930 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3211/6388] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:34:38 2022] POST /identity/v3/projects => generated 385 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:34:38.170709 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd361259-c202-4b20-82f0-62409c6f6f66 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:38.171004 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd361259-c202-4b20-82f0-62409c6f6f66 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:38.171285 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd361259-c202-4b20-82f0-62409c6f6f66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:38.180486 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:38.204824 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3178/6389] 10.222.0.17 () {60 vars in 1161 bytes} [Sat Jul 23 21:34:38 2022] POST /identity/v3/credentials => generated 431 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:34:38.206490 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a907c3a6-1d85-4b3e-bb96-e01f056a8183 tempest-CredentialsTestJSON-508638540 tempest-CredentialsTestJSON-508638540-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:38.245838 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a907c3a6-1d85-4b3e-bb96-e01f056a8183 tempest-CredentialsTestJSON-508638540 tempest-CredentialsTestJSON-508638540-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:38.250418 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-bd361259-c202-4b20-82f0-62409c6f6f66 None None] MFA Rules not processed for user `a6ffeb2286094e5cbf9839c62a496411`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:34:38.251654 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-bd361259-c202-4b20-82f0-62409c6f6f66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:38.360340 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01113f9-3fa8-4acf-8d41-8498e44ee8bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:38.361316 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01113f9-3fa8-4acf-8d41-8498e44ee8bf admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:38.361606 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01113f9-3fa8-4acf-8d41-8498e44ee8bf admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:38.362096 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01113f9-3fa8-4acf-8d41-8498e44ee8bf admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:38.362886 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01113f9-3fa8-4acf-8d41-8498e44ee8bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:38.365665 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01113f9-3fa8-4acf-8d41-8498e44ee8bf admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:38.374510 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3212/6390] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:34:38 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:34:38.375568 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd361259-c202-4b20-82f0-62409c6f6f66 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:38.414451 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3179/6391] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:34:38 2022] POST /identity/v3/users => generated 293 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:34:38.415622 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01113f9-3fa8-4acf-8d41-8498e44ee8bf admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:38.417598 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-d01113f9-3fa8-4acf-8d41-8498e44ee8bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:38.460551 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd361259-c202-4b20-82f0-62409c6f6f66 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:38.468837 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e43663-cd94-40da-a9ee-eeef65c16db2 tempest-CredentialsTestJSON-508638540 tempest-CredentialsTestJSON-508638540-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee6dc6326d854402ace906811c02d207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0de025a9cc0942b3b8d27d1e0988b39b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:38.470095 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e43663-cd94-40da-a9ee-eeef65c16db2 tempest-CredentialsTestJSON-508638540 tempest-CredentialsTestJSON-508638540-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:38.470709 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e43663-cd94-40da-a9ee-eeef65c16db2 tempest-CredentialsTestJSON-508638540 tempest-CredentialsTestJSON-508638540-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:38.471204 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e43663-cd94-40da-a9ee-eeef65c16db2 tempest-CredentialsTestJSON-508638540 tempest-CredentialsTestJSON-508638540-project-admin] PATH_INFO: `/v3/credentials/7a9fedaa531cf7eea31116094340d113f1a8ba989785c5742dc25cb688dcb5dc` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:38.486356 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e43663-cd94-40da-a9ee-eeef65c16db2 tempest-CredentialsTestJSON-508638540 tempest-CredentialsTestJSON-508638540-project-admin] RBAC: Authorizing `identity:update_credential(credential_id=7a9fedaa531cf7eea31116094340d113f1a8ba989785c5742dc25cb688dcb5dc)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:38.491257 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e43663-cd94-40da-a9ee-eeef65c16db2 tempest-CredentialsTestJSON-508638540 tempest-CredentialsTestJSON-508638540-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:38.497712 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e43663-cd94-40da-a9ee-eeef65c16db2 tempest-CredentialsTestJSON-508638540 tempest-CredentialsTestJSON-508638540-project-admin] RBAC: Authorizing `identity:update_credential(credential_id=7a9fedaa531cf7eea31116094340d113f1a8ba989785c5742dc25cb688dcb5dc)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:38.503641 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e43663-cd94-40da-a9ee-eeef65c16db2 tempest-CredentialsTestJSON-508638540 tempest-CredentialsTestJSON-508638540-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:38.511602 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01113f9-3fa8-4acf-8d41-8498e44ee8bf admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:38.517082 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103e09bd-e3b8-46d8-b723-dfd38390ea42 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7f2db148c8e4d5d81431cae3576434b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:38.517763 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103e09bd-e3b8-46d8-b723-dfd38390ea42 service glance] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:38.518071 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103e09bd-e3b8-46d8-b723-dfd38390ea42 service glance] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:38.518357 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103e09bd-e3b8-46d8-b723-dfd38390ea42 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:38.529456 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103e09bd-e3b8-46d8-b723-dfd38390ea42 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:38.531191 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103e09bd-e3b8-46d8-b723-dfd38390ea42 service glance] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:38.539343 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3213/6392] 10.222.0.17 () {60 vars in 1357 bytes} [Sat Jul 23 21:34:38 2022] PATCH /identity/v3/credentials/7a9fedaa531cf7eea31116094340d113f1a8ba989785c5742dc25cb688dcb5dc => generated 435 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:34:38.540797 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e43663-cd94-40da-a9ee-eeef65c16db2 tempest-CredentialsTestJSON-508638540 tempest-CredentialsTestJSON-508638540-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:38.543306 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3180/6393] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:34:38 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:34:38.554580 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103e09bd-e3b8-46d8-b723-dfd38390ea42 service glance] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:38.558404 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e43663-cd94-40da-a9ee-eeef65c16db2 tempest-CredentialsTestJSON-508638540 tempest-CredentialsTestJSON-508638540-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:38.567764 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957c8295-f442-4c28-b6c8-c14e3954b1d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:38.568592 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957c8295-f442-4c28-b6c8-c14e3954b1d5 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:38.568965 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957c8295-f442-4c28-b6c8-c14e3954b1d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:38.569449 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957c8295-f442-4c28-b6c8-c14e3954b1d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:38.570420 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103e09bd-e3b8-46d8-b723-dfd38390ea42 service glance] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:38.571217 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957c8295-f442-4c28-b6c8-c14e3954b1d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:38.573283 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957c8295-f442-4c28-b6c8-c14e3954b1d5 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:38.575372 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8d334e-0b55-4c29-a976-6d7f5bd3099e tempest-CredentialsTestJSON-508638540 tempest-CredentialsTestJSON-508638540-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee6dc6326d854402ace906811c02d207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0de025a9cc0942b3b8d27d1e0988b39b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:38.581038 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8d334e-0b55-4c29-a976-6d7f5bd3099e tempest-CredentialsTestJSON-508638540 tempest-CredentialsTestJSON-508638540-project-admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:38.581452 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8d334e-0b55-4c29-a976-6d7f5bd3099e tempest-CredentialsTestJSON-508638540 tempest-CredentialsTestJSON-508638540-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:38.581708 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8d334e-0b55-4c29-a976-6d7f5bd3099e tempest-CredentialsTestJSON-508638540 tempest-CredentialsTestJSON-508638540-project-admin] PATH_INFO: `/v3/credentials/7a9fedaa531cf7eea31116094340d113f1a8ba989785c5742dc25cb688dcb5dc` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:38.584478 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8d334e-0b55-4c29-a976-6d7f5bd3099e tempest-CredentialsTestJSON-508638540 tempest-CredentialsTestJSON-508638540-project-admin] RBAC: Authorizing `identity:get_credential(credential_id=7a9fedaa531cf7eea31116094340d113f1a8ba989785c5742dc25cb688dcb5dc)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:38.586755 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8d334e-0b55-4c29-a976-6d7f5bd3099e tempest-CredentialsTestJSON-508638540 tempest-CredentialsTestJSON-508638540-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:38.589404 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3181/6394] 10.222.0.17 () {58 vars in 1334 bytes} [Sat Jul 23 21:34:38 2022] GET /identity/v3/credentials/7a9fedaa531cf7eea31116094340d113f1a8ba989785c5742dc25cb688dcb5dc => generated 435 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:34:38.595088 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3214/6395] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:34:38 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:34:38.596208 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8d334e-0b55-4c29-a976-6d7f5bd3099e tempest-CredentialsTestJSON-508638540 tempest-CredentialsTestJSON-508638540-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:38.599877 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957c8295-f442-4c28-b6c8-c14e3954b1d5 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:38.613074 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8d334e-0b55-4c29-a976-6d7f5bd3099e tempest-CredentialsTestJSON-508638540 tempest-CredentialsTestJSON-508638540-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:38.621416 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957c8295-f442-4c28-b6c8-c14e3954b1d5 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:38.623756 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25900b10-791d-4f9d-bf8d-a5fca162ce27 tempest-CredentialsTestJSON-508638540 tempest-CredentialsTestJSON-508638540-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee6dc6326d854402ace906811c02d207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0de025a9cc0942b3b8d27d1e0988b39b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:38.624823 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25900b10-791d-4f9d-bf8d-a5fca162ce27 tempest-CredentialsTestJSON-508638540 tempest-CredentialsTestJSON-508638540-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:38.625164 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25900b10-791d-4f9d-bf8d-a5fca162ce27 tempest-CredentialsTestJSON-508638540 tempest-CredentialsTestJSON-508638540-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:38.625536 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25900b10-791d-4f9d-bf8d-a5fca162ce27 tempest-CredentialsTestJSON-508638540 tempest-CredentialsTestJSON-508638540-project-admin] PATH_INFO: `/v3/credentials/7a9fedaa531cf7eea31116094340d113f1a8ba989785c5742dc25cb688dcb5dc` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:38.627297 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43055a4e-f863-47ac-a001-5889c651179c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:38.627710 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25900b10-791d-4f9d-bf8d-a5fca162ce27 tempest-CredentialsTestJSON-508638540 tempest-CredentialsTestJSON-508638540-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=7a9fedaa531cf7eea31116094340d113f1a8ba989785c5742dc25cb688dcb5dc)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:38.628145 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43055a4e-f863-47ac-a001-5889c651179c admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:38.628488 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43055a4e-f863-47ac-a001-5889c651179c admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:38.628862 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43055a4e-f863-47ac-a001-5889c651179c admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:38.630200 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43055a4e-f863-47ac-a001-5889c651179c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:38.634570 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25900b10-791d-4f9d-bf8d-a5fca162ce27 tempest-CredentialsTestJSON-508638540 tempest-CredentialsTestJSON-508638540-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:38.635125 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43055a4e-f863-47ac-a001-5889c651179c admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:38.653313 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3215/6396] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:34:38 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:34:38.658598 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43055a4e-f863-47ac-a001-5889c651179c admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:38.664039 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3182/6397] 10.222.0.17 () {58 vars in 1337 bytes} [Sat Jul 23 21:34:38 2022] DELETE /identity/v3/credentials/7a9fedaa531cf7eea31116094340d113f1a8ba989785c5742dc25cb688dcb5dc => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:38.669733 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25900b10-791d-4f9d-bf8d-a5fca162ce27 tempest-CredentialsTestJSON-508638540 tempest-CredentialsTestJSON-508638540-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:38.676817 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43055a4e-f863-47ac-a001-5889c651179c admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:38.682489 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25900b10-791d-4f9d-bf8d-a5fca162ce27 tempest-CredentialsTestJSON-508638540 tempest-CredentialsTestJSON-508638540-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:38.683038 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e6df93-5df0-4ba5-9c8a-456596b96598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:38.683948 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e6df93-5df0-4ba5-9c8a-456596b96598 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:38.684252 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e6df93-5df0-4ba5-9c8a-456596b96598 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:38.684526 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e6df93-5df0-4ba5-9c8a-456596b96598 admin admin] PATH_INFO: `/v3/projects/abe9428815bd479f96bb97e74e72337b/users/b81f706e95bd481394751229c7e658f2/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:38.688620 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94f4586-94d3-43cc-a5f1-843ff927c6df tempest-CredentialsTestJSON-508638540 tempest-CredentialsTestJSON-508638540-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee6dc6326d854402ace906811c02d207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0de025a9cc0942b3b8d27d1e0988b39b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:38.689382 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94f4586-94d3-43cc-a5f1-843ff927c6df tempest-CredentialsTestJSON-508638540 tempest-CredentialsTestJSON-508638540-project-admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:38.689718 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94f4586-94d3-43cc-a5f1-843ff927c6df tempest-CredentialsTestJSON-508638540 tempest-CredentialsTestJSON-508638540-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:38.690333 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94f4586-94d3-43cc-a5f1-843ff927c6df tempest-CredentialsTestJSON-508638540 tempest-CredentialsTestJSON-508638540-project-admin] PATH_INFO: `/v3/credentials` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:38.691012 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94f4586-94d3-43cc-a5f1-843ff927c6df tempest-CredentialsTestJSON-508638540 tempest-CredentialsTestJSON-508638540-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:38.692794 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94f4586-94d3-43cc-a5f1-843ff927c6df tempest-CredentialsTestJSON-508638540 tempest-CredentialsTestJSON-508638540-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:38.704673 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e6df93-5df0-4ba5-9c8a-456596b96598 admin admin] RBAC: Authorizing `identity:create_grant(project_id=abe9428815bd479f96bb97e74e72337b, user_id=b81f706e95bd481394751229c7e658f2, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:38.708095 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e6df93-5df0-4ba5-9c8a-456596b96598 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:38.712381 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3183/6398] 10.222.0.17 () {60 vars in 1161 bytes} [Sat Jul 23 21:34:38 2022] POST /identity/v3/credentials => generated 429 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:34:38.713700 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94f4586-94d3-43cc-a5f1-843ff927c6df tempest-CredentialsTestJSON-508638540 tempest-CredentialsTestJSON-508638540-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:38.729561 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3216/6399] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:34:38 2022] PUT /identity/v3/projects/abe9428815bd479f96bb97e74e72337b/users/b81f706e95bd481394751229c7e658f2/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:38.730586 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e6df93-5df0-4ba5-9c8a-456596b96598 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:38.746815 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94f4586-94d3-43cc-a5f1-843ff927c6df tempest-CredentialsTestJSON-508638540 tempest-CredentialsTestJSON-508638540-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:38.758883 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:38.799953 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=98,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:38.815265 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e6df93-5df0-4ba5-9c8a-456596b96598 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:38.821577 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f075c93a-895b-45bc-9305-bfefd480ed81 tempest-CredentialsTestJSON-508638540 tempest-CredentialsTestJSON-508638540-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee6dc6326d854402ace906811c02d207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0de025a9cc0942b3b8d27d1e0988b39b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:38.822832 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f075c93a-895b-45bc-9305-bfefd480ed81 tempest-CredentialsTestJSON-508638540 tempest-CredentialsTestJSON-508638540-project-admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:38.823168 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f075c93a-895b-45bc-9305-bfefd480ed81 tempest-CredentialsTestJSON-508638540 tempest-CredentialsTestJSON-508638540-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:38.823751 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f075c93a-895b-45bc-9305-bfefd480ed81 tempest-CredentialsTestJSON-508638540 tempest-CredentialsTestJSON-508638540-project-admin] PATH_INFO: `/v3/credentials` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:38.824562 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f075c93a-895b-45bc-9305-bfefd480ed81 tempest-CredentialsTestJSON-508638540 tempest-CredentialsTestJSON-508638540-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:38.826400 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f075c93a-895b-45bc-9305-bfefd480ed81 tempest-CredentialsTestJSON-508638540 tempest-CredentialsTestJSON-508638540-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:38.837828 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176796b2-eb41-413e-9abb-3b8fe2a761b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:38.838976 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176796b2-eb41-413e-9abb-3b8fe2a761b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:38.839349 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176796b2-eb41-413e-9abb-3b8fe2a761b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:38.839708 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176796b2-eb41-413e-9abb-3b8fe2a761b0 admin admin] PATH_INFO: `/v3/users/a6ffeb2286094e5cbf9839c62a496411` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:38.842232 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176796b2-eb41-413e-9abb-3b8fe2a761b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6ffeb2286094e5cbf9839c62a496411)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:38.845545 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176796b2-eb41-413e-9abb-3b8fe2a761b0 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:38.860716 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3217/6400] 10.222.0.17 () {60 vars in 1161 bytes} [Sat Jul 23 21:34:38 2022] POST /identity/v3/credentials => generated 429 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:34:38.862408 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae74b068-839f-4c43-abff-dfb0b971b6f2 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:38.862773 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae74b068-839f-4c43-abff-dfb0b971b6f2 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:38.863298 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae74b068-839f-4c43-abff-dfb0b971b6f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:38.904832 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-ae74b068-839f-4c43-abff-dfb0b971b6f2 None None] MFA Rules not processed for user `b81f706e95bd481394751229c7e658f2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:34:38.906101 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-ae74b068-839f-4c43-abff-dfb0b971b6f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:38.930466 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-176796b2-eb41-413e-9abb-3b8fe2a761b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6ffeb2286094e5cbf9839c62a496411'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:38.941677 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-176796b2-eb41-413e-9abb-3b8fe2a761b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6ffeb2286094e5cbf9839c62a496411'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:38.942816 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-176796b2-eb41-413e-9abb-3b8fe2a761b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6ffeb2286094e5cbf9839c62a496411'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:38.961617 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-176796b2-eb41-413e-9abb-3b8fe2a761b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6ffeb2286094e5cbf9839c62a496411'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:38.977390 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-176796b2-eb41-413e-9abb-3b8fe2a761b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6ffeb2286094e5cbf9839c62a496411'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:38.984964 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3184/6401] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:34:38 2022] DELETE /identity/v3/users/a6ffeb2286094e5cbf9839c62a496411 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:38.986058 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176796b2-eb41-413e-9abb-3b8fe2a761b0 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:38.987947 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-176796b2-eb41-413e-9abb-3b8fe2a761b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:39.011430 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3218/6402] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:34:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:34:39.012879 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cde141-fe9c-46ca-bba5-10ee318cb555 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:39.013321 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cde141-fe9c-46ca-bba5-10ee318cb555 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:39.014106 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cde141-fe9c-46ca-bba5-10ee318cb555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:39.037047 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-04cde141-fe9c-46ca-bba5-10ee318cb555 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:34:39.038949 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-04cde141-fe9c-46ca-bba5-10ee318cb555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:39.083161 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176796b2-eb41-413e-9abb-3b8fe2a761b0 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:39.097316 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3156fd-c953-4ef5-b031-925ea424d7a5 tempest-CredentialsTestJSON-508638540 tempest-CredentialsTestJSON-508638540-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee6dc6326d854402ace906811c02d207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0de025a9cc0942b3b8d27d1e0988b39b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:39.098187 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3156fd-c953-4ef5-b031-925ea424d7a5 tempest-CredentialsTestJSON-508638540 tempest-CredentialsTestJSON-508638540-project-admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:39.098751 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3156fd-c953-4ef5-b031-925ea424d7a5 tempest-CredentialsTestJSON-508638540 tempest-CredentialsTestJSON-508638540-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:39.099400 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3156fd-c953-4ef5-b031-925ea424d7a5 tempest-CredentialsTestJSON-508638540 tempest-CredentialsTestJSON-508638540-project-admin] PATH_INFO: `/v3/credentials` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:39.100711 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3156fd-c953-4ef5-b031-925ea424d7a5 tempest-CredentialsTestJSON-508638540 tempest-CredentialsTestJSON-508638540-project-admin] RBAC: Authorizing `identity:list_credentials()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:39.102550 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3156fd-c953-4ef5-b031-925ea424d7a5 tempest-CredentialsTestJSON-508638540 tempest-CredentialsTestJSON-508638540-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:39.121508 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3156fd-c953-4ef5-b031-925ea424d7a5 tempest-CredentialsTestJSON-508638540 tempest-CredentialsTestJSON-508638540-project-admin] RBAC: Authorizing `identity:get_credential()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:39.124521 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3156fd-c953-4ef5-b031-925ea424d7a5 tempest-CredentialsTestJSON-508638540 tempest-CredentialsTestJSON-508638540-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:39.127324 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3156fd-c953-4ef5-b031-925ea424d7a5 tempest-CredentialsTestJSON-508638540 tempest-CredentialsTestJSON-508638540-project-admin] RBAC: Authorizing `identity:get_credential()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:39.128982 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3156fd-c953-4ef5-b031-925ea424d7a5 tempest-CredentialsTestJSON-508638540 tempest-CredentialsTestJSON-508638540-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:39.131233 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3185/6403] 10.222.0.17 () {58 vars in 1139 bytes} [Sat Jul 23 21:34:38 2022] GET /identity/v3/credentials => generated 943 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:34:39.137074 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3156fd-c953-4ef5-b031-925ea424d7a5 tempest-CredentialsTestJSON-508638540 tempest-CredentialsTestJSON-508638540-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:39.143363 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-6b3156fd-c953-4ef5-b031-925ea424d7a5 tempest-CredentialsTestJSON-508638540 tempest-CredentialsTestJSON-508638540-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:39.155550 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3219/6404] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:34:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:34:39.156486 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cde141-fe9c-46ca-bba5-10ee318cb555 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:39.174196 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cde141-fe9c-46ca-bba5-10ee318cb555 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:39.179237 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bfaa3a-bf5f-450d-9e7b-7aef57f914dc tempest-CredentialsTestJSON-508638540 tempest-CredentialsTestJSON-508638540-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee6dc6326d854402ace906811c02d207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0de025a9cc0942b3b8d27d1e0988b39b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:39.180529 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bfaa3a-bf5f-450d-9e7b-7aef57f914dc tempest-CredentialsTestJSON-508638540 tempest-CredentialsTestJSON-508638540-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:39.180920 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bfaa3a-bf5f-450d-9e7b-7aef57f914dc tempest-CredentialsTestJSON-508638540 tempest-CredentialsTestJSON-508638540-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:39.181198 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bfaa3a-bf5f-450d-9e7b-7aef57f914dc tempest-CredentialsTestJSON-508638540 tempest-CredentialsTestJSON-508638540-project-admin] PATH_INFO: `/v3/credentials/2f2738c0ef8c1089e0122fd0d12f63e6e9031ec68af938165595cce70461ccd2` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:39.183419 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bfaa3a-bf5f-450d-9e7b-7aef57f914dc tempest-CredentialsTestJSON-508638540 tempest-CredentialsTestJSON-508638540-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=2f2738c0ef8c1089e0122fd0d12f63e6e9031ec68af938165595cce70461ccd2)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:39.185899 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bfaa3a-bf5f-450d-9e7b-7aef57f914dc tempest-CredentialsTestJSON-508638540 tempest-CredentialsTestJSON-508638540-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:39.206705 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:39.229313 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3220/6405] 10.222.0.17 () {58 vars in 1337 bytes} [Sat Jul 23 21:34:39 2022] DELETE /identity/v3/credentials/2f2738c0ef8c1089e0122fd0d12f63e6e9031ec68af938165595cce70461ccd2 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:39.231717 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bfaa3a-bf5f-450d-9e7b-7aef57f914dc tempest-CredentialsTestJSON-508638540 tempest-CredentialsTestJSON-508638540-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:39.243614 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bfaa3a-bf5f-450d-9e7b-7aef57f914dc tempest-CredentialsTestJSON-508638540 tempest-CredentialsTestJSON-508638540-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:39.250252 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1184ef-1842-4b3b-9738-8d3e7a2fd183 tempest-CredentialsTestJSON-508638540 tempest-CredentialsTestJSON-508638540-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee6dc6326d854402ace906811c02d207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0de025a9cc0942b3b8d27d1e0988b39b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:39.251664 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1184ef-1842-4b3b-9738-8d3e7a2fd183 tempest-CredentialsTestJSON-508638540 tempest-CredentialsTestJSON-508638540-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:39.253049 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1184ef-1842-4b3b-9738-8d3e7a2fd183 tempest-CredentialsTestJSON-508638540 tempest-CredentialsTestJSON-508638540-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:39.253541 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1184ef-1842-4b3b-9738-8d3e7a2fd183 tempest-CredentialsTestJSON-508638540 tempest-CredentialsTestJSON-508638540-project-admin] PATH_INFO: `/v3/credentials/83d8219711714d366c74803c4a3f8ed02b6c4b5a16453fd34dfd299dd8fc7461` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:39.256411 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1184ef-1842-4b3b-9738-8d3e7a2fd183 tempest-CredentialsTestJSON-508638540 tempest-CredentialsTestJSON-508638540-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=83d8219711714d366c74803c4a3f8ed02b6c4b5a16453fd34dfd299dd8fc7461)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:39.259006 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1184ef-1842-4b3b-9738-8d3e7a2fd183 tempest-CredentialsTestJSON-508638540 tempest-CredentialsTestJSON-508638540-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:39.269688 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3156fd-c953-4ef5-b031-925ea424d7a5 tempest-CredentialsTestJSON-508638540 tempest-CredentialsTestJSON-508638540-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:39.282783 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e281e558-4932-4ce4-8716-202293aa3b00 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:39.283869 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3221/6406] 10.222.0.17 () {58 vars in 1337 bytes} [Sat Jul 23 21:34:39 2022] DELETE /identity/v3/credentials/83d8219711714d366c74803c4a3f8ed02b6c4b5a16453fd34dfd299dd8fc7461 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:39.284476 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e281e558-4932-4ce4-8716-202293aa3b00 service nova] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:39.284992 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e281e558-4932-4ce4-8716-202293aa3b00 service nova] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:39.285478 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e281e558-4932-4ce4-8716-202293aa3b00 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:39.288537 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1184ef-1842-4b3b-9738-8d3e7a2fd183 tempest-CredentialsTestJSON-508638540 tempest-CredentialsTestJSON-508638540-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:39.290678 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-cf1184ef-1842-4b3b-9738-8d3e7a2fd183 tempest-CredentialsTestJSON-508638540 tempest-CredentialsTestJSON-508638540-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:39.339767 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:39.368144 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1184ef-1842-4b3b-9738-8d3e7a2fd183 tempest-CredentialsTestJSON-508638540 tempest-CredentialsTestJSON-508638540-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:39.368760 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e281e558-4932-4ce4-8716-202293aa3b00 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:39.371532 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e281e558-4932-4ce4-8716-202293aa3b00 service nova] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:39.372650 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba827dd-9af1-433e-a6f3-21649ee453c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:39.373436 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba827dd-9af1-433e-a6f3-21649ee453c3 service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:39.373811 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba827dd-9af1-433e-a6f3-21649ee453c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:39.374211 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba827dd-9af1-433e-a6f3-21649ee453c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:39.384478 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3186/6407] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:34:39 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:34:39.385595 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e281e558-4932-4ce4-8716-202293aa3b00 service nova] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:39.385839 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba827dd-9af1-433e-a6f3-21649ee453c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:39.387591 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba827dd-9af1-433e-a6f3-21649ee453c3 service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:39.398779 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3222/6408] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:34:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:34:39.400352 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e281e558-4932-4ce4-8716-202293aa3b00 service nova] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:39.405246 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b7fa2d-ffd1-49a9-aa88-d173730947f8 tempest-CredentialsTestJSON-508638540 tempest-CredentialsTestJSON-508638540-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee6dc6326d854402ace906811c02d207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0de025a9cc0942b3b8d27d1e0988b39b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:39.406216 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b7fa2d-ffd1-49a9-aa88-d173730947f8 tempest-CredentialsTestJSON-508638540 tempest-CredentialsTestJSON-508638540-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:39.406500 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b7fa2d-ffd1-49a9-aa88-d173730947f8 tempest-CredentialsTestJSON-508638540 tempest-CredentialsTestJSON-508638540-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:39.406916 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b7fa2d-ffd1-49a9-aa88-d173730947f8 tempest-CredentialsTestJSON-508638540 tempest-CredentialsTestJSON-508638540-project-admin] PATH_INFO: `/v3/projects/3b9ec346675549e48acad91e6b850e9e` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:39.408154 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b7fa2d-ffd1-49a9-aa88-d173730947f8 tempest-CredentialsTestJSON-508638540 tempest-CredentialsTestJSON-508638540-project-admin] RBAC: Authorizing `identity:delete_project(project_id=3b9ec346675549e48acad91e6b850e9e)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:39.410235 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b7fa2d-ffd1-49a9-aa88-d173730947f8 tempest-CredentialsTestJSON-508638540 tempest-CredentialsTestJSON-508638540-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:39.499422 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-92b7fa2d-ffd1-49a9-aa88-d173730947f8 tempest-CredentialsTestJSON-508638540 tempest-CredentialsTestJSON-508638540-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b9ec346675549e48acad91e6b850e9e', 'request_id': 'req-92b7fa2d-ffd1-49a9-aa88-d173730947f8'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:39.511047 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-92b7fa2d-ffd1-49a9-aa88-d173730947f8 tempest-CredentialsTestJSON-508638540 tempest-CredentialsTestJSON-508638540-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b9ec346675549e48acad91e6b850e9e', 'request_id': 'req-92b7fa2d-ffd1-49a9-aa88-d173730947f8'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:39.518329 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-92b7fa2d-ffd1-49a9-aa88-d173730947f8 tempest-CredentialsTestJSON-508638540 tempest-CredentialsTestJSON-508638540-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b9ec346675549e48acad91e6b850e9e', 'request_id': 'req-92b7fa2d-ffd1-49a9-aa88-d173730947f8'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:39.533757 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-92b7fa2d-ffd1-49a9-aa88-d173730947f8 tempest-CredentialsTestJSON-508638540 tempest-CredentialsTestJSON-508638540-project-admin] The token cache is being invalidate because project 3b9ec346675549e48acad91e6b850e9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:34:39.534238 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-92b7fa2d-ffd1-49a9-aa88-d173730947f8 tempest-CredentialsTestJSON-508638540 tempest-CredentialsTestJSON-508638540-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:39.534867 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-92b7fa2d-ffd1-49a9-aa88-d173730947f8 tempest-CredentialsTestJSON-508638540 tempest-CredentialsTestJSON-508638540-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:39.540590 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3187/6409] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:34:39 2022] DELETE /identity/v3/projects/3b9ec346675549e48acad91e6b850e9e => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:39.542477 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba827dd-9af1-433e-a6f3-21649ee453c3 service neutron] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:39.555391 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba827dd-9af1-433e-a6f3-21649ee453c3 service neutron] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:39.653999 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70f8ae6-866e-4304-95cc-e5e386291565 tempest-CredentialsTestJSON-508638540 tempest-CredentialsTestJSON-508638540-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee6dc6326d854402ace906811c02d207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0de025a9cc0942b3b8d27d1e0988b39b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:39.655248 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70f8ae6-866e-4304-95cc-e5e386291565 tempest-CredentialsTestJSON-508638540 tempest-CredentialsTestJSON-508638540-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:39.655602 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70f8ae6-866e-4304-95cc-e5e386291565 tempest-CredentialsTestJSON-508638540 tempest-CredentialsTestJSON-508638540-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:39.655909 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70f8ae6-866e-4304-95cc-e5e386291565 tempest-CredentialsTestJSON-508638540 tempest-CredentialsTestJSON-508638540-project-admin] PATH_INFO: `/v3/projects/dc6940fc438b48e4b6c38c4d62601a7b` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:39.662504 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70f8ae6-866e-4304-95cc-e5e386291565 tempest-CredentialsTestJSON-508638540 tempest-CredentialsTestJSON-508638540-project-admin] RBAC: Authorizing `identity:delete_project(project_id=dc6940fc438b48e4b6c38c4d62601a7b)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:39.665557 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70f8ae6-866e-4304-95cc-e5e386291565 tempest-CredentialsTestJSON-508638540 tempest-CredentialsTestJSON-508638540-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:39.765998 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c70f8ae6-866e-4304-95cc-e5e386291565 tempest-CredentialsTestJSON-508638540 tempest-CredentialsTestJSON-508638540-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc6940fc438b48e4b6c38c4d62601a7b', 'request_id': 'req-c70f8ae6-866e-4304-95cc-e5e386291565'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:39.784236 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c70f8ae6-866e-4304-95cc-e5e386291565 tempest-CredentialsTestJSON-508638540 tempest-CredentialsTestJSON-508638540-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc6940fc438b48e4b6c38c4d62601a7b', 'request_id': 'req-c70f8ae6-866e-4304-95cc-e5e386291565'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:39.814709 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c70f8ae6-866e-4304-95cc-e5e386291565 tempest-CredentialsTestJSON-508638540 tempest-CredentialsTestJSON-508638540-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc6940fc438b48e4b6c38c4d62601a7b', 'request_id': 'req-c70f8ae6-866e-4304-95cc-e5e386291565'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:39.855740 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c70f8ae6-866e-4304-95cc-e5e386291565 tempest-CredentialsTestJSON-508638540 tempest-CredentialsTestJSON-508638540-project-admin] The token cache is being invalidate because project dc6940fc438b48e4b6c38c4d62601a7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:34:39.856364 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c70f8ae6-866e-4304-95cc-e5e386291565 tempest-CredentialsTestJSON-508638540 tempest-CredentialsTestJSON-508638540-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:39.861604 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c70f8ae6-866e-4304-95cc-e5e386291565 tempest-CredentialsTestJSON-508638540 tempest-CredentialsTestJSON-508638540-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:39.867089 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3223/6410] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:34:39 2022] DELETE /identity/v3/projects/dc6940fc438b48e4b6c38c4d62601a7b => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:39.871124 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b7fa2d-ffd1-49a9-aa88-d173730947f8 tempest-CredentialsTestJSON-508638540 tempest-CredentialsTestJSON-508638540-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:39.872691 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-92b7fa2d-ffd1-49a9-aa88-d173730947f8 tempest-CredentialsTestJSON-508638540 tempest-CredentialsTestJSON-508638540-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:40.014702 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70f8ae6-866e-4304-95cc-e5e386291565 tempest-CredentialsTestJSON-508638540 tempest-CredentialsTestJSON-508638540-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:40.015812 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-c70f8ae6-866e-4304-95cc-e5e386291565 tempest-CredentialsTestJSON-508638540 tempest-CredentialsTestJSON-508638540-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:40.041009 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:40.063537 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b7fa2d-ffd1-49a9-aa88-d173730947f8 tempest-CredentialsTestJSON-508638540 tempest-CredentialsTestJSON-508638540-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:40.115920 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70f8ae6-866e-4304-95cc-e5e386291565 tempest-CredentialsTestJSON-508638540 tempest-CredentialsTestJSON-508638540-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:40.121302 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c3a0d7-9a77-4764-bfa3-1dd08c8f7cfb tempest-QuotasNegativeTest-434732875 tempest-QuotasNegativeTest-434732875-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbc7092d01464ead81c9bf7156a90405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44974b353e804139a110f4005cffa04d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:40.122372 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c3a0d7-9a77-4764-bfa3-1dd08c8f7cfb tempest-QuotasNegativeTest-434732875 tempest-QuotasNegativeTest-434732875-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:40.122754 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c3a0d7-9a77-4764-bfa3-1dd08c8f7cfb tempest-QuotasNegativeTest-434732875 tempest-QuotasNegativeTest-434732875-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:40.123300 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c3a0d7-9a77-4764-bfa3-1dd08c8f7cfb tempest-QuotasNegativeTest-434732875 tempest-QuotasNegativeTest-434732875-project-admin] PATH_INFO: `/v3/projects/06163a5a8c2943569f4189edc7a4bac5` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:40.124656 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c3a0d7-9a77-4764-bfa3-1dd08c8f7cfb tempest-QuotasNegativeTest-434732875 tempest-QuotasNegativeTest-434732875-project-admin] RBAC: Authorizing `identity:delete_project(project_id=06163a5a8c2943569f4189edc7a4bac5)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:40.126772 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c3a0d7-9a77-4764-bfa3-1dd08c8f7cfb tempest-QuotasNegativeTest-434732875 tempest-QuotasNegativeTest-434732875-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:40.136663 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17590ee0-a0a8-4dd8-9526-ceb9d87f2654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:40.138080 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17590ee0-a0a8-4dd8-9526-ceb9d87f2654 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:40.138672 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17590ee0-a0a8-4dd8-9526-ceb9d87f2654 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:40.139022 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17590ee0-a0a8-4dd8-9526-ceb9d87f2654 admin admin] PATH_INFO: `/v3/users/eed53e9aba1148f0b88447645d3b3fa5` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:40.140529 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17590ee0-a0a8-4dd8-9526-ceb9d87f2654 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eed53e9aba1148f0b88447645d3b3fa5)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:40.141327 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:40.142868 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17590ee0-a0a8-4dd8-9526-ceb9d87f2654 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:40.189501 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-54c3a0d7-9a77-4764-bfa3-1dd08c8f7cfb tempest-QuotasNegativeTest-434732875 tempest-QuotasNegativeTest-434732875-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06163a5a8c2943569f4189edc7a4bac5', 'request_id': 'req-54c3a0d7-9a77-4764-bfa3-1dd08c8f7cfb'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:40.199633 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-54c3a0d7-9a77-4764-bfa3-1dd08c8f7cfb tempest-QuotasNegativeTest-434732875 tempest-QuotasNegativeTest-434732875-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06163a5a8c2943569f4189edc7a4bac5', 'request_id': 'req-54c3a0d7-9a77-4764-bfa3-1dd08c8f7cfb'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:40.205716 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-17590ee0-a0a8-4dd8-9526-ceb9d87f2654 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eed53e9aba1148f0b88447645d3b3fa5'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:40.207073 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-54c3a0d7-9a77-4764-bfa3-1dd08c8f7cfb tempest-QuotasNegativeTest-434732875 tempest-QuotasNegativeTest-434732875-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06163a5a8c2943569f4189edc7a4bac5', 'request_id': 'req-54c3a0d7-9a77-4764-bfa3-1dd08c8f7cfb'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:40.213826 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-17590ee0-a0a8-4dd8-9526-ceb9d87f2654 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eed53e9aba1148f0b88447645d3b3fa5'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:40.214944 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-17590ee0-a0a8-4dd8-9526-ceb9d87f2654 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eed53e9aba1148f0b88447645d3b3fa5'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:40.222342 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-54c3a0d7-9a77-4764-bfa3-1dd08c8f7cfb tempest-QuotasNegativeTest-434732875 tempest-QuotasNegativeTest-434732875-project-admin] The token cache is being invalidate because project 06163a5a8c2943569f4189edc7a4bac5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:34:40.222598 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-54c3a0d7-9a77-4764-bfa3-1dd08c8f7cfb tempest-QuotasNegativeTest-434732875 tempest-QuotasNegativeTest-434732875-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:40.223406 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-54c3a0d7-9a77-4764-bfa3-1dd08c8f7cfb tempest-QuotasNegativeTest-434732875 tempest-QuotasNegativeTest-434732875-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:40.226127 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-17590ee0-a0a8-4dd8-9526-ceb9d87f2654 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eed53e9aba1148f0b88447645d3b3fa5'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:40.228640 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3224/6411] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:34:40 2022] DELETE /identity/v3/projects/06163a5a8c2943569f4189edc7a4bac5 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:40.233714 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c3a0d7-9a77-4764-bfa3-1dd08c8f7cfb tempest-QuotasNegativeTest-434732875 tempest-QuotasNegativeTest-434732875-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:40.235412 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-54c3a0d7-9a77-4764-bfa3-1dd08c8f7cfb tempest-QuotasNegativeTest-434732875 tempest-QuotasNegativeTest-434732875-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:40.241765 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-17590ee0-a0a8-4dd8-9526-ceb9d87f2654 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eed53e9aba1148f0b88447645d3b3fa5'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:40.248840 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3188/6412] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:34:39 2022] DELETE /identity/v3/users/eed53e9aba1148f0b88447645d3b3fa5 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:40.253771 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045f4252-d830-4e71-8812-c4bbc8c0c6ed None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:40.253958 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045f4252-d830-4e71-8812-c4bbc8c0c6ed None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:40.254210 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045f4252-d830-4e71-8812-c4bbc8c0c6ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:40.276870 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-045f4252-d830-4e71-8812-c4bbc8c0c6ed None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:34:40.277594 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-045f4252-d830-4e71-8812-c4bbc8c0c6ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:40.314934 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c3a0d7-9a77-4764-bfa3-1dd08c8f7cfb tempest-QuotasNegativeTest-434732875 tempest-QuotasNegativeTest-434732875-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:40.366088 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3189/6413] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:34:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:34:40.378175 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045f4252-d830-4e71-8812-c4bbc8c0c6ed None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:40.380045 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-045f4252-d830-4e71-8812-c4bbc8c0c6ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:40.398932 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79f9bfa-0b02-4f41-bd3f-a39965a16283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:40.399911 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79f9bfa-0b02-4f41-bd3f-a39965a16283 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:40.400191 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79f9bfa-0b02-4f41-bd3f-a39965a16283 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:40.400460 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79f9bfa-0b02-4f41-bd3f-a39965a16283 admin admin] PATH_INFO: `/v3/users/abd1d27939c5411cadd2624ef8963ab4` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:40.412123 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79f9bfa-0b02-4f41-bd3f-a39965a16283 admin admin] RBAC: Authorizing `identity:delete_user(user_id=abd1d27939c5411cadd2624ef8963ab4)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:40.412123 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79f9bfa-0b02-4f41-bd3f-a39965a16283 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:40.412306 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:40.475129 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045f4252-d830-4e71-8812-c4bbc8c0c6ed None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:40.477084 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-d79f9bfa-0b02-4f41-bd3f-a39965a16283 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abd1d27939c5411cadd2624ef8963ab4'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:40.477854 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-d79f9bfa-0b02-4f41-bd3f-a39965a16283 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abd1d27939c5411cadd2624ef8963ab4'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:40.479085 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d111d17-67d6-4fda-8114-420dab725327 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:40.479288 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:40.479752 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d111d17-67d6-4fda-8114-420dab725327 service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:40.480039 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d111d17-67d6-4fda-8114-420dab725327 service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:40.480429 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d111d17-67d6-4fda-8114-420dab725327 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:40.492732 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d111d17-67d6-4fda-8114-420dab725327 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:40.492966 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-d79f9bfa-0b02-4f41-bd3f-a39965a16283 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abd1d27939c5411cadd2624ef8963ab4'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:40.494248 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d111d17-67d6-4fda-8114-420dab725327 service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:40.505974 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3190/6414] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:34:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:34:40.506852 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d111d17-67d6-4fda-8114-420dab725327 service neutron] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:40.507468 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-d79f9bfa-0b02-4f41-bd3f-a39965a16283 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abd1d27939c5411cadd2624ef8963ab4'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:40.508192 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-4d111d17-67d6-4fda-8114-420dab725327 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:40.521189 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-d79f9bfa-0b02-4f41-bd3f-a39965a16283 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abd1d27939c5411cadd2624ef8963ab4'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:40.521962 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d111d17-67d6-4fda-8114-420dab725327 service neutron] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:40.527061 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1cc8c8-eca5-4a18-bbd8-081daac584e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:40.528187 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1cc8c8-eca5-4a18-bbd8-081daac584e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:40.528340 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3225/6415] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:34:40 2022] DELETE /identity/v3/users/abd1d27939c5411cadd2624ef8963ab4 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:34:40.528462 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1cc8c8-eca5-4a18-bbd8-081daac584e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:40.528462 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1cc8c8-eca5-4a18-bbd8-081daac584e9 admin admin] PATH_INFO: `/v3/projects/e2fbac9ddb1c488c9f447d3d2122fb9e` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:40.529699 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1cc8c8-eca5-4a18-bbd8-081daac584e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2fbac9ddb1c488c9f447d3d2122fb9e)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:40.532192 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1cc8c8-eca5-4a18-bbd8-081daac584e9 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:40.532332 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb46523-3835-42d9-b190-47b0cdcb6c0d None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:40.532603 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb46523-3835-42d9-b190-47b0cdcb6c0d None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:40.532877 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb46523-3835-42d9-b190-47b0cdcb6c0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:40.556608 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-dcb46523-3835-42d9-b190-47b0cdcb6c0d None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:34:40.557824 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-dcb46523-3835-42d9-b190-47b0cdcb6c0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:40.585266 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-dc1cc8c8-eca5-4a18-bbd8-081daac584e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2fbac9ddb1c488c9f447d3d2122fb9e', 'request_id': 'req-dc1cc8c8-eca5-4a18-bbd8-081daac584e9'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:40.594315 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-dc1cc8c8-eca5-4a18-bbd8-081daac584e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2fbac9ddb1c488c9f447d3d2122fb9e', 'request_id': 'req-dc1cc8c8-eca5-4a18-bbd8-081daac584e9'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:40.601243 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-dc1cc8c8-eca5-4a18-bbd8-081daac584e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2fbac9ddb1c488c9f447d3d2122fb9e', 'request_id': 'req-dc1cc8c8-eca5-4a18-bbd8-081daac584e9'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:40.618232 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-dc1cc8c8-eca5-4a18-bbd8-081daac584e9 admin admin] The token cache is being invalidate because project e2fbac9ddb1c488c9f447d3d2122fb9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:34:40.618825 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-dc1cc8c8-eca5-4a18-bbd8-081daac584e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:40.619938 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-dc1cc8c8-eca5-4a18-bbd8-081daac584e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:40.622225 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3191/6416] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:34:40 2022] DELETE /identity/v3/projects/e2fbac9ddb1c488c9f447d3d2122fb9e => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:40.627139 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246bfd0e-4993-40e5-9ce0-bb56a73c5e19 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:40.627723 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246bfd0e-4993-40e5-9ce0-bb56a73c5e19 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:40.628587 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246bfd0e-4993-40e5-9ce0-bb56a73c5e19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:40.631672 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3226/6417] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:34:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:34:40.641903 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb46523-3835-42d9-b190-47b0cdcb6c0d None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:40.644436 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-dcb46523-3835-42d9-b190-47b0cdcb6c0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:40.651805 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-246bfd0e-4993-40e5-9ce0-bb56a73c5e19 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:34:40.653401 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-246bfd0e-4993-40e5-9ce0-bb56a73c5e19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:40.716880 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb46523-3835-42d9-b190-47b0cdcb6c0d None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:40.738091 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3192/6418] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:34:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:34:40.741004 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca17c3e-8682-4111-8a9e-894190ffc641 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:40.741004 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca17c3e-8682-4111-8a9e-894190ffc641 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:40.741004 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca17c3e-8682-4111-8a9e-894190ffc641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:40.760882 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-cca17c3e-8682-4111-8a9e-894190ffc641 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:34:40.762288 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-cca17c3e-8682-4111-8a9e-894190ffc641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:40.774101 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3193/6419] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:34:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:34:40.775736 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca17c3e-8682-4111-8a9e-894190ffc641 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:40.787324 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca17c3e-8682-4111-8a9e-894190ffc641 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:40.787701 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ca44c7-ed68-4642-be20-801ebe53225c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:40.788531 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ca44c7-ed68-4642-be20-801ebe53225c service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:40.788878 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ca44c7-ed68-4642-be20-801ebe53225c service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:40.789741 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ca44c7-ed68-4642-be20-801ebe53225c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:40.794318 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa7a94b-6e0b-4f7e-a8b5-c15b3f5c8e27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:40.795056 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa7a94b-6e0b-4f7e-a8b5-c15b3f5c8e27 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:40.795548 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa7a94b-6e0b-4f7e-a8b5-c15b3f5c8e27 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:40.795873 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa7a94b-6e0b-4f7e-a8b5-c15b3f5c8e27 admin admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:40.796580 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa7a94b-6e0b-4f7e-a8b5-c15b3f5c8e27 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:34:40.796981 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa7a94b-6e0b-4f7e-a8b5-c15b3f5c8e27 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:40.798831 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa7a94b-6e0b-4f7e-a8b5-c15b3f5c8e27 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:40.804313 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ca44c7-ed68-4642-be20-801ebe53225c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:40.806324 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ca44c7-ed68-4642-be20-801ebe53225c service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:40.819623 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3227/6420] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:34:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:34:40.821129 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3194/6421] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:34:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:34:40.839864 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ca44c7-ed68-4642-be20-801ebe53225c service neutron] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:40.856497 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ca44c7-ed68-4642-be20-801ebe53225c service neutron] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:40.864735 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45274b35-5cef-4bd6-869b-f231393f74c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:40.865825 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45274b35-5cef-4bd6-869b-f231393f74c1 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:40.865944 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45274b35-5cef-4bd6-869b-f231393f74c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:40.866218 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45274b35-5cef-4bd6-869b-f231393f74c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:40.867017 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45274b35-5cef-4bd6-869b-f231393f74c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:40.868937 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45274b35-5cef-4bd6-869b-f231393f74c1 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:40.899123 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3228/6422] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:34:40 2022] POST /identity/v3/projects => generated 379 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:34:40.903458 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa7a94b-6e0b-4f7e-a8b5-c15b3f5c8e27 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:40.921581 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa7a94b-6e0b-4f7e-a8b5-c15b3f5c8e27 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:40.948472 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:41.004801 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05265bf4-843b-4de7-b461-6dfb975e4e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:41.005753 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05265bf4-843b-4de7-b461-6dfb975e4e83 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:41.006211 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05265bf4-843b-4de7-b461-6dfb975e4e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:41.006790 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05265bf4-843b-4de7-b461-6dfb975e4e83 admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:41.008037 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05265bf4-843b-4de7-b461-6dfb975e4e83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:41.011739 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05265bf4-843b-4de7-b461-6dfb975e4e83 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:41.034378 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3195/6423] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:34:40 2022] POST /identity/v3/users => generated 290 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:34:41.038877 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45274b35-5cef-4bd6-869b-f231393f74c1 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:41.048414 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:41.055425 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45274b35-5cef-4bd6-869b-f231393f74c1 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:41.065201 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dddb98-11ff-485a-9ee1-92ec5031acf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:41.066136 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dddb98-11ff-485a-9ee1-92ec5031acf3 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:41.066344 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dddb98-11ff-485a-9ee1-92ec5031acf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:41.066620 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dddb98-11ff-485a-9ee1-92ec5031acf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:41.067512 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dddb98-11ff-485a-9ee1-92ec5031acf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:41.070590 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dddb98-11ff-485a-9ee1-92ec5031acf3 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:41.085696 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3229/6424] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:34:41 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:34:41.089370 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05265bf4-843b-4de7-b461-6dfb975e4e83 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:41.113007 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05265bf4-843b-4de7-b461-6dfb975e4e83 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:41.125833 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87415222-f90b-45d2-b3bb-6d6bd5c15b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:41.126928 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87415222-f90b-45d2-b3bb-6d6bd5c15b85 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:41.127207 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87415222-f90b-45d2-b3bb-6d6bd5c15b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:41.127479 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87415222-f90b-45d2-b3bb-6d6bd5c15b85 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:41.128638 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87415222-f90b-45d2-b3bb-6d6bd5c15b85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:41.134330 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dddb98-11ff-485a-9ee1-92ec5031acf3 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:41.134516 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87415222-f90b-45d2-b3bb-6d6bd5c15b85 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:41.136811 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-42dddb98-11ff-485a-9ee1-92ec5031acf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:41.160540 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dddb98-11ff-485a-9ee1-92ec5031acf3 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:41.165914 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375cabee-d4a2-42d6-b8e0-88397f485c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:41.166065 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3196/6425] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:34:41 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:34:41.166871 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375cabee-d4a2-42d6-b8e0-88397f485c52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:41.167082 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375cabee-d4a2-42d6-b8e0-88397f485c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:41.167359 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375cabee-d4a2-42d6-b8e0-88397f485c52 admin admin] PATH_INFO: `/v3/projects/306389761eba44ccb42836342dfe14b2` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:41.169465 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375cabee-d4a2-42d6-b8e0-88397f485c52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=306389761eba44ccb42836342dfe14b2)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:41.171639 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375cabee-d4a2-42d6-b8e0-88397f485c52 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:41.172209 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87415222-f90b-45d2-b3bb-6d6bd5c15b85 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:41.189958 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87415222-f90b-45d2-b3bb-6d6bd5c15b85 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:41.199393 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e7d066-e472-4bbf-839c-e51dd4b609f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:41.201605 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e7d066-e472-4bbf-839c-e51dd4b609f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:41.202080 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e7d066-e472-4bbf-839c-e51dd4b609f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:41.202516 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e7d066-e472-4bbf-839c-e51dd4b609f6 admin admin] PATH_INFO: `/v3/projects/efdaa937f9bc4939bf69491da0c27453/users/c78a7cb69b0044af846e9d161452b374/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:41.236773 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e7d066-e472-4bbf-839c-e51dd4b609f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=efdaa937f9bc4939bf69491da0c27453, user_id=c78a7cb69b0044af846e9d161452b374, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:41.239999 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e7d066-e472-4bbf-839c-e51dd4b609f6 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:41.245851 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-375cabee-d4a2-42d6-b8e0-88397f485c52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '306389761eba44ccb42836342dfe14b2', 'request_id': 'req-375cabee-d4a2-42d6-b8e0-88397f485c52'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:41.261364 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-375cabee-d4a2-42d6-b8e0-88397f485c52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '306389761eba44ccb42836342dfe14b2', 'request_id': 'req-375cabee-d4a2-42d6-b8e0-88397f485c52'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:41.261505 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3197/6426] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:34:41 2022] PUT /identity/v3/projects/efdaa937f9bc4939bf69491da0c27453/users/c78a7cb69b0044af846e9d161452b374/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:41.269305 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-375cabee-d4a2-42d6-b8e0-88397f485c52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '306389761eba44ccb42836342dfe14b2', 'request_id': 'req-375cabee-d4a2-42d6-b8e0-88397f485c52'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:41.270417 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6dc8a2-8302-4e61-8f51-a765e9459c0c None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:41.270705 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6dc8a2-8302-4e61-8f51-a765e9459c0c None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:41.273067 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6dc8a2-8302-4e61-8f51-a765e9459c0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:41.288385 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-375cabee-d4a2-42d6-b8e0-88397f485c52 admin admin] The token cache is being invalidate because project 306389761eba44ccb42836342dfe14b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:34:41.288748 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-375cabee-d4a2-42d6-b8e0-88397f485c52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:41.289343 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-375cabee-d4a2-42d6-b8e0-88397f485c52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:41.292908 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3230/6427] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:34:41 2022] DELETE /identity/v3/projects/306389761eba44ccb42836342dfe14b2 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:34:41.297980 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375cabee-d4a2-42d6-b8e0-88397f485c52 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:41.299859 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-375cabee-d4a2-42d6-b8e0-88397f485c52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:41.309303 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-bf6dc8a2-8302-4e61-8f51-a765e9459c0c None None] MFA Rules not processed for user `c78a7cb69b0044af846e9d161452b374`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:34:41.311605 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-bf6dc8a2-8302-4e61-8f51-a765e9459c0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:41.416749 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375cabee-d4a2-42d6-b8e0-88397f485c52 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:41.447973 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3198/6428] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:34:41 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:34:41.449264 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6dc8a2-8302-4e61-8f51-a765e9459c0c None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:41.453237 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-bf6dc8a2-8302-4e61-8f51-a765e9459c0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:41.530452 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb4ce56-fca4-494e-9c73-31bf45bc255e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:41.531833 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb4ce56-fca4-494e-9c73-31bf45bc255e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:41.532264 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb4ce56-fca4-494e-9c73-31bf45bc255e admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:41.532730 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb4ce56-fca4-494e-9c73-31bf45bc255e admin admin] PATH_INFO: `/v3/users/ee6dc6326d854402ace906811c02d207` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:41.534196 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb4ce56-fca4-494e-9c73-31bf45bc255e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee6dc6326d854402ace906811c02d207)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:41.535445 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6dc8a2-8302-4e61-8f51-a765e9459c0c None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:41.536317 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb4ce56-fca4-494e-9c73-31bf45bc255e admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:41.540887 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40788bab-08b7-4f9d-ab70-076d2cf614de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:41.542342 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40788bab-08b7-4f9d-ab70-076d2cf614de admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:41.549975 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40788bab-08b7-4f9d-ab70-076d2cf614de admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:41.550886 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40788bab-08b7-4f9d-ab70-076d2cf614de admin admin] PATH_INFO: `/v3/projects/955d6b15592b4e448fd5a4bbef2f7d17` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:41.552887 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40788bab-08b7-4f9d-ab70-076d2cf614de admin admin] RBAC: Authorizing `identity:delete_project(project_id=955d6b15592b4e448fd5a4bbef2f7d17)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:41.555935 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40788bab-08b7-4f9d-ab70-076d2cf614de admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:41.562001 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:41.572868 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:41.600588 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-eeb4ce56-fca4-494e-9c73-31bf45bc255e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee6dc6326d854402ace906811c02d207'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:41.601597 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-eeb4ce56-fca4-494e-9c73-31bf45bc255e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee6dc6326d854402ace906811c02d207'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:41.612357 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-eeb4ce56-fca4-494e-9c73-31bf45bc255e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee6dc6326d854402ace906811c02d207'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:41.618587 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-40788bab-08b7-4f9d-ab70-076d2cf614de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '955d6b15592b4e448fd5a4bbef2f7d17', 'request_id': 'req-40788bab-08b7-4f9d-ab70-076d2cf614de'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:41.623290 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-eeb4ce56-fca4-494e-9c73-31bf45bc255e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee6dc6326d854402ace906811c02d207'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:41.626877 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-40788bab-08b7-4f9d-ab70-076d2cf614de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '955d6b15592b4e448fd5a4bbef2f7d17', 'request_id': 'req-40788bab-08b7-4f9d-ab70-076d2cf614de'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:41.635055 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-40788bab-08b7-4f9d-ab70-076d2cf614de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '955d6b15592b4e448fd5a4bbef2f7d17', 'request_id': 'req-40788bab-08b7-4f9d-ab70-076d2cf614de'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:41.641178 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-eeb4ce56-fca4-494e-9c73-31bf45bc255e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee6dc6326d854402ace906811c02d207'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:41.647281 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-40788bab-08b7-4f9d-ab70-076d2cf614de admin admin] The token cache is being invalidate because project 955d6b15592b4e448fd5a4bbef2f7d17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:34:41.648212 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3231/6429] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:34:41 2022] DELETE /identity/v3/users/ee6dc6326d854402ace906811c02d207 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:41.648389 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-40788bab-08b7-4f9d-ab70-076d2cf614de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:41.648610 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-40788bab-08b7-4f9d-ab70-076d2cf614de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:41.651555 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb4ce56-fca4-494e-9c73-31bf45bc255e admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:41.652788 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-eeb4ce56-fca4-494e-9c73-31bf45bc255e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:41.653978 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3199/6430] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:34:41 2022] DELETE /identity/v3/projects/955d6b15592b4e448fd5a4bbef2f7d17 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:41.654839 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40788bab-08b7-4f9d-ab70-076d2cf614de admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:41.660183 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-40788bab-08b7-4f9d-ab70-076d2cf614de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:41.739441 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40788bab-08b7-4f9d-ab70-076d2cf614de admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:41.761400 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb4ce56-fca4-494e-9c73-31bf45bc255e admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:41.766975 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92626c8a-6dec-4e0d-a0fa-9a8afcf8040c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:41.768065 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92626c8a-6dec-4e0d-a0fa-9a8afcf8040c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:41.768345 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92626c8a-6dec-4e0d-a0fa-9a8afcf8040c admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:41.768627 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92626c8a-6dec-4e0d-a0fa-9a8afcf8040c admin admin] PATH_INFO: `/v3/users/b81f706e95bd481394751229c7e658f2` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:41.770539 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92626c8a-6dec-4e0d-a0fa-9a8afcf8040c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b81f706e95bd481394751229c7e658f2)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:41.772952 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92626c8a-6dec-4e0d-a0fa-9a8afcf8040c admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:41.850564 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05eacb2-b4b3-49bf-959c-d845411e3847 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7f2db148c8e4d5d81431cae3576434b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:41.852713 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05eacb2-b4b3-49bf-959c-d845411e3847 service glance] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:41.853377 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05eacb2-b4b3-49bf-959c-d845411e3847 service glance] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:41.854030 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05eacb2-b4b3-49bf-959c-d845411e3847 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:41.857241 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-a05eacb2-b4b3-49bf-959c-d845411e3847 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:41.880485 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-92626c8a-6dec-4e0d-a0fa-9a8afcf8040c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b81f706e95bd481394751229c7e658f2'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:41.881175 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-92626c8a-6dec-4e0d-a0fa-9a8afcf8040c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b81f706e95bd481394751229c7e658f2'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:41.890028 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-92626c8a-6dec-4e0d-a0fa-9a8afcf8040c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b81f706e95bd481394751229c7e658f2'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:41.902251 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-92626c8a-6dec-4e0d-a0fa-9a8afcf8040c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b81f706e95bd481394751229c7e658f2'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:41.919391 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-92626c8a-6dec-4e0d-a0fa-9a8afcf8040c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b81f706e95bd481394751229c7e658f2'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:41.927737 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3232/6431] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:34:41 2022] DELETE /identity/v3/users/b81f706e95bd481394751229c7e658f2 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:41.929085 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92626c8a-6dec-4e0d-a0fa-9a8afcf8040c admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:41.931846 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-92626c8a-6dec-4e0d-a0fa-9a8afcf8040c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:41.948476 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05eacb2-b4b3-49bf-959c-d845411e3847 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:41.950919 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05eacb2-b4b3-49bf-959c-d845411e3847 service glance] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:41.968092 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:41.981643 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3200/6432] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:34:41 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:34:41.983366 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a9d79c-9afd-4eaa-9cd8-121f13c5f881 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:41.983743 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a9d79c-9afd-4eaa-9cd8-121f13c5f881 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:41.984016 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a9d79c-9afd-4eaa-9cd8-121f13c5f881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:42.032928 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-31a9d79c-9afd-4eaa-9cd8-121f13c5f881 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:34:42.034751 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92626c8a-6dec-4e0d-a0fa-9a8afcf8040c admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:42.046594 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e8ce69-bb8e-43f0-a95c-e64f554b1630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:42.046960 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-31a9d79c-9afd-4eaa-9cd8-121f13c5f881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:42.048029 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e8ce69-bb8e-43f0-a95c-e64f554b1630 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:42.048463 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e8ce69-bb8e-43f0-a95c-e64f554b1630 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:42.048930 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e8ce69-bb8e-43f0-a95c-e64f554b1630 admin admin] PATH_INFO: `/v3/users/cbc7092d01464ead81c9bf7156a90405` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:42.050451 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e8ce69-bb8e-43f0-a95c-e64f554b1630 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cbc7092d01464ead81c9bf7156a90405)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:42.060288 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e8ce69-bb8e-43f0-a95c-e64f554b1630 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:42.083460 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3201/6433] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:34:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:34:42.106601 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a9d79c-9afd-4eaa-9cd8-121f13c5f881 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:42.109063 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-31a9d79c-9afd-4eaa-9cd8-121f13c5f881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:42.115221 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:42.125680 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-e5e8ce69-bb8e-43f0-a95c-e64f554b1630 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cbc7092d01464ead81c9bf7156a90405'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:42.126912 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-e5e8ce69-bb8e-43f0-a95c-e64f554b1630 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cbc7092d01464ead81c9bf7156a90405'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:42.138229 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-e5e8ce69-bb8e-43f0-a95c-e64f554b1630 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cbc7092d01464ead81c9bf7156a90405'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:42.150517 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-e5e8ce69-bb8e-43f0-a95c-e64f554b1630 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cbc7092d01464ead81c9bf7156a90405'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:42.170073 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-e5e8ce69-bb8e-43f0-a95c-e64f554b1630 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cbc7092d01464ead81c9bf7156a90405'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:42.180109 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3233/6434] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:34:41 2022] DELETE /identity/v3/users/cbc7092d01464ead81c9bf7156a90405 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:42.235443 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a9d79c-9afd-4eaa-9cd8-121f13c5f881 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:42.251808 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e8ce69-bb8e-43f0-a95c-e64f554b1630 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:42.254380 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-e5e8ce69-bb8e-43f0-a95c-e64f554b1630 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:42.305636 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b02d2b3-0e0d-4e14-966f-5d4b2a7547c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:42.306405 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b02d2b3-0e0d-4e14-966f-5d4b2a7547c7 service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:42.306741 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b02d2b3-0e0d-4e14-966f-5d4b2a7547c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:42.307083 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b02d2b3-0e0d-4e14-966f-5d4b2a7547c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:42.309016 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-3b02d2b3-0e0d-4e14-966f-5d4b2a7547c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:42.365412 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e8ce69-bb8e-43f0-a95c-e64f554b1630 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:42.374016 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a289afc8-7332-4a95-96f6-e0eaf3461569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:42.375313 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a289afc8-7332-4a95-96f6-e0eaf3461569 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:42.375693 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a289afc8-7332-4a95-96f6-e0eaf3461569 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:42.376061 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a289afc8-7332-4a95-96f6-e0eaf3461569 admin admin] PATH_INFO: `/v3/users/c78a7cb69b0044af846e9d161452b374` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:42.377666 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a289afc8-7332-4a95-96f6-e0eaf3461569 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c78a7cb69b0044af846e9d161452b374)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:42.380540 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a289afc8-7332-4a95-96f6-e0eaf3461569 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:42.392339 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b02d2b3-0e0d-4e14-966f-5d4b2a7547c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:42.394022 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b02d2b3-0e0d-4e14-966f-5d4b2a7547c7 service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:42.406805 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3202/6435] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:34:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 23 21:34:42.440779 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:42.450219 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-a289afc8-7332-4a95-96f6-e0eaf3461569 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c78a7cb69b0044af846e9d161452b374'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:42.452694 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-a289afc8-7332-4a95-96f6-e0eaf3461569 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c78a7cb69b0044af846e9d161452b374'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:42.465108 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-a289afc8-7332-4a95-96f6-e0eaf3461569 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c78a7cb69b0044af846e9d161452b374'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:42.479406 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-a289afc8-7332-4a95-96f6-e0eaf3461569 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c78a7cb69b0044af846e9d161452b374'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:42.498573 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-a289afc8-7332-4a95-96f6-e0eaf3461569 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c78a7cb69b0044af846e9d161452b374'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:42.508649 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3234/6436] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:34:42 2022] DELETE /identity/v3/users/c78a7cb69b0044af846e9d161452b374 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:42.515358 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60af89ea-1443-4c4d-87a9-b4ad01b182ab None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:42.515358 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60af89ea-1443-4c4d-87a9-b4ad01b182ab None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:42.515358 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60af89ea-1443-4c4d-87a9-b4ad01b182ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:42.537218 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-60af89ea-1443-4c4d-87a9-b4ad01b182ab None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:34:42.538669 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-60af89ea-1443-4c4d-87a9-b4ad01b182ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:42.576831 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a289afc8-7332-4a95-96f6-e0eaf3461569 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:42.578250 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-a289afc8-7332-4a95-96f6-e0eaf3461569 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:42.673577 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3203/6437] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:34:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:34:42.677178 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a289afc8-7332-4a95-96f6-e0eaf3461569 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:42.682643 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3035822-185f-4618-9e09-293a49b4c24f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:42.683549 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3035822-185f-4618-9e09-293a49b4c24f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:42.683827 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3035822-185f-4618-9e09-293a49b4c24f admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:42.684112 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3035822-185f-4618-9e09-293a49b4c24f admin admin] PATH_INFO: `/v3/projects/0de025a9cc0942b3b8d27d1e0988b39b` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:42.685310 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3035822-185f-4618-9e09-293a49b4c24f admin admin] RBAC: Authorizing `identity:delete_project(project_id=0de025a9cc0942b3b8d27d1e0988b39b)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:42.686360 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60af89ea-1443-4c4d-87a9-b4ad01b182ab None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:42.687265 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3035822-185f-4618-9e09-293a49b4c24f admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:42.687753 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-60af89ea-1443-4c4d-87a9-b4ad01b182ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:42.703196 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:42.755912 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c3035822-185f-4618-9e09-293a49b4c24f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0de025a9cc0942b3b8d27d1e0988b39b', 'request_id': 'req-c3035822-185f-4618-9e09-293a49b4c24f'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:42.775760 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60af89ea-1443-4c4d-87a9-b4ad01b182ab None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:42.776616 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c3035822-185f-4618-9e09-293a49b4c24f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0de025a9cc0942b3b8d27d1e0988b39b', 'request_id': 'req-c3035822-185f-4618-9e09-293a49b4c24f'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:42.788447 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c3035822-185f-4618-9e09-293a49b4c24f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0de025a9cc0942b3b8d27d1e0988b39b', 'request_id': 'req-c3035822-185f-4618-9e09-293a49b4c24f'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:42.808929 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c3035822-185f-4618-9e09-293a49b4c24f admin admin] The token cache is being invalidate because project 0de025a9cc0942b3b8d27d1e0988b39b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:34:42.809770 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c3035822-185f-4618-9e09-293a49b4c24f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:42.811068 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c3035822-185f-4618-9e09-293a49b4c24f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:42.813179 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3235/6438] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:34:42 2022] DELETE /identity/v3/projects/0de025a9cc0942b3b8d27d1e0988b39b => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:42.819453 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428c43fc-a4db-4865-a4e5-30c3c6e54400 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:42.820397 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428c43fc-a4db-4865-a4e5-30c3c6e54400 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:42.821164 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428c43fc-a4db-4865-a4e5-30c3c6e54400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:42.856385 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-428c43fc-a4db-4865-a4e5-30c3c6e54400 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:34:42.859608 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-428c43fc-a4db-4865-a4e5-30c3c6e54400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:42.868761 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2e8255-57d7-4b82-8a69-3905426471b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:42.871724 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2e8255-57d7-4b82-8a69-3905426471b3 service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:42.872982 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2e8255-57d7-4b82-8a69-3905426471b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:42.873280 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2e8255-57d7-4b82-8a69-3905426471b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:42.881422 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-dc2e8255-57d7-4b82-8a69-3905426471b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:42.958240 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:42.968232 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2e8255-57d7-4b82-8a69-3905426471b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:42.969841 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2e8255-57d7-4b82-8a69-3905426471b3 service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:42.981343 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3204/6439] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:34:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 23 21:34:42.982816 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2e8255-57d7-4b82-8a69-3905426471b3 service neutron] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:42.988812 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3236/6440] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:34:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:34:42.989991 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-dc2e8255-57d7-4b82-8a69-3905426471b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:42.990311 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e4a72d-ceb2-454c-bba7-42dae8b5bb72 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:42.990607 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e4a72d-ceb2-454c-bba7-42dae8b5bb72 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:42.991024 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e4a72d-ceb2-454c-bba7-42dae8b5bb72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:43.003368 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2e8255-57d7-4b82-8a69-3905426471b3 service neutron] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:43.011688 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-25e4a72d-ceb2-454c-bba7-42dae8b5bb72 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:34:43.012693 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa26f048-7be3-4d8d-bfb5-7c6963e7c630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:43.012917 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-25e4a72d-ceb2-454c-bba7-42dae8b5bb72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:43.013696 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa26f048-7be3-4d8d-bfb5-7c6963e7c630 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:43.014023 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa26f048-7be3-4d8d-bfb5-7c6963e7c630 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:43.014296 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa26f048-7be3-4d8d-bfb5-7c6963e7c630 admin admin] PATH_INFO: `/v3/projects/44974b353e804139a110f4005cffa04d` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:43.015571 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa26f048-7be3-4d8d-bfb5-7c6963e7c630 admin admin] RBAC: Authorizing `identity:delete_project(project_id=44974b353e804139a110f4005cffa04d)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:43.017563 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa26f048-7be3-4d8d-bfb5-7c6963e7c630 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:43.025907 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3237/6441] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:34:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:34:43.027660 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e4a72d-ceb2-454c-bba7-42dae8b5bb72 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:43.037437 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e4a72d-ceb2-454c-bba7-42dae8b5bb72 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:43.046334 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1931a368-b017-45fe-b553-0dac03f013fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:43.047015 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1931a368-b017-45fe-b553-0dac03f013fd admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:43.047296 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1931a368-b017-45fe-b553-0dac03f013fd admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:43.048085 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1931a368-b017-45fe-b553-0dac03f013fd admin admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:43.049028 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1931a368-b017-45fe-b553-0dac03f013fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:34:43.049511 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1931a368-b017-45fe-b553-0dac03f013fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:43.051532 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1931a368-b017-45fe-b553-0dac03f013fd admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:43.065749 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3238/6442] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:34:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:34:43.070117 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1931a368-b017-45fe-b553-0dac03f013fd admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:43.078225 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-aa26f048-7be3-4d8d-bfb5-7c6963e7c630 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44974b353e804139a110f4005cffa04d', 'request_id': 'req-aa26f048-7be3-4d8d-bfb5-7c6963e7c630'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:43.081939 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1931a368-b017-45fe-b553-0dac03f013fd admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:43.088297 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-aa26f048-7be3-4d8d-bfb5-7c6963e7c630 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44974b353e804139a110f4005cffa04d', 'request_id': 'req-aa26f048-7be3-4d8d-bfb5-7c6963e7c630'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:43.095241 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-aa26f048-7be3-4d8d-bfb5-7c6963e7c630 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44974b353e804139a110f4005cffa04d', 'request_id': 'req-aa26f048-7be3-4d8d-bfb5-7c6963e7c630'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:43.103111 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:43.109419 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-aa26f048-7be3-4d8d-bfb5-7c6963e7c630 admin admin] The token cache is being invalidate because project 44974b353e804139a110f4005cffa04d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:34:43.109836 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-aa26f048-7be3-4d8d-bfb5-7c6963e7c630 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:43.110737 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-aa26f048-7be3-4d8d-bfb5-7c6963e7c630 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:43.113470 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3205/6443] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:34:42 2022] DELETE /identity/v3/projects/44974b353e804139a110f4005cffa04d => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:43.118926 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e343a0-9121-4090-8fde-77c980964621 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:43.119209 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e343a0-9121-4090-8fde-77c980964621 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:43.119725 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e343a0-9121-4090-8fde-77c980964621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:43.139039 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-e6e343a0-9121-4090-8fde-77c980964621 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:34:43.140447 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-e6e343a0-9121-4090-8fde-77c980964621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:43.155645 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b878ec5-bc6a-4171-a21f-2f9528f77da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:43.156359 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b878ec5-bc6a-4171-a21f-2f9528f77da1 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:43.157062 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b878ec5-bc6a-4171-a21f-2f9528f77da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:43.157062 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b878ec5-bc6a-4171-a21f-2f9528f77da1 admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:43.157619 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b878ec5-bc6a-4171-a21f-2f9528f77da1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:43.159773 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b878ec5-bc6a-4171-a21f-2f9528f77da1 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:43.193024 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3239/6444] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:34:43 2022] POST /identity/v3/projects => generated 367 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:34:43.197181 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b878ec5-bc6a-4171-a21f-2f9528f77da1 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:43.199543 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-8b878ec5-bc6a-4171-a21f-2f9528f77da1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:43.227238 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3206/6445] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:34:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:34:43.229092 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158684fe-96e1-4cb1-8b93-45708ade553e None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:43.229384 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158684fe-96e1-4cb1-8b93-45708ade553e None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:43.229739 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158684fe-96e1-4cb1-8b93-45708ade553e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:43.252302 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-158684fe-96e1-4cb1-8b93-45708ade553e None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:34:43.253537 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-158684fe-96e1-4cb1-8b93-45708ade553e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:43.287529 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b878ec5-bc6a-4171-a21f-2f9528f77da1 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:43.292773 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f9e3c6-f2e2-4b7b-bfaa-47eef621aac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:43.293623 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f9e3c6-f2e2-4b7b-bfaa-47eef621aac4 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:43.293956 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f9e3c6-f2e2-4b7b-bfaa-47eef621aac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:43.294238 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f9e3c6-f2e2-4b7b-bfaa-47eef621aac4 admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:43.294942 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f9e3c6-f2e2-4b7b-bfaa-47eef621aac4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:43.297255 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f9e3c6-f2e2-4b7b-bfaa-47eef621aac4 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:43.340718 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3240/6446] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:34:43 2022] POST /identity/v3/users => generated 284 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:34:43.341961 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f9e3c6-f2e2-4b7b-bfaa-47eef621aac4 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:43.344041 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-95f9e3c6-f2e2-4b7b-bfaa-47eef621aac4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:43.345212 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3207/6447] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:34:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:34:43.349707 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158684fe-96e1-4cb1-8b93-45708ade553e None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:43.360161 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158684fe-96e1-4cb1-8b93-45708ade553e None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:43.364012 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f9e3c6-f2e2-4b7b-bfaa-47eef621aac4 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:43.368115 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca314e0-6ca9-497d-bf6c-9b9b3d556426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:43.368932 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca314e0-6ca9-497d-bf6c-9b9b3d556426 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:43.369218 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca314e0-6ca9-497d-bf6c-9b9b3d556426 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:43.369486 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca314e0-6ca9-497d-bf6c-9b9b3d556426 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:43.370568 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca314e0-6ca9-497d-bf6c-9b9b3d556426 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:43.372135 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca314e0-6ca9-497d-bf6c-9b9b3d556426 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:43.374255 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f788ce3-e9d2-40d4-99be-50679012ad1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:43.375749 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f788ce3-e9d2-40d4-99be-50679012ad1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:43.375969 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f788ce3-e9d2-40d4-99be-50679012ad1f admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:43.376314 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f788ce3-e9d2-40d4-99be-50679012ad1f admin admin] PATH_INFO: `/v3/projects/abe9428815bd479f96bb97e74e72337b` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:43.377678 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f788ce3-e9d2-40d4-99be-50679012ad1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=abe9428815bd479f96bb97e74e72337b)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:43.380562 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f788ce3-e9d2-40d4-99be-50679012ad1f admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:43.386309 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3208/6448] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:34:43 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:34:43.386309 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca314e0-6ca9-497d-bf6c-9b9b3d556426 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:43.400613 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca314e0-6ca9-497d-bf6c-9b9b3d556426 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:43.408707 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7ec076-93a3-4564-aeea-cacc4443e61b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:43.409378 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7ec076-93a3-4564-aeea-cacc4443e61b admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:43.409666 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7ec076-93a3-4564-aeea-cacc4443e61b admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:43.409982 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7ec076-93a3-4564-aeea-cacc4443e61b admin admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:43.410927 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7ec076-93a3-4564-aeea-cacc4443e61b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:34:43.412508 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7ec076-93a3-4564-aeea-cacc4443e61b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:43.414806 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7ec076-93a3-4564-aeea-cacc4443e61b admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:43.444264 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:43.448920 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3209/6449] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:34:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:34:43.449926 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7ec076-93a3-4564-aeea-cacc4443e61b admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:43.461444 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7ec076-93a3-4564-aeea-cacc4443e61b admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:43.466841 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-6f788ce3-e9d2-40d4-99be-50679012ad1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abe9428815bd479f96bb97e74e72337b', 'request_id': 'req-6f788ce3-e9d2-40d4-99be-50679012ad1f'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:43.479442 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-6f788ce3-e9d2-40d4-99be-50679012ad1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abe9428815bd479f96bb97e74e72337b', 'request_id': 'req-6f788ce3-e9d2-40d4-99be-50679012ad1f'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:43.490909 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-6f788ce3-e9d2-40d4-99be-50679012ad1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abe9428815bd479f96bb97e74e72337b', 'request_id': 'req-6f788ce3-e9d2-40d4-99be-50679012ad1f'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:43.505283 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-6f788ce3-e9d2-40d4-99be-50679012ad1f admin admin] The token cache is being invalidate because project abe9428815bd479f96bb97e74e72337b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:34:43.505932 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-6f788ce3-e9d2-40d4-99be-50679012ad1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:43.506839 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-6f788ce3-e9d2-40d4-99be-50679012ad1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:43.509795 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3241/6450] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:34:43 2022] DELETE /identity/v3/projects/abe9428815bd479f96bb97e74e72337b => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:43.510917 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f788ce3-e9d2-40d4-99be-50679012ad1f admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:43.515018 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-6f788ce3-e9d2-40d4-99be-50679012ad1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:43.545796 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f84bad2-9d51-4661-9610-477ab754a0b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:43.546538 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f84bad2-9d51-4661-9610-477ab754a0b2 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:43.546820 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f84bad2-9d51-4661-9610-477ab754a0b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:43.547274 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f84bad2-9d51-4661-9610-477ab754a0b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:43.548030 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f84bad2-9d51-4661-9610-477ab754a0b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:43.549680 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f84bad2-9d51-4661-9610-477ab754a0b2 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:43.570518 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3210/6451] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:34:43 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:34:43.571646 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f84bad2-9d51-4661-9610-477ab754a0b2 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:43.573850 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-3f84bad2-9d51-4661-9610-477ab754a0b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:43.602227 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f788ce3-e9d2-40d4-99be-50679012ad1f admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:43.602559 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f84bad2-9d51-4661-9610-477ab754a0b2 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:43.608267 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd62df3a-7970-4140-b00b-11108be8e9b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:43.609164 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd62df3a-7970-4140-b00b-11108be8e9b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:43.609446 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd62df3a-7970-4140-b00b-11108be8e9b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:43.609746 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd62df3a-7970-4140-b00b-11108be8e9b4 admin admin] PATH_INFO: `/v3/users/6f37216382024474a012fc0fbf310723` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:43.611196 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd62df3a-7970-4140-b00b-11108be8e9b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f37216382024474a012fc0fbf310723)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:43.611595 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b53938-daf7-4ae5-a9c2-4ae25002d5f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:43.612414 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b53938-daf7-4ae5-a9c2-4ae25002d5f4 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:43.612514 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b53938-daf7-4ae5-a9c2-4ae25002d5f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:43.612787 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b53938-daf7-4ae5-a9c2-4ae25002d5f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:43.613137 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd62df3a-7970-4140-b00b-11108be8e9b4 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:43.613576 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b53938-daf7-4ae5-a9c2-4ae25002d5f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:43.615764 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b53938-daf7-4ae5-a9c2-4ae25002d5f4 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:43.618759 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:43.645903 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3242/6452] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:34:43 2022] POST /identity/v3/projects => generated 399 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:34:43.645903 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abd0c43-4bee-48fe-aeae-8d2db035ec56 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:43.645903 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abd0c43-4bee-48fe-aeae-8d2db035ec56 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:43.645903 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abd0c43-4bee-48fe-aeae-8d2db035ec56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:43.664839 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-0abd0c43-4bee-48fe-aeae-8d2db035ec56 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:34:43.665519 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-dd62df3a-7970-4140-b00b-11108be8e9b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f37216382024474a012fc0fbf310723'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:43.666075 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-0abd0c43-4bee-48fe-aeae-8d2db035ec56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:43.672832 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-dd62df3a-7970-4140-b00b-11108be8e9b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f37216382024474a012fc0fbf310723'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:43.673573 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-dd62df3a-7970-4140-b00b-11108be8e9b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f37216382024474a012fc0fbf310723'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:43.681793 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-dd62df3a-7970-4140-b00b-11108be8e9b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f37216382024474a012fc0fbf310723'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:43.696102 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-dd62df3a-7970-4140-b00b-11108be8e9b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f37216382024474a012fc0fbf310723'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:43.702475 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3211/6453] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:34:43 2022] DELETE /identity/v3/users/6f37216382024474a012fc0fbf310723 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:43.703359 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd62df3a-7970-4140-b00b-11108be8e9b4 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:43.704741 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-dd62df3a-7970-4140-b00b-11108be8e9b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:43.729627 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3243/6454] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:34:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:34:43.730531 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abd0c43-4bee-48fe-aeae-8d2db035ec56 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:43.731826 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-0abd0c43-4bee-48fe-aeae-8d2db035ec56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:43.743698 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abd0c43-4bee-48fe-aeae-8d2db035ec56 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:43.773872 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd62df3a-7970-4140-b00b-11108be8e9b4 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:43.779132 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef79b709-1848-48e7-b19e-26d2ab85f73d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:43.780149 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef79b709-1848-48e7-b19e-26d2ab85f73d admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:43.780331 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef79b709-1848-48e7-b19e-26d2ab85f73d admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:43.780688 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef79b709-1848-48e7-b19e-26d2ab85f73d admin admin] PATH_INFO: `/v3/projects/393d0f9c2ea74d258d28440fa8644d4a/users/28814586010d410b814aab2971e084f7/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:43.797990 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef79b709-1848-48e7-b19e-26d2ab85f73d admin admin] RBAC: Authorizing `identity:create_grant(project_id=393d0f9c2ea74d258d28440fa8644d4a, user_id=28814586010d410b814aab2971e084f7, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:43.799651 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:43.800886 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef79b709-1848-48e7-b19e-26d2ab85f73d admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:43.815339 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9116ddfc-e536-4177-9f77-7147a501e608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:43.816611 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9116ddfc-e536-4177-9f77-7147a501e608 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:43.817190 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9116ddfc-e536-4177-9f77-7147a501e608 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:43.817653 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9116ddfc-e536-4177-9f77-7147a501e608 admin admin] PATH_INFO: `/v3/projects/efdaa937f9bc4939bf69491da0c27453` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:43.820299 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9116ddfc-e536-4177-9f77-7147a501e608 admin admin] RBAC: Authorizing `identity:delete_project(project_id=efdaa937f9bc4939bf69491da0c27453)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:43.822934 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9116ddfc-e536-4177-9f77-7147a501e608 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:43.838044 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3212/6455] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:34:43 2022] PUT /identity/v3/projects/393d0f9c2ea74d258d28440fa8644d4a/users/28814586010d410b814aab2971e084f7/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:43.838044 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef79b709-1848-48e7-b19e-26d2ab85f73d admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:43.839500 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-ef79b709-1848-48e7-b19e-26d2ab85f73d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:43.879152 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-9116ddfc-e536-4177-9f77-7147a501e608 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efdaa937f9bc4939bf69491da0c27453', 'request_id': 'req-9116ddfc-e536-4177-9f77-7147a501e608'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:43.890505 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-9116ddfc-e536-4177-9f77-7147a501e608 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efdaa937f9bc4939bf69491da0c27453', 'request_id': 'req-9116ddfc-e536-4177-9f77-7147a501e608'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:43.896807 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-9116ddfc-e536-4177-9f77-7147a501e608 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efdaa937f9bc4939bf69491da0c27453', 'request_id': 'req-9116ddfc-e536-4177-9f77-7147a501e608'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:43.908380 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-9116ddfc-e536-4177-9f77-7147a501e608 admin admin] The token cache is being invalidate because project efdaa937f9bc4939bf69491da0c27453 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:34:43.908668 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-9116ddfc-e536-4177-9f77-7147a501e608 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:43.909334 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-9116ddfc-e536-4177-9f77-7147a501e608 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:43.911289 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3244/6456] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:34:43 2022] DELETE /identity/v3/projects/efdaa937f9bc4939bf69491da0c27453 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:43.912555 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b884cf27-32ef-4b82-a540-a121346abad1 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:43.912842 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b884cf27-32ef-4b82-a540-a121346abad1 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:43.913123 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b884cf27-32ef-4b82-a540-a121346abad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:43.914407 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef79b709-1848-48e7-b19e-26d2ab85f73d admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:43.925414 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:43.932544 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-b884cf27-32ef-4b82-a540-a121346abad1 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:34:43.933778 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-b884cf27-32ef-4b82-a540-a121346abad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:43.978302 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bc2582-f3de-490c-a16e-4819054bf43f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:43.978992 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bc2582-f3de-490c-a16e-4819054bf43f admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:43.979273 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bc2582-f3de-490c-a16e-4819054bf43f admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:43.979552 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bc2582-f3de-490c-a16e-4819054bf43f admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:43.980235 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bc2582-f3de-490c-a16e-4819054bf43f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:43.982269 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bc2582-f3de-490c-a16e-4819054bf43f admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:43.995943 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3245/6457] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:34:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:34:43.997381 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347e3ec5-a01d-424c-be60-39d25e21af1b None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:43.997670 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347e3ec5-a01d-424c-be60-39d25e21af1b None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:43.998009 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347e3ec5-a01d-424c-be60-39d25e21af1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:44.008136 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3213/6458] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:34:43 2022] POST /identity/v3/users => generated 300 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:34:44.008136 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ef48b7-2ab5-4229-9413-680d7a2833bb None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:44.008136 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ef48b7-2ab5-4229-9413-680d7a2833bb None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:44.008136 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ef48b7-2ab5-4229-9413-680d7a2833bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:44.019744 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-347e3ec5-a01d-424c-be60-39d25e21af1b None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:34:44.021083 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-347e3ec5-a01d-424c-be60-39d25e21af1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:44.030391 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3246/6459] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:34:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:34:44.031380 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1557fda-347e-42b3-b10b-3dd57a226a2b None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:44.031668 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1557fda-347e-42b3-b10b-3dd57a226a2b None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:44.031943 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1557fda-347e-42b3-b10b-3dd57a226a2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:44.036568 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-a5ef48b7-2ab5-4229-9413-680d7a2833bb None None] MFA Rules not processed for user `28814586010d410b814aab2971e084f7`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:34:44.037770 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-a5ef48b7-2ab5-4229-9413-680d7a2833bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:44.051435 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-d1557fda-347e-42b3-b10b-3dd57a226a2b None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:34:44.052662 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-d1557fda-347e-42b3-b10b-3dd57a226a2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:44.061128 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3247/6460] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:34:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:34:44.061958 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1557fda-347e-42b3-b10b-3dd57a226a2b None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:44.063162 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-d1557fda-347e-42b3-b10b-3dd57a226a2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:44.102611 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3214/6461] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:34:44 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:34:44.103464 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ef48b7-2ab5-4229-9413-680d7a2833bb None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:44.104760 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-a5ef48b7-2ab5-4229-9413-680d7a2833bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:44.119123 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ef48b7-2ab5-4229-9413-680d7a2833bb None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:44.123616 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1557fda-347e-42b3-b10b-3dd57a226a2b None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:44.124006 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fdb5cb-a69f-4f42-b1a1-1735e84ad895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:44.124695 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fdb5cb-a69f-4f42-b1a1-1735e84ad895 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:44.124954 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fdb5cb-a69f-4f42-b1a1-1735e84ad895 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:44.125224 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fdb5cb-a69f-4f42-b1a1-1735e84ad895 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:44.125978 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fdb5cb-a69f-4f42-b1a1-1735e84ad895 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:44.127243 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bc91ef-df36-4124-8cc5-d29147c72daa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:44.127582 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fdb5cb-a69f-4f42-b1a1-1735e84ad895 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:44.127887 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bc91ef-df36-4124-8cc5-d29147c72daa service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:44.128221 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bc91ef-df36-4124-8cc5-d29147c72daa service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:44.128497 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bc91ef-df36-4124-8cc5-d29147c72daa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:44.137718 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bc91ef-df36-4124-8cc5-d29147c72daa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:44.140875 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3215/6462] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:34:44 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:34:44.140875 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fdb5cb-a69f-4f42-b1a1-1735e84ad895 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:44.141071 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bc91ef-df36-4124-8cc5-d29147c72daa service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:44.148483 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fdb5cb-a69f-4f42-b1a1-1735e84ad895 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:44.148902 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3248/6463] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:34:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:34:44.150167 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40374906-59a9-4d1f-824d-c9df162c5284 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:44.150449 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40374906-59a9-4d1f-824d-c9df162c5284 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:44.150730 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40374906-59a9-4d1f-824d-c9df162c5284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:44.153243 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7348e591-0fbf-40eb-b164-a59f0db69d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:44.153969 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7348e591-0fbf-40eb-b164-a59f0db69d49 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:44.154261 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7348e591-0fbf-40eb-b164-a59f0db69d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:44.154545 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7348e591-0fbf-40eb-b164-a59f0db69d49 admin admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:44.155306 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7348e591-0fbf-40eb-b164-a59f0db69d49 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:34:44.155553 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7348e591-0fbf-40eb-b164-a59f0db69d49 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:44.157160 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7348e591-0fbf-40eb-b164-a59f0db69d49 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:44.168979 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-40374906-59a9-4d1f-824d-c9df162c5284 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:34:44.170678 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-40374906-59a9-4d1f-824d-c9df162c5284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:44.175442 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3216/6464] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:34:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:34:44.175442 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7348e591-0fbf-40eb-b164-a59f0db69d49 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:44.177047 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-7348e591-0fbf-40eb-b164-a59f0db69d49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:44.180947 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3249/6465] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:34:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:34:44.181618 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40374906-59a9-4d1f-824d-c9df162c5284 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:44.191712 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40374906-59a9-4d1f-824d-c9df162c5284 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:44.191965 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7348e591-0fbf-40eb-b164-a59f0db69d49 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:44.196814 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdb8040-9fab-4efa-8745-eb69bcde9c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:44.197538 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdb8040-9fab-4efa-8745-eb69bcde9c70 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:44.197817 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdb8040-9fab-4efa-8745-eb69bcde9c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:44.198225 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54864c7-1355-4ec9-bb74-0ec530c263e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:44.198357 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdb8040-9fab-4efa-8745-eb69bcde9c70 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:44.199034 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdb8040-9fab-4efa-8745-eb69bcde9c70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:44.199163 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54864c7-1355-4ec9-bb74-0ec530c263e9 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:44.199478 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54864c7-1355-4ec9-bb74-0ec530c263e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:44.199847 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54864c7-1355-4ec9-bb74-0ec530c263e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:44.200721 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdb8040-9fab-4efa-8745-eb69bcde9c70 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:44.200840 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54864c7-1355-4ec9-bb74-0ec530c263e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:44.202962 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54864c7-1355-4ec9-bb74-0ec530c263e9 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:44.205263 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:44.220087 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3250/6466] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:34:44 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:34:44.220999 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdb8040-9fab-4efa-8745-eb69bcde9c70 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:44.232519 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdb8040-9fab-4efa-8745-eb69bcde9c70 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:44.239507 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3217/6467] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:34:44 2022] POST /identity/v3/projects => generated 367 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:34:44.239507 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54864c7-1355-4ec9-bb74-0ec530c263e9 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:44.242104 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d74d8a2-cfed-4df0-9aa6-6590d755e843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:44.242924 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d74d8a2-cfed-4df0-9aa6-6590d755e843 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:44.243337 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d74d8a2-cfed-4df0-9aa6-6590d755e843 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:44.243654 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d74d8a2-cfed-4df0-9aa6-6590d755e843 admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:44.244631 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d74d8a2-cfed-4df0-9aa6-6590d755e843 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:44.247079 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d74d8a2-cfed-4df0-9aa6-6590d755e843 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:44.283507 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3251/6468] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:34:44 2022] POST /identity/v3/projects => generated 379 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:34:44.283507 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d74d8a2-cfed-4df0-9aa6-6590d755e843 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:44.294852 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:44.313689 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54864c7-1355-4ec9-bb74-0ec530c263e9 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:44.367596 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d74d8a2-cfed-4df0-9aa6-6590d755e843 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:44.375375 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a9927e-afa8-477e-819a-668ccb93d0ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:44.376522 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a9927e-afa8-477e-819a-668ccb93d0ed admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:44.376803 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a9927e-afa8-477e-819a-668ccb93d0ed admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:44.377462 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a9927e-afa8-477e-819a-668ccb93d0ed admin admin] PATH_INFO: `/v3/projects/a8cf24563e754f26a2a109012085d38d/users/0f975865c7f3476e98d9de6ca7549634/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:44.383449 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58921c8f-cb35-4da6-ae45-6157f688adfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:44.384153 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58921c8f-cb35-4da6-ae45-6157f688adfd admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:44.384430 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58921c8f-cb35-4da6-ae45-6157f688adfd admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:44.384709 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58921c8f-cb35-4da6-ae45-6157f688adfd admin admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:44.385473 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58921c8f-cb35-4da6-ae45-6157f688adfd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:34:44.385782 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58921c8f-cb35-4da6-ae45-6157f688adfd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:44.387480 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58921c8f-cb35-4da6-ae45-6157f688adfd admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:44.394806 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a9927e-afa8-477e-819a-668ccb93d0ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8cf24563e754f26a2a109012085d38d, user_id=0f975865c7f3476e98d9de6ca7549634, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:44.397616 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a9927e-afa8-477e-819a-668ccb93d0ed admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:44.402109 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3218/6469] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:34:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:34:44.403172 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58921c8f-cb35-4da6-ae45-6157f688adfd admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:44.413497 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3252/6470] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:34:44 2022] PUT /identity/v3/projects/a8cf24563e754f26a2a109012085d38d/users/0f975865c7f3476e98d9de6ca7549634/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:44.414082 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58921c8f-cb35-4da6-ae45-6157f688adfd admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:44.414341 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a9927e-afa8-477e-819a-668ccb93d0ed admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:44.470883 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bb8c91-1272-4285-a56a-49fec569a284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:44.471569 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bb8c91-1272-4285-a56a-49fec569a284 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:44.471851 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bb8c91-1272-4285-a56a-49fec569a284 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:44.472123 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bb8c91-1272-4285-a56a-49fec569a284 admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:44.472852 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bb8c91-1272-4285-a56a-49fec569a284 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:44.475264 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bb8c91-1272-4285-a56a-49fec569a284 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:44.479114 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a9927e-afa8-477e-819a-668ccb93d0ed admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:44.483898 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662ad4e6-fc68-4848-adf1-638671f1b4e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:44.484569 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662ad4e6-fc68-4848-adf1-638671f1b4e4 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:44.484856 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662ad4e6-fc68-4848-adf1-638671f1b4e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:44.485135 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662ad4e6-fc68-4848-adf1-638671f1b4e4 admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:44.485852 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662ad4e6-fc68-4848-adf1-638671f1b4e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:44.488145 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662ad4e6-fc68-4848-adf1-638671f1b4e4 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:44.499596 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3219/6471] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:34:44 2022] POST /identity/v3/users => generated 290 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:34:44.499596 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bb8c91-1272-4285-a56a-49fec569a284 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:44.500185 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-e5bb8c91-1272-4285-a56a-49fec569a284 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:44.513915 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3253/6472] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:34:44 2022] POST /identity/v3/users => generated 290 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:34:44.513915 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662ad4e6-fc68-4848-adf1-638671f1b4e4 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:44.514657 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bb8c91-1272-4285-a56a-49fec569a284 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:44.519613 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39672e6f-2528-4fb3-a1a6-1fd7a97fa728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:44.520579 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39672e6f-2528-4fb3-a1a6-1fd7a97fa728 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:44.520852 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39672e6f-2528-4fb3-a1a6-1fd7a97fa728 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:44.521118 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39672e6f-2528-4fb3-a1a6-1fd7a97fa728 admin admin] PATH_INFO: `/v3/projects/2171da48188747b88033b7148304cbe3` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:44.521778 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662ad4e6-fc68-4848-adf1-638671f1b4e4 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:44.522326 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39672e6f-2528-4fb3-a1a6-1fd7a97fa728 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2171da48188747b88033b7148304cbe3)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:44.524254 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39672e6f-2528-4fb3-a1a6-1fd7a97fa728 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:44.526667 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccc2980-f938-46ca-85bf-22e220ba256e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:44.527316 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccc2980-f938-46ca-85bf-22e220ba256e admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:44.527598 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccc2980-f938-46ca-85bf-22e220ba256e admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:44.527875 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccc2980-f938-46ca-85bf-22e220ba256e admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:44.528584 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccc2980-f938-46ca-85bf-22e220ba256e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:44.530514 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccc2980-f938-46ca-85bf-22e220ba256e admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:44.558770 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3254/6473] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:34:44 2022] POST /identity/v3/projects => generated 393 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:34:44.560115 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f86f089-26da-4ff6-8e8d-fc0dc9f0472c None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:44.560610 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f86f089-26da-4ff6-8e8d-fc0dc9f0472c None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:44.560868 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f86f089-26da-4ff6-8e8d-fc0dc9f0472c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:44.573430 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-39672e6f-2528-4fb3-a1a6-1fd7a97fa728 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2171da48188747b88033b7148304cbe3', 'request_id': 'req-39672e6f-2528-4fb3-a1a6-1fd7a97fa728'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:44.581737 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-39672e6f-2528-4fb3-a1a6-1fd7a97fa728 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2171da48188747b88033b7148304cbe3', 'request_id': 'req-39672e6f-2528-4fb3-a1a6-1fd7a97fa728'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:44.588719 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-3f86f089-26da-4ff6-8e8d-fc0dc9f0472c None None] MFA Rules not processed for user `0f975865c7f3476e98d9de6ca7549634`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:34:44.589027 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-39672e6f-2528-4fb3-a1a6-1fd7a97fa728 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2171da48188747b88033b7148304cbe3', 'request_id': 'req-39672e6f-2528-4fb3-a1a6-1fd7a97fa728'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:44.590147 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-3f86f089-26da-4ff6-8e8d-fc0dc9f0472c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:44.602576 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:44.604671 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:44.610388 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-39672e6f-2528-4fb3-a1a6-1fd7a97fa728 admin admin] The token cache is being invalidate because project 2171da48188747b88033b7148304cbe3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:34:44.610739 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-39672e6f-2528-4fb3-a1a6-1fd7a97fa728 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:44.611961 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-39672e6f-2528-4fb3-a1a6-1fd7a97fa728 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:44.617722 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3220/6474] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:34:44 2022] DELETE /identity/v3/projects/2171da48188747b88033b7148304cbe3 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:44.618590 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39672e6f-2528-4fb3-a1a6-1fd7a97fa728 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:44.619970 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-39672e6f-2528-4fb3-a1a6-1fd7a97fa728 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:44.661114 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3255/6475] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:34:44 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:34:44.662001 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f86f089-26da-4ff6-8e8d-fc0dc9f0472c None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:44.663418 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-3f86f089-26da-4ff6-8e8d-fc0dc9f0472c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:44.683925 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39672e6f-2528-4fb3-a1a6-1fd7a97fa728 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:44.688828 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66be74e-1993-4f27-87dd-d3faaf76d44d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:44.689538 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66be74e-1993-4f27-87dd-d3faaf76d44d admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:44.689815 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66be74e-1993-4f27-87dd-d3faaf76d44d admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:44.690120 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66be74e-1993-4f27-87dd-d3faaf76d44d admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:44.690843 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66be74e-1993-4f27-87dd-d3faaf76d44d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:44.692479 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66be74e-1993-4f27-87dd-d3faaf76d44d admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:44.703268 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3221/6476] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:34:44 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:34:44.704193 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66be74e-1993-4f27-87dd-d3faaf76d44d admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:44.706196 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-f66be74e-1993-4f27-87dd-d3faaf76d44d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:44.718523 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66be74e-1993-4f27-87dd-d3faaf76d44d admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:44.723818 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce3cb5b-e135-4ed5-9ca3-f67dbd6c3e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:44.724820 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce3cb5b-e135-4ed5-9ca3-f67dbd6c3e99 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:44.725101 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce3cb5b-e135-4ed5-9ca3-f67dbd6c3e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:44.725375 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce3cb5b-e135-4ed5-9ca3-f67dbd6c3e99 admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:44.726086 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce3cb5b-e135-4ed5-9ca3-f67dbd6c3e99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:44.728004 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce3cb5b-e135-4ed5-9ca3-f67dbd6c3e99 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:44.729842 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f86f089-26da-4ff6-8e8d-fc0dc9f0472c None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:44.734451 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8dfd2b-13e8-4760-ab8c-908dbc74e86d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:44.735128 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8dfd2b-13e8-4760-ab8c-908dbc74e86d admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:44.735409 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8dfd2b-13e8-4760-ab8c-908dbc74e86d admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:44.735893 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8dfd2b-13e8-4760-ab8c-908dbc74e86d admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:44.736412 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8dfd2b-13e8-4760-ab8c-908dbc74e86d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:44.738068 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8dfd2b-13e8-4760-ab8c-908dbc74e86d admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:44.749029 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3256/6477] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:34:44 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:34:44.752418 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3222/6478] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:34:44 2022] POST /identity/v3/users => generated 297 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:34:44.752571 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8dfd2b-13e8-4760-ab8c-908dbc74e86d admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:44.752663 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce3cb5b-e135-4ed5-9ca3-f67dbd6c3e99 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:44.753679 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-6ce3cb5b-e135-4ed5-9ca3-f67dbd6c3e99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:44.753823 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-cc8dfd2b-13e8-4760-ab8c-908dbc74e86d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:44.766914 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce3cb5b-e135-4ed5-9ca3-f67dbd6c3e99 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:44.767088 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8dfd2b-13e8-4760-ab8c-908dbc74e86d admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:44.771868 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648ccc90-7e9d-40cc-83e7-69e43a0f5809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:44.772530 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648ccc90-7e9d-40cc-83e7-69e43a0f5809 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:44.772637 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5bf4f1-1509-4fe8-bf0d-14410a3ba5b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:44.772811 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648ccc90-7e9d-40cc-83e7-69e43a0f5809 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:44.773083 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648ccc90-7e9d-40cc-83e7-69e43a0f5809 admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:44.773500 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5bf4f1-1509-4fe8-bf0d-14410a3ba5b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:44.773765 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648ccc90-7e9d-40cc-83e7-69e43a0f5809 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:44.773955 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5bf4f1-1509-4fe8-bf0d-14410a3ba5b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:44.774238 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5bf4f1-1509-4fe8-bf0d-14410a3ba5b8 admin admin] PATH_INFO: `/v3/users/c273890567f648c5b8e335b15d4b1c70` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:44.775470 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5bf4f1-1509-4fe8-bf0d-14410a3ba5b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c273890567f648c5b8e335b15d4b1c70)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:44.775842 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648ccc90-7e9d-40cc-83e7-69e43a0f5809 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:44.777706 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5bf4f1-1509-4fe8-bf0d-14410a3ba5b8 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:44.807315 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3223/6479] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:34:44 2022] POST /identity/v3/projects => generated 399 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:34:44.808829 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648ccc90-7e9d-40cc-83e7-69e43a0f5809 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:44.846619 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-de5bf4f1-1509-4fe8-bf0d-14410a3ba5b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c273890567f648c5b8e335b15d4b1c70'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:44.847497 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-de5bf4f1-1509-4fe8-bf0d-14410a3ba5b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c273890567f648c5b8e335b15d4b1c70'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:44.855171 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-de5bf4f1-1509-4fe8-bf0d-14410a3ba5b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c273890567f648c5b8e335b15d4b1c70'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:44.866916 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-de5bf4f1-1509-4fe8-bf0d-14410a3ba5b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c273890567f648c5b8e335b15d4b1c70'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:44.878989 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648ccc90-7e9d-40cc-83e7-69e43a0f5809 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:44.880038 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-de5bf4f1-1509-4fe8-bf0d-14410a3ba5b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c273890567f648c5b8e335b15d4b1c70'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:44.883924 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97680a9f-da04-4e6f-90f1-4105c59627bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:44.884830 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97680a9f-da04-4e6f-90f1-4105c59627bf admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:44.885115 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97680a9f-da04-4e6f-90f1-4105c59627bf admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:44.885390 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97680a9f-da04-4e6f-90f1-4105c59627bf admin admin] PATH_INFO: `/v3/projects/e5a262ead17f44c6a1c5df904359cf6b/users/6169c34aa5684bd3a8c97599122f6855/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:44.886492 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3257/6480] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:34:44 2022] DELETE /identity/v3/users/c273890567f648c5b8e335b15d4b1c70 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:44.887241 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5bf4f1-1509-4fe8-bf0d-14410a3ba5b8 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:44.888569 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-de5bf4f1-1509-4fe8-bf0d-14410a3ba5b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:44.908610 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97680a9f-da04-4e6f-90f1-4105c59627bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5a262ead17f44c6a1c5df904359cf6b, user_id=6169c34aa5684bd3a8c97599122f6855, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:44.912398 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97680a9f-da04-4e6f-90f1-4105c59627bf admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:44.920321 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:44.935298 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3224/6481] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:34:44 2022] PUT /identity/v3/projects/e5a262ead17f44c6a1c5df904359cf6b/users/6169c34aa5684bd3a8c97599122f6855/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:44.938900 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97680a9f-da04-4e6f-90f1-4105c59627bf admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:44.946191 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-97680a9f-da04-4e6f-90f1-4105c59627bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:44.979410 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5bf4f1-1509-4fe8-bf0d-14410a3ba5b8 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:44.998411 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:45.045248 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97680a9f-da04-4e6f-90f1-4105c59627bf admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:45.053614 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f395b1f0-6f43-49d5-b94e-366f33133e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:45.054634 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f395b1f0-6f43-49d5-b94e-366f33133e09 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:45.055185 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f395b1f0-6f43-49d5-b94e-366f33133e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:45.055670 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f395b1f0-6f43-49d5-b94e-366f33133e09 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:45.056645 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f395b1f0-6f43-49d5-b94e-366f33133e09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:45.058690 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f395b1f0-6f43-49d5-b94e-366f33133e09 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:45.064542 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c110c6-19dd-469f-8949-99009770f7b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:45.065174 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c110c6-19dd-469f-8949-99009770f7b7 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:45.065445 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c110c6-19dd-469f-8949-99009770f7b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:45.065752 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c110c6-19dd-469f-8949-99009770f7b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:45.067067 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c110c6-19dd-469f-8949-99009770f7b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:45.068747 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c110c6-19dd-469f-8949-99009770f7b7 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:45.074445 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3225/6482] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:34:44 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:34:45.074445 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f395b1f0-6f43-49d5-b94e-366f33133e09 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:45.076546 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-f395b1f0-6f43-49d5-b94e-366f33133e09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:45.079855 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3258/6483] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:34:44 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:34:45.083749 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c110c6-19dd-469f-8949-99009770f7b7 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:45.086009 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-24c110c6-19dd-469f-8949-99009770f7b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:45.097116 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f395b1f0-6f43-49d5-b94e-366f33133e09 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:45.099206 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c110c6-19dd-469f-8949-99009770f7b7 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:45.103315 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbf6d88-be3a-4b17-be4e-0c9f09bf2f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:45.104107 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbf6d88-be3a-4b17-be4e-0c9f09bf2f43 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:45.104395 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbf6d88-be3a-4b17-be4e-0c9f09bf2f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:45.104667 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbf6d88-be3a-4b17-be4e-0c9f09bf2f43 admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:45.104847 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efc01a6-e4ba-4410-b606-9f1494fffa9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:45.105366 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbf6d88-be3a-4b17-be4e-0c9f09bf2f43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:45.105733 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efc01a6-e4ba-4410-b606-9f1494fffa9c admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:45.106172 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efc01a6-e4ba-4410-b606-9f1494fffa9c admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:45.106532 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efc01a6-e4ba-4410-b606-9f1494fffa9c admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:45.107362 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbf6d88-be3a-4b17-be4e-0c9f09bf2f43 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:45.107546 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efc01a6-e4ba-4410-b606-9f1494fffa9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:45.109232 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efc01a6-e4ba-4410-b606-9f1494fffa9c admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:45.121659 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3259/6484] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:34:45 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:34:45.122721 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efc01a6-e4ba-4410-b606-9f1494fffa9c admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:45.134061 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efc01a6-e4ba-4410-b606-9f1494fffa9c admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:45.137559 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3226/6485] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:34:45 2022] POST /identity/v3/users => generated 306 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:34:45.138658 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbf6d88-be3a-4b17-be4e-0c9f09bf2f43 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:45.139720 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6a2f10-b6a8-4c65-ab77-17529df5f5fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:45.140545 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6a2f10-b6a8-4c65-ab77-17529df5f5fc admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:45.140929 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6a2f10-b6a8-4c65-ab77-17529df5f5fc admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:45.141125 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6a2f10-b6a8-4c65-ab77-17529df5f5fc admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:45.141844 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6a2f10-b6a8-4c65-ab77-17529df5f5fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:45.143440 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6a2f10-b6a8-4c65-ab77-17529df5f5fc admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:45.149537 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbf6d88-be3a-4b17-be4e-0c9f09bf2f43 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:45.154163 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3260/6486] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:34:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:34:45.154305 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb102cfc-a03b-4ae7-a42a-9ac663d382d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:45.154832 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6a2f10-b6a8-4c65-ab77-17529df5f5fc admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:45.155213 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb102cfc-a03b-4ae7-a42a-9ac663d382d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:45.155449 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb102cfc-a03b-4ae7-a42a-9ac663d382d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:45.155804 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb102cfc-a03b-4ae7-a42a-9ac663d382d8 admin admin] PATH_INFO: `/v3/projects/bfe378b8ed734056ac85e48626b3606e/users/5283f93db2194a8596d46d2baf2a5e9b/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:45.156683 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-6e6a2f10-b6a8-4c65-ab77-17529df5f5fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:45.169625 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6a2f10-b6a8-4c65-ab77-17529df5f5fc admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:45.171591 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb102cfc-a03b-4ae7-a42a-9ac663d382d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfe378b8ed734056ac85e48626b3606e, user_id=5283f93db2194a8596d46d2baf2a5e9b, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:45.174285 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb102cfc-a03b-4ae7-a42a-9ac663d382d8 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:45.174852 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434bd89f-b0b1-47b2-8f6c-614f53555560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:45.175732 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434bd89f-b0b1-47b2-8f6c-614f53555560 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:45.176019 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434bd89f-b0b1-47b2-8f6c-614f53555560 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:45.176334 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434bd89f-b0b1-47b2-8f6c-614f53555560 admin admin] PATH_INFO: `/v3/projects/3322852c2a7248e9a4c0ba3eb1684cbb` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:45.177574 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434bd89f-b0b1-47b2-8f6c-614f53555560 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3322852c2a7248e9a4c0ba3eb1684cbb)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:45.179795 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434bd89f-b0b1-47b2-8f6c-614f53555560 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:45.187982 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3227/6487] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:34:45 2022] PUT /identity/v3/projects/bfe378b8ed734056ac85e48626b3606e/users/5283f93db2194a8596d46d2baf2a5e9b/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:45.188595 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb102cfc-a03b-4ae7-a42a-9ac663d382d8 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:45.231853 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-434bd89f-b0b1-47b2-8f6c-614f53555560 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3322852c2a7248e9a4c0ba3eb1684cbb', 'request_id': 'req-434bd89f-b0b1-47b2-8f6c-614f53555560'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:45.239792 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-434bd89f-b0b1-47b2-8f6c-614f53555560 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3322852c2a7248e9a4c0ba3eb1684cbb', 'request_id': 'req-434bd89f-b0b1-47b2-8f6c-614f53555560'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:45.245993 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-434bd89f-b0b1-47b2-8f6c-614f53555560 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3322852c2a7248e9a4c0ba3eb1684cbb', 'request_id': 'req-434bd89f-b0b1-47b2-8f6c-614f53555560'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:45.254887 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb102cfc-a03b-4ae7-a42a-9ac663d382d8 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:45.257587 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-434bd89f-b0b1-47b2-8f6c-614f53555560 admin admin] The token cache is being invalidate because project 3322852c2a7248e9a4c0ba3eb1684cbb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:34:45.257907 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-434bd89f-b0b1-47b2-8f6c-614f53555560 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:45.258554 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-434bd89f-b0b1-47b2-8f6c-614f53555560 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:45.260140 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3261/6488] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:34:45 2022] DELETE /identity/v3/projects/3322852c2a7248e9a4c0ba3eb1684cbb => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:45.260909 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434bd89f-b0b1-47b2-8f6c-614f53555560 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:45.262264 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-434bd89f-b0b1-47b2-8f6c-614f53555560 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:45.292798 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:45.313796 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9b54aa-29ab-4fcb-a066-664eed47804a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:45.315180 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b54aa-29ab-4fcb-a066-664eed47804a admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:45.315406 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b54aa-29ab-4fcb-a066-664eed47804a admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:45.315812 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b54aa-29ab-4fcb-a066-664eed47804a admin admin] PATH_INFO: `/v3/projects/e5a262ead17f44c6a1c5df904359cf6b/users/6169c34aa5684bd3a8c97599122f6855/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:45.318119 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9b54aa-29ab-4fcb-a066-664eed47804a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5a262ead17f44c6a1c5df904359cf6b, user_id=6169c34aa5684bd3a8c97599122f6855, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:45.320799 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9b54aa-29ab-4fcb-a066-664eed47804a admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:45.329308 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434bd89f-b0b1-47b2-8f6c-614f53555560 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:45.331125 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3228/6489] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:34:45 2022] PUT /identity/v3/projects/e5a262ead17f44c6a1c5df904359cf6b/users/6169c34aa5684bd3a8c97599122f6855/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:45.331915 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9b54aa-29ab-4fcb-a066-664eed47804a admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:45.342301 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-9c9b54aa-29ab-4fcb-a066-664eed47804a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:45.381681 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:45.385242 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98005978-39ae-44b1-8d54-77c5b1bd887c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:45.385954 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98005978-39ae-44b1-8d54-77c5b1bd887c admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:45.386234 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98005978-39ae-44b1-8d54-77c5b1bd887c admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:45.386505 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98005978-39ae-44b1-8d54-77c5b1bd887c admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:45.387240 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98005978-39ae-44b1-8d54-77c5b1bd887c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:45.388814 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98005978-39ae-44b1-8d54-77c5b1bd887c admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:45.400280 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3262/6490] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:34:45 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:34:45.401360 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c42a51c-2e72-43d8-8aeb-ccff41d89310 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:45.401639 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c42a51c-2e72-43d8-8aeb-ccff41d89310 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:45.401910 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c42a51c-2e72-43d8-8aeb-ccff41d89310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:45.412271 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9b54aa-29ab-4fcb-a066-664eed47804a admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:45.417347 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751aa74c-c3df-42c4-8b18-992fdfb487dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:45.418253 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751aa74c-c3df-42c4-8b18-992fdfb487dc admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:45.418529 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751aa74c-c3df-42c4-8b18-992fdfb487dc admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:45.418798 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751aa74c-c3df-42c4-8b18-992fdfb487dc admin admin] PATH_INFO: `/v3/projects/1b48e944de63412da8a6ddad4a319cb9/users/8c894a195be047038e8d93dae322cdc9/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:45.428548 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-4c42a51c-2e72-43d8-8aeb-ccff41d89310 None None] MFA Rules not processed for user `5283f93db2194a8596d46d2baf2a5e9b`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:34:45.429764 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-4c42a51c-2e72-43d8-8aeb-ccff41d89310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:45.433013 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751aa74c-c3df-42c4-8b18-992fdfb487dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b48e944de63412da8a6ddad4a319cb9, user_id=8c894a195be047038e8d93dae322cdc9, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:45.435747 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751aa74c-c3df-42c4-8b18-992fdfb487dc admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:45.448581 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3229/6491] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:34:45 2022] PUT /identity/v3/projects/1b48e944de63412da8a6ddad4a319cb9/users/8c894a195be047038e8d93dae322cdc9/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:45.449840 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e142383e-b8d2-49e8-8ec7-6c254f2b4a20 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:45.450158 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e142383e-b8d2-49e8-8ec7-6c254f2b4a20 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:45.450430 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e142383e-b8d2-49e8-8ec7-6c254f2b4a20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:45.467761 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-e142383e-b8d2-49e8-8ec7-6c254f2b4a20 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:34:45.468960 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-e142383e-b8d2-49e8-8ec7-6c254f2b4a20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:45.502431 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3263/6492] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:34:45 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:34:45.503862 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e853bd1-8d6e-444c-a142-39f553aafea6 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:45.504148 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e853bd1-8d6e-444c-a142-39f553aafea6 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:45.504462 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e853bd1-8d6e-444c-a142-39f553aafea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:45.528907 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3230/6493] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:34:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:34:45.530048 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e142383e-b8d2-49e8-8ec7-6c254f2b4a20 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:45.531666 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-1e853bd1-8d6e-444c-a142-39f553aafea6 None None] MFA Rules not processed for user `6169c34aa5684bd3a8c97599122f6855`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:34:45.532889 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-1e853bd1-8d6e-444c-a142-39f553aafea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:45.545664 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e142383e-b8d2-49e8-8ec7-6c254f2b4a20 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:45.550548 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edbe667-d7a6-4596-9ef2-f11af1cb8fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:45.551547 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edbe667-d7a6-4596-9ef2-f11af1cb8fb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:45.551824 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edbe667-d7a6-4596-9ef2-f11af1cb8fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:45.552099 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edbe667-d7a6-4596-9ef2-f11af1cb8fb6 admin admin] PATH_INFO: `/v3/projects/eb44e91bd95c4a4ab9792957e14e952e/users/af33cbdae9c84f998bcef8885af6f9e2/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:45.567412 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edbe667-d7a6-4596-9ef2-f11af1cb8fb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb44e91bd95c4a4ab9792957e14e952e, user_id=af33cbdae9c84f998bcef8885af6f9e2, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:45.570064 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edbe667-d7a6-4596-9ef2-f11af1cb8fb6 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:45.581621 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:45.585292 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3231/6494] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:34:45 2022] PUT /identity/v3/projects/eb44e91bd95c4a4ab9792957e14e952e/users/af33cbdae9c84f998bcef8885af6f9e2/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:45.586479 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a47d7ba-3144-438c-95be-51209d44ef96 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:45.586832 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a47d7ba-3144-438c-95be-51209d44ef96 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:45.587163 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a47d7ba-3144-438c-95be-51209d44ef96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:45.606709 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3264/6495] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:34:45 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:34:45.607621 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e853bd1-8d6e-444c-a142-39f553aafea6 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:45.608975 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-1e853bd1-8d6e-444c-a142-39f553aafea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:45.614306 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-9a47d7ba-3144-438c-95be-51209d44ef96 None None] MFA Rules not processed for user `8c894a195be047038e8d93dae322cdc9`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:34:45.615560 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-9a47d7ba-3144-438c-95be-51209d44ef96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:45.622387 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e853bd1-8d6e-444c-a142-39f553aafea6 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:45.682048 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a107cf4-e46a-4f81-93dd-a00d061c9044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:45.682811 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a107cf4-e46a-4f81-93dd-a00d061c9044 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:45.683154 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a107cf4-e46a-4f81-93dd-a00d061c9044 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:45.683521 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a107cf4-e46a-4f81-93dd-a00d061c9044 admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:45.684279 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a107cf4-e46a-4f81-93dd-a00d061c9044 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:45.686681 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a107cf4-e46a-4f81-93dd-a00d061c9044 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:45.695582 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3232/6496] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:34:45 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:34:45.699330 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eac9f1-dc61-485f-ad4b-129a98cdf475 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:45.699330 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eac9f1-dc61-485f-ad4b-129a98cdf475 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:45.699330 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eac9f1-dc61-485f-ad4b-129a98cdf475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:45.717915 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3265/6497] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:34:45 2022] POST /identity/v3/projects => generated 383 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:34:45.720669 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-35eac9f1-dc61-485f-ad4b-129a98cdf475 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:34:45.721795 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a107cf4-e46a-4f81-93dd-a00d061c9044 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:45.721975 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-35eac9f1-dc61-485f-ad4b-129a98cdf475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:45.742393 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:45.785226 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3233/6498] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:34:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:34:45.786336 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eac9f1-dc61-485f-ad4b-129a98cdf475 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:45.788374 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a107cf4-e46a-4f81-93dd-a00d061c9044 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:45.793802 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad275492-c77e-429f-9bc8-112b4717f3e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:45.794633 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad275492-c77e-429f-9bc8-112b4717f3e9 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:45.795026 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad275492-c77e-429f-9bc8-112b4717f3e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:45.795319 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad275492-c77e-429f-9bc8-112b4717f3e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:45.796173 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad275492-c77e-429f-9bc8-112b4717f3e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:45.797787 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad275492-c77e-429f-9bc8-112b4717f3e9 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:45.808078 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3266/6499] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:34:45 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:34:45.808892 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad275492-c77e-429f-9bc8-112b4717f3e9 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:45.818409 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-ad275492-c77e-429f-9bc8-112b4717f3e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:45.852968 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eac9f1-dc61-485f-ad4b-129a98cdf475 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:45.857847 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db7d52d-a1f1-41b5-b9f7-fb4e712240b6 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6169c34aa5684bd3a8c97599122f6855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5a262ead17f44c6a1c5df904359cf6b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:45.858558 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db7d52d-a1f1-41b5-b9f7-fb4e712240b6 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:45.858840 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db7d52d-a1f1-41b5-b9f7-fb4e712240b6 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:45.859135 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db7d52d-a1f1-41b5-b9f7-fb4e712240b6 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:45.859903 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db7d52d-a1f1-41b5-b9f7-fb4e712240b6 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:45.861540 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db7d52d-a1f1-41b5-b9f7-fb4e712240b6 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:45.877746 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3234/6500] 10.222.0.17 () {60 vars in 1149 bytes} [Sat Jul 23 21:34:45 2022] POST /identity/v3/domains => generated 276 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:34:45.878712 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db7d52d-a1f1-41b5-b9f7-fb4e712240b6 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:45.883310 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad275492-c77e-429f-9bc8-112b4717f3e9 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:45.901302 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:45.932853 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c327ca-1b57-432e-bef5-e463d8c736a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:45.933506 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c327ca-1b57-432e-bef5-e463d8c736a8 service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:45.933783 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c327ca-1b57-432e-bef5-e463d8c736a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:45.934236 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c327ca-1b57-432e-bef5-e463d8c736a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:45.940422 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db7d52d-a1f1-41b5-b9f7-fb4e712240b6 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:45.945494 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6f9abd-b1ec-4622-b62e-9ea5d501afe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:45.946204 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6f9abd-b1ec-4622-b62e-9ea5d501afe8 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:45.946483 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6f9abd-b1ec-4622-b62e-9ea5d501afe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:45.946996 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6f9abd-b1ec-4622-b62e-9ea5d501afe8 admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:45.947439 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6f9abd-b1ec-4622-b62e-9ea5d501afe8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:45.949408 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6f9abd-b1ec-4622-b62e-9ea5d501afe8 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:45.976280 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3235/6501] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:34:45 2022] POST /identity/v3/users => generated 292 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:34:45.976280 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6f9abd-b1ec-4622-b62e-9ea5d501afe8 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:45.984066 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6f9abd-b1ec-4622-b62e-9ea5d501afe8 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:45.988723 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785c85bb-8d95-418d-a207-9c503786e667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:45.991883 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785c85bb-8d95-418d-a207-9c503786e667 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:45.992168 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785c85bb-8d95-418d-a207-9c503786e667 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:45.994632 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785c85bb-8d95-418d-a207-9c503786e667 admin admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:45.997465 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c327ca-1b57-432e-bef5-e463d8c736a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:45.997592 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785c85bb-8d95-418d-a207-9c503786e667 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:34:45.997823 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785c85bb-8d95-418d-a207-9c503786e667 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:45.998979 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c327ca-1b57-432e-bef5-e463d8c736a8 service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:45.999461 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785c85bb-8d95-418d-a207-9c503786e667 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:46.008623 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3267/6502] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:34:45 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:34:46.009263 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c327ca-1b57-432e-bef5-e463d8c736a8 service neutron] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:46.012632 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3236/6503] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:34:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:34:46.013610 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785c85bb-8d95-418d-a207-9c503786e667 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:46.020264 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c327ca-1b57-432e-bef5-e463d8c736a8 service neutron] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:46.026136 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc46a296-803f-4b89-8391-1f99d6e54e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:46.027272 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc46a296-803f-4b89-8391-1f99d6e54e78 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:46.027751 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc46a296-803f-4b89-8391-1f99d6e54e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:46.028177 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc46a296-803f-4b89-8391-1f99d6e54e78 admin admin] PATH_INFO: `/v3/projects/eb44e91bd95c4a4ab9792957e14e952e/users/af33cbdae9c84f998bcef8885af6f9e2/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:46.030966 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc46a296-803f-4b89-8391-1f99d6e54e78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb44e91bd95c4a4ab9792957e14e952e, user_id=af33cbdae9c84f998bcef8885af6f9e2, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:46.034174 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc46a296-803f-4b89-8391-1f99d6e54e78 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:46.048433 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3268/6504] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:34:46 2022] PUT /identity/v3/projects/eb44e91bd95c4a4ab9792957e14e952e/users/af33cbdae9c84f998bcef8885af6f9e2/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:46.049151 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc46a296-803f-4b89-8391-1f99d6e54e78 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:46.087554 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:46.118298 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785c85bb-8d95-418d-a207-9c503786e667 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:46.133630 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc46a296-803f-4b89-8391-1f99d6e54e78 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:46.140024 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d669e7-367f-4c65-ab68-93bca0c1936a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:46.140826 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d669e7-367f-4c65-ab68-93bca0c1936a admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:46.141203 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d669e7-367f-4c65-ab68-93bca0c1936a admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:46.141598 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d669e7-367f-4c65-ab68-93bca0c1936a admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:46.142465 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d669e7-367f-4c65-ab68-93bca0c1936a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:46.144246 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d669e7-367f-4c65-ab68-93bca0c1936a admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:46.158410 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3269/6505] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:34:46 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:34:46.158410 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d669e7-367f-4c65-ab68-93bca0c1936a admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:46.167803 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d669e7-367f-4c65-ab68-93bca0c1936a admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:46.180133 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c58534-a94a-4968-acd1-a0e42d2a2de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:46.181191 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c58534-a94a-4968-acd1-a0e42d2a2de7 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:46.181541 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c58534-a94a-4968-acd1-a0e42d2a2de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:46.181936 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c58534-a94a-4968-acd1-a0e42d2a2de7 admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:46.182732 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c58534-a94a-4968-acd1-a0e42d2a2de7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:46.185171 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c58534-a94a-4968-acd1-a0e42d2a2de7 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:46.194305 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1248df65-781f-40a9-b49e-c280c919316f tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6169c34aa5684bd3a8c97599122f6855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5a262ead17f44c6a1c5df904359cf6b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:46.195159 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1248df65-781f-40a9-b49e-c280c919316f tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:46.195540 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1248df65-781f-40a9-b49e-c280c919316f tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:46.195947 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1248df65-781f-40a9-b49e-c280c919316f tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:46.196790 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1248df65-781f-40a9-b49e-c280c919316f tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:46.198588 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1248df65-781f-40a9-b49e-c280c919316f tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:46.217125 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3237/6506] 10.222.0.17 () {60 vars in 1149 bytes} [Sat Jul 23 21:34:46 2022] POST /identity/v3/domains => generated 275 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:34:46.218846 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294fb71a-a513-4d0f-b1ad-b25865ccab97 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:46.219271 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294fb71a-a513-4d0f-b1ad-b25865ccab97 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:46.219917 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294fb71a-a513-4d0f-b1ad-b25865ccab97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:46.220596 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3270/6507] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:34:46 2022] POST /identity/v3/projects => generated 395 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:34:46.221591 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c58534-a94a-4968-acd1-a0e42d2a2de7 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:46.254252 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-294fb71a-a513-4d0f-b1ad-b25865ccab97 None None] MFA Rules not processed for user `af33cbdae9c84f998bcef8885af6f9e2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:34:46.258236 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-294fb71a-a513-4d0f-b1ad-b25865ccab97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:46.273347 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:46.304774 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c58534-a94a-4968-acd1-a0e42d2a2de7 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:46.310405 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ad5dc9-d1af-4f7b-bccc-47eebde8593c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:46.311088 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ad5dc9-d1af-4f7b-bccc-47eebde8593c admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:46.311362 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ad5dc9-d1af-4f7b-bccc-47eebde8593c admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:46.311731 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ad5dc9-d1af-4f7b-bccc-47eebde8593c admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:46.312454 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ad5dc9-d1af-4f7b-bccc-47eebde8593c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:46.315522 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ad5dc9-d1af-4f7b-bccc-47eebde8593c admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:46.329645 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3271/6508] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:34:46 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:34:46.329645 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ad5dc9-d1af-4f7b-bccc-47eebde8593c admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:46.343580 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3238/6509] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:34:46 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:34:46.344461 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294fb71a-a513-4d0f-b1ad-b25865ccab97 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:46.372261 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294fb71a-a513-4d0f-b1ad-b25865ccab97 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:46.381225 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebf984e-8557-486a-b7f7-a2c5e231a36c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:46.386307 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebf984e-8557-486a-b7f7-a2c5e231a36c admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:46.386690 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebf984e-8557-486a-b7f7-a2c5e231a36c admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:46.387181 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebf984e-8557-486a-b7f7-a2c5e231a36c admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:46.387978 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebf984e-8557-486a-b7f7-a2c5e231a36c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:46.391848 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebf984e-8557-486a-b7f7-a2c5e231a36c admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:46.420133 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3239/6510] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:34:46 2022] POST /identity/v3/users => generated 298 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:34:46.421102 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebf984e-8557-486a-b7f7-a2c5e231a36c admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:46.433169 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebf984e-8557-486a-b7f7-a2c5e231a36c admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:46.434824 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ad5dc9-d1af-4f7b-bccc-47eebde8593c admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:46.439060 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5790d49e-67f4-4b5f-97d0-12cbae7741c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:46.440075 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5790d49e-67f4-4b5f-97d0-12cbae7741c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:46.440426 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5790d49e-67f4-4b5f-97d0-12cbae7741c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:46.440768 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5790d49e-67f4-4b5f-97d0-12cbae7741c0 admin admin] PATH_INFO: `/v3/projects/d7e4cfecce7c44f8bda24e5fd88843b6/users/731ed0e3cb1149b590a42553408fc765/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:46.441229 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6f1191-209a-4efb-b11f-b49cb1a9a3c1 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6169c34aa5684bd3a8c97599122f6855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5a262ead17f44c6a1c5df904359cf6b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:46.442162 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6f1191-209a-4efb-b11f-b49cb1a9a3c1 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:46.442443 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6f1191-209a-4efb-b11f-b49cb1a9a3c1 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:46.442727 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6f1191-209a-4efb-b11f-b49cb1a9a3c1 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:46.443520 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6f1191-209a-4efb-b11f-b49cb1a9a3c1 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:46.446977 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6f1191-209a-4efb-b11f-b49cb1a9a3c1 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:46.460852 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5790d49e-67f4-4b5f-97d0-12cbae7741c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7e4cfecce7c44f8bda24e5fd88843b6, user_id=731ed0e3cb1149b590a42553408fc765, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:46.463711 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5790d49e-67f4-4b5f-97d0-12cbae7741c0 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:46.473164 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3272/6511] 10.222.0.17 () {60 vars in 1149 bytes} [Sat Jul 23 21:34:46 2022] POST /identity/v3/domains => generated 277 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:34:46.473164 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6f1191-209a-4efb-b11f-b49cb1a9a3c1 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:46.475046 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-de6f1191-209a-4efb-b11f-b49cb1a9a3c1 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:46.490468 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3240/6512] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:34:46 2022] PUT /identity/v3/projects/d7e4cfecce7c44f8bda24e5fd88843b6/users/731ed0e3cb1149b590a42553408fc765/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:46.493558 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5790d49e-67f4-4b5f-97d0-12cbae7741c0 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:46.523369 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:46.550855 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6f1191-209a-4efb-b11f-b49cb1a9a3c1 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:46.570938 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5790d49e-67f4-4b5f-97d0-12cbae7741c0 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:46.576467 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3388e212-489c-4176-8b81-a9f5905c1c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:46.577154 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3388e212-489c-4176-8b81-a9f5905c1c93 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:46.577438 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3388e212-489c-4176-8b81-a9f5905c1c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:46.577712 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3388e212-489c-4176-8b81-a9f5905c1c93 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:46.578480 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3388e212-489c-4176-8b81-a9f5905c1c93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:46.580106 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3388e212-489c-4176-8b81-a9f5905c1c93 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:46.594379 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3241/6513] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:34:46 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:34:46.594379 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3388e212-489c-4176-8b81-a9f5905c1c93 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:46.618266 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20e0fea-010e-46ae-96a9-35ed4fccad3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:46.618989 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20e0fea-010e-46ae-96a9-35ed4fccad3a service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:46.619266 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20e0fea-010e-46ae-96a9-35ed4fccad3a service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:46.619724 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20e0fea-010e-46ae-96a9-35ed4fccad3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:46.623031 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-e20e0fea-010e-46ae-96a9-35ed4fccad3a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:46.663761 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3388e212-489c-4176-8b81-a9f5905c1c93 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:46.666557 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:46.668799 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7633809f-034e-4a37-8ff3-0dab093d83d5 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6169c34aa5684bd3a8c97599122f6855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5a262ead17f44c6a1c5df904359cf6b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:46.669564 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7633809f-034e-4a37-8ff3-0dab093d83d5 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:46.669837 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7633809f-034e-4a37-8ff3-0dab093d83d5 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:46.670087 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7633809f-034e-4a37-8ff3-0dab093d83d5 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:46.670791 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7633809f-034e-4a37-8ff3-0dab093d83d5 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:46.672845 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7633809f-034e-4a37-8ff3-0dab093d83d5 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:46.690105 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3242/6514] 10.222.0.17 () {60 vars in 1149 bytes} [Sat Jul 23 21:34:46 2022] POST /identity/v3/domains => generated 280 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:34:46.691665 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58d5d81-0149-4069-8a25-b2b5001b1e00 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:46.692188 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58d5d81-0149-4069-8a25-b2b5001b1e00 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:46.692469 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58d5d81-0149-4069-8a25-b2b5001b1e00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:46.698574 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20e0fea-010e-46ae-96a9-35ed4fccad3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:46.700299 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20e0fea-010e-46ae-96a9-35ed4fccad3a service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:46.713197 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3273/6515] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:34:46 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:34:46.714044 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20e0fea-010e-46ae-96a9-35ed4fccad3a service neutron] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:46.724142 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-f58d5d81-0149-4069-8a25-b2b5001b1e00 None None] MFA Rules not processed for user `731ed0e3cb1149b590a42553408fc765`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:34:46.725673 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20e0fea-010e-46ae-96a9-35ed4fccad3a service neutron] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:46.725837 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-f58d5d81-0149-4069-8a25-b2b5001b1e00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:46.801784 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64286078-9ef5-4b81-bb59-129561c70842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:46.802807 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64286078-9ef5-4b81-bb59-129561c70842 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:46.803099 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64286078-9ef5-4b81-bb59-129561c70842 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:46.803787 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64286078-9ef5-4b81-bb59-129561c70842 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:46.804941 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64286078-9ef5-4b81-bb59-129561c70842 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:46.807599 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64286078-9ef5-4b81-bb59-129561c70842 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:46.810819 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3243/6516] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:34:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:34:46.811933 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58d5d81-0149-4069-8a25-b2b5001b1e00 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:46.820772 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3274/6517] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:34:46 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:34:46.822334 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64286078-9ef5-4b81-bb59-129561c70842 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:46.834848 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64286078-9ef5-4b81-bb59-129561c70842 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:46.840718 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bc7f5e-93ef-4e46-b018-7c785920a2b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:46.841571 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bc7f5e-93ef-4e46-b018-7c785920a2b9 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:46.842320 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bc7f5e-93ef-4e46-b018-7c785920a2b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:46.842608 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bc7f5e-93ef-4e46-b018-7c785920a2b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:46.843307 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bc7f5e-93ef-4e46-b018-7c785920a2b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:46.845510 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bc7f5e-93ef-4e46-b018-7c785920a2b9 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:46.881070 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:46.885586 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3275/6518] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:34:46 2022] POST /identity/v3/projects => generated 383 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:34:46.887504 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bc7f5e-93ef-4e46-b018-7c785920a2b9 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:46.915293 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58d5d81-0149-4069-8a25-b2b5001b1e00 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:46.974602 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bc7f5e-93ef-4e46-b018-7c785920a2b9 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:46.983697 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea0c88a-6afa-4148-9008-f67df5fd9fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:46.986771 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea0c88a-6afa-4148-9008-f67df5fd9fb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:46.987302 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea0c88a-6afa-4148-9008-f67df5fd9fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:46.988191 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea0c88a-6afa-4148-9008-f67df5fd9fb6 admin admin] PATH_INFO: `/v3/projects/9655e4d822b94176a8677736f2983ceb/users/eed434ceac1544aaba906e754ec46a87/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:47.005628 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec7d01e-9a0e-4ff0-a8f9-16007256e4c9 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6169c34aa5684bd3a8c97599122f6855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5a262ead17f44c6a1c5df904359cf6b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:47.006563 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec7d01e-9a0e-4ff0-a8f9-16007256e4c9 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:47.006843 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec7d01e-9a0e-4ff0-a8f9-16007256e4c9 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:47.007115 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec7d01e-9a0e-4ff0-a8f9-16007256e4c9 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] PATH_INFO: `/v3/domains/b744c4cc21bc43608968b8d2f29ee12f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:47.011720 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea0c88a-6afa-4148-9008-f67df5fd9fb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9655e4d822b94176a8677736f2983ceb, user_id=eed434ceac1544aaba906e754ec46a87, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:47.015473 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea0c88a-6afa-4148-9008-f67df5fd9fb6 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:47.030051 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec7d01e-9a0e-4ff0-a8f9-16007256e4c9 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=b744c4cc21bc43608968b8d2f29ee12f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:47.032650 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec7d01e-9a0e-4ff0-a8f9-16007256e4c9 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:47.034602 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3276/6519] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:34:46 2022] PUT /identity/v3/projects/9655e4d822b94176a8677736f2983ceb/users/eed434ceac1544aaba906e754ec46a87/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:47.035718 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea0c88a-6afa-4148-9008-f67df5fd9fb6 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:47.079240 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-cec7d01e-9a0e-4ff0-a8f9-16007256e4c9 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'b744c4cc21bc43608968b8d2f29ee12f'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:47.091827 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-cec7d01e-9a0e-4ff0-a8f9-16007256e4c9 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'b744c4cc21bc43608968b8d2f29ee12f'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:47.094084 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:47.134375 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea0c88a-6afa-4148-9008-f67df5fd9fb6 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:47.140324 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e8991b-6ce9-4c79-8210-bdcd7b16f52a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:47.142028 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e8991b-6ce9-4c79-8210-bdcd7b16f52a admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:47.142406 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e8991b-6ce9-4c79-8210-bdcd7b16f52a admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:47.143039 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e8991b-6ce9-4c79-8210-bdcd7b16f52a admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:47.143985 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e8991b-6ce9-4c79-8210-bdcd7b16f52a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:47.146990 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e8991b-6ce9-4c79-8210-bdcd7b16f52a admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:47.162522 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-cec7d01e-9a0e-4ff0-a8f9-16007256e4c9 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b744c4cc21bc43608968b8d2f29ee12f', 'request_id': 'req-cec7d01e-9a0e-4ff0-a8f9-16007256e4c9'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:47.176450 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3277/6520] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:34:47 2022] POST /identity/v3/users => generated 298 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:34:47.176450 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2824d766-6c64-4bc0-816a-6f7cb45a1593 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:47.176450 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2824d766-6c64-4bc0-816a-6f7cb45a1593 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:47.176450 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2824d766-6c64-4bc0-816a-6f7cb45a1593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:47.201018 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-cec7d01e-9a0e-4ff0-a8f9-16007256e4c9 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b744c4cc21bc43608968b8d2f29ee12f', 'request_id': 'req-cec7d01e-9a0e-4ff0-a8f9-16007256e4c9'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:47.211368 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-cec7d01e-9a0e-4ff0-a8f9-16007256e4c9 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b744c4cc21bc43608968b8d2f29ee12f', 'request_id': 'req-cec7d01e-9a0e-4ff0-a8f9-16007256e4c9'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:47.216093 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-2824d766-6c64-4bc0-816a-6f7cb45a1593 None None] MFA Rules not processed for user `eed434ceac1544aaba906e754ec46a87`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:34:47.218282 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-2824d766-6c64-4bc0-816a-6f7cb45a1593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:47.234432 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-cec7d01e-9a0e-4ff0-a8f9-16007256e4c9 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] The token cache is being invalidate because project b744c4cc21bc43608968b8d2f29ee12f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:34:47.235121 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-cec7d01e-9a0e-4ff0-a8f9-16007256e4c9 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:47.236217 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-cec7d01e-9a0e-4ff0-a8f9-16007256e4c9 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:47.249439 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-cec7d01e-9a0e-4ff0-a8f9-16007256e4c9 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'b744c4cc21bc43608968b8d2f29ee12f', 'request_id': 'req-cec7d01e-9a0e-4ff0-a8f9-16007256e4c9'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:47.250705 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-cec7d01e-9a0e-4ff0-a8f9-16007256e4c9 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'b744c4cc21bc43608968b8d2f29ee12f', 'request_id': 'req-cec7d01e-9a0e-4ff0-a8f9-16007256e4c9'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:47.255275 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-cec7d01e-9a0e-4ff0-a8f9-16007256e4c9 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'b744c4cc21bc43608968b8d2f29ee12f', 'request_id': 'req-cec7d01e-9a0e-4ff0-a8f9-16007256e4c9'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:47.268505 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3244/6521] 10.222.0.17 () {58 vars in 1229 bytes} [Sat Jul 23 21:34:46 2022] DELETE /identity/v3/domains/b744c4cc21bc43608968b8d2f29ee12f => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:47.268505 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec7d01e-9a0e-4ff0-a8f9-16007256e4c9 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:47.270017 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-cec7d01e-9a0e-4ff0-a8f9-16007256e4c9 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:47.306788 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:47.324005 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3278/6522] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:34:47 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:34:47.325573 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2824d766-6c64-4bc0-816a-6f7cb45a1593 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:47.328397 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-2824d766-6c64-4bc0-816a-6f7cb45a1593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:47.375974 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec7d01e-9a0e-4ff0-a8f9-16007256e4c9 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:47.383762 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2581d3be-0a70-4078-8588-c0a820001a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:47.384870 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2581d3be-0a70-4078-8588-c0a820001a19 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:47.385224 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2581d3be-0a70-4078-8588-c0a820001a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:47.385568 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2581d3be-0a70-4078-8588-c0a820001a19 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:47.386697 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2581d3be-0a70-4078-8588-c0a820001a19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:47.388174 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2581d3be-0a70-4078-8588-c0a820001a19 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:47.408595 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3245/6523] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:34:47 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:34:47.408595 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2581d3be-0a70-4078-8588-c0a820001a19 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:47.411051 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-2581d3be-0a70-4078-8588-c0a820001a19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:47.459131 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2824d766-6c64-4bc0-816a-6f7cb45a1593 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:47.466752 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c114298-163e-4ce4-b587-6b0f77fcd7f3 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6169c34aa5684bd3a8c97599122f6855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5a262ead17f44c6a1c5df904359cf6b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:47.467647 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c114298-163e-4ce4-b587-6b0f77fcd7f3 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:47.467940 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c114298-163e-4ce4-b587-6b0f77fcd7f3 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:47.468271 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c114298-163e-4ce4-b587-6b0f77fcd7f3 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:47.469072 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c114298-163e-4ce4-b587-6b0f77fcd7f3 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:47.470734 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c114298-163e-4ce4-b587-6b0f77fcd7f3 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:47.502884 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3279/6524] 10.222.0.17 () {60 vars in 1148 bytes} [Sat Jul 23 21:34:47 2022] POST /identity/v3/domains => generated 249 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:34:47.504151 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c114298-163e-4ce4-b587-6b0f77fcd7f3 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:47.506171 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-1c114298-163e-4ce4-b587-6b0f77fcd7f3 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:47.517044 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2581d3be-0a70-4078-8588-c0a820001a19 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:47.609498 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:47.614180 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a867bd8b-6601-4ad3-903f-877a25ef44ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:47.615423 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a867bd8b-6601-4ad3-903f-877a25ef44ec service nova] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:47.616193 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a867bd8b-6601-4ad3-903f-877a25ef44ec service nova] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:47.616633 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a867bd8b-6601-4ad3-903f-877a25ef44ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:47.616809 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c114298-163e-4ce4-b587-6b0f77fcd7f3 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:47.621173 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-a867bd8b-6601-4ad3-903f-877a25ef44ec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:47.622105 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72573c46-fa7a-4e80-b1de-015aa90fc084 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:47.623095 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72573c46-fa7a-4e80-b1de-015aa90fc084 service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:47.624177 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72573c46-fa7a-4e80-b1de-015aa90fc084 service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:47.624538 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72573c46-fa7a-4e80-b1de-015aa90fc084 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:47.699777 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72573c46-fa7a-4e80-b1de-015aa90fc084 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:47.701516 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72573c46-fa7a-4e80-b1de-015aa90fc084 service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:47.708913 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:47.714862 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3280/6525] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:34:47 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:34:47.716064 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72573c46-fa7a-4e80-b1de-015aa90fc084 service neutron] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:47.749749 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a867bd8b-6601-4ad3-903f-877a25ef44ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:47.752027 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a867bd8b-6601-4ad3-903f-877a25ef44ec service nova] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:47.781269 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3246/6526] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:34:47 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:34:47.783267 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a867bd8b-6601-4ad3-903f-877a25ef44ec service nova] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:47.809822 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72573c46-fa7a-4e80-b1de-015aa90fc084 service neutron] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:47.825044 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbad0df1-7815-4f98-a6b1-71f989353462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:47.826514 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbad0df1-7815-4f98-a6b1-71f989353462 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:47.826929 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbad0df1-7815-4f98-a6b1-71f989353462 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:47.827224 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbad0df1-7815-4f98-a6b1-71f989353462 admin admin] PATH_INFO: `/v3/projects/ef0c04895d2c42c483e829b1abe82547/users/205d7acf913b49d48ffce0c01b9a4782/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:47.849323 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbad0df1-7815-4f98-a6b1-71f989353462 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef0c04895d2c42c483e829b1abe82547, user_id=205d7acf913b49d48ffce0c01b9a4782, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:47.852730 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbad0df1-7815-4f98-a6b1-71f989353462 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:47.875497 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3281/6527] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:34:47 2022] PUT /identity/v3/projects/ef0c04895d2c42c483e829b1abe82547/users/205d7acf913b49d48ffce0c01b9a4782/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:47.880670 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbad0df1-7815-4f98-a6b1-71f989353462 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:47.907451 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a867bd8b-6601-4ad3-903f-877a25ef44ec service nova] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:47.999776 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbad0df1-7815-4f98-a6b1-71f989353462 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:48.003209 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b055777-0e0b-48c9-95f1-d6389c22a5f8 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6169c34aa5684bd3a8c97599122f6855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5a262ead17f44c6a1c5df904359cf6b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:48.004461 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b055777-0e0b-48c9-95f1-d6389c22a5f8 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:48.004998 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b055777-0e0b-48c9-95f1-d6389c22a5f8 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:48.005345 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b055777-0e0b-48c9-95f1-d6389c22a5f8 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] PATH_INFO: `/v3/domains/6732862e8c104ce28960dcb1e124425d` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:48.006991 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c8f716-245f-49dc-a1d4-d442b089a1b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:48.007889 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c8f716-245f-49dc-a1d4-d442b089a1b3 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:48.008325 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c8f716-245f-49dc-a1d4-d442b089a1b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:48.008699 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c8f716-245f-49dc-a1d4-d442b089a1b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:48.010574 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c8f716-245f-49dc-a1d4-d442b089a1b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:48.012280 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c8f716-245f-49dc-a1d4-d442b089a1b3 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:48.031638 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3282/6528] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:34:47 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 21:34:48.034500 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b055777-0e0b-48c9-95f1-d6389c22a5f8 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=6732862e8c104ce28960dcb1e124425d)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:48.035542 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c8f716-245f-49dc-a1d4-d442b089a1b3 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:48.040753 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b055777-0e0b-48c9-95f1-d6389c22a5f8 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:48.065733 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c8f716-245f-49dc-a1d4-d442b089a1b3 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:48.073587 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d0ebd3-2bd1-4670-9d7a-23d0a4057b21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:48.074859 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-7b055777-0e0b-48c9-95f1-d6389c22a5f8 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '6732862e8c104ce28960dcb1e124425d'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:48.075366 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d0ebd3-2bd1-4670-9d7a-23d0a4057b21 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:48.075745 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-7b055777-0e0b-48c9-95f1-d6389c22a5f8 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '6732862e8c104ce28960dcb1e124425d'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:48.076065 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d0ebd3-2bd1-4670-9d7a-23d0a4057b21 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:48.076525 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d0ebd3-2bd1-4670-9d7a-23d0a4057b21 admin admin] PATH_INFO: `/v3/projects/ef0c04895d2c42c483e829b1abe82547/users/205d7acf913b49d48ffce0c01b9a4782/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:48.078919 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d0ebd3-2bd1-4670-9d7a-23d0a4057b21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef0c04895d2c42c483e829b1abe82547, user_id=205d7acf913b49d48ffce0c01b9a4782, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:48.083088 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d0ebd3-2bd1-4670-9d7a-23d0a4057b21 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:48.112022 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3283/6529] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:34:48 2022] PUT /identity/v3/projects/ef0c04895d2c42c483e829b1abe82547/users/205d7acf913b49d48ffce0c01b9a4782/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:48.122131 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095e9b3f-3206-4347-a2de-801e30b802b6 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:48.122458 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095e9b3f-3206-4347-a2de-801e30b802b6 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:48.122987 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095e9b3f-3206-4347-a2de-801e30b802b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:48.137574 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-7b055777-0e0b-48c9-95f1-d6389c22a5f8 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '6732862e8c104ce28960dcb1e124425d'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:48.138318 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-7b055777-0e0b-48c9-95f1-d6389c22a5f8 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '6732862e8c104ce28960dcb1e124425d'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:48.141920 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3247/6530] 10.222.0.17 () {60 vars in 1248 bytes} [Sat Jul 23 21:34:47 2022] PATCH /identity/v3/domains/6732862e8c104ce28960dcb1e124425d => generated 250 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:34:48.145381 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b055777-0e0b-48c9-95f1-d6389c22a5f8 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:48.146941 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-7b055777-0e0b-48c9-95f1-d6389c22a5f8 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:48.152354 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:48.167017 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-095e9b3f-3206-4347-a2de-801e30b802b6 None None] MFA Rules not processed for user `205d7acf913b49d48ffce0c01b9a4782`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:34:48.168972 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-095e9b3f-3206-4347-a2de-801e30b802b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:48.262113 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:48.272335 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b055777-0e0b-48c9-95f1-d6389c22a5f8 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:48.292602 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3284/6531] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:34:48 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:34:48.293773 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095e9b3f-3206-4347-a2de-801e30b802b6 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:48.295281 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-095e9b3f-3206-4347-a2de-801e30b802b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:48.391614 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1887241c-8c86-41f3-a99b-52525b1aa594 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6169c34aa5684bd3a8c97599122f6855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5a262ead17f44c6a1c5df904359cf6b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:48.392675 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1887241c-8c86-41f3-a99b-52525b1aa594 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:48.392964 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1887241c-8c86-41f3-a99b-52525b1aa594 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:48.393246 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1887241c-8c86-41f3-a99b-52525b1aa594 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] PATH_INFO: `/v3/domains/6732862e8c104ce28960dcb1e124425d` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:48.401436 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095e9b3f-3206-4347-a2de-801e30b802b6 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:48.415208 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484f9697-dc32-412b-9137-6eee570cb70e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:48.416853 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484f9697-dc32-412b-9137-6eee570cb70e service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:48.417074 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484f9697-dc32-412b-9137-6eee570cb70e service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:48.417936 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484f9697-dc32-412b-9137-6eee570cb70e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:48.418877 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1887241c-8c86-41f3-a99b-52525b1aa594 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=6732862e8c104ce28960dcb1e124425d)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:48.420558 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1887241c-8c86-41f3-a99b-52525b1aa594 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:48.428079 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-484f9697-dc32-412b-9137-6eee570cb70e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:48.464845 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-1887241c-8c86-41f3-a99b-52525b1aa594 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '6732862e8c104ce28960dcb1e124425d'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:48.489956 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-1887241c-8c86-41f3-a99b-52525b1aa594 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '6732862e8c104ce28960dcb1e124425d'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:48.536619 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484f9697-dc32-412b-9137-6eee570cb70e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:48.543490 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484f9697-dc32-412b-9137-6eee570cb70e service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:48.559442 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-1887241c-8c86-41f3-a99b-52525b1aa594 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6732862e8c104ce28960dcb1e124425d', 'request_id': 'req-1887241c-8c86-41f3-a99b-52525b1aa594'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:48.570893 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-1887241c-8c86-41f3-a99b-52525b1aa594 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6732862e8c104ce28960dcb1e124425d', 'request_id': 'req-1887241c-8c86-41f3-a99b-52525b1aa594'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:48.581078 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-1887241c-8c86-41f3-a99b-52525b1aa594 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6732862e8c104ce28960dcb1e124425d', 'request_id': 'req-1887241c-8c86-41f3-a99b-52525b1aa594'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:48.585904 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3285/6532] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:34:48 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:34:48.601533 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-1887241c-8c86-41f3-a99b-52525b1aa594 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] The token cache is being invalidate because project 6732862e8c104ce28960dcb1e124425d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:34:48.601836 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-1887241c-8c86-41f3-a99b-52525b1aa594 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:48.602556 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-1887241c-8c86-41f3-a99b-52525b1aa594 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:48.613535 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-1887241c-8c86-41f3-a99b-52525b1aa594 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '6732862e8c104ce28960dcb1e124425d', 'request_id': 'req-1887241c-8c86-41f3-a99b-52525b1aa594'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:48.614837 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-1887241c-8c86-41f3-a99b-52525b1aa594 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '6732862e8c104ce28960dcb1e124425d', 'request_id': 'req-1887241c-8c86-41f3-a99b-52525b1aa594'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:48.618391 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-1887241c-8c86-41f3-a99b-52525b1aa594 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '6732862e8c104ce28960dcb1e124425d', 'request_id': 'req-1887241c-8c86-41f3-a99b-52525b1aa594'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:48.625492 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3248/6533] 10.222.0.17 () {58 vars in 1229 bytes} [Sat Jul 23 21:34:48 2022] DELETE /identity/v3/domains/6732862e8c104ce28960dcb1e124425d => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:48.630565 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484f9697-dc32-412b-9137-6eee570cb70e service neutron] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:48.642639 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484f9697-dc32-412b-9137-6eee570cb70e service neutron] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:48.704958 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:48.724898 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f740656e-d641-4309-b0e9-62d240411b3c tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6169c34aa5684bd3a8c97599122f6855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5a262ead17f44c6a1c5df904359cf6b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:48.726457 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f740656e-d641-4309-b0e9-62d240411b3c tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:48.726848 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f740656e-d641-4309-b0e9-62d240411b3c tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:48.727331 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f740656e-d641-4309-b0e9-62d240411b3c tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:48.728359 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f740656e-d641-4309-b0e9-62d240411b3c tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:48.730685 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f740656e-d641-4309-b0e9-62d240411b3c tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:48.759194 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3286/6534] 10.222.0.17 () {60 vars in 1148 bytes} [Sat Jul 23 21:34:48 2022] POST /identity/v3/domains => generated 277 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:34:48.762740 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1887241c-8c86-41f3-a99b-52525b1aa594 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:48.764696 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-1887241c-8c86-41f3-a99b-52525b1aa594 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:48.784376 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1887241c-8c86-41f3-a99b-52525b1aa594 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:48.862289 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:48.910943 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b59201-3415-4186-b5a8-02f027d9a9fc tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6169c34aa5684bd3a8c97599122f6855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5a262ead17f44c6a1c5df904359cf6b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:48.912118 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b59201-3415-4186-b5a8-02f027d9a9fc tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:48.913265 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b59201-3415-4186-b5a8-02f027d9a9fc tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:48.913730 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b59201-3415-4186-b5a8-02f027d9a9fc tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] PATH_INFO: `/v3/domains/765b12c364244b97819358acd2d6033e` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:48.929812 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b59201-3415-4186-b5a8-02f027d9a9fc tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=765b12c364244b97819358acd2d6033e)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:48.944493 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b59201-3415-4186-b5a8-02f027d9a9fc tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:48.986650 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-92b59201-3415-4186-b5a8-02f027d9a9fc tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '765b12c364244b97819358acd2d6033e'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:48.988804 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-92b59201-3415-4186-b5a8-02f027d9a9fc tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '765b12c364244b97819358acd2d6033e'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:49.035138 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-92b59201-3415-4186-b5a8-02f027d9a9fc tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '765b12c364244b97819358acd2d6033e'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:49.037391 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-92b59201-3415-4186-b5a8-02f027d9a9fc tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '765b12c364244b97819358acd2d6033e'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:49.044254 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3249/6535] 10.222.0.17 () {60 vars in 1249 bytes} [Sat Jul 23 21:34:48 2022] PATCH /identity/v3/domains/765b12c364244b97819358acd2d6033e => generated 279 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:34:49.048489 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f740656e-d641-4309-b0e9-62d240411b3c tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:49.050392 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-f740656e-d641-4309-b0e9-62d240411b3c tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:49.071012 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f740656e-d641-4309-b0e9-62d240411b3c tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:49.183355 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d319af8-ccd3-4bc8-b156-be9d393d04cb tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6169c34aa5684bd3a8c97599122f6855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5a262ead17f44c6a1c5df904359cf6b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:49.184838 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d319af8-ccd3-4bc8-b156-be9d393d04cb tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:49.185056 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d319af8-ccd3-4bc8-b156-be9d393d04cb tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:49.185711 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d319af8-ccd3-4bc8-b156-be9d393d04cb tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] PATH_INFO: `/v3/domains/765b12c364244b97819358acd2d6033e` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:49.204616 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d319af8-ccd3-4bc8-b156-be9d393d04cb tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] RBAC: Authorizing `identity:get_domain(domain_id=765b12c364244b97819358acd2d6033e)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:49.206876 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d319af8-ccd3-4bc8-b156-be9d393d04cb tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:49.212947 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3287/6536] 10.222.0.17 () {58 vars in 1226 bytes} [Sat Jul 23 21:34:49 2022] GET /identity/v3/domains/765b12c364244b97819358acd2d6033e => generated 279 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:34:49.214303 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b59201-3415-4186-b5a8-02f027d9a9fc tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:49.231809 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b59201-3415-4186-b5a8-02f027d9a9fc tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:49.241236 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e19f8a-b667-48d8-a998-ef80abd9f0bb tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6169c34aa5684bd3a8c97599122f6855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5a262ead17f44c6a1c5df904359cf6b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:49.242170 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e19f8a-b667-48d8-a998-ef80abd9f0bb tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:49.242489 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e19f8a-b667-48d8-a998-ef80abd9f0bb tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:49.242763 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e19f8a-b667-48d8-a998-ef80abd9f0bb tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] PATH_INFO: `/v3/domains/765b12c364244b97819358acd2d6033e` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:49.250877 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e19f8a-b667-48d8-a998-ef80abd9f0bb tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=765b12c364244b97819358acd2d6033e)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:49.252549 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e19f8a-b667-48d8-a998-ef80abd9f0bb tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:49.301790 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-10e19f8a-b667-48d8-a998-ef80abd9f0bb tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '765b12c364244b97819358acd2d6033e'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:49.345439 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-10e19f8a-b667-48d8-a998-ef80abd9f0bb tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '765b12c364244b97819358acd2d6033e'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:49.466079 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-10e19f8a-b667-48d8-a998-ef80abd9f0bb tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '765b12c364244b97819358acd2d6033e', 'request_id': 'req-10e19f8a-b667-48d8-a998-ef80abd9f0bb'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:49.490626 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-10e19f8a-b667-48d8-a998-ef80abd9f0bb tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '765b12c364244b97819358acd2d6033e', 'request_id': 'req-10e19f8a-b667-48d8-a998-ef80abd9f0bb'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:49.499075 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-10e19f8a-b667-48d8-a998-ef80abd9f0bb tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '765b12c364244b97819358acd2d6033e', 'request_id': 'req-10e19f8a-b667-48d8-a998-ef80abd9f0bb'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:49.516588 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-10e19f8a-b667-48d8-a998-ef80abd9f0bb tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] The token cache is being invalidate because project 765b12c364244b97819358acd2d6033e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:34:49.517320 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-10e19f8a-b667-48d8-a998-ef80abd9f0bb tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:49.518161 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-10e19f8a-b667-48d8-a998-ef80abd9f0bb tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:49.528864 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-10e19f8a-b667-48d8-a998-ef80abd9f0bb tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '765b12c364244b97819358acd2d6033e', 'request_id': 'req-10e19f8a-b667-48d8-a998-ef80abd9f0bb'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:49.529690 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-10e19f8a-b667-48d8-a998-ef80abd9f0bb tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '765b12c364244b97819358acd2d6033e', 'request_id': 'req-10e19f8a-b667-48d8-a998-ef80abd9f0bb'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:49.534428 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-10e19f8a-b667-48d8-a998-ef80abd9f0bb tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '765b12c364244b97819358acd2d6033e', 'request_id': 'req-10e19f8a-b667-48d8-a998-ef80abd9f0bb'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:49.548433 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3250/6537] 10.222.0.17 () {58 vars in 1229 bytes} [Sat Jul 23 21:34:49 2022] DELETE /identity/v3/domains/765b12c364244b97819358acd2d6033e => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:49.552802 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d319af8-ccd3-4bc8-b156-be9d393d04cb tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:49.554643 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-8d319af8-ccd3-4bc8-b156-be9d393d04cb tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:49.571013 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d319af8-ccd3-4bc8-b156-be9d393d04cb tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:49.659120 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb67fb17-101d-4ec7-830b-f44fb9ae3519 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6169c34aa5684bd3a8c97599122f6855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5a262ead17f44c6a1c5df904359cf6b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:49.660060 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb67fb17-101d-4ec7-830b-f44fb9ae3519 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:49.660388 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb67fb17-101d-4ec7-830b-f44fb9ae3519 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:49.660882 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb67fb17-101d-4ec7-830b-f44fb9ae3519 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:49.661749 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb67fb17-101d-4ec7-830b-f44fb9ae3519 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:49.667304 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb67fb17-101d-4ec7-830b-f44fb9ae3519 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:49.694538 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3288/6538] 10.222.0.17 () {58 vars in 1127 bytes} [Sat Jul 23 21:34:49 2022] GET /identity/v3/domains => generated 1346 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 21:34:49.698991 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e19f8a-b667-48d8-a998-ef80abd9f0bb tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:49.710289 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e19f8a-b667-48d8-a998-ef80abd9f0bb tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:49.718861 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b473660-4ad7-4cc5-a7ee-29e2a56e720d tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6169c34aa5684bd3a8c97599122f6855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5a262ead17f44c6a1c5df904359cf6b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:49.719904 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b473660-4ad7-4cc5-a7ee-29e2a56e720d tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:49.720293 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b473660-4ad7-4cc5-a7ee-29e2a56e720d tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:49.720736 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b473660-4ad7-4cc5-a7ee-29e2a56e720d tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] PATH_INFO: `/v3/domains/765b12c364244b97819358acd2d6033e` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:49.729781 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b473660-4ad7-4cc5-a7ee-29e2a56e720d tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 21:34:49.743983 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-1b473660-4ad7-4cc5-a7ee-29e2a56e720d tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Could not find domain: 765b12c364244b97819358acd2d6033e.: keystone.exception.DomainNotFound: Could not find domain: 765b12c364244b97819358acd2d6033e. Jul 23 21:34:49.743983 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 21:34:49.743983 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 23 21:34:49.743983 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 23 21:34:49.743983 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 23 21:34:49.743983 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 23 21:34:49.743983 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 23 21:34:49.743983 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 23 21:34:49.743983 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 765b12c364244b97819358acd2d6033e. Jul 23 21:34:49.743983 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 21:34:49.743983 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 23 21:34:49.743983 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 21:34:49.743983 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 21:34:49.743983 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 21:34:49.743983 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 21:34:49.743983 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 21:34:49.745373 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 21:34:49.745373 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 21:34:49.745373 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 21:34:49.745373 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 21:34:49.745373 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 21:34:49.745373 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 21:34:49.745373 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 21:34:49.745373 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jul 23 21:34:49.745373 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jul 23 21:34:49.745373 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 21:34:49.745373 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 21:34:49.745373 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 21:34:49.745373 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 21:34:49.745373 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 21:34:49.745373 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 21:34:49.745373 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 21:34:49.746749 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 21:34:49.746749 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 21:34:49.746749 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 21:34:49.746749 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 21:34:49.746749 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application with Lock( Jul 23 21:34:49.746749 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 21:34:49.746749 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._enter() Jul 23 21:34:49.746749 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 21:34:49.746749 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 21:34:49.746749 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 21:34:49.746749 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.creator() Jul 23 21:34:49.746749 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 21:34:49.746749 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application created_value = creator( Jul 23 21:34:49.746749 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 23 21:34:49.746749 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 23 21:34:49.746749 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 765b12c364244b97819358acd2d6033e. Jul 23 21:34:49.746749 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 21:34:49.754120 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb67fb17-101d-4ec7-830b-f44fb9ae3519 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:49.775157 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb67fb17-101d-4ec7-830b-f44fb9ae3519 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:49.775927 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3251/6539] 10.222.0.17 () {60 vars in 1248 bytes} [Sat Jul 23 21:34:49 2022] PATCH /identity/v3/domains/765b12c364244b97819358acd2d6033e => generated 112 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Jul 23 21:34:49.799510 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855d139d-4363-41f8-9828-a8f1475baa67 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6169c34aa5684bd3a8c97599122f6855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5a262ead17f44c6a1c5df904359cf6b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:49.800892 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855d139d-4363-41f8-9828-a8f1475baa67 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:49.801445 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855d139d-4363-41f8-9828-a8f1475baa67 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:49.802049 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855d139d-4363-41f8-9828-a8f1475baa67 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:49.803121 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855d139d-4363-41f8-9828-a8f1475baa67 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:49.804855 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855d139d-4363-41f8-9828-a8f1475baa67 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:49.837081 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3289/6540] 10.222.0.17 () {60 vars in 1148 bytes} [Sat Jul 23 21:34:49 2022] POST /identity/v3/domains => generated 277 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:34:49.841698 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b473660-4ad7-4cc5-a7ee-29e2a56e720d tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:49.857829 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b473660-4ad7-4cc5-a7ee-29e2a56e720d tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:49.896867 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=87,keystone:UPDATE=1,keystone:DELETE=11,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:49.975740 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286b06d6-eac3-46db-8b18-ca68f1153908 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6169c34aa5684bd3a8c97599122f6855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5a262ead17f44c6a1c5df904359cf6b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:49.976542 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286b06d6-eac3-46db-8b18-ca68f1153908 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:49.976923 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286b06d6-eac3-46db-8b18-ca68f1153908 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:49.977274 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286b06d6-eac3-46db-8b18-ca68f1153908 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:49.978805 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286b06d6-eac3-46db-8b18-ca68f1153908 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:49.980976 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286b06d6-eac3-46db-8b18-ca68f1153908 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:50.029059 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3252/6541] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:34:49 2022] POST /identity/v3/users => generated 348 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:34:50.033507 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855d139d-4363-41f8-9828-a8f1475baa67 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:50.044727 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855d139d-4363-41f8-9828-a8f1475baa67 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:50.049685 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4db2209-aa9a-4dd1-8292-fa2a490b89f6 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6169c34aa5684bd3a8c97599122f6855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5a262ead17f44c6a1c5df904359cf6b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:50.050381 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4db2209-aa9a-4dd1-8292-fa2a490b89f6 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:50.050670 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4db2209-aa9a-4dd1-8292-fa2a490b89f6 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:50.050944 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4db2209-aa9a-4dd1-8292-fa2a490b89f6 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] PATH_INFO: `/v3/groups` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:50.051728 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4db2209-aa9a-4dd1-8292-fa2a490b89f6 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:50.054497 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4db2209-aa9a-4dd1-8292-fa2a490b89f6 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:50.075346 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3290/6542] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:34:50 2022] POST /identity/v3/groups => generated 325 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:34:50.076727 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286b06d6-eac3-46db-8b18-ca68f1153908 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:50.089511 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286b06d6-eac3-46db-8b18-ca68f1153908 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:50.097379 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f796e65a-9ff5-4c60-a3c2-dd63324fdcff tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6169c34aa5684bd3a8c97599122f6855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5a262ead17f44c6a1c5df904359cf6b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:50.099149 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f796e65a-9ff5-4c60-a3c2-dd63324fdcff tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:50.099946 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f796e65a-9ff5-4c60-a3c2-dd63324fdcff tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:50.100392 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f796e65a-9ff5-4c60-a3c2-dd63324fdcff tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] PATH_INFO: `/v3/domains/20711a98dadc462abd01460ce3914545` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:50.102867 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f796e65a-9ff5-4c60-a3c2-dd63324fdcff tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=20711a98dadc462abd01460ce3914545)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:50.104783 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f796e65a-9ff5-4c60-a3c2-dd63324fdcff tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:50.133124 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-f796e65a-9ff5-4c60-a3c2-dd63324fdcff tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '20711a98dadc462abd01460ce3914545'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:50.134230 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-f796e65a-9ff5-4c60-a3c2-dd63324fdcff tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '20711a98dadc462abd01460ce3914545'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:50.176077 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-f796e65a-9ff5-4c60-a3c2-dd63324fdcff tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '20711a98dadc462abd01460ce3914545'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:50.177676 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-f796e65a-9ff5-4c60-a3c2-dd63324fdcff tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '20711a98dadc462abd01460ce3914545'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:50.183839 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3253/6543] 10.222.0.17 () {60 vars in 1248 bytes} [Sat Jul 23 21:34:50 2022] PATCH /identity/v3/domains/20711a98dadc462abd01460ce3914545 => generated 278 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:34:50.185244 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4db2209-aa9a-4dd1-8292-fa2a490b89f6 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:50.187484 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-f4db2209-aa9a-4dd1-8292-fa2a490b89f6 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:50.217046 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4db2209-aa9a-4dd1-8292-fa2a490b89f6 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:50.281730 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:50.307857 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa041b9-bcb1-4efc-8364-283723f2f67b tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6169c34aa5684bd3a8c97599122f6855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5a262ead17f44c6a1c5df904359cf6b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:50.309740 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa041b9-bcb1-4efc-8364-283723f2f67b tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:50.309740 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa041b9-bcb1-4efc-8364-283723f2f67b tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:50.309740 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa041b9-bcb1-4efc-8364-283723f2f67b tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] PATH_INFO: `/v3/domains/20711a98dadc462abd01460ce3914545` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:50.323895 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa041b9-bcb1-4efc-8364-283723f2f67b tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=20711a98dadc462abd01460ce3914545)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:50.327335 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa041b9-bcb1-4efc-8364-283723f2f67b tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:50.363273 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-5fa041b9-bcb1-4efc-8364-283723f2f67b tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '20711a98dadc462abd01460ce3914545'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:50.585527 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-5fa041b9-bcb1-4efc-8364-283723f2f67b tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01ae7c1de8fb4e73812259536df35d4d'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:50.587027 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-5fa041b9-bcb1-4efc-8364-283723f2f67b tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01ae7c1de8fb4e73812259536df35d4d'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:50.598242 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-5fa041b9-bcb1-4efc-8364-283723f2f67b tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01ae7c1de8fb4e73812259536df35d4d'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:50.609351 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-5fa041b9-bcb1-4efc-8364-283723f2f67b tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01ae7c1de8fb4e73812259536df35d4d'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:50.629961 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-5fa041b9-bcb1-4efc-8364-283723f2f67b tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01ae7c1de8fb4e73812259536df35d4d'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:50.657655 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-5fa041b9-bcb1-4efc-8364-283723f2f67b tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '20711a98dadc462abd01460ce3914545'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:50.724821 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:50.750433 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-5fa041b9-bcb1-4efc-8364-283723f2f67b tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20711a98dadc462abd01460ce3914545', 'request_id': 'req-5fa041b9-bcb1-4efc-8364-283723f2f67b'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:50.760910 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-5fa041b9-bcb1-4efc-8364-283723f2f67b tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20711a98dadc462abd01460ce3914545', 'request_id': 'req-5fa041b9-bcb1-4efc-8364-283723f2f67b'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:50.770688 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-5fa041b9-bcb1-4efc-8364-283723f2f67b tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20711a98dadc462abd01460ce3914545', 'request_id': 'req-5fa041b9-bcb1-4efc-8364-283723f2f67b'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:50.854509 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-5fa041b9-bcb1-4efc-8364-283723f2f67b tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] The token cache is being invalidate because project 20711a98dadc462abd01460ce3914545 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:34:50.859700 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-5fa041b9-bcb1-4efc-8364-283723f2f67b tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:50.860541 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-5fa041b9-bcb1-4efc-8364-283723f2f67b tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:50.878924 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-5fa041b9-bcb1-4efc-8364-283723f2f67b tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '20711a98dadc462abd01460ce3914545', 'request_id': 'req-5fa041b9-bcb1-4efc-8364-283723f2f67b'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:50.888925 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-5fa041b9-bcb1-4efc-8364-283723f2f67b tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '20711a98dadc462abd01460ce3914545', 'request_id': 'req-5fa041b9-bcb1-4efc-8364-283723f2f67b'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:50.890776 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-5fa041b9-bcb1-4efc-8364-283723f2f67b tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '20711a98dadc462abd01460ce3914545', 'request_id': 'req-5fa041b9-bcb1-4efc-8364-283723f2f67b'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:50.911858 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3291/6544] 10.222.0.17 () {58 vars in 1229 bytes} [Sat Jul 23 21:34:50 2022] DELETE /identity/v3/domains/20711a98dadc462abd01460ce3914545 => generated 0 bytes in 727 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:50.916403 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f796e65a-9ff5-4c60-a3c2-dd63324fdcff tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:50.939463 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f796e65a-9ff5-4c60-a3c2-dd63324fdcff tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:51.098348 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e687e780-7e4c-4c8a-bb8c-d88e40d08e71 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6169c34aa5684bd3a8c97599122f6855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5a262ead17f44c6a1c5df904359cf6b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:51.099632 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e687e780-7e4c-4c8a-bb8c-d88e40d08e71 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:51.099919 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e687e780-7e4c-4c8a-bb8c-d88e40d08e71 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:51.100196 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e687e780-7e4c-4c8a-bb8c-d88e40d08e71 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] PATH_INFO: `/v3/domains/20711a98dadc462abd01460ce3914545` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:51.110866 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e687e780-7e4c-4c8a-bb8c-d88e40d08e71 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] RBAC: Authorizing `identity:get_domain(domain_id=20711a98dadc462abd01460ce3914545)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:51.113549 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e687e780-7e4c-4c8a-bb8c-d88e40d08e71 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:51.146129 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-e687e780-7e4c-4c8a-bb8c-d88e40d08e71 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Could not find domain: 20711a98dadc462abd01460ce3914545.: keystone.exception.DomainNotFound: Could not find domain: 20711a98dadc462abd01460ce3914545. Jul 23 21:34:51.146129 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 21:34:51.146129 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 23 21:34:51.146129 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 23 21:34:51.146129 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 23 21:34:51.146129 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 23 21:34:51.146129 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 23 21:34:51.146129 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 23 21:34:51.146129 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 20711a98dadc462abd01460ce3914545. Jul 23 21:34:51.146129 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 21:34:51.146129 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 23 21:34:51.146129 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 21:34:51.146129 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 21:34:51.146129 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 21:34:51.146129 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 21:34:51.146129 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 21:34:51.147489 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 21:34:51.147489 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 21:34:51.147489 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 21:34:51.147489 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 21:34:51.147489 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 21:34:51.147489 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 21:34:51.147489 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 21:34:51.147489 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 23 21:34:51.147489 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 23 21:34:51.147489 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 23 21:34:51.147489 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 23 21:34:51.147489 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 21:34:51.147489 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 21:34:51.147489 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 21:34:51.147489 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 21:34:51.147489 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 21:34:51.147489 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 21:34:51.148876 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 21:34:51.148876 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application with Lock( Jul 23 21:34:51.148876 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 21:34:51.148876 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._enter() Jul 23 21:34:51.148876 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 21:34:51.148876 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 21:34:51.148876 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 21:34:51.148876 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.creator() Jul 23 21:34:51.148876 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 21:34:51.148876 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application created_value = creator( Jul 23 21:34:51.148876 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 23 21:34:51.148876 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 23 21:34:51.148876 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 20711a98dadc462abd01460ce3914545. Jul 23 21:34:51.148876 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 21:34:51.154866 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa041b9-bcb1-4efc-8364-283723f2f67b tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:51.166805 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-5fa041b9-bcb1-4efc-8364-283723f2f67b tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:51.167087 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3254/6545] 10.222.0.17 () {58 vars in 1226 bytes} [Sat Jul 23 21:34:50 2022] GET /identity/v3/domains/20711a98dadc462abd01460ce3914545 => generated 112 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 23 21:34:51.197803 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa041b9-bcb1-4efc-8364-283723f2f67b tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:51.206275 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40edf85-81ea-4fe4-8774-0179949b5d04 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6169c34aa5684bd3a8c97599122f6855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5a262ead17f44c6a1c5df904359cf6b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:51.207296 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40edf85-81ea-4fe4-8774-0179949b5d04 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:51.207589 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40edf85-81ea-4fe4-8774-0179949b5d04 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:51.208506 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40edf85-81ea-4fe4-8774-0179949b5d04 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] PATH_INFO: `/v3/users/01ae7c1de8fb4e73812259536df35d4d` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:51.227551 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40edf85-81ea-4fe4-8774-0179949b5d04 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] RBAC: Authorizing `identity:get_user(user_id=01ae7c1de8fb4e73812259536df35d4d)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:51.233383 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40edf85-81ea-4fe4-8774-0179949b5d04 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:51.256601 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-e40edf85-81ea-4fe4-8774-0179949b5d04 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Could not find user: 01ae7c1de8fb4e73812259536df35d4d.: keystone.exception.UserNotFound: Could not find user: 01ae7c1de8fb4e73812259536df35d4d. Jul 23 21:34:51.256601 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 21:34:51.256601 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 21:34:51.256601 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 21:34:51.256601 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 21:34:51.256601 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 21:34:51.256601 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 21:34:51.256601 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 21:34:51.256601 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 21:34:51.256601 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 21:34:51.256601 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 21:34:51.256601 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 21:34:51.256601 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 23 21:34:51.256601 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 23 21:34:51.257617 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 23 21:34:51.257617 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 23 21:34:51.257617 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 21:34:51.257617 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 21:34:51.257617 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 23 21:34:51.257617 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 23 21:34:51.257617 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 23 21:34:51.257617 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 23 21:34:51.257617 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 21:34:51.257617 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 21:34:51.257617 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 21:34:51.257617 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 21:34:51.257617 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 21:34:51.257617 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application with Lock( Jul 23 21:34:51.257617 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 21:34:51.257617 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._enter() Jul 23 21:34:51.257617 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 21:34:51.258715 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 21:34:51.258715 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 21:34:51.258715 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.creator() Jul 23 21:34:51.258715 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 21:34:51.258715 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application created_value = creator( Jul 23 21:34:51.258715 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 23 21:34:51.258715 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 23 21:34:51.258715 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 23 21:34:51.258715 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 23 21:34:51.258715 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 23 21:34:51.258715 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 23 21:34:51.258715 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 01ae7c1de8fb4e73812259536df35d4d. Jul 23 21:34:51.258715 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 21:34:51.258715 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3292/6546] 10.222.0.17 () {58 vars in 1220 bytes} [Sat Jul 23 21:34:51 2022] GET /identity/v3/users/01ae7c1de8fb4e73812259536df35d4d => generated 110 bytes in 104 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Jul 23 21:34:51.265023 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e687e780-7e4c-4c8a-bb8c-d88e40d08e71 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:51.280782 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e687e780-7e4c-4c8a-bb8c-d88e40d08e71 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:51.299968 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1233482-f8e2-4d14-bda0-1f3d89ad8263 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6169c34aa5684bd3a8c97599122f6855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5a262ead17f44c6a1c5df904359cf6b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:51.301065 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1233482-f8e2-4d14-bda0-1f3d89ad8263 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:51.301453 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1233482-f8e2-4d14-bda0-1f3d89ad8263 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:51.301829 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1233482-f8e2-4d14-bda0-1f3d89ad8263 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] PATH_INFO: `/v3/groups/8dcf5018310c436cbb203c677c1b5010` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:51.317928 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1233482-f8e2-4d14-bda0-1f3d89ad8263 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] RBAC: Authorizing `identity:get_group(group_id=8dcf5018310c436cbb203c677c1b5010)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:51.321976 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1233482-f8e2-4d14-bda0-1f3d89ad8263 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:51.344569 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-e1233482-f8e2-4d14-bda0-1f3d89ad8263 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Could not find group: 8dcf5018310c436cbb203c677c1b5010.: keystone.exception.GroupNotFound: Could not find group: 8dcf5018310c436cbb203c677c1b5010. Jul 23 21:34:51.344569 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 21:34:51.344569 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 21:34:51.344569 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 21:34:51.344569 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 21:34:51.344569 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 21:34:51.344569 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 21:34:51.344569 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 21:34:51.344569 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 21:34:51.344569 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 21:34:51.344569 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 21:34:51.344569 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 21:34:51.344569 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/groups.py", line 58, in get Jul 23 21:34:51.344569 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_group(group_id) Jul 23 21:34:51.345889 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/groups.py", line 70, in _get_group Jul 23 21:34:51.345889 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.identity_api.get_group(group_id)) Jul 23 21:34:51.345889 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 21:34:51.345889 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 21:34:51.345889 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 23 21:34:51.345889 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 23 21:34:51.345889 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 23 21:34:51.345889 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 23 21:34:51.345889 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 21:34:51.345889 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 21:34:51.345889 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 21:34:51.345889 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 21:34:51.345889 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 21:34:51.345889 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application with Lock( Jul 23 21:34:51.345889 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 21:34:51.345889 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._enter() Jul 23 21:34:51.345889 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 21:34:51.347195 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 21:34:51.347195 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 21:34:51.347195 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.creator() Jul 23 21:34:51.347195 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 21:34:51.347195 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application created_value = creator( Jul 23 21:34:51.347195 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1262, in get_group Jul 23 21:34:51.347195 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application ref = driver.get_group(entity_id) Jul 23 21:34:51.347195 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 417, in get_group Jul 23 21:34:51.347195 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_group(session, group_id).to_dict() Jul 23 21:34:51.347195 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 412, in _get_group Jul 23 21:34:51.347195 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.GroupNotFound(group_id=group_id) Jul 23 21:34:51.347195 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.GroupNotFound: Could not find group: 8dcf5018310c436cbb203c677c1b5010. Jul 23 21:34:51.347195 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 21:34:51.355352 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40edf85-81ea-4fe4-8774-0179949b5d04 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:51.362062 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3255/6547] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:34:51 2022] GET /identity/v3/groups/8dcf5018310c436cbb203c677c1b5010 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 23 21:34:51.368573 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40edf85-81ea-4fe4-8774-0179949b5d04 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:51.377753 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945ffe1f-25b0-4491-9190-426d7dd11a5d tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6169c34aa5684bd3a8c97599122f6855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5a262ead17f44c6a1c5df904359cf6b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:51.379343 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945ffe1f-25b0-4491-9190-426d7dd11a5d tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:51.379777 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945ffe1f-25b0-4491-9190-426d7dd11a5d tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:51.380063 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945ffe1f-25b0-4491-9190-426d7dd11a5d tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] PATH_INFO: `/v3/groups/8dcf5018310c436cbb203c677c1b5010` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:51.394411 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945ffe1f-25b0-4491-9190-426d7dd11a5d tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 21:34:51.414417 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-945ffe1f-25b0-4491-9190-426d7dd11a5d tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Could not find group: 8dcf5018310c436cbb203c677c1b5010.: keystone.exception.GroupNotFound: Could not find group: 8dcf5018310c436cbb203c677c1b5010. Jul 23 21:34:51.414417 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 21:34:51.414417 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 21:34:51.414417 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 21:34:51.414417 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 21:34:51.414417 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 21:34:51.414417 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 21:34:51.414417 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 21:34:51.414417 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 21:34:51.414417 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 21:34:51.414417 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 21:34:51.414417 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 21:34:51.414417 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/groups.py", line 133, in delete Jul 23 21:34:51.414417 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_group') Jul 23 21:34:51.415738 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 21:34:51.415738 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 21:34:51.415738 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 21:34:51.415738 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 21:34:51.415738 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 21:34:51.415738 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 21:34:51.415738 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 23 21:34:51.415738 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 23 21:34:51.415738 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 23 21:34:51.415738 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 23 21:34:51.415738 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 21:34:51.415738 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 21:34:51.415738 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 21:34:51.415738 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 21:34:51.415738 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 21:34:51.415738 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application with Lock( Jul 23 21:34:51.415738 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 21:34:51.417104 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._enter() Jul 23 21:34:51.417104 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 21:34:51.417104 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 21:34:51.417104 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 21:34:51.417104 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.creator() Jul 23 21:34:51.417104 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 21:34:51.417104 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application created_value = creator( Jul 23 21:34:51.417104 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1262, in get_group Jul 23 21:34:51.417104 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application ref = driver.get_group(entity_id) Jul 23 21:34:51.417104 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 417, in get_group Jul 23 21:34:51.417104 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_group(session, group_id).to_dict() Jul 23 21:34:51.417104 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 412, in _get_group Jul 23 21:34:51.417104 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.GroupNotFound(group_id=group_id) Jul 23 21:34:51.417104 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.GroupNotFound: Could not find group: 8dcf5018310c436cbb203c677c1b5010. Jul 23 21:34:51.417104 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 21:34:51.420440 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1233482-f8e2-4d14-bda0-1f3d89ad8263 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:51.421812 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3293/6548] 10.222.0.17 () {58 vars in 1226 bytes} [Sat Jul 23 21:34:51 2022] DELETE /identity/v3/groups/8dcf5018310c436cbb203c677c1b5010 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Jul 23 21:34:51.431590 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1233482-f8e2-4d14-bda0-1f3d89ad8263 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:51.439037 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8169faa7-0010-4680-869d-fa8b3857178e tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6169c34aa5684bd3a8c97599122f6855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5a262ead17f44c6a1c5df904359cf6b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:51.439956 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8169faa7-0010-4680-869d-fa8b3857178e tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:51.440239 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8169faa7-0010-4680-869d-fa8b3857178e tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:51.440883 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8169faa7-0010-4680-869d-fa8b3857178e tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] PATH_INFO: `/v3/users/01ae7c1de8fb4e73812259536df35d4d` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:51.450259 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8169faa7-0010-4680-869d-fa8b3857178e tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] RBAC: Authorizing `identity:delete_user(user_id=01ae7c1de8fb4e73812259536df35d4d)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:51.452343 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8169faa7-0010-4680-869d-fa8b3857178e tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:51.477070 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-8169faa7-0010-4680-869d-fa8b3857178e tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Could not find user: 01ae7c1de8fb4e73812259536df35d4d.: keystone.exception.UserNotFound: Could not find user: 01ae7c1de8fb4e73812259536df35d4d. Jul 23 21:34:51.477070 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 21:34:51.477070 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 21:34:51.477070 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 21:34:51.477070 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 21:34:51.477070 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 21:34:51.477070 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 21:34:51.477070 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 21:34:51.477070 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 21:34:51.477070 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 21:34:51.477070 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 21:34:51.477070 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 21:34:51.477070 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete Jul 23 21:34:51.477070 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user(user_id) Jul 23 21:34:51.478128 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 21:34:51.478128 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 21:34:51.478128 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 23 21:34:51.478128 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 23 21:34:51.478128 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 23 21:34:51.478128 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 23 21:34:51.478128 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user Jul 23 21:34:51.478128 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) Jul 23 21:34:51.478128 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 21:34:51.478128 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 21:34:51.478128 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 23 21:34:51.478128 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 23 21:34:51.478128 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 23 21:34:51.478128 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 23 21:34:51.478128 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 21:34:51.478128 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 21:34:51.478128 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 21:34:51.478128 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 21:34:51.479243 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 21:34:51.479243 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application with Lock( Jul 23 21:34:51.479243 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 21:34:51.479243 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._enter() Jul 23 21:34:51.479243 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 21:34:51.479243 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 21:34:51.479243 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 21:34:51.479243 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.creator() Jul 23 21:34:51.479243 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 21:34:51.479243 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application created_value = creator( Jul 23 21:34:51.479243 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 23 21:34:51.479243 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 23 21:34:51.479243 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 23 21:34:51.479243 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 23 21:34:51.479243 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 23 21:34:51.479243 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 23 21:34:51.479243 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 01ae7c1de8fb4e73812259536df35d4d. Jul 23 21:34:51.479243 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 21:34:51.480354 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3256/6549] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:34:51 2022] DELETE /identity/v3/users/01ae7c1de8fb4e73812259536df35d4d => generated 110 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 23 21:34:51.483950 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945ffe1f-25b0-4491-9190-426d7dd11a5d tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:51.505149 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945ffe1f-25b0-4491-9190-426d7dd11a5d tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:51.513404 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc4eab3-0cfa-4d1d-a9cf-ce126c0ce4af tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6169c34aa5684bd3a8c97599122f6855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5a262ead17f44c6a1c5df904359cf6b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:51.514517 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc4eab3-0cfa-4d1d-a9cf-ce126c0ce4af tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:51.515200 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc4eab3-0cfa-4d1d-a9cf-ce126c0ce4af tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:51.515306 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc4eab3-0cfa-4d1d-a9cf-ce126c0ce4af tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] PATH_INFO: `/v3/domains/20711a98dadc462abd01460ce3914545` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:51.534575 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc4eab3-0cfa-4d1d-a9cf-ce126c0ce4af tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 21:34:51.558609 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-4dc4eab3-0cfa-4d1d-a9cf-ce126c0ce4af tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Could not find domain: 20711a98dadc462abd01460ce3914545.: keystone.exception.DomainNotFound: Could not find domain: 20711a98dadc462abd01460ce3914545. Jul 23 21:34:51.558609 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 21:34:51.558609 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 23 21:34:51.558609 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 23 21:34:51.558609 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 23 21:34:51.558609 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 23 21:34:51.558609 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 23 21:34:51.558609 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 23 21:34:51.558609 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 20711a98dadc462abd01460ce3914545. Jul 23 21:34:51.558609 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 21:34:51.558609 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 23 21:34:51.558609 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 21:34:51.558609 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 21:34:51.558609 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 21:34:51.558609 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 21:34:51.558609 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 21:34:51.559815 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 21:34:51.559815 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 21:34:51.559815 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 21:34:51.559815 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 21:34:51.559815 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 21:34:51.559815 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 21:34:51.559815 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 21:34:51.559815 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jul 23 21:34:51.559815 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jul 23 21:34:51.559815 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 21:34:51.559815 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 21:34:51.559815 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 21:34:51.559815 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 21:34:51.559815 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 21:34:51.559815 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 21:34:51.559815 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 21:34:51.560786 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 21:34:51.560786 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 21:34:51.560786 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 21:34:51.560786 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 21:34:51.560786 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application with Lock( Jul 23 21:34:51.560786 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 21:34:51.560786 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._enter() Jul 23 21:34:51.560786 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 21:34:51.560786 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 21:34:51.560786 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 21:34:51.560786 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.creator() Jul 23 21:34:51.560786 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 21:34:51.560786 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application created_value = creator( Jul 23 21:34:51.560786 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 23 21:34:51.560786 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 23 21:34:51.560786 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 20711a98dadc462abd01460ce3914545. Jul 23 21:34:51.560786 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 21:34:51.562266 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3294/6550] 10.222.0.17 () {60 vars in 1248 bytes} [Sat Jul 23 21:34:51 2022] PATCH /identity/v3/domains/20711a98dadc462abd01460ce3914545 => generated 112 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 23 21:34:51.567938 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8169faa7-0010-4680-869d-fa8b3857178e tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:51.583107 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8169faa7-0010-4680-869d-fa8b3857178e tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:51.593186 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0ae4de-1f3e-419d-a7f7-965a480970e1 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6169c34aa5684bd3a8c97599122f6855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5a262ead17f44c6a1c5df904359cf6b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:51.594390 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0ae4de-1f3e-419d-a7f7-965a480970e1 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:51.594979 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0ae4de-1f3e-419d-a7f7-965a480970e1 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:51.595422 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0ae4de-1f3e-419d-a7f7-965a480970e1 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:51.596324 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0ae4de-1f3e-419d-a7f7-965a480970e1 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:51.599194 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0ae4de-1f3e-419d-a7f7-965a480970e1 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:51.620643 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3257/6551] 10.222.0.17 () {58 vars in 1127 bytes} [Sat Jul 23 21:34:51 2022] GET /identity/v3/domains => generated 1346 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:34:51.625673 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc4eab3-0cfa-4d1d-a9cf-ce126c0ce4af tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:51.645178 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc4eab3-0cfa-4d1d-a9cf-ce126c0ce4af tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:51.653552 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af18047-f199-4725-abbf-eba66bb29086 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6169c34aa5684bd3a8c97599122f6855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5a262ead17f44c6a1c5df904359cf6b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:51.654287 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af18047-f199-4725-abbf-eba66bb29086 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:51.654704 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af18047-f199-4725-abbf-eba66bb29086 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:51.654990 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af18047-f199-4725-abbf-eba66bb29086 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:51.656515 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af18047-f199-4725-abbf-eba66bb29086 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] RBAC: Adding query filter params (enabled=True) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:34:51.656824 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af18047-f199-4725-abbf-eba66bb29086 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:51.658769 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af18047-f199-4725-abbf-eba66bb29086 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:51.693904 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3295/6552] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:34:51 2022] GET /identity/v3/domains?enabled=True => generated 1093 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:34:51.695206 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0ae4de-1f3e-419d-a7f7-965a480970e1 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:51.708240 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0ae4de-1f3e-419d-a7f7-965a480970e1 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:51.715870 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90a16e0-f72c-4b8a-9288-ee6839251151 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6169c34aa5684bd3a8c97599122f6855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5a262ead17f44c6a1c5df904359cf6b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:51.716561 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90a16e0-f72c-4b8a-9288-ee6839251151 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:51.716842 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90a16e0-f72c-4b8a-9288-ee6839251151 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:51.717962 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90a16e0-f72c-4b8a-9288-ee6839251151 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:51.718795 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90a16e0-f72c-4b8a-9288-ee6839251151 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] RBAC: Adding query filter params (name=tempest-test_domain-1350588524) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:34:51.720176 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90a16e0-f72c-4b8a-9288-ee6839251151 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:51.721580 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90a16e0-f72c-4b8a-9288-ee6839251151 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:51.742369 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3258/6553] 10.222.0.17 () {58 vars in 1198 bytes} [Sat Jul 23 21:34:51 2022] GET /identity/v3/domains?name=tempest-test_domain-1350588524 => generated 408 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:34:51.743787 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af18047-f199-4725-abbf-eba66bb29086 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:51.767606 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af18047-f199-4725-abbf-eba66bb29086 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:51.775297 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5226a3d-6111-4f30-b521-2218567ce452 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6169c34aa5684bd3a8c97599122f6855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5a262ead17f44c6a1c5df904359cf6b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:51.776373 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5226a3d-6111-4f30-b521-2218567ce452 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:51.776749 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5226a3d-6111-4f30-b521-2218567ce452 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:51.778075 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5226a3d-6111-4f30-b521-2218567ce452 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] PATH_INFO: `/v3/domains/20711a98dadc462abd01460ce3914545` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:51.790028 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5226a3d-6111-4f30-b521-2218567ce452 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 21:34:51.805457 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-e5226a3d-6111-4f30-b521-2218567ce452 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Could not find domain: 20711a98dadc462abd01460ce3914545.: keystone.exception.DomainNotFound: Could not find domain: 20711a98dadc462abd01460ce3914545. Jul 23 21:34:51.805457 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 21:34:51.805457 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 23 21:34:51.805457 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 23 21:34:51.805457 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 23 21:34:51.805457 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 23 21:34:51.805457 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 23 21:34:51.805457 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 23 21:34:51.805457 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 20711a98dadc462abd01460ce3914545. Jul 23 21:34:51.805457 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 21:34:51.805457 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 23 21:34:51.805457 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 21:34:51.805457 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 21:34:51.805457 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 21:34:51.805457 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 21:34:51.805457 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 21:34:51.806839 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 21:34:51.806839 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 21:34:51.806839 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 21:34:51.806839 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 21:34:51.806839 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 21:34:51.806839 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 21:34:51.806839 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 21:34:51.806839 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jul 23 21:34:51.806839 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jul 23 21:34:51.806839 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 21:34:51.806839 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 21:34:51.806839 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 21:34:51.806839 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 21:34:51.806839 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 21:34:51.806839 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 21:34:51.806839 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 21:34:51.808160 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 21:34:51.808160 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 21:34:51.808160 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 21:34:51.808160 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 21:34:51.808160 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application with Lock( Jul 23 21:34:51.808160 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 21:34:51.808160 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._enter() Jul 23 21:34:51.808160 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 21:34:51.808160 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 21:34:51.808160 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 21:34:51.808160 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.creator() Jul 23 21:34:51.808160 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 21:34:51.808160 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application created_value = creator( Jul 23 21:34:51.808160 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 23 21:34:51.808160 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 23 21:34:51.808160 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 20711a98dadc462abd01460ce3914545. Jul 23 21:34:51.808160 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 21:34:51.810473 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3296/6554] 10.222.0.17 () {60 vars in 1248 bytes} [Sat Jul 23 21:34:51 2022] PATCH /identity/v3/domains/20711a98dadc462abd01460ce3914545 => generated 112 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 23 21:34:51.814769 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90a16e0-f72c-4b8a-9288-ee6839251151 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:51.829542 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90a16e0-f72c-4b8a-9288-ee6839251151 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:51.839434 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf6796f-15fc-4d40-8a57-043a16e79ef8 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6169c34aa5684bd3a8c97599122f6855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5a262ead17f44c6a1c5df904359cf6b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:51.841522 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf6796f-15fc-4d40-8a57-043a16e79ef8 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:51.841522 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf6796f-15fc-4d40-8a57-043a16e79ef8 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:51.841794 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf6796f-15fc-4d40-8a57-043a16e79ef8 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] PATH_INFO: `/v3/domains/cb4fbebc5a9143aebe1124e1e0908fc2` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:51.845267 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:UPDATE=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:51.874059 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf6796f-15fc-4d40-8a57-043a16e79ef8 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=cb4fbebc5a9143aebe1124e1e0908fc2)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:51.880054 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf6796f-15fc-4d40-8a57-043a16e79ef8 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:51.975306 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3259/6555] 10.222.0.17 () {60 vars in 1248 bytes} [Sat Jul 23 21:34:51 2022] PATCH /identity/v3/domains/cb4fbebc5a9143aebe1124e1e0908fc2 => generated 277 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:34:51.976521 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5226a3d-6111-4f30-b521-2218567ce452 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:51.990360 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5226a3d-6111-4f30-b521-2218567ce452 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:51.996149 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58633a10-6af6-4fc5-af9c-2fcce63cfcd5 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6169c34aa5684bd3a8c97599122f6855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5a262ead17f44c6a1c5df904359cf6b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:51.997550 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58633a10-6af6-4fc5-af9c-2fcce63cfcd5 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:51.998916 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58633a10-6af6-4fc5-af9c-2fcce63cfcd5 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:51.999659 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58633a10-6af6-4fc5-af9c-2fcce63cfcd5 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] PATH_INFO: `/v3/domains/cb4fbebc5a9143aebe1124e1e0908fc2` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:52.021456 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58633a10-6af6-4fc5-af9c-2fcce63cfcd5 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=cb4fbebc5a9143aebe1124e1e0908fc2)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:52.034085 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58633a10-6af6-4fc5-af9c-2fcce63cfcd5 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:52.083139 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-58633a10-6af6-4fc5-af9c-2fcce63cfcd5 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'cb4fbebc5a9143aebe1124e1e0908fc2'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:52.103578 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-58633a10-6af6-4fc5-af9c-2fcce63cfcd5 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'cb4fbebc5a9143aebe1124e1e0908fc2'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:52.188107 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-58633a10-6af6-4fc5-af9c-2fcce63cfcd5 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb4fbebc5a9143aebe1124e1e0908fc2', 'request_id': 'req-58633a10-6af6-4fc5-af9c-2fcce63cfcd5'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:52.203269 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-58633a10-6af6-4fc5-af9c-2fcce63cfcd5 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb4fbebc5a9143aebe1124e1e0908fc2', 'request_id': 'req-58633a10-6af6-4fc5-af9c-2fcce63cfcd5'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:52.226126 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-58633a10-6af6-4fc5-af9c-2fcce63cfcd5 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb4fbebc5a9143aebe1124e1e0908fc2', 'request_id': 'req-58633a10-6af6-4fc5-af9c-2fcce63cfcd5'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:52.237431 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:52.245299 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-58633a10-6af6-4fc5-af9c-2fcce63cfcd5 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] The token cache is being invalidate because project cb4fbebc5a9143aebe1124e1e0908fc2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:34:52.245834 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-58633a10-6af6-4fc5-af9c-2fcce63cfcd5 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:52.247158 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-58633a10-6af6-4fc5-af9c-2fcce63cfcd5 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:52.257032 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-58633a10-6af6-4fc5-af9c-2fcce63cfcd5 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'cb4fbebc5a9143aebe1124e1e0908fc2', 'request_id': 'req-58633a10-6af6-4fc5-af9c-2fcce63cfcd5'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:52.261497 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-58633a10-6af6-4fc5-af9c-2fcce63cfcd5 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'cb4fbebc5a9143aebe1124e1e0908fc2', 'request_id': 'req-58633a10-6af6-4fc5-af9c-2fcce63cfcd5'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:52.262510 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-58633a10-6af6-4fc5-af9c-2fcce63cfcd5 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'cb4fbebc5a9143aebe1124e1e0908fc2', 'request_id': 'req-58633a10-6af6-4fc5-af9c-2fcce63cfcd5'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:52.271827 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3297/6556] 10.222.0.17 () {58 vars in 1229 bytes} [Sat Jul 23 21:34:51 2022] DELETE /identity/v3/domains/cb4fbebc5a9143aebe1124e1e0908fc2 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:52.276374 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf6796f-15fc-4d40-8a57-043a16e79ef8 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:52.278776 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-ecf6796f-15fc-4d40-8a57-043a16e79ef8 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:52.303117 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf6796f-15fc-4d40-8a57-043a16e79ef8 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:52.378205 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7d8a3c-2d99-4d20-894f-a45f39f8f816 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6169c34aa5684bd3a8c97599122f6855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5a262ead17f44c6a1c5df904359cf6b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:52.379163 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7d8a3c-2d99-4d20-894f-a45f39f8f816 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:52.380580 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7d8a3c-2d99-4d20-894f-a45f39f8f816 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:52.380886 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7d8a3c-2d99-4d20-894f-a45f39f8f816 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] PATH_INFO: `/v3/domains/4705fe65b2ee487798ba14d9cce0f57c` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:52.394520 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7d8a3c-2d99-4d20-894f-a45f39f8f816 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=4705fe65b2ee487798ba14d9cce0f57c)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:52.397650 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7d8a3c-2d99-4d20-894f-a45f39f8f816 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:52.426889 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-3d7d8a3c-2d99-4d20-894f-a45f39f8f816 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '4705fe65b2ee487798ba14d9cce0f57c'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:52.427629 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-3d7d8a3c-2d99-4d20-894f-a45f39f8f816 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '4705fe65b2ee487798ba14d9cce0f57c'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:52.459220 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-3d7d8a3c-2d99-4d20-894f-a45f39f8f816 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '4705fe65b2ee487798ba14d9cce0f57c'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:52.459951 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-3d7d8a3c-2d99-4d20-894f-a45f39f8f816 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '4705fe65b2ee487798ba14d9cce0f57c'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:52.464534 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3260/6557] 10.222.0.17 () {60 vars in 1248 bytes} [Sat Jul 23 21:34:52 2022] PATCH /identity/v3/domains/4705fe65b2ee487798ba14d9cce0f57c => generated 276 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:34:52.469806 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58633a10-6af6-4fc5-af9c-2fcce63cfcd5 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:52.488370 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58633a10-6af6-4fc5-af9c-2fcce63cfcd5 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:52.588463 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f900848-e5b1-4cfb-8d11-93388649c09c tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6169c34aa5684bd3a8c97599122f6855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5a262ead17f44c6a1c5df904359cf6b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:52.589653 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f900848-e5b1-4cfb-8d11-93388649c09c tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:52.590185 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f900848-e5b1-4cfb-8d11-93388649c09c tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:52.590878 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f900848-e5b1-4cfb-8d11-93388649c09c tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] PATH_INFO: `/v3/domains/4705fe65b2ee487798ba14d9cce0f57c` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:52.607047 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f900848-e5b1-4cfb-8d11-93388649c09c tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=4705fe65b2ee487798ba14d9cce0f57c)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:52.609154 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f900848-e5b1-4cfb-8d11-93388649c09c tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:52.649442 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-5f900848-e5b1-4cfb-8d11-93388649c09c tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '4705fe65b2ee487798ba14d9cce0f57c'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:52.662325 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-5f900848-e5b1-4cfb-8d11-93388649c09c tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '4705fe65b2ee487798ba14d9cce0f57c'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:52.735430 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-5f900848-e5b1-4cfb-8d11-93388649c09c tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4705fe65b2ee487798ba14d9cce0f57c', 'request_id': 'req-5f900848-e5b1-4cfb-8d11-93388649c09c'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:52.757980 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-5f900848-e5b1-4cfb-8d11-93388649c09c tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4705fe65b2ee487798ba14d9cce0f57c', 'request_id': 'req-5f900848-e5b1-4cfb-8d11-93388649c09c'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:52.766097 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-5f900848-e5b1-4cfb-8d11-93388649c09c tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4705fe65b2ee487798ba14d9cce0f57c', 'request_id': 'req-5f900848-e5b1-4cfb-8d11-93388649c09c'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:52.782879 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-5f900848-e5b1-4cfb-8d11-93388649c09c tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] The token cache is being invalidate because project 4705fe65b2ee487798ba14d9cce0f57c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:34:52.783221 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-5f900848-e5b1-4cfb-8d11-93388649c09c tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:52.784164 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-5f900848-e5b1-4cfb-8d11-93388649c09c tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:52.794322 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-5f900848-e5b1-4cfb-8d11-93388649c09c tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '4705fe65b2ee487798ba14d9cce0f57c', 'request_id': 'req-5f900848-e5b1-4cfb-8d11-93388649c09c'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:52.799005 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-5f900848-e5b1-4cfb-8d11-93388649c09c tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '4705fe65b2ee487798ba14d9cce0f57c', 'request_id': 'req-5f900848-e5b1-4cfb-8d11-93388649c09c'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:52.799984 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-5f900848-e5b1-4cfb-8d11-93388649c09c tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '4705fe65b2ee487798ba14d9cce0f57c', 'request_id': 'req-5f900848-e5b1-4cfb-8d11-93388649c09c'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:52.811133 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3298/6558] 10.222.0.17 () {58 vars in 1229 bytes} [Sat Jul 23 21:34:52 2022] DELETE /identity/v3/domains/4705fe65b2ee487798ba14d9cce0f57c => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:52.812496 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7d8a3c-2d99-4d20-894f-a45f39f8f816 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:52.814007 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-3d7d8a3c-2d99-4d20-894f-a45f39f8f816 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:52.836718 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7d8a3c-2d99-4d20-894f-a45f39f8f816 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:53.048571 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7669fdef-2332-4550-af92-91d9739d0020 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6169c34aa5684bd3a8c97599122f6855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5a262ead17f44c6a1c5df904359cf6b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:53.049545 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7669fdef-2332-4550-af92-91d9739d0020 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:53.050124 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7669fdef-2332-4550-af92-91d9739d0020 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:53.050411 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7669fdef-2332-4550-af92-91d9739d0020 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] PATH_INFO: `/v3/domains/4fede122c8bc46f2b072e87b4c77d6b3` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:53.075236 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7669fdef-2332-4550-af92-91d9739d0020 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=4fede122c8bc46f2b072e87b4c77d6b3)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:53.076529 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7669fdef-2332-4550-af92-91d9739d0020 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:53.102176 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:53.125006 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-7669fdef-2332-4550-af92-91d9739d0020 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '4fede122c8bc46f2b072e87b4c77d6b3'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:53.129704 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-7669fdef-2332-4550-af92-91d9739d0020 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '4fede122c8bc46f2b072e87b4c77d6b3'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:53.180787 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-7669fdef-2332-4550-af92-91d9739d0020 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '4fede122c8bc46f2b072e87b4c77d6b3'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:53.181491 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-7669fdef-2332-4550-af92-91d9739d0020 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '4fede122c8bc46f2b072e87b4c77d6b3'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:53.187860 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3261/6559] 10.222.0.17 () {60 vars in 1248 bytes} [Sat Jul 23 21:34:52 2022] PATCH /identity/v3/domains/4fede122c8bc46f2b072e87b4c77d6b3 => generated 277 bytes in 376 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:34:53.192041 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f900848-e5b1-4cfb-8d11-93388649c09c tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:53.193780 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-5f900848-e5b1-4cfb-8d11-93388649c09c tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:53.211598 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f900848-e5b1-4cfb-8d11-93388649c09c tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:53.246198 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:53.333126 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c8fc84-f578-4d5d-a492-d637f01f377c tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6169c34aa5684bd3a8c97599122f6855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5a262ead17f44c6a1c5df904359cf6b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:53.334057 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c8fc84-f578-4d5d-a492-d637f01f377c tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:53.334339 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c8fc84-f578-4d5d-a492-d637f01f377c tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:53.334616 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c8fc84-f578-4d5d-a492-d637f01f377c tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] PATH_INFO: `/v3/domains/4fede122c8bc46f2b072e87b4c77d6b3` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:53.353242 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c8fc84-f578-4d5d-a492-d637f01f377c tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=4fede122c8bc46f2b072e87b4c77d6b3)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:53.357362 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c8fc84-f578-4d5d-a492-d637f01f377c tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:53.389120 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-f6c8fc84-f578-4d5d-a492-d637f01f377c tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '4fede122c8bc46f2b072e87b4c77d6b3'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:53.404145 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-f6c8fc84-f578-4d5d-a492-d637f01f377c tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '4fede122c8bc46f2b072e87b4c77d6b3'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:53.509344 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-f6c8fc84-f578-4d5d-a492-d637f01f377c tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fede122c8bc46f2b072e87b4c77d6b3', 'request_id': 'req-f6c8fc84-f578-4d5d-a492-d637f01f377c'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:53.543643 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-f6c8fc84-f578-4d5d-a492-d637f01f377c tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fede122c8bc46f2b072e87b4c77d6b3', 'request_id': 'req-f6c8fc84-f578-4d5d-a492-d637f01f377c'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:53.551461 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-f6c8fc84-f578-4d5d-a492-d637f01f377c tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fede122c8bc46f2b072e87b4c77d6b3', 'request_id': 'req-f6c8fc84-f578-4d5d-a492-d637f01f377c'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:53.569519 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-f6c8fc84-f578-4d5d-a492-d637f01f377c tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] The token cache is being invalidate because project 4fede122c8bc46f2b072e87b4c77d6b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:34:53.569783 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-f6c8fc84-f578-4d5d-a492-d637f01f377c tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:53.570871 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-f6c8fc84-f578-4d5d-a492-d637f01f377c tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:53.581252 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-f6c8fc84-f578-4d5d-a492-d637f01f377c tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '4fede122c8bc46f2b072e87b4c77d6b3', 'request_id': 'req-f6c8fc84-f578-4d5d-a492-d637f01f377c'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:53.586817 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-f6c8fc84-f578-4d5d-a492-d637f01f377c tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '4fede122c8bc46f2b072e87b4c77d6b3', 'request_id': 'req-f6c8fc84-f578-4d5d-a492-d637f01f377c'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:53.587583 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-f6c8fc84-f578-4d5d-a492-d637f01f377c tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '4fede122c8bc46f2b072e87b4c77d6b3', 'request_id': 'req-f6c8fc84-f578-4d5d-a492-d637f01f377c'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:53.597935 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3299/6560] 10.222.0.17 () {58 vars in 1229 bytes} [Sat Jul 23 21:34:53 2022] DELETE /identity/v3/domains/4fede122c8bc46f2b072e87b4c77d6b3 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:53.602178 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7669fdef-2332-4550-af92-91d9739d0020 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:53.604387 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-7669fdef-2332-4550-af92-91d9739d0020 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:53.689503 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7669fdef-2332-4550-af92-91d9739d0020 tempest-DomainsTestJSON-1488972028 tempest-DomainsTestJSON-1488972028-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:53.778244 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19445bc1-dfa8-4514-9003-e4d0ce277a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:53.779467 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19445bc1-dfa8-4514-9003-e4d0ce277a5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:53.779742 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19445bc1-dfa8-4514-9003-e4d0ce277a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:53.780057 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19445bc1-dfa8-4514-9003-e4d0ce277a5e admin admin] PATH_INFO: `/v3/users/28814586010d410b814aab2971e084f7` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:53.781622 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19445bc1-dfa8-4514-9003-e4d0ce277a5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=28814586010d410b814aab2971e084f7)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:53.785036 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19445bc1-dfa8-4514-9003-e4d0ce277a5e admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:53.896731 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-19445bc1-dfa8-4514-9003-e4d0ce277a5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28814586010d410b814aab2971e084f7'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:53.912417 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-19445bc1-dfa8-4514-9003-e4d0ce277a5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28814586010d410b814aab2971e084f7'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:53.914047 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-19445bc1-dfa8-4514-9003-e4d0ce277a5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28814586010d410b814aab2971e084f7'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:53.929024 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-19445bc1-dfa8-4514-9003-e4d0ce277a5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28814586010d410b814aab2971e084f7'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:53.977966 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-19445bc1-dfa8-4514-9003-e4d0ce277a5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28814586010d410b814aab2971e084f7'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:53.984093 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=88,keystone:UPDATE=1,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:53.996985 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3262/6561] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:34:53 2022] DELETE /identity/v3/users/28814586010d410b814aab2971e084f7 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:54.001409 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5567bbf-7313-4483-9327-ebe57dffe073 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:54.002322 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5567bbf-7313-4483-9327-ebe57dffe073 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:54.002322 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5567bbf-7313-4483-9327-ebe57dffe073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:54.035101 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-d5567bbf-7313-4483-9327-ebe57dffe073 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:34:54.039083 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-d5567bbf-7313-4483-9327-ebe57dffe073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:54.136968 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:54.159360 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3300/6562] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:34:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:34:54.170801 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19445bc1-dfa8-4514-9003-e4d0ce277a5e admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:54.172276 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-19445bc1-dfa8-4514-9003-e4d0ce277a5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:54.302145 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19445bc1-dfa8-4514-9003-e4d0ce277a5e admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:54.307129 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c093fdeb-ff9d-42d4-9b9d-4672e3cb22c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:54.308069 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c093fdeb-ff9d-42d4-9b9d-4672e3cb22c0 service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:54.308508 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c093fdeb-ff9d-42d4-9b9d-4672e3cb22c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:54.308934 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c093fdeb-ff9d-42d4-9b9d-4672e3cb22c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:54.324241 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c093fdeb-ff9d-42d4-9b9d-4672e3cb22c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:54.326300 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c093fdeb-ff9d-42d4-9b9d-4672e3cb22c0 service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:54.339127 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3263/6563] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:34:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:34:55.743642 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5567bbf-7313-4483-9327-ebe57dffe073 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:55.745125 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-d5567bbf-7313-4483-9327-ebe57dffe073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:55.831287 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c093fdeb-ff9d-42d4-9b9d-4672e3cb22c0 service neutron] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:55.833297 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-c093fdeb-ff9d-42d4-9b9d-4672e3cb22c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:55.857475 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c093fdeb-ff9d-42d4-9b9d-4672e3cb22c0 service neutron] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:55.865490 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7190c476-0702-43ce-b8bc-4e07cce197e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:55.866951 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7190c476-0702-43ce-b8bc-4e07cce197e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:55.867715 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7190c476-0702-43ce-b8bc-4e07cce197e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:55.868253 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7190c476-0702-43ce-b8bc-4e07cce197e2 admin admin] PATH_INFO: `/v3/projects/393d0f9c2ea74d258d28440fa8644d4a` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:55.870171 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7190c476-0702-43ce-b8bc-4e07cce197e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=393d0f9c2ea74d258d28440fa8644d4a)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:55.872482 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7190c476-0702-43ce-b8bc-4e07cce197e2 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:55.928794 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5567bbf-7313-4483-9327-ebe57dffe073 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:55.936528 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7964a3c-38aa-4cf4-9159-18e759ee8591 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:55.937270 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7964a3c-38aa-4cf4-9159-18e759ee8591 service nova] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:55.937643 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7964a3c-38aa-4cf4-9159-18e759ee8591 service nova] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:55.938074 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7964a3c-38aa-4cf4-9159-18e759ee8591 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:55.940721 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-c7964a3c-38aa-4cf4-9159-18e759ee8591 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:56.015153 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-7190c476-0702-43ce-b8bc-4e07cce197e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '393d0f9c2ea74d258d28440fa8644d4a', 'request_id': 'req-7190c476-0702-43ce-b8bc-4e07cce197e2'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:56.033616 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7964a3c-38aa-4cf4-9159-18e759ee8591 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:56.036349 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7964a3c-38aa-4cf4-9159-18e759ee8591 service nova] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:56.051370 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-7190c476-0702-43ce-b8bc-4e07cce197e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '393d0f9c2ea74d258d28440fa8644d4a', 'request_id': 'req-7190c476-0702-43ce-b8bc-4e07cce197e2'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:56.061621 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-7190c476-0702-43ce-b8bc-4e07cce197e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '393d0f9c2ea74d258d28440fa8644d4a', 'request_id': 'req-7190c476-0702-43ce-b8bc-4e07cce197e2'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:56.080466 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-7190c476-0702-43ce-b8bc-4e07cce197e2 admin admin] The token cache is being invalidate because project 393d0f9c2ea74d258d28440fa8644d4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:34:56.080761 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-7190c476-0702-43ce-b8bc-4e07cce197e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:56.082158 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-7190c476-0702-43ce-b8bc-4e07cce197e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:56.082662 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3301/6564] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:34:55 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:34:56.084133 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3264/6565] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:34:55 2022] DELETE /identity/v3/projects/393d0f9c2ea74d258d28440fa8644d4a => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:34:56.085126 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7964a3c-38aa-4cf4-9159-18e759ee8591 service nova] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:56.090850 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7190c476-0702-43ce-b8bc-4e07cce197e2 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:56.092577 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-c7964a3c-38aa-4cf4-9159-18e759ee8591 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:56.093723 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-7190c476-0702-43ce-b8bc-4e07cce197e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:56.127565 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7964a3c-38aa-4cf4-9159-18e759ee8591 service nova] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:56.241293 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7190c476-0702-43ce-b8bc-4e07cce197e2 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:56.252330 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c561590c-55be-4ef1-aaf4-0987cb9eba6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:56.254141 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c561590c-55be-4ef1-aaf4-0987cb9eba6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:56.254858 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c561590c-55be-4ef1-aaf4-0987cb9eba6e admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:56.255802 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c561590c-55be-4ef1-aaf4-0987cb9eba6e admin admin] PATH_INFO: `/v3/users/6169c34aa5684bd3a8c97599122f6855` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:56.257801 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c561590c-55be-4ef1-aaf4-0987cb9eba6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6169c34aa5684bd3a8c97599122f6855)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:56.261735 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c561590c-55be-4ef1-aaf4-0987cb9eba6e admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:56.264491 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33201d48-ba3d-4145-b021-ef91d5f91094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:56.266180 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33201d48-ba3d-4145-b021-ef91d5f91094 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:56.266481 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33201d48-ba3d-4145-b021-ef91d5f91094 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:56.266926 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33201d48-ba3d-4145-b021-ef91d5f91094 admin admin] PATH_INFO: `/v3/users/8c894a195be047038e8d93dae322cdc9` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:56.268023 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33201d48-ba3d-4145-b021-ef91d5f91094 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c894a195be047038e8d93dae322cdc9)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:56.273768 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33201d48-ba3d-4145-b021-ef91d5f91094 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:56.304224 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:56.325097 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:56.362274 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-c561590c-55be-4ef1-aaf4-0987cb9eba6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6169c34aa5684bd3a8c97599122f6855'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:56.372180 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-33201d48-ba3d-4145-b021-ef91d5f91094 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c894a195be047038e8d93dae322cdc9'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:56.372845 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-c561590c-55be-4ef1-aaf4-0987cb9eba6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6169c34aa5684bd3a8c97599122f6855'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:56.372968 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-33201d48-ba3d-4145-b021-ef91d5f91094 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c894a195be047038e8d93dae322cdc9'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:56.373938 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-c561590c-55be-4ef1-aaf4-0987cb9eba6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6169c34aa5684bd3a8c97599122f6855'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:56.384262 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-33201d48-ba3d-4145-b021-ef91d5f91094 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c894a195be047038e8d93dae322cdc9'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:56.397229 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-c561590c-55be-4ef1-aaf4-0987cb9eba6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6169c34aa5684bd3a8c97599122f6855'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:56.401236 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-33201d48-ba3d-4145-b021-ef91d5f91094 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c894a195be047038e8d93dae322cdc9'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:56.418595 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-c561590c-55be-4ef1-aaf4-0987cb9eba6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6169c34aa5684bd3a8c97599122f6855'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:56.427324 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3265/6566] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:34:56 2022] DELETE /identity/v3/users/6169c34aa5684bd3a8c97599122f6855 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:56.428848 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-33201d48-ba3d-4145-b021-ef91d5f91094 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c894a195be047038e8d93dae322cdc9'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:56.437377 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3302/6567] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:34:56 2022] DELETE /identity/v3/users/8c894a195be047038e8d93dae322cdc9 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:56.442247 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f555b00-288e-44d8-a700-e27b4fad25ba None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:56.442532 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f555b00-288e-44d8-a700-e27b4fad25ba None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:56.442805 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f555b00-288e-44d8-a700-e27b4fad25ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:56.466725 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-7f555b00-288e-44d8-a700-e27b4fad25ba None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:34:56.468284 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-7f555b00-288e-44d8-a700-e27b4fad25ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:56.540087 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3266/6568] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:34:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:34:56.559921 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33201d48-ba3d-4145-b021-ef91d5f91094 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:56.561447 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-33201d48-ba3d-4145-b021-ef91d5f91094 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:56.648820 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33201d48-ba3d-4145-b021-ef91d5f91094 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:56.653629 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f542120-36a4-462e-96fe-0b4ff7efd0eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:56.654337 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f542120-36a4-462e-96fe-0b4ff7efd0eb service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:56.654677 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f542120-36a4-462e-96fe-0b4ff7efd0eb service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:56.654947 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f542120-36a4-462e-96fe-0b4ff7efd0eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:56.669431 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f542120-36a4-462e-96fe-0b4ff7efd0eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:56.670913 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f542120-36a4-462e-96fe-0b4ff7efd0eb service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:56.683960 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3303/6569] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:34:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:34:57.115017 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f555b00-288e-44d8-a700-e27b4fad25ba None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:57.116996 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-7f555b00-288e-44d8-a700-e27b4fad25ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:57.149108 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f555b00-288e-44d8-a700-e27b4fad25ba None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:57.156229 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7c2998-a147-47b6-8e0a-0ae1baf84aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:57.158708 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7c2998-a147-47b6-8e0a-0ae1baf84aed admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:57.159185 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7c2998-a147-47b6-8e0a-0ae1baf84aed admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:57.159614 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7c2998-a147-47b6-8e0a-0ae1baf84aed admin admin] PATH_INFO: `/v3/projects/1b48e944de63412da8a6ddad4a319cb9` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:57.161546 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7c2998-a147-47b6-8e0a-0ae1baf84aed admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b48e944de63412da8a6ddad4a319cb9)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:57.164173 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7c2998-a147-47b6-8e0a-0ae1baf84aed admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:57.310115 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-6c7c2998-a147-47b6-8e0a-0ae1baf84aed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b48e944de63412da8a6ddad4a319cb9', 'request_id': 'req-6c7c2998-a147-47b6-8e0a-0ae1baf84aed'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:57.323436 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-6c7c2998-a147-47b6-8e0a-0ae1baf84aed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b48e944de63412da8a6ddad4a319cb9', 'request_id': 'req-6c7c2998-a147-47b6-8e0a-0ae1baf84aed'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:57.334959 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-6c7c2998-a147-47b6-8e0a-0ae1baf84aed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b48e944de63412da8a6ddad4a319cb9', 'request_id': 'req-6c7c2998-a147-47b6-8e0a-0ae1baf84aed'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:57.359617 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-6c7c2998-a147-47b6-8e0a-0ae1baf84aed admin admin] The token cache is being invalidate because project 1b48e944de63412da8a6ddad4a319cb9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:34:57.360144 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-6c7c2998-a147-47b6-8e0a-0ae1baf84aed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:57.361613 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-6c7c2998-a147-47b6-8e0a-0ae1baf84aed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:57.363890 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3267/6570] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:34:57 2022] DELETE /identity/v3/projects/1b48e944de63412da8a6ddad4a319cb9 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:57.370000 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a2e246-a309-4f33-9937-28370cf7abbe None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:57.371032 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a2e246-a309-4f33-9937-28370cf7abbe None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:57.371840 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a2e246-a309-4f33-9937-28370cf7abbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:57.404833 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-e1a2e246-a309-4f33-9937-28370cf7abbe None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:34:57.407173 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-e1a2e246-a309-4f33-9937-28370cf7abbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:57.510711 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3304/6571] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:34:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:34:57.517284 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db68aff-48a0-487b-bf8a-c3dacc893cb8 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:57.517682 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db68aff-48a0-487b-bf8a-c3dacc893cb8 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:57.518084 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db68aff-48a0-487b-bf8a-c3dacc893cb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:57.548623 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-3db68aff-48a0-487b-bf8a-c3dacc893cb8 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:34:57.550151 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-3db68aff-48a0-487b-bf8a-c3dacc893cb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:57.570820 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3268/6572] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:34:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:34:57.572781 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a2e246-a309-4f33-9937-28370cf7abbe None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:57.587938 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a2e246-a309-4f33-9937-28370cf7abbe None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:57.595817 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7dbf41-d03c-4357-bc5b-dbff99d91138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:57.601627 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7dbf41-d03c-4357-bc5b-dbff99d91138 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:57.602254 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7dbf41-d03c-4357-bc5b-dbff99d91138 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:57.603238 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7dbf41-d03c-4357-bc5b-dbff99d91138 admin admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:57.604345 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7dbf41-d03c-4357-bc5b-dbff99d91138 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:34:57.604887 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7dbf41-d03c-4357-bc5b-dbff99d91138 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:57.608608 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7dbf41-d03c-4357-bc5b-dbff99d91138 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:57.623991 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db68aff-48a0-487b-bf8a-c3dacc893cb8 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:57.626863 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-3db68aff-48a0-487b-bf8a-c3dacc893cb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:57.643594 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3305/6573] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:34:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:34:57.645276 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7dbf41-d03c-4357-bc5b-dbff99d91138 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:57.655495 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db68aff-48a0-487b-bf8a-c3dacc893cb8 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:57.669833 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7dbf41-d03c-4357-bc5b-dbff99d91138 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:57.672343 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecd92ed-3e44-4275-aa69-e9b129c98f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:57.673367 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecd92ed-3e44-4275-aa69-e9b129c98f46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:57.673758 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecd92ed-3e44-4275-aa69-e9b129c98f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:57.674161 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecd92ed-3e44-4275-aa69-e9b129c98f46 admin admin] PATH_INFO: `/v3/projects/e5a262ead17f44c6a1c5df904359cf6b` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:57.676306 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecd92ed-3e44-4275-aa69-e9b129c98f46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5a262ead17f44c6a1c5df904359cf6b)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:57.678715 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecd92ed-3e44-4275-aa69-e9b129c98f46 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:57.684467 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dceb4f-511f-4480-97ce-796c8da05406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:57.687600 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dceb4f-511f-4480-97ce-796c8da05406 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:57.688789 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dceb4f-511f-4480-97ce-796c8da05406 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:57.689072 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dceb4f-511f-4480-97ce-796c8da05406 admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:57.689781 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dceb4f-511f-4480-97ce-796c8da05406 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:57.695439 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dceb4f-511f-4480-97ce-796c8da05406 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:57.707951 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:57.745192 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3306/6574] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:34:57 2022] POST /identity/v3/projects => generated 381 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:34:57.749000 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dceb4f-511f-4480-97ce-796c8da05406 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:57.775439 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:57.811533 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-aecd92ed-3e44-4275-aa69-e9b129c98f46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5a262ead17f44c6a1c5df904359cf6b', 'request_id': 'req-aecd92ed-3e44-4275-aa69-e9b129c98f46'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:57.835552 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-aecd92ed-3e44-4275-aa69-e9b129c98f46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5a262ead17f44c6a1c5df904359cf6b', 'request_id': 'req-aecd92ed-3e44-4275-aa69-e9b129c98f46'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:57.855537 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-aecd92ed-3e44-4275-aa69-e9b129c98f46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5a262ead17f44c6a1c5df904359cf6b', 'request_id': 'req-aecd92ed-3e44-4275-aa69-e9b129c98f46'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:57.882436 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-aecd92ed-3e44-4275-aa69-e9b129c98f46 admin admin] The token cache is being invalidate because project e5a262ead17f44c6a1c5df904359cf6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:34:57.882850 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-aecd92ed-3e44-4275-aa69-e9b129c98f46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:57.883673 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-aecd92ed-3e44-4275-aa69-e9b129c98f46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:57.893349 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3269/6575] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:34:57 2022] DELETE /identity/v3/projects/e5a262ead17f44c6a1c5df904359cf6b => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:34:57.904088 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088a83fe-dd0f-4922-b0e2-c1b986ee28cf None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:57.904088 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088a83fe-dd0f-4922-b0e2-c1b986ee28cf None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:57.904465 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088a83fe-dd0f-4922-b0e2-c1b986ee28cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:57.906342 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dceb4f-511f-4480-97ce-796c8da05406 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:57.950596 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-088a83fe-dd0f-4922-b0e2-c1b986ee28cf None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:34:57.952531 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-088a83fe-dd0f-4922-b0e2-c1b986ee28cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:58.031841 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7926b398-49bb-4b92-bff2-4bbf99f37fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:58.032792 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7926b398-49bb-4b92-bff2-4bbf99f37fb0 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:58.033328 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7926b398-49bb-4b92-bff2-4bbf99f37fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:58.033771 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7926b398-49bb-4b92-bff2-4bbf99f37fb0 admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:58.034872 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7926b398-49bb-4b92-bff2-4bbf99f37fb0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:58.041766 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7926b398-49bb-4b92-bff2-4bbf99f37fb0 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:58.049661 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3270/6576] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:34:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:34:58.054000 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e0aa6e-a653-4da9-9bd0-4f87af1a0821 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:58.054747 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e0aa6e-a653-4da9-9bd0-4f87af1a0821 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:58.055543 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e0aa6e-a653-4da9-9bd0-4f87af1a0821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:58.083524 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3307/6577] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:34:57 2022] POST /identity/v3/users => generated 291 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:34:58.084790 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7926b398-49bb-4b92-bff2-4bbf99f37fb0 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:58.087763 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-7926b398-49bb-4b92-bff2-4bbf99f37fb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:58.102649 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7926b398-49bb-4b92-bff2-4bbf99f37fb0 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:58.105175 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-b7e0aa6e-a653-4da9-9bd0-4f87af1a0821 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:34:58.110063 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e613e15-ef9a-449b-9197-42c15dbe9b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:58.110271 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-b7e0aa6e-a653-4da9-9bd0-4f87af1a0821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:58.111098 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e613e15-ef9a-449b-9197-42c15dbe9b8e admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:58.111575 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e613e15-ef9a-449b-9197-42c15dbe9b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:58.112083 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e613e15-ef9a-449b-9197-42c15dbe9b8e admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:58.112975 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e613e15-ef9a-449b-9197-42c15dbe9b8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:58.115697 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e613e15-ef9a-449b-9197-42c15dbe9b8e admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:58.134498 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3308/6578] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:34:58 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:34:58.138102 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3271/6579] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:34:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:34:58.139905 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e0aa6e-a653-4da9-9bd0-4f87af1a0821 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:58.140876 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e613e15-ef9a-449b-9197-42c15dbe9b8e admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:58.167282 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e0aa6e-a653-4da9-9bd0-4f87af1a0821 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:58.168844 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e613e15-ef9a-449b-9197-42c15dbe9b8e admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:58.178570 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12393c1-23c9-4478-ae5b-ecb5019ef820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:58.179514 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12393c1-23c9-4478-ae5b-ecb5019ef820 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:58.180560 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12393c1-23c9-4478-ae5b-ecb5019ef820 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:58.181049 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4752a6-5d3a-4e5f-b169-8445a9163d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:58.181432 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12393c1-23c9-4478-ae5b-ecb5019ef820 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:58.182153 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4752a6-5d3a-4e5f-b169-8445a9163d53 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:58.182659 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4752a6-5d3a-4e5f-b169-8445a9163d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:58.183151 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4752a6-5d3a-4e5f-b169-8445a9163d53 admin admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:58.183455 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12393c1-23c9-4478-ae5b-ecb5019ef820 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:58.184324 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4752a6-5d3a-4e5f-b169-8445a9163d53 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:34:58.184819 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4752a6-5d3a-4e5f-b169-8445a9163d53 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:58.186504 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12393c1-23c9-4478-ae5b-ecb5019ef820 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:58.187942 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4752a6-5d3a-4e5f-b169-8445a9163d53 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:58.217144 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3309/6580] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:34:58 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:34:58.218271 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12393c1-23c9-4478-ae5b-ecb5019ef820 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:58.231567 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12393c1-23c9-4478-ae5b-ecb5019ef820 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:58.233139 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3272/6581] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:34:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:34:58.242344 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2d781e-c2c7-408b-b96d-01ffe89129ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:58.243269 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2d781e-c2c7-408b-b96d-01ffe89129ec admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:58.243555 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2d781e-c2c7-408b-b96d-01ffe89129ec admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:58.243822 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2d781e-c2c7-408b-b96d-01ffe89129ec admin admin] PATH_INFO: `/v3/projects/19ec4ffad5874fd6a5d4dfc7341e18f7/users/39da912080c14017bb47bb945060523d/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:58.255020 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4752a6-5d3a-4e5f-b169-8445a9163d53 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:58.269054 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2d781e-c2c7-408b-b96d-01ffe89129ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=19ec4ffad5874fd6a5d4dfc7341e18f7, user_id=39da912080c14017bb47bb945060523d, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:58.273695 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2d781e-c2c7-408b-b96d-01ffe89129ec admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:58.277416 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4752a6-5d3a-4e5f-b169-8445a9163d53 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:58.292655 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7811da-9903-4fd4-98c0-18939ed26a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:58.293350 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7811da-9903-4fd4-98c0-18939ed26a08 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:58.293783 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7811da-9903-4fd4-98c0-18939ed26a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:58.294106 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7811da-9903-4fd4-98c0-18939ed26a08 admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:58.294814 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7811da-9903-4fd4-98c0-18939ed26a08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:58.296778 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7811da-9903-4fd4-98c0-18939ed26a08 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:58.314530 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3310/6582] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:34:58 2022] PUT /identity/v3/projects/19ec4ffad5874fd6a5d4dfc7341e18f7/users/39da912080c14017bb47bb945060523d/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:58.316220 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b0660-f5d8-4c64-8c41-6d6ac0b2bcff None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:58.316594 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b0660-f5d8-4c64-8c41-6d6ac0b2bcff None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:58.316873 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b0660-f5d8-4c64-8c41-6d6ac0b2bcff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:58.356333 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-de7b0660-f5d8-4c64-8c41-6d6ac0b2bcff None None] MFA Rules not processed for user `39da912080c14017bb47bb945060523d`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:34:58.357402 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3273/6583] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:34:58 2022] POST /identity/v3/projects => generated 387 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:34:58.360945 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-de7b0660-f5d8-4c64-8c41-6d6ac0b2bcff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:58.361743 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7811da-9903-4fd4-98c0-18939ed26a08 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:58.471996 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:58.473314 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7811da-9903-4fd4-98c0-18939ed26a08 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:58.482401 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79080dd5-9717-4c79-884c-207f58113cb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:58.483656 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79080dd5-9717-4c79-884c-207f58113cb2 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:58.483999 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79080dd5-9717-4c79-884c-207f58113cb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:58.484334 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79080dd5-9717-4c79-884c-207f58113cb2 admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:58.485105 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79080dd5-9717-4c79-884c-207f58113cb2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:58.487769 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79080dd5-9717-4c79-884c-207f58113cb2 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:58.495408 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3311/6584] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:34:58 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:34:58.507431 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:58.515237 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7b0660-f5d8-4c64-8c41-6d6ac0b2bcff None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:58.518287 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-de7b0660-f5d8-4c64-8c41-6d6ac0b2bcff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:58.546058 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3274/6585] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:34:58 2022] POST /identity/v3/users => generated 294 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:34:58.547798 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79080dd5-9717-4c79-884c-207f58113cb2 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:58.568858 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79080dd5-9717-4c79-884c-207f58113cb2 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:58.580213 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dc44e3-2b9a-4b81-8e76-aad346cf3dc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:58.581106 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dc44e3-2b9a-4b81-8e76-aad346cf3dc8 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:58.581536 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dc44e3-2b9a-4b81-8e76-aad346cf3dc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:58.582037 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dc44e3-2b9a-4b81-8e76-aad346cf3dc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:58.583593 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dc44e3-2b9a-4b81-8e76-aad346cf3dc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:58.585487 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dc44e3-2b9a-4b81-8e76-aad346cf3dc8 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:58.610403 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3275/6586] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:34:58 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:34:58.612233 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dc44e3-2b9a-4b81-8e76-aad346cf3dc8 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:58.638878 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dc44e3-2b9a-4b81-8e76-aad346cf3dc8 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:58.645417 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4b82e3-68fd-4a77-938d-9c7a36cc7e0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:58.646229 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4b82e3-68fd-4a77-938d-9c7a36cc7e0a admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:58.654115 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4b82e3-68fd-4a77-938d-9c7a36cc7e0a admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:58.654608 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4b82e3-68fd-4a77-938d-9c7a36cc7e0a admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:58.658404 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4b82e3-68fd-4a77-938d-9c7a36cc7e0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:58.663666 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4b82e3-68fd-4a77-938d-9c7a36cc7e0a admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:58.668307 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7b0660-f5d8-4c64-8c41-6d6ac0b2bcff None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:58.678490 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff2bae3-6105-449e-86b9-4690c008e0f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:58.679176 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff2bae3-6105-449e-86b9-4690c008e0f7 service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:58.679428 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff2bae3-6105-449e-86b9-4690c008e0f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:58.679704 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff2bae3-6105-449e-86b9-4690c008e0f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:58.688448 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3276/6587] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:34:58 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:34:58.689342 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff2bae3-6105-449e-86b9-4690c008e0f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:58.690862 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff2bae3-6105-449e-86b9-4690c008e0f7 service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:58.693928 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4b82e3-68fd-4a77-938d-9c7a36cc7e0a admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:58.700974 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3312/6588] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:34:58 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:34:58.705818 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4b82e3-68fd-4a77-938d-9c7a36cc7e0a admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:58.711164 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589c2fd0-e9a3-426f-b936-ebff6a208dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:58.712111 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589c2fd0-e9a3-426f-b936-ebff6a208dd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:58.712389 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589c2fd0-e9a3-426f-b936-ebff6a208dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:58.712800 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589c2fd0-e9a3-426f-b936-ebff6a208dd1 admin admin] PATH_INFO: `/v3/projects/3248ad7c57bd4f779d2bce9e0d5b7710/users/1ded30ce40eb4e6b84433540ab3ddcfb/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:58.736094 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589c2fd0-e9a3-426f-b936-ebff6a208dd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3248ad7c57bd4f779d2bce9e0d5b7710, user_id=1ded30ce40eb4e6b84433540ab3ddcfb, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:58.739035 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589c2fd0-e9a3-426f-b936-ebff6a208dd1 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:58.752601 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff2bae3-6105-449e-86b9-4690c008e0f7 service neutron] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:58.760078 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3277/6589] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:34:58 2022] PUT /identity/v3/projects/3248ad7c57bd4f779d2bce9e0d5b7710/users/1ded30ce40eb4e6b84433540ab3ddcfb/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:58.774240 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff2bae3-6105-449e-86b9-4690c008e0f7 service neutron] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:58.776715 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3a2590-2bf3-44d2-a425-91d91bf53fe2 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:58.777102 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3a2590-2bf3-44d2-a425-91d91bf53fe2 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:58.777686 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3a2590-2bf3-44d2-a425-91d91bf53fe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:58.853818 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-8d3a2590-2bf3-44d2-a425-91d91bf53fe2 None None] MFA Rules not processed for user `1ded30ce40eb4e6b84433540ab3ddcfb`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:34:58.857088 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-8d3a2590-2bf3-44d2-a425-91d91bf53fe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:58.906578 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801c2361-2f7f-4f8f-b096-d6bc50496925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:58.909413 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801c2361-2f7f-4f8f-b096-d6bc50496925 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:58.909812 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801c2361-2f7f-4f8f-b096-d6bc50496925 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:58.910389 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801c2361-2f7f-4f8f-b096-d6bc50496925 admin admin] PATH_INFO: `/v3/users/39da912080c14017bb47bb945060523d` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:58.918741 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801c2361-2f7f-4f8f-b096-d6bc50496925 admin admin] RBAC: Authorizing `identity:delete_user(user_id=39da912080c14017bb47bb945060523d)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:58.918741 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801c2361-2f7f-4f8f-b096-d6bc50496925 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:58.981010 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-801c2361-2f7f-4f8f-b096-d6bc50496925 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39da912080c14017bb47bb945060523d'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:58.981717 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-801c2361-2f7f-4f8f-b096-d6bc50496925 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39da912080c14017bb47bb945060523d'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:58.994969 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-801c2361-2f7f-4f8f-b096-d6bc50496925 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39da912080c14017bb47bb945060523d'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:59.003764 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3278/6590] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:34:58 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:34:59.005071 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3a2590-2bf3-44d2-a425-91d91bf53fe2 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:59.011997 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-801c2361-2f7f-4f8f-b096-d6bc50496925 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39da912080c14017bb47bb945060523d'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:59.028268 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-801c2361-2f7f-4f8f-b096-d6bc50496925 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39da912080c14017bb47bb945060523d'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:34:59.034578 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3a2590-2bf3-44d2-a425-91d91bf53fe2 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:59.037915 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3313/6591] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:34:58 2022] DELETE /identity/v3/users/39da912080c14017bb47bb945060523d => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:34:59.039885 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b24a9a-e276-4c74-8208-88d747c1dee8 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:59.040172 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b24a9a-e276-4c74-8208-88d747c1dee8 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:59.043544 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b24a9a-e276-4c74-8208-88d747c1dee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:59.077313 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-a9b24a9a-e276-4c74-8208-88d747c1dee8 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:34:59.078620 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-a9b24a9a-e276-4c74-8208-88d747c1dee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:59.085832 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:59.152873 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf99d07-728f-4f88-8afb-b5887ac8ef1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:59.154244 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf99d07-728f-4f88-8afb-b5887ac8ef1c admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:59.154658 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf99d07-728f-4f88-8afb-b5887ac8ef1c admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:59.154941 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf99d07-728f-4f88-8afb-b5887ac8ef1c admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:59.156063 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf99d07-728f-4f88-8afb-b5887ac8ef1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:59.158896 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf99d07-728f-4f88-8afb-b5887ac8ef1c admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:59.177346 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3314/6592] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:34:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:34:59.184797 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b24a9a-e276-4c74-8208-88d747c1dee8 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:59.186593 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-a9b24a9a-e276-4c74-8208-88d747c1dee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:59.206735 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3279/6593] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:34:59 2022] POST /identity/v3/projects => generated 385 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:34:59.208422 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf99d07-728f-4f88-8afb-b5887ac8ef1c admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:59.210891 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-baf99d07-728f-4f88-8afb-b5887ac8ef1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:59.252347 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:59.283450 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b24a9a-e276-4c74-8208-88d747c1dee8 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:59.307558 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf99d07-728f-4f88-8afb-b5887ac8ef1c admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:59.315369 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb76c315-579f-4c84-80da-9b13951d99ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:59.316506 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb76c315-579f-4c84-80da-9b13951d99ec admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:59.317138 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb76c315-579f-4c84-80da-9b13951d99ec admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:59.317427 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb76c315-579f-4c84-80da-9b13951d99ec admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:59.318436 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb76c315-579f-4c84-80da-9b13951d99ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:59.320494 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb76c315-579f-4c84-80da-9b13951d99ec admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:59.336725 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7457a11b-996c-44ca-829f-1db673252dd5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:59.337429 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7457a11b-996c-44ca-829f-1db673252dd5 service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:59.337729 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7457a11b-996c-44ca-829f-1db673252dd5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:59.337995 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7457a11b-996c-44ca-829f-1db673252dd5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:59.358221 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3280/6594] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:34:59 2022] POST /identity/v3/users => generated 299 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:34:59.358436 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7457a11b-996c-44ca-829f-1db673252dd5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:59.358436 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7457a11b-996c-44ca-829f-1db673252dd5 service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:59.359834 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb76c315-579f-4c84-80da-9b13951d99ec admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:59.371443 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb76c315-579f-4c84-80da-9b13951d99ec admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:59.373431 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3315/6595] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:34:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:34:59.376436 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5160118-1af8-405e-abc4-373e0f65d967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:59.377106 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5160118-1af8-405e-abc4-373e0f65d967 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:59.377515 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5160118-1af8-405e-abc4-373e0f65d967 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:59.377798 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5160118-1af8-405e-abc4-373e0f65d967 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:59.378689 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5160118-1af8-405e-abc4-373e0f65d967 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:59.381067 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5160118-1af8-405e-abc4-373e0f65d967 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:59.391991 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3281/6596] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:34:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:34:59.396419 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7457a11b-996c-44ca-829f-1db673252dd5 service neutron] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:59.407406 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7457a11b-996c-44ca-829f-1db673252dd5 service neutron] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:59.413731 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd88982-c327-46c6-8bf4-47d274cfd5d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:59.414688 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd88982-c327-46c6-8bf4-47d274cfd5d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:59.415007 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd88982-c327-46c6-8bf4-47d274cfd5d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:59.415259 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd88982-c327-46c6-8bf4-47d274cfd5d5 admin admin] PATH_INFO: `/v3/projects/fd1bcea117aa41569f6119c2358b902d/users/0a91aeb594a848dba2f203ac3bcfdf5f/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:59.432742 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd88982-c327-46c6-8bf4-47d274cfd5d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd1bcea117aa41569f6119c2358b902d, user_id=0a91aeb594a848dba2f203ac3bcfdf5f, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:59.435608 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd88982-c327-46c6-8bf4-47d274cfd5d5 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:59.452806 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3316/6597] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:34:59 2022] PUT /identity/v3/projects/fd1bcea117aa41569f6119c2358b902d/users/0a91aeb594a848dba2f203ac3bcfdf5f/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:34:59.457551 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5160118-1af8-405e-abc4-373e0f65d967 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:59.471900 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5160118-1af8-405e-abc4-373e0f65d967 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:59.537019 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3f6be0-5497-4726-90ed-e6d4f568559f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:59.537701 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3f6be0-5497-4726-90ed-e6d4f568559f admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:59.538022 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3f6be0-5497-4726-90ed-e6d4f568559f admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:59.538414 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3f6be0-5497-4726-90ed-e6d4f568559f admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:59.539168 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3f6be0-5497-4726-90ed-e6d4f568559f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:59.540778 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3f6be0-5497-4726-90ed-e6d4f568559f admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:59.556444 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3282/6598] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:34:59 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:34:59.558055 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd88982-c327-46c6-8bf4-47d274cfd5d5 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:59.569451 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd88982-c327-46c6-8bf4-47d274cfd5d5 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:59.574547 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4302ea-b82b-44b9-add1-7c3202d705be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:59.575456 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4302ea-b82b-44b9-add1-7c3202d705be admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:59.575736 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4302ea-b82b-44b9-add1-7c3202d705be admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:59.576007 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4302ea-b82b-44b9-add1-7c3202d705be admin admin] PATH_INFO: `/v3/projects/fd1bcea117aa41569f6119c2358b902d/users/0a91aeb594a848dba2f203ac3bcfdf5f/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:59.578088 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4302ea-b82b-44b9-add1-7c3202d705be admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd1bcea117aa41569f6119c2358b902d, user_id=0a91aeb594a848dba2f203ac3bcfdf5f, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:59.580949 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4302ea-b82b-44b9-add1-7c3202d705be admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:59.597961 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3317/6599] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:34:59 2022] PUT /identity/v3/projects/fd1bcea117aa41569f6119c2358b902d/users/0a91aeb594a848dba2f203ac3bcfdf5f/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:34:59.604665 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3afda0-a3ee-4f04-877b-b658985b3eab None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:59.604978 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3afda0-a3ee-4f04-877b-b658985b3eab None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:59.605218 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3afda0-a3ee-4f04-877b-b658985b3eab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:59.662507 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-cc3afda0-a3ee-4f04-877b-b658985b3eab None None] MFA Rules not processed for user `0a91aeb594a848dba2f203ac3bcfdf5f`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:34:59.664006 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-cc3afda0-a3ee-4f04-877b-b658985b3eab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:59.874364 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3283/6600] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:34:59 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:34:59.874573 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4302ea-b82b-44b9-add1-7c3202d705be admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:59.898686 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4302ea-b82b-44b9-add1-7c3202d705be admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:34:59.907325 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1501e381-bb62-47a8-9e65-53ef7baffac4 tempest-EndpointsNegativeTestJSON-474721284 tempest-EndpointsNegativeTestJSON-474721284-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a91aeb594a848dba2f203ac3bcfdf5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd1bcea117aa41569f6119c2358b902d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:34:59.908012 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1501e381-bb62-47a8-9e65-53ef7baffac4 tempest-EndpointsNegativeTestJSON-474721284 tempest-EndpointsNegativeTestJSON-474721284-project-admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:34:59.908291 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1501e381-bb62-47a8-9e65-53ef7baffac4 tempest-EndpointsNegativeTestJSON-474721284 tempest-EndpointsNegativeTestJSON-474721284-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:34:59.908569 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1501e381-bb62-47a8-9e65-53ef7baffac4 tempest-EndpointsNegativeTestJSON-474721284 tempest-EndpointsNegativeTestJSON-474721284-project-admin] PATH_INFO: `/v3/services` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:34:59.909290 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1501e381-bb62-47a8-9e65-53ef7baffac4 tempest-EndpointsNegativeTestJSON-474721284 tempest-EndpointsNegativeTestJSON-474721284-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:34:59.914570 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1501e381-bb62-47a8-9e65-53ef7baffac4 tempest-EndpointsNegativeTestJSON-474721284 tempest-EndpointsNegativeTestJSON-474721284-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:34:59.914730 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3afda0-a3ee-4f04-877b-b658985b3eab None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:59.915897 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-cc3afda0-a3ee-4f04-877b-b658985b3eab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:34:59.947090 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3318/6601] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:34:59 2022] POST /identity/v3/services => generated 289 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:34:59.953473 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1501e381-bb62-47a8-9e65-53ef7baffac4 tempest-EndpointsNegativeTestJSON-474721284 tempest-EndpointsNegativeTestJSON-474721284-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:34:59.966459 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:59.997262 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1501e381-bb62-47a8-9e65-53ef7baffac4 tempest-EndpointsNegativeTestJSON-474721284 tempest-EndpointsNegativeTestJSON-474721284-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:00.015279 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fb45e4-2073-469d-843c-19d096ee40da tempest-EndpointsNegativeTestJSON-474721284 tempest-EndpointsNegativeTestJSON-474721284-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a91aeb594a848dba2f203ac3bcfdf5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd1bcea117aa41569f6119c2358b902d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:00.015996 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fb45e4-2073-469d-843c-19d096ee40da tempest-EndpointsNegativeTestJSON-474721284 tempest-EndpointsNegativeTestJSON-474721284-project-admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:00.016432 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fb45e4-2073-469d-843c-19d096ee40da tempest-EndpointsNegativeTestJSON-474721284 tempest-EndpointsNegativeTestJSON-474721284-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:00.016715 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fb45e4-2073-469d-843c-19d096ee40da tempest-EndpointsNegativeTestJSON-474721284 tempest-EndpointsNegativeTestJSON-474721284-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:00.017476 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fb45e4-2073-469d-843c-19d096ee40da tempest-EndpointsNegativeTestJSON-474721284 tempest-EndpointsNegativeTestJSON-474721284-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:00.018576 ncdv-master-1 devstack@keystone.service[91548]: WARNING py.warnings [None req-d8fb45e4-2073-469d-843c-19d096ee40da tempest-EndpointsNegativeTestJSON-474721284 tempest-EndpointsNegativeTestJSON-474721284-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:35:00.018576 ncdv-master-1 devstack@keystone.service[91548]: warnings.warn(msg) Jul 23 21:35:00.018576 ncdv-master-1 devstack@keystone.service[91548]: Jul 23 21:35:00.019959 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fb45e4-2073-469d-843c-19d096ee40da tempest-EndpointsNegativeTestJSON-474721284 tempest-EndpointsNegativeTestJSON-474721284-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:00.034920 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-d8fb45e4-2073-469d-843c-19d096ee40da tempest-EndpointsNegativeTestJSON-474721284 tempest-EndpointsNegativeTestJSON-474721284-project-admin] Invalid input for field 'enabled': 'False' is not of type 'boolean' Jul 23 21:35:00.034920 ncdv-master-1 devstack@keystone.service[91548]: Failed validating 'type' in schema['properties']['enabled']: Jul 23 21:35:00.034920 ncdv-master-1 devstack@keystone.service[91548]: {'enum': [True, False, None], 'type': 'boolean'} Jul 23 21:35:00.034920 ncdv-master-1 devstack@keystone.service[91548]: On instance['enabled']: Jul 23 21:35:00.034920 ncdv-master-1 devstack@keystone.service[91548]: 'False': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Jul 23 21:35:00.034920 ncdv-master-1 devstack@keystone.service[91548]: Failed validating 'type' in schema['properties']['enabled']: Jul 23 21:35:00.034920 ncdv-master-1 devstack@keystone.service[91548]: {'enum': [True, False, None], 'type': 'boolean'} Jul 23 21:35:00.034920 ncdv-master-1 devstack@keystone.service[91548]: On instance['enabled']: Jul 23 21:35:00.034920 ncdv-master-1 devstack@keystone.service[91548]: 'False' Jul 23 21:35:00.034920 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 21:35:00.034920 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Jul 23 21:35:00.034920 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Jul 23 21:35:00.034920 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 23 21:35:00.034920 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise error Jul 23 21:35:00.034920 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'False' is not of type 'boolean' Jul 23 21:35:00.034920 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 21:35:00.034920 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Jul 23 21:35:00.034920 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Jul 23 21:35:00.034920 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 21:35:00.034920 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application On instance['enabled']: Jul 23 21:35:00.034920 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application 'False' Jul 23 21:35:00.034920 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 21:35:00.034920 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 23 21:35:00.037120 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 21:35:00.037120 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 21:35:00.037120 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 21:35:00.037120 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 21:35:00.037120 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 21:35:00.037120 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 21:35:00.037120 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 21:35:00.037120 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 21:35:00.037120 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 21:35:00.037120 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 21:35:00.037120 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 21:35:00.037120 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 21:35:00.037120 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 94, in post Jul 23 21:35:00.037120 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_create, endpoint) Jul 23 21:35:00.037120 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Jul 23 21:35:00.037120 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Jul 23 21:35:00.037120 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Jul 23 21:35:00.038767 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Jul 23 21:35:00.038767 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Jul 23 21:35:00.038767 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 21:35:00.038767 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Jul 23 21:35:00.038767 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Jul 23 21:35:00.038767 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 21:35:00.038767 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application On instance['enabled']: Jul 23 21:35:00.038767 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application 'False' Jul 23 21:35:00.038767 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 21:35:00.038767 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3319/6602] 10.222.0.17 () {60 vars in 1155 bytes} [Sat Jul 23 21:34:59 2022] POST /identity/v3/endpoints => generated 283 bytes in 84 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Jul 23 21:35:00.043151 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fb45e4-2073-469d-843c-19d096ee40da tempest-EndpointsNegativeTestJSON-474721284 tempest-EndpointsNegativeTestJSON-474721284-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:00.057317 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fb45e4-2073-469d-843c-19d096ee40da tempest-EndpointsNegativeTestJSON-474721284 tempest-EndpointsNegativeTestJSON-474721284-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:00.072062 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd47582-6094-42bf-a453-dd96dd82452a tempest-EndpointsNegativeTestJSON-474721284 tempest-EndpointsNegativeTestJSON-474721284-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a91aeb594a848dba2f203ac3bcfdf5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd1bcea117aa41569f6119c2358b902d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:00.072750 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd47582-6094-42bf-a453-dd96dd82452a tempest-EndpointsNegativeTestJSON-474721284 tempest-EndpointsNegativeTestJSON-474721284-project-admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:00.073032 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd47582-6094-42bf-a453-dd96dd82452a tempest-EndpointsNegativeTestJSON-474721284 tempest-EndpointsNegativeTestJSON-474721284-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:00.073304 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd47582-6094-42bf-a453-dd96dd82452a tempest-EndpointsNegativeTestJSON-474721284 tempest-EndpointsNegativeTestJSON-474721284-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:00.074267 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd47582-6094-42bf-a453-dd96dd82452a tempest-EndpointsNegativeTestJSON-474721284 tempest-EndpointsNegativeTestJSON-474721284-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:00.075902 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd47582-6094-42bf-a453-dd96dd82452a tempest-EndpointsNegativeTestJSON-474721284 tempest-EndpointsNegativeTestJSON-474721284-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:00.082713 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-7fd47582-6094-42bf-a453-dd96dd82452a tempest-EndpointsNegativeTestJSON-474721284 tempest-EndpointsNegativeTestJSON-474721284-project-admin] Invalid input for field 'enabled': 'True' is not of type 'boolean' Jul 23 21:35:00.082713 ncdv-master-1 devstack@keystone.service[91548]: Failed validating 'type' in schema['properties']['enabled']: Jul 23 21:35:00.082713 ncdv-master-1 devstack@keystone.service[91548]: {'enum': [True, False, None], 'type': 'boolean'} Jul 23 21:35:00.082713 ncdv-master-1 devstack@keystone.service[91548]: On instance['enabled']: Jul 23 21:35:00.082713 ncdv-master-1 devstack@keystone.service[91548]: 'True': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Jul 23 21:35:00.082713 ncdv-master-1 devstack@keystone.service[91548]: Failed validating 'type' in schema['properties']['enabled']: Jul 23 21:35:00.082713 ncdv-master-1 devstack@keystone.service[91548]: {'enum': [True, False, None], 'type': 'boolean'} Jul 23 21:35:00.082713 ncdv-master-1 devstack@keystone.service[91548]: On instance['enabled']: Jul 23 21:35:00.082713 ncdv-master-1 devstack@keystone.service[91548]: 'True' Jul 23 21:35:00.082713 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 21:35:00.082713 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Jul 23 21:35:00.082713 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Jul 23 21:35:00.082713 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 23 21:35:00.082713 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise error Jul 23 21:35:00.082713 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'True' is not of type 'boolean' Jul 23 21:35:00.082713 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 21:35:00.082713 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Jul 23 21:35:00.082713 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Jul 23 21:35:00.082713 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 21:35:00.082713 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application On instance['enabled']: Jul 23 21:35:00.082713 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application 'True' Jul 23 21:35:00.082713 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 21:35:00.082713 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 23 21:35:00.084761 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 21:35:00.084761 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 21:35:00.084761 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 21:35:00.084761 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 21:35:00.084761 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 21:35:00.084761 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 21:35:00.084761 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 21:35:00.084761 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 21:35:00.084761 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 21:35:00.084761 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 21:35:00.084761 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 21:35:00.084761 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 21:35:00.084761 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 94, in post Jul 23 21:35:00.084761 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_create, endpoint) Jul 23 21:35:00.084761 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Jul 23 21:35:00.084761 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Jul 23 21:35:00.084761 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Jul 23 21:35:00.085824 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Jul 23 21:35:00.085824 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Jul 23 21:35:00.085824 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 21:35:00.085824 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Jul 23 21:35:00.085824 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Jul 23 21:35:00.085824 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 21:35:00.085824 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application On instance['enabled']: Jul 23 21:35:00.085824 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application 'True' Jul 23 21:35:00.085824 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 21:35:00.085824 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3320/6603] 10.222.0.17 () {60 vars in 1155 bytes} [Sat Jul 23 21:35:00 2022] POST /identity/v3/endpoints => generated 281 bytes in 41 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Jul 23 21:35:00.088535 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd47582-6094-42bf-a453-dd96dd82452a tempest-EndpointsNegativeTestJSON-474721284 tempest-EndpointsNegativeTestJSON-474721284-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:00.093176 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3afda0-a3ee-4f04-877b-b658985b3eab None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:00.095582 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:35:00.111077 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd47582-6094-42bf-a453-dd96dd82452a tempest-EndpointsNegativeTestJSON-474721284 tempest-EndpointsNegativeTestJSON-474721284-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:00.125558 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab20bd3-cbfc-41b2-9148-c17ef0af3fa2 tempest-EndpointsNegativeTestJSON-474721284 tempest-EndpointsNegativeTestJSON-474721284-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a91aeb594a848dba2f203ac3bcfdf5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd1bcea117aa41569f6119c2358b902d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:00.133040 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab20bd3-cbfc-41b2-9148-c17ef0af3fa2 tempest-EndpointsNegativeTestJSON-474721284 tempest-EndpointsNegativeTestJSON-474721284-project-admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:00.133335 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab20bd3-cbfc-41b2-9148-c17ef0af3fa2 tempest-EndpointsNegativeTestJSON-474721284 tempest-EndpointsNegativeTestJSON-474721284-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:00.134963 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab20bd3-cbfc-41b2-9148-c17ef0af3fa2 tempest-EndpointsNegativeTestJSON-474721284 tempest-EndpointsNegativeTestJSON-474721284-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:00.135942 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab20bd3-cbfc-41b2-9148-c17ef0af3fa2 tempest-EndpointsNegativeTestJSON-474721284 tempest-EndpointsNegativeTestJSON-474721284-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:00.136288 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6fff8a-1854-4047-8f8f-9eb439aea26a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:00.137212 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6fff8a-1854-4047-8f8f-9eb439aea26a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:00.137494 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6fff8a-1854-4047-8f8f-9eb439aea26a admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:00.137612 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab20bd3-cbfc-41b2-9148-c17ef0af3fa2 tempest-EndpointsNegativeTestJSON-474721284 tempest-EndpointsNegativeTestJSON-474721284-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:00.137817 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6fff8a-1854-4047-8f8f-9eb439aea26a admin admin] PATH_INFO: `/v3/users/0f975865c7f3476e98d9de6ca7549634` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:00.139196 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6fff8a-1854-4047-8f8f-9eb439aea26a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f975865c7f3476e98d9de6ca7549634)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:00.141200 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6fff8a-1854-4047-8f8f-9eb439aea26a admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:00.162173 ncdv-master-1 devstack@keystone.service[91548]: WARNING py.warnings [None req-cab20bd3-cbfc-41b2-9148-c17ef0af3fa2 tempest-EndpointsNegativeTestJSON-474721284 tempest-EndpointsNegativeTestJSON-474721284-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-147807378. To ensure interoperability, identifiers should be a valid uuid. Jul 23 21:35:00.162173 ncdv-master-1 devstack@keystone.service[91548]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Jul 23 21:35:00.162173 ncdv-master-1 devstack@keystone.service[91548]: Jul 23 21:35:00.205660 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3321/6604] 10.222.0.17 () {60 vars in 1155 bytes} [Sat Jul 23 21:35:00 2022] POST /identity/v3/endpoints => generated 356 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:35:00.207023 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab20bd3-cbfc-41b2-9148-c17ef0af3fa2 tempest-EndpointsNegativeTestJSON-474721284 tempest-EndpointsNegativeTestJSON-474721284-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:00.217580 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-bc6fff8a-1854-4047-8f8f-9eb439aea26a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f975865c7f3476e98d9de6ca7549634'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:00.226067 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-bc6fff8a-1854-4047-8f8f-9eb439aea26a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f975865c7f3476e98d9de6ca7549634'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:00.227436 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-bc6fff8a-1854-4047-8f8f-9eb439aea26a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f975865c7f3476e98d9de6ca7549634'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:00.242074 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-bc6fff8a-1854-4047-8f8f-9eb439aea26a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f975865c7f3476e98d9de6ca7549634'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:00.245419 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab20bd3-cbfc-41b2-9148-c17ef0af3fa2 tempest-EndpointsNegativeTestJSON-474721284 tempest-EndpointsNegativeTestJSON-474721284-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:00.251800 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7441235-3d76-4cfd-8569-8146271728c1 tempest-EndpointsNegativeTestJSON-474721284 tempest-EndpointsNegativeTestJSON-474721284-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a91aeb594a848dba2f203ac3bcfdf5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd1bcea117aa41569f6119c2358b902d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:00.253333 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7441235-3d76-4cfd-8569-8146271728c1 tempest-EndpointsNegativeTestJSON-474721284 tempest-EndpointsNegativeTestJSON-474721284-project-admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:00.253621 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7441235-3d76-4cfd-8569-8146271728c1 tempest-EndpointsNegativeTestJSON-474721284 tempest-EndpointsNegativeTestJSON-474721284-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:00.254698 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7441235-3d76-4cfd-8569-8146271728c1 tempest-EndpointsNegativeTestJSON-474721284 tempest-EndpointsNegativeTestJSON-474721284-project-admin] PATH_INFO: `/v3/regions/tempest-region-147807378` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:00.255313 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7441235-3d76-4cfd-8569-8146271728c1 tempest-EndpointsNegativeTestJSON-474721284 tempest-EndpointsNegativeTestJSON-474721284-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-147807378)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:00.256398 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7441235-3d76-4cfd-8569-8146271728c1 tempest-EndpointsNegativeTestJSON-474721284 tempest-EndpointsNegativeTestJSON-474721284-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:00.258904 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3322/6605] 10.222.0.17 () {58 vars in 1202 bytes} [Sat Jul 23 21:35:00 2022] GET /identity/v3/regions/tempest-region-147807378 => generated 178 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:35:00.262752 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7441235-3d76-4cfd-8569-8146271728c1 tempest-EndpointsNegativeTestJSON-474721284 tempest-EndpointsNegativeTestJSON-474721284-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:00.275129 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7441235-3d76-4cfd-8569-8146271728c1 tempest-EndpointsNegativeTestJSON-474721284 tempest-EndpointsNegativeTestJSON-474721284-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:00.275899 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-bc6fff8a-1854-4047-8f8f-9eb439aea26a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f975865c7f3476e98d9de6ca7549634'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:00.281260 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187db5bc-75c7-449a-aedd-c7ce3f8047c6 tempest-EndpointsNegativeTestJSON-474721284 tempest-EndpointsNegativeTestJSON-474721284-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a91aeb594a848dba2f203ac3bcfdf5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd1bcea117aa41569f6119c2358b902d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:00.282333 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187db5bc-75c7-449a-aedd-c7ce3f8047c6 tempest-EndpointsNegativeTestJSON-474721284 tempest-EndpointsNegativeTestJSON-474721284-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:00.283098 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187db5bc-75c7-449a-aedd-c7ce3f8047c6 tempest-EndpointsNegativeTestJSON-474721284 tempest-EndpointsNegativeTestJSON-474721284-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:00.283389 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187db5bc-75c7-449a-aedd-c7ce3f8047c6 tempest-EndpointsNegativeTestJSON-474721284 tempest-EndpointsNegativeTestJSON-474721284-project-admin] PATH_INFO: `/v3/endpoints/618024b1bb7a4cfabff61eb8faf0478b` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:00.295307 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187db5bc-75c7-449a-aedd-c7ce3f8047c6 tempest-EndpointsNegativeTestJSON-474721284 tempest-EndpointsNegativeTestJSON-474721284-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=618024b1bb7a4cfabff61eb8faf0478b)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:00.295307 ncdv-master-1 devstack@keystone.service[91548]: WARNING py.warnings [None req-187db5bc-75c7-449a-aedd-c7ce3f8047c6 tempest-EndpointsNegativeTestJSON-474721284 tempest-EndpointsNegativeTestJSON-474721284-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:35:00.295307 ncdv-master-1 devstack@keystone.service[91548]: warnings.warn(msg) Jul 23 21:35:00.295307 ncdv-master-1 devstack@keystone.service[91548]: Jul 23 21:35:00.295757 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187db5bc-75c7-449a-aedd-c7ce3f8047c6 tempest-EndpointsNegativeTestJSON-474721284 tempest-EndpointsNegativeTestJSON-474721284-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:00.296370 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3284/6606] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:34:59 2022] DELETE /identity/v3/users/0f975865c7f3476e98d9de6ca7549634 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:35:00.298456 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de95f213-de38-4288-9c9d-1f5612cf4c53 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:00.299397 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de95f213-de38-4288-9c9d-1f5612cf4c53 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:00.299959 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de95f213-de38-4288-9c9d-1f5612cf4c53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:00.307513 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-187db5bc-75c7-449a-aedd-c7ce3f8047c6 tempest-EndpointsNegativeTestJSON-474721284 tempest-EndpointsNegativeTestJSON-474721284-project-admin] Invalid input for field 'enabled': 'False' is not of type 'boolean' Jul 23 21:35:00.307513 ncdv-master-1 devstack@keystone.service[91548]: Failed validating 'type' in schema['properties']['enabled']: Jul 23 21:35:00.307513 ncdv-master-1 devstack@keystone.service[91548]: {'enum': [True, False, None], 'type': 'boolean'} Jul 23 21:35:00.307513 ncdv-master-1 devstack@keystone.service[91548]: On instance['enabled']: Jul 23 21:35:00.307513 ncdv-master-1 devstack@keystone.service[91548]: 'False': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Jul 23 21:35:00.307513 ncdv-master-1 devstack@keystone.service[91548]: Failed validating 'type' in schema['properties']['enabled']: Jul 23 21:35:00.307513 ncdv-master-1 devstack@keystone.service[91548]: {'enum': [True, False, None], 'type': 'boolean'} Jul 23 21:35:00.307513 ncdv-master-1 devstack@keystone.service[91548]: On instance['enabled']: Jul 23 21:35:00.307513 ncdv-master-1 devstack@keystone.service[91548]: 'False' Jul 23 21:35:00.307513 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 21:35:00.307513 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Jul 23 21:35:00.307513 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Jul 23 21:35:00.307513 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 23 21:35:00.307513 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise error Jul 23 21:35:00.307513 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'False' is not of type 'boolean' Jul 23 21:35:00.307513 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 21:35:00.307513 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Jul 23 21:35:00.307513 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Jul 23 21:35:00.307513 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 21:35:00.307513 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application On instance['enabled']: Jul 23 21:35:00.307513 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application 'False' Jul 23 21:35:00.307513 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 21:35:00.307513 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 23 21:35:00.310089 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 21:35:00.310089 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 21:35:00.310089 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 21:35:00.310089 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 21:35:00.310089 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 21:35:00.310089 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 21:35:00.310089 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 21:35:00.310089 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 21:35:00.310089 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 21:35:00.310089 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 21:35:00.310089 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 21:35:00.310089 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 21:35:00.310089 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 105, in patch Jul 23 21:35:00.310089 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_update, endpoint) Jul 23 21:35:00.310089 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Jul 23 21:35:00.310089 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Jul 23 21:35:00.310089 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Jul 23 21:35:00.311291 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Jul 23 21:35:00.311291 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Jul 23 21:35:00.311291 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 21:35:00.311291 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Jul 23 21:35:00.311291 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Jul 23 21:35:00.311291 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 21:35:00.311291 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application On instance['enabled']: Jul 23 21:35:00.311291 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application 'False' Jul 23 21:35:00.311291 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 21:35:00.311291 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3323/6607] 10.222.0.17 () {60 vars in 1254 bytes} [Sat Jul 23 21:35:00 2022] PATCH /identity/v3/endpoints/618024b1bb7a4cfabff61eb8faf0478b => generated 283 bytes in 46 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Jul 23 21:35:00.313484 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187db5bc-75c7-449a-aedd-c7ce3f8047c6 tempest-EndpointsNegativeTestJSON-474721284 tempest-EndpointsNegativeTestJSON-474721284-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:00.315586 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-187db5bc-75c7-449a-aedd-c7ce3f8047c6 tempest-EndpointsNegativeTestJSON-474721284 tempest-EndpointsNegativeTestJSON-474721284-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:00.331351 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187db5bc-75c7-449a-aedd-c7ce3f8047c6 tempest-EndpointsNegativeTestJSON-474721284 tempest-EndpointsNegativeTestJSON-474721284-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:00.337702 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-de95f213-de38-4288-9c9d-1f5612cf4c53 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:35:00.339428 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-de95f213-de38-4288-9c9d-1f5612cf4c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:00.422798 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2946a0-e33d-4549-ac11-39c5e760bc7c tempest-EndpointsNegativeTestJSON-474721284 tempest-EndpointsNegativeTestJSON-474721284-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a91aeb594a848dba2f203ac3bcfdf5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd1bcea117aa41569f6119c2358b902d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:00.424150 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2946a0-e33d-4549-ac11-39c5e760bc7c tempest-EndpointsNegativeTestJSON-474721284 tempest-EndpointsNegativeTestJSON-474721284-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:00.424777 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2946a0-e33d-4549-ac11-39c5e760bc7c tempest-EndpointsNegativeTestJSON-474721284 tempest-EndpointsNegativeTestJSON-474721284-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:00.425287 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2946a0-e33d-4549-ac11-39c5e760bc7c tempest-EndpointsNegativeTestJSON-474721284 tempest-EndpointsNegativeTestJSON-474721284-project-admin] PATH_INFO: `/v3/endpoints/618024b1bb7a4cfabff61eb8faf0478b` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:00.427219 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2946a0-e33d-4549-ac11-39c5e760bc7c tempest-EndpointsNegativeTestJSON-474721284 tempest-EndpointsNegativeTestJSON-474721284-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=618024b1bb7a4cfabff61eb8faf0478b)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:00.428792 ncdv-master-1 devstack@keystone.service[91548]: WARNING py.warnings [None req-da2946a0-e33d-4549-ac11-39c5e760bc7c tempest-EndpointsNegativeTestJSON-474721284 tempest-EndpointsNegativeTestJSON-474721284-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:35:00.428792 ncdv-master-1 devstack@keystone.service[91548]: warnings.warn(msg) Jul 23 21:35:00.428792 ncdv-master-1 devstack@keystone.service[91548]: Jul 23 21:35:00.429673 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2946a0-e33d-4549-ac11-39c5e760bc7c tempest-EndpointsNegativeTestJSON-474721284 tempest-EndpointsNegativeTestJSON-474721284-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:00.437771 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3285/6608] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:35:00 2022] POST /identity/v3/auth/tokens => generated 3540 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:35:00.438704 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de95f213-de38-4288-9c9d-1f5612cf4c53 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:00.443149 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-da2946a0-e33d-4549-ac11-39c5e760bc7c tempest-EndpointsNegativeTestJSON-474721284 tempest-EndpointsNegativeTestJSON-474721284-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '618024b1bb7a4cfabff61eb8faf0478b', 'request_id': 'req-da2946a0-e33d-4549-ac11-39c5e760bc7c'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:00.444911 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-de95f213-de38-4288-9c9d-1f5612cf4c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:00.464225 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3324/6609] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:35:00 2022] DELETE /identity/v3/endpoints/618024b1bb7a4cfabff61eb8faf0478b => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:35:00.465122 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de95f213-de38-4288-9c9d-1f5612cf4c53 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:00.465757 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2946a0-e33d-4549-ac11-39c5e760bc7c tempest-EndpointsNegativeTestJSON-474721284 tempest-EndpointsNegativeTestJSON-474721284-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:00.467606 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-da2946a0-e33d-4549-ac11-39c5e760bc7c tempest-EndpointsNegativeTestJSON-474721284 tempest-EndpointsNegativeTestJSON-474721284-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:00.487740 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d31c8e-e552-42aa-a7c1-6ac22e65bf8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:00.488815 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d31c8e-e552-42aa-a7c1-6ac22e65bf8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:00.489156 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d31c8e-e552-42aa-a7c1-6ac22e65bf8d admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:00.489536 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d31c8e-e552-42aa-a7c1-6ac22e65bf8d admin admin] PATH_INFO: `/v3/projects/19ec4ffad5874fd6a5d4dfc7341e18f7` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:00.492080 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d31c8e-e552-42aa-a7c1-6ac22e65bf8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=19ec4ffad5874fd6a5d4dfc7341e18f7)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:00.494874 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d31c8e-e552-42aa-a7c1-6ac22e65bf8d admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:00.509587 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:35:00.559717 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2946a0-e33d-4549-ac11-39c5e760bc7c tempest-EndpointsNegativeTestJSON-474721284 tempest-EndpointsNegativeTestJSON-474721284-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:00.568561 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-62d31c8e-e552-42aa-a7c1-6ac22e65bf8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19ec4ffad5874fd6a5d4dfc7341e18f7', 'request_id': 'req-62d31c8e-e552-42aa-a7c1-6ac22e65bf8d'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:00.580735 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-62d31c8e-e552-42aa-a7c1-6ac22e65bf8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19ec4ffad5874fd6a5d4dfc7341e18f7', 'request_id': 'req-62d31c8e-e552-42aa-a7c1-6ac22e65bf8d'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:00.589374 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-62d31c8e-e552-42aa-a7c1-6ac22e65bf8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19ec4ffad5874fd6a5d4dfc7341e18f7', 'request_id': 'req-62d31c8e-e552-42aa-a7c1-6ac22e65bf8d'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:00.603225 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-62d31c8e-e552-42aa-a7c1-6ac22e65bf8d admin admin] The token cache is being invalidate because project 19ec4ffad5874fd6a5d4dfc7341e18f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:35:00.603651 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-62d31c8e-e552-42aa-a7c1-6ac22e65bf8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:00.604489 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-62d31c8e-e552-42aa-a7c1-6ac22e65bf8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:00.610095 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3286/6610] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:35:00 2022] DELETE /identity/v3/projects/19ec4ffad5874fd6a5d4dfc7341e18f7 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:35:00.611415 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d31c8e-e552-42aa-a7c1-6ac22e65bf8d admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:00.612926 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-62d31c8e-e552-42aa-a7c1-6ac22e65bf8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:00.615960 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:35:00.641480 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caae7376-2821-42f7-970a-d7d6f5436bfe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:00.642626 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caae7376-2821-42f7-970a-d7d6f5436bfe service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:00.644964 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caae7376-2821-42f7-970a-d7d6f5436bfe service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:00.645648 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caae7376-2821-42f7-970a-d7d6f5436bfe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:00.648110 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-caae7376-2821-42f7-970a-d7d6f5436bfe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:00.734185 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d31c8e-e552-42aa-a7c1-6ac22e65bf8d admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:00.740241 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91f63d5-f8f3-443b-93ff-3a241ccc5977 tempest-EndpointsNegativeTestJSON-474721284 tempest-EndpointsNegativeTestJSON-474721284-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a91aeb594a848dba2f203ac3bcfdf5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd1bcea117aa41569f6119c2358b902d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:00.741480 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91f63d5-f8f3-443b-93ff-3a241ccc5977 tempest-EndpointsNegativeTestJSON-474721284 tempest-EndpointsNegativeTestJSON-474721284-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:00.742017 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91f63d5-f8f3-443b-93ff-3a241ccc5977 tempest-EndpointsNegativeTestJSON-474721284 tempest-EndpointsNegativeTestJSON-474721284-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:00.742678 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91f63d5-f8f3-443b-93ff-3a241ccc5977 tempest-EndpointsNegativeTestJSON-474721284 tempest-EndpointsNegativeTestJSON-474721284-project-admin] PATH_INFO: `/v3/regions/tempest-region-147807378` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:00.743590 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91f63d5-f8f3-443b-93ff-3a241ccc5977 tempest-EndpointsNegativeTestJSON-474721284 tempest-EndpointsNegativeTestJSON-474721284-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-147807378)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:00.745514 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91f63d5-f8f3-443b-93ff-3a241ccc5977 tempest-EndpointsNegativeTestJSON-474721284 tempest-EndpointsNegativeTestJSON-474721284-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:00.751686 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caae7376-2821-42f7-970a-d7d6f5436bfe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:00.753928 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caae7376-2821-42f7-970a-d7d6f5436bfe service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:00.765734 ncdv-master-1 devstack@keystone.service[91547]: WARNING py.warnings [None req-b91f63d5-f8f3-443b-93ff-3a241ccc5977 tempest-EndpointsNegativeTestJSON-474721284 tempest-EndpointsNegativeTestJSON-474721284-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-147807378. To ensure interoperability, identifiers should be a valid uuid. Jul 23 21:35:00.765734 ncdv-master-1 devstack@keystone.service[91547]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Jul 23 21:35:00.765734 ncdv-master-1 devstack@keystone.service[91547]: Jul 23 21:35:00.769807 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3325/6611] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:35:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:35:00.771466 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007850b6-34db-482e-a666-c32dd271b176 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:00.771953 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007850b6-34db-482e-a666-c32dd271b176 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:00.772424 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007850b6-34db-482e-a666-c32dd271b176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:00.778490 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3287/6612] 10.222.0.17 () {58 vars in 1205 bytes} [Sat Jul 23 21:35:00 2022] DELETE /identity/v3/regions/tempest-region-147807378 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:35:00.779888 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91f63d5-f8f3-443b-93ff-3a241ccc5977 tempest-EndpointsNegativeTestJSON-474721284 tempest-EndpointsNegativeTestJSON-474721284-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:00.799611 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-007850b6-34db-482e-a666-c32dd271b176 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:35:00.801342 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-007850b6-34db-482e-a666-c32dd271b176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:00.807475 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91f63d5-f8f3-443b-93ff-3a241ccc5977 tempest-EndpointsNegativeTestJSON-474721284 tempest-EndpointsNegativeTestJSON-474721284-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:00.813201 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ae1d37-c8ba-4bfd-9eb9-b9640a53abc2 tempest-EndpointsNegativeTestJSON-474721284 tempest-EndpointsNegativeTestJSON-474721284-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a91aeb594a848dba2f203ac3bcfdf5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd1bcea117aa41569f6119c2358b902d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:00.814249 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ae1d37-c8ba-4bfd-9eb9-b9640a53abc2 tempest-EndpointsNegativeTestJSON-474721284 tempest-EndpointsNegativeTestJSON-474721284-project-admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:00.814691 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ae1d37-c8ba-4bfd-9eb9-b9640a53abc2 tempest-EndpointsNegativeTestJSON-474721284 tempest-EndpointsNegativeTestJSON-474721284-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:00.815032 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ae1d37-c8ba-4bfd-9eb9-b9640a53abc2 tempest-EndpointsNegativeTestJSON-474721284 tempest-EndpointsNegativeTestJSON-474721284-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:00.815973 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ae1d37-c8ba-4bfd-9eb9-b9640a53abc2 tempest-EndpointsNegativeTestJSON-474721284 tempest-EndpointsNegativeTestJSON-474721284-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:00.817819 ncdv-master-1 devstack@keystone.service[91547]: WARNING py.warnings [None req-d1ae1d37-c8ba-4bfd-9eb9-b9640a53abc2 tempest-EndpointsNegativeTestJSON-474721284 tempest-EndpointsNegativeTestJSON-474721284-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:35:00.817819 ncdv-master-1 devstack@keystone.service[91547]: warnings.warn(msg) Jul 23 21:35:00.817819 ncdv-master-1 devstack@keystone.service[91547]: Jul 23 21:35:00.819093 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ae1d37-c8ba-4bfd-9eb9-b9640a53abc2 tempest-EndpointsNegativeTestJSON-474721284 tempest-EndpointsNegativeTestJSON-474721284-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:00.841692 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3326/6613] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:35:00 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:35:00.842950 ncdv-master-1 devstack@keystone.service[91547]: WARNING py.warnings [None req-d1ae1d37-c8ba-4bfd-9eb9-b9640a53abc2 tempest-EndpointsNegativeTestJSON-474721284 tempest-EndpointsNegativeTestJSON-474721284-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-182486438. To ensure interoperability, identifiers should be a valid uuid. Jul 23 21:35:00.842950 ncdv-master-1 devstack@keystone.service[91547]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Jul 23 21:35:00.842950 ncdv-master-1 devstack@keystone.service[91547]: Jul 23 21:35:00.851667 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bce0d4-b9b4-4994-840c-49eafeff83f8 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:00.852413 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bce0d4-b9b4-4994-840c-49eafeff83f8 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:00.853116 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bce0d4-b9b4-4994-840c-49eafeff83f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:00.879569 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-44bce0d4-b9b4-4994-840c-49eafeff83f8 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:35:00.880789 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-44bce0d4-b9b4-4994-840c-49eafeff83f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:00.884004 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3288/6614] 10.222.0.17 () {60 vars in 1155 bytes} [Sat Jul 23 21:35:00 2022] POST /identity/v3/endpoints => generated 358 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:35:00.889071 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ae1d37-c8ba-4bfd-9eb9-b9640a53abc2 tempest-EndpointsNegativeTestJSON-474721284 tempest-EndpointsNegativeTestJSON-474721284-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:00.908657 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3327/6615] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:35:00 2022] POST /identity/v3/auth/tokens => generated 3542 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:35:00.913289 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bce0d4-b9b4-4994-840c-49eafeff83f8 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:00.925167 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bce0d4-b9b4-4994-840c-49eafeff83f8 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:00.932126 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd32b52-0b26-47ee-bf21-f5be63755aca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:00.933167 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd32b52-0b26-47ee-bf21-f5be63755aca admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:00.933674 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd32b52-0b26-47ee-bf21-f5be63755aca admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:00.934122 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd32b52-0b26-47ee-bf21-f5be63755aca admin admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:00.935047 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd32b52-0b26-47ee-bf21-f5be63755aca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:35:00.935424 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd32b52-0b26-47ee-bf21-f5be63755aca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:00.935697 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ae1d37-c8ba-4bfd-9eb9-b9640a53abc2 tempest-EndpointsNegativeTestJSON-474721284 tempest-EndpointsNegativeTestJSON-474721284-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:00.939053 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd32b52-0b26-47ee-bf21-f5be63755aca admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:00.942559 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4220a65b-9903-414b-95ca-59023daeac10 tempest-EndpointsNegativeTestJSON-474721284 tempest-EndpointsNegativeTestJSON-474721284-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a91aeb594a848dba2f203ac3bcfdf5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd1bcea117aa41569f6119c2358b902d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:00.943733 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4220a65b-9903-414b-95ca-59023daeac10 tempest-EndpointsNegativeTestJSON-474721284 tempest-EndpointsNegativeTestJSON-474721284-project-admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:00.944203 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4220a65b-9903-414b-95ca-59023daeac10 tempest-EndpointsNegativeTestJSON-474721284 tempest-EndpointsNegativeTestJSON-474721284-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:00.944743 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4220a65b-9903-414b-95ca-59023daeac10 tempest-EndpointsNegativeTestJSON-474721284 tempest-EndpointsNegativeTestJSON-474721284-project-admin] PATH_INFO: `/v3/regions/tempest-region-182486438` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:00.946752 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4220a65b-9903-414b-95ca-59023daeac10 tempest-EndpointsNegativeTestJSON-474721284 tempest-EndpointsNegativeTestJSON-474721284-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-182486438)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:00.948334 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4220a65b-9903-414b-95ca-59023daeac10 tempest-EndpointsNegativeTestJSON-474721284 tempest-EndpointsNegativeTestJSON-474721284-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:00.950997 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3289/6616] 10.222.0.17 () {58 vars in 1202 bytes} [Sat Jul 23 21:35:00 2022] GET /identity/v3/regions/tempest-region-182486438 => generated 178 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:35:00.957089 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4220a65b-9903-414b-95ca-59023daeac10 tempest-EndpointsNegativeTestJSON-474721284 tempest-EndpointsNegativeTestJSON-474721284-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:00.961350 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3328/6617] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:35:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 21:35:00.962551 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd32b52-0b26-47ee-bf21-f5be63755aca admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:00.975288 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4220a65b-9903-414b-95ca-59023daeac10 tempest-EndpointsNegativeTestJSON-474721284 tempest-EndpointsNegativeTestJSON-474721284-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:00.976665 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd32b52-0b26-47ee-bf21-f5be63755aca admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:00.988265 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed04a36a-9d66-404e-8ec4-e75a16b12252 tempest-EndpointsNegativeTestJSON-474721284 tempest-EndpointsNegativeTestJSON-474721284-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a91aeb594a848dba2f203ac3bcfdf5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd1bcea117aa41569f6119c2358b902d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:00.989209 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed04a36a-9d66-404e-8ec4-e75a16b12252 tempest-EndpointsNegativeTestJSON-474721284 tempest-EndpointsNegativeTestJSON-474721284-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:00.990213 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed04a36a-9d66-404e-8ec4-e75a16b12252 tempest-EndpointsNegativeTestJSON-474721284 tempest-EndpointsNegativeTestJSON-474721284-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:00.990213 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed04a36a-9d66-404e-8ec4-e75a16b12252 tempest-EndpointsNegativeTestJSON-474721284 tempest-EndpointsNegativeTestJSON-474721284-project-admin] PATH_INFO: `/v3/endpoints/0a369bf1e90a421db222e2f6998a65ba` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:00.993358 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0a5702-3d41-4a65-a68e-40a6b00a0517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:00.994417 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0a5702-3d41-4a65-a68e-40a6b00a0517 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:00.994707 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0a5702-3d41-4a65-a68e-40a6b00a0517 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:00.994984 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0a5702-3d41-4a65-a68e-40a6b00a0517 admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:00.995676 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0a5702-3d41-4a65-a68e-40a6b00a0517 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:00.998274 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed04a36a-9d66-404e-8ec4-e75a16b12252 tempest-EndpointsNegativeTestJSON-474721284 tempest-EndpointsNegativeTestJSON-474721284-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=0a369bf1e90a421db222e2f6998a65ba)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:00.998644 ncdv-master-1 devstack@keystone.service[91547]: WARNING py.warnings [None req-ed04a36a-9d66-404e-8ec4-e75a16b12252 tempest-EndpointsNegativeTestJSON-474721284 tempest-EndpointsNegativeTestJSON-474721284-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:35:00.998644 ncdv-master-1 devstack@keystone.service[91547]: warnings.warn(msg) Jul 23 21:35:00.998644 ncdv-master-1 devstack@keystone.service[91547]: Jul 23 21:35:00.998915 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0a5702-3d41-4a65-a68e-40a6b00a0517 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:00.999536 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed04a36a-9d66-404e-8ec4-e75a16b12252 tempest-EndpointsNegativeTestJSON-474721284 tempest-EndpointsNegativeTestJSON-474721284-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:01.013732 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-ed04a36a-9d66-404e-8ec4-e75a16b12252 tempest-EndpointsNegativeTestJSON-474721284 tempest-EndpointsNegativeTestJSON-474721284-project-admin] Invalid input for field 'enabled': 'True' is not of type 'boolean' Jul 23 21:35:01.013732 ncdv-master-1 devstack@keystone.service[91547]: Failed validating 'type' in schema['properties']['enabled']: Jul 23 21:35:01.013732 ncdv-master-1 devstack@keystone.service[91547]: {'enum': [True, False, None], 'type': 'boolean'} Jul 23 21:35:01.013732 ncdv-master-1 devstack@keystone.service[91547]: On instance['enabled']: Jul 23 21:35:01.013732 ncdv-master-1 devstack@keystone.service[91547]: 'True': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Jul 23 21:35:01.013732 ncdv-master-1 devstack@keystone.service[91547]: Failed validating 'type' in schema['properties']['enabled']: Jul 23 21:35:01.013732 ncdv-master-1 devstack@keystone.service[91547]: {'enum': [True, False, None], 'type': 'boolean'} Jul 23 21:35:01.013732 ncdv-master-1 devstack@keystone.service[91547]: On instance['enabled']: Jul 23 21:35:01.013732 ncdv-master-1 devstack@keystone.service[91547]: 'True' Jul 23 21:35:01.013732 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 21:35:01.013732 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Jul 23 21:35:01.013732 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Jul 23 21:35:01.013732 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 23 21:35:01.013732 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise error Jul 23 21:35:01.013732 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'True' is not of type 'boolean' Jul 23 21:35:01.013732 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 21:35:01.013732 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Jul 23 21:35:01.013732 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Jul 23 21:35:01.013732 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 21:35:01.013732 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application On instance['enabled']: Jul 23 21:35:01.013732 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application 'True' Jul 23 21:35:01.013732 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 21:35:01.013732 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 23 21:35:01.015289 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 21:35:01.015289 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 21:35:01.015289 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 21:35:01.015289 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 21:35:01.015289 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 21:35:01.015289 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 21:35:01.015289 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 21:35:01.015289 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 21:35:01.015289 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 21:35:01.015289 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 21:35:01.015289 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 21:35:01.015289 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 21:35:01.015289 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 105, in patch Jul 23 21:35:01.015289 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_update, endpoint) Jul 23 21:35:01.015289 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Jul 23 21:35:01.015289 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Jul 23 21:35:01.015289 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Jul 23 21:35:01.016668 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Jul 23 21:35:01.016668 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Jul 23 21:35:01.016668 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 21:35:01.016668 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Jul 23 21:35:01.016668 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Jul 23 21:35:01.016668 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 21:35:01.016668 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application On instance['enabled']: Jul 23 21:35:01.016668 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application 'True' Jul 23 21:35:01.016668 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 21:35:01.018530 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3290/6618] 10.222.0.17 () {60 vars in 1254 bytes} [Sat Jul 23 21:35:00 2022] PATCH /identity/v3/endpoints/0a369bf1e90a421db222e2f6998a65ba => generated 281 bytes in 62 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Jul 23 21:35:01.019343 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed04a36a-9d66-404e-8ec4-e75a16b12252 tempest-EndpointsNegativeTestJSON-474721284 tempest-EndpointsNegativeTestJSON-474721284-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:01.029809 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed04a36a-9d66-404e-8ec4-e75a16b12252 tempest-EndpointsNegativeTestJSON-474721284 tempest-EndpointsNegativeTestJSON-474721284-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:01.035107 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b479a18-8240-4119-a78b-473b44cfe07c tempest-EndpointsNegativeTestJSON-474721284 tempest-EndpointsNegativeTestJSON-474721284-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a91aeb594a848dba2f203ac3bcfdf5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd1bcea117aa41569f6119c2358b902d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:01.035967 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b479a18-8240-4119-a78b-473b44cfe07c tempest-EndpointsNegativeTestJSON-474721284 tempest-EndpointsNegativeTestJSON-474721284-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:01.036247 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b479a18-8240-4119-a78b-473b44cfe07c tempest-EndpointsNegativeTestJSON-474721284 tempest-EndpointsNegativeTestJSON-474721284-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:01.036521 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b479a18-8240-4119-a78b-473b44cfe07c tempest-EndpointsNegativeTestJSON-474721284 tempest-EndpointsNegativeTestJSON-474721284-project-admin] PATH_INFO: `/v3/endpoints/0a369bf1e90a421db222e2f6998a65ba` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:01.038273 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b479a18-8240-4119-a78b-473b44cfe07c tempest-EndpointsNegativeTestJSON-474721284 tempest-EndpointsNegativeTestJSON-474721284-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=0a369bf1e90a421db222e2f6998a65ba)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:01.039447 ncdv-master-1 devstack@keystone.service[91547]: WARNING py.warnings [None req-5b479a18-8240-4119-a78b-473b44cfe07c tempest-EndpointsNegativeTestJSON-474721284 tempest-EndpointsNegativeTestJSON-474721284-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:35:01.039447 ncdv-master-1 devstack@keystone.service[91547]: warnings.warn(msg) Jul 23 21:35:01.039447 ncdv-master-1 devstack@keystone.service[91547]: Jul 23 21:35:01.040959 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b479a18-8240-4119-a78b-473b44cfe07c tempest-EndpointsNegativeTestJSON-474721284 tempest-EndpointsNegativeTestJSON-474721284-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:01.042544 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=89,keystone:DELETE=8,keystone:INSERT=3 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:35:01.055470 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-5b479a18-8240-4119-a78b-473b44cfe07c tempest-EndpointsNegativeTestJSON-474721284 tempest-EndpointsNegativeTestJSON-474721284-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '0a369bf1e90a421db222e2f6998a65ba', 'request_id': 'req-5b479a18-8240-4119-a78b-473b44cfe07c'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:01.068904 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3329/6619] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:35:00 2022] POST /identity/v3/projects => generated 381 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:35:01.073946 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3291/6620] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:35:01 2022] DELETE /identity/v3/endpoints/0a369bf1e90a421db222e2f6998a65ba => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:35:01.075490 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0a5702-3d41-4a65-a68e-40a6b00a0517 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:01.077570 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b479a18-8240-4119-a78b-473b44cfe07c tempest-EndpointsNegativeTestJSON-474721284 tempest-EndpointsNegativeTestJSON-474721284-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:01.112164 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b479a18-8240-4119-a78b-473b44cfe07c tempest-EndpointsNegativeTestJSON-474721284 tempest-EndpointsNegativeTestJSON-474721284-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:01.159225 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0a5702-3d41-4a65-a68e-40a6b00a0517 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:01.177453 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a5289f-6257-4775-b783-b02d1762c5c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:01.178207 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a5289f-6257-4775-b783-b02d1762c5c2 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:01.178495 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a5289f-6257-4775-b783-b02d1762c5c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:01.180306 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a5289f-6257-4775-b783-b02d1762c5c2 admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:01.181277 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a5289f-6257-4775-b783-b02d1762c5c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:01.183298 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a5289f-6257-4775-b783-b02d1762c5c2 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:01.203103 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:35:01.203506 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94236a94-5d6f-4244-8111-ac1458e9111f tempest-EndpointsNegativeTestJSON-474721284 tempest-EndpointsNegativeTestJSON-474721284-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a91aeb594a848dba2f203ac3bcfdf5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd1bcea117aa41569f6119c2358b902d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:01.206105 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94236a94-5d6f-4244-8111-ac1458e9111f tempest-EndpointsNegativeTestJSON-474721284 tempest-EndpointsNegativeTestJSON-474721284-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:01.206821 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94236a94-5d6f-4244-8111-ac1458e9111f tempest-EndpointsNegativeTestJSON-474721284 tempest-EndpointsNegativeTestJSON-474721284-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:01.208985 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94236a94-5d6f-4244-8111-ac1458e9111f tempest-EndpointsNegativeTestJSON-474721284 tempest-EndpointsNegativeTestJSON-474721284-project-admin] PATH_INFO: `/v3/regions/tempest-region-182486438` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:01.209786 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94236a94-5d6f-4244-8111-ac1458e9111f tempest-EndpointsNegativeTestJSON-474721284 tempest-EndpointsNegativeTestJSON-474721284-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-182486438)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:01.212856 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3330/6621] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:35:01 2022] POST /identity/v3/users => generated 291 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:35:01.227127 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94236a94-5d6f-4244-8111-ac1458e9111f tempest-EndpointsNegativeTestJSON-474721284 tempest-EndpointsNegativeTestJSON-474721284-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:01.318673 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3292/6622] 10.222.0.17 () {58 vars in 1205 bytes} [Sat Jul 23 21:35:01 2022] DELETE /identity/v3/regions/tempest-region-182486438 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:35:01.323894 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a5289f-6257-4775-b783-b02d1762c5c2 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:01.329323 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94236a94-5d6f-4244-8111-ac1458e9111f tempest-EndpointsNegativeTestJSON-474721284 tempest-EndpointsNegativeTestJSON-474721284-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:01.338224 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a5289f-6257-4775-b783-b02d1762c5c2 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:01.369336 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b266df90-6ba9-466b-9143-4831c445de48 tempest-EndpointsNegativeTestJSON-474721284 tempest-EndpointsNegativeTestJSON-474721284-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a91aeb594a848dba2f203ac3bcfdf5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd1bcea117aa41569f6119c2358b902d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:01.370278 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b266df90-6ba9-466b-9143-4831c445de48 tempest-EndpointsNegativeTestJSON-474721284 tempest-EndpointsNegativeTestJSON-474721284-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:01.370569 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b266df90-6ba9-466b-9143-4831c445de48 tempest-EndpointsNegativeTestJSON-474721284 tempest-EndpointsNegativeTestJSON-474721284-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:01.370827 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b266df90-6ba9-466b-9143-4831c445de48 tempest-EndpointsNegativeTestJSON-474721284 tempest-EndpointsNegativeTestJSON-474721284-project-admin] PATH_INFO: `/v3/services/1c1e71f318924146a7f13f7efb6e76c2` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:01.371925 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b266df90-6ba9-466b-9143-4831c445de48 tempest-EndpointsNegativeTestJSON-474721284 tempest-EndpointsNegativeTestJSON-474721284-project-admin] RBAC: Authorizing `identity:delete_service(service_id=1c1e71f318924146a7f13f7efb6e76c2)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:01.373763 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b266df90-6ba9-466b-9143-4831c445de48 tempest-EndpointsNegativeTestJSON-474721284 tempest-EndpointsNegativeTestJSON-474721284-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:01.377275 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94236a94-5d6f-4244-8111-ac1458e9111f tempest-EndpointsNegativeTestJSON-474721284 tempest-EndpointsNegativeTestJSON-474721284-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:01.382949 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c11c7f5-cc92-4cdf-87c4-d18c25cac119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:01.383639 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c11c7f5-cc92-4cdf-87c4-d18c25cac119 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:01.383923 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c11c7f5-cc92-4cdf-87c4-d18c25cac119 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:01.384199 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c11c7f5-cc92-4cdf-87c4-d18c25cac119 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:01.385371 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c11c7f5-cc92-4cdf-87c4-d18c25cac119 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:01.387373 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c11c7f5-cc92-4cdf-87c4-d18c25cac119 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:01.399590 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3293/6623] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:35:01 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 21:35:01.403617 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c11c7f5-cc92-4cdf-87c4-d18c25cac119 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:01.416692 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c11c7f5-cc92-4cdf-87c4-d18c25cac119 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:01.434928 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506aab8c-6712-44af-9a26-8fb02f82eccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:01.435169 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3331/6624] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:35:01 2022] DELETE /identity/v3/services/1c1e71f318924146a7f13f7efb6e76c2 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:35:01.435629 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506aab8c-6712-44af-9a26-8fb02f82eccf admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:01.435909 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506aab8c-6712-44af-9a26-8fb02f82eccf admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:01.436220 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b266df90-6ba9-466b-9143-4831c445de48 tempest-EndpointsNegativeTestJSON-474721284 tempest-EndpointsNegativeTestJSON-474721284-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:01.437826 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506aab8c-6712-44af-9a26-8fb02f82eccf admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:01.438611 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506aab8c-6712-44af-9a26-8fb02f82eccf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:01.438738 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-b266df90-6ba9-466b-9143-4831c445de48 tempest-EndpointsNegativeTestJSON-474721284 tempest-EndpointsNegativeTestJSON-474721284-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:01.442189 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506aab8c-6712-44af-9a26-8fb02f82eccf admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:01.470143 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3294/6625] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:35:01 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 21:35:01.470143 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506aab8c-6712-44af-9a26-8fb02f82eccf admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:01.478566 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-506aab8c-6712-44af-9a26-8fb02f82eccf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:01.487990 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b266df90-6ba9-466b-9143-4831c445de48 tempest-EndpointsNegativeTestJSON-474721284 tempest-EndpointsNegativeTestJSON-474721284-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:01.494518 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7de0b5-4ff5-4374-9b12-a712bbb9d837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:01.496261 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7de0b5-4ff5-4374-9b12-a712bbb9d837 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:01.497296 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7de0b5-4ff5-4374-9b12-a712bbb9d837 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:01.497803 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7de0b5-4ff5-4374-9b12-a712bbb9d837 admin admin] PATH_INFO: `/v3/projects/a8cf24563e754f26a2a109012085d38d` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:01.499474 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7de0b5-4ff5-4374-9b12-a712bbb9d837 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8cf24563e754f26a2a109012085d38d)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:01.502119 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7de0b5-4ff5-4374-9b12-a712bbb9d837 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:01.502363 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506aab8c-6712-44af-9a26-8fb02f82eccf admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:01.515532 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5893ab4f-cb2a-47eb-a15f-ed21798ed5a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:01.516507 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5893ab4f-cb2a-47eb-a15f-ed21798ed5a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:01.516796 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5893ab4f-cb2a-47eb-a15f-ed21798ed5a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:01.517076 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5893ab4f-cb2a-47eb-a15f-ed21798ed5a9 admin admin] PATH_INFO: `/v3/users/1ded30ce40eb4e6b84433540ab3ddcfb` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:01.521517 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5893ab4f-cb2a-47eb-a15f-ed21798ed5a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ded30ce40eb4e6b84433540ab3ddcfb)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:01.527492 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5893ab4f-cb2a-47eb-a15f-ed21798ed5a9 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:01.569849 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-5e7de0b5-4ff5-4374-9b12-a712bbb9d837 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8cf24563e754f26a2a109012085d38d', 'request_id': 'req-5e7de0b5-4ff5-4374-9b12-a712bbb9d837'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:01.581674 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-5e7de0b5-4ff5-4374-9b12-a712bbb9d837 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8cf24563e754f26a2a109012085d38d', 'request_id': 'req-5e7de0b5-4ff5-4374-9b12-a712bbb9d837'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:01.590220 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-5e7de0b5-4ff5-4374-9b12-a712bbb9d837 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8cf24563e754f26a2a109012085d38d', 'request_id': 'req-5e7de0b5-4ff5-4374-9b12-a712bbb9d837'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:01.609264 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-5e7de0b5-4ff5-4374-9b12-a712bbb9d837 admin admin] The token cache is being invalidate because project a8cf24563e754f26a2a109012085d38d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:35:01.609709 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-5e7de0b5-4ff5-4374-9b12-a712bbb9d837 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:01.610430 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-5e7de0b5-4ff5-4374-9b12-a712bbb9d837 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:01.616354 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3332/6626] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:35:01 2022] DELETE /identity/v3/projects/a8cf24563e754f26a2a109012085d38d => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:35:01.616354 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7de0b5-4ff5-4374-9b12-a712bbb9d837 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:01.616914 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-5e7de0b5-4ff5-4374-9b12-a712bbb9d837 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:01.642134 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-5893ab4f-cb2a-47eb-a15f-ed21798ed5a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ded30ce40eb4e6b84433540ab3ddcfb'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:01.652381 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-5893ab4f-cb2a-47eb-a15f-ed21798ed5a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ded30ce40eb4e6b84433540ab3ddcfb'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:01.654085 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-5893ab4f-cb2a-47eb-a15f-ed21798ed5a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ded30ce40eb4e6b84433540ab3ddcfb'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:01.669413 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-5893ab4f-cb2a-47eb-a15f-ed21798ed5a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ded30ce40eb4e6b84433540ab3ddcfb'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:01.704937 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-5893ab4f-cb2a-47eb-a15f-ed21798ed5a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ded30ce40eb4e6b84433540ab3ddcfb'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:01.712806 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3295/6627] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:35:01 2022] DELETE /identity/v3/users/1ded30ce40eb4e6b84433540ab3ddcfb => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:35:01.713189 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7de0b5-4ff5-4374-9b12-a712bbb9d837 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:01.714229 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5893ab4f-cb2a-47eb-a15f-ed21798ed5a9 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:01.716139 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-5893ab4f-cb2a-47eb-a15f-ed21798ed5a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:01.736796 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:35:01.782651 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:35:01.823171 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b37933-116f-4c7f-91f0-65387f289cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:01.824247 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b37933-116f-4c7f-91f0-65387f289cde admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:01.824597 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b37933-116f-4c7f-91f0-65387f289cde admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:01.824976 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b37933-116f-4c7f-91f0-65387f289cde admin admin] PATH_INFO: `/v3/projects/8d861a3383614f2c8dc8f42d7faea471/users/767bb57fb3d04e35bc7fc63506852f26/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:01.842864 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b37933-116f-4c7f-91f0-65387f289cde admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d861a3383614f2c8dc8f42d7faea471, user_id=767bb57fb3d04e35bc7fc63506852f26, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:01.845696 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b37933-116f-4c7f-91f0-65387f289cde admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:01.876211 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3333/6628] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:35:01 2022] PUT /identity/v3/projects/8d861a3383614f2c8dc8f42d7faea471/users/767bb57fb3d04e35bc7fc63506852f26/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:35:01.887056 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d59d6b-8caa-437c-8665-8659883fec04 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:01.887466 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d59d6b-8caa-437c-8665-8659883fec04 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:01.887824 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d59d6b-8caa-437c-8665-8659883fec04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:01.888986 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5893ab4f-cb2a-47eb-a15f-ed21798ed5a9 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:01.912546 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-23d59d6b-8caa-437c-8665-8659883fec04 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:35:01.925263 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-23d59d6b-8caa-437c-8665-8659883fec04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:02.027190 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e80341-eb28-4470-8de7-ebeff820d7ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:02.029582 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e80341-eb28-4470-8de7-ebeff820d7ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:02.030116 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e80341-eb28-4470-8de7-ebeff820d7ee admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:02.030556 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e80341-eb28-4470-8de7-ebeff820d7ee admin admin] PATH_INFO: `/v3/users/af33cbdae9c84f998bcef8885af6f9e2` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:02.033787 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e80341-eb28-4470-8de7-ebeff820d7ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=af33cbdae9c84f998bcef8885af6f9e2)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:02.037246 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e80341-eb28-4470-8de7-ebeff820d7ee admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:02.084261 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3334/6629] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:35:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:35:02.084261 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ce0d8f-1593-47f9-90a3-c86bbb4e161a None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:02.084261 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ce0d8f-1593-47f9-90a3-c86bbb4e161a None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:02.084261 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ce0d8f-1593-47f9-90a3-c86bbb4e161a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:02.140550 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-e3e80341-eb28-4470-8de7-ebeff820d7ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af33cbdae9c84f998bcef8885af6f9e2'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:02.142206 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-b3ce0d8f-1593-47f9-90a3-c86bbb4e161a None None] MFA Rules not processed for user `767bb57fb3d04e35bc7fc63506852f26`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:35:02.144741 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-b3ce0d8f-1593-47f9-90a3-c86bbb4e161a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:02.149433 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-e3e80341-eb28-4470-8de7-ebeff820d7ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af33cbdae9c84f998bcef8885af6f9e2'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:02.150323 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-e3e80341-eb28-4470-8de7-ebeff820d7ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af33cbdae9c84f998bcef8885af6f9e2'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:02.165604 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-e3e80341-eb28-4470-8de7-ebeff820d7ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af33cbdae9c84f998bcef8885af6f9e2'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:02.191770 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-e3e80341-eb28-4470-8de7-ebeff820d7ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af33cbdae9c84f998bcef8885af6f9e2'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:02.200582 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3296/6630] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:35:01 2022] DELETE /identity/v3/users/af33cbdae9c84f998bcef8885af6f9e2 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:35:02.201507 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e80341-eb28-4470-8de7-ebeff820d7ee admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:02.202899 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-e3e80341-eb28-4470-8de7-ebeff820d7ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:02.254180 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:35:02.325412 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3335/6631] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:35:02 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:35:02.337678 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e80341-eb28-4470-8de7-ebeff820d7ee admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:02.338914 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ce0d8f-1593-47f9-90a3-c86bbb4e161a None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:02.340741 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-b3ce0d8f-1593-47f9-90a3-c86bbb4e161a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:02.348103 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bd0af8-d5e3-4b98-8dc7-3a0a490d302f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:02.350263 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bd0af8-d5e3-4b98-8dc7-3a0a490d302f service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:02.352902 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bd0af8-d5e3-4b98-8dc7-3a0a490d302f service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:02.353825 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bd0af8-d5e3-4b98-8dc7-3a0a490d302f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:02.360731 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-35bd0af8-d5e3-4b98-8dc7-3a0a490d302f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:02.443447 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ce0d8f-1593-47f9-90a3-c86bbb4e161a None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:02.447688 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07872c1-34c3-448d-b6ae-2a1e1de7ad5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:02.448502 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07872c1-34c3-448d-b6ae-2a1e1de7ad5d service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:02.448789 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07872c1-34c3-448d-b6ae-2a1e1de7ad5d service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:02.449123 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07872c1-34c3-448d-b6ae-2a1e1de7ad5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:02.470098 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:35:02.480107 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bd0af8-d5e3-4b98-8dc7-3a0a490d302f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:02.482067 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bd0af8-d5e3-4b98-8dc7-3a0a490d302f service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:02.501695 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3297/6632] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:35:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:35:02.526218 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07872c1-34c3-448d-b6ae-2a1e1de7ad5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:02.527870 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07872c1-34c3-448d-b6ae-2a1e1de7ad5d service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:02.539860 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3336/6633] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:35:02 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:35:02.675519 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bd0af8-d5e3-4b98-8dc7-3a0a490d302f service neutron] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:02.677547 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-35bd0af8-d5e3-4b98-8dc7-3a0a490d302f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:02.718044 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bd0af8-d5e3-4b98-8dc7-3a0a490d302f service neutron] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:02.726562 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1f341e-6f84-4ec4-b183-52a57b5eb635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:02.727881 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1f341e-6f84-4ec4-b183-52a57b5eb635 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:02.728446 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1f341e-6f84-4ec4-b183-52a57b5eb635 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:02.728952 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1f341e-6f84-4ec4-b183-52a57b5eb635 admin admin] PATH_INFO: `/v3/projects/eb44e91bd95c4a4ab9792957e14e952e` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:02.730905 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1f341e-6f84-4ec4-b183-52a57b5eb635 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb44e91bd95c4a4ab9792957e14e952e)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:02.734563 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1f341e-6f84-4ec4-b183-52a57b5eb635 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:02.840817 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-2c1f341e-6f84-4ec4-b183-52a57b5eb635 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb44e91bd95c4a4ab9792957e14e952e', 'request_id': 'req-2c1f341e-6f84-4ec4-b183-52a57b5eb635'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:02.859637 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-2c1f341e-6f84-4ec4-b183-52a57b5eb635 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb44e91bd95c4a4ab9792957e14e952e', 'request_id': 'req-2c1f341e-6f84-4ec4-b183-52a57b5eb635'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:02.876220 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-2c1f341e-6f84-4ec4-b183-52a57b5eb635 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb44e91bd95c4a4ab9792957e14e952e', 'request_id': 'req-2c1f341e-6f84-4ec4-b183-52a57b5eb635'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:02.899720 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-2c1f341e-6f84-4ec4-b183-52a57b5eb635 admin admin] The token cache is being invalidate because project eb44e91bd95c4a4ab9792957e14e952e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:35:02.900577 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-2c1f341e-6f84-4ec4-b183-52a57b5eb635 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:02.901484 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-2c1f341e-6f84-4ec4-b183-52a57b5eb635 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:02.907141 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3298/6634] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:35:02 2022] DELETE /identity/v3/projects/eb44e91bd95c4a4ab9792957e14e952e => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:35:02.908536 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2e2d63-26ed-45db-84d7-e5e4393790c9 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:02.909019 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2e2d63-26ed-45db-84d7-e5e4393790c9 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:02.909116 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2e2d63-26ed-45db-84d7-e5e4393790c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:02.934218 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-6e2e2d63-26ed-45db-84d7-e5e4393790c9 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:35:02.935780 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-6e2e2d63-26ed-45db-84d7-e5e4393790c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:03.041328 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1f341e-6f84-4ec4-b183-52a57b5eb635 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:03.043292 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-2c1f341e-6f84-4ec4-b183-52a57b5eb635 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:03.068482 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3337/6635] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:35:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:35:03.070512 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b64a41-7c9e-4ad8-89df-b42cb28f9bda None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:03.070892 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b64a41-7c9e-4ad8-89df-b42cb28f9bda None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:03.071635 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b64a41-7c9e-4ad8-89df-b42cb28f9bda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:03.097789 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-50b64a41-7c9e-4ad8-89df-b42cb28f9bda None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:35:03.099535 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-50b64a41-7c9e-4ad8-89df-b42cb28f9bda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:03.113365 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3338/6636] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:35:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:35:03.114787 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b64a41-7c9e-4ad8-89df-b42cb28f9bda None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:03.126662 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b64a41-7c9e-4ad8-89df-b42cb28f9bda None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:03.136814 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1f341e-6f84-4ec4-b183-52a57b5eb635 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:03.141184 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac297ba5-4680-4c25-89bd-168874567b2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:03.142008 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac297ba5-4680-4c25-89bd-168874567b2f service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:03.142469 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac297ba5-4680-4c25-89bd-168874567b2f service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:03.142621 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac297ba5-4680-4c25-89bd-168874567b2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:03.144583 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-ac297ba5-4680-4c25-89bd-168874567b2f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:03.145561 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d793a174-a362-4961-8fa4-d4a9efe37722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:03.146280 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d793a174-a362-4961-8fa4-d4a9efe37722 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:03.146557 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d793a174-a362-4961-8fa4-d4a9efe37722 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:03.146827 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d793a174-a362-4961-8fa4-d4a9efe37722 admin admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:03.147561 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d793a174-a362-4961-8fa4-d4a9efe37722 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:35:03.147862 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d793a174-a362-4961-8fa4-d4a9efe37722 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:03.149462 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d793a174-a362-4961-8fa4-d4a9efe37722 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:03.155348 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:35:03.163106 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3339/6637] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:35:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:35:03.170387 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d793a174-a362-4961-8fa4-d4a9efe37722 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:03.184189 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d793a174-a362-4961-8fa4-d4a9efe37722 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:03.190229 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4770f0e1-8a8c-4190-bd8f-cf6b7b1d23b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:03.191515 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4770f0e1-8a8c-4190-bd8f-cf6b7b1d23b8 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:03.191879 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4770f0e1-8a8c-4190-bd8f-cf6b7b1d23b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:03.192186 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4770f0e1-8a8c-4190-bd8f-cf6b7b1d23b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:03.192976 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4770f0e1-8a8c-4190-bd8f-cf6b7b1d23b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:03.195180 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4770f0e1-8a8c-4190-bd8f-cf6b7b1d23b8 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:03.236887 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac297ba5-4680-4c25-89bd-168874567b2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:03.238816 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac297ba5-4680-4c25-89bd-168874567b2f service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:03.244549 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3340/6638] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:35:03 2022] POST /identity/v3/projects => generated 357 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:35:03.246924 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4770f0e1-8a8c-4190-bd8f-cf6b7b1d23b8 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:03.274199 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3299/6639] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:35:03 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:35:03.322502 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4770f0e1-8a8c-4190-bd8f-cf6b7b1d23b8 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:03.327241 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf0baa1-4828-44af-9205-e11835a0b6dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:03.327935 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf0baa1-4828-44af-9205-e11835a0b6dc admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:03.328218 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf0baa1-4828-44af-9205-e11835a0b6dc admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:03.328508 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf0baa1-4828-44af-9205-e11835a0b6dc admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:03.329263 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf0baa1-4828-44af-9205-e11835a0b6dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:03.331427 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf0baa1-4828-44af-9205-e11835a0b6dc admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:03.362897 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3341/6640] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:35:03 2022] POST /identity/v3/users => generated 279 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:35:03.364038 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac297ba5-4680-4c25-89bd-168874567b2f service neutron] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:03.394457 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac297ba5-4680-4c25-89bd-168874567b2f service neutron] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:03.403807 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0860e432-6405-4e1f-9b0b-6bab57cd9d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:03.405608 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0860e432-6405-4e1f-9b0b-6bab57cd9d7f admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:03.406220 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0860e432-6405-4e1f-9b0b-6bab57cd9d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:03.406733 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0860e432-6405-4e1f-9b0b-6bab57cd9d7f admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:03.407758 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0860e432-6405-4e1f-9b0b-6bab57cd9d7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:03.409838 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0860e432-6405-4e1f-9b0b-6bab57cd9d7f admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:03.428966 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf0baa1-4828-44af-9205-e11835a0b6dc admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:03.437360 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:35:03.440545 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3300/6641] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:35:03 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:35:03.443318 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf0baa1-4828-44af-9205-e11835a0b6dc admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:03.453337 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c122b4b-d9de-4c1f-b0c4-c211ae812a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:03.454081 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c122b4b-d9de-4c1f-b0c4-c211ae812a49 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:03.454367 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c122b4b-d9de-4c1f-b0c4-c211ae812a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:03.454658 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c122b4b-d9de-4c1f-b0c4-c211ae812a49 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:03.455391 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c122b4b-d9de-4c1f-b0c4-c211ae812a49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:03.459030 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c122b4b-d9de-4c1f-b0c4-c211ae812a49 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:03.477977 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0860e432-6405-4e1f-9b0b-6bab57cd9d7f admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:03.486371 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3342/6642] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:35:03 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:35:03.491778 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0860e432-6405-4e1f-9b0b-6bab57cd9d7f admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:03.504665 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e016127-ab98-4076-b143-e227b7544fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:03.506357 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e016127-ab98-4076-b143-e227b7544fe2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:03.507707 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e016127-ab98-4076-b143-e227b7544fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:03.508241 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e016127-ab98-4076-b143-e227b7544fe2 admin admin] PATH_INFO: `/v3/projects/57b3338515b84cb8b6cb797f29443e2a/users/9c7d8a8b408546a5af5a534f17a65083/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:03.534465 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e016127-ab98-4076-b143-e227b7544fe2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57b3338515b84cb8b6cb797f29443e2a, user_id=9c7d8a8b408546a5af5a534f17a65083, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:03.538657 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e016127-ab98-4076-b143-e227b7544fe2 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:03.579692 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3301/6643] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:35:03 2022] PUT /identity/v3/projects/57b3338515b84cb8b6cb797f29443e2a/users/9c7d8a8b408546a5af5a534f17a65083/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:35:03.582229 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a66882d-ccae-4a10-8844-c98517bec4e9 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:03.583441 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a66882d-ccae-4a10-8844-c98517bec4e9 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:03.583897 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a66882d-ccae-4a10-8844-c98517bec4e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:03.626199 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-0a66882d-ccae-4a10-8844-c98517bec4e9 None None] MFA Rules not processed for user `9c7d8a8b408546a5af5a534f17a65083`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:35:03.627817 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-0a66882d-ccae-4a10-8844-c98517bec4e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:03.729841 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3343/6644] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:35:03 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:35:03.731468 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e016127-ab98-4076-b143-e227b7544fe2 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:03.808272 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e016127-ab98-4076-b143-e227b7544fe2 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:03.826162 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9000b35f-9eeb-4f85-bb6f-ea44d256ff50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:03.829279 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9000b35f-9eeb-4f85-bb6f-ea44d256ff50 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:03.830226 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9000b35f-9eeb-4f85-bb6f-ea44d256ff50 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:03.830226 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9000b35f-9eeb-4f85-bb6f-ea44d256ff50 admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:03.831065 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9000b35f-9eeb-4f85-bb6f-ea44d256ff50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:03.833788 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9000b35f-9eeb-4f85-bb6f-ea44d256ff50 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:03.869672 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3302/6645] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:35:03 2022] POST /identity/v3/projects => generated 355 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:35:03.871646 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a66882d-ccae-4a10-8844-c98517bec4e9 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:03.885332 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a66882d-ccae-4a10-8844-c98517bec4e9 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:03.890885 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9000b35f-9eeb-4f85-bb6f-ea44d256ff50 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:03.893615 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-9000b35f-9eeb-4f85-bb6f-ea44d256ff50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:03.974949 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:35:04.003582 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9000b35f-9eeb-4f85-bb6f-ea44d256ff50 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:04.009789 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcbd4d4-fd81-4745-ad20-db1a7546aa2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:04.011480 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcbd4d4-fd81-4745-ad20-db1a7546aa2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:04.012008 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcbd4d4-fd81-4745-ad20-db1a7546aa2a admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:04.012509 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcbd4d4-fd81-4745-ad20-db1a7546aa2a admin admin] PATH_INFO: `/v3/projects/3248ad7c57bd4f779d2bce9e0d5b7710` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:04.014533 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcbd4d4-fd81-4745-ad20-db1a7546aa2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3248ad7c57bd4f779d2bce9e0d5b7710)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:04.017061 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcbd4d4-fd81-4745-ad20-db1a7546aa2a admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:04.022738 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf70144-097f-4641-9fd1-bde7e1a3fff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:04.024411 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf70144-097f-4641-9fd1-bde7e1a3fff4 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:04.024700 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf70144-097f-4641-9fd1-bde7e1a3fff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:04.025148 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf70144-097f-4641-9fd1-bde7e1a3fff4 admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:04.027203 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf70144-097f-4641-9fd1-bde7e1a3fff4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:04.032172 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf70144-097f-4641-9fd1-bde7e1a3fff4 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:04.071583 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3344/6646] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:35:03 2022] POST /identity/v3/users => generated 284 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:35:04.078226 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf70144-097f-4641-9fd1-bde7e1a3fff4 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:04.108918 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf70144-097f-4641-9fd1-bde7e1a3fff4 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:04.110204 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-2dcbd4d4-fd81-4745-ad20-db1a7546aa2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3248ad7c57bd4f779d2bce9e0d5b7710', 'request_id': 'req-2dcbd4d4-fd81-4745-ad20-db1a7546aa2a'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:04.128749 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-2dcbd4d4-fd81-4745-ad20-db1a7546aa2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3248ad7c57bd4f779d2bce9e0d5b7710', 'request_id': 'req-2dcbd4d4-fd81-4745-ad20-db1a7546aa2a'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:04.138603 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-2dcbd4d4-fd81-4745-ad20-db1a7546aa2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3248ad7c57bd4f779d2bce9e0d5b7710', 'request_id': 'req-2dcbd4d4-fd81-4745-ad20-db1a7546aa2a'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:04.167273 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-2dcbd4d4-fd81-4745-ad20-db1a7546aa2a admin admin] The token cache is being invalidate because project 3248ad7c57bd4f779d2bce9e0d5b7710 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:35:04.167990 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-2dcbd4d4-fd81-4745-ad20-db1a7546aa2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:04.170003 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-2dcbd4d4-fd81-4745-ad20-db1a7546aa2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:04.174706 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3303/6647] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:35:03 2022] DELETE /identity/v3/projects/3248ad7c57bd4f779d2bce9e0d5b7710 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:35:04.180196 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcbd4d4-fd81-4745-ad20-db1a7546aa2a admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:04.182414 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-2dcbd4d4-fd81-4745-ad20-db1a7546aa2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:04.204313 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16035d46-82cc-455d-bffa-ca0037d39076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:04.205456 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16035d46-82cc-455d-bffa-ca0037d39076 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:04.209278 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16035d46-82cc-455d-bffa-ca0037d39076 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:04.209926 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16035d46-82cc-455d-bffa-ca0037d39076 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:04.211587 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16035d46-82cc-455d-bffa-ca0037d39076 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:04.214484 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16035d46-82cc-455d-bffa-ca0037d39076 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:04.232762 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3345/6648] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:35:04 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:35:04.237651 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16035d46-82cc-455d-bffa-ca0037d39076 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:04.241936 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-16035d46-82cc-455d-bffa-ca0037d39076 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:04.260628 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16035d46-82cc-455d-bffa-ca0037d39076 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:04.273008 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07612c9-0483-40dc-9a08-55e3ef1e70fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:04.274062 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07612c9-0483-40dc-9a08-55e3ef1e70fb admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:04.274382 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07612c9-0483-40dc-9a08-55e3ef1e70fb admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:04.274697 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07612c9-0483-40dc-9a08-55e3ef1e70fb admin admin] PATH_INFO: `/v3/projects/15e7b18adaeb456c847141c48da72e98/users/61b48bdcb60b41cf9abc989e973d811d/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:04.278904 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:35:04.292316 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcbd4d4-fd81-4745-ad20-db1a7546aa2a admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:04.299019 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53830b6d-365e-463e-a758-8f55bbc0c7bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:04.299939 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53830b6d-365e-463e-a758-8f55bbc0c7bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:04.300271 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53830b6d-365e-463e-a758-8f55bbc0c7bf admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:04.300712 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53830b6d-365e-463e-a758-8f55bbc0c7bf admin admin] PATH_INFO: `/v3/users/0a91aeb594a848dba2f203ac3bcfdf5f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:04.302114 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53830b6d-365e-463e-a758-8f55bbc0c7bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a91aeb594a848dba2f203ac3bcfdf5f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:04.304183 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53830b6d-365e-463e-a758-8f55bbc0c7bf admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:04.304421 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07612c9-0483-40dc-9a08-55e3ef1e70fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=15e7b18adaeb456c847141c48da72e98, user_id=61b48bdcb60b41cf9abc989e973d811d, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:04.307466 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07612c9-0483-40dc-9a08-55e3ef1e70fb admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:04.334695 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3346/6649] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:35:04 2022] PUT /identity/v3/projects/15e7b18adaeb456c847141c48da72e98/users/61b48bdcb60b41cf9abc989e973d811d/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:35:04.340031 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07612c9-0483-40dc-9a08-55e3ef1e70fb admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:04.380331 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-53830b6d-365e-463e-a758-8f55bbc0c7bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a91aeb594a848dba2f203ac3bcfdf5f'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:04.393410 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-53830b6d-365e-463e-a758-8f55bbc0c7bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a91aeb594a848dba2f203ac3bcfdf5f'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:04.395086 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-53830b6d-365e-463e-a758-8f55bbc0c7bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a91aeb594a848dba2f203ac3bcfdf5f'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:04.406444 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-53830b6d-365e-463e-a758-8f55bbc0c7bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a91aeb594a848dba2f203ac3bcfdf5f'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:04.426472 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:35:04.430110 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-53830b6d-365e-463e-a758-8f55bbc0c7bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a91aeb594a848dba2f203ac3bcfdf5f'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:04.449294 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3304/6650] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:35:04 2022] DELETE /identity/v3/users/0a91aeb594a848dba2f203ac3bcfdf5f => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:35:04.472197 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07612c9-0483-40dc-9a08-55e3ef1e70fb admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:04.557016 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c36763-1b5e-464f-9293-78c2d5040f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:04.557775 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c36763-1b5e-464f-9293-78c2d5040f6c admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:04.558024 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c36763-1b5e-464f-9293-78c2d5040f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:04.558294 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c36763-1b5e-464f-9293-78c2d5040f6c admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:04.559687 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c36763-1b5e-464f-9293-78c2d5040f6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:04.561936 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c36763-1b5e-464f-9293-78c2d5040f6c admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:04.573666 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3347/6651] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:35:04 2022] GET /identity/v3/roles => generated 1420 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:35:04.578621 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53830b6d-365e-463e-a758-8f55bbc0c7bf admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:04.580109 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-53830b6d-365e-463e-a758-8f55bbc0c7bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:04.605018 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53830b6d-365e-463e-a758-8f55bbc0c7bf admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:04.612559 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c55675-2135-4f6b-b2cc-e9649cf732c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:04.613656 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c55675-2135-4f6b-b2cc-e9649cf732c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:04.614080 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c55675-2135-4f6b-b2cc-e9649cf732c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:04.619051 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c55675-2135-4f6b-b2cc-e9649cf732c1 admin admin] PATH_INFO: `/v3/projects/15e7b18adaeb456c847141c48da72e98/users/61b48bdcb60b41cf9abc989e973d811d/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:04.622459 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c55675-2135-4f6b-b2cc-e9649cf732c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15e7b18adaeb456c847141c48da72e98, user_id=61b48bdcb60b41cf9abc989e973d811d, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:04.625295 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c55675-2135-4f6b-b2cc-e9649cf732c1 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:04.641901 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3305/6652] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:35:04 2022] PUT /identity/v3/projects/15e7b18adaeb456c847141c48da72e98/users/61b48bdcb60b41cf9abc989e973d811d/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:35:04.648914 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03985d89-72b8-4b2f-b188-0c19a4ed9b12 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:04.649093 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03985d89-72b8-4b2f-b188-0c19a4ed9b12 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:04.649381 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03985d89-72b8-4b2f-b188-0c19a4ed9b12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:04.687958 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-03985d89-72b8-4b2f-b188-0c19a4ed9b12 None None] MFA Rules not processed for user `61b48bdcb60b41cf9abc989e973d811d`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:35:04.690297 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-03985d89-72b8-4b2f-b188-0c19a4ed9b12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:04.782429 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3348/6653] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:35:04 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:35:04.792780 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c55675-2135-4f6b-b2cc-e9649cf732c1 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:04.810441 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c55675-2135-4f6b-b2cc-e9649cf732c1 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:04.822256 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85984d74-5702-485f-a2e5-d0ea96a20200 tempest-QuotasTest-286877906 tempest-QuotasTest-286877906-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61b48bdcb60b41cf9abc989e973d811d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e7b18adaeb456c847141c48da72e98', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:04.823554 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85984d74-5702-485f-a2e5-d0ea96a20200 tempest-QuotasTest-286877906 tempest-QuotasTest-286877906-project-admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:04.824136 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85984d74-5702-485f-a2e5-d0ea96a20200 tempest-QuotasTest-286877906 tempest-QuotasTest-286877906-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:04.825237 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85984d74-5702-485f-a2e5-d0ea96a20200 tempest-QuotasTest-286877906 tempest-QuotasTest-286877906-project-admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:04.827032 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85984d74-5702-485f-a2e5-d0ea96a20200 tempest-QuotasTest-286877906 tempest-QuotasTest-286877906-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:35:04.827560 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85984d74-5702-485f-a2e5-d0ea96a20200 tempest-QuotasTest-286877906 tempest-QuotasTest-286877906-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:04.829645 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85984d74-5702-485f-a2e5-d0ea96a20200 tempest-QuotasTest-286877906 tempest-QuotasTest-286877906-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:04.851503 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3306/6654] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:35:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:35:04.855929 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03985d89-72b8-4b2f-b188-0c19a4ed9b12 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:04.867814 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03985d89-72b8-4b2f-b188-0c19a4ed9b12 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:04.874355 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27506ad5-da2b-4ed8-a162-7e6d2eb14255 tempest-QuotasTest-286877906 tempest-QuotasTest-286877906-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61b48bdcb60b41cf9abc989e973d811d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e7b18adaeb456c847141c48da72e98', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:04.875420 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27506ad5-da2b-4ed8-a162-7e6d2eb14255 tempest-QuotasTest-286877906 tempest-QuotasTest-286877906-project-admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:04.875939 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27506ad5-da2b-4ed8-a162-7e6d2eb14255 tempest-QuotasTest-286877906 tempest-QuotasTest-286877906-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:04.876419 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27506ad5-da2b-4ed8-a162-7e6d2eb14255 tempest-QuotasTest-286877906 tempest-QuotasTest-286877906-project-admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:04.878467 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27506ad5-da2b-4ed8-a162-7e6d2eb14255 tempest-QuotasTest-286877906 tempest-QuotasTest-286877906-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:04.880945 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27506ad5-da2b-4ed8-a162-7e6d2eb14255 tempest-QuotasTest-286877906 tempest-QuotasTest-286877906-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:04.893234 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:35:04.918336 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3349/6655] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:35:04 2022] POST /identity/v3/projects => generated 349 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:35:04.919852 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85984d74-5702-485f-a2e5-d0ea96a20200 tempest-QuotasTest-286877906 tempest-QuotasTest-286877906-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:04.936909 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85984d74-5702-485f-a2e5-d0ea96a20200 tempest-QuotasTest-286877906 tempest-QuotasTest-286877906-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:05.061234 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5722fa-01ba-4359-83d0-d47d02cc817a tempest-QuotasTest-286877906 tempest-QuotasTest-286877906-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61b48bdcb60b41cf9abc989e973d811d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e7b18adaeb456c847141c48da72e98', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:05.062624 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5722fa-01ba-4359-83d0-d47d02cc817a tempest-QuotasTest-286877906 tempest-QuotasTest-286877906-project-admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:05.063718 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5722fa-01ba-4359-83d0-d47d02cc817a tempest-QuotasTest-286877906 tempest-QuotasTest-286877906-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:05.064360 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5722fa-01ba-4359-83d0-d47d02cc817a tempest-QuotasTest-286877906 tempest-QuotasTest-286877906-project-admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:05.065350 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5722fa-01ba-4359-83d0-d47d02cc817a tempest-QuotasTest-286877906 tempest-QuotasTest-286877906-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:35:05.065942 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5722fa-01ba-4359-83d0-d47d02cc817a tempest-QuotasTest-286877906 tempest-QuotasTest-286877906-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:05.068716 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5722fa-01ba-4359-83d0-d47d02cc817a tempest-QuotasTest-286877906 tempest-QuotasTest-286877906-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:05.086665 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3307/6656] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:35:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:35:05.106777 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5722fa-01ba-4359-83d0-d47d02cc817a tempest-QuotasTest-286877906 tempest-QuotasTest-286877906-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:05.107554 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27506ad5-da2b-4ed8-a162-7e6d2eb14255 tempest-QuotasTest-286877906 tempest-QuotasTest-286877906-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:05.110595 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-9f5722fa-01ba-4359-83d0-d47d02cc817a tempest-QuotasTest-286877906 tempest-QuotasTest-286877906-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:05.111267 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-27506ad5-da2b-4ed8-a162-7e6d2eb14255 tempest-QuotasTest-286877906 tempest-QuotasTest-286877906-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:05.236833 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27506ad5-da2b-4ed8-a162-7e6d2eb14255 tempest-QuotasTest-286877906 tempest-QuotasTest-286877906-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:05.241209 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93193b2-254d-478e-b9ab-c3c3e866bbee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:05.242031 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93193b2-254d-478e-b9ab-c3c3e866bbee service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:05.242959 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93193b2-254d-478e-b9ab-c3c3e866bbee service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:05.243328 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93193b2-254d-478e-b9ab-c3c3e866bbee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:05.254878 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93193b2-254d-478e-b9ab-c3c3e866bbee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:05.256789 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93193b2-254d-478e-b9ab-c3c3e866bbee service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:05.266170 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5722fa-01ba-4359-83d0-d47d02cc817a tempest-QuotasTest-286877906 tempest-QuotasTest-286877906-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:05.272230 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3350/6657] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:35:05 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:35:05.279816 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49e79ae-a1ba-4cf2-820c-75ea74f3622b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:05.282170 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49e79ae-a1ba-4cf2-820c-75ea74f3622b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:05.282564 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49e79ae-a1ba-4cf2-820c-75ea74f3622b admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:05.282964 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49e79ae-a1ba-4cf2-820c-75ea74f3622b admin admin] PATH_INFO: `/v3/projects/fd1bcea117aa41569f6119c2358b902d` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:05.284468 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49e79ae-a1ba-4cf2-820c-75ea74f3622b admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd1bcea117aa41569f6119c2358b902d)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:05.287727 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49e79ae-a1ba-4cf2-820c-75ea74f3622b admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:05.391650 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-f49e79ae-a1ba-4cf2-820c-75ea74f3622b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd1bcea117aa41569f6119c2358b902d', 'request_id': 'req-f49e79ae-a1ba-4cf2-820c-75ea74f3622b'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:05.416550 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-f49e79ae-a1ba-4cf2-820c-75ea74f3622b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd1bcea117aa41569f6119c2358b902d', 'request_id': 'req-f49e79ae-a1ba-4cf2-820c-75ea74f3622b'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:05.430938 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-f49e79ae-a1ba-4cf2-820c-75ea74f3622b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd1bcea117aa41569f6119c2358b902d', 'request_id': 'req-f49e79ae-a1ba-4cf2-820c-75ea74f3622b'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:05.432671 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:35:05.466375 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-f49e79ae-a1ba-4cf2-820c-75ea74f3622b admin admin] The token cache is being invalidate because project fd1bcea117aa41569f6119c2358b902d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:35:05.467099 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-f49e79ae-a1ba-4cf2-820c-75ea74f3622b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:05.469546 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-f49e79ae-a1ba-4cf2-820c-75ea74f3622b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:05.480534 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4094150f-9f8c-4d45-8083-f1221ec07693 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:05.481379 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4094150f-9f8c-4d45-8083-f1221ec07693 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:05.481945 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4094150f-9f8c-4d45-8083-f1221ec07693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:05.484122 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3308/6658] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:35:05 2022] DELETE /identity/v3/projects/fd1bcea117aa41569f6119c2358b902d => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:35:05.507863 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-4094150f-9f8c-4d45-8083-f1221ec07693 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:35:05.509462 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-4094150f-9f8c-4d45-8083-f1221ec07693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:05.609538 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3351/6659] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:35:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:35:05.620573 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5501b034-bc12-44df-a1e1-f66772c255d1 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:05.620861 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5501b034-bc12-44df-a1e1-f66772c255d1 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:05.621136 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5501b034-bc12-44df-a1e1-f66772c255d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:05.668110 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-5501b034-bc12-44df-a1e1-f66772c255d1 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:35:05.671540 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-5501b034-bc12-44df-a1e1-f66772c255d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:05.693266 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3309/6660] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:35:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:35:05.697499 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4094150f-9f8c-4d45-8083-f1221ec07693 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:05.711741 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4094150f-9f8c-4d45-8083-f1221ec07693 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:05.720020 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c0513d-42a0-4d15-9525-318083398467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:05.722149 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c0513d-42a0-4d15-9525-318083398467 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:05.722594 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c0513d-42a0-4d15-9525-318083398467 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:05.722972 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c0513d-42a0-4d15-9525-318083398467 admin admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:05.724221 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c0513d-42a0-4d15-9525-318083398467 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:35:05.724633 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c0513d-42a0-4d15-9525-318083398467 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:05.727585 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c0513d-42a0-4d15-9525-318083398467 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:05.747292 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3352/6661] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:35:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:35:05.751800 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5501b034-bc12-44df-a1e1-f66772c255d1 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:05.765598 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5501b034-bc12-44df-a1e1-f66772c255d1 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:05.772200 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b4a802-44e6-4321-88ca-6c75906413d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:05.774224 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b4a802-44e6-4321-88ca-6c75906413d3 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:05.774780 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b4a802-44e6-4321-88ca-6c75906413d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:05.775415 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b4a802-44e6-4321-88ca-6c75906413d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:05.776543 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b4a802-44e6-4321-88ca-6c75906413d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:05.780676 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b4a802-44e6-4321-88ca-6c75906413d3 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:05.827613 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3310/6662] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:35:05 2022] POST /identity/v3/projects => generated 387 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:35:05.832226 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c0513d-42a0-4d15-9525-318083398467 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:05.851167 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c0513d-42a0-4d15-9525-318083398467 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:05.921838 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b4a802-44e6-4321-88ca-6c75906413d3 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:05.927951 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-43b4a802-44e6-4321-88ca-6c75906413d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:05.982713 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd23bf8e-686f-4098-a8c1-56ab51428ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:05.986241 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd23bf8e-686f-4098-a8c1-56ab51428ff1 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:05.987980 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd23bf8e-686f-4098-a8c1-56ab51428ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:05.988452 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd23bf8e-686f-4098-a8c1-56ab51428ff1 admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:05.989281 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd23bf8e-686f-4098-a8c1-56ab51428ff1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:05.996600 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd23bf8e-686f-4098-a8c1-56ab51428ff1 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:06.052253 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3353/6663] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:35:05 2022] POST /identity/v3/users => generated 294 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:35:06.054963 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd23bf8e-686f-4098-a8c1-56ab51428ff1 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:06.092653 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b4a802-44e6-4321-88ca-6c75906413d3 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:06.103352 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17918ffc-f876-457e-865e-49387aed2ea7 tempest-QuotasTest-286877906 tempest-QuotasTest-286877906-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61b48bdcb60b41cf9abc989e973d811d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e7b18adaeb456c847141c48da72e98', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:06.104258 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17918ffc-f876-457e-865e-49387aed2ea7 tempest-QuotasTest-286877906 tempest-QuotasTest-286877906-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:06.104675 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17918ffc-f876-457e-865e-49387aed2ea7 tempest-QuotasTest-286877906 tempest-QuotasTest-286877906-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:06.104957 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17918ffc-f876-457e-865e-49387aed2ea7 tempest-QuotasTest-286877906 tempest-QuotasTest-286877906-project-admin] PATH_INFO: `/v3/projects/2d6f38fa57304460b2d8275fd428cc7e` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:06.106385 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17918ffc-f876-457e-865e-49387aed2ea7 tempest-QuotasTest-286877906 tempest-QuotasTest-286877906-project-admin] RBAC: Authorizing `identity:delete_project(project_id=2d6f38fa57304460b2d8275fd428cc7e)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:06.108678 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17918ffc-f876-457e-865e-49387aed2ea7 tempest-QuotasTest-286877906 tempest-QuotasTest-286877906-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:06.109991 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd23bf8e-686f-4098-a8c1-56ab51428ff1 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:06.124716 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0882d43f-013e-4f4f-8649-e75f5360f072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:06.125417 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0882d43f-013e-4f4f-8649-e75f5360f072 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:06.125750 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0882d43f-013e-4f4f-8649-e75f5360f072 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:06.126047 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0882d43f-013e-4f4f-8649-e75f5360f072 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:06.126780 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0882d43f-013e-4f4f-8649-e75f5360f072 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:06.128399 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0882d43f-013e-4f4f-8649-e75f5360f072 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:06.151320 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:35:06.170439 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3354/6664] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:35:06 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:35:06.172316 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0882d43f-013e-4f4f-8649-e75f5360f072 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:06.191026 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-17918ffc-f876-457e-865e-49387aed2ea7 tempest-QuotasTest-286877906 tempest-QuotasTest-286877906-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d6f38fa57304460b2d8275fd428cc7e', 'request_id': 'req-17918ffc-f876-457e-865e-49387aed2ea7'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:06.193742 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0882d43f-013e-4f4f-8649-e75f5360f072 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:06.210739 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-17918ffc-f876-457e-865e-49387aed2ea7 tempest-QuotasTest-286877906 tempest-QuotasTest-286877906-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d6f38fa57304460b2d8275fd428cc7e', 'request_id': 'req-17918ffc-f876-457e-865e-49387aed2ea7'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:06.217127 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-17918ffc-f876-457e-865e-49387aed2ea7 tempest-QuotasTest-286877906 tempest-QuotasTest-286877906-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d6f38fa57304460b2d8275fd428cc7e', 'request_id': 'req-17918ffc-f876-457e-865e-49387aed2ea7'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:06.236545 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-17918ffc-f876-457e-865e-49387aed2ea7 tempest-QuotasTest-286877906 tempest-QuotasTest-286877906-project-admin] The token cache is being invalidate because project 2d6f38fa57304460b2d8275fd428cc7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:35:06.236839 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-17918ffc-f876-457e-865e-49387aed2ea7 tempest-QuotasTest-286877906 tempest-QuotasTest-286877906-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:06.237595 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-17918ffc-f876-457e-865e-49387aed2ea7 tempest-QuotasTest-286877906 tempest-QuotasTest-286877906-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:06.239831 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3311/6665] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:35:05 2022] DELETE /identity/v3/projects/2d6f38fa57304460b2d8275fd428cc7e => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:35:06.290965 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bb97ae-e649-47f9-9060-1f387a4814ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:06.291995 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bb97ae-e649-47f9-9060-1f387a4814ae admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:06.292303 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bb97ae-e649-47f9-9060-1f387a4814ae admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:06.292566 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bb97ae-e649-47f9-9060-1f387a4814ae admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:06.293312 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bb97ae-e649-47f9-9060-1f387a4814ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:06.295342 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bb97ae-e649-47f9-9060-1f387a4814ae admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:06.308852 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3355/6666] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:35:06 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:35:06.313069 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17918ffc-f876-457e-865e-49387aed2ea7 tempest-QuotasTest-286877906 tempest-QuotasTest-286877906-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:06.317974 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-17918ffc-f876-457e-865e-49387aed2ea7 tempest-QuotasTest-286877906 tempest-QuotasTest-286877906-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:06.377917 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17918ffc-f876-457e-865e-49387aed2ea7 tempest-QuotasTest-286877906 tempest-QuotasTest-286877906-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:06.384356 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7752b8c-053a-48a5-8229-b9a35f570ed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:06.385998 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7752b8c-053a-48a5-8229-b9a35f570ed7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:06.385998 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7752b8c-053a-48a5-8229-b9a35f570ed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:06.386189 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7752b8c-053a-48a5-8229-b9a35f570ed7 admin admin] PATH_INFO: `/v3/projects/7e5613c85001486aa962a53f28d95223/users/b2560166803945689ad9514b4620b45e/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:06.412750 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7752b8c-053a-48a5-8229-b9a35f570ed7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e5613c85001486aa962a53f28d95223, user_id=b2560166803945689ad9514b4620b45e, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:06.427901 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7752b8c-053a-48a5-8229-b9a35f570ed7 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:06.481849 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3312/6667] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:35:06 2022] PUT /identity/v3/projects/7e5613c85001486aa962a53f28d95223/users/b2560166803945689ad9514b4620b45e/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:35:06.493654 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ebba12-0ccf-4fd3-8ea8-e4be052ee434 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:06.494038 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ebba12-0ccf-4fd3-8ea8-e4be052ee434 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:06.494322 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ebba12-0ccf-4fd3-8ea8-e4be052ee434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:06.548438 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-49ebba12-0ccf-4fd3-8ea8-e4be052ee434 None None] MFA Rules not processed for user `b2560166803945689ad9514b4620b45e`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:35:06.549675 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-49ebba12-0ccf-4fd3-8ea8-e4be052ee434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:06.685920 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3356/6668] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:35:06 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:35:06.690178 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7752b8c-053a-48a5-8229-b9a35f570ed7 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:06.741738 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:35:06.795637 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7752b8c-053a-48a5-8229-b9a35f570ed7 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:06.802010 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419a032d-906a-4b7c-bbf4-aaf423881d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:06.803108 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419a032d-906a-4b7c-bbf4-aaf423881d08 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:06.803506 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419a032d-906a-4b7c-bbf4-aaf423881d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:06.803875 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419a032d-906a-4b7c-bbf4-aaf423881d08 admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:06.805029 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419a032d-906a-4b7c-bbf4-aaf423881d08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:06.807307 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419a032d-906a-4b7c-bbf4-aaf423881d08 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:06.841927 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ebba12-0ccf-4fd3-8ea8-e4be052ee434 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:06.844604 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-49ebba12-0ccf-4fd3-8ea8-e4be052ee434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:06.861732 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3313/6669] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:35:06 2022] POST /identity/v3/projects => generated 389 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:35:06.867116 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419a032d-906a-4b7c-bbf4-aaf423881d08 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:06.873420 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ebba12-0ccf-4fd3-8ea8-e4be052ee434 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:07.018945 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91391a6b-c9b4-4101-83f3-6bcf0ec22c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:07.020241 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91391a6b-c9b4-4101-83f3-6bcf0ec22c2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:07.020749 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91391a6b-c9b4-4101-83f3-6bcf0ec22c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:07.020876 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419a032d-906a-4b7c-bbf4-aaf423881d08 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:07.021411 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91391a6b-c9b4-4101-83f3-6bcf0ec22c2c admin admin] PATH_INFO: `/v3/users/9c7d8a8b408546a5af5a534f17a65083` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:07.023340 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91391a6b-c9b4-4101-83f3-6bcf0ec22c2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c7d8a8b408546a5af5a534f17a65083)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:07.025800 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91391a6b-c9b4-4101-83f3-6bcf0ec22c2c admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:07.032466 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441031ab-7671-4002-b626-b61f15b748e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:07.033488 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441031ab-7671-4002-b626-b61f15b748e8 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:07.033488 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441031ab-7671-4002-b626-b61f15b748e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:07.038684 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441031ab-7671-4002-b626-b61f15b748e8 admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:07.054337 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441031ab-7671-4002-b626-b61f15b748e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:07.057307 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441031ab-7671-4002-b626-b61f15b748e8 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:07.071595 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:35:07.100367 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3314/6670] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:35:06 2022] POST /identity/v3/users => generated 301 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:35:07.102785 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441031ab-7671-4002-b626-b61f15b748e8 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:07.114786 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-91391a6b-c9b4-4101-83f3-6bcf0ec22c2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c7d8a8b408546a5af5a534f17a65083'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:07.116363 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-91391a6b-c9b4-4101-83f3-6bcf0ec22c2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c7d8a8b408546a5af5a534f17a65083'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:07.126134 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441031ab-7671-4002-b626-b61f15b748e8 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:07.131449 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b665231e-9c13-4d4f-b488-3d990b89e099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:07.132311 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b665231e-9c13-4d4f-b488-3d990b89e099 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:07.132596 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b665231e-9c13-4d4f-b488-3d990b89e099 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:07.133029 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b665231e-9c13-4d4f-b488-3d990b89e099 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:07.133774 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b665231e-9c13-4d4f-b488-3d990b89e099 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:07.134487 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-91391a6b-c9b4-4101-83f3-6bcf0ec22c2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c7d8a8b408546a5af5a534f17a65083'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:07.135434 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b665231e-9c13-4d4f-b488-3d990b89e099 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:07.150877 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-91391a6b-c9b4-4101-83f3-6bcf0ec22c2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c7d8a8b408546a5af5a534f17a65083'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:07.161700 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3315/6671] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:35:07 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:35:07.164966 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b665231e-9c13-4d4f-b488-3d990b89e099 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:07.177937 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-91391a6b-c9b4-4101-83f3-6bcf0ec22c2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c7d8a8b408546a5af5a534f17a65083'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:07.181497 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b665231e-9c13-4d4f-b488-3d990b89e099 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:07.187217 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a52e95f-5b36-4384-ae04-bb5f4e7e9476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:07.188163 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a52e95f-5b36-4384-ae04-bb5f4e7e9476 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:07.191485 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a52e95f-5b36-4384-ae04-bb5f4e7e9476 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:07.191485 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a52e95f-5b36-4384-ae04-bb5f4e7e9476 admin admin] PATH_INFO: `/v3/projects/3ec228a9841b420d913021b2a011d25d/users/abb8b3bdfcf14821aaedc9d81efc6d9a/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:07.198091 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3357/6672] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:35:06 2022] DELETE /identity/v3/users/9c7d8a8b408546a5af5a534f17a65083 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:35:07.204169 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06214902-078c-451d-b8ce-f4f38129cc19 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:07.204660 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06214902-078c-451d-b8ce-f4f38129cc19 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:07.205268 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06214902-078c-451d-b8ce-f4f38129cc19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:07.230110 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a52e95f-5b36-4384-ae04-bb5f4e7e9476 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ec228a9841b420d913021b2a011d25d, user_id=abb8b3bdfcf14821aaedc9d81efc6d9a, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:07.233288 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a52e95f-5b36-4384-ae04-bb5f4e7e9476 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:07.245372 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-06214902-078c-451d-b8ce-f4f38129cc19 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:35:07.247044 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-06214902-078c-451d-b8ce-f4f38129cc19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:07.261310 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3316/6673] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:35:07 2022] PUT /identity/v3/projects/3ec228a9841b420d913021b2a011d25d/users/abb8b3bdfcf14821aaedc9d81efc6d9a/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:35:07.265691 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a52e95f-5b36-4384-ae04-bb5f4e7e9476 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:07.268554 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-6a52e95f-5b36-4384-ae04-bb5f4e7e9476 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:07.407883 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a52e95f-5b36-4384-ae04-bb5f4e7e9476 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:07.415899 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c632764-d535-495f-8468-4a5a954afde4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:07.416858 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c632764-d535-495f-8468-4a5a954afde4 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:07.417366 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c632764-d535-495f-8468-4a5a954afde4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:07.417833 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c632764-d535-495f-8468-4a5a954afde4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:07.418848 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c632764-d535-495f-8468-4a5a954afde4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:07.422981 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c632764-d535-495f-8468-4a5a954afde4 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:07.440448 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3358/6674] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:35:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:35:07.446843 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3317/6675] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:35:07 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 21:35:07.451308 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06214902-078c-451d-b8ce-f4f38129cc19 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:07.465778 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06214902-078c-451d-b8ce-f4f38129cc19 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:07.475064 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c632764-d535-495f-8468-4a5a954afde4 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:07.479652 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-8c632764-d535-495f-8468-4a5a954afde4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:07.484824 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef7e47b-ac37-4e90-8bce-1ca21196972a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:07.485739 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef7e47b-ac37-4e90-8bce-1ca21196972a admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:07.486072 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef7e47b-ac37-4e90-8bce-1ca21196972a admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:07.486345 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef7e47b-ac37-4e90-8bce-1ca21196972a admin admin] PATH_INFO: `/v3/projects/3ec228a9841b420d913021b2a011d25d/users/abb8b3bdfcf14821aaedc9d81efc6d9a/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:07.488680 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef7e47b-ac37-4e90-8bce-1ca21196972a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ec228a9841b420d913021b2a011d25d, user_id=abb8b3bdfcf14821aaedc9d81efc6d9a, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:07.491354 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef7e47b-ac37-4e90-8bce-1ca21196972a admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:07.517044 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:35:07.522276 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3359/6676] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:35:07 2022] PUT /identity/v3/projects/3ec228a9841b420d913021b2a011d25d/users/abb8b3bdfcf14821aaedc9d81efc6d9a/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:35:07.535543 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df82186e-6472-4ded-9cb5-58bd862a5adf None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:07.535830 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df82186e-6472-4ded-9cb5-58bd862a5adf None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:07.536102 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df82186e-6472-4ded-9cb5-58bd862a5adf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:07.597894 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-df82186e-6472-4ded-9cb5-58bd862a5adf None None] MFA Rules not processed for user `abb8b3bdfcf14821aaedc9d81efc6d9a`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:35:07.599728 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-df82186e-6472-4ded-9cb5-58bd862a5adf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:07.655391 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c632764-d535-495f-8468-4a5a954afde4 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:07.769278 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3360/6677] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:35:07 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:35:07.772310 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df82186e-6472-4ded-9cb5-58bd862a5adf None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:07.792310 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df82186e-6472-4ded-9cb5-58bd862a5adf None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:07.797440 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf26d673-2867-4c81-af9f-15acb7cd5be5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:07.798836 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296a51bb-8aa0-4979-8f85-fe8272fa5f13 tempest-ListProjectsStaticTestJSON-1954147880 tempest-ListProjectsStaticTestJSON-1954147880-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abb8b3bdfcf14821aaedc9d81efc6d9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ec228a9841b420d913021b2a011d25d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:07.799710 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296a51bb-8aa0-4979-8f85-fe8272fa5f13 tempest-ListProjectsStaticTestJSON-1954147880 tempest-ListProjectsStaticTestJSON-1954147880-project-admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:07.800182 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296a51bb-8aa0-4979-8f85-fe8272fa5f13 tempest-ListProjectsStaticTestJSON-1954147880 tempest-ListProjectsStaticTestJSON-1954147880-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:07.800558 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296a51bb-8aa0-4979-8f85-fe8272fa5f13 tempest-ListProjectsStaticTestJSON-1954147880 tempest-ListProjectsStaticTestJSON-1954147880-project-admin] PATH_INFO: `/v3/projects/7e5613c85001486aa962a53f28d95223` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:07.801016 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf26d673-2867-4c81-af9f-15acb7cd5be5 service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:07.801394 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf26d673-2867-4c81-af9f-15acb7cd5be5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:07.801785 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf26d673-2867-4c81-af9f-15acb7cd5be5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:07.802477 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296a51bb-8aa0-4979-8f85-fe8272fa5f13 tempest-ListProjectsStaticTestJSON-1954147880 tempest-ListProjectsStaticTestJSON-1954147880-project-admin] RBAC: Authorizing `identity:get_project(project_id=7e5613c85001486aa962a53f28d95223)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:07.806061 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296a51bb-8aa0-4979-8f85-fe8272fa5f13 tempest-ListProjectsStaticTestJSON-1954147880 tempest-ListProjectsStaticTestJSON-1954147880-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:07.809934 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3361/6678] 10.222.0.17 () {58 vars in 1229 bytes} [Sat Jul 23 21:35:07 2022] GET /identity/v3/projects/7e5613c85001486aa962a53f28d95223 => generated 387 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:35:07.813550 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296a51bb-8aa0-4979-8f85-fe8272fa5f13 tempest-ListProjectsStaticTestJSON-1954147880 tempest-ListProjectsStaticTestJSON-1954147880-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:07.845527 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296a51bb-8aa0-4979-8f85-fe8272fa5f13 tempest-ListProjectsStaticTestJSON-1954147880 tempest-ListProjectsStaticTestJSON-1954147880-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:07.856635 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a411e179-54bb-44ec-be0a-3226f5b2a9da tempest-ListProjectsStaticTestJSON-1954147880 tempest-ListProjectsStaticTestJSON-1954147880-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abb8b3bdfcf14821aaedc9d81efc6d9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ec228a9841b420d913021b2a011d25d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:07.858327 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a411e179-54bb-44ec-be0a-3226f5b2a9da tempest-ListProjectsStaticTestJSON-1954147880 tempest-ListProjectsStaticTestJSON-1954147880-project-admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:07.858852 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a411e179-54bb-44ec-be0a-3226f5b2a9da tempest-ListProjectsStaticTestJSON-1954147880 tempest-ListProjectsStaticTestJSON-1954147880-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:07.860510 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a411e179-54bb-44ec-be0a-3226f5b2a9da tempest-ListProjectsStaticTestJSON-1954147880 tempest-ListProjectsStaticTestJSON-1954147880-project-admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:07.862189 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a411e179-54bb-44ec-be0a-3226f5b2a9da tempest-ListProjectsStaticTestJSON-1954147880 tempest-ListProjectsStaticTestJSON-1954147880-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:07.867582 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a411e179-54bb-44ec-be0a-3226f5b2a9da tempest-ListProjectsStaticTestJSON-1954147880 tempest-ListProjectsStaticTestJSON-1954147880-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:07.888098 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:35:07.933842 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf26d673-2867-4c81-af9f-15acb7cd5be5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:07.935355 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3362/6679] 10.222.0.17 () {60 vars in 1151 bytes} [Sat Jul 23 21:35:07 2022] POST /identity/v3/projects => generated 338 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:35:07.936500 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf26d673-2867-4c81-af9f-15acb7cd5be5 service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:07.940384 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a411e179-54bb-44ec-be0a-3226f5b2a9da tempest-ListProjectsStaticTestJSON-1954147880 tempest-ListProjectsStaticTestJSON-1954147880-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:07.971024 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3318/6680] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:35:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:35:08.055038 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a411e179-54bb-44ec-be0a-3226f5b2a9da tempest-ListProjectsStaticTestJSON-1954147880 tempest-ListProjectsStaticTestJSON-1954147880-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:08.073890 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9eb4c9b-5c13-4561-b610-45806c1f97f7 tempest-ListProjectsStaticTestJSON-1954147880 tempest-ListProjectsStaticTestJSON-1954147880-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abb8b3bdfcf14821aaedc9d81efc6d9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ec228a9841b420d913021b2a011d25d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:08.075381 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eb4c9b-5c13-4561-b610-45806c1f97f7 tempest-ListProjectsStaticTestJSON-1954147880 tempest-ListProjectsStaticTestJSON-1954147880-project-admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:08.076344 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eb4c9b-5c13-4561-b610-45806c1f97f7 tempest-ListProjectsStaticTestJSON-1954147880 tempest-ListProjectsStaticTestJSON-1954147880-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:08.076734 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eb4c9b-5c13-4561-b610-45806c1f97f7 tempest-ListProjectsStaticTestJSON-1954147880 tempest-ListProjectsStaticTestJSON-1954147880-project-admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:08.078299 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9eb4c9b-5c13-4561-b610-45806c1f97f7 tempest-ListProjectsStaticTestJSON-1954147880 tempest-ListProjectsStaticTestJSON-1954147880-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:08.080556 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9eb4c9b-5c13-4561-b610-45806c1f97f7 tempest-ListProjectsStaticTestJSON-1954147880 tempest-ListProjectsStaticTestJSON-1954147880-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:08.121445 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3363/6681] 10.222.0.17 () {58 vars in 1130 bytes} [Sat Jul 23 21:35:07 2022] GET /identity/v3/projects => generated 7652 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 21:35:08.124033 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf26d673-2867-4c81-af9f-15acb7cd5be5 service neutron] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:08.139834 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf26d673-2867-4c81-af9f-15acb7cd5be5 service neutron] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:08.153067 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c3145e-e6ed-48a4-b8ec-76aa8d9cd254 tempest-ListProjectsStaticTestJSON-1954147880 tempest-ListProjectsStaticTestJSON-1954147880-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abb8b3bdfcf14821aaedc9d81efc6d9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ec228a9841b420d913021b2a011d25d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:08.154243 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c3145e-e6ed-48a4-b8ec-76aa8d9cd254 tempest-ListProjectsStaticTestJSON-1954147880 tempest-ListProjectsStaticTestJSON-1954147880-project-admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:08.155144 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c3145e-e6ed-48a4-b8ec-76aa8d9cd254 tempest-ListProjectsStaticTestJSON-1954147880 tempest-ListProjectsStaticTestJSON-1954147880-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:08.156328 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c3145e-e6ed-48a4-b8ec-76aa8d9cd254 tempest-ListProjectsStaticTestJSON-1954147880 tempest-ListProjectsStaticTestJSON-1954147880-project-admin] PATH_INFO: `/v3/projects/7e5613c85001486aa962a53f28d95223` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:08.158468 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c3145e-e6ed-48a4-b8ec-76aa8d9cd254 tempest-ListProjectsStaticTestJSON-1954147880 tempest-ListProjectsStaticTestJSON-1954147880-project-admin] RBAC: Authorizing `identity:get_project(project_id=7e5613c85001486aa962a53f28d95223)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:08.162611 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c3145e-e6ed-48a4-b8ec-76aa8d9cd254 tempest-ListProjectsStaticTestJSON-1954147880 tempest-ListProjectsStaticTestJSON-1954147880-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:08.170124 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9eb4c9b-5c13-4561-b610-45806c1f97f7 tempest-ListProjectsStaticTestJSON-1954147880 tempest-ListProjectsStaticTestJSON-1954147880-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:08.171160 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3319/6682] 10.222.0.17 () {58 vars in 1229 bytes} [Sat Jul 23 21:35:08 2022] GET /identity/v3/projects/7e5613c85001486aa962a53f28d95223 => generated 387 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 21:35:08.188065 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9eb4c9b-5c13-4561-b610-45806c1f97f7 tempest-ListProjectsStaticTestJSON-1954147880 tempest-ListProjectsStaticTestJSON-1954147880-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:08.202183 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b441bae7-86a6-4aba-bc6c-d1d4d0fd1c35 tempest-ListProjectsStaticTestJSON-1954147880 tempest-ListProjectsStaticTestJSON-1954147880-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abb8b3bdfcf14821aaedc9d81efc6d9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ec228a9841b420d913021b2a011d25d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:08.203444 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b441bae7-86a6-4aba-bc6c-d1d4d0fd1c35 tempest-ListProjectsStaticTestJSON-1954147880 tempest-ListProjectsStaticTestJSON-1954147880-project-admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:08.203764 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b441bae7-86a6-4aba-bc6c-d1d4d0fd1c35 tempest-ListProjectsStaticTestJSON-1954147880 tempest-ListProjectsStaticTestJSON-1954147880-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:08.204320 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b441bae7-86a6-4aba-bc6c-d1d4d0fd1c35 tempest-ListProjectsStaticTestJSON-1954147880 tempest-ListProjectsStaticTestJSON-1954147880-project-admin] PATH_INFO: `/v3/projects/d9de98d38c6645708c2e06b97d03e6ae` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:08.206800 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b441bae7-86a6-4aba-bc6c-d1d4d0fd1c35 tempest-ListProjectsStaticTestJSON-1954147880 tempest-ListProjectsStaticTestJSON-1954147880-project-admin] RBAC: Authorizing `identity:get_project(project_id=d9de98d38c6645708c2e06b97d03e6ae)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:08.210305 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b441bae7-86a6-4aba-bc6c-d1d4d0fd1c35 tempest-ListProjectsStaticTestJSON-1954147880 tempest-ListProjectsStaticTestJSON-1954147880-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:08.220298 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c3145e-e6ed-48a4-b8ec-76aa8d9cd254 tempest-ListProjectsStaticTestJSON-1954147880 tempest-ListProjectsStaticTestJSON-1954147880-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:08.228787 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3364/6683] 10.222.0.17 () {58 vars in 1229 bytes} [Sat Jul 23 21:35:08 2022] GET /identity/v3/projects/d9de98d38c6645708c2e06b97d03e6ae => generated 338 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:35:08.234127 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c3145e-e6ed-48a4-b8ec-76aa8d9cd254 tempest-ListProjectsStaticTestJSON-1954147880 tempest-ListProjectsStaticTestJSON-1954147880-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:08.241298 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e769be-f02d-466c-9615-b08886c3e57b tempest-ListProjectsStaticTestJSON-1954147880 tempest-ListProjectsStaticTestJSON-1954147880-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abb8b3bdfcf14821aaedc9d81efc6d9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ec228a9841b420d913021b2a011d25d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:08.242376 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e769be-f02d-466c-9615-b08886c3e57b tempest-ListProjectsStaticTestJSON-1954147880 tempest-ListProjectsStaticTestJSON-1954147880-project-admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:08.242772 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e769be-f02d-466c-9615-b08886c3e57b tempest-ListProjectsStaticTestJSON-1954147880 tempest-ListProjectsStaticTestJSON-1954147880-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:08.243194 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e769be-f02d-466c-9615-b08886c3e57b tempest-ListProjectsStaticTestJSON-1954147880 tempest-ListProjectsStaticTestJSON-1954147880-project-admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:08.244694 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e769be-f02d-466c-9615-b08886c3e57b tempest-ListProjectsStaticTestJSON-1954147880 tempest-ListProjectsStaticTestJSON-1954147880-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:08.248010 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e769be-f02d-466c-9615-b08886c3e57b tempest-ListProjectsStaticTestJSON-1954147880 tempest-ListProjectsStaticTestJSON-1954147880-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:08.307737 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b441bae7-86a6-4aba-bc6c-d1d4d0fd1c35 tempest-ListProjectsStaticTestJSON-1954147880 tempest-ListProjectsStaticTestJSON-1954147880-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:08.319106 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3320/6684] 10.222.0.17 () {58 vars in 1130 bytes} [Sat Jul 23 21:35:08 2022] GET /identity/v3/projects => generated 7652 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:35:08.323605 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b441bae7-86a6-4aba-bc6c-d1d4d0fd1c35 tempest-ListProjectsStaticTestJSON-1954147880 tempest-ListProjectsStaticTestJSON-1954147880-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:08.339353 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c519b8-9a59-4992-a519-5b91a86a64f2 tempest-ListProjectsStaticTestJSON-1954147880 tempest-ListProjectsStaticTestJSON-1954147880-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abb8b3bdfcf14821aaedc9d81efc6d9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ec228a9841b420d913021b2a011d25d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:08.340223 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c519b8-9a59-4992-a519-5b91a86a64f2 tempest-ListProjectsStaticTestJSON-1954147880 tempest-ListProjectsStaticTestJSON-1954147880-project-admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:08.340616 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c519b8-9a59-4992-a519-5b91a86a64f2 tempest-ListProjectsStaticTestJSON-1954147880 tempest-ListProjectsStaticTestJSON-1954147880-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:08.340992 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c519b8-9a59-4992-a519-5b91a86a64f2 tempest-ListProjectsStaticTestJSON-1954147880 tempest-ListProjectsStaticTestJSON-1954147880-project-admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:08.342062 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c519b8-9a59-4992-a519-5b91a86a64f2 tempest-ListProjectsStaticTestJSON-1954147880 tempest-ListProjectsStaticTestJSON-1954147880-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:35:08.346613 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c519b8-9a59-4992-a519-5b91a86a64f2 tempest-ListProjectsStaticTestJSON-1954147880 tempest-ListProjectsStaticTestJSON-1954147880-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:08.349418 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c519b8-9a59-4992-a519-5b91a86a64f2 tempest-ListProjectsStaticTestJSON-1954147880 tempest-ListProjectsStaticTestJSON-1954147880-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:08.405205 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3365/6685] 10.222.0.17 () {58 vars in 1165 bytes} [Sat Jul 23 21:35:08 2022] GET /identity/v3/projects?domain_id=default => generated 7321 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:35:08.406661 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e769be-f02d-466c-9615-b08886c3e57b tempest-ListProjectsStaticTestJSON-1954147880 tempest-ListProjectsStaticTestJSON-1954147880-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:08.438847 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e769be-f02d-466c-9615-b08886c3e57b tempest-ListProjectsStaticTestJSON-1954147880 tempest-ListProjectsStaticTestJSON-1954147880-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:08.454416 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5e1006-e064-4d84-81a3-41a8e4fd8223 tempest-ListProjectsStaticTestJSON-1954147880 tempest-ListProjectsStaticTestJSON-1954147880-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abb8b3bdfcf14821aaedc9d81efc6d9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ec228a9841b420d913021b2a011d25d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:08.455334 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5e1006-e064-4d84-81a3-41a8e4fd8223 tempest-ListProjectsStaticTestJSON-1954147880 tempest-ListProjectsStaticTestJSON-1954147880-project-admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:08.456109 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5e1006-e064-4d84-81a3-41a8e4fd8223 tempest-ListProjectsStaticTestJSON-1954147880 tempest-ListProjectsStaticTestJSON-1954147880-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:08.456568 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5e1006-e064-4d84-81a3-41a8e4fd8223 tempest-ListProjectsStaticTestJSON-1954147880 tempest-ListProjectsStaticTestJSON-1954147880-project-admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:08.457574 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5e1006-e064-4d84-81a3-41a8e4fd8223 tempest-ListProjectsStaticTestJSON-1954147880 tempest-ListProjectsStaticTestJSON-1954147880-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:08.459743 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5e1006-e064-4d84-81a3-41a8e4fd8223 tempest-ListProjectsStaticTestJSON-1954147880 tempest-ListProjectsStaticTestJSON-1954147880-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:08.490423 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3321/6686] 10.222.0.17 () {58 vars in 1130 bytes} [Sat Jul 23 21:35:08 2022] GET /identity/v3/projects => generated 7652 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:35:08.495528 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c519b8-9a59-4992-a519-5b91a86a64f2 tempest-ListProjectsStaticTestJSON-1954147880 tempest-ListProjectsStaticTestJSON-1954147880-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:08.509749 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c519b8-9a59-4992-a519-5b91a86a64f2 tempest-ListProjectsStaticTestJSON-1954147880 tempest-ListProjectsStaticTestJSON-1954147880-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:08.515073 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884588f5-98cc-4345-8b6e-40489687a4d4 tempest-ListProjectsStaticTestJSON-1954147880 tempest-ListProjectsStaticTestJSON-1954147880-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abb8b3bdfcf14821aaedc9d81efc6d9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ec228a9841b420d913021b2a011d25d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:08.515905 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884588f5-98cc-4345-8b6e-40489687a4d4 tempest-ListProjectsStaticTestJSON-1954147880 tempest-ListProjectsStaticTestJSON-1954147880-project-admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:08.516308 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884588f5-98cc-4345-8b6e-40489687a4d4 tempest-ListProjectsStaticTestJSON-1954147880 tempest-ListProjectsStaticTestJSON-1954147880-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:08.516810 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884588f5-98cc-4345-8b6e-40489687a4d4 tempest-ListProjectsStaticTestJSON-1954147880 tempest-ListProjectsStaticTestJSON-1954147880-project-admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:08.517670 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884588f5-98cc-4345-8b6e-40489687a4d4 tempest-ListProjectsStaticTestJSON-1954147880 tempest-ListProjectsStaticTestJSON-1954147880-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:35:08.518195 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884588f5-98cc-4345-8b6e-40489687a4d4 tempest-ListProjectsStaticTestJSON-1954147880 tempest-ListProjectsStaticTestJSON-1954147880-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:08.520215 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884588f5-98cc-4345-8b6e-40489687a4d4 tempest-ListProjectsStaticTestJSON-1954147880 tempest-ListProjectsStaticTestJSON-1954147880-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:08.547054 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3366/6687] 10.222.0.17 () {58 vars in 1165 bytes} [Sat Jul 23 21:35:08 2022] GET /identity/v3/projects?domain_id=default => generated 7321 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:35:08.557749 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5e1006-e064-4d84-81a3-41a8e4fd8223 tempest-ListProjectsStaticTestJSON-1954147880 tempest-ListProjectsStaticTestJSON-1954147880-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:08.573797 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5e1006-e064-4d84-81a3-41a8e4fd8223 tempest-ListProjectsStaticTestJSON-1954147880 tempest-ListProjectsStaticTestJSON-1954147880-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:08.585891 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62abcacd-2973-4931-970a-715f8cf16920 tempest-ListProjectsStaticTestJSON-1954147880 tempest-ListProjectsStaticTestJSON-1954147880-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abb8b3bdfcf14821aaedc9d81efc6d9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ec228a9841b420d913021b2a011d25d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:08.588419 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62abcacd-2973-4931-970a-715f8cf16920 tempest-ListProjectsStaticTestJSON-1954147880 tempest-ListProjectsStaticTestJSON-1954147880-project-admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:08.588865 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62abcacd-2973-4931-970a-715f8cf16920 tempest-ListProjectsStaticTestJSON-1954147880 tempest-ListProjectsStaticTestJSON-1954147880-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:08.589153 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62abcacd-2973-4931-970a-715f8cf16920 tempest-ListProjectsStaticTestJSON-1954147880 tempest-ListProjectsStaticTestJSON-1954147880-project-admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:08.590238 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62abcacd-2973-4931-970a-715f8cf16920 tempest-ListProjectsStaticTestJSON-1954147880 tempest-ListProjectsStaticTestJSON-1954147880-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:08.592158 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62abcacd-2973-4931-970a-715f8cf16920 tempest-ListProjectsStaticTestJSON-1954147880 tempest-ListProjectsStaticTestJSON-1954147880-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:08.623071 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3322/6688] 10.222.0.17 () {58 vars in 1130 bytes} [Sat Jul 23 21:35:08 2022] GET /identity/v3/projects => generated 7652 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 21:35:08.624575 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884588f5-98cc-4345-8b6e-40489687a4d4 tempest-ListProjectsStaticTestJSON-1954147880 tempest-ListProjectsStaticTestJSON-1954147880-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:08.636427 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884588f5-98cc-4345-8b6e-40489687a4d4 tempest-ListProjectsStaticTestJSON-1954147880 tempest-ListProjectsStaticTestJSON-1954147880-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:08.642227 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5649bdb-4762-47ee-9616-d1a45bfda744 tempest-ListProjectsStaticTestJSON-1954147880 tempest-ListProjectsStaticTestJSON-1954147880-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abb8b3bdfcf14821aaedc9d81efc6d9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ec228a9841b420d913021b2a011d25d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:08.643333 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5649bdb-4762-47ee-9616-d1a45bfda744 tempest-ListProjectsStaticTestJSON-1954147880 tempest-ListProjectsStaticTestJSON-1954147880-project-admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:08.643843 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5649bdb-4762-47ee-9616-d1a45bfda744 tempest-ListProjectsStaticTestJSON-1954147880 tempest-ListProjectsStaticTestJSON-1954147880-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:08.644441 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5649bdb-4762-47ee-9616-d1a45bfda744 tempest-ListProjectsStaticTestJSON-1954147880 tempest-ListProjectsStaticTestJSON-1954147880-project-admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:08.645497 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5649bdb-4762-47ee-9616-d1a45bfda744 tempest-ListProjectsStaticTestJSON-1954147880 tempest-ListProjectsStaticTestJSON-1954147880-project-admin] RBAC: Adding query filter params (name=tempest-ListProjectsStaticTestJSON-268805196) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:35:08.646802 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5649bdb-4762-47ee-9616-d1a45bfda744 tempest-ListProjectsStaticTestJSON-1954147880 tempest-ListProjectsStaticTestJSON-1954147880-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:08.649506 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5649bdb-4762-47ee-9616-d1a45bfda744 tempest-ListProjectsStaticTestJSON-1954147880 tempest-ListProjectsStaticTestJSON-1954147880-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:08.688720 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62abcacd-2973-4931-970a-715f8cf16920 tempest-ListProjectsStaticTestJSON-1954147880 tempest-ListProjectsStaticTestJSON-1954147880-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:08.697043 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3367/6689] 10.222.0.17 () {58 vars in 1229 bytes} [Sat Jul 23 21:35:08 2022] GET /identity/v3/projects?name=tempest-ListProjectsStaticTestJSON-268805196 => generated 534 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:35:08.703175 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62abcacd-2973-4931-970a-715f8cf16920 tempest-ListProjectsStaticTestJSON-1954147880 tempest-ListProjectsStaticTestJSON-1954147880-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:08.711372 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae10bf5d-06fe-486e-bc94-72622ffa6251 tempest-ListProjectsStaticTestJSON-1954147880 tempest-ListProjectsStaticTestJSON-1954147880-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abb8b3bdfcf14821aaedc9d81efc6d9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ec228a9841b420d913021b2a011d25d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:08.712666 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae10bf5d-06fe-486e-bc94-72622ffa6251 tempest-ListProjectsStaticTestJSON-1954147880 tempest-ListProjectsStaticTestJSON-1954147880-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:08.715240 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae10bf5d-06fe-486e-bc94-72622ffa6251 tempest-ListProjectsStaticTestJSON-1954147880 tempest-ListProjectsStaticTestJSON-1954147880-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:08.715859 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae10bf5d-06fe-486e-bc94-72622ffa6251 tempest-ListProjectsStaticTestJSON-1954147880 tempest-ListProjectsStaticTestJSON-1954147880-project-admin] PATH_INFO: `/v3/projects/d9de98d38c6645708c2e06b97d03e6ae` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:08.720659 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae10bf5d-06fe-486e-bc94-72622ffa6251 tempest-ListProjectsStaticTestJSON-1954147880 tempest-ListProjectsStaticTestJSON-1954147880-project-admin] RBAC: Authorizing `identity:delete_project(project_id=d9de98d38c6645708c2e06b97d03e6ae)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:08.724682 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae10bf5d-06fe-486e-bc94-72622ffa6251 tempest-ListProjectsStaticTestJSON-1954147880 tempest-ListProjectsStaticTestJSON-1954147880-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:08.797564 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:35:08.863064 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-ae10bf5d-06fe-486e-bc94-72622ffa6251 tempest-ListProjectsStaticTestJSON-1954147880 tempest-ListProjectsStaticTestJSON-1954147880-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9de98d38c6645708c2e06b97d03e6ae', 'request_id': 'req-ae10bf5d-06fe-486e-bc94-72622ffa6251'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:08.902436 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-ae10bf5d-06fe-486e-bc94-72622ffa6251 tempest-ListProjectsStaticTestJSON-1954147880 tempest-ListProjectsStaticTestJSON-1954147880-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9de98d38c6645708c2e06b97d03e6ae', 'request_id': 'req-ae10bf5d-06fe-486e-bc94-72622ffa6251'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:08.909005 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-ae10bf5d-06fe-486e-bc94-72622ffa6251 tempest-ListProjectsStaticTestJSON-1954147880 tempest-ListProjectsStaticTestJSON-1954147880-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9de98d38c6645708c2e06b97d03e6ae', 'request_id': 'req-ae10bf5d-06fe-486e-bc94-72622ffa6251'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:08.931955 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-ae10bf5d-06fe-486e-bc94-72622ffa6251 tempest-ListProjectsStaticTestJSON-1954147880 tempest-ListProjectsStaticTestJSON-1954147880-project-admin] The token cache is being invalidate because project d9de98d38c6645708c2e06b97d03e6ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:35:08.932250 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-ae10bf5d-06fe-486e-bc94-72622ffa6251 tempest-ListProjectsStaticTestJSON-1954147880 tempest-ListProjectsStaticTestJSON-1954147880-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:08.935141 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-ae10bf5d-06fe-486e-bc94-72622ffa6251 tempest-ListProjectsStaticTestJSON-1954147880 tempest-ListProjectsStaticTestJSON-1954147880-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:08.938907 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3323/6690] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:35:08 2022] DELETE /identity/v3/projects/d9de98d38c6645708c2e06b97d03e6ae => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:35:08.944773 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5649bdb-4762-47ee-9616-d1a45bfda744 tempest-ListProjectsStaticTestJSON-1954147880 tempest-ListProjectsStaticTestJSON-1954147880-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:08.946893 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-d5649bdb-4762-47ee-9616-d1a45bfda744 tempest-ListProjectsStaticTestJSON-1954147880 tempest-ListProjectsStaticTestJSON-1954147880-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:08.978876 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae10bf5d-06fe-486e-bc94-72622ffa6251 tempest-ListProjectsStaticTestJSON-1954147880 tempest-ListProjectsStaticTestJSON-1954147880-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:08.980342 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-ae10bf5d-06fe-486e-bc94-72622ffa6251 tempest-ListProjectsStaticTestJSON-1954147880 tempest-ListProjectsStaticTestJSON-1954147880-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:09.127893 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5649bdb-4762-47ee-9616-d1a45bfda744 tempest-ListProjectsStaticTestJSON-1954147880 tempest-ListProjectsStaticTestJSON-1954147880-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:09.141572 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4edaaa5-9606-4c6b-adf7-5e55f8c8f1c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:09.143715 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4edaaa5-9606-4c6b-adf7-5e55f8c8f1c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:09.144794 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4edaaa5-9606-4c6b-adf7-5e55f8c8f1c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:09.145902 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4edaaa5-9606-4c6b-adf7-5e55f8c8f1c4 admin admin] PATH_INFO: `/v3/users/b2560166803945689ad9514b4620b45e` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:09.149323 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4edaaa5-9606-4c6b-adf7-5e55f8c8f1c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2560166803945689ad9514b4620b45e)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:09.152211 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4edaaa5-9606-4c6b-adf7-5e55f8c8f1c4 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:09.159390 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae10bf5d-06fe-486e-bc94-72622ffa6251 tempest-ListProjectsStaticTestJSON-1954147880 tempest-ListProjectsStaticTestJSON-1954147880-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:09.172554 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e709ffd7-1b8f-4c40-8b17-ccb1a32f7a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:09.174841 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e709ffd7-1b8f-4c40-8b17-ccb1a32f7a86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:09.176876 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e709ffd7-1b8f-4c40-8b17-ccb1a32f7a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:09.177319 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e709ffd7-1b8f-4c40-8b17-ccb1a32f7a86 admin admin] PATH_INFO: `/v3/projects/57b3338515b84cb8b6cb797f29443e2a` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:09.179371 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e709ffd7-1b8f-4c40-8b17-ccb1a32f7a86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=57b3338515b84cb8b6cb797f29443e2a)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:09.186029 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e709ffd7-1b8f-4c40-8b17-ccb1a32f7a86 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:09.261894 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:35:09.274184 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c4edaaa5-9606-4c6b-adf7-5e55f8c8f1c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2560166803945689ad9514b4620b45e'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:09.275301 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c4edaaa5-9606-4c6b-adf7-5e55f8c8f1c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2560166803945689ad9514b4620b45e'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:09.289937 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c4edaaa5-9606-4c6b-adf7-5e55f8c8f1c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2560166803945689ad9514b4620b45e'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:09.312818 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c4edaaa5-9606-4c6b-adf7-5e55f8c8f1c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2560166803945689ad9514b4620b45e'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:09.350239 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-e709ffd7-1b8f-4c40-8b17-ccb1a32f7a86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57b3338515b84cb8b6cb797f29443e2a', 'request_id': 'req-e709ffd7-1b8f-4c40-8b17-ccb1a32f7a86'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:09.352746 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c4edaaa5-9606-4c6b-adf7-5e55f8c8f1c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2560166803945689ad9514b4620b45e'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:09.379611 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3368/6691] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:35:08 2022] DELETE /identity/v3/users/b2560166803945689ad9514b4620b45e => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:35:09.385961 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-e709ffd7-1b8f-4c40-8b17-ccb1a32f7a86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57b3338515b84cb8b6cb797f29443e2a', 'request_id': 'req-e709ffd7-1b8f-4c40-8b17-ccb1a32f7a86'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:09.390833 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aa9f81-4263-4cac-a72d-76804f8ee2f7 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:09.391407 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aa9f81-4263-4cac-a72d-76804f8ee2f7 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:09.391890 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aa9f81-4263-4cac-a72d-76804f8ee2f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:09.402864 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-e709ffd7-1b8f-4c40-8b17-ccb1a32f7a86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57b3338515b84cb8b6cb797f29443e2a', 'request_id': 'req-e709ffd7-1b8f-4c40-8b17-ccb1a32f7a86'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:09.418213 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-13aa9f81-4263-4cac-a72d-76804f8ee2f7 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:35:09.420235 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-13aa9f81-4263-4cac-a72d-76804f8ee2f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:09.431913 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-e709ffd7-1b8f-4c40-8b17-ccb1a32f7a86 admin admin] The token cache is being invalidate because project 57b3338515b84cb8b6cb797f29443e2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:35:09.432212 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-e709ffd7-1b8f-4c40-8b17-ccb1a32f7a86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:09.434727 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-e709ffd7-1b8f-4c40-8b17-ccb1a32f7a86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:09.441493 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3324/6692] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:35:08 2022] DELETE /identity/v3/projects/57b3338515b84cb8b6cb797f29443e2a => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:35:09.445585 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e709ffd7-1b8f-4c40-8b17-ccb1a32f7a86 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:09.447077 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-e709ffd7-1b8f-4c40-8b17-ccb1a32f7a86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:09.569017 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3369/6693] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:35:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:35:09.580635 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:35:09.623253 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13aa9f81-4263-4cac-a72d-76804f8ee2f7 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:09.624725 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-13aa9f81-4263-4cac-a72d-76804f8ee2f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:09.628670 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e709ffd7-1b8f-4c40-8b17-ccb1a32f7a86 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:09.638620 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd11b67-42f9-4d97-b03d-4a4130f568f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:09.640111 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd11b67-42f9-4d97-b03d-4a4130f568f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:09.640495 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd11b67-42f9-4d97-b03d-4a4130f568f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:09.641056 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd11b67-42f9-4d97-b03d-4a4130f568f0 admin admin] PATH_INFO: `/v3/users/61b48bdcb60b41cf9abc989e973d811d` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:09.644469 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd11b67-42f9-4d97-b03d-4a4130f568f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61b48bdcb60b41cf9abc989e973d811d)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:09.652588 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd11b67-42f9-4d97-b03d-4a4130f568f0 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:09.778480 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-fbd11b67-42f9-4d97-b03d-4a4130f568f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61b48bdcb60b41cf9abc989e973d811d'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:09.797165 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13aa9f81-4263-4cac-a72d-76804f8ee2f7 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:09.805054 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-fbd11b67-42f9-4d97-b03d-4a4130f568f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61b48bdcb60b41cf9abc989e973d811d'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:09.809369 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-fbd11b67-42f9-4d97-b03d-4a4130f568f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61b48bdcb60b41cf9abc989e973d811d'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:09.812557 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db092644-a897-4f73-bc81-84801d1c1dd7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:09.813997 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db092644-a897-4f73-bc81-84801d1c1dd7 service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:09.814669 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db092644-a897-4f73-bc81-84801d1c1dd7 service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:09.816748 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db092644-a897-4f73-bc81-84801d1c1dd7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:09.839901 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-fbd11b67-42f9-4d97-b03d-4a4130f568f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61b48bdcb60b41cf9abc989e973d811d'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:09.859736 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db092644-a897-4f73-bc81-84801d1c1dd7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:09.861490 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db092644-a897-4f73-bc81-84801d1c1dd7 service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:09.880357 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-fbd11b67-42f9-4d97-b03d-4a4130f568f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61b48bdcb60b41cf9abc989e973d811d'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:09.908499 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3370/6694] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:35:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:35:09.915497 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3325/6695] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:35:09 2022] DELETE /identity/v3/users/61b48bdcb60b41cf9abc989e973d811d => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:35:10.530208 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db092644-a897-4f73-bc81-84801d1c1dd7 service neutron] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:10.544300 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db092644-a897-4f73-bc81-84801d1c1dd7 service neutron] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:10.646789 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db094d1e-9647-4079-9289-95b191d6d77b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:10.647694 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db094d1e-9647-4079-9289-95b191d6d77b service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:10.648051 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db094d1e-9647-4079-9289-95b191d6d77b service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:10.648398 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db094d1e-9647-4079-9289-95b191d6d77b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:10.651103 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-db094d1e-9647-4079-9289-95b191d6d77b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:10.677308 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:35:10.745348 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db094d1e-9647-4079-9289-95b191d6d77b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:10.747170 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db094d1e-9647-4079-9289-95b191d6d77b service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:10.771280 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3371/6696] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:35:10 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 23 21:35:11.277598 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd11b67-42f9-4d97-b03d-4a4130f568f0 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:11.279537 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-fbd11b67-42f9-4d97-b03d-4a4130f568f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:11.289919 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db094d1e-9647-4079-9289-95b191d6d77b service neutron] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:11.292002 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-db094d1e-9647-4079-9289-95b191d6d77b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:11.447293 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd11b67-42f9-4d97-b03d-4a4130f568f0 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:11.455979 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5041505c-841e-4ffc-ae9a-37c408734363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:11.457389 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5041505c-841e-4ffc-ae9a-37c408734363 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:11.457732 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5041505c-841e-4ffc-ae9a-37c408734363 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:11.458115 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5041505c-841e-4ffc-ae9a-37c408734363 admin admin] PATH_INFO: `/v3/projects/15e7b18adaeb456c847141c48da72e98` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:11.459524 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5041505c-841e-4ffc-ae9a-37c408734363 admin admin] RBAC: Authorizing `identity:delete_project(project_id=15e7b18adaeb456c847141c48da72e98)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:11.462742 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5041505c-841e-4ffc-ae9a-37c408734363 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:11.475357 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db094d1e-9647-4079-9289-95b191d6d77b service neutron] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:11.491831 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85ee8f9-9f4e-446b-8ee9-8a0449023d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:11.492760 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85ee8f9-9f4e-446b-8ee9-8a0449023d5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:11.493174 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85ee8f9-9f4e-446b-8ee9-8a0449023d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:11.493451 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85ee8f9-9f4e-446b-8ee9-8a0449023d5a admin admin] PATH_INFO: `/v3/projects/7e5613c85001486aa962a53f28d95223` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:11.496912 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85ee8f9-9f4e-446b-8ee9-8a0449023d5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e5613c85001486aa962a53f28d95223)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:11.499512 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85ee8f9-9f4e-446b-8ee9-8a0449023d5a admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:11.580808 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-5041505c-841e-4ffc-ae9a-37c408734363 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15e7b18adaeb456c847141c48da72e98', 'request_id': 'req-5041505c-841e-4ffc-ae9a-37c408734363'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:11.619603 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-5041505c-841e-4ffc-ae9a-37c408734363 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15e7b18adaeb456c847141c48da72e98', 'request_id': 'req-5041505c-841e-4ffc-ae9a-37c408734363'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:11.651172 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:35:11.654820 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-5041505c-841e-4ffc-ae9a-37c408734363 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15e7b18adaeb456c847141c48da72e98', 'request_id': 'req-5041505c-841e-4ffc-ae9a-37c408734363'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:11.679377 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-a85ee8f9-9f4e-446b-8ee9-8a0449023d5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e5613c85001486aa962a53f28d95223', 'request_id': 'req-a85ee8f9-9f4e-446b-8ee9-8a0449023d5a'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:11.696768 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-5041505c-841e-4ffc-ae9a-37c408734363 admin admin] The token cache is being invalidate because project 15e7b18adaeb456c847141c48da72e98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:35:11.697709 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-5041505c-841e-4ffc-ae9a-37c408734363 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:11.699899 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-a85ee8f9-9f4e-446b-8ee9-8a0449023d5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e5613c85001486aa962a53f28d95223', 'request_id': 'req-a85ee8f9-9f4e-446b-8ee9-8a0449023d5a'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:11.700459 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-5041505c-841e-4ffc-ae9a-37c408734363 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:11.706874 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3326/6697] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:35:11 2022] DELETE /identity/v3/projects/15e7b18adaeb456c847141c48da72e98 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:35:11.714894 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51fac1c-4ee6-4f60-a199-f738693825be None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:11.715484 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51fac1c-4ee6-4f60-a199-f738693825be None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:11.717590 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51fac1c-4ee6-4f60-a199-f738693825be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:11.727044 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-a85ee8f9-9f4e-446b-8ee9-8a0449023d5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e5613c85001486aa962a53f28d95223', 'request_id': 'req-a85ee8f9-9f4e-446b-8ee9-8a0449023d5a'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:11.754448 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-a85ee8f9-9f4e-446b-8ee9-8a0449023d5a admin admin] The token cache is being invalidate because project 7e5613c85001486aa962a53f28d95223 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:35:11.755071 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-a85ee8f9-9f4e-446b-8ee9-8a0449023d5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:11.756772 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-a85ee8f9-9f4e-446b-8ee9-8a0449023d5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:11.762139 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3372/6698] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:35:11 2022] DELETE /identity/v3/projects/7e5613c85001486aa962a53f28d95223 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:35:11.766141 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85ee8f9-9f4e-446b-8ee9-8a0449023d5a admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:11.768523 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-b51fac1c-4ee6-4f60-a199-f738693825be None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:35:11.769565 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-a85ee8f9-9f4e-446b-8ee9-8a0449023d5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:11.772265 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-b51fac1c-4ee6-4f60-a199-f738693825be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:11.890654 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:35:11.910807 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3327/6699] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:35:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:35:11.919521 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a925856-342c-469a-b2b2-de3297b04ca8 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:11.919884 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a925856-342c-469a-b2b2-de3297b04ca8 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:11.920215 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a925856-342c-469a-b2b2-de3297b04ca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:11.933827 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85ee8f9-9f4e-446b-8ee9-8a0449023d5a admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:11.955045 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff2c994-8e08-44b1-b5ff-c9f72188087b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:11.956301 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff2c994-8e08-44b1-b5ff-c9f72188087b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:11.956735 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff2c994-8e08-44b1-b5ff-c9f72188087b admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:11.957336 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff2c994-8e08-44b1-b5ff-c9f72188087b admin admin] PATH_INFO: `/v3/users/abb8b3bdfcf14821aaedc9d81efc6d9a` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:11.958777 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff2c994-8e08-44b1-b5ff-c9f72188087b admin admin] RBAC: Authorizing `identity:delete_user(user_id=abb8b3bdfcf14821aaedc9d81efc6d9a)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:11.960672 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff2c994-8e08-44b1-b5ff-c9f72188087b admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:11.963450 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-1a925856-342c-469a-b2b2-de3297b04ca8 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:35:11.964692 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-1a925856-342c-469a-b2b2-de3297b04ca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:11.986784 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3328/6700] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:35:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:35:11.988230 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a925856-342c-469a-b2b2-de3297b04ca8 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:12.002998 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a925856-342c-469a-b2b2-de3297b04ca8 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:12.011532 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efff3d51-dc8d-420c-ae29-f5e67c42c466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:12.012873 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efff3d51-dc8d-420c-ae29-f5e67c42c466 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:12.013481 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efff3d51-dc8d-420c-ae29-f5e67c42c466 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:12.013875 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efff3d51-dc8d-420c-ae29-f5e67c42c466 admin admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:12.015021 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efff3d51-dc8d-420c-ae29-f5e67c42c466 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:35:12.015597 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efff3d51-dc8d-420c-ae29-f5e67c42c466 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:12.018599 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efff3d51-dc8d-420c-ae29-f5e67c42c466 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:12.065462 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3329/6701] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:35:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:35:12.067404 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efff3d51-dc8d-420c-ae29-f5e67c42c466 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:12.077645 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-aff2c994-8e08-44b1-b5ff-c9f72188087b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abb8b3bdfcf14821aaedc9d81efc6d9a'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:12.080334 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-aff2c994-8e08-44b1-b5ff-c9f72188087b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abb8b3bdfcf14821aaedc9d81efc6d9a'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:12.086893 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efff3d51-dc8d-420c-ae29-f5e67c42c466 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:12.105557 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-aff2c994-8e08-44b1-b5ff-c9f72188087b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abb8b3bdfcf14821aaedc9d81efc6d9a'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:12.112328 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6d1e48-dd16-4358-8a63-4f64f0575f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:12.113066 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6d1e48-dd16-4358-8a63-4f64f0575f18 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:12.113528 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6d1e48-dd16-4358-8a63-4f64f0575f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:12.113810 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6d1e48-dd16-4358-8a63-4f64f0575f18 admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:12.114557 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6d1e48-dd16-4358-8a63-4f64f0575f18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:12.116631 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6d1e48-dd16-4358-8a63-4f64f0575f18 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:12.130049 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-aff2c994-8e08-44b1-b5ff-c9f72188087b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abb8b3bdfcf14821aaedc9d81efc6d9a'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:12.164648 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-aff2c994-8e08-44b1-b5ff-c9f72188087b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abb8b3bdfcf14821aaedc9d81efc6d9a'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:12.182209 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3373/6702] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:35:11 2022] DELETE /identity/v3/users/abb8b3bdfcf14821aaedc9d81efc6d9a => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:35:12.182576 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3330/6703] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:35:12 2022] POST /identity/v3/projects => generated 377 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:35:12.186431 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff2c994-8e08-44b1-b5ff-c9f72188087b admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:12.188286 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-aff2c994-8e08-44b1-b5ff-c9f72188087b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:12.331365 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff2c994-8e08-44b1-b5ff-c9f72188087b admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:12.369617 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9ddab4-2740-4b06-aec5-37b70d144d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:12.370384 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9ddab4-2740-4b06-aec5-37b70d144d73 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:12.370674 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9ddab4-2740-4b06-aec5-37b70d144d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:12.371177 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9ddab4-2740-4b06-aec5-37b70d144d73 admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:12.371948 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9ddab4-2740-4b06-aec5-37b70d144d73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:12.374974 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9ddab4-2740-4b06-aec5-37b70d144d73 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:12.426646 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3374/6704] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:35:12 2022] POST /identity/v3/users => generated 289 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:35:12.427376 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6d1e48-dd16-4358-8a63-4f64f0575f18 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:12.547646 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6d1e48-dd16-4358-8a63-4f64f0575f18 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:12.553512 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b378cb99-74f5-443b-9eb9-a2115f4c2e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:12.554403 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b378cb99-74f5-443b-9eb9-a2115f4c2e90 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:12.554871 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b378cb99-74f5-443b-9eb9-a2115f4c2e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:12.555236 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b378cb99-74f5-443b-9eb9-a2115f4c2e90 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:12.556250 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b378cb99-74f5-443b-9eb9-a2115f4c2e90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:12.559082 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b378cb99-74f5-443b-9eb9-a2115f4c2e90 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:12.577244 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3331/6705] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:35:12 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:35:12.581041 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9ddab4-2740-4b06-aec5-37b70d144d73 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:12.597571 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9ddab4-2740-4b06-aec5-37b70d144d73 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:12.638826 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d673ab-9562-4aee-95b1-b60095e4cd4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:12.639841 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d673ab-9562-4aee-95b1-b60095e4cd4a admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:12.640945 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d673ab-9562-4aee-95b1-b60095e4cd4a admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:12.641377 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d673ab-9562-4aee-95b1-b60095e4cd4a admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:12.642330 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d673ab-9562-4aee-95b1-b60095e4cd4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:12.646276 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d673ab-9562-4aee-95b1-b60095e4cd4a admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:12.673231 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3375/6706] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:35:12 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:35:12.677938 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b378cb99-74f5-443b-9eb9-a2115f4c2e90 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:12.696369 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b378cb99-74f5-443b-9eb9-a2115f4c2e90 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:12.704525 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f58ae2-9786-40a6-8f20-480ff97d334b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:12.705569 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f58ae2-9786-40a6-8f20-480ff97d334b admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:12.705971 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f58ae2-9786-40a6-8f20-480ff97d334b admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:12.706321 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f58ae2-9786-40a6-8f20-480ff97d334b admin admin] PATH_INFO: `/v3/projects/228cd2a54864493a81f7d5749e5fd5cb/users/bd514caa2bb743dab868e9feba40b851/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:12.738039 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f58ae2-9786-40a6-8f20-480ff97d334b admin admin] RBAC: Authorizing `identity:create_grant(project_id=228cd2a54864493a81f7d5749e5fd5cb, user_id=bd514caa2bb743dab868e9feba40b851, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:12.741156 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f58ae2-9786-40a6-8f20-480ff97d334b admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:12.792422 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3332/6707] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:35:12 2022] PUT /identity/v3/projects/228cd2a54864493a81f7d5749e5fd5cb/users/bd514caa2bb743dab868e9feba40b851/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:35:12.805044 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f19e25-a0f5-485b-976c-eb7abb62f04e None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:12.805569 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f19e25-a0f5-485b-976c-eb7abb62f04e None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:12.805673 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f19e25-a0f5-485b-976c-eb7abb62f04e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:12.845639 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-88f19e25-a0f5-485b-976c-eb7abb62f04e None None] MFA Rules not processed for user `bd514caa2bb743dab868e9feba40b851`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:35:12.847073 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-88f19e25-a0f5-485b-976c-eb7abb62f04e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:12.910279 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:35:12.989597 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3376/6708] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:35:12 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:35:12.994433 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f58ae2-9786-40a6-8f20-480ff97d334b admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:13.041311 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:35:13.103226 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f58ae2-9786-40a6-8f20-480ff97d334b admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:13.110516 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58119f1f-e2d7-438a-b913-df22e01bba69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:13.111617 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58119f1f-e2d7-438a-b913-df22e01bba69 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:13.112201 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58119f1f-e2d7-438a-b913-df22e01bba69 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:13.112856 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58119f1f-e2d7-438a-b913-df22e01bba69 admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:13.114758 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58119f1f-e2d7-438a-b913-df22e01bba69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:13.118489 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58119f1f-e2d7-438a-b913-df22e01bba69 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:13.158113 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3333/6709] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:35:12 2022] POST /identity/v3/projects => generated 375 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:35:13.162491 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f19e25-a0f5-485b-976c-eb7abb62f04e None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:13.178297 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f19e25-a0f5-485b-976c-eb7abb62f04e None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:13.320120 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4dd88a-834a-4bc1-9ecc-0a84eb17f599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:13.320120 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4dd88a-834a-4bc1-9ecc-0a84eb17f599 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:13.320348 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4dd88a-834a-4bc1-9ecc-0a84eb17f599 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:13.320518 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4dd88a-834a-4bc1-9ecc-0a84eb17f599 admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:13.321370 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4dd88a-834a-4bc1-9ecc-0a84eb17f599 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:13.325405 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4dd88a-834a-4bc1-9ecc-0a84eb17f599 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:13.364720 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3377/6710] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:35:13 2022] POST /identity/v3/users => generated 294 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:35:13.368664 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58119f1f-e2d7-438a-b913-df22e01bba69 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:13.381945 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58119f1f-e2d7-438a-b913-df22e01bba69 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:13.392104 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb34082-1c44-48b6-b873-651de231f3d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:13.393659 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb34082-1c44-48b6-b873-651de231f3d5 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:13.395033 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb34082-1c44-48b6-b873-651de231f3d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:13.395555 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb34082-1c44-48b6-b873-651de231f3d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:13.397495 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb34082-1c44-48b6-b873-651de231f3d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:13.401393 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb34082-1c44-48b6-b873-651de231f3d5 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:13.427275 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3334/6711] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:35:13 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:35:13.427784 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4dd88a-834a-4bc1-9ecc-0a84eb17f599 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:13.443481 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4dd88a-834a-4bc1-9ecc-0a84eb17f599 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:13.455940 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d76ce5e-a60e-43a2-bff6-68287b594417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:13.467286 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d76ce5e-a60e-43a2-bff6-68287b594417 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:13.467676 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d76ce5e-a60e-43a2-bff6-68287b594417 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:13.467962 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d76ce5e-a60e-43a2-bff6-68287b594417 admin admin] PATH_INFO: `/v3/projects/85724292ed094634be7b2e4ce98c565b/users/5056bfd4dd8b497e899cae5be25d028d/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:13.491710 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb34082-1c44-48b6-b873-651de231f3d5 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:13.495731 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-afb34082-1c44-48b6-b873-651de231f3d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:13.499179 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d76ce5e-a60e-43a2-bff6-68287b594417 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85724292ed094634be7b2e4ce98c565b, user_id=5056bfd4dd8b497e899cae5be25d028d, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:13.513227 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d76ce5e-a60e-43a2-bff6-68287b594417 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:13.521631 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb34082-1c44-48b6-b873-651de231f3d5 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:13.558698 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d525137a-b63c-49b2-ab8c-5bdc8c90d7dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:13.559617 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d525137a-b63c-49b2-ab8c-5bdc8c90d7dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:13.560644 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d525137a-b63c-49b2-ab8c-5bdc8c90d7dd admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:13.561184 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d525137a-b63c-49b2-ab8c-5bdc8c90d7dd admin admin] PATH_INFO: `/v3/projects/3ec228a9841b420d913021b2a011d25d` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:13.562099 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3378/6712] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:35:13 2022] PUT /identity/v3/projects/85724292ed094634be7b2e4ce98c565b/users/5056bfd4dd8b497e899cae5be25d028d/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:35:13.563741 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d76ce5e-a60e-43a2-bff6-68287b594417 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:13.564168 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d525137a-b63c-49b2-ab8c-5bdc8c90d7dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ec228a9841b420d913021b2a011d25d)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:13.566391 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d525137a-b63c-49b2-ab8c-5bdc8c90d7dd admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:13.668686 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-d525137a-b63c-49b2-ab8c-5bdc8c90d7dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ec228a9841b420d913021b2a011d25d', 'request_id': 'req-d525137a-b63c-49b2-ab8c-5bdc8c90d7dd'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:13.679130 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d76ce5e-a60e-43a2-bff6-68287b594417 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:13.684753 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-d525137a-b63c-49b2-ab8c-5bdc8c90d7dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ec228a9841b420d913021b2a011d25d', 'request_id': 'req-d525137a-b63c-49b2-ab8c-5bdc8c90d7dd'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:13.695483 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-d525137a-b63c-49b2-ab8c-5bdc8c90d7dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ec228a9841b420d913021b2a011d25d', 'request_id': 'req-d525137a-b63c-49b2-ab8c-5bdc8c90d7dd'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:13.712715 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-d525137a-b63c-49b2-ab8c-5bdc8c90d7dd admin admin] The token cache is being invalidate because project 3ec228a9841b420d913021b2a011d25d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:35:13.713133 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-d525137a-b63c-49b2-ab8c-5bdc8c90d7dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:13.713730 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-d525137a-b63c-49b2-ab8c-5bdc8c90d7dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:13.722645 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3335/6713] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:35:13 2022] DELETE /identity/v3/projects/3ec228a9841b420d913021b2a011d25d => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:35:13.724583 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f649e99-82b9-432d-9ff7-1004b478aa44 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:13.724871 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f649e99-82b9-432d-9ff7-1004b478aa44 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:13.725215 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f649e99-82b9-432d-9ff7-1004b478aa44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:13.740887 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:35:13.754559 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-4f649e99-82b9-432d-9ff7-1004b478aa44 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:35:13.756563 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-4f649e99-82b9-432d-9ff7-1004b478aa44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:13.775080 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25900929-aee5-4cbb-9f0f-4a278b289ec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:13.776585 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25900929-aee5-4cbb-9f0f-4a278b289ec0 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:13.777202 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25900929-aee5-4cbb-9f0f-4a278b289ec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:13.777707 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25900929-aee5-4cbb-9f0f-4a278b289ec0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:13.778775 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25900929-aee5-4cbb-9f0f-4a278b289ec0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:13.781298 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25900929-aee5-4cbb-9f0f-4a278b289ec0 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:13.818495 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3379/6714] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:35:13 2022] GET /identity/v3/roles => generated 1420 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:35:13.820824 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25900929-aee5-4cbb-9f0f-4a278b289ec0 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:13.822929 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-25900929-aee5-4cbb-9f0f-4a278b289ec0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:13.849524 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25900929-aee5-4cbb-9f0f-4a278b289ec0 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:13.860542 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67b45bd-8296-4d7f-9b67-cd038cf15a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:13.862391 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67b45bd-8296-4d7f-9b67-cd038cf15a61 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:13.866179 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67b45bd-8296-4d7f-9b67-cd038cf15a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:13.866692 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67b45bd-8296-4d7f-9b67-cd038cf15a61 admin admin] PATH_INFO: `/v3/projects/85724292ed094634be7b2e4ce98c565b/users/5056bfd4dd8b497e899cae5be25d028d/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:13.873078 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67b45bd-8296-4d7f-9b67-cd038cf15a61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85724292ed094634be7b2e4ce98c565b, user_id=5056bfd4dd8b497e899cae5be25d028d, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:13.879919 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3336/6715] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:35:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:35:13.880761 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67b45bd-8296-4d7f-9b67-cd038cf15a61 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:13.887938 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278d199d-6b26-452a-b3a5-f42958152ebb None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:13.888613 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278d199d-6b26-452a-b3a5-f42958152ebb None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:13.889527 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278d199d-6b26-452a-b3a5-f42958152ebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:13.924522 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-278d199d-6b26-452a-b3a5-f42958152ebb None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:35:13.924522 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-278d199d-6b26-452a-b3a5-f42958152ebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:13.938787 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3380/6716] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:35:13 2022] PUT /identity/v3/projects/85724292ed094634be7b2e4ce98c565b/users/5056bfd4dd8b497e899cae5be25d028d/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:35:13.950908 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9a2c91-086c-4171-90be-86af6b43780a None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:13.951183 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9a2c91-086c-4171-90be-86af6b43780a None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:13.951470 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9a2c91-086c-4171-90be-86af6b43780a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:13.978016 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:35:13.995752 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-1d9a2c91-086c-4171-90be-86af6b43780a None None] MFA Rules not processed for user `5056bfd4dd8b497e899cae5be25d028d`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:35:13.997020 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-1d9a2c91-086c-4171-90be-86af6b43780a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:14.072959 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3337/6717] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:35:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:35:14.077961 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278d199d-6b26-452a-b3a5-f42958152ebb None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:14.088090 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278d199d-6b26-452a-b3a5-f42958152ebb None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:14.093054 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38efaaa-5eec-4fc6-9b7a-5be9f7716a4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:14.093736 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38efaaa-5eec-4fc6-9b7a-5be9f7716a4b admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:14.094061 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38efaaa-5eec-4fc6-9b7a-5be9f7716a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:14.094347 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38efaaa-5eec-4fc6-9b7a-5be9f7716a4b admin admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:14.095227 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38efaaa-5eec-4fc6-9b7a-5be9f7716a4b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:35:14.095539 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38efaaa-5eec-4fc6-9b7a-5be9f7716a4b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:14.097738 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38efaaa-5eec-4fc6-9b7a-5be9f7716a4b admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:14.111811 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3338/6718] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:35:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:35:14.118020 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38efaaa-5eec-4fc6-9b7a-5be9f7716a4b admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:14.120141 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3381/6719] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:35:13 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:35:14.133279 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9a2c91-086c-4171-90be-86af6b43780a None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:14.134835 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-1d9a2c91-086c-4171-90be-86af6b43780a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:14.135302 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38efaaa-5eec-4fc6-9b7a-5be9f7716a4b admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:14.141466 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c7d4b0-dc3c-48a0-bb79-43844e6c7fdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:14.142789 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c7d4b0-dc3c-48a0-bb79-43844e6c7fdd admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:14.143309 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c7d4b0-dc3c-48a0-bb79-43844e6c7fdd admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:14.143627 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c7d4b0-dc3c-48a0-bb79-43844e6c7fdd admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:14.144763 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c7d4b0-dc3c-48a0-bb79-43844e6c7fdd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:14.149965 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c7d4b0-dc3c-48a0-bb79-43844e6c7fdd admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:14.207834 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3339/6720] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:35:14 2022] POST /identity/v3/projects => generated 385 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:35:14.210773 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c7d4b0-dc3c-48a0-bb79-43844e6c7fdd admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:14.220049 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9a2c91-086c-4171-90be-86af6b43780a None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:14.320725 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d241e4d-c685-4ed9-96e5-2519b0f4a4b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:14.323630 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d241e4d-c685-4ed9-96e5-2519b0f4a4b6 service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:14.324796 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d241e4d-c685-4ed9-96e5-2519b0f4a4b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:14.325184 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d241e4d-c685-4ed9-96e5-2519b0f4a4b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:14.334225 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c7d4b0-dc3c-48a0-bb79-43844e6c7fdd admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:14.341194 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66e46e1-fbed-4976-862e-05807d594d20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:14.342028 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66e46e1-fbed-4976-862e-05807d594d20 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:14.342233 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66e46e1-fbed-4976-862e-05807d594d20 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:14.342975 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66e46e1-fbed-4976-862e-05807d594d20 admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:14.344461 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66e46e1-fbed-4976-862e-05807d594d20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:14.349465 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66e46e1-fbed-4976-862e-05807d594d20 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:14.353176 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:35:14.383312 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3340/6721] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:35:14 2022] POST /identity/v3/users => generated 293 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:35:14.388067 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66e46e1-fbed-4976-862e-05807d594d20 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:14.402926 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66e46e1-fbed-4976-862e-05807d594d20 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:14.409222 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7f4e02-1083-441e-bbbf-8236981be3cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:14.410508 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7f4e02-1083-441e-bbbf-8236981be3cf admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:14.410957 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7f4e02-1083-441e-bbbf-8236981be3cf admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:14.412025 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7f4e02-1083-441e-bbbf-8236981be3cf admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:14.413070 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7f4e02-1083-441e-bbbf-8236981be3cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:14.415041 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7f4e02-1083-441e-bbbf-8236981be3cf admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:14.416708 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d241e4d-c685-4ed9-96e5-2519b0f4a4b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:14.418241 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d241e4d-c685-4ed9-96e5-2519b0f4a4b6 service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:14.429532 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3382/6722] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:35:14 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:35:14.442672 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3341/6723] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:35:14 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:35:14.442851 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d241e4d-c685-4ed9-96e5-2519b0f4a4b6 service neutron] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:14.444038 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7f4e02-1083-441e-bbbf-8236981be3cf admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:14.444861 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-0d241e4d-c685-4ed9-96e5-2519b0f4a4b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:14.458853 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7f4e02-1083-441e-bbbf-8236981be3cf admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:14.460235 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d241e4d-c685-4ed9-96e5-2519b0f4a4b6 service neutron] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:14.464755 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8e8d3f-df60-4aaa-8517-6800fe3729da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:14.465526 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8e8d3f-df60-4aaa-8517-6800fe3729da admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:14.466665 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8e8d3f-df60-4aaa-8517-6800fe3729da admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:14.466816 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2820c3-9496-4ed6-bf35-0838e531caa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:14.467078 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8e8d3f-df60-4aaa-8517-6800fe3729da admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:14.467801 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2820c3-9496-4ed6-bf35-0838e531caa5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:14.467944 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8e8d3f-df60-4aaa-8517-6800fe3729da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:14.468208 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2820c3-9496-4ed6-bf35-0838e531caa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:14.468548 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2820c3-9496-4ed6-bf35-0838e531caa5 admin admin] PATH_INFO: `/v3/users/eed434ceac1544aaba906e754ec46a87` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:14.470283 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2820c3-9496-4ed6-bf35-0838e531caa5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eed434ceac1544aaba906e754ec46a87)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:14.470720 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8e8d3f-df60-4aaa-8517-6800fe3729da admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:14.473138 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2820c3-9496-4ed6-bf35-0838e531caa5 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:14.493197 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3342/6724] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:35:14 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:35:14.494288 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8e8d3f-df60-4aaa-8517-6800fe3729da admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:14.509916 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8e8d3f-df60-4aaa-8517-6800fe3729da admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:14.516974 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0cd832-3eb4-4acd-b745-425f445273aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:14.518137 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0cd832-3eb4-4acd-b745-425f445273aa admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:14.518422 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0cd832-3eb4-4acd-b745-425f445273aa admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:14.518702 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0cd832-3eb4-4acd-b745-425f445273aa admin admin] PATH_INFO: `/v3/projects/2918d8f16a66478eae767160fc8649a7/users/f36d55aaab9947c0b5c5b0fee94c9799/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:14.542757 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0cd832-3eb4-4acd-b745-425f445273aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=2918d8f16a66478eae767160fc8649a7, user_id=f36d55aaab9947c0b5c5b0fee94c9799, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:14.546833 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0cd832-3eb4-4acd-b745-425f445273aa admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:14.562591 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-dc2820c3-9496-4ed6-bf35-0838e531caa5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eed434ceac1544aaba906e754ec46a87'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:14.563697 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-dc2820c3-9496-4ed6-bf35-0838e531caa5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eed434ceac1544aaba906e754ec46a87'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:14.566590 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3343/6725] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:35:14 2022] PUT /identity/v3/projects/2918d8f16a66478eae767160fc8649a7/users/f36d55aaab9947c0b5c5b0fee94c9799/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:35:14.581741 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-dc2820c3-9496-4ed6-bf35-0838e531caa5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eed434ceac1544aaba906e754ec46a87'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:14.598932 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-dc2820c3-9496-4ed6-bf35-0838e531caa5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eed434ceac1544aaba906e754ec46a87'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:14.624150 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-dc2820c3-9496-4ed6-bf35-0838e531caa5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eed434ceac1544aaba906e754ec46a87'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:14.639308 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3383/6726] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:35:14 2022] DELETE /identity/v3/users/eed434ceac1544aaba906e754ec46a87 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:35:14.642068 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf75e122-854f-401c-a095-48b9f7f6de74 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:14.642567 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf75e122-854f-401c-a095-48b9f7f6de74 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:14.643108 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf75e122-854f-401c-a095-48b9f7f6de74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:14.674965 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-cf75e122-854f-401c-a095-48b9f7f6de74 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:35:14.676748 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-cf75e122-854f-401c-a095-48b9f7f6de74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:14.682823 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2960f2d-4289-4c0f-8a0f-14fd8f2e2679 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:14.683627 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2960f2d-4289-4c0f-8a0f-14fd8f2e2679 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:14.684232 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2960f2d-4289-4c0f-8a0f-14fd8f2e2679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:14.717175 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:35:14.720102 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-f2960f2d-4289-4c0f-8a0f-14fd8f2e2679 None None] MFA Rules not processed for user `f36d55aaab9947c0b5c5b0fee94c9799`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:35:14.721313 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-f2960f2d-4289-4c0f-8a0f-14fd8f2e2679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:14.762921 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3344/6727] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:35:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:35:14.776708 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf75e122-854f-401c-a095-48b9f7f6de74 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:14.778864 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-cf75e122-854f-401c-a095-48b9f7f6de74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:14.809963 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3384/6728] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:35:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:35:14.811127 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2960f2d-4289-4c0f-8a0f-14fd8f2e2679 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:14.813028 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-f2960f2d-4289-4c0f-8a0f-14fd8f2e2679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:14.831701 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2960f2d-4289-4c0f-8a0f-14fd8f2e2679 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:14.839244 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93e19a6-e714-4aaa-ac76-7248f646a8ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:14.840413 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93e19a6-e714-4aaa-ac76-7248f646a8ec admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:14.840939 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93e19a6-e714-4aaa-ac76-7248f646a8ec admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:14.841197 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93e19a6-e714-4aaa-ac76-7248f646a8ec admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:14.842779 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93e19a6-e714-4aaa-ac76-7248f646a8ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:14.845203 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93e19a6-e714-4aaa-ac76-7248f646a8ec admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:14.872055 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:35:14.889889 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf75e122-854f-401c-a095-48b9f7f6de74 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:14.896574 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd2c558-acf6-4a17-b49b-6f775dbfa56b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:14.898583 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd2c558-acf6-4a17-b49b-6f775dbfa56b service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:14.899369 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd2c558-acf6-4a17-b49b-6f775dbfa56b service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:14.899369 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd2c558-acf6-4a17-b49b-6f775dbfa56b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:14.902634 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3385/6729] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:35:14 2022] POST /identity/v3/projects => generated 385 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:35:14.907055 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93e19a6-e714-4aaa-ac76-7248f646a8ec admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:14.915711 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd2c558-acf6-4a17-b49b-6f775dbfa56b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:14.917381 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd2c558-acf6-4a17-b49b-6f775dbfa56b service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:14.931242 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3345/6730] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:35:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 23 21:35:14.996444 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93e19a6-e714-4aaa-ac76-7248f646a8ec admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:15.001427 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dfa419-8787-4301-aba2-99ae09197098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:15.002144 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dfa419-8787-4301-aba2-99ae09197098 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:15.002427 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dfa419-8787-4301-aba2-99ae09197098 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:15.003132 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dfa419-8787-4301-aba2-99ae09197098 admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:15.003445 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dfa419-8787-4301-aba2-99ae09197098 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:15.005372 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dfa419-8787-4301-aba2-99ae09197098 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:15.051334 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3386/6731] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:35:14 2022] POST /identity/v3/users => generated 299 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:35:15.055137 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd2c558-acf6-4a17-b49b-6f775dbfa56b service neutron] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:15.065052 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd2c558-acf6-4a17-b49b-6f775dbfa56b service neutron] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:15.072767 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554616d3-640d-469b-8955-20d0748dda7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:15.073451 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554616d3-640d-469b-8955-20d0748dda7d admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:15.073737 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554616d3-640d-469b-8955-20d0748dda7d admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:15.074048 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554616d3-640d-469b-8955-20d0748dda7d admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:15.074866 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554616d3-640d-469b-8955-20d0748dda7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:15.076749 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554616d3-640d-469b-8955-20d0748dda7d admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:15.091947 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3346/6732] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:35:15 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:35:15.092707 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dfa419-8787-4301-aba2-99ae09197098 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:15.105730 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dfa419-8787-4301-aba2-99ae09197098 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:15.110101 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e267692-90ba-4faa-a255-6cee31009c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:15.111301 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e267692-90ba-4faa-a255-6cee31009c6c admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:15.111644 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e267692-90ba-4faa-a255-6cee31009c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:15.111983 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e267692-90ba-4faa-a255-6cee31009c6c admin admin] PATH_INFO: `/v3/projects/38bf537f01d54245b12994ae15c53b1d/users/d593449bc4024179b73b6f77270e8d1d/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:15.133013 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e267692-90ba-4faa-a255-6cee31009c6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=38bf537f01d54245b12994ae15c53b1d, user_id=d593449bc4024179b73b6f77270e8d1d, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:15.142040 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e267692-90ba-4faa-a255-6cee31009c6c admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:15.155234 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3387/6733] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:35:15 2022] PUT /identity/v3/projects/38bf537f01d54245b12994ae15c53b1d/users/d593449bc4024179b73b6f77270e8d1d/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:35:15.159477 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554616d3-640d-469b-8955-20d0748dda7d admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:15.171496 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554616d3-640d-469b-8955-20d0748dda7d admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:15.261116 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeb8cc7-cf44-441a-97bb-69ef8e63dd65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:15.262456 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeb8cc7-cf44-441a-97bb-69ef8e63dd65 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:15.263003 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeb8cc7-cf44-441a-97bb-69ef8e63dd65 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:15.263623 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeb8cc7-cf44-441a-97bb-69ef8e63dd65 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:15.264602 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eeb8cc7-cf44-441a-97bb-69ef8e63dd65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:15.267578 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eeb8cc7-cf44-441a-97bb-69ef8e63dd65 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:15.282025 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3347/6734] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:35:15 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:35:15.286554 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e267692-90ba-4faa-a255-6cee31009c6c admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:15.299639 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e267692-90ba-4faa-a255-6cee31009c6c admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:15.306414 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267bc6e9-df80-45f1-a603-031ff3d96d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:15.308234 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267bc6e9-df80-45f1-a603-031ff3d96d4c admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:15.308717 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267bc6e9-df80-45f1-a603-031ff3d96d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:15.309111 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267bc6e9-df80-45f1-a603-031ff3d96d4c admin admin] PATH_INFO: `/v3/projects/38bf537f01d54245b12994ae15c53b1d/users/d593449bc4024179b73b6f77270e8d1d/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:15.312067 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267bc6e9-df80-45f1-a603-031ff3d96d4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=38bf537f01d54245b12994ae15c53b1d, user_id=d593449bc4024179b73b6f77270e8d1d, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:15.315326 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267bc6e9-df80-45f1-a603-031ff3d96d4c admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:15.343170 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3388/6735] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:35:15 2022] PUT /identity/v3/projects/38bf537f01d54245b12994ae15c53b1d/users/d593449bc4024179b73b6f77270e8d1d/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:35:15.348339 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6c4347-d33c-40e4-ad2d-2454c2456a0e None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:15.348339 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6c4347-d33c-40e4-ad2d-2454c2456a0e None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:15.348339 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6c4347-d33c-40e4-ad2d-2454c2456a0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:15.372528 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267bc6e9-df80-45f1-a603-031ff3d96d4c admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:15.374950 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-267bc6e9-df80-45f1-a603-031ff3d96d4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:15.400823 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-1f6c4347-d33c-40e4-ad2d-2454c2456a0e None None] MFA Rules not processed for user `d593449bc4024179b73b6f77270e8d1d`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:35:15.404629 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-1f6c4347-d33c-40e4-ad2d-2454c2456a0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:15.482255 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:35:15.503515 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267bc6e9-df80-45f1-a603-031ff3d96d4c admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:15.509528 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94a2ab4-9780-4ba8-bac0-badfa8a63b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:15.511650 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94a2ab4-9780-4ba8-bac0-badfa8a63b61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:15.511940 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94a2ab4-9780-4ba8-bac0-badfa8a63b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:15.512217 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94a2ab4-9780-4ba8-bac0-badfa8a63b61 admin admin] PATH_INFO: `/v3/projects/9655e4d822b94176a8677736f2983ceb` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:15.513735 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94a2ab4-9780-4ba8-bac0-badfa8a63b61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9655e4d822b94176a8677736f2983ceb)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:15.517139 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94a2ab4-9780-4ba8-bac0-badfa8a63b61 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:15.524493 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3348/6736] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:35:15 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:35:15.526831 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6c4347-d33c-40e4-ad2d-2454c2456a0e None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:15.538128 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6c4347-d33c-40e4-ad2d-2454c2456a0e None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:15.543798 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de92b00-0a4f-4df2-8312-22741fa129c8 tempest-IdentityV3ProjectTagsTest-591468286 tempest-IdentityV3ProjectTagsTest-591468286-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd593449bc4024179b73b6f77270e8d1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38bf537f01d54245b12994ae15c53b1d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:15.544930 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de92b00-0a4f-4df2-8312-22741fa129c8 tempest-IdentityV3ProjectTagsTest-591468286 tempest-IdentityV3ProjectTagsTest-591468286-project-admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:15.545507 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de92b00-0a4f-4df2-8312-22741fa129c8 tempest-IdentityV3ProjectTagsTest-591468286 tempest-IdentityV3ProjectTagsTest-591468286-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:15.546336 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de92b00-0a4f-4df2-8312-22741fa129c8 tempest-IdentityV3ProjectTagsTest-591468286 tempest-IdentityV3ProjectTagsTest-591468286-project-admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:15.547194 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de92b00-0a4f-4df2-8312-22741fa129c8 tempest-IdentityV3ProjectTagsTest-591468286 tempest-IdentityV3ProjectTagsTest-591468286-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:15.549320 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de92b00-0a4f-4df2-8312-22741fa129c8 tempest-IdentityV3ProjectTagsTest-591468286 tempest-IdentityV3ProjectTagsTest-591468286-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:15.596538 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3349/6737] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:35:15 2022] POST /identity/v3/projects => generated 360 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:35:15.598314 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:INSERT=6,keystone:SELECT=90,keystone:DELETE=4 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:35:15.598590 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de92b00-0a4f-4df2-8312-22741fa129c8 tempest-IdentityV3ProjectTagsTest-591468286 tempest-IdentityV3ProjectTagsTest-591468286-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:15.600456 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-d94a2ab4-9780-4ba8-bac0-badfa8a63b61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9655e4d822b94176a8677736f2983ceb', 'request_id': 'req-d94a2ab4-9780-4ba8-bac0-badfa8a63b61'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:15.618227 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-d94a2ab4-9780-4ba8-bac0-badfa8a63b61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9655e4d822b94176a8677736f2983ceb', 'request_id': 'req-d94a2ab4-9780-4ba8-bac0-badfa8a63b61'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:15.628217 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-d94a2ab4-9780-4ba8-bac0-badfa8a63b61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9655e4d822b94176a8677736f2983ceb', 'request_id': 'req-d94a2ab4-9780-4ba8-bac0-badfa8a63b61'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:15.646247 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-d94a2ab4-9780-4ba8-bac0-badfa8a63b61 admin admin] The token cache is being invalidate because project 9655e4d822b94176a8677736f2983ceb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:35:15.646628 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-d94a2ab4-9780-4ba8-bac0-badfa8a63b61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:15.647321 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-d94a2ab4-9780-4ba8-bac0-badfa8a63b61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:15.653995 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3389/6738] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:35:15 2022] DELETE /identity/v3/projects/9655e4d822b94176a8677736f2983ceb => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:35:15.656213 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e103bf48-7152-49a8-8087-c020edf5e209 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:15.656507 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e103bf48-7152-49a8-8087-c020edf5e209 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:15.656783 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e103bf48-7152-49a8-8087-c020edf5e209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:15.687915 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-e103bf48-7152-49a8-8087-c020edf5e209 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:35:15.689387 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-e103bf48-7152-49a8-8087-c020edf5e209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:15.710931 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de92b00-0a4f-4df2-8312-22741fa129c8 tempest-IdentityV3ProjectTagsTest-591468286 tempest-IdentityV3ProjectTagsTest-591468286-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:15.718513 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacf5c17-e1de-4855-885d-4fc18e473533 tempest-IdentityV3ProjectTagsTest-591468286 tempest-IdentityV3ProjectTagsTest-591468286-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd593449bc4024179b73b6f77270e8d1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38bf537f01d54245b12994ae15c53b1d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:15.719966 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacf5c17-e1de-4855-885d-4fc18e473533 tempest-IdentityV3ProjectTagsTest-591468286 tempest-IdentityV3ProjectTagsTest-591468286-project-admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:15.720751 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacf5c17-e1de-4855-885d-4fc18e473533 tempest-IdentityV3ProjectTagsTest-591468286 tempest-IdentityV3ProjectTagsTest-591468286-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:15.721042 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacf5c17-e1de-4855-885d-4fc18e473533 tempest-IdentityV3ProjectTagsTest-591468286 tempest-IdentityV3ProjectTagsTest-591468286-project-admin] PATH_INFO: `/v3/projects/dc042ee07fb14bebb010654b1b8dd235/tags/tempest-tag-602250492` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:15.722627 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacf5c17-e1de-4855-885d-4fc18e473533 tempest-IdentityV3ProjectTagsTest-591468286 tempest-IdentityV3ProjectTagsTest-591468286-project-admin] RBAC: Authorizing `identity:create_project_tag(project_id=dc042ee07fb14bebb010654b1b8dd235, value=tempest-tag-602250492)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:15.725642 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacf5c17-e1de-4855-885d-4fc18e473533 tempest-IdentityV3ProjectTagsTest-591468286 tempest-IdentityV3ProjectTagsTest-591468286-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:15.798290 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3390/6739] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:35:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:35:15.807291 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725ea582-5ce3-4a8b-915f-e2e64e6c0787 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:15.808245 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725ea582-5ce3-4a8b-915f-e2e64e6c0787 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:15.808873 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725ea582-5ce3-4a8b-915f-e2e64e6c0787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:15.814030 ncdv-master-1 devstack@keystone.service[91547]: WARNING py.warnings [None req-cacf5c17-e1de-4855-885d-4fc18e473533 tempest-IdentityV3ProjectTagsTest-591468286 tempest-IdentityV3ProjectTagsTest-591468286-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-tag-602250492. To ensure interoperability, identifiers should be a valid uuid. Jul 23 21:35:15.814030 ncdv-master-1 devstack@keystone.service[91547]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Jul 23 21:35:15.814030 ncdv-master-1 devstack@keystone.service[91547]: Jul 23 21:35:15.831267 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3350/6740] 10.222.0.17 () {60 vars in 1329 bytes} [Sat Jul 23 21:35:15 2022] PUT /identity/v3/projects/dc042ee07fb14bebb010654b1b8dd235/tags/tempest-tag-602250492 => generated 0 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 290 bytes (1 switches on core 0) Jul 23 21:35:15.832603 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacf5c17-e1de-4855-885d-4fc18e473533 tempest-IdentityV3ProjectTagsTest-591468286 tempest-IdentityV3ProjectTagsTest-591468286-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:15.835794 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-cacf5c17-e1de-4855-885d-4fc18e473533 tempest-IdentityV3ProjectTagsTest-591468286 tempest-IdentityV3ProjectTagsTest-591468286-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:15.847413 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-725ea582-5ce3-4a8b-915f-e2e64e6c0787 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:35:15.850454 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-725ea582-5ce3-4a8b-915f-e2e64e6c0787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:15.854227 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacf5c17-e1de-4855-885d-4fc18e473533 tempest-IdentityV3ProjectTagsTest-591468286 tempest-IdentityV3ProjectTagsTest-591468286-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:15.860748 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3391/6741] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:35:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:35:15.865009 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc100cb-8eb4-432f-bcac-74e322cd3cf5 tempest-IdentityV3ProjectTagsTest-591468286 tempest-IdentityV3ProjectTagsTest-591468286-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd593449bc4024179b73b6f77270e8d1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38bf537f01d54245b12994ae15c53b1d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:15.865914 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725ea582-5ce3-4a8b-915f-e2e64e6c0787 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:15.866154 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc100cb-8eb4-432f-bcac-74e322cd3cf5 tempest-IdentityV3ProjectTagsTest-591468286 tempest-IdentityV3ProjectTagsTest-591468286-project-admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:15.866773 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc100cb-8eb4-432f-bcac-74e322cd3cf5 tempest-IdentityV3ProjectTagsTest-591468286 tempest-IdentityV3ProjectTagsTest-591468286-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:15.867165 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc100cb-8eb4-432f-bcac-74e322cd3cf5 tempest-IdentityV3ProjectTagsTest-591468286 tempest-IdentityV3ProjectTagsTest-591468286-project-admin] PATH_INFO: `/v3/projects/dc042ee07fb14bebb010654b1b8dd235/tags/tempest-tag-602250492` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:15.882182 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725ea582-5ce3-4a8b-915f-e2e64e6c0787 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:15.883050 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc100cb-8eb4-432f-bcac-74e322cd3cf5 tempest-IdentityV3ProjectTagsTest-591468286 tempest-IdentityV3ProjectTagsTest-591468286-project-admin] RBAC: Authorizing `identity:get_project_tag(project_id=dc042ee07fb14bebb010654b1b8dd235, value=tempest-tag-602250492)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:15.885734 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc100cb-8eb4-432f-bcac-74e322cd3cf5 tempest-IdentityV3ProjectTagsTest-591468286 tempest-IdentityV3ProjectTagsTest-591468286-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:15.887780 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1506946-4f1b-48eb-8a5a-4d5a5381a5e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:15.888531 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1506946-4f1b-48eb-8a5a-4d5a5381a5e3 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:15.888868 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1506946-4f1b-48eb-8a5a-4d5a5381a5e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:15.889148 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1506946-4f1b-48eb-8a5a-4d5a5381a5e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:15.890156 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1506946-4f1b-48eb-8a5a-4d5a5381a5e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:35:15.890666 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1506946-4f1b-48eb-8a5a-4d5a5381a5e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:15.892792 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1506946-4f1b-48eb-8a5a-4d5a5381a5e3 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:15.904199 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3351/6742] 10.222.0.17 () {58 vars in 1310 bytes} [Sat Jul 23 21:35:15 2022] GET /identity/v3/projects/dc042ee07fb14bebb010654b1b8dd235/tags/tempest-tag-602250492 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:35:15.908043 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc100cb-8eb4-432f-bcac-74e322cd3cf5 tempest-IdentityV3ProjectTagsTest-591468286 tempest-IdentityV3ProjectTagsTest-591468286-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:15.911076 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3392/6743] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:35:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:35:15.915655 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1506946-4f1b-48eb-8a5a-4d5a5381a5e3 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:15.923567 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc100cb-8eb4-432f-bcac-74e322cd3cf5 tempest-IdentityV3ProjectTagsTest-591468286 tempest-IdentityV3ProjectTagsTest-591468286-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:15.929813 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ee4ed2-00e6-4618-a098-29cf855da1f2 tempest-IdentityV3ProjectTagsTest-591468286 tempest-IdentityV3ProjectTagsTest-591468286-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd593449bc4024179b73b6f77270e8d1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38bf537f01d54245b12994ae15c53b1d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:15.930862 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ee4ed2-00e6-4618-a098-29cf855da1f2 tempest-IdentityV3ProjectTagsTest-591468286 tempest-IdentityV3ProjectTagsTest-591468286-project-admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:15.931149 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ee4ed2-00e6-4618-a098-29cf855da1f2 tempest-IdentityV3ProjectTagsTest-591468286 tempest-IdentityV3ProjectTagsTest-591468286-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:15.931424 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ee4ed2-00e6-4618-a098-29cf855da1f2 tempest-IdentityV3ProjectTagsTest-591468286 tempest-IdentityV3ProjectTagsTest-591468286-project-admin] PATH_INFO: `/v3/projects/dc042ee07fb14bebb010654b1b8dd235/tags` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:15.932594 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1506946-4f1b-48eb-8a5a-4d5a5381a5e3 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:15.932750 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ee4ed2-00e6-4618-a098-29cf855da1f2 tempest-IdentityV3ProjectTagsTest-591468286 tempest-IdentityV3ProjectTagsTest-591468286-project-admin] RBAC: Authorizing `identity:update_project_tags(project_id=dc042ee07fb14bebb010654b1b8dd235)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:15.934890 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ee4ed2-00e6-4618-a098-29cf855da1f2 tempest-IdentityV3ProjectTagsTest-591468286 tempest-IdentityV3ProjectTagsTest-591468286-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:15.939160 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e302fcd-e2ec-4b2d-b2e6-87ddd1101007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:15.940017 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e302fcd-e2ec-4b2d-b2e6-87ddd1101007 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:15.940391 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e302fcd-e2ec-4b2d-b2e6-87ddd1101007 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:15.940829 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e302fcd-e2ec-4b2d-b2e6-87ddd1101007 admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:15.941851 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e302fcd-e2ec-4b2d-b2e6-87ddd1101007 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:15.945958 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e302fcd-e2ec-4b2d-b2e6-87ddd1101007 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:15.980100 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3393/6744] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:35:15 2022] POST /identity/v3/projects => generated 371 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:35:15.984209 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e302fcd-e2ec-4b2d-b2e6-87ddd1101007 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:16.001175 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3352/6745] 10.222.0.17 () {60 vars in 1264 bytes} [Sat Jul 23 21:35:15 2022] PUT /identity/v3/projects/dc042ee07fb14bebb010654b1b8dd235/tags => generated 140 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:35:16.005167 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ee4ed2-00e6-4618-a098-29cf855da1f2 tempest-IdentityV3ProjectTagsTest-591468286 tempest-IdentityV3ProjectTagsTest-591468286-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:16.022206 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ee4ed2-00e6-4618-a098-29cf855da1f2 tempest-IdentityV3ProjectTagsTest-591468286 tempest-IdentityV3ProjectTagsTest-591468286-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:16.036862 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:35:16.068516 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e302fcd-e2ec-4b2d-b2e6-87ddd1101007 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:16.079875 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d53785-9fb1-404c-9726-c545915b456f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:16.080607 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d53785-9fb1-404c-9726-c545915b456f admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:16.080889 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d53785-9fb1-404c-9726-c545915b456f admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:16.081166 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d53785-9fb1-404c-9726-c545915b456f admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:16.083280 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d53785-9fb1-404c-9726-c545915b456f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:16.085289 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d53785-9fb1-404c-9726-c545915b456f admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:16.111309 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3394/6746] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:35:15 2022] POST /identity/v3/users => generated 286 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:35:16.114564 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33704aa7-8cbb-457d-951f-ef8bc86daabf tempest-IdentityV3ProjectTagsTest-591468286 tempest-IdentityV3ProjectTagsTest-591468286-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd593449bc4024179b73b6f77270e8d1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38bf537f01d54245b12994ae15c53b1d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:16.115461 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d53785-9fb1-404c-9726-c545915b456f admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:16.115786 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33704aa7-8cbb-457d-951f-ef8bc86daabf tempest-IdentityV3ProjectTagsTest-591468286 tempest-IdentityV3ProjectTagsTest-591468286-project-admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:16.116224 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33704aa7-8cbb-457d-951f-ef8bc86daabf tempest-IdentityV3ProjectTagsTest-591468286 tempest-IdentityV3ProjectTagsTest-591468286-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:16.116560 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33704aa7-8cbb-457d-951f-ef8bc86daabf tempest-IdentityV3ProjectTagsTest-591468286 tempest-IdentityV3ProjectTagsTest-591468286-project-admin] PATH_INFO: `/v3/projects/dc042ee07fb14bebb010654b1b8dd235/tags` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:16.130473 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d53785-9fb1-404c-9726-c545915b456f admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:16.130691 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33704aa7-8cbb-457d-951f-ef8bc86daabf tempest-IdentityV3ProjectTagsTest-591468286 tempest-IdentityV3ProjectTagsTest-591468286-project-admin] RBAC: Authorizing `identity:list_project_tags(project_id=dc042ee07fb14bebb010654b1b8dd235)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:16.132862 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33704aa7-8cbb-457d-951f-ef8bc86daabf tempest-IdentityV3ProjectTagsTest-591468286 tempest-IdentityV3ProjectTagsTest-591468286-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:16.135261 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adcc0ff-cbb9-4f08-83f8-acd76563aa88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:16.135945 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adcc0ff-cbb9-4f08-83f8-acd76563aa88 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:16.136228 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adcc0ff-cbb9-4f08-83f8-acd76563aa88 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:16.136977 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adcc0ff-cbb9-4f08-83f8-acd76563aa88 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:16.137499 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adcc0ff-cbb9-4f08-83f8-acd76563aa88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:16.139339 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adcc0ff-cbb9-4f08-83f8-acd76563aa88 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:16.153652 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3395/6747] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:35:16 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 21:35:16.157636 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3353/6748] 10.222.0.17 () {58 vars in 1244 bytes} [Sat Jul 23 21:35:16 2022] GET /identity/v3/projects/dc042ee07fb14bebb010654b1b8dd235/tags => generated 140 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:35:16.157782 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adcc0ff-cbb9-4f08-83f8-acd76563aa88 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:16.159320 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33704aa7-8cbb-457d-951f-ef8bc86daabf tempest-IdentityV3ProjectTagsTest-591468286 tempest-IdentityV3ProjectTagsTest-591468286-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:16.169411 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adcc0ff-cbb9-4f08-83f8-acd76563aa88 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:16.171286 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33704aa7-8cbb-457d-951f-ef8bc86daabf tempest-IdentityV3ProjectTagsTest-591468286 tempest-IdentityV3ProjectTagsTest-591468286-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:16.175928 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a4cbcb-58af-42a8-8c8b-3eb795eb0780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:16.177205 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a4cbcb-58af-42a8-8c8b-3eb795eb0780 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:16.177485 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a4cbcb-58af-42a8-8c8b-3eb795eb0780 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:16.177768 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a4cbcb-58af-42a8-8c8b-3eb795eb0780 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:16.178053 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2551ab97-3276-4cdc-9ae1-4eb2b04bf23a tempest-IdentityV3ProjectTagsTest-591468286 tempest-IdentityV3ProjectTagsTest-591468286-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd593449bc4024179b73b6f77270e8d1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38bf537f01d54245b12994ae15c53b1d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:16.179011 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a4cbcb-58af-42a8-8c8b-3eb795eb0780 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:16.179152 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2551ab97-3276-4cdc-9ae1-4eb2b04bf23a tempest-IdentityV3ProjectTagsTest-591468286 tempest-IdentityV3ProjectTagsTest-591468286-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:16.179516 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2551ab97-3276-4cdc-9ae1-4eb2b04bf23a tempest-IdentityV3ProjectTagsTest-591468286 tempest-IdentityV3ProjectTagsTest-591468286-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:16.179894 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2551ab97-3276-4cdc-9ae1-4eb2b04bf23a tempest-IdentityV3ProjectTagsTest-591468286 tempest-IdentityV3ProjectTagsTest-591468286-project-admin] PATH_INFO: `/v3/projects/dc042ee07fb14bebb010654b1b8dd235/tags/tempest-tag-367944797` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:16.180164 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a4cbcb-58af-42a8-8c8b-3eb795eb0780 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:16.182746 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2551ab97-3276-4cdc-9ae1-4eb2b04bf23a tempest-IdentityV3ProjectTagsTest-591468286 tempest-IdentityV3ProjectTagsTest-591468286-project-admin] RBAC: Authorizing `identity:delete_project_tag(project_id=dc042ee07fb14bebb010654b1b8dd235, value=tempest-tag-367944797)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:16.185851 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2551ab97-3276-4cdc-9ae1-4eb2b04bf23a tempest-IdentityV3ProjectTagsTest-591468286 tempest-IdentityV3ProjectTagsTest-591468286-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:16.200373 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3396/6749] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:35:16 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:35:16.205985 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a4cbcb-58af-42a8-8c8b-3eb795eb0780 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:16.213254 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:35:16.220820 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a4cbcb-58af-42a8-8c8b-3eb795eb0780 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:16.235345 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0010f8-fb1d-4d15-af54-3bf985e8cf7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:16.237036 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0010f8-fb1d-4d15-af54-3bf985e8cf7d admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:16.239006 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0010f8-fb1d-4d15-af54-3bf985e8cf7d admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:16.239527 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0010f8-fb1d-4d15-af54-3bf985e8cf7d admin admin] PATH_INFO: `/v3/projects/9b34dda716324ea18efd15edea1b519c/users/adeb01a7eec540b8aa7f4a300351610c/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:16.242684 ncdv-master-1 devstack@keystone.service[91547]: WARNING py.warnings [None req-2551ab97-3276-4cdc-9ae1-4eb2b04bf23a tempest-IdentityV3ProjectTagsTest-591468286 tempest-IdentityV3ProjectTagsTest-591468286-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-tag-367944797. To ensure interoperability, identifiers should be a valid uuid. Jul 23 21:35:16.242684 ncdv-master-1 devstack@keystone.service[91547]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Jul 23 21:35:16.242684 ncdv-master-1 devstack@keystone.service[91547]: Jul 23 21:35:16.249912 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3354/6750] 10.222.0.17 () {58 vars in 1313 bytes} [Sat Jul 23 21:35:16 2022] DELETE /identity/v3/projects/dc042ee07fb14bebb010654b1b8dd235/tags/tempest-tag-367944797 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:35:16.256070 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2551ab97-3276-4cdc-9ae1-4eb2b04bf23a tempest-IdentityV3ProjectTagsTest-591468286 tempest-IdentityV3ProjectTagsTest-591468286-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:16.261607 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0010f8-fb1d-4d15-af54-3bf985e8cf7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b34dda716324ea18efd15edea1b519c, user_id=adeb01a7eec540b8aa7f4a300351610c, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:16.265143 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0010f8-fb1d-4d15-af54-3bf985e8cf7d admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:16.269147 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2551ab97-3276-4cdc-9ae1-4eb2b04bf23a tempest-IdentityV3ProjectTagsTest-591468286 tempest-IdentityV3ProjectTagsTest-591468286-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:16.287753 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5027fae-c9b5-485a-80a0-96672717913e tempest-IdentityV3ProjectTagsTest-591468286 tempest-IdentityV3ProjectTagsTest-591468286-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd593449bc4024179b73b6f77270e8d1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38bf537f01d54245b12994ae15c53b1d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:16.288992 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5027fae-c9b5-485a-80a0-96672717913e tempest-IdentityV3ProjectTagsTest-591468286 tempest-IdentityV3ProjectTagsTest-591468286-project-admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:16.289457 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5027fae-c9b5-485a-80a0-96672717913e tempest-IdentityV3ProjectTagsTest-591468286 tempest-IdentityV3ProjectTagsTest-591468286-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:16.289891 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5027fae-c9b5-485a-80a0-96672717913e tempest-IdentityV3ProjectTagsTest-591468286 tempest-IdentityV3ProjectTagsTest-591468286-project-admin] PATH_INFO: `/v3/projects/dc042ee07fb14bebb010654b1b8dd235/tags/tempest-tag-367944797` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:16.290166 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3397/6751] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:35:16 2022] PUT /identity/v3/projects/9b34dda716324ea18efd15edea1b519c/users/adeb01a7eec540b8aa7f4a300351610c/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:35:16.300871 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f29132-d620-428f-b4b6-0f4b435eaaaa None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:16.301538 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f29132-d620-428f-b4b6-0f4b435eaaaa None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:16.302113 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f29132-d620-428f-b4b6-0f4b435eaaaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:16.316046 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5027fae-c9b5-485a-80a0-96672717913e tempest-IdentityV3ProjectTagsTest-591468286 tempest-IdentityV3ProjectTagsTest-591468286-project-admin] RBAC: Authorizing `identity:get_project_tag(project_id=dc042ee07fb14bebb010654b1b8dd235, value=tempest-tag-367944797)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:16.319870 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5027fae-c9b5-485a-80a0-96672717913e tempest-IdentityV3ProjectTagsTest-591468286 tempest-IdentityV3ProjectTagsTest-591468286-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:16.348084 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-b5027fae-c9b5-485a-80a0-96672717913e tempest-IdentityV3ProjectTagsTest-591468286 tempest-IdentityV3ProjectTagsTest-591468286-project-admin] Could not find project tag: tempest-tag-367944797.: keystone.exception.ProjectTagNotFound: Could not find project tag: tempest-tag-367944797. Jul 23 21:35:16.348084 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 21:35:16.348084 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 21:35:16.348084 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 21:35:16.348084 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 21:35:16.348084 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 21:35:16.348084 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 21:35:16.348084 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 21:35:16.348084 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 21:35:16.348084 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 21:35:16.348084 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 21:35:16.348084 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 21:35:16.348084 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 284, in get Jul 23 21:35:16.348084 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application PROVIDERS.resource_api.get_project_tag(project_id, value) Jul 23 21:35:16.349330 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 21:35:16.349330 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 21:35:16.349330 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 960, in get_project_tag Jul 23 21:35:16.349330 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.ProjectTagNotFound(project_tag=tag_name) Jul 23 21:35:16.349330 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.ProjectTagNotFound: Could not find project tag: tempest-tag-367944797. Jul 23 21:35:16.349330 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 21:35:16.352341 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3355/6752] 10.222.0.17 () {58 vars in 1310 bytes} [Sat Jul 23 21:35:16 2022] GET /identity/v3/projects/dc042ee07fb14bebb010654b1b8dd235/tags/tempest-tag-367944797 => generated 106 bytes in 99 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Jul 23 21:35:16.354990 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-01f29132-d620-428f-b4b6-0f4b435eaaaa None None] MFA Rules not processed for user `adeb01a7eec540b8aa7f4a300351610c`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:35:16.356323 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-01f29132-d620-428f-b4b6-0f4b435eaaaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:16.357115 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5027fae-c9b5-485a-80a0-96672717913e tempest-IdentityV3ProjectTagsTest-591468286 tempest-IdentityV3ProjectTagsTest-591468286-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:16.377305 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5027fae-c9b5-485a-80a0-96672717913e tempest-IdentityV3ProjectTagsTest-591468286 tempest-IdentityV3ProjectTagsTest-591468286-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:16.478677 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2268efb8-95d1-42ee-bd4c-33ebea4aad01 tempest-IdentityV3ProjectTagsTest-591468286 tempest-IdentityV3ProjectTagsTest-591468286-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd593449bc4024179b73b6f77270e8d1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38bf537f01d54245b12994ae15c53b1d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:16.479945 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2268efb8-95d1-42ee-bd4c-33ebea4aad01 tempest-IdentityV3ProjectTagsTest-591468286 tempest-IdentityV3ProjectTagsTest-591468286-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:16.480679 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2268efb8-95d1-42ee-bd4c-33ebea4aad01 tempest-IdentityV3ProjectTagsTest-591468286 tempest-IdentityV3ProjectTagsTest-591468286-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:16.481157 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2268efb8-95d1-42ee-bd4c-33ebea4aad01 tempest-IdentityV3ProjectTagsTest-591468286 tempest-IdentityV3ProjectTagsTest-591468286-project-admin] PATH_INFO: `/v3/projects/dc042ee07fb14bebb010654b1b8dd235/tags` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:16.483294 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2268efb8-95d1-42ee-bd4c-33ebea4aad01 tempest-IdentityV3ProjectTagsTest-591468286 tempest-IdentityV3ProjectTagsTest-591468286-project-admin] RBAC: Authorizing `identity:delete_project_tags(project_id=dc042ee07fb14bebb010654b1b8dd235)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:16.489561 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3398/6753] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:35:16 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:35:16.489788 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2268efb8-95d1-42ee-bd4c-33ebea4aad01 tempest-IdentityV3ProjectTagsTest-591468286 tempest-IdentityV3ProjectTagsTest-591468286-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:16.522009 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f29132-d620-428f-b4b6-0f4b435eaaaa None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:16.522009 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-01f29132-d620-428f-b4b6-0f4b435eaaaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:16.585460 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3356/6754] 10.222.0.17 () {58 vars in 1247 bytes} [Sat Jul 23 21:35:16 2022] DELETE /identity/v3/projects/dc042ee07fb14bebb010654b1b8dd235/tags => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:35:16.588681 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2268efb8-95d1-42ee-bd4c-33ebea4aad01 tempest-IdentityV3ProjectTagsTest-591468286 tempest-IdentityV3ProjectTagsTest-591468286-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:16.602579 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2268efb8-95d1-42ee-bd4c-33ebea4aad01 tempest-IdentityV3ProjectTagsTest-591468286 tempest-IdentityV3ProjectTagsTest-591468286-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:16.608082 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af67887-5543-4005-a961-492b78db3af8 tempest-IdentityV3ProjectTagsTest-591468286 tempest-IdentityV3ProjectTagsTest-591468286-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd593449bc4024179b73b6f77270e8d1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38bf537f01d54245b12994ae15c53b1d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:16.609159 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af67887-5543-4005-a961-492b78db3af8 tempest-IdentityV3ProjectTagsTest-591468286 tempest-IdentityV3ProjectTagsTest-591468286-project-admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:16.609649 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af67887-5543-4005-a961-492b78db3af8 tempest-IdentityV3ProjectTagsTest-591468286 tempest-IdentityV3ProjectTagsTest-591468286-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:16.610280 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af67887-5543-4005-a961-492b78db3af8 tempest-IdentityV3ProjectTagsTest-591468286 tempest-IdentityV3ProjectTagsTest-591468286-project-admin] PATH_INFO: `/v3/projects/dc042ee07fb14bebb010654b1b8dd235/tags` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:16.612880 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:35:16.636174 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af67887-5543-4005-a961-492b78db3af8 tempest-IdentityV3ProjectTagsTest-591468286 tempest-IdentityV3ProjectTagsTest-591468286-project-admin] RBAC: Authorizing `identity:list_project_tags(project_id=dc042ee07fb14bebb010654b1b8dd235)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:16.640067 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af67887-5543-4005-a961-492b78db3af8 tempest-IdentityV3ProjectTagsTest-591468286 tempest-IdentityV3ProjectTagsTest-591468286-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:16.661879 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3357/6755] 10.222.0.17 () {58 vars in 1244 bytes} [Sat Jul 23 21:35:16 2022] GET /identity/v3/projects/dc042ee07fb14bebb010654b1b8dd235/tags => generated 66 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 23 21:35:16.663288 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af67887-5543-4005-a961-492b78db3af8 tempest-IdentityV3ProjectTagsTest-591468286 tempest-IdentityV3ProjectTagsTest-591468286-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:16.663564 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f29132-d620-428f-b4b6-0f4b435eaaaa None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:16.669927 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1dbba7-0fe6-4c0f-ae15-f66777e31618 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:16.670744 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1dbba7-0fe6-4c0f-ae15-f66777e31618 service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:16.671126 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1dbba7-0fe6-4c0f-ae15-f66777e31618 service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:16.671501 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1dbba7-0fe6-4c0f-ae15-f66777e31618 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:16.677884 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af67887-5543-4005-a961-492b78db3af8 tempest-IdentityV3ProjectTagsTest-591468286 tempest-IdentityV3ProjectTagsTest-591468286-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:16.683655 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a577128-f787-449e-a418-32dd75788376 tempest-IdentityV3ProjectTagsTest-591468286 tempest-IdentityV3ProjectTagsTest-591468286-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd593449bc4024179b73b6f77270e8d1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38bf537f01d54245b12994ae15c53b1d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:16.684988 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a577128-f787-449e-a418-32dd75788376 tempest-IdentityV3ProjectTagsTest-591468286 tempest-IdentityV3ProjectTagsTest-591468286-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:16.685447 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a577128-f787-449e-a418-32dd75788376 tempest-IdentityV3ProjectTagsTest-591468286 tempest-IdentityV3ProjectTagsTest-591468286-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:16.686052 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a577128-f787-449e-a418-32dd75788376 tempest-IdentityV3ProjectTagsTest-591468286 tempest-IdentityV3ProjectTagsTest-591468286-project-admin] PATH_INFO: `/v3/projects/dc042ee07fb14bebb010654b1b8dd235` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:16.687703 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a577128-f787-449e-a418-32dd75788376 tempest-IdentityV3ProjectTagsTest-591468286 tempest-IdentityV3ProjectTagsTest-591468286-project-admin] RBAC: Authorizing `identity:delete_project(project_id=dc042ee07fb14bebb010654b1b8dd235)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:16.690207 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a577128-f787-449e-a418-32dd75788376 tempest-IdentityV3ProjectTagsTest-591468286 tempest-IdentityV3ProjectTagsTest-591468286-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:16.690621 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1dbba7-0fe6-4c0f-ae15-f66777e31618 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:16.694527 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1dbba7-0fe6-4c0f-ae15-f66777e31618 service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:16.721798 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3399/6756] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:35:16 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:35:16.768147 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-8a577128-f787-449e-a418-32dd75788376 tempest-IdentityV3ProjectTagsTest-591468286 tempest-IdentityV3ProjectTagsTest-591468286-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc042ee07fb14bebb010654b1b8dd235', 'request_id': 'req-8a577128-f787-449e-a418-32dd75788376'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:16.779689 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-8a577128-f787-449e-a418-32dd75788376 tempest-IdentityV3ProjectTagsTest-591468286 tempest-IdentityV3ProjectTagsTest-591468286-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc042ee07fb14bebb010654b1b8dd235', 'request_id': 'req-8a577128-f787-449e-a418-32dd75788376'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:16.789556 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-8a577128-f787-449e-a418-32dd75788376 tempest-IdentityV3ProjectTagsTest-591468286 tempest-IdentityV3ProjectTagsTest-591468286-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc042ee07fb14bebb010654b1b8dd235', 'request_id': 'req-8a577128-f787-449e-a418-32dd75788376'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:16.816094 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-8a577128-f787-449e-a418-32dd75788376 tempest-IdentityV3ProjectTagsTest-591468286 tempest-IdentityV3ProjectTagsTest-591468286-project-admin] The token cache is being invalidate because project dc042ee07fb14bebb010654b1b8dd235 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:35:16.816094 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-8a577128-f787-449e-a418-32dd75788376 tempest-IdentityV3ProjectTagsTest-591468286 tempest-IdentityV3ProjectTagsTest-591468286-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:16.816094 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-8a577128-f787-449e-a418-32dd75788376 tempest-IdentityV3ProjectTagsTest-591468286 tempest-IdentityV3ProjectTagsTest-591468286-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:16.825597 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1dbba7-0fe6-4c0f-ae15-f66777e31618 service neutron] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:16.826244 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3358/6757] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:35:16 2022] DELETE /identity/v3/projects/dc042ee07fb14bebb010654b1b8dd235 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:35:16.827784 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-3f1dbba7-0fe6-4c0f-ae15-f66777e31618 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:16.933762 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1dbba7-0fe6-4c0f-ae15-f66777e31618 service neutron] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:16.955042 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:35:17.028961 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab23608-26e2-42de-9fb5-21ea8f40cec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:17.030209 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab23608-26e2-42de-9fb5-21ea8f40cec7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:17.030653 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab23608-26e2-42de-9fb5-21ea8f40cec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:17.031116 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab23608-26e2-42de-9fb5-21ea8f40cec7 admin admin] PATH_INFO: `/v3/users/f36d55aaab9947c0b5c5b0fee94c9799` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:17.038785 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab23608-26e2-42de-9fb5-21ea8f40cec7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f36d55aaab9947c0b5c5b0fee94c9799)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:17.040952 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab23608-26e2-42de-9fb5-21ea8f40cec7 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:17.162656 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-bab23608-26e2-42de-9fb5-21ea8f40cec7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f36d55aaab9947c0b5c5b0fee94c9799'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:17.163407 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-bab23608-26e2-42de-9fb5-21ea8f40cec7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f36d55aaab9947c0b5c5b0fee94c9799'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:17.174538 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-bab23608-26e2-42de-9fb5-21ea8f40cec7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f36d55aaab9947c0b5c5b0fee94c9799'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:17.189294 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-bab23608-26e2-42de-9fb5-21ea8f40cec7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f36d55aaab9947c0b5c5b0fee94c9799'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:17.208989 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-bab23608-26e2-42de-9fb5-21ea8f40cec7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f36d55aaab9947c0b5c5b0fee94c9799'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:17.220678 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3400/6758] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:35:16 2022] DELETE /identity/v3/users/f36d55aaab9947c0b5c5b0fee94c9799 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:35:17.224388 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183a9c15-6b2b-4b95-8889-09393442a6b0 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:17.224675 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183a9c15-6b2b-4b95-8889-09393442a6b0 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:17.225020 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183a9c15-6b2b-4b95-8889-09393442a6b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:17.245220 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-183a9c15-6b2b-4b95-8889-09393442a6b0 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:35:17.246463 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-183a9c15-6b2b-4b95-8889-09393442a6b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:17.337847 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3359/6759] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:35:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:35:17.358255 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab23608-26e2-42de-9fb5-21ea8f40cec7 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:17.359912 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-bab23608-26e2-42de-9fb5-21ea8f40cec7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:17.434424 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab23608-26e2-42de-9fb5-21ea8f40cec7 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:17.441081 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a94c685-aa19-4550-8c91-eba15d043263 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:17.442223 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a94c685-aa19-4550-8c91-eba15d043263 service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:17.442504 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a94c685-aa19-4550-8c91-eba15d043263 service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:17.442833 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a94c685-aa19-4550-8c91-eba15d043263 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:17.453423 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a94c685-aa19-4550-8c91-eba15d043263 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:17.455024 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a94c685-aa19-4550-8c91-eba15d043263 service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:17.469549 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3401/6760] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:35:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:35:17.839983 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183a9c15-6b2b-4b95-8889-09393442a6b0 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:17.841566 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-183a9c15-6b2b-4b95-8889-09393442a6b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:17.870481 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183a9c15-6b2b-4b95-8889-09393442a6b0 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:17.879081 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c797a96-259b-4a7d-8d24-6ec5baf5d05f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:17.880058 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c797a96-259b-4a7d-8d24-6ec5baf5d05f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:17.880347 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c797a96-259b-4a7d-8d24-6ec5baf5d05f admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:17.880612 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c797a96-259b-4a7d-8d24-6ec5baf5d05f admin admin] PATH_INFO: `/v3/users/adeb01a7eec540b8aa7f4a300351610c` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:17.882369 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c797a96-259b-4a7d-8d24-6ec5baf5d05f admin admin] RBAC: Authorizing `identity:delete_user(user_id=adeb01a7eec540b8aa7f4a300351610c)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:17.884757 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c797a96-259b-4a7d-8d24-6ec5baf5d05f admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:17.968187 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-8c797a96-259b-4a7d-8d24-6ec5baf5d05f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'adeb01a7eec540b8aa7f4a300351610c'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:17.982856 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-8c797a96-259b-4a7d-8d24-6ec5baf5d05f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'adeb01a7eec540b8aa7f4a300351610c'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:17.986991 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-8c797a96-259b-4a7d-8d24-6ec5baf5d05f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'adeb01a7eec540b8aa7f4a300351610c'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:18.003672 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-8c797a96-259b-4a7d-8d24-6ec5baf5d05f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'adeb01a7eec540b8aa7f4a300351610c'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:18.005754 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:35:18.022037 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a94c685-aa19-4550-8c91-eba15d043263 service neutron] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:18.023519 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-0a94c685-aa19-4550-8c91-eba15d043263 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:18.024266 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-8c797a96-259b-4a7d-8d24-6ec5baf5d05f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'adeb01a7eec540b8aa7f4a300351610c'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:18.036682 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3360/6761] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:35:17 2022] DELETE /identity/v3/users/adeb01a7eec540b8aa7f4a300351610c => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:35:18.041349 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d653cb9-d928-4044-92b4-558ad82c5307 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:18.041638 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d653cb9-d928-4044-92b4-558ad82c5307 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:18.041947 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d653cb9-d928-4044-92b4-558ad82c5307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:18.044427 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a94c685-aa19-4550-8c91-eba15d043263 service neutron] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:18.063054 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-0d653cb9-d928-4044-92b4-558ad82c5307 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:35:18.064587 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-0d653cb9-d928-4044-92b4-558ad82c5307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:18.121778 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:35:18.151164 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdfbbbd-d32a-495a-8e9c-93e916a75e11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:18.152051 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdfbbbd-d32a-495a-8e9c-93e916a75e11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:18.152334 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdfbbbd-d32a-495a-8e9c-93e916a75e11 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:18.152698 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdfbbbd-d32a-495a-8e9c-93e916a75e11 admin admin] PATH_INFO: `/v3/projects/2918d8f16a66478eae767160fc8649a7` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:18.166068 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdfbbbd-d32a-495a-8e9c-93e916a75e11 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2918d8f16a66478eae767160fc8649a7)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:18.168637 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdfbbbd-d32a-495a-8e9c-93e916a75e11 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:18.176178 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3361/6762] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:35:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:35:18.188973 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d653cb9-d928-4044-92b4-558ad82c5307 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:18.191670 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-0d653cb9-d928-4044-92b4-558ad82c5307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:18.235689 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-0bdfbbbd-d32a-495a-8e9c-93e916a75e11 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2918d8f16a66478eae767160fc8649a7', 'request_id': 'req-0bdfbbbd-d32a-495a-8e9c-93e916a75e11'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:18.248639 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-0bdfbbbd-d32a-495a-8e9c-93e916a75e11 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2918d8f16a66478eae767160fc8649a7', 'request_id': 'req-0bdfbbbd-d32a-495a-8e9c-93e916a75e11'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:18.258127 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-0bdfbbbd-d32a-495a-8e9c-93e916a75e11 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2918d8f16a66478eae767160fc8649a7', 'request_id': 'req-0bdfbbbd-d32a-495a-8e9c-93e916a75e11'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:18.270419 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-0bdfbbbd-d32a-495a-8e9c-93e916a75e11 admin admin] The token cache is being invalidate because project 2918d8f16a66478eae767160fc8649a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:35:18.270940 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d653cb9-d928-4044-92b4-558ad82c5307 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:18.271100 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-0bdfbbbd-d32a-495a-8e9c-93e916a75e11 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:18.271772 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-0bdfbbbd-d32a-495a-8e9c-93e916a75e11 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:18.273606 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3402/6763] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:35:18 2022] DELETE /identity/v3/projects/2918d8f16a66478eae767160fc8649a7 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:35:18.283266 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdfbbbd-d32a-495a-8e9c-93e916a75e11 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:18.284920 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-0bdfbbbd-d32a-495a-8e9c-93e916a75e11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:18.326479 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf3057d-1762-4077-b9d3-ef16d4ddd830 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:18.327153 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf3057d-1762-4077-b9d3-ef16d4ddd830 service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:18.327437 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf3057d-1762-4077-b9d3-ef16d4ddd830 service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:18.327714 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf3057d-1762-4077-b9d3-ef16d4ddd830 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:18.329721 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-eaf3057d-1762-4077-b9d3-ef16d4ddd830 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:18.360527 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdfbbbd-d32a-495a-8e9c-93e916a75e11 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:18.367022 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa960d3-6b49-4cd7-a54c-ddccd4b284ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:18.368032 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa960d3-6b49-4cd7-a54c-ddccd4b284ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:18.368318 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa960d3-6b49-4cd7-a54c-ddccd4b284ea admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:18.368583 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa960d3-6b49-4cd7-a54c-ddccd4b284ea admin admin] PATH_INFO: `/v3/users/d593449bc4024179b73b6f77270e8d1d` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:18.369953 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa960d3-6b49-4cd7-a54c-ddccd4b284ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=d593449bc4024179b73b6f77270e8d1d)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:18.372131 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa960d3-6b49-4cd7-a54c-ddccd4b284ea admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:18.393478 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:35:18.412349 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf3057d-1762-4077-b9d3-ef16d4ddd830 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:18.413990 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf3057d-1762-4077-b9d3-ef16d4ddd830 service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:18.425356 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3362/6764] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:35:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 23 21:35:18.429986 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-baa960d3-6b49-4cd7-a54c-ddccd4b284ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd593449bc4024179b73b6f77270e8d1d'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:18.430767 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-baa960d3-6b49-4cd7-a54c-ddccd4b284ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd593449bc4024179b73b6f77270e8d1d'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:18.440106 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-baa960d3-6b49-4cd7-a54c-ddccd4b284ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd593449bc4024179b73b6f77270e8d1d'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:18.452528 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-baa960d3-6b49-4cd7-a54c-ddccd4b284ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd593449bc4024179b73b6f77270e8d1d'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:18.464475 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:35:18.474577 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-baa960d3-6b49-4cd7-a54c-ddccd4b284ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd593449bc4024179b73b6f77270e8d1d'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:18.488299 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3403/6765] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:35:18 2022] DELETE /identity/v3/users/d593449bc4024179b73b6f77270e8d1d => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:35:18.911558 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf3057d-1762-4077-b9d3-ef16d4ddd830 service neutron] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:18.916824 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-eaf3057d-1762-4077-b9d3-ef16d4ddd830 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:18.961136 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf3057d-1762-4077-b9d3-ef16d4ddd830 service neutron] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:19.041639 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede06d27-f55e-4412-9df7-a48272b1411e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:19.047859 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa960d3-6b49-4cd7-a54c-ddccd4b284ea admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:19.049547 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-baa960d3-6b49-4cd7-a54c-ddccd4b284ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:19.054259 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede06d27-f55e-4412-9df7-a48272b1411e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:19.054598 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede06d27-f55e-4412-9df7-a48272b1411e admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:19.054897 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede06d27-f55e-4412-9df7-a48272b1411e admin admin] PATH_INFO: `/v3/projects/9b34dda716324ea18efd15edea1b519c` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:19.060643 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede06d27-f55e-4412-9df7-a48272b1411e admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b34dda716324ea18efd15edea1b519c)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:19.062638 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede06d27-f55e-4412-9df7-a48272b1411e admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:19.073138 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa960d3-6b49-4cd7-a54c-ddccd4b284ea admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:19.079827 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce1aab0-7209-4597-bb58-c998d4ff551c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:19.082076 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce1aab0-7209-4597-bb58-c998d4ff551c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:19.083263 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce1aab0-7209-4597-bb58-c998d4ff551c admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:19.083263 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce1aab0-7209-4597-bb58-c998d4ff551c admin admin] PATH_INFO: `/v3/projects/38bf537f01d54245b12994ae15c53b1d` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:19.085771 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce1aab0-7209-4597-bb58-c998d4ff551c admin admin] RBAC: Authorizing `identity:delete_project(project_id=38bf537f01d54245b12994ae15c53b1d)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:19.089785 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce1aab0-7209-4597-bb58-c998d4ff551c admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:19.143390 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-ede06d27-f55e-4412-9df7-a48272b1411e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b34dda716324ea18efd15edea1b519c', 'request_id': 'req-ede06d27-f55e-4412-9df7-a48272b1411e'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:19.154380 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-ede06d27-f55e-4412-9df7-a48272b1411e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b34dda716324ea18efd15edea1b519c', 'request_id': 'req-ede06d27-f55e-4412-9df7-a48272b1411e'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:19.163102 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-ede06d27-f55e-4412-9df7-a48272b1411e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b34dda716324ea18efd15edea1b519c', 'request_id': 'req-ede06d27-f55e-4412-9df7-a48272b1411e'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:19.174212 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-3ce1aab0-7209-4597-bb58-c998d4ff551c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38bf537f01d54245b12994ae15c53b1d', 'request_id': 'req-3ce1aab0-7209-4597-bb58-c998d4ff551c'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:19.178669 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-ede06d27-f55e-4412-9df7-a48272b1411e admin admin] The token cache is being invalidate because project 9b34dda716324ea18efd15edea1b519c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:35:19.178669 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-ede06d27-f55e-4412-9df7-a48272b1411e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:19.179855 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-ede06d27-f55e-4412-9df7-a48272b1411e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:19.182232 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3363/6766] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:35:18 2022] DELETE /identity/v3/projects/9b34dda716324ea18efd15edea1b519c => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:35:19.188166 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eb5d25-e7f0-459c-98cb-e37d0d31c799 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:19.188606 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eb5d25-e7f0-459c-98cb-e37d0d31c799 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:19.188948 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eb5d25-e7f0-459c-98cb-e37d0d31c799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:19.191953 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-3ce1aab0-7209-4597-bb58-c998d4ff551c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38bf537f01d54245b12994ae15c53b1d', 'request_id': 'req-3ce1aab0-7209-4597-bb58-c998d4ff551c'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:19.200538 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-3ce1aab0-7209-4597-bb58-c998d4ff551c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38bf537f01d54245b12994ae15c53b1d', 'request_id': 'req-3ce1aab0-7209-4597-bb58-c998d4ff551c'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:19.211018 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-73eb5d25-e7f0-459c-98cb-e37d0d31c799 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:35:19.212373 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-73eb5d25-e7f0-459c-98cb-e37d0d31c799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:19.213687 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-3ce1aab0-7209-4597-bb58-c998d4ff551c admin admin] The token cache is being invalidate because project 38bf537f01d54245b12994ae15c53b1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:35:19.214011 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-3ce1aab0-7209-4597-bb58-c998d4ff551c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:19.214677 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-3ce1aab0-7209-4597-bb58-c998d4ff551c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:19.216312 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3404/6767] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:35:19 2022] DELETE /identity/v3/projects/38bf537f01d54245b12994ae15c53b1d => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:35:19.223144 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9638e19f-ed3d-4188-94ff-c8cc0719a89b None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:19.223429 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9638e19f-ed3d-4188-94ff-c8cc0719a89b None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:19.223700 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9638e19f-ed3d-4188-94ff-c8cc0719a89b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:19.246238 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-9638e19f-ed3d-4188-94ff-c8cc0719a89b None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:35:19.247765 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-9638e19f-ed3d-4188-94ff-c8cc0719a89b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:19.305110 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3364/6768] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:35:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:35:19.312467 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8532b9-51aa-4f46-8555-96a998de4783 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:19.312757 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8532b9-51aa-4f46-8555-96a998de4783 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:19.313032 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8532b9-51aa-4f46-8555-96a998de4783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:19.336370 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-0b8532b9-51aa-4f46-8555-96a998de4783 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:35:19.337032 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3405/6769] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:35:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:35:19.344264 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-0b8532b9-51aa-4f46-8555-96a998de4783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:19.345002 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dd46b8-8dac-4501-b5a9-116090def23b None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:19.345448 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dd46b8-8dac-4501-b5a9-116090def23b None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:19.346003 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dd46b8-8dac-4501-b5a9-116090def23b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:19.361789 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3365/6770] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:35:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:35:19.370044 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-d3dd46b8-8dac-4501-b5a9-116090def23b None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:35:19.371103 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8532b9-51aa-4f46-8555-96a998de4783 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:19.371697 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-d3dd46b8-8dac-4501-b5a9-116090def23b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:19.383392 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3406/6771] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:35:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:35:19.384256 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8532b9-51aa-4f46-8555-96a998de4783 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:19.387410 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dd46b8-8dac-4501-b5a9-116090def23b None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:19.389349 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d959f5c-a4e1-4d4b-b4a6-4d391fde50cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:19.391511 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d959f5c-a4e1-4d4b-b4a6-4d391fde50cd admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:19.391806 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d959f5c-a4e1-4d4b-b4a6-4d391fde50cd admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:19.392083 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d959f5c-a4e1-4d4b-b4a6-4d391fde50cd admin admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:19.394091 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d959f5c-a4e1-4d4b-b4a6-4d391fde50cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:35:19.394418 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d959f5c-a4e1-4d4b-b4a6-4d391fde50cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:19.397933 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d959f5c-a4e1-4d4b-b4a6-4d391fde50cd admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:19.400566 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dd46b8-8dac-4501-b5a9-116090def23b None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:19.405646 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c087113-7bd2-4102-8f09-189c6010b23d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:19.406760 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c087113-7bd2-4102-8f09-189c6010b23d admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:19.407469 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c087113-7bd2-4102-8f09-189c6010b23d admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:19.407930 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c087113-7bd2-4102-8f09-189c6010b23d admin admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:19.408766 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:35:19.410475 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c087113-7bd2-4102-8f09-189c6010b23d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:35:19.410894 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c087113-7bd2-4102-8f09-189c6010b23d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:19.412934 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c087113-7bd2-4102-8f09-189c6010b23d admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:19.434888 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3366/6772] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:35:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:35:19.435290 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3407/6773] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:35:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 21:35:19.435290 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c087113-7bd2-4102-8f09-189c6010b23d admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:19.437797 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d959f5c-a4e1-4d4b-b4a6-4d391fde50cd admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:19.446690 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c087113-7bd2-4102-8f09-189c6010b23d admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:19.451081 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d959f5c-a4e1-4d4b-b4a6-4d391fde50cd admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:19.452349 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a987d53-adac-41a7-98a1-163d04cd708d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:19.453176 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a987d53-adac-41a7-98a1-163d04cd708d admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:19.454037 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a987d53-adac-41a7-98a1-163d04cd708d admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:19.454406 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a987d53-adac-41a7-98a1-163d04cd708d admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:19.455195 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a987d53-adac-41a7-98a1-163d04cd708d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:19.457332 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382ee6fc-ee4c-4657-ba87-531e90a0535a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:19.457897 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a987d53-adac-41a7-98a1-163d04cd708d admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:19.458540 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382ee6fc-ee4c-4657-ba87-531e90a0535a admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:19.458984 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382ee6fc-ee4c-4657-ba87-531e90a0535a admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:19.459458 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382ee6fc-ee4c-4657-ba87-531e90a0535a admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:19.460308 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382ee6fc-ee4c-4657-ba87-531e90a0535a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:19.463290 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382ee6fc-ee4c-4657-ba87-531e90a0535a admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:19.495866 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3408/6774] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:35:19 2022] POST /identity/v3/projects => generated 371 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:35:19.497005 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a987d53-adac-41a7-98a1-163d04cd708d admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:19.511076 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3367/6775] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:35:19 2022] POST /identity/v3/projects => generated 373 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:35:19.513942 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382ee6fc-ee4c-4657-ba87-531e90a0535a admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:19.537524 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=90,keystone:DELETE=8,keystone:INSERT=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:35:19.581732 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a987d53-adac-41a7-98a1-163d04cd708d admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:19.648173 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382ee6fc-ee4c-4657-ba87-531e90a0535a admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:19.653844 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7624e73f-ad9d-4000-b32b-36250961f280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:19.654657 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7624e73f-ad9d-4000-b32b-36250961f280 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:19.654941 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7624e73f-ad9d-4000-b32b-36250961f280 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:19.655217 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7624e73f-ad9d-4000-b32b-36250961f280 admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:19.655923 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7624e73f-ad9d-4000-b32b-36250961f280 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:19.658114 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7624e73f-ad9d-4000-b32b-36250961f280 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:19.696061 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3368/6776] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:35:19 2022] POST /identity/v3/users => generated 287 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:35:19.700390 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7624e73f-ad9d-4000-b32b-36250961f280 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:19.714318 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe9b3f2-06a2-4d1d-bdba-193bb2001edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:19.715030 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe9b3f2-06a2-4d1d-bdba-193bb2001edf admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:19.715296 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe9b3f2-06a2-4d1d-bdba-193bb2001edf admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:19.715562 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe9b3f2-06a2-4d1d-bdba-193bb2001edf admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:19.716471 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe9b3f2-06a2-4d1d-bdba-193bb2001edf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:19.717996 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7624e73f-ad9d-4000-b32b-36250961f280 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:19.718343 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe9b3f2-06a2-4d1d-bdba-193bb2001edf admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:19.726852 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9069db3e-f517-46e9-a9a5-c8450249c31f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:19.732323 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9069db3e-f517-46e9-a9a5-c8450249c31f admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:19.732323 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9069db3e-f517-46e9-a9a5-c8450249c31f admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:19.732323 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9069db3e-f517-46e9-a9a5-c8450249c31f admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:19.732323 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9069db3e-f517-46e9-a9a5-c8450249c31f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:19.733663 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9069db3e-f517-46e9-a9a5-c8450249c31f admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:19.760881 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3369/6777] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:35:19 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:35:19.764903 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9069db3e-f517-46e9-a9a5-c8450249c31f admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:19.781524 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3409/6778] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:35:19 2022] POST /identity/v3/users => generated 286 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:35:19.782560 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe9b3f2-06a2-4d1d-bdba-193bb2001edf admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:19.790388 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9069db3e-f517-46e9-a9a5-c8450249c31f admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:19.799213 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c5e785-30de-47eb-b482-65044add58c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:19.800218 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c5e785-30de-47eb-b482-65044add58c7 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:19.800618 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c5e785-30de-47eb-b482-65044add58c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:19.801214 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c5e785-30de-47eb-b482-65044add58c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:19.802457 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe9b3f2-06a2-4d1d-bdba-193bb2001edf admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:19.802987 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c5e785-30de-47eb-b482-65044add58c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:19.805291 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c5e785-30de-47eb-b482-65044add58c7 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:19.819215 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406df6d7-2834-4c41-95dd-6c80da8680c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:19.819981 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406df6d7-2834-4c41-95dd-6c80da8680c4 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:19.820269 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406df6d7-2834-4c41-95dd-6c80da8680c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:19.820549 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406df6d7-2834-4c41-95dd-6c80da8680c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:19.821288 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406df6d7-2834-4c41-95dd-6c80da8680c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:19.825417 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406df6d7-2834-4c41-95dd-6c80da8680c4 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:19.830354 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3370/6779] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:35:19 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 21:35:19.835100 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c5e785-30de-47eb-b482-65044add58c7 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:19.848237 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c5e785-30de-47eb-b482-65044add58c7 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:19.854218 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2e990f-afa9-4dea-a723-8c13a911fc4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:19.855203 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2e990f-afa9-4dea-a723-8c13a911fc4c admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:19.855597 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2e990f-afa9-4dea-a723-8c13a911fc4c admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:19.855930 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2e990f-afa9-4dea-a723-8c13a911fc4c admin admin] PATH_INFO: `/v3/projects/3de6c09100b34652a1a1e065c238e4d3/users/76b2183cd40d4943aa65a1fcc6f557da/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:19.864726 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3410/6780] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:35:19 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:35:19.865775 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406df6d7-2834-4c41-95dd-6c80da8680c4 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:19.885111 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406df6d7-2834-4c41-95dd-6c80da8680c4 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:19.895370 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2e990f-afa9-4dea-a723-8c13a911fc4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3de6c09100b34652a1a1e065c238e4d3, user_id=76b2183cd40d4943aa65a1fcc6f557da, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:19.898329 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2e990f-afa9-4dea-a723-8c13a911fc4c admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:19.902598 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6816b040-e948-4438-903f-ac8d65f58a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:19.903696 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6816b040-e948-4438-903f-ac8d65f58a7f admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:19.903933 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6816b040-e948-4438-903f-ac8d65f58a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:19.904265 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6816b040-e948-4438-903f-ac8d65f58a7f admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:19.905070 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6816b040-e948-4438-903f-ac8d65f58a7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:19.906876 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6816b040-e948-4438-903f-ac8d65f58a7f admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:19.920024 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3411/6781] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:35:19 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:35:19.924455 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6816b040-e948-4438-903f-ac8d65f58a7f admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:19.924638 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3371/6782] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:35:19 2022] PUT /identity/v3/projects/3de6c09100b34652a1a1e065c238e4d3/users/76b2183cd40d4943aa65a1fcc6f557da/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:35:19.936326 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e4597c-8c34-4331-b59d-ec2a4be135c6 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:19.936620 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e4597c-8c34-4331-b59d-ec2a4be135c6 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:19.936877 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e4597c-8c34-4331-b59d-ec2a4be135c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:19.947891 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6816b040-e948-4438-903f-ac8d65f58a7f admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:19.995811 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-80e4597c-8c34-4331-b59d-ec2a4be135c6 None None] MFA Rules not processed for user `76b2183cd40d4943aa65a1fcc6f557da`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:35:19.996367 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-80e4597c-8c34-4331-b59d-ec2a4be135c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:20.033217 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10edb041-9648-45df-bd65-616fa08dc346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:20.034326 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10edb041-9648-45df-bd65-616fa08dc346 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:20.034680 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10edb041-9648-45df-bd65-616fa08dc346 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:20.035021 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10edb041-9648-45df-bd65-616fa08dc346 admin admin] PATH_INFO: `/v3/projects/d3a91a1a84564bcd9fe28ec7b1996853/users/8c9b7f872d6e4d0293e4c3a402493848/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:20.061088 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10edb041-9648-45df-bd65-616fa08dc346 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3a91a1a84564bcd9fe28ec7b1996853, user_id=8c9b7f872d6e4d0293e4c3a402493848, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:20.064317 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10edb041-9648-45df-bd65-616fa08dc346 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:20.097970 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3412/6783] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:35:19 2022] PUT /identity/v3/projects/d3a91a1a84564bcd9fe28ec7b1996853/users/8c9b7f872d6e4d0293e4c3a402493848/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:35:20.105617 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455b8047-15c0-4ff0-869a-518a24701a86 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:20.105941 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455b8047-15c0-4ff0-869a-518a24701a86 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:20.106216 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455b8047-15c0-4ff0-869a-518a24701a86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:20.150046 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3372/6784] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:35:19 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:35:20.151138 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e4597c-8c34-4331-b59d-ec2a4be135c6 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:20.165641 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-455b8047-15c0-4ff0-869a-518a24701a86 None None] MFA Rules not processed for user `8c9b7f872d6e4d0293e4c3a402493848`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:35:20.174509 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e4597c-8c34-4331-b59d-ec2a4be135c6 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:20.180626 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-455b8047-15c0-4ff0-869a-518a24701a86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:20.196120 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:35:20.235719 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:35:20.294172 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3413/6785] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:35:20 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:35:20.311752 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f80d989-9ecb-4516-bc4f-6ffada68af1b tempest-EC2CredentialsTest-1201253909 tempest-EC2CredentialsTest-1201253909-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b2183cd40d4943aa65a1fcc6f557da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3de6c09100b34652a1a1e065c238e4d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:20.313205 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f80d989-9ecb-4516-bc4f-6ffada68af1b tempest-EC2CredentialsTest-1201253909 tempest-EC2CredentialsTest-1201253909-project] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:20.313785 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f80d989-9ecb-4516-bc4f-6ffada68af1b tempest-EC2CredentialsTest-1201253909 tempest-EC2CredentialsTest-1201253909-project] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:20.314103 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455b8047-15c0-4ff0-869a-518a24701a86 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:20.314620 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f80d989-9ecb-4516-bc4f-6ffada68af1b tempest-EC2CredentialsTest-1201253909 tempest-EC2CredentialsTest-1201253909-project] PATH_INFO: `/v3/users/76b2183cd40d4943aa65a1fcc6f557da/credentials/OS-EC2` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:20.315580 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f80d989-9ecb-4516-bc4f-6ffada68af1b tempest-EC2CredentialsTest-1201253909 tempest-EC2CredentialsTest-1201253909-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=76b2183cd40d4943aa65a1fcc6f557da)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:20.316144 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-455b8047-15c0-4ff0-869a-518a24701a86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:20.317902 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f80d989-9ecb-4516-bc4f-6ffada68af1b tempest-EC2CredentialsTest-1201253909 tempest-EC2CredentialsTest-1201253909-project] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:20.342198 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3373/6786] 10.222.0.17 () {60 vars in 1298 bytes} [Sat Jul 23 21:35:20 2022] POST /identity/v3/users/76b2183cd40d4943aa65a1fcc6f557da/credentials/OS-EC2 => generated 367 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:35:20.346022 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f80d989-9ecb-4516-bc4f-6ffada68af1b tempest-EC2CredentialsTest-1201253909 tempest-EC2CredentialsTest-1201253909-project] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:20.356974 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f80d989-9ecb-4516-bc4f-6ffada68af1b tempest-EC2CredentialsTest-1201253909 tempest-EC2CredentialsTest-1201253909-project] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:20.366055 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3968f7-fb97-4535-a178-190873063d53 tempest-EC2CredentialsTest-1201253909 tempest-EC2CredentialsTest-1201253909-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b2183cd40d4943aa65a1fcc6f557da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3de6c09100b34652a1a1e065c238e4d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:20.367382 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3968f7-fb97-4535-a178-190873063d53 tempest-EC2CredentialsTest-1201253909 tempest-EC2CredentialsTest-1201253909-project] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:20.367838 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3968f7-fb97-4535-a178-190873063d53 tempest-EC2CredentialsTest-1201253909 tempest-EC2CredentialsTest-1201253909-project] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:20.368262 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3968f7-fb97-4535-a178-190873063d53 tempest-EC2CredentialsTest-1201253909 tempest-EC2CredentialsTest-1201253909-project] PATH_INFO: `/v3/users/76b2183cd40d4943aa65a1fcc6f557da/credentials/OS-EC2/115ce2299e7643e59609c5311baa06d3` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:20.372121 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3968f7-fb97-4535-a178-190873063d53 tempest-EC2CredentialsTest-1201253909 tempest-EC2CredentialsTest-1201253909-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=76b2183cd40d4943aa65a1fcc6f557da, credential_id=115ce2299e7643e59609c5311baa06d3)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:20.374913 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3968f7-fb97-4535-a178-190873063d53 tempest-EC2CredentialsTest-1201253909 tempest-EC2CredentialsTest-1201253909-project] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:20.401419 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3374/6787] 10.222.0.17 () {58 vars in 1379 bytes} [Sat Jul 23 21:35:20 2022] DELETE /identity/v3/users/76b2183cd40d4943aa65a1fcc6f557da/credentials/OS-EC2/115ce2299e7643e59609c5311baa06d3 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:35:20.407601 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3968f7-fb97-4535-a178-190873063d53 tempest-EC2CredentialsTest-1201253909 tempest-EC2CredentialsTest-1201253909-project] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:20.421549 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3968f7-fb97-4535-a178-190873063d53 tempest-EC2CredentialsTest-1201253909 tempest-EC2CredentialsTest-1201253909-project] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:20.427043 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23375d51-2b41-4628-987c-4d3022db196a tempest-EC2CredentialsTest-1201253909 tempest-EC2CredentialsTest-1201253909-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b2183cd40d4943aa65a1fcc6f557da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3de6c09100b34652a1a1e065c238e4d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:20.428007 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23375d51-2b41-4628-987c-4d3022db196a tempest-EC2CredentialsTest-1201253909 tempest-EC2CredentialsTest-1201253909-project] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:20.428356 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23375d51-2b41-4628-987c-4d3022db196a tempest-EC2CredentialsTest-1201253909 tempest-EC2CredentialsTest-1201253909-project] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:20.428701 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23375d51-2b41-4628-987c-4d3022db196a tempest-EC2CredentialsTest-1201253909 tempest-EC2CredentialsTest-1201253909-project] PATH_INFO: `/v3/users/76b2183cd40d4943aa65a1fcc6f557da/credentials/OS-EC2` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:20.429531 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23375d51-2b41-4628-987c-4d3022db196a tempest-EC2CredentialsTest-1201253909 tempest-EC2CredentialsTest-1201253909-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=76b2183cd40d4943aa65a1fcc6f557da)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:20.431175 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23375d51-2b41-4628-987c-4d3022db196a tempest-EC2CredentialsTest-1201253909 tempest-EC2CredentialsTest-1201253909-project] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:20.441088 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455b8047-15c0-4ff0-869a-518a24701a86 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:20.447371 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da35ad4-5ec3-4184-8108-030f2ac26d94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:20.448621 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da35ad4-5ec3-4184-8108-030f2ac26d94 service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:20.448899 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da35ad4-5ec3-4184-8108-030f2ac26d94 service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:20.449166 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da35ad4-5ec3-4184-8108-030f2ac26d94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:20.457622 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3375/6788] 10.222.0.17 () {60 vars in 1298 bytes} [Sat Jul 23 21:35:20 2022] POST /identity/v3/users/76b2183cd40d4943aa65a1fcc6f557da/credentials/OS-EC2 => generated 367 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:35:20.459004 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23375d51-2b41-4628-987c-4d3022db196a tempest-EC2CredentialsTest-1201253909 tempest-EC2CredentialsTest-1201253909-project] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:20.469962 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da35ad4-5ec3-4184-8108-030f2ac26d94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:20.470927 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23375d51-2b41-4628-987c-4d3022db196a tempest-EC2CredentialsTest-1201253909 tempest-EC2CredentialsTest-1201253909-project] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:20.474574 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da35ad4-5ec3-4184-8108-030f2ac26d94 service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:20.476177 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326488ec-32c3-4a79-ab10-43c18a9ba903 tempest-EC2CredentialsTest-1201253909 tempest-EC2CredentialsTest-1201253909-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b2183cd40d4943aa65a1fcc6f557da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3de6c09100b34652a1a1e065c238e4d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:20.477176 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326488ec-32c3-4a79-ab10-43c18a9ba903 tempest-EC2CredentialsTest-1201253909 tempest-EC2CredentialsTest-1201253909-project] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:20.477563 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326488ec-32c3-4a79-ab10-43c18a9ba903 tempest-EC2CredentialsTest-1201253909 tempest-EC2CredentialsTest-1201253909-project] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:20.478643 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326488ec-32c3-4a79-ab10-43c18a9ba903 tempest-EC2CredentialsTest-1201253909 tempest-EC2CredentialsTest-1201253909-project] PATH_INFO: `/v3/users/76b2183cd40d4943aa65a1fcc6f557da/credentials/OS-EC2/41ee983f1e99400fa95658f2b5081fed` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:20.480831 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326488ec-32c3-4a79-ab10-43c18a9ba903 tempest-EC2CredentialsTest-1201253909 tempest-EC2CredentialsTest-1201253909-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=76b2183cd40d4943aa65a1fcc6f557da, credential_id=41ee983f1e99400fa95658f2b5081fed)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:20.483268 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326488ec-32c3-4a79-ab10-43c18a9ba903 tempest-EC2CredentialsTest-1201253909 tempest-EC2CredentialsTest-1201253909-project] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:20.500938 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3414/6789] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:35:20 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:35:20.523902 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3376/6790] 10.222.0.17 () {58 vars in 1379 bytes} [Sat Jul 23 21:35:20 2022] DELETE /identity/v3/users/76b2183cd40d4943aa65a1fcc6f557da/credentials/OS-EC2/41ee983f1e99400fa95658f2b5081fed => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:35:20.527972 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da35ad4-5ec3-4184-8108-030f2ac26d94 service neutron] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:20.545743 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da35ad4-5ec3-4184-8108-030f2ac26d94 service neutron] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:20.551141 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08db44be-a356-43d4-9085-00124bae57f0 tempest-EC2CredentialsTest-1201253909 tempest-EC2CredentialsTest-1201253909-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b2183cd40d4943aa65a1fcc6f557da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3de6c09100b34652a1a1e065c238e4d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:20.552334 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08db44be-a356-43d4-9085-00124bae57f0 tempest-EC2CredentialsTest-1201253909 tempest-EC2CredentialsTest-1201253909-project] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:20.552765 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08db44be-a356-43d4-9085-00124bae57f0 tempest-EC2CredentialsTest-1201253909 tempest-EC2CredentialsTest-1201253909-project] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:20.553191 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08db44be-a356-43d4-9085-00124bae57f0 tempest-EC2CredentialsTest-1201253909 tempest-EC2CredentialsTest-1201253909-project] PATH_INFO: `/v3/users/76b2183cd40d4943aa65a1fcc6f557da/credentials/OS-EC2/41ee983f1e99400fa95658f2b5081fed` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:20.587748 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-08db44be-a356-43d4-9085-00124bae57f0 tempest-EC2CredentialsTest-1201253909 tempest-EC2CredentialsTest-1201253909-project] Could not find credential: e81bf2486d8e4aca02cce563dabbacbe200b6244688b78cfcfc609fc97487239.: keystone.exception.CredentialNotFound: Could not find credential: e81bf2486d8e4aca02cce563dabbacbe200b6244688b78cfcfc609fc97487239. Jul 23 21:35:20.587748 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 21:35:20.587748 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 21:35:20.587748 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 21:35:20.587748 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 21:35:20.587748 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 21:35:20.587748 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 21:35:20.587748 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 21:35:20.587748 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 21:35:20.587748 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 21:35:20.587748 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 21:35:20.587748 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 21:35:20.587748 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 426, in get Jul 23 21:35:20.587748 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application ENFORCER.enforce_call( Jul 23 21:35:20.589037 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Jul 23 21:35:20.589037 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Jul 23 21:35:20.589037 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 119, in _build_enforcer_target_data_owner_and_user_id_match Jul 23 21:35:20.589037 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application ref['credential'] = PROVIDERS.credential_api.get_credential( Jul 23 21:35:20.589037 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 21:35:20.589037 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 21:35:20.589037 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/core.py", line 119, in get_credential Jul 23 21:35:20.589037 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application credential = self._get_credential(credential_id) Jul 23 21:35:20.589037 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 21:35:20.589037 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 21:35:20.589037 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 21:35:20.589037 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 21:35:20.589037 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 21:35:20.589037 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application with Lock( Jul 23 21:35:20.589037 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 21:35:20.589037 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._enter() Jul 23 21:35:20.590426 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 21:35:20.590426 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 21:35:20.590426 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 21:35:20.590426 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.creator() Jul 23 21:35:20.590426 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 21:35:20.590426 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application created_value = creator( Jul 23 21:35:20.590426 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/core.py", line 124, in _get_credential Jul 23 21:35:20.590426 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.driver.get_credential(credential_id) Jul 23 21:35:20.590426 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/backends/sql.py", line 88, in get_credential Jul 23 21:35:20.590426 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_credential(session, credential_id).to_dict() Jul 23 21:35:20.590426 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/backends/sql.py", line 83, in _get_credential Jul 23 21:35:20.590426 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.CredentialNotFound(credential_id=credential_id) Jul 23 21:35:20.590426 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.CredentialNotFound: Could not find credential: e81bf2486d8e4aca02cce563dabbacbe200b6244688b78cfcfc609fc97487239. Jul 23 21:35:20.590426 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 21:35:20.594096 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3415/6791] 10.222.0.17 () {58 vars in 1376 bytes} [Sat Jul 23 21:35:20 2022] GET /identity/v3/users/76b2183cd40d4943aa65a1fcc6f557da/credentials/OS-EC2/41ee983f1e99400fa95658f2b5081fed => generated 148 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 23 21:35:20.600153 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326488ec-32c3-4a79-ab10-43c18a9ba903 tempest-EC2CredentialsTest-1201253909 tempest-EC2CredentialsTest-1201253909-project] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:20.612914 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326488ec-32c3-4a79-ab10-43c18a9ba903 tempest-EC2CredentialsTest-1201253909 tempest-EC2CredentialsTest-1201253909-project] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:20.617751 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940cbe59-72ef-465f-880c-aa70f7564383 tempest-EC2CredentialsTest-1201253909 tempest-EC2CredentialsTest-1201253909-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b2183cd40d4943aa65a1fcc6f557da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3de6c09100b34652a1a1e065c238e4d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:20.619457 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940cbe59-72ef-465f-880c-aa70f7564383 tempest-EC2CredentialsTest-1201253909 tempest-EC2CredentialsTest-1201253909-project] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:20.619915 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940cbe59-72ef-465f-880c-aa70f7564383 tempest-EC2CredentialsTest-1201253909 tempest-EC2CredentialsTest-1201253909-project] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:20.620352 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940cbe59-72ef-465f-880c-aa70f7564383 tempest-EC2CredentialsTest-1201253909 tempest-EC2CredentialsTest-1201253909-project] PATH_INFO: `/v3/users/76b2183cd40d4943aa65a1fcc6f557da/credentials/OS-EC2` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:20.621194 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940cbe59-72ef-465f-880c-aa70f7564383 tempest-EC2CredentialsTest-1201253909 tempest-EC2CredentialsTest-1201253909-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=76b2183cd40d4943aa65a1fcc6f557da)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:20.623512 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940cbe59-72ef-465f-880c-aa70f7564383 tempest-EC2CredentialsTest-1201253909 tempest-EC2CredentialsTest-1201253909-project] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:20.650336 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3377/6792] 10.222.0.17 () {60 vars in 1298 bytes} [Sat Jul 23 21:35:20 2022] POST /identity/v3/users/76b2183cd40d4943aa65a1fcc6f557da/credentials/OS-EC2 => generated 367 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:35:20.655214 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08db44be-a356-43d4-9085-00124bae57f0 tempest-EC2CredentialsTest-1201253909 tempest-EC2CredentialsTest-1201253909-project] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:20.671480 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08db44be-a356-43d4-9085-00124bae57f0 tempest-EC2CredentialsTest-1201253909 tempest-EC2CredentialsTest-1201253909-project] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:20.681256 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06901b63-91ea-4d30-89d8-067847824d90 tempest-EC2CredentialsTest-1201253909 tempest-EC2CredentialsTest-1201253909-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b2183cd40d4943aa65a1fcc6f557da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3de6c09100b34652a1a1e065c238e4d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:20.683876 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06901b63-91ea-4d30-89d8-067847824d90 tempest-EC2CredentialsTest-1201253909 tempest-EC2CredentialsTest-1201253909-project] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:20.684464 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06901b63-91ea-4d30-89d8-067847824d90 tempest-EC2CredentialsTest-1201253909 tempest-EC2CredentialsTest-1201253909-project] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:20.686044 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06901b63-91ea-4d30-89d8-067847824d90 tempest-EC2CredentialsTest-1201253909 tempest-EC2CredentialsTest-1201253909-project] PATH_INFO: `/v3/users/76b2183cd40d4943aa65a1fcc6f557da/credentials/OS-EC2` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:20.687436 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06901b63-91ea-4d30-89d8-067847824d90 tempest-EC2CredentialsTest-1201253909 tempest-EC2CredentialsTest-1201253909-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=76b2183cd40d4943aa65a1fcc6f557da)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:20.691146 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06901b63-91ea-4d30-89d8-067847824d90 tempest-EC2CredentialsTest-1201253909 tempest-EC2CredentialsTest-1201253909-project] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:20.719143 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3416/6793] 10.222.0.17 () {60 vars in 1298 bytes} [Sat Jul 23 21:35:20 2022] POST /identity/v3/users/76b2183cd40d4943aa65a1fcc6f557da/credentials/OS-EC2 => generated 367 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:35:20.721277 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940cbe59-72ef-465f-880c-aa70f7564383 tempest-EC2CredentialsTest-1201253909 tempest-EC2CredentialsTest-1201253909-project] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:20.738689 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940cbe59-72ef-465f-880c-aa70f7564383 tempest-EC2CredentialsTest-1201253909 tempest-EC2CredentialsTest-1201253909-project] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:20.746316 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b509bbec-e6e1-43eb-a825-c4e817090bab tempest-EC2CredentialsTest-1201253909 tempest-EC2CredentialsTest-1201253909-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b2183cd40d4943aa65a1fcc6f557da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3de6c09100b34652a1a1e065c238e4d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:20.748810 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b509bbec-e6e1-43eb-a825-c4e817090bab tempest-EC2CredentialsTest-1201253909 tempest-EC2CredentialsTest-1201253909-project] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:20.749914 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b509bbec-e6e1-43eb-a825-c4e817090bab tempest-EC2CredentialsTest-1201253909 tempest-EC2CredentialsTest-1201253909-project] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:20.750374 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b509bbec-e6e1-43eb-a825-c4e817090bab tempest-EC2CredentialsTest-1201253909 tempest-EC2CredentialsTest-1201253909-project] PATH_INFO: `/v3/users/76b2183cd40d4943aa65a1fcc6f557da/credentials/OS-EC2` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:20.751912 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b509bbec-e6e1-43eb-a825-c4e817090bab tempest-EC2CredentialsTest-1201253909 tempest-EC2CredentialsTest-1201253909-project] RBAC: Authorizing `identity:ec2_list_credentials(user_id=76b2183cd40d4943aa65a1fcc6f557da)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:20.754975 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b509bbec-e6e1-43eb-a825-c4e817090bab tempest-EC2CredentialsTest-1201253909 tempest-EC2CredentialsTest-1201253909-project] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:20.785511 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3378/6794] 10.222.0.17 () {58 vars in 1277 bytes} [Sat Jul 23 21:35:20 2022] GET /identity/v3/users/76b2183cd40d4943aa65a1fcc6f557da/credentials/OS-EC2 => generated 865 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:35:20.787882 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06901b63-91ea-4d30-89d8-067847824d90 tempest-EC2CredentialsTest-1201253909 tempest-EC2CredentialsTest-1201253909-project] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:20.815996 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06901b63-91ea-4d30-89d8-067847824d90 tempest-EC2CredentialsTest-1201253909 tempest-EC2CredentialsTest-1201253909-project] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:20.824373 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff14889f-26a5-4e0c-8c1c-ebb8ad6e46fc tempest-EC2CredentialsTest-1201253909 tempest-EC2CredentialsTest-1201253909-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b2183cd40d4943aa65a1fcc6f557da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3de6c09100b34652a1a1e065c238e4d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:20.826062 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff14889f-26a5-4e0c-8c1c-ebb8ad6e46fc tempest-EC2CredentialsTest-1201253909 tempest-EC2CredentialsTest-1201253909-project] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:20.826327 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff14889f-26a5-4e0c-8c1c-ebb8ad6e46fc tempest-EC2CredentialsTest-1201253909 tempest-EC2CredentialsTest-1201253909-project] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:20.826672 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff14889f-26a5-4e0c-8c1c-ebb8ad6e46fc tempest-EC2CredentialsTest-1201253909 tempest-EC2CredentialsTest-1201253909-project] PATH_INFO: `/v3/users/76b2183cd40d4943aa65a1fcc6f557da/credentials/OS-EC2/24eda4d03b6343f2af11377d99565833` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:20.834932 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff14889f-26a5-4e0c-8c1c-ebb8ad6e46fc tempest-EC2CredentialsTest-1201253909 tempest-EC2CredentialsTest-1201253909-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=76b2183cd40d4943aa65a1fcc6f557da, credential_id=24eda4d03b6343f2af11377d99565833)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:20.840682 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff14889f-26a5-4e0c-8c1c-ebb8ad6e46fc tempest-EC2CredentialsTest-1201253909 tempest-EC2CredentialsTest-1201253909-project] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:20.861780 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3417/6795] 10.222.0.17 () {58 vars in 1379 bytes} [Sat Jul 23 21:35:20 2022] DELETE /identity/v3/users/76b2183cd40d4943aa65a1fcc6f557da/credentials/OS-EC2/24eda4d03b6343f2af11377d99565833 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:35:20.867290 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b509bbec-e6e1-43eb-a825-c4e817090bab tempest-EC2CredentialsTest-1201253909 tempest-EC2CredentialsTest-1201253909-project] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:20.880988 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b509bbec-e6e1-43eb-a825-c4e817090bab tempest-EC2CredentialsTest-1201253909 tempest-EC2CredentialsTest-1201253909-project] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:20.910391 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9566d5d-0ce5-4572-9c33-1f6ae30d7c6e tempest-EC2CredentialsTest-1201253909 tempest-EC2CredentialsTest-1201253909-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b2183cd40d4943aa65a1fcc6f557da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3de6c09100b34652a1a1e065c238e4d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:20.911315 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9566d5d-0ce5-4572-9c33-1f6ae30d7c6e tempest-EC2CredentialsTest-1201253909 tempest-EC2CredentialsTest-1201253909-project] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:20.911591 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9566d5d-0ce5-4572-9c33-1f6ae30d7c6e tempest-EC2CredentialsTest-1201253909 tempest-EC2CredentialsTest-1201253909-project] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:20.911872 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9566d5d-0ce5-4572-9c33-1f6ae30d7c6e tempest-EC2CredentialsTest-1201253909 tempest-EC2CredentialsTest-1201253909-project] PATH_INFO: `/v3/users/76b2183cd40d4943aa65a1fcc6f557da/credentials/OS-EC2/04387b8d4aa94f2a82f652be796ae9c8` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:20.919166 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9566d5d-0ce5-4572-9c33-1f6ae30d7c6e tempest-EC2CredentialsTest-1201253909 tempest-EC2CredentialsTest-1201253909-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=76b2183cd40d4943aa65a1fcc6f557da, credential_id=04387b8d4aa94f2a82f652be796ae9c8)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:20.920848 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9566d5d-0ce5-4572-9c33-1f6ae30d7c6e tempest-EC2CredentialsTest-1201253909 tempest-EC2CredentialsTest-1201253909-project] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:20.959259 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3379/6796] 10.222.0.17 () {58 vars in 1379 bytes} [Sat Jul 23 21:35:20 2022] DELETE /identity/v3/users/76b2183cd40d4943aa65a1fcc6f557da/credentials/OS-EC2/04387b8d4aa94f2a82f652be796ae9c8 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:35:20.961642 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff14889f-26a5-4e0c-8c1c-ebb8ad6e46fc tempest-EC2CredentialsTest-1201253909 tempest-EC2CredentialsTest-1201253909-project] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:20.980442 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff14889f-26a5-4e0c-8c1c-ebb8ad6e46fc tempest-EC2CredentialsTest-1201253909 tempest-EC2CredentialsTest-1201253909-project] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:20.986848 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bd255e-2f0f-48d9-9be8-e48428a270e0 tempest-EC2CredentialsTest-1201253909 tempest-EC2CredentialsTest-1201253909-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b2183cd40d4943aa65a1fcc6f557da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3de6c09100b34652a1a1e065c238e4d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:20.988125 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bd255e-2f0f-48d9-9be8-e48428a270e0 tempest-EC2CredentialsTest-1201253909 tempest-EC2CredentialsTest-1201253909-project] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:20.988650 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bd255e-2f0f-48d9-9be8-e48428a270e0 tempest-EC2CredentialsTest-1201253909 tempest-EC2CredentialsTest-1201253909-project] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:20.989280 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bd255e-2f0f-48d9-9be8-e48428a270e0 tempest-EC2CredentialsTest-1201253909 tempest-EC2CredentialsTest-1201253909-project] PATH_INFO: `/v3/users/76b2183cd40d4943aa65a1fcc6f557da/credentials/OS-EC2` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:20.990197 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bd255e-2f0f-48d9-9be8-e48428a270e0 tempest-EC2CredentialsTest-1201253909 tempest-EC2CredentialsTest-1201253909-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=76b2183cd40d4943aa65a1fcc6f557da)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:20.991989 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bd255e-2f0f-48d9-9be8-e48428a270e0 tempest-EC2CredentialsTest-1201253909 tempest-EC2CredentialsTest-1201253909-project] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:21.035484 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9566d5d-0ce5-4572-9c33-1f6ae30d7c6e tempest-EC2CredentialsTest-1201253909 tempest-EC2CredentialsTest-1201253909-project] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:21.041799 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3418/6797] 10.222.0.17 () {60 vars in 1298 bytes} [Sat Jul 23 21:35:20 2022] POST /identity/v3/users/76b2183cd40d4943aa65a1fcc6f557da/credentials/OS-EC2 => generated 367 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:35:21.048342 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9566d5d-0ce5-4572-9c33-1f6ae30d7c6e tempest-EC2CredentialsTest-1201253909 tempest-EC2CredentialsTest-1201253909-project] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:21.053354 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c631e42-f4a9-4563-bae0-fea3e5dc0744 tempest-EC2CredentialsTest-1201253909 tempest-EC2CredentialsTest-1201253909-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b2183cd40d4943aa65a1fcc6f557da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3de6c09100b34652a1a1e065c238e4d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:21.055136 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c631e42-f4a9-4563-bae0-fea3e5dc0744 tempest-EC2CredentialsTest-1201253909 tempest-EC2CredentialsTest-1201253909-project] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:21.055615 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c631e42-f4a9-4563-bae0-fea3e5dc0744 tempest-EC2CredentialsTest-1201253909 tempest-EC2CredentialsTest-1201253909-project] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:21.056054 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c631e42-f4a9-4563-bae0-fea3e5dc0744 tempest-EC2CredentialsTest-1201253909 tempest-EC2CredentialsTest-1201253909-project] PATH_INFO: `/v3/users/76b2183cd40d4943aa65a1fcc6f557da/credentials/OS-EC2/f787fe36840145559be18a8ba3d43294` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:21.058714 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c631e42-f4a9-4563-bae0-fea3e5dc0744 tempest-EC2CredentialsTest-1201253909 tempest-EC2CredentialsTest-1201253909-project] RBAC: Authorizing `identity:ec2_get_credential(user_id=76b2183cd40d4943aa65a1fcc6f557da, credential_id=f787fe36840145559be18a8ba3d43294)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:21.060467 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c631e42-f4a9-4563-bae0-fea3e5dc0744 tempest-EC2CredentialsTest-1201253909 tempest-EC2CredentialsTest-1201253909-project] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:21.064013 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3380/6798] 10.222.0.17 () {58 vars in 1376 bytes} [Sat Jul 23 21:35:21 2022] GET /identity/v3/users/76b2183cd40d4943aa65a1fcc6f557da/credentials/OS-EC2/f787fe36840145559be18a8ba3d43294 => generated 367 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 21:35:21.071018 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bd255e-2f0f-48d9-9be8-e48428a270e0 tempest-EC2CredentialsTest-1201253909 tempest-EC2CredentialsTest-1201253909-project] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:21.089101 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bd255e-2f0f-48d9-9be8-e48428a270e0 tempest-EC2CredentialsTest-1201253909 tempest-EC2CredentialsTest-1201253909-project] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:21.129647 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a76ab9-260a-4a29-ac2b-3452f97f006f tempest-EC2CredentialsTest-1201253909 tempest-EC2CredentialsTest-1201253909-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b2183cd40d4943aa65a1fcc6f557da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3de6c09100b34652a1a1e065c238e4d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:21.130610 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a76ab9-260a-4a29-ac2b-3452f97f006f tempest-EC2CredentialsTest-1201253909 tempest-EC2CredentialsTest-1201253909-project] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:21.130897 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a76ab9-260a-4a29-ac2b-3452f97f006f tempest-EC2CredentialsTest-1201253909 tempest-EC2CredentialsTest-1201253909-project] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:21.131179 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a76ab9-260a-4a29-ac2b-3452f97f006f tempest-EC2CredentialsTest-1201253909 tempest-EC2CredentialsTest-1201253909-project] PATH_INFO: `/v3/users/76b2183cd40d4943aa65a1fcc6f557da/credentials/OS-EC2/f787fe36840145559be18a8ba3d43294` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:21.133358 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a76ab9-260a-4a29-ac2b-3452f97f006f tempest-EC2CredentialsTest-1201253909 tempest-EC2CredentialsTest-1201253909-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=76b2183cd40d4943aa65a1fcc6f557da, credential_id=f787fe36840145559be18a8ba3d43294)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:21.134820 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a76ab9-260a-4a29-ac2b-3452f97f006f tempest-EC2CredentialsTest-1201253909 tempest-EC2CredentialsTest-1201253909-project] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:21.157901 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3419/6799] 10.222.0.17 () {58 vars in 1379 bytes} [Sat Jul 23 21:35:21 2022] DELETE /identity/v3/users/76b2183cd40d4943aa65a1fcc6f557da/credentials/OS-EC2/f787fe36840145559be18a8ba3d43294 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:35:21.162694 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c631e42-f4a9-4563-bae0-fea3e5dc0744 tempest-EC2CredentialsTest-1201253909 tempest-EC2CredentialsTest-1201253909-project] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:21.305911 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c631e42-f4a9-4563-bae0-fea3e5dc0744 tempest-EC2CredentialsTest-1201253909 tempest-EC2CredentialsTest-1201253909-project] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:21.314114 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1989120c-e882-4b7e-a5ba-b2cbe9cbd0d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:21.315151 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1989120c-e882-4b7e-a5ba-b2cbe9cbd0d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:21.315671 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1989120c-e882-4b7e-a5ba-b2cbe9cbd0d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:21.315962 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1989120c-e882-4b7e-a5ba-b2cbe9cbd0d2 admin admin] PATH_INFO: `/v3/users/76b2183cd40d4943aa65a1fcc6f557da` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:21.318530 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1989120c-e882-4b7e-a5ba-b2cbe9cbd0d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=76b2183cd40d4943aa65a1fcc6f557da)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:21.319856 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1989120c-e882-4b7e-a5ba-b2cbe9cbd0d2 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:21.360214 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:35:21.420657 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-1989120c-e882-4b7e-a5ba-b2cbe9cbd0d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76b2183cd40d4943aa65a1fcc6f557da'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:21.457186 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-1989120c-e882-4b7e-a5ba-b2cbe9cbd0d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76b2183cd40d4943aa65a1fcc6f557da'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:21.458273 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-1989120c-e882-4b7e-a5ba-b2cbe9cbd0d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76b2183cd40d4943aa65a1fcc6f557da'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:21.474926 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-1989120c-e882-4b7e-a5ba-b2cbe9cbd0d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76b2183cd40d4943aa65a1fcc6f557da'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:21.497154 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-1989120c-e882-4b7e-a5ba-b2cbe9cbd0d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76b2183cd40d4943aa65a1fcc6f557da'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:21.508602 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3381/6800] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:35:21 2022] DELETE /identity/v3/users/76b2183cd40d4943aa65a1fcc6f557da => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:35:21.515911 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8666c3e2-fab3-4879-8483-1e5fdb92be3d None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:21.516489 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8666c3e2-fab3-4879-8483-1e5fdb92be3d None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:21.516990 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8666c3e2-fab3-4879-8483-1e5fdb92be3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:21.545165 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-8666c3e2-fab3-4879-8483-1e5fdb92be3d None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:35:21.547630 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-8666c3e2-fab3-4879-8483-1e5fdb92be3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:21.637794 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:35:21.668411 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3420/6801] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:35:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:35:21.680504 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1989120c-e882-4b7e-a5ba-b2cbe9cbd0d2 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:21.683468 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-1989120c-e882-4b7e-a5ba-b2cbe9cbd0d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:21.781198 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1989120c-e882-4b7e-a5ba-b2cbe9cbd0d2 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:21.797349 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4c1598-c3a6-4be0-8b47-014b18f4d8ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:21.798226 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4c1598-c3a6-4be0-8b47-014b18f4d8ef service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:21.799626 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4c1598-c3a6-4be0-8b47-014b18f4d8ef service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:21.799626 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4c1598-c3a6-4be0-8b47-014b18f4d8ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:21.837394 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4c1598-c3a6-4be0-8b47-014b18f4d8ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:21.839010 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4c1598-c3a6-4be0-8b47-014b18f4d8ef service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:21.854022 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3382/6802] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:35:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:35:23.122128 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8666c3e2-fab3-4879-8483-1e5fdb92be3d None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:23.123632 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-8666c3e2-fab3-4879-8483-1e5fdb92be3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:23.146946 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8666c3e2-fab3-4879-8483-1e5fdb92be3d None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:23.164692 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b17adb6-825f-4a2d-a52c-2065cdaec9d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:23.169643 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b17adb6-825f-4a2d-a52c-2065cdaec9d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:23.171640 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b17adb6-825f-4a2d-a52c-2065cdaec9d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:23.171949 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b17adb6-825f-4a2d-a52c-2065cdaec9d8 admin admin] PATH_INFO: `/v3/projects/3de6c09100b34652a1a1e065c238e4d3` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:23.175535 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b17adb6-825f-4a2d-a52c-2065cdaec9d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3de6c09100b34652a1a1e065c238e4d3)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:23.177048 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b17adb6-825f-4a2d-a52c-2065cdaec9d8 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:23.335842 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-6b17adb6-825f-4a2d-a52c-2065cdaec9d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3de6c09100b34652a1a1e065c238e4d3', 'request_id': 'req-6b17adb6-825f-4a2d-a52c-2065cdaec9d8'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:23.356811 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-6b17adb6-825f-4a2d-a52c-2065cdaec9d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3de6c09100b34652a1a1e065c238e4d3', 'request_id': 'req-6b17adb6-825f-4a2d-a52c-2065cdaec9d8'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:23.370352 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-6b17adb6-825f-4a2d-a52c-2065cdaec9d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3de6c09100b34652a1a1e065c238e4d3', 'request_id': 'req-6b17adb6-825f-4a2d-a52c-2065cdaec9d8'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:23.386635 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-6b17adb6-825f-4a2d-a52c-2065cdaec9d8 admin admin] The token cache is being invalidate because project 3de6c09100b34652a1a1e065c238e4d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:35:23.387194 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-6b17adb6-825f-4a2d-a52c-2065cdaec9d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:23.387996 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-6b17adb6-825f-4a2d-a52c-2065cdaec9d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:23.393978 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3421/6803] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:35:23 2022] DELETE /identity/v3/projects/3de6c09100b34652a1a1e065c238e4d3 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:35:23.395766 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606b8e71-0301-48e4-b441-70fea80ca5de None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:23.396711 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606b8e71-0301-48e4-b441-70fea80ca5de None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:23.397013 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606b8e71-0301-48e4-b441-70fea80ca5de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:23.431753 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-606b8e71-0301-48e4-b441-70fea80ca5de None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:35:23.431753 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-606b8e71-0301-48e4-b441-70fea80ca5de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:23.601400 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3383/6804] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:35:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:35:23.610113 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d52712-e080-4dcd-88d9-564ebe7fb994 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:23.610895 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d52712-e080-4dcd-88d9-564ebe7fb994 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:23.611547 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d52712-e080-4dcd-88d9-564ebe7fb994 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:23.652560 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-22d52712-e080-4dcd-88d9-564ebe7fb994 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:35:23.654447 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-22d52712-e080-4dcd-88d9-564ebe7fb994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:23.682242 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3422/6805] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:35:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:35:23.686773 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606b8e71-0301-48e4-b441-70fea80ca5de None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:23.705814 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606b8e71-0301-48e4-b441-70fea80ca5de None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:23.716655 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da249efd-0c15-4181-b97c-2af13e81e7e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:23.717743 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da249efd-0c15-4181-b97c-2af13e81e7e4 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:23.718375 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da249efd-0c15-4181-b97c-2af13e81e7e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:23.719793 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da249efd-0c15-4181-b97c-2af13e81e7e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:23.720858 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da249efd-0c15-4181-b97c-2af13e81e7e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:35:23.721389 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da249efd-0c15-4181-b97c-2af13e81e7e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:23.724387 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da249efd-0c15-4181-b97c-2af13e81e7e4 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:23.755360 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d52712-e080-4dcd-88d9-564ebe7fb994 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:23.766252 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3384/6806] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:35:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:35:23.767445 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d52712-e080-4dcd-88d9-564ebe7fb994 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:23.776583 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a77573-03a5-4b8d-9ecb-f3e6387531cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:23.777428 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a77573-03a5-4b8d-9ecb-f3e6387531cf admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:23.780119 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a77573-03a5-4b8d-9ecb-f3e6387531cf admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:23.780622 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a77573-03a5-4b8d-9ecb-f3e6387531cf admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:23.782281 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a77573-03a5-4b8d-9ecb-f3e6387531cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:23.785709 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a77573-03a5-4b8d-9ecb-f3e6387531cf admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:23.860426 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3423/6807] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:35:23 2022] POST /identity/v3/projects => generated 359 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:35:23.862105 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da249efd-0c15-4181-b97c-2af13e81e7e4 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:23.878545 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da249efd-0c15-4181-b97c-2af13e81e7e4 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:23.940931 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:35:23.985910 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b0c07b-9913-4222-9afb-fb530225c3f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:23.987150 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b0c07b-9913-4222-9afb-fb530225c3f2 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:23.987900 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b0c07b-9913-4222-9afb-fb530225c3f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:23.988348 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b0c07b-9913-4222-9afb-fb530225c3f2 admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:23.989448 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b0c07b-9913-4222-9afb-fb530225c3f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:23.992581 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b0c07b-9913-4222-9afb-fb530225c3f2 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:24.025785 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3385/6808] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:35:23 2022] POST /identity/v3/users => generated 280 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:35:24.029205 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a77573-03a5-4b8d-9ecb-f3e6387531cf admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:24.041040 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a77573-03a5-4b8d-9ecb-f3e6387531cf admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:24.046465 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cf0d25-7718-497b-85c8-fa89681315e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:24.047280 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cf0d25-7718-497b-85c8-fa89681315e0 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:24.047666 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cf0d25-7718-497b-85c8-fa89681315e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:24.048049 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cf0d25-7718-497b-85c8-fa89681315e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:24.048899 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cf0d25-7718-497b-85c8-fa89681315e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:24.050903 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cf0d25-7718-497b-85c8-fa89681315e0 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:24.063419 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3424/6809] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:35:24 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 21:35:24.067478 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b0c07b-9913-4222-9afb-fb530225c3f2 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:24.084853 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b0c07b-9913-4222-9afb-fb530225c3f2 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:24.107766 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ed34b5-a795-4dfc-9883-7f057361ff6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:24.109398 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ed34b5-a795-4dfc-9883-7f057361ff6e admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:24.114026 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ed34b5-a795-4dfc-9883-7f057361ff6e admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:24.114328 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ed34b5-a795-4dfc-9883-7f057361ff6e admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:24.115166 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ed34b5-a795-4dfc-9883-7f057361ff6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:24.116888 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ed34b5-a795-4dfc-9883-7f057361ff6e admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:24.154049 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cf0d25-7718-497b-85c8-fa89681315e0 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:24.162103 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3386/6810] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:35:24 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:35:24.184532 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cf0d25-7718-497b-85c8-fa89681315e0 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:24.192773 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8233b8-faf5-477f-ad4a-90e78923dc11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:24.193834 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8233b8-faf5-477f-ad4a-90e78923dc11 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:24.194473 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8233b8-faf5-477f-ad4a-90e78923dc11 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:24.194975 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8233b8-faf5-477f-ad4a-90e78923dc11 admin admin] PATH_INFO: `/v3/projects/a6b5885c331747128e055c5c76be32d4/users/2653fa9d445046118c0658e92213b0dc/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:24.230485 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8233b8-faf5-477f-ad4a-90e78923dc11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6b5885c331747128e055c5c76be32d4, user_id=2653fa9d445046118c0658e92213b0dc, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:24.234316 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8233b8-faf5-477f-ad4a-90e78923dc11 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:24.267975 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3425/6811] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:35:24 2022] PUT /identity/v3/projects/a6b5885c331747128e055c5c76be32d4/users/2653fa9d445046118c0658e92213b0dc/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:35:24.280361 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ee8d66-32a3-4ad4-8592-9656cc5d397d None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:24.280361 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ee8d66-32a3-4ad4-8592-9656cc5d397d None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:24.280725 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ee8d66-32a3-4ad4-8592-9656cc5d397d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:24.351308 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-40ee8d66-32a3-4ad4-8592-9656cc5d397d None None] MFA Rules not processed for user `2653fa9d445046118c0658e92213b0dc`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:35:24.352623 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-40ee8d66-32a3-4ad4-8592-9656cc5d397d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:24.507449 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3387/6812] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:35:24 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:35:24.509095 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b343e9b2-e1d0-4d1e-a447-a1ee9cdc91db None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:24.509390 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b343e9b2-e1d0-4d1e-a447-a1ee9cdc91db None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:24.509674 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b343e9b2-e1d0-4d1e-a447-a1ee9cdc91db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:24.558149 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-b343e9b2-e1d0-4d1e-a447-a1ee9cdc91db None None] MFA Rules not processed for user `2653fa9d445046118c0658e92213b0dc`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:35:24.565270 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-b343e9b2-e1d0-4d1e-a447-a1ee9cdc91db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:24.578578 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3426/6813] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:35:24 2022] POST /identity/v3/auth/tokens => generated 345 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 23 21:35:24.583834 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3daa97a-7ef2-4265-ba40-45979daadf8e None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:24.584279 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3daa97a-7ef2-4265-ba40-45979daadf8e None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:24.584648 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3daa97a-7ef2-4265-ba40-45979daadf8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:24.619310 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-d3daa97a-7ef2-4265-ba40-45979daadf8e None None] MFA Rules not processed for user `2653fa9d445046118c0658e92213b0dc`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:35:24.623216 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-d3daa97a-7ef2-4265-ba40-45979daadf8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:24.637061 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3388/6814] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:35:24 2022] POST /identity/v3/auth/tokens => generated 345 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 23 21:35:24.638183 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b343e9b2-e1d0-4d1e-a447-a1ee9cdc91db None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:24.678289 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b343e9b2-e1d0-4d1e-a447-a1ee9cdc91db None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:24.691670 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1521d5d-0639-4bee-a876-0e146e16f95d tempest-TokensV3Test-941928672 tempest-TokensV3Test-941928672-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2653fa9d445046118c0658e92213b0dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6b5885c331747128e055c5c76be32d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:24.693062 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1521d5d-0639-4bee-a876-0e146e16f95d tempest-TokensV3Test-941928672 tempest-TokensV3Test-941928672-project] REQUEST_METHOD: `HEAD` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:24.693582 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1521d5d-0639-4bee-a876-0e146e16f95d tempest-TokensV3Test-941928672 tempest-TokensV3Test-941928672-project] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:24.694250 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1521d5d-0639-4bee-a876-0e146e16f95d tempest-TokensV3Test-941928672 tempest-TokensV3Test-941928672-project] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:24.715170 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1521d5d-0639-4bee-a876-0e146e16f95d tempest-TokensV3Test-941928672 tempest-TokensV3Test-941928672-project] RBAC: Authorizing `identity:check_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:24.718388 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1521d5d-0639-4bee-a876-0e146e16f95d tempest-TokensV3Test-941928672 tempest-TokensV3Test-941928672-project] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:24.733699 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3daa97a-7ef2-4265-ba40-45979daadf8e None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:24.734393 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3427/6815] 10.222.0.17 () {56 vars in 1263 bytes} [Sat Jul 23 21:35:24 2022] HEAD /identity/v3/auth/tokens => generated 0 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 358 bytes (0 switches on core 0) Jul 23 21:35:24.746453 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3daa97a-7ef2-4265-ba40-45979daadf8e None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:24.763110 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0108abf1-6752-44c8-bbfb-bd3f94dc9ba7 tempest-TokensV3Test-941928672 tempest-TokensV3Test-941928672-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2653fa9d445046118c0658e92213b0dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6b5885c331747128e055c5c76be32d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:24.763943 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0108abf1-6752-44c8-bbfb-bd3f94dc9ba7 tempest-TokensV3Test-941928672 tempest-TokensV3Test-941928672-project] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:24.764237 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0108abf1-6752-44c8-bbfb-bd3f94dc9ba7 tempest-TokensV3Test-941928672 tempest-TokensV3Test-941928672-project] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:24.765385 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0108abf1-6752-44c8-bbfb-bd3f94dc9ba7 tempest-TokensV3Test-941928672 tempest-TokensV3Test-941928672-project] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:24.774483 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0108abf1-6752-44c8-bbfb-bd3f94dc9ba7 tempest-TokensV3Test-941928672 tempest-TokensV3Test-941928672-project] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:24.776280 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0108abf1-6752-44c8-bbfb-bd3f94dc9ba7 tempest-TokensV3Test-941928672 tempest-TokensV3Test-941928672-project] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:24.785909 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3389/6816] 10.222.0.17 () {56 vars in 1262 bytes} [Sat Jul 23 21:35:24 2022] GET /identity/v3/auth/tokens => generated 345 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 23 21:35:24.789808 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1521d5d-0639-4bee-a876-0e146e16f95d tempest-TokensV3Test-941928672 tempest-TokensV3Test-941928672-project] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:24.805748 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1521d5d-0639-4bee-a876-0e146e16f95d tempest-TokensV3Test-941928672 tempest-TokensV3Test-941928672-project] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:24.811559 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7a15fa-85ea-4a75-8adc-371b77b1e9da tempest-TokensV3Test-941928672 tempest-TokensV3Test-941928672-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2653fa9d445046118c0658e92213b0dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6b5885c331747128e055c5c76be32d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:24.812441 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7a15fa-85ea-4a75-8adc-371b77b1e9da tempest-TokensV3Test-941928672 tempest-TokensV3Test-941928672-project] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:24.813020 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7a15fa-85ea-4a75-8adc-371b77b1e9da tempest-TokensV3Test-941928672 tempest-TokensV3Test-941928672-project] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:24.813701 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7a15fa-85ea-4a75-8adc-371b77b1e9da tempest-TokensV3Test-941928672 tempest-TokensV3Test-941928672-project] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:24.822732 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7a15fa-85ea-4a75-8adc-371b77b1e9da tempest-TokensV3Test-941928672 tempest-TokensV3Test-941928672-project] RBAC: Authorizing `identity:revoke_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:24.824933 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7a15fa-85ea-4a75-8adc-371b77b1e9da tempest-TokensV3Test-941928672 tempest-TokensV3Test-941928672-project] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:24.849587 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3428/6817] 10.222.0.17 () {56 vars in 1265 bytes} [Sat Jul 23 21:35:24 2022] DELETE /identity/v3/auth/tokens => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:35:24.854387 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0108abf1-6752-44c8-bbfb-bd3f94dc9ba7 tempest-TokensV3Test-941928672 tempest-TokensV3Test-941928672-project] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:24.872201 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0108abf1-6752-44c8-bbfb-bd3f94dc9ba7 tempest-TokensV3Test-941928672 tempest-TokensV3Test-941928672-project] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:24.886017 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e033b65-2ed1-4ea4-9194-5b539839acce tempest-TokensV3Test-941928672 tempest-TokensV3Test-941928672-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2653fa9d445046118c0658e92213b0dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6b5885c331747128e055c5c76be32d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:24.886883 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e033b65-2ed1-4ea4-9194-5b539839acce tempest-TokensV3Test-941928672 tempest-TokensV3Test-941928672-project] REQUEST_METHOD: `HEAD` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:24.887268 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e033b65-2ed1-4ea4-9194-5b539839acce tempest-TokensV3Test-941928672 tempest-TokensV3Test-941928672-project] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:24.887646 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e033b65-2ed1-4ea4-9194-5b539839acce tempest-TokensV3Test-941928672 tempest-TokensV3Test-941928672-project] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:24.896611 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-9e033b65-2ed1-4ea4-9194-5b539839acce tempest-TokensV3Test-941928672 tempest-TokensV3Test-941928672-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:24.920380 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-9e033b65-2ed1-4ea4-9194-5b539839acce tempest-TokensV3Test-941928672 tempest-TokensV3Test-941928672-project] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Jul 23 21:35:24.920380 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 21:35:24.920380 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 21:35:24.920380 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 21:35:24.920380 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 21:35:24.920380 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 21:35:24.920380 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 21:35:24.920380 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 21:35:24.920380 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 21:35:24.920380 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 21:35:24.920380 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 21:35:24.920380 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 21:35:24.920380 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 283, in get Jul 23 21:35:24.920380 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:check_token') Jul 23 21:35:24.920380 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 422, in enforce_call Jul 23 21:35:24.921757 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application subj_token_target_data = cls._extract_subject_token_target_data() Jul 23 21:35:24.921757 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 261, in _extract_subject_token_target_data Jul 23 21:35:24.921757 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application token = PROVIDER_APIS.token_provider_api.validate_token( Jul 23 21:35:24.921757 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 21:35:24.921757 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 21:35:24.921757 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 146, in validate_token Jul 23 21:35:24.921757 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application self._is_valid_token(token, window_seconds=window_seconds) Jul 23 21:35:24.921757 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 199, in _is_valid_token Jul 23 21:35:24.921757 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application self.check_revocation(token) Jul 23 21:35:24.921757 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 21:35:24.921757 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 21:35:24.921757 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 137, in check_revocation Jul 23 21:35:24.921757 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.check_revocation_v3(token) Jul 23 21:35:24.921757 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 21:35:24.921757 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 21:35:24.921757 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 134, in check_revocation_v3 Jul 23 21:35:24.921757 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application PROVIDERS.revoke_api.check_token(token_values) Jul 23 21:35:24.923280 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 21:35:24.923280 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 21:35:24.923280 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/revoke/core.py", line 137, in check_token Jul 23 21:35:24.923280 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.TokenNotFound(_('Failed to validate token')) Jul 23 21:35:24.923280 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.TokenNotFound: Failed to validate token Jul 23 21:35:24.923280 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 21:35:24.933026 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3390/6818] 10.222.0.17 () {56 vars in 1263 bytes} [Sat Jul 23 21:35:24 2022] HEAD /identity/v3/auth/tokens => generated 0 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (0 switches on core 0) Jul 23 21:35:24.936497 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fc94b2-1e63-4eb5-97ce-517bf8a2fd1e None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:24.936968 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fc94b2-1e63-4eb5-97ce-517bf8a2fd1e None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:24.937471 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fc94b2-1e63-4eb5-97ce-517bf8a2fd1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:24.974254 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-72fc94b2-1e63-4eb5-97ce-517bf8a2fd1e None None] MFA Rules not processed for user `2653fa9d445046118c0658e92213b0dc`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:35:24.976440 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-72fc94b2-1e63-4eb5-97ce-517bf8a2fd1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:24.987404 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3429/6819] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:35:24 2022] POST /identity/v3/auth/tokens => generated 345 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 23 21:35:24.990003 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e033b65-2ed1-4ea4-9194-5b539839acce tempest-TokensV3Test-941928672 tempest-TokensV3Test-941928672-project] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:25.012183 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e033b65-2ed1-4ea4-9194-5b539839acce tempest-TokensV3Test-941928672 tempest-TokensV3Test-941928672-project] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:25.017305 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f2451d-e71d-4cf9-b094-ebb4b2e68325 tempest-TokensV3Test-941928672 tempest-TokensV3Test-941928672-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2653fa9d445046118c0658e92213b0dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6b5885c331747128e055c5c76be32d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:25.018020 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f2451d-e71d-4cf9-b094-ebb4b2e68325 tempest-TokensV3Test-941928672 tempest-TokensV3Test-941928672-project] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:25.018337 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f2451d-e71d-4cf9-b094-ebb4b2e68325 tempest-TokensV3Test-941928672 tempest-TokensV3Test-941928672-project] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:25.018646 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f2451d-e71d-4cf9-b094-ebb4b2e68325 tempest-TokensV3Test-941928672 tempest-TokensV3Test-941928672-project] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:25.036305 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f2451d-e71d-4cf9-b094-ebb4b2e68325 tempest-TokensV3Test-941928672 tempest-TokensV3Test-941928672-project] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:25.038371 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f2451d-e71d-4cf9-b094-ebb4b2e68325 tempest-TokensV3Test-941928672 tempest-TokensV3Test-941928672-project] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:25.055178 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3391/6820] 10.222.0.17 () {56 vars in 1262 bytes} [Sat Jul 23 21:35:24 2022] GET /identity/v3/auth/tokens => generated 345 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 23 21:35:25.055517 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fc94b2-1e63-4eb5-97ce-517bf8a2fd1e None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:25.089061 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fc94b2-1e63-4eb5-97ce-517bf8a2fd1e None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:25.100910 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef12def7-84f7-4f7d-b14c-6c69f818f969 tempest-TokensV3Test-941928672 tempest-TokensV3Test-941928672-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2653fa9d445046118c0658e92213b0dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6b5885c331747128e055c5c76be32d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:25.101656 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef12def7-84f7-4f7d-b14c-6c69f818f969 tempest-TokensV3Test-941928672 tempest-TokensV3Test-941928672-project] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:25.102026 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef12def7-84f7-4f7d-b14c-6c69f818f969 tempest-TokensV3Test-941928672 tempest-TokensV3Test-941928672-project] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:25.102372 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef12def7-84f7-4f7d-b14c-6c69f818f969 tempest-TokensV3Test-941928672 tempest-TokensV3Test-941928672-project] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:25.124994 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef12def7-84f7-4f7d-b14c-6c69f818f969 tempest-TokensV3Test-941928672 tempest-TokensV3Test-941928672-project] RBAC: Authorizing `identity:revoke_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:25.126018 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef12def7-84f7-4f7d-b14c-6c69f818f969 tempest-TokensV3Test-941928672 tempest-TokensV3Test-941928672-project] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:25.164357 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3430/6821] 10.222.0.17 () {56 vars in 1265 bytes} [Sat Jul 23 21:35:25 2022] DELETE /identity/v3/auth/tokens => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:35:25.169297 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f2451d-e71d-4cf9-b094-ebb4b2e68325 tempest-TokensV3Test-941928672 tempest-TokensV3Test-941928672-project] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:25.185448 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f2451d-e71d-4cf9-b094-ebb4b2e68325 tempest-TokensV3Test-941928672 tempest-TokensV3Test-941928672-project] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:25.206978 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691a7dfe-34e3-4b6c-b9af-b5966a736809 tempest-TokensV3Test-941928672 tempest-TokensV3Test-941928672-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2653fa9d445046118c0658e92213b0dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6b5885c331747128e055c5c76be32d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:25.209274 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691a7dfe-34e3-4b6c-b9af-b5966a736809 tempest-TokensV3Test-941928672 tempest-TokensV3Test-941928672-project] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:25.209570 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691a7dfe-34e3-4b6c-b9af-b5966a736809 tempest-TokensV3Test-941928672 tempest-TokensV3Test-941928672-project] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:25.210904 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691a7dfe-34e3-4b6c-b9af-b5966a736809 tempest-TokensV3Test-941928672 tempest-TokensV3Test-941928672-project] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:25.216307 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-691a7dfe-34e3-4b6c-b9af-b5966a736809 tempest-TokensV3Test-941928672 tempest-TokensV3Test-941928672-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:25.240050 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-691a7dfe-34e3-4b6c-b9af-b5966a736809 tempest-TokensV3Test-941928672 tempest-TokensV3Test-941928672-project] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Jul 23 21:35:25.240050 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 21:35:25.240050 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 21:35:25.240050 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 21:35:25.240050 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 21:35:25.240050 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 21:35:25.240050 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 21:35:25.240050 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 21:35:25.240050 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 21:35:25.240050 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 21:35:25.240050 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 21:35:25.240050 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 21:35:25.240050 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 285, in get Jul 23 21:35:25.240050 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:validate_token') Jul 23 21:35:25.240050 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 422, in enforce_call Jul 23 21:35:25.241336 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application subj_token_target_data = cls._extract_subject_token_target_data() Jul 23 21:35:25.241336 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 261, in _extract_subject_token_target_data Jul 23 21:35:25.241336 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application token = PROVIDER_APIS.token_provider_api.validate_token( Jul 23 21:35:25.241336 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 21:35:25.241336 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 21:35:25.241336 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 146, in validate_token Jul 23 21:35:25.241336 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application self._is_valid_token(token, window_seconds=window_seconds) Jul 23 21:35:25.241336 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 199, in _is_valid_token Jul 23 21:35:25.241336 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application self.check_revocation(token) Jul 23 21:35:25.241336 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 21:35:25.241336 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 21:35:25.241336 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 137, in check_revocation Jul 23 21:35:25.241336 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.check_revocation_v3(token) Jul 23 21:35:25.241336 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 21:35:25.241336 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 21:35:25.241336 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 134, in check_revocation_v3 Jul 23 21:35:25.241336 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application PROVIDERS.revoke_api.check_token(token_values) Jul 23 21:35:25.242816 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 21:35:25.242816 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 21:35:25.242816 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/revoke/core.py", line 137, in check_token Jul 23 21:35:25.242816 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.TokenNotFound(_('Failed to validate token')) Jul 23 21:35:25.242816 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.TokenNotFound: Failed to validate token Jul 23 21:35:25.242816 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 21:35:25.248369 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3392/6822] 10.222.0.17 () {56 vars in 1262 bytes} [Sat Jul 23 21:35:25 2022] GET /identity/v3/auth/tokens => generated 80 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 21:35:25.248912 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef12def7-84f7-4f7d-b14c-6c69f818f969 tempest-TokensV3Test-941928672 tempest-TokensV3Test-941928672-project] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:25.264533 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=86,keystone:DELETE=9,keystone:INSERT=5 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:35:25.355757 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef12def7-84f7-4f7d-b14c-6c69f818f969 tempest-TokensV3Test-941928672 tempest-TokensV3Test-941928672-project] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:25.389486 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140b7bfe-436b-4d91-a2fa-2200abdcb09d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:25.390536 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140b7bfe-436b-4d91-a2fa-2200abdcb09d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:25.391450 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140b7bfe-436b-4d91-a2fa-2200abdcb09d admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:25.391730 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140b7bfe-436b-4d91-a2fa-2200abdcb09d admin admin] PATH_INFO: `/v3/users/2653fa9d445046118c0658e92213b0dc` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:25.394410 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140b7bfe-436b-4d91-a2fa-2200abdcb09d admin admin] RBAC: Authorizing `identity:delete_user(user_id=2653fa9d445046118c0658e92213b0dc)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:25.398687 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140b7bfe-436b-4d91-a2fa-2200abdcb09d admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:25.488376 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-140b7bfe-436b-4d91-a2fa-2200abdcb09d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2653fa9d445046118c0658e92213b0dc'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:25.490980 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-140b7bfe-436b-4d91-a2fa-2200abdcb09d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2653fa9d445046118c0658e92213b0dc'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:25.498787 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-140b7bfe-436b-4d91-a2fa-2200abdcb09d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2653fa9d445046118c0658e92213b0dc'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:25.509711 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-140b7bfe-436b-4d91-a2fa-2200abdcb09d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2653fa9d445046118c0658e92213b0dc'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:25.527747 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-140b7bfe-436b-4d91-a2fa-2200abdcb09d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2653fa9d445046118c0658e92213b0dc'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:25.535573 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3431/6823] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:35:25 2022] DELETE /identity/v3/users/2653fa9d445046118c0658e92213b0dc => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:35:25.540080 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b002fd84-c12b-409d-be99-b415df30e898 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:25.540929 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b002fd84-c12b-409d-be99-b415df30e898 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:25.541401 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b002fd84-c12b-409d-be99-b415df30e898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:25.561228 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-b002fd84-c12b-409d-be99-b415df30e898 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:35:25.562538 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-b002fd84-c12b-409d-be99-b415df30e898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:25.624348 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:35:25.650013 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3393/6824] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:35:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:35:25.660394 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140b7bfe-436b-4d91-a2fa-2200abdcb09d admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:25.661978 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-140b7bfe-436b-4d91-a2fa-2200abdcb09d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:25.765427 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140b7bfe-436b-4d91-a2fa-2200abdcb09d admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:25.769529 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad39906-67cc-4aa7-818d-81054d6e1978 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:25.770308 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad39906-67cc-4aa7-818d-81054d6e1978 service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:25.770670 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad39906-67cc-4aa7-818d-81054d6e1978 service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:25.771015 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad39906-67cc-4aa7-818d-81054d6e1978 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:25.784905 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad39906-67cc-4aa7-818d-81054d6e1978 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:25.786621 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad39906-67cc-4aa7-818d-81054d6e1978 service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:25.803057 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3432/6825] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:35:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:35:26.528536 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b002fd84-c12b-409d-be99-b415df30e898 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:26.530409 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-b002fd84-c12b-409d-be99-b415df30e898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:26.698532 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b002fd84-c12b-409d-be99-b415df30e898 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:26.706661 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a9be39-dd12-41cf-907e-c2b9a14206ca tempest-RoutersIpV6AdminTest-145616358 tempest-RoutersIpV6AdminTest-145616358-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5056bfd4dd8b497e899cae5be25d028d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85724292ed094634be7b2e4ce98c565b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:26.707409 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a9be39-dd12-41cf-907e-c2b9a14206ca tempest-RoutersIpV6AdminTest-145616358 tempest-RoutersIpV6AdminTest-145616358-project-admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:26.707689 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a9be39-dd12-41cf-907e-c2b9a14206ca tempest-RoutersIpV6AdminTest-145616358 tempest-RoutersIpV6AdminTest-145616358-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:26.708147 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a9be39-dd12-41cf-907e-c2b9a14206ca tempest-RoutersIpV6AdminTest-145616358 tempest-RoutersIpV6AdminTest-145616358-project-admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:26.709072 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a9be39-dd12-41cf-907e-c2b9a14206ca tempest-RoutersIpV6AdminTest-145616358 tempest-RoutersIpV6AdminTest-145616358-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:35:26.709562 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a9be39-dd12-41cf-907e-c2b9a14206ca tempest-RoutersIpV6AdminTest-145616358 tempest-RoutersIpV6AdminTest-145616358-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:26.717298 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a9be39-dd12-41cf-907e-c2b9a14206ca tempest-RoutersIpV6AdminTest-145616358 tempest-RoutersIpV6AdminTest-145616358-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:26.748795 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3394/6826] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:35:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:35:26.753341 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad39906-67cc-4aa7-818d-81054d6e1978 service neutron] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:26.775539 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad39906-67cc-4aa7-818d-81054d6e1978 service neutron] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:26.782129 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539e6ae0-d7c3-49c2-8b52-52cee6cd7121 tempest-RoutersIpV6AdminTest-145616358 tempest-RoutersIpV6AdminTest-145616358-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5056bfd4dd8b497e899cae5be25d028d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85724292ed094634be7b2e4ce98c565b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:26.783686 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539e6ae0-d7c3-49c2-8b52-52cee6cd7121 tempest-RoutersIpV6AdminTest-145616358 tempest-RoutersIpV6AdminTest-145616358-project-admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:26.784318 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539e6ae0-d7c3-49c2-8b52-52cee6cd7121 tempest-RoutersIpV6AdminTest-145616358 tempest-RoutersIpV6AdminTest-145616358-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:26.785051 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539e6ae0-d7c3-49c2-8b52-52cee6cd7121 tempest-RoutersIpV6AdminTest-145616358 tempest-RoutersIpV6AdminTest-145616358-project-admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:26.786412 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539e6ae0-d7c3-49c2-8b52-52cee6cd7121 tempest-RoutersIpV6AdminTest-145616358 tempest-RoutersIpV6AdminTest-145616358-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:26.789543 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539e6ae0-d7c3-49c2-8b52-52cee6cd7121 tempest-RoutersIpV6AdminTest-145616358 tempest-RoutersIpV6AdminTest-145616358-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:26.845435 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3433/6827] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:35:26 2022] POST /identity/v3/projects => generated 349 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:35:26.850542 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a9be39-dd12-41cf-907e-c2b9a14206ca tempest-RoutersIpV6AdminTest-145616358 tempest-RoutersIpV6AdminTest-145616358-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:26.865542 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a9be39-dd12-41cf-907e-c2b9a14206ca tempest-RoutersIpV6AdminTest-145616358 tempest-RoutersIpV6AdminTest-145616358-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:26.954990 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344f5ba2-0aaa-4878-9f4a-04dd390d910c tempest-RoutersIpV6AdminTest-145616358 tempest-RoutersIpV6AdminTest-145616358-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5056bfd4dd8b497e899cae5be25d028d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85724292ed094634be7b2e4ce98c565b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:26.955279 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344f5ba2-0aaa-4878-9f4a-04dd390d910c tempest-RoutersIpV6AdminTest-145616358 tempest-RoutersIpV6AdminTest-145616358-project-admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:26.955671 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344f5ba2-0aaa-4878-9f4a-04dd390d910c tempest-RoutersIpV6AdminTest-145616358 tempest-RoutersIpV6AdminTest-145616358-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:26.956011 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344f5ba2-0aaa-4878-9f4a-04dd390d910c tempest-RoutersIpV6AdminTest-145616358 tempest-RoutersIpV6AdminTest-145616358-project-admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:26.957095 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344f5ba2-0aaa-4878-9f4a-04dd390d910c tempest-RoutersIpV6AdminTest-145616358 tempest-RoutersIpV6AdminTest-145616358-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:35:26.957381 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344f5ba2-0aaa-4878-9f4a-04dd390d910c tempest-RoutersIpV6AdminTest-145616358 tempest-RoutersIpV6AdminTest-145616358-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:26.961643 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344f5ba2-0aaa-4878-9f4a-04dd390d910c tempest-RoutersIpV6AdminTest-145616358 tempest-RoutersIpV6AdminTest-145616358-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:26.975829 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3395/6828] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:35:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:35:27.031929 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539e6ae0-d7c3-49c2-8b52-52cee6cd7121 tempest-RoutersIpV6AdminTest-145616358 tempest-RoutersIpV6AdminTest-145616358-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:27.034298 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-539e6ae0-d7c3-49c2-8b52-52cee6cd7121 tempest-RoutersIpV6AdminTest-145616358 tempest-RoutersIpV6AdminTest-145616358-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:27.045820 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:35:27.122486 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539e6ae0-d7c3-49c2-8b52-52cee6cd7121 tempest-RoutersIpV6AdminTest-145616358 tempest-RoutersIpV6AdminTest-145616358-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:27.127760 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8443c6ee-f62d-4459-9e04-aff3efc6902e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:27.129286 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8443c6ee-f62d-4459-9e04-aff3efc6902e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:27.129659 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8443c6ee-f62d-4459-9e04-aff3efc6902e admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:27.130136 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8443c6ee-f62d-4459-9e04-aff3efc6902e admin admin] PATH_INFO: `/v3/projects/a6b5885c331747128e055c5c76be32d4` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:27.131428 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8443c6ee-f62d-4459-9e04-aff3efc6902e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6b5885c331747128e055c5c76be32d4)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:27.133709 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8443c6ee-f62d-4459-9e04-aff3efc6902e admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:27.206500 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-8443c6ee-f62d-4459-9e04-aff3efc6902e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6b5885c331747128e055c5c76be32d4', 'request_id': 'req-8443c6ee-f62d-4459-9e04-aff3efc6902e'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:27.219433 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-8443c6ee-f62d-4459-9e04-aff3efc6902e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6b5885c331747128e055c5c76be32d4', 'request_id': 'req-8443c6ee-f62d-4459-9e04-aff3efc6902e'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:27.228620 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-8443c6ee-f62d-4459-9e04-aff3efc6902e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6b5885c331747128e055c5c76be32d4', 'request_id': 'req-8443c6ee-f62d-4459-9e04-aff3efc6902e'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:27.247453 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-8443c6ee-f62d-4459-9e04-aff3efc6902e admin admin] The token cache is being invalidate because project a6b5885c331747128e055c5c76be32d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:35:27.247453 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-8443c6ee-f62d-4459-9e04-aff3efc6902e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:27.248582 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-8443c6ee-f62d-4459-9e04-aff3efc6902e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:27.254475 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3434/6829] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:35:27 2022] DELETE /identity/v3/projects/a6b5885c331747128e055c5c76be32d4 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:35:27.256829 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5218cc-ae3e-4e54-ab6f-7110986bbfa8 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:27.257118 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5218cc-ae3e-4e54-ab6f-7110986bbfa8 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:27.258306 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5218cc-ae3e-4e54-ab6f-7110986bbfa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:27.284688 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-ba5218cc-ae3e-4e54-ab6f-7110986bbfa8 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:35:27.286342 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-ba5218cc-ae3e-4e54-ab6f-7110986bbfa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:27.391262 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3396/6830] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:35:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:35:27.399850 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc50d9f0-ed48-4e65-b90f-b7fae4326ab7 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:27.400276 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc50d9f0-ed48-4e65-b90f-b7fae4326ab7 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:27.400653 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc50d9f0-ed48-4e65-b90f-b7fae4326ab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:27.421774 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-bc50d9f0-ed48-4e65-b90f-b7fae4326ab7 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:35:27.423215 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-bc50d9f0-ed48-4e65-b90f-b7fae4326ab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:27.435085 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3435/6831] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:35:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:35:27.436458 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5218cc-ae3e-4e54-ab6f-7110986bbfa8 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:27.448270 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5218cc-ae3e-4e54-ab6f-7110986bbfa8 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:27.453332 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750994cc-9eff-4b26-af1b-36d74a399480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:27.454249 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750994cc-9eff-4b26-af1b-36d74a399480 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:27.454645 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750994cc-9eff-4b26-af1b-36d74a399480 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:27.455009 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750994cc-9eff-4b26-af1b-36d74a399480 admin admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:27.456091 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750994cc-9eff-4b26-af1b-36d74a399480 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:35:27.456558 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750994cc-9eff-4b26-af1b-36d74a399480 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:27.458355 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750994cc-9eff-4b26-af1b-36d74a399480 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:27.476175 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3397/6832] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:35:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:35:27.477723 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc50d9f0-ed48-4e65-b90f-b7fae4326ab7 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:27.488360 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc50d9f0-ed48-4e65-b90f-b7fae4326ab7 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:27.493417 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa2730e-1806-4cd7-8c95-ec621686b95e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:27.494281 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa2730e-1806-4cd7-8c95-ec621686b95e admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:27.494660 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa2730e-1806-4cd7-8c95-ec621686b95e admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:27.495033 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa2730e-1806-4cd7-8c95-ec621686b95e admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:27.495878 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa2730e-1806-4cd7-8c95-ec621686b95e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:27.498155 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa2730e-1806-4cd7-8c95-ec621686b95e admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:27.532982 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3436/6833] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:35:27 2022] POST /identity/v3/projects => generated 357 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:35:27.535252 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750994cc-9eff-4b26-af1b-36d74a399480 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:27.543047 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:35:27.548703 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750994cc-9eff-4b26-af1b-36d74a399480 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:27.622730 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c30c316-9d23-44dd-975b-98a2c395bcaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:27.623525 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c30c316-9d23-44dd-975b-98a2c395bcaa admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:27.623872 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c30c316-9d23-44dd-975b-98a2c395bcaa admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:27.624209 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c30c316-9d23-44dd-975b-98a2c395bcaa admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:27.624985 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c30c316-9d23-44dd-975b-98a2c395bcaa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:27.627223 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c30c316-9d23-44dd-975b-98a2c395bcaa admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:27.652796 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3398/6834] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:35:27 2022] POST /identity/v3/users => generated 279 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:35:27.657106 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa2730e-1806-4cd7-8c95-ec621686b95e admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:27.668441 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa2730e-1806-4cd7-8c95-ec621686b95e admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:27.673341 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d18600e-d024-4f56-986e-5809b94ff464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:27.674132 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d18600e-d024-4f56-986e-5809b94ff464 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:27.675966 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d18600e-d024-4f56-986e-5809b94ff464 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:27.675966 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d18600e-d024-4f56-986e-5809b94ff464 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:27.675966 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d18600e-d024-4f56-986e-5809b94ff464 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:27.678389 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d18600e-d024-4f56-986e-5809b94ff464 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:27.695084 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3437/6835] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:35:27 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 21:35:27.696346 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c30c316-9d23-44dd-975b-98a2c395bcaa admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:27.718082 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d18600e-d024-4f56-986e-5809b94ff464 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:27.720295 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c30c316-9d23-44dd-975b-98a2c395bcaa admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:27.723250 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-9d18600e-d024-4f56-986e-5809b94ff464 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:27.731706 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b404cc-5eea-4c04-a52e-cf4110d27164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:27.732991 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b404cc-5eea-4c04-a52e-cf4110d27164 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:27.733449 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b404cc-5eea-4c04-a52e-cf4110d27164 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:27.733921 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b404cc-5eea-4c04-a52e-cf4110d27164 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:27.734898 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b404cc-5eea-4c04-a52e-cf4110d27164 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:27.736534 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b404cc-5eea-4c04-a52e-cf4110d27164 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:27.761596 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3399/6836] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:35:27 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:35:27.771918 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b404cc-5eea-4c04-a52e-cf4110d27164 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:27.790873 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b404cc-5eea-4c04-a52e-cf4110d27164 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:27.798627 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0895266-f561-40d6-9351-f43273908c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:27.800478 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0895266-f561-40d6-9351-f43273908c60 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:27.800941 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0895266-f561-40d6-9351-f43273908c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:27.802055 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0895266-f561-40d6-9351-f43273908c60 admin admin] PATH_INFO: `/v3/projects/138c896d9c354d95b7b3cfc6649f7c14/users/0518471b18b849c49d075cec1d040b03/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:27.828052 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d18600e-d024-4f56-986e-5809b94ff464 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:27.829036 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0895266-f561-40d6-9351-f43273908c60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=138c896d9c354d95b7b3cfc6649f7c14, user_id=0518471b18b849c49d075cec1d040b03, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:27.832236 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0895266-f561-40d6-9351-f43273908c60 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:27.833517 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2177a6b2-c86f-4dfd-bcef-7f536f2da5b0 tempest-RoutersIpV6AdminTest-145616358 tempest-RoutersIpV6AdminTest-145616358-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5056bfd4dd8b497e899cae5be25d028d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85724292ed094634be7b2e4ce98c565b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:27.834621 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2177a6b2-c86f-4dfd-bcef-7f536f2da5b0 tempest-RoutersIpV6AdminTest-145616358 tempest-RoutersIpV6AdminTest-145616358-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:27.835140 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2177a6b2-c86f-4dfd-bcef-7f536f2da5b0 tempest-RoutersIpV6AdminTest-145616358 tempest-RoutersIpV6AdminTest-145616358-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:27.835455 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2177a6b2-c86f-4dfd-bcef-7f536f2da5b0 tempest-RoutersIpV6AdminTest-145616358 tempest-RoutersIpV6AdminTest-145616358-project-admin] PATH_INFO: `/v3/projects/0fd68874948d4a7cb8f4e285679c6a87` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:27.837008 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2177a6b2-c86f-4dfd-bcef-7f536f2da5b0 tempest-RoutersIpV6AdminTest-145616358 tempest-RoutersIpV6AdminTest-145616358-project-admin] RBAC: Authorizing `identity:delete_project(project_id=0fd68874948d4a7cb8f4e285679c6a87)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:27.839213 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2177a6b2-c86f-4dfd-bcef-7f536f2da5b0 tempest-RoutersIpV6AdminTest-145616358 tempest-RoutersIpV6AdminTest-145616358-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:27.841297 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:35:27.867810 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3400/6837] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:35:27 2022] PUT /identity/v3/projects/138c896d9c354d95b7b3cfc6649f7c14/users/0518471b18b849c49d075cec1d040b03/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:35:27.868206 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0895266-f561-40d6-9351-f43273908c60 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:27.869933 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-c0895266-f561-40d6-9351-f43273908c60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:27.931738 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-2177a6b2-c86f-4dfd-bcef-7f536f2da5b0 tempest-RoutersIpV6AdminTest-145616358 tempest-RoutersIpV6AdminTest-145616358-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fd68874948d4a7cb8f4e285679c6a87', 'request_id': 'req-2177a6b2-c86f-4dfd-bcef-7f536f2da5b0'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:27.941331 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-2177a6b2-c86f-4dfd-bcef-7f536f2da5b0 tempest-RoutersIpV6AdminTest-145616358 tempest-RoutersIpV6AdminTest-145616358-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fd68874948d4a7cb8f4e285679c6a87', 'request_id': 'req-2177a6b2-c86f-4dfd-bcef-7f536f2da5b0'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:27.948160 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-2177a6b2-c86f-4dfd-bcef-7f536f2da5b0 tempest-RoutersIpV6AdminTest-145616358 tempest-RoutersIpV6AdminTest-145616358-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fd68874948d4a7cb8f4e285679c6a87', 'request_id': 'req-2177a6b2-c86f-4dfd-bcef-7f536f2da5b0'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:27.951309 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0895266-f561-40d6-9351-f43273908c60 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:27.962865 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-2177a6b2-c86f-4dfd-bcef-7f536f2da5b0 tempest-RoutersIpV6AdminTest-145616358 tempest-RoutersIpV6AdminTest-145616358-project-admin] The token cache is being invalidate because project 0fd68874948d4a7cb8f4e285679c6a87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:35:27.963181 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-2177a6b2-c86f-4dfd-bcef-7f536f2da5b0 tempest-RoutersIpV6AdminTest-145616358 tempest-RoutersIpV6AdminTest-145616358-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:27.964259 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-2177a6b2-c86f-4dfd-bcef-7f536f2da5b0 tempest-RoutersIpV6AdminTest-145616358 tempest-RoutersIpV6AdminTest-145616358-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:27.972860 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3438/6838] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:35:27 2022] DELETE /identity/v3/projects/0fd68874948d4a7cb8f4e285679c6a87 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:35:27.972860 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a816b5-c5fd-4b55-8189-4ce94b0751d8 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:27.972860 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a816b5-c5fd-4b55-8189-4ce94b0751d8 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:27.972860 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a816b5-c5fd-4b55-8189-4ce94b0751d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:28.006882 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-25a816b5-c5fd-4b55-8189-4ce94b0751d8 None None] MFA Rules not processed for user `0518471b18b849c49d075cec1d040b03`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:35:28.008303 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-25a816b5-c5fd-4b55-8189-4ce94b0751d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:28.030652 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165a8d09-31c8-4914-8ad3-145c5bbdd40f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:28.031604 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165a8d09-31c8-4914-8ad3-145c5bbdd40f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:28.031884 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165a8d09-31c8-4914-8ad3-145c5bbdd40f admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:28.032157 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165a8d09-31c8-4914-8ad3-145c5bbdd40f admin admin] PATH_INFO: `/v3/users/5283f93db2194a8596d46d2baf2a5e9b` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:28.034305 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165a8d09-31c8-4914-8ad3-145c5bbdd40f admin admin] RBAC: Authorizing `identity:delete_user(user_id=5283f93db2194a8596d46d2baf2a5e9b)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:28.037533 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165a8d09-31c8-4914-8ad3-145c5bbdd40f admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:28.045578 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:35:28.088054 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3439/6839] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:35:27 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:35:28.089549 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a816b5-c5fd-4b55-8189-4ce94b0751d8 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:28.091262 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-25a816b5-c5fd-4b55-8189-4ce94b0751d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:28.109635 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-165a8d09-31c8-4914-8ad3-145c5bbdd40f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5283f93db2194a8596d46d2baf2a5e9b'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:28.122045 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-165a8d09-31c8-4914-8ad3-145c5bbdd40f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5283f93db2194a8596d46d2baf2a5e9b'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:28.122983 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-165a8d09-31c8-4914-8ad3-145c5bbdd40f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5283f93db2194a8596d46d2baf2a5e9b'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:28.138423 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-165a8d09-31c8-4914-8ad3-145c5bbdd40f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5283f93db2194a8596d46d2baf2a5e9b'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:28.154365 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-165a8d09-31c8-4914-8ad3-145c5bbdd40f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5283f93db2194a8596d46d2baf2a5e9b'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:28.162297 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3401/6840] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:35:27 2022] DELETE /identity/v3/users/5283f93db2194a8596d46d2baf2a5e9b => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:35:28.163404 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165a8d09-31c8-4914-8ad3-145c5bbdd40f admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:28.165372 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-165a8d09-31c8-4914-8ad3-145c5bbdd40f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:28.247589 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a816b5-c5fd-4b55-8189-4ce94b0751d8 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:28.262244 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165a8d09-31c8-4914-8ad3-145c5bbdd40f admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:28.271898 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb265f84-0977-43f9-aa81-57dfd42e15f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:28.272889 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb265f84-0977-43f9-aa81-57dfd42e15f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:28.273171 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb265f84-0977-43f9-aa81-57dfd42e15f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:28.273574 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb265f84-0977-43f9-aa81-57dfd42e15f6 admin admin] PATH_INFO: `/v3/users/0518471b18b849c49d075cec1d040b03` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:28.274725 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb265f84-0977-43f9-aa81-57dfd42e15f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0518471b18b849c49d075cec1d040b03)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:28.277450 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb265f84-0977-43f9-aa81-57dfd42e15f6 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:28.300748 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:35:28.320695 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244fe135-540a-450b-bd91-78e86f23ccd4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:28.321589 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244fe135-540a-450b-bd91-78e86f23ccd4 service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:28.322070 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244fe135-540a-450b-bd91-78e86f23ccd4 service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:28.322497 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244fe135-540a-450b-bd91-78e86f23ccd4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:28.324520 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-244fe135-540a-450b-bd91-78e86f23ccd4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:28.383013 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-eb265f84-0977-43f9-aa81-57dfd42e15f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0518471b18b849c49d075cec1d040b03'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:28.392363 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-eb265f84-0977-43f9-aa81-57dfd42e15f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0518471b18b849c49d075cec1d040b03'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:28.393123 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-eb265f84-0977-43f9-aa81-57dfd42e15f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0518471b18b849c49d075cec1d040b03'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:28.394367 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244fe135-540a-450b-bd91-78e86f23ccd4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:28.396390 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244fe135-540a-450b-bd91-78e86f23ccd4 service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:28.409304 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-eb265f84-0977-43f9-aa81-57dfd42e15f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0518471b18b849c49d075cec1d040b03'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:28.412902 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3440/6841] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:35:28 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:35:28.414896 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fc1bc6-100c-4e5c-8a44-5a3f902c7c39 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:28.415484 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fc1bc6-100c-4e5c-8a44-5a3f902c7c39 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:28.415872 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fc1bc6-100c-4e5c-8a44-5a3f902c7c39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:28.443483 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-20fc1bc6-100c-4e5c-8a44-5a3f902c7c39 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:35:28.445470 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-20fc1bc6-100c-4e5c-8a44-5a3f902c7c39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:28.448927 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-eb265f84-0977-43f9-aa81-57dfd42e15f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0518471b18b849c49d075cec1d040b03'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:28.457991 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3441/6842] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:35:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:35:28.468591 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3402/6843] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:35:28 2022] DELETE /identity/v3/users/0518471b18b849c49d075cec1d040b03 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:35:28.474588 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603fd7a7-d08f-422c-8ee6-3adeb43295d0 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:28.475740 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603fd7a7-d08f-422c-8ee6-3adeb43295d0 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:28.476516 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603fd7a7-d08f-422c-8ee6-3adeb43295d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:28.479312 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb265f84-0977-43f9-aa81-57dfd42e15f6 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:28.481442 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-eb265f84-0977-43f9-aa81-57dfd42e15f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:28.501276 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:35:28.509053 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-603fd7a7-d08f-422c-8ee6-3adeb43295d0 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:35:28.512576 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-603fd7a7-d08f-422c-8ee6-3adeb43295d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:28.608861 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3442/6844] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:35:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:35:28.619499 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb265f84-0977-43f9-aa81-57dfd42e15f6 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:28.628663 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9279a3-caf0-428c-bc2e-48944bebb921 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:28.630178 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9279a3-caf0-428c-bc2e-48944bebb921 service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:28.630647 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603fd7a7-d08f-422c-8ee6-3adeb43295d0 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:28.630812 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9279a3-caf0-428c-bc2e-48944bebb921 service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:28.631597 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9279a3-caf0-428c-bc2e-48944bebb921 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:28.653929 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603fd7a7-d08f-422c-8ee6-3adeb43295d0 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:28.656694 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9279a3-caf0-428c-bc2e-48944bebb921 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:28.660229 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9279a3-caf0-428c-bc2e-48944bebb921 service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:28.664894 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815d95b4-d882-4848-a709-b781dc19a18f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:28.664894 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815d95b4-d882-4848-a709-b781dc19a18f service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:28.665215 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815d95b4-d882-4848-a709-b781dc19a18f service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:28.665446 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815d95b4-d882-4848-a709-b781dc19a18f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:28.676622 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3403/6845] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:35:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:35:28.684229 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815d95b4-d882-4848-a709-b781dc19a18f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:28.687520 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815d95b4-d882-4848-a709-b781dc19a18f service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:28.708500 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3443/6846] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:35:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 23 21:35:29.281723 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9279a3-caf0-428c-bc2e-48944bebb921 service neutron] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:29.283902 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-0c9279a3-caf0-428c-bc2e-48944bebb921 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:29.304007 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9279a3-caf0-428c-bc2e-48944bebb921 service neutron] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:29.309456 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6969028f-8b30-47b5-93b0-54da9a4214bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:29.310425 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6969028f-8b30-47b5-93b0-54da9a4214bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:29.310702 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6969028f-8b30-47b5-93b0-54da9a4214bf admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:29.311104 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6969028f-8b30-47b5-93b0-54da9a4214bf admin admin] PATH_INFO: `/v3/projects/bfe378b8ed734056ac85e48626b3606e` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:29.312324 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6969028f-8b30-47b5-93b0-54da9a4214bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfe378b8ed734056ac85e48626b3606e)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:29.316700 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6969028f-8b30-47b5-93b0-54da9a4214bf admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:29.379723 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-6969028f-8b30-47b5-93b0-54da9a4214bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfe378b8ed734056ac85e48626b3606e', 'request_id': 'req-6969028f-8b30-47b5-93b0-54da9a4214bf'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:29.392303 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-6969028f-8b30-47b5-93b0-54da9a4214bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfe378b8ed734056ac85e48626b3606e', 'request_id': 'req-6969028f-8b30-47b5-93b0-54da9a4214bf'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:29.403519 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-6969028f-8b30-47b5-93b0-54da9a4214bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfe378b8ed734056ac85e48626b3606e', 'request_id': 'req-6969028f-8b30-47b5-93b0-54da9a4214bf'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:29.420403 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-6969028f-8b30-47b5-93b0-54da9a4214bf admin admin] The token cache is being invalidate because project bfe378b8ed734056ac85e48626b3606e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:35:29.420741 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-6969028f-8b30-47b5-93b0-54da9a4214bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:29.421347 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-6969028f-8b30-47b5-93b0-54da9a4214bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:29.426190 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3404/6847] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:35:29 2022] DELETE /identity/v3/projects/bfe378b8ed734056ac85e48626b3606e => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:35:29.427117 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815d95b4-d882-4848-a709-b781dc19a18f service neutron] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:29.441298 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815d95b4-d882-4848-a709-b781dc19a18f service neutron] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:29.524710 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b506077-e1d5-4ebd-9eee-0ab722bd7fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:29.525655 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b506077-e1d5-4ebd-9eee-0ab722bd7fa3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:29.525972 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b506077-e1d5-4ebd-9eee-0ab722bd7fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:29.526249 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b506077-e1d5-4ebd-9eee-0ab722bd7fa3 admin admin] PATH_INFO: `/v3/users/731ed0e3cb1149b590a42553408fc765` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:29.527482 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b506077-e1d5-4ebd-9eee-0ab722bd7fa3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=731ed0e3cb1149b590a42553408fc765)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:29.530248 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b506077-e1d5-4ebd-9eee-0ab722bd7fa3 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:29.544115 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:35:29.592014 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-9b506077-e1d5-4ebd-9eee-0ab722bd7fa3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '731ed0e3cb1149b590a42553408fc765'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:29.592629 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-9b506077-e1d5-4ebd-9eee-0ab722bd7fa3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '731ed0e3cb1149b590a42553408fc765'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:29.603732 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-9b506077-e1d5-4ebd-9eee-0ab722bd7fa3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '731ed0e3cb1149b590a42553408fc765'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:29.614960 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-9b506077-e1d5-4ebd-9eee-0ab722bd7fa3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '731ed0e3cb1149b590a42553408fc765'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:29.634572 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-9b506077-e1d5-4ebd-9eee-0ab722bd7fa3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '731ed0e3cb1149b590a42553408fc765'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:29.648759 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3444/6848] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:35:29 2022] DELETE /identity/v3/users/731ed0e3cb1149b590a42553408fc765 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:35:29.793749 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6969028f-8b30-47b5-93b0-54da9a4214bf admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:29.795750 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-6969028f-8b30-47b5-93b0-54da9a4214bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:29.830429 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6969028f-8b30-47b5-93b0-54da9a4214bf admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:29.930476 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a30671d-d469-40a5-8684-68b204c48870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:29.931435 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a30671d-d469-40a5-8684-68b204c48870 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:29.931727 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a30671d-d469-40a5-8684-68b204c48870 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:29.931983 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a30671d-d469-40a5-8684-68b204c48870 admin admin] PATH_INFO: `/v3/projects/138c896d9c354d95b7b3cfc6649f7c14` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:29.933404 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a30671d-d469-40a5-8684-68b204c48870 admin admin] RBAC: Authorizing `identity:delete_project(project_id=138c896d9c354d95b7b3cfc6649f7c14)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:29.935948 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a30671d-d469-40a5-8684-68b204c48870 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:29.994275 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:35:30.016896 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-2a30671d-d469-40a5-8684-68b204c48870 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '138c896d9c354d95b7b3cfc6649f7c14', 'request_id': 'req-2a30671d-d469-40a5-8684-68b204c48870'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:30.059512 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-2a30671d-d469-40a5-8684-68b204c48870 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '138c896d9c354d95b7b3cfc6649f7c14', 'request_id': 'req-2a30671d-d469-40a5-8684-68b204c48870'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:30.084297 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-2a30671d-d469-40a5-8684-68b204c48870 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '138c896d9c354d95b7b3cfc6649f7c14', 'request_id': 'req-2a30671d-d469-40a5-8684-68b204c48870'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:30.116333 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-2a30671d-d469-40a5-8684-68b204c48870 admin admin] The token cache is being invalidate because project 138c896d9c354d95b7b3cfc6649f7c14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:35:30.118179 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-2a30671d-d469-40a5-8684-68b204c48870 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:30.120893 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-2a30671d-d469-40a5-8684-68b204c48870 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:30.123580 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3405/6849] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:35:29 2022] DELETE /identity/v3/projects/138c896d9c354d95b7b3cfc6649f7c14 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:35:30.128966 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2484b58c-9f5e-4b46-9bf1-50a6c85f843b None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:30.129451 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2484b58c-9f5e-4b46-9bf1-50a6c85f843b None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:30.129843 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2484b58c-9f5e-4b46-9bf1-50a6c85f843b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:30.160966 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-2484b58c-9f5e-4b46-9bf1-50a6c85f843b None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:35:30.162782 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-2484b58c-9f5e-4b46-9bf1-50a6c85f843b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:30.317519 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3445/6850] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:35:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:35:30.322774 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d839ab2-b3f7-4c29-a2e3-3c3aa59c0f10 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:30.323327 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d839ab2-b3f7-4c29-a2e3-3c3aa59c0f10 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:30.323633 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d839ab2-b3f7-4c29-a2e3-3c3aa59c0f10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:30.359397 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-5d839ab2-b3f7-4c29-a2e3-3c3aa59c0f10 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:35:30.361465 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-5d839ab2-b3f7-4c29-a2e3-3c3aa59c0f10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:30.373106 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3406/6851] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:35:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:35:30.377092 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2484b58c-9f5e-4b46-9bf1-50a6c85f843b None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:30.387820 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2484b58c-9f5e-4b46-9bf1-50a6c85f843b None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:30.396333 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4c5314-60e1-4fde-bcd5-ffa656b31443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:30.397190 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4c5314-60e1-4fde-bcd5-ffa656b31443 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:30.397569 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4c5314-60e1-4fde-bcd5-ffa656b31443 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:30.398036 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4c5314-60e1-4fde-bcd5-ffa656b31443 admin admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:30.399448 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4c5314-60e1-4fde-bcd5-ffa656b31443 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:35:30.399448 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4c5314-60e1-4fde-bcd5-ffa656b31443 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:30.401703 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4c5314-60e1-4fde-bcd5-ffa656b31443 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:30.418379 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3446/6852] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:35:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:35:30.422601 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d839ab2-b3f7-4c29-a2e3-3c3aa59c0f10 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:30.443253 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d839ab2-b3f7-4c29-a2e3-3c3aa59c0f10 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:30.449923 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1069a47c-3260-4d11-9145-e0ce4896db24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:30.450919 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1069a47c-3260-4d11-9145-e0ce4896db24 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:30.451326 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1069a47c-3260-4d11-9145-e0ce4896db24 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:30.451726 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1069a47c-3260-4d11-9145-e0ce4896db24 admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:30.452534 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1069a47c-3260-4d11-9145-e0ce4896db24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:30.455013 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1069a47c-3260-4d11-9145-e0ce4896db24 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:30.513422 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4c5314-60e1-4fde-bcd5-ffa656b31443 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:30.517160 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-ca4c5314-60e1-4fde-bcd5-ffa656b31443 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:30.541304 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3407/6853] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:35:30 2022] POST /identity/v3/projects => generated 369 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:35:30.547075 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1069a47c-3260-4d11-9145-e0ce4896db24 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:30.581112 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4c5314-60e1-4fde-bcd5-ffa656b31443 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:30.703258 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1069a47c-3260-4d11-9145-e0ce4896db24 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:30.709360 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fd14d3-7434-4aa9-b6c3-acdfa9aa68fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:30.710406 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fd14d3-7434-4aa9-b6c3-acdfa9aa68fa admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:30.711959 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fd14d3-7434-4aa9-b6c3-acdfa9aa68fa admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:30.711959 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fd14d3-7434-4aa9-b6c3-acdfa9aa68fa admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:30.712621 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fd14d3-7434-4aa9-b6c3-acdfa9aa68fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:30.714938 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fd14d3-7434-4aa9-b6c3-acdfa9aa68fa admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:30.719744 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c732b04a-0b18-42f4-9ee5-c7b5d351551c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:30.720863 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c732b04a-0b18-42f4-9ee5-c7b5d351551c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:30.721302 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c732b04a-0b18-42f4-9ee5-c7b5d351551c admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:30.721829 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c732b04a-0b18-42f4-9ee5-c7b5d351551c admin admin] PATH_INFO: `/v3/projects/d7e4cfecce7c44f8bda24e5fd88843b6` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:30.724525 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c732b04a-0b18-42f4-9ee5-c7b5d351551c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7e4cfecce7c44f8bda24e5fd88843b6)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:30.727056 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c732b04a-0b18-42f4-9ee5-c7b5d351551c admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:30.758175 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3408/6854] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:35:30 2022] POST /identity/v3/users => generated 285 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:35:30.759124 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:35:30.761650 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fd14d3-7434-4aa9-b6c3-acdfa9aa68fa admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:30.784402 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fd14d3-7434-4aa9-b6c3-acdfa9aa68fa admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:30.814136 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c732b04a-0b18-42f4-9ee5-c7b5d351551c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7e4cfecce7c44f8bda24e5fd88843b6', 'request_id': 'req-c732b04a-0b18-42f4-9ee5-c7b5d351551c'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:30.821548 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c732b04a-0b18-42f4-9ee5-c7b5d351551c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7e4cfecce7c44f8bda24e5fd88843b6', 'request_id': 'req-c732b04a-0b18-42f4-9ee5-c7b5d351551c'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:30.829542 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c732b04a-0b18-42f4-9ee5-c7b5d351551c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7e4cfecce7c44f8bda24e5fd88843b6', 'request_id': 'req-c732b04a-0b18-42f4-9ee5-c7b5d351551c'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:30.868777 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c732b04a-0b18-42f4-9ee5-c7b5d351551c admin admin] The token cache is being invalidate because project d7e4cfecce7c44f8bda24e5fd88843b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:35:30.869790 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c732b04a-0b18-42f4-9ee5-c7b5d351551c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:30.870721 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c732b04a-0b18-42f4-9ee5-c7b5d351551c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:30.873784 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3447/6855] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:35:30 2022] DELETE /identity/v3/projects/d7e4cfecce7c44f8bda24e5fd88843b6 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:35:30.877374 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c732b04a-0b18-42f4-9ee5-c7b5d351551c admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:30.879321 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-c732b04a-0b18-42f4-9ee5-c7b5d351551c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:30.967621 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080ea912-d041-4ea9-b4ad-ea0e16e5018c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:30.967621 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080ea912-d041-4ea9-b4ad-ea0e16e5018c admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:30.967621 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080ea912-d041-4ea9-b4ad-ea0e16e5018c admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:30.968523 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080ea912-d041-4ea9-b4ad-ea0e16e5018c admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:30.972605 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080ea912-d041-4ea9-b4ad-ea0e16e5018c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:30.978496 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080ea912-d041-4ea9-b4ad-ea0e16e5018c admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:30.993640 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c732b04a-0b18-42f4-9ee5-c7b5d351551c admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:31.001030 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ef965d-44a8-4bd1-accd-c6bba1a8b8b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:31.002225 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3409/6856] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:35:30 2022] GET /identity/v3/roles => generated 1420 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:35:31.002857 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ef965d-44a8-4bd1-accd-c6bba1a8b8b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:31.003188 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ef965d-44a8-4bd1-accd-c6bba1a8b8b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:31.003539 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ef965d-44a8-4bd1-accd-c6bba1a8b8b2 admin admin] PATH_INFO: `/v3/users/205d7acf913b49d48ffce0c01b9a4782` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:31.005247 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ef965d-44a8-4bd1-accd-c6bba1a8b8b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=205d7acf913b49d48ffce0c01b9a4782)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:31.006771 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080ea912-d041-4ea9-b4ad-ea0e16e5018c admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:31.007462 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ef965d-44a8-4bd1-accd-c6bba1a8b8b2 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:31.010063 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-080ea912-d041-4ea9-b4ad-ea0e16e5018c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:31.027365 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080ea912-d041-4ea9-b4ad-ea0e16e5018c admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:31.037982 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589c2ff0-9114-4923-ae3c-4cb17c6f41a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:31.038770 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589c2ff0-9114-4923-ae3c-4cb17c6f41a5 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:31.039172 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589c2ff0-9114-4923-ae3c-4cb17c6f41a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:31.039761 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589c2ff0-9114-4923-ae3c-4cb17c6f41a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:31.040480 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589c2ff0-9114-4923-ae3c-4cb17c6f41a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:31.043369 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589c2ff0-9114-4923-ae3c-4cb17c6f41a5 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:31.061701 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3410/6857] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:35:31 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:35:31.066590 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589c2ff0-9114-4923-ae3c-4cb17c6f41a5 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:31.076529 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-a4ef965d-44a8-4bd1-accd-c6bba1a8b8b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '205d7acf913b49d48ffce0c01b9a4782'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:31.077606 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-a4ef965d-44a8-4bd1-accd-c6bba1a8b8b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '205d7acf913b49d48ffce0c01b9a4782'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:31.081769 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589c2ff0-9114-4923-ae3c-4cb17c6f41a5 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:31.086641 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-a4ef965d-44a8-4bd1-accd-c6bba1a8b8b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '205d7acf913b49d48ffce0c01b9a4782'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:31.087424 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5676dd6-8676-4684-9a71-8a7c01ad4f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:31.088522 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5676dd6-8676-4684-9a71-8a7c01ad4f98 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:31.089044 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5676dd6-8676-4684-9a71-8a7c01ad4f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:31.089473 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5676dd6-8676-4684-9a71-8a7c01ad4f98 admin admin] PATH_INFO: `/v3/projects/8a647900b2d1491e82863e6d23a26587/users/f9dbadf90a0e4a279f0b010de6f5eeb8/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:31.092529 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:35:31.100939 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-a4ef965d-44a8-4bd1-accd-c6bba1a8b8b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '205d7acf913b49d48ffce0c01b9a4782'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:31.126698 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-a4ef965d-44a8-4bd1-accd-c6bba1a8b8b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '205d7acf913b49d48ffce0c01b9a4782'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:31.131008 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5676dd6-8676-4684-9a71-8a7c01ad4f98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a647900b2d1491e82863e6d23a26587, user_id=f9dbadf90a0e4a279f0b010de6f5eeb8, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:31.138426 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3448/6858] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:35:30 2022] DELETE /identity/v3/users/205d7acf913b49d48ffce0c01b9a4782 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:35:31.140307 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5676dd6-8676-4684-9a71-8a7c01ad4f98 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:31.170812 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3411/6859] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:35:31 2022] PUT /identity/v3/projects/8a647900b2d1491e82863e6d23a26587/users/f9dbadf90a0e4a279f0b010de6f5eeb8/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:35:31.181375 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db12282c-c678-485b-a114-e699e9ff5749 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:31.182574 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db12282c-c678-485b-a114-e699e9ff5749 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:31.183197 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db12282c-c678-485b-a114-e699e9ff5749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:31.295820 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-db12282c-c678-485b-a114-e699e9ff5749 None None] MFA Rules not processed for user `f9dbadf90a0e4a279f0b010de6f5eeb8`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:35:31.297994 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-db12282c-c678-485b-a114-e699e9ff5749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:31.385393 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:35:31.492127 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3449/6860] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:35:31 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:35:31.496307 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5676dd6-8676-4684-9a71-8a7c01ad4f98 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:31.498259 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-e5676dd6-8676-4684-9a71-8a7c01ad4f98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:31.610004 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5676dd6-8676-4684-9a71-8a7c01ad4f98 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:31.618107 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2380e609-a447-4f2c-8d71-018be3c5a3cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:31.619542 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2380e609-a447-4f2c-8d71-018be3c5a3cd admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:31.620249 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2380e609-a447-4f2c-8d71-018be3c5a3cd admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:31.620797 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2380e609-a447-4f2c-8d71-018be3c5a3cd admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:31.621733 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2380e609-a447-4f2c-8d71-018be3c5a3cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:31.624961 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2380e609-a447-4f2c-8d71-018be3c5a3cd admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:31.691435 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3412/6861] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:35:31 2022] POST /identity/v3/projects => generated 367 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:35:31.695758 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db12282c-c678-485b-a114-e699e9ff5749 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:31.710993 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db12282c-c678-485b-a114-e699e9ff5749 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:31.805480 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052db930-7645-4670-80bc-2c954ac57225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:31.806213 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052db930-7645-4670-80bc-2c954ac57225 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:31.806491 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052db930-7645-4670-80bc-2c954ac57225 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:31.806763 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052db930-7645-4670-80bc-2c954ac57225 admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:31.807470 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052db930-7645-4670-80bc-2c954ac57225 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:31.810681 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052db930-7645-4670-80bc-2c954ac57225 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:31.884424 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3450/6862] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:35:31 2022] POST /identity/v3/users => generated 290 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:35:31.886193 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2380e609-a447-4f2c-8d71-018be3c5a3cd admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:31.900199 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2380e609-a447-4f2c-8d71-018be3c5a3cd admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:31.914747 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb382198-10e6-424f-af13-40b13baaebcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:31.915738 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb382198-10e6-424f-af13-40b13baaebcd admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:31.916027 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb382198-10e6-424f-af13-40b13baaebcd admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:31.916577 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb382198-10e6-424f-af13-40b13baaebcd admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:31.917489 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb382198-10e6-424f-af13-40b13baaebcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:31.919364 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb382198-10e6-424f-af13-40b13baaebcd admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:31.953991 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3413/6863] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:35:31 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:35:31.962245 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052db930-7645-4670-80bc-2c954ac57225 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:31.987670 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052db930-7645-4670-80bc-2c954ac57225 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:31.997198 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8a5cad-390f-4dcc-a563-80cfbe66ec3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:31.998265 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8a5cad-390f-4dcc-a563-80cfbe66ec3e admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:31.998980 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8a5cad-390f-4dcc-a563-80cfbe66ec3e admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:31.999259 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8a5cad-390f-4dcc-a563-80cfbe66ec3e admin admin] PATH_INFO: `/v3/projects/ba6897c63e074c32ab547ea52f81048f/users/0aaa7ff6b183446c856d821b9e30a1fd/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:32.039625 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8a5cad-390f-4dcc-a563-80cfbe66ec3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba6897c63e074c32ab547ea52f81048f, user_id=0aaa7ff6b183446c856d821b9e30a1fd, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:32.044327 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8a5cad-390f-4dcc-a563-80cfbe66ec3e admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:32.067720 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3451/6864] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:35:31 2022] PUT /identity/v3/projects/ba6897c63e074c32ab547ea52f81048f/users/0aaa7ff6b183446c856d821b9e30a1fd/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:35:32.070493 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb382198-10e6-424f-af13-40b13baaebcd admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:32.083523 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb382198-10e6-424f-af13-40b13baaebcd admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:32.172450 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ad5fb7-fdfc-477f-9d50-a81b0f17f3f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:32.173773 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ad5fb7-fdfc-477f-9d50-a81b0f17f3f3 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:32.174442 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ad5fb7-fdfc-477f-9d50-a81b0f17f3f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:32.175079 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ad5fb7-fdfc-477f-9d50-a81b0f17f3f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:32.176118 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ad5fb7-fdfc-477f-9d50-a81b0f17f3f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:32.177973 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ad5fb7-fdfc-477f-9d50-a81b0f17f3f3 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:32.191241 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3414/6865] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:35:32 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:35:32.196175 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8a5cad-390f-4dcc-a563-80cfbe66ec3e admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:32.209742 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8a5cad-390f-4dcc-a563-80cfbe66ec3e admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:32.215540 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60118c5-2d44-4b24-b565-dd64a7f2b70f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:32.216349 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60118c5-2d44-4b24-b565-dd64a7f2b70f admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:32.216630 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60118c5-2d44-4b24-b565-dd64a7f2b70f admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:32.217135 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60118c5-2d44-4b24-b565-dd64a7f2b70f admin admin] PATH_INFO: `/v3/projects/ba6897c63e074c32ab547ea52f81048f/users/0aaa7ff6b183446c856d821b9e30a1fd/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:32.220157 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60118c5-2d44-4b24-b565-dd64a7f2b70f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba6897c63e074c32ab547ea52f81048f, user_id=0aaa7ff6b183446c856d821b9e30a1fd, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:32.223682 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60118c5-2d44-4b24-b565-dd64a7f2b70f admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:32.245705 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3452/6866] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:35:32 2022] PUT /identity/v3/projects/ba6897c63e074c32ab547ea52f81048f/users/0aaa7ff6b183446c856d821b9e30a1fd/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:35:32.248032 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106dd166-8f03-47ba-b984-21bc72f0d8af None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:32.248246 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106dd166-8f03-47ba-b984-21bc72f0d8af None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:32.248420 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106dd166-8f03-47ba-b984-21bc72f0d8af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:32.279736 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-106dd166-8f03-47ba-b984-21bc72f0d8af None None] MFA Rules not processed for user `0aaa7ff6b183446c856d821b9e30a1fd`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:35:32.280974 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-106dd166-8f03-47ba-b984-21bc72f0d8af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:32.323485 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60118c5-2d44-4b24-b565-dd64a7f2b70f admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:32.326735 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:35:32.329702 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-d60118c5-2d44-4b24-b565-dd64a7f2b70f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:32.378264 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3415/6867] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:35:32 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:35:32.390603 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106dd166-8f03-47ba-b984-21bc72f0d8af None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:32.392470 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-106dd166-8f03-47ba-b984-21bc72f0d8af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:32.458493 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60118c5-2d44-4b24-b565-dd64a7f2b70f admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:32.464394 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aba0c15-15b3-42cf-b990-830d4eb0fb8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:32.465627 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aba0c15-15b3-42cf-b990-830d4eb0fb8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:32.466047 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aba0c15-15b3-42cf-b990-830d4eb0fb8c admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:32.466566 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aba0c15-15b3-42cf-b990-830d4eb0fb8c admin admin] PATH_INFO: `/v3/projects/ef0c04895d2c42c483e829b1abe82547` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:32.468671 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aba0c15-15b3-42cf-b990-830d4eb0fb8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef0c04895d2c42c483e829b1abe82547)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:32.471729 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aba0c15-15b3-42cf-b990-830d4eb0fb8c admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:32.485030 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:35:32.493425 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106dd166-8f03-47ba-b984-21bc72f0d8af None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:32.501030 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3610ea-4226-4950-b150-eb5ce28e30bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:32.503737 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3610ea-4226-4950-b150-eb5ce28e30bc service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:32.504215 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3610ea-4226-4950-b150-eb5ce28e30bc service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:32.504649 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3610ea-4226-4950-b150-eb5ce28e30bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:32.522293 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3610ea-4226-4950-b150-eb5ce28e30bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:32.524456 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3610ea-4226-4950-b150-eb5ce28e30bc service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:32.538083 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-4aba0c15-15b3-42cf-b990-830d4eb0fb8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef0c04895d2c42c483e829b1abe82547', 'request_id': 'req-4aba0c15-15b3-42cf-b990-830d4eb0fb8c'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:32.540486 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3416/6868] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:35:32 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:35:32.548500 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-4aba0c15-15b3-42cf-b990-830d4eb0fb8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef0c04895d2c42c483e829b1abe82547', 'request_id': 'req-4aba0c15-15b3-42cf-b990-830d4eb0fb8c'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:32.555561 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-4aba0c15-15b3-42cf-b990-830d4eb0fb8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef0c04895d2c42c483e829b1abe82547', 'request_id': 'req-4aba0c15-15b3-42cf-b990-830d4eb0fb8c'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:32.568294 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-4aba0c15-15b3-42cf-b990-830d4eb0fb8c admin admin] The token cache is being invalidate because project ef0c04895d2c42c483e829b1abe82547 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:35:32.568587 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-4aba0c15-15b3-42cf-b990-830d4eb0fb8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:32.569296 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-4aba0c15-15b3-42cf-b990-830d4eb0fb8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:32.571097 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3453/6869] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:35:32 2022] DELETE /identity/v3/projects/ef0c04895d2c42c483e829b1abe82547 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:35:32.576592 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cf16ac-34d5-4960-a7bd-7d6b800ab2ac None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:32.577041 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cf16ac-34d5-4960-a7bd-7d6b800ab2ac None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:32.577422 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cf16ac-34d5-4960-a7bd-7d6b800ab2ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:32.601401 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-c0cf16ac-34d5-4960-a7bd-7d6b800ab2ac None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:35:32.602994 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-c0cf16ac-34d5-4960-a7bd-7d6b800ab2ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:32.679767 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3417/6870] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:35:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:35:32.688893 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8af825c-4cb5-45aa-aaae-5ac9407cc8f0 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:32.689321 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8af825c-4cb5-45aa-aaae-5ac9407cc8f0 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:32.689721 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8af825c-4cb5-45aa-aaae-5ac9407cc8f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:32.712138 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-f8af825c-4cb5-45aa-aaae-5ac9407cc8f0 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:35:32.713897 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-f8af825c-4cb5-45aa-aaae-5ac9407cc8f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:32.724533 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3454/6871] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:35:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:35:32.729504 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cf16ac-34d5-4960-a7bd-7d6b800ab2ac None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:32.741214 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cf16ac-34d5-4960-a7bd-7d6b800ab2ac None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:32.747141 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553f73bc-8133-4b0c-bc66-65f4e9e6c998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:32.748198 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553f73bc-8133-4b0c-bc66-65f4e9e6c998 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:32.753733 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553f73bc-8133-4b0c-bc66-65f4e9e6c998 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:32.754741 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553f73bc-8133-4b0c-bc66-65f4e9e6c998 admin admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:32.757349 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553f73bc-8133-4b0c-bc66-65f4e9e6c998 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:35:32.757923 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553f73bc-8133-4b0c-bc66-65f4e9e6c998 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:32.760437 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553f73bc-8133-4b0c-bc66-65f4e9e6c998 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:32.778269 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3418/6872] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:35:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:35:32.782491 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8af825c-4cb5-45aa-aaae-5ac9407cc8f0 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:32.795179 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8af825c-4cb5-45aa-aaae-5ac9407cc8f0 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:32.802916 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4efebc-3d39-4530-858c-83f4e990b81a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:32.804070 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4efebc-3d39-4530-858c-83f4e990b81a admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:32.804482 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4efebc-3d39-4530-858c-83f4e990b81a admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:32.804832 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4efebc-3d39-4530-858c-83f4e990b81a admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:32.806527 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4efebc-3d39-4530-858c-83f4e990b81a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:32.808757 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4efebc-3d39-4530-858c-83f4e990b81a admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:32.861613 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3455/6873] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:35:32 2022] POST /identity/v3/projects => generated 375 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:35:32.866147 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553f73bc-8133-4b0c-bc66-65f4e9e6c998 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:32.882184 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553f73bc-8133-4b0c-bc66-65f4e9e6c998 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:32.998021 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9244bb-ffeb-4a15-b49d-8ef90329162b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:32.999096 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9244bb-ffeb-4a15-b49d-8ef90329162b admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:32.999379 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9244bb-ffeb-4a15-b49d-8ef90329162b admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:33.000716 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9244bb-ffeb-4a15-b49d-8ef90329162b admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:33.001499 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9244bb-ffeb-4a15-b49d-8ef90329162b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:33.005499 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9244bb-ffeb-4a15-b49d-8ef90329162b admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:33.025720 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:35:33.041538 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3419/6874] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:35:32 2022] POST /identity/v3/users => generated 288 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:35:33.042439 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4efebc-3d39-4530-858c-83f4e990b81a admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:33.068957 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4efebc-3d39-4530-858c-83f4e990b81a admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:33.085637 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64bb955-b6f9-44f1-809b-94c6f6f8732c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:33.086363 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64bb955-b6f9-44f1-809b-94c6f6f8732c admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:33.086642 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64bb955-b6f9-44f1-809b-94c6f6f8732c admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:33.086910 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64bb955-b6f9-44f1-809b-94c6f6f8732c admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:33.087759 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64bb955-b6f9-44f1-809b-94c6f6f8732c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:33.089364 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64bb955-b6f9-44f1-809b-94c6f6f8732c admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:33.105988 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3456/6875] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:35:33 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 21:35:33.106891 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9244bb-ffeb-4a15-b49d-8ef90329162b admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:33.122051 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9244bb-ffeb-4a15-b49d-8ef90329162b admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:33.131679 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc1caa5-5416-4da8-aab6-de8a9e68f6db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:33.132372 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc1caa5-5416-4da8-aab6-de8a9e68f6db admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:33.132651 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc1caa5-5416-4da8-aab6-de8a9e68f6db admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:33.132918 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc1caa5-5416-4da8-aab6-de8a9e68f6db admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:33.133647 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc1caa5-5416-4da8-aab6-de8a9e68f6db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:33.135296 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc1caa5-5416-4da8-aab6-de8a9e68f6db admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:33.165520 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3420/6876] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:35:33 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:35:33.169581 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64bb955-b6f9-44f1-809b-94c6f6f8732c admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:33.185755 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64bb955-b6f9-44f1-809b-94c6f6f8732c admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:33.197891 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef7fcf4-9c05-42b1-8113-eca068686b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:33.198804 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef7fcf4-9c05-42b1-8113-eca068686b52 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:33.199080 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef7fcf4-9c05-42b1-8113-eca068686b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:33.199346 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef7fcf4-9c05-42b1-8113-eca068686b52 admin admin] PATH_INFO: `/v3/projects/dfb09e74f3414fa09d491d60f91dd516/users/f9b72d11bd054f23b718e08c34f49516/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:33.227192 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef7fcf4-9c05-42b1-8113-eca068686b52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfb09e74f3414fa09d491d60f91dd516, user_id=f9b72d11bd054f23b718e08c34f49516, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:33.230105 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef7fcf4-9c05-42b1-8113-eca068686b52 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:33.261894 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3457/6877] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:35:33 2022] PUT /identity/v3/projects/dfb09e74f3414fa09d491d60f91dd516/users/f9b72d11bd054f23b718e08c34f49516/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:35:33.366007 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e56049-8578-4dd3-993d-9f68a82e14a9 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:33.366316 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e56049-8578-4dd3-993d-9f68a82e14a9 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:33.367480 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e56049-8578-4dd3-993d-9f68a82e14a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:33.399473 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-d8e56049-8578-4dd3-993d-9f68a82e14a9 None None] MFA Rules not processed for user `f9b72d11bd054f23b718e08c34f49516`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:35:33.400805 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-d8e56049-8578-4dd3-993d-9f68a82e14a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:33.495390 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3421/6878] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:35:33 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:35:33.500012 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef7fcf4-9c05-42b1-8113-eca068686b52 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:33.597686 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef7fcf4-9c05-42b1-8113-eca068686b52 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:33.606532 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546bbd92-95ac-4953-b86e-3e545a89f85f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:33.607728 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546bbd92-95ac-4953-b86e-3e545a89f85f admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:33.608196 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546bbd92-95ac-4953-b86e-3e545a89f85f admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:33.608723 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546bbd92-95ac-4953-b86e-3e545a89f85f admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:33.609537 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546bbd92-95ac-4953-b86e-3e545a89f85f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:33.611631 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546bbd92-95ac-4953-b86e-3e545a89f85f admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:33.653308 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e56049-8578-4dd3-993d-9f68a82e14a9 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:33.665022 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3458/6879] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:35:33 2022] POST /identity/v3/projects => generated 375 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:35:33.667677 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e56049-8578-4dd3-993d-9f68a82e14a9 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:33.749506 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0191f9-9441-4b1a-bd45-b08338e2d50c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:33.750438 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0191f9-9441-4b1a-bd45-b08338e2d50c admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:33.750831 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0191f9-9441-4b1a-bd45-b08338e2d50c admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:33.751174 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0191f9-9441-4b1a-bd45-b08338e2d50c admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:33.751973 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0191f9-9441-4b1a-bd45-b08338e2d50c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:33.754242 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0191f9-9441-4b1a-bd45-b08338e2d50c admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:33.786461 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546bbd92-95ac-4953-b86e-3e545a89f85f admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:33.787936 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3422/6880] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:35:33 2022] POST /identity/v3/users => generated 294 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:35:33.800948 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546bbd92-95ac-4953-b86e-3e545a89f85f admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:33.806895 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45100534-175b-465f-b167-bdccc7a9b3ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:33.808095 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45100534-175b-465f-b167-bdccc7a9b3ef admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:33.808647 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45100534-175b-465f-b167-bdccc7a9b3ef admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:33.810256 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45100534-175b-465f-b167-bdccc7a9b3ef admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:33.811903 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45100534-175b-465f-b167-bdccc7a9b3ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:33.813956 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45100534-175b-465f-b167-bdccc7a9b3ef admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:33.834630 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3459/6881] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:35:33 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:35:33.838675 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0191f9-9441-4b1a-bd45-b08338e2d50c admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:33.867086 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0191f9-9441-4b1a-bd45-b08338e2d50c admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:33.875407 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ad3854-a495-4cfc-864f-3a3a2fe39de4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:33.877368 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ad3854-a495-4cfc-864f-3a3a2fe39de4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:33.878354 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ad3854-a495-4cfc-864f-3a3a2fe39de4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:33.878552 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ad3854-a495-4cfc-864f-3a3a2fe39de4 admin admin] PATH_INFO: `/v3/projects/8b197b142dbb4982ae56f6993d082f39/users/60ae551f45a34ab5b145e5ae42eb39b8/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:33.903809 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ad3854-a495-4cfc-864f-3a3a2fe39de4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b197b142dbb4982ae56f6993d082f39, user_id=60ae551f45a34ab5b145e5ae42eb39b8, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:33.907683 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ad3854-a495-4cfc-864f-3a3a2fe39de4 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:33.929608 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3423/6882] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:35:33 2022] PUT /identity/v3/projects/8b197b142dbb4982ae56f6993d082f39/users/60ae551f45a34ab5b145e5ae42eb39b8/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:35:33.934457 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45100534-175b-465f-b167-bdccc7a9b3ef admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:33.953011 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45100534-175b-465f-b167-bdccc7a9b3ef admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:33.960872 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:35:34.056383 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7a7c6f-584b-40e2-adbe-68859e318fdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:34.058783 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7a7c6f-584b-40e2-adbe-68859e318fdb admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:34.059078 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7a7c6f-584b-40e2-adbe-68859e318fdb admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:34.059359 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7a7c6f-584b-40e2-adbe-68859e318fdb admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:34.060311 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7a7c6f-584b-40e2-adbe-68859e318fdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:34.062280 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7a7c6f-584b-40e2-adbe-68859e318fdb admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:34.103832 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3460/6883] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:35:33 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:35:34.116383 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ad3854-a495-4cfc-864f-3a3a2fe39de4 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:34.140903 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ad3854-a495-4cfc-864f-3a3a2fe39de4 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:34.147167 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deeb681-1c72-4bb5-b0b5-c9b4079888db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:34.148300 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deeb681-1c72-4bb5-b0b5-c9b4079888db admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:34.148577 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deeb681-1c72-4bb5-b0b5-c9b4079888db admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:34.148844 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deeb681-1c72-4bb5-b0b5-c9b4079888db admin admin] PATH_INFO: `/v3/projects/8b197b142dbb4982ae56f6993d082f39/users/60ae551f45a34ab5b145e5ae42eb39b8/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:34.154726 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5deeb681-1c72-4bb5-b0b5-c9b4079888db admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b197b142dbb4982ae56f6993d082f39, user_id=60ae551f45a34ab5b145e5ae42eb39b8, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:34.162167 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5deeb681-1c72-4bb5-b0b5-c9b4079888db admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:34.183808 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3424/6884] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:35:34 2022] PUT /identity/v3/projects/8b197b142dbb4982ae56f6993d082f39/users/60ae551f45a34ab5b145e5ae42eb39b8/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:35:34.193884 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41bf9e5-5091-44c8-bef2-4e3e3078b626 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:34.194373 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41bf9e5-5091-44c8-bef2-4e3e3078b626 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:34.194657 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41bf9e5-5091-44c8-bef2-4e3e3078b626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:34.242592 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-f41bf9e5-5091-44c8-bef2-4e3e3078b626 None None] MFA Rules not processed for user `60ae551f45a34ab5b145e5ae42eb39b8`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:35:34.244792 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-f41bf9e5-5091-44c8-bef2-4e3e3078b626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:34.370342 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3461/6885] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:35:34 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:35:34.466282 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deeb681-1c72-4bb5-b0b5-c9b4079888db admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:34.469579 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-5deeb681-1c72-4bb5-b0b5-c9b4079888db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:34.529944 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:35:34.589680 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deeb681-1c72-4bb5-b0b5-c9b4079888db admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:34.596577 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d23d0f-c51c-41ed-a690-5e589ec3e337 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:34.598019 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d23d0f-c51c-41ed-a690-5e589ec3e337 service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:34.598408 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d23d0f-c51c-41ed-a690-5e589ec3e337 service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:34.598771 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d23d0f-c51c-41ed-a690-5e589ec3e337 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:34.613326 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d23d0f-c51c-41ed-a690-5e589ec3e337 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:34.616482 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d23d0f-c51c-41ed-a690-5e589ec3e337 service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:34.629258 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3425/6886] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:35:34 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 23 21:35:36.226811 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41bf9e5-5091-44c8-bef2-4e3e3078b626 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:36.228285 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-f41bf9e5-5091-44c8-bef2-4e3e3078b626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:36.342628 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41bf9e5-5091-44c8-bef2-4e3e3078b626 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:36.350384 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8853b4ad-6575-4417-a9fe-4b917d8730fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:36.351358 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8853b4ad-6575-4417-a9fe-4b917d8730fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:36.352379 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8853b4ad-6575-4417-a9fe-4b917d8730fb admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:36.353059 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8853b4ad-6575-4417-a9fe-4b917d8730fb admin admin] PATH_INFO: `/v3/users/f9dbadf90a0e4a279f0b010de6f5eeb8` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:36.354973 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8853b4ad-6575-4417-a9fe-4b917d8730fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9dbadf90a0e4a279f0b010de6f5eeb8)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:36.357373 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8853b4ad-6575-4417-a9fe-4b917d8730fb admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:36.437652 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:35:36.475839 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-8853b4ad-6575-4417-a9fe-4b917d8730fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9dbadf90a0e4a279f0b010de6f5eeb8'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:36.476604 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-8853b4ad-6575-4417-a9fe-4b917d8730fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9dbadf90a0e4a279f0b010de6f5eeb8'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:36.488368 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-8853b4ad-6575-4417-a9fe-4b917d8730fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9dbadf90a0e4a279f0b010de6f5eeb8'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:36.503154 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-8853b4ad-6575-4417-a9fe-4b917d8730fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9dbadf90a0e4a279f0b010de6f5eeb8'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:36.541692 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-8853b4ad-6575-4417-a9fe-4b917d8730fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9dbadf90a0e4a279f0b010de6f5eeb8'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:36.558469 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3462/6887] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:35:36 2022] DELETE /identity/v3/users/f9dbadf90a0e4a279f0b010de6f5eeb8 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:35:36.559538 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ec7947-be48-4f17-9812-e198ba2a4ab3 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:36.560051 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ec7947-be48-4f17-9812-e198ba2a4ab3 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:36.560051 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ec7947-be48-4f17-9812-e198ba2a4ab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:36.596437 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-61ec7947-be48-4f17-9812-e198ba2a4ab3 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:35:36.598160 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-61ec7947-be48-4f17-9812-e198ba2a4ab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:36.715294 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3426/6888] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:35:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:35:36.792879 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8853b4ad-6575-4417-a9fe-4b917d8730fb admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:36.793842 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-8853b4ad-6575-4417-a9fe-4b917d8730fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:36.945052 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8853b4ad-6575-4417-a9fe-4b917d8730fb admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:36.954612 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c983143-ca09-41e7-a6e0-b28dc5c1aeb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:36.955728 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c983143-ca09-41e7-a6e0-b28dc5c1aeb4 service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:36.956315 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c983143-ca09-41e7-a6e0-b28dc5c1aeb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:36.956838 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c983143-ca09-41e7-a6e0-b28dc5c1aeb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:36.968463 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c983143-ca09-41e7-a6e0-b28dc5c1aeb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:36.970536 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c983143-ca09-41e7-a6e0-b28dc5c1aeb4 service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:36.987365 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3463/6889] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:35:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:35:37.008850 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ec7947-be48-4f17-9812-e198ba2a4ab3 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:37.010990 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-61ec7947-be48-4f17-9812-e198ba2a4ab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:37.031628 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ec7947-be48-4f17-9812-e198ba2a4ab3 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:37.038592 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbc926f-8fbf-4be8-a1f3-7058b7787083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:37.039974 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbc926f-8fbf-4be8-a1f3-7058b7787083 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:37.040534 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbc926f-8fbf-4be8-a1f3-7058b7787083 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:37.041017 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbc926f-8fbf-4be8-a1f3-7058b7787083 admin admin] PATH_INFO: `/v3/users/767bb57fb3d04e35bc7fc63506852f26` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:37.043334 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbc926f-8fbf-4be8-a1f3-7058b7787083 admin admin] RBAC: Authorizing `identity:delete_user(user_id=767bb57fb3d04e35bc7fc63506852f26)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:37.065564 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbc926f-8fbf-4be8-a1f3-7058b7787083 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:37.193370 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-1cbc926f-8fbf-4be8-a1f3-7058b7787083 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '767bb57fb3d04e35bc7fc63506852f26'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:37.217383 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-1cbc926f-8fbf-4be8-a1f3-7058b7787083 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '767bb57fb3d04e35bc7fc63506852f26'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:37.218317 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-1cbc926f-8fbf-4be8-a1f3-7058b7787083 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '767bb57fb3d04e35bc7fc63506852f26'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:37.234508 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-1cbc926f-8fbf-4be8-a1f3-7058b7787083 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '767bb57fb3d04e35bc7fc63506852f26'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:37.262755 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-1cbc926f-8fbf-4be8-a1f3-7058b7787083 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '767bb57fb3d04e35bc7fc63506852f26'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:37.285537 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917126b4-9852-4561-ac8b-cd450472f164 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:37.285537 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917126b4-9852-4561-ac8b-cd450472f164 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:37.285537 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917126b4-9852-4561-ac8b-cd450472f164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:37.286296 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3427/6890] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:35:37 2022] DELETE /identity/v3/users/767bb57fb3d04e35bc7fc63506852f26 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:35:37.316175 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-917126b4-9852-4561-ac8b-cd450472f164 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:35:37.317677 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-917126b4-9852-4561-ac8b-cd450472f164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:37.422144 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3464/6891] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:35:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:35:37.452232 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbc926f-8fbf-4be8-a1f3-7058b7787083 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:37.458445 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-1cbc926f-8fbf-4be8-a1f3-7058b7787083 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:37.599608 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:35:37.623005 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbc926f-8fbf-4be8-a1f3-7058b7787083 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:37.651669 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868ec8ae-36c2-47d1-b9c1-3114f9da2c82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:37.653054 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868ec8ae-36c2-47d1-b9c1-3114f9da2c82 service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:37.653901 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868ec8ae-36c2-47d1-b9c1-3114f9da2c82 service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:37.654371 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868ec8ae-36c2-47d1-b9c1-3114f9da2c82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:37.680729 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868ec8ae-36c2-47d1-b9c1-3114f9da2c82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:37.682335 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868ec8ae-36c2-47d1-b9c1-3114f9da2c82 service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:37.697913 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3428/6892] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:35:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:35:38.036949 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917126b4-9852-4561-ac8b-cd450472f164 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:38.038528 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-917126b4-9852-4561-ac8b-cd450472f164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:38.051396 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917126b4-9852-4561-ac8b-cd450472f164 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:38.057159 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51fa5ba-f0e5-44ed-b553-484e6a6ac9fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:38.058133 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51fa5ba-f0e5-44ed-b553-484e6a6ac9fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:38.058526 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51fa5ba-f0e5-44ed-b553-484e6a6ac9fa admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:38.058804 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51fa5ba-f0e5-44ed-b553-484e6a6ac9fa admin admin] PATH_INFO: `/v3/projects/8a647900b2d1491e82863e6d23a26587` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:38.060132 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51fa5ba-f0e5-44ed-b553-484e6a6ac9fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a647900b2d1491e82863e6d23a26587)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:38.062196 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51fa5ba-f0e5-44ed-b553-484e6a6ac9fa admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:38.119851 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:35:38.122007 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-b51fa5ba-f0e5-44ed-b553-484e6a6ac9fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a647900b2d1491e82863e6d23a26587', 'request_id': 'req-b51fa5ba-f0e5-44ed-b553-484e6a6ac9fa'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:38.133754 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-b51fa5ba-f0e5-44ed-b553-484e6a6ac9fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a647900b2d1491e82863e6d23a26587', 'request_id': 'req-b51fa5ba-f0e5-44ed-b553-484e6a6ac9fa'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:38.141690 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-b51fa5ba-f0e5-44ed-b553-484e6a6ac9fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a647900b2d1491e82863e6d23a26587', 'request_id': 'req-b51fa5ba-f0e5-44ed-b553-484e6a6ac9fa'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:38.154325 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-b51fa5ba-f0e5-44ed-b553-484e6a6ac9fa admin admin] The token cache is being invalidate because project 8a647900b2d1491e82863e6d23a26587 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:35:38.154325 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-b51fa5ba-f0e5-44ed-b553-484e6a6ac9fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:38.154854 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-b51fa5ba-f0e5-44ed-b553-484e6a6ac9fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:38.159534 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3465/6893] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:35:38 2022] DELETE /identity/v3/projects/8a647900b2d1491e82863e6d23a26587 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:35:38.160798 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868ec8ae-36c2-47d1-b9c1-3114f9da2c82 service neutron] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:38.171041 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868ec8ae-36c2-47d1-b9c1-3114f9da2c82 service neutron] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:38.201812 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51fa5ba-f0e5-44ed-b553-484e6a6ac9fa admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:38.203659 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-b51fa5ba-f0e5-44ed-b553-484e6a6ac9fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:38.269699 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46442b37-7a92-426b-99fa-31e2ac9e74cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:38.270813 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46442b37-7a92-426b-99fa-31e2ac9e74cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:38.271096 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46442b37-7a92-426b-99fa-31e2ac9e74cb admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:38.271439 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46442b37-7a92-426b-99fa-31e2ac9e74cb admin admin] PATH_INFO: `/v3/users/0aaa7ff6b183446c856d821b9e30a1fd` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:38.286478 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46442b37-7a92-426b-99fa-31e2ac9e74cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=0aaa7ff6b183446c856d821b9e30a1fd)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:38.288757 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46442b37-7a92-426b-99fa-31e2ac9e74cb admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:38.323702 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51fa5ba-f0e5-44ed-b553-484e6a6ac9fa admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:38.329909 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49722c92-5449-49bd-b5b5-f49281df9bb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:38.330802 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49722c92-5449-49bd-b5b5-f49281df9bb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:38.331589 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49722c92-5449-49bd-b5b5-f49281df9bb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:38.331789 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49722c92-5449-49bd-b5b5-f49281df9bb7 admin admin] PATH_INFO: `/v3/users/f9b72d11bd054f23b718e08c34f49516` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:38.333282 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49722c92-5449-49bd-b5b5-f49281df9bb7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9b72d11bd054f23b718e08c34f49516)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:38.335566 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49722c92-5449-49bd-b5b5-f49281df9bb7 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:38.355075 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-46442b37-7a92-426b-99fa-31e2ac9e74cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0aaa7ff6b183446c856d821b9e30a1fd'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:38.362737 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-46442b37-7a92-426b-99fa-31e2ac9e74cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0aaa7ff6b183446c856d821b9e30a1fd'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:38.363612 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-46442b37-7a92-426b-99fa-31e2ac9e74cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0aaa7ff6b183446c856d821b9e30a1fd'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:38.375549 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-46442b37-7a92-426b-99fa-31e2ac9e74cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0aaa7ff6b183446c856d821b9e30a1fd'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:38.391097 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-46442b37-7a92-426b-99fa-31e2ac9e74cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0aaa7ff6b183446c856d821b9e30a1fd'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:38.398881 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-49722c92-5449-49bd-b5b5-f49281df9bb7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9b72d11bd054f23b718e08c34f49516'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:38.399477 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3429/6894] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:35:38 2022] DELETE /identity/v3/users/0aaa7ff6b183446c856d821b9e30a1fd => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:35:38.400508 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46442b37-7a92-426b-99fa-31e2ac9e74cb admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:38.402022 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-46442b37-7a92-426b-99fa-31e2ac9e74cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:38.402712 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-49722c92-5449-49bd-b5b5-f49281df9bb7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9b72d11bd054f23b718e08c34f49516'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:38.411398 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-49722c92-5449-49bd-b5b5-f49281df9bb7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9b72d11bd054f23b718e08c34f49516'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:38.429505 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-49722c92-5449-49bd-b5b5-f49281df9bb7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9b72d11bd054f23b718e08c34f49516'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:38.447808 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-49722c92-5449-49bd-b5b5-f49281df9bb7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9b72d11bd054f23b718e08c34f49516'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:38.457913 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3466/6895] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:35:38 2022] DELETE /identity/v3/users/f9b72d11bd054f23b718e08c34f49516 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:35:38.462468 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa15e80-5832-4fa8-88f7-09c25aa95b7a None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:38.462957 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa15e80-5832-4fa8-88f7-09c25aa95b7a None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:38.463692 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa15e80-5832-4fa8-88f7-09c25aa95b7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:38.498812 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-caa15e80-5832-4fa8-88f7-09c25aa95b7a None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:35:38.501502 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-caa15e80-5832-4fa8-88f7-09c25aa95b7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:38.510439 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46442b37-7a92-426b-99fa-31e2ac9e74cb admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:38.522713 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:35:38.581184 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:35:38.599208 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a126e4b-6c0f-4a6e-a6bc-3a790e2db434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:38.602115 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a126e4b-6c0f-4a6e-a6bc-3a790e2db434 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:38.603022 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a126e4b-6c0f-4a6e-a6bc-3a790e2db434 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:38.603463 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a126e4b-6c0f-4a6e-a6bc-3a790e2db434 admin admin] PATH_INFO: `/v3/projects/8d861a3383614f2c8dc8f42d7faea471` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:38.604066 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3467/6896] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:35:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:35:38.605401 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a126e4b-6c0f-4a6e-a6bc-3a790e2db434 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d861a3383614f2c8dc8f42d7faea471)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:38.608594 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a126e4b-6c0f-4a6e-a6bc-3a790e2db434 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:38.615931 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa15e80-5832-4fa8-88f7-09c25aa95b7a None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:38.618232 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-caa15e80-5832-4fa8-88f7-09c25aa95b7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:38.705817 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa15e80-5832-4fa8-88f7-09c25aa95b7a None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:38.706782 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-6a126e4b-6c0f-4a6e-a6bc-3a790e2db434 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d861a3383614f2c8dc8f42d7faea471', 'request_id': 'req-6a126e4b-6c0f-4a6e-a6bc-3a790e2db434'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:38.721772 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-6a126e4b-6c0f-4a6e-a6bc-3a790e2db434 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d861a3383614f2c8dc8f42d7faea471', 'request_id': 'req-6a126e4b-6c0f-4a6e-a6bc-3a790e2db434'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:38.734463 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-6a126e4b-6c0f-4a6e-a6bc-3a790e2db434 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d861a3383614f2c8dc8f42d7faea471', 'request_id': 'req-6a126e4b-6c0f-4a6e-a6bc-3a790e2db434'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:38.749523 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-6a126e4b-6c0f-4a6e-a6bc-3a790e2db434 admin admin] The token cache is being invalidate because project 8d861a3383614f2c8dc8f42d7faea471 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:35:38.749897 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-6a126e4b-6c0f-4a6e-a6bc-3a790e2db434 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:38.750607 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-6a126e4b-6c0f-4a6e-a6bc-3a790e2db434 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:38.753789 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3430/6897] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:35:38 2022] DELETE /identity/v3/projects/8d861a3383614f2c8dc8f42d7faea471 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:35:38.759240 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3159d661-56b2-435c-a5da-52b7c585c353 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:38.759650 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3159d661-56b2-435c-a5da-52b7c585c353 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:38.760372 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3159d661-56b2-435c-a5da-52b7c585c353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:38.777585 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4147239b-27ca-4ec4-bfec-1edf84f73476 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:38.778784 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4147239b-27ca-4ec4-bfec-1edf84f73476 service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:38.779251 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4147239b-27ca-4ec4-bfec-1edf84f73476 service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:38.779698 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4147239b-27ca-4ec4-bfec-1edf84f73476 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:38.788016 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-3159d661-56b2-435c-a5da-52b7c585c353 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:35:38.790724 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-4147239b-27ca-4ec4-bfec-1edf84f73476 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:38.792724 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-3159d661-56b2-435c-a5da-52b7c585c353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:38.897597 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4147239b-27ca-4ec4-bfec-1edf84f73476 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:38.899233 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4147239b-27ca-4ec4-bfec-1edf84f73476 service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:38.910920 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3468/6898] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:35:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 23 21:35:38.935838 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3431/6899] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:35:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:35:38.943679 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fe6b3a-30bd-43a1-a794-23d586ac9db5 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:38.943999 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fe6b3a-30bd-43a1-a794-23d586ac9db5 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:38.944289 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fe6b3a-30bd-43a1-a794-23d586ac9db5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:38.952770 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3159d661-56b2-435c-a5da-52b7c585c353 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:38.954625 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-3159d661-56b2-435c-a5da-52b7c585c353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:38.980965 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-c8fe6b3a-30bd-43a1-a794-23d586ac9db5 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:35:38.982382 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-c8fe6b3a-30bd-43a1-a794-23d586ac9db5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:39.003567 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3469/6900] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:35:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:35:39.007807 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fe6b3a-30bd-43a1-a794-23d586ac9db5 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:39.019056 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3159d661-56b2-435c-a5da-52b7c585c353 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:39.024662 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fe6b3a-30bd-43a1-a794-23d586ac9db5 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:39.029406 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cee6322-f8cb-48b5-9dcf-6ea88c5473a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:39.032222 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cee6322-f8cb-48b5-9dcf-6ea88c5473a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:39.032736 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cee6322-f8cb-48b5-9dcf-6ea88c5473a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:39.033207 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cee6322-f8cb-48b5-9dcf-6ea88c5473a2 admin admin] PATH_INFO: `/v3/projects/ba6897c63e074c32ab547ea52f81048f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:39.035823 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cee6322-f8cb-48b5-9dcf-6ea88c5473a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba6897c63e074c32ab547ea52f81048f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:39.037624 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afbcfc3-2fbd-4496-a2af-c221cc82a54d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:39.038497 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afbcfc3-2fbd-4496-a2af-c221cc82a54d admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:39.038693 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cee6322-f8cb-48b5-9dcf-6ea88c5473a2 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:39.038829 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afbcfc3-2fbd-4496-a2af-c221cc82a54d admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:39.039089 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afbcfc3-2fbd-4496-a2af-c221cc82a54d admin admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:39.039843 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afbcfc3-2fbd-4496-a2af-c221cc82a54d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:35:39.040149 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afbcfc3-2fbd-4496-a2af-c221cc82a54d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:39.041774 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afbcfc3-2fbd-4496-a2af-c221cc82a54d admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:39.077992 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3470/6901] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:35:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:35:39.083221 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afbcfc3-2fbd-4496-a2af-c221cc82a54d admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:39.102548 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afbcfc3-2fbd-4496-a2af-c221cc82a54d admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:39.117499 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:35:39.156876 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-0cee6322-f8cb-48b5-9dcf-6ea88c5473a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba6897c63e074c32ab547ea52f81048f', 'request_id': 'req-0cee6322-f8cb-48b5-9dcf-6ea88c5473a2'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:39.184531 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-0cee6322-f8cb-48b5-9dcf-6ea88c5473a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba6897c63e074c32ab547ea52f81048f', 'request_id': 'req-0cee6322-f8cb-48b5-9dcf-6ea88c5473a2'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:39.201241 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-0cee6322-f8cb-48b5-9dcf-6ea88c5473a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba6897c63e074c32ab547ea52f81048f', 'request_id': 'req-0cee6322-f8cb-48b5-9dcf-6ea88c5473a2'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:39.228073 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:35:39.233745 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-0cee6322-f8cb-48b5-9dcf-6ea88c5473a2 admin admin] The token cache is being invalidate because project ba6897c63e074c32ab547ea52f81048f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:35:39.234354 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-0cee6322-f8cb-48b5-9dcf-6ea88c5473a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:39.236393 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-0cee6322-f8cb-48b5-9dcf-6ea88c5473a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:39.250192 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3432/6902] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:35:38 2022] DELETE /identity/v3/projects/ba6897c63e074c32ab547ea52f81048f => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:35:39.252390 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f3f8b7-a24f-48f7-ad5d-a93e95183b8c None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:39.253005 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f3f8b7-a24f-48f7-ad5d-a93e95183b8c None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:39.253742 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f3f8b7-a24f-48f7-ad5d-a93e95183b8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:39.279234 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67261f2-6b4c-4b28-a22a-c9127323d9fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:39.280218 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67261f2-6b4c-4b28-a22a-c9127323d9fc admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:39.280662 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67261f2-6b4c-4b28-a22a-c9127323d9fc admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:39.281094 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67261f2-6b4c-4b28-a22a-c9127323d9fc admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:39.282145 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67261f2-6b4c-4b28-a22a-c9127323d9fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:39.285259 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67261f2-6b4c-4b28-a22a-c9127323d9fc admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:39.305918 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-09f3f8b7-a24f-48f7-ad5d-a93e95183b8c None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:35:39.307287 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-09f3f8b7-a24f-48f7-ad5d-a93e95183b8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:39.332000 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3433/6903] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:35:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:35:39.340872 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3471/6904] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:35:39 2022] POST /identity/v3/projects => generated 375 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:35:39.344045 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecb45b0-aa9f-4759-8c31-2d3833936d63 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:39.344045 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecb45b0-aa9f-4759-8c31-2d3833936d63 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:39.344045 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecb45b0-aa9f-4759-8c31-2d3833936d63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:39.345974 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67261f2-6b4c-4b28-a22a-c9127323d9fc admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:39.348806 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-d67261f2-6b4c-4b28-a22a-c9127323d9fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:39.385411 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-0ecb45b0-aa9f-4759-8c31-2d3833936d63 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:35:39.386831 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-0ecb45b0-aa9f-4759-8c31-2d3833936d63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:39.426160 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67261f2-6b4c-4b28-a22a-c9127323d9fc admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:39.432808 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1ab28a-5a88-4baf-9a90-f56132f5ed91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:39.434282 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1ab28a-5a88-4baf-9a90-f56132f5ed91 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:39.435158 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1ab28a-5a88-4baf-9a90-f56132f5ed91 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:39.435308 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1ab28a-5a88-4baf-9a90-f56132f5ed91 admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:39.436126 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1ab28a-5a88-4baf-9a90-f56132f5ed91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:39.439127 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1ab28a-5a88-4baf-9a90-f56132f5ed91 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:39.470662 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3472/6905] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:35:39 2022] POST /identity/v3/users => generated 288 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:35:39.477291 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1ab28a-5a88-4baf-9a90-f56132f5ed91 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:39.503331 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1ab28a-5a88-4baf-9a90-f56132f5ed91 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:39.520804 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b4e76f-7adf-4e9e-880f-793be590bfb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:39.521652 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b4e76f-7adf-4e9e-880f-793be590bfb3 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:39.522005 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b4e76f-7adf-4e9e-880f-793be590bfb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:39.522315 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b4e76f-7adf-4e9e-880f-793be590bfb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:39.523048 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b4e76f-7adf-4e9e-880f-793be590bfb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:39.524778 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b4e76f-7adf-4e9e-880f-793be590bfb3 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:39.531142 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3434/6906] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:35:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:35:39.536350 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecb45b0-aa9f-4759-8c31-2d3833936d63 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:39.564158 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3473/6907] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:35:39 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:35:39.565467 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b4e76f-7adf-4e9e-880f-793be590bfb3 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:39.568618 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-49b4e76f-7adf-4e9e-880f-793be590bfb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:39.575397 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecb45b0-aa9f-4759-8c31-2d3833936d63 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:39.583582 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765c2aba-ec1c-4e16-bdb5-e62dcc271d20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:39.584326 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765c2aba-ec1c-4e16-bdb5-e62dcc271d20 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:39.584675 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765c2aba-ec1c-4e16-bdb5-e62dcc271d20 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:39.585101 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765c2aba-ec1c-4e16-bdb5-e62dcc271d20 admin admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:39.587660 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765c2aba-ec1c-4e16-bdb5-e62dcc271d20 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:35:39.588047 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765c2aba-ec1c-4e16-bdb5-e62dcc271d20 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:39.589633 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b4e76f-7adf-4e9e-880f-793be590bfb3 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:39.590104 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765c2aba-ec1c-4e16-bdb5-e62dcc271d20 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:39.595345 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b062a9c-37b8-4e53-9140-6f9d4d1fcc0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:39.596537 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b062a9c-37b8-4e53-9140-6f9d4d1fcc0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:39.597567 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b062a9c-37b8-4e53-9140-6f9d4d1fcc0f admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:39.598729 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b062a9c-37b8-4e53-9140-6f9d4d1fcc0f admin admin] PATH_INFO: `/v3/projects/dfb09e74f3414fa09d491d60f91dd516` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:39.600588 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b062a9c-37b8-4e53-9140-6f9d4d1fcc0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=dfb09e74f3414fa09d491d60f91dd516)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:39.602769 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b062a9c-37b8-4e53-9140-6f9d4d1fcc0f admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:39.606887 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3435/6908] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:35:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:35:39.608275 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765c2aba-ec1c-4e16-bdb5-e62dcc271d20 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:39.622180 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765c2aba-ec1c-4e16-bdb5-e62dcc271d20 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:39.630699 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d68cb7-b062-4d81-b722-0ed02c6ca0b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:39.631542 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d68cb7-b062-4d81-b722-0ed02c6ca0b3 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:39.631899 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d68cb7-b062-4d81-b722-0ed02c6ca0b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:39.632390 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d68cb7-b062-4d81-b722-0ed02c6ca0b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:39.633309 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d68cb7-b062-4d81-b722-0ed02c6ca0b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:39.644224 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d68cb7-b062-4d81-b722-0ed02c6ca0b3 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:39.666547 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-1b062a9c-37b8-4e53-9140-6f9d4d1fcc0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dfb09e74f3414fa09d491d60f91dd516', 'request_id': 'req-1b062a9c-37b8-4e53-9140-6f9d4d1fcc0f'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:39.685525 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3436/6909] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:35:39 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:35:39.686664 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d68cb7-b062-4d81-b722-0ed02c6ca0b3 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:39.700813 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-1b062a9c-37b8-4e53-9140-6f9d4d1fcc0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dfb09e74f3414fa09d491d60f91dd516', 'request_id': 'req-1b062a9c-37b8-4e53-9140-6f9d4d1fcc0f'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:39.711980 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d68cb7-b062-4d81-b722-0ed02c6ca0b3 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:39.712445 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-1b062a9c-37b8-4e53-9140-6f9d4d1fcc0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dfb09e74f3414fa09d491d60f91dd516', 'request_id': 'req-1b062a9c-37b8-4e53-9140-6f9d4d1fcc0f'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:39.728614 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-1b062a9c-37b8-4e53-9140-6f9d4d1fcc0f admin admin] The token cache is being invalidate because project dfb09e74f3414fa09d491d60f91dd516 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:35:39.728949 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-1b062a9c-37b8-4e53-9140-6f9d4d1fcc0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:39.730249 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-1b062a9c-37b8-4e53-9140-6f9d4d1fcc0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:39.735279 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3474/6910] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:35:39 2022] DELETE /identity/v3/projects/dfb09e74f3414fa09d491d60f91dd516 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:35:39.736288 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b062a9c-37b8-4e53-9140-6f9d4d1fcc0f admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:39.738710 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-1b062a9c-37b8-4e53-9140-6f9d4d1fcc0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:39.797047 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:35:39.844464 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186b5727-1a3e-481b-a5b1-5be6b9468e5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:39.846352 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186b5727-1a3e-481b-a5b1-5be6b9468e5c admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:39.846629 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186b5727-1a3e-481b-a5b1-5be6b9468e5c admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:39.847571 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186b5727-1a3e-481b-a5b1-5be6b9468e5c admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:39.849104 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186b5727-1a3e-481b-a5b1-5be6b9468e5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:39.854812 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186b5727-1a3e-481b-a5b1-5be6b9468e5c admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:39.877593 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b062a9c-37b8-4e53-9140-6f9d4d1fcc0f admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:39.888505 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b121d68f-6bfb-4ab4-b17c-73b2803d4ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:39.889799 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b121d68f-6bfb-4ab4-b17c-73b2803d4ad7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:39.889799 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b121d68f-6bfb-4ab4-b17c-73b2803d4ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:39.890100 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b121d68f-6bfb-4ab4-b17c-73b2803d4ad7 admin admin] PATH_INFO: `/v3/projects/6b151c7a88524e86b0ecd780d97aa0ef/users/f9c59dbb77154a4793e0beb2610d026d/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:39.908929 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3437/6911] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:35:39 2022] POST /identity/v3/projects => generated 387 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:35:39.909796 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186b5727-1a3e-481b-a5b1-5be6b9468e5c admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:39.916562 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-186b5727-1a3e-481b-a5b1-5be6b9468e5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:39.924515 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b121d68f-6bfb-4ab4-b17c-73b2803d4ad7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b151c7a88524e86b0ecd780d97aa0ef, user_id=f9c59dbb77154a4793e0beb2610d026d, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:39.926913 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b121d68f-6bfb-4ab4-b17c-73b2803d4ad7 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:39.962039 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3475/6912] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:35:39 2022] PUT /identity/v3/projects/6b151c7a88524e86b0ecd780d97aa0ef/users/f9c59dbb77154a4793e0beb2610d026d/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:35:39.963073 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b121d68f-6bfb-4ab4-b17c-73b2803d4ad7 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:39.965801 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-b121d68f-6bfb-4ab4-b17c-73b2803d4ad7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:39.968919 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:35:40.036238 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186b5727-1a3e-481b-a5b1-5be6b9468e5c admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:40.044529 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b121d68f-6bfb-4ab4-b17c-73b2803d4ad7 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:40.045467 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39be317c-90a9-42a0-8620-7e2edfa9a79b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:40.046407 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39be317c-90a9-42a0-8620-7e2edfa9a79b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:40.046982 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39be317c-90a9-42a0-8620-7e2edfa9a79b admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:40.047369 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39be317c-90a9-42a0-8620-7e2edfa9a79b admin admin] PATH_INFO: `/v3/users/60ae551f45a34ab5b145e5ae42eb39b8` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:40.049796 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39be317c-90a9-42a0-8620-7e2edfa9a79b admin admin] RBAC: Authorizing `identity:delete_user(user_id=60ae551f45a34ab5b145e5ae42eb39b8)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:40.051384 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a7ebad-e428-4c76-b8d0-9bbb364b03ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:40.052066 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a7ebad-e428-4c76-b8d0-9bbb364b03ff admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:40.052343 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a7ebad-e428-4c76-b8d0-9bbb364b03ff admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:40.052778 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a7ebad-e428-4c76-b8d0-9bbb364b03ff admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:40.053507 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a7ebad-e428-4c76-b8d0-9bbb364b03ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:40.054253 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39be317c-90a9-42a0-8620-7e2edfa9a79b admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:40.055585 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a7ebad-e428-4c76-b8d0-9bbb364b03ff admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:40.085493 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3476/6913] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:35:39 2022] POST /identity/v3/users => generated 294 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:35:40.086911 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138932ea-4334-4e5d-af7c-b2a362d0a157 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:40.087856 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138932ea-4334-4e5d-af7c-b2a362d0a157 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:40.088317 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138932ea-4334-4e5d-af7c-b2a362d0a157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:40.122376 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-138932ea-4334-4e5d-af7c-b2a362d0a157 None None] MFA Rules not processed for user `f9c59dbb77154a4793e0beb2610d026d`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:35:40.123814 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-138932ea-4334-4e5d-af7c-b2a362d0a157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:40.178766 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-39be317c-90a9-42a0-8620-7e2edfa9a79b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60ae551f45a34ab5b145e5ae42eb39b8'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:40.202744 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-39be317c-90a9-42a0-8620-7e2edfa9a79b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60ae551f45a34ab5b145e5ae42eb39b8'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:40.203695 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-39be317c-90a9-42a0-8620-7e2edfa9a79b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60ae551f45a34ab5b145e5ae42eb39b8'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:40.222297 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-39be317c-90a9-42a0-8620-7e2edfa9a79b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60ae551f45a34ab5b145e5ae42eb39b8'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:40.247728 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-39be317c-90a9-42a0-8620-7e2edfa9a79b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60ae551f45a34ab5b145e5ae42eb39b8'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:40.262611 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3438/6914] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:35:39 2022] DELETE /identity/v3/users/60ae551f45a34ab5b145e5ae42eb39b8 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:35:40.263939 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39be317c-90a9-42a0-8620-7e2edfa9a79b admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:40.266690 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3477/6915] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:35:40 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:35:40.267658 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138932ea-4334-4e5d-af7c-b2a362d0a157 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:40.269296 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-39be317c-90a9-42a0-8620-7e2edfa9a79b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:40.271432 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-138932ea-4334-4e5d-af7c-b2a362d0a157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:40.304949 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138932ea-4334-4e5d-af7c-b2a362d0a157 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:40.395241 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:35:40.439665 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39be317c-90a9-42a0-8620-7e2edfa9a79b admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:40.458179 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05977025-cf78-4228-a58a-508568c73a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:40.459036 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05977025-cf78-4228-a58a-508568c73a79 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:40.459417 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05977025-cf78-4228-a58a-508568c73a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:40.459791 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05977025-cf78-4228-a58a-508568c73a79 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:40.460786 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05977025-cf78-4228-a58a-508568c73a79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:40.462662 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05977025-cf78-4228-a58a-508568c73a79 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:40.491641 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3439/6916] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:35:40 2022] GET /identity/v3/roles => generated 1420 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:35:40.493109 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05977025-cf78-4228-a58a-508568c73a79 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:40.495452 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-05977025-cf78-4228-a58a-508568c73a79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:40.501430 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4846c3-53cd-40c2-9eff-380d75601b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:40.502635 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4846c3-53cd-40c2-9eff-380d75601b77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:40.502959 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4846c3-53cd-40c2-9eff-380d75601b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:40.503237 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4846c3-53cd-40c2-9eff-380d75601b77 admin admin] PATH_INFO: `/v3/users/8c9b7f872d6e4d0293e4c3a402493848` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:40.504726 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4846c3-53cd-40c2-9eff-380d75601b77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c9b7f872d6e4d0293e4c3a402493848)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:40.506826 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4846c3-53cd-40c2-9eff-380d75601b77 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:40.550482 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:35:40.603582 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-8e4846c3-53cd-40c2-9eff-380d75601b77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c9b7f872d6e4d0293e4c3a402493848'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:40.604278 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-8e4846c3-53cd-40c2-9eff-380d75601b77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c9b7f872d6e4d0293e4c3a402493848'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:40.605135 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05977025-cf78-4228-a58a-508568c73a79 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:40.613913 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-8e4846c3-53cd-40c2-9eff-380d75601b77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c9b7f872d6e4d0293e4c3a402493848'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:40.614425 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32eac05-fe80-45ea-8650-2d5ca3dfc61e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:40.616173 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32eac05-fe80-45ea-8650-2d5ca3dfc61e service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:40.617458 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32eac05-fe80-45ea-8650-2d5ca3dfc61e service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:40.618893 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32eac05-fe80-45ea-8650-2d5ca3dfc61e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:40.622553 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-a32eac05-fe80-45ea-8650-2d5ca3dfc61e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:40.630835 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-8e4846c3-53cd-40c2-9eff-380d75601b77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c9b7f872d6e4d0293e4c3a402493848'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:40.653380 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-8e4846c3-53cd-40c2-9eff-380d75601b77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c9b7f872d6e4d0293e4c3a402493848'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:40.663559 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3478/6917] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:35:40 2022] DELETE /identity/v3/users/8c9b7f872d6e4d0293e4c3a402493848 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:35:40.663559 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4846c3-53cd-40c2-9eff-380d75601b77 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:40.664750 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-8e4846c3-53cd-40c2-9eff-380d75601b77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:40.770432 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32eac05-fe80-45ea-8650-2d5ca3dfc61e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:40.773291 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32eac05-fe80-45ea-8650-2d5ca3dfc61e service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:40.796588 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4846c3-53cd-40c2-9eff-380d75601b77 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:40.803331 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edb7d4f-16f9-4deb-9485-b75ff3e35386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:40.804286 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edb7d4f-16f9-4deb-9485-b75ff3e35386 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:40.804847 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edb7d4f-16f9-4deb-9485-b75ff3e35386 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:40.805306 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edb7d4f-16f9-4deb-9485-b75ff3e35386 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:40.805556 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3440/6918] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:35:40 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:35:40.807311 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edb7d4f-16f9-4deb-9485-b75ff3e35386 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:40.808449 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4210ce-c376-4473-bab3-bc060e2f61ea None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:40.809317 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4210ce-c376-4473-bab3-bc060e2f61ea None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:40.813344 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4210ce-c376-4473-bab3-bc060e2f61ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:40.827950 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edb7d4f-16f9-4deb-9485-b75ff3e35386 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:40.853693 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3479/6919] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:35:40 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:35:40.854513 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edb7d4f-16f9-4deb-9485-b75ff3e35386 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:40.858043 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-7edb7d4f-16f9-4deb-9485-b75ff3e35386 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:40.875828 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edb7d4f-16f9-4deb-9485-b75ff3e35386 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:40.878062 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-2e4210ce-c376-4473-bab3-bc060e2f61ea None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:35:40.882549 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d6596e-5f55-4716-b227-fe74f8bc9678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:40.883053 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-2e4210ce-c376-4473-bab3-bc060e2f61ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:40.883498 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d6596e-5f55-4716-b227-fe74f8bc9678 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:40.883887 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d6596e-5f55-4716-b227-fe74f8bc9678 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:40.884028 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d6596e-5f55-4716-b227-fe74f8bc9678 admin admin] PATH_INFO: `/v3/projects/8b197b142dbb4982ae56f6993d082f39` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:40.885302 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d6596e-5f55-4716-b227-fe74f8bc9678 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b197b142dbb4982ae56f6993d082f39)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:40.887388 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d6596e-5f55-4716-b227-fe74f8bc9678 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:40.894501 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3441/6920] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:35:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:35:40.895333 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4210ce-c376-4473-bab3-bc060e2f61ea None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:40.896802 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-2e4210ce-c376-4473-bab3-bc060e2f61ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:40.916794 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4210ce-c376-4473-bab3-bc060e2f61ea None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:40.934216 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb9d81a-3ab9-497f-8281-5ad3171e9285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:40.935844 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb9d81a-3ab9-497f-8281-5ad3171e9285 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:40.936032 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb9d81a-3ab9-497f-8281-5ad3171e9285 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:40.937401 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb9d81a-3ab9-497f-8281-5ad3171e9285 admin admin] PATH_INFO: `/v3/users/f9c59dbb77154a4793e0beb2610d026d` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:40.939531 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb9d81a-3ab9-497f-8281-5ad3171e9285 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9c59dbb77154a4793e0beb2610d026d)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:40.942220 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb9d81a-3ab9-497f-8281-5ad3171e9285 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:40.963246 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:35:40.975149 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-a7d6596e-5f55-4716-b227-fe74f8bc9678 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b197b142dbb4982ae56f6993d082f39', 'request_id': 'req-a7d6596e-5f55-4716-b227-fe74f8bc9678'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:41.008406 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-a7d6596e-5f55-4716-b227-fe74f8bc9678 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b197b142dbb4982ae56f6993d082f39', 'request_id': 'req-a7d6596e-5f55-4716-b227-fe74f8bc9678'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:41.020672 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-a7d6596e-5f55-4716-b227-fe74f8bc9678 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b197b142dbb4982ae56f6993d082f39', 'request_id': 'req-a7d6596e-5f55-4716-b227-fe74f8bc9678'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:41.034385 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-a7d6596e-5f55-4716-b227-fe74f8bc9678 admin admin] The token cache is being invalidate because project 8b197b142dbb4982ae56f6993d082f39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:35:41.034917 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-a7d6596e-5f55-4716-b227-fe74f8bc9678 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:41.035772 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-a7d6596e-5f55-4716-b227-fe74f8bc9678 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:41.040741 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3480/6921] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:35:40 2022] DELETE /identity/v3/projects/8b197b142dbb4982ae56f6993d082f39 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:35:41.042993 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d6596e-5f55-4716-b227-fe74f8bc9678 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:41.046514 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-a7d6596e-5f55-4716-b227-fe74f8bc9678 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:41.056908 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-ecb9d81a-3ab9-497f-8281-5ad3171e9285 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9c59dbb77154a4793e0beb2610d026d'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:41.068271 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-ecb9d81a-3ab9-497f-8281-5ad3171e9285 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9c59dbb77154a4793e0beb2610d026d'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:41.069444 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-ecb9d81a-3ab9-497f-8281-5ad3171e9285 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9c59dbb77154a4793e0beb2610d026d'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:41.088241 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-ecb9d81a-3ab9-497f-8281-5ad3171e9285 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9c59dbb77154a4793e0beb2610d026d'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:41.108171 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-ecb9d81a-3ab9-497f-8281-5ad3171e9285 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9c59dbb77154a4793e0beb2610d026d'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:41.117433 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3442/6922] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:35:40 2022] DELETE /identity/v3/users/f9c59dbb77154a4793e0beb2610d026d => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:35:41.118354 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb9d81a-3ab9-497f-8281-5ad3171e9285 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:41.119871 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-ecb9d81a-3ab9-497f-8281-5ad3171e9285 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:41.146484 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d6596e-5f55-4716-b227-fe74f8bc9678 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:41.242891 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb9d81a-3ab9-497f-8281-5ad3171e9285 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:41.250858 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb84264-3ece-44b4-bbbc-d1696e23d05a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:41.251604 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb84264-3ece-44b4-bbbc-d1696e23d05a service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:41.251881 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb84264-3ece-44b4-bbbc-d1696e23d05a service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:41.252153 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb84264-3ece-44b4-bbbc-d1696e23d05a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:41.256461 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-8cb84264-3ece-44b4-bbbc-d1696e23d05a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:41.267055 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c57a0a-6460-45c3-b72d-10677600eabb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:41.268092 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c57a0a-6460-45c3-b72d-10677600eabb admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:41.268375 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c57a0a-6460-45c3-b72d-10677600eabb admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:41.268651 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c57a0a-6460-45c3-b72d-10677600eabb admin admin] PATH_INFO: `/v3/projects/95596abbb0f740d69888690df3a5b513/users/e3866ef4c83b413f9d0ef1d64535cf1e/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:41.292447 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c57a0a-6460-45c3-b72d-10677600eabb admin admin] RBAC: Authorizing `identity:create_grant(project_id=95596abbb0f740d69888690df3a5b513, user_id=e3866ef4c83b413f9d0ef1d64535cf1e, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:41.295568 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c57a0a-6460-45c3-b72d-10677600eabb admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:41.295729 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb84264-3ece-44b4-bbbc-d1696e23d05a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:41.297997 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb84264-3ece-44b4-bbbc-d1696e23d05a service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:41.308586 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:35:41.321950 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3481/6923] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:35:41 2022] PUT /identity/v3/projects/95596abbb0f740d69888690df3a5b513/users/e3866ef4c83b413f9d0ef1d64535cf1e/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:35:41.325052 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fc9899-75ba-4a22-9a6c-9958772e73d8 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:41.325931 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fc9899-75ba-4a22-9a6c-9958772e73d8 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:41.326454 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fc9899-75ba-4a22-9a6c-9958772e73d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:41.328400 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3443/6924] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:35:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:35:41.330342 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845e9d19-7a7a-4b38-b702-e0e3077feb39 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:41.331132 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845e9d19-7a7a-4b38-b702-e0e3077feb39 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:41.339992 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845e9d19-7a7a-4b38-b702-e0e3077feb39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:41.362803 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-48fc9899-75ba-4a22-9a6c-9958772e73d8 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:35:41.366074 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-48fc9899-75ba-4a22-9a6c-9958772e73d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:41.379839 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-845e9d19-7a7a-4b38-b702-e0e3077feb39 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:35:41.381113 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-845e9d19-7a7a-4b38-b702-e0e3077feb39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:41.488003 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:35:41.509725 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3482/6925] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:35:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:35:41.513290 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d0be9d-2131-4505-80c2-d09cd650208d None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:41.514296 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d0be9d-2131-4505-80c2-d09cd650208d None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:41.516400 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d0be9d-2131-4505-80c2-d09cd650208d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:41.534849 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3444/6926] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:35:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:35:41.534849 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd71ec65-7ec5-42dd-a761-7b18dc690452 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:41.535383 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd71ec65-7ec5-42dd-a761-7b18dc690452 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:41.536980 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd71ec65-7ec5-42dd-a761-7b18dc690452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:41.582971 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-dd71ec65-7ec5-42dd-a761-7b18dc690452 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:35:41.584755 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-92d0be9d-2131-4505-80c2-d09cd650208d None None] MFA Rules not processed for user `e3866ef4c83b413f9d0ef1d64535cf1e`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:35:41.587209 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-dd71ec65-7ec5-42dd-a761-7b18dc690452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:41.588126 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-92d0be9d-2131-4505-80c2-d09cd650208d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:41.607662 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3445/6927] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:35:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:35:41.611055 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd71ec65-7ec5-42dd-a761-7b18dc690452 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:41.729081 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3483/6928] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:35:41 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:35:41.730151 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d0be9d-2131-4505-80c2-d09cd650208d None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:41.748912 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd71ec65-7ec5-42dd-a761-7b18dc690452 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:41.754802 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9536ec-7ac4-48d2-af50-511cbe9c30c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:41.755121 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9536ec-7ac4-48d2-af50-511cbe9c30c0 service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:41.755404 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9536ec-7ac4-48d2-af50-511cbe9c30c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:41.755681 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9536ec-7ac4-48d2-af50-511cbe9c30c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:41.760778 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d0be9d-2131-4505-80c2-d09cd650208d None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:41.772612 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9536ec-7ac4-48d2-af50-511cbe9c30c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:41.774211 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9536ec-7ac4-48d2-af50-511cbe9c30c0 service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:41.774896 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41628155-3bfc-47c5-928b-2f819093624a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:41.775666 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41628155-3bfc-47c5-928b-2f819093624a admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:41.777744 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41628155-3bfc-47c5-928b-2f819093624a admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:41.778129 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41628155-3bfc-47c5-928b-2f819093624a admin admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:41.778965 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41628155-3bfc-47c5-928b-2f819093624a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:35:41.782000 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41628155-3bfc-47c5-928b-2f819093624a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:41.787702 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3446/6929] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:35:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:35:41.790180 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9536ec-7ac4-48d2-af50-511cbe9c30c0 service neutron] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:41.792082 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-2c9536ec-7ac4-48d2-af50-511cbe9c30c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:41.796645 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41628155-3bfc-47c5-928b-2f819093624a admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:41.813206 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9536ec-7ac4-48d2-af50-511cbe9c30c0 service neutron] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:41.828880 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e9a885-5ea9-40e7-bf70-9794c33ed78a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:41.834194 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e9a885-5ea9-40e7-bf70-9794c33ed78a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:41.835322 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e9a885-5ea9-40e7-bf70-9794c33ed78a admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:41.835791 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e9a885-5ea9-40e7-bf70-9794c33ed78a admin admin] PATH_INFO: `/v3/projects/d3a91a1a84564bcd9fe28ec7b1996853` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:41.837210 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e9a885-5ea9-40e7-bf70-9794c33ed78a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3a91a1a84564bcd9fe28ec7b1996853)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:41.839363 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e9a885-5ea9-40e7-bf70-9794c33ed78a admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:41.843432 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3484/6930] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:35:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:35:41.844480 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41628155-3bfc-47c5-928b-2f819093624a admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:41.858205 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41628155-3bfc-47c5-928b-2f819093624a admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:41.862521 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac44996-2dbf-4e77-8bd7-9de09d580b61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:41.864083 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac44996-2dbf-4e77-8bd7-9de09d580b61 service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:41.867508 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac44996-2dbf-4e77-8bd7-9de09d580b61 service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:41.868203 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac44996-2dbf-4e77-8bd7-9de09d580b61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:41.883619 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac44996-2dbf-4e77-8bd7-9de09d580b61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:41.885136 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac44996-2dbf-4e77-8bd7-9de09d580b61 service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:41.906825 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3485/6931] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:35:41 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:35:41.907690 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac44996-2dbf-4e77-8bd7-9de09d580b61 service neutron] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:41.922245 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-a1e9a885-5ea9-40e7-bf70-9794c33ed78a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3a91a1a84564bcd9fe28ec7b1996853', 'request_id': 'req-a1e9a885-5ea9-40e7-bf70-9794c33ed78a'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:41.922480 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac44996-2dbf-4e77-8bd7-9de09d580b61 service neutron] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:41.938785 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-a1e9a885-5ea9-40e7-bf70-9794c33ed78a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3a91a1a84564bcd9fe28ec7b1996853', 'request_id': 'req-a1e9a885-5ea9-40e7-bf70-9794c33ed78a'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:41.947041 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-a1e9a885-5ea9-40e7-bf70-9794c33ed78a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3a91a1a84564bcd9fe28ec7b1996853', 'request_id': 'req-a1e9a885-5ea9-40e7-bf70-9794c33ed78a'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:41.967279 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-a1e9a885-5ea9-40e7-bf70-9794c33ed78a admin admin] The token cache is being invalidate because project d3a91a1a84564bcd9fe28ec7b1996853 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:35:41.967801 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-a1e9a885-5ea9-40e7-bf70-9794c33ed78a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:41.968698 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-a1e9a885-5ea9-40e7-bf70-9794c33ed78a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:41.971075 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3447/6932] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:35:41 2022] DELETE /identity/v3/projects/d3a91a1a84564bcd9fe28ec7b1996853 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:35:41.977603 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98647103-571c-47da-aff5-5f15fbdd4a68 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:41.977603 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98647103-571c-47da-aff5-5f15fbdd4a68 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:41.977969 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98647103-571c-47da-aff5-5f15fbdd4a68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:41.998422 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6cf4a7-8a76-4103-a067-d0218cd21c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:41.999098 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6cf4a7-8a76-4103-a067-d0218cd21c67 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:41.999377 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6cf4a7-8a76-4103-a067-d0218cd21c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:41.999646 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6cf4a7-8a76-4103-a067-d0218cd21c67 admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:42.003268 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6cf4a7-8a76-4103-a067-d0218cd21c67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:42.005383 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6cf4a7-8a76-4103-a067-d0218cd21c67 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:42.011746 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-98647103-571c-47da-aff5-5f15fbdd4a68 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:35:42.014178 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-98647103-571c-47da-aff5-5f15fbdd4a68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:42.028502 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3448/6933] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:35:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:35:42.038783 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a95ab4-5116-4540-a31b-371d0f58c24c None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:42.039194 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a95ab4-5116-4540-a31b-371d0f58c24c None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:42.039497 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a95ab4-5116-4540-a31b-371d0f58c24c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:42.076154 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3486/6934] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:35:41 2022] POST /identity/v3/projects => generated 369 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:35:42.077493 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6cf4a7-8a76-4103-a067-d0218cd21c67 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:42.079659 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-be6cf4a7-8a76-4103-a067-d0218cd21c67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:42.084545 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-47a95ab4-5116-4540-a31b-371d0f58c24c None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:35:42.086651 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-47a95ab4-5116-4540-a31b-371d0f58c24c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:42.105589 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:35:42.175508 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:35:42.202709 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3449/6935] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:35:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:35:42.207288 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6cf4a7-8a76-4103-a067-d0218cd21c67 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:42.207466 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a95ab4-5116-4540-a31b-371d0f58c24c None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:42.214171 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b58ec29-fa29-4726-8668-23bdac7a1024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:42.215004 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b58ec29-fa29-4726-8668-23bdac7a1024 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:42.215385 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b58ec29-fa29-4726-8668-23bdac7a1024 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:42.215808 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b58ec29-fa29-4726-8668-23bdac7a1024 admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:42.217225 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b58ec29-fa29-4726-8668-23bdac7a1024 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:42.219384 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b58ec29-fa29-4726-8668-23bdac7a1024 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:42.223515 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a95ab4-5116-4540-a31b-371d0f58c24c None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:42.233753 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085ba36b-60a2-4212-9eb4-fdb8d052a762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:42.234972 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085ba36b-60a2-4212-9eb4-fdb8d052a762 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:42.235416 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085ba36b-60a2-4212-9eb4-fdb8d052a762 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:42.236373 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085ba36b-60a2-4212-9eb4-fdb8d052a762 admin admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:42.237779 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085ba36b-60a2-4212-9eb4-fdb8d052a762 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:35:42.238429 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085ba36b-60a2-4212-9eb4-fdb8d052a762 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:42.240338 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085ba36b-60a2-4212-9eb4-fdb8d052a762 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:42.254195 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3487/6936] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:35:42 2022] POST /identity/v3/users => generated 285 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:35:42.255859 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b58ec29-fa29-4726-8668-23bdac7a1024 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:42.270205 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3450/6937] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:35:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 21:35:42.271488 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085ba36b-60a2-4212-9eb4-fdb8d052a762 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:42.276697 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b58ec29-fa29-4726-8668-23bdac7a1024 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:42.286883 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ab0a42-94c5-42ba-9033-af3e67872241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:42.287752 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085ba36b-60a2-4212-9eb4-fdb8d052a762 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:42.288107 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ab0a42-94c5-42ba-9033-af3e67872241 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:42.288538 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ab0a42-94c5-42ba-9033-af3e67872241 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:42.288964 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ab0a42-94c5-42ba-9033-af3e67872241 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:42.293856 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ab0a42-94c5-42ba-9033-af3e67872241 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:42.295321 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cda2c4-574f-4502-a2f5-bf4f557f51ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:42.296113 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ab0a42-94c5-42ba-9033-af3e67872241 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:42.296255 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cda2c4-574f-4502-a2f5-bf4f557f51ba admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:42.296550 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cda2c4-574f-4502-a2f5-bf4f557f51ba admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:42.296980 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cda2c4-574f-4502-a2f5-bf4f557f51ba admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:42.298387 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cda2c4-574f-4502-a2f5-bf4f557f51ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:42.302863 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cda2c4-574f-4502-a2f5-bf4f557f51ba admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:42.327848 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3488/6938] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:35:42 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:35:42.329106 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ab0a42-94c5-42ba-9033-af3e67872241 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:42.341520 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ab0a42-94c5-42ba-9033-af3e67872241 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:42.347374 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d605f4a7-e20c-4361-b38e-92a3cb803fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:42.348293 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d605f4a7-e20c-4361-b38e-92a3cb803fa2 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:42.348797 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3451/6939] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:35:42 2022] POST /identity/v3/projects => generated 359 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:35:42.350179 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d605f4a7-e20c-4361-b38e-92a3cb803fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:42.350584 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d605f4a7-e20c-4361-b38e-92a3cb803fa2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:42.351538 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d605f4a7-e20c-4361-b38e-92a3cb803fa2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:42.352700 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cda2c4-574f-4502-a2f5-bf4f557f51ba admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:42.353817 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d605f4a7-e20c-4361-b38e-92a3cb803fa2 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:42.369522 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3489/6940] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:35:42 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:35:42.373392 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d605f4a7-e20c-4361-b38e-92a3cb803fa2 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:42.388973 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d605f4a7-e20c-4361-b38e-92a3cb803fa2 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:42.438310 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cda2c4-574f-4502-a2f5-bf4f557f51ba admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:42.444641 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077b8bd0-ebc8-4c3b-b9f3-e4ac3cef8143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:42.446087 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077b8bd0-ebc8-4c3b-b9f3-e4ac3cef8143 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:42.446423 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077b8bd0-ebc8-4c3b-b9f3-e4ac3cef8143 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:42.446718 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077b8bd0-ebc8-4c3b-b9f3-e4ac3cef8143 admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:42.447483 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077b8bd0-ebc8-4c3b-b9f3-e4ac3cef8143 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:42.449510 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077b8bd0-ebc8-4c3b-b9f3-e4ac3cef8143 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:42.469265 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023319cc-6193-4f90-b55d-448d3fc657e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:42.470456 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023319cc-6193-4f90-b55d-448d3fc657e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:42.471118 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023319cc-6193-4f90-b55d-448d3fc657e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:42.471405 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023319cc-6193-4f90-b55d-448d3fc657e2 admin admin] PATH_INFO: `/v3/projects/083c0f336ca1445ab8ceedb6579eb953/users/4480be04a53c434687b1e3146699e17e/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:42.477970 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3452/6941] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:35:42 2022] POST /identity/v3/users => generated 280 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:35:42.482194 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077b8bd0-ebc8-4c3b-b9f3-e4ac3cef8143 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:42.496427 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023319cc-6193-4f90-b55d-448d3fc657e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=083c0f336ca1445ab8ceedb6579eb953, user_id=4480be04a53c434687b1e3146699e17e, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:42.497006 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077b8bd0-ebc8-4c3b-b9f3-e4ac3cef8143 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:42.499317 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023319cc-6193-4f90-b55d-448d3fc657e2 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:42.502917 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a05838-b4c9-40f7-a068-06102ccb852b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:42.503614 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a05838-b4c9-40f7-a068-06102ccb852b admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:42.503894 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a05838-b4c9-40f7-a068-06102ccb852b admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:42.504218 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a05838-b4c9-40f7-a068-06102ccb852b admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:42.504965 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a05838-b4c9-40f7-a068-06102ccb852b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:42.507423 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a05838-b4c9-40f7-a068-06102ccb852b admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:42.522533 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3453/6943] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:35:42 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:35:42.530698 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3490/6943] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:35:42 2022] PUT /identity/v3/projects/083c0f336ca1445ab8ceedb6579eb953/users/4480be04a53c434687b1e3146699e17e/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:35:42.547030 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d648b7c-3eeb-4ac0-9402-ef5db02a5773 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:42.547824 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d648b7c-3eeb-4ac0-9402-ef5db02a5773 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:42.548161 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d648b7c-3eeb-4ac0-9402-ef5db02a5773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:42.548417 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023319cc-6193-4f90-b55d-448d3fc657e2 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:42.604458 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-4d648b7c-3eeb-4ac0-9402-ef5db02a5773 None None] MFA Rules not processed for user `4480be04a53c434687b1e3146699e17e`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:35:42.611928 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-4d648b7c-3eeb-4ac0-9402-ef5db02a5773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:42.692938 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023319cc-6193-4f90-b55d-448d3fc657e2 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:42.696401 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:35:42.700036 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641d3be4-23ec-40ee-aaf2-277a7440545f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:42.701253 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641d3be4-23ec-40ee-aaf2-277a7440545f admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:42.701536 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641d3be4-23ec-40ee-aaf2-277a7440545f admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:42.702956 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641d3be4-23ec-40ee-aaf2-277a7440545f admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:42.703768 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641d3be4-23ec-40ee-aaf2-277a7440545f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:42.706027 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641d3be4-23ec-40ee-aaf2-277a7440545f admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:42.724461 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3491/6944] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:35:42 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:35:42.725494 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641d3be4-23ec-40ee-aaf2-277a7440545f admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:42.727891 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-641d3be4-23ec-40ee-aaf2-277a7440545f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:42.734546 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3454/6945] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:35:42 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:35:42.736724 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d648b7c-3eeb-4ac0-9402-ef5db02a5773 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:42.762721 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641d3be4-23ec-40ee-aaf2-277a7440545f admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:42.769521 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7e52c7-f018-4b5b-85e5-767bc66b69cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:42.769995 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d648b7c-3eeb-4ac0-9402-ef5db02a5773 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:42.771232 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7e52c7-f018-4b5b-85e5-767bc66b69cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:42.771495 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7e52c7-f018-4b5b-85e5-767bc66b69cc admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:42.771864 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7e52c7-f018-4b5b-85e5-767bc66b69cc admin admin] PATH_INFO: `/v3/projects/6b151c7a88524e86b0ecd780d97aa0ef` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:42.773252 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7e52c7-f018-4b5b-85e5-767bc66b69cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b151c7a88524e86b0ecd780d97aa0ef)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:42.775348 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7e52c7-f018-4b5b-85e5-767bc66b69cc admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:42.782236 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d832398-7894-408e-bb00-ac6942324e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:42.784191 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d832398-7894-408e-bb00-ac6942324e13 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:42.784489 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d832398-7894-408e-bb00-ac6942324e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:42.784767 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d832398-7894-408e-bb00-ac6942324e13 admin admin] PATH_INFO: `/v3/projects/a6e504faeb7f4d078c7dcba26b8ef28d/users/f5c139ba274044f9a1c1d6ec23353a94/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:42.823765 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d832398-7894-408e-bb00-ac6942324e13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6e504faeb7f4d078c7dcba26b8ef28d, user_id=f5c139ba274044f9a1c1d6ec23353a94, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:42.830380 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d832398-7894-408e-bb00-ac6942324e13 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:42.836261 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:35:42.850834 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3455/6946] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:35:42 2022] PUT /identity/v3/projects/a6e504faeb7f4d078c7dcba26b8ef28d/users/f5c139ba274044f9a1c1d6ec23353a94/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:35:42.851969 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d832398-7894-408e-bb00-ac6942324e13 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:42.869844 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-4d7e52c7-f018-4b5b-85e5-767bc66b69cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b151c7a88524e86b0ecd780d97aa0ef', 'request_id': 'req-4d7e52c7-f018-4b5b-85e5-767bc66b69cc'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:42.887803 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-4d7e52c7-f018-4b5b-85e5-767bc66b69cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b151c7a88524e86b0ecd780d97aa0ef', 'request_id': 'req-4d7e52c7-f018-4b5b-85e5-767bc66b69cc'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:42.894710 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-4d7e52c7-f018-4b5b-85e5-767bc66b69cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b151c7a88524e86b0ecd780d97aa0ef', 'request_id': 'req-4d7e52c7-f018-4b5b-85e5-767bc66b69cc'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:42.920241 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-4d7e52c7-f018-4b5b-85e5-767bc66b69cc admin admin] The token cache is being invalidate because project 6b151c7a88524e86b0ecd780d97aa0ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:35:42.920507 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-4d7e52c7-f018-4b5b-85e5-767bc66b69cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:42.930431 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-4d7e52c7-f018-4b5b-85e5-767bc66b69cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:42.936216 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3492/6947] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:35:42 2022] DELETE /identity/v3/projects/6b151c7a88524e86b0ecd780d97aa0ef => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:35:42.936216 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90a8c43-baaf-479c-812d-d4feb51b0cda None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:42.936216 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90a8c43-baaf-479c-812d-d4feb51b0cda None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:42.936216 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90a8c43-baaf-479c-812d-d4feb51b0cda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:42.966475 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d832398-7894-408e-bb00-ac6942324e13 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:42.973365 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da672430-df51-494f-a4a7-60060e7a48fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:42.975309 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da672430-df51-494f-a4a7-60060e7a48fb admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:42.975791 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da672430-df51-494f-a4a7-60060e7a48fb admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:42.976259 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da672430-df51-494f-a4a7-60060e7a48fb admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:42.977210 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da672430-df51-494f-a4a7-60060e7a48fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:42.979462 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da672430-df51-494f-a4a7-60060e7a48fb admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:42.991598 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-f90a8c43-baaf-479c-812d-d4feb51b0cda None None] MFA Rules not processed for user `f5c139ba274044f9a1c1d6ec23353a94`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:35:42.992815 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-f90a8c43-baaf-479c-812d-d4feb51b0cda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:43.045831 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3456/6948] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:35:42 2022] POST /identity/v3/projects => generated 369 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:35:43.047552 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2392439d-77f8-4c35-a4f3-c707b2c3dd65 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:43.047902 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2392439d-77f8-4c35-a4f3-c707b2c3dd65 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:43.048185 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2392439d-77f8-4c35-a4f3-c707b2c3dd65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:43.085380 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-2392439d-77f8-4c35-a4f3-c707b2c3dd65 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:35:43.086802 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-2392439d-77f8-4c35-a4f3-c707b2c3dd65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:43.123016 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3493/6949] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:35:42 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:35:43.123884 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90a8c43-baaf-479c-812d-d4feb51b0cda None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:43.141506 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-f90a8c43-baaf-479c-812d-d4feb51b0cda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:43.160036 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90a8c43-baaf-479c-812d-d4feb51b0cda None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:43.199497 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3457/6950] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:35:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:35:43.201255 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2392439d-77f8-4c35-a4f3-c707b2c3dd65 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:43.203700 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-2392439d-77f8-4c35-a4f3-c707b2c3dd65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:43.331547 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:35:43.349792 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2392439d-77f8-4c35-a4f3-c707b2c3dd65 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:43.361987 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d63c8e-d40d-498f-b5e2-944fd5f0b0f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:43.362851 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d63c8e-d40d-498f-b5e2-944fd5f0b0f2 service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:43.362961 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d63c8e-d40d-498f-b5e2-944fd5f0b0f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:43.363220 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d63c8e-d40d-498f-b5e2-944fd5f0b0f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:43.456340 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d63c8e-d40d-498f-b5e2-944fd5f0b0f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:43.457925 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d63c8e-d40d-498f-b5e2-944fd5f0b0f2 service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:43.466431 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2820c3a1-7a85-42a7-a46f-9b117d293f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:43.468241 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2820c3a1-7a85-42a7-a46f-9b117d293f87 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:43.468524 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2820c3a1-7a85-42a7-a46f-9b117d293f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:43.468802 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2820c3a1-7a85-42a7-a46f-9b117d293f87 admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:43.469504 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2820c3a1-7a85-42a7-a46f-9b117d293f87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:43.477188 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2820c3a1-7a85-42a7-a46f-9b117d293f87 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:43.480196 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3458/6951] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:35:43 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:35:43.481777 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0091eb-6af3-486d-ba6f-b64c3e659420 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:43.483388 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0091eb-6af3-486d-ba6f-b64c3e659420 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:43.483681 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0091eb-6af3-486d-ba6f-b64c3e659420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:43.514230 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-6d0091eb-6af3-486d-ba6f-b64c3e659420 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:35:43.515912 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-6d0091eb-6af3-486d-ba6f-b64c3e659420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:43.519545 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3494/6952] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:35:43 2022] POST /identity/v3/users => generated 291 bytes in 396 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:35:43.523781 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2820c3a1-7a85-42a7-a46f-9b117d293f87 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:43.529525 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3459/6953] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:35:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:35:43.534946 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0091eb-6af3-486d-ba6f-b64c3e659420 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:43.540586 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2820c3a1-7a85-42a7-a46f-9b117d293f87 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:43.546642 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0091eb-6af3-486d-ba6f-b64c3e659420 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:43.552312 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbdd14f-8cbf-4832-9fc3-250e0c0e8fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:43.553006 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbdd14f-8cbf-4832-9fc3-250e0c0e8fb4 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:43.553288 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbdd14f-8cbf-4832-9fc3-250e0c0e8fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:43.553572 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbdd14f-8cbf-4832-9fc3-250e0c0e8fb4 admin admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:43.554446 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbdd14f-8cbf-4832-9fc3-250e0c0e8fb4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:35:43.554750 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbdd14f-8cbf-4832-9fc3-250e0c0e8fb4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:43.556141 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e5a49b-f144-4903-821f-84eef39d2ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:43.556391 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbdd14f-8cbf-4832-9fc3-250e0c0e8fb4 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:43.556831 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e5a49b-f144-4903-821f-84eef39d2ed6 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:43.557114 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e5a49b-f144-4903-821f-84eef39d2ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:43.557383 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e5a49b-f144-4903-821f-84eef39d2ed6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:43.558325 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e5a49b-f144-4903-821f-84eef39d2ed6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:43.560017 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e5a49b-f144-4903-821f-84eef39d2ed6 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:43.576786 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3460/6954] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:35:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:35:43.577736 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbdd14f-8cbf-4832-9fc3-250e0c0e8fb4 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:43.593548 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbdd14f-8cbf-4832-9fc3-250e0c0e8fb4 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:43.595578 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3495/6955] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:35:43 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 21:35:43.598167 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e5a49b-f144-4903-821f-84eef39d2ed6 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:43.602915 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690640ab-ff76-4b95-b5f0-7e0369db2549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:43.603734 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690640ab-ff76-4b95-b5f0-7e0369db2549 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:43.604281 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690640ab-ff76-4b95-b5f0-7e0369db2549 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:43.604628 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690640ab-ff76-4b95-b5f0-7e0369db2549 admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:43.605971 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690640ab-ff76-4b95-b5f0-7e0369db2549 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:43.609074 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690640ab-ff76-4b95-b5f0-7e0369db2549 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:43.615256 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e5a49b-f144-4903-821f-84eef39d2ed6 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:43.621539 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ffe6b2-5dc8-4ffd-9cf1-3871f05c6619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:43.622845 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ffe6b2-5dc8-4ffd-9cf1-3871f05c6619 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:43.623432 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ffe6b2-5dc8-4ffd-9cf1-3871f05c6619 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:43.623765 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ffe6b2-5dc8-4ffd-9cf1-3871f05c6619 admin admin] PATH_INFO: `/v3/projects/bb46af2c5c9c4ac990634b88c0d9f732/users/6686522fbacf48a3aed3073bc8e1ac63/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:43.656007 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ffe6b2-5dc8-4ffd-9cf1-3871f05c6619 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb46af2c5c9c4ac990634b88c0d9f732, user_id=6686522fbacf48a3aed3073bc8e1ac63, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:43.659991 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ffe6b2-5dc8-4ffd-9cf1-3871f05c6619 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:43.666911 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3461/6956] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:35:43 2022] POST /identity/v3/projects => generated 351 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:35:43.669370 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690640ab-ff76-4b95-b5f0-7e0369db2549 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:43.693132 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3496/6957] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:35:43 2022] PUT /identity/v3/projects/bb46af2c5c9c4ac990634b88c0d9f732/users/6686522fbacf48a3aed3073bc8e1ac63/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:35:43.694462 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ffe6b2-5dc8-4ffd-9cf1-3871f05c6619 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:43.700095 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:35:43.917192 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690640ab-ff76-4b95-b5f0-7e0369db2549 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:43.919389 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ffe6b2-5dc8-4ffd-9cf1-3871f05c6619 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:43.925655 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b286886-43eb-4f6e-82e4-8b6e2a2c0e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:43.927148 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b286886-43eb-4f6e-82e4-8b6e2a2c0e76 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:43.927559 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b286886-43eb-4f6e-82e4-8b6e2a2c0e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:43.928603 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b286886-43eb-4f6e-82e4-8b6e2a2c0e76 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:43.929454 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b286886-43eb-4f6e-82e4-8b6e2a2c0e76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:43.932901 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b286886-43eb-4f6e-82e4-8b6e2a2c0e76 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:43.934688 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728e577c-3449-4881-adb9-91a64bd4723a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:43.935388 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728e577c-3449-4881-adb9-91a64bd4723a admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:43.935666 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728e577c-3449-4881-adb9-91a64bd4723a admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:43.935940 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728e577c-3449-4881-adb9-91a64bd4723a admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:43.936799 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728e577c-3449-4881-adb9-91a64bd4723a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:43.939281 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728e577c-3449-4881-adb9-91a64bd4723a admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:43.960107 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3497/6958] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:35:43 2022] GET /identity/v3/roles => generated 1420 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:35:43.969120 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b286886-43eb-4f6e-82e4-8b6e2a2c0e76 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:43.988040 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3462/6959] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:35:43 2022] POST /identity/v3/users => generated 276 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:35:43.992723 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728e577c-3449-4881-adb9-91a64bd4723a admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:44.000661 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b286886-43eb-4f6e-82e4-8b6e2a2c0e76 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:44.006835 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e081ec6-23b5-46e6-b9e7-dfcc276340c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:44.007905 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e081ec6-23b5-46e6-b9e7-dfcc276340c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:44.008250 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e081ec6-23b5-46e6-b9e7-dfcc276340c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:44.008591 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e081ec6-23b5-46e6-b9e7-dfcc276340c6 admin admin] PATH_INFO: `/v3/projects/bb46af2c5c9c4ac990634b88c0d9f732/users/6686522fbacf48a3aed3073bc8e1ac63/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:44.011018 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728e577c-3449-4881-adb9-91a64bd4723a admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:44.012038 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e081ec6-23b5-46e6-b9e7-dfcc276340c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb46af2c5c9c4ac990634b88c0d9f732, user_id=6686522fbacf48a3aed3073bc8e1ac63, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:44.014884 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e081ec6-23b5-46e6-b9e7-dfcc276340c6 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:44.025701 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938391f3-3b26-4e6e-a629-ffb34ab658cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:44.026427 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938391f3-3b26-4e6e-a629-ffb34ab658cc admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:44.026718 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938391f3-3b26-4e6e-a629-ffb34ab658cc admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:44.026993 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938391f3-3b26-4e6e-a629-ffb34ab658cc admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:44.027732 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938391f3-3b26-4e6e-a629-ffb34ab658cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:44.027855 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3498/6960] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:35:43 2022] PUT /identity/v3/projects/bb46af2c5c9c4ac990634b88c0d9f732/users/6686522fbacf48a3aed3073bc8e1ac63/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:35:44.029365 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938391f3-3b26-4e6e-a629-ffb34ab658cc admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:44.038882 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8989a61f-3a8a-41aa-8497-a42bcd94dc96 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:44.039779 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8989a61f-3a8a-41aa-8497-a42bcd94dc96 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:44.040305 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8989a61f-3a8a-41aa-8497-a42bcd94dc96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:44.056890 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3463/6961] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:35:43 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 21:35:44.057850 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938391f3-3b26-4e6e-a629-ffb34ab658cc admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:44.078940 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-8989a61f-3a8a-41aa-8497-a42bcd94dc96 None None] MFA Rules not processed for user `6686522fbacf48a3aed3073bc8e1ac63`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:35:44.081078 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938391f3-3b26-4e6e-a629-ffb34ab658cc admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:44.084468 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-8989a61f-3a8a-41aa-8497-a42bcd94dc96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:44.155461 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:35:44.179220 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc23287-07b3-4fc9-bd2d-eba08d27b64d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:44.179920 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc23287-07b3-4fc9-bd2d-eba08d27b64d admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:44.180196 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc23287-07b3-4fc9-bd2d-eba08d27b64d admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:44.180559 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc23287-07b3-4fc9-bd2d-eba08d27b64d admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:44.181447 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc23287-07b3-4fc9-bd2d-eba08d27b64d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:44.183304 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc23287-07b3-4fc9-bd2d-eba08d27b64d admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:44.197993 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3464/6962] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:35:44 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:35:44.202397 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc23287-07b3-4fc9-bd2d-eba08d27b64d admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:44.215255 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc23287-07b3-4fc9-bd2d-eba08d27b64d admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:44.220515 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ef7e2c-eb32-435c-8d4c-44eeb3ca0061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:44.221455 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ef7e2c-eb32-435c-8d4c-44eeb3ca0061 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:44.222250 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ef7e2c-eb32-435c-8d4c-44eeb3ca0061 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:44.222526 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ef7e2c-eb32-435c-8d4c-44eeb3ca0061 admin admin] PATH_INFO: `/v3/projects/ef7b4fd0502949038fed4bdd7640da46/users/677a5be5e1a14718abd2df03a2be1dd0/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:44.235876 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3499/6963] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:35:44 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:35:44.247939 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8989a61f-3a8a-41aa-8497-a42bcd94dc96 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:44.252291 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ef7e2c-eb32-435c-8d4c-44eeb3ca0061 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef7b4fd0502949038fed4bdd7640da46, user_id=677a5be5e1a14718abd2df03a2be1dd0, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:44.256045 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ef7e2c-eb32-435c-8d4c-44eeb3ca0061 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:44.275580 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3465/6964] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:35:44 2022] PUT /identity/v3/projects/ef7b4fd0502949038fed4bdd7640da46/users/677a5be5e1a14718abd2df03a2be1dd0/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:35:44.286790 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf9a941-9b78-4fc4-a463-a2dfe35a15ce None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:44.287342 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf9a941-9b78-4fc4-a463-a2dfe35a15ce None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:44.287774 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf9a941-9b78-4fc4-a463-a2dfe35a15ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:44.321665 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-bdf9a941-9b78-4fc4-a463-a2dfe35a15ce None None] MFA Rules not processed for user `677a5be5e1a14718abd2df03a2be1dd0`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:35:44.323264 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-bdf9a941-9b78-4fc4-a463-a2dfe35a15ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:44.346016 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8989a61f-3a8a-41aa-8497-a42bcd94dc96 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:44.391328 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:35:44.417785 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3466/6965] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:35:44 2022] POST /identity/v3/auth/tokens => generated 3218 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:35:44.431360 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00be06d-847c-4313-8f55-60083292451a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:44.432083 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00be06d-847c-4313-8f55-60083292451a service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:44.432366 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00be06d-847c-4313-8f55-60083292451a service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:44.432639 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00be06d-847c-4313-8f55-60083292451a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:44.433552 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf9a941-9b78-4fc4-a463-a2dfe35a15ce None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:44.449945 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf9a941-9b78-4fc4-a463-a2dfe35a15ce None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:44.454492 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4946fda1-35a1-4ccc-8180-0e1e823a66de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:44.455261 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4946fda1-35a1-4ccc-8180-0e1e823a66de service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:44.455723 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4946fda1-35a1-4ccc-8180-0e1e823a66de service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:44.456392 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4946fda1-35a1-4ccc-8180-0e1e823a66de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:44.469411 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4946fda1-35a1-4ccc-8180-0e1e823a66de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:44.471307 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4946fda1-35a1-4ccc-8180-0e1e823a66de service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:44.495118 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3467/6966] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:35:44 2022] GET /identity/v3/auth/tokens => generated 3218 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 23 21:35:44.532786 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00be06d-847c-4313-8f55-60083292451a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:44.534367 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00be06d-847c-4313-8f55-60083292451a service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:44.549196 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3500/6967] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:35:44 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:35:46.878990 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4946fda1-35a1-4ccc-8180-0e1e823a66de service neutron] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:47.017234 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4946fda1-35a1-4ccc-8180-0e1e823a66de service neutron] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:47.023251 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f905f5-713c-4442-bef0-5aa74fdc3ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:47.024183 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f905f5-713c-4442-bef0-5aa74fdc3ac8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:47.024464 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f905f5-713c-4442-bef0-5aa74fdc3ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:47.024733 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f905f5-713c-4442-bef0-5aa74fdc3ac8 admin admin] PATH_INFO: `/v3/users/677a5be5e1a14718abd2df03a2be1dd0` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:47.026105 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f905f5-713c-4442-bef0-5aa74fdc3ac8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=677a5be5e1a14718abd2df03a2be1dd0)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:47.028296 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f905f5-713c-4442-bef0-5aa74fdc3ac8 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:47.076676 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:35:47.095886 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-a6f905f5-713c-4442-bef0-5aa74fdc3ac8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '677a5be5e1a14718abd2df03a2be1dd0'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:47.105764 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-a6f905f5-713c-4442-bef0-5aa74fdc3ac8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '677a5be5e1a14718abd2df03a2be1dd0'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:47.106586 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-a6f905f5-713c-4442-bef0-5aa74fdc3ac8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '677a5be5e1a14718abd2df03a2be1dd0'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:47.115765 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-a6f905f5-713c-4442-bef0-5aa74fdc3ac8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '677a5be5e1a14718abd2df03a2be1dd0'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:47.141786 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-a6f905f5-713c-4442-bef0-5aa74fdc3ac8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '677a5be5e1a14718abd2df03a2be1dd0'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:47.153196 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3468/6968] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:35:46 2022] DELETE /identity/v3/users/677a5be5e1a14718abd2df03a2be1dd0 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:35:47.158629 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f253a4-eb9a-46bb-80eb-fe6152216ce8 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:47.159300 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f253a4-eb9a-46bb-80eb-fe6152216ce8 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:47.159300 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f253a4-eb9a-46bb-80eb-fe6152216ce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:47.187330 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-01f253a4-eb9a-46bb-80eb-fe6152216ce8 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:35:47.188637 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-01f253a4-eb9a-46bb-80eb-fe6152216ce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:47.264865 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3501/6969] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:35:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:35:47.275082 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f905f5-713c-4442-bef0-5aa74fdc3ac8 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:47.276888 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-a6f905f5-713c-4442-bef0-5aa74fdc3ac8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:47.380199 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f905f5-713c-4442-bef0-5aa74fdc3ac8 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:47.384037 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a650d40-004d-4566-be24-32506b269e64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:47.384887 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a650d40-004d-4566-be24-32506b269e64 service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:47.385270 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a650d40-004d-4566-be24-32506b269e64 service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:47.385633 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a650d40-004d-4566-be24-32506b269e64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:47.404931 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a650d40-004d-4566-be24-32506b269e64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:47.406739 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a650d40-004d-4566-be24-32506b269e64 service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:47.432423 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3469/6970] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:35:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:35:47.768913 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f253a4-eb9a-46bb-80eb-fe6152216ce8 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:47.770481 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-01f253a4-eb9a-46bb-80eb-fe6152216ce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:47.783791 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f253a4-eb9a-46bb-80eb-fe6152216ce8 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:47.789729 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b675df-8f4b-453b-9389-0e6a99950ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:47.790993 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b675df-8f4b-453b-9389-0e6a99950ea1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:47.791407 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b675df-8f4b-453b-9389-0e6a99950ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:47.791768 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b675df-8f4b-453b-9389-0e6a99950ea1 admin admin] PATH_INFO: `/v3/projects/ef7b4fd0502949038fed4bdd7640da46` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:47.793892 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b675df-8f4b-453b-9389-0e6a99950ea1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef7b4fd0502949038fed4bdd7640da46)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:47.796147 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b675df-8f4b-453b-9389-0e6a99950ea1 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:47.885837 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-07b675df-8f4b-453b-9389-0e6a99950ea1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef7b4fd0502949038fed4bdd7640da46', 'request_id': 'req-07b675df-8f4b-453b-9389-0e6a99950ea1'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:47.901752 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-07b675df-8f4b-453b-9389-0e6a99950ea1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef7b4fd0502949038fed4bdd7640da46', 'request_id': 'req-07b675df-8f4b-453b-9389-0e6a99950ea1'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:47.917810 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-07b675df-8f4b-453b-9389-0e6a99950ea1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef7b4fd0502949038fed4bdd7640da46', 'request_id': 'req-07b675df-8f4b-453b-9389-0e6a99950ea1'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:47.928716 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:35:47.934073 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-07b675df-8f4b-453b-9389-0e6a99950ea1 admin admin] The token cache is being invalidate because project ef7b4fd0502949038fed4bdd7640da46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:35:47.935086 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-07b675df-8f4b-453b-9389-0e6a99950ea1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:47.936023 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-07b675df-8f4b-453b-9389-0e6a99950ea1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:47.939536 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3502/6971] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:35:47 2022] DELETE /identity/v3/projects/ef7b4fd0502949038fed4bdd7640da46 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:35:47.944615 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeb51a8-92d7-47ca-900f-1b6b491a8a6a None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:47.945204 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeb51a8-92d7-47ca-900f-1b6b491a8a6a None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:47.945204 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeb51a8-92d7-47ca-900f-1b6b491a8a6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:47.976727 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-ffeb51a8-92d7-47ca-900f-1b6b491a8a6a None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:35:47.978169 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-ffeb51a8-92d7-47ca-900f-1b6b491a8a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:48.093492 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9df1497-2d60-4bfe-a024-d594e6a0ff56 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:48.093786 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9df1497-2d60-4bfe-a024-d594e6a0ff56 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:48.094483 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9df1497-2d60-4bfe-a024-d594e6a0ff56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:48.095219 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3470/6972] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:35:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:35:48.141013 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-a9df1497-2d60-4bfe-a024-d594e6a0ff56 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:35:48.143207 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-a9df1497-2d60-4bfe-a024-d594e6a0ff56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:48.167311 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeb51a8-92d7-47ca-900f-1b6b491a8a6a None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:48.178147 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3503/6973] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:35:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:35:48.191611 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeb51a8-92d7-47ca-900f-1b6b491a8a6a None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:48.199390 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6f7089-eb91-468c-9aa9-90657081d58f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:48.200500 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6f7089-eb91-468c-9aa9-90657081d58f admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:48.201479 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6f7089-eb91-468c-9aa9-90657081d58f admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:48.202126 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6f7089-eb91-468c-9aa9-90657081d58f admin admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:48.203053 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6f7089-eb91-468c-9aa9-90657081d58f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:35:48.203502 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6f7089-eb91-468c-9aa9-90657081d58f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:48.206366 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6f7089-eb91-468c-9aa9-90657081d58f admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:48.234352 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3471/6974] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:35:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:35:48.235184 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9df1497-2d60-4bfe-a024-d594e6a0ff56 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:48.249971 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9df1497-2d60-4bfe-a024-d594e6a0ff56 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:48.264629 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32180ea2-ce0e-46c5-bc41-3c20c31cb485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:48.264875 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32180ea2-ce0e-46c5-bc41-3c20c31cb485 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:48.265241 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32180ea2-ce0e-46c5-bc41-3c20c31cb485 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:48.265361 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32180ea2-ce0e-46c5-bc41-3c20c31cb485 admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:48.266097 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32180ea2-ce0e-46c5-bc41-3c20c31cb485 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:48.268113 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32180ea2-ce0e-46c5-bc41-3c20c31cb485 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:48.382620 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3504/6975] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:35:48 2022] POST /identity/v3/projects => generated 403 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:35:48.387252 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6f7089-eb91-468c-9aa9-90657081d58f admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:48.401650 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6f7089-eb91-468c-9aa9-90657081d58f admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:48.494011 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:35:48.563038 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11509bde-955b-4feb-a13f-64998684c21c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:48.564241 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11509bde-955b-4feb-a13f-64998684c21c admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:48.564828 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11509bde-955b-4feb-a13f-64998684c21c admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:48.566001 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11509bde-955b-4feb-a13f-64998684c21c admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:48.568276 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11509bde-955b-4feb-a13f-64998684c21c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:48.571524 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11509bde-955b-4feb-a13f-64998684c21c admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:48.622473 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3472/6976] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:35:48 2022] POST /identity/v3/users => generated 302 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:35:48.623908 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32180ea2-ce0e-46c5-bc41-3c20c31cb485 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:48.638262 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32180ea2-ce0e-46c5-bc41-3c20c31cb485 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:48.647197 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86e4cd1-45cd-47c4-922d-84820e26924e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:48.648271 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86e4cd1-45cd-47c4-922d-84820e26924e admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:48.648393 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86e4cd1-45cd-47c4-922d-84820e26924e admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:48.648603 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86e4cd1-45cd-47c4-922d-84820e26924e admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:48.649594 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86e4cd1-45cd-47c4-922d-84820e26924e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:48.651588 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86e4cd1-45cd-47c4-922d-84820e26924e admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:48.673509 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3505/6977] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:35:48 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:35:48.679319 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11509bde-955b-4feb-a13f-64998684c21c admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:48.697347 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11509bde-955b-4feb-a13f-64998684c21c admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:48.723013 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6c7e1a-5be3-428d-82f3-8296944bfe43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:48.723845 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6c7e1a-5be3-428d-82f3-8296944bfe43 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:48.724634 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6c7e1a-5be3-428d-82f3-8296944bfe43 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:48.724983 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6c7e1a-5be3-428d-82f3-8296944bfe43 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:48.733680 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6c7e1a-5be3-428d-82f3-8296944bfe43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:48.735544 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6c7e1a-5be3-428d-82f3-8296944bfe43 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:48.771133 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3473/6978] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:35:48 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:35:48.772529 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86e4cd1-45cd-47c4-922d-84820e26924e admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:48.793978 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86e4cd1-45cd-47c4-922d-84820e26924e admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:48.804828 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de90d695-9ea4-42b2-b86d-03f6fdd89f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:48.809084 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de90d695-9ea4-42b2-b86d-03f6fdd89f43 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:48.809391 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de90d695-9ea4-42b2-b86d-03f6fdd89f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:48.809676 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de90d695-9ea4-42b2-b86d-03f6fdd89f43 admin admin] PATH_INFO: `/v3/projects/a05a3f349b3a41ef8378d593a8a2945b/users/97f2db84c3644b7fadb0fb3fcca28078/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:48.843676 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de90d695-9ea4-42b2-b86d-03f6fdd89f43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a05a3f349b3a41ef8378d593a8a2945b, user_id=97f2db84c3644b7fadb0fb3fcca28078, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:48.846834 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de90d695-9ea4-42b2-b86d-03f6fdd89f43 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:48.867987 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3506/6979] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:35:48 2022] PUT /identity/v3/projects/a05a3f349b3a41ef8378d593a8a2945b/users/97f2db84c3644b7fadb0fb3fcca28078/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:35:48.870268 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f359d6-1bab-45f2-8e7c-f4b4723a07d0 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:48.870562 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f359d6-1bab-45f2-8e7c-f4b4723a07d0 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:48.870845 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f359d6-1bab-45f2-8e7c-f4b4723a07d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:48.892213 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-06f359d6-1bab-45f2-8e7c-f4b4723a07d0 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:35:48.894013 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-06f359d6-1bab-45f2-8e7c-f4b4723a07d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:48.973507 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3474/6980] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:35:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:35:49.012279 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de90d695-9ea4-42b2-b86d-03f6fdd89f43 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:49.014472 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-de90d695-9ea4-42b2-b86d-03f6fdd89f43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:49.114264 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de90d695-9ea4-42b2-b86d-03f6fdd89f43 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:49.119540 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd00968-9313-49f5-8efd-3c97915f83dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:49.120557 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd00968-9313-49f5-8efd-3c97915f83dc service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:49.121016 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd00968-9313-49f5-8efd-3c97915f83dc service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:49.122006 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd00968-9313-49f5-8efd-3c97915f83dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:49.159270 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd00968-9313-49f5-8efd-3c97915f83dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:49.164450 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd00968-9313-49f5-8efd-3c97915f83dc service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:49.192531 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3507/6981] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:35:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:35:53.174949 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588673f5-566a-418c-ae88-f27b10537196 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:53.175804 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588673f5-566a-418c-ae88-f27b10537196 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:53.177338 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588673f5-566a-418c-ae88-f27b10537196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:53.227056 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-588673f5-566a-418c-ae88-f27b10537196 None None] MFA Rules not processed for user `97f2db84c3644b7fadb0fb3fcca28078`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:35:53.228369 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-588673f5-566a-418c-ae88-f27b10537196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:53.364563 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3475/6982] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:35:53 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:35:53.368975 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd00968-9313-49f5-8efd-3c97915f83dc service neutron] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:53.386797 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd00968-9313-49f5-8efd-3c97915f83dc service neutron] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:53.392108 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3187b2b-3ee1-47e6-a8b9-d8bb8becbb4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:53.393216 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3187b2b-3ee1-47e6-a8b9-d8bb8becbb4f admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:53.393595 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3187b2b-3ee1-47e6-a8b9-d8bb8becbb4f admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:53.393970 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3187b2b-3ee1-47e6-a8b9-d8bb8becbb4f admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:53.395070 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3187b2b-3ee1-47e6-a8b9-d8bb8becbb4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:53.397202 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3187b2b-3ee1-47e6-a8b9-d8bb8becbb4f admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:53.438659 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3508/6983] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:35:53 2022] POST /identity/v3/projects => generated 405 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:35:53.442803 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588673f5-566a-418c-ae88-f27b10537196 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:53.458770 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588673f5-566a-418c-ae88-f27b10537196 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:53.522809 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:35:53.542614 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed488898-cea8-46cd-8b14-5175b38234b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:53.544452 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed488898-cea8-46cd-8b14-5175b38234b4 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:53.545572 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed488898-cea8-46cd-8b14-5175b38234b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:53.545955 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed488898-cea8-46cd-8b14-5175b38234b4 admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:53.546967 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed488898-cea8-46cd-8b14-5175b38234b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:53.550826 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed488898-cea8-46cd-8b14-5175b38234b4 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:53.601695 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3476/6984] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:35:53 2022] POST /identity/v3/users => generated 309 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:35:53.605772 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3187b2b-3ee1-47e6-a8b9-d8bb8becbb4f admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:53.623078 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3187b2b-3ee1-47e6-a8b9-d8bb8becbb4f admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:53.633539 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e960f2b-fdcd-4d3b-a7eb-be9fb9f77e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:53.634473 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e960f2b-fdcd-4d3b-a7eb-be9fb9f77e45 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:53.634886 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e960f2b-fdcd-4d3b-a7eb-be9fb9f77e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:53.635208 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e960f2b-fdcd-4d3b-a7eb-be9fb9f77e45 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:53.636073 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e960f2b-fdcd-4d3b-a7eb-be9fb9f77e45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:53.640149 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e960f2b-fdcd-4d3b-a7eb-be9fb9f77e45 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:53.667147 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3509/6985] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:35:53 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:35:53.673226 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed488898-cea8-46cd-8b14-5175b38234b4 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:53.697464 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed488898-cea8-46cd-8b14-5175b38234b4 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:53.704320 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b23cb3c-6e64-48d5-8f30-bd66a024d6c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:53.705370 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b23cb3c-6e64-48d5-8f30-bd66a024d6c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:53.705509 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b23cb3c-6e64-48d5-8f30-bd66a024d6c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:53.705700 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b23cb3c-6e64-48d5-8f30-bd66a024d6c1 admin admin] PATH_INFO: `/v3/projects/97b3db257ebd4e5ba349ff943df49d0e/users/131c0adf29f245b9ba4625da19f709a5/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:53.727587 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b23cb3c-6e64-48d5-8f30-bd66a024d6c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97b3db257ebd4e5ba349ff943df49d0e, user_id=131c0adf29f245b9ba4625da19f709a5, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:53.730186 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b23cb3c-6e64-48d5-8f30-bd66a024d6c1 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:53.750586 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3477/6986] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:35:53 2022] PUT /identity/v3/projects/97b3db257ebd4e5ba349ff943df49d0e/users/131c0adf29f245b9ba4625da19f709a5/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:35:53.753830 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e960f2b-fdcd-4d3b-a7eb-be9fb9f77e45 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:53.770116 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e960f2b-fdcd-4d3b-a7eb-be9fb9f77e45 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:53.858231 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1212804-7450-4724-84cf-5391629f46a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:53.861552 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1212804-7450-4724-84cf-5391629f46a7 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:53.862303 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1212804-7450-4724-84cf-5391629f46a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:53.862689 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1212804-7450-4724-84cf-5391629f46a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:53.867809 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1212804-7450-4724-84cf-5391629f46a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:53.872774 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1212804-7450-4724-84cf-5391629f46a7 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:53.896898 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3510/6987] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:35:53 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 21:35:53.900297 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b23cb3c-6e64-48d5-8f30-bd66a024d6c1 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:53.918814 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b23cb3c-6e64-48d5-8f30-bd66a024d6c1 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:53.925884 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc68938d-be63-42da-b993-80d7ca5ad587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:53.927178 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc68938d-be63-42da-b993-80d7ca5ad587 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:53.927620 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc68938d-be63-42da-b993-80d7ca5ad587 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:53.928172 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc68938d-be63-42da-b993-80d7ca5ad587 admin admin] PATH_INFO: `/v3/projects/97b3db257ebd4e5ba349ff943df49d0e/users/131c0adf29f245b9ba4625da19f709a5/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:53.931756 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc68938d-be63-42da-b993-80d7ca5ad587 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97b3db257ebd4e5ba349ff943df49d0e, user_id=131c0adf29f245b9ba4625da19f709a5, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:53.935086 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc68938d-be63-42da-b993-80d7ca5ad587 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:53.948204 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3478/6988] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:35:53 2022] PUT /identity/v3/projects/97b3db257ebd4e5ba349ff943df49d0e/users/131c0adf29f245b9ba4625da19f709a5/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:35:55.001238 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1212804-7450-4724-84cf-5391629f46a7 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:55.003845 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-f1212804-7450-4724-84cf-5391629f46a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:55.009373 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:35:55.109670 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1212804-7450-4724-84cf-5391629f46a7 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:55.177530 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2a3828-0ba3-47aa-95d7-6257db226bd0 tempest-RoutersAdminTest-1330337528 tempest-RoutersAdminTest-1330337528-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6686522fbacf48a3aed3073bc8e1ac63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb46af2c5c9c4ac990634b88c0d9f732', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:55.178402 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2a3828-0ba3-47aa-95d7-6257db226bd0 tempest-RoutersAdminTest-1330337528 tempest-RoutersAdminTest-1330337528-project-admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:55.178796 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2a3828-0ba3-47aa-95d7-6257db226bd0 tempest-RoutersAdminTest-1330337528 tempest-RoutersAdminTest-1330337528-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:55.179180 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2a3828-0ba3-47aa-95d7-6257db226bd0 tempest-RoutersAdminTest-1330337528 tempest-RoutersAdminTest-1330337528-project-admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:55.180023 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2a3828-0ba3-47aa-95d7-6257db226bd0 tempest-RoutersAdminTest-1330337528 tempest-RoutersAdminTest-1330337528-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:35:55.180432 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2a3828-0ba3-47aa-95d7-6257db226bd0 tempest-RoutersAdminTest-1330337528 tempest-RoutersAdminTest-1330337528-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:55.182189 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2a3828-0ba3-47aa-95d7-6257db226bd0 tempest-RoutersAdminTest-1330337528 tempest-RoutersAdminTest-1330337528-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:55.196313 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3511/6989] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:35:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:35:55.200744 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc68938d-be63-42da-b993-80d7ca5ad587 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:55.212364 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc68938d-be63-42da-b993-80d7ca5ad587 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:55.216948 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8020d30-b036-4776-8772-3190a293472d tempest-RoutersAdminTest-1330337528 tempest-RoutersAdminTest-1330337528-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6686522fbacf48a3aed3073bc8e1ac63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb46af2c5c9c4ac990634b88c0d9f732', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:55.217619 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8020d30-b036-4776-8772-3190a293472d tempest-RoutersAdminTest-1330337528 tempest-RoutersAdminTest-1330337528-project-admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:55.218122 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8020d30-b036-4776-8772-3190a293472d tempest-RoutersAdminTest-1330337528 tempest-RoutersAdminTest-1330337528-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:55.218552 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8020d30-b036-4776-8772-3190a293472d tempest-RoutersAdminTest-1330337528 tempest-RoutersAdminTest-1330337528-project-admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:55.219400 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8020d30-b036-4776-8772-3190a293472d tempest-RoutersAdminTest-1330337528 tempest-RoutersAdminTest-1330337528-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:55.222184 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8020d30-b036-4776-8772-3190a293472d tempest-RoutersAdminTest-1330337528 tempest-RoutersAdminTest-1330337528-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:55.259310 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3479/6990] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:35:55 2022] POST /identity/v3/projects => generated 349 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:35:55.260471 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2a3828-0ba3-47aa-95d7-6257db226bd0 tempest-RoutersAdminTest-1330337528 tempest-RoutersAdminTest-1330337528-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:55.273911 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2a3828-0ba3-47aa-95d7-6257db226bd0 tempest-RoutersAdminTest-1330337528 tempest-RoutersAdminTest-1330337528-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:55.343953 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3349d5-672e-423a-9dd8-79a3aabac0a0 tempest-RoutersAdminTest-1330337528 tempest-RoutersAdminTest-1330337528-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6686522fbacf48a3aed3073bc8e1ac63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb46af2c5c9c4ac990634b88c0d9f732', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:55.344800 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3349d5-672e-423a-9dd8-79a3aabac0a0 tempest-RoutersAdminTest-1330337528 tempest-RoutersAdminTest-1330337528-project-admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:55.345137 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3349d5-672e-423a-9dd8-79a3aabac0a0 tempest-RoutersAdminTest-1330337528 tempest-RoutersAdminTest-1330337528-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:55.345518 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3349d5-672e-423a-9dd8-79a3aabac0a0 tempest-RoutersAdminTest-1330337528 tempest-RoutersAdminTest-1330337528-project-admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:55.346730 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3349d5-672e-423a-9dd8-79a3aabac0a0 tempest-RoutersAdminTest-1330337528 tempest-RoutersAdminTest-1330337528-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:35:55.347103 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3349d5-672e-423a-9dd8-79a3aabac0a0 tempest-RoutersAdminTest-1330337528 tempest-RoutersAdminTest-1330337528-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:55.348895 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3349d5-672e-423a-9dd8-79a3aabac0a0 tempest-RoutersAdminTest-1330337528 tempest-RoutersAdminTest-1330337528-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:55.366784 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3512/6991] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:35:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 21:35:56.123599 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8020d30-b036-4776-8772-3190a293472d tempest-RoutersAdminTest-1330337528 tempest-RoutersAdminTest-1330337528-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:56.142164 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8020d30-b036-4776-8772-3190a293472d tempest-RoutersAdminTest-1330337528 tempest-RoutersAdminTest-1330337528-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:56.147291 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeef24e-6efa-45e0-a835-a8f0106da395 tempest-RoutersAdminTest-1330337528 tempest-RoutersAdminTest-1330337528-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6686522fbacf48a3aed3073bc8e1ac63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb46af2c5c9c4ac990634b88c0d9f732', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:56.148605 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeef24e-6efa-45e0-a835-a8f0106da395 tempest-RoutersAdminTest-1330337528 tempest-RoutersAdminTest-1330337528-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:56.149198 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeef24e-6efa-45e0-a835-a8f0106da395 tempest-RoutersAdminTest-1330337528 tempest-RoutersAdminTest-1330337528-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:56.149698 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeef24e-6efa-45e0-a835-a8f0106da395 tempest-RoutersAdminTest-1330337528 tempest-RoutersAdminTest-1330337528-project-admin] PATH_INFO: `/v3/projects/ad6147036c324610827fa7acdc284208` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:56.151307 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfeef24e-6efa-45e0-a835-a8f0106da395 tempest-RoutersAdminTest-1330337528 tempest-RoutersAdminTest-1330337528-project-admin] RBAC: Authorizing `identity:delete_project(project_id=ad6147036c324610827fa7acdc284208)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:56.153472 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfeef24e-6efa-45e0-a835-a8f0106da395 tempest-RoutersAdminTest-1330337528 tempest-RoutersAdminTest-1330337528-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:56.216966 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-bfeef24e-6efa-45e0-a835-a8f0106da395 tempest-RoutersAdminTest-1330337528 tempest-RoutersAdminTest-1330337528-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad6147036c324610827fa7acdc284208', 'request_id': 'req-bfeef24e-6efa-45e0-a835-a8f0106da395'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:56.230836 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-bfeef24e-6efa-45e0-a835-a8f0106da395 tempest-RoutersAdminTest-1330337528 tempest-RoutersAdminTest-1330337528-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad6147036c324610827fa7acdc284208', 'request_id': 'req-bfeef24e-6efa-45e0-a835-a8f0106da395'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:56.238719 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-bfeef24e-6efa-45e0-a835-a8f0106da395 tempest-RoutersAdminTest-1330337528 tempest-RoutersAdminTest-1330337528-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad6147036c324610827fa7acdc284208', 'request_id': 'req-bfeef24e-6efa-45e0-a835-a8f0106da395'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:56.254719 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-bfeef24e-6efa-45e0-a835-a8f0106da395 tempest-RoutersAdminTest-1330337528 tempest-RoutersAdminTest-1330337528-project-admin] The token cache is being invalidate because project ad6147036c324610827fa7acdc284208 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:35:56.255195 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-bfeef24e-6efa-45e0-a835-a8f0106da395 tempest-RoutersAdminTest-1330337528 tempest-RoutersAdminTest-1330337528-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:56.256020 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-bfeef24e-6efa-45e0-a835-a8f0106da395 tempest-RoutersAdminTest-1330337528 tempest-RoutersAdminTest-1330337528-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:35:56.265960 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3480/6992] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:35:56 2022] DELETE /identity/v3/projects/ad6147036c324610827fa7acdc284208 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:35:56.281242 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3349d5-672e-423a-9dd8-79a3aabac0a0 tempest-RoutersAdminTest-1330337528 tempest-RoutersAdminTest-1330337528-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:35:56.283988 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-ae3349d5-672e-423a-9dd8-79a3aabac0a0 tempest-RoutersAdminTest-1330337528 tempest-RoutersAdminTest-1330337528-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:56.335265 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:35:56.357079 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3349d5-672e-423a-9dd8-79a3aabac0a0 tempest-RoutersAdminTest-1330337528 tempest-RoutersAdminTest-1330337528-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:35:56.410899 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bade1b88-1125-49c1-aa1d-195dd2d6ef98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:35:56.411588 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bade1b88-1125-49c1-aa1d-195dd2d6ef98 service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:56.411933 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bade1b88-1125-49c1-aa1d-195dd2d6ef98 service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:56.412386 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bade1b88-1125-49c1-aa1d-195dd2d6ef98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:56.414271 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-bade1b88-1125-49c1-aa1d-195dd2d6ef98 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:56.513237 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bade1b88-1125-49c1-aa1d-195dd2d6ef98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:35:56.515497 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bade1b88-1125-49c1-aa1d-195dd2d6ef98 service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:35:56.526123 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3513/6993] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:35:56 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:35:56.909083 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e65a3c-aaf0-4511-ab42-5f5089b9369c None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:35:56.909504 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e65a3c-aaf0-4511-ab42-5f5089b9369c None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:35:56.910137 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e65a3c-aaf0-4511-ab42-5f5089b9369c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:35:56.986527 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-68e65a3c-aaf0-4511-ab42-5f5089b9369c None None] MFA Rules not processed for user `131c0adf29f245b9ba4625da19f709a5`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:35:56.988677 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-68e65a3c-aaf0-4511-ab42-5f5089b9369c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:35:57.049147 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=86,keystone:INSERT=7,keystone:DELETE=7 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:35:57.098406 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3481/6994] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:35:56 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:36:00.236500 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bade1b88-1125-49c1-aa1d-195dd2d6ef98 service neutron] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:00.238157 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-bade1b88-1125-49c1-aa1d-195dd2d6ef98 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:36:00.325876 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bade1b88-1125-49c1-aa1d-195dd2d6ef98 service neutron] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:00.331007 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63218b61-0b4e-4a5d-aac1-e546c26e15d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:00.332026 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63218b61-0b4e-4a5d-aac1-e546c26e15d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:00.332316 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63218b61-0b4e-4a5d-aac1-e546c26e15d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:00.332587 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63218b61-0b4e-4a5d-aac1-e546c26e15d0 admin admin] PATH_INFO: `/v3/users/97f2db84c3644b7fadb0fb3fcca28078` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:00.334242 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63218b61-0b4e-4a5d-aac1-e546c26e15d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97f2db84c3644b7fadb0fb3fcca28078)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:00.336161 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63218b61-0b4e-4a5d-aac1-e546c26e15d0 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:00.411401 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-63218b61-0b4e-4a5d-aac1-e546c26e15d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97f2db84c3644b7fadb0fb3fcca28078'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:00.412153 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-63218b61-0b4e-4a5d-aac1-e546c26e15d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97f2db84c3644b7fadb0fb3fcca28078'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:00.414633 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:36:00.427000 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-63218b61-0b4e-4a5d-aac1-e546c26e15d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97f2db84c3644b7fadb0fb3fcca28078'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:00.439588 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-63218b61-0b4e-4a5d-aac1-e546c26e15d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97f2db84c3644b7fadb0fb3fcca28078'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:00.455526 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-63218b61-0b4e-4a5d-aac1-e546c26e15d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97f2db84c3644b7fadb0fb3fcca28078'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:00.462525 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3514/6995] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:36:00 2022] DELETE /identity/v3/users/97f2db84c3644b7fadb0fb3fcca28078 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:36:01.301143 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e65a3c-aaf0-4511-ab42-5f5089b9369c None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:01.329075 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e65a3c-aaf0-4511-ab42-5f5089b9369c None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:01.434104 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae32a3d4-4e61-439f-a1f8-41f23f372303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:01.435179 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae32a3d4-4e61-439f-a1f8-41f23f372303 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:01.435467 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae32a3d4-4e61-439f-a1f8-41f23f372303 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:01.435744 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae32a3d4-4e61-439f-a1f8-41f23f372303 admin admin] PATH_INFO: `/v3/projects/a05a3f349b3a41ef8378d593a8a2945b` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:01.438038 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae32a3d4-4e61-439f-a1f8-41f23f372303 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a05a3f349b3a41ef8378d593a8a2945b)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:01.440779 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae32a3d4-4e61-439f-a1f8-41f23f372303 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:01.534828 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-ae32a3d4-4e61-439f-a1f8-41f23f372303 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a05a3f349b3a41ef8378d593a8a2945b', 'request_id': 'req-ae32a3d4-4e61-439f-a1f8-41f23f372303'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:01.545079 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-ae32a3d4-4e61-439f-a1f8-41f23f372303 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a05a3f349b3a41ef8378d593a8a2945b', 'request_id': 'req-ae32a3d4-4e61-439f-a1f8-41f23f372303'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:01.551486 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-ae32a3d4-4e61-439f-a1f8-41f23f372303 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a05a3f349b3a41ef8378d593a8a2945b', 'request_id': 'req-ae32a3d4-4e61-439f-a1f8-41f23f372303'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:01.568063 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-ae32a3d4-4e61-439f-a1f8-41f23f372303 admin admin] The token cache is being invalidate because project a05a3f349b3a41ef8378d593a8a2945b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:36:01.568430 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-ae32a3d4-4e61-439f-a1f8-41f23f372303 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:01.569498 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-ae32a3d4-4e61-439f-a1f8-41f23f372303 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:01.571503 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3482/6996] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:36:01 2022] DELETE /identity/v3/projects/a05a3f349b3a41ef8378d593a8a2945b => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:36:01.575804 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63218b61-0b4e-4a5d-aac1-e546c26e15d0 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:01.577814 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-63218b61-0b4e-4a5d-aac1-e546c26e15d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:36:01.596329 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63218b61-0b4e-4a5d-aac1-e546c26e15d0 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:01.660754 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e05923c-7bbb-4195-896b-5a2860078d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:01.661762 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e05923c-7bbb-4195-896b-5a2860078d5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:01.662136 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e05923c-7bbb-4195-896b-5a2860078d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:01.662471 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e05923c-7bbb-4195-896b-5a2860078d5e admin admin] PATH_INFO: `/v3/users/131c0adf29f245b9ba4625da19f709a5` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:01.663747 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e05923c-7bbb-4195-896b-5a2860078d5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=131c0adf29f245b9ba4625da19f709a5)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:01.665725 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e05923c-7bbb-4195-896b-5a2860078d5e admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:01.727715 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-8e05923c-7bbb-4195-896b-5a2860078d5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '131c0adf29f245b9ba4625da19f709a5'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:01.728115 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-8e05923c-7bbb-4195-896b-5a2860078d5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '131c0adf29f245b9ba4625da19f709a5'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:01.738653 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-8e05923c-7bbb-4195-896b-5a2860078d5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '131c0adf29f245b9ba4625da19f709a5'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:01.747840 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-8e05923c-7bbb-4195-896b-5a2860078d5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '131c0adf29f245b9ba4625da19f709a5'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:01.787767 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-8e05923c-7bbb-4195-896b-5a2860078d5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '131c0adf29f245b9ba4625da19f709a5'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:01.800976 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3515/6997] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:36:01 2022] DELETE /identity/v3/users/131c0adf29f245b9ba4625da19f709a5 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:36:02.592848 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae32a3d4-4e61-439f-a1f8-41f23f372303 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:02.595339 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-ae32a3d4-4e61-439f-a1f8-41f23f372303 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:36:02.613425 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae32a3d4-4e61-439f-a1f8-41f23f372303 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:02.684720 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30935d22-390e-4ca6-9b69-576de9c347a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:02.685618 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30935d22-390e-4ca6-9b69-576de9c347a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:02.685936 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30935d22-390e-4ca6-9b69-576de9c347a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:02.686614 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30935d22-390e-4ca6-9b69-576de9c347a1 admin admin] PATH_INFO: `/v3/projects/97b3db257ebd4e5ba349ff943df49d0e` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:02.687556 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30935d22-390e-4ca6-9b69-576de9c347a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=97b3db257ebd4e5ba349ff943df49d0e)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:02.689539 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30935d22-390e-4ca6-9b69-576de9c347a1 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:02.711834 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:36:02.769288 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-30935d22-390e-4ca6-9b69-576de9c347a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97b3db257ebd4e5ba349ff943df49d0e', 'request_id': 'req-30935d22-390e-4ca6-9b69-576de9c347a1'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:02.788486 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-30935d22-390e-4ca6-9b69-576de9c347a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97b3db257ebd4e5ba349ff943df49d0e', 'request_id': 'req-30935d22-390e-4ca6-9b69-576de9c347a1'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:02.800846 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-30935d22-390e-4ca6-9b69-576de9c347a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97b3db257ebd4e5ba349ff943df49d0e', 'request_id': 'req-30935d22-390e-4ca6-9b69-576de9c347a1'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:02.848615 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-30935d22-390e-4ca6-9b69-576de9c347a1 admin admin] The token cache is being invalidate because project 97b3db257ebd4e5ba349ff943df49d0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:36:02.850276 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-30935d22-390e-4ca6-9b69-576de9c347a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:02.855209 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-30935d22-390e-4ca6-9b69-576de9c347a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:02.867168 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3483/6998] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:36:02 2022] DELETE /identity/v3/projects/97b3db257ebd4e5ba349ff943df49d0e => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:36:02.869024 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd66b86-dd59-481d-b364-83610ce79e97 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:02.869500 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd66b86-dd59-481d-b364-83610ce79e97 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:02.869720 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd66b86-dd59-481d-b364-83610ce79e97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:02.891324 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-acd66b86-dd59-481d-b364-83610ce79e97 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:36:02.892644 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-acd66b86-dd59-481d-b364-83610ce79e97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:36:02.957679 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:36:02.983835 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3516/6999] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:36:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:36:02.993794 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9c63ac-72be-48f7-9276-a23698de3baf None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:02.994115 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9c63ac-72be-48f7-9276-a23698de3baf None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:02.994435 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9c63ac-72be-48f7-9276-a23698de3baf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:03.026396 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-1e9c63ac-72be-48f7-9276-a23698de3baf None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:36:03.028126 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-1e9c63ac-72be-48f7-9276-a23698de3baf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:36:03.048405 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3484/7000] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:36:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:36:03.052942 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd66b86-dd59-481d-b364-83610ce79e97 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:03.065112 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd66b86-dd59-481d-b364-83610ce79e97 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:03.072842 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24feaf19-9c96-49b0-8cf0-60865b129729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:03.073546 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24feaf19-9c96-49b0-8cf0-60865b129729 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:03.073822 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24feaf19-9c96-49b0-8cf0-60865b129729 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:03.074330 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24feaf19-9c96-49b0-8cf0-60865b129729 admin admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:03.075268 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24feaf19-9c96-49b0-8cf0-60865b129729 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:36:03.075743 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24feaf19-9c96-49b0-8cf0-60865b129729 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:03.079938 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24feaf19-9c96-49b0-8cf0-60865b129729 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:03.094994 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3517/7001] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:36:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:36:03.100023 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9c63ac-72be-48f7-9276-a23698de3baf None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:03.110587 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9c63ac-72be-48f7-9276-a23698de3baf None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:03.118936 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72119ed4-fccf-408c-a6f8-440a76c94af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:03.119799 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72119ed4-fccf-408c-a6f8-440a76c94af3 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:03.120081 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72119ed4-fccf-408c-a6f8-440a76c94af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:03.120359 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72119ed4-fccf-408c-a6f8-440a76c94af3 admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:03.121067 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72119ed4-fccf-408c-a6f8-440a76c94af3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:03.123237 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72119ed4-fccf-408c-a6f8-440a76c94af3 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:03.167461 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3485/7002] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:36:03 2022] POST /identity/v3/projects => generated 365 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:36:03.172246 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24feaf19-9c96-49b0-8cf0-60865b129729 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:03.188586 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24feaf19-9c96-49b0-8cf0-60865b129729 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:03.286503 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6787019a-de3d-4fad-98e2-e77336c23785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:03.287874 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6787019a-de3d-4fad-98e2-e77336c23785 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:03.288471 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6787019a-de3d-4fad-98e2-e77336c23785 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:03.289550 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6787019a-de3d-4fad-98e2-e77336c23785 admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:03.290747 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6787019a-de3d-4fad-98e2-e77336c23785 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:03.293224 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6787019a-de3d-4fad-98e2-e77336c23785 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:03.324909 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3518/7003] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:36:03 2022] POST /identity/v3/users => generated 283 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:36:03.329244 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72119ed4-fccf-408c-a6f8-440a76c94af3 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:03.342161 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72119ed4-fccf-408c-a6f8-440a76c94af3 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:03.348097 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0451cc46-1160-438d-b2b8-f74f7296318c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:03.348778 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0451cc46-1160-438d-b2b8-f74f7296318c admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:03.349109 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0451cc46-1160-438d-b2b8-f74f7296318c admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:03.349391 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0451cc46-1160-438d-b2b8-f74f7296318c admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:03.350340 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0451cc46-1160-438d-b2b8-f74f7296318c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:03.351892 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0451cc46-1160-438d-b2b8-f74f7296318c admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:03.363880 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3486/7004] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:36:03 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 21:36:03.367910 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6787019a-de3d-4fad-98e2-e77336c23785 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:03.382387 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6787019a-de3d-4fad-98e2-e77336c23785 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:03.387504 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4485b030-0048-4c12-8baf-cad74da85e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:03.388361 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4485b030-0048-4c12-8baf-cad74da85e90 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:03.388987 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4485b030-0048-4c12-8baf-cad74da85e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:03.389385 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4485b030-0048-4c12-8baf-cad74da85e90 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:03.390258 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4485b030-0048-4c12-8baf-cad74da85e90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:03.392008 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4485b030-0048-4c12-8baf-cad74da85e90 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:03.407299 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3519/7005] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:36:03 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 21:36:03.409110 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0451cc46-1160-438d-b2b8-f74f7296318c admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:03.419584 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0451cc46-1160-438d-b2b8-f74f7296318c admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:03.425705 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cea25b6-eab0-4e30-8573-30909d93b2d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:03.426651 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cea25b6-eab0-4e30-8573-30909d93b2d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:03.426920 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cea25b6-eab0-4e30-8573-30909d93b2d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:03.427196 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cea25b6-eab0-4e30-8573-30909d93b2d3 admin admin] PATH_INFO: `/v3/projects/18e0e5c0c68b41aaa3c84f7012f10b62/users/c4348defaf69401480315d4f6ba4f148/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:03.444143 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cea25b6-eab0-4e30-8573-30909d93b2d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18e0e5c0c68b41aaa3c84f7012f10b62, user_id=c4348defaf69401480315d4f6ba4f148, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:03.446894 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cea25b6-eab0-4e30-8573-30909d93b2d3 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:03.465911 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3487/7006] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:36:03 2022] PUT /identity/v3/projects/18e0e5c0c68b41aaa3c84f7012f10b62/users/c4348defaf69401480315d4f6ba4f148/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:36:03.475905 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a29f51d-f5ea-4c1c-bb50-26276890dd0e None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:03.477164 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a29f51d-f5ea-4c1c-bb50-26276890dd0e None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:03.477164 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a29f51d-f5ea-4c1c-bb50-26276890dd0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:03.515533 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-6a29f51d-f5ea-4c1c-bb50-26276890dd0e None None] MFA Rules not processed for user `c4348defaf69401480315d4f6ba4f148`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:36:03.516702 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-6a29f51d-f5ea-4c1c-bb50-26276890dd0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:36:03.592921 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3520/7007] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:36:03 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:36:03.597749 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cea25b6-eab0-4e30-8573-30909d93b2d3 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:03.677368 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cea25b6-eab0-4e30-8573-30909d93b2d3 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:03.683363 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a28725f-f4bd-4e26-ac77-f945ac51e96b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:03.684063 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a28725f-f4bd-4e26-ac77-f945ac51e96b admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:03.684368 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a28725f-f4bd-4e26-ac77-f945ac51e96b admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:03.684618 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a28725f-f4bd-4e26-ac77-f945ac51e96b admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:03.685427 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a28725f-f4bd-4e26-ac77-f945ac51e96b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:03.687539 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a28725f-f4bd-4e26-ac77-f945ac51e96b admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:03.725723 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a29f51d-f5ea-4c1c-bb50-26276890dd0e None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:03.733214 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3488/7008] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:36:03 2022] POST /identity/v3/projects => generated 365 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:36:03.742337 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a29f51d-f5ea-4c1c-bb50-26276890dd0e None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:03.792386 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:36:03.816200 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5334e1b9-72a1-4416-9e4a-c2700d6b1be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:03.817068 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5334e1b9-72a1-4416-9e4a-c2700d6b1be6 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:03.817593 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5334e1b9-72a1-4416-9e4a-c2700d6b1be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:03.818014 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5334e1b9-72a1-4416-9e4a-c2700d6b1be6 admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:03.819320 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5334e1b9-72a1-4416-9e4a-c2700d6b1be6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:03.820872 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5334e1b9-72a1-4416-9e4a-c2700d6b1be6 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:03.846381 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3521/7009] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:36:03 2022] POST /identity/v3/users => generated 289 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:36:03.849836 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a28725f-f4bd-4e26-ac77-f945ac51e96b admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:03.862678 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a28725f-f4bd-4e26-ac77-f945ac51e96b admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:03.867849 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44f7d29-03e6-463b-a1d5-711ae70df086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:03.869171 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44f7d29-03e6-463b-a1d5-711ae70df086 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:03.869567 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44f7d29-03e6-463b-a1d5-711ae70df086 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:03.869975 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44f7d29-03e6-463b-a1d5-711ae70df086 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:03.870832 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44f7d29-03e6-463b-a1d5-711ae70df086 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:03.872651 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44f7d29-03e6-463b-a1d5-711ae70df086 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:03.890415 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3489/7010] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:36:03 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:36:03.891637 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5334e1b9-72a1-4416-9e4a-c2700d6b1be6 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:03.904134 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5334e1b9-72a1-4416-9e4a-c2700d6b1be6 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:03.909754 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0f303e-7d31-4d13-87e9-ed81de3b57cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:03.910734 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0f303e-7d31-4d13-87e9-ed81de3b57cf admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:03.911010 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0f303e-7d31-4d13-87e9-ed81de3b57cf admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:03.911281 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0f303e-7d31-4d13-87e9-ed81de3b57cf admin admin] PATH_INFO: `/v3/projects/79fb8b186d6f47349e8c83916c963e41/users/f99cba6d762041859a930e49b24bff3c/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:03.932026 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0f303e-7d31-4d13-87e9-ed81de3b57cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=79fb8b186d6f47349e8c83916c963e41, user_id=f99cba6d762041859a930e49b24bff3c, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:03.934853 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0f303e-7d31-4d13-87e9-ed81de3b57cf admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:03.964090 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3522/7011] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:36:03 2022] PUT /identity/v3/projects/79fb8b186d6f47349e8c83916c963e41/users/f99cba6d762041859a930e49b24bff3c/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:36:03.966379 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44f7d29-03e6-463b-a1d5-711ae70df086 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:03.980549 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44f7d29-03e6-463b-a1d5-711ae70df086 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:03.997963 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:36:04.060316 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c648c1-4e6b-470a-839e-e9befd2a20c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:04.061103 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c648c1-4e6b-470a-839e-e9befd2a20c7 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:04.061483 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c648c1-4e6b-470a-839e-e9befd2a20c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:04.061880 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c648c1-4e6b-470a-839e-e9befd2a20c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:04.062734 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c648c1-4e6b-470a-839e-e9befd2a20c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:04.064603 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c648c1-4e6b-470a-839e-e9befd2a20c7 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:04.078777 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3490/7012] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:36:03 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:36:04.080093 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0f303e-7d31-4d13-87e9-ed81de3b57cf admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:04.091843 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0f303e-7d31-4d13-87e9-ed81de3b57cf admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:04.098426 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40d27db-d96a-472d-b5ad-da70e73721fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:04.099424 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40d27db-d96a-472d-b5ad-da70e73721fb admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:04.099769 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40d27db-d96a-472d-b5ad-da70e73721fb admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:04.100109 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40d27db-d96a-472d-b5ad-da70e73721fb admin admin] PATH_INFO: `/v3/projects/79fb8b186d6f47349e8c83916c963e41/users/f99cba6d762041859a930e49b24bff3c/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:04.102168 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40d27db-d96a-472d-b5ad-da70e73721fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=79fb8b186d6f47349e8c83916c963e41, user_id=f99cba6d762041859a930e49b24bff3c, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:04.104898 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40d27db-d96a-472d-b5ad-da70e73721fb admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:04.123736 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3523/7013] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:36:04 2022] PUT /identity/v3/projects/79fb8b186d6f47349e8c83916c963e41/users/f99cba6d762041859a930e49b24bff3c/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:36:04.129055 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8ecfb5-5bfa-4278-8802-b1b7ecbd9eef None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:04.129476 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8ecfb5-5bfa-4278-8802-b1b7ecbd9eef None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:04.131047 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8ecfb5-5bfa-4278-8802-b1b7ecbd9eef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:04.162443 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-9b8ecfb5-5bfa-4278-8802-b1b7ecbd9eef None None] MFA Rules not processed for user `f99cba6d762041859a930e49b24bff3c`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:36:04.163807 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-9b8ecfb5-5bfa-4278-8802-b1b7ecbd9eef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:36:04.281250 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3491/7014] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:36:04 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:36:04.294858 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40d27db-d96a-472d-b5ad-da70e73721fb admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:04.297795 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-e40d27db-d96a-472d-b5ad-da70e73721fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:36:04.396332 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40d27db-d96a-472d-b5ad-da70e73721fb admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:04.402003 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf0feb6-6399-4360-9c1d-fb4b1ec01899 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec5fd3a489c341b7964704d689037f05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:04.402682 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf0feb6-6399-4360-9c1d-fb4b1ec01899 service cinder] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:04.402970 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf0feb6-6399-4360-9c1d-fb4b1ec01899 service cinder] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:04.403249 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf0feb6-6399-4360-9c1d-fb4b1ec01899 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:04.416756 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf0feb6-6399-4360-9c1d-fb4b1ec01899 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:04.418597 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf0feb6-6399-4360-9c1d-fb4b1ec01899 service cinder] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:04.430473 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3524/7015] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:36:04 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 23 21:36:04.529962 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8ecfb5-5bfa-4278-8802-b1b7ecbd9eef None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:04.544776 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8ecfb5-5bfa-4278-8802-b1b7ecbd9eef None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:04.548831 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376690f8-d1e0-4bfb-8c71-95bc9a9397a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec5fd3a489c341b7964704d689037f05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:04.549975 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376690f8-d1e0-4bfb-8c71-95bc9a9397a5 service cinder] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:04.549975 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376690f8-d1e0-4bfb-8c71-95bc9a9397a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:04.550253 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376690f8-d1e0-4bfb-8c71-95bc9a9397a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:04.633109 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376690f8-d1e0-4bfb-8c71-95bc9a9397a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:04.635788 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376690f8-d1e0-4bfb-8c71-95bc9a9397a5 service cinder] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:04.657741 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3492/7016] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:36:04 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:36:06.498051 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf0feb6-6399-4360-9c1d-fb4b1ec01899 service cinder] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:06.596241 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf0feb6-6399-4360-9c1d-fb4b1ec01899 service cinder] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:06.605695 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d69234-c9dd-41ac-a818-aa47ed7dabb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:06.606666 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d69234-c9dd-41ac-a818-aa47ed7dabb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:06.606947 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d69234-c9dd-41ac-a818-aa47ed7dabb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:06.607642 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d69234-c9dd-41ac-a818-aa47ed7dabb5 admin admin] PATH_INFO: `/v3/users/c4348defaf69401480315d4f6ba4f148` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:06.609127 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d69234-c9dd-41ac-a818-aa47ed7dabb5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4348defaf69401480315d4f6ba4f148)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:06.611419 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d69234-c9dd-41ac-a818-aa47ed7dabb5 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:06.691312 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:36:06.723784 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-f7d69234-c9dd-41ac-a818-aa47ed7dabb5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4348defaf69401480315d4f6ba4f148'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:06.724385 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-f7d69234-c9dd-41ac-a818-aa47ed7dabb5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4348defaf69401480315d4f6ba4f148'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:06.750707 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-f7d69234-c9dd-41ac-a818-aa47ed7dabb5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4348defaf69401480315d4f6ba4f148'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:06.771088 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-f7d69234-c9dd-41ac-a818-aa47ed7dabb5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4348defaf69401480315d4f6ba4f148'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:06.796225 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-f7d69234-c9dd-41ac-a818-aa47ed7dabb5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4348defaf69401480315d4f6ba4f148'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:06.811841 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3525/7017] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:36:06 2022] DELETE /identity/v3/users/c4348defaf69401480315d4f6ba4f148 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:36:06.824579 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7622f3b-647f-41b4-b97e-adddec618939 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:06.825112 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7622f3b-647f-41b4-b97e-adddec618939 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:06.825112 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7622f3b-647f-41b4-b97e-adddec618939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:06.854880 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-b7622f3b-647f-41b4-b97e-adddec618939 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:36:06.859598 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-b7622f3b-647f-41b4-b97e-adddec618939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:36:06.903074 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:36:06.971949 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3493/7018] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:36:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:36:06.987535 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d69234-c9dd-41ac-a818-aa47ed7dabb5 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:06.989012 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-f7d69234-c9dd-41ac-a818-aa47ed7dabb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:36:07.108853 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d69234-c9dd-41ac-a818-aa47ed7dabb5 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:07.112870 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c45ddf8-90f0-4f1c-ab1e-3e2c6afd6c99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:07.113546 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c45ddf8-90f0-4f1c-ab1e-3e2c6afd6c99 service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:07.113895 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c45ddf8-90f0-4f1c-ab1e-3e2c6afd6c99 service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:07.115588 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c45ddf8-90f0-4f1c-ab1e-3e2c6afd6c99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:07.128538 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c45ddf8-90f0-4f1c-ab1e-3e2c6afd6c99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:07.141889 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c45ddf8-90f0-4f1c-ab1e-3e2c6afd6c99 service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:07.170130 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3526/7019] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:36:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:36:08.268495 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7622f3b-647f-41b4-b97e-adddec618939 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:08.270151 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-b7622f3b-647f-41b4-b97e-adddec618939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:36:08.285566 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7622f3b-647f-41b4-b97e-adddec618939 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:08.302006 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9d9331-b1c0-49a8-96fd-19aa2223f1ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:08.302834 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9d9331-b1c0-49a8-96fd-19aa2223f1ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:08.303118 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9d9331-b1c0-49a8-96fd-19aa2223f1ae admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:08.303394 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9d9331-b1c0-49a8-96fd-19aa2223f1ae admin admin] PATH_INFO: `/v3/projects/18e0e5c0c68b41aaa3c84f7012f10b62` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:08.307861 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9d9331-b1c0-49a8-96fd-19aa2223f1ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=18e0e5c0c68b41aaa3c84f7012f10b62)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:08.310564 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9d9331-b1c0-49a8-96fd-19aa2223f1ae admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:08.380147 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-fd9d9331-b1c0-49a8-96fd-19aa2223f1ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18e0e5c0c68b41aaa3c84f7012f10b62', 'request_id': 'req-fd9d9331-b1c0-49a8-96fd-19aa2223f1ae'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:08.392632 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-fd9d9331-b1c0-49a8-96fd-19aa2223f1ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18e0e5c0c68b41aaa3c84f7012f10b62', 'request_id': 'req-fd9d9331-b1c0-49a8-96fd-19aa2223f1ae'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:08.401815 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-fd9d9331-b1c0-49a8-96fd-19aa2223f1ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18e0e5c0c68b41aaa3c84f7012f10b62', 'request_id': 'req-fd9d9331-b1c0-49a8-96fd-19aa2223f1ae'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:08.416333 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-fd9d9331-b1c0-49a8-96fd-19aa2223f1ae admin admin] The token cache is being invalidate because project 18e0e5c0c68b41aaa3c84f7012f10b62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:36:08.416779 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-fd9d9331-b1c0-49a8-96fd-19aa2223f1ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:08.417625 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-fd9d9331-b1c0-49a8-96fd-19aa2223f1ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:08.419362 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3494/7020] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:36:08 2022] DELETE /identity/v3/projects/18e0e5c0c68b41aaa3c84f7012f10b62 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:36:08.423936 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c45ddf8-90f0-4f1c-ab1e-3e2c6afd6c99 service neutron] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:08.439506 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c45ddf8-90f0-4f1c-ab1e-3e2c6afd6c99 service neutron] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:08.523227 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b919db43-1dce-464c-8b39-876ac6b43faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:08.524409 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b919db43-1dce-464c-8b39-876ac6b43faf admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:08.526170 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b919db43-1dce-464c-8b39-876ac6b43faf admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:08.526574 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b919db43-1dce-464c-8b39-876ac6b43faf admin admin] PATH_INFO: `/v3/users/f99cba6d762041859a930e49b24bff3c` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:08.529472 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b919db43-1dce-464c-8b39-876ac6b43faf admin admin] RBAC: Authorizing `identity:delete_user(user_id=f99cba6d762041859a930e49b24bff3c)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:08.532129 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b919db43-1dce-464c-8b39-876ac6b43faf admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:08.645662 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-b919db43-1dce-464c-8b39-876ac6b43faf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f99cba6d762041859a930e49b24bff3c'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:08.646777 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-b919db43-1dce-464c-8b39-876ac6b43faf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f99cba6d762041859a930e49b24bff3c'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:08.653449 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:36:08.659813 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-b919db43-1dce-464c-8b39-876ac6b43faf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f99cba6d762041859a930e49b24bff3c'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:08.690999 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-b919db43-1dce-464c-8b39-876ac6b43faf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f99cba6d762041859a930e49b24bff3c'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:08.728304 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-b919db43-1dce-464c-8b39-876ac6b43faf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f99cba6d762041859a930e49b24bff3c'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:08.747840 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3527/7021] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:36:08 2022] DELETE /identity/v3/users/f99cba6d762041859a930e49b24bff3c => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:36:09.860512 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9d9331-b1c0-49a8-96fd-19aa2223f1ae admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:09.865514 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-fd9d9331-b1c0-49a8-96fd-19aa2223f1ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:36:09.895389 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9d9331-b1c0-49a8-96fd-19aa2223f1ae admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:10.057320 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f4c0da-ebb8-46e8-9754-75047aff3d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:10.058367 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f4c0da-ebb8-46e8-9754-75047aff3d19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:10.059016 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f4c0da-ebb8-46e8-9754-75047aff3d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:10.059652 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f4c0da-ebb8-46e8-9754-75047aff3d19 admin admin] PATH_INFO: `/v3/projects/79fb8b186d6f47349e8c83916c963e41` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:10.061081 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f4c0da-ebb8-46e8-9754-75047aff3d19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=79fb8b186d6f47349e8c83916c963e41)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:10.063802 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f4c0da-ebb8-46e8-9754-75047aff3d19 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:10.159319 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-c1f4c0da-ebb8-46e8-9754-75047aff3d19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79fb8b186d6f47349e8c83916c963e41', 'request_id': 'req-c1f4c0da-ebb8-46e8-9754-75047aff3d19'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:10.176511 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-c1f4c0da-ebb8-46e8-9754-75047aff3d19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79fb8b186d6f47349e8c83916c963e41', 'request_id': 'req-c1f4c0da-ebb8-46e8-9754-75047aff3d19'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:10.195983 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:36:10.201885 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-c1f4c0da-ebb8-46e8-9754-75047aff3d19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79fb8b186d6f47349e8c83916c963e41', 'request_id': 'req-c1f4c0da-ebb8-46e8-9754-75047aff3d19'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:10.230264 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-c1f4c0da-ebb8-46e8-9754-75047aff3d19 admin admin] The token cache is being invalidate because project 79fb8b186d6f47349e8c83916c963e41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:36:10.230618 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-c1f4c0da-ebb8-46e8-9754-75047aff3d19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:10.234471 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-c1f4c0da-ebb8-46e8-9754-75047aff3d19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:10.238680 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3495/7022] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:36:09 2022] DELETE /identity/v3/projects/79fb8b186d6f47349e8c83916c963e41 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:36:10.243543 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea04e7b-3c59-4484-aa82-737c962d8164 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:10.244091 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea04e7b-3c59-4484-aa82-737c962d8164 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:10.244091 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea04e7b-3c59-4484-aa82-737c962d8164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:10.276489 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-0ea04e7b-3c59-4484-aa82-737c962d8164 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:36:10.281373 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-0ea04e7b-3c59-4484-aa82-737c962d8164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:36:10.394939 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3528/7023] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:36:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:36:10.403283 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a574e6-114c-4aae-acba-2acc8ba0a510 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:10.403918 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a574e6-114c-4aae-acba-2acc8ba0a510 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:10.404386 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a574e6-114c-4aae-acba-2acc8ba0a510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:10.425141 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-e0a574e6-114c-4aae-acba-2acc8ba0a510 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:36:10.426980 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-e0a574e6-114c-4aae-acba-2acc8ba0a510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:36:10.458886 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea04e7b-3c59-4484-aa82-737c962d8164 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:10.466029 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3496/7024] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:36:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:36:10.474570 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea04e7b-3c59-4484-aa82-737c962d8164 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:10.481938 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cac17a-fb00-435c-aa99-e18aecc90b21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:10.486540 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cac17a-fb00-435c-aa99-e18aecc90b21 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:10.486814 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cac17a-fb00-435c-aa99-e18aecc90b21 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:10.487092 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cac17a-fb00-435c-aa99-e18aecc90b21 admin admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:10.487849 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cac17a-fb00-435c-aa99-e18aecc90b21 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:36:10.488156 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cac17a-fb00-435c-aa99-e18aecc90b21 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:10.490247 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cac17a-fb00-435c-aa99-e18aecc90b21 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:10.508293 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3529/7025] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:36:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:36:10.509166 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a574e6-114c-4aae-acba-2acc8ba0a510 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:10.520790 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a574e6-114c-4aae-acba-2acc8ba0a510 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:10.527283 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e13705-8574-4330-9948-bf4831670638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:10.528287 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e13705-8574-4330-9948-bf4831670638 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:10.528559 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e13705-8574-4330-9948-bf4831670638 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:10.528831 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e13705-8574-4330-9948-bf4831670638 admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:10.530259 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e13705-8574-4330-9948-bf4831670638 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:10.531571 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e13705-8574-4330-9948-bf4831670638 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:10.565305 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3497/7026] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:36:10 2022] POST /identity/v3/projects => generated 385 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:36:10.569639 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cac17a-fb00-435c-aa99-e18aecc90b21 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:10.580244 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cac17a-fb00-435c-aa99-e18aecc90b21 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:10.651802 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b35e9a-4cac-44b0-9a9b-64dafa3812b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:10.652720 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b35e9a-4cac-44b0-9a9b-64dafa3812b2 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:10.653005 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b35e9a-4cac-44b0-9a9b-64dafa3812b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:10.653420 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b35e9a-4cac-44b0-9a9b-64dafa3812b2 admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:10.654389 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b35e9a-4cac-44b0-9a9b-64dafa3812b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:10.656946 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b35e9a-4cac-44b0-9a9b-64dafa3812b2 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:10.689941 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3530/7027] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:36:10 2022] POST /identity/v3/users => generated 293 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:36:10.694120 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e13705-8574-4330-9948-bf4831670638 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:10.707682 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e13705-8574-4330-9948-bf4831670638 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:10.718600 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f67f9d-bdae-488b-8ed8-3594d08564ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:10.718600 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f67f9d-bdae-488b-8ed8-3594d08564ab admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:10.718600 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f67f9d-bdae-488b-8ed8-3594d08564ab admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:10.718600 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f67f9d-bdae-488b-8ed8-3594d08564ab admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:10.718998 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f67f9d-bdae-488b-8ed8-3594d08564ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:10.719385 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f67f9d-bdae-488b-8ed8-3594d08564ab admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:10.738266 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3498/7028] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:36:10 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:36:10.742660 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b35e9a-4cac-44b0-9a9b-64dafa3812b2 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:10.760074 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b35e9a-4cac-44b0-9a9b-64dafa3812b2 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:10.766053 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf30ef87-bf62-4515-8c0e-c09fa9815231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:10.767026 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf30ef87-bf62-4515-8c0e-c09fa9815231 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:10.767510 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf30ef87-bf62-4515-8c0e-c09fa9815231 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:10.768232 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf30ef87-bf62-4515-8c0e-c09fa9815231 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:10.769139 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf30ef87-bf62-4515-8c0e-c09fa9815231 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:10.777148 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf30ef87-bf62-4515-8c0e-c09fa9815231 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:10.812660 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3531/7029] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:36:10 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:36:10.818140 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f67f9d-bdae-488b-8ed8-3594d08564ab admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:10.839349 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f67f9d-bdae-488b-8ed8-3594d08564ab admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:10.848008 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7c2e5e-6bb7-4964-b0c1-8056f231326c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:10.848975 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7c2e5e-6bb7-4964-b0c1-8056f231326c admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:10.849998 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7c2e5e-6bb7-4964-b0c1-8056f231326c admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:10.849998 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7c2e5e-6bb7-4964-b0c1-8056f231326c admin admin] PATH_INFO: `/v3/projects/0f657f4884ab4cd3946571238495c538/users/5e917eef5ed54056a8d2a6a4dd522431/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:10.872568 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7c2e5e-6bb7-4964-b0c1-8056f231326c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f657f4884ab4cd3946571238495c538, user_id=5e917eef5ed54056a8d2a6a4dd522431, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:10.878841 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7c2e5e-6bb7-4964-b0c1-8056f231326c admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:10.899726 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3499/7030] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:36:10 2022] PUT /identity/v3/projects/0f657f4884ab4cd3946571238495c538/users/5e917eef5ed54056a8d2a6a4dd522431/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:36:10.910164 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e10768-24d4-450c-af9c-fc44744a3cca None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:10.910531 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e10768-24d4-450c-af9c-fc44744a3cca None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:10.910880 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e10768-24d4-450c-af9c-fc44744a3cca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:10.949182 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-77e10768-24d4-450c-af9c-fc44744a3cca None None] MFA Rules not processed for user `5e917eef5ed54056a8d2a6a4dd522431`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:36:10.950175 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-77e10768-24d4-450c-af9c-fc44744a3cca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:36:10.983825 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:36:11.056152 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3532/7031] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:36:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:36:11.056331 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7c2e5e-6bb7-4964-b0c1-8056f231326c admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:11.175540 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7c2e5e-6bb7-4964-b0c1-8056f231326c admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:11.190286 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c5596e-62cb-4796-a679-54a6419b1711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:11.190987 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c5596e-62cb-4796-a679-54a6419b1711 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:11.191274 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c5596e-62cb-4796-a679-54a6419b1711 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:11.191547 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c5596e-62cb-4796-a679-54a6419b1711 admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:11.192259 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c5596e-62cb-4796-a679-54a6419b1711 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:11.194232 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c5596e-62cb-4796-a679-54a6419b1711 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:11.253037 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e10768-24d4-450c-af9c-fc44744a3cca None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:11.254611 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3500/7032] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:36:11 2022] POST /identity/v3/projects => generated 385 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:36:11.278379 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e10768-24d4-450c-af9c-fc44744a3cca None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:11.376079 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22fee7e-5786-4c8c-bb62-c102f45f349b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:11.376894 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22fee7e-5786-4c8c-bb62-c102f45f349b admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:11.377244 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22fee7e-5786-4c8c-bb62-c102f45f349b admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:11.378201 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22fee7e-5786-4c8c-bb62-c102f45f349b admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:11.378992 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22fee7e-5786-4c8c-bb62-c102f45f349b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:11.383876 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22fee7e-5786-4c8c-bb62-c102f45f349b admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:11.416025 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3533/7033] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:36:11 2022] POST /identity/v3/users => generated 293 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:36:11.420752 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c5596e-62cb-4796-a679-54a6419b1711 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:11.433364 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c5596e-62cb-4796-a679-54a6419b1711 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:11.439382 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b366ed73-541d-4973-b350-94351b10ee4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:11.440268 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b366ed73-541d-4973-b350-94351b10ee4f admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:11.440739 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b366ed73-541d-4973-b350-94351b10ee4f admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:11.441186 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b366ed73-541d-4973-b350-94351b10ee4f admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:11.442112 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b366ed73-541d-4973-b350-94351b10ee4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:11.443902 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b366ed73-541d-4973-b350-94351b10ee4f admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:11.461270 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3501/7034] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:36:11 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:36:11.461744 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22fee7e-5786-4c8c-bb62-c102f45f349b admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:11.477024 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22fee7e-5786-4c8c-bb62-c102f45f349b admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:11.482097 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ecaf26-704f-4c72-82b6-63eb5e743dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:11.483087 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ecaf26-704f-4c72-82b6-63eb5e743dd1 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:11.483087 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ecaf26-704f-4c72-82b6-63eb5e743dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:11.483325 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ecaf26-704f-4c72-82b6-63eb5e743dd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:11.484044 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ecaf26-704f-4c72-82b6-63eb5e743dd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:11.485744 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ecaf26-704f-4c72-82b6-63eb5e743dd1 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:11.506667 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3534/7035] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:36:11 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 21:36:11.511141 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b366ed73-541d-4973-b350-94351b10ee4f admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:11.525692 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b366ed73-541d-4973-b350-94351b10ee4f admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:11.533437 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4112b2-ec97-46d9-b884-4a43911093bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:11.535289 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4112b2-ec97-46d9-b884-4a43911093bd admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:11.535896 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4112b2-ec97-46d9-b884-4a43911093bd admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:11.536346 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4112b2-ec97-46d9-b884-4a43911093bd admin admin] PATH_INFO: `/v3/projects/3d2953fd068e4d1a9b6c932d955fbdb8/users/131054a2827a4ee5b7d3aae9ebcdf8aa/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:11.566102 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4112b2-ec97-46d9-b884-4a43911093bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d2953fd068e4d1a9b6c932d955fbdb8, user_id=131054a2827a4ee5b7d3aae9ebcdf8aa, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:11.568853 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4112b2-ec97-46d9-b884-4a43911093bd admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:11.586004 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3502/7036] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:36:11 2022] PUT /identity/v3/projects/3d2953fd068e4d1a9b6c932d955fbdb8/users/131054a2827a4ee5b7d3aae9ebcdf8aa/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:36:11.599128 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d026d7-1d40-4a0c-851a-9c2046904252 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:11.600309 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d026d7-1d40-4a0c-851a-9c2046904252 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:11.601380 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d026d7-1d40-4a0c-851a-9c2046904252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:11.661623 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-f1d026d7-1d40-4a0c-851a-9c2046904252 None None] MFA Rules not processed for user `131054a2827a4ee5b7d3aae9ebcdf8aa`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:36:11.664243 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-f1d026d7-1d40-4a0c-851a-9c2046904252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:36:11.783793 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3535/7037] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:36:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:36:11.789658 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4112b2-ec97-46d9-b884-4a43911093bd admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:11.869151 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:DELETE=1,keystone:SELECT=95,keystone:INSERT=4 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:36:11.921454 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4112b2-ec97-46d9-b884-4a43911093bd admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:11.928372 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cf0ee3-8734-4e0d-b3df-da071a0c45c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:11.929111 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cf0ee3-8734-4e0d-b3df-da071a0c45c3 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:11.929393 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cf0ee3-8734-4e0d-b3df-da071a0c45c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:11.929798 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cf0ee3-8734-4e0d-b3df-da071a0c45c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:11.930629 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cf0ee3-8734-4e0d-b3df-da071a0c45c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:11.932953 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cf0ee3-8734-4e0d-b3df-da071a0c45c3 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:11.961818 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3503/7038] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:36:11 2022] POST /identity/v3/projects => generated 387 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:36:11.965849 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d026d7-1d40-4a0c-851a-9c2046904252 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:11.977202 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d026d7-1d40-4a0c-851a-9c2046904252 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:12.026024 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:36:12.065583 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ccca52-2de9-40a8-bb41-7b78cd96a774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:12.066432 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ccca52-2de9-40a8-bb41-7b78cd96a774 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:12.066717 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ccca52-2de9-40a8-bb41-7b78cd96a774 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:12.066993 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ccca52-2de9-40a8-bb41-7b78cd96a774 admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:12.067687 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ccca52-2de9-40a8-bb41-7b78cd96a774 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:12.069645 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ccca52-2de9-40a8-bb41-7b78cd96a774 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:12.104654 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3536/7039] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:36:11 2022] POST /identity/v3/users => generated 300 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:36:12.108514 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cf0ee3-8734-4e0d-b3df-da071a0c45c3 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:12.120704 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cf0ee3-8734-4e0d-b3df-da071a0c45c3 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:12.128094 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce3aefb-b349-49a9-aabe-30aa8524e9c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:12.129144 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce3aefb-b349-49a9-aabe-30aa8524e9c4 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:12.129698 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce3aefb-b349-49a9-aabe-30aa8524e9c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:12.130202 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce3aefb-b349-49a9-aabe-30aa8524e9c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:12.131266 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce3aefb-b349-49a9-aabe-30aa8524e9c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:12.134445 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce3aefb-b349-49a9-aabe-30aa8524e9c4 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:12.152534 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3504/7040] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:36:12 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:36:12.156530 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ccca52-2de9-40a8-bb41-7b78cd96a774 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:12.168033 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ccca52-2de9-40a8-bb41-7b78cd96a774 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:12.174549 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5809bd0-0b97-453a-ae0f-b86d3bd72ecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:12.176760 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5809bd0-0b97-453a-ae0f-b86d3bd72ecb admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:12.177139 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5809bd0-0b97-453a-ae0f-b86d3bd72ecb admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:12.177388 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5809bd0-0b97-453a-ae0f-b86d3bd72ecb admin admin] PATH_INFO: `/v3/projects/30cba03aaf3a4861ab4594466ae952f2/users/1a58261bcee145e795328413b0289266/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:12.195458 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5809bd0-0b97-453a-ae0f-b86d3bd72ecb admin admin] RBAC: Authorizing `identity:create_grant(project_id=30cba03aaf3a4861ab4594466ae952f2, user_id=1a58261bcee145e795328413b0289266, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:12.198290 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5809bd0-0b97-453a-ae0f-b86d3bd72ecb admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:12.216807 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3537/7041] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:36:12 2022] PUT /identity/v3/projects/30cba03aaf3a4861ab4594466ae952f2/users/1a58261bcee145e795328413b0289266/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:36:12.221690 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce3aefb-b349-49a9-aabe-30aa8524e9c4 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:12.238530 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce3aefb-b349-49a9-aabe-30aa8524e9c4 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:12.313724 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5809bd0-0b97-453a-ae0f-b86d3bd72ecb admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:12.316175 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-c5809bd0-0b97-453a-ae0f-b86d3bd72ecb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:36:12.351616 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e82b1a-1423-46a0-a15e-10246bb0b372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:12.352408 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e82b1a-1423-46a0-a15e-10246bb0b372 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:12.352751 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e82b1a-1423-46a0-a15e-10246bb0b372 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:12.353030 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e82b1a-1423-46a0-a15e-10246bb0b372 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:12.353979 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e82b1a-1423-46a0-a15e-10246bb0b372 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:12.356619 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e82b1a-1423-46a0-a15e-10246bb0b372 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:12.376749 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3505/7042] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:36:12 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:36:12.379348 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e82b1a-1423-46a0-a15e-10246bb0b372 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:12.395263 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e82b1a-1423-46a0-a15e-10246bb0b372 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:12.400771 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6116f84-72a9-457c-ba80-0c0abaa73ff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:12.401779 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6116f84-72a9-457c-ba80-0c0abaa73ff4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:12.402134 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6116f84-72a9-457c-ba80-0c0abaa73ff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:12.402237 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6116f84-72a9-457c-ba80-0c0abaa73ff4 admin admin] PATH_INFO: `/v3/projects/30cba03aaf3a4861ab4594466ae952f2/users/1a58261bcee145e795328413b0289266/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:12.404474 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6116f84-72a9-457c-ba80-0c0abaa73ff4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30cba03aaf3a4861ab4594466ae952f2, user_id=1a58261bcee145e795328413b0289266, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:12.407261 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6116f84-72a9-457c-ba80-0c0abaa73ff4 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:12.412344 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5809bd0-0b97-453a-ae0f-b86d3bd72ecb admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:12.428549 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3506/7043] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:36:12 2022] PUT /identity/v3/projects/30cba03aaf3a4861ab4594466ae952f2/users/1a58261bcee145e795328413b0289266/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:36:12.430152 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335db919-8be5-4c8f-a46b-b604f0939f8e None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:12.430460 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335db919-8be5-4c8f-a46b-b604f0939f8e None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:12.430716 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335db919-8be5-4c8f-a46b-b604f0939f8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:12.468791 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-335db919-8be5-4c8f-a46b-b604f0939f8e None None] MFA Rules not processed for user `1a58261bcee145e795328413b0289266`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:36:12.471112 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-335db919-8be5-4c8f-a46b-b604f0939f8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:36:12.554535 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabf1440-14a0-4d70-9d4c-49e089439acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:12.556438 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabf1440-14a0-4d70-9d4c-49e089439acb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:12.557499 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabf1440-14a0-4d70-9d4c-49e089439acb admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:12.558059 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabf1440-14a0-4d70-9d4c-49e089439acb admin admin] PATH_INFO: `/v3/users/e3866ef4c83b413f9d0ef1d64535cf1e` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:12.559604 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabf1440-14a0-4d70-9d4c-49e089439acb admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3866ef4c83b413f9d0ef1d64535cf1e)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:12.562426 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabf1440-14a0-4d70-9d4c-49e089439acb admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:12.569264 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3507/7044] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:36:12 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:36:12.570334 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335db919-8be5-4c8f-a46b-b604f0939f8e None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:12.572718 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-335db919-8be5-4c8f-a46b-b604f0939f8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:36:12.603890 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:36:12.655676 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335db919-8be5-4c8f-a46b-b604f0939f8e None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:12.659514 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-eabf1440-14a0-4d70-9d4c-49e089439acb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3866ef4c83b413f9d0ef1d64535cf1e'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:12.661041 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-eabf1440-14a0-4d70-9d4c-49e089439acb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3866ef4c83b413f9d0ef1d64535cf1e'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:12.661895 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:36:12.663627 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b08ad9-b316-4058-b4b2-39192963a5db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec5fd3a489c341b7964704d689037f05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:12.664321 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b08ad9-b316-4058-b4b2-39192963a5db service cinder] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:12.664775 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b08ad9-b316-4058-b4b2-39192963a5db service cinder] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:12.665137 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b08ad9-b316-4058-b4b2-39192963a5db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:12.671737 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-eabf1440-14a0-4d70-9d4c-49e089439acb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3866ef4c83b413f9d0ef1d64535cf1e'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:12.683094 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b08ad9-b316-4058-b4b2-39192963a5db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:12.685891 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b08ad9-b316-4058-b4b2-39192963a5db service cinder] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:12.686810 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-eabf1440-14a0-4d70-9d4c-49e089439acb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3866ef4c83b413f9d0ef1d64535cf1e'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:12.698201 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3508/7045] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:36:12 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:36:12.711264 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-eabf1440-14a0-4d70-9d4c-49e089439acb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3866ef4c83b413f9d0ef1d64535cf1e'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:12.722893 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3538/7046] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:36:12 2022] DELETE /identity/v3/users/e3866ef4c83b413f9d0ef1d64535cf1e => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:36:12.724461 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48a3435-695f-4383-86af-0192cc5d98f0 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:12.724745 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48a3435-695f-4383-86af-0192cc5d98f0 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:12.725039 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48a3435-695f-4383-86af-0192cc5d98f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:12.757227 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-b48a3435-695f-4383-86af-0192cc5d98f0 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:36:12.758576 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-b48a3435-695f-4383-86af-0192cc5d98f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:36:12.852151 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3509/7047] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:36:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:36:12.865327 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabf1440-14a0-4d70-9d4c-49e089439acb admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:12.869651 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-eabf1440-14a0-4d70-9d4c-49e089439acb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:36:13.016034 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabf1440-14a0-4d70-9d4c-49e089439acb admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:13.031411 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5df9db-922b-4460-9b11-7881b0fd3568 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:13.032089 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5df9db-922b-4460-9b11-7881b0fd3568 service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:13.032494 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5df9db-922b-4460-9b11-7881b0fd3568 service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:13.032798 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5df9db-922b-4460-9b11-7881b0fd3568 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:13.045986 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5df9db-922b-4460-9b11-7881b0fd3568 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:13.047589 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5df9db-922b-4460-9b11-7881b0fd3568 service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:13.068413 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3539/7048] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:36:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:36:13.494753 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48a3435-695f-4383-86af-0192cc5d98f0 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:13.497712 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-b48a3435-695f-4383-86af-0192cc5d98f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:36:13.607817 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48a3435-695f-4383-86af-0192cc5d98f0 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:13.612975 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87f47b9-140d-44c1-a2fb-33e45c9da148 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec5fd3a489c341b7964704d689037f05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:13.613968 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87f47b9-140d-44c1-a2fb-33e45c9da148 service cinder] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:13.614342 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87f47b9-140d-44c1-a2fb-33e45c9da148 service cinder] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:13.614712 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87f47b9-140d-44c1-a2fb-33e45c9da148 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:13.617434 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-f87f47b9-140d-44c1-a2fb-33e45c9da148 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:36:13.734730 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87f47b9-140d-44c1-a2fb-33e45c9da148 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:13.736408 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87f47b9-140d-44c1-a2fb-33e45c9da148 service cinder] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:13.756752 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3510/7049] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:36:13 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:36:14.053528 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5df9db-922b-4460-9b11-7881b0fd3568 service neutron] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:14.055306 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-3c5df9db-922b-4460-9b11-7881b0fd3568 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:36:14.087797 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5df9db-922b-4460-9b11-7881b0fd3568 service neutron] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:14.112768 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5028a4f7-d403-4512-abdc-ea5ceb1caad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:14.113676 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5028a4f7-d403-4512-abdc-ea5ceb1caad7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:14.113987 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5028a4f7-d403-4512-abdc-ea5ceb1caad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:14.114264 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5028a4f7-d403-4512-abdc-ea5ceb1caad7 admin admin] PATH_INFO: `/v3/projects/95596abbb0f740d69888690df3a5b513` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:14.118701 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5028a4f7-d403-4512-abdc-ea5ceb1caad7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=95596abbb0f740d69888690df3a5b513)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:14.120713 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5028a4f7-d403-4512-abdc-ea5ceb1caad7 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:14.255330 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-5028a4f7-d403-4512-abdc-ea5ceb1caad7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95596abbb0f740d69888690df3a5b513', 'request_id': 'req-5028a4f7-d403-4512-abdc-ea5ceb1caad7'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:14.265459 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-5028a4f7-d403-4512-abdc-ea5ceb1caad7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95596abbb0f740d69888690df3a5b513', 'request_id': 'req-5028a4f7-d403-4512-abdc-ea5ceb1caad7'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:14.276717 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-5028a4f7-d403-4512-abdc-ea5ceb1caad7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95596abbb0f740d69888690df3a5b513', 'request_id': 'req-5028a4f7-d403-4512-abdc-ea5ceb1caad7'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:14.294798 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-5028a4f7-d403-4512-abdc-ea5ceb1caad7 admin admin] The token cache is being invalidate because project 95596abbb0f740d69888690df3a5b513 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:36:14.295162 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-5028a4f7-d403-4512-abdc-ea5ceb1caad7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:14.297125 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-5028a4f7-d403-4512-abdc-ea5ceb1caad7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:14.298956 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3540/7050] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:36:14 2022] DELETE /identity/v3/projects/95596abbb0f740d69888690df3a5b513 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:36:14.304205 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7170eb-1048-4f5c-b8aa-104265d7d10e None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:14.304518 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7170eb-1048-4f5c-b8aa-104265d7d10e None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:14.304795 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7170eb-1048-4f5c-b8aa-104265d7d10e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:14.347277 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-8e7170eb-1048-4f5c-b8aa-104265d7d10e None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:36:14.352182 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-8e7170eb-1048-4f5c-b8aa-104265d7d10e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:36:14.386140 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:36:14.556373 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3511/7051] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:36:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:36:14.568586 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81c0cab-19ed-4712-90ce-d57432b33268 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:14.569025 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81c0cab-19ed-4712-90ce-d57432b33268 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:14.569438 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81c0cab-19ed-4712-90ce-d57432b33268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:14.609104 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-c81c0cab-19ed-4712-90ce-d57432b33268 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:36:14.610642 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-c81c0cab-19ed-4712-90ce-d57432b33268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:36:14.622870 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3541/7052] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:36:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:36:14.626925 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7170eb-1048-4f5c-b8aa-104265d7d10e None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:14.638140 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7170eb-1048-4f5c-b8aa-104265d7d10e None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:14.643638 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc72d07-5cc1-4ad0-990f-8442d64ce02f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:14.644429 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc72d07-5cc1-4ad0-990f-8442d64ce02f admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:14.644737 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc72d07-5cc1-4ad0-990f-8442d64ce02f admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:14.645011 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc72d07-5cc1-4ad0-990f-8442d64ce02f admin admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:14.646378 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc72d07-5cc1-4ad0-990f-8442d64ce02f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:36:14.646690 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc72d07-5cc1-4ad0-990f-8442d64ce02f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:14.648448 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc72d07-5cc1-4ad0-990f-8442d64ce02f admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:14.665451 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3512/7053] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:36:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:36:14.666845 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81c0cab-19ed-4712-90ce-d57432b33268 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:14.677073 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81c0cab-19ed-4712-90ce-d57432b33268 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:14.682068 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ed8d05-55fd-4a8e-92c2-b96fa36f3544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:14.682884 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ed8d05-55fd-4a8e-92c2-b96fa36f3544 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:14.683266 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ed8d05-55fd-4a8e-92c2-b96fa36f3544 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:14.683661 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ed8d05-55fd-4a8e-92c2-b96fa36f3544 admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:14.684459 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ed8d05-55fd-4a8e-92c2-b96fa36f3544 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:14.686591 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ed8d05-55fd-4a8e-92c2-b96fa36f3544 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:14.730540 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc72d07-5cc1-4ad0-990f-8442d64ce02f admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:14.738256 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3542/7054] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:36:14 2022] POST /identity/v3/projects => generated 363 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:36:14.743997 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc72d07-5cc1-4ad0-990f-8442d64ce02f admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:14.843988 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c765a9d-6e45-4ec5-9d47-69494808e37c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:14.845056 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c765a9d-6e45-4ec5-9d47-69494808e37c admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:14.845806 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c765a9d-6e45-4ec5-9d47-69494808e37c admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:14.846208 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c765a9d-6e45-4ec5-9d47-69494808e37c admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:14.847406 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c765a9d-6e45-4ec5-9d47-69494808e37c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:14.849450 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c765a9d-6e45-4ec5-9d47-69494808e37c admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:14.878097 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3513/7055] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:36:14 2022] POST /identity/v3/users => generated 282 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:36:14.882080 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ed8d05-55fd-4a8e-92c2-b96fa36f3544 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:14.895902 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ed8d05-55fd-4a8e-92c2-b96fa36f3544 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:14.902260 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d68229c-ca24-46d7-9770-2d28c5914133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:14.902916 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d68229c-ca24-46d7-9770-2d28c5914133 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:14.903152 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d68229c-ca24-46d7-9770-2d28c5914133 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:14.903594 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d68229c-ca24-46d7-9770-2d28c5914133 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:14.904251 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d68229c-ca24-46d7-9770-2d28c5914133 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:14.908787 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d68229c-ca24-46d7-9770-2d28c5914133 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:14.920685 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3543/7056] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:36:14 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 21:36:14.924868 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c765a9d-6e45-4ec5-9d47-69494808e37c admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:14.936086 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c765a9d-6e45-4ec5-9d47-69494808e37c admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:14.940955 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dd6e33-42b5-4476-bcc4-33d99d6b048b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:14.942258 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dd6e33-42b5-4476-bcc4-33d99d6b048b admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:14.943931 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dd6e33-42b5-4476-bcc4-33d99d6b048b admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:14.944329 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dd6e33-42b5-4476-bcc4-33d99d6b048b admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:14.946138 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dd6e33-42b5-4476-bcc4-33d99d6b048b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:14.948862 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dd6e33-42b5-4476-bcc4-33d99d6b048b admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:14.963685 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3514/7057] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:36:14 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:36:14.967685 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d68229c-ca24-46d7-9770-2d28c5914133 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:14.980512 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d68229c-ca24-46d7-9770-2d28c5914133 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:14.988316 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4411189-2a24-490a-bbaa-87b7ecce583e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:14.989244 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4411189-2a24-490a-bbaa-87b7ecce583e admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:14.989531 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4411189-2a24-490a-bbaa-87b7ecce583e admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:14.989804 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4411189-2a24-490a-bbaa-87b7ecce583e admin admin] PATH_INFO: `/v3/projects/781bd9f2749e4e7db05ff3da06afaaf4/users/7fc2509e73a9462bbc88ddfaf910b483/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:15.000521 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:36:15.013478 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4411189-2a24-490a-bbaa-87b7ecce583e admin admin] RBAC: Authorizing `identity:create_grant(project_id=781bd9f2749e4e7db05ff3da06afaaf4, user_id=7fc2509e73a9462bbc88ddfaf910b483, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:15.019377 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4411189-2a24-490a-bbaa-87b7ecce583e admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:15.056192 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51174236-bcd3-4580-8f49-fbe9d04e87bf None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:15.056476 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51174236-bcd3-4580-8f49-fbe9d04e87bf None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:15.056752 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51174236-bcd3-4580-8f49-fbe9d04e87bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:15.060703 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3544/7058] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:36:14 2022] PUT /identity/v3/projects/781bd9f2749e4e7db05ff3da06afaaf4/users/7fc2509e73a9462bbc88ddfaf910b483/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:36:15.097305 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-51174236-bcd3-4580-8f49-fbe9d04e87bf None None] MFA Rules not processed for user `7fc2509e73a9462bbc88ddfaf910b483`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:36:15.098893 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-51174236-bcd3-4580-8f49-fbe9d04e87bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:36:15.218382 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3515/7059] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:36:15 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:36:15.254372 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4411189-2a24-490a-bbaa-87b7ecce583e admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:15.256208 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-d4411189-2a24-490a-bbaa-87b7ecce583e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:36:15.375481 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4411189-2a24-490a-bbaa-87b7ecce583e admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:15.381999 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c880af8-589c-464e-bba9-b470fdada09d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:15.388255 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c880af8-589c-464e-bba9-b470fdada09d service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:15.388541 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c880af8-589c-464e-bba9-b470fdada09d service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:15.388816 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c880af8-589c-464e-bba9-b470fdada09d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:15.406008 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c880af8-589c-464e-bba9-b470fdada09d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:15.408175 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c880af8-589c-464e-bba9-b470fdada09d service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:15.430542 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3545/7060] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:36:15 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:36:18.131713 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51174236-bcd3-4580-8f49-fbe9d04e87bf None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:18.134156 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-51174236-bcd3-4580-8f49-fbe9d04e87bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:36:18.182093 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:36:18.273757 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51174236-bcd3-4580-8f49-fbe9d04e87bf None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:18.286260 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec32f98-6129-4036-a3a7-d26bbd638fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:18.287805 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec32f98-6129-4036-a3a7-d26bbd638fb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:18.289896 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec32f98-6129-4036-a3a7-d26bbd638fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:18.290802 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec32f98-6129-4036-a3a7-d26bbd638fb5 admin admin] PATH_INFO: `/v3/users/5e917eef5ed54056a8d2a6a4dd522431` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:18.293118 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec32f98-6129-4036-a3a7-d26bbd638fb5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e917eef5ed54056a8d2a6a4dd522431)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:18.296260 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec32f98-6129-4036-a3a7-d26bbd638fb5 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:18.412933 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-3ec32f98-6129-4036-a3a7-d26bbd638fb5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e917eef5ed54056a8d2a6a4dd522431'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:18.425127 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-3ec32f98-6129-4036-a3a7-d26bbd638fb5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e917eef5ed54056a8d2a6a4dd522431'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:18.427046 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-3ec32f98-6129-4036-a3a7-d26bbd638fb5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e917eef5ed54056a8d2a6a4dd522431'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:18.440426 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-3ec32f98-6129-4036-a3a7-d26bbd638fb5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e917eef5ed54056a8d2a6a4dd522431'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:18.463030 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-3ec32f98-6129-4036-a3a7-d26bbd638fb5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e917eef5ed54056a8d2a6a4dd522431'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:18.476316 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3516/7061] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:36:18 2022] DELETE /identity/v3/users/5e917eef5ed54056a8d2a6a4dd522431 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:36:18.477602 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd6a37e-e5fb-43ec-8d86-7c33beeeafae None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:18.478177 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd6a37e-e5fb-43ec-8d86-7c33beeeafae None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:18.478296 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd6a37e-e5fb-43ec-8d86-7c33beeeafae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:18.511478 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-7cd6a37e-e5fb-43ec-8d86-7c33beeeafae None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:36:18.518560 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-7cd6a37e-e5fb-43ec-8d86-7c33beeeafae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:36:18.624045 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3546/7062] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:36:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:36:18.680554 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec32f98-6129-4036-a3a7-d26bbd638fb5 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:18.682670 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-3ec32f98-6129-4036-a3a7-d26bbd638fb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:36:18.754087 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec32f98-6129-4036-a3a7-d26bbd638fb5 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:18.758164 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fb9d80-e1dd-410d-8808-93b375407bd4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:18.758905 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fb9d80-e1dd-410d-8808-93b375407bd4 service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:18.759750 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fb9d80-e1dd-410d-8808-93b375407bd4 service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:18.759750 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fb9d80-e1dd-410d-8808-93b375407bd4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:18.770260 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fb9d80-e1dd-410d-8808-93b375407bd4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:18.771729 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fb9d80-e1dd-410d-8808-93b375407bd4 service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:18.783819 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3517/7063] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:36:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:36:19.672613 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd6a37e-e5fb-43ec-8d86-7c33beeeafae None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:19.674809 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-7cd6a37e-e5fb-43ec-8d86-7c33beeeafae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:36:19.690007 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd6a37e-e5fb-43ec-8d86-7c33beeeafae None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:19.698264 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342c9ce8-a571-484a-b548-e806b0ae9665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:19.699606 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342c9ce8-a571-484a-b548-e806b0ae9665 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:19.700251 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342c9ce8-a571-484a-b548-e806b0ae9665 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:19.701346 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342c9ce8-a571-484a-b548-e806b0ae9665 admin admin] PATH_INFO: `/v3/projects/0f657f4884ab4cd3946571238495c538` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:19.703204 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342c9ce8-a571-484a-b548-e806b0ae9665 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f657f4884ab4cd3946571238495c538)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:19.706374 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342c9ce8-a571-484a-b548-e806b0ae9665 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:19.790326 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-342c9ce8-a571-484a-b548-e806b0ae9665 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f657f4884ab4cd3946571238495c538', 'request_id': 'req-342c9ce8-a571-484a-b548-e806b0ae9665'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:19.800434 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-342c9ce8-a571-484a-b548-e806b0ae9665 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f657f4884ab4cd3946571238495c538', 'request_id': 'req-342c9ce8-a571-484a-b548-e806b0ae9665'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:19.814462 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-342c9ce8-a571-484a-b548-e806b0ae9665 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f657f4884ab4cd3946571238495c538', 'request_id': 'req-342c9ce8-a571-484a-b548-e806b0ae9665'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:19.831561 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-342c9ce8-a571-484a-b548-e806b0ae9665 admin admin] The token cache is being invalidate because project 0f657f4884ab4cd3946571238495c538 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:36:19.831857 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-342c9ce8-a571-484a-b548-e806b0ae9665 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:19.832532 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-342c9ce8-a571-484a-b548-e806b0ae9665 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:19.837763 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3547/7064] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:36:19 2022] DELETE /identity/v3/projects/0f657f4884ab4cd3946571238495c538 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:36:19.839147 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fb9d80-e1dd-410d-8808-93b375407bd4 service neutron] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:19.852820 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fb9d80-e1dd-410d-8808-93b375407bd4 service neutron] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:19.888161 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342c9ce8-a571-484a-b548-e806b0ae9665 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:19.890616 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-342c9ce8-a571-484a-b548-e806b0ae9665 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:36:19.901359 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:36:19.925238 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:36:19.953228 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a29d743-141a-421e-9c35-9408be766e80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:19.954758 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a29d743-141a-421e-9c35-9408be766e80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:19.955198 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a29d743-141a-421e-9c35-9408be766e80 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:19.955663 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a29d743-141a-421e-9c35-9408be766e80 admin admin] PATH_INFO: `/v3/users/131054a2827a4ee5b7d3aae9ebcdf8aa` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:19.958482 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a29d743-141a-421e-9c35-9408be766e80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=131054a2827a4ee5b7d3aae9ebcdf8aa)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:19.961855 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a29d743-141a-421e-9c35-9408be766e80 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:20.024351 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342c9ce8-a571-484a-b548-e806b0ae9665 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:20.030895 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3333732-3a2e-4817-9343-52dcd6811f48 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc719a3b3ac4461b82ca04ab6451d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:20.031800 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3333732-3a2e-4817-9343-52dcd6811f48 service placement] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:20.032217 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3333732-3a2e-4817-9343-52dcd6811f48 service placement] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:20.032591 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3333732-3a2e-4817-9343-52dcd6811f48 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:20.034912 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-d3333732-3a2e-4817-9343-52dcd6811f48 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:36:20.037012 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-0a29d743-141a-421e-9c35-9408be766e80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '131054a2827a4ee5b7d3aae9ebcdf8aa'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:20.048042 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-0a29d743-141a-421e-9c35-9408be766e80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '131054a2827a4ee5b7d3aae9ebcdf8aa'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:20.049001 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-0a29d743-141a-421e-9c35-9408be766e80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '131054a2827a4ee5b7d3aae9ebcdf8aa'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:20.062345 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-0a29d743-141a-421e-9c35-9408be766e80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '131054a2827a4ee5b7d3aae9ebcdf8aa'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:20.074667 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3333732-3a2e-4817-9343-52dcd6811f48 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:20.078422 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3333732-3a2e-4817-9343-52dcd6811f48 service placement] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:20.102715 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-0a29d743-141a-421e-9c35-9408be766e80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '131054a2827a4ee5b7d3aae9ebcdf8aa'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:20.114408 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3548/7065] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:36:19 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 23 21:36:20.117844 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3518/7066] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:36:19 2022] DELETE /identity/v3/users/131054a2827a4ee5b7d3aae9ebcdf8aa => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:36:21.296174 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3333732-3a2e-4817-9343-52dcd6811f48 service placement] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:21.297763 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-d3333732-3a2e-4817-9343-52dcd6811f48 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:36:21.312720 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3333732-3a2e-4817-9343-52dcd6811f48 service placement] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:21.386144 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e061b60-a89c-4ba9-8402-6fc9b55ad2e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:21.387579 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e061b60-a89c-4ba9-8402-6fc9b55ad2e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:21.387980 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e061b60-a89c-4ba9-8402-6fc9b55ad2e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:21.388495 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e061b60-a89c-4ba9-8402-6fc9b55ad2e4 admin admin] PATH_INFO: `/v3/projects/3d2953fd068e4d1a9b6c932d955fbdb8` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:21.389845 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e061b60-a89c-4ba9-8402-6fc9b55ad2e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d2953fd068e4d1a9b6c932d955fbdb8)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:21.392524 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e061b60-a89c-4ba9-8402-6fc9b55ad2e4 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:21.449929 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-5e061b60-a89c-4ba9-8402-6fc9b55ad2e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d2953fd068e4d1a9b6c932d955fbdb8', 'request_id': 'req-5e061b60-a89c-4ba9-8402-6fc9b55ad2e4'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:21.461387 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-5e061b60-a89c-4ba9-8402-6fc9b55ad2e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d2953fd068e4d1a9b6c932d955fbdb8', 'request_id': 'req-5e061b60-a89c-4ba9-8402-6fc9b55ad2e4'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:21.469212 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-5e061b60-a89c-4ba9-8402-6fc9b55ad2e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d2953fd068e4d1a9b6c932d955fbdb8', 'request_id': 'req-5e061b60-a89c-4ba9-8402-6fc9b55ad2e4'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:21.497055 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-5e061b60-a89c-4ba9-8402-6fc9b55ad2e4 admin admin] The token cache is being invalidate because project 3d2953fd068e4d1a9b6c932d955fbdb8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:36:21.497504 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-5e061b60-a89c-4ba9-8402-6fc9b55ad2e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:21.498570 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-5e061b60-a89c-4ba9-8402-6fc9b55ad2e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:21.500565 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3549/7067] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:36:21 2022] DELETE /identity/v3/projects/3d2953fd068e4d1a9b6c932d955fbdb8 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:36:21.505360 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a29d743-141a-421e-9c35-9408be766e80 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:21.507279 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-0a29d743-141a-421e-9c35-9408be766e80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:36:21.523087 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a29d743-141a-421e-9c35-9408be766e80 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:21.616959 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96684a43-7c24-441b-a7e5-59443f7e2fdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:21.617676 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96684a43-7c24-441b-a7e5-59443f7e2fdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:21.617989 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96684a43-7c24-441b-a7e5-59443f7e2fdd admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:21.618263 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96684a43-7c24-441b-a7e5-59443f7e2fdd admin admin] PATH_INFO: `/v3/users/1a58261bcee145e795328413b0289266` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:21.620912 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96684a43-7c24-441b-a7e5-59443f7e2fdd admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a58261bcee145e795328413b0289266)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:21.622984 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96684a43-7c24-441b-a7e5-59443f7e2fdd admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:21.693616 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-96684a43-7c24-441b-a7e5-59443f7e2fdd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a58261bcee145e795328413b0289266'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:21.708876 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:36:21.711355 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-96684a43-7c24-441b-a7e5-59443f7e2fdd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a58261bcee145e795328413b0289266'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:21.712654 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-96684a43-7c24-441b-a7e5-59443f7e2fdd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a58261bcee145e795328413b0289266'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:21.739976 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-96684a43-7c24-441b-a7e5-59443f7e2fdd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a58261bcee145e795328413b0289266'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:21.770715 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-96684a43-7c24-441b-a7e5-59443f7e2fdd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a58261bcee145e795328413b0289266'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:21.782510 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3519/7068] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:36:21 2022] DELETE /identity/v3/users/1a58261bcee145e795328413b0289266 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:36:23.119413 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e061b60-a89c-4ba9-8402-6fc9b55ad2e4 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:23.121577 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-5e061b60-a89c-4ba9-8402-6fc9b55ad2e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:36:23.158545 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e061b60-a89c-4ba9-8402-6fc9b55ad2e4 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:23.218488 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:36:23.271889 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43385979-c9e9-4689-a6e4-7308ac88ead8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:23.273214 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43385979-c9e9-4689-a6e4-7308ac88ead8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:23.273743 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43385979-c9e9-4689-a6e4-7308ac88ead8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:23.274225 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43385979-c9e9-4689-a6e4-7308ac88ead8 admin admin] PATH_INFO: `/v3/projects/30cba03aaf3a4861ab4594466ae952f2` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:23.275871 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43385979-c9e9-4689-a6e4-7308ac88ead8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=30cba03aaf3a4861ab4594466ae952f2)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:23.278175 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43385979-c9e9-4689-a6e4-7308ac88ead8 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:23.355711 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-43385979-c9e9-4689-a6e4-7308ac88ead8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30cba03aaf3a4861ab4594466ae952f2', 'request_id': 'req-43385979-c9e9-4689-a6e4-7308ac88ead8'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:23.367566 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-43385979-c9e9-4689-a6e4-7308ac88ead8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30cba03aaf3a4861ab4594466ae952f2', 'request_id': 'req-43385979-c9e9-4689-a6e4-7308ac88ead8'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:23.374195 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-43385979-c9e9-4689-a6e4-7308ac88ead8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30cba03aaf3a4861ab4594466ae952f2', 'request_id': 'req-43385979-c9e9-4689-a6e4-7308ac88ead8'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:23.386214 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-43385979-c9e9-4689-a6e4-7308ac88ead8 admin admin] The token cache is being invalidate because project 30cba03aaf3a4861ab4594466ae952f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:36:23.386503 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-43385979-c9e9-4689-a6e4-7308ac88ead8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:23.387194 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-43385979-c9e9-4689-a6e4-7308ac88ead8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:23.388779 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3550/7069] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:36:23 2022] DELETE /identity/v3/projects/30cba03aaf3a4861ab4594466ae952f2 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:36:23.393954 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1266214e-0a58-481a-9fab-bc60c6f0d198 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:23.394460 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1266214e-0a58-481a-9fab-bc60c6f0d198 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:23.394727 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1266214e-0a58-481a-9fab-bc60c6f0d198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:23.416519 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-1266214e-0a58-481a-9fab-bc60c6f0d198 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:36:23.418265 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-1266214e-0a58-481a-9fab-bc60c6f0d198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:36:23.501443 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3520/7070] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:36:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:36:23.503802 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f993660b-f2c3-4be9-a46d-96170a5db68e None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:23.504286 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f993660b-f2c3-4be9-a46d-96170a5db68e None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:23.506517 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f993660b-f2c3-4be9-a46d-96170a5db68e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:23.527420 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-f993660b-f2c3-4be9-a46d-96170a5db68e None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:36:23.528991 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-f993660b-f2c3-4be9-a46d-96170a5db68e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:36:23.537930 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3551/7071] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:36:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:36:23.542306 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1266214e-0a58-481a-9fab-bc60c6f0d198 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:23.553242 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1266214e-0a58-481a-9fab-bc60c6f0d198 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:23.558817 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec593b78-940a-4c97-b298-84af2372a3b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:23.559495 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec593b78-940a-4c97-b298-84af2372a3b5 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:23.559774 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec593b78-940a-4c97-b298-84af2372a3b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:23.560040 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec593b78-940a-4c97-b298-84af2372a3b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:23.560771 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec593b78-940a-4c97-b298-84af2372a3b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:36:23.561068 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec593b78-940a-4c97-b298-84af2372a3b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:23.562726 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec593b78-940a-4c97-b298-84af2372a3b5 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:23.580712 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3521/7072] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:36:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:36:23.582766 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f993660b-f2c3-4be9-a46d-96170a5db68e None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:23.593854 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f993660b-f2c3-4be9-a46d-96170a5db68e None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:23.599858 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5916f700-21d3-4fb1-a3af-2b737eba084e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:23.600852 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5916f700-21d3-4fb1-a3af-2b737eba084e admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:23.601297 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5916f700-21d3-4fb1-a3af-2b737eba084e admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:23.603502 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5916f700-21d3-4fb1-a3af-2b737eba084e admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:23.604988 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5916f700-21d3-4fb1-a3af-2b737eba084e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:23.608433 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5916f700-21d3-4fb1-a3af-2b737eba084e admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:23.655625 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3552/7073] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:36:23 2022] POST /identity/v3/projects => generated 377 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:36:23.657074 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec593b78-940a-4c97-b298-84af2372a3b5 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:23.669707 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec593b78-940a-4c97-b298-84af2372a3b5 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:23.764277 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f55a88-07c6-4a01-b411-f100173a7af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:23.765080 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f55a88-07c6-4a01-b411-f100173a7af3 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:23.765875 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f55a88-07c6-4a01-b411-f100173a7af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:23.766242 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f55a88-07c6-4a01-b411-f100173a7af3 admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:23.766962 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f55a88-07c6-4a01-b411-f100173a7af3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:23.770349 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f55a88-07c6-4a01-b411-f100173a7af3 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:23.808340 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3522/7074] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:36:23 2022] POST /identity/v3/users => generated 289 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:36:23.813274 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5916f700-21d3-4fb1-a3af-2b737eba084e admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:23.827862 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5916f700-21d3-4fb1-a3af-2b737eba084e admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:23.835408 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405a70c1-dbbd-46c8-857c-ddf637d27b7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:23.836250 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405a70c1-dbbd-46c8-857c-ddf637d27b7f admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:23.836626 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405a70c1-dbbd-46c8-857c-ddf637d27b7f admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:23.837489 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405a70c1-dbbd-46c8-857c-ddf637d27b7f admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:23.838592 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405a70c1-dbbd-46c8-857c-ddf637d27b7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:23.840587 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405a70c1-dbbd-46c8-857c-ddf637d27b7f admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:23.857896 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3553/7075] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:36:23 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:36:23.861734 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f55a88-07c6-4a01-b411-f100173a7af3 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:23.872180 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f55a88-07c6-4a01-b411-f100173a7af3 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:23.876988 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1551b581-3aa1-4fcc-ab5e-37ab9d9ead34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:23.877657 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1551b581-3aa1-4fcc-ab5e-37ab9d9ead34 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:23.877953 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1551b581-3aa1-4fcc-ab5e-37ab9d9ead34 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:23.878227 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1551b581-3aa1-4fcc-ab5e-37ab9d9ead34 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:23.878973 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1551b581-3aa1-4fcc-ab5e-37ab9d9ead34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:23.880621 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1551b581-3aa1-4fcc-ab5e-37ab9d9ead34 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:23.894254 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3523/7076] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:36:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:36:23.895558 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405a70c1-dbbd-46c8-857c-ddf637d27b7f admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:23.906474 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405a70c1-dbbd-46c8-857c-ddf637d27b7f admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:23.911147 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d2983b-e711-4e40-baa6-594c95d68d85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:23.912043 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d2983b-e711-4e40-baa6-594c95d68d85 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:23.912319 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d2983b-e711-4e40-baa6-594c95d68d85 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:23.912587 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d2983b-e711-4e40-baa6-594c95d68d85 admin admin] PATH_INFO: `/v3/projects/b448542eac8648229062eeeec658bbce/users/f1b6672628a744bd9fd4019d2b0f801f/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:23.930469 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d2983b-e711-4e40-baa6-594c95d68d85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b448542eac8648229062eeeec658bbce, user_id=f1b6672628a744bd9fd4019d2b0f801f, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:23.933318 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d2983b-e711-4e40-baa6-594c95d68d85 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:23.965425 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3554/7077] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:36:23 2022] PUT /identity/v3/projects/b448542eac8648229062eeeec658bbce/users/f1b6672628a744bd9fd4019d2b0f801f/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:36:23.967374 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e473ed-0cfd-4978-9db9-a68de8934054 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:23.967662 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e473ed-0cfd-4978-9db9-a68de8934054 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:23.967984 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e473ed-0cfd-4978-9db9-a68de8934054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:24.005120 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-25e473ed-0cfd-4978-9db9-a68de8934054 None None] MFA Rules not processed for user `f1b6672628a744bd9fd4019d2b0f801f`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:36:24.009524 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-25e473ed-0cfd-4978-9db9-a68de8934054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:36:24.067045 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:36:24.131055 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3524/7078] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:36:23 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:36:24.132181 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d2983b-e711-4e40-baa6-594c95d68d85 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:24.196974 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:36:24.210101 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d2983b-e711-4e40-baa6-594c95d68d85 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:24.217002 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d973c412-4be9-4601-a69f-1bafd2206b80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:24.218253 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d973c412-4be9-4601-a69f-1bafd2206b80 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:24.218808 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d973c412-4be9-4601-a69f-1bafd2206b80 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:24.219412 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d973c412-4be9-4601-a69f-1bafd2206b80 admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:24.221013 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d973c412-4be9-4601-a69f-1bafd2206b80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:24.223273 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d973c412-4be9-4601-a69f-1bafd2206b80 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:24.256468 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3555/7079] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:36:24 2022] POST /identity/v3/projects => generated 377 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:36:24.260161 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e473ed-0cfd-4978-9db9-a68de8934054 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:24.271579 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e473ed-0cfd-4978-9db9-a68de8934054 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:24.344176 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53edf14-7e89-48ed-9bdb-cf429dcef412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:24.345461 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53edf14-7e89-48ed-9bdb-cf429dcef412 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:24.345855 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53edf14-7e89-48ed-9bdb-cf429dcef412 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:24.346246 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53edf14-7e89-48ed-9bdb-cf429dcef412 admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:24.347210 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53edf14-7e89-48ed-9bdb-cf429dcef412 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:24.349195 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53edf14-7e89-48ed-9bdb-cf429dcef412 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:24.378062 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3525/7080] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:36:24 2022] POST /identity/v3/users => generated 289 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:36:24.379773 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d973c412-4be9-4601-a69f-1bafd2206b80 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:24.391189 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d973c412-4be9-4601-a69f-1bafd2206b80 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:24.396175 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b92a8b4-7846-4e83-bd58-66822c36d57b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:24.397023 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b92a8b4-7846-4e83-bd58-66822c36d57b admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:24.397570 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b92a8b4-7846-4e83-bd58-66822c36d57b admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:24.397975 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b92a8b4-7846-4e83-bd58-66822c36d57b admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:24.398844 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b92a8b4-7846-4e83-bd58-66822c36d57b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:24.400575 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b92a8b4-7846-4e83-bd58-66822c36d57b admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:24.419822 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3556/7081] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:36:24 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 21:36:24.421075 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53edf14-7e89-48ed-9bdb-cf429dcef412 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:24.433509 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53edf14-7e89-48ed-9bdb-cf429dcef412 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:24.439249 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddaf658-b0f9-464f-b347-3c7cf36bfa41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:24.440105 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddaf658-b0f9-464f-b347-3c7cf36bfa41 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:24.440983 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddaf658-b0f9-464f-b347-3c7cf36bfa41 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:24.440983 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddaf658-b0f9-464f-b347-3c7cf36bfa41 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:24.441762 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddaf658-b0f9-464f-b347-3c7cf36bfa41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:24.443636 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddaf658-b0f9-464f-b347-3c7cf36bfa41 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:24.458407 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3526/7082] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:36:24 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:36:24.459748 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b92a8b4-7846-4e83-bd58-66822c36d57b admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:24.471352 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b92a8b4-7846-4e83-bd58-66822c36d57b admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:24.476657 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe26e0a0-b667-4042-a595-867c9f14d5a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:24.478061 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe26e0a0-b667-4042-a595-867c9f14d5a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:24.478502 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe26e0a0-b667-4042-a595-867c9f14d5a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:24.478900 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe26e0a0-b667-4042-a595-867c9f14d5a0 admin admin] PATH_INFO: `/v3/projects/73a197d933fd4d58b6c293fa764213b2/users/2a6d1f22084c425387b1b1925ad49f80/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:24.497106 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe26e0a0-b667-4042-a595-867c9f14d5a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73a197d933fd4d58b6c293fa764213b2, user_id=2a6d1f22084c425387b1b1925ad49f80, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:24.500138 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe26e0a0-b667-4042-a595-867c9f14d5a0 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:24.517915 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3557/7083] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:36:24 2022] PUT /identity/v3/projects/73a197d933fd4d58b6c293fa764213b2/users/2a6d1f22084c425387b1b1925ad49f80/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:36:24.536919 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18abdb49-cd4c-4665-a4dd-db10b03f4f5e None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:24.537584 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18abdb49-cd4c-4665-a4dd-db10b03f4f5e None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:24.538544 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18abdb49-cd4c-4665-a4dd-db10b03f4f5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:24.585254 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-18abdb49-cd4c-4665-a4dd-db10b03f4f5e None None] MFA Rules not processed for user `2a6d1f22084c425387b1b1925ad49f80`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:36:24.587184 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-18abdb49-cd4c-4665-a4dd-db10b03f4f5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:36:24.690017 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3527/7084] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:36:24 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:36:24.691236 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe26e0a0-b667-4042-a595-867c9f14d5a0 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:24.794839 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe26e0a0-b667-4042-a595-867c9f14d5a0 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:24.800164 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f65d58-f3c8-4601-b474-b8604fdd37b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:24.801794 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f65d58-f3c8-4601-b474-b8604fdd37b4 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:24.801794 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f65d58-f3c8-4601-b474-b8604fdd37b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:24.801794 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f65d58-f3c8-4601-b474-b8604fdd37b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:24.802715 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f65d58-f3c8-4601-b474-b8604fdd37b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:24.804728 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f65d58-f3c8-4601-b474-b8604fdd37b4 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:24.848678 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3558/7085] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:36:24 2022] POST /identity/v3/projects => generated 377 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:36:24.853485 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18abdb49-cd4c-4665-a4dd-db10b03f4f5e None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:24.868272 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18abdb49-cd4c-4665-a4dd-db10b03f4f5e None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:24.908860 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:36:24.941002 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8f3834-ea6d-4dfc-b8db-9e20b3de5e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:24.942043 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8f3834-ea6d-4dfc-b8db-9e20b3de5e52 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:24.942415 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8f3834-ea6d-4dfc-b8db-9e20b3de5e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:24.942791 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8f3834-ea6d-4dfc-b8db-9e20b3de5e52 admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:24.943662 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8f3834-ea6d-4dfc-b8db-9e20b3de5e52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:24.946025 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8f3834-ea6d-4dfc-b8db-9e20b3de5e52 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:24.978388 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3528/7086] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:36:24 2022] POST /identity/v3/users => generated 295 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:36:24.982006 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f65d58-f3c8-4601-b474-b8604fdd37b4 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:24.997682 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f65d58-f3c8-4601-b474-b8604fdd37b4 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:25.002881 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d956cd-44a1-4a24-8b05-d734877f7ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:25.003648 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d956cd-44a1-4a24-8b05-d734877f7ce8 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:25.003996 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d956cd-44a1-4a24-8b05-d734877f7ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:25.004466 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d956cd-44a1-4a24-8b05-d734877f7ce8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:25.005261 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d956cd-44a1-4a24-8b05-d734877f7ce8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:25.007997 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d956cd-44a1-4a24-8b05-d734877f7ce8 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:25.027444 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3559/7087] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:36:24 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:36:25.028844 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8f3834-ea6d-4dfc-b8db-9e20b3de5e52 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:25.048563 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8f3834-ea6d-4dfc-b8db-9e20b3de5e52 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:25.054958 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953f3039-9c29-4e78-b9bb-74a5fcc7d58c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:25.056897 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953f3039-9c29-4e78-b9bb-74a5fcc7d58c admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:25.057820 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953f3039-9c29-4e78-b9bb-74a5fcc7d58c admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:25.058369 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953f3039-9c29-4e78-b9bb-74a5fcc7d58c admin admin] PATH_INFO: `/v3/projects/dda68b7dab7844a89e77e7d43a1a4432/users/d024d91d1e5e4e819e94ac43b19725ba/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:25.082468 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953f3039-9c29-4e78-b9bb-74a5fcc7d58c admin admin] RBAC: Authorizing `identity:create_grant(project_id=dda68b7dab7844a89e77e7d43a1a4432, user_id=d024d91d1e5e4e819e94ac43b19725ba, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:25.086260 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953f3039-9c29-4e78-b9bb-74a5fcc7d58c admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:25.110940 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3529/7088] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:36:25 2022] PUT /identity/v3/projects/dda68b7dab7844a89e77e7d43a1a4432/users/d024d91d1e5e4e819e94ac43b19725ba/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:36:25.116470 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d956cd-44a1-4a24-8b05-d734877f7ce8 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:25.140618 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d956cd-44a1-4a24-8b05-d734877f7ce8 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:25.271298 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d81748d-a97d-4aea-beae-2ef663111a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:25.272228 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d81748d-a97d-4aea-beae-2ef663111a41 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:25.272709 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d81748d-a97d-4aea-beae-2ef663111a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:25.273332 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d81748d-a97d-4aea-beae-2ef663111a41 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:25.274841 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d81748d-a97d-4aea-beae-2ef663111a41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:25.277728 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d81748d-a97d-4aea-beae-2ef663111a41 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:25.292524 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3560/7089] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:36:25 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:36:25.296530 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953f3039-9c29-4e78-b9bb-74a5fcc7d58c admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:25.308277 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953f3039-9c29-4e78-b9bb-74a5fcc7d58c admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:25.313185 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fbb2d4-2891-4891-898f-cadd2983db81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:25.314173 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fbb2d4-2891-4891-898f-cadd2983db81 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:25.314455 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fbb2d4-2891-4891-898f-cadd2983db81 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:25.314731 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fbb2d4-2891-4891-898f-cadd2983db81 admin admin] PATH_INFO: `/v3/projects/dda68b7dab7844a89e77e7d43a1a4432/users/d024d91d1e5e4e819e94ac43b19725ba/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:25.316939 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fbb2d4-2891-4891-898f-cadd2983db81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dda68b7dab7844a89e77e7d43a1a4432, user_id=d024d91d1e5e4e819e94ac43b19725ba, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:25.319917 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fbb2d4-2891-4891-898f-cadd2983db81 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:25.342782 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3530/7090] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:36:25 2022] PUT /identity/v3/projects/dda68b7dab7844a89e77e7d43a1a4432/users/d024d91d1e5e4e819e94ac43b19725ba/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:36:25.344094 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c73210e-30c5-4bb2-8194-3ff603fcff09 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:25.344918 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c73210e-30c5-4bb2-8194-3ff603fcff09 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:25.344918 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c73210e-30c5-4bb2-8194-3ff603fcff09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:25.373794 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:36:25.388603 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-0c73210e-30c5-4bb2-8194-3ff603fcff09 None None] MFA Rules not processed for user `d024d91d1e5e4e819e94ac43b19725ba`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:36:25.390184 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-0c73210e-30c5-4bb2-8194-3ff603fcff09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:36:25.492049 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3561/7091] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:36:25 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:36:25.503379 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fbb2d4-2891-4891-898f-cadd2983db81 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:25.505772 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-c0fbb2d4-2891-4891-898f-cadd2983db81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:36:25.607980 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fbb2d4-2891-4891-898f-cadd2983db81 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:25.613127 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6dd759-bb1f-4b9b-a20f-b7a92419b66c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec5fd3a489c341b7964704d689037f05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:25.614505 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6dd759-bb1f-4b9b-a20f-b7a92419b66c service cinder] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:25.614901 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6dd759-bb1f-4b9b-a20f-b7a92419b66c service cinder] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:25.615271 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6dd759-bb1f-4b9b-a20f-b7a92419b66c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:25.628704 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6dd759-bb1f-4b9b-a20f-b7a92419b66c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:25.632894 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6dd759-bb1f-4b9b-a20f-b7a92419b66c service cinder] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:25.649214 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3531/7092] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:36:25 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:36:25.752174 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c73210e-30c5-4bb2-8194-3ff603fcff09 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:25.770390 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c73210e-30c5-4bb2-8194-3ff603fcff09 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:25.779473 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62e6432-878d-4679-bd7e-71ab5f089dc8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec5fd3a489c341b7964704d689037f05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:25.780703 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62e6432-878d-4679-bd7e-71ab5f089dc8 service cinder] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:25.781265 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62e6432-878d-4679-bd7e-71ab5f089dc8 service cinder] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:25.782008 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62e6432-878d-4679-bd7e-71ab5f089dc8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:25.892024 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62e6432-878d-4679-bd7e-71ab5f089dc8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:25.893419 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62e6432-878d-4679-bd7e-71ab5f089dc8 service cinder] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:25.905078 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3562/7093] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:36:25 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 23 21:36:26.056200 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6dd759-bb1f-4b9b-a20f-b7a92419b66c service cinder] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:26.057676 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-5e6dd759-bb1f-4b9b-a20f-b7a92419b66c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:36:26.209654 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6dd759-bb1f-4b9b-a20f-b7a92419b66c service cinder] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:26.217545 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba4d92e-992c-4bf2-a1c1-6858db83a82b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:26.219268 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba4d92e-992c-4bf2-a1c1-6858db83a82b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:26.219268 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba4d92e-992c-4bf2-a1c1-6858db83a82b admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:26.221125 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba4d92e-992c-4bf2-a1c1-6858db83a82b admin admin] PATH_INFO: `/v3/users/bd514caa2bb743dab868e9feba40b851` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:26.223528 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba4d92e-992c-4bf2-a1c1-6858db83a82b admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd514caa2bb743dab868e9feba40b851)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:26.225518 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba4d92e-992c-4bf2-a1c1-6858db83a82b admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:26.285356 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:36:26.312534 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-eba4d92e-992c-4bf2-a1c1-6858db83a82b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd514caa2bb743dab868e9feba40b851'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:26.327342 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-eba4d92e-992c-4bf2-a1c1-6858db83a82b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd514caa2bb743dab868e9feba40b851'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:26.328217 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-eba4d92e-992c-4bf2-a1c1-6858db83a82b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd514caa2bb743dab868e9feba40b851'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:26.349644 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-eba4d92e-992c-4bf2-a1c1-6858db83a82b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd514caa2bb743dab868e9feba40b851'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:26.373656 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-eba4d92e-992c-4bf2-a1c1-6858db83a82b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd514caa2bb743dab868e9feba40b851'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:26.385138 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3532/7094] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:36:26 2022] DELETE /identity/v3/users/bd514caa2bb743dab868e9feba40b851 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:36:26.390257 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa89e81-ba49-4f24-8dba-31c762ec51e9 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:26.392288 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa89e81-ba49-4f24-8dba-31c762ec51e9 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:26.394107 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa89e81-ba49-4f24-8dba-31c762ec51e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:26.433590 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-5fa89e81-ba49-4f24-8dba-31c762ec51e9 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:36:26.436525 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-5fa89e81-ba49-4f24-8dba-31c762ec51e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:36:26.547180 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3563/7095] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:36:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:36:26.576548 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba4d92e-992c-4bf2-a1c1-6858db83a82b admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:26.578024 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-eba4d92e-992c-4bf2-a1c1-6858db83a82b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:36:26.675637 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba4d92e-992c-4bf2-a1c1-6858db83a82b admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:26.679839 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7a020d-c734-4609-8626-533146d21c1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:26.680548 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7a020d-c734-4609-8626-533146d21c1a service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:26.680958 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7a020d-c734-4609-8626-533146d21c1a service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:26.681271 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7a020d-c734-4609-8626-533146d21c1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:26.694008 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7a020d-c734-4609-8626-533146d21c1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:26.695626 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7a020d-c734-4609-8626-533146d21c1a service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:26.708662 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3533/7096] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:36:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:36:27.680036 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa89e81-ba49-4f24-8dba-31c762ec51e9 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:27.681552 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-5fa89e81-ba49-4f24-8dba-31c762ec51e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:36:27.704044 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa89e81-ba49-4f24-8dba-31c762ec51e9 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:27.712350 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43e51c1-880a-475c-a19f-d997b83b6c66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:27.713457 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43e51c1-880a-475c-a19f-d997b83b6c66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:27.713615 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43e51c1-880a-475c-a19f-d997b83b6c66 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:27.713806 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43e51c1-880a-475c-a19f-d997b83b6c66 admin admin] PATH_INFO: `/v3/projects/228cd2a54864493a81f7d5749e5fd5cb` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:27.715037 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43e51c1-880a-475c-a19f-d997b83b6c66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=228cd2a54864493a81f7d5749e5fd5cb)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:27.717030 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43e51c1-880a-475c-a19f-d997b83b6c66 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:27.798048 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:36:27.833549 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c43e51c1-880a-475c-a19f-d997b83b6c66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '228cd2a54864493a81f7d5749e5fd5cb', 'request_id': 'req-c43e51c1-880a-475c-a19f-d997b83b6c66'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:27.858691 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c43e51c1-880a-475c-a19f-d997b83b6c66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '228cd2a54864493a81f7d5749e5fd5cb', 'request_id': 'req-c43e51c1-880a-475c-a19f-d997b83b6c66'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:27.867389 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c43e51c1-880a-475c-a19f-d997b83b6c66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '228cd2a54864493a81f7d5749e5fd5cb', 'request_id': 'req-c43e51c1-880a-475c-a19f-d997b83b6c66'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:27.882842 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c43e51c1-880a-475c-a19f-d997b83b6c66 admin admin] The token cache is being invalidate because project 228cd2a54864493a81f7d5749e5fd5cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:36:27.883992 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c43e51c1-880a-475c-a19f-d997b83b6c66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:27.884672 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c43e51c1-880a-475c-a19f-d997b83b6c66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:27.889196 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3564/7097] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:36:27 2022] DELETE /identity/v3/projects/228cd2a54864493a81f7d5749e5fd5cb => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:36:27.893154 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7a020d-c734-4609-8626-533146d21c1a service neutron] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:27.907537 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7a020d-c734-4609-8626-533146d21c1a service neutron] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:28.040754 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53672173-dba4-4f01-ae05-23d48ea0fdb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:28.041661 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53672173-dba4-4f01-ae05-23d48ea0fdb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:28.041975 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53672173-dba4-4f01-ae05-23d48ea0fdb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:28.042308 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53672173-dba4-4f01-ae05-23d48ea0fdb5 admin admin] PATH_INFO: `/v3/users/5056bfd4dd8b497e899cae5be25d028d` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:28.043730 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53672173-dba4-4f01-ae05-23d48ea0fdb5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5056bfd4dd8b497e899cae5be25d028d)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:28.045837 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53672173-dba4-4f01-ae05-23d48ea0fdb5 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:28.127364 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-53672173-dba4-4f01-ae05-23d48ea0fdb5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5056bfd4dd8b497e899cae5be25d028d'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:28.139350 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:36:28.145551 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-53672173-dba4-4f01-ae05-23d48ea0fdb5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5056bfd4dd8b497e899cae5be25d028d'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:28.146473 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-53672173-dba4-4f01-ae05-23d48ea0fdb5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5056bfd4dd8b497e899cae5be25d028d'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:28.174385 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-53672173-dba4-4f01-ae05-23d48ea0fdb5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5056bfd4dd8b497e899cae5be25d028d'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:28.221349 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-53672173-dba4-4f01-ae05-23d48ea0fdb5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5056bfd4dd8b497e899cae5be25d028d'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:28.240936 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3534/7098] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:36:27 2022] DELETE /identity/v3/users/5056bfd4dd8b497e899cae5be25d028d => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:36:28.532652 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43e51c1-880a-475c-a19f-d997b83b6c66 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:28.534535 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-c43e51c1-880a-475c-a19f-d997b83b6c66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:36:28.551348 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43e51c1-880a-475c-a19f-d997b83b6c66 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:28.633018 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6557cc4a-6c5f-4f7b-8704-3c13505e1144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:28.634833 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6557cc4a-6c5f-4f7b-8704-3c13505e1144 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:28.635385 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6557cc4a-6c5f-4f7b-8704-3c13505e1144 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:28.635905 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6557cc4a-6c5f-4f7b-8704-3c13505e1144 admin admin] PATH_INFO: `/v3/users/f1b6672628a744bd9fd4019d2b0f801f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:28.637548 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6557cc4a-6c5f-4f7b-8704-3c13505e1144 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1b6672628a744bd9fd4019d2b0f801f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:28.639894 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6557cc4a-6c5f-4f7b-8704-3c13505e1144 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:28.739037 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-6557cc4a-6c5f-4f7b-8704-3c13505e1144 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1b6672628a744bd9fd4019d2b0f801f'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:28.741924 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-6557cc4a-6c5f-4f7b-8704-3c13505e1144 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1b6672628a744bd9fd4019d2b0f801f'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:28.752742 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-6557cc4a-6c5f-4f7b-8704-3c13505e1144 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1b6672628a744bd9fd4019d2b0f801f'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:28.772779 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-6557cc4a-6c5f-4f7b-8704-3c13505e1144 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1b6672628a744bd9fd4019d2b0f801f'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:28.798464 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-6557cc4a-6c5f-4f7b-8704-3c13505e1144 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1b6672628a744bd9fd4019d2b0f801f'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:28.806552 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3565/7099] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:36:28 2022] DELETE /identity/v3/users/f1b6672628a744bd9fd4019d2b0f801f => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:36:28.811112 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af553b0b-1bbd-4471-b4d5-dccd6c8ae7b7 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:28.811408 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af553b0b-1bbd-4471-b4d5-dccd6c8ae7b7 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:28.811677 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af553b0b-1bbd-4471-b4d5-dccd6c8ae7b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:28.844490 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-af553b0b-1bbd-4471-b4d5-dccd6c8ae7b7 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:36:28.846744 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-af553b0b-1bbd-4471-b4d5-dccd6c8ae7b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:36:29.002985 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3535/7100] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:36:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:36:29.006681 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6557cc4a-6c5f-4f7b-8704-3c13505e1144 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:29.007836 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-6557cc4a-6c5f-4f7b-8704-3c13505e1144 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:36:29.014483 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af553b0b-1bbd-4471-b4d5-dccd6c8ae7b7 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:29.016243 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-af553b0b-1bbd-4471-b4d5-dccd6c8ae7b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:36:29.022424 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6557cc4a-6c5f-4f7b-8704-3c13505e1144 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:29.035877 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710e194a-9933-4dfe-a008-61e45b028675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:29.037226 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710e194a-9933-4dfe-a008-61e45b028675 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:29.037678 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710e194a-9933-4dfe-a008-61e45b028675 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:29.038189 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710e194a-9933-4dfe-a008-61e45b028675 admin admin] PATH_INFO: `/v3/projects/85724292ed094634be7b2e4ce98c565b` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:29.039461 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710e194a-9933-4dfe-a008-61e45b028675 admin admin] RBAC: Authorizing `identity:delete_project(project_id=85724292ed094634be7b2e4ce98c565b)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:29.041407 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710e194a-9933-4dfe-a008-61e45b028675 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:29.099401 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:36:29.120813 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af553b0b-1bbd-4471-b4d5-dccd6c8ae7b7 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:29.128585 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-710e194a-9933-4dfe-a008-61e45b028675 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85724292ed094634be7b2e4ce98c565b', 'request_id': 'req-710e194a-9933-4dfe-a008-61e45b028675'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:29.150454 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-710e194a-9933-4dfe-a008-61e45b028675 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85724292ed094634be7b2e4ce98c565b', 'request_id': 'req-710e194a-9933-4dfe-a008-61e45b028675'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:29.162919 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-710e194a-9933-4dfe-a008-61e45b028675 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85724292ed094634be7b2e4ce98c565b', 'request_id': 'req-710e194a-9933-4dfe-a008-61e45b028675'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:29.199291 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-710e194a-9933-4dfe-a008-61e45b028675 admin admin] The token cache is being invalidate because project 85724292ed094634be7b2e4ce98c565b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:36:29.199713 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-710e194a-9933-4dfe-a008-61e45b028675 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:29.200429 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-710e194a-9933-4dfe-a008-61e45b028675 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:29.203813 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3566/7101] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:36:29 2022] DELETE /identity/v3/projects/85724292ed094634be7b2e4ce98c565b => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:36:29.214755 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed76979d-fd16-4446-b754-19514539f901 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:29.215887 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed76979d-fd16-4446-b754-19514539f901 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:29.216253 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed76979d-fd16-4446-b754-19514539f901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:29.223526 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065a64b7-e52f-4132-9e09-d592a3b2f6c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:29.224419 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065a64b7-e52f-4132-9e09-d592a3b2f6c6 service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:29.227788 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065a64b7-e52f-4132-9e09-d592a3b2f6c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:29.228653 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065a64b7-e52f-4132-9e09-d592a3b2f6c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:29.231566 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-065a64b7-e52f-4132-9e09-d592a3b2f6c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:36:29.252678 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-ed76979d-fd16-4446-b754-19514539f901 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:36:29.253946 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-ed76979d-fd16-4446-b754-19514539f901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:36:29.334133 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:36:29.367763 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065a64b7-e52f-4132-9e09-d592a3b2f6c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:29.369956 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065a64b7-e52f-4132-9e09-d592a3b2f6c6 service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:29.384479 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3536/7102] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:36:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 23 21:36:29.418202 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3567/7103] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:36:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:36:29.420644 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582531b1-f395-4871-aafd-397dabfbcbde None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:29.421101 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582531b1-f395-4871-aafd-397dabfbcbde None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:29.421524 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582531b1-f395-4871-aafd-397dabfbcbde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:29.447288 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-582531b1-f395-4871-aafd-397dabfbcbde None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:36:29.448560 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-582531b1-f395-4871-aafd-397dabfbcbde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:36:29.459705 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3537/7104] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:36:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:36:29.464345 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed76979d-fd16-4446-b754-19514539f901 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:29.477070 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed76979d-fd16-4446-b754-19514539f901 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:29.482934 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21532edd-0160-4b32-8a66-4bd76dc59a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:29.484061 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21532edd-0160-4b32-8a66-4bd76dc59a0a admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:29.484571 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21532edd-0160-4b32-8a66-4bd76dc59a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:29.485112 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21532edd-0160-4b32-8a66-4bd76dc59a0a admin admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:29.486129 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21532edd-0160-4b32-8a66-4bd76dc59a0a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:36:29.486670 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21532edd-0160-4b32-8a66-4bd76dc59a0a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:29.488513 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21532edd-0160-4b32-8a66-4bd76dc59a0a admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:29.504569 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3568/7105] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:36:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 21:36:29.509017 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582531b1-f395-4871-aafd-397dabfbcbde None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:29.521604 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582531b1-f395-4871-aafd-397dabfbcbde None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:29.540344 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cb3ae0-6db5-4109-ab28-c86d2830cfe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:29.541312 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cb3ae0-6db5-4109-ab28-c86d2830cfe9 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:29.542299 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cb3ae0-6db5-4109-ab28-c86d2830cfe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:29.542669 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cb3ae0-6db5-4109-ab28-c86d2830cfe9 admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:29.552889 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cb3ae0-6db5-4109-ab28-c86d2830cfe9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:29.556065 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cb3ae0-6db5-4109-ab28-c86d2830cfe9 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:29.604303 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3538/7106] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:36:29 2022] POST /identity/v3/projects => generated 369 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:36:29.605736 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21532edd-0160-4b32-8a66-4bd76dc59a0a admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:29.620016 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21532edd-0160-4b32-8a66-4bd76dc59a0a admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:29.773900 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fe7fbe-0789-4b34-aff4-7a27a273405e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:29.774618 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fe7fbe-0789-4b34-aff4-7a27a273405e admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:29.774905 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fe7fbe-0789-4b34-aff4-7a27a273405e admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:29.778652 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fe7fbe-0789-4b34-aff4-7a27a273405e admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:29.781719 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fe7fbe-0789-4b34-aff4-7a27a273405e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:29.784530 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fe7fbe-0789-4b34-aff4-7a27a273405e admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:29.836222 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3569/7107] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:36:29 2022] POST /identity/v3/users => generated 285 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:36:29.840426 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cb3ae0-6db5-4109-ab28-c86d2830cfe9 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:29.857812 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cb3ae0-6db5-4109-ab28-c86d2830cfe9 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:29.866586 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9909f2b-3b1f-447f-9175-2de57387f6c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:29.867293 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9909f2b-3b1f-447f-9175-2de57387f6c8 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:29.867759 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9909f2b-3b1f-447f-9175-2de57387f6c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:29.868039 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9909f2b-3b1f-447f-9175-2de57387f6c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:29.868956 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9909f2b-3b1f-447f-9175-2de57387f6c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:29.871753 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9909f2b-3b1f-447f-9175-2de57387f6c8 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:29.897561 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3539/7108] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:36:29 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:36:29.901612 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fe7fbe-0789-4b34-aff4-7a27a273405e admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:29.917206 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fe7fbe-0789-4b34-aff4-7a27a273405e admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:29.924094 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74305ae-ca85-4a9d-b497-41612952fd5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:29.927394 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74305ae-ca85-4a9d-b497-41612952fd5f admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:29.928053 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74305ae-ca85-4a9d-b497-41612952fd5f admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:29.928559 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74305ae-ca85-4a9d-b497-41612952fd5f admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:29.929797 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74305ae-ca85-4a9d-b497-41612952fd5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:29.932753 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74305ae-ca85-4a9d-b497-41612952fd5f admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:29.948977 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3570/7109] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:36:29 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 21:36:29.953783 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9909f2b-3b1f-447f-9175-2de57387f6c8 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:29.968934 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9909f2b-3b1f-447f-9175-2de57387f6c8 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:29.979205 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43efc7dd-1766-4c42-8890-dcccffa2214f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:29.982607 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43efc7dd-1766-4c42-8890-dcccffa2214f admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:29.985599 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43efc7dd-1766-4c42-8890-dcccffa2214f admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:29.986213 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43efc7dd-1766-4c42-8890-dcccffa2214f admin admin] PATH_INFO: `/v3/projects/2432219c5c43400e978d74c94c39b810/users/0f33541bb2b64d94a0c91b209e28a57e/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:30.019419 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43efc7dd-1766-4c42-8890-dcccffa2214f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2432219c5c43400e978d74c94c39b810, user_id=0f33541bb2b64d94a0c91b209e28a57e, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:30.026672 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43efc7dd-1766-4c42-8890-dcccffa2214f admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:30.085469 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3540/7110] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:36:29 2022] PUT /identity/v3/projects/2432219c5c43400e978d74c94c39b810/users/0f33541bb2b64d94a0c91b209e28a57e/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:36:30.086259 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c176a2-f148-47c7-8874-ff2b3744f451 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:30.086736 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c176a2-f148-47c7-8874-ff2b3744f451 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:30.087175 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c176a2-f148-47c7-8874-ff2b3744f451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:30.124221 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-83c176a2-f148-47c7-8874-ff2b3744f451 None None] MFA Rules not processed for user `0f33541bb2b64d94a0c91b209e28a57e`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:36:30.125532 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-83c176a2-f148-47c7-8874-ff2b3744f451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:36:30.144299 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:36:30.255347 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3571/7111] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:36:30 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:36:30.282956 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43efc7dd-1766-4c42-8890-dcccffa2214f admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:30.284903 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-43efc7dd-1766-4c42-8890-dcccffa2214f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:36:30.424820 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43efc7dd-1766-4c42-8890-dcccffa2214f admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:30.429118 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b060c6c2-2d1f-4278-a3af-7f61093131c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:30.430005 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b060c6c2-2d1f-4278-a3af-7f61093131c1 service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:30.430242 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b060c6c2-2d1f-4278-a3af-7f61093131c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:30.430558 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b060c6c2-2d1f-4278-a3af-7f61093131c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:30.446134 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b060c6c2-2d1f-4278-a3af-7f61093131c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:30.447957 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b060c6c2-2d1f-4278-a3af-7f61093131c1 service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:30.460668 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3541/7112] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:36:30 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:36:31.107510 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c176a2-f148-47c7-8874-ff2b3744f451 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:31.109210 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-83c176a2-f148-47c7-8874-ff2b3744f451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:36:31.310061 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c176a2-f148-47c7-8874-ff2b3744f451 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:31.317523 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452b37f0-8361-4082-b08c-6fcdfdb29bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:31.318558 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452b37f0-8361-4082-b08c-6fcdfdb29bbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:31.318840 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452b37f0-8361-4082-b08c-6fcdfdb29bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:31.319111 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452b37f0-8361-4082-b08c-6fcdfdb29bbd admin admin] PATH_INFO: `/v3/projects/b448542eac8648229062eeeec658bbce` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:31.320379 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452b37f0-8361-4082-b08c-6fcdfdb29bbd admin admin] RBAC: Authorizing `identity:delete_project(project_id=b448542eac8648229062eeeec658bbce)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:31.322416 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452b37f0-8361-4082-b08c-6fcdfdb29bbd admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:31.406886 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-452b37f0-8361-4082-b08c-6fcdfdb29bbd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b448542eac8648229062eeeec658bbce', 'request_id': 'req-452b37f0-8361-4082-b08c-6fcdfdb29bbd'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:31.418005 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-452b37f0-8361-4082-b08c-6fcdfdb29bbd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b448542eac8648229062eeeec658bbce', 'request_id': 'req-452b37f0-8361-4082-b08c-6fcdfdb29bbd'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:31.430242 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-452b37f0-8361-4082-b08c-6fcdfdb29bbd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b448542eac8648229062eeeec658bbce', 'request_id': 'req-452b37f0-8361-4082-b08c-6fcdfdb29bbd'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:31.449605 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-452b37f0-8361-4082-b08c-6fcdfdb29bbd admin admin] The token cache is being invalidate because project b448542eac8648229062eeeec658bbce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:36:31.450085 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-452b37f0-8361-4082-b08c-6fcdfdb29bbd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:31.451125 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-452b37f0-8361-4082-b08c-6fcdfdb29bbd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:31.456206 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3572/7113] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:36:31 2022] DELETE /identity/v3/projects/b448542eac8648229062eeeec658bbce => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:36:31.457254 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b060c6c2-2d1f-4278-a3af-7f61093131c1 service neutron] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:31.489395 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b060c6c2-2d1f-4278-a3af-7f61093131c1 service neutron] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:31.608498 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2232ff4-c5ed-444c-9566-1954310fde15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:31.609629 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2232ff4-c5ed-444c-9566-1954310fde15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:31.610243 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2232ff4-c5ed-444c-9566-1954310fde15 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:31.610623 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2232ff4-c5ed-444c-9566-1954310fde15 admin admin] PATH_INFO: `/v3/users/2a6d1f22084c425387b1b1925ad49f80` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:31.612861 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2232ff4-c5ed-444c-9566-1954310fde15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a6d1f22084c425387b1b1925ad49f80)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:31.615085 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2232ff4-c5ed-444c-9566-1954310fde15 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:31.649340 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:36:31.689054 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-e2232ff4-c5ed-444c-9566-1954310fde15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a6d1f22084c425387b1b1925ad49f80'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:31.699317 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-e2232ff4-c5ed-444c-9566-1954310fde15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a6d1f22084c425387b1b1925ad49f80'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:31.700225 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-e2232ff4-c5ed-444c-9566-1954310fde15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a6d1f22084c425387b1b1925ad49f80'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:31.711321 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-e2232ff4-c5ed-444c-9566-1954310fde15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a6d1f22084c425387b1b1925ad49f80'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:31.736001 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-e2232ff4-c5ed-444c-9566-1954310fde15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a6d1f22084c425387b1b1925ad49f80'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:31.743684 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3542/7114] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:36:31 2022] DELETE /identity/v3/users/2a6d1f22084c425387b1b1925ad49f80 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:36:32.788277 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452b37f0-8361-4082-b08c-6fcdfdb29bbd admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:32.790466 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-452b37f0-8361-4082-b08c-6fcdfdb29bbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:36:32.814578 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452b37f0-8361-4082-b08c-6fcdfdb29bbd admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:32.928710 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:36:32.952356 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72329cdf-d227-4c50-a44b-a806789f3d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:32.953398 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72329cdf-d227-4c50-a44b-a806789f3d16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:32.953812 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72329cdf-d227-4c50-a44b-a806789f3d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:32.954123 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72329cdf-d227-4c50-a44b-a806789f3d16 admin admin] PATH_INFO: `/v3/projects/73a197d933fd4d58b6c293fa764213b2` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:32.959596 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72329cdf-d227-4c50-a44b-a806789f3d16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73a197d933fd4d58b6c293fa764213b2)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:32.965267 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72329cdf-d227-4c50-a44b-a806789f3d16 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:33.078306 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-72329cdf-d227-4c50-a44b-a806789f3d16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73a197d933fd4d58b6c293fa764213b2', 'request_id': 'req-72329cdf-d227-4c50-a44b-a806789f3d16'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:33.100416 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-72329cdf-d227-4c50-a44b-a806789f3d16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73a197d933fd4d58b6c293fa764213b2', 'request_id': 'req-72329cdf-d227-4c50-a44b-a806789f3d16'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:33.107971 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-72329cdf-d227-4c50-a44b-a806789f3d16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73a197d933fd4d58b6c293fa764213b2', 'request_id': 'req-72329cdf-d227-4c50-a44b-a806789f3d16'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:33.127927 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-72329cdf-d227-4c50-a44b-a806789f3d16 admin admin] The token cache is being invalidate because project 73a197d933fd4d58b6c293fa764213b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:36:33.128623 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-72329cdf-d227-4c50-a44b-a806789f3d16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:33.129589 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-72329cdf-d227-4c50-a44b-a806789f3d16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:33.151846 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3573/7115] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:36:32 2022] DELETE /identity/v3/projects/73a197d933fd4d58b6c293fa764213b2 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:36:33.155945 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2232ff4-c5ed-444c-9566-1954310fde15 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:33.157592 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-e2232ff4-c5ed-444c-9566-1954310fde15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:36:33.180742 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2232ff4-c5ed-444c-9566-1954310fde15 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:33.307136 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5d6911-e74a-4043-98a5-d74563e2e274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:33.308191 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5d6911-e74a-4043-98a5-d74563e2e274 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:33.308480 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5d6911-e74a-4043-98a5-d74563e2e274 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:33.308859 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5d6911-e74a-4043-98a5-d74563e2e274 admin admin] PATH_INFO: `/v3/users/d024d91d1e5e4e819e94ac43b19725ba` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:33.310206 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5d6911-e74a-4043-98a5-d74563e2e274 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d024d91d1e5e4e819e94ac43b19725ba)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:33.312256 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5d6911-e74a-4043-98a5-d74563e2e274 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:33.397356 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-ef5d6911-e74a-4043-98a5-d74563e2e274 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd024d91d1e5e4e819e94ac43b19725ba'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:33.413448 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-ef5d6911-e74a-4043-98a5-d74563e2e274 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd024d91d1e5e4e819e94ac43b19725ba'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:33.414447 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-ef5d6911-e74a-4043-98a5-d74563e2e274 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd024d91d1e5e4e819e94ac43b19725ba'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:33.425502 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-ef5d6911-e74a-4043-98a5-d74563e2e274 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd024d91d1e5e4e819e94ac43b19725ba'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:33.442591 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-ef5d6911-e74a-4043-98a5-d74563e2e274 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd024d91d1e5e4e819e94ac43b19725ba'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:33.450693 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3543/7116] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:36:33 2022] DELETE /identity/v3/users/d024d91d1e5e4e819e94ac43b19725ba => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:36:33.785018 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72329cdf-d227-4c50-a44b-a806789f3d16 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:33.787348 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-72329cdf-d227-4c50-a44b-a806789f3d16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:36:33.828498 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72329cdf-d227-4c50-a44b-a806789f3d16 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:33.895947 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a051518b-016b-4be4-a472-df3cbe9b7422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:33.897187 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a051518b-016b-4be4-a472-df3cbe9b7422 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:33.897623 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a051518b-016b-4be4-a472-df3cbe9b7422 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:33.898074 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a051518b-016b-4be4-a472-df3cbe9b7422 admin admin] PATH_INFO: `/v3/projects/dda68b7dab7844a89e77e7d43a1a4432` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:33.899881 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a051518b-016b-4be4-a472-df3cbe9b7422 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dda68b7dab7844a89e77e7d43a1a4432)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:33.902078 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a051518b-016b-4be4-a472-df3cbe9b7422 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:33.966129 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-a051518b-016b-4be4-a472-df3cbe9b7422 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dda68b7dab7844a89e77e7d43a1a4432', 'request_id': 'req-a051518b-016b-4be4-a472-df3cbe9b7422'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:33.978850 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-a051518b-016b-4be4-a472-df3cbe9b7422 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dda68b7dab7844a89e77e7d43a1a4432', 'request_id': 'req-a051518b-016b-4be4-a472-df3cbe9b7422'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:33.988085 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-a051518b-016b-4be4-a472-df3cbe9b7422 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dda68b7dab7844a89e77e7d43a1a4432', 'request_id': 'req-a051518b-016b-4be4-a472-df3cbe9b7422'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:34.000828 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-a051518b-016b-4be4-a472-df3cbe9b7422 admin admin] The token cache is being invalidate because project dda68b7dab7844a89e77e7d43a1a4432 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:36:34.002186 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-a051518b-016b-4be4-a472-df3cbe9b7422 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:34.002959 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-a051518b-016b-4be4-a472-df3cbe9b7422 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:34.010026 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3574/7117] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:36:33 2022] DELETE /identity/v3/projects/dda68b7dab7844a89e77e7d43a1a4432 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:36:34.010822 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d17c13-e246-4850-a8ca-6e612fb6ba93 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:34.011110 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d17c13-e246-4850-a8ca-6e612fb6ba93 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:34.011390 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d17c13-e246-4850-a8ca-6e612fb6ba93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:34.044727 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-f1d17c13-e246-4850-a8ca-6e612fb6ba93 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:36:34.046535 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-f1d17c13-e246-4850-a8ca-6e612fb6ba93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:36:34.070885 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:DELETE=18,keystone:SELECT=80,keystone:INSERT=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:36:34.137534 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3544/7118] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:36:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:36:34.145946 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cfa6f1-4aa5-46c5-aca0-3ed4ab6e6cb4 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:34.146305 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cfa6f1-4aa5-46c5-aca0-3ed4ab6e6cb4 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:34.146688 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cfa6f1-4aa5-46c5-aca0-3ed4ab6e6cb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:34.160576 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:36:34.169050 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-34cfa6f1-4aa5-46c5-aca0-3ed4ab6e6cb4 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:36:34.170417 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-34cfa6f1-4aa5-46c5-aca0-3ed4ab6e6cb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:36:34.184688 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3575/7119] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:36:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:36:34.186153 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d17c13-e246-4850-a8ca-6e612fb6ba93 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:34.197130 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d17c13-e246-4850-a8ca-6e612fb6ba93 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:34.202719 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d19871-5a46-4f7d-8f70-3afc21332694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:34.203463 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d19871-5a46-4f7d-8f70-3afc21332694 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:34.203771 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d19871-5a46-4f7d-8f70-3afc21332694 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:34.204048 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d19871-5a46-4f7d-8f70-3afc21332694 admin admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:34.204782 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d19871-5a46-4f7d-8f70-3afc21332694 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:36:34.205077 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d19871-5a46-4f7d-8f70-3afc21332694 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:34.206893 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d19871-5a46-4f7d-8f70-3afc21332694 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:34.220363 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3545/7120] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:36:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:36:34.224768 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cfa6f1-4aa5-46c5-aca0-3ed4ab6e6cb4 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:34.234967 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cfa6f1-4aa5-46c5-aca0-3ed4ab6e6cb4 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:34.240112 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908b8c83-8129-4afa-9c79-b87529b50425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:34.240763 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908b8c83-8129-4afa-9c79-b87529b50425 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:34.241041 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908b8c83-8129-4afa-9c79-b87529b50425 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:34.241310 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908b8c83-8129-4afa-9c79-b87529b50425 admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:34.242066 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908b8c83-8129-4afa-9c79-b87529b50425 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:34.244021 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908b8c83-8129-4afa-9c79-b87529b50425 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:34.278557 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3576/7121] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:36:34 2022] POST /identity/v3/projects => generated 365 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:36:34.280635 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d19871-5a46-4f7d-8f70-3afc21332694 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:34.299027 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d19871-5a46-4f7d-8f70-3afc21332694 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:34.372124 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab54ecf0-3076-46fa-a8a0-db0c73915878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:34.372895 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab54ecf0-3076-46fa-a8a0-db0c73915878 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:34.373239 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab54ecf0-3076-46fa-a8a0-db0c73915878 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:34.373675 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab54ecf0-3076-46fa-a8a0-db0c73915878 admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:34.374484 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab54ecf0-3076-46fa-a8a0-db0c73915878 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:34.376636 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab54ecf0-3076-46fa-a8a0-db0c73915878 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:34.412506 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3546/7122] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:36:34 2022] POST /identity/v3/users => generated 283 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:36:34.413728 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908b8c83-8129-4afa-9c79-b87529b50425 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:34.429611 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908b8c83-8129-4afa-9c79-b87529b50425 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:34.434595 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349cfa5c-6f8a-48c1-9209-9d419d3d4579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:34.435270 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349cfa5c-6f8a-48c1-9209-9d419d3d4579 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:34.435533 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349cfa5c-6f8a-48c1-9209-9d419d3d4579 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:34.436449 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349cfa5c-6f8a-48c1-9209-9d419d3d4579 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:34.436684 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349cfa5c-6f8a-48c1-9209-9d419d3d4579 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:34.439010 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349cfa5c-6f8a-48c1-9209-9d419d3d4579 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:34.456251 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3577/7123] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:36:34 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 21:36:34.457559 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab54ecf0-3076-46fa-a8a0-db0c73915878 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:34.471589 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab54ecf0-3076-46fa-a8a0-db0c73915878 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:34.476686 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a662d45-7f60-4f3e-b03e-a0b1b824fca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:34.477369 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a662d45-7f60-4f3e-b03e-a0b1b824fca5 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:34.477654 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a662d45-7f60-4f3e-b03e-a0b1b824fca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:34.478963 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a662d45-7f60-4f3e-b03e-a0b1b824fca5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:34.479716 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a662d45-7f60-4f3e-b03e-a0b1b824fca5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:34.481397 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a662d45-7f60-4f3e-b03e-a0b1b824fca5 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:34.497942 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3547/7124] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:36:34 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:36:34.499133 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349cfa5c-6f8a-48c1-9209-9d419d3d4579 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:34.510546 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349cfa5c-6f8a-48c1-9209-9d419d3d4579 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:34.515733 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42b10fe-face-4750-93f8-d91fe14d84fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:34.516841 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42b10fe-face-4750-93f8-d91fe14d84fe admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:34.517270 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42b10fe-face-4750-93f8-d91fe14d84fe admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:34.517519 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42b10fe-face-4750-93f8-d91fe14d84fe admin admin] PATH_INFO: `/v3/projects/8f7fb3587be14297b5982c032a063c51/users/6436e26120d14cdd80edabde9e13345b/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:34.550491 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42b10fe-face-4750-93f8-d91fe14d84fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f7fb3587be14297b5982c032a063c51, user_id=6436e26120d14cdd80edabde9e13345b, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:34.554790 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42b10fe-face-4750-93f8-d91fe14d84fe admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:34.593434 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3578/7125] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:36:34 2022] PUT /identity/v3/projects/8f7fb3587be14297b5982c032a063c51/users/6436e26120d14cdd80edabde9e13345b/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:36:34.600212 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27011cb2-a43e-49e1-8399-844e736d5c9a None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:34.600617 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27011cb2-a43e-49e1-8399-844e736d5c9a None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:34.600996 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27011cb2-a43e-49e1-8399-844e736d5c9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:34.642458 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-27011cb2-a43e-49e1-8399-844e736d5c9a None None] MFA Rules not processed for user `6436e26120d14cdd80edabde9e13345b`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:36:34.644290 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-27011cb2-a43e-49e1-8399-844e736d5c9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:36:34.740636 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3548/7126] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:36:34 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:36:34.745777 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42b10fe-face-4750-93f8-d91fe14d84fe admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:34.856902 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42b10fe-face-4750-93f8-d91fe14d84fe admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:34.862285 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e054bc97-1c1d-47ee-a2ad-ff6bcb6926af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:34.863321 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e054bc97-1c1d-47ee-a2ad-ff6bcb6926af admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:34.863612 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e054bc97-1c1d-47ee-a2ad-ff6bcb6926af admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:34.863887 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e054bc97-1c1d-47ee-a2ad-ff6bcb6926af admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:34.864733 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e054bc97-1c1d-47ee-a2ad-ff6bcb6926af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:34.867016 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e054bc97-1c1d-47ee-a2ad-ff6bcb6926af admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:34.902533 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27011cb2-a43e-49e1-8399-844e736d5c9a None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:34.910695 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3579/7127] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:36:34 2022] POST /identity/v3/projects => generated 367 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:36:34.926441 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27011cb2-a43e-49e1-8399-844e736d5c9a None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:34.939547 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:36:35.018715 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed224a5-d4a9-47bb-9687-a2ce41d62f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:35.019805 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed224a5-d4a9-47bb-9687-a2ce41d62f8a admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:35.020848 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed224a5-d4a9-47bb-9687-a2ce41d62f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:35.022299 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed224a5-d4a9-47bb-9687-a2ce41d62f8a admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:35.023183 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed224a5-d4a9-47bb-9687-a2ce41d62f8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:35.026218 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed224a5-d4a9-47bb-9687-a2ce41d62f8a admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:35.053958 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3549/7128] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:36:34 2022] POST /identity/v3/users => generated 290 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:36:35.059131 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e054bc97-1c1d-47ee-a2ad-ff6bcb6926af admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:35.075908 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e054bc97-1c1d-47ee-a2ad-ff6bcb6926af admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:35.086217 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82745d76-d99c-43ef-bb0b-5c16d5441bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:35.088989 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82745d76-d99c-43ef-bb0b-5c16d5441bb6 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:35.088989 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82745d76-d99c-43ef-bb0b-5c16d5441bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:35.089375 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82745d76-d99c-43ef-bb0b-5c16d5441bb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:35.095476 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82745d76-d99c-43ef-bb0b-5c16d5441bb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:35.096989 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82745d76-d99c-43ef-bb0b-5c16d5441bb6 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:35.142711 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3580/7129] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:36:35 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:36:35.147419 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed224a5-d4a9-47bb-9687-a2ce41d62f8a admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:35.162946 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed224a5-d4a9-47bb-9687-a2ce41d62f8a admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:35.172120 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195bc3bb-d001-4139-b56c-716e7ea0db41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:35.175479 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195bc3bb-d001-4139-b56c-716e7ea0db41 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:35.176001 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195bc3bb-d001-4139-b56c-716e7ea0db41 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:35.177910 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195bc3bb-d001-4139-b56c-716e7ea0db41 admin admin] PATH_INFO: `/v3/projects/38fc8edcbf774cada464b337ffd4fcc4/users/064424f0bdc54967a0e708fd7eb73749/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:35.223643 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195bc3bb-d001-4139-b56c-716e7ea0db41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38fc8edcbf774cada464b337ffd4fcc4, user_id=064424f0bdc54967a0e708fd7eb73749, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:35.229400 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195bc3bb-d001-4139-b56c-716e7ea0db41 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:35.267355 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3550/7130] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:36:35 2022] PUT /identity/v3/projects/38fc8edcbf774cada464b337ffd4fcc4/users/064424f0bdc54967a0e708fd7eb73749/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:36:35.270505 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82745d76-d99c-43ef-bb0b-5c16d5441bb6 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:35.286901 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82745d76-d99c-43ef-bb0b-5c16d5441bb6 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:35.420140 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fa1296-7eff-44c7-bf66-85e8c1a315b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:35.420422 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fa1296-7eff-44c7-bf66-85e8c1a315b4 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:35.420706 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fa1296-7eff-44c7-bf66-85e8c1a315b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:35.420993 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fa1296-7eff-44c7-bf66-85e8c1a315b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:35.422689 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fa1296-7eff-44c7-bf66-85e8c1a315b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:35.423931 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fa1296-7eff-44c7-bf66-85e8c1a315b4 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:35.435090 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3581/7131] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:36:35 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:36:35.441588 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195bc3bb-d001-4139-b56c-716e7ea0db41 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:35.459007 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195bc3bb-d001-4139-b56c-716e7ea0db41 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:35.466452 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f2a19f-d069-4e3c-a701-15886f975e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:35.468142 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f2a19f-d069-4e3c-a701-15886f975e7c admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:35.469060 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f2a19f-d069-4e3c-a701-15886f975e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:35.469551 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f2a19f-d069-4e3c-a701-15886f975e7c admin admin] PATH_INFO: `/v3/projects/38fc8edcbf774cada464b337ffd4fcc4/users/064424f0bdc54967a0e708fd7eb73749/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:35.480125 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f2a19f-d069-4e3c-a701-15886f975e7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=38fc8edcbf774cada464b337ffd4fcc4, user_id=064424f0bdc54967a0e708fd7eb73749, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:35.484177 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f2a19f-d069-4e3c-a701-15886f975e7c admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:35.499563 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3551/7132] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:36:35 2022] PUT /identity/v3/projects/38fc8edcbf774cada464b337ffd4fcc4/users/064424f0bdc54967a0e708fd7eb73749/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:36:35.518436 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20815bbe-0ffd-44ea-bc74-417104313440 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:35.518732 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20815bbe-0ffd-44ea-bc74-417104313440 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:35.519066 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20815bbe-0ffd-44ea-bc74-417104313440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:35.560682 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:36:35.565298 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-20815bbe-0ffd-44ea-bc74-417104313440 None None] MFA Rules not processed for user `064424f0bdc54967a0e708fd7eb73749`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:36:35.568355 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-20815bbe-0ffd-44ea-bc74-417104313440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:36:35.664302 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3582/7133] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:36:35 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:36:35.679585 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f2a19f-d069-4e3c-a701-15886f975e7c admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:35.682187 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-f3f2a19f-d069-4e3c-a701-15886f975e7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:36:35.757758 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f2a19f-d069-4e3c-a701-15886f975e7c admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:35.763131 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdddba7c-b6fb-45c5-8f7e-d0a9c1bcd939 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec5fd3a489c341b7964704d689037f05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:35.763903 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdddba7c-b6fb-45c5-8f7e-d0a9c1bcd939 service cinder] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:35.764216 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdddba7c-b6fb-45c5-8f7e-d0a9c1bcd939 service cinder] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:35.764515 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdddba7c-b6fb-45c5-8f7e-d0a9c1bcd939 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:35.776393 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdddba7c-b6fb-45c5-8f7e-d0a9c1bcd939 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:35.778506 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdddba7c-b6fb-45c5-8f7e-d0a9c1bcd939 service cinder] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:35.791734 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3552/7134] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:36:35 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 23 21:36:35.930033 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20815bbe-0ffd-44ea-bc74-417104313440 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:35.946951 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20815bbe-0ffd-44ea-bc74-417104313440 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:35.956229 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3ebbfa-b3e2-45b4-960c-0d60f83eb89a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec5fd3a489c341b7964704d689037f05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:35.957624 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3ebbfa-b3e2-45b4-960c-0d60f83eb89a service cinder] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:35.958032 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3ebbfa-b3e2-45b4-960c-0d60f83eb89a service cinder] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:35.958412 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3ebbfa-b3e2-45b4-960c-0d60f83eb89a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:36.088127 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3ebbfa-b3e2-45b4-960c-0d60f83eb89a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:36.089692 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3ebbfa-b3e2-45b4-960c-0d60f83eb89a service cinder] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:36.100814 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3583/7135] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:36:35 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:36:36.442771 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdddba7c-b6fb-45c5-8f7e-d0a9c1bcd939 service cinder] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:36.444539 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-cdddba7c-b6fb-45c5-8f7e-d0a9c1bcd939 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:36:36.642703 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdddba7c-b6fb-45c5-8f7e-d0a9c1bcd939 service cinder] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:36.653297 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f7d240-5f97-4b95-88c6-507c9e84c0a7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc719a3b3ac4461b82ca04ab6451d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:36.655297 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f7d240-5f97-4b95-88c6-507c9e84c0a7 service placement] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:36.655612 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f7d240-5f97-4b95-88c6-507c9e84c0a7 service placement] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:36.655877 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f7d240-5f97-4b95-88c6-507c9e84c0a7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:36.663765 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-48f7d240-5f97-4b95-88c6-507c9e84c0a7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:36:36.698437 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:36:36.707713 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f7d240-5f97-4b95-88c6-507c9e84c0a7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:36.712093 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f7d240-5f97-4b95-88c6-507c9e84c0a7 service placement] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:36.745153 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3553/7136] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:36:36 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:36:39.700934 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3ebbfa-b3e2-45b4-960c-0d60f83eb89a service cinder] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:39.824118 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3ebbfa-b3e2-45b4-960c-0d60f83eb89a service cinder] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:39.830767 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f8ee88-2047-4ae5-adbe-552702a46891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:39.831722 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f8ee88-2047-4ae5-adbe-552702a46891 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:39.832028 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f8ee88-2047-4ae5-adbe-552702a46891 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:39.832245 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f8ee88-2047-4ae5-adbe-552702a46891 admin admin] PATH_INFO: `/v3/users/6436e26120d14cdd80edabde9e13345b` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:39.833540 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f8ee88-2047-4ae5-adbe-552702a46891 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6436e26120d14cdd80edabde9e13345b)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:39.836086 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f8ee88-2047-4ae5-adbe-552702a46891 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:39.921797 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:36:39.937621 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-f9f8ee88-2047-4ae5-adbe-552702a46891 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6436e26120d14cdd80edabde9e13345b'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:39.940530 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-f9f8ee88-2047-4ae5-adbe-552702a46891 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6436e26120d14cdd80edabde9e13345b'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:39.981475 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-f9f8ee88-2047-4ae5-adbe-552702a46891 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6436e26120d14cdd80edabde9e13345b'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:39.995602 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-f9f8ee88-2047-4ae5-adbe-552702a46891 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6436e26120d14cdd80edabde9e13345b'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:40.014827 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-f9f8ee88-2047-4ae5-adbe-552702a46891 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6436e26120d14cdd80edabde9e13345b'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:40.027075 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3584/7137] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:36:39 2022] DELETE /identity/v3/users/6436e26120d14cdd80edabde9e13345b => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:36:40.028188 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8c3569-d808-4ebc-9f82-bb6ff4a0adc1 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:40.028698 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8c3569-d808-4ebc-9f82-bb6ff4a0adc1 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:40.028792 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8c3569-d808-4ebc-9f82-bb6ff4a0adc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:40.072780 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-df8c3569-d808-4ebc-9f82-bb6ff4a0adc1 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:36:40.074124 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-df8c3569-d808-4ebc-9f82-bb6ff4a0adc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:36:40.215547 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3554/7138] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:36:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:36:40.235830 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f8ee88-2047-4ae5-adbe-552702a46891 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:40.237600 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-f9f8ee88-2047-4ae5-adbe-552702a46891 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:36:40.406135 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f8ee88-2047-4ae5-adbe-552702a46891 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:40.411286 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebc99f5-bcc0-45bd-82e9-0f28ec23e2db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:40.411286 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebc99f5-bcc0-45bd-82e9-0f28ec23e2db service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:40.411615 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebc99f5-bcc0-45bd-82e9-0f28ec23e2db service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:40.411859 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebc99f5-bcc0-45bd-82e9-0f28ec23e2db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:40.428058 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebc99f5-bcc0-45bd-82e9-0f28ec23e2db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:40.430226 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebc99f5-bcc0-45bd-82e9-0f28ec23e2db service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:40.451538 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3585/7139] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:36:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:36:41.629724 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8c3569-d808-4ebc-9f82-bb6ff4a0adc1 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:41.631879 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-df8c3569-d808-4ebc-9f82-bb6ff4a0adc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:36:41.652220 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8c3569-d808-4ebc-9f82-bb6ff4a0adc1 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:41.665963 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbdc4cb-03d6-4ed0-8176-a0636ae91df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:41.666997 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbdc4cb-03d6-4ed0-8176-a0636ae91df9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:41.667140 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbdc4cb-03d6-4ed0-8176-a0636ae91df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:41.667600 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbdc4cb-03d6-4ed0-8176-a0636ae91df9 admin admin] PATH_INFO: `/v3/projects/8f7fb3587be14297b5982c032a063c51` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:41.670483 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbdc4cb-03d6-4ed0-8176-a0636ae91df9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f7fb3587be14297b5982c032a063c51)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:41.672542 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbdc4cb-03d6-4ed0-8176-a0636ae91df9 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:41.826869 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-3bbdc4cb-03d6-4ed0-8176-a0636ae91df9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f7fb3587be14297b5982c032a063c51', 'request_id': 'req-3bbdc4cb-03d6-4ed0-8176-a0636ae91df9'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:41.839324 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-3bbdc4cb-03d6-4ed0-8176-a0636ae91df9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f7fb3587be14297b5982c032a063c51', 'request_id': 'req-3bbdc4cb-03d6-4ed0-8176-a0636ae91df9'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:41.854364 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-3bbdc4cb-03d6-4ed0-8176-a0636ae91df9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f7fb3587be14297b5982c032a063c51', 'request_id': 'req-3bbdc4cb-03d6-4ed0-8176-a0636ae91df9'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:41.887481 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-3bbdc4cb-03d6-4ed0-8176-a0636ae91df9 admin admin] The token cache is being invalidate because project 8f7fb3587be14297b5982c032a063c51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:36:41.887702 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-3bbdc4cb-03d6-4ed0-8176-a0636ae91df9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:41.888310 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-3bbdc4cb-03d6-4ed0-8176-a0636ae91df9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:41.891207 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3555/7140] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:36:41 2022] DELETE /identity/v3/projects/8f7fb3587be14297b5982c032a063c51 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:36:41.896971 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebc99f5-bcc0-45bd-82e9-0f28ec23e2db service neutron] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:41.911878 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebc99f5-bcc0-45bd-82e9-0f28ec23e2db service neutron] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:41.994849 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756beffe-a957-48ba-887f-f744a605d3ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:41.996041 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756beffe-a957-48ba-887f-f744a605d3ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:41.996516 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756beffe-a957-48ba-887f-f744a605d3ae admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:41.996975 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756beffe-a957-48ba-887f-f744a605d3ae admin admin] PATH_INFO: `/v3/users/064424f0bdc54967a0e708fd7eb73749` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:41.998534 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756beffe-a957-48ba-887f-f744a605d3ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=064424f0bdc54967a0e708fd7eb73749)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:42.000908 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756beffe-a957-48ba-887f-f744a605d3ae admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:42.107333 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-756beffe-a957-48ba-887f-f744a605d3ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '064424f0bdc54967a0e708fd7eb73749'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:42.108051 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-756beffe-a957-48ba-887f-f744a605d3ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '064424f0bdc54967a0e708fd7eb73749'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:42.116327 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-756beffe-a957-48ba-887f-f744a605d3ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '064424f0bdc54967a0e708fd7eb73749'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:42.121275 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:36:42.130789 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-756beffe-a957-48ba-887f-f744a605d3ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '064424f0bdc54967a0e708fd7eb73749'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:42.163823 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-756beffe-a957-48ba-887f-f744a605d3ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '064424f0bdc54967a0e708fd7eb73749'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:42.174011 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3586/7141] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:36:41 2022] DELETE /identity/v3/users/064424f0bdc54967a0e708fd7eb73749 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:36:43.128872 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbdc4cb-03d6-4ed0-8176-a0636ae91df9 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:43.130671 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-3bbdc4cb-03d6-4ed0-8176-a0636ae91df9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:36:43.155682 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbdc4cb-03d6-4ed0-8176-a0636ae91df9 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:43.224952 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999e2ce2-c586-43fc-b624-1a994eceb951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:43.227745 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999e2ce2-c586-43fc-b624-1a994eceb951 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:43.228215 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999e2ce2-c586-43fc-b624-1a994eceb951 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:43.228784 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999e2ce2-c586-43fc-b624-1a994eceb951 admin admin] PATH_INFO: `/v3/projects/38fc8edcbf774cada464b337ffd4fcc4` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:43.230508 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999e2ce2-c586-43fc-b624-1a994eceb951 admin admin] RBAC: Authorizing `identity:delete_project(project_id=38fc8edcbf774cada464b337ffd4fcc4)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:43.233091 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999e2ce2-c586-43fc-b624-1a994eceb951 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:43.270269 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:36:43.304012 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-999e2ce2-c586-43fc-b624-1a994eceb951 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38fc8edcbf774cada464b337ffd4fcc4', 'request_id': 'req-999e2ce2-c586-43fc-b624-1a994eceb951'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:43.317363 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-999e2ce2-c586-43fc-b624-1a994eceb951 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38fc8edcbf774cada464b337ffd4fcc4', 'request_id': 'req-999e2ce2-c586-43fc-b624-1a994eceb951'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:43.330838 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-999e2ce2-c586-43fc-b624-1a994eceb951 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38fc8edcbf774cada464b337ffd4fcc4', 'request_id': 'req-999e2ce2-c586-43fc-b624-1a994eceb951'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:43.358434 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-999e2ce2-c586-43fc-b624-1a994eceb951 admin admin] The token cache is being invalidate because project 38fc8edcbf774cada464b337ffd4fcc4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:36:43.358974 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-999e2ce2-c586-43fc-b624-1a994eceb951 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:43.359883 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-999e2ce2-c586-43fc-b624-1a994eceb951 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:43.361712 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3556/7142] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:36:43 2022] DELETE /identity/v3/projects/38fc8edcbf774cada464b337ffd4fcc4 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:36:43.366861 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335c7f52-d168-4585-8fea-ff38458cb5d7 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:43.367865 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335c7f52-d168-4585-8fea-ff38458cb5d7 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:43.368358 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335c7f52-d168-4585-8fea-ff38458cb5d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:43.391719 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-335c7f52-d168-4585-8fea-ff38458cb5d7 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:36:43.397027 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-335c7f52-d168-4585-8fea-ff38458cb5d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:36:43.509770 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3587/7143] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:36:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:36:43.517701 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb69bfe2-dd80-4b8a-91a9-e98da2e9faf4 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:43.518027 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb69bfe2-dd80-4b8a-91a9-e98da2e9faf4 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:43.518302 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb69bfe2-dd80-4b8a-91a9-e98da2e9faf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:43.537961 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-eb69bfe2-dd80-4b8a-91a9-e98da2e9faf4 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:36:43.539211 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-eb69bfe2-dd80-4b8a-91a9-e98da2e9faf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:36:43.548593 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3557/7144] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:36:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:36:43.553685 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335c7f52-d168-4585-8fea-ff38458cb5d7 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:43.568329 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335c7f52-d168-4585-8fea-ff38458cb5d7 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:43.575707 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735185e8-bb07-4b40-9ebe-5bfbe260b645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:43.576643 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735185e8-bb07-4b40-9ebe-5bfbe260b645 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:43.577085 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735185e8-bb07-4b40-9ebe-5bfbe260b645 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:43.577642 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735185e8-bb07-4b40-9ebe-5bfbe260b645 admin admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:43.578629 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735185e8-bb07-4b40-9ebe-5bfbe260b645 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:36:43.579087 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735185e8-bb07-4b40-9ebe-5bfbe260b645 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:43.581420 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735185e8-bb07-4b40-9ebe-5bfbe260b645 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:43.601056 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3588/7145] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:36:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:36:43.604476 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb69bfe2-dd80-4b8a-91a9-e98da2e9faf4 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:43.620126 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb69bfe2-dd80-4b8a-91a9-e98da2e9faf4 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:43.626014 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cad9e1-0a0c-4ba2-87d1-2eeb1fd4650f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:43.626790 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cad9e1-0a0c-4ba2-87d1-2eeb1fd4650f admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:43.627289 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cad9e1-0a0c-4ba2-87d1-2eeb1fd4650f admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:43.630442 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cad9e1-0a0c-4ba2-87d1-2eeb1fd4650f admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:43.631440 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cad9e1-0a0c-4ba2-87d1-2eeb1fd4650f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:43.634494 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cad9e1-0a0c-4ba2-87d1-2eeb1fd4650f admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:43.670017 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3558/7146] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:36:43 2022] POST /identity/v3/projects => generated 385 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:36:43.674133 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735185e8-bb07-4b40-9ebe-5bfbe260b645 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:43.684929 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735185e8-bb07-4b40-9ebe-5bfbe260b645 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:43.746467 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08f90e9-45c9-48d6-a674-39c54a7cbbfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:43.747161 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08f90e9-45c9-48d6-a674-39c54a7cbbfe admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:43.747430 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08f90e9-45c9-48d6-a674-39c54a7cbbfe admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:43.747701 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08f90e9-45c9-48d6-a674-39c54a7cbbfe admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:43.748438 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08f90e9-45c9-48d6-a674-39c54a7cbbfe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:43.750473 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08f90e9-45c9-48d6-a674-39c54a7cbbfe admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:43.773681 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3589/7147] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:36:43 2022] POST /identity/v3/users => generated 293 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:36:43.777920 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cad9e1-0a0c-4ba2-87d1-2eeb1fd4650f admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:43.790486 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cad9e1-0a0c-4ba2-87d1-2eeb1fd4650f admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:43.796276 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d9c6f8-4662-4374-a55e-caa560688345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:43.797080 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d9c6f8-4662-4374-a55e-caa560688345 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:43.797539 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d9c6f8-4662-4374-a55e-caa560688345 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:43.797833 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d9c6f8-4662-4374-a55e-caa560688345 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:43.799449 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d9c6f8-4662-4374-a55e-caa560688345 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:43.801308 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d9c6f8-4662-4374-a55e-caa560688345 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:43.813815 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3559/7148] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:36:43 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 21:36:43.818213 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08f90e9-45c9-48d6-a674-39c54a7cbbfe admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:43.833159 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08f90e9-45c9-48d6-a674-39c54a7cbbfe admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:43.838119 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b302d8dc-9cc3-41a8-9479-7a455aeb5504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:43.838796 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b302d8dc-9cc3-41a8-9479-7a455aeb5504 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:43.839070 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b302d8dc-9cc3-41a8-9479-7a455aeb5504 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:43.839338 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b302d8dc-9cc3-41a8-9479-7a455aeb5504 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:43.840055 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b302d8dc-9cc3-41a8-9479-7a455aeb5504 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:43.841657 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b302d8dc-9cc3-41a8-9479-7a455aeb5504 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:43.856766 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3590/7149] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:36:43 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 21:36:43.857982 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d9c6f8-4662-4374-a55e-caa560688345 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:43.870719 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d9c6f8-4662-4374-a55e-caa560688345 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:43.877380 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf764b3-083d-4925-8b14-61ab0b0b5f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:43.878404 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf764b3-083d-4925-8b14-61ab0b0b5f9c admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:43.878745 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf764b3-083d-4925-8b14-61ab0b0b5f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:43.879079 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf764b3-083d-4925-8b14-61ab0b0b5f9c admin admin] PATH_INFO: `/v3/projects/cd5a5810f6a048698334dd11feeeba37/users/50099412dd8749f786ac6f50c94468f5/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:43.898769 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf764b3-083d-4925-8b14-61ab0b0b5f9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd5a5810f6a048698334dd11feeeba37, user_id=50099412dd8749f786ac6f50c94468f5, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:43.902062 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf764b3-083d-4925-8b14-61ab0b0b5f9c admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:43.921586 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3560/7150] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:36:43 2022] PUT /identity/v3/projects/cd5a5810f6a048698334dd11feeeba37/users/50099412dd8749f786ac6f50c94468f5/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:36:43.934629 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a06a4e-9902-431a-ac4a-d4db2b40c9cf None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:43.934985 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a06a4e-9902-431a-ac4a-d4db2b40c9cf None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:43.935341 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a06a4e-9902-431a-ac4a-d4db2b40c9cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:43.966387 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-07a06a4e-9902-431a-ac4a-d4db2b40c9cf None None] MFA Rules not processed for user `50099412dd8749f786ac6f50c94468f5`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:36:43.967702 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-07a06a4e-9902-431a-ac4a-d4db2b40c9cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:36:44.020282 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:36:44.075577 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3591/7151] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:36:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:36:44.086862 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf764b3-083d-4925-8b14-61ab0b0b5f9c admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:44.088909 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-acf764b3-083d-4925-8b14-61ab0b0b5f9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:36:44.187889 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf764b3-083d-4925-8b14-61ab0b0b5f9c admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:44.192350 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ce56ae-3091-4f27-8d63-508b2766d7f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec5fd3a489c341b7964704d689037f05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:44.193187 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ce56ae-3091-4f27-8d63-508b2766d7f3 service cinder] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:44.193750 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ce56ae-3091-4f27-8d63-508b2766d7f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:44.194635 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ce56ae-3091-4f27-8d63-508b2766d7f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:44.207938 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ce56ae-3091-4f27-8d63-508b2766d7f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:44.209564 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ce56ae-3091-4f27-8d63-508b2766d7f3 service cinder] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:44.235832 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3561/7152] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:36:44 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:36:44.255797 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a06a4e-9902-431a-ac4a-d4db2b40c9cf None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:44.347668 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a06a4e-9902-431a-ac4a-d4db2b40c9cf None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:44.353198 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e24dc7a-912a-4620-838e-e1a730110d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:44.354393 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e24dc7a-912a-4620-838e-e1a730110d5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:44.354674 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e24dc7a-912a-4620-838e-e1a730110d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:44.354947 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e24dc7a-912a-4620-838e-e1a730110d5d admin admin] PATH_INFO: `/v3/users/50099412dd8749f786ac6f50c94468f5` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:44.356190 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e24dc7a-912a-4620-838e-e1a730110d5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=50099412dd8749f786ac6f50c94468f5)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:44.358247 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e24dc7a-912a-4620-838e-e1a730110d5d admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:44.412174 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-3e24dc7a-912a-4620-838e-e1a730110d5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50099412dd8749f786ac6f50c94468f5'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:44.413447 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-3e24dc7a-912a-4620-838e-e1a730110d5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50099412dd8749f786ac6f50c94468f5'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:44.421601 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-3e24dc7a-912a-4620-838e-e1a730110d5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50099412dd8749f786ac6f50c94468f5'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:44.432189 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-3e24dc7a-912a-4620-838e-e1a730110d5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50099412dd8749f786ac6f50c94468f5'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:44.447958 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-3e24dc7a-912a-4620-838e-e1a730110d5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50099412dd8749f786ac6f50c94468f5'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:44.457940 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3592/7153] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:36:44 2022] DELETE /identity/v3/users/50099412dd8749f786ac6f50c94468f5 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:36:44.462810 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9bece1-0709-4cb4-885a-3a1c8c6543f9 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:44.462810 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9bece1-0709-4cb4-885a-3a1c8c6543f9 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:44.463012 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9bece1-0709-4cb4-885a-3a1c8c6543f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:44.484894 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-2e9bece1-0709-4cb4-885a-3a1c8c6543f9 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:36:44.486180 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-2e9bece1-0709-4cb4-885a-3a1c8c6543f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:36:44.546763 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:DELETE=7,keystone:SELECT=90,keystone:INSERT=3 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:36:44.566378 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3562/7154] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:36:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:36:44.584740 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e24dc7a-912a-4620-838e-e1a730110d5d admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:44.586548 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-3e24dc7a-912a-4620-838e-e1a730110d5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:36:44.704541 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e24dc7a-912a-4620-838e-e1a730110d5d admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:44.709501 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87dc044-919b-4b48-b0c0-b98b68780723 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:44.710393 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87dc044-919b-4b48-b0c0-b98b68780723 service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:44.710681 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87dc044-919b-4b48-b0c0-b98b68780723 service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:44.711180 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87dc044-919b-4b48-b0c0-b98b68780723 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:44.721621 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:36:44.729892 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87dc044-919b-4b48-b0c0-b98b68780723 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:44.735089 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87dc044-919b-4b48-b0c0-b98b68780723 service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:44.755288 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3593/7155] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:36:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:36:45.847983 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9bece1-0709-4cb4-885a-3a1c8c6543f9 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:45.850522 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-2e9bece1-0709-4cb4-885a-3a1c8c6543f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:36:45.909586 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9bece1-0709-4cb4-885a-3a1c8c6543f9 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:45.925462 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7e85bf-e57b-466e-aa7f-a4703deff015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:45.928000 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7e85bf-e57b-466e-aa7f-a4703deff015 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:45.928524 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7e85bf-e57b-466e-aa7f-a4703deff015 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:45.929115 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7e85bf-e57b-466e-aa7f-a4703deff015 admin admin] PATH_INFO: `/v3/projects/cd5a5810f6a048698334dd11feeeba37` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:45.931509 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7e85bf-e57b-466e-aa7f-a4703deff015 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd5a5810f6a048698334dd11feeeba37)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:45.933990 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7e85bf-e57b-466e-aa7f-a4703deff015 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:46.043524 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-2f7e85bf-e57b-466e-aa7f-a4703deff015 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd5a5810f6a048698334dd11feeeba37', 'request_id': 'req-2f7e85bf-e57b-466e-aa7f-a4703deff015'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:46.056673 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-2f7e85bf-e57b-466e-aa7f-a4703deff015 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd5a5810f6a048698334dd11feeeba37', 'request_id': 'req-2f7e85bf-e57b-466e-aa7f-a4703deff015'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:46.068809 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-2f7e85bf-e57b-466e-aa7f-a4703deff015 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd5a5810f6a048698334dd11feeeba37', 'request_id': 'req-2f7e85bf-e57b-466e-aa7f-a4703deff015'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:46.087826 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-2f7e85bf-e57b-466e-aa7f-a4703deff015 admin admin] The token cache is being invalidate because project cd5a5810f6a048698334dd11feeeba37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:36:46.088172 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-2f7e85bf-e57b-466e-aa7f-a4703deff015 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:46.088933 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-2f7e85bf-e57b-466e-aa7f-a4703deff015 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:46.091063 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3563/7156] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:36:45 2022] DELETE /identity/v3/projects/cd5a5810f6a048698334dd11feeeba37 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:36:46.097148 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84111bc3-4c31-4b9b-8a4f-5a607f86daa6 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:46.097625 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84111bc3-4c31-4b9b-8a4f-5a607f86daa6 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:46.097744 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84111bc3-4c31-4b9b-8a4f-5a607f86daa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:46.132774 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-84111bc3-4c31-4b9b-8a4f-5a607f86daa6 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:36:46.136196 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-84111bc3-4c31-4b9b-8a4f-5a607f86daa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:36:46.278351 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3594/7157] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:36:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:36:46.279863 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285c2b0a-dc4f-4044-92e8-73dcce020764 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:46.280149 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285c2b0a-dc4f-4044-92e8-73dcce020764 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:46.280591 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285c2b0a-dc4f-4044-92e8-73dcce020764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:46.314001 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-285c2b0a-dc4f-4044-92e8-73dcce020764 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:36:46.316525 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-285c2b0a-dc4f-4044-92e8-73dcce020764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:36:46.331998 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3564/7158] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:36:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:36:46.333332 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84111bc3-4c31-4b9b-8a4f-5a607f86daa6 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:46.345340 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84111bc3-4c31-4b9b-8a4f-5a607f86daa6 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:46.351436 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076e6d40-d099-4b21-b8d3-998316eadc20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:46.352352 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076e6d40-d099-4b21-b8d3-998316eadc20 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:46.352635 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076e6d40-d099-4b21-b8d3-998316eadc20 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:46.352908 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076e6d40-d099-4b21-b8d3-998316eadc20 admin admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:46.354373 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076e6d40-d099-4b21-b8d3-998316eadc20 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:36:46.354670 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076e6d40-d099-4b21-b8d3-998316eadc20 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:46.356961 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076e6d40-d099-4b21-b8d3-998316eadc20 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:46.384330 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3595/7159] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:36:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:36:46.386141 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285c2b0a-dc4f-4044-92e8-73dcce020764 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:46.397741 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285c2b0a-dc4f-4044-92e8-73dcce020764 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:46.404645 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6541b6f6-7010-4172-a2f1-5691e501b830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:46.406123 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6541b6f6-7010-4172-a2f1-5691e501b830 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:46.406522 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6541b6f6-7010-4172-a2f1-5691e501b830 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:46.406890 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6541b6f6-7010-4172-a2f1-5691e501b830 admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:46.407686 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6541b6f6-7010-4172-a2f1-5691e501b830 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:46.410474 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6541b6f6-7010-4172-a2f1-5691e501b830 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:46.454990 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3565/7160] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:36:46 2022] POST /identity/v3/projects => generated 361 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:36:46.459398 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076e6d40-d099-4b21-b8d3-998316eadc20 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:46.478448 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076e6d40-d099-4b21-b8d3-998316eadc20 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:46.593604 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcf0724-3770-47d6-bb5d-9948086e44d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:46.595293 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcf0724-3770-47d6-bb5d-9948086e44d6 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:46.595821 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcf0724-3770-47d6-bb5d-9948086e44d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:46.596310 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcf0724-3770-47d6-bb5d-9948086e44d6 admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:46.597359 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcf0724-3770-47d6-bb5d-9948086e44d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:46.600050 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcf0724-3770-47d6-bb5d-9948086e44d6 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:46.632767 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3596/7161] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:36:46 2022] POST /identity/v3/users => generated 281 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:36:46.636758 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6541b6f6-7010-4172-a2f1-5691e501b830 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:46.652828 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6541b6f6-7010-4172-a2f1-5691e501b830 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:46.660866 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdcea85-7864-4369-96e1-ccab1ec8fb1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:46.662254 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdcea85-7864-4369-96e1-ccab1ec8fb1e admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:46.663173 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdcea85-7864-4369-96e1-ccab1ec8fb1e admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:46.663994 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdcea85-7864-4369-96e1-ccab1ec8fb1e admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:46.665209 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdcea85-7864-4369-96e1-ccab1ec8fb1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:46.667371 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdcea85-7864-4369-96e1-ccab1ec8fb1e admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:46.682912 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3566/7162] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:36:46 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 21:36:46.686594 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcf0724-3770-47d6-bb5d-9948086e44d6 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:46.702092 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcf0724-3770-47d6-bb5d-9948086e44d6 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:46.709109 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad40c8b1-f07f-443e-ade4-d239c606fda8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:46.710417 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad40c8b1-f07f-443e-ade4-d239c606fda8 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:46.711065 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad40c8b1-f07f-443e-ade4-d239c606fda8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:46.711583 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad40c8b1-f07f-443e-ade4-d239c606fda8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:46.712575 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad40c8b1-f07f-443e-ade4-d239c606fda8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:46.715431 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad40c8b1-f07f-443e-ade4-d239c606fda8 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:46.729684 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3597/7163] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:36:46 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 21:36:46.734437 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdcea85-7864-4369-96e1-ccab1ec8fb1e admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:46.753081 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdcea85-7864-4369-96e1-ccab1ec8fb1e admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:46.763097 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfb86e7-4eca-4554-8c15-4d0072debe67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:46.764161 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfb86e7-4eca-4554-8c15-4d0072debe67 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:46.765035 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfb86e7-4eca-4554-8c15-4d0072debe67 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:46.765179 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfb86e7-4eca-4554-8c15-4d0072debe67 admin admin] PATH_INFO: `/v3/projects/32661f6d06e04d3d8201ac893423d29a/users/a39a9e026a2b4f2ba3e7547f07ee8a40/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:46.788067 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfb86e7-4eca-4554-8c15-4d0072debe67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32661f6d06e04d3d8201ac893423d29a, user_id=a39a9e026a2b4f2ba3e7547f07ee8a40, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:46.793379 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfb86e7-4eca-4554-8c15-4d0072debe67 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:46.833390 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3567/7164] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:36:46 2022] PUT /identity/v3/projects/32661f6d06e04d3d8201ac893423d29a/users/a39a9e026a2b4f2ba3e7547f07ee8a40/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:36:46.845498 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4691c6-c984-446b-b4f2-32e1140d2704 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:46.846222 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4691c6-c984-446b-b4f2-32e1140d2704 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:46.846951 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4691c6-c984-446b-b4f2-32e1140d2704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:46.892594 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-8e4691c6-c984-446b-b4f2-32e1140d2704 None None] MFA Rules not processed for user `a39a9e026a2b4f2ba3e7547f07ee8a40`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:36:46.894604 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-8e4691c6-c984-446b-b4f2-32e1140d2704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:36:46.950099 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:36:46.981350 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3598/7165] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:36:46 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:36:47.008861 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfb86e7-4eca-4554-8c15-4d0072debe67 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:47.011371 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-6cfb86e7-4eca-4554-8c15-4d0072debe67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:36:47.092582 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfb86e7-4eca-4554-8c15-4d0072debe67 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:47.097390 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8df5a1-bb9b-4d99-9496-a08c2aaa36fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec5fd3a489c341b7964704d689037f05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:47.098146 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8df5a1-bb9b-4d99-9496-a08c2aaa36fb service cinder] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:47.098447 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8df5a1-bb9b-4d99-9496-a08c2aaa36fb service cinder] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:47.098714 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8df5a1-bb9b-4d99-9496-a08c2aaa36fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:47.108912 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8df5a1-bb9b-4d99-9496-a08c2aaa36fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:47.111498 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8df5a1-bb9b-4d99-9496-a08c2aaa36fb service cinder] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:47.124301 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3568/7166] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:36:47 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:36:47.137580 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4691c6-c984-446b-b4f2-32e1140d2704 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:47.209206 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4691c6-c984-446b-b4f2-32e1140d2704 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:47.216222 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771c497b-a5d2-44ae-a1f2-4dea335b901f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:47.217276 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771c497b-a5d2-44ae-a1f2-4dea335b901f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:47.217656 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771c497b-a5d2-44ae-a1f2-4dea335b901f admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:47.218061 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771c497b-a5d2-44ae-a1f2-4dea335b901f admin admin] PATH_INFO: `/v3/users/a39a9e026a2b4f2ba3e7547f07ee8a40` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:47.220274 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771c497b-a5d2-44ae-a1f2-4dea335b901f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a39a9e026a2b4f2ba3e7547f07ee8a40)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:47.222275 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771c497b-a5d2-44ae-a1f2-4dea335b901f admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:47.284446 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-771c497b-a5d2-44ae-a1f2-4dea335b901f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a39a9e026a2b4f2ba3e7547f07ee8a40'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:47.285240 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-771c497b-a5d2-44ae-a1f2-4dea335b901f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a39a9e026a2b4f2ba3e7547f07ee8a40'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:47.294603 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-771c497b-a5d2-44ae-a1f2-4dea335b901f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a39a9e026a2b4f2ba3e7547f07ee8a40'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:47.304897 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-771c497b-a5d2-44ae-a1f2-4dea335b901f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a39a9e026a2b4f2ba3e7547f07ee8a40'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:47.322250 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-771c497b-a5d2-44ae-a1f2-4dea335b901f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a39a9e026a2b4f2ba3e7547f07ee8a40'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:47.334618 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3599/7167] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:36:47 2022] DELETE /identity/v3/users/a39a9e026a2b4f2ba3e7547f07ee8a40 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:36:47.339078 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f590891-0ba6-4c33-8f9e-54a50901f847 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:47.339637 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f590891-0ba6-4c33-8f9e-54a50901f847 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:47.340840 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f590891-0ba6-4c33-8f9e-54a50901f847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:47.380997 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-1f590891-0ba6-4c33-8f9e-54a50901f847 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:36:47.382695 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-1f590891-0ba6-4c33-8f9e-54a50901f847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:36:47.391995 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:36:47.472973 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3569/7168] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:36:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:36:47.488009 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771c497b-a5d2-44ae-a1f2-4dea335b901f admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:47.489950 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-771c497b-a5d2-44ae-a1f2-4dea335b901f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:36:47.580040 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771c497b-a5d2-44ae-a1f2-4dea335b901f admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:47.595704 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f3b8fb-10b9-4833-9dc2-b8b8e9451b3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:47.595704 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f3b8fb-10b9-4833-9dc2-b8b8e9451b3d service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:47.595704 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f3b8fb-10b9-4833-9dc2-b8b8e9451b3d service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:47.595704 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f3b8fb-10b9-4833-9dc2-b8b8e9451b3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:47.624983 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f3b8fb-10b9-4833-9dc2-b8b8e9451b3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:47.629717 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f3b8fb-10b9-4833-9dc2-b8b8e9451b3d service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:47.664955 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3600/7169] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:36:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:36:48.106988 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f590891-0ba6-4c33-8f9e-54a50901f847 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:48.108790 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-1f590891-0ba6-4c33-8f9e-54a50901f847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:36:48.126913 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f590891-0ba6-4c33-8f9e-54a50901f847 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:48.141759 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce54e72c-631d-44cf-bafe-cd8f618f0dc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:48.142856 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce54e72c-631d-44cf-bafe-cd8f618f0dc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:48.143135 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce54e72c-631d-44cf-bafe-cd8f618f0dc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:48.143401 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce54e72c-631d-44cf-bafe-cd8f618f0dc8 admin admin] PATH_INFO: `/v3/projects/32661f6d06e04d3d8201ac893423d29a` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:48.144694 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce54e72c-631d-44cf-bafe-cd8f618f0dc8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32661f6d06e04d3d8201ac893423d29a)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:48.146677 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce54e72c-631d-44cf-bafe-cd8f618f0dc8 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:48.222315 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-ce54e72c-631d-44cf-bafe-cd8f618f0dc8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32661f6d06e04d3d8201ac893423d29a', 'request_id': 'req-ce54e72c-631d-44cf-bafe-cd8f618f0dc8'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:48.255273 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-ce54e72c-631d-44cf-bafe-cd8f618f0dc8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32661f6d06e04d3d8201ac893423d29a', 'request_id': 'req-ce54e72c-631d-44cf-bafe-cd8f618f0dc8'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:48.262860 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-ce54e72c-631d-44cf-bafe-cd8f618f0dc8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32661f6d06e04d3d8201ac893423d29a', 'request_id': 'req-ce54e72c-631d-44cf-bafe-cd8f618f0dc8'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:48.275265 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-ce54e72c-631d-44cf-bafe-cd8f618f0dc8 admin admin] The token cache is being invalidate because project 32661f6d06e04d3d8201ac893423d29a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:36:48.275552 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-ce54e72c-631d-44cf-bafe-cd8f618f0dc8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:48.276404 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-ce54e72c-631d-44cf-bafe-cd8f618f0dc8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:48.277998 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3570/7170] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:36:48 2022] DELETE /identity/v3/projects/32661f6d06e04d3d8201ac893423d29a => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:36:48.284175 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4c8dba-a7da-44f2-9b79-90f548f35223 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:48.285739 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4c8dba-a7da-44f2-9b79-90f548f35223 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:48.286971 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4c8dba-a7da-44f2-9b79-90f548f35223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:48.313025 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-da4c8dba-a7da-44f2-9b79-90f548f35223 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:36:48.314342 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-da4c8dba-a7da-44f2-9b79-90f548f35223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:36:48.330773 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:36:48.411782 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3601/7171] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:36:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:36:48.420864 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd65ce6-ce8a-4c2f-b027-27cf38c0acfd None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:48.421152 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd65ce6-ce8a-4c2f-b027-27cf38c0acfd None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:48.421508 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd65ce6-ce8a-4c2f-b027-27cf38c0acfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:48.450924 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-6fd65ce6-ce8a-4c2f-b027-27cf38c0acfd None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:36:48.458779 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-6fd65ce6-ce8a-4c2f-b027-27cf38c0acfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:36:48.472247 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3571/7172] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:36:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:36:48.476181 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4c8dba-a7da-44f2-9b79-90f548f35223 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:48.531030 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4c8dba-a7da-44f2-9b79-90f548f35223 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:48.543699 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed34304-6e91-4b70-ab8e-6dec63b02bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:48.544454 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed34304-6e91-4b70-ab8e-6dec63b02bb6 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:48.544929 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed34304-6e91-4b70-ab8e-6dec63b02bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:48.545255 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed34304-6e91-4b70-ab8e-6dec63b02bb6 admin admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:48.546106 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed34304-6e91-4b70-ab8e-6dec63b02bb6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:36:48.546528 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed34304-6e91-4b70-ab8e-6dec63b02bb6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:48.548235 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed34304-6e91-4b70-ab8e-6dec63b02bb6 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:48.567118 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3602/7173] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:36:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:36:48.571254 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd65ce6-ce8a-4c2f-b027-27cf38c0acfd None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:48.584601 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd65ce6-ce8a-4c2f-b027-27cf38c0acfd None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:48.592017 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e8f267-6f23-4706-ab80-317f3adde213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:48.592706 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e8f267-6f23-4706-ab80-317f3adde213 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:48.593006 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e8f267-6f23-4706-ab80-317f3adde213 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:48.593331 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e8f267-6f23-4706-ab80-317f3adde213 admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:48.594864 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e8f267-6f23-4706-ab80-317f3adde213 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:48.596893 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e8f267-6f23-4706-ab80-317f3adde213 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:48.667469 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3572/7174] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:36:48 2022] POST /identity/v3/projects => generated 369 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:36:48.672473 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed34304-6e91-4b70-ab8e-6dec63b02bb6 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:48.687682 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed34304-6e91-4b70-ab8e-6dec63b02bb6 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:48.771385 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defa6bfe-d095-44e5-81fe-a6094a10185e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:48.772511 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defa6bfe-d095-44e5-81fe-a6094a10185e admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:48.772895 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defa6bfe-d095-44e5-81fe-a6094a10185e admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:48.773266 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defa6bfe-d095-44e5-81fe-a6094a10185e admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:48.774939 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defa6bfe-d095-44e5-81fe-a6094a10185e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:48.777079 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defa6bfe-d095-44e5-81fe-a6094a10185e admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:48.806680 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3603/7175] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:36:48 2022] POST /identity/v3/users => generated 285 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:36:48.811137 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e8f267-6f23-4706-ab80-317f3adde213 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:48.841551 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e8f267-6f23-4706-ab80-317f3adde213 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:48.865271 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29539afe-f0f3-4b81-a95f-bd737a1e0ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:48.866480 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29539afe-f0f3-4b81-a95f-bd737a1e0ecf admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:48.867216 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29539afe-f0f3-4b81-a95f-bd737a1e0ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:48.867802 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29539afe-f0f3-4b81-a95f-bd737a1e0ecf admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:48.868725 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29539afe-f0f3-4b81-a95f-bd737a1e0ecf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:48.873915 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29539afe-f0f3-4b81-a95f-bd737a1e0ecf admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:48.904146 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defa6bfe-d095-44e5-81fe-a6094a10185e admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:48.904564 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3573/7176] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:36:48 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:36:48.928614 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defa6bfe-d095-44e5-81fe-a6094a10185e admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:48.935346 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc4a2f0-5147-4c6c-b970-caf94c0ac9e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:48.936147 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc4a2f0-5147-4c6c-b970-caf94c0ac9e1 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:48.936548 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc4a2f0-5147-4c6c-b970-caf94c0ac9e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:48.937729 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc4a2f0-5147-4c6c-b970-caf94c0ac9e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:48.938172 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc4a2f0-5147-4c6c-b970-caf94c0ac9e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:48.939943 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc4a2f0-5147-4c6c-b970-caf94c0ac9e1 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:48.956729 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3604/7177] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:36:48 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 21:36:48.960070 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29539afe-f0f3-4b81-a95f-bd737a1e0ecf admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:48.976011 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29539afe-f0f3-4b81-a95f-bd737a1e0ecf admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:48.992059 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6034d2b0-056a-4ea3-9d13-a0e88fdd9db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:48.993922 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6034d2b0-056a-4ea3-9d13-a0e88fdd9db3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:48.994448 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6034d2b0-056a-4ea3-9d13-a0e88fdd9db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:48.995617 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6034d2b0-056a-4ea3-9d13-a0e88fdd9db3 admin admin] PATH_INFO: `/v3/projects/e15b4d214a734cada5f9750280d04670/users/d76aaa41e36c43008be9b7b0e8a7a7b7/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:49.038748 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6034d2b0-056a-4ea3-9d13-a0e88fdd9db3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e15b4d214a734cada5f9750280d04670, user_id=d76aaa41e36c43008be9b7b0e8a7a7b7, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:49.042646 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6034d2b0-056a-4ea3-9d13-a0e88fdd9db3 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:49.077135 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3574/7178] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:36:48 2022] PUT /identity/v3/projects/e15b4d214a734cada5f9750280d04670/users/d76aaa41e36c43008be9b7b0e8a7a7b7/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:36:49.095283 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd0ab07-17d8-4b61-a06d-0fb20c434eef None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:49.095878 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd0ab07-17d8-4b61-a06d-0fb20c434eef None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:49.096263 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd0ab07-17d8-4b61-a06d-0fb20c434eef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:49.162463 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-9cd0ab07-17d8-4b61-a06d-0fb20c434eef None None] MFA Rules not processed for user `d76aaa41e36c43008be9b7b0e8a7a7b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:36:49.164001 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-9cd0ab07-17d8-4b61-a06d-0fb20c434eef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:36:49.329158 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3605/7179] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:36:49 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:36:49.343349 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6034d2b0-056a-4ea3-9d13-a0e88fdd9db3 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:49.346565 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-6034d2b0-056a-4ea3-9d13-a0e88fdd9db3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:36:49.427622 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:36:49.546704 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6034d2b0-056a-4ea3-9d13-a0e88fdd9db3 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:49.557020 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9179a0ab-2fef-4b1e-8b34-2ffa4b1b5de7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7f2db148c8e4d5d81431cae3576434b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:49.558085 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9179a0ab-2fef-4b1e-8b34-2ffa4b1b5de7 service glance] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:49.558477 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9179a0ab-2fef-4b1e-8b34-2ffa4b1b5de7 service glance] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:49.559625 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9179a0ab-2fef-4b1e-8b34-2ffa4b1b5de7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:49.578753 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9179a0ab-2fef-4b1e-8b34-2ffa4b1b5de7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:49.581446 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9179a0ab-2fef-4b1e-8b34-2ffa4b1b5de7 service glance] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:49.606322 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3575/7180] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:36:49 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:36:50.943287 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd0ab07-17d8-4b61-a06d-0fb20c434eef None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:50.945616 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-9cd0ab07-17d8-4b61-a06d-0fb20c434eef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:36:50.957941 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:36:51.079496 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd0ab07-17d8-4b61-a06d-0fb20c434eef None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:51.087525 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1078d4d1-79ae-47ea-a38b-83e17ebc0077 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc719a3b3ac4461b82ca04ab6451d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:51.088615 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1078d4d1-79ae-47ea-a38b-83e17ebc0077 service placement] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:51.089104 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1078d4d1-79ae-47ea-a38b-83e17ebc0077 service placement] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:51.089543 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1078d4d1-79ae-47ea-a38b-83e17ebc0077 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:51.092936 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-1078d4d1-79ae-47ea-a38b-83e17ebc0077 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:36:51.123096 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1078d4d1-79ae-47ea-a38b-83e17ebc0077 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:51.125310 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1078d4d1-79ae-47ea-a38b-83e17ebc0077 service placement] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:51.153687 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3606/7181] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:36:50 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:36:52.956003 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9179a0ab-2fef-4b1e-8b34-2ffa4b1b5de7 service glance] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:52.958417 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-9179a0ab-2fef-4b1e-8b34-2ffa4b1b5de7 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:36:53.069217 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9179a0ab-2fef-4b1e-8b34-2ffa4b1b5de7 service glance] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:53.097489 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2149ca-d304-4a9c-abc9-3c4b22be78ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:53.098633 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2149ca-d304-4a9c-abc9-3c4b22be78ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:53.099186 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2149ca-d304-4a9c-abc9-3c4b22be78ba admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:53.099960 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2149ca-d304-4a9c-abc9-3c4b22be78ba admin admin] PATH_INFO: `/v3/users/4480be04a53c434687b1e3146699e17e` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:53.101610 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2149ca-d304-4a9c-abc9-3c4b22be78ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=4480be04a53c434687b1e3146699e17e)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:53.105455 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2149ca-d304-4a9c-abc9-3c4b22be78ba admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:53.197714 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-8a2149ca-d304-4a9c-abc9-3c4b22be78ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4480be04a53c434687b1e3146699e17e'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:53.208230 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-8a2149ca-d304-4a9c-abc9-3c4b22be78ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4480be04a53c434687b1e3146699e17e'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:53.209268 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-8a2149ca-d304-4a9c-abc9-3c4b22be78ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4480be04a53c434687b1e3146699e17e'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:53.223399 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-8a2149ca-d304-4a9c-abc9-3c4b22be78ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4480be04a53c434687b1e3146699e17e'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:53.247618 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-8a2149ca-d304-4a9c-abc9-3c4b22be78ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4480be04a53c434687b1e3146699e17e'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:53.259657 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3576/7182] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:36:52 2022] DELETE /identity/v3/users/4480be04a53c434687b1e3146699e17e => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:36:53.261166 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8139b6f5-1532-48c6-b78e-3dd5d5954d39 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:53.261690 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8139b6f5-1532-48c6-b78e-3dd5d5954d39 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:53.261956 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8139b6f5-1532-48c6-b78e-3dd5d5954d39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:53.284130 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2149ca-d304-4a9c-abc9-3c4b22be78ba admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:53.288730 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-8a2149ca-d304-4a9c-abc9-3c4b22be78ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:36:53.293372 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-8139b6f5-1532-48c6-b78e-3dd5d5954d39 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:36:53.295477 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-8139b6f5-1532-48c6-b78e-3dd5d5954d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:36:53.386608 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:36:53.416989 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2149ca-d304-4a9c-abc9-3c4b22be78ba admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:53.425432 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34485d9c-afd7-48a3-9a07-0a42d9c9665b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:53.427209 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34485d9c-afd7-48a3-9a07-0a42d9c9665b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:53.427725 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34485d9c-afd7-48a3-9a07-0a42d9c9665b admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:53.428361 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34485d9c-afd7-48a3-9a07-0a42d9c9665b admin admin] PATH_INFO: `/v3/users/d76aaa41e36c43008be9b7b0e8a7a7b7` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:53.430661 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34485d9c-afd7-48a3-9a07-0a42d9c9665b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d76aaa41e36c43008be9b7b0e8a7a7b7)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:53.433351 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34485d9c-afd7-48a3-9a07-0a42d9c9665b admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:53.444882 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3607/7183] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:36:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:36:53.469908 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8139b6f5-1532-48c6-b78e-3dd5d5954d39 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:53.471480 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-8139b6f5-1532-48c6-b78e-3dd5d5954d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:36:53.570536 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-34485d9c-afd7-48a3-9a07-0a42d9c9665b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd76aaa41e36c43008be9b7b0e8a7a7b7'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:53.584551 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-34485d9c-afd7-48a3-9a07-0a42d9c9665b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd76aaa41e36c43008be9b7b0e8a7a7b7'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:53.585756 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-34485d9c-afd7-48a3-9a07-0a42d9c9665b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd76aaa41e36c43008be9b7b0e8a7a7b7'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:53.600090 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8139b6f5-1532-48c6-b78e-3dd5d5954d39 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:53.602366 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-34485d9c-afd7-48a3-9a07-0a42d9c9665b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd76aaa41e36c43008be9b7b0e8a7a7b7'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:53.604241 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752a061c-f21e-45bc-8729-ed1b3d505ffb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:53.605003 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752a061c-f21e-45bc-8729-ed1b3d505ffb service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:53.605381 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752a061c-f21e-45bc-8729-ed1b3d505ffb service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:53.605849 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752a061c-f21e-45bc-8729-ed1b3d505ffb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:53.618498 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752a061c-f21e-45bc-8729-ed1b3d505ffb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:53.620386 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752a061c-f21e-45bc-8729-ed1b3d505ffb service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:53.633663 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3608/7184] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:36:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 23 21:36:53.635154 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-34485d9c-afd7-48a3-9a07-0a42d9c9665b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd76aaa41e36c43008be9b7b0e8a7a7b7'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:53.649132 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3577/7185] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:36:53 2022] DELETE /identity/v3/users/d76aaa41e36c43008be9b7b0e8a7a7b7 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:36:53.651126 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf301ac4-2ed7-47ed-8ffa-9ff164f117f4 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:53.651622 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf301ac4-2ed7-47ed-8ffa-9ff164f117f4 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:53.652072 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf301ac4-2ed7-47ed-8ffa-9ff164f117f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:53.676125 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-bf301ac4-2ed7-47ed-8ffa-9ff164f117f4 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:36:53.677426 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-bf301ac4-2ed7-47ed-8ffa-9ff164f117f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:36:53.734345 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:36:53.792043 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3609/7186] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:36:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:36:53.832109 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34485d9c-afd7-48a3-9a07-0a42d9c9665b admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:53.833722 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-34485d9c-afd7-48a3-9a07-0a42d9c9665b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:36:53.939195 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34485d9c-afd7-48a3-9a07-0a42d9c9665b admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:53.950461 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959e5363-c59e-4ef2-a0b6-185ab7a8a9c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:53.952643 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959e5363-c59e-4ef2-a0b6-185ab7a8a9c9 service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:53.952643 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959e5363-c59e-4ef2-a0b6-185ab7a8a9c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:53.952643 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959e5363-c59e-4ef2-a0b6-185ab7a8a9c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:53.984745 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959e5363-c59e-4ef2-a0b6-185ab7a8a9c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:53.986419 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959e5363-c59e-4ef2-a0b6-185ab7a8a9c9 service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:53.998393 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3578/7187] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:36:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:36:54.543655 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf301ac4-2ed7-47ed-8ffa-9ff164f117f4 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:54.545623 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-bf301ac4-2ed7-47ed-8ffa-9ff164f117f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:36:54.559116 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf301ac4-2ed7-47ed-8ffa-9ff164f117f4 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:54.564527 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d79965-4129-471d-9c2d-0cc1c33e1492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:54.565962 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d79965-4129-471d-9c2d-0cc1c33e1492 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:54.566426 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d79965-4129-471d-9c2d-0cc1c33e1492 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:54.566881 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d79965-4129-471d-9c2d-0cc1c33e1492 admin admin] PATH_INFO: `/v3/projects/083c0f336ca1445ab8ceedb6579eb953` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:54.570445 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d79965-4129-471d-9c2d-0cc1c33e1492 admin admin] RBAC: Authorizing `identity:delete_project(project_id=083c0f336ca1445ab8ceedb6579eb953)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:54.572679 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d79965-4129-471d-9c2d-0cc1c33e1492 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:54.636181 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c9d79965-4129-471d-9c2d-0cc1c33e1492 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '083c0f336ca1445ab8ceedb6579eb953', 'request_id': 'req-c9d79965-4129-471d-9c2d-0cc1c33e1492'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:54.650639 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c9d79965-4129-471d-9c2d-0cc1c33e1492 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '083c0f336ca1445ab8ceedb6579eb953', 'request_id': 'req-c9d79965-4129-471d-9c2d-0cc1c33e1492'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:54.661962 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c9d79965-4129-471d-9c2d-0cc1c33e1492 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '083c0f336ca1445ab8ceedb6579eb953', 'request_id': 'req-c9d79965-4129-471d-9c2d-0cc1c33e1492'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:54.683095 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c9d79965-4129-471d-9c2d-0cc1c33e1492 admin admin] The token cache is being invalidate because project 083c0f336ca1445ab8ceedb6579eb953 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:36:54.683499 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c9d79965-4129-471d-9c2d-0cc1c33e1492 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:54.687654 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c9d79965-4129-471d-9c2d-0cc1c33e1492 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:54.693800 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3610/7188] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:36:54 2022] DELETE /identity/v3/projects/083c0f336ca1445ab8ceedb6579eb953 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:36:54.695200 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959e5363-c59e-4ef2-a0b6-185ab7a8a9c9 service neutron] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:54.706309 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959e5363-c59e-4ef2-a0b6-185ab7a8a9c9 service neutron] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:54.775469 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11826081-8cd9-4e59-95db-88963390e84f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:54.776411 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11826081-8cd9-4e59-95db-88963390e84f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:54.776682 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11826081-8cd9-4e59-95db-88963390e84f admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:54.776949 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11826081-8cd9-4e59-95db-88963390e84f admin admin] PATH_INFO: `/v3/users/6686522fbacf48a3aed3073bc8e1ac63` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:54.779389 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11826081-8cd9-4e59-95db-88963390e84f admin admin] RBAC: Authorizing `identity:delete_user(user_id=6686522fbacf48a3aed3073bc8e1ac63)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:54.781438 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11826081-8cd9-4e59-95db-88963390e84f admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:54.788422 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:36:54.859028 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d79965-4129-471d-9c2d-0cc1c33e1492 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:54.861433 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-c9d79965-4129-471d-9c2d-0cc1c33e1492 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:36:54.882082 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d79965-4129-471d-9c2d-0cc1c33e1492 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:54.890222 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd0ef91-a889-4287-be84-29bc4999bce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:54.891516 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd0ef91-a889-4287-be84-29bc4999bce4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:54.892358 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd0ef91-a889-4287-be84-29bc4999bce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:54.892838 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd0ef91-a889-4287-be84-29bc4999bce4 admin admin] PATH_INFO: `/v3/projects/e15b4d214a734cada5f9750280d04670` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:54.895361 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd0ef91-a889-4287-be84-29bc4999bce4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e15b4d214a734cada5f9750280d04670)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:54.896710 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-11826081-8cd9-4e59-95db-88963390e84f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6686522fbacf48a3aed3073bc8e1ac63'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:54.899183 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd0ef91-a889-4287-be84-29bc4999bce4 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:54.924253 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-11826081-8cd9-4e59-95db-88963390e84f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6686522fbacf48a3aed3073bc8e1ac63'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:54.926236 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-11826081-8cd9-4e59-95db-88963390e84f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6686522fbacf48a3aed3073bc8e1ac63'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:54.950722 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-11826081-8cd9-4e59-95db-88963390e84f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6686522fbacf48a3aed3073bc8e1ac63'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:54.979319 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-11826081-8cd9-4e59-95db-88963390e84f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6686522fbacf48a3aed3073bc8e1ac63'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:55.016638 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-1dd0ef91-a889-4287-be84-29bc4999bce4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e15b4d214a734cada5f9750280d04670', 'request_id': 'req-1dd0ef91-a889-4287-be84-29bc4999bce4'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:55.017343 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3579/7189] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:36:54 2022] DELETE /identity/v3/users/6686522fbacf48a3aed3073bc8e1ac63 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:36:55.039010 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-1dd0ef91-a889-4287-be84-29bc4999bce4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e15b4d214a734cada5f9750280d04670', 'request_id': 'req-1dd0ef91-a889-4287-be84-29bc4999bce4'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:55.045362 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-1dd0ef91-a889-4287-be84-29bc4999bce4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e15b4d214a734cada5f9750280d04670', 'request_id': 'req-1dd0ef91-a889-4287-be84-29bc4999bce4'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:55.070395 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-1dd0ef91-a889-4287-be84-29bc4999bce4 admin admin] The token cache is being invalidate because project e15b4d214a734cada5f9750280d04670 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:36:55.070697 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-1dd0ef91-a889-4287-be84-29bc4999bce4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:55.071385 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-1dd0ef91-a889-4287-be84-29bc4999bce4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:55.087695 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3611/7190] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:36:54 2022] DELETE /identity/v3/projects/e15b4d214a734cada5f9750280d04670 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:36:55.465912 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11826081-8cd9-4e59-95db-88963390e84f admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:55.467857 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-11826081-8cd9-4e59-95db-88963390e84f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:36:55.576865 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11826081-8cd9-4e59-95db-88963390e84f admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:55.587485 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5baa63-2eaf-44e5-9d16-c66ab089fa2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:55.591638 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5baa63-2eaf-44e5-9d16-c66ab089fa2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:55.592531 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5baa63-2eaf-44e5-9d16-c66ab089fa2c admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:55.607932 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5baa63-2eaf-44e5-9d16-c66ab089fa2c admin admin] PATH_INFO: `/v3/projects/bb46af2c5c9c4ac990634b88c0d9f732` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:55.612745 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5baa63-2eaf-44e5-9d16-c66ab089fa2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb46af2c5c9c4ac990634b88c0d9f732)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:55.621218 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5baa63-2eaf-44e5-9d16-c66ab089fa2c admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:55.735682 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-ae5baa63-2eaf-44e5-9d16-c66ab089fa2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb46af2c5c9c4ac990634b88c0d9f732', 'request_id': 'req-ae5baa63-2eaf-44e5-9d16-c66ab089fa2c'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:55.754329 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-ae5baa63-2eaf-44e5-9d16-c66ab089fa2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb46af2c5c9c4ac990634b88c0d9f732', 'request_id': 'req-ae5baa63-2eaf-44e5-9d16-c66ab089fa2c'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:55.764972 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-ae5baa63-2eaf-44e5-9d16-c66ab089fa2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb46af2c5c9c4ac990634b88c0d9f732', 'request_id': 'req-ae5baa63-2eaf-44e5-9d16-c66ab089fa2c'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:55.784590 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-ae5baa63-2eaf-44e5-9d16-c66ab089fa2c admin admin] The token cache is being invalidate because project bb46af2c5c9c4ac990634b88c0d9f732 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:36:55.784904 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-ae5baa63-2eaf-44e5-9d16-c66ab089fa2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:55.785966 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-ae5baa63-2eaf-44e5-9d16-c66ab089fa2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:36:55.789979 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3580/7191] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:36:55 2022] DELETE /identity/v3/projects/bb46af2c5c9c4ac990634b88c0d9f732 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:36:55.793546 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178c780d-0b75-4a8d-bb76-e45ccf669cea None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:55.794130 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178c780d-0b75-4a8d-bb76-e45ccf669cea None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:55.794360 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178c780d-0b75-4a8d-bb76-e45ccf669cea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:55.827689 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-178c780d-0b75-4a8d-bb76-e45ccf669cea None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:36:55.829752 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-178c780d-0b75-4a8d-bb76-e45ccf669cea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:36:55.937544 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:36:55.972290 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3612/7192] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:36:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:36:55.981362 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d82904e-7366-4e80-895e-a3cfb2c0c2f2 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:55.981707 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d82904e-7366-4e80-895e-a3cfb2c0c2f2 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:55.982075 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d82904e-7366-4e80-895e-a3cfb2c0c2f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:56.016639 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-1d82904e-7366-4e80-895e-a3cfb2c0c2f2 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:36:56.018415 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-1d82904e-7366-4e80-895e-a3cfb2c0c2f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:36:56.033577 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3581/7193] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:36:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:36:56.038579 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178c780d-0b75-4a8d-bb76-e45ccf669cea None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:56.051708 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178c780d-0b75-4a8d-bb76-e45ccf669cea None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:56.060131 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e796ea8-2cb5-44ea-968c-971280122e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:56.061154 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e796ea8-2cb5-44ea-968c-971280122e8a admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:56.061437 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e796ea8-2cb5-44ea-968c-971280122e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:56.061952 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e796ea8-2cb5-44ea-968c-971280122e8a admin admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:56.063489 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e796ea8-2cb5-44ea-968c-971280122e8a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:36:56.063790 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e796ea8-2cb5-44ea-968c-971280122e8a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:56.065503 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e796ea8-2cb5-44ea-968c-971280122e8a admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:56.088555 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3613/7194] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:36:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 21:36:56.090363 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d82904e-7366-4e80-895e-a3cfb2c0c2f2 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:56.101556 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d82904e-7366-4e80-895e-a3cfb2c0c2f2 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:56.107116 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca17437a-15f8-49cb-8949-f0ebc4bd85e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:56.108110 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca17437a-15f8-49cb-8949-f0ebc4bd85e5 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:56.108566 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca17437a-15f8-49cb-8949-f0ebc4bd85e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:56.109108 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca17437a-15f8-49cb-8949-f0ebc4bd85e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:56.110038 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca17437a-15f8-49cb-8949-f0ebc4bd85e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:56.112364 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca17437a-15f8-49cb-8949-f0ebc4bd85e5 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:56.117562 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:36:56.161353 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3582/7195] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:36:56 2022] POST /identity/v3/projects => generated 363 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:36:56.162621 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e796ea8-2cb5-44ea-968c-971280122e8a admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:56.174060 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e796ea8-2cb5-44ea-968c-971280122e8a admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:56.251333 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21c11fb-8cab-43e0-a124-15cb39093950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:56.252391 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21c11fb-8cab-43e0-a124-15cb39093950 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:56.252853 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21c11fb-8cab-43e0-a124-15cb39093950 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:56.253405 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21c11fb-8cab-43e0-a124-15cb39093950 admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:56.257967 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21c11fb-8cab-43e0-a124-15cb39093950 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:56.260738 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21c11fb-8cab-43e0-a124-15cb39093950 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:56.308881 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3614/7196] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:36:56 2022] POST /identity/v3/users => generated 282 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:36:56.312028 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca17437a-15f8-49cb-8949-f0ebc4bd85e5 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:56.326610 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca17437a-15f8-49cb-8949-f0ebc4bd85e5 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:56.333655 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e3708f-d3c9-41db-bcd7-1c570b0062d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:56.334597 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e3708f-d3c9-41db-bcd7-1c570b0062d7 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:56.335480 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e3708f-d3c9-41db-bcd7-1c570b0062d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:56.335858 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e3708f-d3c9-41db-bcd7-1c570b0062d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:56.336847 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e3708f-d3c9-41db-bcd7-1c570b0062d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:56.338756 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e3708f-d3c9-41db-bcd7-1c570b0062d7 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:56.365840 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3583/7197] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:36:56 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:36:56.367536 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21c11fb-8cab-43e0-a124-15cb39093950 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:56.386843 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21c11fb-8cab-43e0-a124-15cb39093950 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:56.395588 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71699977-765f-4d3e-824f-fbdfec4c9c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:56.396300 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71699977-765f-4d3e-824f-fbdfec4c9c4c admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:56.396583 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71699977-765f-4d3e-824f-fbdfec4c9c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:56.396952 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71699977-765f-4d3e-824f-fbdfec4c9c4c admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:56.397693 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71699977-765f-4d3e-824f-fbdfec4c9c4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:56.399390 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71699977-765f-4d3e-824f-fbdfec4c9c4c admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:56.417937 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3615/7198] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:36:56 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:36:56.422385 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e3708f-d3c9-41db-bcd7-1c570b0062d7 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:56.439166 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e3708f-d3c9-41db-bcd7-1c570b0062d7 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:56.452027 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9546a659-e108-4feb-93dc-5859cb471dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:56.453418 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9546a659-e108-4feb-93dc-5859cb471dd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:56.453838 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9546a659-e108-4feb-93dc-5859cb471dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:56.454344 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9546a659-e108-4feb-93dc-5859cb471dd4 admin admin] PATH_INFO: `/v3/projects/05a0239551b94c9bacfe7de0952ab613/users/68226e68e503445e899fab97a0692aeb/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:56.474785 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9546a659-e108-4feb-93dc-5859cb471dd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05a0239551b94c9bacfe7de0952ab613, user_id=68226e68e503445e899fab97a0692aeb, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:56.488596 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9546a659-e108-4feb-93dc-5859cb471dd4 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:56.524175 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3584/7199] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:36:56 2022] PUT /identity/v3/projects/05a0239551b94c9bacfe7de0952ab613/users/68226e68e503445e899fab97a0692aeb/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:36:56.534703 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac95a46-893e-4949-ae55-b8834cce2156 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:56.534950 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac95a46-893e-4949-ae55-b8834cce2156 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:56.535204 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac95a46-893e-4949-ae55-b8834cce2156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:56.613382 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-6ac95a46-893e-4949-ae55-b8834cce2156 None None] MFA Rules not processed for user `68226e68e503445e899fab97a0692aeb`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:36:56.614675 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-6ac95a46-893e-4949-ae55-b8834cce2156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:36:56.737696 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3616/7200] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:36:56 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:36:56.739736 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9546a659-e108-4feb-93dc-5859cb471dd4 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:56.857183 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9546a659-e108-4feb-93dc-5859cb471dd4 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:56.863468 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac5980e-e9a4-459e-b600-fc1a86eba073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:56.864418 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac5980e-e9a4-459e-b600-fc1a86eba073 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:56.865307 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac5980e-e9a4-459e-b600-fc1a86eba073 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:56.865755 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac5980e-e9a4-459e-b600-fc1a86eba073 admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:56.867116 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac5980e-e9a4-459e-b600-fc1a86eba073 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:56.869332 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac5980e-e9a4-459e-b600-fc1a86eba073 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:56.919345 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3585/7201] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:36:56 2022] POST /identity/v3/projects => generated 365 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:36:56.923570 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac95a46-893e-4949-ae55-b8834cce2156 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:56.945844 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac95a46-893e-4949-ae55-b8834cce2156 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:57.003256 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:36:57.024828 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e4f136-3002-4661-ab74-720900eb7c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:57.026485 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e4f136-3002-4661-ab74-720900eb7c31 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:57.028450 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e4f136-3002-4661-ab74-720900eb7c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:57.028832 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e4f136-3002-4661-ab74-720900eb7c31 admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:57.029654 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e4f136-3002-4661-ab74-720900eb7c31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:57.038094 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e4f136-3002-4661-ab74-720900eb7c31 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:57.069768 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3617/7202] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:36:56 2022] POST /identity/v3/users => generated 289 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:36:57.074052 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac5980e-e9a4-459e-b600-fc1a86eba073 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:57.085380 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac5980e-e9a4-459e-b600-fc1a86eba073 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:57.099064 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4fbd1a-0583-4ec3-8c71-09efe542c5a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:57.099860 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4fbd1a-0583-4ec3-8c71-09efe542c5a6 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:57.099860 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4fbd1a-0583-4ec3-8c71-09efe542c5a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:57.100215 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4fbd1a-0583-4ec3-8c71-09efe542c5a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:57.100850 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4fbd1a-0583-4ec3-8c71-09efe542c5a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:57.102662 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4fbd1a-0583-4ec3-8c71-09efe542c5a6 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:57.115422 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3586/7203] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:36:57 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 21:36:57.119818 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e4f136-3002-4661-ab74-720900eb7c31 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:57.135388 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e4f136-3002-4661-ab74-720900eb7c31 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:57.147445 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc28bd6-ca62-453d-8bca-0c6ae71032a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:57.148512 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc28bd6-ca62-453d-8bca-0c6ae71032a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:57.148654 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc28bd6-ca62-453d-8bca-0c6ae71032a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:57.148910 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc28bd6-ca62-453d-8bca-0c6ae71032a4 admin admin] PATH_INFO: `/v3/projects/22a86ab6c8e14fb592f04a81c48f616f/users/4ad7505fb67149a2a8f1dcf63d82864b/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:57.183375 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc28bd6-ca62-453d-8bca-0c6ae71032a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22a86ab6c8e14fb592f04a81c48f616f, user_id=4ad7505fb67149a2a8f1dcf63d82864b, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:57.186119 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc28bd6-ca62-453d-8bca-0c6ae71032a4 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:57.209291 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3618/7204] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:36:57 2022] PUT /identity/v3/projects/22a86ab6c8e14fb592f04a81c48f616f/users/4ad7505fb67149a2a8f1dcf63d82864b/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:36:57.213252 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4fbd1a-0583-4ec3-8c71-09efe542c5a6 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:57.226312 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4fbd1a-0583-4ec3-8c71-09efe542c5a6 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:57.322324 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4960cea7-8b62-4aec-9a81-969e1d63fa8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:57.323330 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4960cea7-8b62-4aec-9a81-969e1d63fa8b admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:57.323751 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4960cea7-8b62-4aec-9a81-969e1d63fa8b admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:57.324131 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4960cea7-8b62-4aec-9a81-969e1d63fa8b admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:57.325079 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4960cea7-8b62-4aec-9a81-969e1d63fa8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:57.327116 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4960cea7-8b62-4aec-9a81-969e1d63fa8b admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:57.342858 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3587/7205] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:36:57 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:36:57.346938 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc28bd6-ca62-453d-8bca-0c6ae71032a4 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:57.364634 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc28bd6-ca62-453d-8bca-0c6ae71032a4 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:57.377070 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384e7150-7559-49f7-8a29-ccb958970e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:57.377070 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384e7150-7559-49f7-8a29-ccb958970e76 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:57.377070 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384e7150-7559-49f7-8a29-ccb958970e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:57.377070 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384e7150-7559-49f7-8a29-ccb958970e76 admin admin] PATH_INFO: `/v3/projects/22a86ab6c8e14fb592f04a81c48f616f/users/4ad7505fb67149a2a8f1dcf63d82864b/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:57.379894 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384e7150-7559-49f7-8a29-ccb958970e76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22a86ab6c8e14fb592f04a81c48f616f, user_id=4ad7505fb67149a2a8f1dcf63d82864b, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:57.387493 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384e7150-7559-49f7-8a29-ccb958970e76 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:57.415376 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3619/7206] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:36:57 2022] PUT /identity/v3/projects/22a86ab6c8e14fb592f04a81c48f616f/users/4ad7505fb67149a2a8f1dcf63d82864b/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:36:57.426069 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ec5c0e-2bf8-4926-a36a-99d46c44bdcd None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:57.426369 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ec5c0e-2bf8-4926-a36a-99d46c44bdcd None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:57.426640 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ec5c0e-2bf8-4926-a36a-99d46c44bdcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:57.467443 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-17ec5c0e-2bf8-4926-a36a-99d46c44bdcd None None] MFA Rules not processed for user `4ad7505fb67149a2a8f1dcf63d82864b`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:36:57.469461 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-17ec5c0e-2bf8-4926-a36a-99d46c44bdcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:36:57.483917 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:36:57.586732 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3588/7207] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:36:57 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:36:57.643693 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384e7150-7559-49f7-8a29-ccb958970e76 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:36:57.651104 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-384e7150-7559-49f7-8a29-ccb958970e76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:36:57.764808 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384e7150-7559-49f7-8a29-ccb958970e76 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:36:57.779988 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9beab5-447e-4022-84b9-136b4ca23e32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:36:57.780927 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9beab5-447e-4022-84b9-136b4ca23e32 service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:36:57.781322 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9beab5-447e-4022-84b9-136b4ca23e32 service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:36:57.781734 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9beab5-447e-4022-84b9-136b4ca23e32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:36:57.803748 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9beab5-447e-4022-84b9-136b4ca23e32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:36:57.805611 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9beab5-447e-4022-84b9-136b4ca23e32 service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:36:57.835661 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3620/7208] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:36:57 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:37:01.411123 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ec5c0e-2bf8-4926-a36a-99d46c44bdcd None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:37:01.413049 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-17ec5c0e-2bf8-4926-a36a-99d46c44bdcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:37:01.438010 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ec5c0e-2bf8-4926-a36a-99d46c44bdcd None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:37:01.443868 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf198d4-6556-429a-8dd3-7ea5d11831aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:37:01.444844 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf198d4-6556-429a-8dd3-7ea5d11831aa service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:01.445972 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf198d4-6556-429a-8dd3-7ea5d11831aa service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:01.446494 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf198d4-6556-429a-8dd3-7ea5d11831aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:01.533066 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf198d4-6556-429a-8dd3-7ea5d11831aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:37:01.535081 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf198d4-6556-429a-8dd3-7ea5d11831aa service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:37:01.546389 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3589/7209] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:37:01 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:37:02.898477 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9beab5-447e-4022-84b9-136b4ca23e32 service neutron] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:37:03.033759 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9beab5-447e-4022-84b9-136b4ca23e32 service neutron] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:37:03.043542 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b6936a-8c2f-4fde-b79c-c35a67141c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:37:03.044888 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b6936a-8c2f-4fde-b79c-c35a67141c05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:03.045409 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b6936a-8c2f-4fde-b79c-c35a67141c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:03.046703 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b6936a-8c2f-4fde-b79c-c35a67141c05 admin admin] PATH_INFO: `/v3/users/68226e68e503445e899fab97a0692aeb` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:03.048833 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b6936a-8c2f-4fde-b79c-c35a67141c05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=68226e68e503445e899fab97a0692aeb)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:37:03.053158 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b6936a-8c2f-4fde-b79c-c35a67141c05 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:37:03.141181 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=89,keystone:INSERT=5,keystone:DELETE=6 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:37:03.156059 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-69b6936a-8c2f-4fde-b79c-c35a67141c05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68226e68e503445e899fab97a0692aeb'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:37:03.156960 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-69b6936a-8c2f-4fde-b79c-c35a67141c05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68226e68e503445e899fab97a0692aeb'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:37:03.182649 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-69b6936a-8c2f-4fde-b79c-c35a67141c05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68226e68e503445e899fab97a0692aeb'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:37:03.198723 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-69b6936a-8c2f-4fde-b79c-c35a67141c05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68226e68e503445e899fab97a0692aeb'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:37:03.233139 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-69b6936a-8c2f-4fde-b79c-c35a67141c05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68226e68e503445e899fab97a0692aeb'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:37:03.250657 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3621/7210] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:37:02 2022] DELETE /identity/v3/users/68226e68e503445e899fab97a0692aeb => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:37:03.255679 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ab02c0-d9e2-42e8-9b03-fb01bfa7b21d None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:03.256072 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ab02c0-d9e2-42e8-9b03-fb01bfa7b21d None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:03.256072 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ab02c0-d9e2-42e8-9b03-fb01bfa7b21d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:03.280839 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-45ab02c0-d9e2-42e8-9b03-fb01bfa7b21d None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:37:03.284969 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-45ab02c0-d9e2-42e8-9b03-fb01bfa7b21d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:37:03.407872 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3590/7211] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:37:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:37:03.476895 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b6936a-8c2f-4fde-b79c-c35a67141c05 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:37:03.478537 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-69b6936a-8c2f-4fde-b79c-c35a67141c05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:37:03.647467 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b6936a-8c2f-4fde-b79c-c35a67141c05 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:37:03.660222 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef6bbab-a9f4-4960-bdb2-1c7f42e1d967 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:37:03.664403 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef6bbab-a9f4-4960-bdb2-1c7f42e1d967 service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:03.668238 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef6bbab-a9f4-4960-bdb2-1c7f42e1d967 service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:03.668238 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef6bbab-a9f4-4960-bdb2-1c7f42e1d967 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:03.682927 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef6bbab-a9f4-4960-bdb2-1c7f42e1d967 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:37:03.684471 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef6bbab-a9f4-4960-bdb2-1c7f42e1d967 service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:37:03.696972 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3622/7212] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:37:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:37:04.341077 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ab02c0-d9e2-42e8-9b03-fb01bfa7b21d None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:37:04.343970 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-45ab02c0-d9e2-42e8-9b03-fb01bfa7b21d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:37:04.360156 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ab02c0-d9e2-42e8-9b03-fb01bfa7b21d None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:37:04.367729 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dd24d9-a0bb-44cc-80e3-2d73c75c7c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:37:04.369003 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dd24d9-a0bb-44cc-80e3-2d73c75c7c6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:04.369453 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dd24d9-a0bb-44cc-80e3-2d73c75c7c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:04.369953 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dd24d9-a0bb-44cc-80e3-2d73c75c7c6b admin admin] PATH_INFO: `/v3/projects/05a0239551b94c9bacfe7de0952ab613` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:04.371818 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dd24d9-a0bb-44cc-80e3-2d73c75c7c6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=05a0239551b94c9bacfe7de0952ab613)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:37:04.374836 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dd24d9-a0bb-44cc-80e3-2d73c75c7c6b admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:37:04.495676 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:37:04.517479 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-62dd24d9-a0bb-44cc-80e3-2d73c75c7c6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05a0239551b94c9bacfe7de0952ab613', 'request_id': 'req-62dd24d9-a0bb-44cc-80e3-2d73c75c7c6b'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:37:04.542716 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-62dd24d9-a0bb-44cc-80e3-2d73c75c7c6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05a0239551b94c9bacfe7de0952ab613', 'request_id': 'req-62dd24d9-a0bb-44cc-80e3-2d73c75c7c6b'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:37:04.564733 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-62dd24d9-a0bb-44cc-80e3-2d73c75c7c6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05a0239551b94c9bacfe7de0952ab613', 'request_id': 'req-62dd24d9-a0bb-44cc-80e3-2d73c75c7c6b'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:37:04.602096 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-62dd24d9-a0bb-44cc-80e3-2d73c75c7c6b admin admin] The token cache is being invalidate because project 05a0239551b94c9bacfe7de0952ab613 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:37:04.602664 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-62dd24d9-a0bb-44cc-80e3-2d73c75c7c6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:37:04.605182 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-62dd24d9-a0bb-44cc-80e3-2d73c75c7c6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:37:04.612167 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3591/7213] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:37:04 2022] DELETE /identity/v3/projects/05a0239551b94c9bacfe7de0952ab613 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:37:04.616284 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef6bbab-a9f4-4960-bdb2-1c7f42e1d967 service neutron] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:37:04.630889 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef6bbab-a9f4-4960-bdb2-1c7f42e1d967 service neutron] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:37:04.780517 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675acc61-0548-4d57-bcac-2e8405b94a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:37:04.781496 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675acc61-0548-4d57-bcac-2e8405b94a1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:04.781782 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675acc61-0548-4d57-bcac-2e8405b94a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:04.782079 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675acc61-0548-4d57-bcac-2e8405b94a1d admin admin] PATH_INFO: `/v3/users/4ad7505fb67149a2a8f1dcf63d82864b` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:04.787829 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675acc61-0548-4d57-bcac-2e8405b94a1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ad7505fb67149a2a8f1dcf63d82864b)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:37:04.791113 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675acc61-0548-4d57-bcac-2e8405b94a1d admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:37:04.907008 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-675acc61-0548-4d57-bcac-2e8405b94a1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ad7505fb67149a2a8f1dcf63d82864b'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:37:04.908161 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-675acc61-0548-4d57-bcac-2e8405b94a1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ad7505fb67149a2a8f1dcf63d82864b'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:37:04.925408 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-675acc61-0548-4d57-bcac-2e8405b94a1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ad7505fb67149a2a8f1dcf63d82864b'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:37:04.954531 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-675acc61-0548-4d57-bcac-2e8405b94a1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ad7505fb67149a2a8f1dcf63d82864b'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:37:04.956343 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:37:04.979215 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-675acc61-0548-4d57-bcac-2e8405b94a1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ad7505fb67149a2a8f1dcf63d82864b'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:37:04.997043 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3623/7214] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:37:04 2022] DELETE /identity/v3/users/4ad7505fb67149a2a8f1dcf63d82864b => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:37:05.617771 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dd24d9-a0bb-44cc-80e3-2d73c75c7c6b admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:37:05.620013 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-62dd24d9-a0bb-44cc-80e3-2d73c75c7c6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:37:05.641597 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dd24d9-a0bb-44cc-80e3-2d73c75c7c6b admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:37:05.751227 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8d3f25-260e-46a2-a1cd-6ca05274fcd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:37:05.753596 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8d3f25-260e-46a2-a1cd-6ca05274fcd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:05.754118 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8d3f25-260e-46a2-a1cd-6ca05274fcd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:05.754507 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8d3f25-260e-46a2-a1cd-6ca05274fcd7 admin admin] PATH_INFO: `/v3/projects/22a86ab6c8e14fb592f04a81c48f616f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:05.756094 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8d3f25-260e-46a2-a1cd-6ca05274fcd7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22a86ab6c8e14fb592f04a81c48f616f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:37:05.758635 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8d3f25-260e-46a2-a1cd-6ca05274fcd7 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:37:05.882334 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-0d8d3f25-260e-46a2-a1cd-6ca05274fcd7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22a86ab6c8e14fb592f04a81c48f616f', 'request_id': 'req-0d8d3f25-260e-46a2-a1cd-6ca05274fcd7'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:37:05.904047 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-0d8d3f25-260e-46a2-a1cd-6ca05274fcd7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22a86ab6c8e14fb592f04a81c48f616f', 'request_id': 'req-0d8d3f25-260e-46a2-a1cd-6ca05274fcd7'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:37:05.934343 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-0d8d3f25-260e-46a2-a1cd-6ca05274fcd7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22a86ab6c8e14fb592f04a81c48f616f', 'request_id': 'req-0d8d3f25-260e-46a2-a1cd-6ca05274fcd7'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:37:05.949662 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-0d8d3f25-260e-46a2-a1cd-6ca05274fcd7 admin admin] The token cache is being invalidate because project 22a86ab6c8e14fb592f04a81c48f616f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:37:05.951126 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-0d8d3f25-260e-46a2-a1cd-6ca05274fcd7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:37:05.952278 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-0d8d3f25-260e-46a2-a1cd-6ca05274fcd7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:37:05.958846 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3592/7215] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:37:05 2022] DELETE /identity/v3/projects/22a86ab6c8e14fb592f04a81c48f616f => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:37:05.964021 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8537ba07-dc20-481e-a9fc-6cae65c325d3 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:05.964021 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8537ba07-dc20-481e-a9fc-6cae65c325d3 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:05.964656 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8537ba07-dc20-481e-a9fc-6cae65c325d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:06.037572 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-8537ba07-dc20-481e-a9fc-6cae65c325d3 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:37:06.040059 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-8537ba07-dc20-481e-a9fc-6cae65c325d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:37:06.212145 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3624/7216] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:37:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:37:06.221524 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fb5f96-75c3-4f8c-80b5-411d09869de8 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:06.221750 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fb5f96-75c3-4f8c-80b5-411d09869de8 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:06.222074 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fb5f96-75c3-4f8c-80b5-411d09869de8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:06.267447 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-f1fb5f96-75c3-4f8c-80b5-411d09869de8 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:37:06.271114 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-f1fb5f96-75c3-4f8c-80b5-411d09869de8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:37:06.292766 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3593/7217] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:37:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:37:06.295569 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8537ba07-dc20-481e-a9fc-6cae65c325d3 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:37:06.334179 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8537ba07-dc20-481e-a9fc-6cae65c325d3 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:37:06.363793 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f67fbf-48cd-4ced-8b66-cacd338ee4f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:37:06.370574 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f67fbf-48cd-4ced-8b66-cacd338ee4f2 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:06.374059 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f67fbf-48cd-4ced-8b66-cacd338ee4f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:06.375857 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f67fbf-48cd-4ced-8b66-cacd338ee4f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:06.378683 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f67fbf-48cd-4ced-8b66-cacd338ee4f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:37:06.380338 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f67fbf-48cd-4ced-8b66-cacd338ee4f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:37:06.392393 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f67fbf-48cd-4ced-8b66-cacd338ee4f2 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:37:06.439879 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3625/7218] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:37:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:37:06.444852 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fb5f96-75c3-4f8c-80b5-411d09869de8 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:37:06.460003 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fb5f96-75c3-4f8c-80b5-411d09869de8 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:37:06.479220 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db073dfa-9b10-403d-a15a-b4120ac29b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:37:06.480077 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db073dfa-9b10-403d-a15a-b4120ac29b50 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:06.480470 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db073dfa-9b10-403d-a15a-b4120ac29b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:06.483750 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db073dfa-9b10-403d-a15a-b4120ac29b50 admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:06.484645 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db073dfa-9b10-403d-a15a-b4120ac29b50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:37:06.489881 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db073dfa-9b10-403d-a15a-b4120ac29b50 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:37:06.567115 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3594/7219] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:37:06 2022] POST /identity/v3/projects => generated 389 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:37:06.571481 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f67fbf-48cd-4ced-8b66-cacd338ee4f2 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:37:06.584502 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f67fbf-48cd-4ced-8b66-cacd338ee4f2 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:37:06.757980 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76784eef-7c54-4337-b9bf-7e22654a4391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:37:06.758693 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76784eef-7c54-4337-b9bf-7e22654a4391 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:06.758977 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76784eef-7c54-4337-b9bf-7e22654a4391 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:06.759248 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76784eef-7c54-4337-b9bf-7e22654a4391 admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:06.759958 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76784eef-7c54-4337-b9bf-7e22654a4391 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:37:06.761945 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76784eef-7c54-4337-b9bf-7e22654a4391 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:37:06.787507 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3626/7220] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:37:06 2022] POST /identity/v3/users => generated 295 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:37:06.791435 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db073dfa-9b10-403d-a15a-b4120ac29b50 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:37:06.812475 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db073dfa-9b10-403d-a15a-b4120ac29b50 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:37:06.822934 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4735e32f-a074-4a22-9cf8-bb9a149f8f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:37:06.823664 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4735e32f-a074-4a22-9cf8-bb9a149f8f78 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:06.823924 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4735e32f-a074-4a22-9cf8-bb9a149f8f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:06.824410 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4735e32f-a074-4a22-9cf8-bb9a149f8f78 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:06.825344 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4735e32f-a074-4a22-9cf8-bb9a149f8f78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:37:06.827248 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4735e32f-a074-4a22-9cf8-bb9a149f8f78 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:37:06.860904 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3595/7221] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:37:06 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:37:06.862194 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76784eef-7c54-4337-b9bf-7e22654a4391 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:37:06.889357 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76784eef-7c54-4337-b9bf-7e22654a4391 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:37:06.910059 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c03bc4-c7a7-46de-9cbb-a751ab162302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:37:06.914281 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c03bc4-c7a7-46de-9cbb-a751ab162302 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:06.916867 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c03bc4-c7a7-46de-9cbb-a751ab162302 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:06.916867 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c03bc4-c7a7-46de-9cbb-a751ab162302 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:06.923281 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c03bc4-c7a7-46de-9cbb-a751ab162302 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:37:06.925265 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c03bc4-c7a7-46de-9cbb-a751ab162302 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:37:06.950181 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3627/7222] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:37:06 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 21:37:06.953948 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4735e32f-a074-4a22-9cf8-bb9a149f8f78 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:37:06.967831 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4735e32f-a074-4a22-9cf8-bb9a149f8f78 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:37:06.975018 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b741ef-a451-4467-8d8c-8d598d165fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:37:06.976937 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b741ef-a451-4467-8d8c-8d598d165fb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:06.977469 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b741ef-a451-4467-8d8c-8d598d165fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:06.978046 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b741ef-a451-4467-8d8c-8d598d165fb4 admin admin] PATH_INFO: `/v3/projects/61f8ee661649465b9ccdc55f20830f07/users/1e66c730af454d5ba3367315d0a0727a/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:07.015326 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b741ef-a451-4467-8d8c-8d598d165fb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61f8ee661649465b9ccdc55f20830f07, user_id=1e66c730af454d5ba3367315d0a0727a, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:37:07.019267 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b741ef-a451-4467-8d8c-8d598d165fb4 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:37:07.025331 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:37:07.043163 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3596/7223] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:37:06 2022] PUT /identity/v3/projects/61f8ee661649465b9ccdc55f20830f07/users/1e66c730af454d5ba3367315d0a0727a/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:37:07.055406 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bef3bbd-5ffc-4f74-8769-94a874fbe4c4 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:07.056296 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bef3bbd-5ffc-4f74-8769-94a874fbe4c4 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:07.057152 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bef3bbd-5ffc-4f74-8769-94a874fbe4c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:07.122576 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-1bef3bbd-5ffc-4f74-8769-94a874fbe4c4 None None] MFA Rules not processed for user `1e66c730af454d5ba3367315d0a0727a`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:37:07.124269 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-1bef3bbd-5ffc-4f74-8769-94a874fbe4c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:37:07.203024 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:37:07.287111 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3628/7224] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:37:07 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:37:07.302780 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b741ef-a451-4467-8d8c-8d598d165fb4 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:37:07.304714 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-03b741ef-a451-4467-8d8c-8d598d165fb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:37:07.472893 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b741ef-a451-4467-8d8c-8d598d165fb4 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:37:07.478399 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e2d2cb-6159-475e-83fb-a6fbe0531012 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:37:07.479159 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e2d2cb-6159-475e-83fb-a6fbe0531012 service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:07.479355 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e2d2cb-6159-475e-83fb-a6fbe0531012 service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:07.479628 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e2d2cb-6159-475e-83fb-a6fbe0531012 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:07.503509 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e2d2cb-6159-475e-83fb-a6fbe0531012 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:37:07.504995 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e2d2cb-6159-475e-83fb-a6fbe0531012 service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:37:07.525031 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3597/7225] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:37:07 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:37:07.593190 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bef3bbd-5ffc-4f74-8769-94a874fbe4c4 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:37:07.743137 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bef3bbd-5ffc-4f74-8769-94a874fbe4c4 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:37:07.754672 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79de90f5-d6a1-4780-8052-a457000cbc99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:37:07.755787 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79de90f5-d6a1-4780-8052-a457000cbc99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:07.756184 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79de90f5-d6a1-4780-8052-a457000cbc99 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:07.756315 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79de90f5-d6a1-4780-8052-a457000cbc99 admin admin] PATH_INFO: `/v3/users/1e66c730af454d5ba3367315d0a0727a` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:07.759546 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79de90f5-d6a1-4780-8052-a457000cbc99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e66c730af454d5ba3367315d0a0727a)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:37:07.762595 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79de90f5-d6a1-4780-8052-a457000cbc99 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:37:07.887051 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-79de90f5-d6a1-4780-8052-a457000cbc99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e66c730af454d5ba3367315d0a0727a'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:37:07.887930 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-79de90f5-d6a1-4780-8052-a457000cbc99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e66c730af454d5ba3367315d0a0727a'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:37:07.905477 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-79de90f5-d6a1-4780-8052-a457000cbc99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e66c730af454d5ba3367315d0a0727a'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:37:07.923834 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-79de90f5-d6a1-4780-8052-a457000cbc99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e66c730af454d5ba3367315d0a0727a'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:37:07.947457 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-79de90f5-d6a1-4780-8052-a457000cbc99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e66c730af454d5ba3367315d0a0727a'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:37:07.957035 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3629/7226] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:37:07 2022] DELETE /identity/v3/users/1e66c730af454d5ba3367315d0a0727a => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:37:07.961993 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace17ae5-986b-430e-a6a9-5930ea8ca8d9 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:07.963057 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace17ae5-986b-430e-a6a9-5930ea8ca8d9 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:07.963585 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace17ae5-986b-430e-a6a9-5930ea8ca8d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:07.988656 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-ace17ae5-986b-430e-a6a9-5930ea8ca8d9 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:37:07.992075 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-ace17ae5-986b-430e-a6a9-5930ea8ca8d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:37:08.133988 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3598/7227] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:37:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:37:08.147578 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79de90f5-d6a1-4780-8052-a457000cbc99 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:37:08.149081 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-79de90f5-d6a1-4780-8052-a457000cbc99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:37:08.267343 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79de90f5-d6a1-4780-8052-a457000cbc99 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:37:08.271597 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf640ba-f625-45d4-8e7d-ac5ed83935c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:37:08.272276 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf640ba-f625-45d4-8e7d-ac5ed83935c6 service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:08.272566 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf640ba-f625-45d4-8e7d-ac5ed83935c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:08.272842 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf640ba-f625-45d4-8e7d-ac5ed83935c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:08.283723 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf640ba-f625-45d4-8e7d-ac5ed83935c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:37:08.285208 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf640ba-f625-45d4-8e7d-ac5ed83935c6 service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:37:08.289689 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:37:08.296974 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3630/7228] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:37:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:37:09.312247 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace17ae5-986b-430e-a6a9-5930ea8ca8d9 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:37:09.314315 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-ace17ae5-986b-430e-a6a9-5930ea8ca8d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:37:09.334320 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace17ae5-986b-430e-a6a9-5930ea8ca8d9 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:37:09.346272 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7659273-8c9c-458b-a2bb-db81162582f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:37:09.347971 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7659273-8c9c-458b-a2bb-db81162582f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:09.348267 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7659273-8c9c-458b-a2bb-db81162582f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:09.348542 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7659273-8c9c-458b-a2bb-db81162582f2 admin admin] PATH_INFO: `/v3/projects/61f8ee661649465b9ccdc55f20830f07` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:09.349848 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7659273-8c9c-458b-a2bb-db81162582f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61f8ee661649465b9ccdc55f20830f07)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:37:09.355226 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7659273-8c9c-458b-a2bb-db81162582f2 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:37:09.455837 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-f7659273-8c9c-458b-a2bb-db81162582f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61f8ee661649465b9ccdc55f20830f07', 'request_id': 'req-f7659273-8c9c-458b-a2bb-db81162582f2'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:37:09.473846 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-f7659273-8c9c-458b-a2bb-db81162582f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61f8ee661649465b9ccdc55f20830f07', 'request_id': 'req-f7659273-8c9c-458b-a2bb-db81162582f2'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:37:09.490612 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-f7659273-8c9c-458b-a2bb-db81162582f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61f8ee661649465b9ccdc55f20830f07', 'request_id': 'req-f7659273-8c9c-458b-a2bb-db81162582f2'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:37:09.510037 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-f7659273-8c9c-458b-a2bb-db81162582f2 admin admin] The token cache is being invalidate because project 61f8ee661649465b9ccdc55f20830f07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:37:09.510636 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-f7659273-8c9c-458b-a2bb-db81162582f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:37:09.512732 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-f7659273-8c9c-458b-a2bb-db81162582f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:37:09.518947 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3599/7229] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:37:09 2022] DELETE /identity/v3/projects/61f8ee661649465b9ccdc55f20830f07 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:37:09.520888 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3c498d-34b2-4764-b063-9e144a4476aa None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:09.521383 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3c498d-34b2-4764-b063-9e144a4476aa None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:09.521490 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3c498d-34b2-4764-b063-9e144a4476aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:09.545351 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-8c3c498d-34b2-4764-b063-9e144a4476aa None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:37:09.547394 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-8c3c498d-34b2-4764-b063-9e144a4476aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:37:09.628318 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3631/7230] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:37:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:37:09.636269 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4d42fa-f055-4865-88ca-dbf1cab2fcf9 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:09.636617 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4d42fa-f055-4865-88ca-dbf1cab2fcf9 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:09.637169 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4d42fa-f055-4865-88ca-dbf1cab2fcf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:09.666614 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-1e4d42fa-f055-4865-88ca-dbf1cab2fcf9 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:37:09.667871 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-1e4d42fa-f055-4865-88ca-dbf1cab2fcf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:37:09.679661 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3600/7231] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:37:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:37:09.683084 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3c498d-34b2-4764-b063-9e144a4476aa None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:37:09.706116 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3c498d-34b2-4764-b063-9e144a4476aa None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:37:09.715271 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa752d7b-b1ea-4075-b956-657a68ad8657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:37:09.716579 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa752d7b-b1ea-4075-b956-657a68ad8657 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:09.717178 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa752d7b-b1ea-4075-b956-657a68ad8657 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:09.717713 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa752d7b-b1ea-4075-b956-657a68ad8657 admin admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:09.719863 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa752d7b-b1ea-4075-b956-657a68ad8657 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:37:09.720479 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa752d7b-b1ea-4075-b956-657a68ad8657 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:37:09.725368 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa752d7b-b1ea-4075-b956-657a68ad8657 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:37:09.751573 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3632/7232] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:37:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:37:09.759698 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4d42fa-f055-4865-88ca-dbf1cab2fcf9 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:37:09.773085 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4d42fa-f055-4865-88ca-dbf1cab2fcf9 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:37:09.787436 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc5e7da-795e-48c4-b4a9-3bbb159feba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:37:09.789379 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc5e7da-795e-48c4-b4a9-3bbb159feba3 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:09.789738 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc5e7da-795e-48c4-b4a9-3bbb159feba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:09.789977 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc5e7da-795e-48c4-b4a9-3bbb159feba3 admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:09.790762 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc5e7da-795e-48c4-b4a9-3bbb159feba3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:37:09.793089 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc5e7da-795e-48c4-b4a9-3bbb159feba3 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:37:09.833215 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:37:09.881231 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3601/7233] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:37:09 2022] POST /identity/v3/projects => generated 373 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:37:09.886767 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa752d7b-b1ea-4075-b956-657a68ad8657 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:37:09.900639 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa752d7b-b1ea-4075-b956-657a68ad8657 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:37:09.979049 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62666bb0-bbe1-4ec5-87fe-63ccc4887a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:37:09.979930 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62666bb0-bbe1-4ec5-87fe-63ccc4887a1b admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:09.980224 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62666bb0-bbe1-4ec5-87fe-63ccc4887a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:09.980571 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62666bb0-bbe1-4ec5-87fe-63ccc4887a1b admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:09.981396 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62666bb0-bbe1-4ec5-87fe-63ccc4887a1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:37:09.984356 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62666bb0-bbe1-4ec5-87fe-63ccc4887a1b admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:37:10.018604 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3633/7234] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:37:09 2022] POST /identity/v3/users => generated 287 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:37:10.023398 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc5e7da-795e-48c4-b4a9-3bbb159feba3 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:37:10.035877 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc5e7da-795e-48c4-b4a9-3bbb159feba3 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:37:10.041153 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03a7116-940f-4967-9af3-76c3c348b4fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:37:10.042005 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03a7116-940f-4967-9af3-76c3c348b4fd admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:10.042667 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03a7116-940f-4967-9af3-76c3c348b4fd admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:10.042667 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03a7116-940f-4967-9af3-76c3c348b4fd admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:10.043462 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03a7116-940f-4967-9af3-76c3c348b4fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:37:10.045449 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03a7116-940f-4967-9af3-76c3c348b4fd admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:37:10.068392 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3602/7235] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:37:10 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:37:10.069086 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62666bb0-bbe1-4ec5-87fe-63ccc4887a1b admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:37:10.082303 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62666bb0-bbe1-4ec5-87fe-63ccc4887a1b admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:37:10.087952 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bf9584-6813-47bc-a112-e6b0299ba225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:37:10.088666 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bf9584-6813-47bc-a112-e6b0299ba225 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:10.089116 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bf9584-6813-47bc-a112-e6b0299ba225 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:10.089435 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bf9584-6813-47bc-a112-e6b0299ba225 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:10.090196 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bf9584-6813-47bc-a112-e6b0299ba225 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:37:10.092218 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bf9584-6813-47bc-a112-e6b0299ba225 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:37:10.107469 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3634/7236] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:37:10 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:37:10.121751 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03a7116-940f-4967-9af3-76c3c348b4fd admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:37:10.127358 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03a7116-940f-4967-9af3-76c3c348b4fd admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:37:10.132774 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb49c9e-50d8-4432-8c1a-5d80d475694e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:37:10.133724 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb49c9e-50d8-4432-8c1a-5d80d475694e admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:10.134043 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb49c9e-50d8-4432-8c1a-5d80d475694e admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:10.134332 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb49c9e-50d8-4432-8c1a-5d80d475694e admin admin] PATH_INFO: `/v3/projects/4d273248e138400c8a907416d45b4dfa/users/fbdac5390db743fa9ba54b97a4f24628/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:10.154564 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb49c9e-50d8-4432-8c1a-5d80d475694e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d273248e138400c8a907416d45b4dfa, user_id=fbdac5390db743fa9ba54b97a4f24628, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:37:10.157355 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb49c9e-50d8-4432-8c1a-5d80d475694e admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:37:10.190201 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3603/7237] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:37:10 2022] PUT /identity/v3/projects/4d273248e138400c8a907416d45b4dfa/users/fbdac5390db743fa9ba54b97a4f24628/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:37:10.190438 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e368a7-005c-4196-8a60-9b5deb532fe0 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:10.190438 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e368a7-005c-4196-8a60-9b5deb532fe0 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:10.190438 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e368a7-005c-4196-8a60-9b5deb532fe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:10.234858 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-68e368a7-005c-4196-8a60-9b5deb532fe0 None None] MFA Rules not processed for user `fbdac5390db743fa9ba54b97a4f24628`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:37:10.236574 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-68e368a7-005c-4196-8a60-9b5deb532fe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:37:10.344796 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:37:10.364743 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3635/7238] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:37:10 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:37:10.402986 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb49c9e-50d8-4432-8c1a-5d80d475694e admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:37:10.406062 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-3fb49c9e-50d8-4432-8c1a-5d80d475694e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:37:10.535201 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb49c9e-50d8-4432-8c1a-5d80d475694e admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:37:10.540268 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241f3597-c919-4051-9343-06c50e0bd931 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:37:10.541174 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241f3597-c919-4051-9343-06c50e0bd931 service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:10.541634 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241f3597-c919-4051-9343-06c50e0bd931 service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:10.542763 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241f3597-c919-4051-9343-06c50e0bd931 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:10.559103 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241f3597-c919-4051-9343-06c50e0bd931 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:37:10.560754 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241f3597-c919-4051-9343-06c50e0bd931 service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:37:10.584100 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3604/7239] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:37:10 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 23 21:37:20.366357 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=3 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:37:20.575602 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:INSERT=2,keystone:SELECT=43 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:37:30.891587 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e368a7-005c-4196-8a60-9b5deb532fe0 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:37:30.894633 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-68e368a7-005c-4196-8a60-9b5deb532fe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:37:31.016322 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e368a7-005c-4196-8a60-9b5deb532fe0 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:37:31.021290 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d27fc2-f0e4-43e5-85eb-124de67221ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:37:31.022240 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d27fc2-f0e4-43e5-85eb-124de67221ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:31.022522 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d27fc2-f0e4-43e5-85eb-124de67221ec admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:31.022799 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d27fc2-f0e4-43e5-85eb-124de67221ec admin admin] PATH_INFO: `/v3/users/0f33541bb2b64d94a0c91b209e28a57e` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:31.024045 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d27fc2-f0e4-43e5-85eb-124de67221ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f33541bb2b64d94a0c91b209e28a57e)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:37:31.026336 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d27fc2-f0e4-43e5-85eb-124de67221ec admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:37:31.154257 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-b8d27fc2-f0e4-43e5-85eb-124de67221ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f33541bb2b64d94a0c91b209e28a57e'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:37:31.155388 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-b8d27fc2-f0e4-43e5-85eb-124de67221ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f33541bb2b64d94a0c91b209e28a57e'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:37:31.172342 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-b8d27fc2-f0e4-43e5-85eb-124de67221ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f33541bb2b64d94a0c91b209e28a57e'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:37:31.196321 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-b8d27fc2-f0e4-43e5-85eb-124de67221ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f33541bb2b64d94a0c91b209e28a57e'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:37:31.235167 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-b8d27fc2-f0e4-43e5-85eb-124de67221ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f33541bb2b64d94a0c91b209e28a57e'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:37:31.251258 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d478147-d003-45fb-956f-fbae614c4e69 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:31.251830 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d478147-d003-45fb-956f-fbae614c4e69 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:31.251830 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d478147-d003-45fb-956f-fbae614c4e69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:31.268645 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3636/7240] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:37:30 2022] DELETE /identity/v3/users/0f33541bb2b64d94a0c91b209e28a57e => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:37:31.316124 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-4d478147-d003-45fb-956f-fbae614c4e69 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:37:31.318172 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-4d478147-d003-45fb-956f-fbae614c4e69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:37:31.473787 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3605/7241] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:37:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:37:31.540650 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d27fc2-f0e4-43e5-85eb-124de67221ec admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:37:31.542347 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-b8d27fc2-f0e4-43e5-85eb-124de67221ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:37:31.739587 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d27fc2-f0e4-43e5-85eb-124de67221ec admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:37:31.753616 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad81e4db-cc5c-4d24-8986-5fb442260a89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:37:31.754344 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad81e4db-cc5c-4d24-8986-5fb442260a89 service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:31.754630 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad81e4db-cc5c-4d24-8986-5fb442260a89 service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:31.754906 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad81e4db-cc5c-4d24-8986-5fb442260a89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:31.781409 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad81e4db-cc5c-4d24-8986-5fb442260a89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:37:31.784253 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad81e4db-cc5c-4d24-8986-5fb442260a89 service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:37:31.812825 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3637/7242] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:37:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:37:32.495773 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d478147-d003-45fb-956f-fbae614c4e69 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:37:32.497287 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-4d478147-d003-45fb-956f-fbae614c4e69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:37:32.527833 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d478147-d003-45fb-956f-fbae614c4e69 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:37:32.534127 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc7e55a-c477-4120-a16d-60a50857ff80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:37:32.535288 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc7e55a-c477-4120-a16d-60a50857ff80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:32.535762 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc7e55a-c477-4120-a16d-60a50857ff80 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:32.536202 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc7e55a-c477-4120-a16d-60a50857ff80 admin admin] PATH_INFO: `/v3/projects/2432219c5c43400e978d74c94c39b810` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:32.538678 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc7e55a-c477-4120-a16d-60a50857ff80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2432219c5c43400e978d74c94c39b810)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:37:32.540650 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc7e55a-c477-4120-a16d-60a50857ff80 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:37:32.661199 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-edc7e55a-c477-4120-a16d-60a50857ff80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2432219c5c43400e978d74c94c39b810', 'request_id': 'req-edc7e55a-c477-4120-a16d-60a50857ff80'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:37:32.674351 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-edc7e55a-c477-4120-a16d-60a50857ff80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2432219c5c43400e978d74c94c39b810', 'request_id': 'req-edc7e55a-c477-4120-a16d-60a50857ff80'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:37:32.682048 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-edc7e55a-c477-4120-a16d-60a50857ff80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2432219c5c43400e978d74c94c39b810', 'request_id': 'req-edc7e55a-c477-4120-a16d-60a50857ff80'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:37:32.704080 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-edc7e55a-c477-4120-a16d-60a50857ff80 admin admin] The token cache is being invalidate because project 2432219c5c43400e978d74c94c39b810 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:37:32.704318 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-edc7e55a-c477-4120-a16d-60a50857ff80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:37:32.705060 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-edc7e55a-c477-4120-a16d-60a50857ff80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:37:32.713277 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3606/7243] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:37:32 2022] DELETE /identity/v3/projects/2432219c5c43400e978d74c94c39b810 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:37:32.714688 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d190b0-863c-4723-9065-a4b90f0c8b6d None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:32.715209 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d190b0-863c-4723-9065-a4b90f0c8b6d None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:32.715209 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d190b0-863c-4723-9065-a4b90f0c8b6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:32.742625 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-a3d190b0-863c-4723-9065-a4b90f0c8b6d None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:37:32.743925 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-a3d190b0-863c-4723-9065-a4b90f0c8b6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:37:32.768784 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:37:32.831820 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3638/7244] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:37:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:37:32.840403 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbab80db-10c2-4261-87cd-8368b48fa593 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:32.841898 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbab80db-10c2-4261-87cd-8368b48fa593 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:32.842397 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbab80db-10c2-4261-87cd-8368b48fa593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:32.866004 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-fbab80db-10c2-4261-87cd-8368b48fa593 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:37:32.867516 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-fbab80db-10c2-4261-87cd-8368b48fa593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:37:32.876422 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3607/7245] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:37:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:37:32.880968 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d190b0-863c-4723-9065-a4b90f0c8b6d None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:37:32.891800 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d190b0-863c-4723-9065-a4b90f0c8b6d None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:37:32.898061 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89b0114-b0f2-46bc-8c0e-1ff5e65ad242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:37:32.899085 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89b0114-b0f2-46bc-8c0e-1ff5e65ad242 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:32.899444 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89b0114-b0f2-46bc-8c0e-1ff5e65ad242 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:32.899782 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89b0114-b0f2-46bc-8c0e-1ff5e65ad242 admin admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:32.900796 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89b0114-b0f2-46bc-8c0e-1ff5e65ad242 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:37:32.901162 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89b0114-b0f2-46bc-8c0e-1ff5e65ad242 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:37:32.903242 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89b0114-b0f2-46bc-8c0e-1ff5e65ad242 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:37:32.918276 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3639/7246] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:37:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:37:32.920997 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbab80db-10c2-4261-87cd-8368b48fa593 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:37:32.931001 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbab80db-10c2-4261-87cd-8368b48fa593 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:37:32.935827 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21429769-90a9-4ffc-ac8b-2405c41027e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:37:32.936566 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21429769-90a9-4ffc-ac8b-2405c41027e5 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:32.936903 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21429769-90a9-4ffc-ac8b-2405c41027e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:32.937262 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21429769-90a9-4ffc-ac8b-2405c41027e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:32.938060 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21429769-90a9-4ffc-ac8b-2405c41027e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:37:32.940035 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21429769-90a9-4ffc-ac8b-2405c41027e5 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:37:32.972387 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3608/7247] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:37:32 2022] POST /identity/v3/projects => generated 375 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:37:32.976812 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89b0114-b0f2-46bc-8c0e-1ff5e65ad242 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:37:32.988553 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89b0114-b0f2-46bc-8c0e-1ff5e65ad242 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:37:33.055905 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8def9804-d131-4637-b0ba-fdcffa29c3ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:37:33.056685 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8def9804-d131-4637-b0ba-fdcffa29c3ad admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:33.056969 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8def9804-d131-4637-b0ba-fdcffa29c3ad admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:33.057247 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8def9804-d131-4637-b0ba-fdcffa29c3ad admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:33.057976 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8def9804-d131-4637-b0ba-fdcffa29c3ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:37:33.059979 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8def9804-d131-4637-b0ba-fdcffa29c3ad admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:37:33.082534 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3640/7248] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:37:32 2022] POST /identity/v3/users => generated 288 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:37:33.086889 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21429769-90a9-4ffc-ac8b-2405c41027e5 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:37:33.099391 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21429769-90a9-4ffc-ac8b-2405c41027e5 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:37:33.104361 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a6bac7-9f11-40b3-a048-d5c420c1997e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:37:33.105043 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a6bac7-9f11-40b3-a048-d5c420c1997e admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:33.105807 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a6bac7-9f11-40b3-a048-d5c420c1997e admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:33.105807 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a6bac7-9f11-40b3-a048-d5c420c1997e admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:33.109306 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a6bac7-9f11-40b3-a048-d5c420c1997e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:37:33.109306 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a6bac7-9f11-40b3-a048-d5c420c1997e admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:37:33.119488 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3609/7249] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:37:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:37:33.123869 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8def9804-d131-4637-b0ba-fdcffa29c3ad admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:37:33.134354 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8def9804-d131-4637-b0ba-fdcffa29c3ad admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:37:33.139759 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d756e66-4f78-4cd2-a6e4-f426cf23a123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:37:33.140439 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d756e66-4f78-4cd2-a6e4-f426cf23a123 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:33.140726 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d756e66-4f78-4cd2-a6e4-f426cf23a123 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:33.141005 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d756e66-4f78-4cd2-a6e4-f426cf23a123 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:33.141766 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d756e66-4f78-4cd2-a6e4-f426cf23a123 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:37:33.143428 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d756e66-4f78-4cd2-a6e4-f426cf23a123 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:37:33.156334 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3641/7250] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:37:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:37:33.160603 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a6bac7-9f11-40b3-a048-d5c420c1997e admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:37:33.173057 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a6bac7-9f11-40b3-a048-d5c420c1997e admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:37:33.178863 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620a3634-75b7-49be-82a6-e9862a82625f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:37:33.179804 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620a3634-75b7-49be-82a6-e9862a82625f admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:33.180117 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620a3634-75b7-49be-82a6-e9862a82625f admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:33.180360 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620a3634-75b7-49be-82a6-e9862a82625f admin admin] PATH_INFO: `/v3/projects/3f655bf75cc440738f3460479fc031e4/users/b074381786134e4189d3e87f0b1ab6bb/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:33.196981 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620a3634-75b7-49be-82a6-e9862a82625f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f655bf75cc440738f3460479fc031e4, user_id=b074381786134e4189d3e87f0b1ab6bb, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:37:33.199754 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620a3634-75b7-49be-82a6-e9862a82625f admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:37:33.222125 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3610/7251] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:37:33 2022] PUT /identity/v3/projects/3f655bf75cc440738f3460479fc031e4/users/b074381786134e4189d3e87f0b1ab6bb/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:37:33.234876 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393e022b-630f-458b-b2aa-8f23dfd722c8 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:33.234876 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393e022b-630f-458b-b2aa-8f23dfd722c8 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:33.235177 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393e022b-630f-458b-b2aa-8f23dfd722c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:33.296261 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-393e022b-630f-458b-b2aa-8f23dfd722c8 None None] MFA Rules not processed for user `b074381786134e4189d3e87f0b1ab6bb`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:37:33.299119 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-393e022b-630f-458b-b2aa-8f23dfd722c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:37:33.476355 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3642/7252] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:37:33 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:37:33.477010 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620a3634-75b7-49be-82a6-e9862a82625f admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:37:33.517306 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:37:33.576258 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620a3634-75b7-49be-82a6-e9862a82625f admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:37:33.581395 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c7b88f-4eae-4126-935a-09103697451e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:37:33.582119 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c7b88f-4eae-4126-935a-09103697451e admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:33.582398 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c7b88f-4eae-4126-935a-09103697451e admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:33.582667 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c7b88f-4eae-4126-935a-09103697451e admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:33.583366 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c7b88f-4eae-4126-935a-09103697451e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:37:33.585923 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c7b88f-4eae-4126-935a-09103697451e admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:37:33.630050 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3611/7253] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:37:33 2022] POST /identity/v3/projects => generated 373 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:37:33.634061 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393e022b-630f-458b-b2aa-8f23dfd722c8 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:37:33.651087 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393e022b-630f-458b-b2aa-8f23dfd722c8 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:37:33.665370 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:37:33.717327 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2791a0-51f2-41a1-a664-e4ec3e538799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:37:33.718509 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2791a0-51f2-41a1-a664-e4ec3e538799 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:33.718694 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2791a0-51f2-41a1-a664-e4ec3e538799 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:33.718963 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2791a0-51f2-41a1-a664-e4ec3e538799 admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:33.719661 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2791a0-51f2-41a1-a664-e4ec3e538799 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:37:33.721561 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2791a0-51f2-41a1-a664-e4ec3e538799 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:37:33.763614 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3643/7254] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:37:33 2022] POST /identity/v3/users => generated 293 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:37:33.765818 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c7b88f-4eae-4126-935a-09103697451e admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:37:33.781030 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c7b88f-4eae-4126-935a-09103697451e admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:37:33.793508 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4035f922-2f99-41f7-83a0-3a71864ce100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:37:33.794238 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4035f922-2f99-41f7-83a0-3a71864ce100 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:33.794513 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4035f922-2f99-41f7-83a0-3a71864ce100 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:33.794823 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4035f922-2f99-41f7-83a0-3a71864ce100 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:33.795582 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4035f922-2f99-41f7-83a0-3a71864ce100 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:37:33.797203 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4035f922-2f99-41f7-83a0-3a71864ce100 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:37:33.812257 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3612/7255] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:37:33 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:37:33.816280 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2791a0-51f2-41a1-a664-e4ec3e538799 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:37:33.826964 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2791a0-51f2-41a1-a664-e4ec3e538799 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:37:33.832062 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb1741b-b439-4b9b-9e2d-736345cbe6ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:37:33.832984 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb1741b-b439-4b9b-9e2d-736345cbe6ae admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:33.833463 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb1741b-b439-4b9b-9e2d-736345cbe6ae admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:33.833760 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb1741b-b439-4b9b-9e2d-736345cbe6ae admin admin] PATH_INFO: `/v3/projects/8a7c7aeb805a4664809e875d1f78588d/users/2fd6cda01c8f43ea8002cfcc0ed968f0/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:33.854545 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb1741b-b439-4b9b-9e2d-736345cbe6ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a7c7aeb805a4664809e875d1f78588d, user_id=2fd6cda01c8f43ea8002cfcc0ed968f0, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:37:33.857456 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb1741b-b439-4b9b-9e2d-736345cbe6ae admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:37:33.877217 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3644/7256] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:37:33 2022] PUT /identity/v3/projects/8a7c7aeb805a4664809e875d1f78588d/users/2fd6cda01c8f43ea8002cfcc0ed968f0/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:37:33.881238 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4035f922-2f99-41f7-83a0-3a71864ce100 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:37:33.894596 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4035f922-2f99-41f7-83a0-3a71864ce100 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:37:33.960505 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5b6ae2-4197-4e08-84b4-b46d16d46327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:37:33.961461 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5b6ae2-4197-4e08-84b4-b46d16d46327 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:33.961646 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5b6ae2-4197-4e08-84b4-b46d16d46327 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:33.962007 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5b6ae2-4197-4e08-84b4-b46d16d46327 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:33.962815 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5b6ae2-4197-4e08-84b4-b46d16d46327 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:37:33.964512 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5b6ae2-4197-4e08-84b4-b46d16d46327 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:37:33.983109 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3613/7257] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:37:33 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:37:33.984248 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb1741b-b439-4b9b-9e2d-736345cbe6ae admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:37:33.997058 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb1741b-b439-4b9b-9e2d-736345cbe6ae admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:37:34.002080 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03825233-e05f-4706-a1ef-50db2067fd6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:37:34.002989 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03825233-e05f-4706-a1ef-50db2067fd6d admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:34.003274 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03825233-e05f-4706-a1ef-50db2067fd6d admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:34.003549 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03825233-e05f-4706-a1ef-50db2067fd6d admin admin] PATH_INFO: `/v3/projects/8a7c7aeb805a4664809e875d1f78588d/users/2fd6cda01c8f43ea8002cfcc0ed968f0/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:34.005707 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03825233-e05f-4706-a1ef-50db2067fd6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a7c7aeb805a4664809e875d1f78588d, user_id=2fd6cda01c8f43ea8002cfcc0ed968f0, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:37:34.008414 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03825233-e05f-4706-a1ef-50db2067fd6d admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:37:34.021467 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3645/7258] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:37:33 2022] PUT /identity/v3/projects/8a7c7aeb805a4664809e875d1f78588d/users/2fd6cda01c8f43ea8002cfcc0ed968f0/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:37:34.032799 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e26523-d718-42bb-8702-ec69ddc9aaee None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:34.033135 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e26523-d718-42bb-8702-ec69ddc9aaee None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:34.033358 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e26523-d718-42bb-8702-ec69ddc9aaee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:34.072382 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-e3e26523-d718-42bb-8702-ec69ddc9aaee None None] MFA Rules not processed for user `2fd6cda01c8f43ea8002cfcc0ed968f0`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:37:34.074142 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-e3e26523-d718-42bb-8702-ec69ddc9aaee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:37:34.169694 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3614/7259] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:37:34 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:37:34.181383 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03825233-e05f-4706-a1ef-50db2067fd6d admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:37:34.183137 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-03825233-e05f-4706-a1ef-50db2067fd6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:37:34.245685 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03825233-e05f-4706-a1ef-50db2067fd6d admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:37:34.249338 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b897f91-086b-4abc-a167-167f7a45bed9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec5fd3a489c341b7964704d689037f05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:37:34.250067 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b897f91-086b-4abc-a167-167f7a45bed9 service cinder] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:34.250374 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b897f91-086b-4abc-a167-167f7a45bed9 service cinder] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:34.250628 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b897f91-086b-4abc-a167-167f7a45bed9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:34.311796 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b897f91-086b-4abc-a167-167f7a45bed9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:37:34.313273 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b897f91-086b-4abc-a167-167f7a45bed9 service cinder] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:37:34.323481 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3646/7260] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:37:34 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 23 21:37:35.939318 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e26523-d718-42bb-8702-ec69ddc9aaee None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:37:35.964215 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:37:36.032437 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e26523-d718-42bb-8702-ec69ddc9aaee None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:37:36.038770 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0c69bd-c4c0-456d-a8e9-aabb3cba0d9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:37:36.040107 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0c69bd-c4c0-456d-a8e9-aabb3cba0d9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:36.040454 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0c69bd-c4c0-456d-a8e9-aabb3cba0d9d admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:36.040792 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0c69bd-c4c0-456d-a8e9-aabb3cba0d9d admin admin] PATH_INFO: `/v3/users/b074381786134e4189d3e87f0b1ab6bb` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:36.042301 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0c69bd-c4c0-456d-a8e9-aabb3cba0d9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b074381786134e4189d3e87f0b1ab6bb)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:37:36.045845 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0c69bd-c4c0-456d-a8e9-aabb3cba0d9d admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:37:36.110469 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-cf0c69bd-c4c0-456d-a8e9-aabb3cba0d9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b074381786134e4189d3e87f0b1ab6bb'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:37:36.127977 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-cf0c69bd-c4c0-456d-a8e9-aabb3cba0d9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b074381786134e4189d3e87f0b1ab6bb'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:37:36.128737 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-cf0c69bd-c4c0-456d-a8e9-aabb3cba0d9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b074381786134e4189d3e87f0b1ab6bb'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:37:36.140084 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-cf0c69bd-c4c0-456d-a8e9-aabb3cba0d9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b074381786134e4189d3e87f0b1ab6bb'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:37:36.178752 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-cf0c69bd-c4c0-456d-a8e9-aabb3cba0d9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b074381786134e4189d3e87f0b1ab6bb'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:37:36.190771 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3615/7261] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:37:35 2022] DELETE /identity/v3/users/b074381786134e4189d3e87f0b1ab6bb => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:37:36.192628 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee70ed57-8b8e-459c-b0f3-054bfba36fae None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:36.193099 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee70ed57-8b8e-459c-b0f3-054bfba36fae None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:36.193329 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee70ed57-8b8e-459c-b0f3-054bfba36fae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:36.214890 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-ee70ed57-8b8e-459c-b0f3-054bfba36fae None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:37:36.216872 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-ee70ed57-8b8e-459c-b0f3-054bfba36fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:37:36.244755 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:37:36.300930 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3647/7262] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:37:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:37:36.314293 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0c69bd-c4c0-456d-a8e9-aabb3cba0d9d admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:37:36.316214 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-cf0c69bd-c4c0-456d-a8e9-aabb3cba0d9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:37:36.396320 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0c69bd-c4c0-456d-a8e9-aabb3cba0d9d admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:37:36.406066 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4ee682-7ee4-427d-a9ea-b544f5b54e7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:37:36.406731 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4ee682-7ee4-427d-a9ea-b544f5b54e7b service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:36.407014 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4ee682-7ee4-427d-a9ea-b544f5b54e7b service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:36.407291 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4ee682-7ee4-427d-a9ea-b544f5b54e7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:36.420121 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4ee682-7ee4-427d-a9ea-b544f5b54e7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:37:36.421752 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4ee682-7ee4-427d-a9ea-b544f5b54e7b service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:37:36.433054 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3616/7263] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:37:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:37:37.082218 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee70ed57-8b8e-459c-b0f3-054bfba36fae None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:37:37.083756 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-ee70ed57-8b8e-459c-b0f3-054bfba36fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:37:37.096751 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee70ed57-8b8e-459c-b0f3-054bfba36fae None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:37:37.102273 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1612f7f3-4f95-4d25-8df4-7abb18f4fc76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:37:37.103989 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1612f7f3-4f95-4d25-8df4-7abb18f4fc76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:37.104336 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1612f7f3-4f95-4d25-8df4-7abb18f4fc76 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:37.104701 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1612f7f3-4f95-4d25-8df4-7abb18f4fc76 admin admin] PATH_INFO: `/v3/projects/3f655bf75cc440738f3460479fc031e4` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:37.108264 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1612f7f3-4f95-4d25-8df4-7abb18f4fc76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f655bf75cc440738f3460479fc031e4)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:37:37.110321 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1612f7f3-4f95-4d25-8df4-7abb18f4fc76 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:37:37.184111 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-1612f7f3-4f95-4d25-8df4-7abb18f4fc76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f655bf75cc440738f3460479fc031e4', 'request_id': 'req-1612f7f3-4f95-4d25-8df4-7abb18f4fc76'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:37:37.198852 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-1612f7f3-4f95-4d25-8df4-7abb18f4fc76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f655bf75cc440738f3460479fc031e4', 'request_id': 'req-1612f7f3-4f95-4d25-8df4-7abb18f4fc76'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:37:37.207892 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-1612f7f3-4f95-4d25-8df4-7abb18f4fc76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f655bf75cc440738f3460479fc031e4', 'request_id': 'req-1612f7f3-4f95-4d25-8df4-7abb18f4fc76'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:37:37.223453 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-1612f7f3-4f95-4d25-8df4-7abb18f4fc76 admin admin] The token cache is being invalidate because project 3f655bf75cc440738f3460479fc031e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:37:37.223795 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-1612f7f3-4f95-4d25-8df4-7abb18f4fc76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:37:37.227250 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-1612f7f3-4f95-4d25-8df4-7abb18f4fc76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:37:37.229146 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3648/7264] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:37:37 2022] DELETE /identity/v3/projects/3f655bf75cc440738f3460479fc031e4 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:37:37.233740 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4ee682-7ee4-427d-a9ea-b544f5b54e7b service neutron] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:37:37.257304 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4ee682-7ee4-427d-a9ea-b544f5b54e7b service neutron] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:37:37.323425 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:37:37.370343 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5b28b2-b798-40d3-a7f2-43b8d3fac4f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:37:37.371401 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5b28b2-b798-40d3-a7f2-43b8d3fac4f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:37.371748 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5b28b2-b798-40d3-a7f2-43b8d3fac4f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:37.372087 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5b28b2-b798-40d3-a7f2-43b8d3fac4f9 admin admin] PATH_INFO: `/v3/users/2fd6cda01c8f43ea8002cfcc0ed968f0` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:37.373663 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5b28b2-b798-40d3-a7f2-43b8d3fac4f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2fd6cda01c8f43ea8002cfcc0ed968f0)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:37:37.375883 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5b28b2-b798-40d3-a7f2-43b8d3fac4f9 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:37:37.472232 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-2b5b28b2-b798-40d3-a7f2-43b8d3fac4f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2fd6cda01c8f43ea8002cfcc0ed968f0'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:37:37.504041 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-2b5b28b2-b798-40d3-a7f2-43b8d3fac4f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2fd6cda01c8f43ea8002cfcc0ed968f0'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:37:37.504822 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-2b5b28b2-b798-40d3-a7f2-43b8d3fac4f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2fd6cda01c8f43ea8002cfcc0ed968f0'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:37:37.519024 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-2b5b28b2-b798-40d3-a7f2-43b8d3fac4f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2fd6cda01c8f43ea8002cfcc0ed968f0'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:37:37.537530 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-2b5b28b2-b798-40d3-a7f2-43b8d3fac4f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2fd6cda01c8f43ea8002cfcc0ed968f0'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:37:37.545407 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3617/7265] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:37:37 2022] DELETE /identity/v3/users/2fd6cda01c8f43ea8002cfcc0ed968f0 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:37:38.048092 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1612f7f3-4f95-4d25-8df4-7abb18f4fc76 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:37:38.049675 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-1612f7f3-4f95-4d25-8df4-7abb18f4fc76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:37:38.066120 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1612f7f3-4f95-4d25-8df4-7abb18f4fc76 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:37:38.136101 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d35272d-55b1-4a9c-ab5e-5102243254ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:37:38.137679 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d35272d-55b1-4a9c-ab5e-5102243254ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:38.138325 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d35272d-55b1-4a9c-ab5e-5102243254ca admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:38.138759 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d35272d-55b1-4a9c-ab5e-5102243254ca admin admin] PATH_INFO: `/v3/projects/8a7c7aeb805a4664809e875d1f78588d` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:38.140620 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d35272d-55b1-4a9c-ab5e-5102243254ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a7c7aeb805a4664809e875d1f78588d)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:37:38.142860 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d35272d-55b1-4a9c-ab5e-5102243254ca admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:37:38.212319 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-8d35272d-55b1-4a9c-ab5e-5102243254ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a7c7aeb805a4664809e875d1f78588d', 'request_id': 'req-8d35272d-55b1-4a9c-ab5e-5102243254ca'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:37:38.214124 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:37:38.223261 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-8d35272d-55b1-4a9c-ab5e-5102243254ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a7c7aeb805a4664809e875d1f78588d', 'request_id': 'req-8d35272d-55b1-4a9c-ab5e-5102243254ca'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:37:38.230657 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-8d35272d-55b1-4a9c-ab5e-5102243254ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a7c7aeb805a4664809e875d1f78588d', 'request_id': 'req-8d35272d-55b1-4a9c-ab5e-5102243254ca'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:37:38.244229 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-8d35272d-55b1-4a9c-ab5e-5102243254ca admin admin] The token cache is being invalidate because project 8a7c7aeb805a4664809e875d1f78588d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:37:38.244520 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-8d35272d-55b1-4a9c-ab5e-5102243254ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:37:38.245181 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-8d35272d-55b1-4a9c-ab5e-5102243254ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:37:38.246988 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3649/7266] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:37:38 2022] DELETE /identity/v3/projects/8a7c7aeb805a4664809e875d1f78588d => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:37:38.262296 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76491037-ea89-49ac-b2c6-16b1fab77288 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:38.262879 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76491037-ea89-49ac-b2c6-16b1fab77288 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:38.262879 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76491037-ea89-49ac-b2c6-16b1fab77288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:38.283956 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-76491037-ea89-49ac-b2c6-16b1fab77288 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:37:38.285439 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-76491037-ea89-49ac-b2c6-16b1fab77288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:37:38.426403 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819c6bac-7e4f-4a4f-a437-57274c3a4ca1 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:38.426630 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3618/7267] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:37:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:37:38.426770 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819c6bac-7e4f-4a4f-a437-57274c3a4ca1 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:38.426890 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819c6bac-7e4f-4a4f-a437-57274c3a4ca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:38.463891 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-819c6bac-7e4f-4a4f-a437-57274c3a4ca1 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:37:38.465454 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-819c6bac-7e4f-4a4f-a437-57274c3a4ca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:37:38.483004 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3650/7268] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:37:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:37:38.488279 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76491037-ea89-49ac-b2c6-16b1fab77288 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:37:38.506688 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76491037-ea89-49ac-b2c6-16b1fab77288 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:37:38.520720 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6b45a2-4e46-40b3-8a70-b97a64e1ec64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:37:38.522670 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6b45a2-4e46-40b3-8a70-b97a64e1ec64 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:38.523833 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6b45a2-4e46-40b3-8a70-b97a64e1ec64 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:38.524185 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6b45a2-4e46-40b3-8a70-b97a64e1ec64 admin admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:38.525032 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6b45a2-4e46-40b3-8a70-b97a64e1ec64 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:37:38.525557 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6b45a2-4e46-40b3-8a70-b97a64e1ec64 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:37:38.528075 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6b45a2-4e46-40b3-8a70-b97a64e1ec64 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:37:38.549522 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3619/7269] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:37:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:37:38.554258 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819c6bac-7e4f-4a4f-a437-57274c3a4ca1 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:37:38.576421 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819c6bac-7e4f-4a4f-a437-57274c3a4ca1 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:37:38.593424 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c8598d-1cd0-4b78-a14b-fe4c4429f7a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:37:38.594593 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c8598d-1cd0-4b78-a14b-fe4c4429f7a6 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:38.594884 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c8598d-1cd0-4b78-a14b-fe4c4429f7a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:38.595160 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c8598d-1cd0-4b78-a14b-fe4c4429f7a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:38.595906 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c8598d-1cd0-4b78-a14b-fe4c4429f7a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:37:38.597945 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c8598d-1cd0-4b78-a14b-fe4c4429f7a6 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:37:38.664199 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3651/7270] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:37:38 2022] POST /identity/v3/projects => generated 385 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:37:38.664998 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6b45a2-4e46-40b3-8a70-b97a64e1ec64 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:37:38.681537 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6b45a2-4e46-40b3-8a70-b97a64e1ec64 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:37:38.787171 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:37:38.844084 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74558c39-60c8-4054-ac4b-0fe7757c065f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:37:38.845060 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74558c39-60c8-4054-ac4b-0fe7757c065f admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:38.845622 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74558c39-60c8-4054-ac4b-0fe7757c065f admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:38.846169 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74558c39-60c8-4054-ac4b-0fe7757c065f admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:38.846941 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74558c39-60c8-4054-ac4b-0fe7757c065f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:37:38.849418 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74558c39-60c8-4054-ac4b-0fe7757c065f admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:37:38.882277 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3620/7271] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:37:38 2022] POST /identity/v3/users => generated 293 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:37:38.885305 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c8598d-1cd0-4b78-a14b-fe4c4429f7a6 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:37:38.903157 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c8598d-1cd0-4b78-a14b-fe4c4429f7a6 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:37:38.908711 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819293d9-737f-4fbb-bbbe-ad3a6f2edc0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:37:38.910147 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819293d9-737f-4fbb-bbbe-ad3a6f2edc0d admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:38.910738 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819293d9-737f-4fbb-bbbe-ad3a6f2edc0d admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:38.910738 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819293d9-737f-4fbb-bbbe-ad3a6f2edc0d admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:38.911483 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819293d9-737f-4fbb-bbbe-ad3a6f2edc0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:37:38.913937 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819293d9-737f-4fbb-bbbe-ad3a6f2edc0d admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:37:38.941272 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3652/7272] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:37:38 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:37:38.942068 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74558c39-60c8-4054-ac4b-0fe7757c065f admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:37:38.956298 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74558c39-60c8-4054-ac4b-0fe7757c065f admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:37:38.961644 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f26e079-384d-4439-8219-80764b8fb921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:37:38.962502 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f26e079-384d-4439-8219-80764b8fb921 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:38.963322 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f26e079-384d-4439-8219-80764b8fb921 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:38.963322 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f26e079-384d-4439-8219-80764b8fb921 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:38.964080 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f26e079-384d-4439-8219-80764b8fb921 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:37:38.966058 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f26e079-384d-4439-8219-80764b8fb921 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:37:38.988575 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3621/7273] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:37:38 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:37:38.993255 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819293d9-737f-4fbb-bbbe-ad3a6f2edc0d admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:37:39.004275 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819293d9-737f-4fbb-bbbe-ad3a6f2edc0d admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:37:39.009956 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911b1ee0-38be-4cc1-8608-7b56116bbe36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:37:39.010133 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911b1ee0-38be-4cc1-8608-7b56116bbe36 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:39.010402 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911b1ee0-38be-4cc1-8608-7b56116bbe36 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:39.010591 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911b1ee0-38be-4cc1-8608-7b56116bbe36 admin admin] PATH_INFO: `/v3/projects/e59d48c5be2c4ab5bbfd06011f3ce456/users/e4e110dac01f43a6a86771494b86e806/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:39.029493 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911b1ee0-38be-4cc1-8608-7b56116bbe36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e59d48c5be2c4ab5bbfd06011f3ce456, user_id=e4e110dac01f43a6a86771494b86e806, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:37:39.032405 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911b1ee0-38be-4cc1-8608-7b56116bbe36 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:37:39.047720 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3653/7274] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:37:38 2022] PUT /identity/v3/projects/e59d48c5be2c4ab5bbfd06011f3ce456/users/e4e110dac01f43a6a86771494b86e806/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:37:39.058273 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e77384-37c4-4bcc-8cb5-a77d1ef2db96 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:39.058553 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e77384-37c4-4bcc-8cb5-a77d1ef2db96 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:39.058834 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e77384-37c4-4bcc-8cb5-a77d1ef2db96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:39.090598 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-38e77384-37c4-4bcc-8cb5-a77d1ef2db96 None None] MFA Rules not processed for user `e4e110dac01f43a6a86771494b86e806`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:37:39.091954 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-38e77384-37c4-4bcc-8cb5-a77d1ef2db96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:37:39.181550 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3622/7275] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:37:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:37:39.186311 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911b1ee0-38be-4cc1-8608-7b56116bbe36 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:37:39.262943 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911b1ee0-38be-4cc1-8608-7b56116bbe36 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:37:39.268379 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d56e369-e460-4629-aed4-306b4df99db8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:37:39.269260 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d56e369-e460-4629-aed4-306b4df99db8 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:39.269727 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d56e369-e460-4629-aed4-306b4df99db8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:39.270250 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d56e369-e460-4629-aed4-306b4df99db8 admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:39.271390 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d56e369-e460-4629-aed4-306b4df99db8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:37:39.273723 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d56e369-e460-4629-aed4-306b4df99db8 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:37:39.333429 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3654/7276] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:37:39 2022] POST /identity/v3/projects => generated 387 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:37:39.334448 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e77384-37c4-4bcc-8cb5-a77d1ef2db96 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:37:39.354657 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e77384-37c4-4bcc-8cb5-a77d1ef2db96 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:37:39.505714 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a9987c-a9c0-4fa9-aae5-b654101a753b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:37:39.511157 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a9987c-a9c0-4fa9-aae5-b654101a753b admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:39.511693 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a9987c-a9c0-4fa9-aae5-b654101a753b admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:39.512143 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a9987c-a9c0-4fa9-aae5-b654101a753b admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:39.513702 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a9987c-a9c0-4fa9-aae5-b654101a753b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:37:39.515910 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a9987c-a9c0-4fa9-aae5-b654101a753b admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:37:39.550725 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d56e369-e460-4629-aed4-306b4df99db8 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:37:39.561348 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3623/7277] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:37:39 2022] POST /identity/v3/users => generated 300 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:37:39.567460 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d56e369-e460-4629-aed4-306b4df99db8 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:37:39.574196 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a008471-cb89-40f6-befb-92a4e79c6c19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:37:39.575157 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a008471-cb89-40f6-befb-92a4e79c6c19 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:39.575689 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a008471-cb89-40f6-befb-92a4e79c6c19 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:39.576238 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a008471-cb89-40f6-befb-92a4e79c6c19 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:39.577799 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a008471-cb89-40f6-befb-92a4e79c6c19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:37:39.580315 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a008471-cb89-40f6-befb-92a4e79c6c19 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:37:39.606398 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a9987c-a9c0-4fa9-aae5-b654101a753b admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:37:39.606927 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3655/7278] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:37:39 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:37:39.619581 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a9987c-a9c0-4fa9-aae5-b654101a753b admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:37:39.626356 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4573aa-51ba-4b6c-a8b6-2e1f2eccb361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:37:39.627440 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4573aa-51ba-4b6c-a8b6-2e1f2eccb361 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:39.627843 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4573aa-51ba-4b6c-a8b6-2e1f2eccb361 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:39.628174 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4573aa-51ba-4b6c-a8b6-2e1f2eccb361 admin admin] PATH_INFO: `/v3/projects/32fafd1b88e1407b90968c3299115fe9/users/38437b08efc8452195d2743adfb369e3/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:39.652413 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4573aa-51ba-4b6c-a8b6-2e1f2eccb361 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32fafd1b88e1407b90968c3299115fe9, user_id=38437b08efc8452195d2743adfb369e3, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:37:39.657177 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4573aa-51ba-4b6c-a8b6-2e1f2eccb361 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:37:39.687394 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a008471-cb89-40f6-befb-92a4e79c6c19 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:37:39.688919 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3624/7279] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:37:39 2022] PUT /identity/v3/projects/32fafd1b88e1407b90968c3299115fe9/users/38437b08efc8452195d2743adfb369e3/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:37:39.719582 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a008471-cb89-40f6-befb-92a4e79c6c19 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:37:39.797686 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:INSERT=4,keystone:DELETE=3,keystone:SELECT=93 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:37:39.838952 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee056d0-46ee-462b-a145-7a845c5a0ad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:37:39.839750 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee056d0-46ee-462b-a145-7a845c5a0ad2 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:39.840109 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee056d0-46ee-462b-a145-7a845c5a0ad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:39.840653 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee056d0-46ee-462b-a145-7a845c5a0ad2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:39.842034 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee056d0-46ee-462b-a145-7a845c5a0ad2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:37:39.844170 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee056d0-46ee-462b-a145-7a845c5a0ad2 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:37:39.882985 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3656/7280] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:37:39 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:37:39.887081 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4573aa-51ba-4b6c-a8b6-2e1f2eccb361 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:37:39.903596 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4573aa-51ba-4b6c-a8b6-2e1f2eccb361 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:37:39.918076 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6e8795-1b6a-4edf-a879-2b16721bb76f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:37:39.919262 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6e8795-1b6a-4edf-a879-2b16721bb76f admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:39.919573 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6e8795-1b6a-4edf-a879-2b16721bb76f admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:39.919842 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6e8795-1b6a-4edf-a879-2b16721bb76f admin admin] PATH_INFO: `/v3/projects/32fafd1b88e1407b90968c3299115fe9/users/38437b08efc8452195d2743adfb369e3/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:39.923042 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6e8795-1b6a-4edf-a879-2b16721bb76f admin admin] RBAC: Authorizing `identity:create_grant(project_id=32fafd1b88e1407b90968c3299115fe9, user_id=38437b08efc8452195d2743adfb369e3, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:37:39.925752 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6e8795-1b6a-4edf-a879-2b16721bb76f admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:37:39.961192 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3625/7281] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:37:39 2022] PUT /identity/v3/projects/32fafd1b88e1407b90968c3299115fe9/users/38437b08efc8452195d2743adfb369e3/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:37:39.965228 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867fe8d4-fc59-4e84-a137-0132dcaee77a None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:39.972752 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867fe8d4-fc59-4e84-a137-0132dcaee77a None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:39.973241 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867fe8d4-fc59-4e84-a137-0132dcaee77a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:40.027161 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-867fe8d4-fc59-4e84-a137-0132dcaee77a None None] MFA Rules not processed for user `38437b08efc8452195d2743adfb369e3`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:37:40.028721 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-867fe8d4-fc59-4e84-a137-0132dcaee77a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:37:40.133761 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3657/7282] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:37:39 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:37:40.142456 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6e8795-1b6a-4edf-a879-2b16721bb76f admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:37:40.144468 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-1d6e8795-1b6a-4edf-a879-2b16721bb76f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:37:40.152517 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:37:40.238685 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6e8795-1b6a-4edf-a879-2b16721bb76f admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:37:40.243805 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db931340-6600-4ee7-87f8-57b452a7dcf8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec5fd3a489c341b7964704d689037f05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:37:40.244584 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db931340-6600-4ee7-87f8-57b452a7dcf8 service cinder] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:40.245186 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db931340-6600-4ee7-87f8-57b452a7dcf8 service cinder] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:40.245538 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db931340-6600-4ee7-87f8-57b452a7dcf8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:40.261418 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db931340-6600-4ee7-87f8-57b452a7dcf8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:37:40.264499 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db931340-6600-4ee7-87f8-57b452a7dcf8 service cinder] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:37:40.275542 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3626/7283] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:37:40 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:37:40.495441 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867fe8d4-fc59-4e84-a137-0132dcaee77a None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:37:40.595198 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867fe8d4-fc59-4e84-a137-0132dcaee77a None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:37:40.601274 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abccdd8-650c-43b4-b5e5-b6e2e540062a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:37:40.602579 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abccdd8-650c-43b4-b5e5-b6e2e540062a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:40.603100 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abccdd8-650c-43b4-b5e5-b6e2e540062a admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:40.603603 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abccdd8-650c-43b4-b5e5-b6e2e540062a admin admin] PATH_INFO: `/v3/users/e4e110dac01f43a6a86771494b86e806` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:40.606429 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abccdd8-650c-43b4-b5e5-b6e2e540062a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4e110dac01f43a6a86771494b86e806)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:37:40.608765 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abccdd8-650c-43b4-b5e5-b6e2e540062a admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:37:40.691799 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-7abccdd8-650c-43b4-b5e5-b6e2e540062a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4e110dac01f43a6a86771494b86e806'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:37:40.694390 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-7abccdd8-650c-43b4-b5e5-b6e2e540062a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4e110dac01f43a6a86771494b86e806'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:37:40.703624 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-7abccdd8-650c-43b4-b5e5-b6e2e540062a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4e110dac01f43a6a86771494b86e806'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:37:40.715623 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-7abccdd8-650c-43b4-b5e5-b6e2e540062a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4e110dac01f43a6a86771494b86e806'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:37:40.736651 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:37:40.746036 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-7abccdd8-650c-43b4-b5e5-b6e2e540062a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4e110dac01f43a6a86771494b86e806'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:37:40.759189 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3658/7284] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:37:40 2022] DELETE /identity/v3/users/e4e110dac01f43a6a86771494b86e806 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:37:40.764601 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feca0859-70ea-4cd7-85b8-2e4c9bb7fb6d None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:40.765539 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feca0859-70ea-4cd7-85b8-2e4c9bb7fb6d None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:40.766135 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feca0859-70ea-4cd7-85b8-2e4c9bb7fb6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:40.818529 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-feca0859-70ea-4cd7-85b8-2e4c9bb7fb6d None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:37:40.822621 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-feca0859-70ea-4cd7-85b8-2e4c9bb7fb6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:37:40.931383 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3627/7285] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:37:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:37:40.973712 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abccdd8-650c-43b4-b5e5-b6e2e540062a admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:37:40.975901 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-7abccdd8-650c-43b4-b5e5-b6e2e540062a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:37:41.116151 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abccdd8-650c-43b4-b5e5-b6e2e540062a admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:37:41.121717 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc8d34f-605e-4284-88df-705d6edc5f37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:37:41.123546 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc8d34f-605e-4284-88df-705d6edc5f37 service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:41.124036 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc8d34f-605e-4284-88df-705d6edc5f37 service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:41.124512 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc8d34f-605e-4284-88df-705d6edc5f37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:41.143418 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc8d34f-605e-4284-88df-705d6edc5f37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:37:41.145371 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc8d34f-605e-4284-88df-705d6edc5f37 service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:37:41.161164 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3659/7286] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:37:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:37:42.070469 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feca0859-70ea-4cd7-85b8-2e4c9bb7fb6d None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:37:42.072078 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-feca0859-70ea-4cd7-85b8-2e4c9bb7fb6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:37:42.091940 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feca0859-70ea-4cd7-85b8-2e4c9bb7fb6d None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:37:42.097068 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0c9dcb-de40-48ad-997f-54d4f4cef167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:37:42.098907 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0c9dcb-de40-48ad-997f-54d4f4cef167 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:42.099185 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0c9dcb-de40-48ad-997f-54d4f4cef167 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:42.099623 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0c9dcb-de40-48ad-997f-54d4f4cef167 admin admin] PATH_INFO: `/v3/projects/e59d48c5be2c4ab5bbfd06011f3ce456` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:42.101105 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0c9dcb-de40-48ad-997f-54d4f4cef167 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e59d48c5be2c4ab5bbfd06011f3ce456)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:37:42.103343 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0c9dcb-de40-48ad-997f-54d4f4cef167 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:37:42.173135 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-0e0c9dcb-de40-48ad-997f-54d4f4cef167 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e59d48c5be2c4ab5bbfd06011f3ce456', 'request_id': 'req-0e0c9dcb-de40-48ad-997f-54d4f4cef167'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:37:42.188815 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-0e0c9dcb-de40-48ad-997f-54d4f4cef167 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e59d48c5be2c4ab5bbfd06011f3ce456', 'request_id': 'req-0e0c9dcb-de40-48ad-997f-54d4f4cef167'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:37:42.196710 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-0e0c9dcb-de40-48ad-997f-54d4f4cef167 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e59d48c5be2c4ab5bbfd06011f3ce456', 'request_id': 'req-0e0c9dcb-de40-48ad-997f-54d4f4cef167'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:37:42.218710 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-0e0c9dcb-de40-48ad-997f-54d4f4cef167 admin admin] The token cache is being invalidate because project e59d48c5be2c4ab5bbfd06011f3ce456 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:37:42.219431 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-0e0c9dcb-de40-48ad-997f-54d4f4cef167 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:37:42.225073 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-0e0c9dcb-de40-48ad-997f-54d4f4cef167 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:37:42.229663 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3628/7287] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:37:42 2022] DELETE /identity/v3/projects/e59d48c5be2c4ab5bbfd06011f3ce456 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:37:42.233515 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc8d34f-605e-4284-88df-705d6edc5f37 service neutron] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:37:42.243838 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc8d34f-605e-4284-88df-705d6edc5f37 service neutron] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:37:42.325636 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c76161-a75d-4697-a07a-1276a0f08292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:37:42.327638 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c76161-a75d-4697-a07a-1276a0f08292 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:42.327925 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c76161-a75d-4697-a07a-1276a0f08292 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:42.328202 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c76161-a75d-4697-a07a-1276a0f08292 admin admin] PATH_INFO: `/v3/users/38437b08efc8452195d2743adfb369e3` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:42.329711 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c76161-a75d-4697-a07a-1276a0f08292 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38437b08efc8452195d2743adfb369e3)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:37:42.340757 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c76161-a75d-4697-a07a-1276a0f08292 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:37:42.457535 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-a2c76161-a75d-4697-a07a-1276a0f08292 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38437b08efc8452195d2743adfb369e3'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:37:42.459497 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-a2c76161-a75d-4697-a07a-1276a0f08292 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38437b08efc8452195d2743adfb369e3'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:37:42.474997 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-a2c76161-a75d-4697-a07a-1276a0f08292 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38437b08efc8452195d2743adfb369e3'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:37:42.491250 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-a2c76161-a75d-4697-a07a-1276a0f08292 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38437b08efc8452195d2743adfb369e3'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:37:42.516367 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-a2c76161-a75d-4697-a07a-1276a0f08292 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38437b08efc8452195d2743adfb369e3'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:37:42.526883 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3660/7288] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:37:42 2022] DELETE /identity/v3/users/38437b08efc8452195d2743adfb369e3 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:37:43.316211 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0c9dcb-de40-48ad-997f-54d4f4cef167 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:37:43.318456 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-0e0c9dcb-de40-48ad-997f-54d4f4cef167 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:37:43.339821 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0c9dcb-de40-48ad-997f-54d4f4cef167 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:37:43.421719 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:37:43.481133 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceae266a-06c4-4e4b-9523-cf14be3fd93b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:37:43.482283 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceae266a-06c4-4e4b-9523-cf14be3fd93b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:43.482574 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceae266a-06c4-4e4b-9523-cf14be3fd93b admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:43.482998 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceae266a-06c4-4e4b-9523-cf14be3fd93b admin admin] PATH_INFO: `/v3/projects/32fafd1b88e1407b90968c3299115fe9` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:43.484318 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceae266a-06c4-4e4b-9523-cf14be3fd93b admin admin] RBAC: Authorizing `identity:delete_project(project_id=32fafd1b88e1407b90968c3299115fe9)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:37:43.486619 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceae266a-06c4-4e4b-9523-cf14be3fd93b admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:37:43.571080 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-ceae266a-06c4-4e4b-9523-cf14be3fd93b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32fafd1b88e1407b90968c3299115fe9', 'request_id': 'req-ceae266a-06c4-4e4b-9523-cf14be3fd93b'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:37:43.585993 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-ceae266a-06c4-4e4b-9523-cf14be3fd93b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32fafd1b88e1407b90968c3299115fe9', 'request_id': 'req-ceae266a-06c4-4e4b-9523-cf14be3fd93b'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:37:43.601513 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-ceae266a-06c4-4e4b-9523-cf14be3fd93b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32fafd1b88e1407b90968c3299115fe9', 'request_id': 'req-ceae266a-06c4-4e4b-9523-cf14be3fd93b'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:37:43.618785 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-ceae266a-06c4-4e4b-9523-cf14be3fd93b admin admin] The token cache is being invalidate because project 32fafd1b88e1407b90968c3299115fe9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:37:43.619278 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-ceae266a-06c4-4e4b-9523-cf14be3fd93b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:37:43.620185 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-ceae266a-06c4-4e4b-9523-cf14be3fd93b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:37:43.622489 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3629/7289] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:37:43 2022] DELETE /identity/v3/projects/32fafd1b88e1407b90968c3299115fe9 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:37:43.627512 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cbe0c9-ef52-445e-bcc9-144b41df4434 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:43.628467 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cbe0c9-ef52-445e-bcc9-144b41df4434 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:43.628928 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cbe0c9-ef52-445e-bcc9-144b41df4434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:43.674898 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-b6cbe0c9-ef52-445e-bcc9-144b41df4434 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:37:43.676510 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-b6cbe0c9-ef52-445e-bcc9-144b41df4434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:37:43.684095 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:37:43.851228 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3661/7290] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:37:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:37:43.858993 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f1d3b6-8141-4330-ac92-cf14d43507c8 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:43.859378 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f1d3b6-8141-4330-ac92-cf14d43507c8 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:43.859732 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f1d3b6-8141-4330-ac92-cf14d43507c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:43.899440 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-e7f1d3b6-8141-4330-ac92-cf14d43507c8 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:37:43.901156 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-e7f1d3b6-8141-4330-ac92-cf14d43507c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:37:43.924283 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3630/7291] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:37:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:37:43.928451 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cbe0c9-ef52-445e-bcc9-144b41df4434 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:37:43.944386 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cbe0c9-ef52-445e-bcc9-144b41df4434 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:37:43.954527 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eb7615-6054-4229-8c6e-4cc623c2fc92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:37:43.955329 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eb7615-6054-4229-8c6e-4cc623c2fc92 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:43.956831 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eb7615-6054-4229-8c6e-4cc623c2fc92 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:43.957356 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eb7615-6054-4229-8c6e-4cc623c2fc92 admin admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:43.958227 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68eb7615-6054-4229-8c6e-4cc623c2fc92 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:37:43.958606 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68eb7615-6054-4229-8c6e-4cc623c2fc92 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:37:43.965529 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68eb7615-6054-4229-8c6e-4cc623c2fc92 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:37:43.989843 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f1d3b6-8141-4330-ac92-cf14d43507c8 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:37:43.997143 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3662/7292] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:37:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:37:44.003933 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f1d3b6-8141-4330-ac92-cf14d43507c8 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:37:44.013188 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b693ef-aff0-4403-8128-eb417b4adfed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:37:44.014039 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b693ef-aff0-4403-8128-eb417b4adfed admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:44.014416 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b693ef-aff0-4403-8128-eb417b4adfed admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:44.014808 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b693ef-aff0-4403-8128-eb417b4adfed admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:44.015604 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b693ef-aff0-4403-8128-eb417b4adfed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:37:44.017724 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b693ef-aff0-4403-8128-eb417b4adfed admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:37:44.083194 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3631/7293] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:37:43 2022] POST /identity/v3/projects => generated 379 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:37:44.087638 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eb7615-6054-4229-8c6e-4cc623c2fc92 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:37:44.101530 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eb7615-6054-4229-8c6e-4cc623c2fc92 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:37:44.165595 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d6d12f-6bc7-4c3a-b3b2-c70f5bee3c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:37:44.166283 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d6d12f-6bc7-4c3a-b3b2-c70f5bee3c22 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:44.166567 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d6d12f-6bc7-4c3a-b3b2-c70f5bee3c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:44.166850 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d6d12f-6bc7-4c3a-b3b2-c70f5bee3c22 admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:44.167637 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d6d12f-6bc7-4c3a-b3b2-c70f5bee3c22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:37:44.169800 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d6d12f-6bc7-4c3a-b3b2-c70f5bee3c22 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:37:44.200693 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3663/7294] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:37:44 2022] POST /identity/v3/users => generated 290 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:37:44.201997 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b693ef-aff0-4403-8128-eb417b4adfed admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:37:44.218023 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b693ef-aff0-4403-8128-eb417b4adfed admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:37:44.225616 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8141b8-6199-4e7b-b687-d75281134094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:37:44.227101 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8141b8-6199-4e7b-b687-d75281134094 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:44.227560 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8141b8-6199-4e7b-b687-d75281134094 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:44.228364 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8141b8-6199-4e7b-b687-d75281134094 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:44.253170 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8141b8-6199-4e7b-b687-d75281134094 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:37:44.261045 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8141b8-6199-4e7b-b687-d75281134094 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:37:44.294466 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3632/7295] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:37:44 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:37:44.295354 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d6d12f-6bc7-4c3a-b3b2-c70f5bee3c22 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:37:44.309118 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d6d12f-6bc7-4c3a-b3b2-c70f5bee3c22 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:37:44.324984 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97817ee6-444d-4d1f-a694-f3743fcae446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:37:44.326364 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97817ee6-444d-4d1f-a694-f3743fcae446 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:44.327032 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97817ee6-444d-4d1f-a694-f3743fcae446 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:44.327569 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97817ee6-444d-4d1f-a694-f3743fcae446 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:44.328699 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97817ee6-444d-4d1f-a694-f3743fcae446 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:37:44.330752 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97817ee6-444d-4d1f-a694-f3743fcae446 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:37:44.357988 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3664/7296] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:37:44 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 21:37:44.362309 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8141b8-6199-4e7b-b687-d75281134094 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:37:44.377388 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8141b8-6199-4e7b-b687-d75281134094 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:37:44.385044 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319bade3-6b52-441d-b775-69b1334fc07f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:37:44.386772 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319bade3-6b52-441d-b775-69b1334fc07f admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:44.388578 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319bade3-6b52-441d-b775-69b1334fc07f admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:44.389160 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319bade3-6b52-441d-b775-69b1334fc07f admin admin] PATH_INFO: `/v3/projects/135e43e0f7f940c297eb6b2b81ca7bff/users/e9e290f788324fd5b843ca99fab73086/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:44.412966 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319bade3-6b52-441d-b775-69b1334fc07f admin admin] RBAC: Authorizing `identity:create_grant(project_id=135e43e0f7f940c297eb6b2b81ca7bff, user_id=e9e290f788324fd5b843ca99fab73086, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:37:44.418430 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319bade3-6b52-441d-b775-69b1334fc07f admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:37:44.438286 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3633/7297] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:37:44 2022] PUT /identity/v3/projects/135e43e0f7f940c297eb6b2b81ca7bff/users/e9e290f788324fd5b843ca99fab73086/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:37:44.448788 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64413de-0063-4a2b-b3c2-2d0c5e674aec None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:44.449129 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64413de-0063-4a2b-b3c2-2d0c5e674aec None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:44.449471 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64413de-0063-4a2b-b3c2-2d0c5e674aec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:44.489089 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-b64413de-0063-4a2b-b3c2-2d0c5e674aec None None] MFA Rules not processed for user `e9e290f788324fd5b843ca99fab73086`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:37:44.490376 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-b64413de-0063-4a2b-b3c2-2d0c5e674aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:37:44.614300 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319bade3-6b52-441d-b775-69b1334fc07f admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:37:44.628890 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3665/7298] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:37:44 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:37:44.704294 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:37:44.710326 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319bade3-6b52-441d-b775-69b1334fc07f admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:37:44.716476 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde8a3ca-4f62-4771-9781-4358d4c0ba4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:37:44.717998 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde8a3ca-4f62-4771-9781-4358d4c0ba4f admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:44.719137 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde8a3ca-4f62-4771-9781-4358d4c0ba4f admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:44.719769 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde8a3ca-4f62-4771-9781-4358d4c0ba4f admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:44.720984 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde8a3ca-4f62-4771-9781-4358d4c0ba4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:37:44.724514 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde8a3ca-4f62-4771-9781-4358d4c0ba4f admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:37:44.779918 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3634/7299] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:37:44 2022] POST /identity/v3/projects => generated 379 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:37:44.781474 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64413de-0063-4a2b-b3c2-2d0c5e674aec None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:37:44.793111 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64413de-0063-4a2b-b3c2-2d0c5e674aec None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:37:44.797394 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:37:44.888192 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79aae9e0-ae36-4057-9c1c-f3d573ca4ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:37:44.888897 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aae9e0-ae36-4057-9c1c-f3d573ca4ea8 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:44.889177 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aae9e0-ae36-4057-9c1c-f3d573ca4ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:44.889451 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aae9e0-ae36-4057-9c1c-f3d573ca4ea8 admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:44.890850 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79aae9e0-ae36-4057-9c1c-f3d573ca4ea8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:37:44.892801 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79aae9e0-ae36-4057-9c1c-f3d573ca4ea8 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:37:44.922935 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3666/7300] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:37:44 2022] POST /identity/v3/users => generated 296 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:37:44.924386 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde8a3ca-4f62-4771-9781-4358d4c0ba4f admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:37:44.939900 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde8a3ca-4f62-4771-9781-4358d4c0ba4f admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:37:44.948615 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745b03f0-f083-443c-a316-8cea30056087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:37:44.949983 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745b03f0-f083-443c-a316-8cea30056087 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:44.950277 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745b03f0-f083-443c-a316-8cea30056087 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:44.950664 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745b03f0-f083-443c-a316-8cea30056087 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:44.951435 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745b03f0-f083-443c-a316-8cea30056087 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:37:44.953124 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745b03f0-f083-443c-a316-8cea30056087 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:37:44.973244 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3635/7301] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:37:44 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:37:44.975419 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79aae9e0-ae36-4057-9c1c-f3d573ca4ea8 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:37:44.999769 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79aae9e0-ae36-4057-9c1c-f3d573ca4ea8 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:37:45.006034 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91bc076-4ac2-425d-98fc-9b0100c375bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:37:45.007134 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91bc076-4ac2-425d-98fc-9b0100c375bf admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:45.007477 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91bc076-4ac2-425d-98fc-9b0100c375bf admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:45.007816 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91bc076-4ac2-425d-98fc-9b0100c375bf admin admin] PATH_INFO: `/v3/projects/e364aae0fc8c4130bfb6101a1f349fe1/users/671891b5615b4d7b9579b348d6ce7e99/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:45.032047 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91bc076-4ac2-425d-98fc-9b0100c375bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=e364aae0fc8c4130bfb6101a1f349fe1, user_id=671891b5615b4d7b9579b348d6ce7e99, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:37:45.035297 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91bc076-4ac2-425d-98fc-9b0100c375bf admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:37:45.058707 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3667/7302] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:37:44 2022] PUT /identity/v3/projects/e364aae0fc8c4130bfb6101a1f349fe1/users/671891b5615b4d7b9579b348d6ce7e99/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:37:45.060193 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745b03f0-f083-443c-a316-8cea30056087 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:37:45.075898 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745b03f0-f083-443c-a316-8cea30056087 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:37:45.175172 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcef0ef-9fa7-4891-a32f-2a0c20fc302e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:37:45.176738 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcef0ef-9fa7-4891-a32f-2a0c20fc302e admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:45.177465 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcef0ef-9fa7-4891-a32f-2a0c20fc302e admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:45.177465 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcef0ef-9fa7-4891-a32f-2a0c20fc302e admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:45.178478 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcef0ef-9fa7-4891-a32f-2a0c20fc302e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:37:45.180233 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcef0ef-9fa7-4891-a32f-2a0c20fc302e admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:37:45.198901 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3636/7303] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:37:45 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:37:45.201100 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91bc076-4ac2-425d-98fc-9b0100c375bf admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:37:45.214680 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91bc076-4ac2-425d-98fc-9b0100c375bf admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:37:45.220832 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011dc70b-5794-4e62-9f68-08f641384b35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:37:45.221956 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011dc70b-5794-4e62-9f68-08f641384b35 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:45.222519 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011dc70b-5794-4e62-9f68-08f641384b35 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:45.223197 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011dc70b-5794-4e62-9f68-08f641384b35 admin admin] PATH_INFO: `/v3/projects/e364aae0fc8c4130bfb6101a1f349fe1/users/671891b5615b4d7b9579b348d6ce7e99/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:45.225650 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011dc70b-5794-4e62-9f68-08f641384b35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e364aae0fc8c4130bfb6101a1f349fe1, user_id=671891b5615b4d7b9579b348d6ce7e99, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:37:45.229624 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011dc70b-5794-4e62-9f68-08f641384b35 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:37:45.257892 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3668/7304] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:37:45 2022] PUT /identity/v3/projects/e364aae0fc8c4130bfb6101a1f349fe1/users/671891b5615b4d7b9579b348d6ce7e99/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:37:45.379427 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ac95dd-b7c3-4136-b369-12d2931d61df None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:45.381010 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ac95dd-b7c3-4136-b369-12d2931d61df None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:45.381558 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ac95dd-b7c3-4136-b369-12d2931d61df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:45.456804 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-b0ac95dd-b7c3-4136-b369-12d2931d61df None None] MFA Rules not processed for user `671891b5615b4d7b9579b348d6ce7e99`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:37:45.458071 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-b0ac95dd-b7c3-4136-b369-12d2931d61df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:37:45.611791 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3637/7305] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:37:45 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:37:45.630418 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011dc70b-5794-4e62-9f68-08f641384b35 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:37:45.632737 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-011dc70b-5794-4e62-9f68-08f641384b35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:37:45.740906 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011dc70b-5794-4e62-9f68-08f641384b35 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:37:45.753335 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6303fa1-5526-4cb9-9417-169bb5a7c6be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec5fd3a489c341b7964704d689037f05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:37:45.754330 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6303fa1-5526-4cb9-9417-169bb5a7c6be service cinder] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:45.760386 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6303fa1-5526-4cb9-9417-169bb5a7c6be service cinder] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:45.763629 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6303fa1-5526-4cb9-9417-169bb5a7c6be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:45.796909 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6303fa1-5526-4cb9-9417-169bb5a7c6be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:37:45.798630 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6303fa1-5526-4cb9-9417-169bb5a7c6be service cinder] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:37:45.813497 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3669/7306] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:37:45 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:37:46.421483 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ac95dd-b7c3-4136-b369-12d2931d61df None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:37:46.439818 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ac95dd-b7c3-4136-b369-12d2931d61df None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:37:46.447397 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f228e81-4db6-4f34-a0fd-7b1baf7728e7 tempest-VolumeQuotaClassesTest-998968992 tempest-VolumeQuotaClassesTest-998968992-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '671891b5615b4d7b9579b348d6ce7e99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e364aae0fc8c4130bfb6101a1f349fe1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:37:46.448445 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f228e81-4db6-4f34-a0fd-7b1baf7728e7 tempest-VolumeQuotaClassesTest-998968992 tempest-VolumeQuotaClassesTest-998968992-project-admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:46.448944 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f228e81-4db6-4f34-a0fd-7b1baf7728e7 tempest-VolumeQuotaClassesTest-998968992 tempest-VolumeQuotaClassesTest-998968992-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:46.449477 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f228e81-4db6-4f34-a0fd-7b1baf7728e7 tempest-VolumeQuotaClassesTest-998968992 tempest-VolumeQuotaClassesTest-998968992-project-admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:46.450588 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f228e81-4db6-4f34-a0fd-7b1baf7728e7 tempest-VolumeQuotaClassesTest-998968992 tempest-VolumeQuotaClassesTest-998968992-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:37:46.451131 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f228e81-4db6-4f34-a0fd-7b1baf7728e7 tempest-VolumeQuotaClassesTest-998968992 tempest-VolumeQuotaClassesTest-998968992-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:37:46.453332 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f228e81-4db6-4f34-a0fd-7b1baf7728e7 tempest-VolumeQuotaClassesTest-998968992 tempest-VolumeQuotaClassesTest-998968992-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:37:46.470957 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3638/7307] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:37:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 21:37:46.475654 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6303fa1-5526-4cb9-9417-169bb5a7c6be service cinder] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:37:46.485772 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6303fa1-5526-4cb9-9417-169bb5a7c6be service cinder] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:37:46.490866 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3117be1-6430-42a5-91dd-d6ea6e6d5538 tempest-VolumeQuotaClassesTest-998968992 tempest-VolumeQuotaClassesTest-998968992-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '671891b5615b4d7b9579b348d6ce7e99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e364aae0fc8c4130bfb6101a1f349fe1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:37:46.491561 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3117be1-6430-42a5-91dd-d6ea6e6d5538 tempest-VolumeQuotaClassesTest-998968992 tempest-VolumeQuotaClassesTest-998968992-project-admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:46.491850 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3117be1-6430-42a5-91dd-d6ea6e6d5538 tempest-VolumeQuotaClassesTest-998968992 tempest-VolumeQuotaClassesTest-998968992-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:46.492192 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3117be1-6430-42a5-91dd-d6ea6e6d5538 tempest-VolumeQuotaClassesTest-998968992 tempest-VolumeQuotaClassesTest-998968992-project-admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:46.492899 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3117be1-6430-42a5-91dd-d6ea6e6d5538 tempest-VolumeQuotaClassesTest-998968992 tempest-VolumeQuotaClassesTest-998968992-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:37:46.494888 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3117be1-6430-42a5-91dd-d6ea6e6d5538 tempest-VolumeQuotaClassesTest-998968992 tempest-VolumeQuotaClassesTest-998968992-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:37:46.530720 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3670/7308] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:37:46 2022] POST /identity/v3/projects => generated 355 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:37:46.535490 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f228e81-4db6-4f34-a0fd-7b1baf7728e7 tempest-VolumeQuotaClassesTest-998968992 tempest-VolumeQuotaClassesTest-998968992-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:37:46.548206 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f228e81-4db6-4f34-a0fd-7b1baf7728e7 tempest-VolumeQuotaClassesTest-998968992 tempest-VolumeQuotaClassesTest-998968992-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:37:46.604842 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:37:46.635513 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc18df33-72c1-4f7b-9830-9e06d8b5928a tempest-VolumeQuotaClassesTest-998968992 tempest-VolumeQuotaClassesTest-998968992-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '671891b5615b4d7b9579b348d6ce7e99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e364aae0fc8c4130bfb6101a1f349fe1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:37:46.636646 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc18df33-72c1-4f7b-9830-9e06d8b5928a tempest-VolumeQuotaClassesTest-998968992 tempest-VolumeQuotaClassesTest-998968992-project-admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:46.638160 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc18df33-72c1-4f7b-9830-9e06d8b5928a tempest-VolumeQuotaClassesTest-998968992 tempest-VolumeQuotaClassesTest-998968992-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:46.638674 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc18df33-72c1-4f7b-9830-9e06d8b5928a tempest-VolumeQuotaClassesTest-998968992 tempest-VolumeQuotaClassesTest-998968992-project-admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:46.640022 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc18df33-72c1-4f7b-9830-9e06d8b5928a tempest-VolumeQuotaClassesTest-998968992 tempest-VolumeQuotaClassesTest-998968992-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:37:46.640784 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc18df33-72c1-4f7b-9830-9e06d8b5928a tempest-VolumeQuotaClassesTest-998968992 tempest-VolumeQuotaClassesTest-998968992-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:37:46.643576 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc18df33-72c1-4f7b-9830-9e06d8b5928a tempest-VolumeQuotaClassesTest-998968992 tempest-VolumeQuotaClassesTest-998968992-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:37:46.663404 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3639/7309] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:37:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:37:46.714368 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3117be1-6430-42a5-91dd-d6ea6e6d5538 tempest-VolumeQuotaClassesTest-998968992 tempest-VolumeQuotaClassesTest-998968992-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:37:46.728544 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3117be1-6430-42a5-91dd-d6ea6e6d5538 tempest-VolumeQuotaClassesTest-998968992 tempest-VolumeQuotaClassesTest-998968992-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:37:46.745150 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dec97d3-d75b-48b6-9141-e9f1d743fa1e tempest-VolumeQuotaClassesTest-998968992 tempest-VolumeQuotaClassesTest-998968992-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '671891b5615b4d7b9579b348d6ce7e99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e364aae0fc8c4130bfb6101a1f349fe1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:37:46.750394 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dec97d3-d75b-48b6-9141-e9f1d743fa1e tempest-VolumeQuotaClassesTest-998968992 tempest-VolumeQuotaClassesTest-998968992-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:46.751587 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dec97d3-d75b-48b6-9141-e9f1d743fa1e tempest-VolumeQuotaClassesTest-998968992 tempest-VolumeQuotaClassesTest-998968992-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:46.752178 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dec97d3-d75b-48b6-9141-e9f1d743fa1e tempest-VolumeQuotaClassesTest-998968992 tempest-VolumeQuotaClassesTest-998968992-project-admin] PATH_INFO: `/v3/projects/897fb670a380447c91d9dc5839beca85` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:46.756758 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dec97d3-d75b-48b6-9141-e9f1d743fa1e tempest-VolumeQuotaClassesTest-998968992 tempest-VolumeQuotaClassesTest-998968992-project-admin] RBAC: Authorizing `identity:delete_project(project_id=897fb670a380447c91d9dc5839beca85)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:37:46.759380 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dec97d3-d75b-48b6-9141-e9f1d743fa1e tempest-VolumeQuotaClassesTest-998968992 tempest-VolumeQuotaClassesTest-998968992-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:37:46.852024 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=92,keystone:INSERT=6,keystone:DELETE=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:37:46.868280 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-6dec97d3-d75b-48b6-9141-e9f1d743fa1e tempest-VolumeQuotaClassesTest-998968992 tempest-VolumeQuotaClassesTest-998968992-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '897fb670a380447c91d9dc5839beca85', 'request_id': 'req-6dec97d3-d75b-48b6-9141-e9f1d743fa1e'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:37:46.882621 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-6dec97d3-d75b-48b6-9141-e9f1d743fa1e tempest-VolumeQuotaClassesTest-998968992 tempest-VolumeQuotaClassesTest-998968992-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '897fb670a380447c91d9dc5839beca85', 'request_id': 'req-6dec97d3-d75b-48b6-9141-e9f1d743fa1e'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:37:46.893490 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-6dec97d3-d75b-48b6-9141-e9f1d743fa1e tempest-VolumeQuotaClassesTest-998968992 tempest-VolumeQuotaClassesTest-998968992-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '897fb670a380447c91d9dc5839beca85', 'request_id': 'req-6dec97d3-d75b-48b6-9141-e9f1d743fa1e'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:37:46.911451 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-6dec97d3-d75b-48b6-9141-e9f1d743fa1e tempest-VolumeQuotaClassesTest-998968992 tempest-VolumeQuotaClassesTest-998968992-project-admin] The token cache is being invalidate because project 897fb670a380447c91d9dc5839beca85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:37:46.911798 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-6dec97d3-d75b-48b6-9141-e9f1d743fa1e tempest-VolumeQuotaClassesTest-998968992 tempest-VolumeQuotaClassesTest-998968992-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:37:46.912924 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-6dec97d3-d75b-48b6-9141-e9f1d743fa1e tempest-VolumeQuotaClassesTest-998968992 tempest-VolumeQuotaClassesTest-998968992-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:37:46.914606 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3671/7310] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:37:46 2022] DELETE /identity/v3/projects/897fb670a380447c91d9dc5839beca85 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:37:47.207117 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc18df33-72c1-4f7b-9830-9e06d8b5928a tempest-VolumeQuotaClassesTest-998968992 tempest-VolumeQuotaClassesTest-998968992-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:37:47.208891 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-dc18df33-72c1-4f7b-9830-9e06d8b5928a tempest-VolumeQuotaClassesTest-998968992 tempest-VolumeQuotaClassesTest-998968992-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:37:47.305761 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc18df33-72c1-4f7b-9830-9e06d8b5928a tempest-VolumeQuotaClassesTest-998968992 tempest-VolumeQuotaClassesTest-998968992-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:37:47.402559 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00cb1d7-5ff9-4116-b024-481d0b008496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:37:47.402559 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00cb1d7-5ff9-4116-b024-481d0b008496 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:47.403124 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00cb1d7-5ff9-4116-b024-481d0b008496 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:47.403305 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00cb1d7-5ff9-4116-b024-481d0b008496 admin admin] PATH_INFO: `/v3/users/e9e290f788324fd5b843ca99fab73086` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:47.404816 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00cb1d7-5ff9-4116-b024-481d0b008496 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9e290f788324fd5b843ca99fab73086)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:37:47.407275 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00cb1d7-5ff9-4116-b024-481d0b008496 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:37:47.562672 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-d00cb1d7-5ff9-4116-b024-481d0b008496 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9e290f788324fd5b843ca99fab73086'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:37:47.578048 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-d00cb1d7-5ff9-4116-b024-481d0b008496 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9e290f788324fd5b843ca99fab73086'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:37:47.580979 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-d00cb1d7-5ff9-4116-b024-481d0b008496 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9e290f788324fd5b843ca99fab73086'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:37:47.598770 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-d00cb1d7-5ff9-4116-b024-481d0b008496 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9e290f788324fd5b843ca99fab73086'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:37:47.618959 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-d00cb1d7-5ff9-4116-b024-481d0b008496 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9e290f788324fd5b843ca99fab73086'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:37:47.621241 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:37:47.633230 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317da43f-037c-46e2-89e4-8e52e6c5f541 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:47.633537 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317da43f-037c-46e2-89e4-8e52e6c5f541 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:47.633815 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317da43f-037c-46e2-89e4-8e52e6c5f541 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:47.633975 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3640/7311] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:37:47 2022] DELETE /identity/v3/users/e9e290f788324fd5b843ca99fab73086 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:37:47.665883 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-317da43f-037c-46e2-89e4-8e52e6c5f541 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:37:47.667685 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-317da43f-037c-46e2-89e4-8e52e6c5f541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:37:47.768698 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3672/7312] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:37:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:37:47.882719 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00cb1d7-5ff9-4116-b024-481d0b008496 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:37:47.885048 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-d00cb1d7-5ff9-4116-b024-481d0b008496 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:37:47.960605 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00cb1d7-5ff9-4116-b024-481d0b008496 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:37:47.966874 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e779f2-5164-4946-9a7f-6c7df1aa43c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:37:47.968050 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e779f2-5164-4946-9a7f-6c7df1aa43c9 service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:47.968978 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e779f2-5164-4946-9a7f-6c7df1aa43c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:47.969327 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e779f2-5164-4946-9a7f-6c7df1aa43c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:47.987933 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e779f2-5164-4946-9a7f-6c7df1aa43c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:37:47.989490 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e779f2-5164-4946-9a7f-6c7df1aa43c9 service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:37:48.001189 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3641/7313] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:37:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:37:48.809339 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317da43f-037c-46e2-89e4-8e52e6c5f541 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:37:48.814816 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-317da43f-037c-46e2-89e4-8e52e6c5f541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:37:48.843682 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317da43f-037c-46e2-89e4-8e52e6c5f541 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:37:48.862171 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61827296-74e8-42cf-a8fa-29b447044d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:37:48.863415 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61827296-74e8-42cf-a8fa-29b447044d10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:48.864055 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61827296-74e8-42cf-a8fa-29b447044d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:48.864939 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61827296-74e8-42cf-a8fa-29b447044d10 admin admin] PATH_INFO: `/v3/projects/135e43e0f7f940c297eb6b2b81ca7bff` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:48.868161 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61827296-74e8-42cf-a8fa-29b447044d10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=135e43e0f7f940c297eb6b2b81ca7bff)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:37:48.872465 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61827296-74e8-42cf-a8fa-29b447044d10 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:37:49.011447 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-61827296-74e8-42cf-a8fa-29b447044d10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '135e43e0f7f940c297eb6b2b81ca7bff', 'request_id': 'req-61827296-74e8-42cf-a8fa-29b447044d10'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:37:49.033792 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-61827296-74e8-42cf-a8fa-29b447044d10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '135e43e0f7f940c297eb6b2b81ca7bff', 'request_id': 'req-61827296-74e8-42cf-a8fa-29b447044d10'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:37:49.044117 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-61827296-74e8-42cf-a8fa-29b447044d10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '135e43e0f7f940c297eb6b2b81ca7bff', 'request_id': 'req-61827296-74e8-42cf-a8fa-29b447044d10'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:37:49.059118 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-61827296-74e8-42cf-a8fa-29b447044d10 admin admin] The token cache is being invalidate because project 135e43e0f7f940c297eb6b2b81ca7bff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:37:49.059738 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-61827296-74e8-42cf-a8fa-29b447044d10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:37:49.061216 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-61827296-74e8-42cf-a8fa-29b447044d10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:37:49.063765 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3673/7314] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:37:48 2022] DELETE /identity/v3/projects/135e43e0f7f940c297eb6b2b81ca7bff => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:37:49.067933 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e779f2-5164-4946-9a7f-6c7df1aa43c9 service neutron] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:37:49.094646 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e779f2-5164-4946-9a7f-6c7df1aa43c9 service neutron] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:37:49.176997 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799f704c-afe4-47e5-a39e-624591d0138d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:37:49.178743 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799f704c-afe4-47e5-a39e-624591d0138d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:49.179439 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799f704c-afe4-47e5-a39e-624591d0138d admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:49.179725 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799f704c-afe4-47e5-a39e-624591d0138d admin admin] PATH_INFO: `/v3/users/671891b5615b4d7b9579b348d6ce7e99` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:49.181469 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799f704c-afe4-47e5-a39e-624591d0138d admin admin] RBAC: Authorizing `identity:delete_user(user_id=671891b5615b4d7b9579b348d6ce7e99)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:37:49.184199 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799f704c-afe4-47e5-a39e-624591d0138d admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:37:49.283405 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-799f704c-afe4-47e5-a39e-624591d0138d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '671891b5615b4d7b9579b348d6ce7e99'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:37:49.299126 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-799f704c-afe4-47e5-a39e-624591d0138d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '671891b5615b4d7b9579b348d6ce7e99'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:37:49.299740 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-799f704c-afe4-47e5-a39e-624591d0138d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '671891b5615b4d7b9579b348d6ce7e99'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:37:49.312582 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-799f704c-afe4-47e5-a39e-624591d0138d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '671891b5615b4d7b9579b348d6ce7e99'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:37:49.329904 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-799f704c-afe4-47e5-a39e-624591d0138d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '671891b5615b4d7b9579b348d6ce7e99'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:37:49.340269 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3642/7315] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:37:49 2022] DELETE /identity/v3/users/671891b5615b4d7b9579b348d6ce7e99 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:37:50.055502 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61827296-74e8-42cf-a8fa-29b447044d10 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:37:50.059450 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-61827296-74e8-42cf-a8fa-29b447044d10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:37:50.094733 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61827296-74e8-42cf-a8fa-29b447044d10 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:37:50.167722 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:37:50.189383 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a430ec-6525-4c04-977f-92a11e78c9e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:37:50.190476 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a430ec-6525-4c04-977f-92a11e78c9e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:50.190951 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a430ec-6525-4c04-977f-92a11e78c9e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:50.191228 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a430ec-6525-4c04-977f-92a11e78c9e0 admin admin] PATH_INFO: `/v3/projects/e364aae0fc8c4130bfb6101a1f349fe1` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:50.192739 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a430ec-6525-4c04-977f-92a11e78c9e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e364aae0fc8c4130bfb6101a1f349fe1)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:37:50.194745 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a430ec-6525-4c04-977f-92a11e78c9e0 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:37:50.292614 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c2a430ec-6525-4c04-977f-92a11e78c9e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e364aae0fc8c4130bfb6101a1f349fe1', 'request_id': 'req-c2a430ec-6525-4c04-977f-92a11e78c9e0'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:37:50.305722 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c2a430ec-6525-4c04-977f-92a11e78c9e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e364aae0fc8c4130bfb6101a1f349fe1', 'request_id': 'req-c2a430ec-6525-4c04-977f-92a11e78c9e0'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:37:50.313731 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c2a430ec-6525-4c04-977f-92a11e78c9e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e364aae0fc8c4130bfb6101a1f349fe1', 'request_id': 'req-c2a430ec-6525-4c04-977f-92a11e78c9e0'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:37:50.327814 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c2a430ec-6525-4c04-977f-92a11e78c9e0 admin admin] The token cache is being invalidate because project e364aae0fc8c4130bfb6101a1f349fe1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:37:50.328674 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c2a430ec-6525-4c04-977f-92a11e78c9e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:37:50.329618 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c2a430ec-6525-4c04-977f-92a11e78c9e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:37:50.334863 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3674/7316] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:37:50 2022] DELETE /identity/v3/projects/e364aae0fc8c4130bfb6101a1f349fe1 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:37:50.337104 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46bc3c0-4b2f-4586-858e-2eef6d325e7b None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:50.338129 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46bc3c0-4b2f-4586-858e-2eef6d325e7b None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:50.339018 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46bc3c0-4b2f-4586-858e-2eef6d325e7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:50.360309 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-a46bc3c0-4b2f-4586-858e-2eef6d325e7b None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:37:50.362024 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-a46bc3c0-4b2f-4586-858e-2eef6d325e7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:37:50.383017 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:37:50.433606 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3643/7317] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:37:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:37:50.442529 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feddec58-cc01-4f59-ba2d-feaefc945b81 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:50.442820 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feddec58-cc01-4f59-ba2d-feaefc945b81 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:50.443095 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feddec58-cc01-4f59-ba2d-feaefc945b81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:50.463331 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-feddec58-cc01-4f59-ba2d-feaefc945b81 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:37:50.464615 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-feddec58-cc01-4f59-ba2d-feaefc945b81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:37:50.474964 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3675/7318] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:37:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:37:50.479263 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46bc3c0-4b2f-4586-858e-2eef6d325e7b None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:37:50.490766 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46bc3c0-4b2f-4586-858e-2eef6d325e7b None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:37:50.498291 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e541c0dc-4c23-4839-858f-1b2e65f16125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:37:50.498995 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e541c0dc-4c23-4839-858f-1b2e65f16125 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:50.499268 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e541c0dc-4c23-4839-858f-1b2e65f16125 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:50.499549 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e541c0dc-4c23-4839-858f-1b2e65f16125 admin admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:50.500328 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e541c0dc-4c23-4839-858f-1b2e65f16125 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:37:50.500631 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e541c0dc-4c23-4839-858f-1b2e65f16125 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:37:50.502313 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e541c0dc-4c23-4839-858f-1b2e65f16125 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:37:50.515149 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3644/7319] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:37:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:37:50.520056 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feddec58-cc01-4f59-ba2d-feaefc945b81 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:37:50.534265 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feddec58-cc01-4f59-ba2d-feaefc945b81 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:37:50.539862 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b84607-df25-4ec7-bd03-ff02def9af59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:37:50.540776 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b84607-df25-4ec7-bd03-ff02def9af59 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:50.541155 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b84607-df25-4ec7-bd03-ff02def9af59 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:50.541537 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b84607-df25-4ec7-bd03-ff02def9af59 admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:50.542374 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b84607-df25-4ec7-bd03-ff02def9af59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:37:50.550414 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b84607-df25-4ec7-bd03-ff02def9af59 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:37:50.599350 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3676/7320] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:37:50 2022] POST /identity/v3/projects => generated 391 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:37:50.600565 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e541c0dc-4c23-4839-858f-1b2e65f16125 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:37:50.618904 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e541c0dc-4c23-4839-858f-1b2e65f16125 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:37:50.706162 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89808b89-26eb-4701-89c8-c7ee349b2958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:37:50.706983 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89808b89-26eb-4701-89c8-c7ee349b2958 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:50.707273 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89808b89-26eb-4701-89c8-c7ee349b2958 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:50.707672 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89808b89-26eb-4701-89c8-c7ee349b2958 admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:50.708361 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89808b89-26eb-4701-89c8-c7ee349b2958 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:37:50.710308 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89808b89-26eb-4701-89c8-c7ee349b2958 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:37:50.736029 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3645/7321] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:37:50 2022] POST /identity/v3/users => generated 296 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:37:50.740120 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b84607-df25-4ec7-bd03-ff02def9af59 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:37:50.750964 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b84607-df25-4ec7-bd03-ff02def9af59 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:37:50.755926 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa593697-b2c6-4fdd-99bf-5c4aefd3822c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:37:50.756685 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa593697-b2c6-4fdd-99bf-5c4aefd3822c admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:50.757033 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa593697-b2c6-4fdd-99bf-5c4aefd3822c admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:50.757553 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa593697-b2c6-4fdd-99bf-5c4aefd3822c admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:50.758282 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa593697-b2c6-4fdd-99bf-5c4aefd3822c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:37:50.759957 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa593697-b2c6-4fdd-99bf-5c4aefd3822c admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:37:50.774070 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3677/7322] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:37:50 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:37:50.776089 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89808b89-26eb-4701-89c8-c7ee349b2958 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:37:50.786798 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89808b89-26eb-4701-89c8-c7ee349b2958 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:37:50.795510 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2ec921-4fed-4dd1-b588-f453747fedf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:37:50.796514 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2ec921-4fed-4dd1-b588-f453747fedf0 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:50.796514 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2ec921-4fed-4dd1-b588-f453747fedf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:50.796761 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2ec921-4fed-4dd1-b588-f453747fedf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:50.797493 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2ec921-4fed-4dd1-b588-f453747fedf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:37:50.799315 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2ec921-4fed-4dd1-b588-f453747fedf0 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:37:50.813782 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3646/7323] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:37:50 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:37:50.814972 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa593697-b2c6-4fdd-99bf-5c4aefd3822c admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:37:50.827894 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa593697-b2c6-4fdd-99bf-5c4aefd3822c admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:37:50.834169 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a35fd95-1320-47be-b5f8-ecf116a3428f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:37:50.835525 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a35fd95-1320-47be-b5f8-ecf116a3428f admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:50.835984 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a35fd95-1320-47be-b5f8-ecf116a3428f admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:50.836839 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a35fd95-1320-47be-b5f8-ecf116a3428f admin admin] PATH_INFO: `/v3/projects/2212ee77aa804227b2aa6dfb9fe60799/users/ae42760d36b2471a8886b3a5edc970c5/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:50.858418 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a35fd95-1320-47be-b5f8-ecf116a3428f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2212ee77aa804227b2aa6dfb9fe60799, user_id=ae42760d36b2471a8886b3a5edc970c5, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:37:50.864909 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a35fd95-1320-47be-b5f8-ecf116a3428f admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:37:50.883253 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3678/7324] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:37:50 2022] PUT /identity/v3/projects/2212ee77aa804227b2aa6dfb9fe60799/users/ae42760d36b2471a8886b3a5edc970c5/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:37:50.894536 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca0bee8-d6b1-4c9d-804c-d595f0382a09 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:50.895031 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca0bee8-d6b1-4c9d-804c-d595f0382a09 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:50.895448 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca0bee8-d6b1-4c9d-804c-d595f0382a09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:50.940095 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-7ca0bee8-d6b1-4c9d-804c-d595f0382a09 None None] MFA Rules not processed for user `ae42760d36b2471a8886b3a5edc970c5`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:37:50.941385 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-7ca0bee8-d6b1-4c9d-804c-d595f0382a09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:37:51.032770 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3647/7325] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:37:50 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:37:51.034067 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a35fd95-1320-47be-b5f8-ecf116a3428f admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:37:51.116492 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a35fd95-1320-47be-b5f8-ecf116a3428f admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:37:51.122070 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604fc39c-5be9-4547-b5ca-453badf6dc3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:37:51.123531 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604fc39c-5be9-4547-b5ca-453badf6dc3c admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:51.123921 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604fc39c-5be9-4547-b5ca-453badf6dc3c admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:51.124509 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604fc39c-5be9-4547-b5ca-453badf6dc3c admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:51.125319 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604fc39c-5be9-4547-b5ca-453badf6dc3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:37:51.128181 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604fc39c-5be9-4547-b5ca-453badf6dc3c admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:37:51.164715 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:37:51.185932 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3679/7326] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:37:51 2022] POST /identity/v3/projects => generated 389 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:37:51.188642 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca0bee8-d6b1-4c9d-804c-d595f0382a09 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:37:51.211113 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca0bee8-d6b1-4c9d-804c-d595f0382a09 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:37:51.231305 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:37:51.299132 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33bf32d-4ee1-4f48-9976-46a25b168043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:37:51.299837 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33bf32d-4ee1-4f48-9976-46a25b168043 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:51.300118 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33bf32d-4ee1-4f48-9976-46a25b168043 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:51.300397 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33bf32d-4ee1-4f48-9976-46a25b168043 admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:51.301246 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33bf32d-4ee1-4f48-9976-46a25b168043 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:37:51.303429 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33bf32d-4ee1-4f48-9976-46a25b168043 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:37:51.327511 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3648/7327] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:37:51 2022] POST /identity/v3/users => generated 301 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:37:51.331687 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604fc39c-5be9-4547-b5ca-453badf6dc3c admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:37:51.345060 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604fc39c-5be9-4547-b5ca-453badf6dc3c admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:37:51.353545 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd66a73-e8a8-4522-9f31-0c86ec6e554f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:37:51.354449 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd66a73-e8a8-4522-9f31-0c86ec6e554f admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:51.354762 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd66a73-e8a8-4522-9f31-0c86ec6e554f admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:51.355188 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd66a73-e8a8-4522-9f31-0c86ec6e554f admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:51.361499 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd66a73-e8a8-4522-9f31-0c86ec6e554f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:37:51.363193 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd66a73-e8a8-4522-9f31-0c86ec6e554f admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:37:51.377437 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3680/7328] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:37:51 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 21:37:51.382226 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33bf32d-4ee1-4f48-9976-46a25b168043 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:37:51.398280 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33bf32d-4ee1-4f48-9976-46a25b168043 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:37:51.406655 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe732b29-d622-4520-a40a-5ebac3e7ee3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:37:51.407609 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe732b29-d622-4520-a40a-5ebac3e7ee3a admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:51.407973 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe732b29-d622-4520-a40a-5ebac3e7ee3a admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:51.408250 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe732b29-d622-4520-a40a-5ebac3e7ee3a admin admin] PATH_INFO: `/v3/projects/eab47953c8c0445884c6e7e925268ebb/users/d5237cff52ef447b8a33cc5387a18ce4/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:51.433897 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe732b29-d622-4520-a40a-5ebac3e7ee3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=eab47953c8c0445884c6e7e925268ebb, user_id=d5237cff52ef447b8a33cc5387a18ce4, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:37:51.437122 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe732b29-d622-4520-a40a-5ebac3e7ee3a admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:37:51.468081 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd66a73-e8a8-4522-9f31-0c86ec6e554f admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:37:51.470124 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3649/7329] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:37:51 2022] PUT /identity/v3/projects/eab47953c8c0445884c6e7e925268ebb/users/d5237cff52ef447b8a33cc5387a18ce4/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:37:51.517904 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd66a73-e8a8-4522-9f31-0c86ec6e554f admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:37:51.650452 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192be80e-ad41-4bb1-9d80-bebfb8ff76a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:37:51.651865 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192be80e-ad41-4bb1-9d80-bebfb8ff76a5 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:51.651865 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192be80e-ad41-4bb1-9d80-bebfb8ff76a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:51.654546 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192be80e-ad41-4bb1-9d80-bebfb8ff76a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:51.657193 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192be80e-ad41-4bb1-9d80-bebfb8ff76a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:37:51.663256 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192be80e-ad41-4bb1-9d80-bebfb8ff76a5 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:37:51.677087 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3681/7330] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:37:51 2022] GET /identity/v3/roles => generated 1420 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:37:51.680999 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe732b29-d622-4520-a40a-5ebac3e7ee3a admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:37:51.692197 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe732b29-d622-4520-a40a-5ebac3e7ee3a admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:37:51.704177 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0e23e5-6a27-4037-b77a-2b2ef599deee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:37:51.705099 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0e23e5-6a27-4037-b77a-2b2ef599deee admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:51.705438 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0e23e5-6a27-4037-b77a-2b2ef599deee admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:51.705639 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0e23e5-6a27-4037-b77a-2b2ef599deee admin admin] PATH_INFO: `/v3/projects/eab47953c8c0445884c6e7e925268ebb/users/d5237cff52ef447b8a33cc5387a18ce4/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:51.716568 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0e23e5-6a27-4037-b77a-2b2ef599deee admin admin] RBAC: Authorizing `identity:create_grant(project_id=eab47953c8c0445884c6e7e925268ebb, user_id=d5237cff52ef447b8a33cc5387a18ce4, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:37:51.719720 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0e23e5-6a27-4037-b77a-2b2ef599deee admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:37:51.767775 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3650/7331] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:37:51 2022] PUT /identity/v3/projects/eab47953c8c0445884c6e7e925268ebb/users/d5237cff52ef447b8a33cc5387a18ce4/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:37:51.778596 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a80dcd5-9aea-4ff3-8045-7fbda8d2db20 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:51.778885 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a80dcd5-9aea-4ff3-8045-7fbda8d2db20 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:51.779160 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a80dcd5-9aea-4ff3-8045-7fbda8d2db20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:51.829182 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-3a80dcd5-9aea-4ff3-8045-7fbda8d2db20 None None] MFA Rules not processed for user `d5237cff52ef447b8a33cc5387a18ce4`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:37:51.830604 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-3a80dcd5-9aea-4ff3-8045-7fbda8d2db20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:37:51.941993 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3682/7332] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:37:51 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:37:51.955070 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0e23e5-6a27-4037-b77a-2b2ef599deee admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:37:51.957913 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-bb0e23e5-6a27-4037-b77a-2b2ef599deee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:37:52.056616 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0e23e5-6a27-4037-b77a-2b2ef599deee admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:37:52.061828 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff13ffa-0b84-4b6b-84af-2773f899515d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec5fd3a489c341b7964704d689037f05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:37:52.062828 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff13ffa-0b84-4b6b-84af-2773f899515d service cinder] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:52.063221 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff13ffa-0b84-4b6b-84af-2773f899515d service cinder] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:52.064077 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff13ffa-0b84-4b6b-84af-2773f899515d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:52.077801 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff13ffa-0b84-4b6b-84af-2773f899515d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:37:52.079791 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff13ffa-0b84-4b6b-84af-2773f899515d service cinder] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:37:52.094391 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3651/7333] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:37:51 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:37:52.153825 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a80dcd5-9aea-4ff3-8045-7fbda8d2db20 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:37:52.173177 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a80dcd5-9aea-4ff3-8045-7fbda8d2db20 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:37:52.177782 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3317ad-baa9-4901-b448-ea2a9eb908b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec5fd3a489c341b7964704d689037f05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:37:52.178648 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3317ad-baa9-4901-b448-ea2a9eb908b1 service cinder] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:52.179069 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3317ad-baa9-4901-b448-ea2a9eb908b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:52.179482 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3317ad-baa9-4901-b448-ea2a9eb908b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:52.269681 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3317ad-baa9-4901-b448-ea2a9eb908b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:37:52.271331 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3317ad-baa9-4901-b448-ea2a9eb908b1 service cinder] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:37:52.285141 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3683/7334] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:37:52 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:37:54.341146 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff13ffa-0b84-4b6b-84af-2773f899515d service cinder] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:37:54.437256 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff13ffa-0b84-4b6b-84af-2773f899515d service cinder] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:37:54.453184 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3c708a-d0db-40f3-a85b-75e75931a2c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:37:54.454223 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3c708a-d0db-40f3-a85b-75e75931a2c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:54.454575 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3c708a-d0db-40f3-a85b-75e75931a2c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:54.455065 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3c708a-d0db-40f3-a85b-75e75931a2c5 admin admin] PATH_INFO: `/v3/users/ae42760d36b2471a8886b3a5edc970c5` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:54.458541 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3c708a-d0db-40f3-a85b-75e75931a2c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae42760d36b2471a8886b3a5edc970c5)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:37:54.460657 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3c708a-d0db-40f3-a85b-75e75931a2c5 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:37:54.486436 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:37:54.541455 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-5b3c708a-d0db-40f3-a85b-75e75931a2c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae42760d36b2471a8886b3a5edc970c5'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:37:54.550098 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-5b3c708a-d0db-40f3-a85b-75e75931a2c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae42760d36b2471a8886b3a5edc970c5'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:37:54.550661 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-5b3c708a-d0db-40f3-a85b-75e75931a2c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae42760d36b2471a8886b3a5edc970c5'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:37:54.565185 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-5b3c708a-d0db-40f3-a85b-75e75931a2c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae42760d36b2471a8886b3a5edc970c5'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:37:54.595184 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-5b3c708a-d0db-40f3-a85b-75e75931a2c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae42760d36b2471a8886b3a5edc970c5'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:37:54.606873 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3652/7335] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:37:54 2022] DELETE /identity/v3/users/ae42760d36b2471a8886b3a5edc970c5 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:37:54.609514 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fbc096-f12c-4b45-977a-2507106c5938 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:54.609982 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fbc096-f12c-4b45-977a-2507106c5938 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:54.610314 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fbc096-f12c-4b45-977a-2507106c5938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:54.626440 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:37:54.634447 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-58fbc096-f12c-4b45-977a-2507106c5938 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:37:54.635807 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-58fbc096-f12c-4b45-977a-2507106c5938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:37:54.651014 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3c708a-d0db-40f3-a85b-75e75931a2c5 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:37:54.652501 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-5b3c708a-d0db-40f3-a85b-75e75931a2c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:37:54.713595 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3684/7336] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:37:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:37:54.726169 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fbc096-f12c-4b45-977a-2507106c5938 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:37:54.727645 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-58fbc096-f12c-4b45-977a-2507106c5938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:37:54.736550 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3c708a-d0db-40f3-a85b-75e75931a2c5 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:37:54.742201 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d77be6-48b3-4780-966a-7e214ada72d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:37:54.743134 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d77be6-48b3-4780-966a-7e214ada72d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:54.743405 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d77be6-48b3-4780-966a-7e214ada72d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:54.743965 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d77be6-48b3-4780-966a-7e214ada72d9 admin admin] PATH_INFO: `/v3/users/f5c139ba274044f9a1c1d6ec23353a94` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:54.745779 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d77be6-48b3-4780-966a-7e214ada72d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5c139ba274044f9a1c1d6ec23353a94)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:37:54.750004 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d77be6-48b3-4780-966a-7e214ada72d9 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:37:54.799326 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fbc096-f12c-4b45-977a-2507106c5938 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:37:54.803514 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7395646-6530-43c6-99be-bed65cc2395b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:37:54.803861 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7395646-6530-43c6-99be-bed65cc2395b service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:54.804196 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7395646-6530-43c6-99be-bed65cc2395b service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:54.804469 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7395646-6530-43c6-99be-bed65cc2395b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:54.819901 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7395646-6530-43c6-99be-bed65cc2395b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:37:54.821449 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7395646-6530-43c6-99be-bed65cc2395b service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:37:54.831740 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-61d77be6-48b3-4780-966a-7e214ada72d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5c139ba274044f9a1c1d6ec23353a94'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:37:54.835547 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3685/7337] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:37:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:37:54.844009 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-61d77be6-48b3-4780-966a-7e214ada72d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5c139ba274044f9a1c1d6ec23353a94'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:37:54.845149 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-61d77be6-48b3-4780-966a-7e214ada72d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5c139ba274044f9a1c1d6ec23353a94'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:37:54.856689 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-61d77be6-48b3-4780-966a-7e214ada72d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5c139ba274044f9a1c1d6ec23353a94'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:37:54.877472 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-61d77be6-48b3-4780-966a-7e214ada72d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5c139ba274044f9a1c1d6ec23353a94'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:37:54.886742 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3653/7338] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:37:54 2022] DELETE /identity/v3/users/f5c139ba274044f9a1c1d6ec23353a94 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:37:54.892529 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecc589d-988c-4c08-b356-5b2e39352b99 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:54.893114 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecc589d-988c-4c08-b356-5b2e39352b99 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:54.893492 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecc589d-988c-4c08-b356-5b2e39352b99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:54.922034 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-5ecc589d-988c-4c08-b356-5b2e39352b99 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:37:54.923476 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-5ecc589d-988c-4c08-b356-5b2e39352b99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:37:55.039535 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d77be6-48b3-4780-966a-7e214ada72d9 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:37:55.039705 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3686/7339] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:37:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:37:55.041289 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-61d77be6-48b3-4780-966a-7e214ada72d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:37:55.056536 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:37:55.122986 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d77be6-48b3-4780-966a-7e214ada72d9 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:37:55.136474 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f71a54d-6e01-4581-a8ee-a201af1a376b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:37:55.137707 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f71a54d-6e01-4581-a8ee-a201af1a376b service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:55.138223 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f71a54d-6e01-4581-a8ee-a201af1a376b service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:55.138837 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f71a54d-6e01-4581-a8ee-a201af1a376b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:55.164644 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f71a54d-6e01-4581-a8ee-a201af1a376b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:37:55.167035 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f71a54d-6e01-4581-a8ee-a201af1a376b service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:37:55.180155 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3654/7340] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:37:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:37:55.207780 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecc589d-988c-4c08-b356-5b2e39352b99 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:37:55.209726 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-5ecc589d-988c-4c08-b356-5b2e39352b99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:37:55.227463 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecc589d-988c-4c08-b356-5b2e39352b99 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:37:55.234495 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a767ea2-db2b-4d51-867a-11f6333c155e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:37:55.235591 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a767ea2-db2b-4d51-867a-11f6333c155e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:55.236130 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a767ea2-db2b-4d51-867a-11f6333c155e admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:55.236971 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a767ea2-db2b-4d51-867a-11f6333c155e admin admin] PATH_INFO: `/v3/projects/2212ee77aa804227b2aa6dfb9fe60799` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:55.239256 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a767ea2-db2b-4d51-867a-11f6333c155e admin admin] RBAC: Authorizing `identity:delete_project(project_id=2212ee77aa804227b2aa6dfb9fe60799)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:37:55.243017 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a767ea2-db2b-4d51-867a-11f6333c155e admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:37:55.304678 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:37:55.309084 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-6a767ea2-db2b-4d51-867a-11f6333c155e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2212ee77aa804227b2aa6dfb9fe60799', 'request_id': 'req-6a767ea2-db2b-4d51-867a-11f6333c155e'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:37:55.320053 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-6a767ea2-db2b-4d51-867a-11f6333c155e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2212ee77aa804227b2aa6dfb9fe60799', 'request_id': 'req-6a767ea2-db2b-4d51-867a-11f6333c155e'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:37:55.327067 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-6a767ea2-db2b-4d51-867a-11f6333c155e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2212ee77aa804227b2aa6dfb9fe60799', 'request_id': 'req-6a767ea2-db2b-4d51-867a-11f6333c155e'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:37:55.340450 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-6a767ea2-db2b-4d51-867a-11f6333c155e admin admin] The token cache is being invalidate because project 2212ee77aa804227b2aa6dfb9fe60799 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:37:55.340807 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-6a767ea2-db2b-4d51-867a-11f6333c155e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:37:55.341554 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-6a767ea2-db2b-4d51-867a-11f6333c155e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:37:55.344577 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3687/7341] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:37:55 2022] DELETE /identity/v3/projects/2212ee77aa804227b2aa6dfb9fe60799 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:37:55.349589 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f71a54d-6e01-4581-a8ee-a201af1a376b service neutron] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:37:55.363478 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f71a54d-6e01-4581-a8ee-a201af1a376b service neutron] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:37:55.394229 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a767ea2-db2b-4d51-867a-11f6333c155e admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:37:55.395829 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-6a767ea2-db2b-4d51-867a-11f6333c155e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:37:55.458651 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef5fe39-36ac-4dad-aaa6-f56e72cd3243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:37:55.459556 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef5fe39-36ac-4dad-aaa6-f56e72cd3243 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:55.459832 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef5fe39-36ac-4dad-aaa6-f56e72cd3243 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:55.460101 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef5fe39-36ac-4dad-aaa6-f56e72cd3243 admin admin] PATH_INFO: `/v3/users/d5237cff52ef447b8a33cc5387a18ce4` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:55.461533 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef5fe39-36ac-4dad-aaa6-f56e72cd3243 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5237cff52ef447b8a33cc5387a18ce4)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:37:55.464313 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef5fe39-36ac-4dad-aaa6-f56e72cd3243 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:37:55.498018 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a767ea2-db2b-4d51-867a-11f6333c155e admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:37:55.508003 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e901f347-7ad8-41f6-ac8b-ce0012e24667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:37:55.509649 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e901f347-7ad8-41f6-ac8b-ce0012e24667 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:55.510314 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e901f347-7ad8-41f6-ac8b-ce0012e24667 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:55.510651 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e901f347-7ad8-41f6-ac8b-ce0012e24667 admin admin] PATH_INFO: `/v3/projects/a6e504faeb7f4d078c7dcba26b8ef28d` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:55.512230 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e901f347-7ad8-41f6-ac8b-ce0012e24667 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6e504faeb7f4d078c7dcba26b8ef28d)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:37:55.514470 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e901f347-7ad8-41f6-ac8b-ce0012e24667 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:37:55.538295 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-2ef5fe39-36ac-4dad-aaa6-f56e72cd3243 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5237cff52ef447b8a33cc5387a18ce4'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:37:55.547203 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-2ef5fe39-36ac-4dad-aaa6-f56e72cd3243 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5237cff52ef447b8a33cc5387a18ce4'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:37:55.547998 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-2ef5fe39-36ac-4dad-aaa6-f56e72cd3243 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5237cff52ef447b8a33cc5387a18ce4'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:37:55.558684 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-2ef5fe39-36ac-4dad-aaa6-f56e72cd3243 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5237cff52ef447b8a33cc5387a18ce4'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:37:55.580133 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-2ef5fe39-36ac-4dad-aaa6-f56e72cd3243 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5237cff52ef447b8a33cc5387a18ce4'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:37:55.593386 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-e901f347-7ad8-41f6-ac8b-ce0012e24667 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6e504faeb7f4d078c7dcba26b8ef28d', 'request_id': 'req-e901f347-7ad8-41f6-ac8b-ce0012e24667'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:37:55.595109 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3655/7342] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:37:55 2022] DELETE /identity/v3/users/d5237cff52ef447b8a33cc5387a18ce4 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:37:55.608678 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-e901f347-7ad8-41f6-ac8b-ce0012e24667 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6e504faeb7f4d078c7dcba26b8ef28d', 'request_id': 'req-e901f347-7ad8-41f6-ac8b-ce0012e24667'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:37:55.617421 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-e901f347-7ad8-41f6-ac8b-ce0012e24667 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6e504faeb7f4d078c7dcba26b8ef28d', 'request_id': 'req-e901f347-7ad8-41f6-ac8b-ce0012e24667'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:37:55.633460 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-e901f347-7ad8-41f6-ac8b-ce0012e24667 admin admin] The token cache is being invalidate because project a6e504faeb7f4d078c7dcba26b8ef28d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:37:55.633809 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-e901f347-7ad8-41f6-ac8b-ce0012e24667 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:37:55.634502 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-e901f347-7ad8-41f6-ac8b-ce0012e24667 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:37:55.639798 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3688/7343] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:37:55 2022] DELETE /identity/v3/projects/a6e504faeb7f4d078c7dcba26b8ef28d => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:37:55.641964 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eacd202-ac67-4535-b60f-7c773d27a2a7 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:55.642544 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eacd202-ac67-4535-b60f-7c773d27a2a7 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:55.642544 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eacd202-ac67-4535-b60f-7c773d27a2a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:55.663185 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-6eacd202-ac67-4535-b60f-7c773d27a2a7 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:37:55.664512 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-6eacd202-ac67-4535-b60f-7c773d27a2a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:37:55.729820 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:37:55.781490 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3656/7344] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:37:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:37:55.789771 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b77c7b-b402-4a60-93ba-f2b25ba6562f None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:55.789771 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b77c7b-b402-4a60-93ba-f2b25ba6562f None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:55.789771 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b77c7b-b402-4a60-93ba-f2b25ba6562f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:55.817481 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-30b77c7b-b402-4a60-93ba-f2b25ba6562f None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:37:55.819047 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-30b77c7b-b402-4a60-93ba-f2b25ba6562f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:37:55.832097 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3689/7345] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:37:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:37:55.837583 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eacd202-ac67-4535-b60f-7c773d27a2a7 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:37:55.848245 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eacd202-ac67-4535-b60f-7c773d27a2a7 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:37:55.854853 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e81bd73-0376-43f3-92aa-8ef4e924618b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:37:55.855977 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e81bd73-0376-43f3-92aa-8ef4e924618b admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:55.856455 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e81bd73-0376-43f3-92aa-8ef4e924618b admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:55.856923 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e81bd73-0376-43f3-92aa-8ef4e924618b admin admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:55.857943 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e81bd73-0376-43f3-92aa-8ef4e924618b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:37:55.858381 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e81bd73-0376-43f3-92aa-8ef4e924618b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:37:55.860421 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e81bd73-0376-43f3-92aa-8ef4e924618b admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:37:55.876680 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3657/7346] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:37:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:37:55.882584 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b77c7b-b402-4a60-93ba-f2b25ba6562f None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:37:55.893610 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b77c7b-b402-4a60-93ba-f2b25ba6562f None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:37:55.900923 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d78e9a-9ce1-4435-9180-81e3c6ecb67c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:37:55.902004 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d78e9a-9ce1-4435-9180-81e3c6ecb67c admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:55.902870 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d78e9a-9ce1-4435-9180-81e3c6ecb67c admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:55.903497 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d78e9a-9ce1-4435-9180-81e3c6ecb67c admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:55.904444 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d78e9a-9ce1-4435-9180-81e3c6ecb67c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:37:55.907263 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d78e9a-9ce1-4435-9180-81e3c6ecb67c admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:37:55.957519 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e81bd73-0376-43f3-92aa-8ef4e924618b admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:37:55.958825 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3690/7347] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:37:55 2022] POST /identity/v3/projects => generated 359 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:37:55.964235 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-9e81bd73-0376-43f3-92aa-8ef4e924618b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:37:55.965157 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d78e9a-9ce1-4435-9180-81e3c6ecb67c admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:37:56.019936 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:DELETE=11,keystone:SELECT=86,keystone:INSERT=3 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:37:56.022897 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e81bd73-0376-43f3-92aa-8ef4e924618b admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:37:56.051561 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d78e9a-9ce1-4435-9180-81e3c6ecb67c admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:37:56.059687 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408fe175-8043-41e1-9544-3111f9ea3d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:37:56.060332 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408fe175-8043-41e1-9544-3111f9ea3d01 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:56.061526 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408fe175-8043-41e1-9544-3111f9ea3d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:56.061818 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408fe175-8043-41e1-9544-3111f9ea3d01 admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:56.062571 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408fe175-8043-41e1-9544-3111f9ea3d01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:37:56.064528 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408fe175-8043-41e1-9544-3111f9ea3d01 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:37:56.107845 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3691/7348] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:37:55 2022] POST /identity/v3/users => generated 280 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:37:56.113192 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408fe175-8043-41e1-9544-3111f9ea3d01 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:37:56.127152 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7782f268-3754-4e24-a069-09688b75851d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:37:56.129514 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7782f268-3754-4e24-a069-09688b75851d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:56.130161 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7782f268-3754-4e24-a069-09688b75851d admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:56.130340 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408fe175-8043-41e1-9544-3111f9ea3d01 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:37:56.131010 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7782f268-3754-4e24-a069-09688b75851d admin admin] PATH_INFO: `/v3/projects/eab47953c8c0445884c6e7e925268ebb` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:56.133528 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7782f268-3754-4e24-a069-09688b75851d admin admin] RBAC: Authorizing `identity:delete_project(project_id=eab47953c8c0445884c6e7e925268ebb)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:37:56.137605 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7782f268-3754-4e24-a069-09688b75851d admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:37:56.139828 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d794fd-e40f-44d6-8359-445ebb4c86d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:37:56.140812 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d794fd-e40f-44d6-8359-445ebb4c86d5 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:56.143454 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d794fd-e40f-44d6-8359-445ebb4c86d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:56.143774 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d794fd-e40f-44d6-8359-445ebb4c86d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:56.144538 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d794fd-e40f-44d6-8359-445ebb4c86d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:37:56.146590 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d794fd-e40f-44d6-8359-445ebb4c86d5 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:37:56.161462 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3692/7349] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:37:56 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:37:56.165296 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d794fd-e40f-44d6-8359-445ebb4c86d5 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:37:56.184126 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d794fd-e40f-44d6-8359-445ebb4c86d5 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:37:56.195556 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e4529f-b3a8-4bc3-9e07-4b6d27e562b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:37:56.196308 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e4529f-b3a8-4bc3-9e07-4b6d27e562b9 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:56.196598 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e4529f-b3a8-4bc3-9e07-4b6d27e562b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:56.197218 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e4529f-b3a8-4bc3-9e07-4b6d27e562b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:56.198179 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e4529f-b3a8-4bc3-9e07-4b6d27e562b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:37:56.201897 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e4529f-b3a8-4bc3-9e07-4b6d27e562b9 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:37:56.225304 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3693/7350] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:37:56 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:37:56.231098 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e4529f-b3a8-4bc3-9e07-4b6d27e562b9 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:37:56.244753 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e4529f-b3a8-4bc3-9e07-4b6d27e562b9 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:37:56.246927 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-7782f268-3754-4e24-a069-09688b75851d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eab47953c8c0445884c6e7e925268ebb', 'request_id': 'req-7782f268-3754-4e24-a069-09688b75851d'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:37:56.285520 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-7782f268-3754-4e24-a069-09688b75851d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eab47953c8c0445884c6e7e925268ebb', 'request_id': 'req-7782f268-3754-4e24-a069-09688b75851d'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:37:56.297698 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-7782f268-3754-4e24-a069-09688b75851d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eab47953c8c0445884c6e7e925268ebb', 'request_id': 'req-7782f268-3754-4e24-a069-09688b75851d'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:37:56.311193 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-7782f268-3754-4e24-a069-09688b75851d admin admin] The token cache is being invalidate because project eab47953c8c0445884c6e7e925268ebb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:37:56.311697 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-7782f268-3754-4e24-a069-09688b75851d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:37:56.312525 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-7782f268-3754-4e24-a069-09688b75851d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:37:56.314710 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3658/7351] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:37:55 2022] DELETE /identity/v3/projects/eab47953c8c0445884c6e7e925268ebb => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:37:56.322007 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff20244-b619-4c63-87ab-d32ac356e05b None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:56.322459 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff20244-b619-4c63-87ab-d32ac356e05b None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:56.322873 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff20244-b619-4c63-87ab-d32ac356e05b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:56.329041 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64b5643-ed96-4e04-b8ec-3d9439dff130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:37:56.330772 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64b5643-ed96-4e04-b8ec-3d9439dff130 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:56.331168 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64b5643-ed96-4e04-b8ec-3d9439dff130 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:56.331542 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64b5643-ed96-4e04-b8ec-3d9439dff130 admin admin] PATH_INFO: `/v3/projects/a54c40f2fc1742738bbefedf3c4418c0/users/70e2c47b8780456681b37da10eea11e7/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:56.345411 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-fff20244-b619-4c63-87ab-d32ac356e05b None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:37:56.346921 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-fff20244-b619-4c63-87ab-d32ac356e05b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:37:56.352594 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64b5643-ed96-4e04-b8ec-3d9439dff130 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a54c40f2fc1742738bbefedf3c4418c0, user_id=70e2c47b8780456681b37da10eea11e7, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:37:56.355463 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64b5643-ed96-4e04-b8ec-3d9439dff130 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:37:56.356279 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3659/7352] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:37:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:37:56.364815 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1987dfa-0984-4cde-8fd6-f39b6e9bed26 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:56.365325 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1987dfa-0984-4cde-8fd6-f39b6e9bed26 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:56.366067 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1987dfa-0984-4cde-8fd6-f39b6e9bed26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:56.373558 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3694/7353] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:37:56 2022] PUT /identity/v3/projects/a54c40f2fc1742738bbefedf3c4418c0/users/70e2c47b8780456681b37da10eea11e7/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:37:56.385510 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e592c4-2bac-44a7-905f-2c6fcd98b36b None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:56.385936 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e592c4-2bac-44a7-905f-2c6fcd98b36b None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:56.386424 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e592c4-2bac-44a7-905f-2c6fcd98b36b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:56.388435 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-d1987dfa-0984-4cde-8fd6-f39b6e9bed26 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:37:56.390075 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-d1987dfa-0984-4cde-8fd6-f39b6e9bed26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:37:56.418747 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-07e592c4-2bac-44a7-905f-2c6fcd98b36b None None] MFA Rules not processed for user `70e2c47b8780456681b37da10eea11e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:37:56.420567 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-07e592c4-2bac-44a7-905f-2c6fcd98b36b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:37:56.449937 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:37:56.482714 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3660/7354] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:37:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:37:56.489450 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1987dfa-0984-4cde-8fd6-f39b6e9bed26 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:37:56.501852 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1987dfa-0984-4cde-8fd6-f39b6e9bed26 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:37:56.509453 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7718463-792e-417a-8f4b-b55330fda915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:37:56.511489 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7718463-792e-417a-8f4b-b55330fda915 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:56.511766 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7718463-792e-417a-8f4b-b55330fda915 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:56.512043 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7718463-792e-417a-8f4b-b55330fda915 admin admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:56.512833 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7718463-792e-417a-8f4b-b55330fda915 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:37:56.513139 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7718463-792e-417a-8f4b-b55330fda915 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:37:56.515919 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7718463-792e-417a-8f4b-b55330fda915 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:37:56.528957 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3695/7355] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:37:56 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:37:56.537931 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3661/7356] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:37:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 21:37:56.541275 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e592c4-2bac-44a7-905f-2c6fcd98b36b None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:37:56.543041 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7718463-792e-417a-8f4b-b55330fda915 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:37:56.544999 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-07e592c4-2bac-44a7-905f-2c6fcd98b36b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:37:56.563166 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7718463-792e-417a-8f4b-b55330fda915 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:37:56.569754 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986b8a0f-ec72-4a36-a343-92334f38b80d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:37:56.570587 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986b8a0f-ec72-4a36-a343-92334f38b80d admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:56.570960 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986b8a0f-ec72-4a36-a343-92334f38b80d admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:56.572782 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:37:56.573854 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986b8a0f-ec72-4a36-a343-92334f38b80d admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:56.574838 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986b8a0f-ec72-4a36-a343-92334f38b80d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:37:56.576856 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986b8a0f-ec72-4a36-a343-92334f38b80d admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:37:56.616714 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3662/7357] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:37:56 2022] POST /identity/v3/projects => generated 407 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:37:56.617770 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986b8a0f-ec72-4a36-a343-92334f38b80d admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:37:56.641366 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e592c4-2bac-44a7-905f-2c6fcd98b36b None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:37:56.705914 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986b8a0f-ec72-4a36-a343-92334f38b80d admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:37:56.714014 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e2d4b5-c6cb-4707-a2fa-ed2f40badefb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:37:56.714952 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e2d4b5-c6cb-4707-a2fa-ed2f40badefb admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:56.715434 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e2d4b5-c6cb-4707-a2fa-ed2f40badefb admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:56.715993 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e2d4b5-c6cb-4707-a2fa-ed2f40badefb admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:56.717375 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e2d4b5-c6cb-4707-a2fa-ed2f40badefb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:37:56.719603 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e2d4b5-c6cb-4707-a2fa-ed2f40badefb admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:37:56.720877 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d322e8-d469-41e0-b843-036b34759943 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:37:56.721734 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d322e8-d469-41e0-b843-036b34759943 service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:56.722063 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d322e8-d469-41e0-b843-036b34759943 service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:56.722455 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d322e8-d469-41e0-b843-036b34759943 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:56.750874 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3663/7358] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:37:56 2022] POST /identity/v3/users => generated 304 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:37:56.754584 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e2d4b5-c6cb-4707-a2fa-ed2f40badefb admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:37:56.771598 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e2d4b5-c6cb-4707-a2fa-ed2f40badefb admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:37:56.780240 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143aefb3-89d7-4aa0-808f-c3e0fd265908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:37:56.781330 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143aefb3-89d7-4aa0-808f-c3e0fd265908 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:56.781748 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143aefb3-89d7-4aa0-808f-c3e0fd265908 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:56.800925 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143aefb3-89d7-4aa0-808f-c3e0fd265908 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:56.802566 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143aefb3-89d7-4aa0-808f-c3e0fd265908 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:37:56.806317 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143aefb3-89d7-4aa0-808f-c3e0fd265908 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:37:56.821632 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3664/7359] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:37:56 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 21:37:56.827359 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143aefb3-89d7-4aa0-808f-c3e0fd265908 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:37:56.836213 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d322e8-d469-41e0-b843-036b34759943 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:37:56.837773 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d322e8-d469-41e0-b843-036b34759943 service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:37:56.841119 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143aefb3-89d7-4aa0-808f-c3e0fd265908 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:37:56.847636 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f091824e-b26d-47e4-b1e4-d4455d1a8c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:37:56.848536 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f091824e-b26d-47e4-b1e4-d4455d1a8c34 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:56.848648 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3696/7360] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:37:56 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:37:56.849063 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f091824e-b26d-47e4-b1e4-d4455d1a8c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:56.849338 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f091824e-b26d-47e4-b1e4-d4455d1a8c34 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:56.850103 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f091824e-b26d-47e4-b1e4-d4455d1a8c34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:37:56.851730 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f091824e-b26d-47e4-b1e4-d4455d1a8c34 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:37:56.865645 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3665/7361] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:37:56 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:37:56.869526 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d322e8-d469-41e0-b843-036b34759943 service neutron] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:37:56.884763 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d322e8-d469-41e0-b843-036b34759943 service neutron] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:37:56.894176 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65875be-5075-46df-80d5-62d3b3446458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:37:56.895198 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65875be-5075-46df-80d5-62d3b3446458 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:56.895475 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65875be-5075-46df-80d5-62d3b3446458 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:56.895783 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65875be-5075-46df-80d5-62d3b3446458 admin admin] PATH_INFO: `/v3/projects/1be553ac1f464dd8a4dcbda6c703326f/users/1d00831575774cd6b4814813f8cc0d24/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:56.921556 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65875be-5075-46df-80d5-62d3b3446458 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1be553ac1f464dd8a4dcbda6c703326f, user_id=1d00831575774cd6b4814813f8cc0d24, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:37:56.926105 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65875be-5075-46df-80d5-62d3b3446458 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:37:56.944875 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3697/7362] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:37:56 2022] PUT /identity/v3/projects/1be553ac1f464dd8a4dcbda6c703326f/users/1d00831575774cd6b4814813f8cc0d24/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:37:56.956701 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bb7d6c-474c-444b-b541-745913e5417c None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:56.957008 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bb7d6c-474c-444b-b541-745913e5417c None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:56.957283 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bb7d6c-474c-444b-b541-745913e5417c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:57.007086 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-b9bb7d6c-474c-444b-b541-745913e5417c None None] MFA Rules not processed for user `1d00831575774cd6b4814813f8cc0d24`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:37:57.008506 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-b9bb7d6c-474c-444b-b541-745913e5417c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:37:57.099966 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:37:57.116590 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65875be-5075-46df-80d5-62d3b3446458 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:37:57.117634 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3666/7363] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:37:56 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:37:57.218176 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:37:57.246943 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65875be-5075-46df-80d5-62d3b3446458 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:37:57.255319 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76334d7-ff68-411b-af29-f98a62774902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:37:57.259102 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76334d7-ff68-411b-af29-f98a62774902 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:57.260311 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76334d7-ff68-411b-af29-f98a62774902 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:57.263593 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76334d7-ff68-411b-af29-f98a62774902 admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:57.264665 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76334d7-ff68-411b-af29-f98a62774902 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:37:57.267369 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76334d7-ff68-411b-af29-f98a62774902 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:37:57.326261 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3698/7364] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:37:57 2022] POST /identity/v3/projects => generated 409 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:37:57.330619 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bb7d6c-474c-444b-b541-745913e5417c None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:37:57.367693 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bb7d6c-474c-444b-b541-745913e5417c None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:37:57.472551 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463c66c8-46b5-4a9a-bbcd-d507e79b4dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:37:57.473424 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463c66c8-46b5-4a9a-bbcd-d507e79b4dc4 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:57.473708 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463c66c8-46b5-4a9a-bbcd-d507e79b4dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:57.474024 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463c66c8-46b5-4a9a-bbcd-d507e79b4dc4 admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:57.475085 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463c66c8-46b5-4a9a-bbcd-d507e79b4dc4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:37:57.477648 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463c66c8-46b5-4a9a-bbcd-d507e79b4dc4 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:37:57.509661 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3667/7365] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:37:57 2022] POST /identity/v3/users => generated 311 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:37:57.512213 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76334d7-ff68-411b-af29-f98a62774902 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:37:57.540886 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76334d7-ff68-411b-af29-f98a62774902 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:37:57.551992 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8209dc4-76a5-4f55-b84c-a7921b9be606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:37:57.552844 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8209dc4-76a5-4f55-b84c-a7921b9be606 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:57.553202 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8209dc4-76a5-4f55-b84c-a7921b9be606 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:57.553535 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8209dc4-76a5-4f55-b84c-a7921b9be606 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:57.556136 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8209dc4-76a5-4f55-b84c-a7921b9be606 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:37:57.558686 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8209dc4-76a5-4f55-b84c-a7921b9be606 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:37:57.579096 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3699/7366] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:37:57 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:37:57.580508 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463c66c8-46b5-4a9a-bbcd-d507e79b4dc4 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:37:57.595043 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463c66c8-46b5-4a9a-bbcd-d507e79b4dc4 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:37:57.608598 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3896871a-9070-48a6-a3c6-b00ce0fc8b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:37:57.609547 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3896871a-9070-48a6-a3c6-b00ce0fc8b42 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:57.609829 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3896871a-9070-48a6-a3c6-b00ce0fc8b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:57.610132 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3896871a-9070-48a6-a3c6-b00ce0fc8b42 admin admin] PATH_INFO: `/v3/projects/0346faa31761444a92e60156fb095837/users/df81ac7e8cf0407c95b30b38a9c85113/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:57.639846 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3896871a-9070-48a6-a3c6-b00ce0fc8b42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0346faa31761444a92e60156fb095837, user_id=df81ac7e8cf0407c95b30b38a9c85113, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:37:57.642518 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3896871a-9070-48a6-a3c6-b00ce0fc8b42 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:37:57.674557 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3668/7367] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:37:57 2022] PUT /identity/v3/projects/0346faa31761444a92e60156fb095837/users/df81ac7e8cf0407c95b30b38a9c85113/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:37:57.677250 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8209dc4-76a5-4f55-b84c-a7921b9be606 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:37:57.694285 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8209dc4-76a5-4f55-b84c-a7921b9be606 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:37:57.798432 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3db2c4-69b0-4508-b3a0-3aba84a94c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:37:57.799447 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3db2c4-69b0-4508-b3a0-3aba84a94c07 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:57.799800 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3db2c4-69b0-4508-b3a0-3aba84a94c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:57.800148 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3db2c4-69b0-4508-b3a0-3aba84a94c07 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:57.801085 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3db2c4-69b0-4508-b3a0-3aba84a94c07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:37:57.803036 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3db2c4-69b0-4508-b3a0-3aba84a94c07 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:37:57.821709 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3700/7368] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:37:57 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 21:37:57.827419 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3896871a-9070-48a6-a3c6-b00ce0fc8b42 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:37:57.846514 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3896871a-9070-48a6-a3c6-b00ce0fc8b42 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:37:57.857840 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19afd9c1-5eec-4342-839f-3c84d66c8602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:37:57.859144 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19afd9c1-5eec-4342-839f-3c84d66c8602 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:57.859427 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19afd9c1-5eec-4342-839f-3c84d66c8602 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:57.859699 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19afd9c1-5eec-4342-839f-3c84d66c8602 admin admin] PATH_INFO: `/v3/projects/0346faa31761444a92e60156fb095837/users/df81ac7e8cf0407c95b30b38a9c85113/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:57.862397 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19afd9c1-5eec-4342-839f-3c84d66c8602 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0346faa31761444a92e60156fb095837, user_id=df81ac7e8cf0407c95b30b38a9c85113, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:37:57.866047 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19afd9c1-5eec-4342-839f-3c84d66c8602 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:37:57.880143 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3669/7369] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:37:57 2022] PUT /identity/v3/projects/0346faa31761444a92e60156fb095837/users/df81ac7e8cf0407c95b30b38a9c85113/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:37:57.891176 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fe5cb8-72d7-47c4-9bb2-a4734bc48c05 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:57.891518 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fe5cb8-72d7-47c4-9bb2-a4734bc48c05 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:57.891771 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fe5cb8-72d7-47c4-9bb2-a4734bc48c05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:57.925420 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-33fe5cb8-72d7-47c4-9bb2-a4734bc48c05 None None] MFA Rules not processed for user `df81ac7e8cf0407c95b30b38a9c85113`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:37:57.926826 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-33fe5cb8-72d7-47c4-9bb2-a4734bc48c05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:37:58.033905 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3701/7370] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:37:57 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:37:58.043497 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19afd9c1-5eec-4342-839f-3c84d66c8602 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:37:58.045351 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-19afd9c1-5eec-4342-839f-3c84d66c8602 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:37:58.133752 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19afd9c1-5eec-4342-839f-3c84d66c8602 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:37:58.139570 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42333ed-800f-4114-b9b0-ae8c4433b655 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec5fd3a489c341b7964704d689037f05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:37:58.140324 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42333ed-800f-4114-b9b0-ae8c4433b655 service cinder] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:58.140569 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42333ed-800f-4114-b9b0-ae8c4433b655 service cinder] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:58.140845 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42333ed-800f-4114-b9b0-ae8c4433b655 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:58.152862 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42333ed-800f-4114-b9b0-ae8c4433b655 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:37:58.154396 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42333ed-800f-4114-b9b0-ae8c4433b655 service cinder] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:37:58.174083 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3670/7371] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:37:58 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 23 21:37:58.396911 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fe5cb8-72d7-47c4-9bb2-a4734bc48c05 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:37:58.410939 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fe5cb8-72d7-47c4-9bb2-a4734bc48c05 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:37:58.416674 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70adaf35-a5dc-4eab-9569-cb577fee45d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec5fd3a489c341b7964704d689037f05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:37:58.417455 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70adaf35-a5dc-4eab-9569-cb577fee45d0 service cinder] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:37:58.417851 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70adaf35-a5dc-4eab-9569-cb577fee45d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:37:58.418857 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70adaf35-a5dc-4eab-9569-cb577fee45d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:37:58.456094 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:37:58.499438 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70adaf35-a5dc-4eab-9569-cb577fee45d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:37:58.501202 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70adaf35-a5dc-4eab-9569-cb577fee45d0 service cinder] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:37:58.518071 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3702/7372] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:37:58 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:38:00.097110 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42333ed-800f-4114-b9b0-ae8c4433b655 service cinder] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:38:00.099010 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-d42333ed-800f-4114-b9b0-ae8c4433b655 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:38:00.150098 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:38:00.224171 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42333ed-800f-4114-b9b0-ae8c4433b655 service cinder] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:38:00.229819 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61568ef9-2a9d-44d6-a053-b74c981f0fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:38:00.230945 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61568ef9-2a9d-44d6-a053-b74c981f0fbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:00.231369 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61568ef9-2a9d-44d6-a053-b74c981f0fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:00.232136 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61568ef9-2a9d-44d6-a053-b74c981f0fbb admin admin] PATH_INFO: `/v3/users/7fc2509e73a9462bbc88ddfaf910b483` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:00.233096 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61568ef9-2a9d-44d6-a053-b74c981f0fbb admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fc2509e73a9462bbc88ddfaf910b483)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:38:00.235257 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61568ef9-2a9d-44d6-a053-b74c981f0fbb admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:38:00.294083 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-61568ef9-2a9d-44d6-a053-b74c981f0fbb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fc2509e73a9462bbc88ddfaf910b483'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:38:00.304502 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-61568ef9-2a9d-44d6-a053-b74c981f0fbb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fc2509e73a9462bbc88ddfaf910b483'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:38:00.305956 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-61568ef9-2a9d-44d6-a053-b74c981f0fbb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fc2509e73a9462bbc88ddfaf910b483'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:38:00.315688 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-61568ef9-2a9d-44d6-a053-b74c981f0fbb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fc2509e73a9462bbc88ddfaf910b483'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:38:00.328493 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70adaf35-a5dc-4eab-9569-cb577fee45d0 service cinder] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:38:00.338723 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-61568ef9-2a9d-44d6-a053-b74c981f0fbb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fc2509e73a9462bbc88ddfaf910b483'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:38:00.339987 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70adaf35-a5dc-4eab-9569-cb577fee45d0 service cinder] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:38:00.345500 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6571aab-d0f6-4b45-8fe3-3c06b1f719d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:38:00.346465 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3671/7373] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:38:00 2022] DELETE /identity/v3/users/7fc2509e73a9462bbc88ddfaf910b483 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:38:00.346763 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6571aab-d0f6-4b45-8fe3-3c06b1f719d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:00.347149 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6571aab-d0f6-4b45-8fe3-3c06b1f719d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:00.347437 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6571aab-d0f6-4b45-8fe3-3c06b1f719d9 admin admin] PATH_INFO: `/v3/users/1d00831575774cd6b4814813f8cc0d24` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:00.348669 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6571aab-d0f6-4b45-8fe3-3c06b1f719d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d00831575774cd6b4814813f8cc0d24)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:38:00.350944 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6571aab-d0f6-4b45-8fe3-3c06b1f719d9 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:38:00.351459 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a34332-32bb-4aa0-8b11-ee4ed219acdd None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:00.352730 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a34332-32bb-4aa0-8b11-ee4ed219acdd None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:00.353150 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a34332-32bb-4aa0-8b11-ee4ed219acdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:00.385671 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-c2a34332-32bb-4aa0-8b11-ee4ed219acdd None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:38:00.386951 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-c2a34332-32bb-4aa0-8b11-ee4ed219acdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:38:00.405885 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-d6571aab-d0f6-4b45-8fe3-3c06b1f719d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d00831575774cd6b4814813f8cc0d24'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:38:00.407405 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-d6571aab-d0f6-4b45-8fe3-3c06b1f719d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d00831575774cd6b4814813f8cc0d24'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:38:00.417464 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-d6571aab-d0f6-4b45-8fe3-3c06b1f719d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d00831575774cd6b4814813f8cc0d24'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:38:00.428986 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-d6571aab-d0f6-4b45-8fe3-3c06b1f719d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d00831575774cd6b4814813f8cc0d24'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:38:00.446231 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-d6571aab-d0f6-4b45-8fe3-3c06b1f719d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d00831575774cd6b4814813f8cc0d24'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:38:00.454007 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3703/7374] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:38:00 2022] DELETE /identity/v3/users/1d00831575774cd6b4814813f8cc0d24 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:38:00.457165 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3672/7375] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:38:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:38:00.458075 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231a5a6e-f8c3-4043-aff0-687905326635 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:00.458454 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231a5a6e-f8c3-4043-aff0-687905326635 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:00.458742 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231a5a6e-f8c3-4043-aff0-687905326635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:00.467761 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a34332-32bb-4aa0-8b11-ee4ed219acdd None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:38:00.469387 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-c2a34332-32bb-4aa0-8b11-ee4ed219acdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:38:00.483202 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-231a5a6e-f8c3-4043-aff0-687905326635 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:38:00.484924 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-231a5a6e-f8c3-4043-aff0-687905326635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:38:00.507084 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:38:00.611836 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3704/7376] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:38:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:38:00.618844 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a34332-32bb-4aa0-8b11-ee4ed219acdd None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:38:00.627821 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231a5a6e-f8c3-4043-aff0-687905326635 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:38:00.629356 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-231a5a6e-f8c3-4043-aff0-687905326635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:38:00.694910 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:38:00.728865 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231a5a6e-f8c3-4043-aff0-687905326635 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:38:00.737743 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb65740-ced1-4436-8214-d4fdbab52c70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:38:00.738715 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb65740-ced1-4436-8214-d4fdbab52c70 service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:00.738822 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb65740-ced1-4436-8214-d4fdbab52c70 service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:00.739011 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb65740-ced1-4436-8214-d4fdbab52c70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:00.745943 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f778180e-437b-4e1d-abfa-964dae1b6d89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:38:00.746937 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f778180e-437b-4e1d-abfa-964dae1b6d89 service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:00.747175 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f778180e-437b-4e1d-abfa-964dae1b6d89 service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:00.748579 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f778180e-437b-4e1d-abfa-964dae1b6d89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:00.760272 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb65740-ced1-4436-8214-d4fdbab52c70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:38:00.767188 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb65740-ced1-4436-8214-d4fdbab52c70 service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:38:00.777561 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f778180e-437b-4e1d-abfa-964dae1b6d89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:38:00.779654 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f778180e-437b-4e1d-abfa-964dae1b6d89 service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:38:00.793384 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3705/7377] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:38:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:38:00.798873 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3673/7378] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:38:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:38:01.156891 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb65740-ced1-4436-8214-d4fdbab52c70 service neutron] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:38:01.158946 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-8eb65740-ced1-4436-8214-d4fdbab52c70 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:38:01.189468 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb65740-ced1-4436-8214-d4fdbab52c70 service neutron] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:38:01.196382 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebb5f2c-d9d3-4c2a-9cba-9ee2c427e7ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:38:01.199524 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebb5f2c-d9d3-4c2a-9cba-9ee2c427e7ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:01.201285 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebb5f2c-d9d3-4c2a-9cba-9ee2c427e7ac admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:01.201285 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebb5f2c-d9d3-4c2a-9cba-9ee2c427e7ac admin admin] PATH_INFO: `/v3/projects/781bd9f2749e4e7db05ff3da06afaaf4` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:01.202203 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebb5f2c-d9d3-4c2a-9cba-9ee2c427e7ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=781bd9f2749e4e7db05ff3da06afaaf4)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:38:01.204545 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebb5f2c-d9d3-4c2a-9cba-9ee2c427e7ac admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:38:01.307030 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-6ebb5f2c-d9d3-4c2a-9cba-9ee2c427e7ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '781bd9f2749e4e7db05ff3da06afaaf4', 'request_id': 'req-6ebb5f2c-d9d3-4c2a-9cba-9ee2c427e7ac'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:38:01.325511 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-6ebb5f2c-d9d3-4c2a-9cba-9ee2c427e7ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '781bd9f2749e4e7db05ff3da06afaaf4', 'request_id': 'req-6ebb5f2c-d9d3-4c2a-9cba-9ee2c427e7ac'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:38:01.334182 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-6ebb5f2c-d9d3-4c2a-9cba-9ee2c427e7ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '781bd9f2749e4e7db05ff3da06afaaf4', 'request_id': 'req-6ebb5f2c-d9d3-4c2a-9cba-9ee2c427e7ac'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:38:01.355929 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-6ebb5f2c-d9d3-4c2a-9cba-9ee2c427e7ac admin admin] The token cache is being invalidate because project 781bd9f2749e4e7db05ff3da06afaaf4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:38:01.356350 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-6ebb5f2c-d9d3-4c2a-9cba-9ee2c427e7ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:38:01.357347 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-6ebb5f2c-d9d3-4c2a-9cba-9ee2c427e7ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:38:01.361962 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3706/7379] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:38:01 2022] DELETE /identity/v3/projects/781bd9f2749e4e7db05ff3da06afaaf4 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:38:01.365275 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70402d9-63cb-4039-8988-09727c525aa3 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:01.366236 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70402d9-63cb-4039-8988-09727c525aa3 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:01.366724 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70402d9-63cb-4039-8988-09727c525aa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:01.392272 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-a70402d9-63cb-4039-8988-09727c525aa3 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:38:01.394331 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-a70402d9-63cb-4039-8988-09727c525aa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:38:01.495199 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3674/7380] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:38:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:38:01.503514 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901a127c-1208-4bfe-aaf5-43d5846e58f6 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:01.506512 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901a127c-1208-4bfe-aaf5-43d5846e58f6 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:01.506791 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901a127c-1208-4bfe-aaf5-43d5846e58f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:01.531135 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-901a127c-1208-4bfe-aaf5-43d5846e58f6 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:38:01.532539 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-901a127c-1208-4bfe-aaf5-43d5846e58f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:38:01.547945 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70402d9-63cb-4039-8988-09727c525aa3 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:38:01.553159 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3707/7381] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:38:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:38:01.568036 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70402d9-63cb-4039-8988-09727c525aa3 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:38:01.573754 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a62759-56fa-4495-919e-806d0982c653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:38:01.574809 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a62759-56fa-4495-919e-806d0982c653 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:01.575190 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a62759-56fa-4495-919e-806d0982c653 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:01.575560 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a62759-56fa-4495-919e-806d0982c653 admin admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:01.576479 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a62759-56fa-4495-919e-806d0982c653 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:38:01.576882 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a62759-56fa-4495-919e-806d0982c653 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:38:01.578707 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a62759-56fa-4495-919e-806d0982c653 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:38:01.599502 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3675/7382] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:38:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:38:01.603679 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901a127c-1208-4bfe-aaf5-43d5846e58f6 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:38:01.626029 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901a127c-1208-4bfe-aaf5-43d5846e58f6 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:38:01.637530 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2842fd0-d515-4f8b-b1ef-6143669153ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:38:01.638667 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2842fd0-d515-4f8b-b1ef-6143669153ad admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:01.639170 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2842fd0-d515-4f8b-b1ef-6143669153ad admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:01.639639 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2842fd0-d515-4f8b-b1ef-6143669153ad admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:01.640568 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2842fd0-d515-4f8b-b1ef-6143669153ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:38:01.643084 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2842fd0-d515-4f8b-b1ef-6143669153ad admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:38:01.686599 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3708/7383] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:38:01 2022] POST /identity/v3/projects => generated 365 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:38:01.690758 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a62759-56fa-4495-919e-806d0982c653 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:38:01.703739 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a62759-56fa-4495-919e-806d0982c653 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:38:01.770067 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:38:01.796973 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32539851-b200-4109-b04e-2f776407ea8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:38:01.798410 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32539851-b200-4109-b04e-2f776407ea8e admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:01.798769 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32539851-b200-4109-b04e-2f776407ea8e admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:01.799119 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32539851-b200-4109-b04e-2f776407ea8e admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:01.799894 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32539851-b200-4109-b04e-2f776407ea8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:38:01.801939 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32539851-b200-4109-b04e-2f776407ea8e admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:38:01.861680 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3676/7384] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:38:01 2022] POST /identity/v3/users => generated 283 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:38:01.862353 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2842fd0-d515-4f8b-b1ef-6143669153ad admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:38:01.879742 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2842fd0-d515-4f8b-b1ef-6143669153ad admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:38:01.885589 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f74ba1-4ec2-4152-9719-beb04aba35ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:38:01.886416 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f74ba1-4ec2-4152-9719-beb04aba35ad admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:01.886743 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f74ba1-4ec2-4152-9719-beb04aba35ad admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:01.887033 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f74ba1-4ec2-4152-9719-beb04aba35ad admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:01.887851 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f74ba1-4ec2-4152-9719-beb04aba35ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:38:01.889589 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f74ba1-4ec2-4152-9719-beb04aba35ad admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:38:01.903511 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3709/7385] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:38:01 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:38:01.907427 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32539851-b200-4109-b04e-2f776407ea8e admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:38:01.927249 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32539851-b200-4109-b04e-2f776407ea8e admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:38:01.932615 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b177222-3d10-40a2-8343-13db5b419075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:38:01.933477 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b177222-3d10-40a2-8343-13db5b419075 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:01.933759 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b177222-3d10-40a2-8343-13db5b419075 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:01.934098 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b177222-3d10-40a2-8343-13db5b419075 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:01.934840 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b177222-3d10-40a2-8343-13db5b419075 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:38:01.936570 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b177222-3d10-40a2-8343-13db5b419075 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:38:01.952043 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3677/7386] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:38:01 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:38:01.953161 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f74ba1-4ec2-4152-9719-beb04aba35ad admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:38:01.973895 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f74ba1-4ec2-4152-9719-beb04aba35ad admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:38:01.982159 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f530a1-f9b6-4e49-90fe-b34cbd6c0ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:38:01.983239 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f530a1-f9b6-4e49-90fe-b34cbd6c0ff5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:01.983461 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f530a1-f9b6-4e49-90fe-b34cbd6c0ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:01.983731 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f530a1-f9b6-4e49-90fe-b34cbd6c0ff5 admin admin] PATH_INFO: `/v3/projects/04f8858d3bcb4e4ba7d08c8e8e59173b/users/25b3829a83124bcaae3a456770524e2c/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:01.988924 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b177222-3d10-40a2-8343-13db5b419075 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:38:01.991106 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-9b177222-3d10-40a2-8343-13db5b419075 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:38:02.017346 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b177222-3d10-40a2-8343-13db5b419075 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:38:02.026262 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8928b648-88cf-4df6-becd-b7ab65860778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:38:02.033896 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8928b648-88cf-4df6-becd-b7ab65860778 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:02.035402 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8928b648-88cf-4df6-becd-b7ab65860778 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:02.036343 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8928b648-88cf-4df6-becd-b7ab65860778 admin admin] PATH_INFO: `/v3/projects/1be553ac1f464dd8a4dcbda6c703326f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:02.036720 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f530a1-f9b6-4e49-90fe-b34cbd6c0ff5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04f8858d3bcb4e4ba7d08c8e8e59173b, user_id=25b3829a83124bcaae3a456770524e2c, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:38:02.038988 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8928b648-88cf-4df6-becd-b7ab65860778 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1be553ac1f464dd8a4dcbda6c703326f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:38:02.040742 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f530a1-f9b6-4e49-90fe-b34cbd6c0ff5 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:38:02.041703 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8928b648-88cf-4df6-becd-b7ab65860778 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:38:02.081854 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3710/7387] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:38:01 2022] PUT /identity/v3/projects/04f8858d3bcb4e4ba7d08c8e8e59173b/users/25b3829a83124bcaae3a456770524e2c/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:38:02.092739 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0a0150-a7c1-4659-b305-c2c040c23e07 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:02.093416 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0a0150-a7c1-4659-b305-c2c040c23e07 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:02.093978 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0a0150-a7c1-4659-b305-c2c040c23e07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:02.129262 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-cc0a0150-a7c1-4659-b305-c2c040c23e07 None None] MFA Rules not processed for user `25b3829a83124bcaae3a456770524e2c`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:38:02.132244 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-cc0a0150-a7c1-4659-b305-c2c040c23e07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:38:02.136898 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-8928b648-88cf-4df6-becd-b7ab65860778 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1be553ac1f464dd8a4dcbda6c703326f', 'request_id': 'req-8928b648-88cf-4df6-becd-b7ab65860778'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:38:02.152099 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-8928b648-88cf-4df6-becd-b7ab65860778 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1be553ac1f464dd8a4dcbda6c703326f', 'request_id': 'req-8928b648-88cf-4df6-becd-b7ab65860778'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:38:02.163453 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-8928b648-88cf-4df6-becd-b7ab65860778 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1be553ac1f464dd8a4dcbda6c703326f', 'request_id': 'req-8928b648-88cf-4df6-becd-b7ab65860778'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:38:02.199818 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-8928b648-88cf-4df6-becd-b7ab65860778 admin admin] The token cache is being invalidate because project 1be553ac1f464dd8a4dcbda6c703326f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:38:02.200119 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-8928b648-88cf-4df6-becd-b7ab65860778 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:38:02.200906 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-8928b648-88cf-4df6-becd-b7ab65860778 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:38:02.203660 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3678/7388] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:38:01 2022] DELETE /identity/v3/projects/1be553ac1f464dd8a4dcbda6c703326f => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:38:02.209925 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8928b648-88cf-4df6-becd-b7ab65860778 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:38:02.214785 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-8928b648-88cf-4df6-becd-b7ab65860778 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:38:02.224611 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:38:02.251135 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3711/7389] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:38:02 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:38:02.279043 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0a0150-a7c1-4659-b305-c2c040c23e07 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:38:02.282140 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-cc0a0150-a7c1-4659-b305-c2c040c23e07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:38:02.330036 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8928b648-88cf-4df6-becd-b7ab65860778 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:38:02.335175 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb75906-78bb-4a90-9028-c943df4c5b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:38:02.336086 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb75906-78bb-4a90-9028-c943df4c5b11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:02.336364 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb75906-78bb-4a90-9028-c943df4c5b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:02.336639 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb75906-78bb-4a90-9028-c943df4c5b11 admin admin] PATH_INFO: `/v3/users/df81ac7e8cf0407c95b30b38a9c85113` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:02.337879 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb75906-78bb-4a90-9028-c943df4c5b11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df81ac7e8cf0407c95b30b38a9c85113)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:38:02.339839 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb75906-78bb-4a90-9028-c943df4c5b11 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:38:02.373312 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0a0150-a7c1-4659-b305-c2c040c23e07 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:38:02.378543 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9f5e04-aa9d-4efd-8e4e-923fb97a2a75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:38:02.379233 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9f5e04-aa9d-4efd-8e4e-923fb97a2a75 service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:02.379516 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9f5e04-aa9d-4efd-8e4e-923fb97a2a75 service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:02.379855 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9f5e04-aa9d-4efd-8e4e-923fb97a2a75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:02.396153 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9f5e04-aa9d-4efd-8e4e-923fb97a2a75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:38:02.398156 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9f5e04-aa9d-4efd-8e4e-923fb97a2a75 service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:38:02.407917 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=82,keystone:INSERT=4,keystone:DELETE=14 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:38:02.410286 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-dbb75906-78bb-4a90-9028-c943df4c5b11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df81ac7e8cf0407c95b30b38a9c85113'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:38:02.416164 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3712/7390] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:38:02 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:38:02.421327 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-dbb75906-78bb-4a90-9028-c943df4c5b11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df81ac7e8cf0407c95b30b38a9c85113'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:38:02.422567 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-dbb75906-78bb-4a90-9028-c943df4c5b11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df81ac7e8cf0407c95b30b38a9c85113'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:38:02.434527 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-dbb75906-78bb-4a90-9028-c943df4c5b11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df81ac7e8cf0407c95b30b38a9c85113'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:38:02.456333 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-dbb75906-78bb-4a90-9028-c943df4c5b11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df81ac7e8cf0407c95b30b38a9c85113'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:38:02.467470 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3679/7391] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:38:02 2022] DELETE /identity/v3/users/df81ac7e8cf0407c95b30b38a9c85113 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:38:03.136543 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9f5e04-aa9d-4efd-8e4e-923fb97a2a75 service neutron] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:38:03.150747 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9f5e04-aa9d-4efd-8e4e-923fb97a2a75 service neutron] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:38:03.276599 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e720a2ab-eb75-44a2-9470-a809d04fc2c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:38:03.280387 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e720a2ab-eb75-44a2-9470-a809d04fc2c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:03.280859 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e720a2ab-eb75-44a2-9470-a809d04fc2c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:03.281444 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e720a2ab-eb75-44a2-9470-a809d04fc2c6 admin admin] PATH_INFO: `/v3/projects/0346faa31761444a92e60156fb095837` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:03.283675 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e720a2ab-eb75-44a2-9470-a809d04fc2c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0346faa31761444a92e60156fb095837)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:38:03.286745 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e720a2ab-eb75-44a2-9470-a809d04fc2c6 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:38:03.392249 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-e720a2ab-eb75-44a2-9470-a809d04fc2c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0346faa31761444a92e60156fb095837', 'request_id': 'req-e720a2ab-eb75-44a2-9470-a809d04fc2c6'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:38:03.421940 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-e720a2ab-eb75-44a2-9470-a809d04fc2c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0346faa31761444a92e60156fb095837', 'request_id': 'req-e720a2ab-eb75-44a2-9470-a809d04fc2c6'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:38:03.434220 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-e720a2ab-eb75-44a2-9470-a809d04fc2c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0346faa31761444a92e60156fb095837', 'request_id': 'req-e720a2ab-eb75-44a2-9470-a809d04fc2c6'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:38:03.458083 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-e720a2ab-eb75-44a2-9470-a809d04fc2c6 admin admin] The token cache is being invalidate because project 0346faa31761444a92e60156fb095837 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:38:03.458639 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-e720a2ab-eb75-44a2-9470-a809d04fc2c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:38:03.460234 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-e720a2ab-eb75-44a2-9470-a809d04fc2c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:38:03.463908 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3713/7392] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:38:03 2022] DELETE /identity/v3/projects/0346faa31761444a92e60156fb095837 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:38:03.472242 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f69320-35d4-49de-a6b7-beefd4bafee6 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:03.473348 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f69320-35d4-49de-a6b7-beefd4bafee6 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:03.473661 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f69320-35d4-49de-a6b7-beefd4bafee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:03.513239 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-55f69320-35d4-49de-a6b7-beefd4bafee6 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:38:03.514534 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-55f69320-35d4-49de-a6b7-beefd4bafee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:38:03.662689 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3680/7393] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:38:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:38:03.671378 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448126e7-1945-429e-8e39-e85a73065ca9 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:03.671892 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448126e7-1945-429e-8e39-e85a73065ca9 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:03.672343 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448126e7-1945-429e-8e39-e85a73065ca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:03.711384 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-448126e7-1945-429e-8e39-e85a73065ca9 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:38:03.713036 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-448126e7-1945-429e-8e39-e85a73065ca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:38:03.723955 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3714/7394] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:38:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:38:03.728602 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f69320-35d4-49de-a6b7-beefd4bafee6 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:38:03.744390 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f69320-35d4-49de-a6b7-beefd4bafee6 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:38:03.751338 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2d952e-2f97-4072-bac7-a3c7321e5cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:38:03.753305 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2d952e-2f97-4072-bac7-a3c7321e5cc1 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:03.753731 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2d952e-2f97-4072-bac7-a3c7321e5cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:03.754195 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2d952e-2f97-4072-bac7-a3c7321e5cc1 admin admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:03.756267 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2d952e-2f97-4072-bac7-a3c7321e5cc1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:38:03.757010 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2d952e-2f97-4072-bac7-a3c7321e5cc1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:38:03.759829 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2d952e-2f97-4072-bac7-a3c7321e5cc1 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:38:03.794989 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3681/7395] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:38:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:38:03.798887 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448126e7-1945-429e-8e39-e85a73065ca9 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:38:03.812434 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448126e7-1945-429e-8e39-e85a73065ca9 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:38:03.824454 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57935e39-be83-48c6-9e61-2d43498ada73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:38:03.825692 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57935e39-be83-48c6-9e61-2d43498ada73 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:03.828836 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57935e39-be83-48c6-9e61-2d43498ada73 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:03.829571 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57935e39-be83-48c6-9e61-2d43498ada73 admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:03.830857 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57935e39-be83-48c6-9e61-2d43498ada73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:38:03.833741 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57935e39-be83-48c6-9e61-2d43498ada73 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:38:03.877580 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:38:03.887816 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3715/7396] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:38:03 2022] POST /identity/v3/projects => generated 379 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:38:03.891786 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2d952e-2f97-4072-bac7-a3c7321e5cc1 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:38:03.906924 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2d952e-2f97-4072-bac7-a3c7321e5cc1 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:38:04.017248 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f422fad9-7ba2-416d-9c09-435e0f351aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:38:04.018515 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f422fad9-7ba2-416d-9c09-435e0f351aa5 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:04.018899 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f422fad9-7ba2-416d-9c09-435e0f351aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:04.019960 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f422fad9-7ba2-416d-9c09-435e0f351aa5 admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:04.021404 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f422fad9-7ba2-416d-9c09-435e0f351aa5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:38:04.023828 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f422fad9-7ba2-416d-9c09-435e0f351aa5 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:38:04.053068 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3682/7397] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:38:03 2022] POST /identity/v3/users => generated 290 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:38:04.058146 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57935e39-be83-48c6-9e61-2d43498ada73 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:38:04.083559 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57935e39-be83-48c6-9e61-2d43498ada73 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:38:04.094800 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8f4bdd-ae55-4d7b-8952-fd8adb024f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:38:04.095717 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8f4bdd-ae55-4d7b-8952-fd8adb024f1a admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:04.096925 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8f4bdd-ae55-4d7b-8952-fd8adb024f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:04.097933 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8f4bdd-ae55-4d7b-8952-fd8adb024f1a admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:04.099179 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8f4bdd-ae55-4d7b-8952-fd8adb024f1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:38:04.102043 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8f4bdd-ae55-4d7b-8952-fd8adb024f1a admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:38:04.129343 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3716/7398] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:38:04 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:38:04.133283 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f422fad9-7ba2-416d-9c09-435e0f351aa5 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:38:04.161893 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f422fad9-7ba2-416d-9c09-435e0f351aa5 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:38:04.167809 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb418a4-8dc9-438e-8eca-4849aee15582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:38:04.168971 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb418a4-8dc9-438e-8eca-4849aee15582 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:04.169354 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb418a4-8dc9-438e-8eca-4849aee15582 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:04.170468 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb418a4-8dc9-438e-8eca-4849aee15582 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:04.172919 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb418a4-8dc9-438e-8eca-4849aee15582 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:38:04.174919 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb418a4-8dc9-438e-8eca-4849aee15582 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:38:04.191302 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3683/7399] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:38:04 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:38:04.192773 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8f4bdd-ae55-4d7b-8952-fd8adb024f1a admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:38:04.206029 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8f4bdd-ae55-4d7b-8952-fd8adb024f1a admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:38:04.211338 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137ae161-b125-4fad-88a7-64bf112d496e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:38:04.212577 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137ae161-b125-4fad-88a7-64bf112d496e admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:04.213147 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137ae161-b125-4fad-88a7-64bf112d496e admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:04.213736 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137ae161-b125-4fad-88a7-64bf112d496e admin admin] PATH_INFO: `/v3/projects/e35dae6681604d2894fe45c25859dc05/users/61ea652d1ecb41acbe44b70a913ccbe9/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:04.232972 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137ae161-b125-4fad-88a7-64bf112d496e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e35dae6681604d2894fe45c25859dc05, user_id=61ea652d1ecb41acbe44b70a913ccbe9, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:38:04.236291 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137ae161-b125-4fad-88a7-64bf112d496e admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:38:04.281918 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712ebc62-27cb-490d-b571-3958e2f5af77 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:04.282473 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712ebc62-27cb-490d-b571-3958e2f5af77 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:04.282693 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3717/7400] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:38:04 2022] PUT /identity/v3/projects/e35dae6681604d2894fe45c25859dc05/users/61ea652d1ecb41acbe44b70a913ccbe9/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:38:04.282934 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712ebc62-27cb-490d-b571-3958e2f5af77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:04.327527 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-712ebc62-27cb-490d-b571-3958e2f5af77 None None] MFA Rules not processed for user `61ea652d1ecb41acbe44b70a913ccbe9`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:38:04.329213 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-712ebc62-27cb-490d-b571-3958e2f5af77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:38:04.392593 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:38:04.473049 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3684/7401] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:38:04 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:38:04.475538 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137ae161-b125-4fad-88a7-64bf112d496e admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:38:04.598514 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137ae161-b125-4fad-88a7-64bf112d496e admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:38:04.604866 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f6c114-ad8f-4bb1-92b4-d9c14ea3c09a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:38:04.605893 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f6c114-ad8f-4bb1-92b4-d9c14ea3c09a admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:04.606250 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f6c114-ad8f-4bb1-92b4-d9c14ea3c09a admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:04.606480 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f6c114-ad8f-4bb1-92b4-d9c14ea3c09a admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:04.607650 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f6c114-ad8f-4bb1-92b4-d9c14ea3c09a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:38:04.610474 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f6c114-ad8f-4bb1-92b4-d9c14ea3c09a admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:38:04.651530 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3718/7402] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:38:04 2022] POST /identity/v3/projects => generated 379 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:38:04.655469 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712ebc62-27cb-490d-b571-3958e2f5af77 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:38:04.672662 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712ebc62-27cb-490d-b571-3958e2f5af77 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:38:04.792274 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c9107f-a1e2-41f5-b585-09a2cb86512d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:38:04.793430 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c9107f-a1e2-41f5-b585-09a2cb86512d admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:04.795702 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c9107f-a1e2-41f5-b585-09a2cb86512d admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:04.796004 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c9107f-a1e2-41f5-b585-09a2cb86512d admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:04.797114 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c9107f-a1e2-41f5-b585-09a2cb86512d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:38:04.799295 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c9107f-a1e2-41f5-b585-09a2cb86512d admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:38:04.838277 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3685/7403] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:38:04 2022] POST /identity/v3/users => generated 296 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:38:04.842564 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f6c114-ad8f-4bb1-92b4-d9c14ea3c09a admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:38:04.858713 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f6c114-ad8f-4bb1-92b4-d9c14ea3c09a admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:38:04.867534 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f785ccf-8eb5-49a5-9016-c75dde39a1e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:38:04.869323 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f785ccf-8eb5-49a5-9016-c75dde39a1e3 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:04.870891 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f785ccf-8eb5-49a5-9016-c75dde39a1e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:04.871323 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f785ccf-8eb5-49a5-9016-c75dde39a1e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:04.872270 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f785ccf-8eb5-49a5-9016-c75dde39a1e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:38:04.878003 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f785ccf-8eb5-49a5-9016-c75dde39a1e3 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:38:04.895375 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3719/7404] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:38:04 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:38:04.899660 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c9107f-a1e2-41f5-b585-09a2cb86512d admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:38:04.911465 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c9107f-a1e2-41f5-b585-09a2cb86512d admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:38:04.917186 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7a2aaa-e6af-4b3c-940f-a074e31b7080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:38:04.918957 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7a2aaa-e6af-4b3c-940f-a074e31b7080 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:04.918957 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7a2aaa-e6af-4b3c-940f-a074e31b7080 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:04.918957 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7a2aaa-e6af-4b3c-940f-a074e31b7080 admin admin] PATH_INFO: `/v3/projects/8cb2a2e5b2684321bd2d8eac78e9a5ba/users/713c29c82a7c464593b8a82353f5b185/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:04.938036 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7a2aaa-e6af-4b3c-940f-a074e31b7080 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8cb2a2e5b2684321bd2d8eac78e9a5ba, user_id=713c29c82a7c464593b8a82353f5b185, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:38:04.941742 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7a2aaa-e6af-4b3c-940f-a074e31b7080 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:38:04.975056 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3686/7405] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:38:04 2022] PUT /identity/v3/projects/8cb2a2e5b2684321bd2d8eac78e9a5ba/users/713c29c82a7c464593b8a82353f5b185/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:38:04.975510 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f785ccf-8eb5-49a5-9016-c75dde39a1e3 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:38:04.987243 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f785ccf-8eb5-49a5-9016-c75dde39a1e3 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:38:05.070751 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2909784-e557-431d-ae4c-8061b24ba921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:38:05.071462 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2909784-e557-431d-ae4c-8061b24ba921 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:05.071750 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2909784-e557-431d-ae4c-8061b24ba921 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:05.072029 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2909784-e557-431d-ae4c-8061b24ba921 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:05.072774 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2909784-e557-431d-ae4c-8061b24ba921 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:38:05.074456 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2909784-e557-431d-ae4c-8061b24ba921 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:38:05.098530 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3720/7406] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:38:04 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:38:05.103078 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7a2aaa-e6af-4b3c-940f-a074e31b7080 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:38:05.114562 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7a2aaa-e6af-4b3c-940f-a074e31b7080 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:38:05.130651 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7656854c-902a-4d57-968c-45262b403d09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:38:05.132024 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7656854c-902a-4d57-968c-45262b403d09 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:05.132867 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7656854c-902a-4d57-968c-45262b403d09 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:05.133386 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7656854c-902a-4d57-968c-45262b403d09 admin admin] PATH_INFO: `/v3/projects/8cb2a2e5b2684321bd2d8eac78e9a5ba/users/713c29c82a7c464593b8a82353f5b185/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:05.136281 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7656854c-902a-4d57-968c-45262b403d09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8cb2a2e5b2684321bd2d8eac78e9a5ba, user_id=713c29c82a7c464593b8a82353f5b185, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:38:05.141395 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7656854c-902a-4d57-968c-45262b403d09 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:38:05.163051 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3687/7407] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:38:05 2022] PUT /identity/v3/projects/8cb2a2e5b2684321bd2d8eac78e9a5ba/users/713c29c82a7c464593b8a82353f5b185/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:38:05.173509 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b03a163-307f-407b-986f-b4e7e3e6456c None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:05.173856 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b03a163-307f-407b-986f-b4e7e3e6456c None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:05.174133 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b03a163-307f-407b-986f-b4e7e3e6456c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:05.219947 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-7b03a163-307f-407b-986f-b4e7e3e6456c None None] MFA Rules not processed for user `713c29c82a7c464593b8a82353f5b185`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:38:05.221235 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-7b03a163-307f-407b-986f-b4e7e3e6456c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:38:05.267998 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:38:05.430225 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3721/7408] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:38:05 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:38:05.447715 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7656854c-902a-4d57-968c-45262b403d09 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:38:05.449793 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-7656854c-902a-4d57-968c-45262b403d09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:38:05.594860 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7656854c-902a-4d57-968c-45262b403d09 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:38:05.607152 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048db636-1267-435e-a35b-6ef117a3dd19 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec5fd3a489c341b7964704d689037f05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:38:05.608555 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048db636-1267-435e-a35b-6ef117a3dd19 service cinder] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:05.609759 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048db636-1267-435e-a35b-6ef117a3dd19 service cinder] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:05.611711 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048db636-1267-435e-a35b-6ef117a3dd19 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:05.641434 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048db636-1267-435e-a35b-6ef117a3dd19 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:38:05.642355 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048db636-1267-435e-a35b-6ef117a3dd19 service cinder] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:38:05.678446 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3688/7409] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:38:05 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:38:06.428648 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b03a163-307f-407b-986f-b4e7e3e6456c None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:38:06.576847 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b03a163-307f-407b-986f-b4e7e3e6456c None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:38:06.588282 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1ea68c-0999-427b-a7f6-dfdc35c65233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:38:06.589285 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1ea68c-0999-427b-a7f6-dfdc35c65233 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:06.589561 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1ea68c-0999-427b-a7f6-dfdc35c65233 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:06.589948 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1ea68c-0999-427b-a7f6-dfdc35c65233 admin admin] PATH_INFO: `/v3/users/61ea652d1ecb41acbe44b70a913ccbe9` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:06.592116 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1ea68c-0999-427b-a7f6-dfdc35c65233 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61ea652d1ecb41acbe44b70a913ccbe9)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:38:06.598192 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1ea68c-0999-427b-a7f6-dfdc35c65233 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:38:06.706476 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-1c1ea68c-0999-427b-a7f6-dfdc35c65233 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61ea652d1ecb41acbe44b70a913ccbe9'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:38:06.707856 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-1c1ea68c-0999-427b-a7f6-dfdc35c65233 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61ea652d1ecb41acbe44b70a913ccbe9'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:38:06.739126 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-1c1ea68c-0999-427b-a7f6-dfdc35c65233 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61ea652d1ecb41acbe44b70a913ccbe9'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:38:06.753072 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-1c1ea68c-0999-427b-a7f6-dfdc35c65233 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61ea652d1ecb41acbe44b70a913ccbe9'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:38:06.771257 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-1c1ea68c-0999-427b-a7f6-dfdc35c65233 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61ea652d1ecb41acbe44b70a913ccbe9'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:38:06.778625 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3722/7410] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:38:06 2022] DELETE /identity/v3/users/61ea652d1ecb41acbe44b70a913ccbe9 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:38:06.783544 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5de3df0-1ce2-4e41-9844-8e92cb89afa7 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:06.784198 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5de3df0-1ce2-4e41-9844-8e92cb89afa7 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:06.784198 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5de3df0-1ce2-4e41-9844-8e92cb89afa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:06.836735 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-d5de3df0-1ce2-4e41-9844-8e92cb89afa7 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:38:06.838422 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-d5de3df0-1ce2-4e41-9844-8e92cb89afa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:38:06.851035 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:38:06.944911 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3689/7411] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:38:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:38:06.955547 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1ea68c-0999-427b-a7f6-dfdc35c65233 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:38:06.957048 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-1c1ea68c-0999-427b-a7f6-dfdc35c65233 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:38:07.035532 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:38:07.056915 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1ea68c-0999-427b-a7f6-dfdc35c65233 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:38:07.067215 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2e383c-ab13-4065-a6df-0d27919cce87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:38:07.068189 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2e383c-ab13-4065-a6df-0d27919cce87 service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:07.068832 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2e383c-ab13-4065-a6df-0d27919cce87 service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:07.069454 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2e383c-ab13-4065-a6df-0d27919cce87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:07.081969 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2e383c-ab13-4065-a6df-0d27919cce87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:38:07.083613 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2e383c-ab13-4065-a6df-0d27919cce87 service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:38:07.098738 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3723/7412] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:38:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:38:07.835943 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5de3df0-1ce2-4e41-9844-8e92cb89afa7 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:38:07.838264 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-d5de3df0-1ce2-4e41-9844-8e92cb89afa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:38:07.866521 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5de3df0-1ce2-4e41-9844-8e92cb89afa7 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:38:07.875915 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0797bcc4-edba-4174-a221-c3586c5bb223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:38:07.876830 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0797bcc4-edba-4174-a221-c3586c5bb223 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:07.877376 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0797bcc4-edba-4174-a221-c3586c5bb223 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:07.877713 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0797bcc4-edba-4174-a221-c3586c5bb223 admin admin] PATH_INFO: `/v3/projects/e35dae6681604d2894fe45c25859dc05` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:07.880385 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0797bcc4-edba-4174-a221-c3586c5bb223 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e35dae6681604d2894fe45c25859dc05)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:38:07.883628 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0797bcc4-edba-4174-a221-c3586c5bb223 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:38:07.999170 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-0797bcc4-edba-4174-a221-c3586c5bb223 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e35dae6681604d2894fe45c25859dc05', 'request_id': 'req-0797bcc4-edba-4174-a221-c3586c5bb223'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:38:08.009662 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-0797bcc4-edba-4174-a221-c3586c5bb223 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e35dae6681604d2894fe45c25859dc05', 'request_id': 'req-0797bcc4-edba-4174-a221-c3586c5bb223'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:38:08.035048 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-0797bcc4-edba-4174-a221-c3586c5bb223 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e35dae6681604d2894fe45c25859dc05', 'request_id': 'req-0797bcc4-edba-4174-a221-c3586c5bb223'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:38:08.084029 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-0797bcc4-edba-4174-a221-c3586c5bb223 admin admin] The token cache is being invalidate because project e35dae6681604d2894fe45c25859dc05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:38:08.084496 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-0797bcc4-edba-4174-a221-c3586c5bb223 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:38:08.085153 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-0797bcc4-edba-4174-a221-c3586c5bb223 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:38:08.090889 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3690/7413] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:38:07 2022] DELETE /identity/v3/projects/e35dae6681604d2894fe45c25859dc05 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:38:08.092598 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2e383c-ab13-4065-a6df-0d27919cce87 service neutron] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:38:08.104475 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2e383c-ab13-4065-a6df-0d27919cce87 service neutron] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:38:08.198656 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c58d952-55d2-4640-b8aa-eaeb2c0e3593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:38:08.199790 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c58d952-55d2-4640-b8aa-eaeb2c0e3593 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:08.200080 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c58d952-55d2-4640-b8aa-eaeb2c0e3593 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:08.201254 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c58d952-55d2-4640-b8aa-eaeb2c0e3593 admin admin] PATH_INFO: `/v3/users/713c29c82a7c464593b8a82353f5b185` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:08.202773 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c58d952-55d2-4640-b8aa-eaeb2c0e3593 admin admin] RBAC: Authorizing `identity:delete_user(user_id=713c29c82a7c464593b8a82353f5b185)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:38:08.206660 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c58d952-55d2-4640-b8aa-eaeb2c0e3593 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:38:08.295997 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-6c58d952-55d2-4640-b8aa-eaeb2c0e3593 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '713c29c82a7c464593b8a82353f5b185'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:38:08.298366 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-6c58d952-55d2-4640-b8aa-eaeb2c0e3593 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '713c29c82a7c464593b8a82353f5b185'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:38:08.314955 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-6c58d952-55d2-4640-b8aa-eaeb2c0e3593 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '713c29c82a7c464593b8a82353f5b185'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:38:08.328748 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-6c58d952-55d2-4640-b8aa-eaeb2c0e3593 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '713c29c82a7c464593b8a82353f5b185'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:38:08.362755 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-6c58d952-55d2-4640-b8aa-eaeb2c0e3593 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '713c29c82a7c464593b8a82353f5b185'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:38:08.373754 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3724/7414] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:38:08 2022] DELETE /identity/v3/users/713c29c82a7c464593b8a82353f5b185 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:38:09.386619 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0797bcc4-edba-4174-a221-c3586c5bb223 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:38:09.388285 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-0797bcc4-edba-4174-a221-c3586c5bb223 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:38:09.419441 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0797bcc4-edba-4174-a221-c3586c5bb223 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:38:09.583617 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150afcc6-427b-4d0e-a6af-df80decad609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:38:09.585452 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150afcc6-427b-4d0e-a6af-df80decad609 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:09.586776 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150afcc6-427b-4d0e-a6af-df80decad609 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:09.587157 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150afcc6-427b-4d0e-a6af-df80decad609 admin admin] PATH_INFO: `/v3/projects/8cb2a2e5b2684321bd2d8eac78e9a5ba` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:09.590379 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150afcc6-427b-4d0e-a6af-df80decad609 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8cb2a2e5b2684321bd2d8eac78e9a5ba)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:38:09.593404 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150afcc6-427b-4d0e-a6af-df80decad609 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:38:09.725040 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:38:09.748775 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-150afcc6-427b-4d0e-a6af-df80decad609 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8cb2a2e5b2684321bd2d8eac78e9a5ba', 'request_id': 'req-150afcc6-427b-4d0e-a6af-df80decad609'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:38:09.779730 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-150afcc6-427b-4d0e-a6af-df80decad609 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8cb2a2e5b2684321bd2d8eac78e9a5ba', 'request_id': 'req-150afcc6-427b-4d0e-a6af-df80decad609'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:38:09.795071 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-150afcc6-427b-4d0e-a6af-df80decad609 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8cb2a2e5b2684321bd2d8eac78e9a5ba', 'request_id': 'req-150afcc6-427b-4d0e-a6af-df80decad609'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:38:09.831988 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-150afcc6-427b-4d0e-a6af-df80decad609 admin admin] The token cache is being invalidate because project 8cb2a2e5b2684321bd2d8eac78e9a5ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:38:09.832292 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-150afcc6-427b-4d0e-a6af-df80decad609 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:38:09.834239 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-150afcc6-427b-4d0e-a6af-df80decad609 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:38:09.838227 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3691/7415] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:38:09 2022] DELETE /identity/v3/projects/8cb2a2e5b2684321bd2d8eac78e9a5ba => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:38:09.843464 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b055e573-e6ea-42d7-8fcc-427526117f0c None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:09.843952 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b055e573-e6ea-42d7-8fcc-427526117f0c None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:09.844039 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b055e573-e6ea-42d7-8fcc-427526117f0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:09.880557 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-b055e573-e6ea-42d7-8fcc-427526117f0c None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:38:09.881805 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-b055e573-e6ea-42d7-8fcc-427526117f0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:38:10.055482 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3725/7416] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:38:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:38:10.064689 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc37cc3-db9f-4298-9195-907c1821c743 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:10.065082 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc37cc3-db9f-4298-9195-907c1821c743 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:10.065366 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc37cc3-db9f-4298-9195-907c1821c743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:10.107899 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-9dc37cc3-db9f-4298-9195-907c1821c743 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:38:10.112651 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-9dc37cc3-db9f-4298-9195-907c1821c743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:38:10.136312 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3692/7417] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:38:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:38:10.136542 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b055e573-e6ea-42d7-8fcc-427526117f0c None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:38:10.143747 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:38:10.158724 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b055e573-e6ea-42d7-8fcc-427526117f0c None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:38:10.182741 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735a4016-8991-4c48-a8b1-b55ae9b8ba1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:38:10.183903 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735a4016-8991-4c48-a8b1-b55ae9b8ba1e admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:10.184731 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735a4016-8991-4c48-a8b1-b55ae9b8ba1e admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:10.185207 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735a4016-8991-4c48-a8b1-b55ae9b8ba1e admin admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:10.186518 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735a4016-8991-4c48-a8b1-b55ae9b8ba1e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:38:10.193427 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735a4016-8991-4c48-a8b1-b55ae9b8ba1e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:38:10.195512 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735a4016-8991-4c48-a8b1-b55ae9b8ba1e admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:38:10.217017 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3726/7418] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:38:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:38:10.222358 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc37cc3-db9f-4298-9195-907c1821c743 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:38:10.243184 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc37cc3-db9f-4298-9195-907c1821c743 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:38:10.261242 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f9afaa-8340-4c7c-a111-f178de1d82b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:38:10.262209 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f9afaa-8340-4c7c-a111-f178de1d82b8 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:10.262528 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f9afaa-8340-4c7c-a111-f178de1d82b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:10.262849 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f9afaa-8340-4c7c-a111-f178de1d82b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:10.264017 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f9afaa-8340-4c7c-a111-f178de1d82b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:38:10.266042 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f9afaa-8340-4c7c-a111-f178de1d82b8 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:38:10.339500 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3693/7419] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:38:10 2022] POST /identity/v3/projects => generated 373 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:38:10.340475 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735a4016-8991-4c48-a8b1-b55ae9b8ba1e admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:38:10.362492 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735a4016-8991-4c48-a8b1-b55ae9b8ba1e admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:38:10.468508 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a705deb-9c70-44d8-bbf7-c649cb1a5926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:38:10.469132 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a705deb-9c70-44d8-bbf7-c649cb1a5926 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:10.470197 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a705deb-9c70-44d8-bbf7-c649cb1a5926 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:10.470992 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a705deb-9c70-44d8-bbf7-c649cb1a5926 admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:10.471754 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a705deb-9c70-44d8-bbf7-c649cb1a5926 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:38:10.478112 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a705deb-9c70-44d8-bbf7-c649cb1a5926 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:38:10.515804 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f9afaa-8340-4c7c-a111-f178de1d82b8 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:38:10.530121 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3727/7420] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:38:10 2022] POST /identity/v3/users => generated 287 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:38:10.548225 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f9afaa-8340-4c7c-a111-f178de1d82b8 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:38:10.560157 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5c354f-84d8-4cd0-8ab1-bf677155bff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:38:10.561787 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5c354f-84d8-4cd0-8ab1-bf677155bff8 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:10.562095 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5c354f-84d8-4cd0-8ab1-bf677155bff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:10.562372 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5c354f-84d8-4cd0-8ab1-bf677155bff8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:10.563138 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5c354f-84d8-4cd0-8ab1-bf677155bff8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:38:10.574682 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5c354f-84d8-4cd0-8ab1-bf677155bff8 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:38:10.586742 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3694/7421] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:38:10 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:38:10.590957 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a705deb-9c70-44d8-bbf7-c649cb1a5926 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:38:10.621632 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a705deb-9c70-44d8-bbf7-c649cb1a5926 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:38:10.638764 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42529949-6486-4b9e-8c6a-086a54acb040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:38:10.639839 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42529949-6486-4b9e-8c6a-086a54acb040 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:10.640328 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42529949-6486-4b9e-8c6a-086a54acb040 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:10.640968 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42529949-6486-4b9e-8c6a-086a54acb040 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:10.642079 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42529949-6486-4b9e-8c6a-086a54acb040 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:38:10.644748 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42529949-6486-4b9e-8c6a-086a54acb040 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:38:10.663954 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3728/7422] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:38:10 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:38:10.664682 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5c354f-84d8-4cd0-8ab1-bf677155bff8 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:38:10.676366 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5c354f-84d8-4cd0-8ab1-bf677155bff8 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:38:10.682600 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da449fb-a373-4d6b-aa33-b1a6a57d1860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:38:10.684133 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da449fb-a373-4d6b-aa33-b1a6a57d1860 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:10.684893 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da449fb-a373-4d6b-aa33-b1a6a57d1860 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:10.685345 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da449fb-a373-4d6b-aa33-b1a6a57d1860 admin admin] PATH_INFO: `/v3/projects/a7862d08120b4bad8902c1d9c080d36d/users/2a8a21cd4bc1490c82dd3636ac4186b1/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:10.709926 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da449fb-a373-4d6b-aa33-b1a6a57d1860 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7862d08120b4bad8902c1d9c080d36d, user_id=2a8a21cd4bc1490c82dd3636ac4186b1, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:38:10.713551 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da449fb-a373-4d6b-aa33-b1a6a57d1860 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:38:10.743631 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e252da11-d11c-4c3a-8695-4d9d7f7806af None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:10.743973 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e252da11-d11c-4c3a-8695-4d9d7f7806af None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:10.744248 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e252da11-d11c-4c3a-8695-4d9d7f7806af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:10.756479 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3695/7423] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:38:10 2022] PUT /identity/v3/projects/a7862d08120b4bad8902c1d9c080d36d/users/2a8a21cd4bc1490c82dd3636ac4186b1/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:38:10.767543 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-e252da11-d11c-4c3a-8695-4d9d7f7806af None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:38:10.769963 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-e252da11-d11c-4c3a-8695-4d9d7f7806af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:38:10.854602 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3729/7424] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:38:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:38:10.876084 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da449fb-a373-4d6b-aa33-b1a6a57d1860 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:38:10.881173 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-1da449fb-a373-4d6b-aa33-b1a6a57d1860 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:38:11.004378 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da449fb-a373-4d6b-aa33-b1a6a57d1860 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:38:11.009306 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b19bf8-5e47-4ecf-89c8-1abd78f6d152 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:38:11.010336 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b19bf8-5e47-4ecf-89c8-1abd78f6d152 service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:11.010761 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b19bf8-5e47-4ecf-89c8-1abd78f6d152 service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:11.011176 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b19bf8-5e47-4ecf-89c8-1abd78f6d152 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:11.026452 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b19bf8-5e47-4ecf-89c8-1abd78f6d152 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:38:11.030215 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b19bf8-5e47-4ecf-89c8-1abd78f6d152 service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:38:11.046179 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3696/7425] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:38:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:38:11.401042 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e252da11-d11c-4c3a-8695-4d9d7f7806af None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:38:11.404713 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-e252da11-d11c-4c3a-8695-4d9d7f7806af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:38:11.441592 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e252da11-d11c-4c3a-8695-4d9d7f7806af None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:38:11.457829 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9c742a-c63a-4b32-9676-f936fda50275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:38:11.458919 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9c742a-c63a-4b32-9676-f936fda50275 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:11.459307 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9c742a-c63a-4b32-9676-f936fda50275 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:11.461580 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9c742a-c63a-4b32-9676-f936fda50275 admin admin] PATH_INFO: `/v3/users/70e2c47b8780456681b37da10eea11e7` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:11.463874 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9c742a-c63a-4b32-9676-f936fda50275 admin admin] RBAC: Authorizing `identity:delete_user(user_id=70e2c47b8780456681b37da10eea11e7)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:38:11.472381 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9c742a-c63a-4b32-9676-f936fda50275 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:38:11.598543 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-2d9c742a-c63a-4b32-9676-f936fda50275 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70e2c47b8780456681b37da10eea11e7'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:38:11.607342 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-2d9c742a-c63a-4b32-9676-f936fda50275 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70e2c47b8780456681b37da10eea11e7'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:38:11.624274 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-2d9c742a-c63a-4b32-9676-f936fda50275 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70e2c47b8780456681b37da10eea11e7'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:38:11.637919 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-2d9c742a-c63a-4b32-9676-f936fda50275 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70e2c47b8780456681b37da10eea11e7'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:38:11.641272 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:38:11.701301 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-2d9c742a-c63a-4b32-9676-f936fda50275 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70e2c47b8780456681b37da10eea11e7'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:38:11.712148 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3730/7426] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:38:11 2022] DELETE /identity/v3/users/70e2c47b8780456681b37da10eea11e7 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:38:11.716858 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510ecb37-85be-4966-8b5c-a56277b41fbe None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:11.717732 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510ecb37-85be-4966-8b5c-a56277b41fbe None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:11.718183 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510ecb37-85be-4966-8b5c-a56277b41fbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:11.745820 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-510ecb37-85be-4966-8b5c-a56277b41fbe None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:38:11.747415 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-510ecb37-85be-4966-8b5c-a56277b41fbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:38:11.845963 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3697/7427] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:38:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:38:11.857052 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9c742a-c63a-4b32-9676-f936fda50275 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:38:11.858566 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-2d9c742a-c63a-4b32-9676-f936fda50275 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:38:11.932401 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9c742a-c63a-4b32-9676-f936fda50275 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:38:11.937917 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e3603d-fcff-4278-ac40-ba42c65f2ac8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:38:11.938664 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e3603d-fcff-4278-ac40-ba42c65f2ac8 service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:11.938954 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e3603d-fcff-4278-ac40-ba42c65f2ac8 service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:11.940147 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e3603d-fcff-4278-ac40-ba42c65f2ac8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:11.953221 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e3603d-fcff-4278-ac40-ba42c65f2ac8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:38:11.955204 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e3603d-fcff-4278-ac40-ba42c65f2ac8 service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:38:11.969645 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3731/7428] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:38:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 23 21:38:12.375575 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510ecb37-85be-4966-8b5c-a56277b41fbe None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:38:12.378093 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-510ecb37-85be-4966-8b5c-a56277b41fbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:38:12.396122 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b31f613-c145-4c51-aad1-7e59ab8766ee None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:12.396352 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b31f613-c145-4c51-aad1-7e59ab8766ee None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:12.396633 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b31f613-c145-4c51-aad1-7e59ab8766ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:12.416297 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510ecb37-85be-4966-8b5c-a56277b41fbe None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:38:12.426127 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635ea002-392d-47a9-b60a-40196bf587dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:38:12.427467 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635ea002-392d-47a9-b60a-40196bf587dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:12.428036 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635ea002-392d-47a9-b60a-40196bf587dc admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:12.428541 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635ea002-392d-47a9-b60a-40196bf587dc admin admin] PATH_INFO: `/v3/projects/a54c40f2fc1742738bbefedf3c4418c0` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:12.430345 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635ea002-392d-47a9-b60a-40196bf587dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=a54c40f2fc1742738bbefedf3c4418c0)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:38:12.432701 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635ea002-392d-47a9-b60a-40196bf587dc admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:38:12.434951 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:38:12.449031 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-0b31f613-c145-4c51-aad1-7e59ab8766ee None None] MFA Rules not processed for user `2a8a21cd4bc1490c82dd3636ac4186b1`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:38:12.450572 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-0b31f613-c145-4c51-aad1-7e59ab8766ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:38:12.594020 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-635ea002-392d-47a9-b60a-40196bf587dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a54c40f2fc1742738bbefedf3c4418c0', 'request_id': 'req-635ea002-392d-47a9-b60a-40196bf587dc'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:38:12.623329 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3732/7429] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:38:12 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:38:12.635227 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-635ea002-392d-47a9-b60a-40196bf587dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a54c40f2fc1742738bbefedf3c4418c0', 'request_id': 'req-635ea002-392d-47a9-b60a-40196bf587dc'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:38:12.647188 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-635ea002-392d-47a9-b60a-40196bf587dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a54c40f2fc1742738bbefedf3c4418c0', 'request_id': 'req-635ea002-392d-47a9-b60a-40196bf587dc'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:38:12.661401 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b31f613-c145-4c51-aad1-7e59ab8766ee None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:38:12.663063 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-635ea002-392d-47a9-b60a-40196bf587dc admin admin] The token cache is being invalidate because project a54c40f2fc1742738bbefedf3c4418c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:38:12.663380 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-0b31f613-c145-4c51-aad1-7e59ab8766ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:38:12.666912 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-635ea002-392d-47a9-b60a-40196bf587dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:38:12.670026 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-635ea002-392d-47a9-b60a-40196bf587dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:38:12.674774 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3698/7430] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:38:12 2022] DELETE /identity/v3/projects/a54c40f2fc1742738bbefedf3c4418c0 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:38:12.679950 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a9928d-f7b8-44b6-9233-fb5a76714c0c None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:12.680333 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a9928d-f7b8-44b6-9233-fb5a76714c0c None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:12.680508 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a9928d-f7b8-44b6-9233-fb5a76714c0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:12.725601 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-46a9928d-f7b8-44b6-9233-fb5a76714c0c None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:38:12.727836 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-46a9928d-f7b8-44b6-9233-fb5a76714c0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:38:12.756341 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b31f613-c145-4c51-aad1-7e59ab8766ee None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:38:12.816097 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:38:12.862681 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f4fc34-4335-4c26-bd57-bce05753de8c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec5fd3a489c341b7964704d689037f05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:38:12.863540 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f4fc34-4335-4c26-bd57-bce05753de8c service cinder] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:12.863967 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f4fc34-4335-4c26-bd57-bce05753de8c service cinder] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:12.864540 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f4fc34-4335-4c26-bd57-bce05753de8c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:12.866535 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-70f4fc34-4335-4c26-bd57-bce05753de8c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:38:12.867580 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3699/7431] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:38:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:38:12.876403 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4582f2-e28d-401e-8359-5067fc2b245c None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:12.882257 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4582f2-e28d-401e-8359-5067fc2b245c None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:12.882736 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4582f2-e28d-401e-8359-5067fc2b245c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:12.911907 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-1c4582f2-e28d-401e-8359-5067fc2b245c None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:38:12.913383 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-1c4582f2-e28d-401e-8359-5067fc2b245c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:38:12.925942 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3700/7432] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:38:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:38:12.929653 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4582f2-e28d-401e-8359-5067fc2b245c None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:38:12.949173 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4582f2-e28d-401e-8359-5067fc2b245c None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:38:12.956101 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fc7296-d89d-4cda-8a8f-006b5625f727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:38:12.956851 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fc7296-d89d-4cda-8a8f-006b5625f727 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:12.957138 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fc7296-d89d-4cda-8a8f-006b5625f727 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:12.958131 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fc7296-d89d-4cda-8a8f-006b5625f727 admin admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:12.958953 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fc7296-d89d-4cda-8a8f-006b5625f727 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:38:12.959271 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fc7296-d89d-4cda-8a8f-006b5625f727 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:38:12.962168 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fc7296-d89d-4cda-8a8f-006b5625f727 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:38:12.982252 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3701/7433] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:38:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 21:38:12.986300 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fc7296-d89d-4cda-8a8f-006b5625f727 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:38:12.989929 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f4fc34-4335-4c26-bd57-bce05753de8c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:38:12.991457 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f4fc34-4335-4c26-bd57-bce05753de8c service cinder] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:38:13.001452 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fc7296-d89d-4cda-8a8f-006b5625f727 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:38:13.004888 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3733/7434] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:38:12 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 23 21:38:13.009704 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1ae8c5-8094-41d1-90e3-8fe1f65f70c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:38:13.010777 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1ae8c5-8094-41d1-90e3-8fe1f65f70c1 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:13.010777 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1ae8c5-8094-41d1-90e3-8fe1f65f70c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:13.011060 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1ae8c5-8094-41d1-90e3-8fe1f65f70c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:13.011649 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1ae8c5-8094-41d1-90e3-8fe1f65f70c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:38:13.013627 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1ae8c5-8094-41d1-90e3-8fe1f65f70c1 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:38:13.048436 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3702/7435] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:38:12 2022] POST /identity/v3/projects => generated 371 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:38:13.052074 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f4fc34-4335-4c26-bd57-bce05753de8c service cinder] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:38:13.063503 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f4fc34-4335-4c26-bd57-bce05753de8c service cinder] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:38:13.174443 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9781853-71a9-4f79-ac9e-f01efd7766f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:38:13.175489 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9781853-71a9-4f79-ac9e-f01efd7766f3 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:13.175862 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9781853-71a9-4f79-ac9e-f01efd7766f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:13.176217 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9781853-71a9-4f79-ac9e-f01efd7766f3 admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:13.177080 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9781853-71a9-4f79-ac9e-f01efd7766f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:38:13.180086 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9781853-71a9-4f79-ac9e-f01efd7766f3 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:38:13.211208 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3734/7436] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:38:13 2022] POST /identity/v3/users => generated 286 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:38:13.214214 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1ae8c5-8094-41d1-90e3-8fe1f65f70c1 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:38:13.227673 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1ae8c5-8094-41d1-90e3-8fe1f65f70c1 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:38:13.233823 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcddd782-26d0-4811-9f3f-089ed2f1b4ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:38:13.234827 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcddd782-26d0-4811-9f3f-089ed2f1b4ca admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:13.235110 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcddd782-26d0-4811-9f3f-089ed2f1b4ca admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:13.235397 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcddd782-26d0-4811-9f3f-089ed2f1b4ca admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:13.237379 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcddd782-26d0-4811-9f3f-089ed2f1b4ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:38:13.238292 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcddd782-26d0-4811-9f3f-089ed2f1b4ca admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:38:13.252723 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3703/7437] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:38:13 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:38:13.254157 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9781853-71a9-4f79-ac9e-f01efd7766f3 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:38:13.267360 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9781853-71a9-4f79-ac9e-f01efd7766f3 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:38:13.273370 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abe25a8-f38b-4ba9-b4c3-1fafcf496baa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:38:13.276062 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abe25a8-f38b-4ba9-b4c3-1fafcf496baa admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:13.276449 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abe25a8-f38b-4ba9-b4c3-1fafcf496baa admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:13.276737 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abe25a8-f38b-4ba9-b4c3-1fafcf496baa admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:13.277542 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abe25a8-f38b-4ba9-b4c3-1fafcf496baa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:38:13.279273 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abe25a8-f38b-4ba9-b4c3-1fafcf496baa admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:38:13.295509 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3735/7438] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:38:13 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:38:13.297166 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcddd782-26d0-4811-9f3f-089ed2f1b4ca admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:38:13.309408 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcddd782-26d0-4811-9f3f-089ed2f1b4ca admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:38:13.316016 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a05d0f-80d6-4449-b2d3-edef2bc58b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:38:13.316958 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a05d0f-80d6-4449-b2d3-edef2bc58b4b admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:13.317240 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a05d0f-80d6-4449-b2d3-edef2bc58b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:13.317519 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a05d0f-80d6-4449-b2d3-edef2bc58b4b admin admin] PATH_INFO: `/v3/projects/7a63929cab2c44139d7465b008310955/users/9722b3f840aa418782cee6d98624fb6b/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:13.336542 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a05d0f-80d6-4449-b2d3-edef2bc58b4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a63929cab2c44139d7465b008310955, user_id=9722b3f840aa418782cee6d98624fb6b, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:38:13.340242 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a05d0f-80d6-4449-b2d3-edef2bc58b4b admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:38:13.393598 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3704/7439] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:38:13 2022] PUT /identity/v3/projects/7a63929cab2c44139d7465b008310955/users/9722b3f840aa418782cee6d98624fb6b/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:38:13.395440 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aef810f-95d1-48bf-b4eb-29b9e7766b0b None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:13.395729 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aef810f-95d1-48bf-b4eb-29b9e7766b0b None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:13.396006 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aef810f-95d1-48bf-b4eb-29b9e7766b0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:13.460388 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-2aef810f-95d1-48bf-b4eb-29b9e7766b0b None None] MFA Rules not processed for user `9722b3f840aa418782cee6d98624fb6b`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:38:13.462006 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-2aef810f-95d1-48bf-b4eb-29b9e7766b0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:38:13.561704 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:38:13.599038 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3736/7440] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:38:13 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:38:13.603462 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a05d0f-80d6-4449-b2d3-edef2bc58b4b admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:38:13.640032 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:38:13.719537 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a05d0f-80d6-4449-b2d3-edef2bc58b4b admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:38:13.724111 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6141f94-279c-41bd-8044-a0b25d679fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:38:13.724783 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6141f94-279c-41bd-8044-a0b25d679fb3 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:13.725059 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6141f94-279c-41bd-8044-a0b25d679fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:13.725330 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6141f94-279c-41bd-8044-a0b25d679fb3 admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:13.726056 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6141f94-279c-41bd-8044-a0b25d679fb3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:38:13.727957 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6141f94-279c-41bd-8044-a0b25d679fb3 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:38:13.759712 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3705/7441] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:38:13 2022] POST /identity/v3/projects => generated 373 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:38:13.761030 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aef810f-95d1-48bf-b4eb-29b9e7766b0b None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:38:13.774738 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aef810f-95d1-48bf-b4eb-29b9e7766b0b None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:38:13.843440 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04d6116-c54d-44a2-986d-fad8373495db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:38:13.844148 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04d6116-c54d-44a2-986d-fad8373495db admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:13.844435 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04d6116-c54d-44a2-986d-fad8373495db admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:13.844708 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04d6116-c54d-44a2-986d-fad8373495db admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:13.845400 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04d6116-c54d-44a2-986d-fad8373495db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:38:13.847385 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04d6116-c54d-44a2-986d-fad8373495db admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:38:13.869396 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3737/7442] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:38:13 2022] POST /identity/v3/users => generated 293 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:38:13.873502 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6141f94-279c-41bd-8044-a0b25d679fb3 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:38:13.884248 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6141f94-279c-41bd-8044-a0b25d679fb3 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:38:13.889180 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0a8834-49f3-49f4-9275-a3cb5c194d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:38:13.889904 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0a8834-49f3-49f4-9275-a3cb5c194d3e admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:13.890191 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0a8834-49f3-49f4-9275-a3cb5c194d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:13.890472 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0a8834-49f3-49f4-9275-a3cb5c194d3e admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:13.891258 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0a8834-49f3-49f4-9275-a3cb5c194d3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:38:13.892895 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0a8834-49f3-49f4-9275-a3cb5c194d3e admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:38:13.904711 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3706/7443] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:38:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:38:13.909022 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04d6116-c54d-44a2-986d-fad8373495db admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:38:13.919716 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04d6116-c54d-44a2-986d-fad8373495db admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:38:13.924442 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62bde1b-fdaa-479b-b1eb-db3d36aa6673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:38:13.925364 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62bde1b-fdaa-479b-b1eb-db3d36aa6673 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:13.925655 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62bde1b-fdaa-479b-b1eb-db3d36aa6673 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:13.926063 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62bde1b-fdaa-479b-b1eb-db3d36aa6673 admin admin] PATH_INFO: `/v3/projects/eed4a59d047f4e89a7becd9becd7af63/users/af2c3acd186c461389d8d545053a8833/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:13.942349 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62bde1b-fdaa-479b-b1eb-db3d36aa6673 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eed4a59d047f4e89a7becd9becd7af63, user_id=af2c3acd186c461389d8d545053a8833, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:38:13.945048 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62bde1b-fdaa-479b-b1eb-db3d36aa6673 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:38:13.963087 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3738/7444] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:38:13 2022] PUT /identity/v3/projects/eed4a59d047f4e89a7becd9becd7af63/users/af2c3acd186c461389d8d545053a8833/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:38:13.967626 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0a8834-49f3-49f4-9275-a3cb5c194d3e admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:38:13.978273 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0a8834-49f3-49f4-9275-a3cb5c194d3e admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:38:14.038365 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abc6775-a37b-4483-ada3-24ea98ba878f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:38:14.039058 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abc6775-a37b-4483-ada3-24ea98ba878f admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:14.039338 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abc6775-a37b-4483-ada3-24ea98ba878f admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:14.039607 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abc6775-a37b-4483-ada3-24ea98ba878f admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:14.040349 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abc6775-a37b-4483-ada3-24ea98ba878f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:38:14.042011 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abc6775-a37b-4483-ada3-24ea98ba878f admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:38:14.053120 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3707/7445] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:38:13 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:38:14.058340 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62bde1b-fdaa-479b-b1eb-db3d36aa6673 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:38:14.069604 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62bde1b-fdaa-479b-b1eb-db3d36aa6673 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:38:14.075813 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7789aaad-5c44-4374-a655-912812c1ead3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:38:14.076719 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7789aaad-5c44-4374-a655-912812c1ead3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:14.076995 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7789aaad-5c44-4374-a655-912812c1ead3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:14.077270 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7789aaad-5c44-4374-a655-912812c1ead3 admin admin] PATH_INFO: `/v3/projects/eed4a59d047f4e89a7becd9becd7af63/users/af2c3acd186c461389d8d545053a8833/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:14.079497 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7789aaad-5c44-4374-a655-912812c1ead3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eed4a59d047f4e89a7becd9becd7af63, user_id=af2c3acd186c461389d8d545053a8833, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:38:14.082336 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7789aaad-5c44-4374-a655-912812c1ead3 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:38:14.094843 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3739/7446] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:38:14 2022] PUT /identity/v3/projects/eed4a59d047f4e89a7becd9becd7af63/users/af2c3acd186c461389d8d545053a8833/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:38:14.106291 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0f0265-76b3-4a93-960c-965b5fc42cac None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:14.106581 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0f0265-76b3-4a93-960c-965b5fc42cac None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:14.106871 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0f0265-76b3-4a93-960c-965b5fc42cac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:14.136495 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-bd0f0265-76b3-4a93-960c-965b5fc42cac None None] MFA Rules not processed for user `af2c3acd186c461389d8d545053a8833`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:38:14.137889 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-bd0f0265-76b3-4a93-960c-965b5fc42cac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:38:14.211916 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3708/7447] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:38:14 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:38:14.223749 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7789aaad-5c44-4374-a655-912812c1ead3 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:38:14.225825 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-7789aaad-5c44-4374-a655-912812c1ead3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:38:14.288799 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7789aaad-5c44-4374-a655-912812c1ead3 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:38:14.292671 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb38bdd-00c8-4739-b64f-59e6a8c7b34b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec5fd3a489c341b7964704d689037f05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:38:14.293369 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb38bdd-00c8-4739-b64f-59e6a8c7b34b service cinder] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:14.293664 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb38bdd-00c8-4739-b64f-59e6a8c7b34b service cinder] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:14.293973 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb38bdd-00c8-4739-b64f-59e6a8c7b34b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:14.303813 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb38bdd-00c8-4739-b64f-59e6a8c7b34b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:38:14.305295 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb38bdd-00c8-4739-b64f-59e6a8c7b34b service cinder] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:38:14.315358 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3740/7448] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:38:14 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:38:14.410625 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0f0265-76b3-4a93-960c-965b5fc42cac None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:38:14.423790 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0f0265-76b3-4a93-960c-965b5fc42cac None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:38:14.428023 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f3c6e9-fb5d-4457-898b-96e3c41d207a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec5fd3a489c341b7964704d689037f05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:38:14.428732 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f3c6e9-fb5d-4457-898b-96e3c41d207a service cinder] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:14.428986 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f3c6e9-fb5d-4457-898b-96e3c41d207a service cinder] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:14.429887 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f3c6e9-fb5d-4457-898b-96e3c41d207a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:14.436142 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:38:14.495241 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f3c6e9-fb5d-4457-898b-96e3c41d207a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:38:14.496838 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f3c6e9-fb5d-4457-898b-96e3c41d207a service cinder] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:38:14.506530 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3709/7449] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:38:14 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:38:15.709077 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb38bdd-00c8-4739-b64f-59e6a8c7b34b service cinder] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:38:15.712334 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-1fb38bdd-00c8-4739-b64f-59e6a8c7b34b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:38:15.776857 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f3c6e9-fb5d-4457-898b-96e3c41d207a service cinder] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:38:15.778770 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-46f3c6e9-fb5d-4457-898b-96e3c41d207a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:38:15.793041 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:38:15.826207 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb38bdd-00c8-4739-b64f-59e6a8c7b34b service cinder] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:38:15.834738 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca6d02b-d976-4029-95dd-fda474da0de7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc719a3b3ac4461b82ca04ab6451d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:38:15.835636 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca6d02b-d976-4029-95dd-fda474da0de7 service placement] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:15.835983 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca6d02b-d976-4029-95dd-fda474da0de7 service placement] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:15.836431 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca6d02b-d976-4029-95dd-fda474da0de7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:15.838496 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-dca6d02b-d976-4029-95dd-fda474da0de7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:38:15.855716 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca6d02b-d976-4029-95dd-fda474da0de7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:38:15.857962 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca6d02b-d976-4029-95dd-fda474da0de7 service placement] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:38:15.875170 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f3c6e9-fb5d-4457-898b-96e3c41d207a service cinder] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:38:15.875769 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3741/7450] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:38:15 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:38:15.882563 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba83686-527c-419d-9a2d-8fcfacdaaca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:38:15.883477 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba83686-527c-419d-9a2d-8fcfacdaaca3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:15.883747 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba83686-527c-419d-9a2d-8fcfacdaaca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:15.884048 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba83686-527c-419d-9a2d-8fcfacdaaca3 admin admin] PATH_INFO: `/v3/users/2a8a21cd4bc1490c82dd3636ac4186b1` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:15.885290 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba83686-527c-419d-9a2d-8fcfacdaaca3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a8a21cd4bc1490c82dd3636ac4186b1)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:38:15.887405 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba83686-527c-419d-9a2d-8fcfacdaaca3 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:38:15.944571 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-dba83686-527c-419d-9a2d-8fcfacdaaca3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a8a21cd4bc1490c82dd3636ac4186b1'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:38:15.954163 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-dba83686-527c-419d-9a2d-8fcfacdaaca3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a8a21cd4bc1490c82dd3636ac4186b1'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:38:15.955182 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-dba83686-527c-419d-9a2d-8fcfacdaaca3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a8a21cd4bc1490c82dd3636ac4186b1'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:38:15.964560 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-dba83686-527c-419d-9a2d-8fcfacdaaca3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a8a21cd4bc1490c82dd3636ac4186b1'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:38:15.987205 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-dba83686-527c-419d-9a2d-8fcfacdaaca3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a8a21cd4bc1490c82dd3636ac4186b1'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:38:15.994187 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3710/7451] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:38:15 2022] DELETE /identity/v3/users/2a8a21cd4bc1490c82dd3636ac4186b1 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:38:16.196526 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca6d02b-d976-4029-95dd-fda474da0de7 service placement] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:38:16.219282 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca6d02b-d976-4029-95dd-fda474da0de7 service placement] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:38:16.304651 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697bdf39-0958-49af-a01b-bbe53eee993a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:38:16.305921 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697bdf39-0958-49af-a01b-bbe53eee993a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:16.306212 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697bdf39-0958-49af-a01b-bbe53eee993a admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:16.306652 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697bdf39-0958-49af-a01b-bbe53eee993a admin admin] PATH_INFO: `/v3/projects/a7862d08120b4bad8902c1d9c080d36d` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:16.308154 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697bdf39-0958-49af-a01b-bbe53eee993a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7862d08120b4bad8902c1d9c080d36d)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:38:16.310889 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697bdf39-0958-49af-a01b-bbe53eee993a admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:38:16.364488 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-697bdf39-0958-49af-a01b-bbe53eee993a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7862d08120b4bad8902c1d9c080d36d', 'request_id': 'req-697bdf39-0958-49af-a01b-bbe53eee993a'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:38:16.374588 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-697bdf39-0958-49af-a01b-bbe53eee993a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7862d08120b4bad8902c1d9c080d36d', 'request_id': 'req-697bdf39-0958-49af-a01b-bbe53eee993a'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:38:16.381423 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-697bdf39-0958-49af-a01b-bbe53eee993a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7862d08120b4bad8902c1d9c080d36d', 'request_id': 'req-697bdf39-0958-49af-a01b-bbe53eee993a'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:38:16.393427 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-697bdf39-0958-49af-a01b-bbe53eee993a admin admin] The token cache is being invalidate because project a7862d08120b4bad8902c1d9c080d36d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:38:16.393714 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-697bdf39-0958-49af-a01b-bbe53eee993a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:38:16.394529 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-697bdf39-0958-49af-a01b-bbe53eee993a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:38:16.396109 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3742/7452] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:38:16 2022] DELETE /identity/v3/projects/a7862d08120b4bad8902c1d9c080d36d => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:38:16.403800 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad16e47e-3029-49cc-8862-73ce60298b35 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:16.404200 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad16e47e-3029-49cc-8862-73ce60298b35 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:16.404545 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad16e47e-3029-49cc-8862-73ce60298b35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:16.423867 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-ad16e47e-3029-49cc-8862-73ce60298b35 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:38:16.425268 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-ad16e47e-3029-49cc-8862-73ce60298b35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:38:16.449409 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:38:16.493904 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3711/7453] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:38:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:38:16.502388 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a98763b-d2fe-4177-ae30-0a4ea2514808 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:16.502677 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a98763b-d2fe-4177-ae30-0a4ea2514808 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:16.502955 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a98763b-d2fe-4177-ae30-0a4ea2514808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:16.523329 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-5a98763b-d2fe-4177-ae30-0a4ea2514808 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:38:16.524587 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-5a98763b-d2fe-4177-ae30-0a4ea2514808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:38:16.538748 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3743/7454] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:38:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:38:16.540307 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad16e47e-3029-49cc-8862-73ce60298b35 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:38:16.552351 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad16e47e-3029-49cc-8862-73ce60298b35 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:38:16.561681 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e28f1a-f39c-4114-9db3-df907a91453d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:38:16.562445 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e28f1a-f39c-4114-9db3-df907a91453d admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:16.562726 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e28f1a-f39c-4114-9db3-df907a91453d admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:16.562999 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e28f1a-f39c-4114-9db3-df907a91453d admin admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:16.563737 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e28f1a-f39c-4114-9db3-df907a91453d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:38:16.564179 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e28f1a-f39c-4114-9db3-df907a91453d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:38:16.565795 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e28f1a-f39c-4114-9db3-df907a91453d admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:38:16.582413 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3712/7455] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:38:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:38:16.583599 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a98763b-d2fe-4177-ae30-0a4ea2514808 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:38:16.594038 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a98763b-d2fe-4177-ae30-0a4ea2514808 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:38:16.598991 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51633ce8-6e7d-46e9-98d0-9cdac781f2b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:38:16.599669 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51633ce8-6e7d-46e9-98d0-9cdac781f2b5 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:16.599949 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51633ce8-6e7d-46e9-98d0-9cdac781f2b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:16.600218 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51633ce8-6e7d-46e9-98d0-9cdac781f2b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:16.600917 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51633ce8-6e7d-46e9-98d0-9cdac781f2b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:38:16.602895 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51633ce8-6e7d-46e9-98d0-9cdac781f2b5 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:38:16.632214 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3744/7456] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:38:16 2022] POST /identity/v3/projects => generated 371 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:38:16.636911 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e28f1a-f39c-4114-9db3-df907a91453d admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:38:16.647860 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e28f1a-f39c-4114-9db3-df907a91453d admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:38:16.759592 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b282d19-e27e-4428-bdfa-b62c90e3f536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:38:16.760384 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b282d19-e27e-4428-bdfa-b62c90e3f536 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:16.761221 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b282d19-e27e-4428-bdfa-b62c90e3f536 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:16.761601 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b282d19-e27e-4428-bdfa-b62c90e3f536 admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:16.762539 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b282d19-e27e-4428-bdfa-b62c90e3f536 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:38:16.764704 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b282d19-e27e-4428-bdfa-b62c90e3f536 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:38:16.805365 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3713/7457] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:38:16 2022] POST /identity/v3/users => generated 286 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:38:16.806917 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51633ce8-6e7d-46e9-98d0-9cdac781f2b5 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:38:16.833000 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51633ce8-6e7d-46e9-98d0-9cdac781f2b5 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:38:16.846700 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f500b573-9144-4f34-a43a-d0d83c404243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:38:16.847686 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f500b573-9144-4f34-a43a-d0d83c404243 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:16.847979 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f500b573-9144-4f34-a43a-d0d83c404243 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:16.848247 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f500b573-9144-4f34-a43a-d0d83c404243 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:16.848985 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f500b573-9144-4f34-a43a-d0d83c404243 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:38:16.850682 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f500b573-9144-4f34-a43a-d0d83c404243 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:38:16.865709 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3745/7458] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:38:16 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:38:16.866979 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b282d19-e27e-4428-bdfa-b62c90e3f536 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:38:16.896177 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b282d19-e27e-4428-bdfa-b62c90e3f536 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:38:16.902086 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1702563-732a-42cc-8c69-67bf1dfd12fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:38:16.902756 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1702563-732a-42cc-8c69-67bf1dfd12fe admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:16.903037 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1702563-732a-42cc-8c69-67bf1dfd12fe admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:16.903314 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1702563-732a-42cc-8c69-67bf1dfd12fe admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:16.904057 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1702563-732a-42cc-8c69-67bf1dfd12fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:38:16.905701 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1702563-732a-42cc-8c69-67bf1dfd12fe admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:38:16.920454 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3714/7459] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:38:16 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:38:16.921847 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f500b573-9144-4f34-a43a-d0d83c404243 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:38:16.936592 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f500b573-9144-4f34-a43a-d0d83c404243 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:38:16.942484 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc7400d-2d14-40aa-a1b7-d104f7f2b701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:38:16.944609 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc7400d-2d14-40aa-a1b7-d104f7f2b701 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:16.944954 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc7400d-2d14-40aa-a1b7-d104f7f2b701 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:16.945320 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc7400d-2d14-40aa-a1b7-d104f7f2b701 admin admin] PATH_INFO: `/v3/projects/671965122db6464493404ca387b8a123/users/5d7f64c4f90344c3b23e601bd2b10c1a/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:16.964067 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc7400d-2d14-40aa-a1b7-d104f7f2b701 admin admin] RBAC: Authorizing `identity:create_grant(project_id=671965122db6464493404ca387b8a123, user_id=5d7f64c4f90344c3b23e601bd2b10c1a, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:38:16.967381 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc7400d-2d14-40aa-a1b7-d104f7f2b701 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:38:16.989366 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3746/7460] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:38:16 2022] PUT /identity/v3/projects/671965122db6464493404ca387b8a123/users/5d7f64c4f90344c3b23e601bd2b10c1a/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:38:17.001243 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b376100e-dcb0-4539-a866-3a27a2fe972d None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:17.001533 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b376100e-dcb0-4539-a866-3a27a2fe972d None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:17.001815 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b376100e-dcb0-4539-a866-3a27a2fe972d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:17.040029 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-b376100e-dcb0-4539-a866-3a27a2fe972d None None] MFA Rules not processed for user `5d7f64c4f90344c3b23e601bd2b10c1a`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:38:17.041767 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-b376100e-dcb0-4539-a866-3a27a2fe972d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:38:17.329782 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3715/7461] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:38:16 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:38:17.356247 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc7400d-2d14-40aa-a1b7-d104f7f2b701 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:38:17.358076 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-5bc7400d-2d14-40aa-a1b7-d104f7f2b701 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:38:17.363630 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:38:17.440811 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc7400d-2d14-40aa-a1b7-d104f7f2b701 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:38:17.447238 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d0db5f-f572-4642-9e69-63736afddb62 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec5fd3a489c341b7964704d689037f05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:38:17.448143 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d0db5f-f572-4642-9e69-63736afddb62 service cinder] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:17.448572 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d0db5f-f572-4642-9e69-63736afddb62 service cinder] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:17.449005 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d0db5f-f572-4642-9e69-63736afddb62 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:17.458928 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d0db5f-f572-4642-9e69-63736afddb62 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:38:17.460375 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d0db5f-f572-4642-9e69-63736afddb62 service cinder] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:38:17.471068 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3747/7462] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:38:17 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:38:20.071889 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b376100e-dcb0-4539-a866-3a27a2fe972d None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:38:20.073839 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-b376100e-dcb0-4539-a866-3a27a2fe972d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:38:20.104243 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:38:20.149327 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b376100e-dcb0-4539-a866-3a27a2fe972d None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:38:20.154522 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46aaee2-eedc-4e7f-9aca-355e5d759559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:38:20.155428 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46aaee2-eedc-4e7f-9aca-355e5d759559 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:20.155709 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46aaee2-eedc-4e7f-9aca-355e5d759559 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:20.155966 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46aaee2-eedc-4e7f-9aca-355e5d759559 admin admin] PATH_INFO: `/v3/users/9722b3f840aa418782cee6d98624fb6b` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:20.157198 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46aaee2-eedc-4e7f-9aca-355e5d759559 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9722b3f840aa418782cee6d98624fb6b)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:38:20.159377 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46aaee2-eedc-4e7f-9aca-355e5d759559 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:38:20.217729 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-d46aaee2-eedc-4e7f-9aca-355e5d759559 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9722b3f840aa418782cee6d98624fb6b'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:38:20.225506 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-d46aaee2-eedc-4e7f-9aca-355e5d759559 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9722b3f840aa418782cee6d98624fb6b'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:38:20.226394 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-d46aaee2-eedc-4e7f-9aca-355e5d759559 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9722b3f840aa418782cee6d98624fb6b'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:38:20.235403 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-d46aaee2-eedc-4e7f-9aca-355e5d759559 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9722b3f840aa418782cee6d98624fb6b'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:38:20.270229 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-d46aaee2-eedc-4e7f-9aca-355e5d759559 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9722b3f840aa418782cee6d98624fb6b'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:38:20.277641 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3716/7463] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:38:20 2022] DELETE /identity/v3/users/9722b3f840aa418782cee6d98624fb6b => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:38:20.282028 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b2d6c7-25f5-4bfe-8d93-52c450b1b489 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:20.282507 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b2d6c7-25f5-4bfe-8d93-52c450b1b489 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:20.282595 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b2d6c7-25f5-4bfe-8d93-52c450b1b489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:20.302640 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-a3b2d6c7-25f5-4bfe-8d93-52c450b1b489 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:38:20.304041 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-a3b2d6c7-25f5-4bfe-8d93-52c450b1b489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:38:20.371773 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3748/7464] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:38:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:38:20.385889 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46aaee2-eedc-4e7f-9aca-355e5d759559 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:38:20.387380 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-d46aaee2-eedc-4e7f-9aca-355e5d759559 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:38:20.468369 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46aaee2-eedc-4e7f-9aca-355e5d759559 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:38:20.472054 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11365fce-af11-4738-98fe-612341c1a45d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:38:20.472723 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11365fce-af11-4738-98fe-612341c1a45d service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:20.473005 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11365fce-af11-4738-98fe-612341c1a45d service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:20.473281 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11365fce-af11-4738-98fe-612341c1a45d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:20.483297 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11365fce-af11-4738-98fe-612341c1a45d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:38:20.484689 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11365fce-af11-4738-98fe-612341c1a45d service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:38:20.495280 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3717/7465] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:38:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:38:21.088850 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b2d6c7-25f5-4bfe-8d93-52c450b1b489 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:38:21.091115 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-a3b2d6c7-25f5-4bfe-8d93-52c450b1b489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:38:21.106704 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b2d6c7-25f5-4bfe-8d93-52c450b1b489 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:38:21.112025 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11365fce-af11-4738-98fe-612341c1a45d service neutron] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:38:21.113605 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-11365fce-af11-4738-98fe-612341c1a45d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:38:21.116006 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16099c74-0e1e-4a5e-8ee9-8d77efbdab9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:38:21.116992 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16099c74-0e1e-4a5e-8ee9-8d77efbdab9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:21.117346 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16099c74-0e1e-4a5e-8ee9-8d77efbdab9a admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:21.117704 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16099c74-0e1e-4a5e-8ee9-8d77efbdab9a admin admin] PATH_INFO: `/v3/users/5d7f64c4f90344c3b23e601bd2b10c1a` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:21.119071 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16099c74-0e1e-4a5e-8ee9-8d77efbdab9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d7f64c4f90344c3b23e601bd2b10c1a)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:38:21.121570 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16099c74-0e1e-4a5e-8ee9-8d77efbdab9a admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:38:21.136817 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11365fce-af11-4738-98fe-612341c1a45d service neutron] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:38:21.150732 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a7e184-4df8-4efb-b3ed-82910d03f63a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:38:21.151641 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a7e184-4df8-4efb-b3ed-82910d03f63a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:21.151909 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a7e184-4df8-4efb-b3ed-82910d03f63a admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:21.152258 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a7e184-4df8-4efb-b3ed-82910d03f63a admin admin] PATH_INFO: `/v3/projects/7a63929cab2c44139d7465b008310955` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:21.153887 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a7e184-4df8-4efb-b3ed-82910d03f63a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a63929cab2c44139d7465b008310955)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:38:21.155829 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a7e184-4df8-4efb-b3ed-82910d03f63a admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:38:21.218458 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:38:21.228815 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-39a7e184-4df8-4efb-b3ed-82910d03f63a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a63929cab2c44139d7465b008310955', 'request_id': 'req-39a7e184-4df8-4efb-b3ed-82910d03f63a'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:38:21.237070 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-16099c74-0e1e-4a5e-8ee9-8d77efbdab9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d7f64c4f90344c3b23e601bd2b10c1a'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:38:21.238280 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-16099c74-0e1e-4a5e-8ee9-8d77efbdab9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d7f64c4f90344c3b23e601bd2b10c1a'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:38:21.241374 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-39a7e184-4df8-4efb-b3ed-82910d03f63a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a63929cab2c44139d7465b008310955', 'request_id': 'req-39a7e184-4df8-4efb-b3ed-82910d03f63a'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:38:21.247089 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-16099c74-0e1e-4a5e-8ee9-8d77efbdab9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d7f64c4f90344c3b23e601bd2b10c1a'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:38:21.248554 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-39a7e184-4df8-4efb-b3ed-82910d03f63a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a63929cab2c44139d7465b008310955', 'request_id': 'req-39a7e184-4df8-4efb-b3ed-82910d03f63a'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:38:21.259709 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-16099c74-0e1e-4a5e-8ee9-8d77efbdab9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d7f64c4f90344c3b23e601bd2b10c1a'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:38:21.262845 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-39a7e184-4df8-4efb-b3ed-82910d03f63a admin admin] The token cache is being invalidate because project 7a63929cab2c44139d7465b008310955 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:38:21.263133 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-39a7e184-4df8-4efb-b3ed-82910d03f63a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:38:21.264100 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-39a7e184-4df8-4efb-b3ed-82910d03f63a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:38:21.267903 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3718/7466] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:38:21 2022] DELETE /identity/v3/projects/7a63929cab2c44139d7465b008310955 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:38:21.271831 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a7e184-4df8-4efb-b3ed-82910d03f63a admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:38:21.273192 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-39a7e184-4df8-4efb-b3ed-82910d03f63a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:38:21.278657 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-16099c74-0e1e-4a5e-8ee9-8d77efbdab9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d7f64c4f90344c3b23e601bd2b10c1a'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:38:21.291303 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3749/7467] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:38:21 2022] DELETE /identity/v3/users/5d7f64c4f90344c3b23e601bd2b10c1a => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:38:21.292960 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438f21dd-9ac9-4024-bbdc-8ed2e844d801 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:21.293253 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438f21dd-9ac9-4024-bbdc-8ed2e844d801 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:21.293568 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438f21dd-9ac9-4024-bbdc-8ed2e844d801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:21.313451 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-438f21dd-9ac9-4024-bbdc-8ed2e844d801 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:38:21.315001 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-438f21dd-9ac9-4024-bbdc-8ed2e844d801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:38:21.335181 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:38:21.355762 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a7e184-4df8-4efb-b3ed-82910d03f63a admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:38:21.381175 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3750/7468] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:38:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:38:21.393528 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438f21dd-9ac9-4024-bbdc-8ed2e844d801 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:38:21.395012 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-438f21dd-9ac9-4024-bbdc-8ed2e844d801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:38:21.424906 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91730c1-c422-471a-88fa-2e3d9b953db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:38:21.425900 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91730c1-c422-471a-88fa-2e3d9b953db2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:21.426249 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91730c1-c422-471a-88fa-2e3d9b953db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:21.426711 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91730c1-c422-471a-88fa-2e3d9b953db2 admin admin] PATH_INFO: `/v3/users/af2c3acd186c461389d8d545053a8833` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:21.428066 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91730c1-c422-471a-88fa-2e3d9b953db2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af2c3acd186c461389d8d545053a8833)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:38:21.430362 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91730c1-c422-471a-88fa-2e3d9b953db2 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:38:21.464234 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438f21dd-9ac9-4024-bbdc-8ed2e844d801 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:38:21.468708 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d36870-49d9-4f5d-a0e0-86386fa7accd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:38:21.469503 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d36870-49d9-4f5d-a0e0-86386fa7accd service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:21.469856 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d36870-49d9-4f5d-a0e0-86386fa7accd service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:21.470236 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d36870-49d9-4f5d-a0e0-86386fa7accd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:21.481220 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d36870-49d9-4f5d-a0e0-86386fa7accd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:38:21.482836 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d36870-49d9-4f5d-a0e0-86386fa7accd service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:38:21.486251 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-e91730c1-c422-471a-88fa-2e3d9b953db2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af2c3acd186c461389d8d545053a8833'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:38:21.493797 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-e91730c1-c422-471a-88fa-2e3d9b953db2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af2c3acd186c461389d8d545053a8833'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:38:21.494632 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-e91730c1-c422-471a-88fa-2e3d9b953db2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af2c3acd186c461389d8d545053a8833'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:38:21.498045 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3751/7469] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:38:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:38:21.504208 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-e91730c1-c422-471a-88fa-2e3d9b953db2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af2c3acd186c461389d8d545053a8833'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:38:21.516120 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:38:21.519449 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-e91730c1-c422-471a-88fa-2e3d9b953db2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af2c3acd186c461389d8d545053a8833'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:38:21.528682 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3719/7470] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:38:21 2022] DELETE /identity/v3/users/af2c3acd186c461389d8d545053a8833 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:38:22.018559 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d36870-49d9-4f5d-a0e0-86386fa7accd service neutron] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:38:22.020318 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-91d36870-49d9-4f5d-a0e0-86386fa7accd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:38:22.040050 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d36870-49d9-4f5d-a0e0-86386fa7accd service neutron] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:38:22.070338 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91730c1-c422-471a-88fa-2e3d9b953db2 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:38:22.072330 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-e91730c1-c422-471a-88fa-2e3d9b953db2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:38:22.174527 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce330908-8c74-47d2-9eac-1c48a7381bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:38:22.176253 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce330908-8c74-47d2-9eac-1c48a7381bd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:22.176655 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce330908-8c74-47d2-9eac-1c48a7381bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:22.177525 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce330908-8c74-47d2-9eac-1c48a7381bd9 admin admin] PATH_INFO: `/v3/projects/671965122db6464493404ca387b8a123` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:22.179296 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce330908-8c74-47d2-9eac-1c48a7381bd9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=671965122db6464493404ca387b8a123)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:38:22.181772 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce330908-8c74-47d2-9eac-1c48a7381bd9 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:38:22.193110 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91730c1-c422-471a-88fa-2e3d9b953db2 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:38:22.200327 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e423b927-56ce-43cc-bd8b-c21fb8c317c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:38:22.201233 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e423b927-56ce-43cc-bd8b-c21fb8c317c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:22.201514 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e423b927-56ce-43cc-bd8b-c21fb8c317c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:22.201789 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e423b927-56ce-43cc-bd8b-c21fb8c317c8 admin admin] PATH_INFO: `/v3/projects/eed4a59d047f4e89a7becd9becd7af63` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:22.203565 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e423b927-56ce-43cc-bd8b-c21fb8c317c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eed4a59d047f4e89a7becd9becd7af63)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:38:22.205820 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e423b927-56ce-43cc-bd8b-c21fb8c317c8 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:38:22.249593 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-ce330908-8c74-47d2-9eac-1c48a7381bd9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '671965122db6464493404ca387b8a123', 'request_id': 'req-ce330908-8c74-47d2-9eac-1c48a7381bd9'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:38:22.262163 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-ce330908-8c74-47d2-9eac-1c48a7381bd9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '671965122db6464493404ca387b8a123', 'request_id': 'req-ce330908-8c74-47d2-9eac-1c48a7381bd9'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:38:22.269638 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:38:22.271397 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-ce330908-8c74-47d2-9eac-1c48a7381bd9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '671965122db6464493404ca387b8a123', 'request_id': 'req-ce330908-8c74-47d2-9eac-1c48a7381bd9'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:38:22.273508 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-e423b927-56ce-43cc-bd8b-c21fb8c317c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eed4a59d047f4e89a7becd9becd7af63', 'request_id': 'req-e423b927-56ce-43cc-bd8b-c21fb8c317c8'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:38:22.283654 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-e423b927-56ce-43cc-bd8b-c21fb8c317c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eed4a59d047f4e89a7becd9becd7af63', 'request_id': 'req-e423b927-56ce-43cc-bd8b-c21fb8c317c8'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:38:22.291693 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-ce330908-8c74-47d2-9eac-1c48a7381bd9 admin admin] The token cache is being invalidate because project 671965122db6464493404ca387b8a123 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:38:22.292517 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-ce330908-8c74-47d2-9eac-1c48a7381bd9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:38:22.293547 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-ce330908-8c74-47d2-9eac-1c48a7381bd9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:38:22.295744 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3752/7471] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:38:22 2022] DELETE /identity/v3/projects/671965122db6464493404ca387b8a123 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:38:22.296082 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-e423b927-56ce-43cc-bd8b-c21fb8c317c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eed4a59d047f4e89a7becd9becd7af63', 'request_id': 'req-e423b927-56ce-43cc-bd8b-c21fb8c317c8'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:38:22.301993 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a18e82a-3ae0-46a0-ac81-b7b020538354 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:22.302491 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a18e82a-3ae0-46a0-ac81-b7b020538354 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:22.302770 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a18e82a-3ae0-46a0-ac81-b7b020538354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:22.315682 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-e423b927-56ce-43cc-bd8b-c21fb8c317c8 admin admin] The token cache is being invalidate because project eed4a59d047f4e89a7becd9becd7af63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:38:22.316132 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-e423b927-56ce-43cc-bd8b-c21fb8c317c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:38:22.318307 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-e423b927-56ce-43cc-bd8b-c21fb8c317c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:38:22.321813 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3720/7472] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:38:22 2022] DELETE /identity/v3/projects/eed4a59d047f4e89a7becd9becd7af63 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:38:22.324768 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-9a18e82a-3ae0-46a0-ac81-b7b020538354 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:38:22.326280 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-9a18e82a-3ae0-46a0-ac81-b7b020538354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:38:22.331361 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5360d6d3-90c3-4c94-b4da-03031e4d0450 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:22.331750 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5360d6d3-90c3-4c94-b4da-03031e4d0450 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:22.332722 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5360d6d3-90c3-4c94-b4da-03031e4d0450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:22.351590 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-5360d6d3-90c3-4c94-b4da-03031e4d0450 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:38:22.353116 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-5360d6d3-90c3-4c94-b4da-03031e4d0450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:38:22.400808 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3753/7473] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:38:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:38:22.415472 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc560d83-3191-4670-b495-eb4f0646b76f None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:22.416587 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc560d83-3191-4670-b495-eb4f0646b76f None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:22.417043 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc560d83-3191-4670-b495-eb4f0646b76f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:22.454310 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-fc560d83-3191-4670-b495-eb4f0646b76f None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:38:22.455570 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-fc560d83-3191-4670-b495-eb4f0646b76f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:38:22.461375 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3721/7474] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:38:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:38:22.468430 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6bdd57-9e60-4c46-b93a-d86041a2d01b None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:22.468760 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6bdd57-9e60-4c46-b93a-d86041a2d01b None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:22.469006 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6bdd57-9e60-4c46-b93a-d86041a2d01b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:22.477819 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3754/7475] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:38:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:38:22.485731 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc560d83-3191-4670-b495-eb4f0646b76f None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:38:22.493460 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-fd6bdd57-9e60-4c46-b93a-d86041a2d01b None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:38:22.494902 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-fd6bdd57-9e60-4c46-b93a-d86041a2d01b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:38:22.506366 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3722/7476] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:38:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:38:22.508768 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc560d83-3191-4670-b495-eb4f0646b76f None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:38:22.512837 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6bdd57-9e60-4c46-b93a-d86041a2d01b None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:38:22.515252 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5704f372-7890-4366-9ed9-981a3298dbd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:38:22.515952 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5704f372-7890-4366-9ed9-981a3298dbd4 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:22.516235 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5704f372-7890-4366-9ed9-981a3298dbd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:22.516504 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5704f372-7890-4366-9ed9-981a3298dbd4 admin admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:22.517424 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5704f372-7890-4366-9ed9-981a3298dbd4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:38:22.518615 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5704f372-7890-4366-9ed9-981a3298dbd4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:38:22.519553 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5704f372-7890-4366-9ed9-981a3298dbd4 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:38:22.533275 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3755/7477] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:38:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:38:22.533517 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6bdd57-9e60-4c46-b93a-d86041a2d01b None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:38:22.538586 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5704f372-7890-4366-9ed9-981a3298dbd4 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:38:22.551293 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5391a1f-1a71-4135-97c0-16e917c7ff5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:38:22.552135 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5391a1f-1a71-4135-97c0-16e917c7ff5d admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:22.552521 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5391a1f-1a71-4135-97c0-16e917c7ff5d admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:22.552888 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5391a1f-1a71-4135-97c0-16e917c7ff5d admin admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:22.553727 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5391a1f-1a71-4135-97c0-16e917c7ff5d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:38:22.554465 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5391a1f-1a71-4135-97c0-16e917c7ff5d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:38:22.556206 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5391a1f-1a71-4135-97c0-16e917c7ff5d admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:38:22.563419 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5704f372-7890-4366-9ed9-981a3298dbd4 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:38:22.576594 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999200a0-1cf0-432b-8ac1-c49560311745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:38:22.577406 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999200a0-1cf0-432b-8ac1-c49560311745 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:22.577898 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999200a0-1cf0-432b-8ac1-c49560311745 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:22.578183 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999200a0-1cf0-432b-8ac1-c49560311745 admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:22.578979 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999200a0-1cf0-432b-8ac1-c49560311745 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:38:22.582361 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999200a0-1cf0-432b-8ac1-c49560311745 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:38:22.588522 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3723/7478] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:38:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:38:22.589829 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5391a1f-1a71-4135-97c0-16e917c7ff5d admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:38:22.609288 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:38:22.616232 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5391a1f-1a71-4135-97c0-16e917c7ff5d admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:38:22.624313 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621c5a4e-b3d7-47b0-8596-40aff0a693ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:38:22.625039 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621c5a4e-b3d7-47b0-8596-40aff0a693ce admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:22.625551 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621c5a4e-b3d7-47b0-8596-40aff0a693ce admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:22.625826 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621c5a4e-b3d7-47b0-8596-40aff0a693ce admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:22.627391 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3756/7479] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:38:22 2022] POST /identity/v3/projects => generated 375 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:38:22.632263 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999200a0-1cf0-432b-8ac1-c49560311745 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:38:22.636301 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621c5a4e-b3d7-47b0-8596-40aff0a693ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:38:22.642285 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621c5a4e-b3d7-47b0-8596-40aff0a693ce admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:38:22.694721 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3724/7480] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:38:22 2022] POST /identity/v3/projects => generated 371 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:38:22.698569 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621c5a4e-b3d7-47b0-8596-40aff0a693ce admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:38:22.773581 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999200a0-1cf0-432b-8ac1-c49560311745 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:38:22.828658 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621c5a4e-b3d7-47b0-8596-40aff0a693ce admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:38:22.844722 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6cd3c0-698e-4d57-ac57-75989cdc91cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:38:22.846098 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6cd3c0-698e-4d57-ac57-75989cdc91cf admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:22.847445 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6cd3c0-698e-4d57-ac57-75989cdc91cf admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:22.848824 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6cd3c0-698e-4d57-ac57-75989cdc91cf admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:22.849832 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6cd3c0-698e-4d57-ac57-75989cdc91cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:38:22.855368 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6cd3c0-698e-4d57-ac57-75989cdc91cf admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:38:22.870313 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:38:22.878452 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef73b47-3148-4d12-9091-b34fafe88b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:38:22.879695 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef73b47-3148-4d12-9091-b34fafe88b42 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:22.880271 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef73b47-3148-4d12-9091-b34fafe88b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:22.880681 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef73b47-3148-4d12-9091-b34fafe88b42 admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:22.881697 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef73b47-3148-4d12-9091-b34fafe88b42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:38:22.884015 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef73b47-3148-4d12-9091-b34fafe88b42 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:38:22.887042 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3725/7481] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:38:22 2022] POST /identity/v3/users => generated 286 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:38:22.890533 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6cd3c0-698e-4d57-ac57-75989cdc91cf admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:38:22.910847 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6cd3c0-698e-4d57-ac57-75989cdc91cf admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:38:22.919975 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5055a647-3006-4699-a615-3b0ab846e5c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:38:22.921692 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3757/7482] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:38:22 2022] POST /identity/v3/users => generated 288 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:38:22.922033 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5055a647-3006-4699-a615-3b0ab846e5c6 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:22.922533 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5055a647-3006-4699-a615-3b0ab846e5c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:22.922908 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5055a647-3006-4699-a615-3b0ab846e5c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:22.924305 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5055a647-3006-4699-a615-3b0ab846e5c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:38:22.926903 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef73b47-3148-4d12-9091-b34fafe88b42 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:38:22.927097 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5055a647-3006-4699-a615-3b0ab846e5c6 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:38:22.939134 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef73b47-3148-4d12-9091-b34fafe88b42 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:38:22.942007 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3726/7483] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:38:22 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 21:38:22.944605 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc716594-48fb-4577-9d16-3e6d144498c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:38:22.945143 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc716594-48fb-4577-9d16-3e6d144498c0 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:22.945424 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc716594-48fb-4577-9d16-3e6d144498c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:22.945695 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc716594-48fb-4577-9d16-3e6d144498c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:22.945946 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5055a647-3006-4699-a615-3b0ab846e5c6 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:38:22.946458 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc716594-48fb-4577-9d16-3e6d144498c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:38:22.948066 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc716594-48fb-4577-9d16-3e6d144498c0 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:38:22.963452 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3758/7484] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:38:22 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:38:22.963671 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5055a647-3006-4699-a615-3b0ab846e5c6 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:38:22.964651 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc716594-48fb-4577-9d16-3e6d144498c0 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:38:22.970380 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc90cf0-4ea9-4dbd-898e-f695d98bf042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:38:22.971286 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc90cf0-4ea9-4dbd-898e-f695d98bf042 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:22.971691 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc90cf0-4ea9-4dbd-898e-f695d98bf042 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:22.972368 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc90cf0-4ea9-4dbd-898e-f695d98bf042 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:22.973493 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc90cf0-4ea9-4dbd-898e-f695d98bf042 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:38:22.976073 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc90cf0-4ea9-4dbd-898e-f695d98bf042 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:38:22.981647 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc716594-48fb-4577-9d16-3e6d144498c0 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:38:22.988687 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768e60af-25e4-4a72-8276-28fce8fb720f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:38:22.990520 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768e60af-25e4-4a72-8276-28fce8fb720f admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:22.990943 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768e60af-25e4-4a72-8276-28fce8fb720f admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:22.991376 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768e60af-25e4-4a72-8276-28fce8fb720f admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:22.991720 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3727/7485] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:38:22 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 21:38:22.992454 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768e60af-25e4-4a72-8276-28fce8fb720f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:38:22.994058 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc90cf0-4ea9-4dbd-898e-f695d98bf042 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:38:22.996711 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768e60af-25e4-4a72-8276-28fce8fb720f admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:38:23.008915 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc90cf0-4ea9-4dbd-898e-f695d98bf042 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:38:23.014798 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23438860-878b-4871-96ac-4c00d9d238c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:38:23.015981 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23438860-878b-4871-96ac-4c00d9d238c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:23.016364 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23438860-878b-4871-96ac-4c00d9d238c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:23.016737 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23438860-878b-4871-96ac-4c00d9d238c6 admin admin] PATH_INFO: `/v3/projects/20471be81d304644914d5b8b39f61da3/users/e7b737394932432dbfadcd6cf26de29d/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:23.018240 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3759/7486] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:38:22 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:38:23.021693 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768e60af-25e4-4a72-8276-28fce8fb720f admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:38:23.034308 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23438860-878b-4871-96ac-4c00d9d238c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20471be81d304644914d5b8b39f61da3, user_id=e7b737394932432dbfadcd6cf26de29d, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:38:23.038612 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23438860-878b-4871-96ac-4c00d9d238c6 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:38:23.040729 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768e60af-25e4-4a72-8276-28fce8fb720f admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:38:23.048651 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fce084-2510-4fd1-9ba4-38901d65f06a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:38:23.049813 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fce084-2510-4fd1-9ba4-38901d65f06a admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:23.050025 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fce084-2510-4fd1-9ba4-38901d65f06a admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:23.050419 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fce084-2510-4fd1-9ba4-38901d65f06a admin admin] PATH_INFO: `/v3/projects/75e97a96ba304a259cb89d131a1772a0/users/cb4d9b73581a467da24255792e2ddb20/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:23.058279 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3728/7487] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:38:22 2022] PUT /identity/v3/projects/20471be81d304644914d5b8b39f61da3/users/e7b737394932432dbfadcd6cf26de29d/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:38:23.063302 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f8c2b8-4383-4d73-a12d-eead7be9cc00 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:23.063789 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f8c2b8-4383-4d73-a12d-eead7be9cc00 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:23.064386 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f8c2b8-4383-4d73-a12d-eead7be9cc00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:23.078154 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fce084-2510-4fd1-9ba4-38901d65f06a admin admin] RBAC: Authorizing `identity:create_grant(project_id=75e97a96ba304a259cb89d131a1772a0, user_id=cb4d9b73581a467da24255792e2ddb20, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:38:23.086489 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fce084-2510-4fd1-9ba4-38901d65f06a admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:38:23.087521 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-49f8c2b8-4383-4d73-a12d-eead7be9cc00 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:38:23.088861 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-49f8c2b8-4383-4d73-a12d-eead7be9cc00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:38:23.117328 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3760/7488] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:38:23 2022] PUT /identity/v3/projects/75e97a96ba304a259cb89d131a1772a0/users/cb4d9b73581a467da24255792e2ddb20/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:38:23.119600 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76a1327-8011-4f6b-bd4e-74610c0d8663 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:23.119978 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76a1327-8011-4f6b-bd4e-74610c0d8663 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:23.120880 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76a1327-8011-4f6b-bd4e-74610c0d8663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:23.149134 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-e76a1327-8011-4f6b-bd4e-74610c0d8663 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:38:23.151521 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-e76a1327-8011-4f6b-bd4e-74610c0d8663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:38:23.176694 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3729/7489] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:38:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:38:23.188722 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f8c2b8-4383-4d73-a12d-eead7be9cc00 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:38:23.190559 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-49f8c2b8-4383-4d73-a12d-eead7be9cc00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:38:23.238586 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:38:23.247360 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3761/7490] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:38:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:38:23.255952 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76a1327-8011-4f6b-bd4e-74610c0d8663 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:38:23.259058 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-e76a1327-8011-4f6b-bd4e-74610c0d8663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:38:23.294636 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f8c2b8-4383-4d73-a12d-eead7be9cc00 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:38:23.369729 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76a1327-8011-4f6b-bd4e-74610c0d8663 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:38:23.372851 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a466d1dc-689e-42ba-a6b8-a4313aaed373 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:38:23.373710 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a466d1dc-689e-42ba-a6b8-a4313aaed373 service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:23.374153 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819860db-5f58-4a4e-b428-bbfe3cb24d93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:38:23.374358 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a466d1dc-689e-42ba-a6b8-a4313aaed373 service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:23.374777 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a466d1dc-689e-42ba-a6b8-a4313aaed373 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:23.375783 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819860db-5f58-4a4e-b428-bbfe3cb24d93 service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:23.376163 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819860db-5f58-4a4e-b428-bbfe3cb24d93 service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:23.376557 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819860db-5f58-4a4e-b428-bbfe3cb24d93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:23.393583 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a466d1dc-689e-42ba-a6b8-a4313aaed373 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:38:23.395300 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a466d1dc-689e-42ba-a6b8-a4313aaed373 service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:38:23.396717 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819860db-5f58-4a4e-b428-bbfe3cb24d93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:38:23.398637 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819860db-5f58-4a4e-b428-bbfe3cb24d93 service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:38:23.418550 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3762/7491] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:38:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 23 21:38:23.422328 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3730/7492] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:38:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 23 21:38:24.293474 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819860db-5f58-4a4e-b428-bbfe3cb24d93 service neutron] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:38:24.296420 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-819860db-5f58-4a4e-b428-bbfe3cb24d93 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:38:24.375159 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:38:24.439773 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819860db-5f58-4a4e-b428-bbfe3cb24d93 service neutron] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:38:24.447574 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5d7592-498a-4b4f-b624-dd2877fbcd78 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:38:24.448603 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5d7592-498a-4b4f-b624-dd2877fbcd78 service nova] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:24.449292 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5d7592-498a-4b4f-b624-dd2877fbcd78 service nova] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:24.449824 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5d7592-498a-4b4f-b624-dd2877fbcd78 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:24.452394 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-ad5d7592-498a-4b4f-b624-dd2877fbcd78 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:38:24.556978 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5d7592-498a-4b4f-b624-dd2877fbcd78 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:38:24.559304 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5d7592-498a-4b4f-b624-dd2877fbcd78 service nova] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:38:24.603208 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3763/7493] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:38:24 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:38:25.453683 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9a864d-420e-4dbe-ab7c-2007158c53b0 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:25.454115 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9a864d-420e-4dbe-ab7c-2007158c53b0 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:25.454357 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9a864d-420e-4dbe-ab7c-2007158c53b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:25.493564 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-9d9a864d-420e-4dbe-ab7c-2007158c53b0 None None] MFA Rules not processed for user `e7b737394932432dbfadcd6cf26de29d`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:38:25.495069 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-9d9a864d-420e-4dbe-ab7c-2007158c53b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:38:25.619692 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3731/7494] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:38:25 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:38:25.621198 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5d7592-498a-4b4f-b624-dd2877fbcd78 service nova] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:38:25.639026 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5d7592-498a-4b4f-b624-dd2877fbcd78 service nova] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:38:25.654633 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cf76d4-3a62-4964-930f-cf35590dbbbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:38:25.655505 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cf76d4-3a62-4964-930f-cf35590dbbbf admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:25.655809 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cf76d4-3a62-4964-930f-cf35590dbbbf admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:25.656101 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cf76d4-3a62-4964-930f-cf35590dbbbf admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:25.656802 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cf76d4-3a62-4964-930f-cf35590dbbbf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:38:25.659220 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cf76d4-3a62-4964-930f-cf35590dbbbf admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:38:25.734923 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3764/7495] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:38:25 2022] POST /identity/v3/projects => generated 373 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:38:25.736210 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9a864d-420e-4dbe-ab7c-2007158c53b0 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:38:25.749104 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9a864d-420e-4dbe-ab7c-2007158c53b0 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:38:25.858958 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a8129b-73c1-4d0d-b2ea-a27b58f00a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:38:25.860111 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a8129b-73c1-4d0d-b2ea-a27b58f00a34 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:25.860111 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a8129b-73c1-4d0d-b2ea-a27b58f00a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:25.860383 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a8129b-73c1-4d0d-b2ea-a27b58f00a34 admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:25.861047 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a8129b-73c1-4d0d-b2ea-a27b58f00a34 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:38:25.863330 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a8129b-73c1-4d0d-b2ea-a27b58f00a34 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:38:25.899647 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3732/7496] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:38:25 2022] POST /identity/v3/users => generated 293 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:38:25.903715 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cf76d4-3a62-4964-930f-cf35590dbbbf admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:38:25.951577 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cf76d4-3a62-4964-930f-cf35590dbbbf admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:38:25.969096 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2034679b-f094-4072-b32e-7981b40d06b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:38:25.971216 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2034679b-f094-4072-b32e-7981b40d06b0 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:25.971988 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2034679b-f094-4072-b32e-7981b40d06b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:25.973360 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2034679b-f094-4072-b32e-7981b40d06b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:25.974588 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2034679b-f094-4072-b32e-7981b40d06b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:38:25.979230 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2034679b-f094-4072-b32e-7981b40d06b0 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:38:26.013569 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3765/7497] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:38:25 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:38:26.018236 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a8129b-73c1-4d0d-b2ea-a27b58f00a34 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:38:26.029899 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:38:26.039936 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a8129b-73c1-4d0d-b2ea-a27b58f00a34 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:38:26.061698 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e315c15b-c90d-44ab-b228-fe0c3dee185b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:38:26.062693 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e315c15b-c90d-44ab-b228-fe0c3dee185b admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:26.062965 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e315c15b-c90d-44ab-b228-fe0c3dee185b admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:26.063234 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e315c15b-c90d-44ab-b228-fe0c3dee185b admin admin] PATH_INFO: `/v3/projects/4e62f2f7963f4e368a5737fb305dabe9/users/6984dcc835ad4d7c8bef37e7fff6d018/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:26.094934 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e315c15b-c90d-44ab-b228-fe0c3dee185b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e62f2f7963f4e368a5737fb305dabe9, user_id=6984dcc835ad4d7c8bef37e7fff6d018, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:38:26.097780 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e315c15b-c90d-44ab-b228-fe0c3dee185b admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:38:26.124796 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3733/7498] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:38:26 2022] PUT /identity/v3/projects/4e62f2f7963f4e368a5737fb305dabe9/users/6984dcc835ad4d7c8bef37e7fff6d018/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:38:26.127099 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2034679b-f094-4072-b32e-7981b40d06b0 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:38:26.144695 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2034679b-f094-4072-b32e-7981b40d06b0 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:38:26.240051 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ff8138-db53-4494-a44c-262f5171889b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:38:26.241445 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ff8138-db53-4494-a44c-262f5171889b admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:26.242154 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ff8138-db53-4494-a44c-262f5171889b admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:26.242647 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ff8138-db53-4494-a44c-262f5171889b admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:26.243913 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ff8138-db53-4494-a44c-262f5171889b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:38:26.247615 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ff8138-db53-4494-a44c-262f5171889b admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:38:26.268594 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3766/7499] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:38:26 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 21:38:26.270105 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e315c15b-c90d-44ab-b228-fe0c3dee185b admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:38:26.291564 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e315c15b-c90d-44ab-b228-fe0c3dee185b admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:38:26.311428 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f491647d-89e6-4695-b67a-1c02c8158c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:38:26.313311 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f491647d-89e6-4695-b67a-1c02c8158c89 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:26.313893 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f491647d-89e6-4695-b67a-1c02c8158c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:26.314917 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f491647d-89e6-4695-b67a-1c02c8158c89 admin admin] PATH_INFO: `/v3/projects/4e62f2f7963f4e368a5737fb305dabe9/users/6984dcc835ad4d7c8bef37e7fff6d018/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:26.320359 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f491647d-89e6-4695-b67a-1c02c8158c89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e62f2f7963f4e368a5737fb305dabe9, user_id=6984dcc835ad4d7c8bef37e7fff6d018, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:38:26.326282 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f491647d-89e6-4695-b67a-1c02c8158c89 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:38:26.359969 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3734/7500] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:38:26 2022] PUT /identity/v3/projects/4e62f2f7963f4e368a5737fb305dabe9/users/6984dcc835ad4d7c8bef37e7fff6d018/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:38:28.745005 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52949918-b0f4-4cca-90de-ef300e6ad854 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:28.745718 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52949918-b0f4-4cca-90de-ef300e6ad854 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:28.745718 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52949918-b0f4-4cca-90de-ef300e6ad854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:28.834896 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-52949918-b0f4-4cca-90de-ef300e6ad854 None None] MFA Rules not processed for user `6984dcc835ad4d7c8bef37e7fff6d018`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:38:28.836443 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-52949918-b0f4-4cca-90de-ef300e6ad854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:38:28.875811 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:38:28.990875 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3767/7501] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:38:28 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:38:29.000918 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e41160-9303-4214-911c-56da03abc2a2 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:29.001784 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e41160-9303-4214-911c-56da03abc2a2 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:29.002310 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e41160-9303-4214-911c-56da03abc2a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:29.043085 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-a0e41160-9303-4214-911c-56da03abc2a2 None None] MFA Rules not processed for user `e7b737394932432dbfadcd6cf26de29d`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:38:29.044603 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-a0e41160-9303-4214-911c-56da03abc2a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:38:29.182368 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3735/7502] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:38:28 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:38:29.194056 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52949918-b0f4-4cca-90de-ef300e6ad854 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:38:29.378976 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52949918-b0f4-4cca-90de-ef300e6ad854 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:38:29.391872 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9304821-a261-4d78-822a-cd982342995b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:38:29.392574 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9304821-a261-4d78-822a-cd982342995b service nova] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:29.392839 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9304821-a261-4d78-822a-cd982342995b service nova] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:29.393110 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9304821-a261-4d78-822a-cd982342995b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:29.407803 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9304821-a261-4d78-822a-cd982342995b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:38:29.409685 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9304821-a261-4d78-822a-cd982342995b service nova] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:38:29.455349 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3768/7503] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:38:29 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 23 21:38:30.236626 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e41160-9303-4214-911c-56da03abc2a2 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:38:30.240380 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-a0e41160-9303-4214-911c-56da03abc2a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:38:30.329639 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e41160-9303-4214-911c-56da03abc2a2 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:38:30.335673 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbd4c59-f023-4999-b572-e6c2346ea37b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:38:30.336944 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbd4c59-f023-4999-b572-e6c2346ea37b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:30.337439 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbd4c59-f023-4999-b572-e6c2346ea37b admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:30.337972 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbd4c59-f023-4999-b572-e6c2346ea37b admin admin] PATH_INFO: `/v3/users/fbdac5390db743fa9ba54b97a4f24628` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:30.339753 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbd4c59-f023-4999-b572-e6c2346ea37b admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbdac5390db743fa9ba54b97a4f24628)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:38:30.343610 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbd4c59-f023-4999-b572-e6c2346ea37b admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:38:30.400225 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-8cbd4c59-f023-4999-b572-e6c2346ea37b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbdac5390db743fa9ba54b97a4f24628'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:38:30.412884 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-8cbd4c59-f023-4999-b572-e6c2346ea37b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbdac5390db743fa9ba54b97a4f24628'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:38:30.414662 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-8cbd4c59-f023-4999-b572-e6c2346ea37b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbdac5390db743fa9ba54b97a4f24628'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:38:30.428692 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-8cbd4c59-f023-4999-b572-e6c2346ea37b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbdac5390db743fa9ba54b97a4f24628'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:38:30.444475 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:38:30.460741 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-8cbd4c59-f023-4999-b572-e6c2346ea37b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbdac5390db743fa9ba54b97a4f24628'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:38:30.470156 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3736/7504] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:38:30 2022] DELETE /identity/v3/users/fbdac5390db743fa9ba54b97a4f24628 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:38:30.473755 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9304821-a261-4d78-822a-cd982342995b service nova] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:38:30.474298 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8045138a-8aee-4586-ace8-bab6c55db182 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:30.474672 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8045138a-8aee-4586-ace8-bab6c55db182 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:30.475005 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8045138a-8aee-4586-ace8-bab6c55db182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:30.494245 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-8045138a-8aee-4586-ace8-bab6c55db182 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:38:30.496268 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-8045138a-8aee-4586-ace8-bab6c55db182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:38:30.546897 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9304821-a261-4d78-822a-cd982342995b service nova] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:38:30.574524 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3737/7505] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:38:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:38:30.583734 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8045138a-8aee-4586-ace8-bab6c55db182 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:38:30.585751 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-8045138a-8aee-4586-ace8-bab6c55db182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:38:30.618186 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e98180-f631-42d1-b877-1ed8c9b9a38b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:38:30.619301 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e98180-f631-42d1-b877-1ed8c9b9a38b service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:30.619718 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e98180-f631-42d1-b877-1ed8c9b9a38b service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:30.620159 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e98180-f631-42d1-b877-1ed8c9b9a38b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:30.622432 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-a0e98180-f631-42d1-b877-1ed8c9b9a38b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:38:30.629766 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:38:30.653236 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8045138a-8aee-4586-ace8-bab6c55db182 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:38:30.659048 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2172a54-c64f-4fb4-8053-767c0c77430e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:38:30.659876 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2172a54-c64f-4fb4-8053-767c0c77430e service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:30.660251 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2172a54-c64f-4fb4-8053-767c0c77430e service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:30.660672 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2172a54-c64f-4fb4-8053-767c0c77430e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:30.672634 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2172a54-c64f-4fb4-8053-767c0c77430e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:38:30.674327 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2172a54-c64f-4fb4-8053-767c0c77430e service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:38:30.696633 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3738/7506] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:38:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:38:30.718129 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e98180-f631-42d1-b877-1ed8c9b9a38b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:38:30.719696 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e98180-f631-42d1-b877-1ed8c9b9a38b service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:38:30.739842 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3769/7507] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:38:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:38:30.842377 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2172a54-c64f-4fb4-8053-767c0c77430e service neutron] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:38:30.844188 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-b2172a54-c64f-4fb4-8053-767c0c77430e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:38:30.884003 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2172a54-c64f-4fb4-8053-767c0c77430e service neutron] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:38:30.891808 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e847417-c517-4eb2-88ee-ff62f69398c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:38:30.892747 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e847417-c517-4eb2-88ee-ff62f69398c9 service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:30.893141 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e847417-c517-4eb2-88ee-ff62f69398c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:30.893507 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e847417-c517-4eb2-88ee-ff62f69398c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:30.895713 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-8e847417-c517-4eb2-88ee-ff62f69398c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:38:30.902508 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e98180-f631-42d1-b877-1ed8c9b9a38b service neutron] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:38:30.904401 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-a0e98180-f631-42d1-b877-1ed8c9b9a38b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:38:30.917176 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e847417-c517-4eb2-88ee-ff62f69398c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:38:30.919123 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e847417-c517-4eb2-88ee-ff62f69398c9 service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:38:30.923889 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e98180-f631-42d1-b877-1ed8c9b9a38b service neutron] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:38:30.939804 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6769a077-fb52-4816-868d-732f7adcf0a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:38:30.940955 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6769a077-fb52-4816-868d-732f7adcf0a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:30.942932 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6769a077-fb52-4816-868d-732f7adcf0a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:30.943929 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3739/7508] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:38:30 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:38:30.944187 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6769a077-fb52-4816-868d-732f7adcf0a7 admin admin] PATH_INFO: `/v3/projects/4d273248e138400c8a907416d45b4dfa` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:30.945730 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6769a077-fb52-4816-868d-732f7adcf0a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d273248e138400c8a907416d45b4dfa)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:38:30.948201 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6769a077-fb52-4816-868d-732f7adcf0a7 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:38:31.053068 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-6769a077-fb52-4816-868d-732f7adcf0a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d273248e138400c8a907416d45b4dfa', 'request_id': 'req-6769a077-fb52-4816-868d-732f7adcf0a7'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:38:31.073248 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-6769a077-fb52-4816-868d-732f7adcf0a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d273248e138400c8a907416d45b4dfa', 'request_id': 'req-6769a077-fb52-4816-868d-732f7adcf0a7'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:38:31.082036 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-6769a077-fb52-4816-868d-732f7adcf0a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d273248e138400c8a907416d45b4dfa', 'request_id': 'req-6769a077-fb52-4816-868d-732f7adcf0a7'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:38:31.096168 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-6769a077-fb52-4816-868d-732f7adcf0a7 admin admin] The token cache is being invalidate because project 4d273248e138400c8a907416d45b4dfa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:38:31.096512 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-6769a077-fb52-4816-868d-732f7adcf0a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:38:31.097304 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-6769a077-fb52-4816-868d-732f7adcf0a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:38:31.099304 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3770/7509] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:38:30 2022] DELETE /identity/v3/projects/4d273248e138400c8a907416d45b4dfa => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:38:31.104209 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55672768-5d04-44d3-8c72-88ebf932dade None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:31.104949 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55672768-5d04-44d3-8c72-88ebf932dade None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:31.105230 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55672768-5d04-44d3-8c72-88ebf932dade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:31.128591 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-55672768-5d04-44d3-8c72-88ebf932dade None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:38:31.130189 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-55672768-5d04-44d3-8c72-88ebf932dade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:38:31.231957 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3740/7510] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:38:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:38:31.239879 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f457cd19-6d18-4c3b-ba80-1f212987211f None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:31.240469 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f457cd19-6d18-4c3b-ba80-1f212987211f None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:31.240963 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f457cd19-6d18-4c3b-ba80-1f212987211f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:31.264003 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-f457cd19-6d18-4c3b-ba80-1f212987211f None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:38:31.265787 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-f457cd19-6d18-4c3b-ba80-1f212987211f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:38:31.276769 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3771/7511] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:38:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:38:31.282750 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55672768-5d04-44d3-8c72-88ebf932dade None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:38:31.293768 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55672768-5d04-44d3-8c72-88ebf932dade None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:38:31.298742 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c5fe56-47eb-404a-b165-78ca04ba0220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:38:31.299419 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c5fe56-47eb-404a-b165-78ca04ba0220 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:31.299697 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c5fe56-47eb-404a-b165-78ca04ba0220 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:31.300005 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c5fe56-47eb-404a-b165-78ca04ba0220 admin admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:31.300747 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c5fe56-47eb-404a-b165-78ca04ba0220 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:38:31.301047 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c5fe56-47eb-404a-b165-78ca04ba0220 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:38:31.303406 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c5fe56-47eb-404a-b165-78ca04ba0220 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:38:31.325997 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f457cd19-6d18-4c3b-ba80-1f212987211f None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:38:31.326243 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3741/7512] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:38:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:38:31.337716 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f457cd19-6d18-4c3b-ba80-1f212987211f None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:38:31.343776 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab48352-114a-47a6-aa4c-71c9329653a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:38:31.344618 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab48352-114a-47a6-aa4c-71c9329653a6 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:31.345014 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab48352-114a-47a6-aa4c-71c9329653a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:31.345407 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab48352-114a-47a6-aa4c-71c9329653a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:31.346390 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab48352-114a-47a6-aa4c-71c9329653a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:38:31.349322 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab48352-114a-47a6-aa4c-71c9329653a6 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:38:31.393969 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3772/7513] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:38:31 2022] POST /identity/v3/projects => generated 385 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:38:31.398060 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c5fe56-47eb-404a-b165-78ca04ba0220 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:38:31.411554 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c5fe56-47eb-404a-b165-78ca04ba0220 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:38:31.431644 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:38:31.543891 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560c64a3-c946-4c33-bf48-b8c352615406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:38:31.544778 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560c64a3-c946-4c33-bf48-b8c352615406 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:31.544985 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560c64a3-c946-4c33-bf48-b8c352615406 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:31.545266 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560c64a3-c946-4c33-bf48-b8c352615406 admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:31.546096 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560c64a3-c946-4c33-bf48-b8c352615406 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:38:31.550139 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560c64a3-c946-4c33-bf48-b8c352615406 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:38:31.618664 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3742/7514] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:38:31 2022] POST /identity/v3/users => generated 293 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:38:31.623067 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab48352-114a-47a6-aa4c-71c9329653a6 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:38:31.639271 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab48352-114a-47a6-aa4c-71c9329653a6 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:38:31.650204 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560c64a3-c946-4c33-bf48-b8c352615406 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:38:31.652211 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-560c64a3-c946-4c33-bf48-b8c352615406 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:38:31.652481 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd23c129-2ecd-4f68-9620-2f847933305b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:38:31.653198 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd23c129-2ecd-4f68-9620-2f847933305b admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:31.653479 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd23c129-2ecd-4f68-9620-2f847933305b admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:31.653757 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd23c129-2ecd-4f68-9620-2f847933305b admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:31.654538 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd23c129-2ecd-4f68-9620-2f847933305b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:38:31.659126 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd23c129-2ecd-4f68-9620-2f847933305b admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:38:31.687795 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3773/7515] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:38:31 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:38:31.688689 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd23c129-2ecd-4f68-9620-2f847933305b admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:38:31.709281 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd23c129-2ecd-4f68-9620-2f847933305b admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:38:31.727463 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6824cb7d-ddc5-4add-bfa9-89913cd5b204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:38:31.728168 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6824cb7d-ddc5-4add-bfa9-89913cd5b204 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:31.728450 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6824cb7d-ddc5-4add-bfa9-89913cd5b204 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:31.728725 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6824cb7d-ddc5-4add-bfa9-89913cd5b204 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:31.729532 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6824cb7d-ddc5-4add-bfa9-89913cd5b204 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:38:31.734378 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6824cb7d-ddc5-4add-bfa9-89913cd5b204 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:38:31.761627 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3774/7516] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:38:31 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:38:31.762847 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6824cb7d-ddc5-4add-bfa9-89913cd5b204 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:38:31.783553 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6824cb7d-ddc5-4add-bfa9-89913cd5b204 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:38:31.790634 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ed5049-0026-4268-a473-c3366b2a09ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:38:31.792693 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ed5049-0026-4268-a473-c3366b2a09ad admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:31.793156 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ed5049-0026-4268-a473-c3366b2a09ad admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:31.794370 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ed5049-0026-4268-a473-c3366b2a09ad admin admin] PATH_INFO: `/v3/projects/901cee8cc7804e4d9ce9855f7421372d/users/65cee8ae536f477faeb3029ad0df4c68/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:31.820766 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ed5049-0026-4268-a473-c3366b2a09ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=901cee8cc7804e4d9ce9855f7421372d, user_id=65cee8ae536f477faeb3029ad0df4c68, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:38:31.828080 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560c64a3-c946-4c33-bf48-b8c352615406 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:38:31.829563 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ed5049-0026-4268-a473-c3366b2a09ad admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:38:31.850255 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0c826d-1570-425c-bd0f-2c4eeccc1ae5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc719a3b3ac4461b82ca04ab6451d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:38:31.851228 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0c826d-1570-425c-bd0f-2c4eeccc1ae5 service placement] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:31.851602 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0c826d-1570-425c-bd0f-2c4eeccc1ae5 service placement] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:31.851992 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0c826d-1570-425c-bd0f-2c4eeccc1ae5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:31.855225 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-1e0c826d-1570-425c-bd0f-2c4eeccc1ae5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:38:31.859260 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3775/7517] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:38:31 2022] PUT /identity/v3/projects/901cee8cc7804e4d9ce9855f7421372d/users/65cee8ae536f477faeb3029ad0df4c68/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:38:31.871149 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa8b4d9-a271-4567-9e50-75bc56271edc None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:31.871691 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa8b4d9-a271-4567-9e50-75bc56271edc None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:31.872094 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa8b4d9-a271-4567-9e50-75bc56271edc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:31.883599 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:38:31.889479 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0c826d-1570-425c-bd0f-2c4eeccc1ae5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:38:31.891276 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0c826d-1570-425c-bd0f-2c4eeccc1ae5 service placement] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:38:31.908594 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3743/7518] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:38:31 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 23 21:38:31.937882 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-5aa8b4d9-a271-4567-9e50-75bc56271edc None None] MFA Rules not processed for user `65cee8ae536f477faeb3029ad0df4c68`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:38:31.939273 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-5aa8b4d9-a271-4567-9e50-75bc56271edc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:38:32.081923 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3776/7519] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:38:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:38:32.100960 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0c826d-1570-425c-bd0f-2c4eeccc1ae5 service placement] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:38:32.102612 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-1e0c826d-1570-425c-bd0f-2c4eeccc1ae5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:38:32.166624 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0c826d-1570-425c-bd0f-2c4eeccc1ae5 service placement] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:38:32.212388 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:38:32.225379 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c282f73-44a2-4b98-833b-89c8f3e13fd3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:38:32.226281 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c282f73-44a2-4b98-833b-89c8f3e13fd3 service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:32.226697 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c282f73-44a2-4b98-833b-89c8f3e13fd3 service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:32.227165 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c282f73-44a2-4b98-833b-89c8f3e13fd3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:32.237273 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c282f73-44a2-4b98-833b-89c8f3e13fd3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:38:32.239111 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c282f73-44a2-4b98-833b-89c8f3e13fd3 service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:38:32.249836 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3744/7520] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:38:32 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:38:32.949986 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa8b4d9-a271-4567-9e50-75bc56271edc None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:38:33.058884 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa8b4d9-a271-4567-9e50-75bc56271edc None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:38:33.070979 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03681001-090d-48d0-b44b-08d7a9293658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:38:33.071915 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03681001-090d-48d0-b44b-08d7a9293658 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:33.072716 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03681001-090d-48d0-b44b-08d7a9293658 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:33.073000 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03681001-090d-48d0-b44b-08d7a9293658 admin admin] PATH_INFO: `/v3/users/65cee8ae536f477faeb3029ad0df4c68` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:33.075065 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03681001-090d-48d0-b44b-08d7a9293658 admin admin] RBAC: Authorizing `identity:delete_user(user_id=65cee8ae536f477faeb3029ad0df4c68)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:38:33.082259 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03681001-090d-48d0-b44b-08d7a9293658 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:38:33.191864 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-03681001-090d-48d0-b44b-08d7a9293658 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65cee8ae536f477faeb3029ad0df4c68'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:38:33.192728 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-03681001-090d-48d0-b44b-08d7a9293658 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65cee8ae536f477faeb3029ad0df4c68'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:38:33.202007 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-03681001-090d-48d0-b44b-08d7a9293658 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65cee8ae536f477faeb3029ad0df4c68'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:38:33.217476 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-03681001-090d-48d0-b44b-08d7a9293658 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65cee8ae536f477faeb3029ad0df4c68'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:38:33.233392 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-03681001-090d-48d0-b44b-08d7a9293658 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65cee8ae536f477faeb3029ad0df4c68'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:38:33.247927 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3777/7521] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:38:32 2022] DELETE /identity/v3/users/65cee8ae536f477faeb3029ad0df4c68 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:38:33.249329 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c07793-380c-469f-99aa-738ecb84dc8f None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:33.249789 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c07793-380c-469f-99aa-738ecb84dc8f None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:33.249946 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c07793-380c-469f-99aa-738ecb84dc8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:33.275058 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-33c07793-380c-469f-99aa-738ecb84dc8f None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:38:33.276305 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-33c07793-380c-469f-99aa-738ecb84dc8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:38:33.363363 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3745/7522] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:38:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:38:33.386749 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03681001-090d-48d0-b44b-08d7a9293658 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:38:33.389183 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-03681001-090d-48d0-b44b-08d7a9293658 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:38:33.423645 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:38:33.484187 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03681001-090d-48d0-b44b-08d7a9293658 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:38:33.488369 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d1b9ab-6010-4bcd-a709-62a5a0cf0b99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:38:33.489200 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d1b9ab-6010-4bcd-a709-62a5a0cf0b99 service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:33.489579 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d1b9ab-6010-4bcd-a709-62a5a0cf0b99 service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:33.490001 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d1b9ab-6010-4bcd-a709-62a5a0cf0b99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:33.508137 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d1b9ab-6010-4bcd-a709-62a5a0cf0b99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:38:33.509904 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d1b9ab-6010-4bcd-a709-62a5a0cf0b99 service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:38:33.526627 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3778/7523] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:38:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:38:33.821575 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc7f665-9e57-4bd6-9baf-8ca17c613f02 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:33.822104 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc7f665-9e57-4bd6-9baf-8ca17c613f02 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:33.822407 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc7f665-9e57-4bd6-9baf-8ca17c613f02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:33.905805 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-7fc7f665-9e57-4bd6-9baf-8ca17c613f02 None None] MFA Rules not processed for user `cb4d9b73581a467da24255792e2ddb20`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:38:33.907255 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-7fc7f665-9e57-4bd6-9baf-8ca17c613f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:38:33.916043 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d1b9ab-6010-4bcd-a709-62a5a0cf0b99 service neutron] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:38:33.931883 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d1b9ab-6010-4bcd-a709-62a5a0cf0b99 service neutron] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:38:33.940292 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f32f54-4b2e-4dc0-b58f-6dfd6cfcd404 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:38:33.940956 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f32f54-4b2e-4dc0-b58f-6dfd6cfcd404 service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:33.941244 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f32f54-4b2e-4dc0-b58f-6dfd6cfcd404 service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:33.941551 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f32f54-4b2e-4dc0-b58f-6dfd6cfcd404 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:33.943706 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-e4f32f54-4b2e-4dc0-b58f-6dfd6cfcd404 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:38:33.962922 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f32f54-4b2e-4dc0-b58f-6dfd6cfcd404 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:38:33.967485 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f32f54-4b2e-4dc0-b58f-6dfd6cfcd404 service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:38:33.991197 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3779/7524] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:38:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:38:34.010668 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3746/7525] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:38:33 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:38:34.015060 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f32f54-4b2e-4dc0-b58f-6dfd6cfcd404 service neutron] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:38:34.016790 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-e4f32f54-4b2e-4dc0-b58f-6dfd6cfcd404 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:38:34.029817 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f32f54-4b2e-4dc0-b58f-6dfd6cfcd404 service neutron] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:38:34.035380 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84556e38-38ae-4c92-8234-04b31319c9b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:38:34.035887 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84556e38-38ae-4c92-8234-04b31319c9b9 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:34.036500 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84556e38-38ae-4c92-8234-04b31319c9b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:34.036883 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84556e38-38ae-4c92-8234-04b31319c9b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:34.037667 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84556e38-38ae-4c92-8234-04b31319c9b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:38:34.039703 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84556e38-38ae-4c92-8234-04b31319c9b9 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:38:34.081551 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3780/7526] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:38:34 2022] POST /identity/v3/projects => generated 375 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:38:34.085753 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc7f665-9e57-4bd6-9baf-8ca17c613f02 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:38:34.100296 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc7f665-9e57-4bd6-9baf-8ca17c613f02 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:38:34.105602 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84556e38-38ae-4c92-8234-04b31319c9b9 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:38:34.111104 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-84556e38-38ae-4c92-8234-04b31319c9b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:38:34.235007 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84556e38-38ae-4c92-8234-04b31319c9b9 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:38:34.247492 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27b20b3-81ec-4c52-b634-94d4356d6160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:38:34.248570 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27b20b3-81ec-4c52-b634-94d4356d6160 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:34.249084 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27b20b3-81ec-4c52-b634-94d4356d6160 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:34.249457 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27b20b3-81ec-4c52-b634-94d4356d6160 admin admin] PATH_INFO: `/v3/projects/901cee8cc7804e4d9ce9855f7421372d` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:34.250816 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27b20b3-81ec-4c52-b634-94d4356d6160 admin admin] RBAC: Authorizing `identity:delete_project(project_id=901cee8cc7804e4d9ce9855f7421372d)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:38:34.253795 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27b20b3-81ec-4c52-b634-94d4356d6160 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:38:34.255741 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a18579-fb4b-48f3-90c6-3983b2f9cfc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:38:34.257669 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a18579-fb4b-48f3-90c6-3983b2f9cfc6 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:34.258245 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a18579-fb4b-48f3-90c6-3983b2f9cfc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:34.258711 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a18579-fb4b-48f3-90c6-3983b2f9cfc6 admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:34.259657 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a18579-fb4b-48f3-90c6-3983b2f9cfc6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:38:34.263289 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a18579-fb4b-48f3-90c6-3983b2f9cfc6 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:38:34.300026 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3747/7527] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:38:34 2022] POST /identity/v3/users => generated 294 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:38:34.304769 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a18579-fb4b-48f3-90c6-3983b2f9cfc6 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:38:34.321468 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a18579-fb4b-48f3-90c6-3983b2f9cfc6 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:38:34.335781 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f6cb1c-5b31-4922-94e6-442377c7d1ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:38:34.336714 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f6cb1c-5b31-4922-94e6-442377c7d1ae admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:34.337089 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f6cb1c-5b31-4922-94e6-442377c7d1ae admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:34.337456 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f6cb1c-5b31-4922-94e6-442377c7d1ae admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:34.338357 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f6cb1c-5b31-4922-94e6-442377c7d1ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:38:34.340716 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f6cb1c-5b31-4922-94e6-442377c7d1ae admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:38:34.342625 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:38:34.359412 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3748/7528] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:38:34 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:38:34.360131 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-f27b20b3-81ec-4c52-b634-94d4356d6160 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '901cee8cc7804e4d9ce9855f7421372d', 'request_id': 'req-f27b20b3-81ec-4c52-b634-94d4356d6160'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:38:34.361662 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f6cb1c-5b31-4922-94e6-442377c7d1ae admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:38:34.373500 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-f27b20b3-81ec-4c52-b634-94d4356d6160 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '901cee8cc7804e4d9ce9855f7421372d', 'request_id': 'req-f27b20b3-81ec-4c52-b634-94d4356d6160'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:38:34.385527 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-f27b20b3-81ec-4c52-b634-94d4356d6160 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '901cee8cc7804e4d9ce9855f7421372d', 'request_id': 'req-f27b20b3-81ec-4c52-b634-94d4356d6160'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:38:34.388596 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f6cb1c-5b31-4922-94e6-442377c7d1ae admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:38:34.406537 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-f27b20b3-81ec-4c52-b634-94d4356d6160 admin admin] The token cache is being invalidate because project 901cee8cc7804e4d9ce9855f7421372d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:38:34.407052 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-f27b20b3-81ec-4c52-b634-94d4356d6160 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:38:34.409576 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-f27b20b3-81ec-4c52-b634-94d4356d6160 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:38:34.412287 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3781/7529] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:38:34 2022] DELETE /identity/v3/projects/901cee8cc7804e4d9ce9855f7421372d => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:38:34.418115 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ea298c-c366-4e53-b31b-bcfa78155dc8 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:34.418400 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ea298c-c366-4e53-b31b-bcfa78155dc8 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:34.418678 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ea298c-c366-4e53-b31b-bcfa78155dc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:34.464648 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-46ea298c-c366-4e53-b31b-bcfa78155dc8 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:38:34.467775 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-46ea298c-c366-4e53-b31b-bcfa78155dc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:38:34.478287 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:38:34.527855 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d788049a-02ee-4380-965c-0200d5a2cbaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:38:34.528846 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d788049a-02ee-4380-965c-0200d5a2cbaa admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:34.529420 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d788049a-02ee-4380-965c-0200d5a2cbaa admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:34.529698 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d788049a-02ee-4380-965c-0200d5a2cbaa admin admin] PATH_INFO: `/v3/projects/0c601305524f4bdb84548c52cfb8f05c/users/698e4fa363ce4d94970c3aaffb47cef0/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:34.564714 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d788049a-02ee-4380-965c-0200d5a2cbaa admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c601305524f4bdb84548c52cfb8f05c, user_id=698e4fa363ce4d94970c3aaffb47cef0, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:38:34.567520 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d788049a-02ee-4380-965c-0200d5a2cbaa admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:38:34.594597 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3749/7530] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:38:34 2022] PUT /identity/v3/projects/0c601305524f4bdb84548c52cfb8f05c/users/698e4fa363ce4d94970c3aaffb47cef0/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:38:34.596175 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d788049a-02ee-4380-965c-0200d5a2cbaa admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:38:34.598782 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-d788049a-02ee-4380-965c-0200d5a2cbaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:38:34.614427 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3782/7531] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:38:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:38:34.622730 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fc4402-b962-4281-a452-5cef476e054f None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:34.623278 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fc4402-b962-4281-a452-5cef476e054f None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:34.624094 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fc4402-b962-4281-a452-5cef476e054f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:34.660646 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-d6fc4402-b962-4281-a452-5cef476e054f None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:38:34.664436 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-d6fc4402-b962-4281-a452-5cef476e054f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:38:34.722673 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d788049a-02ee-4380-965c-0200d5a2cbaa admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:38:34.729526 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1108577-9168-4df0-b777-64cd43b1b85a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:38:34.730305 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1108577-9168-4df0-b777-64cd43b1b85a admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:34.730584 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1108577-9168-4df0-b777-64cd43b1b85a admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:34.730952 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1108577-9168-4df0-b777-64cd43b1b85a admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:34.731739 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1108577-9168-4df0-b777-64cd43b1b85a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:38:34.733680 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1108577-9168-4df0-b777-64cd43b1b85a admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:38:34.747875 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3750/7532] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:38:34 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:38:34.752634 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1108577-9168-4df0-b777-64cd43b1b85a admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:38:34.768424 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1108577-9168-4df0-b777-64cd43b1b85a admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:38:34.774532 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd34f63f-ad3f-4d47-842f-916250f5366f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:38:34.775539 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd34f63f-ad3f-4d47-842f-916250f5366f admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:34.776063 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd34f63f-ad3f-4d47-842f-916250f5366f admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:34.776436 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd34f63f-ad3f-4d47-842f-916250f5366f admin admin] PATH_INFO: `/v3/projects/0c601305524f4bdb84548c52cfb8f05c/users/698e4fa363ce4d94970c3aaffb47cef0/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:34.779107 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd34f63f-ad3f-4d47-842f-916250f5366f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c601305524f4bdb84548c52cfb8f05c, user_id=698e4fa363ce4d94970c3aaffb47cef0, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:38:34.782443 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd34f63f-ad3f-4d47-842f-916250f5366f admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:38:34.785379 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3783/7533] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:38:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:38:34.789443 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fc4402-b962-4281-a452-5cef476e054f None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:38:34.797968 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3751/7534] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:38:34 2022] PUT /identity/v3/projects/0c601305524f4bdb84548c52cfb8f05c/users/698e4fa363ce4d94970c3aaffb47cef0/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:38:34.800031 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fc4402-b962-4281-a452-5cef476e054f None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:38:34.894618 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adddee17-2ce9-49ac-a7c2-3aa1f6bc1b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:38:34.895486 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adddee17-2ce9-49ac-a7c2-3aa1f6bc1b18 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:34.896115 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adddee17-2ce9-49ac-a7c2-3aa1f6bc1b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:34.896495 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adddee17-2ce9-49ac-a7c2-3aa1f6bc1b18 admin admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:34.897351 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adddee17-2ce9-49ac-a7c2-3aa1f6bc1b18 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:38:34.897765 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adddee17-2ce9-49ac-a7c2-3aa1f6bc1b18 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:38:34.900081 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adddee17-2ce9-49ac-a7c2-3aa1f6bc1b18 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:38:34.926845 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3784/7535] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:38:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:38:34.927546 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd34f63f-ad3f-4d47-842f-916250f5366f admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:38:34.941001 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd34f63f-ad3f-4d47-842f-916250f5366f admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:38:34.948054 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745aa713-24d0-4f37-a2ad-038db39b2ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:38:34.949103 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745aa713-24d0-4f37-a2ad-038db39b2ec7 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:34.949479 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745aa713-24d0-4f37-a2ad-038db39b2ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:34.950035 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745aa713-24d0-4f37-a2ad-038db39b2ec7 admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:34.950769 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745aa713-24d0-4f37-a2ad-038db39b2ec7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:38:34.953182 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745aa713-24d0-4f37-a2ad-038db39b2ec7 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:38:34.997907 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3752/7536] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:38:34 2022] POST /identity/v3/projects => generated 369 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:38:35.002632 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adddee17-2ce9-49ac-a7c2-3aa1f6bc1b18 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:38:35.021089 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adddee17-2ce9-49ac-a7c2-3aa1f6bc1b18 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:38:35.092600 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:38:35.112666 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1170d5a-5b38-480e-b64a-ea097340199b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:38:35.113646 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1170d5a-5b38-480e-b64a-ea097340199b admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:35.113986 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1170d5a-5b38-480e-b64a-ea097340199b admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:35.114302 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1170d5a-5b38-480e-b64a-ea097340199b admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:35.115255 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1170d5a-5b38-480e-b64a-ea097340199b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:38:35.117519 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1170d5a-5b38-480e-b64a-ea097340199b admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:38:35.150326 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3785/7537] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:38:35 2022] POST /identity/v3/users => generated 285 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:38:35.151943 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745aa713-24d0-4f37-a2ad-038db39b2ec7 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:38:35.165069 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745aa713-24d0-4f37-a2ad-038db39b2ec7 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:38:35.170907 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368ef8c5-6901-4ca2-937a-9ed2a81f246d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:38:35.171838 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368ef8c5-6901-4ca2-937a-9ed2a81f246d admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:35.173397 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368ef8c5-6901-4ca2-937a-9ed2a81f246d admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:35.173833 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368ef8c5-6901-4ca2-937a-9ed2a81f246d admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:35.174978 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368ef8c5-6901-4ca2-937a-9ed2a81f246d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:38:35.176961 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368ef8c5-6901-4ca2-937a-9ed2a81f246d admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:38:35.218887 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1170d5a-5b38-480e-b64a-ea097340199b admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:38:35.226092 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3753/7538] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:38:35 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:38:35.234532 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1170d5a-5b38-480e-b64a-ea097340199b admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:38:35.244446 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0486f49-ebfb-452c-846c-6b6d7eb7eaab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:38:35.245558 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0486f49-ebfb-452c-846c-6b6d7eb7eaab admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:35.247286 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0486f49-ebfb-452c-846c-6b6d7eb7eaab admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:35.247785 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0486f49-ebfb-452c-846c-6b6d7eb7eaab admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:35.250332 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0486f49-ebfb-452c-846c-6b6d7eb7eaab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:38:35.255477 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0486f49-ebfb-452c-846c-6b6d7eb7eaab admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:38:35.285913 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3786/7539] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:38:35 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:38:35.287747 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368ef8c5-6901-4ca2-937a-9ed2a81f246d admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:38:35.301304 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368ef8c5-6901-4ca2-937a-9ed2a81f246d admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:38:35.307341 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58c867c-9743-4223-a9f1-d715271bbd05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:38:35.308649 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58c867c-9743-4223-a9f1-d715271bbd05 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:35.309471 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58c867c-9743-4223-a9f1-d715271bbd05 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:35.309913 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58c867c-9743-4223-a9f1-d715271bbd05 admin admin] PATH_INFO: `/v3/projects/f08a7ab705ed47678b35f267baab62aa/users/71404921d5224b4ea9fe43876d56a844/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:35.329050 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58c867c-9743-4223-a9f1-d715271bbd05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f08a7ab705ed47678b35f267baab62aa, user_id=71404921d5224b4ea9fe43876d56a844, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:38:35.332641 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58c867c-9743-4223-a9f1-d715271bbd05 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:38:35.376033 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f1117c-40cd-4b5a-b2ba-2cdabed16024 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:35.376423 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f1117c-40cd-4b5a-b2ba-2cdabed16024 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:35.376797 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f1117c-40cd-4b5a-b2ba-2cdabed16024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:35.378357 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3754/7540] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:38:35 2022] PUT /identity/v3/projects/f08a7ab705ed47678b35f267baab62aa/users/71404921d5224b4ea9fe43876d56a844/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:38:35.423701 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-27f1117c-40cd-4b5a-b2ba-2cdabed16024 None None] MFA Rules not processed for user `71404921d5224b4ea9fe43876d56a844`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:38:35.427482 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-27f1117c-40cd-4b5a-b2ba-2cdabed16024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:38:35.549676 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3787/7541] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:38:35 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:38:35.599468 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58c867c-9743-4223-a9f1-d715271bbd05 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:38:35.601745 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-c58c867c-9743-4223-a9f1-d715271bbd05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:38:35.610172 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:38:35.736435 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58c867c-9743-4223-a9f1-d715271bbd05 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:38:35.742490 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5516b7ec-8379-4556-8466-144930476773 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:38:35.743968 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5516b7ec-8379-4556-8466-144930476773 service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:35.743968 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5516b7ec-8379-4556-8466-144930476773 service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:35.744346 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5516b7ec-8379-4556-8466-144930476773 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:35.755499 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5516b7ec-8379-4556-8466-144930476773 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:38:35.757297 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5516b7ec-8379-4556-8466-144930476773 service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:38:35.768978 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3755/7542] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:38:35 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:38:45.452477 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f1117c-40cd-4b5a-b2ba-2cdabed16024 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:38:45.461740 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-27f1117c-40cd-4b5a-b2ba-2cdabed16024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:38:45.610450 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f1117c-40cd-4b5a-b2ba-2cdabed16024 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:38:45.629480 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93697a2-3082-4a00-b3be-b693e671fb86 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:38:45.630455 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93697a2-3082-4a00-b3be-b693e671fb86 service nova] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:45.644788 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93697a2-3082-4a00-b3be-b693e671fb86 service nova] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:45.645268 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93697a2-3082-4a00-b3be-b693e671fb86 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:45.648538 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-a93697a2-3082-4a00-b3be-b693e671fb86 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:38:45.672434 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93697a2-3082-4a00-b3be-b693e671fb86 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:38:45.674089 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93697a2-3082-4a00-b3be-b693e671fb86 service nova] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:38:45.692107 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3788/7543] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:38:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:38:45.763444 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=24 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:38:47.556150 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb7f837-e992-45db-a876-2c12eb7bf121 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:47.556768 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb7f837-e992-45db-a876-2c12eb7bf121 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:47.556768 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb7f837-e992-45db-a876-2c12eb7bf121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:47.589302 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-7fb7f837-e992-45db-a876-2c12eb7bf121 None None] MFA Rules not processed for user `698e4fa363ce4d94970c3aaffb47cef0`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:38:47.591213 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-7fb7f837-e992-45db-a876-2c12eb7bf121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:38:47.726668 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3756/7544] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:38:47 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:38:48.125970 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93697a2-3082-4a00-b3be-b693e671fb86 service nova] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:38:48.148110 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93697a2-3082-4a00-b3be-b693e671fb86 service nova] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:38:48.154845 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe4815d-7006-4233-b8ce-30c0b6a836e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:38:48.155921 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe4815d-7006-4233-b8ce-30c0b6a836e1 service nova] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:48.156355 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe4815d-7006-4233-b8ce-30c0b6a836e1 service nova] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:48.156802 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe4815d-7006-4233-b8ce-30c0b6a836e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:48.173172 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe4815d-7006-4233-b8ce-30c0b6a836e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:38:48.180037 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe4815d-7006-4233-b8ce-30c0b6a836e1 service nova] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:38:48.192994 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3789/7545] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:38:48 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:38:48.289287 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f8f416-5e80-4791-bd21-871a9d994fc7 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:48.289287 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f8f416-5e80-4791-bd21-871a9d994fc7 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:48.289287 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f8f416-5e80-4791-bd21-871a9d994fc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:48.319457 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-56f8f416-5e80-4791-bd21-871a9d994fc7 None None] MFA Rules not processed for user `cb4d9b73581a467da24255792e2ddb20`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:38:48.320735 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-56f8f416-5e80-4791-bd21-871a9d994fc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:38:48.480931 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3757/7546] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:38:48 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:38:54.092848 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe4815d-7006-4233-b8ce-30c0b6a836e1 service nova] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:38:54.097928 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-9fe4815d-7006-4233-b8ce-30c0b6a836e1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:38:54.169809 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:38:54.278821 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe4815d-7006-4233-b8ce-30c0b6a836e1 service nova] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:38:54.283867 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26246638-8113-4edb-ba58-c30d03d58337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:38:54.285093 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26246638-8113-4edb-ba58-c30d03d58337 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:54.285907 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26246638-8113-4edb-ba58-c30d03d58337 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:54.286645 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26246638-8113-4edb-ba58-c30d03d58337 admin admin] PATH_INFO: `/v3/users/47bdbd5d201c465a82540c1d8c0fdf57` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:54.288215 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26246638-8113-4edb-ba58-c30d03d58337 admin admin] RBAC: Authorizing `identity:delete_user(user_id=47bdbd5d201c465a82540c1d8c0fdf57)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:38:54.290422 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26246638-8113-4edb-ba58-c30d03d58337 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:38:54.405006 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-26246638-8113-4edb-ba58-c30d03d58337 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47bdbd5d201c465a82540c1d8c0fdf57'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:38:54.405692 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-26246638-8113-4edb-ba58-c30d03d58337 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47bdbd5d201c465a82540c1d8c0fdf57'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:38:54.416021 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-26246638-8113-4edb-ba58-c30d03d58337 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47bdbd5d201c465a82540c1d8c0fdf57'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:38:54.427812 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-26246638-8113-4edb-ba58-c30d03d58337 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47bdbd5d201c465a82540c1d8c0fdf57'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:38:54.448021 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-26246638-8113-4edb-ba58-c30d03d58337 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47bdbd5d201c465a82540c1d8c0fdf57'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:38:54.460575 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3790/7547] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:38:54 2022] DELETE /identity/v3/users/47bdbd5d201c465a82540c1d8c0fdf57 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:38:55.045258 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f8f416-5e80-4791-bd21-871a9d994fc7 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:38:55.063065 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f8f416-5e80-4791-bd21-871a9d994fc7 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:38:55.159283 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af21519-a910-4970-bccd-e7eac53bac4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:38:55.160588 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af21519-a910-4970-bccd-e7eac53bac4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:55.161106 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af21519-a910-4970-bccd-e7eac53bac4b admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:55.161388 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af21519-a910-4970-bccd-e7eac53bac4b admin admin] PATH_INFO: `/v3/projects/6f1825873b0849ea98136c0979b251c4` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:55.163123 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af21519-a910-4970-bccd-e7eac53bac4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f1825873b0849ea98136c0979b251c4)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:38:55.169518 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af21519-a910-4970-bccd-e7eac53bac4b admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:38:55.225996 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:38:55.250432 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-1af21519-a910-4970-bccd-e7eac53bac4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f1825873b0849ea98136c0979b251c4', 'request_id': 'req-1af21519-a910-4970-bccd-e7eac53bac4b'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:38:55.261043 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-1af21519-a910-4970-bccd-e7eac53bac4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f1825873b0849ea98136c0979b251c4', 'request_id': 'req-1af21519-a910-4970-bccd-e7eac53bac4b'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:38:55.268354 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-1af21519-a910-4970-bccd-e7eac53bac4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f1825873b0849ea98136c0979b251c4', 'request_id': 'req-1af21519-a910-4970-bccd-e7eac53bac4b'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:38:55.281598 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-1af21519-a910-4970-bccd-e7eac53bac4b admin admin] The token cache is being invalidate because project 6f1825873b0849ea98136c0979b251c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:38:55.282206 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-1af21519-a910-4970-bccd-e7eac53bac4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:38:55.283067 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-1af21519-a910-4970-bccd-e7eac53bac4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:38:55.284827 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3758/7548] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:38:55 2022] DELETE /identity/v3/projects/6f1825873b0849ea98136c0979b251c4 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:38:55.289138 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26246638-8113-4edb-ba58-c30d03d58337 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:38:55.290855 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-26246638-8113-4edb-ba58-c30d03d58337 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:38:55.309361 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26246638-8113-4edb-ba58-c30d03d58337 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:38:55.379385 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d42e5b-a325-4011-baf7-e8f4ea51821f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:38:55.380284 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d42e5b-a325-4011-baf7-e8f4ea51821f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:55.380734 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d42e5b-a325-4011-baf7-e8f4ea51821f admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:55.381005 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d42e5b-a325-4011-baf7-e8f4ea51821f admin admin] PATH_INFO: `/v3/users/b338527a084f45d3bb03e2b69c486d8d` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:55.382978 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d42e5b-a325-4011-baf7-e8f4ea51821f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b338527a084f45d3bb03e2b69c486d8d)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:38:55.387069 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d42e5b-a325-4011-baf7-e8f4ea51821f admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:38:55.483367 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:38:55.490685 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-f3d42e5b-a325-4011-baf7-e8f4ea51821f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b338527a084f45d3bb03e2b69c486d8d'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:38:55.491767 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-f3d42e5b-a325-4011-baf7-e8f4ea51821f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b338527a084f45d3bb03e2b69c486d8d'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:38:55.530656 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-f3d42e5b-a325-4011-baf7-e8f4ea51821f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b338527a084f45d3bb03e2b69c486d8d'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:38:55.546995 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-f3d42e5b-a325-4011-baf7-e8f4ea51821f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b338527a084f45d3bb03e2b69c486d8d'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:38:55.572785 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-f3d42e5b-a325-4011-baf7-e8f4ea51821f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b338527a084f45d3bb03e2b69c486d8d'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:38:55.580898 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3791/7549] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:38:55 2022] DELETE /identity/v3/users/b338527a084f45d3bb03e2b69c486d8d => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:38:56.140360 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af21519-a910-4970-bccd-e7eac53bac4b admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:38:56.142095 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-1af21519-a910-4970-bccd-e7eac53bac4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:38:56.166598 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af21519-a910-4970-bccd-e7eac53bac4b admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:38:56.315369 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a8009a-e48e-467d-85ba-765adefd6325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:38:56.316267 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a8009a-e48e-467d-85ba-765adefd6325 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:38:56.316541 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a8009a-e48e-467d-85ba-765adefd6325 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:38:56.316828 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a8009a-e48e-467d-85ba-765adefd6325 admin admin] PATH_INFO: `/v3/projects/6bba4cc301d8412ea4b79e2403d58ce2` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:38:56.319033 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a8009a-e48e-467d-85ba-765adefd6325 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6bba4cc301d8412ea4b79e2403d58ce2)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:38:56.320965 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a8009a-e48e-467d-85ba-765adefd6325 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:38:56.412167 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-01a8009a-e48e-467d-85ba-765adefd6325 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6bba4cc301d8412ea4b79e2403d58ce2', 'request_id': 'req-01a8009a-e48e-467d-85ba-765adefd6325'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:38:56.427374 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-01a8009a-e48e-467d-85ba-765adefd6325 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6bba4cc301d8412ea4b79e2403d58ce2', 'request_id': 'req-01a8009a-e48e-467d-85ba-765adefd6325'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:38:56.434708 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-01a8009a-e48e-467d-85ba-765adefd6325 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6bba4cc301d8412ea4b79e2403d58ce2', 'request_id': 'req-01a8009a-e48e-467d-85ba-765adefd6325'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:38:56.449423 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-01a8009a-e48e-467d-85ba-765adefd6325 admin admin] The token cache is being invalidate because project 6bba4cc301d8412ea4b79e2403d58ce2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:38:56.449811 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-01a8009a-e48e-467d-85ba-765adefd6325 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:38:56.450675 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-01a8009a-e48e-467d-85ba-765adefd6325 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:38:56.457974 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3759/7550] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:38:56 2022] DELETE /identity/v3/projects/6bba4cc301d8412ea4b79e2403d58ce2 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:39:05.035618 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d42e5b-a325-4011-baf7-e8f4ea51821f admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:39:05.037768 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-f3d42e5b-a325-4011-baf7-e8f4ea51821f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:39:05.054111 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d42e5b-a325-4011-baf7-e8f4ea51821f admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:39:05.118533 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9734da5c-9bc2-45bf-bbfd-bfc3c6e9b4a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:39:05.119551 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9734da5c-9bc2-45bf-bbfd-bfc3c6e9b4a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:39:05.119933 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9734da5c-9bc2-45bf-bbfd-bfc3c6e9b4a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:39:05.120271 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9734da5c-9bc2-45bf-bbfd-bfc3c6e9b4a8 admin admin] PATH_INFO: `/v3/users/e7b737394932432dbfadcd6cf26de29d` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:39:05.121894 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9734da5c-9bc2-45bf-bbfd-bfc3c6e9b4a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7b737394932432dbfadcd6cf26de29d)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:39:05.123486 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9734da5c-9bc2-45bf-bbfd-bfc3c6e9b4a8 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:39:05.175970 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-9734da5c-9bc2-45bf-bbfd-bfc3c6e9b4a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7b737394932432dbfadcd6cf26de29d'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:39:05.176542 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-9734da5c-9bc2-45bf-bbfd-bfc3c6e9b4a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7b737394932432dbfadcd6cf26de29d'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:39:05.184616 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-9734da5c-9bc2-45bf-bbfd-bfc3c6e9b4a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7b737394932432dbfadcd6cf26de29d'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:39:05.196439 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-9734da5c-9bc2-45bf-bbfd-bfc3c6e9b4a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7b737394932432dbfadcd6cf26de29d'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:39:05.210082 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-9734da5c-9bc2-45bf-bbfd-bfc3c6e9b4a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7b737394932432dbfadcd6cf26de29d'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:39:05.218768 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3792/7551] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:39:05 2022] DELETE /identity/v3/users/e7b737394932432dbfadcd6cf26de29d => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:39:05.652658 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a8009a-e48e-467d-85ba-765adefd6325 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:39:05.654177 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-01a8009a-e48e-467d-85ba-765adefd6325 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:39:05.678518 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a8009a-e48e-467d-85ba-765adefd6325 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:39:05.744497 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735a8b6d-05ff-4a45-bb0f-c60bcb65ceaa None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:39:05.744856 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735a8b6d-05ff-4a45-bb0f-c60bcb65ceaa None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:39:05.745053 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735a8b6d-05ff-4a45-bb0f-c60bcb65ceaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:39:05.766120 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-735a8b6d-05ff-4a45-bb0f-c60bcb65ceaa None None] MFA Rules not processed for user `cb4d9b73581a467da24255792e2ddb20`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:39:05.767348 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-735a8b6d-05ff-4a45-bb0f-c60bcb65ceaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:39:05.788419 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:39:05.800121 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa71480-2b76-4600-8de6-2c6cdc1254cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:39:05.801108 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa71480-2b76-4600-8de6-2c6cdc1254cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:39:05.801392 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa71480-2b76-4600-8de6-2c6cdc1254cd admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:39:05.801662 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa71480-2b76-4600-8de6-2c6cdc1254cd admin admin] PATH_INFO: `/v3/projects/20471be81d304644914d5b8b39f61da3` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:39:05.803172 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa71480-2b76-4600-8de6-2c6cdc1254cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=20471be81d304644914d5b8b39f61da3)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:39:05.805998 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa71480-2b76-4600-8de6-2c6cdc1254cd admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:39:05.851565 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:39:05.877909 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3793/7552] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:39:05 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:39:05.890699 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-aaa71480-2b76-4600-8de6-2c6cdc1254cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20471be81d304644914d5b8b39f61da3', 'request_id': 'req-aaa71480-2b76-4600-8de6-2c6cdc1254cd'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:39:05.904704 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-aaa71480-2b76-4600-8de6-2c6cdc1254cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20471be81d304644914d5b8b39f61da3', 'request_id': 'req-aaa71480-2b76-4600-8de6-2c6cdc1254cd'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:39:05.915074 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-aaa71480-2b76-4600-8de6-2c6cdc1254cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20471be81d304644914d5b8b39f61da3', 'request_id': 'req-aaa71480-2b76-4600-8de6-2c6cdc1254cd'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:39:05.937768 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-aaa71480-2b76-4600-8de6-2c6cdc1254cd admin admin] The token cache is being invalidate because project 20471be81d304644914d5b8b39f61da3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:39:05.938104 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-aaa71480-2b76-4600-8de6-2c6cdc1254cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:39:05.938941 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-aaa71480-2b76-4600-8de6-2c6cdc1254cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:39:05.941357 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3760/7553] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:39:05 2022] DELETE /identity/v3/projects/20471be81d304644914d5b8b39f61da3 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:39:05.945062 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735a8b6d-05ff-4a45-bb0f-c60bcb65ceaa None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:39:05.946469 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-735a8b6d-05ff-4a45-bb0f-c60bcb65ceaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:39:05.972969 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735a8b6d-05ff-4a45-bb0f-c60bcb65ceaa None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:39:06.060688 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d7ab86-4169-4209-9879-7c554edba8c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:39:06.062428 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d7ab86-4169-4209-9879-7c554edba8c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:39:06.062567 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d7ab86-4169-4209-9879-7c554edba8c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:39:06.062739 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d7ab86-4169-4209-9879-7c554edba8c1 admin admin] PATH_INFO: `/v3/users/6984dcc835ad4d7c8bef37e7fff6d018` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:39:06.064094 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d7ab86-4169-4209-9879-7c554edba8c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6984dcc835ad4d7c8bef37e7fff6d018)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:39:06.066537 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d7ab86-4169-4209-9879-7c554edba8c1 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:39:06.131674 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-f3d7ab86-4169-4209-9879-7c554edba8c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6984dcc835ad4d7c8bef37e7fff6d018'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:39:06.133140 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-f3d7ab86-4169-4209-9879-7c554edba8c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6984dcc835ad4d7c8bef37e7fff6d018'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:39:06.143146 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-f3d7ab86-4169-4209-9879-7c554edba8c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6984dcc835ad4d7c8bef37e7fff6d018'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:39:06.153248 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-f3d7ab86-4169-4209-9879-7c554edba8c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6984dcc835ad4d7c8bef37e7fff6d018'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:39:06.168475 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-f3d7ab86-4169-4209-9879-7c554edba8c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6984dcc835ad4d7c8bef37e7fff6d018'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:39:06.178111 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3794/7554] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:39:05 2022] DELETE /identity/v3/users/6984dcc835ad4d7c8bef37e7fff6d018 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:39:06.798833 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa71480-2b76-4600-8de6-2c6cdc1254cd admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:39:06.801497 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-aaa71480-2b76-4600-8de6-2c6cdc1254cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:39:06.833360 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa71480-2b76-4600-8de6-2c6cdc1254cd admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:39:06.984177 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d36cc28-2b92-42f5-86f2-f7802fbbc49f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:39:06.985234 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d36cc28-2b92-42f5-86f2-f7802fbbc49f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:39:06.985507 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d36cc28-2b92-42f5-86f2-f7802fbbc49f admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:39:06.985783 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d36cc28-2b92-42f5-86f2-f7802fbbc49f admin admin] PATH_INFO: `/v3/projects/4e62f2f7963f4e368a5737fb305dabe9` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:39:06.987342 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d36cc28-2b92-42f5-86f2-f7802fbbc49f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e62f2f7963f4e368a5737fb305dabe9)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:39:06.990323 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d36cc28-2b92-42f5-86f2-f7802fbbc49f admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:39:07.166943 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-0d36cc28-2b92-42f5-86f2-f7802fbbc49f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e62f2f7963f4e368a5737fb305dabe9', 'request_id': 'req-0d36cc28-2b92-42f5-86f2-f7802fbbc49f'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:39:07.182597 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-0d36cc28-2b92-42f5-86f2-f7802fbbc49f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e62f2f7963f4e368a5737fb305dabe9', 'request_id': 'req-0d36cc28-2b92-42f5-86f2-f7802fbbc49f'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:39:07.190654 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-0d36cc28-2b92-42f5-86f2-f7802fbbc49f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e62f2f7963f4e368a5737fb305dabe9', 'request_id': 'req-0d36cc28-2b92-42f5-86f2-f7802fbbc49f'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:39:07.204689 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-0d36cc28-2b92-42f5-86f2-f7802fbbc49f admin admin] The token cache is being invalidate because project 4e62f2f7963f4e368a5737fb305dabe9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:39:07.205266 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-0d36cc28-2b92-42f5-86f2-f7802fbbc49f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:39:07.206173 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-0d36cc28-2b92-42f5-86f2-f7802fbbc49f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:39:07.208735 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3761/7555] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:39:06 2022] DELETE /identity/v3/projects/4e62f2f7963f4e368a5737fb305dabe9 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:39:07.214185 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c4350c-b1ec-4d30-a765-36f8d67abdcd None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:39:07.215079 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c4350c-b1ec-4d30-a765-36f8d67abdcd None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:39:07.215571 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c4350c-b1ec-4d30-a765-36f8d67abdcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:39:07.235710 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-02c4350c-b1ec-4d30-a765-36f8d67abdcd None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:39:07.237484 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-02c4350c-b1ec-4d30-a765-36f8d67abdcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:39:07.328306 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3795/7556] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:39:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:39:07.329177 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48c72ce-6bc8-4f6f-9cfd-34f9f0445880 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:39:07.329468 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48c72ce-6bc8-4f6f-9cfd-34f9f0445880 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:39:07.329762 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48c72ce-6bc8-4f6f-9cfd-34f9f0445880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:39:07.357620 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-f48c72ce-6bc8-4f6f-9cfd-34f9f0445880 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:39:07.359291 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-f48c72ce-6bc8-4f6f-9cfd-34f9f0445880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:39:07.374520 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3762/7557] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:39:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:39:07.381586 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c4350c-b1ec-4d30-a765-36f8d67abdcd None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:39:07.402855 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c4350c-b1ec-4d30-a765-36f8d67abdcd None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:39:07.408933 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a8f973-1081-49aa-ab85-d6f36967aa03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:39:07.409920 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a8f973-1081-49aa-ab85-d6f36967aa03 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:39:07.410403 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a8f973-1081-49aa-ab85-d6f36967aa03 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:39:07.410875 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a8f973-1081-49aa-ab85-d6f36967aa03 admin admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:39:07.412079 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a8f973-1081-49aa-ab85-d6f36967aa03 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:39:07.412536 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a8f973-1081-49aa-ab85-d6f36967aa03 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:39:07.414422 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a8f973-1081-49aa-ab85-d6f36967aa03 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:39:07.417205 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:39:07.440182 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3796/7558] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:39:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:39:07.441895 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48c72ce-6bc8-4f6f-9cfd-34f9f0445880 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:39:07.448490 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:39:07.457170 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48c72ce-6bc8-4f6f-9cfd-34f9f0445880 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:39:07.478831 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65562a6-879c-4d2e-8a70-25fe8905e0cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:39:07.479834 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65562a6-879c-4d2e-8a70-25fe8905e0cd admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:39:07.480236 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65562a6-879c-4d2e-8a70-25fe8905e0cd admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:39:07.481175 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65562a6-879c-4d2e-8a70-25fe8905e0cd admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:39:07.482609 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65562a6-879c-4d2e-8a70-25fe8905e0cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:39:07.486265 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65562a6-879c-4d2e-8a70-25fe8905e0cd admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:39:07.543432 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3763/7559] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:39:07 2022] POST /identity/v3/projects => generated 377 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:39:07.548930 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a8f973-1081-49aa-ab85-d6f36967aa03 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:39:07.563122 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a8f973-1081-49aa-ab85-d6f36967aa03 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:39:07.708053 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fac5ff-06e7-4191-bb85-9def633c5efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:39:07.710473 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fac5ff-06e7-4191-bb85-9def633c5efa admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:39:07.710767 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fac5ff-06e7-4191-bb85-9def633c5efa admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:39:07.713281 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fac5ff-06e7-4191-bb85-9def633c5efa admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:39:07.714832 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fac5ff-06e7-4191-bb85-9def633c5efa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:39:07.718053 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fac5ff-06e7-4191-bb85-9def633c5efa admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:39:07.750115 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3797/7560] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:39:07 2022] POST /identity/v3/users => generated 289 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:39:07.753108 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65562a6-879c-4d2e-8a70-25fe8905e0cd admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:39:07.781039 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65562a6-879c-4d2e-8a70-25fe8905e0cd admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:39:07.787285 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e02d1f-93c7-491e-b2ab-8873276687b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:39:07.787978 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e02d1f-93c7-491e-b2ab-8873276687b8 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:39:07.788264 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e02d1f-93c7-491e-b2ab-8873276687b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:39:07.788530 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e02d1f-93c7-491e-b2ab-8873276687b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:39:07.790085 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e02d1f-93c7-491e-b2ab-8873276687b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:39:07.791845 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e02d1f-93c7-491e-b2ab-8873276687b8 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:39:07.840514 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3764/7561] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:39:07 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:39:07.845761 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fac5ff-06e7-4191-bb85-9def633c5efa admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:39:07.869673 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fac5ff-06e7-4191-bb85-9def633c5efa admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:39:07.875513 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb59e42-8c6d-4568-879c-88879d2d03d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:39:07.876208 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb59e42-8c6d-4568-879c-88879d2d03d0 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:39:07.876487 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb59e42-8c6d-4568-879c-88879d2d03d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:39:07.876820 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb59e42-8c6d-4568-879c-88879d2d03d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:39:07.877552 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb59e42-8c6d-4568-879c-88879d2d03d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:39:07.879215 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb59e42-8c6d-4568-879c-88879d2d03d0 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:39:07.894614 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3798/7562] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:39:07 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:39:07.899985 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e02d1f-93c7-491e-b2ab-8873276687b8 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:39:07.911737 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e02d1f-93c7-491e-b2ab-8873276687b8 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:39:07.916554 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2239800b-cccf-4ce3-9375-ca3f21cb03b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:39:07.917446 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2239800b-cccf-4ce3-9375-ca3f21cb03b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:39:07.917898 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2239800b-cccf-4ce3-9375-ca3f21cb03b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:39:07.918344 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2239800b-cccf-4ce3-9375-ca3f21cb03b9 admin admin] PATH_INFO: `/v3/projects/57332eb8cde04a958b6233b4529372f4/users/7f73deb66927486aa78dcc7030cdacb0/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:39:07.936401 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2239800b-cccf-4ce3-9375-ca3f21cb03b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57332eb8cde04a958b6233b4529372f4, user_id=7f73deb66927486aa78dcc7030cdacb0, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:39:07.939926 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2239800b-cccf-4ce3-9375-ca3f21cb03b9 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:39:07.959333 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3765/7563] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:39:07 2022] PUT /identity/v3/projects/57332eb8cde04a958b6233b4529372f4/users/7f73deb66927486aa78dcc7030cdacb0/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:39:07.970958 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ed4dea-7603-45d4-8f45-115491179cfb None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:39:07.971054 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ed4dea-7603-45d4-8f45-115491179cfb None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:39:07.971392 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ed4dea-7603-45d4-8f45-115491179cfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:39:08.019380 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-a2ed4dea-7603-45d4-8f45-115491179cfb None None] MFA Rules not processed for user `7f73deb66927486aa78dcc7030cdacb0`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:39:08.020605 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-a2ed4dea-7603-45d4-8f45-115491179cfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:39:08.111446 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3799/7564] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:39:07 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:39:08.125107 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2239800b-cccf-4ce3-9375-ca3f21cb03b9 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:39:08.127157 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-2239800b-cccf-4ce3-9375-ca3f21cb03b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:39:08.195220 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2239800b-cccf-4ce3-9375-ca3f21cb03b9 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:39:08.199627 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc60f85-ed46-4fa4-b326-fabadc4c48ee service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7f2db148c8e4d5d81431cae3576434b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:39:08.200607 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc60f85-ed46-4fa4-b326-fabadc4c48ee service glance] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:39:08.201104 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc60f85-ed46-4fa4-b326-fabadc4c48ee service glance] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:39:08.201382 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc60f85-ed46-4fa4-b326-fabadc4c48ee service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:39:08.215698 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc60f85-ed46-4fa4-b326-fabadc4c48ee service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:39:08.218443 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc60f85-ed46-4fa4-b326-fabadc4c48ee service glance] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:39:08.233597 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3766/7565] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:39:08 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:39:10.334069 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ed4dea-7603-45d4-8f45-115491179cfb None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:39:10.335556 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-a2ed4dea-7603-45d4-8f45-115491179cfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:39:10.358527 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc60f85-ed46-4fa4-b326-fabadc4c48ee service glance] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:39:10.454245 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc60f85-ed46-4fa4-b326-fabadc4c48ee service glance] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:39:10.459789 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2019615b-12b3-40da-9fef-055d914de83f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:39:10.460961 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2019615b-12b3-40da-9fef-055d914de83f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:39:10.461403 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2019615b-12b3-40da-9fef-055d914de83f admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:39:10.462146 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2019615b-12b3-40da-9fef-055d914de83f admin admin] PATH_INFO: `/v3/users/7f73deb66927486aa78dcc7030cdacb0` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:39:10.464327 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2019615b-12b3-40da-9fef-055d914de83f admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f73deb66927486aa78dcc7030cdacb0)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:39:10.466101 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ed4dea-7603-45d4-8f45-115491179cfb None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:39:10.467371 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2019615b-12b3-40da-9fef-055d914de83f admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:39:10.470032 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f269f77-6c98-4fc8-be9e-ceb6c7410c70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:39:10.470717 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f269f77-6c98-4fc8-be9e-ceb6c7410c70 service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:39:10.470999 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f269f77-6c98-4fc8-be9e-ceb6c7410c70 service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:39:10.471274 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f269f77-6c98-4fc8-be9e-ceb6c7410c70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:39:10.479628 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-6f269f77-6c98-4fc8-be9e-ceb6c7410c70 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:39:10.517030 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f269f77-6c98-4fc8-be9e-ceb6c7410c70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:39:10.518559 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f269f77-6c98-4fc8-be9e-ceb6c7410c70 service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:39:10.548906 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3800/7566] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:39:10 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:39:10.589240 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-2019615b-12b3-40da-9fef-055d914de83f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f73deb66927486aa78dcc7030cdacb0'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:39:10.595115 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:39:10.598720 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-2019615b-12b3-40da-9fef-055d914de83f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f73deb66927486aa78dcc7030cdacb0'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:39:10.599743 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-2019615b-12b3-40da-9fef-055d914de83f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f73deb66927486aa78dcc7030cdacb0'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:39:10.611471 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-2019615b-12b3-40da-9fef-055d914de83f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f73deb66927486aa78dcc7030cdacb0'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:39:10.634233 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-2019615b-12b3-40da-9fef-055d914de83f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f73deb66927486aa78dcc7030cdacb0'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:39:10.652488 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3767/7567] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:39:10 2022] DELETE /identity/v3/users/7f73deb66927486aa78dcc7030cdacb0 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:39:10.654697 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fcfbae-925c-46bd-b619-55316a74a421 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:39:10.655225 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fcfbae-925c-46bd-b619-55316a74a421 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:39:10.655695 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fcfbae-925c-46bd-b619-55316a74a421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:39:10.666272 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:39:10.685710 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-85fcfbae-925c-46bd-b619-55316a74a421 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:39:10.688169 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-85fcfbae-925c-46bd-b619-55316a74a421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:39:10.783570 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3801/7568] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:39:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:39:10.805339 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2019615b-12b3-40da-9fef-055d914de83f admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:39:10.807943 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-2019615b-12b3-40da-9fef-055d914de83f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:39:10.956838 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2019615b-12b3-40da-9fef-055d914de83f admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:39:10.961184 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2928b99-5a61-4fe8-93cb-610fa50df309 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:39:10.961964 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2928b99-5a61-4fe8-93cb-610fa50df309 service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:39:10.962355 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2928b99-5a61-4fe8-93cb-610fa50df309 service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:39:10.962780 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2928b99-5a61-4fe8-93cb-610fa50df309 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:39:10.977239 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2928b99-5a61-4fe8-93cb-610fa50df309 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:39:10.987500 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2928b99-5a61-4fe8-93cb-610fa50df309 service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:39:11.040803 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3768/7569] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:39:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:39:11.503676 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fcfbae-925c-46bd-b619-55316a74a421 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:39:11.505265 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-85fcfbae-925c-46bd-b619-55316a74a421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:39:11.541584 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fcfbae-925c-46bd-b619-55316a74a421 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:39:11.560351 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b2bd6d-062d-40ad-9264-22e2147c61d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:39:11.562298 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b2bd6d-062d-40ad-9264-22e2147c61d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:39:11.562736 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b2bd6d-062d-40ad-9264-22e2147c61d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:39:11.563160 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b2bd6d-062d-40ad-9264-22e2147c61d0 admin admin] PATH_INFO: `/v3/projects/57332eb8cde04a958b6233b4529372f4` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:39:11.565746 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b2bd6d-062d-40ad-9264-22e2147c61d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=57332eb8cde04a958b6233b4529372f4)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:39:11.570301 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b2bd6d-062d-40ad-9264-22e2147c61d0 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:39:11.699386 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c5b2bd6d-062d-40ad-9264-22e2147c61d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57332eb8cde04a958b6233b4529372f4', 'request_id': 'req-c5b2bd6d-062d-40ad-9264-22e2147c61d0'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:39:11.719275 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c5b2bd6d-062d-40ad-9264-22e2147c61d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57332eb8cde04a958b6233b4529372f4', 'request_id': 'req-c5b2bd6d-062d-40ad-9264-22e2147c61d0'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:39:11.730300 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c5b2bd6d-062d-40ad-9264-22e2147c61d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57332eb8cde04a958b6233b4529372f4', 'request_id': 'req-c5b2bd6d-062d-40ad-9264-22e2147c61d0'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:39:11.756381 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c5b2bd6d-062d-40ad-9264-22e2147c61d0 admin admin] The token cache is being invalidate because project 57332eb8cde04a958b6233b4529372f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:39:11.756869 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c5b2bd6d-062d-40ad-9264-22e2147c61d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:39:11.757796 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c5b2bd6d-062d-40ad-9264-22e2147c61d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:39:11.764918 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3802/7570] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:39:11 2022] DELETE /identity/v3/projects/57332eb8cde04a958b6233b4529372f4 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:39:11.773289 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d471bd9b-9f6d-483f-83a9-ce37edca5eda None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:39:11.773787 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d471bd9b-9f6d-483f-83a9-ce37edca5eda None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:39:11.773958 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d471bd9b-9f6d-483f-83a9-ce37edca5eda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:39:11.802367 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-d471bd9b-9f6d-483f-83a9-ce37edca5eda None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:39:11.803454 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-d471bd9b-9f6d-483f-83a9-ce37edca5eda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:39:11.924692 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3769/7571] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:39:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:39:11.937441 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad0a87f-0dd9-472f-977c-e3f6dd592f69 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:39:11.937729 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad0a87f-0dd9-472f-977c-e3f6dd592f69 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:39:11.945031 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad0a87f-0dd9-472f-977c-e3f6dd592f69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:39:11.978887 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-7ad0a87f-0dd9-472f-977c-e3f6dd592f69 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:39:11.981276 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-7ad0a87f-0dd9-472f-977c-e3f6dd592f69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:39:12.015691 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3803/7572] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:39:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:39:12.019854 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d471bd9b-9f6d-483f-83a9-ce37edca5eda None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:39:12.030619 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d471bd9b-9f6d-483f-83a9-ce37edca5eda None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:39:12.047650 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e285f22c-6faf-4b04-bd73-d2dada95a1f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:39:12.048381 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e285f22c-6faf-4b04-bd73-d2dada95a1f6 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:39:12.048726 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e285f22c-6faf-4b04-bd73-d2dada95a1f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:39:12.048999 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e285f22c-6faf-4b04-bd73-d2dada95a1f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:39:12.049750 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e285f22c-6faf-4b04-bd73-d2dada95a1f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:39:12.050160 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e285f22c-6faf-4b04-bd73-d2dada95a1f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:39:12.051780 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e285f22c-6faf-4b04-bd73-d2dada95a1f6 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:39:12.086557 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3770/7573] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:39:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:39:12.090305 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad0a87f-0dd9-472f-977c-e3f6dd592f69 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:39:12.102296 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad0a87f-0dd9-472f-977c-e3f6dd592f69 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:39:12.131467 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e82031-6fb1-49b4-998d-288c8c8bcf41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:39:12.131467 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e82031-6fb1-49b4-998d-288c8c8bcf41 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:39:12.131784 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e82031-6fb1-49b4-998d-288c8c8bcf41 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:39:12.132028 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e82031-6fb1-49b4-998d-288c8c8bcf41 admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:39:12.132748 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e82031-6fb1-49b4-998d-288c8c8bcf41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:39:12.134816 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e82031-6fb1-49b4-998d-288c8c8bcf41 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:39:12.191783 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3804/7574] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:39:12 2022] POST /identity/v3/projects => generated 375 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:39:12.193289 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e285f22c-6faf-4b04-bd73-d2dada95a1f6 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:39:12.216549 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e285f22c-6faf-4b04-bd73-d2dada95a1f6 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:39:12.401004 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdd2cd5-fd9a-4ea3-bade-1d8c5f37696e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:39:12.401751 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdd2cd5-fd9a-4ea3-bade-1d8c5f37696e admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:39:12.402059 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdd2cd5-fd9a-4ea3-bade-1d8c5f37696e admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:39:12.402328 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdd2cd5-fd9a-4ea3-bade-1d8c5f37696e admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:39:12.403088 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdd2cd5-fd9a-4ea3-bade-1d8c5f37696e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:39:12.406024 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdd2cd5-fd9a-4ea3-bade-1d8c5f37696e admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:39:12.417002 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:39:12.464967 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3771/7575] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:39:12 2022] POST /identity/v3/users => generated 288 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:39:12.471008 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e82031-6fb1-49b4-998d-288c8c8bcf41 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:39:12.489014 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e82031-6fb1-49b4-998d-288c8c8bcf41 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:39:12.504412 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400a44d1-598c-4257-8795-3381afbfe88c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:39:12.505502 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400a44d1-598c-4257-8795-3381afbfe88c admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:39:12.505798 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400a44d1-598c-4257-8795-3381afbfe88c admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:39:12.506141 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400a44d1-598c-4257-8795-3381afbfe88c admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:39:12.507332 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400a44d1-598c-4257-8795-3381afbfe88c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:39:12.512594 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400a44d1-598c-4257-8795-3381afbfe88c admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:39:12.537846 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3805/7576] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:39:12 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:39:12.540495 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdd2cd5-fd9a-4ea3-bade-1d8c5f37696e admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:39:12.556937 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdd2cd5-fd9a-4ea3-bade-1d8c5f37696e admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:39:12.563883 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f09c43-a562-4ef9-a248-0f005b9372e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:39:12.564743 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f09c43-a562-4ef9-a248-0f005b9372e3 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:39:12.564743 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f09c43-a562-4ef9-a248-0f005b9372e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:39:12.564743 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f09c43-a562-4ef9-a248-0f005b9372e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:39:12.565483 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f09c43-a562-4ef9-a248-0f005b9372e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:39:12.567496 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f09c43-a562-4ef9-a248-0f005b9372e3 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:39:12.584086 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3772/7577] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:39:12 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:39:12.585334 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400a44d1-598c-4257-8795-3381afbfe88c admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:39:12.601822 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400a44d1-598c-4257-8795-3381afbfe88c admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:39:12.607464 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3627961-de34-405c-88bf-4fddd1372210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:39:12.609689 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3627961-de34-405c-88bf-4fddd1372210 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:39:12.609814 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3627961-de34-405c-88bf-4fddd1372210 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:39:12.610225 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3627961-de34-405c-88bf-4fddd1372210 admin admin] PATH_INFO: `/v3/projects/65492b81223147b8b79b29554f822059/users/3f5e5b087bdf48f6912a9e8aa3b78d5c/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:39:12.628557 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3627961-de34-405c-88bf-4fddd1372210 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65492b81223147b8b79b29554f822059, user_id=3f5e5b087bdf48f6912a9e8aa3b78d5c, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:39:12.632812 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3627961-de34-405c-88bf-4fddd1372210 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:39:12.664516 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3806/7578] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:39:12 2022] PUT /identity/v3/projects/65492b81223147b8b79b29554f822059/users/3f5e5b087bdf48f6912a9e8aa3b78d5c/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:39:12.764545 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f89867-a2c0-406f-90e6-e8d4243d7de9 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:39:12.765008 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f89867-a2c0-406f-90e6-e8d4243d7de9 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:39:12.765383 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f89867-a2c0-406f-90e6-e8d4243d7de9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:39:12.802778 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-35f89867-a2c0-406f-90e6-e8d4243d7de9 None None] MFA Rules not processed for user `3f5e5b087bdf48f6912a9e8aa3b78d5c`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:39:12.804074 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-35f89867-a2c0-406f-90e6-e8d4243d7de9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:39:12.938474 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3773/7579] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:39:12 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:39:12.945673 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3627961-de34-405c-88bf-4fddd1372210 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:39:12.947609 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-f3627961-de34-405c-88bf-4fddd1372210 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:39:12.988198 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:39:13.037796 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3627961-de34-405c-88bf-4fddd1372210 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:39:13.047136 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35959e7a-856a-4702-bd8c-3a5d9ae8992c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec5fd3a489c341b7964704d689037f05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:39:13.048175 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35959e7a-856a-4702-bd8c-3a5d9ae8992c service cinder] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:39:13.048687 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35959e7a-856a-4702-bd8c-3a5d9ae8992c service cinder] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:39:13.049001 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35959e7a-856a-4702-bd8c-3a5d9ae8992c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:39:13.062041 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35959e7a-856a-4702-bd8c-3a5d9ae8992c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:39:13.063834 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35959e7a-856a-4702-bd8c-3a5d9ae8992c service cinder] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:39:13.076250 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3807/7580] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:39:12 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:39:15.016123 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f89867-a2c0-406f-90e6-e8d4243d7de9 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:39:15.131979 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f89867-a2c0-406f-90e6-e8d4243d7de9 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:39:15.148206 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c26b6d-3193-4db6-acaa-ee5c90327406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:39:15.149131 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c26b6d-3193-4db6-acaa-ee5c90327406 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:39:15.149402 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c26b6d-3193-4db6-acaa-ee5c90327406 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:39:15.149673 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c26b6d-3193-4db6-acaa-ee5c90327406 admin admin] PATH_INFO: `/v3/users/3f5e5b087bdf48f6912a9e8aa3b78d5c` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:39:15.152853 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c26b6d-3193-4db6-acaa-ee5c90327406 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f5e5b087bdf48f6912a9e8aa3b78d5c)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:39:15.156196 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c26b6d-3193-4db6-acaa-ee5c90327406 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:39:15.231185 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-29c26b6d-3193-4db6-acaa-ee5c90327406 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f5e5b087bdf48f6912a9e8aa3b78d5c'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:39:15.242345 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-29c26b6d-3193-4db6-acaa-ee5c90327406 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f5e5b087bdf48f6912a9e8aa3b78d5c'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:39:15.244173 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-29c26b6d-3193-4db6-acaa-ee5c90327406 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f5e5b087bdf48f6912a9e8aa3b78d5c'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:39:15.258079 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-29c26b6d-3193-4db6-acaa-ee5c90327406 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f5e5b087bdf48f6912a9e8aa3b78d5c'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:39:15.268556 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:INSERT=4,keystone:SELECT=87,keystone:DELETE=9 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:39:15.293820 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-29c26b6d-3193-4db6-acaa-ee5c90327406 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f5e5b087bdf48f6912a9e8aa3b78d5c'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:39:15.303627 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3774/7581] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:39:15 2022] DELETE /identity/v3/users/3f5e5b087bdf48f6912a9e8aa3b78d5c => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:39:15.308315 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac800a3d-b759-4731-b314-a02fe04428f2 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:39:15.308859 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac800a3d-b759-4731-b314-a02fe04428f2 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:39:15.308859 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac800a3d-b759-4731-b314-a02fe04428f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:39:15.331195 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-ac800a3d-b759-4731-b314-a02fe04428f2 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:39:15.332774 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-ac800a3d-b759-4731-b314-a02fe04428f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:39:15.437739 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3808/7582] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:39:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:39:15.457774 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c26b6d-3193-4db6-acaa-ee5c90327406 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:39:15.460057 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-29c26b6d-3193-4db6-acaa-ee5c90327406 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:39:15.564525 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c26b6d-3193-4db6-acaa-ee5c90327406 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:39:15.570207 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fa01f7-5b3f-43ab-88c0-ade98184176d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:39:15.571038 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fa01f7-5b3f-43ab-88c0-ade98184176d service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:39:15.571428 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fa01f7-5b3f-43ab-88c0-ade98184176d service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:39:15.571891 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fa01f7-5b3f-43ab-88c0-ade98184176d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:39:15.587142 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fa01f7-5b3f-43ab-88c0-ade98184176d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:39:15.587142 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fa01f7-5b3f-43ab-88c0-ade98184176d service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:39:15.601702 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3775/7583] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:39:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:39:16.778430 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac800a3d-b759-4731-b314-a02fe04428f2 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:39:16.781251 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-ac800a3d-b759-4731-b314-a02fe04428f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:39:16.807638 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac800a3d-b759-4731-b314-a02fe04428f2 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:39:16.825476 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8003ea68-924b-47f3-b419-e9ce90180386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:39:16.827229 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8003ea68-924b-47f3-b419-e9ce90180386 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:39:16.827867 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8003ea68-924b-47f3-b419-e9ce90180386 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:39:16.828414 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8003ea68-924b-47f3-b419-e9ce90180386 admin admin] PATH_INFO: `/v3/projects/65492b81223147b8b79b29554f822059` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:39:16.832731 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8003ea68-924b-47f3-b419-e9ce90180386 admin admin] RBAC: Authorizing `identity:delete_project(project_id=65492b81223147b8b79b29554f822059)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:39:16.836517 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8003ea68-924b-47f3-b419-e9ce90180386 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:39:16.990407 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-8003ea68-924b-47f3-b419-e9ce90180386 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65492b81223147b8b79b29554f822059', 'request_id': 'req-8003ea68-924b-47f3-b419-e9ce90180386'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:39:17.011753 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-8003ea68-924b-47f3-b419-e9ce90180386 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65492b81223147b8b79b29554f822059', 'request_id': 'req-8003ea68-924b-47f3-b419-e9ce90180386'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:39:17.021789 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-8003ea68-924b-47f3-b419-e9ce90180386 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65492b81223147b8b79b29554f822059', 'request_id': 'req-8003ea68-924b-47f3-b419-e9ce90180386'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:39:17.065007 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-8003ea68-924b-47f3-b419-e9ce90180386 admin admin] The token cache is being invalidate because project 65492b81223147b8b79b29554f822059 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:39:17.065384 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-8003ea68-924b-47f3-b419-e9ce90180386 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:39:17.066448 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-8003ea68-924b-47f3-b419-e9ce90180386 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:39:17.070627 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3809/7584] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:39:16 2022] DELETE /identity/v3/projects/65492b81223147b8b79b29554f822059 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:39:17.075947 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c0eeb4-003e-4d60-bd56-72be3ef25e5b None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:39:17.076440 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c0eeb4-003e-4d60-bd56-72be3ef25e5b None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:39:17.076622 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c0eeb4-003e-4d60-bd56-72be3ef25e5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:39:17.128253 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-d1c0eeb4-003e-4d60-bd56-72be3ef25e5b None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:39:17.130711 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-d1c0eeb4-003e-4d60-bd56-72be3ef25e5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:39:17.248621 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3776/7585] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:39:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:39:17.253441 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3164e4ef-e717-4461-9c74-bd0b09b191b0 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:39:17.253724 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3164e4ef-e717-4461-9c74-bd0b09b191b0 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:39:17.254059 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3164e4ef-e717-4461-9c74-bd0b09b191b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:39:17.284979 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-3164e4ef-e717-4461-9c74-bd0b09b191b0 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:39:17.297802 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-3164e4ef-e717-4461-9c74-bd0b09b191b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:39:17.316854 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3810/7586] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:39:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:39:17.318172 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c0eeb4-003e-4d60-bd56-72be3ef25e5b None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:39:17.338807 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c0eeb4-003e-4d60-bd56-72be3ef25e5b None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:39:17.348214 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042c794e-d9bb-480f-a7dd-1d42d8266dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:39:17.349510 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042c794e-d9bb-480f-a7dd-1d42d8266dc6 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:39:17.349510 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042c794e-d9bb-480f-a7dd-1d42d8266dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:39:17.351716 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042c794e-d9bb-480f-a7dd-1d42d8266dc6 admin admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:39:17.352968 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042c794e-d9bb-480f-a7dd-1d42d8266dc6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:39:17.354170 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042c794e-d9bb-480f-a7dd-1d42d8266dc6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:39:17.359196 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042c794e-d9bb-480f-a7dd-1d42d8266dc6 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:39:17.392761 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3777/7587] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:39:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:39:17.394483 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3164e4ef-e717-4461-9c74-bd0b09b191b0 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:39:17.408360 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3164e4ef-e717-4461-9c74-bd0b09b191b0 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:39:17.415026 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6c04fd-bca9-4c0d-a768-45bd31097f52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:39:17.416547 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6c04fd-bca9-4c0d-a768-45bd31097f52 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:39:17.417240 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6c04fd-bca9-4c0d-a768-45bd31097f52 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:39:17.417240 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6c04fd-bca9-4c0d-a768-45bd31097f52 admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:39:17.418046 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6c04fd-bca9-4c0d-a768-45bd31097f52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:39:17.421631 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6c04fd-bca9-4c0d-a768-45bd31097f52 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:39:17.468858 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042c794e-d9bb-480f-a7dd-1d42d8266dc6 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:39:17.470136 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3811/7588] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:39:17 2022] POST /identity/v3/projects => generated 385 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:39:17.484547 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042c794e-d9bb-480f-a7dd-1d42d8266dc6 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:39:17.596672 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7f2c91-ef1d-4da7-96d3-1d0179290c73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:39:17.597724 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7f2c91-ef1d-4da7-96d3-1d0179290c73 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:39:17.598265 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7f2c91-ef1d-4da7-96d3-1d0179290c73 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:39:17.598541 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7f2c91-ef1d-4da7-96d3-1d0179290c73 admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:39:17.599290 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7f2c91-ef1d-4da7-96d3-1d0179290c73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:39:17.601409 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7f2c91-ef1d-4da7-96d3-1d0179290c73 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:39:17.651642 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3778/7589] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:39:17 2022] POST /identity/v3/users => generated 293 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:39:17.663298 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6c04fd-bca9-4c0d-a768-45bd31097f52 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:39:17.692328 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6c04fd-bca9-4c0d-a768-45bd31097f52 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:39:17.705044 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb2f108-c8bf-4a63-8d80-6482540375dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:39:17.705927 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb2f108-c8bf-4a63-8d80-6482540375dc admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:39:17.706216 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb2f108-c8bf-4a63-8d80-6482540375dc admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:39:17.706551 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb2f108-c8bf-4a63-8d80-6482540375dc admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:39:17.707316 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb2f108-c8bf-4a63-8d80-6482540375dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:39:17.709399 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb2f108-c8bf-4a63-8d80-6482540375dc admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:39:17.745914 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3812/7590] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:39:17 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:39:17.747684 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7f2c91-ef1d-4da7-96d3-1d0179290c73 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:39:17.801632 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7f2c91-ef1d-4da7-96d3-1d0179290c73 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:39:17.825624 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415512ce-9bd7-497c-9954-21834d23c304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:39:17.826698 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415512ce-9bd7-497c-9954-21834d23c304 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:39:17.826977 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415512ce-9bd7-497c-9954-21834d23c304 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:39:17.827254 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415512ce-9bd7-497c-9954-21834d23c304 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:39:17.828016 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415512ce-9bd7-497c-9954-21834d23c304 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:39:17.829655 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415512ce-9bd7-497c-9954-21834d23c304 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:39:17.837972 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:39:17.863599 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb2f108-c8bf-4a63-8d80-6482540375dc admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:39:17.882465 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb2f108-c8bf-4a63-8d80-6482540375dc admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:39:17.883729 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3779/7591] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:39:17 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:39:17.888256 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eccc48b-cf1e-450b-a3af-24aca220fe7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:39:17.890351 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eccc48b-cf1e-450b-a3af-24aca220fe7b admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:39:17.890676 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eccc48b-cf1e-450b-a3af-24aca220fe7b admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:39:17.891042 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eccc48b-cf1e-450b-a3af-24aca220fe7b admin admin] PATH_INFO: `/v3/projects/eeed151f3d9744e9aa4055afd51d8645/users/ba1952dad916474d8ae8778c02cb2fcb/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:39:17.903701 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:39:17.914577 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eccc48b-cf1e-450b-a3af-24aca220fe7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=eeed151f3d9744e9aa4055afd51d8645, user_id=ba1952dad916474d8ae8778c02cb2fcb, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:39:17.926171 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eccc48b-cf1e-450b-a3af-24aca220fe7b admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:39:17.967133 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa1c2f8-61e5-4d72-9c7b-cfd8dcc25b93 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:39:17.967422 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa1c2f8-61e5-4d72-9c7b-cfd8dcc25b93 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:39:17.967872 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa1c2f8-61e5-4d72-9c7b-cfd8dcc25b93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:39:17.969232 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3813/7592] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:39:17 2022] PUT /identity/v3/projects/eeed151f3d9744e9aa4055afd51d8645/users/ba1952dad916474d8ae8778c02cb2fcb/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:39:17.998496 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-ffa1c2f8-61e5-4d72-9c7b-cfd8dcc25b93 None None] MFA Rules not processed for user `ba1952dad916474d8ae8778c02cb2fcb`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:39:18.000836 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-ffa1c2f8-61e5-4d72-9c7b-cfd8dcc25b93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:39:18.133216 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3780/7593] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:39:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:39:18.138358 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eccc48b-cf1e-450b-a3af-24aca220fe7b admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:39:18.140139 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-8eccc48b-cf1e-450b-a3af-24aca220fe7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:39:18.234604 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eccc48b-cf1e-450b-a3af-24aca220fe7b admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:39:18.239512 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6795ed7-c0ab-4a7c-bc16-af037730dbd8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec5fd3a489c341b7964704d689037f05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:39:18.240449 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6795ed7-c0ab-4a7c-bc16-af037730dbd8 service cinder] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:39:18.240900 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6795ed7-c0ab-4a7c-bc16-af037730dbd8 service cinder] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:39:18.241323 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6795ed7-c0ab-4a7c-bc16-af037730dbd8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:39:18.264202 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6795ed7-c0ab-4a7c-bc16-af037730dbd8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:39:18.265887 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6795ed7-c0ab-4a7c-bc16-af037730dbd8 service cinder] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:39:18.279853 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3814/7594] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:39:18 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:39:20.083842 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa1c2f8-61e5-4d72-9c7b-cfd8dcc25b93 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:39:20.220923 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa1c2f8-61e5-4d72-9c7b-cfd8dcc25b93 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:39:20.235659 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61c437b-594a-48dd-a7e8-fbdd4fb92f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:39:20.236620 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61c437b-594a-48dd-a7e8-fbdd4fb92f16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:39:20.236903 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61c437b-594a-48dd-a7e8-fbdd4fb92f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:39:20.237176 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61c437b-594a-48dd-a7e8-fbdd4fb92f16 admin admin] PATH_INFO: `/v3/users/ba1952dad916474d8ae8778c02cb2fcb` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:39:20.238489 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61c437b-594a-48dd-a7e8-fbdd4fb92f16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba1952dad916474d8ae8778c02cb2fcb)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:39:20.240381 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61c437b-594a-48dd-a7e8-fbdd4fb92f16 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:39:20.370258 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-b61c437b-594a-48dd-a7e8-fbdd4fb92f16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba1952dad916474d8ae8778c02cb2fcb'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:39:20.395696 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-b61c437b-594a-48dd-a7e8-fbdd4fb92f16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba1952dad916474d8ae8778c02cb2fcb'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:39:20.396562 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-b61c437b-594a-48dd-a7e8-fbdd4fb92f16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba1952dad916474d8ae8778c02cb2fcb'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:39:20.414408 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-b61c437b-594a-48dd-a7e8-fbdd4fb92f16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba1952dad916474d8ae8778c02cb2fcb'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:39:20.439444 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-b61c437b-594a-48dd-a7e8-fbdd4fb92f16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba1952dad916474d8ae8778c02cb2fcb'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:39:20.446999 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3781/7595] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:39:20 2022] DELETE /identity/v3/users/ba1952dad916474d8ae8778c02cb2fcb => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:39:20.452024 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b45d588-4186-4735-85df-ae4e99158a61 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:39:20.452530 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b45d588-4186-4735-85df-ae4e99158a61 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:39:20.452637 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b45d588-4186-4735-85df-ae4e99158a61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:39:20.481464 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-9b45d588-4186-4735-85df-ae4e99158a61 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:39:20.482742 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-9b45d588-4186-4735-85df-ae4e99158a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:39:20.603004 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3815/7596] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:39:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:39:20.611485 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61c437b-594a-48dd-a7e8-fbdd4fb92f16 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:39:20.615850 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-b61c437b-594a-48dd-a7e8-fbdd4fb92f16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:39:20.625006 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:39:20.710555 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61c437b-594a-48dd-a7e8-fbdd4fb92f16 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:39:20.715863 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eafb232-dc91-4d8c-a9d7-023cbee4dc4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:39:20.716641 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eafb232-dc91-4d8c-a9d7-023cbee4dc4a service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:39:20.717424 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eafb232-dc91-4d8c-a9d7-023cbee4dc4a service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:39:20.717424 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eafb232-dc91-4d8c-a9d7-023cbee4dc4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:39:20.730063 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eafb232-dc91-4d8c-a9d7-023cbee4dc4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:39:20.731658 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eafb232-dc91-4d8c-a9d7-023cbee4dc4a service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:39:20.745037 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3782/7597] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:39:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:39:21.362263 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b45d588-4186-4735-85df-ae4e99158a61 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:39:21.364013 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-9b45d588-4186-4735-85df-ae4e99158a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:39:21.380003 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b45d588-4186-4735-85df-ae4e99158a61 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:39:21.385389 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264396fb-0f5e-4da6-8dce-0b1397693043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:39:21.386676 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264396fb-0f5e-4da6-8dce-0b1397693043 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:39:21.387151 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264396fb-0f5e-4da6-8dce-0b1397693043 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:39:21.387424 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264396fb-0f5e-4da6-8dce-0b1397693043 admin admin] PATH_INFO: `/v3/projects/eeed151f3d9744e9aa4055afd51d8645` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:39:21.388696 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264396fb-0f5e-4da6-8dce-0b1397693043 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eeed151f3d9744e9aa4055afd51d8645)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:39:21.403988 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264396fb-0f5e-4da6-8dce-0b1397693043 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:39:21.539033 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-264396fb-0f5e-4da6-8dce-0b1397693043 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eeed151f3d9744e9aa4055afd51d8645', 'request_id': 'req-264396fb-0f5e-4da6-8dce-0b1397693043'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:39:21.556312 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-264396fb-0f5e-4da6-8dce-0b1397693043 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eeed151f3d9744e9aa4055afd51d8645', 'request_id': 'req-264396fb-0f5e-4da6-8dce-0b1397693043'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:39:21.569018 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-264396fb-0f5e-4da6-8dce-0b1397693043 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eeed151f3d9744e9aa4055afd51d8645', 'request_id': 'req-264396fb-0f5e-4da6-8dce-0b1397693043'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:39:21.596248 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-264396fb-0f5e-4da6-8dce-0b1397693043 admin admin] The token cache is being invalidate because project eeed151f3d9744e9aa4055afd51d8645 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:39:21.596585 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-264396fb-0f5e-4da6-8dce-0b1397693043 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:39:21.597269 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-264396fb-0f5e-4da6-8dce-0b1397693043 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:39:21.603387 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3816/7598] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:39:21 2022] DELETE /identity/v3/projects/eeed151f3d9744e9aa4055afd51d8645 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:39:21.604522 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127cdbc2-60aa-4713-bfd1-e8fdb314368b None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:39:21.604982 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127cdbc2-60aa-4713-bfd1-e8fdb314368b None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:39:21.605070 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127cdbc2-60aa-4713-bfd1-e8fdb314368b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:39:21.642411 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-127cdbc2-60aa-4713-bfd1-e8fdb314368b None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:39:21.644142 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-127cdbc2-60aa-4713-bfd1-e8fdb314368b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:39:21.722282 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3783/7599] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:39:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:39:21.731423 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1365cd1-376b-4669-93c8-1b7961bfedec None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:39:21.731745 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1365cd1-376b-4669-93c8-1b7961bfedec None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:39:21.732158 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1365cd1-376b-4669-93c8-1b7961bfedec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:39:21.788437 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-f1365cd1-376b-4669-93c8-1b7961bfedec None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:39:21.789997 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-f1365cd1-376b-4669-93c8-1b7961bfedec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:39:21.801908 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3817/7600] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:39:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:39:21.806681 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127cdbc2-60aa-4713-bfd1-e8fdb314368b None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:39:21.851324 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127cdbc2-60aa-4713-bfd1-e8fdb314368b None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:39:21.856540 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b0d714-f0eb-4532-89b7-6c5e7ffc12df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:39:21.857137 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b0d714-f0eb-4532-89b7-6c5e7ffc12df admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:39:21.857411 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b0d714-f0eb-4532-89b7-6c5e7ffc12df admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:39:21.857681 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b0d714-f0eb-4532-89b7-6c5e7ffc12df admin admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:39:21.858839 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b0d714-f0eb-4532-89b7-6c5e7ffc12df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:39:21.858839 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b0d714-f0eb-4532-89b7-6c5e7ffc12df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:39:21.860366 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b0d714-f0eb-4532-89b7-6c5e7ffc12df admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:39:21.887828 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3784/7601] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:39:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:39:21.894223 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1365cd1-376b-4669-93c8-1b7961bfedec None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:39:21.907480 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1365cd1-376b-4669-93c8-1b7961bfedec None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:39:21.912850 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db29e0f5-060d-4942-903a-ed10ae57c7fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:39:21.913778 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db29e0f5-060d-4942-903a-ed10ae57c7fd admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:39:21.914090 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db29e0f5-060d-4942-903a-ed10ae57c7fd admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:39:21.914371 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db29e0f5-060d-4942-903a-ed10ae57c7fd admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:39:21.915068 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db29e0f5-060d-4942-903a-ed10ae57c7fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:39:21.917190 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db29e0f5-060d-4942-903a-ed10ae57c7fd admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:39:21.920836 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:39:21.953816 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3818/7602] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:39:21 2022] POST /identity/v3/projects => generated 373 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:39:21.955130 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b0d714-f0eb-4532-89b7-6c5e7ffc12df admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:39:21.966825 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b0d714-f0eb-4532-89b7-6c5e7ffc12df admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:39:22.042124 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04849260-2b25-4fdf-bb34-dd739153e3d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:39:22.043155 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04849260-2b25-4fdf-bb34-dd739153e3d4 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:39:22.043760 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04849260-2b25-4fdf-bb34-dd739153e3d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:39:22.044255 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04849260-2b25-4fdf-bb34-dd739153e3d4 admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:39:22.045202 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04849260-2b25-4fdf-bb34-dd739153e3d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:39:22.047690 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04849260-2b25-4fdf-bb34-dd739153e3d4 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:39:22.092416 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3785/7603] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:39:21 2022] POST /identity/v3/users => generated 287 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:39:22.094234 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db29e0f5-060d-4942-903a-ed10ae57c7fd admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:39:22.112755 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db29e0f5-060d-4942-903a-ed10ae57c7fd admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:39:22.127084 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6fa53d-b148-48d8-8176-b9f6dd0182d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:39:22.127852 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6fa53d-b148-48d8-8176-b9f6dd0182d5 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:39:22.128138 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6fa53d-b148-48d8-8176-b9f6dd0182d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:39:22.128404 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6fa53d-b148-48d8-8176-b9f6dd0182d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:39:22.129152 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6fa53d-b148-48d8-8176-b9f6dd0182d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:39:22.134679 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6fa53d-b148-48d8-8176-b9f6dd0182d5 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:39:22.159665 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3819/7604] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:39:22 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:39:22.161218 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04849260-2b25-4fdf-bb34-dd739153e3d4 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:39:22.179352 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04849260-2b25-4fdf-bb34-dd739153e3d4 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:39:22.190202 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a42a2d-008f-4381-af14-28b8e7ca8e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:39:22.191380 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a42a2d-008f-4381-af14-28b8e7ca8e36 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:39:22.191783 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a42a2d-008f-4381-af14-28b8e7ca8e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:39:22.192271 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a42a2d-008f-4381-af14-28b8e7ca8e36 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:39:22.193139 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a42a2d-008f-4381-af14-28b8e7ca8e36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:39:22.195682 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a42a2d-008f-4381-af14-28b8e7ca8e36 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:39:22.208010 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3786/7605] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:39:22 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 21:39:22.211988 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6fa53d-b148-48d8-8176-b9f6dd0182d5 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:39:22.227819 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6fa53d-b148-48d8-8176-b9f6dd0182d5 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:39:22.235187 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c967b1-2bbe-4652-9f8c-fbac5dc1bea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:39:22.236094 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c967b1-2bbe-4652-9f8c-fbac5dc1bea5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:39:22.236601 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c967b1-2bbe-4652-9f8c-fbac5dc1bea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:39:22.236881 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c967b1-2bbe-4652-9f8c-fbac5dc1bea5 admin admin] PATH_INFO: `/v3/projects/d9d9dea9242a4fec924348f888d15003/users/0199519e117a44918274ca5086a86cd8/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:39:22.262092 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c967b1-2bbe-4652-9f8c-fbac5dc1bea5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9d9dea9242a4fec924348f888d15003, user_id=0199519e117a44918274ca5086a86cd8, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:39:22.265929 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c967b1-2bbe-4652-9f8c-fbac5dc1bea5 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:39:22.290844 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3820/7606] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:39:22 2022] PUT /identity/v3/projects/d9d9dea9242a4fec924348f888d15003/users/0199519e117a44918274ca5086a86cd8/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:39:22.301630 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26493f7-cd74-4836-a90a-2fd0b51fa371 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:39:22.301937 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26493f7-cd74-4836-a90a-2fd0b51fa371 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:39:22.302219 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26493f7-cd74-4836-a90a-2fd0b51fa371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:39:22.339545 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:39:22.344461 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-f26493f7-cd74-4836-a90a-2fd0b51fa371 None None] MFA Rules not processed for user `0199519e117a44918274ca5086a86cd8`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:39:22.345905 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-f26493f7-cd74-4836-a90a-2fd0b51fa371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:39:22.431642 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3787/7607] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:39:22 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:39:22.441303 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c967b1-2bbe-4652-9f8c-fbac5dc1bea5 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:39:22.443221 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-a6c967b1-2bbe-4652-9f8c-fbac5dc1bea5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:39:22.516006 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c967b1-2bbe-4652-9f8c-fbac5dc1bea5 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:39:22.520066 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f96cd3b-7656-42f2-ad3c-0e2ab8112157 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec5fd3a489c341b7964704d689037f05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:39:22.520733 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f96cd3b-7656-42f2-ad3c-0e2ab8112157 service cinder] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:39:22.521010 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f96cd3b-7656-42f2-ad3c-0e2ab8112157 service cinder] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:39:22.521329 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f96cd3b-7656-42f2-ad3c-0e2ab8112157 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:39:22.531278 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f96cd3b-7656-42f2-ad3c-0e2ab8112157 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:39:22.532916 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f96cd3b-7656-42f2-ad3c-0e2ab8112157 service cinder] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:39:22.544705 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3821/7608] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:39:22 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:39:24.751218 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26493f7-cd74-4836-a90a-2fd0b51fa371 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:39:24.913508 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26493f7-cd74-4836-a90a-2fd0b51fa371 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:39:24.929224 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa18e9aa-0c4d-4a35-8c1b-900322234b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:39:24.930641 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa18e9aa-0c4d-4a35-8c1b-900322234b37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:39:24.931006 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa18e9aa-0c4d-4a35-8c1b-900322234b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:39:24.931447 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa18e9aa-0c4d-4a35-8c1b-900322234b37 admin admin] PATH_INFO: `/v3/users/0199519e117a44918274ca5086a86cd8` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:39:24.933105 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa18e9aa-0c4d-4a35-8c1b-900322234b37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0199519e117a44918274ca5086a86cd8)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:39:24.935740 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa18e9aa-0c4d-4a35-8c1b-900322234b37 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:39:25.033359 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-aa18e9aa-0c4d-4a35-8c1b-900322234b37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0199519e117a44918274ca5086a86cd8'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:39:25.045926 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-aa18e9aa-0c4d-4a35-8c1b-900322234b37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0199519e117a44918274ca5086a86cd8'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:39:25.047098 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-aa18e9aa-0c4d-4a35-8c1b-900322234b37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0199519e117a44918274ca5086a86cd8'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:39:25.070704 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-aa18e9aa-0c4d-4a35-8c1b-900322234b37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0199519e117a44918274ca5086a86cd8'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:39:25.092135 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-aa18e9aa-0c4d-4a35-8c1b-900322234b37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0199519e117a44918274ca5086a86cd8'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:39:25.107244 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3788/7609] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:39:24 2022] DELETE /identity/v3/users/0199519e117a44918274ca5086a86cd8 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:39:25.111666 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b107f6e7-b420-4664-a4af-e500f1d77222 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:39:25.112661 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b107f6e7-b420-4664-a4af-e500f1d77222 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:39:25.113155 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b107f6e7-b420-4664-a4af-e500f1d77222 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:39:25.152049 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-b107f6e7-b420-4664-a4af-e500f1d77222 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:39:25.155874 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-b107f6e7-b420-4664-a4af-e500f1d77222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:39:25.345769 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3822/7610] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:39:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:39:25.366703 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa18e9aa-0c4d-4a35-8c1b-900322234b37 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:39:25.368654 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-aa18e9aa-0c4d-4a35-8c1b-900322234b37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:39:25.414387 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:39:25.514821 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa18e9aa-0c4d-4a35-8c1b-900322234b37 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:39:25.527871 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6f7e6f-651e-46ba-8d1b-108234017dac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:39:25.528564 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6f7e6f-651e-46ba-8d1b-108234017dac service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:39:25.528858 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6f7e6f-651e-46ba-8d1b-108234017dac service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:39:25.529133 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6f7e6f-651e-46ba-8d1b-108234017dac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:39:25.562686 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6f7e6f-651e-46ba-8d1b-108234017dac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:39:25.564174 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6f7e6f-651e-46ba-8d1b-108234017dac service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:39:25.592699 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3789/7611] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:39:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:39:26.283819 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b107f6e7-b420-4664-a4af-e500f1d77222 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:39:26.285323 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-b107f6e7-b420-4664-a4af-e500f1d77222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:39:26.311010 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b107f6e7-b420-4664-a4af-e500f1d77222 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:39:26.320017 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c517c75b-a541-4246-8d46-25f485a9a2d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:39:26.322750 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c517c75b-a541-4246-8d46-25f485a9a2d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:39:26.326482 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c517c75b-a541-4246-8d46-25f485a9a2d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:39:26.326881 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c517c75b-a541-4246-8d46-25f485a9a2d9 admin admin] PATH_INFO: `/v3/projects/d9d9dea9242a4fec924348f888d15003` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:39:26.328412 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c517c75b-a541-4246-8d46-25f485a9a2d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9d9dea9242a4fec924348f888d15003)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:39:26.337737 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c517c75b-a541-4246-8d46-25f485a9a2d9 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:39:26.461668 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:39:26.463612 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c517c75b-a541-4246-8d46-25f485a9a2d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9d9dea9242a4fec924348f888d15003', 'request_id': 'req-c517c75b-a541-4246-8d46-25f485a9a2d9'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:39:26.476906 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c517c75b-a541-4246-8d46-25f485a9a2d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9d9dea9242a4fec924348f888d15003', 'request_id': 'req-c517c75b-a541-4246-8d46-25f485a9a2d9'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:39:26.485638 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c517c75b-a541-4246-8d46-25f485a9a2d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9d9dea9242a4fec924348f888d15003', 'request_id': 'req-c517c75b-a541-4246-8d46-25f485a9a2d9'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:39:26.504044 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c517c75b-a541-4246-8d46-25f485a9a2d9 admin admin] The token cache is being invalidate because project d9d9dea9242a4fec924348f888d15003 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:39:26.504373 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c517c75b-a541-4246-8d46-25f485a9a2d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:39:26.505196 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c517c75b-a541-4246-8d46-25f485a9a2d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:39:26.511813 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3823/7612] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:39:26 2022] DELETE /identity/v3/projects/d9d9dea9242a4fec924348f888d15003 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:39:26.525371 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c1ef22-8c86-46f0-b039-90bc3c7aec5d None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:39:26.526628 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c1ef22-8c86-46f0-b039-90bc3c7aec5d None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:39:26.527439 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c1ef22-8c86-46f0-b039-90bc3c7aec5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:39:26.557590 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-d8c1ef22-8c86-46f0-b039-90bc3c7aec5d None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:39:26.559536 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-d8c1ef22-8c86-46f0-b039-90bc3c7aec5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:39:26.709282 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3790/7613] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:39:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:39:26.719635 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f2c28f-64eb-4638-8328-973ca4b90a36 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:39:26.719922 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f2c28f-64eb-4638-8328-973ca4b90a36 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:39:26.720201 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f2c28f-64eb-4638-8328-973ca4b90a36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:39:26.758512 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-c5f2c28f-64eb-4638-8328-973ca4b90a36 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:39:26.759918 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-c5f2c28f-64eb-4638-8328-973ca4b90a36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:39:26.784951 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3824/7614] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:39:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:39:26.786338 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c1ef22-8c86-46f0-b039-90bc3c7aec5d None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:39:26.802702 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c1ef22-8c86-46f0-b039-90bc3c7aec5d None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:39:26.832034 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad1ff6a-57f0-4353-8009-fd6a4d442cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:39:26.841472 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad1ff6a-57f0-4353-8009-fd6a4d442cac admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:39:26.842516 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad1ff6a-57f0-4353-8009-fd6a4d442cac admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:39:26.843790 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad1ff6a-57f0-4353-8009-fd6a4d442cac admin admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:39:26.846910 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad1ff6a-57f0-4353-8009-fd6a4d442cac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:39:26.848420 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad1ff6a-57f0-4353-8009-fd6a4d442cac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:39:26.853101 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad1ff6a-57f0-4353-8009-fd6a4d442cac admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:39:26.880286 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3791/7615] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:39:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:39:26.882391 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f2c28f-64eb-4638-8328-973ca4b90a36 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:39:26.904346 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f2c28f-64eb-4638-8328-973ca4b90a36 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:39:26.924113 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de544851-bc2c-4481-924f-1e0d106442f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:39:26.925003 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de544851-bc2c-4481-924f-1e0d106442f0 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:39:26.925436 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de544851-bc2c-4481-924f-1e0d106442f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:39:26.925905 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de544851-bc2c-4481-924f-1e0d106442f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:39:26.926810 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de544851-bc2c-4481-924f-1e0d106442f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:39:26.928915 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de544851-bc2c-4481-924f-1e0d106442f0 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:39:27.010012 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3825/7616] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:39:26 2022] POST /identity/v3/projects => generated 365 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:39:27.014893 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad1ff6a-57f0-4353-8009-fd6a4d442cac admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:39:27.032209 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad1ff6a-57f0-4353-8009-fd6a4d442cac admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:39:27.187037 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdba157f-807e-4dce-a505-a46cbb4468c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:39:27.187872 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdba157f-807e-4dce-a505-a46cbb4468c5 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:39:27.188262 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdba157f-807e-4dce-a505-a46cbb4468c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:39:27.188691 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdba157f-807e-4dce-a505-a46cbb4468c5 admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:39:27.189768 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdba157f-807e-4dce-a505-a46cbb4468c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:39:27.195308 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdba157f-807e-4dce-a505-a46cbb4468c5 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:39:27.258452 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3792/7617] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:39:27 2022] POST /identity/v3/users => generated 283 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:39:27.262575 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de544851-bc2c-4481-924f-1e0d106442f0 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:39:27.280407 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de544851-bc2c-4481-924f-1e0d106442f0 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:39:27.300460 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd47108-d533-4a20-b2e4-373084d27e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:39:27.301163 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd47108-d533-4a20-b2e4-373084d27e7d admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:39:27.301455 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd47108-d533-4a20-b2e4-373084d27e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:39:27.301780 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd47108-d533-4a20-b2e4-373084d27e7d admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:39:27.302802 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd47108-d533-4a20-b2e4-373084d27e7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:39:27.312719 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd47108-d533-4a20-b2e4-373084d27e7d admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:39:27.351052 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3826/7618] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:39:27 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:39:27.355309 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdba157f-807e-4dce-a505-a46cbb4468c5 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:39:27.370694 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdba157f-807e-4dce-a505-a46cbb4468c5 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:39:27.385573 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba2e0c3-acc1-4756-bffe-95d64fc9464c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:39:27.386351 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba2e0c3-acc1-4756-bffe-95d64fc9464c admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:39:27.386635 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba2e0c3-acc1-4756-bffe-95d64fc9464c admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:39:27.389835 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba2e0c3-acc1-4756-bffe-95d64fc9464c admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:39:27.389835 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba2e0c3-acc1-4756-bffe-95d64fc9464c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:39:27.389835 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba2e0c3-acc1-4756-bffe-95d64fc9464c admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:39:27.412847 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3793/7619] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:39:27 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:39:27.417141 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd47108-d533-4a20-b2e4-373084d27e7d admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:39:27.431666 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd47108-d533-4a20-b2e4-373084d27e7d admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:39:27.464089 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2166de0a-8526-4f38-9cb9-6fe9de3f8bb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:39:27.465029 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2166de0a-8526-4f38-9cb9-6fe9de3f8bb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:39:27.465317 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2166de0a-8526-4f38-9cb9-6fe9de3f8bb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:39:27.465594 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2166de0a-8526-4f38-9cb9-6fe9de3f8bb7 admin admin] PATH_INFO: `/v3/projects/273e3e34781b40e8a69981b383ff41a7/users/8ff275c0a0e5456b8d4c95faff9c90e4/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:39:27.513812 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2166de0a-8526-4f38-9cb9-6fe9de3f8bb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=273e3e34781b40e8a69981b383ff41a7, user_id=8ff275c0a0e5456b8d4c95faff9c90e4, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:39:27.516564 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2166de0a-8526-4f38-9cb9-6fe9de3f8bb7 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:39:27.552042 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3827/7620] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:39:27 2022] PUT /identity/v3/projects/273e3e34781b40e8a69981b383ff41a7/users/8ff275c0a0e5456b8d4c95faff9c90e4/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:39:27.558595 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430b3c35-cbc4-4795-86ad-a9906b271ab1 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:39:27.559049 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430b3c35-cbc4-4795-86ad-a9906b271ab1 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:39:27.559148 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430b3c35-cbc4-4795-86ad-a9906b271ab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:39:27.616336 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-430b3c35-cbc4-4795-86ad-a9906b271ab1 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:39:27.627453 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-430b3c35-cbc4-4795-86ad-a9906b271ab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:39:27.708314 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:39:27.789385 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3794/7621] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:39:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:39:27.834434 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2166de0a-8526-4f38-9cb9-6fe9de3f8bb7 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:39:27.836329 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-2166de0a-8526-4f38-9cb9-6fe9de3f8bb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:39:27.978593 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2166de0a-8526-4f38-9cb9-6fe9de3f8bb7 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:39:27.986734 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbde105-af57-4442-a3ca-06950686a35f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:39:27.989111 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbde105-af57-4442-a3ca-06950686a35f service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:39:27.989406 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbde105-af57-4442-a3ca-06950686a35f service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:39:27.990452 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbde105-af57-4442-a3ca-06950686a35f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:39:28.007453 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbde105-af57-4442-a3ca-06950686a35f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:39:28.008943 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbde105-af57-4442-a3ca-06950686a35f service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:39:28.034193 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3828/7622] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:39:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:39:29.016336 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430b3c35-cbc4-4795-86ad-a9906b271ab1 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:39:29.019882 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-430b3c35-cbc4-4795-86ad-a9906b271ab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:39:29.207385 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430b3c35-cbc4-4795-86ad-a9906b271ab1 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:39:29.235616 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7009106f-f75f-40f6-875a-0078a169f3c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:39:29.238862 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7009106f-f75f-40f6-875a-0078a169f3c8 service nova] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:39:29.239845 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7009106f-f75f-40f6-875a-0078a169f3c8 service nova] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:39:29.241709 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7009106f-f75f-40f6-875a-0078a169f3c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:39:29.245797 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-7009106f-f75f-40f6-875a-0078a169f3c8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:39:29.268888 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7009106f-f75f-40f6-875a-0078a169f3c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:39:29.272085 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7009106f-f75f-40f6-875a-0078a169f3c8 service nova] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:39:29.298564 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3795/7623] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:39:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:39:33.086986 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbde105-af57-4442-a3ca-06950686a35f service neutron] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:39:33.090894 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-0cbde105-af57-4442-a3ca-06950686a35f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:39:33.130009 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbde105-af57-4442-a3ca-06950686a35f service neutron] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:39:33.139577 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260b16f4-e942-44da-a331-d7b10c6367e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:39:33.143192 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260b16f4-e942-44da-a331-d7b10c6367e2 service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:39:33.143678 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260b16f4-e942-44da-a331-d7b10c6367e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:39:33.144864 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260b16f4-e942-44da-a331-d7b10c6367e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:39:33.149654 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-260b16f4-e942-44da-a331-d7b10c6367e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:39:33.186198 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260b16f4-e942-44da-a331-d7b10c6367e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:39:33.193297 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260b16f4-e942-44da-a331-d7b10c6367e2 service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:39:33.225974 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3829/7624] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:39:33 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:39:38.878714 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb482b12-6fe0-4d31-8938-01fe86666700 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:39:38.879187 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb482b12-6fe0-4d31-8938-01fe86666700 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:39:38.879629 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb482b12-6fe0-4d31-8938-01fe86666700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:39:38.945535 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-cb482b12-6fe0-4d31-8938-01fe86666700 None None] MFA Rules not processed for user `8ff275c0a0e5456b8d4c95faff9c90e4`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:39:38.947799 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-cb482b12-6fe0-4d31-8938-01fe86666700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:39:39.080416 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3796/7625] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:39:38 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:39:39.085482 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260b16f4-e942-44da-a331-d7b10c6367e2 service neutron] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:39:39.104033 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260b16f4-e942-44da-a331-d7b10c6367e2 service neutron] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:39:39.109074 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0050ddb-66fd-40dd-ae83-efad69880863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:39:39.110989 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0050ddb-66fd-40dd-ae83-efad69880863 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:39:39.111278 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0050ddb-66fd-40dd-ae83-efad69880863 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:39:39.111561 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0050ddb-66fd-40dd-ae83-efad69880863 admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:39:39.112301 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0050ddb-66fd-40dd-ae83-efad69880863 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:39:39.121111 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0050ddb-66fd-40dd-ae83-efad69880863 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:39:39.155332 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3830/7626] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:39:39 2022] POST /identity/v3/users => generated 288 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:39:39.159411 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb482b12-6fe0-4d31-8938-01fe86666700 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:39:39.174147 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb482b12-6fe0-4d31-8938-01fe86666700 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:39:39.181340 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19524579-7d9a-490b-946b-6e87e53f14fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:39:39.182341 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19524579-7d9a-490b-946b-6e87e53f14fa admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:39:39.182894 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19524579-7d9a-490b-946b-6e87e53f14fa admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:39:39.183347 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19524579-7d9a-490b-946b-6e87e53f14fa admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:39:39.184241 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19524579-7d9a-490b-946b-6e87e53f14fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:39:39.186651 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19524579-7d9a-490b-946b-6e87e53f14fa admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:39:39.207647 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3797/7627] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:39:39 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:39:39.211873 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0050ddb-66fd-40dd-ae83-efad69880863 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:39:39.230095 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0050ddb-66fd-40dd-ae83-efad69880863 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:39:39.237222 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd04aa6c-fa9e-41ee-b1bb-f9bad43e4999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:39:39.238588 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd04aa6c-fa9e-41ee-b1bb-f9bad43e4999 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:39:39.239057 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd04aa6c-fa9e-41ee-b1bb-f9bad43e4999 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:39:39.239698 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd04aa6c-fa9e-41ee-b1bb-f9bad43e4999 admin admin] PATH_INFO: `/v3/system/users/803be81d715e456bac40d0ae11209ace/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:39:39.259007 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd04aa6c-fa9e-41ee-b1bb-f9bad43e4999 admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=803be81d715e456bac40d0ae11209ace, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:39:39.261596 ncdv-master-1 devstack@keystone.service[91548]: WARNING py.warnings [None req-fd04aa6c-fa9e-41ee-b1bb-f9bad43e4999 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:39:39.261596 ncdv-master-1 devstack@keystone.service[91548]: warnings.warn(msg) Jul 23 21:39:39.261596 ncdv-master-1 devstack@keystone.service[91548]: Jul 23 21:39:39.263082 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd04aa6c-fa9e-41ee-b1bb-f9bad43e4999 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:39:39.276771 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3831/7628] 10.222.0.17 () {60 vars in 1377 bytes} [Sat Jul 23 21:39:39 2022] PUT /identity/v3/system/users/803be81d715e456bac40d0ae11209ace/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:39:39.287840 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0ed4c3-9442-439e-9184-b1ef013fdc6c None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:39:39.288747 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0ed4c3-9442-439e-9184-b1ef013fdc6c None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:39:39.289261 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0ed4c3-9442-439e-9184-b1ef013fdc6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:39:39.349992 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-fd0ed4c3-9442-439e-9184-b1ef013fdc6c None None] MFA Rules not processed for user `803be81d715e456bac40d0ae11209ace`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:39:39.353203 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-fd0ed4c3-9442-439e-9184-b1ef013fdc6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:39:39.404902 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:39:39.528705 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd04aa6c-fa9e-41ee-b1bb-f9bad43e4999 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:39:39.533311 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3798/7629] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:39:39 2022] POST /identity/v3/auth/tokens => generated 2405 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 23 21:39:39.563488 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=90,keystone:INSERT=7,keystone:DELETE=3 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:39:39.695965 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd04aa6c-fa9e-41ee-b1bb-f9bad43e4999 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:39:39.781300 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69d2c38-e6af-441a-b532-60e63642b618 None tempest-ImageQuotaTest-1043018635-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '803be81d715e456bac40d0ae11209ace', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:39:39.782115 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69d2c38-e6af-441a-b532-60e63642b618 None tempest-ImageQuotaTest-1043018635-system-admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:39:39.782992 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69d2c38-e6af-441a-b532-60e63642b618 None tempest-ImageQuotaTest-1043018635-system-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:39:39.783333 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69d2c38-e6af-441a-b532-60e63642b618 None tempest-ImageQuotaTest-1043018635-system-admin] PATH_INFO: `/v3/services` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:39:39.784036 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69d2c38-e6af-441a-b532-60e63642b618 None tempest-ImageQuotaTest-1043018635-system-admin] RBAC: Authorizing `identity:list_services()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:39:39.785916 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69d2c38-e6af-441a-b532-60e63642b618 None tempest-ImageQuotaTest-1043018635-system-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:39:39.802847 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3832/7630] 10.222.0.17 () {58 vars in 1109 bytes} [Sat Jul 23 21:39:39 2022] GET /identity/v3/services => generated 2191 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:39:39.804301 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0ed4c3-9442-439e-9184-b1ef013fdc6c None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:39:39.920985 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0ed4c3-9442-439e-9184-b1ef013fdc6c None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:39:39.961381 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0380335-727a-466a-8b02-8cc38485af04 None tempest-ImageQuotaTest-1043018635-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '803be81d715e456bac40d0ae11209ace', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:39:39.962978 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0380335-727a-466a-8b02-8cc38485af04 None tempest-ImageQuotaTest-1043018635-system-admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:39:39.963760 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0380335-727a-466a-8b02-8cc38485af04 None tempest-ImageQuotaTest-1043018635-system-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:39:39.964246 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0380335-727a-466a-8b02-8cc38485af04 None tempest-ImageQuotaTest-1043018635-system-admin] PATH_INFO: `/v3/limits` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:39:39.965324 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0380335-727a-466a-8b02-8cc38485af04 None tempest-ImageQuotaTest-1043018635-system-admin] RBAC: Authorizing `identity:create_limits()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:39:39.967138 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0380335-727a-466a-8b02-8cc38485af04 None tempest-ImageQuotaTest-1043018635-system-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:39:40.016731 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-e0380335-727a-466a-8b02-8cc38485af04 None tempest-ImageQuotaTest-1043018635-system-admin] Unable to create a limit that has no corresponding registered limit.: keystone.exception.NoLimitReference: Unable to create a limit that has no corresponding registered limit. Jul 23 21:39:40.016731 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 21:39:40.016731 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 21:39:40.016731 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 21:39:40.016731 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 21:39:40.016731 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 21:39:40.016731 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 21:39:40.016731 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 21:39:40.016731 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 21:39:40.016731 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 21:39:40.016731 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 21:39:40.016731 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 21:39:40.016731 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/limits.py", line 110, in post Jul 23 21:39:40.016731 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application refs = PROVIDERS.unified_limit_api.create_limits(limits) Jul 23 21:39:40.017715 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 21:39:40.017715 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 21:39:40.017715 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/limit/core.py", line 116, in create_limits Jul 23 21:39:40.017715 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.driver.create_limits(limits) Jul 23 21:39:40.017715 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 23 21:39:40.017715 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 23 21:39:40.017715 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/limit/backends/sql.py", line 260, in create_limits Jul 23 21:39:40.017715 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application target = self._check_and_fill_registered_limit_id(limit) Jul 23 21:39:40.017715 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/limit/backends/sql.py", line 249, in _check_and_fill_registered_limit_id Jul 23 21:39:40.017715 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.NoLimitReference Jul 23 21:39:40.017715 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.NoLimitReference: Unable to create a limit that has no corresponding registered limit. Jul 23 21:39:40.017715 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 21:39:40.022683 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3799/7631] 10.222.0.17 () {60 vars in 1125 bytes} [Sat Jul 23 21:39:39 2022] POST /identity/v3/limits => generated 124 bytes in 215 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Jul 23 21:39:40.024455 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69d2c38-e6af-441a-b532-60e63642b618 None tempest-ImageQuotaTest-1043018635-system-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:39:40.151349 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:39:40.173381 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69d2c38-e6af-441a-b532-60e63642b618 None tempest-ImageQuotaTest-1043018635-system-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:39:40.215303 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d409b749-b262-4c81-ac00-b743df18fbcf None tempest-ImageQuotaTest-1043018635-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '803be81d715e456bac40d0ae11209ace', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:39:40.216402 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d409b749-b262-4c81-ac00-b743df18fbcf None tempest-ImageQuotaTest-1043018635-system-admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:39:40.216909 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d409b749-b262-4c81-ac00-b743df18fbcf None tempest-ImageQuotaTest-1043018635-system-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:39:40.217439 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d409b749-b262-4c81-ac00-b743df18fbcf None tempest-ImageQuotaTest-1043018635-system-admin] PATH_INFO: `/v3/registered_limits` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:39:40.218847 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d409b749-b262-4c81-ac00-b743df18fbcf None tempest-ImageQuotaTest-1043018635-system-admin] RBAC: Authorizing `identity:list_registered_limits()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:39:40.220213 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d409b749-b262-4c81-ac00-b743df18fbcf None tempest-ImageQuotaTest-1043018635-system-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:39:40.251582 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0380335-727a-466a-8b02-8cc38485af04 None tempest-ImageQuotaTest-1043018635-system-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:39:40.251961 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3833/7632] 10.222.0.17 () {58 vars in 1136 bytes} [Sat Jul 23 21:39:40 2022] GET /identity/v3/registered_limits => generated 129 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:39:40.269982 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:39:40.497133 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0380335-727a-466a-8b02-8cc38485af04 None tempest-ImageQuotaTest-1043018635-system-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:39:40.553510 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c29eaca-dc29-43a7-8ac7-397537de93d0 None tempest-ImageQuotaTest-1043018635-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '803be81d715e456bac40d0ae11209ace', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:39:40.554628 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c29eaca-dc29-43a7-8ac7-397537de93d0 None tempest-ImageQuotaTest-1043018635-system-admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:39:40.555177 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c29eaca-dc29-43a7-8ac7-397537de93d0 None tempest-ImageQuotaTest-1043018635-system-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:39:40.555809 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c29eaca-dc29-43a7-8ac7-397537de93d0 None tempest-ImageQuotaTest-1043018635-system-admin] PATH_INFO: `/v3/registered_limits` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:39:40.556813 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c29eaca-dc29-43a7-8ac7-397537de93d0 None tempest-ImageQuotaTest-1043018635-system-admin] RBAC: Authorizing `identity:list_registered_limits()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:39:40.558156 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c29eaca-dc29-43a7-8ac7-397537de93d0 None tempest-ImageQuotaTest-1043018635-system-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:39:40.583517 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3800/7633] 10.222.0.17 () {58 vars in 1136 bytes} [Sat Jul 23 21:39:40 2022] GET /identity/v3/registered_limits => generated 129 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 21:39:48.260933 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d409b749-b262-4c81-ac00-b743df18fbcf None tempest-ImageQuotaTest-1043018635-system-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:39:48.284439 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d409b749-b262-4c81-ac00-b743df18fbcf None tempest-ImageQuotaTest-1043018635-system-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:39:48.294875 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3c2bb3-1c03-4719-955b-51ed1e30f139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:39:48.296256 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3c2bb3-1c03-4719-955b-51ed1e30f139 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:39:48.296740 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3c2bb3-1c03-4719-955b-51ed1e30f139 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:39:48.297774 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3c2bb3-1c03-4719-955b-51ed1e30f139 admin admin] PATH_INFO: `/v3/users/8ff275c0a0e5456b8d4c95faff9c90e4` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:39:48.299976 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3c2bb3-1c03-4719-955b-51ed1e30f139 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ff275c0a0e5456b8d4c95faff9c90e4)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:39:48.302482 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3c2bb3-1c03-4719-955b-51ed1e30f139 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:39:48.459976 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-1f3c2bb3-1c03-4719-955b-51ed1e30f139 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ff275c0a0e5456b8d4c95faff9c90e4'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:39:48.460889 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-1f3c2bb3-1c03-4719-955b-51ed1e30f139 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ff275c0a0e5456b8d4c95faff9c90e4'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:39:48.481485 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-1f3c2bb3-1c03-4719-955b-51ed1e30f139 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ff275c0a0e5456b8d4c95faff9c90e4'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:39:48.507853 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-1f3c2bb3-1c03-4719-955b-51ed1e30f139 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ff275c0a0e5456b8d4c95faff9c90e4'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:39:48.544200 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-1f3c2bb3-1c03-4719-955b-51ed1e30f139 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ff275c0a0e5456b8d4c95faff9c90e4'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:39:48.561530 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3834/7634] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:39:48 2022] DELETE /identity/v3/users/8ff275c0a0e5456b8d4c95faff9c90e4 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:39:49.121212 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c29eaca-dc29-43a7-8ac7-397537de93d0 None tempest-ImageQuotaTest-1043018635-system-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:39:49.124413 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-9c29eaca-dc29-43a7-8ac7-397537de93d0 None tempest-ImageQuotaTest-1043018635-system-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:39:49.327378 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c29eaca-dc29-43a7-8ac7-397537de93d0 None tempest-ImageQuotaTest-1043018635-system-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:39:49.334127 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bed6fd6-bb47-477b-a963-c49fb213f139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:39:49.334590 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bed6fd6-bb47-477b-a963-c49fb213f139 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:39:49.335067 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bed6fd6-bb47-477b-a963-c49fb213f139 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:39:49.335177 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bed6fd6-bb47-477b-a963-c49fb213f139 admin admin] PATH_INFO: `/v3/projects/273e3e34781b40e8a69981b383ff41a7` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:39:49.336767 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bed6fd6-bb47-477b-a963-c49fb213f139 admin admin] RBAC: Authorizing `identity:delete_project(project_id=273e3e34781b40e8a69981b383ff41a7)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:39:49.339953 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bed6fd6-bb47-477b-a963-c49fb213f139 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:39:49.371600 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:39:49.407355 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-8bed6fd6-bb47-477b-a963-c49fb213f139 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '273e3e34781b40e8a69981b383ff41a7', 'request_id': 'req-8bed6fd6-bb47-477b-a963-c49fb213f139'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:39:49.420718 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-8bed6fd6-bb47-477b-a963-c49fb213f139 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '273e3e34781b40e8a69981b383ff41a7', 'request_id': 'req-8bed6fd6-bb47-477b-a963-c49fb213f139'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:39:49.430374 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-8bed6fd6-bb47-477b-a963-c49fb213f139 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '273e3e34781b40e8a69981b383ff41a7', 'request_id': 'req-8bed6fd6-bb47-477b-a963-c49fb213f139'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:39:49.446194 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-8bed6fd6-bb47-477b-a963-c49fb213f139 admin admin] The token cache is being invalidate because project 273e3e34781b40e8a69981b383ff41a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:39:49.446479 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-8bed6fd6-bb47-477b-a963-c49fb213f139 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:39:49.447361 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-8bed6fd6-bb47-477b-a963-c49fb213f139 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:39:49.450337 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3801/7635] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:39:49 2022] DELETE /identity/v3/projects/273e3e34781b40e8a69981b383ff41a7 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:39:49.454131 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3c2bb3-1c03-4719-955b-51ed1e30f139 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:39:49.471832 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3c2bb3-1c03-4719-955b-51ed1e30f139 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:39:49.543545 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d190aa2-c775-4632-a11d-88dd9dd6a6a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:39:49.545905 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d190aa2-c775-4632-a11d-88dd9dd6a6a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:39:49.546458 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d190aa2-c775-4632-a11d-88dd9dd6a6a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:39:49.548507 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d190aa2-c775-4632-a11d-88dd9dd6a6a7 admin admin] PATH_INFO: `/v3/users/803be81d715e456bac40d0ae11209ace` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:39:49.550069 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d190aa2-c775-4632-a11d-88dd9dd6a6a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=803be81d715e456bac40d0ae11209ace)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:39:49.552243 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d190aa2-c775-4632-a11d-88dd9dd6a6a7 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:39:49.596869 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:39:49.664477 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-0d190aa2-c775-4632-a11d-88dd9dd6a6a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '803be81d715e456bac40d0ae11209ace'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:39:49.665627 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-0d190aa2-c775-4632-a11d-88dd9dd6a6a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '803be81d715e456bac40d0ae11209ace'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:39:49.677529 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-0d190aa2-c775-4632-a11d-88dd9dd6a6a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '803be81d715e456bac40d0ae11209ace'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:39:49.693754 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-0d190aa2-c775-4632-a11d-88dd9dd6a6a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '803be81d715e456bac40d0ae11209ace'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:39:49.732798 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-0d190aa2-c775-4632-a11d-88dd9dd6a6a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '803be81d715e456bac40d0ae11209ace'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:39:49.740246 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3835/7636] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:39:49 2022] DELETE /identity/v3/users/803be81d715e456bac40d0ae11209ace => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:39:50.051468 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bed6fd6-bb47-477b-a963-c49fb213f139 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:39:50.052554 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-8bed6fd6-bb47-477b-a963-c49fb213f139 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:39:50.079296 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bed6fd6-bb47-477b-a963-c49fb213f139 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:39:50.202813 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ead6d04-00c9-4064-a804-3c399a385d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:39:50.204123 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ead6d04-00c9-4064-a804-3c399a385d98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:39:50.204703 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ead6d04-00c9-4064-a804-3c399a385d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:39:50.210120 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ead6d04-00c9-4064-a804-3c399a385d98 admin admin] PATH_INFO: `/v3/projects/None` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:39:50.227945 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ead6d04-00c9-4064-a804-3c399a385d98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=None)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:39:50.230157 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ead6d04-00c9-4064-a804-3c399a385d98 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:39:50.249993 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application [None req-3ead6d04-00c9-4064-a804-3c399a385d98 admin admin] Could not find project: None.: keystone.exception.ProjectNotFound: Could not find project: None. Jul 23 21:39:50.249993 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 21:39:50.249993 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 21:39:50.249993 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 21:39:50.249993 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 21:39:50.249993 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 21:39:50.249993 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 21:39:50.249993 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 21:39:50.249993 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 21:39:50.249993 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 21:39:50.249993 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 21:39:50.249993 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 21:39:50.249993 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 211, in delete Jul 23 21:39:50.249993 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_project( Jul 23 21:39:50.249993 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 21:39:50.249993 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 21:39:50.251108 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 478, in delete_project Jul 23 21:39:50.251108 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application project = self.driver.get_project(project_id) Jul 23 21:39:50.251108 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 23 21:39:50.251108 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 23 21:39:50.251108 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 23 21:39:50.251108 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 23 21:39:50.251108 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: None. Jul 23 21:39:50.251108 ncdv-master-1 devstack@keystone.service[91547]: ERROR keystone.server.flask.application Jul 23 21:39:50.264495 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3802/7637] 10.222.0.17 () {58 vars in 1148 bytes} [Sat Jul 23 21:39:50 2022] DELETE /identity/v3/projects/None => generated 85 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 23 21:39:50.986347 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d190aa2-c775-4632-a11d-88dd9dd6a6a7 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:39:50.990566 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-0d190aa2-c775-4632-a11d-88dd9dd6a6a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:39:51.012768 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d190aa2-c775-4632-a11d-88dd9dd6a6a7 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:39:51.026277 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cb9be4-d839-43e1-8af0-540219ae0c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:39:51.027552 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cb9be4-d839-43e1-8af0-540219ae0c3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:39:51.027977 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cb9be4-d839-43e1-8af0-540219ae0c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:39:51.028391 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cb9be4-d839-43e1-8af0-540219ae0c3c admin admin] PATH_INFO: `/v3/users/cb4d9b73581a467da24255792e2ddb20` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:39:51.030643 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cb9be4-d839-43e1-8af0-540219ae0c3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb4d9b73581a467da24255792e2ddb20)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:39:51.035706 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cb9be4-d839-43e1-8af0-540219ae0c3c admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:39:51.141103 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-e5cb9be4-d839-43e1-8af0-540219ae0c3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb4d9b73581a467da24255792e2ddb20'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:39:51.146119 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-e5cb9be4-d839-43e1-8af0-540219ae0c3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb4d9b73581a467da24255792e2ddb20'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:39:51.158383 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-e5cb9be4-d839-43e1-8af0-540219ae0c3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb4d9b73581a467da24255792e2ddb20'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:39:51.168744 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-e5cb9be4-d839-43e1-8af0-540219ae0c3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb4d9b73581a467da24255792e2ddb20'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:39:51.184049 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-e5cb9be4-d839-43e1-8af0-540219ae0c3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb4d9b73581a467da24255792e2ddb20'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:39:51.190801 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3836/7638] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:39:50 2022] DELETE /identity/v3/users/cb4d9b73581a467da24255792e2ddb20 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:39:51.451124 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ead6d04-00c9-4064-a804-3c399a385d98 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:39:51.466405 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-3ead6d04-00c9-4064-a804-3c399a385d98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:39:51.507277 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ead6d04-00c9-4064-a804-3c399a385d98 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:39:51.622089 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a084638b-2bf0-4851-86d2-f06b3bda2e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:39:51.624584 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a084638b-2bf0-4851-86d2-f06b3bda2e75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:39:51.625117 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a084638b-2bf0-4851-86d2-f06b3bda2e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:39:51.625614 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a084638b-2bf0-4851-86d2-f06b3bda2e75 admin admin] PATH_INFO: `/v3/projects/75e97a96ba304a259cb89d131a1772a0` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:39:51.627151 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a084638b-2bf0-4851-86d2-f06b3bda2e75 admin admin] RBAC: Authorizing `identity:delete_project(project_id=75e97a96ba304a259cb89d131a1772a0)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:39:51.631672 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a084638b-2bf0-4851-86d2-f06b3bda2e75 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:39:51.691571 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:39:51.692696 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-a084638b-2bf0-4851-86d2-f06b3bda2e75 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75e97a96ba304a259cb89d131a1772a0', 'request_id': 'req-a084638b-2bf0-4851-86d2-f06b3bda2e75'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:39:51.704055 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-a084638b-2bf0-4851-86d2-f06b3bda2e75 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75e97a96ba304a259cb89d131a1772a0', 'request_id': 'req-a084638b-2bf0-4851-86d2-f06b3bda2e75'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:39:51.721622 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-a084638b-2bf0-4851-86d2-f06b3bda2e75 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75e97a96ba304a259cb89d131a1772a0', 'request_id': 'req-a084638b-2bf0-4851-86d2-f06b3bda2e75'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:39:51.738429 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-a084638b-2bf0-4851-86d2-f06b3bda2e75 admin admin] The token cache is being invalidate because project 75e97a96ba304a259cb89d131a1772a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:39:51.738723 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-a084638b-2bf0-4851-86d2-f06b3bda2e75 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:39:51.739378 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-a084638b-2bf0-4851-86d2-f06b3bda2e75 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:39:51.741275 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3803/7639] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:39:51 2022] DELETE /identity/v3/projects/75e97a96ba304a259cb89d131a1772a0 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:39:51.745233 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cb9be4-d839-43e1-8af0-540219ae0c3c admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:39:51.756358 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cb9be4-d839-43e1-8af0-540219ae0c3c admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:39:51.842211 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:DELETE=19,keystone:SELECT=79,keystone:INSERT=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:39:51.850882 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e40d716-2341-4f5b-a9b0-5e0424bfff0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:39:51.851983 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e40d716-2341-4f5b-a9b0-5e0424bfff0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:39:51.852358 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e40d716-2341-4f5b-a9b0-5e0424bfff0f admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:39:51.852818 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e40d716-2341-4f5b-a9b0-5e0424bfff0f admin admin] PATH_INFO: `/v3/users/698e4fa363ce4d94970c3aaffb47cef0` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:39:51.854434 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e40d716-2341-4f5b-a9b0-5e0424bfff0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=698e4fa363ce4d94970c3aaffb47cef0)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:39:51.856899 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e40d716-2341-4f5b-a9b0-5e0424bfff0f admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:39:51.918385 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-2e40d716-2341-4f5b-a9b0-5e0424bfff0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '698e4fa363ce4d94970c3aaffb47cef0'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:39:51.919332 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-2e40d716-2341-4f5b-a9b0-5e0424bfff0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '698e4fa363ce4d94970c3aaffb47cef0'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:39:51.929416 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-2e40d716-2341-4f5b-a9b0-5e0424bfff0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '698e4fa363ce4d94970c3aaffb47cef0'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:39:51.941848 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-2e40d716-2341-4f5b-a9b0-5e0424bfff0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '698e4fa363ce4d94970c3aaffb47cef0'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:39:51.956611 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-2e40d716-2341-4f5b-a9b0-5e0424bfff0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '698e4fa363ce4d94970c3aaffb47cef0'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:39:51.972830 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3837/7640] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:39:51 2022] DELETE /identity/v3/users/698e4fa363ce4d94970c3aaffb47cef0 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:39:52.346895 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a084638b-2bf0-4851-86d2-f06b3bda2e75 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:39:52.348845 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-a084638b-2bf0-4851-86d2-f06b3bda2e75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:39:52.362907 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a084638b-2bf0-4851-86d2-f06b3bda2e75 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:39:52.436619 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33579506-eb03-4506-87a3-bfa775ba7ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:39:52.437697 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33579506-eb03-4506-87a3-bfa775ba7ede admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:39:52.438004 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33579506-eb03-4506-87a3-bfa775ba7ede admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:39:52.438264 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33579506-eb03-4506-87a3-bfa775ba7ede admin admin] PATH_INFO: `/v3/projects/0c601305524f4bdb84548c52cfb8f05c` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:39:52.439627 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33579506-eb03-4506-87a3-bfa775ba7ede admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c601305524f4bdb84548c52cfb8f05c)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:39:52.442412 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33579506-eb03-4506-87a3-bfa775ba7ede admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:39:52.510006 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-33579506-eb03-4506-87a3-bfa775ba7ede admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c601305524f4bdb84548c52cfb8f05c', 'request_id': 'req-33579506-eb03-4506-87a3-bfa775ba7ede'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:39:52.523173 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-33579506-eb03-4506-87a3-bfa775ba7ede admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c601305524f4bdb84548c52cfb8f05c', 'request_id': 'req-33579506-eb03-4506-87a3-bfa775ba7ede'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:39:52.540128 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-33579506-eb03-4506-87a3-bfa775ba7ede admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c601305524f4bdb84548c52cfb8f05c', 'request_id': 'req-33579506-eb03-4506-87a3-bfa775ba7ede'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:39:52.555341 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-33579506-eb03-4506-87a3-bfa775ba7ede admin admin] The token cache is being invalidate because project 0c601305524f4bdb84548c52cfb8f05c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:39:52.555628 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-33579506-eb03-4506-87a3-bfa775ba7ede admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:39:52.556306 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-33579506-eb03-4506-87a3-bfa775ba7ede admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:39:52.558390 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3804/7641] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:39:52 2022] DELETE /identity/v3/projects/0c601305524f4bdb84548c52cfb8f05c => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:39:56.791516 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e40d716-2341-4f5b-a9b0-5e0424bfff0f admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:39:56.794091 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-2e40d716-2341-4f5b-a9b0-5e0424bfff0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:39:56.955501 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e40d716-2341-4f5b-a9b0-5e0424bfff0f admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:39:57.058531 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abd4bd2-d22f-4fc1-880f-b7601467e484 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec5fd3a489c341b7964704d689037f05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:39:57.070696 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abd4bd2-d22f-4fc1-880f-b7601467e484 service cinder] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:39:57.070696 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abd4bd2-d22f-4fc1-880f-b7601467e484 service cinder] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:39:57.070696 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abd4bd2-d22f-4fc1-880f-b7601467e484 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:39:57.070696 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-2abd4bd2-d22f-4fc1-880f-b7601467e484 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:39:57.138808 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:39:57.250130 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abd4bd2-d22f-4fc1-880f-b7601467e484 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:39:57.251805 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abd4bd2-d22f-4fc1-880f-b7601467e484 service cinder] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:39:57.291394 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3838/7642] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:39:56 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 500 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:40:01.286675 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33579506-eb03-4506-87a3-bfa775ba7ede admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:01.288251 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-33579506-eb03-4506-87a3-bfa775ba7ede admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:40:01.381335 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33579506-eb03-4506-87a3-bfa775ba7ede admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:01.392420 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be4e015-7906-45cd-9e69-0c3e7884c42e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:01.393772 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be4e015-7906-45cd-9e69-0c3e7884c42e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:01.394389 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be4e015-7906-45cd-9e69-0c3e7884c42e admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:01.394839 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be4e015-7906-45cd-9e69-0c3e7884c42e admin admin] PATH_INFO: `/v3/users/25b3829a83124bcaae3a456770524e2c` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:01.396281 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be4e015-7906-45cd-9e69-0c3e7884c42e admin admin] RBAC: Authorizing `identity:delete_user(user_id=25b3829a83124bcaae3a456770524e2c)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:01.400801 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be4e015-7906-45cd-9e69-0c3e7884c42e admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:01.415698 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:40:01.490838 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-7be4e015-7906-45cd-9e69-0c3e7884c42e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25b3829a83124bcaae3a456770524e2c'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:01.500145 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-7be4e015-7906-45cd-9e69-0c3e7884c42e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25b3829a83124bcaae3a456770524e2c'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:01.500916 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-7be4e015-7906-45cd-9e69-0c3e7884c42e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25b3829a83124bcaae3a456770524e2c'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:01.511933 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-7be4e015-7906-45cd-9e69-0c3e7884c42e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25b3829a83124bcaae3a456770524e2c'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:01.530542 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-7be4e015-7906-45cd-9e69-0c3e7884c42e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25b3829a83124bcaae3a456770524e2c'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:01.537974 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3805/7643] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:40:01 2022] DELETE /identity/v3/users/25b3829a83124bcaae3a456770524e2c => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:40:01.542769 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53fd0ef-1baf-4cc7-85df-f01dc1bcfccd None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:01.543829 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53fd0ef-1baf-4cc7-85df-f01dc1bcfccd None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:01.544563 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53fd0ef-1baf-4cc7-85df-f01dc1bcfccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:01.565609 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-d53fd0ef-1baf-4cc7-85df-f01dc1bcfccd None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:40:01.567877 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-d53fd0ef-1baf-4cc7-85df-f01dc1bcfccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:40:01.670800 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3839/7644] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:40:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:40:01.678143 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be4e015-7906-45cd-9e69-0c3e7884c42e admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:01.679807 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-7be4e015-7906-45cd-9e69-0c3e7884c42e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:40:01.749667 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be4e015-7906-45cd-9e69-0c3e7884c42e admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:01.753528 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd9f616-d61f-4bd0-bd37-5e67e3a69d71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:01.754242 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd9f616-d61f-4bd0-bd37-5e67e3a69d71 service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:01.754524 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd9f616-d61f-4bd0-bd37-5e67e3a69d71 service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:01.754801 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd9f616-d61f-4bd0-bd37-5e67e3a69d71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:01.770015 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd9f616-d61f-4bd0-bd37-5e67e3a69d71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:01.771812 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd9f616-d61f-4bd0-bd37-5e67e3a69d71 service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:01.784106 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3806/7645] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:40:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:40:01.983793 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53fd0ef-1baf-4cc7-85df-f01dc1bcfccd None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:01.985414 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-d53fd0ef-1baf-4cc7-85df-f01dc1bcfccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:40:02.000105 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53fd0ef-1baf-4cc7-85df-f01dc1bcfccd None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:02.005450 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaecc39-998e-4e13-a755-9412a200df3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:02.006651 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaecc39-998e-4e13-a755-9412a200df3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:02.006921 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaecc39-998e-4e13-a755-9412a200df3e admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:02.007195 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaecc39-998e-4e13-a755-9412a200df3e admin admin] PATH_INFO: `/v3/projects/04f8858d3bcb4e4ba7d08c8e8e59173b` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:02.008480 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaecc39-998e-4e13-a755-9412a200df3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=04f8858d3bcb4e4ba7d08c8e8e59173b)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:02.012482 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaecc39-998e-4e13-a755-9412a200df3e admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:02.083055 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-bdaecc39-998e-4e13-a755-9412a200df3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04f8858d3bcb4e4ba7d08c8e8e59173b', 'request_id': 'req-bdaecc39-998e-4e13-a755-9412a200df3e'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:02.095423 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-bdaecc39-998e-4e13-a755-9412a200df3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04f8858d3bcb4e4ba7d08c8e8e59173b', 'request_id': 'req-bdaecc39-998e-4e13-a755-9412a200df3e'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:02.105205 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-bdaecc39-998e-4e13-a755-9412a200df3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04f8858d3bcb4e4ba7d08c8e8e59173b', 'request_id': 'req-bdaecc39-998e-4e13-a755-9412a200df3e'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:02.119711 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-bdaecc39-998e-4e13-a755-9412a200df3e admin admin] The token cache is being invalidate because project 04f8858d3bcb4e4ba7d08c8e8e59173b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:40:02.120209 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-bdaecc39-998e-4e13-a755-9412a200df3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:02.121060 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-bdaecc39-998e-4e13-a755-9412a200df3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:02.123079 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3840/7646] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:40:01 2022] DELETE /identity/v3/projects/04f8858d3bcb4e4ba7d08c8e8e59173b => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:40:02.129236 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3addc109-4a8c-4ca6-8d48-0bd9a60d9859 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:02.129604 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3addc109-4a8c-4ca6-8d48-0bd9a60d9859 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:02.130611 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3addc109-4a8c-4ca6-8d48-0bd9a60d9859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:02.150005 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-3addc109-4a8c-4ca6-8d48-0bd9a60d9859 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:40:02.151298 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-3addc109-4a8c-4ca6-8d48-0bd9a60d9859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:40:02.225427 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3807/7647] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:40:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:40:02.233410 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a606aa87-5991-4aeb-aa64-b87cc5697816 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:02.234021 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a606aa87-5991-4aeb-aa64-b87cc5697816 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:02.234428 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a606aa87-5991-4aeb-aa64-b87cc5697816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:02.255114 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-a606aa87-5991-4aeb-aa64-b87cc5697816 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:40:02.256345 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-a606aa87-5991-4aeb-aa64-b87cc5697816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:40:02.266109 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3841/7648] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:40:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:40:02.270297 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3addc109-4a8c-4ca6-8d48-0bd9a60d9859 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:02.280949 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3addc109-4a8c-4ca6-8d48-0bd9a60d9859 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:02.286755 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdb9d00-11cd-4be5-b712-11659f00c17d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:02.288070 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdb9d00-11cd-4be5-b712-11659f00c17d admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:02.288070 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdb9d00-11cd-4be5-b712-11659f00c17d admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:02.288070 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdb9d00-11cd-4be5-b712-11659f00c17d admin admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:02.288869 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdb9d00-11cd-4be5-b712-11659f00c17d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:40:02.289176 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdb9d00-11cd-4be5-b712-11659f00c17d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:02.290874 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdb9d00-11cd-4be5-b712-11659f00c17d admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:02.305914 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3808/7649] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:40:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:40:02.309848 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a606aa87-5991-4aeb-aa64-b87cc5697816 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:02.320985 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a606aa87-5991-4aeb-aa64-b87cc5697816 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:02.326546 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc5496f-17e5-4d77-ada3-f4b00569493f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:02.327234 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc5496f-17e5-4d77-ada3-f4b00569493f admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:02.327515 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc5496f-17e5-4d77-ada3-f4b00569493f admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:02.327897 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc5496f-17e5-4d77-ada3-f4b00569493f admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:02.328635 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc5496f-17e5-4d77-ada3-f4b00569493f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:02.330841 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc5496f-17e5-4d77-ada3-f4b00569493f admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:02.366559 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3842/7650] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:40:02 2022] POST /identity/v3/projects => generated 375 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:40:02.370555 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdb9d00-11cd-4be5-b712-11659f00c17d admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:02.381704 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdb9d00-11cd-4be5-b712-11659f00c17d admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:02.394376 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:40:02.454194 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32777de1-1daa-4380-a450-dc67ac432c82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:02.455055 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32777de1-1daa-4380-a450-dc67ac432c82 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:02.455430 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32777de1-1daa-4380-a450-dc67ac432c82 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:02.456074 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32777de1-1daa-4380-a450-dc67ac432c82 admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:02.456589 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32777de1-1daa-4380-a450-dc67ac432c82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:02.458684 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32777de1-1daa-4380-a450-dc67ac432c82 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:02.485132 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3809/7651] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:40:02 2022] POST /identity/v3/users => generated 288 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:40:02.489259 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc5496f-17e5-4d77-ada3-f4b00569493f admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:02.498796 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:40:02.508156 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc5496f-17e5-4d77-ada3-f4b00569493f admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:02.515073 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6254eab4-f2dc-4264-a93e-a62672b5cd00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:02.515899 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6254eab4-f2dc-4264-a93e-a62672b5cd00 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:02.516255 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6254eab4-f2dc-4264-a93e-a62672b5cd00 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:02.516550 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6254eab4-f2dc-4264-a93e-a62672b5cd00 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:02.517354 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6254eab4-f2dc-4264-a93e-a62672b5cd00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:02.519595 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6254eab4-f2dc-4264-a93e-a62672b5cd00 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:02.547350 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3843/7652] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:40:02 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 21:40:02.548632 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32777de1-1daa-4380-a450-dc67ac432c82 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:02.560096 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32777de1-1daa-4380-a450-dc67ac432c82 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:02.565199 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11342dc5-1c05-42c2-8501-984cfad174ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:02.565992 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11342dc5-1c05-42c2-8501-984cfad174ba admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:02.566393 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11342dc5-1c05-42c2-8501-984cfad174ba admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:02.566761 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11342dc5-1c05-42c2-8501-984cfad174ba admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:02.567593 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11342dc5-1c05-42c2-8501-984cfad174ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:02.569329 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11342dc5-1c05-42c2-8501-984cfad174ba admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:02.582421 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3810/7653] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:40:02 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:40:02.587585 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6254eab4-f2dc-4264-a93e-a62672b5cd00 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:02.599200 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6254eab4-f2dc-4264-a93e-a62672b5cd00 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:02.604976 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988dbf72-b971-4dc0-a087-6cf2bb948bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:02.605994 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988dbf72-b971-4dc0-a087-6cf2bb948bdd admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:02.606253 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988dbf72-b971-4dc0-a087-6cf2bb948bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:02.606545 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988dbf72-b971-4dc0-a087-6cf2bb948bdd admin admin] PATH_INFO: `/v3/projects/4d48037758464a04b8ce33ac09e067d4/users/7c7bc17cd32d48eda2ac5c462c198e0a/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:02.629483 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988dbf72-b971-4dc0-a087-6cf2bb948bdd admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d48037758464a04b8ce33ac09e067d4, user_id=7c7bc17cd32d48eda2ac5c462c198e0a, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:02.632806 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988dbf72-b971-4dc0-a087-6cf2bb948bdd admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:02.657429 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3844/7654] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:40:02 2022] PUT /identity/v3/projects/4d48037758464a04b8ce33ac09e067d4/users/7c7bc17cd32d48eda2ac5c462c198e0a/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:40:02.671881 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4057863c-ec5d-42ff-8180-2d1634d9fe47 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:02.672248 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4057863c-ec5d-42ff-8180-2d1634d9fe47 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:02.672581 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4057863c-ec5d-42ff-8180-2d1634d9fe47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:02.702836 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-4057863c-ec5d-42ff-8180-2d1634d9fe47 None None] MFA Rules not processed for user `7c7bc17cd32d48eda2ac5c462c198e0a`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:40:02.705730 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-4057863c-ec5d-42ff-8180-2d1634d9fe47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:40:02.806812 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3811/7655] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:40:02 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:40:02.817327 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988dbf72-b971-4dc0-a087-6cf2bb948bdd admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:02.820293 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-988dbf72-b971-4dc0-a087-6cf2bb948bdd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:40:02.900633 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988dbf72-b971-4dc0-a087-6cf2bb948bdd admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:02.904589 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71e5280-8f0e-4f4a-b930-50241a15221b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:02.905336 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71e5280-8f0e-4f4a-b930-50241a15221b service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:02.905699 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71e5280-8f0e-4f4a-b930-50241a15221b service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:02.906066 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71e5280-8f0e-4f4a-b930-50241a15221b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:02.916506 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71e5280-8f0e-4f4a-b930-50241a15221b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:02.919082 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71e5280-8f0e-4f4a-b930-50241a15221b service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:02.930616 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3845/7656] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:40:02 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:40:08.347893 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4057863c-ec5d-42ff-8180-2d1634d9fe47 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:08.349534 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-4057863c-ec5d-42ff-8180-2d1634d9fe47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:40:08.503651 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4057863c-ec5d-42ff-8180-2d1634d9fe47 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:08.509015 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14337358-515d-442c-9885-111b9f19787d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:08.509448 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14337358-515d-442c-9885-111b9f19787d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:08.509774 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14337358-515d-442c-9885-111b9f19787d admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:08.510092 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14337358-515d-442c-9885-111b9f19787d admin admin] PATH_INFO: `/v3/users/71404921d5224b4ea9fe43876d56a844` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:08.511701 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14337358-515d-442c-9885-111b9f19787d admin admin] RBAC: Authorizing `identity:delete_user(user_id=71404921d5224b4ea9fe43876d56a844)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:08.513958 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14337358-515d-442c-9885-111b9f19787d admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:08.544426 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:40:08.604903 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-14337358-515d-442c-9885-111b9f19787d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71404921d5224b4ea9fe43876d56a844'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:08.616719 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-14337358-515d-442c-9885-111b9f19787d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71404921d5224b4ea9fe43876d56a844'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:08.617563 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-14337358-515d-442c-9885-111b9f19787d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71404921d5224b4ea9fe43876d56a844'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:08.629014 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-14337358-515d-442c-9885-111b9f19787d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71404921d5224b4ea9fe43876d56a844'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:08.653817 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-14337358-515d-442c-9885-111b9f19787d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71404921d5224b4ea9fe43876d56a844'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:08.662345 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3812/7657] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:40:08 2022] DELETE /identity/v3/users/71404921d5224b4ea9fe43876d56a844 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:40:08.664336 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1cb0e1-6590-4181-aa4e-7f7183f45dea None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:08.664791 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1cb0e1-6590-4181-aa4e-7f7183f45dea None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:08.664887 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1cb0e1-6590-4181-aa4e-7f7183f45dea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:08.691630 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-8f1cb0e1-6590-4181-aa4e-7f7183f45dea None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:40:08.692858 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-8f1cb0e1-6590-4181-aa4e-7f7183f45dea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:40:08.791500 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3846/7658] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:40:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:40:08.801832 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14337358-515d-442c-9885-111b9f19787d admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:08.803407 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-14337358-515d-442c-9885-111b9f19787d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:40:08.946896 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14337358-515d-442c-9885-111b9f19787d admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:08.957467 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610fd535-0ca8-4ae2-b24d-d221dad909ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:08.968992 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610fd535-0ca8-4ae2-b24d-d221dad909ef service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:08.969287 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610fd535-0ca8-4ae2-b24d-d221dad909ef service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:08.969752 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610fd535-0ca8-4ae2-b24d-d221dad909ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:08.988582 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610fd535-0ca8-4ae2-b24d-d221dad909ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:08.990710 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610fd535-0ca8-4ae2-b24d-d221dad909ef service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:09.018251 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3813/7659] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:40:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:40:09.322874 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1cb0e1-6590-4181-aa4e-7f7183f45dea None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:09.324622 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-8f1cb0e1-6590-4181-aa4e-7f7183f45dea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:40:09.340144 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1cb0e1-6590-4181-aa4e-7f7183f45dea None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:09.344910 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b54cc4-56ed-479a-82a4-494a1e940123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:09.345989 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b54cc4-56ed-479a-82a4-494a1e940123 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:09.346396 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b54cc4-56ed-479a-82a4-494a1e940123 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:09.346754 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b54cc4-56ed-479a-82a4-494a1e940123 admin admin] PATH_INFO: `/v3/projects/f08a7ab705ed47678b35f267baab62aa` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:09.348462 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b54cc4-56ed-479a-82a4-494a1e940123 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f08a7ab705ed47678b35f267baab62aa)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:09.350594 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b54cc4-56ed-479a-82a4-494a1e940123 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:09.441369 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-10b54cc4-56ed-479a-82a4-494a1e940123 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f08a7ab705ed47678b35f267baab62aa', 'request_id': 'req-10b54cc4-56ed-479a-82a4-494a1e940123'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:09.453831 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-10b54cc4-56ed-479a-82a4-494a1e940123 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f08a7ab705ed47678b35f267baab62aa', 'request_id': 'req-10b54cc4-56ed-479a-82a4-494a1e940123'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:09.465288 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-10b54cc4-56ed-479a-82a4-494a1e940123 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f08a7ab705ed47678b35f267baab62aa', 'request_id': 'req-10b54cc4-56ed-479a-82a4-494a1e940123'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:09.466756 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:40:09.482765 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-10b54cc4-56ed-479a-82a4-494a1e940123 admin admin] The token cache is being invalidate because project f08a7ab705ed47678b35f267baab62aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:40:09.483869 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-10b54cc4-56ed-479a-82a4-494a1e940123 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:09.485123 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-10b54cc4-56ed-479a-82a4-494a1e940123 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:09.488038 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3847/7660] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:40:09 2022] DELETE /identity/v3/projects/f08a7ab705ed47678b35f267baab62aa => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:40:09.493196 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1104e67f-5f31-4a05-8ae1-e13764f307d2 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:09.493700 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1104e67f-5f31-4a05-8ae1-e13764f307d2 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:09.493793 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1104e67f-5f31-4a05-8ae1-e13764f307d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:09.527529 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-1104e67f-5f31-4a05-8ae1-e13764f307d2 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:40:09.528790 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-1104e67f-5f31-4a05-8ae1-e13764f307d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:40:09.629171 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3814/7661] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:40:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:40:09.637112 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea53ad2-690b-4a3e-a43f-40415336d7d0 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:09.637460 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea53ad2-690b-4a3e-a43f-40415336d7d0 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:09.638410 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea53ad2-690b-4a3e-a43f-40415336d7d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:09.680284 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-2ea53ad2-690b-4a3e-a43f-40415336d7d0 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:40:09.681581 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-2ea53ad2-690b-4a3e-a43f-40415336d7d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:40:09.694414 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3848/7662] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:40:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:40:09.699721 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1104e67f-5f31-4a05-8ae1-e13764f307d2 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:09.730470 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1104e67f-5f31-4a05-8ae1-e13764f307d2 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:09.740292 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11edc9b-0cc6-43ab-88f6-c6a784b3a064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:09.741348 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11edc9b-0cc6-43ab-88f6-c6a784b3a064 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:09.741975 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11edc9b-0cc6-43ab-88f6-c6a784b3a064 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:09.742450 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11edc9b-0cc6-43ab-88f6-c6a784b3a064 admin admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:09.743427 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11edc9b-0cc6-43ab-88f6-c6a784b3a064 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:40:09.743949 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11edc9b-0cc6-43ab-88f6-c6a784b3a064 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:09.745770 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11edc9b-0cc6-43ab-88f6-c6a784b3a064 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:09.769392 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3815/7663] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:40:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:40:09.774651 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea53ad2-690b-4a3e-a43f-40415336d7d0 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:09.787349 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea53ad2-690b-4a3e-a43f-40415336d7d0 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:09.794129 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18880a1-c18c-4f72-97ab-5c3c6fff1a6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:09.794829 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18880a1-c18c-4f72-97ab-5c3c6fff1a6d admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:09.795108 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18880a1-c18c-4f72-97ab-5c3c6fff1a6d admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:09.795386 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18880a1-c18c-4f72-97ab-5c3c6fff1a6d admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:09.796147 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18880a1-c18c-4f72-97ab-5c3c6fff1a6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:09.798425 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18880a1-c18c-4f72-97ab-5c3c6fff1a6d admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:09.845902 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3849/7664] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:40:09 2022] POST /identity/v3/projects => generated 383 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:40:09.851576 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11edc9b-0cc6-43ab-88f6-c6a784b3a064 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:09.862288 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11edc9b-0cc6-43ab-88f6-c6a784b3a064 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:09.898362 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:40:09.952905 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622cd069-9fef-4247-90f6-d2ab62e7f24e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:09.954016 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622cd069-9fef-4247-90f6-d2ab62e7f24e admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:09.954369 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622cd069-9fef-4247-90f6-d2ab62e7f24e admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:09.954777 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622cd069-9fef-4247-90f6-d2ab62e7f24e admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:09.955578 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622cd069-9fef-4247-90f6-d2ab62e7f24e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:09.957749 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622cd069-9fef-4247-90f6-d2ab62e7f24e admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:09.986156 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3816/7665] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:40:09 2022] POST /identity/v3/users => generated 292 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:40:09.990599 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18880a1-c18c-4f72-97ab-5c3c6fff1a6d admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:10.003615 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18880a1-c18c-4f72-97ab-5c3c6fff1a6d admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:10.008738 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6610a928-bb4c-4829-b2b3-ccff8b6c5a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:10.009526 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6610a928-bb4c-4829-b2b3-ccff8b6c5a5c admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:10.010065 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6610a928-bb4c-4829-b2b3-ccff8b6c5a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:10.010415 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6610a928-bb4c-4829-b2b3-ccff8b6c5a5c admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:10.011185 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6610a928-bb4c-4829-b2b3-ccff8b6c5a5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:10.012863 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6610a928-bb4c-4829-b2b3-ccff8b6c5a5c admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:10.025519 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3850/7666] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:40:09 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 21:40:10.030180 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622cd069-9fef-4247-90f6-d2ab62e7f24e admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:10.042350 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622cd069-9fef-4247-90f6-d2ab62e7f24e admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:10.047464 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf4e574-7f6f-4dec-a11d-ccc6a3709750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:10.048173 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf4e574-7f6f-4dec-a11d-ccc6a3709750 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:10.048483 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf4e574-7f6f-4dec-a11d-ccc6a3709750 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:10.048770 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf4e574-7f6f-4dec-a11d-ccc6a3709750 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:10.049578 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf4e574-7f6f-4dec-a11d-ccc6a3709750 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:10.051304 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf4e574-7f6f-4dec-a11d-ccc6a3709750 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:10.066994 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3817/7667] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:40:10 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:40:10.068339 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6610a928-bb4c-4829-b2b3-ccff8b6c5a5c admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:10.080259 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6610a928-bb4c-4829-b2b3-ccff8b6c5a5c admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:10.085500 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7720d6-4adf-4d13-a863-81088e31a68c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:10.086851 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7720d6-4adf-4d13-a863-81088e31a68c admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:10.087134 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7720d6-4adf-4d13-a863-81088e31a68c admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:10.087409 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7720d6-4adf-4d13-a863-81088e31a68c admin admin] PATH_INFO: `/v3/projects/ba213601de53445096f31a47bd361be0/users/59808ad7bdb8470fa018047b04a7282a/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:10.105937 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7720d6-4adf-4d13-a863-81088e31a68c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba213601de53445096f31a47bd361be0, user_id=59808ad7bdb8470fa018047b04a7282a, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:10.108746 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7720d6-4adf-4d13-a863-81088e31a68c admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:10.126962 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3851/7668] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:40:10 2022] PUT /identity/v3/projects/ba213601de53445096f31a47bd361be0/users/59808ad7bdb8470fa018047b04a7282a/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:40:10.138191 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4196cf2-2c2e-4bae-b287-383a08e17d79 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:10.138682 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4196cf2-2c2e-4bae-b287-383a08e17d79 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:10.139022 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4196cf2-2c2e-4bae-b287-383a08e17d79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:10.170273 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-d4196cf2-2c2e-4bae-b287-383a08e17d79 None None] MFA Rules not processed for user `59808ad7bdb8470fa018047b04a7282a`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:40:10.171529 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-d4196cf2-2c2e-4bae-b287-383a08e17d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:40:10.266381 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3818/7669] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:40:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:40:10.280658 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7720d6-4adf-4d13-a863-81088e31a68c admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:10.283097 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-7d7720d6-4adf-4d13-a863-81088e31a68c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:40:10.391388 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7720d6-4adf-4d13-a863-81088e31a68c admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:10.395949 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486ea077-a948-45f9-a8fb-a06c381abf89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:10.396629 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486ea077-a948-45f9-a8fb-a06c381abf89 service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:10.396913 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486ea077-a948-45f9-a8fb-a06c381abf89 service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:10.397330 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486ea077-a948-45f9-a8fb-a06c381abf89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:10.409447 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486ea077-a948-45f9-a8fb-a06c381abf89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:10.410948 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486ea077-a948-45f9-a8fb-a06c381abf89 service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:10.426088 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3852/7670] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:40:10 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:40:15.639841 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4196cf2-2c2e-4bae-b287-383a08e17d79 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:15.720538 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4196cf2-2c2e-4bae-b287-383a08e17d79 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:15.725023 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef858711-96fb-4760-aef2-ac064f34059f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:15.726010 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef858711-96fb-4760-aef2-ac064f34059f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:15.726290 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef858711-96fb-4760-aef2-ac064f34059f admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:15.726561 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef858711-96fb-4760-aef2-ac064f34059f admin admin] PATH_INFO: `/v3/users/59808ad7bdb8470fa018047b04a7282a` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:15.727767 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef858711-96fb-4760-aef2-ac064f34059f admin admin] RBAC: Authorizing `identity:delete_user(user_id=59808ad7bdb8470fa018047b04a7282a)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:15.729705 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef858711-96fb-4760-aef2-ac064f34059f admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:15.779878 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:40:15.785738 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-ef858711-96fb-4760-aef2-ac064f34059f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59808ad7bdb8470fa018047b04a7282a'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:15.796179 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-ef858711-96fb-4760-aef2-ac064f34059f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59808ad7bdb8470fa018047b04a7282a'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:15.796901 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-ef858711-96fb-4760-aef2-ac064f34059f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59808ad7bdb8470fa018047b04a7282a'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:15.805381 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-ef858711-96fb-4760-aef2-ac064f34059f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59808ad7bdb8470fa018047b04a7282a'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:15.818464 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-ef858711-96fb-4760-aef2-ac064f34059f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59808ad7bdb8470fa018047b04a7282a'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:15.824963 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3819/7671] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:40:15 2022] DELETE /identity/v3/users/59808ad7bdb8470fa018047b04a7282a => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:40:15.829827 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fec75bc-3550-4a1c-9816-39ddda5ff76e None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:15.830329 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fec75bc-3550-4a1c-9816-39ddda5ff76e None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:15.830479 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fec75bc-3550-4a1c-9816-39ddda5ff76e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:15.850340 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-7fec75bc-3550-4a1c-9816-39ddda5ff76e None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:40:15.851603 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-7fec75bc-3550-4a1c-9816-39ddda5ff76e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:40:15.923530 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3853/7672] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:40:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:40:15.933391 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef858711-96fb-4760-aef2-ac064f34059f admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:15.935248 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-ef858711-96fb-4760-aef2-ac064f34059f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:40:16.010048 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef858711-96fb-4760-aef2-ac064f34059f admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:16.019424 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3501fb9-274f-420e-b4b1-675c6aab8f1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:16.020149 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3501fb9-274f-420e-b4b1-675c6aab8f1b service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:16.020428 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3501fb9-274f-420e-b4b1-675c6aab8f1b service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:16.020701 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3501fb9-274f-420e-b4b1-675c6aab8f1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:16.032994 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3501fb9-274f-420e-b4b1-675c6aab8f1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:16.035518 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3501fb9-274f-420e-b4b1-675c6aab8f1b service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:16.052547 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3820/7673] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:40:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 23 21:40:16.304014 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fec75bc-3550-4a1c-9816-39ddda5ff76e None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:16.305533 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-7fec75bc-3550-4a1c-9816-39ddda5ff76e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:40:16.326773 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fec75bc-3550-4a1c-9816-39ddda5ff76e None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:16.332196 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b899478-3bfd-4466-8685-5b5653ce996d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:16.333409 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b899478-3bfd-4466-8685-5b5653ce996d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:16.333759 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b899478-3bfd-4466-8685-5b5653ce996d admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:16.334225 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b899478-3bfd-4466-8685-5b5653ce996d admin admin] PATH_INFO: `/v3/projects/ba213601de53445096f31a47bd361be0` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:16.335863 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b899478-3bfd-4466-8685-5b5653ce996d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba213601de53445096f31a47bd361be0)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:16.339130 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b899478-3bfd-4466-8685-5b5653ce996d admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:16.388316 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:40:16.422002 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-5b899478-3bfd-4466-8685-5b5653ce996d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba213601de53445096f31a47bd361be0', 'request_id': 'req-5b899478-3bfd-4466-8685-5b5653ce996d'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:16.430683 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-5b899478-3bfd-4466-8685-5b5653ce996d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba213601de53445096f31a47bd361be0', 'request_id': 'req-5b899478-3bfd-4466-8685-5b5653ce996d'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:16.436589 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-5b899478-3bfd-4466-8685-5b5653ce996d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba213601de53445096f31a47bd361be0', 'request_id': 'req-5b899478-3bfd-4466-8685-5b5653ce996d'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:16.448460 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-5b899478-3bfd-4466-8685-5b5653ce996d admin admin] The token cache is being invalidate because project ba213601de53445096f31a47bd361be0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:40:16.449263 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-5b899478-3bfd-4466-8685-5b5653ce996d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:16.449959 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-5b899478-3bfd-4466-8685-5b5653ce996d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:16.451690 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3854/7674] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:40:16 2022] DELETE /identity/v3/projects/ba213601de53445096f31a47bd361be0 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:40:16.456874 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d799fcd7-5adf-4ca6-9c13-1d4cbdaf74da None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:16.457232 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d799fcd7-5adf-4ca6-9c13-1d4cbdaf74da None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:16.457571 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d799fcd7-5adf-4ca6-9c13-1d4cbdaf74da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:16.480167 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-d799fcd7-5adf-4ca6-9c13-1d4cbdaf74da None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:40:16.481461 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-d799fcd7-5adf-4ca6-9c13-1d4cbdaf74da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:40:16.571031 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3821/7675] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:40:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:40:16.580831 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eccc63-dfdc-45a1-b135-dd638e4f7bb1 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:16.581343 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eccc63-dfdc-45a1-b135-dd638e4f7bb1 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:16.581716 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eccc63-dfdc-45a1-b135-dd638e4f7bb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:16.602378 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-f8eccc63-dfdc-45a1-b135-dd638e4f7bb1 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:40:16.603800 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-f8eccc63-dfdc-45a1-b135-dd638e4f7bb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:40:16.614478 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3855/7676] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:40:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:40:16.616499 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d799fcd7-5adf-4ca6-9c13-1d4cbdaf74da None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:16.627432 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d799fcd7-5adf-4ca6-9c13-1d4cbdaf74da None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:16.632276 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3e5827-c5d6-433f-bfa0-fa020ae3e7be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:16.632949 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3e5827-c5d6-433f-bfa0-fa020ae3e7be admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:16.633235 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3e5827-c5d6-433f-bfa0-fa020ae3e7be admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:16.633972 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3e5827-c5d6-433f-bfa0-fa020ae3e7be admin admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:16.634601 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3e5827-c5d6-433f-bfa0-fa020ae3e7be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:40:16.634908 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3e5827-c5d6-433f-bfa0-fa020ae3e7be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:16.636534 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3e5827-c5d6-433f-bfa0-fa020ae3e7be admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:16.652388 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3822/7677] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:40:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:40:16.654273 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8eccc63-dfdc-45a1-b135-dd638e4f7bb1 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:16.665459 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8eccc63-dfdc-45a1-b135-dd638e4f7bb1 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:16.676229 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186928b5-d0a5-4afa-875d-c8ab7a469b6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:16.676909 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186928b5-d0a5-4afa-875d-c8ab7a469b6f admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:16.677707 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186928b5-d0a5-4afa-875d-c8ab7a469b6f admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:16.677707 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186928b5-d0a5-4afa-875d-c8ab7a469b6f admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:16.678158 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186928b5-d0a5-4afa-875d-c8ab7a469b6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:16.680524 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186928b5-d0a5-4afa-875d-c8ab7a469b6f admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:16.742439 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3856/7678] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:40:16 2022] POST /identity/v3/projects => generated 389 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:40:16.747041 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3e5827-c5d6-433f-bfa0-fa020ae3e7be admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:16.762587 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3e5827-c5d6-433f-bfa0-fa020ae3e7be admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:16.857825 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:40:16.872986 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10b29b9-2509-43ab-83f7-9ee0c4a57a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:16.873769 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10b29b9-2509-43ab-83f7-9ee0c4a57a72 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:16.874125 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10b29b9-2509-43ab-83f7-9ee0c4a57a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:16.874400 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10b29b9-2509-43ab-83f7-9ee0c4a57a72 admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:16.875100 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10b29b9-2509-43ab-83f7-9ee0c4a57a72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:16.877017 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10b29b9-2509-43ab-83f7-9ee0c4a57a72 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:16.909910 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3823/7679] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:40:16 2022] POST /identity/v3/users => generated 295 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:40:16.912694 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186928b5-d0a5-4afa-875d-c8ab7a469b6f admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:16.924292 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186928b5-d0a5-4afa-875d-c8ab7a469b6f admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:16.929037 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ec433e-369c-4471-8278-c494958dae4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:16.929712 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ec433e-369c-4471-8278-c494958dae4c admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:16.930023 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ec433e-369c-4471-8278-c494958dae4c admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:16.930297 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ec433e-369c-4471-8278-c494958dae4c admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:16.931025 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ec433e-369c-4471-8278-c494958dae4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:16.932620 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ec433e-369c-4471-8278-c494958dae4c admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:16.949901 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3857/7680] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:40:16 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:40:16.952382 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10b29b9-2509-43ab-83f7-9ee0c4a57a72 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:16.963432 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10b29b9-2509-43ab-83f7-9ee0c4a57a72 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:16.968105 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c4235c-db2c-47a6-9a56-92fe62f17171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:16.968778 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c4235c-db2c-47a6-9a56-92fe62f17171 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:16.969060 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c4235c-db2c-47a6-9a56-92fe62f17171 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:16.969336 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c4235c-db2c-47a6-9a56-92fe62f17171 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:16.970116 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c4235c-db2c-47a6-9a56-92fe62f17171 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:16.971740 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c4235c-db2c-47a6-9a56-92fe62f17171 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:16.985164 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3824/7681] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:40:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:40:16.986553 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ec433e-369c-4471-8278-c494958dae4c admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:16.996880 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ec433e-369c-4471-8278-c494958dae4c admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:17.001706 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d95d72-80f2-4ba5-bcac-7f5d98f6618e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:17.002778 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d95d72-80f2-4ba5-bcac-7f5d98f6618e admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:17.003127 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d95d72-80f2-4ba5-bcac-7f5d98f6618e admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:17.003771 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d95d72-80f2-4ba5-bcac-7f5d98f6618e admin admin] PATH_INFO: `/v3/projects/24402b05c55d4150b6f136505487f771/users/6db7819db6a94e8d8fdce38c6d6adb16/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:17.021375 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d95d72-80f2-4ba5-bcac-7f5d98f6618e admin admin] RBAC: Authorizing `identity:create_grant(project_id=24402b05c55d4150b6f136505487f771, user_id=6db7819db6a94e8d8fdce38c6d6adb16, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:17.024126 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d95d72-80f2-4ba5-bcac-7f5d98f6618e admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:17.042005 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3858/7682] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:40:16 2022] PUT /identity/v3/projects/24402b05c55d4150b6f136505487f771/users/6db7819db6a94e8d8fdce38c6d6adb16/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:40:17.052845 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5facb686-0894-4595-a03e-892486ea0574 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:17.053134 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5facb686-0894-4595-a03e-892486ea0574 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:17.053408 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5facb686-0894-4595-a03e-892486ea0574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:17.081986 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-5facb686-0894-4595-a03e-892486ea0574 None None] MFA Rules not processed for user `6db7819db6a94e8d8fdce38c6d6adb16`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:40:17.083256 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-5facb686-0894-4595-a03e-892486ea0574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:40:17.158417 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3825/7683] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:40:17 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:40:17.162761 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d95d72-80f2-4ba5-bcac-7f5d98f6618e admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:17.226232 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d95d72-80f2-4ba5-bcac-7f5d98f6618e admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:17.231143 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a74cae6-5c3b-45b1-9c36-aebbea740634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:17.231843 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a74cae6-5c3b-45b1-9c36-aebbea740634 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:17.232152 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a74cae6-5c3b-45b1-9c36-aebbea740634 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:17.232425 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a74cae6-5c3b-45b1-9c36-aebbea740634 admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:17.233112 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a74cae6-5c3b-45b1-9c36-aebbea740634 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:17.235099 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a74cae6-5c3b-45b1-9c36-aebbea740634 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:17.263721 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3859/7684] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:40:17 2022] POST /identity/v3/projects => generated 389 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:40:17.268054 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5facb686-0894-4595-a03e-892486ea0574 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:17.279172 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5facb686-0894-4595-a03e-892486ea0574 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:17.338659 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f87a02e-737d-4c4f-b575-77b763f42cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:17.339269 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f87a02e-737d-4c4f-b575-77b763f42cdc admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:17.339557 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f87a02e-737d-4c4f-b575-77b763f42cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:17.339826 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f87a02e-737d-4c4f-b575-77b763f42cdc admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:17.340520 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f87a02e-737d-4c4f-b575-77b763f42cdc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:17.342470 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f87a02e-737d-4c4f-b575-77b763f42cdc admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:17.365474 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3826/7685] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:40:17 2022] POST /identity/v3/users => generated 301 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:40:17.367101 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a74cae6-5c3b-45b1-9c36-aebbea740634 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:17.378563 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a74cae6-5c3b-45b1-9c36-aebbea740634 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:17.384998 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87837c96-319c-41a0-aa64-82e852e839e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:17.385770 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87837c96-319c-41a0-aa64-82e852e839e6 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:17.386204 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87837c96-319c-41a0-aa64-82e852e839e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:17.386514 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87837c96-319c-41a0-aa64-82e852e839e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:17.387250 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87837c96-319c-41a0-aa64-82e852e839e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:17.388896 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87837c96-319c-41a0-aa64-82e852e839e6 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:17.400745 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3860/7686] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:40:17 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:40:17.404987 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f87a02e-737d-4c4f-b575-77b763f42cdc admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:17.416667 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f87a02e-737d-4c4f-b575-77b763f42cdc admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:17.430050 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a614a970-7950-433b-ac10-0ec6f0409fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:17.430990 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a614a970-7950-433b-ac10-0ec6f0409fff admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:17.431256 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a614a970-7950-433b-ac10-0ec6f0409fff admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:17.431527 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a614a970-7950-433b-ac10-0ec6f0409fff admin admin] PATH_INFO: `/v3/projects/ca9a5fa2957b4167b147afd02bf4b1ec/users/1788c18596d34448957d31b663c1a5c9/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:17.448787 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a614a970-7950-433b-ac10-0ec6f0409fff admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca9a5fa2957b4167b147afd02bf4b1ec, user_id=1788c18596d34448957d31b663c1a5c9, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:17.451567 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a614a970-7950-433b-ac10-0ec6f0409fff admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:17.467483 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3827/7687] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:40:17 2022] PUT /identity/v3/projects/ca9a5fa2957b4167b147afd02bf4b1ec/users/1788c18596d34448957d31b663c1a5c9/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:40:17.471250 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87837c96-319c-41a0-aa64-82e852e839e6 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:17.482112 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87837c96-319c-41a0-aa64-82e852e839e6 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:17.506214 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:40:17.549299 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b13996-7cd8-4fc3-9b79-3bf8a47bf4ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:17.551493 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b13996-7cd8-4fc3-9b79-3bf8a47bf4ca admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:17.551691 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b13996-7cd8-4fc3-9b79-3bf8a47bf4ca admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:17.552043 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b13996-7cd8-4fc3-9b79-3bf8a47bf4ca admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:17.552819 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b13996-7cd8-4fc3-9b79-3bf8a47bf4ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:17.554569 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b13996-7cd8-4fc3-9b79-3bf8a47bf4ca admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:17.571097 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3861/7688] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:40:17 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 21:40:17.572344 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a614a970-7950-433b-ac10-0ec6f0409fff admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:17.585751 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a614a970-7950-433b-ac10-0ec6f0409fff admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:17.591186 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5499b10-a992-45aa-86c3-b88683ea7654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:17.592033 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5499b10-a992-45aa-86c3-b88683ea7654 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:17.592315 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5499b10-a992-45aa-86c3-b88683ea7654 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:17.592591 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5499b10-a992-45aa-86c3-b88683ea7654 admin admin] PATH_INFO: `/v3/projects/ca9a5fa2957b4167b147afd02bf4b1ec/users/1788c18596d34448957d31b663c1a5c9/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:17.594671 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5499b10-a992-45aa-86c3-b88683ea7654 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca9a5fa2957b4167b147afd02bf4b1ec, user_id=1788c18596d34448957d31b663c1a5c9, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:17.597352 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5499b10-a992-45aa-86c3-b88683ea7654 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:17.608497 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3828/7689] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:40:17 2022] PUT /identity/v3/projects/ca9a5fa2957b4167b147afd02bf4b1ec/users/1788c18596d34448957d31b663c1a5c9/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:40:17.619453 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75cafd6-9a05-459d-9e33-02d0a76223fa None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:17.619744 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75cafd6-9a05-459d-9e33-02d0a76223fa None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:17.620027 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75cafd6-9a05-459d-9e33-02d0a76223fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:17.654794 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-a75cafd6-9a05-459d-9e33-02d0a76223fa None None] MFA Rules not processed for user `1788c18596d34448957d31b663c1a5c9`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:40:17.656058 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-a75cafd6-9a05-459d-9e33-02d0a76223fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:40:17.736210 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3862/7690] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:40:17 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:40:17.747557 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5499b10-a992-45aa-86c3-b88683ea7654 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:17.749424 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-c5499b10-a992-45aa-86c3-b88683ea7654 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:40:17.761954 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:40:17.828387 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5499b10-a992-45aa-86c3-b88683ea7654 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:17.833633 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b15d800-293a-4609-adbd-610c7bebb288 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec5fd3a489c341b7964704d689037f05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:17.834577 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b15d800-293a-4609-adbd-610c7bebb288 service cinder] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:17.835025 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b15d800-293a-4609-adbd-610c7bebb288 service cinder] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:17.835302 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b15d800-293a-4609-adbd-610c7bebb288 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:17.850700 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b15d800-293a-4609-adbd-610c7bebb288 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:17.852300 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b15d800-293a-4609-adbd-610c7bebb288 service cinder] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:17.862719 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3829/7691] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:40:17 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:40:18.039893 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75cafd6-9a05-459d-9e33-02d0a76223fa None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:18.103772 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75cafd6-9a05-459d-9e33-02d0a76223fa None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:18.108337 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e264cca4-b2c5-43c3-a3d1-a2d73bb58630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:18.109240 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e264cca4-b2c5-43c3-a3d1-a2d73bb58630 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:18.109512 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e264cca4-b2c5-43c3-a3d1-a2d73bb58630 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:18.109778 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e264cca4-b2c5-43c3-a3d1-a2d73bb58630 admin admin] PATH_INFO: `/v3/users/6db7819db6a94e8d8fdce38c6d6adb16` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:18.111053 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e264cca4-b2c5-43c3-a3d1-a2d73bb58630 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6db7819db6a94e8d8fdce38c6d6adb16)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:18.112975 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e264cca4-b2c5-43c3-a3d1-a2d73bb58630 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:18.162873 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-e264cca4-b2c5-43c3-a3d1-a2d73bb58630 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6db7819db6a94e8d8fdce38c6d6adb16'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:18.163533 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-e264cca4-b2c5-43c3-a3d1-a2d73bb58630 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6db7819db6a94e8d8fdce38c6d6adb16'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:18.165528 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:40:18.172176 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-e264cca4-b2c5-43c3-a3d1-a2d73bb58630 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6db7819db6a94e8d8fdce38c6d6adb16'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:18.180275 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-e264cca4-b2c5-43c3-a3d1-a2d73bb58630 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6db7819db6a94e8d8fdce38c6d6adb16'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:18.193293 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-e264cca4-b2c5-43c3-a3d1-a2d73bb58630 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6db7819db6a94e8d8fdce38c6d6adb16'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:18.199766 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3863/7692] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:40:18 2022] DELETE /identity/v3/users/6db7819db6a94e8d8fdce38c6d6adb16 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:40:18.204755 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8dd15e-e36b-4714-b54c-e82855fc68ca None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:18.205134 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8dd15e-e36b-4714-b54c-e82855fc68ca None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:18.205577 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8dd15e-e36b-4714-b54c-e82855fc68ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:18.223801 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-dd8dd15e-e36b-4714-b54c-e82855fc68ca None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:40:18.225015 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-dd8dd15e-e36b-4714-b54c-e82855fc68ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:40:18.287359 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3830/7693] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:40:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:40:18.297744 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e264cca4-b2c5-43c3-a3d1-a2d73bb58630 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:18.299490 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-e264cca4-b2c5-43c3-a3d1-a2d73bb58630 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:40:18.322702 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8dd15e-e36b-4714-b54c-e82855fc68ca None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:18.324344 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-dd8dd15e-e36b-4714-b54c-e82855fc68ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:40:18.337270 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8dd15e-e36b-4714-b54c-e82855fc68ca None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:18.341927 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a70cd0-87c4-42e3-8046-44e4757711c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:18.342806 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a70cd0-87c4-42e3-8046-44e4757711c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:18.343095 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a70cd0-87c4-42e3-8046-44e4757711c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:18.343354 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a70cd0-87c4-42e3-8046-44e4757711c9 admin admin] PATH_INFO: `/v3/users/7c7bc17cd32d48eda2ac5c462c198e0a` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:18.344535 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a70cd0-87c4-42e3-8046-44e4757711c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c7bc17cd32d48eda2ac5c462c198e0a)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:18.346531 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a70cd0-87c4-42e3-8046-44e4757711c9 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:18.364708 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e264cca4-b2c5-43c3-a3d1-a2d73bb58630 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:18.368532 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b98fad8-4acd-4ccf-b1e3-5a97afff2b90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:18.369199 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b98fad8-4acd-4ccf-b1e3-5a97afff2b90 service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:18.369478 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b98fad8-4acd-4ccf-b1e3-5a97afff2b90 service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:18.369766 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b98fad8-4acd-4ccf-b1e3-5a97afff2b90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:18.381178 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b98fad8-4acd-4ccf-b1e3-5a97afff2b90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:18.382849 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b98fad8-4acd-4ccf-b1e3-5a97afff2b90 service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:18.392678 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3864/7694] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:40:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:40:18.395480 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-09a70cd0-87c4-42e3-8046-44e4757711c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c7bc17cd32d48eda2ac5c462c198e0a'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:18.402685 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-09a70cd0-87c4-42e3-8046-44e4757711c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c7bc17cd32d48eda2ac5c462c198e0a'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:18.403385 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-09a70cd0-87c4-42e3-8046-44e4757711c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c7bc17cd32d48eda2ac5c462c198e0a'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:18.412283 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-09a70cd0-87c4-42e3-8046-44e4757711c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c7bc17cd32d48eda2ac5c462c198e0a'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:18.424789 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-09a70cd0-87c4-42e3-8046-44e4757711c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c7bc17cd32d48eda2ac5c462c198e0a'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:18.431075 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3831/7695] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:40:18 2022] DELETE /identity/v3/users/7c7bc17cd32d48eda2ac5c462c198e0a => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:40:18.435819 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fba373-147d-4d49-a125-fce7bd7a4fef None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:18.436116 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fba373-147d-4d49-a125-fce7bd7a4fef None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:18.436399 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fba373-147d-4d49-a125-fce7bd7a4fef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:18.455636 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-e2fba373-147d-4d49-a125-fce7bd7a4fef None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:40:18.457093 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-e2fba373-147d-4d49-a125-fce7bd7a4fef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:40:18.520603 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3865/7696] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:40:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:40:18.530747 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a70cd0-87c4-42e3-8046-44e4757711c9 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:18.532280 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-09a70cd0-87c4-42e3-8046-44e4757711c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:40:18.563066 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:40:18.599385 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a70cd0-87c4-42e3-8046-44e4757711c9 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:18.603078 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e739ba-905f-422f-a74d-96b6bb7bda09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:18.603744 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e739ba-905f-422f-a74d-96b6bb7bda09 service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:18.604026 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e739ba-905f-422f-a74d-96b6bb7bda09 service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:18.604300 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e739ba-905f-422f-a74d-96b6bb7bda09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:18.613757 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e739ba-905f-422f-a74d-96b6bb7bda09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:18.615297 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e739ba-905f-422f-a74d-96b6bb7bda09 service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:18.625756 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3832/7697] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:40:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:40:18.724923 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fba373-147d-4d49-a125-fce7bd7a4fef None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:18.726648 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-e2fba373-147d-4d49-a125-fce7bd7a4fef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:40:18.740274 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fba373-147d-4d49-a125-fce7bd7a4fef None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:18.746506 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f696b4-a1e8-43e3-8fc8-a4daa36d7e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:18.747406 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f696b4-a1e8-43e3-8fc8-a4daa36d7e16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:18.747689 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f696b4-a1e8-43e3-8fc8-a4daa36d7e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:18.747965 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f696b4-a1e8-43e3-8fc8-a4daa36d7e16 admin admin] PATH_INFO: `/v3/projects/24402b05c55d4150b6f136505487f771` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:18.749434 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f696b4-a1e8-43e3-8fc8-a4daa36d7e16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24402b05c55d4150b6f136505487f771)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:18.751814 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f696b4-a1e8-43e3-8fc8-a4daa36d7e16 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:18.829123 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-66f696b4-a1e8-43e3-8fc8-a4daa36d7e16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24402b05c55d4150b6f136505487f771', 'request_id': 'req-66f696b4-a1e8-43e3-8fc8-a4daa36d7e16'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:18.838401 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-66f696b4-a1e8-43e3-8fc8-a4daa36d7e16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24402b05c55d4150b6f136505487f771', 'request_id': 'req-66f696b4-a1e8-43e3-8fc8-a4daa36d7e16'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:18.844531 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-66f696b4-a1e8-43e3-8fc8-a4daa36d7e16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24402b05c55d4150b6f136505487f771', 'request_id': 'req-66f696b4-a1e8-43e3-8fc8-a4daa36d7e16'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:18.845717 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:40:18.857259 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e739ba-905f-422f-a74d-96b6bb7bda09 service neutron] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:18.859279 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-13e739ba-905f-422f-a74d-96b6bb7bda09 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:40:18.860217 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-66f696b4-a1e8-43e3-8fc8-a4daa36d7e16 admin admin] The token cache is being invalidate because project 24402b05c55d4150b6f136505487f771 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:40:18.861335 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-66f696b4-a1e8-43e3-8fc8-a4daa36d7e16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:18.862107 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-66f696b4-a1e8-43e3-8fc8-a4daa36d7e16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:18.863991 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3866/7698] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:40:18 2022] DELETE /identity/v3/projects/24402b05c55d4150b6f136505487f771 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:40:18.868554 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f696b4-a1e8-43e3-8fc8-a4daa36d7e16 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:18.871330 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-66f696b4-a1e8-43e3-8fc8-a4daa36d7e16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:40:18.873223 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e739ba-905f-422f-a74d-96b6bb7bda09 service neutron] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:18.934378 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0b2b23-ab7e-4677-9849-80cbe1cab95a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:18.935265 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0b2b23-ab7e-4677-9849-80cbe1cab95a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:18.935544 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0b2b23-ab7e-4677-9849-80cbe1cab95a admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:18.935815 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0b2b23-ab7e-4677-9849-80cbe1cab95a admin admin] PATH_INFO: `/v3/projects/4d48037758464a04b8ce33ac09e067d4` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:18.937209 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0b2b23-ab7e-4677-9849-80cbe1cab95a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d48037758464a04b8ce33ac09e067d4)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:18.939294 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0b2b23-ab7e-4677-9849-80cbe1cab95a admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:18.941002 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f696b4-a1e8-43e3-8fc8-a4daa36d7e16 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:18.947374 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a1ae44-42d3-496c-a5e6-f1eaeadaf74d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:18.949659 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a1ae44-42d3-496c-a5e6-f1eaeadaf74d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:18.950110 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a1ae44-42d3-496c-a5e6-f1eaeadaf74d admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:18.950393 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a1ae44-42d3-496c-a5e6-f1eaeadaf74d admin admin] PATH_INFO: `/v3/users/1788c18596d34448957d31b663c1a5c9` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:18.951652 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a1ae44-42d3-496c-a5e6-f1eaeadaf74d admin admin] RBAC: Authorizing `identity:delete_user(user_id=1788c18596d34448957d31b663c1a5c9)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:18.953605 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a1ae44-42d3-496c-a5e6-f1eaeadaf74d admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:18.991585 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-7a0b2b23-ab7e-4677-9849-80cbe1cab95a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d48037758464a04b8ce33ac09e067d4', 'request_id': 'req-7a0b2b23-ab7e-4677-9849-80cbe1cab95a'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:18.998636 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-7a0b2b23-ab7e-4677-9849-80cbe1cab95a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d48037758464a04b8ce33ac09e067d4', 'request_id': 'req-7a0b2b23-ab7e-4677-9849-80cbe1cab95a'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:19.004218 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-7a0b2b23-ab7e-4677-9849-80cbe1cab95a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d48037758464a04b8ce33ac09e067d4', 'request_id': 'req-7a0b2b23-ab7e-4677-9849-80cbe1cab95a'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:19.008294 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-38a1ae44-42d3-496c-a5e6-f1eaeadaf74d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1788c18596d34448957d31b663c1a5c9'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:19.008961 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-38a1ae44-42d3-496c-a5e6-f1eaeadaf74d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1788c18596d34448957d31b663c1a5c9'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:19.016141 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-38a1ae44-42d3-496c-a5e6-f1eaeadaf74d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1788c18596d34448957d31b663c1a5c9'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:19.016345 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-7a0b2b23-ab7e-4677-9849-80cbe1cab95a admin admin] The token cache is being invalidate because project 4d48037758464a04b8ce33ac09e067d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:40:19.016648 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-7a0b2b23-ab7e-4677-9849-80cbe1cab95a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:19.017282 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-7a0b2b23-ab7e-4677-9849-80cbe1cab95a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:19.019501 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3833/7699] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:40:18 2022] DELETE /identity/v3/projects/4d48037758464a04b8ce33ac09e067d4 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:40:19.024699 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8732cb07-52ed-473d-9a1b-fb7d9b862694 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:19.025038 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8732cb07-52ed-473d-9a1b-fb7d9b862694 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:19.025234 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-38a1ae44-42d3-496c-a5e6-f1eaeadaf74d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1788c18596d34448957d31b663c1a5c9'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:19.025346 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8732cb07-52ed-473d-9a1b-fb7d9b862694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:19.040709 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-38a1ae44-42d3-496c-a5e6-f1eaeadaf74d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1788c18596d34448957d31b663c1a5c9'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:19.043775 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-8732cb07-52ed-473d-9a1b-fb7d9b862694 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:40:19.044994 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-8732cb07-52ed-473d-9a1b-fb7d9b862694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:40:19.047080 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3867/7700] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:40:18 2022] DELETE /identity/v3/users/1788c18596d34448957d31b663c1a5c9 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:40:19.097116 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:40:19.110380 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3834/7701] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:40:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:40:19.119024 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f25701-a768-478f-ad5d-cd5446310b24 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:19.119235 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f25701-a768-478f-ad5d-cd5446310b24 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:19.119506 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f25701-a768-478f-ad5d-cd5446310b24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:19.138404 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-65f25701-a768-478f-ad5d-cd5446310b24 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:40:19.139616 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-65f25701-a768-478f-ad5d-cd5446310b24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:40:19.147967 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3868/7702] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:40:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:40:19.152408 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8732cb07-52ed-473d-9a1b-fb7d9b862694 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:19.162710 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8732cb07-52ed-473d-9a1b-fb7d9b862694 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:19.167498 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcd29fe-a34b-431b-981f-94051fd18419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:19.168172 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcd29fe-a34b-431b-981f-94051fd18419 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:19.168451 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcd29fe-a34b-431b-981f-94051fd18419 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:19.168724 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcd29fe-a34b-431b-981f-94051fd18419 admin admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:19.169452 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcd29fe-a34b-431b-981f-94051fd18419 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:40:19.169752 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcd29fe-a34b-431b-981f-94051fd18419 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:19.171403 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcd29fe-a34b-431b-981f-94051fd18419 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:19.184198 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3835/7703] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:40:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:40:19.188506 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f25701-a768-478f-ad5d-cd5446310b24 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:19.198393 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f25701-a768-478f-ad5d-cd5446310b24 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:19.203264 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8989f92b-032f-4a01-8fbe-fe6d53aca896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:19.203939 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8989f92b-032f-4a01-8fbe-fe6d53aca896 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:19.204361 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8989f92b-032f-4a01-8fbe-fe6d53aca896 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:19.204653 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8989f92b-032f-4a01-8fbe-fe6d53aca896 admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:19.205344 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8989f92b-032f-4a01-8fbe-fe6d53aca896 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:19.207432 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8989f92b-032f-4a01-8fbe-fe6d53aca896 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:19.239830 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3869/7704] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:40:19 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:40:19.241076 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcd29fe-a34b-431b-981f-94051fd18419 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:19.251424 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcd29fe-a34b-431b-981f-94051fd18419 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:19.308709 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51b97f4-0de6-4feb-a019-0b3d096ac73b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:19.309394 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51b97f4-0de6-4feb-a019-0b3d096ac73b admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:19.309713 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51b97f4-0de6-4feb-a019-0b3d096ac73b admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:19.310019 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51b97f4-0de6-4feb-a019-0b3d096ac73b admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:19.310714 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51b97f4-0de6-4feb-a019-0b3d096ac73b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:19.313022 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51b97f4-0de6-4feb-a019-0b3d096ac73b admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:19.330155 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8989f92b-032f-4a01-8fbe-fe6d53aca896 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:19.332051 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-8989f92b-032f-4a01-8fbe-fe6d53aca896 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:40:19.346075 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3836/7705] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:40:19 2022] POST /identity/v3/users => generated 287 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:40:19.347036 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51b97f4-0de6-4feb-a019-0b3d096ac73b admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:19.347817 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8989f92b-032f-4a01-8fbe-fe6d53aca896 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:19.353205 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5b78f8-4ab4-45c4-9ef6-a921941d7527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:19.354185 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5b78f8-4ab4-45c4-9ef6-a921941d7527 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:19.354465 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5b78f8-4ab4-45c4-9ef6-a921941d7527 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:19.354741 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5b78f8-4ab4-45c4-9ef6-a921941d7527 admin admin] PATH_INFO: `/v3/projects/ca9a5fa2957b4167b147afd02bf4b1ec` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:19.355971 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5b78f8-4ab4-45c4-9ef6-a921941d7527 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca9a5fa2957b4167b147afd02bf4b1ec)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:19.357933 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5b78f8-4ab4-45c4-9ef6-a921941d7527 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:19.358059 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51b97f4-0de6-4feb-a019-0b3d096ac73b admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:19.363626 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99602c9-b026-415a-ac9a-c4097851f173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:19.364283 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99602c9-b026-415a-ac9a-c4097851f173 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:19.364567 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99602c9-b026-415a-ac9a-c4097851f173 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:19.364843 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99602c9-b026-415a-ac9a-c4097851f173 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:19.366147 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99602c9-b026-415a-ac9a-c4097851f173 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:19.368160 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99602c9-b026-415a-ac9a-c4097851f173 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:19.379427 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3837/7706] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:40:19 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:40:19.383346 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99602c9-b026-415a-ac9a-c4097851f173 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:19.394351 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99602c9-b026-415a-ac9a-c4097851f173 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:19.399536 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:40:19.407616 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-dc5b78f8-4ab4-45c4-9ef6-a921941d7527 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca9a5fa2957b4167b147afd02bf4b1ec', 'request_id': 'req-dc5b78f8-4ab4-45c4-9ef6-a921941d7527'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:19.416916 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-dc5b78f8-4ab4-45c4-9ef6-a921941d7527 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca9a5fa2957b4167b147afd02bf4b1ec', 'request_id': 'req-dc5b78f8-4ab4-45c4-9ef6-a921941d7527'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:19.422656 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-dc5b78f8-4ab4-45c4-9ef6-a921941d7527 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca9a5fa2957b4167b147afd02bf4b1ec', 'request_id': 'req-dc5b78f8-4ab4-45c4-9ef6-a921941d7527'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:19.434746 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-dc5b78f8-4ab4-45c4-9ef6-a921941d7527 admin admin] The token cache is being invalidate because project ca9a5fa2957b4167b147afd02bf4b1ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:40:19.435034 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-dc5b78f8-4ab4-45c4-9ef6-a921941d7527 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:19.435849 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-dc5b78f8-4ab4-45c4-9ef6-a921941d7527 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:19.437615 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3870/7707] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:40:19 2022] DELETE /identity/v3/projects/ca9a5fa2957b4167b147afd02bf4b1ec => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:40:19.442281 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e92036-8f53-49e9-ad47-7211e514291c None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:19.442567 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e92036-8f53-49e9-ad47-7211e514291c None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:19.442842 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e92036-8f53-49e9-ad47-7211e514291c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:19.455386 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8590fa21-dfc9-469b-a542-fa83d9664c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:19.456070 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8590fa21-dfc9-469b-a542-fa83d9664c38 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:19.456342 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8590fa21-dfc9-469b-a542-fa83d9664c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:19.456614 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8590fa21-dfc9-469b-a542-fa83d9664c38 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:19.457339 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8590fa21-dfc9-469b-a542-fa83d9664c38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:19.458985 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8590fa21-dfc9-469b-a542-fa83d9664c38 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:19.460408 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-e5e92036-8f53-49e9-ad47-7211e514291c None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:40:19.462093 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-e5e92036-8f53-49e9-ad47-7211e514291c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:40:19.472838 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3838/7708] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:40:19 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 21:40:19.472995 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3871/7709] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:40:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:40:19.473888 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8590fa21-dfc9-469b-a542-fa83d9664c38 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:19.475623 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-8590fa21-dfc9-469b-a542-fa83d9664c38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:40:19.478258 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40281422-42d5-493e-979e-c3e5b847e85a None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:19.478549 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40281422-42d5-493e-979e-c3e5b847e85a None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:19.478855 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40281422-42d5-493e-979e-c3e5b847e85a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:19.489087 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8590fa21-dfc9-469b-a542-fa83d9664c38 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:19.494296 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e936c5b-2da1-486b-84fa-0168e96740de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:19.495186 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e936c5b-2da1-486b-84fa-0168e96740de admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:19.495460 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e936c5b-2da1-486b-84fa-0168e96740de admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:19.495731 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e936c5b-2da1-486b-84fa-0168e96740de admin admin] PATH_INFO: `/v3/projects/88bc6bc4c83a4a838b3948b568cefcd8/users/6f29264d5dec4a2cbd1bba58e247a17e/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:19.497627 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-40281422-42d5-493e-979e-c3e5b847e85a None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:40:19.498987 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-40281422-42d5-493e-979e-c3e5b847e85a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:40:19.507011 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3872/7710] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:40:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:40:19.511125 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40281422-42d5-493e-979e-c3e5b847e85a None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:19.512225 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e936c5b-2da1-486b-84fa-0168e96740de admin admin] RBAC: Authorizing `identity:create_grant(project_id=88bc6bc4c83a4a838b3948b568cefcd8, user_id=6f29264d5dec4a2cbd1bba58e247a17e, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:19.515052 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e936c5b-2da1-486b-84fa-0168e96740de admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:19.520442 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40281422-42d5-493e-979e-c3e5b847e85a None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:19.526295 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a976abf6-b645-413d-932c-06eee7a0900b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:19.526959 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a976abf6-b645-413d-932c-06eee7a0900b admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:19.527266 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a976abf6-b645-413d-932c-06eee7a0900b admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:19.527524 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a976abf6-b645-413d-932c-06eee7a0900b admin admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:19.528258 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a976abf6-b645-413d-932c-06eee7a0900b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:40:19.528567 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a976abf6-b645-413d-932c-06eee7a0900b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:19.529898 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3839/7711] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:40:19 2022] PUT /identity/v3/projects/88bc6bc4c83a4a838b3948b568cefcd8/users/6f29264d5dec4a2cbd1bba58e247a17e/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:40:19.530286 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a976abf6-b645-413d-932c-06eee7a0900b admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:19.540495 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24f9012-6077-4dd2-b1fc-3419e6f61abe None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:19.540495 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24f9012-6077-4dd2-b1fc-3419e6f61abe None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:19.540750 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24f9012-6077-4dd2-b1fc-3419e6f61abe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:19.543886 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3873/7712] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:40:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 21:40:19.548064 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a976abf6-b645-413d-932c-06eee7a0900b admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:19.558498 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a976abf6-b645-413d-932c-06eee7a0900b admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:19.568770 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-b24f9012-6077-4dd2-b1fc-3419e6f61abe None None] MFA Rules not processed for user `6f29264d5dec4a2cbd1bba58e247a17e`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:40:19.570073 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-b24f9012-6077-4dd2-b1fc-3419e6f61abe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:40:19.594771 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:40:19.618855 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d54fc39-ee96-48ed-827b-18191029c74c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:19.619538 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d54fc39-ee96-48ed-827b-18191029c74c admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:19.619816 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d54fc39-ee96-48ed-827b-18191029c74c admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:19.620090 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d54fc39-ee96-48ed-827b-18191029c74c admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:19.620786 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d54fc39-ee96-48ed-827b-18191029c74c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:19.622730 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d54fc39-ee96-48ed-827b-18191029c74c admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:19.640497 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3840/7713] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:40:19 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:40:19.645453 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24f9012-6077-4dd2-b1fc-3419e6f61abe None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:19.652952 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3874/7714] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:40:19 2022] POST /identity/v3/projects => generated 377 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:40:19.653878 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d54fc39-ee96-48ed-827b-18191029c74c admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:19.656051 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24f9012-6077-4dd2-b1fc-3419e6f61abe None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:19.713536 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241b965b-3f0f-4779-9d8e-bf2ccdba9fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:19.714243 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241b965b-3f0f-4779-9d8e-bf2ccdba9fe9 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:19.714534 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241b965b-3f0f-4779-9d8e-bf2ccdba9fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:19.714806 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241b965b-3f0f-4779-9d8e-bf2ccdba9fe9 admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:19.715517 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241b965b-3f0f-4779-9d8e-bf2ccdba9fe9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:19.715851 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d54fc39-ee96-48ed-827b-18191029c74c admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:19.717422 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241b965b-3f0f-4779-9d8e-bf2ccdba9fe9 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:19.720646 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afa0bf3-90f0-4f62-8b56-ea0197e8a959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:19.721315 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afa0bf3-90f0-4f62-8b56-ea0197e8a959 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:19.721594 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afa0bf3-90f0-4f62-8b56-ea0197e8a959 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:19.721891 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afa0bf3-90f0-4f62-8b56-ea0197e8a959 admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:19.722572 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afa0bf3-90f0-4f62-8b56-ea0197e8a959 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:19.724610 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afa0bf3-90f0-4f62-8b56-ea0197e8a959 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:19.745907 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3841/7715] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:40:19 2022] POST /identity/v3/projects => generated 371 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:40:19.748563 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3875/7716] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:40:19 2022] POST /identity/v3/users => generated 289 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:40:19.749507 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241b965b-3f0f-4779-9d8e-bf2ccdba9fe9 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:19.749719 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afa0bf3-90f0-4f62-8b56-ea0197e8a959 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:19.759510 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afa0bf3-90f0-4f62-8b56-ea0197e8a959 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:19.770995 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:40:19.822521 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241b965b-3f0f-4779-9d8e-bf2ccdba9fe9 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:19.823817 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87be2b5-451c-41f9-b8a2-fcc53c84428f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:19.824619 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87be2b5-451c-41f9-b8a2-fcc53c84428f admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:19.824914 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87be2b5-451c-41f9-b8a2-fcc53c84428f admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:19.825123 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87be2b5-451c-41f9-b8a2-fcc53c84428f admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:19.825884 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87be2b5-451c-41f9-b8a2-fcc53c84428f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:19.827931 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87be2b5-451c-41f9-b8a2-fcc53c84428f admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:19.828051 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1145a69c-64e3-445e-9c43-b7ea665973b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:19.828695 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1145a69c-64e3-445e-9c43-b7ea665973b7 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:19.828971 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1145a69c-64e3-445e-9c43-b7ea665973b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:19.829303 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1145a69c-64e3-445e-9c43-b7ea665973b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:19.830079 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1145a69c-64e3-445e-9c43-b7ea665973b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:19.831672 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1145a69c-64e3-445e-9c43-b7ea665973b7 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:19.843410 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3842/7717] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:40:19 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:40:19.847105 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1145a69c-64e3-445e-9c43-b7ea665973b7 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:19.849899 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3876/7718] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:40:19 2022] POST /identity/v3/users => generated 292 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:40:19.854966 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87be2b5-451c-41f9-b8a2-fcc53c84428f admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:19.857303 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1145a69c-64e3-445e-9c43-b7ea665973b7 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:19.861886 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f489e4-e4f2-4a84-b632-eef0218fabc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:19.862538 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f489e4-e4f2-4a84-b632-eef0218fabc5 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:19.862817 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f489e4-e4f2-4a84-b632-eef0218fabc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:19.863087 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f489e4-e4f2-4a84-b632-eef0218fabc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:19.863800 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f489e4-e4f2-4a84-b632-eef0218fabc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:19.864607 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87be2b5-451c-41f9-b8a2-fcc53c84428f admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:19.865481 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f489e4-e4f2-4a84-b632-eef0218fabc5 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:19.869398 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1a3a7c-23b2-4dd6-94d3-0af3131bfea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:19.870136 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1a3a7c-23b2-4dd6-94d3-0af3131bfea1 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:19.870419 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1a3a7c-23b2-4dd6-94d3-0af3131bfea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:19.870694 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1a3a7c-23b2-4dd6-94d3-0af3131bfea1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:19.871438 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1a3a7c-23b2-4dd6-94d3-0af3131bfea1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:19.873018 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1a3a7c-23b2-4dd6-94d3-0af3131bfea1 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:19.879235 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3843/7719] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:40:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 21:40:19.880368 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f489e4-e4f2-4a84-b632-eef0218fabc5 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:19.886269 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3877/7720] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:40:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 21:40:19.887860 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1a3a7c-23b2-4dd6-94d3-0af3131bfea1 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:19.890569 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f489e4-e4f2-4a84-b632-eef0218fabc5 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:19.895060 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841ba6f5-9553-47f2-b363-ccdef0e2b499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:19.895940 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841ba6f5-9553-47f2-b363-ccdef0e2b499 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:19.896219 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841ba6f5-9553-47f2-b363-ccdef0e2b499 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:19.896495 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841ba6f5-9553-47f2-b363-ccdef0e2b499 admin admin] PATH_INFO: `/v3/projects/04c1186c239b45919b2057d3ca6a8569/users/44efc734cb6e437495fa7c4997cc0c05/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:19.898002 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1a3a7c-23b2-4dd6-94d3-0af3131bfea1 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:19.902824 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b72ca4e-2046-4989-84c5-2a71e1d55d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:19.903702 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b72ca4e-2046-4989-84c5-2a71e1d55d52 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:19.903983 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b72ca4e-2046-4989-84c5-2a71e1d55d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:19.904255 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b72ca4e-2046-4989-84c5-2a71e1d55d52 admin admin] PATH_INFO: `/v3/projects/1c860ff8ad51431aa9d514f83ec9d91d/users/991f747923a74a93adcc4060cf071420/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:19.911499 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841ba6f5-9553-47f2-b363-ccdef0e2b499 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04c1186c239b45919b2057d3ca6a8569, user_id=44efc734cb6e437495fa7c4997cc0c05, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:19.914299 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841ba6f5-9553-47f2-b363-ccdef0e2b499 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:19.920482 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b72ca4e-2046-4989-84c5-2a71e1d55d52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c860ff8ad51431aa9d514f83ec9d91d, user_id=991f747923a74a93adcc4060cf071420, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:19.923318 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b72ca4e-2046-4989-84c5-2a71e1d55d52 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:19.930571 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3844/7721] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:40:19 2022] PUT /identity/v3/projects/04c1186c239b45919b2057d3ca6a8569/users/44efc734cb6e437495fa7c4997cc0c05/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:40:19.937901 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3878/7722] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:40:19 2022] PUT /identity/v3/projects/1c860ff8ad51431aa9d514f83ec9d91d/users/991f747923a74a93adcc4060cf071420/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:40:19.941499 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7357a99b-cc90-4e3a-9300-983fc9c41c27 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:19.941631 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b72ca4e-2046-4989-84c5-2a71e1d55d52 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:19.942052 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7357a99b-cc90-4e3a-9300-983fc9c41c27 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:19.942407 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7357a99b-cc90-4e3a-9300-983fc9c41c27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:19.961895 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:40:19.971155 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-7357a99b-cc90-4e3a-9300-983fc9c41c27 None None] MFA Rules not processed for user `44efc734cb6e437495fa7c4997cc0c05`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:40:19.972749 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-7357a99b-cc90-4e3a-9300-983fc9c41c27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:40:20.004108 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b72ca4e-2046-4989-84c5-2a71e1d55d52 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:20.009008 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6118dec1-ffde-4507-bdb9-083778c96d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:20.009687 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6118dec1-ffde-4507-bdb9-083778c96d5b admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:20.010001 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6118dec1-ffde-4507-bdb9-083778c96d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:20.010273 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6118dec1-ffde-4507-bdb9-083778c96d5b admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:20.010993 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6118dec1-ffde-4507-bdb9-083778c96d5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:20.012600 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6118dec1-ffde-4507-bdb9-083778c96d5b admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:20.025903 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3879/7723] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:40:19 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 21:40:20.028769 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6118dec1-ffde-4507-bdb9-083778c96d5b admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:20.040179 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6118dec1-ffde-4507-bdb9-083778c96d5b admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:20.045349 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b83ad5c-0dad-4a97-8393-7c358b742b6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:20.046280 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b83ad5c-0dad-4a97-8393-7c358b742b6a admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:20.046559 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b83ad5c-0dad-4a97-8393-7c358b742b6a admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:20.047066 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b83ad5c-0dad-4a97-8393-7c358b742b6a admin admin] PATH_INFO: `/v3/projects/1c860ff8ad51431aa9d514f83ec9d91d/users/991f747923a74a93adcc4060cf071420/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:20.049482 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b83ad5c-0dad-4a97-8393-7c358b742b6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c860ff8ad51431aa9d514f83ec9d91d, user_id=991f747923a74a93adcc4060cf071420, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:20.051934 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3845/7724] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:40:19 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:40:20.052156 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b83ad5c-0dad-4a97-8393-7c358b742b6a admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:20.056353 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7357a99b-cc90-4e3a-9300-983fc9c41c27 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:20.063184 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3880/7725] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:40:20 2022] PUT /identity/v3/projects/1c860ff8ad51431aa9d514f83ec9d91d/users/991f747923a74a93adcc4060cf071420/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:40:20.069538 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7357a99b-cc90-4e3a-9300-983fc9c41c27 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:20.073333 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4003a7a-57bf-40f7-8b64-19fc5ec6c5e7 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:20.073651 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4003a7a-57bf-40f7-8b64-19fc5ec6c5e7 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:20.073964 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4003a7a-57bf-40f7-8b64-19fc5ec6c5e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:20.101627 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-a4003a7a-57bf-40f7-8b64-19fc5ec6c5e7 None None] MFA Rules not processed for user `991f747923a74a93adcc4060cf071420`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:40:20.102869 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-a4003a7a-57bf-40f7-8b64-19fc5ec6c5e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:40:20.125485 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c959d77-ba1c-41d0-b02a-f760d86757df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:20.126198 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c959d77-ba1c-41d0-b02a-f760d86757df admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:20.126474 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c959d77-ba1c-41d0-b02a-f760d86757df admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:20.126744 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c959d77-ba1c-41d0-b02a-f760d86757df admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:20.127422 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c959d77-ba1c-41d0-b02a-f760d86757df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:20.129345 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c959d77-ba1c-41d0-b02a-f760d86757df admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:20.147328 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:40:20.157225 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3846/7726] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:40:20 2022] POST /identity/v3/projects => generated 377 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:40:20.161431 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c959d77-ba1c-41d0-b02a-f760d86757df admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:20.177060 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3881/7727] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:40:20 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:40:20.189928 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4003a7a-57bf-40f7-8b64-19fc5ec6c5e7 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:20.191530 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-a4003a7a-57bf-40f7-8b64-19fc5ec6c5e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:40:20.225544 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c959d77-ba1c-41d0-b02a-f760d86757df admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:20.230891 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ef4f6d-0d65-4ea7-ad82-257947e1def1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:20.231557 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ef4f6d-0d65-4ea7-ad82-257947e1def1 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:20.231836 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ef4f6d-0d65-4ea7-ad82-257947e1def1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:20.232111 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ef4f6d-0d65-4ea7-ad82-257947e1def1 admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:20.232798 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ef4f6d-0d65-4ea7-ad82-257947e1def1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:20.234789 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ef4f6d-0d65-4ea7-ad82-257947e1def1 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:20.251905 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4003a7a-57bf-40f7-8b64-19fc5ec6c5e7 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:20.254669 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3847/7728] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:40:20 2022] POST /identity/v3/users => generated 289 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:40:20.258606 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ef4f6d-0d65-4ea7-ad82-257947e1def1 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:20.268688 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ef4f6d-0d65-4ea7-ad82-257947e1def1 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:20.274651 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d597c2c-b172-4825-903b-fa3cab1a500b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:20.275315 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d597c2c-b172-4825-903b-fa3cab1a500b admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:20.275600 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d597c2c-b172-4825-903b-fa3cab1a500b admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:20.275876 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d597c2c-b172-4825-903b-fa3cab1a500b admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:20.276605 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d597c2c-b172-4825-903b-fa3cab1a500b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:20.278256 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d597c2c-b172-4825-903b-fa3cab1a500b admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:20.291560 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3848/7729] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:40:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 21:40:20.293025 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d597c2c-b172-4825-903b-fa3cab1a500b admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:20.299761 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:40:20.302047 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d97b529-946f-4b46-aa44-1e29ebad768c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec5fd3a489c341b7964704d689037f05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:20.302716 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d97b529-946f-4b46-aa44-1e29ebad768c service cinder] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:20.303023 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d97b529-946f-4b46-aa44-1e29ebad768c service cinder] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:20.303296 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d97b529-946f-4b46-aa44-1e29ebad768c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:20.303794 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d597c2c-b172-4825-903b-fa3cab1a500b admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:20.310115 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8c9402-0cb3-47d3-a29f-9a9d8cb65bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:20.310776 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8c9402-0cb3-47d3-a29f-9a9d8cb65bd0 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:20.311059 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8c9402-0cb3-47d3-a29f-9a9d8cb65bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:20.311339 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8c9402-0cb3-47d3-a29f-9a9d8cb65bd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:20.312091 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8c9402-0cb3-47d3-a29f-9a9d8cb65bd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:20.313697 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8c9402-0cb3-47d3-a29f-9a9d8cb65bd0 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:20.328006 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3849/7730] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:40:20 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:40:20.329065 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8c9402-0cb3-47d3-a29f-9a9d8cb65bd0 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:20.339197 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8c9402-0cb3-47d3-a29f-9a9d8cb65bd0 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:20.345136 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8f996c-b58a-4e3c-9d51-4927f909a42b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:20.346075 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8f996c-b58a-4e3c-9d51-4927f909a42b admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:20.346357 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8f996c-b58a-4e3c-9d51-4927f909a42b admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:20.346671 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8f996c-b58a-4e3c-9d51-4927f909a42b admin admin] PATH_INFO: `/v3/projects/e3e2f8b474694a5b92c8499049a66313/users/fc92903bc92a475e9f00d434ae50d35c/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:20.363729 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8f996c-b58a-4e3c-9d51-4927f909a42b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3e2f8b474694a5b92c8499049a66313, user_id=fc92903bc92a475e9f00d434ae50d35c, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:20.366504 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8f996c-b58a-4e3c-9d51-4927f909a42b admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:20.369723 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d97b529-946f-4b46-aa44-1e29ebad768c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:20.371166 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d97b529-946f-4b46-aa44-1e29ebad768c service cinder] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:20.381221 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3850/7732] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:40:20 2022] PUT /identity/v3/projects/e3e2f8b474694a5b92c8499049a66313/users/fc92903bc92a475e9f00d434ae50d35c/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:40:20.381374 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3882/7732] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:40:20 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:40:20.392661 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38396606-2809-4689-ab86-15990ae61634 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:20.392941 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38396606-2809-4689-ab86-15990ae61634 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:20.393248 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38396606-2809-4689-ab86-15990ae61634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:20.421432 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-38396606-2809-4689-ab86-15990ae61634 None None] MFA Rules not processed for user `fc92903bc92a475e9f00d434ae50d35c`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:40:20.423199 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-38396606-2809-4689-ab86-15990ae61634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:40:20.500999 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3851/7733] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:40:20 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:40:20.507886 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d97b529-946f-4b46-aa44-1e29ebad768c service cinder] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:20.516093 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d97b529-946f-4b46-aa44-1e29ebad768c service cinder] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:20.560778 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:40:20.579459 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38930601-8cc4-49bf-a2c8-e27553dd5050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:20.580140 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38930601-8cc4-49bf-a2c8-e27553dd5050 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:20.580496 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38930601-8cc4-49bf-a2c8-e27553dd5050 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:20.580776 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38930601-8cc4-49bf-a2c8-e27553dd5050 admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:20.581516 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38930601-8cc4-49bf-a2c8-e27553dd5050 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:20.583474 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38930601-8cc4-49bf-a2c8-e27553dd5050 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:20.612641 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3883/7734] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:40:20 2022] POST /identity/v3/projects => generated 377 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:40:20.616800 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38396606-2809-4689-ab86-15990ae61634 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:20.628181 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38396606-2809-4689-ab86-15990ae61634 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:20.690720 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770e80ac-c6b3-4b15-8079-6a10ee98f783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:20.691416 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770e80ac-c6b3-4b15-8079-6a10ee98f783 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:20.691700 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770e80ac-c6b3-4b15-8079-6a10ee98f783 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:20.691975 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770e80ac-c6b3-4b15-8079-6a10ee98f783 admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:20.692849 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770e80ac-c6b3-4b15-8079-6a10ee98f783 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:20.695670 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770e80ac-c6b3-4b15-8079-6a10ee98f783 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:20.719964 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3852/7735] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:40:20 2022] POST /identity/v3/users => generated 295 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:40:20.723986 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38930601-8cc4-49bf-a2c8-e27553dd5050 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:20.735163 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38930601-8cc4-49bf-a2c8-e27553dd5050 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:20.741709 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659dc041-c446-47d5-854f-a07a41aec7b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:20.742900 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659dc041-c446-47d5-854f-a07a41aec7b3 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:20.743303 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659dc041-c446-47d5-854f-a07a41aec7b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:20.743652 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659dc041-c446-47d5-854f-a07a41aec7b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:20.744339 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659dc041-c446-47d5-854f-a07a41aec7b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:20.746181 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659dc041-c446-47d5-854f-a07a41aec7b3 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:20.758815 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3884/7736] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:40:20 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:40:20.763328 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770e80ac-c6b3-4b15-8079-6a10ee98f783 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:20.772980 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659dc041-c446-47d5-854f-a07a41aec7b3 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:20.776971 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770e80ac-c6b3-4b15-8079-6a10ee98f783 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:20.781994 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6c8e13-c3f1-43a4-bd65-90abf5f8c78f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:20.782972 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6c8e13-c3f1-43a4-bd65-90abf5f8c78f admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:20.783321 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6c8e13-c3f1-43a4-bd65-90abf5f8c78f admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:20.783621 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659dc041-c446-47d5-854f-a07a41aec7b3 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:20.783726 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6c8e13-c3f1-43a4-bd65-90abf5f8c78f admin admin] PATH_INFO: `/v3/projects/b151e66baa5649e594951d82f148cb8e/users/f75ebbd555274c26ad9c21742ff31d9a/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:20.788430 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a54758-1a46-4a49-835c-832ca16c1764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:20.789330 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a54758-1a46-4a49-835c-832ca16c1764 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:20.789637 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a54758-1a46-4a49-835c-832ca16c1764 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:20.789934 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a54758-1a46-4a49-835c-832ca16c1764 admin admin] PATH_INFO: `/v3/users/6f29264d5dec4a2cbd1bba58e247a17e` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:20.791361 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a54758-1a46-4a49-835c-832ca16c1764 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f29264d5dec4a2cbd1bba58e247a17e)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:20.793925 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a54758-1a46-4a49-835c-832ca16c1764 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:20.800901 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6c8e13-c3f1-43a4-bd65-90abf5f8c78f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b151e66baa5649e594951d82f148cb8e, user_id=f75ebbd555274c26ad9c21742ff31d9a, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:20.803635 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6c8e13-c3f1-43a4-bd65-90abf5f8c78f admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:20.820399 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3853/7737] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:40:20 2022] PUT /identity/v3/projects/b151e66baa5649e594951d82f148cb8e/users/f75ebbd555274c26ad9c21742ff31d9a/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:40:20.826421 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6c8e13-c3f1-43a4-bd65-90abf5f8c78f admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:20.854889 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-e0a54758-1a46-4a49-835c-832ca16c1764 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f29264d5dec4a2cbd1bba58e247a17e'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:20.855621 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-e0a54758-1a46-4a49-835c-832ca16c1764 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f29264d5dec4a2cbd1bba58e247a17e'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:20.859776 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:40:20.864046 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-e0a54758-1a46-4a49-835c-832ca16c1764 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f29264d5dec4a2cbd1bba58e247a17e'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:20.873071 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-e0a54758-1a46-4a49-835c-832ca16c1764 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f29264d5dec4a2cbd1bba58e247a17e'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:20.885536 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-e0a54758-1a46-4a49-835c-832ca16c1764 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f29264d5dec4a2cbd1bba58e247a17e'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:20.892219 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3885/7738] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:40:20 2022] DELETE /identity/v3/users/6f29264d5dec4a2cbd1bba58e247a17e => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:40:20.897604 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cd8fd5-89c0-4131-87fc-07918f0f1b06 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:20.897907 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cd8fd5-89c0-4131-87fc-07918f0f1b06 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:20.898235 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cd8fd5-89c0-4131-87fc-07918f0f1b06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:20.899220 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6c8e13-c3f1-43a4-bd65-90abf5f8c78f admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:20.916157 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-30cd8fd5-89c0-4131-87fc-07918f0f1b06 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:40:20.917295 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-30cd8fd5-89c0-4131-87fc-07918f0f1b06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:40:20.956884 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a56f063-4150-4103-8cb7-fa8d6e8da405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:20.957584 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a56f063-4150-4103-8cb7-fa8d6e8da405 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:20.957895 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a56f063-4150-4103-8cb7-fa8d6e8da405 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:20.958173 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a56f063-4150-4103-8cb7-fa8d6e8da405 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:20.958903 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a56f063-4150-4103-8cb7-fa8d6e8da405 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:20.960568 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a56f063-4150-4103-8cb7-fa8d6e8da405 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:20.971393 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3854/7739] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:40:20 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:40:20.975592 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a56f063-4150-4103-8cb7-fa8d6e8da405 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:20.977257 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-3a56f063-4150-4103-8cb7-fa8d6e8da405 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:40:20.982385 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3886/7740] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:40:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:40:20.990424 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a56f063-4150-4103-8cb7-fa8d6e8da405 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:20.993030 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cd8fd5-89c0-4131-87fc-07918f0f1b06 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:20.994413 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-30cd8fd5-89c0-4131-87fc-07918f0f1b06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:40:20.995438 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15cb9b6-88be-4115-9d5c-7d96f31ec19f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:20.996342 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15cb9b6-88be-4115-9d5c-7d96f31ec19f admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:20.996659 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15cb9b6-88be-4115-9d5c-7d96f31ec19f admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:20.997071 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15cb9b6-88be-4115-9d5c-7d96f31ec19f admin admin] PATH_INFO: `/v3/projects/b151e66baa5649e594951d82f148cb8e/users/f75ebbd555274c26ad9c21742ff31d9a/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:20.999102 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15cb9b6-88be-4115-9d5c-7d96f31ec19f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b151e66baa5649e594951d82f148cb8e, user_id=f75ebbd555274c26ad9c21742ff31d9a, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:21.001759 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15cb9b6-88be-4115-9d5c-7d96f31ec19f admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:21.014752 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3855/7741] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:40:20 2022] PUT /identity/v3/projects/b151e66baa5649e594951d82f148cb8e/users/f75ebbd555274c26ad9c21742ff31d9a/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:40:21.028141 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17e5210-d4e6-48d5-a27f-45f9eddcc1fa None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:21.028486 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17e5210-d4e6-48d5-a27f-45f9eddcc1fa None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:21.028720 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17e5210-d4e6-48d5-a27f-45f9eddcc1fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:21.029990 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:40:21.060726 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-d17e5210-d4e6-48d5-a27f-45f9eddcc1fa None None] MFA Rules not processed for user `f75ebbd555274c26ad9c21742ff31d9a`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:40:21.063157 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-d17e5210-d4e6-48d5-a27f-45f9eddcc1fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:40:21.066371 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cd8fd5-89c0-4131-87fc-07918f0f1b06 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:21.124108 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398eabfc-a882-4744-a144-29ffd6d23582 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:21.124783 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398eabfc-a882-4744-a144-29ffd6d23582 service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:21.125059 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398eabfc-a882-4744-a144-29ffd6d23582 service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:21.125328 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398eabfc-a882-4744-a144-29ffd6d23582 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:21.139919 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3856/7742] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:40:21 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:40:21.152271 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17e5210-d4e6-48d5-a27f-45f9eddcc1fa None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:21.154389 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-d17e5210-d4e6-48d5-a27f-45f9eddcc1fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:40:21.191758 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398eabfc-a882-4744-a144-29ffd6d23582 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:21.193278 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398eabfc-a882-4744-a144-29ffd6d23582 service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:21.199738 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:40:21.203760 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3887/7743] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:40:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:40:21.222886 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17e5210-d4e6-48d5-a27f-45f9eddcc1fa None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:21.226933 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe73a3f7-05f2-45e0-b1f2-5cb6bfadc872 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec5fd3a489c341b7964704d689037f05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:21.227662 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe73a3f7-05f2-45e0-b1f2-5cb6bfadc872 service cinder] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:21.228034 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe73a3f7-05f2-45e0-b1f2-5cb6bfadc872 service cinder] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:21.228370 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe73a3f7-05f2-45e0-b1f2-5cb6bfadc872 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:21.230395 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-fe73a3f7-05f2-45e0-b1f2-5cb6bfadc872 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:40:21.289737 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe73a3f7-05f2-45e0-b1f2-5cb6bfadc872 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:21.291226 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe73a3f7-05f2-45e0-b1f2-5cb6bfadc872 service cinder] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:21.300615 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3857/7744] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:40:21 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:40:21.488546 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398eabfc-a882-4744-a144-29ffd6d23582 service neutron] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:21.490108 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-398eabfc-a882-4744-a144-29ffd6d23582 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:40:21.503694 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398eabfc-a882-4744-a144-29ffd6d23582 service neutron] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:21.510051 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d0e230-f4cc-45d6-8418-4743532f2b5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:21.511119 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d0e230-f4cc-45d6-8418-4743532f2b5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:21.511423 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d0e230-f4cc-45d6-8418-4743532f2b5d admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:21.511700 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d0e230-f4cc-45d6-8418-4743532f2b5d admin admin] PATH_INFO: `/v3/projects/88bc6bc4c83a4a838b3948b568cefcd8` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:21.513251 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d0e230-f4cc-45d6-8418-4743532f2b5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=88bc6bc4c83a4a838b3948b568cefcd8)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:21.515378 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d0e230-f4cc-45d6-8418-4743532f2b5d admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:21.567460 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c8d0e230-f4cc-45d6-8418-4743532f2b5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88bc6bc4c83a4a838b3948b568cefcd8', 'request_id': 'req-c8d0e230-f4cc-45d6-8418-4743532f2b5d'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:21.576885 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c8d0e230-f4cc-45d6-8418-4743532f2b5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88bc6bc4c83a4a838b3948b568cefcd8', 'request_id': 'req-c8d0e230-f4cc-45d6-8418-4743532f2b5d'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:21.583010 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c8d0e230-f4cc-45d6-8418-4743532f2b5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88bc6bc4c83a4a838b3948b568cefcd8', 'request_id': 'req-c8d0e230-f4cc-45d6-8418-4743532f2b5d'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:21.596914 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c8d0e230-f4cc-45d6-8418-4743532f2b5d admin admin] The token cache is being invalidate because project 88bc6bc4c83a4a838b3948b568cefcd8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:40:21.597356 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c8d0e230-f4cc-45d6-8418-4743532f2b5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:21.598159 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c8d0e230-f4cc-45d6-8418-4743532f2b5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:21.600156 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3888/7745] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:40:21 2022] DELETE /identity/v3/projects/88bc6bc4c83a4a838b3948b568cefcd8 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:40:21.604210 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe73a3f7-05f2-45e0-b1f2-5cb6bfadc872 service cinder] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:21.616354 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe73a3f7-05f2-45e0-b1f2-5cb6bfadc872 service cinder] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:21.677900 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11390f20-0f18-46ce-b33f-cabfd9e17e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:21.678813 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11390f20-0f18-46ce-b33f-cabfd9e17e6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:21.679089 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11390f20-0f18-46ce-b33f-cabfd9e17e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:21.679360 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11390f20-0f18-46ce-b33f-cabfd9e17e6d admin admin] PATH_INFO: `/v3/users/991f747923a74a93adcc4060cf071420` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:21.680550 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11390f20-0f18-46ce-b33f-cabfd9e17e6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=991f747923a74a93adcc4060cf071420)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:21.682527 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11390f20-0f18-46ce-b33f-cabfd9e17e6d admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:21.732004 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-11390f20-0f18-46ce-b33f-cabfd9e17e6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '991f747923a74a93adcc4060cf071420'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:21.738745 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-11390f20-0f18-46ce-b33f-cabfd9e17e6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '991f747923a74a93adcc4060cf071420'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:21.739436 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-11390f20-0f18-46ce-b33f-cabfd9e17e6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '991f747923a74a93adcc4060cf071420'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:21.746622 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-11390f20-0f18-46ce-b33f-cabfd9e17e6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '991f747923a74a93adcc4060cf071420'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:21.758226 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-11390f20-0f18-46ce-b33f-cabfd9e17e6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '991f747923a74a93adcc4060cf071420'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:21.764129 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3858/7746] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:40:21 2022] DELETE /identity/v3/users/991f747923a74a93adcc4060cf071420 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:40:22.045548 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d0e230-f4cc-45d6-8418-4743532f2b5d admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:22.047031 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-c8d0e230-f4cc-45d6-8418-4743532f2b5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:40:22.061141 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d0e230-f4cc-45d6-8418-4743532f2b5d admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:22.081691 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:40:22.126074 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0ba2db-9c0f-407f-9371-50786b6d3364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:22.127010 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0ba2db-9c0f-407f-9371-50786b6d3364 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:22.127258 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0ba2db-9c0f-407f-9371-50786b6d3364 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:22.127567 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0ba2db-9c0f-407f-9371-50786b6d3364 admin admin] PATH_INFO: `/v3/projects/1c860ff8ad51431aa9d514f83ec9d91d` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:22.128762 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0ba2db-9c0f-407f-9371-50786b6d3364 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c860ff8ad51431aa9d514f83ec9d91d)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:22.130749 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0ba2db-9c0f-407f-9371-50786b6d3364 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:22.179058 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-0b0ba2db-9c0f-407f-9371-50786b6d3364 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c860ff8ad51431aa9d514f83ec9d91d', 'request_id': 'req-0b0ba2db-9c0f-407f-9371-50786b6d3364'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:22.187646 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-0b0ba2db-9c0f-407f-9371-50786b6d3364 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c860ff8ad51431aa9d514f83ec9d91d', 'request_id': 'req-0b0ba2db-9c0f-407f-9371-50786b6d3364'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:22.193355 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-0b0ba2db-9c0f-407f-9371-50786b6d3364 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c860ff8ad51431aa9d514f83ec9d91d', 'request_id': 'req-0b0ba2db-9c0f-407f-9371-50786b6d3364'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:22.204662 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-0b0ba2db-9c0f-407f-9371-50786b6d3364 admin admin] The token cache is being invalidate because project 1c860ff8ad51431aa9d514f83ec9d91d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:40:22.204963 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-0b0ba2db-9c0f-407f-9371-50786b6d3364 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:22.205613 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-0b0ba2db-9c0f-407f-9371-50786b6d3364 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:22.207295 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3889/7747] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:40:22 2022] DELETE /identity/v3/projects/1c860ff8ad51431aa9d514f83ec9d91d => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:40:22.212720 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14999588-7ee2-4059-ab31-82cff2284cfe None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:22.213215 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14999588-7ee2-4059-ab31-82cff2284cfe None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:22.213330 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14999588-7ee2-4059-ab31-82cff2284cfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:22.231759 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-14999588-7ee2-4059-ab31-82cff2284cfe None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:40:22.232969 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-14999588-7ee2-4059-ab31-82cff2284cfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:40:22.242221 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:40:22.301300 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3859/7748] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:40:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:40:22.313655 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b299779-5c6e-489a-a7ce-49e168172656 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:22.314105 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b299779-5c6e-489a-a7ce-49e168172656 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:22.314445 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b299779-5c6e-489a-a7ce-49e168172656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:22.337387 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-8b299779-5c6e-489a-a7ce-49e168172656 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:40:22.338652 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-8b299779-5c6e-489a-a7ce-49e168172656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:40:22.348369 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3890/7749] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:40:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:40:22.353507 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14999588-7ee2-4059-ab31-82cff2284cfe None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:22.364453 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14999588-7ee2-4059-ab31-82cff2284cfe None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:22.370102 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ed6782-1cb3-4ca8-bfa4-c4ce1757b8e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:22.370765 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ed6782-1cb3-4ca8-bfa4-c4ce1757b8e2 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:22.371060 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ed6782-1cb3-4ca8-bfa4-c4ce1757b8e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:22.371312 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ed6782-1cb3-4ca8-bfa4-c4ce1757b8e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:22.372038 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ed6782-1cb3-4ca8-bfa4-c4ce1757b8e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:40:22.372358 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ed6782-1cb3-4ca8-bfa4-c4ce1757b8e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:22.373993 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ed6782-1cb3-4ca8-bfa4-c4ce1757b8e2 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:22.386328 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3860/7750] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:40:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 21:40:22.390941 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b299779-5c6e-489a-a7ce-49e168172656 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:22.400739 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b299779-5c6e-489a-a7ce-49e168172656 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:22.406749 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf65753-ae7d-430b-9b76-a69cbddf3957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:22.407394 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf65753-ae7d-430b-9b76-a69cbddf3957 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:22.407671 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf65753-ae7d-430b-9b76-a69cbddf3957 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:22.407947 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf65753-ae7d-430b-9b76-a69cbddf3957 admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:22.408643 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf65753-ae7d-430b-9b76-a69cbddf3957 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:22.410559 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf65753-ae7d-430b-9b76-a69cbddf3957 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:22.438663 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3891/7751] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:40:22 2022] POST /identity/v3/projects => generated 355 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:40:22.442893 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ed6782-1cb3-4ca8-bfa4-c4ce1757b8e2 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:22.453772 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ed6782-1cb3-4ca8-bfa4-c4ce1757b8e2 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:22.512743 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141b0054-04e2-4ecb-a2fa-0d8d4182ee4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:22.513414 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141b0054-04e2-4ecb-a2fa-0d8d4182ee4c admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:22.513695 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141b0054-04e2-4ecb-a2fa-0d8d4182ee4c admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:22.514004 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141b0054-04e2-4ecb-a2fa-0d8d4182ee4c admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:22.514693 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141b0054-04e2-4ecb-a2fa-0d8d4182ee4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:22.516649 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141b0054-04e2-4ecb-a2fa-0d8d4182ee4c admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:22.539098 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3861/7752] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:40:22 2022] POST /identity/v3/users => generated 278 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:40:22.543382 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf65753-ae7d-430b-9b76-a69cbddf3957 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:22.554147 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf65753-ae7d-430b-9b76-a69cbddf3957 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:22.559355 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d344eb87-9c8f-47ea-a250-17e8005e85d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:22.560021 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d344eb87-9c8f-47ea-a250-17e8005e85d5 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:22.560313 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d344eb87-9c8f-47ea-a250-17e8005e85d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:22.560581 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d344eb87-9c8f-47ea-a250-17e8005e85d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:22.561348 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d344eb87-9c8f-47ea-a250-17e8005e85d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:22.563022 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d344eb87-9c8f-47ea-a250-17e8005e85d5 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:22.573665 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3892/7753] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:40:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:40:22.577793 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141b0054-04e2-4ecb-a2fa-0d8d4182ee4c admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:22.588825 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141b0054-04e2-4ecb-a2fa-0d8d4182ee4c admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:22.594520 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89047a41-3cb0-4130-8d37-d50ae7fa1058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:22.595188 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89047a41-3cb0-4130-8d37-d50ae7fa1058 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:22.595439 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89047a41-3cb0-4130-8d37-d50ae7fa1058 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:22.595712 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89047a41-3cb0-4130-8d37-d50ae7fa1058 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:22.596472 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89047a41-3cb0-4130-8d37-d50ae7fa1058 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:22.598115 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89047a41-3cb0-4130-8d37-d50ae7fa1058 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:22.608486 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3862/7754] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:40:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:40:22.612789 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d344eb87-9c8f-47ea-a250-17e8005e85d5 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:22.623810 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d344eb87-9c8f-47ea-a250-17e8005e85d5 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:22.628779 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf18dee-b0a0-40e8-8efb-79c87205ab26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:22.629680 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf18dee-b0a0-40e8-8efb-79c87205ab26 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:22.629985 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf18dee-b0a0-40e8-8efb-79c87205ab26 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:22.630279 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf18dee-b0a0-40e8-8efb-79c87205ab26 admin admin] PATH_INFO: `/v3/projects/477a77882a2c4289a3123427f2eadc86/users/9300fdb6b7714eb89df502033136faff/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:22.645454 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf18dee-b0a0-40e8-8efb-79c87205ab26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=477a77882a2c4289a3123427f2eadc86, user_id=9300fdb6b7714eb89df502033136faff, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:22.648306 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf18dee-b0a0-40e8-8efb-79c87205ab26 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:22.662388 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3893/7755] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:40:22 2022] PUT /identity/v3/projects/477a77882a2c4289a3123427f2eadc86/users/9300fdb6b7714eb89df502033136faff/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:40:22.672705 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82abec5c-b550-470c-9de2-d35823392877 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:22.673179 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82abec5c-b550-470c-9de2-d35823392877 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:22.673459 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82abec5c-b550-470c-9de2-d35823392877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:22.701126 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-82abec5c-b550-470c-9de2-d35823392877 None None] MFA Rules not processed for user `9300fdb6b7714eb89df502033136faff`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:40:22.702467 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-82abec5c-b550-470c-9de2-d35823392877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:40:22.767444 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3863/7756] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:40:22 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:40:22.771948 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf18dee-b0a0-40e8-8efb-79c87205ab26 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:22.832017 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:40:22.848733 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf18dee-b0a0-40e8-8efb-79c87205ab26 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:22.854573 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb46202-0471-4646-8c45-cf740371e05b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:22.855229 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb46202-0471-4646-8c45-cf740371e05b admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:22.855509 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb46202-0471-4646-8c45-cf740371e05b admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:22.855784 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb46202-0471-4646-8c45-cf740371e05b admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:22.856473 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb46202-0471-4646-8c45-cf740371e05b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:22.858421 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb46202-0471-4646-8c45-cf740371e05b admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:22.910807 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3894/7757] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:40:22 2022] POST /identity/v3/projects => generated 357 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:40:22.911620 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82abec5c-b550-470c-9de2-d35823392877 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:22.927147 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82abec5c-b550-470c-9de2-d35823392877 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:22.933019 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:40:22.990338 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1814674-63af-4590-b097-1ddb9e31cdbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:22.991048 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1814674-63af-4590-b097-1ddb9e31cdbf admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:22.991324 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1814674-63af-4590-b097-1ddb9e31cdbf admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:22.991596 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1814674-63af-4590-b097-1ddb9e31cdbf admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:22.992285 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1814674-63af-4590-b097-1ddb9e31cdbf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:22.994232 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1814674-63af-4590-b097-1ddb9e31cdbf admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:23.014864 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3864/7758] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:40:22 2022] POST /identity/v3/users => generated 285 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:40:23.018980 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb46202-0471-4646-8c45-cf740371e05b admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:23.029363 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb46202-0471-4646-8c45-cf740371e05b admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:23.034354 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec1462c-a338-447e-b7f8-3f1817fb300c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:23.035012 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec1462c-a338-447e-b7f8-3f1817fb300c admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:23.035287 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec1462c-a338-447e-b7f8-3f1817fb300c admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:23.035560 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec1462c-a338-447e-b7f8-3f1817fb300c admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:23.036283 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec1462c-a338-447e-b7f8-3f1817fb300c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:23.038014 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec1462c-a338-447e-b7f8-3f1817fb300c admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:23.050879 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3895/7759] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:40:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:40:23.055430 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1814674-63af-4590-b097-1ddb9e31cdbf admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:23.065837 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1814674-63af-4590-b097-1ddb9e31cdbf admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:23.070763 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5972aa-0075-4c39-b99d-7714f75fdd5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:23.071647 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5972aa-0075-4c39-b99d-7714f75fdd5c admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:23.071924 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5972aa-0075-4c39-b99d-7714f75fdd5c admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:23.072197 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5972aa-0075-4c39-b99d-7714f75fdd5c admin admin] PATH_INFO: `/v3/projects/fcb4a7dda2dc40b1b1e1cf58cfc60be5/users/777100d36a864451b7453054f077f486/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:23.087335 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5972aa-0075-4c39-b99d-7714f75fdd5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcb4a7dda2dc40b1b1e1cf58cfc60be5, user_id=777100d36a864451b7453054f077f486, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:23.090027 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5972aa-0075-4c39-b99d-7714f75fdd5c admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:23.105718 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3865/7760] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:40:23 2022] PUT /identity/v3/projects/fcb4a7dda2dc40b1b1e1cf58cfc60be5/users/777100d36a864451b7453054f077f486/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:40:23.110009 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec1462c-a338-447e-b7f8-3f1817fb300c admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:23.120712 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec1462c-a338-447e-b7f8-3f1817fb300c admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:23.181400 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3d6b55-d4e7-4246-bb71-50b22ebf4d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:23.182104 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3d6b55-d4e7-4246-bb71-50b22ebf4d6e admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:23.182382 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3d6b55-d4e7-4246-bb71-50b22ebf4d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:23.182652 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3d6b55-d4e7-4246-bb71-50b22ebf4d6e admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:23.183371 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3d6b55-d4e7-4246-bb71-50b22ebf4d6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:23.184966 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3d6b55-d4e7-4246-bb71-50b22ebf4d6e admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:23.198118 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3896/7761] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:40:23 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:40:23.199288 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5972aa-0075-4c39-b99d-7714f75fdd5c admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:23.209692 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5972aa-0075-4c39-b99d-7714f75fdd5c admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:23.218795 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e6edae-1f3c-4ebf-97d4-b6d3485bb41d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:23.218795 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e6edae-1f3c-4ebf-97d4-b6d3485bb41d admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:23.218795 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e6edae-1f3c-4ebf-97d4-b6d3485bb41d admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:23.218795 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e6edae-1f3c-4ebf-97d4-b6d3485bb41d admin admin] PATH_INFO: `/v3/projects/fcb4a7dda2dc40b1b1e1cf58cfc60be5/users/777100d36a864451b7453054f077f486/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:23.219615 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e6edae-1f3c-4ebf-97d4-b6d3485bb41d admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcb4a7dda2dc40b1b1e1cf58cfc60be5, user_id=777100d36a864451b7453054f077f486, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:23.221132 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e6edae-1f3c-4ebf-97d4-b6d3485bb41d admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:23.231453 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3866/7762] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:40:23 2022] PUT /identity/v3/projects/fcb4a7dda2dc40b1b1e1cf58cfc60be5/users/777100d36a864451b7453054f077f486/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:40:23.243184 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351e221f-a13e-4d89-90b0-b8392edef055 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:23.243469 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351e221f-a13e-4d89-90b0-b8392edef055 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:23.243742 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351e221f-a13e-4d89-90b0-b8392edef055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:23.283284 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-351e221f-a13e-4d89-90b0-b8392edef055 None None] MFA Rules not processed for user `777100d36a864451b7453054f077f486`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:40:23.284441 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-351e221f-a13e-4d89-90b0-b8392edef055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:40:23.360489 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3897/7763] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:40:23 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:40:23.373105 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e6edae-1f3c-4ebf-97d4-b6d3485bb41d admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:23.375260 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-26e6edae-1f3c-4ebf-97d4-b6d3485bb41d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:40:23.445353 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e6edae-1f3c-4ebf-97d4-b6d3485bb41d admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:23.449782 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a236cbc6-2866-4019-b352-d72ae91cac31 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec5fd3a489c341b7964704d689037f05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:23.450810 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a236cbc6-2866-4019-b352-d72ae91cac31 service cinder] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:23.451091 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a236cbc6-2866-4019-b352-d72ae91cac31 service cinder] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:23.451361 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a236cbc6-2866-4019-b352-d72ae91cac31 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:23.463040 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a236cbc6-2866-4019-b352-d72ae91cac31 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:23.464846 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a236cbc6-2866-4019-b352-d72ae91cac31 service cinder] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:23.474614 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3867/7764] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:40:23 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:40:23.553094 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351e221f-a13e-4d89-90b0-b8392edef055 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:23.565767 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351e221f-a13e-4d89-90b0-b8392edef055 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:23.569647 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc86d725-7334-49b0-81d0-4c2aafa09ac6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec5fd3a489c341b7964704d689037f05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:23.570342 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc86d725-7334-49b0-81d0-4c2aafa09ac6 service cinder] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:23.570619 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc86d725-7334-49b0-81d0-4c2aafa09ac6 service cinder] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:23.570914 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc86d725-7334-49b0-81d0-4c2aafa09ac6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:23.620718 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:40:23.641624 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc86d725-7334-49b0-81d0-4c2aafa09ac6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:23.643112 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc86d725-7334-49b0-81d0-4c2aafa09ac6 service cinder] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:23.652451 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3898/7765] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:40:23 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:40:24.322262 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a236cbc6-2866-4019-b352-d72ae91cac31 service cinder] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:24.323938 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-a236cbc6-2866-4019-b352-d72ae91cac31 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:40:24.392909 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a236cbc6-2866-4019-b352-d72ae91cac31 service cinder] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:24.398039 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd84b5a-7ad8-4022-81cf-ac9933c08e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:24.398922 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd84b5a-7ad8-4022-81cf-ac9933c08e48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:24.399223 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd84b5a-7ad8-4022-81cf-ac9933c08e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:24.399497 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd84b5a-7ad8-4022-81cf-ac9933c08e48 admin admin] PATH_INFO: `/v3/users/44efc734cb6e437495fa7c4997cc0c05` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:24.400684 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd84b5a-7ad8-4022-81cf-ac9933c08e48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44efc734cb6e437495fa7c4997cc0c05)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:24.402663 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd84b5a-7ad8-4022-81cf-ac9933c08e48 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:24.407726 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:40:24.452174 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-ffd84b5a-7ad8-4022-81cf-ac9933c08e48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44efc734cb6e437495fa7c4997cc0c05'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:24.459641 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-ffd84b5a-7ad8-4022-81cf-ac9933c08e48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44efc734cb6e437495fa7c4997cc0c05'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:24.460343 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-ffd84b5a-7ad8-4022-81cf-ac9933c08e48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44efc734cb6e437495fa7c4997cc0c05'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:24.470741 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-ffd84b5a-7ad8-4022-81cf-ac9933c08e48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44efc734cb6e437495fa7c4997cc0c05'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:24.483243 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-ffd84b5a-7ad8-4022-81cf-ac9933c08e48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44efc734cb6e437495fa7c4997cc0c05'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:24.489169 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3868/7766] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:40:24 2022] DELETE /identity/v3/users/44efc734cb6e437495fa7c4997cc0c05 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:40:24.493779 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2a533e-ec10-4710-85e6-54d29e5c559d None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:24.494296 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2a533e-ec10-4710-85e6-54d29e5c559d None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:24.494387 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2a533e-ec10-4710-85e6-54d29e5c559d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:24.511864 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-8f2a533e-ec10-4710-85e6-54d29e5c559d None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:40:24.513078 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-8f2a533e-ec10-4710-85e6-54d29e5c559d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:40:24.582710 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3899/7767] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:40:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:40:24.593327 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd84b5a-7ad8-4022-81cf-ac9933c08e48 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:24.594987 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-ffd84b5a-7ad8-4022-81cf-ac9933c08e48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:40:24.658709 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd84b5a-7ad8-4022-81cf-ac9933c08e48 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:24.662988 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3778d753-94ce-4a17-8204-5a2bb995c439 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:24.663645 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3778d753-94ce-4a17-8204-5a2bb995c439 service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:24.663924 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3778d753-94ce-4a17-8204-5a2bb995c439 service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:24.664204 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3778d753-94ce-4a17-8204-5a2bb995c439 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:24.673634 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3778d753-94ce-4a17-8204-5a2bb995c439 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:24.675138 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3778d753-94ce-4a17-8204-5a2bb995c439 service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:24.684916 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3869/7768] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:40:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:40:24.977405 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2a533e-ec10-4710-85e6-54d29e5c559d None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:24.978918 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-8f2a533e-ec10-4710-85e6-54d29e5c559d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:40:24.995278 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2a533e-ec10-4710-85e6-54d29e5c559d None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:25.003102 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cb5ebc-9f95-4cb5-9b12-c0f9ede75e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:25.004248 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cb5ebc-9f95-4cb5-9b12-c0f9ede75e25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:25.004628 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cb5ebc-9f95-4cb5-9b12-c0f9ede75e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:25.005080 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cb5ebc-9f95-4cb5-9b12-c0f9ede75e25 admin admin] PATH_INFO: `/v3/projects/04c1186c239b45919b2057d3ca6a8569` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:25.006402 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cb5ebc-9f95-4cb5-9b12-c0f9ede75e25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=04c1186c239b45919b2057d3ca6a8569)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:25.008780 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cb5ebc-9f95-4cb5-9b12-c0f9ede75e25 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:25.061426 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-b4cb5ebc-9f95-4cb5-9b12-c0f9ede75e25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04c1186c239b45919b2057d3ca6a8569', 'request_id': 'req-b4cb5ebc-9f95-4cb5-9b12-c0f9ede75e25'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:25.072657 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-b4cb5ebc-9f95-4cb5-9b12-c0f9ede75e25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04c1186c239b45919b2057d3ca6a8569', 'request_id': 'req-b4cb5ebc-9f95-4cb5-9b12-c0f9ede75e25'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:25.077061 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-b4cb5ebc-9f95-4cb5-9b12-c0f9ede75e25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04c1186c239b45919b2057d3ca6a8569', 'request_id': 'req-b4cb5ebc-9f95-4cb5-9b12-c0f9ede75e25'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:25.089855 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-b4cb5ebc-9f95-4cb5-9b12-c0f9ede75e25 admin admin] The token cache is being invalidate because project 04c1186c239b45919b2057d3ca6a8569 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:40:25.089855 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-b4cb5ebc-9f95-4cb5-9b12-c0f9ede75e25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:25.089855 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-b4cb5ebc-9f95-4cb5-9b12-c0f9ede75e25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:25.091691 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3900/7769] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:40:24 2022] DELETE /identity/v3/projects/04c1186c239b45919b2057d3ca6a8569 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:40:25.097135 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3778d753-94ce-4a17-8204-5a2bb995c439 service neutron] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:25.107282 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3778d753-94ce-4a17-8204-5a2bb995c439 service neutron] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:25.166603 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612b404b-376e-43fb-9c70-33bf30b83453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:25.167596 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612b404b-376e-43fb-9c70-33bf30b83453 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:25.167931 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612b404b-376e-43fb-9c70-33bf30b83453 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:25.168304 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612b404b-376e-43fb-9c70-33bf30b83453 admin admin] PATH_INFO: `/v3/users/fc92903bc92a475e9f00d434ae50d35c` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:25.170290 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612b404b-376e-43fb-9c70-33bf30b83453 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc92903bc92a475e9f00d434ae50d35c)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:25.171522 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612b404b-376e-43fb-9c70-33bf30b83453 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:25.202748 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:40:25.229546 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-612b404b-376e-43fb-9c70-33bf30b83453 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc92903bc92a475e9f00d434ae50d35c'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:25.238198 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-612b404b-376e-43fb-9c70-33bf30b83453 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc92903bc92a475e9f00d434ae50d35c'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:25.239078 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-612b404b-376e-43fb-9c70-33bf30b83453 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc92903bc92a475e9f00d434ae50d35c'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:25.247145 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-612b404b-376e-43fb-9c70-33bf30b83453 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc92903bc92a475e9f00d434ae50d35c'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:25.259544 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-612b404b-376e-43fb-9c70-33bf30b83453 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc92903bc92a475e9f00d434ae50d35c'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:25.265400 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3870/7770] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:40:25 2022] DELETE /identity/v3/users/fc92903bc92a475e9f00d434ae50d35c => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:40:25.552720 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cb5ebc-9f95-4cb5-9b12-c0f9ede75e25 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:25.554299 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-b4cb5ebc-9f95-4cb5-9b12-c0f9ede75e25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:40:25.569332 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cb5ebc-9f95-4cb5-9b12-c0f9ede75e25 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:25.629024 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79f729f-46a8-4f26-a81b-0deeee402430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:25.629949 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79f729f-46a8-4f26-a81b-0deeee402430 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:25.630213 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79f729f-46a8-4f26-a81b-0deeee402430 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:25.630476 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79f729f-46a8-4f26-a81b-0deeee402430 admin admin] PATH_INFO: `/v3/projects/e3e2f8b474694a5b92c8499049a66313` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:25.631718 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79f729f-46a8-4f26-a81b-0deeee402430 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3e2f8b474694a5b92c8499049a66313)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:25.633609 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79f729f-46a8-4f26-a81b-0deeee402430 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:25.639882 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:40:25.683515 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-a79f729f-46a8-4f26-a81b-0deeee402430 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3e2f8b474694a5b92c8499049a66313', 'request_id': 'req-a79f729f-46a8-4f26-a81b-0deeee402430'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:25.691797 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-a79f729f-46a8-4f26-a81b-0deeee402430 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3e2f8b474694a5b92c8499049a66313', 'request_id': 'req-a79f729f-46a8-4f26-a81b-0deeee402430'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:25.697339 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-a79f729f-46a8-4f26-a81b-0deeee402430 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3e2f8b474694a5b92c8499049a66313', 'request_id': 'req-a79f729f-46a8-4f26-a81b-0deeee402430'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:25.708718 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-a79f729f-46a8-4f26-a81b-0deeee402430 admin admin] The token cache is being invalidate because project e3e2f8b474694a5b92c8499049a66313 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:40:25.709154 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-a79f729f-46a8-4f26-a81b-0deeee402430 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:25.710124 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-a79f729f-46a8-4f26-a81b-0deeee402430 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:25.712160 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3901/7771] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:40:25 2022] DELETE /identity/v3/projects/e3e2f8b474694a5b92c8499049a66313 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:40:25.715979 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612b404b-376e-43fb-9c70-33bf30b83453 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:25.717637 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-612b404b-376e-43fb-9c70-33bf30b83453 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:40:25.733963 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612b404b-376e-43fb-9c70-33bf30b83453 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:25.793723 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476744e8-b09d-4547-bbd4-87a47cbb1d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:25.794703 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476744e8-b09d-4547-bbd4-87a47cbb1d53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:25.794974 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476744e8-b09d-4547-bbd4-87a47cbb1d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:25.795249 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476744e8-b09d-4547-bbd4-87a47cbb1d53 admin admin] PATH_INFO: `/v3/users/f75ebbd555274c26ad9c21742ff31d9a` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:25.796503 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476744e8-b09d-4547-bbd4-87a47cbb1d53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f75ebbd555274c26ad9c21742ff31d9a)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:25.798478 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476744e8-b09d-4547-bbd4-87a47cbb1d53 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:25.853390 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-476744e8-b09d-4547-bbd4-87a47cbb1d53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f75ebbd555274c26ad9c21742ff31d9a'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:25.860064 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-476744e8-b09d-4547-bbd4-87a47cbb1d53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f75ebbd555274c26ad9c21742ff31d9a'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:25.860716 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-476744e8-b09d-4547-bbd4-87a47cbb1d53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f75ebbd555274c26ad9c21742ff31d9a'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:25.869091 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-476744e8-b09d-4547-bbd4-87a47cbb1d53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f75ebbd555274c26ad9c21742ff31d9a'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:25.885748 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-476744e8-b09d-4547-bbd4-87a47cbb1d53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f75ebbd555274c26ad9c21742ff31d9a'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:25.892272 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3871/7772] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:40:25 2022] DELETE /identity/v3/users/f75ebbd555274c26ad9c21742ff31d9a => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:40:26.180390 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79f729f-46a8-4f26-a81b-0deeee402430 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:26.182118 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-a79f729f-46a8-4f26-a81b-0deeee402430 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:40:26.206042 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79f729f-46a8-4f26-a81b-0deeee402430 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:26.279154 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6b4478-92bc-4add-83d1-7d3611784137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:26.280063 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6b4478-92bc-4add-83d1-7d3611784137 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:26.280326 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6b4478-92bc-4add-83d1-7d3611784137 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:26.280606 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6b4478-92bc-4add-83d1-7d3611784137 admin admin] PATH_INFO: `/v3/projects/b151e66baa5649e594951d82f148cb8e` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:26.281809 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6b4478-92bc-4add-83d1-7d3611784137 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b151e66baa5649e594951d82f148cb8e)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:26.283842 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6b4478-92bc-4add-83d1-7d3611784137 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:26.334263 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-0c6b4478-92bc-4add-83d1-7d3611784137 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b151e66baa5649e594951d82f148cb8e', 'request_id': 'req-0c6b4478-92bc-4add-83d1-7d3611784137'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:26.342698 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-0c6b4478-92bc-4add-83d1-7d3611784137 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b151e66baa5649e594951d82f148cb8e', 'request_id': 'req-0c6b4478-92bc-4add-83d1-7d3611784137'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:26.349022 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-0c6b4478-92bc-4add-83d1-7d3611784137 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b151e66baa5649e594951d82f148cb8e', 'request_id': 'req-0c6b4478-92bc-4add-83d1-7d3611784137'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:26.361257 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-0c6b4478-92bc-4add-83d1-7d3611784137 admin admin] The token cache is being invalidate because project b151e66baa5649e594951d82f148cb8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:40:26.361547 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-0c6b4478-92bc-4add-83d1-7d3611784137 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:26.362223 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-0c6b4478-92bc-4add-83d1-7d3611784137 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:26.363989 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3902/7773] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:40:26 2022] DELETE /identity/v3/projects/b151e66baa5649e594951d82f148cb8e => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:40:26.369081 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6bef8e-d186-4689-86b9-139b7f3687b9 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:26.369418 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6bef8e-d186-4689-86b9-139b7f3687b9 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:26.369700 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6bef8e-d186-4689-86b9-139b7f3687b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:26.387931 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-5a6bef8e-d186-4689-86b9-139b7f3687b9 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:40:26.389171 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-5a6bef8e-d186-4689-86b9-139b7f3687b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:40:26.410366 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:40:26.457467 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3872/7774] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:40:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:40:26.466337 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3028a6-1971-45ea-9da1-3ab9b4393cc9 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:26.466662 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3028a6-1971-45ea-9da1-3ab9b4393cc9 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:26.466888 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3028a6-1971-45ea-9da1-3ab9b4393cc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:26.487155 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-8a3028a6-1971-45ea-9da1-3ab9b4393cc9 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:40:26.488376 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-8a3028a6-1971-45ea-9da1-3ab9b4393cc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:40:26.499933 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3903/7775] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:40:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:40:26.504656 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6bef8e-d186-4689-86b9-139b7f3687b9 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:26.515120 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6bef8e-d186-4689-86b9-139b7f3687b9 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:26.523035 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa67251-d28d-4021-b4c5-7ac936d61797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:26.523730 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa67251-d28d-4021-b4c5-7ac936d61797 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:26.524026 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa67251-d28d-4021-b4c5-7ac936d61797 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:26.524315 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa67251-d28d-4021-b4c5-7ac936d61797 admin admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:26.525026 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa67251-d28d-4021-b4c5-7ac936d61797 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:40:26.525324 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa67251-d28d-4021-b4c5-7ac936d61797 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:26.526983 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa67251-d28d-4021-b4c5-7ac936d61797 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:26.539457 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3873/7776] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:40:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 21:40:26.544081 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3028a6-1971-45ea-9da1-3ab9b4393cc9 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:26.554200 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3028a6-1971-45ea-9da1-3ab9b4393cc9 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:26.558999 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ebfa1b-66d7-4421-8521-cf56e1632053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:26.559735 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ebfa1b-66d7-4421-8521-cf56e1632053 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:26.560066 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ebfa1b-66d7-4421-8521-cf56e1632053 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:26.560348 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ebfa1b-66d7-4421-8521-cf56e1632053 admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:26.561218 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ebfa1b-66d7-4421-8521-cf56e1632053 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:26.562989 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ebfa1b-66d7-4421-8521-cf56e1632053 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:26.583684 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:40:26.598417 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3904/7777] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:40:26 2022] POST /identity/v3/projects => generated 399 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:40:26.603074 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa67251-d28d-4021-b4c5-7ac936d61797 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:26.614229 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa67251-d28d-4021-b4c5-7ac936d61797 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:26.666746 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ebfa1b-66d7-4421-8521-cf56e1632053 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:26.668505 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-e5ebfa1b-66d7-4421-8521-cf56e1632053 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:40:26.674976 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecc7454-465e-4fa6-9e87-6a163cef2832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:26.675692 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecc7454-465e-4fa6-9e87-6a163cef2832 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:26.675972 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecc7454-465e-4fa6-9e87-6a163cef2832 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:26.676245 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecc7454-465e-4fa6-9e87-6a163cef2832 admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:26.676931 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecc7454-465e-4fa6-9e87-6a163cef2832 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:26.678894 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecc7454-465e-4fa6-9e87-6a163cef2832 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:26.700040 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3874/7778] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:40:26 2022] POST /identity/v3/users => generated 300 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:40:26.704231 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecc7454-465e-4fa6-9e87-6a163cef2832 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:26.715491 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecc7454-465e-4fa6-9e87-6a163cef2832 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:26.721115 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d52da3-52d8-483e-81a7-b7eac6c17075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:26.721780 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d52da3-52d8-483e-81a7-b7eac6c17075 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:26.722100 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d52da3-52d8-483e-81a7-b7eac6c17075 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:26.722372 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d52da3-52d8-483e-81a7-b7eac6c17075 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:26.723121 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d52da3-52d8-483e-81a7-b7eac6c17075 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:26.724727 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d52da3-52d8-483e-81a7-b7eac6c17075 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:26.735520 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3875/7779] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:40:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 21:40:26.737907 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ebfa1b-66d7-4421-8521-cf56e1632053 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:26.739677 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d52da3-52d8-483e-81a7-b7eac6c17075 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:26.743088 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226bad8a-2c94-4a75-a64c-1dabe30f95ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:26.744012 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226bad8a-2c94-4a75-a64c-1dabe30f95ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:26.744294 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226bad8a-2c94-4a75-a64c-1dabe30f95ca admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:26.744569 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226bad8a-2c94-4a75-a64c-1dabe30f95ca admin admin] PATH_INFO: `/v3/users/9300fdb6b7714eb89df502033136faff` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:26.745765 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226bad8a-2c94-4a75-a64c-1dabe30f95ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=9300fdb6b7714eb89df502033136faff)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:26.748168 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226bad8a-2c94-4a75-a64c-1dabe30f95ca admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:26.749888 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d52da3-52d8-483e-81a7-b7eac6c17075 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:26.756400 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79118ccb-6352-4361-a969-f0899f3c6f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:26.757095 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79118ccb-6352-4361-a969-f0899f3c6f91 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:26.757371 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79118ccb-6352-4361-a969-f0899f3c6f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:26.757644 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79118ccb-6352-4361-a969-f0899f3c6f91 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:26.758440 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79118ccb-6352-4361-a969-f0899f3c6f91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:26.760040 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79118ccb-6352-4361-a969-f0899f3c6f91 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:26.773923 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3876/7780] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:40:26 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 21:40:26.777646 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79118ccb-6352-4361-a969-f0899f3c6f91 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:26.789238 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79118ccb-6352-4361-a969-f0899f3c6f91 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:26.793907 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c88c104-b399-4f9d-96c3-89af698c6cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:26.794787 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c88c104-b399-4f9d-96c3-89af698c6cf5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:26.795064 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c88c104-b399-4f9d-96c3-89af698c6cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:26.795331 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c88c104-b399-4f9d-96c3-89af698c6cf5 admin admin] PATH_INFO: `/v3/projects/3211731ca94a4776a63d3f0ff54c0be5/users/3596b56b58e84ad0a78db49897857c67/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:26.799844 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-226bad8a-2c94-4a75-a64c-1dabe30f95ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9300fdb6b7714eb89df502033136faff'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:26.800572 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-226bad8a-2c94-4a75-a64c-1dabe30f95ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9300fdb6b7714eb89df502033136faff'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:26.807502 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-226bad8a-2c94-4a75-a64c-1dabe30f95ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9300fdb6b7714eb89df502033136faff'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:26.810787 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c88c104-b399-4f9d-96c3-89af698c6cf5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3211731ca94a4776a63d3f0ff54c0be5, user_id=3596b56b58e84ad0a78db49897857c67, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:26.814237 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c88c104-b399-4f9d-96c3-89af698c6cf5 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:26.817320 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-226bad8a-2c94-4a75-a64c-1dabe30f95ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9300fdb6b7714eb89df502033136faff'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:26.833696 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3877/7781] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:40:26 2022] PUT /identity/v3/projects/3211731ca94a4776a63d3f0ff54c0be5/users/3596b56b58e84ad0a78db49897857c67/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:40:26.841721 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-226bad8a-2c94-4a75-a64c-1dabe30f95ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9300fdb6b7714eb89df502033136faff'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:26.845778 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db95d34b-c628-4a06-819c-962c97f693cc None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:26.846107 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db95d34b-c628-4a06-819c-962c97f693cc None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:26.846466 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db95d34b-c628-4a06-819c-962c97f693cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:26.848873 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3905/7782] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:40:26 2022] DELETE /identity/v3/users/9300fdb6b7714eb89df502033136faff => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:40:26.853395 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5dca41-4c68-4fc3-993e-c53525b699ee None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:26.853645 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5dca41-4c68-4fc3-993e-c53525b699ee None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:26.853957 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5dca41-4c68-4fc3-993e-c53525b699ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:26.871160 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-9a5dca41-4c68-4fc3-993e-c53525b699ee None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:40:26.872357 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-9a5dca41-4c68-4fc3-993e-c53525b699ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:40:26.872805 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-db95d34b-c628-4a06-819c-962c97f693cc None None] MFA Rules not processed for user `3596b56b58e84ad0a78db49897857c67`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:40:26.874022 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-db95d34b-c628-4a06-819c-962c97f693cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:40:26.923641 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:40:26.934732 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3906/7783] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:40:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:40:26.944836 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5dca41-4c68-4fc3-993e-c53525b699ee None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:26.945765 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3878/7784] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:40:26 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:40:26.946233 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-9a5dca41-4c68-4fc3-993e-c53525b699ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:40:26.965365 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db95d34b-c628-4a06-819c-962c97f693cc None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:26.966544 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:40:26.966941 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-db95d34b-c628-4a06-819c-962c97f693cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:40:27.011852 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5dca41-4c68-4fc3-993e-c53525b699ee None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:27.015513 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649c0cc6-7935-423a-8ef0-e3ab7d82eb8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:27.016169 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649c0cc6-7935-423a-8ef0-e3ab7d82eb8b service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:27.016452 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649c0cc6-7935-423a-8ef0-e3ab7d82eb8b service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:27.016757 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649c0cc6-7935-423a-8ef0-e3ab7d82eb8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:27.025699 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db95d34b-c628-4a06-819c-962c97f693cc None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:27.026116 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649c0cc6-7935-423a-8ef0-e3ab7d82eb8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:27.027548 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649c0cc6-7935-423a-8ef0-e3ab7d82eb8b service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:27.029368 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c752cf62-2bd0-4f70-954b-4877a71cddf8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec5fd3a489c341b7964704d689037f05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:27.030053 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c752cf62-2bd0-4f70-954b-4877a71cddf8 service cinder] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:27.030331 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c752cf62-2bd0-4f70-954b-4877a71cddf8 service cinder] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:27.030601 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c752cf62-2bd0-4f70-954b-4877a71cddf8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:27.037186 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3907/7785] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:40:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:40:27.039142 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c752cf62-2bd0-4f70-954b-4877a71cddf8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:27.040573 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c752cf62-2bd0-4f70-954b-4877a71cddf8 service cinder] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:27.050843 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3879/7786] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:40:26 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:40:27.333253 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649c0cc6-7935-423a-8ef0-e3ab7d82eb8b service neutron] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:27.334935 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-649c0cc6-7935-423a-8ef0-e3ab7d82eb8b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:40:27.364120 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649c0cc6-7935-423a-8ef0-e3ab7d82eb8b service neutron] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:27.373398 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd80fe0-cf2e-4623-b8a6-b1c6c9b880dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:27.374447 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd80fe0-cf2e-4623-b8a6-b1c6c9b880dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:27.374850 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd80fe0-cf2e-4623-b8a6-b1c6c9b880dd admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:27.375190 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd80fe0-cf2e-4623-b8a6-b1c6c9b880dd admin admin] PATH_INFO: `/v3/projects/477a77882a2c4289a3123427f2eadc86` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:27.376521 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd80fe0-cf2e-4623-b8a6-b1c6c9b880dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=477a77882a2c4289a3123427f2eadc86)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:27.378589 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd80fe0-cf2e-4623-b8a6-b1c6c9b880dd admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:27.429101 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-cdd80fe0-cf2e-4623-b8a6-b1c6c9b880dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '477a77882a2c4289a3123427f2eadc86', 'request_id': 'req-cdd80fe0-cf2e-4623-b8a6-b1c6c9b880dd'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:27.437050 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-cdd80fe0-cf2e-4623-b8a6-b1c6c9b880dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '477a77882a2c4289a3123427f2eadc86', 'request_id': 'req-cdd80fe0-cf2e-4623-b8a6-b1c6c9b880dd'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:27.442691 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-cdd80fe0-cf2e-4623-b8a6-b1c6c9b880dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '477a77882a2c4289a3123427f2eadc86', 'request_id': 'req-cdd80fe0-cf2e-4623-b8a6-b1c6c9b880dd'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:27.453818 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-cdd80fe0-cf2e-4623-b8a6-b1c6c9b880dd admin admin] The token cache is being invalidate because project 477a77882a2c4289a3123427f2eadc86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:40:27.454148 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-cdd80fe0-cf2e-4623-b8a6-b1c6c9b880dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:27.454794 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-cdd80fe0-cf2e-4623-b8a6-b1c6c9b880dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:27.456404 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3908/7787] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:40:27 2022] DELETE /identity/v3/projects/477a77882a2c4289a3123427f2eadc86 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:40:27.460489 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c752cf62-2bd0-4f70-954b-4877a71cddf8 service cinder] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:27.471543 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c752cf62-2bd0-4f70-954b-4877a71cddf8 service cinder] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:27.531329 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6c5f6e-fc48-4a77-850e-99c53fa1704e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:27.532239 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6c5f6e-fc48-4a77-850e-99c53fa1704e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:27.532521 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6c5f6e-fc48-4a77-850e-99c53fa1704e admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:27.532805 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6c5f6e-fc48-4a77-850e-99c53fa1704e admin admin] PATH_INFO: `/v3/users/777100d36a864451b7453054f077f486` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:27.534325 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6c5f6e-fc48-4a77-850e-99c53fa1704e admin admin] RBAC: Authorizing `identity:delete_user(user_id=777100d36a864451b7453054f077f486)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:27.536347 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6c5f6e-fc48-4a77-850e-99c53fa1704e admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:27.591319 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-2e6c5f6e-fc48-4a77-850e-99c53fa1704e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '777100d36a864451b7453054f077f486'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:27.598644 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-2e6c5f6e-fc48-4a77-850e-99c53fa1704e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '777100d36a864451b7453054f077f486'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:27.599366 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-2e6c5f6e-fc48-4a77-850e-99c53fa1704e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '777100d36a864451b7453054f077f486'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:27.608829 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-2e6c5f6e-fc48-4a77-850e-99c53fa1704e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '777100d36a864451b7453054f077f486'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:27.625844 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-2e6c5f6e-fc48-4a77-850e-99c53fa1704e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '777100d36a864451b7453054f077f486'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:27.633415 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3880/7788] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:40:27 2022] DELETE /identity/v3/users/777100d36a864451b7453054f077f486 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:40:27.922943 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd80fe0-cf2e-4623-b8a6-b1c6c9b880dd admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:27.924668 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-cdd80fe0-cf2e-4623-b8a6-b1c6c9b880dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:40:27.939428 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd80fe0-cf2e-4623-b8a6-b1c6c9b880dd admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:28.000301 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3e2490-0ed2-4cdd-95e6-48b71a2c2a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:28.001232 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3e2490-0ed2-4cdd-95e6-48b71a2c2a8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:28.001526 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3e2490-0ed2-4cdd-95e6-48b71a2c2a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:28.001776 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3e2490-0ed2-4cdd-95e6-48b71a2c2a8e admin admin] PATH_INFO: `/v3/projects/fcb4a7dda2dc40b1b1e1cf58cfc60be5` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:28.003025 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3e2490-0ed2-4cdd-95e6-48b71a2c2a8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=fcb4a7dda2dc40b1b1e1cf58cfc60be5)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:28.004983 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3e2490-0ed2-4cdd-95e6-48b71a2c2a8e admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:28.051383 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:40:28.054940 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-2c3e2490-0ed2-4cdd-95e6-48b71a2c2a8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fcb4a7dda2dc40b1b1e1cf58cfc60be5', 'request_id': 'req-2c3e2490-0ed2-4cdd-95e6-48b71a2c2a8e'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:28.063809 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-2c3e2490-0ed2-4cdd-95e6-48b71a2c2a8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fcb4a7dda2dc40b1b1e1cf58cfc60be5', 'request_id': 'req-2c3e2490-0ed2-4cdd-95e6-48b71a2c2a8e'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:28.069695 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-2c3e2490-0ed2-4cdd-95e6-48b71a2c2a8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fcb4a7dda2dc40b1b1e1cf58cfc60be5', 'request_id': 'req-2c3e2490-0ed2-4cdd-95e6-48b71a2c2a8e'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:28.081150 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-2c3e2490-0ed2-4cdd-95e6-48b71a2c2a8e admin admin] The token cache is being invalidate because project fcb4a7dda2dc40b1b1e1cf58cfc60be5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:40:28.081437 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-2c3e2490-0ed2-4cdd-95e6-48b71a2c2a8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:28.082196 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-2c3e2490-0ed2-4cdd-95e6-48b71a2c2a8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:28.083880 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3909/7789] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:40:27 2022] DELETE /identity/v3/projects/fcb4a7dda2dc40b1b1e1cf58cfc60be5 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:40:28.089718 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801a04c2-3f49-45cf-81d8-575ee48c510f None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:28.090349 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801a04c2-3f49-45cf-81d8-575ee48c510f None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:28.090349 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801a04c2-3f49-45cf-81d8-575ee48c510f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:28.103109 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:40:28.110850 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-801a04c2-3f49-45cf-81d8-575ee48c510f None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:40:28.112671 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-801a04c2-3f49-45cf-81d8-575ee48c510f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:40:28.173034 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3881/7790] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:40:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:40:28.181325 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67238c59-3c63-433c-8c82-122dfd377bc3 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:28.181616 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67238c59-3c63-433c-8c82-122dfd377bc3 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:28.181961 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67238c59-3c63-433c-8c82-122dfd377bc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:28.201527 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-67238c59-3c63-433c-8c82-122dfd377bc3 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:40:28.202810 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-67238c59-3c63-433c-8c82-122dfd377bc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:40:28.211861 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3910/7791] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:40:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:40:28.216479 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801a04c2-3f49-45cf-81d8-575ee48c510f None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:28.227343 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801a04c2-3f49-45cf-81d8-575ee48c510f None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:28.232999 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f5364b-c255-4408-83bb-d6a9f7761f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:28.233699 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f5364b-c255-4408-83bb-d6a9f7761f17 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:28.234026 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f5364b-c255-4408-83bb-d6a9f7761f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:28.234309 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f5364b-c255-4408-83bb-d6a9f7761f17 admin admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:28.235050 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f5364b-c255-4408-83bb-d6a9f7761f17 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:40:28.235348 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f5364b-c255-4408-83bb-d6a9f7761f17 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:28.236997 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f5364b-c255-4408-83bb-d6a9f7761f17 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:28.249903 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3882/7792] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:40:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:40:28.254364 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67238c59-3c63-433c-8c82-122dfd377bc3 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:28.264196 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67238c59-3c63-433c-8c82-122dfd377bc3 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:28.269913 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e376101e-eb48-4f29-a6de-d424cdb12613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:28.270635 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e376101e-eb48-4f29-a6de-d424cdb12613 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:28.270946 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e376101e-eb48-4f29-a6de-d424cdb12613 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:28.271214 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e376101e-eb48-4f29-a6de-d424cdb12613 admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:28.271921 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e376101e-eb48-4f29-a6de-d424cdb12613 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:28.273808 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e376101e-eb48-4f29-a6de-d424cdb12613 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:28.306376 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3911/7793] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:40:28 2022] POST /identity/v3/projects => generated 363 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:40:28.310834 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f5364b-c255-4408-83bb-d6a9f7761f17 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:28.321891 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f5364b-c255-4408-83bb-d6a9f7761f17 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:28.379024 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e426516d-0657-4a4d-9bd7-748067f2d60a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:28.379695 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e426516d-0657-4a4d-9bd7-748067f2d60a admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:28.379975 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e426516d-0657-4a4d-9bd7-748067f2d60a admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:28.380249 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e426516d-0657-4a4d-9bd7-748067f2d60a admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:28.380933 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e426516d-0657-4a4d-9bd7-748067f2d60a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:28.383018 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e426516d-0657-4a4d-9bd7-748067f2d60a admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:28.404378 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3883/7794] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:40:28 2022] POST /identity/v3/users => generated 282 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:40:28.408015 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e376101e-eb48-4f29-a6de-d424cdb12613 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:28.420298 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e376101e-eb48-4f29-a6de-d424cdb12613 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:28.426386 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731dc30c-61c2-4d06-80ef-8519fd4603a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:28.427219 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731dc30c-61c2-4d06-80ef-8519fd4603a5 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:28.427565 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731dc30c-61c2-4d06-80ef-8519fd4603a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:28.427843 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731dc30c-61c2-4d06-80ef-8519fd4603a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:28.428885 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731dc30c-61c2-4d06-80ef-8519fd4603a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:28.431209 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731dc30c-61c2-4d06-80ef-8519fd4603a5 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:28.442901 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3912/7795] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:40:28 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 21:40:28.447163 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e426516d-0657-4a4d-9bd7-748067f2d60a admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:28.457618 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e426516d-0657-4a4d-9bd7-748067f2d60a admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:28.462892 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8146e96-510c-442b-bdf9-8b1641f90cd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:28.463555 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8146e96-510c-442b-bdf9-8b1641f90cd2 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:28.463836 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8146e96-510c-442b-bdf9-8b1641f90cd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:28.464138 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8146e96-510c-442b-bdf9-8b1641f90cd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:28.464864 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8146e96-510c-442b-bdf9-8b1641f90cd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:28.466513 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8146e96-510c-442b-bdf9-8b1641f90cd2 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:28.476495 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3884/7796] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:40:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:40:28.480694 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731dc30c-61c2-4d06-80ef-8519fd4603a5 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:28.491407 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731dc30c-61c2-4d06-80ef-8519fd4603a5 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:28.497267 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8fdef3-c7b9-44d6-8205-b85979fffb75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:28.498188 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8fdef3-c7b9-44d6-8205-b85979fffb75 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:28.498466 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8fdef3-c7b9-44d6-8205-b85979fffb75 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:28.498724 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8fdef3-c7b9-44d6-8205-b85979fffb75 admin admin] PATH_INFO: `/v3/projects/4ecc13083f754f53815106fa286fed14/users/b73558794bde4c4a9681add9d6abd213/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:28.514229 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8fdef3-c7b9-44d6-8205-b85979fffb75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ecc13083f754f53815106fa286fed14, user_id=b73558794bde4c4a9681add9d6abd213, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:28.516875 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8fdef3-c7b9-44d6-8205-b85979fffb75 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:28.533014 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3913/7797] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:40:28 2022] PUT /identity/v3/projects/4ecc13083f754f53815106fa286fed14/users/b73558794bde4c4a9681add9d6abd213/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:40:28.543499 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aaa902-7d14-42dd-8f51-c8241c9fe850 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:28.543817 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aaa902-7d14-42dd-8f51-c8241c9fe850 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:28.544089 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aaa902-7d14-42dd-8f51-c8241c9fe850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:28.573449 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-b0aaa902-7d14-42dd-8f51-c8241c9fe850 None None] MFA Rules not processed for user `b73558794bde4c4a9681add9d6abd213`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:40:28.574651 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-b0aaa902-7d14-42dd-8f51-c8241c9fe850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:40:28.642268 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3885/7798] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:40:28 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:40:28.648462 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8fdef3-c7b9-44d6-8205-b85979fffb75 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:28.715497 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8fdef3-c7b9-44d6-8205-b85979fffb75 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:28.727157 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c8df57-dba6-4891-809c-f7ee6da6e92a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:28.728127 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c8df57-dba6-4891-809c-f7ee6da6e92a admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:28.728415 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c8df57-dba6-4891-809c-f7ee6da6e92a admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:28.728691 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c8df57-dba6-4891-809c-f7ee6da6e92a admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:28.729387 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c8df57-dba6-4891-809c-f7ee6da6e92a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:28.731353 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c8df57-dba6-4891-809c-f7ee6da6e92a admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:28.762219 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3914/7799] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:40:28 2022] POST /identity/v3/projects => generated 363 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:40:28.766698 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aaa902-7d14-42dd-8f51-c8241c9fe850 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:28.772255 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:40:28.781081 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aaa902-7d14-42dd-8f51-c8241c9fe850 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:28.841770 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a29c7b5-5fdb-4313-8bbd-82c40668329b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:28.842488 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a29c7b5-5fdb-4313-8bbd-82c40668329b admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:28.842791 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a29c7b5-5fdb-4313-8bbd-82c40668329b admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:28.843064 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a29c7b5-5fdb-4313-8bbd-82c40668329b admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:28.843755 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a29c7b5-5fdb-4313-8bbd-82c40668329b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:28.845674 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a29c7b5-5fdb-4313-8bbd-82c40668329b admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:28.866100 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3886/7800] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:40:28 2022] POST /identity/v3/users => generated 288 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:40:28.870277 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c8df57-dba6-4891-809c-f7ee6da6e92a admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:28.882499 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c8df57-dba6-4891-809c-f7ee6da6e92a admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:28.889066 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f0e241-96be-48db-b0d2-d7e98c4d2efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:28.889722 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f0e241-96be-48db-b0d2-d7e98c4d2efa admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:28.890039 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f0e241-96be-48db-b0d2-d7e98c4d2efa admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:28.890314 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f0e241-96be-48db-b0d2-d7e98c4d2efa admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:28.891041 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f0e241-96be-48db-b0d2-d7e98c4d2efa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:28.892697 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f0e241-96be-48db-b0d2-d7e98c4d2efa admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:28.907158 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3915/7801] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:40:28 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:40:28.912693 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a29c7b5-5fdb-4313-8bbd-82c40668329b admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:28.913789 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f0e241-96be-48db-b0d2-d7e98c4d2efa admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:28.915705 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-a3f0e241-96be-48db-b0d2-d7e98c4d2efa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:40:28.922048 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a29c7b5-5fdb-4313-8bbd-82c40668329b admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:28.926729 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea30287-4977-4cc7-ba59-e4f9d849d4c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:28.927628 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea30287-4977-4cc7-ba59-e4f9d849d4c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:28.927914 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea30287-4977-4cc7-ba59-e4f9d849d4c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:28.928198 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea30287-4977-4cc7-ba59-e4f9d849d4c9 admin admin] PATH_INFO: `/v3/projects/8942e35e4e3a481d834b4dede203c561/users/cfec8760be6e45eca8d5394089af0ccc/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:28.928783 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f0e241-96be-48db-b0d2-d7e98c4d2efa admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:28.933453 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91cf590-3ed3-4b62-8aaf-c5a3f3f19c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:28.934377 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91cf590-3ed3-4b62-8aaf-c5a3f3f19c3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:28.934655 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91cf590-3ed3-4b62-8aaf-c5a3f3f19c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:28.934930 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91cf590-3ed3-4b62-8aaf-c5a3f3f19c3d admin admin] PATH_INFO: `/v3/users/3596b56b58e84ad0a78db49897857c67` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:28.936126 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91cf590-3ed3-4b62-8aaf-c5a3f3f19c3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=3596b56b58e84ad0a78db49897857c67)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:28.938072 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91cf590-3ed3-4b62-8aaf-c5a3f3f19c3d admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:28.943492 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea30287-4977-4cc7-ba59-e4f9d849d4c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8942e35e4e3a481d834b4dede203c561, user_id=cfec8760be6e45eca8d5394089af0ccc, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:28.946254 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea30287-4977-4cc7-ba59-e4f9d849d4c9 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:28.961428 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3887/7802] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:40:28 2022] PUT /identity/v3/projects/8942e35e4e3a481d834b4dede203c561/users/cfec8760be6e45eca8d5394089af0ccc/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:40:28.966057 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea30287-4977-4cc7-ba59-e4f9d849d4c9 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:28.981196 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:40:28.994192 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-b91cf590-3ed3-4b62-8aaf-c5a3f3f19c3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3596b56b58e84ad0a78db49897857c67'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:28.995018 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-b91cf590-3ed3-4b62-8aaf-c5a3f3f19c3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3596b56b58e84ad0a78db49897857c67'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:29.003362 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-b91cf590-3ed3-4b62-8aaf-c5a3f3f19c3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3596b56b58e84ad0a78db49897857c67'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:29.012288 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-b91cf590-3ed3-4b62-8aaf-c5a3f3f19c3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3596b56b58e84ad0a78db49897857c67'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:29.024840 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-b91cf590-3ed3-4b62-8aaf-c5a3f3f19c3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3596b56b58e84ad0a78db49897857c67'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:29.028612 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea30287-4977-4cc7-ba59-e4f9d849d4c9 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:29.030924 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3916/7803] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:40:28 2022] DELETE /identity/v3/users/3596b56b58e84ad0a78db49897857c67 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:40:29.034150 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51e2745-9ace-4df6-9225-1f410d6cc177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:29.034670 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51e2745-9ace-4df6-9225-1f410d6cc177 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:29.034950 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51e2745-9ace-4df6-9225-1f410d6cc177 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:29.035222 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51e2745-9ace-4df6-9225-1f410d6cc177 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:29.035372 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5018eb0c-43b0-4704-b97f-284dfa3fd746 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:29.035712 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5018eb0c-43b0-4704-b97f-284dfa3fd746 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:29.035946 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51e2745-9ace-4df6-9225-1f410d6cc177 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:29.036048 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5018eb0c-43b0-4704-b97f-284dfa3fd746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:29.037579 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51e2745-9ace-4df6-9225-1f410d6cc177 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:29.050850 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3888/7804] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:40:28 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 21:40:29.051888 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51e2745-9ace-4df6-9225-1f410d6cc177 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:29.053642 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-d51e2745-9ace-4df6-9225-1f410d6cc177 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:40:29.053840 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-5018eb0c-43b0-4704-b97f-284dfa3fd746 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:40:29.055063 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-5018eb0c-43b0-4704-b97f-284dfa3fd746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:40:29.066296 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51e2745-9ace-4df6-9225-1f410d6cc177 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:29.116448 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3917/7805] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:40:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:40:29.124339 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849e0b05-1966-421a-96e9-52e96e2b0834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:29.125379 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849e0b05-1966-421a-96e9-52e96e2b0834 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:29.125658 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849e0b05-1966-421a-96e9-52e96e2b0834 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:29.125970 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849e0b05-1966-421a-96e9-52e96e2b0834 admin admin] PATH_INFO: `/v3/projects/8942e35e4e3a481d834b4dede203c561/users/cfec8760be6e45eca8d5394089af0ccc/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:29.126360 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5018eb0c-43b0-4704-b97f-284dfa3fd746 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:29.128644 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-5018eb0c-43b0-4704-b97f-284dfa3fd746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:40:29.128961 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849e0b05-1966-421a-96e9-52e96e2b0834 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8942e35e4e3a481d834b4dede203c561, user_id=cfec8760be6e45eca8d5394089af0ccc, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:29.132019 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849e0b05-1966-421a-96e9-52e96e2b0834 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:29.138179 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:40:29.146197 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3889/7806] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:40:29 2022] PUT /identity/v3/projects/8942e35e4e3a481d834b4dede203c561/users/cfec8760be6e45eca8d5394089af0ccc/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:40:29.155385 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4cdfc9-478a-406c-95b6-11bdbf72e36d None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:29.155671 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4cdfc9-478a-406c-95b6-11bdbf72e36d None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:29.155945 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4cdfc9-478a-406c-95b6-11bdbf72e36d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:29.182914 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-ed4cdfc9-478a-406c-95b6-11bdbf72e36d None None] MFA Rules not processed for user `cfec8760be6e45eca8d5394089af0ccc`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:40:29.184115 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-ed4cdfc9-478a-406c-95b6-11bdbf72e36d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:40:29.191446 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5018eb0c-43b0-4704-b97f-284dfa3fd746 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:29.241157 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d895a9-afac-4e4d-957a-a0b573493371 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:29.241839 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d895a9-afac-4e4d-957a-a0b573493371 service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:29.242145 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d895a9-afac-4e4d-957a-a0b573493371 service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:29.242421 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d895a9-afac-4e4d-957a-a0b573493371 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:29.254161 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3890/7807] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:40:29 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:40:29.265621 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4cdfc9-478a-406c-95b6-11bdbf72e36d None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:29.267032 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-ed4cdfc9-478a-406c-95b6-11bdbf72e36d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:40:29.268409 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:40:29.306987 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d895a9-afac-4e4d-957a-a0b573493371 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:29.308449 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d895a9-afac-4e4d-957a-a0b573493371 service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:29.318180 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3918/7808] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:40:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:40:29.327458 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4cdfc9-478a-406c-95b6-11bdbf72e36d None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:29.331220 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3af2cb-c3ba-40f9-ba8c-a4bbf9f8e742 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec5fd3a489c341b7964704d689037f05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:29.331877 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3af2cb-c3ba-40f9-ba8c-a4bbf9f8e742 service cinder] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:29.332154 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3af2cb-c3ba-40f9-ba8c-a4bbf9f8e742 service cinder] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:29.332424 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3af2cb-c3ba-40f9-ba8c-a4bbf9f8e742 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:29.342372 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3af2cb-c3ba-40f9-ba8c-a4bbf9f8e742 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:29.343789 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3af2cb-c3ba-40f9-ba8c-a4bbf9f8e742 service cinder] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:29.353593 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3891/7809] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:40:29 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 23 21:40:29.429387 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d895a9-afac-4e4d-957a-a0b573493371 service neutron] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:29.442166 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d895a9-afac-4e4d-957a-a0b573493371 service neutron] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:29.446526 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c15c73-54cc-434b-b953-4dfd77e88b49 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec5fd3a489c341b7964704d689037f05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:29.447184 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c15c73-54cc-434b-b953-4dfd77e88b49 service cinder] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:29.447525 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c15c73-54cc-434b-b953-4dfd77e88b49 service cinder] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:29.447806 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c15c73-54cc-434b-b953-4dfd77e88b49 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:29.450093 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-c7c15c73-54cc-434b-b953-4dfd77e88b49 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:40:29.516711 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c15c73-54cc-434b-b953-4dfd77e88b49 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:29.518463 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c15c73-54cc-434b-b953-4dfd77e88b49 service cinder] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:29.528019 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3919/7810] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:40:29 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:40:29.592865 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3af2cb-c3ba-40f9-ba8c-a4bbf9f8e742 service cinder] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:29.595204 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-da3af2cb-c3ba-40f9-ba8c-a4bbf9f8e742 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:40:29.627039 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3af2cb-c3ba-40f9-ba8c-a4bbf9f8e742 service cinder] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:29.634195 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a531eeb-ca9d-4421-b20a-ca378fd70252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:29.634635 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a531eeb-ca9d-4421-b20a-ca378fd70252 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:29.634918 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a531eeb-ca9d-4421-b20a-ca378fd70252 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:29.635190 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a531eeb-ca9d-4421-b20a-ca378fd70252 admin admin] PATH_INFO: `/v3/projects/3211731ca94a4776a63d3f0ff54c0be5` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:29.637062 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a531eeb-ca9d-4421-b20a-ca378fd70252 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3211731ca94a4776a63d3f0ff54c0be5)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:29.639028 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a531eeb-ca9d-4421-b20a-ca378fd70252 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:29.691508 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-2a531eeb-ca9d-4421-b20a-ca378fd70252 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3211731ca94a4776a63d3f0ff54c0be5', 'request_id': 'req-2a531eeb-ca9d-4421-b20a-ca378fd70252'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:29.699778 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-2a531eeb-ca9d-4421-b20a-ca378fd70252 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3211731ca94a4776a63d3f0ff54c0be5', 'request_id': 'req-2a531eeb-ca9d-4421-b20a-ca378fd70252'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:29.706556 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-2a531eeb-ca9d-4421-b20a-ca378fd70252 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3211731ca94a4776a63d3f0ff54c0be5', 'request_id': 'req-2a531eeb-ca9d-4421-b20a-ca378fd70252'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:29.717801 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-2a531eeb-ca9d-4421-b20a-ca378fd70252 admin admin] The token cache is being invalidate because project 3211731ca94a4776a63d3f0ff54c0be5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:40:29.718116 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-2a531eeb-ca9d-4421-b20a-ca378fd70252 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:29.718742 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-2a531eeb-ca9d-4421-b20a-ca378fd70252 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:29.720301 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3892/7811] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:40:29 2022] DELETE /identity/v3/projects/3211731ca94a4776a63d3f0ff54c0be5 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:40:29.725775 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0363542c-c0b0-4cf7-b4e7-d62e720a228b None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:29.726054 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0363542c-c0b0-4cf7-b4e7-d62e720a228b None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:29.726306 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0363542c-c0b0-4cf7-b4e7-d62e720a228b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:29.746551 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-0363542c-c0b0-4cf7-b4e7-d62e720a228b None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:40:29.747810 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-0363542c-c0b0-4cf7-b4e7-d62e720a228b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:40:29.811530 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3920/7812] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:40:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:40:29.820414 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8cac63-84ff-4ef6-853c-7df172246cde None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:29.820414 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8cac63-84ff-4ef6-853c-7df172246cde None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:29.820414 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8cac63-84ff-4ef6-853c-7df172246cde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:29.840951 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-0b8cac63-84ff-4ef6-853c-7df172246cde None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:40:29.842210 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-0b8cac63-84ff-4ef6-853c-7df172246cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:40:29.850699 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3893/7813] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:40:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:40:29.855138 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0363542c-c0b0-4cf7-b4e7-d62e720a228b None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:29.865380 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0363542c-c0b0-4cf7-b4e7-d62e720a228b None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:29.870615 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9204d0a8-6973-42e0-bed2-3cbed6536380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:29.871279 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9204d0a8-6973-42e0-bed2-3cbed6536380 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:29.871561 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9204d0a8-6973-42e0-bed2-3cbed6536380 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:29.871829 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9204d0a8-6973-42e0-bed2-3cbed6536380 admin admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:29.872566 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9204d0a8-6973-42e0-bed2-3cbed6536380 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:40:29.872871 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9204d0a8-6973-42e0-bed2-3cbed6536380 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:29.874521 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9204d0a8-6973-42e0-bed2-3cbed6536380 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:29.886984 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3921/7814] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:40:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:40:29.891246 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8cac63-84ff-4ef6-853c-7df172246cde None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:29.895792 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:40:29.901390 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8cac63-84ff-4ef6-853c-7df172246cde None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:29.908680 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44942da3-6094-41a2-872b-c59b7ee81c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:29.909357 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44942da3-6094-41a2-872b-c59b7ee81c60 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:29.909845 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44942da3-6094-41a2-872b-c59b7ee81c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:29.910162 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44942da3-6094-41a2-872b-c59b7ee81c60 admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:29.910881 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44942da3-6094-41a2-872b-c59b7ee81c60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:29.913349 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44942da3-6094-41a2-872b-c59b7ee81c60 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:29.940129 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3894/7815] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:40:29 2022] POST /identity/v3/projects => generated 393 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:40:29.944367 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9204d0a8-6973-42e0-bed2-3cbed6536380 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:29.954786 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9204d0a8-6973-42e0-bed2-3cbed6536380 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:30.002635 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:40:30.017374 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686c6758-ea6e-4002-b50c-bcfd02b1542f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:30.018105 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686c6758-ea6e-4002-b50c-bcfd02b1542f admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:30.018363 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686c6758-ea6e-4002-b50c-bcfd02b1542f admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:30.018642 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686c6758-ea6e-4002-b50c-bcfd02b1542f admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:30.019324 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686c6758-ea6e-4002-b50c-bcfd02b1542f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:30.021249 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686c6758-ea6e-4002-b50c-bcfd02b1542f admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:30.044736 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3922/7816] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:40:29 2022] POST /identity/v3/users => generated 297 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:40:30.048716 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44942da3-6094-41a2-872b-c59b7ee81c60 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:30.060230 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44942da3-6094-41a2-872b-c59b7ee81c60 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:30.065760 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce66c8de-b075-4de4-8693-ba52a4a23a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:30.066492 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce66c8de-b075-4de4-8693-ba52a4a23a08 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:30.066775 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce66c8de-b075-4de4-8693-ba52a4a23a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:30.067047 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce66c8de-b075-4de4-8693-ba52a4a23a08 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:30.067776 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce66c8de-b075-4de4-8693-ba52a4a23a08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:30.069424 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce66c8de-b075-4de4-8693-ba52a4a23a08 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:30.080176 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3895/7817] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:40:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:40:30.084286 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686c6758-ea6e-4002-b50c-bcfd02b1542f admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:30.095741 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686c6758-ea6e-4002-b50c-bcfd02b1542f admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:30.101391 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa24a7b-b838-46df-bebd-1f3552d29e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:30.102180 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa24a7b-b838-46df-bebd-1f3552d29e74 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:30.102502 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa24a7b-b838-46df-bebd-1f3552d29e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:30.102870 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa24a7b-b838-46df-bebd-1f3552d29e74 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:30.103664 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa24a7b-b838-46df-bebd-1f3552d29e74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:30.105445 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa24a7b-b838-46df-bebd-1f3552d29e74 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:30.116954 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3923/7818] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:40:30 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:40:30.121270 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce66c8de-b075-4de4-8693-ba52a4a23a08 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:30.132210 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce66c8de-b075-4de4-8693-ba52a4a23a08 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:30.137963 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09f98a5-2e11-4be3-a997-376f1f76258e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:30.138825 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09f98a5-2e11-4be3-a997-376f1f76258e admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:30.139108 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09f98a5-2e11-4be3-a997-376f1f76258e admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:30.139381 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09f98a5-2e11-4be3-a997-376f1f76258e admin admin] PATH_INFO: `/v3/projects/36bd2862980e45849b0d3fc3f52a6926/users/96ade420fd324acfb57e4ac81bfece9e/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:30.155266 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09f98a5-2e11-4be3-a997-376f1f76258e admin admin] RBAC: Authorizing `identity:create_grant(project_id=36bd2862980e45849b0d3fc3f52a6926, user_id=96ade420fd324acfb57e4ac81bfece9e, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:30.157992 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09f98a5-2e11-4be3-a997-376f1f76258e admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:30.172778 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3896/7819] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:40:30 2022] PUT /identity/v3/projects/36bd2862980e45849b0d3fc3f52a6926/users/96ade420fd324acfb57e4ac81bfece9e/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:40:30.183398 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba8a753-87e1-4114-93d2-392c7f816aab None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:30.183731 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba8a753-87e1-4114-93d2-392c7f816aab None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:30.183996 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba8a753-87e1-4114-93d2-392c7f816aab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:30.211715 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-4ba8a753-87e1-4114-93d2-392c7f816aab None None] MFA Rules not processed for user `96ade420fd324acfb57e4ac81bfece9e`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:40:30.212923 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-4ba8a753-87e1-4114-93d2-392c7f816aab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:40:30.279143 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3924/7820] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:40:30 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:40:30.284048 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09f98a5-2e11-4be3-a997-376f1f76258e admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:30.348763 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09f98a5-2e11-4be3-a997-376f1f76258e admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:30.354195 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830f58e1-26aa-4acd-8eb4-76833dbe1516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:30.354869 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830f58e1-26aa-4acd-8eb4-76833dbe1516 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:30.355143 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830f58e1-26aa-4acd-8eb4-76833dbe1516 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:30.355421 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830f58e1-26aa-4acd-8eb4-76833dbe1516 admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:30.356102 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830f58e1-26aa-4acd-8eb4-76833dbe1516 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:30.358055 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830f58e1-26aa-4acd-8eb4-76833dbe1516 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:30.385410 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3897/7821] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:40:30 2022] POST /identity/v3/projects => generated 391 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:40:30.389487 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba8a753-87e1-4114-93d2-392c7f816aab None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:30.401833 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba8a753-87e1-4114-93d2-392c7f816aab None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:30.465494 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7389041d-004b-4e41-bcf9-bd432e5826de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:30.466286 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7389041d-004b-4e41-bcf9-bd432e5826de admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:30.466567 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7389041d-004b-4e41-bcf9-bd432e5826de admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:30.466841 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7389041d-004b-4e41-bcf9-bd432e5826de admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:30.467545 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7389041d-004b-4e41-bcf9-bd432e5826de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:30.469621 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7389041d-004b-4e41-bcf9-bd432e5826de admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:30.495687 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3925/7822] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:40:30 2022] POST /identity/v3/users => generated 302 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:40:30.496954 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830f58e1-26aa-4acd-8eb4-76833dbe1516 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:30.507817 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830f58e1-26aa-4acd-8eb4-76833dbe1516 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:30.512655 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0110d24a-f39a-4890-9e42-90cb55aab2b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:30.513327 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0110d24a-f39a-4890-9e42-90cb55aab2b5 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:30.513607 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0110d24a-f39a-4890-9e42-90cb55aab2b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:30.513909 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0110d24a-f39a-4890-9e42-90cb55aab2b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:30.514647 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0110d24a-f39a-4890-9e42-90cb55aab2b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:30.516264 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0110d24a-f39a-4890-9e42-90cb55aab2b5 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:30.530655 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3898/7823] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:40:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:40:30.531863 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7389041d-004b-4e41-bcf9-bd432e5826de admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:30.543056 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7389041d-004b-4e41-bcf9-bd432e5826de admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:30.548334 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2856291-4f16-48c1-b5cd-8c2fadcb5fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:30.549266 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2856291-4f16-48c1-b5cd-8c2fadcb5fd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:30.549548 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2856291-4f16-48c1-b5cd-8c2fadcb5fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:30.549825 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2856291-4f16-48c1-b5cd-8c2fadcb5fd6 admin admin] PATH_INFO: `/v3/projects/86dc934708144527824a9309b2cf068d/users/b457c730ff32489a8d64d3f92ce95945/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:30.571176 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2856291-4f16-48c1-b5cd-8c2fadcb5fd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86dc934708144527824a9309b2cf068d, user_id=b457c730ff32489a8d64d3f92ce95945, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:30.574105 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2856291-4f16-48c1-b5cd-8c2fadcb5fd6 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:30.588630 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3926/7824] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:40:30 2022] PUT /identity/v3/projects/86dc934708144527824a9309b2cf068d/users/b457c730ff32489a8d64d3f92ce95945/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:40:30.592741 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0110d24a-f39a-4890-9e42-90cb55aab2b5 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:30.603268 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0110d24a-f39a-4890-9e42-90cb55aab2b5 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:30.669231 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7492b41d-d172-413c-8d79-df13980748dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:30.669826 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7492b41d-d172-413c-8d79-df13980748dd admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:30.670133 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7492b41d-d172-413c-8d79-df13980748dd admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:30.670404 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7492b41d-d172-413c-8d79-df13980748dd admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:30.671138 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7492b41d-d172-413c-8d79-df13980748dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:30.672745 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7492b41d-d172-413c-8d79-df13980748dd admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:30.686548 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3899/7825] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:40:30 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:40:30.687817 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2856291-4f16-48c1-b5cd-8c2fadcb5fd6 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:30.699105 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2856291-4f16-48c1-b5cd-8c2fadcb5fd6 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:30.711065 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10411fe4-8c50-435c-a09b-3aa0417a6d2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:30.711065 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10411fe4-8c50-435c-a09b-3aa0417a6d2f admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:30.711065 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10411fe4-8c50-435c-a09b-3aa0417a6d2f admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:30.711065 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10411fe4-8c50-435c-a09b-3aa0417a6d2f admin admin] PATH_INFO: `/v3/projects/86dc934708144527824a9309b2cf068d/users/b457c730ff32489a8d64d3f92ce95945/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:30.711385 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10411fe4-8c50-435c-a09b-3aa0417a6d2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=86dc934708144527824a9309b2cf068d, user_id=b457c730ff32489a8d64d3f92ce95945, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:30.711865 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10411fe4-8c50-435c-a09b-3aa0417a6d2f admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:30.723964 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3927/7826] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:40:30 2022] PUT /identity/v3/projects/86dc934708144527824a9309b2cf068d/users/b457c730ff32489a8d64d3f92ce95945/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:40:30.832782 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57a3ffc-823e-4d22-9652-50e4f787a317 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:30.833038 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57a3ffc-823e-4d22-9652-50e4f787a317 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:30.833342 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57a3ffc-823e-4d22-9652-50e4f787a317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:30.867628 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-f57a3ffc-823e-4d22-9652-50e4f787a317 None None] MFA Rules not processed for user `b457c730ff32489a8d64d3f92ce95945`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:40:30.868865 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-f57a3ffc-823e-4d22-9652-50e4f787a317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:40:30.872934 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:40:30.941881 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3900/7827] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:40:30 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:40:30.957725 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10411fe4-8c50-435c-a09b-3aa0417a6d2f admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:30.959738 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-10411fe4-8c50-435c-a09b-3aa0417a6d2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:40:30.972433 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:40:31.038798 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57a3ffc-823e-4d22-9652-50e4f787a317 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:31.040231 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-f57a3ffc-823e-4d22-9652-50e4f787a317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:40:31.046348 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10411fe4-8c50-435c-a09b-3aa0417a6d2f admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:31.052542 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c0091e-a603-4359-b2e6-b37ba349bb6f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:31.053275 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c0091e-a603-4359-b2e6-b37ba349bb6f service nova] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:31.053560 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c0091e-a603-4359-b2e6-b37ba349bb6f service nova] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:31.053840 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c0091e-a603-4359-b2e6-b37ba349bb6f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:31.109605 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57a3ffc-823e-4d22-9652-50e4f787a317 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:31.113067 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c0091e-a603-4359-b2e6-b37ba349bb6f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:31.114819 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c0091e-a603-4359-b2e6-b37ba349bb6f service nova] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:31.115358 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a599c9-c638-466b-8c12-ce0bc33a1eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:31.116377 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a599c9-c638-466b-8c12-ce0bc33a1eb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:31.116780 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a599c9-c638-466b-8c12-ce0bc33a1eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:31.117160 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a599c9-c638-466b-8c12-ce0bc33a1eb7 admin admin] PATH_INFO: `/v3/users/b73558794bde4c4a9681add9d6abd213` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:31.118862 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a599c9-c638-466b-8c12-ce0bc33a1eb7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b73558794bde4c4a9681add9d6abd213)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:31.121450 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a599c9-c638-466b-8c12-ce0bc33a1eb7 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:31.124230 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3928/7828] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:40:30 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:40:31.172624 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-86a599c9-c638-466b-8c12-ce0bc33a1eb7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b73558794bde4c4a9681add9d6abd213'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:31.182823 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-86a599c9-c638-466b-8c12-ce0bc33a1eb7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b73558794bde4c4a9681add9d6abd213'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:31.183544 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-86a599c9-c638-466b-8c12-ce0bc33a1eb7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b73558794bde4c4a9681add9d6abd213'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:31.192439 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-86a599c9-c638-466b-8c12-ce0bc33a1eb7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b73558794bde4c4a9681add9d6abd213'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:31.205469 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-86a599c9-c638-466b-8c12-ce0bc33a1eb7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b73558794bde4c4a9681add9d6abd213'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:31.212660 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3901/7829] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:40:31 2022] DELETE /identity/v3/users/b73558794bde4c4a9681add9d6abd213 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:40:31.217206 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb82730d-1d02-45d4-9629-b49186f8ccd0 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:31.217505 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb82730d-1d02-45d4-9629-b49186f8ccd0 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:31.217775 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb82730d-1d02-45d4-9629-b49186f8ccd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:31.234982 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-fb82730d-1d02-45d4-9629-b49186f8ccd0 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:40:31.236183 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-fb82730d-1d02-45d4-9629-b49186f8ccd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:40:31.304004 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3929/7830] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:40:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:40:31.315531 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a599c9-c638-466b-8c12-ce0bc33a1eb7 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:31.317120 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-86a599c9-c638-466b-8c12-ce0bc33a1eb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:40:31.341581 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:40:31.392593 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a599c9-c638-466b-8c12-ce0bc33a1eb7 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:31.397312 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9148fc59-1a15-4635-b7ab-1c1793cc89d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:31.398043 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9148fc59-1a15-4635-b7ab-1c1793cc89d8 service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:31.398511 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9148fc59-1a15-4635-b7ab-1c1793cc89d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:31.398790 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9148fc59-1a15-4635-b7ab-1c1793cc89d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:31.408636 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9148fc59-1a15-4635-b7ab-1c1793cc89d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:31.410106 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9148fc59-1a15-4635-b7ab-1c1793cc89d8 service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:31.420739 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3902/7831] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:40:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:40:32.101207 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb82730d-1d02-45d4-9629-b49186f8ccd0 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:32.102789 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-fb82730d-1d02-45d4-9629-b49186f8ccd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:40:32.115704 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb82730d-1d02-45d4-9629-b49186f8ccd0 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:32.120737 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95abbbe8-56af-4bf5-987e-683a5f094b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:32.121929 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95abbbe8-56af-4bf5-987e-683a5f094b75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:32.122239 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95abbbe8-56af-4bf5-987e-683a5f094b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:32.122845 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95abbbe8-56af-4bf5-987e-683a5f094b75 admin admin] PATH_INFO: `/v3/projects/4ecc13083f754f53815106fa286fed14` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:32.124018 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95abbbe8-56af-4bf5-987e-683a5f094b75 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ecc13083f754f53815106fa286fed14)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:32.126268 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95abbbe8-56af-4bf5-987e-683a5f094b75 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:32.173789 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:40:32.182193 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-95abbbe8-56af-4bf5-987e-683a5f094b75 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ecc13083f754f53815106fa286fed14', 'request_id': 'req-95abbbe8-56af-4bf5-987e-683a5f094b75'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:32.191390 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-95abbbe8-56af-4bf5-987e-683a5f094b75 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ecc13083f754f53815106fa286fed14', 'request_id': 'req-95abbbe8-56af-4bf5-987e-683a5f094b75'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:32.197563 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-95abbbe8-56af-4bf5-987e-683a5f094b75 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ecc13083f754f53815106fa286fed14', 'request_id': 'req-95abbbe8-56af-4bf5-987e-683a5f094b75'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:32.209284 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-95abbbe8-56af-4bf5-987e-683a5f094b75 admin admin] The token cache is being invalidate because project 4ecc13083f754f53815106fa286fed14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:40:32.209573 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-95abbbe8-56af-4bf5-987e-683a5f094b75 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:32.210403 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-95abbbe8-56af-4bf5-987e-683a5f094b75 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:32.212307 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3930/7832] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:40:32 2022] DELETE /identity/v3/projects/4ecc13083f754f53815106fa286fed14 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:40:32.216531 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9148fc59-1a15-4635-b7ab-1c1793cc89d8 service neutron] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:32.227401 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9148fc59-1a15-4635-b7ab-1c1793cc89d8 service neutron] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:32.287274 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb7145a-ef79-439c-9c4c-a79936cd474c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:32.288169 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb7145a-ef79-439c-9c4c-a79936cd474c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:32.288481 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb7145a-ef79-439c-9c4c-a79936cd474c admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:32.288757 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb7145a-ef79-439c-9c4c-a79936cd474c admin admin] PATH_INFO: `/v3/users/cfec8760be6e45eca8d5394089af0ccc` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:32.289981 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb7145a-ef79-439c-9c4c-a79936cd474c admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfec8760be6e45eca8d5394089af0ccc)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:32.292511 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb7145a-ef79-439c-9c4c-a79936cd474c admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:32.343947 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-6cb7145a-ef79-439c-9c4c-a79936cd474c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfec8760be6e45eca8d5394089af0ccc'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:32.353451 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-6cb7145a-ef79-439c-9c4c-a79936cd474c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfec8760be6e45eca8d5394089af0ccc'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:32.353451 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-6cb7145a-ef79-439c-9c4c-a79936cd474c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfec8760be6e45eca8d5394089af0ccc'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:32.361585 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-6cb7145a-ef79-439c-9c4c-a79936cd474c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfec8760be6e45eca8d5394089af0ccc'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:32.375743 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-6cb7145a-ef79-439c-9c4c-a79936cd474c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfec8760be6e45eca8d5394089af0ccc'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:32.383774 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3903/7833] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:40:32 2022] DELETE /identity/v3/users/cfec8760be6e45eca8d5394089af0ccc => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:40:32.675830 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95abbbe8-56af-4bf5-987e-683a5f094b75 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:32.678593 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-95abbbe8-56af-4bf5-987e-683a5f094b75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:40:32.697428 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95abbbe8-56af-4bf5-987e-683a5f094b75 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:32.759207 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a41b6bb-f45a-4a6a-a613-3298ac9de1a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:32.760101 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a41b6bb-f45a-4a6a-a613-3298ac9de1a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:32.760383 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a41b6bb-f45a-4a6a-a613-3298ac9de1a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:32.760657 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a41b6bb-f45a-4a6a-a613-3298ac9de1a2 admin admin] PATH_INFO: `/v3/projects/8942e35e4e3a481d834b4dede203c561` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:32.761836 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a41b6bb-f45a-4a6a-a613-3298ac9de1a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8942e35e4e3a481d834b4dede203c561)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:32.763837 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a41b6bb-f45a-4a6a-a613-3298ac9de1a2 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:32.811020 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-1a41b6bb-f45a-4a6a-a613-3298ac9de1a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8942e35e4e3a481d834b4dede203c561', 'request_id': 'req-1a41b6bb-f45a-4a6a-a613-3298ac9de1a2'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:32.820400 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-1a41b6bb-f45a-4a6a-a613-3298ac9de1a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8942e35e4e3a481d834b4dede203c561', 'request_id': 'req-1a41b6bb-f45a-4a6a-a613-3298ac9de1a2'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:32.828272 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-1a41b6bb-f45a-4a6a-a613-3298ac9de1a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8942e35e4e3a481d834b4dede203c561', 'request_id': 'req-1a41b6bb-f45a-4a6a-a613-3298ac9de1a2'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:32.841504 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-1a41b6bb-f45a-4a6a-a613-3298ac9de1a2 admin admin] The token cache is being invalidate because project 8942e35e4e3a481d834b4dede203c561 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:40:32.841790 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-1a41b6bb-f45a-4a6a-a613-3298ac9de1a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:32.842480 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-1a41b6bb-f45a-4a6a-a613-3298ac9de1a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:32.844080 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3931/7834] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:40:32 2022] DELETE /identity/v3/projects/8942e35e4e3a481d834b4dede203c561 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:40:32.849291 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d76e0d-d1ba-4ff8-b62d-f6ecf2eded27 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:32.849573 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d76e0d-d1ba-4ff8-b62d-f6ecf2eded27 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:32.849892 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d76e0d-d1ba-4ff8-b62d-f6ecf2eded27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:32.870345 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-b0d76e0d-d1ba-4ff8-b62d-f6ecf2eded27 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:40:32.871727 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-b0d76e0d-d1ba-4ff8-b62d-f6ecf2eded27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:40:32.912452 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:40:32.937088 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3904/7835] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:40:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:40:32.945736 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e90dc5-fc37-4a25-a625-fa4880b3b499 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:32.946267 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e90dc5-fc37-4a25-a625-fa4880b3b499 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:32.946726 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e90dc5-fc37-4a25-a625-fa4880b3b499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:32.970487 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-90e90dc5-fc37-4a25-a625-fa4880b3b499 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:40:32.971819 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-90e90dc5-fc37-4a25-a625-fa4880b3b499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:40:32.980386 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3932/7836] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:40:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:40:32.984658 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d76e0d-d1ba-4ff8-b62d-f6ecf2eded27 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:32.994628 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d76e0d-d1ba-4ff8-b62d-f6ecf2eded27 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:32.999271 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf45e57-99d8-470a-8e84-a74b5d449e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:32.999995 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf45e57-99d8-470a-8e84-a74b5d449e8e admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:33.000391 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf45e57-99d8-470a-8e84-a74b5d449e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:33.000604 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf45e57-99d8-470a-8e84-a74b5d449e8e admin admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:33.001330 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf45e57-99d8-470a-8e84-a74b5d449e8e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:40:33.001630 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf45e57-99d8-470a-8e84-a74b5d449e8e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:33.003277 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf45e57-99d8-470a-8e84-a74b5d449e8e admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:33.018629 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3905/7837] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:40:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:40:33.020045 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e90dc5-fc37-4a25-a625-fa4880b3b499 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:33.029748 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e90dc5-fc37-4a25-a625-fa4880b3b499 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:33.034679 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed030665-ea17-4134-8f43-24ee3405754a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:33.035452 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed030665-ea17-4134-8f43-24ee3405754a admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:33.035736 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed030665-ea17-4134-8f43-24ee3405754a admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:33.036008 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed030665-ea17-4134-8f43-24ee3405754a admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:33.036735 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed030665-ea17-4134-8f43-24ee3405754a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:33.039088 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed030665-ea17-4134-8f43-24ee3405754a admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:33.069850 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3933/7838] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:40:33 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:40:33.072260 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf45e57-99d8-470a-8e84-a74b5d449e8e admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:33.083009 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf45e57-99d8-470a-8e84-a74b5d449e8e admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:33.141831 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ada60c-653d-4990-9ca2-8d38f06b2258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:33.142778 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ada60c-653d-4990-9ca2-8d38f06b2258 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:33.143204 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ada60c-653d-4990-9ca2-8d38f06b2258 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:33.143458 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ada60c-653d-4990-9ca2-8d38f06b2258 admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:33.144277 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ada60c-653d-4990-9ca2-8d38f06b2258 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:33.146371 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ada60c-653d-4990-9ca2-8d38f06b2258 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:33.171532 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3906/7839] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:40:33 2022] POST /identity/v3/users => generated 287 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:40:33.175555 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed030665-ea17-4134-8f43-24ee3405754a admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:33.187303 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed030665-ea17-4134-8f43-24ee3405754a admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:33.192181 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894a9672-fcc5-4688-aebb-97a7858d7abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:33.192923 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894a9672-fcc5-4688-aebb-97a7858d7abf admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:33.193173 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894a9672-fcc5-4688-aebb-97a7858d7abf admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:33.193456 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894a9672-fcc5-4688-aebb-97a7858d7abf admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:33.194230 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894a9672-fcc5-4688-aebb-97a7858d7abf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:33.195887 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894a9672-fcc5-4688-aebb-97a7858d7abf admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:33.207501 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3934/7840] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:40:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 21:40:33.212450 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ada60c-653d-4990-9ca2-8d38f06b2258 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:33.223112 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ada60c-653d-4990-9ca2-8d38f06b2258 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:33.228702 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d56c21-d430-43f5-a476-64392ca01325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:33.229387 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d56c21-d430-43f5-a476-64392ca01325 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:33.229672 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d56c21-d430-43f5-a476-64392ca01325 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:33.229984 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d56c21-d430-43f5-a476-64392ca01325 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:33.230722 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d56c21-d430-43f5-a476-64392ca01325 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:33.232388 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d56c21-d430-43f5-a476-64392ca01325 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:33.245984 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3907/7841] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:40:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:40:33.247545 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894a9672-fcc5-4688-aebb-97a7858d7abf admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:33.258461 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894a9672-fcc5-4688-aebb-97a7858d7abf admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:33.263371 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696a9041-55d4-4736-8d47-b0f62dbc7028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:33.264330 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696a9041-55d4-4736-8d47-b0f62dbc7028 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:33.264617 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696a9041-55d4-4736-8d47-b0f62dbc7028 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:33.264892 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696a9041-55d4-4736-8d47-b0f62dbc7028 admin admin] PATH_INFO: `/v3/projects/10beab432052429980e2ba18efe8c2d1/users/944751e429034a7ca92ed973684ebecb/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:33.280100 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696a9041-55d4-4736-8d47-b0f62dbc7028 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10beab432052429980e2ba18efe8c2d1, user_id=944751e429034a7ca92ed973684ebecb, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:33.283138 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696a9041-55d4-4736-8d47-b0f62dbc7028 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:33.285459 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:40:33.299120 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3935/7842] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:40:33 2022] PUT /identity/v3/projects/10beab432052429980e2ba18efe8c2d1/users/944751e429034a7ca92ed973684ebecb/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:40:33.310948 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f9a784-5452-40d0-a56b-802d7231bb56 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:33.311237 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f9a784-5452-40d0-a56b-802d7231bb56 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:33.311518 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f9a784-5452-40d0-a56b-802d7231bb56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:33.340240 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-50f9a784-5452-40d0-a56b-802d7231bb56 None None] MFA Rules not processed for user `944751e429034a7ca92ed973684ebecb`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:40:33.341330 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-50f9a784-5452-40d0-a56b-802d7231bb56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:40:33.411262 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3908/7843] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:40:33 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:40:33.423051 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696a9041-55d4-4736-8d47-b0f62dbc7028 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:33.425011 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-696a9041-55d4-4736-8d47-b0f62dbc7028 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:40:33.489622 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696a9041-55d4-4736-8d47-b0f62dbc7028 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:33.493518 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234e6621-9c61-42d6-abd0-2e77ed6f1a2d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec5fd3a489c341b7964704d689037f05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:33.494235 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234e6621-9c61-42d6-abd0-2e77ed6f1a2d service cinder] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:33.494518 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234e6621-9c61-42d6-abd0-2e77ed6f1a2d service cinder] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:33.494795 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234e6621-9c61-42d6-abd0-2e77ed6f1a2d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:33.503641 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234e6621-9c61-42d6-abd0-2e77ed6f1a2d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:33.505023 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234e6621-9c61-42d6-abd0-2e77ed6f1a2d service cinder] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:33.514522 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3936/7844] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:40:33 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:40:33.534110 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f9a784-5452-40d0-a56b-802d7231bb56 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:33.576108 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:40:33.601835 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f9a784-5452-40d0-a56b-802d7231bb56 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:33.606740 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027dd3df-fe64-46fe-8cb8-703e0644e72f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:33.607634 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027dd3df-fe64-46fe-8cb8-703e0644e72f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:33.608038 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027dd3df-fe64-46fe-8cb8-703e0644e72f admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:33.608320 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027dd3df-fe64-46fe-8cb8-703e0644e72f admin admin] PATH_INFO: `/v3/users/944751e429034a7ca92ed973684ebecb` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:33.609558 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027dd3df-fe64-46fe-8cb8-703e0644e72f admin admin] RBAC: Authorizing `identity:delete_user(user_id=944751e429034a7ca92ed973684ebecb)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:33.611527 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027dd3df-fe64-46fe-8cb8-703e0644e72f admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:33.660901 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-027dd3df-fe64-46fe-8cb8-703e0644e72f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '944751e429034a7ca92ed973684ebecb'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:33.669153 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-027dd3df-fe64-46fe-8cb8-703e0644e72f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '944751e429034a7ca92ed973684ebecb'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:33.669960 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-027dd3df-fe64-46fe-8cb8-703e0644e72f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '944751e429034a7ca92ed973684ebecb'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:33.679658 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-027dd3df-fe64-46fe-8cb8-703e0644e72f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '944751e429034a7ca92ed973684ebecb'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:33.692306 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-027dd3df-fe64-46fe-8cb8-703e0644e72f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '944751e429034a7ca92ed973684ebecb'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:33.698778 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3909/7845] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:40:33 2022] DELETE /identity/v3/users/944751e429034a7ca92ed973684ebecb => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:40:33.703400 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d17129c-4073-44c4-bb04-e5f360e57bc0 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:33.703855 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d17129c-4073-44c4-bb04-e5f360e57bc0 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:33.704206 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d17129c-4073-44c4-bb04-e5f360e57bc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:33.722598 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-8d17129c-4073-44c4-bb04-e5f360e57bc0 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:40:33.723919 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-8d17129c-4073-44c4-bb04-e5f360e57bc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:40:33.788246 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3937/7846] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:40:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:40:33.798408 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027dd3df-fe64-46fe-8cb8-703e0644e72f admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:33.800106 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-027dd3df-fe64-46fe-8cb8-703e0644e72f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:40:33.871685 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027dd3df-fe64-46fe-8cb8-703e0644e72f admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:33.875910 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b416344-4587-4032-8e2b-7a757696a4be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:33.876573 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b416344-4587-4032-8e2b-7a757696a4be service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:33.876886 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b416344-4587-4032-8e2b-7a757696a4be service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:33.877140 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b416344-4587-4032-8e2b-7a757696a4be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:33.886968 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b416344-4587-4032-8e2b-7a757696a4be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:33.888420 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b416344-4587-4032-8e2b-7a757696a4be service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:33.898391 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3910/7847] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:40:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:40:34.081833 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d17129c-4073-44c4-bb04-e5f360e57bc0 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:34.084257 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-8d17129c-4073-44c4-bb04-e5f360e57bc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:40:34.102409 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d17129c-4073-44c4-bb04-e5f360e57bc0 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:34.107972 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdadabb4-e25a-4883-8a90-e4edad769652 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:34.108720 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdadabb4-e25a-4883-8a90-e4edad769652 service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:34.109074 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdadabb4-e25a-4883-8a90-e4edad769652 service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:34.109466 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdadabb4-e25a-4883-8a90-e4edad769652 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:34.111852 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-fdadabb4-e25a-4883-8a90-e4edad769652 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:40:34.182404 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b416344-4587-4032-8e2b-7a757696a4be service neutron] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:34.184417 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-7b416344-4587-4032-8e2b-7a757696a4be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:40:34.187181 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdadabb4-e25a-4883-8a90-e4edad769652 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:34.188634 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdadabb4-e25a-4883-8a90-e4edad769652 service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:34.200546 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b416344-4587-4032-8e2b-7a757696a4be service neutron] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:34.203029 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3938/7848] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:40:34 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 23 21:40:34.206362 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d65c25c-d12f-4e67-9716-c3ed73ddb569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:34.207519 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d65c25c-d12f-4e67-9716-c3ed73ddb569 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:34.208025 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d65c25c-d12f-4e67-9716-c3ed73ddb569 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:34.208504 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d65c25c-d12f-4e67-9716-c3ed73ddb569 admin admin] PATH_INFO: `/v3/projects/10beab432052429980e2ba18efe8c2d1` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:34.209947 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d65c25c-d12f-4e67-9716-c3ed73ddb569 admin admin] RBAC: Authorizing `identity:delete_project(project_id=10beab432052429980e2ba18efe8c2d1)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:34.213010 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d65c25c-d12f-4e67-9716-c3ed73ddb569 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:34.269282 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-3d65c25c-d12f-4e67-9716-c3ed73ddb569 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10beab432052429980e2ba18efe8c2d1', 'request_id': 'req-3d65c25c-d12f-4e67-9716-c3ed73ddb569'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:34.274158 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:40:34.285699 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-3d65c25c-d12f-4e67-9716-c3ed73ddb569 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10beab432052429980e2ba18efe8c2d1', 'request_id': 'req-3d65c25c-d12f-4e67-9716-c3ed73ddb569'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:34.294330 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-3d65c25c-d12f-4e67-9716-c3ed73ddb569 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10beab432052429980e2ba18efe8c2d1', 'request_id': 'req-3d65c25c-d12f-4e67-9716-c3ed73ddb569'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:34.306814 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-3d65c25c-d12f-4e67-9716-c3ed73ddb569 admin admin] The token cache is being invalidate because project 10beab432052429980e2ba18efe8c2d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:40:34.307144 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-3d65c25c-d12f-4e67-9716-c3ed73ddb569 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:34.307751 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-3d65c25c-d12f-4e67-9716-c3ed73ddb569 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:34.309344 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3911/7849] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:40:34 2022] DELETE /identity/v3/projects/10beab432052429980e2ba18efe8c2d1 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:40:34.314875 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183d5ba2-129e-45ee-b3f1-b6f70307587c None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:34.315371 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183d5ba2-129e-45ee-b3f1-b6f70307587c None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:34.316049 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183d5ba2-129e-45ee-b3f1-b6f70307587c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:34.339248 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-183d5ba2-129e-45ee-b3f1-b6f70307587c None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:40:34.340894 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-183d5ba2-129e-45ee-b3f1-b6f70307587c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:40:34.377778 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:40:34.422536 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3939/7850] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:40:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:40:34.527264 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244292f1-4b6f-4e2e-b1c8-341d00294c2d None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:34.527618 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244292f1-4b6f-4e2e-b1c8-341d00294c2d None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:34.527856 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244292f1-4b6f-4e2e-b1c8-341d00294c2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:34.551887 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-244292f1-4b6f-4e2e-b1c8-341d00294c2d None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:40:34.555498 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-244292f1-4b6f-4e2e-b1c8-341d00294c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:40:34.569957 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3912/7851] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:40:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:40:34.571513 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183d5ba2-129e-45ee-b3f1-b6f70307587c None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:34.582664 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183d5ba2-129e-45ee-b3f1-b6f70307587c None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:34.587912 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1cd983-f9ad-4715-8f3a-c0faa4b30621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:34.588976 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1cd983-f9ad-4715-8f3a-c0faa4b30621 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:34.589249 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1cd983-f9ad-4715-8f3a-c0faa4b30621 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:34.589521 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1cd983-f9ad-4715-8f3a-c0faa4b30621 admin admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:34.590301 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1cd983-f9ad-4715-8f3a-c0faa4b30621 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:40:34.590603 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1cd983-f9ad-4715-8f3a-c0faa4b30621 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:34.592249 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1cd983-f9ad-4715-8f3a-c0faa4b30621 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:34.605462 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3940/7852] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:40:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:40:34.610702 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244292f1-4b6f-4e2e-b1c8-341d00294c2d None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:34.621264 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244292f1-4b6f-4e2e-b1c8-341d00294c2d None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:34.627010 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29cf8e2-1e22-4243-affe-a8900be51718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:34.627691 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29cf8e2-1e22-4243-affe-a8900be51718 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:34.627976 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29cf8e2-1e22-4243-affe-a8900be51718 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:34.628253 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29cf8e2-1e22-4243-affe-a8900be51718 admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:34.628953 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29cf8e2-1e22-4243-affe-a8900be51718 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:34.630937 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29cf8e2-1e22-4243-affe-a8900be51718 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:34.662104 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3913/7853] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:40:34 2022] POST /identity/v3/projects => generated 385 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:40:34.666662 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1cd983-f9ad-4715-8f3a-c0faa4b30621 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:34.677226 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1cd983-f9ad-4715-8f3a-c0faa4b30621 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:34.754862 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8ccfd9-9ff0-40b5-9e29-1dfe20fb49be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:34.755570 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8ccfd9-9ff0-40b5-9e29-1dfe20fb49be admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:34.755920 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8ccfd9-9ff0-40b5-9e29-1dfe20fb49be admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:34.756107 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8ccfd9-9ff0-40b5-9e29-1dfe20fb49be admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:34.756856 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8ccfd9-9ff0-40b5-9e29-1dfe20fb49be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:34.758945 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8ccfd9-9ff0-40b5-9e29-1dfe20fb49be admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:34.786762 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3941/7854] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:40:34 2022] POST /identity/v3/users => generated 293 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:40:34.790366 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29cf8e2-1e22-4243-affe-a8900be51718 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:34.804914 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29cf8e2-1e22-4243-affe-a8900be51718 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:34.827712 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c8d2cb-b746-40ab-8245-4d926d932570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:34.828504 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c8d2cb-b746-40ab-8245-4d926d932570 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:34.828795 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c8d2cb-b746-40ab-8245-4d926d932570 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:34.829081 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c8d2cb-b746-40ab-8245-4d926d932570 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:34.830505 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c8d2cb-b746-40ab-8245-4d926d932570 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:34.832841 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c8d2cb-b746-40ab-8245-4d926d932570 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:34.848364 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3914/7855] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:40:34 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:40:34.852139 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8ccfd9-9ff0-40b5-9e29-1dfe20fb49be admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:34.863701 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8ccfd9-9ff0-40b5-9e29-1dfe20fb49be admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:34.869362 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791df4d7-82ef-46b5-9c91-e763470592bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:34.870092 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791df4d7-82ef-46b5-9c91-e763470592bc admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:34.870367 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791df4d7-82ef-46b5-9c91-e763470592bc admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:34.870655 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791df4d7-82ef-46b5-9c91-e763470592bc admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:34.871576 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791df4d7-82ef-46b5-9c91-e763470592bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:34.873182 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791df4d7-82ef-46b5-9c91-e763470592bc admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:34.888775 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3942/7856] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:40:34 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:40:34.890933 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c8d2cb-b746-40ab-8245-4d926d932570 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:34.902354 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c8d2cb-b746-40ab-8245-4d926d932570 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:34.907775 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790b6eb1-3406-449a-8c84-d0830c816f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:34.909753 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790b6eb1-3406-449a-8c84-d0830c816f5f admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:34.909753 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790b6eb1-3406-449a-8c84-d0830c816f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:34.909753 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790b6eb1-3406-449a-8c84-d0830c816f5f admin admin] PATH_INFO: `/v3/projects/74f16ffa165e4e199325bcf8fe025f23/users/9d3e4cfb85594aed8df78f04b4a5f781/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:34.928141 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790b6eb1-3406-449a-8c84-d0830c816f5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=74f16ffa165e4e199325bcf8fe025f23, user_id=9d3e4cfb85594aed8df78f04b4a5f781, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:34.931298 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790b6eb1-3406-449a-8c84-d0830c816f5f admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:34.959945 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3915/7857] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:40:34 2022] PUT /identity/v3/projects/74f16ffa165e4e199325bcf8fe025f23/users/9d3e4cfb85594aed8df78f04b4a5f781/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 21:40:34.962769 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cc6199-19ec-4b74-8cbf-4a7d1724ed6d None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:34.963275 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cc6199-19ec-4b74-8cbf-4a7d1724ed6d None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:34.963787 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cc6199-19ec-4b74-8cbf-4a7d1724ed6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:35.003621 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-99cc6199-19ec-4b74-8cbf-4a7d1724ed6d None None] MFA Rules not processed for user `9d3e4cfb85594aed8df78f04b4a5f781`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:40:35.005190 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-99cc6199-19ec-4b74-8cbf-4a7d1724ed6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:40:35.098809 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3943/7858] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:40:34 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:40:35.107755 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790b6eb1-3406-449a-8c84-d0830c816f5f admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:35.109895 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-790b6eb1-3406-449a-8c84-d0830c816f5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:40:35.173171 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790b6eb1-3406-449a-8c84-d0830c816f5f admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:35.178189 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda7ef79-c10d-4ead-bcfd-603ee3cac9a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec5fd3a489c341b7964704d689037f05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:35.179172 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda7ef79-c10d-4ead-bcfd-603ee3cac9a7 service cinder] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:35.179643 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda7ef79-c10d-4ead-bcfd-603ee3cac9a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:35.180112 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda7ef79-c10d-4ead-bcfd-603ee3cac9a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:35.189914 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda7ef79-c10d-4ead-bcfd-603ee3cac9a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:35.191643 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda7ef79-c10d-4ead-bcfd-603ee3cac9a7 service cinder] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:35.201832 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3916/7859] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:40:35 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 23 21:40:36.766930 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cc6199-19ec-4b74-8cbf-4a7d1724ed6d None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:36.802344 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:40:36.844580 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cc6199-19ec-4b74-8cbf-4a7d1724ed6d None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:36.850851 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cd0510-6b40-461f-a3f6-bb8b7648a4cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:36.851882 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cd0510-6b40-461f-a3f6-bb8b7648a4cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:36.852239 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cd0510-6b40-461f-a3f6-bb8b7648a4cd admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:36.852584 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cd0510-6b40-461f-a3f6-bb8b7648a4cd admin admin] PATH_INFO: `/v3/users/9d3e4cfb85594aed8df78f04b4a5f781` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:36.853924 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cd0510-6b40-461f-a3f6-bb8b7648a4cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d3e4cfb85594aed8df78f04b4a5f781)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:36.855950 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cd0510-6b40-461f-a3f6-bb8b7648a4cd admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:36.925946 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-86cd0510-6b40-461f-a3f6-bb8b7648a4cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d3e4cfb85594aed8df78f04b4a5f781'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:36.926711 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-86cd0510-6b40-461f-a3f6-bb8b7648a4cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d3e4cfb85594aed8df78f04b4a5f781'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:36.935963 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-86cd0510-6b40-461f-a3f6-bb8b7648a4cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d3e4cfb85594aed8df78f04b4a5f781'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:36.961722 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-86cd0510-6b40-461f-a3f6-bb8b7648a4cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d3e4cfb85594aed8df78f04b4a5f781'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:36.981895 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-86cd0510-6b40-461f-a3f6-bb8b7648a4cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d3e4cfb85594aed8df78f04b4a5f781'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:36.991727 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3944/7860] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:40:36 2022] DELETE /identity/v3/users/9d3e4cfb85594aed8df78f04b4a5f781 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:40:36.993738 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ee7ba2-2f8c-4a53-a2f3-7b58d7e46cb0 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:36.994242 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ee7ba2-2f8c-4a53-a2f3-7b58d7e46cb0 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:36.994350 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ee7ba2-2f8c-4a53-a2f3-7b58d7e46cb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:37.018991 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-94ee7ba2-2f8c-4a53-a2f3-7b58d7e46cb0 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:40:37.020311 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-94ee7ba2-2f8c-4a53-a2f3-7b58d7e46cb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:40:37.102199 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3917/7861] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:40:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:40:37.117547 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cd0510-6b40-461f-a3f6-bb8b7648a4cd admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:37.120139 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-86cd0510-6b40-461f-a3f6-bb8b7648a4cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:40:37.223955 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cd0510-6b40-461f-a3f6-bb8b7648a4cd admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:37.228122 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ad2b44-0560-4200-90d7-3495f67e1859 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:37.228870 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ad2b44-0560-4200-90d7-3495f67e1859 service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:37.229223 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ad2b44-0560-4200-90d7-3495f67e1859 service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:37.229568 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ad2b44-0560-4200-90d7-3495f67e1859 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:37.240971 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ad2b44-0560-4200-90d7-3495f67e1859 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:37.242969 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ad2b44-0560-4200-90d7-3495f67e1859 service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:37.256694 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3945/7862] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:40:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:40:37.633742 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ee7ba2-2f8c-4a53-a2f3-7b58d7e46cb0 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:37.636408 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-94ee7ba2-2f8c-4a53-a2f3-7b58d7e46cb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:40:37.676559 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ee7ba2-2f8c-4a53-a2f3-7b58d7e46cb0 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:37.684876 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab45a47-c654-43e0-b9a5-efb40aca7b26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:37.685856 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab45a47-c654-43e0-b9a5-efb40aca7b26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:37.686248 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab45a47-c654-43e0-b9a5-efb40aca7b26 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:37.686591 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab45a47-c654-43e0-b9a5-efb40aca7b26 admin admin] PATH_INFO: `/v3/projects/74f16ffa165e4e199325bcf8fe025f23` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:37.687311 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530116ba-47fc-4e8b-92a9-f7b599291cc9 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:37.687598 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530116ba-47fc-4e8b-92a9-f7b599291cc9 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:37.687953 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530116ba-47fc-4e8b-92a9-f7b599291cc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:37.688818 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab45a47-c654-43e0-b9a5-efb40aca7b26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=74f16ffa165e4e199325bcf8fe025f23)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:37.691108 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab45a47-c654-43e0-b9a5-efb40aca7b26 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:37.707470 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-530116ba-47fc-4e8b-92a9-f7b599291cc9 None None] MFA Rules not processed for user `96ade420fd324acfb57e4ac81bfece9e`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:40:37.708582 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-530116ba-47fc-4e8b-92a9-f7b599291cc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:40:37.719752 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:40:37.766974 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-0ab45a47-c654-43e0-b9a5-efb40aca7b26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74f16ffa165e4e199325bcf8fe025f23', 'request_id': 'req-0ab45a47-c654-43e0-b9a5-efb40aca7b26'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:37.776900 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-0ab45a47-c654-43e0-b9a5-efb40aca7b26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74f16ffa165e4e199325bcf8fe025f23', 'request_id': 'req-0ab45a47-c654-43e0-b9a5-efb40aca7b26'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:37.777623 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:40:37.783837 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-0ab45a47-c654-43e0-b9a5-efb40aca7b26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74f16ffa165e4e199325bcf8fe025f23', 'request_id': 'req-0ab45a47-c654-43e0-b9a5-efb40aca7b26'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:37.799421 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-0ab45a47-c654-43e0-b9a5-efb40aca7b26 admin admin] The token cache is being invalidate because project 74f16ffa165e4e199325bcf8fe025f23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:40:37.799913 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-0ab45a47-c654-43e0-b9a5-efb40aca7b26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:37.800631 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-0ab45a47-c654-43e0-b9a5-efb40aca7b26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:37.802612 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3918/7863] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:40:37 2022] DELETE /identity/v3/projects/74f16ffa165e4e199325bcf8fe025f23 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:40:37.805119 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3946/7864] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:40:37 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:40:37.814569 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e9c4b7-6f31-4556-974e-2f6d657bb133 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:37.814882 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e9c4b7-6f31-4556-974e-2f6d657bb133 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:37.815656 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e9c4b7-6f31-4556-974e-2f6d657bb133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:37.854153 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-51e9c4b7-6f31-4556-974e-2f6d657bb133 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:40:37.855694 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-51e9c4b7-6f31-4556-974e-2f6d657bb133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:40:37.976799 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3919/7865] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:40:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:40:37.985190 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2f4ce8-43e3-445d-888e-c19ad411979a None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:37.985649 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2f4ce8-43e3-445d-888e-c19ad411979a None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:37.986217 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2f4ce8-43e3-445d-888e-c19ad411979a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:38.019076 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-bf2f4ce8-43e3-445d-888e-c19ad411979a None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:40:38.020273 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-bf2f4ce8-43e3-445d-888e-c19ad411979a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:40:38.039923 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3947/7866] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:40:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:40:38.040455 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e9c4b7-6f31-4556-974e-2f6d657bb133 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:38.058856 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e9c4b7-6f31-4556-974e-2f6d657bb133 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:38.064720 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e919771-16a6-495d-b7de-6378d4adb6aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:38.065783 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e919771-16a6-495d-b7de-6378d4adb6aa admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:38.066302 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e919771-16a6-495d-b7de-6378d4adb6aa admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:38.066812 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e919771-16a6-495d-b7de-6378d4adb6aa admin admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:38.068050 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e919771-16a6-495d-b7de-6378d4adb6aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:40:38.068565 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e919771-16a6-495d-b7de-6378d4adb6aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:38.070804 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e919771-16a6-495d-b7de-6378d4adb6aa admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:38.097441 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2f4ce8-43e3-445d-888e-c19ad411979a None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:38.104074 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3920/7867] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:40:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 21:40:38.110494 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2f4ce8-43e3-445d-888e-c19ad411979a None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:38.115778 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8c0cd3-818d-4e4c-a5c0-c5a417d158d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:38.116877 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8c0cd3-818d-4e4c-a5c0-c5a417d158d1 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:38.117128 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8c0cd3-818d-4e4c-a5c0-c5a417d158d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:38.117425 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8c0cd3-818d-4e4c-a5c0-c5a417d158d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:38.118253 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8c0cd3-818d-4e4c-a5c0-c5a417d158d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:38.120339 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8c0cd3-818d-4e4c-a5c0-c5a417d158d1 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:38.154196 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3948/7868] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:40:38 2022] POST /identity/v3/projects => generated 377 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:40:38.157375 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e919771-16a6-495d-b7de-6378d4adb6aa admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:38.174113 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e919771-16a6-495d-b7de-6378d4adb6aa admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:38.271096 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139741cc-0192-47b1-a9b1-582e533c22fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:38.272063 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139741cc-0192-47b1-a9b1-582e533c22fe admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:38.272530 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139741cc-0192-47b1-a9b1-582e533c22fe admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:38.272908 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139741cc-0192-47b1-a9b1-582e533c22fe admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:38.273734 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139741cc-0192-47b1-a9b1-582e533c22fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:38.275911 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139741cc-0192-47b1-a9b1-582e533c22fe admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:38.306317 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3921/7869] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:40:38 2022] POST /identity/v3/users => generated 289 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:40:38.310330 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8c0cd3-818d-4e4c-a5c0-c5a417d158d1 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:38.326446 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8c0cd3-818d-4e4c-a5c0-c5a417d158d1 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:38.341778 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83c266f-57d9-485b-8b35-dfddf112aef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:38.342548 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83c266f-57d9-485b-8b35-dfddf112aef7 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:38.342836 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83c266f-57d9-485b-8b35-dfddf112aef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:38.343117 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83c266f-57d9-485b-8b35-dfddf112aef7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:38.343858 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83c266f-57d9-485b-8b35-dfddf112aef7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:38.350140 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83c266f-57d9-485b-8b35-dfddf112aef7 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:38.386535 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3949/7870] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:40:38 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:40:38.391503 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139741cc-0192-47b1-a9b1-582e533c22fe admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:38.405696 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139741cc-0192-47b1-a9b1-582e533c22fe admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:38.410999 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747db307-beb6-44b1-81a2-fbe1f6d94315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:38.412110 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747db307-beb6-44b1-81a2-fbe1f6d94315 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:38.412392 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747db307-beb6-44b1-81a2-fbe1f6d94315 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:38.412678 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747db307-beb6-44b1-81a2-fbe1f6d94315 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:38.413471 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747db307-beb6-44b1-81a2-fbe1f6d94315 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:38.421209 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747db307-beb6-44b1-81a2-fbe1f6d94315 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:38.446602 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3922/7871] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:40:38 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:40:38.449224 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83c266f-57d9-485b-8b35-dfddf112aef7 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:38.470696 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83c266f-57d9-485b-8b35-dfddf112aef7 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:38.477678 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59ca1f6-b399-4493-b334-7901292e2240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:38.479128 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59ca1f6-b399-4493-b334-7901292e2240 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:38.479490 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59ca1f6-b399-4493-b334-7901292e2240 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:38.479835 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59ca1f6-b399-4493-b334-7901292e2240 admin admin] PATH_INFO: `/v3/projects/55c0a719495842de958d3c4ba5ec87b2/users/d13d3e354fdd4d42af76e14e213de559/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:38.508144 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59ca1f6-b399-4493-b334-7901292e2240 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55c0a719495842de958d3c4ba5ec87b2, user_id=d13d3e354fdd4d42af76e14e213de559, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:38.512530 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59ca1f6-b399-4493-b334-7901292e2240 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:38.530707 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3950/7872] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:40:38 2022] PUT /identity/v3/projects/55c0a719495842de958d3c4ba5ec87b2/users/d13d3e354fdd4d42af76e14e213de559/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:40:38.541003 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d95300-9cdc-4b25-b0e0-716b00970550 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:38.541319 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d95300-9cdc-4b25-b0e0-716b00970550 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:38.541601 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d95300-9cdc-4b25-b0e0-716b00970550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:38.563131 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:40:38.572014 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-57d95300-9cdc-4b25-b0e0-716b00970550 None None] MFA Rules not processed for user `d13d3e354fdd4d42af76e14e213de559`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:40:38.574476 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-57d95300-9cdc-4b25-b0e0-716b00970550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:40:38.655730 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3923/7873] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:40:38 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:40:38.668210 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59ca1f6-b399-4493-b334-7901292e2240 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:38.669982 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-b59ca1f6-b399-4493-b334-7901292e2240 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:40:38.758420 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59ca1f6-b399-4493-b334-7901292e2240 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:38.763092 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c06ca6f-6df2-46b7-b0b3-6af2705f5e56 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec5fd3a489c341b7964704d689037f05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:38.764272 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c06ca6f-6df2-46b7-b0b3-6af2705f5e56 service cinder] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:38.764986 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c06ca6f-6df2-46b7-b0b3-6af2705f5e56 service cinder] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:38.765579 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c06ca6f-6df2-46b7-b0b3-6af2705f5e56 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:38.778181 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c06ca6f-6df2-46b7-b0b3-6af2705f5e56 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:38.779902 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c06ca6f-6df2-46b7-b0b3-6af2705f5e56 service cinder] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:38.790294 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3951/7874] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:40:38 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:40:40.599659 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d95300-9cdc-4b25-b0e0-716b00970550 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:40.674824 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d95300-9cdc-4b25-b0e0-716b00970550 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:40.681229 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7e025e-98ce-481e-acfd-e75379676b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:40.682278 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7e025e-98ce-481e-acfd-e75379676b75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:40.682621 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7e025e-98ce-481e-acfd-e75379676b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:40.683267 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7e025e-98ce-481e-acfd-e75379676b75 admin admin] PATH_INFO: `/v3/users/d13d3e354fdd4d42af76e14e213de559` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:40.684504 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7e025e-98ce-481e-acfd-e75379676b75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d13d3e354fdd4d42af76e14e213de559)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:40.686508 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7e025e-98ce-481e-acfd-e75379676b75 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:40.764788 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-dd7e025e-98ce-481e-acfd-e75379676b75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd13d3e354fdd4d42af76e14e213de559'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:40.773813 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-dd7e025e-98ce-481e-acfd-e75379676b75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd13d3e354fdd4d42af76e14e213de559'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:40.774766 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-dd7e025e-98ce-481e-acfd-e75379676b75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd13d3e354fdd4d42af76e14e213de559'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:40.785358 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-dd7e025e-98ce-481e-acfd-e75379676b75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd13d3e354fdd4d42af76e14e213de559'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:40.800762 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-dd7e025e-98ce-481e-acfd-e75379676b75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd13d3e354fdd4d42af76e14e213de559'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:40.809611 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3924/7875] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:40:40 2022] DELETE /identity/v3/users/d13d3e354fdd4d42af76e14e213de559 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:40:40.814975 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9ed44d-a8da-47ce-8f42-76986dfc715a None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:40.815877 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9ed44d-a8da-47ce-8f42-76986dfc715a None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:40.816341 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9ed44d-a8da-47ce-8f42-76986dfc715a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:40.854807 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-fc9ed44d-a8da-47ce-8f42-76986dfc715a None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:40:40.856330 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-fc9ed44d-a8da-47ce-8f42-76986dfc715a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:40:40.957046 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3952/7876] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:40:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 21:40:40.968362 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7e025e-98ce-481e-acfd-e75379676b75 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:40.969906 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-dd7e025e-98ce-481e-acfd-e75379676b75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:40:40.993164 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:40:41.033205 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7e025e-98ce-481e-acfd-e75379676b75 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:41.036793 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186f866d-0622-4784-b5e3-acf9ea20d6ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:41.037492 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186f866d-0622-4784-b5e3-acf9ea20d6ec service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:41.037767 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186f866d-0622-4784-b5e3-acf9ea20d6ec service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:41.038130 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186f866d-0622-4784-b5e3-acf9ea20d6ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:41.047469 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186f866d-0622-4784-b5e3-acf9ea20d6ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:41.048918 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186f866d-0622-4784-b5e3-acf9ea20d6ec service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:41.059207 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3925/7877] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:40:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:40:41.361048 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9ed44d-a8da-47ce-8f42-76986dfc715a None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:41.362445 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-fc9ed44d-a8da-47ce-8f42-76986dfc715a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:40:41.377163 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9ed44d-a8da-47ce-8f42-76986dfc715a None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:41.382369 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a138fa5-0cf9-4bc1-ad44-ed49fa9c7dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:41.383269 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a138fa5-0cf9-4bc1-ad44-ed49fa9c7dff admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:41.383543 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a138fa5-0cf9-4bc1-ad44-ed49fa9c7dff admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:41.383815 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a138fa5-0cf9-4bc1-ad44-ed49fa9c7dff admin admin] PATH_INFO: `/v3/projects/55c0a719495842de958d3c4ba5ec87b2` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:41.385037 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a138fa5-0cf9-4bc1-ad44-ed49fa9c7dff admin admin] RBAC: Authorizing `identity:delete_project(project_id=55c0a719495842de958d3c4ba5ec87b2)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:41.386972 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a138fa5-0cf9-4bc1-ad44-ed49fa9c7dff admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:41.429233 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:40:41.449989 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-8a138fa5-0cf9-4bc1-ad44-ed49fa9c7dff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55c0a719495842de958d3c4ba5ec87b2', 'request_id': 'req-8a138fa5-0cf9-4bc1-ad44-ed49fa9c7dff'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:41.457852 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-8a138fa5-0cf9-4bc1-ad44-ed49fa9c7dff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55c0a719495842de958d3c4ba5ec87b2', 'request_id': 'req-8a138fa5-0cf9-4bc1-ad44-ed49fa9c7dff'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:41.464131 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-8a138fa5-0cf9-4bc1-ad44-ed49fa9c7dff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55c0a719495842de958d3c4ba5ec87b2', 'request_id': 'req-8a138fa5-0cf9-4bc1-ad44-ed49fa9c7dff'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:41.476290 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-8a138fa5-0cf9-4bc1-ad44-ed49fa9c7dff admin admin] The token cache is being invalidate because project 55c0a719495842de958d3c4ba5ec87b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:40:41.476487 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-8a138fa5-0cf9-4bc1-ad44-ed49fa9c7dff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:41.477224 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-8a138fa5-0cf9-4bc1-ad44-ed49fa9c7dff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:41.478853 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3953/7878] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:40:41 2022] DELETE /identity/v3/projects/55c0a719495842de958d3c4ba5ec87b2 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:40:41.484063 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711e4798-1475-45ca-8a92-274d8e0e994c None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:41.484422 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711e4798-1475-45ca-8a92-274d8e0e994c None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:41.484706 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711e4798-1475-45ca-8a92-274d8e0e994c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:41.503332 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-711e4798-1475-45ca-8a92-274d8e0e994c None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:40:41.504580 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-711e4798-1475-45ca-8a92-274d8e0e994c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:40:41.570937 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3926/7879] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:40:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:40:41.580529 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30542b5-6636-4826-9449-e0c494969406 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:41.581051 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30542b5-6636-4826-9449-e0c494969406 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:41.581328 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30542b5-6636-4826-9449-e0c494969406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:41.603101 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-d30542b5-6636-4826-9449-e0c494969406 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:40:41.604372 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-d30542b5-6636-4826-9449-e0c494969406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:40:41.614345 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3954/7880] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:40:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:40:41.618821 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711e4798-1475-45ca-8a92-274d8e0e994c None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:41.631079 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711e4798-1475-45ca-8a92-274d8e0e994c None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:41.636648 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b3fc5d-90e6-404d-b923-aa09a3b1806b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:41.637613 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b3fc5d-90e6-404d-b923-aa09a3b1806b admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:41.638120 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b3fc5d-90e6-404d-b923-aa09a3b1806b admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:41.638550 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b3fc5d-90e6-404d-b923-aa09a3b1806b admin admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:41.639541 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b3fc5d-90e6-404d-b923-aa09a3b1806b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:40:41.639763 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b3fc5d-90e6-404d-b923-aa09a3b1806b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:41.641370 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b3fc5d-90e6-404d-b923-aa09a3b1806b admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:41.659747 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3927/7881] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:40:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:40:41.661125 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30542b5-6636-4826-9449-e0c494969406 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:41.675381 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30542b5-6636-4826-9449-e0c494969406 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:41.680637 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f2f8b9-73c7-4bb7-9aff-3925c5325637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:41.681462 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f2f8b9-73c7-4bb7-9aff-3925c5325637 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:41.681748 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f2f8b9-73c7-4bb7-9aff-3925c5325637 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:41.682071 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f2f8b9-73c7-4bb7-9aff-3925c5325637 admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:41.682787 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f2f8b9-73c7-4bb7-9aff-3925c5325637 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:41.684732 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f2f8b9-73c7-4bb7-9aff-3925c5325637 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:41.713392 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3955/7882] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:40:41 2022] POST /identity/v3/projects => generated 365 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:40:41.717642 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b3fc5d-90e6-404d-b923-aa09a3b1806b admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:41.728013 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b3fc5d-90e6-404d-b923-aa09a3b1806b admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:41.793411 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05eb60a-f8f0-4ab8-92ad-68825b32187a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:41.794242 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05eb60a-f8f0-4ab8-92ad-68825b32187a admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:41.794583 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05eb60a-f8f0-4ab8-92ad-68825b32187a admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:41.794924 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05eb60a-f8f0-4ab8-92ad-68825b32187a admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:41.795692 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05eb60a-f8f0-4ab8-92ad-68825b32187a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:41.797766 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05eb60a-f8f0-4ab8-92ad-68825b32187a admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:41.825565 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3928/7883] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:40:41 2022] POST /identity/v3/users => generated 283 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:40:41.830313 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f2f8b9-73c7-4bb7-9aff-3925c5325637 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:41.845209 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f2f8b9-73c7-4bb7-9aff-3925c5325637 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:41.851424 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd1806f-fdf8-45b4-8459-f0dd59a5d10a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:41.852372 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd1806f-fdf8-45b4-8459-f0dd59a5d10a admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:41.852654 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd1806f-fdf8-45b4-8459-f0dd59a5d10a admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:41.852931 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd1806f-fdf8-45b4-8459-f0dd59a5d10a admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:41.853679 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd1806f-fdf8-45b4-8459-f0dd59a5d10a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:41.855375 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd1806f-fdf8-45b4-8459-f0dd59a5d10a admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:41.870562 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3956/7884] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:40:41 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 21:40:41.872642 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05eb60a-f8f0-4ab8-92ad-68825b32187a admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:41.888638 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05eb60a-f8f0-4ab8-92ad-68825b32187a admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:41.894664 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a102dfc3-bdea-46d5-9187-91020e98c8fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:41.895443 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a102dfc3-bdea-46d5-9187-91020e98c8fd admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:41.895798 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a102dfc3-bdea-46d5-9187-91020e98c8fd admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:41.896136 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a102dfc3-bdea-46d5-9187-91020e98c8fd admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:41.897116 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a102dfc3-bdea-46d5-9187-91020e98c8fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:41.898930 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a102dfc3-bdea-46d5-9187-91020e98c8fd admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:41.910411 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3929/7885] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:40:41 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 21:40:41.914827 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd1806f-fdf8-45b4-8459-f0dd59a5d10a admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:41.926998 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd1806f-fdf8-45b4-8459-f0dd59a5d10a admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:41.932367 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b6fb08-d3da-441f-88dd-7003382c2566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:41.933358 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b6fb08-d3da-441f-88dd-7003382c2566 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:41.934163 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b6fb08-d3da-441f-88dd-7003382c2566 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:41.934163 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b6fb08-d3da-441f-88dd-7003382c2566 admin admin] PATH_INFO: `/v3/projects/159b9a8a61114a35819e2a692ededf60/users/7a04d41e1db440e28b37de86a00debd1/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:41.952246 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b6fb08-d3da-441f-88dd-7003382c2566 admin admin] RBAC: Authorizing `identity:create_grant(project_id=159b9a8a61114a35819e2a692ededf60, user_id=7a04d41e1db440e28b37de86a00debd1, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:41.962687 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b6fb08-d3da-441f-88dd-7003382c2566 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:41.990660 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3957/7886] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:40:41 2022] PUT /identity/v3/projects/159b9a8a61114a35819e2a692ededf60/users/7a04d41e1db440e28b37de86a00debd1/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:40:41.993600 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156d6d02-6bda-4dd7-9a32-c854cf5cc36c None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:41.993891 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156d6d02-6bda-4dd7-9a32-c854cf5cc36c None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:41.994338 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156d6d02-6bda-4dd7-9a32-c854cf5cc36c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:42.057979 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-156d6d02-6bda-4dd7-9a32-c854cf5cc36c None None] MFA Rules not processed for user `7a04d41e1db440e28b37de86a00debd1`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:40:42.059245 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-156d6d02-6bda-4dd7-9a32-c854cf5cc36c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:40:42.094118 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:40:42.155629 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3930/7887] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:40:41 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:40:42.168050 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b6fb08-d3da-441f-88dd-7003382c2566 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:42.169974 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-51b6fb08-d3da-441f-88dd-7003382c2566 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:40:42.240849 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b6fb08-d3da-441f-88dd-7003382c2566 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:42.246142 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684ccd80-f92d-442f-99c9-23e5580fe0de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec5fd3a489c341b7964704d689037f05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:42.246829 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684ccd80-f92d-442f-99c9-23e5580fe0de service cinder] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:42.247112 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684ccd80-f92d-442f-99c9-23e5580fe0de service cinder] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:42.247867 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684ccd80-f92d-442f-99c9-23e5580fe0de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:42.263504 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684ccd80-f92d-442f-99c9-23e5580fe0de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:42.264971 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684ccd80-f92d-442f-99c9-23e5580fe0de service cinder] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:42.277094 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3958/7888] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:40:42 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:40:46.889065 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156d6d02-6bda-4dd7-9a32-c854cf5cc36c None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:46.970590 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156d6d02-6bda-4dd7-9a32-c854cf5cc36c None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:46.975456 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3c5533-7b47-457d-8fa2-c34a63b2e765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:46.976464 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3c5533-7b47-457d-8fa2-c34a63b2e765 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:46.976915 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3c5533-7b47-457d-8fa2-c34a63b2e765 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:46.977274 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3c5533-7b47-457d-8fa2-c34a63b2e765 admin admin] PATH_INFO: `/v3/users/7a04d41e1db440e28b37de86a00debd1` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:46.978648 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3c5533-7b47-457d-8fa2-c34a63b2e765 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a04d41e1db440e28b37de86a00debd1)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:46.980637 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3c5533-7b47-457d-8fa2-c34a63b2e765 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:47.037548 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-6b3c5533-7b47-457d-8fa2-c34a63b2e765 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a04d41e1db440e28b37de86a00debd1'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:47.044595 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-6b3c5533-7b47-457d-8fa2-c34a63b2e765 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a04d41e1db440e28b37de86a00debd1'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:47.045307 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-6b3c5533-7b47-457d-8fa2-c34a63b2e765 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a04d41e1db440e28b37de86a00debd1'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:47.054834 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-6b3c5533-7b47-457d-8fa2-c34a63b2e765 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a04d41e1db440e28b37de86a00debd1'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:47.067422 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-6b3c5533-7b47-457d-8fa2-c34a63b2e765 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a04d41e1db440e28b37de86a00debd1'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:47.073560 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3931/7889] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:40:46 2022] DELETE /identity/v3/users/7a04d41e1db440e28b37de86a00debd1 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:40:47.078373 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7315d510-2ba6-482c-b460-2d412b1a6c20 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:47.078867 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7315d510-2ba6-482c-b460-2d412b1a6c20 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:47.079090 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7315d510-2ba6-482c-b460-2d412b1a6c20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:47.096870 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-7315d510-2ba6-482c-b460-2d412b1a6c20 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:40:47.098159 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-7315d510-2ba6-482c-b460-2d412b1a6c20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:40:47.151173 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:40:47.165501 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3959/7890] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:40:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:40:47.175752 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3c5533-7b47-457d-8fa2-c34a63b2e765 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:47.177416 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-6b3c5533-7b47-457d-8fa2-c34a63b2e765 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:40:47.222317 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:40:47.244746 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3c5533-7b47-457d-8fa2-c34a63b2e765 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:47.248746 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c3a4e5-31b0-41f9-9b16-2d71c718d621 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:47.249413 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c3a4e5-31b0-41f9-9b16-2d71c718d621 service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:47.249687 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c3a4e5-31b0-41f9-9b16-2d71c718d621 service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:47.249991 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c3a4e5-31b0-41f9-9b16-2d71c718d621 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:47.260429 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c3a4e5-31b0-41f9-9b16-2d71c718d621 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:47.261915 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c3a4e5-31b0-41f9-9b16-2d71c718d621 service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:47.272934 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3932/7891] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:40:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:40:47.596254 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7315d510-2ba6-482c-b460-2d412b1a6c20 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:47.598413 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-7315d510-2ba6-482c-b460-2d412b1a6c20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:40:47.611805 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7315d510-2ba6-482c-b460-2d412b1a6c20 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:47.617711 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cde8a7-1283-4726-8248-0a5df0c014c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:47.618779 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cde8a7-1283-4726-8248-0a5df0c014c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:47.619151 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cde8a7-1283-4726-8248-0a5df0c014c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:47.619644 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cde8a7-1283-4726-8248-0a5df0c014c7 admin admin] PATH_INFO: `/v3/projects/159b9a8a61114a35819e2a692ededf60` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:47.621382 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cde8a7-1283-4726-8248-0a5df0c014c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=159b9a8a61114a35819e2a692ededf60)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:47.623517 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cde8a7-1283-4726-8248-0a5df0c014c7 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:47.678090 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-a3cde8a7-1283-4726-8248-0a5df0c014c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '159b9a8a61114a35819e2a692ededf60', 'request_id': 'req-a3cde8a7-1283-4726-8248-0a5df0c014c7'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:47.687404 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-a3cde8a7-1283-4726-8248-0a5df0c014c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '159b9a8a61114a35819e2a692ededf60', 'request_id': 'req-a3cde8a7-1283-4726-8248-0a5df0c014c7'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:47.692986 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-a3cde8a7-1283-4726-8248-0a5df0c014c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '159b9a8a61114a35819e2a692ededf60', 'request_id': 'req-a3cde8a7-1283-4726-8248-0a5df0c014c7'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:47.704257 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-a3cde8a7-1283-4726-8248-0a5df0c014c7 admin admin] The token cache is being invalidate because project 159b9a8a61114a35819e2a692ededf60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:40:47.704542 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-a3cde8a7-1283-4726-8248-0a5df0c014c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:47.705168 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-a3cde8a7-1283-4726-8248-0a5df0c014c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:47.706868 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3960/7892] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:40:47 2022] DELETE /identity/v3/projects/159b9a8a61114a35819e2a692ededf60 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:40:47.712318 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc529042-bf8b-4670-84db-501e2beabb73 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:47.712608 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc529042-bf8b-4670-84db-501e2beabb73 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:47.712881 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc529042-bf8b-4670-84db-501e2beabb73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:47.731392 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-fc529042-bf8b-4670-84db-501e2beabb73 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:40:47.732613 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-fc529042-bf8b-4670-84db-501e2beabb73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:40:47.798062 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3933/7893] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:40:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:40:47.806248 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b71f5d-76e2-4e61-9f3f-baab0fe8885f None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:47.806531 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b71f5d-76e2-4e61-9f3f-baab0fe8885f None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:47.806804 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b71f5d-76e2-4e61-9f3f-baab0fe8885f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:47.827487 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-c4b71f5d-76e2-4e61-9f3f-baab0fe8885f None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:40:47.829087 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-c4b71f5d-76e2-4e61-9f3f-baab0fe8885f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:40:47.838635 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3961/7894] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:40:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:40:47.843100 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc529042-bf8b-4670-84db-501e2beabb73 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:47.853419 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc529042-bf8b-4670-84db-501e2beabb73 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:47.858763 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111f94ea-86fa-47c5-9eb1-cd1e5ad124ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:47.859423 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111f94ea-86fa-47c5-9eb1-cd1e5ad124ff admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:47.859702 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111f94ea-86fa-47c5-9eb1-cd1e5ad124ff admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:47.859977 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111f94ea-86fa-47c5-9eb1-cd1e5ad124ff admin admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:47.860704 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111f94ea-86fa-47c5-9eb1-cd1e5ad124ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:40:47.861005 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111f94ea-86fa-47c5-9eb1-cd1e5ad124ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:47.862649 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111f94ea-86fa-47c5-9eb1-cd1e5ad124ff admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:47.874459 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3934/7895] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:40:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:40:47.878656 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b71f5d-76e2-4e61-9f3f-baab0fe8885f None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:47.888130 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b71f5d-76e2-4e61-9f3f-baab0fe8885f None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:47.893279 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec7b690-f6a0-4298-89ac-78bfc06e2b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:47.893952 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec7b690-f6a0-4298-89ac-78bfc06e2b4c admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:47.894234 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec7b690-f6a0-4298-89ac-78bfc06e2b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:47.894511 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec7b690-f6a0-4298-89ac-78bfc06e2b4c admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:47.895163 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec7b690-f6a0-4298-89ac-78bfc06e2b4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:47.897080 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec7b690-f6a0-4298-89ac-78bfc06e2b4c admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:47.925499 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3962/7896] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:40:47 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:40:47.930054 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111f94ea-86fa-47c5-9eb1-cd1e5ad124ff admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:47.940671 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111f94ea-86fa-47c5-9eb1-cd1e5ad124ff admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:48.002609 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b7afac-6853-4128-8f6a-90e2460dbce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:48.003300 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b7afac-6853-4128-8f6a-90e2460dbce2 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:48.003574 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b7afac-6853-4128-8f6a-90e2460dbce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:48.003837 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b7afac-6853-4128-8f6a-90e2460dbce2 admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:48.004682 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b7afac-6853-4128-8f6a-90e2460dbce2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:48.006749 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b7afac-6853-4128-8f6a-90e2460dbce2 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:48.029449 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3935/7897] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:40:47 2022] POST /identity/v3/users => generated 287 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:40:48.033565 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec7b690-f6a0-4298-89ac-78bfc06e2b4c admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:48.044717 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec7b690-f6a0-4298-89ac-78bfc06e2b4c admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:48.050412 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3efa577-203f-4d0f-8806-490ae3b8b236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:48.051088 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3efa577-203f-4d0f-8806-490ae3b8b236 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:48.051368 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3efa577-203f-4d0f-8806-490ae3b8b236 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:48.051632 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3efa577-203f-4d0f-8806-490ae3b8b236 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:48.052358 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3efa577-203f-4d0f-8806-490ae3b8b236 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:48.053958 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3efa577-203f-4d0f-8806-490ae3b8b236 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:48.068251 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3963/7898] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:40:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:40:48.069773 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b7afac-6853-4128-8f6a-90e2460dbce2 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:48.080671 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b7afac-6853-4128-8f6a-90e2460dbce2 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:48.086703 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a419995e-59bc-49ea-ab23-a05b42eccd73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:48.087376 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a419995e-59bc-49ea-ab23-a05b42eccd73 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:48.087626 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a419995e-59bc-49ea-ab23-a05b42eccd73 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:48.087900 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a419995e-59bc-49ea-ab23-a05b42eccd73 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:48.088623 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a419995e-59bc-49ea-ab23-a05b42eccd73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:48.090297 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a419995e-59bc-49ea-ab23-a05b42eccd73 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:48.103855 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3936/7899] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:40:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:40:48.105112 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3efa577-203f-4d0f-8806-490ae3b8b236 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:48.116151 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3efa577-203f-4d0f-8806-490ae3b8b236 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:48.120975 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01753729-f545-4df0-99e0-446f3cbfcd5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:48.121892 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01753729-f545-4df0-99e0-446f3cbfcd5b admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:48.122191 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01753729-f545-4df0-99e0-446f3cbfcd5b admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:48.122463 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01753729-f545-4df0-99e0-446f3cbfcd5b admin admin] PATH_INFO: `/v3/projects/dde4411659a2433b86968f195a5d4b98/users/2be32f962c2c4d1c9551047dabebb43e/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:48.139236 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01753729-f545-4df0-99e0-446f3cbfcd5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=dde4411659a2433b86968f195a5d4b98, user_id=2be32f962c2c4d1c9551047dabebb43e, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:48.142056 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01753729-f545-4df0-99e0-446f3cbfcd5b admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:48.157458 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3964/7900] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:40:48 2022] PUT /identity/v3/projects/dde4411659a2433b86968f195a5d4b98/users/2be32f962c2c4d1c9551047dabebb43e/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:40:48.167837 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012b256e-4138-48ac-8b21-5b393fbc835d None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:48.168124 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012b256e-4138-48ac-8b21-5b393fbc835d None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:48.168452 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012b256e-4138-48ac-8b21-5b393fbc835d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:48.199709 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-012b256e-4138-48ac-8b21-5b393fbc835d None None] MFA Rules not processed for user `2be32f962c2c4d1c9551047dabebb43e`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:40:48.200942 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-012b256e-4138-48ac-8b21-5b393fbc835d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:40:48.235228 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:40:48.268146 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3937/7901] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:40:48 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:40:48.281719 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01753729-f545-4df0-99e0-446f3cbfcd5b admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:48.284044 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-01753729-f545-4df0-99e0-446f3cbfcd5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:40:48.349493 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01753729-f545-4df0-99e0-446f3cbfcd5b admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:48.354210 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7e20d9-f63e-4cd9-bb16-7a14dbecc849 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec5fd3a489c341b7964704d689037f05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:48.354861 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7e20d9-f63e-4cd9-bb16-7a14dbecc849 service cinder] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:48.355136 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7e20d9-f63e-4cd9-bb16-7a14dbecc849 service cinder] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:48.355406 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7e20d9-f63e-4cd9-bb16-7a14dbecc849 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:48.364723 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7e20d9-f63e-4cd9-bb16-7a14dbecc849 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:48.366187 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7e20d9-f63e-4cd9-bb16-7a14dbecc849 service cinder] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:48.375556 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3965/7902] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:40:48 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:40:49.938480 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012b256e-4138-48ac-8b21-5b393fbc835d None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:50.003987 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012b256e-4138-48ac-8b21-5b393fbc835d None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:50.008838 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37eaa9b-7bc0-4ea5-bc34-0af03b4f7f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:50.010009 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37eaa9b-7bc0-4ea5-bc34-0af03b4f7f9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:50.010132 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37eaa9b-7bc0-4ea5-bc34-0af03b4f7f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:50.010350 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37eaa9b-7bc0-4ea5-bc34-0af03b4f7f9c admin admin] PATH_INFO: `/v3/users/2be32f962c2c4d1c9551047dabebb43e` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:50.011655 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37eaa9b-7bc0-4ea5-bc34-0af03b4f7f9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=2be32f962c2c4d1c9551047dabebb43e)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:50.013610 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37eaa9b-7bc0-4ea5-bc34-0af03b4f7f9c admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:50.067995 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-d37eaa9b-7bc0-4ea5-bc34-0af03b4f7f9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2be32f962c2c4d1c9551047dabebb43e'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:50.075046 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-d37eaa9b-7bc0-4ea5-bc34-0af03b4f7f9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2be32f962c2c4d1c9551047dabebb43e'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:50.075655 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-d37eaa9b-7bc0-4ea5-bc34-0af03b4f7f9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2be32f962c2c4d1c9551047dabebb43e'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:50.083371 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-d37eaa9b-7bc0-4ea5-bc34-0af03b4f7f9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2be32f962c2c4d1c9551047dabebb43e'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:50.096423 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-d37eaa9b-7bc0-4ea5-bc34-0af03b4f7f9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2be32f962c2c4d1c9551047dabebb43e'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:50.102699 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3938/7903] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:40:49 2022] DELETE /identity/v3/users/2be32f962c2c4d1c9551047dabebb43e => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:40:50.107374 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a41fea8-4722-4c6d-9ab1-fc51a453b39e None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:50.107851 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a41fea8-4722-4c6d-9ab1-fc51a453b39e None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:50.107973 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a41fea8-4722-4c6d-9ab1-fc51a453b39e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:50.129880 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-0a41fea8-4722-4c6d-9ab1-fc51a453b39e None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:40:50.131021 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-0a41fea8-4722-4c6d-9ab1-fc51a453b39e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:40:50.145356 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:40:50.202913 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3966/7904] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:40:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:40:50.213293 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37eaa9b-7bc0-4ea5-bc34-0af03b4f7f9c admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:50.214897 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-d37eaa9b-7bc0-4ea5-bc34-0af03b4f7f9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:40:50.277874 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37eaa9b-7bc0-4ea5-bc34-0af03b4f7f9c admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:50.281809 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e7aa28-60f4-4f9f-94ea-3ac1050b9e72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:50.282591 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e7aa28-60f4-4f9f-94ea-3ac1050b9e72 service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:50.282881 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e7aa28-60f4-4f9f-94ea-3ac1050b9e72 service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:50.283749 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e7aa28-60f4-4f9f-94ea-3ac1050b9e72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:50.292934 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e7aa28-60f4-4f9f-94ea-3ac1050b9e72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:50.294647 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e7aa28-60f4-4f9f-94ea-3ac1050b9e72 service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:50.298672 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:40:50.306713 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3939/7905] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:40:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:40:50.587007 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a41fea8-4722-4c6d-9ab1-fc51a453b39e None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:50.589119 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-0a41fea8-4722-4c6d-9ab1-fc51a453b39e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:40:50.605580 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a41fea8-4722-4c6d-9ab1-fc51a453b39e None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:50.611745 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc79ed9b-07e4-473e-af2c-8d4b75dbe287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:50.612765 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc79ed9b-07e4-473e-af2c-8d4b75dbe287 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:50.613053 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc79ed9b-07e4-473e-af2c-8d4b75dbe287 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:50.613330 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc79ed9b-07e4-473e-af2c-8d4b75dbe287 admin admin] PATH_INFO: `/v3/projects/dde4411659a2433b86968f195a5d4b98` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:50.614761 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc79ed9b-07e4-473e-af2c-8d4b75dbe287 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dde4411659a2433b86968f195a5d4b98)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:50.616884 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc79ed9b-07e4-473e-af2c-8d4b75dbe287 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:50.668427 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-fc79ed9b-07e4-473e-af2c-8d4b75dbe287 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dde4411659a2433b86968f195a5d4b98', 'request_id': 'req-fc79ed9b-07e4-473e-af2c-8d4b75dbe287'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:50.676939 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-fc79ed9b-07e4-473e-af2c-8d4b75dbe287 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dde4411659a2433b86968f195a5d4b98', 'request_id': 'req-fc79ed9b-07e4-473e-af2c-8d4b75dbe287'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:50.684071 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-fc79ed9b-07e4-473e-af2c-8d4b75dbe287 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dde4411659a2433b86968f195a5d4b98', 'request_id': 'req-fc79ed9b-07e4-473e-af2c-8d4b75dbe287'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:50.696428 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-fc79ed9b-07e4-473e-af2c-8d4b75dbe287 admin admin] The token cache is being invalidate because project dde4411659a2433b86968f195a5d4b98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:40:50.696967 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-fc79ed9b-07e4-473e-af2c-8d4b75dbe287 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:50.697785 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-fc79ed9b-07e4-473e-af2c-8d4b75dbe287 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:40:50.699739 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3967/7906] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:40:50 2022] DELETE /identity/v3/projects/dde4411659a2433b86968f195a5d4b98 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:40:50.707589 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa28a001-9c05-4671-9b3c-591969062ffb None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:50.707879 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa28a001-9c05-4671-9b3c-591969062ffb None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:50.708161 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa28a001-9c05-4671-9b3c-591969062ffb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:50.727397 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-fa28a001-9c05-4671-9b3c-591969062ffb None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:40:50.728731 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-fa28a001-9c05-4671-9b3c-591969062ffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:40:50.791163 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3940/7907] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:40:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:40:50.800287 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f175636d-e7cb-41d6-844b-c811ecb1228e None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:50.800609 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f175636d-e7cb-41d6-844b-c811ecb1228e None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:50.800878 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f175636d-e7cb-41d6-844b-c811ecb1228e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:50.826274 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-f175636d-e7cb-41d6-844b-c811ecb1228e None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:40:50.827586 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-f175636d-e7cb-41d6-844b-c811ecb1228e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:40:50.839118 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3968/7908] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:40:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:40:50.843437 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa28a001-9c05-4671-9b3c-591969062ffb None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:50.854460 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa28a001-9c05-4671-9b3c-591969062ffb None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:50.859550 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9739924-fa12-49f5-91ed-21ee0bcbfb27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:50.860238 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9739924-fa12-49f5-91ed-21ee0bcbfb27 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:50.860512 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9739924-fa12-49f5-91ed-21ee0bcbfb27 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:50.860778 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9739924-fa12-49f5-91ed-21ee0bcbfb27 admin admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:50.861510 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9739924-fa12-49f5-91ed-21ee0bcbfb27 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:40:50.861812 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9739924-fa12-49f5-91ed-21ee0bcbfb27 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:50.863495 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9739924-fa12-49f5-91ed-21ee0bcbfb27 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:50.877948 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3941/7909] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:40:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:40:50.882816 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f175636d-e7cb-41d6-844b-c811ecb1228e None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:50.892847 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f175636d-e7cb-41d6-844b-c811ecb1228e None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:50.897900 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ccd7d6-5807-4aa1-a896-675321e23b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:50.898245 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ccd7d6-5807-4aa1-a896-675321e23b40 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:50.898650 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ccd7d6-5807-4aa1-a896-675321e23b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:50.898879 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ccd7d6-5807-4aa1-a896-675321e23b40 admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:50.899626 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ccd7d6-5807-4aa1-a896-675321e23b40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:50.901543 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ccd7d6-5807-4aa1-a896-675321e23b40 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:50.929635 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3969/7910] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:40:50 2022] POST /identity/v3/projects => generated 379 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:40:50.933895 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9739924-fa12-49f5-91ed-21ee0bcbfb27 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:50.944829 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9739924-fa12-49f5-91ed-21ee0bcbfb27 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:51.009097 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a76186-3257-4e45-807f-e43185677e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:51.009788 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a76186-3257-4e45-807f-e43185677e36 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:51.010108 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a76186-3257-4e45-807f-e43185677e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:51.010380 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a76186-3257-4e45-807f-e43185677e36 admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:51.011121 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a76186-3257-4e45-807f-e43185677e36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:51.013064 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a76186-3257-4e45-807f-e43185677e36 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:51.035691 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3942/7911] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:40:50 2022] POST /identity/v3/users => generated 290 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:40:51.040016 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ccd7d6-5807-4aa1-a896-675321e23b40 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:51.051380 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ccd7d6-5807-4aa1-a896-675321e23b40 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:51.056137 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5935a0e-64f2-4f2a-a925-2fe25b1f62e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:51.056942 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5935a0e-64f2-4f2a-a925-2fe25b1f62e2 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:51.057220 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5935a0e-64f2-4f2a-a925-2fe25b1f62e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:51.057487 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5935a0e-64f2-4f2a-a925-2fe25b1f62e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:51.058251 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5935a0e-64f2-4f2a-a925-2fe25b1f62e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:51.060162 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5935a0e-64f2-4f2a-a925-2fe25b1f62e2 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:51.072580 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3970/7912] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:40:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:40:51.076804 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a76186-3257-4e45-807f-e43185677e36 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:51.088736 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a76186-3257-4e45-807f-e43185677e36 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:51.094112 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebb11a8-4432-416c-9b86-f6339713f012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:51.094803 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebb11a8-4432-416c-9b86-f6339713f012 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:51.095080 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebb11a8-4432-416c-9b86-f6339713f012 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:51.095349 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebb11a8-4432-416c-9b86-f6339713f012 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:51.096083 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebb11a8-4432-416c-9b86-f6339713f012 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:51.097784 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebb11a8-4432-416c-9b86-f6339713f012 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:51.112424 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3943/7913] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:40:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:40:51.114078 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5935a0e-64f2-4f2a-a925-2fe25b1f62e2 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:51.125331 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5935a0e-64f2-4f2a-a925-2fe25b1f62e2 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:51.130449 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8285c07d-0467-4636-bfa6-26490a25c63d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:51.131452 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8285c07d-0467-4636-bfa6-26490a25c63d admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:51.131789 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8285c07d-0467-4636-bfa6-26490a25c63d admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:51.132128 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8285c07d-0467-4636-bfa6-26490a25c63d admin admin] PATH_INFO: `/v3/projects/219ae5cad0c341018edf6c57af2c3948/users/a041faf7139b4923a2dacefd5ec7834b/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:51.147867 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8285c07d-0467-4636-bfa6-26490a25c63d admin admin] RBAC: Authorizing `identity:create_grant(project_id=219ae5cad0c341018edf6c57af2c3948, user_id=a041faf7139b4923a2dacefd5ec7834b, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:51.150807 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8285c07d-0467-4636-bfa6-26490a25c63d admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:51.166012 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3971/7914] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:40:51 2022] PUT /identity/v3/projects/219ae5cad0c341018edf6c57af2c3948/users/a041faf7139b4923a2dacefd5ec7834b/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:40:51.171394 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a239feef-3d2e-4460-b7cb-f52d8f23d7c4 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:51.171780 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a239feef-3d2e-4460-b7cb-f52d8f23d7c4 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:51.172203 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a239feef-3d2e-4460-b7cb-f52d8f23d7c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:51.197598 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-a239feef-3d2e-4460-b7cb-f52d8f23d7c4 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:40:51.199252 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-a239feef-3d2e-4460-b7cb-f52d8f23d7c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:40:51.265886 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3944/7915] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:40:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:40:51.276001 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8285c07d-0467-4636-bfa6-26490a25c63d admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:51.277750 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-8285c07d-0467-4636-bfa6-26490a25c63d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:40:51.323350 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:40:51.346270 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8285c07d-0467-4636-bfa6-26490a25c63d admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:51.350465 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fdf79d-8e03-4909-9805-7e1b272098b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:51.351265 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fdf79d-8e03-4909-9805-7e1b272098b1 service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:51.351629 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fdf79d-8e03-4909-9805-7e1b272098b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:51.351968 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fdf79d-8e03-4909-9805-7e1b272098b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:51.362247 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fdf79d-8e03-4909-9805-7e1b272098b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:51.363699 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fdf79d-8e03-4909-9805-7e1b272098b1 service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:51.374447 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3972/7916] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:40:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:40:51.824285 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a239feef-3d2e-4460-b7cb-f52d8f23d7c4 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:51.826049 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-a239feef-3d2e-4460-b7cb-f52d8f23d7c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:40:51.833271 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:40:51.923590 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a239feef-3d2e-4460-b7cb-f52d8f23d7c4 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:51.933008 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f84db2-b077-4abb-9332-ffb102dc59a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:51.933672 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f84db2-b077-4abb-9332-ffb102dc59a7 service nova] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:51.933973 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f84db2-b077-4abb-9332-ffb102dc59a7 service nova] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:51.934249 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f84db2-b077-4abb-9332-ffb102dc59a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:51.936793 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-10f84db2-b077-4abb-9332-ffb102dc59a7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:40:51.952326 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f84db2-b077-4abb-9332-ffb102dc59a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:51.954097 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f84db2-b077-4abb-9332-ffb102dc59a7 service nova] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:51.973424 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3945/7917] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:40:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:40:55.484598 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74109217-db6f-4a97-aaf2-2586ae4423fe None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:55.485143 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74109217-db6f-4a97-aaf2-2586ae4423fe None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:55.485569 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74109217-db6f-4a97-aaf2-2586ae4423fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:55.520771 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-74109217-db6f-4a97-aaf2-2586ae4423fe None None] MFA Rules not processed for user `a041faf7139b4923a2dacefd5ec7834b`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:40:55.522043 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-74109217-db6f-4a97-aaf2-2586ae4423fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:40:55.591918 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3973/7918] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:40:55 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:40:55.596808 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f84db2-b077-4abb-9332-ffb102dc59a7 service nova] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:55.608130 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f84db2-b077-4abb-9332-ffb102dc59a7 service nova] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:55.617840 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4701f250-fdb9-456b-8509-33aaaa2dbc79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:55.618692 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4701f250-fdb9-456b-8509-33aaaa2dbc79 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:55.619050 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4701f250-fdb9-456b-8509-33aaaa2dbc79 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:55.619460 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4701f250-fdb9-456b-8509-33aaaa2dbc79 admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:55.620422 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4701f250-fdb9-456b-8509-33aaaa2dbc79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:55.622541 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4701f250-fdb9-456b-8509-33aaaa2dbc79 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:55.655212 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3946/7919] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:40:55 2022] POST /identity/v3/projects => generated 379 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:40:55.656379 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74109217-db6f-4a97-aaf2-2586ae4423fe None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:55.667625 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74109217-db6f-4a97-aaf2-2586ae4423fe None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:55.735158 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d31a7b0-a0c3-4136-bcc3-f329a0daaea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:55.735998 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d31a7b0-a0c3-4136-bcc3-f329a0daaea0 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:55.736275 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d31a7b0-a0c3-4136-bcc3-f329a0daaea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:55.736547 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d31a7b0-a0c3-4136-bcc3-f329a0daaea0 admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:55.737472 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d31a7b0-a0c3-4136-bcc3-f329a0daaea0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:55.739467 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d31a7b0-a0c3-4136-bcc3-f329a0daaea0 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:55.764888 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3974/7920] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:40:55 2022] POST /identity/v3/users => generated 296 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:40:55.766219 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4701f250-fdb9-456b-8509-33aaaa2dbc79 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:55.776993 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4701f250-fdb9-456b-8509-33aaaa2dbc79 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:55.781573 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8474dfce-d0db-430d-b67b-d0b593e46ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:55.782355 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8474dfce-d0db-430d-b67b-d0b593e46ff8 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:55.782623 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8474dfce-d0db-430d-b67b-d0b593e46ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:55.782891 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8474dfce-d0db-430d-b67b-d0b593e46ff8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:55.783637 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8474dfce-d0db-430d-b67b-d0b593e46ff8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:55.785397 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8474dfce-d0db-430d-b67b-d0b593e46ff8 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:55.797409 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3947/7921] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:40:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:40:55.802519 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d31a7b0-a0c3-4136-bcc3-f329a0daaea0 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:55.813844 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d31a7b0-a0c3-4136-bcc3-f329a0daaea0 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:55.820807 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca3a48d-eb7e-456f-ac2b-4ffe9858b4ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:55.821847 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca3a48d-eb7e-456f-ac2b-4ffe9858b4ef admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:55.822207 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca3a48d-eb7e-456f-ac2b-4ffe9858b4ef admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:55.822536 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca3a48d-eb7e-456f-ac2b-4ffe9858b4ef admin admin] PATH_INFO: `/v3/projects/8be2efa00b6549e3b234d43334ff6b64/users/6c971e6cd5c64d59bf7bbc04fead55b1/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:55.846286 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca3a48d-eb7e-456f-ac2b-4ffe9858b4ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=8be2efa00b6549e3b234d43334ff6b64, user_id=6c971e6cd5c64d59bf7bbc04fead55b1, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:55.849673 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca3a48d-eb7e-456f-ac2b-4ffe9858b4ef admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:55.872246 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8474dfce-d0db-430d-b67b-d0b593e46ff8 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:55.872696 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3975/7922] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:40:55 2022] PUT /identity/v3/projects/8be2efa00b6549e3b234d43334ff6b64/users/6c971e6cd5c64d59bf7bbc04fead55b1/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:40:55.896820 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8474dfce-d0db-430d-b67b-d0b593e46ff8 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:55.965656 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd042496-6a60-4e4b-9d6a-762ee5534761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:55.966406 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd042496-6a60-4e4b-9d6a-762ee5534761 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:55.966672 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd042496-6a60-4e4b-9d6a-762ee5534761 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:55.966961 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd042496-6a60-4e4b-9d6a-762ee5534761 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:55.967700 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd042496-6a60-4e4b-9d6a-762ee5534761 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:55.969346 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd042496-6a60-4e4b-9d6a-762ee5534761 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:55.981053 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3948/7923] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:40:55 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:40:55.985567 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca3a48d-eb7e-456f-ac2b-4ffe9858b4ef admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:40:55.996482 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca3a48d-eb7e-456f-ac2b-4ffe9858b4ef admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:40:56.001319 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d13e5e6-5512-4007-ac97-6ab9b9e886a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:40:56.002271 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d13e5e6-5512-4007-ac97-6ab9b9e886a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:40:56.002559 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d13e5e6-5512-4007-ac97-6ab9b9e886a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:40:56.002840 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d13e5e6-5512-4007-ac97-6ab9b9e886a7 admin admin] PATH_INFO: `/v3/projects/8be2efa00b6549e3b234d43334ff6b64/users/6c971e6cd5c64d59bf7bbc04fead55b1/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:40:56.005335 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d13e5e6-5512-4007-ac97-6ab9b9e886a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8be2efa00b6549e3b234d43334ff6b64, user_id=6c971e6cd5c64d59bf7bbc04fead55b1, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:40:56.007955 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d13e5e6-5512-4007-ac97-6ab9b9e886a7 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:40:56.019662 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3976/7924] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:40:55 2022] PUT /identity/v3/projects/8be2efa00b6549e3b234d43334ff6b64/users/6c971e6cd5c64d59bf7bbc04fead55b1/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:41:00.409514 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfca3c0-8a0a-4785-8115-334b4985d688 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:41:00.410554 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfca3c0-8a0a-4785-8115-334b4985d688 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:41:00.410900 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfca3c0-8a0a-4785-8115-334b4985d688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:41:00.439506 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-8dfca3c0-8a0a-4785-8115-334b4985d688 None None] MFA Rules not processed for user `6c971e6cd5c64d59bf7bbc04fead55b1`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:41:00.441017 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-8dfca3c0-8a0a-4785-8115-334b4985d688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:41:00.492165 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:41:00.524757 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3949/7925] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:41:00 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:41:00.537711 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d13e5e6-5512-4007-ac97-6ab9b9e886a7 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:41:00.564292 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:41:00.617479 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d13e5e6-5512-4007-ac97-6ab9b9e886a7 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:41:00.623869 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0e05ec-5b60-4a04-8283-c36c83aa0320 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:41:00.624556 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0e05ec-5b60-4a04-8283-c36c83aa0320 service nova] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:41:00.624833 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0e05ec-5b60-4a04-8283-c36c83aa0320 service nova] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:41:00.625110 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0e05ec-5b60-4a04-8283-c36c83aa0320 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:41:00.633762 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0e05ec-5b60-4a04-8283-c36c83aa0320 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:41:00.635392 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0e05ec-5b60-4a04-8283-c36c83aa0320 service nova] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:41:00.645170 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3977/7926] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:41:00 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:41:00.892492 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfca3c0-8a0a-4785-8115-334b4985d688 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:41:00.895118 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-8dfca3c0-8a0a-4785-8115-334b4985d688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:41:00.988602 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfca3c0-8a0a-4785-8115-334b4985d688 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:41:00.995938 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0604dd89-859b-4a32-a087-6f061f7690ff service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc719a3b3ac4461b82ca04ab6451d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:41:00.995938 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0604dd89-859b-4a32-a087-6f061f7690ff service placement] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:41:00.995938 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0604dd89-859b-4a32-a087-6f061f7690ff service placement] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:41:00.995938 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0604dd89-859b-4a32-a087-6f061f7690ff service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:41:00.998638 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-0604dd89-859b-4a32-a087-6f061f7690ff service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:41:01.023391 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0604dd89-859b-4a32-a087-6f061f7690ff service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:41:01.025089 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0604dd89-859b-4a32-a087-6f061f7690ff service placement] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:41:01.039497 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3950/7927] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:41:00 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:41:08.492174 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0e05ec-5b60-4a04-8283-c36c83aa0320 service nova] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:41:08.557844 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0e05ec-5b60-4a04-8283-c36c83aa0320 service nova] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:41:08.562679 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d72031-55d3-4ca6-8dbd-151a72399ead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:41:08.563605 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d72031-55d3-4ca6-8dbd-151a72399ead admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:41:08.563879 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d72031-55d3-4ca6-8dbd-151a72399ead admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:41:08.564153 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d72031-55d3-4ca6-8dbd-151a72399ead admin admin] PATH_INFO: `/v3/users/a041faf7139b4923a2dacefd5ec7834b` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:41:08.565385 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d72031-55d3-4ca6-8dbd-151a72399ead admin admin] RBAC: Authorizing `identity:delete_user(user_id=a041faf7139b4923a2dacefd5ec7834b)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:41:08.567350 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d72031-55d3-4ca6-8dbd-151a72399ead admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:41:08.620162 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-90d72031-55d3-4ca6-8dbd-151a72399ead admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a041faf7139b4923a2dacefd5ec7834b'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:41:08.620768 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-90d72031-55d3-4ca6-8dbd-151a72399ead admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a041faf7139b4923a2dacefd5ec7834b'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:41:08.627789 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-90d72031-55d3-4ca6-8dbd-151a72399ead admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a041faf7139b4923a2dacefd5ec7834b'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:41:08.637012 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-90d72031-55d3-4ca6-8dbd-151a72399ead admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a041faf7139b4923a2dacefd5ec7834b'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:41:08.649443 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-90d72031-55d3-4ca6-8dbd-151a72399ead admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a041faf7139b4923a2dacefd5ec7834b'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:41:08.655598 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3978/7928] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:41:08 2022] DELETE /identity/v3/users/a041faf7139b4923a2dacefd5ec7834b => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:41:08.841973 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0604dd89-859b-4a32-a087-6f061f7690ff service placement] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:41:08.861128 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0604dd89-859b-4a32-a087-6f061f7690ff service placement] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:41:08.918278 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4db7bd7-9a72-4762-9067-d781559257a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:41:08.919164 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4db7bd7-9a72-4762-9067-d781559257a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:41:08.919438 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4db7bd7-9a72-4762-9067-d781559257a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:41:08.919707 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4db7bd7-9a72-4762-9067-d781559257a6 admin admin] PATH_INFO: `/v3/projects/219ae5cad0c341018edf6c57af2c3948` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:41:08.920923 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4db7bd7-9a72-4762-9067-d781559257a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=219ae5cad0c341018edf6c57af2c3948)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:41:08.922894 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4db7bd7-9a72-4762-9067-d781559257a6 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:41:08.972143 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-d4db7bd7-9a72-4762-9067-d781559257a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '219ae5cad0c341018edf6c57af2c3948', 'request_id': 'req-d4db7bd7-9a72-4762-9067-d781559257a6'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:41:08.981539 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-d4db7bd7-9a72-4762-9067-d781559257a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '219ae5cad0c341018edf6c57af2c3948', 'request_id': 'req-d4db7bd7-9a72-4762-9067-d781559257a6'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:41:08.987025 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-d4db7bd7-9a72-4762-9067-d781559257a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '219ae5cad0c341018edf6c57af2c3948', 'request_id': 'req-d4db7bd7-9a72-4762-9067-d781559257a6'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:41:08.994044 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:41:08.998838 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-d4db7bd7-9a72-4762-9067-d781559257a6 admin admin] The token cache is being invalidate because project 219ae5cad0c341018edf6c57af2c3948 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:41:08.999110 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-d4db7bd7-9a72-4762-9067-d781559257a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:41:08.999875 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-d4db7bd7-9a72-4762-9067-d781559257a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:41:09.001559 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3951/7929] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:41:08 2022] DELETE /identity/v3/projects/219ae5cad0c341018edf6c57af2c3948 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:41:09.005786 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d72031-55d3-4ca6-8dbd-151a72399ead admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:41:09.007311 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-90d72031-55d3-4ca6-8dbd-151a72399ead admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:41:09.020943 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d72031-55d3-4ca6-8dbd-151a72399ead admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:41:09.045125 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:41:09.079041 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e6a827-d5f1-4b6e-9eac-a9b529238fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:41:09.079953 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e6a827-d5f1-4b6e-9eac-a9b529238fd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:41:09.080229 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e6a827-d5f1-4b6e-9eac-a9b529238fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:41:09.080493 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e6a827-d5f1-4b6e-9eac-a9b529238fd4 admin admin] PATH_INFO: `/v3/users/6c971e6cd5c64d59bf7bbc04fead55b1` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:41:09.081752 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e6a827-d5f1-4b6e-9eac-a9b529238fd4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c971e6cd5c64d59bf7bbc04fead55b1)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:41:09.083714 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e6a827-d5f1-4b6e-9eac-a9b529238fd4 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:41:09.134793 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-46e6a827-d5f1-4b6e-9eac-a9b529238fd4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c971e6cd5c64d59bf7bbc04fead55b1'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:41:09.135378 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-46e6a827-d5f1-4b6e-9eac-a9b529238fd4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c971e6cd5c64d59bf7bbc04fead55b1'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:41:09.142346 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-46e6a827-d5f1-4b6e-9eac-a9b529238fd4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c971e6cd5c64d59bf7bbc04fead55b1'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:41:09.152600 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-46e6a827-d5f1-4b6e-9eac-a9b529238fd4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c971e6cd5c64d59bf7bbc04fead55b1'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:41:09.165391 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-46e6a827-d5f1-4b6e-9eac-a9b529238fd4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c971e6cd5c64d59bf7bbc04fead55b1'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:41:09.171564 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3979/7930] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:41:09 2022] DELETE /identity/v3/users/6c971e6cd5c64d59bf7bbc04fead55b1 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:41:09.352415 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4db7bd7-9a72-4762-9067-d781559257a6 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:41:09.353876 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-d4db7bd7-9a72-4762-9067-d781559257a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:41:09.371882 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4db7bd7-9a72-4762-9067-d781559257a6 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:41:09.430090 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce31e297-0ac3-41c7-9a04-b7b583872957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:41:09.431114 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce31e297-0ac3-41c7-9a04-b7b583872957 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:41:09.431392 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce31e297-0ac3-41c7-9a04-b7b583872957 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:41:09.431688 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce31e297-0ac3-41c7-9a04-b7b583872957 admin admin] PATH_INFO: `/v3/projects/8be2efa00b6549e3b234d43334ff6b64` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:41:09.433299 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce31e297-0ac3-41c7-9a04-b7b583872957 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8be2efa00b6549e3b234d43334ff6b64)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:41:09.434841 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce31e297-0ac3-41c7-9a04-b7b583872957 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:41:09.486413 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-ce31e297-0ac3-41c7-9a04-b7b583872957 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8be2efa00b6549e3b234d43334ff6b64', 'request_id': 'req-ce31e297-0ac3-41c7-9a04-b7b583872957'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:41:09.495944 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-ce31e297-0ac3-41c7-9a04-b7b583872957 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8be2efa00b6549e3b234d43334ff6b64', 'request_id': 'req-ce31e297-0ac3-41c7-9a04-b7b583872957'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:41:09.501915 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-ce31e297-0ac3-41c7-9a04-b7b583872957 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8be2efa00b6549e3b234d43334ff6b64', 'request_id': 'req-ce31e297-0ac3-41c7-9a04-b7b583872957'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:41:09.515430 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-ce31e297-0ac3-41c7-9a04-b7b583872957 admin admin] The token cache is being invalidate because project 8be2efa00b6549e3b234d43334ff6b64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:41:09.515815 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-ce31e297-0ac3-41c7-9a04-b7b583872957 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:41:09.516751 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-ce31e297-0ac3-41c7-9a04-b7b583872957 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:41:09.519104 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3952/7931] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:41:09 2022] DELETE /identity/v3/projects/8be2efa00b6549e3b234d43334ff6b64 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:41:09.525498 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5347cce-284a-4078-ade5-c32d3b5415c2 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:41:09.526021 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5347cce-284a-4078-ade5-c32d3b5415c2 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:41:09.526021 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5347cce-284a-4078-ade5-c32d3b5415c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:41:09.555432 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-f5347cce-284a-4078-ade5-c32d3b5415c2 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:41:09.556627 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-f5347cce-284a-4078-ade5-c32d3b5415c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:41:09.620058 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3980/7932] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:41:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:41:09.628027 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458d0e10-0256-435d-ad37-1f7c7596850f None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:41:09.628314 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458d0e10-0256-435d-ad37-1f7c7596850f None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:41:09.628590 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458d0e10-0256-435d-ad37-1f7c7596850f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:41:09.647757 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-458d0e10-0256-435d-ad37-1f7c7596850f None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:41:09.649034 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-458d0e10-0256-435d-ad37-1f7c7596850f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:41:09.657663 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3953/7933] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:41:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:41:09.662246 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5347cce-284a-4078-ade5-c32d3b5415c2 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:41:09.672925 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5347cce-284a-4078-ade5-c32d3b5415c2 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:41:09.678576 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aec53c8-d1b1-4e32-81fd-9311bf942dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:41:09.679240 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aec53c8-d1b1-4e32-81fd-9311bf942dbe admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:41:09.679550 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aec53c8-d1b1-4e32-81fd-9311bf942dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:41:09.679862 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aec53c8-d1b1-4e32-81fd-9311bf942dbe admin admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:41:09.680918 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aec53c8-d1b1-4e32-81fd-9311bf942dbe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:41:09.681155 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aec53c8-d1b1-4e32-81fd-9311bf942dbe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:41:09.683162 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aec53c8-d1b1-4e32-81fd-9311bf942dbe admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:41:09.695492 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3981/7934] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:41:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:41:09.699895 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458d0e10-0256-435d-ad37-1f7c7596850f None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:41:09.709897 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458d0e10-0256-435d-ad37-1f7c7596850f None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:41:09.715395 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cca84df-2bcd-42de-8bd8-f80cf7eb3cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:41:09.716050 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cca84df-2bcd-42de-8bd8-f80cf7eb3cf1 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:41:09.716327 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cca84df-2bcd-42de-8bd8-f80cf7eb3cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:41:09.716598 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cca84df-2bcd-42de-8bd8-f80cf7eb3cf1 admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:41:09.717334 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cca84df-2bcd-42de-8bd8-f80cf7eb3cf1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:41:09.719308 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cca84df-2bcd-42de-8bd8-f80cf7eb3cf1 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:41:09.749877 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3954/7935] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:41:09 2022] POST /identity/v3/projects => generated 381 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 21:41:09.754326 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aec53c8-d1b1-4e32-81fd-9311bf942dbe admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:41:09.765308 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aec53c8-d1b1-4e32-81fd-9311bf942dbe admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:41:09.787035 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:41:09.825931 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f890579f-d19e-4aa7-9694-43300a1f537b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:41:09.826639 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f890579f-d19e-4aa7-9694-43300a1f537b admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:41:09.826898 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f890579f-d19e-4aa7-9694-43300a1f537b admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:41:09.827173 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f890579f-d19e-4aa7-9694-43300a1f537b admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:41:09.827868 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f890579f-d19e-4aa7-9694-43300a1f537b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:41:09.829778 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f890579f-d19e-4aa7-9694-43300a1f537b admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:41:09.854156 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3982/7936] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:41:09 2022] POST /identity/v3/users => generated 291 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:41:09.856650 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cca84df-2bcd-42de-8bd8-f80cf7eb3cf1 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:41:09.867670 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cca84df-2bcd-42de-8bd8-f80cf7eb3cf1 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:41:09.872866 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1be989-5333-4da7-81ad-8a887cee16b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:41:09.873530 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1be989-5333-4da7-81ad-8a887cee16b5 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:41:09.873813 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1be989-5333-4da7-81ad-8a887cee16b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:41:09.874132 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1be989-5333-4da7-81ad-8a887cee16b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:41:09.874864 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1be989-5333-4da7-81ad-8a887cee16b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:41:09.876483 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1be989-5333-4da7-81ad-8a887cee16b5 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:41:09.887879 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3955/7937] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:41:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:41:09.891890 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f890579f-d19e-4aa7-9694-43300a1f537b admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:41:09.902726 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f890579f-d19e-4aa7-9694-43300a1f537b admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:41:09.908476 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25964b9-eb7d-4a4e-b54b-7a81c47d83d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:41:09.909147 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25964b9-eb7d-4a4e-b54b-7a81c47d83d8 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:41:09.909429 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25964b9-eb7d-4a4e-b54b-7a81c47d83d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:41:09.909700 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25964b9-eb7d-4a4e-b54b-7a81c47d83d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:41:09.910441 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25964b9-eb7d-4a4e-b54b-7a81c47d83d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:41:09.912089 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25964b9-eb7d-4a4e-b54b-7a81c47d83d8 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:41:09.922532 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3983/7938] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:41:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:41:09.926778 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1be989-5333-4da7-81ad-8a887cee16b5 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:41:09.937088 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1be989-5333-4da7-81ad-8a887cee16b5 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:41:09.941817 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11402b5e-7190-45da-a602-afd77e5d917e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:41:09.942716 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11402b5e-7190-45da-a602-afd77e5d917e admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:41:09.943009 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11402b5e-7190-45da-a602-afd77e5d917e admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:41:09.943283 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11402b5e-7190-45da-a602-afd77e5d917e admin admin] PATH_INFO: `/v3/projects/8b579044b43f49b283e2e940ede4dff8/users/3d3c31f3bb7841cdaadd99719fb672e9/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:41:09.958136 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11402b5e-7190-45da-a602-afd77e5d917e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b579044b43f49b283e2e940ede4dff8, user_id=3d3c31f3bb7841cdaadd99719fb672e9, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:41:09.961156 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11402b5e-7190-45da-a602-afd77e5d917e admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:41:09.977161 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3956/7939] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:41:09 2022] PUT /identity/v3/projects/8b579044b43f49b283e2e940ede4dff8/users/3d3c31f3bb7841cdaadd99719fb672e9/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:41:09.982571 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd5fb8a-551e-4242-b06e-702904b0d238 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:41:09.982859 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd5fb8a-551e-4242-b06e-702904b0d238 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:41:09.983131 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd5fb8a-551e-4242-b06e-702904b0d238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:41:10.001668 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-2cd5fb8a-551e-4242-b06e-702904b0d238 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:41:10.002919 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-2cd5fb8a-551e-4242-b06e-702904b0d238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:41:10.063511 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3984/7940] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:41:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:41:10.073549 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11402b5e-7190-45da-a602-afd77e5d917e admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:41:10.075438 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-11402b5e-7190-45da-a602-afd77e5d917e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:41:10.104801 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:41:10.140155 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11402b5e-7190-45da-a602-afd77e5d917e admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:41:10.144309 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a907fcd-e8ee-4317-8e98-ec551c153626 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:41:10.144964 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a907fcd-e8ee-4317-8e98-ec551c153626 service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:41:10.145243 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a907fcd-e8ee-4317-8e98-ec551c153626 service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:41:10.145518 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a907fcd-e8ee-4317-8e98-ec551c153626 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:41:10.154936 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a907fcd-e8ee-4317-8e98-ec551c153626 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:41:10.156393 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a907fcd-e8ee-4317-8e98-ec551c153626 service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:41:10.166308 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3957/7941] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:41:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:41:14.280719 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c0d562-15d3-4aca-9696-c9beda0bc696 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:41:14.281242 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c0d562-15d3-4aca-9696-c9beda0bc696 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:41:14.281242 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c0d562-15d3-4aca-9696-c9beda0bc696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:41:14.311463 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-24c0d562-15d3-4aca-9696-c9beda0bc696 None None] MFA Rules not processed for user `3d3c31f3bb7841cdaadd99719fb672e9`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:41:14.313307 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-24c0d562-15d3-4aca-9696-c9beda0bc696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:41:14.397665 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3985/7942] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:41:14 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:41:14.402764 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a907fcd-e8ee-4317-8e98-ec551c153626 service neutron] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:41:14.412826 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a907fcd-e8ee-4317-8e98-ec551c153626 service neutron] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:41:14.417466 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6af00d5-9eaf-4a4c-a55d-c8b2c906e853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:41:14.418195 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6af00d5-9eaf-4a4c-a55d-c8b2c906e853 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:41:14.418477 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6af00d5-9eaf-4a4c-a55d-c8b2c906e853 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:41:14.418756 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6af00d5-9eaf-4a4c-a55d-c8b2c906e853 admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:41:14.419441 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6af00d5-9eaf-4a4c-a55d-c8b2c906e853 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:41:14.421360 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6af00d5-9eaf-4a4c-a55d-c8b2c906e853 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:41:14.457929 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3958/7943] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:41:14 2022] POST /identity/v3/projects => generated 381 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:41:14.459580 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c0d562-15d3-4aca-9696-c9beda0bc696 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:41:14.471481 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c0d562-15d3-4aca-9696-c9beda0bc696 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:41:14.504162 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:41:14.534790 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c8c3fe-5bab-4cc1-a710-d744e6907c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:41:14.535501 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c8c3fe-5bab-4cc1-a710-d744e6907c77 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:41:14.535776 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c8c3fe-5bab-4cc1-a710-d744e6907c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:41:14.536053 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c8c3fe-5bab-4cc1-a710-d744e6907c77 admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:41:14.536847 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c8c3fe-5bab-4cc1-a710-d744e6907c77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:41:14.538830 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c8c3fe-5bab-4cc1-a710-d744e6907c77 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:41:14.561916 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3986/7944] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:41:14 2022] POST /identity/v3/users => generated 297 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:41:14.565834 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6af00d5-9eaf-4a4c-a55d-c8b2c906e853 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:41:14.576724 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6af00d5-9eaf-4a4c-a55d-c8b2c906e853 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:41:14.581449 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ed51ab-e5fb-4973-96e9-541d89514d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:41:14.582172 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ed51ab-e5fb-4973-96e9-541d89514d88 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:41:14.582457 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ed51ab-e5fb-4973-96e9-541d89514d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:41:14.582736 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ed51ab-e5fb-4973-96e9-541d89514d88 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:41:14.583479 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ed51ab-e5fb-4973-96e9-541d89514d88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:41:14.585480 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ed51ab-e5fb-4973-96e9-541d89514d88 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:41:14.597052 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3959/7945] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:41:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 21:41:14.601418 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c8c3fe-5bab-4cc1-a710-d744e6907c77 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:41:14.613084 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c8c3fe-5bab-4cc1-a710-d744e6907c77 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:41:14.618029 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de005896-8935-4e21-a832-a9052891e800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:41:14.619165 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de005896-8935-4e21-a832-a9052891e800 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:41:14.619450 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de005896-8935-4e21-a832-a9052891e800 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:41:14.619737 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de005896-8935-4e21-a832-a9052891e800 admin admin] PATH_INFO: `/v3/projects/da45cbd222a74484ba999414a5863e7e/users/b764ea3d6c1b4954ba0f8b51fcf9f853/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:41:14.638384 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de005896-8935-4e21-a832-a9052891e800 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da45cbd222a74484ba999414a5863e7e, user_id=b764ea3d6c1b4954ba0f8b51fcf9f853, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:41:14.641001 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de005896-8935-4e21-a832-a9052891e800 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:41:14.656421 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3987/7946] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:41:14 2022] PUT /identity/v3/projects/da45cbd222a74484ba999414a5863e7e/users/b764ea3d6c1b4954ba0f8b51fcf9f853/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:41:14.660453 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ed51ab-e5fb-4973-96e9-541d89514d88 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:41:14.671452 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ed51ab-e5fb-4973-96e9-541d89514d88 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:41:14.730872 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc81242d-f85c-4bb0-ab43-956289469df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:41:14.731737 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc81242d-f85c-4bb0-ab43-956289469df5 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:41:14.732129 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc81242d-f85c-4bb0-ab43-956289469df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:41:14.732515 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc81242d-f85c-4bb0-ab43-956289469df5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:41:14.733316 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc81242d-f85c-4bb0-ab43-956289469df5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:41:14.735101 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc81242d-f85c-4bb0-ab43-956289469df5 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:41:14.753994 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3960/7947] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:41:14 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:41:14.755147 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de005896-8935-4e21-a832-a9052891e800 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:41:14.770190 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de005896-8935-4e21-a832-a9052891e800 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:41:14.779682 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1457a5fd-1f82-40eb-a672-8f8bb44cddaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:41:14.780622 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1457a5fd-1f82-40eb-a672-8f8bb44cddaa admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:41:14.780920 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1457a5fd-1f82-40eb-a672-8f8bb44cddaa admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:41:14.781199 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1457a5fd-1f82-40eb-a672-8f8bb44cddaa admin admin] PATH_INFO: `/v3/projects/da45cbd222a74484ba999414a5863e7e/users/b764ea3d6c1b4954ba0f8b51fcf9f853/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:41:14.783298 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1457a5fd-1f82-40eb-a672-8f8bb44cddaa admin admin] RBAC: Authorizing `identity:create_grant(project_id=da45cbd222a74484ba999414a5863e7e, user_id=b764ea3d6c1b4954ba0f8b51fcf9f853, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:41:14.787637 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1457a5fd-1f82-40eb-a672-8f8bb44cddaa admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:41:14.802177 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3988/7948] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:41:14 2022] PUT /identity/v3/projects/da45cbd222a74484ba999414a5863e7e/users/b764ea3d6c1b4954ba0f8b51fcf9f853/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:41:19.433020 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce3a7dd-664e-4e5a-b554-3875e4e19444 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:41:19.433548 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce3a7dd-664e-4e5a-b554-3875e4e19444 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:41:19.433548 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce3a7dd-664e-4e5a-b554-3875e4e19444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:41:19.461462 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-4ce3a7dd-664e-4e5a-b554-3875e4e19444 None None] MFA Rules not processed for user `b764ea3d6c1b4954ba0f8b51fcf9f853`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:41:19.462673 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-4ce3a7dd-664e-4e5a-b554-3875e4e19444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:41:19.535309 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3961/7949] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:41:19 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:41:19.547574 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1457a5fd-1f82-40eb-a672-8f8bb44cddaa admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:41:19.549637 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-1457a5fd-1f82-40eb-a672-8f8bb44cddaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:41:19.613639 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1457a5fd-1f82-40eb-a672-8f8bb44cddaa admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:41:19.617503 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08576a83-cfcc-47a4-8ddc-66e9a8625458 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7f2db148c8e4d5d81431cae3576434b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:41:19.618192 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08576a83-cfcc-47a4-8ddc-66e9a8625458 service glance] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:41:19.618468 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08576a83-cfcc-47a4-8ddc-66e9a8625458 service glance] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:41:19.618744 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08576a83-cfcc-47a4-8ddc-66e9a8625458 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:41:19.686145 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08576a83-cfcc-47a4-8ddc-66e9a8625458 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:41:19.687804 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08576a83-cfcc-47a4-8ddc-66e9a8625458 service glance] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:41:19.698549 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3989/7950] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:41:19 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:41:24.097758 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce3a7dd-664e-4e5a-b554-3875e4e19444 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:41:24.101051 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-4ce3a7dd-664e-4e5a-b554-3875e4e19444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:41:24.126920 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:41:24.228305 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce3a7dd-664e-4e5a-b554-3875e4e19444 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:41:24.233650 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa146514-9022-4563-8354-872c6baf011d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc719a3b3ac4461b82ca04ab6451d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:41:24.234407 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa146514-9022-4563-8354-872c6baf011d service placement] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:41:24.234774 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa146514-9022-4563-8354-872c6baf011d service placement] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:41:24.235237 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa146514-9022-4563-8354-872c6baf011d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:41:24.237657 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-fa146514-9022-4563-8354-872c6baf011d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:41:24.253178 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa146514-9022-4563-8354-872c6baf011d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:41:24.255059 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa146514-9022-4563-8354-872c6baf011d service placement] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:41:24.272167 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3962/7951] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:41:24 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:41:24.568110 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a1d81d-12cb-465f-8b12-8bb1b57593b8 None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:41:24.569259 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a1d81d-12cb-465f-8b12-8bb1b57593b8 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:41:24.569810 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a1d81d-12cb-465f-8b12-8bb1b57593b8 None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:41:24.572810 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3990/7952] 10.222.0.17 () {54 vars in 912 bytes} [Sat Jul 23 21:41:24 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:41:24.579996 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c269dc-a87f-4431-a976-d70390b2d07e None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:41:24.580274 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c269dc-a87f-4431-a976-d70390b2d07e None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:41:24.580512 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c269dc-a87f-4431-a976-d70390b2d07e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:41:24.631610 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-a9c269dc-a87f-4431-a976-d70390b2d07e None None] MFA Rules not processed for user `abc719a3b3ac4461b82ca04ab6451d81`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:41:24.632886 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-a9c269dc-a87f-4431-a976-d70390b2d07e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:41:24.643456 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3963/7953] 10.222.0.17 () {58 vars in 1009 bytes} [Sat Jul 23 21:41:24 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:41:24.674144 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a1d81d-12cb-465f-8b12-8bb1b57593b8 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:41:24.692466 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a1d81d-12cb-465f-8b12-8bb1b57593b8 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:41:24.699037 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e674b446-3381-467e-810f-085a63a04d91 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc719a3b3ac4461b82ca04ab6451d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:41:24.700474 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e674b446-3381-467e-810f-085a63a04d91 service placement] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:41:24.700958 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e674b446-3381-467e-810f-085a63a04d91 service placement] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:41:24.701441 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e674b446-3381-467e-810f-085a63a04d91 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:41:24.713026 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e674b446-3381-467e-810f-085a63a04d91 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:41:24.714673 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e674b446-3381-467e-810f-085a63a04d91 service placement] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:41:24.734118 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3991/7954] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:41:24 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:41:24.971154 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c269dc-a87f-4431-a976-d70390b2d07e None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:41:25.066393 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c269dc-a87f-4431-a976-d70390b2d07e None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:41:25.071520 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381ac771-17a0-4712-bb71-7023445d48da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:41:25.072211 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381ac771-17a0-4712-bb71-7023445d48da service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:41:25.072494 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381ac771-17a0-4712-bb71-7023445d48da service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:41:25.072768 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381ac771-17a0-4712-bb71-7023445d48da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:41:25.075032 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-381ac771-17a0-4712-bb71-7023445d48da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:41:25.095689 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381ac771-17a0-4712-bb71-7023445d48da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:41:25.098311 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381ac771-17a0-4712-bb71-7023445d48da service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:41:25.113900 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3964/7955] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:41:24 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:41:25.254049 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be77a08-3445-474d-8e26-11518f6e4f94 None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:41:25.254322 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be77a08-3445-474d-8e26-11518f6e4f94 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:41:25.254595 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be77a08-3445-474d-8e26-11518f6e4f94 None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:41:25.255989 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3992/7956] 10.222.0.17 () {54 vars in 921 bytes} [Sat Jul 23 21:41:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:41:25.261389 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f768488-0ae3-42de-b599-0a7d3c8bfa4c None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:41:25.261549 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f768488-0ae3-42de-b599-0a7d3c8bfa4c None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:41:25.261833 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f768488-0ae3-42de-b599-0a7d3c8bfa4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:41:25.289776 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-1f768488-0ae3-42de-b599-0a7d3c8bfa4c None None] MFA Rules not processed for user `abc719a3b3ac4461b82ca04ab6451d81`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:41:25.291027 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-1f768488-0ae3-42de-b599-0a7d3c8bfa4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:41:25.300189 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3965/7957] 10.222.0.17 () {58 vars in 1018 bytes} [Sat Jul 23 21:41:25 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:41:25.322517 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be77a08-3445-474d-8e26-11518f6e4f94 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:41:25.340780 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be77a08-3445-474d-8e26-11518f6e4f94 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:41:25.346707 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535d725a-0355-4fa3-805d-8d66548ec481 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc719a3b3ac4461b82ca04ab6451d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:41:25.347658 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535d725a-0355-4fa3-805d-8d66548ec481 service placement] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:41:25.348250 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535d725a-0355-4fa3-805d-8d66548ec481 service placement] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:41:25.348682 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535d725a-0355-4fa3-805d-8d66548ec481 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:41:25.360073 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535d725a-0355-4fa3-805d-8d66548ec481 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:41:25.361939 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535d725a-0355-4fa3-805d-8d66548ec481 service placement] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:41:25.373954 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3993/7958] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:41:25 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:41:25.554619 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f768488-0ae3-42de-b599-0a7d3c8bfa4c None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:41:25.556183 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-1f768488-0ae3-42de-b599-0a7d3c8bfa4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:41:25.571321 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f768488-0ae3-42de-b599-0a7d3c8bfa4c None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:41:25.575785 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd608e80-a233-495b-b5a3-895a2afa65db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:41:25.576451 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd608e80-a233-495b-b5a3-895a2afa65db service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:41:25.576723 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd608e80-a233-495b-b5a3-895a2afa65db service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:41:25.576979 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd608e80-a233-495b-b5a3-895a2afa65db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:41:25.578821 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-bd608e80-a233-495b-b5a3-895a2afa65db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:41:25.651790 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:41:25.656824 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd608e80-a233-495b-b5a3-895a2afa65db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:41:25.658356 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd608e80-a233-495b-b5a3-895a2afa65db service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:41:25.673278 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3966/7959] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:41:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:41:28.383832 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535d725a-0355-4fa3-805d-8d66548ec481 service placement] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:41:28.400933 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:41:28.455194 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535d725a-0355-4fa3-805d-8d66548ec481 service placement] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:41:28.460335 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef471cf7-b566-4415-9889-d0bf85f77501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:41:28.461305 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef471cf7-b566-4415-9889-d0bf85f77501 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:41:28.461579 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef471cf7-b566-4415-9889-d0bf85f77501 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:41:28.461849 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef471cf7-b566-4415-9889-d0bf85f77501 admin admin] PATH_INFO: `/v3/users/3d3c31f3bb7841cdaadd99719fb672e9` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:41:28.463112 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef471cf7-b566-4415-9889-d0bf85f77501 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d3c31f3bb7841cdaadd99719fb672e9)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:41:28.465097 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef471cf7-b566-4415-9889-d0bf85f77501 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:41:28.516261 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-ef471cf7-b566-4415-9889-d0bf85f77501 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d3c31f3bb7841cdaadd99719fb672e9'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:41:28.516911 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-ef471cf7-b566-4415-9889-d0bf85f77501 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d3c31f3bb7841cdaadd99719fb672e9'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:41:28.526233 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-ef471cf7-b566-4415-9889-d0bf85f77501 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d3c31f3bb7841cdaadd99719fb672e9'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:41:28.536119 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-ef471cf7-b566-4415-9889-d0bf85f77501 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d3c31f3bb7841cdaadd99719fb672e9'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:41:28.549236 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-ef471cf7-b566-4415-9889-d0bf85f77501 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d3c31f3bb7841cdaadd99719fb672e9'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:41:28.555446 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3994/7960] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:41:28 2022] DELETE /identity/v3/users/3d3c31f3bb7841cdaadd99719fb672e9 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:41:28.823850 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd608e80-a233-495b-b5a3-895a2afa65db service neutron] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:41:28.847551 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd608e80-a233-495b-b5a3-895a2afa65db service neutron] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:41:28.920997 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ecb39d-8eba-49e9-888a-3b8c026166a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:41:28.921903 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ecb39d-8eba-49e9-888a-3b8c026166a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:41:28.922171 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ecb39d-8eba-49e9-888a-3b8c026166a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:41:28.922436 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ecb39d-8eba-49e9-888a-3b8c026166a6 admin admin] PATH_INFO: `/v3/projects/8b579044b43f49b283e2e940ede4dff8` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:41:28.923687 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ecb39d-8eba-49e9-888a-3b8c026166a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b579044b43f49b283e2e940ede4dff8)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:41:28.926059 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ecb39d-8eba-49e9-888a-3b8c026166a6 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:41:28.973589 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-46ecb39d-8eba-49e9-888a-3b8c026166a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b579044b43f49b283e2e940ede4dff8', 'request_id': 'req-46ecb39d-8eba-49e9-888a-3b8c026166a6'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:41:28.981683 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-46ecb39d-8eba-49e9-888a-3b8c026166a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b579044b43f49b283e2e940ede4dff8', 'request_id': 'req-46ecb39d-8eba-49e9-888a-3b8c026166a6'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:41:28.987663 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-46ecb39d-8eba-49e9-888a-3b8c026166a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b579044b43f49b283e2e940ede4dff8', 'request_id': 'req-46ecb39d-8eba-49e9-888a-3b8c026166a6'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:41:28.998879 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-46ecb39d-8eba-49e9-888a-3b8c026166a6 admin admin] The token cache is being invalidate because project 8b579044b43f49b283e2e940ede4dff8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:41:28.999149 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-46ecb39d-8eba-49e9-888a-3b8c026166a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:41:28.999798 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-46ecb39d-8eba-49e9-888a-3b8c026166a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:41:29.001630 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3967/7961] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:41:28 2022] DELETE /identity/v3/projects/8b579044b43f49b283e2e940ede4dff8 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:41:29.005632 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef471cf7-b566-4415-9889-d0bf85f77501 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:41:29.007508 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-ef471cf7-b566-4415-9889-d0bf85f77501 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:41:29.021258 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef471cf7-b566-4415-9889-d0bf85f77501 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:41:29.077211 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6003a93-461c-4e48-8b41-b9e44ec77f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:41:29.078155 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6003a93-461c-4e48-8b41-b9e44ec77f4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:41:29.078425 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6003a93-461c-4e48-8b41-b9e44ec77f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:41:29.078701 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6003a93-461c-4e48-8b41-b9e44ec77f4f admin admin] PATH_INFO: `/v3/users/b764ea3d6c1b4954ba0f8b51fcf9f853` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:41:29.079904 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6003a93-461c-4e48-8b41-b9e44ec77f4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b764ea3d6c1b4954ba0f8b51fcf9f853)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:41:29.081833 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6003a93-461c-4e48-8b41-b9e44ec77f4f admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:41:29.120454 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:41:29.131564 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-f6003a93-461c-4e48-8b41-b9e44ec77f4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b764ea3d6c1b4954ba0f8b51fcf9f853'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:41:29.132219 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-f6003a93-461c-4e48-8b41-b9e44ec77f4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b764ea3d6c1b4954ba0f8b51fcf9f853'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:41:29.139384 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-f6003a93-461c-4e48-8b41-b9e44ec77f4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b764ea3d6c1b4954ba0f8b51fcf9f853'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:41:29.147815 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-f6003a93-461c-4e48-8b41-b9e44ec77f4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b764ea3d6c1b4954ba0f8b51fcf9f853'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:41:29.161298 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-f6003a93-461c-4e48-8b41-b9e44ec77f4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b764ea3d6c1b4954ba0f8b51fcf9f853'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:41:29.167892 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3995/7962] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:41:29 2022] DELETE /identity/v3/users/b764ea3d6c1b4954ba0f8b51fcf9f853 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:41:29.350312 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ecb39d-8eba-49e9-888a-3b8c026166a6 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:41:29.351866 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-46ecb39d-8eba-49e9-888a-3b8c026166a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:41:29.365681 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ecb39d-8eba-49e9-888a-3b8c026166a6 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:41:29.425192 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff7cf2c-d839-461e-8dd8-95f97abcbddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:41:29.426095 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff7cf2c-d839-461e-8dd8-95f97abcbddf admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:41:29.426373 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff7cf2c-d839-461e-8dd8-95f97abcbddf admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:41:29.426644 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff7cf2c-d839-461e-8dd8-95f97abcbddf admin admin] PATH_INFO: `/v3/projects/da45cbd222a74484ba999414a5863e7e` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:41:29.427899 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff7cf2c-d839-461e-8dd8-95f97abcbddf admin admin] RBAC: Authorizing `identity:delete_project(project_id=da45cbd222a74484ba999414a5863e7e)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:41:29.429897 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff7cf2c-d839-461e-8dd8-95f97abcbddf admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:41:29.463101 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:41:29.480452 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-6ff7cf2c-d839-461e-8dd8-95f97abcbddf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da45cbd222a74484ba999414a5863e7e', 'request_id': 'req-6ff7cf2c-d839-461e-8dd8-95f97abcbddf'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:41:29.490713 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-6ff7cf2c-d839-461e-8dd8-95f97abcbddf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da45cbd222a74484ba999414a5863e7e', 'request_id': 'req-6ff7cf2c-d839-461e-8dd8-95f97abcbddf'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:41:29.499705 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-6ff7cf2c-d839-461e-8dd8-95f97abcbddf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da45cbd222a74484ba999414a5863e7e', 'request_id': 'req-6ff7cf2c-d839-461e-8dd8-95f97abcbddf'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:41:29.513602 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-6ff7cf2c-d839-461e-8dd8-95f97abcbddf admin admin] The token cache is being invalidate because project da45cbd222a74484ba999414a5863e7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:41:29.513894 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-6ff7cf2c-d839-461e-8dd8-95f97abcbddf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:41:29.514902 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-6ff7cf2c-d839-461e-8dd8-95f97abcbddf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:41:29.517300 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3968/7963] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:41:29 2022] DELETE /identity/v3/projects/da45cbd222a74484ba999414a5863e7e => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:41:39.164336 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=16,keystone:DELETE=5,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:41:39.510301 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=14,keystone:DELETE=5,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:41:41.397668 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6003a93-461c-4e48-8b41-b9e44ec77f4f admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:41:41.399429 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-f6003a93-461c-4e48-8b41-b9e44ec77f4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:41:41.482126 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6003a93-461c-4e48-8b41-b9e44ec77f4f admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:41:41.551334 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b94365-d921-488d-ae06-2659b38d2c8d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc719a3b3ac4461b82ca04ab6451d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:41:41.552002 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b94365-d921-488d-ae06-2659b38d2c8d service placement] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:41:41.552280 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b94365-d921-488d-ae06-2659b38d2c8d service placement] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:41:41.552551 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b94365-d921-488d-ae06-2659b38d2c8d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:41:41.554403 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-95b94365-d921-488d-ae06-2659b38d2c8d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:41:41.568457 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b94365-d921-488d-ae06-2659b38d2c8d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:41:41.570069 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b94365-d921-488d-ae06-2659b38d2c8d service placement] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:41:41.582570 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3996/7964] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:41:41 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:41:51.576279 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=58 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:42:38.029904 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb4a93e-b364-4d0c-b0d6-be33053f525b None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:42:38.030423 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb4a93e-b364-4d0c-b0d6-be33053f525b None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:42:38.030423 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb4a93e-b364-4d0c-b0d6-be33053f525b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:42:38.050394 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-4bb4a93e-b364-4d0c-b0d6-be33053f525b None None] MFA Rules not processed for user `96ade420fd324acfb57e4ac81bfece9e`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:42:38.053010 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-4bb4a93e-b364-4d0c-b0d6-be33053f525b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:42:38.123833 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3969/7965] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:42:38 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:42:48.116762 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=25 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:43:25.513488 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b916fa77-7b70-48b1-86fd-cd8eb6898633 None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:43:25.514130 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b916fa77-7b70-48b1-86fd-cd8eb6898633 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:43:25.514130 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b916fa77-7b70-48b1-86fd-cd8eb6898633 None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:43:25.515684 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3997/7966] 10.222.0.17 () {54 vars in 921 bytes} [Sat Jul 23 21:43:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:43:25.520801 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3001acc-df0a-4847-9658-0ad01e1618ed None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:43:25.521286 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3001acc-df0a-4847-9658-0ad01e1618ed None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:43:25.521462 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3001acc-df0a-4847-9658-0ad01e1618ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:43:25.552316 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-e3001acc-df0a-4847-9658-0ad01e1618ed None None] MFA Rules not processed for user `abc719a3b3ac4461b82ca04ab6451d81`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:43:25.553596 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-e3001acc-df0a-4847-9658-0ad01e1618ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:43:25.562619 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3970/7967] 10.222.0.17 () {58 vars in 1018 bytes} [Sat Jul 23 21:43:25 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:43:25.584425 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b916fa77-7b70-48b1-86fd-cd8eb6898633 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:43:25.586287 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-b916fa77-7b70-48b1-86fd-cd8eb6898633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:43:25.606202 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b916fa77-7b70-48b1-86fd-cd8eb6898633 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:43:25.611846 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3510ce-c4ab-40e9-890f-10f7f07af230 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc719a3b3ac4461b82ca04ab6451d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:43:25.612540 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3510ce-c4ab-40e9-890f-10f7f07af230 service placement] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:43:25.612819 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3510ce-c4ab-40e9-890f-10f7f07af230 service placement] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:43:25.613087 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3510ce-c4ab-40e9-890f-10f7f07af230 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:43:25.623256 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3510ce-c4ab-40e9-890f-10f7f07af230 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:43:25.624894 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3510ce-c4ab-40e9-890f-10f7f07af230 service placement] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:43:25.635634 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3998/7968] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:43:25 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:43:31.378265 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3001acc-df0a-4847-9658-0ad01e1618ed None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:43:31.380021 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-e3001acc-df0a-4847-9658-0ad01e1618ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:43:31.446731 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3001acc-df0a-4847-9658-0ad01e1618ed None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:43:31.451331 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf4aca2-00c0-4853-92c5-00c774ab6ba6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:43:31.451994 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf4aca2-00c0-4853-92c5-00c774ab6ba6 service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:43:31.452275 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf4aca2-00c0-4853-92c5-00c774ab6ba6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:43:31.452574 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf4aca2-00c0-4853-92c5-00c774ab6ba6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:43:31.455151 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-5cf4aca2-00c0-4853-92c5-00c774ab6ba6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:43:31.550361 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf4aca2-00c0-4853-92c5-00c774ab6ba6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:43:31.551822 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf4aca2-00c0-4853-92c5-00c774ab6ba6 service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:43:31.565732 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3971/7969] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:43:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:43:35.631295 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=6 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:43:41.558121 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=69 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:43:49.965982 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3510ce-c4ab-40e9-890f-10f7f07af230 service placement] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:43:49.967744 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-0a3510ce-c4ab-40e9-890f-10f7f07af230 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:43:49.987481 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3510ce-c4ab-40e9-890f-10f7f07af230 service placement] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:43:49.995442 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efe92c2-3014-42d0-b48a-ae7090adc93b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:43:49.995760 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efe92c2-3014-42d0-b48a-ae7090adc93b service nova] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:43:49.996044 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efe92c2-3014-42d0-b48a-ae7090adc93b service nova] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:43:49.996317 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efe92c2-3014-42d0-b48a-ae7090adc93b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:43:49.998457 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-4efe92c2-3014-42d0-b48a-ae7090adc93b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:43:50.015308 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efe92c2-3014-42d0-b48a-ae7090adc93b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:43:50.016920 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efe92c2-3014-42d0-b48a-ae7090adc93b service nova] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:43:50.031248 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 3999/7970] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:43:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:44:00.025671 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=6 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:44:28.293639 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf4aca2-00c0-4853-92c5-00c774ab6ba6 service neutron] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:44:28.305680 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf4aca2-00c0-4853-92c5-00c774ab6ba6 service neutron] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:44:28.309924 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6f5828-2919-4d82-9aed-8117dbe5d775 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:44:28.310453 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6f5828-2919-4d82-9aed-8117dbe5d775 service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:44:28.310797 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6f5828-2919-4d82-9aed-8117dbe5d775 service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:44:28.311041 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6f5828-2919-4d82-9aed-8117dbe5d775 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:44:28.312891 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-7d6f5828-2919-4d82-9aed-8117dbe5d775 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:44:28.326454 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6f5828-2919-4d82-9aed-8117dbe5d775 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:44:28.327835 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6f5828-2919-4d82-9aed-8117dbe5d775 service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:44:28.339444 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3972/7971] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:44:28 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:44:29.317979 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efe92c2-3014-42d0-b48a-ae7090adc93b service nova] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:44:29.332593 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efe92c2-3014-42d0-b48a-ae7090adc93b service nova] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:44:29.338376 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a078709e-7b80-4715-8554-b110843f9d1a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:44:29.339033 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a078709e-7b80-4715-8554-b110843f9d1a service nova] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:44:29.339312 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a078709e-7b80-4715-8554-b110843f9d1a service nova] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:44:29.339586 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a078709e-7b80-4715-8554-b110843f9d1a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:44:29.341436 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-a078709e-7b80-4715-8554-b110843f9d1a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:44:29.356984 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a078709e-7b80-4715-8554-b110843f9d1a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:44:29.358697 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a078709e-7b80-4715-8554-b110843f9d1a service nova] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:44:29.372814 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4000/7972] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:44:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:44:33.339656 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6f5828-2919-4d82-9aed-8117dbe5d775 service neutron] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:44:33.356231 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6f5828-2919-4d82-9aed-8117dbe5d775 service neutron] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:44:33.362830 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c273d016-d0aa-4669-b66d-9222b88f6949 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc719a3b3ac4461b82ca04ab6451d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:44:33.363509 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c273d016-d0aa-4669-b66d-9222b88f6949 service placement] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:44:33.363793 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c273d016-d0aa-4669-b66d-9222b88f6949 service placement] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:44:33.364067 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c273d016-d0aa-4669-b66d-9222b88f6949 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:44:33.366381 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-c273d016-d0aa-4669-b66d-9222b88f6949 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:44:33.381443 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c273d016-d0aa-4669-b66d-9222b88f6949 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:44:33.383120 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c273d016-d0aa-4669-b66d-9222b88f6949 service placement] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:44:33.399409 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3973/7973] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:44:33 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:44:38.974085 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ac1469-e8ef-4b29-8d2e-d0d5e8746710 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:44:38.974642 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ac1469-e8ef-4b29-8d2e-d0d5e8746710 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:44:38.974642 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ac1469-e8ef-4b29-8d2e-d0d5e8746710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:44:38.995358 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-24ac1469-e8ef-4b29-8d2e-d0d5e8746710 None None] MFA Rules not processed for user `96ade420fd324acfb57e4ac81bfece9e`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:44:38.996701 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-24ac1469-e8ef-4b29-8d2e-d0d5e8746710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:44:39.004291 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4001/7974] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:44:38 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:44:39.337629 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c273d016-d0aa-4669-b66d-9222b88f6949 service placement] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:44:39.351452 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c273d016-d0aa-4669-b66d-9222b88f6949 service placement] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:44:39.355204 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1971b5-cd71-4b36-9640-d8c104ae99a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:44:39.355860 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1971b5-cd71-4b36-9640-d8c104ae99a9 service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:44:39.356141 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1971b5-cd71-4b36-9640-d8c104ae99a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:44:39.356413 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1971b5-cd71-4b36-9640-d8c104ae99a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:44:39.358405 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-0b1971b5-cd71-4b36-9640-d8c104ae99a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:44:39.371052 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1971b5-cd71-4b36-9640-d8c104ae99a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:44:39.372910 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1971b5-cd71-4b36-9640-d8c104ae99a9 service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:44:39.384802 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3974/7975] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:44:39 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:44:39.798352 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ac1469-e8ef-4b29-8d2e-d0d5e8746710 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:44:39.829521 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ac1469-e8ef-4b29-8d2e-d0d5e8746710 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:44:39.843794 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc93c0c4-b5d6-4e35-881e-867f3021d362 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc719a3b3ac4461b82ca04ab6451d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:44:39.844683 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc93c0c4-b5d6-4e35-881e-867f3021d362 service placement] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:44:39.845165 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc93c0c4-b5d6-4e35-881e-867f3021d362 service placement] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:44:39.846971 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc93c0c4-b5d6-4e35-881e-867f3021d362 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:44:39.849176 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-cc93c0c4-b5d6-4e35-881e-867f3021d362 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:44:39.870922 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc93c0c4-b5d6-4e35-881e-867f3021d362 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:44:39.872554 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc93c0c4-b5d6-4e35-881e-867f3021d362 service placement] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:44:39.897313 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4002/7976] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:44:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:44:41.892931 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1971b5-cd71-4b36-9640-d8c104ae99a9 service neutron] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:44:41.906574 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1971b5-cd71-4b36-9640-d8c104ae99a9 service neutron] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:44:41.910795 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5368a89-9807-4e89-8dc7-b7fdd6d1b3db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:44:41.911667 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5368a89-9807-4e89-8dc7-b7fdd6d1b3db service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:44:41.911952 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5368a89-9807-4e89-8dc7-b7fdd6d1b3db service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:44:41.912230 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5368a89-9807-4e89-8dc7-b7fdd6d1b3db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:44:41.914141 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-e5368a89-9807-4e89-8dc7-b7fdd6d1b3db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:44:41.930787 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5368a89-9807-4e89-8dc7-b7fdd6d1b3db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:44:41.932338 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5368a89-9807-4e89-8dc7-b7fdd6d1b3db service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:44:41.945332 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3975/7977] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:44:41 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:44:49.888694 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=15 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:44:51.938366 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=24 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:44:56.991495 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc93c0c4-b5d6-4e35-881e-867f3021d362 service placement] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:44:56.993178 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-cc93c0c4-b5d6-4e35-881e-867f3021d362 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:44:57.055617 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc93c0c4-b5d6-4e35-881e-867f3021d362 service placement] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:44:57.059310 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c92d6d8-d49a-41b9-905b-861926d891a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec5fd3a489c341b7964704d689037f05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:44:57.059954 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c92d6d8-d49a-41b9-905b-861926d891a8 service cinder] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:44:57.060242 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c92d6d8-d49a-41b9-905b-861926d891a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:44:57.060522 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c92d6d8-d49a-41b9-905b-861926d891a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:44:57.062522 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-9c92d6d8-d49a-41b9-905b-861926d891a8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:44:57.126228 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c92d6d8-d49a-41b9-905b-861926d891a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:44:57.127663 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c92d6d8-d49a-41b9-905b-861926d891a8 service cinder] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:44:57.139437 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4003/7978] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:44:56 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:45:07.133077 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=48 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:45:21.917890 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41890d2-45da-4a1e-ae8b-a130a7e392c9 None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:45:21.918420 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41890d2-45da-4a1e-ae8b-a130a7e392c9 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:45:21.918420 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41890d2-45da-4a1e-ae8b-a130a7e392c9 None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:45:21.919778 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3976/7979] 10.222.0.17 () {54 vars in 921 bytes} [Sat Jul 23 21:45:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 21:45:21.927095 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cc59f0-2121-4a0a-9256-1dd957701c85 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:45:21.927549 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cc59f0-2121-4a0a-9256-1dd957701c85 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:45:21.927656 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cc59f0-2121-4a0a-9256-1dd957701c85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:45:21.951115 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-39cc59f0-2121-4a0a-9256-1dd957701c85 None None] MFA Rules not processed for user `abc719a3b3ac4461b82ca04ab6451d81`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:45:21.952331 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-39cc59f0-2121-4a0a-9256-1dd957701c85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:45:21.962627 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4004/7980] 10.222.0.17 () {58 vars in 1018 bytes} [Sat Jul 23 21:45:21 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:45:21.983766 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41890d2-45da-4a1e-ae8b-a130a7e392c9 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:45:22.001766 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41890d2-45da-4a1e-ae8b-a130a7e392c9 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:45:22.007586 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49c79d4-d0cf-48d6-a9ba-c05490b1c486 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc719a3b3ac4461b82ca04ab6451d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:45:22.008190 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49c79d4-d0cf-48d6-a9ba-c05490b1c486 service placement] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:45:22.008466 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49c79d4-d0cf-48d6-a9ba-c05490b1c486 service placement] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:45:22.008740 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49c79d4-d0cf-48d6-a9ba-c05490b1c486 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:45:22.017306 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49c79d4-d0cf-48d6-a9ba-c05490b1c486 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:45:22.018919 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49c79d4-d0cf-48d6-a9ba-c05490b1c486 service placement] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:45:22.028637 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3977/7981] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:45:21 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:45:31.569391 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cc59f0-2121-4a0a-9256-1dd957701c85 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:45:31.585347 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cc59f0-2121-4a0a-9256-1dd957701c85 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:45:31.591651 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b7fd18-2f77-4f03-8333-ba314f9818f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:45:31.592303 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b7fd18-2f77-4f03-8333-ba314f9818f0 service nova] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:45:31.592627 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b7fd18-2f77-4f03-8333-ba314f9818f0 service nova] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:45:31.592898 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b7fd18-2f77-4f03-8333-ba314f9818f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:45:31.594801 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-b5b7fd18-2f77-4f03-8333-ba314f9818f0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:45:31.605508 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b7fd18-2f77-4f03-8333-ba314f9818f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:45:31.607120 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b7fd18-2f77-4f03-8333-ba314f9818f0 service nova] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:45:31.616184 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4005/7982] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:45:31 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:45:32.024577 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=6 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:45:38.713078 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49c79d4-d0cf-48d6-a9ba-c05490b1c486 service placement] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:45:38.714623 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-b49c79d4-d0cf-48d6-a9ba-c05490b1c486 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:45:38.731947 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49c79d4-d0cf-48d6-a9ba-c05490b1c486 service placement] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:45:38.738209 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4c9677-edc2-4e98-8bcc-2f80ac395bf6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc719a3b3ac4461b82ca04ab6451d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:45:38.738883 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4c9677-edc2-4e98-8bcc-2f80ac395bf6 service placement] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:45:38.739333 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4c9677-edc2-4e98-8bcc-2f80ac395bf6 service placement] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:45:38.739617 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4c9677-edc2-4e98-8bcc-2f80ac395bf6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:45:38.741615 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-2c4c9677-edc2-4e98-8bcc-2f80ac395bf6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:45:38.757109 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4c9677-edc2-4e98-8bcc-2f80ac395bf6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:45:38.758792 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4c9677-edc2-4e98-8bcc-2f80ac395bf6 service placement] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:45:38.772669 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3978/7983] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:45:38 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:45:41.612034 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=9 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:45:41.679116 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b7fd18-2f77-4f03-8333-ba314f9818f0 service nova] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:45:41.709788 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b7fd18-2f77-4f03-8333-ba314f9818f0 service nova] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:45:41.714030 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a94d69-0e5b-48a8-b939-291db94792ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:45:41.715065 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a94d69-0e5b-48a8-b939-291db94792ad service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:45:41.715547 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a94d69-0e5b-48a8-b939-291db94792ad service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:45:41.716195 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a94d69-0e5b-48a8-b939-291db94792ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:45:41.718354 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-47a94d69-0e5b-48a8-b939-291db94792ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:45:41.788942 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a94d69-0e5b-48a8-b939-291db94792ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:45:41.790469 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a94d69-0e5b-48a8-b939-291db94792ad service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:45:41.801432 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4006/7984] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:45:41 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:45:45.241555 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4593bf34-fddf-43b5-b8bb-0fdc95af034c None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:45:45.242489 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4593bf34-fddf-43b5-b8bb-0fdc95af034c None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:45:45.242947 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4593bf34-fddf-43b5-b8bb-0fdc95af034c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:45:45.266572 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-4593bf34-fddf-43b5-b8bb-0fdc95af034c None None] MFA Rules not processed for user `96ade420fd324acfb57e4ac81bfece9e`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:45:45.267829 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-4593bf34-fddf-43b5-b8bb-0fdc95af034c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:45:45.281544 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3979/7985] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:45:45 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:45:51.796593 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=34 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:45:55.259223 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=9 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:46:29.068891 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a94d69-0e5b-48a8-b939-291db94792ad service neutron] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:46:29.094831 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a94d69-0e5b-48a8-b939-291db94792ad service neutron] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:46:29.100496 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f55a4af-f3fd-433d-9746-5a6748f19b82 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc719a3b3ac4461b82ca04ab6451d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:46:29.101148 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f55a4af-f3fd-433d-9746-5a6748f19b82 service placement] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:46:29.101418 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f55a4af-f3fd-433d-9746-5a6748f19b82 service placement] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:46:29.101691 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f55a4af-f3fd-433d-9746-5a6748f19b82 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:46:29.103720 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-6f55a4af-f3fd-433d-9746-5a6748f19b82 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:46:29.118925 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f55a4af-f3fd-433d-9746-5a6748f19b82 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:46:29.120595 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f55a4af-f3fd-433d-9746-5a6748f19b82 service placement] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:46:29.133386 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4007/7986] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:46:29 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:46:39.126684 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=10 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:46:47.860243 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4593bf34-fddf-43b5-b8bb-0fdc95af034c None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:46:47.876491 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4593bf34-fddf-43b5-b8bb-0fdc95af034c None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:46:47.882307 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e751e306-777d-44df-8b38-d1f5515ed33b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc719a3b3ac4461b82ca04ab6451d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:46:47.882956 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e751e306-777d-44df-8b38-d1f5515ed33b service placement] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:46:47.883240 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e751e306-777d-44df-8b38-d1f5515ed33b service placement] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:46:47.883515 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e751e306-777d-44df-8b38-d1f5515ed33b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:46:47.895052 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e751e306-777d-44df-8b38-d1f5515ed33b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:46:47.896804 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e751e306-777d-44df-8b38-d1f5515ed33b service placement] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:46:47.909519 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3980/7987] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:46:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:46:57.902841 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=6 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:47:20.927869 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f55a4af-f3fd-433d-9746-5a6748f19b82 service placement] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:47:20.944364 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f55a4af-f3fd-433d-9746-5a6748f19b82 service placement] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:47:20.951260 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba88d665-253b-4d27-84c9-bd314ef4f71f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:47:20.952305 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba88d665-253b-4d27-84c9-bd314ef4f71f service nova] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:47:20.952585 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba88d665-253b-4d27-84c9-bd314ef4f71f service nova] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:47:20.952859 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba88d665-253b-4d27-84c9-bd314ef4f71f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:47:20.955021 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-ba88d665-253b-4d27-84c9-bd314ef4f71f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:47:20.974159 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba88d665-253b-4d27-84c9-bd314ef4f71f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:47:20.975885 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba88d665-253b-4d27-84c9-bd314ef4f71f service nova] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:47:20.990510 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4008/7988] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:47:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:47:26.877924 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e751e306-777d-44df-8b38-d1f5515ed33b service placement] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:47:26.880568 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-e751e306-777d-44df-8b38-d1f5515ed33b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:47:26.958512 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e751e306-777d-44df-8b38-d1f5515ed33b service placement] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:47:26.966919 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df25d8b-4171-4e5d-a4c1-9dcf97011d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:47:26.968083 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df25d8b-4171-4e5d-a4c1-9dcf97011d7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:47:26.968732 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df25d8b-4171-4e5d-a4c1-9dcf97011d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:47:26.969020 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df25d8b-4171-4e5d-a4c1-9dcf97011d7c admin admin] PATH_INFO: `/v3/users/96ade420fd324acfb57e4ac81bfece9e` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:47:26.970337 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df25d8b-4171-4e5d-a4c1-9dcf97011d7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=96ade420fd324acfb57e4ac81bfece9e)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:47:26.972890 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df25d8b-4171-4e5d-a4c1-9dcf97011d7c admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:47:27.023001 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-4df25d8b-4171-4e5d-a4c1-9dcf97011d7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96ade420fd324acfb57e4ac81bfece9e'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:47:27.030107 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-4df25d8b-4171-4e5d-a4c1-9dcf97011d7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96ade420fd324acfb57e4ac81bfece9e'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:47:27.030784 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-4df25d8b-4171-4e5d-a4c1-9dcf97011d7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96ade420fd324acfb57e4ac81bfece9e'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:47:27.039144 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-4df25d8b-4171-4e5d-a4c1-9dcf97011d7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96ade420fd324acfb57e4ac81bfece9e'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:47:27.053021 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-4df25d8b-4171-4e5d-a4c1-9dcf97011d7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96ade420fd324acfb57e4ac81bfece9e'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:47:27.059209 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3981/7989] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:47:26 2022] DELETE /identity/v3/users/96ade420fd324acfb57e4ac81bfece9e => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:47:27.063977 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757f0450-f190-4062-b4f8-313afcde6223 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:47:27.064954 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757f0450-f190-4062-b4f8-313afcde6223 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:47:27.065340 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757f0450-f190-4062-b4f8-313afcde6223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:47:27.083941 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-757f0450-f190-4062-b4f8-313afcde6223 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:47:27.085315 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-757f0450-f190-4062-b4f8-313afcde6223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:47:27.156586 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4009/7990] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:47:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:47:27.166750 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df25d8b-4171-4e5d-a4c1-9dcf97011d7c admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:47:27.168318 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-4df25d8b-4171-4e5d-a4c1-9dcf97011d7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:47:27.232339 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df25d8b-4171-4e5d-a4c1-9dcf97011d7c admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:47:27.236671 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01121fb-cb7e-4a10-8bb4-6792076412ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:47:27.237355 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01121fb-cb7e-4a10-8bb4-6792076412ec service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:47:27.237633 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01121fb-cb7e-4a10-8bb4-6792076412ec service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:47:27.237898 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01121fb-cb7e-4a10-8bb4-6792076412ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:47:27.248171 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01121fb-cb7e-4a10-8bb4-6792076412ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:47:27.249613 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01121fb-cb7e-4a10-8bb4-6792076412ec service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:47:27.261476 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3982/7991] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:47:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:47:27.444156 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757f0450-f190-4062-b4f8-313afcde6223 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:47:27.445648 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-757f0450-f190-4062-b4f8-313afcde6223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:47:27.459301 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757f0450-f190-4062-b4f8-313afcde6223 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:47:27.465115 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42001586-86e7-4d66-82a2-cb73e366e4a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:47:27.465685 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42001586-86e7-4d66-82a2-cb73e366e4a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:47:27.466006 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42001586-86e7-4d66-82a2-cb73e366e4a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:47:27.466244 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42001586-86e7-4d66-82a2-cb73e366e4a5 admin admin] PATH_INFO: `/v3/projects/36bd2862980e45849b0d3fc3f52a6926` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:47:27.467515 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42001586-86e7-4d66-82a2-cb73e366e4a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=36bd2862980e45849b0d3fc3f52a6926)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:47:27.469440 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42001586-86e7-4d66-82a2-cb73e366e4a5 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:47:27.523085 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-42001586-86e7-4d66-82a2-cb73e366e4a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36bd2862980e45849b0d3fc3f52a6926', 'request_id': 'req-42001586-86e7-4d66-82a2-cb73e366e4a5'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:47:27.531905 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-42001586-86e7-4d66-82a2-cb73e366e4a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36bd2862980e45849b0d3fc3f52a6926', 'request_id': 'req-42001586-86e7-4d66-82a2-cb73e366e4a5'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:47:27.537660 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-42001586-86e7-4d66-82a2-cb73e366e4a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36bd2862980e45849b0d3fc3f52a6926', 'request_id': 'req-42001586-86e7-4d66-82a2-cb73e366e4a5'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:47:27.549012 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-42001586-86e7-4d66-82a2-cb73e366e4a5 admin admin] The token cache is being invalidate because project 36bd2862980e45849b0d3fc3f52a6926 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:47:27.549295 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-42001586-86e7-4d66-82a2-cb73e366e4a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:47:27.550011 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-42001586-86e7-4d66-82a2-cb73e366e4a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:47:27.551581 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4010/7992] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:47:27 2022] DELETE /identity/v3/projects/36bd2862980e45849b0d3fc3f52a6926 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:47:27.555778 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01121fb-cb7e-4a10-8bb4-6792076412ec service neutron] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:47:27.566163 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01121fb-cb7e-4a10-8bb4-6792076412ec service neutron] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:47:27.575678 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:47:27.625631 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47591b2e-99b4-47c9-97a4-8e45e5bad0ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:47:27.626547 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47591b2e-99b4-47c9-97a4-8e45e5bad0ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:47:27.626823 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47591b2e-99b4-47c9-97a4-8e45e5bad0ac admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:47:27.627095 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47591b2e-99b4-47c9-97a4-8e45e5bad0ac admin admin] PATH_INFO: `/v3/users/b457c730ff32489a8d64d3f92ce95945` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:47:27.628344 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47591b2e-99b4-47c9-97a4-8e45e5bad0ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=b457c730ff32489a8d64d3f92ce95945)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:47:27.630335 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47591b2e-99b4-47c9-97a4-8e45e5bad0ac admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:47:27.679188 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-47591b2e-99b4-47c9-97a4-8e45e5bad0ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b457c730ff32489a8d64d3f92ce95945'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:47:27.686274 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-47591b2e-99b4-47c9-97a4-8e45e5bad0ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b457c730ff32489a8d64d3f92ce95945'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:47:27.686949 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-47591b2e-99b4-47c9-97a4-8e45e5bad0ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b457c730ff32489a8d64d3f92ce95945'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:47:27.695470 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-47591b2e-99b4-47c9-97a4-8e45e5bad0ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b457c730ff32489a8d64d3f92ce95945'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:47:27.709183 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-47591b2e-99b4-47c9-97a4-8e45e5bad0ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b457c730ff32489a8d64d3f92ce95945'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:47:27.715693 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3983/7993] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:47:27 2022] DELETE /identity/v3/users/b457c730ff32489a8d64d3f92ce95945 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:47:27.895196 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42001586-86e7-4d66-82a2-cb73e366e4a5 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:47:27.896697 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-42001586-86e7-4d66-82a2-cb73e366e4a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:47:27.917659 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42001586-86e7-4d66-82a2-cb73e366e4a5 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:47:27.985055 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c4de96-8a5b-4265-8600-f2f3cebc6a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:47:27.985956 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c4de96-8a5b-4265-8600-f2f3cebc6a1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:47:27.986197 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c4de96-8a5b-4265-8600-f2f3cebc6a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:47:27.986487 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c4de96-8a5b-4265-8600-f2f3cebc6a1e admin admin] PATH_INFO: `/v3/projects/86dc934708144527824a9309b2cf068d` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:47:27.987812 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c4de96-8a5b-4265-8600-f2f3cebc6a1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=86dc934708144527824a9309b2cf068d)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:47:27.989708 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c4de96-8a5b-4265-8600-f2f3cebc6a1e admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:47:28.003125 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:47:28.042146 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-35c4de96-8a5b-4265-8600-f2f3cebc6a1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86dc934708144527824a9309b2cf068d', 'request_id': 'req-35c4de96-8a5b-4265-8600-f2f3cebc6a1e'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:47:28.050666 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-35c4de96-8a5b-4265-8600-f2f3cebc6a1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86dc934708144527824a9309b2cf068d', 'request_id': 'req-35c4de96-8a5b-4265-8600-f2f3cebc6a1e'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:47:28.056266 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-35c4de96-8a5b-4265-8600-f2f3cebc6a1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86dc934708144527824a9309b2cf068d', 'request_id': 'req-35c4de96-8a5b-4265-8600-f2f3cebc6a1e'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:47:28.067415 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-35c4de96-8a5b-4265-8600-f2f3cebc6a1e admin admin] The token cache is being invalidate because project 86dc934708144527824a9309b2cf068d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:47:28.067980 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-35c4de96-8a5b-4265-8600-f2f3cebc6a1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:47:28.068245 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-35c4de96-8a5b-4265-8600-f2f3cebc6a1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:47:28.069854 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4011/7994] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:47:27 2022] DELETE /identity/v3/projects/86dc934708144527824a9309b2cf068d => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:47:37.712181 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=47,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:47:38.064309 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=19,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:49:56.619833 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47591b2e-99b4-47c9-97a4-8e45e5bad0ac admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:49:56.622900 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-47591b2e-99b4-47c9-97a4-8e45e5bad0ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:49:56.732112 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47591b2e-99b4-47c9-97a4-8e45e5bad0ac admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:49:56.783902 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60ac91f-d639-42a2-ac19-806247a4bf2a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec5fd3a489c341b7964704d689037f05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:49:56.784568 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60ac91f-d639-42a2-ac19-806247a4bf2a service cinder] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:49:56.784850 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60ac91f-d639-42a2-ac19-806247a4bf2a service cinder] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:49:56.785127 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60ac91f-d639-42a2-ac19-806247a4bf2a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:49:56.787122 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-c60ac91f-d639-42a2-ac19-806247a4bf2a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:49:56.865949 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60ac91f-d639-42a2-ac19-806247a4bf2a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:49:56.867317 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60ac91f-d639-42a2-ac19-806247a4bf2a service cinder] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:49:56.880196 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3984/7995] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:49:56 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:50:06.872212 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=91 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:51:33.152899 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c4de96-8a5b-4265-8600-f2f3cebc6a1e admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:51:33.154572 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-35c4de96-8a5b-4265-8600-f2f3cebc6a1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:51:33.294014 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c4de96-8a5b-4265-8600-f2f3cebc6a1e admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:51:33.302443 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3774d89b-3428-44b4-aca3-87775875b176 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc719a3b3ac4461b82ca04ab6451d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:51:33.303119 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3774d89b-3428-44b4-aca3-87775875b176 service placement] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:51:33.303396 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3774d89b-3428-44b4-aca3-87775875b176 service placement] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:51:33.303676 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3774d89b-3428-44b4-aca3-87775875b176 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:51:33.305747 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-3774d89b-3428-44b4-aca3-87775875b176 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:51:33.320389 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3774d89b-3428-44b4-aca3-87775875b176 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:51:33.322007 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3774d89b-3428-44b4-aca3-87775875b176 service placement] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:51:33.334715 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4012/7996] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:51:33 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:51:43.328087 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=48 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:51:53.326103 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60ac91f-d639-42a2-ac19-806247a4bf2a service cinder] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:51:53.328226 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-c60ac91f-d639-42a2-ac19-806247a4bf2a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:51:53.348179 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60ac91f-d639-42a2-ac19-806247a4bf2a service cinder] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:51:53.354479 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58314c84-1077-44c1-b1b9-acde0b4e03f6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc719a3b3ac4461b82ca04ab6451d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:51:53.355129 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58314c84-1077-44c1-b1b9-acde0b4e03f6 service placement] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:51:53.355401 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58314c84-1077-44c1-b1b9-acde0b4e03f6 service placement] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:51:53.355673 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58314c84-1077-44c1-b1b9-acde0b4e03f6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:51:53.357498 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-58314c84-1077-44c1-b1b9-acde0b4e03f6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:51:53.371496 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58314c84-1077-44c1-b1b9-acde0b4e03f6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:51:53.373090 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58314c84-1077-44c1-b1b9-acde0b4e03f6 service placement] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:51:53.385501 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3985/7997] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:51:53 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:52:03.379250 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=6 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:54:56.717155 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3774d89b-3428-44b4-aca3-87775875b176 service placement] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:54:56.719244 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-3774d89b-3428-44b4-aca3-87775875b176 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:54:56.748152 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3774d89b-3428-44b4-aca3-87775875b176 service placement] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:54:56.752372 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edda43f-6087-475f-975b-8dadbd7f1b54 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec5fd3a489c341b7964704d689037f05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:54:56.753073 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edda43f-6087-475f-975b-8dadbd7f1b54 service cinder] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:54:56.753353 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edda43f-6087-475f-975b-8dadbd7f1b54 service cinder] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:54:56.753625 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edda43f-6087-475f-975b-8dadbd7f1b54 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:54:56.765219 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edda43f-6087-475f-975b-8dadbd7f1b54 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:54:56.766679 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edda43f-6087-475f-975b-8dadbd7f1b54 service cinder] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:54:56.796443 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4013/7998] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:54:56 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:55:06.793905 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=18 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:55:51.051317 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58314c84-1077-44c1-b1b9-acde0b4e03f6 service placement] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:55:51.053431 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-58314c84-1077-44c1-b1b9-acde0b4e03f6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:55:51.136102 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58314c84-1077-44c1-b1b9-acde0b4e03f6 service placement] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:55:51.140027 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1d277d-667b-4536-becb-2da88ec20b66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:55:51.140671 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1d277d-667b-4536-becb-2da88ec20b66 service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:55:51.140950 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1d277d-667b-4536-becb-2da88ec20b66 service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:55:51.141220 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1d277d-667b-4536-becb-2da88ec20b66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:55:51.143066 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-dc1d277d-667b-4536-becb-2da88ec20b66 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:55:51.250400 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1d277d-667b-4536-becb-2da88ec20b66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:55:51.252528 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1d277d-667b-4536-becb-2da88ec20b66 service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:55:51.267957 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3986/7999] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:55:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:55:54.143073 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edda43f-6087-475f-975b-8dadbd7f1b54 service cinder] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:55:54.161286 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edda43f-6087-475f-975b-8dadbd7f1b54 service cinder] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:55:54.172017 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5d497a-36bf-4c06-8c90-2db9acfdc3f8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc719a3b3ac4461b82ca04ab6451d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:55:54.172712 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5d497a-36bf-4c06-8c90-2db9acfdc3f8 service placement] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:55:54.172997 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5d497a-36bf-4c06-8c90-2db9acfdc3f8 service placement] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:55:54.173328 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5d497a-36bf-4c06-8c90-2db9acfdc3f8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:55:54.175142 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-1f5d497a-36bf-4c06-8c90-2db9acfdc3f8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:55:54.191160 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5d497a-36bf-4c06-8c90-2db9acfdc3f8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:55:54.193389 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5d497a-36bf-4c06-8c90-2db9acfdc3f8 service placement] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:55:54.225961 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4014/8000] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:55:54 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:55:57.507917 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1d277d-667b-4536-becb-2da88ec20b66 service neutron] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:55:57.522519 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1d277d-667b-4536-becb-2da88ec20b66 service neutron] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:55:57.528623 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe52f0f-d3fd-46e1-9e92-4bf57c288207 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc719a3b3ac4461b82ca04ab6451d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:55:57.529291 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe52f0f-d3fd-46e1-9e92-4bf57c288207 service placement] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:55:57.529566 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe52f0f-d3fd-46e1-9e92-4bf57c288207 service placement] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:55:57.529931 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe52f0f-d3fd-46e1-9e92-4bf57c288207 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:55:57.531703 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-1fe52f0f-d3fd-46e1-9e92-4bf57c288207 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:55:57.546288 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe52f0f-d3fd-46e1-9e92-4bf57c288207 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:55:57.547874 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe52f0f-d3fd-46e1-9e92-4bf57c288207 service placement] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:55:57.561298 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3987/8001] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:55:57 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:55:57.574916 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5d497a-36bf-4c06-8c90-2db9acfdc3f8 service placement] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:55:57.576414 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-1f5d497a-36bf-4c06-8c90-2db9acfdc3f8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:55:57.601646 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5d497a-36bf-4c06-8c90-2db9acfdc3f8 service placement] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:55:57.607956 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19f6063-5bdc-4471-9d09-5a0ec8eb5f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:55:57.608862 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19f6063-5bdc-4471-9d09-5a0ec8eb5f7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:55:57.609168 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19f6063-5bdc-4471-9d09-5a0ec8eb5f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:55:57.609390 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19f6063-5bdc-4471-9d09-5a0ec8eb5f7d admin admin] PATH_INFO: `/v3/users/7578019c30174bc888279bf5009c0f4b` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:55:57.624756 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19f6063-5bdc-4471-9d09-5a0ec8eb5f7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=7578019c30174bc888279bf5009c0f4b)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:55:57.626812 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19f6063-5bdc-4471-9d09-5a0ec8eb5f7d admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:55:57.673764 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-f19f6063-5bdc-4471-9d09-5a0ec8eb5f7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7578019c30174bc888279bf5009c0f4b'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:55:57.674433 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-f19f6063-5bdc-4471-9d09-5a0ec8eb5f7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7578019c30174bc888279bf5009c0f4b'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:55:57.681637 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-f19f6063-5bdc-4471-9d09-5a0ec8eb5f7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7578019c30174bc888279bf5009c0f4b'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:55:57.690242 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-f19f6063-5bdc-4471-9d09-5a0ec8eb5f7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7578019c30174bc888279bf5009c0f4b'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:55:57.703075 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-f19f6063-5bdc-4471-9d09-5a0ec8eb5f7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7578019c30174bc888279bf5009c0f4b'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:55:57.709604 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4015/8002] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:55:57 2022] DELETE /identity/v3/users/7578019c30174bc888279bf5009c0f4b => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:55:57.890366 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe52f0f-d3fd-46e1-9e92-4bf57c288207 service placement] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:55:57.904493 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe52f0f-d3fd-46e1-9e92-4bf57c288207 service placement] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:55:57.958931 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:55:57.965818 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8718a58f-1517-4275-b201-4d04869a2aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:55:57.966783 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8718a58f-1517-4275-b201-4d04869a2aee admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:55:57.967062 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8718a58f-1517-4275-b201-4d04869a2aee admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:55:57.967311 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8718a58f-1517-4275-b201-4d04869a2aee admin admin] PATH_INFO: `/v3/projects/31c41ae7265a4a629521b546a7231319` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:55:57.968538 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8718a58f-1517-4275-b201-4d04869a2aee admin admin] RBAC: Authorizing `identity:delete_project(project_id=31c41ae7265a4a629521b546a7231319)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:55:57.970915 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8718a58f-1517-4275-b201-4d04869a2aee admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:55:58.018739 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-8718a58f-1517-4275-b201-4d04869a2aee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31c41ae7265a4a629521b546a7231319', 'request_id': 'req-8718a58f-1517-4275-b201-4d04869a2aee'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:55:58.027563 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-8718a58f-1517-4275-b201-4d04869a2aee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31c41ae7265a4a629521b546a7231319', 'request_id': 'req-8718a58f-1517-4275-b201-4d04869a2aee'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:55:58.033279 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-8718a58f-1517-4275-b201-4d04869a2aee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31c41ae7265a4a629521b546a7231319', 'request_id': 'req-8718a58f-1517-4275-b201-4d04869a2aee'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:55:58.044489 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-8718a58f-1517-4275-b201-4d04869a2aee admin admin] The token cache is being invalidate because project 31c41ae7265a4a629521b546a7231319 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:55:58.044779 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-8718a58f-1517-4275-b201-4d04869a2aee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:55:58.045501 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-8718a58f-1517-4275-b201-4d04869a2aee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:55:58.047196 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3988/8003] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:55:57 2022] DELETE /identity/v3/projects/31c41ae7265a4a629521b546a7231319 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:55:58.051429 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19f6063-5bdc-4471-9d09-5a0ec8eb5f7d admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:55:58.053001 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-f19f6063-5bdc-4471-9d09-5a0ec8eb5f7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:55:58.069239 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19f6063-5bdc-4471-9d09-5a0ec8eb5f7d admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:55:58.132528 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d11a26d-a01b-4f74-90e0-d5024f6fc754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:55:58.133555 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d11a26d-a01b-4f74-90e0-d5024f6fc754 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:55:58.133837 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d11a26d-a01b-4f74-90e0-d5024f6fc754 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:55:58.134141 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d11a26d-a01b-4f74-90e0-d5024f6fc754 admin admin] PATH_INFO: `/v3/users/3f189667b4fb48b28d450ebfb44a961b` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:55:58.149082 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d11a26d-a01b-4f74-90e0-d5024f6fc754 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f189667b4fb48b28d450ebfb44a961b)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:55:58.151067 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d11a26d-a01b-4f74-90e0-d5024f6fc754 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:55:58.199589 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:55:58.206783 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-3d11a26d-a01b-4f74-90e0-d5024f6fc754 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f189667b4fb48b28d450ebfb44a961b'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:55:58.207531 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-3d11a26d-a01b-4f74-90e0-d5024f6fc754 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f189667b4fb48b28d450ebfb44a961b'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:55:58.215185 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-3d11a26d-a01b-4f74-90e0-d5024f6fc754 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f189667b4fb48b28d450ebfb44a961b'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:55:58.222935 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-3d11a26d-a01b-4f74-90e0-d5024f6fc754 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f189667b4fb48b28d450ebfb44a961b'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:55:58.235462 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-3d11a26d-a01b-4f74-90e0-d5024f6fc754 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f189667b4fb48b28d450ebfb44a961b'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:55:58.241541 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4016/8004] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:55:58 2022] DELETE /identity/v3/users/3f189667b4fb48b28d450ebfb44a961b => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:55:58.425661 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8718a58f-1517-4275-b201-4d04869a2aee admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:55:58.427398 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-8718a58f-1517-4275-b201-4d04869a2aee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:55:58.443847 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8718a58f-1517-4275-b201-4d04869a2aee admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:55:58.504290 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16b1636-5da1-497d-8ed7-b9d1c72c6d12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:55:58.504290 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16b1636-5da1-497d-8ed7-b9d1c72c6d12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:55:58.504675 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16b1636-5da1-497d-8ed7-b9d1c72c6d12 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:55:58.504959 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16b1636-5da1-497d-8ed7-b9d1c72c6d12 admin admin] PATH_INFO: `/v3/projects/dfd64c2641fa4a50aa8a20b28499c9bd` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:55:58.517501 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16b1636-5da1-497d-8ed7-b9d1c72c6d12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dfd64c2641fa4a50aa8a20b28499c9bd)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:55:58.519566 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16b1636-5da1-497d-8ed7-b9d1c72c6d12 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:55:58.567853 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-b16b1636-5da1-497d-8ed7-b9d1c72c6d12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dfd64c2641fa4a50aa8a20b28499c9bd', 'request_id': 'req-b16b1636-5da1-497d-8ed7-b9d1c72c6d12'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:55:58.575757 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-b16b1636-5da1-497d-8ed7-b9d1c72c6d12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dfd64c2641fa4a50aa8a20b28499c9bd', 'request_id': 'req-b16b1636-5da1-497d-8ed7-b9d1c72c6d12'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:55:58.581345 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-b16b1636-5da1-497d-8ed7-b9d1c72c6d12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dfd64c2641fa4a50aa8a20b28499c9bd', 'request_id': 'req-b16b1636-5da1-497d-8ed7-b9d1c72c6d12'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:55:58.592853 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-b16b1636-5da1-497d-8ed7-b9d1c72c6d12 admin admin] The token cache is being invalidate because project dfd64c2641fa4a50aa8a20b28499c9bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 21:55:58.593131 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-b16b1636-5da1-497d-8ed7-b9d1c72c6d12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:55:58.593759 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-b16b1636-5da1-497d-8ed7-b9d1c72c6d12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 21:55:58.595762 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3989/8005] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:55:58 2022] DELETE /identity/v3/projects/dfd64c2641fa4a50aa8a20b28499c9bd => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:55:58.602151 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ca767d-ef7f-4ff2-bbf4-0043e3617b22 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:55:58.602685 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ca767d-ef7f-4ff2-bbf4-0043e3617b22 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:55:58.602685 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ca767d-ef7f-4ff2-bbf4-0043e3617b22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:55:58.662577 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-66ca767d-ef7f-4ff2-bbf4-0043e3617b22 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:55:58.663795 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-66ca767d-ef7f-4ff2-bbf4-0043e3617b22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:55:58.727872 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4017/8006] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:55:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:55:58.736348 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0664af2f-ff6f-47f0-8560-d27a3b6f5666 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:55:58.736636 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0664af2f-ff6f-47f0-8560-d27a3b6f5666 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:55:58.736938 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0664af2f-ff6f-47f0-8560-d27a3b6f5666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:55:58.755344 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-0664af2f-ff6f-47f0-8560-d27a3b6f5666 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:55:58.756547 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-0664af2f-ff6f-47f0-8560-d27a3b6f5666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:55:58.765399 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3990/8007] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:55:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:55:58.769851 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ca767d-ef7f-4ff2-bbf4-0043e3617b22 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:55:58.780445 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ca767d-ef7f-4ff2-bbf4-0043e3617b22 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:55:58.786122 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1285013f-f053-4e8b-b90e-e51fe819f400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:55:58.786823 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1285013f-f053-4e8b-b90e-e51fe819f400 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:55:58.787109 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1285013f-f053-4e8b-b90e-e51fe819f400 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:55:58.787385 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1285013f-f053-4e8b-b90e-e51fe819f400 admin admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:55:58.788117 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1285013f-f053-4e8b-b90e-e51fe819f400 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 21:55:58.788421 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1285013f-f053-4e8b-b90e-e51fe819f400 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:55:58.790259 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1285013f-f053-4e8b-b90e-e51fe819f400 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:55:58.802985 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4018/8008] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 21:55:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 21:55:58.807277 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0664af2f-ff6f-47f0-8560-d27a3b6f5666 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:55:58.811878 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:55:58.818546 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0664af2f-ff6f-47f0-8560-d27a3b6f5666 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:55:58.825085 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d29a689-d149-4ba6-9549-524a5adc60dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:55:58.825778 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d29a689-d149-4ba6-9549-524a5adc60dc admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:55:58.826385 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d29a689-d149-4ba6-9549-524a5adc60dc admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:55:58.826924 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d29a689-d149-4ba6-9549-524a5adc60dc admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:55:58.827883 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d29a689-d149-4ba6-9549-524a5adc60dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:55:58.829830 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d29a689-d149-4ba6-9549-524a5adc60dc admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:55:58.869797 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3991/8009] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 21:55:58 2022] POST /identity/v3/projects => generated 377 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:55:58.874269 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1285013f-f053-4e8b-b90e-e51fe819f400 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:55:58.885195 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1285013f-f053-4e8b-b90e-e51fe819f400 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:55:58.945213 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df5323a-e5b3-448f-a3c2-748005cdd586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:55:58.945921 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df5323a-e5b3-448f-a3c2-748005cdd586 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:55:58.946207 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df5323a-e5b3-448f-a3c2-748005cdd586 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:55:58.946483 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df5323a-e5b3-448f-a3c2-748005cdd586 admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:55:58.947179 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df5323a-e5b3-448f-a3c2-748005cdd586 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:55:58.949117 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df5323a-e5b3-448f-a3c2-748005cdd586 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:55:58.972106 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4019/8010] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 21:55:58 2022] POST /identity/v3/users => generated 289 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 21:55:58.974256 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d29a689-d149-4ba6-9549-524a5adc60dc admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:55:58.985007 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d29a689-d149-4ba6-9549-524a5adc60dc admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:55:58.989563 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4075b648-b3b8-4e99-b0cc-fb38c2152620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:55:58.990303 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4075b648-b3b8-4e99-b0cc-fb38c2152620 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:55:58.990566 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4075b648-b3b8-4e99-b0cc-fb38c2152620 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:55:58.990840 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4075b648-b3b8-4e99-b0cc-fb38c2152620 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:55:58.991563 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4075b648-b3b8-4e99-b0cc-fb38c2152620 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:55:58.993207 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4075b648-b3b8-4e99-b0cc-fb38c2152620 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:55:59.003129 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3992/8011] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:55:58 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:55:59.007081 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df5323a-e5b3-448f-a3c2-748005cdd586 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:55:59.012468 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:55:59.018500 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df5323a-e5b3-448f-a3c2-748005cdd586 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:55:59.024313 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6431b4e-ba86-41da-ac20-60bbd68c77b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:55:59.025042 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6431b4e-ba86-41da-ac20-60bbd68c77b7 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:55:59.025329 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6431b4e-ba86-41da-ac20-60bbd68c77b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:55:59.025603 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6431b4e-ba86-41da-ac20-60bbd68c77b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:55:59.026353 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6431b4e-ba86-41da-ac20-60bbd68c77b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:55:59.027951 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6431b4e-ba86-41da-ac20-60bbd68c77b7 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:55:59.038051 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4020/8012] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:55:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 21:55:59.042387 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4075b648-b3b8-4e99-b0cc-fb38c2152620 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:55:59.052999 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4075b648-b3b8-4e99-b0cc-fb38c2152620 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:55:59.059022 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eae62d-fde8-499d-b51e-db2b9402a754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:55:59.059948 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eae62d-fde8-499d-b51e-db2b9402a754 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:55:59.060227 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eae62d-fde8-499d-b51e-db2b9402a754 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:55:59.060505 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eae62d-fde8-499d-b51e-db2b9402a754 admin admin] PATH_INFO: `/v3/projects/7f624e0dec4a4f64b1d3580e60867c41/users/b5408fb2f4044c6d88527222b190230d/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:55:59.076088 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77eae62d-fde8-499d-b51e-db2b9402a754 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f624e0dec4a4f64b1d3580e60867c41, user_id=b5408fb2f4044c6d88527222b190230d, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:55:59.078815 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77eae62d-fde8-499d-b51e-db2b9402a754 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:55:59.095330 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3993/8013] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 21:55:59 2022] PUT /identity/v3/projects/7f624e0dec4a4f64b1d3580e60867c41/users/b5408fb2f4044c6d88527222b190230d/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 21:55:59.100720 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459f0432-1a7c-4598-a2b9-b37407cd9f6e None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:55:59.101009 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459f0432-1a7c-4598-a2b9-b37407cd9f6e None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:55:59.101308 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459f0432-1a7c-4598-a2b9-b37407cd9f6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:55:59.120090 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-459f0432-1a7c-4598-a2b9-b37407cd9f6e None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:55:59.121296 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-459f0432-1a7c-4598-a2b9-b37407cd9f6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:55:59.185142 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4021/8014] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:55:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:55:59.196538 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eae62d-fde8-499d-b51e-db2b9402a754 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:55:59.198655 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-77eae62d-fde8-499d-b51e-db2b9402a754 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:55:59.261830 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eae62d-fde8-499d-b51e-db2b9402a754 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:55:59.267080 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd8e1d3-bd17-4cd5-b6c2-1b322eb597c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:55:59.267736 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd8e1d3-bd17-4cd5-b6c2-1b322eb597c0 service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:55:59.268012 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd8e1d3-bd17-4cd5-b6c2-1b322eb597c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:55:59.268279 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd8e1d3-bd17-4cd5-b6c2-1b322eb597c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:55:59.278539 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd8e1d3-bd17-4cd5-b6c2-1b322eb597c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:55:59.279979 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd8e1d3-bd17-4cd5-b6c2-1b322eb597c0 service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:55:59.289647 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3994/8015] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:55:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:56:03.073144 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaace6c-45ad-4617-bd87-6209b970b16e None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:56:03.073714 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaace6c-45ad-4617-bd87-6209b970b16e None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:56:03.073714 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaace6c-45ad-4617-bd87-6209b970b16e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:56:03.103086 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-cbaace6c-45ad-4617-bd87-6209b970b16e None None] MFA Rules not processed for user `b5408fb2f4044c6d88527222b190230d`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:56:03.104332 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-cbaace6c-45ad-4617-bd87-6209b970b16e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:56:03.172108 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4022/8016] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:56:03 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:56:03.193174 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd8e1d3-bd17-4cd5-b6c2-1b322eb597c0 service neutron] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:56:03.194777 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-4fd8e1d3-bd17-4cd5-b6c2-1b322eb597c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:56:03.312098 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd8e1d3-bd17-4cd5-b6c2-1b322eb597c0 service neutron] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:56:03.317784 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a394a3-2e07-4cf4-924e-f02fef08f14d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:56:03.318551 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a394a3-2e07-4cf4-924e-f02fef08f14d service nova] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:56:03.319039 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a394a3-2e07-4cf4-924e-f02fef08f14d service nova] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:56:03.319244 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a394a3-2e07-4cf4-924e-f02fef08f14d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:56:03.328066 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a394a3-2e07-4cf4-924e-f02fef08f14d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:56:03.329761 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a394a3-2e07-4cf4-924e-f02fef08f14d service nova] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:56:03.333698 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:56:03.341673 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3995/8017] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:56:03 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:56:04.692265 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0b9432-afea-449f-9a8d-9b939da2d884 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:56:04.692747 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0b9432-afea-449f-9a8d-9b939da2d884 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:56:04.692868 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0b9432-afea-449f-9a8d-9b939da2d884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:56:04.711789 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-0c0b9432-afea-449f-9a8d-9b939da2d884 None None] MFA Rules not processed for user `b5408fb2f4044c6d88527222b190230d`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:56:04.713012 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-0c0b9432-afea-449f-9a8d-9b939da2d884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:56:04.721536 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4023/8018] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:56:04 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:56:04.762283 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a394a3-2e07-4cf4-924e-f02fef08f14d service nova] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:56:04.763974 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-52a394a3-2e07-4cf4-924e-f02fef08f14d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:56:04.848231 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a394a3-2e07-4cf4-924e-f02fef08f14d service nova] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:56:04.852128 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cb6a0c-a21b-47c6-8704-4f7274b2ed4a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7f2db148c8e4d5d81431cae3576434b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:56:04.852780 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cb6a0c-a21b-47c6-8704-4f7274b2ed4a service glance] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:56:04.853061 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cb6a0c-a21b-47c6-8704-4f7274b2ed4a service glance] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:56:04.853325 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cb6a0c-a21b-47c6-8704-4f7274b2ed4a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:56:04.855186 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-e3cb6a0c-a21b-47c6-8704-4f7274b2ed4a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:56:04.871028 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cb6a0c-a21b-47c6-8704-4f7274b2ed4a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:56:04.872461 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cb6a0c-a21b-47c6-8704-4f7274b2ed4a service glance] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:56:04.886501 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3996/8019] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:56:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:56:05.168110 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0b9432-afea-449f-9a8d-9b939da2d884 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:56:05.169534 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-0c0b9432-afea-449f-9a8d-9b939da2d884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:56:05.185361 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0b9432-afea-449f-9a8d-9b939da2d884 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:56:05.190060 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9ac5f3-49a5-4aa8-8731-bcdde747b3ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:56:05.190821 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9ac5f3-49a5-4aa8-8731-bcdde747b3ae service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:56:05.191102 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9ac5f3-49a5-4aa8-8731-bcdde747b3ae service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:56:05.191372 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9ac5f3-49a5-4aa8-8731-bcdde747b3ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:56:05.193271 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-fd9ac5f3-49a5-4aa8-8731-bcdde747b3ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:56:05.206749 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9ac5f3-49a5-4aa8-8731-bcdde747b3ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:56:05.208217 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9ac5f3-49a5-4aa8-8731-bcdde747b3ae service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:56:05.219070 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4024/8020] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:56:05 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:56:05.942794 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cb6a0c-a21b-47c6-8704-4f7274b2ed4a service glance] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:56:05.944875 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-e3cb6a0c-a21b-47c6-8704-4f7274b2ed4a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:56:06.033669 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cb6a0c-a21b-47c6-8704-4f7274b2ed4a service glance] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:56:06.041224 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c65c98a-114c-4728-944c-44d0a3dbc492 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc719a3b3ac4461b82ca04ab6451d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:56:06.042331 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c65c98a-114c-4728-944c-44d0a3dbc492 service placement] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:56:06.042817 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c65c98a-114c-4728-944c-44d0a3dbc492 service placement] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:56:06.043295 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c65c98a-114c-4728-944c-44d0a3dbc492 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:56:06.045604 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-2c65c98a-114c-4728-944c-44d0a3dbc492 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:56:06.061569 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c65c98a-114c-4728-944c-44d0a3dbc492 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:56:06.063384 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c65c98a-114c-4728-944c-44d0a3dbc492 service placement] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:56:06.079490 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3997/8021] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:56:05 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:56:07.901102 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9ac5f3-49a5-4aa8-8731-bcdde747b3ae service neutron] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:56:07.913064 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9ac5f3-49a5-4aa8-8731-bcdde747b3ae service neutron] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:56:07.917558 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107f1226-3446-4ed5-82cb-f5b2c39297ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:56:07.918310 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107f1226-3446-4ed5-82cb-f5b2c39297ca service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:56:07.918578 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107f1226-3446-4ed5-82cb-f5b2c39297ca service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:56:07.918844 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107f1226-3446-4ed5-82cb-f5b2c39297ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:56:07.920919 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-107f1226-3446-4ed5-82cb-f5b2c39297ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:56:07.934691 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107f1226-3446-4ed5-82cb-f5b2c39297ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:56:07.936158 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107f1226-3446-4ed5-82cb-f5b2c39297ca service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:56:07.948210 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4025/8022] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:56:07 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:56:08.663498 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c65c98a-114c-4728-944c-44d0a3dbc492 service placement] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:56:08.689270 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c65c98a-114c-4728-944c-44d0a3dbc492 service placement] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:56:08.696196 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d3643b-6ad4-4d76-b0a4-b4b34ffe3b20 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:56:08.697239 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d3643b-6ad4-4d76-b0a4-b4b34ffe3b20 service nova] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:56:08.697758 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d3643b-6ad4-4d76-b0a4-b4b34ffe3b20 service nova] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:56:08.698278 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d3643b-6ad4-4d76-b0a4-b4b34ffe3b20 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:56:08.700845 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-e1d3643b-6ad4-4d76-b0a4-b4b34ffe3b20 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:56:08.717163 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d3643b-6ad4-4d76-b0a4-b4b34ffe3b20 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:56:08.718920 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d3643b-6ad4-4d76-b0a4-b4b34ffe3b20 service nova] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:56:08.736158 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3998/8023] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:56:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:56:13.177831 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107f1226-3446-4ed5-82cb-f5b2c39297ca service neutron] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:56:13.194621 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107f1226-3446-4ed5-82cb-f5b2c39297ca service neutron] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:56:13.200638 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8230844c-7a65-473e-b66f-0a629be36171 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:56:13.201300 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8230844c-7a65-473e-b66f-0a629be36171 service nova] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:56:13.201579 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8230844c-7a65-473e-b66f-0a629be36171 service nova] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:56:13.201908 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8230844c-7a65-473e-b66f-0a629be36171 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:56:13.203746 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-8230844c-7a65-473e-b66f-0a629be36171 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:56:13.219670 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8230844c-7a65-473e-b66f-0a629be36171 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:56:13.221269 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8230844c-7a65-473e-b66f-0a629be36171 service nova] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:56:13.235116 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4026/8024] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:56:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:56:18.730723 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=74 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:56:23.228337 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=84 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:56:39.131654 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d3643b-6ad4-4d76-b0a4-b4b34ffe3b20 service nova] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:56:39.159007 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d3643b-6ad4-4d76-b0a4-b4b34ffe3b20 service nova] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:56:39.164799 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9dc6b8-1195-4bb7-9c4d-b5bc2c71622d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc719a3b3ac4461b82ca04ab6451d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:56:39.165440 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9dc6b8-1195-4bb7-9c4d-b5bc2c71622d service placement] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:56:39.165716 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9dc6b8-1195-4bb7-9c4d-b5bc2c71622d service placement] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:56:39.166025 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9dc6b8-1195-4bb7-9c4d-b5bc2c71622d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:56:39.167943 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-9c9dc6b8-1195-4bb7-9c4d-b5bc2c71622d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:56:39.181932 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9dc6b8-1195-4bb7-9c4d-b5bc2c71622d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:56:39.183517 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9dc6b8-1195-4bb7-9c4d-b5bc2c71622d service placement] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:56:39.195871 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 3999/8025] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:56:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:56:49.189639 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=10 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:56:57.214203 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb98dec9-1b01-4cb7-a673-833bfca8bd93 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:56:57.214697 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb98dec9-1b01-4cb7-a673-833bfca8bd93 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:56:57.214899 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb98dec9-1b01-4cb7-a673-833bfca8bd93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:56:57.282533 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-fb98dec9-1b01-4cb7-a673-833bfca8bd93 None None] MFA Rules not processed for user `17b779a3e21a415bb42cde5d6863d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:56:57.283736 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-fb98dec9-1b01-4cb7-a673-833bfca8bd93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:56:57.355171 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4027/8026] 10.222.0.17 () {58 vars in 1009 bytes} [Sat Jul 23 21:56:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:56:57.403834 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9dc6b8-1195-4bb7-9c4d-b5bc2c71622d service placement] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:56:57.405574 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-9c9dc6b8-1195-4bb7-9c4d-b5bc2c71622d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:56:57.501155 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9dc6b8-1195-4bb7-9c4d-b5bc2c71622d service placement] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:56:57.506712 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81abd10f-6a71-473e-b7d7-8d8c982744e3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f0a685b7da46afb81024848f079d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:56:57.507528 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81abd10f-6a71-473e-b7d7-8d8c982744e3 service swift] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:56:57.507804 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81abd10f-6a71-473e-b7d7-8d8c982744e3 service swift] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:56:57.508074 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81abd10f-6a71-473e-b7d7-8d8c982744e3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:56:57.516980 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81abd10f-6a71-473e-b7d7-8d8c982744e3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:56:57.518604 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81abd10f-6a71-473e-b7d7-8d8c982744e3 service swift] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:56:57.526806 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4000/8027] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 23 21:56:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 23 21:57:00.318795 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb98dec9-1b01-4cb7-a673-833bfca8bd93 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:57:00.320411 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-fb98dec9-1b01-4cb7-a673-833bfca8bd93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:57:00.340360 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb98dec9-1b01-4cb7-a673-833bfca8bd93 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:57:00.346316 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e906c0a-04bc-444b-9045-d39d39071a53 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc719a3b3ac4461b82ca04ab6451d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:57:00.347061 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e906c0a-04bc-444b-9045-d39d39071a53 service placement] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:57:00.347519 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e906c0a-04bc-444b-9045-d39d39071a53 service placement] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:57:00.348331 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e906c0a-04bc-444b-9045-d39d39071a53 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:57:00.351552 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-7e906c0a-04bc-444b-9045-d39d39071a53 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:57:00.370184 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e906c0a-04bc-444b-9045-d39d39071a53 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:57:00.372141 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e906c0a-04bc-444b-9045-d39d39071a53 service placement] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:57:00.390348 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4028/8028] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:57:00 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:57:07.523611 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=41 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:57:10.383918 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=50 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:57:11.537735 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d763c02-d794-451e-acb9-249458128160 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:57:11.538278 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d763c02-d794-451e-acb9-249458128160 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:57:11.538278 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d763c02-d794-451e-acb9-249458128160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:57:11.556475 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-6d763c02-d794-451e-acb9-249458128160 None None] MFA Rules not processed for user `17b779a3e21a415bb42cde5d6863d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:57:11.557754 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-6d763c02-d794-451e-acb9-249458128160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:57:11.566207 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4001/8029] 10.222.0.17 () {58 vars in 1009 bytes} [Sat Jul 23 21:57:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:57:11.578631 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e906c0a-04bc-444b-9045-d39d39071a53 service placement] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:57:11.593145 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e906c0a-04bc-444b-9045-d39d39071a53 service placement] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:57:11.599409 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7d162d-a0dc-45a9-ba48-4914bc799fa3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f0a685b7da46afb81024848f079d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:57:11.600195 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7d162d-a0dc-45a9-ba48-4914bc799fa3 service swift] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:57:11.600480 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7d162d-a0dc-45a9-ba48-4914bc799fa3 service swift] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:57:11.600755 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7d162d-a0dc-45a9-ba48-4914bc799fa3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:57:11.609569 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7d162d-a0dc-45a9-ba48-4914bc799fa3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:57:11.611359 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7d162d-a0dc-45a9-ba48-4914bc799fa3 service swift] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:57:11.620279 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4029/8030] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 23 21:57:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 23 21:57:21.550796 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=3 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:57:21.616597 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=6 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:57:25.395623 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8782be54-fb37-4743-98b4-895afe77e20e None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:57:25.396133 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8782be54-fb37-4743-98b4-895afe77e20e None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:57:25.396528 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8782be54-fb37-4743-98b4-895afe77e20e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:57:25.419425 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-8782be54-fb37-4743-98b4-895afe77e20e None None] MFA Rules not processed for user `17b779a3e21a415bb42cde5d6863d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:57:25.420635 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-8782be54-fb37-4743-98b4-895afe77e20e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:57:25.428812 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4002/8031] 10.222.0.17 () {58 vars in 1009 bytes} [Sat Jul 23 21:57:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:57:25.443446 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7d162d-a0dc-45a9-ba48-4914bc799fa3 service swift] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:57:25.458803 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7d162d-a0dc-45a9-ba48-4914bc799fa3 service swift] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:57:25.464722 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624ad29a-5677-41b0-903c-59bf0541d064 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f0a685b7da46afb81024848f079d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:57:25.465414 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624ad29a-5677-41b0-903c-59bf0541d064 service swift] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:57:25.465888 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624ad29a-5677-41b0-903c-59bf0541d064 service swift] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:57:25.466173 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624ad29a-5677-41b0-903c-59bf0541d064 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:57:25.476136 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624ad29a-5677-41b0-903c-59bf0541d064 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:57:25.477748 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624ad29a-5677-41b0-903c-59bf0541d064 service swift] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:57:25.487103 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4030/8032] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 23 21:57:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 23 21:57:34.736694 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc730678-f9fd-45d2-989f-ec55942b57ab None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:57:34.737273 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc730678-f9fd-45d2-989f-ec55942b57ab None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:57:34.737273 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc730678-f9fd-45d2-989f-ec55942b57ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:57:34.756476 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-fc730678-f9fd-45d2-989f-ec55942b57ab None None] MFA Rules not processed for user `17b779a3e21a415bb42cde5d6863d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:57:34.757692 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-fc730678-f9fd-45d2-989f-ec55942b57ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:57:34.766408 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4003/8033] 10.222.0.17 () {58 vars in 967 bytes} [Sat Jul 23 21:57:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:57:34.778812 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624ad29a-5677-41b0-903c-59bf0541d064 service swift] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:57:34.792363 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624ad29a-5677-41b0-903c-59bf0541d064 service swift] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:57:34.798428 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc12671-9baf-41f6-acf8-fb6edb67b355 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f0a685b7da46afb81024848f079d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:57:34.799072 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc12671-9baf-41f6-acf8-fb6edb67b355 service swift] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:57:34.799356 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc12671-9baf-41f6-acf8-fb6edb67b355 service swift] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:57:34.799676 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc12671-9baf-41f6-acf8-fb6edb67b355 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:57:34.808520 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc12671-9baf-41f6-acf8-fb6edb67b355 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:57:34.810241 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc12671-9baf-41f6-acf8-fb6edb67b355 service swift] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:57:34.818978 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4031/8034] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 23 21:57:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 23 21:57:35.407414 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81ff97b-dda6-4313-abf5-2285a8d85642 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:57:35.407698 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81ff97b-dda6-4313-abf5-2285a8d85642 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:57:35.407968 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81ff97b-dda6-4313-abf5-2285a8d85642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:57:35.426698 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-c81ff97b-dda6-4313-abf5-2285a8d85642 None None] MFA Rules not processed for user `17b779a3e21a415bb42cde5d6863d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:57:35.427939 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-c81ff97b-dda6-4313-abf5-2285a8d85642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:57:35.435746 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4004/8035] 10.222.0.17 () {58 vars in 967 bytes} [Sat Jul 23 21:57:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:57:35.448142 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc12671-9baf-41f6-acf8-fb6edb67b355 service swift] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:57:35.461527 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc12671-9baf-41f6-acf8-fb6edb67b355 service swift] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:57:35.467365 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808ca7fb-fed5-40cf-8c19-6f60a0471b22 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f0a685b7da46afb81024848f079d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:57:35.468014 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808ca7fb-fed5-40cf-8c19-6f60a0471b22 service swift] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:57:35.468287 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808ca7fb-fed5-40cf-8c19-6f60a0471b22 service swift] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:57:35.468787 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808ca7fb-fed5-40cf-8c19-6f60a0471b22 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:57:35.477764 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808ca7fb-fed5-40cf-8c19-6f60a0471b22 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:57:35.479382 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808ca7fb-fed5-40cf-8c19-6f60a0471b22 service swift] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:57:35.487602 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4032/8036] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 23 21:57:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 23 21:57:35.817065 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd1482c-25c2-415c-a16f-178984050a6d None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:57:35.817528 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd1482c-25c2-415c-a16f-178984050a6d None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:57:35.817625 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd1482c-25c2-415c-a16f-178984050a6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:57:35.835697 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-6bd1482c-25c2-415c-a16f-178984050a6d None None] MFA Rules not processed for user `17b779a3e21a415bb42cde5d6863d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:57:35.836887 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-6bd1482c-25c2-415c-a16f-178984050a6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:57:35.845539 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4005/8037] 10.222.0.17 () {58 vars in 967 bytes} [Sat Jul 23 21:57:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:57:35.858829 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808ca7fb-fed5-40cf-8c19-6f60a0471b22 service swift] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:57:35.872083 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808ca7fb-fed5-40cf-8c19-6f60a0471b22 service swift] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:57:35.877467 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65bd9dc-415f-495e-a670-984323185612 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f0a685b7da46afb81024848f079d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:57:35.878212 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65bd9dc-415f-495e-a670-984323185612 service swift] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:57:35.878490 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65bd9dc-415f-495e-a670-984323185612 service swift] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:57:35.878764 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65bd9dc-415f-495e-a670-984323185612 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:57:35.887105 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65bd9dc-415f-495e-a670-984323185612 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:57:35.888687 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65bd9dc-415f-495e-a670-984323185612 service swift] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:57:35.896867 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4033/8038] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 23 21:57:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 23 21:57:39.045083 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de848244-f34c-4dfb-bc9f-cfd2230ed0ca None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:57:39.045610 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de848244-f34c-4dfb-bc9f-cfd2230ed0ca None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:57:39.045610 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de848244-f34c-4dfb-bc9f-cfd2230ed0ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:57:39.065281 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-de848244-f34c-4dfb-bc9f-cfd2230ed0ca None None] MFA Rules not processed for user `b5408fb2f4044c6d88527222b190230d`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:57:39.066543 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-de848244-f34c-4dfb-bc9f-cfd2230ed0ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:57:39.074707 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4006/8039] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:57:39 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:57:41.401162 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65bd9dc-415f-495e-a670-984323185612 service swift] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:57:41.416263 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65bd9dc-415f-495e-a670-984323185612 service swift] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:57:41.421208 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772b4141-d8fa-43d7-96a6-f5c56e44259a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:57:41.422501 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772b4141-d8fa-43d7-96a6-f5c56e44259a service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:57:41.422882 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772b4141-d8fa-43d7-96a6-f5c56e44259a service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:57:41.423259 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772b4141-d8fa-43d7-96a6-f5c56e44259a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:57:41.426170 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-772b4141-d8fa-43d7-96a6-f5c56e44259a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:57:41.440172 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772b4141-d8fa-43d7-96a6-f5c56e44259a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:57:41.441632 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772b4141-d8fa-43d7-96a6-f5c56e44259a service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:57:41.453652 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4034/8040] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:57:41 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 23 21:57:42.448630 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de848244-f34c-4dfb-bc9f-cfd2230ed0ca None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 21:57:42.477446 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de848244-f34c-4dfb-bc9f-cfd2230ed0ca None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 21:57:42.488274 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6a5113-d8cd-4757-b84d-4ee25bf702b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 21:57:42.489188 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6a5113-d8cd-4757-b84d-4ee25bf702b1 service nova] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:57:42.490141 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6a5113-d8cd-4757-b84d-4ee25bf702b1 service nova] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:57:42.490513 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6a5113-d8cd-4757-b84d-4ee25bf702b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:57:42.492632 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-7a6a5113-d8cd-4757-b84d-4ee25bf702b1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:57:42.512010 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6a5113-d8cd-4757-b84d-4ee25bf702b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 21:57:42.513665 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6a5113-d8cd-4757-b84d-4ee25bf702b1 service nova] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 21:57:42.528642 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4007/8041] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 21:57:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 21:57:51.446900 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=30 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:57:52.521059 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=21 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:58:17.344075 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc971e17-72d7-4560-b990-bd5e9cecab35 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 21:58:17.344993 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc971e17-72d7-4560-b990-bd5e9cecab35 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 21:58:17.344993 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc971e17-72d7-4560-b990-bd5e9cecab35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 21:58:17.365947 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-dc971e17-72d7-4560-b990-bd5e9cecab35 None None] MFA Rules not processed for user `b5408fb2f4044c6d88527222b190230d`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 21:58:17.367239 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-dc971e17-72d7-4560-b990-bd5e9cecab35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 21:58:17.376350 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4035/8042] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 21:58:17 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 21:58:27.360127 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=3 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:00:07.014658 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5207492-2193-45c3-a238-c8fd9a4cb6af None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:00:07.015447 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5207492-2193-45c3-a238-c8fd9a4cb6af None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:00:07.015447 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5207492-2193-45c3-a238-c8fd9a4cb6af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:00:07.045002 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-c5207492-2193-45c3-a238-c8fd9a4cb6af None None] MFA Rules not processed for user `b5408fb2f4044c6d88527222b190230d`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:00:07.046330 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-c5207492-2193-45c3-a238-c8fd9a4cb6af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:00:07.053650 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4008/8043] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:00:07 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:00:17.039829 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=7 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:00:19.663988 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203c005c-d08a-43a2-ab75-bede709d474a None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:00:19.664563 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203c005c-d08a-43a2-ab75-bede709d474a None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:00:19.664563 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203c005c-d08a-43a2-ab75-bede709d474a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:00:19.683946 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-203c005c-d08a-43a2-ab75-bede709d474a None None] MFA Rules not processed for user `b5408fb2f4044c6d88527222b190230d`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:00:19.685188 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-203c005c-d08a-43a2-ab75-bede709d474a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:00:19.693174 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4036/8044] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:00:19 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:00:29.678505 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=3 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:00:34.670458 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25fdfd0-3b7c-4b40-b2ad-5b95640e5137 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:00:34.671035 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25fdfd0-3b7c-4b40-b2ad-5b95640e5137 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:00:34.671035 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25fdfd0-3b7c-4b40-b2ad-5b95640e5137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:00:34.695617 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-b25fdfd0-3b7c-4b40-b2ad-5b95640e5137 None None] MFA Rules not processed for user `17b779a3e21a415bb42cde5d6863d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:00:34.697375 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-b25fdfd0-3b7c-4b40-b2ad-5b95640e5137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:00:34.732568 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4009/8045] 10.222.0.17 () {58 vars in 1009 bytes} [Sat Jul 23 22:00:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:00:34.787734 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203c005c-d08a-43a2-ab75-bede709d474a None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:00:34.803167 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203c005c-d08a-43a2-ab75-bede709d474a None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:00:34.809712 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110e1973-d18b-4fe1-96b8-307080b11940 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f0a685b7da46afb81024848f079d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:00:34.810410 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110e1973-d18b-4fe1-96b8-307080b11940 service swift] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:00:34.810699 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110e1973-d18b-4fe1-96b8-307080b11940 service swift] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:00:34.810972 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110e1973-d18b-4fe1-96b8-307080b11940 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:00:34.820801 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110e1973-d18b-4fe1-96b8-307080b11940 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:00:34.822443 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110e1973-d18b-4fe1-96b8-307080b11940 service swift] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:00:34.831434 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4037/8046] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 23 22:00:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 23 22:00:44.721828 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=10 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:00:44.827802 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=6 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:01:02.813155 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25fdfd0-3b7c-4b40-b2ad-5b95640e5137 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:01:02.834259 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25fdfd0-3b7c-4b40-b2ad-5b95640e5137 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:01:02.840115 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c949986f-7e2e-4eed-a49f-29f587ccf28c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:01:02.840784 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c949986f-7e2e-4eed-a49f-29f587ccf28c service nova] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:01:02.841066 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c949986f-7e2e-4eed-a49f-29f587ccf28c service nova] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:01:02.841345 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c949986f-7e2e-4eed-a49f-29f587ccf28c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:01:02.850050 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c949986f-7e2e-4eed-a49f-29f587ccf28c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:01:02.851658 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c949986f-7e2e-4eed-a49f-29f587ccf28c service nova] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:01:02.861670 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4010/8047] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:01:02 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:01:04.816081 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110e1973-d18b-4fe1-96b8-307080b11940 service swift] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:01:04.817642 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-110e1973-d18b-4fe1-96b8-307080b11940 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:01:04.833373 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110e1973-d18b-4fe1-96b8-307080b11940 service swift] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:01:04.837497 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c7b91a-201b-401e-8cd6-68407fc9d965 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7f2db148c8e4d5d81431cae3576434b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:01:04.838190 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c7b91a-201b-401e-8cd6-68407fc9d965 service glance] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:01:04.838468 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c7b91a-201b-401e-8cd6-68407fc9d965 service glance] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:01:04.838745 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c7b91a-201b-401e-8cd6-68407fc9d965 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:01:04.852441 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c7b91a-201b-401e-8cd6-68407fc9d965 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:01:04.853898 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c7b91a-201b-401e-8cd6-68407fc9d965 service glance] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:01:04.867461 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4038/8048] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:01:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:01:04.898163 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e342b8-4470-4332-800e-b06b0db8c629 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:01:04.898666 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e342b8-4470-4332-800e-b06b0db8c629 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:01:04.898666 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e342b8-4470-4332-800e-b06b0db8c629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:01:04.917325 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-d7e342b8-4470-4332-800e-b06b0db8c629 None None] MFA Rules not processed for user `17b779a3e21a415bb42cde5d6863d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:01:04.918568 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-d7e342b8-4470-4332-800e-b06b0db8c629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:01:04.927241 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4011/8049] 10.222.0.17 () {58 vars in 967 bytes} [Sat Jul 23 22:01:04 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:01:04.939838 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c7b91a-201b-401e-8cd6-68407fc9d965 service glance] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:01:04.954161 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c7b91a-201b-401e-8cd6-68407fc9d965 service glance] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:01:04.959908 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e8effd-4f7e-4b75-868c-41f038df065f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f0a685b7da46afb81024848f079d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:01:04.960549 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e8effd-4f7e-4b75-868c-41f038df065f service swift] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:01:04.960831 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e8effd-4f7e-4b75-868c-41f038df065f service swift] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:01:04.961109 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e8effd-4f7e-4b75-868c-41f038df065f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:01:04.972145 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e8effd-4f7e-4b75-868c-41f038df065f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:01:04.973795 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e8effd-4f7e-4b75-868c-41f038df065f service swift] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:01:04.982694 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4039/8050] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 23 22:01:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 23 22:01:05.879310 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e342b8-4470-4332-800e-b06b0db8c629 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:01:05.901368 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e342b8-4470-4332-800e-b06b0db8c629 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:01:05.912818 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78520e7c-ffae-4cd2-9ff3-e912ba2ea083 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc719a3b3ac4461b82ca04ab6451d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:01:05.916508 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78520e7c-ffae-4cd2-9ff3-e912ba2ea083 service placement] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:01:05.917034 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78520e7c-ffae-4cd2-9ff3-e912ba2ea083 service placement] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:01:05.917536 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78520e7c-ffae-4cd2-9ff3-e912ba2ea083 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:01:05.919829 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-78520e7c-ffae-4cd2-9ff3-e912ba2ea083 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:01:05.939078 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78520e7c-ffae-4cd2-9ff3-e912ba2ea083 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:01:05.940939 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78520e7c-ffae-4cd2-9ff3-e912ba2ea083 service placement] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:01:05.959287 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4012/8051] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:01:05 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:01:11.613359 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e8effd-4f7e-4b75-868c-41f038df065f service swift] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:01:11.628832 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e8effd-4f7e-4b75-868c-41f038df065f service swift] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:01:11.635584 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7611f254-6fb8-4f9f-90f7-2a8be55f6236 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:01:11.636356 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7611f254-6fb8-4f9f-90f7-2a8be55f6236 service nova] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:01:11.636823 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7611f254-6fb8-4f9f-90f7-2a8be55f6236 service nova] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:01:11.637286 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7611f254-6fb8-4f9f-90f7-2a8be55f6236 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:01:11.650174 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7611f254-6fb8-4f9f-90f7-2a8be55f6236 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:01:11.651845 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7611f254-6fb8-4f9f-90f7-2a8be55f6236 service nova] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:01:11.666867 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4040/8052] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:01:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:01:15.950348 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=15 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:01:19.292695 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae1a918-a898-4fd8-9ab5-dab3bde64536 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:01:19.293347 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae1a918-a898-4fd8-9ab5-dab3bde64536 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:01:19.293347 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae1a918-a898-4fd8-9ab5-dab3bde64536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:01:19.336766 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-cae1a918-a898-4fd8-9ab5-dab3bde64536 None None] MFA Rules not processed for user `c497326ee890462e8f48b4a56f81990c`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:01:19.337973 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-cae1a918-a898-4fd8-9ab5-dab3bde64536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:01:19.345434 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4013/8053] 10.222.0.17 () {58 vars in 1062 bytes} [Sat Jul 23 22:01:19 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:01:19.351629 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7611f254-6fb8-4f9f-90f7-2a8be55f6236 service nova] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:01:19.361783 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7611f254-6fb8-4f9f-90f7-2a8be55f6236 service nova] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:01:19.366228 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8d849f-4d72-4294-950d-6566f4fb3c10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:01:19.366883 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8d849f-4d72-4294-950d-6566f4fb3c10 service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:01:19.367156 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8d849f-4d72-4294-950d-6566f4fb3c10 service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:01:19.367430 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8d849f-4d72-4294-950d-6566f4fb3c10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:01:19.376987 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8d849f-4d72-4294-950d-6566f4fb3c10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:01:19.378463 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8d849f-4d72-4294-950d-6566f4fb3c10 service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:01:19.398530 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4041/8054] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:01:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:01:22.710675 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae1a918-a898-4fd8-9ab5-dab3bde64536 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:01:22.726911 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae1a918-a898-4fd8-9ab5-dab3bde64536 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:01:22.733340 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38659ffb-b897-441a-b7c7-1d91b52d9e6c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc719a3b3ac4461b82ca04ab6451d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:01:22.734062 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38659ffb-b897-441a-b7c7-1d91b52d9e6c service placement] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:01:22.734352 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38659ffb-b897-441a-b7c7-1d91b52d9e6c service placement] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:01:22.734642 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38659ffb-b897-441a-b7c7-1d91b52d9e6c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:01:22.736601 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-38659ffb-b897-441a-b7c7-1d91b52d9e6c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:01:22.752238 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38659ffb-b897-441a-b7c7-1d91b52d9e6c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:01:22.753974 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38659ffb-b897-441a-b7c7-1d91b52d9e6c service placement] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:01:22.768084 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8d849f-4d72-4294-950d-6566f4fb3c10 service neutron] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:01:22.768765 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4014/8055] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:01:22 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:01:22.780745 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8d849f-4d72-4294-950d-6566f4fb3c10 service neutron] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:01:22.785811 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c35186-4682-4527-b4d5-6a1cc0bd7e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:01:22.787146 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c35186-4682-4527-b4d5-6a1cc0bd7e1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:01:22.787261 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c35186-4682-4527-b4d5-6a1cc0bd7e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:01:22.787497 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c35186-4682-4527-b4d5-6a1cc0bd7e1d admin admin] PATH_INFO: `/v3/users/b5408fb2f4044c6d88527222b190230d` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:01:22.788720 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c35186-4682-4527-b4d5-6a1cc0bd7e1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5408fb2f4044c6d88527222b190230d)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:01:22.792354 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c35186-4682-4527-b4d5-6a1cc0bd7e1d admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:01:22.840700 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c6c35186-4682-4527-b4d5-6a1cc0bd7e1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5408fb2f4044c6d88527222b190230d'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:01:22.841338 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c6c35186-4682-4527-b4d5-6a1cc0bd7e1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5408fb2f4044c6d88527222b190230d'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:01:22.848998 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c6c35186-4682-4527-b4d5-6a1cc0bd7e1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5408fb2f4044c6d88527222b190230d'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:01:22.857894 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c6c35186-4682-4527-b4d5-6a1cc0bd7e1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5408fb2f4044c6d88527222b190230d'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:01:22.872383 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c6c35186-4682-4527-b4d5-6a1cc0bd7e1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5408fb2f4044c6d88527222b190230d'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:01:22.880589 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4042/8056] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 22:01:22 2022] DELETE /identity/v3/users/b5408fb2f4044c6d88527222b190230d => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:01:23.073334 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38659ffb-b897-441a-b7c7-1d91b52d9e6c service placement] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:01:23.084618 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38659ffb-b897-441a-b7c7-1d91b52d9e6c service placement] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:01:23.146423 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec0fbd9-b0de-4f70-99d9-972f21485a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:01:23.147328 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec0fbd9-b0de-4f70-99d9-972f21485a40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:01:23.147603 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec0fbd9-b0de-4f70-99d9-972f21485a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:01:23.147871 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec0fbd9-b0de-4f70-99d9-972f21485a40 admin admin] PATH_INFO: `/v3/projects/7f624e0dec4a4f64b1d3580e60867c41` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:01:23.149039 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec0fbd9-b0de-4f70-99d9-972f21485a40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f624e0dec4a4f64b1d3580e60867c41)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:01:23.150987 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec0fbd9-b0de-4f70-99d9-972f21485a40 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:01:23.198577 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-dec0fbd9-b0de-4f70-99d9-972f21485a40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f624e0dec4a4f64b1d3580e60867c41', 'request_id': 'req-dec0fbd9-b0de-4f70-99d9-972f21485a40'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:01:23.207142 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-dec0fbd9-b0de-4f70-99d9-972f21485a40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f624e0dec4a4f64b1d3580e60867c41', 'request_id': 'req-dec0fbd9-b0de-4f70-99d9-972f21485a40'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:01:23.213270 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-dec0fbd9-b0de-4f70-99d9-972f21485a40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f624e0dec4a4f64b1d3580e60867c41', 'request_id': 'req-dec0fbd9-b0de-4f70-99d9-972f21485a40'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:01:23.236932 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-dec0fbd9-b0de-4f70-99d9-972f21485a40 admin admin] The token cache is being invalidate because project 7f624e0dec4a4f64b1d3580e60867c41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 22:01:23.237243 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-dec0fbd9-b0de-4f70-99d9-972f21485a40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:01:23.237992 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-dec0fbd9-b0de-4f70-99d9-972f21485a40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:01:23.239614 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4015/8057] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 22:01:23 2022] DELETE /identity/v3/projects/7f624e0dec4a4f64b1d3580e60867c41 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:01:23.244874 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed32a8e3-96f0-4bec-84fc-9ef57320d00e None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:01:23.245162 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed32a8e3-96f0-4bec-84fc-9ef57320d00e None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:01:23.245437 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed32a8e3-96f0-4bec-84fc-9ef57320d00e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:01:23.266098 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-ed32a8e3-96f0-4bec-84fc-9ef57320d00e None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:01:23.267328 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-ed32a8e3-96f0-4bec-84fc-9ef57320d00e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:01:23.331138 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4043/8058] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:01:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:01:23.339051 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abc59bb-f03d-44e8-bb45-9429ae3d7e6d None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:01:23.339336 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abc59bb-f03d-44e8-bb45-9429ae3d7e6d None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:01:23.339615 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abc59bb-f03d-44e8-bb45-9429ae3d7e6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:01:23.359622 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-8abc59bb-f03d-44e8-bb45-9429ae3d7e6d None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:01:23.360836 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-8abc59bb-f03d-44e8-bb45-9429ae3d7e6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:01:23.369558 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4016/8059] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:01:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:01:23.374054 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed32a8e3-96f0-4bec-84fc-9ef57320d00e None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:01:23.384599 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed32a8e3-96f0-4bec-84fc-9ef57320d00e None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:01:23.389988 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c656aa11-5507-477a-868d-821d4a4f51e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:01:23.390652 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c656aa11-5507-477a-868d-821d4a4f51e4 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:01:23.390937 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c656aa11-5507-477a-868d-821d4a4f51e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:01:23.391231 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c656aa11-5507-477a-868d-821d4a4f51e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:01:23.391964 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c656aa11-5507-477a-868d-821d4a4f51e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 22:01:23.392279 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c656aa11-5507-477a-868d-821d4a4f51e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:01:23.393895 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c656aa11-5507-477a-868d-821d4a4f51e4 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:01:23.400869 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:01:23.409600 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4044/8060] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 22:01:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 22:01:23.411071 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abc59bb-f03d-44e8-bb45-9429ae3d7e6d None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:01:23.420646 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abc59bb-f03d-44e8-bb45-9429ae3d7e6d None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:01:23.425324 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6325c6af-e537-452c-a0f0-c757029f4af0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:01:23.426016 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6325c6af-e537-452c-a0f0-c757029f4af0 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:01:23.426297 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6325c6af-e537-452c-a0f0-c757029f4af0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:01:23.426573 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6325c6af-e537-452c-a0f0-c757029f4af0 admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:01:23.427258 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6325c6af-e537-452c-a0f0-c757029f4af0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:01:23.429170 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6325c6af-e537-452c-a0f0-c757029f4af0 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:01:23.456657 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4017/8061] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 22:01:23 2022] POST /identity/v3/projects => generated 379 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 22:01:23.461218 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c656aa11-5507-477a-868d-821d4a4f51e4 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:01:23.472130 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c656aa11-5507-477a-868d-821d4a4f51e4 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:01:23.540683 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253e5ca1-17f3-46a0-a2d4-11316ec5a226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:01:23.541422 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253e5ca1-17f3-46a0-a2d4-11316ec5a226 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:01:23.541738 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253e5ca1-17f3-46a0-a2d4-11316ec5a226 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:01:23.542037 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253e5ca1-17f3-46a0-a2d4-11316ec5a226 admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:01:23.543017 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253e5ca1-17f3-46a0-a2d4-11316ec5a226 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:01:23.544938 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253e5ca1-17f3-46a0-a2d4-11316ec5a226 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:01:23.567736 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4045/8062] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 22:01:23 2022] POST /identity/v3/users => generated 290 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 22:01:23.572208 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6325c6af-e537-452c-a0f0-c757029f4af0 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:01:23.583320 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6325c6af-e537-452c-a0f0-c757029f4af0 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:01:23.588200 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3633bd43-046b-4cb5-bd56-0f5bdfe04172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:01:23.588899 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3633bd43-046b-4cb5-bd56-0f5bdfe04172 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:01:23.589156 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3633bd43-046b-4cb5-bd56-0f5bdfe04172 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:01:23.589548 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3633bd43-046b-4cb5-bd56-0f5bdfe04172 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:01:23.590198 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3633bd43-046b-4cb5-bd56-0f5bdfe04172 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:01:23.592033 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3633bd43-046b-4cb5-bd56-0f5bdfe04172 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:01:23.603993 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4018/8063] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 22:01:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 22:01:23.608122 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253e5ca1-17f3-46a0-a2d4-11316ec5a226 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:01:23.618794 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253e5ca1-17f3-46a0-a2d4-11316ec5a226 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:01:23.624386 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7487c1dc-7272-4c52-8002-d3ca1ba42e71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:01:23.625057 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7487c1dc-7272-4c52-8002-d3ca1ba42e71 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:01:23.625328 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7487c1dc-7272-4c52-8002-d3ca1ba42e71 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:01:23.625598 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7487c1dc-7272-4c52-8002-d3ca1ba42e71 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:01:23.626352 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7487c1dc-7272-4c52-8002-d3ca1ba42e71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:01:23.627944 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7487c1dc-7272-4c52-8002-d3ca1ba42e71 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:01:23.639284 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4046/8064] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 22:01:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 22:01:23.643240 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3633bd43-046b-4cb5-bd56-0f5bdfe04172 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:01:23.653806 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3633bd43-046b-4cb5-bd56-0f5bdfe04172 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:01:23.659416 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54cfcba-6201-4ecf-b219-b72ecb3c4707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:01:23.660302 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54cfcba-6201-4ecf-b219-b72ecb3c4707 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:01:23.660587 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54cfcba-6201-4ecf-b219-b72ecb3c4707 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:01:23.660856 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54cfcba-6201-4ecf-b219-b72ecb3c4707 admin admin] PATH_INFO: `/v3/projects/5a1e48bc49cd4a3996dd57c72ad2266f/users/38b5e24cb177465a97ed2fc983e68f70/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:01:23.675852 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54cfcba-6201-4ecf-b219-b72ecb3c4707 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a1e48bc49cd4a3996dd57c72ad2266f, user_id=38b5e24cb177465a97ed2fc983e68f70, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:01:23.678550 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54cfcba-6201-4ecf-b219-b72ecb3c4707 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:01:23.680888 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:01:23.698187 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4019/8065] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 22:01:23 2022] PUT /identity/v3/projects/5a1e48bc49cd4a3996dd57c72ad2266f/users/38b5e24cb177465a97ed2fc983e68f70/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:01:23.703230 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c6f9da-bf0e-496d-8f63-8f58c7dffda9 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:01:23.703534 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c6f9da-bf0e-496d-8f63-8f58c7dffda9 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:01:23.703905 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c6f9da-bf0e-496d-8f63-8f58c7dffda9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:01:23.722564 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-40c6f9da-bf0e-496d-8f63-8f58c7dffda9 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:01:23.723778 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-40c6f9da-bf0e-496d-8f63-8f58c7dffda9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:01:23.784133 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4047/8066] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:01:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:01:23.793679 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d6d9aa-2d77-4b69-9d40-36d6db0cee03 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:01:23.794137 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d6d9aa-2d77-4b69-9d40-36d6db0cee03 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:01:23.794253 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d6d9aa-2d77-4b69-9d40-36d6db0cee03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:01:23.812853 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-31d6d9aa-2d77-4b69-9d40-36d6db0cee03 None None] MFA Rules not processed for user `c497326ee890462e8f48b4a56f81990c`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:01:23.814264 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-31d6d9aa-2d77-4b69-9d40-36d6db0cee03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:01:23.867814 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4020/8067] 10.222.0.17 () {58 vars in 1062 bytes} [Sat Jul 23 22:01:23 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:01:23.873903 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c6f9da-bf0e-496d-8f63-8f58c7dffda9 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:01:23.884338 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c6f9da-bf0e-496d-8f63-8f58c7dffda9 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:01:23.889519 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3773d9-73a4-4b91-b280-4b73eb92903e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:01:23.890193 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3773d9-73a4-4b91-b280-4b73eb92903e service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:01:23.890470 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3773d9-73a4-4b91-b280-4b73eb92903e service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:01:23.890736 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3773d9-73a4-4b91-b280-4b73eb92903e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:01:23.901495 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3773d9-73a4-4b91-b280-4b73eb92903e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:01:23.902957 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3773d9-73a4-4b91-b280-4b73eb92903e service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:01:23.913170 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4048/8068] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:01:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:01:27.657939 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e83a46-95ff-4f11-bda0-8960d0b470d1 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:01:27.658862 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e83a46-95ff-4f11-bda0-8960d0b470d1 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:01:27.659310 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e83a46-95ff-4f11-bda0-8960d0b470d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:01:27.690584 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-f7e83a46-95ff-4f11-bda0-8960d0b470d1 None None] MFA Rules not processed for user `38b5e24cb177465a97ed2fc983e68f70`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:01:27.691798 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-f7e83a46-95ff-4f11-bda0-8960d0b470d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:01:27.771627 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4021/8069] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:01:27 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:01:27.784881 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3773d9-73a4-4b91-b280-4b73eb92903e service neutron] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:01:27.786976 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-2b3773d9-73a4-4b91-b280-4b73eb92903e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:01:27.876289 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:01:27.886983 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3773d9-73a4-4b91-b280-4b73eb92903e service neutron] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:01:27.895730 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4ee959-8cf8-4b58-a9f1-f2139b54f3e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:01:27.896408 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4ee959-8cf8-4b58-a9f1-f2139b54f3e9 service nova] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:01:27.896685 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4ee959-8cf8-4b58-a9f1-f2139b54f3e9 service nova] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:01:27.896954 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4ee959-8cf8-4b58-a9f1-f2139b54f3e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:01:27.907540 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4ee959-8cf8-4b58-a9f1-f2139b54f3e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:01:27.909179 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4ee959-8cf8-4b58-a9f1-f2139b54f3e9 service nova] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:01:27.920508 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4049/8070] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:01:27 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:01:31.443994 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e83a46-95ff-4f11-bda0-8960d0b470d1 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:01:31.456889 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e83a46-95ff-4f11-bda0-8960d0b470d1 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:01:31.461704 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8060644a-a86e-4943-8492-84dadc03cf51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:01:31.462824 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8060644a-a86e-4943-8492-84dadc03cf51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:01:31.462969 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8060644a-a86e-4943-8492-84dadc03cf51 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:01:31.463436 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8060644a-a86e-4943-8492-84dadc03cf51 admin admin] PATH_INFO: `/v3/users/38b5e24cb177465a97ed2fc983e68f70` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:01:31.464669 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8060644a-a86e-4943-8492-84dadc03cf51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38b5e24cb177465a97ed2fc983e68f70)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:01:31.466907 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8060644a-a86e-4943-8492-84dadc03cf51 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:01:31.518845 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-8060644a-a86e-4943-8492-84dadc03cf51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38b5e24cb177465a97ed2fc983e68f70'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:01:31.525768 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-8060644a-a86e-4943-8492-84dadc03cf51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38b5e24cb177465a97ed2fc983e68f70'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:01:31.526709 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-8060644a-a86e-4943-8492-84dadc03cf51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38b5e24cb177465a97ed2fc983e68f70'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:01:31.535341 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-8060644a-a86e-4943-8492-84dadc03cf51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38b5e24cb177465a97ed2fc983e68f70'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:01:31.549231 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-8060644a-a86e-4943-8492-84dadc03cf51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38b5e24cb177465a97ed2fc983e68f70'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:01:31.555825 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4022/8071] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 22:01:31 2022] DELETE /identity/v3/users/38b5e24cb177465a97ed2fc983e68f70 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:01:31.742000 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4ee959-8cf8-4b58-a9f1-f2139b54f3e9 service nova] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:01:31.756918 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4ee959-8cf8-4b58-a9f1-f2139b54f3e9 service nova] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:01:31.820935 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6438bf3-118a-4124-a67e-700374e0656b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:01:31.821889 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6438bf3-118a-4124-a67e-700374e0656b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:01:31.822180 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6438bf3-118a-4124-a67e-700374e0656b admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:01:31.822475 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6438bf3-118a-4124-a67e-700374e0656b admin admin] PATH_INFO: `/v3/projects/5a1e48bc49cd4a3996dd57c72ad2266f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:01:31.823677 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6438bf3-118a-4124-a67e-700374e0656b admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a1e48bc49cd4a3996dd57c72ad2266f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:01:31.825630 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6438bf3-118a-4124-a67e-700374e0656b admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:01:31.877012 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-f6438bf3-118a-4124-a67e-700374e0656b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a1e48bc49cd4a3996dd57c72ad2266f', 'request_id': 'req-f6438bf3-118a-4124-a67e-700374e0656b'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:01:31.886322 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-f6438bf3-118a-4124-a67e-700374e0656b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a1e48bc49cd4a3996dd57c72ad2266f', 'request_id': 'req-f6438bf3-118a-4124-a67e-700374e0656b'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:01:31.891954 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-f6438bf3-118a-4124-a67e-700374e0656b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a1e48bc49cd4a3996dd57c72ad2266f', 'request_id': 'req-f6438bf3-118a-4124-a67e-700374e0656b'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:01:31.903132 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-f6438bf3-118a-4124-a67e-700374e0656b admin admin] The token cache is being invalidate because project 5a1e48bc49cd4a3996dd57c72ad2266f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 22:01:31.903414 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-f6438bf3-118a-4124-a67e-700374e0656b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:01:31.904054 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-f6438bf3-118a-4124-a67e-700374e0656b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:01:31.905653 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4050/8072] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 22:01:31 2022] DELETE /identity/v3/projects/5a1e48bc49cd4a3996dd57c72ad2266f => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:01:31.910846 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a74640-ef6d-469a-9287-bd4230acbf09 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:01:31.911133 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a74640-ef6d-469a-9287-bd4230acbf09 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:01:31.911409 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a74640-ef6d-469a-9287-bd4230acbf09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:01:31.918855 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:01:31.930688 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-76a74640-ef6d-469a-9287-bd4230acbf09 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:01:31.932318 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-76a74640-ef6d-469a-9287-bd4230acbf09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:01:31.997722 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4023/8073] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:01:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:01:32.006891 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd032015-8f8b-48f8-90ee-a7e902052a8e None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:01:32.007184 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd032015-8f8b-48f8-90ee-a7e902052a8e None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:01:32.007466 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd032015-8f8b-48f8-90ee-a7e902052a8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:01:32.026715 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-fd032015-8f8b-48f8-90ee-a7e902052a8e None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:01:32.027946 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-fd032015-8f8b-48f8-90ee-a7e902052a8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:01:32.037074 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4051/8074] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:01:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:01:32.041498 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a74640-ef6d-469a-9287-bd4230acbf09 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:01:32.051793 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a74640-ef6d-469a-9287-bd4230acbf09 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:01:32.057066 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d8dc1b-cd41-40ec-845b-1d6276fe5d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:01:32.057729 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d8dc1b-cd41-40ec-845b-1d6276fe5d26 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:01:32.058048 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d8dc1b-cd41-40ec-845b-1d6276fe5d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:01:32.058321 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d8dc1b-cd41-40ec-845b-1d6276fe5d26 admin admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:01:32.059037 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d8dc1b-cd41-40ec-845b-1d6276fe5d26 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 22:01:32.059339 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d8dc1b-cd41-40ec-845b-1d6276fe5d26 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:01:32.060951 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d8dc1b-cd41-40ec-845b-1d6276fe5d26 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:01:32.072955 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4024/8075] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 22:01:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 22:01:32.077711 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd032015-8f8b-48f8-90ee-a7e902052a8e None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:01:32.092232 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd032015-8f8b-48f8-90ee-a7e902052a8e None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:01:32.101641 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f969b782-a002-4fc1-822a-68c0c57b8b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:01:32.102551 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f969b782-a002-4fc1-822a-68c0c57b8b2d admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:01:32.102835 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f969b782-a002-4fc1-822a-68c0c57b8b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:01:32.103109 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f969b782-a002-4fc1-822a-68c0c57b8b2d admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:01:32.103793 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f969b782-a002-4fc1-822a-68c0c57b8b2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:01:32.105722 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f969b782-a002-4fc1-822a-68c0c57b8b2d admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:01:32.137961 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4052/8076] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 22:01:32 2022] POST /identity/v3/projects => generated 373 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 22:01:32.142276 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d8dc1b-cd41-40ec-845b-1d6276fe5d26 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:01:32.152555 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d8dc1b-cd41-40ec-845b-1d6276fe5d26 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:01:32.220831 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da43420c-8b87-4d25-86d2-43bfa1ed3a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:01:32.221514 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da43420c-8b87-4d25-86d2-43bfa1ed3a08 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:01:32.221793 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da43420c-8b87-4d25-86d2-43bfa1ed3a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:01:32.222090 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da43420c-8b87-4d25-86d2-43bfa1ed3a08 admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:01:32.222778 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da43420c-8b87-4d25-86d2-43bfa1ed3a08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:01:32.224734 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da43420c-8b87-4d25-86d2-43bfa1ed3a08 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:01:32.246904 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4025/8077] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 22:01:32 2022] POST /identity/v3/users => generated 287 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 22:01:32.251472 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f969b782-a002-4fc1-822a-68c0c57b8b2d admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:01:32.262603 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f969b782-a002-4fc1-822a-68c0c57b8b2d admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:01:32.268065 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5d1dfc-a023-4b0c-bd91-03ba89a7fc10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:01:32.268712 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5d1dfc-a023-4b0c-bd91-03ba89a7fc10 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:01:32.269059 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5d1dfc-a023-4b0c-bd91-03ba89a7fc10 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:01:32.269371 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5d1dfc-a023-4b0c-bd91-03ba89a7fc10 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:01:32.270325 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5d1dfc-a023-4b0c-bd91-03ba89a7fc10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:01:32.271929 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5d1dfc-a023-4b0c-bd91-03ba89a7fc10 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:01:32.282646 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4053/8078] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 22:01:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 22:01:32.286706 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da43420c-8b87-4d25-86d2-43bfa1ed3a08 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:01:32.297286 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da43420c-8b87-4d25-86d2-43bfa1ed3a08 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:01:32.302831 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4b6047-1a23-47fb-82e8-fb8ce45d1c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:01:32.303509 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4b6047-1a23-47fb-82e8-fb8ce45d1c95 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:01:32.303827 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4b6047-1a23-47fb-82e8-fb8ce45d1c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:01:32.304093 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4b6047-1a23-47fb-82e8-fb8ce45d1c95 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:01:32.304816 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4b6047-1a23-47fb-82e8-fb8ce45d1c95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:01:32.306697 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4b6047-1a23-47fb-82e8-fb8ce45d1c95 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:01:32.317065 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4026/8079] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 22:01:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 22:01:32.321402 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5d1dfc-a023-4b0c-bd91-03ba89a7fc10 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:01:32.331814 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5d1dfc-a023-4b0c-bd91-03ba89a7fc10 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:01:32.336857 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062191d2-938c-4964-8561-4b31d755abc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:01:32.337790 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062191d2-938c-4964-8561-4b31d755abc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:01:32.338105 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062191d2-938c-4964-8561-4b31d755abc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:01:32.338399 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062191d2-938c-4964-8561-4b31d755abc8 admin admin] PATH_INFO: `/v3/projects/85920446208748ee806840fe4b2b9414/users/98e4e707d5684b82b6548010a3d94263/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:01:32.355907 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062191d2-938c-4964-8561-4b31d755abc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85920446208748ee806840fe4b2b9414, user_id=98e4e707d5684b82b6548010a3d94263, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:01:32.358620 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062191d2-938c-4964-8561-4b31d755abc8 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:01:32.377811 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4054/8080] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 22:01:32 2022] PUT /identity/v3/projects/85920446208748ee806840fe4b2b9414/users/98e4e707d5684b82b6548010a3d94263/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 22:01:32.383125 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc7a4b3-60be-45c5-a56b-26d78283f1e9 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:01:32.383485 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc7a4b3-60be-45c5-a56b-26d78283f1e9 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:01:32.383747 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc7a4b3-60be-45c5-a56b-26d78283f1e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:01:32.402729 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-3fc7a4b3-60be-45c5-a56b-26d78283f1e9 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:01:32.403995 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-3fc7a4b3-60be-45c5-a56b-26d78283f1e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:01:32.465440 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4027/8081] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:01:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:01:32.475692 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062191d2-938c-4964-8561-4b31d755abc8 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:01:32.477616 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-062191d2-938c-4964-8561-4b31d755abc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:01:32.497098 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:01:32.541093 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062191d2-938c-4964-8561-4b31d755abc8 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:01:32.545459 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a1af52-c002-473a-8c4f-0da61991e70a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:01:32.546140 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a1af52-c002-473a-8c4f-0da61991e70a service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:01:32.546420 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a1af52-c002-473a-8c4f-0da61991e70a service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:01:32.546689 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a1af52-c002-473a-8c4f-0da61991e70a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:01:32.556826 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a1af52-c002-473a-8c4f-0da61991e70a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:01:32.558309 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a1af52-c002-473a-8c4f-0da61991e70a service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:01:32.568245 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4055/8082] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:01:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:01:36.672022 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c714acbc-21a3-4fd2-a930-a7d53b092f46 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:01:36.672531 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c714acbc-21a3-4fd2-a930-a7d53b092f46 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:01:36.672713 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c714acbc-21a3-4fd2-a930-a7d53b092f46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:01:36.692981 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:01:36.702769 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-c714acbc-21a3-4fd2-a930-a7d53b092f46 None None] MFA Rules not processed for user `98e4e707d5684b82b6548010a3d94263`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:01:36.704496 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-c714acbc-21a3-4fd2-a930-a7d53b092f46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:01:36.807922 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4028/8083] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:01:36 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:01:36.820751 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a1af52-c002-473a-8c4f-0da61991e70a service neutron] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:01:36.822483 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-79a1af52-c002-473a-8c4f-0da61991e70a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:01:36.930306 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a1af52-c002-473a-8c4f-0da61991e70a service neutron] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:01:36.936251 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227ca0f2-a732-4fc0-a601-a1f2082d3948 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:01:36.936996 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227ca0f2-a732-4fc0-a601-a1f2082d3948 service nova] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:01:36.937341 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227ca0f2-a732-4fc0-a601-a1f2082d3948 service nova] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:01:36.937694 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227ca0f2-a732-4fc0-a601-a1f2082d3948 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:01:36.946824 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227ca0f2-a732-4fc0-a601-a1f2082d3948 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:01:36.948235 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227ca0f2-a732-4fc0-a601-a1f2082d3948 service nova] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:01:36.958892 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4056/8084] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:01:36 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:01:37.713984 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be86b77-5879-4246-ade0-cb23e9aeb8c6 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:01:37.715600 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be86b77-5879-4246-ade0-cb23e9aeb8c6 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:01:37.716129 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be86b77-5879-4246-ade0-cb23e9aeb8c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:01:37.742252 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-3be86b77-5879-4246-ade0-cb23e9aeb8c6 None None] MFA Rules not processed for user `98e4e707d5684b82b6548010a3d94263`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:01:37.744094 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-3be86b77-5879-4246-ade0-cb23e9aeb8c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:01:37.751618 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4029/8085] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:01:37 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:01:38.040194 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227ca0f2-a732-4fc0-a601-a1f2082d3948 service nova] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:01:38.050263 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227ca0f2-a732-4fc0-a601-a1f2082d3948 service nova] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:01:38.054887 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a96d32e-9e12-4e6c-a510-c38e4a47214e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:01:38.055539 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a96d32e-9e12-4e6c-a510-c38e4a47214e service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:01:38.055818 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a96d32e-9e12-4e6c-a510-c38e4a47214e service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:01:38.056095 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a96d32e-9e12-4e6c-a510-c38e4a47214e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:01:38.058226 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-9a96d32e-9e12-4e6c-a510-c38e4a47214e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:01:38.070525 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a96d32e-9e12-4e6c-a510-c38e4a47214e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:01:38.072005 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a96d32e-9e12-4e6c-a510-c38e4a47214e service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:01:38.082554 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4057/8086] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:01:38 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:01:38.560171 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be86b77-5879-4246-ade0-cb23e9aeb8c6 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:01:38.561792 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-3be86b77-5879-4246-ade0-cb23e9aeb8c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:01:38.654893 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be86b77-5879-4246-ade0-cb23e9aeb8c6 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:01:38.659797 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c37630-888f-45de-ae34-037d4094eb2e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc719a3b3ac4461b82ca04ab6451d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:01:38.660450 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c37630-888f-45de-ae34-037d4094eb2e service placement] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:01:38.660725 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c37630-888f-45de-ae34-037d4094eb2e service placement] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:01:38.661158 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c37630-888f-45de-ae34-037d4094eb2e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:01:38.664829 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-46c37630-888f-45de-ae34-037d4094eb2e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:01:38.678662 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c37630-888f-45de-ae34-037d4094eb2e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:01:38.680409 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c37630-888f-45de-ae34-037d4094eb2e service placement] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:01:38.694545 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4030/8087] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:01:38 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:01:43.048430 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a96d32e-9e12-4e6c-a510-c38e4a47214e service neutron] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:01:43.064775 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a96d32e-9e12-4e6c-a510-c38e4a47214e service neutron] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:01:43.070378 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd58665-d5ea-4177-b014-61dea4d0b04f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc719a3b3ac4461b82ca04ab6451d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:01:43.071057 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd58665-d5ea-4177-b014-61dea4d0b04f service placement] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:01:43.071336 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd58665-d5ea-4177-b014-61dea4d0b04f service placement] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:01:43.071607 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd58665-d5ea-4177-b014-61dea4d0b04f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:01:43.073447 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-0cd58665-d5ea-4177-b014-61dea4d0b04f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:01:43.088685 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd58665-d5ea-4177-b014-61dea4d0b04f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:01:43.090287 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd58665-d5ea-4177-b014-61dea4d0b04f service placement] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:01:43.103310 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4058/8088] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:01:43 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:01:47.078732 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c37630-888f-45de-ae34-037d4094eb2e service placement] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:01:47.094960 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c37630-888f-45de-ae34-037d4094eb2e service placement] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:01:47.102197 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920538e6-1371-4d9d-b119-ae1e0bc507d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:01:47.103172 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920538e6-1371-4d9d-b119-ae1e0bc507d4 service nova] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:01:47.103458 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920538e6-1371-4d9d-b119-ae1e0bc507d4 service nova] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:01:47.103735 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920538e6-1371-4d9d-b119-ae1e0bc507d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:01:47.105822 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-920538e6-1371-4d9d-b119-ae1e0bc507d4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:01:47.121664 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920538e6-1371-4d9d-b119-ae1e0bc507d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:01:47.123349 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920538e6-1371-4d9d-b119-ae1e0bc507d4 service nova] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:01:47.137210 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4031/8089] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:01:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:01:53.096604 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=76 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:01:54.936109 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd58665-d5ea-4177-b014-61dea4d0b04f service placement] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:01:54.951389 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd58665-d5ea-4177-b014-61dea4d0b04f service placement] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:01:54.957284 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2fe9c6-5c9c-4a53-a12f-e9a7d1879b56 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc719a3b3ac4461b82ca04ab6451d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:01:54.958070 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2fe9c6-5c9c-4a53-a12f-e9a7d1879b56 service placement] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:01:54.958357 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2fe9c6-5c9c-4a53-a12f-e9a7d1879b56 service placement] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:01:54.958638 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2fe9c6-5c9c-4a53-a12f-e9a7d1879b56 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:01:54.960609 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-fe2fe9c6-5c9c-4a53-a12f-e9a7d1879b56 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:01:54.981719 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2fe9c6-5c9c-4a53-a12f-e9a7d1879b56 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:01:54.981719 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2fe9c6-5c9c-4a53-a12f-e9a7d1879b56 service placement] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:01:55.002042 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4059/8090] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:01:54 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:01:55.016315 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920538e6-1371-4d9d-b119-ae1e0bc507d4 service nova] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:01:55.028494 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920538e6-1371-4d9d-b119-ae1e0bc507d4 service nova] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:01:55.034823 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93cebde-bde3-447c-8b02-c28a78c84e5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:01:55.036319 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93cebde-bde3-447c-8b02-c28a78c84e5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:01:55.036599 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93cebde-bde3-447c-8b02-c28a78c84e5d admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:01:55.036871 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93cebde-bde3-447c-8b02-c28a78c84e5d admin admin] PATH_INFO: `/v3/users/98e4e707d5684b82b6548010a3d94263` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:01:55.038102 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93cebde-bde3-447c-8b02-c28a78c84e5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=98e4e707d5684b82b6548010a3d94263)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:01:55.040044 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93cebde-bde3-447c-8b02-c28a78c84e5d admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:01:55.079724 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:01:55.093139 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-a93cebde-bde3-447c-8b02-c28a78c84e5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98e4e707d5684b82b6548010a3d94263'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:01:55.100629 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-a93cebde-bde3-447c-8b02-c28a78c84e5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98e4e707d5684b82b6548010a3d94263'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:01:55.101311 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-a93cebde-bde3-447c-8b02-c28a78c84e5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98e4e707d5684b82b6548010a3d94263'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:01:55.108972 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-a93cebde-bde3-447c-8b02-c28a78c84e5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98e4e707d5684b82b6548010a3d94263'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:01:55.120882 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-a93cebde-bde3-447c-8b02-c28a78c84e5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98e4e707d5684b82b6548010a3d94263'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:01:55.126754 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4032/8091] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 22:01:55 2022] DELETE /identity/v3/users/98e4e707d5684b82b6548010a3d94263 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:01:55.311891 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2fe9c6-5c9c-4a53-a12f-e9a7d1879b56 service placement] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:01:55.325958 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2fe9c6-5c9c-4a53-a12f-e9a7d1879b56 service placement] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:01:55.387703 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7168a2-2c65-4b6d-b4e8-f9604b758ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:01:55.388577 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7168a2-2c65-4b6d-b4e8-f9604b758ed4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:01:55.388853 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7168a2-2c65-4b6d-b4e8-f9604b758ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:01:55.389125 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7168a2-2c65-4b6d-b4e8-f9604b758ed4 admin admin] PATH_INFO: `/v3/projects/85920446208748ee806840fe4b2b9414` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:01:55.390431 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7168a2-2c65-4b6d-b4e8-f9604b758ed4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=85920446208748ee806840fe4b2b9414)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:01:55.392339 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7168a2-2c65-4b6d-b4e8-f9604b758ed4 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:01:55.440859 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-6f7168a2-2c65-4b6d-b4e8-f9604b758ed4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85920446208748ee806840fe4b2b9414', 'request_id': 'req-6f7168a2-2c65-4b6d-b4e8-f9604b758ed4'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:01:55.450430 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-6f7168a2-2c65-4b6d-b4e8-f9604b758ed4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85920446208748ee806840fe4b2b9414', 'request_id': 'req-6f7168a2-2c65-4b6d-b4e8-f9604b758ed4'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:01:55.456038 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-6f7168a2-2c65-4b6d-b4e8-f9604b758ed4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85920446208748ee806840fe4b2b9414', 'request_id': 'req-6f7168a2-2c65-4b6d-b4e8-f9604b758ed4'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:01:55.467248 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-6f7168a2-2c65-4b6d-b4e8-f9604b758ed4 admin admin] The token cache is being invalidate because project 85920446208748ee806840fe4b2b9414 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 22:01:55.467900 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-6f7168a2-2c65-4b6d-b4e8-f9604b758ed4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:01:55.468554 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-6f7168a2-2c65-4b6d-b4e8-f9604b758ed4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:01:55.470179 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4060/8092] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 22:01:55 2022] DELETE /identity/v3/projects/85920446208748ee806840fe4b2b9414 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:01:55.475249 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be456d0-aa6f-49f2-b818-e6f1774d4fea None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:01:55.475543 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be456d0-aa6f-49f2-b818-e6f1774d4fea None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:01:55.475825 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be456d0-aa6f-49f2-b818-e6f1774d4fea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:01:55.494576 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-2be456d0-aa6f-49f2-b818-e6f1774d4fea None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:01:55.495778 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-2be456d0-aa6f-49f2-b818-e6f1774d4fea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:01:55.563335 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4033/8093] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:01:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:01:55.572256 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef61fab3-38c5-448e-a1fc-4fb74a89eada None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:01:55.572381 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef61fab3-38c5-448e-a1fc-4fb74a89eada None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:01:55.572647 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef61fab3-38c5-448e-a1fc-4fb74a89eada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:01:55.591817 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-ef61fab3-38c5-448e-a1fc-4fb74a89eada None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:01:55.593429 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-ef61fab3-38c5-448e-a1fc-4fb74a89eada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:01:55.601635 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4061/8094] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:01:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:01:55.606002 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be456d0-aa6f-49f2-b818-e6f1774d4fea None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:01:55.616831 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be456d0-aa6f-49f2-b818-e6f1774d4fea None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:01:55.621690 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a32cf27-6169-44c0-ae1f-a7391ab68534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:01:55.622626 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a32cf27-6169-44c0-ae1f-a7391ab68534 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:01:55.622965 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a32cf27-6169-44c0-ae1f-a7391ab68534 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:01:55.623302 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a32cf27-6169-44c0-ae1f-a7391ab68534 admin admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:01:55.624171 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a32cf27-6169-44c0-ae1f-a7391ab68534 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 22:01:55.624457 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a32cf27-6169-44c0-ae1f-a7391ab68534 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:01:55.626156 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a32cf27-6169-44c0-ae1f-a7391ab68534 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:01:55.638290 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4034/8095] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 22:01:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 22:01:55.642944 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef61fab3-38c5-448e-a1fc-4fb74a89eada None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:01:55.653150 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef61fab3-38c5-448e-a1fc-4fb74a89eada None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:01:55.658158 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbdaaac-5850-4fbf-bcc4-213b8f2dc172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:01:55.658824 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbdaaac-5850-4fbf-bcc4-213b8f2dc172 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:01:55.659107 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbdaaac-5850-4fbf-bcc4-213b8f2dc172 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:01:55.659380 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbdaaac-5850-4fbf-bcc4-213b8f2dc172 admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:01:55.660071 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbdaaac-5850-4fbf-bcc4-213b8f2dc172 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:01:55.662008 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbdaaac-5850-4fbf-bcc4-213b8f2dc172 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:01:55.689279 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4062/8096] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 22:01:55 2022] POST /identity/v3/projects => generated 379 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 22:01:55.693478 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a32cf27-6169-44c0-ae1f-a7391ab68534 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:01:55.704462 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a32cf27-6169-44c0-ae1f-a7391ab68534 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:01:55.760780 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580ed632-073e-4584-8e59-9c9b8569e143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:01:55.761485 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580ed632-073e-4584-8e59-9c9b8569e143 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:01:55.761764 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580ed632-073e-4584-8e59-9c9b8569e143 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:01:55.762068 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580ed632-073e-4584-8e59-9c9b8569e143 admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:01:55.762836 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580ed632-073e-4584-8e59-9c9b8569e143 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:01:55.764788 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580ed632-073e-4584-8e59-9c9b8569e143 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:01:55.786749 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4035/8097] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 22:01:55 2022] POST /identity/v3/users => generated 290 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 22:01:55.790800 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbdaaac-5850-4fbf-bcc4-213b8f2dc172 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:01:55.802315 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbdaaac-5850-4fbf-bcc4-213b8f2dc172 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:01:55.807825 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75b8553-3ab4-48ec-806b-9cfa06cc0351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:01:55.808494 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75b8553-3ab4-48ec-806b-9cfa06cc0351 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:01:55.808784 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75b8553-3ab4-48ec-806b-9cfa06cc0351 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:01:55.809031 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75b8553-3ab4-48ec-806b-9cfa06cc0351 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:01:55.809784 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75b8553-3ab4-48ec-806b-9cfa06cc0351 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:01:55.811435 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75b8553-3ab4-48ec-806b-9cfa06cc0351 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:01:55.823093 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4063/8098] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 22:01:55 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 22:01:55.827525 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580ed632-073e-4584-8e59-9c9b8569e143 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:01:55.837886 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580ed632-073e-4584-8e59-9c9b8569e143 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:01:55.843392 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d5aab2-01c5-4b5c-b1a0-bcfab097aef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:01:55.844062 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d5aab2-01c5-4b5c-b1a0-bcfab097aef2 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:01:55.844339 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d5aab2-01c5-4b5c-b1a0-bcfab097aef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:01:55.844617 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d5aab2-01c5-4b5c-b1a0-bcfab097aef2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:01:55.845341 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d5aab2-01c5-4b5c-b1a0-bcfab097aef2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:01:55.846980 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d5aab2-01c5-4b5c-b1a0-bcfab097aef2 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:01:55.857349 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4036/8099] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 22:01:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 22:01:55.862321 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75b8553-3ab4-48ec-806b-9cfa06cc0351 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:01:55.873018 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75b8553-3ab4-48ec-806b-9cfa06cc0351 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:01:55.878949 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a94efe5-c767-4096-ad72-a2528fde81ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:01:55.879823 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a94efe5-c767-4096-ad72-a2528fde81ff admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:01:55.880103 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a94efe5-c767-4096-ad72-a2528fde81ff admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:01:55.880361 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a94efe5-c767-4096-ad72-a2528fde81ff admin admin] PATH_INFO: `/v3/projects/67a499777d904b1884cfba632bb2a8c6/users/a3d16a88a1e243cdb465ce67f556e784/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:01:55.896490 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a94efe5-c767-4096-ad72-a2528fde81ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=67a499777d904b1884cfba632bb2a8c6, user_id=a3d16a88a1e243cdb465ce67f556e784, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:01:55.899235 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a94efe5-c767-4096-ad72-a2528fde81ff admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:01:55.915868 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4064/8100] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 22:01:55 2022] PUT /identity/v3/projects/67a499777d904b1884cfba632bb2a8c6/users/a3d16a88a1e243cdb465ce67f556e784/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:01:55.921424 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3e15bc-4fc4-48d2-b3ec-80f373fbd5c6 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:01:55.921712 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3e15bc-4fc4-48d2-b3ec-80f373fbd5c6 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:01:55.922024 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3e15bc-4fc4-48d2-b3ec-80f373fbd5c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:01:55.940375 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-9d3e15bc-4fc4-48d2-b3ec-80f373fbd5c6 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:01:55.941588 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-9d3e15bc-4fc4-48d2-b3ec-80f373fbd5c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:01:55.955080 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:01:56.005701 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4037/8101] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:01:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:01:56.015814 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a94efe5-c767-4096-ad72-a2528fde81ff admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:01:56.017619 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-9a94efe5-c767-4096-ad72-a2528fde81ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:01:56.032640 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:01:56.081660 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a94efe5-c767-4096-ad72-a2528fde81ff admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:01:56.086193 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0b70d8-e3a3-4bb8-938e-f5f802b3394d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:01:56.086848 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0b70d8-e3a3-4bb8-938e-f5f802b3394d service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:01:56.087125 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0b70d8-e3a3-4bb8-938e-f5f802b3394d service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:01:56.087389 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0b70d8-e3a3-4bb8-938e-f5f802b3394d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:01:56.097773 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0b70d8-e3a3-4bb8-938e-f5f802b3394d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:01:56.099249 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0b70d8-e3a3-4bb8-938e-f5f802b3394d service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:01:56.108860 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4065/8102] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:01:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:01:59.872985 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39000834-acc5-4573-ac13-b8132d14bc16 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:01:59.873553 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39000834-acc5-4573-ac13-b8132d14bc16 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:01:59.873553 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39000834-acc5-4573-ac13-b8132d14bc16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:01:59.905718 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-39000834-acc5-4573-ac13-b8132d14bc16 None None] MFA Rules not processed for user `a3d16a88a1e243cdb465ce67f556e784`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:01:59.906980 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-39000834-acc5-4573-ac13-b8132d14bc16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:01:59.979963 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4038/8103] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:01:59 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:01:59.991391 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833533dd-0357-4ae1-83cd-fbf927087e98 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:01:59.992117 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833533dd-0357-4ae1-83cd-fbf927087e98 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:01:59.992117 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833533dd-0357-4ae1-83cd-fbf927087e98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:00.011977 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-833533dd-0357-4ae1-83cd-fbf927087e98 None None] MFA Rules not processed for user `a3d16a88a1e243cdb465ce67f556e784`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:02:00.013365 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-833533dd-0357-4ae1-83cd-fbf927087e98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:02:00.020806 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4066/8104] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:01:59 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:02:00.033036 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39000834-acc5-4573-ac13-b8132d14bc16 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:00.034494 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-39000834-acc5-4573-ac13-b8132d14bc16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:02:00.112492 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39000834-acc5-4573-ac13-b8132d14bc16 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:00.118052 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1242dcb5-9f06-436a-b7db-6382527364a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:00.118723 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1242dcb5-9f06-436a-b7db-6382527364a8 service nova] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:00.118999 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1242dcb5-9f06-436a-b7db-6382527364a8 service nova] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:00.119273 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1242dcb5-9f06-436a-b7db-6382527364a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:00.127972 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1242dcb5-9f06-436a-b7db-6382527364a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:00.129620 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1242dcb5-9f06-436a-b7db-6382527364a8 service nova] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:00.139416 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4039/8105] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:02:00 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:02:00.706953 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5caa816-854a-44c3-897c-3dfc1defa3b8 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:00.707246 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5caa816-854a-44c3-897c-3dfc1defa3b8 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:00.707527 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5caa816-854a-44c3-897c-3dfc1defa3b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:00.746893 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-d5caa816-854a-44c3-897c-3dfc1defa3b8 None None] MFA Rules not processed for user `abc719a3b3ac4461b82ca04ab6451d81`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:02:00.748265 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-d5caa816-854a-44c3-897c-3dfc1defa3b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:02:00.820683 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4067/8106] 10.222.0.17 () {58 vars in 1018 bytes} [Sat Jul 23 22:02:00 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:02:00.834563 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1242dcb5-9f06-436a-b7db-6382527364a8 service nova] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:00.835999 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-1242dcb5-9f06-436a-b7db-6382527364a8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:02:00.853953 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1242dcb5-9f06-436a-b7db-6382527364a8 service nova] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:00.858952 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f6e7b5-f0d8-4b66-babf-26fc2fbe6d91 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc719a3b3ac4461b82ca04ab6451d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:00.859599 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f6e7b5-f0d8-4b66-babf-26fc2fbe6d91 service placement] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:00.859880 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f6e7b5-f0d8-4b66-babf-26fc2fbe6d91 service placement] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:00.860155 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f6e7b5-f0d8-4b66-babf-26fc2fbe6d91 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:00.868693 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f6e7b5-f0d8-4b66-babf-26fc2fbe6d91 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:00.870273 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f6e7b5-f0d8-4b66-babf-26fc2fbe6d91 service placement] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:00.880160 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4040/8107] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:02:00 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:02:03.000279 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5caa816-854a-44c3-897c-3dfc1defa3b8 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:03.001539 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-d5caa816-854a-44c3-897c-3dfc1defa3b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:02:03.013973 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5caa816-854a-44c3-897c-3dfc1defa3b8 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:03.018000 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf0cd97-6f60-4415-b9b4-8f3cd37f7410 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:03.018671 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf0cd97-6f60-4415-b9b4-8f3cd37f7410 service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:03.018953 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf0cd97-6f60-4415-b9b4-8f3cd37f7410 service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:03.019226 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf0cd97-6f60-4415-b9b4-8f3cd37f7410 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:03.026229 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-0bf0cd97-6f60-4415-b9b4-8f3cd37f7410 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:02:03.040846 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf0cd97-6f60-4415-b9b4-8f3cd37f7410 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:03.042428 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf0cd97-6f60-4415-b9b4-8f3cd37f7410 service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:03.055352 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4068/8108] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:02:02 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:02:06.322404 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f6e7b5-f0d8-4b66-babf-26fc2fbe6d91 service placement] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:06.337142 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f6e7b5-f0d8-4b66-babf-26fc2fbe6d91 service placement] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:06.343156 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c601368-086a-4804-a208-dc424e5c1b96 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc719a3b3ac4461b82ca04ab6451d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:06.343811 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c601368-086a-4804-a208-dc424e5c1b96 service placement] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:06.344091 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c601368-086a-4804-a208-dc424e5c1b96 service placement] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:06.344367 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c601368-086a-4804-a208-dc424e5c1b96 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:06.346328 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-8c601368-086a-4804-a208-dc424e5c1b96 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:02:06.361010 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c601368-086a-4804-a208-dc424e5c1b96 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:06.362625 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c601368-086a-4804-a208-dc424e5c1b96 service placement] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:06.375302 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4041/8109] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:02:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:02:13.048550 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=64 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:02:16.059376 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf0cd97-6f60-4415-b9b4-8f3cd37f7410 service neutron] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:16.071668 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf0cd97-6f60-4415-b9b4-8f3cd37f7410 service neutron] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:16.076954 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7dd190-3595-407b-8975-c797632a6803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:16.077852 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7dd190-3595-407b-8975-c797632a6803 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:16.078165 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7dd190-3595-407b-8975-c797632a6803 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:16.078441 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7dd190-3595-407b-8975-c797632a6803 admin admin] PATH_INFO: `/v3/users/a3d16a88a1e243cdb465ce67f556e784` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:16.079628 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7dd190-3595-407b-8975-c797632a6803 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3d16a88a1e243cdb465ce67f556e784)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:16.081556 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7dd190-3595-407b-8975-c797632a6803 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:16.130656 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-9d7dd190-3595-407b-8975-c797632a6803 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3d16a88a1e243cdb465ce67f556e784'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:16.131333 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-9d7dd190-3595-407b-8975-c797632a6803 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3d16a88a1e243cdb465ce67f556e784'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:16.138715 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-9d7dd190-3595-407b-8975-c797632a6803 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3d16a88a1e243cdb465ce67f556e784'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:16.149130 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-9d7dd190-3595-407b-8975-c797632a6803 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3d16a88a1e243cdb465ce67f556e784'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:16.162439 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-9d7dd190-3595-407b-8975-c797632a6803 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3d16a88a1e243cdb465ce67f556e784'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:16.168474 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4069/8110] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 22:02:16 2022] DELETE /identity/v3/users/a3d16a88a1e243cdb465ce67f556e784 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:02:16.349839 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c601368-086a-4804-a208-dc424e5c1b96 service placement] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:16.363603 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c601368-086a-4804-a208-dc424e5c1b96 service placement] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:16.369045 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=100 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:02:16.424980 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcb2bc3-6b7a-4839-a7a4-89442c9e9269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:16.425888 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcb2bc3-6b7a-4839-a7a4-89442c9e9269 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:16.426177 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcb2bc3-6b7a-4839-a7a4-89442c9e9269 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:16.426455 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcb2bc3-6b7a-4839-a7a4-89442c9e9269 admin admin] PATH_INFO: `/v3/projects/67a499777d904b1884cfba632bb2a8c6` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:16.427818 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcb2bc3-6b7a-4839-a7a4-89442c9e9269 admin admin] RBAC: Authorizing `identity:delete_project(project_id=67a499777d904b1884cfba632bb2a8c6)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:16.429752 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcb2bc3-6b7a-4839-a7a4-89442c9e9269 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:16.478908 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-3dcb2bc3-6b7a-4839-a7a4-89442c9e9269 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67a499777d904b1884cfba632bb2a8c6', 'request_id': 'req-3dcb2bc3-6b7a-4839-a7a4-89442c9e9269'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:16.487948 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-3dcb2bc3-6b7a-4839-a7a4-89442c9e9269 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67a499777d904b1884cfba632bb2a8c6', 'request_id': 'req-3dcb2bc3-6b7a-4839-a7a4-89442c9e9269'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:16.493794 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-3dcb2bc3-6b7a-4839-a7a4-89442c9e9269 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67a499777d904b1884cfba632bb2a8c6', 'request_id': 'req-3dcb2bc3-6b7a-4839-a7a4-89442c9e9269'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:16.504997 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-3dcb2bc3-6b7a-4839-a7a4-89442c9e9269 admin admin] The token cache is being invalidate because project 67a499777d904b1884cfba632bb2a8c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 22:02:16.505269 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-3dcb2bc3-6b7a-4839-a7a4-89442c9e9269 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:16.505977 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-3dcb2bc3-6b7a-4839-a7a4-89442c9e9269 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:16.507581 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4042/8111] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 22:02:16 2022] DELETE /identity/v3/projects/67a499777d904b1884cfba632bb2a8c6 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:02:16.514318 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a390bc-aa35-4810-a902-b6533e6b3e74 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:16.514605 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a390bc-aa35-4810-a902-b6533e6b3e74 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:16.514882 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a390bc-aa35-4810-a902-b6533e6b3e74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:16.534383 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-49a390bc-aa35-4810-a902-b6533e6b3e74 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:02:16.535522 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-49a390bc-aa35-4810-a902-b6533e6b3e74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:02:16.600858 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4070/8112] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:02:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 22:02:16.610078 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac489e1-8718-48b2-8680-0d51f7b61335 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:16.610361 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac489e1-8718-48b2-8680-0d51f7b61335 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:16.610633 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac489e1-8718-48b2-8680-0d51f7b61335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:16.629823 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-0ac489e1-8718-48b2-8680-0d51f7b61335 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:02:16.631086 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-0ac489e1-8718-48b2-8680-0d51f7b61335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:02:16.639860 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4043/8113] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:02:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:02:16.644867 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a390bc-aa35-4810-a902-b6533e6b3e74 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:16.659552 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a390bc-aa35-4810-a902-b6533e6b3e74 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:16.667779 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee143dc-a2d5-42df-9f9c-3f148c714437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:16.668707 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee143dc-a2d5-42df-9f9c-3f148c714437 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:16.669072 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee143dc-a2d5-42df-9f9c-3f148c714437 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:16.669345 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee143dc-a2d5-42df-9f9c-3f148c714437 admin admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:16.670418 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee143dc-a2d5-42df-9f9c-3f148c714437 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 22:02:16.670721 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee143dc-a2d5-42df-9f9c-3f148c714437 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:16.672325 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee143dc-a2d5-42df-9f9c-3f148c714437 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:16.684902 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4071/8114] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 22:02:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 22:02:16.689198 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac489e1-8718-48b2-8680-0d51f7b61335 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:16.698779 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac489e1-8718-48b2-8680-0d51f7b61335 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:16.704272 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776cca1c-f0ce-4640-8386-762211507f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:16.704926 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776cca1c-f0ce-4640-8386-762211507f45 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:16.705203 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776cca1c-f0ce-4640-8386-762211507f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:16.705470 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776cca1c-f0ce-4640-8386-762211507f45 admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:16.706177 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776cca1c-f0ce-4640-8386-762211507f45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:16.708083 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776cca1c-f0ce-4640-8386-762211507f45 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:16.738098 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4044/8115] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 22:02:16 2022] POST /identity/v3/projects => generated 363 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 22:02:16.743582 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee143dc-a2d5-42df-9f9c-3f148c714437 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:16.755643 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee143dc-a2d5-42df-9f9c-3f148c714437 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:16.820495 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4051d86-4fa6-43fb-8599-d80a6127fa6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:16.821185 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4051d86-4fa6-43fb-8599-d80a6127fa6b admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:16.821464 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4051d86-4fa6-43fb-8599-d80a6127fa6b admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:16.821810 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4051d86-4fa6-43fb-8599-d80a6127fa6b admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:16.822532 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4051d86-4fa6-43fb-8599-d80a6127fa6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:16.824496 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4051d86-4fa6-43fb-8599-d80a6127fa6b admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:16.831424 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:02:16.848273 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4072/8116] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 22:02:16 2022] POST /identity/v3/users => generated 282 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 22:02:16.852497 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776cca1c-f0ce-4640-8386-762211507f45 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:16.863030 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776cca1c-f0ce-4640-8386-762211507f45 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:16.868936 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6860bbb4-9763-474b-9103-0a7fb39076e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:16.869594 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6860bbb4-9763-474b-9103-0a7fb39076e0 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:16.869890 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6860bbb4-9763-474b-9103-0a7fb39076e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:16.870173 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6860bbb4-9763-474b-9103-0a7fb39076e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:16.870892 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6860bbb4-9763-474b-9103-0a7fb39076e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:16.872526 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6860bbb4-9763-474b-9103-0a7fb39076e0 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:16.883234 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4045/8117] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 22:02:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 22:02:16.887232 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4051d86-4fa6-43fb-8599-d80a6127fa6b admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:16.898066 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4051d86-4fa6-43fb-8599-d80a6127fa6b admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:16.904203 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0348cc-37e6-4b26-a161-bc6c8c8222df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:16.904865 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0348cc-37e6-4b26-a161-bc6c8c8222df admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:16.905165 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0348cc-37e6-4b26-a161-bc6c8c8222df admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:16.905444 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0348cc-37e6-4b26-a161-bc6c8c8222df admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:16.906208 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0348cc-37e6-4b26-a161-bc6c8c8222df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:16.907807 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0348cc-37e6-4b26-a161-bc6c8c8222df admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:16.918585 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4073/8118] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 22:02:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 22:02:16.922889 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6860bbb4-9763-474b-9103-0a7fb39076e0 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:16.933086 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6860bbb4-9763-474b-9103-0a7fb39076e0 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:16.938710 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380a058b-a1ba-4602-aae7-ec54e21a1c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:16.939580 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380a058b-a1ba-4602-aae7-ec54e21a1c3b admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:16.939855 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380a058b-a1ba-4602-aae7-ec54e21a1c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:16.940128 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380a058b-a1ba-4602-aae7-ec54e21a1c3b admin admin] PATH_INFO: `/v3/projects/7d0d8e7be9d64d9eadf5b9f2612286cd/users/d41e5ea680fe4ce1bb9a7f5fe4deb833/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:16.955841 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380a058b-a1ba-4602-aae7-ec54e21a1c3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d0d8e7be9d64d9eadf5b9f2612286cd, user_id=d41e5ea680fe4ce1bb9a7f5fe4deb833, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:16.958549 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380a058b-a1ba-4602-aae7-ec54e21a1c3b admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:16.973941 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4046/8119] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 22:02:16 2022] PUT /identity/v3/projects/7d0d8e7be9d64d9eadf5b9f2612286cd/users/d41e5ea680fe4ce1bb9a7f5fe4deb833/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 22:02:16.984570 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0683bf-7640-47c5-9d38-dc5d3b56b1ba None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:16.984821 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0683bf-7640-47c5-9d38-dc5d3b56b1ba None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:16.985122 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0683bf-7640-47c5-9d38-dc5d3b56b1ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:17.013628 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-4d0683bf-7640-47c5-9d38-dc5d3b56b1ba None None] MFA Rules not processed for user `d41e5ea680fe4ce1bb9a7f5fe4deb833`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:02:17.014986 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-4d0683bf-7640-47c5-9d38-dc5d3b56b1ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:02:17.089070 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4074/8120] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:02:16 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:02:17.101609 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380a058b-a1ba-4602-aae7-ec54e21a1c3b admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:17.103764 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-380a058b-a1ba-4602-aae7-ec54e21a1c3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:02:17.158326 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:02:17.204314 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380a058b-a1ba-4602-aae7-ec54e21a1c3b admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:17.211361 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eeed037-8b5a-448c-80f7-db52d0becc9d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:17.212028 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeed037-8b5a-448c-80f7-db52d0becc9d service nova] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:17.212305 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeed037-8b5a-448c-80f7-db52d0becc9d service nova] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:17.212574 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeed037-8b5a-448c-80f7-db52d0becc9d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:17.221696 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eeed037-8b5a-448c-80f7-db52d0becc9d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:17.223329 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eeed037-8b5a-448c-80f7-db52d0becc9d service nova] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:17.232840 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4047/8121] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:02:17 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:02:17.273526 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0683bf-7640-47c5-9d38-dc5d3b56b1ba None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:17.340760 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0683bf-7640-47c5-9d38-dc5d3b56b1ba None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:17.346697 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9153a8-f1f8-4c0b-8c49-e7bd374fc389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:17.347597 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9153a8-f1f8-4c0b-8c49-e7bd374fc389 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:17.347876 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9153a8-f1f8-4c0b-8c49-e7bd374fc389 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:17.348141 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9153a8-f1f8-4c0b-8c49-e7bd374fc389 admin admin] PATH_INFO: `/v3/users/d41e5ea680fe4ce1bb9a7f5fe4deb833` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:17.349469 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9153a8-f1f8-4c0b-8c49-e7bd374fc389 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d41e5ea680fe4ce1bb9a7f5fe4deb833)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:17.351546 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9153a8-f1f8-4c0b-8c49-e7bd374fc389 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:17.402675 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-dc9153a8-f1f8-4c0b-8c49-e7bd374fc389 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd41e5ea680fe4ce1bb9a7f5fe4deb833'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:17.403363 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-dc9153a8-f1f8-4c0b-8c49-e7bd374fc389 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd41e5ea680fe4ce1bb9a7f5fe4deb833'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:17.410995 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-dc9153a8-f1f8-4c0b-8c49-e7bd374fc389 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd41e5ea680fe4ce1bb9a7f5fe4deb833'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:17.420095 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-dc9153a8-f1f8-4c0b-8c49-e7bd374fc389 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd41e5ea680fe4ce1bb9a7f5fe4deb833'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:17.425848 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:INSERT=4,keystone:SELECT=87,keystone:DELETE=9 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:02:17.434000 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-dc9153a8-f1f8-4c0b-8c49-e7bd374fc389 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd41e5ea680fe4ce1bb9a7f5fe4deb833'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:17.441292 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4075/8122] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 22:02:17 2022] DELETE /identity/v3/users/d41e5ea680fe4ce1bb9a7f5fe4deb833 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:02:17.446772 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9643232a-050a-45f9-bfba-d5dbc96e61de None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:17.447325 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9643232a-050a-45f9-bfba-d5dbc96e61de None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:17.447325 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9643232a-050a-45f9-bfba-d5dbc96e61de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:17.465260 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-9643232a-050a-45f9-bfba-d5dbc96e61de None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:02:17.466513 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-9643232a-050a-45f9-bfba-d5dbc96e61de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:02:17.532263 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4048/8123] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:02:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:02:17.544118 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9153a8-f1f8-4c0b-8c49-e7bd374fc389 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:17.545848 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-dc9153a8-f1f8-4c0b-8c49-e7bd374fc389 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:02:17.605993 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9153a8-f1f8-4c0b-8c49-e7bd374fc389 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:17.610067 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a67854c-5183-434e-b408-21467f7a06b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:17.610732 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a67854c-5183-434e-b408-21467f7a06b0 service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:17.611021 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a67854c-5183-434e-b408-21467f7a06b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:17.611312 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a67854c-5183-434e-b408-21467f7a06b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:17.621287 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a67854c-5183-434e-b408-21467f7a06b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:17.622757 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a67854c-5183-434e-b408-21467f7a06b0 service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:17.632988 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4076/8124] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:02:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:02:18.254558 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9643232a-050a-45f9-bfba-d5dbc96e61de None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:18.256155 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-9643232a-050a-45f9-bfba-d5dbc96e61de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:02:18.269821 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9643232a-050a-45f9-bfba-d5dbc96e61de None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:18.275378 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921ab267-09f0-4f3c-ae10-371fe4a8509b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:18.276392 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921ab267-09f0-4f3c-ae10-371fe4a8509b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:18.276773 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921ab267-09f0-4f3c-ae10-371fe4a8509b admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:18.276938 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921ab267-09f0-4f3c-ae10-371fe4a8509b admin admin] PATH_INFO: `/v3/projects/7d0d8e7be9d64d9eadf5b9f2612286cd` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:18.278196 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921ab267-09f0-4f3c-ae10-371fe4a8509b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d0d8e7be9d64d9eadf5b9f2612286cd)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:18.280119 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921ab267-09f0-4f3c-ae10-371fe4a8509b admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:18.331608 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-921ab267-09f0-4f3c-ae10-371fe4a8509b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d0d8e7be9d64d9eadf5b9f2612286cd', 'request_id': 'req-921ab267-09f0-4f3c-ae10-371fe4a8509b'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:18.338746 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-921ab267-09f0-4f3c-ae10-371fe4a8509b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d0d8e7be9d64d9eadf5b9f2612286cd', 'request_id': 'req-921ab267-09f0-4f3c-ae10-371fe4a8509b'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:18.344704 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-921ab267-09f0-4f3c-ae10-371fe4a8509b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d0d8e7be9d64d9eadf5b9f2612286cd', 'request_id': 'req-921ab267-09f0-4f3c-ae10-371fe4a8509b'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:18.355909 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-921ab267-09f0-4f3c-ae10-371fe4a8509b admin admin] The token cache is being invalidate because project 7d0d8e7be9d64d9eadf5b9f2612286cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 22:02:18.356213 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-921ab267-09f0-4f3c-ae10-371fe4a8509b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:18.356933 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-921ab267-09f0-4f3c-ae10-371fe4a8509b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:18.358765 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4049/8125] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 22:02:18 2022] DELETE /identity/v3/projects/7d0d8e7be9d64d9eadf5b9f2612286cd => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:02:18.363949 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ca8462-ff31-4605-aa62-a65e914bc5a7 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:18.364435 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ca8462-ff31-4605-aa62-a65e914bc5a7 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:18.364567 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ca8462-ff31-4605-aa62-a65e914bc5a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:18.383067 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-60ca8462-ff31-4605-aa62-a65e914bc5a7 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:02:18.384275 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-60ca8462-ff31-4605-aa62-a65e914bc5a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:02:18.448419 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4077/8126] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:02:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:02:18.456235 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc6065d-5940-4f39-b4d6-03b2efb3f9f7 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:18.456784 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc6065d-5940-4f39-b4d6-03b2efb3f9f7 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:18.456898 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc6065d-5940-4f39-b4d6-03b2efb3f9f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:18.476056 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-9dc6065d-5940-4f39-b4d6-03b2efb3f9f7 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:02:18.477272 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-9dc6065d-5940-4f39-b4d6-03b2efb3f9f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:02:18.485739 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4050/8127] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:02:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:02:18.490115 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ca8462-ff31-4605-aa62-a65e914bc5a7 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:18.500251 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ca8462-ff31-4605-aa62-a65e914bc5a7 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:18.505300 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1028d7ec-a7b2-4c76-a0a3-943e5a10de2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:18.505982 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1028d7ec-a7b2-4c76-a0a3-943e5a10de2e admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:18.506258 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1028d7ec-a7b2-4c76-a0a3-943e5a10de2e admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:18.506524 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1028d7ec-a7b2-4c76-a0a3-943e5a10de2e admin admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:18.507242 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1028d7ec-a7b2-4c76-a0a3-943e5a10de2e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 22:02:18.507542 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1028d7ec-a7b2-4c76-a0a3-943e5a10de2e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:18.509132 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1028d7ec-a7b2-4c76-a0a3-943e5a10de2e admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:18.521358 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4078/8128] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 22:02:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 22:02:18.525737 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc6065d-5940-4f39-b4d6-03b2efb3f9f7 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:18.535607 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc6065d-5940-4f39-b4d6-03b2efb3f9f7 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:18.541189 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8c569c-94a5-4007-aa46-710a44f99c3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:18.541853 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8c569c-94a5-4007-aa46-710a44f99c3f admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:18.542167 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8c569c-94a5-4007-aa46-710a44f99c3f admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:18.542449 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8c569c-94a5-4007-aa46-710a44f99c3f admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:18.543145 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8c569c-94a5-4007-aa46-710a44f99c3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:18.545108 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8c569c-94a5-4007-aa46-710a44f99c3f admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:18.572316 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4051/8129] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 22:02:18 2022] POST /identity/v3/projects => generated 365 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 22:02:18.577074 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1028d7ec-a7b2-4c76-a0a3-943e5a10de2e admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:18.591027 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1028d7ec-a7b2-4c76-a0a3-943e5a10de2e admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:18.654744 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d35fd63-c978-4cb9-bddc-4c3ae8e7d036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:18.655528 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d35fd63-c978-4cb9-bddc-4c3ae8e7d036 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:18.655811 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d35fd63-c978-4cb9-bddc-4c3ae8e7d036 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:18.656107 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d35fd63-c978-4cb9-bddc-4c3ae8e7d036 admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:18.656790 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d35fd63-c978-4cb9-bddc-4c3ae8e7d036 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:18.658760 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d35fd63-c978-4cb9-bddc-4c3ae8e7d036 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:18.680653 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4079/8130] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 22:02:18 2022] POST /identity/v3/users => generated 283 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 22:02:18.684809 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8c569c-94a5-4007-aa46-710a44f99c3f admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:18.695958 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8c569c-94a5-4007-aa46-710a44f99c3f admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:18.701695 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995e20d2-d01e-4e14-af07-d7e6c16c4f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:18.702477 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995e20d2-d01e-4e14-af07-d7e6c16c4f50 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:18.702806 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995e20d2-d01e-4e14-af07-d7e6c16c4f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:18.703078 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995e20d2-d01e-4e14-af07-d7e6c16c4f50 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:18.703803 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995e20d2-d01e-4e14-af07-d7e6c16c4f50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:18.705427 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995e20d2-d01e-4e14-af07-d7e6c16c4f50 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:18.716502 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4052/8131] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 22:02:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 22:02:18.720972 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d35fd63-c978-4cb9-bddc-4c3ae8e7d036 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:18.731688 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d35fd63-c978-4cb9-bddc-4c3ae8e7d036 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:18.737137 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5037f97c-ebe1-455a-82d9-f0d729030b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:18.737809 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5037f97c-ebe1-455a-82d9-f0d729030b12 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:18.738118 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5037f97c-ebe1-455a-82d9-f0d729030b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:18.738377 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5037f97c-ebe1-455a-82d9-f0d729030b12 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:18.739094 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5037f97c-ebe1-455a-82d9-f0d729030b12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:18.740683 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5037f97c-ebe1-455a-82d9-f0d729030b12 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:18.742017 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:02:18.754028 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4080/8132] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 22:02:18 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 22:02:18.758213 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995e20d2-d01e-4e14-af07-d7e6c16c4f50 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:18.764741 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:02:18.768867 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995e20d2-d01e-4e14-af07-d7e6c16c4f50 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:18.775132 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7c17a8-d9aa-41f3-b6e4-8b479522db63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:18.776061 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7c17a8-d9aa-41f3-b6e4-8b479522db63 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:18.776546 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7c17a8-d9aa-41f3-b6e4-8b479522db63 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:18.776986 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7c17a8-d9aa-41f3-b6e4-8b479522db63 admin admin] PATH_INFO: `/v3/projects/ac148c26c08f40d993564ef1a30313dc/users/c3fe4d81f4b24a619e04d8be00a94f79/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:18.792408 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7c17a8-d9aa-41f3-b6e4-8b479522db63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac148c26c08f40d993564ef1a30313dc, user_id=c3fe4d81f4b24a619e04d8be00a94f79, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:18.795095 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7c17a8-d9aa-41f3-b6e4-8b479522db63 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:18.814911 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4053/8133] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 22:02:18 2022] PUT /identity/v3/projects/ac148c26c08f40d993564ef1a30313dc/users/c3fe4d81f4b24a619e04d8be00a94f79/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:02:18.898245 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3f01b4-dd43-4b05-89f4-981bd1c85cee None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:18.898521 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3f01b4-dd43-4b05-89f4-981bd1c85cee None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:18.898802 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3f01b4-dd43-4b05-89f4-981bd1c85cee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:18.930998 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-2c3f01b4-dd43-4b05-89f4-981bd1c85cee None None] MFA Rules not processed for user `c3fe4d81f4b24a619e04d8be00a94f79`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:02:18.932177 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-2c3f01b4-dd43-4b05-89f4-981bd1c85cee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:02:19.004795 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4081/8134] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:02:18 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:02:19.018217 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7c17a8-d9aa-41f3-b6e4-8b479522db63 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:19.020103 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-1e7c17a8-d9aa-41f3-b6e4-8b479522db63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:02:19.100915 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7c17a8-d9aa-41f3-b6e4-8b479522db63 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:19.107310 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e47f84-de85-4525-aa28-32174163d154 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:19.108006 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e47f84-de85-4525-aa28-32174163d154 service nova] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:19.108357 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e47f84-de85-4525-aa28-32174163d154 service nova] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:19.108641 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e47f84-de85-4525-aa28-32174163d154 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:19.117712 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e47f84-de85-4525-aa28-32174163d154 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:19.119356 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e47f84-de85-4525-aa28-32174163d154 service nova] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:19.129192 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4054/8135] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:02:19 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:02:19.143143 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e803e4e2-675a-4706-b7fd-235fec0a6ef6 None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:19.143656 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e803e4e2-675a-4706-b7fd-235fec0a6ef6 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:19.144123 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e803e4e2-675a-4706-b7fd-235fec0a6ef6 None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:19.146439 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4082/8136] 10.222.0.17 () {54 vars in 912 bytes} [Sat Jul 23 22:02:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 22:02:19.151112 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e47f84-de85-4525-aa28-32174163d154 service nova] Authenticating service token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 23 22:02:19.165653 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e47f84-de85-4525-aa28-32174163d154 service nova] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:19.174191 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e47f84-de85-4525-aa28-32174163d154 service nova] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:19.179553 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e30d67-b6a0-4965-8e83-fc15b0d6414d tempest-QuotasTestJSON-1065858816 tempest-QuotasTestJSON-1065858816-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3fe4d81f4b24a619e04d8be00a94f79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac148c26c08f40d993564ef1a30313dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:19.180451 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e30d67-b6a0-4965-8e83-fc15b0d6414d tempest-QuotasTestJSON-1065858816 tempest-QuotasTestJSON-1065858816-project] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:19.180733 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e30d67-b6a0-4965-8e83-fc15b0d6414d tempest-QuotasTestJSON-1065858816 tempest-QuotasTestJSON-1065858816-project] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:19.181009 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e30d67-b6a0-4965-8e83-fc15b0d6414d tempest-QuotasTestJSON-1065858816 tempest-QuotasTestJSON-1065858816-project] PATH_INFO: `/v3/projects/ac148c26c08f40d993564ef1a30313dc` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:19.182372 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e30d67-b6a0-4965-8e83-fc15b0d6414d tempest-QuotasTestJSON-1065858816 tempest-QuotasTestJSON-1065858816-project] RBAC: Authorizing `identity:get_project(project_id=ac148c26c08f40d993564ef1a30313dc)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:19.184173 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e30d67-b6a0-4965-8e83-fc15b0d6414d tempest-QuotasTestJSON-1065858816 tempest-QuotasTestJSON-1065858816-project] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:19.185901 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4055/8137] 10.222.0.17 () {58 vars in 1443 bytes} [Sat Jul 23 22:02:19 2022] GET /identity/v3/projects/ac148c26c08f40d993564ef1a30313dc => generated 365 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 22:02:19.214244 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afef0f8-b751-45cd-bb4f-27f903b47fad None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:19.214533 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afef0f8-b751-45cd-bb4f-27f903b47fad None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:19.214839 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afef0f8-b751-45cd-bb4f-27f903b47fad None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:19.216216 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4083/8138] 10.222.0.17 () {54 vars in 912 bytes} [Sat Jul 23 22:02:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 22:02:19.221623 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e30d67-b6a0-4965-8e83-fc15b0d6414d tempest-QuotasTestJSON-1065858816 tempest-QuotasTestJSON-1065858816-project] Authenticating service token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 23 22:02:19.238023 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e30d67-b6a0-4965-8e83-fc15b0d6414d tempest-QuotasTestJSON-1065858816 tempest-QuotasTestJSON-1065858816-project] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:19.246366 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e30d67-b6a0-4965-8e83-fc15b0d6414d tempest-QuotasTestJSON-1065858816 tempest-QuotasTestJSON-1065858816-project] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:19.251091 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aad171-7b42-48d8-b74d-21d68770acd6 tempest-QuotasTestJSON-1065858816 tempest-QuotasTestJSON-1065858816-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3fe4d81f4b24a619e04d8be00a94f79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac148c26c08f40d993564ef1a30313dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:19.251947 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aad171-7b42-48d8-b74d-21d68770acd6 tempest-QuotasTestJSON-1065858816 tempest-QuotasTestJSON-1065858816-project] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:19.252227 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aad171-7b42-48d8-b74d-21d68770acd6 tempest-QuotasTestJSON-1065858816 tempest-QuotasTestJSON-1065858816-project] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:19.252505 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aad171-7b42-48d8-b74d-21d68770acd6 tempest-QuotasTestJSON-1065858816 tempest-QuotasTestJSON-1065858816-project] PATH_INFO: `/v3/projects/ac148c26c08f40d993564ef1a30313dc` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:19.253840 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93aad171-7b42-48d8-b74d-21d68770acd6 tempest-QuotasTestJSON-1065858816 tempest-QuotasTestJSON-1065858816-project] RBAC: Authorizing `identity:get_project(project_id=ac148c26c08f40d993564ef1a30313dc)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:19.255705 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93aad171-7b42-48d8-b74d-21d68770acd6 tempest-QuotasTestJSON-1065858816 tempest-QuotasTestJSON-1065858816-project] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:19.257404 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4056/8139] 10.222.0.17 () {58 vars in 1443 bytes} [Sat Jul 23 22:02:19 2022] GET /identity/v3/projects/ac148c26c08f40d993564ef1a30313dc => generated 365 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 22:02:19.300140 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16ce673-2890-4c78-b969-c57a4de599cd None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:19.300429 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16ce673-2890-4c78-b969-c57a4de599cd None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:19.300703 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16ce673-2890-4c78-b969-c57a4de599cd None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:19.302151 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4084/8140] 10.222.0.17 () {54 vars in 912 bytes} [Sat Jul 23 22:02:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 22:02:19.307034 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aad171-7b42-48d8-b74d-21d68770acd6 tempest-QuotasTestJSON-1065858816 tempest-QuotasTestJSON-1065858816-project] Authenticating service token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 23 22:02:19.323519 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aad171-7b42-48d8-b74d-21d68770acd6 tempest-QuotasTestJSON-1065858816 tempest-QuotasTestJSON-1065858816-project] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:19.331896 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aad171-7b42-48d8-b74d-21d68770acd6 tempest-QuotasTestJSON-1065858816 tempest-QuotasTestJSON-1065858816-project] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:19.336517 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76883bd5-3df9-4ffe-b45b-550891662547 tempest-QuotasTestJSON-1065858816 tempest-QuotasTestJSON-1065858816-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3fe4d81f4b24a619e04d8be00a94f79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac148c26c08f40d993564ef1a30313dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:19.337381 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76883bd5-3df9-4ffe-b45b-550891662547 tempest-QuotasTestJSON-1065858816 tempest-QuotasTestJSON-1065858816-project] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:19.337662 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76883bd5-3df9-4ffe-b45b-550891662547 tempest-QuotasTestJSON-1065858816 tempest-QuotasTestJSON-1065858816-project] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:19.337967 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76883bd5-3df9-4ffe-b45b-550891662547 tempest-QuotasTestJSON-1065858816 tempest-QuotasTestJSON-1065858816-project] PATH_INFO: `/v3/projects/ac148c26c08f40d993564ef1a30313dc` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:19.339228 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76883bd5-3df9-4ffe-b45b-550891662547 tempest-QuotasTestJSON-1065858816 tempest-QuotasTestJSON-1065858816-project] RBAC: Authorizing `identity:get_project(project_id=ac148c26c08f40d993564ef1a30313dc)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:19.341048 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76883bd5-3df9-4ffe-b45b-550891662547 tempest-QuotasTestJSON-1065858816 tempest-QuotasTestJSON-1065858816-project] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:19.343247 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4057/8141] 10.222.0.17 () {58 vars in 1443 bytes} [Sat Jul 23 22:02:19 2022] GET /identity/v3/projects/ac148c26c08f40d993564ef1a30313dc => generated 365 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 22:02:19.371608 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54152f1a-4696-4456-953b-af1956dad157 None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:19.372110 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54152f1a-4696-4456-953b-af1956dad157 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:19.372208 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54152f1a-4696-4456-953b-af1956dad157 None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:19.374368 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4085/8142] 10.222.0.17 () {54 vars in 912 bytes} [Sat Jul 23 22:02:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 22:02:19.379108 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76883bd5-3df9-4ffe-b45b-550891662547 tempest-QuotasTestJSON-1065858816 tempest-QuotasTestJSON-1065858816-project] Authenticating service token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 23 22:02:19.396175 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76883bd5-3df9-4ffe-b45b-550891662547 tempest-QuotasTestJSON-1065858816 tempest-QuotasTestJSON-1065858816-project] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:19.405797 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76883bd5-3df9-4ffe-b45b-550891662547 tempest-QuotasTestJSON-1065858816 tempest-QuotasTestJSON-1065858816-project] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:19.411211 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582509ce-452f-4db8-a334-d90a82750d58 tempest-QuotasTestJSON-1065858816 tempest-QuotasTestJSON-1065858816-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3fe4d81f4b24a619e04d8be00a94f79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac148c26c08f40d993564ef1a30313dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:19.412079 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582509ce-452f-4db8-a334-d90a82750d58 tempest-QuotasTestJSON-1065858816 tempest-QuotasTestJSON-1065858816-project] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:19.412368 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582509ce-452f-4db8-a334-d90a82750d58 tempest-QuotasTestJSON-1065858816 tempest-QuotasTestJSON-1065858816-project] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:19.412671 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582509ce-452f-4db8-a334-d90a82750d58 tempest-QuotasTestJSON-1065858816 tempest-QuotasTestJSON-1065858816-project] PATH_INFO: `/v3/projects/ac148c26c08f40d993564ef1a30313dc` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:19.414045 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582509ce-452f-4db8-a334-d90a82750d58 tempest-QuotasTestJSON-1065858816 tempest-QuotasTestJSON-1065858816-project] RBAC: Authorizing `identity:get_project(project_id=ac148c26c08f40d993564ef1a30313dc)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:19.415849 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582509ce-452f-4db8-a334-d90a82750d58 tempest-QuotasTestJSON-1065858816 tempest-QuotasTestJSON-1065858816-project] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:19.417575 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4058/8143] 10.222.0.17 () {58 vars in 1443 bytes} [Sat Jul 23 22:02:19 2022] GET /identity/v3/projects/ac148c26c08f40d993564ef1a30313dc => generated 365 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 22:02:19.461646 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a96939f-8866-4858-872a-6f9728fb5d65 None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:19.461985 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a96939f-8866-4858-872a-6f9728fb5d65 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:19.462446 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a96939f-8866-4858-872a-6f9728fb5d65 None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:19.464977 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4086/8144] 10.222.0.17 () {54 vars in 912 bytes} [Sat Jul 23 22:02:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 22:02:19.471467 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582509ce-452f-4db8-a334-d90a82750d58 tempest-QuotasTestJSON-1065858816 tempest-QuotasTestJSON-1065858816-project] Authenticating service token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 23 22:02:19.495044 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582509ce-452f-4db8-a334-d90a82750d58 tempest-QuotasTestJSON-1065858816 tempest-QuotasTestJSON-1065858816-project] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:19.504878 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582509ce-452f-4db8-a334-d90a82750d58 tempest-QuotasTestJSON-1065858816 tempest-QuotasTestJSON-1065858816-project] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:19.509493 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c924f38-f6b5-44cd-ac0d-3660ddbcb122 tempest-QuotasTestJSON-1065858816 tempest-QuotasTestJSON-1065858816-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3fe4d81f4b24a619e04d8be00a94f79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac148c26c08f40d993564ef1a30313dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:19.510338 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c924f38-f6b5-44cd-ac0d-3660ddbcb122 tempest-QuotasTestJSON-1065858816 tempest-QuotasTestJSON-1065858816-project] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:19.510624 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c924f38-f6b5-44cd-ac0d-3660ddbcb122 tempest-QuotasTestJSON-1065858816 tempest-QuotasTestJSON-1065858816-project] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:19.510894 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c924f38-f6b5-44cd-ac0d-3660ddbcb122 tempest-QuotasTestJSON-1065858816 tempest-QuotasTestJSON-1065858816-project] PATH_INFO: `/v3/projects/ac148c26c08f40d993564ef1a30313dc` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:19.512247 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c924f38-f6b5-44cd-ac0d-3660ddbcb122 tempest-QuotasTestJSON-1065858816 tempest-QuotasTestJSON-1065858816-project] RBAC: Authorizing `identity:get_project(project_id=ac148c26c08f40d993564ef1a30313dc)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:19.514076 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c924f38-f6b5-44cd-ac0d-3660ddbcb122 tempest-QuotasTestJSON-1065858816 tempest-QuotasTestJSON-1065858816-project] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:19.515791 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4059/8145] 10.222.0.17 () {58 vars in 1443 bytes} [Sat Jul 23 22:02:19 2022] GET /identity/v3/projects/ac148c26c08f40d993564ef1a30313dc => generated 365 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 22:02:19.547947 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a96939f-8866-4858-872a-6f9728fb5d65 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:19.617516 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a96939f-8866-4858-872a-6f9728fb5d65 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:19.622490 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db983af-5c18-4728-8cd5-abd11cc1f1de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:19.623373 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db983af-5c18-4728-8cd5-abd11cc1f1de admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:19.623647 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db983af-5c18-4728-8cd5-abd11cc1f1de admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:19.623975 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db983af-5c18-4728-8cd5-abd11cc1f1de admin admin] PATH_INFO: `/v3/users/c3fe4d81f4b24a619e04d8be00a94f79` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:19.625177 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db983af-5c18-4728-8cd5-abd11cc1f1de admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3fe4d81f4b24a619e04d8be00a94f79)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:19.627145 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db983af-5c18-4728-8cd5-abd11cc1f1de admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:19.680419 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-0db983af-5c18-4728-8cd5-abd11cc1f1de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3fe4d81f4b24a619e04d8be00a94f79'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:19.681088 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-0db983af-5c18-4728-8cd5-abd11cc1f1de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3fe4d81f4b24a619e04d8be00a94f79'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:19.687968 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-0db983af-5c18-4728-8cd5-abd11cc1f1de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3fe4d81f4b24a619e04d8be00a94f79'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:19.696092 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-0db983af-5c18-4728-8cd5-abd11cc1f1de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3fe4d81f4b24a619e04d8be00a94f79'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:19.709239 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-0db983af-5c18-4728-8cd5-abd11cc1f1de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3fe4d81f4b24a619e04d8be00a94f79'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:19.716148 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4087/8146] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 22:02:19 2022] DELETE /identity/v3/users/c3fe4d81f4b24a619e04d8be00a94f79 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:02:19.721172 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a956029-d183-431c-9520-83da9aaa66ce None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:19.721463 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a956029-d183-431c-9520-83da9aaa66ce None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:19.721737 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a956029-d183-431c-9520-83da9aaa66ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:19.739698 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-9a956029-d183-431c-9520-83da9aaa66ce None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:02:19.740891 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-9a956029-d183-431c-9520-83da9aaa66ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:02:19.801200 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4060/8147] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:02:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:02:19.811275 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db983af-5c18-4728-8cd5-abd11cc1f1de admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:19.812914 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-0db983af-5c18-4728-8cd5-abd11cc1f1de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:02:19.820276 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:02:19.877432 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db983af-5c18-4728-8cd5-abd11cc1f1de admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:19.881475 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02200c4b-16b6-4095-8e3f-c77208751704 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:19.882168 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02200c4b-16b6-4095-8e3f-c77208751704 service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:19.882451 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02200c4b-16b6-4095-8e3f-c77208751704 service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:19.882728 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02200c4b-16b6-4095-8e3f-c77208751704 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:19.892050 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02200c4b-16b6-4095-8e3f-c77208751704 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:19.893485 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02200c4b-16b6-4095-8e3f-c77208751704 service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:19.902931 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4088/8148] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:02:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:02:20.178731 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a956029-d183-431c-9520-83da9aaa66ce None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:20.181152 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-9a956029-d183-431c-9520-83da9aaa66ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:02:20.195966 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a956029-d183-431c-9520-83da9aaa66ce None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:20.201056 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9959b77e-31b0-41e8-829b-96788c05840d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:20.202069 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9959b77e-31b0-41e8-829b-96788c05840d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:20.202413 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9959b77e-31b0-41e8-829b-96788c05840d admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:20.202749 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9959b77e-31b0-41e8-829b-96788c05840d admin admin] PATH_INFO: `/v3/projects/ac148c26c08f40d993564ef1a30313dc` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:20.203976 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9959b77e-31b0-41e8-829b-96788c05840d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac148c26c08f40d993564ef1a30313dc)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:20.205934 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9959b77e-31b0-41e8-829b-96788c05840d admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:20.223556 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:02:20.255210 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-9959b77e-31b0-41e8-829b-96788c05840d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac148c26c08f40d993564ef1a30313dc', 'request_id': 'req-9959b77e-31b0-41e8-829b-96788c05840d'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:20.263987 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-9959b77e-31b0-41e8-829b-96788c05840d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac148c26c08f40d993564ef1a30313dc', 'request_id': 'req-9959b77e-31b0-41e8-829b-96788c05840d'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:20.269654 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-9959b77e-31b0-41e8-829b-96788c05840d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac148c26c08f40d993564ef1a30313dc', 'request_id': 'req-9959b77e-31b0-41e8-829b-96788c05840d'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:20.280418 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-9959b77e-31b0-41e8-829b-96788c05840d admin admin] The token cache is being invalidate because project ac148c26c08f40d993564ef1a30313dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 22:02:20.280699 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-9959b77e-31b0-41e8-829b-96788c05840d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:20.281336 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-9959b77e-31b0-41e8-829b-96788c05840d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:20.283012 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4061/8149] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 22:02:20 2022] DELETE /identity/v3/projects/ac148c26c08f40d993564ef1a30313dc => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:02:20.291996 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43592046-bbee-4879-9319-8ab34d8fc00c None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:20.292307 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43592046-bbee-4879-9319-8ab34d8fc00c None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:20.292583 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43592046-bbee-4879-9319-8ab34d8fc00c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:20.311207 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-43592046-bbee-4879-9319-8ab34d8fc00c None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:02:20.312347 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-43592046-bbee-4879-9319-8ab34d8fc00c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:02:20.376187 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4089/8150] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:02:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:02:20.384678 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadf3ff1-ddb1-45f8-891a-de321f489b6a None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:20.384971 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadf3ff1-ddb1-45f8-891a-de321f489b6a None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:20.385248 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadf3ff1-ddb1-45f8-891a-de321f489b6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:20.404276 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-fadf3ff1-ddb1-45f8-891a-de321f489b6a None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:02:20.405479 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-fadf3ff1-ddb1-45f8-891a-de321f489b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:02:20.414100 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4062/8151] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:02:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:02:20.418304 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43592046-bbee-4879-9319-8ab34d8fc00c None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:20.428778 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43592046-bbee-4879-9319-8ab34d8fc00c None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:20.434695 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8ce2ee-8604-4228-9b53-7e9d5ef7609d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:20.435352 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8ce2ee-8604-4228-9b53-7e9d5ef7609d admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:20.435628 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8ce2ee-8604-4228-9b53-7e9d5ef7609d admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:20.435901 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8ce2ee-8604-4228-9b53-7e9d5ef7609d admin admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:20.436622 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8ce2ee-8604-4228-9b53-7e9d5ef7609d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 22:02:20.436894 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8ce2ee-8604-4228-9b53-7e9d5ef7609d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:20.438533 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8ce2ee-8604-4228-9b53-7e9d5ef7609d admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:20.450585 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4090/8152] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 22:02:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 22:02:20.455614 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadf3ff1-ddb1-45f8-891a-de321f489b6a None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:20.468130 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadf3ff1-ddb1-45f8-891a-de321f489b6a None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:20.473196 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ce1e77-4ca3-497c-ac69-ad4b2b72436b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:20.473801 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ce1e77-4ca3-497c-ac69-ad4b2b72436b admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:20.474123 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ce1e77-4ca3-497c-ac69-ad4b2b72436b admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:20.474393 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ce1e77-4ca3-497c-ac69-ad4b2b72436b admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:20.475079 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ce1e77-4ca3-497c-ac69-ad4b2b72436b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:20.476984 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ce1e77-4ca3-497c-ac69-ad4b2b72436b admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:20.504282 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4063/8153] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 22:02:20 2022] POST /identity/v3/projects => generated 369 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 22:02:20.508599 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8ce2ee-8604-4228-9b53-7e9d5ef7609d admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:20.519413 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8ce2ee-8604-4228-9b53-7e9d5ef7609d admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:20.584417 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6d7c0c-be5f-4818-8599-2094cd406ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:20.585011 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6d7c0c-be5f-4818-8599-2094cd406ce5 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:20.585289 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6d7c0c-be5f-4818-8599-2094cd406ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:20.585567 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6d7c0c-be5f-4818-8599-2094cd406ce5 admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:20.586284 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6d7c0c-be5f-4818-8599-2094cd406ce5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:20.588204 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6d7c0c-be5f-4818-8599-2094cd406ce5 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:20.612696 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4091/8154] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 22:02:20 2022] POST /identity/v3/users => generated 285 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 22:02:20.618953 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ce1e77-4ca3-497c-ac69-ad4b2b72436b admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:20.634265 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ce1e77-4ca3-497c-ac69-ad4b2b72436b admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:20.639577 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf395009-ef1e-41fe-8f49-cccad596165c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:20.640262 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf395009-ef1e-41fe-8f49-cccad596165c admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:20.640536 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf395009-ef1e-41fe-8f49-cccad596165c admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:20.640804 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf395009-ef1e-41fe-8f49-cccad596165c admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:20.641628 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf395009-ef1e-41fe-8f49-cccad596165c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:20.643292 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf395009-ef1e-41fe-8f49-cccad596165c admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:20.653647 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4064/8155] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 22:02:20 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 22:02:20.657612 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6d7c0c-be5f-4818-8599-2094cd406ce5 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:20.667842 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6d7c0c-be5f-4818-8599-2094cd406ce5 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:20.673714 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1108cbef-6dd7-4524-973f-a3b1eae28a05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:20.674437 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1108cbef-6dd7-4524-973f-a3b1eae28a05 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:20.674710 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1108cbef-6dd7-4524-973f-a3b1eae28a05 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:20.674983 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1108cbef-6dd7-4524-973f-a3b1eae28a05 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:20.675708 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1108cbef-6dd7-4524-973f-a3b1eae28a05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:20.677313 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1108cbef-6dd7-4524-973f-a3b1eae28a05 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:20.687990 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4092/8156] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 22:02:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 22:02:20.692193 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf395009-ef1e-41fe-8f49-cccad596165c admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:20.703259 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf395009-ef1e-41fe-8f49-cccad596165c admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:20.708853 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d9061e-37f3-4556-8f41-5c18d7f9d677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:20.709733 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d9061e-37f3-4556-8f41-5c18d7f9d677 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:20.710044 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d9061e-37f3-4556-8f41-5c18d7f9d677 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:20.710317 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d9061e-37f3-4556-8f41-5c18d7f9d677 admin admin] PATH_INFO: `/v3/projects/ea4cca4e43aa4b28ab8fc8a5943b24f5/users/6882b832ed994a1ba087e5dafd1e0c37/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:20.727118 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d9061e-37f3-4556-8f41-5c18d7f9d677 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea4cca4e43aa4b28ab8fc8a5943b24f5, user_id=6882b832ed994a1ba087e5dafd1e0c37, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:20.729855 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d9061e-37f3-4556-8f41-5c18d7f9d677 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:20.744458 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4065/8157] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 22:02:20 2022] PUT /identity/v3/projects/ea4cca4e43aa4b28ab8fc8a5943b24f5/users/6882b832ed994a1ba087e5dafd1e0c37/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:02:20.756044 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e566d5d3-fd76-4562-9d9c-76547f29b7ae None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:20.756332 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e566d5d3-fd76-4562-9d9c-76547f29b7ae None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:20.756608 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e566d5d3-fd76-4562-9d9c-76547f29b7ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:20.781540 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:02:20.784764 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-e566d5d3-fd76-4562-9d9c-76547f29b7ae None None] MFA Rules not processed for user `6882b832ed994a1ba087e5dafd1e0c37`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:02:20.786941 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-e566d5d3-fd76-4562-9d9c-76547f29b7ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:02:20.853239 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4093/8158] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:02:20 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:02:20.857939 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d9061e-37f3-4556-8f41-5c18d7f9d677 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:20.921233 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d9061e-37f3-4556-8f41-5c18d7f9d677 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:20.926605 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb52d7f8-009c-48a3-9afb-3dc575541e3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:20.927280 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb52d7f8-009c-48a3-9afb-3dc575541e3a admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:20.927557 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb52d7f8-009c-48a3-9afb-3dc575541e3a admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:20.927826 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb52d7f8-009c-48a3-9afb-3dc575541e3a admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:20.928511 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb52d7f8-009c-48a3-9afb-3dc575541e3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:20.930464 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb52d7f8-009c-48a3-9afb-3dc575541e3a admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:20.957550 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4066/8159] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 22:02:20 2022] POST /identity/v3/projects => generated 371 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 22:02:20.961852 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e566d5d3-fd76-4562-9d9c-76547f29b7ae None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:20.973311 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e566d5d3-fd76-4562-9d9c-76547f29b7ae None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:21.031766 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1facca71-cfe0-4461-a068-549890630a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:21.032527 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1facca71-cfe0-4461-a068-549890630a90 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:21.032788 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1facca71-cfe0-4461-a068-549890630a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:21.033052 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1facca71-cfe0-4461-a068-549890630a90 admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:21.033769 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1facca71-cfe0-4461-a068-549890630a90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:21.035781 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1facca71-cfe0-4461-a068-549890630a90 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:21.058050 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4094/8160] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 22:02:20 2022] POST /identity/v3/users => generated 292 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 22:02:21.062261 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb52d7f8-009c-48a3-9afb-3dc575541e3a admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:21.072820 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb52d7f8-009c-48a3-9afb-3dc575541e3a admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:21.078077 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017e5d39-5ef1-4fa5-afc3-fe9a2ae449cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:21.078738 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017e5d39-5ef1-4fa5-afc3-fe9a2ae449cc admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:21.079074 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017e5d39-5ef1-4fa5-afc3-fe9a2ae449cc admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:21.079354 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017e5d39-5ef1-4fa5-afc3-fe9a2ae449cc admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:21.080105 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017e5d39-5ef1-4fa5-afc3-fe9a2ae449cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:21.081732 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017e5d39-5ef1-4fa5-afc3-fe9a2ae449cc admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:21.092986 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4067/8161] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 22:02:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 22:02:21.097136 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1facca71-cfe0-4461-a068-549890630a90 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:21.107986 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1facca71-cfe0-4461-a068-549890630a90 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:21.113311 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc809da-988d-4ab7-b39b-8356adb42f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:21.114269 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc809da-988d-4ab7-b39b-8356adb42f1d admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:21.114556 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc809da-988d-4ab7-b39b-8356adb42f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:21.114834 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc809da-988d-4ab7-b39b-8356adb42f1d admin admin] PATH_INFO: `/v3/projects/07b4ee6c1f464943800fe97e983998a5/users/f6c3a3005a124b01ba3277f30d909662/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:21.130587 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc809da-988d-4ab7-b39b-8356adb42f1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=07b4ee6c1f464943800fe97e983998a5, user_id=f6c3a3005a124b01ba3277f30d909662, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:21.133244 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc809da-988d-4ab7-b39b-8356adb42f1d admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:21.148763 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4095/8162] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 22:02:21 2022] PUT /identity/v3/projects/07b4ee6c1f464943800fe97e983998a5/users/f6c3a3005a124b01ba3277f30d909662/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:02:21.154228 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017e5d39-5ef1-4fa5-afc3-fe9a2ae449cc admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:21.164963 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017e5d39-5ef1-4fa5-afc3-fe9a2ae449cc admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:21.176931 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:02:21.227209 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ffe2ab-9d37-4344-9f83-b5c2f16a3699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:21.227874 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ffe2ab-9d37-4344-9f83-b5c2f16a3699 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:21.228149 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ffe2ab-9d37-4344-9f83-b5c2f16a3699 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:21.228421 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ffe2ab-9d37-4344-9f83-b5c2f16a3699 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:21.229140 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ffe2ab-9d37-4344-9f83-b5c2f16a3699 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:21.230809 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ffe2ab-9d37-4344-9f83-b5c2f16a3699 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:21.241105 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4068/8163] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 22:02:21 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 22:02:21.245310 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc809da-988d-4ab7-b39b-8356adb42f1d admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:21.255915 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc809da-988d-4ab7-b39b-8356adb42f1d admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:21.260797 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44e43e5-582e-4f28-aba6-b18471633a83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:21.261691 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44e43e5-582e-4f28-aba6-b18471633a83 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:21.261999 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44e43e5-582e-4f28-aba6-b18471633a83 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:21.262271 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44e43e5-582e-4f28-aba6-b18471633a83 admin admin] PATH_INFO: `/v3/projects/07b4ee6c1f464943800fe97e983998a5/users/f6c3a3005a124b01ba3277f30d909662/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:21.264265 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44e43e5-582e-4f28-aba6-b18471633a83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07b4ee6c1f464943800fe97e983998a5, user_id=f6c3a3005a124b01ba3277f30d909662, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:21.267136 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44e43e5-582e-4f28-aba6-b18471633a83 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:21.277213 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4096/8164] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 22:02:21 2022] PUT /identity/v3/projects/07b4ee6c1f464943800fe97e983998a5/users/f6c3a3005a124b01ba3277f30d909662/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:02:21.289160 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00347174-2cb3-4efb-8a9e-3bfb52a9fb9a None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:21.289477 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00347174-2cb3-4efb-8a9e-3bfb52a9fb9a None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:21.289780 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00347174-2cb3-4efb-8a9e-3bfb52a9fb9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:21.317697 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-00347174-2cb3-4efb-8a9e-3bfb52a9fb9a None None] MFA Rules not processed for user `f6c3a3005a124b01ba3277f30d909662`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:02:21.318959 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-00347174-2cb3-4efb-8a9e-3bfb52a9fb9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:02:21.390801 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4069/8165] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:02:21 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:02:21.395618 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44e43e5-582e-4f28-aba6-b18471633a83 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:21.407181 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44e43e5-582e-4f28-aba6-b18471633a83 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:21.412239 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f565bbe-0482-40fe-bb14-c378f5b2427c tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c3a3005a124b01ba3277f30d909662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b4ee6c1f464943800fe97e983998a5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:21.412920 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f565bbe-0482-40fe-bb14-c378f5b2427c tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:21.413203 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f565bbe-0482-40fe-bb14-c378f5b2427c tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:21.413478 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f565bbe-0482-40fe-bb14-c378f5b2427c tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] PATH_INFO: `/v3/services` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:21.414233 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f565bbe-0482-40fe-bb14-c378f5b2427c tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:21.415813 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f565bbe-0482-40fe-bb14-c378f5b2427c tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:21.436713 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4097/8166] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 22:02:21 2022] POST /identity/v3/services => generated 290 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 22:02:21.441143 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00347174-2cb3-4efb-8a9e-3bfb52a9fb9a None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:21.450824 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00347174-2cb3-4efb-8a9e-3bfb52a9fb9a None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:21.466971 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1da206-791e-454d-95cb-e7a8dfd91a85 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c3a3005a124b01ba3277f30d909662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b4ee6c1f464943800fe97e983998a5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:21.467989 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1da206-791e-454d-95cb-e7a8dfd91a85 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:21.468275 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1da206-791e-454d-95cb-e7a8dfd91a85 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:21.468549 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1da206-791e-454d-95cb-e7a8dfd91a85 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:21.469281 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1da206-791e-454d-95cb-e7a8dfd91a85 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:21.470997 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1da206-791e-454d-95cb-e7a8dfd91a85 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:21.490705 ncdv-master-1 devstack@keystone.service[91547]: WARNING py.warnings [None req-0c1da206-791e-454d-95cb-e7a8dfd91a85 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-845949350. To ensure interoperability, identifiers should be a valid uuid. Jul 23 22:02:21.490705 ncdv-master-1 devstack@keystone.service[91547]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Jul 23 22:02:21.490705 ncdv-master-1 devstack@keystone.service[91547]: Jul 23 22:02:21.523607 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4070/8167] 10.222.0.17 () {60 vars in 1155 bytes} [Sat Jul 23 22:02:21 2022] POST /identity/v3/endpoints => generated 359 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 22:02:21.526949 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f565bbe-0482-40fe-bb14-c378f5b2427c tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:21.538974 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f565bbe-0482-40fe-bb14-c378f5b2427c tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:21.554737 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42242bba-2c98-4d54-80e1-1f17a042653a tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c3a3005a124b01ba3277f30d909662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b4ee6c1f464943800fe97e983998a5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:21.555582 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42242bba-2c98-4d54-80e1-1f17a042653a tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:21.555860 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42242bba-2c98-4d54-80e1-1f17a042653a tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:21.556134 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42242bba-2c98-4d54-80e1-1f17a042653a tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] PATH_INFO: `/v3/regions/tempest-region-845949350` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:21.556782 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42242bba-2c98-4d54-80e1-1f17a042653a tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-845949350)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:21.557841 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42242bba-2c98-4d54-80e1-1f17a042653a tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:21.559749 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4098/8168] 10.222.0.17 () {58 vars in 1202 bytes} [Sat Jul 23 22:02:21 2022] GET /identity/v3/regions/tempest-region-845949350 => generated 178 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 22:02:21.564098 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1da206-791e-454d-95cb-e7a8dfd91a85 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:21.575150 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1da206-791e-454d-95cb-e7a8dfd91a85 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:21.580283 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb693a44-d6c1-4b87-b0eb-f6cd0106d3ea tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c3a3005a124b01ba3277f30d909662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b4ee6c1f464943800fe97e983998a5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:21.580937 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb693a44-d6c1-4b87-b0eb-f6cd0106d3ea tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:21.581208 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb693a44-d6c1-4b87-b0eb-f6cd0106d3ea tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:21.581490 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb693a44-d6c1-4b87-b0eb-f6cd0106d3ea tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] PATH_INFO: `/v3/services` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:21.582236 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb693a44-d6c1-4b87-b0eb-f6cd0106d3ea tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:21.583865 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb693a44-d6c1-4b87-b0eb-f6cd0106d3ea tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:21.602358 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4071/8169] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 22:02:21 2022] POST /identity/v3/services => generated 288 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 22:02:21.606617 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42242bba-2c98-4d54-80e1-1f17a042653a tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:21.621630 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42242bba-2c98-4d54-80e1-1f17a042653a tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:21.638967 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8ebea8-7ad2-4d62-aec2-5ae9ab22e9ca tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c3a3005a124b01ba3277f30d909662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b4ee6c1f464943800fe97e983998a5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:21.639643 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8ebea8-7ad2-4d62-aec2-5ae9ab22e9ca tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:21.639925 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8ebea8-7ad2-4d62-aec2-5ae9ab22e9ca tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:21.640205 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8ebea8-7ad2-4d62-aec2-5ae9ab22e9ca tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:21.640983 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8ebea8-7ad2-4d62-aec2-5ae9ab22e9ca tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:21.642590 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8ebea8-7ad2-4d62-aec2-5ae9ab22e9ca tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:21.659327 ncdv-master-1 devstack@keystone.service[91548]: WARNING py.warnings [None req-3d8ebea8-7ad2-4d62-aec2-5ae9ab22e9ca tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1602958084. To ensure interoperability, identifiers should be a valid uuid. Jul 23 22:02:21.659327 ncdv-master-1 devstack@keystone.service[91548]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Jul 23 22:02:21.659327 ncdv-master-1 devstack@keystone.service[91548]: Jul 23 22:02:21.660783 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:02:21.687217 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4099/8170] 10.222.0.17 () {60 vars in 1155 bytes} [Sat Jul 23 22:02:21 2022] POST /identity/v3/endpoints => generated 363 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 22:02:21.691398 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb693a44-d6c1-4b87-b0eb-f6cd0106d3ea tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:21.702257 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb693a44-d6c1-4b87-b0eb-f6cd0106d3ea tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:21.719013 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacd8f5e-f0b1-49ad-adba-b00cdbe47e59 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c3a3005a124b01ba3277f30d909662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b4ee6c1f464943800fe97e983998a5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:21.720087 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacd8f5e-f0b1-49ad-adba-b00cdbe47e59 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:21.720367 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacd8f5e-f0b1-49ad-adba-b00cdbe47e59 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:21.720638 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacd8f5e-f0b1-49ad-adba-b00cdbe47e59 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] PATH_INFO: `/v3/regions/tempest-region-1602958084` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:21.721290 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacd8f5e-f0b1-49ad-adba-b00cdbe47e59 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1602958084)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:21.722412 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacd8f5e-f0b1-49ad-adba-b00cdbe47e59 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:21.724335 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4072/8171] 10.222.0.17 () {58 vars in 1205 bytes} [Sat Jul 23 22:02:21 2022] GET /identity/v3/regions/tempest-region-1602958084 => generated 180 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 22:02:21.728790 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8ebea8-7ad2-4d62-aec2-5ae9ab22e9ca tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:21.739680 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8ebea8-7ad2-4d62-aec2-5ae9ab22e9ca tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:21.744996 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb74fa6b-403b-48e7-8a86-7208a4cba31d tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c3a3005a124b01ba3277f30d909662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b4ee6c1f464943800fe97e983998a5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:21.745668 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb74fa6b-403b-48e7-8a86-7208a4cba31d tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:21.745959 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb74fa6b-403b-48e7-8a86-7208a4cba31d tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:21.746235 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb74fa6b-403b-48e7-8a86-7208a4cba31d tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:21.746976 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb74fa6b-403b-48e7-8a86-7208a4cba31d tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:21.748571 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb74fa6b-403b-48e7-8a86-7208a4cba31d tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:21.766702 ncdv-master-1 devstack@keystone.service[91548]: WARNING py.warnings [None req-bb74fa6b-403b-48e7-8a86-7208a4cba31d tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1982532584. To ensure interoperability, identifiers should be a valid uuid. Jul 23 22:02:21.766702 ncdv-master-1 devstack@keystone.service[91548]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Jul 23 22:02:21.766702 ncdv-master-1 devstack@keystone.service[91548]: Jul 23 22:02:21.794655 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4100/8172] 10.222.0.17 () {60 vars in 1155 bytes} [Sat Jul 23 22:02:21 2022] POST /identity/v3/endpoints => generated 361 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 22:02:21.800344 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacd8f5e-f0b1-49ad-adba-b00cdbe47e59 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:21.813690 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacd8f5e-f0b1-49ad-adba-b00cdbe47e59 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:21.836454 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e282b393-e7d5-4bd8-8a4f-bc388fa10ff3 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c3a3005a124b01ba3277f30d909662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b4ee6c1f464943800fe97e983998a5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:21.837320 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e282b393-e7d5-4bd8-8a4f-bc388fa10ff3 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:21.837601 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e282b393-e7d5-4bd8-8a4f-bc388fa10ff3 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:21.837901 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e282b393-e7d5-4bd8-8a4f-bc388fa10ff3 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] PATH_INFO: `/v3/regions/tempest-region-1982532584` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:21.838584 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e282b393-e7d5-4bd8-8a4f-bc388fa10ff3 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1982532584)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:21.839673 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e282b393-e7d5-4bd8-8a4f-bc388fa10ff3 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:21.841791 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4073/8173] 10.222.0.17 () {58 vars in 1205 bytes} [Sat Jul 23 22:02:21 2022] GET /identity/v3/regions/tempest-region-1982532584 => generated 180 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 22:02:21.846916 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb74fa6b-403b-48e7-8a86-7208a4cba31d tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:21.858160 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb74fa6b-403b-48e7-8a86-7208a4cba31d tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:21.863511 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f591078f-5044-43a8-a47f-401bdb801342 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c3a3005a124b01ba3277f30d909662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b4ee6c1f464943800fe97e983998a5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:21.864169 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f591078f-5044-43a8-a47f-401bdb801342 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:21.864453 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f591078f-5044-43a8-a47f-401bdb801342 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:21.864740 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f591078f-5044-43a8-a47f-401bdb801342 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:21.865437 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f591078f-5044-43a8-a47f-401bdb801342 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:21.866487 ncdv-master-1 devstack@keystone.service[91548]: WARNING py.warnings [None req-f591078f-5044-43a8-a47f-401bdb801342 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 22:02:21.866487 ncdv-master-1 devstack@keystone.service[91548]: warnings.warn(msg) Jul 23 22:02:21.866487 ncdv-master-1 devstack@keystone.service[91548]: Jul 23 22:02:21.867374 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f591078f-5044-43a8-a47f-401bdb801342 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:21.875951 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4101/8174] 10.222.0.17 () {58 vars in 1133 bytes} [Sat Jul 23 22:02:21 2022] GET /identity/v3/endpoints => generated 4387 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 22:02:21.880113 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e282b393-e7d5-4bd8-8a4f-bc388fa10ff3 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:21.890581 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e282b393-e7d5-4bd8-8a4f-bc388fa10ff3 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:21.895708 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b0aa63-9a43-4cda-a1a1-4b4b6458f08a tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c3a3005a124b01ba3277f30d909662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b4ee6c1f464943800fe97e983998a5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:21.896490 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b0aa63-9a43-4cda-a1a1-4b4b6458f08a tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:21.896773 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b0aa63-9a43-4cda-a1a1-4b4b6458f08a tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:21.897040 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b0aa63-9a43-4cda-a1a1-4b4b6458f08a tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] PATH_INFO: `/v3/endpoints/9ec8ede571ac443cb95d468ebb0d0ad8` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:21.899816 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:02:21.903365 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b0aa63-9a43-4cda-a1a1-4b4b6458f08a tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] RBAC: Authorizing `identity:get_endpoint(endpoint_id=9ec8ede571ac443cb95d468ebb0d0ad8)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:21.905098 ncdv-master-1 devstack@keystone.service[91547]: WARNING py.warnings [None req-a8b0aa63-9a43-4cda-a1a1-4b4b6458f08a tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_endpoint": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 22:02:21.905098 ncdv-master-1 devstack@keystone.service[91547]: warnings.warn(msg) Jul 23 22:02:21.905098 ncdv-master-1 devstack@keystone.service[91547]: Jul 23 22:02:21.906122 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b0aa63-9a43-4cda-a1a1-4b4b6458f08a tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:21.908109 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4074/8175] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 22:02:21 2022] GET /identity/v3/endpoints/9ec8ede571ac443cb95d468ebb0d0ad8 => generated 361 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 22:02:21.911742 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f591078f-5044-43a8-a47f-401bdb801342 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:21.922070 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f591078f-5044-43a8-a47f-401bdb801342 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:21.927080 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940ebfa5-b1af-4f48-b919-2dc4d672a09d tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c3a3005a124b01ba3277f30d909662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b4ee6c1f464943800fe97e983998a5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:21.927939 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940ebfa5-b1af-4f48-b919-2dc4d672a09d tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:21.928220 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940ebfa5-b1af-4f48-b919-2dc4d672a09d tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:21.928494 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940ebfa5-b1af-4f48-b919-2dc4d672a09d tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] PATH_INFO: `/v3/endpoints/9ec8ede571ac443cb95d468ebb0d0ad8` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:21.929763 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940ebfa5-b1af-4f48-b919-2dc4d672a09d tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=9ec8ede571ac443cb95d468ebb0d0ad8)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:21.931386 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940ebfa5-b1af-4f48-b919-2dc4d672a09d tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:21.941181 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-940ebfa5-b1af-4f48-b919-2dc4d672a09d tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '9ec8ede571ac443cb95d468ebb0d0ad8', 'request_id': 'req-940ebfa5-b1af-4f48-b919-2dc4d672a09d'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:21.951000 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4102/8176] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:02:21 2022] DELETE /identity/v3/endpoints/9ec8ede571ac443cb95d468ebb0d0ad8 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 22:02:21.954862 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b0aa63-9a43-4cda-a1a1-4b4b6458f08a tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:21.964995 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b0aa63-9a43-4cda-a1a1-4b4b6458f08a tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:21.980921 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ff4df1-0126-4b11-888d-2fd75d61b5e3 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c3a3005a124b01ba3277f30d909662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b4ee6c1f464943800fe97e983998a5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:21.981572 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ff4df1-0126-4b11-888d-2fd75d61b5e3 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:21.981855 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ff4df1-0126-4b11-888d-2fd75d61b5e3 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:21.982167 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ff4df1-0126-4b11-888d-2fd75d61b5e3 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:21.982862 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ff4df1-0126-4b11-888d-2fd75d61b5e3 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:21.983896 ncdv-master-1 devstack@keystone.service[91547]: WARNING py.warnings [None req-80ff4df1-0126-4b11-888d-2fd75d61b5e3 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 22:02:21.983896 ncdv-master-1 devstack@keystone.service[91547]: warnings.warn(msg) Jul 23 22:02:21.983896 ncdv-master-1 devstack@keystone.service[91547]: Jul 23 22:02:21.984830 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ff4df1-0126-4b11-888d-2fd75d61b5e3 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:21.993567 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4075/8177] 10.222.0.17 () {58 vars in 1133 bytes} [Sat Jul 23 22:02:21 2022] GET /identity/v3/endpoints => generated 4039 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 22:02:21.997880 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940ebfa5-b1af-4f48-b919-2dc4d672a09d tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:22.009282 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940ebfa5-b1af-4f48-b919-2dc4d672a09d tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:22.014849 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7932921b-44d2-4f80-83ce-09c444be79dd tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c3a3005a124b01ba3277f30d909662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b4ee6c1f464943800fe97e983998a5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:22.015710 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7932921b-44d2-4f80-83ce-09c444be79dd tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:22.015993 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7932921b-44d2-4f80-83ce-09c444be79dd tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:22.016269 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7932921b-44d2-4f80-83ce-09c444be79dd tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] PATH_INFO: `/v3/endpoints/9ec8ede571ac443cb95d468ebb0d0ad8` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:22.021118 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7932921b-44d2-4f80-83ce-09c444be79dd tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 23 22:02:22.031272 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-7932921b-44d2-4f80-83ce-09c444be79dd tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] Could not find endpoint: 9ec8ede571ac443cb95d468ebb0d0ad8.: keystone.exception.EndpointNotFound: Could not find endpoint: 9ec8ede571ac443cb95d468ebb0d0ad8. Jul 23 22:02:22.031272 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 22:02:22.031272 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 236, in _get_endpoint Jul 23 22:02:22.031272 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return session.query(Endpoint).filter_by(id=endpoint_id).one() Jul 23 22:02:22.031272 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2865, in one Jul 23 22:02:22.031272 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._iter().one() Jul 23 22:02:22.031272 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1417, in one Jul 23 22:02:22.031272 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._only_one_row( Jul 23 22:02:22.031272 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Jul 23 22:02:22.031272 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exc.NoResultFound( Jul 23 22:02:22.031272 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Jul 23 22:02:22.031272 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 22:02:22.031272 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 23 22:02:22.031272 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 22:02:22.031272 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 22:02:22.031272 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 228, in get_endpoint Jul 23 22:02:22.032558 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.driver.get_endpoint(endpoint_id) Jul 23 22:02:22.032558 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 242, in get_endpoint Jul 23 22:02:22.032558 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_endpoint(session, endpoint_id).to_dict() Jul 23 22:02:22.032558 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 238, in _get_endpoint Jul 23 22:02:22.032558 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.EndpointNotFound(endpoint_id=endpoint_id) Jul 23 22:02:22.032558 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.EndpointNotFound: Could not find endpoint: 9ec8ede571ac443cb95d468ebb0d0ad8. Jul 23 22:02:22.032558 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 22:02:22.032558 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 23 22:02:22.032558 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 22:02:22.032558 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 22:02:22.032558 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 22:02:22.032558 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 22:02:22.032558 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 22:02:22.032558 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 22:02:22.032558 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 22:02:22.032558 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 22:02:22.032558 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 22:02:22.033743 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 22:02:22.033743 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 22:02:22.033743 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 22:02:22.033743 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 113, in delete Jul 23 22:02:22.033743 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_endpoint') Jul 23 22:02:22.033743 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 23 22:02:22.033743 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 23 22:02:22.033743 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 23 22:02:22.033743 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 23 22:02:22.033743 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 22:02:22.033743 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 22:02:22.033743 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 22:02:22.033743 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 22:02:22.033743 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 22:02:22.033743 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 22:02:22.033743 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 22:02:22.034853 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application with Lock( Jul 23 22:02:22.034853 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 22:02:22.034853 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._enter() Jul 23 22:02:22.034853 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 22:02:22.034853 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 22:02:22.034853 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 22:02:22.034853 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.creator() Jul 23 22:02:22.034853 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 22:02:22.034853 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application created_value = creator( Jul 23 22:02:22.034853 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 230, in get_endpoint Jul 23 22:02:22.034853 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.EndpointNotFound(endpoint_id=endpoint_id) Jul 23 22:02:22.034853 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.EndpointNotFound: Could not find endpoint: 9ec8ede571ac443cb95d468ebb0d0ad8. Jul 23 22:02:22.034853 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 22:02:22.034853 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4103/8178] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:02:21 2022] DELETE /identity/v3/endpoints/9ec8ede571ac443cb95d468ebb0d0ad8 => generated 114 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 23 22:02:22.036500 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ff4df1-0126-4b11-888d-2fd75d61b5e3 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:22.046674 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ff4df1-0126-4b11-888d-2fd75d61b5e3 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:22.051960 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868725fb-d609-40b6-8e3f-907536757618 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c3a3005a124b01ba3277f30d909662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b4ee6c1f464943800fe97e983998a5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:22.052795 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868725fb-d609-40b6-8e3f-907536757618 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:22.053079 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868725fb-d609-40b6-8e3f-907536757618 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:22.053358 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868725fb-d609-40b6-8e3f-907536757618 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] PATH_INFO: `/v3/regions/tempest-region-1982532584` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:22.054049 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868725fb-d609-40b6-8e3f-907536757618 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1982532584)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:22.055658 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868725fb-d609-40b6-8e3f-907536757618 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:22.070671 ncdv-master-1 devstack@keystone.service[91547]: WARNING py.warnings [None req-868725fb-d609-40b6-8e3f-907536757618 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1982532584. To ensure interoperability, identifiers should be a valid uuid. Jul 23 22:02:22.070671 ncdv-master-1 devstack@keystone.service[91547]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Jul 23 22:02:22.070671 ncdv-master-1 devstack@keystone.service[91547]: Jul 23 22:02:22.077535 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4076/8179] 10.222.0.17 () {58 vars in 1208 bytes} [Sat Jul 23 22:02:22 2022] DELETE /identity/v3/regions/tempest-region-1982532584 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 22:02:22.082615 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7932921b-44d2-4f80-83ce-09c444be79dd tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:22.093000 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7932921b-44d2-4f80-83ce-09c444be79dd tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:22.109106 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de642b40-06f9-4e22-ab91-f38275a669da tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c3a3005a124b01ba3277f30d909662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b4ee6c1f464943800fe97e983998a5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:22.110026 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de642b40-06f9-4e22-ab91-f38275a669da tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:22.110355 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de642b40-06f9-4e22-ab91-f38275a669da tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:22.110637 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de642b40-06f9-4e22-ab91-f38275a669da tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:22.111335 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de642b40-06f9-4e22-ab91-f38275a669da tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:22.112952 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de642b40-06f9-4e22-ab91-f38275a669da tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:22.121310 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4104/8180] 10.222.0.17 () {58 vars in 1133 bytes} [Sat Jul 23 22:02:22 2022] GET /identity/v3/endpoints => generated 4039 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 22:02:22.125572 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868725fb-d609-40b6-8e3f-907536757618 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:22.139432 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868725fb-d609-40b6-8e3f-907536757618 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:22.144648 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389ec9c1-f617-4dcd-bed3-1e969bffc6c0 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c3a3005a124b01ba3277f30d909662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b4ee6c1f464943800fe97e983998a5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:22.145309 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389ec9c1-f617-4dcd-bed3-1e969bffc6c0 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:22.145595 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389ec9c1-f617-4dcd-bed3-1e969bffc6c0 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:22.145945 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389ec9c1-f617-4dcd-bed3-1e969bffc6c0 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:22.146646 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389ec9c1-f617-4dcd-bed3-1e969bffc6c0 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] RBAC: Adding query filter params (service_id=8ce69e4187c4493c861586182b2f86c5) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 22:02:22.146951 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389ec9c1-f617-4dcd-bed3-1e969bffc6c0 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:22.148647 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389ec9c1-f617-4dcd-bed3-1e969bffc6c0 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:22.159393 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4077/8181] 10.222.0.17 () {58 vars in 1220 bytes} [Sat Jul 23 22:02:22 2022] GET /identity/v3/endpoints?service_id=8ce69e4187c4493c861586182b2f86c5 => generated 501 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 22:02:22.163956 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de642b40-06f9-4e22-ab91-f38275a669da tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:22.178657 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de642b40-06f9-4e22-ab91-f38275a669da tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:22.184597 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97855376-22fe-4f8d-b2af-189b4ea5ec37 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c3a3005a124b01ba3277f30d909662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b4ee6c1f464943800fe97e983998a5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:22.185553 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97855376-22fe-4f8d-b2af-189b4ea5ec37 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:22.186116 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97855376-22fe-4f8d-b2af-189b4ea5ec37 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:22.186552 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97855376-22fe-4f8d-b2af-189b4ea5ec37 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:22.190169 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97855376-22fe-4f8d-b2af-189b4ea5ec37 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] RBAC: Adding query filter params (service_id=01a15ac9282b42ab96a0a5c6b46e3271) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 22:02:22.190169 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97855376-22fe-4f8d-b2af-189b4ea5ec37 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:22.190169 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97855376-22fe-4f8d-b2af-189b4ea5ec37 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:22.196339 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4105/8182] 10.222.0.17 () {58 vars in 1220 bytes} [Sat Jul 23 22:02:22 2022] GET /identity/v3/endpoints?service_id=01a15ac9282b42ab96a0a5c6b46e3271 => generated 505 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 22:02:22.201153 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389ec9c1-f617-4dcd-bed3-1e969bffc6c0 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:22.218063 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389ec9c1-f617-4dcd-bed3-1e969bffc6c0 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:22.224315 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841b4456-5264-4727-8786-aab136e04943 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c3a3005a124b01ba3277f30d909662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b4ee6c1f464943800fe97e983998a5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:22.225013 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841b4456-5264-4727-8786-aab136e04943 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:22.225123 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841b4456-5264-4727-8786-aab136e04943 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:22.225300 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841b4456-5264-4727-8786-aab136e04943 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:22.226148 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841b4456-5264-4727-8786-aab136e04943 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] RBAC: Adding query filter params (interface=public) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 22:02:22.226420 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841b4456-5264-4727-8786-aab136e04943 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:22.228361 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841b4456-5264-4727-8786-aab136e04943 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:22.239490 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4078/8183] 10.222.0.17 () {58 vars in 1166 bytes} [Sat Jul 23 22:02:22 2022] GET /identity/v3/endpoints?interface=public => generated 3394 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 22:02:22.243969 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97855376-22fe-4f8d-b2af-189b4ea5ec37 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:22.254651 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97855376-22fe-4f8d-b2af-189b4ea5ec37 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:22.259615 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8108c3d3-d419-4fac-977e-ae11f428f23c tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c3a3005a124b01ba3277f30d909662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b4ee6c1f464943800fe97e983998a5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:22.260269 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8108c3d3-d419-4fac-977e-ae11f428f23c tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:22.260561 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8108c3d3-d419-4fac-977e-ae11f428f23c tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:22.260834 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8108c3d3-d419-4fac-977e-ae11f428f23c tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:22.261573 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8108c3d3-d419-4fac-977e-ae11f428f23c tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] RBAC: Adding query filter params (interface=internal) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 22:02:22.261893 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8108c3d3-d419-4fac-977e-ae11f428f23c tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:22.263522 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8108c3d3-d419-4fac-977e-ae11f428f23c tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:22.274404 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4106/8184] 10.222.0.17 () {58 vars in 1170 bytes} [Sat Jul 23 22:02:22 2022] GET /identity/v3/endpoints?interface=internal => generated 480 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 22:02:22.279007 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841b4456-5264-4727-8786-aab136e04943 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:22.289573 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841b4456-5264-4727-8786-aab136e04943 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:22.294840 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabccfdb-84e6-4a2d-a2c2-2073eb682bf3 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c3a3005a124b01ba3277f30d909662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b4ee6c1f464943800fe97e983998a5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:22.295523 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabccfdb-84e6-4a2d-a2c2-2073eb682bf3 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:22.295848 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabccfdb-84e6-4a2d-a2c2-2073eb682bf3 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:22.296095 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabccfdb-84e6-4a2d-a2c2-2073eb682bf3 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] PATH_INFO: `/v3/services` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:22.296883 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabccfdb-84e6-4a2d-a2c2-2073eb682bf3 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:22.298604 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabccfdb-84e6-4a2d-a2c2-2073eb682bf3 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:22.313838 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4079/8185] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 22:02:22 2022] POST /identity/v3/services => generated 289 bytes in 35 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 22:02:22.318082 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8108c3d3-d419-4fac-977e-ae11f428f23c tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:22.328733 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8108c3d3-d419-4fac-977e-ae11f428f23c tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:22.345727 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b00d32-d484-4c9d-97e5-cc51b8f6fae1 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c3a3005a124b01ba3277f30d909662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b4ee6c1f464943800fe97e983998a5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:22.346424 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b00d32-d484-4c9d-97e5-cc51b8f6fae1 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:22.346714 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b00d32-d484-4c9d-97e5-cc51b8f6fae1 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:22.346993 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b00d32-d484-4c9d-97e5-cc51b8f6fae1 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:22.347731 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b00d32-d484-4c9d-97e5-cc51b8f6fae1 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:22.349341 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b00d32-d484-4c9d-97e5-cc51b8f6fae1 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:22.365045 ncdv-master-1 devstack@keystone.service[91548]: WARNING py.warnings [None req-64b00d32-d484-4c9d-97e5-cc51b8f6fae1 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1056173603. To ensure interoperability, identifiers should be a valid uuid. Jul 23 22:02:22.365045 ncdv-master-1 devstack@keystone.service[91548]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Jul 23 22:02:22.365045 ncdv-master-1 devstack@keystone.service[91548]: Jul 23 22:02:22.389016 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4107/8186] 10.222.0.17 () {60 vars in 1155 bytes} [Sat Jul 23 22:02:22 2022] POST /identity/v3/endpoints => generated 361 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 22:02:22.392925 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabccfdb-84e6-4a2d-a2c2-2073eb682bf3 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:22.403645 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabccfdb-84e6-4a2d-a2c2-2073eb682bf3 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:22.418505 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9518357-fe67-411f-9af5-5b423d324ba5 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c3a3005a124b01ba3277f30d909662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b4ee6c1f464943800fe97e983998a5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:22.419441 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9518357-fe67-411f-9af5-5b423d324ba5 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:22.419725 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9518357-fe67-411f-9af5-5b423d324ba5 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:22.420008 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9518357-fe67-411f-9af5-5b423d324ba5 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] PATH_INFO: `/v3/regions/tempest-region-1056173603` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:22.420634 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9518357-fe67-411f-9af5-5b423d324ba5 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1056173603)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:22.421710 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9518357-fe67-411f-9af5-5b423d324ba5 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:22.423838 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4080/8187] 10.222.0.17 () {58 vars in 1205 bytes} [Sat Jul 23 22:02:22 2022] GET /identity/v3/regions/tempest-region-1056173603 => generated 180 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 22:02:22.427540 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b00d32-d484-4c9d-97e5-cc51b8f6fae1 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:22.439123 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b00d32-d484-4c9d-97e5-cc51b8f6fae1 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:22.444033 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd25af6-007a-4d8f-90fc-7d3f51b37c55 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c3a3005a124b01ba3277f30d909662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b4ee6c1f464943800fe97e983998a5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:22.444900 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd25af6-007a-4d8f-90fc-7d3f51b37c55 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:22.445190 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd25af6-007a-4d8f-90fc-7d3f51b37c55 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:22.445470 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd25af6-007a-4d8f-90fc-7d3f51b37c55 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] PATH_INFO: `/v3/endpoints/99b4cc0ce4754b0ca03e38e9247da2a2` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:22.450880 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd25af6-007a-4d8f-90fc-7d3f51b37c55 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=99b4cc0ce4754b0ca03e38e9247da2a2)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:22.452489 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd25af6-007a-4d8f-90fc-7d3f51b37c55 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:22.469118 ncdv-master-1 devstack@keystone.service[91548]: WARNING py.warnings [None req-9fd25af6-007a-4d8f-90fc-7d3f51b37c55 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-395198297. To ensure interoperability, identifiers should be a valid uuid. Jul 23 22:02:22.469118 ncdv-master-1 devstack@keystone.service[91548]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Jul 23 22:02:22.469118 ncdv-master-1 devstack@keystone.service[91548]: Jul 23 22:02:22.502367 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4108/8188] 10.222.0.17 () {60 vars in 1255 bytes} [Sat Jul 23 22:02:22 2022] PATCH /identity/v3/endpoints/99b4cc0ce4754b0ca03e38e9247da2a2 => generated 362 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 22:02:22.506578 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9518357-fe67-411f-9af5-5b423d324ba5 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:22.517073 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9518357-fe67-411f-9af5-5b423d324ba5 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:22.532860 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b504f7-9fc0-4a45-90f3-ec79bf9963fb tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c3a3005a124b01ba3277f30d909662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b4ee6c1f464943800fe97e983998a5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:22.533704 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b504f7-9fc0-4a45-90f3-ec79bf9963fb tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:22.534011 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b504f7-9fc0-4a45-90f3-ec79bf9963fb tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:22.534289 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b504f7-9fc0-4a45-90f3-ec79bf9963fb tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] PATH_INFO: `/v3/regions/tempest-region-395198297` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:22.534985 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b504f7-9fc0-4a45-90f3-ec79bf9963fb tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-395198297)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:22.536083 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b504f7-9fc0-4a45-90f3-ec79bf9963fb tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:22.538136 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4081/8189] 10.222.0.17 () {58 vars in 1202 bytes} [Sat Jul 23 22:02:22 2022] GET /identity/v3/regions/tempest-region-395198297 => generated 178 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 22:02:22.542282 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd25af6-007a-4d8f-90fc-7d3f51b37c55 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:22.547598 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=91,keystone:INSERT=6,keystone:DELETE=2,keystone:UPDATE=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:02:22.554655 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd25af6-007a-4d8f-90fc-7d3f51b37c55 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:22.560338 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf04112-5c64-4971-84f9-2e0118d5733e tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c3a3005a124b01ba3277f30d909662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b4ee6c1f464943800fe97e983998a5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:22.561186 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf04112-5c64-4971-84f9-2e0118d5733e tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:22.561722 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf04112-5c64-4971-84f9-2e0118d5733e tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:22.562225 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf04112-5c64-4971-84f9-2e0118d5733e tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] PATH_INFO: `/v3/endpoints/99b4cc0ce4754b0ca03e38e9247da2a2` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:22.567870 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf04112-5c64-4971-84f9-2e0118d5733e tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=99b4cc0ce4754b0ca03e38e9247da2a2)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:22.569508 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf04112-5c64-4971-84f9-2e0118d5733e tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:22.578389 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-2bf04112-5c64-4971-84f9-2e0118d5733e tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '99b4cc0ce4754b0ca03e38e9247da2a2', 'request_id': 'req-2bf04112-5c64-4971-84f9-2e0118d5733e'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:22.588723 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4109/8190] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:02:22 2022] DELETE /identity/v3/endpoints/99b4cc0ce4754b0ca03e38e9247da2a2 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:02:22.593178 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b504f7-9fc0-4a45-90f3-ec79bf9963fb tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:22.603813 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b504f7-9fc0-4a45-90f3-ec79bf9963fb tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:22.620771 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5796899a-7731-4a73-9201-5cdbe1b79e47 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c3a3005a124b01ba3277f30d909662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b4ee6c1f464943800fe97e983998a5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:22.621640 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5796899a-7731-4a73-9201-5cdbe1b79e47 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:22.621967 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5796899a-7731-4a73-9201-5cdbe1b79e47 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:22.622250 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5796899a-7731-4a73-9201-5cdbe1b79e47 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] PATH_INFO: `/v3/regions/tempest-region-395198297` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:22.622907 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5796899a-7731-4a73-9201-5cdbe1b79e47 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-395198297)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:22.624558 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5796899a-7731-4a73-9201-5cdbe1b79e47 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:22.640375 ncdv-master-1 devstack@keystone.service[91547]: WARNING py.warnings [None req-5796899a-7731-4a73-9201-5cdbe1b79e47 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-395198297. To ensure interoperability, identifiers should be a valid uuid. Jul 23 22:02:22.640375 ncdv-master-1 devstack@keystone.service[91547]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Jul 23 22:02:22.640375 ncdv-master-1 devstack@keystone.service[91547]: Jul 23 22:02:22.648049 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4082/8191] 10.222.0.17 () {58 vars in 1205 bytes} [Sat Jul 23 22:02:22 2022] DELETE /identity/v3/regions/tempest-region-395198297 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:02:22.652264 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf04112-5c64-4971-84f9-2e0118d5733e tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:22.663170 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf04112-5c64-4971-84f9-2e0118d5733e tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:22.678294 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdac9a60-2000-4ffc-9445-54f1c97fbc6c tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c3a3005a124b01ba3277f30d909662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b4ee6c1f464943800fe97e983998a5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:22.679137 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdac9a60-2000-4ffc-9445-54f1c97fbc6c tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:22.679415 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdac9a60-2000-4ffc-9445-54f1c97fbc6c tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:22.679701 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdac9a60-2000-4ffc-9445-54f1c97fbc6c tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] PATH_INFO: `/v3/regions/tempest-region-1056173603` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:22.680349 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdac9a60-2000-4ffc-9445-54f1c97fbc6c tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1056173603)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:22.681994 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdac9a60-2000-4ffc-9445-54f1c97fbc6c tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:22.702985 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4110/8192] 10.222.0.17 () {58 vars in 1208 bytes} [Sat Jul 23 22:02:22 2022] DELETE /identity/v3/regions/tempest-region-1056173603 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:02:22.707241 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5796899a-7731-4a73-9201-5cdbe1b79e47 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:22.718551 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5796899a-7731-4a73-9201-5cdbe1b79e47 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:22.733955 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7550957e-d4b5-487a-8eda-0d6e376991d8 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c3a3005a124b01ba3277f30d909662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b4ee6c1f464943800fe97e983998a5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:22.734829 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7550957e-d4b5-487a-8eda-0d6e376991d8 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:22.735138 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7550957e-d4b5-487a-8eda-0d6e376991d8 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:22.735502 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7550957e-d4b5-487a-8eda-0d6e376991d8 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] PATH_INFO: `/v3/services/4c6c1b937a2c44049824651a5354e81d` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:22.736154 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7550957e-d4b5-487a-8eda-0d6e376991d8 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] RBAC: Authorizing `identity:delete_service(service_id=4c6c1b937a2c44049824651a5354e81d)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:22.737772 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7550957e-d4b5-487a-8eda-0d6e376991d8 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:22.760296 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4083/8193] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 22:02:22 2022] DELETE /identity/v3/services/4c6c1b937a2c44049824651a5354e81d => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:02:22.765773 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdac9a60-2000-4ffc-9445-54f1c97fbc6c tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:22.777083 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdac9a60-2000-4ffc-9445-54f1c97fbc6c tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:22.794159 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5ccd93-dcb5-4de0-8329-c59022a4f655 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c3a3005a124b01ba3277f30d909662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b4ee6c1f464943800fe97e983998a5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:22.795178 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5ccd93-dcb5-4de0-8329-c59022a4f655 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:22.795464 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5ccd93-dcb5-4de0-8329-c59022a4f655 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:22.795736 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5ccd93-dcb5-4de0-8329-c59022a4f655 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] PATH_INFO: `/v3/endpoints/7cad8f5993aa493db8adf650700f4d84` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:22.801010 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5ccd93-dcb5-4de0-8329-c59022a4f655 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=7cad8f5993aa493db8adf650700f4d84)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:22.802644 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5ccd93-dcb5-4de0-8329-c59022a4f655 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:22.812450 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-2c5ccd93-dcb5-4de0-8329-c59022a4f655 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '7cad8f5993aa493db8adf650700f4d84', 'request_id': 'req-2c5ccd93-dcb5-4de0-8329-c59022a4f655'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:22.830213 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4111/8194] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:02:22 2022] DELETE /identity/v3/endpoints/7cad8f5993aa493db8adf650700f4d84 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 22:02:22.834401 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7550957e-d4b5-487a-8eda-0d6e376991d8 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:22.846085 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7550957e-d4b5-487a-8eda-0d6e376991d8 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:22.861790 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0e1b3e-d5a5-4fd8-8d6a-9705792ef5d6 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c3a3005a124b01ba3277f30d909662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b4ee6c1f464943800fe97e983998a5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:22.862671 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0e1b3e-d5a5-4fd8-8d6a-9705792ef5d6 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:22.862953 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0e1b3e-d5a5-4fd8-8d6a-9705792ef5d6 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:22.863230 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0e1b3e-d5a5-4fd8-8d6a-9705792ef5d6 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] PATH_INFO: `/v3/regions/tempest-region-1602958084` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:22.863883 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0e1b3e-d5a5-4fd8-8d6a-9705792ef5d6 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1602958084)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:22.865506 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0e1b3e-d5a5-4fd8-8d6a-9705792ef5d6 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:22.879458 ncdv-master-1 devstack@keystone.service[91547]: WARNING py.warnings [None req-0b0e1b3e-d5a5-4fd8-8d6a-9705792ef5d6 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1602958084. To ensure interoperability, identifiers should be a valid uuid. Jul 23 22:02:22.879458 ncdv-master-1 devstack@keystone.service[91547]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Jul 23 22:02:22.879458 ncdv-master-1 devstack@keystone.service[91547]: Jul 23 22:02:22.887804 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4084/8195] 10.222.0.17 () {58 vars in 1208 bytes} [Sat Jul 23 22:02:22 2022] DELETE /identity/v3/regions/tempest-region-1602958084 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:02:22.893088 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5ccd93-dcb5-4de0-8329-c59022a4f655 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:22.904718 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5ccd93-dcb5-4de0-8329-c59022a4f655 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:22.921606 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eecbed9-3f88-448e-9306-5c6a31f9f50c tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c3a3005a124b01ba3277f30d909662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b4ee6c1f464943800fe97e983998a5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:22.922427 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eecbed9-3f88-448e-9306-5c6a31f9f50c tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:22.922728 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eecbed9-3f88-448e-9306-5c6a31f9f50c tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:22.923030 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eecbed9-3f88-448e-9306-5c6a31f9f50c tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] PATH_INFO: `/v3/services/01a15ac9282b42ab96a0a5c6b46e3271` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:22.923684 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eecbed9-3f88-448e-9306-5c6a31f9f50c tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] RBAC: Authorizing `identity:delete_service(service_id=01a15ac9282b42ab96a0a5c6b46e3271)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:22.925811 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eecbed9-3f88-448e-9306-5c6a31f9f50c tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:22.950443 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4112/8196] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 22:02:22 2022] DELETE /identity/v3/services/01a15ac9282b42ab96a0a5c6b46e3271 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:02:22.954656 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0e1b3e-d5a5-4fd8-8d6a-9705792ef5d6 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:22.965648 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0e1b3e-d5a5-4fd8-8d6a-9705792ef5d6 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:22.981915 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5756b3-a9c0-4c4b-8e4b-f5cf41ce29d8 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c3a3005a124b01ba3277f30d909662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b4ee6c1f464943800fe97e983998a5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:22.982809 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5756b3-a9c0-4c4b-8e4b-f5cf41ce29d8 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:22.983097 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5756b3-a9c0-4c4b-8e4b-f5cf41ce29d8 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:22.983375 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5756b3-a9c0-4c4b-8e4b-f5cf41ce29d8 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] PATH_INFO: `/v3/endpoints/c222dbbb525f459485fb00e56cd3d201` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:22.989293 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5756b3-a9c0-4c4b-8e4b-f5cf41ce29d8 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=c222dbbb525f459485fb00e56cd3d201)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:22.991008 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5756b3-a9c0-4c4b-8e4b-f5cf41ce29d8 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:23.001118 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-dc5756b3-a9c0-4c4b-8e4b-f5cf41ce29d8 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': 'c222dbbb525f459485fb00e56cd3d201', 'request_id': 'req-dc5756b3-a9c0-4c4b-8e4b-f5cf41ce29d8'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:23.003255 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:02:23.012635 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4085/8197] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:02:22 2022] DELETE /identity/v3/endpoints/c222dbbb525f459485fb00e56cd3d201 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 22:02:23.016594 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eecbed9-3f88-448e-9306-5c6a31f9f50c tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:23.028189 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eecbed9-3f88-448e-9306-5c6a31f9f50c tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:23.044035 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc82a67-8c39-432b-9c4c-5c14b3438174 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c3a3005a124b01ba3277f30d909662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b4ee6c1f464943800fe97e983998a5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:23.044904 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc82a67-8c39-432b-9c4c-5c14b3438174 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:23.045205 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc82a67-8c39-432b-9c4c-5c14b3438174 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:23.045470 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc82a67-8c39-432b-9c4c-5c14b3438174 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] PATH_INFO: `/v3/regions/tempest-region-845949350` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:23.046147 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc82a67-8c39-432b-9c4c-5c14b3438174 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-845949350)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:23.047787 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc82a67-8c39-432b-9c4c-5c14b3438174 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:23.061091 ncdv-master-1 devstack@keystone.service[91548]: WARNING py.warnings [None req-dfc82a67-8c39-432b-9c4c-5c14b3438174 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-845949350. To ensure interoperability, identifiers should be a valid uuid. Jul 23 22:02:23.061091 ncdv-master-1 devstack@keystone.service[91548]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Jul 23 22:02:23.061091 ncdv-master-1 devstack@keystone.service[91548]: Jul 23 22:02:23.068571 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4113/8198] 10.222.0.17 () {58 vars in 1205 bytes} [Sat Jul 23 22:02:23 2022] DELETE /identity/v3/regions/tempest-region-845949350 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:02:23.073328 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5756b3-a9c0-4c4b-8e4b-f5cf41ce29d8 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:23.084668 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5756b3-a9c0-4c4b-8e4b-f5cf41ce29d8 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:23.100386 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f8e28d-578c-49bc-baec-18cd7ee5400d tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c3a3005a124b01ba3277f30d909662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07b4ee6c1f464943800fe97e983998a5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:23.101266 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f8e28d-578c-49bc-baec-18cd7ee5400d tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:23.101532 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f8e28d-578c-49bc-baec-18cd7ee5400d tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:23.101803 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f8e28d-578c-49bc-baec-18cd7ee5400d tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] PATH_INFO: `/v3/services/8ce69e4187c4493c861586182b2f86c5` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:23.102480 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f8e28d-578c-49bc-baec-18cd7ee5400d tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] RBAC: Authorizing `identity:delete_service(service_id=8ce69e4187c4493c861586182b2f86c5)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:23.104082 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f8e28d-578c-49bc-baec-18cd7ee5400d tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:23.125881 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4086/8199] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 22:02:23 2022] DELETE /identity/v3/services/8ce69e4187c4493c861586182b2f86c5 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 22:02:23.130036 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc82a67-8c39-432b-9c4c-5c14b3438174 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:23.201748 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc82a67-8c39-432b-9c4c-5c14b3438174 tempest-EndPointsTestJSON-1276632683 tempest-EndPointsTestJSON-1276632683-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:23.208092 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:02:23.217811 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b24a2df-f196-4475-8c18-9d581305ed25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:23.218733 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b24a2df-f196-4475-8c18-9d581305ed25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:23.219015 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b24a2df-f196-4475-8c18-9d581305ed25 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:23.219291 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b24a2df-f196-4475-8c18-9d581305ed25 admin admin] PATH_INFO: `/v3/users/6882b832ed994a1ba087e5dafd1e0c37` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:23.220621 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b24a2df-f196-4475-8c18-9d581305ed25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6882b832ed994a1ba087e5dafd1e0c37)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:23.222909 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b24a2df-f196-4475-8c18-9d581305ed25 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:23.270087 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-9b24a2df-f196-4475-8c18-9d581305ed25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6882b832ed994a1ba087e5dafd1e0c37'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:23.270735 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-9b24a2df-f196-4475-8c18-9d581305ed25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6882b832ed994a1ba087e5dafd1e0c37'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:23.277508 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-9b24a2df-f196-4475-8c18-9d581305ed25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6882b832ed994a1ba087e5dafd1e0c37'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:23.286684 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-9b24a2df-f196-4475-8c18-9d581305ed25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6882b832ed994a1ba087e5dafd1e0c37'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:23.298420 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-9b24a2df-f196-4475-8c18-9d581305ed25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6882b832ed994a1ba087e5dafd1e0c37'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:23.305251 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4114/8200] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 22:02:23 2022] DELETE /identity/v3/users/6882b832ed994a1ba087e5dafd1e0c37 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:02:23.310092 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb59cff-1e83-46f4-856f-d2cb4b0764b6 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:23.310380 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb59cff-1e83-46f4-856f-d2cb4b0764b6 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:23.310655 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb59cff-1e83-46f4-856f-d2cb4b0764b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:23.329335 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-aeb59cff-1e83-46f4-856f-d2cb4b0764b6 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:02:23.330636 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-aeb59cff-1e83-46f4-856f-d2cb4b0764b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:02:23.393350 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4087/8201] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:02:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:02:23.403587 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b24a2df-f196-4475-8c18-9d581305ed25 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:23.405103 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-9b24a2df-f196-4475-8c18-9d581305ed25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:02:23.479058 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b24a2df-f196-4475-8c18-9d581305ed25 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:23.483317 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1d81a3-aea9-4aec-a984-659122e79515 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:23.484009 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1d81a3-aea9-4aec-a984-659122e79515 service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:23.484273 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1d81a3-aea9-4aec-a984-659122e79515 service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:23.484550 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1d81a3-aea9-4aec-a984-659122e79515 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:23.497045 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1d81a3-aea9-4aec-a984-659122e79515 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:23.498531 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1d81a3-aea9-4aec-a984-659122e79515 service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:23.509067 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4115/8202] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:02:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:02:24.168050 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb59cff-1e83-46f4-856f-d2cb4b0764b6 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:24.169596 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-aeb59cff-1e83-46f4-856f-d2cb4b0764b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:02:24.184760 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb59cff-1e83-46f4-856f-d2cb4b0764b6 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:24.190153 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5980e9ec-4913-44f0-b202-8bae3c85961e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:24.191287 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5980e9ec-4913-44f0-b202-8bae3c85961e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:24.191436 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5980e9ec-4913-44f0-b202-8bae3c85961e admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:24.191733 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5980e9ec-4913-44f0-b202-8bae3c85961e admin admin] PATH_INFO: `/v3/projects/ea4cca4e43aa4b28ab8fc8a5943b24f5` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:24.193010 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5980e9ec-4913-44f0-b202-8bae3c85961e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea4cca4e43aa4b28ab8fc8a5943b24f5)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:24.194920 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5980e9ec-4913-44f0-b202-8bae3c85961e admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:24.246826 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-5980e9ec-4913-44f0-b202-8bae3c85961e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea4cca4e43aa4b28ab8fc8a5943b24f5', 'request_id': 'req-5980e9ec-4913-44f0-b202-8bae3c85961e'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:24.255201 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-5980e9ec-4913-44f0-b202-8bae3c85961e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea4cca4e43aa4b28ab8fc8a5943b24f5', 'request_id': 'req-5980e9ec-4913-44f0-b202-8bae3c85961e'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:24.260916 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-5980e9ec-4913-44f0-b202-8bae3c85961e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea4cca4e43aa4b28ab8fc8a5943b24f5', 'request_id': 'req-5980e9ec-4913-44f0-b202-8bae3c85961e'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:24.271977 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-5980e9ec-4913-44f0-b202-8bae3c85961e admin admin] The token cache is being invalidate because project ea4cca4e43aa4b28ab8fc8a5943b24f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 22:02:24.272265 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-5980e9ec-4913-44f0-b202-8bae3c85961e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:24.272903 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-5980e9ec-4913-44f0-b202-8bae3c85961e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:24.274631 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4088/8203] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 22:02:24 2022] DELETE /identity/v3/projects/ea4cca4e43aa4b28ab8fc8a5943b24f5 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:02:24.278826 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1d81a3-aea9-4aec-a984-659122e79515 service neutron] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:24.289219 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1d81a3-aea9-4aec-a984-659122e79515 service neutron] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:24.352324 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dec6a7-66cb-47cf-b8e1-6b0594645ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:24.353131 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dec6a7-66cb-47cf-b8e1-6b0594645ba1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:24.353410 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dec6a7-66cb-47cf-b8e1-6b0594645ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:24.353689 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dec6a7-66cb-47cf-b8e1-6b0594645ba1 admin admin] PATH_INFO: `/v3/users/f6c3a3005a124b01ba3277f30d909662` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:24.354945 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dec6a7-66cb-47cf-b8e1-6b0594645ba1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6c3a3005a124b01ba3277f30d909662)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:24.356869 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dec6a7-66cb-47cf-b8e1-6b0594645ba1 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:24.362347 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:02:24.404904 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-16dec6a7-66cb-47cf-b8e1-6b0594645ba1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6c3a3005a124b01ba3277f30d909662'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:24.405540 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-16dec6a7-66cb-47cf-b8e1-6b0594645ba1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6c3a3005a124b01ba3277f30d909662'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:24.412304 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-16dec6a7-66cb-47cf-b8e1-6b0594645ba1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6c3a3005a124b01ba3277f30d909662'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:24.419573 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-16dec6a7-66cb-47cf-b8e1-6b0594645ba1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6c3a3005a124b01ba3277f30d909662'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:24.431748 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-16dec6a7-66cb-47cf-b8e1-6b0594645ba1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6c3a3005a124b01ba3277f30d909662'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:24.437934 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4116/8204] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 22:02:24 2022] DELETE /identity/v3/users/f6c3a3005a124b01ba3277f30d909662 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:02:24.721262 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5980e9ec-4913-44f0-b202-8bae3c85961e admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:24.722772 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-5980e9ec-4913-44f0-b202-8bae3c85961e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:02:24.738003 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5980e9ec-4913-44f0-b202-8bae3c85961e admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:24.784901 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:02:24.799183 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb4f1c5-422f-4511-a864-32dcd58ec6b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:24.800081 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb4f1c5-422f-4511-a864-32dcd58ec6b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:24.800358 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb4f1c5-422f-4511-a864-32dcd58ec6b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:24.800631 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb4f1c5-422f-4511-a864-32dcd58ec6b8 admin admin] PATH_INFO: `/v3/projects/07b4ee6c1f464943800fe97e983998a5` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:24.801808 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb4f1c5-422f-4511-a864-32dcd58ec6b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07b4ee6c1f464943800fe97e983998a5)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:24.803768 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb4f1c5-422f-4511-a864-32dcd58ec6b8 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:24.854872 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-cbb4f1c5-422f-4511-a864-32dcd58ec6b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07b4ee6c1f464943800fe97e983998a5', 'request_id': 'req-cbb4f1c5-422f-4511-a864-32dcd58ec6b8'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:24.862194 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-cbb4f1c5-422f-4511-a864-32dcd58ec6b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07b4ee6c1f464943800fe97e983998a5', 'request_id': 'req-cbb4f1c5-422f-4511-a864-32dcd58ec6b8'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:24.867871 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-cbb4f1c5-422f-4511-a864-32dcd58ec6b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07b4ee6c1f464943800fe97e983998a5', 'request_id': 'req-cbb4f1c5-422f-4511-a864-32dcd58ec6b8'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:24.878896 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-cbb4f1c5-422f-4511-a864-32dcd58ec6b8 admin admin] The token cache is being invalidate because project 07b4ee6c1f464943800fe97e983998a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 22:02:24.879178 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-cbb4f1c5-422f-4511-a864-32dcd58ec6b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:24.879814 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-cbb4f1c5-422f-4511-a864-32dcd58ec6b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:24.881385 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4089/8205] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 22:02:24 2022] DELETE /identity/v3/projects/07b4ee6c1f464943800fe97e983998a5 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:02:24.886611 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a396f5-c91a-4957-a235-bc347e64687d None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:24.887082 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a396f5-c91a-4957-a235-bc347e64687d None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:24.887198 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a396f5-c91a-4957-a235-bc347e64687d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:24.906223 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-12a396f5-c91a-4957-a235-bc347e64687d None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:02:24.907379 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-12a396f5-c91a-4957-a235-bc347e64687d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:02:24.971719 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4117/8206] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:02:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:02:24.980043 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00c57e3-95be-403c-905f-adca96058f07 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:24.980324 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00c57e3-95be-403c-905f-adca96058f07 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:24.980590 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00c57e3-95be-403c-905f-adca96058f07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:24.999901 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-c00c57e3-95be-403c-905f-adca96058f07 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:02:25.001113 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-c00c57e3-95be-403c-905f-adca96058f07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:02:25.009469 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4090/8207] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:02:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:02:25.014693 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a396f5-c91a-4957-a235-bc347e64687d None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:25.025782 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a396f5-c91a-4957-a235-bc347e64687d None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:25.031653 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f68203-9460-4d41-b692-403d1ca681b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:25.032356 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f68203-9460-4d41-b692-403d1ca681b9 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:25.032632 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f68203-9460-4d41-b692-403d1ca681b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:25.032903 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f68203-9460-4d41-b692-403d1ca681b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:25.033621 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f68203-9460-4d41-b692-403d1ca681b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 22:02:25.033963 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f68203-9460-4d41-b692-403d1ca681b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:25.035566 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f68203-9460-4d41-b692-403d1ca681b9 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:25.048327 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4118/8208] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 22:02:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 22:02:25.052939 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00c57e3-95be-403c-905f-adca96058f07 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:25.062939 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00c57e3-95be-403c-905f-adca96058f07 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:25.068897 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c28072-b2dd-41cc-afe0-515c1f0d73be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:25.069550 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c28072-b2dd-41cc-afe0-515c1f0d73be admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:25.069821 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c28072-b2dd-41cc-afe0-515c1f0d73be admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:25.070133 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c28072-b2dd-41cc-afe0-515c1f0d73be admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:25.070821 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c28072-b2dd-41cc-afe0-515c1f0d73be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:25.072729 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c28072-b2dd-41cc-afe0-515c1f0d73be admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:25.102609 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4091/8209] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 22:02:25 2022] POST /identity/v3/projects => generated 369 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 22:02:25.108181 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f68203-9460-4d41-b692-403d1ca681b9 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:25.118835 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f68203-9460-4d41-b692-403d1ca681b9 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:25.178739 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c853f01-165d-4336-9cea-a68717f14aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:25.179340 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c853f01-165d-4336-9cea-a68717f14aad admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:25.179619 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c853f01-165d-4336-9cea-a68717f14aad admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:25.179873 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c853f01-165d-4336-9cea-a68717f14aad admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:25.180561 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c853f01-165d-4336-9cea-a68717f14aad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:25.182519 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c853f01-165d-4336-9cea-a68717f14aad admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:25.205479 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4119/8210] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 22:02:25 2022] POST /identity/v3/users => generated 285 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 22:02:25.209744 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c28072-b2dd-41cc-afe0-515c1f0d73be admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:25.220764 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c28072-b2dd-41cc-afe0-515c1f0d73be admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:25.225733 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b499b0-c375-44b0-9308-34c95e5e1448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:25.226466 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b499b0-c375-44b0-9308-34c95e5e1448 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:25.226745 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b499b0-c375-44b0-9308-34c95e5e1448 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:25.227017 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b499b0-c375-44b0-9308-34c95e5e1448 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:25.227750 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b499b0-c375-44b0-9308-34c95e5e1448 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:25.229367 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b499b0-c375-44b0-9308-34c95e5e1448 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:25.240321 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4092/8211] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 22:02:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 22:02:25.244355 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c853f01-165d-4336-9cea-a68717f14aad admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:25.249578 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:02:25.256381 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c853f01-165d-4336-9cea-a68717f14aad admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:25.262167 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0b1af9-3eae-42f2-8859-4885f3207457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:25.262834 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0b1af9-3eae-42f2-8859-4885f3207457 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:25.263121 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0b1af9-3eae-42f2-8859-4885f3207457 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:25.263375 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0b1af9-3eae-42f2-8859-4885f3207457 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:25.264098 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0b1af9-3eae-42f2-8859-4885f3207457 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:25.265699 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0b1af9-3eae-42f2-8859-4885f3207457 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:25.276280 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4120/8212] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 22:02:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 22:02:25.280194 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b499b0-c375-44b0-9308-34c95e5e1448 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:25.290783 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b499b0-c375-44b0-9308-34c95e5e1448 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:25.295920 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7462cdf8-9121-4d48-96c4-0187cc68b137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:25.296800 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7462cdf8-9121-4d48-96c4-0187cc68b137 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:25.297074 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7462cdf8-9121-4d48-96c4-0187cc68b137 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:25.297356 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7462cdf8-9121-4d48-96c4-0187cc68b137 admin admin] PATH_INFO: `/v3/projects/7ed1f925186641378f83a374b59635b0/users/85cfd2642712430583d4a3874d7aa37f/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:25.312491 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7462cdf8-9121-4d48-96c4-0187cc68b137 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ed1f925186641378f83a374b59635b0, user_id=85cfd2642712430583d4a3874d7aa37f, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:25.315241 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7462cdf8-9121-4d48-96c4-0187cc68b137 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:25.330490 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4093/8213] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 22:02:25 2022] PUT /identity/v3/projects/7ed1f925186641378f83a374b59635b0/users/85cfd2642712430583d4a3874d7aa37f/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:02:25.342886 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612c710d-9c80-460c-b348-2b517c68cfa3 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:25.343183 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612c710d-9c80-460c-b348-2b517c68cfa3 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:25.343453 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612c710d-9c80-460c-b348-2b517c68cfa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:25.370938 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-612c710d-9c80-460c-b348-2b517c68cfa3 None None] MFA Rules not processed for user `85cfd2642712430583d4a3874d7aa37f`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:02:25.372139 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-612c710d-9c80-460c-b348-2b517c68cfa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:02:25.441856 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4121/8214] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:02:25 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:02:25.446569 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7462cdf8-9121-4d48-96c4-0187cc68b137 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:25.514022 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7462cdf8-9121-4d48-96c4-0187cc68b137 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:25.520061 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33896e9f-41f2-4f1f-931d-ffc21573b23a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:25.520738 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33896e9f-41f2-4f1f-931d-ffc21573b23a admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:25.521019 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33896e9f-41f2-4f1f-931d-ffc21573b23a admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:25.521293 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33896e9f-41f2-4f1f-931d-ffc21573b23a admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:25.522027 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33896e9f-41f2-4f1f-931d-ffc21573b23a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:25.523965 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33896e9f-41f2-4f1f-931d-ffc21573b23a admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:25.546958 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:02:25.559053 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4094/8215] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 22:02:25 2022] POST /identity/v3/projects => generated 369 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 22:02:25.560050 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612c710d-9c80-460c-b348-2b517c68cfa3 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:25.571861 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612c710d-9c80-460c-b348-2b517c68cfa3 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:25.640715 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a147a8c1-8ebf-4f3a-9b5b-a1a5df351756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:25.641379 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a147a8c1-8ebf-4f3a-9b5b-a1a5df351756 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:25.641780 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a147a8c1-8ebf-4f3a-9b5b-a1a5df351756 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:25.642094 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a147a8c1-8ebf-4f3a-9b5b-a1a5df351756 admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:25.642790 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a147a8c1-8ebf-4f3a-9b5b-a1a5df351756 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:25.644732 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a147a8c1-8ebf-4f3a-9b5b-a1a5df351756 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:25.666322 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4122/8216] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 22:02:25 2022] POST /identity/v3/users => generated 291 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 22:02:25.670304 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33896e9f-41f2-4f1f-931d-ffc21573b23a admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:25.681227 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33896e9f-41f2-4f1f-931d-ffc21573b23a admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:25.687013 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521a6d1b-6824-4946-b835-6dafa88e57be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:25.687702 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521a6d1b-6824-4946-b835-6dafa88e57be admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:25.687978 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521a6d1b-6824-4946-b835-6dafa88e57be admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:25.688244 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521a6d1b-6824-4946-b835-6dafa88e57be admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:25.688966 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521a6d1b-6824-4946-b835-6dafa88e57be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:25.690710 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521a6d1b-6824-4946-b835-6dafa88e57be admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:25.702403 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4095/8217] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 22:02:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 22:02:25.706300 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a147a8c1-8ebf-4f3a-9b5b-a1a5df351756 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:25.717360 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a147a8c1-8ebf-4f3a-9b5b-a1a5df351756 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:25.722658 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcb76bf-d5db-4a79-8acf-2d70c0a5625a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:25.723570 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcb76bf-d5db-4a79-8acf-2d70c0a5625a admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:25.723843 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcb76bf-d5db-4a79-8acf-2d70c0a5625a admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:25.724110 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcb76bf-d5db-4a79-8acf-2d70c0a5625a admin admin] PATH_INFO: `/v3/projects/f1cc6417415a4137bee3c0db24cac709/users/a50ec5144cc2428cae64fe5bcf63247a/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:25.739553 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcb76bf-d5db-4a79-8acf-2d70c0a5625a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1cc6417415a4137bee3c0db24cac709, user_id=a50ec5144cc2428cae64fe5bcf63247a, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:25.742264 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcb76bf-d5db-4a79-8acf-2d70c0a5625a admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:25.761009 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4123/8218] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 22:02:25 2022] PUT /identity/v3/projects/f1cc6417415a4137bee3c0db24cac709/users/a50ec5144cc2428cae64fe5bcf63247a/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:02:25.766833 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521a6d1b-6824-4946-b835-6dafa88e57be admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:25.778125 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521a6d1b-6824-4946-b835-6dafa88e57be admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:25.843973 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36122bcf-f830-4d7d-a8fd-c769c69b6913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:25.844655 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36122bcf-f830-4d7d-a8fd-c769c69b6913 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:25.844936 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36122bcf-f830-4d7d-a8fd-c769c69b6913 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:25.845194 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36122bcf-f830-4d7d-a8fd-c769c69b6913 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:25.846035 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36122bcf-f830-4d7d-a8fd-c769c69b6913 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:25.847641 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36122bcf-f830-4d7d-a8fd-c769c69b6913 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:25.860034 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4096/8219] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 22:02:25 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 22:02:25.865637 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcb76bf-d5db-4a79-8acf-2d70c0a5625a admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:25.876646 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcb76bf-d5db-4a79-8acf-2d70c0a5625a admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:25.881822 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0be8cb-81e3-4407-9f9a-637691db99ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:25.882750 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0be8cb-81e3-4407-9f9a-637691db99ce admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:25.883029 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0be8cb-81e3-4407-9f9a-637691db99ce admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:25.883306 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0be8cb-81e3-4407-9f9a-637691db99ce admin admin] PATH_INFO: `/v3/projects/f1cc6417415a4137bee3c0db24cac709/users/a50ec5144cc2428cae64fe5bcf63247a/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:25.885341 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0be8cb-81e3-4407-9f9a-637691db99ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1cc6417415a4137bee3c0db24cac709, user_id=a50ec5144cc2428cae64fe5bcf63247a, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:25.888053 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0be8cb-81e3-4407-9f9a-637691db99ce admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:25.900916 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4124/8220] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 22:02:25 2022] PUT /identity/v3/projects/f1cc6417415a4137bee3c0db24cac709/users/a50ec5144cc2428cae64fe5bcf63247a/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:02:25.916559 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994f8bbe-1362-4324-bdf0-f05a98224977 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:25.916879 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994f8bbe-1362-4324-bdf0-f05a98224977 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:25.917157 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994f8bbe-1362-4324-bdf0-f05a98224977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:25.944071 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-994f8bbe-1362-4324-bdf0-f05a98224977 None None] MFA Rules not processed for user `a50ec5144cc2428cae64fe5bcf63247a`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:02:25.945270 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-994f8bbe-1362-4324-bdf0-f05a98224977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:02:26.016429 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4097/8221] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:02:25 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:02:26.021629 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0be8cb-81e3-4407-9f9a-637691db99ce admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:26.032654 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0be8cb-81e3-4407-9f9a-637691db99ce admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:26.037679 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8040bddf-b70b-413f-9f03-318aef584edf tempest-ServicesTestJSON-1004563024 tempest-ServicesTestJSON-1004563024-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a50ec5144cc2428cae64fe5bcf63247a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1cc6417415a4137bee3c0db24cac709', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:26.038354 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8040bddf-b70b-413f-9f03-318aef584edf tempest-ServicesTestJSON-1004563024 tempest-ServicesTestJSON-1004563024-project-admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:26.038641 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8040bddf-b70b-413f-9f03-318aef584edf tempest-ServicesTestJSON-1004563024 tempest-ServicesTestJSON-1004563024-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:26.038938 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8040bddf-b70b-413f-9f03-318aef584edf tempest-ServicesTestJSON-1004563024 tempest-ServicesTestJSON-1004563024-project-admin] PATH_INFO: `/v3/services` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:26.039706 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8040bddf-b70b-413f-9f03-318aef584edf tempest-ServicesTestJSON-1004563024 tempest-ServicesTestJSON-1004563024-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:26.041342 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8040bddf-b70b-413f-9f03-318aef584edf tempest-ServicesTestJSON-1004563024 tempest-ServicesTestJSON-1004563024-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:26.056132 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4125/8222] 10.222.0.17 () {60 vars in 1151 bytes} [Sat Jul 23 22:02:26 2022] POST /identity/v3/services => generated 240 bytes in 35 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 22:02:26.060280 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994f8bbe-1362-4324-bdf0-f05a98224977 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:26.070159 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994f8bbe-1362-4324-bdf0-f05a98224977 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:26.085131 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5f4de4-4934-418a-858f-a486652a4d90 tempest-ServicesTestJSON-1004563024 tempest-ServicesTestJSON-1004563024-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a50ec5144cc2428cae64fe5bcf63247a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1cc6417415a4137bee3c0db24cac709', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:26.086031 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5f4de4-4934-418a-858f-a486652a4d90 tempest-ServicesTestJSON-1004563024 tempest-ServicesTestJSON-1004563024-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:26.086314 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5f4de4-4934-418a-858f-a486652a4d90 tempest-ServicesTestJSON-1004563024 tempest-ServicesTestJSON-1004563024-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:26.086590 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5f4de4-4934-418a-858f-a486652a4d90 tempest-ServicesTestJSON-1004563024 tempest-ServicesTestJSON-1004563024-project-admin] PATH_INFO: `/v3/services/11064ebf5d0c472ca1cd4810e0b53636` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:26.087241 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5f4de4-4934-418a-858f-a486652a4d90 tempest-ServicesTestJSON-1004563024 tempest-ServicesTestJSON-1004563024-project-admin] RBAC: Authorizing `identity:delete_service(service_id=11064ebf5d0c472ca1cd4810e0b53636)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:26.088851 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5f4de4-4934-418a-858f-a486652a4d90 tempest-ServicesTestJSON-1004563024 tempest-ServicesTestJSON-1004563024-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:26.111699 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4098/8223] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 22:02:26 2022] DELETE /identity/v3/services/11064ebf5d0c472ca1cd4810e0b53636 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:02:26.116610 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8040bddf-b70b-413f-9f03-318aef584edf tempest-ServicesTestJSON-1004563024 tempest-ServicesTestJSON-1004563024-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:26.127783 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8040bddf-b70b-413f-9f03-318aef584edf tempest-ServicesTestJSON-1004563024 tempest-ServicesTestJSON-1004563024-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:26.142868 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f878d8e-6fa5-4d64-b611-d8fab0e7ad30 tempest-ServicesTestJSON-1004563024 tempest-ServicesTestJSON-1004563024-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a50ec5144cc2428cae64fe5bcf63247a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1cc6417415a4137bee3c0db24cac709', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:26.143538 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f878d8e-6fa5-4d64-b611-d8fab0e7ad30 tempest-ServicesTestJSON-1004563024 tempest-ServicesTestJSON-1004563024-project-admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:26.143811 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f878d8e-6fa5-4d64-b611-d8fab0e7ad30 tempest-ServicesTestJSON-1004563024 tempest-ServicesTestJSON-1004563024-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:26.144089 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f878d8e-6fa5-4d64-b611-d8fab0e7ad30 tempest-ServicesTestJSON-1004563024 tempest-ServicesTestJSON-1004563024-project-admin] PATH_INFO: `/v3/services` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:26.144789 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f878d8e-6fa5-4d64-b611-d8fab0e7ad30 tempest-ServicesTestJSON-1004563024 tempest-ServicesTestJSON-1004563024-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:26.146427 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f878d8e-6fa5-4d64-b611-d8fab0e7ad30 tempest-ServicesTestJSON-1004563024 tempest-ServicesTestJSON-1004563024-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:26.154942 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:02:26.165338 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4126/8224] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 22:02:26 2022] POST /identity/v3/services => generated 287 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 22:02:26.167434 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5f4de4-4934-418a-858f-a486652a4d90 tempest-ServicesTestJSON-1004563024 tempest-ServicesTestJSON-1004563024-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:26.178660 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5f4de4-4934-418a-858f-a486652a4d90 tempest-ServicesTestJSON-1004563024 tempest-ServicesTestJSON-1004563024-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:26.194870 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf1637c-69ce-4762-9d33-d17285044554 tempest-ServicesTestJSON-1004563024 tempest-ServicesTestJSON-1004563024-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a50ec5144cc2428cae64fe5bcf63247a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1cc6417415a4137bee3c0db24cac709', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:26.195765 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf1637c-69ce-4762-9d33-d17285044554 tempest-ServicesTestJSON-1004563024 tempest-ServicesTestJSON-1004563024-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:26.196066 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf1637c-69ce-4762-9d33-d17285044554 tempest-ServicesTestJSON-1004563024 tempest-ServicesTestJSON-1004563024-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:26.196336 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf1637c-69ce-4762-9d33-d17285044554 tempest-ServicesTestJSON-1004563024 tempest-ServicesTestJSON-1004563024-project-admin] PATH_INFO: `/v3/services/a730c7d0f6bd49e28d374f25aec3be46` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:26.197049 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf1637c-69ce-4762-9d33-d17285044554 tempest-ServicesTestJSON-1004563024 tempest-ServicesTestJSON-1004563024-project-admin] RBAC: Authorizing `identity:update_service(service_id=a730c7d0f6bd49e28d374f25aec3be46)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:26.198173 ncdv-master-1 devstack@keystone.service[91547]: WARNING py.warnings [None req-5cf1637c-69ce-4762-9d33-d17285044554 tempest-ServicesTestJSON-1004563024 tempest-ServicesTestJSON-1004563024-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 22:02:26.198173 ncdv-master-1 devstack@keystone.service[91547]: warnings.warn(msg) Jul 23 22:02:26.198173 ncdv-master-1 devstack@keystone.service[91547]: Jul 23 22:02:26.199086 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf1637c-69ce-4762-9d33-d17285044554 tempest-ServicesTestJSON-1004563024 tempest-ServicesTestJSON-1004563024-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:26.218742 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4099/8225] 10.222.0.17 () {60 vars in 1251 bytes} [Sat Jul 23 22:02:26 2022] PATCH /identity/v3/services/a730c7d0f6bd49e28d374f25aec3be46 => generated 281 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 22:02:26.223887 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f878d8e-6fa5-4d64-b611-d8fab0e7ad30 tempest-ServicesTestJSON-1004563024 tempest-ServicesTestJSON-1004563024-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:26.234948 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f878d8e-6fa5-4d64-b611-d8fab0e7ad30 tempest-ServicesTestJSON-1004563024 tempest-ServicesTestJSON-1004563024-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:26.250393 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c81b35-a6d6-493f-9865-389a8414c7b8 tempest-ServicesTestJSON-1004563024 tempest-ServicesTestJSON-1004563024-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a50ec5144cc2428cae64fe5bcf63247a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1cc6417415a4137bee3c0db24cac709', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:26.251267 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c81b35-a6d6-493f-9865-389a8414c7b8 tempest-ServicesTestJSON-1004563024 tempest-ServicesTestJSON-1004563024-project-admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:26.251549 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c81b35-a6d6-493f-9865-389a8414c7b8 tempest-ServicesTestJSON-1004563024 tempest-ServicesTestJSON-1004563024-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:26.251823 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c81b35-a6d6-493f-9865-389a8414c7b8 tempest-ServicesTestJSON-1004563024 tempest-ServicesTestJSON-1004563024-project-admin] PATH_INFO: `/v3/services/a730c7d0f6bd49e28d374f25aec3be46` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:26.252517 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c81b35-a6d6-493f-9865-389a8414c7b8 tempest-ServicesTestJSON-1004563024 tempest-ServicesTestJSON-1004563024-project-admin] RBAC: Authorizing `identity:get_service(service_id=a730c7d0f6bd49e28d374f25aec3be46)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:26.253588 ncdv-master-1 devstack@keystone.service[91548]: WARNING py.warnings [None req-21c81b35-a6d6-493f-9865-389a8414c7b8 tempest-ServicesTestJSON-1004563024 tempest-ServicesTestJSON-1004563024-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_service": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 22:02:26.253588 ncdv-master-1 devstack@keystone.service[91548]: warnings.warn(msg) Jul 23 22:02:26.253588 ncdv-master-1 devstack@keystone.service[91548]: Jul 23 22:02:26.254439 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c81b35-a6d6-493f-9865-389a8414c7b8 tempest-ServicesTestJSON-1004563024 tempest-ServicesTestJSON-1004563024-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:26.259972 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4127/8226] 10.222.0.17 () {58 vars in 1229 bytes} [Sat Jul 23 22:02:26 2022] GET /identity/v3/services/a730c7d0f6bd49e28d374f25aec3be46 => generated 281 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 22:02:26.264332 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf1637c-69ce-4762-9d33-d17285044554 tempest-ServicesTestJSON-1004563024 tempest-ServicesTestJSON-1004563024-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:26.275390 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf1637c-69ce-4762-9d33-d17285044554 tempest-ServicesTestJSON-1004563024 tempest-ServicesTestJSON-1004563024-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:26.281354 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c61d49f-2ba6-48e7-bb8b-2c813e088af5 tempest-ServicesTestJSON-1004563024 tempest-ServicesTestJSON-1004563024-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a50ec5144cc2428cae64fe5bcf63247a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1cc6417415a4137bee3c0db24cac709', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:26.282265 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c61d49f-2ba6-48e7-bb8b-2c813e088af5 tempest-ServicesTestJSON-1004563024 tempest-ServicesTestJSON-1004563024-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:26.282554 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c61d49f-2ba6-48e7-bb8b-2c813e088af5 tempest-ServicesTestJSON-1004563024 tempest-ServicesTestJSON-1004563024-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:26.282837 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c61d49f-2ba6-48e7-bb8b-2c813e088af5 tempest-ServicesTestJSON-1004563024 tempest-ServicesTestJSON-1004563024-project-admin] PATH_INFO: `/v3/services/a730c7d0f6bd49e28d374f25aec3be46` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:26.283549 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c61d49f-2ba6-48e7-bb8b-2c813e088af5 tempest-ServicesTestJSON-1004563024 tempest-ServicesTestJSON-1004563024-project-admin] RBAC: Authorizing `identity:delete_service(service_id=a730c7d0f6bd49e28d374f25aec3be46)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:26.285155 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c61d49f-2ba6-48e7-bb8b-2c813e088af5 tempest-ServicesTestJSON-1004563024 tempest-ServicesTestJSON-1004563024-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:26.290770 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:UPDATE=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:02:26.308636 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4100/8227] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 22:02:26 2022] DELETE /identity/v3/services/a730c7d0f6bd49e28d374f25aec3be46 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:02:26.312782 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c81b35-a6d6-493f-9865-389a8414c7b8 tempest-ServicesTestJSON-1004563024 tempest-ServicesTestJSON-1004563024-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:26.323589 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c81b35-a6d6-493f-9865-389a8414c7b8 tempest-ServicesTestJSON-1004563024 tempest-ServicesTestJSON-1004563024-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:26.340202 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771566e0-70ff-4d16-b6b5-d93f0a0b5493 tempest-ServicesTestJSON-1004563024 tempest-ServicesTestJSON-1004563024-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a50ec5144cc2428cae64fe5bcf63247a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1cc6417415a4137bee3c0db24cac709', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:26.341084 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771566e0-70ff-4d16-b6b5-d93f0a0b5493 tempest-ServicesTestJSON-1004563024 tempest-ServicesTestJSON-1004563024-project-admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:26.341368 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771566e0-70ff-4d16-b6b5-d93f0a0b5493 tempest-ServicesTestJSON-1004563024 tempest-ServicesTestJSON-1004563024-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:26.341642 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771566e0-70ff-4d16-b6b5-d93f0a0b5493 tempest-ServicesTestJSON-1004563024 tempest-ServicesTestJSON-1004563024-project-admin] PATH_INFO: `/v3/services/a730c7d0f6bd49e28d374f25aec3be46` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:26.342686 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771566e0-70ff-4d16-b6b5-d93f0a0b5493 tempest-ServicesTestJSON-1004563024 tempest-ServicesTestJSON-1004563024-project-admin] RBAC: Authorizing `identity:get_service(service_id=a730c7d0f6bd49e28d374f25aec3be46)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:26.344300 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771566e0-70ff-4d16-b6b5-d93f0a0b5493 tempest-ServicesTestJSON-1004563024 tempest-ServicesTestJSON-1004563024-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:26.358615 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-771566e0-70ff-4d16-b6b5-d93f0a0b5493 tempest-ServicesTestJSON-1004563024 tempest-ServicesTestJSON-1004563024-project-admin] Could not find service: a730c7d0f6bd49e28d374f25aec3be46.: keystone.exception.ServiceNotFound: Could not find service: a730c7d0f6bd49e28d374f25aec3be46. Jul 23 22:02:26.358615 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 22:02:26.358615 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 23 22:02:26.358615 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 23 22:02:26.358615 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 23 22:02:26.358615 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 23 22:02:26.358615 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 23 22:02:26.358615 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 23 22:02:26.358615 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: a730c7d0f6bd49e28d374f25aec3be46. Jul 23 22:02:26.358615 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 22:02:26.358615 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 23 22:02:26.358615 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 22:02:26.358615 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 22:02:26.358615 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 22:02:26.358615 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 22:02:26.359827 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 22:02:26.359827 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 22:02:26.359827 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 22:02:26.359827 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 22:02:26.359827 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 22:02:26.359827 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 22:02:26.359827 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 22:02:26.359827 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 22:02:26.359827 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 23 22:02:26.359827 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 23 22:02:26.359827 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 23 22:02:26.359827 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 23 22:02:26.359827 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 22:02:26.359827 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 22:02:26.359827 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 22:02:26.359827 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 22:02:26.361062 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 22:02:26.361062 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 22:02:26.361062 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 22:02:26.361062 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application with Lock( Jul 23 22:02:26.361062 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 22:02:26.361062 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._enter() Jul 23 22:02:26.361062 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 22:02:26.361062 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 22:02:26.361062 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 22:02:26.361062 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.creator() Jul 23 22:02:26.361062 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 22:02:26.361062 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application created_value = creator( Jul 23 22:02:26.361062 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 23 22:02:26.361062 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 23 22:02:26.361062 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: a730c7d0f6bd49e28d374f25aec3be46. Jul 23 22:02:26.361062 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 22:02:26.362386 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4128/8228] 10.222.0.17 () {58 vars in 1229 bytes} [Sat Jul 23 22:02:26 2022] GET /identity/v3/services/a730c7d0f6bd49e28d374f25aec3be46 => generated 113 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Jul 23 22:02:26.365174 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c61d49f-2ba6-48e7-bb8b-2c813e088af5 tempest-ServicesTestJSON-1004563024 tempest-ServicesTestJSON-1004563024-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:26.376466 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c61d49f-2ba6-48e7-bb8b-2c813e088af5 tempest-ServicesTestJSON-1004563024 tempest-ServicesTestJSON-1004563024-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:26.382179 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6d2805-e93a-4dff-8500-92868338472b tempest-ServicesTestJSON-1004563024 tempest-ServicesTestJSON-1004563024-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a50ec5144cc2428cae64fe5bcf63247a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1cc6417415a4137bee3c0db24cac709', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:26.382845 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6d2805-e93a-4dff-8500-92868338472b tempest-ServicesTestJSON-1004563024 tempest-ServicesTestJSON-1004563024-project-admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:26.383132 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6d2805-e93a-4dff-8500-92868338472b tempest-ServicesTestJSON-1004563024 tempest-ServicesTestJSON-1004563024-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:26.383407 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6d2805-e93a-4dff-8500-92868338472b tempest-ServicesTestJSON-1004563024 tempest-ServicesTestJSON-1004563024-project-admin] PATH_INFO: `/v3/services` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:26.384143 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6d2805-e93a-4dff-8500-92868338472b tempest-ServicesTestJSON-1004563024 tempest-ServicesTestJSON-1004563024-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:26.385734 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6d2805-e93a-4dff-8500-92868338472b tempest-ServicesTestJSON-1004563024 tempest-ServicesTestJSON-1004563024-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:26.400812 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4101/8229] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 22:02:26 2022] POST /identity/v3/services => generated 274 bytes in 36 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 22:02:26.404584 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771566e0-70ff-4d16-b6b5-d93f0a0b5493 tempest-ServicesTestJSON-1004563024 tempest-ServicesTestJSON-1004563024-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:26.414763 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771566e0-70ff-4d16-b6b5-d93f0a0b5493 tempest-ServicesTestJSON-1004563024 tempest-ServicesTestJSON-1004563024-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:26.429627 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340d7bf7-7636-43f7-b426-4d07ca521fbc tempest-ServicesTestJSON-1004563024 tempest-ServicesTestJSON-1004563024-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a50ec5144cc2428cae64fe5bcf63247a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1cc6417415a4137bee3c0db24cac709', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:26.430313 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340d7bf7-7636-43f7-b426-4d07ca521fbc tempest-ServicesTestJSON-1004563024 tempest-ServicesTestJSON-1004563024-project-admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:26.430599 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340d7bf7-7636-43f7-b426-4d07ca521fbc tempest-ServicesTestJSON-1004563024 tempest-ServicesTestJSON-1004563024-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:26.430877 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340d7bf7-7636-43f7-b426-4d07ca521fbc tempest-ServicesTestJSON-1004563024 tempest-ServicesTestJSON-1004563024-project-admin] PATH_INFO: `/v3/services` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:26.431584 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340d7bf7-7636-43f7-b426-4d07ca521fbc tempest-ServicesTestJSON-1004563024 tempest-ServicesTestJSON-1004563024-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:26.433174 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340d7bf7-7636-43f7-b426-4d07ca521fbc tempest-ServicesTestJSON-1004563024 tempest-ServicesTestJSON-1004563024-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:26.448141 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4129/8230] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 22:02:26 2022] POST /identity/v3/services => generated 274 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 22:02:26.452134 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6d2805-e93a-4dff-8500-92868338472b tempest-ServicesTestJSON-1004563024 tempest-ServicesTestJSON-1004563024-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:26.463104 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6d2805-e93a-4dff-8500-92868338472b tempest-ServicesTestJSON-1004563024 tempest-ServicesTestJSON-1004563024-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:26.481127 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ea5db7-be9a-4f45-8ffc-4ba0c569a8b2 tempest-ServicesTestJSON-1004563024 tempest-ServicesTestJSON-1004563024-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a50ec5144cc2428cae64fe5bcf63247a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1cc6417415a4137bee3c0db24cac709', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:26.481818 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ea5db7-be9a-4f45-8ffc-4ba0c569a8b2 tempest-ServicesTestJSON-1004563024 tempest-ServicesTestJSON-1004563024-project-admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:26.482112 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ea5db7-be9a-4f45-8ffc-4ba0c569a8b2 tempest-ServicesTestJSON-1004563024 tempest-ServicesTestJSON-1004563024-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:26.482416 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ea5db7-be9a-4f45-8ffc-4ba0c569a8b2 tempest-ServicesTestJSON-1004563024 tempest-ServicesTestJSON-1004563024-project-admin] PATH_INFO: `/v3/services` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:26.483129 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ea5db7-be9a-4f45-8ffc-4ba0c569a8b2 tempest-ServicesTestJSON-1004563024 tempest-ServicesTestJSON-1004563024-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:26.484745 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ea5db7-be9a-4f45-8ffc-4ba0c569a8b2 tempest-ServicesTestJSON-1004563024 tempest-ServicesTestJSON-1004563024-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:26.500296 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4102/8231] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 22:02:26 2022] POST /identity/v3/services => generated 275 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 22:02:26.504304 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340d7bf7-7636-43f7-b426-4d07ca521fbc tempest-ServicesTestJSON-1004563024 tempest-ServicesTestJSON-1004563024-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:26.515109 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340d7bf7-7636-43f7-b426-4d07ca521fbc tempest-ServicesTestJSON-1004563024 tempest-ServicesTestJSON-1004563024-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:26.530906 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9adc7af-0206-4318-a55f-ad71d8381bef tempest-ServicesTestJSON-1004563024 tempest-ServicesTestJSON-1004563024-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a50ec5144cc2428cae64fe5bcf63247a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1cc6417415a4137bee3c0db24cac709', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:26.531588 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9adc7af-0206-4318-a55f-ad71d8381bef tempest-ServicesTestJSON-1004563024 tempest-ServicesTestJSON-1004563024-project-admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:26.531875 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9adc7af-0206-4318-a55f-ad71d8381bef tempest-ServicesTestJSON-1004563024 tempest-ServicesTestJSON-1004563024-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:26.532149 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9adc7af-0206-4318-a55f-ad71d8381bef tempest-ServicesTestJSON-1004563024 tempest-ServicesTestJSON-1004563024-project-admin] PATH_INFO: `/v3/services` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:26.532836 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9adc7af-0206-4318-a55f-ad71d8381bef tempest-ServicesTestJSON-1004563024 tempest-ServicesTestJSON-1004563024-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:26.533900 ncdv-master-1 devstack@keystone.service[91548]: WARNING py.warnings [None req-a9adc7af-0206-4318-a55f-ad71d8381bef tempest-ServicesTestJSON-1004563024 tempest-ServicesTestJSON-1004563024-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 22:02:26.533900 ncdv-master-1 devstack@keystone.service[91548]: warnings.warn(msg) Jul 23 22:02:26.533900 ncdv-master-1 devstack@keystone.service[91548]: Jul 23 22:02:26.534801 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9adc7af-0206-4318-a55f-ad71d8381bef tempest-ServicesTestJSON-1004563024 tempest-ServicesTestJSON-1004563024-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:26.543141 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4130/8232] 10.222.0.17 () {58 vars in 1130 bytes} [Sat Jul 23 22:02:26 2022] GET /identity/v3/services => generated 2978 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 22:02:26.547426 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ea5db7-be9a-4f45-8ffc-4ba0c569a8b2 tempest-ServicesTestJSON-1004563024 tempest-ServicesTestJSON-1004563024-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:26.558656 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ea5db7-be9a-4f45-8ffc-4ba0c569a8b2 tempest-ServicesTestJSON-1004563024 tempest-ServicesTestJSON-1004563024-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:26.563676 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7173a16-dd0c-4bd8-a3e9-229c750fc6c8 tempest-ServicesTestJSON-1004563024 tempest-ServicesTestJSON-1004563024-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a50ec5144cc2428cae64fe5bcf63247a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1cc6417415a4137bee3c0db24cac709', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:26.564335 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7173a16-dd0c-4bd8-a3e9-229c750fc6c8 tempest-ServicesTestJSON-1004563024 tempest-ServicesTestJSON-1004563024-project-admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:26.564644 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7173a16-dd0c-4bd8-a3e9-229c750fc6c8 tempest-ServicesTestJSON-1004563024 tempest-ServicesTestJSON-1004563024-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:26.564919 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7173a16-dd0c-4bd8-a3e9-229c750fc6c8 tempest-ServicesTestJSON-1004563024 tempest-ServicesTestJSON-1004563024-project-admin] PATH_INFO: `/v3/services` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:26.565637 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7173a16-dd0c-4bd8-a3e9-229c750fc6c8 tempest-ServicesTestJSON-1004563024 tempest-ServicesTestJSON-1004563024-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-290253961) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 22:02:26.565974 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7173a16-dd0c-4bd8-a3e9-229c750fc6c8 tempest-ServicesTestJSON-1004563024 tempest-ServicesTestJSON-1004563024-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:26.567000 ncdv-master-1 devstack@keystone.service[91547]: WARNING py.warnings [None req-a7173a16-dd0c-4bd8-a3e9-229c750fc6c8 tempest-ServicesTestJSON-1004563024 tempest-ServicesTestJSON-1004563024-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 22:02:26.567000 ncdv-master-1 devstack@keystone.service[91547]: warnings.warn(msg) Jul 23 22:02:26.567000 ncdv-master-1 devstack@keystone.service[91547]: Jul 23 22:02:26.567882 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7173a16-dd0c-4bd8-a3e9-229c750fc6c8 tempest-ServicesTestJSON-1004563024 tempest-ServicesTestJSON-1004563024-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:26.573127 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4103/8233] 10.222.0.17 () {58 vars in 1219 bytes} [Sat Jul 23 22:02:26 2022] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-290253961 => generated 416 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 22:02:26.577117 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9adc7af-0206-4318-a55f-ad71d8381bef tempest-ServicesTestJSON-1004563024 tempest-ServicesTestJSON-1004563024-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:26.587446 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9adc7af-0206-4318-a55f-ad71d8381bef tempest-ServicesTestJSON-1004563024 tempest-ServicesTestJSON-1004563024-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:26.593012 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91da3118-bf37-43aa-9c5b-675f5ab26744 tempest-ServicesTestJSON-1004563024 tempest-ServicesTestJSON-1004563024-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a50ec5144cc2428cae64fe5bcf63247a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1cc6417415a4137bee3c0db24cac709', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:26.593666 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91da3118-bf37-43aa-9c5b-675f5ab26744 tempest-ServicesTestJSON-1004563024 tempest-ServicesTestJSON-1004563024-project-admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:26.593977 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91da3118-bf37-43aa-9c5b-675f5ab26744 tempest-ServicesTestJSON-1004563024 tempest-ServicesTestJSON-1004563024-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:26.594280 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91da3118-bf37-43aa-9c5b-675f5ab26744 tempest-ServicesTestJSON-1004563024 tempest-ServicesTestJSON-1004563024-project-admin] PATH_INFO: `/v3/services` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:26.594986 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91da3118-bf37-43aa-9c5b-675f5ab26744 tempest-ServicesTestJSON-1004563024 tempest-ServicesTestJSON-1004563024-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-1225152537) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 22:02:26.595286 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91da3118-bf37-43aa-9c5b-675f5ab26744 tempest-ServicesTestJSON-1004563024 tempest-ServicesTestJSON-1004563024-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:26.596905 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91da3118-bf37-43aa-9c5b-675f5ab26744 tempest-ServicesTestJSON-1004563024 tempest-ServicesTestJSON-1004563024-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:26.602088 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4131/8234] 10.222.0.17 () {58 vars in 1221 bytes} [Sat Jul 23 22:02:26 2022] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-1225152537 => generated 417 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 22:02:26.605925 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7173a16-dd0c-4bd8-a3e9-229c750fc6c8 tempest-ServicesTestJSON-1004563024 tempest-ServicesTestJSON-1004563024-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:26.616290 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7173a16-dd0c-4bd8-a3e9-229c750fc6c8 tempest-ServicesTestJSON-1004563024 tempest-ServicesTestJSON-1004563024-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:26.621188 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d11ce39-7c1f-4c47-ad62-2fbffa591c56 tempest-ServicesTestJSON-1004563024 tempest-ServicesTestJSON-1004563024-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a50ec5144cc2428cae64fe5bcf63247a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1cc6417415a4137bee3c0db24cac709', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:26.621828 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d11ce39-7c1f-4c47-ad62-2fbffa591c56 tempest-ServicesTestJSON-1004563024 tempest-ServicesTestJSON-1004563024-project-admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:26.622150 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d11ce39-7c1f-4c47-ad62-2fbffa591c56 tempest-ServicesTestJSON-1004563024 tempest-ServicesTestJSON-1004563024-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:26.622436 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d11ce39-7c1f-4c47-ad62-2fbffa591c56 tempest-ServicesTestJSON-1004563024 tempest-ServicesTestJSON-1004563024-project-admin] PATH_INFO: `/v3/services` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:26.623160 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d11ce39-7c1f-4c47-ad62-2fbffa591c56 tempest-ServicesTestJSON-1004563024 tempest-ServicesTestJSON-1004563024-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-1141395405) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 22:02:26.623470 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d11ce39-7c1f-4c47-ad62-2fbffa591c56 tempest-ServicesTestJSON-1004563024 tempest-ServicesTestJSON-1004563024-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:26.625064 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d11ce39-7c1f-4c47-ad62-2fbffa591c56 tempest-ServicesTestJSON-1004563024 tempest-ServicesTestJSON-1004563024-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:26.630100 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4104/8235] 10.222.0.17 () {58 vars in 1221 bytes} [Sat Jul 23 22:02:26 2022] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-1141395405 => generated 418 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 22:02:26.634058 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91da3118-bf37-43aa-9c5b-675f5ab26744 tempest-ServicesTestJSON-1004563024 tempest-ServicesTestJSON-1004563024-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:26.644637 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91da3118-bf37-43aa-9c5b-675f5ab26744 tempest-ServicesTestJSON-1004563024 tempest-ServicesTestJSON-1004563024-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:26.650312 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebda5be-4543-426d-b3bc-1c3fb64e3cb9 tempest-ServicesTestJSON-1004563024 tempest-ServicesTestJSON-1004563024-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a50ec5144cc2428cae64fe5bcf63247a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1cc6417415a4137bee3c0db24cac709', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:26.651171 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebda5be-4543-426d-b3bc-1c3fb64e3cb9 tempest-ServicesTestJSON-1004563024 tempest-ServicesTestJSON-1004563024-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:26.651455 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebda5be-4543-426d-b3bc-1c3fb64e3cb9 tempest-ServicesTestJSON-1004563024 tempest-ServicesTestJSON-1004563024-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:26.651731 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebda5be-4543-426d-b3bc-1c3fb64e3cb9 tempest-ServicesTestJSON-1004563024 tempest-ServicesTestJSON-1004563024-project-admin] PATH_INFO: `/v3/services/06386a510f6740759da136c33806643f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:26.652378 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebda5be-4543-426d-b3bc-1c3fb64e3cb9 tempest-ServicesTestJSON-1004563024 tempest-ServicesTestJSON-1004563024-project-admin] RBAC: Authorizing `identity:delete_service(service_id=06386a510f6740759da136c33806643f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:26.654005 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebda5be-4543-426d-b3bc-1c3fb64e3cb9 tempest-ServicesTestJSON-1004563024 tempest-ServicesTestJSON-1004563024-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:26.679784 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4132/8236] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 22:02:26 2022] DELETE /identity/v3/services/06386a510f6740759da136c33806643f => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:02:26.684087 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d11ce39-7c1f-4c47-ad62-2fbffa591c56 tempest-ServicesTestJSON-1004563024 tempest-ServicesTestJSON-1004563024-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:26.695280 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d11ce39-7c1f-4c47-ad62-2fbffa591c56 tempest-ServicesTestJSON-1004563024 tempest-ServicesTestJSON-1004563024-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:26.712202 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac32c54c-af2d-4a88-b9cc-4df6eddf4537 tempest-ServicesTestJSON-1004563024 tempest-ServicesTestJSON-1004563024-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a50ec5144cc2428cae64fe5bcf63247a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1cc6417415a4137bee3c0db24cac709', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:26.713109 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac32c54c-af2d-4a88-b9cc-4df6eddf4537 tempest-ServicesTestJSON-1004563024 tempest-ServicesTestJSON-1004563024-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:26.713389 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac32c54c-af2d-4a88-b9cc-4df6eddf4537 tempest-ServicesTestJSON-1004563024 tempest-ServicesTestJSON-1004563024-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:26.713664 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac32c54c-af2d-4a88-b9cc-4df6eddf4537 tempest-ServicesTestJSON-1004563024 tempest-ServicesTestJSON-1004563024-project-admin] PATH_INFO: `/v3/services/57d842052bbf4816b2bbd13b62d6f4c8` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:26.714356 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac32c54c-af2d-4a88-b9cc-4df6eddf4537 tempest-ServicesTestJSON-1004563024 tempest-ServicesTestJSON-1004563024-project-admin] RBAC: Authorizing `identity:delete_service(service_id=57d842052bbf4816b2bbd13b62d6f4c8)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:26.715974 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac32c54c-af2d-4a88-b9cc-4df6eddf4537 tempest-ServicesTestJSON-1004563024 tempest-ServicesTestJSON-1004563024-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:26.739982 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4105/8237] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 22:02:26 2022] DELETE /identity/v3/services/57d842052bbf4816b2bbd13b62d6f4c8 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:02:26.744664 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebda5be-4543-426d-b3bc-1c3fb64e3cb9 tempest-ServicesTestJSON-1004563024 tempest-ServicesTestJSON-1004563024-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:26.756094 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebda5be-4543-426d-b3bc-1c3fb64e3cb9 tempest-ServicesTestJSON-1004563024 tempest-ServicesTestJSON-1004563024-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:26.771386 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07368fd1-ed59-4032-82d5-a65e0bd32ada tempest-ServicesTestJSON-1004563024 tempest-ServicesTestJSON-1004563024-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a50ec5144cc2428cae64fe5bcf63247a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1cc6417415a4137bee3c0db24cac709', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:26.772251 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07368fd1-ed59-4032-82d5-a65e0bd32ada tempest-ServicesTestJSON-1004563024 tempest-ServicesTestJSON-1004563024-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:26.772534 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07368fd1-ed59-4032-82d5-a65e0bd32ada tempest-ServicesTestJSON-1004563024 tempest-ServicesTestJSON-1004563024-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:26.772805 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07368fd1-ed59-4032-82d5-a65e0bd32ada tempest-ServicesTestJSON-1004563024 tempest-ServicesTestJSON-1004563024-project-admin] PATH_INFO: `/v3/services/09a9583c7f004937bd57db9c2c241a80` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:26.773441 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07368fd1-ed59-4032-82d5-a65e0bd32ada tempest-ServicesTestJSON-1004563024 tempest-ServicesTestJSON-1004563024-project-admin] RBAC: Authorizing `identity:delete_service(service_id=09a9583c7f004937bd57db9c2c241a80)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:26.775082 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07368fd1-ed59-4032-82d5-a65e0bd32ada tempest-ServicesTestJSON-1004563024 tempest-ServicesTestJSON-1004563024-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:26.797783 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4133/8238] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 22:02:26 2022] DELETE /identity/v3/services/09a9583c7f004937bd57db9c2c241a80 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:02:26.802974 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac32c54c-af2d-4a88-b9cc-4df6eddf4537 tempest-ServicesTestJSON-1004563024 tempest-ServicesTestJSON-1004563024-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:26.879799 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac32c54c-af2d-4a88-b9cc-4df6eddf4537 tempest-ServicesTestJSON-1004563024 tempest-ServicesTestJSON-1004563024-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:26.897108 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f85552-5cfe-4139-b13e-50991c38e194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:26.898040 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f85552-5cfe-4139-b13e-50991c38e194 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:26.898320 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f85552-5cfe-4139-b13e-50991c38e194 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:26.898582 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f85552-5cfe-4139-b13e-50991c38e194 admin admin] PATH_INFO: `/v3/users/85cfd2642712430583d4a3874d7aa37f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:26.899816 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f85552-5cfe-4139-b13e-50991c38e194 admin admin] RBAC: Authorizing `identity:delete_user(user_id=85cfd2642712430583d4a3874d7aa37f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:26.901730 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f85552-5cfe-4139-b13e-50991c38e194 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:26.952089 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:02:26.953662 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-a3f85552-5cfe-4139-b13e-50991c38e194 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85cfd2642712430583d4a3874d7aa37f'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:26.963932 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-a3f85552-5cfe-4139-b13e-50991c38e194 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85cfd2642712430583d4a3874d7aa37f'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:26.964920 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-a3f85552-5cfe-4139-b13e-50991c38e194 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85cfd2642712430583d4a3874d7aa37f'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:26.975491 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-a3f85552-5cfe-4139-b13e-50991c38e194 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85cfd2642712430583d4a3874d7aa37f'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:26.988785 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-a3f85552-5cfe-4139-b13e-50991c38e194 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85cfd2642712430583d4a3874d7aa37f'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:26.994832 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4106/8239] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 22:02:26 2022] DELETE /identity/v3/users/85cfd2642712430583d4a3874d7aa37f => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 22:02:26.999483 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbccc5b-a1fa-4490-82e3-8cd7e131e4ec None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:26.999976 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbccc5b-a1fa-4490-82e3-8cd7e131e4ec None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:27.000103 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbccc5b-a1fa-4490-82e3-8cd7e131e4ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:27.017945 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-abbccc5b-a1fa-4490-82e3-8cd7e131e4ec None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:02:27.019049 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-abbccc5b-a1fa-4490-82e3-8cd7e131e4ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:02:27.081565 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4134/8240] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:02:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:02:27.091523 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f85552-5cfe-4139-b13e-50991c38e194 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:27.093486 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-a3f85552-5cfe-4139-b13e-50991c38e194 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:02:27.164476 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f85552-5cfe-4139-b13e-50991c38e194 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:27.168745 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bcdd80-be23-4057-b19a-51241b959958 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:27.169396 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bcdd80-be23-4057-b19a-51241b959958 service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:27.169682 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bcdd80-be23-4057-b19a-51241b959958 service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:27.169989 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bcdd80-be23-4057-b19a-51241b959958 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:27.180205 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bcdd80-be23-4057-b19a-51241b959958 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:27.181654 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bcdd80-be23-4057-b19a-51241b959958 service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:27.191508 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4107/8241] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:02:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:02:27.470351 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbccc5b-a1fa-4490-82e3-8cd7e131e4ec None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:27.471924 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-abbccc5b-a1fa-4490-82e3-8cd7e131e4ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:02:27.484488 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbccc5b-a1fa-4490-82e3-8cd7e131e4ec None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:27.490658 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec1211d-03a8-4933-acc6-e6e837dcba29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:27.491562 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec1211d-03a8-4933-acc6-e6e837dcba29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:27.491840 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec1211d-03a8-4933-acc6-e6e837dcba29 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:27.492114 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec1211d-03a8-4933-acc6-e6e837dcba29 admin admin] PATH_INFO: `/v3/projects/7ed1f925186641378f83a374b59635b0` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:27.493447 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec1211d-03a8-4933-acc6-e6e837dcba29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ed1f925186641378f83a374b59635b0)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:27.495427 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec1211d-03a8-4933-acc6-e6e837dcba29 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:27.510871 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:02:27.553290 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-5ec1211d-03a8-4933-acc6-e6e837dcba29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ed1f925186641378f83a374b59635b0', 'request_id': 'req-5ec1211d-03a8-4933-acc6-e6e837dcba29'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:27.562240 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-5ec1211d-03a8-4933-acc6-e6e837dcba29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ed1f925186641378f83a374b59635b0', 'request_id': 'req-5ec1211d-03a8-4933-acc6-e6e837dcba29'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:27.568206 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-5ec1211d-03a8-4933-acc6-e6e837dcba29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ed1f925186641378f83a374b59635b0', 'request_id': 'req-5ec1211d-03a8-4933-acc6-e6e837dcba29'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:27.580004 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-5ec1211d-03a8-4933-acc6-e6e837dcba29 admin admin] The token cache is being invalidate because project 7ed1f925186641378f83a374b59635b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 22:02:27.580317 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-5ec1211d-03a8-4933-acc6-e6e837dcba29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:27.581014 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-5ec1211d-03a8-4933-acc6-e6e837dcba29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:27.582680 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4135/8242] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 22:02:27 2022] DELETE /identity/v3/projects/7ed1f925186641378f83a374b59635b0 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 22:02:27.586990 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bcdd80-be23-4057-b19a-51241b959958 service neutron] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:27.597671 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bcdd80-be23-4057-b19a-51241b959958 service neutron] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:27.657664 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a471059-88d2-4e01-b1f1-5e7588d4777a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:27.658636 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a471059-88d2-4e01-b1f1-5e7588d4777a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:27.658913 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a471059-88d2-4e01-b1f1-5e7588d4777a admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:27.659182 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a471059-88d2-4e01-b1f1-5e7588d4777a admin admin] PATH_INFO: `/v3/users/a50ec5144cc2428cae64fe5bcf63247a` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:27.660386 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a471059-88d2-4e01-b1f1-5e7588d4777a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a50ec5144cc2428cae64fe5bcf63247a)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:27.662348 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a471059-88d2-4e01-b1f1-5e7588d4777a admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:27.709620 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-2a471059-88d2-4e01-b1f1-5e7588d4777a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a50ec5144cc2428cae64fe5bcf63247a'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:27.716498 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-2a471059-88d2-4e01-b1f1-5e7588d4777a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a50ec5144cc2428cae64fe5bcf63247a'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:27.717519 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-2a471059-88d2-4e01-b1f1-5e7588d4777a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a50ec5144cc2428cae64fe5bcf63247a'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:27.720130 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:02:27.726452 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-2a471059-88d2-4e01-b1f1-5e7588d4777a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a50ec5144cc2428cae64fe5bcf63247a'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:27.739126 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-2a471059-88d2-4e01-b1f1-5e7588d4777a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a50ec5144cc2428cae64fe5bcf63247a'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:27.745200 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4108/8243] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 22:02:27 2022] DELETE /identity/v3/users/a50ec5144cc2428cae64fe5bcf63247a => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:02:28.038084 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec1211d-03a8-4933-acc6-e6e837dcba29 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:28.039561 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-5ec1211d-03a8-4933-acc6-e6e837dcba29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:02:28.056394 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec1211d-03a8-4933-acc6-e6e837dcba29 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:28.116420 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77d52e3-59c4-4c68-a32a-1cea2c18194a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:28.117218 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77d52e3-59c4-4c68-a32a-1cea2c18194a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:28.117499 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77d52e3-59c4-4c68-a32a-1cea2c18194a admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:28.117775 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77d52e3-59c4-4c68-a32a-1cea2c18194a admin admin] PATH_INFO: `/v3/projects/f1cc6417415a4137bee3c0db24cac709` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:28.119052 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77d52e3-59c4-4c68-a32a-1cea2c18194a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1cc6417415a4137bee3c0db24cac709)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:28.120970 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77d52e3-59c4-4c68-a32a-1cea2c18194a admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:28.169794 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-b77d52e3-59c4-4c68-a32a-1cea2c18194a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1cc6417415a4137bee3c0db24cac709', 'request_id': 'req-b77d52e3-59c4-4c68-a32a-1cea2c18194a'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:28.178694 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-b77d52e3-59c4-4c68-a32a-1cea2c18194a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1cc6417415a4137bee3c0db24cac709', 'request_id': 'req-b77d52e3-59c4-4c68-a32a-1cea2c18194a'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:28.184379 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-b77d52e3-59c4-4c68-a32a-1cea2c18194a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1cc6417415a4137bee3c0db24cac709', 'request_id': 'req-b77d52e3-59c4-4c68-a32a-1cea2c18194a'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:28.195118 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-b77d52e3-59c4-4c68-a32a-1cea2c18194a admin admin] The token cache is being invalidate because project f1cc6417415a4137bee3c0db24cac709 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 22:02:28.195400 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-b77d52e3-59c4-4c68-a32a-1cea2c18194a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:28.196036 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-b77d52e3-59c4-4c68-a32a-1cea2c18194a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:28.197615 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4136/8244] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 22:02:28 2022] DELETE /identity/v3/projects/f1cc6417415a4137bee3c0db24cac709 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:02:28.202623 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112d566f-1d4d-4d18-8cab-d506e09f0a85 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:28.202943 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112d566f-1d4d-4d18-8cab-d506e09f0a85 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:28.203217 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112d566f-1d4d-4d18-8cab-d506e09f0a85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:28.221450 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-112d566f-1d4d-4d18-8cab-d506e09f0a85 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:02:28.222725 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-112d566f-1d4d-4d18-8cab-d506e09f0a85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:02:28.285401 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4109/8245] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:02:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:02:28.293524 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61d6281-c436-4cd2-a28b-7528ec8314e2 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:28.293883 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61d6281-c436-4cd2-a28b-7528ec8314e2 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:28.294161 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61d6281-c436-4cd2-a28b-7528ec8314e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:28.313437 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-f61d6281-c436-4cd2-a28b-7528ec8314e2 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:02:28.314723 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-f61d6281-c436-4cd2-a28b-7528ec8314e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:02:28.323181 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4137/8246] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:02:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:02:28.327860 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112d566f-1d4d-4d18-8cab-d506e09f0a85 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:28.338485 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112d566f-1d4d-4d18-8cab-d506e09f0a85 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:28.344217 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336e2217-9fdc-48fa-b652-617bf261820b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:28.344916 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336e2217-9fdc-48fa-b652-617bf261820b admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:28.345200 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336e2217-9fdc-48fa-b652-617bf261820b admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:28.345468 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336e2217-9fdc-48fa-b652-617bf261820b admin admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:28.346365 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336e2217-9fdc-48fa-b652-617bf261820b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 22:02:28.346663 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336e2217-9fdc-48fa-b652-617bf261820b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:28.348279 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336e2217-9fdc-48fa-b652-617bf261820b admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:28.360689 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4110/8247] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 22:02:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 22:02:28.365485 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61d6281-c436-4cd2-a28b-7528ec8314e2 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:28.375547 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61d6281-c436-4cd2-a28b-7528ec8314e2 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:28.381624 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ebdb95-1982-443b-a4cb-28f9a8401c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:28.382310 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ebdb95-1982-443b-a4cb-28f9a8401c88 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:28.382589 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ebdb95-1982-443b-a4cb-28f9a8401c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:28.382858 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ebdb95-1982-443b-a4cb-28f9a8401c88 admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:28.383546 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ebdb95-1982-443b-a4cb-28f9a8401c88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:28.385493 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ebdb95-1982-443b-a4cb-28f9a8401c88 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:28.414360 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4138/8248] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 22:02:28 2022] POST /identity/v3/projects => generated 371 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 22:02:28.418732 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336e2217-9fdc-48fa-b652-617bf261820b admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:28.429235 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336e2217-9fdc-48fa-b652-617bf261820b admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:28.488428 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc84d0df-b63c-4600-ad4e-233603f20920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:28.489124 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc84d0df-b63c-4600-ad4e-233603f20920 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:28.489403 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc84d0df-b63c-4600-ad4e-233603f20920 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:28.489677 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc84d0df-b63c-4600-ad4e-233603f20920 admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:28.490394 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc84d0df-b63c-4600-ad4e-233603f20920 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:28.492317 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc84d0df-b63c-4600-ad4e-233603f20920 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:28.514841 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4111/8249] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 22:02:28 2022] POST /identity/v3/users => generated 286 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 22:02:28.519185 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ebdb95-1982-443b-a4cb-28f9a8401c88 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:28.527886 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:02:28.535349 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ebdb95-1982-443b-a4cb-28f9a8401c88 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:28.541885 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bda81a-dc61-4b91-9a15-2845775f84f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:28.542601 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bda81a-dc61-4b91-9a15-2845775f84f5 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:28.542885 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bda81a-dc61-4b91-9a15-2845775f84f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:28.543160 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bda81a-dc61-4b91-9a15-2845775f84f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:28.543891 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bda81a-dc61-4b91-9a15-2845775f84f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:28.545655 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bda81a-dc61-4b91-9a15-2845775f84f5 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:28.556894 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4139/8250] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 22:02:28 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 22:02:28.561068 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc84d0df-b63c-4600-ad4e-233603f20920 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:28.572281 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc84d0df-b63c-4600-ad4e-233603f20920 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:28.577516 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cb141f-881e-4840-b62a-a207da5dbf02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:28.578226 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cb141f-881e-4840-b62a-a207da5dbf02 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:28.578510 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cb141f-881e-4840-b62a-a207da5dbf02 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:28.578786 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cb141f-881e-4840-b62a-a207da5dbf02 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:28.579518 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cb141f-881e-4840-b62a-a207da5dbf02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:28.581227 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cb141f-881e-4840-b62a-a207da5dbf02 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:28.591764 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4112/8251] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 22:02:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 22:02:28.596558 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bda81a-dc61-4b91-9a15-2845775f84f5 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:28.606937 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bda81a-dc61-4b91-9a15-2845775f84f5 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:28.612033 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1298cbc-3bc8-4a15-bdb7-401cde2bed65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:28.613033 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1298cbc-3bc8-4a15-bdb7-401cde2bed65 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:28.613314 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1298cbc-3bc8-4a15-bdb7-401cde2bed65 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:28.613587 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1298cbc-3bc8-4a15-bdb7-401cde2bed65 admin admin] PATH_INFO: `/v3/projects/12603811cc96477d8ba246dc6f9736e7/users/dc8fe38fd2d14883ac013fe162d7d597/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:28.628988 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1298cbc-3bc8-4a15-bdb7-401cde2bed65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12603811cc96477d8ba246dc6f9736e7, user_id=dc8fe38fd2d14883ac013fe162d7d597, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:28.631626 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1298cbc-3bc8-4a15-bdb7-401cde2bed65 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:28.646729 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4140/8252] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 22:02:28 2022] PUT /identity/v3/projects/12603811cc96477d8ba246dc6f9736e7/users/dc8fe38fd2d14883ac013fe162d7d597/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:02:28.658182 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f343286-25df-4b46-b692-524cf4226168 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:28.658446 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f343286-25df-4b46-b692-524cf4226168 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:28.658783 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f343286-25df-4b46-b692-524cf4226168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:28.686556 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-5f343286-25df-4b46-b692-524cf4226168 None None] MFA Rules not processed for user `dc8fe38fd2d14883ac013fe162d7d597`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:02:28.687804 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-5f343286-25df-4b46-b692-524cf4226168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:02:28.726001 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:02:28.767177 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4113/8253] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:02:28 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:02:28.772700 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1298cbc-3bc8-4a15-bdb7-401cde2bed65 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:28.841846 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1298cbc-3bc8-4a15-bdb7-401cde2bed65 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:28.847792 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc466894-f6eb-4927-9c6f-7e134f750aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:28.848464 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc466894-f6eb-4927-9c6f-7e134f750aa5 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:28.848748 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc466894-f6eb-4927-9c6f-7e134f750aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:28.849023 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc466894-f6eb-4927-9c6f-7e134f750aa5 admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:28.849716 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc466894-f6eb-4927-9c6f-7e134f750aa5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:28.851663 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc466894-f6eb-4927-9c6f-7e134f750aa5 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:28.880480 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4141/8254] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 22:02:28 2022] POST /identity/v3/projects => generated 371 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 22:02:28.887172 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f343286-25df-4b46-b692-524cf4226168 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:28.898756 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f343286-25df-4b46-b692-524cf4226168 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:28.958352 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9be8198-2b21-4301-96ec-5a60040aec2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:28.959032 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9be8198-2b21-4301-96ec-5a60040aec2e admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:28.959310 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9be8198-2b21-4301-96ec-5a60040aec2e admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:28.959583 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9be8198-2b21-4301-96ec-5a60040aec2e admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:28.960265 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9be8198-2b21-4301-96ec-5a60040aec2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:28.962240 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9be8198-2b21-4301-96ec-5a60040aec2e admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:28.983773 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4114/8255] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 22:02:28 2022] POST /identity/v3/users => generated 292 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 22:02:28.988482 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc466894-f6eb-4927-9c6f-7e134f750aa5 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:28.999293 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc466894-f6eb-4927-9c6f-7e134f750aa5 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:29.004187 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b88da20-5378-416a-963b-882787a7e011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:29.004847 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b88da20-5378-416a-963b-882787a7e011 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:29.005110 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b88da20-5378-416a-963b-882787a7e011 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:29.005408 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b88da20-5378-416a-963b-882787a7e011 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:29.006197 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b88da20-5378-416a-963b-882787a7e011 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:29.007790 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b88da20-5378-416a-963b-882787a7e011 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:29.018517 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4142/8256] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 22:02:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 22:02:29.022713 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9be8198-2b21-4301-96ec-5a60040aec2e admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:29.033552 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9be8198-2b21-4301-96ec-5a60040aec2e admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:29.039753 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9482c4-be21-4ac7-a5c8-caee161484e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:29.040640 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9482c4-be21-4ac7-a5c8-caee161484e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:29.040916 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9482c4-be21-4ac7-a5c8-caee161484e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:29.041182 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9482c4-be21-4ac7-a5c8-caee161484e7 admin admin] PATH_INFO: `/v3/projects/80788c3758b8471bbcdab63448e87ab0/users/0cc43da5455340c8b257f2b13a7d39a8/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:29.056891 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9482c4-be21-4ac7-a5c8-caee161484e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80788c3758b8471bbcdab63448e87ab0, user_id=0cc43da5455340c8b257f2b13a7d39a8, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:29.059594 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9482c4-be21-4ac7-a5c8-caee161484e7 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:29.073834 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4115/8257] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 22:02:29 2022] PUT /identity/v3/projects/80788c3758b8471bbcdab63448e87ab0/users/0cc43da5455340c8b257f2b13a7d39a8/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:02:29.077603 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b88da20-5378-416a-963b-882787a7e011 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:29.088151 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b88da20-5378-416a-963b-882787a7e011 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:29.147428 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69518e02-407a-4a41-a25a-9bb77d77f2ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:29.148024 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69518e02-407a-4a41-a25a-9bb77d77f2ea admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:29.148307 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69518e02-407a-4a41-a25a-9bb77d77f2ea admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:29.148582 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69518e02-407a-4a41-a25a-9bb77d77f2ea admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:29.149289 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69518e02-407a-4a41-a25a-9bb77d77f2ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:29.150950 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69518e02-407a-4a41-a25a-9bb77d77f2ea admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:29.161458 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4143/8258] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 22:02:29 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 22:02:29.165803 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9482c4-be21-4ac7-a5c8-caee161484e7 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:29.176423 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9482c4-be21-4ac7-a5c8-caee161484e7 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:29.181464 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ede9d2-fd74-44af-8c5c-f37175844482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:29.182377 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ede9d2-fd74-44af-8c5c-f37175844482 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:29.182646 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ede9d2-fd74-44af-8c5c-f37175844482 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:29.182913 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ede9d2-fd74-44af-8c5c-f37175844482 admin admin] PATH_INFO: `/v3/projects/80788c3758b8471bbcdab63448e87ab0/users/0cc43da5455340c8b257f2b13a7d39a8/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:29.185073 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ede9d2-fd74-44af-8c5c-f37175844482 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80788c3758b8471bbcdab63448e87ab0, user_id=0cc43da5455340c8b257f2b13a7d39a8, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:29.187935 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ede9d2-fd74-44af-8c5c-f37175844482 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:29.199096 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4116/8259] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 22:02:29 2022] PUT /identity/v3/projects/80788c3758b8471bbcdab63448e87ab0/users/0cc43da5455340c8b257f2b13a7d39a8/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:02:29.209436 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46cf3b4-ffb6-4608-a4ad-215417c2244e None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:29.209754 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46cf3b4-ffb6-4608-a4ad-215417c2244e None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:29.210058 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46cf3b4-ffb6-4608-a4ad-215417c2244e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:29.237134 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-b46cf3b4-ffb6-4608-a4ad-215417c2244e None None] MFA Rules not processed for user `0cc43da5455340c8b257f2b13a7d39a8`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:02:29.238384 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-b46cf3b4-ffb6-4608-a4ad-215417c2244e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:02:29.265085 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:02:29.308802 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4144/8260] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:02:29 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:02:29.314881 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ede9d2-fd74-44af-8c5c-f37175844482 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:29.331828 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ede9d2-fd74-44af-8c5c-f37175844482 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:29.337363 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc50019-c495-4344-a000-0d189d8694a7 tempest-UsersNegativeTest-1569684706 tempest-UsersNegativeTest-1569684706-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cc43da5455340c8b257f2b13a7d39a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80788c3758b8471bbcdab63448e87ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:29.338061 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc50019-c495-4344-a000-0d189d8694a7 tempest-UsersNegativeTest-1569684706 tempest-UsersNegativeTest-1569684706-project-admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:29.338343 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc50019-c495-4344-a000-0d189d8694a7 tempest-UsersNegativeTest-1569684706 tempest-UsersNegativeTest-1569684706-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:29.338623 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc50019-c495-4344-a000-0d189d8694a7 tempest-UsersNegativeTest-1569684706 tempest-UsersNegativeTest-1569684706-project-admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:29.339306 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc50019-c495-4344-a000-0d189d8694a7 tempest-UsersNegativeTest-1569684706 tempest-UsersNegativeTest-1569684706-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:29.341149 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc50019-c495-4344-a000-0d189d8694a7 tempest-UsersNegativeTest-1569684706 tempest-UsersNegativeTest-1569684706-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:29.374566 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4117/8261] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 22:02:29 2022] POST /identity/v3/projects => generated 360 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 22:02:29.378900 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46cf3b4-ffb6-4608-a4ad-215417c2244e None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:29.388809 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46cf3b4-ffb6-4608-a4ad-215417c2244e None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:29.450829 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01c7321-7467-42e7-a0e7-446d272fe4e7 tempest-UsersNegativeTest-1569684706 tempest-UsersNegativeTest-1569684706-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cc43da5455340c8b257f2b13a7d39a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80788c3758b8471bbcdab63448e87ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:29.451434 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01c7321-7467-42e7-a0e7-446d272fe4e7 tempest-UsersNegativeTest-1569684706 tempest-UsersNegativeTest-1569684706-project-admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:29.451724 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01c7321-7467-42e7-a0e7-446d272fe4e7 tempest-UsersNegativeTest-1569684706 tempest-UsersNegativeTest-1569684706-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:29.452002 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01c7321-7467-42e7-a0e7-446d272fe4e7 tempest-UsersNegativeTest-1569684706 tempest-UsersNegativeTest-1569684706-project-admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:29.452705 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01c7321-7467-42e7-a0e7-446d272fe4e7 tempest-UsersNegativeTest-1569684706 tempest-UsersNegativeTest-1569684706-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:29.454615 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01c7321-7467-42e7-a0e7-446d272fe4e7 tempest-UsersNegativeTest-1569684706 tempest-UsersNegativeTest-1569684706-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:29.480198 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4145/8262] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 22:02:29 2022] POST /identity/v3/users => generated 373 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 22:02:29.484431 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc50019-c495-4344-a000-0d189d8694a7 tempest-UsersNegativeTest-1569684706 tempest-UsersNegativeTest-1569684706-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:29.495773 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc50019-c495-4344-a000-0d189d8694a7 tempest-UsersNegativeTest-1569684706 tempest-UsersNegativeTest-1569684706-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:29.501227 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b582d8-0ef9-48c2-88a2-68a9a7b29f0a tempest-UsersNegativeTest-1569684706 tempest-UsersNegativeTest-1569684706-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cc43da5455340c8b257f2b13a7d39a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80788c3758b8471bbcdab63448e87ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:29.501926 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b582d8-0ef9-48c2-88a2-68a9a7b29f0a tempest-UsersNegativeTest-1569684706 tempest-UsersNegativeTest-1569684706-project-admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:29.502231 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b582d8-0ef9-48c2-88a2-68a9a7b29f0a tempest-UsersNegativeTest-1569684706 tempest-UsersNegativeTest-1569684706-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:29.502508 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b582d8-0ef9-48c2-88a2-68a9a7b29f0a tempest-UsersNegativeTest-1569684706 tempest-UsersNegativeTest-1569684706-project-admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:29.503349 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b582d8-0ef9-48c2-88a2-68a9a7b29f0a tempest-UsersNegativeTest-1569684706 tempest-UsersNegativeTest-1569684706-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 22:02:29.503682 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b582d8-0ef9-48c2-88a2-68a9a7b29f0a tempest-UsersNegativeTest-1569684706 tempest-UsersNegativeTest-1569684706-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:29.505715 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b582d8-0ef9-48c2-88a2-68a9a7b29f0a tempest-UsersNegativeTest-1569684706 tempest-UsersNegativeTest-1569684706-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:29.530205 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4118/8263] 10.222.0.17 () {58 vars in 1156 bytes} [Sat Jul 23 22:02:29 2022] GET /identity/v3/users?domain_id=default => generated 5757 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 22:02:29.534714 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01c7321-7467-42e7-a0e7-446d272fe4e7 tempest-UsersNegativeTest-1569684706 tempest-UsersNegativeTest-1569684706-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:29.547129 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01c7321-7467-42e7-a0e7-446d272fe4e7 tempest-UsersNegativeTest-1569684706 tempest-UsersNegativeTest-1569684706-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:29.553415 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784e45ab-7acc-410f-804b-4744a7b6b4ec tempest-UsersNegativeTest-1569684706 tempest-UsersNegativeTest-1569684706-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cc43da5455340c8b257f2b13a7d39a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80788c3758b8471bbcdab63448e87ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:29.554332 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784e45ab-7acc-410f-804b-4744a7b6b4ec tempest-UsersNegativeTest-1569684706 tempest-UsersNegativeTest-1569684706-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:29.554612 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784e45ab-7acc-410f-804b-4744a7b6b4ec tempest-UsersNegativeTest-1569684706 tempest-UsersNegativeTest-1569684706-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:29.554889 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784e45ab-7acc-410f-804b-4744a7b6b4ec tempest-UsersNegativeTest-1569684706 tempest-UsersNegativeTest-1569684706-project-admin] PATH_INFO: `/v3/users/8d6c4f6428014746b1ca26ca2250524b` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:29.571148 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784e45ab-7acc-410f-804b-4744a7b6b4ec tempest-UsersNegativeTest-1569684706 tempest-UsersNegativeTest-1569684706-project-admin] RBAC: Authorizing `identity:update_user(user_id=8d6c4f6428014746b1ca26ca2250524b)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:29.573249 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784e45ab-7acc-410f-804b-4744a7b6b4ec tempest-UsersNegativeTest-1569684706 tempest-UsersNegativeTest-1569684706-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:29.602658 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-784e45ab-7acc-410f-804b-4744a7b6b4ec tempest-UsersNegativeTest-1569684706 tempest-UsersNegativeTest-1569684706-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '8d6c4f6428014746b1ca26ca2250524b'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:29.610736 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-784e45ab-7acc-410f-804b-4744a7b6b4ec tempest-UsersNegativeTest-1569684706 tempest-UsersNegativeTest-1569684706-project-admin] Invalidating the token cache because user 8d6c4f6428014746b1ca26ca2250524b was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 22:02:29.611016 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-784e45ab-7acc-410f-804b-4744a7b6b4ec tempest-UsersNegativeTest-1569684706 tempest-UsersNegativeTest-1569684706-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:29.611981 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-784e45ab-7acc-410f-804b-4744a7b6b4ec tempest-UsersNegativeTest-1569684706 tempest-UsersNegativeTest-1569684706-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:29.614188 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4146/8264] 10.222.0.17 () {60 vars in 1243 bytes} [Sat Jul 23 22:02:29 2022] PATCH /identity/v3/users/8d6c4f6428014746b1ca26ca2250524b => generated 488 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 22:02:29.619034 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db3d6a7-ed3b-4948-846d-8a678e6f9e56 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:29.619500 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db3d6a7-ed3b-4948-846d-8a678e6f9e56 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:29.619621 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db3d6a7-ed3b-4948-846d-8a678e6f9e56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:29.635333 ncdv-master-1 devstack@keystone.service[91547]: WARNING keystone.auth.plugins.core [None req-6db3d6a7-ed3b-4948-846d-8a678e6f9e56 None None] User is disabled: 8d6c4f6428014746b1ca26ca2250524b: AssertionError: User is disabled: 8d6c4f6428014746b1ca26ca2250524b Jul 23 22:02:29.645586 ncdv-master-1 devstack@keystone.service[91547]: WARNING keystone.server.flask.application [None req-6db3d6a7-ed3b-4948-846d-8a678e6f9e56 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.17: keystone.exception.Unauthorized: The request you have made requires authentication. Jul 23 22:02:29.647119 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4119/8265] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:02:29 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 29 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Jul 23 22:02:29.651504 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784e45ab-7acc-410f-804b-4744a7b6b4ec tempest-UsersNegativeTest-1569684706 tempest-UsersNegativeTest-1569684706-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:29.653219 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-784e45ab-7acc-410f-804b-4744a7b6b4ec tempest-UsersNegativeTest-1569684706 tempest-UsersNegativeTest-1569684706-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:02:29.666949 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784e45ab-7acc-410f-804b-4744a7b6b4ec tempest-UsersNegativeTest-1569684706 tempest-UsersNegativeTest-1569684706-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:29.673091 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206d50df-9491-40ef-aea1-458683984403 tempest-UsersNegativeTest-1569684706 tempest-UsersNegativeTest-1569684706-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cc43da5455340c8b257f2b13a7d39a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80788c3758b8471bbcdab63448e87ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:29.674023 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206d50df-9491-40ef-aea1-458683984403 tempest-UsersNegativeTest-1569684706 tempest-UsersNegativeTest-1569684706-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:29.674277 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206d50df-9491-40ef-aea1-458683984403 tempest-UsersNegativeTest-1569684706 tempest-UsersNegativeTest-1569684706-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:29.674580 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206d50df-9491-40ef-aea1-458683984403 tempest-UsersNegativeTest-1569684706 tempest-UsersNegativeTest-1569684706-project-admin] PATH_INFO: `/v3/users/8d6c4f6428014746b1ca26ca2250524b` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:29.689422 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206d50df-9491-40ef-aea1-458683984403 tempest-UsersNegativeTest-1569684706 tempest-UsersNegativeTest-1569684706-project-admin] RBAC: Authorizing `identity:delete_user(user_id=8d6c4f6428014746b1ca26ca2250524b)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:29.691501 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206d50df-9491-40ef-aea1-458683984403 tempest-UsersNegativeTest-1569684706 tempest-UsersNegativeTest-1569684706-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:29.741690 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-206d50df-9491-40ef-aea1-458683984403 tempest-UsersNegativeTest-1569684706 tempest-UsersNegativeTest-1569684706-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d6c4f6428014746b1ca26ca2250524b'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:29.742591 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-206d50df-9491-40ef-aea1-458683984403 tempest-UsersNegativeTest-1569684706 tempest-UsersNegativeTest-1569684706-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d6c4f6428014746b1ca26ca2250524b'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:29.752002 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-206d50df-9491-40ef-aea1-458683984403 tempest-UsersNegativeTest-1569684706 tempest-UsersNegativeTest-1569684706-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d6c4f6428014746b1ca26ca2250524b'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:29.754160 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=87,keystone:INSERT=4,keystone:UPDATE=1,keystone:DELETE=8 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:02:29.760940 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-206d50df-9491-40ef-aea1-458683984403 tempest-UsersNegativeTest-1569684706 tempest-UsersNegativeTest-1569684706-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d6c4f6428014746b1ca26ca2250524b'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:29.774863 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-206d50df-9491-40ef-aea1-458683984403 tempest-UsersNegativeTest-1569684706 tempest-UsersNegativeTest-1569684706-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d6c4f6428014746b1ca26ca2250524b'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:29.780785 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4147/8266] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 22:02:29 2022] DELETE /identity/v3/users/8d6c4f6428014746b1ca26ca2250524b => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:02:29.785012 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db3d6a7-ed3b-4948-846d-8a678e6f9e56 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:29.786929 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-6db3d6a7-ed3b-4948-846d-8a678e6f9e56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:02:29.835525 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:02:29.859106 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db3d6a7-ed3b-4948-846d-8a678e6f9e56 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:29.864664 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4019a6e-06a5-4b56-8707-e6b96466ba62 tempest-UsersNegativeTest-1569684706 tempest-UsersNegativeTest-1569684706-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cc43da5455340c8b257f2b13a7d39a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80788c3758b8471bbcdab63448e87ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:29.865555 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4019a6e-06a5-4b56-8707-e6b96466ba62 tempest-UsersNegativeTest-1569684706 tempest-UsersNegativeTest-1569684706-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:29.865841 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4019a6e-06a5-4b56-8707-e6b96466ba62 tempest-UsersNegativeTest-1569684706 tempest-UsersNegativeTest-1569684706-project-admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:29.866145 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4019a6e-06a5-4b56-8707-e6b96466ba62 tempest-UsersNegativeTest-1569684706 tempest-UsersNegativeTest-1569684706-project-admin] PATH_INFO: `/v3/projects/2179522cc317487e8c7ef6c423664b9a` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:29.867386 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4019a6e-06a5-4b56-8707-e6b96466ba62 tempest-UsersNegativeTest-1569684706 tempest-UsersNegativeTest-1569684706-project-admin] RBAC: Authorizing `identity:delete_project(project_id=2179522cc317487e8c7ef6c423664b9a)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:29.869317 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4019a6e-06a5-4b56-8707-e6b96466ba62 tempest-UsersNegativeTest-1569684706 tempest-UsersNegativeTest-1569684706-project-admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:29.917893 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-c4019a6e-06a5-4b56-8707-e6b96466ba62 tempest-UsersNegativeTest-1569684706 tempest-UsersNegativeTest-1569684706-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2179522cc317487e8c7ef6c423664b9a', 'request_id': 'req-c4019a6e-06a5-4b56-8707-e6b96466ba62'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:29.927185 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-c4019a6e-06a5-4b56-8707-e6b96466ba62 tempest-UsersNegativeTest-1569684706 tempest-UsersNegativeTest-1569684706-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2179522cc317487e8c7ef6c423664b9a', 'request_id': 'req-c4019a6e-06a5-4b56-8707-e6b96466ba62'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:29.933167 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-c4019a6e-06a5-4b56-8707-e6b96466ba62 tempest-UsersNegativeTest-1569684706 tempest-UsersNegativeTest-1569684706-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2179522cc317487e8c7ef6c423664b9a', 'request_id': 'req-c4019a6e-06a5-4b56-8707-e6b96466ba62'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:29.944198 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-c4019a6e-06a5-4b56-8707-e6b96466ba62 tempest-UsersNegativeTest-1569684706 tempest-UsersNegativeTest-1569684706-project-admin] The token cache is being invalidate because project 2179522cc317487e8c7ef6c423664b9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 22:02:29.944485 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-c4019a6e-06a5-4b56-8707-e6b96466ba62 tempest-UsersNegativeTest-1569684706 tempest-UsersNegativeTest-1569684706-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:29.945229 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-c4019a6e-06a5-4b56-8707-e6b96466ba62 tempest-UsersNegativeTest-1569684706 tempest-UsersNegativeTest-1569684706-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:29.946917 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4120/8267] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 22:02:29 2022] DELETE /identity/v3/projects/2179522cc317487e8c7ef6c423664b9a => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:02:29.952699 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206d50df-9491-40ef-aea1-458683984403 tempest-UsersNegativeTest-1569684706 tempest-UsersNegativeTest-1569684706-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:29.963272 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206d50df-9491-40ef-aea1-458683984403 tempest-UsersNegativeTest-1569684706 tempest-UsersNegativeTest-1569684706-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:30.022929 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848eeebe-c446-4205-a1cb-754af4cbd309 tempest-UsersNegativeTest-1569684706 tempest-UsersNegativeTest-1569684706-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cc43da5455340c8b257f2b13a7d39a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80788c3758b8471bbcdab63448e87ab0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:30.023632 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848eeebe-c446-4205-a1cb-754af4cbd309 tempest-UsersNegativeTest-1569684706 tempest-UsersNegativeTest-1569684706-project-admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:30.023922 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848eeebe-c446-4205-a1cb-754af4cbd309 tempest-UsersNegativeTest-1569684706 tempest-UsersNegativeTest-1569684706-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:30.024181 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848eeebe-c446-4205-a1cb-754af4cbd309 tempest-UsersNegativeTest-1569684706 tempest-UsersNegativeTest-1569684706-project-admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:30.024887 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848eeebe-c446-4205-a1cb-754af4cbd309 tempest-UsersNegativeTest-1569684706 tempest-UsersNegativeTest-1569684706-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:30.026944 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848eeebe-c446-4205-a1cb-754af4cbd309 tempest-UsersNegativeTest-1569684706 tempest-UsersNegativeTest-1569684706-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:30.039409 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application [None req-848eeebe-c446-4205-a1cb-754af4cbd309 tempest-UsersNegativeTest-1569684706 tempest-UsersNegativeTest-1569684706-project-admin] Could not find domain: b876b72eeb144fbd885cb4195c91071d.: keystone.exception.DomainNotFound: Could not find domain: b876b72eeb144fbd885cb4195c91071d. Jul 23 22:02:30.039409 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 22:02:30.039409 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 23 22:02:30.039409 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 23 22:02:30.039409 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 23 22:02:30.039409 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 23 22:02:30.039409 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 23 22:02:30.039409 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 23 22:02:30.039409 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: b876b72eeb144fbd885cb4195c91071d. Jul 23 22:02:30.039409 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 22:02:30.039409 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 23 22:02:30.039409 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 22:02:30.039409 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 23 22:02:30.039409 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 23 22:02:30.039409 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 23 22:02:30.040636 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 23 22:02:30.040636 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 23 22:02:30.040636 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 23 22:02:30.040636 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 23 22:02:30.040636 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 23 22:02:30.040636 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 23 22:02:30.040636 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 23 22:02:30.040636 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 23 22:02:30.040636 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 23 22:02:30.040636 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 23 22:02:30.040636 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 22:02:30.040636 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 22:02:30.040636 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 23 22:02:30.040636 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 23 22:02:30.040636 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 23 22:02:30.040636 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 23 22:02:30.040636 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 987, in create_user Jul 23 22:02:30.041901 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application PROVIDERS.resource_api.get_domain(domain_id) Jul 23 22:02:30.041901 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 23 22:02:30.041901 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 23 22:02:30.041901 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 23 22:02:30.041901 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 23 22:02:30.041901 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 23 22:02:30.041901 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.get_or_create( Jul 23 22:02:30.041901 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 23 22:02:30.041901 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application with Lock( Jul 23 22:02:30.041901 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 23 22:02:30.041901 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self._enter() Jul 23 22:02:30.041901 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 23 22:02:30.041901 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 23 22:02:30.041901 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 23 22:02:30.041901 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application return self.creator() Jul 23 22:02:30.041901 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 23 22:02:30.041901 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application created_value = creator( Jul 23 22:02:30.043190 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 23 22:02:30.043190 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 23 22:02:30.043190 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: b876b72eeb144fbd885cb4195c91071d. Jul 23 22:02:30.043190 ncdv-master-1 devstack@keystone.service[91548]: ERROR keystone.server.flask.application Jul 23 22:02:30.043190 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4148/8268] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 22:02:29 2022] POST /identity/v3/users => generated 112 bytes in 88 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Jul 23 22:02:30.045492 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4019a6e-06a5-4b56-8707-e6b96466ba62 tempest-UsersNegativeTest-1569684706 tempest-UsersNegativeTest-1569684706-project-admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:30.046948 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-c4019a6e-06a5-4b56-8707-e6b96466ba62 tempest-UsersNegativeTest-1569684706 tempest-UsersNegativeTest-1569684706-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:02:30.114223 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4019a6e-06a5-4b56-8707-e6b96466ba62 tempest-UsersNegativeTest-1569684706 tempest-UsersNegativeTest-1569684706-project-admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:30.119736 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153e5fe9-845f-45a4-8248-79e2f9b852c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:30.120622 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153e5fe9-845f-45a4-8248-79e2f9b852c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:30.120906 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153e5fe9-845f-45a4-8248-79e2f9b852c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:30.121180 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153e5fe9-845f-45a4-8248-79e2f9b852c2 admin admin] PATH_INFO: `/v3/users/dc8fe38fd2d14883ac013fe162d7d597` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:30.122546 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153e5fe9-845f-45a4-8248-79e2f9b852c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc8fe38fd2d14883ac013fe162d7d597)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:30.124513 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153e5fe9-845f-45a4-8248-79e2f9b852c2 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:30.173233 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-153e5fe9-845f-45a4-8248-79e2f9b852c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc8fe38fd2d14883ac013fe162d7d597'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:30.180402 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-153e5fe9-845f-45a4-8248-79e2f9b852c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc8fe38fd2d14883ac013fe162d7d597'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:30.181076 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-153e5fe9-845f-45a4-8248-79e2f9b852c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc8fe38fd2d14883ac013fe162d7d597'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:30.189172 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-153e5fe9-845f-45a4-8248-79e2f9b852c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc8fe38fd2d14883ac013fe162d7d597'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:30.200220 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:02:30.202720 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-153e5fe9-845f-45a4-8248-79e2f9b852c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc8fe38fd2d14883ac013fe162d7d597'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:30.210351 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4121/8269] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 22:02:30 2022] DELETE /identity/v3/users/dc8fe38fd2d14883ac013fe162d7d597 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:02:30.215113 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feb2fd2-6662-4b26-b5eb-5f7bba102f41 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:30.215588 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feb2fd2-6662-4b26-b5eb-5f7bba102f41 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:30.215689 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feb2fd2-6662-4b26-b5eb-5f7bba102f41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:30.235082 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-2feb2fd2-6662-4b26-b5eb-5f7bba102f41 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:02:30.236290 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-2feb2fd2-6662-4b26-b5eb-5f7bba102f41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:02:30.297259 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4149/8270] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:02:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:02:30.307815 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153e5fe9-845f-45a4-8248-79e2f9b852c2 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:30.309399 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-153e5fe9-845f-45a4-8248-79e2f9b852c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:02:30.368122 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153e5fe9-845f-45a4-8248-79e2f9b852c2 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:30.372497 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e521ed-c28e-408c-85c4-b8ddc72f16dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:30.373160 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e521ed-c28e-408c-85c4-b8ddc72f16dd service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:30.373455 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e521ed-c28e-408c-85c4-b8ddc72f16dd service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:30.373769 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e521ed-c28e-408c-85c4-b8ddc72f16dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:30.383963 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e521ed-c28e-408c-85c4-b8ddc72f16dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:30.385461 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e521ed-c28e-408c-85c4-b8ddc72f16dd service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:30.395705 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4122/8271] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:02:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:02:30.677542 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2feb2fd2-6662-4b26-b5eb-5f7bba102f41 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:30.679224 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-2feb2fd2-6662-4b26-b5eb-5f7bba102f41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:02:30.693053 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2feb2fd2-6662-4b26-b5eb-5f7bba102f41 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:30.698554 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a6ba88-f38d-428b-9762-e4782f47bb7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:30.699538 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a6ba88-f38d-428b-9762-e4782f47bb7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:30.699894 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a6ba88-f38d-428b-9762-e4782f47bb7e admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:30.700231 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a6ba88-f38d-428b-9762-e4782f47bb7e admin admin] PATH_INFO: `/v3/projects/12603811cc96477d8ba246dc6f9736e7` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:30.701706 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a6ba88-f38d-428b-9762-e4782f47bb7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=12603811cc96477d8ba246dc6f9736e7)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:30.703990 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a6ba88-f38d-428b-9762-e4782f47bb7e admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:30.753108 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-11a6ba88-f38d-428b-9762-e4782f47bb7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12603811cc96477d8ba246dc6f9736e7', 'request_id': 'req-11a6ba88-f38d-428b-9762-e4782f47bb7e'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:30.761968 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-11a6ba88-f38d-428b-9762-e4782f47bb7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12603811cc96477d8ba246dc6f9736e7', 'request_id': 'req-11a6ba88-f38d-428b-9762-e4782f47bb7e'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:30.767891 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-11a6ba88-f38d-428b-9762-e4782f47bb7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12603811cc96477d8ba246dc6f9736e7', 'request_id': 'req-11a6ba88-f38d-428b-9762-e4782f47bb7e'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:30.769828 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:INSERT=2,keystone:DELETE=10,keystone:SELECT=88 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:02:30.781541 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-11a6ba88-f38d-428b-9762-e4782f47bb7e admin admin] The token cache is being invalidate because project 12603811cc96477d8ba246dc6f9736e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 22:02:30.781825 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-11a6ba88-f38d-428b-9762-e4782f47bb7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:30.782492 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-11a6ba88-f38d-428b-9762-e4782f47bb7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:30.784126 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4150/8272] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 22:02:30 2022] DELETE /identity/v3/projects/12603811cc96477d8ba246dc6f9736e7 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:02:30.788223 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e521ed-c28e-408c-85c4-b8ddc72f16dd service neutron] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:30.798464 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e521ed-c28e-408c-85c4-b8ddc72f16dd service neutron] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:30.862573 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9a8f1b-fdc7-4afd-b635-558fdb622878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:30.863469 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9a8f1b-fdc7-4afd-b635-558fdb622878 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:30.863744 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9a8f1b-fdc7-4afd-b635-558fdb622878 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:30.864014 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9a8f1b-fdc7-4afd-b635-558fdb622878 admin admin] PATH_INFO: `/v3/users/0cc43da5455340c8b257f2b13a7d39a8` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:30.865247 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9a8f1b-fdc7-4afd-b635-558fdb622878 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0cc43da5455340c8b257f2b13a7d39a8)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:30.867239 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9a8f1b-fdc7-4afd-b635-558fdb622878 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:30.921944 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-9b9a8f1b-fdc7-4afd-b635-558fdb622878 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0cc43da5455340c8b257f2b13a7d39a8'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:30.930295 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-9b9a8f1b-fdc7-4afd-b635-558fdb622878 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0cc43da5455340c8b257f2b13a7d39a8'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:30.930962 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-9b9a8f1b-fdc7-4afd-b635-558fdb622878 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0cc43da5455340c8b257f2b13a7d39a8'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:30.939738 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-9b9a8f1b-fdc7-4afd-b635-558fdb622878 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0cc43da5455340c8b257f2b13a7d39a8'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:30.952872 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-9b9a8f1b-fdc7-4afd-b635-558fdb622878 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0cc43da5455340c8b257f2b13a7d39a8'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:30.959075 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4123/8273] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 22:02:30 2022] DELETE /identity/v3/users/0cc43da5455340c8b257f2b13a7d39a8 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 22:02:31.242762 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a6ba88-f38d-428b-9762-e4782f47bb7e admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:31.244392 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-11a6ba88-f38d-428b-9762-e4782f47bb7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:02:31.259807 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a6ba88-f38d-428b-9762-e4782f47bb7e admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:31.321130 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b375a33c-cf3f-4d66-a362-837761ecbafa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:31.322048 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b375a33c-cf3f-4d66-a362-837761ecbafa admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:31.322330 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b375a33c-cf3f-4d66-a362-837761ecbafa admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:31.322601 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b375a33c-cf3f-4d66-a362-837761ecbafa admin admin] PATH_INFO: `/v3/projects/80788c3758b8471bbcdab63448e87ab0` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:31.323844 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b375a33c-cf3f-4d66-a362-837761ecbafa admin admin] RBAC: Authorizing `identity:delete_project(project_id=80788c3758b8471bbcdab63448e87ab0)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:31.325768 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b375a33c-cf3f-4d66-a362-837761ecbafa admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:31.379560 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-b375a33c-cf3f-4d66-a362-837761ecbafa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80788c3758b8471bbcdab63448e87ab0', 'request_id': 'req-b375a33c-cf3f-4d66-a362-837761ecbafa'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:31.389411 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-b375a33c-cf3f-4d66-a362-837761ecbafa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80788c3758b8471bbcdab63448e87ab0', 'request_id': 'req-b375a33c-cf3f-4d66-a362-837761ecbafa'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:31.395737 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-b375a33c-cf3f-4d66-a362-837761ecbafa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80788c3758b8471bbcdab63448e87ab0', 'request_id': 'req-b375a33c-cf3f-4d66-a362-837761ecbafa'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:31.407625 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-b375a33c-cf3f-4d66-a362-837761ecbafa admin admin] The token cache is being invalidate because project 80788c3758b8471bbcdab63448e87ab0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 22:02:31.407905 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-b375a33c-cf3f-4d66-a362-837761ecbafa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:31.408597 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-b375a33c-cf3f-4d66-a362-837761ecbafa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:31.410323 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4151/8274] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 22:02:31 2022] DELETE /identity/v3/projects/80788c3758b8471bbcdab63448e87ab0 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:02:31.417241 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e25bc78-47f4-4639-a714-93d6fccbe095 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:31.417533 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e25bc78-47f4-4639-a714-93d6fccbe095 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:31.417810 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e25bc78-47f4-4639-a714-93d6fccbe095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:31.436559 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-3e25bc78-47f4-4639-a714-93d6fccbe095 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:02:31.437893 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-3e25bc78-47f4-4639-a714-93d6fccbe095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:02:31.448512 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:02:31.502690 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4124/8275] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:02:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:02:31.510920 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d671c823-0c3a-4b72-96ef-75a92ce4afd8 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:31.511206 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d671c823-0c3a-4b72-96ef-75a92ce4afd8 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:31.511512 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d671c823-0c3a-4b72-96ef-75a92ce4afd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:31.530884 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-d671c823-0c3a-4b72-96ef-75a92ce4afd8 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:02:31.532098 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-d671c823-0c3a-4b72-96ef-75a92ce4afd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:02:31.540754 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4152/8276] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:02:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:02:31.545193 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e25bc78-47f4-4639-a714-93d6fccbe095 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:31.556262 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e25bc78-47f4-4639-a714-93d6fccbe095 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:31.561604 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee5ebf0-dd09-4dff-ab6e-2b5293d235e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:31.562311 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee5ebf0-dd09-4dff-ab6e-2b5293d235e2 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:31.562596 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee5ebf0-dd09-4dff-ab6e-2b5293d235e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:31.562872 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee5ebf0-dd09-4dff-ab6e-2b5293d235e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:31.563628 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee5ebf0-dd09-4dff-ab6e-2b5293d235e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 22:02:31.563922 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee5ebf0-dd09-4dff-ab6e-2b5293d235e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:31.565568 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee5ebf0-dd09-4dff-ab6e-2b5293d235e2 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:31.577799 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4125/8277] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 22:02:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 22:02:31.582852 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d671c823-0c3a-4b72-96ef-75a92ce4afd8 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:31.597465 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d671c823-0c3a-4b72-96ef-75a92ce4afd8 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:31.605604 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea0c770-f59e-41bb-a453-f2d9cfc401d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:31.606562 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea0c770-f59e-41bb-a453-f2d9cfc401d3 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:31.606848 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea0c770-f59e-41bb-a453-f2d9cfc401d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:31.607173 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea0c770-f59e-41bb-a453-f2d9cfc401d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:31.608176 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea0c770-f59e-41bb-a453-f2d9cfc401d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:31.611093 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea0c770-f59e-41bb-a453-f2d9cfc401d3 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:31.640182 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4153/8278] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 22:02:31 2022] POST /identity/v3/projects => generated 395 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 22:02:31.644469 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee5ebf0-dd09-4dff-ab6e-2b5293d235e2 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:31.655216 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee5ebf0-dd09-4dff-ab6e-2b5293d235e2 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:31.715445 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8667e6-28c4-4eb0-9a97-645fbe17432e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:31.716126 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8667e6-28c4-4eb0-9a97-645fbe17432e admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:31.716419 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8667e6-28c4-4eb0-9a97-645fbe17432e admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:31.716687 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8667e6-28c4-4eb0-9a97-645fbe17432e admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:31.717748 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8667e6-28c4-4eb0-9a97-645fbe17432e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:31.719813 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8667e6-28c4-4eb0-9a97-645fbe17432e admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:31.741487 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4126/8279] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 22:02:31 2022] POST /identity/v3/users => generated 304 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 22:02:31.745692 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea0c770-f59e-41bb-a453-f2d9cfc401d3 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:31.757025 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea0c770-f59e-41bb-a453-f2d9cfc401d3 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:31.762396 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5863389a-6f19-4eff-8c46-64d1401e00ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:31.763057 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5863389a-6f19-4eff-8c46-64d1401e00ac admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:31.763333 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5863389a-6f19-4eff-8c46-64d1401e00ac admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:31.763599 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5863389a-6f19-4eff-8c46-64d1401e00ac admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:31.764321 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5863389a-6f19-4eff-8c46-64d1401e00ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:31.765930 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5863389a-6f19-4eff-8c46-64d1401e00ac admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:31.778105 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4154/8280] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 22:02:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 22:02:31.782464 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8667e6-28c4-4eb0-9a97-645fbe17432e admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:31.793339 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8667e6-28c4-4eb0-9a97-645fbe17432e admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:31.798790 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381b28e2-47aa-4391-a9bb-6f3fbc9a66c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:31.799673 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381b28e2-47aa-4391-a9bb-6f3fbc9a66c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:31.800059 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381b28e2-47aa-4391-a9bb-6f3fbc9a66c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:31.800338 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381b28e2-47aa-4391-a9bb-6f3fbc9a66c7 admin admin] PATH_INFO: `/v3/projects/e54ce173dd7b49eda1c1d2d92e54ced9/users/868060ce08904f609517802a02bfe0ec/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:31.815946 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381b28e2-47aa-4391-a9bb-6f3fbc9a66c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e54ce173dd7b49eda1c1d2d92e54ced9, user_id=868060ce08904f609517802a02bfe0ec, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:31.818657 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381b28e2-47aa-4391-a9bb-6f3fbc9a66c7 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:31.834115 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4127/8281] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 22:02:31 2022] PUT /identity/v3/projects/e54ce173dd7b49eda1c1d2d92e54ced9/users/868060ce08904f609517802a02bfe0ec/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:02:31.838240 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5863389a-6f19-4eff-8c46-64d1401e00ac admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:31.849232 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5863389a-6f19-4eff-8c46-64d1401e00ac admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:31.895283 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:02:31.909817 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a557ba75-cb73-4894-a137-ade331e794c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:31.910519 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a557ba75-cb73-4894-a137-ade331e794c0 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:31.910802 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a557ba75-cb73-4894-a137-ade331e794c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:31.911074 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a557ba75-cb73-4894-a137-ade331e794c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:31.911789 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a557ba75-cb73-4894-a137-ade331e794c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:31.913374 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a557ba75-cb73-4894-a137-ade331e794c0 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:31.923749 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4155/8282] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 22:02:31 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 22:02:31.928295 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381b28e2-47aa-4391-a9bb-6f3fbc9a66c7 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:31.939477 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381b28e2-47aa-4391-a9bb-6f3fbc9a66c7 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:31.945775 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0d8a4c-d87b-4b4b-929d-c806784541e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:31.946684 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0d8a4c-d87b-4b4b-929d-c806784541e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:31.946957 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0d8a4c-d87b-4b4b-929d-c806784541e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:31.947223 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0d8a4c-d87b-4b4b-929d-c806784541e7 admin admin] PATH_INFO: `/v3/projects/e54ce173dd7b49eda1c1d2d92e54ced9/users/868060ce08904f609517802a02bfe0ec/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:31.949519 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0d8a4c-d87b-4b4b-929d-c806784541e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e54ce173dd7b49eda1c1d2d92e54ced9, user_id=868060ce08904f609517802a02bfe0ec, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:31.952246 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0d8a4c-d87b-4b4b-929d-c806784541e7 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:31.966082 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4128/8283] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 22:02:31 2022] PUT /identity/v3/projects/e54ce173dd7b49eda1c1d2d92e54ced9/users/868060ce08904f609517802a02bfe0ec/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:02:31.978108 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab8a0c1-0fb1-4bca-a098-3b0a91cd83c8 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:31.978429 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab8a0c1-0fb1-4bca-a098-3b0a91cd83c8 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:31.978703 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab8a0c1-0fb1-4bca-a098-3b0a91cd83c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:32.006993 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-5ab8a0c1-0fb1-4bca-a098-3b0a91cd83c8 None None] MFA Rules not processed for user `868060ce08904f609517802a02bfe0ec`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:02:32.008234 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-5ab8a0c1-0fb1-4bca-a098-3b0a91cd83c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:02:32.093296 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4156/8284] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:02:31 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:02:32.099164 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0d8a4c-d87b-4b4b-929d-c806784541e7 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:32.157756 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:02:32.164652 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0d8a4c-d87b-4b4b-929d-c806784541e7 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:32.171937 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c133e445-d522-481f-9641-5368c0e20516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:32.172608 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c133e445-d522-481f-9641-5368c0e20516 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:32.172895 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c133e445-d522-481f-9641-5368c0e20516 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:32.173166 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c133e445-d522-481f-9641-5368c0e20516 admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:32.173847 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c133e445-d522-481f-9641-5368c0e20516 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:32.175850 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c133e445-d522-481f-9641-5368c0e20516 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:32.205561 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4129/8285] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 22:02:32 2022] POST /identity/v3/projects => generated 395 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 22:02:32.209970 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab8a0c1-0fb1-4bca-a098-3b0a91cd83c8 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:32.221046 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab8a0c1-0fb1-4bca-a098-3b0a91cd83c8 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:32.288927 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b436b13b-df19-4903-9110-4cd925cb7ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:32.289783 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b436b13b-df19-4903-9110-4cd925cb7ce2 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:32.290175 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b436b13b-df19-4903-9110-4cd925cb7ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:32.290619 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b436b13b-df19-4903-9110-4cd925cb7ce2 admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:32.291784 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b436b13b-df19-4903-9110-4cd925cb7ce2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:32.295012 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b436b13b-df19-4903-9110-4cd925cb7ce2 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:32.321959 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4157/8286] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 22:02:32 2022] POST /identity/v3/users => generated 298 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 22:02:32.323909 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c133e445-d522-481f-9641-5368c0e20516 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:32.337381 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c133e445-d522-481f-9641-5368c0e20516 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:32.343474 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d707b72-de0e-4528-9453-b8067138d86a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:32.344157 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d707b72-de0e-4528-9453-b8067138d86a admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:32.344425 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d707b72-de0e-4528-9453-b8067138d86a admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:32.344698 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d707b72-de0e-4528-9453-b8067138d86a admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:32.345429 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d707b72-de0e-4528-9453-b8067138d86a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:32.347075 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d707b72-de0e-4528-9453-b8067138d86a admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:32.357896 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4130/8287] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 22:02:32 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 22:02:32.362086 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b436b13b-df19-4903-9110-4cd925cb7ce2 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:32.373034 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b436b13b-df19-4903-9110-4cd925cb7ce2 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:32.378817 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec029790-3b08-4cbd-8b32-66ebc023c131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:32.379494 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec029790-3b08-4cbd-8b32-66ebc023c131 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:32.379781 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec029790-3b08-4cbd-8b32-66ebc023c131 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:32.380058 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec029790-3b08-4cbd-8b32-66ebc023c131 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:32.380786 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec029790-3b08-4cbd-8b32-66ebc023c131 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:32.382424 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec029790-3b08-4cbd-8b32-66ebc023c131 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:32.392846 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4158/8288] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 22:02:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 22:02:32.397227 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d707b72-de0e-4528-9453-b8067138d86a admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:32.408176 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d707b72-de0e-4528-9453-b8067138d86a admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:32.413921 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891f28ba-4381-4981-95bb-2a9035c4983b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:32.414826 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891f28ba-4381-4981-95bb-2a9035c4983b admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:32.415105 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891f28ba-4381-4981-95bb-2a9035c4983b admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:32.415381 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891f28ba-4381-4981-95bb-2a9035c4983b admin admin] PATH_INFO: `/v3/projects/de2c6c11290242b1883de85405188697/users/cc8300a3b7c74773ac6dec9a1457fb8f/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:32.431805 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891f28ba-4381-4981-95bb-2a9035c4983b admin admin] RBAC: Authorizing `identity:create_grant(project_id=de2c6c11290242b1883de85405188697, user_id=cc8300a3b7c74773ac6dec9a1457fb8f, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:32.434530 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891f28ba-4381-4981-95bb-2a9035c4983b admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:32.449443 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4131/8289] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 22:02:32 2022] PUT /identity/v3/projects/de2c6c11290242b1883de85405188697/users/cc8300a3b7c74773ac6dec9a1457fb8f/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:02:32.460127 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85968720-a378-44e4-8cc3-112892d891f0 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:32.460415 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85968720-a378-44e4-8cc3-112892d891f0 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:32.460695 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85968720-a378-44e4-8cc3-112892d891f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:32.490141 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-85968720-a378-44e4-8cc3-112892d891f0 None None] MFA Rules not processed for user `cc8300a3b7c74773ac6dec9a1457fb8f`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:02:32.491738 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-85968720-a378-44e4-8cc3-112892d891f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:02:32.527413 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:02:32.564675 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4159/8290] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:02:32 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:02:32.576883 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891f28ba-4381-4981-95bb-2a9035c4983b admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:32.579029 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-891f28ba-4381-4981-95bb-2a9035c4983b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:02:32.655246 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891f28ba-4381-4981-95bb-2a9035c4983b admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:32.660064 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa19b35e-7a98-410f-8435-e9e2d24f19d3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7f2db148c8e4d5d81431cae3576434b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:32.660649 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa19b35e-7a98-410f-8435-e9e2d24f19d3 service glance] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:32.660934 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa19b35e-7a98-410f-8435-e9e2d24f19d3 service glance] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:32.661206 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa19b35e-7a98-410f-8435-e9e2d24f19d3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:32.726868 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa19b35e-7a98-410f-8435-e9e2d24f19d3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:32.728331 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa19b35e-7a98-410f-8435-e9e2d24f19d3 service glance] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:32.738269 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4132/8291] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:02:32 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:02:33.076573 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85968720-a378-44e4-8cc3-112892d891f0 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:33.142471 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85968720-a378-44e4-8cc3-112892d891f0 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:33.147441 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dce75e-03da-4a6a-8f5a-7b9495476120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:33.148323 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dce75e-03da-4a6a-8f5a-7b9495476120 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:33.148600 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dce75e-03da-4a6a-8f5a-7b9495476120 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:33.148870 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dce75e-03da-4a6a-8f5a-7b9495476120 admin admin] PATH_INFO: `/v3/users/868060ce08904f609517802a02bfe0ec` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:33.150066 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dce75e-03da-4a6a-8f5a-7b9495476120 admin admin] RBAC: Authorizing `identity:delete_user(user_id=868060ce08904f609517802a02bfe0ec)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:33.152033 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dce75e-03da-4a6a-8f5a-7b9495476120 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:33.203062 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-b9dce75e-03da-4a6a-8f5a-7b9495476120 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '868060ce08904f609517802a02bfe0ec'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:33.203628 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-b9dce75e-03da-4a6a-8f5a-7b9495476120 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '868060ce08904f609517802a02bfe0ec'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:33.211057 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-b9dce75e-03da-4a6a-8f5a-7b9495476120 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '868060ce08904f609517802a02bfe0ec'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:33.220225 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-b9dce75e-03da-4a6a-8f5a-7b9495476120 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '868060ce08904f609517802a02bfe0ec'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:33.232595 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-b9dce75e-03da-4a6a-8f5a-7b9495476120 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '868060ce08904f609517802a02bfe0ec'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:33.238632 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4160/8292] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 22:02:33 2022] DELETE /identity/v3/users/868060ce08904f609517802a02bfe0ec => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:02:33.243340 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5faaeb-9b42-4899-b1a4-8a1411f08310 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:33.243849 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5faaeb-9b42-4899-b1a4-8a1411f08310 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:33.244017 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5faaeb-9b42-4899-b1a4-8a1411f08310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:33.261792 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-cc5faaeb-9b42-4899-b1a4-8a1411f08310 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:02:33.263031 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-cc5faaeb-9b42-4899-b1a4-8a1411f08310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:02:33.307278 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:02:33.328109 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4133/8293] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:02:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:02:33.339641 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dce75e-03da-4a6a-8f5a-7b9495476120 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:33.341181 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-b9dce75e-03da-4a6a-8f5a-7b9495476120 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:02:33.402826 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dce75e-03da-4a6a-8f5a-7b9495476120 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:33.406948 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3cdd1f-be05-452e-a003-f701f23ced82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:33.407601 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3cdd1f-be05-452e-a003-f701f23ced82 service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:33.407886 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3cdd1f-be05-452e-a003-f701f23ced82 service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:33.408186 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3cdd1f-be05-452e-a003-f701f23ced82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:33.418272 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3cdd1f-be05-452e-a003-f701f23ced82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:33.419714 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3cdd1f-be05-452e-a003-f701f23ced82 service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:33.423767 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:02:33.431045 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4161/8294] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:02:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:02:33.710434 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5faaeb-9b42-4899-b1a4-8a1411f08310 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:33.712064 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-cc5faaeb-9b42-4899-b1a4-8a1411f08310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:02:33.725265 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5faaeb-9b42-4899-b1a4-8a1411f08310 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:33.730548 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76b2bc6-4ecb-466c-a92f-c6093ec9e5ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:33.731452 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76b2bc6-4ecb-466c-a92f-c6093ec9e5ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:33.731731 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76b2bc6-4ecb-466c-a92f-c6093ec9e5ba admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:33.732009 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76b2bc6-4ecb-466c-a92f-c6093ec9e5ba admin admin] PATH_INFO: `/v3/projects/e54ce173dd7b49eda1c1d2d92e54ced9` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:33.733258 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76b2bc6-4ecb-466c-a92f-c6093ec9e5ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=e54ce173dd7b49eda1c1d2d92e54ced9)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:33.735188 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76b2bc6-4ecb-466c-a92f-c6093ec9e5ba admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:33.785025 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-b76b2bc6-4ecb-466c-a92f-c6093ec9e5ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e54ce173dd7b49eda1c1d2d92e54ced9', 'request_id': 'req-b76b2bc6-4ecb-466c-a92f-c6093ec9e5ba'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:33.792743 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-b76b2bc6-4ecb-466c-a92f-c6093ec9e5ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e54ce173dd7b49eda1c1d2d92e54ced9', 'request_id': 'req-b76b2bc6-4ecb-466c-a92f-c6093ec9e5ba'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:33.798476 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-b76b2bc6-4ecb-466c-a92f-c6093ec9e5ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e54ce173dd7b49eda1c1d2d92e54ced9', 'request_id': 'req-b76b2bc6-4ecb-466c-a92f-c6093ec9e5ba'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:33.809477 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-b76b2bc6-4ecb-466c-a92f-c6093ec9e5ba admin admin] The token cache is being invalidate because project e54ce173dd7b49eda1c1d2d92e54ced9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 22:02:33.809770 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-b76b2bc6-4ecb-466c-a92f-c6093ec9e5ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:33.810438 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-b76b2bc6-4ecb-466c-a92f-c6093ec9e5ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:33.812040 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4134/8295] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 22:02:33 2022] DELETE /identity/v3/projects/e54ce173dd7b49eda1c1d2d92e54ced9 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:02:33.816252 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3cdd1f-be05-452e-a003-f701f23ced82 service neutron] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:33.826709 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3cdd1f-be05-452e-a003-f701f23ced82 service neutron] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:33.888281 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d260ae-f2a0-42d1-88f3-a6206dc04bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:33.889179 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d260ae-f2a0-42d1-88f3-a6206dc04bd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:33.889469 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d260ae-f2a0-42d1-88f3-a6206dc04bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:33.889737 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d260ae-f2a0-42d1-88f3-a6206dc04bd2 admin admin] PATH_INFO: `/v3/users/cc8300a3b7c74773ac6dec9a1457fb8f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:33.891011 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d260ae-f2a0-42d1-88f3-a6206dc04bd2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc8300a3b7c74773ac6dec9a1457fb8f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:33.892979 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d260ae-f2a0-42d1-88f3-a6206dc04bd2 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:33.945162 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-72d260ae-f2a0-42d1-88f3-a6206dc04bd2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc8300a3b7c74773ac6dec9a1457fb8f'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:33.945837 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-72d260ae-f2a0-42d1-88f3-a6206dc04bd2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc8300a3b7c74773ac6dec9a1457fb8f'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:33.953361 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-72d260ae-f2a0-42d1-88f3-a6206dc04bd2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc8300a3b7c74773ac6dec9a1457fb8f'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:33.961389 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-72d260ae-f2a0-42d1-88f3-a6206dc04bd2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc8300a3b7c74773ac6dec9a1457fb8f'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:33.973904 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-72d260ae-f2a0-42d1-88f3-a6206dc04bd2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc8300a3b7c74773ac6dec9a1457fb8f'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:33.980053 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4162/8296] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 22:02:33 2022] DELETE /identity/v3/users/cc8300a3b7c74773ac6dec9a1457fb8f => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 22:02:34.258024 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76b2bc6-4ecb-466c-a92f-c6093ec9e5ba admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:34.259578 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-b76b2bc6-4ecb-466c-a92f-c6093ec9e5ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:02:34.274333 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76b2bc6-4ecb-466c-a92f-c6093ec9e5ba admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:34.335405 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e476518b-5017-48a3-8f13-8f14de929e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:34.336218 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e476518b-5017-48a3-8f13-8f14de929e33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:34.336495 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e476518b-5017-48a3-8f13-8f14de929e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:34.336748 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e476518b-5017-48a3-8f13-8f14de929e33 admin admin] PATH_INFO: `/v3/projects/de2c6c11290242b1883de85405188697` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:34.338116 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e476518b-5017-48a3-8f13-8f14de929e33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de2c6c11290242b1883de85405188697)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:34.340065 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e476518b-5017-48a3-8f13-8f14de929e33 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:34.393509 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-e476518b-5017-48a3-8f13-8f14de929e33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de2c6c11290242b1883de85405188697', 'request_id': 'req-e476518b-5017-48a3-8f13-8f14de929e33'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:34.401226 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-e476518b-5017-48a3-8f13-8f14de929e33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de2c6c11290242b1883de85405188697', 'request_id': 'req-e476518b-5017-48a3-8f13-8f14de929e33'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:34.407500 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-e476518b-5017-48a3-8f13-8f14de929e33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de2c6c11290242b1883de85405188697', 'request_id': 'req-e476518b-5017-48a3-8f13-8f14de929e33'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:34.415333 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:02:34.419840 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-e476518b-5017-48a3-8f13-8f14de929e33 admin admin] The token cache is being invalidate because project de2c6c11290242b1883de85405188697 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 22:02:34.420141 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-e476518b-5017-48a3-8f13-8f14de929e33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:34.420942 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-e476518b-5017-48a3-8f13-8f14de929e33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:34.422720 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4135/8297] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 22:02:34 2022] DELETE /identity/v3/projects/de2c6c11290242b1883de85405188697 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:02:34.427932 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1daceb-32ff-4a68-8b34-22caa4d1f480 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:34.428426 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1daceb-32ff-4a68-8b34-22caa4d1f480 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:34.428550 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1daceb-32ff-4a68-8b34-22caa4d1f480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:34.448143 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-7f1daceb-32ff-4a68-8b34-22caa4d1f480 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:02:34.449352 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-7f1daceb-32ff-4a68-8b34-22caa4d1f480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:02:34.513975 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4163/8298] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:02:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:02:34.521945 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939b2137-938b-4344-84ba-702bf45d9bdb None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:34.522234 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939b2137-938b-4344-84ba-702bf45d9bdb None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:34.522512 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939b2137-938b-4344-84ba-702bf45d9bdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:34.541644 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-939b2137-938b-4344-84ba-702bf45d9bdb None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:02:34.542915 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-939b2137-938b-4344-84ba-702bf45d9bdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:02:34.551758 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4136/8299] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:02:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:02:34.556081 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1daceb-32ff-4a68-8b34-22caa4d1f480 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:34.566260 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1daceb-32ff-4a68-8b34-22caa4d1f480 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:34.571097 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245c83fd-986e-4479-b76a-e21f5c0e4a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:34.571748 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245c83fd-986e-4479-b76a-e21f5c0e4a9a admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:34.572033 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245c83fd-986e-4479-b76a-e21f5c0e4a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:34.572309 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245c83fd-986e-4479-b76a-e21f5c0e4a9a admin admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:34.573033 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245c83fd-986e-4479-b76a-e21f5c0e4a9a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 22:02:34.573336 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245c83fd-986e-4479-b76a-e21f5c0e4a9a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:34.574985 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245c83fd-986e-4479-b76a-e21f5c0e4a9a admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:34.587098 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4164/8300] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 22:02:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 22:02:34.591319 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939b2137-938b-4344-84ba-702bf45d9bdb None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:34.601696 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939b2137-938b-4344-84ba-702bf45d9bdb None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:34.607295 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bd1295-a821-4d5c-a40d-3533b7da5d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:34.607956 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bd1295-a821-4d5c-a40d-3533b7da5d54 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:34.608262 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bd1295-a821-4d5c-a40d-3533b7da5d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:34.608537 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bd1295-a821-4d5c-a40d-3533b7da5d54 admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:34.609224 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bd1295-a821-4d5c-a40d-3533b7da5d54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:34.611203 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bd1295-a821-4d5c-a40d-3533b7da5d54 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:34.639726 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4137/8301] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 22:02:34 2022] POST /identity/v3/projects => generated 367 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 22:02:34.643990 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245c83fd-986e-4479-b76a-e21f5c0e4a9a admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:34.651581 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:02:34.656059 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245c83fd-986e-4479-b76a-e21f5c0e4a9a admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:34.731768 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cd0110-ded8-4e76-9b44-c06ca3f062f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:34.732749 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cd0110-ded8-4e76-9b44-c06ca3f062f8 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:34.733135 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cd0110-ded8-4e76-9b44-c06ca3f062f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:34.733420 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cd0110-ded8-4e76-9b44-c06ca3f062f8 admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:34.734171 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cd0110-ded8-4e76-9b44-c06ca3f062f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:34.736154 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cd0110-ded8-4e76-9b44-c06ca3f062f8 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:34.762514 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4165/8302] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 22:02:34 2022] POST /identity/v3/users => generated 284 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 22:02:34.769100 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bd1295-a821-4d5c-a40d-3533b7da5d54 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:34.780276 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bd1295-a821-4d5c-a40d-3533b7da5d54 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:34.786200 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f222ea3d-e16d-414c-bbd2-818b97949e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:34.786867 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f222ea3d-e16d-414c-bbd2-818b97949e23 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:34.787148 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f222ea3d-e16d-414c-bbd2-818b97949e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:34.787423 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f222ea3d-e16d-414c-bbd2-818b97949e23 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:34.788150 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f222ea3d-e16d-414c-bbd2-818b97949e23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:34.789770 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f222ea3d-e16d-414c-bbd2-818b97949e23 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:34.800386 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4138/8303] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 22:02:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 22:02:34.804379 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cd0110-ded8-4e76-9b44-c06ca3f062f8 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:34.814832 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cd0110-ded8-4e76-9b44-c06ca3f062f8 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:34.819962 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc2f4c7-b995-44dc-b6f2-82b27655e601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:34.820630 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc2f4c7-b995-44dc-b6f2-82b27655e601 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:34.820913 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc2f4c7-b995-44dc-b6f2-82b27655e601 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:34.821203 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc2f4c7-b995-44dc-b6f2-82b27655e601 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:34.821986 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc2f4c7-b995-44dc-b6f2-82b27655e601 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:34.823625 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc2f4c7-b995-44dc-b6f2-82b27655e601 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:34.836439 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4166/8304] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 22:02:34 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 22:02:34.840847 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f222ea3d-e16d-414c-bbd2-818b97949e23 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:34.852171 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f222ea3d-e16d-414c-bbd2-818b97949e23 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:34.858197 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9316329-2a29-455f-b8d2-599ad71a19bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:34.859095 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9316329-2a29-455f-b8d2-599ad71a19bf admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:34.859365 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9316329-2a29-455f-b8d2-599ad71a19bf admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:34.859646 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9316329-2a29-455f-b8d2-599ad71a19bf admin admin] PATH_INFO: `/v3/projects/257183413578439d8e20865fe4d2e682/users/003dbfd9a93d4c69853ed2f04e6ed193/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:34.875289 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9316329-2a29-455f-b8d2-599ad71a19bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=257183413578439d8e20865fe4d2e682, user_id=003dbfd9a93d4c69853ed2f04e6ed193, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:34.878058 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9316329-2a29-455f-b8d2-599ad71a19bf admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:34.893004 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4139/8305] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 22:02:34 2022] PUT /identity/v3/projects/257183413578439d8e20865fe4d2e682/users/003dbfd9a93d4c69853ed2f04e6ed193/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:02:34.904648 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e542fc23-852f-4226-a38b-4c2787b2425c None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:34.904936 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e542fc23-852f-4226-a38b-4c2787b2425c None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:34.905181 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e542fc23-852f-4226-a38b-4c2787b2425c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:34.932411 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-e542fc23-852f-4226-a38b-4c2787b2425c None None] MFA Rules not processed for user `003dbfd9a93d4c69853ed2f04e6ed193`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:02:34.933665 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-e542fc23-852f-4226-a38b-4c2787b2425c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:02:35.002785 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4167/8306] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:02:34 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:02:35.007698 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9316329-2a29-455f-b8d2-599ad71a19bf admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:35.078219 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9316329-2a29-455f-b8d2-599ad71a19bf admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:35.083981 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01da735c-6109-4795-ae2b-30a2735098de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:35.084655 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01da735c-6109-4795-ae2b-30a2735098de admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:35.084938 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01da735c-6109-4795-ae2b-30a2735098de admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:35.085210 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01da735c-6109-4795-ae2b-30a2735098de admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:35.085899 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01da735c-6109-4795-ae2b-30a2735098de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:35.087872 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01da735c-6109-4795-ae2b-30a2735098de admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:35.116247 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4140/8307] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 22:02:35 2022] POST /identity/v3/projects => generated 369 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 22:02:35.120500 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e542fc23-852f-4226-a38b-4c2787b2425c None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:35.131568 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e542fc23-852f-4226-a38b-4c2787b2425c None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:35.189270 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77991989-0cc6-4917-9a21-7201dca1c114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:35.189970 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77991989-0cc6-4917-9a21-7201dca1c114 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:35.190246 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77991989-0cc6-4917-9a21-7201dca1c114 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:35.190612 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77991989-0cc6-4917-9a21-7201dca1c114 admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:35.191294 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77991989-0cc6-4917-9a21-7201dca1c114 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:35.193215 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77991989-0cc6-4917-9a21-7201dca1c114 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:35.215345 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4168/8308] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 22:02:35 2022] POST /identity/v3/users => generated 285 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 22:02:35.219674 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01da735c-6109-4795-ae2b-30a2735098de admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:35.230982 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01da735c-6109-4795-ae2b-30a2735098de admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:35.236399 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023eb777-d597-491e-b47d-d7c58acda108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:35.237061 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023eb777-d597-491e-b47d-d7c58acda108 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:35.237343 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023eb777-d597-491e-b47d-d7c58acda108 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:35.237617 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023eb777-d597-491e-b47d-d7c58acda108 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:35.238371 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023eb777-d597-491e-b47d-d7c58acda108 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:35.240016 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023eb777-d597-491e-b47d-d7c58acda108 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:35.252051 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4141/8309] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 22:02:35 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 22:02:35.256235 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77991989-0cc6-4917-9a21-7201dca1c114 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:35.261506 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:02:35.268227 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77991989-0cc6-4917-9a21-7201dca1c114 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:35.273577 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf986627-533e-4316-90df-a995111a6d56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:35.274285 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf986627-533e-4316-90df-a995111a6d56 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:35.274560 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf986627-533e-4316-90df-a995111a6d56 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:35.274832 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf986627-533e-4316-90df-a995111a6d56 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:35.275553 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf986627-533e-4316-90df-a995111a6d56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:35.277152 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf986627-533e-4316-90df-a995111a6d56 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:35.287212 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4169/8310] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 22:02:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 22:02:35.291468 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023eb777-d597-491e-b47d-d7c58acda108 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:35.302249 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023eb777-d597-491e-b47d-d7c58acda108 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:35.308193 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab658f80-4124-4779-9c41-6c80ce85bccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:35.309062 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab658f80-4124-4779-9c41-6c80ce85bccc admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:35.309372 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab658f80-4124-4779-9c41-6c80ce85bccc admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:35.309646 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab658f80-4124-4779-9c41-6c80ce85bccc admin admin] PATH_INFO: `/v3/projects/af1f4168a97a4066a3ead560a502219a/users/1644d1f45aa24a32a938e52640b055d7/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:35.325301 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab658f80-4124-4779-9c41-6c80ce85bccc admin admin] RBAC: Authorizing `identity:create_grant(project_id=af1f4168a97a4066a3ead560a502219a, user_id=1644d1f45aa24a32a938e52640b055d7, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:35.328016 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab658f80-4124-4779-9c41-6c80ce85bccc admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:35.344679 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4142/8311] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 22:02:35 2022] PUT /identity/v3/projects/af1f4168a97a4066a3ead560a502219a/users/1644d1f45aa24a32a938e52640b055d7/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:02:35.355952 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb37ae5-d56a-4e8a-a615-94407e259667 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:35.356328 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb37ae5-d56a-4e8a-a615-94407e259667 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:35.356704 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb37ae5-d56a-4e8a-a615-94407e259667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:35.386584 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-1fb37ae5-d56a-4e8a-a615-94407e259667 None None] MFA Rules not processed for user `1644d1f45aa24a32a938e52640b055d7`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:02:35.387737 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-1fb37ae5-d56a-4e8a-a615-94407e259667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:02:35.457882 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4170/8312] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:02:35 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:02:35.470796 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab658f80-4124-4779-9c41-6c80ce85bccc admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:35.473029 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-ab658f80-4124-4779-9c41-6c80ce85bccc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:02:35.528564 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:02:35.538702 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab658f80-4124-4779-9c41-6c80ce85bccc admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:35.543279 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92599503-4f61-415c-983e-b8f2a318a3cb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7f2db148c8e4d5d81431cae3576434b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:35.543921 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92599503-4f61-415c-983e-b8f2a318a3cb service glance] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:35.544197 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92599503-4f61-415c-983e-b8f2a318a3cb service glance] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:35.544467 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92599503-4f61-415c-983e-b8f2a318a3cb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:35.603395 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92599503-4f61-415c-983e-b8f2a318a3cb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:35.604898 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92599503-4f61-415c-983e-b8f2a318a3cb service glance] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:35.614152 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4143/8313] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:02:35 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:02:35.733826 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb37ae5-d56a-4e8a-a615-94407e259667 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:35.746763 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb37ae5-d56a-4e8a-a615-94407e259667 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:35.750827 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e01706-44ca-4337-a458-f1629c1e8cf4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7f2db148c8e4d5d81431cae3576434b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:35.751508 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e01706-44ca-4337-a458-f1629c1e8cf4 service glance] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:35.751782 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e01706-44ca-4337-a458-f1629c1e8cf4 service glance] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:35.752053 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e01706-44ca-4337-a458-f1629c1e8cf4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:35.761026 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e01706-44ca-4337-a458-f1629c1e8cf4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:35.762536 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e01706-44ca-4337-a458-f1629c1e8cf4 service glance] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:35.771653 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4171/8314] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:02:35 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:02:36.884798 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92599503-4f61-415c-983e-b8f2a318a3cb service glance] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:36.948905 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92599503-4f61-415c-983e-b8f2a318a3cb service glance] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:36.954651 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d121ddf6-8c0a-4136-b87a-bfb31220a9a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:36.955552 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d121ddf6-8c0a-4136-b87a-bfb31220a9a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:36.955832 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d121ddf6-8c0a-4136-b87a-bfb31220a9a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:36.956186 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d121ddf6-8c0a-4136-b87a-bfb31220a9a0 admin admin] PATH_INFO: `/v3/users/003dbfd9a93d4c69853ed2f04e6ed193` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:36.957530 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d121ddf6-8c0a-4136-b87a-bfb31220a9a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=003dbfd9a93d4c69853ed2f04e6ed193)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:36.959542 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d121ddf6-8c0a-4136-b87a-bfb31220a9a0 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:37.014520 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-d121ddf6-8c0a-4136-b87a-bfb31220a9a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '003dbfd9a93d4c69853ed2f04e6ed193'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:37.023344 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-d121ddf6-8c0a-4136-b87a-bfb31220a9a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '003dbfd9a93d4c69853ed2f04e6ed193'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:37.024060 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-d121ddf6-8c0a-4136-b87a-bfb31220a9a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '003dbfd9a93d4c69853ed2f04e6ed193'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:37.032983 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-d121ddf6-8c0a-4136-b87a-bfb31220a9a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '003dbfd9a93d4c69853ed2f04e6ed193'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:37.045599 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-d121ddf6-8c0a-4136-b87a-bfb31220a9a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '003dbfd9a93d4c69853ed2f04e6ed193'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:37.051533 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4144/8315] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 22:02:36 2022] DELETE /identity/v3/users/003dbfd9a93d4c69853ed2f04e6ed193 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:02:37.056455 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f849c020-b4d8-415d-9b67-7c0363b037a0 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:37.056942 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f849c020-b4d8-415d-9b67-7c0363b037a0 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:37.057063 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f849c020-b4d8-415d-9b67-7c0363b037a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:37.075938 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-f849c020-b4d8-415d-9b67-7c0363b037a0 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:02:37.077126 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-f849c020-b4d8-415d-9b67-7c0363b037a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:02:37.137906 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4172/8316] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:02:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:02:37.149305 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d121ddf6-8c0a-4136-b87a-bfb31220a9a0 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:37.151717 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-d121ddf6-8c0a-4136-b87a-bfb31220a9a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:02:37.176625 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:02:37.214161 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d121ddf6-8c0a-4136-b87a-bfb31220a9a0 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:37.218483 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1132dd61-fe99-4c3a-a6d8-fec7b630f514 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:37.219166 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1132dd61-fe99-4c3a-a6d8-fec7b630f514 service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:37.219466 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1132dd61-fe99-4c3a-a6d8-fec7b630f514 service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:37.219737 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1132dd61-fe99-4c3a-a6d8-fec7b630f514 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:37.230353 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1132dd61-fe99-4c3a-a6d8-fec7b630f514 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:37.231792 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1132dd61-fe99-4c3a-a6d8-fec7b630f514 service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:37.241840 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4145/8317] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:02:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:02:37.540492 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f849c020-b4d8-415d-9b67-7c0363b037a0 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:37.542085 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-f849c020-b4d8-415d-9b67-7c0363b037a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:02:37.556184 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f849c020-b4d8-415d-9b67-7c0363b037a0 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:37.561153 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58894c30-02d8-41fa-904f-7af38ea991ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:37.562081 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58894c30-02d8-41fa-904f-7af38ea991ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:37.562384 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58894c30-02d8-41fa-904f-7af38ea991ad admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:37.562654 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58894c30-02d8-41fa-904f-7af38ea991ad admin admin] PATH_INFO: `/v3/projects/257183413578439d8e20865fe4d2e682` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:37.563870 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58894c30-02d8-41fa-904f-7af38ea991ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=257183413578439d8e20865fe4d2e682)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:37.565805 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58894c30-02d8-41fa-904f-7af38ea991ad admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:37.614731 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-58894c30-02d8-41fa-904f-7af38ea991ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '257183413578439d8e20865fe4d2e682', 'request_id': 'req-58894c30-02d8-41fa-904f-7af38ea991ad'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:37.623648 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-58894c30-02d8-41fa-904f-7af38ea991ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '257183413578439d8e20865fe4d2e682', 'request_id': 'req-58894c30-02d8-41fa-904f-7af38ea991ad'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:37.628620 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:02:37.630097 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-58894c30-02d8-41fa-904f-7af38ea991ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '257183413578439d8e20865fe4d2e682', 'request_id': 'req-58894c30-02d8-41fa-904f-7af38ea991ad'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:37.643120 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-58894c30-02d8-41fa-904f-7af38ea991ad admin admin] The token cache is being invalidate because project 257183413578439d8e20865fe4d2e682 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 22:02:37.643404 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-58894c30-02d8-41fa-904f-7af38ea991ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:37.644078 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-58894c30-02d8-41fa-904f-7af38ea991ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:37.645676 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4173/8318] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 22:02:37 2022] DELETE /identity/v3/projects/257183413578439d8e20865fe4d2e682 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:02:37.649825 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1132dd61-fe99-4c3a-a6d8-fec7b630f514 service neutron] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:37.660563 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1132dd61-fe99-4c3a-a6d8-fec7b630f514 service neutron] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:37.720057 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789eaa39-7b95-4f17-b447-f9b3a76f6b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:37.720961 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789eaa39-7b95-4f17-b447-f9b3a76f6b3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:37.721240 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789eaa39-7b95-4f17-b447-f9b3a76f6b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:37.721536 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789eaa39-7b95-4f17-b447-f9b3a76f6b3c admin admin] PATH_INFO: `/v3/users/1644d1f45aa24a32a938e52640b055d7` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:37.722887 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789eaa39-7b95-4f17-b447-f9b3a76f6b3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1644d1f45aa24a32a938e52640b055d7)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:37.724848 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789eaa39-7b95-4f17-b447-f9b3a76f6b3c admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:37.786626 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-789eaa39-7b95-4f17-b447-f9b3a76f6b3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1644d1f45aa24a32a938e52640b055d7'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:37.793686 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-789eaa39-7b95-4f17-b447-f9b3a76f6b3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1644d1f45aa24a32a938e52640b055d7'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:37.794390 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-789eaa39-7b95-4f17-b447-f9b3a76f6b3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1644d1f45aa24a32a938e52640b055d7'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:37.803972 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-789eaa39-7b95-4f17-b447-f9b3a76f6b3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1644d1f45aa24a32a938e52640b055d7'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:37.821278 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-789eaa39-7b95-4f17-b447-f9b3a76f6b3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1644d1f45aa24a32a938e52640b055d7'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:37.830612 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4146/8319] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 22:02:37 2022] DELETE /identity/v3/users/1644d1f45aa24a32a938e52640b055d7 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:02:38.116469 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58894c30-02d8-41fa-904f-7af38ea991ad admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:38.118923 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-58894c30-02d8-41fa-904f-7af38ea991ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:02:38.140333 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58894c30-02d8-41fa-904f-7af38ea991ad admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:38.212664 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cd04d4-2409-4b97-ac3e-1948fb92c982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:38.213475 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cd04d4-2409-4b97-ac3e-1948fb92c982 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:38.213758 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cd04d4-2409-4b97-ac3e-1948fb92c982 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:38.214137 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cd04d4-2409-4b97-ac3e-1948fb92c982 admin admin] PATH_INFO: `/v3/projects/af1f4168a97a4066a3ead560a502219a` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:38.215392 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cd04d4-2409-4b97-ac3e-1948fb92c982 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af1f4168a97a4066a3ead560a502219a)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:38.217716 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cd04d4-2409-4b97-ac3e-1948fb92c982 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:38.266659 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c3cd04d4-2409-4b97-ac3e-1948fb92c982 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af1f4168a97a4066a3ead560a502219a', 'request_id': 'req-c3cd04d4-2409-4b97-ac3e-1948fb92c982'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:38.274788 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c3cd04d4-2409-4b97-ac3e-1948fb92c982 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af1f4168a97a4066a3ead560a502219a', 'request_id': 'req-c3cd04d4-2409-4b97-ac3e-1948fb92c982'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:38.280325 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c3cd04d4-2409-4b97-ac3e-1948fb92c982 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af1f4168a97a4066a3ead560a502219a', 'request_id': 'req-c3cd04d4-2409-4b97-ac3e-1948fb92c982'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:38.291429 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c3cd04d4-2409-4b97-ac3e-1948fb92c982 admin admin] The token cache is being invalidate because project af1f4168a97a4066a3ead560a502219a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 22:02:38.291713 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c3cd04d4-2409-4b97-ac3e-1948fb92c982 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:38.292338 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c3cd04d4-2409-4b97-ac3e-1948fb92c982 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:38.293908 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4174/8320] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 22:02:38 2022] DELETE /identity/v3/projects/af1f4168a97a4066a3ead560a502219a => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:02:38.300310 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d72fda-431d-4177-94eb-ae45b1b1f1b2 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:38.300838 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d72fda-431d-4177-94eb-ae45b1b1f1b2 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:38.300838 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d72fda-431d-4177-94eb-ae45b1b1f1b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:38.319416 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-b3d72fda-431d-4177-94eb-ae45b1b1f1b2 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:02:38.320702 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-b3d72fda-431d-4177-94eb-ae45b1b1f1b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:02:38.365318 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:02:38.388022 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4147/8321] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:02:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:02:38.396886 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6036dd41-1f34-4bcb-9e17-f614933a24f1 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:38.397189 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6036dd41-1f34-4bcb-9e17-f614933a24f1 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:38.397463 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6036dd41-1f34-4bcb-9e17-f614933a24f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:38.417679 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-6036dd41-1f34-4bcb-9e17-f614933a24f1 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:02:38.418945 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-6036dd41-1f34-4bcb-9e17-f614933a24f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:02:38.428298 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4175/8322] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:02:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:02:38.432855 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d72fda-431d-4177-94eb-ae45b1b1f1b2 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:38.442908 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d72fda-431d-4177-94eb-ae45b1b1f1b2 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:38.447913 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f15f3f-18f9-413a-84dc-0cf65201e3b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:38.448566 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f15f3f-18f9-413a-84dc-0cf65201e3b0 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:38.448836 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f15f3f-18f9-413a-84dc-0cf65201e3b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:38.449108 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f15f3f-18f9-413a-84dc-0cf65201e3b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:38.449829 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f15f3f-18f9-413a-84dc-0cf65201e3b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 22:02:38.450165 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f15f3f-18f9-413a-84dc-0cf65201e3b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:38.451762 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f15f3f-18f9-413a-84dc-0cf65201e3b0 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:38.463765 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4148/8323] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 22:02:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 22:02:38.468490 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6036dd41-1f34-4bcb-9e17-f614933a24f1 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:38.478398 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6036dd41-1f34-4bcb-9e17-f614933a24f1 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:38.483530 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21f3c07-8800-4f7c-927a-2bf62c09e86f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:38.484208 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21f3c07-8800-4f7c-927a-2bf62c09e86f admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:38.484484 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21f3c07-8800-4f7c-927a-2bf62c09e86f admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:38.484757 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21f3c07-8800-4f7c-927a-2bf62c09e86f admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:38.485441 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21f3c07-8800-4f7c-927a-2bf62c09e86f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:38.487640 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21f3c07-8800-4f7c-927a-2bf62c09e86f admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:38.515474 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4176/8324] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 22:02:38 2022] POST /identity/v3/projects => generated 391 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 22:02:38.519857 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f15f3f-18f9-413a-84dc-0cf65201e3b0 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:38.530841 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f15f3f-18f9-413a-84dc-0cf65201e3b0 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:38.592310 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9355b704-8615-471e-98df-93b94c20164d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:38.592989 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9355b704-8615-471e-98df-93b94c20164d admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:38.593271 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9355b704-8615-471e-98df-93b94c20164d admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:38.593544 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9355b704-8615-471e-98df-93b94c20164d admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:38.594273 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9355b704-8615-471e-98df-93b94c20164d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:38.596212 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9355b704-8615-471e-98df-93b94c20164d admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:38.618598 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4149/8325] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 22:02:38 2022] POST /identity/v3/users => generated 296 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 22:02:38.622562 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21f3c07-8800-4f7c-927a-2bf62c09e86f admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:38.633158 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21f3c07-8800-4f7c-927a-2bf62c09e86f admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:38.639428 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26faae25-5d59-4f4f-8262-c03ebfe710c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:38.640130 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26faae25-5d59-4f4f-8262-c03ebfe710c0 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:38.640404 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26faae25-5d59-4f4f-8262-c03ebfe710c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:38.640671 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26faae25-5d59-4f4f-8262-c03ebfe710c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:38.641390 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26faae25-5d59-4f4f-8262-c03ebfe710c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:38.643028 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26faae25-5d59-4f4f-8262-c03ebfe710c0 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:38.655586 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4177/8326] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 22:02:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 22:02:38.659882 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9355b704-8615-471e-98df-93b94c20164d admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:38.670696 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9355b704-8615-471e-98df-93b94c20164d admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:38.676312 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c27dff5-e5c9-41ad-ae8c-ce6f9e72c5d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:38.676997 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c27dff5-e5c9-41ad-ae8c-ce6f9e72c5d9 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:38.677273 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c27dff5-e5c9-41ad-ae8c-ce6f9e72c5d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:38.677545 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c27dff5-e5c9-41ad-ae8c-ce6f9e72c5d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:38.678313 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c27dff5-e5c9-41ad-ae8c-ce6f9e72c5d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:38.679915 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c27dff5-e5c9-41ad-ae8c-ce6f9e72c5d9 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:38.691129 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4150/8327] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 22:02:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 22:02:38.695579 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26faae25-5d59-4f4f-8262-c03ebfe710c0 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:38.705680 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26faae25-5d59-4f4f-8262-c03ebfe710c0 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:38.710495 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f912d431-27db-4577-91d8-85209a1db254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:38.711387 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f912d431-27db-4577-91d8-85209a1db254 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:38.711665 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f912d431-27db-4577-91d8-85209a1db254 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:38.711939 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f912d431-27db-4577-91d8-85209a1db254 admin admin] PATH_INFO: `/v3/projects/6f1951a9e09241b18986f3ceafa5e85e/users/d9a3172d2af146c6a55e7cd90351b2ba/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:38.727595 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f912d431-27db-4577-91d8-85209a1db254 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f1951a9e09241b18986f3ceafa5e85e, user_id=d9a3172d2af146c6a55e7cd90351b2ba, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:38.730312 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f912d431-27db-4577-91d8-85209a1db254 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:38.745027 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4178/8328] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 22:02:38 2022] PUT /identity/v3/projects/6f1951a9e09241b18986f3ceafa5e85e/users/d9a3172d2af146c6a55e7cd90351b2ba/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:02:38.757572 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6387db79-b190-421b-919b-657acafb4ccf None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:38.757953 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6387db79-b190-421b-919b-657acafb4ccf None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:38.758254 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6387db79-b190-421b-919b-657acafb4ccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:38.791108 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-6387db79-b190-421b-919b-657acafb4ccf None None] MFA Rules not processed for user `d9a3172d2af146c6a55e7cd90351b2ba`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:02:38.792316 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-6387db79-b190-421b-919b-657acafb4ccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:02:38.862125 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4151/8329] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:02:38 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:02:38.867064 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f912d431-27db-4577-91d8-85209a1db254 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:38.888033 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:02:38.933073 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f912d431-27db-4577-91d8-85209a1db254 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:38.938909 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f938b1-0acc-40d8-b5f7-2d28c105420e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:38.939679 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f938b1-0acc-40d8-b5f7-2d28c105420e admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:38.939959 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f938b1-0acc-40d8-b5f7-2d28c105420e admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:38.940213 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f938b1-0acc-40d8-b5f7-2d28c105420e admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:38.941023 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f938b1-0acc-40d8-b5f7-2d28c105420e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:38.943021 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f938b1-0acc-40d8-b5f7-2d28c105420e admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:38.971950 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4179/8330] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 22:02:38 2022] POST /identity/v3/projects => generated 389 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 22:02:38.978482 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6387db79-b190-421b-919b-657acafb4ccf None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:38.996849 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6387db79-b190-421b-919b-657acafb4ccf None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:39.033899 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:02:39.065522 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b311af45-2432-46a1-8993-20a4238a5eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:39.066234 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b311af45-2432-46a1-8993-20a4238a5eaa admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:39.066517 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b311af45-2432-46a1-8993-20a4238a5eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:39.066798 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b311af45-2432-46a1-8993-20a4238a5eaa admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:39.067488 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b311af45-2432-46a1-8993-20a4238a5eaa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:39.069468 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b311af45-2432-46a1-8993-20a4238a5eaa admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:39.089403 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4152/8331] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 22:02:38 2022] POST /identity/v3/users => generated 301 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 22:02:39.094120 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f938b1-0acc-40d8-b5f7-2d28c105420e admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:39.105152 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f938b1-0acc-40d8-b5f7-2d28c105420e admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:39.110718 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abca7310-6875-4b84-8ba4-6cf4842322ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:39.111393 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abca7310-6875-4b84-8ba4-6cf4842322ff admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:39.111677 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abca7310-6875-4b84-8ba4-6cf4842322ff admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:39.111952 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abca7310-6875-4b84-8ba4-6cf4842322ff admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:39.112781 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abca7310-6875-4b84-8ba4-6cf4842322ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:39.114427 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abca7310-6875-4b84-8ba4-6cf4842322ff admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:39.125698 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4180/8332] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 22:02:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 22:02:39.130049 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b311af45-2432-46a1-8993-20a4238a5eaa admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:39.140770 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b311af45-2432-46a1-8993-20a4238a5eaa admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:39.146662 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce06a8e-b5db-48d9-b8e8-0cec4e081671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:39.147549 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce06a8e-b5db-48d9-b8e8-0cec4e081671 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:39.147824 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce06a8e-b5db-48d9-b8e8-0cec4e081671 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:39.148104 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce06a8e-b5db-48d9-b8e8-0cec4e081671 admin admin] PATH_INFO: `/v3/projects/c2e92f5eee68448593955a96262ca34e/users/219d3e0c036749ee821039323b6c03f3/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:39.164743 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce06a8e-b5db-48d9-b8e8-0cec4e081671 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2e92f5eee68448593955a96262ca34e, user_id=219d3e0c036749ee821039323b6c03f3, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:39.167469 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce06a8e-b5db-48d9-b8e8-0cec4e081671 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:39.181659 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4153/8333] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 22:02:39 2022] PUT /identity/v3/projects/c2e92f5eee68448593955a96262ca34e/users/219d3e0c036749ee821039323b6c03f3/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:02:39.185657 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abca7310-6875-4b84-8ba4-6cf4842322ff admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:39.196596 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abca7310-6875-4b84-8ba4-6cf4842322ff admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:39.264756 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0609ad-68a1-4142-9b6e-98e9a54c6764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:39.265681 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0609ad-68a1-4142-9b6e-98e9a54c6764 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:39.266008 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0609ad-68a1-4142-9b6e-98e9a54c6764 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:39.266349 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0609ad-68a1-4142-9b6e-98e9a54c6764 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:39.267211 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0609ad-68a1-4142-9b6e-98e9a54c6764 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:39.269510 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0609ad-68a1-4142-9b6e-98e9a54c6764 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:39.279707 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4181/8334] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 22:02:39 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 22:02:39.284347 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce06a8e-b5db-48d9-b8e8-0cec4e081671 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:39.295808 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce06a8e-b5db-48d9-b8e8-0cec4e081671 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:39.301814 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893b5bd2-b9c7-4fd6-a45f-6f632b3d7891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:39.302819 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893b5bd2-b9c7-4fd6-a45f-6f632b3d7891 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:39.303131 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893b5bd2-b9c7-4fd6-a45f-6f632b3d7891 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:39.303398 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893b5bd2-b9c7-4fd6-a45f-6f632b3d7891 admin admin] PATH_INFO: `/v3/projects/c2e92f5eee68448593955a96262ca34e/users/219d3e0c036749ee821039323b6c03f3/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:39.305701 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893b5bd2-b9c7-4fd6-a45f-6f632b3d7891 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2e92f5eee68448593955a96262ca34e, user_id=219d3e0c036749ee821039323b6c03f3, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:39.308412 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893b5bd2-b9c7-4fd6-a45f-6f632b3d7891 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:39.319214 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4154/8335] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 22:02:39 2022] PUT /identity/v3/projects/c2e92f5eee68448593955a96262ca34e/users/219d3e0c036749ee821039323b6c03f3/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:02:39.329579 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bb8487-b629-412c-b5c0-695dd3d189a9 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:39.329887 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bb8487-b629-412c-b5c0-695dd3d189a9 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:39.330172 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bb8487-b629-412c-b5c0-695dd3d189a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:39.358316 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-f5bb8487-b629-412c-b5c0-695dd3d189a9 None None] MFA Rules not processed for user `219d3e0c036749ee821039323b6c03f3`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:02:39.359536 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-f5bb8487-b629-412c-b5c0-695dd3d189a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:02:39.445953 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4182/8336] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:02:39 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:02:39.456375 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893b5bd2-b9c7-4fd6-a45f-6f632b3d7891 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:39.458183 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-893b5bd2-b9c7-4fd6-a45f-6f632b3d7891 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:02:39.516577 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893b5bd2-b9c7-4fd6-a45f-6f632b3d7891 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:39.520757 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321e0817-5c8c-4ac7-ae1a-afaf8cfd5885 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:39.521400 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321e0817-5c8c-4ac7-ae1a-afaf8cfd5885 service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:39.521673 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321e0817-5c8c-4ac7-ae1a-afaf8cfd5885 service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:39.521980 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321e0817-5c8c-4ac7-ae1a-afaf8cfd5885 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:39.580979 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321e0817-5c8c-4ac7-ae1a-afaf8cfd5885 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:39.582464 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321e0817-5c8c-4ac7-ae1a-afaf8cfd5885 service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:39.591693 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4155/8337] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:02:39 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:02:41.587498 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bb8487-b629-412c-b5c0-695dd3d189a9 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:41.598734 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bb8487-b629-412c-b5c0-695dd3d189a9 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:41.602983 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a1cebb-f5f3-4328-8f64-3d92ee9cf54a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:41.603672 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a1cebb-f5f3-4328-8f64-3d92ee9cf54a service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:41.603955 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a1cebb-f5f3-4328-8f64-3d92ee9cf54a service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:41.605027 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a1cebb-f5f3-4328-8f64-3d92ee9cf54a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:41.620883 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a1cebb-f5f3-4328-8f64-3d92ee9cf54a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:41.622415 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a1cebb-f5f3-4328-8f64-3d92ee9cf54a service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:41.628985 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:02:41.634582 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4183/8338] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:02:41 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:02:43.884011 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321e0817-5c8c-4ac7-ae1a-afaf8cfd5885 service neutron] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:43.934510 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:02:43.952718 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321e0817-5c8c-4ac7-ae1a-afaf8cfd5885 service neutron] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:43.957473 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc1e976-acda-4864-bae6-827da4dc9c72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:43.958424 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc1e976-acda-4864-bae6-827da4dc9c72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:43.958701 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc1e976-acda-4864-bae6-827da4dc9c72 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:43.958975 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc1e976-acda-4864-bae6-827da4dc9c72 admin admin] PATH_INFO: `/v3/users/d9a3172d2af146c6a55e7cd90351b2ba` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:43.960218 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc1e976-acda-4864-bae6-827da4dc9c72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9a3172d2af146c6a55e7cd90351b2ba)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:43.962208 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc1e976-acda-4864-bae6-827da4dc9c72 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:44.009631 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-dfc1e976-acda-4864-bae6-827da4dc9c72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9a3172d2af146c6a55e7cd90351b2ba'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:44.016509 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-dfc1e976-acda-4864-bae6-827da4dc9c72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9a3172d2af146c6a55e7cd90351b2ba'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:44.017093 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-dfc1e976-acda-4864-bae6-827da4dc9c72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9a3172d2af146c6a55e7cd90351b2ba'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:44.025046 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-dfc1e976-acda-4864-bae6-827da4dc9c72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9a3172d2af146c6a55e7cd90351b2ba'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:44.037431 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-dfc1e976-acda-4864-bae6-827da4dc9c72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9a3172d2af146c6a55e7cd90351b2ba'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:44.043989 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4156/8339] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 22:02:43 2022] DELETE /identity/v3/users/d9a3172d2af146c6a55e7cd90351b2ba => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:02:44.048690 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86f0ab7-3924-4b47-873f-e12bb5db096b None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:44.049277 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86f0ab7-3924-4b47-873f-e12bb5db096b None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:44.049277 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86f0ab7-3924-4b47-873f-e12bb5db096b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:44.067808 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-c86f0ab7-3924-4b47-873f-e12bb5db096b None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:02:44.069104 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-c86f0ab7-3924-4b47-873f-e12bb5db096b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:02:44.129795 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4184/8340] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:02:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:02:44.140042 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc1e976-acda-4864-bae6-827da4dc9c72 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:44.141743 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-dfc1e976-acda-4864-bae6-827da4dc9c72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:02:44.200057 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc1e976-acda-4864-bae6-827da4dc9c72 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:44.203771 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b998104-4e06-4074-ad6c-3c7b573b1437 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:44.204422 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b998104-4e06-4074-ad6c-3c7b573b1437 service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:44.204705 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b998104-4e06-4074-ad6c-3c7b573b1437 service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:44.204981 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b998104-4e06-4074-ad6c-3c7b573b1437 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:44.214304 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b998104-4e06-4074-ad6c-3c7b573b1437 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:44.215747 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b998104-4e06-4074-ad6c-3c7b573b1437 service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:44.225931 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4157/8341] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:02:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:02:44.409832 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86f0ab7-3924-4b47-873f-e12bb5db096b None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:44.411393 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-c86f0ab7-3924-4b47-873f-e12bb5db096b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:02:44.426303 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86f0ab7-3924-4b47-873f-e12bb5db096b None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:44.432311 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc44781-08ca-44aa-8e19-aa38a42fec39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:44.433477 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc44781-08ca-44aa-8e19-aa38a42fec39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:44.434204 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc44781-08ca-44aa-8e19-aa38a42fec39 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:44.434442 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc44781-08ca-44aa-8e19-aa38a42fec39 admin admin] PATH_INFO: `/v3/projects/6f1951a9e09241b18986f3ceafa5e85e` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:44.435770 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc44781-08ca-44aa-8e19-aa38a42fec39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f1951a9e09241b18986f3ceafa5e85e)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:44.437779 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc44781-08ca-44aa-8e19-aa38a42fec39 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:44.488244 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-ecc44781-08ca-44aa-8e19-aa38a42fec39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f1951a9e09241b18986f3ceafa5e85e', 'request_id': 'req-ecc44781-08ca-44aa-8e19-aa38a42fec39'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:44.496967 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-ecc44781-08ca-44aa-8e19-aa38a42fec39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f1951a9e09241b18986f3ceafa5e85e', 'request_id': 'req-ecc44781-08ca-44aa-8e19-aa38a42fec39'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:44.502748 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-ecc44781-08ca-44aa-8e19-aa38a42fec39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f1951a9e09241b18986f3ceafa5e85e', 'request_id': 'req-ecc44781-08ca-44aa-8e19-aa38a42fec39'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:44.514061 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-ecc44781-08ca-44aa-8e19-aa38a42fec39 admin admin] The token cache is being invalidate because project 6f1951a9e09241b18986f3ceafa5e85e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 22:02:44.514378 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-ecc44781-08ca-44aa-8e19-aa38a42fec39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:44.515125 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-ecc44781-08ca-44aa-8e19-aa38a42fec39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:44.516834 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4185/8342] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 22:02:44 2022] DELETE /identity/v3/projects/6f1951a9e09241b18986f3ceafa5e85e => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:02:44.521478 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b998104-4e06-4074-ad6c-3c7b573b1437 service neutron] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:44.531505 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b998104-4e06-4074-ad6c-3c7b573b1437 service neutron] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:44.601402 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c7fcc1-43cb-4697-bc2a-d6848a5470fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:44.602318 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c7fcc1-43cb-4697-bc2a-d6848a5470fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:44.602593 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c7fcc1-43cb-4697-bc2a-d6848a5470fe admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:44.602865 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c7fcc1-43cb-4697-bc2a-d6848a5470fe admin admin] PATH_INFO: `/v3/users/219d3e0c036749ee821039323b6c03f3` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:44.604098 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c7fcc1-43cb-4697-bc2a-d6848a5470fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=219d3e0c036749ee821039323b6c03f3)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:44.606058 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c7fcc1-43cb-4697-bc2a-d6848a5470fe admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:44.611584 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:02:44.656296 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-d2c7fcc1-43cb-4697-bc2a-d6848a5470fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '219d3e0c036749ee821039323b6c03f3'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:44.663292 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-d2c7fcc1-43cb-4697-bc2a-d6848a5470fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '219d3e0c036749ee821039323b6c03f3'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:44.663957 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-d2c7fcc1-43cb-4697-bc2a-d6848a5470fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '219d3e0c036749ee821039323b6c03f3'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:44.672802 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-d2c7fcc1-43cb-4697-bc2a-d6848a5470fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '219d3e0c036749ee821039323b6c03f3'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:44.690891 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-d2c7fcc1-43cb-4697-bc2a-d6848a5470fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '219d3e0c036749ee821039323b6c03f3'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:44.697362 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4158/8343] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 22:02:44 2022] DELETE /identity/v3/users/219d3e0c036749ee821039323b6c03f3 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:02:44.989324 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc44781-08ca-44aa-8e19-aa38a42fec39 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:44.990823 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-ecc44781-08ca-44aa-8e19-aa38a42fec39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:02:45.005355 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc44781-08ca-44aa-8e19-aa38a42fec39 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:45.066435 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcea59c-8e22-4b59-8d1f-5ba08eb09630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:45.067250 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcea59c-8e22-4b59-8d1f-5ba08eb09630 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:45.067535 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcea59c-8e22-4b59-8d1f-5ba08eb09630 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:45.067799 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcea59c-8e22-4b59-8d1f-5ba08eb09630 admin admin] PATH_INFO: `/v3/projects/c2e92f5eee68448593955a96262ca34e` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:45.069146 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcea59c-8e22-4b59-8d1f-5ba08eb09630 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2e92f5eee68448593955a96262ca34e)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:45.071153 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcea59c-8e22-4b59-8d1f-5ba08eb09630 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:45.106359 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:02:45.123599 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-ddcea59c-8e22-4b59-8d1f-5ba08eb09630 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2e92f5eee68448593955a96262ca34e', 'request_id': 'req-ddcea59c-8e22-4b59-8d1f-5ba08eb09630'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:45.133085 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-ddcea59c-8e22-4b59-8d1f-5ba08eb09630 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2e92f5eee68448593955a96262ca34e', 'request_id': 'req-ddcea59c-8e22-4b59-8d1f-5ba08eb09630'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:45.142104 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-ddcea59c-8e22-4b59-8d1f-5ba08eb09630 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2e92f5eee68448593955a96262ca34e', 'request_id': 'req-ddcea59c-8e22-4b59-8d1f-5ba08eb09630'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:45.154733 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-ddcea59c-8e22-4b59-8d1f-5ba08eb09630 admin admin] The token cache is being invalidate because project c2e92f5eee68448593955a96262ca34e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 22:02:45.155020 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-ddcea59c-8e22-4b59-8d1f-5ba08eb09630 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:45.155731 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-ddcea59c-8e22-4b59-8d1f-5ba08eb09630 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:02:45.157343 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4186/8344] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 22:02:44 2022] DELETE /identity/v3/projects/c2e92f5eee68448593955a96262ca34e => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:02:45.162832 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38499dc-9d51-4790-8687-85f98d16f752 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:45.163415 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38499dc-9d51-4790-8687-85f98d16f752 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:45.163415 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38499dc-9d51-4790-8687-85f98d16f752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:45.182000 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-f38499dc-9d51-4790-8687-85f98d16f752 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:02:45.183222 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-f38499dc-9d51-4790-8687-85f98d16f752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:02:45.244588 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4159/8345] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:02:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:02:45.254059 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ba4869-11b1-414b-b906-038050e46852 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:45.254348 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ba4869-11b1-414b-b906-038050e46852 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:45.254655 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ba4869-11b1-414b-b906-038050e46852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:45.275726 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-a3ba4869-11b1-414b-b906-038050e46852 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:02:45.276945 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-a3ba4869-11b1-414b-b906-038050e46852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:02:45.286637 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4187/8346] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:02:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:02:45.291195 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38499dc-9d51-4790-8687-85f98d16f752 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:45.301710 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38499dc-9d51-4790-8687-85f98d16f752 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:45.307699 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ddd179-e8d4-4123-82ca-b63230449226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:45.308364 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ddd179-e8d4-4123-82ca-b63230449226 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:45.308643 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ddd179-e8d4-4123-82ca-b63230449226 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:45.308915 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ddd179-e8d4-4123-82ca-b63230449226 admin admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:45.309638 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ddd179-e8d4-4123-82ca-b63230449226 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 22:02:45.309974 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ddd179-e8d4-4123-82ca-b63230449226 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:45.311589 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ddd179-e8d4-4123-82ca-b63230449226 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:45.324183 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4160/8347] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 22:02:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 22:02:45.328530 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ba4869-11b1-414b-b906-038050e46852 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:45.338415 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ba4869-11b1-414b-b906-038050e46852 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:45.344369 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcea5862-e2b1-4cf5-a845-d26a3d7ff51e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:45.345034 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcea5862-e2b1-4cf5-a845-d26a3d7ff51e admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:45.345314 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcea5862-e2b1-4cf5-a845-d26a3d7ff51e admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:45.345585 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcea5862-e2b1-4cf5-a845-d26a3d7ff51e admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:45.346312 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcea5862-e2b1-4cf5-a845-d26a3d7ff51e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:45.348284 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcea5862-e2b1-4cf5-a845-d26a3d7ff51e admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:45.381929 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4188/8348] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 22:02:45 2022] POST /identity/v3/projects => generated 373 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 22:02:45.386309 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ddd179-e8d4-4123-82ca-b63230449226 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:45.398919 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ddd179-e8d4-4123-82ca-b63230449226 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:45.459630 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a4b5b4-3e96-49ea-aeec-f7b6e29478dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:45.460305 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a4b5b4-3e96-49ea-aeec-f7b6e29478dd admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:45.460585 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a4b5b4-3e96-49ea-aeec-f7b6e29478dd admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:45.460842 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a4b5b4-3e96-49ea-aeec-f7b6e29478dd admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:45.461515 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a4b5b4-3e96-49ea-aeec-f7b6e29478dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:45.463474 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a4b5b4-3e96-49ea-aeec-f7b6e29478dd admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:45.489141 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4161/8349] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 22:02:45 2022] POST /identity/v3/users => generated 287 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 22:02:45.490417 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcea5862-e2b1-4cf5-a845-d26a3d7ff51e admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:45.501265 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcea5862-e2b1-4cf5-a845-d26a3d7ff51e admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:45.507083 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a871d90-0f18-43e6-b7b2-f3cad8aa7780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:45.507750 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a871d90-0f18-43e6-b7b2-f3cad8aa7780 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:45.508030 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a871d90-0f18-43e6-b7b2-f3cad8aa7780 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:45.508304 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a871d90-0f18-43e6-b7b2-f3cad8aa7780 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:45.509017 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a871d90-0f18-43e6-b7b2-f3cad8aa7780 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:45.510670 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a871d90-0f18-43e6-b7b2-f3cad8aa7780 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:45.521769 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4189/8350] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 22:02:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 22:02:45.525842 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a4b5b4-3e96-49ea-aeec-f7b6e29478dd admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:45.531284 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:02:45.538520 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a4b5b4-3e96-49ea-aeec-f7b6e29478dd admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:45.544295 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c56b068-51d4-48a7-b0c6-7f14941a4940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:45.544960 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c56b068-51d4-48a7-b0c6-7f14941a4940 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:45.545237 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c56b068-51d4-48a7-b0c6-7f14941a4940 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:45.545507 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c56b068-51d4-48a7-b0c6-7f14941a4940 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:45.546263 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c56b068-51d4-48a7-b0c6-7f14941a4940 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:45.547859 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c56b068-51d4-48a7-b0c6-7f14941a4940 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:45.560509 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4162/8351] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 22:02:45 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 22:02:45.564839 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a871d90-0f18-43e6-b7b2-f3cad8aa7780 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:45.575576 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a871d90-0f18-43e6-b7b2-f3cad8aa7780 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:45.580236 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65a2200-4ab3-4eb4-80a6-a55025e9f653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:45.581136 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65a2200-4ab3-4eb4-80a6-a55025e9f653 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:45.581416 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65a2200-4ab3-4eb4-80a6-a55025e9f653 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:45.581696 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65a2200-4ab3-4eb4-80a6-a55025e9f653 admin admin] PATH_INFO: `/v3/projects/4294a4f141604186ab5d37c0d4828275/users/fc33fa8e1c6849749ceea888e16affeb/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:45.596872 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65a2200-4ab3-4eb4-80a6-a55025e9f653 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4294a4f141604186ab5d37c0d4828275, user_id=fc33fa8e1c6849749ceea888e16affeb, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:45.599622 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65a2200-4ab3-4eb4-80a6-a55025e9f653 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:45.614267 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4190/8352] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 22:02:45 2022] PUT /identity/v3/projects/4294a4f141604186ab5d37c0d4828275/users/fc33fa8e1c6849749ceea888e16affeb/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:02:45.624810 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740b1c8d-f2d5-432a-a889-a6eb33e2baa2 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:45.625100 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740b1c8d-f2d5-432a-a889-a6eb33e2baa2 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:45.625376 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740b1c8d-f2d5-432a-a889-a6eb33e2baa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:45.652092 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-740b1c8d-f2d5-432a-a889-a6eb33e2baa2 None None] MFA Rules not processed for user `fc33fa8e1c6849749ceea888e16affeb`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:02:45.653338 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-740b1c8d-f2d5-432a-a889-a6eb33e2baa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:02:45.719744 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4163/8353] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:02:45 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:02:45.730313 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65a2200-4ab3-4eb4-80a6-a55025e9f653 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:02:45.732271 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-e65a2200-4ab3-4eb4-80a6-a55025e9f653 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:02:45.794121 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65a2200-4ab3-4eb4-80a6-a55025e9f653 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:02:45.798260 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b06b19-6520-47ff-aa49-bee506ca121a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:02:45.798914 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b06b19-6520-47ff-aa49-bee506ca121a service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:02:45.799193 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b06b19-6520-47ff-aa49-bee506ca121a service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:02:45.799463 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b06b19-6520-47ff-aa49-bee506ca121a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:02:45.808272 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b06b19-6520-47ff-aa49-bee506ca121a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:02:45.809700 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b06b19-6520-47ff-aa49-bee506ca121a service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:02:45.820948 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4191/8354] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:02:45 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:02:55.716239 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=36 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:02:55.816636 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:DELETE=6,keystone:SELECT=67,keystone:INSERT=3 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:03:54.455407 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740b1c8d-f2d5-432a-a889-a6eb33e2baa2 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:03:54.521560 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740b1c8d-f2d5-432a-a889-a6eb33e2baa2 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:03:54.526637 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95855f23-7ef5-4cdf-b428-660856dbfee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:03:54.527526 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95855f23-7ef5-4cdf-b428-660856dbfee0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:03:54.527806 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95855f23-7ef5-4cdf-b428-660856dbfee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:03:54.528081 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95855f23-7ef5-4cdf-b428-660856dbfee0 admin admin] PATH_INFO: `/v3/users/fc33fa8e1c6849749ceea888e16affeb` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:03:54.529279 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95855f23-7ef5-4cdf-b428-660856dbfee0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc33fa8e1c6849749ceea888e16affeb)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:03:54.531251 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95855f23-7ef5-4cdf-b428-660856dbfee0 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:03:54.579692 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-95855f23-7ef5-4cdf-b428-660856dbfee0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc33fa8e1c6849749ceea888e16affeb'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:03:54.586502 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-95855f23-7ef5-4cdf-b428-660856dbfee0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc33fa8e1c6849749ceea888e16affeb'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:03:54.587172 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-95855f23-7ef5-4cdf-b428-660856dbfee0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc33fa8e1c6849749ceea888e16affeb'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:03:54.596013 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-95855f23-7ef5-4cdf-b428-660856dbfee0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc33fa8e1c6849749ceea888e16affeb'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:03:54.610010 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-95855f23-7ef5-4cdf-b428-660856dbfee0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc33fa8e1c6849749ceea888e16affeb'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:03:54.616517 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4164/8355] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 22:03:54 2022] DELETE /identity/v3/users/fc33fa8e1c6849749ceea888e16affeb => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:03:54.621240 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4afa924-175f-4d1d-8163-4011b5a5804b None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:03:54.621816 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4afa924-175f-4d1d-8163-4011b5a5804b None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:03:54.621816 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4afa924-175f-4d1d-8163-4011b5a5804b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:03:54.640666 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-d4afa924-175f-4d1d-8163-4011b5a5804b None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:03:54.641939 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-d4afa924-175f-4d1d-8163-4011b5a5804b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:03:54.705345 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4192/8356] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:03:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:03:54.715291 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95855f23-7ef5-4cdf-b428-660856dbfee0 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:03:54.717403 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-95855f23-7ef5-4cdf-b428-660856dbfee0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:03:54.783617 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95855f23-7ef5-4cdf-b428-660856dbfee0 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:03:54.788540 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638ba902-0436-477b-8ad7-1bb8deeaca62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:03:54.789210 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638ba902-0436-477b-8ad7-1bb8deeaca62 service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:03:54.789488 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638ba902-0436-477b-8ad7-1bb8deeaca62 service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:03:54.789755 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638ba902-0436-477b-8ad7-1bb8deeaca62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:03:54.801273 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638ba902-0436-477b-8ad7-1bb8deeaca62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:03:54.802761 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638ba902-0436-477b-8ad7-1bb8deeaca62 service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:03:54.814297 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4165/8357] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:03:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:03:54.993653 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4afa924-175f-4d1d-8163-4011b5a5804b None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:03:54.995301 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-d4afa924-175f-4d1d-8163-4011b5a5804b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:03:55.008395 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4afa924-175f-4d1d-8163-4011b5a5804b None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:03:55.013773 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b46e26-37b3-4c12-ae9d-16f31ef0a36c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:03:55.014709 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b46e26-37b3-4c12-ae9d-16f31ef0a36c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:03:55.014993 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b46e26-37b3-4c12-ae9d-16f31ef0a36c admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:03:55.015266 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b46e26-37b3-4c12-ae9d-16f31ef0a36c admin admin] PATH_INFO: `/v3/projects/4294a4f141604186ab5d37c0d4828275` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:03:55.016663 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b46e26-37b3-4c12-ae9d-16f31ef0a36c admin admin] RBAC: Authorizing `identity:delete_project(project_id=4294a4f141604186ab5d37c0d4828275)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:03:55.018682 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b46e26-37b3-4c12-ae9d-16f31ef0a36c admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:03:55.065758 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-34b46e26-37b3-4c12-ae9d-16f31ef0a36c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4294a4f141604186ab5d37c0d4828275', 'request_id': 'req-34b46e26-37b3-4c12-ae9d-16f31ef0a36c'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:03:55.074092 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-34b46e26-37b3-4c12-ae9d-16f31ef0a36c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4294a4f141604186ab5d37c0d4828275', 'request_id': 'req-34b46e26-37b3-4c12-ae9d-16f31ef0a36c'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:03:55.079920 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-34b46e26-37b3-4c12-ae9d-16f31ef0a36c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4294a4f141604186ab5d37c0d4828275', 'request_id': 'req-34b46e26-37b3-4c12-ae9d-16f31ef0a36c'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:03:55.093894 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-34b46e26-37b3-4c12-ae9d-16f31ef0a36c admin admin] The token cache is being invalidate because project 4294a4f141604186ab5d37c0d4828275 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 22:03:55.094375 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-34b46e26-37b3-4c12-ae9d-16f31ef0a36c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:03:55.095102 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-34b46e26-37b3-4c12-ae9d-16f31ef0a36c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:03:55.096736 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4193/8358] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 22:03:54 2022] DELETE /identity/v3/projects/4294a4f141604186ab5d37c0d4828275 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:03:55.102934 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeddad6-bb5a-4767-a35d-fc36ed7101b8 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:03:55.103252 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeddad6-bb5a-4767-a35d-fc36ed7101b8 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:03:55.103531 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeddad6-bb5a-4767-a35d-fc36ed7101b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:03:55.122816 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-efeddad6-bb5a-4767-a35d-fc36ed7101b8 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:03:55.123983 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-efeddad6-bb5a-4767-a35d-fc36ed7101b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:03:55.142947 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:03:55.195831 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4166/8359] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:03:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:03:55.203785 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6771673e-75a2-4569-829c-33fc9d349c56 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:03:55.204095 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6771673e-75a2-4569-829c-33fc9d349c56 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:03:55.204370 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6771673e-75a2-4569-829c-33fc9d349c56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:03:55.224415 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-6771673e-75a2-4569-829c-33fc9d349c56 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:03:55.225631 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-6771673e-75a2-4569-829c-33fc9d349c56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:03:55.234549 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4194/8360] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:03:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:03:55.239352 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeddad6-bb5a-4767-a35d-fc36ed7101b8 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:03:55.253909 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeddad6-bb5a-4767-a35d-fc36ed7101b8 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:03:55.259531 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fd669e-d5b0-42c1-8dd4-77f1fbea1f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:03:55.260200 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fd669e-d5b0-42c1-8dd4-77f1fbea1f87 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:03:55.260468 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fd669e-d5b0-42c1-8dd4-77f1fbea1f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:03:55.260737 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fd669e-d5b0-42c1-8dd4-77f1fbea1f87 admin admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:03:55.261456 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fd669e-d5b0-42c1-8dd4-77f1fbea1f87 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 22:03:55.261751 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fd669e-d5b0-42c1-8dd4-77f1fbea1f87 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:03:55.263386 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fd669e-d5b0-42c1-8dd4-77f1fbea1f87 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:03:55.275592 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4167/8361] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 22:03:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 22:03:55.280016 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6771673e-75a2-4569-829c-33fc9d349c56 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:03:55.289803 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6771673e-75a2-4569-829c-33fc9d349c56 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:03:55.294867 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4155fdf3-b7f9-47ea-99e2-89cf185083b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:03:55.295529 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4155fdf3-b7f9-47ea-99e2-89cf185083b9 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:03:55.295808 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4155fdf3-b7f9-47ea-99e2-89cf185083b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:03:55.296085 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4155fdf3-b7f9-47ea-99e2-89cf185083b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:03:55.296775 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4155fdf3-b7f9-47ea-99e2-89cf185083b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:03:55.298730 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4155fdf3-b7f9-47ea-99e2-89cf185083b9 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:03:55.328910 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4195/8362] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 22:03:55 2022] POST /identity/v3/projects => generated 389 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 22:03:55.333291 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fd669e-d5b0-42c1-8dd4-77f1fbea1f87 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:03:55.344233 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fd669e-d5b0-42c1-8dd4-77f1fbea1f87 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:03:55.402741 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9329c22-6740-4d99-bb60-ba20e703bd86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:03:55.403338 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9329c22-6740-4d99-bb60-ba20e703bd86 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:03:55.403624 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9329c22-6740-4d99-bb60-ba20e703bd86 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:03:55.403900 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9329c22-6740-4d99-bb60-ba20e703bd86 admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:03:55.404602 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9329c22-6740-4d99-bb60-ba20e703bd86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:03:55.406593 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9329c22-6740-4d99-bb60-ba20e703bd86 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:03:55.427390 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4168/8363] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 22:03:55 2022] POST /identity/v3/users => generated 295 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 22:03:55.431707 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4155fdf3-b7f9-47ea-99e2-89cf185083b9 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:03:55.443657 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4155fdf3-b7f9-47ea-99e2-89cf185083b9 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:03:55.448727 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9152aa2-1f6d-4a47-b106-d506ac9bbc95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:03:55.449394 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9152aa2-1f6d-4a47-b106-d506ac9bbc95 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:03:55.449669 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9152aa2-1f6d-4a47-b106-d506ac9bbc95 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:03:55.449977 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9152aa2-1f6d-4a47-b106-d506ac9bbc95 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:03:55.450952 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9152aa2-1f6d-4a47-b106-d506ac9bbc95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:03:55.452550 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9152aa2-1f6d-4a47-b106-d506ac9bbc95 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:03:55.464912 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4196/8364] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 22:03:55 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 22:03:55.469617 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9329c22-6740-4d99-bb60-ba20e703bd86 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:03:55.480484 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9329c22-6740-4d99-bb60-ba20e703bd86 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:03:55.485023 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41004998-eef5-4eb1-9024-948928490fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:03:55.485683 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41004998-eef5-4eb1-9024-948928490fe6 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:03:55.485993 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41004998-eef5-4eb1-9024-948928490fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:03:55.486257 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41004998-eef5-4eb1-9024-948928490fe6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:03:55.486991 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41004998-eef5-4eb1-9024-948928490fe6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:03:55.488589 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41004998-eef5-4eb1-9024-948928490fe6 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:03:55.500176 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4169/8365] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 22:03:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 22:03:55.504829 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9152aa2-1f6d-4a47-b106-d506ac9bbc95 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:03:55.515554 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9152aa2-1f6d-4a47-b106-d506ac9bbc95 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:03:55.521198 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb189fb-7d0f-4ca0-9fe3-e631f73022b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:03:55.522144 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb189fb-7d0f-4ca0-9fe3-e631f73022b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:03:55.522431 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb189fb-7d0f-4ca0-9fe3-e631f73022b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:03:55.522707 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb189fb-7d0f-4ca0-9fe3-e631f73022b5 admin admin] PATH_INFO: `/v3/projects/936546e029d845ffa5a7261ff9cc0293/users/33c2e29ae36b47afb5c3bc96b3088413/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:03:55.540051 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb189fb-7d0f-4ca0-9fe3-e631f73022b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=936546e029d845ffa5a7261ff9cc0293, user_id=33c2e29ae36b47afb5c3bc96b3088413, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:03:55.542801 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb189fb-7d0f-4ca0-9fe3-e631f73022b5 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:03:55.558915 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4197/8366] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 22:03:55 2022] PUT /identity/v3/projects/936546e029d845ffa5a7261ff9cc0293/users/33c2e29ae36b47afb5c3bc96b3088413/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:03:55.569819 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd63f169-96c1-43dc-93f1-0d50b589283c None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:03:55.570148 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd63f169-96c1-43dc-93f1-0d50b589283c None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:03:55.570425 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd63f169-96c1-43dc-93f1-0d50b589283c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:03:55.597660 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-bd63f169-96c1-43dc-93f1-0d50b589283c None None] MFA Rules not processed for user `33c2e29ae36b47afb5c3bc96b3088413`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:03:55.598903 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-bd63f169-96c1-43dc-93f1-0d50b589283c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:03:55.665146 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4170/8367] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:03:55 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:03:55.675307 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb189fb-7d0f-4ca0-9fe3-e631f73022b5 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:03:55.677435 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-aeb189fb-7d0f-4ca0-9fe3-e631f73022b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:03:55.699810 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:03:55.739975 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb189fb-7d0f-4ca0-9fe3-e631f73022b5 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:03:55.743854 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c78a9e9-6456-4786-8214-fb4eff3e0394 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:03:55.744500 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c78a9e9-6456-4786-8214-fb4eff3e0394 service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:03:55.744781 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c78a9e9-6456-4786-8214-fb4eff3e0394 service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:03:55.745056 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c78a9e9-6456-4786-8214-fb4eff3e0394 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:03:55.753782 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c78a9e9-6456-4786-8214-fb4eff3e0394 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:03:55.755235 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c78a9e9-6456-4786-8214-fb4eff3e0394 service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:03:55.764149 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4198/8368] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:03:55 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:04:04.732696 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd63f169-96c1-43dc-93f1-0d50b589283c None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:04:04.755812 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:04:04.799559 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd63f169-96c1-43dc-93f1-0d50b589283c None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:04:04.804547 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c361d7c-0420-4679-b3cc-b1fa95e56ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:04:04.805440 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c361d7c-0420-4679-b3cc-b1fa95e56ae8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:04.805727 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c361d7c-0420-4679-b3cc-b1fa95e56ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:04.806009 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c361d7c-0420-4679-b3cc-b1fa95e56ae8 admin admin] PATH_INFO: `/v3/users/33c2e29ae36b47afb5c3bc96b3088413` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:04.807259 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c361d7c-0420-4679-b3cc-b1fa95e56ae8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33c2e29ae36b47afb5c3bc96b3088413)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:04:04.809171 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c361d7c-0420-4679-b3cc-b1fa95e56ae8 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:04:04.860240 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-5c361d7c-0420-4679-b3cc-b1fa95e56ae8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33c2e29ae36b47afb5c3bc96b3088413'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:04:04.867938 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-5c361d7c-0420-4679-b3cc-b1fa95e56ae8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33c2e29ae36b47afb5c3bc96b3088413'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:04:04.868818 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-5c361d7c-0420-4679-b3cc-b1fa95e56ae8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33c2e29ae36b47afb5c3bc96b3088413'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:04:04.878264 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-5c361d7c-0420-4679-b3cc-b1fa95e56ae8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33c2e29ae36b47afb5c3bc96b3088413'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:04:04.891258 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-5c361d7c-0420-4679-b3cc-b1fa95e56ae8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33c2e29ae36b47afb5c3bc96b3088413'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:04:04.897544 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4171/8369] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 22:04:04 2022] DELETE /identity/v3/users/33c2e29ae36b47afb5c3bc96b3088413 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:04:04.902359 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ca70c2-33d5-4c5d-9103-9836f7dc69e5 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:04.902878 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ca70c2-33d5-4c5d-9103-9836f7dc69e5 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:04.902878 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ca70c2-33d5-4c5d-9103-9836f7dc69e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:04.920591 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-d2ca70c2-33d5-4c5d-9103-9836f7dc69e5 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:04:04.921832 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-d2ca70c2-33d5-4c5d-9103-9836f7dc69e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:04:04.990412 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4199/8370] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:04:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:04:05.000555 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c361d7c-0420-4679-b3cc-b1fa95e56ae8 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:04:05.002273 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-5c361d7c-0420-4679-b3cc-b1fa95e56ae8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:04:05.064134 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c361d7c-0420-4679-b3cc-b1fa95e56ae8 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:04:05.068334 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a05195f-9fc1-4abb-9940-a71ebfc621e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:04:05.068978 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a05195f-9fc1-4abb-9940-a71ebfc621e4 service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:05.069251 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a05195f-9fc1-4abb-9940-a71ebfc621e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:05.069524 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a05195f-9fc1-4abb-9940-a71ebfc621e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:05.078958 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a05195f-9fc1-4abb-9940-a71ebfc621e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:04:05.080424 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a05195f-9fc1-4abb-9940-a71ebfc621e4 service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:04:05.090000 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4172/8371] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:04:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:04:05.274434 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ca70c2-33d5-4c5d-9103-9836f7dc69e5 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:04:05.275909 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-d2ca70c2-33d5-4c5d-9103-9836f7dc69e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:04:05.290521 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ca70c2-33d5-4c5d-9103-9836f7dc69e5 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:04:05.296422 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f46056a-34a4-4b8c-b997-7e28a0999f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:04:05.297482 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f46056a-34a4-4b8c-b997-7e28a0999f68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:05.297766 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f46056a-34a4-4b8c-b997-7e28a0999f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:05.298163 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f46056a-34a4-4b8c-b997-7e28a0999f68 admin admin] PATH_INFO: `/v3/projects/936546e029d845ffa5a7261ff9cc0293` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:05.299362 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f46056a-34a4-4b8c-b997-7e28a0999f68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=936546e029d845ffa5a7261ff9cc0293)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:04:05.301282 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f46056a-34a4-4b8c-b997-7e28a0999f68 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:04:05.360061 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-7f46056a-34a4-4b8c-b997-7e28a0999f68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '936546e029d845ffa5a7261ff9cc0293', 'request_id': 'req-7f46056a-34a4-4b8c-b997-7e28a0999f68'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:04:05.371090 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-7f46056a-34a4-4b8c-b997-7e28a0999f68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '936546e029d845ffa5a7261ff9cc0293', 'request_id': 'req-7f46056a-34a4-4b8c-b997-7e28a0999f68'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:04:05.380083 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-7f46056a-34a4-4b8c-b997-7e28a0999f68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '936546e029d845ffa5a7261ff9cc0293', 'request_id': 'req-7f46056a-34a4-4b8c-b997-7e28a0999f68'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:04:05.396175 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-7f46056a-34a4-4b8c-b997-7e28a0999f68 admin admin] The token cache is being invalidate because project 936546e029d845ffa5a7261ff9cc0293 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 22:04:05.396352 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-7f46056a-34a4-4b8c-b997-7e28a0999f68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:04:05.397126 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-7f46056a-34a4-4b8c-b997-7e28a0999f68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:04:05.398882 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4200/8372] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 22:04:05 2022] DELETE /identity/v3/projects/936546e029d845ffa5a7261ff9cc0293 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:04:05.403960 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bc978c-80d5-48df-a453-fd0fa05910fc None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:05.404249 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bc978c-80d5-48df-a453-fd0fa05910fc None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:05.404527 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bc978c-80d5-48df-a453-fd0fa05910fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:05.423356 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-33bc978c-80d5-48df-a453-fd0fa05910fc None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:04:05.424689 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-33bc978c-80d5-48df-a453-fd0fa05910fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:04:05.459700 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:04:05.486385 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4173/8373] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:04:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:04:05.495602 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5578b6-cd0e-41aa-82d0-586cbc7b2ff2 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:05.495891 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5578b6-cd0e-41aa-82d0-586cbc7b2ff2 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:05.496164 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5578b6-cd0e-41aa-82d0-586cbc7b2ff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:05.515475 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-8e5578b6-cd0e-41aa-82d0-586cbc7b2ff2 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:04:05.516682 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-8e5578b6-cd0e-41aa-82d0-586cbc7b2ff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:04:05.525679 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4201/8374] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:04:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:04:05.530036 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bc978c-80d5-48df-a453-fd0fa05910fc None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:04:05.542616 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bc978c-80d5-48df-a453-fd0fa05910fc None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:04:05.550221 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95479831-28e9-4928-acbf-a8c53cf41152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:04:05.550867 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95479831-28e9-4928-acbf-a8c53cf41152 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:05.551141 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95479831-28e9-4928-acbf-a8c53cf41152 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:05.551408 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95479831-28e9-4928-acbf-a8c53cf41152 admin admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:05.552153 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95479831-28e9-4928-acbf-a8c53cf41152 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 22:04:05.552446 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95479831-28e9-4928-acbf-a8c53cf41152 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:04:05.554070 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95479831-28e9-4928-acbf-a8c53cf41152 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:04:05.566680 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4174/8375] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 22:04:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 22:04:05.572635 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5578b6-cd0e-41aa-82d0-586cbc7b2ff2 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:04:05.582665 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5578b6-cd0e-41aa-82d0-586cbc7b2ff2 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:04:05.588732 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b063c8-c304-4ac6-a272-3752f2f8c3ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:04:05.589459 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b063c8-c304-4ac6-a272-3752f2f8c3ce admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:05.589667 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b063c8-c304-4ac6-a272-3752f2f8c3ce admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:05.590033 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b063c8-c304-4ac6-a272-3752f2f8c3ce admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:05.591040 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b063c8-c304-4ac6-a272-3752f2f8c3ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:04:05.592882 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b063c8-c304-4ac6-a272-3752f2f8c3ce admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:04:05.624481 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4202/8376] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 22:04:05 2022] POST /identity/v3/projects => generated 381 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 22:04:05.628868 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95479831-28e9-4928-acbf-a8c53cf41152 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:04:05.639687 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95479831-28e9-4928-acbf-a8c53cf41152 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:04:05.695743 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c376cd8-30f0-43a5-b430-9661da67b694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:04:05.696433 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c376cd8-30f0-43a5-b430-9661da67b694 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:05.696738 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c376cd8-30f0-43a5-b430-9661da67b694 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:05.696994 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c376cd8-30f0-43a5-b430-9661da67b694 admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:05.697685 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c376cd8-30f0-43a5-b430-9661da67b694 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:04:05.699663 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c376cd8-30f0-43a5-b430-9661da67b694 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:04:05.721743 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4175/8377] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 22:04:05 2022] POST /identity/v3/users => generated 291 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 22:04:05.725931 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b063c8-c304-4ac6-a272-3752f2f8c3ce admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:04:05.736793 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b063c8-c304-4ac6-a272-3752f2f8c3ce admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:04:05.741773 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41528261-7978-400a-97ae-a645befabeeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:04:05.742487 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41528261-7978-400a-97ae-a645befabeeb admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:05.742754 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41528261-7978-400a-97ae-a645befabeeb admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:05.743033 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41528261-7978-400a-97ae-a645befabeeb admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:05.743760 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41528261-7978-400a-97ae-a645befabeeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:04:05.745400 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41528261-7978-400a-97ae-a645befabeeb admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:04:05.755961 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4203/8378] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 22:04:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 22:04:05.759977 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c376cd8-30f0-43a5-b430-9661da67b694 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:04:05.770801 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c376cd8-30f0-43a5-b430-9661da67b694 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:04:05.776169 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4a671e-6173-44a4-871d-d818577a02d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:04:05.776854 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4a671e-6173-44a4-871d-d818577a02d0 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:05.777135 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4a671e-6173-44a4-871d-d818577a02d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:05.777410 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4a671e-6173-44a4-871d-d818577a02d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:05.778163 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4a671e-6173-44a4-871d-d818577a02d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:04:05.779849 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4a671e-6173-44a4-871d-d818577a02d0 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:04:05.790308 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4176/8379] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 22:04:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 22:04:05.794283 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41528261-7978-400a-97ae-a645befabeeb admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:04:05.804610 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41528261-7978-400a-97ae-a645befabeeb admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:04:05.815275 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d49565-5adc-4734-9da3-621e11aa8800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:04:05.815275 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d49565-5adc-4734-9da3-621e11aa8800 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:05.815275 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d49565-5adc-4734-9da3-621e11aa8800 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:05.815275 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d49565-5adc-4734-9da3-621e11aa8800 admin admin] PATH_INFO: `/v3/projects/a730a00429274cd29aecde4a5152ea28/users/ed33d6b4096e46e88b31eb6b7a1c9586/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:05.816001 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:04:05.831024 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d49565-5adc-4734-9da3-621e11aa8800 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a730a00429274cd29aecde4a5152ea28, user_id=ed33d6b4096e46e88b31eb6b7a1c9586, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:04:05.833713 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d49565-5adc-4734-9da3-621e11aa8800 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:04:05.848667 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4204/8380] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 22:04:05 2022] PUT /identity/v3/projects/a730a00429274cd29aecde4a5152ea28/users/ed33d6b4096e46e88b31eb6b7a1c9586/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:04:05.859299 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbe1136-e594-45bb-a52d-926bb8c4ccf4 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:05.859590 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbe1136-e594-45bb-a52d-926bb8c4ccf4 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:05.859865 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbe1136-e594-45bb-a52d-926bb8c4ccf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:05.886363 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-dfbe1136-e594-45bb-a52d-926bb8c4ccf4 None None] MFA Rules not processed for user `ed33d6b4096e46e88b31eb6b7a1c9586`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:04:05.887594 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-dfbe1136-e594-45bb-a52d-926bb8c4ccf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:04:05.953554 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4177/8381] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:04:05 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:04:05.964449 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d49565-5adc-4734-9da3-621e11aa8800 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:04:05.966883 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-d8d49565-5adc-4734-9da3-621e11aa8800 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:04:06.027412 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d49565-5adc-4734-9da3-621e11aa8800 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:04:06.031674 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2fb9d6-b1e0-4835-ae1f-8e9303f6c8d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:04:06.032325 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2fb9d6-b1e0-4835-ae1f-8e9303f6c8d1 service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:06.032605 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2fb9d6-b1e0-4835-ae1f-8e9303f6c8d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:06.032878 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2fb9d6-b1e0-4835-ae1f-8e9303f6c8d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:06.041851 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2fb9d6-b1e0-4835-ae1f-8e9303f6c8d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:04:06.043315 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2fb9d6-b1e0-4835-ae1f-8e9303f6c8d1 service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:04:06.052577 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4205/8382] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:04:05 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:04:15.950608 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=81,keystone:INSERT=3 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:04:16.048515 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=33,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:04:17.382716 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbe1136-e594-45bb-a52d-926bb8c4ccf4 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:04:17.450414 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbe1136-e594-45bb-a52d-926bb8c4ccf4 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:04:17.455184 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be89027-da18-44ed-a2a9-483b5cad93c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:04:17.456176 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be89027-da18-44ed-a2a9-483b5cad93c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:17.456455 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be89027-da18-44ed-a2a9-483b5cad93c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:17.456724 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be89027-da18-44ed-a2a9-483b5cad93c0 admin admin] PATH_INFO: `/v3/users/ed33d6b4096e46e88b31eb6b7a1c9586` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:17.457984 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be89027-da18-44ed-a2a9-483b5cad93c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed33d6b4096e46e88b31eb6b7a1c9586)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:04:17.459963 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be89027-da18-44ed-a2a9-483b5cad93c0 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:04:17.510559 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-1be89027-da18-44ed-a2a9-483b5cad93c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed33d6b4096e46e88b31eb6b7a1c9586'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:04:17.518273 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-1be89027-da18-44ed-a2a9-483b5cad93c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed33d6b4096e46e88b31eb6b7a1c9586'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:04:17.518878 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-1be89027-da18-44ed-a2a9-483b5cad93c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed33d6b4096e46e88b31eb6b7a1c9586'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:04:17.527356 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-1be89027-da18-44ed-a2a9-483b5cad93c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed33d6b4096e46e88b31eb6b7a1c9586'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:04:17.541340 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-1be89027-da18-44ed-a2a9-483b5cad93c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed33d6b4096e46e88b31eb6b7a1c9586'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:04:17.547396 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4178/8383] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 22:04:17 2022] DELETE /identity/v3/users/ed33d6b4096e46e88b31eb6b7a1c9586 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:04:17.552153 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd3679c-797a-4ead-a779-f0ec0702d71f None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:17.552669 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd3679c-797a-4ead-a779-f0ec0702d71f None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:17.552787 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd3679c-797a-4ead-a779-f0ec0702d71f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:17.570180 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-3cd3679c-797a-4ead-a779-f0ec0702d71f None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:04:17.571418 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-3cd3679c-797a-4ead-a779-f0ec0702d71f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:04:17.636476 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4206/8384] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:04:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:04:17.646517 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be89027-da18-44ed-a2a9-483b5cad93c0 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:04:17.647999 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-1be89027-da18-44ed-a2a9-483b5cad93c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:04:17.705358 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be89027-da18-44ed-a2a9-483b5cad93c0 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:04:17.709581 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5697219a-b96d-4632-8026-27eb500892c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:04:17.710286 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5697219a-b96d-4632-8026-27eb500892c0 service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:17.710571 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5697219a-b96d-4632-8026-27eb500892c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:17.710848 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5697219a-b96d-4632-8026-27eb500892c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:17.721539 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5697219a-b96d-4632-8026-27eb500892c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:04:17.723055 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5697219a-b96d-4632-8026-27eb500892c0 service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:04:17.733060 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4179/8385] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:04:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:04:17.910262 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd3679c-797a-4ead-a779-f0ec0702d71f None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:04:17.911822 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-3cd3679c-797a-4ead-a779-f0ec0702d71f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:04:17.927306 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd3679c-797a-4ead-a779-f0ec0702d71f None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:04:17.933283 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e50b660-407c-419f-a3ca-102eb7029148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:04:17.934223 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e50b660-407c-419f-a3ca-102eb7029148 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:17.934645 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e50b660-407c-419f-a3ca-102eb7029148 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:17.934970 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e50b660-407c-419f-a3ca-102eb7029148 admin admin] PATH_INFO: `/v3/projects/a730a00429274cd29aecde4a5152ea28` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:17.936313 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e50b660-407c-419f-a3ca-102eb7029148 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a730a00429274cd29aecde4a5152ea28)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:04:17.938309 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e50b660-407c-419f-a3ca-102eb7029148 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:04:17.988372 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-9e50b660-407c-419f-a3ca-102eb7029148 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a730a00429274cd29aecde4a5152ea28', 'request_id': 'req-9e50b660-407c-419f-a3ca-102eb7029148'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:04:17.996227 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-9e50b660-407c-419f-a3ca-102eb7029148 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a730a00429274cd29aecde4a5152ea28', 'request_id': 'req-9e50b660-407c-419f-a3ca-102eb7029148'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:04:18.002412 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-9e50b660-407c-419f-a3ca-102eb7029148 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a730a00429274cd29aecde4a5152ea28', 'request_id': 'req-9e50b660-407c-419f-a3ca-102eb7029148'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:04:18.013949 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-9e50b660-407c-419f-a3ca-102eb7029148 admin admin] The token cache is being invalidate because project a730a00429274cd29aecde4a5152ea28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 22:04:18.014217 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-9e50b660-407c-419f-a3ca-102eb7029148 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:04:18.014985 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-9e50b660-407c-419f-a3ca-102eb7029148 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:04:18.016677 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4207/8386] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 22:04:17 2022] DELETE /identity/v3/projects/a730a00429274cd29aecde4a5152ea28 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:04:18.022132 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa05e7b-c382-4bdd-8f9c-fd9e6b508211 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:18.022421 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa05e7b-c382-4bdd-8f9c-fd9e6b508211 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:18.022696 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa05e7b-c382-4bdd-8f9c-fd9e6b508211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:18.042006 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-faa05e7b-c382-4bdd-8f9c-fd9e6b508211 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:04:18.043224 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-faa05e7b-c382-4bdd-8f9c-fd9e6b508211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:04:18.061184 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:04:18.106489 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4180/8387] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:04:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:04:18.114756 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9725d21a-803e-487c-8743-5079833f5448 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:18.115040 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9725d21a-803e-487c-8743-5079833f5448 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:18.115322 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9725d21a-803e-487c-8743-5079833f5448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:18.135479 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-9725d21a-803e-487c-8743-5079833f5448 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:04:18.136676 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-9725d21a-803e-487c-8743-5079833f5448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:04:18.145788 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4208/8388] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:04:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:04:18.149980 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa05e7b-c382-4bdd-8f9c-fd9e6b508211 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:04:18.160056 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa05e7b-c382-4bdd-8f9c-fd9e6b508211 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:04:18.164905 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5269c01-9f73-4764-a48c-5a98c8b07c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:04:18.165556 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5269c01-9f73-4764-a48c-5a98c8b07c9c admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:18.165836 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5269c01-9f73-4764-a48c-5a98c8b07c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:18.166140 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5269c01-9f73-4764-a48c-5a98c8b07c9c admin admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:18.166866 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5269c01-9f73-4764-a48c-5a98c8b07c9c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 22:04:18.167169 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5269c01-9f73-4764-a48c-5a98c8b07c9c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:04:18.168774 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5269c01-9f73-4764-a48c-5a98c8b07c9c admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:04:18.180790 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4181/8389] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 22:04:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 22:04:18.184782 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9725d21a-803e-487c-8743-5079833f5448 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:04:18.194430 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9725d21a-803e-487c-8743-5079833f5448 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:04:18.200177 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4a055e-32ec-4024-a4a8-5c57cddb30cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:04:18.200825 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4a055e-32ec-4024-a4a8-5c57cddb30cd admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:18.201106 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4a055e-32ec-4024-a4a8-5c57cddb30cd admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:18.201375 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4a055e-32ec-4024-a4a8-5c57cddb30cd admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:18.202104 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4a055e-32ec-4024-a4a8-5c57cddb30cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:04:18.204011 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4a055e-32ec-4024-a4a8-5c57cddb30cd admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:04:18.231911 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4209/8390] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 22:04:18 2022] POST /identity/v3/projects => generated 379 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 22:04:18.236125 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5269c01-9f73-4764-a48c-5a98c8b07c9c admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:04:18.246561 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5269c01-9f73-4764-a48c-5a98c8b07c9c admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:04:18.313841 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1723f79a-8a4d-4679-8c06-977f54520853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:04:18.314749 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1723f79a-8a4d-4679-8c06-977f54520853 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:18.315166 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1723f79a-8a4d-4679-8c06-977f54520853 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:18.315449 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1723f79a-8a4d-4679-8c06-977f54520853 admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:18.316488 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1723f79a-8a4d-4679-8c06-977f54520853 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:04:18.319571 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1723f79a-8a4d-4679-8c06-977f54520853 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:04:18.345965 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4182/8391] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 22:04:18 2022] POST /identity/v3/users => generated 290 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 22:04:18.350241 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4a055e-32ec-4024-a4a8-5c57cddb30cd admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:04:18.360802 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4a055e-32ec-4024-a4a8-5c57cddb30cd admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:04:18.365694 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cd3b5f-7981-4160-ae52-ace02144f9a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:04:18.366401 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cd3b5f-7981-4160-ae52-ace02144f9a8 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:18.366675 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cd3b5f-7981-4160-ae52-ace02144f9a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:18.366941 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cd3b5f-7981-4160-ae52-ace02144f9a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:18.367653 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cd3b5f-7981-4160-ae52-ace02144f9a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:04:18.369240 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cd3b5f-7981-4160-ae52-ace02144f9a8 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:04:18.379872 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4210/8392] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 22:04:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 22:04:18.384359 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1723f79a-8a4d-4679-8c06-977f54520853 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:04:18.395906 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1723f79a-8a4d-4679-8c06-977f54520853 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:04:18.400652 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea080ba-4abe-4637-a13a-e16edbfb5a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:04:18.401593 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea080ba-4abe-4637-a13a-e16edbfb5a8b admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:18.402043 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea080ba-4abe-4637-a13a-e16edbfb5a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:18.402429 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea080ba-4abe-4637-a13a-e16edbfb5a8b admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:18.403172 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea080ba-4abe-4637-a13a-e16edbfb5a8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:04:18.404773 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea080ba-4abe-4637-a13a-e16edbfb5a8b admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:04:18.414952 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4183/8393] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 22:04:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 22:04:18.419251 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cd3b5f-7981-4160-ae52-ace02144f9a8 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:04:18.429487 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cd3b5f-7981-4160-ae52-ace02144f9a8 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:04:18.434433 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62550764-12e8-482d-be6c-5583d59fec3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:04:18.435305 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62550764-12e8-482d-be6c-5583d59fec3e admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:18.435594 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62550764-12e8-482d-be6c-5583d59fec3e admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:18.435884 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62550764-12e8-482d-be6c-5583d59fec3e admin admin] PATH_INFO: `/v3/projects/aede97dc5318420686169d8bec4e83a3/users/3a264356ed494afc92298bb8cdc220c2/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:18.452090 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62550764-12e8-482d-be6c-5583d59fec3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=aede97dc5318420686169d8bec4e83a3, user_id=3a264356ed494afc92298bb8cdc220c2, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:04:18.454850 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62550764-12e8-482d-be6c-5583d59fec3e admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:04:18.472912 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4211/8394] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 22:04:18 2022] PUT /identity/v3/projects/aede97dc5318420686169d8bec4e83a3/users/3a264356ed494afc92298bb8cdc220c2/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:04:18.483450 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61361ba4-bfa6-441e-9e1b-6394fdc90362 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:18.483744 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61361ba4-bfa6-441e-9e1b-6394fdc90362 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:18.484027 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61361ba4-bfa6-441e-9e1b-6394fdc90362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:18.513477 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-61361ba4-bfa6-441e-9e1b-6394fdc90362 None None] MFA Rules not processed for user `3a264356ed494afc92298bb8cdc220c2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:04:18.514730 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-61361ba4-bfa6-441e-9e1b-6394fdc90362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:04:18.580764 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4184/8395] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:04:18 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:04:18.591529 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62550764-12e8-482d-be6c-5583d59fec3e admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:04:18.593734 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-62550764-12e8-482d-be6c-5583d59fec3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:04:18.618439 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:04:18.657167 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62550764-12e8-482d-be6c-5583d59fec3e admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:04:18.660976 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82d4ef2-5f75-4d4d-a0a2-fb7491e35a73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:04:18.661618 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82d4ef2-5f75-4d4d-a0a2-fb7491e35a73 service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:18.661934 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82d4ef2-5f75-4d4d-a0a2-fb7491e35a73 service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:18.662214 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82d4ef2-5f75-4d4d-a0a2-fb7491e35a73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:18.670807 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82d4ef2-5f75-4d4d-a0a2-fb7491e35a73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:04:18.672239 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82d4ef2-5f75-4d4d-a0a2-fb7491e35a73 service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:04:18.681380 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4212/8396] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:04:18 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:04:28.577741 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:04:28.677254 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=17 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:04:35.742458 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61361ba4-bfa6-441e-9e1b-6394fdc90362 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:04:35.808446 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61361ba4-bfa6-441e-9e1b-6394fdc90362 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:04:35.813589 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd8bd55-dbba-404b-8365-b1d26d07666c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:04:35.814586 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd8bd55-dbba-404b-8365-b1d26d07666c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:35.814867 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd8bd55-dbba-404b-8365-b1d26d07666c admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:35.815138 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd8bd55-dbba-404b-8365-b1d26d07666c admin admin] PATH_INFO: `/v3/users/3a264356ed494afc92298bb8cdc220c2` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:35.816371 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd8bd55-dbba-404b-8365-b1d26d07666c admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a264356ed494afc92298bb8cdc220c2)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:04:35.818791 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd8bd55-dbba-404b-8365-b1d26d07666c admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:04:35.874665 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-3bd8bd55-dbba-404b-8365-b1d26d07666c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a264356ed494afc92298bb8cdc220c2'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:04:35.883272 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-3bd8bd55-dbba-404b-8365-b1d26d07666c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a264356ed494afc92298bb8cdc220c2'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:04:35.884029 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-3bd8bd55-dbba-404b-8365-b1d26d07666c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a264356ed494afc92298bb8cdc220c2'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:04:35.894139 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-3bd8bd55-dbba-404b-8365-b1d26d07666c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a264356ed494afc92298bb8cdc220c2'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:04:35.906779 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-3bd8bd55-dbba-404b-8365-b1d26d07666c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a264356ed494afc92298bb8cdc220c2'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:04:35.913027 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4185/8397] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 22:04:35 2022] DELETE /identity/v3/users/3a264356ed494afc92298bb8cdc220c2 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:04:35.917876 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbf4611-e92d-4cf9-9c66-d4ec808bc3c8 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:35.918394 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbf4611-e92d-4cf9-9c66-d4ec808bc3c8 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:35.918546 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbf4611-e92d-4cf9-9c66-d4ec808bc3c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:35.936416 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-1dbf4611-e92d-4cf9-9c66-d4ec808bc3c8 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:04:35.937666 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-1dbf4611-e92d-4cf9-9c66-d4ec808bc3c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:04:36.000298 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4213/8398] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:04:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 22:04:36.010641 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd8bd55-dbba-404b-8365-b1d26d07666c admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:04:36.012107 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-3bd8bd55-dbba-404b-8365-b1d26d07666c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:04:36.071239 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd8bd55-dbba-404b-8365-b1d26d07666c admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:04:36.075175 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baaaa0e-71ee-4f72-88c6-e9d6d3ffcd36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:04:36.075826 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baaaa0e-71ee-4f72-88c6-e9d6d3ffcd36 service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:36.076106 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baaaa0e-71ee-4f72-88c6-e9d6d3ffcd36 service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:36.076379 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baaaa0e-71ee-4f72-88c6-e9d6d3ffcd36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:36.086167 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baaaa0e-71ee-4f72-88c6-e9d6d3ffcd36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:04:36.087609 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baaaa0e-71ee-4f72-88c6-e9d6d3ffcd36 service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:04:36.097791 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4186/8399] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:04:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:04:36.284998 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbf4611-e92d-4cf9-9c66-d4ec808bc3c8 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:04:36.286515 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-1dbf4611-e92d-4cf9-9c66-d4ec808bc3c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:04:36.299673 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbf4611-e92d-4cf9-9c66-d4ec808bc3c8 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:04:36.305133 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88a3d21-12e7-4b94-8129-207b61b133d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:04:36.306054 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88a3d21-12e7-4b94-8129-207b61b133d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:36.306346 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88a3d21-12e7-4b94-8129-207b61b133d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:36.306591 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88a3d21-12e7-4b94-8129-207b61b133d1 admin admin] PATH_INFO: `/v3/projects/aede97dc5318420686169d8bec4e83a3` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:36.307929 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88a3d21-12e7-4b94-8129-207b61b133d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aede97dc5318420686169d8bec4e83a3)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:04:36.309776 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88a3d21-12e7-4b94-8129-207b61b133d1 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:04:36.359804 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-d88a3d21-12e7-4b94-8129-207b61b133d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aede97dc5318420686169d8bec4e83a3', 'request_id': 'req-d88a3d21-12e7-4b94-8129-207b61b133d1'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:04:36.368502 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-d88a3d21-12e7-4b94-8129-207b61b133d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aede97dc5318420686169d8bec4e83a3', 'request_id': 'req-d88a3d21-12e7-4b94-8129-207b61b133d1'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:04:36.374029 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-d88a3d21-12e7-4b94-8129-207b61b133d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aede97dc5318420686169d8bec4e83a3', 'request_id': 'req-d88a3d21-12e7-4b94-8129-207b61b133d1'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:04:36.384817 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-d88a3d21-12e7-4b94-8129-207b61b133d1 admin admin] The token cache is being invalidate because project aede97dc5318420686169d8bec4e83a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 22:04:36.385094 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-d88a3d21-12e7-4b94-8129-207b61b133d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:04:36.385711 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-d88a3d21-12e7-4b94-8129-207b61b133d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:04:36.387304 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4214/8400] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 22:04:36 2022] DELETE /identity/v3/projects/aede97dc5318420686169d8bec4e83a3 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:04:36.392355 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a1d294-3296-4825-887d-e68fd6b9c897 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:36.392635 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a1d294-3296-4825-887d-e68fd6b9c897 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:36.392914 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a1d294-3296-4825-887d-e68fd6b9c897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:36.412018 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-74a1d294-3296-4825-887d-e68fd6b9c897 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:04:36.413231 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-74a1d294-3296-4825-887d-e68fd6b9c897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:04:36.431875 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:04:36.479280 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4187/8401] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:04:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:04:36.487567 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74f293a-55b5-4534-be37-bd02d49a1c02 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:36.487855 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74f293a-55b5-4534-be37-bd02d49a1c02 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:36.488126 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74f293a-55b5-4534-be37-bd02d49a1c02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:36.507087 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-e74f293a-55b5-4534-be37-bd02d49a1c02 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:04:36.508278 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-e74f293a-55b5-4534-be37-bd02d49a1c02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:04:36.516821 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4215/8402] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:04:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:04:36.521144 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a1d294-3296-4825-887d-e68fd6b9c897 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:04:36.531593 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a1d294-3296-4825-887d-e68fd6b9c897 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:04:36.537038 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1669d2-21a7-4e8c-9a7c-aa32246e7310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:04:36.537772 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1669d2-21a7-4e8c-9a7c-aa32246e7310 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:36.538091 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1669d2-21a7-4e8c-9a7c-aa32246e7310 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:36.538366 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1669d2-21a7-4e8c-9a7c-aa32246e7310 admin admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:36.539099 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1669d2-21a7-4e8c-9a7c-aa32246e7310 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 22:04:36.539407 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1669d2-21a7-4e8c-9a7c-aa32246e7310 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:04:36.541010 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1669d2-21a7-4e8c-9a7c-aa32246e7310 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:04:36.553670 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4188/8403] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 22:04:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 22:04:36.558328 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74f293a-55b5-4534-be37-bd02d49a1c02 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:04:36.568446 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74f293a-55b5-4534-be37-bd02d49a1c02 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:04:36.573426 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f348a1-3dc3-4594-bd34-46bb10b2d432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:04:36.574134 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f348a1-3dc3-4594-bd34-46bb10b2d432 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:36.574412 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f348a1-3dc3-4594-bd34-46bb10b2d432 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:36.574834 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f348a1-3dc3-4594-bd34-46bb10b2d432 admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:36.575359 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f348a1-3dc3-4594-bd34-46bb10b2d432 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:04:36.577289 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f348a1-3dc3-4594-bd34-46bb10b2d432 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:04:36.604552 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4216/8404] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 22:04:36 2022] POST /identity/v3/projects => generated 377 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 22:04:36.608895 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1669d2-21a7-4e8c-9a7c-aa32246e7310 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:04:36.619336 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1669d2-21a7-4e8c-9a7c-aa32246e7310 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:04:36.678339 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2b4212-dabd-4d06-b0e7-83ea1c99b507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:04:36.678926 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2b4212-dabd-4d06-b0e7-83ea1c99b507 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:36.679205 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2b4212-dabd-4d06-b0e7-83ea1c99b507 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:36.679478 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2b4212-dabd-4d06-b0e7-83ea1c99b507 admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:36.680187 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2b4212-dabd-4d06-b0e7-83ea1c99b507 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:04:36.682175 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2b4212-dabd-4d06-b0e7-83ea1c99b507 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:04:36.704836 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4189/8405] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 22:04:36 2022] POST /identity/v3/users => generated 289 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 22:04:36.709205 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f348a1-3dc3-4594-bd34-46bb10b2d432 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:04:36.720860 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f348a1-3dc3-4594-bd34-46bb10b2d432 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:04:36.726146 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10b68ac-df19-433a-8140-0f3e2bd167aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:04:36.726870 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10b68ac-df19-433a-8140-0f3e2bd167aa admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:36.727152 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10b68ac-df19-433a-8140-0f3e2bd167aa admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:36.727422 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10b68ac-df19-433a-8140-0f3e2bd167aa admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:36.728145 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10b68ac-df19-433a-8140-0f3e2bd167aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:04:36.729756 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10b68ac-df19-433a-8140-0f3e2bd167aa admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:04:36.740894 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4217/8406] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 22:04:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 22:04:36.744972 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2b4212-dabd-4d06-b0e7-83ea1c99b507 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:04:36.755649 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2b4212-dabd-4d06-b0e7-83ea1c99b507 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:04:36.760794 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a9f411-e99d-4c23-a4e6-4081c6237e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:04:36.761498 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a9f411-e99d-4c23-a4e6-4081c6237e92 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:36.761776 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a9f411-e99d-4c23-a4e6-4081c6237e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:36.762079 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a9f411-e99d-4c23-a4e6-4081c6237e92 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:36.762794 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a9f411-e99d-4c23-a4e6-4081c6237e92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:04:36.764416 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a9f411-e99d-4c23-a4e6-4081c6237e92 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:04:36.774559 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4190/8407] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 22:04:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 22:04:36.778758 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10b68ac-df19-433a-8140-0f3e2bd167aa admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:04:36.789626 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10b68ac-df19-433a-8140-0f3e2bd167aa admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:04:36.794827 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b6242b-3811-4874-b354-4fea885244cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:04:36.795760 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b6242b-3811-4874-b354-4fea885244cf admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:36.796046 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b6242b-3811-4874-b354-4fea885244cf admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:36.796367 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b6242b-3811-4874-b354-4fea885244cf admin admin] PATH_INFO: `/v3/projects/e8bf0cf3c6ed4a5db43d547b360f9bf7/users/a6bf78eb676e4f46bd6e939b6c0f3b39/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:36.811860 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b6242b-3811-4874-b354-4fea885244cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8bf0cf3c6ed4a5db43d547b360f9bf7, user_id=a6bf78eb676e4f46bd6e939b6c0f3b39, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:04:36.814632 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b6242b-3811-4874-b354-4fea885244cf admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:04:36.829814 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4218/8408] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 22:04:36 2022] PUT /identity/v3/projects/e8bf0cf3c6ed4a5db43d547b360f9bf7/users/a6bf78eb676e4f46bd6e939b6c0f3b39/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:04:36.841190 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86861cea-c06a-401d-a5d1-99a9df8f296e None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:36.841477 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86861cea-c06a-401d-a5d1-99a9df8f296e None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:36.841752 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86861cea-c06a-401d-a5d1-99a9df8f296e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:36.870103 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-86861cea-c06a-401d-a5d1-99a9df8f296e None None] MFA Rules not processed for user `a6bf78eb676e4f46bd6e939b6c0f3b39`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:04:36.871315 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-86861cea-c06a-401d-a5d1-99a9df8f296e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:04:36.937371 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4191/8409] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:04:36 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:04:36.959242 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b6242b-3811-4874-b354-4fea885244cf admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:04:36.961147 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-49b6242b-3811-4874-b354-4fea885244cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:04:36.984302 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:04:37.021879 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b6242b-3811-4874-b354-4fea885244cf admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:04:37.026145 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6df0def-b9f2-44ef-a20a-28c2ecd7729d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:04:37.026804 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6df0def-b9f2-44ef-a20a-28c2ecd7729d service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:37.027090 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6df0def-b9f2-44ef-a20a-28c2ecd7729d service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:37.027367 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6df0def-b9f2-44ef-a20a-28c2ecd7729d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:37.036356 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6df0def-b9f2-44ef-a20a-28c2ecd7729d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:04:37.037854 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6df0def-b9f2-44ef-a20a-28c2ecd7729d service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:04:37.047885 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4219/8410] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:04:36 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 23 22:04:37.061472 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86861cea-c06a-401d-a5d1-99a9df8f296e None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:04:37.081101 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:04:37.126153 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86861cea-c06a-401d-a5d1-99a9df8f296e None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:04:37.130982 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf035f6-8aa3-41d3-b552-6911fc12e8a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:04:37.131854 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf035f6-8aa3-41d3-b552-6911fc12e8a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:37.132134 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf035f6-8aa3-41d3-b552-6911fc12e8a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:37.132411 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf035f6-8aa3-41d3-b552-6911fc12e8a5 admin admin] PATH_INFO: `/v3/users/a6bf78eb676e4f46bd6e939b6c0f3b39` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:37.133651 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf035f6-8aa3-41d3-b552-6911fc12e8a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6bf78eb676e4f46bd6e939b6c0f3b39)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:04:37.135886 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf035f6-8aa3-41d3-b552-6911fc12e8a5 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:04:37.185903 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-7bf035f6-8aa3-41d3-b552-6911fc12e8a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6bf78eb676e4f46bd6e939b6c0f3b39'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:04:37.194459 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-7bf035f6-8aa3-41d3-b552-6911fc12e8a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6bf78eb676e4f46bd6e939b6c0f3b39'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:04:37.195149 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-7bf035f6-8aa3-41d3-b552-6911fc12e8a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6bf78eb676e4f46bd6e939b6c0f3b39'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:04:37.204756 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-7bf035f6-8aa3-41d3-b552-6911fc12e8a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6bf78eb676e4f46bd6e939b6c0f3b39'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:04:37.218934 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-7bf035f6-8aa3-41d3-b552-6911fc12e8a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6bf78eb676e4f46bd6e939b6c0f3b39'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:04:37.225334 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4192/8411] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 22:04:37 2022] DELETE /identity/v3/users/a6bf78eb676e4f46bd6e939b6c0f3b39 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:04:37.230235 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3131e1a9-37a6-4ec4-b109-1afb31ee7cf3 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:37.230758 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3131e1a9-37a6-4ec4-b109-1afb31ee7cf3 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:37.231035 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3131e1a9-37a6-4ec4-b109-1afb31ee7cf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:37.248720 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-3131e1a9-37a6-4ec4-b109-1afb31ee7cf3 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:04:37.249960 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-3131e1a9-37a6-4ec4-b109-1afb31ee7cf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:04:37.315468 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4220/8412] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:04:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:04:37.328420 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf035f6-8aa3-41d3-b552-6911fc12e8a5 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:04:37.330238 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-7bf035f6-8aa3-41d3-b552-6911fc12e8a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:04:37.392592 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf035f6-8aa3-41d3-b552-6911fc12e8a5 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:04:37.396683 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd423fbf-0ce8-4728-b3e5-6a112f0f6269 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:04:37.397303 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd423fbf-0ce8-4728-b3e5-6a112f0f6269 service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:37.397564 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd423fbf-0ce8-4728-b3e5-6a112f0f6269 service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:37.397834 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd423fbf-0ce8-4728-b3e5-6a112f0f6269 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:37.407398 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd423fbf-0ce8-4728-b3e5-6a112f0f6269 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:04:37.408950 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd423fbf-0ce8-4728-b3e5-6a112f0f6269 service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:04:37.418533 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4193/8413] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:04:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:04:37.703420 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3131e1a9-37a6-4ec4-b109-1afb31ee7cf3 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:04:37.705087 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-3131e1a9-37a6-4ec4-b109-1afb31ee7cf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:04:37.719828 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3131e1a9-37a6-4ec4-b109-1afb31ee7cf3 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:04:37.726010 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd81c2d-7e39-4daa-8186-e36f5c7282ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:04:37.726923 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd81c2d-7e39-4daa-8186-e36f5c7282ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:37.727243 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd81c2d-7e39-4daa-8186-e36f5c7282ca admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:37.727608 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd81c2d-7e39-4daa-8186-e36f5c7282ca admin admin] PATH_INFO: `/v3/projects/e8bf0cf3c6ed4a5db43d547b360f9bf7` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:37.728809 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd81c2d-7e39-4daa-8186-e36f5c7282ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8bf0cf3c6ed4a5db43d547b360f9bf7)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:04:37.730743 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd81c2d-7e39-4daa-8186-e36f5c7282ca admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:04:37.782227 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-ffd81c2d-7e39-4daa-8186-e36f5c7282ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8bf0cf3c6ed4a5db43d547b360f9bf7', 'request_id': 'req-ffd81c2d-7e39-4daa-8186-e36f5c7282ca'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:04:37.791130 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-ffd81c2d-7e39-4daa-8186-e36f5c7282ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8bf0cf3c6ed4a5db43d547b360f9bf7', 'request_id': 'req-ffd81c2d-7e39-4daa-8186-e36f5c7282ca'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:04:37.799868 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-ffd81c2d-7e39-4daa-8186-e36f5c7282ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8bf0cf3c6ed4a5db43d547b360f9bf7', 'request_id': 'req-ffd81c2d-7e39-4daa-8186-e36f5c7282ca'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:04:37.811106 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-ffd81c2d-7e39-4daa-8186-e36f5c7282ca admin admin] The token cache is being invalidate because project e8bf0cf3c6ed4a5db43d547b360f9bf7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 22:04:37.811348 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-ffd81c2d-7e39-4daa-8186-e36f5c7282ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:04:37.812069 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-ffd81c2d-7e39-4daa-8186-e36f5c7282ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:04:37.813626 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4221/8414] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 22:04:37 2022] DELETE /identity/v3/projects/e8bf0cf3c6ed4a5db43d547b360f9bf7 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 22:04:37.819061 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628240e8-09c0-4fbf-9f31-dfbd0009bab8 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:37.819516 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628240e8-09c0-4fbf-9f31-dfbd0009bab8 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:37.819857 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628240e8-09c0-4fbf-9f31-dfbd0009bab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:37.838974 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-628240e8-09c0-4fbf-9f31-dfbd0009bab8 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:04:37.840542 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-628240e8-09c0-4fbf-9f31-dfbd0009bab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:04:37.875278 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:04:37.905500 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4194/8415] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:04:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:04:37.913840 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c7a34e-ce67-4604-8b60-9847533e9783 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:37.914153 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c7a34e-ce67-4604-8b60-9847533e9783 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:37.914432 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c7a34e-ce67-4604-8b60-9847533e9783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:37.938866 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-22c7a34e-ce67-4604-8b60-9847533e9783 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:04:37.940688 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-22c7a34e-ce67-4604-8b60-9847533e9783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:04:37.952453 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4222/8416] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:04:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:04:37.957753 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628240e8-09c0-4fbf-9f31-dfbd0009bab8 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:04:37.971568 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628240e8-09c0-4fbf-9f31-dfbd0009bab8 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:04:37.977247 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ef16d1-3c01-4a1a-8a95-33c5f425c741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:04:37.977949 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ef16d1-3c01-4a1a-8a95-33c5f425c741 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:37.978230 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ef16d1-3c01-4a1a-8a95-33c5f425c741 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:37.978524 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ef16d1-3c01-4a1a-8a95-33c5f425c741 admin admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:37.979286 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ef16d1-3c01-4a1a-8a95-33c5f425c741 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 22:04:37.979594 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ef16d1-3c01-4a1a-8a95-33c5f425c741 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:04:37.981254 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ef16d1-3c01-4a1a-8a95-33c5f425c741 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:04:37.994425 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4195/8417] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 22:04:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 22:04:37.999753 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c7a34e-ce67-4604-8b60-9847533e9783 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:04:38.010476 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c7a34e-ce67-4604-8b60-9847533e9783 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:04:38.016550 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89577077-9b55-4476-b9b0-d3222f8ba6b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:04:38.017219 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89577077-9b55-4476-b9b0-d3222f8ba6b4 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:38.017503 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89577077-9b55-4476-b9b0-d3222f8ba6b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:38.017786 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89577077-9b55-4476-b9b0-d3222f8ba6b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:38.018514 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89577077-9b55-4476-b9b0-d3222f8ba6b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:04:38.020480 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89577077-9b55-4476-b9b0-d3222f8ba6b4 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:04:38.048152 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4223/8418] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 22:04:37 2022] POST /identity/v3/projects => generated 403 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 22:04:38.052373 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ef16d1-3c01-4a1a-8a95-33c5f425c741 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:04:38.062906 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ef16d1-3c01-4a1a-8a95-33c5f425c741 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:04:38.120379 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6de1e3-9ea0-46fb-ab70-e440ea21f70e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:04:38.121046 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6de1e3-9ea0-46fb-ab70-e440ea21f70e admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:38.121338 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6de1e3-9ea0-46fb-ab70-e440ea21f70e admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:38.121599 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6de1e3-9ea0-46fb-ab70-e440ea21f70e admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:38.122339 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6de1e3-9ea0-46fb-ab70-e440ea21f70e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:04:38.124281 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6de1e3-9ea0-46fb-ab70-e440ea21f70e admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:04:38.146179 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4196/8419] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 22:04:38 2022] POST /identity/v3/users => generated 302 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 22:04:38.150226 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89577077-9b55-4476-b9b0-d3222f8ba6b4 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:04:38.161155 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89577077-9b55-4476-b9b0-d3222f8ba6b4 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:04:38.166230 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6216ca-8eb1-4d35-ab44-c39c932fd06b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:04:38.166947 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6216ca-8eb1-4d35-ab44-c39c932fd06b admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:38.167234 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6216ca-8eb1-4d35-ab44-c39c932fd06b admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:38.167515 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6216ca-8eb1-4d35-ab44-c39c932fd06b admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:38.168250 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6216ca-8eb1-4d35-ab44-c39c932fd06b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:04:38.169900 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6216ca-8eb1-4d35-ab44-c39c932fd06b admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:04:38.181120 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4224/8420] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 22:04:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 22:04:38.185193 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6de1e3-9ea0-46fb-ab70-e440ea21f70e admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:04:38.196289 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6de1e3-9ea0-46fb-ab70-e440ea21f70e admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:04:38.202621 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3b71d3-d3a4-4084-946c-0cb1690b7c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:04:38.203296 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3b71d3-d3a4-4084-946c-0cb1690b7c93 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:38.203565 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3b71d3-d3a4-4084-946c-0cb1690b7c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:38.203830 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3b71d3-d3a4-4084-946c-0cb1690b7c93 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:38.204562 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3b71d3-d3a4-4084-946c-0cb1690b7c93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:04:38.206195 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3b71d3-d3a4-4084-946c-0cb1690b7c93 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:04:38.217104 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4197/8421] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 22:04:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 22:04:38.221349 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6216ca-8eb1-4d35-ab44-c39c932fd06b admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:04:38.232315 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6216ca-8eb1-4d35-ab44-c39c932fd06b admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:04:38.238438 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e841d5-4197-4b13-8cc8-0aad1a4f30a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:04:38.239345 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e841d5-4197-4b13-8cc8-0aad1a4f30a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:38.239625 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e841d5-4197-4b13-8cc8-0aad1a4f30a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:38.239901 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e841d5-4197-4b13-8cc8-0aad1a4f30a1 admin admin] PATH_INFO: `/v3/projects/4fbd297bc76d4120bae740455259775a/users/71b300acf824412ebdb8b69dd392aeae/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:38.242502 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:04:38.258113 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e841d5-4197-4b13-8cc8-0aad1a4f30a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fbd297bc76d4120bae740455259775a, user_id=71b300acf824412ebdb8b69dd392aeae, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:04:38.260805 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e841d5-4197-4b13-8cc8-0aad1a4f30a1 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:04:38.275332 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4225/8422] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 22:04:38 2022] PUT /identity/v3/projects/4fbd297bc76d4120bae740455259775a/users/71b300acf824412ebdb8b69dd392aeae/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:04:38.287269 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599a16e5-cc07-4a95-8999-bbe3eb8708d6 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:38.287560 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599a16e5-cc07-4a95-8999-bbe3eb8708d6 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:38.287843 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599a16e5-cc07-4a95-8999-bbe3eb8708d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:38.321914 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-599a16e5-cc07-4a95-8999-bbe3eb8708d6 None None] MFA Rules not processed for user `71b300acf824412ebdb8b69dd392aeae`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:04:38.323098 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-599a16e5-cc07-4a95-8999-bbe3eb8708d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:04:38.389254 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4198/8423] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:04:38 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:04:38.394008 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e841d5-4197-4b13-8cc8-0aad1a4f30a1 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:04:38.457165 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e841d5-4197-4b13-8cc8-0aad1a4f30a1 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:04:38.462029 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2355a2db-8cd0-4530-85bd-80a2d618633a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:04:38.462709 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2355a2db-8cd0-4530-85bd-80a2d618633a admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:38.462988 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2355a2db-8cd0-4530-85bd-80a2d618633a admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:38.463259 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2355a2db-8cd0-4530-85bd-80a2d618633a admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:38.463953 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2355a2db-8cd0-4530-85bd-80a2d618633a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:04:38.466434 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2355a2db-8cd0-4530-85bd-80a2d618633a admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:04:38.499586 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4226/8424] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 22:04:38 2022] POST /identity/v3/projects => generated 403 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 22:04:38.503505 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599a16e5-cc07-4a95-8999-bbe3eb8708d6 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:04:38.515382 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599a16e5-cc07-4a95-8999-bbe3eb8708d6 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:04:38.550052 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:04:38.576156 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2734535-1990-4e86-ac68-dd5951bad537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:04:38.577228 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2734535-1990-4e86-ac68-dd5951bad537 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:38.577528 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2734535-1990-4e86-ac68-dd5951bad537 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:38.577802 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2734535-1990-4e86-ac68-dd5951bad537 admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:38.578574 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2734535-1990-4e86-ac68-dd5951bad537 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:04:38.580763 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2734535-1990-4e86-ac68-dd5951bad537 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:04:38.604695 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4199/8425] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 22:04:38 2022] POST /identity/v3/users => generated 308 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 22:04:38.608916 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2355a2db-8cd0-4530-85bd-80a2d618633a admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:04:38.624978 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2355a2db-8cd0-4530-85bd-80a2d618633a admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:04:38.636506 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f0b63b-5e7f-4109-a266-b31fd3239bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:04:38.637199 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f0b63b-5e7f-4109-a266-b31fd3239bd9 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:38.637565 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f0b63b-5e7f-4109-a266-b31fd3239bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:38.637888 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f0b63b-5e7f-4109-a266-b31fd3239bd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:38.638629 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f0b63b-5e7f-4109-a266-b31fd3239bd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:04:38.640281 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f0b63b-5e7f-4109-a266-b31fd3239bd9 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:04:38.652249 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4227/8426] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 22:04:38 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 22:04:38.656599 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2734535-1990-4e86-ac68-dd5951bad537 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:04:38.667120 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2734535-1990-4e86-ac68-dd5951bad537 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:04:38.672070 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7881b077-960b-4a59-baeb-6fded7fb5592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:04:38.672967 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7881b077-960b-4a59-baeb-6fded7fb5592 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:38.673261 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7881b077-960b-4a59-baeb-6fded7fb5592 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:38.673527 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7881b077-960b-4a59-baeb-6fded7fb5592 admin admin] PATH_INFO: `/v3/projects/dee321e9cc2c46ccb2d8f4407ed29861/users/5509b927fd364b2b9f67df26ca40a487/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:38.688457 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7881b077-960b-4a59-baeb-6fded7fb5592 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dee321e9cc2c46ccb2d8f4407ed29861, user_id=5509b927fd364b2b9f67df26ca40a487, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:04:38.691222 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7881b077-960b-4a59-baeb-6fded7fb5592 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:04:38.707971 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4200/8427] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 22:04:38 2022] PUT /identity/v3/projects/dee321e9cc2c46ccb2d8f4407ed29861/users/5509b927fd364b2b9f67df26ca40a487/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:04:38.712257 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f0b63b-5e7f-4109-a266-b31fd3239bd9 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:04:38.723754 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f0b63b-5e7f-4109-a266-b31fd3239bd9 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:04:38.783254 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0308ccf1-84e1-4273-82dc-c68d1cb91132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:04:38.783932 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0308ccf1-84e1-4273-82dc-c68d1cb91132 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:38.784215 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0308ccf1-84e1-4273-82dc-c68d1cb91132 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:38.784557 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0308ccf1-84e1-4273-82dc-c68d1cb91132 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:38.785275 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0308ccf1-84e1-4273-82dc-c68d1cb91132 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:04:38.786938 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0308ccf1-84e1-4273-82dc-c68d1cb91132 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:04:38.796984 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4228/8428] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 22:04:38 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 22:04:38.801381 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7881b077-960b-4a59-baeb-6fded7fb5592 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:04:38.812001 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7881b077-960b-4a59-baeb-6fded7fb5592 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:04:38.816839 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec7611a-6319-4f6a-8fcc-e6ff48445e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:04:38.817761 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec7611a-6319-4f6a-8fcc-e6ff48445e4e admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:38.818076 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec7611a-6319-4f6a-8fcc-e6ff48445e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:38.818356 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec7611a-6319-4f6a-8fcc-e6ff48445e4e admin admin] PATH_INFO: `/v3/projects/dee321e9cc2c46ccb2d8f4407ed29861/users/5509b927fd364b2b9f67df26ca40a487/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:38.820366 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec7611a-6319-4f6a-8fcc-e6ff48445e4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=dee321e9cc2c46ccb2d8f4407ed29861, user_id=5509b927fd364b2b9f67df26ca40a487, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:04:38.823070 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec7611a-6319-4f6a-8fcc-e6ff48445e4e admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:04:38.833834 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4201/8429] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 22:04:38 2022] PUT /identity/v3/projects/dee321e9cc2c46ccb2d8f4407ed29861/users/5509b927fd364b2b9f67df26ca40a487/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 22:04:38.844215 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e52eb7-80b0-4166-9094-f56e81fe9d1e None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:38.844505 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e52eb7-80b0-4166-9094-f56e81fe9d1e None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:38.844767 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e52eb7-80b0-4166-9094-f56e81fe9d1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:38.873596 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-84e52eb7-80b0-4166-9094-f56e81fe9d1e None None] MFA Rules not processed for user `5509b927fd364b2b9f67df26ca40a487`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:04:38.874882 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-84e52eb7-80b0-4166-9094-f56e81fe9d1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:04:38.928340 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:04:38.959329 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4229/8430] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:04:38 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:04:38.970827 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14973279-3546-4025-9572-eede1dd94676 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:38.971115 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14973279-3546-4025-9572-eede1dd94676 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:38.971389 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14973279-3546-4025-9572-eede1dd94676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:39.008717 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-14973279-3546-4025-9572-eede1dd94676 None None] MFA Rules not processed for user `ec5fd3a489c341b7964704d689037f05`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:04:39.009994 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-14973279-3546-4025-9572-eede1dd94676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:04:39.070428 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4202/8431] 10.222.0.17 () {58 vars in 1061 bytes} [Sat Jul 23 22:04:38 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:04:39.077246 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e52eb7-80b0-4166-9094-f56e81fe9d1e None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:04:39.089174 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e52eb7-80b0-4166-9094-f56e81fe9d1e None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:04:39.094258 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a79af9-533f-4393-9125-c6c5bd877ba0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec5fd3a489c341b7964704d689037f05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:04:39.094915 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a79af9-533f-4393-9125-c6c5bd877ba0 service cinder] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:39.095198 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a79af9-533f-4393-9125-c6c5bd877ba0 service cinder] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:39.095471 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a79af9-533f-4393-9125-c6c5bd877ba0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:39.105608 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a79af9-533f-4393-9125-c6c5bd877ba0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:04:39.107111 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a79af9-533f-4393-9125-c6c5bd877ba0 service cinder] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:04:39.117198 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4230/8432] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:04:39 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:04:39.188019 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14973279-3546-4025-9572-eede1dd94676 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:04:39.254092 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14973279-3546-4025-9572-eede1dd94676 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:04:39.259411 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdef932-49d2-4e4e-b579-027b63ea5a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:04:39.260292 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdef932-49d2-4e4e-b579-027b63ea5a67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:39.260566 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdef932-49d2-4e4e-b579-027b63ea5a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:39.260829 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdef932-49d2-4e4e-b579-027b63ea5a67 admin admin] PATH_INFO: `/v3/users/71b300acf824412ebdb8b69dd392aeae` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:39.262105 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdef932-49d2-4e4e-b579-027b63ea5a67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=71b300acf824412ebdb8b69dd392aeae)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:04:39.264031 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdef932-49d2-4e4e-b579-027b63ea5a67 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:04:39.280333 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:04:39.313052 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-dbdef932-49d2-4e4e-b579-027b63ea5a67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71b300acf824412ebdb8b69dd392aeae'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:04:39.319966 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-dbdef932-49d2-4e4e-b579-027b63ea5a67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71b300acf824412ebdb8b69dd392aeae'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:04:39.320628 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-dbdef932-49d2-4e4e-b579-027b63ea5a67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71b300acf824412ebdb8b69dd392aeae'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:04:39.330393 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-dbdef932-49d2-4e4e-b579-027b63ea5a67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71b300acf824412ebdb8b69dd392aeae'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:04:39.342760 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-dbdef932-49d2-4e4e-b579-027b63ea5a67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71b300acf824412ebdb8b69dd392aeae'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:04:39.348632 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4203/8433] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 22:04:39 2022] DELETE /identity/v3/users/71b300acf824412ebdb8b69dd392aeae => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:04:39.353274 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab530b0-cf3f-4510-9a75-7d6f9db2068b None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:39.353561 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab530b0-cf3f-4510-9a75-7d6f9db2068b None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:39.353846 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab530b0-cf3f-4510-9a75-7d6f9db2068b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:39.371577 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-1ab530b0-cf3f-4510-9a75-7d6f9db2068b None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:04:39.372773 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-1ab530b0-cf3f-4510-9a75-7d6f9db2068b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:04:39.432859 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4231/8434] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:04:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:04:39.443231 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdef932-49d2-4e4e-b579-027b63ea5a67 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:04:39.444849 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-dbdef932-49d2-4e4e-b579-027b63ea5a67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:04:39.505345 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdef932-49d2-4e4e-b579-027b63ea5a67 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:04:39.509342 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0edb70a-469e-4eec-87d5-25569fd590f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:04:39.510027 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0edb70a-469e-4eec-87d5-25569fd590f4 service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:39.510306 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0edb70a-469e-4eec-87d5-25569fd590f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:39.510576 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0edb70a-469e-4eec-87d5-25569fd590f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:39.520427 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0edb70a-469e-4eec-87d5-25569fd590f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:04:39.521996 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0edb70a-469e-4eec-87d5-25569fd590f4 service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:04:39.531590 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4204/8435] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:04:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:04:39.823947 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab530b0-cf3f-4510-9a75-7d6f9db2068b None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:04:39.825495 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-1ab530b0-cf3f-4510-9a75-7d6f9db2068b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:04:39.838534 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab530b0-cf3f-4510-9a75-7d6f9db2068b None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:04:39.843955 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7816b9ff-fb07-4515-83fd-c8ad18240315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:04:39.844888 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7816b9ff-fb07-4515-83fd-c8ad18240315 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:39.845144 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7816b9ff-fb07-4515-83fd-c8ad18240315 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:39.845436 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7816b9ff-fb07-4515-83fd-c8ad18240315 admin admin] PATH_INFO: `/v3/projects/4fbd297bc76d4120bae740455259775a` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:39.846630 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7816b9ff-fb07-4515-83fd-c8ad18240315 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4fbd297bc76d4120bae740455259775a)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:04:39.848562 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7816b9ff-fb07-4515-83fd-c8ad18240315 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:04:39.899235 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-7816b9ff-fb07-4515-83fd-c8ad18240315 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fbd297bc76d4120bae740455259775a', 'request_id': 'req-7816b9ff-fb07-4515-83fd-c8ad18240315'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:04:39.908865 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-7816b9ff-fb07-4515-83fd-c8ad18240315 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fbd297bc76d4120bae740455259775a', 'request_id': 'req-7816b9ff-fb07-4515-83fd-c8ad18240315'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:04:39.914649 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-7816b9ff-fb07-4515-83fd-c8ad18240315 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fbd297bc76d4120bae740455259775a', 'request_id': 'req-7816b9ff-fb07-4515-83fd-c8ad18240315'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:04:39.925768 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-7816b9ff-fb07-4515-83fd-c8ad18240315 admin admin] The token cache is being invalidate because project 4fbd297bc76d4120bae740455259775a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 22:04:39.926093 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-7816b9ff-fb07-4515-83fd-c8ad18240315 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:04:39.926728 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-7816b9ff-fb07-4515-83fd-c8ad18240315 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:04:39.928338 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4232/8436] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 22:04:39 2022] DELETE /identity/v3/projects/4fbd297bc76d4120bae740455259775a => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 22:04:39.932849 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0edb70a-469e-4eec-87d5-25569fd590f4 service neutron] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:04:39.943382 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0edb70a-469e-4eec-87d5-25569fd590f4 service neutron] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:04:40.002030 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec7bbad-b7d8-4055-8adf-91a2f3cc03ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:04:40.002917 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec7bbad-b7d8-4055-8adf-91a2f3cc03ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:40.003226 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec7bbad-b7d8-4055-8adf-91a2f3cc03ff admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:40.003511 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec7bbad-b7d8-4055-8adf-91a2f3cc03ff admin admin] PATH_INFO: `/v3/users/5509b927fd364b2b9f67df26ca40a487` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:40.004713 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec7bbad-b7d8-4055-8adf-91a2f3cc03ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=5509b927fd364b2b9f67df26ca40a487)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:04:40.006822 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec7bbad-b7d8-4055-8adf-91a2f3cc03ff admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:04:40.050048 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:04:40.056284 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-5ec7bbad-b7d8-4055-8adf-91a2f3cc03ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5509b927fd364b2b9f67df26ca40a487'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:04:40.064219 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-5ec7bbad-b7d8-4055-8adf-91a2f3cc03ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5509b927fd364b2b9f67df26ca40a487'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:04:40.064872 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-5ec7bbad-b7d8-4055-8adf-91a2f3cc03ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5509b927fd364b2b9f67df26ca40a487'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:04:40.073208 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-5ec7bbad-b7d8-4055-8adf-91a2f3cc03ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5509b927fd364b2b9f67df26ca40a487'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:04:40.084928 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-5ec7bbad-b7d8-4055-8adf-91a2f3cc03ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5509b927fd364b2b9f67df26ca40a487'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:04:40.091124 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4205/8437] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 22:04:39 2022] DELETE /identity/v3/users/5509b927fd364b2b9f67df26ca40a487 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:04:40.371517 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7816b9ff-fb07-4515-83fd-c8ad18240315 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:04:40.373131 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-7816b9ff-fb07-4515-83fd-c8ad18240315 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:04:40.386756 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7816b9ff-fb07-4515-83fd-c8ad18240315 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:04:40.432414 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:04:40.447601 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b074de97-506f-4fd9-b514-e4b07d8e4286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:04:40.448518 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b074de97-506f-4fd9-b514-e4b07d8e4286 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:40.448823 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b074de97-506f-4fd9-b514-e4b07d8e4286 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:40.449095 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b074de97-506f-4fd9-b514-e4b07d8e4286 admin admin] PATH_INFO: `/v3/projects/dee321e9cc2c46ccb2d8f4407ed29861` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:40.450314 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b074de97-506f-4fd9-b514-e4b07d8e4286 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dee321e9cc2c46ccb2d8f4407ed29861)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:04:40.452248 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b074de97-506f-4fd9-b514-e4b07d8e4286 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:04:40.504430 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-b074de97-506f-4fd9-b514-e4b07d8e4286 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dee321e9cc2c46ccb2d8f4407ed29861', 'request_id': 'req-b074de97-506f-4fd9-b514-e4b07d8e4286'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:04:40.514101 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-b074de97-506f-4fd9-b514-e4b07d8e4286 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dee321e9cc2c46ccb2d8f4407ed29861', 'request_id': 'req-b074de97-506f-4fd9-b514-e4b07d8e4286'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:04:40.520398 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-b074de97-506f-4fd9-b514-e4b07d8e4286 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dee321e9cc2c46ccb2d8f4407ed29861', 'request_id': 'req-b074de97-506f-4fd9-b514-e4b07d8e4286'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:04:40.532050 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-b074de97-506f-4fd9-b514-e4b07d8e4286 admin admin] The token cache is being invalidate because project dee321e9cc2c46ccb2d8f4407ed29861 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 22:04:40.532353 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-b074de97-506f-4fd9-b514-e4b07d8e4286 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:04:40.533144 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-b074de97-506f-4fd9-b514-e4b07d8e4286 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:04:40.534892 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4233/8438] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 22:04:40 2022] DELETE /identity/v3/projects/dee321e9cc2c46ccb2d8f4407ed29861 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:04:40.540190 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d66b862-27bb-4447-a3a0-ef39c7569c5e None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:40.540480 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d66b862-27bb-4447-a3a0-ef39c7569c5e None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:40.540775 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d66b862-27bb-4447-a3a0-ef39c7569c5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:40.560612 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-9d66b862-27bb-4447-a3a0-ef39c7569c5e None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:04:40.561818 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-9d66b862-27bb-4447-a3a0-ef39c7569c5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:04:40.625856 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4206/8439] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:04:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:04:40.635911 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c84729-df88-4a50-ad6a-2563653f82e1 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:40.636319 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c84729-df88-4a50-ad6a-2563653f82e1 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:40.636628 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c84729-df88-4a50-ad6a-2563653f82e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:40.659536 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-76c84729-df88-4a50-ad6a-2563653f82e1 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:04:40.661297 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-76c84729-df88-4a50-ad6a-2563653f82e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:04:40.671680 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4234/8440] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:04:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:04:40.677555 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d66b862-27bb-4447-a3a0-ef39c7569c5e None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:04:40.695204 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d66b862-27bb-4447-a3a0-ef39c7569c5e None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:04:40.702975 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ac106e-cd20-4e33-80cb-f66d5cefb1f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:04:40.703906 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ac106e-cd20-4e33-80cb-f66d5cefb1f3 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:40.704287 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ac106e-cd20-4e33-80cb-f66d5cefb1f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:40.704630 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ac106e-cd20-4e33-80cb-f66d5cefb1f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:40.705511 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ac106e-cd20-4e33-80cb-f66d5cefb1f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 22:04:40.705816 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ac106e-cd20-4e33-80cb-f66d5cefb1f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:04:40.707456 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ac106e-cd20-4e33-80cb-f66d5cefb1f3 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:04:40.719721 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4207/8441] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 22:04:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 22:04:40.724274 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c84729-df88-4a50-ad6a-2563653f82e1 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:04:40.734317 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c84729-df88-4a50-ad6a-2563653f82e1 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:04:40.740085 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0161b7-0c9c-4461-bbf3-65d4c85b5bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:04:40.740743 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0161b7-0c9c-4461-bbf3-65d4c85b5bea admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:40.741019 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0161b7-0c9c-4461-bbf3-65d4c85b5bea admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:40.741293 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0161b7-0c9c-4461-bbf3-65d4c85b5bea admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:40.742031 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0161b7-0c9c-4461-bbf3-65d4c85b5bea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:04:40.743938 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0161b7-0c9c-4461-bbf3-65d4c85b5bea admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:04:40.775713 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4235/8442] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 22:04:40 2022] POST /identity/v3/projects => generated 379 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 22:04:40.776986 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ac106e-cd20-4e33-80cb-f66d5cefb1f3 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:04:40.787314 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ac106e-cd20-4e33-80cb-f66d5cefb1f3 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:04:40.844366 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe5b0a9-e051-4bdd-b495-1e799c191d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:04:40.845039 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe5b0a9-e051-4bdd-b495-1e799c191d25 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:40.845322 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe5b0a9-e051-4bdd-b495-1e799c191d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:40.845621 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe5b0a9-e051-4bdd-b495-1e799c191d25 admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:40.846348 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe5b0a9-e051-4bdd-b495-1e799c191d25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:04:40.848263 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe5b0a9-e051-4bdd-b495-1e799c191d25 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:04:40.869799 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4208/8443] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 22:04:40 2022] POST /identity/v3/users => generated 290 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 22:04:40.874014 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0161b7-0c9c-4461-bbf3-65d4c85b5bea admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:04:40.884895 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0161b7-0c9c-4461-bbf3-65d4c85b5bea admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:04:40.890086 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643ef18b-43f2-42e8-b028-83f7ccde6c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:04:40.890756 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643ef18b-43f2-42e8-b028-83f7ccde6c25 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:40.891005 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643ef18b-43f2-42e8-b028-83f7ccde6c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:40.891282 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643ef18b-43f2-42e8-b028-83f7ccde6c25 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:40.892012 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643ef18b-43f2-42e8-b028-83f7ccde6c25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:04:40.893667 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643ef18b-43f2-42e8-b028-83f7ccde6c25 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:04:40.904443 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4236/8444] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 22:04:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 22:04:40.908349 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe5b0a9-e051-4bdd-b495-1e799c191d25 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:04:40.919078 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe5b0a9-e051-4bdd-b495-1e799c191d25 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:04:40.924944 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9960da-533e-40d2-82e0-05c7ae444a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:04:40.925687 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9960da-533e-40d2-82e0-05c7ae444a5f admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:40.925963 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9960da-533e-40d2-82e0-05c7ae444a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:40.926239 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9960da-533e-40d2-82e0-05c7ae444a5f admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:40.927097 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9960da-533e-40d2-82e0-05c7ae444a5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:04:40.929611 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9960da-533e-40d2-82e0-05c7ae444a5f admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:04:40.942339 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4209/8445] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 22:04:40 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 22:04:40.946818 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643ef18b-43f2-42e8-b028-83f7ccde6c25 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:04:40.957247 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643ef18b-43f2-42e8-b028-83f7ccde6c25 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:04:40.962142 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e6c687-a8e7-4c27-ad14-274ecfeb4be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:04:40.963032 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e6c687-a8e7-4c27-ad14-274ecfeb4be6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:40.963328 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e6c687-a8e7-4c27-ad14-274ecfeb4be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:40.963584 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e6c687-a8e7-4c27-ad14-274ecfeb4be6 admin admin] PATH_INFO: `/v3/projects/c65e4c8d8ffc41e3bdf47c7bbcb8cb6a/users/5090ca7992af484c96954f723ae58615/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:40.978821 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e6c687-a8e7-4c27-ad14-274ecfeb4be6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c65e4c8d8ffc41e3bdf47c7bbcb8cb6a, user_id=5090ca7992af484c96954f723ae58615, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:04:40.981486 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e6c687-a8e7-4c27-ad14-274ecfeb4be6 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:04:40.995882 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4237/8446] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 22:04:40 2022] PUT /identity/v3/projects/c65e4c8d8ffc41e3bdf47c7bbcb8cb6a/users/5090ca7992af484c96954f723ae58615/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 22:04:41.007443 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b4df0d-0287-48d8-a366-572157c55fc8 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:41.007737 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b4df0d-0287-48d8-a366-572157c55fc8 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:41.008027 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b4df0d-0287-48d8-a366-572157c55fc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:41.034859 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-43b4df0d-0287-48d8-a366-572157c55fc8 None None] MFA Rules not processed for user `5090ca7992af484c96954f723ae58615`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:04:41.036067 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-43b4df0d-0287-48d8-a366-572157c55fc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:04:41.045621 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:04:41.119325 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4210/8447] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:04:41 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:04:41.126164 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e6c687-a8e7-4c27-ad14-274ecfeb4be6 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:04:41.191422 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e6c687-a8e7-4c27-ad14-274ecfeb4be6 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:04:41.198937 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa7c5bb-7e72-46fe-a2e3-24f06769455e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:04:41.199926 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa7c5bb-7e72-46fe-a2e3-24f06769455e admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:41.200311 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa7c5bb-7e72-46fe-a2e3-24f06769455e admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:41.200675 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa7c5bb-7e72-46fe-a2e3-24f06769455e admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:41.201714 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa7c5bb-7e72-46fe-a2e3-24f06769455e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:04:41.204403 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa7c5bb-7e72-46fe-a2e3-24f06769455e admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:04:41.231978 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:04:41.240480 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4238/8448] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 22:04:41 2022] POST /identity/v3/projects => generated 381 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 22:04:41.244609 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b4df0d-0287-48d8-a366-572157c55fc8 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:04:41.256072 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b4df0d-0287-48d8-a366-572157c55fc8 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:04:41.325896 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1c4501-391c-47de-b0de-6432db8c6466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:04:41.326595 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1c4501-391c-47de-b0de-6432db8c6466 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:41.326879 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1c4501-391c-47de-b0de-6432db8c6466 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:41.327152 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1c4501-391c-47de-b0de-6432db8c6466 admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:41.327839 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1c4501-391c-47de-b0de-6432db8c6466 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:04:41.329796 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1c4501-391c-47de-b0de-6432db8c6466 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:04:41.352066 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4211/8449] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 22:04:41 2022] POST /identity/v3/users => generated 297 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 22:04:41.358123 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa7c5bb-7e72-46fe-a2e3-24f06769455e admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:04:41.370564 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa7c5bb-7e72-46fe-a2e3-24f06769455e admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:04:41.376680 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c9eec3-e570-4123-b7c8-027e8a759ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:04:41.377307 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c9eec3-e570-4123-b7c8-027e8a759ceb admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:41.377626 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c9eec3-e570-4123-b7c8-027e8a759ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:41.377909 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c9eec3-e570-4123-b7c8-027e8a759ceb admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:41.378648 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c9eec3-e570-4123-b7c8-027e8a759ceb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:04:41.380275 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c9eec3-e570-4123-b7c8-027e8a759ceb admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:04:41.392603 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4239/8450] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 22:04:41 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 22:04:41.396868 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1c4501-391c-47de-b0de-6432db8c6466 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:04:41.407430 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1c4501-391c-47de-b0de-6432db8c6466 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:04:41.412975 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ba0351-b994-4f17-a0ea-af0b399c853f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:04:41.413882 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ba0351-b994-4f17-a0ea-af0b399c853f admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:41.414173 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ba0351-b994-4f17-a0ea-af0b399c853f admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:41.414443 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ba0351-b994-4f17-a0ea-af0b399c853f admin admin] PATH_INFO: `/v3/projects/c1ce1877c6c749948be0c6c218d939c4/users/17dc12dce5ab41e98a9fa81b4d86bbbe/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:41.429447 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ba0351-b994-4f17-a0ea-af0b399c853f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1ce1877c6c749948be0c6c218d939c4, user_id=17dc12dce5ab41e98a9fa81b4d86bbbe, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:04:41.432118 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ba0351-b994-4f17-a0ea-af0b399c853f admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:04:41.447006 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4212/8451] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 22:04:41 2022] PUT /identity/v3/projects/c1ce1877c6c749948be0c6c218d939c4/users/17dc12dce5ab41e98a9fa81b4d86bbbe/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:04:41.450987 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c9eec3-e570-4123-b7c8-027e8a759ceb admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:04:41.461499 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c9eec3-e570-4123-b7c8-027e8a759ceb admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:04:41.519495 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852b8435-377c-4493-aa04-b3415a536650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:04:41.520166 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852b8435-377c-4493-aa04-b3415a536650 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:41.520473 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852b8435-377c-4493-aa04-b3415a536650 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:41.520742 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852b8435-377c-4493-aa04-b3415a536650 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:41.521457 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852b8435-377c-4493-aa04-b3415a536650 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:04:41.523088 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852b8435-377c-4493-aa04-b3415a536650 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:04:41.533185 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4240/8452] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 22:04:41 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 22:04:41.537549 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ba0351-b994-4f17-a0ea-af0b399c853f admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:04:41.548184 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ba0351-b994-4f17-a0ea-af0b399c853f admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:04:41.553679 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0facee03-ae2f-4103-8217-6e82772f32b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:04:41.554632 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0facee03-ae2f-4103-8217-6e82772f32b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:41.554915 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0facee03-ae2f-4103-8217-6e82772f32b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:41.555175 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0facee03-ae2f-4103-8217-6e82772f32b1 admin admin] PATH_INFO: `/v3/projects/c1ce1877c6c749948be0c6c218d939c4/users/17dc12dce5ab41e98a9fa81b4d86bbbe/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:41.557403 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0facee03-ae2f-4103-8217-6e82772f32b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1ce1877c6c749948be0c6c218d939c4, user_id=17dc12dce5ab41e98a9fa81b4d86bbbe, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:04:41.560101 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0facee03-ae2f-4103-8217-6e82772f32b1 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:04:41.571433 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4213/8453] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 22:04:41 2022] PUT /identity/v3/projects/c1ce1877c6c749948be0c6c218d939c4/users/17dc12dce5ab41e98a9fa81b4d86bbbe/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:04:41.581339 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f50c53-94b8-44a3-893d-91013aaf011b None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:41.581634 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f50c53-94b8-44a3-893d-91013aaf011b None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:41.581894 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f50c53-94b8-44a3-893d-91013aaf011b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:41.609895 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-30f50c53-94b8-44a3-893d-91013aaf011b None None] MFA Rules not processed for user `17dc12dce5ab41e98a9fa81b4d86bbbe`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:04:41.611180 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-30f50c53-94b8-44a3-893d-91013aaf011b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:04:41.680973 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4241/8454] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:04:41 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:04:41.692865 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0facee03-ae2f-4103-8217-6e82772f32b1 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:04:41.694804 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-0facee03-ae2f-4103-8217-6e82772f32b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:04:41.754747 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0facee03-ae2f-4103-8217-6e82772f32b1 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:04:41.759058 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cf2a34-a040-485c-81a7-a2be66d7076c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec5fd3a489c341b7964704d689037f05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:04:41.759705 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cf2a34-a040-485c-81a7-a2be66d7076c service cinder] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:41.759960 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cf2a34-a040-485c-81a7-a2be66d7076c service cinder] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:41.760276 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cf2a34-a040-485c-81a7-a2be66d7076c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:41.770472 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cf2a34-a040-485c-81a7-a2be66d7076c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:04:41.771913 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cf2a34-a040-485c-81a7-a2be66d7076c service cinder] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:04:41.781852 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4214/8455] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:04:41 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:04:41.861219 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f50c53-94b8-44a3-893d-91013aaf011b None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:04:41.870948 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f50c53-94b8-44a3-893d-91013aaf011b None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:04:41.874880 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4f878b-d6b5-41a0-992c-9d2f48f0db3b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec5fd3a489c341b7964704d689037f05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:04:41.875525 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4f878b-d6b5-41a0-992c-9d2f48f0db3b service cinder] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:41.875843 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4f878b-d6b5-41a0-992c-9d2f48f0db3b service cinder] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:41.876121 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4f878b-d6b5-41a0-992c-9d2f48f0db3b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:41.933387 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4f878b-d6b5-41a0-992c-9d2f48f0db3b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:04:41.934862 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4f878b-d6b5-41a0-992c-9d2f48f0db3b service cinder] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:04:41.944050 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4242/8456] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:04:41 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:04:43.416572 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cf2a34-a040-485c-81a7-a2be66d7076c service cinder] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:04:43.426297 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:04:43.485517 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cf2a34-a040-485c-81a7-a2be66d7076c service cinder] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:04:43.490854 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7099b1ea-a99c-4f53-bb94-8edfdbd1993c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:04:43.491788 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7099b1ea-a99c-4f53-bb94-8edfdbd1993c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:43.492062 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7099b1ea-a99c-4f53-bb94-8edfdbd1993c admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:43.492334 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7099b1ea-a99c-4f53-bb94-8edfdbd1993c admin admin] PATH_INFO: `/v3/users/5090ca7992af484c96954f723ae58615` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:43.493591 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7099b1ea-a99c-4f53-bb94-8edfdbd1993c admin admin] RBAC: Authorizing `identity:delete_user(user_id=5090ca7992af484c96954f723ae58615)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:04:43.495597 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7099b1ea-a99c-4f53-bb94-8edfdbd1993c admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:04:43.545656 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-7099b1ea-a99c-4f53-bb94-8edfdbd1993c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5090ca7992af484c96954f723ae58615'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:04:43.552571 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-7099b1ea-a99c-4f53-bb94-8edfdbd1993c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5090ca7992af484c96954f723ae58615'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:04:43.553236 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-7099b1ea-a99c-4f53-bb94-8edfdbd1993c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5090ca7992af484c96954f723ae58615'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:04:43.562805 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-7099b1ea-a99c-4f53-bb94-8edfdbd1993c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5090ca7992af484c96954f723ae58615'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:04:43.576339 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-7099b1ea-a99c-4f53-bb94-8edfdbd1993c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5090ca7992af484c96954f723ae58615'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:04:43.582887 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4215/8457] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 22:04:43 2022] DELETE /identity/v3/users/5090ca7992af484c96954f723ae58615 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:04:43.587859 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80fcbd2-0ec9-4044-93c6-61cf5e4db544 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:43.588418 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80fcbd2-0ec9-4044-93c6-61cf5e4db544 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:43.588418 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80fcbd2-0ec9-4044-93c6-61cf5e4db544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:43.608128 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-f80fcbd2-0ec9-4044-93c6-61cf5e4db544 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:04:43.609364 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-f80fcbd2-0ec9-4044-93c6-61cf5e4db544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:04:43.613963 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=100 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:04:43.672183 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4243/8458] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:04:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 22:04:43.684100 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7099b1ea-a99c-4f53-bb94-8edfdbd1993c admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:04:43.685798 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-7099b1ea-a99c-4f53-bb94-8edfdbd1993c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:04:43.750198 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7099b1ea-a99c-4f53-bb94-8edfdbd1993c admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:04:43.754307 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b919db-51ef-49df-aeff-6fd5efc9514b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:04:43.754972 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b919db-51ef-49df-aeff-6fd5efc9514b service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:43.755253 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b919db-51ef-49df-aeff-6fd5efc9514b service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:43.755528 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b919db-51ef-49df-aeff-6fd5efc9514b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:43.764795 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b919db-51ef-49df-aeff-6fd5efc9514b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:04:43.766290 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b919db-51ef-49df-aeff-6fd5efc9514b service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:04:43.776395 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4216/8459] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:04:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:04:44.051744 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80fcbd2-0ec9-4044-93c6-61cf5e4db544 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:04:44.053284 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-f80fcbd2-0ec9-4044-93c6-61cf5e4db544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:04:44.066217 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80fcbd2-0ec9-4044-93c6-61cf5e4db544 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:04:44.071036 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74915c52-248c-48a0-83af-2bda606dd35b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:04:44.071940 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74915c52-248c-48a0-83af-2bda606dd35b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:44.072223 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74915c52-248c-48a0-83af-2bda606dd35b admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:44.072501 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74915c52-248c-48a0-83af-2bda606dd35b admin admin] PATH_INFO: `/v3/projects/c65e4c8d8ffc41e3bdf47c7bbcb8cb6a` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:44.073707 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74915c52-248c-48a0-83af-2bda606dd35b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c65e4c8d8ffc41e3bdf47c7bbcb8cb6a)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:04:44.075678 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74915c52-248c-48a0-83af-2bda606dd35b admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:04:44.131009 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-74915c52-248c-48a0-83af-2bda606dd35b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c65e4c8d8ffc41e3bdf47c7bbcb8cb6a', 'request_id': 'req-74915c52-248c-48a0-83af-2bda606dd35b'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:04:44.140403 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-74915c52-248c-48a0-83af-2bda606dd35b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c65e4c8d8ffc41e3bdf47c7bbcb8cb6a', 'request_id': 'req-74915c52-248c-48a0-83af-2bda606dd35b'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:04:44.146310 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-74915c52-248c-48a0-83af-2bda606dd35b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c65e4c8d8ffc41e3bdf47c7bbcb8cb6a', 'request_id': 'req-74915c52-248c-48a0-83af-2bda606dd35b'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:04:44.157632 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-74915c52-248c-48a0-83af-2bda606dd35b admin admin] The token cache is being invalidate because project c65e4c8d8ffc41e3bdf47c7bbcb8cb6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 22:04:44.157989 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-74915c52-248c-48a0-83af-2bda606dd35b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:04:44.158672 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-74915c52-248c-48a0-83af-2bda606dd35b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:04:44.160273 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4244/8460] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 22:04:44 2022] DELETE /identity/v3/projects/c65e4c8d8ffc41e3bdf47c7bbcb8cb6a => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:04:44.164421 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b919db-51ef-49df-aeff-6fd5efc9514b service neutron] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:04:44.174628 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b919db-51ef-49df-aeff-6fd5efc9514b service neutron] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:04:44.203231 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:04:44.242250 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3f2457-9864-4f41-8687-4b80a5080be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:04:44.243177 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3f2457-9864-4f41-8687-4b80a5080be5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:44.243455 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3f2457-9864-4f41-8687-4b80a5080be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:44.243731 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3f2457-9864-4f41-8687-4b80a5080be5 admin admin] PATH_INFO: `/v3/users/17dc12dce5ab41e98a9fa81b4d86bbbe` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:44.244981 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3f2457-9864-4f41-8687-4b80a5080be5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17dc12dce5ab41e98a9fa81b4d86bbbe)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:04:44.246974 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3f2457-9864-4f41-8687-4b80a5080be5 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:04:44.297517 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-0d3f2457-9864-4f41-8687-4b80a5080be5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17dc12dce5ab41e98a9fa81b4d86bbbe'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:04:44.304586 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-0d3f2457-9864-4f41-8687-4b80a5080be5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17dc12dce5ab41e98a9fa81b4d86bbbe'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:04:44.305234 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-0d3f2457-9864-4f41-8687-4b80a5080be5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17dc12dce5ab41e98a9fa81b4d86bbbe'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:04:44.314009 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-0d3f2457-9864-4f41-8687-4b80a5080be5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17dc12dce5ab41e98a9fa81b4d86bbbe'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:04:44.326979 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-0d3f2457-9864-4f41-8687-4b80a5080be5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17dc12dce5ab41e98a9fa81b4d86bbbe'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:04:44.333222 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4217/8461] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 22:04:44 2022] DELETE /identity/v3/users/17dc12dce5ab41e98a9fa81b4d86bbbe => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:04:44.623178 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74915c52-248c-48a0-83af-2bda606dd35b admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:04:44.624758 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-74915c52-248c-48a0-83af-2bda606dd35b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:04:44.640810 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74915c52-248c-48a0-83af-2bda606dd35b admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:04:44.715967 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13537a19-fd68-4bef-87ef-fa27501ccce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:04:44.716789 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13537a19-fd68-4bef-87ef-fa27501ccce3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:44.717059 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13537a19-fd68-4bef-87ef-fa27501ccce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:44.717342 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13537a19-fd68-4bef-87ef-fa27501ccce3 admin admin] PATH_INFO: `/v3/projects/c1ce1877c6c749948be0c6c218d939c4` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:44.718602 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13537a19-fd68-4bef-87ef-fa27501ccce3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1ce1877c6c749948be0c6c218d939c4)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:04:44.720603 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13537a19-fd68-4bef-87ef-fa27501ccce3 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:04:44.760331 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:04:44.771569 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-13537a19-fd68-4bef-87ef-fa27501ccce3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1ce1877c6c749948be0c6c218d939c4', 'request_id': 'req-13537a19-fd68-4bef-87ef-fa27501ccce3'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:04:44.779594 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-13537a19-fd68-4bef-87ef-fa27501ccce3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1ce1877c6c749948be0c6c218d939c4', 'request_id': 'req-13537a19-fd68-4bef-87ef-fa27501ccce3'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:04:44.785331 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-13537a19-fd68-4bef-87ef-fa27501ccce3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1ce1877c6c749948be0c6c218d939c4', 'request_id': 'req-13537a19-fd68-4bef-87ef-fa27501ccce3'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:04:44.799423 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-13537a19-fd68-4bef-87ef-fa27501ccce3 admin admin] The token cache is being invalidate because project c1ce1877c6c749948be0c6c218d939c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 22:04:44.799726 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-13537a19-fd68-4bef-87ef-fa27501ccce3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:04:44.800450 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-13537a19-fd68-4bef-87ef-fa27501ccce3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:04:44.802112 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4245/8462] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 22:04:44 2022] DELETE /identity/v3/projects/c1ce1877c6c749948be0c6c218d939c4 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:04:44.807269 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7014c7-57fc-4f6a-96ed-c4ca4dd7e4d2 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:44.807801 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7014c7-57fc-4f6a-96ed-c4ca4dd7e4d2 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:44.807933 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7014c7-57fc-4f6a-96ed-c4ca4dd7e4d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:44.827163 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-1b7014c7-57fc-4f6a-96ed-c4ca4dd7e4d2 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:04:44.828400 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-1b7014c7-57fc-4f6a-96ed-c4ca4dd7e4d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:04:44.893620 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4218/8463] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:04:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 22:04:44.902152 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5695a91e-ffb8-4013-8c80-135b94a08593 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:44.902448 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5695a91e-ffb8-4013-8c80-135b94a08593 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:44.902730 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5695a91e-ffb8-4013-8c80-135b94a08593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:44.923048 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-5695a91e-ffb8-4013-8c80-135b94a08593 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:04:44.924269 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-5695a91e-ffb8-4013-8c80-135b94a08593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:04:44.933735 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4246/8464] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:04:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:04:44.938305 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7014c7-57fc-4f6a-96ed-c4ca4dd7e4d2 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:04:44.949147 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7014c7-57fc-4f6a-96ed-c4ca4dd7e4d2 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:04:44.954907 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cd9e5a-ae77-419d-9e99-ceedf45e8b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:04:44.955549 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cd9e5a-ae77-419d-9e99-ceedf45e8b27 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:44.955825 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cd9e5a-ae77-419d-9e99-ceedf45e8b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:44.956098 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cd9e5a-ae77-419d-9e99-ceedf45e8b27 admin admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:44.956826 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cd9e5a-ae77-419d-9e99-ceedf45e8b27 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 22:04:44.957132 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cd9e5a-ae77-419d-9e99-ceedf45e8b27 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:04:44.958779 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cd9e5a-ae77-419d-9e99-ceedf45e8b27 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:04:44.971854 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4219/8465] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 22:04:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 22:04:44.976487 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5695a91e-ffb8-4013-8c80-135b94a08593 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:04:44.986446 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5695a91e-ffb8-4013-8c80-135b94a08593 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:04:44.992913 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fff63e-ceea-410c-b47a-acd747b6db63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:04:44.993570 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fff63e-ceea-410c-b47a-acd747b6db63 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:44.993856 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fff63e-ceea-410c-b47a-acd747b6db63 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:44.994167 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fff63e-ceea-410c-b47a-acd747b6db63 admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:44.994847 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fff63e-ceea-410c-b47a-acd747b6db63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:04:44.996756 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fff63e-ceea-410c-b47a-acd747b6db63 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:04:45.025484 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4247/8466] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 22:04:44 2022] POST /identity/v3/projects => generated 365 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 22:04:45.029711 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cd9e5a-ae77-419d-9e99-ceedf45e8b27 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:04:45.040360 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cd9e5a-ae77-419d-9e99-ceedf45e8b27 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:04:45.084331 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:04:45.112312 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d50b564-b630-4544-af81-2393cdd4c56e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:04:45.113026 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d50b564-b630-4544-af81-2393cdd4c56e admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:45.113331 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d50b564-b630-4544-af81-2393cdd4c56e admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:45.113602 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d50b564-b630-4544-af81-2393cdd4c56e admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:45.114386 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d50b564-b630-4544-af81-2393cdd4c56e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:04:45.116381 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d50b564-b630-4544-af81-2393cdd4c56e admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:04:45.137755 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4220/8467] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 22:04:45 2022] POST /identity/v3/users => generated 283 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 22:04:45.143559 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fff63e-ceea-410c-b47a-acd747b6db63 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:04:45.154566 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fff63e-ceea-410c-b47a-acd747b6db63 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:04:45.159918 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4483bc3a-9d85-4bc8-a3bf-4ee2e639a5cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:04:45.160579 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4483bc3a-9d85-4bc8-a3bf-4ee2e639a5cf admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:45.160857 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4483bc3a-9d85-4bc8-a3bf-4ee2e639a5cf admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:45.161127 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4483bc3a-9d85-4bc8-a3bf-4ee2e639a5cf admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:45.161845 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4483bc3a-9d85-4bc8-a3bf-4ee2e639a5cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:04:45.163467 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4483bc3a-9d85-4bc8-a3bf-4ee2e639a5cf admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:04:45.174369 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4248/8468] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 22:04:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 22:04:45.178377 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d50b564-b630-4544-af81-2393cdd4c56e admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:04:45.188708 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d50b564-b630-4544-af81-2393cdd4c56e admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:04:45.193630 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af478436-d4ef-43b4-94cc-9ffca66706a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:04:45.194326 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af478436-d4ef-43b4-94cc-9ffca66706a6 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:45.194635 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af478436-d4ef-43b4-94cc-9ffca66706a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:45.194906 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af478436-d4ef-43b4-94cc-9ffca66706a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:45.195621 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af478436-d4ef-43b4-94cc-9ffca66706a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:04:45.197226 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af478436-d4ef-43b4-94cc-9ffca66706a6 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:04:45.207661 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4221/8469] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 22:04:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 22:04:45.211859 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4483bc3a-9d85-4bc8-a3bf-4ee2e639a5cf admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:04:45.222384 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4483bc3a-9d85-4bc8-a3bf-4ee2e639a5cf admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:04:45.226988 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0aa7ac-2673-42ed-a3cd-cc5143c36eeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:04:45.227860 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0aa7ac-2673-42ed-a3cd-cc5143c36eeb admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:45.228147 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0aa7ac-2673-42ed-a3cd-cc5143c36eeb admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:45.228407 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0aa7ac-2673-42ed-a3cd-cc5143c36eeb admin admin] PATH_INFO: `/v3/projects/36241eada81242228ec6b422237b4811/users/4fb61f0b1c594ca986b2b4cf291a6d1b/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:45.244876 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0aa7ac-2673-42ed-a3cd-cc5143c36eeb admin admin] RBAC: Authorizing `identity:create_grant(project_id=36241eada81242228ec6b422237b4811, user_id=4fb61f0b1c594ca986b2b4cf291a6d1b, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:04:45.249205 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0aa7ac-2673-42ed-a3cd-cc5143c36eeb admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:04:45.269093 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4249/8470] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 22:04:45 2022] PUT /identity/v3/projects/36241eada81242228ec6b422237b4811/users/4fb61f0b1c594ca986b2b4cf291a6d1b/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:04:45.280169 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789ab5a0-6f22-4ee4-8079-9ad0bcb90d0d None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:45.280463 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789ab5a0-6f22-4ee4-8079-9ad0bcb90d0d None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:45.280741 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789ab5a0-6f22-4ee4-8079-9ad0bcb90d0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:45.307750 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-789ab5a0-6f22-4ee4-8079-9ad0bcb90d0d None None] MFA Rules not processed for user `4fb61f0b1c594ca986b2b4cf291a6d1b`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:04:45.309069 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-789ab5a0-6f22-4ee4-8079-9ad0bcb90d0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:04:45.375807 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4222/8471] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:04:45 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:04:45.380488 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0aa7ac-2673-42ed-a3cd-cc5143c36eeb admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:04:45.445684 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0aa7ac-2673-42ed-a3cd-cc5143c36eeb admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:04:45.451115 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d136b6-df28-4f40-9b65-3580e98cfd46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:04:45.451767 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d136b6-df28-4f40-9b65-3580e98cfd46 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:45.452051 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d136b6-df28-4f40-9b65-3580e98cfd46 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:45.452332 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d136b6-df28-4f40-9b65-3580e98cfd46 admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:45.453012 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d136b6-df28-4f40-9b65-3580e98cfd46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:04:45.454979 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d136b6-df28-4f40-9b65-3580e98cfd46 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:04:45.484170 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4250/8472] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 22:04:45 2022] POST /identity/v3/projects => generated 365 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 22:04:45.488370 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789ab5a0-6f22-4ee4-8079-9ad0bcb90d0d None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:04:45.499826 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789ab5a0-6f22-4ee4-8079-9ad0bcb90d0d None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:04:45.557911 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecf57d8-dfff-464a-ac36-9e2818ff8ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:04:45.558589 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecf57d8-dfff-464a-ac36-9e2818ff8ab4 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:45.558872 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecf57d8-dfff-464a-ac36-9e2818ff8ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:45.559150 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecf57d8-dfff-464a-ac36-9e2818ff8ab4 admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:45.559843 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecf57d8-dfff-464a-ac36-9e2818ff8ab4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:04:45.561776 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecf57d8-dfff-464a-ac36-9e2818ff8ab4 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:04:45.584060 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4223/8473] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 22:04:45 2022] POST /identity/v3/users => generated 289 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 22:04:45.588461 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d136b6-df28-4f40-9b65-3580e98cfd46 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:04:45.600324 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d136b6-df28-4f40-9b65-3580e98cfd46 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:04:45.606539 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d42f074-f583-49e3-b1fc-bdb4065b7f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:04:45.607218 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d42f074-f583-49e3-b1fc-bdb4065b7f88 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:45.607493 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d42f074-f583-49e3-b1fc-bdb4065b7f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:45.607781 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d42f074-f583-49e3-b1fc-bdb4065b7f88 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:45.608506 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d42f074-f583-49e3-b1fc-bdb4065b7f88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:04:45.610153 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d42f074-f583-49e3-b1fc-bdb4065b7f88 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:04:45.621667 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4251/8474] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 22:04:45 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 22:04:45.626465 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecf57d8-dfff-464a-ac36-9e2818ff8ab4 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:04:45.637637 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecf57d8-dfff-464a-ac36-9e2818ff8ab4 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:04:45.642903 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cf70d0-e787-458d-8891-bc74bfb7b42e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:04:45.643795 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cf70d0-e787-458d-8891-bc74bfb7b42e admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:45.644072 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cf70d0-e787-458d-8891-bc74bfb7b42e admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:45.644345 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cf70d0-e787-458d-8891-bc74bfb7b42e admin admin] PATH_INFO: `/v3/projects/13b9e9fc60c6448caa18c5989b970f4e/users/09665848e0b14831b6444a429d2ffb72/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:45.659641 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cf70d0-e787-458d-8891-bc74bfb7b42e admin admin] RBAC: Authorizing `identity:create_grant(project_id=13b9e9fc60c6448caa18c5989b970f4e, user_id=09665848e0b14831b6444a429d2ffb72, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:04:45.662342 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cf70d0-e787-458d-8891-bc74bfb7b42e admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:04:45.676832 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4224/8475] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 22:04:45 2022] PUT /identity/v3/projects/13b9e9fc60c6448caa18c5989b970f4e/users/09665848e0b14831b6444a429d2ffb72/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:04:45.680922 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d42f074-f583-49e3-b1fc-bdb4065b7f88 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:04:45.691626 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d42f074-f583-49e3-b1fc-bdb4065b7f88 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:04:45.723295 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:04:45.751668 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4cec8c-3260-4e21-951c-fd6ec3b5669a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:04:45.752270 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4cec8c-3260-4e21-951c-fd6ec3b5669a admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:45.752553 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4cec8c-3260-4e21-951c-fd6ec3b5669a admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:45.752827 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4cec8c-3260-4e21-951c-fd6ec3b5669a admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:45.753549 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4cec8c-3260-4e21-951c-fd6ec3b5669a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:04:45.755195 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4cec8c-3260-4e21-951c-fd6ec3b5669a admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:04:45.764952 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4252/8476] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 22:04:45 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 22:04:45.769324 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cf70d0-e787-458d-8891-bc74bfb7b42e admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:04:45.780299 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cf70d0-e787-458d-8891-bc74bfb7b42e admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:04:45.785618 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f77300d-c001-4483-ba75-d3fcf5b97e5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:04:45.786549 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f77300d-c001-4483-ba75-d3fcf5b97e5c admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:45.786828 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f77300d-c001-4483-ba75-d3fcf5b97e5c admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:45.787099 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f77300d-c001-4483-ba75-d3fcf5b97e5c admin admin] PATH_INFO: `/v3/projects/13b9e9fc60c6448caa18c5989b970f4e/users/09665848e0b14831b6444a429d2ffb72/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:45.789121 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f77300d-c001-4483-ba75-d3fcf5b97e5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=13b9e9fc60c6448caa18c5989b970f4e, user_id=09665848e0b14831b6444a429d2ffb72, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:04:45.791795 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f77300d-c001-4483-ba75-d3fcf5b97e5c admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:04:45.795018 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:04:45.804691 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4225/8477] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 22:04:45 2022] PUT /identity/v3/projects/13b9e9fc60c6448caa18c5989b970f4e/users/09665848e0b14831b6444a429d2ffb72/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:04:45.815297 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6c28a0-4346-489d-a105-23ba7d7d595e None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:45.815615 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6c28a0-4346-489d-a105-23ba7d7d595e None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:45.815892 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6c28a0-4346-489d-a105-23ba7d7d595e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:45.844398 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-8b6c28a0-4346-489d-a105-23ba7d7d595e None None] MFA Rules not processed for user `09665848e0b14831b6444a429d2ffb72`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:04:45.845684 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-8b6c28a0-4346-489d-a105-23ba7d7d595e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:04:45.916322 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4253/8478] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:04:45 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:04:45.927927 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f77300d-c001-4483-ba75-d3fcf5b97e5c admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:04:45.930009 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-1f77300d-c001-4483-ba75-d3fcf5b97e5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:04:45.992056 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f77300d-c001-4483-ba75-d3fcf5b97e5c admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:04:45.996366 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdaaaf9-8e97-47ea-8050-066ec180f81a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec5fd3a489c341b7964704d689037f05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:04:45.997006 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdaaaf9-8e97-47ea-8050-066ec180f81a service cinder] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:45.997260 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdaaaf9-8e97-47ea-8050-066ec180f81a service cinder] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:45.997551 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdaaaf9-8e97-47ea-8050-066ec180f81a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:46.007803 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdaaaf9-8e97-47ea-8050-066ec180f81a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:04:46.009271 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdaaaf9-8e97-47ea-8050-066ec180f81a service cinder] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:04:46.018974 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4226/8479] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:04:45 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:04:46.437510 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6c28a0-4346-489d-a105-23ba7d7d595e None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:04:46.509653 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6c28a0-4346-489d-a105-23ba7d7d595e None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:04:46.515201 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5284355-d058-4676-8706-0376eaac6538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:04:46.516027 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5284355-d058-4676-8706-0376eaac6538 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:46.516303 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5284355-d058-4676-8706-0376eaac6538 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:46.516542 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5284355-d058-4676-8706-0376eaac6538 admin admin] PATH_INFO: `/v3/users/4fb61f0b1c594ca986b2b4cf291a6d1b` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:46.517983 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5284355-d058-4676-8706-0376eaac6538 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4fb61f0b1c594ca986b2b4cf291a6d1b)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:04:46.519928 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5284355-d058-4676-8706-0376eaac6538 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:04:46.571220 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-d5284355-d058-4676-8706-0376eaac6538 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4fb61f0b1c594ca986b2b4cf291a6d1b'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:04:46.571934 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-d5284355-d058-4676-8706-0376eaac6538 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4fb61f0b1c594ca986b2b4cf291a6d1b'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:04:46.578690 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-d5284355-d058-4676-8706-0376eaac6538 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4fb61f0b1c594ca986b2b4cf291a6d1b'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:04:46.580383 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:04:46.589530 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-d5284355-d058-4676-8706-0376eaac6538 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4fb61f0b1c594ca986b2b4cf291a6d1b'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:04:46.602442 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-d5284355-d058-4676-8706-0376eaac6538 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4fb61f0b1c594ca986b2b4cf291a6d1b'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:04:46.608714 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4254/8480] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 22:04:46 2022] DELETE /identity/v3/users/4fb61f0b1c594ca986b2b4cf291a6d1b => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:04:46.613571 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582d9f5a-7db5-4772-9b32-9e08d41dd7db None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:46.613878 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582d9f5a-7db5-4772-9b32-9e08d41dd7db None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:46.614172 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582d9f5a-7db5-4772-9b32-9e08d41dd7db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:46.633142 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-582d9f5a-7db5-4772-9b32-9e08d41dd7db None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:04:46.634385 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-582d9f5a-7db5-4772-9b32-9e08d41dd7db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:04:46.696052 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4227/8481] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:04:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:04:46.706322 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5284355-d058-4676-8706-0376eaac6538 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:04:46.707930 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-d5284355-d058-4676-8706-0376eaac6538 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:04:46.767256 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5284355-d058-4676-8706-0376eaac6538 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:04:46.771326 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123cb22d-ed08-4c43-821e-52f979aa28a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:04:46.771974 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123cb22d-ed08-4c43-821e-52f979aa28a0 service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:46.772243 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123cb22d-ed08-4c43-821e-52f979aa28a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:46.772513 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123cb22d-ed08-4c43-821e-52f979aa28a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:46.782021 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123cb22d-ed08-4c43-821e-52f979aa28a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:04:46.783608 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123cb22d-ed08-4c43-821e-52f979aa28a0 service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:04:46.793175 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4255/8482] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:04:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:04:47.086301 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582d9f5a-7db5-4772-9b32-9e08d41dd7db None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:04:47.087775 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-582d9f5a-7db5-4772-9b32-9e08d41dd7db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:04:47.100563 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582d9f5a-7db5-4772-9b32-9e08d41dd7db None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:04:47.105478 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5981e411-a77d-4b58-a296-728c1b48e6f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:04:47.106396 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5981e411-a77d-4b58-a296-728c1b48e6f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:47.106672 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5981e411-a77d-4b58-a296-728c1b48e6f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:47.107030 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5981e411-a77d-4b58-a296-728c1b48e6f4 admin admin] PATH_INFO: `/v3/projects/36241eada81242228ec6b422237b4811` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:47.108141 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5981e411-a77d-4b58-a296-728c1b48e6f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=36241eada81242228ec6b422237b4811)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:04:47.110097 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5981e411-a77d-4b58-a296-728c1b48e6f4 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:04:47.159474 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-5981e411-a77d-4b58-a296-728c1b48e6f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36241eada81242228ec6b422237b4811', 'request_id': 'req-5981e411-a77d-4b58-a296-728c1b48e6f4'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:04:47.167164 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-5981e411-a77d-4b58-a296-728c1b48e6f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36241eada81242228ec6b422237b4811', 'request_id': 'req-5981e411-a77d-4b58-a296-728c1b48e6f4'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:04:47.173112 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-5981e411-a77d-4b58-a296-728c1b48e6f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36241eada81242228ec6b422237b4811', 'request_id': 'req-5981e411-a77d-4b58-a296-728c1b48e6f4'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:04:47.184710 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-5981e411-a77d-4b58-a296-728c1b48e6f4 admin admin] The token cache is being invalidate because project 36241eada81242228ec6b422237b4811 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 22:04:47.184995 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-5981e411-a77d-4b58-a296-728c1b48e6f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:04:47.185691 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-5981e411-a77d-4b58-a296-728c1b48e6f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:04:47.187394 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4228/8483] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 22:04:47 2022] DELETE /identity/v3/projects/36241eada81242228ec6b422237b4811 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:04:47.191665 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123cb22d-ed08-4c43-821e-52f979aa28a0 service neutron] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:04:47.202018 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123cb22d-ed08-4c43-821e-52f979aa28a0 service neutron] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:04:47.261882 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c77e28f-cced-443a-866c-6d8a069c27c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:04:47.262796 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c77e28f-cced-443a-866c-6d8a069c27c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:47.263078 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c77e28f-cced-443a-866c-6d8a069c27c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:47.263357 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c77e28f-cced-443a-866c-6d8a069c27c2 admin admin] PATH_INFO: `/v3/users/09665848e0b14831b6444a429d2ffb72` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:47.264587 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c77e28f-cced-443a-866c-6d8a069c27c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=09665848e0b14831b6444a429d2ffb72)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:04:47.266543 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c77e28f-cced-443a-866c-6d8a069c27c2 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:04:47.312329 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-7c77e28f-cced-443a-866c-6d8a069c27c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09665848e0b14831b6444a429d2ffb72'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:04:47.312909 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-7c77e28f-cced-443a-866c-6d8a069c27c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09665848e0b14831b6444a429d2ffb72'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:04:47.319949 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-7c77e28f-cced-443a-866c-6d8a069c27c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09665848e0b14831b6444a429d2ffb72'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:04:47.327787 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-7c77e28f-cced-443a-866c-6d8a069c27c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09665848e0b14831b6444a429d2ffb72'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:04:47.340568 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:04:47.342369 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-7c77e28f-cced-443a-866c-6d8a069c27c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09665848e0b14831b6444a429d2ffb72'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:04:47.350022 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4256/8484] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 22:04:47 2022] DELETE /identity/v3/users/09665848e0b14831b6444a429d2ffb72 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:04:47.639793 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5981e411-a77d-4b58-a296-728c1b48e6f4 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:04:47.641391 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-5981e411-a77d-4b58-a296-728c1b48e6f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:04:47.656128 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5981e411-a77d-4b58-a296-728c1b48e6f4 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:04:47.677504 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:04:47.720969 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89d92e4-0d75-446a-8c5a-2ae1ce17df1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:04:47.721870 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89d92e4-0d75-446a-8c5a-2ae1ce17df1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:47.722166 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89d92e4-0d75-446a-8c5a-2ae1ce17df1e admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:47.722438 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89d92e4-0d75-446a-8c5a-2ae1ce17df1e admin admin] PATH_INFO: `/v3/projects/13b9e9fc60c6448caa18c5989b970f4e` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:47.723687 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89d92e4-0d75-446a-8c5a-2ae1ce17df1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=13b9e9fc60c6448caa18c5989b970f4e)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:04:47.725619 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89d92e4-0d75-446a-8c5a-2ae1ce17df1e admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:04:47.775021 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-b89d92e4-0d75-446a-8c5a-2ae1ce17df1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13b9e9fc60c6448caa18c5989b970f4e', 'request_id': 'req-b89d92e4-0d75-446a-8c5a-2ae1ce17df1e'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:04:47.782519 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-b89d92e4-0d75-446a-8c5a-2ae1ce17df1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13b9e9fc60c6448caa18c5989b970f4e', 'request_id': 'req-b89d92e4-0d75-446a-8c5a-2ae1ce17df1e'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:04:47.788222 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-b89d92e4-0d75-446a-8c5a-2ae1ce17df1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13b9e9fc60c6448caa18c5989b970f4e', 'request_id': 'req-b89d92e4-0d75-446a-8c5a-2ae1ce17df1e'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:04:47.799146 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-b89d92e4-0d75-446a-8c5a-2ae1ce17df1e admin admin] The token cache is being invalidate because project 13b9e9fc60c6448caa18c5989b970f4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 22:04:47.799430 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-b89d92e4-0d75-446a-8c5a-2ae1ce17df1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:04:47.800064 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-b89d92e4-0d75-446a-8c5a-2ae1ce17df1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:04:47.801643 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4229/8485] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 22:04:47 2022] DELETE /identity/v3/projects/13b9e9fc60c6448caa18c5989b970f4e => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:04:47.806651 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dafb93-30ee-4d9c-b51a-82081cd371fc None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:47.807138 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dafb93-30ee-4d9c-b51a-82081cd371fc None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:47.807244 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dafb93-30ee-4d9c-b51a-82081cd371fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:47.826632 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-10dafb93-30ee-4d9c-b51a-82081cd371fc None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:04:47.827858 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-10dafb93-30ee-4d9c-b51a-82081cd371fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:04:47.891813 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4257/8486] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:04:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:04:47.899741 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63028e51-33b9-4849-ba6f-a346a3ec993e None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:47.900033 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63028e51-33b9-4849-ba6f-a346a3ec993e None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:47.900309 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63028e51-33b9-4849-ba6f-a346a3ec993e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:47.920987 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-63028e51-33b9-4849-ba6f-a346a3ec993e None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:04:47.922246 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-63028e51-33b9-4849-ba6f-a346a3ec993e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:04:47.931434 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4230/8487] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:04:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:04:47.935870 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dafb93-30ee-4d9c-b51a-82081cd371fc None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:04:47.946302 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dafb93-30ee-4d9c-b51a-82081cd371fc None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:04:47.951905 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8900b471-22c9-4adf-94a0-84e0c6ee4974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:04:47.952560 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8900b471-22c9-4adf-94a0-84e0c6ee4974 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:47.952852 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8900b471-22c9-4adf-94a0-84e0c6ee4974 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:47.953119 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8900b471-22c9-4adf-94a0-84e0c6ee4974 admin admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:47.953847 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8900b471-22c9-4adf-94a0-84e0c6ee4974 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 22:04:47.954183 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8900b471-22c9-4adf-94a0-84e0c6ee4974 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:04:47.955823 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8900b471-22c9-4adf-94a0-84e0c6ee4974 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:04:47.968149 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4258/8488] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 22:04:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 22:04:47.972542 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63028e51-33b9-4849-ba6f-a346a3ec993e None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:04:47.982514 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63028e51-33b9-4849-ba6f-a346a3ec993e None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:04:47.988455 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cededc-0aa4-4461-8f3f-ee04180259f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:04:47.989105 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cededc-0aa4-4461-8f3f-ee04180259f8 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:47.989381 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cededc-0aa4-4461-8f3f-ee04180259f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:47.989652 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cededc-0aa4-4461-8f3f-ee04180259f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:47.990369 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cededc-0aa4-4461-8f3f-ee04180259f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:04:47.992318 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cededc-0aa4-4461-8f3f-ee04180259f8 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:04:48.020548 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4231/8489] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 22:04:47 2022] POST /identity/v3/projects => generated 369 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 22:04:48.024719 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8900b471-22c9-4adf-94a0-84e0c6ee4974 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:04:48.035016 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8900b471-22c9-4adf-94a0-84e0c6ee4974 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:04:48.093290 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a04a91-903b-4b61-924d-93ff039c2a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:04:48.093952 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a04a91-903b-4b61-924d-93ff039c2a5c admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:48.094267 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a04a91-903b-4b61-924d-93ff039c2a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:48.094539 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a04a91-903b-4b61-924d-93ff039c2a5c admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:48.095207 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a04a91-903b-4b61-924d-93ff039c2a5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:04:48.097253 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a04a91-903b-4b61-924d-93ff039c2a5c admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:04:48.118018 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4259/8490] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 22:04:48 2022] POST /identity/v3/users => generated 285 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 22:04:48.122109 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cededc-0aa4-4461-8f3f-ee04180259f8 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:04:48.133687 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cededc-0aa4-4461-8f3f-ee04180259f8 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:04:48.138759 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103a44b8-013b-43f8-bde2-6cad5bb61b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:04:48.139437 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103a44b8-013b-43f8-bde2-6cad5bb61b4e admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:48.139719 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103a44b8-013b-43f8-bde2-6cad5bb61b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:48.139993 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103a44b8-013b-43f8-bde2-6cad5bb61b4e admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:48.140733 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103a44b8-013b-43f8-bde2-6cad5bb61b4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:04:48.142446 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103a44b8-013b-43f8-bde2-6cad5bb61b4e admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:04:48.153017 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4232/8491] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 22:04:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 22:04:48.157061 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a04a91-903b-4b61-924d-93ff039c2a5c admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:04:48.167569 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a04a91-903b-4b61-924d-93ff039c2a5c admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:04:48.172703 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ffebc3-8110-4818-bb93-065247952a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:04:48.173398 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ffebc3-8110-4818-bb93-065247952a00 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:48.173708 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ffebc3-8110-4818-bb93-065247952a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:48.174016 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ffebc3-8110-4818-bb93-065247952a00 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:48.174738 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ffebc3-8110-4818-bb93-065247952a00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:04:48.176343 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ffebc3-8110-4818-bb93-065247952a00 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:04:48.186525 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4260/8492] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 22:04:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 22:04:48.190735 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103a44b8-013b-43f8-bde2-6cad5bb61b4e admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:04:48.201267 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103a44b8-013b-43f8-bde2-6cad5bb61b4e admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:04:48.206752 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85918ce-b005-4922-82f7-7674206e71d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:04:48.207627 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85918ce-b005-4922-82f7-7674206e71d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:48.207902 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85918ce-b005-4922-82f7-7674206e71d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:48.208172 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85918ce-b005-4922-82f7-7674206e71d6 admin admin] PATH_INFO: `/v3/projects/26a866f7f7d24ac7a39a4e68e350de95/users/c39d55594e0347e591848465ae1ccdcd/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:48.223330 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85918ce-b005-4922-82f7-7674206e71d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26a866f7f7d24ac7a39a4e68e350de95, user_id=c39d55594e0347e591848465ae1ccdcd, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:04:48.226018 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85918ce-b005-4922-82f7-7674206e71d6 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:04:48.241539 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4233/8493] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 22:04:48 2022] PUT /identity/v3/projects/26a866f7f7d24ac7a39a4e68e350de95/users/c39d55594e0347e591848465ae1ccdcd/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:04:48.252765 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bc570c-07d8-4ac0-84f5-6806097d6165 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:48.253055 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bc570c-07d8-4ac0-84f5-6806097d6165 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:48.253329 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bc570c-07d8-4ac0-84f5-6806097d6165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:48.280256 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-06bc570c-07d8-4ac0-84f5-6806097d6165 None None] MFA Rules not processed for user `c39d55594e0347e591848465ae1ccdcd`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:04:48.281481 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-06bc570c-07d8-4ac0-84f5-6806097d6165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:04:48.332310 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:04:48.354018 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4261/8494] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:04:48 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:04:48.358649 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85918ce-b005-4922-82f7-7674206e71d6 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:04:48.407928 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:04:48.423678 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85918ce-b005-4922-82f7-7674206e71d6 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:04:48.428941 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed6ad6f-d041-411c-b860-8e42264ff5f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:04:48.429644 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed6ad6f-d041-411c-b860-8e42264ff5f7 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:48.429945 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed6ad6f-d041-411c-b860-8e42264ff5f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:48.430222 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed6ad6f-d041-411c-b860-8e42264ff5f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:48.430914 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed6ad6f-d041-411c-b860-8e42264ff5f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:04:48.432861 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed6ad6f-d041-411c-b860-8e42264ff5f7 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:04:48.460114 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4234/8495] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 22:04:48 2022] POST /identity/v3/projects => generated 369 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 22:04:48.464436 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bc570c-07d8-4ac0-84f5-6806097d6165 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:04:48.475814 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bc570c-07d8-4ac0-84f5-6806097d6165 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:04:48.532256 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad3d955-e495-44a1-81c0-779479d60db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:04:48.532920 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad3d955-e495-44a1-81c0-779479d60db4 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:48.533200 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad3d955-e495-44a1-81c0-779479d60db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:48.533471 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad3d955-e495-44a1-81c0-779479d60db4 admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:48.534173 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad3d955-e495-44a1-81c0-779479d60db4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:04:48.536083 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad3d955-e495-44a1-81c0-779479d60db4 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:04:48.558100 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4262/8496] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 22:04:48 2022] POST /identity/v3/users => generated 291 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 22:04:48.562393 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed6ad6f-d041-411c-b860-8e42264ff5f7 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:04:48.573351 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed6ad6f-d041-411c-b860-8e42264ff5f7 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:04:48.578104 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8888208-fcf3-4100-b15d-a26e8cdf56bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:04:48.578759 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8888208-fcf3-4100-b15d-a26e8cdf56bb admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:48.579033 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8888208-fcf3-4100-b15d-a26e8cdf56bb admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:48.579305 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8888208-fcf3-4100-b15d-a26e8cdf56bb admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:48.580026 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8888208-fcf3-4100-b15d-a26e8cdf56bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:04:48.581692 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8888208-fcf3-4100-b15d-a26e8cdf56bb admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:04:48.598738 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4235/8497] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 22:04:48 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 22:04:48.602848 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad3d955-e495-44a1-81c0-779479d60db4 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:04:48.616686 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad3d955-e495-44a1-81c0-779479d60db4 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:04:48.622767 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d51ea5-0e16-45cc-a543-7e9b10c4a98d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:04:48.623670 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d51ea5-0e16-45cc-a543-7e9b10c4a98d admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:48.623951 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d51ea5-0e16-45cc-a543-7e9b10c4a98d admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:48.624224 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d51ea5-0e16-45cc-a543-7e9b10c4a98d admin admin] PATH_INFO: `/v3/projects/a1dd799387654ca183ffd3be8b0ca308/users/ddd87b7c3bc64ccaadfe5e3eb8016dad/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:48.639621 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d51ea5-0e16-45cc-a543-7e9b10c4a98d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1dd799387654ca183ffd3be8b0ca308, user_id=ddd87b7c3bc64ccaadfe5e3eb8016dad, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:04:48.642316 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d51ea5-0e16-45cc-a543-7e9b10c4a98d admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:04:48.656562 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4263/8498] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 22:04:48 2022] PUT /identity/v3/projects/a1dd799387654ca183ffd3be8b0ca308/users/ddd87b7c3bc64ccaadfe5e3eb8016dad/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:04:48.660685 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8888208-fcf3-4100-b15d-a26e8cdf56bb admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:04:48.670675 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8888208-fcf3-4100-b15d-a26e8cdf56bb admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:04:48.729561 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f6464b-fec1-445b-87a7-f82bfa0efdd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:04:48.730351 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f6464b-fec1-445b-87a7-f82bfa0efdd0 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:48.730641 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f6464b-fec1-445b-87a7-f82bfa0efdd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:48.731020 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f6464b-fec1-445b-87a7-f82bfa0efdd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:48.731750 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f6464b-fec1-445b-87a7-f82bfa0efdd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:04:48.733360 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f6464b-fec1-445b-87a7-f82bfa0efdd0 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:04:48.745847 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4236/8499] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 22:04:48 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 22:04:48.750216 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d51ea5-0e16-45cc-a543-7e9b10c4a98d admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:04:48.761388 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d51ea5-0e16-45cc-a543-7e9b10c4a98d admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:04:48.766224 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0317c44b-dc63-4a63-941a-af36704781b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:04:48.767195 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0317c44b-dc63-4a63-941a-af36704781b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:48.767546 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0317c44b-dc63-4a63-941a-af36704781b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:48.767884 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0317c44b-dc63-4a63-941a-af36704781b7 admin admin] PATH_INFO: `/v3/projects/a1dd799387654ca183ffd3be8b0ca308/users/ddd87b7c3bc64ccaadfe5e3eb8016dad/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:48.769993 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0317c44b-dc63-4a63-941a-af36704781b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1dd799387654ca183ffd3be8b0ca308, user_id=ddd87b7c3bc64ccaadfe5e3eb8016dad, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:04:48.772802 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0317c44b-dc63-4a63-941a-af36704781b7 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:04:48.793412 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4264/8500] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 22:04:48 2022] PUT /identity/v3/projects/a1dd799387654ca183ffd3be8b0ca308/users/ddd87b7c3bc64ccaadfe5e3eb8016dad/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 22:04:48.798132 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6071892c-fc3d-4226-bf04-5c3d70d4ef8e None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:48.798423 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6071892c-fc3d-4226-bf04-5c3d70d4ef8e None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:48.798728 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6071892c-fc3d-4226-bf04-5c3d70d4ef8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:48.831622 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-6071892c-fc3d-4226-bf04-5c3d70d4ef8e None None] MFA Rules not processed for user `ddd87b7c3bc64ccaadfe5e3eb8016dad`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:04:48.832925 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-6071892c-fc3d-4226-bf04-5c3d70d4ef8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:04:48.902496 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4237/8501] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:04:48 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:04:48.913736 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0317c44b-dc63-4a63-941a-af36704781b7 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:04:48.915520 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-0317c44b-dc63-4a63-941a-af36704781b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:04:48.976687 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0317c44b-dc63-4a63-941a-af36704781b7 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:04:48.980424 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83871f91-f254-4208-bf82-79643c20f054 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec5fd3a489c341b7964704d689037f05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:04:48.981076 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83871f91-f254-4208-bf82-79643c20f054 service cinder] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:48.981357 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83871f91-f254-4208-bf82-79643c20f054 service cinder] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:48.981632 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83871f91-f254-4208-bf82-79643c20f054 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:48.990970 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83871f91-f254-4208-bf82-79643c20f054 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:04:48.992402 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83871f91-f254-4208-bf82-79643c20f054 service cinder] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:04:49.002394 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4265/8502] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:04:48 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:04:50.394295 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6071892c-fc3d-4226-bf04-5c3d70d4ef8e None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:04:50.443429 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:04:50.471339 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6071892c-fc3d-4226-bf04-5c3d70d4ef8e None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:04:50.477524 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9453be09-c045-451e-9931-103cafa10e80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:04:50.478476 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9453be09-c045-451e-9931-103cafa10e80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:50.478753 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9453be09-c045-451e-9931-103cafa10e80 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:50.479031 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9453be09-c045-451e-9931-103cafa10e80 admin admin] PATH_INFO: `/v3/users/c39d55594e0347e591848465ae1ccdcd` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:50.480353 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9453be09-c045-451e-9931-103cafa10e80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c39d55594e0347e591848465ae1ccdcd)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:04:50.482341 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9453be09-c045-451e-9931-103cafa10e80 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:04:50.531421 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-9453be09-c045-451e-9931-103cafa10e80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c39d55594e0347e591848465ae1ccdcd'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:04:50.538229 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-9453be09-c045-451e-9931-103cafa10e80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c39d55594e0347e591848465ae1ccdcd'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:04:50.538961 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-9453be09-c045-451e-9931-103cafa10e80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c39d55594e0347e591848465ae1ccdcd'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:04:50.547446 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-9453be09-c045-451e-9931-103cafa10e80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c39d55594e0347e591848465ae1ccdcd'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:04:50.559912 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-9453be09-c045-451e-9931-103cafa10e80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c39d55594e0347e591848465ae1ccdcd'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:04:50.565878 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4238/8503] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 22:04:50 2022] DELETE /identity/v3/users/c39d55594e0347e591848465ae1ccdcd => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:04:50.570721 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5ac982-82c8-4d93-9bf6-c0ce57873076 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:50.571199 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5ac982-82c8-4d93-9bf6-c0ce57873076 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:50.571322 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5ac982-82c8-4d93-9bf6-c0ce57873076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:50.590637 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-cf5ac982-82c8-4d93-9bf6-c0ce57873076 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:04:50.591868 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-cf5ac982-82c8-4d93-9bf6-c0ce57873076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:04:50.642909 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:04:50.662722 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4266/8504] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:04:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:04:50.672630 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9453be09-c045-451e-9931-103cafa10e80 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:04:50.674183 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-9453be09-c045-451e-9931-103cafa10e80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:04:50.734860 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9453be09-c045-451e-9931-103cafa10e80 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:04:50.738954 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce605aa5-a3b3-477f-b45b-5edaec95d4b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:04:50.739624 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce605aa5-a3b3-477f-b45b-5edaec95d4b3 service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:50.740014 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce605aa5-a3b3-477f-b45b-5edaec95d4b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:50.740301 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce605aa5-a3b3-477f-b45b-5edaec95d4b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:50.750737 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce605aa5-a3b3-477f-b45b-5edaec95d4b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:04:50.752179 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce605aa5-a3b3-477f-b45b-5edaec95d4b3 service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:04:50.762660 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4239/8505] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:04:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 23 22:04:51.042650 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5ac982-82c8-4d93-9bf6-c0ce57873076 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:04:51.044574 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-cf5ac982-82c8-4d93-9bf6-c0ce57873076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:04:51.061789 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5ac982-82c8-4d93-9bf6-c0ce57873076 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:04:51.067139 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bfac70-da27-409d-8f4e-2c3ff8a68088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:04:51.068134 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bfac70-da27-409d-8f4e-2c3ff8a68088 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:51.068310 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bfac70-da27-409d-8f4e-2c3ff8a68088 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:51.068616 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bfac70-da27-409d-8f4e-2c3ff8a68088 admin admin] PATH_INFO: `/v3/projects/26a866f7f7d24ac7a39a4e68e350de95` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:51.070082 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bfac70-da27-409d-8f4e-2c3ff8a68088 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26a866f7f7d24ac7a39a4e68e350de95)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:04:51.071978 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bfac70-da27-409d-8f4e-2c3ff8a68088 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:04:51.127048 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-94bfac70-da27-409d-8f4e-2c3ff8a68088 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26a866f7f7d24ac7a39a4e68e350de95', 'request_id': 'req-94bfac70-da27-409d-8f4e-2c3ff8a68088'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:04:51.136044 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-94bfac70-da27-409d-8f4e-2c3ff8a68088 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26a866f7f7d24ac7a39a4e68e350de95', 'request_id': 'req-94bfac70-da27-409d-8f4e-2c3ff8a68088'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:04:51.141951 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-94bfac70-da27-409d-8f4e-2c3ff8a68088 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26a866f7f7d24ac7a39a4e68e350de95', 'request_id': 'req-94bfac70-da27-409d-8f4e-2c3ff8a68088'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:04:51.152942 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-94bfac70-da27-409d-8f4e-2c3ff8a68088 admin admin] The token cache is being invalidate because project 26a866f7f7d24ac7a39a4e68e350de95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 22:04:51.153221 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-94bfac70-da27-409d-8f4e-2c3ff8a68088 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:04:51.153889 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-94bfac70-da27-409d-8f4e-2c3ff8a68088 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:04:51.155474 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4267/8506] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 22:04:51 2022] DELETE /identity/v3/projects/26a866f7f7d24ac7a39a4e68e350de95 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:04:51.159720 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce605aa5-a3b3-477f-b45b-5edaec95d4b3 service neutron] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:04:51.169750 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce605aa5-a3b3-477f-b45b-5edaec95d4b3 service neutron] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:04:51.227184 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f14277-c0a4-47bc-a6f8-b8b7f531e920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:04:51.228072 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f14277-c0a4-47bc-a6f8-b8b7f531e920 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:51.228347 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f14277-c0a4-47bc-a6f8-b8b7f531e920 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:51.228613 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f14277-c0a4-47bc-a6f8-b8b7f531e920 admin admin] PATH_INFO: `/v3/users/ddd87b7c3bc64ccaadfe5e3eb8016dad` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:51.229910 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f14277-c0a4-47bc-a6f8-b8b7f531e920 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ddd87b7c3bc64ccaadfe5e3eb8016dad)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:04:51.231856 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f14277-c0a4-47bc-a6f8-b8b7f531e920 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:04:51.237160 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:04:51.282291 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-b4f14277-c0a4-47bc-a6f8-b8b7f531e920 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ddd87b7c3bc64ccaadfe5e3eb8016dad'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:04:51.289387 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-b4f14277-c0a4-47bc-a6f8-b8b7f531e920 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ddd87b7c3bc64ccaadfe5e3eb8016dad'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:04:51.290031 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-b4f14277-c0a4-47bc-a6f8-b8b7f531e920 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ddd87b7c3bc64ccaadfe5e3eb8016dad'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:04:51.300435 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-b4f14277-c0a4-47bc-a6f8-b8b7f531e920 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ddd87b7c3bc64ccaadfe5e3eb8016dad'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:04:51.312478 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-b4f14277-c0a4-47bc-a6f8-b8b7f531e920 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ddd87b7c3bc64ccaadfe5e3eb8016dad'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:04:51.318427 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4240/8507] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 22:04:51 2022] DELETE /identity/v3/users/ddd87b7c3bc64ccaadfe5e3eb8016dad => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:04:51.593729 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bfac70-da27-409d-8f4e-2c3ff8a68088 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:04:51.594855 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-94bfac70-da27-409d-8f4e-2c3ff8a68088 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:04:51.610773 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bfac70-da27-409d-8f4e-2c3ff8a68088 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:04:51.670460 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d129a3d8-2646-4d5c-9735-ee3c75d442fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:04:51.671340 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d129a3d8-2646-4d5c-9735-ee3c75d442fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:51.671616 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d129a3d8-2646-4d5c-9735-ee3c75d442fd admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:51.671887 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d129a3d8-2646-4d5c-9735-ee3c75d442fd admin admin] PATH_INFO: `/v3/projects/a1dd799387654ca183ffd3be8b0ca308` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:51.673117 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d129a3d8-2646-4d5c-9735-ee3c75d442fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1dd799387654ca183ffd3be8b0ca308)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:04:51.675034 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d129a3d8-2646-4d5c-9735-ee3c75d442fd admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:04:51.724264 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-d129a3d8-2646-4d5c-9735-ee3c75d442fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1dd799387654ca183ffd3be8b0ca308', 'request_id': 'req-d129a3d8-2646-4d5c-9735-ee3c75d442fd'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:04:51.733085 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-d129a3d8-2646-4d5c-9735-ee3c75d442fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1dd799387654ca183ffd3be8b0ca308', 'request_id': 'req-d129a3d8-2646-4d5c-9735-ee3c75d442fd'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:04:51.738849 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-d129a3d8-2646-4d5c-9735-ee3c75d442fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1dd799387654ca183ffd3be8b0ca308', 'request_id': 'req-d129a3d8-2646-4d5c-9735-ee3c75d442fd'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:04:51.746759 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:04:51.751406 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-d129a3d8-2646-4d5c-9735-ee3c75d442fd admin admin] The token cache is being invalidate because project a1dd799387654ca183ffd3be8b0ca308 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 22:04:51.751691 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-d129a3d8-2646-4d5c-9735-ee3c75d442fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:04:51.752591 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-d129a3d8-2646-4d5c-9735-ee3c75d442fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:04:51.754728 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4268/8508] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 22:04:51 2022] DELETE /identity/v3/projects/a1dd799387654ca183ffd3be8b0ca308 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:04:51.759705 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2d5dff-e672-48ac-9404-ec83bb927455 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:51.760183 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2d5dff-e672-48ac-9404-ec83bb927455 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:51.760304 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2d5dff-e672-48ac-9404-ec83bb927455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:51.778555 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-bd2d5dff-e672-48ac-9404-ec83bb927455 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:04:51.779752 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-bd2d5dff-e672-48ac-9404-ec83bb927455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:04:51.845394 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4241/8509] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:04:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:04:51.854557 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71983ed1-5e8f-48f1-aecc-fda0129da4a9 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:51.854847 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71983ed1-5e8f-48f1-aecc-fda0129da4a9 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:51.855128 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71983ed1-5e8f-48f1-aecc-fda0129da4a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:51.874109 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-71983ed1-5e8f-48f1-aecc-fda0129da4a9 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:04:51.875329 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-71983ed1-5e8f-48f1-aecc-fda0129da4a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:04:51.884248 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4269/8510] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:04:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:04:51.888624 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2d5dff-e672-48ac-9404-ec83bb927455 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:04:51.898994 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2d5dff-e672-48ac-9404-ec83bb927455 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:04:51.904644 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21a961a-2a97-4d36-9036-638fee05a68b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:04:51.905307 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21a961a-2a97-4d36-9036-638fee05a68b admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:51.905592 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21a961a-2a97-4d36-9036-638fee05a68b admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:51.905889 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21a961a-2a97-4d36-9036-638fee05a68b admin admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:51.906625 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21a961a-2a97-4d36-9036-638fee05a68b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 22:04:51.906930 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21a961a-2a97-4d36-9036-638fee05a68b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:04:51.908601 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21a961a-2a97-4d36-9036-638fee05a68b admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:04:51.921036 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4242/8511] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 22:04:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 22:04:51.925274 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71983ed1-5e8f-48f1-aecc-fda0129da4a9 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:04:51.935134 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71983ed1-5e8f-48f1-aecc-fda0129da4a9 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:04:51.941021 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7041e29-9bab-49ec-bd6a-115bc85c938b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:04:51.941675 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7041e29-9bab-49ec-bd6a-115bc85c938b admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:51.942023 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7041e29-9bab-49ec-bd6a-115bc85c938b admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:51.942295 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7041e29-9bab-49ec-bd6a-115bc85c938b admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:51.942980 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7041e29-9bab-49ec-bd6a-115bc85c938b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:04:51.944892 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7041e29-9bab-49ec-bd6a-115bc85c938b admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:04:51.974060 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4270/8512] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 22:04:51 2022] POST /identity/v3/projects => generated 399 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 22:04:51.978117 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21a961a-2a97-4d36-9036-638fee05a68b admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:04:51.988442 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21a961a-2a97-4d36-9036-638fee05a68b admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:04:52.048020 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a89fff-dd4e-45b5-9b7a-6a1f841c38a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:04:52.048702 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a89fff-dd4e-45b5-9b7a-6a1f841c38a0 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:52.048986 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a89fff-dd4e-45b5-9b7a-6a1f841c38a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:52.049261 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a89fff-dd4e-45b5-9b7a-6a1f841c38a0 admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:52.049998 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a89fff-dd4e-45b5-9b7a-6a1f841c38a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:04:52.052014 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a89fff-dd4e-45b5-9b7a-6a1f841c38a0 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:04:52.076522 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4243/8513] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 22:04:51 2022] POST /identity/v3/users => generated 300 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 22:04:52.077753 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7041e29-9bab-49ec-bd6a-115bc85c938b admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:04:52.088519 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7041e29-9bab-49ec-bd6a-115bc85c938b admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:04:52.093889 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398679f1-ee17-4ffc-87ff-5b904edcecb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:04:52.094548 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398679f1-ee17-4ffc-87ff-5b904edcecb1 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:52.094829 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398679f1-ee17-4ffc-87ff-5b904edcecb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:52.095107 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398679f1-ee17-4ffc-87ff-5b904edcecb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:52.095887 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398679f1-ee17-4ffc-87ff-5b904edcecb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:04:52.097454 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398679f1-ee17-4ffc-87ff-5b904edcecb1 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:04:52.109308 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4271/8514] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 22:04:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 22:04:52.113295 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a89fff-dd4e-45b5-9b7a-6a1f841c38a0 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:04:52.118926 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:04:52.124818 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a89fff-dd4e-45b5-9b7a-6a1f841c38a0 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:04:52.130507 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5472f212-4d4d-47fd-a850-2571a6522f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:04:52.131278 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5472f212-4d4d-47fd-a850-2571a6522f1e admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:52.131567 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5472f212-4d4d-47fd-a850-2571a6522f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:52.132026 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5472f212-4d4d-47fd-a850-2571a6522f1e admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:52.132951 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5472f212-4d4d-47fd-a850-2571a6522f1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:04:52.134776 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5472f212-4d4d-47fd-a850-2571a6522f1e admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:04:52.145370 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4244/8515] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 22:04:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 22:04:52.149581 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398679f1-ee17-4ffc-87ff-5b904edcecb1 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:04:52.160004 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398679f1-ee17-4ffc-87ff-5b904edcecb1 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:04:52.165570 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f102da3d-7aa7-42ab-ba5b-5fad15ecf4dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:04:52.166568 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f102da3d-7aa7-42ab-ba5b-5fad15ecf4dc admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:52.166849 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f102da3d-7aa7-42ab-ba5b-5fad15ecf4dc admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:52.167123 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f102da3d-7aa7-42ab-ba5b-5fad15ecf4dc admin admin] PATH_INFO: `/v3/projects/2a2b5960905346e9a6de4cb9d1ac6f02/users/ba502fbccd7245b4ae4916e132c4a7c6/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:52.182194 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f102da3d-7aa7-42ab-ba5b-5fad15ecf4dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a2b5960905346e9a6de4cb9d1ac6f02, user_id=ba502fbccd7245b4ae4916e132c4a7c6, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:04:52.184844 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f102da3d-7aa7-42ab-ba5b-5fad15ecf4dc admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:04:52.200311 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4272/8516] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 22:04:52 2022] PUT /identity/v3/projects/2a2b5960905346e9a6de4cb9d1ac6f02/users/ba502fbccd7245b4ae4916e132c4a7c6/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:04:52.211968 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53060cb-b087-46fb-ac3f-5fb1e6fe17c7 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:52.212385 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53060cb-b087-46fb-ac3f-5fb1e6fe17c7 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:52.212683 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53060cb-b087-46fb-ac3f-5fb1e6fe17c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:52.245323 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-e53060cb-b087-46fb-ac3f-5fb1e6fe17c7 None None] MFA Rules not processed for user `ba502fbccd7245b4ae4916e132c4a7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:04:52.246560 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-e53060cb-b087-46fb-ac3f-5fb1e6fe17c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:04:52.316662 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4245/8517] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:04:52 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:04:52.321463 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f102da3d-7aa7-42ab-ba5b-5fad15ecf4dc admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:04:52.386882 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f102da3d-7aa7-42ab-ba5b-5fad15ecf4dc admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:04:52.392413 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffab060a-1828-4e79-9fa8-284e61c8a834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:04:52.393077 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffab060a-1828-4e79-9fa8-284e61c8a834 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:52.393353 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffab060a-1828-4e79-9fa8-284e61c8a834 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:52.393625 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffab060a-1828-4e79-9fa8-284e61c8a834 admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:52.394348 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffab060a-1828-4e79-9fa8-284e61c8a834 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:04:52.396337 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffab060a-1828-4e79-9fa8-284e61c8a834 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:04:52.425559 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4273/8518] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 22:04:52 2022] POST /identity/v3/projects => generated 399 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 22:04:52.428453 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53060cb-b087-46fb-ac3f-5fb1e6fe17c7 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:04:52.440019 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53060cb-b087-46fb-ac3f-5fb1e6fe17c7 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:04:52.496559 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c91842e-51ff-424b-8a31-44ff1c9ec22b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:04:52.497143 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c91842e-51ff-424b-8a31-44ff1c9ec22b admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:52.497427 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c91842e-51ff-424b-8a31-44ff1c9ec22b admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:52.497699 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c91842e-51ff-424b-8a31-44ff1c9ec22b admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:52.498425 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c91842e-51ff-424b-8a31-44ff1c9ec22b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:04:52.500369 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c91842e-51ff-424b-8a31-44ff1c9ec22b admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:04:52.524361 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4246/8519] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 22:04:52 2022] POST /identity/v3/users => generated 306 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 22:04:52.528682 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffab060a-1828-4e79-9fa8-284e61c8a834 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:04:52.539505 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffab060a-1828-4e79-9fa8-284e61c8a834 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:04:52.544480 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93930243-f114-4b5f-943b-2c9ef2400fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:04:52.545137 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93930243-f114-4b5f-943b-2c9ef2400fb6 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:52.545415 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93930243-f114-4b5f-943b-2c9ef2400fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:52.545703 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93930243-f114-4b5f-943b-2c9ef2400fb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:52.546431 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93930243-f114-4b5f-943b-2c9ef2400fb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:04:52.548059 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93930243-f114-4b5f-943b-2c9ef2400fb6 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:04:52.558822 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4274/8520] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 22:04:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 22:04:52.562874 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c91842e-51ff-424b-8a31-44ff1c9ec22b admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:04:52.573447 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c91842e-51ff-424b-8a31-44ff1c9ec22b admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:04:52.579239 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e46807-2148-499c-a09b-c0261ca95835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:04:52.580128 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e46807-2148-499c-a09b-c0261ca95835 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:52.580414 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e46807-2148-499c-a09b-c0261ca95835 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:52.580690 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e46807-2148-499c-a09b-c0261ca95835 admin admin] PATH_INFO: `/v3/projects/8d0669023cc04e1ebd5b7a055bdb3e87/users/e33ee73c50494e7ca58792231e18b96a/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:52.596703 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e46807-2148-499c-a09b-c0261ca95835 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d0669023cc04e1ebd5b7a055bdb3e87, user_id=e33ee73c50494e7ca58792231e18b96a, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:04:52.599545 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e46807-2148-499c-a09b-c0261ca95835 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:04:52.615939 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4247/8521] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 22:04:52 2022] PUT /identity/v3/projects/8d0669023cc04e1ebd5b7a055bdb3e87/users/e33ee73c50494e7ca58792231e18b96a/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 22:04:52.620240 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93930243-f114-4b5f-943b-2c9ef2400fb6 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:04:52.631517 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93930243-f114-4b5f-943b-2c9ef2400fb6 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:04:52.692754 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a83e4c5-bcc3-4df2-8c3b-632a04e1bd54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:04:52.693447 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a83e4c5-bcc3-4df2-8c3b-632a04e1bd54 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:52.693733 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a83e4c5-bcc3-4df2-8c3b-632a04e1bd54 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:52.694044 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a83e4c5-bcc3-4df2-8c3b-632a04e1bd54 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:52.694784 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a83e4c5-bcc3-4df2-8c3b-632a04e1bd54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:04:52.696420 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a83e4c5-bcc3-4df2-8c3b-632a04e1bd54 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:04:52.710569 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4275/8522] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 22:04:52 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 22:04:52.711825 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e46807-2148-499c-a09b-c0261ca95835 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:04:52.723353 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e46807-2148-499c-a09b-c0261ca95835 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:04:52.728160 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f75cda-fd30-4367-8fce-cf7ff9207297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:04:52.729075 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f75cda-fd30-4367-8fce-cf7ff9207297 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:52.729353 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f75cda-fd30-4367-8fce-cf7ff9207297 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:52.729623 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f75cda-fd30-4367-8fce-cf7ff9207297 admin admin] PATH_INFO: `/v3/projects/8d0669023cc04e1ebd5b7a055bdb3e87/users/e33ee73c50494e7ca58792231e18b96a/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:52.731688 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f75cda-fd30-4367-8fce-cf7ff9207297 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d0669023cc04e1ebd5b7a055bdb3e87, user_id=e33ee73c50494e7ca58792231e18b96a, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:04:52.734429 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f75cda-fd30-4367-8fce-cf7ff9207297 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:04:52.755304 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4248/8523] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 22:04:52 2022] PUT /identity/v3/projects/8d0669023cc04e1ebd5b7a055bdb3e87/users/e33ee73c50494e7ca58792231e18b96a/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:04:52.757188 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae94e28-22a0-48e7-8d01-bd5932741929 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:52.757480 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae94e28-22a0-48e7-8d01-bd5932741929 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:52.757761 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae94e28-22a0-48e7-8d01-bd5932741929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:52.771229 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:04:52.788806 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-2ae94e28-22a0-48e7-8d01-bd5932741929 None None] MFA Rules not processed for user `e33ee73c50494e7ca58792231e18b96a`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:04:52.790471 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-2ae94e28-22a0-48e7-8d01-bd5932741929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:04:52.862701 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4276/8524] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:04:52 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 22:04:52.873779 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f75cda-fd30-4367-8fce-cf7ff9207297 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:04:52.875707 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-78f75cda-fd30-4367-8fce-cf7ff9207297 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:04:52.913810 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:04:52.940015 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f75cda-fd30-4367-8fce-cf7ff9207297 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:04:52.943917 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a4079d-45b0-4a7a-96ba-35bd77fa5741 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec5fd3a489c341b7964704d689037f05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:04:52.944608 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a4079d-45b0-4a7a-96ba-35bd77fa5741 service cinder] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:52.944855 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a4079d-45b0-4a7a-96ba-35bd77fa5741 service cinder] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:52.945158 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a4079d-45b0-4a7a-96ba-35bd77fa5741 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:52.954432 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a4079d-45b0-4a7a-96ba-35bd77fa5741 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:04:52.955875 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a4079d-45b0-4a7a-96ba-35bd77fa5741 service cinder] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:04:52.965963 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4249/8525] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:04:52 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:04:53.042744 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae94e28-22a0-48e7-8d01-bd5932741929 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:04:53.053877 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae94e28-22a0-48e7-8d01-bd5932741929 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:04:53.058439 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0855db-d3e3-480a-82e4-a86e95c24460 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec5fd3a489c341b7964704d689037f05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:04:53.059093 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0855db-d3e3-480a-82e4-a86e95c24460 service cinder] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:53.059374 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0855db-d3e3-480a-82e4-a86e95c24460 service cinder] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:53.059651 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0855db-d3e3-480a-82e4-a86e95c24460 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:53.118764 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0855db-d3e3-480a-82e4-a86e95c24460 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:04:53.120237 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0855db-d3e3-480a-82e4-a86e95c24460 service cinder] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:04:53.129500 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4277/8526] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:04:53 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:04:54.750021 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a4079d-45b0-4a7a-96ba-35bd77fa5741 service cinder] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:04:54.812333 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a4079d-45b0-4a7a-96ba-35bd77fa5741 service cinder] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:04:54.817760 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48342c29-8fe7-4c2f-b4fb-ea90aa6e1c8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:04:54.818782 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48342c29-8fe7-4c2f-b4fb-ea90aa6e1c8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:54.819076 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48342c29-8fe7-4c2f-b4fb-ea90aa6e1c8f admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:54.819331 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48342c29-8fe7-4c2f-b4fb-ea90aa6e1c8f admin admin] PATH_INFO: `/v3/users/ba502fbccd7245b4ae4916e132c4a7c6` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:54.820832 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48342c29-8fe7-4c2f-b4fb-ea90aa6e1c8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba502fbccd7245b4ae4916e132c4a7c6)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:04:54.822736 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48342c29-8fe7-4c2f-b4fb-ea90aa6e1c8f admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:04:54.873051 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-48342c29-8fe7-4c2f-b4fb-ea90aa6e1c8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba502fbccd7245b4ae4916e132c4a7c6'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:04:54.880701 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-48342c29-8fe7-4c2f-b4fb-ea90aa6e1c8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba502fbccd7245b4ae4916e132c4a7c6'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:04:54.881493 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-48342c29-8fe7-4c2f-b4fb-ea90aa6e1c8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba502fbccd7245b4ae4916e132c4a7c6'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:04:54.890212 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-48342c29-8fe7-4c2f-b4fb-ea90aa6e1c8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba502fbccd7245b4ae4916e132c4a7c6'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:04:54.902546 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-48342c29-8fe7-4c2f-b4fb-ea90aa6e1c8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba502fbccd7245b4ae4916e132c4a7c6'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:04:54.909299 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4250/8527] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 22:04:54 2022] DELETE /identity/v3/users/ba502fbccd7245b4ae4916e132c4a7c6 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:04:54.914342 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c3719c-20df-4c48-bb5a-0cb6ed339764 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:54.914859 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c3719c-20df-4c48-bb5a-0cb6ed339764 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:54.914859 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c3719c-20df-4c48-bb5a-0cb6ed339764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:54.933486 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-b9c3719c-20df-4c48-bb5a-0cb6ed339764 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:04:54.934650 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-b9c3719c-20df-4c48-bb5a-0cb6ed339764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:04:54.996551 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4278/8528] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:04:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:04:55.008391 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48342c29-8fe7-4c2f-b4fb-ea90aa6e1c8f admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:04:55.010029 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-48342c29-8fe7-4c2f-b4fb-ea90aa6e1c8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:04:55.067002 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48342c29-8fe7-4c2f-b4fb-ea90aa6e1c8f admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:04:55.071145 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ca8aff-ad2d-4f84-81e9-a2195f02a5cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:04:55.071788 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ca8aff-ad2d-4f84-81e9-a2195f02a5cd service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:55.072066 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ca8aff-ad2d-4f84-81e9-a2195f02a5cd service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:55.072344 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ca8aff-ad2d-4f84-81e9-a2195f02a5cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:55.081644 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ca8aff-ad2d-4f84-81e9-a2195f02a5cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:04:55.083134 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ca8aff-ad2d-4f84-81e9-a2195f02a5cd service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:04:55.087190 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:04:55.094923 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4251/8529] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:04:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:04:55.381961 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c3719c-20df-4c48-bb5a-0cb6ed339764 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:04:55.383546 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-b9c3719c-20df-4c48-bb5a-0cb6ed339764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:04:55.397236 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c3719c-20df-4c48-bb5a-0cb6ed339764 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:04:55.403309 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9d15f6-639a-408e-8598-842cb5b79fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:04:55.404149 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9d15f6-639a-408e-8598-842cb5b79fe9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:55.404430 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9d15f6-639a-408e-8598-842cb5b79fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:55.404709 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9d15f6-639a-408e-8598-842cb5b79fe9 admin admin] PATH_INFO: `/v3/projects/2a2b5960905346e9a6de4cb9d1ac6f02` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:55.405994 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9d15f6-639a-408e-8598-842cb5b79fe9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a2b5960905346e9a6de4cb9d1ac6f02)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:04:55.408038 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9d15f6-639a-408e-8598-842cb5b79fe9 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:04:55.440762 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:04:55.458181 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-ce9d15f6-639a-408e-8598-842cb5b79fe9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a2b5960905346e9a6de4cb9d1ac6f02', 'request_id': 'req-ce9d15f6-639a-408e-8598-842cb5b79fe9'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:04:55.467001 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-ce9d15f6-639a-408e-8598-842cb5b79fe9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a2b5960905346e9a6de4cb9d1ac6f02', 'request_id': 'req-ce9d15f6-639a-408e-8598-842cb5b79fe9'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:04:55.473036 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-ce9d15f6-639a-408e-8598-842cb5b79fe9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a2b5960905346e9a6de4cb9d1ac6f02', 'request_id': 'req-ce9d15f6-639a-408e-8598-842cb5b79fe9'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:04:55.485082 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-ce9d15f6-639a-408e-8598-842cb5b79fe9 admin admin] The token cache is being invalidate because project 2a2b5960905346e9a6de4cb9d1ac6f02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 22:04:55.485373 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-ce9d15f6-639a-408e-8598-842cb5b79fe9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:04:55.486114 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-ce9d15f6-639a-408e-8598-842cb5b79fe9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:04:55.487790 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4279/8530] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 22:04:55 2022] DELETE /identity/v3/projects/2a2b5960905346e9a6de4cb9d1ac6f02 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 22:04:55.492061 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ca8aff-ad2d-4f84-81e9-a2195f02a5cd service neutron] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:04:55.502166 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ca8aff-ad2d-4f84-81e9-a2195f02a5cd service neutron] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:04:55.565098 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c72005a-aefa-4115-8c3d-153ddfbdfe43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:04:55.566030 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c72005a-aefa-4115-8c3d-153ddfbdfe43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:55.566338 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c72005a-aefa-4115-8c3d-153ddfbdfe43 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:55.566611 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c72005a-aefa-4115-8c3d-153ddfbdfe43 admin admin] PATH_INFO: `/v3/users/e33ee73c50494e7ca58792231e18b96a` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:55.567831 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c72005a-aefa-4115-8c3d-153ddfbdfe43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e33ee73c50494e7ca58792231e18b96a)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:04:55.569903 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c72005a-aefa-4115-8c3d-153ddfbdfe43 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:04:55.625100 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-0c72005a-aefa-4115-8c3d-153ddfbdfe43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e33ee73c50494e7ca58792231e18b96a'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:04:55.632145 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-0c72005a-aefa-4115-8c3d-153ddfbdfe43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e33ee73c50494e7ca58792231e18b96a'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:04:55.632853 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-0c72005a-aefa-4115-8c3d-153ddfbdfe43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e33ee73c50494e7ca58792231e18b96a'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:04:55.642053 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-0c72005a-aefa-4115-8c3d-153ddfbdfe43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e33ee73c50494e7ca58792231e18b96a'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:04:55.654246 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-0c72005a-aefa-4115-8c3d-153ddfbdfe43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e33ee73c50494e7ca58792231e18b96a'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:04:55.660210 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4252/8531] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 22:04:55 2022] DELETE /identity/v3/users/e33ee73c50494e7ca58792231e18b96a => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:04:55.952236 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9d15f6-639a-408e-8598-842cb5b79fe9 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:04:55.953803 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-ce9d15f6-639a-408e-8598-842cb5b79fe9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:04:55.967968 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9d15f6-639a-408e-8598-842cb5b79fe9 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:04:56.025793 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cdb6a1-bcaf-4b04-bd8a-09f90fc01811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:04:56.026615 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cdb6a1-bcaf-4b04-bd8a-09f90fc01811 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:56.026893 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cdb6a1-bcaf-4b04-bd8a-09f90fc01811 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:56.027162 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cdb6a1-bcaf-4b04-bd8a-09f90fc01811 admin admin] PATH_INFO: `/v3/projects/8d0669023cc04e1ebd5b7a055bdb3e87` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:56.028355 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cdb6a1-bcaf-4b04-bd8a-09f90fc01811 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d0669023cc04e1ebd5b7a055bdb3e87)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:04:56.030310 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cdb6a1-bcaf-4b04-bd8a-09f90fc01811 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:04:56.077889 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-e0cdb6a1-bcaf-4b04-bd8a-09f90fc01811 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d0669023cc04e1ebd5b7a055bdb3e87', 'request_id': 'req-e0cdb6a1-bcaf-4b04-bd8a-09f90fc01811'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:04:56.085534 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-e0cdb6a1-bcaf-4b04-bd8a-09f90fc01811 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d0669023cc04e1ebd5b7a055bdb3e87', 'request_id': 'req-e0cdb6a1-bcaf-4b04-bd8a-09f90fc01811'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:04:56.091564 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-e0cdb6a1-bcaf-4b04-bd8a-09f90fc01811 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d0669023cc04e1ebd5b7a055bdb3e87', 'request_id': 'req-e0cdb6a1-bcaf-4b04-bd8a-09f90fc01811'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:04:56.102449 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-e0cdb6a1-bcaf-4b04-bd8a-09f90fc01811 admin admin] The token cache is being invalidate because project 8d0669023cc04e1ebd5b7a055bdb3e87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 22:04:56.102727 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-e0cdb6a1-bcaf-4b04-bd8a-09f90fc01811 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:04:56.103363 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-e0cdb6a1-bcaf-4b04-bd8a-09f90fc01811 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:04:56.104930 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4280/8532] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 22:04:55 2022] DELETE /identity/v3/projects/8d0669023cc04e1ebd5b7a055bdb3e87 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:04:56.109995 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48692781-caa5-4ff4-89de-84376de70c17 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:56.110496 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48692781-caa5-4ff4-89de-84376de70c17 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:56.110496 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48692781-caa5-4ff4-89de-84376de70c17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:56.128091 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-48692781-caa5-4ff4-89de-84376de70c17 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:04:56.129287 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-48692781-caa5-4ff4-89de-84376de70c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:04:56.188799 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4253/8533] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:04:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:04:56.199125 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bee800f-e878-4717-861b-e71e4c43620c None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:56.199556 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bee800f-e878-4717-861b-e71e4c43620c None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:56.199927 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bee800f-e878-4717-861b-e71e4c43620c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:56.223943 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-8bee800f-e878-4717-861b-e71e4c43620c None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:04:56.225350 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-8bee800f-e878-4717-861b-e71e4c43620c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:04:56.234602 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4281/8534] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:04:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:04:56.239070 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48692781-caa5-4ff4-89de-84376de70c17 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:04:56.249451 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48692781-caa5-4ff4-89de-84376de70c17 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:04:56.255497 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16e0b23-bac1-47f8-b38d-01ad18ed8965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:04:56.256198 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16e0b23-bac1-47f8-b38d-01ad18ed8965 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:56.256475 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16e0b23-bac1-47f8-b38d-01ad18ed8965 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:56.256730 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16e0b23-bac1-47f8-b38d-01ad18ed8965 admin admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:56.257451 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16e0b23-bac1-47f8-b38d-01ad18ed8965 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 22:04:56.257760 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16e0b23-bac1-47f8-b38d-01ad18ed8965 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:04:56.259388 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16e0b23-bac1-47f8-b38d-01ad18ed8965 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:04:56.271216 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4254/8535] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 22:04:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 22:04:56.275404 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bee800f-e878-4717-861b-e71e4c43620c None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:04:56.285038 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bee800f-e878-4717-861b-e71e4c43620c None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:04:56.290419 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9d17b4-3e5c-4573-9c10-3cf5fe4049a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:04:56.291070 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9d17b4-3e5c-4573-9c10-3cf5fe4049a7 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:56.291356 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9d17b4-3e5c-4573-9c10-3cf5fe4049a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:56.291622 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9d17b4-3e5c-4573-9c10-3cf5fe4049a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:56.292308 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9d17b4-3e5c-4573-9c10-3cf5fe4049a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:04:56.294225 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9d17b4-3e5c-4573-9c10-3cf5fe4049a7 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:04:56.321759 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4282/8536] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 22:04:56 2022] POST /identity/v3/projects => generated 389 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 22:04:56.325983 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16e0b23-bac1-47f8-b38d-01ad18ed8965 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:04:56.332383 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:04:56.336640 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16e0b23-bac1-47f8-b38d-01ad18ed8965 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:04:56.395656 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0666c067-72dc-4927-979c-effb9a029098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:04:56.396369 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0666c067-72dc-4927-979c-effb9a029098 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:56.396655 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0666c067-72dc-4927-979c-effb9a029098 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:56.396930 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0666c067-72dc-4927-979c-effb9a029098 admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:56.397623 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0666c067-72dc-4927-979c-effb9a029098 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:04:56.399617 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0666c067-72dc-4927-979c-effb9a029098 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:04:56.424930 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4255/8537] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 22:04:56 2022] POST /identity/v3/users => generated 295 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 22:04:56.430802 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9d17b4-3e5c-4573-9c10-3cf5fe4049a7 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:04:56.441607 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9d17b4-3e5c-4573-9c10-3cf5fe4049a7 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:04:56.446760 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8540fe0-b40d-4c39-8499-36781c72b2e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:04:56.447408 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8540fe0-b40d-4c39-8499-36781c72b2e8 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:56.447696 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8540fe0-b40d-4c39-8499-36781c72b2e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:56.447966 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8540fe0-b40d-4c39-8499-36781c72b2e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:56.448680 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8540fe0-b40d-4c39-8499-36781c72b2e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:04:56.450318 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8540fe0-b40d-4c39-8499-36781c72b2e8 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:04:56.460963 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4283/8538] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 22:04:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 22:04:56.465499 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0666c067-72dc-4927-979c-effb9a029098 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:04:56.476591 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0666c067-72dc-4927-979c-effb9a029098 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:04:56.481440 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dab779a-a649-4380-a347-5b825302ab78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:04:56.482137 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dab779a-a649-4380-a347-5b825302ab78 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:56.482419 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dab779a-a649-4380-a347-5b825302ab78 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:56.482694 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dab779a-a649-4380-a347-5b825302ab78 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:56.483417 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dab779a-a649-4380-a347-5b825302ab78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:04:56.485018 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dab779a-a649-4380-a347-5b825302ab78 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:04:56.495374 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4256/8539] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 22:04:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 22:04:56.499806 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8540fe0-b40d-4c39-8499-36781c72b2e8 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:04:56.506509 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:04:56.510414 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8540fe0-b40d-4c39-8499-36781c72b2e8 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:04:56.516528 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652d692e-5cf8-4659-998e-fe6705009044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:04:56.517411 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652d692e-5cf8-4659-998e-fe6705009044 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:56.517689 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652d692e-5cf8-4659-998e-fe6705009044 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:56.518071 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652d692e-5cf8-4659-998e-fe6705009044 admin admin] PATH_INFO: `/v3/projects/2dd9c77216a447c69de1420ba18749c7/users/85bd4e2fde604486b269a81b8699c618/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:56.533579 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652d692e-5cf8-4659-998e-fe6705009044 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2dd9c77216a447c69de1420ba18749c7, user_id=85bd4e2fde604486b269a81b8699c618, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:04:56.536305 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652d692e-5cf8-4659-998e-fe6705009044 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:04:56.551423 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4284/8540] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 22:04:56 2022] PUT /identity/v3/projects/2dd9c77216a447c69de1420ba18749c7/users/85bd4e2fde604486b269a81b8699c618/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:04:56.562302 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34883a3c-c5dd-4c4e-b79e-2518e00f1345 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:56.562586 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34883a3c-c5dd-4c4e-b79e-2518e00f1345 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:56.562888 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34883a3c-c5dd-4c4e-b79e-2518e00f1345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:56.590402 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-34883a3c-c5dd-4c4e-b79e-2518e00f1345 None None] MFA Rules not processed for user `85bd4e2fde604486b269a81b8699c618`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:04:56.591588 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-34883a3c-c5dd-4c4e-b79e-2518e00f1345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:04:56.657529 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4257/8541] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:04:56 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:04:56.668728 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652d692e-5cf8-4659-998e-fe6705009044 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:04:56.670734 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-652d692e-5cf8-4659-998e-fe6705009044 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:04:56.733160 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652d692e-5cf8-4659-998e-fe6705009044 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:04:56.737741 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba7d0cc-aacd-45d6-a5cd-2f2399d4309f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec5fd3a489c341b7964704d689037f05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:04:56.738430 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba7d0cc-aacd-45d6-a5cd-2f2399d4309f service cinder] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:56.738711 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba7d0cc-aacd-45d6-a5cd-2f2399d4309f service cinder] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:56.738978 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba7d0cc-aacd-45d6-a5cd-2f2399d4309f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:56.748343 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba7d0cc-aacd-45d6-a5cd-2f2399d4309f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:04:56.749788 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba7d0cc-aacd-45d6-a5cd-2f2399d4309f service cinder] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:04:56.759042 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4285/8542] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:04:56 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:04:58.253904 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34883a3c-c5dd-4c4e-b79e-2518e00f1345 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:04:58.328728 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34883a3c-c5dd-4c4e-b79e-2518e00f1345 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:04:58.335907 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fe411d-bcb0-4f9e-b15c-4e8e45a834a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:04:58.336806 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fe411d-bcb0-4f9e-b15c-4e8e45a834a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:58.337114 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fe411d-bcb0-4f9e-b15c-4e8e45a834a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:58.337392 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fe411d-bcb0-4f9e-b15c-4e8e45a834a7 admin admin] PATH_INFO: `/v3/users/85bd4e2fde604486b269a81b8699c618` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:58.338633 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fe411d-bcb0-4f9e-b15c-4e8e45a834a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=85bd4e2fde604486b269a81b8699c618)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:04:58.340957 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fe411d-bcb0-4f9e-b15c-4e8e45a834a7 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:04:58.355822 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:04:58.390400 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-16fe411d-bcb0-4f9e-b15c-4e8e45a834a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85bd4e2fde604486b269a81b8699c618'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:04:58.397358 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-16fe411d-bcb0-4f9e-b15c-4e8e45a834a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85bd4e2fde604486b269a81b8699c618'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:04:58.398159 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-16fe411d-bcb0-4f9e-b15c-4e8e45a834a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85bd4e2fde604486b269a81b8699c618'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:04:58.407771 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-16fe411d-bcb0-4f9e-b15c-4e8e45a834a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85bd4e2fde604486b269a81b8699c618'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:04:58.419870 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-16fe411d-bcb0-4f9e-b15c-4e8e45a834a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85bd4e2fde604486b269a81b8699c618'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:04:58.425753 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4258/8543] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 22:04:58 2022] DELETE /identity/v3/users/85bd4e2fde604486b269a81b8699c618 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:04:58.430666 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c9d88b-dc57-4912-b3b7-b11832de5fbb None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:58.431161 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c9d88b-dc57-4912-b3b7-b11832de5fbb None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:58.431258 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c9d88b-dc57-4912-b3b7-b11832de5fbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:58.448699 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-c7c9d88b-dc57-4912-b3b7-b11832de5fbb None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:04:58.449941 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-c7c9d88b-dc57-4912-b3b7-b11832de5fbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:04:58.511584 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4286/8544] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:04:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:04:58.522267 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fe411d-bcb0-4f9e-b15c-4e8e45a834a7 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:04:58.524633 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-16fe411d-bcb0-4f9e-b15c-4e8e45a834a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:04:58.595466 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fe411d-bcb0-4f9e-b15c-4e8e45a834a7 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:04:58.599746 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80a53f4-1321-4049-82b9-43ab2bd2780e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:04:58.600403 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80a53f4-1321-4049-82b9-43ab2bd2780e service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:58.600679 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80a53f4-1321-4049-82b9-43ab2bd2780e service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:58.601012 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80a53f4-1321-4049-82b9-43ab2bd2780e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:58.611125 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80a53f4-1321-4049-82b9-43ab2bd2780e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:04:58.612565 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80a53f4-1321-4049-82b9-43ab2bd2780e service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:04:58.622653 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4259/8545] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:04:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:04:58.905192 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c9d88b-dc57-4912-b3b7-b11832de5fbb None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:04:58.906916 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-c7c9d88b-dc57-4912-b3b7-b11832de5fbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:04:58.927508 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c9d88b-dc57-4912-b3b7-b11832de5fbb None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:04:58.940030 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8c096f-5292-40c0-809c-338053d4325d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:04:58.940927 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8c096f-5292-40c0-809c-338053d4325d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:58.941183 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8c096f-5292-40c0-809c-338053d4325d admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:58.941454 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8c096f-5292-40c0-809c-338053d4325d admin admin] PATH_INFO: `/v3/projects/2dd9c77216a447c69de1420ba18749c7` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:58.942797 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8c096f-5292-40c0-809c-338053d4325d admin admin] RBAC: Authorizing `identity:delete_project(project_id=2dd9c77216a447c69de1420ba18749c7)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:04:58.944728 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8c096f-5292-40c0-809c-338053d4325d admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:04:58.998280 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-be8c096f-5292-40c0-809c-338053d4325d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2dd9c77216a447c69de1420ba18749c7', 'request_id': 'req-be8c096f-5292-40c0-809c-338053d4325d'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:04:59.007103 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-be8c096f-5292-40c0-809c-338053d4325d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2dd9c77216a447c69de1420ba18749c7', 'request_id': 'req-be8c096f-5292-40c0-809c-338053d4325d'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:04:59.012722 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-be8c096f-5292-40c0-809c-338053d4325d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2dd9c77216a447c69de1420ba18749c7', 'request_id': 'req-be8c096f-5292-40c0-809c-338053d4325d'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:04:59.023860 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-be8c096f-5292-40c0-809c-338053d4325d admin admin] The token cache is being invalidate because project 2dd9c77216a447c69de1420ba18749c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 22:04:59.024140 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-be8c096f-5292-40c0-809c-338053d4325d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:04:59.024754 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-be8c096f-5292-40c0-809c-338053d4325d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:04:59.026390 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4287/8546] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 22:04:58 2022] DELETE /identity/v3/projects/2dd9c77216a447c69de1420ba18749c7 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:04:59.034192 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aa85de-48c4-4454-b3ba-ba035987ad8c None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:59.034480 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aa85de-48c4-4454-b3ba-ba035987ad8c None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:59.034752 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aa85de-48c4-4454-b3ba-ba035987ad8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:59.053601 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-06aa85de-48c4-4454-b3ba-ba035987ad8c None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:04:59.054948 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-06aa85de-48c4-4454-b3ba-ba035987ad8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:04:59.122139 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4260/8547] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:04:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:04:59.130298 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ed80c2-16d4-429d-822b-ed06de03af24 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:59.130591 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ed80c2-16d4-429d-822b-ed06de03af24 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:59.130878 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ed80c2-16d4-429d-822b-ed06de03af24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:59.143718 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:04:59.150545 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-73ed80c2-16d4-429d-822b-ed06de03af24 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:04:59.152217 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-73ed80c2-16d4-429d-822b-ed06de03af24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:04:59.162480 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4288/8548] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:04:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:04:59.166821 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aa85de-48c4-4454-b3ba-ba035987ad8c None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:04:59.177025 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aa85de-48c4-4454-b3ba-ba035987ad8c None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:04:59.182149 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57a9c55-2fd1-4cdf-a43f-30e28f501101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:04:59.182814 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57a9c55-2fd1-4cdf-a43f-30e28f501101 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:59.183099 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57a9c55-2fd1-4cdf-a43f-30e28f501101 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:59.183397 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57a9c55-2fd1-4cdf-a43f-30e28f501101 admin admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:59.184152 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57a9c55-2fd1-4cdf-a43f-30e28f501101 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 22:04:59.184458 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57a9c55-2fd1-4cdf-a43f-30e28f501101 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:04:59.186134 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57a9c55-2fd1-4cdf-a43f-30e28f501101 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:04:59.198017 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4261/8549] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 22:04:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 23 22:04:59.202338 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ed80c2-16d4-429d-822b-ed06de03af24 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:04:59.211955 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ed80c2-16d4-429d-822b-ed06de03af24 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:04:59.217757 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8885cca2-fba7-41ca-9845-ca5a1b58105f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:04:59.218460 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8885cca2-fba7-41ca-9845-ca5a1b58105f admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:59.218743 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8885cca2-fba7-41ca-9845-ca5a1b58105f admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:59.219019 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8885cca2-fba7-41ca-9845-ca5a1b58105f admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:59.219707 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8885cca2-fba7-41ca-9845-ca5a1b58105f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:04:59.221618 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8885cca2-fba7-41ca-9845-ca5a1b58105f admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:04:59.249182 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4289/8550] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 22:04:59 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 22:04:59.253579 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57a9c55-2fd1-4cdf-a43f-30e28f501101 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:04:59.263994 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57a9c55-2fd1-4cdf-a43f-30e28f501101 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:04:59.282951 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:04:59.325043 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e646c8-74fe-43cd-b053-b5359ac6075c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:04:59.325900 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e646c8-74fe-43cd-b053-b5359ac6075c admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:59.326409 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e646c8-74fe-43cd-b053-b5359ac6075c admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:59.326754 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e646c8-74fe-43cd-b053-b5359ac6075c admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:59.327447 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e646c8-74fe-43cd-b053-b5359ac6075c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:04:59.329399 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e646c8-74fe-43cd-b053-b5359ac6075c admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:04:59.352649 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4262/8551] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 22:04:59 2022] POST /identity/v3/users => generated 287 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 22:04:59.357950 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8885cca2-fba7-41ca-9845-ca5a1b58105f admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:04:59.372774 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8885cca2-fba7-41ca-9845-ca5a1b58105f admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:04:59.380096 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b32226-f952-44a9-8694-00c769511c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:04:59.380797 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b32226-f952-44a9-8694-00c769511c0a admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:59.381074 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b32226-f952-44a9-8694-00c769511c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:59.381339 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b32226-f952-44a9-8694-00c769511c0a admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:59.382162 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b32226-f952-44a9-8694-00c769511c0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:04:59.383795 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b32226-f952-44a9-8694-00c769511c0a admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:04:59.396999 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4290/8552] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 22:04:59 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 22:04:59.401313 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e646c8-74fe-43cd-b053-b5359ac6075c admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:04:59.412376 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e646c8-74fe-43cd-b053-b5359ac6075c admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:04:59.417674 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4a7e6e-b544-4c75-b45b-6c9fb4b6fa69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:04:59.418369 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4a7e6e-b544-4c75-b45b-6c9fb4b6fa69 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:59.418646 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4a7e6e-b544-4c75-b45b-6c9fb4b6fa69 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:59.418913 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4a7e6e-b544-4c75-b45b-6c9fb4b6fa69 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:59.419635 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4a7e6e-b544-4c75-b45b-6c9fb4b6fa69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:04:59.421222 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4a7e6e-b544-4c75-b45b-6c9fb4b6fa69 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:04:59.431315 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4263/8553] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 22:04:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 22:04:59.437460 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b32226-f952-44a9-8694-00c769511c0a admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:04:59.448940 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b32226-f952-44a9-8694-00c769511c0a admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:04:59.454865 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cf6a83-c826-47b3-a49a-c8a1b57a4c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:04:59.455890 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cf6a83-c826-47b3-a49a-c8a1b57a4c07 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:59.456177 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cf6a83-c826-47b3-a49a-c8a1b57a4c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:59.456454 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cf6a83-c826-47b3-a49a-c8a1b57a4c07 admin admin] PATH_INFO: `/v3/projects/1d1919be84b04d4c9306ef33015632a0/users/5ce861b0f93142849eb235b3df8b9aa0/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:59.472822 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cf6a83-c826-47b3-a49a-c8a1b57a4c07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d1919be84b04d4c9306ef33015632a0, user_id=5ce861b0f93142849eb235b3df8b9aa0, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:04:59.475554 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cf6a83-c826-47b3-a49a-c8a1b57a4c07 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:04:59.490285 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4291/8554] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 22:04:59 2022] PUT /identity/v3/projects/1d1919be84b04d4c9306ef33015632a0/users/5ce861b0f93142849eb235b3df8b9aa0/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:04:59.501711 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfadac0-9af1-4d12-9b22-7974a60b44b6 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:59.502037 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfadac0-9af1-4d12-9b22-7974a60b44b6 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:59.502320 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfadac0-9af1-4d12-9b22-7974a60b44b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:59.530315 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-2bfadac0-9af1-4d12-9b22-7974a60b44b6 None None] MFA Rules not processed for user `5ce861b0f93142849eb235b3df8b9aa0`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:04:59.531561 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-2bfadac0-9af1-4d12-9b22-7974a60b44b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:04:59.600573 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4264/8555] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:04:59 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:04:59.605220 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cf6a83-c826-47b3-a49a-c8a1b57a4c07 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:04:59.670528 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cf6a83-c826-47b3-a49a-c8a1b57a4c07 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:04:59.675646 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc55ed40-73a2-4ca3-ba96-11357c93cbc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:04:59.681024 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc55ed40-73a2-4ca3-ba96-11357c93cbc5 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:59.681305 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc55ed40-73a2-4ca3-ba96-11357c93cbc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:59.681856 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc55ed40-73a2-4ca3-ba96-11357c93cbc5 admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:59.682682 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc55ed40-73a2-4ca3-ba96-11357c93cbc5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:04:59.684624 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc55ed40-73a2-4ca3-ba96-11357c93cbc5 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:04:59.717798 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4292/8556] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 22:04:59 2022] POST /identity/v3/projects => generated 373 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 22:04:59.719526 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfadac0-9af1-4d12-9b22-7974a60b44b6 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:04:59.738451 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfadac0-9af1-4d12-9b22-7974a60b44b6 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:04:59.797313 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a90611-92f4-4ed3-bf29-ce9a6db29ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:04:59.798042 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a90611-92f4-4ed3-bf29-ce9a6db29ba7 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:59.798308 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a90611-92f4-4ed3-bf29-ce9a6db29ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:59.798577 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a90611-92f4-4ed3-bf29-ce9a6db29ba7 admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:59.799272 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a90611-92f4-4ed3-bf29-ce9a6db29ba7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:04:59.801203 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a90611-92f4-4ed3-bf29-ce9a6db29ba7 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:04:59.823059 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4265/8557] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 22:04:59 2022] POST /identity/v3/users => generated 293 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 22:04:59.826941 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc55ed40-73a2-4ca3-ba96-11357c93cbc5 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:04:59.838341 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc55ed40-73a2-4ca3-ba96-11357c93cbc5 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:04:59.844470 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7ac086-57ab-496b-bc06-9aad13a867a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:04:59.845199 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7ac086-57ab-496b-bc06-9aad13a867a7 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:59.845477 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7ac086-57ab-496b-bc06-9aad13a867a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:59.845752 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7ac086-57ab-496b-bc06-9aad13a867a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:59.846513 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7ac086-57ab-496b-bc06-9aad13a867a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:04:59.848114 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7ac086-57ab-496b-bc06-9aad13a867a7 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:04:59.858970 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4293/8558] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 22:04:59 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 22:04:59.863246 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a90611-92f4-4ed3-bf29-ce9a6db29ba7 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:04:59.873684 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a90611-92f4-4ed3-bf29-ce9a6db29ba7 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:04:59.878653 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819a7824-05f1-4497-b76b-58f9503919b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:04:59.879539 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819a7824-05f1-4497-b76b-58f9503919b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:59.879815 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819a7824-05f1-4497-b76b-58f9503919b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:59.880091 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819a7824-05f1-4497-b76b-58f9503919b9 admin admin] PATH_INFO: `/v3/projects/d63eff7074af425ca8edb07016cb8100/users/ac472f308fa14b3b8cd2ead16a315804/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:59.895310 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819a7824-05f1-4497-b76b-58f9503919b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d63eff7074af425ca8edb07016cb8100, user_id=ac472f308fa14b3b8cd2ead16a315804, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:04:59.898072 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819a7824-05f1-4497-b76b-58f9503919b9 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:04:59.901100 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:04:59.914293 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4266/8559] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 22:04:59 2022] PUT /identity/v3/projects/d63eff7074af425ca8edb07016cb8100/users/ac472f308fa14b3b8cd2ead16a315804/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:04:59.918320 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7ac086-57ab-496b-bc06-9aad13a867a7 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:04:59.928778 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7ac086-57ab-496b-bc06-9aad13a867a7 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:04:59.987519 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b7682e-12d4-4e85-8d2d-281d3194ddbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:04:59.988197 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b7682e-12d4-4e85-8d2d-281d3194ddbe admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:04:59.988477 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b7682e-12d4-4e85-8d2d-281d3194ddbe admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:04:59.988752 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b7682e-12d4-4e85-8d2d-281d3194ddbe admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:04:59.989470 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b7682e-12d4-4e85-8d2d-281d3194ddbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:04:59.991107 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b7682e-12d4-4e85-8d2d-281d3194ddbe admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:05:00.001090 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4294/8560] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 22:04:59 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 22:05:00.005615 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819a7824-05f1-4497-b76b-58f9503919b9 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:05:00.016461 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819a7824-05f1-4497-b76b-58f9503919b9 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:05:00.026729 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d674418-3a8d-414d-9afb-251b4a5d6477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:05:00.027671 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d674418-3a8d-414d-9afb-251b4a5d6477 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:05:00.027953 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d674418-3a8d-414d-9afb-251b4a5d6477 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:05:00.028225 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d674418-3a8d-414d-9afb-251b4a5d6477 admin admin] PATH_INFO: `/v3/projects/d63eff7074af425ca8edb07016cb8100/users/ac472f308fa14b3b8cd2ead16a315804/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:05:00.030416 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d674418-3a8d-414d-9afb-251b4a5d6477 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d63eff7074af425ca8edb07016cb8100, user_id=ac472f308fa14b3b8cd2ead16a315804, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:05:00.033085 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d674418-3a8d-414d-9afb-251b4a5d6477 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:05:00.047107 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4267/8561] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 22:05:00 2022] PUT /identity/v3/projects/d63eff7074af425ca8edb07016cb8100/users/ac472f308fa14b3b8cd2ead16a315804/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:05:00.059456 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af20b33-bcf5-495d-88cb-85a41f79cbac None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:05:00.059743 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af20b33-bcf5-495d-88cb-85a41f79cbac None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:05:00.060021 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af20b33-bcf5-495d-88cb-85a41f79cbac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:05:00.085787 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:05:00.089009 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-8af20b33-bcf5-495d-88cb-85a41f79cbac None None] MFA Rules not processed for user `ac472f308fa14b3b8cd2ead16a315804`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:05:00.091278 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-8af20b33-bcf5-495d-88cb-85a41f79cbac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:05:00.165985 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4295/8562] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:05:00 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:05:00.177206 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d674418-3a8d-414d-9afb-251b4a5d6477 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:05:00.179302 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-6d674418-3a8d-414d-9afb-251b4a5d6477 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:05:00.242273 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d674418-3a8d-414d-9afb-251b4a5d6477 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:05:00.246607 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14348669-806c-4540-8df2-428c8b4ed607 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:05:00.247259 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14348669-806c-4540-8df2-428c8b4ed607 service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:05:00.247537 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14348669-806c-4540-8df2-428c8b4ed607 service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:05:00.247837 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14348669-806c-4540-8df2-428c8b4ed607 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:05:00.307954 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14348669-806c-4540-8df2-428c8b4ed607 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:05:00.309391 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14348669-806c-4540-8df2-428c8b4ed607 service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:05:00.318546 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4268/8563] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:05:00 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:05:02.110040 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af20b33-bcf5-495d-88cb-85a41f79cbac None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:05:02.111747 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-8af20b33-bcf5-495d-88cb-85a41f79cbac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:05:02.124538 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af20b33-bcf5-495d-88cb-85a41f79cbac None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:05:02.128256 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b65a18e-9558-4914-8fec-4e6607a73407 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:05:02.128906 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b65a18e-9558-4914-8fec-4e6607a73407 service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:05:02.129184 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b65a18e-9558-4914-8fec-4e6607a73407 service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:05:02.129507 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b65a18e-9558-4914-8fec-4e6607a73407 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:05:02.139326 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b65a18e-9558-4914-8fec-4e6607a73407 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:05:02.140762 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b65a18e-9558-4914-8fec-4e6607a73407 service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:05:02.150753 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4296/8564] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:05:02 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:05:07.832902 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a37133a-d38a-4a08-a993-4f63db90b19e None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:05:07.833450 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a37133a-d38a-4a08-a993-4f63db90b19e None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:05:07.833450 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a37133a-d38a-4a08-a993-4f63db90b19e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:05:07.852211 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-5a37133a-d38a-4a08-a993-4f63db90b19e None None] MFA Rules not processed for user `5ce861b0f93142849eb235b3df8b9aa0`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:05:07.853773 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-5a37133a-d38a-4a08-a993-4f63db90b19e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:05:07.860906 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4269/8565] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:05:07 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:05:09.549295 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b43b104-2b63-470f-a7c0-2854b85a2b0a None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:05:09.549802 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b43b104-2b63-470f-a7c0-2854b85a2b0a None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:05:09.549802 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b43b104-2b63-470f-a7c0-2854b85a2b0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:05:09.571203 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-4b43b104-2b63-470f-a7c0-2854b85a2b0a None None] MFA Rules not processed for user `abc719a3b3ac4461b82ca04ab6451d81`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:05:09.572693 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-4b43b104-2b63-470f-a7c0-2854b85a2b0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:05:09.652711 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4297/8566] 10.222.0.17 () {58 vars in 1018 bytes} [Sat Jul 23 22:05:09 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:05:09.664520 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a37133a-d38a-4a08-a993-4f63db90b19e None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:05:09.666190 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-5a37133a-d38a-4a08-a993-4f63db90b19e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:05:09.684063 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a37133a-d38a-4a08-a993-4f63db90b19e None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:05:09.689579 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe08a86-ad70-4a3e-b943-c4b89844ec46 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc719a3b3ac4461b82ca04ab6451d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:05:09.690252 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe08a86-ad70-4a3e-b943-c4b89844ec46 service placement] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:05:09.690532 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe08a86-ad70-4a3e-b943-c4b89844ec46 service placement] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:05:09.690776 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe08a86-ad70-4a3e-b943-c4b89844ec46 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:05:09.699681 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe08a86-ad70-4a3e-b943-c4b89844ec46 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:05:09.701275 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe08a86-ad70-4a3e-b943-c4b89844ec46 service placement] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:05:09.711574 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4270/8567] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:05:09 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:05:19.649717 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=67 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:05:19.707152 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=64,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:05:59.183295 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce028e40-f805-4ba1-87a8-15e06cea61f8 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:05:59.183841 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce028e40-f805-4ba1-87a8-15e06cea61f8 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:05:59.183841 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce028e40-f805-4ba1-87a8-15e06cea61f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:05:59.202403 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-ce028e40-f805-4ba1-87a8-15e06cea61f8 None None] MFA Rules not processed for user `5ce861b0f93142849eb235b3df8b9aa0`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:05:59.203608 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-ce028e40-f805-4ba1-87a8-15e06cea61f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:05:59.211654 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4298/8568] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:05:59 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:06:02.011180 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe08a86-ad70-4a3e-b943-c4b89844ec46 service placement] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:06:02.022589 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe08a86-ad70-4a3e-b943-c4b89844ec46 service placement] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:06:02.026427 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6202c5cc-fdf0-4589-b5dc-437abb8fc0b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:06:02.027105 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6202c5cc-fdf0-4589-b5dc-437abb8fc0b6 service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:06:02.027570 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6202c5cc-fdf0-4589-b5dc-437abb8fc0b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:06:02.028050 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6202c5cc-fdf0-4589-b5dc-437abb8fc0b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:06:02.030011 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-6202c5cc-fdf0-4589-b5dc-437abb8fc0b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:06:02.058072 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6202c5cc-fdf0-4589-b5dc-437abb8fc0b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:06:02.059510 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6202c5cc-fdf0-4589-b5dc-437abb8fc0b6 service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:06:02.071349 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4271/8569] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:06:02 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:06:02.711843 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce028e40-f805-4ba1-87a8-15e06cea61f8 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:06:02.715258 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-ce028e40-f805-4ba1-87a8-15e06cea61f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:06:02.819848 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce028e40-f805-4ba1-87a8-15e06cea61f8 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:06:02.825830 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6b6235-f09c-46f6-ac80-49c554fb8ab2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:06:02.826639 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6b6235-f09c-46f6-ac80-49c554fb8ab2 service nova] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:06:02.826943 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6b6235-f09c-46f6-ac80-49c554fb8ab2 service nova] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:06:02.827218 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6b6235-f09c-46f6-ac80-49c554fb8ab2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:06:02.829141 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-aa6b6235-f09c-46f6-ac80-49c554fb8ab2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:06:02.846194 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6b6235-f09c-46f6-ac80-49c554fb8ab2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:06:02.847820 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6b6235-f09c-46f6-ac80-49c554fb8ab2 service nova] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:06:02.863293 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4299/8570] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:06:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:06:05.658563 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6202c5cc-fdf0-4589-b5dc-437abb8fc0b6 service neutron] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:06:05.667674 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6202c5cc-fdf0-4589-b5dc-437abb8fc0b6 service neutron] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:06:05.672152 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d53edd-c92f-4072-80e2-a1943ba95f6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:06:05.672844 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d53edd-c92f-4072-80e2-a1943ba95f6c service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:06:05.673146 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d53edd-c92f-4072-80e2-a1943ba95f6c service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:06:05.673419 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d53edd-c92f-4072-80e2-a1943ba95f6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:06:05.675389 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-d7d53edd-c92f-4072-80e2-a1943ba95f6c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:06:05.712549 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d53edd-c92f-4072-80e2-a1943ba95f6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:06:05.714415 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d53edd-c92f-4072-80e2-a1943ba95f6c service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:06:05.728720 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4272/8571] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:06:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 23 22:06:12.857073 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=41 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:06:15.721033 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=25 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:06:40.931792 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6b6235-f09c-46f6-ac80-49c554fb8ab2 service nova] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:06:40.950416 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6b6235-f09c-46f6-ac80-49c554fb8ab2 service nova] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:06:40.957512 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a25d286-9dba-497f-99ff-9eb019435fe7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc719a3b3ac4461b82ca04ab6451d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:06:40.958528 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a25d286-9dba-497f-99ff-9eb019435fe7 service placement] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:06:40.959122 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a25d286-9dba-497f-99ff-9eb019435fe7 service placement] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:06:40.959663 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a25d286-9dba-497f-99ff-9eb019435fe7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:06:40.961768 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-8a25d286-9dba-497f-99ff-9eb019435fe7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:06:40.980005 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a25d286-9dba-497f-99ff-9eb019435fe7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:06:40.987311 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a25d286-9dba-497f-99ff-9eb019435fe7 service placement] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:06:41.010034 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4300/8572] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:06:40 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:06:44.160169 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d53edd-c92f-4072-80e2-a1943ba95f6c service neutron] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:06:44.175035 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d53edd-c92f-4072-80e2-a1943ba95f6c service neutron] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:06:44.181638 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527779ed-59cf-460b-92a5-2e0f952f1d54 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc719a3b3ac4461b82ca04ab6451d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:06:44.182323 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527779ed-59cf-460b-92a5-2e0f952f1d54 service placement] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:06:44.182606 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527779ed-59cf-460b-92a5-2e0f952f1d54 service placement] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:06:44.182849 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527779ed-59cf-460b-92a5-2e0f952f1d54 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:06:44.185051 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-527779ed-59cf-460b-92a5-2e0f952f1d54 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:06:44.200321 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527779ed-59cf-460b-92a5-2e0f952f1d54 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:06:44.201881 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527779ed-59cf-460b-92a5-2e0f952f1d54 service placement] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:06:44.215516 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4273/8573] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:06:44 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:06:51.003940 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=6 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:06:54.193221 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9898973e-5ec1-4438-b66f-32c9c95145df None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:06:54.193930 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9898973e-5ec1-4438-b66f-32c9c95145df None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:06:54.193930 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9898973e-5ec1-4438-b66f-32c9c95145df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:06:54.207958 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=6 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:06:54.214380 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-9898973e-5ec1-4438-b66f-32c9c95145df None None] MFA Rules not processed for user `5ce861b0f93142849eb235b3df8b9aa0`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:06:54.215533 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-9898973e-5ec1-4438-b66f-32c9c95145df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:06:54.222931 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4301/8574] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:06:54 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:06:54.545991 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527779ed-59cf-460b-92a5-2e0f952f1d54 service placement] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:06:54.555835 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527779ed-59cf-460b-92a5-2e0f952f1d54 service placement] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:06:54.559864 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c08e1c-ce6a-44b9-a031-91389856e43e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:06:54.560540 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c08e1c-ce6a-44b9-a031-91389856e43e service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:06:54.560821 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c08e1c-ce6a-44b9-a031-91389856e43e service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:06:54.561098 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c08e1c-ce6a-44b9-a031-91389856e43e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:06:54.562928 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-d5c08e1c-ce6a-44b9-a031-91389856e43e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:06:54.575457 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c08e1c-ce6a-44b9-a031-91389856e43e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:06:54.576913 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c08e1c-ce6a-44b9-a031-91389856e43e service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:06:54.588382 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4274/8575] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:06:54 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:07:04.172645 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9898973e-5ec1-4438-b66f-32c9c95145df None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:07:04.189435 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9898973e-5ec1-4438-b66f-32c9c95145df None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:07:04.195339 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8af760-1dfd-481d-a7ba-aeb724c314c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:07:04.196000 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8af760-1dfd-481d-a7ba-aeb724c314c4 service nova] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:07:04.196280 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8af760-1dfd-481d-a7ba-aeb724c314c4 service nova] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:07:04.196559 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8af760-1dfd-481d-a7ba-aeb724c314c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:07:04.198513 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-4f8af760-1dfd-481d-a7ba-aeb724c314c4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:07:04.214770 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8af760-1dfd-481d-a7ba-aeb724c314c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:07:04.216350 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8af760-1dfd-481d-a7ba-aeb724c314c4 service nova] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:07:04.230723 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4302/8576] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:07:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:07:04.328752 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c08e1c-ce6a-44b9-a031-91389856e43e service neutron] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:07:04.338514 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c08e1c-ce6a-44b9-a031-91389856e43e service neutron] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:07:04.342453 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058782ed-27c3-4bde-b535-098ab47d7793 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:07:04.343102 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058782ed-27c3-4bde-b535-098ab47d7793 service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:07:04.343379 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058782ed-27c3-4bde-b535-098ab47d7793 service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:07:04.343624 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058782ed-27c3-4bde-b535-098ab47d7793 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:07:04.345546 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-058782ed-27c3-4bde-b535-098ab47d7793 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:07:04.358314 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058782ed-27c3-4bde-b535-098ab47d7793 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:07:04.359765 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058782ed-27c3-4bde-b535-098ab47d7793 service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:07:04.371406 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4275/8577] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:07:04 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:07:08.930026 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8af760-1dfd-481d-a7ba-aeb724c314c4 service nova] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:07:08.944230 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8af760-1dfd-481d-a7ba-aeb724c314c4 service nova] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:07:08.949929 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1d1aaf-ec34-4c8e-8b4c-6b12d07bbd70 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:07:08.950585 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1d1aaf-ec34-4c8e-8b4c-6b12d07bbd70 service nova] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:07:08.950864 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1d1aaf-ec34-4c8e-8b4c-6b12d07bbd70 service nova] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:07:08.951137 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1d1aaf-ec34-4c8e-8b4c-6b12d07bbd70 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:07:08.952967 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-2a1d1aaf-ec34-4c8e-8b4c-6b12d07bbd70 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:07:08.971475 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1d1aaf-ec34-4c8e-8b4c-6b12d07bbd70 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:07:08.973238 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1d1aaf-ec34-4c8e-8b4c-6b12d07bbd70 service nova] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:07:08.988171 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4303/8578] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:07:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:07:11.288916 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058782ed-27c3-4bde-b535-098ab47d7793 service neutron] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:07:11.307497 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058782ed-27c3-4bde-b535-098ab47d7793 service neutron] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:07:11.315642 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c5b5a0-d3ef-492d-b74f-235902eec01e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc719a3b3ac4461b82ca04ab6451d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:07:11.316290 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c5b5a0-d3ef-492d-b74f-235902eec01e service placement] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:07:11.316566 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c5b5a0-d3ef-492d-b74f-235902eec01e service placement] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:07:11.316837 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c5b5a0-d3ef-492d-b74f-235902eec01e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:07:11.318988 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-61c5b5a0-d3ef-492d-b74f-235902eec01e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:07:11.335204 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c5b5a0-d3ef-492d-b74f-235902eec01e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:07:11.336764 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c5b5a0-d3ef-492d-b74f-235902eec01e service placement] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:07:11.349769 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4276/8579] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:07:11 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:07:18.983141 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=15 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:07:21.343186 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=18 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:07:44.414531 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1d1aaf-ec34-4c8e-8b4c-6b12d07bbd70 service nova] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:07:44.429697 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1d1aaf-ec34-4c8e-8b4c-6b12d07bbd70 service nova] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:07:44.435230 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c472edb9-113d-46e9-bda2-9d17b798fc04 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc719a3b3ac4461b82ca04ab6451d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:07:44.436093 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c472edb9-113d-46e9-bda2-9d17b798fc04 service placement] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:07:44.436376 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c472edb9-113d-46e9-bda2-9d17b798fc04 service placement] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:07:44.436651 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c472edb9-113d-46e9-bda2-9d17b798fc04 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:07:44.438791 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-c472edb9-113d-46e9-bda2-9d17b798fc04 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:07:44.454527 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c472edb9-113d-46e9-bda2-9d17b798fc04 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:07:44.456047 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c472edb9-113d-46e9-bda2-9d17b798fc04 service placement] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:07:44.471789 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4304/8580] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:07:44 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:07:44.499508 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c5b5a0-d3ef-492d-b74f-235902eec01e service placement] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:07:44.577538 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c5b5a0-d3ef-492d-b74f-235902eec01e service placement] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:07:44.582666 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf52b118-13e4-4047-83ae-8b4272ded6b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:07:44.583559 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf52b118-13e4-4047-83ae-8b4272ded6b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:07:44.583835 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf52b118-13e4-4047-83ae-8b4272ded6b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:07:44.584113 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf52b118-13e4-4047-83ae-8b4272ded6b3 admin admin] PATH_INFO: `/v3/users/5ce861b0f93142849eb235b3df8b9aa0` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:07:44.585582 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf52b118-13e4-4047-83ae-8b4272ded6b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ce861b0f93142849eb235b3df8b9aa0)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:07:44.588003 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf52b118-13e4-4047-83ae-8b4272ded6b3 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:07:44.643645 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-cf52b118-13e4-4047-83ae-8b4272ded6b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ce861b0f93142849eb235b3df8b9aa0'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:07:44.650784 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-cf52b118-13e4-4047-83ae-8b4272ded6b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ce861b0f93142849eb235b3df8b9aa0'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:07:44.651467 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-cf52b118-13e4-4047-83ae-8b4272ded6b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ce861b0f93142849eb235b3df8b9aa0'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:07:44.660062 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-cf52b118-13e4-4047-83ae-8b4272ded6b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ce861b0f93142849eb235b3df8b9aa0'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:07:44.673066 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-cf52b118-13e4-4047-83ae-8b4272ded6b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ce861b0f93142849eb235b3df8b9aa0'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:07:44.679705 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4277/8581] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 22:07:44 2022] DELETE /identity/v3/users/5ce861b0f93142849eb235b3df8b9aa0 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:07:44.684769 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5cf8c5-714f-44c7-8ba2-3a96fd1e0d90 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:07:44.685077 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5cf8c5-714f-44c7-8ba2-3a96fd1e0d90 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:07:44.685390 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5cf8c5-714f-44c7-8ba2-3a96fd1e0d90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:07:44.726529 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-fb5cf8c5-714f-44c7-8ba2-3a96fd1e0d90 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:07:44.727936 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-fb5cf8c5-714f-44c7-8ba2-3a96fd1e0d90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:07:44.789490 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4305/8582] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:07:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 22:07:44.799604 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf52b118-13e4-4047-83ae-8b4272ded6b3 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:07:44.801098 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-cf52b118-13e4-4047-83ae-8b4272ded6b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:07:44.877645 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf52b118-13e4-4047-83ae-8b4272ded6b3 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:07:44.881494 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4fc44d-23c8-4f73-8b62-261e1304597e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:07:44.882225 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4fc44d-23c8-4f73-8b62-261e1304597e service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:07:44.882503 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4fc44d-23c8-4f73-8b62-261e1304597e service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:07:44.882773 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4fc44d-23c8-4f73-8b62-261e1304597e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:07:44.891975 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4fc44d-23c8-4f73-8b62-261e1304597e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:07:44.893456 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4fc44d-23c8-4f73-8b62-261e1304597e service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:07:44.903054 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4278/8583] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:07:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:07:45.076957 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5cf8c5-714f-44c7-8ba2-3a96fd1e0d90 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:07:45.078467 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-fb5cf8c5-714f-44c7-8ba2-3a96fd1e0d90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:07:45.093516 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5cf8c5-714f-44c7-8ba2-3a96fd1e0d90 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:07:45.099628 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c680d9f6-8d77-4734-97a1-47d7c7e9c4c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:07:45.100597 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c680d9f6-8d77-4734-97a1-47d7c7e9c4c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:07:45.100943 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c680d9f6-8d77-4734-97a1-47d7c7e9c4c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:07:45.101346 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c680d9f6-8d77-4734-97a1-47d7c7e9c4c4 admin admin] PATH_INFO: `/v3/projects/1d1919be84b04d4c9306ef33015632a0` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:07:45.103064 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c680d9f6-8d77-4734-97a1-47d7c7e9c4c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d1919be84b04d4c9306ef33015632a0)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:07:45.105537 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c680d9f6-8d77-4734-97a1-47d7c7e9c4c4 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:07:45.154091 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c680d9f6-8d77-4734-97a1-47d7c7e9c4c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d1919be84b04d4c9306ef33015632a0', 'request_id': 'req-c680d9f6-8d77-4734-97a1-47d7c7e9c4c4'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:07:45.162201 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c680d9f6-8d77-4734-97a1-47d7c7e9c4c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d1919be84b04d4c9306ef33015632a0', 'request_id': 'req-c680d9f6-8d77-4734-97a1-47d7c7e9c4c4'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:07:45.168014 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c680d9f6-8d77-4734-97a1-47d7c7e9c4c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d1919be84b04d4c9306ef33015632a0', 'request_id': 'req-c680d9f6-8d77-4734-97a1-47d7c7e9c4c4'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:07:45.179256 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c680d9f6-8d77-4734-97a1-47d7c7e9c4c4 admin admin] The token cache is being invalidate because project 1d1919be84b04d4c9306ef33015632a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 22:07:45.179539 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c680d9f6-8d77-4734-97a1-47d7c7e9c4c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:07:45.180251 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c680d9f6-8d77-4734-97a1-47d7c7e9c4c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:07:45.182000 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4306/8584] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 22:07:45 2022] DELETE /identity/v3/projects/1d1919be84b04d4c9306ef33015632a0 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 22:07:45.186243 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4fc44d-23c8-4f73-8b62-261e1304597e service neutron] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:07:45.196180 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4fc44d-23c8-4f73-8b62-261e1304597e service neutron] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:07:45.205189 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:07:45.254930 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caddfa4-52ef-41d2-852d-bc03ddf28f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:07:45.255733 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caddfa4-52ef-41d2-852d-bc03ddf28f1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:07:45.256007 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caddfa4-52ef-41d2-852d-bc03ddf28f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:07:45.256271 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caddfa4-52ef-41d2-852d-bc03ddf28f1f admin admin] PATH_INFO: `/v3/users/ac472f308fa14b3b8cd2ead16a315804` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:07:45.257491 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caddfa4-52ef-41d2-852d-bc03ddf28f1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac472f308fa14b3b8cd2ead16a315804)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:07:45.259472 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caddfa4-52ef-41d2-852d-bc03ddf28f1f admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:07:45.306806 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-4caddfa4-52ef-41d2-852d-bc03ddf28f1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac472f308fa14b3b8cd2ead16a315804'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:07:45.313790 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-4caddfa4-52ef-41d2-852d-bc03ddf28f1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac472f308fa14b3b8cd2ead16a315804'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:07:45.314461 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-4caddfa4-52ef-41d2-852d-bc03ddf28f1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac472f308fa14b3b8cd2ead16a315804'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:07:45.322943 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-4caddfa4-52ef-41d2-852d-bc03ddf28f1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac472f308fa14b3b8cd2ead16a315804'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:07:45.334658 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-4caddfa4-52ef-41d2-852d-bc03ddf28f1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac472f308fa14b3b8cd2ead16a315804'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:07:45.341039 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4279/8585] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 22:07:45 2022] DELETE /identity/v3/users/ac472f308fa14b3b8cd2ead16a315804 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 22:07:45.632613 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c680d9f6-8d77-4734-97a1-47d7c7e9c4c4 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:07:45.634192 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-c680d9f6-8d77-4734-97a1-47d7c7e9c4c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:07:45.648332 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c680d9f6-8d77-4734-97a1-47d7c7e9c4c4 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:07:45.698977 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:07:45.710290 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c959ec23-adf3-47c2-abb4-0918293c18bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:07:45.711230 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c959ec23-adf3-47c2-abb4-0918293c18bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:07:45.711472 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c959ec23-adf3-47c2-abb4-0918293c18bd admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:07:45.712118 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c959ec23-adf3-47c2-abb4-0918293c18bd admin admin] PATH_INFO: `/v3/projects/d63eff7074af425ca8edb07016cb8100` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:07:45.713539 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c959ec23-adf3-47c2-abb4-0918293c18bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=d63eff7074af425ca8edb07016cb8100)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:07:45.715765 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c959ec23-adf3-47c2-abb4-0918293c18bd admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:07:45.764564 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c959ec23-adf3-47c2-abb4-0918293c18bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd63eff7074af425ca8edb07016cb8100', 'request_id': 'req-c959ec23-adf3-47c2-abb4-0918293c18bd'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:07:45.773293 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c959ec23-adf3-47c2-abb4-0918293c18bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd63eff7074af425ca8edb07016cb8100', 'request_id': 'req-c959ec23-adf3-47c2-abb4-0918293c18bd'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:07:45.779514 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c959ec23-adf3-47c2-abb4-0918293c18bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd63eff7074af425ca8edb07016cb8100', 'request_id': 'req-c959ec23-adf3-47c2-abb4-0918293c18bd'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:07:45.792191 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c959ec23-adf3-47c2-abb4-0918293c18bd admin admin] The token cache is being invalidate because project d63eff7074af425ca8edb07016cb8100 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 22:07:45.792485 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c959ec23-adf3-47c2-abb4-0918293c18bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:07:45.793143 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-c959ec23-adf3-47c2-abb4-0918293c18bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:07:45.798051 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4307/8586] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 22:07:45 2022] DELETE /identity/v3/projects/d63eff7074af425ca8edb07016cb8100 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:07:45.800260 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9fa974-98fe-46f2-af71-402f16ce0cf3 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:07:45.800732 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9fa974-98fe-46f2-af71-402f16ce0cf3 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:07:45.800732 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9fa974-98fe-46f2-af71-402f16ce0cf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:07:45.852565 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-1b9fa974-98fe-46f2-af71-402f16ce0cf3 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:07:45.853767 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-1b9fa974-98fe-46f2-af71-402f16ce0cf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:07:45.912997 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4280/8587] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:07:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:07:45.921463 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30df41af-afc4-4860-a40b-23e356a92ac2 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:07:45.921820 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30df41af-afc4-4860-a40b-23e356a92ac2 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:07:45.922196 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30df41af-afc4-4860-a40b-23e356a92ac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:07:45.941898 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-30df41af-afc4-4860-a40b-23e356a92ac2 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:07:45.943168 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-30df41af-afc4-4860-a40b-23e356a92ac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:07:45.951439 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4308/8588] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:07:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:07:45.955758 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9fa974-98fe-46f2-af71-402f16ce0cf3 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:07:45.966661 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9fa974-98fe-46f2-af71-402f16ce0cf3 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:07:45.971951 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472b17f6-6a77-4ecd-9cc2-60795ec733d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:07:45.972610 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472b17f6-6a77-4ecd-9cc2-60795ec733d7 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:07:45.972893 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472b17f6-6a77-4ecd-9cc2-60795ec733d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:07:45.973166 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472b17f6-6a77-4ecd-9cc2-60795ec733d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:07:45.973926 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472b17f6-6a77-4ecd-9cc2-60795ec733d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 22:07:45.974233 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472b17f6-6a77-4ecd-9cc2-60795ec733d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:07:45.975847 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472b17f6-6a77-4ecd-9cc2-60795ec733d7 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:07:45.978304 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:07:45.989355 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4281/8589] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 22:07:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 22:07:45.993706 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30df41af-afc4-4860-a40b-23e356a92ac2 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:07:46.003418 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30df41af-afc4-4860-a40b-23e356a92ac2 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:07:46.008382 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4e5a88-d902-48ca-bb81-2797d8f6fbc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:07:46.009017 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4e5a88-d902-48ca-bb81-2797d8f6fbc4 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:07:46.009316 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4e5a88-d902-48ca-bb81-2797d8f6fbc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:07:46.009545 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4e5a88-d902-48ca-bb81-2797d8f6fbc4 admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:07:46.010267 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4e5a88-d902-48ca-bb81-2797d8f6fbc4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:07:46.012190 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4e5a88-d902-48ca-bb81-2797d8f6fbc4 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:07:46.051125 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4309/8590] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 22:07:45 2022] POST /identity/v3/projects => generated 379 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 22:07:46.055357 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472b17f6-6a77-4ecd-9cc2-60795ec733d7 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:07:46.066170 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472b17f6-6a77-4ecd-9cc2-60795ec733d7 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:07:46.126285 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecfcd05-d8ad-4f36-9b53-32898623aefb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:07:46.126984 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecfcd05-d8ad-4f36-9b53-32898623aefb admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:07:46.127266 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecfcd05-d8ad-4f36-9b53-32898623aefb admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:07:46.127539 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecfcd05-d8ad-4f36-9b53-32898623aefb admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:07:46.128244 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecfcd05-d8ad-4f36-9b53-32898623aefb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:07:46.130272 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecfcd05-d8ad-4f36-9b53-32898623aefb admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:07:46.155144 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4282/8591] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 22:07:46 2022] POST /identity/v3/users => generated 290 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 22:07:46.156662 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4e5a88-d902-48ca-bb81-2797d8f6fbc4 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:07:46.167562 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4e5a88-d902-48ca-bb81-2797d8f6fbc4 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:07:46.173513 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fca8a68-3971-4eb0-9477-9091ddc6885b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:07:46.174308 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fca8a68-3971-4eb0-9477-9091ddc6885b admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:07:46.174600 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fca8a68-3971-4eb0-9477-9091ddc6885b admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:07:46.174880 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fca8a68-3971-4eb0-9477-9091ddc6885b admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:07:46.175605 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fca8a68-3971-4eb0-9477-9091ddc6885b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:07:46.177225 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fca8a68-3971-4eb0-9477-9091ddc6885b admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:07:46.188802 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4310/8592] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 22:07:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 22:07:46.192800 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecfcd05-d8ad-4f36-9b53-32898623aefb admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:07:46.203220 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecfcd05-d8ad-4f36-9b53-32898623aefb admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:07:46.209004 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5ee15e-ae98-406f-9a0a-2842612f567e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:07:46.209692 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5ee15e-ae98-406f-9a0a-2842612f567e admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:07:46.209998 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5ee15e-ae98-406f-9a0a-2842612f567e admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:07:46.210270 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5ee15e-ae98-406f-9a0a-2842612f567e admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:07:46.211021 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5ee15e-ae98-406f-9a0a-2842612f567e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:07:46.213030 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5ee15e-ae98-406f-9a0a-2842612f567e admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:07:46.223625 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4283/8593] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 22:07:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 22:07:46.227844 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fca8a68-3971-4eb0-9477-9091ddc6885b admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:07:46.238457 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fca8a68-3971-4eb0-9477-9091ddc6885b admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:07:46.244392 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd09f5dc-d97f-40f9-b997-581dca656adc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:07:46.245285 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd09f5dc-d97f-40f9-b997-581dca656adc admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:07:46.245556 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd09f5dc-d97f-40f9-b997-581dca656adc admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:07:46.245855 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd09f5dc-d97f-40f9-b997-581dca656adc admin admin] PATH_INFO: `/v3/projects/960e6d7d52ec40ca82fefcfad3075776/users/c39ae90b08e14ad8a0e66643f63013b4/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:07:46.261973 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd09f5dc-d97f-40f9-b997-581dca656adc admin admin] RBAC: Authorizing `identity:create_grant(project_id=960e6d7d52ec40ca82fefcfad3075776, user_id=c39ae90b08e14ad8a0e66643f63013b4, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:07:46.264696 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd09f5dc-d97f-40f9-b997-581dca656adc admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:07:46.279912 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4311/8594] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 22:07:46 2022] PUT /identity/v3/projects/960e6d7d52ec40ca82fefcfad3075776/users/c39ae90b08e14ad8a0e66643f63013b4/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:07:46.285370 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72b943e-b72c-427a-8517-8bfdac840d79 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:07:46.285657 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72b943e-b72c-427a-8517-8bfdac840d79 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:07:46.285965 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72b943e-b72c-427a-8517-8bfdac840d79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:07:46.304538 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-d72b943e-b72c-427a-8517-8bfdac840d79 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:07:46.305701 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-d72b943e-b72c-427a-8517-8bfdac840d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:07:46.368599 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4284/8595] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:07:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 22:07:46.378634 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd09f5dc-d97f-40f9-b997-581dca656adc admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:07:46.380485 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-bd09f5dc-d97f-40f9-b997-581dca656adc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:07:46.438436 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd09f5dc-d97f-40f9-b997-581dca656adc admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:07:46.442843 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabdac74-4cbd-49d0-b986-bbff1354abb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:07:46.443488 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabdac74-4cbd-49d0-b986-bbff1354abb3 service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:07:46.443768 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabdac74-4cbd-49d0-b986-bbff1354abb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:07:46.444043 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabdac74-4cbd-49d0-b986-bbff1354abb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:07:46.453819 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabdac74-4cbd-49d0-b986-bbff1354abb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:07:46.455285 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabdac74-4cbd-49d0-b986-bbff1354abb3 service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:07:46.465541 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4312/8596] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:07:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:07:47.250619 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac16f47a-414b-499f-8e40-9cb5a28325c5 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:07:47.251270 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac16f47a-414b-499f-8e40-9cb5a28325c5 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:07:47.251270 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac16f47a-414b-499f-8e40-9cb5a28325c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:07:47.280152 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-ac16f47a-414b-499f-8e40-9cb5a28325c5 None None] MFA Rules not processed for user `c39ae90b08e14ad8a0e66643f63013b4`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:07:47.281473 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-ac16f47a-414b-499f-8e40-9cb5a28325c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:07:47.353990 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4285/8597] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:07:47 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:07:47.358902 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabdac74-4cbd-49d0-b986-bbff1354abb3 service neutron] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:07:47.369685 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabdac74-4cbd-49d0-b986-bbff1354abb3 service neutron] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:07:47.375925 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d954cb1b-8324-4c6d-a25b-fc62b38cbbf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:07:47.376580 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d954cb1b-8324-4c6d-a25b-fc62b38cbbf2 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:07:47.376854 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d954cb1b-8324-4c6d-a25b-fc62b38cbbf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:07:47.377121 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d954cb1b-8324-4c6d-a25b-fc62b38cbbf2 admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:07:47.377811 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d954cb1b-8324-4c6d-a25b-fc62b38cbbf2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:07:47.379746 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d954cb1b-8324-4c6d-a25b-fc62b38cbbf2 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:07:47.390340 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:07:47.410138 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4313/8598] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 22:07:47 2022] POST /identity/v3/projects => generated 377 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 22:07:47.414275 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac16f47a-414b-499f-8e40-9cb5a28325c5 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:07:47.421198 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:07:47.426029 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac16f47a-414b-499f-8e40-9cb5a28325c5 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:07:47.486138 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33767f58-e897-447a-bb0b-1832fa48d6f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:07:47.486796 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33767f58-e897-447a-bb0b-1832fa48d6f7 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:07:47.487078 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33767f58-e897-447a-bb0b-1832fa48d6f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:07:47.487353 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33767f58-e897-447a-bb0b-1832fa48d6f7 admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:07:47.488047 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33767f58-e897-447a-bb0b-1832fa48d6f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:07:47.490013 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33767f58-e897-447a-bb0b-1832fa48d6f7 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:07:47.514699 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4286/8599] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 22:07:47 2022] POST /identity/v3/users => generated 295 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 22:07:47.515980 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d954cb1b-8324-4c6d-a25b-fc62b38cbbf2 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:07:47.526739 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d954cb1b-8324-4c6d-a25b-fc62b38cbbf2 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:07:47.531879 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b47077-aef4-4eec-8c11-993201c351f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:07:47.532601 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b47077-aef4-4eec-8c11-993201c351f4 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:07:47.532883 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b47077-aef4-4eec-8c11-993201c351f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:07:47.533158 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b47077-aef4-4eec-8c11-993201c351f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:07:47.533900 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b47077-aef4-4eec-8c11-993201c351f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:07:47.535507 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b47077-aef4-4eec-8c11-993201c351f4 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:07:47.546362 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4314/8600] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 22:07:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 22:07:47.550589 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33767f58-e897-447a-bb0b-1832fa48d6f7 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:07:47.561146 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33767f58-e897-447a-bb0b-1832fa48d6f7 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:07:47.566994 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4059a0a7-4323-4ed2-9b3b-ae19cb5a88be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:07:47.568367 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4059a0a7-4323-4ed2-9b3b-ae19cb5a88be admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:07:47.568648 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4059a0a7-4323-4ed2-9b3b-ae19cb5a88be admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:07:47.568923 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4059a0a7-4323-4ed2-9b3b-ae19cb5a88be admin admin] PATH_INFO: `/v3/projects/f80aabf2a59447da992bf602a81e30a8/users/8655f2a05aab49eab8227ed4fdfbd4ed/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:07:47.584575 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4059a0a7-4323-4ed2-9b3b-ae19cb5a88be admin admin] RBAC: Authorizing `identity:create_grant(project_id=f80aabf2a59447da992bf602a81e30a8, user_id=8655f2a05aab49eab8227ed4fdfbd4ed, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:07:47.587699 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4059a0a7-4323-4ed2-9b3b-ae19cb5a88be admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:07:47.603605 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4287/8601] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 22:07:47 2022] PUT /identity/v3/projects/f80aabf2a59447da992bf602a81e30a8/users/8655f2a05aab49eab8227ed4fdfbd4ed/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 22:07:47.607769 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b47077-aef4-4eec-8c11-993201c351f4 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:07:47.618134 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b47077-aef4-4eec-8c11-993201c351f4 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:07:47.678352 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bf7764-a61a-4d83-9774-af105671d43d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:07:47.679031 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bf7764-a61a-4d83-9774-af105671d43d admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:07:47.679310 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bf7764-a61a-4d83-9774-af105671d43d admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:07:47.679582 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bf7764-a61a-4d83-9774-af105671d43d admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:07:47.680308 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bf7764-a61a-4d83-9774-af105671d43d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:07:47.682109 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bf7764-a61a-4d83-9774-af105671d43d admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:07:47.692815 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4315/8602] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 22:07:47 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 22:07:47.697171 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4059a0a7-4323-4ed2-9b3b-ae19cb5a88be admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:07:47.708374 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4059a0a7-4323-4ed2-9b3b-ae19cb5a88be admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:07:47.714553 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bc8c74-dbab-4142-b356-4cfac4886e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:07:47.715463 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bc8c74-dbab-4142-b356-4cfac4886e30 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:07:47.715735 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bc8c74-dbab-4142-b356-4cfac4886e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:07:47.716003 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bc8c74-dbab-4142-b356-4cfac4886e30 admin admin] PATH_INFO: `/v3/projects/f80aabf2a59447da992bf602a81e30a8/users/8655f2a05aab49eab8227ed4fdfbd4ed/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:07:47.718431 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bc8c74-dbab-4142-b356-4cfac4886e30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f80aabf2a59447da992bf602a81e30a8, user_id=8655f2a05aab49eab8227ed4fdfbd4ed, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:07:47.721225 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bc8c74-dbab-4142-b356-4cfac4886e30 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:07:47.732792 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4288/8603] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 22:07:47 2022] PUT /identity/v3/projects/f80aabf2a59447da992bf602a81e30a8/users/8655f2a05aab49eab8227ed4fdfbd4ed/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:07:48.381154 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fded60d9-86be-4fd7-8534-4dc388c9272b None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:07:48.381715 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fded60d9-86be-4fd7-8534-4dc388c9272b None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:07:48.381884 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fded60d9-86be-4fd7-8534-4dc388c9272b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:07:48.409921 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-fded60d9-86be-4fd7-8534-4dc388c9272b None None] MFA Rules not processed for user `8655f2a05aab49eab8227ed4fdfbd4ed`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:07:48.411282 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-fded60d9-86be-4fd7-8534-4dc388c9272b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:07:48.484059 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4316/8604] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:07:48 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:07:48.495167 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade8d8a2-51e3-4376-8777-810320574123 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:07:48.495722 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade8d8a2-51e3-4376-8777-810320574123 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:07:48.495722 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade8d8a2-51e3-4376-8777-810320574123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:07:48.513831 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-ade8d8a2-51e3-4376-8777-810320574123 None None] MFA Rules not processed for user `c39ae90b08e14ad8a0e66643f63013b4`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:07:48.515077 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-ade8d8a2-51e3-4376-8777-810320574123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:07:48.572567 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4289/8605] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:07:48 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:07:48.587140 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fded60d9-86be-4fd7-8534-4dc388c9272b None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:07:48.588558 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-fded60d9-86be-4fd7-8534-4dc388c9272b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:07:48.654108 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:07:48.677681 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fded60d9-86be-4fd7-8534-4dc388c9272b None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:07:48.687188 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221a8108-5ea5-4ad8-80a1-832c6637930f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:07:48.687859 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221a8108-5ea5-4ad8-80a1-832c6637930f service nova] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:07:48.688137 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221a8108-5ea5-4ad8-80a1-832c6637930f service nova] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:07:48.688409 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221a8108-5ea5-4ad8-80a1-832c6637930f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:07:48.697557 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221a8108-5ea5-4ad8-80a1-832c6637930f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:07:48.699200 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221a8108-5ea5-4ad8-80a1-832c6637930f service nova] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:07:48.708824 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4317/8606] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:07:48 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:07:49.306872 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade8d8a2-51e3-4376-8777-810320574123 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:07:49.308416 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-ade8d8a2-51e3-4376-8777-810320574123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:07:49.376846 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:07:49.384855 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade8d8a2-51e3-4376-8777-810320574123 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:07:49.390172 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202cf50c-6e1b-4c0c-b832-be4702cd7d72 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc719a3b3ac4461b82ca04ab6451d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:07:49.390838 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202cf50c-6e1b-4c0c-b832-be4702cd7d72 service placement] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:07:49.391114 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202cf50c-6e1b-4c0c-b832-be4702cd7d72 service placement] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:07:49.391386 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202cf50c-6e1b-4c0c-b832-be4702cd7d72 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:07:49.393153 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-202cf50c-6e1b-4c0c-b832-be4702cd7d72 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:07:49.404745 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202cf50c-6e1b-4c0c-b832-be4702cd7d72 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:07:49.406362 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202cf50c-6e1b-4c0c-b832-be4702cd7d72 service placement] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:07:49.416343 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4290/8607] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:07:49 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:07:58.704235 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=6 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:07:59.412376 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=4 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:08:10.602998 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221a8108-5ea5-4ad8-80a1-832c6637930f service nova] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:08:10.672564 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221a8108-5ea5-4ad8-80a1-832c6637930f service nova] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:08:10.677557 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4d5215-fc0e-4cb2-bcdc-bd2193178ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:08:10.678481 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4d5215-fc0e-4cb2-bcdc-bd2193178ff1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:08:10.678754 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4d5215-fc0e-4cb2-bcdc-bd2193178ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:08:10.679031 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4d5215-fc0e-4cb2-bcdc-bd2193178ff1 admin admin] PATH_INFO: `/v3/users/c39ae90b08e14ad8a0e66643f63013b4` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:08:10.680958 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4d5215-fc0e-4cb2-bcdc-bd2193178ff1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c39ae90b08e14ad8a0e66643f63013b4)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:08:10.682935 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4d5215-fc0e-4cb2-bcdc-bd2193178ff1 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:08:10.732559 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-8f4d5215-fc0e-4cb2-bcdc-bd2193178ff1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c39ae90b08e14ad8a0e66643f63013b4'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:08:10.733195 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-8f4d5215-fc0e-4cb2-bcdc-bd2193178ff1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c39ae90b08e14ad8a0e66643f63013b4'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:08:10.740614 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-8f4d5215-fc0e-4cb2-bcdc-bd2193178ff1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c39ae90b08e14ad8a0e66643f63013b4'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:08:10.749079 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-8f4d5215-fc0e-4cb2-bcdc-bd2193178ff1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c39ae90b08e14ad8a0e66643f63013b4'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:08:10.761373 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-8f4d5215-fc0e-4cb2-bcdc-bd2193178ff1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c39ae90b08e14ad8a0e66643f63013b4'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:08:10.767306 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4318/8608] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 22:08:10 2022] DELETE /identity/v3/users/c39ae90b08e14ad8a0e66643f63013b4 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:08:10.950912 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202cf50c-6e1b-4c0c-b832-be4702cd7d72 service placement] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:08:10.963340 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202cf50c-6e1b-4c0c-b832-be4702cd7d72 service placement] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:08:11.024456 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f28fc1a-c566-4597-aebd-70ef2ec4ba63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:08:11.025599 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f28fc1a-c566-4597-aebd-70ef2ec4ba63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:08:11.025918 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f28fc1a-c566-4597-aebd-70ef2ec4ba63 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:08:11.026308 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f28fc1a-c566-4597-aebd-70ef2ec4ba63 admin admin] PATH_INFO: `/v3/projects/960e6d7d52ec40ca82fefcfad3075776` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:08:11.027531 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f28fc1a-c566-4597-aebd-70ef2ec4ba63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=960e6d7d52ec40ca82fefcfad3075776)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:08:11.029449 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f28fc1a-c566-4597-aebd-70ef2ec4ba63 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:08:11.076135 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-7f28fc1a-c566-4597-aebd-70ef2ec4ba63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '960e6d7d52ec40ca82fefcfad3075776', 'request_id': 'req-7f28fc1a-c566-4597-aebd-70ef2ec4ba63'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:08:11.084721 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-7f28fc1a-c566-4597-aebd-70ef2ec4ba63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '960e6d7d52ec40ca82fefcfad3075776', 'request_id': 'req-7f28fc1a-c566-4597-aebd-70ef2ec4ba63'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:08:11.090907 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-7f28fc1a-c566-4597-aebd-70ef2ec4ba63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '960e6d7d52ec40ca82fefcfad3075776', 'request_id': 'req-7f28fc1a-c566-4597-aebd-70ef2ec4ba63'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:08:11.102151 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-7f28fc1a-c566-4597-aebd-70ef2ec4ba63 admin admin] The token cache is being invalidate because project 960e6d7d52ec40ca82fefcfad3075776 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 22:08:11.102440 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-7f28fc1a-c566-4597-aebd-70ef2ec4ba63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:08:11.103189 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-7f28fc1a-c566-4597-aebd-70ef2ec4ba63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:08:11.104994 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4291/8609] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 22:08:10 2022] DELETE /identity/v3/projects/960e6d7d52ec40ca82fefcfad3075776 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:08:11.109135 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4d5215-fc0e-4cb2-bcdc-bd2193178ff1 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:08:11.110663 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-8f4d5215-fc0e-4cb2-bcdc-bd2193178ff1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:08:11.124182 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4d5215-fc0e-4cb2-bcdc-bd2193178ff1 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:08:11.179869 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3693470d-f4c4-429e-9e2d-97388ccac990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:08:11.180754 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3693470d-f4c4-429e-9e2d-97388ccac990 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:08:11.181027 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3693470d-f4c4-429e-9e2d-97388ccac990 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:08:11.181277 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3693470d-f4c4-429e-9e2d-97388ccac990 admin admin] PATH_INFO: `/v3/users/8655f2a05aab49eab8227ed4fdfbd4ed` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:08:11.182520 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3693470d-f4c4-429e-9e2d-97388ccac990 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8655f2a05aab49eab8227ed4fdfbd4ed)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:08:11.184427 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3693470d-f4c4-429e-9e2d-97388ccac990 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:08:11.206855 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:08:11.236377 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-3693470d-f4c4-429e-9e2d-97388ccac990 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8655f2a05aab49eab8227ed4fdfbd4ed'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:08:11.237183 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-3693470d-f4c4-429e-9e2d-97388ccac990 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8655f2a05aab49eab8227ed4fdfbd4ed'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:08:11.244448 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-3693470d-f4c4-429e-9e2d-97388ccac990 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8655f2a05aab49eab8227ed4fdfbd4ed'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:08:11.253281 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-3693470d-f4c4-429e-9e2d-97388ccac990 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8655f2a05aab49eab8227ed4fdfbd4ed'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:08:11.265475 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-3693470d-f4c4-429e-9e2d-97388ccac990 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8655f2a05aab49eab8227ed4fdfbd4ed'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:08:11.271442 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4319/8610] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 22:08:11 2022] DELETE /identity/v3/users/8655f2a05aab49eab8227ed4fdfbd4ed => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:08:11.455580 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f28fc1a-c566-4597-aebd-70ef2ec4ba63 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:08:11.457036 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-7f28fc1a-c566-4597-aebd-70ef2ec4ba63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:08:11.470440 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f28fc1a-c566-4597-aebd-70ef2ec4ba63 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:08:11.528497 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea4bea0-e223-4956-bfd3-30d0c3473562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:08:11.529385 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea4bea0-e223-4956-bfd3-30d0c3473562 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:08:11.529664 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea4bea0-e223-4956-bfd3-30d0c3473562 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:08:11.529963 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea4bea0-e223-4956-bfd3-30d0c3473562 admin admin] PATH_INFO: `/v3/projects/f80aabf2a59447da992bf602a81e30a8` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:08:11.531143 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea4bea0-e223-4956-bfd3-30d0c3473562 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f80aabf2a59447da992bf602a81e30a8)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:08:11.533097 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea4bea0-e223-4956-bfd3-30d0c3473562 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:08:11.570198 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:08:11.583783 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-8ea4bea0-e223-4956-bfd3-30d0c3473562 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f80aabf2a59447da992bf602a81e30a8', 'request_id': 'req-8ea4bea0-e223-4956-bfd3-30d0c3473562'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:08:11.591666 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-8ea4bea0-e223-4956-bfd3-30d0c3473562 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f80aabf2a59447da992bf602a81e30a8', 'request_id': 'req-8ea4bea0-e223-4956-bfd3-30d0c3473562'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:08:11.597333 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-8ea4bea0-e223-4956-bfd3-30d0c3473562 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f80aabf2a59447da992bf602a81e30a8', 'request_id': 'req-8ea4bea0-e223-4956-bfd3-30d0c3473562'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:08:11.608472 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-8ea4bea0-e223-4956-bfd3-30d0c3473562 admin admin] The token cache is being invalidate because project f80aabf2a59447da992bf602a81e30a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 22:08:11.608754 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-8ea4bea0-e223-4956-bfd3-30d0c3473562 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:08:11.609418 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-8ea4bea0-e223-4956-bfd3-30d0c3473562 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:08:11.611035 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4292/8611] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 22:08:11 2022] DELETE /identity/v3/projects/f80aabf2a59447da992bf602a81e30a8 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:08:11.616538 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6535172b-fba6-42a8-9f6c-70cda947666f None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:08:11.617043 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6535172b-fba6-42a8-9f6c-70cda947666f None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:08:11.617169 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6535172b-fba6-42a8-9f6c-70cda947666f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:08:11.635243 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-6535172b-fba6-42a8-9f6c-70cda947666f None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:08:11.636357 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-6535172b-fba6-42a8-9f6c-70cda947666f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:08:11.698426 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4320/8612] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:08:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 22:08:11.706219 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a19f91-b219-472b-a39d-d19b5ea06c1b None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:08:11.706503 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a19f91-b219-472b-a39d-d19b5ea06c1b None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:08:11.706778 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a19f91-b219-472b-a39d-d19b5ea06c1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:08:11.726324 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-b7a19f91-b219-472b-a39d-d19b5ea06c1b None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:08:11.727548 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-b7a19f91-b219-472b-a39d-d19b5ea06c1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:08:11.736617 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4293/8613] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:08:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:08:11.740738 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6535172b-fba6-42a8-9f6c-70cda947666f None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:08:11.751006 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6535172b-fba6-42a8-9f6c-70cda947666f None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:08:11.755780 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2c568c-e7ea-4177-a1b9-b82994803c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:08:11.756432 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2c568c-e7ea-4177-a1b9-b82994803c3c admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:08:11.756707 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2c568c-e7ea-4177-a1b9-b82994803c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:08:11.756979 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2c568c-e7ea-4177-a1b9-b82994803c3c admin admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:08:11.757737 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2c568c-e7ea-4177-a1b9-b82994803c3c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 22:08:11.758069 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2c568c-e7ea-4177-a1b9-b82994803c3c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:08:11.759710 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2c568c-e7ea-4177-a1b9-b82994803c3c admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:08:11.771675 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4321/8614] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 22:08:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 22:08:11.776112 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a19f91-b219-472b-a39d-d19b5ea06c1b None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:08:11.785743 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a19f91-b219-472b-a39d-d19b5ea06c1b None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:08:11.791559 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1094092-d3b5-40b5-b4b0-6aa684c5de0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:08:11.792218 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1094092-d3b5-40b5-b4b0-6aa684c5de0f admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:08:11.792493 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1094092-d3b5-40b5-b4b0-6aa684c5de0f admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:08:11.792768 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1094092-d3b5-40b5-b4b0-6aa684c5de0f admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:08:11.793531 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1094092-d3b5-40b5-b4b0-6aa684c5de0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:08:11.795471 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1094092-d3b5-40b5-b4b0-6aa684c5de0f admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:08:11.824649 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4294/8615] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 22:08:11 2022] POST /identity/v3/projects => generated 379 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 22:08:11.829006 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2c568c-e7ea-4177-a1b9-b82994803c3c admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:08:11.840125 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2c568c-e7ea-4177-a1b9-b82994803c3c admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:08:11.907602 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979813a5-ac53-4b3f-926c-5ec090d7d481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:08:11.908197 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979813a5-ac53-4b3f-926c-5ec090d7d481 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:08:11.908483 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979813a5-ac53-4b3f-926c-5ec090d7d481 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:08:11.908757 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979813a5-ac53-4b3f-926c-5ec090d7d481 admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:08:11.909601 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979813a5-ac53-4b3f-926c-5ec090d7d481 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:08:11.911912 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979813a5-ac53-4b3f-926c-5ec090d7d481 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:08:11.933510 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4322/8616] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 22:08:11 2022] POST /identity/v3/users => generated 290 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 22:08:11.937819 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1094092-d3b5-40b5-b4b0-6aa684c5de0f admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:08:11.948775 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1094092-d3b5-40b5-b4b0-6aa684c5de0f admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:08:11.954290 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384c5077-3c93-49ea-9b73-783602ff6510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:08:11.954931 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384c5077-3c93-49ea-9b73-783602ff6510 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:08:11.955226 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384c5077-3c93-49ea-9b73-783602ff6510 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:08:11.955497 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384c5077-3c93-49ea-9b73-783602ff6510 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:08:11.956210 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384c5077-3c93-49ea-9b73-783602ff6510 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:08:11.957910 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384c5077-3c93-49ea-9b73-783602ff6510 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:08:11.969029 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4295/8617] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 22:08:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 22:08:11.973014 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979813a5-ac53-4b3f-926c-5ec090d7d481 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:08:11.983344 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979813a5-ac53-4b3f-926c-5ec090d7d481 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:08:11.988283 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c27f6f0-fdf0-416a-90d1-696c893b92f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:08:11.988959 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c27f6f0-fdf0-416a-90d1-696c893b92f7 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:08:11.989232 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c27f6f0-fdf0-416a-90d1-696c893b92f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:08:11.989505 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c27f6f0-fdf0-416a-90d1-696c893b92f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:08:11.990337 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c27f6f0-fdf0-416a-90d1-696c893b92f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:08:11.991925 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c27f6f0-fdf0-416a-90d1-696c893b92f7 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:08:12.002656 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4323/8618] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 22:08:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 22:08:12.006973 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384c5077-3c93-49ea-9b73-783602ff6510 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:08:12.017441 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384c5077-3c93-49ea-9b73-783602ff6510 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:08:12.022496 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12aa35c-6717-42e9-851d-09b5b77c8b45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:08:12.023463 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12aa35c-6717-42e9-851d-09b5b77c8b45 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:08:12.023742 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12aa35c-6717-42e9-851d-09b5b77c8b45 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:08:12.024004 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12aa35c-6717-42e9-851d-09b5b77c8b45 admin admin] PATH_INFO: `/v3/projects/2c90e4831ffd42c9b0fc070521d8277e/users/8f94ed62a87a484b989f98f823ecd61f/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:08:12.038873 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12aa35c-6717-42e9-851d-09b5b77c8b45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c90e4831ffd42c9b0fc070521d8277e, user_id=8f94ed62a87a484b989f98f823ecd61f, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:08:12.041532 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12aa35c-6717-42e9-851d-09b5b77c8b45 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:08:12.056236 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4296/8619] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 22:08:12 2022] PUT /identity/v3/projects/2c90e4831ffd42c9b0fc070521d8277e/users/8f94ed62a87a484b989f98f823ecd61f/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:08:12.061438 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49428640-8f12-4962-81bd-df0bb18af1a5 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:08:12.061750 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49428640-8f12-4962-81bd-df0bb18af1a5 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:08:12.062061 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49428640-8f12-4962-81bd-df0bb18af1a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:08:12.069054 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:08:12.080969 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-49428640-8f12-4962-81bd-df0bb18af1a5 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:08:12.082840 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-49428640-8f12-4962-81bd-df0bb18af1a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:08:12.144112 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4324/8620] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:08:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:08:12.154180 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12aa35c-6717-42e9-851d-09b5b77c8b45 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:08:12.156053 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-f12aa35c-6717-42e9-851d-09b5b77c8b45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:08:12.212349 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12aa35c-6717-42e9-851d-09b5b77c8b45 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:08:12.216288 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78daabca-8fb2-48e7-90ad-678f4d21a196 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:08:12.216926 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78daabca-8fb2-48e7-90ad-678f4d21a196 service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:08:12.217201 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78daabca-8fb2-48e7-90ad-678f4d21a196 service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:08:12.217511 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78daabca-8fb2-48e7-90ad-678f4d21a196 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:08:12.227127 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78daabca-8fb2-48e7-90ad-678f4d21a196 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:08:12.228581 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78daabca-8fb2-48e7-90ad-678f4d21a196 service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:08:12.239052 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4297/8621] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:08:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:08:16.319867 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f1d495-7a35-43c9-b049-92b6ce2ce1a5 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:08:16.320335 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f1d495-7a35-43c9-b049-92b6ce2ce1a5 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:08:16.320464 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f1d495-7a35-43c9-b049-92b6ce2ce1a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:08:16.350994 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-24f1d495-7a35-43c9-b049-92b6ce2ce1a5 None None] MFA Rules not processed for user `8f94ed62a87a484b989f98f823ecd61f`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:08:16.352220 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-24f1d495-7a35-43c9-b049-92b6ce2ce1a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:08:16.420778 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4325/8622] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:08:16 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:08:16.425700 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78daabca-8fb2-48e7-90ad-678f4d21a196 service neutron] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:08:16.436224 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78daabca-8fb2-48e7-90ad-678f4d21a196 service neutron] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:08:16.441418 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971c5a9b-0a39-4fca-8c21-ab9dbee1bbc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:08:16.442217 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971c5a9b-0a39-4fca-8c21-ab9dbee1bbc1 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:08:16.442587 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971c5a9b-0a39-4fca-8c21-ab9dbee1bbc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:08:16.443059 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971c5a9b-0a39-4fca-8c21-ab9dbee1bbc1 admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:08:16.443931 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971c5a9b-0a39-4fca-8c21-ab9dbee1bbc1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:08:16.446172 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971c5a9b-0a39-4fca-8c21-ab9dbee1bbc1 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:08:16.498978 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4298/8623] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 22:08:16 2022] POST /identity/v3/projects => generated 379 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 22:08:16.503159 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f1d495-7a35-43c9-b049-92b6ce2ce1a5 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:08:16.519281 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f1d495-7a35-43c9-b049-92b6ce2ce1a5 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:08:16.578621 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8caa39-a7b7-471d-af24-bdd40eb5833e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:08:16.579236 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8caa39-a7b7-471d-af24-bdd40eb5833e admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:08:16.579526 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8caa39-a7b7-471d-af24-bdd40eb5833e admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:08:16.579801 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8caa39-a7b7-471d-af24-bdd40eb5833e admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:08:16.580517 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8caa39-a7b7-471d-af24-bdd40eb5833e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:08:16.582585 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8caa39-a7b7-471d-af24-bdd40eb5833e admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:08:16.610026 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4326/8624] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 22:08:16 2022] POST /identity/v3/users => generated 296 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 22:08:16.611297 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971c5a9b-0a39-4fca-8c21-ab9dbee1bbc1 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:08:16.622823 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971c5a9b-0a39-4fca-8c21-ab9dbee1bbc1 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:08:16.627609 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a07169-1e3d-4b33-8d64-c09884e3d3bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:08:16.628285 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a07169-1e3d-4b33-8d64-c09884e3d3bc admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:08:16.628562 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a07169-1e3d-4b33-8d64-c09884e3d3bc admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:08:16.628833 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a07169-1e3d-4b33-8d64-c09884e3d3bc admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:08:16.629659 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a07169-1e3d-4b33-8d64-c09884e3d3bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:08:16.631314 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a07169-1e3d-4b33-8d64-c09884e3d3bc admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:08:16.642887 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4299/8625] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 22:08:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 22:08:16.647367 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8caa39-a7b7-471d-af24-bdd40eb5833e admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:08:16.658210 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8caa39-a7b7-471d-af24-bdd40eb5833e admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:08:16.663215 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca352273-cd77-4684-9158-76e3ee811ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:08:16.664138 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca352273-cd77-4684-9158-76e3ee811ccf admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:08:16.664415 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca352273-cd77-4684-9158-76e3ee811ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:08:16.664688 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca352273-cd77-4684-9158-76e3ee811ccf admin admin] PATH_INFO: `/v3/projects/2ed9f858da58405f86a4a48727d5f844/users/53af0e670b75439187cce23a3b61a1e7/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:08:16.681532 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca352273-cd77-4684-9158-76e3ee811ccf admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ed9f858da58405f86a4a48727d5f844, user_id=53af0e670b75439187cce23a3b61a1e7, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:08:16.684234 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca352273-cd77-4684-9158-76e3ee811ccf admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:08:16.694819 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:08:16.700303 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4327/8626] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 22:08:16 2022] PUT /identity/v3/projects/2ed9f858da58405f86a4a48727d5f844/users/53af0e670b75439187cce23a3b61a1e7/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:08:16.704389 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a07169-1e3d-4b33-8d64-c09884e3d3bc admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:08:16.715498 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a07169-1e3d-4b33-8d64-c09884e3d3bc admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:08:16.741450 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:08:16.776219 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa2a601-a0ee-4fc9-ac18-dea1728bf86c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:08:16.776910 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa2a601-a0ee-4fc9-ac18-dea1728bf86c admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:08:16.777186 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa2a601-a0ee-4fc9-ac18-dea1728bf86c admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:08:16.777459 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa2a601-a0ee-4fc9-ac18-dea1728bf86c admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:08:16.778216 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa2a601-a0ee-4fc9-ac18-dea1728bf86c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:08:16.779835 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa2a601-a0ee-4fc9-ac18-dea1728bf86c admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:08:16.790322 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4300/8627] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 22:08:16 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 22:08:16.794565 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca352273-cd77-4684-9158-76e3ee811ccf admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:08:16.805377 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca352273-cd77-4684-9158-76e3ee811ccf admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:08:16.811773 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487d72b4-7f16-402f-a9bd-1a61a55a65ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:08:16.812792 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487d72b4-7f16-402f-a9bd-1a61a55a65ae admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:08:16.813149 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487d72b4-7f16-402f-a9bd-1a61a55a65ae admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:08:16.813559 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487d72b4-7f16-402f-a9bd-1a61a55a65ae admin admin] PATH_INFO: `/v3/projects/2ed9f858da58405f86a4a48727d5f844/users/53af0e670b75439187cce23a3b61a1e7/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:08:16.815622 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487d72b4-7f16-402f-a9bd-1a61a55a65ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ed9f858da58405f86a4a48727d5f844, user_id=53af0e670b75439187cce23a3b61a1e7, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:08:16.818450 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487d72b4-7f16-402f-a9bd-1a61a55a65ae admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:08:16.833053 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4328/8628] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 22:08:16 2022] PUT /identity/v3/projects/2ed9f858da58405f86a4a48727d5f844/users/53af0e670b75439187cce23a3b61a1e7/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 22:08:21.144127 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d21c69-b870-47f6-abeb-a3a8de59438f None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:08:21.144811 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d21c69-b870-47f6-abeb-a3a8de59438f None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:08:21.144921 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d21c69-b870-47f6-abeb-a3a8de59438f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:08:21.172856 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-e9d21c69-b870-47f6-abeb-a3a8de59438f None None] MFA Rules not processed for user `53af0e670b75439187cce23a3b61a1e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:08:21.174419 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-e9d21c69-b870-47f6-abeb-a3a8de59438f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:08:21.250352 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4301/8629] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:08:21 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:08:21.263109 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd503d04-88d9-48dc-a490-0091f9a16872 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:08:21.263109 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd503d04-88d9-48dc-a490-0091f9a16872 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:08:21.263733 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd503d04-88d9-48dc-a490-0091f9a16872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:08:21.324915 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-cd503d04-88d9-48dc-a490-0091f9a16872 None None] MFA Rules not processed for user `f7f2db148c8e4d5d81431cae3576434b`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:08:21.326140 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-cd503d04-88d9-48dc-a490-0091f9a16872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:08:21.383570 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4329/8630] 10.222.0.17 () {58 vars in 1063 bytes} [Sat Jul 23 22:08:21 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:08:21.389436 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d21c69-b870-47f6-abeb-a3a8de59438f None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:08:21.400455 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d21c69-b870-47f6-abeb-a3a8de59438f None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:08:21.404092 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c293ef3-9259-414e-96f6-fe050fc2d050 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7f2db148c8e4d5d81431cae3576434b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:08:21.404741 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c293ef3-9259-414e-96f6-fe050fc2d050 service glance] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:08:21.405017 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c293ef3-9259-414e-96f6-fe050fc2d050 service glance] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:08:21.405287 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c293ef3-9259-414e-96f6-fe050fc2d050 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:08:21.464954 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c293ef3-9259-414e-96f6-fe050fc2d050 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:08:21.466449 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c293ef3-9259-414e-96f6-fe050fc2d050 service glance] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:08:21.476299 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4302/8631] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:08:21 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:08:31.376478 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=43,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:08:31.472553 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=79 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:08:34.228691 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd503d04-88d9-48dc-a490-0091f9a16872 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:08:34.302518 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd503d04-88d9-48dc-a490-0091f9a16872 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:08:34.307205 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e77d057-f5c8-492e-87ae-788a613c6c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:08:34.308101 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e77d057-f5c8-492e-87ae-788a613c6c65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:08:34.308385 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e77d057-f5c8-492e-87ae-788a613c6c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:08:34.308657 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e77d057-f5c8-492e-87ae-788a613c6c65 admin admin] PATH_INFO: `/v3/users/8f94ed62a87a484b989f98f823ecd61f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:08:34.310051 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e77d057-f5c8-492e-87ae-788a613c6c65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f94ed62a87a484b989f98f823ecd61f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:08:34.311992 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e77d057-f5c8-492e-87ae-788a613c6c65 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:08:34.361810 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-6e77d057-f5c8-492e-87ae-788a613c6c65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f94ed62a87a484b989f98f823ecd61f'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:08:34.362552 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-6e77d057-f5c8-492e-87ae-788a613c6c65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f94ed62a87a484b989f98f823ecd61f'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:08:34.369407 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-6e77d057-f5c8-492e-87ae-788a613c6c65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f94ed62a87a484b989f98f823ecd61f'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:08:34.378210 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-6e77d057-f5c8-492e-87ae-788a613c6c65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f94ed62a87a484b989f98f823ecd61f'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:08:34.390301 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-6e77d057-f5c8-492e-87ae-788a613c6c65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f94ed62a87a484b989f98f823ecd61f'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:08:34.396441 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4330/8632] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 22:08:34 2022] DELETE /identity/v3/users/8f94ed62a87a484b989f98f823ecd61f => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:08:34.585473 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c293ef3-9259-414e-96f6-fe050fc2d050 service glance] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:08:34.599033 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c293ef3-9259-414e-96f6-fe050fc2d050 service glance] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:08:34.656176 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5127d04-989a-4334-9d60-f5c2857b8cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:08:34.657065 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5127d04-989a-4334-9d60-f5c2857b8cf0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:08:34.657347 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5127d04-989a-4334-9d60-f5c2857b8cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:08:34.657625 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5127d04-989a-4334-9d60-f5c2857b8cf0 admin admin] PATH_INFO: `/v3/projects/2c90e4831ffd42c9b0fc070521d8277e` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:08:34.658848 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5127d04-989a-4334-9d60-f5c2857b8cf0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c90e4831ffd42c9b0fc070521d8277e)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:08:34.660911 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5127d04-989a-4334-9d60-f5c2857b8cf0 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:08:34.710011 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-f5127d04-989a-4334-9d60-f5c2857b8cf0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c90e4831ffd42c9b0fc070521d8277e', 'request_id': 'req-f5127d04-989a-4334-9d60-f5c2857b8cf0'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:08:34.719302 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-f5127d04-989a-4334-9d60-f5c2857b8cf0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c90e4831ffd42c9b0fc070521d8277e', 'request_id': 'req-f5127d04-989a-4334-9d60-f5c2857b8cf0'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:08:34.725284 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-f5127d04-989a-4334-9d60-f5c2857b8cf0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c90e4831ffd42c9b0fc070521d8277e', 'request_id': 'req-f5127d04-989a-4334-9d60-f5c2857b8cf0'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:08:34.736188 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-f5127d04-989a-4334-9d60-f5c2857b8cf0 admin admin] The token cache is being invalidate because project 2c90e4831ffd42c9b0fc070521d8277e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 22:08:34.736500 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-f5127d04-989a-4334-9d60-f5c2857b8cf0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:08:34.737196 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-f5127d04-989a-4334-9d60-f5c2857b8cf0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:08:34.738894 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4303/8633] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 22:08:34 2022] DELETE /identity/v3/projects/2c90e4831ffd42c9b0fc070521d8277e => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:08:34.743069 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e77d057-f5c8-492e-87ae-788a613c6c65 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:08:34.744598 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-6e77d057-f5c8-492e-87ae-788a613c6c65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:08:34.758591 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e77d057-f5c8-492e-87ae-788a613c6c65 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:08:34.821399 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91820c7f-0fbc-4736-b29d-1c34ec5e96a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:08:34.822508 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91820c7f-0fbc-4736-b29d-1c34ec5e96a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:08:34.822787 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91820c7f-0fbc-4736-b29d-1c34ec5e96a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:08:34.823057 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91820c7f-0fbc-4736-b29d-1c34ec5e96a8 admin admin] PATH_INFO: `/v3/users/53af0e670b75439187cce23a3b61a1e7` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:08:34.824421 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91820c7f-0fbc-4736-b29d-1c34ec5e96a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=53af0e670b75439187cce23a3b61a1e7)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:08:34.826410 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91820c7f-0fbc-4736-b29d-1c34ec5e96a8 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:08:34.850673 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:08:34.889382 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-91820c7f-0fbc-4736-b29d-1c34ec5e96a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53af0e670b75439187cce23a3b61a1e7'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:08:34.890465 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-91820c7f-0fbc-4736-b29d-1c34ec5e96a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53af0e670b75439187cce23a3b61a1e7'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:08:34.900058 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-91820c7f-0fbc-4736-b29d-1c34ec5e96a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53af0e670b75439187cce23a3b61a1e7'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:08:34.909157 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-91820c7f-0fbc-4736-b29d-1c34ec5e96a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53af0e670b75439187cce23a3b61a1e7'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:08:34.926862 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-91820c7f-0fbc-4736-b29d-1c34ec5e96a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53af0e670b75439187cce23a3b61a1e7'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:08:34.933621 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4331/8634] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 22:08:34 2022] DELETE /identity/v3/users/53af0e670b75439187cce23a3b61a1e7 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:08:35.123840 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5127d04-989a-4334-9d60-f5c2857b8cf0 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:08:35.125332 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-f5127d04-989a-4334-9d60-f5c2857b8cf0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:08:35.139398 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5127d04-989a-4334-9d60-f5c2857b8cf0 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:08:35.200404 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb93058-dc39-4382-b206-1063b2831f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:08:35.201320 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb93058-dc39-4382-b206-1063b2831f2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:08:35.201602 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb93058-dc39-4382-b206-1063b2831f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:08:35.201896 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb93058-dc39-4382-b206-1063b2831f2f admin admin] PATH_INFO: `/v3/projects/2ed9f858da58405f86a4a48727d5f844` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:08:35.203155 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb93058-dc39-4382-b206-1063b2831f2f admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ed9f858da58405f86a4a48727d5f844)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:08:35.205182 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb93058-dc39-4382-b206-1063b2831f2f admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:08:35.242690 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:08:35.257326 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-9bb93058-dc39-4382-b206-1063b2831f2f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ed9f858da58405f86a4a48727d5f844', 'request_id': 'req-9bb93058-dc39-4382-b206-1063b2831f2f'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:08:35.265470 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-9bb93058-dc39-4382-b206-1063b2831f2f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ed9f858da58405f86a4a48727d5f844', 'request_id': 'req-9bb93058-dc39-4382-b206-1063b2831f2f'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:08:35.271199 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-9bb93058-dc39-4382-b206-1063b2831f2f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ed9f858da58405f86a4a48727d5f844', 'request_id': 'req-9bb93058-dc39-4382-b206-1063b2831f2f'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:08:35.282314 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-9bb93058-dc39-4382-b206-1063b2831f2f admin admin] The token cache is being invalidate because project 2ed9f858da58405f86a4a48727d5f844 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 22:08:35.282596 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-9bb93058-dc39-4382-b206-1063b2831f2f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:08:35.283312 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-9bb93058-dc39-4382-b206-1063b2831f2f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:08:35.284963 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4304/8635] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 22:08:35 2022] DELETE /identity/v3/projects/2ed9f858da58405f86a4a48727d5f844 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:08:44.905335 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4a7295-296c-4517-9a27-96b65ae19cfb None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:08:44.905945 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4a7295-296c-4517-9a27-96b65ae19cfb None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:08:44.905945 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4a7295-296c-4517-9a27-96b65ae19cfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:08:44.925447 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-3b4a7295-296c-4517-9a27-96b65ae19cfb None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:08:44.926738 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-3b4a7295-296c-4517-9a27-96b65ae19cfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:08:44.995136 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4332/8636] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:08:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:08:45.004556 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d41c03-96ec-4068-9739-f66530397005 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:08:45.005028 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d41c03-96ec-4068-9739-f66530397005 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:08:45.005159 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d41c03-96ec-4068-9739-f66530397005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:08:45.023578 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-30d41c03-96ec-4068-9739-f66530397005 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:08:45.025007 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-30d41c03-96ec-4068-9739-f66530397005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:08:45.033704 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4305/8637] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:08:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:08:45.038504 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4a7295-296c-4517-9a27-96b65ae19cfb None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:08:45.048479 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4a7295-296c-4517-9a27-96b65ae19cfb None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:08:45.056637 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007f9f58-ab49-4558-b00c-fb27f1e10695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:08:45.057311 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007f9f58-ab49-4558-b00c-fb27f1e10695 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:08:45.057600 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007f9f58-ab49-4558-b00c-fb27f1e10695 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:08:45.057892 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007f9f58-ab49-4558-b00c-fb27f1e10695 admin admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:08:45.058639 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007f9f58-ab49-4558-b00c-fb27f1e10695 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 22:08:45.058939 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007f9f58-ab49-4558-b00c-fb27f1e10695 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:08:45.060542 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007f9f58-ab49-4558-b00c-fb27f1e10695 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:08:45.072818 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4333/8638] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 22:08:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 22:08:45.087541 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d41c03-96ec-4068-9739-f66530397005 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:08:45.099268 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d41c03-96ec-4068-9739-f66530397005 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:08:45.104580 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606bbf92-858f-409b-aa9d-945a95c3bd39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:08:45.105252 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606bbf92-858f-409b-aa9d-945a95c3bd39 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:08:45.105538 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606bbf92-858f-409b-aa9d-945a95c3bd39 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:08:45.105819 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606bbf92-858f-409b-aa9d-945a95c3bd39 admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:08:45.106560 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606bbf92-858f-409b-aa9d-945a95c3bd39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:08:45.108488 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606bbf92-858f-409b-aa9d-945a95c3bd39 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:08:45.136342 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4306/8639] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 22:08:45 2022] POST /identity/v3/projects => generated 391 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 22:08:45.140664 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007f9f58-ab49-4558-b00c-fb27f1e10695 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:08:45.150854 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007f9f58-ab49-4558-b00c-fb27f1e10695 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:08:45.211639 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b8af78-83d6-4307-a691-1bb2feaa343f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:08:45.212344 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b8af78-83d6-4307-a691-1bb2feaa343f admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:08:45.212630 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b8af78-83d6-4307-a691-1bb2feaa343f admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:08:45.212884 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b8af78-83d6-4307-a691-1bb2feaa343f admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:08:45.213631 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b8af78-83d6-4307-a691-1bb2feaa343f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:08:45.215576 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b8af78-83d6-4307-a691-1bb2feaa343f admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:08:45.236955 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4334/8640] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 22:08:45 2022] POST /identity/v3/users => generated 296 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 22:08:45.241215 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606bbf92-858f-409b-aa9d-945a95c3bd39 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:08:45.251869 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606bbf92-858f-409b-aa9d-945a95c3bd39 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:08:45.259780 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b756ac8-e735-4f79-9ae6-4ae1acaa15f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:08:45.260749 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b756ac8-e735-4f79-9ae6-4ae1acaa15f5 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:08:45.261114 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b756ac8-e735-4f79-9ae6-4ae1acaa15f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:08:45.261449 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b756ac8-e735-4f79-9ae6-4ae1acaa15f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:08:45.262552 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b756ac8-e735-4f79-9ae6-4ae1acaa15f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:08:45.264923 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b756ac8-e735-4f79-9ae6-4ae1acaa15f5 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:08:45.280723 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4307/8641] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 22:08:45 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 22:08:45.285494 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b8af78-83d6-4307-a691-1bb2feaa343f admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:08:45.296547 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b8af78-83d6-4307-a691-1bb2feaa343f admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:08:45.302532 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d75ffc-0bca-40bf-93a5-223c2286ace1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:08:45.303208 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d75ffc-0bca-40bf-93a5-223c2286ace1 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:08:45.303484 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d75ffc-0bca-40bf-93a5-223c2286ace1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:08:45.303760 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d75ffc-0bca-40bf-93a5-223c2286ace1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:08:45.304473 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d75ffc-0bca-40bf-93a5-223c2286ace1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:08:45.306138 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d75ffc-0bca-40bf-93a5-223c2286ace1 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:08:45.316638 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4335/8642] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 22:08:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 22:08:45.322385 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b756ac8-e735-4f79-9ae6-4ae1acaa15f5 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:08:45.333395 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b756ac8-e735-4f79-9ae6-4ae1acaa15f5 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:08:45.340593 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290090a2-d7a4-4a7d-b7ec-bf1a84ac4d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:08:45.341815 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290090a2-d7a4-4a7d-b7ec-bf1a84ac4d25 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:08:45.342218 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290090a2-d7a4-4a7d-b7ec-bf1a84ac4d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:08:45.342546 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290090a2-d7a4-4a7d-b7ec-bf1a84ac4d25 admin admin] PATH_INFO: `/v3/projects/43fd816b6f2f40fd8255b789bc0bcb4f/users/4f2d11138f934d9c964d3a68bcba60cc/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:08:45.360131 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290090a2-d7a4-4a7d-b7ec-bf1a84ac4d25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43fd816b6f2f40fd8255b789bc0bcb4f, user_id=4f2d11138f934d9c964d3a68bcba60cc, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:08:45.362869 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290090a2-d7a4-4a7d-b7ec-bf1a84ac4d25 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:08:45.379663 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4308/8643] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 22:08:45 2022] PUT /identity/v3/projects/43fd816b6f2f40fd8255b789bc0bcb4f/users/4f2d11138f934d9c964d3a68bcba60cc/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:08:45.393754 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9ee69a-db63-4620-801c-a19e385754c8 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:08:45.394158 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9ee69a-db63-4620-801c-a19e385754c8 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:08:45.394663 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9ee69a-db63-4620-801c-a19e385754c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:08:45.402690 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:08:45.425204 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-fc9ee69a-db63-4620-801c-a19e385754c8 None None] MFA Rules not processed for user `4f2d11138f934d9c964d3a68bcba60cc`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:08:45.426532 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-fc9ee69a-db63-4620-801c-a19e385754c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:08:45.495337 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4336/8644] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:08:45 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:08:45.499989 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290090a2-d7a4-4a7d-b7ec-bf1a84ac4d25 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:08:45.561643 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290090a2-d7a4-4a7d-b7ec-bf1a84ac4d25 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:08:45.566924 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e87b48-8b44-4574-871b-c6ff3419c276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:08:45.567588 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e87b48-8b44-4574-871b-c6ff3419c276 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:08:45.567868 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e87b48-8b44-4574-871b-c6ff3419c276 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:08:45.568148 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e87b48-8b44-4574-871b-c6ff3419c276 admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:08:45.568830 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e87b48-8b44-4574-871b-c6ff3419c276 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:08:45.570784 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e87b48-8b44-4574-871b-c6ff3419c276 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:08:45.601418 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4309/8645] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 22:08:45 2022] POST /identity/v3/projects => generated 391 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 22:08:45.605499 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9ee69a-db63-4620-801c-a19e385754c8 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:08:45.617071 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9ee69a-db63-4620-801c-a19e385754c8 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:08:45.677759 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8479d5-255a-4969-8ebd-e3e7fd9aa9e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:08:45.678470 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8479d5-255a-4969-8ebd-e3e7fd9aa9e5 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:08:45.678749 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8479d5-255a-4969-8ebd-e3e7fd9aa9e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:08:45.679022 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8479d5-255a-4969-8ebd-e3e7fd9aa9e5 admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:08:45.679708 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8479d5-255a-4969-8ebd-e3e7fd9aa9e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:08:45.681666 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8479d5-255a-4969-8ebd-e3e7fd9aa9e5 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:08:45.702832 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4337/8646] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 22:08:45 2022] POST /identity/v3/users => generated 302 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 22:08:45.708203 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e87b48-8b44-4574-871b-c6ff3419c276 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:08:45.719452 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e87b48-8b44-4574-871b-c6ff3419c276 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:08:45.724306 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec66513-43d7-411d-9c4b-749cf4fd6437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:08:45.724974 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec66513-43d7-411d-9c4b-749cf4fd6437 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:08:45.725253 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec66513-43d7-411d-9c4b-749cf4fd6437 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:08:45.725524 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec66513-43d7-411d-9c4b-749cf4fd6437 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:08:45.726300 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec66513-43d7-411d-9c4b-749cf4fd6437 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:08:45.727904 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec66513-43d7-411d-9c4b-749cf4fd6437 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:08:45.738738 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4310/8647] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 22:08:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 22:08:45.743139 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8479d5-255a-4969-8ebd-e3e7fd9aa9e5 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:08:45.753613 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8479d5-255a-4969-8ebd-e3e7fd9aa9e5 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:08:45.759778 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552500da-2438-4965-9a51-5818cd4852be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:08:45.760730 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552500da-2438-4965-9a51-5818cd4852be admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:08:45.761003 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552500da-2438-4965-9a51-5818cd4852be admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:08:45.761297 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552500da-2438-4965-9a51-5818cd4852be admin admin] PATH_INFO: `/v3/projects/eed1bc3623834e359fd56a6dfe73e3ff/users/553940f818364b1780306b0f4280301d/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:08:45.777345 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552500da-2438-4965-9a51-5818cd4852be admin admin] RBAC: Authorizing `identity:create_grant(project_id=eed1bc3623834e359fd56a6dfe73e3ff, user_id=553940f818364b1780306b0f4280301d, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:08:45.780040 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552500da-2438-4965-9a51-5818cd4852be admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:08:45.798896 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4338/8648] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 22:08:45 2022] PUT /identity/v3/projects/eed1bc3623834e359fd56a6dfe73e3ff/users/553940f818364b1780306b0f4280301d/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 22:08:45.804154 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec66513-43d7-411d-9c4b-749cf4fd6437 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:08:45.815122 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec66513-43d7-411d-9c4b-749cf4fd6437 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:08:45.850026 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:08:45.881526 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146b5240-aff5-4c20-8b0e-5d9dc81d9aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:08:45.882181 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146b5240-aff5-4c20-8b0e-5d9dc81d9aa9 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:08:45.882465 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146b5240-aff5-4c20-8b0e-5d9dc81d9aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:08:45.882742 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146b5240-aff5-4c20-8b0e-5d9dc81d9aa9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:08:45.883505 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146b5240-aff5-4c20-8b0e-5d9dc81d9aa9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:08:45.885147 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146b5240-aff5-4c20-8b0e-5d9dc81d9aa9 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:08:45.895475 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4311/8649] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 22:08:45 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 22:08:45.899899 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552500da-2438-4965-9a51-5818cd4852be admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:08:45.910629 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552500da-2438-4965-9a51-5818cd4852be admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:08:45.915807 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2611872f-e491-4e7d-a44b-95cb2181de45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:08:45.916694 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2611872f-e491-4e7d-a44b-95cb2181de45 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:08:45.916970 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2611872f-e491-4e7d-a44b-95cb2181de45 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:08:45.917243 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2611872f-e491-4e7d-a44b-95cb2181de45 admin admin] PATH_INFO: `/v3/projects/eed1bc3623834e359fd56a6dfe73e3ff/users/553940f818364b1780306b0f4280301d/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:08:45.919376 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2611872f-e491-4e7d-a44b-95cb2181de45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eed1bc3623834e359fd56a6dfe73e3ff, user_id=553940f818364b1780306b0f4280301d, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:08:45.922061 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2611872f-e491-4e7d-a44b-95cb2181de45 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:08:45.932656 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4339/8650] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 22:08:45 2022] PUT /identity/v3/projects/eed1bc3623834e359fd56a6dfe73e3ff/users/553940f818364b1780306b0f4280301d/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:08:45.943032 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04138ff-cec8-417e-ac9a-c30f718f6ca9 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:08:45.943345 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04138ff-cec8-417e-ac9a-c30f718f6ca9 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:08:45.943643 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04138ff-cec8-417e-ac9a-c30f718f6ca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:08:45.971765 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-d04138ff-cec8-417e-ac9a-c30f718f6ca9 None None] MFA Rules not processed for user `553940f818364b1780306b0f4280301d`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:08:45.973102 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-d04138ff-cec8-417e-ac9a-c30f718f6ca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:08:46.044885 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4312/8651] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:08:45 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 22:08:46.057341 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e88e85a-12a6-4e72-b554-2eb5684dc8f7 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:08:46.057625 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e88e85a-12a6-4e72-b554-2eb5684dc8f7 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:08:46.057897 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e88e85a-12a6-4e72-b554-2eb5684dc8f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:08:46.076816 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-0e88e85a-12a6-4e72-b554-2eb5684dc8f7 None None] MFA Rules not processed for user `4f2d11138f934d9c964d3a68bcba60cc`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:08:46.078076 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-0e88e85a-12a6-4e72-b554-2eb5684dc8f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:08:46.129650 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:08:46.145658 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4340/8652] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:08:46 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:08:46.160536 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04138ff-cec8-417e-ac9a-c30f718f6ca9 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:08:46.162208 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-d04138ff-cec8-417e-ac9a-c30f718f6ca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:08:46.241956 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04138ff-cec8-417e-ac9a-c30f718f6ca9 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:08:46.248176 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f22084-a64b-4fd8-9da6-fb09698f546f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:08:46.248821 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f22084-a64b-4fd8-9da6-fb09698f546f service nova] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:08:46.249100 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f22084-a64b-4fd8-9da6-fb09698f546f service nova] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:08:46.249374 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f22084-a64b-4fd8-9da6-fb09698f546f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:08:46.258096 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f22084-a64b-4fd8-9da6-fb09698f546f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:08:46.259681 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f22084-a64b-4fd8-9da6-fb09698f546f service nova] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:08:46.269126 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4313/8653] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:08:46 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:08:56.138719 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=4 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:08:56.264788 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=83 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:08:58.928242 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e88e85a-12a6-4e72-b554-2eb5684dc8f7 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:08:58.944757 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e88e85a-12a6-4e72-b554-2eb5684dc8f7 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:08:58.951609 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74529f8d-4f84-48ec-982f-497197547c65 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:08:58.952297 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74529f8d-4f84-48ec-982f-497197547c65 service nova] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:08:58.952577 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74529f8d-4f84-48ec-982f-497197547c65 service nova] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:08:58.952858 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74529f8d-4f84-48ec-982f-497197547c65 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:08:58.961909 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74529f8d-4f84-48ec-982f-497197547c65 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:08:58.963543 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74529f8d-4f84-48ec-982f-497197547c65 service nova] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:08:58.973554 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4341/8654] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:08:58 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:08:58.987328 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d61d7ba-2644-4ee8-9cd0-67337e590e5e None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:08:58.987782 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d61d7ba-2644-4ee8-9cd0-67337e590e5e None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:08:58.987860 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d61d7ba-2644-4ee8-9cd0-67337e590e5e None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:08:58.989249 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4314/8655] 10.222.0.17 () {54 vars in 912 bytes} [Sat Jul 23 22:08:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 22:08:58.994186 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74529f8d-4f84-48ec-982f-497197547c65 service nova] Authenticating service token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 23 22:08:59.008353 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74529f8d-4f84-48ec-982f-497197547c65 service nova] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:08:59.017073 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74529f8d-4f84-48ec-982f-497197547c65 service nova] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:08:59.023260 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7091e9d7-40fa-4fc6-bb09-f418ae4b8568 tempest-ServersAdminNegativeTestJSON-916764799 tempest-ServersAdminNegativeTestJSON-916764799-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '553940f818364b1780306b0f4280301d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eed1bc3623834e359fd56a6dfe73e3ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:08:59.024118 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7091e9d7-40fa-4fc6-bb09-f418ae4b8568 tempest-ServersAdminNegativeTestJSON-916764799 tempest-ServersAdminNegativeTestJSON-916764799-project-admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:08:59.024384 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7091e9d7-40fa-4fc6-bb09-f418ae4b8568 tempest-ServersAdminNegativeTestJSON-916764799 tempest-ServersAdminNegativeTestJSON-916764799-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:08:59.024681 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7091e9d7-40fa-4fc6-bb09-f418ae4b8568 tempest-ServersAdminNegativeTestJSON-916764799 tempest-ServersAdminNegativeTestJSON-916764799-project-admin] PATH_INFO: `/v3/projects/eed1bc3623834e359fd56a6dfe73e3ff` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:08:59.026682 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7091e9d7-40fa-4fc6-bb09-f418ae4b8568 tempest-ServersAdminNegativeTestJSON-916764799 tempest-ServersAdminNegativeTestJSON-916764799-project-admin] RBAC: Authorizing `identity:get_project(project_id=eed1bc3623834e359fd56a6dfe73e3ff)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:08:59.029451 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7091e9d7-40fa-4fc6-bb09-f418ae4b8568 tempest-ServersAdminNegativeTestJSON-916764799 tempest-ServersAdminNegativeTestJSON-916764799-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:08:59.032342 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4342/8656] 10.222.0.17 () {58 vars in 1443 bytes} [Sat Jul 23 22:08:58 2022] GET /identity/v3/projects/eed1bc3623834e359fd56a6dfe73e3ff => generated 391 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 22:08:59.328259 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4ac085-18e6-4807-950a-a556c58a8f37 None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:08:59.328549 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4ac085-18e6-4807-950a-a556c58a8f37 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:08:59.328822 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4ac085-18e6-4807-950a-a556c58a8f37 None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:08:59.330247 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4315/8657] 10.222.0.17 () {54 vars in 912 bytes} [Sat Jul 23 22:08:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 22:08:59.335675 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7091e9d7-40fa-4fc6-bb09-f418ae4b8568 tempest-ServersAdminNegativeTestJSON-916764799 tempest-ServersAdminNegativeTestJSON-916764799-project-admin] Authenticating service token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 23 22:08:59.353053 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7091e9d7-40fa-4fc6-bb09-f418ae4b8568 tempest-ServersAdminNegativeTestJSON-916764799 tempest-ServersAdminNegativeTestJSON-916764799-project-admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:08:59.362582 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7091e9d7-40fa-4fc6-bb09-f418ae4b8568 tempest-ServersAdminNegativeTestJSON-916764799 tempest-ServersAdminNegativeTestJSON-916764799-project-admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:08:59.368188 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b20290e-caba-4c10-bf7f-a50766841726 tempest-ServersAdminNegativeTestJSON-916764799 tempest-ServersAdminNegativeTestJSON-916764799-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '553940f818364b1780306b0f4280301d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eed1bc3623834e359fd56a6dfe73e3ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:08:59.369117 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b20290e-caba-4c10-bf7f-a50766841726 tempest-ServersAdminNegativeTestJSON-916764799 tempest-ServersAdminNegativeTestJSON-916764799-project-admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:08:59.369397 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b20290e-caba-4c10-bf7f-a50766841726 tempest-ServersAdminNegativeTestJSON-916764799 tempest-ServersAdminNegativeTestJSON-916764799-project-admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:08:59.369668 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b20290e-caba-4c10-bf7f-a50766841726 tempest-ServersAdminNegativeTestJSON-916764799 tempest-ServersAdminNegativeTestJSON-916764799-project-admin] PATH_INFO: `/v3/projects/eed1bc3623834e359fd56a6dfe73e3ff` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:08:59.370915 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b20290e-caba-4c10-bf7f-a50766841726 tempest-ServersAdminNegativeTestJSON-916764799 tempest-ServersAdminNegativeTestJSON-916764799-project-admin] RBAC: Authorizing `identity:get_project(project_id=eed1bc3623834e359fd56a6dfe73e3ff)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:08:59.373053 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b20290e-caba-4c10-bf7f-a50766841726 tempest-ServersAdminNegativeTestJSON-916764799 tempest-ServersAdminNegativeTestJSON-916764799-project-admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:08:59.374968 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4343/8658] 10.222.0.17 () {58 vars in 1443 bytes} [Sat Jul 23 22:08:59 2022] GET /identity/v3/projects/eed1bc3623834e359fd56a6dfe73e3ff => generated 391 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 22:09:02.106201 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4ac085-18e6-4807-950a-a556c58a8f37 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:09:02.176578 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4ac085-18e6-4807-950a-a556c58a8f37 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:09:02.181968 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60495b00-e09f-4723-8810-baa2d5efe4a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:09:02.182826 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60495b00-e09f-4723-8810-baa2d5efe4a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:09:02.183113 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60495b00-e09f-4723-8810-baa2d5efe4a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:09:02.183391 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60495b00-e09f-4723-8810-baa2d5efe4a6 admin admin] PATH_INFO: `/v3/users/4f2d11138f934d9c964d3a68bcba60cc` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:09:02.184687 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60495b00-e09f-4723-8810-baa2d5efe4a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f2d11138f934d9c964d3a68bcba60cc)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:09:02.186667 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60495b00-e09f-4723-8810-baa2d5efe4a6 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:09:02.234323 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-60495b00-e09f-4723-8810-baa2d5efe4a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f2d11138f934d9c964d3a68bcba60cc'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:09:02.241309 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-60495b00-e09f-4723-8810-baa2d5efe4a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f2d11138f934d9c964d3a68bcba60cc'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:09:02.241945 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-60495b00-e09f-4723-8810-baa2d5efe4a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f2d11138f934d9c964d3a68bcba60cc'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:09:02.250114 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-60495b00-e09f-4723-8810-baa2d5efe4a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f2d11138f934d9c964d3a68bcba60cc'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:09:02.262110 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-60495b00-e09f-4723-8810-baa2d5efe4a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f2d11138f934d9c964d3a68bcba60cc'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:09:02.268286 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4316/8659] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 22:09:02 2022] DELETE /identity/v3/users/4f2d11138f934d9c964d3a68bcba60cc => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:09:02.272993 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2898cf8-4358-4184-8c1a-b98c6c3864f5 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:09:02.273492 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2898cf8-4358-4184-8c1a-b98c6c3864f5 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:09:02.273623 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2898cf8-4358-4184-8c1a-b98c6c3864f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:09:02.293579 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-f2898cf8-4358-4184-8c1a-b98c6c3864f5 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:09:02.294871 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-f2898cf8-4358-4184-8c1a-b98c6c3864f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:09:02.355985 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4344/8660] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:09:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 22:09:02.366091 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60495b00-e09f-4723-8810-baa2d5efe4a6 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:09:02.367604 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-60495b00-e09f-4723-8810-baa2d5efe4a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:09:02.437333 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60495b00-e09f-4723-8810-baa2d5efe4a6 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:09:02.442103 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b6f595-5a88-40b4-8f2c-f16959c4aa5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:09:02.442769 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b6f595-5a88-40b4-8f2c-f16959c4aa5b service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:09:02.443052 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b6f595-5a88-40b4-8f2c-f16959c4aa5b service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:09:02.443318 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b6f595-5a88-40b4-8f2c-f16959c4aa5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:09:02.453141 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b6f595-5a88-40b4-8f2c-f16959c4aa5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:09:02.454633 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b6f595-5a88-40b4-8f2c-f16959c4aa5b service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:09:02.464997 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4317/8661] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:09:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:09:02.644110 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2898cf8-4358-4184-8c1a-b98c6c3864f5 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:09:02.645551 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-f2898cf8-4358-4184-8c1a-b98c6c3864f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:09:02.660499 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2898cf8-4358-4184-8c1a-b98c6c3864f5 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:09:02.665446 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6d6d28-a524-41c9-b463-1aadcb14a9fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:09:02.666510 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6d6d28-a524-41c9-b463-1aadcb14a9fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:09:02.666794 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6d6d28-a524-41c9-b463-1aadcb14a9fd admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:09:02.667074 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6d6d28-a524-41c9-b463-1aadcb14a9fd admin admin] PATH_INFO: `/v3/projects/43fd816b6f2f40fd8255b789bc0bcb4f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:09:02.668440 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6d6d28-a524-41c9-b463-1aadcb14a9fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=43fd816b6f2f40fd8255b789bc0bcb4f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:09:02.670405 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6d6d28-a524-41c9-b463-1aadcb14a9fd admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:09:02.723303 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-ed6d6d28-a524-41c9-b463-1aadcb14a9fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43fd816b6f2f40fd8255b789bc0bcb4f', 'request_id': 'req-ed6d6d28-a524-41c9-b463-1aadcb14a9fd'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:09:02.732598 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-ed6d6d28-a524-41c9-b463-1aadcb14a9fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43fd816b6f2f40fd8255b789bc0bcb4f', 'request_id': 'req-ed6d6d28-a524-41c9-b463-1aadcb14a9fd'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:09:02.738407 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-ed6d6d28-a524-41c9-b463-1aadcb14a9fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43fd816b6f2f40fd8255b789bc0bcb4f', 'request_id': 'req-ed6d6d28-a524-41c9-b463-1aadcb14a9fd'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:09:02.753211 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-ed6d6d28-a524-41c9-b463-1aadcb14a9fd admin admin] The token cache is being invalidate because project 43fd816b6f2f40fd8255b789bc0bcb4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 22:09:02.753494 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-ed6d6d28-a524-41c9-b463-1aadcb14a9fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:09:02.754190 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-ed6d6d28-a524-41c9-b463-1aadcb14a9fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:09:02.756027 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4345/8662] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 22:09:02 2022] DELETE /identity/v3/projects/43fd816b6f2f40fd8255b789bc0bcb4f => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:09:02.760703 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b6f595-5a88-40b4-8f2c-f16959c4aa5b service neutron] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:09:02.772076 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b6f595-5a88-40b4-8f2c-f16959c4aa5b service neutron] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:09:02.791879 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:09:02.832424 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdbc0c7-72ab-4e6e-a849-53a6110bc370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:09:02.833321 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdbc0c7-72ab-4e6e-a849-53a6110bc370 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:09:02.833604 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdbc0c7-72ab-4e6e-a849-53a6110bc370 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:09:02.833903 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdbc0c7-72ab-4e6e-a849-53a6110bc370 admin admin] PATH_INFO: `/v3/users/553940f818364b1780306b0f4280301d` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:09:02.835524 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdbc0c7-72ab-4e6e-a849-53a6110bc370 admin admin] RBAC: Authorizing `identity:delete_user(user_id=553940f818364b1780306b0f4280301d)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:09:02.837483 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdbc0c7-72ab-4e6e-a849-53a6110bc370 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:09:02.883851 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-cfdbc0c7-72ab-4e6e-a849-53a6110bc370 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '553940f818364b1780306b0f4280301d'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:09:02.890732 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-cfdbc0c7-72ab-4e6e-a849-53a6110bc370 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '553940f818364b1780306b0f4280301d'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:09:02.891316 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-cfdbc0c7-72ab-4e6e-a849-53a6110bc370 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '553940f818364b1780306b0f4280301d'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:09:02.899961 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-cfdbc0c7-72ab-4e6e-a849-53a6110bc370 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '553940f818364b1780306b0f4280301d'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:09:02.912197 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-cfdbc0c7-72ab-4e6e-a849-53a6110bc370 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '553940f818364b1780306b0f4280301d'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:09:02.919230 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4318/8663] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 22:09:02 2022] DELETE /identity/v3/users/553940f818364b1780306b0f4280301d => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:09:03.215266 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6d6d28-a524-41c9-b463-1aadcb14a9fd admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:09:03.216735 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-ed6d6d28-a524-41c9-b463-1aadcb14a9fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:09:03.230661 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6d6d28-a524-41c9-b463-1aadcb14a9fd admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:09:03.281605 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:09:03.291884 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4021dd62-fef0-4390-a527-4fc2e7a62860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:09:03.292924 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4021dd62-fef0-4390-a527-4fc2e7a62860 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:09:03.293211 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4021dd62-fef0-4390-a527-4fc2e7a62860 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:09:03.293487 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4021dd62-fef0-4390-a527-4fc2e7a62860 admin admin] PATH_INFO: `/v3/projects/eed1bc3623834e359fd56a6dfe73e3ff` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:09:03.294916 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4021dd62-fef0-4390-a527-4fc2e7a62860 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eed1bc3623834e359fd56a6dfe73e3ff)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:09:03.297226 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4021dd62-fef0-4390-a527-4fc2e7a62860 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:09:03.347880 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-4021dd62-fef0-4390-a527-4fc2e7a62860 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eed1bc3623834e359fd56a6dfe73e3ff', 'request_id': 'req-4021dd62-fef0-4390-a527-4fc2e7a62860'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:09:03.357196 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-4021dd62-fef0-4390-a527-4fc2e7a62860 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eed1bc3623834e359fd56a6dfe73e3ff', 'request_id': 'req-4021dd62-fef0-4390-a527-4fc2e7a62860'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:09:03.363456 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-4021dd62-fef0-4390-a527-4fc2e7a62860 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eed1bc3623834e359fd56a6dfe73e3ff', 'request_id': 'req-4021dd62-fef0-4390-a527-4fc2e7a62860'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:09:03.376321 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-4021dd62-fef0-4390-a527-4fc2e7a62860 admin admin] The token cache is being invalidate because project eed1bc3623834e359fd56a6dfe73e3ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 22:09:03.376641 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-4021dd62-fef0-4390-a527-4fc2e7a62860 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:09:03.377555 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-4021dd62-fef0-4390-a527-4fc2e7a62860 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:09:03.379242 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4346/8664] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 22:09:03 2022] DELETE /identity/v3/projects/eed1bc3623834e359fd56a6dfe73e3ff => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:09:03.385382 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b92d7e-f0b1-473a-83c6-20ecb9040c37 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:09:03.385913 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b92d7e-f0b1-473a-83c6-20ecb9040c37 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:09:03.385995 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b92d7e-f0b1-473a-83c6-20ecb9040c37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:09:03.404605 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-40b92d7e-f0b1-473a-83c6-20ecb9040c37 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:09:03.405814 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-40b92d7e-f0b1-473a-83c6-20ecb9040c37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:09:03.463840 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4319/8665] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:09:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:09:03.472130 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85b6ba7-9f4f-422c-bd3a-31154a360d4d None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:09:03.472413 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85b6ba7-9f4f-422c-bd3a-31154a360d4d None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:09:03.472685 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85b6ba7-9f4f-422c-bd3a-31154a360d4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:09:03.492162 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-e85b6ba7-9f4f-422c-bd3a-31154a360d4d None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:09:03.493470 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-e85b6ba7-9f4f-422c-bd3a-31154a360d4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:09:03.501664 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4347/8666] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:09:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:09:03.506131 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b92d7e-f0b1-473a-83c6-20ecb9040c37 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:09:03.516251 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b92d7e-f0b1-473a-83c6-20ecb9040c37 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:09:03.520935 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383752ee-557e-42b0-8a97-8c65555246c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:09:03.521581 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383752ee-557e-42b0-8a97-8c65555246c3 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:09:03.521890 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383752ee-557e-42b0-8a97-8c65555246c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:09:03.522170 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383752ee-557e-42b0-8a97-8c65555246c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:09:03.522919 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383752ee-557e-42b0-8a97-8c65555246c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 22:09:03.523216 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383752ee-557e-42b0-8a97-8c65555246c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:09:03.524870 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383752ee-557e-42b0-8a97-8c65555246c3 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:09:03.536668 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4320/8667] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 22:09:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 22:09:03.540951 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85b6ba7-9f4f-422c-bd3a-31154a360d4d None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:09:03.550804 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85b6ba7-9f4f-422c-bd3a-31154a360d4d None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:09:03.556187 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c64980-88ad-42f1-9afd-5f86a45016cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:09:03.556842 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c64980-88ad-42f1-9afd-5f86a45016cd admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:09:03.557125 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c64980-88ad-42f1-9afd-5f86a45016cd admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:09:03.557402 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c64980-88ad-42f1-9afd-5f86a45016cd admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:09:03.558100 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c64980-88ad-42f1-9afd-5f86a45016cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:09:03.560019 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c64980-88ad-42f1-9afd-5f86a45016cd admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:09:03.588706 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4348/8668] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 22:09:03 2022] POST /identity/v3/projects => generated 379 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 22:09:03.592874 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383752ee-557e-42b0-8a97-8c65555246c3 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:09:03.603174 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383752ee-557e-42b0-8a97-8c65555246c3 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:09:03.629609 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:09:03.666660 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d276317-e9f6-4502-a8b2-268faa68b5dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:09:03.667340 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d276317-e9f6-4502-a8b2-268faa68b5dd admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:09:03.667625 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d276317-e9f6-4502-a8b2-268faa68b5dd admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:09:03.667971 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d276317-e9f6-4502-a8b2-268faa68b5dd admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:09:03.668670 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d276317-e9f6-4502-a8b2-268faa68b5dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:09:03.670652 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d276317-e9f6-4502-a8b2-268faa68b5dd admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:09:03.692068 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4321/8669] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 22:09:03 2022] POST /identity/v3/users => generated 290 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 22:09:03.696459 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c64980-88ad-42f1-9afd-5f86a45016cd admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:09:03.707143 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c64980-88ad-42f1-9afd-5f86a45016cd admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:09:03.712331 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db99969-184f-435a-8d6c-8d95ddefb625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:09:03.712986 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db99969-184f-435a-8d6c-8d95ddefb625 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:09:03.713262 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db99969-184f-435a-8d6c-8d95ddefb625 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:09:03.713531 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db99969-184f-435a-8d6c-8d95ddefb625 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:09:03.714336 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db99969-184f-435a-8d6c-8d95ddefb625 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:09:03.715874 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db99969-184f-435a-8d6c-8d95ddefb625 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:09:03.726427 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4349/8670] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 22:09:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 22:09:03.730650 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d276317-e9f6-4502-a8b2-268faa68b5dd admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:09:03.741038 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d276317-e9f6-4502-a8b2-268faa68b5dd admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:09:03.746017 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124ed338-0357-41d7-a6a5-fecd4d9e1051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:09:03.746715 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124ed338-0357-41d7-a6a5-fecd4d9e1051 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:09:03.747022 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124ed338-0357-41d7-a6a5-fecd4d9e1051 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:09:03.747294 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124ed338-0357-41d7-a6a5-fecd4d9e1051 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:09:03.748021 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124ed338-0357-41d7-a6a5-fecd4d9e1051 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:09:03.749666 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124ed338-0357-41d7-a6a5-fecd4d9e1051 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:09:03.761136 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4322/8671] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 22:09:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 22:09:03.765372 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db99969-184f-435a-8d6c-8d95ddefb625 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:09:03.776428 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db99969-184f-435a-8d6c-8d95ddefb625 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:09:03.782077 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd223221-889b-4df7-a052-8b94edb15b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:09:03.782973 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd223221-889b-4df7-a052-8b94edb15b6c admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:09:03.783260 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd223221-889b-4df7-a052-8b94edb15b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:09:03.783538 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd223221-889b-4df7-a052-8b94edb15b6c admin admin] PATH_INFO: `/v3/projects/62de2e01319a49feb262b98ca4a23a7b/users/cfb9e87eb6734c4ea35a0fdf4cd3b397/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:09:03.799030 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd223221-889b-4df7-a052-8b94edb15b6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=62de2e01319a49feb262b98ca4a23a7b, user_id=cfb9e87eb6734c4ea35a0fdf4cd3b397, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:09:03.801795 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd223221-889b-4df7-a052-8b94edb15b6c admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:09:03.817423 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4350/8672] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 22:09:03 2022] PUT /identity/v3/projects/62de2e01319a49feb262b98ca4a23a7b/users/cfb9e87eb6734c4ea35a0fdf4cd3b397/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:09:03.822856 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b43a924-37f3-49bf-b6e2-891922e183da None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:09:03.823152 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b43a924-37f3-49bf-b6e2-891922e183da None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:09:03.823440 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b43a924-37f3-49bf-b6e2-891922e183da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:09:03.842080 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-7b43a924-37f3-49bf-b6e2-891922e183da None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:09:03.843297 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-7b43a924-37f3-49bf-b6e2-891922e183da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:09:03.904049 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4323/8673] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:09:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:09:03.914511 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd223221-889b-4df7-a052-8b94edb15b6c admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:09:03.916348 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-dd223221-889b-4df7-a052-8b94edb15b6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:09:03.974237 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd223221-889b-4df7-a052-8b94edb15b6c admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:09:03.978927 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e86c40-f12a-45eb-9511-387b882bbe9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:09:03.979596 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e86c40-f12a-45eb-9511-387b882bbe9e service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:09:03.979904 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e86c40-f12a-45eb-9511-387b882bbe9e service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:09:03.980181 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e86c40-f12a-45eb-9511-387b882bbe9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:09:03.991873 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e86c40-f12a-45eb-9511-387b882bbe9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:09:03.993747 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e86c40-f12a-45eb-9511-387b882bbe9e service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:09:04.004037 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4351/8674] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:09:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:09:08.053620 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87ee3e1-fc99-41f9-a3b5-f39bc2bdf250 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:09:08.054108 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87ee3e1-fc99-41f9-a3b5-f39bc2bdf250 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:09:08.054234 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87ee3e1-fc99-41f9-a3b5-f39bc2bdf250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:09:08.080715 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-c87ee3e1-fc99-41f9-a3b5-f39bc2bdf250 None None] MFA Rules not processed for user `cfb9e87eb6734c4ea35a0fdf4cd3b397`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:09:08.081897 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-c87ee3e1-fc99-41f9-a3b5-f39bc2bdf250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:09:08.150022 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4324/8675] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:09:08 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:09:08.162501 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae55335-b210-457c-8b11-056fd55ef7c5 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:09:08.162935 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae55335-b210-457c-8b11-056fd55ef7c5 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:09:08.163034 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae55335-b210-457c-8b11-056fd55ef7c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:09:08.182410 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-eae55335-b210-457c-8b11-056fd55ef7c5 None None] MFA Rules not processed for user `cfb9e87eb6734c4ea35a0fdf4cd3b397`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:09:08.183648 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-eae55335-b210-457c-8b11-056fd55ef7c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:09:08.191174 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4352/8676] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:09:08 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:09:08.202806 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87ee3e1-fc99-41f9-a3b5-f39bc2bdf250 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:09:08.204378 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-c87ee3e1-fc99-41f9-a3b5-f39bc2bdf250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:09:08.253904 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:09:08.290593 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87ee3e1-fc99-41f9-a3b5-f39bc2bdf250 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:09:08.296533 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e7f2c4-a093-433a-bb53-36b5a3b7a9c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:09:08.297199 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e7f2c4-a093-433a-bb53-36b5a3b7a9c2 service nova] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:09:08.297477 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e7f2c4-a093-433a-bb53-36b5a3b7a9c2 service nova] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:09:08.297751 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e7f2c4-a093-433a-bb53-36b5a3b7a9c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:09:08.306468 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e7f2c4-a093-433a-bb53-36b5a3b7a9c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:09:08.308072 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e7f2c4-a093-433a-bb53-36b5a3b7a9c2 service nova] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:09:08.317670 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4325/8677] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:09:08 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:09:09.398046 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754152de-dc46-4e65-a2ce-bf4f435233ff None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:09:09.398563 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754152de-dc46-4e65-a2ce-bf4f435233ff None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:09:09.398675 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754152de-dc46-4e65-a2ce-bf4f435233ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:09:09.417905 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-754152de-dc46-4e65-a2ce-bf4f435233ff None None] MFA Rules not processed for user `abc719a3b3ac4461b82ca04ab6451d81`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:09:09.419137 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-754152de-dc46-4e65-a2ce-bf4f435233ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:09:09.429305 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:09:09.487790 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4353/8678] 10.222.0.42 () {58 vars in 1015 bytes} [Sat Jul 23 22:09:09 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:09:09.500305 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e7f2c4-a093-433a-bb53-36b5a3b7a9c2 service nova] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:09:09.501746 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-c4e7f2c4-a093-433a-bb53-36b5a3b7a9c2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:09:09.519555 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e7f2c4-a093-433a-bb53-36b5a3b7a9c2 service nova] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:09:09.524705 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64feb700-0e2c-4cdb-86d2-ced6f2323bc0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc719a3b3ac4461b82ca04ab6451d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:09:09.525358 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64feb700-0e2c-4cdb-86d2-ced6f2323bc0 service placement] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:09:09.525832 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64feb700-0e2c-4cdb-86d2-ced6f2323bc0 service placement] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:09:09.526135 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64feb700-0e2c-4cdb-86d2-ced6f2323bc0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:09:09.535364 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64feb700-0e2c-4cdb-86d2-ced6f2323bc0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:09:09.536935 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64feb700-0e2c-4cdb-86d2-ced6f2323bc0 service placement] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:09:09.546964 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4326/8679] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:09:09 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:09:14.324266 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a05a751-d32a-439d-897c-d0b8b8419834 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:09:14.324809 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a05a751-d32a-439d-897c-d0b8b8419834 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:09:14.324809 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a05a751-d32a-439d-897c-d0b8b8419834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:09:14.347983 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-2a05a751-d32a-439d-897c-d0b8b8419834 None None] MFA Rules not processed for user `abc719a3b3ac4461b82ca04ab6451d81`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:09:14.349275 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-2a05a751-d32a-439d-897c-d0b8b8419834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:09:14.359629 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4354/8680] 10.222.0.39 () {58 vars in 1015 bytes} [Sat Jul 23 22:09:14 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:09:14.373282 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa515eb-8919-4a09-9a39-6e7a3d8d4cc6 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:09:14.373692 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa515eb-8919-4a09-9a39-6e7a3d8d4cc6 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:09:14.373846 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa515eb-8919-4a09-9a39-6e7a3d8d4cc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:09:14.394145 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-0aa515eb-8919-4a09-9a39-6e7a3d8d4cc6 None None] MFA Rules not processed for user `abc719a3b3ac4461b82ca04ab6451d81`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:09:14.395361 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-0aa515eb-8919-4a09-9a39-6e7a3d8d4cc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:09:14.404535 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4327/8681] 10.222.0.17 () {58 vars in 1058 bytes} [Sat Jul 23 22:09:14 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:09:14.410994 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a05a751-d32a-439d-897c-d0b8b8419834 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:09:14.422353 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a05a751-d32a-439d-897c-d0b8b8419834 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:09:14.428882 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4d8421-4816-4a67-9501-bf79efe54d7d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc719a3b3ac4461b82ca04ab6451d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:09:14.429533 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4d8421-4816-4a67-9501-bf79efe54d7d service placement] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:09:14.429812 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4d8421-4816-4a67-9501-bf79efe54d7d service placement] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:09:14.430134 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4d8421-4816-4a67-9501-bf79efe54d7d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:09:14.438977 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4d8421-4816-4a67-9501-bf79efe54d7d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:09:14.440590 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4d8421-4816-4a67-9501-bf79efe54d7d service placement] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:09:14.450457 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4355/8682] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:09:14 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:09:18.650854 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa515eb-8919-4a09-9a39-6e7a3d8d4cc6 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:09:18.652347 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-0aa515eb-8919-4a09-9a39-6e7a3d8d4cc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:09:18.664256 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa515eb-8919-4a09-9a39-6e7a3d8d4cc6 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:09:18.668459 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fa410b-70e8-41d6-9cfd-ade3f26aa5db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:09:18.669227 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fa410b-70e8-41d6-9cfd-ade3f26aa5db service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:09:18.669509 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fa410b-70e8-41d6-9cfd-ade3f26aa5db service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:09:18.669818 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fa410b-70e8-41d6-9cfd-ade3f26aa5db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:09:18.672125 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-52fa410b-70e8-41d6-9cfd-ade3f26aa5db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:09:18.690254 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fa410b-70e8-41d6-9cfd-ade3f26aa5db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:09:18.691878 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fa410b-70e8-41d6-9cfd-ade3f26aa5db service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:09:18.704319 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4328/8683] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:09:18 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:09:18.817186 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b127e303-c6d2-4c62-9555-c49525f25ca2 None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:09:18.817186 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b127e303-c6d2-4c62-9555-c49525f25ca2 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:09:18.817626 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b127e303-c6d2-4c62-9555-c49525f25ca2 None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:09:18.818905 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4356/8684] 10.222.0.17 () {54 vars in 921 bytes} [Sat Jul 23 22:09:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 22:09:18.823806 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c5e006-b90c-4f3f-985a-4fe5f7d2ce95 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:09:18.824095 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c5e006-b90c-4f3f-985a-4fe5f7d2ce95 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:09:18.824417 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c5e006-b90c-4f3f-985a-4fe5f7d2ce95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:09:18.843829 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-42c5e006-b90c-4f3f-985a-4fe5f7d2ce95 None None] MFA Rules not processed for user `abc719a3b3ac4461b82ca04ab6451d81`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:09:18.845049 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-42c5e006-b90c-4f3f-985a-4fe5f7d2ce95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:09:18.854319 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4329/8685] 10.222.0.17 () {58 vars in 1018 bytes} [Sat Jul 23 22:09:18 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:09:18.882635 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b127e303-c6d2-4c62-9555-c49525f25ca2 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:09:18.898781 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b127e303-c6d2-4c62-9555-c49525f25ca2 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:09:18.904656 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecaffcb-5ea3-4652-b22a-fdd49f7fdb31 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc719a3b3ac4461b82ca04ab6451d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:09:18.905295 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecaffcb-5ea3-4652-b22a-fdd49f7fdb31 service placement] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:09:18.905578 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecaffcb-5ea3-4652-b22a-fdd49f7fdb31 service placement] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:09:18.905854 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecaffcb-5ea3-4652-b22a-fdd49f7fdb31 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:09:18.914614 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecaffcb-5ea3-4652-b22a-fdd49f7fdb31 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:09:18.916225 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecaffcb-5ea3-4652-b22a-fdd49f7fdb31 service placement] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:09:18.926347 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4357/8686] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:09:18 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:09:19.100119 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c5e006-b90c-4f3f-985a-4fe5f7d2ce95 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:09:19.110535 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c5e006-b90c-4f3f-985a-4fe5f7d2ce95 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:09:19.114434 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3db51e3-ef9d-47a8-b4d5-d19c8e3c83af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:09:19.115088 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3db51e3-ef9d-47a8-b4d5-d19c8e3c83af service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:09:19.115371 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3db51e3-ef9d-47a8-b4d5-d19c8e3c83af service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:09:19.115649 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3db51e3-ef9d-47a8-b4d5-d19c8e3c83af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:09:19.117497 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-b3db51e3-ef9d-47a8-b4d5-d19c8e3c83af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:09:19.133431 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3db51e3-ef9d-47a8-b4d5-d19c8e3c83af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:09:19.134892 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3db51e3-ef9d-47a8-b4d5-d19c8e3c83af service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:09:19.148408 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4330/8687] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:09:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:09:28.922473 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=37 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:09:29.141545 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=41 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:09:59.413201 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecaffcb-5ea3-4652-b22a-fdd49f7fdb31 service placement] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:09:59.423661 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecaffcb-5ea3-4652-b22a-fdd49f7fdb31 service placement] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:09:59.428227 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb343b3-6986-4556-b9d1-5d8b270d820c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:09:59.429113 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb343b3-6986-4556-b9d1-5d8b270d820c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:09:59.429394 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb343b3-6986-4556-b9d1-5d8b270d820c admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:09:59.429663 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb343b3-6986-4556-b9d1-5d8b270d820c admin admin] PATH_INFO: `/v3/users/cfb9e87eb6734c4ea35a0fdf4cd3b397` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:09:59.430875 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb343b3-6986-4556-b9d1-5d8b270d820c admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfb9e87eb6734c4ea35a0fdf4cd3b397)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:09:59.432783 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb343b3-6986-4556-b9d1-5d8b270d820c admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:09:59.482627 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-9cb343b3-6986-4556-b9d1-5d8b270d820c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfb9e87eb6734c4ea35a0fdf4cd3b397'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:09:59.483365 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-9cb343b3-6986-4556-b9d1-5d8b270d820c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfb9e87eb6734c4ea35a0fdf4cd3b397'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:09:59.490971 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-9cb343b3-6986-4556-b9d1-5d8b270d820c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfb9e87eb6734c4ea35a0fdf4cd3b397'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:09:59.500524 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-9cb343b3-6986-4556-b9d1-5d8b270d820c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfb9e87eb6734c4ea35a0fdf4cd3b397'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:09:59.513057 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-9cb343b3-6986-4556-b9d1-5d8b270d820c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfb9e87eb6734c4ea35a0fdf4cd3b397'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:09:59.519218 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4358/8688] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 22:09:59 2022] DELETE /identity/v3/users/cfb9e87eb6734c4ea35a0fdf4cd3b397 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:09:59.700450 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3db51e3-ef9d-47a8-b4d5-d19c8e3c83af service neutron] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:09:59.713070 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3db51e3-ef9d-47a8-b4d5-d19c8e3c83af service neutron] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:09:59.771177 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18d370c-7dba-4b53-9cf6-e26ad1444999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:09:59.772076 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18d370c-7dba-4b53-9cf6-e26ad1444999 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:09:59.772358 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18d370c-7dba-4b53-9cf6-e26ad1444999 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:09:59.772629 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18d370c-7dba-4b53-9cf6-e26ad1444999 admin admin] PATH_INFO: `/v3/projects/62de2e01319a49feb262b98ca4a23a7b` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:09:59.773831 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18d370c-7dba-4b53-9cf6-e26ad1444999 admin admin] RBAC: Authorizing `identity:delete_project(project_id=62de2e01319a49feb262b98ca4a23a7b)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:09:59.775801 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18d370c-7dba-4b53-9cf6-e26ad1444999 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:09:59.833474 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-c18d370c-7dba-4b53-9cf6-e26ad1444999 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62de2e01319a49feb262b98ca4a23a7b', 'request_id': 'req-c18d370c-7dba-4b53-9cf6-e26ad1444999'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:09:59.843622 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-c18d370c-7dba-4b53-9cf6-e26ad1444999 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62de2e01319a49feb262b98ca4a23a7b', 'request_id': 'req-c18d370c-7dba-4b53-9cf6-e26ad1444999'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:09:59.850355 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-c18d370c-7dba-4b53-9cf6-e26ad1444999 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62de2e01319a49feb262b98ca4a23a7b', 'request_id': 'req-c18d370c-7dba-4b53-9cf6-e26ad1444999'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:09:59.871687 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-c18d370c-7dba-4b53-9cf6-e26ad1444999 admin admin] The token cache is being invalidate because project 62de2e01319a49feb262b98ca4a23a7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 22:09:59.872010 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-c18d370c-7dba-4b53-9cf6-e26ad1444999 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:09:59.872674 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-c18d370c-7dba-4b53-9cf6-e26ad1444999 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:09:59.874285 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4331/8689] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 22:09:59 2022] DELETE /identity/v3/projects/62de2e01319a49feb262b98ca4a23a7b => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:09:59.883710 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f572b6b-6f18-4a48-a463-3cfd3832a320 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:09:59.883996 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f572b6b-6f18-4a48-a463-3cfd3832a320 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:09:59.884271 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f572b6b-6f18-4a48-a463-3cfd3832a320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:09:59.902733 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-0f572b6b-6f18-4a48-a463-3cfd3832a320 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:09:59.903955 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-0f572b6b-6f18-4a48-a463-3cfd3832a320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:09:59.970873 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4359/8690] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:09:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:09:59.979373 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aaeaa2-2e94-4b67-8a90-4f940fb8652f None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:09:59.979655 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aaeaa2-2e94-4b67-8a90-4f940fb8652f None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:09:59.979929 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aaeaa2-2e94-4b67-8a90-4f940fb8652f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:09:59.999091 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-18aaeaa2-2e94-4b67-8a90-4f940fb8652f None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:10:00.000318 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-18aaeaa2-2e94-4b67-8a90-4f940fb8652f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:10:00.009673 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4332/8691] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:09:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 22:10:00.014630 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f572b6b-6f18-4a48-a463-3cfd3832a320 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:10:00.030130 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f572b6b-6f18-4a48-a463-3cfd3832a320 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:10:00.036385 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350b7886-9481-46d0-9b77-274860b15bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:10:00.037095 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350b7886-9481-46d0-9b77-274860b15bd0 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:10:00.037381 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350b7886-9481-46d0-9b77-274860b15bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:10:00.037678 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350b7886-9481-46d0-9b77-274860b15bd0 admin admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:10:00.038486 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350b7886-9481-46d0-9b77-274860b15bd0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 22:10:00.038793 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350b7886-9481-46d0-9b77-274860b15bd0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:10:00.040405 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350b7886-9481-46d0-9b77-274860b15bd0 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:10:00.053366 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4360/8692] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 22:10:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 22:10:00.057991 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18aaeaa2-2e94-4b67-8a90-4f940fb8652f None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:10:00.068857 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18aaeaa2-2e94-4b67-8a90-4f940fb8652f None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:10:00.074395 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803bbe82-59c6-4e84-8a5e-934bce910b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:10:00.075051 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803bbe82-59c6-4e84-8a5e-934bce910b9f admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:10:00.075329 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803bbe82-59c6-4e84-8a5e-934bce910b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:10:00.075596 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803bbe82-59c6-4e84-8a5e-934bce910b9f admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:10:00.076280 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803bbe82-59c6-4e84-8a5e-934bce910b9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:10:00.078217 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803bbe82-59c6-4e84-8a5e-934bce910b9f admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:10:00.107353 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4333/8693] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 22:10:00 2022] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 22:10:00.113053 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350b7886-9481-46d0-9b77-274860b15bd0 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:10:00.123518 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350b7886-9481-46d0-9b77-274860b15bd0 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:10:00.181263 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7483ec20-c672-438b-9209-8fdcaf5f102f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:10:00.181990 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7483ec20-c672-438b-9209-8fdcaf5f102f admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:10:00.182259 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7483ec20-c672-438b-9209-8fdcaf5f102f admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:10:00.182526 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7483ec20-c672-438b-9209-8fdcaf5f102f admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:10:00.183222 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7483ec20-c672-438b-9209-8fdcaf5f102f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:10:00.185250 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7483ec20-c672-438b-9209-8fdcaf5f102f admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:10:00.192290 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:10:00.212811 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4361/8694] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 22:10:00 2022] POST /identity/v3/users => generated 293 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 22:10:00.219551 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803bbe82-59c6-4e84-8a5e-934bce910b9f admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:10:00.232495 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803bbe82-59c6-4e84-8a5e-934bce910b9f admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:10:00.237552 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02104e88-35b2-4bc5-9985-8c7a4030c0a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:10:00.238250 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02104e88-35b2-4bc5-9985-8c7a4030c0a0 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:10:00.238498 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02104e88-35b2-4bc5-9985-8c7a4030c0a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:10:00.238789 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02104e88-35b2-4bc5-9985-8c7a4030c0a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:10:00.239537 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02104e88-35b2-4bc5-9985-8c7a4030c0a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:10:00.241135 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02104e88-35b2-4bc5-9985-8c7a4030c0a0 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:10:00.252583 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4334/8695] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 22:10:00 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 22:10:00.256895 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7483ec20-c672-438b-9209-8fdcaf5f102f admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:10:00.267634 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7483ec20-c672-438b-9209-8fdcaf5f102f admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:10:00.272448 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf14b0f1-3b41-47d9-a4b2-411c15746c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:10:00.273109 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf14b0f1-3b41-47d9-a4b2-411c15746c99 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:10:00.273385 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf14b0f1-3b41-47d9-a4b2-411c15746c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:10:00.273655 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf14b0f1-3b41-47d9-a4b2-411c15746c99 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:10:00.274436 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf14b0f1-3b41-47d9-a4b2-411c15746c99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:10:00.276015 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf14b0f1-3b41-47d9-a4b2-411c15746c99 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:10:00.286315 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4362/8696] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 22:10:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 22:10:00.290719 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02104e88-35b2-4bc5-9985-8c7a4030c0a0 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:10:00.301244 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02104e88-35b2-4bc5-9985-8c7a4030c0a0 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:10:00.306701 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea90403-05f6-4013-8d6a-dcc87ead34ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:10:00.307592 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea90403-05f6-4013-8d6a-dcc87ead34ff admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:10:00.307869 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea90403-05f6-4013-8d6a-dcc87ead34ff admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:10:00.308127 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea90403-05f6-4013-8d6a-dcc87ead34ff admin admin] PATH_INFO: `/v3/projects/ffd080cbf1b24a55b60c5035cb102a12/users/834c51a542834eebb2815f7fceeda333/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:10:00.323399 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea90403-05f6-4013-8d6a-dcc87ead34ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffd080cbf1b24a55b60c5035cb102a12, user_id=834c51a542834eebb2815f7fceeda333, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:10:00.326096 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea90403-05f6-4013-8d6a-dcc87ead34ff admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:10:00.341477 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4335/8697] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 22:10:00 2022] PUT /identity/v3/projects/ffd080cbf1b24a55b60c5035cb102a12/users/834c51a542834eebb2815f7fceeda333/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:10:00.346723 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc71752-407f-4fb4-b8f7-97f8082026c8 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:10:00.347018 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc71752-407f-4fb4-b8f7-97f8082026c8 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:10:00.347284 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc71752-407f-4fb4-b8f7-97f8082026c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:10:00.365757 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-efc71752-407f-4fb4-b8f7-97f8082026c8 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:10:00.367005 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-efc71752-407f-4fb4-b8f7-97f8082026c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:10:00.429227 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4363/8698] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:10:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:10:00.439107 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea90403-05f6-4013-8d6a-dcc87ead34ff admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:10:00.440932 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-eea90403-05f6-4013-8d6a-dcc87ead34ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:10:00.474495 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:10:00.504491 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea90403-05f6-4013-8d6a-dcc87ead34ff admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:10:00.508566 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504541db-fd01-4a9c-8219-d9d57e7563b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:10:00.509197 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504541db-fd01-4a9c-8219-d9d57e7563b2 service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:10:00.509485 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504541db-fd01-4a9c-8219-d9d57e7563b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:10:00.509757 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504541db-fd01-4a9c-8219-d9d57e7563b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:10:00.519506 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504541db-fd01-4a9c-8219-d9d57e7563b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:10:00.521047 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504541db-fd01-4a9c-8219-d9d57e7563b2 service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:10:00.530745 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4336/8699] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:10:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 23 22:10:04.625024 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1566f4c6-d06e-499c-9ae8-d9e4325d1ce9 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:10:04.625572 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1566f4c6-d06e-499c-9ae8-d9e4325d1ce9 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:10:04.625572 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1566f4c6-d06e-499c-9ae8-d9e4325d1ce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:10:04.654807 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-1566f4c6-d06e-499c-9ae8-d9e4325d1ce9 None None] MFA Rules not processed for user `834c51a542834eebb2815f7fceeda333`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:10:04.656791 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-1566f4c6-d06e-499c-9ae8-d9e4325d1ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:10:04.733963 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4364/8700] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:10:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:10:04.744857 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cd03fb-43ce-4588-9674-44017629a021 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:10:04.745392 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cd03fb-43ce-4588-9674-44017629a021 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:10:04.745392 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cd03fb-43ce-4588-9674-44017629a021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:10:04.763533 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-a3cd03fb-43ce-4588-9674-44017629a021 None None] MFA Rules not processed for user `834c51a542834eebb2815f7fceeda333`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:10:04.765402 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-a3cd03fb-43ce-4588-9674-44017629a021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:10:04.773443 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4337/8701] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:10:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:10:04.785794 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1566f4c6-d06e-499c-9ae8-d9e4325d1ce9 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:10:04.787374 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-1566f4c6-d06e-499c-9ae8-d9e4325d1ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:10:04.868697 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1566f4c6-d06e-499c-9ae8-d9e4325d1ce9 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:10:04.874223 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922f0458-22ba-4fb4-8db4-4b926089a4fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:10:04.874891 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922f0458-22ba-4fb4-8db4-4b926089a4fd service nova] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:10:04.875170 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922f0458-22ba-4fb4-8db4-4b926089a4fd service nova] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:10:04.875441 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922f0458-22ba-4fb4-8db4-4b926089a4fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:10:04.880517 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:10:04.884649 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922f0458-22ba-4fb4-8db4-4b926089a4fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:10:04.886786 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922f0458-22ba-4fb4-8db4-4b926089a4fd service nova] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:10:04.898615 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4365/8702] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:10:04 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:10:14.758078 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=17 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:10:14.894485 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=3 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:10:18.194053 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb97393-7cd5-46f5-a6bc-016666e7b8d1 None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:10:18.194558 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb97393-7cd5-46f5-a6bc-016666e7b8d1 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:10:18.194629 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb97393-7cd5-46f5-a6bc-016666e7b8d1 None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:10:18.196090 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4338/8703] 10.222.0.17 () {54 vars in 921 bytes} [Sat Jul 23 22:10:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 22:10:18.201510 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d937c13-d73d-4e37-a43f-dd05cebab2de None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:10:18.202049 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d937c13-d73d-4e37-a43f-dd05cebab2de None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:10:18.202142 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d937c13-d73d-4e37-a43f-dd05cebab2de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:10:18.234801 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-6d937c13-d73d-4e37-a43f-dd05cebab2de None None] MFA Rules not processed for user `abc719a3b3ac4461b82ca04ab6451d81`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:10:18.236028 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-6d937c13-d73d-4e37-a43f-dd05cebab2de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:10:18.300709 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4366/8704] 10.222.0.17 () {58 vars in 1018 bytes} [Sat Jul 23 22:10:18 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 22:10:18.321266 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb97393-7cd5-46f5-a6bc-016666e7b8d1 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:10:18.323394 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-ccb97393-7cd5-46f5-a6bc-016666e7b8d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:10:18.344429 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb97393-7cd5-46f5-a6bc-016666e7b8d1 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:10:18.350048 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41d0af3-4765-44e9-97d4-6f8d6c4bafd3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc719a3b3ac4461b82ca04ab6451d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:10:18.350684 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41d0af3-4765-44e9-97d4-6f8d6c4bafd3 service placement] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:10:18.350968 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41d0af3-4765-44e9-97d4-6f8d6c4bafd3 service placement] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:10:18.351243 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41d0af3-4765-44e9-97d4-6f8d6c4bafd3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:10:18.360003 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41d0af3-4765-44e9-97d4-6f8d6c4bafd3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:10:18.361588 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41d0af3-4765-44e9-97d4-6f8d6c4bafd3 service placement] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:10:18.371494 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4339/8705] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:10:18 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:10:18.620161 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d937c13-d73d-4e37-a43f-dd05cebab2de None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:10:18.634366 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d937c13-d73d-4e37-a43f-dd05cebab2de None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:10:18.640567 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edae769-2b60-4f82-bdd6-d245e310a71d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc719a3b3ac4461b82ca04ab6451d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:10:18.641409 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edae769-2b60-4f82-bdd6-d245e310a71d service placement] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:10:18.641793 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edae769-2b60-4f82-bdd6-d245e310a71d service placement] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:10:18.642203 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edae769-2b60-4f82-bdd6-d245e310a71d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:10:18.644420 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-4edae769-2b60-4f82-bdd6-d245e310a71d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:10:18.657805 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edae769-2b60-4f82-bdd6-d245e310a71d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:10:18.659428 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edae769-2b60-4f82-bdd6-d245e310a71d service placement] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:10:18.670168 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4367/8706] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:10:18 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:10:28.367551 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=6 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:10:28.665187 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=39 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:10:53.410414 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dd3af9-724f-4405-bc18-1b35247d71a0 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:10:53.411024 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dd3af9-724f-4405-bc18-1b35247d71a0 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:10:53.411024 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dd3af9-724f-4405-bc18-1b35247d71a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:10:53.430478 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-d3dd3af9-724f-4405-bc18-1b35247d71a0 None None] MFA Rules not processed for user `834c51a542834eebb2815f7fceeda333`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:10:53.431742 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-d3dd3af9-724f-4405-bc18-1b35247d71a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:10:53.438744 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4340/8707] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:10:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:11:03.425217 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=3 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:11:05.698486 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edae769-2b60-4f82-bdd6-d245e310a71d service placement] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:11:05.700232 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-4edae769-2b60-4f82-bdd6-d245e310a71d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:11:05.732101 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edae769-2b60-4f82-bdd6-d245e310a71d service placement] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:11:05.737506 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5c0bfb-6a50-4624-b350-3ab8a4a43663 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:11:05.738217 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5c0bfb-6a50-4624-b350-3ab8a4a43663 service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:11:05.738511 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5c0bfb-6a50-4624-b350-3ab8a4a43663 service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:11:05.738779 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5c0bfb-6a50-4624-b350-3ab8a4a43663 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:11:05.740795 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-8d5c0bfb-6a50-4624-b350-3ab8a4a43663 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:11:05.757705 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5c0bfb-6a50-4624-b350-3ab8a4a43663 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:11:05.759162 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5c0bfb-6a50-4624-b350-3ab8a4a43663 service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:11:05.773514 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4368/8708] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:11:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:11:06.337234 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cb4d51-795b-48fa-a52e-73df3c8d1f01 None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:11:06.337828 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cb4d51-795b-48fa-a52e-73df3c8d1f01 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:11:06.337828 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cb4d51-795b-48fa-a52e-73df3c8d1f01 None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:11:06.339409 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4341/8709] 10.222.0.17 () {54 vars in 921 bytes} [Sat Jul 23 22:11:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 22:11:06.344811 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f998db9-c4f0-4d74-8449-e4e8d9667c82 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:11:06.345202 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f998db9-c4f0-4d74-8449-e4e8d9667c82 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:11:06.345572 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f998db9-c4f0-4d74-8449-e4e8d9667c82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:11:06.364460 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-8f998db9-c4f0-4d74-8449-e4e8d9667c82 None None] MFA Rules not processed for user `abc719a3b3ac4461b82ca04ab6451d81`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:11:06.365674 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-8f998db9-c4f0-4d74-8449-e4e8d9667c82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:11:06.374765 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4369/8710] 10.222.0.17 () {58 vars in 1018 bytes} [Sat Jul 23 22:11:06 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:11:06.396250 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cb4d51-795b-48fa-a52e-73df3c8d1f01 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:11:06.412828 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cb4d51-795b-48fa-a52e-73df3c8d1f01 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:11:06.418100 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0fa13c-1a43-4a7a-a081-1120c3e3a6bf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc719a3b3ac4461b82ca04ab6451d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:11:06.418739 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0fa13c-1a43-4a7a-a081-1120c3e3a6bf service placement] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:11:06.419019 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0fa13c-1a43-4a7a-a081-1120c3e3a6bf service placement] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:11:06.419289 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0fa13c-1a43-4a7a-a081-1120c3e3a6bf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:11:06.428034 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0fa13c-1a43-4a7a-a081-1120c3e3a6bf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:11:06.429621 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0fa13c-1a43-4a7a-a081-1120c3e3a6bf service placement] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:11:06.440303 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4342/8711] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:11:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:11:16.359357 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=16 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:11:16.436001 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=6 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:11:27.549829 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5547bb37-8c78-4078-95f9-3c09ec77d1aa None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:11:27.550651 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5547bb37-8c78-4078-95f9-3c09ec77d1aa None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:11:27.550651 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5547bb37-8c78-4078-95f9-3c09ec77d1aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:11:27.601159 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-5547bb37-8c78-4078-95f9-3c09ec77d1aa None None] MFA Rules not processed for user `079f31ed2c844e67bd4e206f24b69d97`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:11:27.602445 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-5547bb37-8c78-4078-95f9-3c09ec77d1aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:11:27.618196 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4370/8712] 10.222.0.17 () {58 vars in 1059 bytes} [Sat Jul 23 22:11:27 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:11:28.807893 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe722926-509e-4901-a762-82af35e75310 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:11:28.808438 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe722926-509e-4901-a762-82af35e75310 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:11:28.808438 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe722926-509e-4901-a762-82af35e75310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:11:28.827793 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-fe722926-509e-4901-a762-82af35e75310 None None] MFA Rules not processed for user `079f31ed2c844e67bd4e206f24b69d97`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:11:28.829011 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-fe722926-509e-4901-a762-82af35e75310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:11:28.840642 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4343/8713] 10.222.0.17 () {58 vars in 1009 bytes} [Sat Jul 23 22:11:28 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:11:28.851833 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5547bb37-8c78-4078-95f9-3c09ec77d1aa None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:11:28.861756 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5547bb37-8c78-4078-95f9-3c09ec77d1aa None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:11:28.865706 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48f641b-4db4-408a-ac08-fa2a1d4f8e9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:11:28.866393 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48f641b-4db4-408a-ac08-fa2a1d4f8e9f service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:11:28.866671 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48f641b-4db4-408a-ac08-fa2a1d4f8e9f service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:11:28.866943 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48f641b-4db4-408a-ac08-fa2a1d4f8e9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:11:28.877373 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48f641b-4db4-408a-ac08-fa2a1d4f8e9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:11:28.878826 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48f641b-4db4-408a-ac08-fa2a1d4f8e9f service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:11:28.889734 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4371/8714] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:11:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:11:34.733421 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213649bd-f92a-4676-a38a-53ce36dfc20d None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:11:34.734376 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213649bd-f92a-4676-a38a-53ce36dfc20d None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:11:34.734376 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213649bd-f92a-4676-a38a-53ce36dfc20d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:11:34.787891 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-213649bd-f92a-4676-a38a-53ce36dfc20d None None] MFA Rules not processed for user `c497326ee890462e8f48b4a56f81990c`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:11:34.789175 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-213649bd-f92a-4676-a38a-53ce36dfc20d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:11:34.797051 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4344/8715] 10.222.0.42 () {58 vars in 1015 bytes} [Sat Jul 23 22:11:34 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:11:34.809539 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48f641b-4db4-408a-ac08-fa2a1d4f8e9f service neutron] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:11:34.818829 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48f641b-4db4-408a-ac08-fa2a1d4f8e9f service neutron] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:11:34.822595 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e226366f-517e-4689-863d-16f806abdd4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:11:34.823244 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e226366f-517e-4689-863d-16f806abdd4a service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:11:34.823520 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e226366f-517e-4689-863d-16f806abdd4a service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:11:34.823792 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e226366f-517e-4689-863d-16f806abdd4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:11:34.831900 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e226366f-517e-4689-863d-16f806abdd4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:11:34.833437 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e226366f-517e-4689-863d-16f806abdd4a service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:11:34.841855 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4372/8716] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:11:34 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 23 22:11:35.072184 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213649bd-f92a-4676-a38a-53ce36dfc20d None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:11:35.082701 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213649bd-f92a-4676-a38a-53ce36dfc20d None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:11:35.087307 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f8d44e-0091-4326-9ee0-b155e60bc245 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:11:35.087960 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f8d44e-0091-4326-9ee0-b155e60bc245 service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:11:35.088246 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f8d44e-0091-4326-9ee0-b155e60bc245 service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:11:35.088515 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f8d44e-0091-4326-9ee0-b155e60bc245 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:11:35.090648 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-b3f8d44e-0091-4326-9ee0-b155e60bc245 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:11:35.104014 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f8d44e-0091-4326-9ee0-b155e60bc245 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:11:35.105583 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f8d44e-0091-4326-9ee0-b155e60bc245 service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:11:35.116520 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4345/8717] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:11:35 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:11:35.527308 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e226366f-517e-4689-863d-16f806abdd4a service neutron] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:11:35.541652 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e226366f-517e-4689-863d-16f806abdd4a service neutron] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:11:35.547948 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b37c87-b899-4a01-a947-5ba36dd7335d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:11:35.548613 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b37c87-b899-4a01-a947-5ba36dd7335d service nova] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:11:35.548894 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b37c87-b899-4a01-a947-5ba36dd7335d service nova] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:11:35.549185 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b37c87-b899-4a01-a947-5ba36dd7335d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:11:35.551079 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-47b37c87-b899-4a01-a947-5ba36dd7335d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:11:35.567091 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b37c87-b899-4a01-a947-5ba36dd7335d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:11:35.568871 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b37c87-b899-4a01-a947-5ba36dd7335d service nova] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:11:35.593345 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4373/8718] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:11:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:11:45.110381 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=18 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:11:45.586615 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=27 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:11:46.801090 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f8d44e-0091-4326-9ee0-b155e60bc245 service neutron] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:11:46.844541 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f8d44e-0091-4326-9ee0-b155e60bc245 service neutron] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:11:46.849190 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d1a6a9-4276-417a-bc74-631e9e5323f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:11:46.850122 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d1a6a9-4276-417a-bc74-631e9e5323f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:11:46.850402 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d1a6a9-4276-417a-bc74-631e9e5323f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:11:46.850676 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d1a6a9-4276-417a-bc74-631e9e5323f4 admin admin] PATH_INFO: `/v3/users/834c51a542834eebb2815f7fceeda333` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:11:46.851882 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d1a6a9-4276-417a-bc74-631e9e5323f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=834c51a542834eebb2815f7fceeda333)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:11:46.854479 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d1a6a9-4276-417a-bc74-631e9e5323f4 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:11:46.904388 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-22d1a6a9-4276-417a-bc74-631e9e5323f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '834c51a542834eebb2815f7fceeda333'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:11:46.912284 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-22d1a6a9-4276-417a-bc74-631e9e5323f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '834c51a542834eebb2815f7fceeda333'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:11:46.912990 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-22d1a6a9-4276-417a-bc74-631e9e5323f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '834c51a542834eebb2815f7fceeda333'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:11:46.922452 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-22d1a6a9-4276-417a-bc74-631e9e5323f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '834c51a542834eebb2815f7fceeda333'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:11:46.934385 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-22d1a6a9-4276-417a-bc74-631e9e5323f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '834c51a542834eebb2815f7fceeda333'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:11:46.940556 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4346/8719] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 22:11:46 2022] DELETE /identity/v3/users/834c51a542834eebb2815f7fceeda333 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:11:47.123454 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b37c87-b899-4a01-a947-5ba36dd7335d service nova] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:11:47.161844 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b37c87-b899-4a01-a947-5ba36dd7335d service nova] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:11:47.218286 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f166eae9-d3b3-49c6-998e-ba63988594f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:11:47.219191 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f166eae9-d3b3-49c6-998e-ba63988594f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:11:47.219475 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f166eae9-d3b3-49c6-998e-ba63988594f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:11:47.219751 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f166eae9-d3b3-49c6-998e-ba63988594f0 admin admin] PATH_INFO: `/v3/projects/ffd080cbf1b24a55b60c5035cb102a12` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:11:47.221197 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f166eae9-d3b3-49c6-998e-ba63988594f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffd080cbf1b24a55b60c5035cb102a12)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:11:47.223154 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f166eae9-d3b3-49c6-998e-ba63988594f0 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:11:47.273938 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-f166eae9-d3b3-49c6-998e-ba63988594f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffd080cbf1b24a55b60c5035cb102a12', 'request_id': 'req-f166eae9-d3b3-49c6-998e-ba63988594f0'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:11:47.283046 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-f166eae9-d3b3-49c6-998e-ba63988594f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffd080cbf1b24a55b60c5035cb102a12', 'request_id': 'req-f166eae9-d3b3-49c6-998e-ba63988594f0'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:11:47.289631 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-f166eae9-d3b3-49c6-998e-ba63988594f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffd080cbf1b24a55b60c5035cb102a12', 'request_id': 'req-f166eae9-d3b3-49c6-998e-ba63988594f0'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:11:47.309717 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-f166eae9-d3b3-49c6-998e-ba63988594f0 admin admin] The token cache is being invalidate because project ffd080cbf1b24a55b60c5035cb102a12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 22:11:47.309919 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-f166eae9-d3b3-49c6-998e-ba63988594f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:11:47.310612 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-f166eae9-d3b3-49c6-998e-ba63988594f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:11:47.312253 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4374/8720] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 22:11:47 2022] DELETE /identity/v3/projects/ffd080cbf1b24a55b60c5035cb102a12 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:11:47.317520 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9075bfc7-4692-45f7-a49c-16617dd224b3 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:11:47.317804 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9075bfc7-4692-45f7-a49c-16617dd224b3 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:11:47.318147 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9075bfc7-4692-45f7-a49c-16617dd224b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:11:47.337107 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-9075bfc7-4692-45f7-a49c-16617dd224b3 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:11:47.338364 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-9075bfc7-4692-45f7-a49c-16617dd224b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:11:47.400677 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4347/8721] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:11:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:11:47.408862 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ed0bfb-ad01-4f25-99df-8158c65b9080 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:11:47.409146 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ed0bfb-ad01-4f25-99df-8158c65b9080 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:11:47.409421 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ed0bfb-ad01-4f25-99df-8158c65b9080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:11:47.428076 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-b8ed0bfb-ad01-4f25-99df-8158c65b9080 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:11:47.429295 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-b8ed0bfb-ad01-4f25-99df-8158c65b9080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:11:47.437580 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4375/8722] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:11:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:11:47.442014 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9075bfc7-4692-45f7-a49c-16617dd224b3 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:11:47.452475 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9075bfc7-4692-45f7-a49c-16617dd224b3 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:11:47.458851 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d44cf6-be29-40c3-a07c-7d97b48e56df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:11:47.459509 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d44cf6-be29-40c3-a07c-7d97b48e56df admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:11:47.459784 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d44cf6-be29-40c3-a07c-7d97b48e56df admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:11:47.460050 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d44cf6-be29-40c3-a07c-7d97b48e56df admin admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:11:47.460775 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d44cf6-be29-40c3-a07c-7d97b48e56df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 22:11:47.461070 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d44cf6-be29-40c3-a07c-7d97b48e56df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:11:47.462724 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d44cf6-be29-40c3-a07c-7d97b48e56df admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:11:47.475289 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4348/8723] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 22:11:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 22:11:47.479977 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ed0bfb-ad01-4f25-99df-8158c65b9080 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:11:47.489819 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ed0bfb-ad01-4f25-99df-8158c65b9080 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:11:47.495152 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dc5155-f4dd-4a3e-92b2-358a06cd245d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:11:47.495806 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dc5155-f4dd-4a3e-92b2-358a06cd245d admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:11:47.496088 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dc5155-f4dd-4a3e-92b2-358a06cd245d admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:11:47.496358 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dc5155-f4dd-4a3e-92b2-358a06cd245d admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:11:47.497053 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dc5155-f4dd-4a3e-92b2-358a06cd245d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:11:47.499025 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dc5155-f4dd-4a3e-92b2-358a06cd245d admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:11:47.529928 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4376/8724] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 22:11:47 2022] POST /identity/v3/projects => generated 379 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 22:11:47.531374 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d44cf6-be29-40c3-a07c-7d97b48e56df admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:11:47.541816 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d44cf6-be29-40c3-a07c-7d97b48e56df admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:11:47.576425 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:11:47.603938 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1948db-623f-4418-809c-1cd29f9c06da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:11:47.604621 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1948db-623f-4418-809c-1cd29f9c06da admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:11:47.604905 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1948db-623f-4418-809c-1cd29f9c06da admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:11:47.605178 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1948db-623f-4418-809c-1cd29f9c06da admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:11:47.605880 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1948db-623f-4418-809c-1cd29f9c06da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:11:47.607878 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1948db-623f-4418-809c-1cd29f9c06da admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:11:47.633561 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4349/8725] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 22:11:47 2022] POST /identity/v3/users => generated 290 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 22:11:47.639346 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dc5155-f4dd-4a3e-92b2-358a06cd245d admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:11:47.650646 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dc5155-f4dd-4a3e-92b2-358a06cd245d admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:11:47.655888 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad165c0-442b-4525-ab6a-9ecb82432418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:11:47.656531 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad165c0-442b-4525-ab6a-9ecb82432418 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:11:47.656805 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad165c0-442b-4525-ab6a-9ecb82432418 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:11:47.657076 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad165c0-442b-4525-ab6a-9ecb82432418 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:11:47.657927 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad165c0-442b-4525-ab6a-9ecb82432418 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:11:47.659521 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad165c0-442b-4525-ab6a-9ecb82432418 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:11:47.670882 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4377/8726] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 22:11:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 22:11:47.674832 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1948db-623f-4418-809c-1cd29f9c06da admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:11:47.685242 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1948db-623f-4418-809c-1cd29f9c06da admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:11:47.690451 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d56ed72-7edd-42c0-a814-7ebd8b4022d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:11:47.691111 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d56ed72-7edd-42c0-a814-7ebd8b4022d1 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:11:47.691386 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d56ed72-7edd-42c0-a814-7ebd8b4022d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:11:47.691657 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d56ed72-7edd-42c0-a814-7ebd8b4022d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:11:47.692371 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d56ed72-7edd-42c0-a814-7ebd8b4022d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:11:47.693994 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d56ed72-7edd-42c0-a814-7ebd8b4022d1 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:11:47.703976 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4350/8727] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 22:11:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 22:11:47.708470 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad165c0-442b-4525-ab6a-9ecb82432418 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:11:47.719320 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad165c0-442b-4525-ab6a-9ecb82432418 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:11:47.724663 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cc894c-d086-4817-a850-9919288c3b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:11:47.725561 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cc894c-d086-4817-a850-9919288c3b5c admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:11:47.725842 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cc894c-d086-4817-a850-9919288c3b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:11:47.726148 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cc894c-d086-4817-a850-9919288c3b5c admin admin] PATH_INFO: `/v3/projects/5ca8bc0082894aa6b90a714ddc6a6790/users/14820436f99c404b80194a1b985c76b1/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:11:47.741009 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cc894c-d086-4817-a850-9919288c3b5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ca8bc0082894aa6b90a714ddc6a6790, user_id=14820436f99c404b80194a1b985c76b1, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:11:47.743710 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cc894c-d086-4817-a850-9919288c3b5c admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:11:47.758628 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4378/8728] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 22:11:47 2022] PUT /identity/v3/projects/5ca8bc0082894aa6b90a714ddc6a6790/users/14820436f99c404b80194a1b985c76b1/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:11:47.763968 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043e6fd2-eb8b-40a8-981b-b20e3726c093 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:11:47.764253 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043e6fd2-eb8b-40a8-981b-b20e3726c093 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:11:47.764526 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043e6fd2-eb8b-40a8-981b-b20e3726c093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:11:47.783285 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-043e6fd2-eb8b-40a8-981b-b20e3726c093 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:11:47.784502 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-043e6fd2-eb8b-40a8-981b-b20e3726c093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:11:47.851517 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4351/8729] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:11:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:11:47.861551 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cc894c-d086-4817-a850-9919288c3b5c admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:11:47.863630 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-a2cc894c-d086-4817-a850-9919288c3b5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:11:47.869424 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:11:47.936102 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cc894c-d086-4817-a850-9919288c3b5c admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:11:47.940665 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aedcb38-4313-4079-92f3-0b980949acb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:11:47.941330 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aedcb38-4313-4079-92f3-0b980949acb5 service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:11:47.941614 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aedcb38-4313-4079-92f3-0b980949acb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:11:47.941894 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aedcb38-4313-4079-92f3-0b980949acb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:11:47.952048 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aedcb38-4313-4079-92f3-0b980949acb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:11:47.953467 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aedcb38-4313-4079-92f3-0b980949acb5 service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:11:47.964923 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4379/8730] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:11:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:11:52.080829 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46e5bc2-72bf-4684-a0ab-70d3afcbc20b None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:11:52.081702 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46e5bc2-72bf-4684-a0ab-70d3afcbc20b None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:11:52.082206 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46e5bc2-72bf-4684-a0ab-70d3afcbc20b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:11:52.113459 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-f46e5bc2-72bf-4684-a0ab-70d3afcbc20b None None] MFA Rules not processed for user `14820436f99c404b80194a1b985c76b1`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:11:52.118709 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-f46e5bc2-72bf-4684-a0ab-70d3afcbc20b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:11:52.203453 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4352/8731] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:11:52 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:11:52.218811 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aedcb38-4313-4079-92f3-0b980949acb5 service neutron] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:11:52.220348 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-5aedcb38-4313-4079-92f3-0b980949acb5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:11:52.299570 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aedcb38-4313-4079-92f3-0b980949acb5 service neutron] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:11:52.305090 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32767148-37bc-4a4f-a1fc-756f8c91edd2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:11:52.305769 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32767148-37bc-4a4f-a1fc-756f8c91edd2 service nova] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:11:52.306082 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32767148-37bc-4a4f-a1fc-756f8c91edd2 service nova] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:11:52.306357 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32767148-37bc-4a4f-a1fc-756f8c91edd2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:11:52.315292 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32767148-37bc-4a4f-a1fc-756f8c91edd2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:11:52.316879 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32767148-37bc-4a4f-a1fc-756f8c91edd2 service nova] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:11:52.326770 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4380/8732] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:11:52 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:11:53.712639 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9fbd3d-c233-4a9d-9786-de5a227be336 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:11:53.713162 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9fbd3d-c233-4a9d-9786-de5a227be336 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:11:53.713275 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9fbd3d-c233-4a9d-9786-de5a227be336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:11:53.732727 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-ba9fbd3d-c233-4a9d-9786-de5a227be336 None None] MFA Rules not processed for user `14820436f99c404b80194a1b985c76b1`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:11:53.734024 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-ba9fbd3d-c233-4a9d-9786-de5a227be336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:11:53.742197 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4353/8733] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:11:53 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:12:01.432775 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f3a938-409b-4d70-ad85-8edd918c150a None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:12:01.433936 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f3a938-409b-4d70-ad85-8edd918c150a None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:12:01.434470 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f3a938-409b-4d70-ad85-8edd918c150a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:12:01.462942 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-12f3a938-409b-4d70-ad85-8edd918c150a None None] MFA Rules not processed for user `079f31ed2c844e67bd4e206f24b69d97`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:12:01.464229 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-12f3a938-409b-4d70-ad85-8edd918c150a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:12:01.476414 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4381/8734] 10.222.0.17 () {58 vars in 1018 bytes} [Sat Jul 23 22:12:01 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:12:01.489400 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9fbd3d-c233-4a9d-9786-de5a227be336 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:12:01.502828 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9fbd3d-c233-4a9d-9786-de5a227be336 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:12:01.508667 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5abf67-c4e3-4198-b027-81f34e25a97c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:12:01.509447 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5abf67-c4e3-4198-b027-81f34e25a97c service nova] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:12:01.509850 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5abf67-c4e3-4198-b027-81f34e25a97c service nova] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:12:01.510300 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5abf67-c4e3-4198-b027-81f34e25a97c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:12:01.520205 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5abf67-c4e3-4198-b027-81f34e25a97c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:12:01.521811 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5abf67-c4e3-4198-b027-81f34e25a97c service nova] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:12:01.532526 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4354/8735] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:12:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:12:04.875295 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51625e92-82ac-4381-85d9-c7896467c2dc None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:12:04.875810 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51625e92-82ac-4381-85d9-c7896467c2dc None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:12:04.875911 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51625e92-82ac-4381-85d9-c7896467c2dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:12:04.894919 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-51625e92-82ac-4381-85d9-c7896467c2dc None None] MFA Rules not processed for user `079f31ed2c844e67bd4e206f24b69d97`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:12:04.896136 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-51625e92-82ac-4381-85d9-c7896467c2dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:12:04.906643 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4382/8736] 10.222.0.17 () {58 vars in 1018 bytes} [Sat Jul 23 22:12:04 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:12:04.921830 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5abf67-c4e3-4198-b027-81f34e25a97c service nova] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:12:04.933601 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5abf67-c4e3-4198-b027-81f34e25a97c service nova] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:12:04.939382 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e423dd1-6ecc-4c11-8d79-a4d44c042eea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:12:04.940030 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e423dd1-6ecc-4c11-8d79-a4d44c042eea service nova] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:12:04.940444 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e423dd1-6ecc-4c11-8d79-a4d44c042eea service nova] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:12:04.941276 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e423dd1-6ecc-4c11-8d79-a4d44c042eea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:12:04.950160 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e423dd1-6ecc-4c11-8d79-a4d44c042eea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:12:04.951917 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e423dd1-6ecc-4c11-8d79-a4d44c042eea service nova] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:12:04.963187 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4355/8737] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:12:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:12:14.889637 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=65 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:12:14.958841 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=92,keystone:INSERT=3 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:12:41.998318 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc53d6ef-3a6d-40ba-8021-ea12e9a7dbc1 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:12:41.998894 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc53d6ef-3a6d-40ba-8021-ea12e9a7dbc1 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:12:41.998894 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc53d6ef-3a6d-40ba-8021-ea12e9a7dbc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:12:42.017743 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-cc53d6ef-3a6d-40ba-8021-ea12e9a7dbc1 None None] MFA Rules not processed for user `c497326ee890462e8f48b4a56f81990c`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:12:42.019011 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-cc53d6ef-3a6d-40ba-8021-ea12e9a7dbc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:12:42.036492 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4383/8738] 10.222.0.17 () {58 vars in 1018 bytes} [Sat Jul 23 22:12:41 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:12:42.055779 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e423dd1-6ecc-4c11-8d79-a4d44c042eea service nova] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:12:42.057316 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-0e423dd1-6ecc-4c11-8d79-a4d44c042eea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:12:42.069558 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e423dd1-6ecc-4c11-8d79-a4d44c042eea service nova] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:12:42.073193 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa822db2-42a8-4c82-891c-863c1d59906a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:12:42.073840 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa822db2-42a8-4c82-891c-863c1d59906a service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:12:42.074148 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa822db2-42a8-4c82-891c-863c1d59906a service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:12:42.074448 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa822db2-42a8-4c82-891c-863c1d59906a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:12:42.082898 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa822db2-42a8-4c82-891c-863c1d59906a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:12:42.084467 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa822db2-42a8-4c82-891c-863c1d59906a service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:12:42.092821 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4356/8739] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:12:42 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:12:42.180249 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d1935b-ba5d-4ef4-9865-9f8cdb6f66ff None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:12:42.180566 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d1935b-ba5d-4ef4-9865-9f8cdb6f66ff None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:12:42.180842 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d1935b-ba5d-4ef4-9865-9f8cdb6f66ff None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:12:42.182293 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4384/8740] 10.222.0.17 () {54 vars in 921 bytes} [Sat Jul 23 22:12:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 22:12:42.188154 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b989d7-d461-496d-a66d-be83d553e1ac None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:12:42.188505 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b989d7-d461-496d-a66d-be83d553e1ac None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:12:42.188929 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b989d7-d461-496d-a66d-be83d553e1ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:12:42.245427 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-58b989d7-d461-496d-a66d-be83d553e1ac None None] MFA Rules not processed for user `abc719a3b3ac4461b82ca04ab6451d81`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:12:42.246681 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-58b989d7-d461-496d-a66d-be83d553e1ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:12:42.312561 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4357/8741] 10.222.0.17 () {58 vars in 1018 bytes} [Sat Jul 23 22:12:42 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:12:42.333216 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c6463d-d663-4e72-be49-64e3db09318b None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:12:42.333502 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c6463d-d663-4e72-be49-64e3db09318b None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:12:42.333779 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c6463d-d663-4e72-be49-64e3db09318b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:12:42.353638 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-d5c6463d-d663-4e72-be49-64e3db09318b None None] MFA Rules not processed for user `abc719a3b3ac4461b82ca04ab6451d81`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:12:42.354820 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-d5c6463d-d663-4e72-be49-64e3db09318b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:12:42.365243 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4385/8742] 10.222.0.17 () {58 vars in 1058 bytes} [Sat Jul 23 22:12:42 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:12:42.371374 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b989d7-d461-496d-a66d-be83d553e1ac None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:12:42.382187 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b989d7-d461-496d-a66d-be83d553e1ac None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:12:42.387807 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e62f0e5-0448-4b1c-86c9-bef70d7d92ab service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc719a3b3ac4461b82ca04ab6451d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:12:42.388486 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e62f0e5-0448-4b1c-86c9-bef70d7d92ab service placement] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:12:42.388758 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e62f0e5-0448-4b1c-86c9-bef70d7d92ab service placement] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:12:42.389033 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e62f0e5-0448-4b1c-86c9-bef70d7d92ab service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:12:42.397897 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e62f0e5-0448-4b1c-86c9-bef70d7d92ab service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:12:42.399568 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e62f0e5-0448-4b1c-86c9-bef70d7d92ab service placement] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:12:42.410052 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4358/8743] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:12:42 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 23 22:12:52.347945 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=10 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:12:52.405496 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=52 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:12:56.045925 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a706dc4a-0c63-43fa-bfbc-d0b7b60fac8e None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:12:56.046725 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a706dc4a-0c63-43fa-bfbc-d0b7b60fac8e None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:12:56.046725 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a706dc4a-0c63-43fa-bfbc-d0b7b60fac8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:12:56.066785 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-a706dc4a-0c63-43fa-bfbc-d0b7b60fac8e None None] MFA Rules not processed for user `c497326ee890462e8f48b4a56f81990c`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:12:56.067978 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-a706dc4a-0c63-43fa-bfbc-d0b7b60fac8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:12:56.074901 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4386/8744] 10.222.0.39 () {58 vars in 1015 bytes} [Sat Jul 23 22:12:56 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:12:56.087375 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e62f0e5-0448-4b1c-86c9-bef70d7d92ab service placement] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:12:56.097063 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e62f0e5-0448-4b1c-86c9-bef70d7d92ab service placement] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:12:56.101224 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcf21ec-d7fd-4e3a-9209-9934864996b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:12:56.101880 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcf21ec-d7fd-4e3a-9209-9934864996b5 service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:12:56.102166 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcf21ec-d7fd-4e3a-9209-9934864996b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:12:56.102432 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcf21ec-d7fd-4e3a-9209-9934864996b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:12:56.109745 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcf21ec-d7fd-4e3a-9209-9934864996b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:12:56.111236 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcf21ec-d7fd-4e3a-9209-9934864996b5 service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:12:56.119393 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4359/8745] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:12:56 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:12:56.856920 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1714f45f-6d00-4510-9ee7-219470b8db55 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:12:56.857201 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1714f45f-6d00-4510-9ee7-219470b8db55 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:12:56.857480 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1714f45f-6d00-4510-9ee7-219470b8db55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:12:56.877226 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-1714f45f-6d00-4510-9ee7-219470b8db55 None None] MFA Rules not processed for user `079f31ed2c844e67bd4e206f24b69d97`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:12:56.878487 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-1714f45f-6d00-4510-9ee7-219470b8db55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:12:56.892611 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4387/8746] 10.222.0.17 () {58 vars in 1018 bytes} [Sat Jul 23 22:12:56 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:12:56.914537 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcf21ec-d7fd-4e3a-9209-9934864996b5 service neutron] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:12:56.935419 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcf21ec-d7fd-4e3a-9209-9934864996b5 service neutron] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:12:56.942550 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451e49bf-2ecd-44df-bef2-ff009908649f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:12:56.943302 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451e49bf-2ecd-44df-bef2-ff009908649f service nova] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:12:56.943646 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451e49bf-2ecd-44df-bef2-ff009908649f service nova] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:12:56.944043 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451e49bf-2ecd-44df-bef2-ff009908649f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:12:56.972144 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451e49bf-2ecd-44df-bef2-ff009908649f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:12:56.974357 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451e49bf-2ecd-44df-bef2-ff009908649f service nova] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:12:56.988069 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4360/8747] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:12:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:13:05.671046 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af76634f-c943-461b-8f53-d3e58b00432a None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:13:05.671522 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af76634f-c943-461b-8f53-d3e58b00432a None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:13:05.671616 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af76634f-c943-461b-8f53-d3e58b00432a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:13:05.689994 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-af76634f-c943-461b-8f53-d3e58b00432a None None] MFA Rules not processed for user `14820436f99c404b80194a1b985c76b1`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:13:05.691206 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-af76634f-c943-461b-8f53-d3e58b00432a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:13:05.699755 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4388/8748] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:13:05 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:13:06.023536 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1704552f-a77a-46d8-84bb-3bc9babca16f None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:13:06.024107 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1704552f-a77a-46d8-84bb-3bc9babca16f None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:13:06.024107 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1704552f-a77a-46d8-84bb-3bc9babca16f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:13:06.044599 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-1704552f-a77a-46d8-84bb-3bc9babca16f None None] MFA Rules not processed for user `c497326ee890462e8f48b4a56f81990c`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:13:06.045808 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-1704552f-a77a-46d8-84bb-3bc9babca16f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:13:06.052982 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4361/8749] 10.222.0.17 () {58 vars in 1009 bytes} [Sat Jul 23 22:13:06 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:13:06.065259 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af76634f-c943-461b-8f53-d3e58b00432a None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:13:06.075638 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af76634f-c943-461b-8f53-d3e58b00432a None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:13:06.080069 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5f1df8-d907-402b-843b-9b30a4ede690 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:13:06.080711 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5f1df8-d907-402b-843b-9b30a4ede690 service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:13:06.080985 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5f1df8-d907-402b-843b-9b30a4ede690 service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:13:06.081254 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5f1df8-d907-402b-843b-9b30a4ede690 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:13:06.088814 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5f1df8-d907-402b-843b-9b30a4ede690 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:13:06.090279 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5f1df8-d907-402b-843b-9b30a4ede690 service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:13:06.098330 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4389/8750] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:13:06 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:13:06.433903 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1704552f-a77a-46d8-84bb-3bc9babca16f None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:13:06.435452 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-1704552f-a77a-46d8-84bb-3bc9babca16f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:13:06.450509 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1704552f-a77a-46d8-84bb-3bc9babca16f None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:13:06.455812 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7939cd35-32e9-4be0-bd99-69b96c9b03bd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc719a3b3ac4461b82ca04ab6451d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:13:06.456461 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7939cd35-32e9-4be0-bd99-69b96c9b03bd service placement] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:13:06.456740 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7939cd35-32e9-4be0-bd99-69b96c9b03bd service placement] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:13:06.457007 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7939cd35-32e9-4be0-bd99-69b96c9b03bd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:13:06.458770 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-7939cd35-32e9-4be0-bd99-69b96c9b03bd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:13:06.471726 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7939cd35-32e9-4be0-bd99-69b96c9b03bd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:13:06.473385 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7939cd35-32e9-4be0-bd99-69b96c9b03bd service placement] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:13:06.484327 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4362/8751] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:13:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:13:16.094781 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=15 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:13:16.479837 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=21 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:14:05.581479 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f2ead3-afa1-46ef-864c-fdccb6852715 None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:14:05.582144 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f2ead3-afa1-46ef-864c-fdccb6852715 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:14:05.582144 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f2ead3-afa1-46ef-864c-fdccb6852715 None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:14:05.583818 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4390/8752] 10.222.0.17 () {54 vars in 921 bytes} [Sat Jul 23 22:14:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 22:14:05.589499 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19eadb7-685b-400f-a193-e1a93b215262 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:14:05.590012 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19eadb7-685b-400f-a193-e1a93b215262 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:14:05.590111 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19eadb7-685b-400f-a193-e1a93b215262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:14:05.611189 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-a19eadb7-685b-400f-a193-e1a93b215262 None None] MFA Rules not processed for user `abc719a3b3ac4461b82ca04ab6451d81`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:14:05.612476 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-a19eadb7-685b-400f-a193-e1a93b215262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:14:05.622726 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4363/8753] 10.222.0.17 () {58 vars in 1018 bytes} [Sat Jul 23 22:14:05 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:14:05.643858 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f2ead3-afa1-46ef-864c-fdccb6852715 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:14:05.665709 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f2ead3-afa1-46ef-864c-fdccb6852715 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:14:05.671972 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a059b545-c530-4821-a7ec-571b278cff9d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc719a3b3ac4461b82ca04ab6451d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:14:05.672623 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a059b545-c530-4821-a7ec-571b278cff9d service placement] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:14:05.672901 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a059b545-c530-4821-a7ec-571b278cff9d service placement] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:14:05.673174 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a059b545-c530-4821-a7ec-571b278cff9d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:14:05.682247 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a059b545-c530-4821-a7ec-571b278cff9d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:14:05.683890 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a059b545-c530-4821-a7ec-571b278cff9d service placement] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:14:05.695191 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4391/8754] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:14:05 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:14:05.858556 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cb53af-43b6-40e2-bd6e-2517a485ccb5 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:14:05.858840 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cb53af-43b6-40e2-bd6e-2517a485ccb5 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:14:05.859109 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cb53af-43b6-40e2-bd6e-2517a485ccb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:14:05.878094 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-e1cb53af-43b6-40e2-bd6e-2517a485ccb5 None None] MFA Rules not processed for user `079f31ed2c844e67bd4e206f24b69d97`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:14:05.879301 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-e1cb53af-43b6-40e2-bd6e-2517a485ccb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:14:05.890399 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4364/8755] 10.222.0.17 () {58 vars in 1018 bytes} [Sat Jul 23 22:14:05 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:14:05.900339 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a059b545-c530-4821-a7ec-571b278cff9d service placement] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:14:05.910329 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a059b545-c530-4821-a7ec-571b278cff9d service placement] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:14:05.914321 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7bac98-e27b-4d00-a098-a3e37f58659e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:14:05.914961 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7bac98-e27b-4d00-a098-a3e37f58659e service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:14:05.915236 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7bac98-e27b-4d00-a098-a3e37f58659e service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:14:05.915510 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7bac98-e27b-4d00-a098-a3e37f58659e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:14:05.927373 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7bac98-e27b-4d00-a098-a3e37f58659e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:14:05.928804 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7bac98-e27b-4d00-a098-a3e37f58659e service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:14:05.940034 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4392/8756] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:14:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:14:11.371701 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cb53af-43b6-40e2-bd6e-2517a485ccb5 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:14:11.384636 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cb53af-43b6-40e2-bd6e-2517a485ccb5 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:14:11.391395 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4309755a-ae53-4daa-9573-a9e6252f82b0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc719a3b3ac4461b82ca04ab6451d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:14:11.391961 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4309755a-ae53-4daa-9573-a9e6252f82b0 service placement] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:14:11.392241 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4309755a-ae53-4daa-9573-a9e6252f82b0 service placement] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:14:11.392509 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4309755a-ae53-4daa-9573-a9e6252f82b0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:14:11.394580 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-4309755a-ae53-4daa-9573-a9e6252f82b0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:14:11.406807 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4309755a-ae53-4daa-9573-a9e6252f82b0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:14:11.408477 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4309755a-ae53-4daa-9573-a9e6252f82b0 service placement] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:14:11.419423 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4365/8757] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:14:11 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:14:14.135113 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7bac98-e27b-4d00-a098-a3e37f58659e service neutron] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:14:14.146692 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7bac98-e27b-4d00-a098-a3e37f58659e service neutron] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:14:14.151927 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4010622-5054-4c78-bee3-607eedfcf937 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc719a3b3ac4461b82ca04ab6451d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:14:14.152838 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4010622-5054-4c78-bee3-607eedfcf937 service placement] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:14:14.153187 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4010622-5054-4c78-bee3-607eedfcf937 service placement] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:14:14.153544 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4010622-5054-4c78-bee3-607eedfcf937 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:14:14.155567 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-b4010622-5054-4c78-bee3-607eedfcf937 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:14:14.168451 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4010622-5054-4c78-bee3-607eedfcf937 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:14:14.170074 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4010622-5054-4c78-bee3-607eedfcf937 service placement] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:14:14.180083 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4393/8758] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:14:14 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:14:20.629057 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b5796c-d915-4aec-940b-1a4b2305308f None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:14:20.629544 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b5796c-d915-4aec-940b-1a4b2305308f None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:14:20.629653 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b5796c-d915-4aec-940b-1a4b2305308f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:14:20.648568 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-50b5796c-d915-4aec-940b-1a4b2305308f None None] MFA Rules not processed for user `14820436f99c404b80194a1b985c76b1`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:14:20.649780 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-50b5796c-d915-4aec-940b-1a4b2305308f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:14:20.658168 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4366/8759] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:14:20 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:14:24.176064 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=18 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:14:30.642780 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=15 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:15:05.030572 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f451c54-c065-4687-9b18-28f20fbc9e79 None None] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:15:05.031208 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f451c54-c065-4687-9b18-28f20fbc9e79 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:15:05.031208 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f451c54-c065-4687-9b18-28f20fbc9e79 None None] PATH_INFO: `/` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:15:05.032562 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4394/8760] 10.222.0.17 () {54 vars in 921 bytes} [Sat Jul 23 22:15:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 22:15:05.038125 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c6301d-46af-46f6-97e7-3da51b9eb29e None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:15:05.038663 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c6301d-46af-46f6-97e7-3da51b9eb29e None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:15:05.038959 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c6301d-46af-46f6-97e7-3da51b9eb29e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:15:05.059840 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-39c6301d-46af-46f6-97e7-3da51b9eb29e None None] MFA Rules not processed for user `abc719a3b3ac4461b82ca04ab6451d81`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:15:05.061261 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-39c6301d-46af-46f6-97e7-3da51b9eb29e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:15:05.071971 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4367/8761] 10.222.0.17 () {58 vars in 1018 bytes} [Sat Jul 23 22:15:05 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:15:05.093685 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f451c54-c065-4687-9b18-28f20fbc9e79 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:15:05.107289 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f451c54-c065-4687-9b18-28f20fbc9e79 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:15:05.112592 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcc7e06-ab01-4a2c-b945-1adebaddfa2d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc719a3b3ac4461b82ca04ab6451d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:15:05.113329 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcc7e06-ab01-4a2c-b945-1adebaddfa2d service placement] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:15:05.113570 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcc7e06-ab01-4a2c-b945-1adebaddfa2d service placement] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:15:05.113844 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcc7e06-ab01-4a2c-b945-1adebaddfa2d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:15:05.123546 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcc7e06-ab01-4a2c-b945-1adebaddfa2d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:15:05.125117 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcc7e06-ab01-4a2c-b945-1adebaddfa2d service placement] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:15:05.135551 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4395/8762] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:15:05 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:15:15.053965 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=3 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:15:15.131716 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=6 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:15:38.155093 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6b1d91-d718-48b7-8569-1d735f0a34da None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:15:38.155645 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6b1d91-d718-48b7-8569-1d735f0a34da None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:15:38.155645 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6b1d91-d718-48b7-8569-1d735f0a34da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:15:38.174711 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-fe6b1d91-d718-48b7-8569-1d735f0a34da None None] MFA Rules not processed for user `14820436f99c404b80194a1b985c76b1`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:15:38.175912 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-fe6b1d91-d718-48b7-8569-1d735f0a34da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:15:38.183954 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4368/8763] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:15:38 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:15:48.168961 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=3 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:16:31.746995 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd1ed04-7692-4939-b2a7-53ff805b8bdd None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:16:31.747541 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd1ed04-7692-4939-b2a7-53ff805b8bdd None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:16:31.747666 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd1ed04-7692-4939-b2a7-53ff805b8bdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:16:31.768271 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-8bd1ed04-7692-4939-b2a7-53ff805b8bdd None None] MFA Rules not processed for user `abc719a3b3ac4461b82ca04ab6451d81`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:16:31.769497 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-8bd1ed04-7692-4939-b2a7-53ff805b8bdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:16:31.788185 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4396/8764] 10.222.0.17 () {58 vars in 1018 bytes} [Sat Jul 23 22:16:31 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 22:16:31.805956 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6b1d91-d718-48b7-8569-1d735f0a34da None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:16:31.826615 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd1ed04-7692-4939-b2a7-53ff805b8bdd None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:16:31.832057 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6b1d91-d718-48b7-8569-1d735f0a34da None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:16:31.837276 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bed3cba-8eb3-4409-8728-f95076260fae service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc719a3b3ac4461b82ca04ab6451d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:16:31.838161 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bed3cba-8eb3-4409-8728-f95076260fae service placement] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:16:31.838440 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bed3cba-8eb3-4409-8728-f95076260fae service placement] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:16:31.838831 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bed3cba-8eb3-4409-8728-f95076260fae service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:16:31.848222 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bed3cba-8eb3-4409-8728-f95076260fae service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:16:31.850720 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bed3cba-8eb3-4409-8728-f95076260fae service placement] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:16:31.857112 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd1ed04-7692-4939-b2a7-53ff805b8bdd None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:16:31.860835 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4369/8765] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:16:31 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:16:31.862358 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4afc94d-c690-4ffe-ada6-c83c5274854d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:16:31.863413 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4afc94d-c690-4ffe-ada6-c83c5274854d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:16:31.863783 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4afc94d-c690-4ffe-ada6-c83c5274854d admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:16:31.864108 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4afc94d-c690-4ffe-ada6-c83c5274854d admin admin] PATH_INFO: `/v3/users/14820436f99c404b80194a1b985c76b1` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:16:31.865388 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4afc94d-c690-4ffe-ada6-c83c5274854d admin admin] RBAC: Authorizing `identity:delete_user(user_id=14820436f99c404b80194a1b985c76b1)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:16:31.867416 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4afc94d-c690-4ffe-ada6-c83c5274854d admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:16:31.917255 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-f4afc94d-c690-4ffe-ada6-c83c5274854d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14820436f99c404b80194a1b985c76b1'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:16:31.918000 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-f4afc94d-c690-4ffe-ada6-c83c5274854d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14820436f99c404b80194a1b985c76b1'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:16:31.924966 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-f4afc94d-c690-4ffe-ada6-c83c5274854d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14820436f99c404b80194a1b985c76b1'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:16:31.933430 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-f4afc94d-c690-4ffe-ada6-c83c5274854d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14820436f99c404b80194a1b985c76b1'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:16:31.946124 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-f4afc94d-c690-4ffe-ada6-c83c5274854d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14820436f99c404b80194a1b985c76b1'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:16:31.952516 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4397/8766] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 22:16:31 2022] DELETE /identity/v3/users/14820436f99c404b80194a1b985c76b1 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 22:16:32.135674 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bed3cba-8eb3-4409-8728-f95076260fae service placement] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:16:32.147262 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bed3cba-8eb3-4409-8728-f95076260fae service placement] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:16:32.205188 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f96487-241d-48b4-875f-6c4d77c460a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:16:32.206110 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f96487-241d-48b4-875f-6c4d77c460a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:16:32.206391 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f96487-241d-48b4-875f-6c4d77c460a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:16:32.206665 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f96487-241d-48b4-875f-6c4d77c460a1 admin admin] PATH_INFO: `/v3/projects/5ca8bc0082894aa6b90a714ddc6a6790` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:16:32.207846 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f96487-241d-48b4-875f-6c4d77c460a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ca8bc0082894aa6b90a714ddc6a6790)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:16:32.209779 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f96487-241d-48b4-875f-6c4d77c460a1 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:16:32.258428 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-e7f96487-241d-48b4-875f-6c4d77c460a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ca8bc0082894aa6b90a714ddc6a6790', 'request_id': 'req-e7f96487-241d-48b4-875f-6c4d77c460a1'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:16:32.266728 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-e7f96487-241d-48b4-875f-6c4d77c460a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ca8bc0082894aa6b90a714ddc6a6790', 'request_id': 'req-e7f96487-241d-48b4-875f-6c4d77c460a1'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:16:32.272489 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-e7f96487-241d-48b4-875f-6c4d77c460a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ca8bc0082894aa6b90a714ddc6a6790', 'request_id': 'req-e7f96487-241d-48b4-875f-6c4d77c460a1'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:16:32.284367 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-e7f96487-241d-48b4-875f-6c4d77c460a1 admin admin] The token cache is being invalidate because project 5ca8bc0082894aa6b90a714ddc6a6790 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 22:16:32.284652 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-e7f96487-241d-48b4-875f-6c4d77c460a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:16:32.285295 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-e7f96487-241d-48b4-875f-6c4d77c460a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:16:32.286915 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4370/8767] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 22:16:32 2022] DELETE /identity/v3/projects/5ca8bc0082894aa6b90a714ddc6a6790 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:16:32.292004 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc0f3c9-c0a0-4277-8cb3-da9b24358033 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:16:32.292291 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc0f3c9-c0a0-4277-8cb3-da9b24358033 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:16:32.292564 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc0f3c9-c0a0-4277-8cb3-da9b24358033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:16:32.311303 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-ddc0f3c9-c0a0-4277-8cb3-da9b24358033 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:16:32.313136 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-ddc0f3c9-c0a0-4277-8cb3-da9b24358033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:16:32.377203 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4398/8768] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:16:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:16:32.386051 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db62626-b89c-4cca-90bc-ca76a305713d None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:16:32.386337 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db62626-b89c-4cca-90bc-ca76a305713d None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:16:32.386612 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db62626-b89c-4cca-90bc-ca76a305713d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:16:32.406301 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-4db62626-b89c-4cca-90bc-ca76a305713d None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:16:32.407498 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-4db62626-b89c-4cca-90bc-ca76a305713d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:16:32.418381 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4371/8769] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:16:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:16:32.424388 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc0f3c9-c0a0-4277-8cb3-da9b24358033 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:16:32.435517 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc0f3c9-c0a0-4277-8cb3-da9b24358033 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:16:32.441139 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c388f1-251a-4e71-b1b2-c181a4fd1d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:16:32.441797 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c388f1-251a-4e71-b1b2-c181a4fd1d38 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:16:32.442102 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c388f1-251a-4e71-b1b2-c181a4fd1d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:16:32.442363 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c388f1-251a-4e71-b1b2-c181a4fd1d38 admin admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:16:32.443120 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c388f1-251a-4e71-b1b2-c181a4fd1d38 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 22:16:32.443416 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c388f1-251a-4e71-b1b2-c181a4fd1d38 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:16:32.445003 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c388f1-251a-4e71-b1b2-c181a4fd1d38 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:16:32.457140 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4399/8770] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 22:16:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 22:16:32.461440 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db62626-b89c-4cca-90bc-ca76a305713d None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:16:32.470991 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db62626-b89c-4cca-90bc-ca76a305713d None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:16:32.476523 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5227ef-5c8d-468f-83fc-5c62b594bca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:16:32.477179 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5227ef-5c8d-468f-83fc-5c62b594bca8 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:16:32.477456 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5227ef-5c8d-468f-83fc-5c62b594bca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:16:32.477722 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5227ef-5c8d-468f-83fc-5c62b594bca8 admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:16:32.478453 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5227ef-5c8d-468f-83fc-5c62b594bca8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:16:32.480389 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5227ef-5c8d-468f-83fc-5c62b594bca8 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:16:32.509954 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4372/8771] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 22:16:32 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 22:16:32.514431 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c388f1-251a-4e71-b1b2-c181a4fd1d38 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:16:32.525084 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c388f1-251a-4e71-b1b2-c181a4fd1d38 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:16:32.558641 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:16:32.586176 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff604b64-a31a-4db6-99b4-76bfcf899447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:16:32.586849 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff604b64-a31a-4db6-99b4-76bfcf899447 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:16:32.587128 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff604b64-a31a-4db6-99b4-76bfcf899447 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:16:32.587397 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff604b64-a31a-4db6-99b4-76bfcf899447 admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:16:32.588073 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff604b64-a31a-4db6-99b4-76bfcf899447 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:16:32.590013 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff604b64-a31a-4db6-99b4-76bfcf899447 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:16:32.611244 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4400/8772] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 22:16:32 2022] POST /identity/v3/users => generated 292 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 22:16:32.615828 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5227ef-5c8d-468f-83fc-5c62b594bca8 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:16:32.626425 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5227ef-5c8d-468f-83fc-5c62b594bca8 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:16:32.630989 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019e7d33-3e40-4ad1-bba7-744d4089816f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:16:32.631587 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019e7d33-3e40-4ad1-bba7-744d4089816f admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:16:32.631863 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019e7d33-3e40-4ad1-bba7-744d4089816f admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:16:32.632133 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019e7d33-3e40-4ad1-bba7-744d4089816f admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:16:32.632853 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019e7d33-3e40-4ad1-bba7-744d4089816f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:16:32.634484 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019e7d33-3e40-4ad1-bba7-744d4089816f admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:16:32.646185 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4373/8773] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 22:16:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 22:16:32.650305 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff604b64-a31a-4db6-99b4-76bfcf899447 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:16:32.660834 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff604b64-a31a-4db6-99b4-76bfcf899447 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:16:32.666649 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdd5045-a020-4a9e-ac11-2543fc52ff79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:16:32.667314 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdd5045-a020-4a9e-ac11-2543fc52ff79 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:16:32.667596 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdd5045-a020-4a9e-ac11-2543fc52ff79 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:16:32.667872 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdd5045-a020-4a9e-ac11-2543fc52ff79 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:16:32.668599 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdd5045-a020-4a9e-ac11-2543fc52ff79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:16:32.670409 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdd5045-a020-4a9e-ac11-2543fc52ff79 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:16:32.680514 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4401/8774] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 22:16:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 22:16:32.685048 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019e7d33-3e40-4ad1-bba7-744d4089816f admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:16:32.695494 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019e7d33-3e40-4ad1-bba7-744d4089816f admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:16:32.701326 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad66249-ad62-41a8-828c-ad80b9fb1c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:16:32.702278 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad66249-ad62-41a8-828c-ad80b9fb1c6c admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:16:32.702560 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad66249-ad62-41a8-828c-ad80b9fb1c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:16:32.702834 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad66249-ad62-41a8-828c-ad80b9fb1c6c admin admin] PATH_INFO: `/v3/projects/c9d7e3d863d84f04b2396946162934bf/users/9a11c0f61b4b45498c79dae845c4b3ce/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:16:32.717746 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad66249-ad62-41a8-828c-ad80b9fb1c6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9d7e3d863d84f04b2396946162934bf, user_id=9a11c0f61b4b45498c79dae845c4b3ce, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:16:32.720443 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad66249-ad62-41a8-828c-ad80b9fb1c6c admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:16:32.735715 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4374/8775] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 22:16:32 2022] PUT /identity/v3/projects/c9d7e3d863d84f04b2396946162934bf/users/9a11c0f61b4b45498c79dae845c4b3ce/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:16:32.740938 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349c2d33-27e5-49f1-86ff-ec31a49dcd19 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:16:32.741224 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349c2d33-27e5-49f1-86ff-ec31a49dcd19 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:16:32.741498 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349c2d33-27e5-49f1-86ff-ec31a49dcd19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:16:32.760088 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-349c2d33-27e5-49f1-86ff-ec31a49dcd19 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:16:32.761296 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-349c2d33-27e5-49f1-86ff-ec31a49dcd19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:16:32.823283 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4402/8776] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:16:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:16:32.833668 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad66249-ad62-41a8-828c-ad80b9fb1c6c admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:16:32.835521 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-dad66249-ad62-41a8-828c-ad80b9fb1c6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:16:32.854502 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:16:32.910293 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad66249-ad62-41a8-828c-ad80b9fb1c6c admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:16:32.914318 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be85bbd-9b7a-46fc-be30-d9af64f022e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:16:32.914978 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be85bbd-9b7a-46fc-be30-d9af64f022e1 service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:16:32.915261 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be85bbd-9b7a-46fc-be30-d9af64f022e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:16:32.915535 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be85bbd-9b7a-46fc-be30-d9af64f022e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:16:32.925106 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be85bbd-9b7a-46fc-be30-d9af64f022e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:16:32.926587 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be85bbd-9b7a-46fc-be30-d9af64f022e1 service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:16:32.936897 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4375/8777] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:16:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:16:37.244393 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083b41f0-706d-4333-98e0-ab2c650c59f1 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:16:37.245286 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083b41f0-706d-4333-98e0-ab2c650c59f1 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:16:37.245707 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083b41f0-706d-4333-98e0-ab2c650c59f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:16:37.274574 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-083b41f0-706d-4333-98e0-ab2c650c59f1 None None] MFA Rules not processed for user `9a11c0f61b4b45498c79dae845c4b3ce`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:16:37.275829 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-083b41f0-706d-4333-98e0-ab2c650c59f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:16:37.347192 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4403/8778] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:16:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:16:37.415740 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f61f74-688c-4048-a92a-adcb78d950c2 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:16:37.416351 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f61f74-688c-4048-a92a-adcb78d950c2 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:16:37.416351 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f61f74-688c-4048-a92a-adcb78d950c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:16:37.434943 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-48f61f74-688c-4048-a92a-adcb78d950c2 None None] MFA Rules not processed for user `9a11c0f61b4b45498c79dae845c4b3ce`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:16:37.436165 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-48f61f74-688c-4048-a92a-adcb78d950c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:16:37.443425 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4376/8779] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:16:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:16:37.456243 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083b41f0-706d-4333-98e0-ab2c650c59f1 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:16:37.457942 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-083b41f0-706d-4333-98e0-ab2c650c59f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:16:37.509453 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:16:37.566672 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083b41f0-706d-4333-98e0-ab2c650c59f1 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:16:37.572110 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d868bc2b-6863-4e76-9461-378acada5fa3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:16:37.572764 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d868bc2b-6863-4e76-9461-378acada5fa3 service nova] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:16:37.573046 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d868bc2b-6863-4e76-9461-378acada5fa3 service nova] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:16:37.573330 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d868bc2b-6863-4e76-9461-378acada5fa3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:16:37.581663 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d868bc2b-6863-4e76-9461-378acada5fa3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:16:37.583296 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d868bc2b-6863-4e76-9461-378acada5fa3 service nova] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:16:37.592210 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4404/8780] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:16:37 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:16:37.634338 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19447bc1-5c6f-4cd1-bc42-c80769516187 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:16:37.634616 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19447bc1-5c6f-4cd1-bc42-c80769516187 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:16:37.634878 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19447bc1-5c6f-4cd1-bc42-c80769516187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:16:37.654642 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-19447bc1-5c6f-4cd1-bc42-c80769516187 None None] MFA Rules not processed for user `f7f2db148c8e4d5d81431cae3576434b`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:16:37.655843 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-19447bc1-5c6f-4cd1-bc42-c80769516187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:16:37.719187 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4377/8781] 10.222.0.17 () {58 vars in 1063 bytes} [Sat Jul 23 22:16:37 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:16:37.725515 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d868bc2b-6863-4e76-9461-378acada5fa3 service nova] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:16:37.735210 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d868bc2b-6863-4e76-9461-378acada5fa3 service nova] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:16:37.739040 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcf3eca-d2a6-47ee-9626-23b9677e42f1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7f2db148c8e4d5d81431cae3576434b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:16:37.739644 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcf3eca-d2a6-47ee-9626-23b9677e42f1 service glance] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:16:37.739921 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcf3eca-d2a6-47ee-9626-23b9677e42f1 service glance] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:16:37.740202 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcf3eca-d2a6-47ee-9626-23b9677e42f1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:16:37.742204 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-5dcf3eca-d2a6-47ee-9626-23b9677e42f1 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:16:37.755685 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcf3eca-d2a6-47ee-9626-23b9677e42f1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:16:37.757144 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcf3eca-d2a6-47ee-9626-23b9677e42f1 service glance] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:16:37.768106 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4405/8782] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:16:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:16:38.333454 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19447bc1-5c6f-4cd1-bc42-c80769516187 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:16:38.335134 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-19447bc1-5c6f-4cd1-bc42-c80769516187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:16:38.425090 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19447bc1-5c6f-4cd1-bc42-c80769516187 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:16:38.430326 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8787cd-737a-4cec-8777-554ef57a1517 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc719a3b3ac4461b82ca04ab6451d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:16:38.431082 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8787cd-737a-4cec-8777-554ef57a1517 service placement] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:16:38.431309 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8787cd-737a-4cec-8777-554ef57a1517 service placement] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:16:38.431599 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8787cd-737a-4cec-8777-554ef57a1517 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:16:38.433433 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-aa8787cd-737a-4cec-8777-554ef57a1517 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:16:38.446269 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8787cd-737a-4cec-8777-554ef57a1517 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:16:38.447887 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8787cd-737a-4cec-8777-554ef57a1517 service placement] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:16:38.459698 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4378/8783] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:16:38 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:16:40.291339 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcf3eca-d2a6-47ee-9626-23b9677e42f1 service glance] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:16:40.293632 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-5dcf3eca-d2a6-47ee-9626-23b9677e42f1 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:16:40.306483 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcf3eca-d2a6-47ee-9626-23b9677e42f1 service glance] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:16:40.311345 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76382a0f-0d6d-4080-b372-aa38c15a86b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:16:40.312172 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76382a0f-0d6d-4080-b372-aa38c15a86b4 service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:16:40.312576 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76382a0f-0d6d-4080-b372-aa38c15a86b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:16:40.312939 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76382a0f-0d6d-4080-b372-aa38c15a86b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:16:40.314907 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-76382a0f-0d6d-4080-b372-aa38c15a86b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:16:40.326355 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76382a0f-0d6d-4080-b372-aa38c15a86b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:16:40.327994 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76382a0f-0d6d-4080-b372-aa38c15a86b4 service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:16:40.337467 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4406/8784] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:16:40 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 23 22:16:48.457939 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=87 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:16:49.041679 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979644f3-705c-48c9-ad1f-b77f60a8f051 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:16:49.041928 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979644f3-705c-48c9-ad1f-b77f60a8f051 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:16:49.042208 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979644f3-705c-48c9-ad1f-b77f60a8f051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:16:49.061236 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-979644f3-705c-48c9-ad1f-b77f60a8f051 None None] MFA Rules not processed for user `9a11c0f61b4b45498c79dae845c4b3ce`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:16:49.062494 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-979644f3-705c-48c9-ad1f-b77f60a8f051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:16:49.071019 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4379/8785] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:16:49 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:16:50.333327 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=38 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:16:59.055394 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=3 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:17:09.413661 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a515763c-bd78-485f-a767-e4fa99f1ffaa None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:17:09.414717 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a515763c-bd78-485f-a767-e4fa99f1ffaa None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:17:09.415185 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a515763c-bd78-485f-a767-e4fa99f1ffaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:17:09.437734 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-a515763c-bd78-485f-a767-e4fa99f1ffaa None None] MFA Rules not processed for user `abc719a3b3ac4461b82ca04ab6451d81`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:17:09.439070 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-a515763c-bd78-485f-a767-e4fa99f1ffaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:17:09.449562 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4407/8786] 10.222.0.17 () {58 vars in 1018 bytes} [Sat Jul 23 22:17:09 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 22:17:09.463641 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979644f3-705c-48c9-ad1f-b77f60a8f051 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:17:09.465052 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-979644f3-705c-48c9-ad1f-b77f60a8f051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:17:09.481599 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a515763c-bd78-485f-a767-e4fa99f1ffaa None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:17:09.482625 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979644f3-705c-48c9-ad1f-b77f60a8f051 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:17:09.494211 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f880ec64-8501-42f5-b1d0-de7ba7adbaf0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc719a3b3ac4461b82ca04ab6451d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:17:09.494211 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f880ec64-8501-42f5-b1d0-de7ba7adbaf0 service placement] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:17:09.494211 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f880ec64-8501-42f5-b1d0-de7ba7adbaf0 service placement] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:17:09.494211 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f880ec64-8501-42f5-b1d0-de7ba7adbaf0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:17:09.501972 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f880ec64-8501-42f5-b1d0-de7ba7adbaf0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:17:09.502154 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a515763c-bd78-485f-a767-e4fa99f1ffaa None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:17:09.502981 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f880ec64-8501-42f5-b1d0-de7ba7adbaf0 service placement] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:17:09.507062 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e735d9-24d1-4094-8f7a-9802901d29dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:17:09.508080 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e735d9-24d1-4094-8f7a-9802901d29dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:17:09.508353 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e735d9-24d1-4094-8f7a-9802901d29dc admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:17:09.509113 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e735d9-24d1-4094-8f7a-9802901d29dc admin admin] PATH_INFO: `/v3/users/9a11c0f61b4b45498c79dae845c4b3ce` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:17:09.510215 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e735d9-24d1-4094-8f7a-9802901d29dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a11c0f61b4b45498c79dae845c4b3ce)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:17:09.512160 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e735d9-24d1-4094-8f7a-9802901d29dc admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:17:09.513661 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4380/8787] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:17:09 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:17:09.562949 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-48e735d9-24d1-4094-8f7a-9802901d29dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a11c0f61b4b45498c79dae845c4b3ce'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:17:09.563636 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-48e735d9-24d1-4094-8f7a-9802901d29dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a11c0f61b4b45498c79dae845c4b3ce'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:17:09.570650 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-48e735d9-24d1-4094-8f7a-9802901d29dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a11c0f61b4b45498c79dae845c4b3ce'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:17:09.580044 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-48e735d9-24d1-4094-8f7a-9802901d29dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a11c0f61b4b45498c79dae845c4b3ce'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:17:09.592566 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-48e735d9-24d1-4094-8f7a-9802901d29dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a11c0f61b4b45498c79dae845c4b3ce'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:17:09.598882 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4408/8788] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 22:17:09 2022] DELETE /identity/v3/users/9a11c0f61b4b45498c79dae845c4b3ce => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 22:17:09.780945 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f880ec64-8501-42f5-b1d0-de7ba7adbaf0 service placement] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:17:09.792698 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f880ec64-8501-42f5-b1d0-de7ba7adbaf0 service placement] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:17:09.849489 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efdf491-a981-4a0c-9bfb-6107710a9c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:17:09.850399 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efdf491-a981-4a0c-9bfb-6107710a9c97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:17:09.850679 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efdf491-a981-4a0c-9bfb-6107710a9c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:17:09.850952 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efdf491-a981-4a0c-9bfb-6107710a9c97 admin admin] PATH_INFO: `/v3/projects/c9d7e3d863d84f04b2396946162934bf` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:17:09.852127 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efdf491-a981-4a0c-9bfb-6107710a9c97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9d7e3d863d84f04b2396946162934bf)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:17:09.854091 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efdf491-a981-4a0c-9bfb-6107710a9c97 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:17:09.909788 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-9efdf491-a981-4a0c-9bfb-6107710a9c97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9d7e3d863d84f04b2396946162934bf', 'request_id': 'req-9efdf491-a981-4a0c-9bfb-6107710a9c97'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:17:09.918948 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-9efdf491-a981-4a0c-9bfb-6107710a9c97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9d7e3d863d84f04b2396946162934bf', 'request_id': 'req-9efdf491-a981-4a0c-9bfb-6107710a9c97'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:17:09.924776 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-9efdf491-a981-4a0c-9bfb-6107710a9c97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9d7e3d863d84f04b2396946162934bf', 'request_id': 'req-9efdf491-a981-4a0c-9bfb-6107710a9c97'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:17:09.936210 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-9efdf491-a981-4a0c-9bfb-6107710a9c97 admin admin] The token cache is being invalidate because project c9d7e3d863d84f04b2396946162934bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 22:17:09.936477 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-9efdf491-a981-4a0c-9bfb-6107710a9c97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:17:09.937137 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-9efdf491-a981-4a0c-9bfb-6107710a9c97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:17:09.938846 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4381/8789] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 22:17:09 2022] DELETE /identity/v3/projects/c9d7e3d863d84f04b2396946162934bf => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:17:09.944091 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea4218b-6fd3-40fc-aa95-583dc6d5cc26 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:17:09.944404 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea4218b-6fd3-40fc-aa95-583dc6d5cc26 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:17:09.944704 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea4218b-6fd3-40fc-aa95-583dc6d5cc26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:17:09.964406 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-bea4218b-6fd3-40fc-aa95-583dc6d5cc26 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:17:09.965541 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-bea4218b-6fd3-40fc-aa95-583dc6d5cc26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:17:10.029698 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4409/8790] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:17:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:17:10.038565 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea07d91-c695-44d8-91c9-63e1ec5c3a27 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:17:10.038918 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea07d91-c695-44d8-91c9-63e1ec5c3a27 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:17:10.039221 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea07d91-c695-44d8-91c9-63e1ec5c3a27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:17:10.059638 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-dea07d91-c695-44d8-91c9-63e1ec5c3a27 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:17:10.060908 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-dea07d91-c695-44d8-91c9-63e1ec5c3a27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:17:10.069500 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4382/8791] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:17:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:17:10.074600 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea4218b-6fd3-40fc-aa95-583dc6d5cc26 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:17:10.090085 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea4218b-6fd3-40fc-aa95-583dc6d5cc26 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:17:10.091004 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af57044-b4a2-4c66-9f58-119c1b0fb001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:17:10.091675 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af57044-b4a2-4c66-9f58-119c1b0fb001 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:17:10.091956 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af57044-b4a2-4c66-9f58-119c1b0fb001 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:17:10.092231 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af57044-b4a2-4c66-9f58-119c1b0fb001 admin admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:17:10.092964 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af57044-b4a2-4c66-9f58-119c1b0fb001 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 22:17:10.093262 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af57044-b4a2-4c66-9f58-119c1b0fb001 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:17:10.094901 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af57044-b4a2-4c66-9f58-119c1b0fb001 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:17:10.107368 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4410/8792] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 22:17:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 22:17:10.112221 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea07d91-c695-44d8-91c9-63e1ec5c3a27 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:17:10.121907 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea07d91-c695-44d8-91c9-63e1ec5c3a27 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:17:10.126989 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2a3c99-d8fc-4f09-a99b-a34f9a1a9c82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:17:10.127660 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2a3c99-d8fc-4f09-a99b-a34f9a1a9c82 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:17:10.127938 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2a3c99-d8fc-4f09-a99b-a34f9a1a9c82 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:17:10.128435 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2a3c99-d8fc-4f09-a99b-a34f9a1a9c82 admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:17:10.129197 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2a3c99-d8fc-4f09-a99b-a34f9a1a9c82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:17:10.131340 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2a3c99-d8fc-4f09-a99b-a34f9a1a9c82 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:17:10.161219 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4383/8793] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 22:17:10 2022] POST /identity/v3/projects => generated 369 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 22:17:10.162829 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af57044-b4a2-4c66-9f58-119c1b0fb001 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:17:10.174126 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af57044-b4a2-4c66-9f58-119c1b0fb001 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:17:10.223086 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:17:10.233928 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db6ca29-0fff-451a-91e4-bdf76fb635d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:17:10.234833 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db6ca29-0fff-451a-91e4-bdf76fb635d0 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:17:10.235382 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db6ca29-0fff-451a-91e4-bdf76fb635d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:17:10.235717 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db6ca29-0fff-451a-91e4-bdf76fb635d0 admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:17:10.236706 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db6ca29-0fff-451a-91e4-bdf76fb635d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:17:10.238695 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db6ca29-0fff-451a-91e4-bdf76fb635d0 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:17:10.260531 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4411/8794] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 22:17:10 2022] POST /identity/v3/users => generated 285 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 23 22:17:10.264796 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2a3c99-d8fc-4f09-a99b-a34f9a1a9c82 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:17:10.275680 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2a3c99-d8fc-4f09-a99b-a34f9a1a9c82 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:17:10.280415 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8efd34e-3d83-4070-8d17-781d99f2bdc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:17:10.281042 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8efd34e-3d83-4070-8d17-781d99f2bdc3 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:17:10.281332 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8efd34e-3d83-4070-8d17-781d99f2bdc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:17:10.281605 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8efd34e-3d83-4070-8d17-781d99f2bdc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:17:10.282514 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8efd34e-3d83-4070-8d17-781d99f2bdc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:17:10.284120 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8efd34e-3d83-4070-8d17-781d99f2bdc3 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:17:10.294828 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4384/8795] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 22:17:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 22:17:10.299399 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db6ca29-0fff-451a-91e4-bdf76fb635d0 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:17:10.312467 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db6ca29-0fff-451a-91e4-bdf76fb635d0 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:17:10.320745 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609e2801-375b-422e-8929-b032ba484dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:17:10.321733 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609e2801-375b-422e-8929-b032ba484dab admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:17:10.322101 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609e2801-375b-422e-8929-b032ba484dab admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:17:10.322457 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609e2801-375b-422e-8929-b032ba484dab admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:17:10.323776 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609e2801-375b-422e-8929-b032ba484dab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:17:10.326176 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609e2801-375b-422e-8929-b032ba484dab admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:17:10.337978 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4412/8796] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 22:17:10 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 22:17:10.342239 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8efd34e-3d83-4070-8d17-781d99f2bdc3 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:17:10.353102 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8efd34e-3d83-4070-8d17-781d99f2bdc3 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:17:10.358808 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499828da-870b-4ce5-aba0-37155ad8ff75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:17:10.359696 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499828da-870b-4ce5-aba0-37155ad8ff75 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:17:10.359975 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499828da-870b-4ce5-aba0-37155ad8ff75 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:17:10.360222 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499828da-870b-4ce5-aba0-37155ad8ff75 admin admin] PATH_INFO: `/v3/projects/dc2e3ec479214dd1a8d010e06744f5ad/users/a9ac514ac3c44de09a562b4ac7ef914d/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:17:10.375969 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499828da-870b-4ce5-aba0-37155ad8ff75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc2e3ec479214dd1a8d010e06744f5ad, user_id=a9ac514ac3c44de09a562b4ac7ef914d, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:17:10.378718 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499828da-870b-4ce5-aba0-37155ad8ff75 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:17:10.394225 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4385/8797] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 22:17:10 2022] PUT /identity/v3/projects/dc2e3ec479214dd1a8d010e06744f5ad/users/a9ac514ac3c44de09a562b4ac7ef914d/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:17:10.404756 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24746d45-1853-4cd1-8188-bbe15aacc3b3 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:17:10.405046 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24746d45-1853-4cd1-8188-bbe15aacc3b3 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:17:10.405321 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24746d45-1853-4cd1-8188-bbe15aacc3b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:17:10.433615 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-24746d45-1853-4cd1-8188-bbe15aacc3b3 None None] MFA Rules not processed for user `a9ac514ac3c44de09a562b4ac7ef914d`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:17:10.434878 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-24746d45-1853-4cd1-8188-bbe15aacc3b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:17:10.499959 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4413/8798] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:17:10 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:17:10.510549 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499828da-870b-4ce5-aba0-37155ad8ff75 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:17:10.512355 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-499828da-870b-4ce5-aba0-37155ad8ff75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:17:10.527228 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:17:10.577736 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499828da-870b-4ce5-aba0-37155ad8ff75 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:17:10.582227 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af7c1c4-f019-48a6-9a71-fb747d31e14d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:17:10.582884 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af7c1c4-f019-48a6-9a71-fb747d31e14d service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:17:10.583136 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af7c1c4-f019-48a6-9a71-fb747d31e14d service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:17:10.583406 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af7c1c4-f019-48a6-9a71-fb747d31e14d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:17:10.592713 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af7c1c4-f019-48a6-9a71-fb747d31e14d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:17:10.594201 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af7c1c4-f019-48a6-9a71-fb747d31e14d service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:17:10.603417 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4386/8799] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:17:10 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:17:20.496833 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=42,keystone:INSERT=3 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:17:20.599244 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=20 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:17:22.435855 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24746d45-1853-4cd1-8188-bbe15aacc3b3 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:17:22.515619 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24746d45-1853-4cd1-8188-bbe15aacc3b3 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:17:22.520096 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276cd119-8601-43bd-80db-e61531a99a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:17:22.520993 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276cd119-8601-43bd-80db-e61531a99a86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:17:22.521273 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276cd119-8601-43bd-80db-e61531a99a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:17:22.521544 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276cd119-8601-43bd-80db-e61531a99a86 admin admin] PATH_INFO: `/v3/users/a9ac514ac3c44de09a562b4ac7ef914d` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:17:22.522766 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276cd119-8601-43bd-80db-e61531a99a86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9ac514ac3c44de09a562b4ac7ef914d)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:17:22.524703 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276cd119-8601-43bd-80db-e61531a99a86 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:17:22.575291 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-276cd119-8601-43bd-80db-e61531a99a86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9ac514ac3c44de09a562b4ac7ef914d'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:17:22.575977 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-276cd119-8601-43bd-80db-e61531a99a86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9ac514ac3c44de09a562b4ac7ef914d'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:17:22.583153 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-276cd119-8601-43bd-80db-e61531a99a86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9ac514ac3c44de09a562b4ac7ef914d'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:17:22.600232 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-276cd119-8601-43bd-80db-e61531a99a86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9ac514ac3c44de09a562b4ac7ef914d'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:17:22.612602 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-276cd119-8601-43bd-80db-e61531a99a86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9ac514ac3c44de09a562b4ac7ef914d'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:17:22.618882 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4414/8800] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 22:17:22 2022] DELETE /identity/v3/users/a9ac514ac3c44de09a562b4ac7ef914d => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:17:22.623552 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2b1b21-aef8-4e00-805a-b2b802e78608 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:17:22.624034 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2b1b21-aef8-4e00-805a-b2b802e78608 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:17:22.624126 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2b1b21-aef8-4e00-805a-b2b802e78608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:17:22.642057 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-be2b1b21-aef8-4e00-805a-b2b802e78608 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:17:22.643363 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-be2b1b21-aef8-4e00-805a-b2b802e78608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:17:22.704950 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4387/8801] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:17:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:17:22.714855 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276cd119-8601-43bd-80db-e61531a99a86 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:17:22.716410 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-276cd119-8601-43bd-80db-e61531a99a86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:17:22.776273 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276cd119-8601-43bd-80db-e61531a99a86 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:17:22.780233 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b0472d-793e-4550-86de-8347746098b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:17:22.780853 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b0472d-793e-4550-86de-8347746098b9 service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:17:22.781133 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b0472d-793e-4550-86de-8347746098b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:17:22.781433 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b0472d-793e-4550-86de-8347746098b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:17:22.791229 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b0472d-793e-4550-86de-8347746098b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:17:22.792658 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b0472d-793e-4550-86de-8347746098b9 service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:17:22.802808 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4415/8802] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:17:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:17:22.984426 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2b1b21-aef8-4e00-805a-b2b802e78608 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:17:22.986070 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-be2b1b21-aef8-4e00-805a-b2b802e78608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:17:22.998547 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2b1b21-aef8-4e00-805a-b2b802e78608 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:17:23.003566 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9633d9e7-eb51-424a-b324-63ef0476b5ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:17:23.004510 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9633d9e7-eb51-424a-b324-63ef0476b5ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:17:23.004935 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9633d9e7-eb51-424a-b324-63ef0476b5ef admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:17:23.005465 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9633d9e7-eb51-424a-b324-63ef0476b5ef admin admin] PATH_INFO: `/v3/projects/dc2e3ec479214dd1a8d010e06744f5ad` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:17:23.006706 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9633d9e7-eb51-424a-b324-63ef0476b5ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc2e3ec479214dd1a8d010e06744f5ad)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:17:23.008710 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9633d9e7-eb51-424a-b324-63ef0476b5ef admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:17:23.057600 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-9633d9e7-eb51-424a-b324-63ef0476b5ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc2e3ec479214dd1a8d010e06744f5ad', 'request_id': 'req-9633d9e7-eb51-424a-b324-63ef0476b5ef'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:17:23.066649 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-9633d9e7-eb51-424a-b324-63ef0476b5ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc2e3ec479214dd1a8d010e06744f5ad', 'request_id': 'req-9633d9e7-eb51-424a-b324-63ef0476b5ef'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:17:23.072351 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-9633d9e7-eb51-424a-b324-63ef0476b5ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc2e3ec479214dd1a8d010e06744f5ad', 'request_id': 'req-9633d9e7-eb51-424a-b324-63ef0476b5ef'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:17:23.084222 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-9633d9e7-eb51-424a-b324-63ef0476b5ef admin admin] The token cache is being invalidate because project dc2e3ec479214dd1a8d010e06744f5ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 22:17:23.084544 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-9633d9e7-eb51-424a-b324-63ef0476b5ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:17:23.085306 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-9633d9e7-eb51-424a-b324-63ef0476b5ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:17:23.086978 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4388/8803] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 22:17:22 2022] DELETE /identity/v3/projects/dc2e3ec479214dd1a8d010e06744f5ad => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:17:23.095112 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97042970-bce8-453d-9102-369377b8583c None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:17:23.095400 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97042970-bce8-453d-9102-369377b8583c None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:17:23.095672 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97042970-bce8-453d-9102-369377b8583c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:17:23.118204 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-97042970-bce8-453d-9102-369377b8583c None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:17:23.119389 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-97042970-bce8-453d-9102-369377b8583c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:17:23.136705 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:17:23.183374 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4416/8804] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:17:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:17:23.191287 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13547cb-85b7-487c-8d0d-e1712800ffb0 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:17:23.191613 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13547cb-85b7-487c-8d0d-e1712800ffb0 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:17:23.191894 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13547cb-85b7-487c-8d0d-e1712800ffb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:17:23.211490 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-f13547cb-85b7-487c-8d0d-e1712800ffb0 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:17:23.212643 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-f13547cb-85b7-487c-8d0d-e1712800ffb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:17:23.221379 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4389/8805] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:17:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:17:23.225683 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97042970-bce8-453d-9102-369377b8583c None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:17:23.236123 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97042970-bce8-453d-9102-369377b8583c None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:17:23.242140 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde53c78-20be-458c-a880-7f429214817b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:17:23.242843 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde53c78-20be-458c-a880-7f429214817b admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:17:23.243116 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde53c78-20be-458c-a880-7f429214817b admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:17:23.243383 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde53c78-20be-458c-a880-7f429214817b admin admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:17:23.244108 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde53c78-20be-458c-a880-7f429214817b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 22:17:23.244431 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde53c78-20be-458c-a880-7f429214817b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:17:23.246074 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde53c78-20be-458c-a880-7f429214817b admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:17:23.258348 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4417/8806] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 22:17:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 22:17:23.262833 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13547cb-85b7-487c-8d0d-e1712800ffb0 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:17:23.273020 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13547cb-85b7-487c-8d0d-e1712800ffb0 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:17:23.278762 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5650d4-b9ba-419d-9e0a-268c43d00a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:17:23.279475 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5650d4-b9ba-419d-9e0a-268c43d00a0d admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:17:23.279928 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5650d4-b9ba-419d-9e0a-268c43d00a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:17:23.280223 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5650d4-b9ba-419d-9e0a-268c43d00a0d admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:17:23.280920 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5650d4-b9ba-419d-9e0a-268c43d00a0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:17:23.283049 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5650d4-b9ba-419d-9e0a-268c43d00a0d admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:17:23.312273 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4390/8807] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 22:17:23 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 22:17:23.316749 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde53c78-20be-458c-a880-7f429214817b admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:17:23.327955 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde53c78-20be-458c-a880-7f429214817b admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:17:23.391822 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddf756b-eab4-4459-9b41-282bab85b9e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:17:23.392521 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddf756b-eab4-4459-9b41-282bab85b9e2 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:17:23.392802 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddf756b-eab4-4459-9b41-282bab85b9e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:17:23.393071 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddf756b-eab4-4459-9b41-282bab85b9e2 admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:17:23.393714 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddf756b-eab4-4459-9b41-282bab85b9e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:17:23.395689 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddf756b-eab4-4459-9b41-282bab85b9e2 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:17:23.420042 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4418/8808] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 22:17:23 2022] POST /identity/v3/users => generated 287 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 22:17:23.421512 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5650d4-b9ba-419d-9e0a-268c43d00a0d admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:17:23.432349 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5650d4-b9ba-419d-9e0a-268c43d00a0d admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:17:23.437895 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f51a9c-8bae-4466-8ad8-f38c618b5e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:17:23.438653 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f51a9c-8bae-4466-8ad8-f38c618b5e60 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:17:23.438916 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f51a9c-8bae-4466-8ad8-f38c618b5e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:17:23.439185 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f51a9c-8bae-4466-8ad8-f38c618b5e60 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:17:23.439912 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f51a9c-8bae-4466-8ad8-f38c618b5e60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:17:23.441540 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f51a9c-8bae-4466-8ad8-f38c618b5e60 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:17:23.452951 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4391/8809] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 22:17:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 22:17:23.457213 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddf756b-eab4-4459-9b41-282bab85b9e2 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:17:23.467576 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddf756b-eab4-4459-9b41-282bab85b9e2 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:17:23.472450 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60874e8e-e7e9-45af-95cb-a284e1dd8741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:17:23.473107 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60874e8e-e7e9-45af-95cb-a284e1dd8741 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:17:23.473385 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60874e8e-e7e9-45af-95cb-a284e1dd8741 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:17:23.473655 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60874e8e-e7e9-45af-95cb-a284e1dd8741 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:17:23.474407 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60874e8e-e7e9-45af-95cb-a284e1dd8741 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:17:23.475992 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60874e8e-e7e9-45af-95cb-a284e1dd8741 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:17:23.485927 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4419/8810] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 22:17:23 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 22:17:23.490117 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f51a9c-8bae-4466-8ad8-f38c618b5e60 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:17:23.500703 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f51a9c-8bae-4466-8ad8-f38c618b5e60 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:17:23.506823 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e2c264-aa62-4512-a045-4d5461203cc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:17:23.507825 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e2c264-aa62-4512-a045-4d5461203cc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:17:23.508109 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e2c264-aa62-4512-a045-4d5461203cc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:17:23.508385 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e2c264-aa62-4512-a045-4d5461203cc3 admin admin] PATH_INFO: `/v3/projects/03b2f151dcec4754aa40269748160e0f/users/b269c45c51494654ba34f8dd486ea141/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:17:23.524318 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e2c264-aa62-4512-a045-4d5461203cc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03b2f151dcec4754aa40269748160e0f, user_id=b269c45c51494654ba34f8dd486ea141, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:17:23.527029 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e2c264-aa62-4512-a045-4d5461203cc3 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:17:23.542205 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4392/8811] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 22:17:23 2022] PUT /identity/v3/projects/03b2f151dcec4754aa40269748160e0f/users/b269c45c51494654ba34f8dd486ea141/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:17:23.552794 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3699503f-0250-4ab3-a0ec-ff0935dc9fcd None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:17:23.553189 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3699503f-0250-4ab3-a0ec-ff0935dc9fcd None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:17:23.553552 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3699503f-0250-4ab3-a0ec-ff0935dc9fcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:17:23.584227 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-3699503f-0250-4ab3-a0ec-ff0935dc9fcd None None] MFA Rules not processed for user `b269c45c51494654ba34f8dd486ea141`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:17:23.586135 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-3699503f-0250-4ab3-a0ec-ff0935dc9fcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:17:23.659387 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4420/8812] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:17:23 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:17:23.671584 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e2c264-aa62-4512-a045-4d5461203cc3 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:17:23.673687 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-11e2c264-aa62-4512-a045-4d5461203cc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:17:23.696479 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:17:23.732754 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e2c264-aa62-4512-a045-4d5461203cc3 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:17:23.736476 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072dc4cb-f58e-4758-8d93-8c0f595e01ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:17:23.737126 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072dc4cb-f58e-4758-8d93-8c0f595e01ce service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:17:23.737404 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072dc4cb-f58e-4758-8d93-8c0f595e01ce service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:17:23.737676 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072dc4cb-f58e-4758-8d93-8c0f595e01ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:17:23.746611 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072dc4cb-f58e-4758-8d93-8c0f595e01ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:17:23.748082 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072dc4cb-f58e-4758-8d93-8c0f595e01ce service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:17:23.757026 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4393/8813] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:17:23 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:17:28.050534 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3699503f-0250-4ab3-a0ec-ff0935dc9fcd None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:17:28.072198 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:17:28.120718 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3699503f-0250-4ab3-a0ec-ff0935dc9fcd None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:17:28.125369 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09640939-7c49-4edb-940a-dcd6f73f9b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:17:28.126304 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09640939-7c49-4edb-940a-dcd6f73f9b86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:17:28.126583 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09640939-7c49-4edb-940a-dcd6f73f9b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:17:28.126851 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09640939-7c49-4edb-940a-dcd6f73f9b86 admin admin] PATH_INFO: `/v3/users/b269c45c51494654ba34f8dd486ea141` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:17:28.128039 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09640939-7c49-4edb-940a-dcd6f73f9b86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b269c45c51494654ba34f8dd486ea141)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:17:28.130033 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09640939-7c49-4edb-940a-dcd6f73f9b86 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:17:28.177147 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-09640939-7c49-4edb-940a-dcd6f73f9b86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b269c45c51494654ba34f8dd486ea141'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:17:28.177817 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-09640939-7c49-4edb-940a-dcd6f73f9b86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b269c45c51494654ba34f8dd486ea141'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:17:28.184788 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-09640939-7c49-4edb-940a-dcd6f73f9b86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b269c45c51494654ba34f8dd486ea141'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:17:28.192920 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-09640939-7c49-4edb-940a-dcd6f73f9b86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b269c45c51494654ba34f8dd486ea141'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:17:28.205559 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-09640939-7c49-4edb-940a-dcd6f73f9b86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b269c45c51494654ba34f8dd486ea141'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:17:28.211564 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4421/8814] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 22:17:28 2022] DELETE /identity/v3/users/b269c45c51494654ba34f8dd486ea141 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:17:28.216268 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16295c59-89a9-4d11-a1ff-05f1829518df None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:17:28.216730 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16295c59-89a9-4d11-a1ff-05f1829518df None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:17:28.216844 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16295c59-89a9-4d11-a1ff-05f1829518df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:17:28.233750 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-16295c59-89a9-4d11-a1ff-05f1829518df None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:17:28.235096 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-16295c59-89a9-4d11-a1ff-05f1829518df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:17:28.292310 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4394/8815] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:17:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 22:17:28.304056 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09640939-7c49-4edb-940a-dcd6f73f9b86 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:17:28.306904 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-09640939-7c49-4edb-940a-dcd6f73f9b86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:17:28.367636 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09640939-7c49-4edb-940a-dcd6f73f9b86 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:17:28.371828 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5403b972-6d83-462c-9939-4675efc4b0e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:17:28.372483 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5403b972-6d83-462c-9939-4675efc4b0e7 service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:17:28.372766 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5403b972-6d83-462c-9939-4675efc4b0e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:17:28.373038 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5403b972-6d83-462c-9939-4675efc4b0e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:17:28.383229 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5403b972-6d83-462c-9939-4675efc4b0e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:17:28.384658 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5403b972-6d83-462c-9939-4675efc4b0e7 service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:17:28.395083 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4422/8816] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:17:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:17:28.572737 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16295c59-89a9-4d11-a1ff-05f1829518df None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:17:28.574634 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-16295c59-89a9-4d11-a1ff-05f1829518df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:17:28.587636 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16295c59-89a9-4d11-a1ff-05f1829518df None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:17:28.593065 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10c758b-ce3c-495d-a052-3accf4d1418e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:17:28.593992 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10c758b-ce3c-495d-a052-3accf4d1418e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:17:28.594399 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10c758b-ce3c-495d-a052-3accf4d1418e admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:17:28.594670 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10c758b-ce3c-495d-a052-3accf4d1418e admin admin] PATH_INFO: `/v3/projects/03b2f151dcec4754aa40269748160e0f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:17:28.595951 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10c758b-ce3c-495d-a052-3accf4d1418e admin admin] RBAC: Authorizing `identity:delete_project(project_id=03b2f151dcec4754aa40269748160e0f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:17:28.597925 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10c758b-ce3c-495d-a052-3accf4d1418e admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:17:28.651615 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-b10c758b-ce3c-495d-a052-3accf4d1418e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03b2f151dcec4754aa40269748160e0f', 'request_id': 'req-b10c758b-ce3c-495d-a052-3accf4d1418e'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:17:28.661431 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-b10c758b-ce3c-495d-a052-3accf4d1418e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03b2f151dcec4754aa40269748160e0f', 'request_id': 'req-b10c758b-ce3c-495d-a052-3accf4d1418e'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:17:28.667944 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-b10c758b-ce3c-495d-a052-3accf4d1418e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03b2f151dcec4754aa40269748160e0f', 'request_id': 'req-b10c758b-ce3c-495d-a052-3accf4d1418e'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:17:28.679579 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-b10c758b-ce3c-495d-a052-3accf4d1418e admin admin] The token cache is being invalidate because project 03b2f151dcec4754aa40269748160e0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 22:17:28.679862 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-b10c758b-ce3c-495d-a052-3accf4d1418e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:17:28.680501 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-b10c758b-ce3c-495d-a052-3accf4d1418e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:17:28.682165 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4395/8817] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 22:17:28 2022] DELETE /identity/v3/projects/03b2f151dcec4754aa40269748160e0f => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:17:28.688384 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfee7c8-f074-4f09-a6b2-a74e083fb427 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:17:28.688665 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfee7c8-f074-4f09-a6b2-a74e083fb427 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:17:28.688934 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfee7c8-f074-4f09-a6b2-a74e083fb427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:17:28.706770 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-5cfee7c8-f074-4f09-a6b2-a74e083fb427 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:17:28.707953 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-5cfee7c8-f074-4f09-a6b2-a74e083fb427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:17:28.742817 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:17:28.772014 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4423/8818] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:17:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 22:17:28.781100 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dd6053-5001-4e08-aae0-d9e2f540df74 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:17:28.781389 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dd6053-5001-4e08-aae0-d9e2f540df74 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:17:28.781712 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dd6053-5001-4e08-aae0-d9e2f540df74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:17:28.801012 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-67dd6053-5001-4e08-aae0-d9e2f540df74 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:17:28.802291 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-67dd6053-5001-4e08-aae0-d9e2f540df74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:17:28.812524 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4396/8819] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:17:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:17:28.815331 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfee7c8-f074-4f09-a6b2-a74e083fb427 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:17:28.826137 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfee7c8-f074-4f09-a6b2-a74e083fb427 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:17:28.831584 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6260a26-0130-4f66-a9c5-0b4356ffba6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:17:28.832253 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6260a26-0130-4f66-a9c5-0b4356ffba6c admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:17:28.832559 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6260a26-0130-4f66-a9c5-0b4356ffba6c admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:17:28.832836 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6260a26-0130-4f66-a9c5-0b4356ffba6c admin admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:17:28.833581 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6260a26-0130-4f66-a9c5-0b4356ffba6c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 22:17:28.833884 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6260a26-0130-4f66-a9c5-0b4356ffba6c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:17:28.835498 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6260a26-0130-4f66-a9c5-0b4356ffba6c admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:17:28.848020 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4424/8820] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 22:17:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 22:17:28.852462 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dd6053-5001-4e08-aae0-d9e2f540df74 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:17:28.862331 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dd6053-5001-4e08-aae0-d9e2f540df74 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:17:28.867751 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53977d90-427e-4b95-b4f8-cf10a776c814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:17:28.868407 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53977d90-427e-4b95-b4f8-cf10a776c814 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:17:28.868685 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53977d90-427e-4b95-b4f8-cf10a776c814 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:17:28.868953 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53977d90-427e-4b95-b4f8-cf10a776c814 admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:17:28.869632 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53977d90-427e-4b95-b4f8-cf10a776c814 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:17:28.871648 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53977d90-427e-4b95-b4f8-cf10a776c814 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:17:28.899311 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4397/8821] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 22:17:28 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 22:17:28.903856 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6260a26-0130-4f66-a9c5-0b4356ffba6c admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:17:28.914544 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6260a26-0130-4f66-a9c5-0b4356ffba6c admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:17:28.976005 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebc29be-1197-4b9c-bfe2-02ee3ebb7243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:17:28.976716 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebc29be-1197-4b9c-bfe2-02ee3ebb7243 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:17:28.976966 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebc29be-1197-4b9c-bfe2-02ee3ebb7243 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:17:28.977235 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebc29be-1197-4b9c-bfe2-02ee3ebb7243 admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:17:28.977937 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebc29be-1197-4b9c-bfe2-02ee3ebb7243 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:17:28.979891 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebc29be-1197-4b9c-bfe2-02ee3ebb7243 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:17:29.002112 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4425/8822] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 22:17:28 2022] POST /identity/v3/users => generated 293 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 22:17:29.006600 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53977d90-427e-4b95-b4f8-cf10a776c814 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:17:29.017221 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53977d90-427e-4b95-b4f8-cf10a776c814 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:17:29.022155 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66918ace-364d-46c4-9521-05a95dd77701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:17:29.022826 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66918ace-364d-46c4-9521-05a95dd77701 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:17:29.023098 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66918ace-364d-46c4-9521-05a95dd77701 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:17:29.023371 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66918ace-364d-46c4-9521-05a95dd77701 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:17:29.024099 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66918ace-364d-46c4-9521-05a95dd77701 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:17:29.025696 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66918ace-364d-46c4-9521-05a95dd77701 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:17:29.036337 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4398/8823] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 22:17:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 22:17:29.040410 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebc29be-1197-4b9c-bfe2-02ee3ebb7243 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:17:29.051212 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebc29be-1197-4b9c-bfe2-02ee3ebb7243 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:17:29.059175 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002d9fd8-bd5b-4d77-bbad-0718685fe0a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:17:29.059834 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002d9fd8-bd5b-4d77-bbad-0718685fe0a5 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:17:29.060114 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002d9fd8-bd5b-4d77-bbad-0718685fe0a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:17:29.060388 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002d9fd8-bd5b-4d77-bbad-0718685fe0a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:17:29.061112 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002d9fd8-bd5b-4d77-bbad-0718685fe0a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:17:29.062809 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002d9fd8-bd5b-4d77-bbad-0718685fe0a5 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:17:29.073779 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4426/8824] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 22:17:29 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 22:17:29.077832 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66918ace-364d-46c4-9521-05a95dd77701 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:17:29.088317 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66918ace-364d-46c4-9521-05a95dd77701 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:17:29.092987 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa7eb27-a4f0-4ad0-ad43-c2a09c5ea619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:17:29.093948 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa7eb27-a4f0-4ad0-ad43-c2a09c5ea619 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:17:29.094212 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa7eb27-a4f0-4ad0-ad43-c2a09c5ea619 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:17:29.094485 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa7eb27-a4f0-4ad0-ad43-c2a09c5ea619 admin admin] PATH_INFO: `/v3/projects/ca0dd3e44fa14488a171994ee34ebdc8/users/4e7399a71fa0499f8a305c8f79a0be97/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:17:29.096783 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:17:29.111998 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa7eb27-a4f0-4ad0-ad43-c2a09c5ea619 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca0dd3e44fa14488a171994ee34ebdc8, user_id=4e7399a71fa0499f8a305c8f79a0be97, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:17:29.114670 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa7eb27-a4f0-4ad0-ad43-c2a09c5ea619 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:17:29.128686 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4399/8825] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 22:17:29 2022] PUT /identity/v3/projects/ca0dd3e44fa14488a171994ee34ebdc8/users/4e7399a71fa0499f8a305c8f79a0be97/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 22:17:29.133979 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dbd1c6-6661-486c-94cc-b96350c94ed0 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:17:29.134312 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dbd1c6-6661-486c-94cc-b96350c94ed0 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:17:29.134590 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dbd1c6-6661-486c-94cc-b96350c94ed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:17:29.153464 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-b8dbd1c6-6661-486c-94cc-b96350c94ed0 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:17:29.154700 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-b8dbd1c6-6661-486c-94cc-b96350c94ed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:17:29.217583 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4427/8826] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:17:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 22:17:29.227732 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa7eb27-a4f0-4ad0-ad43-c2a09c5ea619 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:17:29.229781 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-6fa7eb27-a4f0-4ad0-ad43-c2a09c5ea619 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:17:29.287719 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa7eb27-a4f0-4ad0-ad43-c2a09c5ea619 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:17:29.292385 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0974375-c6c0-46af-a7a4-8c15f45f5a81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:17:29.293027 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0974375-c6c0-46af-a7a4-8c15f45f5a81 service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:17:29.293328 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0974375-c6c0-46af-a7a4-8c15f45f5a81 service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:17:29.293571 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0974375-c6c0-46af-a7a4-8c15f45f5a81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:17:29.302765 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0974375-c6c0-46af-a7a4-8c15f45f5a81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:17:29.304209 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0974375-c6c0-46af-a7a4-8c15f45f5a81 service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:17:29.313621 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4400/8827] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:17:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:17:33.388720 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8423a609-76e6-4daf-a4b9-3cff82aa5b84 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:17:33.389248 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8423a609-76e6-4daf-a4b9-3cff82aa5b84 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:17:33.389248 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8423a609-76e6-4daf-a4b9-3cff82aa5b84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:17:33.418489 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-8423a609-76e6-4daf-a4b9-3cff82aa5b84 None None] MFA Rules not processed for user `4e7399a71fa0499f8a305c8f79a0be97`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:17:33.419666 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-8423a609-76e6-4daf-a4b9-3cff82aa5b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:17:33.461433 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:17:33.496750 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4428/8828] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:17:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:17:33.501095 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0974375-c6c0-46af-a7a4-8c15f45f5a81 service neutron] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:17:33.511120 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0974375-c6c0-46af-a7a4-8c15f45f5a81 service neutron] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:17:33.516117 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3406a78-ba05-49c4-bbb4-128bee8bc9b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:17:33.516775 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3406a78-ba05-49c4-bbb4-128bee8bc9b7 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:17:33.517050 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3406a78-ba05-49c4-bbb4-128bee8bc9b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:17:33.517321 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3406a78-ba05-49c4-bbb4-128bee8bc9b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:17:33.518039 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3406a78-ba05-49c4-bbb4-128bee8bc9b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:17:33.519931 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3406a78-ba05-49c4-bbb4-128bee8bc9b7 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:17:33.550136 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4401/8829] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 22:17:33 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 22:17:33.551455 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8423a609-76e6-4daf-a4b9-3cff82aa5b84 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:17:33.562265 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8423a609-76e6-4daf-a4b9-3cff82aa5b84 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:17:33.628475 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dd6646-3861-4381-a986-a326e7a23cb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:17:33.629172 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dd6646-3861-4381-a986-a326e7a23cb9 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:17:33.629497 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dd6646-3861-4381-a986-a326e7a23cb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:17:33.629771 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dd6646-3861-4381-a986-a326e7a23cb9 admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:17:33.630503 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dd6646-3861-4381-a986-a326e7a23cb9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:17:33.632513 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dd6646-3861-4381-a986-a326e7a23cb9 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:17:33.654819 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4429/8830] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 22:17:33 2022] POST /identity/v3/users => generated 298 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 22:17:33.658921 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3406a78-ba05-49c4-bbb4-128bee8bc9b7 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:17:33.670234 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3406a78-ba05-49c4-bbb4-128bee8bc9b7 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:17:33.675585 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ba1abe-33f8-4c95-aceb-ee716daa6535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:17:33.676257 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ba1abe-33f8-4c95-aceb-ee716daa6535 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:17:33.676541 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ba1abe-33f8-4c95-aceb-ee716daa6535 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:17:33.676820 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ba1abe-33f8-4c95-aceb-ee716daa6535 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:17:33.677613 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ba1abe-33f8-4c95-aceb-ee716daa6535 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:17:33.679303 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ba1abe-33f8-4c95-aceb-ee716daa6535 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:17:33.691184 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4402/8831] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 22:17:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 22:17:33.695597 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dd6646-3861-4381-a986-a326e7a23cb9 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:17:33.706746 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dd6646-3861-4381-a986-a326e7a23cb9 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:17:33.711375 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20961566-9cf6-4c0a-a523-0e30533883cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:17:33.712332 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20961566-9cf6-4c0a-a523-0e30533883cd admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:17:33.712553 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20961566-9cf6-4c0a-a523-0e30533883cd admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:17:33.712823 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20961566-9cf6-4c0a-a523-0e30533883cd admin admin] PATH_INFO: `/v3/projects/1331f01d153c4a4da95593a2165e7692/users/159c121eca554950a397bfc5bbd9fd58/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:17:33.729506 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20961566-9cf6-4c0a-a523-0e30533883cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=1331f01d153c4a4da95593a2165e7692, user_id=159c121eca554950a397bfc5bbd9fd58, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:17:33.732316 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20961566-9cf6-4c0a-a523-0e30533883cd admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:17:33.755290 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4430/8832] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 22:17:33 2022] PUT /identity/v3/projects/1331f01d153c4a4da95593a2165e7692/users/159c121eca554950a397bfc5bbd9fd58/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:17:33.761284 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ba1abe-33f8-4c95-aceb-ee716daa6535 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:17:33.772689 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ba1abe-33f8-4c95-aceb-ee716daa6535 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:17:33.841269 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba99a40-c49d-4d6b-b731-289344255d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:17:33.842110 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba99a40-c49d-4d6b-b731-289344255d9a admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:17:33.842464 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba99a40-c49d-4d6b-b731-289344255d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:17:33.842807 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba99a40-c49d-4d6b-b731-289344255d9a admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:17:33.843619 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba99a40-c49d-4d6b-b731-289344255d9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:17:33.845413 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba99a40-c49d-4d6b-b731-289344255d9a admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:17:33.856315 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4403/8833] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 22:17:33 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 22:17:33.860733 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20961566-9cf6-4c0a-a523-0e30533883cd admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:17:33.871636 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20961566-9cf6-4c0a-a523-0e30533883cd admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:17:33.876516 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004b0f0b-94b1-4ed6-b431-e1a5142f7587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:17:33.877434 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004b0f0b-94b1-4ed6-b431-e1a5142f7587 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:17:33.877713 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004b0f0b-94b1-4ed6-b431-e1a5142f7587 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:17:33.878024 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004b0f0b-94b1-4ed6-b431-e1a5142f7587 admin admin] PATH_INFO: `/v3/projects/1331f01d153c4a4da95593a2165e7692/users/159c121eca554950a397bfc5bbd9fd58/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:17:33.880028 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004b0f0b-94b1-4ed6-b431-e1a5142f7587 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1331f01d153c4a4da95593a2165e7692, user_id=159c121eca554950a397bfc5bbd9fd58, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:17:33.882750 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004b0f0b-94b1-4ed6-b431-e1a5142f7587 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:17:33.901281 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4431/8834] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 22:17:33 2022] PUT /identity/v3/projects/1331f01d153c4a4da95593a2165e7692/users/159c121eca554950a397bfc5bbd9fd58/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:17:38.460617 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454fcfca-99cb-4d9a-a979-d516cb90c50b None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:17:38.461936 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454fcfca-99cb-4d9a-a979-d516cb90c50b None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:17:38.462420 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454fcfca-99cb-4d9a-a979-d516cb90c50b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:17:38.497545 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-454fcfca-99cb-4d9a-a979-d516cb90c50b None None] MFA Rules not processed for user `159c121eca554950a397bfc5bbd9fd58`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:17:38.498953 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-454fcfca-99cb-4d9a-a979-d516cb90c50b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:17:38.546422 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:17:38.586206 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4404/8835] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:17:38 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:17:38.616014 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004b0f0b-94b1-4ed6-b431-e1a5142f7587 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:17:38.617998 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-004b0f0b-94b1-4ed6-b431-e1a5142f7587 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:17:38.687276 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004b0f0b-94b1-4ed6-b431-e1a5142f7587 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:17:38.691549 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf7d40c-ea2f-4fc5-9b6b-2674bc5ab61f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7f2db148c8e4d5d81431cae3576434b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:17:38.692489 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf7d40c-ea2f-4fc5-9b6b-2674bc5ab61f service glance] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:17:38.692842 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf7d40c-ea2f-4fc5-9b6b-2674bc5ab61f service glance] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:17:38.693188 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf7d40c-ea2f-4fc5-9b6b-2674bc5ab61f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:17:38.740410 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:17:38.757804 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf7d40c-ea2f-4fc5-9b6b-2674bc5ab61f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:17:38.759466 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf7d40c-ea2f-4fc5-9b6b-2674bc5ab61f service glance] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:17:38.770310 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4432/8836] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:17:38 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:17:38.890433 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7d4da0-c238-4eea-b94b-f86f54750d25 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:17:38.891009 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7d4da0-c238-4eea-b94b-f86f54750d25 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:17:38.891654 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7d4da0-c238-4eea-b94b-f86f54750d25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:17:38.944877 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-dd7d4da0-c238-4eea-b94b-f86f54750d25 None None] MFA Rules not processed for user `17b779a3e21a415bb42cde5d6863d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:17:38.946235 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-dd7d4da0-c238-4eea-b94b-f86f54750d25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:17:39.015841 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4405/8837] 10.222.0.17 () {58 vars in 1009 bytes} [Sat Jul 23 22:17:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 22:17:39.077193 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9badece8-d26f-47dc-b6e3-6df3febbc2e5 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:17:39.077810 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9badece8-d26f-47dc-b6e3-6df3febbc2e5 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:17:39.078328 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9badece8-d26f-47dc-b6e3-6df3febbc2e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:17:39.140377 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-9badece8-d26f-47dc-b6e3-6df3febbc2e5 None None] MFA Rules not processed for user `47f0a685b7da46afb81024848f079d2f`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:17:39.142406 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-9badece8-d26f-47dc-b6e3-6df3febbc2e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:17:39.232363 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4433/8838] 10.222.0.17 () {58 vars in 1040 bytes} [Sat Jul 23 22:17:39 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 23 22:17:39.238670 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7d4da0-c238-4eea-b94b-f86f54750d25 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:17:39.250758 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7d4da0-c238-4eea-b94b-f86f54750d25 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:17:39.255624 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a875cb3-b4e4-48d3-9d81-30ec8f66a57e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f0a685b7da46afb81024848f079d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:17:39.256281 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a875cb3-b4e4-48d3-9d81-30ec8f66a57e service swift] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:17:39.256558 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a875cb3-b4e4-48d3-9d81-30ec8f66a57e service swift] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:17:39.256828 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a875cb3-b4e4-48d3-9d81-30ec8f66a57e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:17:39.266016 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a875cb3-b4e4-48d3-9d81-30ec8f66a57e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:17:39.267816 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a875cb3-b4e4-48d3-9d81-30ec8f66a57e service swift] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:17:39.278270 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4406/8839] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 23 22:17:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 23 22:17:48.056431 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f465e4e-08e8-488d-8842-9495fd4835c8 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:17:48.056986 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f465e4e-08e8-488d-8842-9495fd4835c8 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:17:48.057092 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f465e4e-08e8-488d-8842-9495fd4835c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:17:48.078077 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-0f465e4e-08e8-488d-8842-9495fd4835c8 None None] MFA Rules not processed for user `4e7399a71fa0499f8a305c8f79a0be97`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:17:48.079236 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-0f465e4e-08e8-488d-8842-9495fd4835c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:17:48.088385 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4434/8840] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:17:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:17:49.273666 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=58 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:17:49.889883 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ff522d-72ca-4265-b2ad-8e798f0c306e None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:17:49.890192 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ff522d-72ca-4265-b2ad-8e798f0c306e None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:17:49.890586 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ff522d-72ca-4265-b2ad-8e798f0c306e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:17:49.908921 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-82ff522d-72ca-4265-b2ad-8e798f0c306e None None] MFA Rules not processed for user `17b779a3e21a415bb42cde5d6863d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:17:49.910162 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-82ff522d-72ca-4265-b2ad-8e798f0c306e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:17:49.917599 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4407/8841] 10.222.0.17 () {58 vars in 1009 bytes} [Sat Jul 23 22:17:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:17:49.931205 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f465e4e-08e8-488d-8842-9495fd4835c8 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:17:49.943941 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f465e4e-08e8-488d-8842-9495fd4835c8 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:17:49.950421 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60eb828-ef5e-42e3-8c4e-fe25ba7b931f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f0a685b7da46afb81024848f079d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:17:49.951082 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60eb828-ef5e-42e3-8c4e-fe25ba7b931f service swift] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:17:49.951362 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60eb828-ef5e-42e3-8c4e-fe25ba7b931f service swift] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:17:49.951653 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60eb828-ef5e-42e3-8c4e-fe25ba7b931f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:17:49.961192 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60eb828-ef5e-42e3-8c4e-fe25ba7b931f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:17:49.962909 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60eb828-ef5e-42e3-8c4e-fe25ba7b931f service swift] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:17:49.972368 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4435/8842] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 23 22:17:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 23 22:17:58.014662 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ff522d-72ca-4265-b2ad-8e798f0c306e None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:17:58.017402 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-82ff522d-72ca-4265-b2ad-8e798f0c306e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:17:58.122818 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ff522d-72ca-4265-b2ad-8e798f0c306e None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:17:58.128522 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a21aeb5-0a3a-480a-a94c-de0f855e9dda service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:17:58.129198 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a21aeb5-0a3a-480a-a94c-de0f855e9dda service nova] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:17:58.129473 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a21aeb5-0a3a-480a-a94c-de0f855e9dda service nova] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:17:58.129747 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a21aeb5-0a3a-480a-a94c-de0f855e9dda service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:17:58.131690 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-0a21aeb5-0a3a-480a-a94c-de0f855e9dda service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:17:58.145693 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a21aeb5-0a3a-480a-a94c-de0f855e9dda service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:17:58.147429 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a21aeb5-0a3a-480a-a94c-de0f855e9dda service nova] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:17:58.159896 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4408/8843] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:17:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:17:59.968848 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=61 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:18:03.164224 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60eb828-ef5e-42e3-8c4e-fe25ba7b931f service swift] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:18:03.178328 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60eb828-ef5e-42e3-8c4e-fe25ba7b931f service swift] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:18:03.184139 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c35b4e-5916-4b36-810b-74b4c7644420 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:18:03.184798 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c35b4e-5916-4b36-810b-74b4c7644420 service nova] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:18:03.185076 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c35b4e-5916-4b36-810b-74b4c7644420 service nova] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:18:03.185350 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c35b4e-5916-4b36-810b-74b4c7644420 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:18:03.187220 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-d1c35b4e-5916-4b36-810b-74b4c7644420 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:18:03.200116 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c35b4e-5916-4b36-810b-74b4c7644420 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:18:03.201688 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c35b4e-5916-4b36-810b-74b4c7644420 service nova] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:18:03.212655 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4436/8844] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:18:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:18:08.155355 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=37 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:18:09.934094 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd41d99-c4ed-4597-909d-97be94625525 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:18:09.934654 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd41d99-c4ed-4597-909d-97be94625525 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:18:09.934654 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd41d99-c4ed-4597-909d-97be94625525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:18:09.954165 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-4fd41d99-c4ed-4597-909d-97be94625525 None None] MFA Rules not processed for user `17b779a3e21a415bb42cde5d6863d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:18:09.955390 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-4fd41d99-c4ed-4597-909d-97be94625525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:18:09.963875 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4409/8845] 10.222.0.17 () {58 vars in 967 bytes} [Sat Jul 23 22:18:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:18:09.976283 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c35b4e-5916-4b36-810b-74b4c7644420 service nova] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:18:09.988120 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c35b4e-5916-4b36-810b-74b4c7644420 service nova] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:18:09.993752 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9851127d-48ec-4ef9-82f4-5a8fea68dda9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f0a685b7da46afb81024848f079d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:18:09.994646 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9851127d-48ec-4ef9-82f4-5a8fea68dda9 service swift] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:18:09.994737 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9851127d-48ec-4ef9-82f4-5a8fea68dda9 service swift] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:18:09.995064 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9851127d-48ec-4ef9-82f4-5a8fea68dda9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:18:10.005163 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9851127d-48ec-4ef9-82f4-5a8fea68dda9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:18:10.006923 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9851127d-48ec-4ef9-82f4-5a8fea68dda9 service swift] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:18:10.015566 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4437/8846] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 23 22:18:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 23 22:18:10.501701 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b28fe5-1a22-4a76-8e69-46561dbf65aa None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:18:10.502027 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b28fe5-1a22-4a76-8e69-46561dbf65aa None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:18:10.502311 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b28fe5-1a22-4a76-8e69-46561dbf65aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:18:10.522707 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-45b28fe5-1a22-4a76-8e69-46561dbf65aa None None] MFA Rules not processed for user `17b779a3e21a415bb42cde5d6863d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:18:10.523922 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-45b28fe5-1a22-4a76-8e69-46561dbf65aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:18:10.532732 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4410/8847] 10.222.0.17 () {58 vars in 1009 bytes} [Sat Jul 23 22:18:10 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:18:10.546147 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9851127d-48ec-4ef9-82f4-5a8fea68dda9 service swift] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:18:10.557729 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9851127d-48ec-4ef9-82f4-5a8fea68dda9 service swift] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:18:10.564285 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19407ebf-7049-4e36-8308-16b0f2637fa9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f0a685b7da46afb81024848f079d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:18:10.564935 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19407ebf-7049-4e36-8308-16b0f2637fa9 service swift] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:18:10.565205 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19407ebf-7049-4e36-8308-16b0f2637fa9 service swift] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:18:10.565473 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19407ebf-7049-4e36-8308-16b0f2637fa9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:18:10.575180 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19407ebf-7049-4e36-8308-16b0f2637fa9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:18:10.576761 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19407ebf-7049-4e36-8308-16b0f2637fa9 service swift] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:18:10.585147 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4438/8848] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 23 22:18:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 23 22:18:18.761034 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757096a0-3ba5-4b28-ae00-e998c3a9a2ed None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:18:18.761543 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757096a0-3ba5-4b28-ae00-e998c3a9a2ed None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:18:18.761667 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757096a0-3ba5-4b28-ae00-e998c3a9a2ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:18:18.779981 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-757096a0-3ba5-4b28-ae00-e998c3a9a2ed None None] MFA Rules not processed for user `4e7399a71fa0499f8a305c8f79a0be97`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:18:18.781182 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-757096a0-3ba5-4b28-ae00-e998c3a9a2ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:18:18.789436 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4411/8849] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:18:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:18:19.053995 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19407ebf-7049-4e36-8308-16b0f2637fa9 service swift] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:18:19.055699 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-19407ebf-7049-4e36-8308-16b0f2637fa9 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:18:19.117385 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19407ebf-7049-4e36-8308-16b0f2637fa9 service swift] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:18:19.121284 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd28e87-0201-444d-934e-2ff947de4402 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:18:19.121947 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd28e87-0201-444d-934e-2ff947de4402 service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:18:19.122227 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd28e87-0201-444d-934e-2ff947de4402 service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:18:19.122521 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd28e87-0201-444d-934e-2ff947de4402 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:18:19.124403 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-7fd28e87-0201-444d-934e-2ff947de4402 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:18:19.134192 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd28e87-0201-444d-934e-2ff947de4402 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:18:19.135615 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd28e87-0201-444d-934e-2ff947de4402 service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:18:19.143726 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4439/8850] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:18:19 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:18:19.463705 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757096a0-3ba5-4b28-ae00-e998c3a9a2ed None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:18:19.465407 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-757096a0-3ba5-4b28-ae00-e998c3a9a2ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:18:19.535962 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757096a0-3ba5-4b28-ae00-e998c3a9a2ed None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:18:19.541045 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa739fa5-41a1-4a3f-a979-147cd1694baf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc719a3b3ac4461b82ca04ab6451d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:18:19.541700 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa739fa5-41a1-4a3f-a979-147cd1694baf service placement] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:18:19.542023 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa739fa5-41a1-4a3f-a979-147cd1694baf service placement] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:18:19.542292 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa739fa5-41a1-4a3f-a979-147cd1694baf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:18:19.544076 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-aa739fa5-41a1-4a3f-a979-147cd1694baf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:18:19.557291 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa739fa5-41a1-4a3f-a979-147cd1694baf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:18:19.558953 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa739fa5-41a1-4a3f-a979-147cd1694baf service placement] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:18:19.569065 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4412/8851] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:18:19 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:18:20.684354 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343c82da-9105-4787-9f8b-e5cf6434d6c9 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:18:20.684836 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343c82da-9105-4787-9f8b-e5cf6434d6c9 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:18:20.684915 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343c82da-9105-4787-9f8b-e5cf6434d6c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:18:20.704069 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-343c82da-9105-4787-9f8b-e5cf6434d6c9 None None] MFA Rules not processed for user `17b779a3e21a415bb42cde5d6863d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:18:20.705338 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-343c82da-9105-4787-9f8b-e5cf6434d6c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:18:20.713101 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4440/8852] 10.222.0.17 () {58 vars in 1009 bytes} [Sat Jul 23 22:18:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:18:20.725892 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa739fa5-41a1-4a3f-a979-147cd1694baf service placement] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:18:20.738577 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa739fa5-41a1-4a3f-a979-147cd1694baf service placement] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:18:20.743897 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2888c8d-ee39-4e88-84b7-221f0c9710ac service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f0a685b7da46afb81024848f079d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:18:20.744563 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2888c8d-ee39-4e88-84b7-221f0c9710ac service swift] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:18:20.744842 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2888c8d-ee39-4e88-84b7-221f0c9710ac service swift] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:18:20.745114 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2888c8d-ee39-4e88-84b7-221f0c9710ac service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:18:20.754545 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2888c8d-ee39-4e88-84b7-221f0c9710ac service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:18:20.756141 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2888c8d-ee39-4e88-84b7-221f0c9710ac service swift] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:18:20.764939 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4413/8853] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 23 22:18:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 23 22:18:30.697723 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=47 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:18:30.761479 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=47 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:18:41.605167 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30102316-5f8b-49cb-b0b0-0db4cb507813 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:18:41.605651 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30102316-5f8b-49cb-b0b0-0db4cb507813 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:18:41.605746 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30102316-5f8b-49cb-b0b0-0db4cb507813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:18:41.635874 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-30102316-5f8b-49cb-b0b0-0db4cb507813 None None] MFA Rules not processed for user `17b779a3e21a415bb42cde5d6863d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:18:41.637074 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-30102316-5f8b-49cb-b0b0-0db4cb507813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:18:41.645269 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4441/8854] 10.222.0.17 () {58 vars in 967 bytes} [Sat Jul 23 22:18:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:18:41.666686 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2888c8d-ee39-4e88-84b7-221f0c9710ac service swift] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:18:41.677492 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2888c8d-ee39-4e88-84b7-221f0c9710ac service swift] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:18:41.683160 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ec44ff-c3d4-40c8-b501-7207421bf910 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f0a685b7da46afb81024848f079d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:18:41.683821 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ec44ff-c3d4-40c8-b501-7207421bf910 service swift] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:18:41.684095 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ec44ff-c3d4-40c8-b501-7207421bf910 service swift] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:18:41.684365 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ec44ff-c3d4-40c8-b501-7207421bf910 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:18:41.692681 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ec44ff-c3d4-40c8-b501-7207421bf910 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:18:41.694297 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ec44ff-c3d4-40c8-b501-7207421bf910 service swift] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:18:41.702919 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4414/8855] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 23 22:18:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 23 22:18:48.207820 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30102316-5f8b-49cb-b0b0-0db4cb507813 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:18:48.286327 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30102316-5f8b-49cb-b0b0-0db4cb507813 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:18:48.292131 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9f7950-431c-48ce-bca5-c09340598fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:18:48.293341 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9f7950-431c-48ce-bca5-c09340598fd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:18:48.293684 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9f7950-431c-48ce-bca5-c09340598fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:18:48.294090 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9f7950-431c-48ce-bca5-c09340598fd5 admin admin] PATH_INFO: `/v3/users/4e7399a71fa0499f8a305c8f79a0be97` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:18:48.296093 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9f7950-431c-48ce-bca5-c09340598fd5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e7399a71fa0499f8a305c8f79a0be97)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:18:48.298587 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9f7950-431c-48ce-bca5-c09340598fd5 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:18:48.348785 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-6a9f7950-431c-48ce-bca5-c09340598fd5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e7399a71fa0499f8a305c8f79a0be97'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:18:48.349605 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-6a9f7950-431c-48ce-bca5-c09340598fd5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e7399a71fa0499f8a305c8f79a0be97'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:18:48.361195 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-6a9f7950-431c-48ce-bca5-c09340598fd5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e7399a71fa0499f8a305c8f79a0be97'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:18:48.371117 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-6a9f7950-431c-48ce-bca5-c09340598fd5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e7399a71fa0499f8a305c8f79a0be97'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:18:48.383779 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-6a9f7950-431c-48ce-bca5-c09340598fd5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e7399a71fa0499f8a305c8f79a0be97'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:18:48.389953 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4442/8856] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 22:18:48 2022] DELETE /identity/v3/users/4e7399a71fa0499f8a305c8f79a0be97 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:18:48.575839 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ec44ff-c3d4-40c8-b501-7207421bf910 service swift] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:18:48.587039 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ec44ff-c3d4-40c8-b501-7207421bf910 service swift] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:18:48.649022 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6499c740-6fab-428f-bfb7-4a251e270ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:18:48.649927 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6499c740-6fab-428f-bfb7-4a251e270ffc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:18:48.650208 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6499c740-6fab-428f-bfb7-4a251e270ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:18:48.650478 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6499c740-6fab-428f-bfb7-4a251e270ffc admin admin] PATH_INFO: `/v3/projects/ca0dd3e44fa14488a171994ee34ebdc8` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:18:48.651696 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6499c740-6fab-428f-bfb7-4a251e270ffc admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca0dd3e44fa14488a171994ee34ebdc8)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:18:48.653719 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6499c740-6fab-428f-bfb7-4a251e270ffc admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:18:48.702131 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-6499c740-6fab-428f-bfb7-4a251e270ffc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca0dd3e44fa14488a171994ee34ebdc8', 'request_id': 'req-6499c740-6fab-428f-bfb7-4a251e270ffc'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:18:48.710702 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-6499c740-6fab-428f-bfb7-4a251e270ffc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca0dd3e44fa14488a171994ee34ebdc8', 'request_id': 'req-6499c740-6fab-428f-bfb7-4a251e270ffc'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:18:48.716226 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-6499c740-6fab-428f-bfb7-4a251e270ffc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca0dd3e44fa14488a171994ee34ebdc8', 'request_id': 'req-6499c740-6fab-428f-bfb7-4a251e270ffc'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:18:48.739818 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-6499c740-6fab-428f-bfb7-4a251e270ffc admin admin] The token cache is being invalidate because project ca0dd3e44fa14488a171994ee34ebdc8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 22:18:48.740104 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-6499c740-6fab-428f-bfb7-4a251e270ffc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:18:48.740831 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-6499c740-6fab-428f-bfb7-4a251e270ffc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:18:48.742593 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4415/8857] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 22:18:48 2022] DELETE /identity/v3/projects/ca0dd3e44fa14488a171994ee34ebdc8 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:18:48.746903 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9f7950-431c-48ce-bca5-c09340598fd5 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:18:48.748562 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-6a9f7950-431c-48ce-bca5-c09340598fd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:18:48.763312 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9f7950-431c-48ce-bca5-c09340598fd5 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:18:48.819508 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:18:48.830564 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9f110b-caed-41cb-8774-c427817d0f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:18:48.832125 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9f110b-caed-41cb-8774-c427817d0f5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:18:48.832734 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9f110b-caed-41cb-8774-c427817d0f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:18:48.833224 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9f110b-caed-41cb-8774-c427817d0f5a admin admin] PATH_INFO: `/v3/users/159c121eca554950a397bfc5bbd9fd58` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:18:48.835137 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9f110b-caed-41cb-8774-c427817d0f5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=159c121eca554950a397bfc5bbd9fd58)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:18:48.837709 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9f110b-caed-41cb-8774-c427817d0f5a admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:18:48.884511 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-bb9f110b-caed-41cb-8774-c427817d0f5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '159c121eca554950a397bfc5bbd9fd58'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:18:48.885153 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-bb9f110b-caed-41cb-8774-c427817d0f5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '159c121eca554950a397bfc5bbd9fd58'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:18:48.892225 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-bb9f110b-caed-41cb-8774-c427817d0f5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '159c121eca554950a397bfc5bbd9fd58'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:18:48.901180 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-bb9f110b-caed-41cb-8774-c427817d0f5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '159c121eca554950a397bfc5bbd9fd58'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:18:48.914641 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-bb9f110b-caed-41cb-8774-c427817d0f5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '159c121eca554950a397bfc5bbd9fd58'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:18:48.920669 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4443/8858] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 22:18:48 2022] DELETE /identity/v3/users/159c121eca554950a397bfc5bbd9fd58 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:18:49.114256 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6499c740-6fab-428f-bfb7-4a251e270ffc admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:18:49.116017 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-6499c740-6fab-428f-bfb7-4a251e270ffc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:18:49.129612 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6499c740-6fab-428f-bfb7-4a251e270ffc admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:18:49.188678 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e1f307-a1bc-4466-b247-931d392a36f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:18:49.189558 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e1f307-a1bc-4466-b247-931d392a36f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:18:49.189831 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e1f307-a1bc-4466-b247-931d392a36f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:18:49.190137 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e1f307-a1bc-4466-b247-931d392a36f1 admin admin] PATH_INFO: `/v3/projects/1331f01d153c4a4da95593a2165e7692` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:18:49.191368 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e1f307-a1bc-4466-b247-931d392a36f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1331f01d153c4a4da95593a2165e7692)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:18:49.193297 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e1f307-a1bc-4466-b247-931d392a36f1 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:18:49.201684 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:18:49.241798 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-05e1f307-a1bc-4466-b247-931d392a36f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1331f01d153c4a4da95593a2165e7692', 'request_id': 'req-05e1f307-a1bc-4466-b247-931d392a36f1'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:18:49.251018 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-05e1f307-a1bc-4466-b247-931d392a36f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1331f01d153c4a4da95593a2165e7692', 'request_id': 'req-05e1f307-a1bc-4466-b247-931d392a36f1'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:18:49.256496 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-05e1f307-a1bc-4466-b247-931d392a36f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1331f01d153c4a4da95593a2165e7692', 'request_id': 'req-05e1f307-a1bc-4466-b247-931d392a36f1'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:18:49.267319 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-05e1f307-a1bc-4466-b247-931d392a36f1 admin admin] The token cache is being invalidate because project 1331f01d153c4a4da95593a2165e7692 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 22:18:49.267592 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-05e1f307-a1bc-4466-b247-931d392a36f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:18:49.268248 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-05e1f307-a1bc-4466-b247-931d392a36f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:18:49.269842 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4416/8859] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 22:18:49 2022] DELETE /identity/v3/projects/1331f01d153c4a4da95593a2165e7692 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:18:49.275380 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f97209-27a0-4774-8e22-06cb95efa20c None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:18:49.275876 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f97209-27a0-4774-8e22-06cb95efa20c None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:18:49.275986 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f97209-27a0-4774-8e22-06cb95efa20c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:18:49.335907 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-61f97209-27a0-4774-8e22-06cb95efa20c None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:18:49.341324 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-61f97209-27a0-4774-8e22-06cb95efa20c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:18:49.414920 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4444/8860] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:18:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:18:49.424368 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7325d8-694b-40a1-b3cf-dd69cd76a3f4 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:18:49.424661 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7325d8-694b-40a1-b3cf-dd69cd76a3f4 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:18:49.424941 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7325d8-694b-40a1-b3cf-dd69cd76a3f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:18:49.445149 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-0f7325d8-694b-40a1-b3cf-dd69cd76a3f4 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:18:49.446788 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-0f7325d8-694b-40a1-b3cf-dd69cd76a3f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:18:49.457253 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4417/8861] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:18:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:18:49.461648 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f97209-27a0-4774-8e22-06cb95efa20c None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:18:49.472769 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f97209-27a0-4774-8e22-06cb95efa20c None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:18:49.479072 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5bb8f2-7a89-4665-adf4-751323f1e5e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:18:49.479755 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5bb8f2-7a89-4665-adf4-751323f1e5e0 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:18:49.480029 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5bb8f2-7a89-4665-adf4-751323f1e5e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:18:49.480294 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5bb8f2-7a89-4665-adf4-751323f1e5e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:18:49.481020 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5bb8f2-7a89-4665-adf4-751323f1e5e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 22:18:49.481318 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5bb8f2-7a89-4665-adf4-751323f1e5e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:18:49.482964 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5bb8f2-7a89-4665-adf4-751323f1e5e0 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:18:49.495334 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4445/8862] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 22:18:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 22:18:49.499434 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7325d8-694b-40a1-b3cf-dd69cd76a3f4 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:18:49.509193 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7325d8-694b-40a1-b3cf-dd69cd76a3f4 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:18:49.514502 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0dba52-9dbd-4851-92f2-a7b741d33fe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:18:49.515179 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0dba52-9dbd-4851-92f2-a7b741d33fe0 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:18:49.515455 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0dba52-9dbd-4851-92f2-a7b741d33fe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:18:49.515724 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0dba52-9dbd-4851-92f2-a7b741d33fe0 admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:18:49.516410 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0dba52-9dbd-4851-92f2-a7b741d33fe0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:18:49.518375 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0dba52-9dbd-4851-92f2-a7b741d33fe0 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:18:49.556144 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4418/8863] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 22:18:49 2022] POST /identity/v3/projects => generated 393 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 22:18:49.560467 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5bb8f2-7a89-4665-adf4-751323f1e5e0 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:18:49.571190 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5bb8f2-7a89-4665-adf4-751323f1e5e0 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:18:49.601980 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:18:49.632372 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6820b7-7883-4b6d-842b-a1011ba65280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:18:49.633044 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6820b7-7883-4b6d-842b-a1011ba65280 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:18:49.633325 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6820b7-7883-4b6d-842b-a1011ba65280 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:18:49.633595 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6820b7-7883-4b6d-842b-a1011ba65280 admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:18:49.634331 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6820b7-7883-4b6d-842b-a1011ba65280 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:18:49.636237 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6820b7-7883-4b6d-842b-a1011ba65280 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:18:49.657965 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4446/8864] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 22:18:49 2022] POST /identity/v3/users => generated 297 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 22:18:49.664122 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0dba52-9dbd-4851-92f2-a7b741d33fe0 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:18:49.677393 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0dba52-9dbd-4851-92f2-a7b741d33fe0 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:18:49.684834 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc6bb02-dc88-4d20-9621-7686bc4e05f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:18:49.685662 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc6bb02-dc88-4d20-9621-7686bc4e05f5 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:18:49.686015 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc6bb02-dc88-4d20-9621-7686bc4e05f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:18:49.686304 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc6bb02-dc88-4d20-9621-7686bc4e05f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:18:49.687361 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc6bb02-dc88-4d20-9621-7686bc4e05f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:18:49.689424 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc6bb02-dc88-4d20-9621-7686bc4e05f5 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:18:49.702777 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4419/8865] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 22:18:49 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 22:18:49.707156 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6820b7-7883-4b6d-842b-a1011ba65280 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:18:49.718313 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6820b7-7883-4b6d-842b-a1011ba65280 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:18:49.723504 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3f591f-a091-4b20-8327-bd1ee06f75bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:18:49.724171 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3f591f-a091-4b20-8327-bd1ee06f75bb admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:18:49.724451 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3f591f-a091-4b20-8327-bd1ee06f75bb admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:18:49.724727 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3f591f-a091-4b20-8327-bd1ee06f75bb admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:18:49.725450 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3f591f-a091-4b20-8327-bd1ee06f75bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:18:49.727094 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3f591f-a091-4b20-8327-bd1ee06f75bb admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:18:49.737463 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4447/8866] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 22:18:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 22:18:49.741803 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc6bb02-dc88-4d20-9621-7686bc4e05f5 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:18:49.752531 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc6bb02-dc88-4d20-9621-7686bc4e05f5 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:18:49.757405 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41151462-5c27-4f76-b45e-bb5be52cc32a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:18:49.758328 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41151462-5c27-4f76-b45e-bb5be52cc32a admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:18:49.758604 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41151462-5c27-4f76-b45e-bb5be52cc32a admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:18:49.758874 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41151462-5c27-4f76-b45e-bb5be52cc32a admin admin] PATH_INFO: `/v3/projects/a14b865dcbd14987870351ce4e45aaac/users/a686380934d042b4a078eb60e9bb6712/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:18:49.774182 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41151462-5c27-4f76-b45e-bb5be52cc32a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a14b865dcbd14987870351ce4e45aaac, user_id=a686380934d042b4a078eb60e9bb6712, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:18:49.776888 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41151462-5c27-4f76-b45e-bb5be52cc32a admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:18:49.790945 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4420/8867] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 22:18:49 2022] PUT /identity/v3/projects/a14b865dcbd14987870351ce4e45aaac/users/a686380934d042b4a078eb60e9bb6712/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:18:49.801842 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bc35e0-4941-4812-b634-9d83a51d922e None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:18:49.802240 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bc35e0-4941-4812-b634-9d83a51d922e None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:18:49.802581 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bc35e0-4941-4812-b634-9d83a51d922e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:18:49.832085 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-57bc35e0-4941-4812-b634-9d83a51d922e None None] MFA Rules not processed for user `a686380934d042b4a078eb60e9bb6712`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:18:49.833323 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-57bc35e0-4941-4812-b634-9d83a51d922e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:18:49.897388 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4448/8868] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:18:49 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:18:49.902389 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41151462-5c27-4f76-b45e-bb5be52cc32a admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:18:49.963620 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41151462-5c27-4f76-b45e-bb5be52cc32a admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:18:49.968487 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4655ce5-b97c-4a26-bc66-331727ea7ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:18:49.969160 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4655ce5-b97c-4a26-bc66-331727ea7ad9 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:18:49.969431 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4655ce5-b97c-4a26-bc66-331727ea7ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:18:49.969699 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4655ce5-b97c-4a26-bc66-331727ea7ad9 admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:18:49.970413 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4655ce5-b97c-4a26-bc66-331727ea7ad9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:18:49.972326 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4655ce5-b97c-4a26-bc66-331727ea7ad9 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:18:49.999385 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4421/8869] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 22:18:49 2022] POST /identity/v3/projects => generated 393 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 22:18:50.003726 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bc35e0-4941-4812-b634-9d83a51d922e None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:18:50.015026 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bc35e0-4941-4812-b634-9d83a51d922e None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:18:50.076340 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85e292e-d6bc-4b0a-ab00-7abaa8dcdd32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:18:50.077018 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85e292e-d6bc-4b0a-ab00-7abaa8dcdd32 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:18:50.077300 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85e292e-d6bc-4b0a-ab00-7abaa8dcdd32 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:18:50.077576 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85e292e-d6bc-4b0a-ab00-7abaa8dcdd32 admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:18:50.078309 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85e292e-d6bc-4b0a-ab00-7abaa8dcdd32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:18:50.080272 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85e292e-d6bc-4b0a-ab00-7abaa8dcdd32 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:18:50.106374 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4449/8870] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 22:18:50 2022] POST /identity/v3/users => generated 303 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 22:18:50.107739 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4655ce5-b97c-4a26-bc66-331727ea7ad9 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:18:50.118630 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4655ce5-b97c-4a26-bc66-331727ea7ad9 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:18:50.124885 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8b42e4-d70a-41da-a20f-e1e54b6199a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:18:50.125568 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8b42e4-d70a-41da-a20f-e1e54b6199a2 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:18:50.125845 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8b42e4-d70a-41da-a20f-e1e54b6199a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:18:50.126147 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8b42e4-d70a-41da-a20f-e1e54b6199a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:18:50.126870 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8b42e4-d70a-41da-a20f-e1e54b6199a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:18:50.128489 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8b42e4-d70a-41da-a20f-e1e54b6199a2 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:18:50.130834 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:18:50.142930 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4422/8871] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 22:18:50 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 22:18:50.147115 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85e292e-d6bc-4b0a-ab00-7abaa8dcdd32 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:18:50.157633 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85e292e-d6bc-4b0a-ab00-7abaa8dcdd32 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:18:50.163391 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445442bd-c71e-4e06-88d3-ca4fd937fff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:18:50.164288 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445442bd-c71e-4e06-88d3-ca4fd937fff1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:18:50.164659 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445442bd-c71e-4e06-88d3-ca4fd937fff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:18:50.164945 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445442bd-c71e-4e06-88d3-ca4fd937fff1 admin admin] PATH_INFO: `/v3/projects/3eeb27796b894ba1aff93dc64a6f2f8b/users/1d1904bf6ebd44d7932ce1598219c500/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:18:50.180126 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445442bd-c71e-4e06-88d3-ca4fd937fff1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3eeb27796b894ba1aff93dc64a6f2f8b, user_id=1d1904bf6ebd44d7932ce1598219c500, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:18:50.182843 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445442bd-c71e-4e06-88d3-ca4fd937fff1 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:18:50.196860 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4450/8872] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 22:18:50 2022] PUT /identity/v3/projects/3eeb27796b894ba1aff93dc64a6f2f8b/users/1d1904bf6ebd44d7932ce1598219c500/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 22:18:50.201004 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8b42e4-d70a-41da-a20f-e1e54b6199a2 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:18:50.211841 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8b42e4-d70a-41da-a20f-e1e54b6199a2 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:18:50.268933 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b555550-8671-4649-b7ca-dc9298a7baa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:18:50.269604 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b555550-8671-4649-b7ca-dc9298a7baa6 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:18:50.269917 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b555550-8671-4649-b7ca-dc9298a7baa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:18:50.270195 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b555550-8671-4649-b7ca-dc9298a7baa6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:18:50.270912 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b555550-8671-4649-b7ca-dc9298a7baa6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:18:50.272506 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b555550-8671-4649-b7ca-dc9298a7baa6 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:18:50.282074 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4423/8873] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 22:18:50 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 22:18:50.286551 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445442bd-c71e-4e06-88d3-ca4fd937fff1 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:18:50.293551 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:18:50.297427 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445442bd-c71e-4e06-88d3-ca4fd937fff1 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:18:50.303821 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd2c85c-b350-449b-bb83-d18f7913eac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:18:50.304719 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd2c85c-b350-449b-bb83-d18f7913eac2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:18:50.305038 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd2c85c-b350-449b-bb83-d18f7913eac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:18:50.305339 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd2c85c-b350-449b-bb83-d18f7913eac2 admin admin] PATH_INFO: `/v3/projects/3eeb27796b894ba1aff93dc64a6f2f8b/users/1d1904bf6ebd44d7932ce1598219c500/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:18:50.307585 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd2c85c-b350-449b-bb83-d18f7913eac2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3eeb27796b894ba1aff93dc64a6f2f8b, user_id=1d1904bf6ebd44d7932ce1598219c500, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:18:50.310312 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd2c85c-b350-449b-bb83-d18f7913eac2 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:18:50.321609 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4451/8874] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 22:18:50 2022] PUT /identity/v3/projects/3eeb27796b894ba1aff93dc64a6f2f8b/users/1d1904bf6ebd44d7932ce1598219c500/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:18:50.332905 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e523c9-6a81-4910-93e4-f5ccd40a546b None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:18:50.333183 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e523c9-6a81-4910-93e4-f5ccd40a546b None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:18:50.333456 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e523c9-6a81-4910-93e4-f5ccd40a546b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:18:50.360589 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-b0e523c9-6a81-4910-93e4-f5ccd40a546b None None] MFA Rules not processed for user `1d1904bf6ebd44d7932ce1598219c500`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:18:50.361785 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-b0e523c9-6a81-4910-93e4-f5ccd40a546b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:18:50.434598 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4424/8875] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:18:50 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:18:50.450602 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd2c85c-b350-449b-bb83-d18f7913eac2 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:18:50.452512 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-4bd2c85c-b350-449b-bb83-d18f7913eac2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:18:50.526357 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd2c85c-b350-449b-bb83-d18f7913eac2 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:18:50.532433 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f030bf-a535-4cd6-ac60-d6a940c2f456 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:18:50.533074 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f030bf-a535-4cd6-ac60-d6a940c2f456 service nova] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:18:50.533351 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f030bf-a535-4cd6-ac60-d6a940c2f456 service nova] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:18:50.533623 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f030bf-a535-4cd6-ac60-d6a940c2f456 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:18:50.590259 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f030bf-a535-4cd6-ac60-d6a940c2f456 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:18:50.591840 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f030bf-a535-4cd6-ac60-d6a940c2f456 service nova] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:18:50.600932 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4452/8876] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:18:50 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:18:53.703172 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e523c9-6a81-4910-93e4-f5ccd40a546b None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:18:53.709410 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-b0e523c9-6a81-4910-93e4-f5ccd40a546b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:18:53.790793 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e523c9-6a81-4910-93e4-f5ccd40a546b None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:18:53.795111 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39641936-9cb7-4369-bdf0-5a8003c29d45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:18:53.795773 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39641936-9cb7-4369-bdf0-5a8003c29d45 service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:18:53.796050 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39641936-9cb7-4369-bdf0-5a8003c29d45 service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:18:53.796410 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39641936-9cb7-4369-bdf0-5a8003c29d45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:18:53.807151 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39641936-9cb7-4369-bdf0-5a8003c29d45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:18:53.808729 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39641936-9cb7-4369-bdf0-5a8003c29d45 service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:18:53.824148 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4425/8877] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:18:53 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:18:56.892201 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e413f671-f470-4e89-8249-75cea9b6bc84 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:18:56.892684 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e413f671-f470-4e89-8249-75cea9b6bc84 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:18:56.892940 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e413f671-f470-4e89-8249-75cea9b6bc84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:18:56.911092 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-e413f671-f470-4e89-8249-75cea9b6bc84 None None] MFA Rules not processed for user `a686380934d042b4a078eb60e9bb6712`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:18:56.912321 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-e413f671-f470-4e89-8249-75cea9b6bc84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:18:56.930291 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4453/8878] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:18:56 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:19:03.815438 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=90 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:19:06.908414 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=62,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:19:09.482155 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39641936-9cb7-4369-bdf0-5a8003c29d45 service neutron] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:19:09.494398 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39641936-9cb7-4369-bdf0-5a8003c29d45 service neutron] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:19:09.501108 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe09b15-8c9b-4434-9781-fe73add5c906 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:19:09.501763 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe09b15-8c9b-4434-9781-fe73add5c906 service nova] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:19:09.502125 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe09b15-8c9b-4434-9781-fe73add5c906 service nova] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:19:09.502373 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe09b15-8c9b-4434-9781-fe73add5c906 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:19:09.504348 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-1fe09b15-8c9b-4434-9781-fe73add5c906 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:19:09.519646 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe09b15-8c9b-4434-9781-fe73add5c906 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:19:09.521213 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe09b15-8c9b-4434-9781-fe73add5c906 service nova] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:19:09.532820 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4426/8879] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:19:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 23 22:19:19.528338 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=6 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:19:27.279775 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e413f671-f470-4e89-8249-75cea9b6bc84 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:19:27.281447 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-e413f671-f470-4e89-8249-75cea9b6bc84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:19:27.354639 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e413f671-f470-4e89-8249-75cea9b6bc84 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:19:27.359976 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b56ca4-8119-4471-b168-5f1160c4a110 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc719a3b3ac4461b82ca04ab6451d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:19:27.360625 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b56ca4-8119-4471-b168-5f1160c4a110 service placement] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:19:27.361018 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b56ca4-8119-4471-b168-5f1160c4a110 service placement] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:19:27.361288 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b56ca4-8119-4471-b168-5f1160c4a110 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:19:27.363376 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-a8b56ca4-8119-4471-b168-5f1160c4a110 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:19:27.375209 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b56ca4-8119-4471-b168-5f1160c4a110 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:19:27.376820 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b56ca4-8119-4471-b168-5f1160c4a110 service placement] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:19:27.386956 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4454/8880] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:19:27 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:19:37.382808 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=32 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:19:47.439988 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe09b15-8c9b-4434-9781-fe73add5c906 service nova] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:19:47.442319 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-1fe09b15-8c9b-4434-9781-fe73add5c906 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:19:47.458341 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe09b15-8c9b-4434-9781-fe73add5c906 service nova] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:19:47.464779 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cd9cc1-77ac-4719-a570-9706f3a6c5f3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc719a3b3ac4461b82ca04ab6451d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:19:47.465439 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cd9cc1-77ac-4719-a570-9706f3a6c5f3 service placement] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:19:47.465714 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cd9cc1-77ac-4719-a570-9706f3a6c5f3 service placement] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:19:47.466067 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cd9cc1-77ac-4719-a570-9706f3a6c5f3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:19:47.467969 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-58cd9cc1-77ac-4719-a570-9706f3a6c5f3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:19:47.480765 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cd9cc1-77ac-4719-a570-9706f3a6c5f3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:19:47.482341 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cd9cc1-77ac-4719-a570-9706f3a6c5f3 service placement] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:19:47.493612 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4427/8881] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:19:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:19:57.192387 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeb7c62-dbbe-432d-834b-d092ae5ce57a None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:19:57.192990 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeb7c62-dbbe-432d-834b-d092ae5ce57a None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:19:57.192990 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeb7c62-dbbe-432d-834b-d092ae5ce57a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:19:57.212978 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-1aeb7c62-dbbe-432d-834b-d092ae5ce57a None None] MFA Rules not processed for user `a686380934d042b4a078eb60e9bb6712`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:19:57.214280 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-1aeb7c62-dbbe-432d-834b-d092ae5ce57a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:19:57.222104 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4455/8882] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:19:57 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:19:57.488783 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=6 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:20:07.207899 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=3 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:21:43.697984 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e2b414-a25b-449a-9414-8c5b91efe712 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:21:43.698585 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e2b414-a25b-449a-9414-8c5b91efe712 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:21:43.698876 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e2b414-a25b-449a-9414-8c5b91efe712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:21:43.738084 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-e8e2b414-a25b-449a-9414-8c5b91efe712 None None] MFA Rules not processed for user `a686380934d042b4a078eb60e9bb6712`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:21:43.739943 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-e8e2b414-a25b-449a-9414-8c5b91efe712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:21:43.750158 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4428/8883] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:21:43 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:21:43.805090 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeb7c62-dbbe-432d-834b-d092ae5ce57a None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:21:43.806597 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-1aeb7c62-dbbe-432d-834b-d092ae5ce57a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:21:43.909317 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeb7c62-dbbe-432d-834b-d092ae5ce57a None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:21:43.913147 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fb4a64-a51f-4083-8813-21d9540fa9a5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7f2db148c8e4d5d81431cae3576434b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:21:43.913821 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fb4a64-a51f-4083-8813-21d9540fa9a5 service glance] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:21:43.914154 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fb4a64-a51f-4083-8813-21d9540fa9a5 service glance] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:21:43.914601 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fb4a64-a51f-4083-8813-21d9540fa9a5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:21:43.916351 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-31fb4a64-a51f-4083-8813-21d9540fa9a5 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:21:43.931175 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fb4a64-a51f-4083-8813-21d9540fa9a5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:21:43.932630 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fb4a64-a51f-4083-8813-21d9540fa9a5 service glance] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:21:43.944924 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4456/8884] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:21:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:21:46.116825 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e2b414-a25b-449a-9414-8c5b91efe712 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:21:46.131097 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e2b414-a25b-449a-9414-8c5b91efe712 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:21:46.137450 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5751e74e-cc79-45a8-9c20-ff03e549d546 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc719a3b3ac4461b82ca04ab6451d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:21:46.138180 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5751e74e-cc79-45a8-9c20-ff03e549d546 service placement] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:21:46.138461 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5751e74e-cc79-45a8-9c20-ff03e549d546 service placement] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:21:46.138751 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5751e74e-cc79-45a8-9c20-ff03e549d546 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:21:46.140702 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-5751e74e-cc79-45a8-9c20-ff03e549d546 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:21:46.152968 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5751e74e-cc79-45a8-9c20-ff03e549d546 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:21:46.154610 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5751e74e-cc79-45a8-9c20-ff03e549d546 service placement] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:21:46.164915 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4429/8885] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:21:46 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:21:50.962232 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fb4a64-a51f-4083-8813-21d9540fa9a5 service glance] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:21:50.975735 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fb4a64-a51f-4083-8813-21d9540fa9a5 service glance] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:21:50.979523 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81daa48f-0b7d-4b49-aaa3-a9e58095de54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:21:50.980176 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81daa48f-0b7d-4b49-aaa3-a9e58095de54 service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:21:50.980459 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81daa48f-0b7d-4b49-aaa3-a9e58095de54 service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:21:50.980731 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81daa48f-0b7d-4b49-aaa3-a9e58095de54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:21:50.982633 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-81daa48f-0b7d-4b49-aaa3-a9e58095de54 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:21:50.993662 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81daa48f-0b7d-4b49-aaa3-a9e58095de54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:21:50.995243 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81daa48f-0b7d-4b49-aaa3-a9e58095de54 service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:21:51.004487 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4457/8886] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:21:50 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 23 22:21:56.160824 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=13 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:22:01.000592 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=50 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:22:33.553241 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1760897-61c1-4518-b13e-5aa07aff4e2f None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:22:33.553905 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1760897-61c1-4518-b13e-5aa07aff4e2f None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:22:33.553905 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1760897-61c1-4518-b13e-5aa07aff4e2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:22:33.593565 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-d1760897-61c1-4518-b13e-5aa07aff4e2f None None] MFA Rules not processed for user `c497326ee890462e8f48b4a56f81990c`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:22:33.594935 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-d1760897-61c1-4518-b13e-5aa07aff4e2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:22:33.602953 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4430/8887] 10.222.0.17 () {58 vars in 1018 bytes} [Sat Jul 23 22:22:33 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:22:33.614532 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81daa48f-0b7d-4b49-aaa3-a9e58095de54 service neutron] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:22:33.616054 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-81daa48f-0b7d-4b49-aaa3-a9e58095de54 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:22:33.627522 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81daa48f-0b7d-4b49-aaa3-a9e58095de54 service neutron] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:22:33.631312 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4571e893-f24c-409e-93af-3ba1bc5d8fcb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:22:33.632040 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4571e893-f24c-409e-93af-3ba1bc5d8fcb service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:22:33.632318 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4571e893-f24c-409e-93af-3ba1bc5d8fcb service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:22:33.632589 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4571e893-f24c-409e-93af-3ba1bc5d8fcb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:22:33.640539 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4571e893-f24c-409e-93af-3ba1bc5d8fcb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:22:33.642119 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4571e893-f24c-409e-93af-3ba1bc5d8fcb service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:22:33.650502 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4458/8888] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:22:33 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:22:33.745515 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfc26ae-0a1a-4e69-a803-4fc138ed77f2 None None] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:22:33.745771 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfc26ae-0a1a-4e69-a803-4fc138ed77f2 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:22:33.746107 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfc26ae-0a1a-4e69-a803-4fc138ed77f2 None None] PATH_INFO: `/` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:22:33.747483 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4431/8889] 10.222.0.17 () {54 vars in 921 bytes} [Sat Jul 23 22:22:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 23 22:22:33.752578 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df75778-6465-496f-aa90-2473af57867d None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:22:33.752866 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df75778-6465-496f-aa90-2473af57867d None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:22:33.753266 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df75778-6465-496f-aa90-2473af57867d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:22:33.772413 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-6df75778-6465-496f-aa90-2473af57867d None None] MFA Rules not processed for user `abc719a3b3ac4461b82ca04ab6451d81`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:22:33.773610 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-6df75778-6465-496f-aa90-2473af57867d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:22:33.803623 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4459/8890] 10.222.0.17 () {58 vars in 1018 bytes} [Sat Jul 23 22:22:33 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:22:33.826114 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfc26ae-0a1a-4e69-a803-4fc138ed77f2 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:22:33.841064 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfc26ae-0a1a-4e69-a803-4fc138ed77f2 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:22:33.846569 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc8110a-edce-446a-b50a-2db325874c6b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc719a3b3ac4461b82ca04ab6451d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:22:33.847217 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc8110a-edce-446a-b50a-2db325874c6b service placement] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:22:33.847494 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc8110a-edce-446a-b50a-2db325874c6b service placement] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:22:33.847761 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc8110a-edce-446a-b50a-2db325874c6b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:22:33.856679 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc8110a-edce-446a-b50a-2db325874c6b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:22:33.858303 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc8110a-edce-446a-b50a-2db325874c6b service placement] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:22:33.868218 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4432/8891] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:22:33 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:22:34.040310 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f6e978-58db-4d05-a085-3cfda73cc2f0 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:22:34.040673 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f6e978-58db-4d05-a085-3cfda73cc2f0 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:22:34.040955 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f6e978-58db-4d05-a085-3cfda73cc2f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:22:34.079796 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-e1f6e978-58db-4d05-a085-3cfda73cc2f0 None None] MFA Rules not processed for user `079f31ed2c844e67bd4e206f24b69d97`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:22:34.081006 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-e1f6e978-58db-4d05-a085-3cfda73cc2f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:22:34.091019 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4460/8892] 10.222.0.17 () {58 vars in 1018 bytes} [Sat Jul 23 22:22:34 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:22:34.101835 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc8110a-edce-446a-b50a-2db325874c6b service placement] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:22:34.112059 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc8110a-edce-446a-b50a-2db325874c6b service placement] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:22:34.116029 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acac9f56-e71c-4834-a45a-a44ce220d98f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:22:34.116645 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acac9f56-e71c-4834-a45a-a44ce220d98f service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:22:34.117008 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acac9f56-e71c-4834-a45a-a44ce220d98f service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:22:34.117338 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acac9f56-e71c-4834-a45a-a44ce220d98f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:22:34.128484 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acac9f56-e71c-4834-a45a-a44ce220d98f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:22:34.129953 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acac9f56-e71c-4834-a45a-a44ce220d98f service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:22:34.141028 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4433/8893] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:22:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:22:44.077629 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=27 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:22:44.136260 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=21 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:22:52.897278 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f6e978-58db-4d05-a085-3cfda73cc2f0 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:22:52.918059 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f6e978-58db-4d05-a085-3cfda73cc2f0 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:22:52.921557 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea61e72b-ded6-4dda-8f57-ddbf8ebda21a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:22:52.922239 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea61e72b-ded6-4dda-8f57-ddbf8ebda21a service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:22:52.922527 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea61e72b-ded6-4dda-8f57-ddbf8ebda21a service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:22:52.922798 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea61e72b-ded6-4dda-8f57-ddbf8ebda21a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:22:52.924596 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-ea61e72b-ded6-4dda-8f57-ddbf8ebda21a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:22:52.933822 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea61e72b-ded6-4dda-8f57-ddbf8ebda21a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:22:52.935281 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea61e72b-ded6-4dda-8f57-ddbf8ebda21a service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:22:52.943207 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4461/8894] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:22:52 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:23:02.940132 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=10 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:23:27.989082 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acac9f56-e71c-4834-a45a-a44ce220d98f service neutron] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:23:28.000602 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acac9f56-e71c-4834-a45a-a44ce220d98f service neutron] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:23:28.006922 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5801c5ae-eaf9-4039-a3be-0e410df84909 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:23:28.007607 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5801c5ae-eaf9-4039-a3be-0e410df84909 service nova] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:23:28.007887 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5801c5ae-eaf9-4039-a3be-0e410df84909 service nova] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:23:28.008157 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5801c5ae-eaf9-4039-a3be-0e410df84909 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:23:28.010039 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-5801c5ae-eaf9-4039-a3be-0e410df84909 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:23:28.023470 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5801c5ae-eaf9-4039-a3be-0e410df84909 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:23:28.025163 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5801c5ae-eaf9-4039-a3be-0e410df84909 service nova] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:23:28.036689 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4434/8895] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:23:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:23:33.284931 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea61e72b-ded6-4dda-8f57-ddbf8ebda21a service neutron] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:23:33.298896 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea61e72b-ded6-4dda-8f57-ddbf8ebda21a service neutron] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:23:33.304629 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13c3e39-7ef4-4aa4-b70c-278d28b00323 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc719a3b3ac4461b82ca04ab6451d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:23:33.305366 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13c3e39-7ef4-4aa4-b70c-278d28b00323 service placement] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:23:33.305669 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13c3e39-7ef4-4aa4-b70c-278d28b00323 service placement] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:23:33.305981 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13c3e39-7ef4-4aa4-b70c-278d28b00323 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:23:33.307944 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-e13c3e39-7ef4-4aa4-b70c-278d28b00323 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:23:33.339361 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13c3e39-7ef4-4aa4-b70c-278d28b00323 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:23:33.341212 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13c3e39-7ef4-4aa4-b70c-278d28b00323 service placement] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:23:33.364402 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4462/8896] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:23:33 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:23:38.032080 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=6 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:23:39.435139 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f161e3-82ad-4201-b463-53f3dd3f75a0 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:23:39.435733 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f161e3-82ad-4201-b463-53f3dd3f75a0 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:23:39.435733 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f161e3-82ad-4201-b463-53f3dd3f75a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:23:39.461306 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-e5f161e3-82ad-4201-b463-53f3dd3f75a0 None None] MFA Rules not processed for user `a686380934d042b4a078eb60e9bb6712`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:23:39.462660 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-e5f161e3-82ad-4201-b463-53f3dd3f75a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:23:39.470211 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4435/8897] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:23:39 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:23:39.820595 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13c3e39-7ef4-4aa4-b70c-278d28b00323 service placement] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:23:39.830968 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13c3e39-7ef4-4aa4-b70c-278d28b00323 service placement] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:23:39.835676 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f11973-add2-4322-9c38-a4b965d4be79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:23:39.835676 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f11973-add2-4322-9c38-a4b965d4be79 service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:23:39.836088 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f11973-add2-4322-9c38-a4b965d4be79 service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:23:39.836358 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f11973-add2-4322-9c38-a4b965d4be79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:23:39.838291 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-09f11973-add2-4322-9c38-a4b965d4be79 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:23:39.848102 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f11973-add2-4322-9c38-a4b965d4be79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:23:39.849521 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f11973-add2-4322-9c38-a4b965d4be79 service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:23:39.858070 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4463/8898] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:23:39 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 23 22:23:49.310901 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f161e3-82ad-4201-b463-53f3dd3f75a0 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:23:49.326413 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f161e3-82ad-4201-b463-53f3dd3f75a0 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:23:49.332347 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d841ab7a-7da5-4e70-a7ef-0ca53b44fbaf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:23:49.333043 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d841ab7a-7da5-4e70-a7ef-0ca53b44fbaf service nova] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:23:49.333328 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d841ab7a-7da5-4e70-a7ef-0ca53b44fbaf service nova] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:23:49.333602 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d841ab7a-7da5-4e70-a7ef-0ca53b44fbaf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:23:49.335495 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-d841ab7a-7da5-4e70-a7ef-0ca53b44fbaf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:23:49.348466 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d841ab7a-7da5-4e70-a7ef-0ca53b44fbaf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:23:49.350111 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d841ab7a-7da5-4e70-a7ef-0ca53b44fbaf service nova] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:23:49.361141 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4436/8899] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:23:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:23:49.854251 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=17 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:23:49.887359 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f11973-add2-4322-9c38-a4b965d4be79 service neutron] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:23:49.902619 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f11973-add2-4322-9c38-a4b965d4be79 service neutron] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:23:49.910061 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d66e281-f8a8-4595-ac96-48e09808eed1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:23:49.910712 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d66e281-f8a8-4595-ac96-48e09808eed1 service nova] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:23:49.910994 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d66e281-f8a8-4595-ac96-48e09808eed1 service nova] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:23:49.911268 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d66e281-f8a8-4595-ac96-48e09808eed1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:23:49.919546 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d66e281-f8a8-4595-ac96-48e09808eed1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:23:49.921132 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d66e281-f8a8-4595-ac96-48e09808eed1 service nova] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:23:49.930709 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4464/8900] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:23:49 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:23:59.357398 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=9 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:23:59.926400 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=6 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:24:33.319621 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d841ab7a-7da5-4e70-a7ef-0ca53b44fbaf service nova] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:24:33.332113 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d841ab7a-7da5-4e70-a7ef-0ca53b44fbaf service nova] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:24:33.338679 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012440be-197d-4cc8-99e8-c0a5df0057cc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc719a3b3ac4461b82ca04ab6451d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:24:33.339330 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012440be-197d-4cc8-99e8-c0a5df0057cc service placement] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:24:33.339616 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012440be-197d-4cc8-99e8-c0a5df0057cc service placement] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:24:33.339889 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012440be-197d-4cc8-99e8-c0a5df0057cc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:24:33.348823 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012440be-197d-4cc8-99e8-c0a5df0057cc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:24:33.350468 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012440be-197d-4cc8-99e8-c0a5df0057cc service placement] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:24:33.360641 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4437/8901] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:24:33 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:24:43.356622 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=6 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:25:00.048905 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d66e281-f8a8-4595-ac96-48e09808eed1 service nova] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:25:00.061324 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d66e281-f8a8-4595-ac96-48e09808eed1 service nova] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:25:00.067527 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57612cda-9e78-4413-ba99-1fbd08e0134a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc719a3b3ac4461b82ca04ab6451d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:25:00.068187 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57612cda-9e78-4413-ba99-1fbd08e0134a service placement] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:25:00.068467 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57612cda-9e78-4413-ba99-1fbd08e0134a service placement] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:25:00.068740 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57612cda-9e78-4413-ba99-1fbd08e0134a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:25:00.078984 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57612cda-9e78-4413-ba99-1fbd08e0134a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:25:00.080556 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57612cda-9e78-4413-ba99-1fbd08e0134a service placement] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:25:00.091046 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4465/8902] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:25:00 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:25:10.086797 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=6 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:25:17.522182 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012440be-197d-4cc8-99e8-c0a5df0057cc service placement] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:25:17.536215 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012440be-197d-4cc8-99e8-c0a5df0057cc service placement] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:25:17.543471 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90da4eb4-54db-44b6-b7cf-6d04dbbe5e3e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:25:17.544128 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90da4eb4-54db-44b6-b7cf-6d04dbbe5e3e service nova] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:25:17.544413 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90da4eb4-54db-44b6-b7cf-6d04dbbe5e3e service nova] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:25:17.544687 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90da4eb4-54db-44b6-b7cf-6d04dbbe5e3e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:25:17.555749 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90da4eb4-54db-44b6-b7cf-6d04dbbe5e3e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:25:17.557365 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90da4eb4-54db-44b6-b7cf-6d04dbbe5e3e service nova] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:25:17.568934 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4438/8903] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:25:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:25:22.086359 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57612cda-9e78-4413-ba99-1fbd08e0134a service placement] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:25:22.098021 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57612cda-9e78-4413-ba99-1fbd08e0134a service placement] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:25:22.103486 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312a1512-0d51-4d31-8f14-4b296b7101b6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc719a3b3ac4461b82ca04ab6451d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:25:22.104149 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312a1512-0d51-4d31-8f14-4b296b7101b6 service placement] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:25:22.104426 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312a1512-0d51-4d31-8f14-4b296b7101b6 service placement] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:25:22.104694 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312a1512-0d51-4d31-8f14-4b296b7101b6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:25:22.106521 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-312a1512-0d51-4d31-8f14-4b296b7101b6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:25:22.119719 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312a1512-0d51-4d31-8f14-4b296b7101b6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:25:22.121484 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312a1512-0d51-4d31-8f14-4b296b7101b6 service placement] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:25:22.134168 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4466/8904] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:25:22 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:25:25.051052 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90da4eb4-54db-44b6-b7cf-6d04dbbe5e3e service nova] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:25:25.064361 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90da4eb4-54db-44b6-b7cf-6d04dbbe5e3e service nova] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:25:25.068373 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de844612-5a3e-4249-bc3b-0da151776e8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:25:25.068996 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de844612-5a3e-4249-bc3b-0da151776e8f service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:25:25.069275 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de844612-5a3e-4249-bc3b-0da151776e8f service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:25:25.069549 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de844612-5a3e-4249-bc3b-0da151776e8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:25:25.079807 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de844612-5a3e-4249-bc3b-0da151776e8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:25:25.081339 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de844612-5a3e-4249-bc3b-0da151776e8f service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:25:25.091709 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4439/8905] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:25:25 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:25:28.055166 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc58af3d-e6a0-41e8-84a9-4c1182754b3a None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:25:28.055656 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc58af3d-e6a0-41e8-84a9-4c1182754b3a None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:25:28.055898 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc58af3d-e6a0-41e8-84a9-4c1182754b3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:25:28.077141 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-bc58af3d-e6a0-41e8-84a9-4c1182754b3a None None] MFA Rules not processed for user `a686380934d042b4a078eb60e9bb6712`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:25:28.078557 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-bc58af3d-e6a0-41e8-84a9-4c1182754b3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:25:28.089688 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4467/8906] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:25:28 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:25:28.892734 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de844612-5a3e-4249-bc3b-0da151776e8f service neutron] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:25:28.908968 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de844612-5a3e-4249-bc3b-0da151776e8f service neutron] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:25:28.917034 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cece7c-6f93-4da4-b237-5ec6e8787358 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc719a3b3ac4461b82ca04ab6451d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:25:28.917713 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cece7c-6f93-4da4-b237-5ec6e8787358 service placement] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:25:28.918034 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cece7c-6f93-4da4-b237-5ec6e8787358 service placement] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:25:28.918795 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cece7c-6f93-4da4-b237-5ec6e8787358 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:25:28.920922 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-02cece7c-6f93-4da4-b237-5ec6e8787358 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:25:28.942935 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cece7c-6f93-4da4-b237-5ec6e8787358 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:25:28.944717 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cece7c-6f93-4da4-b237-5ec6e8787358 service placement] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:25:28.961647 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4440/8907] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:25:28 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 23 22:25:38.070825 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=9 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:25:38.956166 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=18 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:26:25.746311 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc58af3d-e6a0-41e8-84a9-4c1182754b3a None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:26:25.816628 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc58af3d-e6a0-41e8-84a9-4c1182754b3a None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:26:25.822162 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601f51d5-4fc6-49ca-81e6-28567901c2bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:26:25.823144 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601f51d5-4fc6-49ca-81e6-28567901c2bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:26:25.823422 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601f51d5-4fc6-49ca-81e6-28567901c2bd admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:26:25.823726 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601f51d5-4fc6-49ca-81e6-28567901c2bd admin admin] PATH_INFO: `/v3/users/a686380934d042b4a078eb60e9bb6712` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:26:25.825352 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601f51d5-4fc6-49ca-81e6-28567901c2bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=a686380934d042b4a078eb60e9bb6712)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:26:25.827336 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601f51d5-4fc6-49ca-81e6-28567901c2bd admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:26:25.876690 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-601f51d5-4fc6-49ca-81e6-28567901c2bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a686380934d042b4a078eb60e9bb6712'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:26:25.877328 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-601f51d5-4fc6-49ca-81e6-28567901c2bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a686380934d042b4a078eb60e9bb6712'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:26:25.884194 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-601f51d5-4fc6-49ca-81e6-28567901c2bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a686380934d042b4a078eb60e9bb6712'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:26:25.894561 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-601f51d5-4fc6-49ca-81e6-28567901c2bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a686380934d042b4a078eb60e9bb6712'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:26:25.913326 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-601f51d5-4fc6-49ca-81e6-28567901c2bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a686380934d042b4a078eb60e9bb6712'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:26:25.922601 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4468/8908] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 22:26:25 2022] DELETE /identity/v3/users/a686380934d042b4a078eb60e9bb6712 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:26:25.929262 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14c7c9b-2193-4565-8f3d-753e58c07689 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:26:25.929748 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14c7c9b-2193-4565-8f3d-753e58c07689 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:26:25.930100 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14c7c9b-2193-4565-8f3d-753e58c07689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:26:25.953838 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-f14c7c9b-2193-4565-8f3d-753e58c07689 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:26:25.955616 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-f14c7c9b-2193-4565-8f3d-753e58c07689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:26:26.027401 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4441/8909] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:26:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:26:26.037498 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601f51d5-4fc6-49ca-81e6-28567901c2bd admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:26:26.038986 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-601f51d5-4fc6-49ca-81e6-28567901c2bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:26:26.099429 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601f51d5-4fc6-49ca-81e6-28567901c2bd admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:26:26.103961 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528ff857-d460-4627-9798-28c9820b0694 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:26:26.104622 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528ff857-d460-4627-9798-28c9820b0694 service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:26:26.104928 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528ff857-d460-4627-9798-28c9820b0694 service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:26:26.105206 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528ff857-d460-4627-9798-28c9820b0694 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:26:26.114952 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528ff857-d460-4627-9798-28c9820b0694 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:26:26.116397 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528ff857-d460-4627-9798-28c9820b0694 service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:26:26.126855 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4469/8910] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:26:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:26:26.307924 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14c7c9b-2193-4565-8f3d-753e58c07689 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:26:26.309622 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-f14c7c9b-2193-4565-8f3d-753e58c07689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:26:26.322760 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14c7c9b-2193-4565-8f3d-753e58c07689 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:26:26.328536 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab62f7f0-d8c7-436e-a41b-1c9012c24974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:26:26.329422 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab62f7f0-d8c7-436e-a41b-1c9012c24974 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:26:26.329703 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab62f7f0-d8c7-436e-a41b-1c9012c24974 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:26:26.330025 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab62f7f0-d8c7-436e-a41b-1c9012c24974 admin admin] PATH_INFO: `/v3/projects/a14b865dcbd14987870351ce4e45aaac` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:26:26.331268 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab62f7f0-d8c7-436e-a41b-1c9012c24974 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a14b865dcbd14987870351ce4e45aaac)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:26:26.333179 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab62f7f0-d8c7-436e-a41b-1c9012c24974 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:26:26.383324 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-ab62f7f0-d8c7-436e-a41b-1c9012c24974 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a14b865dcbd14987870351ce4e45aaac', 'request_id': 'req-ab62f7f0-d8c7-436e-a41b-1c9012c24974'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:26:26.393282 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-ab62f7f0-d8c7-436e-a41b-1c9012c24974 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a14b865dcbd14987870351ce4e45aaac', 'request_id': 'req-ab62f7f0-d8c7-436e-a41b-1c9012c24974'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:26:26.402060 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-ab62f7f0-d8c7-436e-a41b-1c9012c24974 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a14b865dcbd14987870351ce4e45aaac', 'request_id': 'req-ab62f7f0-d8c7-436e-a41b-1c9012c24974'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:26:26.414239 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-ab62f7f0-d8c7-436e-a41b-1c9012c24974 admin admin] The token cache is being invalidate because project a14b865dcbd14987870351ce4e45aaac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 22:26:26.414508 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-ab62f7f0-d8c7-436e-a41b-1c9012c24974 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:26:26.415204 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-ab62f7f0-d8c7-436e-a41b-1c9012c24974 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:26:26.416836 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4442/8911] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 22:26:26 2022] DELETE /identity/v3/projects/a14b865dcbd14987870351ce4e45aaac => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:26:26.421166 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528ff857-d460-4627-9798-28c9820b0694 service neutron] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:26:26.431404 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528ff857-d460-4627-9798-28c9820b0694 service neutron] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:26:26.452851 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:26:26.498085 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b8ad13-2873-4bf0-82e5-f769c4c6fcfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:26:26.498980 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b8ad13-2873-4bf0-82e5-f769c4c6fcfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:26:26.499254 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b8ad13-2873-4bf0-82e5-f769c4c6fcfa admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:26:26.499525 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b8ad13-2873-4bf0-82e5-f769c4c6fcfa admin admin] PATH_INFO: `/v3/users/1d1904bf6ebd44d7932ce1598219c500` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:26:26.500719 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b8ad13-2873-4bf0-82e5-f769c4c6fcfa admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d1904bf6ebd44d7932ce1598219c500)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:26:26.502725 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b8ad13-2873-4bf0-82e5-f769c4c6fcfa admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:26:26.550255 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-76b8ad13-2873-4bf0-82e5-f769c4c6fcfa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d1904bf6ebd44d7932ce1598219c500'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:26:26.550914 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-76b8ad13-2873-4bf0-82e5-f769c4c6fcfa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d1904bf6ebd44d7932ce1598219c500'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:26:26.557904 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-76b8ad13-2873-4bf0-82e5-f769c4c6fcfa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d1904bf6ebd44d7932ce1598219c500'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:26:26.566878 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-76b8ad13-2873-4bf0-82e5-f769c4c6fcfa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d1904bf6ebd44d7932ce1598219c500'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:26:26.579209 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-76b8ad13-2873-4bf0-82e5-f769c4c6fcfa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d1904bf6ebd44d7932ce1598219c500'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:26:26.585361 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4470/8912] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 22:26:26 2022] DELETE /identity/v3/users/1d1904bf6ebd44d7932ce1598219c500 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:26:26.887409 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab62f7f0-d8c7-436e-a41b-1c9012c24974 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:26:26.888907 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-ab62f7f0-d8c7-436e-a41b-1c9012c24974 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:26:26.902621 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab62f7f0-d8c7-436e-a41b-1c9012c24974 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:26:26.961387 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4010d8cf-0da4-4026-aa94-03778e8a445b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:26:26.962212 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4010d8cf-0da4-4026-aa94-03778e8a445b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:26:26.962489 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4010d8cf-0da4-4026-aa94-03778e8a445b admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:26:26.962759 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4010d8cf-0da4-4026-aa94-03778e8a445b admin admin] PATH_INFO: `/v3/projects/3eeb27796b894ba1aff93dc64a6f2f8b` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:26:26.963970 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4010d8cf-0da4-4026-aa94-03778e8a445b admin admin] RBAC: Authorizing `identity:delete_project(project_id=3eeb27796b894ba1aff93dc64a6f2f8b)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:26:26.965959 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4010d8cf-0da4-4026-aa94-03778e8a445b admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:26:26.999966 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:26:27.017356 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-4010d8cf-0da4-4026-aa94-03778e8a445b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3eeb27796b894ba1aff93dc64a6f2f8b', 'request_id': 'req-4010d8cf-0da4-4026-aa94-03778e8a445b'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:26:27.026209 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-4010d8cf-0da4-4026-aa94-03778e8a445b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3eeb27796b894ba1aff93dc64a6f2f8b', 'request_id': 'req-4010d8cf-0da4-4026-aa94-03778e8a445b'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:26:27.032110 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-4010d8cf-0da4-4026-aa94-03778e8a445b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3eeb27796b894ba1aff93dc64a6f2f8b', 'request_id': 'req-4010d8cf-0da4-4026-aa94-03778e8a445b'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:26:27.044446 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-4010d8cf-0da4-4026-aa94-03778e8a445b admin admin] The token cache is being invalidate because project 3eeb27796b894ba1aff93dc64a6f2f8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 22:26:27.044760 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-4010d8cf-0da4-4026-aa94-03778e8a445b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:26:27.045482 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-4010d8cf-0da4-4026-aa94-03778e8a445b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:26:27.048354 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4443/8913] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 22:26:26 2022] DELETE /identity/v3/projects/3eeb27796b894ba1aff93dc64a6f2f8b => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:26:27.052749 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e012fab-53d4-4d8b-921e-385bd5ac9c99 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:26:27.053235 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e012fab-53d4-4d8b-921e-385bd5ac9c99 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:26:27.053356 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e012fab-53d4-4d8b-921e-385bd5ac9c99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:26:27.073220 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-5e012fab-53d4-4d8b-921e-385bd5ac9c99 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:26:27.075054 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-5e012fab-53d4-4d8b-921e-385bd5ac9c99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:26:27.135080 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4471/8914] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:26:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:26:27.144099 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c683d1bc-e9e6-4051-8173-c0b9eeb55702 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:26:27.144328 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c683d1bc-e9e6-4051-8173-c0b9eeb55702 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:26:27.144815 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c683d1bc-e9e6-4051-8173-c0b9eeb55702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:26:27.164139 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-c683d1bc-e9e6-4051-8173-c0b9eeb55702 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:26:27.165329 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-c683d1bc-e9e6-4051-8173-c0b9eeb55702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:26:27.173894 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4444/8915] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:26:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:26:27.178437 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e012fab-53d4-4d8b-921e-385bd5ac9c99 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:26:27.188851 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e012fab-53d4-4d8b-921e-385bd5ac9c99 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:26:27.194418 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a56e62-e279-46f8-bfe7-337aa7a4f734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:26:27.195074 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a56e62-e279-46f8-bfe7-337aa7a4f734 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:26:27.195351 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a56e62-e279-46f8-bfe7-337aa7a4f734 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:26:27.195621 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a56e62-e279-46f8-bfe7-337aa7a4f734 admin admin] PATH_INFO: `/v3/domains` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:26:27.196356 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a56e62-e279-46f8-bfe7-337aa7a4f734 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 22:26:27.196654 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a56e62-e279-46f8-bfe7-337aa7a4f734 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:26:27.198414 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a56e62-e279-46f8-bfe7-337aa7a4f734 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:26:27.213982 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4472/8916] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 22:26:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 22:26:27.215680 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c683d1bc-e9e6-4051-8173-c0b9eeb55702 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:26:27.225150 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c683d1bc-e9e6-4051-8173-c0b9eeb55702 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:26:27.229727 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fcb55d-c607-49c6-ae38-951c1a3e21e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:26:27.230472 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fcb55d-c607-49c6-ae38-951c1a3e21e8 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:26:27.230748 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fcb55d-c607-49c6-ae38-951c1a3e21e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:26:27.231018 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fcb55d-c607-49c6-ae38-951c1a3e21e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:26:27.232027 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fcb55d-c607-49c6-ae38-951c1a3e21e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:26:27.234080 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fcb55d-c607-49c6-ae38-951c1a3e21e8 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:26:27.261343 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4445/8917] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 22:26:27 2022] POST /identity/v3/projects => generated 371 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 22:26:27.265684 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a56e62-e279-46f8-bfe7-337aa7a4f734 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:26:27.276064 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a56e62-e279-46f8-bfe7-337aa7a4f734 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:26:27.311663 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:26:27.350839 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55973b3f-c1e5-48b0-95ee-7293af98894f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:26:27.351502 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55973b3f-c1e5-48b0-95ee-7293af98894f admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:26:27.351788 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55973b3f-c1e5-48b0-95ee-7293af98894f admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:26:27.352067 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55973b3f-c1e5-48b0-95ee-7293af98894f admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:26:27.352762 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55973b3f-c1e5-48b0-95ee-7293af98894f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:26:27.354727 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55973b3f-c1e5-48b0-95ee-7293af98894f admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:26:27.375827 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4473/8918] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 22:26:27 2022] POST /identity/v3/users => generated 286 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 22:26:27.380148 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fcb55d-c607-49c6-ae38-951c1a3e21e8 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:26:27.390877 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fcb55d-c607-49c6-ae38-951c1a3e21e8 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:26:27.396081 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99a018e-1534-411d-b6ec-0f5b05ea11b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:26:27.396743 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99a018e-1534-411d-b6ec-0f5b05ea11b8 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:26:27.397021 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99a018e-1534-411d-b6ec-0f5b05ea11b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:26:27.397292 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99a018e-1534-411d-b6ec-0f5b05ea11b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:26:27.398032 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99a018e-1534-411d-b6ec-0f5b05ea11b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:26:27.399617 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99a018e-1534-411d-b6ec-0f5b05ea11b8 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:26:27.410484 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4446/8919] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 22:26:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 22:26:27.414504 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55973b3f-c1e5-48b0-95ee-7293af98894f admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:26:27.424900 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55973b3f-c1e5-48b0-95ee-7293af98894f admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:26:27.430618 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce39b730-a946-4ee9-ae3f-10fa067282a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:26:27.431272 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce39b730-a946-4ee9-ae3f-10fa067282a6 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:26:27.431560 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce39b730-a946-4ee9-ae3f-10fa067282a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:26:27.431831 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce39b730-a946-4ee9-ae3f-10fa067282a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:26:27.432547 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce39b730-a946-4ee9-ae3f-10fa067282a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:26:27.434334 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce39b730-a946-4ee9-ae3f-10fa067282a6 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:26:27.444400 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4474/8920] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 22:26:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 22:26:27.448905 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99a018e-1534-411d-b6ec-0f5b05ea11b8 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:26:27.459677 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99a018e-1534-411d-b6ec-0f5b05ea11b8 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:26:27.464791 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd686ac8-e1c0-40d8-baff-61e8c64e56f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:26:27.465610 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd686ac8-e1c0-40d8-baff-61e8c64e56f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:26:27.465903 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd686ac8-e1c0-40d8-baff-61e8c64e56f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:26:27.466178 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd686ac8-e1c0-40d8-baff-61e8c64e56f4 admin admin] PATH_INFO: `/v3/projects/b45dbfa8603541f686c9b2e0bf291dd7/users/c72a610b85c64df7ab471c6ee1d68dcd/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:26:27.481279 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd686ac8-e1c0-40d8-baff-61e8c64e56f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b45dbfa8603541f686c9b2e0bf291dd7, user_id=c72a610b85c64df7ab471c6ee1d68dcd, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:26:27.484043 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd686ac8-e1c0-40d8-baff-61e8c64e56f4 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:26:27.499463 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4447/8921] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 22:26:27 2022] PUT /identity/v3/projects/b45dbfa8603541f686c9b2e0bf291dd7/users/c72a610b85c64df7ab471c6ee1d68dcd/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 22:26:27.504870 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a9327b-9a8a-42da-a5ef-75e89936321a None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:26:27.505176 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a9327b-9a8a-42da-a5ef-75e89936321a None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:26:27.505442 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a9327b-9a8a-42da-a5ef-75e89936321a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:26:27.524161 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-30a9327b-9a8a-42da-a5ef-75e89936321a None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:26:27.525413 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-30a9327b-9a8a-42da-a5ef-75e89936321a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:26:27.589689 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4475/8922] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:26:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:26:27.600547 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd686ac8-e1c0-40d8-baff-61e8c64e56f4 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:26:27.603673 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-bd686ac8-e1c0-40d8-baff-61e8c64e56f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:26:27.675610 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd686ac8-e1c0-40d8-baff-61e8c64e56f4 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:26:27.682455 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b618181-19ed-41a0-9cb4-336909af8061 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:26:27.683366 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b618181-19ed-41a0-9cb4-336909af8061 service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:26:27.683645 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b618181-19ed-41a0-9cb4-336909af8061 service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:26:27.683913 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b618181-19ed-41a0-9cb4-336909af8061 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:26:27.694661 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b618181-19ed-41a0-9cb4-336909af8061 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:26:27.696112 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b618181-19ed-41a0-9cb4-336909af8061 service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:26:27.706572 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4448/8923] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:26:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:26:31.519312 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77860cb1-6b75-4324-afcb-b5741703ea2f None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:26:31.519772 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77860cb1-6b75-4324-afcb-b5741703ea2f None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:26:31.519886 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77860cb1-6b75-4324-afcb-b5741703ea2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:26:31.548507 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-77860cb1-6b75-4324-afcb-b5741703ea2f None None] MFA Rules not processed for user `c72a610b85c64df7ab471c6ee1d68dcd`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:26:31.549737 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-77860cb1-6b75-4324-afcb-b5741703ea2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:26:31.629504 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4476/8924] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:26:31 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:26:31.634351 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b618181-19ed-41a0-9cb4-336909af8061 service neutron] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:26:31.645093 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b618181-19ed-41a0-9cb4-336909af8061 service neutron] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:26:31.649650 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a68c28c-198d-4ff3-94fa-9a92ee6dc33d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:26:31.650363 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a68c28c-198d-4ff3-94fa-9a92ee6dc33d admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:26:31.650634 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a68c28c-198d-4ff3-94fa-9a92ee6dc33d admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:26:31.650905 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a68c28c-198d-4ff3-94fa-9a92ee6dc33d admin admin] PATH_INFO: `/v3/projects` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:26:31.651657 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a68c28c-198d-4ff3-94fa-9a92ee6dc33d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:26:31.653748 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a68c28c-198d-4ff3-94fa-9a92ee6dc33d admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:26:31.683643 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4449/8925] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 22:26:31 2022] POST /identity/v3/projects => generated 371 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 22:26:31.684834 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77860cb1-6b75-4324-afcb-b5741703ea2f None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:26:31.696118 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77860cb1-6b75-4324-afcb-b5741703ea2f None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:26:31.732304 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:26:31.757540 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d75b45-8c90-4d9e-a966-61c79f7646b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:26:31.758309 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d75b45-8c90-4d9e-a966-61c79f7646b3 admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:26:31.758593 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d75b45-8c90-4d9e-a966-61c79f7646b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:26:31.758867 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d75b45-8c90-4d9e-a966-61c79f7646b3 admin admin] PATH_INFO: `/v3/users` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:26:31.759563 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d75b45-8c90-4d9e-a966-61c79f7646b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:26:31.761637 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d75b45-8c90-4d9e-a966-61c79f7646b3 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:26:31.788608 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4477/8926] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 22:26:31 2022] POST /identity/v3/users => generated 292 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 22:26:31.789986 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a68c28c-198d-4ff3-94fa-9a92ee6dc33d admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:26:31.801258 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a68c28c-198d-4ff3-94fa-9a92ee6dc33d admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:26:31.806297 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fd7086-1a95-4cd7-af27-9b7fb8161898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:26:31.807094 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fd7086-1a95-4cd7-af27-9b7fb8161898 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:26:31.807439 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fd7086-1a95-4cd7-af27-9b7fb8161898 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:26:31.807745 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fd7086-1a95-4cd7-af27-9b7fb8161898 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:26:31.808578 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fd7086-1a95-4cd7-af27-9b7fb8161898 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:26:31.810259 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fd7086-1a95-4cd7-af27-9b7fb8161898 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:26:31.828826 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4450/8927] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 22:26:31 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 22:26:31.830139 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d75b45-8c90-4d9e-a966-61c79f7646b3 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:26:31.841536 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d75b45-8c90-4d9e-a966-61c79f7646b3 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:26:31.846684 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b12503a-5efb-41e8-92a5-f39bc116ca36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:26:31.847639 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b12503a-5efb-41e8-92a5-f39bc116ca36 admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:26:31.847901 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b12503a-5efb-41e8-92a5-f39bc116ca36 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:26:31.848172 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b12503a-5efb-41e8-92a5-f39bc116ca36 admin admin] PATH_INFO: `/v3/projects/ce6fb12dba88433e83ed7bd4663d77e9/users/19d1b5aa870f42ad9e1c2cc198ddf83e/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:26:31.864004 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b12503a-5efb-41e8-92a5-f39bc116ca36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce6fb12dba88433e83ed7bd4663d77e9, user_id=19d1b5aa870f42ad9e1c2cc198ddf83e, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:26:31.867352 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b12503a-5efb-41e8-92a5-f39bc116ca36 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:26:31.881398 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4478/8928] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 22:26:31 2022] PUT /identity/v3/projects/ce6fb12dba88433e83ed7bd4663d77e9/users/19d1b5aa870f42ad9e1c2cc198ddf83e/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:26:31.885441 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fd7086-1a95-4cd7-af27-9b7fb8161898 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:26:31.906540 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fd7086-1a95-4cd7-af27-9b7fb8161898 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:26:31.914299 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:26:31.967930 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e0890f-526a-4a0f-a3da-ae0e36e7c38a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:26:31.968804 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e0890f-526a-4a0f-a3da-ae0e36e7c38a admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:26:31.969087 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e0890f-526a-4a0f-a3da-ae0e36e7c38a admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:26:31.969361 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e0890f-526a-4a0f-a3da-ae0e36e7c38a admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:26:31.970137 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e0890f-526a-4a0f-a3da-ae0e36e7c38a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:26:31.971845 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e0890f-526a-4a0f-a3da-ae0e36e7c38a admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:26:31.986006 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4451/8929] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 22:26:31 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 22:26:31.987126 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b12503a-5efb-41e8-92a5-f39bc116ca36 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:26:32.011949 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b12503a-5efb-41e8-92a5-f39bc116ca36 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:26:32.020138 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fb76e2-d8ab-441f-bcc0-ce7c77a7236f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:26:32.021489 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fb76e2-d8ab-441f-bcc0-ce7c77a7236f admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:26:32.021935 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fb76e2-d8ab-441f-bcc0-ce7c77a7236f admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:26:32.022319 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fb76e2-d8ab-441f-bcc0-ce7c77a7236f admin admin] PATH_INFO: `/v3/projects/ce6fb12dba88433e83ed7bd4663d77e9/users/19d1b5aa870f42ad9e1c2cc198ddf83e/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:26:32.025430 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fb76e2-d8ab-441f-bcc0-ce7c77a7236f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce6fb12dba88433e83ed7bd4663d77e9, user_id=19d1b5aa870f42ad9e1c2cc198ddf83e, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:26:32.028978 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fb76e2-d8ab-441f-bcc0-ce7c77a7236f admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:26:32.044598 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4479/8930] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 22:26:31 2022] PUT /identity/v3/projects/ce6fb12dba88433e83ed7bd4663d77e9/users/19d1b5aa870f42ad9e1c2cc198ddf83e/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:26:37.090041 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcc8de4-8035-4e73-8e67-65f6b1c1c4fd None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:26:37.090606 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcc8de4-8035-4e73-8e67-65f6b1c1c4fd None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:26:37.090777 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcc8de4-8035-4e73-8e67-65f6b1c1c4fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:26:37.120408 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-ddcc8de4-8035-4e73-8e67-65f6b1c1c4fd None None] MFA Rules not processed for user `19d1b5aa870f42ad9e1c2cc198ddf83e`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:26:37.121995 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-ddcc8de4-8035-4e73-8e67-65f6b1c1c4fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:26:37.202413 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4452/8931] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:26:37 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:26:37.221317 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fb76e2-d8ab-441f-bcc0-ce7c77a7236f admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:26:37.223396 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-99fb76e2-d8ab-441f-bcc0-ce7c77a7236f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:26:37.299705 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fb76e2-d8ab-441f-bcc0-ce7c77a7236f admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:26:37.305173 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54ab45a-d6b1-4459-82ee-b0c90bba338f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:26:37.306025 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54ab45a-d6b1-4459-82ee-b0c90bba338f service nova] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:26:37.306306 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54ab45a-d6b1-4459-82ee-b0c90bba338f service nova] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:26:37.306579 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54ab45a-d6b1-4459-82ee-b0c90bba338f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:26:37.365072 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54ab45a-d6b1-4459-82ee-b0c90bba338f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:26:37.366783 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54ab45a-d6b1-4459-82ee-b0c90bba338f service nova] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:26:37.377943 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4480/8932] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:26:37 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:26:38.385735 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75b3388-5505-47cb-b505-e2bea867772c None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:26:38.386236 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75b3388-5505-47cb-b505-e2bea867772c None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:26:38.386327 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75b3388-5505-47cb-b505-e2bea867772c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:26:38.405535 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-b75b3388-5505-47cb-b505-e2bea867772c None None] MFA Rules not processed for user `c72a610b85c64df7ab471c6ee1d68dcd`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:26:38.406920 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-b75b3388-5505-47cb-b505-e2bea867772c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:26:38.418361 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4453/8933] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:26:38 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:26:44.605371 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54ab45a-d6b1-4459-82ee-b0c90bba338f service nova] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:26:44.625472 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:26:44.662541 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54ab45a-d6b1-4459-82ee-b0c90bba338f service nova] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:26:44.666167 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5aac52-3aa5-45af-adf2-009a64cd1560 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:26:44.666840 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5aac52-3aa5-45af-adf2-009a64cd1560 service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:26:44.667093 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5aac52-3aa5-45af-adf2-009a64cd1560 service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:26:44.667362 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5aac52-3aa5-45af-adf2-009a64cd1560 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:26:44.669138 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-fe5aac52-3aa5-45af-adf2-009a64cd1560 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:26:44.704566 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5aac52-3aa5-45af-adf2-009a64cd1560 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:26:44.706047 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5aac52-3aa5-45af-adf2-009a64cd1560 service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:26:44.727950 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4481/8934] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:26:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:26:48.401711 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=61 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:26:52.235198 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75b3388-5505-47cb-b505-e2bea867772c None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:26:52.249011 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75b3388-5505-47cb-b505-e2bea867772c None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:26:52.253653 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5887e79c-57f8-47d1-918d-c88e3d81d386 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:26:52.254337 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5887e79c-57f8-47d1-918d-c88e3d81d386 service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:26:52.254614 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5887e79c-57f8-47d1-918d-c88e3d81d386 service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:26:52.254879 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5887e79c-57f8-47d1-918d-c88e3d81d386 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:26:52.264948 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5887e79c-57f8-47d1-918d-c88e3d81d386 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:26:52.266468 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5887e79c-57f8-47d1-918d-c88e3d81d386 service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:26:52.276693 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4454/8935] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:26:52 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:26:54.330559 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5aac52-3aa5-45af-adf2-009a64cd1560 service neutron] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:26:54.340142 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5aac52-3aa5-45af-adf2-009a64cd1560 service neutron] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:26:54.344868 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216f8951-2538-4088-a2eb-7c0b211f6775 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:26:54.345548 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216f8951-2538-4088-a2eb-7c0b211f6775 service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:26:54.345830 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216f8951-2538-4088-a2eb-7c0b211f6775 service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:26:54.346217 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216f8951-2538-4088-a2eb-7c0b211f6775 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:26:54.348355 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-216f8951-2538-4088-a2eb-7c0b211f6775 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:26:54.371786 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216f8951-2538-4088-a2eb-7c0b211f6775 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:26:54.373231 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216f8951-2538-4088-a2eb-7c0b211f6775 service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:26:54.381504 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4482/8936] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:26:54 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:27:02.272144 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=6 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:27:04.378147 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=41 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:29:02.019851 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e73762-1d19-41b6-80bf-fc5fc8ce1b60 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:29:02.020343 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e73762-1d19-41b6-80bf-fc5fc8ce1b60 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:29:02.020343 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e73762-1d19-41b6-80bf-fc5fc8ce1b60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:29:02.079271 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-34e73762-1d19-41b6-80bf-fc5fc8ce1b60 None None] MFA Rules not processed for user `17b779a3e21a415bb42cde5d6863d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:29:02.080492 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-34e73762-1d19-41b6-80bf-fc5fc8ce1b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:29:02.152966 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4455/8937] 10.222.0.17 () {58 vars in 1009 bytes} [Sat Jul 23 22:29:02 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:29:02.203682 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216f8951-2538-4088-a2eb-7c0b211f6775 service neutron] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:29:02.205315 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-216f8951-2538-4088-a2eb-7c0b211f6775 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:29:02.309697 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216f8951-2538-4088-a2eb-7c0b211f6775 service neutron] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:29:02.316489 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc2d48f-54f2-4e5d-9fd2-1f4bf12ab804 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f0a685b7da46afb81024848f079d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:29:02.317146 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc2d48f-54f2-4e5d-9fd2-1f4bf12ab804 service swift] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:29:02.317426 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc2d48f-54f2-4e5d-9fd2-1f4bf12ab804 service swift] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:29:02.317702 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc2d48f-54f2-4e5d-9fd2-1f4bf12ab804 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:29:02.327916 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc2d48f-54f2-4e5d-9fd2-1f4bf12ab804 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:29:02.329515 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc2d48f-54f2-4e5d-9fd2-1f4bf12ab804 service swift] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:29:02.338181 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4483/8938] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 23 22:29:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 23 22:29:02.633044 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e73762-1d19-41b6-80bf-fc5fc8ce1b60 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:29:02.652876 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e73762-1d19-41b6-80bf-fc5fc8ce1b60 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:29:02.674502 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75284ee0-fc01-4f4b-a054-3f07232e0e49 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:29:02.675639 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75284ee0-fc01-4f4b-a054-3f07232e0e49 service nova] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:29:02.676142 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75284ee0-fc01-4f4b-a054-3f07232e0e49 service nova] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:29:02.676608 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75284ee0-fc01-4f4b-a054-3f07232e0e49 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:29:02.678959 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-75284ee0-fc01-4f4b-a054-3f07232e0e49 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:29:02.693471 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75284ee0-fc01-4f4b-a054-3f07232e0e49 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:29:02.695687 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75284ee0-fc01-4f4b-a054-3f07232e0e49 service nova] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:29:02.709810 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4456/8939] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:29:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:29:12.334762 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=41 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:29:12.704049 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=50 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:29:13.930717 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc2d48f-54f2-4e5d-9fd2-1f4bf12ab804 service swift] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:29:13.943404 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc2d48f-54f2-4e5d-9fd2-1f4bf12ab804 service swift] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:29:13.951007 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25918f2-8006-4acb-9f9f-1bc5955da767 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:29:13.951908 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25918f2-8006-4acb-9f9f-1bc5955da767 service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:29:13.952288 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25918f2-8006-4acb-9f9f-1bc5955da767 service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:29:13.952643 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25918f2-8006-4acb-9f9f-1bc5955da767 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:29:13.955943 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-c25918f2-8006-4acb-9f9f-1bc5955da767 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:29:13.968622 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25918f2-8006-4acb-9f9f-1bc5955da767 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:29:13.970087 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25918f2-8006-4acb-9f9f-1bc5955da767 service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:29:13.978679 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4484/8940] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:29:13 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:29:14.081298 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26cd6f8-86ab-40b4-81fc-3ea547fc8d5c None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:29:14.081850 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26cd6f8-86ab-40b4-81fc-3ea547fc8d5c None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:29:14.082060 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26cd6f8-86ab-40b4-81fc-3ea547fc8d5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:29:14.111095 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-d26cd6f8-86ab-40b4-81fc-3ea547fc8d5c None None] MFA Rules not processed for user `079f31ed2c844e67bd4e206f24b69d97`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:29:14.112320 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-d26cd6f8-86ab-40b4-81fc-3ea547fc8d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:29:14.122348 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4457/8941] 10.222.0.17 () {58 vars in 1018 bytes} [Sat Jul 23 22:29:14 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:29:14.133991 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25918f2-8006-4acb-9f9f-1bc5955da767 service neutron] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:29:14.135413 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-c25918f2-8006-4acb-9f9f-1bc5955da767 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:29:14.203059 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25918f2-8006-4acb-9f9f-1bc5955da767 service neutron] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:29:14.206827 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b11d02-0b0f-4100-b75d-0700a729968e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7f2db148c8e4d5d81431cae3576434b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:29:14.207468 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b11d02-0b0f-4100-b75d-0700a729968e service glance] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:29:14.207745 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b11d02-0b0f-4100-b75d-0700a729968e service glance] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:29:14.208018 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b11d02-0b0f-4100-b75d-0700a729968e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:29:14.218679 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b11d02-0b0f-4100-b75d-0700a729968e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:29:14.220104 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b11d02-0b0f-4100-b75d-0700a729968e service glance] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:29:14.230685 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4485/8942] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:29:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:29:14.302234 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26cd6f8-86ab-40b4-81fc-3ea547fc8d5c None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:29:14.311718 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26cd6f8-86ab-40b4-81fc-3ea547fc8d5c None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:29:14.315338 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a338208c-9c57-449e-b265-e7f241fa8134 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:29:14.315977 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a338208c-9c57-449e-b265-e7f241fa8134 service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:29:14.316254 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a338208c-9c57-449e-b265-e7f241fa8134 service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:29:14.316522 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a338208c-9c57-449e-b265-e7f241fa8134 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:29:14.318364 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-a338208c-9c57-449e-b265-e7f241fa8134 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:29:14.328556 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a338208c-9c57-449e-b265-e7f241fa8134 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:29:14.330048 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a338208c-9c57-449e-b265-e7f241fa8134 service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:29:14.338207 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4458/8943] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:29:14 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 23 22:29:14.412445 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b11d02-0b0f-4100-b75d-0700a729968e service glance] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:29:14.423017 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b11d02-0b0f-4100-b75d-0700a729968e service glance] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:29:14.427667 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02eff82-daa3-4f90-9c56-30eeb5a6badf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:29:14.428308 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02eff82-daa3-4f90-9c56-30eeb5a6badf service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:29:14.428583 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02eff82-daa3-4f90-9c56-30eeb5a6badf service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:29:14.428856 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02eff82-daa3-4f90-9c56-30eeb5a6badf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:29:14.430928 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-f02eff82-daa3-4f90-9c56-30eeb5a6badf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:29:14.445204 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02eff82-daa3-4f90-9c56-30eeb5a6badf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:29:14.446679 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02eff82-daa3-4f90-9c56-30eeb5a6badf service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:29:14.457890 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4486/8944] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:29:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:29:15.256822 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a338208c-9c57-449e-b265-e7f241fa8134 service neutron] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:29:15.258587 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-a338208c-9c57-449e-b265-e7f241fa8134 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:29:15.269678 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a338208c-9c57-449e-b265-e7f241fa8134 service neutron] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:29:15.274267 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5605b1f-6e04-4969-86f3-193f28c0d064 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:29:15.274913 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5605b1f-6e04-4969-86f3-193f28c0d064 service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:29:15.275186 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5605b1f-6e04-4969-86f3-193f28c0d064 service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:29:15.275457 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5605b1f-6e04-4969-86f3-193f28c0d064 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:29:15.277526 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-c5605b1f-6e04-4969-86f3-193f28c0d064 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:29:15.288326 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5605b1f-6e04-4969-86f3-193f28c0d064 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:29:15.289771 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5605b1f-6e04-4969-86f3-193f28c0d064 service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:29:15.298413 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4459/8945] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:29:15 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:29:16.142899 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02eff82-daa3-4f90-9c56-30eeb5a6badf service neutron] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:29:16.155209 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02eff82-daa3-4f90-9c56-30eeb5a6badf service neutron] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:29:16.162155 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca71934c-d311-4138-b1b5-6a62b853c021 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:29:16.162834 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca71934c-d311-4138-b1b5-6a62b853c021 service nova] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:29:16.163117 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca71934c-d311-4138-b1b5-6a62b853c021 service nova] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:29:16.163562 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca71934c-d311-4138-b1b5-6a62b853c021 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:29:16.165751 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-ca71934c-d311-4138-b1b5-6a62b853c021 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:29:16.179797 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca71934c-d311-4138-b1b5-6a62b853c021 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:29:16.181407 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca71934c-d311-4138-b1b5-6a62b853c021 service nova] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:29:16.193037 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4487/8946] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:29:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:29:17.102668 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6541b4ae-53de-4f96-bc18-0dadcbef6886 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:29:17.103122 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6541b4ae-53de-4f96-bc18-0dadcbef6886 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:29:17.103317 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6541b4ae-53de-4f96-bc18-0dadcbef6886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:29:17.122516 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-6541b4ae-53de-4f96-bc18-0dadcbef6886 None None] MFA Rules not processed for user `17b779a3e21a415bb42cde5d6863d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:29:17.123824 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-6541b4ae-53de-4f96-bc18-0dadcbef6886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:29:17.131876 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4460/8947] 10.222.0.17 () {58 vars in 1009 bytes} [Sat Jul 23 22:29:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:29:17.144379 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca71934c-d311-4138-b1b5-6a62b853c021 service nova] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:29:17.156478 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca71934c-d311-4138-b1b5-6a62b853c021 service nova] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:29:17.162301 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0520ea7c-3810-487d-87f7-fbd9cfa3236f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f0a685b7da46afb81024848f079d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:29:17.162951 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0520ea7c-3810-487d-87f7-fbd9cfa3236f service swift] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:29:17.163232 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0520ea7c-3810-487d-87f7-fbd9cfa3236f service swift] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:29:17.164126 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0520ea7c-3810-487d-87f7-fbd9cfa3236f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:29:17.172951 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0520ea7c-3810-487d-87f7-fbd9cfa3236f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:29:17.174560 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0520ea7c-3810-487d-87f7-fbd9cfa3236f service swift] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:29:17.183173 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4488/8948] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 23 22:29:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 23 22:29:27.116701 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=22 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:29:27.179556 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=54 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:29:33.623075 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ebee66-c965-41e5-bfb0-8f879af336e6 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:29:33.623575 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ebee66-c965-41e5-bfb0-8f879af336e6 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:29:33.623728 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ebee66-c965-41e5-bfb0-8f879af336e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:29:33.641969 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-93ebee66-c965-41e5-bfb0-8f879af336e6 None None] MFA Rules not processed for user `17b779a3e21a415bb42cde5d6863d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:29:33.643178 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-93ebee66-c965-41e5-bfb0-8f879af336e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:29:33.650981 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4461/8949] 10.222.0.17 () {58 vars in 967 bytes} [Sat Jul 23 22:29:33 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:29:33.663224 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0520ea7c-3810-487d-87f7-fbd9cfa3236f service swift] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:29:33.674169 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0520ea7c-3810-487d-87f7-fbd9cfa3236f service swift] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:29:33.680609 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60478229-0311-474e-b64b-29c273fcb28a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f0a685b7da46afb81024848f079d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:29:33.681265 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60478229-0311-474e-b64b-29c273fcb28a service swift] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:29:33.681544 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60478229-0311-474e-b64b-29c273fcb28a service swift] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:29:33.682507 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60478229-0311-474e-b64b-29c273fcb28a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:29:33.691254 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60478229-0311-474e-b64b-29c273fcb28a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:29:33.692922 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60478229-0311-474e-b64b-29c273fcb28a service swift] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:29:33.701326 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4489/8950] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 23 22:29:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 23 22:29:36.232291 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ebee66-c965-41e5-bfb0-8f879af336e6 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:29:36.233897 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-93ebee66-c965-41e5-bfb0-8f879af336e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:29:36.314652 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ebee66-c965-41e5-bfb0-8f879af336e6 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:29:36.320458 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f18ea3-f634-4162-bf6a-344d7434d829 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc719a3b3ac4461b82ca04ab6451d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:29:36.321104 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f18ea3-f634-4162-bf6a-344d7434d829 service placement] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:29:36.321380 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f18ea3-f634-4162-bf6a-344d7434d829 service placement] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:29:36.321648 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f18ea3-f634-4162-bf6a-344d7434d829 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:29:36.323536 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-c6f18ea3-f634-4162-bf6a-344d7434d829 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:29:36.335594 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f18ea3-f634-4162-bf6a-344d7434d829 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:29:36.337210 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f18ea3-f634-4162-bf6a-344d7434d829 service placement] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:29:36.346919 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4462/8951] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:29:36 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:29:43.698100 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=6 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:29:46.343182 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=39 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:30:02.089816 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60478229-0311-474e-b64b-29c273fcb28a service swift] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:30:02.091521 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-60478229-0311-474e-b64b-29c273fcb28a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:30:02.107736 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60478229-0311-474e-b64b-29c273fcb28a service swift] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:30:02.114545 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150a6309-aa72-429b-8d3c-e7347b740900 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc719a3b3ac4461b82ca04ab6451d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:30:02.115217 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150a6309-aa72-429b-8d3c-e7347b740900 service placement] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:30:02.115508 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150a6309-aa72-429b-8d3c-e7347b740900 service placement] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:30:02.115777 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150a6309-aa72-429b-8d3c-e7347b740900 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:30:02.117755 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-150a6309-aa72-429b-8d3c-e7347b740900 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:30:02.129349 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150a6309-aa72-429b-8d3c-e7347b740900 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:30:02.130991 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150a6309-aa72-429b-8d3c-e7347b740900 service placement] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:30:02.141441 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4490/8952] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:30:02 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:30:12.137432 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=6 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:30:45.260900 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f18ea3-f634-4162-bf6a-344d7434d829 service placement] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:30:45.273817 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f18ea3-f634-4162-bf6a-344d7434d829 service placement] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:30:45.279718 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f33f592-885d-4ee8-896e-2e6034172f70 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:30:45.282278 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f33f592-885d-4ee8-896e-2e6034172f70 service nova] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:30:45.282641 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f33f592-885d-4ee8-896e-2e6034172f70 service nova] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:30:45.282930 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f33f592-885d-4ee8-896e-2e6034172f70 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:30:45.284835 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-1f33f592-885d-4ee8-896e-2e6034172f70 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:30:45.297535 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f33f592-885d-4ee8-896e-2e6034172f70 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:30:45.299255 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f33f592-885d-4ee8-896e-2e6034172f70 service nova] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:30:45.309729 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4463/8953] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:30:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:30:49.028282 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526a04c8-57dd-42e6-8533-0731d5b56f5e None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:30:49.028908 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526a04c8-57dd-42e6-8533-0731d5b56f5e None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:30:49.028908 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526a04c8-57dd-42e6-8533-0731d5b56f5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:30:49.049010 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-526a04c8-57dd-42e6-8533-0731d5b56f5e None None] MFA Rules not processed for user `c72a610b85c64df7ab471c6ee1d68dcd`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:30:49.050319 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-526a04c8-57dd-42e6-8533-0731d5b56f5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:30:49.057811 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4491/8954] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:30:49 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:30:53.809993 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f33f592-885d-4ee8-896e-2e6034172f70 service nova] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:30:53.831242 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f33f592-885d-4ee8-896e-2e6034172f70 service nova] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:30:53.836521 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff63f065-1316-46ed-9697-44eff353885a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc719a3b3ac4461b82ca04ab6451d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:30:53.837278 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff63f065-1316-46ed-9697-44eff353885a service placement] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:30:53.837535 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff63f065-1316-46ed-9697-44eff353885a service placement] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:30:53.837834 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff63f065-1316-46ed-9697-44eff353885a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:30:53.839674 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-ff63f065-1316-46ed-9697-44eff353885a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:30:53.852161 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff63f065-1316-46ed-9697-44eff353885a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:30:53.854099 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff63f065-1316-46ed-9697-44eff353885a service placement] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:30:53.877243 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4464/8955] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:30:53 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:30:57.442399 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526a04c8-57dd-42e6-8533-0731d5b56f5e None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:30:57.462911 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526a04c8-57dd-42e6-8533-0731d5b56f5e None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:30:57.469298 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e0e180-ff12-4434-abe0-f82cc655216b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc719a3b3ac4461b82ca04ab6451d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:30:57.470242 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e0e180-ff12-4434-abe0-f82cc655216b service placement] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:30:57.470242 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e0e180-ff12-4434-abe0-f82cc655216b service placement] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:30:57.470518 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e0e180-ff12-4434-abe0-f82cc655216b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:30:57.473010 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-12e0e180-ff12-4434-abe0-f82cc655216b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:30:57.485875 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e0e180-ff12-4434-abe0-f82cc655216b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:30:57.487501 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e0e180-ff12-4434-abe0-f82cc655216b service placement] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:30:57.498413 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4492/8956] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:30:57 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:30:57.516924 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff63f065-1316-46ed-9697-44eff353885a service placement] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:30:57.599026 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff63f065-1316-46ed-9697-44eff353885a service placement] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:30:57.603743 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f703e2b-9da8-4789-a16b-9a80ed78383f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:30:57.604628 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f703e2b-9da8-4789-a16b-9a80ed78383f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:30:57.604927 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f703e2b-9da8-4789-a16b-9a80ed78383f admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:30:57.605226 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f703e2b-9da8-4789-a16b-9a80ed78383f admin admin] PATH_INFO: `/v3/users/c72a610b85c64df7ab471c6ee1d68dcd` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:30:57.606410 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f703e2b-9da8-4789-a16b-9a80ed78383f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c72a610b85c64df7ab471c6ee1d68dcd)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:30:57.608347 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f703e2b-9da8-4789-a16b-9a80ed78383f admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:30:57.657238 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-0f703e2b-9da8-4789-a16b-9a80ed78383f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c72a610b85c64df7ab471c6ee1d68dcd'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:30:57.663846 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-0f703e2b-9da8-4789-a16b-9a80ed78383f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c72a610b85c64df7ab471c6ee1d68dcd'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:30:57.664489 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-0f703e2b-9da8-4789-a16b-9a80ed78383f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c72a610b85c64df7ab471c6ee1d68dcd'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:30:57.673089 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-0f703e2b-9da8-4789-a16b-9a80ed78383f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c72a610b85c64df7ab471c6ee1d68dcd'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:30:57.685479 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-0f703e2b-9da8-4789-a16b-9a80ed78383f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c72a610b85c64df7ab471c6ee1d68dcd'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:30:57.691810 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4465/8957] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 22:30:57 2022] DELETE /identity/v3/users/c72a610b85c64df7ab471c6ee1d68dcd => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:30:57.873662 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e0e180-ff12-4434-abe0-f82cc655216b service placement] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:30:57.886940 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e0e180-ff12-4434-abe0-f82cc655216b service placement] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:30:57.949632 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfc561b-9c09-432c-9f3d-663ca2a41349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:30:57.950546 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfc561b-9c09-432c-9f3d-663ca2a41349 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:30:57.950828 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfc561b-9c09-432c-9f3d-663ca2a41349 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:30:57.951100 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfc561b-9c09-432c-9f3d-663ca2a41349 admin admin] PATH_INFO: `/v3/projects/b45dbfa8603541f686c9b2e0bf291dd7` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:30:57.952323 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfc561b-9c09-432c-9f3d-663ca2a41349 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b45dbfa8603541f686c9b2e0bf291dd7)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:30:57.954280 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfc561b-9c09-432c-9f3d-663ca2a41349 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:30:58.001469 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-4bfc561b-9c09-432c-9f3d-663ca2a41349 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b45dbfa8603541f686c9b2e0bf291dd7', 'request_id': 'req-4bfc561b-9c09-432c-9f3d-663ca2a41349'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:30:58.009067 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-4bfc561b-9c09-432c-9f3d-663ca2a41349 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b45dbfa8603541f686c9b2e0bf291dd7', 'request_id': 'req-4bfc561b-9c09-432c-9f3d-663ca2a41349'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:30:58.017259 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-4bfc561b-9c09-432c-9f3d-663ca2a41349 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b45dbfa8603541f686c9b2e0bf291dd7', 'request_id': 'req-4bfc561b-9c09-432c-9f3d-663ca2a41349'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:30:58.047468 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-4bfc561b-9c09-432c-9f3d-663ca2a41349 admin admin] The token cache is being invalidate because project b45dbfa8603541f686c9b2e0bf291dd7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 22:30:58.047765 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-4bfc561b-9c09-432c-9f3d-663ca2a41349 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:30:58.048414 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-4bfc561b-9c09-432c-9f3d-663ca2a41349 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:30:58.050046 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4493/8958] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 22:30:57 2022] DELETE /identity/v3/projects/b45dbfa8603541f686c9b2e0bf291dd7 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:30:58.054535 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f703e2b-9da8-4789-a16b-9a80ed78383f admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:30:58.056276 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-0f703e2b-9da8-4789-a16b-9a80ed78383f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:30:58.070755 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f703e2b-9da8-4789-a16b-9a80ed78383f admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:30:58.115584 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:30:58.133268 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6bde3e-e5bf-4112-b20c-b5637eb56d12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:30:58.134192 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6bde3e-e5bf-4112-b20c-b5637eb56d12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:30:58.134478 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6bde3e-e5bf-4112-b20c-b5637eb56d12 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:30:58.134752 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6bde3e-e5bf-4112-b20c-b5637eb56d12 admin admin] PATH_INFO: `/v3/users/19d1b5aa870f42ad9e1c2cc198ddf83e` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:30:58.135961 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6bde3e-e5bf-4112-b20c-b5637eb56d12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19d1b5aa870f42ad9e1c2cc198ddf83e)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:30:58.138044 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6bde3e-e5bf-4112-b20c-b5637eb56d12 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:30:58.189229 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-fe6bde3e-e5bf-4112-b20c-b5637eb56d12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19d1b5aa870f42ad9e1c2cc198ddf83e'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:30:58.196473 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-fe6bde3e-e5bf-4112-b20c-b5637eb56d12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19d1b5aa870f42ad9e1c2cc198ddf83e'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:30:58.197240 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-fe6bde3e-e5bf-4112-b20c-b5637eb56d12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19d1b5aa870f42ad9e1c2cc198ddf83e'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:30:58.206250 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-fe6bde3e-e5bf-4112-b20c-b5637eb56d12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19d1b5aa870f42ad9e1c2cc198ddf83e'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:30:58.218686 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-fe6bde3e-e5bf-4112-b20c-b5637eb56d12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19d1b5aa870f42ad9e1c2cc198ddf83e'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:30:58.224567 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4466/8959] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 22:30:58 2022] DELETE /identity/v3/users/19d1b5aa870f42ad9e1c2cc198ddf83e => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:30:58.407729 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfc561b-9c09-432c-9f3d-663ca2a41349 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:30:58.409418 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-4bfc561b-9c09-432c-9f3d-663ca2a41349 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:30:58.423398 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfc561b-9c09-432c-9f3d-663ca2a41349 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:30:58.482385 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b917242e-1a2c-4f9c-80b4-e406ce85c2bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:30:58.483273 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b917242e-1a2c-4f9c-80b4-e406ce85c2bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:30:58.483553 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b917242e-1a2c-4f9c-80b4-e406ce85c2bd admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:30:58.483828 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b917242e-1a2c-4f9c-80b4-e406ce85c2bd admin admin] PATH_INFO: `/v3/projects/ce6fb12dba88433e83ed7bd4663d77e9` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:30:58.485052 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b917242e-1a2c-4f9c-80b4-e406ce85c2bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce6fb12dba88433e83ed7bd4663d77e9)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:30:58.487021 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b917242e-1a2c-4f9c-80b4-e406ce85c2bd admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:30:58.488461 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:30:58.537754 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-b917242e-1a2c-4f9c-80b4-e406ce85c2bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce6fb12dba88433e83ed7bd4663d77e9', 'request_id': 'req-b917242e-1a2c-4f9c-80b4-e406ce85c2bd'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:30:58.545258 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-b917242e-1a2c-4f9c-80b4-e406ce85c2bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce6fb12dba88433e83ed7bd4663d77e9', 'request_id': 'req-b917242e-1a2c-4f9c-80b4-e406ce85c2bd'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:30:58.550978 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-b917242e-1a2c-4f9c-80b4-e406ce85c2bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce6fb12dba88433e83ed7bd4663d77e9', 'request_id': 'req-b917242e-1a2c-4f9c-80b4-e406ce85c2bd'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:30:58.562594 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-b917242e-1a2c-4f9c-80b4-e406ce85c2bd admin admin] The token cache is being invalidate because project ce6fb12dba88433e83ed7bd4663d77e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 22:30:58.562881 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-b917242e-1a2c-4f9c-80b4-e406ce85c2bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:30:58.563740 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-b917242e-1a2c-4f9c-80b4-e406ce85c2bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:30:58.565519 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4494/8960] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 22:30:58 2022] DELETE /identity/v3/projects/ce6fb12dba88433e83ed7bd4663d77e9 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 23 22:30:58.570798 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52834b2-9afc-49fb-b1c0-e569298eb6d1 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:30:58.571255 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52834b2-9afc-49fb-b1c0-e569298eb6d1 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:30:58.571339 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52834b2-9afc-49fb-b1c0-e569298eb6d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:30:58.623714 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-a52834b2-9afc-49fb-b1c0-e569298eb6d1 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:30:58.624959 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-a52834b2-9afc-49fb-b1c0-e569298eb6d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:30:58.684363 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4467/8961] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:30:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:30:58.692287 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16329fd-16fc-4d20-8be9-0fb3ad72faa7 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:30:58.692575 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16329fd-16fc-4d20-8be9-0fb3ad72faa7 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:30:58.692876 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16329fd-16fc-4d20-8be9-0fb3ad72faa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:30:58.712139 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-f16329fd-16fc-4d20-8be9-0fb3ad72faa7 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:30:58.713385 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-f16329fd-16fc-4d20-8be9-0fb3ad72faa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:30:58.721800 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4495/8962] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:30:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:30:58.726356 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52834b2-9afc-49fb-b1c0-e569298eb6d1 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:30:58.736492 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52834b2-9afc-49fb-b1c0-e569298eb6d1 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:30:58.741531 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238a2441-8d86-49eb-b6a7-c41d1a1cbe28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:30:58.742222 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238a2441-8d86-49eb-b6a7-c41d1a1cbe28 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:30:58.742502 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238a2441-8d86-49eb-b6a7-c41d1a1cbe28 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:30:58.742773 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238a2441-8d86-49eb-b6a7-c41d1a1cbe28 admin admin] PATH_INFO: `/v3/domains` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:30:58.743754 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238a2441-8d86-49eb-b6a7-c41d1a1cbe28 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91547) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 23 22:30:58.743846 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238a2441-8d86-49eb-b6a7-c41d1a1cbe28 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:30:58.745375 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238a2441-8d86-49eb-b6a7-c41d1a1cbe28 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:30:58.761036 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4468/8963] 10.222.0.17 () {58 vars in 1152 bytes} [Sat Jul 23 22:30:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 23 22:30:58.762031 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16329fd-16fc-4d20-8be9-0fb3ad72faa7 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:30:58.771853 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16329fd-16fc-4d20-8be9-0fb3ad72faa7 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:30:58.776812 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fc44f8-b76c-465a-b4c9-6a92a7cbbc3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:30:58.777488 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fc44f8-b76c-465a-b4c9-6a92a7cbbc3e admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:30:58.777781 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fc44f8-b76c-465a-b4c9-6a92a7cbbc3e admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:30:58.778078 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fc44f8-b76c-465a-b4c9-6a92a7cbbc3e admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:30:58.778784 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fc44f8-b76c-465a-b4c9-6a92a7cbbc3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:30:58.780690 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fc44f8-b76c-465a-b4c9-6a92a7cbbc3e admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:30:58.820977 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4496/8964] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 22:30:58 2022] POST /identity/v3/projects => generated 373 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 22:30:58.825928 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238a2441-8d86-49eb-b6a7-c41d1a1cbe28 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:30:58.837212 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238a2441-8d86-49eb-b6a7-c41d1a1cbe28 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:30:58.864308 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:30:58.897785 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e05f9a3-94f1-449c-92ae-c7af64cc2490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:30:58.898547 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e05f9a3-94f1-449c-92ae-c7af64cc2490 admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:30:58.898831 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e05f9a3-94f1-449c-92ae-c7af64cc2490 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:30:58.899108 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e05f9a3-94f1-449c-92ae-c7af64cc2490 admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:30:58.899799 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e05f9a3-94f1-449c-92ae-c7af64cc2490 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:30:58.901717 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e05f9a3-94f1-449c-92ae-c7af64cc2490 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:30:58.922346 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4469/8965] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 22:30:58 2022] POST /identity/v3/users => generated 287 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 22:30:58.926434 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fc44f8-b76c-465a-b4c9-6a92a7cbbc3e admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:30:58.938182 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fc44f8-b76c-465a-b4c9-6a92a7cbbc3e admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:30:58.944212 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeadc03-97e0-4a58-bd2a-db0f71d58d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:30:58.944873 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeadc03-97e0-4a58-bd2a-db0f71d58d33 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:30:58.945163 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeadc03-97e0-4a58-bd2a-db0f71d58d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:30:58.945421 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeadc03-97e0-4a58-bd2a-db0f71d58d33 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:30:58.946186 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eeadc03-97e0-4a58-bd2a-db0f71d58d33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:30:58.947778 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eeadc03-97e0-4a58-bd2a-db0f71d58d33 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:30:58.958437 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4497/8966] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 22:30:58 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 22:30:58.962998 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e05f9a3-94f1-449c-92ae-c7af64cc2490 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:30:58.978502 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e05f9a3-94f1-449c-92ae-c7af64cc2490 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:30:58.985217 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608e49d9-5d64-4ebf-b06b-81f951ac9154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:30:58.986082 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608e49d9-5d64-4ebf-b06b-81f951ac9154 admin admin] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:30:58.986423 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608e49d9-5d64-4ebf-b06b-81f951ac9154 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:30:58.986764 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608e49d9-5d64-4ebf-b06b-81f951ac9154 admin admin] PATH_INFO: `/v3/roles` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:30:58.987886 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608e49d9-5d64-4ebf-b06b-81f951ac9154 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:30:58.990258 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608e49d9-5d64-4ebf-b06b-81f951ac9154 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:30:59.002710 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4470/8967] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 22:30:58 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 23 22:30:59.006905 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeadc03-97e0-4a58-bd2a-db0f71d58d33 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:30:59.017764 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeadc03-97e0-4a58-bd2a-db0f71d58d33 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:30:59.023476 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d87ac53-c74d-4d21-8814-a050164b0f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:30:59.024380 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d87ac53-c74d-4d21-8814-a050164b0f2c admin admin] REQUEST_METHOD: `PUT` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:30:59.024662 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d87ac53-c74d-4d21-8814-a050164b0f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:30:59.024936 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d87ac53-c74d-4d21-8814-a050164b0f2c admin admin] PATH_INFO: `/v3/projects/4ab318d1c967420cbac48456436e90c5/users/94052639b2b5416aa2cd97854deae6b2/roles/14824669685048b38361b1676f7f0f9f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:30:59.040440 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d87ac53-c74d-4d21-8814-a050164b0f2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ab318d1c967420cbac48456436e90c5, user_id=94052639b2b5416aa2cd97854deae6b2, role_id=14824669685048b38361b1676f7f0f9f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:30:59.043148 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d87ac53-c74d-4d21-8814-a050164b0f2c admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:30:59.056945 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4498/8968] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 22:30:59 2022] PUT /identity/v3/projects/4ab318d1c967420cbac48456436e90c5/users/94052639b2b5416aa2cd97854deae6b2/roles/14824669685048b38361b1676f7f0f9f => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:30:59.062186 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb30d93-43c5-49d9-b6b8-d8cf398e1683 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:30:59.062493 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb30d93-43c5-49d9-b6b8-d8cf398e1683 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:30:59.062793 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb30d93-43c5-49d9-b6b8-d8cf398e1683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:30:59.080524 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-8eb30d93-43c5-49d9-b6b8-d8cf398e1683 None None] MFA Rules not processed for user `ef460ef8c739443881697a7ad53288a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:30:59.081673 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-8eb30d93-43c5-49d9-b6b8-d8cf398e1683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:30:59.143635 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4471/8969] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:30:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:30:59.153753 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d87ac53-c74d-4d21-8814-a050164b0f2c admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:30:59.155756 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-1d87ac53-c74d-4d21-8814-a050164b0f2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:30:59.218986 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d87ac53-c74d-4d21-8814-a050164b0f2c admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:30:59.223031 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66700b1c-b193-4ba1-9fc8-042a9cefdfff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:30:59.223702 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66700b1c-b193-4ba1-9fc8-042a9cefdfff service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:30:59.223977 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66700b1c-b193-4ba1-9fc8-042a9cefdfff service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:30:59.224249 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66700b1c-b193-4ba1-9fc8-042a9cefdfff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:30:59.233604 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66700b1c-b193-4ba1-9fc8-042a9cefdfff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:30:59.235062 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66700b1c-b193-4ba1-9fc8-042a9cefdfff service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:30:59.244560 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4499/8970] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:30:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:31:03.353045 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e766b136-635e-4fd2-86b5-8e06e2cac628 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:31:03.353510 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e766b136-635e-4fd2-86b5-8e06e2cac628 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:31:03.353612 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e766b136-635e-4fd2-86b5-8e06e2cac628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:31:03.381199 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-e766b136-635e-4fd2-86b5-8e06e2cac628 None None] MFA Rules not processed for user `94052639b2b5416aa2cd97854deae6b2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:31:03.382463 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-e766b136-635e-4fd2-86b5-8e06e2cac628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:31:03.457953 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4472/8971] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:31:03 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:31:03.459208 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66700b1c-b193-4ba1-9fc8-042a9cefdfff service neutron] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:31:03.469637 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66700b1c-b193-4ba1-9fc8-042a9cefdfff service neutron] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:31:03.476367 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c813beb-23dc-4732-9ebc-fa2c79ec1eed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:31:03.477050 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c813beb-23dc-4732-9ebc-fa2c79ec1eed admin admin] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:31:03.477331 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c813beb-23dc-4732-9ebc-fa2c79ec1eed admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:31:03.477599 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c813beb-23dc-4732-9ebc-fa2c79ec1eed admin admin] PATH_INFO: `/v3/projects` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:31:03.478359 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c813beb-23dc-4732-9ebc-fa2c79ec1eed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:31:03.481074 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c813beb-23dc-4732-9ebc-fa2c79ec1eed admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:31:03.504011 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:31:03.515162 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4500/8972] 10.222.0.17 () {60 vars in 1152 bytes} [Sat Jul 23 22:31:03 2022] POST /identity/v3/projects => generated 375 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 22:31:03.516293 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e766b136-635e-4fd2-86b5-8e06e2cac628 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:31:03.528597 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e766b136-635e-4fd2-86b5-8e06e2cac628 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:31:03.565457 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:31:03.592863 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec88a169-3136-46eb-a37c-c6dab87130af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:31:03.593564 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec88a169-3136-46eb-a37c-c6dab87130af admin admin] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:31:03.593846 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec88a169-3136-46eb-a37c-c6dab87130af admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:31:03.594145 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec88a169-3136-46eb-a37c-c6dab87130af admin admin] PATH_INFO: `/v3/users` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:31:03.596042 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec88a169-3136-46eb-a37c-c6dab87130af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:31:03.598033 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec88a169-3136-46eb-a37c-c6dab87130af admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:31:03.622280 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4473/8973] 10.222.0.17 () {60 vars in 1143 bytes} [Sat Jul 23 22:31:03 2022] POST /identity/v3/users => generated 294 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 23 22:31:03.625225 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c813beb-23dc-4732-9ebc-fa2c79ec1eed admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:31:03.636830 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c813beb-23dc-4732-9ebc-fa2c79ec1eed admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:31:03.641834 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e56460-7b74-4c0f-8ab3-2c8c9bd4436c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:31:03.642517 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e56460-7b74-4c0f-8ab3-2c8c9bd4436c admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:31:03.642794 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e56460-7b74-4c0f-8ab3-2c8c9bd4436c admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:31:03.643061 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e56460-7b74-4c0f-8ab3-2c8c9bd4436c admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:31:03.643782 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e56460-7b74-4c0f-8ab3-2c8c9bd4436c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:31:03.645477 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e56460-7b74-4c0f-8ab3-2c8c9bd4436c admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:31:03.657581 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4501/8974] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 22:31:03 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 22:31:03.661700 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec88a169-3136-46eb-a37c-c6dab87130af admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:31:03.672097 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec88a169-3136-46eb-a37c-c6dab87130af admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:31:03.677298 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edf4293-caf8-4470-92de-001998097fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:31:03.678340 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edf4293-caf8-4470-92de-001998097fa4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:31:03.678641 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edf4293-caf8-4470-92de-001998097fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:31:03.678950 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edf4293-caf8-4470-92de-001998097fa4 admin admin] PATH_INFO: `/v3/projects/f7f4c7e1788c4241a080ebeefdaa9a9e/users/b408683cdedb499885d100aa8ecedd0f/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:31:03.694055 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edf4293-caf8-4470-92de-001998097fa4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7f4c7e1788c4241a080ebeefdaa9a9e, user_id=b408683cdedb499885d100aa8ecedd0f, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:31:03.696771 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edf4293-caf8-4470-92de-001998097fa4 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:31:03.711036 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4474/8975] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 22:31:03 2022] PUT /identity/v3/projects/f7f4c7e1788c4241a080ebeefdaa9a9e/users/b408683cdedb499885d100aa8ecedd0f/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:31:03.715168 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e56460-7b74-4c0f-8ab3-2c8c9bd4436c admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:31:03.725231 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e56460-7b74-4c0f-8ab3-2c8c9bd4436c admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:31:03.786966 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7658f7a4-b63a-4004-b825-7135acd59763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:31:03.787578 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7658f7a4-b63a-4004-b825-7135acd59763 admin admin] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:31:03.787856 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7658f7a4-b63a-4004-b825-7135acd59763 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:31:03.788216 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7658f7a4-b63a-4004-b825-7135acd59763 admin admin] PATH_INFO: `/v3/roles` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:31:03.788932 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7658f7a4-b63a-4004-b825-7135acd59763 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:31:03.790601 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7658f7a4-b63a-4004-b825-7135acd59763 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:31:03.800714 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4502/8976] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 22:31:03 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 23 22:31:03.805167 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edf4293-caf8-4470-92de-001998097fa4 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:31:03.817184 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edf4293-caf8-4470-92de-001998097fa4 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:31:03.822479 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b31c30a-e190-41fb-9a41-7ed04019d50d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:31:03.823407 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b31c30a-e190-41fb-9a41-7ed04019d50d admin admin] REQUEST_METHOD: `PUT` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:31:03.823640 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b31c30a-e190-41fb-9a41-7ed04019d50d admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:31:03.824308 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b31c30a-e190-41fb-9a41-7ed04019d50d admin admin] PATH_INFO: `/v3/projects/f7f4c7e1788c4241a080ebeefdaa9a9e/users/b408683cdedb499885d100aa8ecedd0f/roles/fec17bfdc65349a2b9c06a89131191df` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:31:03.831260 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b31c30a-e190-41fb-9a41-7ed04019d50d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7f4c7e1788c4241a080ebeefdaa9a9e, user_id=b408683cdedb499885d100aa8ecedd0f, role_id=fec17bfdc65349a2b9c06a89131191df)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:31:03.834647 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b31c30a-e190-41fb-9a41-7ed04019d50d admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:31:03.846614 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4475/8977] 10.222.0.17 () {60 vars in 1482 bytes} [Sat Jul 23 22:31:03 2022] PUT /identity/v3/projects/f7f4c7e1788c4241a080ebeefdaa9a9e/users/b408683cdedb499885d100aa8ecedd0f/roles/fec17bfdc65349a2b9c06a89131191df => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:31:08.312017 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6b5e7f-2d21-4837-aace-8e725f0290b4 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:31:08.312494 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6b5e7f-2d21-4837-aace-8e725f0290b4 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:31:08.312895 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6b5e7f-2d21-4837-aace-8e725f0290b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:31:08.345707 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-ec6b5e7f-2d21-4837-aace-8e725f0290b4 None None] MFA Rules not processed for user `b408683cdedb499885d100aa8ecedd0f`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:31:08.347090 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-ec6b5e7f-2d21-4837-aace-8e725f0290b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:31:08.436990 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4503/8978] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:31:08 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:31:08.456290 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b31c30a-e190-41fb-9a41-7ed04019d50d admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:31:08.458581 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-8b31c30a-e190-41fb-9a41-7ed04019d50d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:31:08.558827 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b31c30a-e190-41fb-9a41-7ed04019d50d admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:31:08.565566 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fd4cac-0ea0-4d46-9a32-434005391545 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:31:08.566222 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fd4cac-0ea0-4d46-9a32-434005391545 service nova] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:31:08.566499 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fd4cac-0ea0-4d46-9a32-434005391545 service nova] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:31:08.566773 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fd4cac-0ea0-4d46-9a32-434005391545 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:31:08.645007 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fd4cac-0ea0-4d46-9a32-434005391545 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:31:08.646867 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fd4cac-0ea0-4d46-9a32-434005391545 service nova] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:31:08.656538 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4476/8979] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:31:08 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:31:09.681810 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2967a044-2715-47fc-8074-0b457aed54a1 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:31:09.682299 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2967a044-2715-47fc-8074-0b457aed54a1 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:31:09.682406 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2967a044-2715-47fc-8074-0b457aed54a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:31:09.852947 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-2967a044-2715-47fc-8074-0b457aed54a1 None None] MFA Rules not processed for user `94052639b2b5416aa2cd97854deae6b2`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:31:09.854205 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-2967a044-2715-47fc-8074-0b457aed54a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:31:09.861659 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4504/8980] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:31:09 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:31:11.515953 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fd4cac-0ea0-4d46-9a32-434005391545 service nova] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:31:11.517651 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-b9fd4cac-0ea0-4d46-9a32-434005391545 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:31:11.552029 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:31:11.600688 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fd4cac-0ea0-4d46-9a32-434005391545 service nova] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:31:11.606506 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be253d70-ca49-48a3-b775-19d50089cf16 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc719a3b3ac4461b82ca04ab6451d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:31:11.607195 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be253d70-ca49-48a3-b775-19d50089cf16 service placement] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:31:11.607471 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be253d70-ca49-48a3-b775-19d50089cf16 service placement] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:31:11.607742 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be253d70-ca49-48a3-b775-19d50089cf16 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:31:11.609606 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-be253d70-ca49-48a3-b775-19d50089cf16 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:31:11.622981 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be253d70-ca49-48a3-b775-19d50089cf16 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:31:11.624594 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be253d70-ca49-48a3-b775-19d50089cf16 service placement] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:31:11.636256 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4477/8981] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:31:11 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:31:19.695429 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=72 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:31:21.631265 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=20 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:31:23.508657 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2967a044-2715-47fc-8074-0b457aed54a1 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:31:23.510333 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-2967a044-2715-47fc-8074-0b457aed54a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:31:23.568806 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2967a044-2715-47fc-8074-0b457aed54a1 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:31:23.572602 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73500944-8940-4834-950c-38a2493346bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:31:23.573254 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73500944-8940-4834-950c-38a2493346bb service neutron] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:31:23.573529 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73500944-8940-4834-950c-38a2493346bb service neutron] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:31:23.574189 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73500944-8940-4834-950c-38a2493346bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:31:23.583331 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73500944-8940-4834-950c-38a2493346bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:31:23.584754 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73500944-8940-4834-950c-38a2493346bb service neutron] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:31:23.594278 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4505/8982] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:31:23 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:31:33.590292 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=26 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:32:21.000883 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be253d70-ca49-48a3-b775-19d50089cf16 service placement] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:32:21.026488 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be253d70-ca49-48a3-b775-19d50089cf16 service placement] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:32:21.030912 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d43425c-9949-4403-a773-ac25df66629b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:32:21.031599 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d43425c-9949-4403-a773-ac25df66629b service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:32:21.031861 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d43425c-9949-4403-a773-ac25df66629b service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:32:21.032133 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d43425c-9949-4403-a773-ac25df66629b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:32:21.034356 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-1d43425c-9949-4403-a773-ac25df66629b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:32:21.065334 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d43425c-9949-4403-a773-ac25df66629b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:32:21.066825 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d43425c-9949-4403-a773-ac25df66629b service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:32:21.075590 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4478/8983] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:32:20 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:32:31.071610 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=19 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:33:20.808391 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73500944-8940-4834-950c-38a2493346bb service neutron] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:33:20.809880 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-73500944-8940-4834-950c-38a2493346bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:33:20.891439 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73500944-8940-4834-950c-38a2493346bb service neutron] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:33:20.896242 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c1a485-0147-4da5-9904-346c3014f94e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7f2db148c8e4d5d81431cae3576434b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:33:20.896890 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c1a485-0147-4da5-9904-346c3014f94e service glance] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:33:20.897166 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c1a485-0147-4da5-9904-346c3014f94e service glance] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:33:20.897438 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c1a485-0147-4da5-9904-346c3014f94e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:33:20.899443 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-66c1a485-0147-4da5-9904-346c3014f94e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:33:20.934853 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c1a485-0147-4da5-9904-346c3014f94e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:33:20.936266 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c1a485-0147-4da5-9904-346c3014f94e service glance] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:33:20.948186 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4506/8984] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:33:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:33:25.354171 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33da41bb-7c69-4b44-928d-c4d4676824d7 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:33:25.354667 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33da41bb-7c69-4b44-928d-c4d4676824d7 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:33:25.354757 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33da41bb-7c69-4b44-928d-c4d4676824d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:33:25.372618 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-33da41bb-7c69-4b44-928d-c4d4676824d7 None None] MFA Rules not processed for user `17b779a3e21a415bb42cde5d6863d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:33:25.373791 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-33da41bb-7c69-4b44-928d-c4d4676824d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:33:25.432900 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4479/8985] 10.222.0.17 () {58 vars in 1009 bytes} [Sat Jul 23 22:33:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:33:25.484153 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c1a485-0147-4da5-9904-346c3014f94e service glance] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:33:25.485788 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-66c1a485-0147-4da5-9904-346c3014f94e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:33:25.558462 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c1a485-0147-4da5-9904-346c3014f94e service glance] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:33:25.565020 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3baf00-ff12-47db-8967-6bfb6582fefb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f0a685b7da46afb81024848f079d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:33:25.565668 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3baf00-ff12-47db-8967-6bfb6582fefb service swift] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:33:25.565977 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3baf00-ff12-47db-8967-6bfb6582fefb service swift] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:33:25.566252 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3baf00-ff12-47db-8967-6bfb6582fefb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:33:25.575332 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3baf00-ff12-47db-8967-6bfb6582fefb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:33:25.576897 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3baf00-ff12-47db-8967-6bfb6582fefb service swift] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:33:25.585677 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4507/8986] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 23 22:33:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 23 22:33:34.708953 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638674f7-7f70-44d4-a971-e7e4d270fce3 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:33:34.709495 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638674f7-7f70-44d4-a971-e7e4d270fce3 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:33:34.709602 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638674f7-7f70-44d4-a971-e7e4d270fce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:33:34.730218 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-638674f7-7f70-44d4-a971-e7e4d270fce3 None None] MFA Rules not processed for user `94052639b2b5416aa2cd97854deae6b2`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:33:34.731439 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-638674f7-7f70-44d4-a971-e7e4d270fce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:33:34.739655 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4480/8987] 10.222.0.17 () {58 vars in 957 bytes} [Sat Jul 23 22:33:34 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:33:35.388943 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3baf00-ff12-47db-8967-6bfb6582fefb service swift] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:33:35.400522 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3baf00-ff12-47db-8967-6bfb6582fefb service swift] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:33:35.406973 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9422b8b5-7442-4119-85cf-ea2d37e16108 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc719a3b3ac4461b82ca04ab6451d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:33:35.407634 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9422b8b5-7442-4119-85cf-ea2d37e16108 service placement] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:33:35.407940 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9422b8b5-7442-4119-85cf-ea2d37e16108 service placement] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:33:35.408180 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9422b8b5-7442-4119-85cf-ea2d37e16108 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:33:35.410239 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-9422b8b5-7442-4119-85cf-ea2d37e16108 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:33:35.438817 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9422b8b5-7442-4119-85cf-ea2d37e16108 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:33:35.440447 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9422b8b5-7442-4119-85cf-ea2d37e16108 service placement] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:33:35.451323 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4508/8988] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:33:35 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:33:36.611606 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a65e92c-4e99-49d0-940f-f3e36a643d26 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:33:36.612107 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a65e92c-4e99-49d0-940f-f3e36a643d26 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:33:36.612199 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a65e92c-4e99-49d0-940f-f3e36a643d26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:33:36.630941 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-5a65e92c-4e99-49d0-940f-f3e36a643d26 None None] MFA Rules not processed for user `17b779a3e21a415bb42cde5d6863d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:33:36.632146 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-5a65e92c-4e99-49d0-940f-f3e36a643d26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:33:36.639468 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4481/8989] 10.222.0.17 () {58 vars in 1009 bytes} [Sat Jul 23 22:33:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:33:36.651663 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9422b8b5-7442-4119-85cf-ea2d37e16108 service placement] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:33:36.663001 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9422b8b5-7442-4119-85cf-ea2d37e16108 service placement] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:33:36.668042 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664e7c58-959d-4fd6-9e66-9bc5c8f6b05b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f0a685b7da46afb81024848f079d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:33:36.668699 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664e7c58-959d-4fd6-9e66-9bc5c8f6b05b service swift] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:33:36.668971 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664e7c58-959d-4fd6-9e66-9bc5c8f6b05b service swift] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:33:36.669237 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664e7c58-959d-4fd6-9e66-9bc5c8f6b05b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:33:36.678044 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664e7c58-959d-4fd6-9e66-9bc5c8f6b05b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:33:36.679692 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664e7c58-959d-4fd6-9e66-9bc5c8f6b05b service swift] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:33:36.688268 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4509/8990] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 23 22:33:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 23 22:33:46.625716 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=31 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:33:46.684833 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=94 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:34:21.781673 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a65e92c-4e99-49d0-940f-f3e36a643d26 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:34:21.802539 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a65e92c-4e99-49d0-940f-f3e36a643d26 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:34:21.806822 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecce872-512c-4368-bf93-3fad276c99f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c497326ee890462e8f48b4a56f81990c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:34:21.807483 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecce872-512c-4368-bf93-3fad276c99f5 service neutron] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:34:21.807768 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecce872-512c-4368-bf93-3fad276c99f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:34:21.808064 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecce872-512c-4368-bf93-3fad276c99f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:34:21.810145 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-3ecce872-512c-4368-bf93-3fad276c99f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:34:21.824134 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecce872-512c-4368-bf93-3fad276c99f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:34:21.825619 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecce872-512c-4368-bf93-3fad276c99f5 service neutron] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:34:21.833827 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4482/8991] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:34:21 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:34:31.830578 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=10 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:34:42.258572 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664e7c58-959d-4fd6-9e66-9bc5c8f6b05b service swift] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:34:42.270663 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664e7c58-959d-4fd6-9e66-9bc5c8f6b05b service swift] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:34:42.276861 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a75b418-042e-4b25-9da3-a49cf576a5b9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc719a3b3ac4461b82ca04ab6451d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:34:42.277502 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a75b418-042e-4b25-9da3-a49cf576a5b9 service placement] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:34:42.277775 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a75b418-042e-4b25-9da3-a49cf576a5b9 service placement] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:34:42.278079 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a75b418-042e-4b25-9da3-a49cf576a5b9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:34:42.280017 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-4a75b418-042e-4b25-9da3-a49cf576a5b9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:34:42.292816 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a75b418-042e-4b25-9da3-a49cf576a5b9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:34:42.294429 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a75b418-042e-4b25-9da3-a49cf576a5b9 service placement] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:34:42.305104 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4510/8992] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:34:42 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:34:52.300665 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=6 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:35:08.050354 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecce872-512c-4368-bf93-3fad276c99f5 service neutron] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:35:08.052055 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-3ecce872-512c-4368-bf93-3fad276c99f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:35:08.068642 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecce872-512c-4368-bf93-3fad276c99f5 service neutron] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:35:08.075330 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a21a753-48ae-4fd1-8940-70a0096af5db service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc719a3b3ac4461b82ca04ab6451d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:35:08.075975 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a21a753-48ae-4fd1-8940-70a0096af5db service placement] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:35:08.076256 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a21a753-48ae-4fd1-8940-70a0096af5db service placement] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:35:08.076590 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a21a753-48ae-4fd1-8940-70a0096af5db service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:35:08.078537 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-1a21a753-48ae-4fd1-8940-70a0096af5db service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:35:08.090053 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a21a753-48ae-4fd1-8940-70a0096af5db service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:35:08.091696 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a21a753-48ae-4fd1-8940-70a0096af5db service placement] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:35:08.101724 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4483/8993] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:35:08 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:35:18.098029 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=6 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:35:26.089518 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee166698-c792-453b-83b8-f83e71a83596 None None] REQUEST_METHOD: `POST` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:35:26.090074 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee166698-c792-453b-83b8-f83e71a83596 None None] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:35:26.090188 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee166698-c792-453b-83b8-f83e71a83596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:35:26.109632 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.auth.core [None req-ee166698-c792-453b-83b8-f83e71a83596 None None] MFA Rules not processed for user `17b779a3e21a415bb42cde5d6863d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=91548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:35:26.111137 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-ee166698-c792-453b-83b8-f83e71a83596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:35:26.120577 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4511/8994] 10.222.0.17 () {58 vars in 1009 bytes} [Sat Jul 23 22:35:26 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:35:26.162216 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a21a753-48ae-4fd1-8940-70a0096af5db service placement] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:35:26.174009 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a21a753-48ae-4fd1-8940-70a0096af5db service placement] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:35:26.179224 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c3d83e-c454-4e74-ba6e-f7cb50b48dcd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f0a685b7da46afb81024848f079d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:35:26.179915 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c3d83e-c454-4e74-ba6e-f7cb50b48dcd service swift] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:35:26.180194 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c3d83e-c454-4e74-ba6e-f7cb50b48dcd service swift] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:35:26.180462 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c3d83e-c454-4e74-ba6e-f7cb50b48dcd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:35:26.189919 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c3d83e-c454-4e74-ba6e-f7cb50b48dcd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:35:26.191546 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c3d83e-c454-4e74-ba6e-f7cb50b48dcd service swift] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:35:26.201057 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4484/8995] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 23 22:35:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 23 22:35:28.104729 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee166698-c792-453b-83b8-f83e71a83596 None None] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:35:28.119183 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee166698-c792-453b-83b8-f83e71a83596 None None] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:35:28.125811 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bdc66b-e6fb-4446-9ea8-9feb64de8dde service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:35:28.126861 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bdc66b-e6fb-4446-9ea8-9feb64de8dde service nova] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:35:28.127262 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bdc66b-e6fb-4446-9ea8-9feb64de8dde service nova] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:35:28.127775 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bdc66b-e6fb-4446-9ea8-9feb64de8dde service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:35:28.130005 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-11bdc66b-e6fb-4446-9ea8-9feb64de8dde service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:35:28.143781 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bdc66b-e6fb-4446-9ea8-9feb64de8dde service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:35:28.145949 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bdc66b-e6fb-4446-9ea8-9feb64de8dde service nova] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:35:28.158205 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4512/8996] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:35:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 23 22:35:35.543673 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef33056-42a4-45ef-b8e5-2471407f5627 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:35:35.544201 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef33056-42a4-45ef-b8e5-2471407f5627 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:35:35.544201 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef33056-42a4-45ef-b8e5-2471407f5627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:35:35.562891 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-9ef33056-42a4-45ef-b8e5-2471407f5627 None None] MFA Rules not processed for user `17b779a3e21a415bb42cde5d6863d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:35:35.564090 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-9ef33056-42a4-45ef-b8e5-2471407f5627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:35:35.572320 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4485/8997] 10.222.0.17 () {58 vars in 967 bytes} [Sat Jul 23 22:35:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:35:35.584496 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bdc66b-e6fb-4446-9ea8-9feb64de8dde service nova] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:35:35.596671 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bdc66b-e6fb-4446-9ea8-9feb64de8dde service nova] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:35:35.603140 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad03da5-282c-47a1-8a13-f7836389044a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f0a685b7da46afb81024848f079d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:35:35.603805 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad03da5-282c-47a1-8a13-f7836389044a service swift] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:35:35.604055 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad03da5-282c-47a1-8a13-f7836389044a service swift] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:35:35.604333 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad03da5-282c-47a1-8a13-f7836389044a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:35:35.613199 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad03da5-282c-47a1-8a13-f7836389044a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:35:35.614787 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad03da5-282c-47a1-8a13-f7836389044a service swift] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:35:35.623231 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4513/8998] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 23 22:35:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 23 22:35:40.503569 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7e17b0-5164-4710-b52e-4e81aca7ad83 None None] REQUEST_METHOD: `POST` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:35:40.504053 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7e17b0-5164-4710-b52e-4e81aca7ad83 None None] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:35:40.504170 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7e17b0-5164-4710-b52e-4e81aca7ad83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:35:40.522909 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.auth.core [None req-0b7e17b0-5164-4710-b52e-4e81aca7ad83 None None] MFA Rules not processed for user `17b779a3e21a415bb42cde5d6863d9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=91547) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 23 22:35:40.524120 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-0b7e17b0-5164-4710-b52e-4e81aca7ad83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:35:40.532580 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4486/8999] 10.222.0.17 () {58 vars in 967 bytes} [Sat Jul 23 22:35:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 23 22:35:40.545115 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad03da5-282c-47a1-8a13-f7836389044a service swift] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:35:40.555809 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad03da5-282c-47a1-8a13-f7836389044a service swift] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:35:40.561145 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd920aa5-9466-4111-ba11-37ec74005739 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f0a685b7da46afb81024848f079d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:35:40.561806 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd920aa5-9466-4111-ba11-37ec74005739 service swift] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:35:40.562114 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd920aa5-9466-4111-ba11-37ec74005739 service swift] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:35:40.562386 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd920aa5-9466-4111-ba11-37ec74005739 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:35:40.570684 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd920aa5-9466-4111-ba11-37ec74005739 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:35:40.572807 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd920aa5-9466-4111-ba11-37ec74005739 service swift] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:35:40.581513 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4514/9000] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Jul 23 22:35:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 23 22:35:42.023231 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7e17b0-5164-4710-b52e-4e81aca7ad83 None None] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:35:42.036989 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7e17b0-5164-4710-b52e-4e81aca7ad83 None None] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:35:42.043708 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0008e704-d3d5-47e3-90c9-0b3eb51ae001 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079f31ed2c844e67bd4e206f24b69d97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:35:42.044395 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0008e704-d3d5-47e3-90c9-0b3eb51ae001 service nova] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:35:42.045157 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0008e704-d3d5-47e3-90c9-0b3eb51ae001 service nova] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:35:42.045157 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0008e704-d3d5-47e3-90c9-0b3eb51ae001 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:35:42.046994 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-0008e704-d3d5-47e3-90c9-0b3eb51ae001 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:35:42.060398 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0008e704-d3d5-47e3-90c9-0b3eb51ae001 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:35:42.062266 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0008e704-d3d5-47e3-90c9-0b3eb51ae001 service nova] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:35:42.075354 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4487/9001] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:35:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:35:50.577918 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=21 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:35:52.069656 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=18 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:35:52.440958 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd920aa5-9466-4111-ba11-37ec74005739 service swift] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:35:52.505762 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd920aa5-9466-4111-ba11-37ec74005739 service swift] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:35:52.511786 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b0cbca-b553-452a-9a51-163eb2a89603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:35:52.512706 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b0cbca-b553-452a-9a51-163eb2a89603 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:35:52.512986 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b0cbca-b553-452a-9a51-163eb2a89603 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:35:52.513237 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b0cbca-b553-452a-9a51-163eb2a89603 admin admin] PATH_INFO: `/v3/users/94052639b2b5416aa2cd97854deae6b2` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:35:52.514584 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b0cbca-b553-452a-9a51-163eb2a89603 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94052639b2b5416aa2cd97854deae6b2)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:35:52.516516 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b0cbca-b553-452a-9a51-163eb2a89603 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:35:52.564533 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-e7b0cbca-b553-452a-9a51-163eb2a89603 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94052639b2b5416aa2cd97854deae6b2'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:35:52.565093 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-e7b0cbca-b553-452a-9a51-163eb2a89603 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94052639b2b5416aa2cd97854deae6b2'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:35:52.572482 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-e7b0cbca-b553-452a-9a51-163eb2a89603 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94052639b2b5416aa2cd97854deae6b2'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:35:52.580227 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-e7b0cbca-b553-452a-9a51-163eb2a89603 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94052639b2b5416aa2cd97854deae6b2'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:35:52.592401 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-e7b0cbca-b553-452a-9a51-163eb2a89603 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94052639b2b5416aa2cd97854deae6b2'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:35:52.598323 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4515/9002] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 22:35:52 2022] DELETE /identity/v3/users/94052639b2b5416aa2cd97854deae6b2 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:35:52.775500 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0008e704-d3d5-47e3-90c9-0b3eb51ae001 service nova] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:35:52.795262 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0008e704-d3d5-47e3-90c9-0b3eb51ae001 service nova] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:35:52.859437 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41893d7f-3e02-4ff1-86bc-7df4e915c642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:35:52.860329 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41893d7f-3e02-4ff1-86bc-7df4e915c642 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:35:52.860614 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41893d7f-3e02-4ff1-86bc-7df4e915c642 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:35:52.860889 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41893d7f-3e02-4ff1-86bc-7df4e915c642 admin admin] PATH_INFO: `/v3/projects/4ab318d1c967420cbac48456436e90c5` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:35:52.862152 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41893d7f-3e02-4ff1-86bc-7df4e915c642 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ab318d1c967420cbac48456436e90c5)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:35:52.864082 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41893d7f-3e02-4ff1-86bc-7df4e915c642 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:35:52.910359 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-41893d7f-3e02-4ff1-86bc-7df4e915c642 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ab318d1c967420cbac48456436e90c5', 'request_id': 'req-41893d7f-3e02-4ff1-86bc-7df4e915c642'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:35:52.918338 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-41893d7f-3e02-4ff1-86bc-7df4e915c642 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ab318d1c967420cbac48456436e90c5', 'request_id': 'req-41893d7f-3e02-4ff1-86bc-7df4e915c642'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:35:52.924840 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-41893d7f-3e02-4ff1-86bc-7df4e915c642 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ab318d1c967420cbac48456436e90c5', 'request_id': 'req-41893d7f-3e02-4ff1-86bc-7df4e915c642'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:35:52.936434 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-41893d7f-3e02-4ff1-86bc-7df4e915c642 admin admin] The token cache is being invalidate because project 4ab318d1c967420cbac48456436e90c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 22:35:52.936701 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-41893d7f-3e02-4ff1-86bc-7df4e915c642 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:35:52.937422 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-41893d7f-3e02-4ff1-86bc-7df4e915c642 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:35:52.939127 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4488/9003] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 22:35:52 2022] DELETE /identity/v3/projects/4ab318d1c967420cbac48456436e90c5 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:35:52.944324 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b0cbca-b553-452a-9a51-163eb2a89603 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:35:52.946305 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-e7b0cbca-b553-452a-9a51-163eb2a89603 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:35:52.961187 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b0cbca-b553-452a-9a51-163eb2a89603 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:35:53.022645 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468a59c6-9c54-4e02-a76c-8fc3f1a98d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:35:53.023563 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468a59c6-9c54-4e02-a76c-8fc3f1a98d57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:35:53.023845 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468a59c6-9c54-4e02-a76c-8fc3f1a98d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:35:53.024103 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468a59c6-9c54-4e02-a76c-8fc3f1a98d57 admin admin] PATH_INFO: `/v3/users/b408683cdedb499885d100aa8ecedd0f` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:35:53.025350 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468a59c6-9c54-4e02-a76c-8fc3f1a98d57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b408683cdedb499885d100aa8ecedd0f)` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:35:53.027311 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468a59c6-9c54-4e02-a76c-8fc3f1a98d57 admin admin] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:35:53.048868 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:35:53.074803 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-468a59c6-9c54-4e02-a76c-8fc3f1a98d57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b408683cdedb499885d100aa8ecedd0f'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:35:53.075376 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-468a59c6-9c54-4e02-a76c-8fc3f1a98d57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b408683cdedb499885d100aa8ecedd0f'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:35:53.082217 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-468a59c6-9c54-4e02-a76c-8fc3f1a98d57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b408683cdedb499885d100aa8ecedd0f'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:35:53.092044 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-468a59c6-9c54-4e02-a76c-8fc3f1a98d57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b408683cdedb499885d100aa8ecedd0f'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:35:53.105738 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.notifications [None req-468a59c6-9c54-4e02-a76c-8fc3f1a98d57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b408683cdedb499885d100aa8ecedd0f'} {{(pid=91548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:35:53.111838 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4516/9004] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 22:35:52 2022] DELETE /identity/v3/users/b408683cdedb499885d100aa8ecedd0f => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:35:53.293552 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41893d7f-3e02-4ff1-86bc-7df4e915c642 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:35:53.295065 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-41893d7f-3e02-4ff1-86bc-7df4e915c642 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:35:53.308342 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41893d7f-3e02-4ff1-86bc-7df4e915c642 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:35:53.370075 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f091c7dd-ce54-4e19-bbcb-98896db9ff40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef460ef8c739443881697a7ad53288a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6f3124c18f04946a431e587fc205bd4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:35:53.370877 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f091c7dd-ce54-4e19-bbcb-98896db9ff40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:35:53.371154 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f091c7dd-ce54-4e19-bbcb-98896db9ff40 admin admin] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:35:53.371422 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f091c7dd-ce54-4e19-bbcb-98896db9ff40 admin admin] PATH_INFO: `/v3/projects/f7f4c7e1788c4241a080ebeefdaa9a9e` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:35:53.372643 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f091c7dd-ce54-4e19-bbcb-98896db9ff40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7f4c7e1788c4241a080ebeefdaa9a9e)` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:35:53.374599 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f091c7dd-ce54-4e19-bbcb-98896db9ff40 admin admin] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:35:53.412250 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:35:53.426888 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-f091c7dd-ce54-4e19-bbcb-98896db9ff40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7f4c7e1788c4241a080ebeefdaa9a9e', 'request_id': 'req-f091c7dd-ce54-4e19-bbcb-98896db9ff40'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:35:53.435790 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-f091c7dd-ce54-4e19-bbcb-98896db9ff40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7f4c7e1788c4241a080ebeefdaa9a9e', 'request_id': 'req-f091c7dd-ce54-4e19-bbcb-98896db9ff40'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:35:53.441455 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-f091c7dd-ce54-4e19-bbcb-98896db9ff40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7f4c7e1788c4241a080ebeefdaa9a9e', 'request_id': 'req-f091c7dd-ce54-4e19-bbcb-98896db9ff40'} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:35:53.452762 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-f091c7dd-ce54-4e19-bbcb-98896db9ff40 admin admin] The token cache is being invalidate because project f7f4c7e1788c4241a080ebeefdaa9a9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91547) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 23 22:35:53.453046 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-f091c7dd-ce54-4e19-bbcb-98896db9ff40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:35:53.453680 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.notifications [None req-f091c7dd-ce54-4e19-bbcb-98896db9ff40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91547) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 23 22:35:53.455265 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4489/9005] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 22:35:53 2022] DELETE /identity/v3/projects/f7f4c7e1788c4241a080ebeefdaa9a9e => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 23 22:36:03.108330 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:DELETE=7,keystone:SELECT=20,keystone:INSERT=1 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:36:03.449975 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=12,keystone:DELETE=5,keystone:INSERT=1 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:39:48.265510 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468a59c6-9c54-4e02-a76c-8fc3f1a98d57 admin admin] Authenticating user token {{(pid=91548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:39:48.267110 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-468a59c6-9c54-4e02-a76c-8fc3f1a98d57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:39:48.351913 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468a59c6-9c54-4e02-a76c-8fc3f1a98d57 admin admin] Validating token access rules against request {{(pid=91548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:39:48.412609 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db80d734-74c1-4f5f-9049-cdfc45b4264c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc719a3b3ac4461b82ca04ab6451d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:39:48.413254 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db80d734-74c1-4f5f-9049-cdfc45b4264c service placement] REQUEST_METHOD: `GET` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:39:48.413532 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db80d734-74c1-4f5f-9049-cdfc45b4264c service placement] SCRIPT_NAME: `/identity` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:39:48.413799 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db80d734-74c1-4f5f-9049-cdfc45b4264c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:39:48.415739 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.fernet_utils [None req-db80d734-74c1-4f5f-9049-cdfc45b4264c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:39:48.426750 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db80d734-74c1-4f5f-9049-cdfc45b4264c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:39:48.428307 ncdv-master-1 devstack@keystone.service[91548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db80d734-74c1-4f5f-9049-cdfc45b4264c service placement] RBAC: Authorization granted {{(pid=91548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:39:48.438148 ncdv-master-1 devstack@keystone.service[91548]: [pid: 91548|app: 0|req: 4517/9006] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:39:48 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:39:58.434314 ncdv-master-1 devstack@keystone.service[91548]: DEBUG dbcounter [-] [91548] Writing DB stats keystone:SELECT=62 {{(pid=91548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:40:13.038689 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f091c7dd-ce54-4e19-bbcb-98896db9ff40 admin admin] Authenticating user token {{(pid=91547) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 23 22:40:13.041132 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-f091c7dd-ce54-4e19-bbcb-98896db9ff40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:40:13.059758 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f091c7dd-ce54-4e19-bbcb-98896db9ff40 admin admin] Validating token access rules against request {{(pid=91547) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 23 22:40:13.066315 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9258977a-5cd6-4e0a-b067-890dca7c74d4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc719a3b3ac4461b82ca04ab6451d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4804ed61295f4d4a92d9b685dd9e9f3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91547) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 23 22:40:13.067436 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9258977a-5cd6-4e0a-b067-890dca7c74d4 service placement] REQUEST_METHOD: `GET` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 23 22:40:13.067713 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9258977a-5cd6-4e0a-b067-890dca7c74d4 service placement] SCRIPT_NAME: `/identity` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 23 22:40:13.067969 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9258977a-5cd6-4e0a-b067-890dca7c74d4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91547) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 23 22:40:13.070093 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.fernet_utils [None req-9258977a-5cd6-4e0a-b067-890dca7c74d4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91547) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 23 22:40:13.082680 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9258977a-5cd6-4e0a-b067-890dca7c74d4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 23 22:40:13.084191 ncdv-master-1 devstack@keystone.service[91547]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9258977a-5cd6-4e0a-b067-890dca7c74d4 service placement] RBAC: Authorization granted {{(pid=91547) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 23 22:40:13.094407 ncdv-master-1 devstack@keystone.service[91547]: [pid: 91547|app: 0|req: 4490/9007] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Jul 23 22:40:13 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 23 22:40:23.090370 ncdv-master-1 devstack@keystone.service[91547]: DEBUG dbcounter [-] [91547] Writing DB stats keystone:SELECT=6 {{(pid=91547) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}